summaryrefslogtreecommitdiffhomepage
diff options
context:
space:
mode:
authorZach Koopmans <zkoopmans@google.com>2021-03-23 10:08:56 -0700
committergVisor bot <gvisor-bot@google.com>2021-03-23 10:11:26 -0700
commit98f378d9efaa6d9d494ad7661eca43df1f0d3ac0 (patch)
treeb4fd4c2982b0f0df95534c49ccb39d9dc45b5695
parent409a11445442488ec7e0397372a673910062fa5f (diff)
Split fio read/write and randread/randwrite operations
The fio benchmark was changed to a fixed size read/write ammount because the timed benchmark was overwhelming machine memory on tmpfs mounts. Now rand(read|write) operations are prohibitively long, leading to timeouts. Split the benchmarks as they were in python bm-tools: the read/write as fixed sized (1GB) and the rand(read|write) as timed operations (15s). PiperOrigin-RevId: 364584436
-rw-r--r--.buildkite/pipeline.yaml8
1 files changed, 6 insertions, 2 deletions
diff --git a/.buildkite/pipeline.yaml b/.buildkite/pipeline.yaml
index 98526dcec..3bc5041c0 100644
--- a/.buildkite/pipeline.yaml
+++ b/.buildkite/pipeline.yaml
@@ -188,8 +188,12 @@ steps:
# but for tmpfs mounts, the size can grow to more memory than the machine
# has availabe. Fix the runs to 1GB written/read for the benchmark.
- <<: *benchmarks
- label: ":floppy_disk: FIO benchmarks"
- command: make benchmark-platforms BENCHMARKS_SUITE=fio BENCHMARKS_TARGETS=test/benchmarks/fs:fio_test BENCHMARKS_OPTIONS=--test.benchtime=1000x
+ label: ":floppy_disk: FIO benchmarks (read/write)"
+ command: make benchmark-platforms BENCHMARKS_SUITE=fio BENCHMARKS_TARGETS=test/benchmarks/fs:fio_test BENCHMARKS_FILTER=Fio/operation\.[rw][er] BENCHMARKS_OPTIONS=--test.benchtime=1000x
+ # For rand(read|write) fio benchmarks, running 15s does not overwhelm the system for tmpfs mounts.
+ - <<: *benchmarks
+ label: ":cd: FIO benchmarks (randread/randwrite)"
+ command: make benchmark-platforms BENCHMARKS_SUITE=fio BENCHMARKS_TARGETS=test/benchmarks/fs:fio_test BENCHMARKS_FILTER=Fio/operation\.rand BENCHMARKS_OPTIONS=--test.benchtime=15s
- <<: *benchmarks
label: ":globe_with_meridians: HTTPD benchmarks"
command: make benchmark-platforms BENCHMARKS_FILTER="Continuous" BENCHMARKS_SUITE=httpd BENCHMARKS_TARGETS=test/benchmarks/network:httpd_test