Commit graph

18 commits

Author SHA1 Message Date
Joe Onorato
b9ff8e4205 add csv output to format_benchmarks
Test: format_benchmarks --csv
Bug: 316189534
Change-Id: I9a19861ed1ca6249c6e6ddbed0fcf9574f871d93
2024-05-20 14:23:00 -07:00
Joe Onorato
159cc8c594 The lunch benchmarks don't have targets, so don't fail.
Bug: 316189534
Test: format_benchmarks
Change-Id: I5b37a99624801a9c8d5f43ded788c8f0721b45f8
2024-05-18 07:58:24 -07:00
Yu Liu
473bb051c1 Fix the changing public api CUJ failure.
Bug: 318706915
Test: ABTD
Change-Id: I7de7ed5a0d1e805fa32d2c9bb1f632e107c6c31e
2024-02-13 23:46:06 +00:00
Liz Kammer
0b7bdeeb9b Store metrics for each run of a benchmark.
Enables a breakdown to understand where time is being spent on each CUJ.

Test: run ./build/make/tools/perf/benchmarks --store-metrics
Change-Id: I28f3f62b2b2c1fd810ecce9238c7177c1eb382d7
2024-01-31 09:49:47 -05:00
Liz Kammer
efb6650d45 Add benchmarks for lunch
Test: ./benchmarks --benchmark full_lunch
Change-Id: Id6be3b41a518d4ca9cad882a913f1dcc59f0d01a
2024-01-31 09:46:05 -05:00
Liz Kammer
864dd43c07 Update benchmarks to handle cog workflows
Test: run ./build/make/tools/benchmarks in a cog workspace
Change-Id: I421d1d08b4e90a79b8416486025229d4f3263fbe
2024-01-29 14:13:57 -05:00
Liz Kammer
f67a6e8114 Fix doing preroll for postroll
Test: ./build/make/tools/perf/benchmarks
Change-Id: Ib64ddd53ea9234dc2934fd6dea988add02729d29
2024-01-29 14:09:43 -05:00
Treehugger Robot
1094ec1e81 Merge "Add the rebuilt modules to the benchmark formatting" into main 2024-01-19 17:38:02 +00:00
Joe Onorato
6b40826d2e Add the rebuilt modules to the benchmark formatting
Test: format_benchmarks
Change-Id: Ib3fffc99a1c66a2f700c27821886e8de2e2ec041
2024-01-19 16:41:27 +00:00
Yu Liu
cda84245af Tweak the CUJ scripts to make it work in CI.
Bug: 318706915
Test: manual test
Change-Id: I0982d1d724ec05aee7a0d6bdaa05497745421674
2024-01-18 00:35:13 +00:00
Yu Liu
c6576ad307 Properly report failures in the CUJ scripts
Bug: 318706915
Test: manual test
Change-Id: I25dc7908f354c09cb829070e6de86f6cdfa38dab
2024-01-16 19:27:45 +00:00
Joe Onorato
7eba158c59 Skip metrics upload when doing benchmarks.
metrics-uploader runs asynchronously, and causes a race condition where
the out dir can't be deleted because metrics uploader is busy in it.

Has the side effect of not polluting the local developer metrics with
benchmark runs too.

Test: treehugger
Change-Id: I7953020cd9c69fb10745facd22648f931fc94477
2024-01-03 12:38:55 -08:00
Joe Onorato
519c9dab25 Fix formatting string in benchmark pretty printer
Test: th
Change-Id: I960cfdb897ed140b90caa765b1be6892d2ed208e
2024-01-03 12:37:25 -08:00
Joe Onorato
60c36ade0f dist-one flag should be a boolean, not a string
Test: th
Change-Id: I99a22011518b4a7a7f506b93d6a5ac9c7c4a2ef5
2024-01-02 16:36:31 -08:00
Joe Onorato
67c944b351 Allow filtering and sorting by tag in benchmark result formatting
Test: build/make/tools/perf/format_benchmarks --tags n2d-standard-128 n2-standard-80 n2d-standard-48
Change-Id: Ie4a4e36d4bc2aab50a017acbaf3ef0e23ddae958
2023-12-21 13:29:48 -08:00
Joe Onorato
0543464834 Add --dist-one flag to the benchmark script to make it copy a single set of build metrics to a dist dir.
Change-Id: Id392a33c42fed6c5014b2fd5dd69fa80fa0d9f0f
2023-12-20 05:00:04 +00:00
Joe Onorato
01277d4067 Add the rest of the CUJs to the new benchmark script.
Change-Id: Iabf8875f9d77a3d50a37f6ab1230bc9f473a15dd
2023-12-20 04:00:42 +00:00
Joe Onorato
88ede35828 Rewrite the build system benchmarks to be much simpler and not require bazel.
Test: ./benchmarks && ./format_benchmarks
Change-Id: I907421ed0c85e961d78342a3e58b2d4ab4aaf6ac
2023-12-19 15:39:56 +00:00