Repository navigation
Refresh CodSpeed simulation counts and timings - #11231
Conversation
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
|
shard timings were:
We could add build time to this if we wanted... anyways @joseph-isaacs since there are less benchmarks now (14 min total) we can reduce to 4 shards if you want. maybe 3, up to you |
Merging this PR will improve performance by 21.72%1 warning
Performance Changes
Tip Curious why performance improved? Comment Comparing Footnotes
|
Summary
The snapshot used by #11180 predates the benchmark cleanup merges, so it overestimates simulation counts and target runtimes. Refresh both snapshots from the five successful simulation shards in develop run 41869576169 at
141abdc590.Note that these are just heuristics, so this will never affect correctness / running of benchmarks.
Changes
Recorded simulation cases fall from 1,869 to 1,408, and total target execution time falls from 711s to 400s. The refreshed plan estimates 83-84s for each regular shard and 65s for the allocation-excluded shard. These are target execution estimates, not full CI job times.
Verified complete measurements for all 129 targets, exact target coverage, the 800-benchmark cap, and allocation-mode separation. The planner and
git diff --checkpassed. No local tests or benchmarks were run. The pre-commit and pre-push hooks were bypassed as requested.