Repository navigation
chore(deps): update rust crate divan to v6 - #10785
Conversation
Merging this PR will degrade performance by 2.34%3 warnings, 1 note
🎉 Hooray!
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | CPU Simulation | from_bool_slice[1024] |
3.3 µs | 19 µs | -82.44% |
| ❌ | CPU Simulation | ScalarBuffer<i32>>, 128] |
3.7 µs | 19.1 µs | -80.45% |
| ❌ | CPU Simulation | from_iter_bit_buffer[1024] |
7.2 µs | 22.4 µs | -67.75% |
| ❌ | CPU Simulation | from_iter[Buffer<i32>, 128] |
6.9 µs | 20.5 µs | -66.24% |
| ❌ | CPU Simulation | filter_run_end[len=4096_run=16_density=0.9] |
53.9 µs | 156.5 µs | -65.57% |
| ❌ | CPU Simulation | filter_run_end[len=4096_run=16_density=0.5] |
53.9 µs | 156.4 µs | -65.55% |
| ❌ | CPU Simulation | execute_mask_then_value[1024] |
15.6 µs | 41.2 µs | -62.17% |
| ❌ | CPU Simulation | ScalarBuffer<i32>>, 1024] |
9 µs | 22 µs | -58.95% |
| ❌ | CPU Simulation | from_iter_bit_buffer[2048] |
10.4 µs | 25.1 µs | -58.69% |
| ❌ | CPU Simulation | from_iter[Buffer<i32>, 1024] |
10.6 µs | 23.5 µs | -54.92% |
| ❌ | CPU Simulation | ScalarBuffer<i32>>, 2048] |
13.5 µs | 26.4 µs | -48.82% |
| ❌ | CPU Simulation | from_iter[Buffer<i32>, 2048] |
14.7 µs | 27.6 µs | -46.79% |
| ❌ | CPU Simulation | decode_bool[10000_1000_all_false] |
14.5 µs | 26.8 µs | -45.77% |
| ❌ | CPU Simulation | decode_bool[10000_1000_all_true] |
14.5 µs | 26.8 µs | -45.77% |
| ❌ | CPU Simulation | decode_bool[10000_1000_mostly_true] |
14.6 µs | 26.8 µs | -45.57% |
| ❌ | CPU Simulation | decode_bool[10000_1000_alternating] |
14.6 µs | 26.8 µs | -45.57% |
| ❌ | CPU Simulation | decode_bool[10000_1000_mostly_false] |
14.6 µs | 26.8 µs | -45.57% |
| ❌ | CPU Simulation | filter_all_true[100000] |
12.3 µs | 22.2 µs | -44.39% |
| ❌ | CPU Simulation | filter_all_true[10000] |
12.4 µs | 22.2 µs | -44.26% |
| ❌ | CPU Simulation | decompress[u8, (1000, 256)] |
27.7 µs | 49.7 µs | -44.2% |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing renovate/divan-6.x (e8fd8ca) with develop (910f993)
Footnotes
-
12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
robert3005
left a comment
There was a problem hiding this comment.
Your Divan and Criterion benchmarks now run in separate processes. Changes to one benchmark no longer carry allocator state into the benchmarks that follow it, improving consistency as your benchmark suite evolves.
Early results showed lower run-to-run variance, with roughly 70% fewer benchmarks varying by more than 1%.
No benchmark code changes required. Your WallTime results are unaffected.
…#10796) ## Summary `codspeed` 6.0.0 (#10784, #10785) adds process isolation, which is on by default. `codspeed-divan-compat` now runs each benchmark in a new copy of the benchmark binary. Simulation mode measures one iteration without warmup, so each benchmark also pays for allocator setup (mimalloc) and for simulated cache misses on memory it touches for the first time. Before, an earlier benchmark in the same process had already paid these costs. The CodSpeed report on #10785 shows a near-constant ~15 µs added to short benchmarks.
This PR contains the following updates:
5.0.0→6.0.0Warning
Some dependencies could not be looked up. Check the Dependency Dashboard for more information.
Release Notes
CodSpeedHQ/codspeed-rust (divan)
v6.0.0Compare Source
CodSpeed for Rust 6.0.0 removes a source of measurement noise from your CPU Simulation benchmarks, so you can spend less time investigating unexpected changes in unrelated results.
Highlights
Your Divan and Criterion benchmarks now run in separate processes. Changes to one benchmark no longer carry allocator state into the benchmarks that follow it, improving consistency as your benchmark suite evolves.
Early results showed lower run-to-run variance, with roughly 70% fewer benchmarks varying by more than 1%.
No benchmark code changes required. Your WallTime results are unaffected.
Breaking Changes
Set
CODSPEED_PROCESS_ISOLATION=falseto revert to the previous behavior.What's Changed
Full Changelog: CodSpeedHQ/codspeed-rust@v5.0.3...v6.0.0
Configuration
📅 Schedule: (UTC)
* 0-3 * * 1#2,1#4)🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.