Skip to content

Choose the scan version per benchmark in the bench orchestrator - #11049

Merged
joseph-isaacs merged 2 commits into
developfrom
ji/vibrant-clarke-5b971d
Oct 30, 2026
Merged

joseph-isaacs merged 2 commits into
developfrom
ji/vibrant-clarke-5b971d

List the Vortex scan version of every benchmark

af654ec
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis failed Oct 30, 2026 in 0s

Performance Regression: -17.95%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 1 improved benchmark
❌ 4 regressed benchmarks
✅ 2313 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime filter_neon[64] 1.9 µs 2.8 µs -34.34%
❌ Walltime threshold_neon[64] 2.6 µs 3.4 µs -24.84%
❌ Walltime filter_neon[80] 2.5 µs 3.2 µs -20.88%
❌ Walltime threshold_neon[80] 3.4 µs 4.1 µs -15.45%
⚡ Walltime lt_i64_nullable_avx512 8.3 µs 7.4 µs +12.66%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/vibrant-clarke-5b971d (af654ec) with develop (37d9e8e)

Open in CodSpeed