Skip to content

bench: run every DataFusion benchmark on the V2 scan - #10977

Closed
joseph-isaacs wants to merge 1 commit into
developfrom
ji/inspiring-heisenberg-p4k61b
Closed

joseph-isaacs wants to merge 1 commit into
developfrom
ji/inspiring-heisenberg-p4k61b

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Until now, datafusion-bench used the planner-driven V2 Vortex scan by default only for TPC-H, TPC-DS and ClickBench. This PR switches every DataFusion benchmark suite to V2 by changing the Python bench orchestrator (vx-bench), which runs the benchmarks both in CI and locally.

Changes

  • BenchmarkExecutor.build_command now passes --scan-v2 true to every datafusion-bench invocation. DuckDB invocations are unchanged.
  • Added executor tests covering the flag for DataFusion and its absence for DuckDB.

Checks run: ruff format --check, ruff check, and pytest bench-orchestrator/tests/test_executor.py (8 passed).


Generated by Claude Code

The orchestrator now passes --scan-v2 true to datafusion-bench, so every
benchmark suite uses the planner-driven V2 Vortex scan rather than only
TPC-H, TPC-DS and ClickBench.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBD1TEu6bod84sjRqAX
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 29, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the changelog/chore A trivial change label Oct 29, 2026 — with Claude
@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done e42f887 random-access-bench 1 Explore Profiling Data
🟢 Done e42f887 fineweb-s3 1 Explore Profiling Data
🟢 Done e42f887 tpch-s3 1 Explore Profiling Data
🟢 Done e42f887 vortex-queries 1 Explore Profiling Data
🟢 Done e42f887 polarsignals 1 Explore Profiling Data
🟢 Done e42f887 compress-bench 1 Explore Profiling Data
🟢 Done e42f887 string-bench 1 Explore Profiling Data
🟢 Done e42f887 statpopgen 1 Explore Profiling Data
🟢 Done e42f887 job-nvme 1 Explore Profiling Data
🟢 Done e42f887 clickbench-nvme 1 Explore Profiling Data
🟢 Done e42f887 tpch-nvme 1 Explore Profiling Data
🟢 Done e42f887 tpcds-nvme 1 Explore Profiling Data
🟢 Done e42f887 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done e42f887 tpch-nvme-10 1 Explore Profiling Data
🟢 Done e42f887 tpch-s3-10 1 Explore Profiling Data
🟢 Done e42f887 appian-nvme 1 Explore Profiling Data
🟢 Done e42f887 fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@codspeed

codspeed Bot commented Oct 29, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 10.49%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 3 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 1 improved benchmark
✅ 2303 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Walltime threshold_avx2[80] 2.9 µs 2.7 µs +10.49%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/inspiring-heisenberg-p4k61b (e42f887) with develop (e4dce8b)

Open in CodSpeed

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR e42f8876 vs base 2a9c7628
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +9.1%
Engines: DataFusion No clear signal (+20.5%, medium confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 1.096x ➖ · cold 1.098x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.026x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.960x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5942124 / 6903610 / -13.9% 🟢 20678930 / 17910056 / +15.5% 🔴 0.29 / 0.39 / -25.5%
fineweb_q01/datafusion:vortex-file-compressed 9739596 / 8689116 / +12.1% 🔴 51512151 / 44097276 / +16.8% 🔴 0.19 / 0.20 / -4.0%
fineweb_q02/datafusion:vortex-file-compressed 11718362 / 10214480 / +14.7% 🔴 50819760 / 51600306 / -1.5% 0.23 / 0.20 / +16.5%
fineweb_q03/datafusion:vortex-file-compressed 17542254 / 19591272 / -10.5% 🟢 116688819 / 107891043 / +8.2% 0.15 / 0.18 / -17.2%
fineweb_q04/datafusion:vortex-file-compressed 65045530 / 66685910 / -2.5% 153451073 / 160241075 / -4.2% 0.42 / 0.42 / +1.9%
fineweb_q05/datafusion:vortex-file-compressed 62171886 / 67421159 / -7.8% 150295653 / 157717787 / -4.7% 0.41 / 0.43 / -3.2%
fineweb_q06/datafusion:vortex-file-compressed 17790591 / 18932958 / -6.0% 120976514 / 114653888 / +5.5% 0.15 / 0.17 / -10.9%
fineweb_q07/datafusion:vortex-file-compressed 17711316 / 18335188 / -3.4% 115773364 / 105325486 / +9.9% 0.15 / 0.17 / -12.1%
fineweb_q08/datafusion:vortex-file-compressed 8754908 / 10204749 / -14.2% 🟢 40787677 / 50634223 / -19.4% 🟢 0.21 / 0.20 / +6.5%
datafusion / vortex-compact / ns (1.510x ❌, 1↑ 8↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6084290 / 7023072 / -13.4% 🟢 21211670 / 17387044 / +22.0% 🔴 0.29 / 0.40 / -29.0%
fineweb_q01/datafusion:vortex-compact 109654037 / 42651379 / +157.1% 🔴 152387321 / 81178200 / +87.7% 🔴 0.72 / 0.53 / +37.0%
fineweb_q02/datafusion:vortex-compact 111530122 / 43764864 / +154.8% 🔴 149404674 / 115724902 / +29.1% 🔴 0.75 / 0.38 / +97.4%
fineweb_q03/datafusion:vortex-compact 192059603 / 166280580 / +15.5% 🔴 295673590 / 223727971 / +32.2% 🔴 0.65 / 0.74 / -12.6%
fineweb_q04/datafusion:vortex-compact 203325660 / 172158084 / +18.1% 🔴 302243637 / 249011083 / +21.4% 🔴 0.67 / 0.69 / -2.7%
fineweb_q05/datafusion:vortex-compact 203265630 / 152584954 / +33.2% 🔴 284222768 / 230234155 / +23.4% 🔴 0.72 / 0.66 / +7.9%
fineweb_q06/datafusion:vortex-compact 126449590 / 86237404 / +46.6% 🔴 212539839 / 163114635 / +30.3% 🔴 0.59 / 0.53 / +12.5%
fineweb_q07/datafusion:vortex-compact 137450593 / 88086068 / +56.0% 🔴 240188831 / 156303791 / +53.7% 🔴 0.57 / 0.56 / +1.5%
fineweb_q08/datafusion:vortex-compact 14136883 / 8179060 / +72.8% 🔴 28878050 / 42771034 / -32.5% 🟢 0.49 / 0.19 / +156.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9541652 / 9482157 / +0.6% 33156091 / 32111399 / +3.3% 0.29 / 0.30 / -2.5%
fineweb_q01/datafusion:parquet 74953246 / 75129645 / -0.2% 162479441 / 156360166 / +3.9% 0.46 / 0.48 / -4.0%
fineweb_q02/datafusion:parquet 75307634 / 73747780 / +2.1% 165127847 / 159846521 / +3.3% 0.46 / 0.46 / -1.2%
fineweb_q03/datafusion:parquet 73150352 / 74768342 / -2.2% 160052454 / 157975411 / +1.3% 0.46 / 0.47 / -3.4%
fineweb_q04/datafusion:parquet 83118555 / 82819587 / +0.4% 157616884 / 157992861 / -0.2% 0.53 / 0.52 / +0.6%
fineweb_q05/datafusion:parquet 81506759 / 81080730 / +0.5% 162149828 / 157515065 / +2.9% 0.50 / 0.51 / -2.3%
fineweb_q06/datafusion:parquet 75551102 / 76820271 / -1.7% 166120306 / 167173020 / -0.6% 0.45 / 0.46 / -1.0%
fineweb_q07/datafusion:parquet 74034820 / 73624110 / +0.6% 160869552 / 156859062 / +2.6% 0.46 / 0.47 / -1.9%
fineweb_q08/datafusion:parquet 73200357 / 73579522 / -0.5% 159571361 / 161416701 / -1.1% 0.46 / 0.46 / +0.6%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1991413 / 2060458 / -3.4% 7479806 / 7235617 / +3.4% 0.27 / 0.28 / -6.5%
fineweb_q01/duckdb:vortex-file-compressed 9599153 / 9533635 / +0.7% 36898636 / 33428263 / +10.4% 🔴 0.26 / 0.29 / -8.8%
fineweb_q02/duckdb:vortex-file-compressed 11030642 / 10827112 / +1.9% 42075406 / 33795730 / +24.5% 🔴 0.26 / 0.32 / -18.2%
fineweb_q03/duckdb:vortex-file-compressed 19565278 / 19616776 / -0.3% 114918367 / 88574457 / +29.7% 🔴 0.17 / 0.22 / -23.1%
fineweb_q04/duckdb:vortex-file-compressed 68964237 / 66064766 / +4.4% 128427824 / 108051698 / +18.9% 🔴 0.54 / 0.61 / -12.2%
fineweb_q05/duckdb:vortex-file-compressed 66517790 / 66540793 / -0.0% 121429836 / 105711829 / +14.9% 🔴 0.55 / 0.63 / -13.0%
fineweb_q06/duckdb:vortex-file-compressed 19072813 / 19522226 / -2.3% 109019154 / 94334392 / +15.6% 🔴 0.17 / 0.21 / -15.5%
fineweb_q07/duckdb:vortex-file-compressed 19082338 / 18991482 / +0.5% 104244596 / 88019344 / +18.4% 🔴 0.18 / 0.22 / -15.2%
fineweb_q08/duckdb:vortex-file-compressed 5550420 / 5492126 / +1.1% 14624604 / 14753686 / -0.9% 0.38 / 0.37 / +2.0%
duckdb / vortex-compact / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2193838 / 2165560 / +1.3% 7164345 / 8354714 / -14.2% 🟢 0.31 / 0.26 / +18.1%
fineweb_q01/duckdb:vortex-compact 42795994 / 43180296 / -0.9% 66788991 / 66917388 / -0.2% 0.64 / 0.65 / -0.7%
fineweb_q02/duckdb:vortex-compact 43388592 / 43780352 / -0.9% 69878987 / 67304791 / +3.8% 0.62 / 0.65 / -4.5%
fineweb_q03/duckdb:vortex-compact 183991276 / 182456056 / +0.8% 226618402 / 208748600 / +8.6% 0.81 / 0.87 / -7.1%
fineweb_q04/duckdb:vortex-compact 191800784 / 199313586 / -3.8% 235660357 / 248786836 / -5.3% 0.81 / 0.80 / +1.6%
fineweb_q05/duckdb:vortex-compact 182031644 / 172901193 / +5.3% 213726932 / 210124984 / +1.7% 0.85 / 0.82 / +3.5%
fineweb_q06/duckdb:vortex-compact 88894590 / 89299043 / -0.5% 138407525 / 138153362 / +0.2% 0.64 / 0.65 / -0.6%
fineweb_q07/duckdb:vortex-compact 88569094 / 90780659 / -2.4% 135576292 / 135565338 / +0.0% 0.65 / 0.67 / -2.4%
fineweb_q08/duckdb:vortex-compact 5217958 / 5492876 / -5.0% 12237925 / 12843447 / -4.7% 0.43 / 0.43 / -0.3%
duckdb / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23940986 / 23448581 / +2.1% 27830162 / 27593808 / +0.9% 0.86 / 0.85 / +1.2%
fineweb_q01/duckdb:parquet 56313371 / 54933198 / +2.5% 82013760 / 76123605 / +7.7% 0.69 / 0.72 / -4.8%
fineweb_q02/duckdb:parquet 60048794 / 58051781 / +3.4% 88188751 / 79202689 / +11.3% 🔴 0.68 / 0.73 / -7.1%
fineweb_q03/duckdb:parquet 117564592 / 118155770 / -0.5% 180924472 / 179057039 / +1.0% 0.65 / 0.66 / -1.5%
fineweb_q04/duckdb:parquet 161711146 / 161386539 / +0.2% 218884969 / 216551920 / +1.1% 0.74 / 0.75 / -0.9%
fineweb_q05/duckdb:parquet 159271011 / 157119474 / +1.4% 212881930 / 208784938 / +2.0% 0.75 / 0.75 / -0.6%
fineweb_q06/duckdb:parquet 89173952 / 89287572 / -0.1% 155405683 / 154201019 / +0.8% 0.57 / 0.58 / -0.9%
fineweb_q07/duckdb:parquet 90747462 / 91067884 / -0.4% 155847537 / 145204462 / +7.3% 0.58 / 0.63 / -7.2%
fineweb_q08/duckdb:parquet 29476282 / 29225694 / +0.9% 30711799 / 30385447 / +1.1% 0.96 / 0.96 / -0.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR e42f8876 vs base 705911cd
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Engines: DataFusion No clear signal (+6.0%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.031x ➖ · cold 1.155x ❌
Parquet (geomean): hot 1.002x ➖ · cold 1.047x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.948x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 175628568 / 166026873 / +5.8% 581857223 / 503843314 / +15.5% 🔴 0.30 / 0.33 / -8.4%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10650893 / 10754483 / -1.0% 56388520 / 45858500 / +23.0% 🔴 0.19 / 0.23 / -19.5%
clickbench-sorted_q26/datafusion:vortex-file-compressed 10989840 / 11221532 / -2.1% 55908980 / 46429007 / +20.4% 🔴 0.20 / 0.24 / -18.7%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22655008 / 23713256 / -4.5% 77345783 / 59358522 / +30.3% 🔴 0.29 / 0.40 / -26.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18622050 / 19219168 / -3.1% 66178454 / 47321184 / +39.8% 🔴 0.28 / 0.41 / -30.7%
clickbench-sorted_q38/datafusion:vortex-file-compressed 12722188 / 17562020 / -27.6% 🟢 64647465 / 55734492 / +16.0% 🔴 0.20 / 0.32 / -37.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed 37527660 / 40087292 / -6.4% 104333693 / 84748256 / +23.1% 🔴 0.36 / 0.47 / -24.0%
clickbench-sorted_q40/datafusion:vortex-file-compressed 11280150 / 11748310 / -4.0% 47112097 / 37868047 / +24.4% 🔴 0.24 / 0.31 / -22.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 10924702 / 11217508 / -2.6% 47386692 / 39851704 / +18.9% 🔴 0.23 / 0.28 / -18.1%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9585882 / 9798738 / -2.2% 41748294 / 30920829 / +35.0% 🔴 0.23 / 0.32 / -27.5%
datafusion / vortex-compact / ns (1.195x ❌, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 392284462 / 165029854 / +137.7% 🔴 678186368 / 422005424 / +60.7% 🔴 0.58 / 0.39 / +47.9%
clickbench-sorted_q24/datafusion:vortex-compact 19832077 / 18182929 / +9.1% 66412406 / 51339205 / +29.4% 🔴 0.30 / 0.35 / -15.7%
clickbench-sorted_q26/datafusion:vortex-compact 19959497 / 20492904 / -2.6% 63685311 / 53208539 / +19.7% 🔴 0.31 / 0.39 / -18.6%
clickbench-sorted_q36/datafusion:vortex-compact 36191065 / 25248826 / +43.3% 🔴 81059382 / 61359658 / +32.1% 🔴 0.45 / 0.41 / +8.5%
clickbench-sorted_q37/datafusion:vortex-compact 31816973 / 21671924 / +46.8% 🔴 76973039 / 58723119 / +31.1% 🔴 0.41 / 0.37 / +12.0%
clickbench-sorted_q38/datafusion:vortex-compact 22603460 / 20479642 / +10.4% 🔴 74972875 / 60638180 / +23.6% 🔴 0.30 / 0.34 / -10.7%
clickbench-sorted_q39/datafusion:vortex-compact 44737112 / 43126393 / +3.7% 101653429 / 77045894 / +31.9% 🔴 0.44 / 0.56 / -21.4%
clickbench-sorted_q40/datafusion:vortex-compact 13649364 / 13662890 / -0.1% 48773136 / 37416875 / +30.4% 🔴 0.28 / 0.37 / -23.4%
clickbench-sorted_q41/datafusion:vortex-compact 13820984 / 13617252 / +1.5% 47434165 / 42195028 / +12.4% 🔴 0.29 / 0.32 / -9.7%
clickbench-sorted_q42/datafusion:vortex-compact 10432540 / 10856802 / -3.9% 39213925 / 31585815 / +24.2% 🔴 0.27 / 0.34 / -22.6%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 749213634 / 754218798 / -0.7% 969141302 / 950148226 / +2.0% 0.77 / 0.79 / -2.6%
clickbench-sorted_q24/datafusion:parquet 9455342 / 8991144 / +5.2% 72456691 / 68488639 / +5.8% 0.13 / 0.13 / -0.6%
clickbench-sorted_q26/datafusion:parquet 9249928 / 9180885 / +0.8% 73446271 / 67103111 / +9.5% 0.13 / 0.14 / -7.9%
clickbench-sorted_q36/datafusion:parquet 93102346 / 93592084 / -0.5% 171861294 / 159422974 / +7.8% 0.54 / 0.59 / -7.7%
clickbench-sorted_q37/datafusion:parquet 63573879 / 63756239 / -0.3% 133771764 / 122631987 / +9.1% 0.48 / 0.52 / -8.6%
clickbench-sorted_q38/datafusion:parquet 86560777 / 86623633 / -0.1% 163920713 / 150072549 / +9.2% 0.53 / 0.58 / -8.5%
clickbench-sorted_q39/datafusion:parquet 159047348 / 158808192 / +0.2% 240239045 / 227695376 / +5.5% 0.66 / 0.70 / -5.1%
clickbench-sorted_q40/datafusion:parquet 43858450 / 44084866 / -0.5% 119310387 / 105091578 / +13.5% 🔴 0.37 / 0.42 / -12.4%
clickbench-sorted_q41/datafusion:parquet 41528286 / 41672864 / -0.3% 117030632 / 102816085 / +13.8% 🔴 0.35 / 0.41 / -12.5%
clickbench-sorted_q42/datafusion:parquet 25836746 / 25630483 / +0.8% 87865317 / 82914289 / +6.0% 0.29 / 0.31 / -4.9%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 31009324 / 30916787 / +0.3% 64043257 / 64715109 / -1.0% 0.48 / 0.48 / +1.4%
clickbench-sorted_q24/duckdb:vortex-file-compressed 9148060 / 9050724 / +1.1% 24274541 / 25842313 / -6.1% 0.38 / 0.35 / +7.6%
clickbench-sorted_q26/duckdb:vortex-file-compressed 8456314 / 8667996 / -2.4% 25743493 / 26326843 / -2.2% 0.33 / 0.33 / -0.2%
clickbench-sorted_q36/duckdb:vortex-file-compressed 21892848 / 22143256 / -1.1% 57794663 / 52504061 / +10.1% 🔴 0.38 / 0.42 / -10.2%
clickbench-sorted_q37/duckdb:vortex-file-compressed 16881139 / 16906864 / -0.2% 47652317 / 44111139 / +8.0% 0.35 / 0.38 / -7.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 18202706 / 18401852 / -1.1% 54990856 / 48420710 / +13.6% 🔴 0.33 / 0.38 / -12.9%
clickbench-sorted_q39/duckdb:vortex-file-compressed 39300536 / 39336694 / -0.1% 91222210 / 81721819 / +11.6% 🔴 0.43 / 0.48 / -10.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed 10669648 / 10712776 / -0.4% 39151591 / 34088737 / +14.9% 🔴 0.27 / 0.31 / -13.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed 11530198 / 11712234 / -1.6% 38943242 / 34578883 / +12.6% 🔴 0.30 / 0.34 / -12.6%
clickbench-sorted_q42/duckdb:vortex-file-compressed 8353278 / 8330264 / +0.3% 31341991 / 29584634 / +5.9% 0.27 / 0.28 / -5.3%
duckdb / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 38065680 / 38384418 / -0.8% 68817022 / 68325651 / +0.7% 0.55 / 0.56 / -1.5%
clickbench-sorted_q24/duckdb:vortex-compact 10942574 / 11058226 / -1.0% 28183127 / 29034743 / -2.9% 0.39 / 0.38 / +1.9%
clickbench-sorted_q26/duckdb:vortex-compact 11264763 / 11166906 / +0.9% 34040720 / 31813426 / +7.0% 0.33 / 0.35 / -5.7%
clickbench-sorted_q36/duckdb:vortex-compact 26196358 / 26486367 / -1.1% 60194537 / 57487185 / +4.7% 0.44 / 0.46 / -5.5%
clickbench-sorted_q37/duckdb:vortex-compact 21788018 / 21978045 / -0.9% 55306195 / 54189866 / +2.1% 0.39 / 0.41 / -2.9%
clickbench-sorted_q38/duckdb:vortex-compact 22295891 / 21851868 / +2.0% 60271050 / 55389976 / +8.8% 0.37 / 0.39 / -6.2%
clickbench-sorted_q39/duckdb:vortex-compact 50422136 / 49877286 / +1.1% 88855829 / 80656741 / +10.2% 🔴 0.57 / 0.62 / -8.2%
clickbench-sorted_q40/duckdb:vortex-compact 12147886 / 11633076 / +4.4% 38029438 / 35624558 / +6.8% 0.32 / 0.33 / -2.2%
clickbench-sorted_q41/duckdb:vortex-compact 12809147 / 13179196 / -2.8% 40381445 / 37487302 / +7.7% 0.32 / 0.35 / -9.8%
clickbench-sorted_q42/duckdb:vortex-compact 9205786 / 9204596 / +0.0% 29929822 / 30820382 / -2.9% 0.31 / 0.30 / +3.0%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 144337154 / 146335620 / -1.4% 166027136 / 184504108 / -10.0% 🟢 0.87 / 0.79 / +9.6%
clickbench-sorted_q24/duckdb:parquet 17428696 / 18065978 / -3.5% 24939896 / 19469484 / +28.1% 🔴 0.70 / 0.93 / -24.7%
clickbench-sorted_q26/duckdb:parquet 17921664 / 17818950 / +0.6% 27590401 / 23710411 / +16.4% 🔴 0.65 / 0.75 / -13.6%
clickbench-sorted_q36/duckdb:parquet 50925884 / 51106530 / -0.4% 67204254 / 65776506 / +2.2% 0.76 / 0.78 / -2.5%
clickbench-sorted_q37/duckdb:parquet 40630150 / 38138248 / +6.5% 48728430 / 55582943 / -12.3% 🟢 0.83 / 0.69 / +21.5%
clickbench-sorted_q38/duckdb:parquet 43829112 / 44876224 / -2.3% 63668963 / 60865383 / +4.6% 0.69 / 0.74 / -6.6%
clickbench-sorted_q39/duckdb:parquet 79700892 / 81891463 / -2.7% 92373424 / 91992453 / +0.4% 0.86 / 0.89 / -3.1%
clickbench-sorted_q40/duckdb:parquet 24130208 / 24675160 / -2.2% 34095962 / 35128566 / -2.9% 0.71 / 0.70 / +0.8%
clickbench-sorted_q41/duckdb:parquet 25749363 / 24181471 / +6.5% 31471015 / 34420786 / -8.6% 0.82 / 0.70 / +16.5%
clickbench-sorted_q42/duckdb:parquet 18033566 / 18192875 / -0.9% 26000868 / 25565274 / +1.7% 0.69 / 0.71 / -2.5%
duckdb / duckdb / ns (1.020x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 76800742 / 75947152 / +1.1% 132166257 / 124361963 / +6.3% 0.58 / 0.61 / -4.8%
clickbench-sorted_q24/duckdb:duckdb 26272172 / 25521790 / +2.9% 32109109 / 30626247 / +4.8% 0.82 / 0.83 / -1.8%
clickbench-sorted_q26/duckdb:duckdb 27043640 / 26128205 / +3.5% 33517637 / 31898536 / +5.1% 0.81 / 0.82 / -1.5%
clickbench-sorted_q36/duckdb:duckdb 39944402 / 42089188 / -5.1% 78692186 / 74116989 / +6.2% 0.51 / 0.57 / -10.6%
clickbench-sorted_q37/duckdb:duckdb 41936924 / 37614391 / +11.5% 🔴 76971757 / 76605774 / +0.5% 0.54 / 0.49 / +11.0%
clickbench-sorted_q38/duckdb:duckdb 33563045 / 31743795 / +5.7% 69671866 / 67575492 / +3.1% 0.48 / 0.47 / +2.5%
clickbench-sorted_q39/duckdb:duckdb 56630494 / 56562173 / +0.1% 115185200 / 114760356 / +0.4% 0.49 / 0.49 / -0.2%
clickbench-sorted_q40/duckdb:duckdb 23416250 / 23108628 / +1.3% 49011261 / 46989213 / +4.3% 0.48 / 0.49 / -2.8%
clickbench-sorted_q41/duckdb:duckdb 22300598 / 22489330 / -0.8% 41942863 / 40237219 / +4.2% 0.53 / 0.56 / -4.9%
clickbench-sorted_q42/duckdb:duckdb 18267216 / 18180768 / +0.5% 30449329 / 28935827 / +5.2% 0.60 / 0.63 / -4.5%

File Size Changes (200 files changed, +0.0% overall, 106↑ 94↓)
File Scale Format Base HEAD Change %
hits_024.vortex 1.0 vortex-file-compressed 159.49 MB 161.09 MB +1.60 MB +1.0%
hits_034.vortex 1.0 vortex-file-compressed 183.08 MB 184.81 MB +1.73 MB +0.9%
hits_064.vortex 1.0 vortex-compact 138.69 MB 139.97 MB +1.28 MB +0.9%
hits_041.vortex 1.0 vortex-compact 97.11 MB 97.88 MB +786.98 KB +0.8%
hits_055.vortex 1.0 vortex-file-compressed 199.32 MB 200.82 MB +1.50 MB +0.8%
hits_018.vortex 1.0 vortex-compact 151.91 MB 153.03 MB +1.12 MB +0.7%
hits_097.vortex 1.0 vortex-compact 140.12 MB 141.09 MB +988.05 KB +0.7%
hits_090.vortex 1.0 vortex-compact 140.09 MB 141.05 MB +984.28 KB +0.7%
hits_023.vortex 1.0 vortex-compact 141.62 MB 142.59 MB +986.36 KB +0.7%
hits_007.vortex 1.0 vortex-file-compressed 199.98 MB 201.33 MB +1.35 MB +0.7%
hits_028.vortex 1.0 vortex-file-compressed 152.27 MB 153.20 MB +947.93 KB +0.6%
hits_052.vortex 1.0 vortex-compact 97.44 MB 98.02 MB +590.41 KB +0.6%
hits_045.vortex 1.0 vortex-file-compressed 139.16 MB 139.93 MB +791.98 KB +0.6%
hits_087.vortex 1.0 vortex-compact 125.05 MB 125.74 MB +709.59 KB +0.6%
hits_070.vortex 1.0 vortex-file-compressed 199.63 MB 200.73 MB +1.10 MB +0.6%
hits_033.vortex 1.0 vortex-file-compressed 200.03 MB 200.97 MB +957.59 KB +0.5%
hits_030.vortex 1.0 vortex-compact 97.96 MB 98.40 MB +444.38 KB +0.4%
hits_095.vortex 1.0 vortex-compact 110.17 MB 110.61 MB +448.80 KB +0.4%
hits_084.vortex 1.0 vortex-compact 109.98 MB 110.42 MB +447.62 KB +0.4%
hits_071.vortex 1.0 vortex-file-compressed 140.00 MB 140.43 MB +439.31 KB +0.3%
hits_063.vortex 1.0 vortex-file-compressed 130.83 MB 131.19 MB +371.02 KB +0.3%
hits_078.vortex 1.0 vortex-compact 97.55 MB 97.81 MB +274.01 KB +0.3%
hits_031.vortex 1.0 vortex-compact 111.29 MB 111.58 MB +296.95 KB +0.3%
hits_049.vortex 1.0 vortex-compact 139.34 MB 139.70 MB +366.64 KB +0.3%
hits_094.vortex 1.0 vortex-compact 110.79 MB 111.07 MB +285.61 KB +0.3%
hits_045.vortex 1.0 vortex-compact 105.77 MB 106.02 MB +256.13 KB +0.2%
hits_080.vortex 1.0 vortex-compact 96.65 MB 96.86 MB +214.04 KB +0.2%
hits_005.vortex 1.0 vortex-compact 116.03 MB 116.28 MB +255.39 KB +0.2%
hits_047.vortex 1.0 vortex-file-compressed 153.79 MB 154.12 MB +336.41 KB +0.2%
hits_032.vortex 1.0 vortex-compact 109.91 MB 110.14 MB +239.88 KB +0.2%
hits_024.vortex 1.0 vortex-compact 124.84 MB 125.10 MB +262.42 KB +0.2%
hits_058.vortex 1.0 vortex-compact 110.13 MB 110.35 MB +229.74 KB +0.2%
hits_032.vortex 1.0 vortex-file-compressed 153.97 MB 154.28 MB +320.85 KB +0.2%
hits_040.vortex 1.0 vortex-file-compressed 144.20 MB 144.48 MB +286.04 KB +0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.57 MB 130.81 MB +252.88 KB +0.2%
hits_026.vortex 1.0 vortex-compact 98.08 MB 98.27 MB +185.52 KB +0.2%
hits_017.vortex 1.0 vortex-file-compressed 147.19 MB 147.44 MB +256.70 KB +0.2%
hits_069.vortex 1.0 vortex-file-compressed 142.86 MB 143.11 MB +248.09 KB +0.2%
hits_014.vortex 1.0 vortex-file-compressed 172.76 MB 173.05 MB +297.85 KB +0.2%
hits_094.vortex 1.0 vortex-file-compressed 158.39 MB 158.65 MB +263.69 KB +0.2%
hits_061.vortex 1.0 vortex-file-compressed 161.35 MB 161.59 MB +245.30 KB +0.1%
hits_002.vortex 1.0 vortex-compact 125.15 MB 125.32 MB +170.48 KB +0.1%
hits_006.vortex 1.0 vortex-compact 95.85 MB 95.97 MB +121.37 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.33 MB 130.48 MB +158.87 KB +0.1%
hits_075.vortex 1.0 vortex-compact 137.82 MB 137.98 MB +160.71 KB +0.1%
hits_036.vortex 1.0 vortex-file-compressed 171.84 MB 171.99 MB +154.78 KB +0.1%
hits_034.vortex 1.0 vortex-compact 133.24 MB 133.35 MB +117.90 KB +0.1%
hits_060.vortex 1.0 vortex-compact 140.12 MB 140.23 MB +118.01 KB +0.1%
hits_061.vortex 1.0 vortex-compact 125.17 MB 125.28 MB +105.26 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.10 MB 130.20 MB +101.59 KB +0.1%
hits_012.vortex 1.0 vortex-file-compressed 190.42 MB 190.56 MB +140.26 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.81 MB 130.91 MB +94.47 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.21 MB 167.32 MB +114.13 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 200.85 MB 200.99 MB +136.17 KB +0.1%
hits_027.vortex 1.0 vortex-file-compressed 189.65 MB 189.77 MB +119.96 KB +0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.59 MB 161.69 MB +101.99 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.77 MB 100.83 MB +61.28 KB +0.1%
hits_051.vortex 1.0 vortex-compact 133.68 MB 133.76 MB +80.98 KB +0.1%
hits_077.vortex 1.0 vortex-compact 134.07 MB 134.14 MB +71.89 KB +0.1%
hits_065.vortex 1.0 vortex-compact 125.70 MB 125.76 MB +65.53 KB +0.1%
hits_074.vortex 1.0 vortex-file-compressed 200.18 MB 200.28 MB +102.30 KB +0.0%
hits_027.vortex 1.0 vortex-compact 139.01 MB 139.08 MB +68.95 KB +0.0%
hits_050.vortex 1.0 vortex-compact 125.38 MB 125.43 MB +59.51 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.59 MB 161.66 MB +75.80 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.03 MB 191.12 MB +89.33 KB +0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.54 MB 130.60 MB +60.59 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.03 MB 127.08 MB +54.83 KB +0.0%
hits_064.vortex 1.0 vortex-file-compressed 190.45 MB 190.52 MB +79.37 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.06 MB 101.10 MB +41.02 KB +0.0%
hits_053.vortex 1.0 vortex-compact 138.37 MB 138.42 MB +55.95 KB +0.0%
hits_014.vortex 1.0 vortex-compact 133.74 MB 133.78 MB +47.80 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.23 MB 102.27 MB +36.47 KB +0.0%
hits_036.vortex 1.0 vortex-compact 133.12 MB 133.16 MB +47.09 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.15 MB 178.20 MB +60.70 KB +0.0%
hits_017.vortex 1.0 vortex-compact 111.95 MB 111.99 MB +37.65 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.04 MB 189.10 MB +58.04 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.78 MB 111.81 MB +34.06 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.73 MB 130.77 MB +38.69 KB +0.0%
hits_062.vortex 1.0 vortex-compact 132.57 MB 132.61 MB +38.02 KB +0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.88 MB 194.93 MB +53.70 KB +0.0%
hits_038.vortex 1.0 vortex-compact 138.29 MB 138.33 MB +36.02 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.63 MB 192.67 MB +43.06 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.66 MB 161.69 MB +35.96 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.37 MB 147.40 MB +32.56 KB +0.0%
hits_020.vortex 1.0 vortex-compact 111.75 MB 111.77 MB +22.11 KB +0.0%
hits_020.vortex 1.0 vortex-file-compressed 159.95 MB 159.98 MB +31.22 KB +0.0%
hits_074.vortex 1.0 vortex-compact 152.38 MB 152.41 MB +29.33 KB +0.0%
hits_069.vortex 1.0 vortex-compact 99.79 MB 99.81 MB +18.95 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.80 MB 126.82 MB +21.39 KB +0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.20 MB 159.23 MB +23.84 KB +0.0%
hits_083.vortex 1.0 vortex-compact 110.09 MB 110.11 MB +15.59 KB +0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.76 MB 153.78 MB +21.41 KB +0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.71 MB 130.73 MB +17.60 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.86 MB 200.89 MB +26.74 KB +0.0%
hits_055.vortex 1.0 vortex-compact 153.09 MB 153.11 MB +18.45 KB +0.0%
hits_046.vortex 1.0 vortex-compact 75.01 MB 75.02 MB +8.40 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.57 MB 189.59 MB +19.09 KB +0.0%
hits_091.vortex 1.0 vortex-compact 112.07 MB 112.08 MB +8.75 KB +0.0%
hits_059.vortex 1.0 vortex-file-compressed 200.18 MB 200.20 MB +14.73 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.70 MB 136.71 MB +8.57 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.81 MB 153.82 MB +8.95 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.09 MB 134.09 MB +5.33 KB +0.0%
hits_056.vortex 1.0 vortex-compact 100.86 MB 100.87 MB +3.52 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.12 MB 131.12 MB +3.48 KB +0.0%
hits_096.vortex 1.0 vortex-file-compressed 200.41 MB 200.41 MB +1.61 KB +0.0%
hits_072.vortex 1.0 vortex-compact 75.61 MB 75.61 MB +472 B +0.0%
hits_016.vortex 1.0 vortex-compact 127.41 MB 127.41 MB 40 B -0.0%
hits_082.vortex 1.0 vortex-compact 105.71 MB 105.71 MB 984 B -0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.59 MB 161.59 MB 1.53 KB -0.0%
hits_001.vortex 1.0 vortex-compact 137.72 MB 137.72 MB 2.41 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.60 MB 189.59 MB 6.11 KB -0.0%
hits_012.vortex 1.0 vortex-compact 138.87 MB 138.87 MB 6.43 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.27 MB 156.26 MB 10.30 KB -0.0%
hits_071.vortex 1.0 vortex-compact 105.66 MB 105.66 MB 8.45 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.82 MB 191.80 MB 22.20 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.88 MB 101.86 MB 13.54 KB -0.0%
hits_079.vortex 1.0 vortex-compact 128.05 MB 128.03 MB 18.87 KB -0.0%
hits_092.vortex 1.0 vortex-compact 153.08 MB 153.05 MB 26.91 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.61 MB 126.59 MB 23.66 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.13 MB 106.11 MB 24.16 KB -0.0%
hits_028.vortex 1.0 vortex-compact 115.76 MB 115.73 MB 28.51 KB -0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.80 MB 137.76 MB 39.73 KB -0.0%
hits_035.vortex 1.0 vortex-compact 75.98 MB 75.96 MB 22.65 KB -0.0%
hits_054.vortex 1.0 vortex-compact 111.86 MB 111.82 MB 33.50 KB -0.0%
hits_011.vortex 1.0 vortex-file-compressed 200.25 MB 200.19 MB 63.52 KB -0.0%
hits_068.vortex 1.0 vortex-compact 112.09 MB 112.05 MB 37.40 KB -0.0%
hits_022.vortex 1.0 vortex-file-compressed 200.16 MB 200.09 MB 70.54 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.76 MB 200.69 MB 71.75 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 75.22 MB 27.08 KB -0.0%
hits_007.vortex 1.0 vortex-compact 153.62 MB 153.56 MB 56.77 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.60 MB 136.55 MB 52.32 KB -0.0%
hits_001.vortex 1.0 vortex-file-compressed 188.80 MB 188.72 MB 74.09 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.48 MB 160.42 MB 64.20 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 140.08 MB 140.02 MB 61.06 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.76 MB 104.71 MB 47.13 KB -0.0%
hits_044.vortex 1.0 vortex-compact 153.19 MB 153.12 MB 72.27 KB -0.0%
hits_000.vortex 1.0 vortex-compact 98.28 MB 98.23 MB 46.39 KB -0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.92 MB 171.83 MB 84.92 KB -0.0%
hits_098.vortex 1.0 vortex-compact 103.75 MB 103.69 MB 56.46 KB -0.1%
hits_048.vortex 1.0 vortex-file-compressed 200.75 MB 200.64 MB 109.55 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.61 MB 161.53 MB 89.06 KB -0.1%
hits_099.vortex 1.0 vortex-compact 133.13 MB 133.05 MB 74.66 KB -0.1%
hits_065.vortex 1.0 vortex-file-compressed 161.93 MB 161.83 MB 102.21 KB -0.1%
hits_040.vortex 1.0 vortex-compact 110.32 MB 110.25 MB 74.62 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 173.17 MB 173.05 MB 121.03 KB -0.1%
hits_085.vortex 1.0 vortex-compact 152.70 MB 152.59 MB 108.39 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 179.85 MB 179.73 MB 128.50 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.38 MB 130.29 MB 93.51 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.39 MB 130.30 MB 94.89 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.97 MB 161.85 MB 118.52 KB -0.1%
hits_010.vortex 1.0 vortex-file-compressed 169.08 MB 168.95 MB 138.55 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.48 MB 192.32 MB 166.94 KB -0.1%
hits_029.vortex 1.0 vortex-compact 153.30 MB 153.16 MB 143.25 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.30 MB 201.11 MB 188.89 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.92 MB 192.74 MB 184.78 KB -0.1%
hits_008.vortex 1.0 vortex-compact 105.82 MB 105.72 MB 102.77 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.13 MB 131.00 MB 128.05 KB -0.1%
hits_093.vortex 1.0 vortex-compact 98.52 MB 98.42 MB 96.24 KB -0.1%
hits_066.vortex 1.0 vortex-file-compressed 163.12 MB 162.96 MB 168.20 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 173.11 MB 172.93 MB 183.71 KB -0.1%
hits_096.vortex 1.0 vortex-compact 152.51 MB 152.35 MB 164.83 KB -0.1%
hits_033.vortex 1.0 vortex-compact 153.24 MB 153.07 MB 170.75 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 154.65 MB 154.48 MB 177.21 KB -0.1%
hits_081.vortex 1.0 vortex-compact 153.38 MB 153.20 MB 178.95 KB -0.1%
hits_043.vortex 1.0 vortex-compact 94.26 MB 94.15 MB 115.59 KB -0.1%
hits_025.vortex 1.0 vortex-compact 133.91 MB 133.74 MB 169.03 KB -0.1%
hits_063.vortex 1.0 vortex-compact 97.98 MB 97.86 MB 127.84 KB -0.1%
hits_070.vortex 1.0 vortex-compact 153.54 MB 153.34 MB 204.92 KB -0.1%
hits_088.vortex 1.0 vortex-compact 133.87 MB 133.69 MB 181.26 KB -0.1%
hits_039.vortex 1.0 vortex-compact 125.53 MB 125.35 MB 177.72 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 173.24 MB 173.00 MB 245.98 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.47 MB 139.26 MB 211.53 KB -0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.14 MB 153.91 MB 236.91 KB -0.2%
hits_021.vortex 1.0 vortex-compact 110.14 MB 109.94 MB 209.25 KB -0.2%
hits_022.vortex 1.0 vortex-compact 152.44 MB 152.13 MB 313.86 KB -0.2%
hits_013.vortex 1.0 vortex-compact 124.35 MB 124.08 MB 271.56 KB -0.2%
hits_092.vortex 1.0 vortex-file-compressed 201.13 MB 200.67 MB 466.94 KB -0.2%
hits_057.vortex 1.0 vortex-file-compressed 160.40 MB 160.02 MB 387.84 KB -0.2%
hits_037.vortex 1.0 vortex-compact 132.57 MB 132.19 MB 389.53 KB -0.3%
hits_010.vortex 1.0 vortex-compact 122.88 MB 122.52 MB 364.76 KB -0.3%
hits_004.vortex 1.0 vortex-compact 97.84 MB 97.56 MB 294.87 KB -0.3%
hits_011.vortex 1.0 vortex-compact 152.30 MB 151.84 MB 466.46 KB -0.3%
hits_025.vortex 1.0 vortex-file-compressed 172.88 MB 172.35 MB 541.88 KB -0.3%
hits_042.vortex 1.0 vortex-file-compressed 202.10 MB 201.35 MB 773.86 KB -0.4%
hits_054.vortex 1.0 vortex-file-compressed 147.97 MB 147.40 MB 578.13 KB -0.4%
hits_051.vortex 1.0 vortex-file-compressed 173.68 MB 172.99 MB 707.28 KB -0.4%
hits_056.vortex 1.0 vortex-file-compressed 135.53 MB 134.98 MB 558.67 KB -0.4%
hits_082.vortex 1.0 vortex-file-compressed 139.90 MB 139.33 MB 579.95 KB -0.4%
hits_089.vortex 1.0 vortex-compact 98.23 MB 97.82 MB 419.75 KB -0.4%
hits_047.vortex 1.0 vortex-compact 110.46 MB 109.99 MB 473.98 KB -0.4%
hits_059.vortex 1.0 vortex-compact 151.70 MB 151.05 MB 671.92 KB -0.4%
hits_015.vortex 1.0 vortex-compact 97.86 MB 97.38 MB 488.16 KB -0.5%
hits_062.vortex 1.0 vortex-file-compressed 172.27 MB 171.30 MB 986.06 KB -0.6%
hits_066.vortex 1.0 vortex-compact 117.41 MB 116.64 MB 786.47 KB -0.7%
hits_079.vortex 1.0 vortex-file-compressed 181.88 MB 180.56 MB 1.31 MB -0.7%
hits_086.vortex 1.0 vortex-compact 140.67 MB 139.64 MB 1.03 MB -0.7%
hits_081.vortex 1.0 vortex-file-compressed 201.07 MB 199.45 MB 1.61 MB -0.8%
hits_067.vortex 1.0 vortex-compact 99.06 MB 98.23 MB 850.58 KB -0.8%
hits_048.vortex 1.0 vortex-compact 153.22 MB 151.93 MB 1.29 MB -0.8%
hits_076.vortex 1.0 vortex-compact 125.50 MB 123.91 MB 1.59 MB -1.3%

Totals:

  • vortex-compact: 11.91 GB → 11.91 GB (+0.0%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR e42f8876 vs base e4dce8b7
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.971x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.995x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90625657 / 89830011 / +0.9% 152428758 / 151818144 / +0.4% 0.59 / 0.59 / +0.5%
tpch_q02/datafusion:vortex-file-compressed 65138046 / 64854619 / +0.4% 97013400 / 96510938 / +0.5% 0.67 / 0.67 / -0.1%
tpch_q03/datafusion:vortex-file-compressed 63278611 / 63550931 / -0.4% 117177197 / 119844418 / -2.2% 0.54 / 0.53 / +1.8%
tpch_q04/datafusion:vortex-file-compressed 34376598 / 34118013 / +0.8% 71670928 / 74172009 / -3.4% 0.48 / 0.46 / +4.3%
tpch_q05/datafusion:vortex-file-compressed 118266052 / 119303737 / -0.9% 175385599 / 176595992 / -0.7% 0.67 / 0.68 / -0.2%
tpch_q06/datafusion:vortex-file-compressed 10306104 / 10214165 / +0.9% 58481165 / 58267176 / +0.4% 0.18 / 0.18 / +0.5%
tpch_q07/datafusion:vortex-file-compressed 134489314 / 134451358 / +0.0% 200344586 / 204294147 / -1.9% 0.67 / 0.66 / +2.0%
tpch_q08/datafusion:vortex-file-compressed 142543747 / 141418962 / +0.8% 211372230 / 218182653 / -3.1% 0.67 / 0.65 / +4.0%
tpch_q09/datafusion:vortex-file-compressed 186785373 / 186296815 / +0.3% 257659032 / 344793657 / -25.3% 🟢 0.72 / 0.54 / +34.2%
tpch_q10/datafusion:vortex-file-compressed 70029813 / 70616992 / -0.8% 140187183 / 139484560 / +0.5% 0.50 / 0.51 / -1.3%
tpch_q11/datafusion:vortex-file-compressed 43203783 / 43151620 / +0.1% 66854703 / 68265687 / -2.1% 0.65 / 0.63 / +2.2%
tpch_q12/datafusion:vortex-file-compressed 35040198 / 34764636 / +0.8% 83242529 / 79411471 / +4.8% 0.42 / 0.44 / -3.8%
tpch_q13/datafusion:vortex-file-compressed 48594081 / 47706128 / +1.9% 77815085 / 81386369 / -4.4% 0.62 / 0.59 / +6.5%
tpch_q14/datafusion:vortex-file-compressed 21611843 / 20531467 / +5.3% 89490232 / 85266103 / +5.0% 0.24 / 0.24 / +0.3%
tpch_q15/datafusion:vortex-file-compressed 33955185 / 33441075 / +1.5% 92943420 / 92057550 / +1.0% 0.37 / 0.36 / +0.6%
tpch_q16/datafusion:vortex-file-compressed 37287802 / 37244823 / +0.1% 69239126 / 69393168 / -0.2% 0.54 / 0.54 / +0.3%
tpch_q17/datafusion:vortex-file-compressed 176172162 / 175378873 / +0.5% 222259798 / 239083332 / -7.0% 0.79 / 0.73 / +8.1%
tpch_q18/datafusion:vortex-file-compressed 208670566 / 206077691 / +1.3% 271915887 / 271336435 / +0.2% 0.77 / 0.76 / +1.0%
tpch_q19/datafusion:vortex-file-compressed 30745777 / 29236220 / +5.2% 92225283 / 84425029 / +9.2% 0.33 / 0.35 / -3.7%
tpch_q20/datafusion:vortex-file-compressed 60405312 / 59415400 / +1.7% 117125986 / 120037556 / -2.4% 0.52 / 0.49 / +4.2%
tpch_q21/datafusion:vortex-file-compressed 180733024 / 179428225 / +0.7% 247677367 / 245075636 / +1.1% 0.73 / 0.73 / -0.3%
tpch_q22/datafusion:vortex-file-compressed 25105751 / 25427504 / -1.3% 54431177 / 53010554 / +2.7% 0.46 / 0.48 / -3.8%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 97526357 / 98508906 / -1.0% 153869845 / 153161526 / +0.5% 0.63 / 0.64 / -1.5%
tpch_q02/datafusion:vortex-compact 64447499 / 64335825 / +0.2% 95158689 / 98908311 / -3.8% 0.68 / 0.65 / +4.1%
tpch_q03/datafusion:vortex-compact 67676333 / 67609268 / +0.1% 112514842 / 114823701 / -2.0% 0.60 / 0.59 / +2.2%
tpch_q04/datafusion:vortex-compact 37888050 / 38956144 / -2.7% 64905320 / 65065995 / -0.2% 0.58 / 0.60 / -2.5%
tpch_q05/datafusion:vortex-compact 119382091 / 119115816 / +0.2% 168427489 / 174382337 / -3.4% 0.71 / 0.68 / +3.8%
tpch_q06/datafusion:vortex-compact 15187979 / 15465891 / -1.8% 50098651 / 52604143 / -4.8% 0.30 / 0.29 / +3.1%
tpch_q07/datafusion:vortex-compact 140697567 / 140880653 / -0.1% 181632156 / 191743590 / -5.3% 0.77 / 0.73 / +5.4%
tpch_q08/datafusion:vortex-compact 145564971 / 143391609 / +1.5% 199620908 / 206191044 / -3.2% 0.73 / 0.70 / +4.9%
tpch_q09/datafusion:vortex-compact 187467397 / 185797772 / +0.9% 254572821 / 258501422 / -1.5% 0.74 / 0.72 / +2.5%
tpch_q10/datafusion:vortex-compact 78839732 / 79491607 / -0.8% 124259373 / 127897224 / -2.8% 0.63 / 0.62 / +2.1%
tpch_q11/datafusion:vortex-compact 43750772 / 44011855 / -0.6% 70069740 / 67989883 / +3.1% 0.62 / 0.65 / -3.5%
tpch_q12/datafusion:vortex-compact 48508133 / 46560612 / +4.2% 80027687 / 81759613 / -2.1% 0.61 / 0.57 / +6.4%
tpch_q13/datafusion:vortex-compact 57182114 / 57586977 / -0.7% 92845508 / 88757056 / +4.6% 0.62 / 0.65 / -5.1%
tpch_q14/datafusion:vortex-compact 26050082 / 25294134 / +3.0% 91871600 / 91240853 / +0.7% 0.28 / 0.28 / +2.3%
tpch_q15/datafusion:vortex-compact 46494717 / 46049948 / +1.0% 99301661 / 95749240 / +3.7% 0.47 / 0.48 / -2.6%
tpch_q16/datafusion:vortex-compact 40351535 / 39649852 / +1.8% 68834475 / 66815540 / +3.0% 0.59 / 0.59 / -1.2%
tpch_q17/datafusion:vortex-compact 174909994 / 175168861 / -0.1% 220689898 / 221727373 / -0.5% 0.79 / 0.79 / +0.3%
tpch_q18/datafusion:vortex-compact 207853046 / 207902068 / -0.0% 269404361 / 271512938 / -0.8% 0.77 / 0.77 / +0.8%
tpch_q19/datafusion:vortex-compact 35823625 / 36412090 / -1.6% 84289138 / 83376804 / +1.1% 0.43 / 0.44 / -2.7%
tpch_q20/datafusion:vortex-compact 65834985 / 65385121 / +0.7% 113041839 / 118503500 / -4.6% 0.58 / 0.55 / +5.6%
tpch_q21/datafusion:vortex-compact 185680599 / 186419245 / -0.4% 238296243 / 241879488 / -1.5% 0.78 / 0.77 / +1.1%
tpch_q22/datafusion:vortex-compact 26415170 / 26596026 / -0.7% 55267840 / 54640284 / +1.1% 0.48 / 0.49 / -1.8%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 88286089 / 87800478 / +0.6% 129410205 / 124663848 / +3.8% 0.68 / 0.70 / -3.1%
tpch_q02/datafusion:parquet 175935136 / 175634980 / +0.2% 197986564 / 199100564 / -0.6% 0.89 / 0.88 / +0.7%
tpch_q03/datafusion:parquet 137097678 / 137912852 / -0.6% 184053076 / 186509083 / -1.3% 0.74 / 0.74 / +0.7%
tpch_q04/datafusion:parquet 58775262 / 58892301 / -0.2% 88534220 / 90000676 / -1.6% 0.66 / 0.65 / +1.5%
tpch_q05/datafusion:parquet 170157122 / 169261575 / +0.5% 221805987 / 225899960 / -1.8% 0.77 / 0.75 / +2.4%
tpch_q06/datafusion:parquet 37548905 / 37055532 / +1.3% 74874736 / 76020246 / -1.5% 0.50 / 0.49 / +2.9%
tpch_q07/datafusion:parquet 219154805 / 218334890 / +0.4% 280494961 / 274775085 / +2.1% 0.78 / 0.79 / -1.7%
tpch_q08/datafusion:parquet 223630991 / 223397220 / +0.1% 290584361 / 293135311 / -0.9% 0.77 / 0.76 / +1.0%
tpch_q09/datafusion:parquet 313410540 / 313323388 / +0.0% 380976308 / 373153344 / +2.1% 0.82 / 0.84 / -2.0%
tpch_q10/datafusion:parquet 321029935 / 321738718 / -0.2% 375902707 / 384951266 / -2.4% 0.85 / 0.84 / +2.2%
tpch_q11/datafusion:parquet 126819232 / 126230808 / +0.5% 150222604 / 151825601 / -1.1% 0.84 / 0.83 / +1.5%
tpch_q12/datafusion:parquet 84578805 / 84520245 / +0.1% 119623035 / 119787021 / -0.1% 0.71 / 0.71 / +0.2%
tpch_q13/datafusion:parquet 216657855 / 216706113 / -0.0% 246385989 / 248737828 / -0.9% 0.88 / 0.87 / +0.9%
tpch_q14/datafusion:parquet 88171609 / 87320756 / +1.0% 194767310 / 189870970 / +2.6% 0.45 / 0.46 / -1.6%
tpch_q15/datafusion:parquet 106367662 / 105600133 / +0.7% 157717355 / 154090694 / +2.4% 0.67 / 0.69 / -1.6%
tpch_q16/datafusion:parquet 97862182 / 97578567 / +0.3% 122880345 / 123943111 / -0.9% 0.80 / 0.79 / +1.2%
tpch_q17/datafusion:parquet 212615195 / 213561188 / -0.4% 266100806 / 262174166 / +1.5% 0.80 / 0.81 / -1.9%
tpch_q18/datafusion:parquet 272785125 / 271257080 / +0.6% 317938930 / 309546314 / +2.7% 0.86 / 0.88 / -2.1%
tpch_q19/datafusion:parquet 109145578 / 108789195 / +0.3% 166110383 / 163981763 / +1.3% 0.66 / 0.66 / -1.0%
tpch_q20/datafusion:parquet 190333713 / 189538186 / +0.4% 241461659 / 255326074 / -5.4% 0.79 / 0.74 / +6.2%
tpch_q21/datafusion:parquet 247755758 / 247379946 / +0.2% 314737288 / 306670089 / +2.6% 0.79 / 0.81 / -2.4%
tpch_q22/datafusion:parquet 154174667 / 153645112 / +0.3% 174949535 / 178130561 / -1.8% 0.88 / 0.86 / +2.2%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33162659 / 32077948 / +3.4% 61238357 / 70515169 / -13.2% 🟢 0.54 / 0.45 / +19.0%
tpch_q02/duckdb:vortex-file-compressed 32166685 / 31689639 / +1.5% 46934352 / 45999869 / +2.0% 0.69 / 0.69 / -0.5%
tpch_q03/duckdb:vortex-file-compressed 51651345 / 52252090 / -1.1% 96254637 / 104288678 / -7.7% 0.54 / 0.50 / +7.1%
tpch_q04/duckdb:vortex-file-compressed 50535707 / 51363015 / -1.6% 81783060 / 88809134 / -7.9% 0.62 / 0.58 / +6.8%
tpch_q05/duckdb:vortex-file-compressed 69149612 / 68452969 / +1.0% 101032708 / 109042430 / -7.3% 0.68 / 0.63 / +9.0%
tpch_q06/duckdb:vortex-file-compressed 14622514 / 14744661 / -0.8% 48389738 / 53147272 / -9.0% 0.30 / 0.28 / +8.9%
tpch_q07/duckdb:vortex-file-compressed 55023177 / 54042271 / +1.8% 102536297 / 107217288 / -4.4% 0.54 / 0.50 / +6.5%
tpch_q08/duckdb:vortex-file-compressed 87124315 / 87867832 / -0.8% 126265177 / 135645945 / -6.9% 0.69 / 0.65 / +6.5%
tpch_q09/duckdb:vortex-file-compressed 95794278 / 98164827 / -2.4% 151326272 / 155130197 / -2.5% 0.63 / 0.63 / +0.0%
tpch_q10/duckdb:vortex-file-compressed 86544293 / 87134754 / -0.7% 137278823 / 139118698 / -1.3% 0.63 / 0.63 / +0.7%
tpch_q11/duckdb:vortex-file-compressed 13304194 / 13390970 / -0.6% 27313835 / 26765247 / +2.0% 0.49 / 0.50 / -2.6%
tpch_q12/duckdb:vortex-file-compressed 43680396 / 43546451 / +0.3% 77211225 / 83700266 / -7.8% 0.57 / 0.52 / +8.7%
tpch_q13/duckdb:vortex-file-compressed 68658123 / 67540566 / +1.7% 86548151 / 89707214 / -3.5% 0.79 / 0.75 / +5.4%
tpch_q14/duckdb:vortex-file-compressed 28390446 / 28563596 / -0.6% 68518185 / 72628672 / -5.7% 0.41 / 0.39 / +5.4%
tpch_q15/duckdb:vortex-file-compressed 24585561 / 24418965 / +0.7% 59964178 / 63395202 / -5.4% 0.41 / 0.39 / +6.4%
tpch_q16/duckdb:vortex-file-compressed 49558370 / 49970484 / -0.8% 57931011 / 58954296 / -1.7% 0.86 / 0.85 / +0.9%
tpch_q17/duckdb:vortex-file-compressed 34224335 / 34691816 / -1.3% 61908917 / 64570526 / -4.1% 0.55 / 0.54 / +2.9%
tpch_q18/duckdb:vortex-file-compressed 98110184 / 102146185 / -4.0% 115560597 / 119685578 / -3.4% 0.85 / 0.85 / -0.5%
tpch_q19/duckdb:vortex-file-compressed 25206480 / 25282184 / -0.3% 69516358 / 74371680 / -6.5% 0.36 / 0.34 / +6.7%
tpch_q20/duckdb:vortex-file-compressed 39124366 / 38634831 / +1.3% 85838996 / 87016480 / -1.4% 0.46 / 0.44 / +2.7%
tpch_q21/duckdb:vortex-file-compressed 94614585 / 93192133 / +1.5% 137441554 / 146063804 / -5.9% 0.69 / 0.64 / +7.9%
tpch_q22/duckdb:vortex-file-compressed 34450378 / 35119478 / -1.9% 50907891 / 51565567 / -1.3% 0.68 / 0.68 / -0.6%
duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 46420154 / 47401993 / -2.1% 68955704 / 76770526 / -10.2% 🟢 0.67 / 0.62 / +9.0%
tpch_q02/duckdb:vortex-compact 41554064 / 41375094 / +0.4% 55693370 / 54993206 / +1.3% 0.75 / 0.75 / -0.8%
tpch_q03/duckdb:vortex-compact 58580307 / 57410987 / +2.0% 88239311 / 95120195 / -7.2% 0.66 / 0.60 / +10.0%
tpch_q04/duckdb:vortex-compact 53527003 / 53359347 / +0.3% 76040972 / 77982220 / -2.5% 0.70 / 0.68 / +2.9%
tpch_q05/duckdb:vortex-compact 71965275 / 70892090 / +1.5% 98029499 / 102351882 / -4.2% 0.73 / 0.69 / +6.0%
tpch_q06/duckdb:vortex-compact 18963016 / 19492679 / -2.7% 44426569 / 52042761 / -14.6% 🟢 0.43 / 0.37 / +14.0%
tpch_q07/duckdb:vortex-compact 61005484 / 63287944 / -3.6% 96569669 / 106317060 / -9.2% 0.63 / 0.60 / +6.1%
tpch_q08/duckdb:vortex-compact 91095973 / 91532743 / -0.5% 123721006 / 127589625 / -3.0% 0.74 / 0.72 / +2.6%
tpch_q09/duckdb:vortex-compact 106360614 / 102861152 / +3.4% 148315602 / 153572533 / -3.4% 0.72 / 0.67 / +7.1%
tpch_q10/duckdb:vortex-compact 103524639 / 102699127 / +0.8% 134649967 / 141051207 / -4.5% 0.77 / 0.73 / +5.6%
tpch_q11/duckdb:vortex-compact 13799700 / 14196604 / -2.8% 27750522 / 26619391 / +4.2% 0.50 / 0.53 / -6.8%
tpch_q12/duckdb:vortex-compact 58754630 / 58109950 / +1.1% 79839961 / 82077501 / -2.7% 0.74 / 0.71 / +3.9%
tpch_q13/duckdb:vortex-compact 77273485 / 77160069 / +0.1% 93999366 / 94665912 / -0.7% 0.82 / 0.82 / +0.9%
tpch_q14/duckdb:vortex-compact 32789939 / 33022272 / -0.7% 63904472 / 69382535 / -7.9% 0.51 / 0.48 / +7.8%
tpch_q15/duckdb:vortex-compact 31089489 / 31134757 / -0.1% 61101545 / 63999984 / -4.5% 0.51 / 0.49 / +4.6%
tpch_q16/duckdb:vortex-compact 53398428 / 53882755 / -0.9% 64678533 / 65740685 / -1.6% 0.83 / 0.82 / +0.7%
tpch_q17/duckdb:vortex-compact 35831508 / 36597378 / -2.1% 61146400 / 67249681 / -9.1% 0.59 / 0.54 / +7.7%
tpch_q18/duckdb:vortex-compact 104440189 / 100273603 / +4.2% 117049597 / 117723880 / -0.6% 0.89 / 0.85 / +4.8%
tpch_q19/duckdb:vortex-compact 33061463 / 33453277 / -1.2% 69903803 / 75016956 / -6.8% 0.47 / 0.45 / +6.1%
tpch_q20/duckdb:vortex-compact 48462417 / 48924655 / -0.9% 87823615 / 94399716 / -7.0% 0.55 / 0.52 / +6.5%
tpch_q21/duckdb:vortex-compact 107056544 / 107336795 / -0.3% 143412607 / 148634392 / -3.5% 0.75 / 0.72 / +3.4%
tpch_q22/duckdb:vortex-compact 39447614 / 39711157 / -0.7% 55373257 / 56697154 / -2.3% 0.71 / 0.70 / +1.7%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68763859 / 68262903 / +0.7% 93477803 / 88536814 / +5.6% 0.74 / 0.77 / -4.6%
tpch_q02/duckdb:parquet 87562579 / 87656653 / -0.1% 97374993 / 99659690 / -2.3% 0.90 / 0.88 / +2.2%
tpch_q03/duckdb:parquet 111398748 / 111506958 / -0.1% 143177540 / 141440734 / +1.2% 0.78 / 0.79 / -1.3%
tpch_q04/duckdb:parquet 77441995 / 77574264 / -0.2% 98227950 / 99420174 / -1.2% 0.79 / 0.78 / +1.0%
tpch_q05/duckdb:parquet 124466044 / 124869472 / -0.3% 157676833 / 158164322 / -0.3% 0.79 / 0.79 / -0.0%
tpch_q06/duckdb:parquet 36598976 / 35794079 / +2.2% 57703757 / 61327927 / -5.9% 0.63 / 0.58 / +8.7%
tpch_q07/duckdb:parquet 118389849 / 117352182 / +0.9% 156866312 / 157089827 / -0.1% 0.75 / 0.75 / +1.0%
tpch_q08/duckdb:parquet 150220417 / 150500878 / -0.2% 190514810 / 195037624 / -2.3% 0.79 / 0.77 / +2.2%
tpch_q09/duckdb:parquet 237135826 / 238356231 / -0.5% 281355160 / 278458130 / +1.0% 0.84 / 0.86 / -1.5%
tpch_q10/duckdb:parquet 316460463 / 315937428 / +0.2% 343571470 / 344280953 / -0.2% 0.92 / 0.92 / +0.4%
tpch_q11/duckdb:parquet 43824076 / 43938893 / -0.3% 50616743 / 51316202 / -1.4% 0.87 / 0.86 / +1.1%
tpch_q12/duckdb:parquet 74068032 / 72804373 / +1.7% 89718465 / 92638335 / -3.2% 0.83 / 0.79 / +5.0%
tpch_q13/duckdb:parquet 294738676 / 293227096 / +0.5% 310916496 / 312586726 / -0.5% 0.95 / 0.94 / +1.1%
tpch_q14/duckdb:parquet 102009194 / 102160925 / -0.1% 137849421 / 138700487 / -0.6% 0.74 / 0.74 / +0.5%
tpch_q15/duckdb:parquet 58963355 / 58545984 / +0.7% 88543668 / 88765349 / -0.2% 0.67 / 0.66 / +1.0%
tpch_q16/duckdb:parquet 101349462 / 101830675 / -0.5% 107846453 / 109668032 / -1.7% 0.94 / 0.93 / +1.2%
tpch_q17/duckdb:parquet 82356517 / 81951009 / +0.5% 110973828 / 114997347 / -3.5% 0.74 / 0.71 / +4.1%
tpch_q18/duckdb:parquet 156578411 / 158384707 / -1.1% 167279022 / 172904089 / -3.3% 0.94 / 0.92 / +2.2%
tpch_q19/duckdb:parquet 101230450 / 99875581 / +1.4% 134134325 / 135151679 / -0.8% 0.75 / 0.74 / +2.1%
tpch_q20/duckdb:parquet 148404494 / 147572331 / +0.6% 184342908 / 186394590 / -1.1% 0.81 / 0.79 / +1.7%
tpch_q21/duckdb:parquet 257396243 / 258661149 / -0.5% 277686104 / 284540040 / -2.4% 0.93 / 0.91 / +2.0%
tpch_q22/duckdb:parquet 169257899 / 168980292 / +0.2% 183336162 / 184513322 / -0.6% 0.92 / 0.92 / +0.8%
duckdb / duckdb / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 24852507 / 24253173 / +2.5% 51971483 / 56725095 / -8.4% 0.48 / 0.43 / +11.8%
tpch_q02/duckdb:duckdb 20778670 / 20933763 / -0.7% 32708345 / 34952013 / -6.4% 0.64 / 0.60 / +6.1%
tpch_q03/duckdb:duckdb 45441635 / 45687018 / -0.5% 75569973 / 80194942 / -5.8% 0.60 / 0.57 / +5.6%
tpch_q04/duckdb:duckdb 56657486 / 55619492 / +1.9% 78311031 / 80550971 / -2.8% 0.72 / 0.69 / +4.8%
tpch_q05/duckdb:duckdb 60773066 / 59982147 / +1.3% 95584699 / 96242578 / -0.7% 0.64 / 0.62 / +2.0%
tpch_q06/duckdb:duckdb 15368152 / 14781274 / +4.0% 45754778 / 49625225 / -7.8% 0.34 / 0.30 / +12.8%
tpch_q07/duckdb:duckdb 44383194 / 43512293 / +2.0% 82806626 / 84666823 / -2.2% 0.54 / 0.51 / +4.3%
tpch_q08/duckdb:duckdb 67065304 / 66967080 / +0.1% 105650094 / 110767888 / -4.6% 0.63 / 0.60 / +5.0%
tpch_q09/duckdb:duckdb 77113930 / 76770886 / +0.4% 117407931 / 120478981 / -2.5% 0.66 / 0.64 / +3.1%
tpch_q10/duckdb:duckdb 93892259 / 92313467 / +1.7% 118736061 / 126738232 / -6.3% 0.79 / 0.73 / +8.6%
tpch_q11/duckdb:duckdb 10113251 / 10045870 / +0.7% 17706888 / 18024917 / -1.8% 0.57 / 0.56 / +2.5%
tpch_q12/duckdb:duckdb 40047758 / 40518357 / -1.2% 71845266 / 71433012 / +0.6% 0.56 / 0.57 / -1.7%
tpch_q13/duckdb:duckdb 102091488 / 100418886 / +1.7% 114139440 / 114601336 / -0.4% 0.89 / 0.88 / +2.1%
tpch_q14/duckdb:duckdb 33213065 / 32959701 / +0.8% 69202307 / 72588675 / -4.7% 0.48 / 0.45 / +5.7%
tpch_q15/duckdb:duckdb 25714551 / 25276563 / +1.7% 58408193 / 59383280 / -1.6% 0.44 / 0.43 / +3.4%
tpch_q16/duckdb:duckdb 45044970 / 45140921 / -0.2% 50943490 / 50865919 / +0.2% 0.88 / 0.89 / -0.4%
tpch_q17/duckdb:duckdb 26963891 / 26940674 / +0.1% 64012119 / 64937741 / -1.4% 0.42 / 0.41 / +1.5%
tpch_q18/duckdb:duckdb 72893335 / 71963761 / +1.3% 91356931 / 93092384 / -1.9% 0.80 / 0.77 / +3.2%
tpch_q19/duckdb:duckdb 29977818 / 29831475 / +0.5% 69085250 / 70543462 / -2.1% 0.43 / 0.42 / +2.6%
tpch_q20/duckdb:duckdb 38342169 / 38106850 / +0.6% 80172790 / 83980411 / -4.5% 0.48 / 0.45 / +5.4%
tpch_q21/duckdb:duckdb 65277920 / 64923481 / +0.5% 97265534 / 100206534 / -2.9% 0.67 / 0.65 / +3.6%
tpch_q22/duckdb:duckdb 35829583 / 35707477 / +0.3% 47514052 / 48093852 / -1.2% 0.75 / 0.74 / +1.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR e42f8876 vs base e4dce8b7
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-1.2%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15292467 / 15607835 / -2.0% 48004750 / 45507841 / +5.5% 0.32 / 0.34 / -7.1%
tpch_q02/datafusion:vortex-file-compressed 16817893 / 16796832 / +0.1% 37497182 / 36805512 / +1.9% 0.45 / 0.46 / -1.7%
tpch_q03/datafusion:vortex-file-compressed 19792425 / 19633819 / +0.8% 58581397 / 54107397 / +8.3% 0.34 / 0.36 / -6.9%
tpch_q04/datafusion:vortex-file-compressed 10427880 / 11138700 / -6.4% 36913246 / 36790061 / +0.3% 0.28 / 0.30 / -6.7%
tpch_q05/datafusion:vortex-file-compressed 37290297 / 37263118 / +0.1% 68756323 / 67505515 / +1.9% 0.54 / 0.55 / -1.7%
tpch_q06/datafusion:vortex-file-compressed 4179414 / 5873126 / -28.8% 🟢 31245067 / 33195445 / -5.9% 0.13 / 0.18 / -24.4%
tpch_q07/datafusion:vortex-file-compressed 51255385 / 52107116 / -1.6% 85144238 / 78010183 / +9.1% 0.60 / 0.67 / -9.9%
tpch_q08/datafusion:vortex-file-compressed 52306522 / 51992388 / +0.6% 86927485 / 88785000 / -2.1% 0.60 / 0.59 / +2.8%
tpch_q09/datafusion:vortex-file-compressed 47603108 / 47965526 / -0.8% 79974309 / 77919761 / +2.6% 0.60 / 0.62 / -3.3%
tpch_q10/datafusion:vortex-file-compressed 17160071 / 17788404 / -3.5% 50397449 / 54029704 / -6.7% 0.34 / 0.33 / +3.4%
tpch_q11/datafusion:vortex-file-compressed 13960659 / 13987638 / -0.2% 33504085 / 34892980 / -4.0% 0.42 / 0.40 / +3.9%
tpch_q12/datafusion:vortex-file-compressed 18135898 / 18450437 / -1.7% 43775296 / 43187900 / +1.4% 0.41 / 0.43 / -3.0%
tpch_q13/datafusion:vortex-file-compressed 18922814 / 19359674 / -2.3% 39004263 / 41051445 / -5.0% 0.49 / 0.47 / +2.9%
tpch_q14/datafusion:vortex-file-compressed 14815603 / 14795047 / +0.1% 38509132 / 39498372 / -2.5% 0.38 / 0.37 / +2.7%
tpch_q15/datafusion:vortex-file-compressed 18719728 / 18614935 / +0.6% 45149836 / 44949232 / +0.4% 0.41 / 0.41 / +0.1%
tpch_q16/datafusion:vortex-file-compressed 18463656 / 18332545 / +0.7% 41536373 / 43950533 / -5.5% 0.44 / 0.42 / +6.6%
tpch_q17/datafusion:vortex-file-compressed 28296308 / 27955439 / +1.2% 59745515 / 58275324 / +2.5% 0.47 / 0.48 / -1.3%
tpch_q18/datafusion:vortex-file-compressed 36866170 / 36081534 / +2.2% 59803939 / 60761802 / -1.6% 0.62 / 0.59 / +3.8%
tpch_q19/datafusion:vortex-file-compressed 11526391 / 12012013 / -4.0% 39605508 / 38743602 / +2.2% 0.29 / 0.31 / -6.1%
tpch_q20/datafusion:vortex-file-compressed 20432709 / 20215061 / +1.1% 46749723 / 48407596 / -3.4% 0.44 / 0.42 / +4.7%
tpch_q21/datafusion:vortex-file-compressed 40348842 / 38965459 / +3.6% 72211027 / 73730125 / -2.1% 0.56 / 0.53 / +5.7%
tpch_q22/datafusion:vortex-file-compressed 10406081 / 10758687 / -3.3% 31006445 / 30842443 / +0.5% 0.34 / 0.35 / -3.8%
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16381651 / 16059879 / +2.0% 44294814 / 44755457 / -1.0% 0.37 / 0.36 / +3.1%
tpch_q02/datafusion:vortex-compact 18322031 / 18320278 / +0.0% 38524016 / 37515122 / +2.7% 0.48 / 0.49 / -2.6%
tpch_q03/datafusion:vortex-compact 20351595 / 20326289 / +0.1% 50843951 / 46789381 / +8.7% 0.40 / 0.43 / -7.9%
tpch_q04/datafusion:vortex-compact 11224285 / 10922288 / +2.8% 34414926 / 33041734 / +4.2% 0.33 / 0.33 / -1.3%
tpch_q05/datafusion:vortex-compact 37502269 / 37300483 / +0.5% 66246532 / 65321339 / +1.4% 0.57 / 0.57 / -0.9%
tpch_q06/datafusion:vortex-compact 6729872 / 6874553 / -2.1% 28864439 / 27135658 / +6.4% 0.23 / 0.25 / -8.0%
tpch_q07/datafusion:vortex-compact 52269788 / 53291827 / -1.9% 77628085 / 80078929 / -3.1% 0.67 / 0.67 / +1.2%
tpch_q08/datafusion:vortex-compact 51722659 / 51672972 / +0.1% 81899562 / 80761419 / +1.4% 0.63 / 0.64 / -1.3%
tpch_q09/datafusion:vortex-compact 48971791 / 47607869 / +2.9% 76787168 / 78240619 / -1.9% 0.64 / 0.61 / +4.8%
tpch_q10/datafusion:vortex-compact 19792567 / 19646243 / +0.7% 50263544 / 49629565 / +1.3% 0.39 / 0.40 / -0.5%
tpch_q11/datafusion:vortex-compact 14592883 / 14495647 / +0.7% 34394115 / 34354334 / +0.1% 0.42 / 0.42 / +0.6%
tpch_q12/datafusion:vortex-compact 20081994 / 20006228 / +0.4% 42036089 / 44379676 / -5.3% 0.48 / 0.45 / +6.0%
tpch_q13/datafusion:vortex-compact 19581881 / 19982084 / -2.0% 43552724 / 39461175 / +10.4% 🔴 0.45 / 0.51 / -11.2%
tpch_q14/datafusion:vortex-compact 15178963 / 15542917 / -2.3% 41052139 / 40838910 / +0.5% 0.37 / 0.38 / -2.8%
tpch_q15/datafusion:vortex-compact 20377991 / 20599396 / -1.1% 47548791 / 47718183 / -0.4% 0.43 / 0.43 / -0.7%
tpch_q16/datafusion:vortex-compact 18991482 / 19135008 / -0.8% 41678822 / 42977785 / -3.0% 0.46 / 0.45 / +2.3%
tpch_q17/datafusion:vortex-compact 29088963 / 28595050 / +1.7% 56597144 / 60642850 / -6.7% 0.51 / 0.47 / +9.0%
tpch_q18/datafusion:vortex-compact 36442873 / 36159660 / +0.8% 58462933 / 60915190 / -4.0% 0.62 / 0.59 / +5.0%
tpch_q19/datafusion:vortex-compact 13645374 / 14154735 / -3.6% 39688922 / 39687102 / +0.0% 0.34 / 0.36 / -3.6%
tpch_q20/datafusion:vortex-compact 21151347 / 21208318 / -0.3% 46304314 / 47694968 / -2.9% 0.46 / 0.44 / +2.7%
tpch_q21/datafusion:vortex-compact 41094687 / 41328231 / -0.6% 71003736 / 72718867 / -2.4% 0.58 / 0.57 / +1.8%
tpch_q22/datafusion:vortex-compact 11076432 / 10936383 / +1.3% 32704437 / 32281243 / +1.3% 0.34 / 0.34 / -0.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71954743 / 71969113 / -0.0% 93703823 / 92802457 / +1.0% 0.77 / 0.78 / -1.0%
tpch_q02/datafusion:parquet 75595919 / 75770541 / -0.2% 98111478 / 94880353 / +3.4% 0.77 / 0.80 / -3.5%
tpch_q03/datafusion:parquet 83940515 / 83766864 / +0.2% 109454968 / 112208368 / -2.5% 0.77 / 0.75 / +2.7%
tpch_q04/datafusion:parquet 40373733 / 40671073 / -0.7% 64831767 / 61949435 / +4.7% 0.62 / 0.66 / -5.1%
tpch_q05/datafusion:parquet 112856640 / 112246238 / +0.5% 142837596 / 145114520 / -1.6% 0.79 / 0.77 / +2.1%
tpch_q06/datafusion:parquet 32171554 / 32161848 / +0.0% 50345194 / 54816934 / -8.2% 0.64 / 0.59 / +8.9%
tpch_q07/datafusion:parquet 115011500 / 115500290 / -0.4% 141740531 / 145126856 / -2.3% 0.81 / 0.80 / +2.0%
tpch_q08/datafusion:parquet 119454074 / 120138450 / -0.6% 149953740 / 151639013 / -1.1% 0.80 / 0.79 / +0.5%
tpch_q09/datafusion:parquet 140535619 / 140188485 / +0.2% 173132802 / 172161059 / +0.6% 0.81 / 0.81 / -0.3%
tpch_q10/datafusion:parquet 106240314 / 105984527 / +0.2% 137091489 / 133218267 / +2.9% 0.77 / 0.80 / -2.6%
tpch_q11/datafusion:parquet 61190804 / 60607001 / +1.0% 86060784 / 86432821 / -0.4% 0.71 / 0.70 / +1.4%
tpch_q12/datafusion:parquet 64960642 / 65713999 / -1.1% 88686072 / 87018326 / +1.9% 0.73 / 0.76 / -3.0%
tpch_q13/datafusion:parquet 146516409 / 147629440 / -0.8% 171876101 / 170891764 / +0.6% 0.85 / 0.86 / -1.3%
tpch_q14/datafusion:parquet 47777893 / 47924506 / -0.3% 77040807 / 77808188 / -1.0% 0.62 / 0.62 / +0.7%
tpch_q15/datafusion:parquet 74809962 / 75125752 / -0.4% 100814320 / 102479453 / -1.6% 0.74 / 0.73 / +1.2%
tpch_q16/datafusion:parquet 44420381 / 43795938 / +1.4% 65618553 / 63935867 / +2.6% 0.68 / 0.68 / -1.2%
tpch_q17/datafusion:parquet 124271691 / 123682628 / +0.5% 150585744 / 150467220 / +0.1% 0.83 / 0.82 / +0.4%
tpch_q18/datafusion:parquet 124153172 / 123392142 / +0.6% 147288077 / 146483887 / +0.5% 0.84 / 0.84 / +0.1%
tpch_q19/datafusion:parquet 58264095 / 58866299 / -1.0% 87357674 / 84837324 / +3.0% 0.67 / 0.69 / -3.9%
tpch_q20/datafusion:parquet 79543181 / 78589102 / +1.2% 104528405 / 108098748 / -3.3% 0.76 / 0.73 / +4.7%
tpch_q21/datafusion:parquet 117136238 / 116874255 / +0.2% 142513034 / 143490399 / -0.7% 0.82 / 0.81 / +0.9%
tpch_q22/datafusion:parquet 52013735 / 51145448 / +1.7% 73120600 / 72915625 / +0.3% 0.71 / 0.70 / +1.4%
duckdb / vortex-file-compressed / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8350759 / 9383105 / -11.0% 🟢 21768864 / 19623594 / +10.9% 🔴 0.38 / 0.48 / -19.8%
tpch_q02/duckdb:vortex-file-compressed 15380732 / 15990209 / -3.8% 25418146 / 26301474 / -3.4% 0.61 / 0.61 / -0.5%
tpch_q03/duckdb:vortex-file-compressed 18092126 / 18199731 / -0.6% 33684173 / 34754248 / -3.1% 0.54 / 0.52 / +2.6%
tpch_q04/duckdb:vortex-file-compressed 12236405 / 12246623 / -0.1% 26519404 / 26460940 / +0.2% 0.46 / 0.46 / -0.3%
tpch_q05/duckdb:vortex-file-compressed 20854953 / 20205740 / +3.2% 33622177 / 33605992 / +0.0% 0.62 / 0.60 / +3.2%
tpch_q06/duckdb:vortex-file-compressed 4730837 / 4748184 / -0.4% 14547207 / 16516268 / -11.9% 🟢 0.33 / 0.29 / +13.1%
tpch_q07/duckdb:vortex-file-compressed 24055487 / 23965441 / +0.4% 37951840 / 39781401 / -4.6% 0.63 / 0.60 / +5.2%
tpch_q08/duckdb:vortex-file-compressed 21270972 / 21101720 / +0.8% 36648952 / 39216010 / -6.5% 0.58 / 0.54 / +7.9%
tpch_q09/duckdb:vortex-file-compressed 21623710 / 21675153 / -0.2% 37409878 / 37355023 / +0.1% 0.58 / 0.58 / -0.4%
tpch_q10/duckdb:vortex-file-compressed 27174805 / 26969375 / +0.8% 42439856 / 41744635 / +1.7% 0.64 / 0.65 / -0.9%
tpch_q11/duckdb:vortex-file-compressed 8324147 / 8406158 / -1.0% 17590534 / 20474469 / -14.1% 🟢 0.47 / 0.41 / +15.3%
tpch_q12/duckdb:vortex-file-compressed 14004091 / 14206389 / -1.4% 27782947 / 27243187 / +2.0% 0.50 / 0.52 / -3.3%
tpch_q13/duckdb:vortex-file-compressed 23379934 / 23589899 / -0.9% 32520495 / 32763713 / -0.7% 0.72 / 0.72 / -0.1%
tpch_q14/duckdb:vortex-file-compressed 11682423 / 11483867 / +1.7% 24251509 / 24299007 / -0.2% 0.48 / 0.47 / +1.9%
tpch_q15/duckdb:vortex-file-compressed 8517487 / 8560995 / -0.5% 20054110 / 19792769 / +1.3% 0.42 / 0.43 / -1.8%
tpch_q16/duckdb:vortex-file-compressed 16549704 / 16600884 / -0.3% 24080515 / 24367938 / -1.2% 0.69 / 0.68 / +0.9%
tpch_q17/duckdb:vortex-file-compressed 12148255 / 12141785 / +0.1% 25571369 / 26642745 / -4.0% 0.48 / 0.46 / +4.2%
tpch_q18/duckdb:vortex-file-compressed 23767233 / 24022389 / -1.1% 33755395 / 33623510 / +0.4% 0.70 / 0.71 / -1.4%
tpch_q19/duckdb:vortex-file-compressed 10824547 / 11238316 / -3.7% 23883715 / 23474357 / +1.7% 0.45 / 0.48 / -5.3%
tpch_q20/duckdb:vortex-file-compressed 14340717 / 14187408 / +1.1% 29878463 / 29161926 / +2.5% 0.48 / 0.49 / -1.3%
tpch_q21/duckdb:vortex-file-compressed 36797472 / 36427795 / +1.0% 56559600 / 55881969 / +1.2% 0.65 / 0.65 / -0.2%
tpch_q22/duckdb:vortex-file-compressed 18923031 / 19171658 / -1.3% 30976588 / 28743634 / +7.8% 0.61 / 0.67 / -8.4%
duckdb / vortex-compact / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 9706502 / 10194427 / -4.8% 21218821 / 21584823 / -1.7% 0.46 / 0.47 / -3.1%
tpch_q02/duckdb:vortex-compact 18791914 / 18410374 / +2.1% 28517207 / 28007679 / +1.8% 0.66 / 0.66 / +0.2%
tpch_q03/duckdb:vortex-compact 19552167 / 19417394 / +0.7% 34502546 / 34792856 / -0.8% 0.57 / 0.56 / +1.5%
tpch_q04/duckdb:vortex-compact 12908170 / 12560870 / +2.8% 24068140 / 25375164 / -5.2% 0.54 / 0.50 / +8.3%
tpch_q05/duckdb:vortex-compact 21230512 / 20950939 / +1.3% 33753455 / 34148413 / -1.2% 0.63 / 0.61 / +2.5%
tpch_q06/duckdb:vortex-compact 5198391 / 5253561 / -1.1% 15960402 / 16118936 / -1.0% 0.33 / 0.33 / -0.1%
tpch_q07/duckdb:vortex-compact 25054860 / 25297115 / -1.0% 40972205 / 41424738 / -1.1% 0.61 / 0.61 / +0.1%
tpch_q08/duckdb:vortex-compact 22348055 / 22521442 / -0.8% 36909849 / 37792504 / -2.3% 0.61 / 0.60 / +1.6%
tpch_q09/duckdb:vortex-compact 24576511 / 24669136 / -0.4% 39272123 / 37959385 / +3.5% 0.63 / 0.65 / -3.7%
tpch_q10/duckdb:vortex-compact 38169153 / 37833492 / +0.9% 52629907 / 52880467 / -0.5% 0.73 / 0.72 / +1.4%
tpch_q11/duckdb:vortex-compact 8721940 / 8715399 / +0.1% 17289884 / 17742863 / -2.6% 0.50 / 0.49 / +2.7%
tpch_q12/duckdb:vortex-compact 17430555 / 17412319 / +0.1% 27835518 / 27921536 / -0.3% 0.63 / 0.62 / +0.4%
tpch_q13/duckdb:vortex-compact 26586999 / 26720958 / -0.5% 35794410 / 35171071 / +1.8% 0.74 / 0.76 / -2.2%
tpch_q14/duckdb:vortex-compact 12441619 / 12299644 / +1.2% 25357325 / 26099109 / -2.8% 0.49 / 0.47 / +4.1%
tpch_q15/duckdb:vortex-compact 9543918 / 9586811 / -0.4% 21931045 / 22367475 / -2.0% 0.44 / 0.43 / +1.5%
tpch_q16/duckdb:vortex-compact 17457474 / 17564199 / -0.6% 24000068 / 23916265 / +0.4% 0.73 / 0.73 / -1.0%
tpch_q17/duckdb:vortex-compact 13226395 / 13186825 / +0.3% 28582382 / 27242606 / +4.9% 0.46 / 0.48 / -4.4%
tpch_q18/duckdb:vortex-compact 25037569 / 24022982 / +4.2% 33721099 / 32925017 / +2.4% 0.74 / 0.73 / +1.8%
tpch_q19/duckdb:vortex-compact 14210354 / 14132815 / +0.5% 27509169 / 27274877 / +0.9% 0.52 / 0.52 / -0.3%
tpch_q20/duckdb:vortex-compact 19717666 / 19053236 / +3.5% 33598629 / 32663307 / +2.9% 0.59 / 0.58 / +0.6%
tpch_q21/duckdb:vortex-compact 38775916 / 38773862 / +0.0% 56287031 / 56255641 / +0.1% 0.69 / 0.69 / -0.1%
tpch_q22/duckdb:vortex-compact 23741350 / 23749517 / -0.0% 34948296 / 33306398 / +4.9% 0.68 / 0.71 / -4.7%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48588010 / 48351838 / +0.5% 55245958 / 55210341 / +0.1% 0.88 / 0.88 / +0.4%
tpch_q02/duckdb:parquet 48782800 / 49481794 / -1.4% 56485247 / 56264691 / +0.4% 0.86 / 0.88 / -1.8%
tpch_q03/duckdb:parquet 60670439 / 60829180 / -0.3% 69366795 / 70421407 / -1.5% 0.87 / 0.86 / +1.3%
tpch_q04/duckdb:parquet 35316858 / 35385639 / -0.2% 44567053 / 44192723 / +0.8% 0.79 / 0.80 / -1.0%
tpch_q05/duckdb:parquet 67715973 / 67885116 / -0.2% 78069484 / 78905084 / -1.1% 0.87 / 0.86 / +0.8%
tpch_q06/duckdb:parquet 22327414 / 22027640 / +1.4% 28109583 / 27742026 / +1.3% 0.79 / 0.79 / +0.0%
tpch_q07/duckdb:parquet 64584762 / 64701172 / -0.2% 73830002 / 75553958 / -2.3% 0.87 / 0.86 / +2.2%
tpch_q08/duckdb:parquet 76252629 / 76552886 / -0.4% 87576089 / 88332438 / -0.9% 0.87 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 107789427 / 108784087 / -0.9% 120068737 / 120280086 / -0.2% 0.90 / 0.90 / -0.7%
tpch_q10/duckdb:parquet 106596994 / 107017645 / -0.4% 118516975 / 119062376 / -0.5% 0.90 / 0.90 / +0.1%
tpch_q11/duckdb:parquet 29876697 / 29917826 / -0.1% 35000114 / 35444727 / -1.3% 0.85 / 0.84 / +1.1%
tpch_q12/duckdb:parquet 38162638 / 38194529 / -0.1% 45618135 / 45189487 / +0.9% 0.84 / 0.85 / -1.0%
tpch_q13/duckdb:parquet 175261357 / 176707536 / -0.8% 182247110 / 185048237 / -1.5% 0.96 / 0.95 / +0.7%
tpch_q14/duckdb:parquet 42940241 / 42795246 / +0.3% 51361097 / 51947176 / -1.1% 0.84 / 0.82 / +1.5%
tpch_q15/duckdb:parquet 33074692 / 33046835 / +0.1% 41793902 / 42420739 / -1.5% 0.79 / 0.78 / +1.6%
tpch_q16/duckdb:parquet 48047399 / 48418364 / -0.8% 53274395 / 54103027 / -1.5% 0.90 / 0.89 / +0.8%
tpch_q17/duckdb:parquet 48306796 / 48340897 / -0.1% 57597860 / 58411266 / -1.4% 0.84 / 0.83 / +1.3%
tpch_q18/duckdb:parquet 74646651 / 75312189 / -0.9% 81716961 / 82508427 / -1.0% 0.91 / 0.91 / +0.1%
tpch_q19/duckdb:parquet 51675477 / 50025434 / +3.3% 58045640 / 58705277 / -1.1% 0.89 / 0.85 / +4.5%
tpch_q20/duckdb:parquet 63905872 / 64061145 / -0.2% 75068726 / 75382665 / -0.4% 0.85 / 0.85 / +0.2%
tpch_q21/duckdb:parquet 107467826 / 107675898 / -0.2% 118439599 / 117483370 / +0.8% 0.91 / 0.92 / -1.0%
tpch_q22/duckdb:parquet 50798074 / 51326224 / -1.0% 60244295 / 60592045 / -0.6% 0.84 / 0.85 / -0.5%
duckdb / duckdb / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 6560242 / 6622230 / -0.9% 14917945 / 14346419 / +4.0% 0.44 / 0.46 / -4.7%
tpch_q02/duckdb:duckdb 9118873 / 8981433 / +1.5% 17350987 / 17037338 / +1.8% 0.53 / 0.53 / -0.3%
tpch_q03/duckdb:duckdb 15649355 / 15668242 / -0.1% 26573581 / 26197292 / +1.4% 0.59 / 0.60 / -1.5%
tpch_q04/duckdb:duckdb 11545986 / 11464430 / +0.7% 21414843 / 20780908 / +3.1% 0.54 / 0.55 / -2.3%
tpch_q05/duckdb:duckdb 15679169 / 15947158 / -1.7% 26867919 / 26665996 / +0.8% 0.58 / 0.60 / -2.4%
tpch_q06/duckdb:duckdb 3241102 / 3256995 / -0.5% 10753838 / 10061397 / +6.9% 0.30 / 0.32 / -6.9%
tpch_q07/duckdb:duckdb 18419390 / 18460573 / -0.2% 30470445 / 30171964 / +1.0% 0.60 / 0.61 / -1.2%
tpch_q08/duckdb:duckdb 17584928 / 17467405 / +0.7% 31083711 / 30768691 / +1.0% 0.57 / 0.57 / -0.3%
tpch_q09/duckdb:duckdb 23930790 / 24124752 / -0.8% 37619577 / 37482230 / +0.4% 0.64 / 0.64 / -1.2%
tpch_q10/duckdb:duckdb 29279521 / 29405512 / -0.4% 44066521 / 41556623 / +6.0% 0.66 / 0.71 / -6.1%
tpch_q11/duckdb:duckdb 5954813 / 5954715 / +0.0% 12222176 / 12281079 / -0.5% 0.49 / 0.48 / +0.5%
tpch_q12/duckdb:duckdb 10919402 / 10848952 / +0.6% 19918178 / 20418639 / -2.5% 0.55 / 0.53 / +3.2%
tpch_q13/duckdb:duckdb 32238085 / 32269942 / -0.1% 40414350 / 40975414 / -1.4% 0.80 / 0.79 / +1.3%
tpch_q14/duckdb:duckdb 12856900 / 12758019 / +0.8% 22648599 / 21997442 / +3.0% 0.57 / 0.58 / -2.1%
tpch_q15/duckdb:duckdb 7054926 / 7073195 / -0.3% 17920428 / 18727149 / -4.3% 0.39 / 0.38 / +4.2%
tpch_q16/duckdb:duckdb 19108063 / 19523413 / -2.1% 24963989 / 25038926 / -0.3% 0.77 / 0.78 / -1.8%
tpch_q17/duckdb:duckdb 8441991 / 8492744 / -0.6% 18467348 / 18342187 / +0.7% 0.46 / 0.46 / -1.3%
tpch_q18/duckdb:duckdb 18481846 / 18661379 / -1.0% 27218815 / 26673516 / +2.0% 0.68 / 0.70 / -2.9%
tpch_q19/duckdb:duckdb 12864885 / 13044563 / -1.4% 22623165 / 22548200 / +0.3% 0.57 / 0.58 / -1.7%
tpch_q20/duckdb:duckdb 14459485 / 14568888 / -0.8% 27561044 / 27477934 / +0.3% 0.52 / 0.53 / -1.1%
tpch_q21/duckdb:duckdb 22305097 / 22182014 / +0.6% 33931093 / 33599586 / +1.0% 0.66 / 0.66 / -0.4%
tpch_q22/duckdb:duckdb 23311037 / 23533262 / -0.9% 32649939 / 32088522 / +1.7% 0.71 / 0.73 / -2.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR e42f8876 vs base 705911cd
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.010x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.996x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed 52772209 / 52616081 / +0.3% 77223473 / 72583741 / +6.4% 0.68 / 0.72 / -5.7%
appian_q02/datafusion:vortex-file-compressed 227183726 / 226906840 / +0.1% 273037605 / 263705124 / +3.5% 0.83 / 0.86 / -3.3%
appian_q03/datafusion:vortex-file-compressed 141931320 / 141829103 / +0.1% 185922940 / 192887863 / -3.6% 0.76 / 0.74 / +3.8%
appian_q04/datafusion:vortex-file-compressed 9617417292 / 9636568809 / -0.2% 9684346784 / 9746103239 / -0.6% 0.99 / 0.99 / +0.4%
appian_q05/datafusion:vortex-file-compressed 133180842 / 135071707 / -1.4% 171752477 / 163411258 / +5.1% 0.78 / 0.83 / -6.2%
appian_q06/datafusion:vortex-file-compressed 138758657 / 139106585 / -0.3% 170700463 / 163854716 / +4.2% 0.81 / 0.85 / -4.3%
appian_q07/datafusion:vortex-file-compressed 157973561 / 155596013 / +1.5% 200755399 / 199467230 / +0.6% 0.79 / 0.78 / +0.9%
appian_q08/datafusion:vortex-file-compressed 526638666 / 517881390 / +1.7% 593484356 / 574478462 / +3.3% 0.89 / 0.90 / -1.6%
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52992613 / 52361183 / +1.2% 77506932 / 72729084 / +6.6% 0.68 / 0.72 / -5.0%
appian_q02/datafusion:vortex-compact 228734003 / 228505483 / +0.1% 270554939 / 265219029 / +2.0% 0.85 / 0.86 / -1.9%
appian_q03/datafusion:vortex-compact 144450410 / 144849521 / -0.3% 194311817 / 185732965 / +4.6% 0.74 / 0.78 / -4.7%
appian_q04/datafusion:vortex-compact 9636733047 / 9623111037 / +0.1% 9677745052 / 9710243147 / -0.3% 1.00 / 0.99 / +0.5%
appian_q05/datafusion:vortex-compact 133171897 / 134109614 / -0.7% 164933333 / 166065546 / -0.7% 0.81 / 0.81 / -0.0%
appian_q06/datafusion:vortex-compact 141603499 / 142150345 / -0.4% 166011390 / 166500643 / -0.3% 0.85 / 0.85 / -0.1%
appian_q07/datafusion:vortex-compact 160649132 / 159203781 / +0.9% 200876519 / 190544902 / +5.4% 0.80 / 0.84 / -4.3%
appian_q08/datafusion:vortex-compact 536610012 / 527452987 / +1.7% 583647984 / 604810925 / -3.5% 0.92 / 0.87 / +5.4%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72819787 / 72178087 / +0.9% 93688682 / 93341814 / +0.4% 0.78 / 0.77 / +0.5%
appian_q02/datafusion:parquet 293075907 / 292140596 / +0.3% 333998348 / 332080418 / +0.6% 0.88 / 0.88 / -0.3%
appian_q03/datafusion:parquet 186334158 / 186276852 / +0.0% 231188215 / 231989354 / -0.3% 0.81 / 0.80 / +0.4%
appian_q04/datafusion:parquet 9680736400 / 9657809282 / +0.2% 9775306232 / 9743871374 / +0.3% 0.99 / 0.99 / -0.1%
appian_q05/datafusion:parquet 193656823 / 196254648 / -1.3% 221547105 / 221894290 / -0.2% 0.87 / 0.88 / -1.2%
appian_q06/datafusion:parquet 165941901 / 167722094 / -1.1% 188014462 / 194785399 / -3.5% 0.88 / 0.86 / +2.5%
appian_q07/datafusion:parquet 205177336 / 205878592 / -0.3% 238332383 / 236607866 / +0.7% 0.86 / 0.87 / -1.1%
appian_q08/datafusion:parquet 633430574 / 631973748 / +0.2% 699356870 / 692775585 / +0.9% 0.91 / 0.91 / -0.7%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed 83732347 / 85335098 / -1.9% 98157347 / 102809824 / -4.5% 0.85 / 0.83 / +2.8%
appian_q02/duckdb:vortex-file-compressed 243758820 / 241232219 / +1.0% 260731769 / 250891224 / +3.9% 0.93 / 0.96 / -2.8%
appian_q03/duckdb:vortex-file-compressed 112690386 / 113024347 / -0.3% 135031917 / 134232428 / +0.6% 0.83 / 0.84 / -0.9%
appian_q04/duckdb:vortex-file-compressed 626205619 / 609591968 / +2.7% 610310079 / 649277618 / -6.0% 1.03 / 0.94 / +9.3%
appian_q05/duckdb:vortex-file-compressed 117555849 / 118906641 / -1.1% 133807303 / 132750836 / +0.8% 0.88 / 0.90 / -1.9%
appian_q06/duckdb:vortex-file-compressed 196384723 / 197563937 / -0.6% 200916553 / 210342133 / -4.5% 0.98 / 0.94 / +4.1%
appian_q07/duckdb:vortex-file-compressed 117960950 / 118796446 / -0.7% 135095880 / 134654022 / +0.3% 0.87 / 0.88 / -1.0%
appian_q08/duckdb:vortex-file-compressed 342062201 / 339596836 / +0.7% 374806197 / 376517103 / -0.5% 0.91 / 0.90 / +1.2%
duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 83613906 / 86046017 / -2.8% 102613290 / 99928401 / +2.7% 0.81 / 0.86 / -5.4%
appian_q02/duckdb:vortex-compact 240754123 / 242179132 / -0.6% 267169646 / 255972532 / +4.4% 0.90 / 0.95 / -4.8%
appian_q03/duckdb:vortex-compact 114300042 / 115710723 / -1.2% 133213595 / 132484816 / +0.6% 0.86 / 0.87 / -1.8%
appian_q04/duckdb:vortex-compact 633854606 / 626671213 / +1.1% 669053199 / 627361590 / +6.6% 0.95 / 1.00 / -5.2%
appian_q05/duckdb:vortex-compact 117986974 / 117873326 / +0.1% 145592401 / 133798566 / +8.8% 0.81 / 0.88 / -8.0%
appian_q06/duckdb:vortex-compact 197880825 / 202045252 / -2.1% 210089181 / 207903796 / +1.1% 0.94 / 0.97 / -3.1%
appian_q07/duckdb:vortex-compact 119807951 / 120094455 / -0.2% 126562343 / 139267834 / -9.1% 0.95 / 0.86 / +9.8%
appian_q08/duckdb:vortex-compact 340280118 / 343561892 / -1.0% 367107417 / 373618997 / -1.7% 0.93 / 0.92 / +0.8%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 97118334 / 94705317 / +2.5% 99656054 / 102430218 / -2.7% 0.97 / 0.92 / +5.4%
appian_q02/duckdb:parquet 245441162 / 246219722 / -0.3% 259044354 / 263447061 / -1.7% 0.95 / 0.93 / +1.4%
appian_q03/duckdb:parquet 132921367 / 132940429 / -0.0% 140051235 / 142147721 / -1.5% 0.95 / 0.94 / +1.5%
appian_q04/duckdb:parquet 489873896 / 484474864 / +1.1% 488223412 / 500412886 / -2.4% 1.00 / 0.97 / +3.6%
appian_q05/duckdb:parquet 133529942 / 133752666 / -0.2% 142192478 / 136812050 / +3.9% 0.94 / 0.98 / -3.9%
appian_q06/duckdb:parquet 115096150 / 115661488 / -0.5% 121359667 / 119585316 / +1.5% 0.95 / 0.97 / -1.9%
appian_q07/duckdb:parquet 109612522 / 109451287 / +0.1% 125630473 / 125651215 / -0.0% 0.87 / 0.87 / +0.2%
appian_q08/duckdb:parquet 362897852 / 368905594 / -1.6% 366864179 / 373096033 / -1.7% 0.99 / 0.99 / +0.0%
duckdb / duckdb / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb 77817188 / 79720517 / -2.4% 90279957 / 91007064 / -0.8% 0.86 / 0.88 / -1.6%
appian_q02/duckdb:duckdb 222141553 / 219729294 / +1.1% 227994096 / 223121015 / +2.2% 0.97 / 0.98 / -1.1%
appian_q03/duckdb:duckdb 85299824 / 85368673 / -0.1% 95339335 / 95814933 / -0.5% 0.89 / 0.89 / +0.4%
appian_q04/duckdb:duckdb 546656380 / 536445993 / +1.9% 554147611 / 561767618 / -1.4% 0.99 / 0.95 / +3.3%
appian_q05/duckdb:duckdb 110086411 / 108306798 / +1.6% 121078590 / 120898949 / +0.1% 0.91 / 0.90 / +1.5%
appian_q06/duckdb:duckdb 185622905 / 188106857 / -1.3% 190748808 / 190323287 / +0.2% 0.97 / 0.99 / -1.5%
appian_q07/duckdb:duckdb 87778779 / 88255366 / -0.5% 101814602 / 102090786 / -0.3% 0.86 / 0.86 / -0.3%
appian_q08/duckdb:duckdb 312646187 / 326264700 / -4.2% 330667993 / 335218868 / -1.4% 0.95 / 0.97 / -2.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR e42f8876 vs base e4dce8b7
Vortex (geomean): hot 1.772x ❌ · cold 1.481x ❌


datafusion / vortex-file-compressed / ns (1.772x ❌, 0↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 185961837 / 44542838 / +317.5% 🔴 236577748 / 89892344 / +163.2% 🔴 0.79 / 0.50 / +58.6%
polarsignals_q01/datafusion:vortex-file-compressed 196632360 / 50214840 / +291.6% 🔴 265676411 / 113889124 / +133.3% 🔴 0.74 / 0.44 / +67.9%
polarsignals_q02/datafusion:vortex-file-compressed 42731800 / 43719912 / -2.3% 87238013 / 86090170 / +1.3% 0.49 / 0.51 / -3.5%
polarsignals_q03/datafusion:vortex-file-compressed 200059424 / 53425202 / +274.5% 🔴 262065722 / 115285323 / +127.3% 🔴 0.76 / 0.46 / +64.7%
polarsignals_q04/datafusion:vortex-file-compressed 12534765 / 9302224 / +34.8% 🔴 50141125 / 44753886 / +12.0% 🔴 0.25 / 0.21 / +20.3%
polarsignals_q05/datafusion:vortex-file-compressed 14184442 / 11759190 / +20.6% 🔴 55556581 / 49264118 / +12.8% 🔴 0.26 / 0.24 / +7.0%
polarsignals_q06/datafusion:vortex-file-compressed 23468594 / 23731105 / -1.1% 63599360 / 59138928 / +7.5% 0.37 / 0.40 / -8.0%
polarsignals_q07/datafusion:vortex-file-compressed 14368147 / 10927024 / +31.5% 🔴 56378269 / 45867334 / +22.9% 🔴 0.25 / 0.24 / +7.0%
polarsignals_q08/datafusion:vortex-file-compressed 243383514 / 97959968 / +148.5% 🔴 307182151 / 157519393 / +95.0% 🔴 0.79 / 0.62 / +27.4%
polarsignals_q09/datafusion:vortex-file-compressed 9842067 / 10124616 / -2.8% 47246846 / 42928250 / +10.1% 🔴 0.21 / 0.24 / -11.7%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: JOB on NVME 📖

Commits: PR e42f8876 vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

No baseline is available for this benchmark yet; PR measurements are shown without comparison.


duckdb / vortex-file-compressed / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:vortex-file-compressed 14103906 / — / no baseline 28592899 / — / no baseline 0.49 / — / no baseline
job_q02/duckdb:vortex-file-compressed 25814007 / — / no baseline 42039256 / — / no baseline 0.61 / — / no baseline
job_q03/duckdb:vortex-file-compressed 16281896 / — / no baseline 32483685 / — / no baseline 0.50 / — / no baseline
job_q04/duckdb:vortex-file-compressed 27838895 / — / no baseline 45517515 / — / no baseline 0.61 / — / no baseline
job_q05/duckdb:vortex-file-compressed 20159656 / — / no baseline 39150253 / — / no baseline 0.51 / — / no baseline
job_q06/duckdb:vortex-file-compressed 16817079 / — / no baseline 34654307 / — / no baseline 0.49 / — / no baseline
job_q07/duckdb:vortex-file-compressed 10840433 / — / no baseline 28680292 / — / no baseline 0.38 / — / no baseline
job_q08/duckdb:vortex-file-compressed 22313589 / — / no baseline 40724682 / — / no baseline 0.55 / — / no baseline
job_q09/duckdb:vortex-file-compressed 27369428 / — / no baseline 62597291 / — / no baseline 0.44 / — / no baseline
job_q10/duckdb:vortex-file-compressed 26046410 / — / no baseline 63444762 / — / no baseline 0.41 / — / no baseline
job_q100/duckdb:vortex-file-compressed 44736012 / — / no baseline 89744118 / — / no baseline 0.50 / — / no baseline
job_q101/duckdb:vortex-file-compressed 43261277 / — / no baseline 87729140 / — / no baseline 0.49 / — / no baseline
job_q102/duckdb:vortex-file-compressed 77492387 / — / no baseline 125777112 / — / no baseline 0.62 / — / no baseline
job_q103/duckdb:vortex-file-compressed 55454231 / — / no baseline 96613259 / — / no baseline 0.57 / — / no baseline
job_q104/duckdb:vortex-file-compressed 44421290 / — / no baseline 85194615 / — / no baseline 0.52 / — / no baseline
job_q105/duckdb:vortex-file-compressed 74337244 / — / no baseline 119333573 / — / no baseline 0.62 / — / no baseline
job_q106/duckdb:vortex-file-compressed 52910942 / — / no baseline 95700855 / — / no baseline 0.55 / — / no baseline
job_q107/duckdb:vortex-file-compressed 50733474 / — / no baseline 93143702 / — / no baseline 0.54 / — / no baseline
job_q108/duckdb:vortex-file-compressed 53762454 / — / no baseline 97749184 / — / no baseline 0.55 / — / no baseline
job_q109/duckdb:vortex-file-compressed 11719390 / — / no baseline 27422202 / — / no baseline 0.43 / — / no baseline
job_q11/duckdb:vortex-file-compressed 29870722 / — / no baseline 64624445 / — / no baseline 0.46 / — / no baseline
job_q110/duckdb:vortex-file-compressed 18792965 / — / no baseline 35484881 / — / no baseline 0.53 / — / no baseline
job_q111/duckdb:vortex-file-compressed 30025282 / — / no baseline 51679500 / — / no baseline 0.58 / — / no baseline
job_q112/duckdb:vortex-file-compressed 29693170 / — / no baseline 50956312 / — / no baseline 0.58 / — / no baseline
job_q113/duckdb:vortex-file-compressed 34191611 / — / no baseline 55521642 / — / no baseline 0.62 / — / no baseline
job_q12/duckdb:vortex-file-compressed 44296708 / — / no baseline 62361288 / — / no baseline 0.71 / — / no baseline
job_q13/duckdb:vortex-file-compressed 16744976 / — / no baseline 33375977 / — / no baseline 0.50 / — / no baseline
job_q14/duckdb:vortex-file-compressed 59194702 / — / no baseline 77076835 / — / no baseline 0.77 / — / no baseline
job_q15/duckdb:vortex-file-compressed 26930046 / — / no baseline 61316443 / — / no baseline 0.44 / — / no baseline
job_q16/duckdb:vortex-file-compressed 25726298 / — / no baseline 60308387 / — / no baseline 0.43 / — / no baseline
job_q17/duckdb:vortex-file-compressed 36090200 / — / no baseline 70519569 / — / no baseline 0.51 / — / no baseline
job_q18/duckdb:vortex-file-compressed 29527047 / — / no baseline 59791285 / — / no baseline 0.49 / — / no baseline
job_q19/duckdb:vortex-file-compressed 18126574 / — / no baseline 45320119 / — / no baseline 0.40 / — / no baseline
job_q20/duckdb:vortex-file-compressed 18030775 / — / no baseline 46580612 / — / no baseline 0.39 / — / no baseline
job_q21/duckdb:vortex-file-compressed 32912982 / — / no baseline 63999833 / — / no baseline 0.51 / — / no baseline
job_q22/duckdb:vortex-file-compressed 26353240 / — / no baseline 56581382 / — / no baseline 0.47 / — / no baseline
job_q23/duckdb:vortex-file-compressed 64179492 / — / no baseline 96808941 / — / no baseline 0.66 / — / no baseline
job_q24/duckdb:vortex-file-compressed 42150890 / — / no baseline 76666707 / — / no baseline 0.55 / — / no baseline
job_q25/duckdb:vortex-file-compressed 36451932 / — / no baseline 70561018 / — / no baseline 0.52 / — / no baseline
job_q26/duckdb:vortex-file-compressed 87649646 / — / no baseline 128686816 / — / no baseline 0.68 / — / no baseline
job_q27/duckdb:vortex-file-compressed 29666969 / — / no baseline 58482783 / — / no baseline 0.51 / — / no baseline
job_q28/duckdb:vortex-file-compressed 26247438 / — / no baseline 56743666 / — / no baseline 0.46 / — / no baseline
job_q29/duckdb:vortex-file-compressed 85563194 / — / no baseline 104458668 / — / no baseline 0.82 / — / no baseline
job_q30/duckdb:vortex-file-compressed 68062263 / — / no baseline 86046015 / — / no baseline 0.79 / — / no baseline
job_q31/duckdb:vortex-file-compressed 64016756 / — / no baseline 101829522 / — / no baseline 0.63 / — / no baseline
job_q32/duckdb:vortex-file-compressed 50558331 / — / no baseline 87889144 / — / no baseline 0.58 / — / no baseline
job_q33/duckdb:vortex-file-compressed 63659176 / — / no baseline 92943488 / — / no baseline 0.68 / — / no baseline
job_q34/duckdb:vortex-file-compressed 128282384 / — / no baseline 162812244 / — / no baseline 0.79 / — / no baseline
job_q35/duckdb:vortex-file-compressed 29370119 / — / no baseline 59662845 / — / no baseline 0.49 / — / no baseline
job_q36/duckdb:vortex-file-compressed 23224494 / — / no baseline 51281298 / — / no baseline 0.45 / — / no baseline
job_q37/duckdb:vortex-file-compressed 53935989 / — / no baseline 85422040 / — / no baseline 0.63 / — / no baseline
job_q38/duckdb:vortex-file-compressed 19925507 / — / no baseline 41431585 / — / no baseline 0.48 / — / no baseline
job_q39/duckdb:vortex-file-compressed 17593716 / — / no baseline 37174726 / — / no baseline 0.47 / — / no baseline
job_q40/duckdb:vortex-file-compressed 96875319 / — / no baseline 121313300 / — / no baseline 0.80 / — / no baseline
job_q41/duckdb:vortex-file-compressed 263203411 / — / no baseline 296519400 / — / no baseline 0.89 / — / no baseline
job_q42/duckdb:vortex-file-compressed 33178352 / — / no baseline 54549428 / — / no baseline 0.61 / — / no baseline
job_q43/duckdb:vortex-file-compressed 25757254 / — / no baseline 45358986 / — / no baseline 0.57 / — / no baseline
job_q44/duckdb:vortex-file-compressed 46736824 / — / no baseline 68520578 / — / no baseline 0.68 / — / no baseline
job_q45/duckdb:vortex-file-compressed 75021261 / — / no baseline 101217359 / — / no baseline 0.74 / — / no baseline
job_q46/duckdb:vortex-file-compressed 26875793 / — / no baseline 46489246 / — / no baseline 0.58 / — / no baseline
job_q47/duckdb:vortex-file-compressed 24280164 / — / no baseline 44676426 / — / no baseline 0.54 / — / no baseline
job_q48/duckdb:vortex-file-compressed 74597188 / — / no baseline 99643006 / — / no baseline 0.75 / — / no baseline
job_q49/duckdb:vortex-file-compressed 43618964 / — / no baseline 67913089 / — / no baseline 0.64 / — / no baseline
job_q50/duckdb:vortex-file-compressed 38690080 / — / no baseline 61487918 / — / no baseline 0.63 / — / no baseline
job_q51/duckdb:vortex-file-compressed 65315542 / — / no baseline 85455204 / — / no baseline 0.76 / — / no baseline
job_q52/duckdb:vortex-file-compressed 54999498 / — / no baseline 85197974 / — / no baseline 0.65 / — / no baseline
job_q53/duckdb:vortex-file-compressed 50708103 / — / no baseline 83525540 / — / no baseline 0.61 / — / no baseline
job_q54/duckdb:vortex-file-compressed 62089569 / — / no baseline 93234554 / — / no baseline 0.67 / — / no baseline
job_q55/duckdb:vortex-file-compressed 58481111 / — / no baseline 86633672 / — / no baseline 0.68 / — / no baseline
job_q56/duckdb:vortex-file-compressed 37975086 / — / no baseline 75018488 / — / no baseline 0.51 / — / no baseline
job_q57/duckdb:vortex-file-compressed 83970016 / — / no baseline 115160623 / — / no baseline 0.73 / — / no baseline
job_q58/duckdb:vortex-file-compressed 67164526 / — / no baseline 102769993 / — / no baseline 0.65 / — / no baseline
job_q59/duckdb:vortex-file-compressed 62766334 / — / no baseline 101061518 / — / no baseline 0.62 / — / no baseline
job_q60/duckdb:vortex-file-compressed 42298226 / — / no baseline 68058506 / — / no baseline 0.62 / — / no baseline
job_q61/duckdb:vortex-file-compressed 32650564 / — / no baseline 63369194 / — / no baseline 0.52 / — / no baseline
job_q62/duckdb:vortex-file-compressed 31859036 / — / no baseline 61279954 / — / no baseline 0.52 / — / no baseline
job_q63/duckdb:vortex-file-compressed 34687252 / — / no baseline 64982576 / — / no baseline 0.53 / — / no baseline
job_q64/duckdb:vortex-file-compressed 58998197 / — / no baseline 89390477 / — / no baseline 0.66 / — / no baseline
job_q65/duckdb:vortex-file-compressed 49174804 / — / no baseline 77789528 / — / no baseline 0.63 / — / no baseline
job_q66/duckdb:vortex-file-compressed 41041448 / — / no baseline 79230907 / — / no baseline 0.52 / — / no baseline
job_q67/duckdb:vortex-file-compressed 42255404 / — / no baseline 78702334 / — / no baseline 0.54 / — / no baseline
job_q68/duckdb:vortex-file-compressed 51424690 / — / no baseline 87096643 / — / no baseline 0.59 / — / no baseline
job_q69/duckdb:vortex-file-compressed 79371063 / — / no baseline 117713678 / — / no baseline 0.67 / — / no baseline
job_q70/duckdb:vortex-file-compressed 47832652 / — / no baseline 83856666 / — / no baseline 0.57 / — / no baseline
job_q71/duckdb:vortex-file-compressed 70795234 / — / no baseline 108213338 / — / no baseline 0.65 / — / no baseline
job_q72/duckdb:vortex-file-compressed 143600846 / — / no baseline 179005938 / — / no baseline 0.80 / — / no baseline
job_q73/duckdb:vortex-file-compressed 87682458 / — / no baseline 129826259 / — / no baseline 0.68 / — / no baseline
job_q74/duckdb:vortex-file-compressed 76255724 / — / no baseline 122707563 / — / no baseline 0.62 / — / no baseline
job_q75/duckdb:vortex-file-compressed 68648208 / — / no baseline 116025042 / — / no baseline 0.59 / — / no baseline
job_q76/duckdb:vortex-file-compressed 28106578 / — / no baseline 57099063 / — / no baseline 0.49 / — / no baseline
job_q77/duckdb:vortex-file-compressed 27742166 / — / no baseline 54824544 / — / no baseline 0.51 / — / no baseline
job_q78/duckdb:vortex-file-compressed 29258818 / — / no baseline 58573562 / — / no baseline 0.50 / — / no baseline
job_q79/duckdb:vortex-file-compressed 76104744 / — / no baseline 105397113 / — / no baseline 0.72 / — / no baseline
job_q80/duckdb:vortex-file-compressed 52523230 / — / no baseline 83526713 / — / no baseline 0.63 / — / no baseline
job_q81/duckdb:vortex-file-compressed 162429187 / — / no baseline 187027173 / — / no baseline 0.87 / — / no baseline
job_q82/duckdb:vortex-file-compressed 302249044 / — / no baseline 331237782 / — / no baseline 0.91 / — / no baseline
job_q83/duckdb:vortex-file-compressed 44387892 / — / no baseline 76027331 / — / no baseline 0.58 / — / no baseline
job_q84/duckdb:vortex-file-compressed 42729390 / — / no baseline 73158065 / — / no baseline 0.58 / — / no baseline
job_q85/duckdb:vortex-file-compressed 49241188 / — / no baseline 81453641 / — / no baseline 0.60 / — / no baseline
job_q86/duckdb:vortex-file-compressed 69305287 / — / no baseline 112490129 / — / no baseline 0.62 / — / no baseline
job_q87/duckdb:vortex-file-compressed 64901838 / — / no baseline 109933895 / — / no baseline 0.59 / — / no baseline
job_q88/duckdb:vortex-file-compressed 52276972 / — / no baseline 92543397 / — / no baseline 0.56 / — / no baseline
job_q89/duckdb:vortex-file-compressed 34427836 / — / no baseline 72657311 / — / no baseline 0.47 / — / no baseline
job_q90/duckdb:vortex-file-compressed 73976816 / — / no baseline 113772809 / — / no baseline 0.65 / — / no baseline
job_q91/duckdb:vortex-file-compressed 63962454 / — / no baseline 109926872 / — / no baseline 0.58 / — / no baseline
job_q92/duckdb:vortex-file-compressed 46394493 / — / no baseline 89714931 / — / no baseline 0.52 / — / no baseline
job_q93/duckdb:vortex-file-compressed 72377904 / — / no baseline 118186186 / — / no baseline 0.61 / — / no baseline
job_q94/duckdb:vortex-file-compressed 28647490 / — / no baseline 55893508 / — / no baseline 0.51 / — / no baseline
job_q95/duckdb:vortex-file-compressed 26435583 / — / no baseline 54098374 / — / no baseline 0.49 / — / no baseline
job_q96/duckdb:vortex-file-compressed 29455646 / — / no baseline 57691474 / — / no baseline 0.51 / — / no baseline
job_q97/duckdb:vortex-file-compressed 97504058 / — / no baseline 146460576 / — / no baseline 0.67 / — / no baseline
job_q98/duckdb:vortex-file-compressed 59032646 / — / no baseline 105973707 / — / no baseline 0.56 / — / no baseline
job_q99/duckdb:vortex-file-compressed 89032250 / — / no baseline 134972127 / — / no baseline 0.66 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:parquet 61311004 / — / no baseline 68987387 / — / no baseline 0.89 / — / no baseline
job_q02/duckdb:parquet 155086824 / — / no baseline 165582127 / — / no baseline 0.94 / — / no baseline
job_q03/duckdb:parquet 90851494 / — / no baseline 101343024 / — / no baseline 0.90 / — / no baseline
job_q04/duckdb:parquet 167729560 / — / no baseline 182348332 / — / no baseline 0.92 / — / no baseline
job_q05/duckdb:parquet 77561292 / — / no baseline 90778920 / — / no baseline 0.85 / — / no baseline
job_q06/duckdb:parquet 74089578 / — / no baseline 85124305 / — / no baseline 0.87 / — / no baseline
job_q07/duckdb:parquet 32258923 / — / no baseline 43580769 / — / no baseline 0.74 / — / no baseline
job_q08/duckdb:parquet 94524496 / — / no baseline 104800581 / — / no baseline 0.90 / — / no baseline
job_q09/duckdb:parquet 294871062 / — / no baseline 315859877 / — / no baseline 0.93 / — / no baseline
job_q10/duckdb:parquet 243465576 / — / no baseline 257995276 / — / no baseline 0.94 / — / no baseline
job_q100/duckdb:parquet 234713795 / — / no baseline 239660622 / — / no baseline 0.98 / — / no baseline
job_q101/duckdb:parquet 224260632 / — / no baseline 262555729 / — / no baseline 0.85 / — / no baseline
job_q102/duckdb:parquet 273150056 / — / no baseline 296676836 / — / no baseline 0.92 / — / no baseline
job_q103/duckdb:parquet 202693376 / — / no baseline 234963097 / — / no baseline 0.86 / — / no baseline
job_q104/duckdb:parquet 159784668 / — / no baseline 198948819 / — / no baseline 0.80 / — / no baseline
job_q105/duckdb:parquet 203655949 / — / no baseline 255336779 / — / no baseline 0.80 / — / no baseline
job_q106/duckdb:parquet 220501726 / — / no baseline 259063559 / — / no baseline 0.85 / — / no baseline
job_q107/duckdb:parquet 192527204 / — / no baseline 237909454 / — / no baseline 0.81 / — / no baseline
job_q108/duckdb:parquet 210042364 / — / no baseline 272644222 / — / no baseline 0.77 / — / no baseline
job_q109/duckdb:parquet 30563794 / — / no baseline 37599927 / — / no baseline 0.81 / — / no baseline
job_q11/duckdb:parquet 326586855 / — / no baseline 348904521 / — / no baseline 0.94 / — / no baseline
job_q110/duckdb:parquet 79333562 / — / no baseline 87834671 / — / no baseline 0.90 / — / no baseline
job_q111/duckdb:parquet 109410748 / — / no baseline 120707522 / — / no baseline 0.91 / — / no baseline
job_q112/duckdb:parquet 107983844 / — / no baseline 119303952 / — / no baseline 0.91 / — / no baseline
job_q113/duckdb:parquet 120092956 / — / no baseline 129710930 / — / no baseline 0.93 / — / no baseline
job_q12/duckdb:parquet 108684626 / — / no baseline 118964198 / — / no baseline 0.91 / — / no baseline
job_q13/duckdb:parquet 60720824 / — / no baseline 71770731 / — / no baseline 0.85 / — / no baseline
job_q14/duckdb:parquet 127226820 / — / no baseline 137649146 / — / no baseline 0.92 / — / no baseline
job_q15/duckdb:parquet 363184072 / — / no baseline 386439940 / — / no baseline 0.94 / — / no baseline
job_q16/duckdb:parquet 316762036 / — / no baseline 211715653 / — / no baseline 1.50 / — / no baseline
job_q17/duckdb:parquet 361323064 / — / no baseline 392429996 / — / no baseline 0.92 / — / no baseline
job_q18/duckdb:parquet 86080542 / — / no baseline 102287936 / — / no baseline 0.84 / — / no baseline
job_q19/duckdb:parquet 73037398 / — / no baseline 84980221 / — / no baseline 0.86 / — / no baseline
job_q20/duckdb:parquet 72517712 / — / no baseline 85266199 / — / no baseline 0.85 / — / no baseline
job_q21/duckdb:parquet 117151054 / — / no baseline 135591006 / — / no baseline 0.86 / — / no baseline
job_q22/duckdb:parquet 108279882 / — / no baseline 128592739 / — / no baseline 0.84 / — / no baseline
job_q23/duckdb:parquet 202530538 / — / no baseline 226709989 / — / no baseline 0.89 / — / no baseline
job_q24/duckdb:parquet 166074678 / — / no baseline 190820183 / — / no baseline 0.87 / — / no baseline
job_q25/duckdb:parquet 134011879 / — / no baseline 157575860 / — / no baseline 0.85 / — / no baseline
job_q26/duckdb:parquet 326356695 / — / no baseline 355762002 / — / no baseline 0.92 / — / no baseline
job_q27/duckdb:parquet 135702544 / — / no baseline 152449520 / — / no baseline 0.89 / — / no baseline
job_q28/duckdb:parquet 144990492 / — / no baseline 162044164 / — / no baseline 0.89 / — / no baseline
job_q29/duckdb:parquet 392918625 / — / no baseline 414767035 / — / no baseline 0.95 / — / no baseline
job_q30/duckdb:parquet 207315260 / — / no baseline 218306945 / — / no baseline 0.95 / — / no baseline
job_q31/duckdb:parquet 315632481 / — / no baseline 332785786 / — / no baseline 0.95 / — / no baseline
job_q32/duckdb:parquet 274778054 / — / no baseline 297366827 / — / no baseline 0.92 / — / no baseline
job_q33/duckdb:parquet 264582072 / — / no baseline 298481269 / — / no baseline 0.89 / — / no baseline
job_q34/duckdb:parquet 419712085 / — / no baseline 440206253 / — / no baseline 0.95 / — / no baseline
job_q35/duckdb:parquet 143340454 / — / no baseline 158947720 / — / no baseline 0.90 / — / no baseline
job_q36/duckdb:parquet 87057204 / — / no baseline 103478682 / — / no baseline 0.84 / — / no baseline
job_q37/duckdb:parquet 250446906 / — / no baseline 269679636 / — / no baseline 0.93 / — / no baseline
job_q38/duckdb:parquet 70459498 / — / no baseline 79642600 / — / no baseline 0.88 / — / no baseline
job_q39/duckdb:parquet 62195912 / — / no baseline 76439559 / — / no baseline 0.81 / — / no baseline
job_q40/duckdb:parquet 81935084 / — / no baseline 94333087 / — / no baseline 0.87 / — / no baseline
job_q41/duckdb:parquet 93556650 / — / no baseline 106959981 / — / no baseline 0.87 / — / no baseline
job_q42/duckdb:parquet 160015271 / — / no baseline 216523805 / — / no baseline 0.74 / — / no baseline
job_q43/duckdb:parquet 56939938 / — / no baseline 69303083 / — / no baseline 0.82 / — / no baseline
job_q44/duckdb:parquet 189383312 / — / no baseline 218062550 / — / no baseline 0.87 / — / no baseline
job_q45/duckdb:parquet 179494018 / — / no baseline 192725292 / — / no baseline 0.93 / — / no baseline
job_q46/duckdb:parquet 115730924 / — / no baseline 128783624 / — / no baseline 0.90 / — / no baseline
job_q47/duckdb:parquet 93989748 / — / no baseline 106610414 / — / no baseline 0.88 / — / no baseline
job_q48/duckdb:parquet 172425067 / — / no baseline 187586808 / — / no baseline 0.92 / — / no baseline
job_q49/duckdb:parquet 165492134 / — / no baseline 196266424 / — / no baseline 0.84 / — / no baseline
job_q50/duckdb:parquet 130918135 / — / no baseline 167961554 / — / no baseline 0.78 / — / no baseline
job_q51/duckdb:parquet 188325864 / — / no baseline 205008267 / — / no baseline 0.92 / — / no baseline
job_q52/duckdb:parquet 189533592 / — / no baseline 212359009 / — / no baseline 0.89 / — / no baseline
job_q53/duckdb:parquet 174859769 / — / no baseline 193982379 / — / no baseline 0.90 / — / no baseline
job_q54/duckdb:parquet 172622719 / — / no baseline 187173674 / — / no baseline 0.92 / — / no baseline
job_q55/duckdb:parquet 175383714 / — / no baseline 194133537 / — / no baseline 0.90 / — / no baseline
job_q56/duckdb:parquet 155961899 / — / no baseline 184749853 / — / no baseline 0.84 / — / no baseline
job_q57/duckdb:parquet 207884908 / — / no baseline 231167492 / — / no baseline 0.90 / — / no baseline
job_q58/duckdb:parquet 243559889 / — / no baseline 270642922 / — / no baseline 0.90 / — / no baseline
job_q59/duckdb:parquet 227745862 / — / no baseline 256241269 / — / no baseline 0.89 / — / no baseline
job_q60/duckdb:parquet 94561196 / — / no baseline 114958933 / — / no baseline 0.82 / — / no baseline
job_q61/duckdb:parquet 76923996 / — / no baseline 97605828 / — / no baseline 0.79 / — / no baseline
job_q62/duckdb:parquet 73547665 / — / no baseline 90644921 / — / no baseline 0.81 / — / no baseline
job_q63/duckdb:parquet 90565272 / — / no baseline 107688598 / — / no baseline 0.84 / — / no baseline
job_q64/duckdb:parquet 161340554 / — / no baseline 182301059 / — / no baseline 0.89 / — / no baseline
job_q65/duckdb:parquet 111694758 / — / no baseline 129980440 / — / no baseline 0.86 / — / no baseline
job_q66/duckdb:parquet 189562006 / — / no baseline 215688196 / — / no baseline 0.88 / — / no baseline
job_q67/duckdb:parquet 168150710 / — / no baseline 192179683 / — / no baseline 0.87 / — / no baseline
job_q68/duckdb:parquet 186107159 / — / no baseline 210970714 / — / no baseline 0.88 / — / no baseline
job_q69/duckdb:parquet 311421094 / — / no baseline 329779148 / — / no baseline 0.94 / — / no baseline
job_q70/duckdb:parquet 239564188 / — / no baseline 267718841 / — / no baseline 0.89 / — / no baseline
job_q71/duckdb:parquet 203586554 / — / no baseline 234208328 / — / no baseline 0.87 / — / no baseline
job_q72/duckdb:parquet 292316463 / — / no baseline 306710163 / — / no baseline 0.95 / — / no baseline
job_q73/duckdb:parquet 198295092 / — / no baseline 227919238 / — / no baseline 0.87 / — / no baseline
job_q74/duckdb:parquet 196797981 / — / no baseline 224474338 / — / no baseline 0.88 / — / no baseline
job_q75/duckdb:parquet 227619224 / — / no baseline 254284465 / — / no baseline 0.90 / — / no baseline
job_q76/duckdb:parquet 137417560 / — / no baseline 158505640 / — / no baseline 0.87 / — / no baseline
job_q77/duckdb:parquet 125390972 / — / no baseline 164148365 / — / no baseline 0.76 / — / no baseline
job_q78/duckdb:parquet 131047375 / — / no baseline 156492572 / — / no baseline 0.84 / — / no baseline
job_q79/duckdb:parquet 261006049 / — / no baseline 289226984 / — / no baseline 0.90 / — / no baseline
job_q80/duckdb:parquet 252210960 / — / no baseline 275779738 / — / no baseline 0.91 / — / no baseline
job_q81/duckdb:parquet 370419628 / — / no baseline 404515295 / — / no baseline 0.92 / — / no baseline
job_q82/duckdb:parquet 287323648 / — / no baseline 394815947 / — / no baseline 0.73 / — / no baseline
job_q83/duckdb:parquet 126973908 / — / no baseline 178468705 / — / no baseline 0.71 / — / no baseline
job_q84/duckdb:parquet 128762014 / — / no baseline 157764235 / — / no baseline 0.82 / — / no baseline
job_q85/duckdb:parquet 125733347 / — / no baseline 157292724 / — / no baseline 0.80 / — / no baseline
job_q86/duckdb:parquet 228669460 / — / no baseline 269754050 / — / no baseline 0.85 / — / no baseline
job_q87/duckdb:parquet 201416197 / — / no baseline 239054281 / — / no baseline 0.84 / — / no baseline
job_q88/duckdb:parquet 199507132 / — / no baseline 229723719 / — / no baseline 0.87 / — / no baseline
job_q89/duckdb:parquet 165347336 / — / no baseline 217714444 / — / no baseline 0.76 / — / no baseline
job_q90/duckdb:parquet 224688590 / — / no baseline 258061864 / — / no baseline 0.87 / — / no baseline
job_q91/duckdb:parquet 257865568 / — / no baseline 288237534 / — / no baseline 0.89 / — / no baseline
job_q92/duckdb:parquet 200728234 / — / no baseline 232166755 / — / no baseline 0.86 / — / no baseline
job_q93/duckdb:parquet 243398036 / — / no baseline 273882875 / — / no baseline 0.89 / — / no baseline
job_q94/duckdb:parquet 145283946 / — / no baseline 170730785 / — / no baseline 0.85 / — / no baseline
job_q95/duckdb:parquet 126429124 / — / no baseline 151496312 / — / no baseline 0.83 / — / no baseline
job_q96/duckdb:parquet 140247552 / — / no baseline 177339188 / — / no baseline 0.79 / — / no baseline
job_q97/duckdb:parquet 256612402 / — / no baseline 322890887 / — / no baseline 0.79 / — / no baseline
job_q98/duckdb:parquet 203369711 / — / no baseline 252685692 / — / no baseline 0.80 / — / no baseline
job_q99/duckdb:parquet 247493453 / — / no baseline 319282017 / — / no baseline 0.78 / — / no baseline
duckdb / duckdb / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:duckdb 7938070 / — / no baseline 17020170 / — / no baseline 0.47 / — / no baseline
job_q02/duckdb:duckdb 6000412 / — / no baseline 14069147 / — / no baseline 0.43 / — / no baseline
job_q03/duckdb:duckdb 6530050 / — / no baseline 14989391 / — / no baseline 0.44 / — / no baseline
job_q04/duckdb:duckdb 6247991 / — / no baseline 13648017 / — / no baseline 0.46 / — / no baseline
job_q05/duckdb:duckdb 14944289 / — / no baseline 26177572 / — / no baseline 0.57 / — / no baseline
job_q06/duckdb:duckdb 14542730 / — / no baseline 25134940 / — / no baseline 0.58 / — / no baseline
job_q07/duckdb:duckdb 11059730 / — / no baseline 20559388 / — / no baseline 0.54 / — / no baseline
job_q08/duckdb:duckdb 16860458 / — / no baseline 27182178 / — / no baseline 0.62 / — / no baseline
job_q09/duckdb:duckdb 64156720 / — / no baseline 93037321 / — / no baseline 0.69 / — / no baseline
job_q10/duckdb:duckdb 41876851 / — / no baseline 69567567 / — / no baseline 0.60 / — / no baseline
job_q100/duckdb:duckdb 25024522 / — / no baseline 47603658 / — / no baseline 0.53 / — / no baseline
job_q101/duckdb:duckdb 26073732 / — / no baseline 50601783 / — / no baseline 0.52 / — / no baseline
job_q102/duckdb:duckdb 45729776 / — / no baseline 73379187 / — / no baseline 0.62 / — / no baseline
job_q103/duckdb:duckdb 55673694 / — / no baseline 84997360 / — / no baseline 0.66 / — / no baseline
job_q104/duckdb:duckdb 46976936 / — / no baseline 72884148 / — / no baseline 0.64 / — / no baseline
job_q105/duckdb:duckdb 73716065 / — / no baseline 105018802 / — / no baseline 0.70 / — / no baseline
job_q106/duckdb:duckdb 65827458 / — / no baseline 99460396 / — / no baseline 0.66 / — / no baseline
job_q107/duckdb:duckdb 61621655 / — / no baseline 89551968 / — / no baseline 0.69 / — / no baseline
job_q108/duckdb:duckdb 76527682 / — / no baseline 108186145 / — / no baseline 0.71 / — / no baseline
job_q109/duckdb:duckdb 7133724 / — / no baseline 16002261 / — / no baseline 0.45 / — / no baseline
job_q11/duckdb:duckdb 49242754 / — / no baseline 83933705 / — / no baseline 0.59 / — / no baseline
job_q110/duckdb:duckdb 13970518 / — / no baseline 23278018 / — / no baseline 0.60 / — / no baseline
job_q111/duckdb:duckdb 16791106 / — / no baseline 28238641 / — / no baseline 0.59 / — / no baseline
job_q112/duckdb:duckdb 22330032 / — / no baseline 34389206 / — / no baseline 0.65 / — / no baseline
job_q113/duckdb:duckdb 18671506 / — / no baseline 31742054 / — / no baseline 0.59 / — / no baseline
job_q12/duckdb:duckdb 27506562 / — / no baseline 38113249 / — / no baseline 0.72 / — / no baseline
job_q13/duckdb:duckdb 10150522 / — / no baseline 19153187 / — / no baseline 0.53 / — / no baseline
job_q14/duckdb:duckdb 35681096 / — / no baseline 45656575 / — / no baseline 0.78 / — / no baseline
job_q15/duckdb:duckdb 56801809 / — / no baseline 90657156 / — / no baseline 0.63 / — / no baseline
job_q16/duckdb:duckdb 46972050 / — / no baseline 75668453 / — / no baseline 0.62 / — / no baseline
job_q17/duckdb:duckdb 54552660 / — / no baseline 84670733 / — / no baseline 0.64 / — / no baseline
job_q18/duckdb:duckdb 21458464 / — / no baseline 44934966 / — / no baseline 0.48 / — / no baseline
job_q19/duckdb:duckdb 12395188 / — / no baseline 21592900 / — / no baseline 0.57 / — / no baseline
job_q20/duckdb:duckdb 15771380 / — / no baseline 34552867 / — / no baseline 0.46 / — / no baseline
job_q21/duckdb:duckdb 22449565 / — / no baseline 34391974 / — / no baseline 0.65 / — / no baseline
job_q22/duckdb:duckdb 21500508 / — / no baseline 44949534 / — / no baseline 0.48 / — / no baseline
job_q23/duckdb:duckdb 41452396 / — / no baseline 59664610 / — / no baseline 0.69 / — / no baseline
job_q24/duckdb:duckdb 18169755 / — / no baseline 35155810 / — / no baseline 0.52 / — / no baseline
job_q25/duckdb:duckdb 15747809 / — / no baseline 28961615 / — / no baseline 0.54 / — / no baseline
job_q26/duckdb:duckdb 79131885 / — / no baseline 130665826 / — / no baseline 0.61 / — / no baseline
job_q27/duckdb:duckdb 26607134 / — / no baseline 45439461 / — / no baseline 0.59 / — / no baseline
job_q28/duckdb:duckdb 25638210 / — / no baseline 42561787 / — / no baseline 0.60 / — / no baseline
job_q29/duckdb:duckdb 86303296 / — / no baseline 101439790 / — / no baseline 0.85 / — / no baseline
job_q30/duckdb:duckdb 57038230 / — / no baseline 71195305 / — / no baseline 0.80 / — / no baseline
job_q31/duckdb:duckdb 67810288 / — / no baseline 89257260 / — / no baseline 0.76 / — / no baseline
job_q32/duckdb:duckdb 47872348 / — / no baseline 72629895 / — / no baseline 0.66 / — / no baseline
job_q33/duckdb:duckdb 56520682 / — / no baseline 78737137 / — / no baseline 0.72 / — / no baseline
job_q34/duckdb:duckdb 92787404 / — / no baseline 112944501 / — / no baseline 0.82 / — / no baseline
job_q35/duckdb:duckdb 22254756 / — / no baseline 40165477 / — / no baseline 0.55 / — / no baseline
job_q36/duckdb:duckdb 15779166 / — / no baseline 32320144 / — / no baseline 0.49 / — / no baseline
job_q37/duckdb:duckdb 50965560 / — / no baseline 75911863 / — / no baseline 0.67 / — / no baseline
job_q38/duckdb:duckdb 17982499 / — / no baseline 31735903 / — / no baseline 0.57 / — / no baseline
job_q39/duckdb:duckdb 14374953 / — / no baseline 26361375 / — / no baseline 0.55 / — / no baseline
job_q40/duckdb:duckdb 25942967 / — / no baseline 39083925 / — / no baseline 0.66 / — / no baseline
job_q41/duckdb:duckdb 39640556 / — / no baseline 51952822 / — / no baseline 0.76 / — / no baseline
job_q42/duckdb:duckdb 21351087 / — / no baseline 32462780 / — / no baseline 0.66 / — / no baseline
job_q43/duckdb:duckdb 23978774 / — / no baseline 36268068 / — / no baseline 0.66 / — / no baseline
job_q44/duckdb:duckdb 29642936 / — / no baseline 40286101 / — / no baseline 0.74 / — / no baseline
job_q45/duckdb:duckdb 22663622 / — / no baseline 35479392 / — / no baseline 0.64 / — / no baseline
job_q46/duckdb:duckdb 34919220 / — / no baseline 46779332 / — / no baseline 0.75 / — / no baseline
job_q47/duckdb:duckdb 33063228 / — / no baseline 45478930 / — / no baseline 0.73 / — / no baseline
job_q48/duckdb:duckdb 59660596 / — / no baseline 70411428 / — / no baseline 0.85 / — / no baseline
job_q49/duckdb:duckdb 53792296 / — / no baseline 67759046 / — / no baseline 0.79 / — / no baseline
job_q50/duckdb:duckdb 27982662 / — / no baseline 39871434 / — / no baseline 0.70 / — / no baseline
job_q51/duckdb:duckdb 39591878 / — / no baseline 51558950 / — / no baseline 0.77 / — / no baseline
job_q52/duckdb:duckdb 35520548 / — / no baseline 50759713 / — / no baseline 0.70 / — / no baseline
job_q53/duckdb:duckdb 22699666 / — / no baseline 38091916 / — / no baseline 0.60 / — / no baseline
job_q54/duckdb:duckdb 59464022 / — / no baseline 75148017 / — / no baseline 0.79 / — / no baseline
job_q55/duckdb:duckdb 66933858 / — / no baseline 84474113 / — / no baseline 0.79 / — / no baseline
job_q56/duckdb:duckdb 25365514 / — / no baseline 48407488 / — / no baseline 0.52 / — / no baseline
job_q57/duckdb:duckdb 112726426 / — / no baseline 136264640 / — / no baseline 0.83 / — / no baseline
job_q58/duckdb:duckdb 45356278 / — / no baseline 70513711 / — / no baseline 0.64 / — / no baseline
job_q59/duckdb:duckdb 42027674 / — / no baseline 67381827 / — / no baseline 0.62 / — / no baseline
job_q60/duckdb:duckdb 47591953 / — / no baseline 66014182 / — / no baseline 0.72 / — / no baseline
job_q61/duckdb:duckdb 53618925 / — / no baseline 73364701 / — / no baseline 0.73 / — / no baseline
job_q62/duckdb:duckdb 53175204 / — / no baseline 70618629 / — / no baseline 0.75 / — / no baseline
job_q63/duckdb:duckdb 58794500 / — / no baseline 78741378 / — / no baseline 0.75 / — / no baseline
job_q64/duckdb:duckdb 46464184 / — / no baseline 66183447 / — / no baseline 0.70 / — / no baseline
job_q65/duckdb:duckdb 76254111 / — / no baseline 92900027 / — / no baseline 0.82 / — / no baseline
job_q66/duckdb:duckdb 53874257 / — / no baseline 83735362 / — / no baseline 0.64 / — / no baseline
job_q67/duckdb:duckdb 24664666 / — / no baseline 50829225 / — / no baseline 0.49 / — / no baseline
job_q68/duckdb:duckdb 53045347 / — / no baseline 77030799 / — / no baseline 0.69 / — / no baseline
job_q69/duckdb:duckdb 76348880 / — / no baseline 99718025 / — / no baseline 0.77 / — / no baseline
job_q70/duckdb:duckdb 47466119 / — / no baseline 66714274 / — / no baseline 0.71 / — / no baseline
job_q71/duckdb:duckdb 79842282 / — / no baseline 102980437 / — / no baseline 0.78 / — / no baseline
job_q72/duckdb:duckdb 109884516 / — / no baseline 130876369 / — / no baseline 0.84 / — / no baseline
job_q73/duckdb:duckdb 64847210 / — / no baseline 87938680 / — / no baseline 0.74 / — / no baseline
job_q74/duckdb:duckdb 62580547 / — / no baseline 88161958 / — / no baseline 0.71 / — / no baseline
job_q75/duckdb:duckdb 54880762 / — / no baseline 77999988 / — / no baseline 0.70 / — / no baseline
job_q76/duckdb:duckdb 25033316 / — / no baseline 44205989 / — / no baseline 0.57 / — / no baseline
job_q77/duckdb:duckdb 23363912 / — / no baseline 38503536 / — / no baseline 0.61 / — / no baseline
job_q78/duckdb:duckdb 25247952 / — / no baseline 46215944 / — / no baseline 0.55 / — / no baseline
job_q79/duckdb:duckdb 64703356 / — / no baseline 82818705 / — / no baseline 0.78 / — / no baseline
job_q80/duckdb:duckdb 47791123 / — / no baseline 65753012 / — / no baseline 0.73 / — / no baseline
job_q81/duckdb:duckdb 103502684 / — / no baseline 122577301 / — / no baseline 0.84 / — / no baseline
job_q82/duckdb:duckdb 144405020 / — / no baseline 163984710 / — / no baseline 0.88 / — / no baseline
job_q83/duckdb:duckdb 48854238 / — / no baseline 65268870 / — / no baseline 0.75 / — / no baseline
job_q84/duckdb:duckdb 27204030 / — / no baseline 42907995 / — / no baseline 0.63 / — / no baseline
job_q85/duckdb:duckdb 50226829 / — / no baseline 67798225 / — / no baseline 0.74 / — / no baseline
job_q86/duckdb:duckdb 54717438 / — / no baseline 80332391 / — / no baseline 0.68 / — / no baseline
job_q87/duckdb:duckdb 34360634 / — / no baseline 62480229 / — / no baseline 0.55 / — / no baseline
job_q88/duckdb:duckdb 48903436 / — / no baseline 80293717 / — / no baseline 0.61 / — / no baseline
job_q89/duckdb:duckdb 26734110 / — / no baseline 50088853 / — / no baseline 0.53 / — / no baseline
job_q90/duckdb:duckdb 59210584 / — / no baseline 87839338 / — / no baseline 0.67 / — / no baseline
job_q91/duckdb:duckdb 54291698 / — / no baseline 85564452 / — / no baseline 0.63 / — / no baseline
job_q92/duckdb:duckdb 34463006 / — / no baseline 63631279 / — / no baseline 0.54 / — / no baseline
job_q93/duckdb:duckdb 80415772 / — / no baseline 109411479 / — / no baseline 0.73 / — / no baseline
job_q94/duckdb:duckdb 23304590 / — / no baseline 38888255 / — / no baseline 0.60 / — / no baseline
job_q95/duckdb:duckdb 22410931 / — / no baseline 38601410 / — / no baseline 0.58 / — / no baseline
job_q96/duckdb:duckdb 24088160 / — / no baseline 41309301 / — / no baseline 0.58 / — / no baseline
job_q97/duckdb:duckdb 86907978 / — / no baseline 104883418 / — / no baseline 0.83 / — / no baseline
job_q98/duckdb:duckdb 46453496 / — / no baseline 63625440 / — / no baseline 0.73 / — / no baseline
job_q99/duckdb:duckdb 78759602 / — / no baseline 95565546 / — / no baseline 0.82 / — / no baseline

No baseline file sizes found for base commit.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR e42f8876 vs base e4dce8b7
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.7%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.011x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1848841 / 1832618 / +0.9% 7425373 / 7443029 / -0.2% 0.25 / 0.25 / +1.1%
statpopgen_q01/datafusion:vortex-file-compressed 23545582 / 25005843 / -5.8% 25014804 / 21817594 / +14.7% 🔴 0.94 / 1.15 / -17.9%
statpopgen_q02/datafusion:vortex-file-compressed 112714721 / 110801254 / +1.7% 140495915 / 144883143 / -3.0% 0.80 / 0.76 / +4.9%
statpopgen_q03/datafusion:vortex-file-compressed 345455914 / 343079157 / +0.7% 394329508 / 395749402 / -0.4% 0.88 / 0.87 / +1.1%
statpopgen_q04/datafusion:vortex-file-compressed 353378380 / 343036452 / +3.0% 398462542 / 400963345 / -0.6% 0.89 / 0.86 / +3.7%
statpopgen_q05/datafusion:vortex-file-compressed 216971200 / 217823266 / -0.4% 263802816 / 259635627 / +1.6% 0.82 / 0.84 / -2.0%
statpopgen_q06/datafusion:vortex-file-compressed 757289284 / 787005240 / -3.8% 800212445 / 800095487 / +0.0% 0.95 / 0.98 / -3.8%
statpopgen_q07/datafusion:vortex-file-compressed 400814447 / 384949989 / +4.1% 440555500 / 416450754 / +5.8% 0.91 / 0.92 / -1.6%
statpopgen_q08/datafusion:vortex-file-compressed 403227830 / 385042873 / +4.7% 433942937 / 409464126 / +6.0% 0.93 / 0.94 / -1.2%
statpopgen_q09/datafusion:vortex-file-compressed 247804359 / 246350190 / +0.6% 285543202 / 282538784 / +1.1% 0.87 / 0.87 / -0.5%
statpopgen_q10/datafusion:vortex-file-compressed 661695214 / 659938749 / +0.3% 708819920 / 705029044 / +0.5% 0.93 / 0.94 / -0.3%
datafusion / vortex-compact / ns (0.983x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1839565 / 1824316 / +0.8% 7528691 / 7035516 / +7.0% 0.24 / 0.26 / -5.8%
statpopgen_q01/datafusion:vortex-compact 22517352 / 28981994 / -22.3% 🟢 23320763 / 20482353 / +13.9% 🔴 0.97 / 1.41 / -31.8%
statpopgen_q02/datafusion:vortex-compact 135513574 / 135754222 / -0.2% 154171880 / 155421973 / -0.8% 0.88 / 0.87 / +0.6%
statpopgen_q03/datafusion:vortex-compact 401968396 / 392422900 / +2.4% 419999323 / 421738938 / -0.4% 0.96 / 0.93 / +2.9%
statpopgen_q04/datafusion:vortex-compact 397170001 / 393771620 / +0.9% 467037738 / 579236689 / -19.4% 🟢 0.85 / 0.68 / +25.1%
statpopgen_q05/datafusion:vortex-compact 240402160 / 238722259 / +0.7% 269654882 / 272703731 / -1.1% 0.89 / 0.88 / +1.8%
statpopgen_q06/datafusion:vortex-compact 806426148 / 800933528 / +0.7% 839134775 / 829806806 / +1.1% 0.96 / 0.97 / -0.4%
statpopgen_q07/datafusion:vortex-compact 827590712 / 823037853 / +0.6% 880551857 / 850766090 / +3.5% 0.94 / 0.97 / -2.8%
statpopgen_q08/datafusion:vortex-compact 840467530 / 823019857 / +2.1% 868433558 / 842330383 / +3.1% 0.97 / 0.98 / -0.9%
statpopgen_q09/datafusion:vortex-compact 297515060 / 298227120 / -0.2% 326792512 / 315778199 / +3.5% 0.91 / 0.94 / -3.6%
statpopgen_q10/datafusion:vortex-compact 714568020 / 724561690 / -1.4% 755876261 / 878491064 / -14.0% 🟢 0.95 / 0.82 / +14.6%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1997744 / 1974603 / +1.2% 90913845 / 90884229 / +0.0% 0.02 / 0.02 / +1.1%
statpopgen_q01/datafusion:parquet 163218934 / 164525899 / -0.8% 173854194 / 174716585 / -0.5% 0.94 / 0.94 / -0.3%
statpopgen_q02/datafusion:parquet 286877529 / 282132448 / +1.7% 430784607 / 427283511 / +0.8% 0.67 / 0.66 / +0.9%
statpopgen_q03/datafusion:parquet 398697358 / 386810613 / +3.1% 525772872 / 531208642 / -1.0% 0.76 / 0.73 / +4.1%
statpopgen_q04/datafusion:parquet 378891632 / 386588653 / -2.0% 507364595 / 509189199 / -0.4% 0.75 / 0.76 / -1.6%
statpopgen_q05/datafusion:parquet 314802320 / 328724464 / -4.2% 461478995 / 436588870 / +5.7% 0.68 / 0.75 / -9.4%
statpopgen_q06/datafusion:parquet 476844624 / 489067080 / -2.5% 652218312 / 644223141 / +1.2% 0.73 / 0.76 / -3.7%
statpopgen_q07/datafusion:parquet 422356466 / 423586262 / -0.3% 562838661 / 542861054 / +3.7% 0.75 / 0.78 / -3.8%
statpopgen_q08/datafusion:parquet 424302599 / 427913004 / -0.8% 586087612 / 552615683 / +6.1% 0.72 / 0.77 / -6.5%
statpopgen_q09/datafusion:parquet 351862961 / 353172386 / -0.4% 480671411 / 497890996 / -3.5% 0.73 / 0.71 / +3.2%
statpopgen_q10/datafusion:parquet 529012754 / 533097882 / -0.8% 692375696 / 691781874 / +0.1% 0.76 / 0.77 / -0.9%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 12846129 / 12845450 / +0.0% 15028052 / 14976529 / +0.3% 0.85 / 0.86 / -0.3%
statpopgen_q01/duckdb:vortex-file-compressed 14379931 / 14355556 / +0.2% 20070453 / 20142349 / -0.4% 0.72 / 0.71 / +0.5%
statpopgen_q02/duckdb:vortex-file-compressed 266968195 / 267783720 / -0.3% 305997368 / 301675547 / +1.4% 0.87 / 0.89 / -1.7%
statpopgen_q03/duckdb:vortex-file-compressed 684260170 / 683197346 / +0.2% 718490644 / 711566045 / +1.0% 0.95 / 0.96 / -0.8%
statpopgen_q04/duckdb:vortex-file-compressed 696142691 / 688635297 / +1.1% 717264055 / 718697087 / -0.2% 0.97 / 0.96 / +1.3%
statpopgen_q05/duckdb:vortex-file-compressed 289240167 / 294338346 / -1.7% 331059041 / 325956938 / +1.6% 0.87 / 0.90 / -3.2%
statpopgen_q06/duckdb:vortex-file-compressed 917472966 / 916331390 / +0.1% 949829003 / 951694933 / -0.2% 0.97 / 0.96 / +0.3%
statpopgen_q07/duckdb:vortex-file-compressed 378100198 / 364643664 / +3.7% 382670716 / 366621121 / +4.4% 0.99 / 0.99 / -0.7%
statpopgen_q08/duckdb:vortex-file-compressed 370969858 / 369702854 / +0.3% 377485154 / 383639874 / -1.6% 0.98 / 0.96 / +2.0%
statpopgen_q09/duckdb:vortex-file-compressed 516727163 / 524078970 / -1.4% 548481308 / 549655895 / -0.2% 0.94 / 0.95 / -1.2%
statpopgen_q10/duckdb:vortex-file-compressed 1521365457 / 1519981020 / +0.1% 1497543751 / 1512864434 / -1.0% 1.02 / 1.00 / +1.1%
duckdb / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 12781547 / 12813972 / -0.3% 15234538 / 15150571 / +0.6% 0.84 / 0.85 / -0.8%
statpopgen_q01/duckdb:vortex-compact 14342872 / 14228046 / +0.8% 18782066 / 19062466 / -1.5% 0.76 / 0.75 / +2.3%
statpopgen_q02/duckdb:vortex-compact 282736959 / 281021128 / +0.6% 301948085 / 310338258 / -2.7% 0.94 / 0.91 / +3.4%
statpopgen_q03/duckdb:vortex-compact 714702806 / 719951279 / -0.7% 746001899 / 758805048 / -1.7% 0.96 / 0.95 / +1.0%
statpopgen_q04/duckdb:vortex-compact 717230290 / 724767006 / -1.0% 746438486 / 740307598 / +0.8% 0.96 / 0.98 / -1.9%
statpopgen_q05/duckdb:vortex-compact 319149962 / 319072978 / +0.0% 341149424 / 344497554 / -1.0% 0.94 / 0.93 / +1.0%
statpopgen_q06/duckdb:vortex-compact 907993978 / 908812949 / -0.1% 929680377 / 928275779 / +0.2% 0.98 / 0.98 / -0.2%
statpopgen_q07/duckdb:vortex-compact 810138068 / 810832117 / -0.1% 809748595 / 832583588 / -2.7% 1.00 / 0.97 / +2.7%
statpopgen_q08/duckdb:vortex-compact 810275201 / 823324328 / -1.6% 827234731 / 818665897 / +1.0% 0.98 / 1.01 / -2.6%
statpopgen_q09/duckdb:vortex-compact 552391904 / 558639762 / -1.1% 569569500 / 573296765 / -0.7% 0.97 / 0.97 / -0.5%
statpopgen_q10/duckdb:vortex-compact 1563067972 / 1552277293 / +0.7% 1564550537 / 1558961734 / +0.4% 1.00 / 1.00 / +0.3%
duckdb / parquet / ns (1.007x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 273703139 / 269207030 / +1.7% 273135445 / 272772821 / +0.1% 1.00 / 0.99 / +1.5%
statpopgen_q01/duckdb:parquet 339191060 / 331314574 / +2.4% 347044245 / 333593486 / +4.0% 0.98 / 0.99 / -1.6%
statpopgen_q02/duckdb:parquet 613244410 / 572648256 / +7.1% 612805130 / 574322289 / +6.7% 1.00 / 1.00 / +0.4%
statpopgen_q03/duckdb:parquet 774231420 / 745885188 / +3.8% 875872970 / 842092885 / +4.0% 0.88 / 0.89 / -0.2%
statpopgen_q04/duckdb:parquet 718978709 / 762667889 / -5.7% 824585187 / 825220872 / -0.1% 0.87 / 0.92 / -5.7%
statpopgen_q05/duckdb:parquet 538814750 / 603465277 / -10.7% 🟢 595155173 / 605453047 / -1.7% 0.91 / 1.00 / -9.2%
statpopgen_q06/duckdb:parquet 660208845 / 638774152 / +3.4% 713707264 / 697848268 / +2.3% 0.93 / 0.92 / +1.1%
statpopgen_q07/duckdb:parquet 598043047 / 599459956 / -0.2% 689039666 / 679143723 / +1.5% 0.87 / 0.88 / -1.7%
statpopgen_q08/duckdb:parquet 608932348 / 603043734 / +1.0% 676150922 / 697751036 / -3.1% 0.90 / 0.86 / +4.2%
statpopgen_q09/duckdb:parquet 736117092 / 680643839 / +8.2% 808239459 / 791285890 / +2.1% 0.91 / 0.86 / +5.9%
statpopgen_q10/duckdb:parquet 1045640872 / 1064961318 / -1.8% 1139581097 / 1180986982 / -3.5% 0.92 / 0.90 / +1.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR e42f8876 vs base 2eae7646
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20792614 / 20736572 / +0.3% 38624928 / 38405999 / +0.6% 0.54 / 0.54 / -0.3%
tpcds_q02/datafusion:vortex-file-compressed 44913154 / 44960007 / -0.1% 65238830 / 66596513 / -2.0% 0.69 / 0.68 / +2.0%
tpcds_q03/datafusion:vortex-file-compressed 11216723 / 11163618 / +0.5% 30249859 / 29454441 / +2.7% 0.37 / 0.38 / -2.2%
tpcds_q04/datafusion:vortex-file-compressed 87525491 / 87711472 / -0.2% 122200235 / 120658431 / +1.3% 0.72 / 0.73 / -1.5%
tpcds_q05/datafusion:vortex-file-compressed 56966198 / 57048750 / -0.1% 78392359 / 79084756 / -0.9% 0.73 / 0.72 / +0.7%
tpcds_q06/datafusion:vortex-file-compressed 22488166 / 22191796 / +1.3% 42563591 / 41846594 / +1.7% 0.53 / 0.53 / -0.4%
tpcds_q07/datafusion:vortex-file-compressed 28855062 / 28833024 / +0.1% 53383255 / 54016986 / -1.2% 0.54 / 0.53 / +1.3%
tpcds_q08/datafusion:vortex-file-compressed 24299272 / 24345478 / -0.2% 44390929 / 43646226 / +1.7% 0.55 / 0.56 / -1.9%
tpcds_q09/datafusion:vortex-file-compressed 19866972 / 19788594 / +0.4% 37926140 / 37953745 / -0.1% 0.52 / 0.52 / +0.5%
tpcds_q10/datafusion:vortex-file-compressed 26887154 / 26880341 / +0.0% 49899382 / 48189355 / +3.5% 0.54 / 0.56 / -3.4%
tpcds_q11/datafusion:vortex-file-compressed 52633936 / 53619606 / -1.8% 83589764 / 83011130 / +0.7% 0.63 / 0.65 / -2.5%
tpcds_q12/datafusion:vortex-file-compressed 14882312 / 14684026 / +1.4% 33883348 / 34622629 / -2.1% 0.44 / 0.42 / +3.6%
tpcds_q13/datafusion:vortex-file-compressed 31073904 / 32010802 / -2.9% 57363135 / 57156922 / +0.4% 0.54 / 0.56 / -3.3%
tpcds_q14/datafusion:vortex-file-compressed 489292988 / 489791444 / -0.1% 545336001 / 544706009 / +0.1% 0.90 / 0.90 / -0.2%
tpcds_q15/datafusion:vortex-file-compressed 12228151 / 12428364 / -1.6% 34861592 / 35106180 / -0.7% 0.35 / 0.35 / -0.9%
tpcds_q16/datafusion:vortex-file-compressed 18575330 / 18871203 / -1.6% 39243734 / 38696845 / +1.4% 0.47 / 0.49 / -2.9%
tpcds_q17/datafusion:vortex-file-compressed 54496411 / 54804677 / -0.6% 77932033 / 68970389 / +13.0% 🔴 0.70 / 0.79 / -12.0%
tpcds_q18/datafusion:vortex-file-compressed 62534613 / 63107622 / -0.9% 86578831 / 88163596 / -1.8% 0.72 / 0.72 / +0.9%
tpcds_q19/datafusion:vortex-file-compressed 16868364 / 16957530 / -0.5% 39099903 / 39298980 / -0.5% 0.43 / 0.43 / -0.0%
tpcds_q20/datafusion:vortex-file-compressed 16258844 / 16280346 / -0.1% 36633438 / 37472069 / -2.2% 0.44 / 0.43 / +2.2%
tpcds_q21/datafusion:vortex-file-compressed 15873796 / 16013264 / -0.9% 38709673 / 39733354 / -2.6% 0.41 / 0.40 / +1.8%
tpcds_q22/datafusion:vortex-file-compressed 49344430 / 50017827 / -1.3% 72448868 / 73780778 / -1.8% 0.68 / 0.68 / +0.5%
tpcds_q23/datafusion:vortex-file-compressed 68927878 / 69828523 / -1.3% 98326752 / 97465580 / +0.9% 0.70 / 0.72 / -2.2%
tpcds_q24/datafusion:vortex-file-compressed 65452663 / 65137612 / +0.5% 87835122 / 85710935 / +2.5% 0.75 / 0.76 / -1.9%
tpcds_q25/datafusion:vortex-file-compressed 48010582 / 46268614 / +3.8% 73849843 / 74997004 / -1.5% 0.65 / 0.62 / +5.4%
tpcds_q26/datafusion:vortex-file-compressed 26258130 / 25919592 / +1.3% 48770849 / 47267426 / +3.2% 0.54 / 0.55 / -1.8%
tpcds_q27/datafusion:vortex-file-compressed 57838034 / 59859851 / -3.4% 83405148 / 85439628 / -2.4% 0.69 / 0.70 / -1.0%
tpcds_q28/datafusion:vortex-file-compressed 25783652 / 25556006 / +0.9% 40742423 / 41798690 / -2.5% 0.63 / 0.61 / +3.5%
tpcds_q29/datafusion:vortex-file-compressed 53392671 / 52733690 / +1.2% 68618324 / 78174129 / -12.2% 🟢 0.78 / 0.67 / +15.3%
tpcds_q30/datafusion:vortex-file-compressed 26248738 / 26061660 / +0.7% 45170307 / 45714736 / -1.2% 0.58 / 0.57 / +1.9%
tpcds_q31/datafusion:vortex-file-compressed 58401862 / 58715528 / -0.5% 85667400 / 83377309 / +2.7% 0.68 / 0.70 / -3.2%
tpcds_q32/datafusion:vortex-file-compressed 12455666 / 12384680 / +0.6% 30076198 / 30828997 / -2.4% 0.41 / 0.40 / +3.1%
tpcds_q33/datafusion:vortex-file-compressed 27182313 / 27666098 / -1.7% 50106738 / 51488916 / -2.7% 0.54 / 0.54 / +1.0%
tpcds_q34/datafusion:vortex-file-compressed 17246001 / 17538776 / -1.7% 37624125 / 37949314 / -0.9% 0.46 / 0.46 / -0.8%
tpcds_q35/datafusion:vortex-file-compressed 30458234 / 30742987 / -0.9% 56004181 / 55450642 / +1.0% 0.54 / 0.55 / -1.9%
tpcds_q36/datafusion:vortex-file-compressed 47663999 / 47658494 / +0.0% 72144904 / 72216789 / -0.1% 0.66 / 0.66 / +0.1%
tpcds_q37/datafusion:vortex-file-compressed 11813020 / 11754964 / +0.5% 34359048 / 31903786 / +7.7% 0.34 / 0.37 / -6.7%
tpcds_q38/datafusion:vortex-file-compressed 25318376 / 25455642 / -0.5% 47934679 / 47570390 / +0.8% 0.53 / 0.54 / -1.3%
tpcds_q39/datafusion:vortex-file-compressed 64763550 / 65391072 / -1.0% 91805304 / 94596898 / -3.0% 0.71 / 0.69 / +2.1%
tpcds_q40/datafusion:vortex-file-compressed 22980040 / 23162004 / -0.8% 43717173 / 43357778 / +0.8% 0.53 / 0.53 / -1.6%
tpcds_q41/datafusion:vortex-file-compressed 20288576 / 20563480 / -1.3% 34662704 / 35125640 / -1.3% 0.59 / 0.59 / -0.0%
tpcds_q42/datafusion:vortex-file-compressed 10881716 / 10929430 / -0.4% 28617030 / 27706306 / +3.3% 0.38 / 0.39 / -3.6%
tpcds_q43/datafusion:vortex-file-compressed 12528855 / 12312582 / +1.8% 33033382 / 31657360 / +4.3% 0.38 / 0.39 / -2.5%
tpcds_q44/datafusion:vortex-file-compressed 29044512 / 29079660 / -0.1% 51274588 / 50526229 / +1.5% 0.57 / 0.58 / -1.6%
tpcds_q45/datafusion:vortex-file-compressed 15747680 / 15536190 / +1.4% 36665732 / 36061992 / +1.7% 0.43 / 0.43 / -0.3%
tpcds_q46/datafusion:vortex-file-compressed 23181038 / 23676298 / -2.1% 48247978 / 48925337 / -1.4% 0.48 / 0.48 / -0.7%
tpcds_q47/datafusion:vortex-file-compressed 75983646 / 75516806 / +0.6% 105616668 / 102974875 / +2.6% 0.72 / 0.73 / -1.9%
tpcds_q48/datafusion:vortex-file-compressed 28586742 / 28621022 / -0.1% 53871970 / 51252076 / +5.1% 0.53 / 0.56 / -5.0%
tpcds_q49/datafusion:vortex-file-compressed 58880459 / 57934282 / +1.6% 79157104 / 81057591 / -2.3% 0.74 / 0.71 / +4.1%
tpcds_q50/datafusion:vortex-file-compressed 30325071 / 30504951 / -0.6% 52124895 / 51842641 / +0.5% 0.58 / 0.59 / -1.1%
tpcds_q51/datafusion:vortex-file-compressed 65903572 / 66739860 / -1.3% 87158670 / 89216884 / -2.3% 0.76 / 0.75 / +1.1%
tpcds_q52/datafusion:vortex-file-compressed 11136727 / 11486826 / -3.0% 27770960 / 28144941 / -1.3% 0.40 / 0.41 / -1.7%
tpcds_q53/datafusion:vortex-file-compressed 17497382 / 17635886 / -0.8% 40408922 / 39401217 / +2.6% 0.43 / 0.45 / -3.3%
tpcds_q54/datafusion:vortex-file-compressed 30897710 / 30993613 / -0.3% 53948287 / 54530298 / -1.1% 0.57 / 0.57 / +0.8%
tpcds_q55/datafusion:vortex-file-compressed 10715468 / 10919304 / -1.9% 27426918 / 28328444 / -3.2% 0.39 / 0.39 / +1.4%
tpcds_q56/datafusion:vortex-file-compressed 26173070 / 26194657 / -0.1% 49109116 / 48905701 / +0.4% 0.53 / 0.54 / -0.5%
tpcds_q57/datafusion:vortex-file-compressed 63293260 / 62552246 / +1.2% 87283220 / 87159231 / +0.1% 0.73 / 0.72 / +1.0%
tpcds_q58/datafusion:vortex-file-compressed 38136491 / 38119668 / +0.0% 63468977 / 64269325 / -1.2% 0.60 / 0.59 / +1.3%
tpcds_q59/datafusion:vortex-file-compressed 29654900 / 29347601 / +1.0% 54774787 / 55529104 / -1.4% 0.54 / 0.53 / +2.4%
tpcds_q60/datafusion:vortex-file-compressed 26004486 / 26249020 / -0.9% 48560622 / 48441049 / +0.2% 0.54 / 0.54 / -1.2%
tpcds_q61/datafusion:vortex-file-compressed 21422926 / 21233962 / +0.9% 41636113 / 44202292 / -5.8% 0.51 / 0.48 / +7.1%
tpcds_q62/datafusion:vortex-file-compressed 16230459 / 16153737 / +0.5% 35608553 / 35428323 / +0.5% 0.46 / 0.46 / -0.0%
tpcds_q63/datafusion:vortex-file-compressed 17657636 / 17442618 / +1.2% 39595365 / 41266460 / -4.0% 0.45 / 0.42 / +5.5%
tpcds_q64/datafusion:vortex-file-compressed 212061690 / 212920401 / -0.4% 247408212 / 250161382 / -1.1% 0.86 / 0.85 / +0.7%
tpcds_q65/datafusion:vortex-file-compressed 73534466 / 73469396 / +0.1% 96233498 / 94631498 / +1.7% 0.76 / 0.78 / -1.6%
tpcds_q66/datafusion:vortex-file-compressed 50524644 / 50285458 / +0.5% 72548672 / 72724750 / -0.2% 0.70 / 0.69 / +0.7%
tpcds_q67/datafusion:vortex-file-compressed 50245018 / 50810750 / -1.1% 83420695 / 84051406 / -0.8% 0.60 / 0.60 / -0.4%
tpcds_q68/datafusion:vortex-file-compressed 22685707 / 22983880 / -1.3% 47191699 / 46096786 / +2.4% 0.48 / 0.50 / -3.6%
tpcds_q69/datafusion:vortex-file-compressed 25416551 / 25296852 / +0.5% 47673769 / 48493054 / -1.7% 0.53 / 0.52 / +2.2%
tpcds_q70/datafusion:vortex-file-compressed 71679948 / 71362809 / +0.4% 95698325 / 92995793 / +2.9% 0.75 / 0.77 / -2.4%
tpcds_q71/datafusion:vortex-file-compressed 19669441 / 18804240 / +4.6% 38949042 / 41461839 / -6.1% 0.51 / 0.45 / +11.3%
tpcds_q72/datafusion:vortex-file-compressed 341975458 / 351370834 / -2.7% 406871926 / 392437145 / +3.7% 0.84 / 0.90 / -6.1%
tpcds_q73/datafusion:vortex-file-compressed 16025032 / 16288636 / -1.6% 38325196 / 38199079 / +0.3% 0.42 / 0.43 / -1.9%
tpcds_q74/datafusion:vortex-file-compressed 39468594 / 40284501 / -2.0% 68514387 / 68516208 / -0.0% 0.58 / 0.59 / -2.0%
tpcds_q75/datafusion:vortex-file-compressed 136833944 / 137048270 / -0.2% 162809866 / 173301409 / -6.1% 0.84 / 0.79 / +6.3%
tpcds_q76/datafusion:vortex-file-compressed 29471700 / 29981948 / -1.7% 49994993 / 50367313 / -0.7% 0.59 / 0.60 / -1.0%
tpcds_q77/datafusion:vortex-file-compressed 45118812 / 44970793 / +0.3% 67811074 / 69972210 / -3.1% 0.67 / 0.64 / +3.5%
tpcds_q78/datafusion:vortex-file-compressed 64080307 / 63644904 / +0.7% 92972996 / 94056119 / -1.2% 0.69 / 0.68 / +1.9%
tpcds_q79/datafusion:vortex-file-compressed 19566550 / 19564490 / +0.0% 44197754 / 45043582 / -1.9% 0.44 / 0.43 / +1.9%
tpcds_q80/datafusion:vortex-file-compressed 73772006 / 73714639 / +0.1% 100961492 / 103229025 / -2.2% 0.73 / 0.71 / +2.3%
tpcds_q81/datafusion:vortex-file-compressed 26405730 / 25926592 / +1.8% 44456038 / 44352898 / +0.2% 0.59 / 0.58 / +1.6%
tpcds_q82/datafusion:vortex-file-compressed 11866626 / 12160181 / -2.4% 33972654 / 34570893 / -1.7% 0.35 / 0.35 / -0.7%
tpcds_q83/datafusion:vortex-file-compressed 32528810 / 32478950 / +0.2% 53352678 / 53088303 / +0.5% 0.61 / 0.61 / -0.3%
tpcds_q84/datafusion:vortex-file-compressed 10046264 / 10129449 / -0.8% 26941141 / 26998053 / -0.2% 0.37 / 0.38 / -0.6%
tpcds_q85/datafusion:vortex-file-compressed 52757304 / 53699598 / -1.8% 79994666 / 80407590 / -0.5% 0.66 / 0.67 / -1.2%
tpcds_q86/datafusion:vortex-file-compressed 15766153 / 15602730 / +1.0% 34844994 / 35782430 / -2.6% 0.45 / 0.44 / +3.8%
tpcds_q87/datafusion:vortex-file-compressed 25598126 / 25552502 / +0.2% 51118865 / 49287645 / +3.7% 0.50 / 0.52 / -3.4%
tpcds_q88/datafusion:vortex-file-compressed 31747664 / 31486772 / +0.8% 52615252 / 51437520 / +2.3% 0.60 / 0.61 / -1.4%
tpcds_q89/datafusion:vortex-file-compressed 21112635 / 21248858 / -0.6% 42776659 / 44461382 / -3.8% 0.49 / 0.48 / +3.3%
tpcds_q90/datafusion:vortex-file-compressed 9843447 / 10180899 / -3.3% 26145386 / 25860873 / +1.1% 0.38 / 0.39 / -4.4%
tpcds_q91/datafusion:vortex-file-compressed 16672091 / 16782189 / -0.7% 36385176 / 37416834 / -2.8% 0.46 / 0.45 / +2.2%
tpcds_q92/datafusion:vortex-file-compressed 12841476 / 12578666 / +2.1% 28748213 / 29697138 / -3.2% 0.45 / 0.42 / +5.5%
tpcds_q93/datafusion:vortex-file-compressed 20396616 / 20115911 / +1.4% 42140564 / 41616396 / +1.3% 0.48 / 0.48 / +0.1%
tpcds_q94/datafusion:vortex-file-compressed 18267966 / 17917832 / +2.0% 38464161 / 36596533 / +5.1% 0.47 / 0.49 / -3.0%
tpcds_q95/datafusion:vortex-file-compressed 42621116 / 42279548 / +0.8% 62961467 / 62554880 / +0.6% 0.68 / 0.68 / +0.2%
tpcds_q96/datafusion:vortex-file-compressed 7735674 / 7632010 / +1.4% 25547323 / 24618012 / +3.8% 0.30 / 0.31 / -2.3%
tpcds_q97/datafusion:vortex-file-compressed 17248374 / 17309329 / -0.4% 38273388 / 39384526 / -2.8% 0.45 / 0.44 / +2.5%
tpcds_q98/datafusion:vortex-file-compressed 16116758 / 16278846 / -1.0% 38961221 / 39621723 / -1.7% 0.41 / 0.41 / +0.7%
tpcds_q99/datafusion:vortex-file-compressed 15844642 / 15787693 / +0.4% 35975710 / 35518409 / +1.3% 0.44 / 0.44 / -0.9%
datafusion / vortex-compact / ns (1.001x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 20887507 / 21028862 / -0.7% 39327047 / 39946203 / -1.5% 0.53 / 0.53 / +0.9%
tpcds_q02/datafusion:vortex-compact 44902199 / 44685199 / +0.5% 67671400 / 66004417 / +2.5% 0.66 / 0.68 / -2.0%
tpcds_q03/datafusion:vortex-compact 11426381 / 11616775 / -1.6% 31621260 / 31773622 / -0.5% 0.36 / 0.37 / -1.2%
tpcds_q04/datafusion:vortex-compact 93524113 / 94332029 / -0.9% 126708705 / 123834764 / +2.3% 0.74 / 0.76 / -3.1%
tpcds_q05/datafusion:vortex-compact 57343464 / 56759586 / +1.0% 77896793 / 81012480 / -3.8% 0.74 / 0.70 / +5.1%
tpcds_q06/datafusion:vortex-compact 22894670 / 22935511 / -0.2% 43730766 / 44366332 / -1.4% 0.52 / 0.52 / +1.3%
tpcds_q07/datafusion:vortex-compact 31926216 / 31830766 / +0.3% 53815939 / 53263720 / +1.0% 0.59 / 0.60 / -0.7%
tpcds_q08/datafusion:vortex-compact 27037704 / 26888928 / +0.6% 46689102 / 47283703 / -1.3% 0.58 / 0.57 / +1.8%
tpcds_q09/datafusion:vortex-compact 22698364 / 22739376 / -0.2% 40086150 / 40775921 / -1.7% 0.57 / 0.56 / +1.5%
tpcds_q10/datafusion:vortex-compact 29338646 / 29488756 / -0.5% 54352429 / 52215586 / +4.1% 0.54 / 0.56 / -4.4%
tpcds_q11/datafusion:vortex-compact 56981046 / 55960686 / +1.8% 87657784 / 88465003 / -0.9% 0.65 / 0.63 / +2.8%
tpcds_q12/datafusion:vortex-compact 18823647 / 18657119 / +0.9% 38625494 / 38355311 / +0.7% 0.49 / 0.49 / +0.2%
tpcds_q13/datafusion:vortex-compact 47484650 / 48467116 / -2.0% 68918519 / 68498250 / +0.6% 0.69 / 0.71 / -2.6%
tpcds_q14/datafusion:vortex-compact 632812278 / 632535068 / +0.0% 693945840 / 690661155 / +0.5% 0.91 / 0.92 / -0.4%
tpcds_q15/datafusion:vortex-compact 14026354 / 13924863 / +0.7% 35851958 / 36390469 / -1.5% 0.39 / 0.38 / +2.2%
tpcds_q16/datafusion:vortex-compact 19643634 / 19565868 / +0.4% 40375476 / 41432056 / -2.6% 0.49 / 0.47 / +3.0%
tpcds_q17/datafusion:vortex-compact 58470778 / 54607680 / +7.1% 71892743 / 80832730 / -11.1% 🟢 0.81 / 0.68 / +20.4%
tpcds_q18/datafusion:vortex-compact 61492588 / 61059100 / +0.7% 82787184 / 82155434 / +0.8% 0.74 / 0.74 / -0.1%
tpcds_q19/datafusion:vortex-compact 19031492 / 18685470 / +1.9% 42163524 / 40775488 / +3.4% 0.45 / 0.46 / -1.5%
tpcds_q20/datafusion:vortex-compact 20941130 / 20387472 / +2.7% 40913370 / 40735581 / +0.4% 0.51 / 0.50 / +2.3%
tpcds_q21/datafusion:vortex-compact 17519596 / 17634598 / -0.7% 40277708 / 39651358 / +1.6% 0.43 / 0.44 / -2.2%
tpcds_q22/datafusion:vortex-compact 50006258 / 49712656 / +0.6% 70820264 / 75392597 / -6.1% 0.71 / 0.66 / +7.1%
tpcds_q23/datafusion:vortex-compact 73101358 / 73476988 / -0.5% 98605678 / 103086403 / -4.3% 0.74 / 0.71 / +4.0%
tpcds_q24/datafusion:vortex-compact 71380678 / 71585412 / -0.3% 95410551 / 93337008 / +2.2% 0.75 / 0.77 / -2.5%
tpcds_q25/datafusion:vortex-compact 52594485 / 52616396 / -0.0% 83797788 / 83039714 / +0.9% 0.63 / 0.63 / -0.9%
tpcds_q26/datafusion:vortex-compact 27897397 / 27813824 / +0.3% 47620574 / 49022759 / -2.9% 0.59 / 0.57 / +3.3%
tpcds_q27/datafusion:vortex-compact 56769183 / 57555000 / -1.4% 81160559 / 77091896 / +5.3% 0.70 / 0.75 / -6.3%
tpcds_q28/datafusion:vortex-compact 28525892 / 27805246 / +2.6% 46953535 / 45860617 / +2.4% 0.61 / 0.61 / +0.2%
tpcds_q29/datafusion:vortex-compact 56924624 / 57388737 / -0.8% 78997914 / 71630386 / +10.3% 🔴 0.72 / 0.80 / -10.1%
tpcds_q30/datafusion:vortex-compact 27880236 / 27962110 / -0.3% 46094629 / 45858956 / +0.5% 0.60 / 0.61 / -0.8%
tpcds_q31/datafusion:vortex-compact 61146278 / 60896348 / +0.4% 86310002 / 87551588 / -1.4% 0.71 / 0.70 / +1.9%
tpcds_q32/datafusion:vortex-compact 13706182 / 13607825 / +0.7% 32421959 / 33823115 / -4.1% 0.42 / 0.40 / +5.1%
tpcds_q33/datafusion:vortex-compact 28056436 / 27014932 / +3.9% 52109935 / 53175773 / -2.0% 0.54 / 0.51 / +6.0%
tpcds_q34/datafusion:vortex-compact 18750757 / 19011584 / -1.4% 38130125 / 38866730 / -1.9% 0.49 / 0.49 / +0.5%
tpcds_q35/datafusion:vortex-compact 33268160 / 33176594 / +0.3% 58385844 / 56089981 / +4.1% 0.57 / 0.59 / -3.7%
tpcds_q36/datafusion:vortex-compact 49363895 / 47936036 / +3.0% 76069359 / 75072109 / +1.3% 0.65 / 0.64 / +1.6%
tpcds_q37/datafusion:vortex-compact 14806456 / 15580877 / -5.0% 37104961 / 37987452 / -2.3% 0.40 / 0.41 / -2.7%
tpcds_q38/datafusion:vortex-compact 26114748 / 25813056 / +1.2% 49284829 / 48513283 / +1.6% 0.53 / 0.53 / -0.4%
tpcds_q39/datafusion:vortex-compact 65839800 / 64620333 / +1.9% 89288783 / 89872442 / -0.6% 0.74 / 0.72 / +2.6%
tpcds_q40/datafusion:vortex-compact 24244560 / 24063502 / +0.8% 47426313 / 47305654 / +0.3% 0.51 / 0.51 / +0.5%
tpcds_q41/datafusion:vortex-compact 20909156 / 21118406 / -1.0% 36274847 / 36710549 / -1.2% 0.58 / 0.58 / +0.2%
tpcds_q42/datafusion:vortex-compact 11217196 / 11246331 / -0.3% 30416483 / 29509522 / +3.1% 0.37 / 0.38 / -3.2%
tpcds_q43/datafusion:vortex-compact 13004242 / 12962840 / +0.3% 32043489 / 32139471 / -0.3% 0.41 / 0.40 / +0.6%
tpcds_q44/datafusion:vortex-compact 28462778 / 28333082 / +0.5% 49641973 / 49762249 / -0.2% 0.57 / 0.57 / +0.7%
tpcds_q45/datafusion:vortex-compact 17518745 / 17539481 / -0.1% 38667072 / 40374423 / -4.2% 0.45 / 0.43 / +4.3%
tpcds_q46/datafusion:vortex-compact 24987774 / 24610571 / +1.5% 48278945 / 47633846 / +1.4% 0.52 / 0.52 / +0.2%
tpcds_q47/datafusion:vortex-compact 80330096 / 80386698 / -0.1% 109751334 / 112663092 / -2.6% 0.73 / 0.71 / +2.6%
tpcds_q48/datafusion:vortex-compact 44831683 / 43510006 / +3.0% 64341458 / 63468253 / +1.4% 0.70 / 0.69 / +1.6%
tpcds_q49/datafusion:vortex-compact 62654102 / 60800470 / +3.0% 82382454 / 85298364 / -3.4% 0.76 / 0.71 / +6.7%
tpcds_q50/datafusion:vortex-compact 31292892 / 31362131 / -0.2% 51667518 / 52879164 / -2.3% 0.61 / 0.59 / +2.1%
tpcds_q51/datafusion:vortex-compact 66763641 / 66453426 / +0.5% 85299952 / 89820009 / -5.0% 0.78 / 0.74 / +5.8%
tpcds_q52/datafusion:vortex-compact 11412121 / 11479406 / -0.6% 32063393 / 32300563 / -0.7% 0.36 / 0.36 / +0.1%
tpcds_q53/datafusion:vortex-compact 20572262 / 20758338 / -0.9% 42404499 / 43356285 / -2.2% 0.49 / 0.48 / +1.3%
tpcds_q54/datafusion:vortex-compact 33538400 / 33272951 / +0.8% 58011431 / 58811368 / -1.4% 0.58 / 0.57 / +2.2%
tpcds_q55/datafusion:vortex-compact 10773778 / 11100132 / -2.9% 29885187 / 30433809 / -1.8% 0.36 / 0.36 / -1.2%
tpcds_q56/datafusion:vortex-compact 26576495 / 27073358 / -1.8% 50229678 / 48587798 / +3.4% 0.53 / 0.56 / -5.0%
tpcds_q57/datafusion:vortex-compact 66431531 / 66530748 / -0.1% 93835298 / 95512762 / -1.8% 0.71 / 0.70 / +1.6%
tpcds_q58/datafusion:vortex-compact 42387512 / 41861431 / +1.3% 68002115 / 70082064 / -3.0% 0.62 / 0.60 / +4.4%
tpcds_q59/datafusion:vortex-compact 31620617 / 30864351 / +2.5% 56043116 / 56540725 / -0.9% 0.56 / 0.55 / +3.4%
tpcds_q60/datafusion:vortex-compact 25962789 / 26197058 / -0.9% 49344658 / 48905900 / +0.9% 0.53 / 0.54 / -1.8%
tpcds_q61/datafusion:vortex-compact 22984850 / 22876006 / +0.5% 44311133 / 45514889 / -2.6% 0.52 / 0.50 / +3.2%
tpcds_q62/datafusion:vortex-compact 16737630 / 16561672 / +1.1% 35004989 / 35625263 / -1.7% 0.48 / 0.46 / +2.9%
tpcds_q63/datafusion:vortex-compact 20706492 / 20630510 / +0.4% 41390183 / 42270955 / -2.1% 0.50 / 0.49 / +2.5%
tpcds_q64/datafusion:vortex-compact 304384206 / 302900626 / +0.5% 339394838 / 335337564 / +1.2% 0.90 / 0.90 / -0.7%
tpcds_q65/datafusion:vortex-compact 76831189 / 75701346 / +1.5% 100575705 / 99805597 / +0.8% 0.76 / 0.76 / +0.7%
tpcds_q66/datafusion:vortex-compact 51198928 / 51304474 / -0.2% 73736473 / 74150647 / -0.6% 0.69 / 0.69 / +0.4%
tpcds_q67/datafusion:vortex-compact 53000986 / 52231260 / +1.5% 82230762 / 88866004 / -7.5% 0.64 / 0.59 / +9.7%
tpcds_q68/datafusion:vortex-compact 25500412 / 25136068 / +1.4% 50285309 / 51769850 / -2.9% 0.51 / 0.49 / +4.4%
tpcds_q69/datafusion:vortex-compact 28469944 / 29409393 / -3.2% 51313420 / 51703707 / -0.8% 0.55 / 0.57 / -2.5%
tpcds_q70/datafusion:vortex-compact 71384904 / 72677735 / -1.8% 93056800 / 93563251 / -0.5% 0.77 / 0.78 / -1.2%
tpcds_q71/datafusion:vortex-compact 18824094 / 19888799 / -5.4% 40111975 / 40780950 / -1.6% 0.47 / 0.49 / -3.8%
tpcds_q72/datafusion:vortex-compact 346933325 / 349366304 / -0.7% 402064595 / 399873875 / +0.5% 0.86 / 0.87 / -1.2%
tpcds_q73/datafusion:vortex-compact 17712078 / 17193889 / +3.0% 40490889 / 39732049 / +1.9% 0.44 / 0.43 / +1.1%
tpcds_q74/datafusion:vortex-compact 42036018 / 41483094 / +1.3% 68891724 / 70285626 / -2.0% 0.61 / 0.59 / +3.4%
tpcds_q75/datafusion:vortex-compact 139120808 / 140928321 / -1.3% 169255553 / 172050069 / -1.6% 0.82 / 0.82 / +0.3%
tpcds_q76/datafusion:vortex-compact 29974584 / 30597968 / -2.0% 51235648 / 49289343 / +3.9% 0.59 / 0.62 / -5.8%
tpcds_q77/datafusion:vortex-compact 44916592 / 45936302 / -2.2% 69608252 / 70371529 / -1.1% 0.65 / 0.65 / -1.1%
tpcds_q78/datafusion:vortex-compact 66084206 / 65231740 / +1.3% 94099677 / 95886750 / -1.9% 0.70 / 0.68 / +3.2%
tpcds_q79/datafusion:vortex-compact 21794214 / 21480142 / +1.5% 42959125 / 43442393 / -1.1% 0.51 / 0.49 / +2.6%
tpcds_q80/datafusion:vortex-compact 75201808 / 74973934 / +0.3% 104812709 / 104611758 / +0.2% 0.72 / 0.72 / +0.1%
tpcds_q81/datafusion:vortex-compact 27182594 / 26903131 / +1.0% 45663979 / 45475860 / +0.4% 0.60 / 0.59 / +0.6%
tpcds_q82/datafusion:vortex-compact 14490490 / 13476632 / +7.5% 35463267 / 37053348 / -4.3% 0.41 / 0.36 / +12.3%
tpcds_q83/datafusion:vortex-compact 33036157 / 33190405 / -0.5% 56610223 / 54004576 / +4.8% 0.58 / 0.61 / -5.0%
tpcds_q84/datafusion:vortex-compact 10717809 / 11081080 / -3.3% 27685536 / 26934652 / +2.8% 0.39 / 0.41 / -5.9%
tpcds_q85/datafusion:vortex-compact 95328660 / 95621979 / -0.3% 121221006 / 121638830 / -0.3% 0.79 / 0.79 / +0.0%
tpcds_q86/datafusion:vortex-compact 15606825 / 15492744 / +0.7% 34096384 / 35957587 / -5.2% 0.46 / 0.43 / +6.2%
tpcds_q87/datafusion:vortex-compact 26441752 / 26450590 / -0.0% 49172723 / 48363135 / +1.7% 0.54 / 0.55 / -1.7%
tpcds_q88/datafusion:vortex-compact 36458664 / 35777582 / +1.9% 60028097 / 56132179 / +6.9% 0.61 / 0.64 / -4.7%
tpcds_q89/datafusion:vortex-compact 22802967 / 22556978 / +1.1% 45344695 / 44386911 / +2.2% 0.50 / 0.51 / -1.0%
tpcds_q90/datafusion:vortex-compact 10327108 / 10468834 / -1.4% 27694490 / 27617005 / +0.3% 0.37 / 0.38 / -1.6%
tpcds_q91/datafusion:vortex-compact 24714568 / 28353672 / -12.8% 🟢 44995894 / 43877863 / +2.5% 0.55 / 0.65 / -15.0%
tpcds_q92/datafusion:vortex-compact 13564860 / 13555962 / +0.1% 31052711 / 31299547 / -0.8% 0.44 / 0.43 / +0.9%
tpcds_q93/datafusion:vortex-compact 20592440 / 20824386 / -1.1% 40446741 / 44006728 / -8.1% 0.51 / 0.47 / +7.6%
tpcds_q94/datafusion:vortex-compact 19685168 / 19412286 / +1.4% 38538803 / 37497326 / +2.8% 0.51 / 0.52 / -1.3%
tpcds_q95/datafusion:vortex-compact 43130444 / 42889974 / +0.6% 63488553 / 64412711 / -1.4% 0.68 / 0.67 / +2.0%
tpcds_q96/datafusion:vortex-compact 8303347 / 8299726 / +0.0% 27690774 / 26795923 / +3.3% 0.30 / 0.31 / -3.2%
tpcds_q97/datafusion:vortex-compact 17276539 / 17361658 / -0.5% 37681373 / 37831766 / -0.4% 0.46 / 0.46 / -0.1%
tpcds_q98/datafusion:vortex-compact 20656145 / 20722482 / -0.3% 41676141 / 42843373 / -2.7% 0.50 / 0.48 / +2.5%
tpcds_q99/datafusion:vortex-compact 16652639 / 16774622 / -0.7% 35570770 / 35540350 / +0.1% 0.47 / 0.47 / -0.8%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43944635 / 43658199 / +0.7% 62283972 / 60943177 / +2.2% 0.71 / 0.72 / -1.5%
tpcds_q02/datafusion:parquet 55676656 / 55423770 / +0.5% 72822578 / 70972903 / +2.6% 0.76 / 0.78 / -2.1%
tpcds_q03/datafusion:parquet 19173084 / 19214446 / -0.2% 34751274 / 31718953 / +9.6% 0.55 / 0.61 / -8.9%
tpcds_q04/datafusion:parquet 181265250 / 179813229 / +0.8% 209333869 / 205801638 / +1.7% 0.87 / 0.87 / -0.9%
tpcds_q05/datafusion:parquet 68199708 / 69629538 / -2.1% 89798322 / 90776006 / -1.1% 0.76 / 0.77 / -1.0%
tpcds_q06/datafusion:parquet 33196410 / 33763684 / -1.7% 48769069 / 47902691 / +1.8% 0.68 / 0.70 / -3.4%
tpcds_q07/datafusion:parquet 47085326 / 46940258 / +0.3% 68669335 / 66338840 / +3.5% 0.69 / 0.71 / -3.1%
tpcds_q08/datafusion:parquet 30907772 / 31287272 / -1.2% 48466968 / 46978633 / +3.2% 0.64 / 0.67 / -4.2%
tpcds_q09/datafusion:parquet 31163566 / 30651653 / +1.7% 44812211 / 41978239 / +6.8% 0.70 / 0.73 / -4.8%
tpcds_q10/datafusion:parquet 44185434 / 44884127 / -1.6% 59282533 / 60409581 / -1.9% 0.75 / 0.74 / +0.3%
tpcds_q11/datafusion:parquet 97665385 / 97834872 / -0.2% 122419291 / 122298239 / +0.1% 0.80 / 0.80 / -0.3%
tpcds_q12/datafusion:parquet 23340018 / 24234904 / -3.7% 40322420 / 37168482 / +8.5% 0.58 / 0.65 / -11.2%
tpcds_q13/datafusion:parquet 46764199 / 47211462 / -0.9% 67954375 / 67673792 / +0.4% 0.69 / 0.70 / -1.4%
tpcds_q14/datafusion:parquet 535885254 / 536580714 / -0.1% 589777427 / 584606306 / +0.9% 0.91 / 0.92 / -1.0%
tpcds_q15/datafusion:parquet 23108602 / 23943495 / -3.5% 39360097 / 38218441 / +3.0% 0.59 / 0.63 / -6.3%
tpcds_q16/datafusion:parquet 36773104 / 36880231 / -0.3% 52320296 / 51968747 / +0.7% 0.70 / 0.71 / -1.0%
tpcds_q17/datafusion:parquet 73002466 / 73650080 / -0.9% 99719129 / 107102666 / -6.9% 0.73 / 0.69 / +6.5%
tpcds_q18/datafusion:parquet 68578693 / 65002738 / +5.5% 90943900 / 93980592 / -3.2% 0.75 / 0.69 / +9.0%
tpcds_q19/datafusion:parquet 30056536 / 29489076 / +1.9% 46755139 / 44906270 / +4.1% 0.64 / 0.66 / -2.1%
tpcds_q20/datafusion:parquet 25485638 / 25197604 / +1.1% 38446534 / 38301750 / +0.4% 0.66 / 0.66 / +0.8%
tpcds_q21/datafusion:parquet 20452828 / 20246114 / +1.0% 33496264 / 33698687 / -0.6% 0.61 / 0.60 / +1.6%
tpcds_q22/datafusion:parquet 77467508 / 77469621 / -0.0% 90240213 / 90260472 / -0.0% 0.86 / 0.86 / +0.0%
tpcds_q23/datafusion:parquet 90181575 / 93549315 / -3.6% 114789397 / 114879393 / -0.1% 0.79 / 0.81 / -3.5%
tpcds_q24/datafusion:parquet 91465459 / 92865438 / -1.5% 113123750 / 112753421 / +0.3% 0.81 / 0.82 / -1.8%
tpcds_q25/datafusion:parquet 82687236 / 79701328 / +3.7% 104172301 / 101024405 / +3.1% 0.79 / 0.79 / +0.6%
tpcds_q26/datafusion:parquet 43590043 / 43194364 / +0.9% 61789294 / 59751323 / +3.4% 0.71 / 0.72 / -2.4%
tpcds_q27/datafusion:parquet 75208274 / 77348072 / -2.8% 98780110 / 100806234 / -2.0% 0.76 / 0.77 / -0.8%
tpcds_q28/datafusion:parquet 28971216 / 28437738 / +1.9% 44422785 / 43577839 / +1.9% 0.65 / 0.65 / -0.1%
tpcds_q29/datafusion:parquet 76858414 / 73966966 / +3.9% 98334760 / 98578243 / -0.2% 0.78 / 0.75 / +4.2%
tpcds_q30/datafusion:parquet 44861453 / 46150132 / -2.8% 57725363 / 60532757 / -4.6% 0.78 / 0.76 / +1.9%
tpcds_q31/datafusion:parquet 82008408 / 80469645 / +1.9% 102225179 / 103216937 / -1.0% 0.80 / 0.78 / +2.9%
tpcds_q32/datafusion:parquet 26660746 / 26650390 / +0.0% 39871606 / 40916806 / -2.6% 0.67 / 0.65 / +2.7%
tpcds_q33/datafusion:parquet 39047845 / 37267688 / +4.8% 54931208 / 54729829 / +0.4% 0.71 / 0.68 / +4.4%
tpcds_q34/datafusion:parquet 24595904 / 24666976 / -0.3% 38341485 / 36848382 / +4.1% 0.64 / 0.67 / -4.2%
tpcds_q35/datafusion:parquet 49525906 / 49932274 / -0.8% 66810231 / 62996947 / +6.1% 0.74 / 0.79 / -6.5%
tpcds_q36/datafusion:parquet 51830628 / 53423298 / -3.0% 78461410 / 72683003 / +8.0% 0.66 / 0.74 / -10.1%
tpcds_q37/datafusion:parquet 21456260 / 21471490 / -0.1% 34588271 / 34451312 / +0.4% 0.62 / 0.62 / -0.5%
tpcds_q38/datafusion:parquet 45183408 / 45288117 / -0.2% 66416917 / 63455922 / +4.7% 0.68 / 0.71 / -4.7%
tpcds_q39/datafusion:parquet 67905686 / 67716499 / +0.3% 88299705 / 84506643 / +4.5% 0.77 / 0.80 / -4.0%
tpcds_q40/datafusion:parquet 30638788 / 31264841 / -2.0% 52167555 / 52782503 / -1.2% 0.59 / 0.59 / -0.8%
tpcds_q41/datafusion:parquet 19751134 / 20257628 / -2.5% 33249646 / 33680977 / -1.3% 0.59 / 0.60 / -1.2%
tpcds_q42/datafusion:parquet 18412342 / 18427980 / -0.1% 30086575 / 31402061 / -4.2% 0.61 / 0.59 / +4.3%
tpcds_q43/datafusion:parquet 19541909 / 19287466 / +1.3% 31989611 / 32862682 / -2.7% 0.61 / 0.59 / +4.1%
tpcds_q44/datafusion:parquet 35093894 / 35878126 / -2.2% 51695522 / 51644829 / +0.1% 0.68 / 0.69 / -2.3%
tpcds_q45/datafusion:parquet 27790098 / 27704888 / +0.3% 41902097 / 43013862 / -2.6% 0.66 / 0.64 / +3.0%
tpcds_q46/datafusion:parquet 29583413 / 29495568 / +0.3% 46595556 / 48092991 / -3.1% 0.63 / 0.61 / +3.5%
tpcds_q47/datafusion:parquet 98280337 / 97501476 / +0.8% 121331203 / 122328220 / -0.8% 0.81 / 0.80 / +1.6%
tpcds_q48/datafusion:parquet 42480384 / 41494568 / +2.4% 60178863 / 60127838 / +0.1% 0.71 / 0.69 / +2.3%
tpcds_q49/datafusion:parquet 71994280 / 70196298 / +2.6% 94586956 / 101253069 / -6.6% 0.76 / 0.69 / +9.8%
tpcds_q50/datafusion:parquet 47790377 / 48306693 / -1.1% 68543175 / 68577818 / -0.1% 0.70 / 0.70 / -1.0%
tpcds_q51/datafusion:parquet 75301444 / 75628612 / -0.4% 95914533 / 98096408 / -2.2% 0.79 / 0.77 / +1.8%
tpcds_q52/datafusion:parquet 18715326 / 18541890 / +0.9% 30725878 / 31305609 / -1.9% 0.61 / 0.59 / +2.8%
tpcds_q53/datafusion:parquet 22751378 / 22362498 / +1.7% 37944810 / 39466685 / -3.9% 0.60 / 0.57 / +5.8%
tpcds_q54/datafusion:parquet 52229318 / 52320264 / -0.2% 64285808 / 69576116 / -7.6% 0.81 / 0.75 / +8.0%
tpcds_q55/datafusion:parquet 18318764 / 18077733 / +1.3% 29502278 / 30313112 / -2.7% 0.62 / 0.60 / +4.1%
tpcds_q56/datafusion:parquet 41462178 / 40925384 / +1.3% 54337885 / 57194224 / -5.0% 0.76 / 0.72 / +6.6%
tpcds_q57/datafusion:parquet 101832246 / 103119716 / -1.2% 116710582 / 117275221 / -0.5% 0.87 / 0.88 / -0.8%
tpcds_q58/datafusion:parquet 66492284 / 65545894 / +1.4% 85358244 / 83120731 / +2.7% 0.78 / 0.79 / -1.2%
tpcds_q59/datafusion:parquet 49151142 / 47269116 / +4.0% 65038189 / 66030597 / -1.5% 0.76 / 0.72 / +5.6%
tpcds_q60/datafusion:parquet 43102876 / 39975871 / +7.8% 55611261 / 55407931 / +0.4% 0.78 / 0.72 / +7.4%
tpcds_q61/datafusion:parquet 37149759 / 35471024 / +4.7% 52677095 / 51547790 / +2.2% 0.71 / 0.69 / +2.5%
tpcds_q62/datafusion:parquet 25399897 / 25224585 / +0.7% 38962824 / 38945684 / +0.0% 0.65 / 0.65 / +0.7%
tpcds_q63/datafusion:parquet 22149556 / 22562046 / -1.8% 38811681 / 39531222 / -1.8% 0.57 / 0.57 / -0.0%
tpcds_q64/datafusion:parquet 290313552 / 290867720 / -0.2% 329118087 / 325516132 / +1.1% 0.88 / 0.89 / -1.3%
tpcds_q65/datafusion:parquet 122679002 / 120293760 / +2.0% 139905583 / 139188369 / +0.5% 0.88 / 0.86 / +1.5%
tpcds_q66/datafusion:parquet 60103881 / 61756606 / -2.7% 76792848 / 77797136 / -1.3% 0.78 / 0.79 / -1.4%
tpcds_q67/datafusion:parquet 69030811 / 68913771 / +0.2% 92537165 / 92011175 / +0.6% 0.75 / 0.75 / -0.4%
tpcds_q68/datafusion:parquet 29469530 / 29779442 / -1.0% 50540717 / 48828282 / +3.5% 0.58 / 0.61 / -4.4%
tpcds_q69/datafusion:parquet 44131064 / 43878845 / +0.6% 53866842 / 59838125 / -10.0% 0.82 / 0.73 / +11.7%
tpcds_q70/datafusion:parquet 81390450 / 80256592 / +1.4% 100799899 / 99147497 / +1.7% 0.81 / 0.81 / -0.2%
tpcds_q71/datafusion:parquet 25843967 / 26092964 / -1.0% 38447466 / 38566117 / -0.3% 0.67 / 0.68 / -0.6%
tpcds_q72/datafusion:parquet 523018045 / 522185742 / +0.2% 543989469 / 574822687 / -5.4% 0.96 / 0.91 / +5.8%
tpcds_q73/datafusion:parquet 23963435 / 24014178 / -0.2% 37114194 / 36542091 / +1.6% 0.65 / 0.66 / -1.7%
tpcds_q74/datafusion:parquet 69478650 / 69969681 / -0.7% 89169967 / 92011565 / -3.1% 0.78 / 0.76 / +2.5%
tpcds_q75/datafusion:parquet 152778670 / 154087810 / -0.8% 181261434 / 176254384 / +2.8% 0.84 / 0.87 / -3.6%
tpcds_q76/datafusion:parquet 33398762 / 33935723 / -1.6% 48923346 / 47508325 / +3.0% 0.68 / 0.71 / -4.4%
tpcds_q77/datafusion:parquet 56941638 / 56800628 / +0.2% 74702076 / 72593147 / +2.9% 0.76 / 0.78 / -2.6%
tpcds_q78/datafusion:parquet 85976763 / 86261868 / -0.3% 119976529 / 116695205 / +2.8% 0.72 / 0.74 / -3.1%
tpcds_q79/datafusion:parquet 27198290 / 27627303 / -1.6% 42779584 / 42767950 / +0.0% 0.64 / 0.65 / -1.6%
tpcds_q80/datafusion:parquet 81874306 / 80904811 / +1.2% 110840658 / 111558327 / -0.6% 0.74 / 0.73 / +1.9%
tpcds_q81/datafusion:parquet 39152294 / 37810623 / +3.5% 53863936 / 53772597 / +0.2% 0.73 / 0.70 / +3.4%
tpcds_q82/datafusion:parquet 22356396 / 22247050 / +0.5% 35740209 / 37455198 / -4.6% 0.63 / 0.59 / +5.3%
tpcds_q83/datafusion:parquet 58880813 / 58914584 / -0.1% 79149318 / 75045545 / +5.5% 0.74 / 0.79 / -5.2%
tpcds_q84/datafusion:parquet 26627904 / 26044978 / +2.2% 42399510 / 40645781 / +4.3% 0.63 / 0.64 / -2.0%
tpcds_q85/datafusion:parquet 80663949 / 80556026 / +0.1% 104414388 / 107010712 / -2.4% 0.77 / 0.75 / +2.6%
tpcds_q86/datafusion:parquet 21126674 / 20960206 / +0.8% 33594917 / 34543593 / -2.7% 0.63 / 0.61 / +3.6%
tpcds_q87/datafusion:parquet 45618399 / 43995419 / +3.7% 62021766 / 59933032 / +3.5% 0.74 / 0.73 / +0.2%
tpcds_q88/datafusion:parquet 38017222 / 36897422 / +3.0% 50873641 / 52353603 / -2.8% 0.75 / 0.70 / +6.0%
tpcds_q89/datafusion:parquet 26590318 / 25893977 / +2.7% 42289866 / 42601923 / -0.7% 0.63 / 0.61 / +3.4%
tpcds_q90/datafusion:parquet 14700263 / 14672462 / +0.2% 27256814 / 26744164 / +1.9% 0.54 / 0.55 / -1.7%
tpcds_q91/datafusion:parquet 32200800 / 33329088 / -3.4% 46677688 / 47026720 / -0.7% 0.69 / 0.71 / -2.7%
tpcds_q92/datafusion:parquet 26638126 / 27143973 / -1.9% 41217988 / 42705707 / -3.5% 0.65 / 0.64 / +1.7%
tpcds_q93/datafusion:parquet 26553402 / 27628552 / -3.9% 44271411 / 47880954 / -7.5% 0.60 / 0.58 / +3.9%
tpcds_q94/datafusion:parquet 35867961 / 35585808 / +0.8% 49362993 / 49143286 / +0.4% 0.73 / 0.72 / +0.3%
tpcds_q95/datafusion:parquet 63823248 / 63122057 / +1.1% 79114051 / 78862690 / +0.3% 0.81 / 0.80 / +0.8%
tpcds_q96/datafusion:parquet 12445232 / 12433756 / +0.1% 24998213 / 24630553 / +1.5% 0.50 / 0.50 / -1.4%
tpcds_q97/datafusion:parquet 35391776 / 35584840 / -0.5% 51551588 / 52924338 / -2.6% 0.69 / 0.67 / +2.1%
tpcds_q98/datafusion:parquet 24744428 / 25360130 / -2.4% 38422069 / 40590595 / -5.3% 0.64 / 0.62 / +3.1%
tpcds_q99/datafusion:parquet 29996325 / 29664510 / +1.1% 43060951 / 44126649 / -2.4% 0.70 / 0.67 / +3.6%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15704076 / 15875504 / -1.1% 24680703 / 24489214 / +0.8% 0.64 / 0.65 / -1.8%
tpcds_q02/duckdb:vortex-file-compressed 15521940 / 15684361 / -1.0% 23523850 / 22668187 / +3.8% 0.66 / 0.69 / -4.6%
tpcds_q03/duckdb:vortex-file-compressed 6912740 / 7197356 / -4.0% 17264490 / 15632535 / +10.4% 🔴 0.40 / 0.46 / -13.0%
tpcds_q04/duckdb:vortex-file-compressed 45017279 / 45456996 / -1.0% 55753863 / 54139184 / +3.0% 0.81 / 0.84 / -3.8%
tpcds_q05/duckdb:vortex-file-compressed 23118046 / 23271996 / -0.7% 31455767 / 30796820 / +2.1% 0.73 / 0.76 / -2.7%
tpcds_q06/duckdb:vortex-file-compressed 24151397 / 23978900 / +0.7% 37466947 / 37388980 / +0.2% 0.64 / 0.64 / +0.5%
tpcds_q07/duckdb:vortex-file-compressed 13348620 / 13655938 / -2.3% 24138018 / 23960450 / +0.7% 0.55 / 0.57 / -3.0%
tpcds_q08/duckdb:vortex-file-compressed 17527776 / 17567138 / -0.2% 25028744 / 25248495 / -0.9% 0.70 / 0.70 / +0.7%
tpcds_q09/duckdb:vortex-file-compressed 18688838 / 18449622 / +1.3% 29253167 / 29198478 / +0.2% 0.64 / 0.63 / +1.1%
tpcds_q10/duckdb:vortex-file-compressed 27078768 / 27127474 / -0.2% 40086844 / 39840544 / +0.6% 0.68 / 0.68 / -0.8%
tpcds_q11/duckdb:vortex-file-compressed 36786656 / 36676414 / +0.3% 45630061 / 44931756 / +1.6% 0.81 / 0.82 / -1.2%
tpcds_q12/duckdb:vortex-file-compressed 10014924 / 10017012 / -0.0% 17428002 / 17308692 / +0.7% 0.57 / 0.58 / -0.7%
tpcds_q13/duckdb:vortex-file-compressed 20755958 / 20624071 / +0.6% 34102520 / 34434545 / -1.0% 0.61 / 0.60 / +1.6%
tpcds_q14/duckdb:vortex-file-compressed 55345018 / 56240348 / -1.6% 65574163 / 65784158 / -0.3% 0.84 / 0.85 / -1.3%
tpcds_q15/duckdb:vortex-file-compressed 10917520 / 11000403 / -0.8% 19321784 / 18327589 / +5.4% 0.57 / 0.60 / -5.9%
tpcds_q16/duckdb:vortex-file-compressed 24129718 / 24257230 / -0.5% 36258213 / 35676373 / +1.6% 0.67 / 0.68 / -2.1%
tpcds_q17/duckdb:vortex-file-compressed 25533780 / 25912763 / -1.5% 41342322 / 39477309 / +4.7% 0.62 / 0.66 / -5.9%
tpcds_q18/duckdb:vortex-file-compressed 31232593 / 31462938 / -0.7% 43600234 / 41609562 / +4.8% 0.72 / 0.76 / -5.3%
tpcds_q19/duckdb:vortex-file-compressed 78700428 / 78601780 / +0.1% 88650073 / 90091081 / -1.6% 0.89 / 0.87 / +1.8%
tpcds_q20/duckdb:vortex-file-compressed 10726905 / 10879779 / -1.4% 18853210 / 18527817 / +1.8% 0.57 / 0.59 / -3.1%
tpcds_q21/duckdb:vortex-file-compressed 10535234 / 10707715 / -1.6% 21702195 / 22814996 / -4.9% 0.49 / 0.47 / +3.4%
tpcds_q22/duckdb:vortex-file-compressed 17843004 / 18323022 / -2.6% 29062031 / 28535595 / +1.8% 0.61 / 0.64 / -4.4%
tpcds_q23/duckdb:vortex-file-compressed 37252020 / 38026448 / -2.0% 48974392 / 48924360 / +0.1% 0.76 / 0.78 / -2.1%
tpcds_q24/duckdb:vortex-file-compressed 27292840 / 26870124 / +1.6% 39146722 / 39001709 / +0.4% 0.70 / 0.69 / +1.2%
tpcds_q25/duckdb:vortex-file-compressed 23842350 / 23442076 / +1.7% 38468157 / 36473249 / +5.5% 0.62 / 0.64 / -3.6%
tpcds_q26/duckdb:vortex-file-compressed 12976553 / 12901828 / +0.6% 20812379 / 20650723 / +0.8% 0.62 / 0.62 / -0.2%
tpcds_q27/duckdb:vortex-file-compressed 15967642 / 15830956 / +0.9% 27628164 / 26656624 / +3.6% 0.58 / 0.59 / -2.7%
tpcds_q28/duckdb:vortex-file-compressed 15766954 / 15426118 / +2.2% 25873342 / 25006288 / +3.5% 0.61 / 0.62 / -1.2%
tpcds_q29/duckdb:vortex-file-compressed 23739574 / 23746532 / -0.0% 37718878 / 36757161 / +2.6% 0.63 / 0.65 / -2.6%
tpcds_q30/duckdb:vortex-file-compressed 15625918 / 15954575 / -2.1% 24270033 / 24825144 / -2.2% 0.64 / 0.64 / +0.2%
tpcds_q31/duckdb:vortex-file-compressed 18076811 / 18154132 / -0.4% 26471445 / 25929563 / +2.1% 0.68 / 0.70 / -2.5%
tpcds_q32/duckdb:vortex-file-compressed 11333662 / 11535256 / -1.7% 21068763 / 20915342 / +0.7% 0.54 / 0.55 / -2.5%
tpcds_q33/duckdb:vortex-file-compressed 18763846 / 19141802 / -2.0% 28758322 / 28114604 / +2.3% 0.65 / 0.68 / -4.2%
tpcds_q34/duckdb:vortex-file-compressed 12430350 / 12503580 / -0.6% 22317242 / 21231642 / +5.1% 0.56 / 0.59 / -5.4%
tpcds_q35/duckdb:vortex-file-compressed 27960242 / 28393516 / -1.5% 39460857 / 39197965 / +0.7% 0.71 / 0.72 / -2.2%
tpcds_q36/duckdb:vortex-file-compressed 14402080 / 14659320 / -1.8% 24886722 / 25222270 / -1.3% 0.58 / 0.58 / -0.4%
tpcds_q37/duckdb:vortex-file-compressed 9250459 / 9099264 / +1.7% 22784601 / 23075633 / -1.3% 0.41 / 0.39 / +3.0%
tpcds_q38/duckdb:vortex-file-compressed 24227326 / 24225386 / +0.0% 30988114 / 31247118 / -0.8% 0.78 / 0.78 / +0.8%
tpcds_q39/duckdb:vortex-file-compressed 20436238 / 19560393 / +4.5% 32555167 / 31619553 / +3.0% 0.63 / 0.62 / +1.5%
tpcds_q40/duckdb:vortex-file-compressed 14601352 / 14350364 / +1.7% 22020092 / 22188050 / -0.8% 0.66 / 0.65 / +2.5%
tpcds_q41/duckdb:vortex-file-compressed 16698986 / 16958494 / -1.5% 24087834 / 23541479 / +2.3% 0.69 / 0.72 / -3.8%
tpcds_q42/duckdb:vortex-file-compressed 6979932 / 7127124 / -2.1% 16363114 / 15050409 / +8.7% 0.43 / 0.47 / -9.9%
tpcds_q43/duckdb:vortex-file-compressed 9870216 / 10310099 / -4.3% 19307642 / 18333215 / +5.3% 0.51 / 0.56 / -9.1%
tpcds_q44/duckdb:vortex-file-compressed 12976938 / 13091620 / -0.9% 24370207 / 23385044 / +4.2% 0.53 / 0.56 / -4.9%
tpcds_q45/duckdb:vortex-file-compressed 23480659 / 23858272 / -1.6% 31362716 / 31286503 / +0.2% 0.75 / 0.76 / -1.8%
tpcds_q46/duckdb:vortex-file-compressed 19437932 / 19291743 / +0.8% 27832284 / 28576853 / -2.6% 0.70 / 0.68 / +3.5%
tpcds_q47/duckdb:vortex-file-compressed 34040598 / 34301335 / -0.8% 44599536 / 43387393 / +2.8% 0.76 / 0.79 / -3.5%
tpcds_q48/duckdb:vortex-file-compressed 23391030 / 23784070 / -1.7% 38180322 / 35523401 / +7.5% 0.61 / 0.67 / -8.5%
tpcds_q49/duckdb:vortex-file-compressed 19614666 / 19410378 / +1.1% 33359377 / 32644832 / +2.2% 0.59 / 0.59 / -1.1%
tpcds_q50/duckdb:vortex-file-compressed 17108783 / 17536435 / -2.4% 29182656 / 29438790 / -0.9% 0.59 / 0.60 / -1.6%
tpcds_q51/duckdb:vortex-file-compressed 48895561 / 48600816 / +0.6% 78239612 / 75773843 / +3.3% 0.62 / 0.64 / -2.6%
tpcds_q52/duckdb:vortex-file-compressed 7030234 / 7095745 / -0.9% 15763650 / 15980745 / -1.4% 0.45 / 0.44 / +0.4%
tpcds_q53/duckdb:vortex-file-compressed 11392738 / 11362870 / +0.3% 22013887 / 20377628 / +8.0% 0.52 / 0.56 / -7.2%
tpcds_q54/duckdb:vortex-file-compressed 19976988 / 20174906 / -1.0% 30065787 / 29952189 / +0.4% 0.66 / 0.67 / -1.4%
tpcds_q55/duckdb:vortex-file-compressed 6940816 / 7215078 / -3.8% 15340594 / 15375469 / -0.2% 0.45 / 0.47 / -3.6%
tpcds_q56/duckdb:vortex-file-compressed 18077661 / 18543393 / -2.5% 28542522 / 28341633 / +0.7% 0.63 / 0.65 / -3.2%
tpcds_q57/duckdb:vortex-file-compressed 25769698 / 25654170 / +0.5% 34351650 / 34774172 / -1.2% 0.75 / 0.74 / +1.7%
tpcds_q58/duckdb:vortex-file-compressed 20273736 / 20051878 / +1.1% 30036331 / 29807852 / +0.8% 0.67 / 0.67 / +0.3%
tpcds_q59/duckdb:vortex-file-compressed 19400138 / 19742718 / -1.7% 27981494 / 27952252 / +0.1% 0.69 / 0.71 / -1.8%
tpcds_q60/duckdb:vortex-file-compressed 18707430 / 18834968 / -0.7% 28855355 / 28284295 / +2.0% 0.65 / 0.67 / -2.6%
tpcds_q61/duckdb:vortex-file-compressed 24683677 / 24831340 / -0.6% 34250938 / 33986765 / +0.8% 0.72 / 0.73 / -1.4%
tpcds_q62/duckdb:vortex-file-compressed 11780272 / 11900526 / -1.0% 19501312 / 18544672 / +5.2% 0.60 / 0.64 / -5.9%
tpcds_q63/duckdb:vortex-file-compressed 10885368 / 11053794 / -1.5% 21437065 / 20299837 / +5.6% 0.51 / 0.54 / -6.7%
tpcds_q64/duckdb:vortex-file-compressed 49833822 / 49715240 / +0.2% 70352531 / 67151496 / +4.8% 0.71 / 0.74 / -4.3%
tpcds_q65/duckdb:vortex-file-compressed 13136514 / 13180014 / -0.3% 21890024 / 21135828 / +3.6% 0.60 / 0.62 / -3.8%
tpcds_q66/duckdb:vortex-file-compressed 29196070 / 28990700 / +0.7% 38955420 / 38101611 / +2.2% 0.75 / 0.76 / -1.5%
tpcds_q67/duckdb:vortex-file-compressed 57979634 / 58403212 / -0.7% 66748391 / 66912194 / -0.2% 0.87 / 0.87 / -0.5%
tpcds_q68/duckdb:vortex-file-compressed 19112810 / 19002982 / +0.6% 27462543 / 27410922 / +0.2% 0.70 / 0.69 / +0.4%
tpcds_q69/duckdb:vortex-file-compressed 22134326 / 22509526 / -1.7% 37689652 / 37293275 / +1.1% 0.59 / 0.60 / -2.7%
tpcds_q70/duckdb:vortex-file-compressed 15714043 / 15519942 / +1.3% 26122252 / 25478412 / +2.5% 0.60 / 0.61 / -1.2%
tpcds_q71/duckdb:vortex-file-compressed 12659760 / 12744691 / -0.7% 22484476 / 21649740 / +3.9% 0.56 / 0.59 / -4.4%
tpcds_q72/duckdb:vortex-file-compressed 55008436 / 55267513 / -0.5% 71040455 / 68458838 / +3.8% 0.77 / 0.81 / -4.1%
tpcds_q73/duckdb:vortex-file-compressed 11394989 / 11534118 / -1.2% 21656505 / 20832464 / +4.0% 0.53 / 0.55 / -5.0%
tpcds_q74/duckdb:vortex-file-compressed 25931632 / 26170604 / -0.9% 33609366 / 33390598 / +0.7% 0.77 / 0.78 / -1.6%
tpcds_q75/duckdb:vortex-file-compressed 28639779 / 28995782 / -1.2% 40203683 / 38431813 / +4.6% 0.71 / 0.75 / -5.6%
tpcds_q76/duckdb:vortex-file-compressed 13128846 / 13331641 / -1.5% 24684487 / 23718851 / +4.1% 0.53 / 0.56 / -5.4%
tpcds_q77/duckdb:vortex-file-compressed 20753934 / 21116455 / -1.7% 30910357 / 29904371 / +3.4% 0.67 / 0.71 / -4.9%
tpcds_q78/duckdb:vortex-file-compressed 43503824 / 44065460 / -1.3% 53735727 / 53538870 / +0.4% 0.81 / 0.82 / -1.6%
tpcds_q79/duckdb:vortex-file-compressed 13079106 / 13430027 / -2.6% 22618948 / 21671903 / +4.4% 0.58 / 0.62 / -6.7%
tpcds_q80/duckdb:vortex-file-compressed 36843249 / 37150568 / -0.8% 50261692 / 49808236 / +0.9% 0.73 / 0.75 / -1.7%
tpcds_q81/duckdb:vortex-file-compressed 21303979 / 20909108 / +1.9% 29450160 / 29376487 / +0.3% 0.72 / 0.71 / +1.6%
tpcds_q82/duckdb:vortex-file-compressed 9595689 / 9652046 / -0.6% 22674253 / 22873009 / -0.9% 0.42 / 0.42 / +0.3%
tpcds_q83/duckdb:vortex-file-compressed 17605974 / 17588516 / +0.1% 25453001 / 24397194 / +4.3% 0.69 / 0.72 / -4.1%
tpcds_q84/duckdb:vortex-file-compressed 15569642 / 15671088 / -0.6% 23159700 / 23410069 / -1.1% 0.67 / 0.67 / +0.4%
tpcds_q85/duckdb:vortex-file-compressed 24465349 / 24732175 / -1.1% 38671448 / 37249870 / +3.8% 0.63 / 0.66 / -4.7%
tpcds_q86/duckdb:vortex-file-compressed 9685451 / 9780924 / -1.0% 17368662 / 18584669 / -6.5% 0.56 / 0.53 / +6.0%
tpcds_q87/duckdb:vortex-file-compressed 25906812 / 26063862 / -0.6% 33196230 / 33575767 / -1.1% 0.78 / 0.78 / +0.5%
tpcds_q88/duckdb:vortex-file-compressed 31366604 / 31464763 / -0.3% 39437606 / 40054103 / -1.5% 0.80 / 0.79 / +1.2%
tpcds_q89/duckdb:vortex-file-compressed 11999512 / 12039094 / -0.3% 22142043 / 21889766 / +1.2% 0.54 / 0.55 / -1.5%
tpcds_q90/duckdb:vortex-file-compressed 8288424 / 8202510 / +1.0% 15781960 / 16270014 / -3.0% 0.53 / 0.50 / +4.2%
tpcds_q91/duckdb:vortex-file-compressed 13970238 / 14290856 / -2.2% 22483311 / 22527453 / -0.2% 0.62 / 0.63 / -2.1%
tpcds_q92/duckdb:vortex-file-compressed 11991990 / 11930096 / +0.5% 20891675 / 20747185 / +0.7% 0.57 / 0.58 / -0.2%
tpcds_q93/duckdb:vortex-file-compressed 10433943 / 10626948 / -1.8% 24368153 / 24616507 / -1.0% 0.43 / 0.43 / -0.8%
tpcds_q94/duckdb:vortex-file-compressed 21736088 / 21740610 / -0.0% 32107587 / 31665547 / +1.4% 0.68 / 0.69 / -1.4%
tpcds_q95/duckdb:vortex-file-compressed 62064867 / 62215516 / -0.2% 71849353 / 70884009 / +1.4% 0.86 / 0.88 / -1.6%
tpcds_q96/duckdb:vortex-file-compressed 6851550 / 6777132 / +1.1% 15608893 / 15591831 / +0.1% 0.44 / 0.43 / +1.0%
tpcds_q97/duckdb:vortex-file-compressed 22941149 / 23265829 / -1.4% 31090650 / 31775916 / -2.2% 0.74 / 0.73 / +0.8%
tpcds_q98/duckdb:vortex-file-compressed 11433506 / 11444256 / -0.1% 20807812 / 19949545 / +4.3% 0.55 / 0.57 / -4.2%
tpcds_q99/duckdb:vortex-file-compressed 14760750 / 14811038 / -0.3% 22381885 / 22133407 / +1.1% 0.66 / 0.67 / -1.4%
duckdb / vortex-compact / ns (0.994x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17688704 / 17702925 / -0.1% 26419693 / 27148512 / -2.7% 0.67 / 0.65 / +2.7%
tpcds_q02/duckdb:vortex-compact 16540550 / 17021706 / -2.8% 24208240 / 24268818 / -0.2% 0.68 / 0.70 / -2.6%
tpcds_q03/duckdb:vortex-compact 7897643 / 8222670 / -4.0% 16514283 / 16788749 / -1.6% 0.48 / 0.49 / -2.4%
tpcds_q04/duckdb:vortex-compact 46882184 / 47083122 / -0.4% 57438255 / 57952877 / -0.9% 0.82 / 0.81 / +0.5%
tpcds_q05/duckdb:vortex-compact 24983895 / 25332134 / -1.4% 33114219 / 33014014 / +0.3% 0.75 / 0.77 / -1.7%
tpcds_q06/duckdb:vortex-compact 25197452 / 25622418 / -1.7% 39141582 / 38845868 / +0.8% 0.64 / 0.66 / -2.4%
tpcds_q07/duckdb:vortex-compact 18274464 / 18288161 / -0.1% 28651228 / 27906334 / +2.7% 0.64 / 0.66 / -2.7%
tpcds_q08/duckdb:vortex-compact 22484616 / 22339058 / +0.7% 30064668 / 30453049 / -1.3% 0.75 / 0.73 / +2.0%
tpcds_q09/duckdb:vortex-compact 21753974 / 21864250 / -0.5% 32084955 / 30056713 / +6.7% 0.68 / 0.73 / -6.8%
tpcds_q10/duckdb:vortex-compact 30653892 / 31132177 / -1.5% 45231782 / 44194044 / +2.3% 0.68 / 0.70 / -3.8%
tpcds_q11/duckdb:vortex-compact 38320412 / 38655816 / -0.9% 47945808 / 48013576 / -0.1% 0.80 / 0.81 / -0.7%
tpcds_q12/duckdb:vortex-compact 12803869 / 13059013 / -2.0% 20294486 / 19791765 / +2.5% 0.63 / 0.66 / -4.4%
tpcds_q13/duckdb:vortex-compact 37694176 / 38138589 / -1.2% 49838734 / 48804780 / +2.1% 0.76 / 0.78 / -3.2%
tpcds_q14/duckdb:vortex-compact 57594590 / 57931378 / -0.6% 68074828 / 67835031 / +0.4% 0.85 / 0.85 / -0.9%
tpcds_q15/duckdb:vortex-compact 14547302 / 14377454 / +1.2% 21757762 / 22886416 / -4.9% 0.67 / 0.63 / +6.4%
tpcds_q16/duckdb:vortex-compact 27021240 / 27628776 / -2.2% 36258432 / 36089835 / +0.5% 0.75 / 0.77 / -2.7%
tpcds_q17/duckdb:vortex-compact 28561820 / 28998478 / -1.5% 44290667 / 41804612 / +5.9% 0.64 / 0.69 / -7.0%
tpcds_q18/duckdb:vortex-compact 38550116 / 36350174 / +6.1% 45914529 / 45714725 / +0.4% 0.84 / 0.80 / +5.6%
tpcds_q19/duckdb:vortex-compact 81710328 / 83409016 / -2.0% 95274429 / 93474582 / +1.9% 0.86 / 0.89 / -3.9%
tpcds_q20/duckdb:vortex-compact 13292496 / 13409712 / -0.9% 20812748 / 20853197 / -0.2% 0.64 / 0.64 / -0.7%
tpcds_q21/duckdb:vortex-compact 11972633 / 12119693 / -1.2% 23374567 / 22912972 / +2.0% 0.51 / 0.53 / -3.2%
tpcds_q22/duckdb:vortex-compact 19717244 / 19651974 / +0.3% 30198324 / 29674641 / +1.8% 0.65 / 0.66 / -1.4%
tpcds_q23/duckdb:vortex-compact 40017406 / 40417391 / -1.0% 52230056 / 49816941 / +4.8% 0.77 / 0.81 / -5.6%
tpcds_q24/duckdb:vortex-compact 28983344 / 29003298 / -0.1% 40114422 / 40237479 / -0.3% 0.72 / 0.72 / +0.2%
tpcds_q25/duckdb:vortex-compact 27915865 / 27362462 / +2.0% 42431048 / 40244526 / +5.4% 0.66 / 0.68 / -3.2%
tpcds_q26/duckdb:vortex-compact 20102818 / 19117002 / +5.2% 26696502 / 24777533 / +7.7% 0.75 / 0.77 / -2.4%
tpcds_q27/duckdb:vortex-compact 20391336 / 20878788 / -2.3% 30181241 / 30529720 / -1.1% 0.68 / 0.68 / -1.2%
tpcds_q28/duckdb:vortex-compact 21117813 / 21293228 / -0.8% 30985820 / 31106066 / -0.4% 0.68 / 0.68 / -0.4%
tpcds_q29/duckdb:vortex-compact 27691652 / 27481877 / +0.8% 41832389 / 41073340 / +1.8% 0.66 / 0.67 / -1.1%
tpcds_q30/duckdb:vortex-compact 18230017 / 18411188 / -1.0% 27025017 / 27124559 / -0.4% 0.67 / 0.68 / -0.6%
tpcds_q31/duckdb:vortex-compact 18838400 / 19455366 / -3.2% 27365560 / 27642619 / -1.0% 0.69 / 0.70 / -2.2%
tpcds_q32/duckdb:vortex-compact 12975796 / 13385936 / -3.1% 23086668 / 22638675 / +2.0% 0.56 / 0.59 / -4.9%
tpcds_q33/duckdb:vortex-compact 20482455 / 20653884 / -0.8% 29432519 / 29787044 / -1.2% 0.70 / 0.69 / +0.4%
tpcds_q34/duckdb:vortex-compact 14474888 / 14377465 / +0.7% 24854577 / 24643570 / +0.9% 0.58 / 0.58 / -0.2%
tpcds_q35/duckdb:vortex-compact 31602095 / 31887534 / -0.9% 42970380 / 42858096 / +0.3% 0.74 / 0.74 / -1.2%
tpcds_q36/duckdb:vortex-compact 15805954 / 15900874 / -0.6% 24924225 / 24328405 / +2.4% 0.63 / 0.65 / -3.0%
tpcds_q37/duckdb:vortex-compact 13472312 / 13698030 / -1.6% 27429208 / 26501975 / +3.5% 0.49 / 0.52 / -5.0%
tpcds_q38/duckdb:vortex-compact 24834237 / 25161018 / -1.3% 32860768 / 33815743 / -2.8% 0.76 / 0.74 / +1.6%
tpcds_q39/duckdb:vortex-compact 20526906 / 21387727 / -4.0% 31880229 / 31772013 / +0.3% 0.64 / 0.67 / -4.4%
tpcds_q40/duckdb:vortex-compact 16007668 / 15810307 / +1.2% 22259766 / 22268876 / -0.0% 0.72 / 0.71 / +1.3%
tpcds_q41/duckdb:vortex-compact 18497018 / 18812265 / -1.7% 26164570 / 26630277 / -1.7% 0.71 / 0.71 / +0.1%
tpcds_q42/duckdb:vortex-compact 8117914 / 8194042 / -0.9% 16762198 / 16301566 / +2.8% 0.48 / 0.50 / -3.7%
tpcds_q43/duckdb:vortex-compact 10582518 / 10736844 / -1.4% 19089869 / 18573210 / +2.8% 0.55 / 0.58 / -4.1%
tpcds_q44/duckdb:vortex-compact 15611208 / 15569719 / +0.3% 26750745 / 26943320 / -0.7% 0.58 / 0.58 / +1.0%
tpcds_q45/duckdb:vortex-compact 26560892 / 27058701 / -1.8% 34366295 / 34178580 / +0.5% 0.77 / 0.79 / -2.4%
tpcds_q46/duckdb:vortex-compact 20126706 / 20930183 / -3.8% 29382123 / 29061066 / +1.1% 0.68 / 0.72 / -4.9%
tpcds_q47/duckdb:vortex-compact 35694790 / 35749606 / -0.2% 44922468 / 44916676 / +0.0% 0.79 / 0.80 / -0.2%
tpcds_q48/duckdb:vortex-compact 39757540 / 39620763 / +0.3% 51213412 / 50210435 / +2.0% 0.78 / 0.79 / -1.6%
tpcds_q49/duckdb:vortex-compact 23026071 / 22949810 / +0.3% 35974454 / 34279479 / +4.9% 0.64 / 0.67 / -4.4%
tpcds_q50/duckdb:vortex-compact 18966856 / 18952066 / +0.1% 29871735 / 29746502 / +0.4% 0.63 / 0.64 / -0.3%
tpcds_q51/duckdb:vortex-compact 49474198 / 49464556 / +0.0% 78719168 / 78627148 / +0.1% 0.63 / 0.63 / -0.1%
tpcds_q52/duckdb:vortex-compact 8193664 / 8258728 / -0.8% 16789632 / 16989962 / -1.2% 0.49 / 0.49 / +0.4%
tpcds_q53/duckdb:vortex-compact 13344430 / 13485906 / -1.0% 23296282 / 22437480 / +3.8% 0.57 / 0.60 / -4.7%
tpcds_q54/duckdb:vortex-compact 21232895 / 21372543 / -0.7% 31370810 / 30350492 / +3.4% 0.68 / 0.70 / -3.9%
tpcds_q55/duckdb:vortex-compact 7757686 / 8027004 / -3.4% 16967306 / 16347253 / +3.8% 0.46 / 0.49 / -6.9%
tpcds_q56/duckdb:vortex-compact 19339928 / 19485283 / -0.7% 29819674 / 29925939 / -0.4% 0.65 / 0.65 / -0.4%
tpcds_q57/duckdb:vortex-compact 27055648 / 27121212 / -0.2% 34881713 / 34946596 / -0.2% 0.78 / 0.78 / -0.1%
tpcds_q58/duckdb:vortex-compact 20876655 / 21078326 / -1.0% 30735443 / 30649139 / +0.3% 0.68 / 0.69 / -1.2%
tpcds_q59/duckdb:vortex-compact 21003830 / 22306078 / -5.8% 27867711 / 28046570 / -0.6% 0.75 / 0.80 / -5.2%
tpcds_q60/duckdb:vortex-compact 20348656 / 20144244 / +1.0% 30111897 / 29186815 / +3.2% 0.68 / 0.69 / -2.1%
tpcds_q61/duckdb:vortex-compact 26075360 / 26225115 / -0.6% 35418351 / 36581682 / -3.2% 0.74 / 0.72 / +2.7%
tpcds_q62/duckdb:vortex-compact 12837779 / 12984614 / -1.1% 20423071 / 19487213 / +4.8% 0.63 / 0.67 / -5.7%
tpcds_q63/duckdb:vortex-compact 12725496 / 12999621 / -2.1% 22477507 / 22116327 / +1.6% 0.57 / 0.59 / -3.7%
tpcds_q64/duckdb:vortex-compact 57420646 / 57072376 / +0.6% 76099453 / 73192612 / +4.0% 0.75 / 0.78 / -3.2%
tpcds_q65/duckdb:vortex-compact 13946832 / 14045783 / -0.7% 22371983 / 22848336 / -2.1% 0.62 / 0.61 / +1.4%
tpcds_q66/duckdb:vortex-compact 31175140 / 31140936 / +0.1% 40024195 / 40625450 / -1.5% 0.78 / 0.77 / +1.6%
tpcds_q67/duckdb:vortex-compact 59683824 / 59994544 / -0.5% 68210296 / 68576156 / -0.5% 0.87 / 0.87 / +0.0%
tpcds_q68/duckdb:vortex-compact 19793236 / 20100648 / -1.5% 28660778 / 28718148 / -0.2% 0.69 / 0.70 / -1.3%
tpcds_q69/duckdb:vortex-compact 26955690 / 26907518 / +0.2% 43084908 / 42899977 / +0.4% 0.63 / 0.63 / -0.3%
tpcds_q70/duckdb:vortex-compact 17822314 / 17539836 / +1.6% 28522722 / 28444293 / +0.3% 0.62 / 0.62 / +1.3%
tpcds_q71/duckdb:vortex-compact 13819939 / 14159554 / -2.4% 24287980 / 23652730 / +2.7% 0.57 / 0.60 / -5.0%
tpcds_q72/duckdb:vortex-compact 59816227 / 60209039 / -0.7% 74564132 / 74889020 / -0.4% 0.80 / 0.80 / -0.2%
tpcds_q73/duckdb:vortex-compact 13364858 / 13515836 / -1.1% 23518381 / 23910535 / -1.6% 0.57 / 0.57 / +0.5%
tpcds_q74/duckdb:vortex-compact 26721360 / 26824206 / -0.4% 35117259 / 35165083 / -0.1% 0.76 / 0.76 / -0.2%
tpcds_q75/duckdb:vortex-compact 30107104 / 30530054 / -1.4% 40627626 / 39047226 / +4.0% 0.74 / 0.78 / -5.2%
tpcds_q76/duckdb:vortex-compact 14328860 / 14077601 / +1.8% 24406063 / 24349417 / +0.2% 0.59 / 0.58 / +1.5%
tpcds_q77/duckdb:vortex-compact 22400152 / 21797106 / +2.8% 31107755 / 30983661 / +0.4% 0.72 / 0.70 / +2.4%
tpcds_q78/duckdb:vortex-compact 44537296 / 45074101 / -1.2% 55913300 / 54691353 / +2.2% 0.80 / 0.82 / -3.4%
tpcds_q79/duckdb:vortex-compact 15404793 / 13778390 / +11.8% 🔴 23472566 / 22154719 / +5.9% 0.66 / 0.62 / +5.5%
tpcds_q80/duckdb:vortex-compact 40182358 / 39969880 / +0.5% 51366936 / 51935223 / -1.1% 0.78 / 0.77 / +1.6%
tpcds_q81/duckdb:vortex-compact 24294001 / 23892912 / +1.7% 31545894 / 31787999 / -0.8% 0.77 / 0.75 / +2.5%
tpcds_q82/duckdb:vortex-compact 13542763 / 13770453 / -1.7% 26530234 / 27284042 / -2.8% 0.51 / 0.50 / +1.1%
tpcds_q83/duckdb:vortex-compact 18371934 / 18435302 / -0.3% 25881267 / 25381601 / +2.0% 0.71 / 0.73 / -2.3%
tpcds_q84/duckdb:vortex-compact 17856062 / 17641076 / +1.2% 23998738 / 24252013 / -1.0% 0.74 / 0.73 / +2.3%
tpcds_q85/duckdb:vortex-compact 38712815 / 38707952 / +0.0% 53196210 / 51357849 / +3.6% 0.73 / 0.75 / -3.4%
tpcds_q86/duckdb:vortex-compact 10826840 / 10749260 / +0.7% 17655340 / 17849767 / -1.1% 0.61 / 0.60 / +1.8%
tpcds_q87/duckdb:vortex-compact 26335056 / 26445600 / -0.4% 34420139 / 34489442 / -0.2% 0.77 / 0.77 / -0.2%
tpcds_q88/duckdb:vortex-compact 32627577 / 33214792 / -1.8% 40736071 / 41106628 / -0.9% 0.80 / 0.81 / -0.9%
tpcds_q89/duckdb:vortex-compact 13687930 / 13658114 / +0.2% 23423509 / 23762224 / -1.4% 0.58 / 0.57 / +1.7%
tpcds_q90/duckdb:vortex-compact 8620580 / 8821022 / -2.3% 16054098 / 16558898 / -3.0% 0.54 / 0.53 / +0.8%
tpcds_q91/duckdb:vortex-compact 22898302 / 22899340 / -0.0% 32580501 / 31496005 / +3.4% 0.70 / 0.73 / -3.3%
tpcds_q92/duckdb:vortex-compact 13843631 / 13940145 / -0.7% 22828696 / 22210835 / +2.8% 0.61 / 0.63 / -3.4%
tpcds_q93/duckdb:vortex-compact 13117962 / 13292406 / -1.3% 26779782 / 26170460 / +2.3% 0.49 / 0.51 / -3.6%
tpcds_q94/duckdb:vortex-compact 23551067 / 23777194 / -1.0% 34215022 / 33633237 / +1.7% 0.69 / 0.71 / -2.6%
tpcds_q95/duckdb:vortex-compact 63763058 / 63676429 / +0.1% 72854330 / 73774996 / -1.2% 0.88 / 0.86 / +1.4%
tpcds_q96/duckdb:vortex-compact 8381074 / 8631517 / -2.9% 16697653 / 17338573 / -3.7% 0.50 / 0.50 / +0.8%
tpcds_q97/duckdb:vortex-compact 23770308 / 23680724 / +0.4% 33326681 / 33161715 / +0.5% 0.71 / 0.71 / -0.1%
tpcds_q98/duckdb:vortex-compact 14016296 / 14227124 / -1.5% 23002201 / 22903107 / +0.4% 0.61 / 0.62 / -1.9%
tpcds_q99/duckdb:vortex-compact 15467086 / 15564155 / -0.6% 22867170 / 23098046 / -1.0% 0.68 / 0.67 / +0.4%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24477916 / 24479455 / -0.0% 31588469 / 31540378 / +0.2% 0.77 / 0.78 / -0.2%
tpcds_q02/duckdb:parquet 18404558 / 18546854 / -0.8% 24805835 / 24600487 / +0.8% 0.74 / 0.75 / -1.6%
tpcds_q03/duckdb:parquet 9957142 / 9964764 / -0.1% 16180381 / 16305274 / -0.8% 0.62 / 0.61 / +0.7%
tpcds_q04/duckdb:parquet 118311940 / 118715828 / -0.3% 127669961 / 126755105 / +0.7% 0.93 / 0.94 / -1.1%
tpcds_q05/duckdb:parquet 28563992 / 29582986 / -3.4% 33147700 / 33015783 / +0.4% 0.86 / 0.90 / -3.8%
tpcds_q06/duckdb:parquet 26527713 / 26976334 / -1.7% 36439416 / 36544933 / -0.3% 0.73 / 0.74 / -1.4%
tpcds_q07/duckdb:parquet 31088318 / 32216002 / -3.5% 38688626 / 39075961 / -1.0% 0.80 / 0.82 / -2.5%
tpcds_q08/duckdb:parquet 20147085 / 20427146 / -1.4% 24469034 / 26090033 / -6.2% 0.82 / 0.78 / +5.2%
tpcds_q09/duckdb:parquet 27663410 / 27336589 / +1.2% 30803738 / 31440301 / -2.0% 0.90 / 0.87 / +3.3%
tpcds_q10/duckdb:parquet 33236568 / 33068388 / +0.5% 41204756 / 40555648 / +1.6% 0.81 / 0.82 / -1.1%
tpcds_q11/duckdb:parquet 69103316 / 69169413 / -0.1% 75476142 / 75980846 / -0.7% 0.92 / 0.91 / +0.6%
tpcds_q12/duckdb:parquet 14160004 / 14499482 / -2.3% 19437031 / 19624642 / -1.0% 0.73 / 0.74 / -1.4%
tpcds_q13/duckdb:parquet 32420837 / 31018066 / +4.5% 40441129 / 41406832 / -2.3% 0.80 / 0.75 / +7.0%
tpcds_q14/duckdb:parquet 65287102 / 66129030 / -1.3% 69681791 / 69799863 / -0.2% 0.94 / 0.95 / -1.1%
tpcds_q15/duckdb:parquet 17097946 / 17047618 / +0.3% 23341257 / 23393634 / -0.2% 0.73 / 0.73 / +0.5%
tpcds_q16/duckdb:parquet 30822348 / 30901553 / -0.3% 37754363 / 37823747 / -0.2% 0.82 / 0.82 / -0.1%
tpcds_q17/duckdb:parquet 35114388 / 35465552 / -1.0% 40865985 / 40563606 / +0.7% 0.86 / 0.87 / -1.7%
tpcds_q18/duckdb:parquet 48116214 / 48222156 / -0.2% 55756496 / 56727126 / -1.7% 0.86 / 0.85 / +1.5%
tpcds_q19/duckdb:parquet 20053897 / 20789238 / -3.5% 26566842 / 25560161 / +3.9% 0.75 / 0.81 / -7.2%
tpcds_q20/duckdb:parquet 15108622 / 15223840 / -0.8% 19832408 / 20122594 / -1.4% 0.76 / 0.76 / +0.7%
tpcds_q21/duckdb:parquet 10912546 / 10910331 / +0.0% 17325030 / 17120256 / +1.2% 0.63 / 0.64 / -1.2%
tpcds_q22/duckdb:parquet 21334265 / 20941282 / +1.9% 27419536 / 26997961 / +1.6% 0.78 / 0.78 / +0.3%
tpcds_q23/duckdb:parquet 43597094 / 43751704 / -0.4% 48008131 / 48623456 / -1.3% 0.91 / 0.90 / +0.9%
tpcds_q24/duckdb:parquet 30616622 / 30797412 / -0.6% 37530393 / 37154839 / +1.0% 0.82 / 0.83 / -1.6%
tpcds_q25/duckdb:parquet 30800878 / 30969357 / -0.5% 37888937 / 37609934 / +0.7% 0.81 / 0.82 / -1.3%
tpcds_q26/duckdb:parquet 29370198 / 29155850 / +0.7% 35410464 / 35457918 / -0.1% 0.83 / 0.82 / +0.9%
tpcds_q27/duckdb:parquet 34646716 / 36320324 / -4.6% 42315216 / 43432485 / -2.6% 0.82 / 0.84 / -2.1%
tpcds_q28/duckdb:parquet 26454212 / 26966524 / -1.9% 32953268 / 34791225 / -5.3% 0.80 / 0.78 / +3.6%
tpcds_q29/duckdb:parquet 32556456 / 32647080 / -0.3% 40250044 / 39624824 / +1.6% 0.81 / 0.82 / -1.8%
tpcds_q30/duckdb:parquet 36093573 / 36141742 / -0.1% 45352764 / 44639374 / +1.6% 0.80 / 0.81 / -1.7%
tpcds_q31/duckdb:parquet 35958254 / 36103002 / -0.4% 43045412 / 43223056 / -0.4% 0.84 / 0.84 / +0.0%
tpcds_q32/duckdb:parquet 14424338 / 14558962 / -0.9% 21337122 / 21220566 / +0.5% 0.68 / 0.69 / -1.5%
tpcds_q33/duckdb:parquet 23352434 / 24122627 / -3.2% 29541522 / 29765788 / -0.8% 0.79 / 0.81 / -2.5%
tpcds_q34/duckdb:parquet 17364525 / 17950727 / -3.3% 24512873 / 24475725 / +0.2% 0.71 / 0.73 / -3.4%
tpcds_q35/duckdb:parquet 35879068 / 35938448 / -0.2% 44879449 / 44290490 / +1.3% 0.80 / 0.81 / -1.5%
tpcds_q36/duckdb:parquet 40452671 / 39845692 / +1.5% 48893244 / 49305976 / -0.8% 0.83 / 0.81 / +2.4%
tpcds_q37/duckdb:parquet 12959238 / 13041880 / -0.6% 19675017 / 19866882 / -1.0% 0.66 / 0.66 / +0.3%
tpcds_q38/duckdb:parquet 29593243 / 30159170 / -1.9% 34566097 / 34535928 / +0.1% 0.86 / 0.87 / -2.0%
tpcds_q39/duckdb:parquet 23445942 / 23540880 / -0.4% 30053571 / 29937976 / +0.4% 0.78 / 0.79 / -0.8%
tpcds_q40/duckdb:parquet 16325668 / 16544088 / -1.3% 22078468 / 21810901 / +1.2% 0.74 / 0.76 / -2.5%
tpcds_q41/duckdb:parquet 12222436 / 12573224 / -2.8% 18389878 / 18856284 / -2.5% 0.66 / 0.67 / -0.3%
tpcds_q42/duckdb:parquet 9838074 / 10074018 / -2.3% 15811049 / 15916659 / -0.7% 0.62 / 0.63 / -1.7%
tpcds_q43/duckdb:parquet 12542842 / 12429254 / +0.9% 19264844 / 18628719 / +3.4% 0.65 / 0.67 / -2.4%
tpcds_q44/duckdb:parquet 21683556 / 21616264 / +0.3% 26464389 / 26008750 / +1.8% 0.82 / 0.83 / -1.4%
tpcds_q45/duckdb:parquet 21043751 / 21742656 / -3.2% 28582854 / 28235920 / +1.2% 0.74 / 0.77 / -4.4%
tpcds_q46/duckdb:parquet 38445112 / 38556017 / -0.3% 44390308 / 43869228 / +1.2% 0.87 / 0.88 / -1.5%
tpcds_q47/duckdb:parquet 34337873 / 34679724 / -1.0% 40952715 / 41340095 / -0.9% 0.84 / 0.84 / -0.0%
tpcds_q48/duckdb:parquet 29017426 / 30503852 / -4.9% 37054390 / 37008782 / +0.1% 0.78 / 0.82 / -5.0%
tpcds_q49/duckdb:parquet 29964474 / 30485160 / -1.7% 36867914 / 36657568 / +0.6% 0.81 / 0.83 / -2.3%
tpcds_q50/duckdb:parquet 19920747 / 20052375 / -0.7% 26046688 / 26150290 / -0.4% 0.76 / 0.77 / -0.3%
tpcds_q51/duckdb:parquet 52377688 / 52799133 / -0.8% 78856071 / 60957590 / +29.4% 🔴 0.66 / 0.87 / -23.3%
tpcds_q52/duckdb:parquet 9735736 / 9726054 / +0.1% 16114015 / 16467083 / -2.1% 0.60 / 0.59 / +2.3%
tpcds_q53/duckdb:parquet 13881340 / 14269734 / -2.7% 21075193 / 21306939 / -1.1% 0.66 / 0.67 / -1.7%
tpcds_q54/duckdb:parquet 25444200 / 25302144 / +0.6% 32428536 / 32984443 / -1.7% 0.78 / 0.77 / +2.3%
tpcds_q55/duckdb:parquet 9661289 / 9558158 / +1.1% 15655212 / 15977311 / -2.0% 0.62 / 0.60 / +3.2%
tpcds_q56/duckdb:parquet 25648638 / 26200086 / -2.1% 30933491 / 31863876 / -2.9% 0.83 / 0.82 / +0.8%
tpcds_q57/duckdb:parquet 30726278 / 31289106 / -1.8% 36451890 / 36626342 / -0.5% 0.84 / 0.85 / -1.3%
tpcds_q58/duckdb:parquet 24371536 / 24765920 / -1.6% 30341855 / 30676182 / -1.1% 0.80 / 0.81 / -0.5%
tpcds_q59/duckdb:parquet 23291808 / 23785168 / -2.1% 29600419 / 29632716 / -0.1% 0.79 / 0.80 / -2.0%
tpcds_q60/duckdb:parquet 26838310 / 28841434 / -6.9% 33401390 / 32787322 / +1.9% 0.80 / 0.88 / -8.7%
tpcds_q61/duckdb:parquet 26081707 / 24980782 / +4.4% 29687060 / 30036840 / -1.2% 0.88 / 0.83 / +5.6%
tpcds_q62/duckdb:parquet 13305754 / 13334333 / -0.2% 18285101 / 18118743 / +0.9% 0.73 / 0.74 / -1.1%
tpcds_q63/duckdb:parquet 13555946 / 14023434 / -3.3% 20023112 / 20570316 / -2.7% 0.68 / 0.68 / -0.7%
tpcds_q64/duckdb:parquet 71617468 / 71626491 / -0.0% 84188999 / 81092367 / +3.8% 0.85 / 0.88 / -3.7%
tpcds_q65/duckdb:parquet 20496004 / 19305582 / +6.2% 25326450 / 24823672 / +2.0% 0.81 / 0.78 / +4.1%
tpcds_q66/duckdb:parquet 35433934 / 35842760 / -1.1% 42356024 / 42894709 / -1.3% 0.84 / 0.84 / +0.1%
tpcds_q67/duckdb:parquet 61225676 / 61535260 / -0.5% 67502278 / 67379851 / +0.2% 0.91 / 0.91 / -0.7%
tpcds_q68/duckdb:parquet 29814904 / 30318556 / -1.7% 36985217 / 36684810 / +0.8% 0.81 / 0.83 / -2.5%
tpcds_q69/duckdb:parquet 26290284 / 26588785 / -1.1% 35037350 / 35068655 / -0.1% 0.75 / 0.76 / -1.0%
tpcds_q70/duckdb:parquet 19494872 / 19749757 / -1.3% 26614873 / 26331850 / +1.1% 0.73 / 0.75 / -2.3%
tpcds_q71/duckdb:parquet 17118062 / 17171030 / -0.3% 23975521 / 24052467 / -0.3% 0.71 / 0.71 / +0.0%
tpcds_q72/duckdb:parquet 54675432 / 54883820 / -0.4% 62552473 / 63201295 / -1.0% 0.87 / 0.87 / +0.7%
tpcds_q73/duckdb:parquet 14826674 / 15435618 / -3.9% 21714565 / 21714175 / +0.0% 0.68 / 0.71 / -3.9%
tpcds_q74/duckdb:parquet 84705504 / 84703426 / +0.0% 92628363 / 89863044 / +3.1% 0.91 / 0.94 / -3.0%
tpcds_q75/duckdb:parquet 43999135 / 45805078 / -3.9% 51486150 / 51740282 / -0.5% 0.85 / 0.89 / -3.5%
tpcds_q76/duckdb:parquet 19958147 / 19098062 / +4.5% 24058129 / 23400492 / +2.8% 0.83 / 0.82 / +1.6%
tpcds_q77/duckdb:parquet 25464136 / 24981092 / +1.9% 32211368 / 32905465 / -2.1% 0.79 / 0.76 / +4.1%
tpcds_q78/duckdb:parquet 79069266 / 78772726 / +0.4% 87122303 / 85591203 / +1.8% 0.91 / 0.92 / -1.4%
tpcds_q79/duckdb:parquet 21798348 / 22076539 / -1.3% 28950730 / 29110863 / -0.6% 0.75 / 0.76 / -0.7%
tpcds_q80/duckdb:parquet 38288382 / 36705837 / +4.3% 43994920 / 44370809 / -0.8% 0.87 / 0.83 / +5.2%
tpcds_q81/duckdb:parquet 36824526 / 36730007 / +0.3% 45919231 / 45779635 / +0.3% 0.80 / 0.80 / -0.0%
tpcds_q82/duckdb:parquet 14274018 / 13879060 / +2.8% 20959458 / 20554599 / +2.0% 0.68 / 0.68 / +0.9%
tpcds_q83/duckdb:parquet 20601970 / 20599988 / +0.0% 25864353 / 25368071 / +2.0% 0.80 / 0.81 / -1.9%
tpcds_q84/duckdb:parquet 23374910 / 23373618 / +0.0% 28987007 / 28846228 / +0.5% 0.81 / 0.81 / -0.5%
tpcds_q85/duckdb:parquet 32823902 / 33090109 / -0.8% 40732961 / 40069577 / +1.7% 0.81 / 0.83 / -2.4%
tpcds_q86/duckdb:parquet 11959852 / 12187504 / -1.9% 17327972 / 16916681 / +2.4% 0.69 / 0.72 / -4.2%
tpcds_q87/duckdb:parquet 31553529 / 31616461 / -0.2% 35807795 / 35577579 / +0.6% 0.88 / 0.89 / -0.8%
tpcds_q88/duckdb:parquet 39995234 / 39823490 / +0.4% 46381101 / 46268531 / +0.2% 0.86 / 0.86 / +0.2%
tpcds_q89/duckdb:parquet 14315577 / 14505937 / -1.3% 21234531 / 21692725 / -2.1% 0.67 / 0.67 / +0.8%
tpcds_q90/duckdb:parquet 10364948 / 10273513 / +0.9% 15124930 / 15970790 / -5.3% 0.69 / 0.64 / +6.5%
tpcds_q91/duckdb:parquet 21442530 / 21525870 / -0.4% 28990269 / 29195947 / -0.7% 0.74 / 0.74 / +0.3%
tpcds_q92/duckdb:parquet 15903974 / 16022490 / -0.7% 23311756 / 22667161 / +2.8% 0.68 / 0.71 / -3.5%
tpcds_q93/duckdb:parquet 14229191 / 14273519 / -0.3% 20592277 / 20331722 / +1.3% 0.69 / 0.70 / -1.6%
tpcds_q94/duckdb:parquet 25825442 / 26026274 / -0.8% 33194848 / 33547712 / -1.1% 0.78 / 0.78 / +0.3%
tpcds_q95/duckdb:parquet 43698738 / 43808508 / -0.3% 50654613 / 50355491 / +0.6% 0.86 / 0.87 / -0.8%
tpcds_q96/duckdb:parquet 8522190 / 8412118 / +1.3% 14339027 / 14209085 / +0.9% 0.59 / 0.59 / +0.4%
tpcds_q97/duckdb:parquet 27788524 / 27759165 / +0.1% 33260609 / 34504831 / -3.6% 0.84 / 0.80 / +3.9%
tpcds_q98/duckdb:parquet 16743126 / 16832234 / -0.5% 23438557 / 23609451 / -0.7% 0.71 / 0.71 / +0.2%
tpcds_q99/duckdb:parquet 19368376 / 19293061 / +0.4% 24811726 / 24321987 / +2.0% 0.78 / 0.79 / -1.6%
duckdb / duckdb / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb 15575254 / 15903688 / -2.1% 24912531 / 24544159 / +1.5% 0.63 / 0.65 / -3.5%
tpcds_q02/duckdb:duckdb 12699418 / 12724186 / -0.2% 19305801 / 18309154 / +5.4% 0.66 / 0.69 / -5.3%
tpcds_q03/duckdb:duckdb 4906091 / 4984133 / -1.6% 12129323 / 11376352 / +6.6% 0.40 / 0.44 / -7.7%
tpcds_q04/duckdb:duckdb 49059406 / 48743074 / +0.6% 57176714 / 57364157 / -0.3% 0.86 / 0.85 / +1.0%
tpcds_q05/duckdb:duckdb 16043804 / 16215840 / -1.1% 21915708 / 22061314 / -0.7% 0.73 / 0.74 / -0.4%
tpcds_q06/duckdb:duckdb 17856200 / 17601139 / +1.4% 29685109 / 28764457 / +3.2% 0.60 / 0.61 / -1.7%
tpcds_q07/duckdb:duckdb 21099149 / 21113190 / -0.1% 32284241 / 31236573 / +3.4% 0.65 / 0.68 / -3.3%
tpcds_q08/duckdb:duckdb 18381082 / 18656238 / -1.5% 28144301 / 27201214 / +3.5% 0.65 / 0.69 / -4.8%
tpcds_q09/duckdb:duckdb 8589744 / 8754203 / -1.9% 14202644 / 13662448 / +4.0% 0.60 / 0.64 / -5.6%
tpcds_q10/duckdb:duckdb 18141492 / 18254556 / -0.6% 29523412 / 27442555 / +7.6% 0.61 / 0.67 / -7.6%
tpcds_q11/duckdb:duckdb 41967154 / 42152320 / -0.4% 50562642 / 50758839 / -0.4% 0.83 / 0.83 / -0.1%
tpcds_q12/duckdb:duckdb 9444995 / 9441336 / +0.0% 17077025 / 16778054 / +1.8% 0.55 / 0.56 / -1.7%
tpcds_q13/duckdb:duckdb 20371880 / 20937476 / -2.7% 32392941 / 31301372 / +3.5% 0.63 / 0.67 / -6.0%
tpcds_q14/duckdb:duckdb 40438754 / 40717134 / -0.7% 48370394 / 47412304 / +2.0% 0.84 / 0.86 / -2.7%
tpcds_q15/duckdb:duckdb 8032026 / 8346806 / -3.8% 14646459 / 13826869 / +5.9% 0.55 / 0.60 / -9.2%
tpcds_q16/duckdb:duckdb 12458252 / 12822204 / -2.8% 22394747 / 21236551 / +5.5% 0.56 / 0.60 / -7.9%
tpcds_q17/duckdb:duckdb 17823662 / 18055068 / -1.3% 29891394 / 28122775 / +6.3% 0.60 / 0.64 / -7.1%
tpcds_q18/duckdb:duckdb 32832727 / 33174955 / -1.0% 46029688 / 44752952 / +2.9% 0.71 / 0.74 / -3.8%
tpcds_q19/duckdb:duckdb 10485814 / 10749843 / -2.5% 20793422 / 18968055 / +9.6% 0.50 / 0.57 / -11.0%
tpcds_q20/duckdb:duckdb 9733220 / 9829753 / -1.0% 17579206 / 16894792 / +4.1% 0.55 / 0.58 / -4.8%
tpcds_q21/duckdb:duckdb 6478414 / 6474754 / +0.1% 11686217 / 12420023 / -5.9% 0.55 / 0.52 / +6.3%
tpcds_q22/duckdb:duckdb 17615830 / 17767873 / -0.9% 23638234 / 23375065 / +1.1% 0.75 / 0.76 / -2.0%
tpcds_q23/duckdb:duckdb 27329734 / 27257792 / +0.3% 36426475 / 35349897 / +3.0% 0.75 / 0.77 / -2.7%
tpcds_q24/duckdb:duckdb 15778236 / 15346096 / +2.8% 31040548 / 28228332 / +10.0% 0.51 / 0.54 / -6.5%
tpcds_q25/duckdb:duckdb 13975778 / 14399138 / -2.9% 27423215 / 25842325 / +6.1% 0.51 / 0.56 / -8.5%
tpcds_q26/duckdb:duckdb 18322872 / 18503009 / -1.0% 28139362 / 26529654 / +6.1% 0.65 / 0.70 / -6.6%
tpcds_q27/duckdb:duckdb 23354618 / 23637409 / -1.2% 35344174 / 34418789 / +2.7% 0.66 / 0.69 / -3.8%
tpcds_q28/duckdb:duckdb 12090728 / 12157238 / -0.5% 19203966 / 18301689 / +4.9% 0.63 / 0.66 / -5.2%
tpcds_q29/duckdb:duckdb 14329560 / 14329338 / +0.0% 27057193 / 25203027 / +7.4% 0.53 / 0.57 / -6.9%
tpcds_q30/duckdb:duckdb 17889196 / 17889253 / -0.0% 30073289 / 29723776 / +1.2% 0.59 / 0.60 / -1.2%
tpcds_q31/duckdb:duckdb 30337118 / 30157598 / +0.6% 38590548 / 38157398 / +1.1% 0.79 / 0.79 / -0.5%
tpcds_q32/duckdb:duckdb 5533677 / 5629038 / -1.7% 13050919 / 12787906 / +2.1% 0.42 / 0.44 / -3.7%
tpcds_q33/duckdb:duckdb 9056666 / 9209371 / -1.7% 16616545 / 16133563 / +3.0% 0.55 / 0.57 / -4.5%
tpcds_q34/duckdb:duckdb 10646031 / 10750109 / -1.0% 20807804 / 19295106 / +7.8% 0.51 / 0.56 / -8.2%
tpcds_q35/duckdb:duckdb 24450759 / 24407326 / +0.2% 34610467 / 33950058 / +1.9% 0.71 / 0.72 / -1.7%
tpcds_q36/duckdb:duckdb 13606142 / 13527550 / +0.6% 24122077 / 22739510 / +6.1% 0.56 / 0.59 / -5.2%
tpcds_q37/duckdb:duckdb 5400804 / 5425835 / -0.5% 13956553 / 13625927 / +2.4% 0.39 / 0.40 / -2.8%
tpcds_q38/duckdb:duckdb 22590231 / 22968510 / -1.6% 29992473 / 30435408 / -1.5% 0.75 / 0.75 / -0.2%
tpcds_q39/duckdb:duckdb 19661070 / 19553949 / +0.5% 25168708 / 25042777 / +0.5% 0.78 / 0.78 / +0.0%
tpcds_q40/duckdb:duckdb 8837382 / 8838138 / -0.0% 17213044 / 16625224 / +3.5% 0.51 / 0.53 / -3.4%
tpcds_q41/duckdb:duckdb 10107055 / 10315832 / -2.0% 17336241 / 17194131 / +0.8% 0.58 / 0.60 / -2.8%
tpcds_q42/duckdb:duckdb 4878066 / 4870988 / +0.1% 12459269 / 11948254 / +4.3% 0.39 / 0.41 / -4.0%
tpcds_q43/duckdb:duckdb 8138882 / 8182029 / -0.5% 14964429 / 15049822 / -0.6% 0.54 / 0.54 / +0.0%
tpcds_q44/duckdb:duckdb 9398686 / 9372028 / +0.3% 18142231 / 18023457 / +0.7% 0.52 / 0.52 / -0.4%
tpcds_q45/duckdb:duckdb 13591905 / 13918694 / -2.3% 22795340 / 22007384 / +3.6% 0.60 / 0.63 / -5.7%
tpcds_q46/duckdb:duckdb 25107502 / 25203318 / -0.4% 36801488 / 35017594 / +5.1% 0.68 / 0.72 / -5.2%
tpcds_q47/duckdb:duckdb 33346792 / 33547677 / -0.6% 43386603 / 40973155 / +5.9% 0.77 / 0.82 / -6.1%
tpcds_q48/duckdb:duckdb 27053969 / 27788064 / -2.6% 38519459 / 36661037 / +5.1% 0.70 / 0.76 / -7.3%
tpcds_q49/duckdb:duckdb 14757018 / 15131212 / -2.5% 26151826 / 24971555 / +4.7% 0.56 / 0.61 / -6.9%
tpcds_q50/duckdb:duckdb 10814421 / 10872448 / -0.5% 18904103 / 18347792 / +3.0% 0.57 / 0.59 / -3.5%
tpcds_q51/duckdb:duckdb 46627072 / 47004052 / -0.8% 73176609 / 71233116 / +2.7% 0.64 / 0.66 / -3.4%
tpcds_q52/duckdb:duckdb 4987450 / 5075110 / -1.7% 12367109 / 11177118 / +10.6% 🔴 0.40 / 0.45 / -11.2%
tpcds_q53/duckdb:duckdb 9597965 / 9673752 / -0.8% 19249582 / 17376184 / +10.8% 🔴 0.50 / 0.56 / -10.4%
tpcds_q54/duckdb:duckdb 12052427 / 12210974 / -1.3% 21641906 / 21645610 / -0.0% 0.56 / 0.56 / -1.3%
tpcds_q55/duckdb:duckdb 4829687 / 5005848 / -3.5% 12352135 / 11627660 / +6.2% 0.39 / 0.43 / -9.2%
tpcds_q56/duckdb:duckdb 10487406 / 10356818 / +1.3% 19182710 / 16900350 / +13.5% 🔴 0.55 / 0.61 / -10.8%
tpcds_q57/duckdb:duckdb 27747408 / 28037778 / -1.0% 35011952 / 34742141 / +0.8% 0.79 / 0.81 / -1.8%
tpcds_q58/duckdb:duckdb 10971858 / 10959705 / +0.1% 17892083 / 17923941 / -0.2% 0.61 / 0.61 / +0.3%
tpcds_q59/duckdb:duckdb 17273338 / 17459404 / -1.1% 25176547 / 24644247 / +2.2% 0.69 / 0.71 / -3.2%
tpcds_q60/duckdb:duckdb 11195590 / 11112839 / +0.7% 18260825 / 17166106 / +6.4% 0.61 / 0.65 / -5.3%
tpcds_q61/duckdb:duckdb 10343990 / 10391650 / -0.5% 20855733 / 19354551 / +7.8% 0.50 / 0.54 / -7.6%
tpcds_q62/duckdb:duckdb 8764816 / 8767005 / -0.0% 14880260 / 14263381 / +4.3% 0.59 / 0.61 / -4.2%
tpcds_q63/duckdb:duckdb 9042110 / 9075245 / -0.4% 17306959 / 16711840 / +3.6% 0.52 / 0.54 / -3.8%
tpcds_q64/duckdb:duckdb 39020002 / 39390921 / -0.9% 58944466 / 56010158 / +5.2% 0.66 / 0.70 / -5.9%
tpcds_q65/duckdb:duckdb 9891940 / 9917420 / -0.3% 18199510 / 17548372 / +3.7% 0.54 / 0.57 / -3.8%
tpcds_q66/duckdb:duckdb 26776712 / 26592613 / +0.7% 37597957 / 37396685 / +0.5% 0.71 / 0.71 / +0.2%
tpcds_q67/duckdb:duckdb 55029010 / 55511322 / -0.9% 67209578 / 64435510 / +4.3% 0.82 / 0.86 / -5.0%
tpcds_q68/duckdb:duckdb 15960581 / 16607554 / -3.9% 26966628 / 26075463 / +3.4% 0.59 / 0.64 / -7.1%
tpcds_q69/duckdb:duckdb 15261510 / 15350758 / -0.6% 25088475 / 24003431 / +4.5% 0.61 / 0.64 / -4.9%
tpcds_q70/duckdb:duckdb 10129836 / 10159766 / -0.3% 19616514 / 18891736 / +3.8% 0.52 / 0.54 / -4.0%
tpcds_q71/duckdb:duckdb 8046447 / 8084996 / -0.5% 16370958 / 15552518 / +5.3% 0.49 / 0.52 / -5.5%
tpcds_q72/duckdb:duckdb 38285214 / 38062338 / +0.6% 49387538 / 49424375 / -0.1% 0.78 / 0.77 / +0.7%
tpcds_q73/duckdb:duckdb 8175608 / 8065260 / +1.4% 17825164 / 16854054 / +5.8% 0.46 / 0.48 / -4.2%
tpcds_q74/duckdb:duckdb 35874200 / 36186304 / -0.9% 44780816 / 44049338 / +1.7% 0.80 / 0.82 / -2.5%
tpcds_q75/duckdb:duckdb 30525363 / 30754184 / -0.7% 41341625 / 41103355 / +0.6% 0.74 / 0.75 / -1.3%
tpcds_q76/duckdb:duckdb 8438362 / 8467510 / -0.3% 17642608 / 16692320 / +5.7% 0.48 / 0.51 / -5.7%
tpcds_q77/duckdb:duckdb 11188576 / 11230098 / -0.4% 20655439 / 19961612 / +3.5% 0.54 / 0.56 / -3.7%
tpcds_q78/duckdb:duckdb 65662810 / 65010795 / +1.0% 75443874 / 75018096 / +0.6% 0.87 / 0.87 / +0.4%
tpcds_q79/duckdb:duckdb 12692412 / 12818118 / -1.0% 23653734 / 22170727 / +6.7% 0.54 / 0.58 / -7.2%
tpcds_q80/duckdb:duckdb 17402506 / 17444426 / -0.2% 29561885 / 29279130 / +1.0% 0.59 / 0.60 / -1.2%
tpcds_q81/duckdb:duckdb 25915273 / 26058738 / -0.6% 38628493 / 37533033 / +2.9% 0.67 / 0.69 / -3.4%
tpcds_q82/duckdb:duckdb 5894566 / 6007336 / -1.9% 14331093 / 14236628 / +0.7% 0.41 / 0.42 / -2.5%
tpcds_q83/duckdb:duckdb 9205523 / 9130054 / +0.8% 15717343 / 15385378 / +2.2% 0.59 / 0.59 / -1.3%
tpcds_q84/duckdb:duckdb 9199213 / 9430714 / -2.5% 18364847 / 17515940 / +4.8% 0.50 / 0.54 / -7.0%
tpcds_q85/duckdb:duckdb 21406101 / 21611124 / -0.9% 35968804 / 33947655 / +6.0% 0.60 / 0.64 / -6.5%
tpcds_q86/duckdb:duckdb 8751496 / 8792380 / -0.5% 16028119 / 15051059 / +6.5% 0.55 / 0.58 / -6.5%
tpcds_q87/duckdb:duckdb 24835380 / 24873344 / -0.2% 31875494 / 31505053 / +1.2% 0.78 / 0.79 / -1.3%
tpcds_q88/duckdb:duckdb 19504411 / 19564419 / -0.3% 26037063 / 25837061 / +0.8% 0.75 / 0.76 / -1.1%
tpcds_q89/duckdb:duckdb 10603494 / 10590510 / +0.1% 19695666 / 18087628 / +8.9% 0.54 / 0.59 / -8.1%
tpcds_q90/duckdb:duckdb 5015867 / 4991828 / +0.5% 10704518 / 10593546 / +1.0% 0.47 / 0.47 / -0.6%
tpcds_q91/duckdb:duckdb 8869087 / 9124810 / -2.8% 18510718 / 18624635 / -0.6% 0.48 / 0.49 / -2.2%
tpcds_q92/duckdb:duckdb 6799822 / 6859944 / -0.9% 14982832 / 14736010 / +1.7% 0.45 / 0.47 / -2.5%
tpcds_q93/duckdb:duckdb 7026843 / 7161298 / -1.9% 14958337 / 14249857 / +5.0% 0.47 / 0.50 / -6.5%
tpcds_q94/duckdb:duckdb 12021461 / 12415581 / -3.2% 23220607 / 22461105 / +3.4% 0.52 / 0.55 / -6.3%
tpcds_q95/duckdb:duckdb 35501590 / 35874598 / -1.0% 44365176 / 43792990 / +1.3% 0.80 / 0.82 / -2.3%
tpcds_q96/duckdb:duckdb 3840556 / 3917874 / -2.0% 9832277 / 9278814 / +6.0% 0.39 / 0.42 / -7.5%
tpcds_q97/duckdb:duckdb 22192986 / 21955912 / +1.1% 28187528 / 27493053 / +2.5% 0.79 / 0.80 / -1.4%
tpcds_q98/duckdb:duckdb 10956450 / 10975015 / -0.2% 19721297 / 18894451 / +4.4% 0.56 / 0.58 / -4.4%
tpcds_q99/duckdb:duckdb 13591980 / 13468528 / +0.9% 19645005 / 19176721 / +2.4% 0.69 / 0.70 / -1.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR e42f8876 vs base c338bca9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.3%
Engines: DataFusion No clear signal (+8.7%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.045x ➖ · cold 1.039x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.028x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1228830 / 1242226 / -1.1% 23933430 / 23354544 / +2.5% 0.05 / 0.05 / -3.5%
clickbench_q01/datafusion:vortex-file-compressed 5998620 / 5916606 / +1.4% 31343390 / 35413448 / -11.5% 🟢 0.19 / 0.17 / +14.6%
clickbench_q02/datafusion:vortex-file-compressed 11470855 / 9146362 / +25.4% 🔴 43632573 / 39119228 / +11.5% 🔴 0.26 / 0.23 / +12.4%
clickbench_q03/datafusion:vortex-file-compressed 13282226 / 11153665 / +19.1% 🔴 55418776 / 54305896 / +2.0% 0.24 / 0.21 / +16.7%
clickbench_q04/datafusion:vortex-file-compressed 58409120 / 55262754 / +5.7% 104020988 / 91163149 / +14.1% 🔴 0.56 / 0.61 / -7.4%
clickbench_q05/datafusion:vortex-file-compressed 77645680 / 73538732 / +5.6% 130279920 / 115763314 / +12.5% 🔴 0.60 / 0.64 / -6.2%
clickbench_q06/datafusion:vortex-file-compressed 1216945 / 1252446 / -2.8% 23271805 / 23619833 / -1.5% 0.05 / 0.05 / -1.4%
clickbench_q07/datafusion:vortex-file-compressed 9331911 / 9223014 / +1.2% 39418510 / 33916533 / +16.2% 🔴 0.24 / 0.27 / -12.9%
clickbench_q08/datafusion:vortex-file-compressed 78864886 / 73948282 / +6.6% 127223988 / 120142110 / +5.9% 0.62 / 0.62 / +0.7%
clickbench_q09/datafusion:vortex-file-compressed 170882284 / 169756979 / +0.7% 214849584 / 206475307 / +4.1% 0.80 / 0.82 / -3.3%
clickbench_q10/datafusion:vortex-file-compressed 23502016 / 22684716 / +3.6% 72733164 / 66276125 / +9.7% 0.32 / 0.34 / -5.6%
clickbench_q11/datafusion:vortex-file-compressed 25953952 / 24931768 / +4.1% 73375472 / 67038684 / +9.5% 0.35 / 0.37 / -4.9%
clickbench_q12/datafusion:vortex-file-compressed 74433338 / 70859224 / +5.0% 124558838 / 115928102 / +7.4% 0.60 / 0.61 / -2.2%
clickbench_q13/datafusion:vortex-file-compressed 115853862 / 117816266 / -1.7% 190868864 / 181354649 / +5.2% 0.61 / 0.65 / -6.6%
clickbench_q14/datafusion:vortex-file-compressed 75744104 / 73946614 / +2.4% 128234680 / 122431483 / +4.7% 0.59 / 0.60 / -2.2%
clickbench_q15/datafusion:vortex-file-compressed 62196757 / 61622170 / +0.9% 101182353 / 95504187 / +5.9% 0.61 / 0.65 / -4.7%
clickbench_q16/datafusion:vortex-file-compressed 153925024 / 149279961 / +3.1% 215173049 / 207753652 / +3.6% 0.72 / 0.72 / -0.4%
clickbench_q17/datafusion:vortex-file-compressed 151906076 / 148881328 / +2.0% 224210195 / 209724928 / +6.9% 0.68 / 0.71 / -4.6%
clickbench_q18/datafusion:vortex-file-compressed 293498258 / 295266472 / -0.6% 384242851 / 379469279 / +1.3% 0.76 / 0.78 / -1.8%
clickbench_q19/datafusion:vortex-file-compressed 8278778 / 7520013 / +10.1% 🔴 50079271 / 51203740 / -2.2% 0.17 / 0.15 / +12.6%
clickbench_q20/datafusion:vortex-file-compressed 68860974 / 60493515 / +13.8% 🔴 246800115 / 226008481 / +9.2% 0.28 / 0.27 / +4.2%
clickbench_q21/datafusion:vortex-file-compressed 78286805 / 88935954 / -12.0% 🟢 291212964 / 268761221 / +8.4% 0.27 / 0.33 / -18.8%
clickbench_q22/datafusion:vortex-file-compressed 95486167 / 98035056 / -2.6% 391761394 / 348821768 / +12.3% 🔴 0.24 / 0.28 / -13.3%
clickbench_q23/datafusion:vortex-file-compressed 194460395 / 198164716 / -1.9% 548586211 / 465903524 / +17.7% 🔴 0.35 / 0.43 / -16.7%
clickbench_q24/datafusion:vortex-file-compressed 16237393 / 15648106 / +3.8% 72461360 / 69464622 / +4.3% 0.22 / 0.23 / -0.5%
clickbench_q25/datafusion:vortex-file-compressed 19214771 / 17637556 / +8.9% 62453913 / 61995208 / +0.7% 0.31 / 0.28 / +8.1%
clickbench_q26/datafusion:vortex-file-compressed 17258990 / 16124396 / +7.0% 72193439 / 69428502 / +4.0% 0.24 / 0.23 / +2.9%
clickbench_q27/datafusion:vortex-file-compressed 103792889 / 98388999 / +5.5% 256936432 / 240766149 / +6.7% 0.40 / 0.41 / -1.1%
clickbench_q28/datafusion:vortex-file-compressed 562546438 / 557849062 / +0.8% 641202926 / 617857653 / +3.8% 0.88 / 0.90 / -2.8%
clickbench_q29/datafusion:vortex-file-compressed 24404362 / 23029578 / +6.0% 57608515 / 51978025 / +10.8% 🔴 0.42 / 0.44 / -4.4%
clickbench_q30/datafusion:vortex-file-compressed 56322743 / 57489981 / -2.0% 115549834 / 107067151 / +7.9% 0.49 / 0.54 / -9.2%
clickbench_q31/datafusion:vortex-file-compressed 65821464 / 66210690 / -0.6% 159524116 / 155898346 / +2.3% 0.41 / 0.42 / -2.8%
clickbench_q32/datafusion:vortex-file-compressed 287055206 / 284643612 / +0.8% 384745288 / 386403523 / -0.4% 0.75 / 0.74 / +1.3%
clickbench_q33/datafusion:vortex-file-compressed 326528054 / 318906708 / +2.4% 439525573 / 432158546 / +1.7% 0.74 / 0.74 / +0.7%
clickbench_q34/datafusion:vortex-file-compressed 329083024 / 317768674 / +3.6% 441017950 / 422761689 / +4.3% 0.75 / 0.75 / -0.7%
clickbench_q35/datafusion:vortex-file-compressed 57332637 / 56169426 / +2.1% 93298052 / 89162052 / +4.6% 0.61 / 0.63 / -2.5%
clickbench_q36/datafusion:vortex-file-compressed 37983224 / 36967170 / +2.7% 70168981 / 67482538 / +4.0% 0.54 / 0.55 / -1.2%
clickbench_q37/datafusion:vortex-file-compressed 21157144 / 21469310 / -1.5% 48820488 / 50081576 / -2.5% 0.43 / 0.43 / +1.1%
clickbench_q38/datafusion:vortex-file-compressed 13613254 / 11605638 / +17.3% 🔴 42546789 / 40739995 / +4.4% 0.32 / 0.28 / +12.3%
clickbench_q39/datafusion:vortex-file-compressed 80004408 / 78098635 / +2.4% 113332363 / 111984724 / +1.2% 0.71 / 0.70 / +1.2%
clickbench_q40/datafusion:vortex-file-compressed 10818296 / 11158767 / -3.1% 38747130 / 38384386 / +0.9% 0.28 / 0.29 / -4.0%
clickbench_q41/datafusion:vortex-file-compressed 10161910 / 10763694 / -5.6% 37772921 / 38384110 / -1.6% 0.27 / 0.28 / -4.1%
clickbench_q42/datafusion:vortex-file-compressed 10604415 / 11494408 / -7.7% 38178911 / 38136173 / +0.1% 0.28 / 0.30 / -7.8%
datafusion / vortex-compact / ns (1.153x ❌, 0↑ 18↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1253195 / 1249440 / +0.3% 24149445 / 22809628 / +5.9% 0.05 / 0.05 / -5.3%
clickbench_q01/datafusion:vortex-compact 7393952 / 6195966 / +19.3% 🔴 31957932 / 34390712 / -7.1% 0.23 / 0.18 / +28.4%
clickbench_q02/datafusion:vortex-compact 13885183 / 11659128 / +19.1% 🔴 38591396 / 41566102 / -7.2% 0.36 / 0.28 / +28.3%
clickbench_q03/datafusion:vortex-compact 13069014 / 11020226 / +18.6% 🔴 48571022 / 38003311 / +27.8% 🔴 0.27 / 0.29 / -7.2%
clickbench_q04/datafusion:vortex-compact 58145858 / 55357023 / +5.0% 99835176 / 86860328 / +14.9% 🔴 0.58 / 0.64 / -8.6%
clickbench_q05/datafusion:vortex-compact 86261526 / 81052122 / +6.4% 140258722 / 121740527 / +15.2% 🔴 0.62 / 0.67 / -7.6%
clickbench_q06/datafusion:vortex-compact 1243128 / 1227843 / +1.2% 22924731 / 22522411 / +1.8% 0.05 / 0.05 / -0.5%
clickbench_q07/datafusion:vortex-compact 12060758 / 10145360 / +18.9% 🔴 38353824 / 35174117 / +9.0% 0.31 / 0.29 / +9.0%
clickbench_q08/datafusion:vortex-compact 80606022 / 79035199 / +2.0% 120839180 / 110335446 / +9.5% 0.67 / 0.72 / -6.9%
clickbench_q09/datafusion:vortex-compact 177495373 / 175827892 / +0.9% 206387455 / 200655825 / +2.9% 0.86 / 0.88 / -1.9%
clickbench_q10/datafusion:vortex-compact 26945089 / 26540716 / +1.5% 62705890 / 58656796 / +6.9% 0.43 / 0.45 / -5.0%
clickbench_q11/datafusion:vortex-compact 31472644 / 30370860 / +3.6% 66182914 / 61254492 / +8.0% 0.48 / 0.50 / -4.1%
clickbench_q12/datafusion:vortex-compact 90424654 / 80922606 / +11.7% 🔴 136828266 / 121958197 / +12.2% 🔴 0.66 / 0.66 / -0.4%
clickbench_q13/datafusion:vortex-compact 135467252 / 127455080 / +6.3% 189429123 / 182233962 / +3.9% 0.72 / 0.70 / +2.2%
clickbench_q14/datafusion:vortex-compact 99172690 / 85255930 / +16.3% 🔴 139510387 / 122375328 / +14.0% 🔴 0.71 / 0.70 / +2.0%
clickbench_q15/datafusion:vortex-compact 63818624 / 62201161 / +2.6% 98894545 / 94002862 / +5.2% 0.65 / 0.66 / -2.5%
clickbench_q16/datafusion:vortex-compact 161563246 / 155550158 / +3.9% 226324052 / 211459245 / +7.0% 0.71 / 0.74 / -3.0%
clickbench_q17/datafusion:vortex-compact 162603196 / 154817900 / +5.0% 227461353 / 209185747 / +8.7% 0.71 / 0.74 / -3.4%
clickbench_q18/datafusion:vortex-compact 293574584 / 287424878 / +2.1% 382580117 / 371766241 / +2.9% 0.77 / 0.77 / -0.7%
clickbench_q19/datafusion:vortex-compact 10301496 / 7864574 / +31.0% 🔴 39310303 / 42755519 / -8.1% 0.26 / 0.18 / +42.5%
clickbench_q20/datafusion:vortex-compact 87205508 / 70473370 / +23.7% 🔴 226619904 / 194037525 / +16.8% 🔴 0.38 / 0.36 / +6.0%
clickbench_q21/datafusion:vortex-compact 118963069 / 100618989 / +18.2% 🔴 253406821 / 228614316 / +10.8% 🔴 0.47 / 0.44 / +6.7%
clickbench_q22/datafusion:vortex-compact 227632112 / 141605276 / +60.8% 🔴 387650939 / 262569773 / +47.6% 🔴 0.59 / 0.54 / +8.9%
clickbench_q23/datafusion:vortex-compact 646427530 / 254083384 / +154.4% 🔴 828014840 / 399688863 / +107.2% 🔴 0.78 / 0.64 / +22.8%
clickbench_q24/datafusion:vortex-compact 34380132 / 21215195 / +62.1% 🔴 74811028 / 60600665 / +23.4% 🔴 0.46 / 0.35 / +31.3%
clickbench_q25/datafusion:vortex-compact 40013252 / 25640676 / +56.1% 🔴 80325526 / 66034769 / +21.6% 🔴 0.50 / 0.39 / +28.3%
clickbench_q26/datafusion:vortex-compact 34972641 / 22226354 / +57.3% 🔴 79960375 / 59210272 / +35.0% 🔴 0.44 / 0.38 / +16.5%
clickbench_q27/datafusion:vortex-compact 169578154 / 102287734 / +65.8% 🔴 266287343 / 209823255 / +26.9% 🔴 0.64 / 0.49 / +30.6%
clickbench_q28/datafusion:vortex-compact 612648825 / 572695860 / +7.0% 669237804 / 610309049 / +9.7% 0.92 / 0.94 / -2.4%
clickbench_q29/datafusion:vortex-compact 26702617 / 23938196 / +11.5% 🔴 53941727 / 49208912 / +9.6% 0.50 / 0.49 / +1.8%
clickbench_q30/datafusion:vortex-compact 73554770 / 74486756 / -1.3% 126356521 / 117222374 / +7.8% 0.58 / 0.64 / -8.4%
clickbench_q31/datafusion:vortex-compact 78818070 / 81593288 / -3.4% 151546246 / 150697892 / +0.6% 0.52 / 0.54 / -3.9%
clickbench_q32/datafusion:vortex-compact 287768233 / 285230088 / +0.9% 387414432 / 382648485 / +1.2% 0.74 / 0.75 / -0.4%
clickbench_q33/datafusion:vortex-compact 337598720 / 332185160 / +1.6% 436405239 / 420988690 / +3.7% 0.77 / 0.79 / -2.0%
clickbench_q34/datafusion:vortex-compact 332977038 / 326465132 / +2.0% 432860775 / 421850502 / +2.6% 0.77 / 0.77 / -0.6%
clickbench_q35/datafusion:vortex-compact 59937195 / 58142926 / +3.1% 92850713 / 86049019 / +7.9% 0.65 / 0.68 / -4.5%
clickbench_q36/datafusion:vortex-compact 44257316 / 38259906 / +15.7% 🔴 74947279 / 68522958 / +9.4% 0.59 / 0.56 / +5.8%
clickbench_q37/datafusion:vortex-compact 23053994 / 22658009 / +1.7% 50919182 / 51098677 / -0.4% 0.45 / 0.44 / +2.1%
clickbench_q38/datafusion:vortex-compact 19804204 / 13023762 / +52.1% 🔴 49888475 / 42680655 / +16.9% 🔴 0.40 / 0.31 / +30.1%
clickbench_q39/datafusion:vortex-compact 84773965 / 79104609 / +7.2% 116946281 / 112917043 / +3.6% 0.72 / 0.70 / +3.5%
clickbench_q40/datafusion:vortex-compact 12390082 / 12234400 / +1.3% 38720336 / 39163615 / -1.1% 0.32 / 0.31 / +2.4%
clickbench_q41/datafusion:vortex-compact 11350069 / 11627250 / -2.4% 36370521 / 37958192 / -4.2% 0.31 / 0.31 / +1.9%
clickbench_q42/datafusion:vortex-compact 10845105 / 11032612 / -1.7% 38154677 / 38815277 / -1.7% 0.28 / 0.28 / +0.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1251812 / 1292727 / -3.2% 51422874 / 51429275 / -0.0% 0.02 / 0.03 / -3.2%
clickbench_q01/datafusion:parquet 16305928 / 15724702 / +3.7% 68403987 / 66304223 / +3.2% 0.24 / 0.24 / +0.5%
clickbench_q02/datafusion:parquet 18610891 / 19685862 / -5.5% 81398109 / 79593503 / +2.3% 0.23 / 0.25 / -7.6%
clickbench_q03/datafusion:parquet 17254710 / 17179412 / +0.4% 80474732 / 78927343 / +2.0% 0.21 / 0.22 / -1.5%
clickbench_q04/datafusion:parquet 63736149 / 63943636 / -0.3% 134498897 / 124608793 / +7.9% 0.47 / 0.51 / -7.7%
clickbench_q05/datafusion:parquet 87940451 / 88850790 / -1.0% 159175442 / 165978659 / -4.1% 0.55 / 0.54 / +3.2%
clickbench_q06/datafusion:parquet 1270466 / 1283734 / -1.0% 51202975 / 49634926 / +3.2% 0.02 / 0.03 / -4.1%
clickbench_q07/datafusion:parquet 17010964 / 16701536 / +1.9% 70570243 / 67569196 / +4.4% 0.24 / 0.25 / -2.5%
clickbench_q08/datafusion:parquet 85999221 / 84710226 / +1.5% 163154036 / 159949716 / +2.0% 0.53 / 0.53 / -0.5%
clickbench_q09/datafusion:parquet 189131053 / 188511196 / +0.3% 265163707 / 273576179 / -3.1% 0.71 / 0.69 / +3.5%
clickbench_q10/datafusion:parquet 36017060 / 35680800 / +0.9% 103645756 / 100468313 / +3.2% 0.35 / 0.36 / -2.2%
clickbench_q11/datafusion:parquet 43043666 / 42389734 / +1.5% 113891871 / 110084720 / +3.5% 0.38 / 0.39 / -1.9%
clickbench_q12/datafusion:parquet 94729921 / 95755996 / -1.1% 163511155 / 163909078 / -0.2% 0.58 / 0.58 / -0.8%
clickbench_q13/datafusion:parquet 149170776 / 147815394 / +0.9% 227507360 / 225889564 / +0.7% 0.66 / 0.65 / +0.2%
clickbench_q14/datafusion:parquet 101454948 / 100974914 / +0.5% 175694669 / 172320121 / +2.0% 0.58 / 0.59 / -1.5%
clickbench_q15/datafusion:parquet 71254229 / 68835041 / +3.5% 134055630 / 131037815 / +2.3% 0.53 / 0.53 / +1.2%
clickbench_q16/datafusion:parquet 155406276 / 156705754 / -0.8% 236680811 / 236721936 / -0.0% 0.66 / 0.66 / -0.8%
clickbench_q17/datafusion:parquet 156750492 / 156508832 / +0.2% 238261333 / 237116554 / +0.5% 0.66 / 0.66 / -0.3%
clickbench_q18/datafusion:parquet 311898094 / 313280058 / -0.4% 421814199 / 423418303 / -0.4% 0.74 / 0.74 / -0.1%
clickbench_q19/datafusion:parquet 19767252 / 18927142 / +4.4% 80217350 / 78553631 / +2.1% 0.25 / 0.24 / +2.3%
clickbench_q20/datafusion:parquet 177869109 / 177536218 / +0.2% 304063322 / 282411476 / +7.7% 0.58 / 0.63 / -6.9%
clickbench_q21/datafusion:parquet 175218544 / 173823807 / +0.8% 315567768 / 298714470 / +5.6% 0.56 / 0.58 / -4.6%
clickbench_q22/datafusion:parquet 260870333 / 260235730 / +0.2% 460165263 / 429827192 / +7.1% 0.57 / 0.61 / -6.4%
clickbench_q23/datafusion:parquet 1015296252 / 1011775139 / +0.3% 1196096272 / 1200760738 / -0.4% 0.85 / 0.84 / +0.7%
clickbench_q24/datafusion:parquet 30778473 / 29950337 / +2.8% 92915659 / 89131317 / +4.2% 0.33 / 0.34 / -1.4%
clickbench_q25/datafusion:parquet 37766526 / 37100437 / +1.8% 105011675 / 103472440 / +1.5% 0.36 / 0.36 / +0.3%
clickbench_q26/datafusion:parquet 31000047 / 30848104 / +0.5% 92240019 / 90939726 / +1.4% 0.34 / 0.34 / -0.9%
clickbench_q27/datafusion:parquet 194669021 / 193325144 / +0.7% 303425823 / 291751815 / +4.0% 0.64 / 0.66 / -3.2%
clickbench_q28/datafusion:parquet 615873408 / 617919300 / -0.3% 713362996 / 699237225 / +2.0% 0.86 / 0.88 / -2.3%
clickbench_q29/datafusion:parquet 29129814 / 28764218 / +1.3% 91166889 / 88876919 / +2.6% 0.32 / 0.32 / -1.3%
clickbench_q30/datafusion:parquet 89515640 / 90128857 / -0.7% 174655910 / 174824426 / -0.1% 0.51 / 0.52 / -0.6%
clickbench_q31/datafusion:parquet 101980526 / 103697978 / -1.7% 199006809 / 199458925 / -0.2% 0.51 / 0.52 / -1.4%
clickbench_q32/datafusion:parquet 309060003 / 312205432 / -1.0% 429381720 / 436029730 / -1.5% 0.72 / 0.72 / +0.5%
clickbench_q33/datafusion:parquet 378387336 / 378165010 / +0.1% 480779071 / 478877199 / +0.4% 0.79 / 0.79 / -0.3%
clickbench_q34/datafusion:parquet 378895262 / 376054618 / +0.8% 479035494 / 476367491 / +0.6% 0.79 / 0.79 / +0.2%
clickbench_q35/datafusion:parquet 63047866 / 64638304 / -2.5% 123194776 / 123247798 / -0.0% 0.51 / 0.52 / -2.4%
clickbench_q36/datafusion:parquet 73553980 / 73863247 / -0.4% 138551467 / 136667579 / +1.4% 0.53 / 0.54 / -1.8%
clickbench_q37/datafusion:parquet 35132382 / 35210374 / -0.2% 91897145 / 93210245 / -1.4% 0.38 / 0.38 / +1.2%
clickbench_q38/datafusion:parquet 47457332 / 47816977 / -0.8% 109145338 / 107350470 / +1.7% 0.43 / 0.45 / -2.4%
clickbench_q39/datafusion:parquet 143844150 / 144149812 / -0.2% 210227393 / 211017501 / -0.4% 0.68 / 0.68 / +0.2%
clickbench_q40/datafusion:parquet 20026815 / 19908000 / +0.6% 76920630 / 78573241 / -2.1% 0.26 / 0.25 / +2.8%
clickbench_q41/datafusion:parquet 18730457 / 18809140 / -0.4% 76228861 / 75928869 / +0.4% 0.25 / 0.25 / -0.8%
clickbench_q42/datafusion:parquet 19512018 / 19267130 / +1.3% 75336995 / 76343853 / -1.3% 0.26 / 0.25 / +2.6%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2127265 / 2222206 / -4.3% 25473975 / 23958495 / +6.3% 0.08 / 0.09 / -10.0%
clickbench_q01/duckdb:vortex-file-compressed 7206310 / 6928975 / +4.0% 25376329 / 28341541 / -10.5% 🟢 0.28 / 0.24 / +16.2%
clickbench_q02/duckdb:vortex-file-compressed 8352302 / 8063267 / +3.6% 36795204 / 35880354 / +2.5% 0.23 / 0.22 / +1.0%
clickbench_q03/duckdb:vortex-file-compressed 14221508 / 14226860 / -0.0% 58517552 / 57730133 / +1.4% 0.24 / 0.25 / -1.4%
clickbench_q04/duckdb:vortex-file-compressed 57150067 / 55874206 / +2.3% 102747458 / 96781314 / +6.2% 0.56 / 0.58 / -3.7%
clickbench_q05/duckdb:vortex-file-compressed 63607728 / 63984847 / -0.6% 93420288 / 95072560 / -1.7% 0.68 / 0.67 / +1.2%
clickbench_q06/duckdb:vortex-file-compressed 2640088 / 2623332 / +0.6% 30804254 / 30455352 / +1.1% 0.09 / 0.09 / -0.5%
clickbench_q07/duckdb:vortex-file-compressed 8411024 / 8451770 / -0.5% 31952533 / 27631507 / +15.6% 🔴 0.26 / 0.31 / -13.9%
clickbench_q08/duckdb:vortex-file-compressed 67429326 / 67446781 / -0.0% 113320158 / 114870637 / -1.3% 0.60 / 0.59 / +1.3%
clickbench_q09/duckdb:vortex-file-compressed 88040534 / 85687268 / +2.7% 133316530 / 124952757 / +6.7% 0.66 / 0.69 / -3.7%
clickbench_q10/duckdb:vortex-file-compressed 25996476 / 26235404 / -0.9% 70952806 / 69736391 / +1.7% 0.37 / 0.38 / -2.6%
clickbench_q11/duckdb:vortex-file-compressed 28689602 / 28577976 / +0.4% 73564481 / 73207306 / +0.5% 0.39 / 0.39 / -0.1%
clickbench_q12/duckdb:vortex-file-compressed 71150178 / 69895970 / +1.8% 101558710 / 101609384 / -0.0% 0.70 / 0.69 / +1.8%
clickbench_q13/duckdb:vortex-file-compressed 125519224 / 125767462 / -0.2% 166975413 / 166480346 / +0.3% 0.75 / 0.76 / -0.5%
clickbench_q14/duckdb:vortex-file-compressed 72801496 / 73288446 / -0.7% 102254648 / 105453708 / -3.0% 0.71 / 0.69 / +2.4%
clickbench_q15/duckdb:vortex-file-compressed 75402742 / 75527416 / -0.2% 117500608 / 114496151 / +2.6% 0.64 / 0.66 / -2.7%
clickbench_q16/duckdb:vortex-file-compressed 140135224 / 137599848 / +1.8% 181888763 / 183131796 / -0.7% 0.77 / 0.75 / +2.5%
clickbench_q17/duckdb:vortex-file-compressed 143417340 / 140602652 / +2.0% 176348294 / 177255229 / -0.5% 0.81 / 0.79 / +2.5%
clickbench_q18/duckdb:vortex-file-compressed 256786724 / 262993362 / -2.4% 316804204 / 321146835 / -1.4% 0.81 / 0.82 / -1.0%
clickbench_q19/duckdb:vortex-file-compressed 9478288 / 9417383 / +0.6% 43829755 / 42268236 / +3.7% 0.22 / 0.22 / -2.9%
clickbench_q20/duckdb:vortex-file-compressed 65739782 / 64657158 / +1.7% 166446453 / 167274168 / -0.5% 0.39 / 0.39 / +2.2%
clickbench_q21/duckdb:vortex-file-compressed 95247842 / 95590748 / -0.4% 269769557 / 269789600 / -0.0% 0.35 / 0.35 / -0.4%
clickbench_q22/duckdb:vortex-file-compressed 171100008 / 174743704 / -2.1% 425211762 / 421409690 / +0.9% 0.40 / 0.41 / -3.0%
clickbench_q23/duckdb:vortex-file-compressed 33945985 / 34688912 / -2.1% 87708839 / 84339625 / +4.0% 0.39 / 0.41 / -5.9%
clickbench_q24/duckdb:vortex-file-compressed 14288930 / 13685352 / +4.4% 31114135 / 37912194 / -17.9% 🟢 0.46 / 0.36 / +27.2%
clickbench_q25/duckdb:vortex-file-compressed 18944618 / 18822893 / +0.6% 49732136 / 50834134 / -2.2% 0.38 / 0.37 / +2.9%
clickbench_q26/duckdb:vortex-file-compressed 11852834 / 11356684 / +4.4% 35868187 / 34421944 / +4.2% 0.33 / 0.33 / +0.2%
clickbench_q27/duckdb:vortex-file-compressed 53202766 / 53450462 / -0.5% 223516172 / 222466954 / +0.5% 0.24 / 0.24 / -0.9%
clickbench_q28/duckdb:vortex-file-compressed 511004666 / 510929311 / +0.0% 580207497 / 571873140 / +1.5% 0.88 / 0.89 / -1.4%
clickbench_q29/duckdb:vortex-file-compressed 17365044 / 16264289 / +6.8% 46746753 / 45075047 / +3.7% 0.37 / 0.36 / +2.9%
clickbench_q30/duckdb:vortex-file-compressed 58785571 / 58845004 / -0.1% 111907207 / 110425667 / +1.3% 0.53 / 0.53 / -1.4%
clickbench_q31/duckdb:vortex-file-compressed 109458740 / 108566590 / +0.8% 202539629 / 199822695 / +1.4% 0.54 / 0.54 / -0.5%
clickbench_q32/duckdb:vortex-file-compressed 364647339 / 379055942 / -3.8% 397333708 / 415156767 / -4.3% 0.92 / 0.91 / +0.5%
clickbench_q33/duckdb:vortex-file-compressed 347443066 / 347975154 / -0.2% 445006418 / 446120863 / -0.2% 0.78 / 0.78 / +0.1%
clickbench_q34/duckdb:vortex-file-compressed 365204820 / 358660825 / +1.8% 467318086 / 462833109 / +1.0% 0.78 / 0.77 / +0.8%
clickbench_q35/duckdb:vortex-file-compressed 56220238 / 56742598 / -0.9% 90865271 / 89058189 / +2.0% 0.62 / 0.64 / -2.9%
clickbench_q36/duckdb:vortex-file-compressed 11233957 / 11481320 / -2.2% 31971804 / 31060675 / +2.9% 0.35 / 0.37 / -4.9%
clickbench_q37/duckdb:vortex-file-compressed 7676335 / 7854712 / -2.3% 29268855 / 29003058 / +0.9% 0.26 / 0.27 / -3.2%
clickbench_q38/duckdb:vortex-file-compressed 8392001 / 8225890 / +2.0% 29702562 / 28856584 / +2.9% 0.28 / 0.29 / -0.9%
clickbench_q39/duckdb:vortex-file-compressed 19530240 / 19106820 / +2.2% 40234163 / 39530894 / +1.8% 0.49 / 0.48 / +0.4%
clickbench_q40/duckdb:vortex-file-compressed 6854598 / 6700448 / +2.3% 29458156 / 29976310 / -1.7% 0.23 / 0.22 / +4.1%
clickbench_q41/duckdb:vortex-file-compressed 7940504 / 7610971 / +4.3% 28948907 / 29615744 / -2.3% 0.27 / 0.26 / +6.7%
clickbench_q42/duckdb:vortex-file-compressed 7046583 / 6996449 / +0.7% 29068461 / 28020192 / +3.7% 0.24 / 0.25 / -2.9%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 2180590 / 2239697 / -2.6% 25731060 / 25967249 / -0.9% 0.08 / 0.09 / -1.7%
clickbench_q01/duckdb:vortex-compact 7470321 / 7318810 / +2.1% 27768838 / 26928182 / +3.1% 0.27 / 0.27 / -1.0%
clickbench_q02/duckdb:vortex-compact 10935576 / 10700722 / +2.2% 34087189 / 34901834 / -2.3% 0.32 / 0.31 / +4.6%
clickbench_q03/duckdb:vortex-compact 15723420 / 15459316 / +1.7% 50675814 / 52447167 / -3.4% 0.31 / 0.29 / +5.3%
clickbench_q04/duckdb:vortex-compact 58401929 / 58957162 / -0.9% 94318204 / 98283240 / -4.0% 0.62 / 0.60 / +3.2%
clickbench_q05/duckdb:vortex-compact 67867656 / 68618752 / -1.1% 98074677 / 96052148 / +2.1% 0.69 / 0.71 / -3.1%
clickbench_q06/duckdb:vortex-compact 2603878 / 2638540 / -1.3% 28349098 / 30209262 / -6.2% 0.09 / 0.09 / +5.2%
clickbench_q07/duckdb:vortex-compact 9349581 / 9275290 / +0.8% 33750969 / 31273332 / +7.9% 0.28 / 0.30 / -6.6%
clickbench_q08/duckdb:vortex-compact 72043964 / 71799231 / +0.3% 111387590 / 111848767 / -0.4% 0.65 / 0.64 / +0.8%
clickbench_q09/duckdb:vortex-compact 101656102 / 97893498 / +3.8% 138687107 / 137982908 / +0.5% 0.73 / 0.71 / +3.3%
clickbench_q10/duckdb:vortex-compact 31658565 / 31378838 / +0.9% 70786778 / 68947550 / +2.7% 0.45 / 0.46 / -1.7%
clickbench_q11/duckdb:vortex-compact 35433813 / 35485988 / -0.1% 72925802 / 72740312 / +0.3% 0.49 / 0.49 / -0.4%
clickbench_q12/duckdb:vortex-compact 77514069 / 75621878 / +2.5% 111482621 / 110503124 / +0.9% 0.70 / 0.68 / +1.6%
clickbench_q13/duckdb:vortex-compact 139192118 / 137610788 / +1.1% 178280001 / 178934044 / -0.4% 0.78 / 0.77 / +1.5%
clickbench_q14/duckdb:vortex-compact 81263236 / 81991393 / -0.9% 114598654 / 112351023 / +2.0% 0.71 / 0.73 / -2.8%
clickbench_q15/duckdb:vortex-compact 77828280 / 76879574 / +1.2% 113890487 / 114842775 / -0.8% 0.68 / 0.67 / +2.1%
clickbench_q16/duckdb:vortex-compact 149079775 / 149787281 / -0.5% 191224162 / 189948697 / +0.7% 0.78 / 0.79 / -1.1%
clickbench_q17/duckdb:vortex-compact 152420589 / 151533738 / +0.6% 185055930 / 188177162 / -1.7% 0.82 / 0.81 / +2.3%
clickbench_q18/duckdb:vortex-compact 265577712 / 264819332 / +0.3% 314935636 / 320617196 / -1.8% 0.84 / 0.83 / +2.1%
clickbench_q19/duckdb:vortex-compact 10692300 / 10738188 / -0.4% 37910906 / 38754707 / -2.2% 0.28 / 0.28 / +1.8%
clickbench_q20/duckdb:vortex-compact 82180754 / 80292185 / +2.4% 159264303 / 156038448 / +2.1% 0.52 / 0.51 / +0.3%
clickbench_q21/duckdb:vortex-compact 130988708 / 130848662 / +0.1% 278374277 / 275678884 / +1.0% 0.47 / 0.47 / -0.9%
clickbench_q22/duckdb:vortex-compact 284078258 / 283581994 / +0.2% 467150661 / 468040911 / -0.2% 0.61 / 0.61 / +0.4%
clickbench_q23/duckdb:vortex-compact 42551922 / 47102200 / -9.7% 84150226 / 81745824 / +2.9% 0.51 / 0.58 / -12.2%
clickbench_q24/duckdb:vortex-compact 18297239 / 17858812 / +2.5% 37913709 / 40088852 / -5.4% 0.48 / 0.45 / +8.3%
clickbench_q25/duckdb:vortex-compact 32446334 / 32316832 / +0.4% 62662025 / 61452198 / +2.0% 0.52 / 0.53 / -1.5%
clickbench_q26/duckdb:vortex-compact 14118946 / 14525968 / -2.8% 36350297 / 35335752 / +2.9% 0.39 / 0.41 / -5.5%
clickbench_q27/duckdb:vortex-compact 146553676 / 147479300 / -0.6% 262501682 / 261744564 / +0.3% 0.56 / 0.56 / -0.9%
clickbench_q28/duckdb:vortex-compact 540921052 / 538104636 / +0.5% 606756559 / 608433537 / -0.3% 0.89 / 0.88 / +0.8%
clickbench_q29/duckdb:vortex-compact 18671750 / 19575312 / -4.6% 43971549 / 44893748 / -2.1% 0.42 / 0.44 / -2.6%
clickbench_q30/duckdb:vortex-compact 82512436 / 82245257 / +0.3% 125978275 / 121886088 / +3.4% 0.65 / 0.67 / -2.9%
clickbench_q31/duckdb:vortex-compact 131217851 / 130018232 / +0.9% 183774979 / 206621457 / -11.1% 🟢 0.71 / 0.63 / +13.5%
clickbench_q32/duckdb:vortex-compact 362505244 / 387651789 / -6.5% 401640335 / 417104463 / -3.7% 0.90 / 0.93 / -2.9%
clickbench_q33/duckdb:vortex-compact 358243565 / 357875779 / +0.1% 452558000 / 465086911 / -2.7% 0.79 / 0.77 / +2.9%
clickbench_q34/duckdb:vortex-compact 372126990 / 371908488 / +0.1% 476665677 / 473535325 / +0.7% 0.78 / 0.79 / -0.6%
clickbench_q35/duckdb:vortex-compact 59478331 / 57740550 / +3.0% 89761390 / 86724827 / +3.5% 0.66 / 0.67 / -0.5%
clickbench_q36/duckdb:vortex-compact 12273984 / 11842877 / +3.6% 33957089 / 33096118 / +2.6% 0.36 / 0.36 / +1.0%
clickbench_q37/duckdb:vortex-compact 10409266 / 10009078 / +4.0% 33047043 / 32426161 / +1.9% 0.31 / 0.31 / +2.0%
clickbench_q38/duckdb:vortex-compact 9166248 / 9153094 / +0.1% 31823038 / 29319782 / +8.5% 0.29 / 0.31 / -7.7%
clickbench_q39/duckdb:vortex-compact 20779274 / 20472994 / +1.5% 41531529 / 40911285 / +1.5% 0.50 / 0.50 / -0.0%
clickbench_q40/duckdb:vortex-compact 8006150 / 8539164 / -6.2% 32773362 / 29757499 / +10.1% 🔴 0.24 / 0.29 / -14.9%
clickbench_q41/duckdb:vortex-compact 8581474 / 8782236 / -2.3% 30994653 / 30399556 / +2.0% 0.28 / 0.29 / -4.2%
clickbench_q42/duckdb:vortex-compact 7331841 / 7239728 / +1.3% 30818300 / 29400203 / +4.8% 0.24 / 0.25 / -3.4%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 10877209 / 11415982 / -4.7% 19942640 / 18482923 / +7.9% 0.55 / 0.62 / -11.7%
clickbench_q01/duckdb:parquet 17667929 / 17262068 / +2.4% 24146150 / 24780782 / -2.6% 0.73 / 0.70 / +5.0%
clickbench_q02/duckdb:parquet 24054081 / 24124268 / -0.3% 35455755 / 33554001 / +5.7% 0.68 / 0.72 / -5.6%
clickbench_q03/duckdb:parquet 24873154 / 25455372 / -2.3% 38299104 / 37720312 / +1.5% 0.65 / 0.67 / -3.8%
clickbench_q04/duckdb:parquet 63380411 / 63595764 / -0.3% 78946826 / 78036944 / +1.2% 0.80 / 0.81 / -1.5%
clickbench_q05/duckdb:parquet 85974904 / 86032291 / -0.1% 102830301 / 101738799 / +1.1% 0.84 / 0.85 / -1.1%
clickbench_q06/duckdb:parquet 21660861 / 22374970 / -3.2% 31897041 / 30286903 / +5.3% 0.68 / 0.74 / -8.1%
clickbench_q07/duckdb:parquet 18685083 / 18509272 / +0.9% 27988619 / 26190760 / +6.9% 0.67 / 0.71 / -5.5%
clickbench_q08/duckdb:parquet 76484878 / 76414384 / +0.1% 91810573 / 93852716 / -2.2% 0.83 / 0.81 / +2.3%
clickbench_q09/duckdb:parquet 106682582 / 104907798 / +1.7% 122559751 / 125353818 / -2.2% 0.87 / 0.84 / +4.0%
clickbench_q10/duckdb:parquet 43224267 / 42460382 / +1.8% 57107757 / 58372707 / -2.2% 0.76 / 0.73 / +4.1%
clickbench_q11/duckdb:parquet 46858170 / 47204799 / -0.7% 66218023 / 67488962 / -1.9% 0.71 / 0.70 / +1.2%
clickbench_q12/duckdb:parquet 94096794 / 94100974 / -0.0% 114492934 / 114315358 / +0.2% 0.82 / 0.82 / -0.2%
clickbench_q13/duckdb:parquet 154318262 / 153237472 / +0.7% 175107086 / 177341820 / -1.3% 0.88 / 0.86 / +2.0%
clickbench_q14/duckdb:parquet 103720362 / 103828812 / -0.1% 129184107 / 130732021 / -1.2% 0.80 / 0.79 / +1.1%
clickbench_q15/duckdb:parquet 90796601 / 89405708 / +1.6% 107795436 / 106818787 / +0.9% 0.84 / 0.84 / +0.6%
clickbench_q16/duckdb:parquet 172305614 / 175346758 / -1.7% 188386007 / 214413380 / -12.1% 🟢 0.91 / 0.82 / +11.8%
clickbench_q17/duckdb:parquet 176360062 / 179646660 / -1.8% 190188916 / 191495705 / -0.7% 0.93 / 0.94 / -1.2%
clickbench_q18/duckdb:parquet 302284427 / 315357630 / -4.1% 338853834 / 334940956 / +1.2% 0.89 / 0.94 / -5.3%
clickbench_q19/duckdb:parquet 22107290 / 21665418 / +2.0% 30218744 / 33834084 / -10.7% 🟢 0.73 / 0.64 / +14.2%
clickbench_q20/duckdb:parquet 192840344 / 181774530 / +6.1% 232180013 / 231734237 / +0.2% 0.83 / 0.78 / +5.9%
clickbench_q21/duckdb:parquet 228484535 / 229562876 / -0.5% 276780314 / 272693042 / +1.5% 0.83 / 0.84 / -1.9%
clickbench_q22/duckdb:parquet 325159297 / 323896802 / +0.4% 366095956 / 358176355 / +2.2% 0.89 / 0.90 / -1.8%
clickbench_q23/duckdb:parquet 175160796 / 169878666 / +3.1% 231942781 / 210963959 / +9.9% 0.76 / 0.81 / -6.2%
clickbench_q24/duckdb:parquet 31531658 / 33011015 / -4.5% 48798486 / 42474403 / +14.9% 🔴 0.65 / 0.78 / -16.9%
clickbench_q25/duckdb:parquet 44332992 / 42971348 / +3.2% 60803188 / 60833469 / -0.0% 0.73 / 0.71 / +3.2%
clickbench_q26/duckdb:parquet 32789659 / 32896224 / -0.3% 47742578 / 48567899 / -1.7% 0.69 / 0.68 / +1.4%
clickbench_q27/duckdb:parquet 188454365 / 191601110 / -1.6% 229532853 / 236116723 / -2.8% 0.82 / 0.81 / +1.2%
clickbench_q28/duckdb:parquet 996102272 / 990126514 / +0.6% 971043134 / 972084581 / -0.1% 1.03 / 1.02 / +0.7%
clickbench_q29/duckdb:parquet 26387194 / 26120010 / +1.0% 36477097 / 35303947 / +3.3% 0.72 / 0.74 / -2.2%
clickbench_q30/duckdb:parquet 108059614 / 108766078 / -0.6% 134056255 / 136037324 / -1.5% 0.81 / 0.80 / +0.8%
clickbench_q31/duckdb:parquet 163097840 / 149946098 / +8.8% 181534732 / 207284849 / -12.4% 🟢 0.90 / 0.72 / +24.2%
clickbench_q32/duckdb:parquet 405461924 / 399214187 / +1.6% 417104747 / 419763237 / -0.6% 0.97 / 0.95 / +2.2%
clickbench_q33/duckdb:parquet 475447357 / 477155358 / -0.4% 443150239 / 457931404 / -3.2% 1.07 / 1.04 / +3.0%
clickbench_q34/duckdb:parquet 465112932 / 486413606 / -4.4% 469981165 / 470841613 / -0.2% 0.99 / 1.03 / -4.2%
clickbench_q35/duckdb:parquet 63446525 / 63671559 / -0.4% 78458495 / 76562356 / +2.5% 0.81 / 0.83 / -2.8%
clickbench_q36/duckdb:parquet 33807418 / 32070820 / +5.4% 40705215 / 40819374 / -0.3% 0.83 / 0.79 / +5.7%
clickbench_q37/duckdb:parquet 25581602 / 25882098 / -1.2% 35456683 / 34045151 / +4.1% 0.72 / 0.76 / -5.1%
clickbench_q38/duckdb:parquet 25544460 / 25510308 / +0.1% 34727651 / 35183097 / -1.3% 0.74 / 0.73 / +1.4%
clickbench_q39/duckdb:parquet 55164053 / 55330345 / -0.3% 64864558 / 62774910 / +3.3% 0.85 / 0.88 / -3.5%
clickbench_q40/duckdb:parquet 16087535 / 15608988 / +3.1% 24570009 / 24824920 / -1.0% 0.65 / 0.63 / +4.1%
clickbench_q41/duckdb:parquet 16798396 / 16944480 / -0.9% 24967937 / 23644910 / +5.6% 0.67 / 0.72 / -6.1%
clickbench_q42/duckdb:parquet 16428805 / 16488906 / -0.4% 25010432 / 25478801 / -1.8% 0.66 / 0.65 / +1.5%
duckdb / duckdb / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb 11764644 / 11779798 / -0.1% 14106465 / 14031411 / +0.5% 0.83 / 0.84 / -0.7%
clickbench_q01/duckdb:duckdb 27107628 / 27343006 / -0.9% 47374436 / 47690642 / -0.7% 0.57 / 0.57 / -0.2%
clickbench_q02/duckdb:duckdb 23414886 / 23309892 / +0.5% 49315669 / 52271338 / -5.7% 0.47 / 0.45 / +6.5%
clickbench_q03/duckdb:duckdb 22808432 / 22740594 / +0.3% 46979802 / 49517692 / -5.1% 0.49 / 0.46 / +5.7%
clickbench_q04/duckdb:duckdb 76281121 / 75494780 / +1.0% 100299755 / 102183904 / -1.8% 0.76 / 0.74 / +2.9%
clickbench_q05/duckdb:duckdb 80857339 / 81269445 / -0.5% 102709942 / 104319696 / -1.5% 0.79 / 0.78 / +1.1%
clickbench_q06/duckdb:duckdb 22383744 / 22187562 / +0.9% 30803608 / 31124887 / -1.0% 0.73 / 0.71 / +1.9%
clickbench_q07/duckdb:duckdb 18836161 / 18773932 / +0.3% 35228254 / 36571699 / -3.7% 0.53 / 0.51 / +4.2%
clickbench_q08/duckdb:duckdb 89923519 / 88477854 / +1.6% 121726179 / 121164025 / +0.5% 0.74 / 0.73 / +1.2%
clickbench_q09/duckdb:duckdb 99545902 / 99544299 / +0.0% 141439206 / 141314353 / +0.1% 0.70 / 0.70 / -0.1%
clickbench_q10/duckdb:duckdb 52566946 / 53055300 / -0.9% 95810807 / 97776254 / -2.0% 0.55 / 0.54 / +1.1%
clickbench_q11/duckdb:duckdb 56083927 / 57046840 / -1.7% 104966737 / 102834647 / +2.1% 0.53 / 0.55 / -3.7%
clickbench_q12/duckdb:duckdb 83851632 / 85001630 / -1.4% 107962687 / 108098633 / -0.1% 0.78 / 0.79 / -1.2%
clickbench_q13/duckdb:duckdb 147920192 / 149112278 / -0.8% 184839808 / 184938282 / -0.1% 0.80 / 0.81 / -0.7%
clickbench_q14/duckdb:duckdb 93864465 / 93267366 / +0.6% 119132560 / 118390969 / +0.6% 0.79 / 0.79 / +0.0%
clickbench_q15/duckdb:duckdb 83321985 / 83552545 / -0.3% 107079184 / 108575303 / -1.4% 0.78 / 0.77 / +1.1%
clickbench_q16/duckdb:duckdb 170438939 / 175465936 / -2.9% 196860049 / 194567878 / +1.2% 0.87 / 0.90 / -4.0%
clickbench_q17/duckdb:duckdb 157056774 / 160798184 / -2.3% 191407127 / 188803149 / +1.4% 0.82 / 0.85 / -3.7%
clickbench_q18/duckdb:duckdb 307794956 / 312877110 / -1.6% 361391602 / 368268765 / -1.9% 0.85 / 0.85 / +0.2%
clickbench_q19/duckdb:duckdb 19046314 / 18392207 / +3.6% 34997720 / 35397783 / -1.1% 0.54 / 0.52 / +4.7%
clickbench_q20/duckdb:duckdb 186068826 / 195378351 / -4.8% 500840882 / 475202144 / +5.4% 0.37 / 0.41 / -9.6%
clickbench_q21/duckdb:duckdb 169081522 / 180534980 / -6.3% 501757728 / 487908448 / +2.8% 0.34 / 0.37 / -8.9%
clickbench_q22/duckdb:duckdb 187976692 / 194377304 / -3.3% 492198376 / 486169795 / +1.2% 0.38 / 0.40 / -4.5%
clickbench_q23/duckdb:duckdb 74109033 / 74723534 / -0.8% 151188389 / 153695926 / -1.6% 0.49 / 0.49 / +0.8%
clickbench_q24/duckdb:duckdb 32643284 / 31967182 / +2.1% 47406857 / 48268901 / -1.8% 0.69 / 0.66 / +4.0%
clickbench_q25/duckdb:duckdb 43472878 / 43226641 / +0.6% 82105231 / 79897974 / +2.8% 0.53 / 0.54 / -2.1%
clickbench_q26/duckdb:duckdb 33344166 / 32800448 / +1.7% 49760750 / 51285710 / -3.0% 0.67 / 0.64 / +4.8%
clickbench_q27/duckdb:duckdb 156532240 / 163580666 / -4.3% 468267831 / 502702910 / -6.8% 0.33 / 0.33 / +2.7%
clickbench_q28/duckdb:duckdb 866832466 / 849558047 / +2.0% 917493046 / 921986004 / -0.5% 0.94 / 0.92 / +2.5%
clickbench_q29/duckdb:duckdb 28611486 / 28535710 / +0.3% 45380831 / 48678654 / -6.8% 0.63 / 0.59 / +7.6%
clickbench_q30/duckdb:duckdb 103012580 / 103489513 / -0.5% 180162233 / 176010126 / +2.4% 0.57 / 0.59 / -2.8%
clickbench_q31/duckdb:duckdb 163293916 / 163751862 / -0.3% 260985815 / 257395462 / +1.4% 0.63 / 0.64 / -1.7%
clickbench_q32/duckdb:duckdb 477976384 / 463569245 / +3.1% 495566041 / 506674593 / -2.2% 0.96 / 0.91 / +5.4%
clickbench_q33/duckdb:duckdb 459891269 / 470690884 / -2.3% 622946113 / 640235375 / -2.7% 0.74 / 0.74 / +0.4%
clickbench_q34/duckdb:duckdb 464355915 / 486030104 / -4.5% 637263305 / 664426847 / -4.1% 0.73 / 0.73 / -0.4%
clickbench_q35/duckdb:duckdb 76649396 / 75693654 / +1.3% 96518921 / 97226399 / -0.7% 0.79 / 0.78 / +2.0%
clickbench_q36/duckdb:duckdb 33591044 / 33515464 / +0.2% 47371150 / 48764268 / -2.9% 0.71 / 0.69 / +3.2%
clickbench_q37/duckdb:duckdb 18105090 / 18265744 / -0.9% 28223639 / 28765066 / -1.9% 0.64 / 0.63 / +1.0%
clickbench_q38/duckdb:duckdb 20290420 / 20057823 / +1.2% 34974923 / 38299380 / -8.7% 0.58 / 0.52 / +10.8%
clickbench_q39/duckdb:duckdb 56252682 / 55791392 / +0.8% 81611122 / 80888608 / +0.9% 0.69 / 0.69 / -0.1%
clickbench_q40/duckdb:duckdb 17506511 / 17482245 / +0.1% 29987737 / 32149733 / -6.7% 0.58 / 0.54 / +7.4%
clickbench_q41/duckdb:duckdb 17330424 / 17387253 / -0.3% 25710122 / 29054516 / -11.5% 🟢 0.67 / 0.60 / +12.6%
clickbench_q42/duckdb:duckdb 17378998 / 17299102 / +0.5% 27010538 / 29161454 / -7.4% 0.64 / 0.59 / +8.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR e42f8876 vs base 2a9c7628


vortex / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 488087927 / 493840421 / -1.2%
compress time/Bimbo 1997740982 / 1967603288 / +1.5%
compress time/CMSprovider 948591487 / 967940739 / -2.0%
compress time/Euro2016 163780895 / 165504556 / -1.0%
compress time/Food 222899708 / 227160475 / -1.9%
compress time/HashTags 374661892 / 376389339 / -0.5%
compress time/TPC-H l_comment canonical 391084267 / 392629145 / -0.4%
compress time/TPC-H l_comment chunked 389349907 / 393013107 / -0.9%
compress time/taxi 186420499 / 185986114 / +0.2%
compress time/wide table cols=100 chunks=1 rows=1000 4221268 / 4274764 / -1.3%
compress time/wide table cols=100 chunks=50 rows=1000 4206362 / 4403188 / -4.5%
compress time/wide table cols=1000 chunks=1 rows=1000 40744050 / 40467301 / +0.7%
compress time/wide table cols=1000 chunks=50 rows=1000 40742973 / 40614384 / +0.3%
compress time/wide table cols=10000 chunks=1 rows=1000 465724729 / 461386012 / +0.9%
compress time/wide table cols=10000 chunks=50 rows=1000 458498129 / 465266694 / -1.5%
decompress time/Arade 14023690 / 14233164 / -1.5%
decompress time/Bimbo 67134886 / 66639587 / +0.7%
decompress time/CMSprovider 38476276 / 38240675 / +0.6%
decompress time/Euro2016 14290748 / 14231542 / +0.4%
decompress time/Food 3767651 / 3815322 / -1.2%
decompress time/HashTags 39294497 / 39493428 / -0.5%
decompress time/TPC-H l_comment canonical 14717840 / 14824342 / -0.7%
decompress time/TPC-H l_comment chunked 14867932 / 14700296 / +1.1%
decompress time/taxi 9794833 / 9510964 / +3.0%
decompress time/wide table cols=100 chunks=1 rows=1000 1397699 / 1409203 / -0.8%
decompress time/wide table cols=100 chunks=50 rows=1000 1422710 / 1580160 / -10.0%
decompress time/wide table cols=1000 chunks=1 rows=1000 13329106 / 13087410 / +1.8%
decompress time/wide table cols=1000 chunks=50 rows=1000 13259159 / 12961503 / +2.3%
decompress time/wide table cols=10000 chunks=1 rows=1000 141439357 / 142175427 / -0.5%
decompress time/wide table cols=10000 chunks=50 rows=1000 142091872 / 141194017 / +0.6%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142214220 / 142214220 / +0.0%
vortex-file-compressed size/Bimbo 458581412 / 458581412 / +0.0%
vortex-file-compressed size/CMSprovider 420808940 / 420808940 / +0.0%
vortex-file-compressed size/Euro2016 164567148 / 164567148 / +0.0%
vortex-file-compressed size/Food 38951432 / 38951432 / +0.0%
vortex-file-compressed size/HashTags 195467452 / 195467452 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 178709224 / 178709224 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 178709224 / 178709224 / +0.0%
vortex-file-compressed size/taxi 49998508 / 49998508 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 935376 / 935376 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 935376 / 935376 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9336872 / 9336872 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9336872 / 9336872 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93387872 / 93387872 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93387872 / 93387872 / +0.0%
vortex / vortex-file-compressed / ratio (0.999x ➖, 0↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.667285593 / 0.673448359 / -0.9%
vortex:parquet-zstd ratio compress time/Bimbo 1.00152074 / 0.988123118 / +1.4%
vortex:parquet-zstd ratio compress time/CMSprovider 0.895452555 / 0.914145965 / -2.0%
vortex:parquet-zstd ratio compress time/Euro2016 0.254938346 / 0.257876844 / -1.1%
vortex:parquet-zstd ratio compress time/Food 0.69817292 / 0.711621739 / -1.9%
vortex:parquet-zstd ratio compress time/HashTags 1.09466654 / 1.10272937 / -0.7%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.370190405 / 0.372494436 / -0.6%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.369331188 / 0.372695247 / -0.9%
vortex:parquet-zstd ratio compress time/taxi 0.962869706 / 0.961675537 / +0.1%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.23508194 / 1.20694641 / +2.3%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.22494824 / 1.27691188 / -4.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.1252996 / 1.10017586 / +2.3%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.16607113 / 1.12890466 / +3.3%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.26176533 / 1.23769911 / +1.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.24929626 / 1.25141548 / -0.2%
vortex:parquet-zstd ratio decompress time/Arade 0.286640597 / 0.290763617 / -1.4%
vortex:parquet-zstd ratio decompress time/Bimbo 0.758096278 / 0.747444934 / +1.4%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.374654656 / 0.371571123 / +0.8%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0952941129 / 0.0947961727 / +0.5%
vortex:parquet-zstd ratio decompress time/Food 0.150298491 / 0.151856876 / -1.0%
vortex:parquet-zstd ratio decompress time/HashTags 0.0937557575 / 0.0940645135 / -0.3%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.178339846 / 0.179063316 / -0.4%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.181125792 / 0.178740522 / +1.3%
vortex:parquet-zstd ratio decompress time/taxi 0.167407932 / 0.162147592 / +3.2%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.683417255 / 0.687893596 / -0.7%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.698437743 / 0.775412301 / -9.9%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.565173377 / 0.553108993 / +2.2%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.563072852 / 0.551845281 / +2.0%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.561236604 / 0.558989208 / +0.4%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.559216903 / 0.564288356 / -0.9%
vortex:parquet-zstd size/Arade 0.551187395 / 0.551187395 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19261584 / 1.19261584 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11653605 / 1.11653605 / +0.0%
vortex:parquet-zstd size/Euro2016 1.33817223 / 1.33817223 / -0.0%
vortex:parquet-zstd size/Food 1.09109181 / 1.09109181 / -0.0%
vortex:parquet-zstd size/HashTags 1.4642021 / 1.4642021 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.12851233 / 1.12851233 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.12851233 / 1.12851233 / -0.0%
vortex:parquet-zstd size/taxi 0.904399792 / 0.904399792 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00318746 / 1.00318746 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00318746 / 1.00318746 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1.00138009 / 1.00138009 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1.00138009 / 1.00138009 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 1.00158589 / 1.00158589 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 1.00158589 / 1.00158589 / -0.0%
vortex / parquet / ns (0.996x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 731452817 / 733301098 / -0.3%
parquet_rs-zstd compress time/Bimbo 1994707556 / 1991253166 / +0.2%
parquet_rs-zstd compress time/CMSprovider 1059343102 / 1058847029 / +0.0%
parquet_rs-zstd compress time/Euro2016 642433348 / 641796888 / +0.1%
parquet_rs-zstd compress time/Food 319261463 / 319215199 / +0.0%
parquet_rs-zstd compress time/HashTags 342261207 / 341325216 / +0.3%
parquet_rs-zstd compress time/TPC-H l_comment canonical 1056440853 / 1054053717 / +0.2%
parquet_rs-zstd compress time/TPC-H l_comment chunked 1054202624 / 1054516015 / -0.0%
parquet_rs-zstd compress time/taxi 193609268 / 193397988 / +0.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3417804 / 3541801 / -3.5%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3433910 / 3448310 / -0.4%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 36207291 / 36782575 / -1.6%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 34940384 / 35976806 / -2.9%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 369105662 / 372777203 / -1.0%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 367005125 / 371792344 / -1.3%
parquet_rs-zstd decompress time/Arade 48924298 / 48950980 / -0.1%
parquet_rs-zstd decompress time/Bimbo 88557203 / 89156517 / -0.7%
parquet_rs-zstd decompress time/CMSprovider 102697979 / 102916165 / -0.2%
parquet_rs-zstd decompress time/Euro2016 149964647 / 150127812 / -0.1%
parquet_rs-zstd decompress time/Food 25067790 / 25124460 / -0.2%
parquet_rs-zstd decompress time/HashTags 419115562 / 419854699 / -0.2%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 82526930 / 82788269 / -0.3%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 82086222 / 82243779 / -0.2%
parquet_rs-zstd decompress time/taxi 58508775 / 58656215 / -0.3%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2045162 / 2048577 / -0.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2036989 / 2037832 / -0.0%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23584101 / 23661539 / -0.3%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23547857 / 23487567 / +0.3%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 252013778 / 254343778 / -0.9%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 254090803 / 250216074 / +1.5%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.995x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 96010284 / 96960971 / -1.0%
arrow-ipc compress time/Bimbo 604074200 / 610367280 / -1.0%
arrow-ipc compress time/CMSprovider 375175534 / 383013840 / -2.0%
arrow-ipc compress time/Euro2016 38268965 / 38507888 / -0.6%
arrow-ipc compress time/Food 39914036 / 40550020 / -1.6%
arrow-ipc compress time/HashTags 77778892 / 78121259 / -0.4%
arrow-ipc compress time/TPC-H l_comment canonical 129661410 / 128737477 / +0.7%
arrow-ipc compress time/TPC-H l_comment chunked 127838159 / 129655287 / -1.4%
arrow-ipc compress time/taxi 59141564 / 60011449 / -1.4%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 194536 / 198367 / -1.9%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 193382 / 200635 / -3.6%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2197556 / 2220755 / -1.0%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2170470 / 2196501 / -1.2%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 24709739 / 24904957 / -0.8%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 24780510 / 24905266 / -0.5%
arrow-ipc decompress time/Arade 217875401 / 212024179 / +2.8%
arrow-ipc decompress time/Bimbo 415105490 / 419039205 / -0.9%
arrow-ipc decompress time/CMSprovider 696371418 / 678945114 / +2.6%
arrow-ipc decompress time/Euro2016 85812743 / 83884817 / +2.3%
arrow-ipc decompress time/Food 67390366 / 66105025 / +1.9%
arrow-ipc decompress time/HashTags 164459356 / 161604300 / +1.8%
arrow-ipc decompress time/TPC-H l_comment canonical 189598652 / 191817503 / -1.2%
arrow-ipc decompress time/TPC-H l_comment chunked 189627645 / 191970678 / -1.2%
arrow-ipc decompress time/taxi 51210619 / 51285829 / -0.1%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 318480 / 320044 / -0.5%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 317650 / 317759 / -0.0%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3669057 / 3665271 / +0.1%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3706479 / 3695227 / +0.3%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 35982486 / 37117166 / -3.1%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 36432371 / 36861474 / -1.2%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 680639722 / 680639722 / +0.0%
arrow-ipc size/Bimbo 3168319202 / 3168319202 / +0.0%
arrow-ipc size/CMSprovider 2394412322 / 2394412322 / +0.0%
arrow-ipc size/Euro2016 359300042 / 359300042 / +0.0%
arrow-ipc size/Food 252069442 / 252069442 / +0.0%
arrow-ipc size/HashTags 700364562 / 700364562 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 1021072290 / 1021072290 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 1021072290 / 1021072290 / +0.0%
arrow-ipc size/taxi 474481242 / 474481242 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 123192506 / 123192506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 123192506 / 123192506 / +0.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR e42f8876 vs base 2a9c7628


vortex / vortex-file-compressed / ms (1.000x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/amazon/book_reviews/fsst 41.494388 / 41.425573 / +0.2%
read/amazon/book_reviews/onpair-12 30.392587 / 30.456817 / -0.2%
read/amazon/book_reviews/onpair-16 33.874096 / 33.891484 / -0.1%
read/amazon/book_titles/fsst 3.443107 / 3.439866 / +0.1%
read/amazon/book_titles/onpair-12 3.137449 / 3.12664 / +0.3%
read/amazon/book_titles/onpair-16 3.017766 / 3.018159 / -0.0%
read/clickbench/URL/shard-0/fsst 31.799755 / 31.855382 / -0.2%
read/clickbench/URL/shard-0/onpair-12 18.974873 / 19.028271 / -0.3%
read/clickbench/URL/shard-0/onpair-16 18.06416 / 18.200764 / -0.8%
read/fineweb/text/fsst 10.371166 / 10.370255 / +0.0%
read/fineweb/text/onpair-12 9.679484 / 9.621927 / +0.6%
read/fineweb/text/onpair-16 8.506904 / 8.458859 / +0.6%
read/news/headlines/fsst 17.699104 / 17.768773 / -0.4%
read/news/headlines/onpair-12 16.886559 / 16.930312 / -0.3%
read/news/headlines/onpair-16 15.956533 / 15.998964 / -0.3%
read/tpch/l_comment/fsst 50.939487 / 50.882439 / +0.1%
read/tpch/l_comment/onpair-12 42.699869 / 42.765965 / -0.2%
read/tpch/l_comment/onpair-16 42.628411 / 42.669344 / -0.1%
read/twitter/sentiment140/fsst 36.886645 / 36.822251 / +0.2%
read/twitter/sentiment140/onpair-12 33.636072 / 33.58903 / +0.1%
read/twitter/sentiment140/onpair-16 33.575321 / 33.493973 / +0.2%
write/amazon/book_reviews/fsst 554.310975 / 553.603391 / +0.1%
write/amazon/book_reviews/onpair-12 983.911989 / 984.558728 / -0.1%
write/amazon/book_reviews/onpair-16 987.431523 / 986.243038 / +0.1%
write/amazon/book_titles/fsst 57.885118 / 57.904423 / -0.0%
write/amazon/book_titles/onpair-12 89.483614 / 89.511694 / -0.0%
write/amazon/book_titles/onpair-16 92.491849 / 92.547814 / -0.1%
write/clickbench/URL/shard-0/fsst 433.604631 / 435.119002 / -0.3%
write/clickbench/URL/shard-0/onpair-12 609.855467 / 611.313208 / -0.2%
write/clickbench/URL/shard-0/onpair-16 617.534674 / 618.909562 / -0.2%
write/fineweb/text/fsst 213.23135 / 213.427292 / -0.1%
write/fineweb/text/onpair-12 511.998479 / 512.31718 / -0.1%
write/fineweb/text/onpair-16 524.8377 / 525.974457 / -0.2%
write/news/headlines/fsst 335.564992 / 335.394569 / +0.1%
write/news/headlines/onpair-12 472.755746 / 472.852269 / -0.0%
write/news/headlines/onpair-16 484.640255 / 484.223932 / +0.1%
write/tpch/l_comment/fsst 1072.99075 / 1072.57905 / +0.0%
write/tpch/l_comment/onpair-12 1047.09729 / 1047.98903 / -0.1%
write/tpch/l_comment/onpair-16 1061.20061 / 1061.85803 / -0.1%
write/twitter/sentiment140/fsst 556.691736 / 556.055977 / +0.1%
write/twitter/sentiment140/onpair-12 953.444617 / 952.590986 / +0.1%
write/twitter/sentiment140/onpair-16 1040.31677 / 1038.87788 / +0.1%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/amazon/book_reviews/fsst 52.0932297 / 52.0932297 / +0.0%
size/amazon/book_reviews/onpair-12 38.2297968 / 38.2297968 / +0.0%
size/amazon/book_reviews/onpair-16 37.9346843 / 37.9346843 / +0.0%
size/amazon/book_titles/fsst 50.779364 / 50.779364 / +0.0%
size/amazon/book_titles/onpair-12 44.5264018 / 44.5264018 / +0.0%
size/amazon/book_titles/onpair-16 45.7158264 / 45.7158264 / +0.0%
size/clickbench/URL/shard-0/fsst 47.2486457 / 47.2486457 / +0.0%
size/clickbench/URL/shard-0/onpair-12 28.3413513 / 28.3413513 / +0.0%
size/clickbench/URL/shard-0/onpair-16 28.6933028 / 28.6933028 / +0.0%
size/fineweb/text/fsst 55.9882316 / 55.9882316 / +0.0%
size/fineweb/text/onpair-12 44.3843629 / 44.3843629 / +0.0%
size/fineweb/text/onpair-16 40.162824 / 40.162824 / +0.0%
size/news/headlines/fsst 43.8568018 / 43.8568018 / +0.0%
size/news/headlines/onpair-12 37.7869807 / 37.7869807 / +0.0%
size/news/headlines/onpair-16 38.4686211 / 38.4686211 / +0.0%
size/tpch/l_comment/fsst 30.1176704 / 30.1176704 / +0.0%
size/tpch/l_comment/onpair-12 23.0416159 / 23.0416159 / +0.0%
size/tpch/l_comment/onpair-16 23.0561301 / 23.0561301 / +0.0%
size/twitter/sentiment140/fsst 51.8203241 / 51.8203241 / +0.0%
size/twitter/sentiment140/onpair-12 44.1542181 / 44.1542181 / +0.0%
size/twitter/sentiment140/onpair-16 46.0840466 / 46.0840466 / +0.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR e42f8876 vs base 6cc1b921
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.5%
Engines: DataFusion No clear signal (-7.6%, environment too noisy confidence) · DuckDB No clear signal (+0.8%, environment too noisy confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.014x ➖
Parquet (geomean): hot 1.031x ➖ · cold 1.083x ➖
Shifts: Parquet (control) +3.1% · Median polish +0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 353069156 / 346743878 / +1.8% 1151202881 / 1014095571 / +13.5% 0.31 / 0.34 / -10.3%
tpch_q02/datafusion:vortex-file-compressed 515703187 / 516705712 / -0.2% 1019004030 / 1249965051 / -18.5% 0.51 / 0.41 / +22.4%
tpch_q03/datafusion:vortex-file-compressed 562763821 / 632758663 / -11.1% 1839747579 / 1424744444 / +29.1% 0.31 / 0.44 / -31.1%
tpch_q04/datafusion:vortex-file-compressed 432856736 / 560718011 / -22.8% 675094158 / 868216458 / -22.2% 0.64 / 0.65 / -0.7%
tpch_q05/datafusion:vortex-file-compressed 781992253 / 863249781 / -9.4% 965304852 / 1165073481 / -17.1% 0.81 / 0.74 / +9.3%
tpch_q06/datafusion:vortex-file-compressed 428147119 / 323205684 / +32.5% 🔴 630968516 / 450499128 / +40.1% 🔴 0.68 / 0.72 / -5.4%
tpch_q07/datafusion:vortex-file-compressed 932380932 / 827166156 / +12.7% 1230679799 / 1039103466 / +18.4% 0.76 / 0.80 / -4.8%
tpch_q08/datafusion:vortex-file-compressed 1007463116 / 1113389288 / -9.5% 1203686174 / 1239670404 / -2.9% 0.84 / 0.90 / -6.8%
tpch_q09/datafusion:vortex-file-compressed 1364817592 / 1162945615 / +17.4% 1505677321 / 1168815263 / +28.8% 0.91 / 0.99 / -8.9%
tpch_q10/datafusion:vortex-file-compressed 629980760 / 956798476 / -34.2% 🟢 935273726 / 1050241627 / -10.9% 0.67 / 0.91 / -26.1%
tpch_q11/datafusion:vortex-file-compressed 359048089 / 449193836 / -20.1% 658164688 / 676860683 / -2.8% 0.55 / 0.66 / -17.8%
tpch_q12/datafusion:vortex-file-compressed 396827521 / 521030418 / -23.8% 595818804 / 634788066 / -6.1% 0.67 / 0.82 / -18.9%
tpch_q13/datafusion:vortex-file-compressed 336849067 / 249510486 / +35.0% 🔴 517148949 / 622764331 / -17.0% 0.65 / 0.40 / +62.6%
tpch_q14/datafusion:vortex-file-compressed 377523171 / 331630387 / +13.8% 455255939 / 523628084 / -13.1% 0.83 / 0.63 / +30.9%
tpch_q15/datafusion:vortex-file-compressed 589078137 / 730092520 / -19.3% 926282596 / 1100034867 / -15.8% 0.64 / 0.66 / -4.2%
tpch_q16/datafusion:vortex-file-compressed 302242780 / 292835360 / +3.2% 504898505 / 434950134 / +16.1% 0.60 / 0.67 / -11.1%
tpch_q17/datafusion:vortex-file-compressed 817860086 / 819236700 / -0.2% 1012059810 / 1059856455 / -4.5% 0.81 / 0.77 / +4.5%
tpch_q18/datafusion:vortex-file-compressed 924931106 / 993202933 / -6.9% 984780936 / 1149732790 / -14.3% 0.94 / 0.86 / +8.7%
tpch_q19/datafusion:vortex-file-compressed 414927117 / 430597018 / -3.6% 883285731 / 550342586 / +60.5% 🔴 0.47 / 0.78 / -40.0%
tpch_q20/datafusion:vortex-file-compressed 936088114 / 551930904 / +69.6% 🔴 1069626825 / 988960733 / +8.2% 0.88 / 0.56 / +56.8%
tpch_q21/datafusion:vortex-file-compressed 1058651346 / 1069595165 / -1.0% 1093715203 / 1133778018 / -3.5% 0.97 / 0.94 / +2.6%
tpch_q22/datafusion:vortex-file-compressed 379288997 / 316593076 / +19.8% 628107065 / 539694493 / +16.4% 0.60 / 0.59 / +2.9%
datafusion / vortex-compact / ns (1.020x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 369755109 / 329475614 / +12.2% 958197777 / 1007358547 / -4.9% 0.39 / 0.33 / +18.0%
tpch_q02/datafusion:vortex-compact 605316842 / 555959364 / +8.9% 1145249109 / 1056058992 / +8.4% 0.53 / 0.53 / +0.4%
tpch_q03/datafusion:vortex-compact 554611979 / 529517222 / +4.7% 1335763618 / 1351777643 / -1.2% 0.42 / 0.39 / +6.0%
tpch_q04/datafusion:vortex-compact 413286892 / 416797828 / -0.8% 541403657 / 570092013 / -5.0% 0.76 / 0.73 / +4.4%
tpch_q05/datafusion:vortex-compact 795117876 / 715801241 / +11.1% 1213389396 / 1004132836 / +20.8% 0.66 / 0.71 / -8.1%
tpch_q06/datafusion:vortex-compact 266268665 / 250154482 / +6.4% 413622552 / 456283327 / -9.3% 0.64 / 0.55 / +17.4%
tpch_q07/datafusion:vortex-compact 669502950 / 682881682 / -2.0% 867284527 / 914900366 / -5.2% 0.77 / 0.75 / +3.4%
tpch_q08/datafusion:vortex-compact 1136413852 / 1036416082 / +9.6% 1149618798 / 1058538614 / +8.6% 0.99 / 0.98 / +1.0%
tpch_q09/datafusion:vortex-compact 826379743 / 760406676 / +8.7% 1173186677 / 1058205555 / +10.9% 0.70 / 0.72 / -2.0%
tpch_q10/datafusion:vortex-compact 690618778 / 635715217 / +8.6% 1633062633 / 1028126323 / +58.8% 🔴 0.42 / 0.62 / -31.6%
tpch_q11/datafusion:vortex-compact 504687995 / 486737906 / +3.7% 685033599 / 929470989 / -26.3% 0.74 / 0.52 / +40.7%
tpch_q12/datafusion:vortex-compact 308889333 / 403926562 / -23.5% 466827953 / 435908800 / +7.1% 0.66 / 0.93 / -28.6%
tpch_q13/datafusion:vortex-compact 356995720 / 364544401 / -2.1% 612539073 / 576875670 / +6.2% 0.58 / 0.63 / -7.8%
tpch_q14/datafusion:vortex-compact 382574592 / 310128454 / +23.4% 518470864 / 484617054 / +7.0% 0.74 / 0.64 / +15.3%
tpch_q15/datafusion:vortex-compact 579195612 / 578671381 / +0.1% 826450091 / 796981273 / +3.7% 0.70 / 0.73 / -3.5%
tpch_q16/datafusion:vortex-compact 256360776 / 263556958 / -2.7% 429893326 / 435351618 / -1.3% 0.60 / 0.61 / -1.5%
tpch_q17/datafusion:vortex-compact 747975791 / 806557551 / -7.3% 931157538 / 902796599 / +3.1% 0.80 / 0.89 / -10.1%
tpch_q18/datafusion:vortex-compact 608869100 / 968443636 / -37.1% 🟢 934599078 / 1146714314 / -18.5% 0.65 / 0.84 / -22.9%
tpch_q19/datafusion:vortex-compact 420683462 / 392478173 / +7.2% 580271440 / 700588699 / -17.2% 0.72 / 0.56 / +29.4%
tpch_q20/datafusion:vortex-compact 671934319 / 629829701 / +6.7% 787929522 / 780803398 / +0.9% 0.85 / 0.81 / +5.7%
tpch_q21/datafusion:vortex-compact 965084163 / 944225698 / +2.2% 1091587443 / 940640560 / +16.0% 0.88 / 1.00 / -11.9%
tpch_q22/datafusion:vortex-compact 390442254 / 303471610 / +28.7% 689328422 / 977860656 / -29.5% 0.57 / 0.31 / +82.5%
datafusion / parquet / ns (1.092x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 249651825 / 235004736 / +6.2% 700993533 / 708291435 / -1.0% 0.36 / 0.33 / +7.3%
tpch_q02/datafusion:parquet 508271370 / 448963607 / +13.2% 1050101977 / 1125821958 / -6.7% 0.48 / 0.40 / +21.4%
tpch_q03/datafusion:parquet 890678842 / 515454362 / +72.8% 🔴 1193978095 / 1038999178 / +14.9% 0.75 / 0.50 / +50.4%
tpch_q04/datafusion:parquet 401276739 / 407684123 / -1.6% 514728425 / 609652679 / -15.6% 0.78 / 0.67 / +16.6%
tpch_q05/datafusion:parquet 715610591 / 580845965 / +23.2% 1432844202 / 957354731 / +49.7% 🔴 0.50 / 0.61 / -17.7%
tpch_q06/datafusion:parquet 225017442 / 189274257 / +18.9% 357766150 / 547734829 / -34.7% 🟢 0.63 / 0.35 / +82.0%
tpch_q07/datafusion:parquet 594146876 / 666459733 / -10.9% 928246729 / 855628498 / +8.5% 0.64 / 0.78 / -17.8%
tpch_q08/datafusion:parquet 1230376379 / 736657839 / +67.0% 🔴 1751781108 / 999656644 / +75.2% 🔴 0.70 / 0.74 / -4.7%
tpch_q09/datafusion:parquet 949117980 / 1259926864 / -24.7% 1166988579 / 1598610728 / -27.0% 0.81 / 0.79 / +3.2%
tpch_q10/datafusion:parquet 1419686564 / 1633727320 / -13.1% 1781139035 / 1437485676 / +23.9% 0.80 / 1.14 / -29.9%
tpch_q11/datafusion:parquet 611721432 / 422103104 / +44.9% 🔴 658668386 / 574243629 / +14.7% 0.93 / 0.74 / +26.3%
tpch_q12/datafusion:parquet 363705888 / 373802714 / -2.7% 530248724 / 519401660 / +2.1% 0.69 / 0.72 / -4.7%
tpch_q13/datafusion:parquet 451191796 / 421973307 / +6.9% 802353361 / 686871316 / +16.8% 0.56 / 0.61 / -8.5%
tpch_q14/datafusion:parquet 392916647 / 389926991 / +0.8% 533860566 / 650715086 / -18.0% 0.74 / 0.60 / +22.8%
tpch_q15/datafusion:parquet 637333379 / 625939367 / +1.8% 889647088 / 964750834 / -7.8% 0.72 / 0.65 / +10.4%
tpch_q16/datafusion:parquet 233337974 / 216958397 / +7.5% 451525132 / 423487227 / +6.6% 0.52 / 0.51 / +0.9%
tpch_q17/datafusion:parquet 630568660 / 621198946 / +1.5% 750437620 / 772798115 / -2.9% 0.84 / 0.80 / +4.5%
tpch_q18/datafusion:parquet 588605754 / 608104201 / -3.2% 913531427 / 807134341 / +13.2% 0.64 / 0.75 / -14.5%
tpch_q19/datafusion:parquet 452163403 / 452609898 / -0.1% 540163045 / 481180240 / +12.3% 0.84 / 0.94 / -11.0%
tpch_q20/datafusion:parquet 813821655 / 678010987 / +20.0% 884553044 / 832005818 / +6.3% 0.92 / 0.81 / +12.9%
tpch_q21/datafusion:parquet 1085921597 / 908815704 / +19.5% 1198576354 / 1004709207 / +19.3% 0.91 / 0.90 / +0.2%
tpch_q22/datafusion:parquet 422547328 / 419723497 / +0.7% 679091407 / 640645483 / +6.0% 0.62 / 0.66 / -5.0%
duckdb / vortex-file-compressed / ns (0.946x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 1007278247 / 1025114139 / -1.7% 1719133788 / 1266138738 / +35.8% 🔴 0.59 / 0.81 / -27.6%
tpch_q02/duckdb:vortex-file-compressed 562088773 / 897260476 / -37.4% 🟢 727932003 / 986756643 / -26.2% 0.77 / 0.91 / -15.1%
tpch_q03/duckdb:vortex-file-compressed 1343256164 / 1552319225 / -13.5% 2051935546 / 1878110541 / +9.3% 0.65 / 0.83 / -20.8%
tpch_q04/duckdb:vortex-file-compressed 1005106431 / 1110315226 / -9.5% 1262916151 / 1289298459 / -2.0% 0.80 / 0.86 / -7.6%
tpch_q05/duckdb:vortex-file-compressed 1066689956 / 1165089385 / -8.4% 1280536922 / 1464412094 / -12.6% 0.83 / 0.80 / +4.7%
tpch_q06/duckdb:vortex-file-compressed 815624023 / 837221263 / -2.6% 917776153 / 966139305 / -5.0% 0.89 / 0.87 / +2.6%
tpch_q07/duckdb:vortex-file-compressed 1240541762 / 1260749228 / -1.6% 1449718358 / 1435978039 / +1.0% 0.86 / 0.88 / -2.5%
tpch_q08/duckdb:vortex-file-compressed 1616551563 / 1566310328 / +3.2% 1708326437 / 1561266679 / +9.4% 0.95 / 1.00 / -5.7%
tpch_q09/duckdb:vortex-file-compressed 1499589226 / 1335276648 / +12.3% 1664777269 / 1555365275 / +7.0% 0.90 / 0.86 / +4.9%
tpch_q10/duckdb:vortex-file-compressed 1528415258 / 1450181789 / +5.4% 1877978963 / 1723297673 / +9.0% 0.81 / 0.84 / -3.3%
tpch_q11/duckdb:vortex-file-compressed 352128370 / 496916436 / -29.1% 401221062 / 511883192 / -21.6% 0.88 / 0.97 / -9.6%
tpch_q12/duckdb:vortex-file-compressed 971244184 / 993691241 / -2.3% 1143190031 / 1215642693 / -6.0% 0.85 / 0.82 / +3.9%
tpch_q13/duckdb:vortex-file-compressed 509265946 / 406699975 / +25.2% 600855509 / 676145914 / -11.1% 0.85 / 0.60 / +40.9%
tpch_q14/duckdb:vortex-file-compressed 1037540120 / 1007331977 / +3.0% 1306809070 / 1084478594 / +20.5% 0.79 / 0.93 / -14.5%
tpch_q15/duckdb:vortex-file-compressed 838051764 / 991888938 / -15.5% 1006682408 / 1061276873 / -5.1% 0.83 / 0.93 / -10.9%
tpch_q16/duckdb:vortex-file-compressed 365349755 / 314159782 / +16.3% 467778640 / 319007398 / +46.6% 🔴 0.78 / 0.98 / -20.7%
tpch_q17/duckdb:vortex-file-compressed 1279771577 / 1397695226 / -8.4% 1168610476 / 1364147633 / -14.3% 1.10 / 1.02 / +6.9%
tpch_q18/duckdb:vortex-file-compressed 1151475567 / 1399493583 / -17.7% 1444409864 / 1599445547 / -9.7% 0.80 / 0.87 / -8.9%
tpch_q19/duckdb:vortex-file-compressed 1090915330 / 1136366393 / -4.0% 1313558222 / 1115325695 / +17.8% 0.83 / 1.02 / -18.5%
tpch_q20/duckdb:vortex-file-compressed 1077592650 / 1196508186 / -9.9% 1250261391 / 1721693141 / -27.4% 0.86 / 0.69 / +24.0%
tpch_q21/duckdb:vortex-file-compressed 2551986951 / 2620344207 / -2.6% 2601745345 / 2707726378 / -3.9% 0.98 / 0.97 / +1.4%
tpch_q22/duckdb:vortex-file-compressed 432197506 / 425399937 / +1.6% 595788838 / 594887844 / +0.2% 0.73 / 0.72 / +1.4%
duckdb / vortex-compact / ns (1.020x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1139919990 / 958638033 / +18.9% 1738034052 / 1375793444 / +26.3% 0.66 / 0.70 / -5.9%
tpch_q02/duckdb:vortex-compact 773732576 / 621620370 / +24.5% 647237753 / 644017439 / +0.5% 1.20 / 0.97 / +23.9%
tpch_q03/duckdb:vortex-compact 1195476584 / 1266136551 / -5.6% 1722909900 / 1999447812 / -13.8% 0.69 / 0.63 / +9.6%
tpch_q04/duckdb:vortex-compact 878983928 / 896195356 / -1.9% 1549501947 / 1399951971 / +10.7% 0.57 / 0.64 / -11.4%
tpch_q05/duckdb:vortex-compact 1137315285 / 974585287 / +16.7% 1315085878 / 1302130639 / +1.0% 0.86 / 0.75 / +15.5%
tpch_q06/duckdb:vortex-compact 804078918 / 766834253 / +4.9% 938531555 / 848532992 / +10.6% 0.86 / 0.90 / -5.2%
tpch_q07/duckdb:vortex-compact 1152796303 / 1164188866 / -1.0% 1453332188 / 1340082015 / +8.5% 0.79 / 0.87 / -8.7%
tpch_q08/duckdb:vortex-compact 1158915884 / 1256128984 / -7.7% 1487169540 / 1428784626 / +4.1% 0.78 / 0.88 / -11.4%
tpch_q09/duckdb:vortex-compact 1424548410 / 1337474110 / +6.5% 1686978324 / 1519538193 / +11.0% 0.84 / 0.88 / -4.1%
tpch_q10/duckdb:vortex-compact 1469088831 / 1448600490 / +1.4% 1834209661 / 1705852000 / +7.5% 0.80 / 0.85 / -5.7%
tpch_q11/duckdb:vortex-compact 351571049 / 404268750 / -13.0% 541299214 / 496303851 / +9.1% 0.65 / 0.81 / -20.3%
tpch_q12/duckdb:vortex-compact 945473868 / 892661721 / +5.9% 1369843485 / 1033094683 / +32.6% 🔴 0.69 / 0.86 / -20.1%
tpch_q13/duckdb:vortex-compact 657330533 / 380399002 / +72.8% 🔴 681259167 / 512576197 / +32.9% 🔴 0.96 / 0.74 / +30.0%
tpch_q14/duckdb:vortex-compact 915211852 / 940567129 / -2.7% 1085285640 / 1105121452 / -1.8% 0.84 / 0.85 / -0.9%
tpch_q15/duckdb:vortex-compact 816234870 / 834117352 / -2.1% 983413652 / 999616891 / -1.6% 0.83 / 0.83 / -0.5%
tpch_q16/duckdb:vortex-compact 299168755 / 300581245 / -0.5% 358132520 / 358430366 / -0.1% 0.84 / 0.84 / -0.4%
tpch_q17/duckdb:vortex-compact 1167633389 / 1224531331 / -4.6% 1183673358 / 1232092053 / -3.9% 0.99 / 0.99 / -0.7%
tpch_q18/duckdb:vortex-compact 1053509564 / 1204533199 / -12.5% 1134949522 / 1309485399 / -13.3% 0.93 / 0.92 / +0.9%
tpch_q19/duckdb:vortex-compact 1073336754 / 1196100700 / -10.3% 1341226782 / 1241877289 / +8.0% 0.80 / 0.96 / -16.9%
tpch_q20/duckdb:vortex-compact 1215350122 / 1063895085 / +14.2% 1416464982 / 1269401078 / +11.6% 0.86 / 0.84 / +2.4%
tpch_q21/duckdb:vortex-compact 2350438235 / 2377956907 / -1.2% 2705169146 / 2691946020 / +0.5% 0.87 / 0.88 / -1.6%
tpch_q22/duckdb:vortex-compact 393049314 / 539604867 / -27.2% 651402955 / 810777285 / -19.7% 0.60 / 0.67 / -9.3%
duckdb / parquet / ns (0.974x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 306061204 / 409679258 / -25.3% 386524514 / 416900103 / -7.3% 0.79 / 0.98 / -19.4%
tpch_q02/duckdb:parquet 546963001 / 641881930 / -14.8% 900699380 / 848069644 / +6.2% 0.61 / 0.76 / -19.8%
tpch_q03/duckdb:parquet 605733951 / 545782457 / +11.0% 1283384662 / 963110771 / +33.3% 🔴 0.47 / 0.57 / -16.7%
tpch_q04/duckdb:parquet 500313879 / 458438953 / +9.1% 1010639543 / 638509030 / +58.3% 🔴 0.50 / 0.72 / -31.1%
tpch_q05/duckdb:parquet 684952624 / 930199292 / -26.4% 938803808 / 897563747 / +4.6% 0.73 / 1.04 / -29.6%
tpch_q06/duckdb:parquet 245843931 / 295064725 / -16.7% 348205616 / 382893013 / -9.1% 0.71 / 0.77 / -8.4%
tpch_q07/duckdb:parquet 857605805 / 844837080 / +1.5% 1413763133 / 760342146 / +85.9% 🔴 0.61 / 1.11 / -45.4%
tpch_q08/duckdb:parquet 976537313 / 1042370214 / -6.3% 1085236742 / 1093909760 / -0.8% 0.90 / 0.95 / -5.6%
tpch_q09/duckdb:parquet 1054356592 / 1059723097 / -0.5% 1166708271 / 1249402792 / -6.6% 0.90 / 0.85 / +6.5%
tpch_q10/duckdb:parquet 876473479 / 975058118 / -10.1% 1660365330 / 1100933319 / +50.8% 🔴 0.53 / 0.89 / -40.4%
tpch_q11/duckdb:parquet 435198958 / 339961504 / +28.0% 428772745 / 402743014 / +6.5% 1.01 / 0.84 / +20.2%
tpch_q12/duckdb:parquet 476826191 / 505930703 / -5.8% 560409277 / 654943837 / -14.4% 0.85 / 0.77 / +10.1%
tpch_q13/duckdb:parquet 636027767 / 583211702 / +9.1% 755132180 / 762860244 / -1.0% 0.84 / 0.76 / +10.2%
tpch_q14/duckdb:parquet 578374753 / 544197529 / +6.3% 662553234 / 568396563 / +16.6% 0.87 / 0.96 / -8.8%
tpch_q15/duckdb:parquet 393456680 / 418564479 / -6.0% 364242323 / 425907665 / -14.5% 1.08 / 0.98 / +9.9%
tpch_q16/duckdb:parquet 391708039 / 385431286 / +1.6% 444744498 / 392188265 / +13.4% 0.88 / 0.98 / -10.4%
tpch_q17/duckdb:parquet 615967320 / 441420248 / +39.5% 🔴 808098016 / 520809409 / +55.2% 🔴 0.76 / 0.85 / -10.1%
tpch_q18/duckdb:parquet 544844248 / 559810136 / -2.7% 679201831 / 531352074 / +27.8% 0.80 / 1.05 / -23.9%
tpch_q19/duckdb:parquet 596873051 / 655567722 / -9.0% 692215091 / 810732535 / -14.6% 0.86 / 0.81 / +6.6%
tpch_q20/duckdb:parquet 827938446 / 890760966 / -7.1% 997410293 / 1207407822 / -17.4% 0.83 / 0.74 / +12.5%
tpch_q21/duckdb:parquet 789285801 / 793422083 / -0.5% 851539474 / 791994124 / +7.5% 0.93 / 1.00 / -7.5%
tpch_q22/duckdb:parquet 556700500 / 613311846 / -9.2% 834843124 / 553132206 / +50.9% 🔴 0.67 / 1.11 / -39.9%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Commits: PR e42f8876 vs base e4dce8b7
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.1%
Engines: DataFusion No clear signal (-6.8%, medium confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 0.971x ➖ · cold 0.964x ➖
Parquet (geomean): hot 1.012x ➖ · cold 0.981x ➖
Shifts: Parquet (control) +1.2% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.940x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed 131924140 / 144937594 / -9.0% 553167665 / 504453830 / +9.7% 0.24 / 0.29 / -17.0%
vortex_q01/datafusion:vortex-file-compressed 123452861 / 111329150 / +10.9% 🔴 292850856 / 373549234 / -21.6% 🟢 0.42 / 0.30 / +41.4%
vortex_q02/datafusion:vortex-file-compressed 142177786 / 172902826 / -17.8% 🟢 281949141 / 302661984 / -6.8% 0.50 / 0.57 / -11.7%
datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet 135937758 / 134370732 / +1.2% 1255893508 / 1341084371 / -6.4% 0.11 / 0.10 / +8.0%
vortex_q01/datafusion:parquet 69601898 / 69246605 / +0.5% 118365069 / 118267898 / +0.1% 0.59 / 0.59 / +0.4%
vortex_q02/datafusion:parquet 291476006 / 289084341 / +0.8% 746245601 / 748114380 / -0.2% 0.39 / 0.39 / +1.1%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed 203404752 / 204271672 / -0.4% 972641821 / 1004633737 / -3.2% 0.21 / 0.20 / +2.9%
vortex_q01/duckdb:vortex-file-compressed 139984996 / 139687712 / +0.2% 579728580 / 582787500 / -0.5% 0.24 / 0.24 / +0.7%
vortex_q02/duckdb:vortex-file-compressed 202517577 / 200625402 / +0.9% 556186587 / 534214794 / +4.1% 0.36 / 0.38 / -3.0%
duckdb / parquet / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet 291781101 / 287337432 / +1.5% 891367817 / 993658020 / -10.3% 🟢 0.33 / 0.29 / +13.2%
vortex_q01/duckdb:parquet 174770318 / 170879899 / +2.3% 188671059 / 179033883 / +5.4% 0.93 / 0.95 / -2.9%
vortex_q02/duckdb:parquet 355236081 / 351464169 / +1.1% 702649628 / 695991369 / +1.0% 0.51 / 0.50 / +0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR e42f8876 vs base e4dce8b7
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.9%
Engines: DataFusion No clear signal (-5.9%, environment too noisy confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): hot 0.903x ➖ · cold 0.873x ➖
Parquet (geomean): hot 0.930x ➖ · cold 0.915x ➖
Shifts: Parquet (control) -7.0% · Median polish -7.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.792x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 41832984 / 44431674 / -5.8% 182616445 / 202578392 / -9.9% 0.23 / 0.22 / +4.4%
fineweb_q01/datafusion:vortex-file-compressed 268784970 / 392600933 / -31.5% 🟢 695368351 / 738356696 / -5.8% 0.39 / 0.53 / -27.3%
fineweb_q02/datafusion:vortex-file-compressed 222018568 / 430583412 / -48.4% 🟢 350015284 / 689385611 / -49.2% 🟢 0.63 / 0.62 / +1.6%
fineweb_q03/datafusion:vortex-file-compressed 447724920 / 466169676 / -4.0% 631449540 / 753519318 / -16.2% 0.71 / 0.62 / +14.6%
fineweb_q04/datafusion:vortex-file-compressed 423232262 / 419035993 / +1.0% 450000959 / 518399820 / -13.2% 0.94 / 0.81 / +16.4%
fineweb_q05/datafusion:vortex-file-compressed 431979962 / 435218820 / -0.7% 478140898 / 530139185 / -9.8% 0.90 / 0.82 / +10.0%
fineweb_q06/datafusion:vortex-file-compressed 514960931 / 1047446066 / -50.8% 🟢 547105907 / 1291687868 / -57.6% 🟢 0.94 / 0.81 / +16.1%
fineweb_q07/datafusion:vortex-file-compressed 430039669 / 530986558 / -19.0% 465732172 / 465630250 / +0.0% 0.92 / 1.14 / -19.0%
fineweb_q08/datafusion:vortex-file-compressed 185248489 / 192071192 / -3.6% 225388983 / 306507874 / -26.5% 0.82 / 0.63 / +31.2%
datafusion / vortex-compact / ns (0.891x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 42733422 / 64271170 / -33.5% 🟢 125522281 / 121741481 / +3.1% 0.34 / 0.53 / -35.5%
fineweb_q01/datafusion:vortex-compact 361619799 / 488630562 / -26.0% 746331872 / 876827926 / -14.9% 0.48 / 0.56 / -13.1%
fineweb_q02/datafusion:vortex-compact 320186228 / 385896192 / -17.0% 426673116 / 524706977 / -18.7% 0.75 / 0.74 / +2.0%
fineweb_q03/datafusion:vortex-compact 500624133 / 598276317 / -16.3% 544034205 / 1109376445 / -51.0% 🟢 0.92 / 0.54 / +70.6%
fineweb_q04/datafusion:vortex-compact 533434580 / 451456230 / +18.2% 590060101 / 487719951 / +21.0% 0.90 / 0.93 / -2.3%
fineweb_q05/datafusion:vortex-compact 502447665 / 472909890 / +6.2% 628612258 / 548514395 / +14.6% 0.80 / 0.86 / -7.3%
fineweb_q06/datafusion:vortex-compact 608448367 / 663558456 / -8.3% 711762247 / 891479501 / -20.2% 0.85 / 0.74 / +14.8%
fineweb_q07/datafusion:vortex-compact 505452352 / 495792041 / +1.9% 526764534 / 517989793 / +1.7% 0.96 / 0.96 / +0.3%
fineweb_q08/datafusion:vortex-compact 146617502 / 166352544 / -11.9% 181096961 / 181817937 / -0.4% 0.81 / 0.91 / -11.5%
datafusion / parquet / ns (0.893x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 531433509 / 637770726 / -16.7% 851890799 / 1019905122 / -16.5% 0.62 / 0.63 / -0.2%
fineweb_q01/datafusion:parquet 726352286 / 845520625 / -14.1% 681856051 / 705148462 / -3.3% 1.07 / 1.20 / -11.2%
fineweb_q02/datafusion:parquet 743471746 / 817651456 / -9.1% 648344991 / 903176761 / -28.2% 1.15 / 0.91 / +26.7%
fineweb_q03/datafusion:parquet 863586245 / 784173974 / +10.1% 879607995 / 1072765264 / -18.0% 0.98 / 0.73 / +34.3%
fineweb_q04/datafusion:parquet 817806763 / 787491474 / +3.8% 958664228 / 752410139 / +27.4% 0.85 / 1.05 / -18.5%
fineweb_q05/datafusion:parquet 753439142 / 887997192 / -15.2% 705008675 / 877114280 / -19.6% 1.07 / 1.01 / +5.6%
fineweb_q06/datafusion:parquet 716073536 / 918642794 / -22.1% 702850525 / 866933402 / -18.9% 1.02 / 1.06 / -3.9%
fineweb_q07/datafusion:parquet 805900352 / 907568030 / -11.2% 756541049 / 848713126 / -10.9% 1.07 / 1.07 / -0.4%
fineweb_q08/datafusion:parquet 756962985 / 915447420 / -17.3% 758835092 / 840457190 / -9.7% 1.00 / 1.09 / -8.4%
duckdb / vortex-file-compressed / ns (1.050x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 80889830 / 75054426 / +7.8% 63357145 / 91089358 / -30.4% 🟢 1.28 / 0.82 / +54.9%
fineweb_q01/duckdb:vortex-file-compressed 468700258 / 479800938 / -2.3% 422797637 / 475693919 / -11.1% 1.11 / 1.01 / +9.9%
fineweb_q02/duckdb:vortex-file-compressed 651367947 / 550649356 / +18.3% 599265833 / 672158136 / -10.8% 1.09 / 0.82 / +32.7%
fineweb_q03/duckdb:vortex-file-compressed 1012299072 / 1094721018 / -7.5% 1125839474 / 1145932977 / -1.8% 0.90 / 0.96 / -5.9%
fineweb_q04/duckdb:vortex-file-compressed 1034148584 / 1030796430 / +0.3% 973181757 / 1078964997 / -9.8% 1.06 / 0.96 / +11.2%
fineweb_q05/duckdb:vortex-file-compressed 931086918 / 891427650 / +4.4% 1056676782 / 945597039 / +11.7% 0.88 / 0.94 / -6.5%
fineweb_q06/duckdb:vortex-file-compressed 1181118623 / 1161136304 / +1.7% 1179220552 / 1159364860 / +1.7% 1.00 / 1.00 / +0.0%
fineweb_q07/duckdb:vortex-file-compressed 1072137789 / 984551389 / +8.9% 1190830451 / 1058785713 / +12.5% 0.90 / 0.93 / -3.2%
fineweb_q08/duckdb:vortex-file-compressed 460024349 / 395324233 / +16.4% 503037736 / 481554996 / +4.5% 0.91 / 0.82 / +11.4%
duckdb / vortex-compact / ns (0.899x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 67725034 / 65806134 / +2.9% 68846119 / 106919627 / -35.6% 🟢 0.98 / 0.62 / +59.8%
fineweb_q01/duckdb:vortex-compact 385836066 / 480958639 / -19.8% 422968641 / 440933324 / -4.1% 0.91 / 1.09 / -16.4%
fineweb_q02/duckdb:vortex-compact 695444236 / 952053593 / -27.0% 585185073 / 599109307 / -2.3% 1.19 / 1.59 / -25.2%
fineweb_q03/duckdb:vortex-compact 1090319093 / 1075012473 / +1.4% 1151580950 / 1287479277 / -10.6% 0.95 / 0.83 / +13.4%
fineweb_q04/duckdb:vortex-compact 1087607044 / 1264369820 / -14.0% 1146454117 / 1255241151 / -8.7% 0.95 / 1.01 / -5.8%
fineweb_q05/duckdb:vortex-compact 895909087 / 908252088 / -1.4% 1156964345 / 1058576879 / +9.3% 0.77 / 0.86 / -9.7%
fineweb_q06/duckdb:vortex-compact 1033009716 / 1162419529 / -11.1% 1111133366 / 1196569084 / -7.1% 0.93 / 0.97 / -4.3%
fineweb_q07/duckdb:vortex-compact 944560940 / 1028490335 / -8.2% 1064711378 / 991806638 / +7.4% 0.89 / 1.04 / -14.4%
fineweb_q08/duckdb:vortex-compact 363251940 / 401585193 / -9.5% 419325051 / 677278758 / -38.1% 🟢 0.87 / 0.59 / +46.1%
duckdb / parquet / ns (0.969x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 314712457 / 334681374 / -6.0% 400434393 / 393014253 / +1.9% 0.79 / 0.85 / -7.7%
fineweb_q01/duckdb:parquet 533916376 / 457069850 / +16.8% 571212755 / 603060223 / -5.3% 0.93 / 0.76 / +23.3%
fineweb_q02/duckdb:parquet 501248042 / 540856568 / -7.3% 550719449 / 628888375 / -12.4% 0.91 / 0.86 / +5.8%
fineweb_q03/duckdb:parquet 782104935 / 680053244 / +15.0% 887464561 / 736402596 / +20.5% 0.88 / 0.92 / -4.6%
fineweb_q04/duckdb:parquet 712270076 / 800146448 / -11.0% 704725336 / 1050785014 / -32.9% 🟢 1.01 / 0.76 / +32.7%
fineweb_q05/duckdb:parquet 700203138 / 802883384 / -12.8% 737353779 / 848831306 / -13.1% 0.95 / 0.95 / +0.4%
fineweb_q06/duckdb:parquet 716247556 / 793050808 / -9.7% 854606292 / 860194115 / -0.6% 0.84 / 0.92 / -9.1%
fineweb_q07/duckdb:parquet 739951654 / 719285198 / +2.9% 801913312 / 765673103 / +4.7% 0.92 / 0.94 / -1.8%
fineweb_q08/duckdb:parquet 304348724 / 341187678 / -10.8% 410967563 / 398992381 / +3.0% 0.74 / 0.86 / -13.4%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR e42f8876 vs base e4dce8b7
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.2%
Engines: DataFusion No clear signal (-11.8%, environment too noisy confidence) · DuckDB No clear signal (-6.6%, environment too noisy confidence)
Vortex (geomean): hot 0.866x ➖ · cold 0.923x ➖
Parquet (geomean): hot 0.954x ➖ · cold 0.961x ➖
Shifts: Parquet (control) -4.6% · Median polish -7.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.812x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 243436646 / 252318706 / -3.5% 696822039 / 721967905 / -3.5% 0.35 / 0.35 / -0.0%
tpch_q02/datafusion:vortex-file-compressed 356757790 / 362397240 / -1.6% 708770638 / 772685510 / -8.3% 0.50 / 0.47 / +7.3%
tpch_q03/datafusion:vortex-file-compressed 374298004 / 439054430 / -14.7% 1163789414 / 1125793637 / +3.4% 0.32 / 0.39 / -17.5%
tpch_q04/datafusion:vortex-file-compressed 195360113 / 226516957 / -13.8% 427020472 / 670485382 / -36.3% 🟢 0.46 / 0.34 / +35.4%
tpch_q05/datafusion:vortex-file-compressed 418516197 / 462256955 / -9.5% 754814015 / 655532810 / +15.1% 0.55 / 0.71 / -21.4%
tpch_q06/datafusion:vortex-file-compressed 128097289 / 184092348 / -30.4% 🟢 263287428 / 351970105 / -25.2% 0.49 / 0.52 / -7.0%
tpch_q07/datafusion:vortex-file-compressed 436144130 / 520218033 / -16.2% 630486371 / 851750664 / -26.0% 0.69 / 0.61 / +13.3%
tpch_q08/datafusion:vortex-file-compressed 433444347 / 619189991 / -30.0% 690075796 / 725632307 / -4.9% 0.63 / 0.85 / -26.4%
tpch_q09/datafusion:vortex-file-compressed 308733491 / 349275672 / -11.6% 747697762 / 552481034 / +35.3% 🔴 0.41 / 0.63 / -34.7%
tpch_q10/datafusion:vortex-file-compressed 361162760 / 392457340 / -8.0% 679845777 / 569940788 / +19.3% 0.53 / 0.69 / -22.9%
tpch_q11/datafusion:vortex-file-compressed 270151816 / 349129311 / -22.6% 477182821 / 445172707 / +7.2% 0.57 / 0.78 / -27.8%
tpch_q12/datafusion:vortex-file-compressed 230841916 / 246516056 / -6.4% 405948916 / 600302877 / -32.4% 🟢 0.57 / 0.41 / +38.5%
tpch_q13/datafusion:vortex-file-compressed 129392102 / 137625019 / -6.0% 287936827 / 422300586 / -31.8% 🟢 0.45 / 0.33 / +37.9%
tpch_q14/datafusion:vortex-file-compressed 166633954 / 189432359 / -12.0% 353443843 / 359913304 / -1.8% 0.47 / 0.53 / -10.4%
tpch_q15/datafusion:vortex-file-compressed 305671096 / 394658290 / -22.5% 457566013 / 533557281 / -14.2% 0.67 / 0.74 / -9.7%
tpch_q16/datafusion:vortex-file-compressed 127193736 / 196123916 / -35.1% 🟢 308078290 / 269928546 / +14.1% 0.41 / 0.73 / -43.2%
tpch_q17/datafusion:vortex-file-compressed 241749781 / 333869135 / -27.6% 525756303 / 824514056 / -36.2% 🟢 0.46 / 0.40 / +13.6%
tpch_q18/datafusion:vortex-file-compressed 253017027 / 687407189 / -63.2% 🟢 398635362 / 1138273564 / -65.0% 🟢 0.63 / 0.60 / +5.1%
tpch_q19/datafusion:vortex-file-compressed 245771512 / 287675105 / -14.6% 395408738 / 417014963 / -5.2% 0.62 / 0.69 / -9.9%
tpch_q20/datafusion:vortex-file-compressed 285780202 / 298085290 / -4.1% 453374168 / 461692875 / -1.8% 0.63 / 0.65 / -2.4%
tpch_q21/datafusion:vortex-file-compressed 465199429 / 518039523 / -10.2% 715625136 / 734539368 / -2.6% 0.65 / 0.71 / -7.8%
tpch_q22/datafusion:vortex-file-compressed 151951742 / 186397294 / -18.5% 411031106 / 515337092 / -20.2% 0.37 / 0.36 / +2.2%
datafusion / vortex-compact / ns (0.877x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 237578605 / 245707518 / -3.3% 779384919 / 751271149 / +3.7% 0.30 / 0.33 / -6.8%
tpch_q02/datafusion:vortex-compact 345755809 / 333791174 / +3.6% 862689969 / 655590983 / +31.6% 🔴 0.40 / 0.51 / -21.3%
tpch_q03/datafusion:vortex-compact 330157791 / 346560810 / -4.7% 741757373 / 762547222 / -2.7% 0.45 / 0.45 / -2.1%
tpch_q04/datafusion:vortex-compact 159549572 / 177966148 / -10.3% 353991560 / 411445565 / -14.0% 0.45 / 0.43 / +4.2%
tpch_q05/datafusion:vortex-compact 386168503 / 399971353 / -3.5% 733337664 / 773598111 / -5.2% 0.53 / 0.52 / +1.8%
tpch_q06/datafusion:vortex-compact 150006264 / 263377897 / -43.0% 🟢 327612977 / 346967171 / -5.6% 0.46 / 0.76 / -39.7%
tpch_q07/datafusion:vortex-compact 373907086 / 434259803 / -13.9% 546359771 / 660102210 / -17.2% 0.68 / 0.66 / +4.0%
tpch_q08/datafusion:vortex-compact 407083891 / 412941284 / -1.4% 739807465 / 595984241 / +24.1% 0.55 / 0.69 / -20.6%
tpch_q09/datafusion:vortex-compact 268203846 / 484167568 / -44.6% 🟢 443041526 / 539426303 / -17.9% 0.61 / 0.90 / -32.6%
tpch_q10/datafusion:vortex-compact 350708592 / 373906167 / -6.2% 586685076 / 471163912 / +24.5% 0.60 / 0.79 / -24.7%
tpch_q11/datafusion:vortex-compact 251047367 / 265929297 / -5.6% 439495906 / 427472907 / +2.8% 0.57 / 0.62 / -8.2%
tpch_q12/datafusion:vortex-compact 197451961 / 187500979 / +5.3% 358130447 / 305384232 / +17.3% 0.55 / 0.61 / -10.2%
tpch_q13/datafusion:vortex-compact 117384273 / 123959306 / -5.3% 377120454 / 335425917 / +12.4% 0.31 / 0.37 / -15.8%
tpch_q14/datafusion:vortex-compact 176458001 / 228444715 / -22.8% 383228107 / 308245676 / +24.3% 0.46 / 0.74 / -37.9%
tpch_q15/datafusion:vortex-compact 339094016 / 315130656 / +7.6% 512439353 / 632542196 / -19.0% 0.66 / 0.50 / +32.8%
tpch_q16/datafusion:vortex-compact 134735084 / 152389925 / -11.6% 305627600 / 251090666 / +21.7% 0.44 / 0.61 / -27.4%
tpch_q17/datafusion:vortex-compact 236519549 / 283952409 / -16.7% 536217607 / 449275557 / +19.4% 0.44 / 0.63 / -30.2%
tpch_q18/datafusion:vortex-compact 246820489 / 359335891 / -31.3% 🟢 405574514 / 549680554 / -26.2% 0.61 / 0.65 / -6.9%
tpch_q19/datafusion:vortex-compact 249916813 / 291815976 / -14.4% 334887933 / 484208979 / -30.8% 🟢 0.75 / 0.60 / +23.8%
tpch_q20/datafusion:vortex-compact 261278643 / 289435380 / -9.7% 452737979 / 651594612 / -30.5% 🟢 0.58 / 0.44 / +29.9%
tpch_q21/datafusion:vortex-compact 419891377 / 508991044 / -17.5% 718211114 / 809064372 / -11.2% 0.58 / 0.63 / -7.1%
tpch_q22/datafusion:vortex-compact 180650577 / 169028227 / +6.9% 336411747 / 365870359 / -8.1% 0.54 / 0.46 / +16.2%
datafusion / parquet / ns (0.956x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 154165603 / 173350016 / -11.1% 550273011 / 533896368 / +3.1% 0.28 / 0.32 / -13.7%
tpch_q02/datafusion:parquet 282955927 / 291983032 / -3.1% 549471241 / 591713098 / -7.1% 0.51 / 0.49 / +4.4%
tpch_q03/datafusion:parquet 225863389 / 271089279 / -16.7% 645892831 / 777116006 / -16.9% 0.35 / 0.35 / +0.2%
tpch_q04/datafusion:parquet 150189455 / 155149936 / -3.2% 401178567 / 365764170 / +9.7% 0.37 / 0.42 / -11.7%
tpch_q05/datafusion:parquet 343107094 / 344613900 / -0.4% 540423539 / 474051756 / +14.0% 0.63 / 0.73 / -12.7%
tpch_q06/datafusion:parquet 130085573 / 137995794 / -5.7% 270809048 / 273088746 / -0.8% 0.48 / 0.51 / -4.9%
tpch_q07/datafusion:parquet 339647141 / 353847750 / -4.0% 453801176 / 530553096 / -14.5% 0.75 / 0.67 / +12.2%
tpch_q08/datafusion:parquet 422956379 / 454413998 / -6.9% 728209234 / 555999225 / +31.0% 🔴 0.58 / 0.82 / -28.9%
tpch_q09/datafusion:parquet 388450251 / 417123291 / -6.9% 567836124 / 839369051 / -32.3% 🟢 0.68 / 0.50 / +37.7%
tpch_q10/datafusion:parquet 325975795 / 312760623 / +4.2% 491522256 / 474341308 / +3.6% 0.66 / 0.66 / +0.6%
tpch_q11/datafusion:parquet 326115094 / 288766902 / +12.9% 1055969603 / 413074940 / +155.6% 🔴 0.31 / 0.70 / -55.8%
tpch_q12/datafusion:parquet 174506632 / 180075465 / -3.1% 370651461 / 374511749 / -1.0% 0.47 / 0.48 / -2.1%
tpch_q13/datafusion:parquet 290410609 / 287582781 / +1.0% 523943343 / 495117703 / +5.8% 0.55 / 0.58 / -4.6%
tpch_q14/datafusion:parquet 161537527 / 181192519 / -10.8% 338233213 / 340765749 / -0.7% 0.48 / 0.53 / -10.2%
tpch_q15/datafusion:parquet 310706220 / 397193321 / -21.8% 447194527 / 597758706 / -25.2% 0.69 / 0.66 / +4.6%
tpch_q16/datafusion:parquet 106368331 / 115202914 / -7.7% 187231017 / 249185877 / -24.9% 0.57 / 0.46 / +22.9%
tpch_q17/datafusion:parquet 268822953 / 305214779 / -11.9% 420950812 / 460600666 / -8.6% 0.64 / 0.66 / -3.6%
tpch_q18/datafusion:parquet 379804856 / 347808877 / +9.2% 705864265 / 478905958 / +47.4% 🔴 0.54 / 0.73 / -25.9%
tpch_q19/datafusion:parquet 189889731 / 183646441 / +3.4% 401349570 / 292384593 / +37.3% 🔴 0.47 / 0.63 / -24.7%
tpch_q20/datafusion:parquet 246920227 / 276822025 / -10.8% 370138440 / 444029927 / -16.6% 0.67 / 0.62 / +7.0%
tpch_q21/datafusion:parquet 309384901 / 306044024 / +1.1% 461586668 / 517594616 / -10.8% 0.67 / 0.59 / +13.4%
tpch_q22/datafusion:parquet 163266753 / 157174669 / +3.9% 400579267 / 347411279 / +15.3% 0.41 / 0.45 / -9.9%
duckdb / vortex-file-compressed / ns (0.920x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 246711285 / 255410313 / -3.4% 275254725 / 280824589 / -2.0% 0.90 / 0.91 / -1.5%
tpch_q02/duckdb:vortex-file-compressed 463064462 / 419851957 / +10.3% 488936898 / 526997579 / -7.2% 0.95 / 0.80 / +18.9%
tpch_q03/duckdb:vortex-file-compressed 448469255 / 401898807 / +11.6% 476401965 / 487846114 / -2.3% 0.94 / 0.82 / +14.3%
tpch_q04/duckdb:vortex-file-compressed 276842150 / 390430961 / -29.1% 303379483 / 374005706 / -18.9% 0.91 / 1.04 / -12.6%
tpch_q05/duckdb:vortex-file-compressed 760777262 / 650321656 / +17.0% 630427515 / 621268846 / +1.5% 1.21 / 1.05 / +15.3%
tpch_q06/duckdb:vortex-file-compressed 156925396 / 171784473 / -8.6% 186876107 / 245292798 / -23.8% 0.84 / 0.70 / +19.9%
tpch_q07/duckdb:vortex-file-compressed 464714118 / 525270510 / -11.5% 501800151 / 449630250 / +11.6% 0.93 / 1.17 / -20.7%
tpch_q08/duckdb:vortex-file-compressed 610593523 / 655308590 / -6.8% 674257333 / 643447135 / +4.8% 0.91 / 1.02 / -11.1%
tpch_q09/duckdb:vortex-file-compressed 396365261 / 451743689 / -12.3% 602342269 / 479277749 / +25.7% 0.66 / 0.94 / -30.2%
tpch_q10/duckdb:vortex-file-compressed 520467778 / 527475319 / -1.3% 543188366 / 563771575 / -3.7% 0.96 / 0.94 / +2.4%
tpch_q11/duckdb:vortex-file-compressed 317737811 / 338452979 / -6.1% 320812205 / 324730945 / -1.2% 0.99 / 1.04 / -5.0%
tpch_q12/duckdb:vortex-file-compressed 236221365 / 250522601 / -5.7% 374582232 / 267013854 / +40.3% 🔴 0.63 / 0.94 / -32.8%
tpch_q13/duckdb:vortex-file-compressed 270713231 / 291505096 / -7.1% 246732781 / 296014987 / -16.6% 1.10 / 0.98 / +11.4%
tpch_q14/duckdb:vortex-file-compressed 226614628 / 242005067 / -6.4% 280674703 / 301305453 / -6.8% 0.81 / 0.80 / +0.5%
tpch_q15/duckdb:vortex-file-compressed 259481982 / 237461722 / +9.3% 284045696 / 299362710 / -5.1% 0.91 / 0.79 / +15.2%
tpch_q16/duckdb:vortex-file-compressed 224031274 / 205006085 / +9.3% 284392694 / 243932522 / +16.6% 0.79 / 0.84 / -6.3%
tpch_q17/duckdb:vortex-file-compressed 332656500 / 356947592 / -6.8% 343528895 / 384935077 / -10.8% 0.97 / 0.93 / +4.4%
tpch_q18/duckdb:vortex-file-compressed 346945314 / 382345712 / -9.3% 584928020 / 383854206 / +52.4% 🔴 0.59 / 1.00 / -40.5%
tpch_q19/duckdb:vortex-file-compressed 268271548 / 293814733 / -8.7% 314933061 / 463496997 / -32.1% 🟢 0.85 / 0.63 / +34.4%
tpch_q20/duckdb:vortex-file-compressed 417394194 / 678826072 / -38.5% 🟢 650829981 / 770727690 / -15.6% 0.64 / 0.88 / -27.2%
tpch_q21/duckdb:vortex-file-compressed 630226101 / 663237665 / -5.0% 740328438 / 679043611 / +9.0% 0.85 / 0.98 / -12.8%
tpch_q22/duckdb:vortex-file-compressed 251594410 / 423969512 / -40.7% 🟢 313303995 / 386492514 / -18.9% 0.80 / 1.10 / -26.8%
duckdb / vortex-compact / ns (0.860x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 183976751 / 202145179 / -9.0% 248113779 / 221993385 / +11.8% 0.74 / 0.91 / -18.6%
tpch_q02/duckdb:vortex-compact 385538284 / 457360379 / -15.7% 442724006 / 440652777 / +0.5% 0.87 / 1.04 / -16.1%
tpch_q03/duckdb:vortex-compact 416197822 / 542569300 / -23.3% 529824000 / 464656634 / +14.0% 0.79 / 1.17 / -32.7%
tpch_q04/duckdb:vortex-compact 209383921 / 295275735 / -29.1% 273969243 / 495792077 / -44.7% 🟢 0.76 / 0.60 / +28.3%
tpch_q05/duckdb:vortex-compact 551032591 / 577725896 / -4.6% 551757359 / 548773198 / +0.5% 1.00 / 1.05 / -5.1%
tpch_q06/duckdb:vortex-compact 177862385 / 195824169 / -9.2% 216512125 / 207380036 / +4.4% 0.82 / 0.94 / -13.0%
tpch_q07/duckdb:vortex-compact 395005612 / 411194498 / -3.9% 476161640 / 533033602 / -10.7% 0.83 / 0.77 / +7.5%
tpch_q08/duckdb:vortex-compact 640300607 / 602952423 / +6.2% 602182609 / 701612472 / -14.2% 1.06 / 0.86 / +23.7%
tpch_q09/duckdb:vortex-compact 417637751 / 641540076 / -34.9% 🟢 476334143 / 749994057 / -36.5% 🟢 0.88 / 0.86 / +2.5%
tpch_q10/duckdb:vortex-compact 484431931 / 488956659 / -0.9% 489187877 / 560010155 / -12.6% 0.99 / 0.87 / +13.4%
tpch_q11/duckdb:vortex-compact 326575199 / 287670112 / +13.5% 328722112 / 314545817 / +4.5% 0.99 / 0.91 / +8.6%
tpch_q12/duckdb:vortex-compact 217777220 / 202962694 / +7.3% 307429833 / 358051360 / -14.1% 0.71 / 0.57 / +25.0%
tpch_q13/duckdb:vortex-compact 271840704 / 269374202 / +0.9% 229852923 / 243898288 / -5.8% 1.18 / 1.10 / +7.1%
tpch_q14/duckdb:vortex-compact 222066770 / 258979974 / -14.3% 301300356 / 325977455 / -7.6% 0.74 / 0.79 / -7.2%
tpch_q15/duckdb:vortex-compact 239318591 / 260583142 / -8.2% 265617505 / 410772978 / -35.3% 🟢 0.90 / 0.63 / +42.0%
tpch_q16/duckdb:vortex-compact 196460983 / 243280667 / -19.2% 261026124 / 310615021 / -16.0% 0.75 / 0.78 / -3.9%
tpch_q17/duckdb:vortex-compact 402629931 / 557647467 / -27.8% 430718242 / 716032295 / -39.8% 🟢 0.93 / 0.78 / +20.0%
tpch_q18/duckdb:vortex-compact 354575660 / 371199928 / -4.5% 583204584 / 459191550 / +27.0% 0.61 / 0.81 / -24.8%
tpch_q19/duckdb:vortex-compact 275217701 / 536556836 / -48.7% 🟢 301010565 / 396081972 / -24.0% 0.91 / 1.35 / -32.5%
tpch_q20/duckdb:vortex-compact 370437224 / 566056019 / -34.6% 🟢 483304567 / 525226155 / -8.0% 0.77 / 1.08 / -28.9%
tpch_q21/duckdb:vortex-compact 551742660 / 591650843 / -6.7% 558390297 / 693997900 / -19.5% 0.99 / 0.85 / +15.9%
tpch_q22/duckdb:vortex-compact 222532049 / 245969016 / -9.5% 280380874 / 314526453 / -10.9% 0.79 / 0.78 / +1.5%
duckdb / parquet / ns (0.952x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 195923763 / 186444064 / +5.1% 237568219 / 282527813 / -15.9% 0.82 / 0.66 / +25.0%
tpch_q02/duckdb:parquet 461102594 / 474518401 / -2.8% 506460228 / 513358696 / -1.3% 0.91 / 0.92 / -1.5%
tpch_q03/duckdb:parquet 402857597 / 388916387 / +3.6% 525919369 / 630518576 / -16.6% 0.77 / 0.62 / +24.2%
tpch_q04/duckdb:parquet 306098063 / 333484444 / -8.2% 299692961 / 352606432 / -15.0% 1.02 / 0.95 / +8.0%
tpch_q05/duckdb:parquet 635122886 / 587483889 / +8.1% 630859900 / 785134709 / -19.6% 1.01 / 0.75 / +34.5%
tpch_q06/duckdb:parquet 195025386 / 171065019 / +14.0% 271340003 / 227464493 / +19.3% 0.72 / 0.75 / -4.4%
tpch_q07/duckdb:parquet 439107366 / 479532912 / -8.4% 509963740 / 496973228 / +2.6% 0.86 / 0.96 / -10.8%
tpch_q08/duckdb:parquet 717786484 / 605142694 / +18.6% 669556702 / 745229145 / -10.2% 1.07 / 0.81 / +32.0%
tpch_q09/duckdb:parquet 615219608 / 944471828 / -34.9% 🟢 600157158 / 1264518164 / -52.5% 🟢 1.03 / 0.75 / +37.2%
tpch_q10/duckdb:parquet 627874400 / 662599778 / -5.2% 602255163 / 673531358 / -10.6% 1.04 / 0.98 / +6.0%
tpch_q11/duckdb:parquet 306172271 / 316939372 / -3.4% 306687406 / 328577210 / -6.7% 1.00 / 0.96 / +3.5%
tpch_q12/duckdb:parquet 255706124 / 310175817 / -17.6% 317401977 / 362225519 / -12.4% 0.81 / 0.86 / -5.9%
tpch_q13/duckdb:parquet 410996392 / 427374154 / -3.8% 538194551 / 597143617 / -9.9% 0.76 / 0.72 / +6.7%
tpch_q14/duckdb:parquet 270478507 / 240100433 / +12.7% 293948076 / 298651575 / -1.6% 0.92 / 0.80 / +14.5%
tpch_q15/duckdb:parquet 221518777 / 262284657 / -15.5% 311383032 / 300349427 / +3.7% 0.71 / 0.87 / -18.5%
tpch_q16/duckdb:parquet 297042396 / 331542209 / -10.4% 300088930 / 321132742 / -6.6% 0.99 / 1.03 / -4.1%
tpch_q17/duckdb:parquet 288935996 / 290567264 / -0.6% 386808174 / 392945962 / -1.6% 0.75 / 0.74 / +1.0%
tpch_q18/duckdb:parquet 319463749 / 392000396 / -18.5% 360013602 / 423335499 / -15.0% 0.89 / 0.93 / -4.2%
tpch_q19/duckdb:parquet 289498566 / 380346270 / -23.9% 354344084 / 373673328 / -5.2% 0.82 / 1.02 / -19.7%
tpch_q20/duckdb:parquet 453334251 / 434487627 / +4.3% 443597586 / 507857898 / -12.7% 1.02 / 0.86 / +19.5%
tpch_q21/duckdb:parquet 479900355 / 497658230 / -3.6% 553355504 / 553429713 / -0.0% 0.87 / 0.90 / -3.6%
tpch_q22/duckdb:parquet 332290489 / 316207253 / +5.1% 345083753 / 393167450 / -12.2% 0.96 / 0.80 / +19.7%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR e42f8876 vs base 2a9c7628
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.9%
Engines: random-access No clear signal (-2.9%, environment too noisy confidence)
Vortex (geomean): hot 0.868x ➖
Parquet (geomean): hot 0.894x ➖
Shifts: Parquet (control) -10.6% · Median polish -7.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (0.868x ➖, 2↑ 1↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 108102 / 111847 / -3.3%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 110290438 / 130351660 / -15.4%
random-access/feature-vectors/uniform/vortex-tokio-s3 55344698 / 173814883 / -68.2% 🟢
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 216921751 / 206375713 / +5.1%
random-access/nested-lists/correlated/vortex-tokio-s3 93500 / 96783 / -3.4%
random-access/nested-lists/correlated/vortex-tokio-s3-footer 79862663 / 106356306 / -24.9%
random-access/nested-lists/uniform/vortex-tokio-s3 44127997 / 45877441 / -3.8%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 229177301 / 140083900 / +63.6% 🔴
random-access/nested-structs/correlated/vortex-tokio-s3 117794 / 120904 / -2.6%
random-access/nested-structs/correlated/vortex-tokio-s3-footer 90781442 / 105549027 / -14.0%
random-access/nested-structs/uniform/vortex-tokio-s3 254199 / 262484 / -3.2%
random-access/nested-structs/uniform/vortex-tokio-s3-footer 139654460 / 108611833 / +28.6%
random-access/taxi/correlated/vortex-tokio-s3 250101 / 259876 / -3.8%
random-access/taxi/correlated/vortex-tokio-s3-footer 105344381 / 133561046 / -21.1%
random-access/taxi/uniform/vortex-tokio-s3 831318 / 838107 / -0.8%
random-access/taxi/uniform/vortex-tokio-s3-footer 162221494 / 161363427 / +0.5%
random-access/vortex-tokio-s3 217735 / 221468 / -1.7%
random-access/vortex-tokio-s3-footer 95969752 / 296734559 / -67.7% 🟢
random-access / parquet / ns (0.894x ➖, 3↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 67283993 / 116941902 / -42.5% 🟢
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 134399995 / 170018475 / -20.9%
random-access/feature-vectors/uniform/parquet-tokio-s3 579812500 / 686522338 / -15.5%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 617097622 / 930270745 / -33.7% 🟢
random-access/nested-lists/correlated/parquet-tokio-s3 45939205 / 67642373 / -32.1% 🟢
random-access/nested-lists/correlated/parquet-tokio-s3-footer 129819444 / 129279670 / +0.4%
random-access/nested-lists/uniform/parquet-tokio-s3 179291949 / 198943160 / -9.9%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 267436301 / 262793809 / +1.8%
random-access/nested-structs/correlated/parquet-tokio-s3 63434583 / 69954147 / -9.3%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 164998649 / 164878735 / +0.1%
random-access/nested-structs/uniform/parquet-tokio-s3 446020714 / 446007689 / +0.0%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 538394182 / 530582426 / +1.5%
random-access/parquet-tokio-s3 203379110 / 200337937 / +1.5%
random-access/parquet-tokio-s3-footer 250415291 / 262119641 / -4.5%
random-access/taxi/correlated/parquet-tokio-s3 218987849 / 219163214 / -0.1%
random-access/taxi/correlated/parquet-tokio-s3-footer 257305270 / 260416648 / -1.2%
random-access/taxi/uniform/parquet-tokio-s3 220670803 / 227279480 / -2.9%
random-access/taxi/uniform/parquet-tokio-s3-footer 278383019 / 286751492 / -2.9%
random-access / lance / ns (0.904x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 39545811 / 42900225 / -7.8%
random-access/feature-vectors/correlated/lance-tokio-s3-footer 201361824 / 209847462 / -4.0%
random-access/feature-vectors/uniform/lance-tokio-s3 99103508 / 104634060 / -5.3%
random-access/feature-vectors/uniform/lance-tokio-s3-footer 237551777 / 275339865 / -13.7%
random-access/lance-tokio-s3 57785701 / 53969241 / +7.1%
random-access/lance-tokio-s3-footer 263645253 / 313044446 / -15.8%
random-access/nested-lists/correlated/lance-tokio-s3 33239768 / 40566014 / -18.1%
random-access/nested-lists/correlated/lance-tokio-s3-footer 239607984 / 242248271 / -1.1%
random-access/nested-lists/uniform/lance-tokio-s3 73798610 / 80748660 / -8.6%
random-access/nested-lists/uniform/lance-tokio-s3-footer 256637338 / 337604938 / -24.0%
random-access/nested-structs/correlated/lance-tokio-s3 47139791 / 53948537 / -12.6%
random-access/nested-structs/correlated/lance-tokio-s3-footer 253506389 / 264718675 / -4.2%
random-access/nested-structs/uniform/lance-tokio-s3 121440946 / 139368720 / -12.9%
random-access/nested-structs/uniform/lance-tokio-s3-footer 325612161 / 343335781 / -5.2%
random-access/taxi/correlated/lance-tokio-s3 64670855 / 71057954 / -9.0%
random-access/taxi/correlated/lance-tokio-s3-footer 261814667 / 299682329 / -12.6%
random-access/taxi/uniform/lance-tokio-s3 244681109 / 264550987 / -7.5%
random-access/taxi/uniform/lance-tokio-s3-footer 413250386 / 470346400 / -12.1%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR e42f8876 vs base 2a9c7628
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: random-access No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.992x ➖
Parquet (geomean): hot 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.042x ➖, 1↑ 2↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 75177 / 72786 / +3.3%
random-access/arrow-tokio-local-disk-footer 169259 / 167202 / +1.2%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 2818269 / 1313941 / +114.5% 🔴
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 2055786 / 3620456 / -43.2% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk 50448590 / 51482088 / -2.0%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 49401596 / 49893520 / -1.0%
random-access/nested-lists/correlated/arrow-tokio-local-disk 59848 / 59114 / +1.2%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 109589 / 103268 / +6.1%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1094131 / 1168462 / -6.4%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1173989 / 1135717 / +3.4%
random-access/nested-structs/correlated/arrow-tokio-local-disk 55816 / 52523 / +6.3%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 99170 / 92229 / +7.5%
random-access/nested-structs/uniform/arrow-tokio-local-disk 959393 / 840062 / +14.2% 🔴
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 969927 / 891588 / +8.8%
random-access/taxi/correlated/arrow-tokio-local-disk 126669 / 116690 / +8.6%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 225754 / 220554 / +2.4%
random-access/taxi/uniform/arrow-tokio-local-disk 3035655 / 2960019 / +2.6%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 3093900 / 3091937 / +0.1%
random-access / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 111132 / 108260 / +2.7%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1233880 / 1256723 / -1.8%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1005094 / 1036443 / -3.0%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2359074 / 2330680 / +1.2%
random-access/nested-lists/correlated/vortex-tokio-local-disk 96380 / 99470 / -3.1%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 339559 / 341060 / -0.4%
random-access/nested-lists/uniform/vortex-tokio-local-disk 428360 / 438813 / -2.4%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 879241 / 854882 / +2.8%
random-access/nested-structs/correlated/vortex-tokio-local-disk 119944 / 121413 / -1.2%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 426427 / 437715 / -2.6%
random-access/nested-structs/uniform/vortex-tokio-local-disk 248760 / 255113 / -2.5%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 652629 / 660299 / -1.2%
random-access/taxi/correlated/vortex-tokio-local-disk 254888 / 258204 / -1.3%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1141786 / 1149085 / -0.6%
random-access/taxi/uniform/vortex-tokio-local-disk 830509 / 828228 / +0.3%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 2996090 / 2996202 / -0.0%
random-access/vortex-tokio-local-disk 218627 / 221214 / -1.2%
random-access/vortex-tokio-local-disk-footer 971057 / 975347 / -0.4%
random-access / parquet / ns (1.001x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 10373724 / 10382322 / -0.1%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 10691116 / 10650352 / +0.4%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 133409310 / 138083351 / -3.4%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 137536527 / 136999219 / +0.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk 4733666 / 4728724 / +0.1%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 4914250 / 4915837 / -0.0%
random-access/nested-lists/uniform/parquet-tokio-local-disk 38235468 / 38597867 / -0.9%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 40174071 / 39693444 / +1.2%
random-access/nested-structs/correlated/parquet-tokio-local-disk 9305114 / 9309934 / -0.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 9460385 / 9441535 / +0.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk 37727947 / 37703232 / +0.1%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 37933884 / 37855403 / +0.2%
random-access/parquet-tokio-local-disk 17549035 / 17616469 / -0.4%
random-access/parquet-tokio-local-disk-footer 18258880 / 17786758 / +2.7%
random-access/taxi/correlated/parquet-tokio-local-disk 25031529 / 24950771 / +0.3%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 25378267 / 25149305 / +0.9%
random-access/taxi/uniform/parquet-tokio-local-disk 39419778 / 39448662 / -0.1%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 39458431 / 39486865 / -0.1%
random-access / lance / ns (0.986x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 154132 / 153794 / +0.2%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 927666 / 949030 / -2.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk 989154 / 992607 / -0.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1759031 / 1772891 / -0.8%
random-access/lance-tokio-local-disk 425077 / 436546 / -2.6%
random-access/lance-tokio-local-disk-footer 1244987 / 1239456 / +0.4%
random-access/nested-lists/correlated/lance-tokio-local-disk 113269 / 114192 / -0.8%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 431150 / 463483 / -7.0%
random-access/nested-lists/uniform/lance-tokio-local-disk 822558 / 836730 / -1.7%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1319038 / 1395372 / -5.5%
random-access/nested-structs/correlated/lance-tokio-local-disk 213808 / 221094 / -3.3%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 505929 / 501281 / +0.9%
random-access/nested-structs/uniform/lance-tokio-local-disk 2206310 / 2152794 / +2.5%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2514622 / 2521422 / -0.3%
random-access/taxi/correlated/lance-tokio-local-disk 639444 / 647840 / -1.3%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1637576 / 1651002 / -0.8%
random-access/taxi/uniform/lance-tokio-local-disk 6776969 / 6925457 / -2.1%
random-access/taxi/uniform/lance-tokio-local-disk-footer 7833239 / 7892561 / -0.8%
random-access / litdata / ns (0.998x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/litdata-tokio-local-disk 762460 / 769368 / -0.9%
random-access/feature-vectors/correlated/litdata-tokio-local-disk-footer 3675218 / 3621213 / +1.5%
random-access/feature-vectors/uniform/litdata-tokio-local-disk 1321387 / 1267176 / +4.3%
random-access/feature-vectors/uniform/litdata-tokio-local-disk-footer 21776877 / 21917587 / -0.6%
random-access/litdata-tokio-local-disk 93298 / 93512 / -0.2%
random-access/litdata-tokio-local-disk-footer 16131160 / 16314032 / -1.1%
random-access/nested-lists/correlated/litdata-tokio-local-disk 608410 / 614641 / -1.0%
random-access/nested-lists/correlated/litdata-tokio-local-disk-footer 23920463 / 23533776 / +1.6%
random-access/nested-lists/uniform/litdata-tokio-local-disk 642892 / 651789 / -1.4%
random-access/nested-lists/uniform/litdata-tokio-local-disk-footer 23686165 / 23534742 / +0.6%
random-access/nested-structs/correlated/litdata-tokio-local-disk 715038 / 721194 / -0.9%
random-access/nested-structs/correlated/litdata-tokio-local-disk-footer 24440192 / 25706702 / -4.9%
random-access/nested-structs/uniform/litdata-tokio-local-disk 786430 / 788550 / -0.3%
random-access/nested-structs/uniform/litdata-tokio-local-disk-footer 23375097 / 23812291 / -1.8%
random-access/taxi/correlated/litdata-tokio-local-disk 1286143 / 1274763 / +0.9%
random-access/taxi/correlated/litdata-tokio-local-disk-footer 28982305 / 28969095 / +0.0%
random-access/taxi/uniform/litdata-tokio-local-disk 1444096 / 1442672 / +0.1%
random-access/taxi/uniform/litdata-tokio-local-disk-footer 87554920 / 87479871 / +0.1%

Copy link
Copy Markdown
Contributor Author

Closing as superseded: #11049, #11061 and #11097 now choose the V2 scan per benchmark in the bench orchestrator. V1 is kept only through the BENCHMARK_SCAN_V1 allowlist.


Generated by Claude Code

@robert3005
robert3005 deleted the ji/inspiring-heisenberg-p4k61b branch November 10, 2026 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants