Skip to content

Overlap reads across two DuckDB Scan V2 chunks per thread - #11140

Draft
joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-duckdb-two-chunks
Draft

joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-duckdb-two-chunks

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Split out of #10964 as an independently measurable piece.

Each DuckDB thread ran one Scan V2 chunk at a time, so it sat idle whenever that chunk waited on storage. With two chunks live on each thread's run, one chunk's reads overlap the other's compute.

Changes

  • CHUNKS_PER_THREAD in vortex-duckdb/src/scan_v2.rs goes from 1 to 2.

Local validation

4 vCPU cloud VM, TPC-H SF10 Vortex files, Scan V2, 2 alternating (ABBA) rounds × 5 iterations against develop (246a397). Base-vs-base noise: +1.3% geomean, up to ±8% per query.

Engine Geomean of medians Geomean of mins
DuckDB -8.8% -8.9%
  • cargo nextest run -p vortex-duckdb: 276 passed, 2 skipped.
  • Pinned-nightly rustfmt --check on changed files: clean.
  • cargo clippy: not yet run.

Generated by Claude Code

Each DuckDB thread ran one V2 chunk at a time, so it sat idle whenever that chunk waited on
storage. Keep two chunks live on each thread's run so one chunk's reads overlap the other's
compute.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 3, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f86626f clickbench-nvme 1 Explore Profiling Data
🟢 Done f86626f fineweb 1 Explore Profiling Data
🟢 Done f86626f tpch-nvme-10 1 Explore Profiling Data
🟢 Done f86626f polarsignals 1 Explore Profiling Data
🟢 Done f86626f tpch-s3 1 Explore Profiling Data
🟢 Done f86626f tpcds-nvme 1 Explore Profiling Data
🟢 Done f86626f tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR f86626f0 vs base 246a397e
Vortex (geomean): hot 0.988x ➖ · cold 1.051x ➖


datafusion / vortex-file-compressed / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44198598 / 44174877 / +0.1% 88141532 / 83381591 / +5.7% 0.50 / 0.53 / -5.3%
polarsignals_q01/datafusion:vortex-file-compressed 52509078 / 59498684 / -11.7% 🟢 111558046 / 113392846 / -1.6% 0.47 / 0.52 / -10.3%
polarsignals_q02/datafusion:vortex-file-compressed 12114845 / 11978216 / +1.1% 50567185 / 49588551 / +2.0% 0.24 / 0.24 / -0.8%
polarsignals_q03/datafusion:vortex-file-compressed 53787532 / 54233533 / -0.8% 143616949 / 112439358 / +27.7% 🔴 0.37 / 0.48 / -22.4%
polarsignals_q04/datafusion:vortex-file-compressed 8950600 / 9157702 / -2.3% 41268339 / 40279396 / +2.5% 0.22 / 0.23 / -4.6%
polarsignals_q05/datafusion:vortex-file-compressed 11659512 / 11581688 / +0.7% 45994409 / 44512288 / +3.3% 0.25 / 0.26 / -2.6%
polarsignals_q06/datafusion:vortex-file-compressed 22810246 / 23169506 / -1.6% 54524453 / 52769004 / +3.3% 0.42 / 0.44 / -4.7%
polarsignals_q07/datafusion:vortex-file-compressed 10450373 / 10570672 / -1.1% 42794735 / 41644590 / +2.8% 0.24 / 0.25 / -3.8%
polarsignals_q08/datafusion:vortex-file-compressed 97858075 / 97258934 / +0.6% 155487577 / 150877578 / +3.1% 0.63 / 0.64 / -2.4%
polarsignals_q09/datafusion:vortex-file-compressed 10084641 / 9737686 / +3.6% 41009416 / 39267571 / +4.4% 0.25 / 0.25 / -0.8%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR f86626f0 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.8%
Engines: DataFusion No clear signal (+3.5%, low confidence) · DuckDB No clear signal (+8.1%, low confidence)
Vortex (geomean): hot 1.066x ➖ · cold 0.974x ➖
Parquet (geomean): hot 1.008x ➖ · cold 0.999x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.042x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6060228 / 6024191 / +0.6% 18854854 / 21309376 / -11.5% 🟢 0.32 / 0.28 / +13.7%
fineweb_q01/datafusion:vortex-file-compressed 9625446 / 9747476 / -1.3% 41084505 / 42020755 / -2.2% 0.23 / 0.23 / +1.0%
fineweb_q02/datafusion:vortex-file-compressed 11285706 / 11618604 / -2.9% 39726480 / 41766392 / -4.9% 0.28 / 0.28 / +2.1%
fineweb_q03/datafusion:vortex-file-compressed 17707755 / 17329895 / +2.2% 104677447 / 108086646 / -3.2% 0.17 / 0.16 / +5.5%
fineweb_q04/datafusion:vortex-file-compressed 65901872 / 65737414 / +0.3% 141907231 / 145352776 / -2.4% 0.46 / 0.45 / +2.7%
fineweb_q05/datafusion:vortex-file-compressed 63583260 / 61795532 / +2.9% 140375399 / 137019662 / +2.4% 0.45 / 0.45 / +0.4%
fineweb_q06/datafusion:vortex-file-compressed 18119300 / 18066823 / +0.3% 104233682 / 104665880 / -0.4% 0.17 / 0.17 / +0.7%
fineweb_q07/datafusion:vortex-file-compressed 18166386 / 18844782 / -3.6% 107196720 / 103604493 / +3.5% 0.17 / 0.18 / -6.8%
fineweb_q08/datafusion:vortex-file-compressed 10950580 / 7447691 / +47.0% 🔴 29001307 / 30345802 / -4.4% 0.38 / 0.25 / +53.8%
datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9694642 / 9347190 / +3.7% 32659514 / 33061275 / -1.2% 0.30 / 0.28 / +5.0%
fineweb_q01/datafusion:parquet 74842288 / 74932425 / -0.1% 158803154 / 150742572 / +5.3% 0.47 / 0.50 / -5.2%
fineweb_q02/datafusion:parquet 73801814 / 74583498 / -1.0% 150093484 / 163418319 / -8.2% 0.49 / 0.46 / +7.7%
fineweb_q03/datafusion:parquet 73176510 / 73245926 / -0.1% 149506934 / 146136322 / +2.3% 0.49 / 0.50 / -2.3%
fineweb_q04/datafusion:parquet 83553592 / 81855403 / +2.1% 154012478 / 149348852 / +3.1% 0.54 / 0.55 / -1.0%
fineweb_q05/datafusion:parquet 79998446 / 79554145 / +0.6% 151437149 / 154855107 / -2.2% 0.53 / 0.51 / +2.8%
fineweb_q06/datafusion:parquet 75127718 / 75032262 / +0.1% 151458941 / 149137469 / +1.6% 0.50 / 0.50 / -1.4%
fineweb_q07/datafusion:parquet 74691492 / 73707845 / +1.3% 151386693 / 147218019 / +2.8% 0.49 / 0.50 / -1.5%
fineweb_q08/datafusion:parquet 73455306 / 73897006 / -0.6% 150891982 / 148685620 / +1.5% 0.49 / 0.50 / -2.1%
duckdb / vortex-file-compressed / ns (1.092x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2302158 / 2054080 / +12.1% 🔴 7390929 / 8030872 / -8.0% 0.31 / 0.26 / +21.8%
fineweb_q01/duckdb:vortex-file-compressed 10542672 / 8039040 / +31.1% 🔴 28031375 / 27088970 / +3.5% 0.38 / 0.30 / +26.7%
fineweb_q02/duckdb:vortex-file-compressed 12118540 / 9083977 / +33.4% 🔴 30203731 / 31774590 / -4.9% 0.40 / 0.29 / +40.3%
fineweb_q03/duckdb:vortex-file-compressed 18398508 / 19157832 / -4.0% 91222197 / 98793352 / -7.7% 0.20 / 0.19 / +4.0%
fineweb_q04/duckdb:vortex-file-compressed 70139902 / 65255572 / +7.5% 117161738 / 112260318 / +4.4% 0.60 / 0.58 / +3.0%
fineweb_q05/duckdb:vortex-file-compressed 70335062 / 65341412 / +7.6% 114378911 / 108297733 / +5.6% 0.61 / 0.60 / +1.9%
fineweb_q06/duckdb:vortex-file-compressed 18831778 / 18257114 / +3.1% 90609178 / 91068935 / -0.5% 0.21 / 0.20 / +3.7%
fineweb_q07/duckdb:vortex-file-compressed 18315994 / 17490810 / +4.7% 90226715 / 91425750 / -1.3% 0.20 / 0.19 / +6.1%
fineweb_q08/duckdb:vortex-file-compressed 4627784 / 4946861 / -6.5% 11487381 / 13182286 / -12.9% 🟢 0.40 / 0.38 / +7.4%
duckdb / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23924697 / 23445777 / +2.0% 27968308 / 28195844 / -0.8% 0.86 / 0.83 / +2.9%
fineweb_q01/duckdb:parquet 55536104 / 53982162 / +2.9% 73322078 / 71997604 / +1.8% 0.76 / 0.75 / +1.0%
fineweb_q02/duckdb:parquet 58596920 / 57294482 / +2.3% 75517158 / 77346633 / -2.4% 0.78 / 0.74 / +4.8%
fineweb_q03/duckdb:parquet 118228527 / 117275600 / +0.8% 171538281 / 177695815 / -3.5% 0.69 / 0.66 / +4.4%
fineweb_q04/duckdb:parquet 163137756 / 162362744 / +0.5% 200976543 / 207889629 / -3.3% 0.81 / 0.78 / +3.9%
fineweb_q05/duckdb:parquet 156503144 / 154398161 / +1.4% 201741102 / 198729928 / +1.5% 0.78 / 0.78 / -0.1%
fineweb_q06/duckdb:parquet 88040067 / 87783252 / +0.3% 144847571 / 145322183 / -0.3% 0.61 / 0.60 / +0.6%
fineweb_q07/duckdb:parquet 90618668 / 91502205 / -1.0% 142317748 / 144300475 / -1.4% 0.64 / 0.63 / +0.4%
fineweb_q08/duckdb:parquet 29087308 / 29233083 / -0.5% 30558449 / 29945779 / +2.0% 0.95 / 0.98 / -2.5%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR f86626f0 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-1.1%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.963x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.984x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15389651 / 16263915 / -5.4% 42080310 / 44263199 / -4.9% 0.37 / 0.37 / -0.5%
tpch_q02/datafusion:vortex-file-compressed 16388393 / 16894974 / -3.0% 35035126 / 36611616 / -4.3% 0.47 / 0.46 / +1.4%
tpch_q03/datafusion:vortex-file-compressed 19702703 / 19527766 / +0.9% 43492252 / 49847443 / -12.7% 🟢 0.45 / 0.39 / +15.6%
tpch_q04/datafusion:vortex-file-compressed 11176878 / 10188611 / +9.7% 33642519 / 35817404 / -6.1% 0.33 / 0.28 / +16.8%
tpch_q05/datafusion:vortex-file-compressed 37008971 / 37541382 / -1.4% 64469373 / 67849249 / -5.0% 0.57 / 0.55 / +3.8%
tpch_q06/datafusion:vortex-file-compressed 6268616 / 5955274 / +5.3% 24864020 / 28481717 / -12.7% 🟢 0.25 / 0.21 / +20.6%
tpch_q07/datafusion:vortex-file-compressed 51578126 / 51398304 / +0.3% 73699058 / 82045194 / -10.2% 🟢 0.70 / 0.63 / +11.7%
tpch_q08/datafusion:vortex-file-compressed 51233690 / 51875388 / -1.2% 79357157 / 80701452 / -1.7% 0.65 / 0.64 / +0.4%
tpch_q09/datafusion:vortex-file-compressed 47171837 / 47995869 / -1.7% 77037493 / 80826300 / -4.7% 0.61 / 0.59 / +3.1%
tpch_q10/datafusion:vortex-file-compressed 17118493 / 17741482 / -3.5% 48165833 / 53082340 / -9.3% 0.36 / 0.33 / +6.3%
tpch_q11/datafusion:vortex-file-compressed 14083637 / 14031627 / +0.4% 32718002 / 33512469 / -2.4% 0.43 / 0.42 / +2.8%
tpch_q12/datafusion:vortex-file-compressed 18283362 / 18328359 / -0.2% 42619561 / 45157861 / -5.6% 0.43 / 0.41 / +5.7%
tpch_q13/datafusion:vortex-file-compressed 18619257 / 19616934 / -5.1% 37129709 / 38185157 / -2.8% 0.50 / 0.51 / -2.4%
tpch_q14/datafusion:vortex-file-compressed 14543461 / 14594152 / -0.3% 36129928 / 39735581 / -9.1% 0.40 / 0.37 / +9.6%
tpch_q15/datafusion:vortex-file-compressed 18606100 / 18763971 / -0.8% 42666763 / 43533246 / -2.0% 0.44 / 0.43 / +1.2%
tpch_q16/datafusion:vortex-file-compressed 18259893 / 18234276 / +0.1% 38488110 / 37635522 / +2.3% 0.47 / 0.48 / -2.1%
tpch_q17/datafusion:vortex-file-compressed 28151851 / 28378421 / -0.8% 59107379 / 61847418 / -4.4% 0.48 / 0.46 / +3.8%
tpch_q18/datafusion:vortex-file-compressed 35944113 / 35305543 / +1.8% 58884432 / 61599150 / -4.4% 0.61 / 0.57 / +6.5%
tpch_q19/datafusion:vortex-file-compressed 12211718 / 11827307 / +3.3% 35080881 / 35891404 / -2.3% 0.35 / 0.33 / +5.6%
tpch_q20/datafusion:vortex-file-compressed 20336682 / 20441467 / -0.5% 42539226 / 46957425 / -9.4% 0.48 / 0.44 / +9.8%
tpch_q21/datafusion:vortex-file-compressed 38736887 / 38735030 / +0.0% 67848315 / 69895942 / -2.9% 0.57 / 0.55 / +3.0%
tpch_q22/datafusion:vortex-file-compressed 10741440 / 10820078 / -0.7% 29682419 / 29933093 / -0.8% 0.36 / 0.36 / +0.1%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71918831 / 71895679 / +0.0% 87346985 / 90101832 / -3.1% 0.82 / 0.80 / +3.2%
tpch_q02/datafusion:parquet 75342615 / 76098843 / -1.0% 90596044 / 90855700 / -0.3% 0.83 / 0.84 / -0.7%
tpch_q03/datafusion:parquet 81635225 / 81802859 / -0.2% 102027009 / 104624570 / -2.5% 0.80 / 0.78 / +2.3%
tpch_q04/datafusion:parquet 39646903 / 39443450 / +0.5% 56629913 / 56105007 / +0.9% 0.70 / 0.70 / -0.4%
tpch_q05/datafusion:parquet 110193601 / 110243073 / -0.0% 134628596 / 137233632 / -1.9% 0.82 / 0.80 / +1.9%
tpch_q06/datafusion:parquet 31180917 / 31285870 / -0.3% 46010632 / 48958203 / -6.0% 0.68 / 0.64 / +6.0%
tpch_q07/datafusion:parquet 112510047 / 112628638 / -0.1% 137085539 / 140164965 / -2.2% 0.82 / 0.80 / +2.1%
tpch_q08/datafusion:parquet 117081929 / 117365432 / -0.2% 142232034 / 144858333 / -1.8% 0.82 / 0.81 / +1.6%
tpch_q09/datafusion:parquet 137112370 / 137648335 / -0.4% 162752258 / 165675523 / -1.8% 0.84 / 0.83 / +1.4%
tpch_q10/datafusion:parquet 103188902 / 104232599 / -1.0% 124748771 / 131557659 / -5.2% 0.83 / 0.79 / +4.4%
tpch_q11/datafusion:parquet 61657725 / 61117621 / +0.9% 81546580 / 83469534 / -2.3% 0.76 / 0.73 / +3.3%
tpch_q12/datafusion:parquet 63997447 / 63935260 / +0.1% 83710225 / 85713684 / -2.3% 0.76 / 0.75 / +2.5%
tpch_q13/datafusion:parquet 143706394 / 143039529 / +0.5% 160952563 / 163205266 / -1.4% 0.89 / 0.88 / +1.9%
tpch_q14/datafusion:parquet 47485781 / 47461665 / +0.1% 67769880 / 70523444 / -3.9% 0.70 / 0.67 / +4.1%
tpch_q15/datafusion:parquet 73673515 / 73406392 / +0.4% 92682611 / 92742867 / -0.1% 0.79 / 0.79 / +0.4%
tpch_q16/datafusion:parquet 43205745 / 43563928 / -0.8% 62689467 / 63270122 / -0.9% 0.69 / 0.69 / +0.1%
tpch_q17/datafusion:parquet 123328787 / 123301020 / +0.0% 140777624 / 147211074 / -4.4% 0.88 / 0.84 / +4.6%
tpch_q18/datafusion:parquet 120761095 / 121046192 / -0.2% 140951923 / 142737474 / -1.3% 0.86 / 0.85 / +1.0%
tpch_q19/datafusion:parquet 56540096 / 57598916 / -1.8% 79695249 / 84233107 / -5.4% 0.71 / 0.68 / +3.8%
tpch_q20/datafusion:parquet 77736367 / 77933849 / -0.3% 99540513 / 103206085 / -3.6% 0.78 / 0.76 / +3.4%
tpch_q21/datafusion:parquet 112907116 / 113408807 / -0.4% 139307819 / 138663269 / +0.5% 0.81 / 0.82 / -0.9%
tpch_q22/datafusion:parquet 51608174 / 52165988 / -1.1% 66277216 / 67936274 / -2.4% 0.78 / 0.77 / +1.4%
duckdb / vortex-file-compressed / ns (0.987x ➖, 4↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8751631 / 9761332 / -10.3% 🟢 18338084 / 18912466 / -3.0% 0.48 / 0.52 / -7.5%
tpch_q02/duckdb:vortex-file-compressed 16060603 / 15133618 / +6.1% 25790457 / 25240568 / +2.2% 0.62 / 0.60 / +3.9%
tpch_q03/duckdb:vortex-file-compressed 17022761 / 18478693 / -7.9% 32947119 / 35420760 / -7.0% 0.52 / 0.52 / -1.0%
tpch_q04/duckdb:vortex-file-compressed 11700674 / 12526559 / -6.6% 23928312 / 26797289 / -10.7% 🟢 0.49 / 0.47 / +4.6%
tpch_q05/duckdb:vortex-file-compressed 18904548 / 19984330 / -5.4% 35165065 / 35135251 / +0.1% 0.54 / 0.57 / -5.5%
tpch_q06/duckdb:vortex-file-compressed 4579194 / 4707229 / -2.7% 13052976 / 14897236 / -12.4% 🟢 0.35 / 0.32 / +11.0%
tpch_q07/duckdb:vortex-file-compressed 21385696 / 24433501 / -12.5% 🟢 39131999 / 40669053 / -3.8% 0.55 / 0.60 / -9.0%
tpch_q08/duckdb:vortex-file-compressed 20241257 / 21158117 / -4.3% 37509892 / 37360088 / +0.4% 0.54 / 0.57 / -4.7%
tpch_q09/duckdb:vortex-file-compressed 22125305 / 21780886 / +1.6% 38762290 / 39377115 / -1.6% 0.57 / 0.55 / +3.2%
tpch_q10/duckdb:vortex-file-compressed 22342371 / 23061494 / -3.1% 37711443 / 40021706 / -5.8% 0.59 / 0.58 / +2.8%
tpch_q11/duckdb:vortex-file-compressed 8845933 / 8190706 / +8.0% 17345493 / 17311375 / +0.2% 0.51 / 0.47 / +7.8%
tpch_q12/duckdb:vortex-file-compressed 13693347 / 14552453 / -5.9% 25593291 / 27518794 / -7.0% 0.54 / 0.53 / +1.2%
tpch_q13/duckdb:vortex-file-compressed 20112143 / 19645042 / +2.4% 31911476 / 32940206 / -3.1% 0.63 / 0.60 / +5.7%
tpch_q14/duckdb:vortex-file-compressed 13135842 / 11380023 / +15.4% 🔴 25513815 / 24837163 / +2.7% 0.51 / 0.46 / +12.4%
tpch_q15/duckdb:vortex-file-compressed 7435898 / 8545626 / -13.0% 🟢 17944882 / 20629863 / -13.0% 🟢 0.41 / 0.41 / +0.0%
tpch_q16/duckdb:vortex-file-compressed 18493432 / 16616443 / +11.3% 🔴 24907210 / 22882070 / +8.9% 0.74 / 0.73 / +2.2%
tpch_q17/duckdb:vortex-file-compressed 11184701 / 12625912 / -11.4% 🟢 28013613 / 26443070 / +5.9% 0.40 / 0.48 / -16.4%
tpch_q18/duckdb:vortex-file-compressed 23711217 / 24532908 / -3.3% 34243858 / 34479790 / -0.7% 0.69 / 0.71 / -2.7%
tpch_q19/duckdb:vortex-file-compressed 12543272 / 12047148 / +4.1% 26696792 / 25716209 / +3.8% 0.47 / 0.47 / +0.3%
tpch_q20/duckdb:vortex-file-compressed 14074287 / 14345954 / -1.9% 29254676 / 30444524 / -3.9% 0.48 / 0.47 / +2.1%
tpch_q21/duckdb:vortex-file-compressed 34762566 / 37122052 / -6.4% 56539018 / 57121904 / -1.0% 0.61 / 0.65 / -5.4%
tpch_q22/duckdb:vortex-file-compressed 21462768 / 16816566 / +27.6% 🔴 28468488 / 25979595 / +9.6% 0.75 / 0.65 / +16.5%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47628335 / 47858045 / -0.5% 53825954 / 54404459 / -1.1% 0.88 / 0.88 / +0.6%
tpch_q02/duckdb:parquet 48212500 / 48336474 / -0.3% 55513362 / 55353685 / +0.3% 0.87 / 0.87 / -0.5%
tpch_q03/duckdb:parquet 60413537 / 60227192 / +0.3% 68025789 / 68349323 / -0.5% 0.89 / 0.88 / +0.8%
tpch_q04/duckdb:parquet 34569164 / 34720265 / -0.4% 42406346 / 43310065 / -2.1% 0.82 / 0.80 / +1.7%
tpch_q05/duckdb:parquet 67213531 / 67254941 / -0.1% 77044834 / 77626992 / -0.7% 0.87 / 0.87 / +0.7%
tpch_q06/duckdb:parquet 21495595 / 21944900 / -2.0% 27435473 / 27248080 / +0.7% 0.78 / 0.81 / -2.7%
tpch_q07/duckdb:parquet 63635499 / 63950143 / -0.5% 72459741 / 73664982 / -1.6% 0.88 / 0.87 / +1.2%
tpch_q08/duckdb:parquet 75543310 / 75776774 / -0.3% 86041537 / 86626463 / -0.7% 0.88 / 0.87 / +0.4%
tpch_q09/duckdb:parquet 107601065 / 107707033 / -0.1% 117575703 / 119514067 / -1.6% 0.92 / 0.90 / +1.5%
tpch_q10/duckdb:parquet 105452610 / 105854709 / -0.4% 116366620 / 118365462 / -1.7% 0.91 / 0.89 / +1.3%
tpch_q11/duckdb:parquet 29264408 / 29396110 / -0.4% 34542361 / 34577937 / -0.1% 0.85 / 0.85 / -0.3%
tpch_q12/duckdb:parquet 37123536 / 37190745 / -0.2% 43425980 / 44080916 / -1.5% 0.85 / 0.84 / +1.3%
tpch_q13/duckdb:parquet 174860202 / 174943548 / -0.0% 181868217 / 181832631 / +0.0% 0.96 / 0.96 / -0.1%
tpch_q14/duckdb:parquet 42364691 / 42368298 / -0.0% 51209178 / 51640657 / -0.8% 0.83 / 0.82 / +0.8%
tpch_q15/duckdb:parquet 32447703 / 32604664 / -0.5% 40620958 / 41186217 / -1.4% 0.80 / 0.79 / +0.9%
tpch_q16/duckdb:parquet 47096674 / 47438886 / -0.7% 52636380 / 52839714 / -0.4% 0.89 / 0.90 / -0.3%
tpch_q17/duckdb:parquet 47908327 / 47948653 / -0.1% 56863081 / 56916284 / -0.1% 0.84 / 0.84 / +0.0%
tpch_q18/duckdb:parquet 74228570 / 74218067 / +0.0% 79863906 / 81836806 / -2.4% 0.93 / 0.91 / +2.5%
tpch_q19/duckdb:parquet 49105394 / 47859814 / +2.6% 54475787 / 54599501 / -0.2% 0.90 / 0.88 / +2.8%
tpch_q20/duckdb:parquet 63378881 / 63470737 / -0.1% 73129020 / 74451035 / -1.8% 0.87 / 0.85 / +1.7%
tpch_q21/duckdb:parquet 106153945 / 106811631 / -0.6% 114894452 / 115756341 / -0.7% 0.92 / 0.92 / +0.1%
tpch_q22/duckdb:parquet 50394563 / 50510487 / -0.2% 58485634 / 58832593 / -0.6% 0.86 / 0.86 / +0.4%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR f86626f0 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.9%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-7.1%, low confidence)
Vortex (geomean): hot 0.957x ➖ · cold 0.940x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.981x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92979687 / 92421374 / +0.6% 154354984 / 147337644 / +4.8% 0.60 / 0.63 / -4.0%
tpch_q02/datafusion:vortex-file-compressed 64314482 / 65027104 / -1.1% 94342782 / 94796662 / -0.5% 0.68 / 0.69 / -0.6%
tpch_q03/datafusion:vortex-file-compressed 62587020 / 63028520 / -0.7% 115576859 / 120349559 / -4.0% 0.54 / 0.52 / +3.4%
tpch_q04/datafusion:vortex-file-compressed 33752274 / 33815475 / -0.2% 73308517 / 69506239 / +5.5% 0.46 / 0.49 / -5.4%
tpch_q05/datafusion:vortex-file-compressed 117679208 / 117313380 / +0.3% 167321329 / 176710106 / -5.3% 0.70 / 0.66 / +5.9%
tpch_q06/datafusion:vortex-file-compressed 10237365 / 10725012 / -4.5% 56254740 / 57362676 / -1.9% 0.18 / 0.19 / -2.7%
tpch_q07/datafusion:vortex-file-compressed 133184723 / 134275774 / -0.8% 188490548 / 209952759 / -10.2% 🟢 0.71 / 0.64 / +10.5%
tpch_q08/datafusion:vortex-file-compressed 141453642 / 142650106 / -0.8% 214065199 / 221708280 / -3.4% 0.66 / 0.64 / +2.7%
tpch_q09/datafusion:vortex-file-compressed 182044272 / 184132835 / -1.1% 254050561 / 257568148 / -1.4% 0.72 / 0.71 / +0.2%
tpch_q10/datafusion:vortex-file-compressed 69349352 / 69455539 / -0.2% 129863282 / 134716861 / -3.6% 0.53 / 0.52 / +3.6%
tpch_q11/datafusion:vortex-file-compressed 42940165 / 43143661 / -0.5% 68465965 / 67640381 / +1.2% 0.63 / 0.64 / -1.7%
tpch_q12/datafusion:vortex-file-compressed 34822788 / 35061881 / -0.7% 77757870 / 85227270 / -8.8% 0.45 / 0.41 / +8.9%
tpch_q13/datafusion:vortex-file-compressed 48124282 / 48574220 / -0.9% 79301584 / 87462734 / -9.3% 0.61 / 0.56 / +9.3%
tpch_q14/datafusion:vortex-file-compressed 20840412 / 21632584 / -3.7% 84633411 / 86011756 / -1.6% 0.25 / 0.25 / -2.1%
tpch_q15/datafusion:vortex-file-compressed 33478943 / 33883815 / -1.2% 90338968 / 91939519 / -1.7% 0.37 / 0.37 / +0.6%
tpch_q16/datafusion:vortex-file-compressed 36641005 / 37360931 / -1.9% 69357269 / 67235326 / +3.2% 0.53 / 0.56 / -4.9%
tpch_q17/datafusion:vortex-file-compressed 177587622 / 179258740 / -0.9% 289306486 / 225548853 / +28.3% 🔴 0.61 / 0.79 / -22.8%
tpch_q18/datafusion:vortex-file-compressed 205652239 / 208064713 / -1.2% 273496802 / 265841334 / +2.9% 0.75 / 0.78 / -3.9%
tpch_q19/datafusion:vortex-file-compressed 28913162 / 30852811 / -6.3% 88921949 / 90459069 / -1.7% 0.33 / 0.34 / -4.7%
tpch_q20/datafusion:vortex-file-compressed 60741233 / 60119739 / +1.0% 113846038 / 116242771 / -2.1% 0.53 / 0.52 / +3.2%
tpch_q21/datafusion:vortex-file-compressed 179835774 / 179920903 / -0.0% 244978407 / 236016105 / +3.8% 0.73 / 0.76 / -3.7%
tpch_q22/datafusion:vortex-file-compressed 25054867 / 24937759 / +0.5% 53974274 / 53553354 / +0.8% 0.46 / 0.47 / -0.3%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87905316 / 87372046 / +0.6% 122446976 / 127117134 / -3.7% 0.72 / 0.69 / +4.4%
tpch_q02/datafusion:parquet 172978941 / 173541457 / -0.3% 196597642 / 200787531 / -2.1% 0.88 / 0.86 / +1.8%
tpch_q03/datafusion:parquet 135044485 / 135400852 / -0.3% 180479226 / 177515979 / +1.7% 0.75 / 0.76 / -1.9%
tpch_q04/datafusion:parquet 57115105 / 57301728 / -0.3% 85794216 / 90634805 / -5.3% 0.67 / 0.63 / +5.3%
tpch_q05/datafusion:parquet 166445467 / 167450726 / -0.6% 218954456 / 216918602 / +0.9% 0.76 / 0.77 / -1.5%
tpch_q06/datafusion:parquet 36337146 / 36759711 / -1.1% 73160597 / 73377160 / -0.3% 0.50 / 0.50 / -0.9%
tpch_q07/datafusion:parquet 214714089 / 217452485 / -1.3% 269853920 / 278757728 / -3.2% 0.80 / 0.78 / +2.0%
tpch_q08/datafusion:parquet 217068929 / 217547432 / -0.2% 280402120 / 281050041 / -0.2% 0.77 / 0.77 / +0.0%
tpch_q09/datafusion:parquet 308734262 / 309992739 / -0.4% 367680837 / 377617099 / -2.6% 0.84 / 0.82 / +2.3%
tpch_q10/datafusion:parquet 312088499 / 312607055 / -0.2% 358818661 / 374635413 / -4.2% 0.87 / 0.83 / +4.2%
tpch_q11/datafusion:parquet 127168592 / 126904955 / +0.2% 146828900 / 152092729 / -3.5% 0.87 / 0.83 / +3.8%
tpch_q12/datafusion:parquet 82263266 / 82490217 / -0.3% 115765817 / 119609598 / -3.2% 0.71 / 0.69 / +3.0%
tpch_q13/datafusion:parquet 210117007 / 210792627 / -0.3% 238903211 / 238505978 / +0.2% 0.88 / 0.88 / -0.5%
tpch_q14/datafusion:parquet 85284941 / 86178289 / -1.0% 192061757 / 190854700 / +0.6% 0.44 / 0.45 / -1.7%
tpch_q15/datafusion:parquet 105912184 / 106397081 / -0.5% 149808183 / 152062782 / -1.5% 0.71 / 0.70 / +1.0%
tpch_q16/datafusion:parquet 94785773 / 95891635 / -1.2% 121426357 / 122835240 / -1.1% 0.78 / 0.78 / -0.0%
tpch_q17/datafusion:parquet 214045485 / 215828919 / -0.8% 259396068 / 258232254 / +0.5% 0.83 / 0.84 / -1.3%
tpch_q18/datafusion:parquet 268551331 / 267911042 / +0.2% 315561099 / 315891179 / -0.1% 0.85 / 0.85 / +0.3%
tpch_q19/datafusion:parquet 107529911 / 108165843 / -0.6% 163189325 / 161949085 / +0.8% 0.66 / 0.67 / -1.3%
tpch_q20/datafusion:parquet 185924163 / 185545816 / +0.2% 249162133 / 247539770 / +0.7% 0.75 / 0.75 / -0.4%
tpch_q21/datafusion:parquet 241560928 / 244526968 / -1.2% 307358648 / 313261935 / -1.9% 0.79 / 0.78 / +0.7%
tpch_q22/datafusion:parquet 149606354 / 150249864 / -0.4% 175458987 / 175023324 / +0.2% 0.85 / 0.86 / -0.7%
duckdb / vortex-file-compressed / ns (0.926x ➖, 6↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 30385651 / 33717250 / -9.9% 54240084 / 72546071 / -25.2% 🟢 0.56 / 0.46 / +20.5%
tpch_q02/duckdb:vortex-file-compressed 27349289 / 28535483 / -4.2% 42576853 / 42812168 / -0.5% 0.64 / 0.67 / -3.6%
tpch_q03/duckdb:vortex-file-compressed 49784771 / 52395190 / -5.0% 91208642 / 107856916 / -15.4% 🟢 0.55 / 0.49 / +12.4%
tpch_q04/duckdb:vortex-file-compressed 50199340 / 51642374 / -2.8% 75900194 / 90715191 / -16.3% 🟢 0.66 / 0.57 / +16.2%
tpch_q05/duckdb:vortex-file-compressed 66535909 / 68284064 / -2.6% 100470858 / 112287453 / -10.5% 🟢 0.66 / 0.61 / +8.9%
tpch_q06/duckdb:vortex-file-compressed 12007892 / 15523980 / -22.6% 🟢 42965275 / 54001994 / -20.4% 🟢 0.28 / 0.29 / -2.8%
tpch_q07/duckdb:vortex-file-compressed 53196157 / 56289317 / -5.5% 99236959 / 109517607 / -9.4% 0.54 / 0.51 / +4.3%
tpch_q08/duckdb:vortex-file-compressed 85188280 / 87993665 / -3.2% 119959787 / 136034326 / -11.8% 🟢 0.71 / 0.65 / +9.8%
tpch_q09/duckdb:vortex-file-compressed 96419154 / 104478542 / -7.7% 142462950 / 160545830 / -11.3% 🟢 0.68 / 0.65 / +4.0%
tpch_q10/duckdb:vortex-file-compressed 85858191 / 96530974 / -11.1% 🟢 124301030 / 149480239 / -16.8% 🟢 0.69 / 0.65 / +7.0%
tpch_q11/duckdb:vortex-file-compressed 12319294 / 13271624 / -7.2% 29452135 / 28437282 / +3.6% 0.42 / 0.47 / -10.4%
tpch_q12/duckdb:vortex-file-compressed 42586043 / 44829286 / -5.0% 68654579 / 82101250 / -16.4% 🟢 0.62 / 0.55 / +13.6%
tpch_q13/duckdb:vortex-file-compressed 68781146 / 73482635 / -6.4% 90315922 / 100644151 / -10.3% 🟢 0.76 / 0.73 / +4.3%
tpch_q14/duckdb:vortex-file-compressed 26065411 / 28597524 / -8.9% 69091894 / 75301257 / -8.2% 0.38 / 0.38 / -0.7%
tpch_q15/duckdb:vortex-file-compressed 20658119 / 24850425 / -16.9% 🟢 55033624 / 64680737 / -14.9% 🟢 0.38 / 0.38 / -2.3%
tpch_q16/duckdb:vortex-file-compressed 42618710 / 48665139 / -12.4% 🟢 53124485 / 57917111 / -8.3% 0.80 / 0.84 / -4.5%
tpch_q17/duckdb:vortex-file-compressed 32683058 / 35017407 / -6.7% 64133183 / 68787564 / -6.8% 0.51 / 0.51 / +0.1%
tpch_q18/duckdb:vortex-file-compressed 101645057 / 101349193 / +0.3% 115189766 / 121104468 / -4.9% 0.88 / 0.84 / +5.4%
tpch_q19/duckdb:vortex-file-compressed 23216930 / 27586274 / -15.8% 🟢 69548910 / 75468750 / -7.8% 0.33 / 0.37 / -8.7%
tpch_q20/duckdb:vortex-file-compressed 36113593 / 42028653 / -14.1% 🟢 76007491 / 94143242 / -19.3% 🟢 0.48 / 0.45 / +6.4%
tpch_q21/duckdb:vortex-file-compressed 87569296 / 92926669 / -5.8% 131497837 / 149459387 / -12.0% 🟢 0.67 / 0.62 / +7.1%
tpch_q22/duckdb:vortex-file-compressed 38590434 / 32967821 / +17.1% 🔴 51309330 / 50673568 / +1.3% 0.75 / 0.65 / +15.6%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67283444 / 68059780 / -1.1% 88465843 / 89550266 / -1.2% 0.76 / 0.76 / +0.1%
tpch_q02/duckdb:parquet 86535401 / 87335480 / -0.9% 97221957 / 97718209 / -0.5% 0.89 / 0.89 / -0.4%
tpch_q03/duckdb:parquet 109891619 / 110511015 / -0.6% 137720138 / 142463897 / -3.3% 0.80 / 0.78 / +2.9%
tpch_q04/duckdb:parquet 76038902 / 76502436 / -0.6% 96930955 / 99440715 / -2.5% 0.78 / 0.77 / +2.0%
tpch_q05/duckdb:parquet 133505695 / 124172926 / +7.5% 155311626 / 157124433 / -1.2% 0.86 / 0.79 / +8.8%
tpch_q06/duckdb:parquet 35427804 / 35619223 / -0.5% 56337065 / 66005123 / -14.6% 🟢 0.63 / 0.54 / +16.5%
tpch_q07/duckdb:parquet 116450864 / 117398526 / -0.8% 153954797 / 154106673 / -0.1% 0.76 / 0.76 / -0.7%
tpch_q08/duckdb:parquet 146919466 / 147136506 / -0.1% 186873079 / 191273949 / -2.3% 0.79 / 0.77 / +2.2%
tpch_q09/duckdb:parquet 236664419 / 236712079 / -0.0% 276524825 / 283406742 / -2.4% 0.86 / 0.84 / +2.5%
tpch_q10/duckdb:parquet 312799778 / 314185931 / -0.4% 336089456 / 343372079 / -2.1% 0.93 / 0.92 / +1.7%
tpch_q11/duckdb:parquet 43303681 / 43742423 / -1.0% 50659559 / 50965528 / -0.6% 0.85 / 0.86 / -0.4%
tpch_q12/duckdb:parquet 69345888 / 71137236 / -2.5% 92714416 / 91779500 / +1.0% 0.75 / 0.78 / -3.5%
tpch_q13/duckdb:parquet 293176686 / 293366910 / -0.1% 305543737 / 308621731 / -1.0% 0.96 / 0.95 / +0.9%
tpch_q14/duckdb:parquet 100229233 / 102273386 / -2.0% 139469848 / 141851063 / -1.7% 0.72 / 0.72 / -0.3%
tpch_q15/duckdb:parquet 57787121 / 57070305 / +1.3% 86488246 / 86533692 / -0.1% 0.67 / 0.66 / +1.3%
tpch_q16/duckdb:parquet 100041047 / 100916878 / -0.9% 106015577 / 107993358 / -1.8% 0.94 / 0.93 / +1.0%
tpch_q17/duckdb:parquet 81115936 / 82884448 / -2.1% 111147647 / 124989202 / -11.1% 🟢 0.73 / 0.66 / +10.1%
tpch_q18/duckdb:parquet 157613065 / 157350187 / +0.2% 175237650 / 174516370 / +0.4% 0.90 / 0.90 / -0.2%
tpch_q19/duckdb:parquet 97135838 / 98221882 / -1.1% 127484511 / 134004453 / -4.9% 0.76 / 0.73 / +4.0%
tpch_q20/duckdb:parquet 146400301 / 147378796 / -0.7% 180411325 / 187264562 / -3.7% 0.81 / 0.79 / +3.1%
tpch_q21/duckdb:parquet 252835950 / 251811968 / +0.4% 277379297 / 275521800 / +0.7% 0.91 / 0.91 / -0.3%
tpch_q22/duckdb:parquet 167824399 / 168385842 / -0.3% 179596335 / 180610188 / -0.6% 0.93 / 0.93 / +0.2%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR f86626f0 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+5.6%, low confidence)
Vortex (geomean): hot 1.027x ➖ · cold 1.016x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.999x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20985667 / 21075930 / -0.4% 39569427 / 38638247 / +2.4% 0.53 / 0.55 / -2.8%
tpcds_q02/datafusion:vortex-file-compressed 44206353 / 44337330 / -0.3% 64527146 / 64322678 / +0.3% 0.69 / 0.69 / -0.6%
tpcds_q03/datafusion:vortex-file-compressed 11221326 / 11162676 / +0.5% 27594699 / 27874319 / -1.0% 0.41 / 0.40 / +1.5%
tpcds_q04/datafusion:vortex-file-compressed 87261793 / 86734277 / +0.6% 114229445 / 118451152 / -3.6% 0.76 / 0.73 / +4.3%
tpcds_q05/datafusion:vortex-file-compressed 56890616 / 56827797 / +0.1% 77988739 / 76114099 / +2.5% 0.73 / 0.75 / -2.3%
tpcds_q06/datafusion:vortex-file-compressed 22585510 / 22692446 / -0.5% 42287318 / 42045614 / +0.6% 0.53 / 0.54 / -1.0%
tpcds_q07/datafusion:vortex-file-compressed 28588808 / 28756891 / -0.6% 50988247 / 50270298 / +1.4% 0.56 / 0.57 / -2.0%
tpcds_q08/datafusion:vortex-file-compressed 24690453 / 24565008 / +0.5% 44452040 / 44075611 / +0.9% 0.56 / 0.56 / -0.3%
tpcds_q09/datafusion:vortex-file-compressed 20657426 / 21207415 / -2.6% 38369007 / 35851284 / +7.0% 0.54 / 0.59 / -9.0%
tpcds_q10/datafusion:vortex-file-compressed 27033725 / 27171788 / -0.5% 50564521 / 48716984 / +3.8% 0.53 / 0.56 / -4.1%
tpcds_q11/datafusion:vortex-file-compressed 52036462 / 52909560 / -1.7% 81623339 / 79987379 / +2.0% 0.64 / 0.66 / -3.6%
tpcds_q12/datafusion:vortex-file-compressed 14705105 / 14883221 / -1.2% 31289049 / 31358319 / -0.2% 0.47 / 0.47 / -1.0%
tpcds_q13/datafusion:vortex-file-compressed 31174560 / 31185554 / -0.0% 58716481 / 56269502 / +4.3% 0.53 / 0.55 / -4.2%
tpcds_q14/datafusion:vortex-file-compressed 486103466 / 489067088 / -0.6% 545269439 / 543494011 / +0.3% 0.89 / 0.90 / -0.9%
tpcds_q15/datafusion:vortex-file-compressed 12809936 / 12361730 / +3.6% 33138288 / 32624708 / +1.6% 0.39 / 0.38 / +2.0%
tpcds_q16/datafusion:vortex-file-compressed 18288326 / 18767600 / -2.6% 39477694 / 37497209 / +5.3% 0.46 / 0.50 / -7.4%
tpcds_q17/datafusion:vortex-file-compressed 53593884 / 54689321 / -2.0% 77742941 / 71444295 / +8.8% 0.69 / 0.77 / -9.9%
tpcds_q18/datafusion:vortex-file-compressed 62832384 / 62745430 / +0.1% 83986898 / 84923290 / -1.1% 0.75 / 0.74 / +1.3%
tpcds_q19/datafusion:vortex-file-compressed 16605782 / 16953830 / -2.1% 37304694 / 38328755 / -2.7% 0.45 / 0.44 / +0.6%
tpcds_q20/datafusion:vortex-file-compressed 16190744 / 15971812 / +1.4% 35008558 / 36958911 / -5.3% 0.46 / 0.43 / +7.0%
tpcds_q21/datafusion:vortex-file-compressed 15899160 / 16341850 / -2.7% 37701167 / 37152728 / +1.5% 0.42 / 0.44 / -4.1%
tpcds_q22/datafusion:vortex-file-compressed 48962410 / 49281792 / -0.6% 72038787 / 72884478 / -1.2% 0.68 / 0.68 / +0.5%
tpcds_q23/datafusion:vortex-file-compressed 69989466 / 70660138 / -0.9% 96822904 / 98187087 / -1.4% 0.72 / 0.72 / +0.4%
tpcds_q24/datafusion:vortex-file-compressed 65391428 / 64849742 / +0.8% 85525837 / 85912267 / -0.4% 0.76 / 0.75 / +1.3%
tpcds_q25/datafusion:vortex-file-compressed 48097778 / 48102446 / -0.0% 66520852 / 73606543 / -9.6% 0.72 / 0.65 / +10.6%
tpcds_q26/datafusion:vortex-file-compressed 25928746 / 25675571 / +1.0% 47117277 / 46144233 / +2.1% 0.55 / 0.56 / -1.1%
tpcds_q27/datafusion:vortex-file-compressed 61111354 / 57037719 / +7.1% 81164668 / 79256017 / +2.4% 0.75 / 0.72 / +4.6%
tpcds_q28/datafusion:vortex-file-compressed 24458206 / 24421590 / +0.1% 38552689 / 41637022 / -7.4% 0.63 / 0.59 / +8.2%
tpcds_q29/datafusion:vortex-file-compressed 53064470 / 53192800 / -0.2% 76753064 / 75657345 / +1.4% 0.69 / 0.70 / -1.7%
tpcds_q30/datafusion:vortex-file-compressed 26036614 / 25828708 / +0.8% 43658953 / 43291925 / +0.8% 0.60 / 0.60 / -0.0%
tpcds_q31/datafusion:vortex-file-compressed 58143904 / 58867606 / -1.2% 81573492 / 83455412 / -2.3% 0.71 / 0.71 / +1.0%
tpcds_q32/datafusion:vortex-file-compressed 12490690 / 12386412 / +0.8% 29692955 / 28927311 / +2.6% 0.42 / 0.43 / -1.8%
tpcds_q33/datafusion:vortex-file-compressed 27515891 / 27251526 / +1.0% 50584199 / 48738507 / +3.8% 0.54 / 0.56 / -2.7%
tpcds_q34/datafusion:vortex-file-compressed 17554142 / 17480834 / +0.4% 34814753 / 34421823 / +1.1% 0.50 / 0.51 / -0.7%
tpcds_q35/datafusion:vortex-file-compressed 30216490 / 30075320 / +0.5% 53036022 / 53053102 / -0.0% 0.57 / 0.57 / +0.5%
tpcds_q36/datafusion:vortex-file-compressed 46937306 / 46675208 / +0.6% 70276610 / 69079110 / +1.7% 0.67 / 0.68 / -1.2%
tpcds_q37/datafusion:vortex-file-compressed 11665070 / 11904318 / -2.0% 33708161 / 33415021 / +0.9% 0.35 / 0.36 / -2.9%
tpcds_q38/datafusion:vortex-file-compressed 25686708 / 25706742 / -0.1% 46375248 / 46753111 / -0.8% 0.55 / 0.55 / +0.7%
tpcds_q39/datafusion:vortex-file-compressed 64132582 / 64869784 / -1.1% 88995956 / 89570934 / -0.6% 0.72 / 0.72 / -0.5%
tpcds_q40/datafusion:vortex-file-compressed 23246578 / 23325174 / -0.3% 42261329 / 42047023 / +0.5% 0.55 / 0.55 / -0.8%
tpcds_q41/datafusion:vortex-file-compressed 20672428 / 20342688 / +1.6% 32131909 / 31695807 / +1.4% 0.64 / 0.64 / +0.2%
tpcds_q42/datafusion:vortex-file-compressed 10882946 / 10755524 / +1.2% 27617761 / 26462137 / +4.4% 0.39 / 0.41 / -3.0%
tpcds_q43/datafusion:vortex-file-compressed 12310152 / 12549322 / -1.9% 32400717 / 31280405 / +3.6% 0.38 / 0.40 / -5.3%
tpcds_q44/datafusion:vortex-file-compressed 28661983 / 28515654 / +0.5% 50940155 / 50995861 / -0.1% 0.56 / 0.56 / +0.6%
tpcds_q45/datafusion:vortex-file-compressed 16074227 / 16298120 / -1.4% 34606787 / 33457337 / +3.4% 0.46 / 0.49 / -4.6%
tpcds_q46/datafusion:vortex-file-compressed 23178380 / 23229427 / -0.2% 47621788 / 44755548 / +6.4% 0.49 / 0.52 / -6.2%
tpcds_q47/datafusion:vortex-file-compressed 74733242 / 74695810 / +0.1% 104602968 / 101833669 / +2.7% 0.71 / 0.73 / -2.6%
tpcds_q48/datafusion:vortex-file-compressed 28702738 / 28485442 / +0.8% 52194475 / 50825432 / +2.7% 0.55 / 0.56 / -1.9%
tpcds_q49/datafusion:vortex-file-compressed 58073330 / 56616678 / +2.6% 78403899 / 79193807 / -1.0% 0.74 / 0.71 / +3.6%
tpcds_q50/datafusion:vortex-file-compressed 30191346 / 30225275 / -0.1% 50340943 / 51542216 / -2.3% 0.60 / 0.59 / +2.3%
tpcds_q51/datafusion:vortex-file-compressed 66201824 / 66238316 / -0.1% 86771523 / 85961923 / +0.9% 0.76 / 0.77 / -1.0%
tpcds_q52/datafusion:vortex-file-compressed 11441372 / 11173757 / +2.4% 25690374 / 26707892 / -3.8% 0.45 / 0.42 / +6.5%
tpcds_q53/datafusion:vortex-file-compressed 17702294 / 17815272 / -0.6% 39629452 / 38592794 / +2.7% 0.45 / 0.46 / -3.2%
tpcds_q54/datafusion:vortex-file-compressed 31457925 / 31294044 / +0.5% 54476132 / 54411096 / +0.1% 0.58 / 0.58 / +0.4%
tpcds_q55/datafusion:vortex-file-compressed 11006003 / 10977064 / +0.3% 24897515 / 26445815 / -5.9% 0.44 / 0.42 / +6.5%
tpcds_q56/datafusion:vortex-file-compressed 26586408 / 26267608 / +1.2% 46359131 / 47242232 / -1.9% 0.57 / 0.56 / +3.1%
tpcds_q57/datafusion:vortex-file-compressed 61507022 / 61853212 / -0.6% 86732195 / 86088207 / +0.7% 0.71 / 0.72 / -1.3%
tpcds_q58/datafusion:vortex-file-compressed 38030092 / 38380444 / -0.9% 63480502 / 63376054 / +0.2% 0.60 / 0.61 / -1.1%
tpcds_q59/datafusion:vortex-file-compressed 29675802 / 29424571 / +0.9% 53719648 / 53366384 / +0.7% 0.55 / 0.55 / +0.2%
tpcds_q60/datafusion:vortex-file-compressed 26091669 / 25428852 / +2.6% 46739807 / 46248957 / +1.1% 0.56 / 0.55 / +1.5%
tpcds_q61/datafusion:vortex-file-compressed 21453583 / 21069785 / +1.8% 42991169 / 42650322 / +0.8% 0.50 / 0.49 / +1.0%
tpcds_q62/datafusion:vortex-file-compressed 16537382 / 16464280 / +0.4% 33651166 / 34481569 / -2.4% 0.49 / 0.48 / +2.9%
tpcds_q63/datafusion:vortex-file-compressed 17562084 / 17537600 / +0.1% 39056643 / 37514994 / +4.1% 0.45 / 0.47 / -3.8%
tpcds_q64/datafusion:vortex-file-compressed 210193973 / 209658176 / +0.3% 246275324 / 244014821 / +0.9% 0.85 / 0.86 / -0.7%
tpcds_q65/datafusion:vortex-file-compressed 71341684 / 71931186 / -0.8% 94140924 / 93293623 / +0.9% 0.76 / 0.77 / -1.7%
tpcds_q66/datafusion:vortex-file-compressed 49777534 / 50314022 / -1.1% 72879766 / 73443461 / -0.8% 0.68 / 0.69 / -0.3%
tpcds_q67/datafusion:vortex-file-compressed 50587285 / 50809885 / -0.4% 81628086 / 80439935 / +1.5% 0.62 / 0.63 / -1.9%
tpcds_q68/datafusion:vortex-file-compressed 22504868 / 22935066 / -1.9% 44385669 / 46212376 / -4.0% 0.51 / 0.50 / +2.2%
tpcds_q69/datafusion:vortex-file-compressed 25263604 / 25957220 / -2.7% 48150114 / 48199065 / -0.1% 0.52 / 0.54 / -2.6%
tpcds_q70/datafusion:vortex-file-compressed 70964870 / 70921686 / +0.1% 95383888 / 91526378 / +4.2% 0.74 / 0.77 / -4.0%
tpcds_q71/datafusion:vortex-file-compressed 18574734 / 19479654 / -4.6% 39501770 / 39385822 / +0.3% 0.47 / 0.49 / -4.9%
tpcds_q72/datafusion:vortex-file-compressed 353603414 / 349635619 / +1.1% 404746262 / 390053124 / +3.8% 0.87 / 0.90 / -2.5%
tpcds_q73/datafusion:vortex-file-compressed 16194162 / 16370256 / -1.1% 36034609 / 35825318 / +0.6% 0.45 / 0.46 / -1.7%
tpcds_q74/datafusion:vortex-file-compressed 39457734 / 40729710 / -3.1% 66758569 / 66101755 / +1.0% 0.59 / 0.62 / -4.1%
tpcds_q75/datafusion:vortex-file-compressed 134005322 / 133231577 / +0.6% 158743945 / 159508865 / -0.5% 0.84 / 0.84 / +1.1%
tpcds_q76/datafusion:vortex-file-compressed 29500502 / 29878010 / -1.3% 48283096 / 49131830 / -1.7% 0.61 / 0.61 / +0.5%
tpcds_q77/datafusion:vortex-file-compressed 44369857 / 44794824 / -0.9% 65999719 / 68725579 / -4.0% 0.67 / 0.65 / +3.1%
tpcds_q78/datafusion:vortex-file-compressed 63832265 / 64149016 / -0.5% 90905876 / 91826652 / -1.0% 0.70 / 0.70 / +0.5%
tpcds_q79/datafusion:vortex-file-compressed 19626766 / 19747138 / -0.6% 42883112 / 41330856 / +3.8% 0.46 / 0.48 / -4.2%
tpcds_q80/datafusion:vortex-file-compressed 71981582 / 73516756 / -2.1% 102147000 / 103399339 / -1.2% 0.70 / 0.71 / -0.9%
tpcds_q81/datafusion:vortex-file-compressed 25891241 / 26433507 / -2.1% 44233065 / 44049315 / +0.4% 0.59 / 0.60 / -2.5%
tpcds_q82/datafusion:vortex-file-compressed 11998038 / 12061347 / -0.5% 33773995 / 33334269 / +1.3% 0.36 / 0.36 / -1.8%
tpcds_q83/datafusion:vortex-file-compressed 32823495 / 32437804 / +1.2% 51399674 / 52048289 / -1.2% 0.64 / 0.62 / +2.5%
tpcds_q84/datafusion:vortex-file-compressed 10046852 / 10107068 / -0.6% 26667793 / 25586667 / +4.2% 0.38 / 0.40 / -4.6%
tpcds_q85/datafusion:vortex-file-compressed 53026027 / 53327322 / -0.6% 78700193 / 79919547 / -1.5% 0.67 / 0.67 / +1.0%
tpcds_q86/datafusion:vortex-file-compressed 15362660 / 15658314 / -1.9% 33229582 / 32167556 / +3.3% 0.46 / 0.49 / -5.0%
tpcds_q87/datafusion:vortex-file-compressed 25831950 / 26232334 / -1.5% 48628251 / 48269535 / +0.7% 0.53 / 0.54 / -2.3%
tpcds_q88/datafusion:vortex-file-compressed 31997004 / 31404654 / +1.9% 49803807 / 50217706 / -0.8% 0.64 / 0.63 / +2.7%
tpcds_q89/datafusion:vortex-file-compressed 20727459 / 20857143 / -0.6% 40524219 / 40998842 / -1.2% 0.51 / 0.51 / +0.5%
tpcds_q90/datafusion:vortex-file-compressed 9828548 / 9857710 / -0.3% 23621168 / 24004775 / -1.6% 0.42 / 0.41 / +1.3%
tpcds_q91/datafusion:vortex-file-compressed 15958614 / 16590985 / -3.8% 36792372 / 36406808 / +1.1% 0.43 / 0.46 / -4.8%
tpcds_q92/datafusion:vortex-file-compressed 13059765 / 12785642 / +2.1% 27795692 / 28212901 / -1.5% 0.47 / 0.45 / +3.7%
tpcds_q93/datafusion:vortex-file-compressed 20114826 / 20514612 / -1.9% 41253153 / 39172325 / +5.3% 0.49 / 0.52 / -6.9%
tpcds_q94/datafusion:vortex-file-compressed 18057560 / 18329141 / -1.5% 36953012 / 37017769 / -0.2% 0.49 / 0.50 / -1.3%
tpcds_q95/datafusion:vortex-file-compressed 41856180 / 41892583 / -0.1% 63333787 / 60792282 / +4.2% 0.66 / 0.69 / -4.1%
tpcds_q96/datafusion:vortex-file-compressed 7657789 / 7680347 / -0.3% 24243566 / 24590568 / -1.4% 0.32 / 0.31 / +1.1%
tpcds_q97/datafusion:vortex-file-compressed 17026988 / 16976546 / +0.3% 36105366 / 36962622 / -2.3% 0.47 / 0.46 / +2.7%
tpcds_q98/datafusion:vortex-file-compressed 16845771 / 16323012 / +3.2% 36479875 / 35491744 / +2.8% 0.46 / 0.46 / +0.4%
tpcds_q99/datafusion:vortex-file-compressed 15790176 / 16055726 / -1.7% 34528991 / 34645287 / -0.3% 0.46 / 0.46 / -1.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43491727 / 42790168 / +1.6% 58014095 / 57645148 / +0.6% 0.75 / 0.74 / +1.0%
tpcds_q02/datafusion:parquet 54396438 / 54765044 / -0.7% 68974735 / 70421354 / -2.1% 0.79 / 0.78 / +1.4%
tpcds_q03/datafusion:parquet 18769332 / 19097265 / -1.7% 29757332 / 30445091 / -2.3% 0.63 / 0.63 / +0.6%
tpcds_q04/datafusion:parquet 179755622 / 178887614 / +0.5% 206203131 / 202039145 / +2.1% 0.87 / 0.89 / -1.5%
tpcds_q05/datafusion:parquet 66909271 / 67878001 / -1.4% 90006670 / 89709488 / +0.3% 0.74 / 0.76 / -1.8%
tpcds_q06/datafusion:parquet 33795451 / 33778804 / +0.0% 47399280 / 45692699 / +3.7% 0.71 / 0.74 / -3.6%
tpcds_q07/datafusion:parquet 47115821 / 47393786 / -0.6% 64285897 / 65545052 / -1.9% 0.73 / 0.72 / +1.4%
tpcds_q08/datafusion:parquet 31409442 / 30786170 / +2.0% 46895673 / 43159155 / +8.7% 0.67 / 0.71 / -6.1%
tpcds_q09/datafusion:parquet 32298337 / 30591208 / +5.6% 42261774 / 42974319 / -1.7% 0.76 / 0.71 / +7.4%
tpcds_q10/datafusion:parquet 43811990 / 43909954 / -0.2% 59680647 / 58393927 / +2.2% 0.73 / 0.75 / -2.4%
tpcds_q11/datafusion:parquet 97824760 / 97359220 / +0.5% 119345640 / 119001225 / +0.3% 0.82 / 0.82 / +0.2%
tpcds_q12/datafusion:parquet 23797244 / 23515044 / +1.2% 34829779 / 34010680 / +2.4% 0.68 / 0.69 / -1.2%
tpcds_q13/datafusion:parquet 45919696 / 46313484 / -0.9% 67058039 / 68018563 / -1.4% 0.68 / 0.68 / +0.6%
tpcds_q14/datafusion:parquet 534254184 / 534683184 / -0.1% 577491217 / 582375794 / -0.8% 0.93 / 0.92 / +0.8%
tpcds_q15/datafusion:parquet 23762348 / 24175697 / -1.7% 37143486 / 36583322 / +1.5% 0.64 / 0.66 / -3.2%
tpcds_q16/datafusion:parquet 36862771 / 37052644 / -0.5% 49131600 / 49572893 / -0.9% 0.75 / 0.75 / +0.4%
tpcds_q17/datafusion:parquet 73275602 / 75207760 / -2.6% 97059866 / 98319183 / -1.3% 0.75 / 0.76 / -1.3%
tpcds_q18/datafusion:parquet 67423925 / 67278429 / +0.2% 87507608 / 89472378 / -2.2% 0.77 / 0.75 / +2.5%
tpcds_q19/datafusion:parquet 29309907 / 29426323 / -0.4% 42436123 / 42286597 / +0.4% 0.69 / 0.70 / -0.7%
tpcds_q20/datafusion:parquet 25303386 / 24728196 / +2.3% 36467107 / 35453048 / +2.9% 0.69 / 0.70 / -0.5%
tpcds_q21/datafusion:parquet 19811030 / 19988597 / -0.9% 30654463 / 33163707 / -7.6% 0.65 / 0.60 / +7.2%
tpcds_q22/datafusion:parquet 77348866 / 77207674 / +0.2% 87475686 / 87517272 / -0.0% 0.88 / 0.88 / +0.2%
tpcds_q23/datafusion:parquet 90380160 / 91103138 / -0.8% 112169069 / 115810894 / -3.1% 0.81 / 0.79 / +2.4%
tpcds_q24/datafusion:parquet 90739278 / 90312194 / +0.5% 112257547 / 114753768 / -2.2% 0.81 / 0.79 / +2.7%
tpcds_q25/datafusion:parquet 80218836 / 82183728 / -2.4% 99609140 / 101090115 / -1.5% 0.81 / 0.81 / -0.9%
tpcds_q26/datafusion:parquet 43021136 / 43975604 / -2.2% 60563724 / 60140227 / +0.7% 0.71 / 0.73 / -2.9%
tpcds_q27/datafusion:parquet 78414857 / 75256415 / +4.2% 99124137 / 96796596 / +2.4% 0.79 / 0.78 / +1.8%
tpcds_q28/datafusion:parquet 28578582 / 28282492 / +1.0% 40841115 / 40540051 / +0.7% 0.70 / 0.70 / +0.3%
tpcds_q29/datafusion:parquet 74722782 / 76327373 / -2.1% 94188025 / 95497789 / -1.4% 0.79 / 0.80 / -0.7%
tpcds_q30/datafusion:parquet 44024184 / 44172996 / -0.3% 56338100 / 56428909 / -0.2% 0.78 / 0.78 / -0.2%
tpcds_q31/datafusion:parquet 80812448 / 81059734 / -0.3% 94746994 / 97847034 / -3.2% 0.85 / 0.83 / +3.0%
tpcds_q32/datafusion:parquet 26544223 / 26106716 / +1.7% 40212746 / 38996408 / +3.1% 0.66 / 0.67 / -1.4%
tpcds_q33/datafusion:parquet 37421912 / 36632188 / +2.2% 53322650 / 51696853 / +3.1% 0.70 / 0.71 / -1.0%
tpcds_q34/datafusion:parquet 24129760 / 24283762 / -0.6% 34901155 / 35496823 / -1.7% 0.69 / 0.68 / +1.1%
tpcds_q35/datafusion:parquet 49583947 / 51092331 / -3.0% 64101633 / 63128294 / +1.5% 0.77 / 0.81 / -4.4%
tpcds_q36/datafusion:parquet 53297918 / 52133216 / +2.2% 70021400 / 73276361 / -4.4% 0.76 / 0.71 / +7.0%
tpcds_q37/datafusion:parquet 20950947 / 21186441 / -1.1% 35063131 / 32501720 / +7.9% 0.60 / 0.65 / -8.3%
tpcds_q38/datafusion:parquet 45373694 / 44473320 / +2.0% 61918556 / 60661224 / +2.1% 0.73 / 0.73 / -0.0%
tpcds_q39/datafusion:parquet 67429188 / 67893870 / -0.7% 85518206 / 85512997 / +0.0% 0.79 / 0.79 / -0.7%
tpcds_q40/datafusion:parquet 30231906 / 30116612 / +0.4% 49879531 / 50944751 / -2.1% 0.61 / 0.59 / +2.5%
tpcds_q41/datafusion:parquet 19764486 / 19875884 / -0.6% 31058055 / 30988887 / +0.2% 0.64 / 0.64 / -0.8%
tpcds_q42/datafusion:parquet 17923622 / 18263912 / -1.9% 29661841 / 31580411 / -6.1% 0.60 / 0.58 / +4.5%
tpcds_q43/datafusion:parquet 19528233 / 19328598 / +1.0% 31549821 / 32363765 / -2.5% 0.62 / 0.60 / +3.6%
tpcds_q44/datafusion:parquet 36706768 / 34729506 / +5.7% 49867941 / 49650609 / +0.4% 0.74 / 0.70 / +5.2%
tpcds_q45/datafusion:parquet 27793328 / 27674712 / +0.4% 40332198 / 40581829 / -0.6% 0.69 / 0.68 / +1.1%
tpcds_q46/datafusion:parquet 28949261 / 28849347 / +0.3% 45047586 / 44446206 / +1.4% 0.64 / 0.65 / -1.0%
tpcds_q47/datafusion:parquet 97959019 / 97767068 / +0.2% 119279650 / 116071791 / +2.8% 0.82 / 0.84 / -2.5%
tpcds_q48/datafusion:parquet 41631570 / 42223134 / -1.4% 59950169 / 58362840 / +2.7% 0.69 / 0.72 / -4.0%
tpcds_q49/datafusion:parquet 71316128 / 71584984 / -0.4% 92535012 / 93559482 / -1.1% 0.77 / 0.77 / +0.7%
tpcds_q50/datafusion:parquet 49315108 / 47188732 / +4.5% 65769454 / 65957634 / -0.3% 0.75 / 0.72 / +4.8%
tpcds_q51/datafusion:parquet 75785766 / 75687516 / +0.1% 93102037 / 93987537 / -0.9% 0.81 / 0.81 / +1.1%
tpcds_q52/datafusion:parquet 18399468 / 18477546 / -0.4% 29514510 / 30516528 / -3.3% 0.62 / 0.61 / +3.0%
tpcds_q53/datafusion:parquet 22506707 / 22069787 / +2.0% 39797194 / 37394397 / +6.4% 0.57 / 0.59 / -4.2%
tpcds_q54/datafusion:parquet 52519137 / 53068499 / -1.0% 66348812 / 66798825 / -0.7% 0.79 / 0.79 / -0.4%
tpcds_q55/datafusion:parquet 18281898 / 18177591 / +0.6% 28535675 / 29615062 / -3.6% 0.64 / 0.61 / +4.4%
tpcds_q56/datafusion:parquet 41042780 / 40536538 / +1.2% 55664721 / 51702806 / +7.7% 0.74 / 0.78 / -6.0%
tpcds_q57/datafusion:parquet 101204363 / 100992704 / +0.2% 116049263 / 119321534 / -2.7% 0.87 / 0.85 / +3.0%
tpcds_q58/datafusion:parquet 64703894 / 65003510 / -0.5% 83593120 / 81993727 / +2.0% 0.77 / 0.79 / -2.4%
tpcds_q59/datafusion:parquet 46474208 / 47142071 / -1.4% 64074429 / 64332209 / -0.4% 0.73 / 0.73 / -1.0%
tpcds_q60/datafusion:parquet 39750656 / 41143805 / -3.4% 53222663 / 56528494 / -5.8% 0.75 / 0.73 / +2.6%
tpcds_q61/datafusion:parquet 35688822 / 37070528 / -3.7% 50698868 / 50658408 / +0.1% 0.70 / 0.73 / -3.8%
tpcds_q62/datafusion:parquet 24723989 / 25299585 / -2.3% 37549465 / 37400865 / +0.4% 0.66 / 0.68 / -2.7%
tpcds_q63/datafusion:parquet 22376663 / 22137338 / +1.1% 37980245 / 37267059 / +1.9% 0.59 / 0.59 / -0.8%
tpcds_q64/datafusion:parquet 284728610 / 283491307 / +0.4% 319612188 / 324365594 / -1.5% 0.89 / 0.87 / +1.9%
tpcds_q65/datafusion:parquet 121209560 / 121796900 / -0.5% 139650750 / 140340790 / -0.5% 0.87 / 0.87 / +0.0%
tpcds_q66/datafusion:parquet 59690320 / 60159790 / -0.8% 74376593 / 74271493 / +0.1% 0.80 / 0.81 / -0.9%
tpcds_q67/datafusion:parquet 68512565 / 69200688 / -1.0% 91549397 / 92158955 / -0.7% 0.75 / 0.75 / -0.3%
tpcds_q68/datafusion:parquet 29001260 / 28638674 / +1.3% 46977067 / 47694525 / -1.5% 0.62 / 0.60 / +2.8%
tpcds_q69/datafusion:parquet 43169310 / 43345552 / -0.4% 53875873 / 54686235 / -1.5% 0.80 / 0.79 / +1.1%
tpcds_q70/datafusion:parquet 81775164 / 80271896 / +1.9% 97225863 / 100088952 / -2.9% 0.84 / 0.80 / +4.9%
tpcds_q71/datafusion:parquet 26665186 / 24373552 / +9.4% 37766750 / 38366867 / -1.6% 0.71 / 0.64 / +11.1%
tpcds_q72/datafusion:parquet 529042866 / 527329837 / +0.3% 535861093 / 560736807 / -4.4% 0.99 / 0.94 / +5.0%
tpcds_q73/datafusion:parquet 23977472 / 23675195 / +1.3% 35858883 / 35651529 / +0.6% 0.67 / 0.66 / +0.7%
tpcds_q74/datafusion:parquet 69415389 / 69750544 / -0.5% 86668001 / 88419484 / -2.0% 0.80 / 0.79 / +1.5%
tpcds_q75/datafusion:parquet 151870772 / 154280426 / -1.6% 173325398 / 175992735 / -1.5% 0.88 / 0.88 / -0.0%
tpcds_q76/datafusion:parquet 33205080 / 32552642 / +2.0% 47250230 / 46197310 / +2.3% 0.70 / 0.70 / -0.3%
tpcds_q77/datafusion:parquet 57348148 / 55912258 / +2.6% 73015260 / 75401961 / -3.2% 0.79 / 0.74 / +5.9%
tpcds_q78/datafusion:parquet 88282246 / 86298158 / +2.3% 118487723 / 119573989 / -0.9% 0.75 / 0.72 / +3.2%
tpcds_q79/datafusion:parquet 26546320 / 26941018 / -1.5% 41437231 / 41670899 / -0.6% 0.64 / 0.65 / -0.9%
tpcds_q80/datafusion:parquet 79898559 / 79571648 / +0.4% 112876450 / 107798298 / +4.7% 0.71 / 0.74 / -4.1%
tpcds_q81/datafusion:parquet 35328707 / 37708022 / -6.3% 52123319 / 49644780 / +5.0% 0.68 / 0.76 / -10.8%
tpcds_q82/datafusion:parquet 22262645 / 22862742 / -2.6% 35211131 / 35659042 / -1.3% 0.63 / 0.64 / -1.4%
tpcds_q83/datafusion:parquet 59652846 / 58728850 / +1.6% 73545198 / 73572759 / -0.0% 0.81 / 0.80 / +1.6%
tpcds_q84/datafusion:parquet 26026142 / 27588446 / -5.7% 39884661 / 37424130 / +6.6% 0.65 / 0.74 / -11.5%
tpcds_q85/datafusion:parquet 79595254 / 80037900 / -0.6% 102818145 / 103303133 / -0.5% 0.77 / 0.77 / -0.1%
tpcds_q86/datafusion:parquet 20720734 / 20803682 / -0.4% 32386248 / 32694603 / -0.9% 0.64 / 0.64 / +0.5%
tpcds_q87/datafusion:parquet 45044004 / 44953774 / +0.2% 59653347 / 58673543 / +1.7% 0.76 / 0.77 / -1.4%
tpcds_q88/datafusion:parquet 37095696 / 37194222 / -0.3% 50288077 / 51481242 / -2.3% 0.74 / 0.72 / +2.1%
tpcds_q89/datafusion:parquet 25732351 / 25767740 / -0.1% 41881431 / 40885679 / +2.4% 0.61 / 0.63 / -2.5%
tpcds_q90/datafusion:parquet 15012010 / 15051543 / -0.3% 27657067 / 27168268 / +1.8% 0.54 / 0.55 / -2.0%
tpcds_q91/datafusion:parquet 31901682 / 32426770 / -1.6% 45346034 / 45756299 / -0.9% 0.70 / 0.71 / -0.7%
tpcds_q92/datafusion:parquet 26653342 / 26788312 / -0.5% 40022882 / 39570067 / +1.1% 0.67 / 0.68 / -1.6%
tpcds_q93/datafusion:parquet 27417434 / 26826836 / +2.2% 44899240 / 45720426 / -1.8% 0.61 / 0.59 / +4.1%
tpcds_q94/datafusion:parquet 35341330 / 35612212 / -0.8% 47554302 / 47235641 / +0.7% 0.74 / 0.75 / -1.4%
tpcds_q95/datafusion:parquet 65246607 / 64407442 / +1.3% 77607990 / 79417285 / -2.3% 0.84 / 0.81 / +3.7%
tpcds_q96/datafusion:parquet 12771614 / 13109518 / -2.6% 22998723 / 25052704 / -8.2% 0.56 / 0.52 / +6.1%
tpcds_q97/datafusion:parquet 35276600 / 35212817 / +0.2% 51375199 / 51110766 / +0.5% 0.69 / 0.69 / -0.3%
tpcds_q98/datafusion:parquet 24354014 / 24928664 / -2.3% 37030499 / 36311664 / +2.0% 0.66 / 0.69 / -4.2%
tpcds_q99/datafusion:parquet 29682702 / 29956348 / -0.9% 41179828 / 41613620 / -1.0% 0.72 / 0.72 / +0.1%
duckdb / vortex-file-compressed / ns (1.058x ➖, 0↑ 16↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 17493142 / 16142117 / +8.4% 24969964 / 24883739 / +0.3% 0.70 / 0.65 / +8.0%
tpcds_q02/duckdb:vortex-file-compressed 18353574 / 16709276 / +9.8% 25699155 / 22051108 / +16.5% 🔴 0.71 / 0.76 / -5.8%
tpcds_q03/duckdb:vortex-file-compressed 7153872 / 7045657 / +1.5% 16038252 / 16301596 / -1.6% 0.45 / 0.43 / +3.2%
tpcds_q04/duckdb:vortex-file-compressed 47290304 / 45758252 / +3.3% 56254396 / 56479163 / -0.4% 0.84 / 0.81 / +3.8%
tpcds_q05/duckdb:vortex-file-compressed 23736911 / 23036528 / +3.0% 33994549 / 32578849 / +4.3% 0.70 / 0.71 / -1.3%
tpcds_q06/duckdb:vortex-file-compressed 24046040 / 24423028 / -1.5% 38706358 / 38193338 / +1.3% 0.62 / 0.64 / -2.8%
tpcds_q07/duckdb:vortex-file-compressed 15088980 / 13353038 / +13.0% 🔴 25463935 / 24712568 / +3.0% 0.59 / 0.54 / +9.7%
tpcds_q08/duckdb:vortex-file-compressed 17215316 / 17520489 / -1.7% 24242447 / 25721441 / -5.8% 0.71 / 0.68 / +4.3%
tpcds_q09/duckdb:vortex-file-compressed 17666526 / 19111982 / -7.6% 27463702 / 29348465 / -6.4% 0.64 / 0.65 / -1.2%
tpcds_q10/duckdb:vortex-file-compressed 30309726 / 27612226 / +9.8% 42859303 / 40320225 / +6.3% 0.71 / 0.68 / +3.3%
tpcds_q11/duckdb:vortex-file-compressed 37637084 / 36903964 / +2.0% 46873555 / 46177346 / +1.5% 0.80 / 0.80 / +0.5%
tpcds_q12/duckdb:vortex-file-compressed 11011633 / 10200694 / +7.9% 17860770 / 17187152 / +3.9% 0.62 / 0.59 / +3.9%
tpcds_q13/duckdb:vortex-file-compressed 21971460 / 21263297 / +3.3% 34920595 / 32547269 / +7.3% 0.63 / 0.65 / -3.7%
tpcds_q14/duckdb:vortex-file-compressed 62734180 / 57809828 / +8.5% 73356664 / 68046783 / +7.8% 0.86 / 0.85 / +0.7%
tpcds_q15/duckdb:vortex-file-compressed 11832726 / 11119113 / +6.4% 19018433 / 18816176 / +1.1% 0.62 / 0.59 / +5.3%
tpcds_q16/duckdb:vortex-file-compressed 25205920 / 24266849 / +3.9% 36213710 / 34786209 / +4.1% 0.70 / 0.70 / -0.2%
tpcds_q17/duckdb:vortex-file-compressed 26063207 / 24227736 / +7.6% 38698262 / 36525117 / +5.9% 0.67 / 0.66 / +1.5%
tpcds_q18/duckdb:vortex-file-compressed 33529326 / 31509080 / +6.4% 43134181 / 41766543 / +3.3% 0.78 / 0.75 / +3.0%
tpcds_q19/duckdb:vortex-file-compressed 78565194 / 77960863 / +0.8% 88305345 / 89377861 / -1.2% 0.89 / 0.87 / +2.0%
tpcds_q20/duckdb:vortex-file-compressed 11803971 / 10971804 / +7.6% 18838893 / 17747764 / +6.1% 0.63 / 0.62 / +1.4%
tpcds_q21/duckdb:vortex-file-compressed 9777390 / 9745305 / +0.3% 23425759 / 20923879 / +12.0% 🔴 0.42 / 0.47 / -10.4%
tpcds_q22/duckdb:vortex-file-compressed 21264232 / 17585292 / +20.9% 🔴 31500825 / 29572488 / +6.5% 0.68 / 0.59 / +13.5%
tpcds_q23/duckdb:vortex-file-compressed 43165960 / 38130006 / +13.2% 🔴 54952741 / 49924896 / +10.1% 🔴 0.79 / 0.76 / +2.8%
tpcds_q24/duckdb:vortex-file-compressed 27153594 / 26574018 / +2.2% 38341800 / 36642246 / +4.6% 0.71 / 0.73 / -2.3%
tpcds_q25/duckdb:vortex-file-compressed 24837794 / 23695962 / +4.8% 34408431 / 36381968 / -5.4% 0.72 / 0.65 / +10.8%
tpcds_q26/duckdb:vortex-file-compressed 14614546 / 13100696 / +11.6% 🔴 21901717 / 21291607 / +2.9% 0.67 / 0.62 / +8.4%
tpcds_q27/duckdb:vortex-file-compressed 17228952 / 15963922 / +7.9% 27028435 / 27540444 / -1.9% 0.64 / 0.58 / +10.0%
tpcds_q28/duckdb:vortex-file-compressed 14595708 / 15588588 / -6.4% 24552378 / 26167172 / -6.2% 0.59 / 0.60 / -0.2%
tpcds_q29/duckdb:vortex-file-compressed 24261338 / 22710729 / +6.8% 35241690 / 34899355 / +1.0% 0.69 / 0.65 / +5.8%
tpcds_q30/duckdb:vortex-file-compressed 16829082 / 15872199 / +6.0% 24815512 / 24336692 / +2.0% 0.68 / 0.65 / +4.0%
tpcds_q31/duckdb:vortex-file-compressed 18683525 / 18069675 / +3.4% 27132112 / 26891648 / +0.9% 0.69 / 0.67 / +2.5%
tpcds_q32/duckdb:vortex-file-compressed 12619823 / 11623212 / +8.6% 21523090 / 20950684 / +2.7% 0.59 / 0.55 / +5.7%
tpcds_q33/duckdb:vortex-file-compressed 20569309 / 18357493 / +12.0% 🔴 29812033 / 28185569 / +5.8% 0.69 / 0.65 / +5.9%
tpcds_q34/duckdb:vortex-file-compressed 13804616 / 13014242 / +6.1% 22487631 / 23047270 / -2.4% 0.61 / 0.56 / +8.7%
tpcds_q35/duckdb:vortex-file-compressed 29964524 / 27929879 / +7.3% 40913880 / 39014716 / +4.9% 0.73 / 0.72 / +2.3%
tpcds_q36/duckdb:vortex-file-compressed 15363068 / 13908706 / +10.5% 🔴 25148158 / 23970044 / +4.9% 0.61 / 0.58 / +5.3%
tpcds_q37/duckdb:vortex-file-compressed 9271582 / 9515167 / -2.6% 23432612 / 24340830 / -3.7% 0.40 / 0.39 / +1.2%
tpcds_q38/duckdb:vortex-file-compressed 24248688 / 24300837 / -0.2% 33129066 / 32361884 / +2.4% 0.73 / 0.75 / -2.5%
tpcds_q39/duckdb:vortex-file-compressed 19656744 / 18334157 / +7.2% 33321078 / 33896858 / -1.7% 0.59 / 0.54 / +9.1%
tpcds_q40/duckdb:vortex-file-compressed 15405781 / 14107318 / +9.2% 21343956 / 20388858 / +4.7% 0.72 / 0.69 / +4.3%
tpcds_q41/duckdb:vortex-file-compressed 19023222 / 18789802 / +1.2% 25382196 / 25592058 / -0.8% 0.75 / 0.73 / +2.1%
tpcds_q42/duckdb:vortex-file-compressed 7315302 / 7115361 / +2.8% 16376545 / 16445425 / -0.4% 0.45 / 0.43 / +3.2%
tpcds_q43/duckdb:vortex-file-compressed 11570804 / 9847942 / +17.5% 🔴 21341542 / 19094789 / +11.8% 🔴 0.54 / 0.52 / +5.1%
tpcds_q44/duckdb:vortex-file-compressed 12763624 / 12546484 / +1.7% 23527718 / 24279354 / -3.1% 0.54 / 0.52 / +5.0%
tpcds_q45/duckdb:vortex-file-compressed 23946870 / 23264362 / +2.9% 31471280 / 31280867 / +0.6% 0.76 / 0.74 / +2.3%
tpcds_q46/duckdb:vortex-file-compressed 19096901 / 19680982 / -3.0% 27233979 / 27352411 / -0.4% 0.70 / 0.72 / -2.5%
tpcds_q47/duckdb:vortex-file-compressed 37310886 / 34836730 / +7.1% 46383355 / 45045037 / +3.0% 0.80 / 0.77 / +4.0%
tpcds_q48/duckdb:vortex-file-compressed 24081346 / 23197005 / +3.8% 36663094 / 36376826 / +0.8% 0.66 / 0.64 / +3.0%
tpcds_q49/duckdb:vortex-file-compressed 19586569 / 18947468 / +3.4% 31450788 / 31460092 / -0.0% 0.62 / 0.60 / +3.4%
tpcds_q50/duckdb:vortex-file-compressed 18953248 / 16868396 / +12.4% 🔴 30200224 / 27316563 / +10.6% 🔴 0.63 / 0.62 / +1.6%
tpcds_q51/duckdb:vortex-file-compressed 50491237 / 48747450 / +3.6% 77575084 / 76407317 / +1.5% 0.65 / 0.64 / +2.0%
tpcds_q52/duckdb:vortex-file-compressed 7424564 / 7223788 / +2.8% 16229983 / 16544978 / -1.9% 0.46 / 0.44 / +4.8%
tpcds_q53/duckdb:vortex-file-compressed 12070499 / 11580455 / +4.2% 20578299 / 20950001 / -1.8% 0.59 / 0.55 / +6.1%
tpcds_q54/duckdb:vortex-file-compressed 20241548 / 20288914 / -0.2% 30251829 / 30647003 / -1.3% 0.67 / 0.66 / +1.1%
tpcds_q55/duckdb:vortex-file-compressed 7270469 / 6902994 / +5.3% 15532082 / 15931120 / -2.5% 0.47 / 0.43 / +8.0%
tpcds_q56/duckdb:vortex-file-compressed 18877619 / 17960990 / +5.1% 28570231 / 27713372 / +3.1% 0.66 / 0.65 / +2.0%
tpcds_q57/duckdb:vortex-file-compressed 31187975 / 26098614 / +19.5% 🔴 34905200 / 34582639 / +0.9% 0.89 / 0.75 / +18.4%
tpcds_q58/duckdb:vortex-file-compressed 20613050 / 20331842 / +1.4% 30704760 / 30877019 / -0.6% 0.67 / 0.66 / +2.0%
tpcds_q59/duckdb:vortex-file-compressed 23122446 / 19688060 / +17.4% 🔴 30202217 / 27058532 / +11.6% 🔴 0.77 / 0.73 / +5.2%
tpcds_q60/duckdb:vortex-file-compressed 19943104 / 18617518 / +7.1% 30348634 / 29659067 / +2.3% 0.66 / 0.63 / +4.7%
tpcds_q61/duckdb:vortex-file-compressed 27338602 / 25605872 / +6.8% 36304106 / 34595872 / +4.9% 0.75 / 0.74 / +1.7%
tpcds_q62/duckdb:vortex-file-compressed 14205442 / 11685066 / +21.6% 🔴 21090064 / 18455703 / +14.3% 🔴 0.67 / 0.63 / +6.4%
tpcds_q63/duckdb:vortex-file-compressed 11466666 / 10996244 / +4.3% 20291072 / 20737428 / -2.2% 0.57 / 0.53 / +6.6%
tpcds_q64/duckdb:vortex-file-compressed 52222474 / 49381384 / +5.8% 68747798 / 66047661 / +4.1% 0.76 / 0.75 / +1.6%
tpcds_q65/duckdb:vortex-file-compressed 14605102 / 13292210 / +9.9% 25050788 / 23558633 / +6.3% 0.58 / 0.56 / +3.3%
tpcds_q66/duckdb:vortex-file-compressed 30976075 / 29707612 / +4.3% 36934531 / 35612347 / +3.7% 0.84 / 0.83 / +0.5%
tpcds_q67/duckdb:vortex-file-compressed 62847146 / 58292138 / +7.8% 72030956 / 66652555 / +8.1% 0.87 / 0.87 / -0.2%
tpcds_q68/duckdb:vortex-file-compressed 18663398 / 19064728 / -2.1% 27036575 / 27773620 / -2.7% 0.69 / 0.69 / +0.6%
tpcds_q69/duckdb:vortex-file-compressed 25631112 / 22826429 / +12.3% 🔴 39382922 / 37192445 / +5.9% 0.65 / 0.61 / +6.0%
tpcds_q70/duckdb:vortex-file-compressed 17987730 / 16314066 / +10.3% 🔴 28439916 / 27191282 / +4.6% 0.63 / 0.60 / +5.4%
tpcds_q71/duckdb:vortex-file-compressed 13822258 / 12617499 / +9.5% 23323498 / 23746617 / -1.8% 0.59 / 0.53 / +11.5%
tpcds_q72/duckdb:vortex-file-compressed 52447523 / 51945424 / +1.0% 65554085 / 62476510 / +4.9% 0.80 / 0.83 / -3.8%
tpcds_q73/duckdb:vortex-file-compressed 12367845 / 11909118 / +3.9% 20519692 / 21101470 / -2.8% 0.60 / 0.56 / +6.8%
tpcds_q74/duckdb:vortex-file-compressed 27774648 / 26041908 / +6.7% 34920826 / 34022832 / +2.6% 0.80 / 0.77 / +3.9%
tpcds_q75/duckdb:vortex-file-compressed 29847738 / 28133652 / +6.1% 40324350 / 38375865 / +5.1% 0.74 / 0.73 / +1.0%
tpcds_q76/duckdb:vortex-file-compressed 12763854 / 12764356 / -0.0% 22679101 / 22963071 / -1.2% 0.56 / 0.56 / +1.2%
tpcds_q77/duckdb:vortex-file-compressed 21538103 / 21418045 / +0.6% 32376454 / 32708962 / -1.0% 0.67 / 0.65 / +1.6%
tpcds_q78/duckdb:vortex-file-compressed 46813350 / 43337642 / +8.0% 53630835 / 53885227 / -0.5% 0.87 / 0.80 / +8.5%
tpcds_q79/duckdb:vortex-file-compressed 13751720 / 13232534 / +3.9% 22596132 / 21910779 / +3.1% 0.61 / 0.60 / +0.8%
tpcds_q80/duckdb:vortex-file-compressed 36618882 / 36847054 / -0.6% 51137773 / 49501801 / +3.3% 0.72 / 0.74 / -3.8%
tpcds_q81/duckdb:vortex-file-compressed 22739412 / 21429800 / +6.1% 30398670 / 30095533 / +1.0% 0.75 / 0.71 / +5.1%
tpcds_q82/duckdb:vortex-file-compressed 9636870 / 9708050 / -0.7% 25638287 / 25061879 / +2.3% 0.38 / 0.39 / -3.0%
tpcds_q83/duckdb:vortex-file-compressed 17548174 / 17427131 / +0.7% 24407103 / 24376519 / +0.1% 0.72 / 0.71 / +0.6%
tpcds_q84/duckdb:vortex-file-compressed 17042453 / 15770181 / +8.1% 24860711 / 23129342 / +7.5% 0.69 / 0.68 / +0.5%
tpcds_q85/duckdb:vortex-file-compressed 25654352 / 24403894 / +5.1% 37859350 / 36380296 / +4.1% 0.68 / 0.67 / +1.0%
tpcds_q86/duckdb:vortex-file-compressed 10610721 / 9717139 / +9.2% 17780444 / 15906721 / +11.8% 🔴 0.60 / 0.61 / -2.3%
tpcds_q87/duckdb:vortex-file-compressed 25827432 / 26017050 / -0.7% 32239000 / 33396290 / -3.5% 0.80 / 0.78 / +2.8%
tpcds_q88/duckdb:vortex-file-compressed 31380904 / 30324574 / +3.5% 38492053 / 38572757 / -0.2% 0.82 / 0.79 / +3.7%
tpcds_q89/duckdb:vortex-file-compressed 12912542 / 12106472 / +6.7% 22762405 / 20820791 / +9.3% 0.57 / 0.58 / -2.4%
tpcds_q90/duckdb:vortex-file-compressed 8395124 / 7989972 / +5.1% 15695940 / 15308508 / +2.5% 0.53 / 0.52 / +2.5%
tpcds_q91/duckdb:vortex-file-compressed 14973822 / 14428822 / +3.8% 22552030 / 23070665 / -2.2% 0.66 / 0.63 / +6.2%
tpcds_q92/duckdb:vortex-file-compressed 12957630 / 12093567 / +7.1% 21500575 / 20435129 / +5.2% 0.60 / 0.59 / +1.8%
tpcds_q93/duckdb:vortex-file-compressed 11009590 / 10489510 / +5.0% 23221232 / 23114016 / +0.5% 0.47 / 0.45 / +4.5%
tpcds_q94/duckdb:vortex-file-compressed 23285174 / 21924813 / +6.2% 32927412 / 32104172 / +2.6% 0.71 / 0.68 / +3.5%
tpcds_q95/duckdb:vortex-file-compressed 81363770 / 62938576 / +29.3% 🔴 90865124 / 71963612 / +26.3% 🔴 0.90 / 0.87 / +2.4%
tpcds_q96/duckdb:vortex-file-compressed 7565937 / 6838084 / +10.6% 🔴 15615434 / 14762606 / +5.8% 0.48 / 0.46 / +4.6%
tpcds_q97/duckdb:vortex-file-compressed 23480401 / 23163218 / +1.4% 33592617 / 31012754 / +8.3% 0.70 / 0.75 / -6.4%
tpcds_q98/duckdb:vortex-file-compressed 12324070 / 11360176 / +8.5% 20609673 / 19475284 / +5.8% 0.60 / 0.58 / +2.5%
tpcds_q99/duckdb:vortex-file-compressed 16725920 / 14668948 / +14.0% 🔴 22616125 / 22813440 / -0.9% 0.74 / 0.64 / +15.0%
duckdb / parquet / ns (1.001x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23868925 / 23966969 / -0.4% 30937795 / 30829019 / +0.4% 0.77 / 0.78 / -0.8%
tpcds_q02/duckdb:parquet 17767701 / 17973470 / -1.1% 23641051 / 23889142 / -1.0% 0.75 / 0.75 / -0.1%
tpcds_q03/duckdb:parquet 9747122 / 9784454 / -0.4% 15694618 / 15698965 / -0.0% 0.62 / 0.62 / -0.4%
tpcds_q04/duckdb:parquet 118164248 / 117912489 / +0.2% 125531675 / 126089418 / -0.4% 0.94 / 0.94 / +0.7%
tpcds_q05/duckdb:parquet 28340482 / 28395371 / -0.2% 32246263 / 32582262 / -1.0% 0.88 / 0.87 / +0.8%
tpcds_q06/duckdb:parquet 26285423 / 26216986 / +0.3% 35720346 / 35588221 / +0.4% 0.74 / 0.74 / -0.1%
tpcds_q07/duckdb:parquet 33061044 / 33420428 / -1.1% 38606201 / 38430436 / +0.5% 0.86 / 0.87 / -1.5%
tpcds_q08/duckdb:parquet 19767766 / 19585998 / +0.9% 25871785 / 26172260 / -1.1% 0.76 / 0.75 / +2.1%
tpcds_q09/duckdb:parquet 26020536 / 27371152 / -4.9% 29902248 / 29649948 / +0.9% 0.87 / 0.92 / -5.7%
tpcds_q10/duckdb:parquet 32547918 / 32361482 / +0.6% 40591744 / 40184705 / +1.0% 0.80 / 0.81 / -0.4%
tpcds_q11/duckdb:parquet 68463503 / 68514487 / -0.1% 76113009 / 76389272 / -0.4% 0.90 / 0.90 / +0.3%
tpcds_q12/duckdb:parquet 13838989 / 13876876 / -0.3% 19141475 / 19186188 / -0.2% 0.72 / 0.72 / -0.0%
tpcds_q13/duckdb:parquet 30161619 / 30368470 / -0.7% 39595985 / 40187836 / -1.5% 0.76 / 0.76 / +0.8%
tpcds_q14/duckdb:parquet 63935461 / 63510142 / +0.7% 67128632 / 67941108 / -1.2% 0.95 / 0.93 / +1.9%
tpcds_q15/duckdb:parquet 16441215 / 16546332 / -0.6% 22615505 / 22895550 / -1.2% 0.73 / 0.72 / +0.6%
tpcds_q16/duckdb:parquet 30079618 / 30007520 / +0.2% 36814229 / 36406547 / +1.1% 0.82 / 0.82 / -0.9%
tpcds_q17/duckdb:parquet 34226053 / 34177397 / +0.1% 40391720 / 40441172 / -0.1% 0.85 / 0.85 / +0.3%
tpcds_q18/duckdb:parquet 46987326 / 47042055 / -0.1% 54310122 / 54456240 / -0.3% 0.87 / 0.86 / +0.2%
tpcds_q19/duckdb:parquet 18584144 / 18502952 / +0.4% 25694663 / 25759438 / -0.3% 0.72 / 0.72 / +0.7%
tpcds_q20/duckdb:parquet 14769977 / 14883558 / -0.8% 19623384 / 19539428 / +0.4% 0.75 / 0.76 / -1.2%
tpcds_q21/duckdb:parquet 10336264 / 10610768 / -2.6% 16828810 / 17113867 / -1.7% 0.61 / 0.62 / -0.9%
tpcds_q22/duckdb:parquet 20487905 / 20553610 / -0.3% 26161594 / 26725059 / -2.1% 0.78 / 0.77 / +1.8%
tpcds_q23/duckdb:parquet 42472056 / 43575614 / -2.5% 47028559 / 46598579 / +0.9% 0.90 / 0.94 / -3.4%
tpcds_q24/duckdb:parquet 29829148 / 30367457 / -1.8% 36520617 / 36478211 / +0.1% 0.82 / 0.83 / -1.9%
tpcds_q25/duckdb:parquet 30372080 / 30221780 / +0.5% 37166641 / 36937818 / +0.6% 0.82 / 0.82 / -0.1%
tpcds_q26/duckdb:parquet 28702212 / 28776880 / -0.3% 34974042 / 35302112 / -0.9% 0.82 / 0.82 / +0.7%
tpcds_q27/duckdb:parquet 34606782 / 35523786 / -2.6% 41940213 / 41611405 / +0.8% 0.83 / 0.85 / -3.3%
tpcds_q28/duckdb:parquet 25995113 / 26328432 / -1.3% 33983522 / 34309155 / -0.9% 0.76 / 0.77 / -0.3%
tpcds_q29/duckdb:parquet 32121058 / 31825925 / +0.9% 40288849 / 38870785 / +3.6% 0.80 / 0.82 / -2.6%
tpcds_q30/duckdb:parquet 34962040 / 35121615 / -0.5% 43955268 / 44712118 / -1.7% 0.80 / 0.79 / +1.3%
tpcds_q31/duckdb:parquet 35451737 / 35271778 / +0.5% 42905891 / 42481930 / +1.0% 0.83 / 0.83 / -0.5%
tpcds_q32/duckdb:parquet 14161393 / 14057028 / +0.7% 20690910 / 20598153 / +0.5% 0.68 / 0.68 / +0.3%
tpcds_q33/duckdb:parquet 23097990 / 23124152 / -0.1% 28570526 / 29167207 / -2.0% 0.81 / 0.79 / +2.0%
tpcds_q34/duckdb:parquet 16924671 / 16934344 / -0.1% 24039108 / 24303526 / -1.1% 0.70 / 0.70 / +1.0%
tpcds_q35/duckdb:parquet 35181545 / 35187535 / -0.0% 43469030 / 43708254 / -0.5% 0.81 / 0.81 / +0.5%
tpcds_q36/duckdb:parquet 39529810 / 39353736 / +0.4% 47142663 / 47971471 / -1.7% 0.84 / 0.82 / +2.2%
tpcds_q37/duckdb:parquet 12476184 / 12699916 / -1.8% 19385985 / 19775516 / -2.0% 0.64 / 0.64 / +0.2%
tpcds_q38/duckdb:parquet 29772398 / 29409083 / +1.2% 33470218 / 33644782 / -0.5% 0.89 / 0.87 / +1.8%
tpcds_q39/duckdb:parquet 23235056 / 23268776 / -0.1% 30005904 / 30173448 / -0.6% 0.77 / 0.77 / +0.4%
tpcds_q40/duckdb:parquet 15762767 / 15818668 / -0.4% 21023037 / 21350935 / -1.5% 0.75 / 0.74 / +1.2%
tpcds_q41/duckdb:parquet 11860012 / 11937368 / -0.6% 17761980 / 17654837 / +0.6% 0.67 / 0.68 / -1.2%
tpcds_q42/duckdb:parquet 9426276 / 9467242 / -0.4% 15978887 / 15390992 / +3.8% 0.59 / 0.62 / -4.1%
tpcds_q43/duckdb:parquet 11935734 / 13469714 / -11.4% 🟢 17711990 / 18054883 / -1.9% 0.67 / 0.75 / -9.7%
tpcds_q44/duckdb:parquet 20920724 / 21728390 / -3.7% 27392022 / 27212840 / +0.7% 0.76 / 0.80 / -4.3%
tpcds_q45/duckdb:parquet 20745017 / 20743408 / +0.0% 27890352 / 27840154 / +0.2% 0.74 / 0.75 / -0.2%
tpcds_q46/duckdb:parquet 37906052 / 36989149 / +2.5% 43377515 / 44071441 / -1.6% 0.87 / 0.84 / +4.1%
tpcds_q47/duckdb:parquet 35765760 / 34549854 / +3.5% 41451714 / 41188971 / +0.6% 0.86 / 0.84 / +2.9%
tpcds_q48/duckdb:parquet 29369473 / 30458733 / -3.6% 36854726 / 37126578 / -0.7% 0.80 / 0.82 / -2.9%
tpcds_q49/duckdb:parquet 30761730 / 30077962 / +2.3% 36322007 / 35486466 / +2.4% 0.85 / 0.85 / -0.1%
tpcds_q50/duckdb:parquet 19237870 / 19303932 / -0.3% 25693941 / 25663854 / +0.1% 0.75 / 0.75 / -0.5%
tpcds_q51/duckdb:parquet 52268448 / 51972089 / +0.6% 77577500 / 60028308 / +29.2% 🔴 0.67 / 0.87 / -22.2%
tpcds_q52/duckdb:parquet 9665592 / 9584687 / +0.8% 15517676 / 15536302 / -0.1% 0.62 / 0.62 / +1.0%
tpcds_q53/duckdb:parquet 13876227 / 13859535 / +0.1% 21007054 / 21051270 / -0.2% 0.66 / 0.66 / +0.3%
tpcds_q54/duckdb:parquet 24986779 / 24769012 / +0.9% 32155843 / 32317507 / -0.5% 0.78 / 0.77 / +1.4%
tpcds_q55/duckdb:parquet 10486128 / 9458322 / +10.9% 🔴 15002800 / 15628508 / -4.0% 0.70 / 0.61 / +15.5%
tpcds_q56/duckdb:parquet 25298580 / 24451846 / +3.5% 30392304 / 30263945 / +0.4% 0.83 / 0.81 / +3.0%
tpcds_q57/duckdb:parquet 30523642 / 30496694 / +0.1% 36173637 / 36082806 / +0.3% 0.84 / 0.85 / -0.2%
tpcds_q58/duckdb:parquet 23722491 / 24048685 / -1.4% 29407560 / 29574418 / -0.6% 0.81 / 0.81 / -0.8%
tpcds_q59/duckdb:parquet 22563120 / 22781209 / -1.0% 28930480 / 28822798 / +0.4% 0.78 / 0.79 / -1.3%
tpcds_q60/duckdb:parquet 27989388 / 26326926 / +6.3% 32143662 / 32439784 / -0.9% 0.87 / 0.81 / +7.3%
tpcds_q61/duckdb:parquet 25132664 / 24386621 / +3.1% 29411087 / 28840820 / +2.0% 0.85 / 0.85 / +1.1%
tpcds_q62/duckdb:parquet 12682760 / 12837852 / -1.2% 17798657 / 18021543 / -1.2% 0.71 / 0.71 / +0.0%
tpcds_q63/duckdb:parquet 13232645 / 13411461 / -1.3% 20188363 / 20165946 / +0.1% 0.66 / 0.67 / -1.4%
tpcds_q64/duckdb:parquet 70002066 / 70200230 / -0.3% 80559734 / 80412181 / +0.2% 0.87 / 0.87 / -0.5%
tpcds_q65/duckdb:parquet 19907440 / 18687231 / +6.5% 25569385 / 26192155 / -2.4% 0.78 / 0.71 / +9.1%
tpcds_q66/duckdb:parquet 33178036 / 33369771 / -0.6% 37902871 / 37725314 / +0.5% 0.88 / 0.88 / -1.0%
tpcds_q67/duckdb:parquet 60933780 / 60819089 / +0.2% 68023320 / 67228661 / +1.2% 0.90 / 0.90 / -1.0%
tpcds_q68/duckdb:parquet 29468663 / 29259984 / +0.7% 36632348 / 36839271 / -0.6% 0.80 / 0.79 / +1.3%
tpcds_q69/duckdb:parquet 25936142 / 25569940 / +1.4% 34476776 / 34423942 / +0.2% 0.75 / 0.74 / +1.3%
tpcds_q70/duckdb:parquet 19242000 / 19192084 / +0.3% 27216238 / 26739741 / +1.8% 0.71 / 0.72 / -1.5%
tpcds_q71/duckdb:parquet 17315434 / 17054927 / +1.5% 24231298 / 23954836 / +1.2% 0.71 / 0.71 / +0.4%
tpcds_q72/duckdb:parquet 52895432 / 52932942 / -0.1% 59210053 / 59845214 / -1.1% 0.89 / 0.88 / +1.0%
tpcds_q73/duckdb:parquet 14771080 / 14661652 / +0.7% 21213839 / 21893138 / -3.1% 0.70 / 0.67 / +4.0%
tpcds_q74/duckdb:parquet 84522990 / 84390668 / +0.2% 89938735 / 91452584 / -1.7% 0.94 / 0.92 / +1.8%
tpcds_q75/duckdb:parquet 45245610 / 44687585 / +1.2% 49440209 / 50609140 / -2.3% 0.92 / 0.88 / +3.6%
tpcds_q76/duckdb:parquet 18708748 / 19040094 / -1.7% 23528402 / 23607159 / -0.3% 0.80 / 0.81 / -1.4%
tpcds_q77/duckdb:parquet 25484904 / 25425972 / +0.2% 31221532 / 32155175 / -2.9% 0.82 / 0.79 / +3.2%
tpcds_q78/duckdb:parquet 77426159 / 77093010 / +0.4% 83653168 / 84250182 / -0.7% 0.93 / 0.92 / +1.1%
tpcds_q79/duckdb:parquet 24463715 / 21130690 / +15.8% 🔴 28918220 / 29307556 / -1.3% 0.85 / 0.72 / +17.3%
tpcds_q80/duckdb:parquet 36773003 / 37184819 / -1.1% 44270326 / 43847529 / +1.0% 0.83 / 0.85 / -2.1%
tpcds_q81/duckdb:parquet 35991328 / 35976995 / +0.0% 44746152 / 44333291 / +0.9% 0.80 / 0.81 / -0.9%
tpcds_q82/duckdb:parquet 13366234 / 13373336 / -0.1% 20456356 / 20170460 / +1.4% 0.65 / 0.66 / -1.4%
tpcds_q83/duckdb:parquet 19900698 / 20056018 / -0.8% 24904185 / 24832676 / +0.3% 0.80 / 0.81 / -1.1%
tpcds_q84/duckdb:parquet 22661033 / 22552006 / +0.5% 29028642 / 28863502 / +0.6% 0.78 / 0.78 / -0.1%
tpcds_q85/duckdb:parquet 32324370 / 32295063 / +0.1% 39058947 / 39757757 / -1.8% 0.83 / 0.81 / +1.9%
tpcds_q86/duckdb:parquet 11845252 / 11671840 / +1.5% 16894937 / 17041774 / -0.9% 0.70 / 0.68 / +2.4%
tpcds_q87/duckdb:parquet 31308924 / 31295030 / +0.0% 34930367 / 35573309 / -1.8% 0.90 / 0.88 / +1.9%
tpcds_q88/duckdb:parquet 38212883 / 38174937 / +0.1% 42498437 / 41231775 / +3.1% 0.90 / 0.93 / -2.9%
tpcds_q89/duckdb:parquet 14011042 / 15086220 / -7.1% 21334514 / 21158011 / +0.8% 0.66 / 0.71 / -7.9%
tpcds_q90/duckdb:parquet 9994422 / 9834406 / +1.6% 14773689 / 15371268 / -3.9% 0.68 / 0.64 / +5.7%
tpcds_q91/duckdb:parquet 21058454 / 20811260 / +1.2% 28379641 / 28789486 / -1.4% 0.74 / 0.72 / +2.6%
tpcds_q92/duckdb:parquet 15434958 / 15505942 / -0.5% 21858909 / 21884251 / -0.1% 0.71 / 0.71 / -0.3%
tpcds_q93/duckdb:parquet 14065092 / 14008072 / +0.4% 20311360 / 20243382 / +0.3% 0.69 / 0.69 / +0.1%
tpcds_q94/duckdb:parquet 25181174 / 25514996 / -1.3% 32820817 / 32909651 / -0.3% 0.77 / 0.78 / -1.0%
tpcds_q95/duckdb:parquet 43973818 / 43842982 / +0.3% 49632195 / 49538887 / +0.2% 0.89 / 0.89 / +0.1%
tpcds_q96/duckdb:parquet 8271461 / 8142782 / +1.6% 13459376 / 13576831 / -0.9% 0.61 / 0.60 / +2.5%
tpcds_q97/duckdb:parquet 27531034 / 27093344 / +1.6% 33722151 / 32358898 / +4.2% 0.82 / 0.84 / -2.5%
tpcds_q98/duckdb:parquet 16269120 / 16374839 / -0.6% 22878967 / 23141567 / -1.1% 0.71 / 0.71 / +0.5%
tpcds_q99/duckdb:parquet 18814914 / 18656013 / +0.9% 24556191 / 24696138 / -0.6% 0.77 / 0.76 / +1.4%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR f86626f0 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-2.1%, low confidence)
Vortex (geomean): hot 0.986x ➖ · cold 0.968x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.995x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1245108 / 1223583 / +1.8% 22068353 / 22393554 / -1.5% 0.06 / 0.05 / +3.3%
clickbench_q01/datafusion:vortex-file-compressed 6148310 / 6046842 / +1.7% 30006044 / 29592395 / +1.4% 0.20 / 0.20 / +0.3%
clickbench_q02/datafusion:vortex-file-compressed 10468278 / 10531240 / -0.6% 43341276 / 46036487 / -5.9% 0.24 / 0.23 / +5.6%
clickbench_q03/datafusion:vortex-file-compressed 13038858 / 12387916 / +5.3% 56179927 / 56727916 / -1.0% 0.23 / 0.22 / +6.3%
clickbench_q04/datafusion:vortex-file-compressed 58225632 / 58081216 / +0.2% 102771979 / 103589636 / -0.8% 0.57 / 0.56 / +1.0%
clickbench_q05/datafusion:vortex-file-compressed 76340581 / 79014320 / -3.4% 122285737 / 128484768 / -4.8% 0.62 / 0.61 / +1.5%
clickbench_q06/datafusion:vortex-file-compressed 1246402 / 1263943 / -1.4% 21543293 / 22422362 / -3.9% 0.06 / 0.06 / +2.6%
clickbench_q07/datafusion:vortex-file-compressed 9558866 / 9508768 / +0.5% 38196387 / 33881448 / +12.7% 🔴 0.25 / 0.28 / -10.8%
clickbench_q08/datafusion:vortex-file-compressed 79798759 / 79137674 / +0.8% 125769107 / 128803436 / -2.4% 0.63 / 0.61 / +3.3%
clickbench_q09/datafusion:vortex-file-compressed 172026542 / 173755480 / -1.0% 216335661 / 207375596 / +4.3% 0.80 / 0.84 / -5.1%
clickbench_q10/datafusion:vortex-file-compressed 23238354 / 23479735 / -1.0% 70727805 / 69620750 / +1.6% 0.33 / 0.34 / -2.6%
clickbench_q11/datafusion:vortex-file-compressed 25043958 / 26005739 / -3.7% 70699966 / 70384896 / +0.4% 0.35 / 0.37 / -4.1%
clickbench_q12/datafusion:vortex-file-compressed 74775792 / 75527217 / -1.0% 125186922 / 123896189 / +1.0% 0.60 / 0.61 / -2.0%
clickbench_q13/datafusion:vortex-file-compressed 121069962 / 115900178 / +4.5% 184490616 / 187353692 / -1.5% 0.66 / 0.62 / +6.1%
clickbench_q14/datafusion:vortex-file-compressed 76570244 / 75510882 / +1.4% 125316548 / 125936863 / -0.5% 0.61 / 0.60 / +1.9%
clickbench_q15/datafusion:vortex-file-compressed 64334438 / 63030918 / +2.1% 97325122 / 100187136 / -2.9% 0.66 / 0.63 / +5.1%
clickbench_q16/datafusion:vortex-file-compressed 154310260 / 155538995 / -0.8% 215702314 / 217221220 / -0.7% 0.72 / 0.72 / -0.1%
clickbench_q17/datafusion:vortex-file-compressed 155995887 / 155207311 / +0.5% 218821725 / 226552616 / -3.4% 0.71 / 0.69 / +4.1%
clickbench_q18/datafusion:vortex-file-compressed 299664930 / 294130736 / +1.9% 373151220 / 390830976 / -4.5% 0.80 / 0.75 / +6.7%
clickbench_q19/datafusion:vortex-file-compressed 8401725 / 8303792 / +1.2% 47535844 / 48242070 / -1.5% 0.18 / 0.17 / +2.7%
clickbench_q20/datafusion:vortex-file-compressed 67428876 / 71745774 / -6.0% 243316792 / 248435282 / -2.1% 0.28 / 0.29 / -4.0%
clickbench_q21/datafusion:vortex-file-compressed 78881364 / 79455405 / -0.7% 283199985 / 288506255 / -1.8% 0.28 / 0.28 / +1.1%
clickbench_q22/datafusion:vortex-file-compressed 93714846 / 91696814 / +2.2% 396553690 / 390845073 / +1.5% 0.24 / 0.23 / +0.7%
clickbench_q23/datafusion:vortex-file-compressed 196105605 / 183993637 / +6.6% 545709841 / 539539151 / +1.1% 0.36 / 0.34 / +5.4%
clickbench_q24/datafusion:vortex-file-compressed 16376597 / 15307686 / +7.0% 69445007 / 70032970 / -0.8% 0.24 / 0.22 / +7.9%
clickbench_q25/datafusion:vortex-file-compressed 18400151 / 19863486 / -7.4% 66766286 / 62923085 / +6.1% 0.28 / 0.32 / -12.7%
clickbench_q26/datafusion:vortex-file-compressed 16931737 / 16533236 / +2.4% 69575442 / 70743668 / -1.7% 0.24 / 0.23 / +4.1%
clickbench_q27/datafusion:vortex-file-compressed 100966248 / 101740724 / -0.8% 258267688 / 251569553 / +2.7% 0.39 / 0.40 / -3.3%
clickbench_q28/datafusion:vortex-file-compressed 562594517 / 562333160 / +0.0% 632227181 / 643537242 / -1.8% 0.89 / 0.87 / +1.8%
clickbench_q29/datafusion:vortex-file-compressed 24316326 / 24245137 / +0.3% 52533754 / 53670057 / -2.1% 0.46 / 0.45 / +2.5%
clickbench_q30/datafusion:vortex-file-compressed 58104804 / 57397381 / +1.2% 107256602 / 112998342 / -5.1% 0.54 / 0.51 / +6.7%
clickbench_q31/datafusion:vortex-file-compressed 65497746 / 65356445 / +0.2% 154882881 / 163081172 / -5.0% 0.42 / 0.40 / +5.5%
clickbench_q32/datafusion:vortex-file-compressed 285658114 / 290282297 / -1.6% 384951531 / 393223115 / -2.1% 0.74 / 0.74 / +0.5%
clickbench_q33/datafusion:vortex-file-compressed 323094082 / 324626808 / -0.5% 431274615 / 432328318 / -0.2% 0.75 / 0.75 / -0.2%
clickbench_q34/datafusion:vortex-file-compressed 323963702 / 324894899 / -0.3% 432280378 / 444404496 / -2.7% 0.75 / 0.73 / +2.5%
clickbench_q35/datafusion:vortex-file-compressed 56056788 / 56027504 / +0.1% 93311695 / 93654723 / -0.4% 0.60 / 0.60 / +0.4%
clickbench_q36/datafusion:vortex-file-compressed 37506290 / 37622886 / -0.3% 66851544 / 67872658 / -1.5% 0.56 / 0.55 / +1.2%
clickbench_q37/datafusion:vortex-file-compressed 21233174 / 21259280 / -0.1% 46915662 / 47424626 / -1.1% 0.45 / 0.45 / +1.0%
clickbench_q38/datafusion:vortex-file-compressed 13239310 / 13259514 / -0.2% 41094442 / 41723747 / -1.5% 0.32 / 0.32 / +1.4%
clickbench_q39/datafusion:vortex-file-compressed 78224230 / 78839799 / -0.8% 112529931 / 111367852 / +1.0% 0.70 / 0.71 / -1.8%
clickbench_q40/datafusion:vortex-file-compressed 10383682 / 10378568 / +0.0% 36772250 / 36528657 / +0.7% 0.28 / 0.28 / -0.6%
clickbench_q41/datafusion:vortex-file-compressed 9716822 / 9976754 / -2.6% 35139109 / 34471787 / +1.9% 0.28 / 0.29 / -4.5%
clickbench_q42/datafusion:vortex-file-compressed 10070956 / 10423952 / -3.4% 35888257 / 35196628 / +2.0% 0.28 / 0.30 / -5.2%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1245977 / 1245842 / +0.0% 48832361 / 49718186 / -1.8% 0.03 / 0.03 / +1.8%
clickbench_q01/datafusion:parquet 16062732 / 15975198 / +0.5% 65821269 / 66883453 / -1.6% 0.24 / 0.24 / +2.2%
clickbench_q02/datafusion:parquet 18798774 / 19024956 / -1.2% 78940481 / 81292366 / -2.9% 0.24 / 0.23 / +1.8%
clickbench_q03/datafusion:parquet 16840816 / 17560503 / -4.1% 78285127 / 79048536 / -1.0% 0.22 / 0.22 / -3.2%
clickbench_q04/datafusion:parquet 63643656 / 62657254 / +1.6% 124373878 / 129056405 / -3.6% 0.51 / 0.49 / +5.4%
clickbench_q05/datafusion:parquet 88163552 / 89388218 / -1.4% 155377179 / 157935497 / -1.6% 0.57 / 0.57 / +0.3%
clickbench_q06/datafusion:parquet 1250966 / 1247492 / +0.3% 49089076 / 49860473 / -1.5% 0.03 / 0.03 / +1.9%
clickbench_q07/datafusion:parquet 16608570 / 16844414 / -1.4% 66721689 / 67110170 / -0.6% 0.25 / 0.25 / -0.8%
clickbench_q08/datafusion:parquet 86386396 / 85805378 / +0.7% 160175561 / 160618520 / -0.3% 0.54 / 0.53 / +1.0%
clickbench_q09/datafusion:parquet 184648563 / 187483740 / -1.5% 269317123 / 273970246 / -1.7% 0.69 / 0.68 / +0.2%
clickbench_q10/datafusion:parquet 35710050 / 35933968 / -0.6% 98251862 / 99356253 / -1.1% 0.36 / 0.36 / +0.5%
clickbench_q11/datafusion:parquet 42318144 / 42619872 / -0.7% 108598729 / 107756386 / +0.8% 0.39 / 0.40 / -1.5%
clickbench_q12/datafusion:parquet 94191529 / 96266114 / -2.2% 160437850 / 162038776 / -1.0% 0.59 / 0.59 / -1.2%
clickbench_q13/datafusion:parquet 146850700 / 146539911 / +0.2% 226829102 / 227411999 / -0.3% 0.65 / 0.64 / +0.5%
clickbench_q14/datafusion:parquet 101529340 / 102721975 / -1.2% 173720344 / 174323102 / -0.3% 0.58 / 0.59 / -0.8%
clickbench_q15/datafusion:parquet 71983672 / 72072821 / -0.1% 128631407 / 130369029 / -1.3% 0.56 / 0.55 / +1.2%
clickbench_q16/datafusion:parquet 155970674 / 155655536 / +0.2% 235258463 / 242072681 / -2.8% 0.66 / 0.64 / +3.1%
clickbench_q17/datafusion:parquet 157230669 / 156748302 / +0.3% 234290822 / 234690281 / -0.2% 0.67 / 0.67 / +0.5%
clickbench_q18/datafusion:parquet 308364033 / 311937038 / -1.1% 417874091 / 429885360 / -2.8% 0.74 / 0.73 / +1.7%
clickbench_q19/datafusion:parquet 18804556 / 18985055 / -1.0% 74586085 / 76428879 / -2.4% 0.25 / 0.25 / +1.5%
clickbench_q20/datafusion:parquet 178144662 / 178201950 / -0.0% 282572932 / 277984119 / +1.7% 0.63 / 0.64 / -1.7%
clickbench_q21/datafusion:parquet 173281474 / 174353110 / -0.6% 299406013 / 298763106 / +0.2% 0.58 / 0.58 / -0.8%
clickbench_q22/datafusion:parquet 261776134 / 264644574 / -1.1% 430613896 / 427231380 / +0.8% 0.61 / 0.62 / -1.9%
clickbench_q23/datafusion:parquet 1013775857 / 1015310230 / -0.2% 1185791262 / 1186767292 / -0.1% 0.85 / 0.86 / -0.1%
clickbench_q24/datafusion:parquet 30034060 / 30461840 / -1.4% 89220027 / 89550560 / -0.4% 0.34 / 0.34 / -1.0%
clickbench_q25/datafusion:parquet 36198496 / 36461936 / -0.7% 101812928 / 103796692 / -1.9% 0.36 / 0.35 / +1.2%
clickbench_q26/datafusion:parquet 30324257 / 30640387 / -1.0% 89765275 / 89946311 / -0.2% 0.34 / 0.34 / -0.8%
clickbench_q27/datafusion:parquet 192336602 / 192726410 / -0.2% 292443567 / 288972174 / +1.2% 0.66 / 0.67 / -1.4%
clickbench_q28/datafusion:parquet 617474422 / 621473269 / -0.6% 700618810 / 715604342 / -2.1% 0.88 / 0.87 / +1.5%
clickbench_q29/datafusion:parquet 28946956 / 28657065 / +1.0% 90728838 / 90415523 / +0.3% 0.32 / 0.32 / +0.7%
clickbench_q30/datafusion:parquet 89767947 / 91351340 / -1.7% 173097289 / 172111509 / +0.6% 0.52 / 0.53 / -2.3%
clickbench_q31/datafusion:parquet 103348200 / 102634058 / +0.7% 198461730 / 198577852 / -0.1% 0.52 / 0.52 / +0.8%
clickbench_q32/datafusion:parquet 307153324 / 311819602 / -1.5% 429981514 / 434802281 / -1.1% 0.71 / 0.72 / -0.4%
clickbench_q33/datafusion:parquet 377349156 / 380089808 / -0.7% 475460503 / 473796518 / +0.4% 0.79 / 0.80 / -1.1%
clickbench_q34/datafusion:parquet 377606458 / 376914011 / +0.2% 477144322 / 477819866 / -0.1% 0.79 / 0.79 / +0.3%
clickbench_q35/datafusion:parquet 63443168 / 65520001 / -3.2% 122696718 / 122720394 / -0.0% 0.52 / 0.53 / -3.2%
clickbench_q36/datafusion:parquet 73620100 / 73697400 / -0.1% 135947173 / 136472185 / -0.4% 0.54 / 0.54 / +0.3%
clickbench_q37/datafusion:parquet 35470712 / 35543201 / -0.2% 89841406 / 91265731 / -1.6% 0.39 / 0.39 / +1.4%
clickbench_q38/datafusion:parquet 47691200 / 48184051 / -1.0% 108698999 / 110190286 / -1.4% 0.44 / 0.44 / +0.3%
clickbench_q39/datafusion:parquet 144898036 / 143896086 / +0.7% 210262462 / 213345420 / -1.4% 0.69 / 0.67 / +2.2%
clickbench_q40/datafusion:parquet 19731715 / 20053370 / -1.6% 75499415 / 78117633 / -3.4% 0.26 / 0.26 / +1.8%
clickbench_q41/datafusion:parquet 18902932 / 18881718 / +0.1% 74892838 / 76285755 / -1.8% 0.25 / 0.25 / +2.0%
clickbench_q42/datafusion:parquet 18757142 / 19347004 / -3.0% 73188895 / 74154859 / -1.3% 0.26 / 0.26 / -1.8%
duckdb / vortex-file-compressed / ns (0.973x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2233220 / 2237106 / -0.2% 23978733 / 25307876 / -5.3% 0.09 / 0.09 / +5.4%
clickbench_q01/duckdb:vortex-file-compressed 7385818 / 7655398 / -3.5% 28813973 / 30911132 / -6.8% 0.26 / 0.25 / +3.5%
clickbench_q02/duckdb:vortex-file-compressed 8381581 / 9039239 / -7.3% 34658071 / 38103656 / -9.0% 0.24 / 0.24 / +1.9%
clickbench_q03/duckdb:vortex-file-compressed 12784404 / 14038454 / -8.9% 46091087 / 51361504 / -10.3% 🟢 0.28 / 0.27 / +1.5%
clickbench_q04/duckdb:vortex-file-compressed 56774340 / 55959632 / +1.5% 87899232 / 90702001 / -3.1% 0.65 / 0.62 / +4.7%
clickbench_q05/duckdb:vortex-file-compressed 63085273 / 63897903 / -1.3% 92691947 / 96923586 / -4.4% 0.68 / 0.66 / +3.2%
clickbench_q06/duckdb:vortex-file-compressed 2613244 / 2644494 / -1.2% 26948928 / 29217110 / -7.8% 0.10 / 0.09 / +7.1%
clickbench_q07/duckdb:vortex-file-compressed 9421326 / 9511088 / -0.9% 30436513 / 30810489 / -1.2% 0.31 / 0.31 / +0.3%
clickbench_q08/duckdb:vortex-file-compressed 69404549 / 69255778 / +0.2% 103893163 / 107914279 / -3.7% 0.67 / 0.64 / +4.1%
clickbench_q09/duckdb:vortex-file-compressed 90935532 / 92548142 / -1.7% 126623892 / 128409391 / -1.4% 0.72 / 0.72 / -0.4%
clickbench_q10/duckdb:vortex-file-compressed 24565172 / 27689274 / -11.3% 🟢 65154059 / 72148281 / -9.7% 0.38 / 0.38 / -1.8%
clickbench_q11/duckdb:vortex-file-compressed 27708400 / 30540370 / -9.3% 62874466 / 79204582 / -20.6% 🟢 0.44 / 0.39 / +14.3%
clickbench_q12/duckdb:vortex-file-compressed 68704097 / 69892491 / -1.7% 96663027 / 100654921 / -4.0% 0.71 / 0.69 / +2.4%
clickbench_q13/duckdb:vortex-file-compressed 122566297 / 127172012 / -3.6% 154942101 / 169732824 / -8.7% 0.79 / 0.75 / +5.6%
clickbench_q14/duckdb:vortex-file-compressed 72707625 / 74951316 / -3.0% 102420301 / 108241821 / -5.4% 0.71 / 0.69 / +2.5%
clickbench_q15/duckdb:vortex-file-compressed 76251925 / 75857344 / +0.5% 106660946 / 109421143 / -2.5% 0.71 / 0.69 / +3.1%
clickbench_q16/duckdb:vortex-file-compressed 134770732 / 133718120 / +0.8% 166833548 / 172972559 / -3.5% 0.81 / 0.77 / +4.5%
clickbench_q17/duckdb:vortex-file-compressed 135782516 / 139145834 / -2.4% 165684940 / 176256527 / -6.0% 0.82 / 0.79 / +3.8%
clickbench_q18/duckdb:vortex-file-compressed 252198902 / 261284120 / -3.5% 304356011 / 305972300 / -0.5% 0.83 / 0.85 / -3.0%
clickbench_q19/duckdb:vortex-file-compressed 8666166 / 9433455 / -8.1% 37418604 / 38621943 / -3.1% 0.23 / 0.24 / -5.2%
clickbench_q20/duckdb:vortex-file-compressed 64471061 / 67552078 / -4.6% 146446346 / 169737178 / -13.7% 🟢 0.44 / 0.40 / +10.6%
clickbench_q21/duckdb:vortex-file-compressed 80430258 / 85506677 / -5.9% 165617955 / 194027861 / -14.6% 🟢 0.49 / 0.44 / +10.2%
clickbench_q22/duckdb:vortex-file-compressed 147527345 / 176474637 / -16.4% 🟢 304241688 / 345523729 / -11.9% 🟢 0.48 / 0.51 / -5.1%
clickbench_q23/duckdb:vortex-file-compressed 39586775 / 41929978 / -5.6% 83779624 / 90293247 / -7.2% 0.47 / 0.46 / +1.8%
clickbench_q24/duckdb:vortex-file-compressed 13781593 / 14160536 / -2.7% 36788309 / 39660096 / -7.2% 0.37 / 0.36 / +4.9%
clickbench_q25/duckdb:vortex-file-compressed 17980234 / 19419968 / -7.4% 50088976 / 54403251 / -7.9% 0.36 / 0.36 / +0.6%
clickbench_q26/duckdb:vortex-file-compressed 11601732 / 11388071 / +1.9% 35272397 / 39205981 / -10.0% 🟢 0.33 / 0.29 / +13.2%
clickbench_q27/duckdb:vortex-file-compressed 50670332 / 55108350 / -8.1% 158059342 / 180380940 / -12.4% 🟢 0.32 / 0.31 / +4.9%
clickbench_q28/duckdb:vortex-file-compressed 497630960 / 516077988 / -3.6% 533054283 / 559514013 / -4.7% 0.93 / 0.92 / +1.2%
clickbench_q29/duckdb:vortex-file-compressed 16354450 / 16801554 / -2.7% 43602408 / 43120020 / +1.1% 0.38 / 0.39 / -3.7%
clickbench_q30/duckdb:vortex-file-compressed 58212674 / 60694336 / -4.1% 98654870 / 112438538 / -12.3% 🟢 0.59 / 0.54 / +9.3%
clickbench_q31/duckdb:vortex-file-compressed 106166587 / 110928932 / -4.3% 163577678 / 200481515 / -18.4% 🟢 0.65 / 0.55 / +17.3%
clickbench_q32/duckdb:vortex-file-compressed 357380578 / 376905062 / -5.2% 397325676 / 411978991 / -3.6% 0.90 / 0.91 / -1.7%
clickbench_q33/duckdb:vortex-file-compressed 337234798 / 346800168 / -2.8% 398140113 / 400039829 / -0.5% 0.85 / 0.87 / -2.3%
clickbench_q34/duckdb:vortex-file-compressed 350943837 / 358757820 / -2.2% 416681269 / 415394371 / +0.3% 0.84 / 0.86 / -2.5%
clickbench_q35/duckdb:vortex-file-compressed 56915280 / 57165394 / -0.4% 86468621 / 89565873 / -3.5% 0.66 / 0.64 / +3.1%
clickbench_q36/duckdb:vortex-file-compressed 12247542 / 11736720 / +4.4% 34184686 / 31701737 / +7.8% 0.36 / 0.37 / -3.2%
clickbench_q37/duckdb:vortex-file-compressed 8995185 / 8307028 / +8.3% 28225166 / 28390029 / -0.6% 0.32 / 0.29 / +8.9%
clickbench_q38/duckdb:vortex-file-compressed 9080082 / 9089105 / -0.1% 29062221 / 28411635 / +2.3% 0.31 / 0.32 / -2.3%
clickbench_q39/duckdb:vortex-file-compressed 19196275 / 18985566 / +1.1% 41238515 / 41519995 / -0.7% 0.47 / 0.46 / +1.8%
clickbench_q40/duckdb:vortex-file-compressed 7713794 / 7541189 / +2.3% 28142864 / 26930257 / +4.5% 0.27 / 0.28 / -2.1%
clickbench_q41/duckdb:vortex-file-compressed 8511191 / 8447401 / +0.8% 28790962 / 30600085 / -5.9% 0.30 / 0.28 / +7.1%
clickbench_q42/duckdb:vortex-file-compressed 8121621 / 7460622 / +8.9% 28039490 / 28688927 / -2.3% 0.29 / 0.26 / +11.4%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9441732 / 9718106 / -2.8% 14625299 / 14404944 / +1.5% 0.65 / 0.67 / -4.3%
clickbench_q01/duckdb:parquet 15366726 / 15834801 / -3.0% 20333536 / 20779530 / -2.1% 0.76 / 0.76 / -0.8%
clickbench_q02/duckdb:parquet 22441614 / 22998262 / -2.4% 32365000 / 30933941 / +4.6% 0.69 / 0.74 / -6.7%
clickbench_q03/duckdb:parquet 22814506 / 22952789 / -0.6% 33700973 / 36373798 / -7.3% 0.68 / 0.63 / +7.3%
clickbench_q04/duckdb:parquet 61253046 / 61553110 / -0.5% 71436348 / 78571229 / -9.1% 0.86 / 0.78 / +9.5%
clickbench_q05/duckdb:parquet 83636756 / 82357820 / +1.6% 97079687 / 96778532 / +0.3% 0.86 / 0.85 / +1.2%
clickbench_q06/duckdb:parquet 20495110 / 20631596 / -0.7% 28868883 / 27932745 / +3.4% 0.71 / 0.74 / -3.9%
clickbench_q07/duckdb:parquet 17092470 / 17411882 / -1.8% 23188687 / 23086324 / +0.4% 0.74 / 0.75 / -2.3%
clickbench_q08/duckdb:parquet 74975126 / 74193970 / +1.1% 93436421 / 88499093 / +5.6% 0.80 / 0.84 / -4.3%
clickbench_q09/duckdb:parquet 103335290 / 102344946 / +1.0% 124671313 / 118287242 / +5.4% 0.83 / 0.87 / -4.2%
clickbench_q10/duckdb:parquet 41695514 / 41585957 / +0.3% 55960267 / 53914290 / +3.8% 0.75 / 0.77 / -3.4%
clickbench_q11/duckdb:parquet 46117754 / 46376690 / -0.6% 61089254 / 62469950 / -2.2% 0.75 / 0.74 / +1.7%
clickbench_q12/duckdb:parquet 93815096 / 93246466 / +0.6% 105047343 / 106709132 / -1.6% 0.89 / 0.87 / +2.2%
clickbench_q13/duckdb:parquet 152577462 / 151353115 / +0.8% 170488699 / 168774480 / +1.0% 0.89 / 0.90 / -0.2%
clickbench_q14/duckdb:parquet 101518350 / 101132109 / +0.4% 117444526 / 121484338 / -3.3% 0.86 / 0.83 / +3.8%
clickbench_q15/duckdb:parquet 87161882 / 87152113 / +0.0% 99219073 / 99157583 / +0.1% 0.88 / 0.88 / -0.1%
clickbench_q16/duckdb:parquet 161415419 / 161518198 / -0.1% 176475557 / 177677559 / -0.7% 0.91 / 0.91 / +0.6%
clickbench_q17/duckdb:parquet 170287526 / 163501751 / +4.2% 181244270 / 179044078 / +1.2% 0.94 / 0.91 / +2.9%
clickbench_q18/duckdb:parquet 288888513 / 297760434 / -3.0% 318304193 / 317638716 / +0.2% 0.91 / 0.94 / -3.2%
clickbench_q19/duckdb:parquet 20019520 / 20044906 / -0.1% 25854576 / 26219883 / -1.4% 0.77 / 0.76 / +1.3%
clickbench_q20/duckdb:parquet 181327743 / 190656931 / -4.9% 235887607 / 223372775 / +5.6% 0.77 / 0.85 / -9.9%
clickbench_q21/duckdb:parquet 223203092 / 221775748 / +0.6% 266962237 / 270636772 / -1.4% 0.84 / 0.82 / +2.0%
clickbench_q22/duckdb:parquet 311419258 / 316494844 / -1.6% 358493527 / 356496439 / +0.6% 0.87 / 0.89 / -2.2%
clickbench_q23/duckdb:parquet 169240413 / 172903391 / -2.1% 239960935 / 233746562 / +2.7% 0.71 / 0.74 / -4.7%
clickbench_q24/duckdb:parquet 30763267 / 30525626 / +0.8% 45320244 / 44919682 / +0.9% 0.68 / 0.68 / -0.1%
clickbench_q25/duckdb:parquet 41586772 / 43279324 / -3.9% 58801317 / 55176174 / +6.6% 0.71 / 0.78 / -9.8%
clickbench_q26/duckdb:parquet 31370940 / 29909380 / +4.9% 45394563 / 47593911 / -4.6% 0.69 / 0.63 / +10.0%
clickbench_q27/duckdb:parquet 187646635 / 190317469 / -1.4% 216214799 / 230460935 / -6.2% 0.87 / 0.83 / +5.1%
clickbench_q28/duckdb:parquet 947026410 / 966912630 / -2.1% 973912334 / 939906810 / +3.6% 0.97 / 1.03 / -5.5%
clickbench_q29/duckdb:parquet 24071384 / 23708308 / +1.5% 31085784 / 31487776 / -1.3% 0.77 / 0.75 / +2.8%
clickbench_q30/duckdb:parquet 106159795 / 107434616 / -1.2% 125686730 / 126651318 / -0.8% 0.84 / 0.85 / -0.4%
clickbench_q31/duckdb:parquet 146885249 / 146264200 / +0.4% 177154850 / 172955499 / +2.4% 0.83 / 0.85 / -2.0%
clickbench_q32/duckdb:parquet 390839278 / 392919146 / -0.5% 411840040 / 417034375 / -1.2% 0.95 / 0.94 / +0.7%
clickbench_q33/duckdb:parquet 482841816 / 489452036 / -1.4% 464569898 / 442277693 / +5.0% 1.04 / 1.11 / -6.1%
clickbench_q34/duckdb:parquet 456002016 / 466236417 / -2.2% 446076178 / 469010681 / -4.9% 1.02 / 0.99 / +2.8%
clickbench_q35/duckdb:parquet 60529188 / 61471326 / -1.5% 77423643 / 75534239 / +2.5% 0.78 / 0.81 / -3.9%
clickbench_q36/duckdb:parquet 29510744 / 30715884 / -3.9% 36417235 / 36664389 / -0.7% 0.81 / 0.84 / -3.3%
clickbench_q37/duckdb:parquet 23046870 / 23465799 / -1.8% 29266296 / 29463089 / -0.7% 0.79 / 0.80 / -1.1%
clickbench_q38/duckdb:parquet 23632418 / 23803284 / -0.7% 29414981 / 30067802 / -2.2% 0.80 / 0.79 / +1.5%
clickbench_q39/duckdb:parquet 52493072 / 53454965 / -1.8% 60703492 / 60267957 / +0.7% 0.86 / 0.89 / -2.5%
clickbench_q40/duckdb:parquet 14209758 / 14620130 / -2.8% 19885528 / 20417625 / -2.6% 0.71 / 0.72 / -0.2%
clickbench_q41/duckdb:parquet 15650140 / 15522580 / +0.8% 21152292 / 20561068 / +2.9% 0.74 / 0.75 / -2.0%
clickbench_q42/duckdb:parquet 14805623 / 14508395 / +2.0% 20739883 / 21329381 / -2.8% 0.71 / 0.68 / +4.9%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR f86626f0 vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +18.0%
Engines: DataFusion No clear signal (+38.3%, environment too noisy confidence) · DuckDB No clear signal (+0.6%, environment too noisy confidence)
Vortex (geomean): hot 1.343x ❌ · cold 1.213x ➖
Parquet (geomean): hot 1.139x ➖ · cold 1.216x ➖
Shifts: Parquet (control) +13.9% · Median polish +16.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.528x ❌, 0↑ 15↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 264769990 / 220831264 / +19.9% 1092169945 / 576458480 / +89.5% 🔴 0.24 / 0.38 / -36.7%
tpch_q02/datafusion:vortex-file-compressed 431798528 / 308669932 / +39.9% 🔴 748229548 / 674528013 / +10.9% 0.58 / 0.46 / +26.1%
tpch_q03/datafusion:vortex-file-compressed 474617608 / 347086704 / +36.7% 🔴 1152680121 / 871608881 / +32.2% 🔴 0.41 / 0.40 / +3.4%
tpch_q04/datafusion:vortex-file-compressed 207698854 / 207021749 / +0.3% 480606117 / 422384755 / +13.8% 0.43 / 0.49 / -11.8%
tpch_q05/datafusion:vortex-file-compressed 523486853 / 425586511 / +23.0% 638888025 / 613441206 / +4.1% 0.82 / 0.69 / +18.1%
tpch_q06/datafusion:vortex-file-compressed 175567614 / 141424151 / +24.1% 351764835 / 371254228 / -5.2% 0.50 / 0.38 / +31.0%
tpch_q07/datafusion:vortex-file-compressed 450054410 / 462415225 / -2.7% 720182218 / 582547518 / +23.6% 0.62 / 0.79 / -21.3%
tpch_q08/datafusion:vortex-file-compressed 911033590 / 427390773 / +113.2% 🔴 824914124 / 601931393 / +37.0% 🔴 1.10 / 0.71 / +55.5%
tpch_q09/datafusion:vortex-file-compressed 518807567 / 268529658 / +93.2% 🔴 643517121 / 473357724 / +35.9% 🔴 0.81 / 0.57 / +42.1%
tpch_q10/datafusion:vortex-file-compressed 495565083 / 348508035 / +42.2% 🔴 750826725 / 528499094 / +42.1% 🔴 0.66 / 0.66 / +0.1%
tpch_q11/datafusion:vortex-file-compressed 425637448 / 257327413 / +65.4% 🔴 679818425 / 420659524 / +61.6% 🔴 0.63 / 0.61 / +2.4%
tpch_q12/datafusion:vortex-file-compressed 1873842261 / 210715328 / +789.3% 🔴 445722524 / 429074710 / +3.9% 4.20 / 0.49 / +756.1%
tpch_q13/datafusion:vortex-file-compressed 137507476 / 131309055 / +4.7% 365997542 / 370354402 / -1.2% 0.38 / 0.35 / +6.0%
tpch_q14/datafusion:vortex-file-compressed 404776916 / 211521200 / +91.4% 🔴 629211470 / 383637559 / +64.0% 🔴 0.64 / 0.55 / +16.7%
tpch_q15/datafusion:vortex-file-compressed 410368464 / 292649172 / +40.2% 🔴 783378899 / 520914480 / +50.4% 🔴 0.52 / 0.56 / -6.8%
tpch_q16/datafusion:vortex-file-compressed 245040260 / 158770515 / +54.3% 🔴 512191041 / 318188188 / +61.0% 🔴 0.48 / 0.50 / -4.1%
tpch_q17/datafusion:vortex-file-compressed 576649125 / 307709054 / +87.4% 🔴 998181609 / 454845057 / +119.5% 🔴 0.58 / 0.68 / -14.6%
tpch_q18/datafusion:vortex-file-compressed 979126410 / 590427775 / +65.8% 🔴 1143775383 / 723635830 / +58.1% 🔴 0.86 / 0.82 / +4.9%
tpch_q19/datafusion:vortex-file-compressed 320792133 / 216120746 / +48.4% 🔴 506025474 / 356996489 / +41.7% 🔴 0.63 / 0.61 / +4.7%
tpch_q20/datafusion:vortex-file-compressed 301524180 / 292443661 / +3.1% 556758500 / 509890552 / +9.2% 0.54 / 0.57 / -5.6%
tpch_q21/datafusion:vortex-file-compressed 649770937 / 456400316 / +42.4% 🔴 779253683 / 730212380 / +6.7% 0.83 / 0.63 / +33.4%
tpch_q22/datafusion:vortex-file-compressed 217168904 / 167024301 / +30.0% 🔴 413565403 / 388209621 / +6.5% 0.53 / 0.43 / +22.1%
datafusion / parquet / ns (1.105x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 180714931 / 150351198 / +20.2% 680181447 / 460460005 / +47.7% 🔴 0.27 / 0.33 / -18.6%
tpch_q02/datafusion:parquet 326538938 / 284014916 / +15.0% 622434116 / 458008198 / +35.9% 🔴 0.52 / 0.62 / -15.4%
tpch_q03/datafusion:parquet 251922572 / 271007543 / -7.0% 817850756 / 753951884 / +8.5% 0.31 / 0.36 / -14.3%
tpch_q04/datafusion:parquet 172495075 / 133714329 / +29.0% 373790115 / 322406865 / +15.9% 0.46 / 0.41 / +11.3%
tpch_q05/datafusion:parquet 394531374 / 342356608 / +15.2% 615116505 / 468240904 / +31.4% 🔴 0.64 / 0.73 / -12.3%
tpch_q06/datafusion:parquet 144632028 / 112055911 / +29.1% 273925385 / 226141107 / +21.1% 0.53 / 0.50 / +6.6%
tpch_q07/datafusion:parquet 350810723 / 329957349 / +6.3% 880458193 / 516179984 / +70.6% 🔴 0.40 / 0.64 / -37.7%
tpch_q08/datafusion:parquet 423129875 / 432763020 / -2.2% 553801572 / 536690978 / +3.2% 0.76 / 0.81 / -5.2%
tpch_q09/datafusion:parquet 403420335 / 373806384 / +7.9% 632991700 / 539014441 / +17.4% 0.64 / 0.69 / -8.1%
tpch_q10/datafusion:parquet 314813307 / 309340609 / +1.8% 461970161 / 417479206 / +10.7% 0.68 / 0.74 / -8.0%
tpch_q11/datafusion:parquet 286526274 / 261901027 / +9.4% 392197423 / 373704730 / +4.9% 0.73 / 0.70 / +4.2%
tpch_q12/datafusion:parquet 195636706 / 162342440 / +20.5% 394275459 / 309500458 / +27.4% 0.50 / 0.52 / -5.4%
tpch_q13/datafusion:parquet 278766863 / 276376623 / +0.9% 504243251 / 436081873 / +15.6% 0.55 / 0.63 / -12.8%
tpch_q14/datafusion:parquet 184025453 / 157906152 / +16.5% 477730847 / 273555838 / +74.6% 🔴 0.39 / 0.58 / -33.3%
tpch_q15/datafusion:parquet 347444125 / 317865748 / +9.3% 649544494 / 523121657 / +24.2% 0.53 / 0.61 / -12.0%
tpch_q16/datafusion:parquet 104639130 / 111322386 / -6.0% 280838023 / 231410953 / +21.4% 0.37 / 0.48 / -22.5%
tpch_q17/datafusion:parquet 343060212 / 272274209 / +26.0% 467732955 / 526187695 / -11.1% 0.73 / 0.52 / +41.7%
tpch_q18/datafusion:parquet 356206287 / 341966792 / +4.2% 500114169 / 503106611 / -0.6% 0.71 / 0.68 / +4.8%
tpch_q19/datafusion:parquet 168403167 / 157601017 / +6.9% 311445858 / 273426259 / +13.9% 0.54 / 0.58 / -6.2%
tpch_q20/datafusion:parquet 329735345 / 235515300 / +40.0% 🔴 552245039 / 397076072 / +39.1% 🔴 0.60 / 0.59 / +0.7%
tpch_q21/datafusion:parquet 313505815 / 292874917 / +7.0% 541032261 / 463033836 / +16.8% 0.58 / 0.63 / -8.4%
tpch_q22/datafusion:parquet 153158636 / 160199804 / -4.4% 281041215 / 388871374 / -27.7% 0.54 / 0.41 / +32.3%
duckdb / vortex-file-compressed / ns (1.181x ➖, 0↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 268917932 / 247509334 / +8.6% 422526089 / 267181463 / +58.1% 🔴 0.64 / 0.93 / -31.3%
tpch_q02/duckdb:vortex-file-compressed 441592769 / 408988212 / +8.0% 512761989 / 495524216 / +3.5% 0.86 / 0.83 / +4.3%
tpch_q03/duckdb:vortex-file-compressed 554325135 / 416179552 / +33.2% 🔴 528134679 / 484765981 / +8.9% 1.05 / 0.86 / +22.3%
tpch_q04/duckdb:vortex-file-compressed 381598181 / 273734107 / +39.4% 🔴 324871531 / 309747374 / +4.9% 1.17 / 0.88 / +32.9%
tpch_q05/duckdb:vortex-file-compressed 639209838 / 585375507 / +9.2% 613019596 / 657952067 / -6.8% 1.04 / 0.89 / +17.2%
tpch_q06/duckdb:vortex-file-compressed 176194771 / 203012163 / -13.2% 216182750 / 217053599 / -0.4% 0.82 / 0.94 / -12.9%
tpch_q07/duckdb:vortex-file-compressed 585294909 / 433499388 / +35.0% 🔴 781676224 / 491006362 / +59.2% 🔴 0.75 / 0.88 / -15.2%
tpch_q08/duckdb:vortex-file-compressed 745248170 / 856662362 / -13.0% 995131363 / 924712147 / +7.6% 0.75 / 0.93 / -19.2%
tpch_q09/duckdb:vortex-file-compressed 558910573 / 430063376 / +30.0% 519726459 / 472261724 / +10.1% 1.08 / 0.91 / +18.1%
tpch_q10/duckdb:vortex-file-compressed 563836015 / 562615415 / +0.2% 549946199 / 577179328 / -4.7% 1.03 / 0.97 / +5.2%
tpch_q11/duckdb:vortex-file-compressed 309304253 / 295453825 / +4.7% 346070179 / 295294530 / +17.2% 0.89 / 1.00 / -10.7%
tpch_q12/duckdb:vortex-file-compressed 372144603 / 281391065 / +32.3% 🔴 370402257 / 342314564 / +8.2% 1.00 / 0.82 / +22.2%
tpch_q13/duckdb:vortex-file-compressed 315776257 / 257839733 / +22.5% 249179395 / 337095202 / -26.1% 1.27 / 0.76 / +65.7%
tpch_q14/duckdb:vortex-file-compressed 256235294 / 215999117 / +18.6% 354785577 / 312373489 / +13.6% 0.72 / 0.69 / +4.4%
tpch_q15/duckdb:vortex-file-compressed 288566255 / 339636073 / -15.0% 364009662 / 292926502 / +24.3% 0.79 / 1.16 / -31.6%
tpch_q16/duckdb:vortex-file-compressed 244385860 / 210376153 / +16.2% 257705786 / 230946559 / +11.6% 0.95 / 0.91 / +4.1%
tpch_q17/duckdb:vortex-file-compressed 606205756 / 324970756 / +86.5% 🔴 540105845 / 357086182 / +51.3% 🔴 1.12 / 0.91 / +23.3%
tpch_q18/duckdb:vortex-file-compressed 403544612 / 431733303 / -6.5% 397016516 / 402106068 / -1.3% 1.02 / 1.07 / -5.3%
tpch_q19/duckdb:vortex-file-compressed 358649707 / 303395982 / +18.2% 387195260 / 339697179 / +14.0% 0.93 / 0.89 / +3.7%
tpch_q20/duckdb:vortex-file-compressed 509643699 / 385636006 / +32.2% 🔴 553612295 / 483758671 / +14.4% 0.92 / 0.80 / +15.5%
tpch_q21/duckdb:vortex-file-compressed 799239357 / 656583605 / +21.7% 811557119 / 782358666 / +3.7% 0.98 / 0.84 / +17.3%
tpch_q22/duckdb:vortex-file-compressed 469090113 / 251855732 / +86.3% 🔴 427017352 / 334512025 / +27.7% 1.10 / 0.75 / +45.9%
duckdb / parquet / ns (1.173x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 180326773 / 152166910 / +18.5% 237855604 / 211204649 / +12.6% 0.76 / 0.72 / +5.2%
tpch_q02/duckdb:parquet 508061728 / 453471368 / +12.0% 614721537 / 426327264 / +44.2% 🔴 0.83 / 1.06 / -22.3%
tpch_q03/duckdb:parquet 487390017 / 358243434 / +36.0% 🔴 463310639 / 423368603 / +9.4% 1.05 / 0.85 / +24.3%
tpch_q04/duckdb:parquet 297132454 / 281717280 / +5.5% 338904504 / 332953926 / +1.8% 0.88 / 0.85 / +3.6%
tpch_q05/duckdb:parquet 592053270 / 536493872 / +10.4% 663605019 / 570606274 / +16.3% 0.89 / 0.94 / -5.1%
tpch_q06/duckdb:parquet 300039023 / 161239284 / +86.1% 🔴 243755656 / 206658661 / +18.0% 1.23 / 0.78 / +57.8%
tpch_q07/duckdb:parquet 469957558 / 436361603 / +7.7% 487252074 / 493434333 / -1.3% 0.96 / 0.88 / +9.1%
tpch_q08/duckdb:parquet 696336109 / 631844333 / +10.2% 1255913221 / 652757052 / +92.4% 🔴 0.55 / 0.97 / -42.7%
tpch_q09/duckdb:parquet 598873951 / 564743109 / +6.0% 593128507 / 620443574 / -4.4% 1.01 / 0.91 / +10.9%
tpch_q10/duckdb:parquet 620167474 / 581110821 / +6.7% 779104960 / 636456873 / +22.4% 0.80 / 0.91 / -12.8%
tpch_q11/duckdb:parquet 321621712 / 285994921 / +12.5% 328522649 / 263711609 / +24.6% 0.98 / 1.08 / -9.7%
tpch_q12/duckdb:parquet 268583948 / 252866750 / +6.2% 311868336 / 291902719 / +6.8% 0.86 / 0.87 / -0.6%
tpch_q13/duckdb:parquet 413381604 / 369355879 / +11.9% 526376438 / 429176067 / +22.6% 0.79 / 0.86 / -8.7%
tpch_q14/duckdb:parquet 254432356 / 269935408 / -5.7% 326931153 / 344984516 / -5.2% 0.78 / 0.78 / -0.5%
tpch_q15/duckdb:parquet 242018246 / 212505719 / +13.9% 469080313 / 228893439 / +104.9% 🔴 0.52 / 0.93 / -44.4%
tpch_q16/duckdb:parquet 295417073 / 275747511 / +7.1% 366712183 / 327100698 / +12.1% 0.81 / 0.84 / -4.4%
tpch_q17/duckdb:parquet 510703190 / 263952606 / +93.5% 🔴 829112069 / 331901361 / +149.8% 🔴 0.62 / 0.80 / -22.5%
tpch_q18/duckdb:parquet 498977568 / 382490629 / +30.5% 🔴 673821069 / 393794532 / +71.1% 🔴 0.74 / 0.97 / -23.8%
tpch_q19/duckdb:parquet 322023885 / 266061746 / +21.0% 393403035 / 345007366 / +14.0% 0.82 / 0.77 / +6.1%
tpch_q20/duckdb:parquet 472402711 / 448150426 / +5.4% 554231478 / 480087501 / +15.4% 0.85 / 0.93 / -8.7%
tpch_q21/duckdb:parquet 560114066 / 418893862 / +33.7% 🔴 535478448 / 454759125 / +17.7% 1.05 / 0.92 / +13.6%
tpch_q22/duckdb:parquet 313528428 / 323115195 / -3.0% 323237394 / 335134028 / -3.5% 0.97 / 0.96 / +0.6%

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant