Skip to content

[Benchmark only] Lazy struct-root expansion in ExpressionPackRule - #11062

Closed
joseph-isaacs wants to merge 1 commit into
developfrom
ji/v2-isolate-lazy-pack-root
Closed

joseph-isaacs wants to merge 1 commit into
developfrom
ji/v2-isolate-lazy-pack-root

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

One of the three changes in #11060, on its own, so CI can benchmark it in isolation. Do not merge; this draft is closed once its benchmark results are in.

ExpressionPackRule builds the pack of every struct field only for expressions that use the bare root.

It has the same base as #11060 (19dcd2f2d).

🤖 Generated with Claude Code

https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM

One of the three changes of #11060, on its own, to benchmark it in isolation.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 30, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 475b320 clickbench-nvme 1 Explore Profiling Data
🟢 Done 475b320 polarsignals 1 Explore Profiling Data
🟢 Done 475b320 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 475b320 tpch-s3 1 Explore Profiling Data
🟢 Done 475b320 fineweb 1 Explore Profiling Data
🟢 Done 475b320 tpch-nvme 1 Explore Profiling Data
🟢 Done 475b320 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 475b320a vs base 19dcd2f2
Vortex (geomean): hot 0.990x ➖ · cold 0.955x ➖


datafusion / vortex-file-compressed / ns (0.990x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44515686 / 44198107 / +0.7% 85630434 / 89439370 / -4.3% 0.52 / 0.49 / +5.2%
polarsignals_q01/datafusion:vortex-file-compressed 53783624 / 53423409 / +0.7% 112629160 / 135084640 / -16.6% 🟢 0.48 / 0.40 / +20.7%
polarsignals_q02/datafusion:vortex-file-compressed 14573342 / 11887196 / +22.6% 🔴 44759922 / 50980997 / -12.2% 🟢 0.33 / 0.23 / +39.6%
polarsignals_q03/datafusion:vortex-file-compressed 54750544 / 71391736 / -23.3% 🟢 115970521 / 117694461 / -1.5% 0.47 / 0.61 / -22.2%
polarsignals_q04/datafusion:vortex-file-compressed 9167794 / 9044253 / +1.4% 42442494 / 44519732 / -4.7% 0.22 / 0.20 / +6.3%
polarsignals_q05/datafusion:vortex-file-compressed 11758527 / 11570807 / +1.6% 45317792 / 46066653 / -1.6% 0.26 / 0.25 / +3.3%
polarsignals_q06/datafusion:vortex-file-compressed 23288778 / 23543970 / -1.1% 55491211 / 55935271 / -0.8% 0.42 / 0.42 / -0.3%
polarsignals_q07/datafusion:vortex-file-compressed 10580586 / 10790669 / -1.9% 43350079 / 43925484 / -1.3% 0.24 / 0.25 / -0.6%
polarsignals_q08/datafusion:vortex-file-compressed 97347274 / 104038217 / -6.4% 157383169 / 159248816 / -1.2% 0.62 / 0.65 / -5.3%
polarsignals_q09/datafusion:vortex-file-compressed 9949719 / 9853164 / +1.0% 41226196 / 40771950 / +1.1% 0.24 / 0.24 / -0.1%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 475b320a vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 0.953x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.944x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6977682 / 6914164 / +0.9% 16904253 / 15894016 / +6.4% 0.41 / 0.44 / -5.1%
fineweb_q01/datafusion:vortex-file-compressed 8950366 / 8207537 / +9.1% 44026997 / 42273090 / +4.1% 0.20 / 0.19 / +4.7%
fineweb_q02/datafusion:vortex-file-compressed 10228640 / 9825386 / +4.1% 45414166 / 45991505 / -1.3% 0.23 / 0.21 / +5.4%
fineweb_q03/datafusion:vortex-file-compressed 19474961 / 19985364 / -2.6% 94928607 / 112849457 / -15.9% 🟢 0.21 / 0.18 / +15.8%
fineweb_q04/datafusion:vortex-file-compressed 66075760 / 67072209 / -1.5% 142406823 / 154793659 / -8.0% 0.46 / 0.43 / +7.1%
fineweb_q05/datafusion:vortex-file-compressed 67378000 / 67066206 / +0.5% 141395941 / 152013803 / -7.0% 0.48 / 0.44 / +8.0%
fineweb_q06/datafusion:vortex-file-compressed 19167580 / 19077528 / +0.5% 99745172 / 116530631 / -14.4% 🟢 0.19 / 0.16 / +17.4%
fineweb_q07/datafusion:vortex-file-compressed 18608502 / 19804552 / -6.0% 100162300 / 111729640 / -10.4% 🟢 0.19 / 0.18 / +4.8%
fineweb_q08/datafusion:vortex-file-compressed 9203314 / 9231922 / -0.3% 37928579 / 44729078 / -15.2% 🟢 0.24 / 0.21 / +17.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9251920 / 9298051 / -0.5% 33720100 / 32161720 / +4.8% 0.27 / 0.29 / -5.1%
fineweb_q01/datafusion:parquet 76619402 / 75948676 / +0.9% 146994371 / 158050833 / -7.0% 0.52 / 0.48 / +8.5%
fineweb_q02/datafusion:parquet 74241471 / 74828561 / -0.8% 144575306 / 169180315 / -14.5% 🟢 0.51 / 0.44 / +16.1%
fineweb_q03/datafusion:parquet 73275526 / 75375235 / -2.8% 139150580 / 164650672 / -15.5% 🟢 0.53 / 0.46 / +15.0%
fineweb_q04/datafusion:parquet 82253733 / 82536988 / -0.3% 148910879 / 162124376 / -8.2% 0.55 / 0.51 / +8.5%
fineweb_q05/datafusion:parquet 80804972 / 80616398 / +0.2% 146626506 / 162946673 / -10.0% 🟢 0.55 / 0.49 / +11.4%
fineweb_q06/datafusion:parquet 75265023 / 74993748 / +0.4% 156718849 / 167327373 / -6.3% 0.48 / 0.45 / +7.2%
fineweb_q07/datafusion:parquet 75322262 / 74703466 / +0.8% 144913820 / 161875074 / -10.5% 🟢 0.52 / 0.46 / +12.6%
fineweb_q08/datafusion:parquet 72491977 / 73652338 / -1.6% 143204639 / 166993254 / -14.2% 🟢 0.51 / 0.44 / +14.8%
duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2087197 / 1992354 / +4.8% 7280961 / 7167288 / +1.6% 0.29 / 0.28 / +3.1%
fineweb_q01/duckdb:vortex-file-compressed 9386886 / 9302676 / +0.9% 30901294 / 33383961 / -7.4% 0.30 / 0.28 / +9.0%
fineweb_q02/duckdb:vortex-file-compressed 10922776 / 11086372 / -1.5% 32758800 / 32959285 / -0.6% 0.33 / 0.34 / -0.9%
fineweb_q03/duckdb:vortex-file-compressed 19812845 / 20108287 / -1.5% 89429405 / 93189312 / -4.0% 0.22 / 0.22 / +2.7%
fineweb_q04/duckdb:vortex-file-compressed 69426898 / 67281247 / +3.2% 104639596 / 109561330 / -4.5% 0.66 / 0.61 / +8.0%
fineweb_q05/duckdb:vortex-file-compressed 66592037 / 66431544 / +0.2% 105644972 / 106341165 / -0.7% 0.63 / 0.62 / +0.9%
fineweb_q06/duckdb:vortex-file-compressed 19712438 / 19036190 / +3.6% 92902908 / 93820093 / -1.0% 0.21 / 0.20 / +4.6%
fineweb_q07/duckdb:vortex-file-compressed 18563757 / 18786800 / -1.2% 89759374 / 90565938 / -0.9% 0.21 / 0.21 / -0.3%
fineweb_q08/duckdb:vortex-file-compressed 5449340 / 5376968 / +1.3% 13055638 / 13261327 / -1.6% 0.42 / 0.41 / +2.9%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24287966 / 23973552 / +1.3% 29067047 / 28107016 / +3.4% 0.84 / 0.85 / -2.0%
fineweb_q01/duckdb:parquet 56038393 / 56632112 / -1.0% 77480024 / 75490626 / +2.6% 0.72 / 0.75 / -3.6%
fineweb_q02/duckdb:parquet 60385634 / 61085010 / -1.1% 77733647 / 84868736 / -8.4% 0.78 / 0.72 / +7.9%
fineweb_q03/duckdb:parquet 119699838 / 119366500 / +0.3% 177049771 / 185364019 / -4.5% 0.68 / 0.64 / +5.0%
fineweb_q04/duckdb:parquet 166639493 / 161989686 / +2.9% 212878677 / 214789038 / -0.9% 0.78 / 0.75 / +3.8%
fineweb_q05/duckdb:parquet 160567044 / 160108938 / +0.3% 199510698 / 209160474 / -4.6% 0.80 / 0.77 / +5.1%
fineweb_q06/duckdb:parquet 90708207 / 87576319 / +3.6% 150405821 / 148207180 / +1.5% 0.60 / 0.59 / +2.1%
fineweb_q07/duckdb:parquet 92718456 / 92192530 / +0.6% 145379396 / 148218580 / -1.9% 0.64 / 0.62 / +2.5%
fineweb_q08/duckdb:parquet 29445818 / 30171232 / -2.4% 30741672 / 31697555 / -3.0% 0.96 / 0.95 / +0.6%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 475b320a vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Engines: DataFusion No clear signal (-4.5%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.983x ➖ · cold 1.016x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.959x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15093049 / 15244796 / -1.0% 42468173 / 43107623 / -1.5% 0.36 / 0.35 / +0.5%
tpch_q02/datafusion:vortex-file-compressed 16360862 / 16785369 / -2.5% 35782472 / 35606088 / +0.5% 0.46 / 0.47 / -3.0%
tpch_q03/datafusion:vortex-file-compressed 19571879 / 19704057 / -0.7% 48712363 / 46014863 / +5.9% 0.40 / 0.43 / -6.2%
tpch_q04/datafusion:vortex-file-compressed 9681256 / 10379829 / -6.7% 34328774 / 32939078 / +4.2% 0.28 / 0.32 / -10.5%
tpch_q05/datafusion:vortex-file-compressed 37192198 / 37109828 / +0.2% 66546924 / 66535663 / +0.0% 0.56 / 0.56 / +0.2%
tpch_q06/datafusion:vortex-file-compressed 4364650 / 5996442 / -27.2% 🟢 27448531 / 25090471 / +9.4% 0.16 / 0.24 / -33.5%
tpch_q07/datafusion:vortex-file-compressed 51275015 / 51590471 / -0.6% 80429058 / 75221258 / +6.9% 0.64 / 0.69 / -7.0%
tpch_q08/datafusion:vortex-file-compressed 51511781 / 51934499 / -0.8% 81937398 / 79965898 / +2.5% 0.63 / 0.65 / -3.2%
tpch_q09/datafusion:vortex-file-compressed 47542752 / 47546136 / -0.0% 77735643 / 79942083 / -2.8% 0.61 / 0.59 / +2.8%
tpch_q10/datafusion:vortex-file-compressed 17206369 / 17645205 / -2.5% 51003472 / 47530092 / +7.3% 0.34 / 0.37 / -9.1%
tpch_q11/datafusion:vortex-file-compressed 13996935 / 14039900 / -0.3% 34339942 / 33161470 / +3.6% 0.41 / 0.42 / -3.7%
tpch_q12/datafusion:vortex-file-compressed 18029826 / 18302956 / -1.5% 44689473 / 43729009 / +2.2% 0.40 / 0.42 / -3.6%
tpch_q13/datafusion:vortex-file-compressed 19499715 / 19620384 / -0.6% 38875766 / 41663145 / -6.7% 0.50 / 0.47 / +6.5%
tpch_q14/datafusion:vortex-file-compressed 14239770 / 14553341 / -2.2% 40502425 / 37184545 / +8.9% 0.35 / 0.39 / -10.2%
tpch_q15/datafusion:vortex-file-compressed 18061773 / 18610835 / -3.0% 44356556 / 43225258 / +2.6% 0.41 / 0.43 / -5.4%
tpch_q16/datafusion:vortex-file-compressed 18438523 / 18329773 / +0.6% 39005417 / 40570847 / -3.9% 0.47 / 0.45 / +4.6%
tpch_q17/datafusion:vortex-file-compressed 27657972 / 27783290 / -0.5% 61176801 / 58070075 / +5.3% 0.45 / 0.48 / -5.5%
tpch_q18/datafusion:vortex-file-compressed 35845976 / 36366608 / -1.4% 58270738 / 60484474 / -3.7% 0.62 / 0.60 / +2.3%
tpch_q19/datafusion:vortex-file-compressed 9273020 / 12404911 / -25.2% 🟢 39530441 / 37955343 / +4.1% 0.23 / 0.33 / -28.2%
tpch_q20/datafusion:vortex-file-compressed 20162402 / 20323772 / -0.8% 45380472 / 45113470 / +0.6% 0.44 / 0.45 / -1.4%
tpch_q21/datafusion:vortex-file-compressed 38620713 / 40850950 / -5.5% 73408679 / 69381261 / +5.8% 0.53 / 0.59 / -10.6%
tpch_q22/datafusion:vortex-file-compressed 10525248 / 10664079 / -1.3% 31747668 / 31422514 / +1.0% 0.33 / 0.34 / -2.3%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72319017 / 72197453 / +0.2% 89906294 / 88021582 / +2.1% 0.80 / 0.82 / -1.9%
tpch_q02/datafusion:parquet 76438198 / 76113619 / +0.4% 92941605 / 91783594 / +1.3% 0.82 / 0.83 / -0.8%
tpch_q03/datafusion:parquet 83763854 / 83587244 / +0.2% 107299147 / 104079904 / +3.1% 0.78 / 0.80 / -2.8%
tpch_q04/datafusion:parquet 41165632 / 41074548 / +0.2% 60171331 / 58708424 / +2.5% 0.68 / 0.70 / -2.2%
tpch_q05/datafusion:parquet 112656477 / 111873269 / +0.7% 139698424 / 138232292 / +1.1% 0.81 / 0.81 / -0.4%
tpch_q06/datafusion:parquet 32087966 / 32164141 / -0.2% 49701822 / 48132854 / +3.3% 0.65 / 0.67 / -3.4%
tpch_q07/datafusion:parquet 114558804 / 115287140 / -0.6% 142172655 / 138852302 / +2.4% 0.81 / 0.83 / -3.0%
tpch_q08/datafusion:parquet 119666823 / 119975551 / -0.3% 146802869 / 146061083 / +0.5% 0.82 / 0.82 / -0.8%
tpch_q09/datafusion:parquet 140086434 / 140206080 / -0.1% 170085800 / 167370100 / +1.6% 0.82 / 0.84 / -1.7%
tpch_q10/datafusion:parquet 106428530 / 106687730 / -0.2% 131870155 / 129115049 / +2.1% 0.81 / 0.83 / -2.3%
tpch_q11/datafusion:parquet 62952442 / 60132019 / +4.7% 84395954 / 80765575 / +4.5% 0.75 / 0.74 / +0.2%
tpch_q12/datafusion:parquet 65030848 / 65627851 / -0.9% 86200348 / 87684783 / -1.7% 0.75 / 0.75 / +0.8%
tpch_q13/datafusion:parquet 147575398 / 147425213 / +0.1% 167380355 / 165702279 / +1.0% 0.88 / 0.89 / -0.9%
tpch_q14/datafusion:parquet 47951307 / 47798012 / +0.3% 72593743 / 69229230 / +4.9% 0.66 / 0.69 / -4.3%
tpch_q15/datafusion:parquet 75835926 / 74426434 / +1.9% 96796942 / 92888867 / +4.2% 0.78 / 0.80 / -2.2%
tpch_q16/datafusion:parquet 44091402 / 43982597 / +0.2% 63234401 / 60662108 / +4.2% 0.70 / 0.73 / -3.8%
tpch_q17/datafusion:parquet 123931551 / 123982033 / -0.0% 145908984 / 146222630 / -0.2% 0.85 / 0.85 / +0.2%
tpch_q18/datafusion:parquet 124584277 / 123784690 / +0.6% 146679297 / 145985967 / +0.5% 0.85 / 0.85 / +0.2%
tpch_q19/datafusion:parquet 57934870 / 58291246 / -0.6% 82995736 / 82910665 / +0.1% 0.70 / 0.70 / -0.7%
tpch_q20/datafusion:parquet 79091483 / 78072120 / +1.3% 103604702 / 104292926 / -0.7% 0.76 / 0.75 / +2.0%
tpch_q21/datafusion:parquet 116457758 / 116406825 / +0.0% 142023905 / 140577249 / +1.0% 0.82 / 0.83 / -1.0%
tpch_q22/datafusion:parquet 51953604 / 51648092 / +0.6% 68530981 / 70957245 / -3.4% 0.76 / 0.73 / +4.2%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10058320 / 9331715 / +7.8% 20798318 / 22301445 / -6.7% 0.48 / 0.42 / +15.6%
tpch_q02/duckdb:vortex-file-compressed 15387784 / 15484601 / -0.6% 25817400 / 25552226 / +1.0% 0.60 / 0.61 / -1.6%
tpch_q03/duckdb:vortex-file-compressed 18836140 / 19032979 / -1.0% 34550189 / 34316634 / +0.7% 0.55 / 0.55 / -1.7%
tpch_q04/duckdb:vortex-file-compressed 12540516 / 12472751 / +0.5% 26300393 / 26219641 / +0.3% 0.48 / 0.48 / +0.2%
tpch_q05/duckdb:vortex-file-compressed 20716814 / 20655679 / +0.3% 37697278 / 36659669 / +2.8% 0.55 / 0.56 / -2.5%
tpch_q06/duckdb:vortex-file-compressed 4843072 / 4857931 / -0.3% 14466829 / 14308025 / +1.1% 0.33 / 0.34 / -1.4%
tpch_q07/duckdb:vortex-file-compressed 24413913 / 24022009 / +1.6% 42063417 / 42111704 / -0.1% 0.58 / 0.57 / +1.7%
tpch_q08/duckdb:vortex-file-compressed 21680562 / 20985996 / +3.3% 39050504 / 37397733 / +4.4% 0.56 / 0.56 / -1.1%
tpch_q09/duckdb:vortex-file-compressed 22727032 / 23200613 / -2.0% 39211127 / 39713549 / -1.3% 0.58 / 0.58 / -0.8%
tpch_q10/duckdb:vortex-file-compressed 22579883 / 22845856 / -1.2% 38748904 / 37304677 / +3.9% 0.58 / 0.61 / -4.8%
tpch_q11/duckdb:vortex-file-compressed 8362548 / 8326778 / +0.4% 18069882 / 17727782 / +1.9% 0.46 / 0.47 / -1.5%
tpch_q12/duckdb:vortex-file-compressed 14636256 / 14696796 / -0.4% 27366443 / 26761598 / +2.3% 0.53 / 0.55 / -2.6%
tpch_q13/duckdb:vortex-file-compressed 19664620 / 19458653 / +1.1% 32686240 / 31940922 / +2.3% 0.60 / 0.61 / -1.2%
tpch_q14/duckdb:vortex-file-compressed 11746133 / 11617118 / +1.1% 24375439 / 24005548 / +1.5% 0.48 / 0.48 / -0.4%
tpch_q15/duckdb:vortex-file-compressed 8797676 / 8531969 / +3.1% 21894358 / 19674383 / +11.3% 🔴 0.40 / 0.43 / -7.3%
tpch_q16/duckdb:vortex-file-compressed 17061864 / 16840450 / +1.3% 23896188 / 23631828 / +1.1% 0.71 / 0.71 / +0.2%
tpch_q17/duckdb:vortex-file-compressed 12511383 / 12519740 / -0.1% 28810485 / 28338798 / +1.7% 0.43 / 0.44 / -1.7%
tpch_q18/duckdb:vortex-file-compressed 24853450 / 24609179 / +1.0% 34233870 / 33693817 / +1.6% 0.73 / 0.73 / -0.6%
tpch_q19/duckdb:vortex-file-compressed 12045040 / 12334808 / -2.3% 26734581 / 30730234 / -13.0% 🟢 0.45 / 0.40 / +12.2%
tpch_q20/duckdb:vortex-file-compressed 14431710 / 14293355 / +1.0% 31791026 / 30174689 / +5.4% 0.45 / 0.47 / -4.2%
tpch_q21/duckdb:vortex-file-compressed 37160093 / 37652395 / -1.3% 57429131 / 58206800 / -1.3% 0.65 / 0.65 / +0.0%
tpch_q22/duckdb:vortex-file-compressed 17179566 / 16837835 / +2.0% 26872020 / 26922218 / -0.2% 0.64 / 0.63 / +2.2%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48394635 / 48307040 / +0.2% 55275134 / 54616876 / +1.2% 0.88 / 0.88 / -1.0%
tpch_q02/duckdb:parquet 49120785 / 48896101 / +0.5% 56332750 / 56077374 / +0.5% 0.87 / 0.87 / +0.0%
tpch_q03/duckdb:parquet 61102618 / 60904244 / +0.3% 69699059 / 68371951 / +1.9% 0.88 / 0.89 / -1.6%
tpch_q04/duckdb:parquet 35429503 / 35226993 / +0.6% 44480527 / 44130480 / +0.8% 0.80 / 0.80 / -0.2%
tpch_q05/duckdb:parquet 68192842 / 68007656 / +0.3% 79255024 / 77731599 / +2.0% 0.86 / 0.87 / -1.7%
tpch_q06/duckdb:parquet 22069716 / 21889190 / +0.8% 27881784 / 27655555 / +0.8% 0.79 / 0.79 / +0.0%
tpch_q07/duckdb:parquet 64874699 / 64584662 / +0.4% 75062923 / 73435438 / +2.2% 0.86 / 0.88 / -1.7%
tpch_q08/duckdb:parquet 76833068 / 76297906 / +0.7% 88363047 / 87034681 / +1.5% 0.87 / 0.88 / -0.8%
tpch_q09/duckdb:parquet 108824277 / 108722543 / +0.1% 120862484 / 120496821 / +0.3% 0.90 / 0.90 / -0.2%
tpch_q10/duckdb:parquet 107744975 / 106897948 / +0.8% 120267013 / 116850249 / +2.9% 0.90 / 0.91 / -2.1%
tpch_q11/duckdb:parquet 30082347 / 29838442 / +0.8% 35813403 / 35529130 / +0.8% 0.84 / 0.84 / +0.0%
tpch_q12/duckdb:parquet 38125977 / 38296481 / -0.4% 45986915 / 45197180 / +1.7% 0.83 / 0.85 / -2.2%
tpch_q13/duckdb:parquet 176584550 / 175842570 / +0.4% 182565092 / 182383123 / +0.1% 0.97 / 0.96 / +0.3%
tpch_q14/duckdb:parquet 43071495 / 43217986 / -0.3% 51445894 / 52537443 / -2.1% 0.84 / 0.82 / +1.8%
tpch_q15/duckdb:parquet 33170604 / 33055371 / +0.3% 41720959 / 41534637 / +0.4% 0.80 / 0.80 / -0.1%
tpch_q16/duckdb:parquet 48692081 / 48446976 / +0.5% 54465630 / 53452908 / +1.9% 0.89 / 0.91 / -1.4%
tpch_q17/duckdb:parquet 48628909 / 48382020 / +0.5% 58292384 / 57851431 / +0.8% 0.83 / 0.84 / -0.3%
tpch_q18/duckdb:parquet 75552173 / 75180930 / +0.5% 83508396 / 83106544 / +0.5% 0.90 / 0.90 / +0.0%
tpch_q19/duckdb:parquet 47827108 / 50581915 / -5.4% 59446931 / 60744521 / -2.1% 0.80 / 0.83 / -3.4%
tpch_q20/duckdb:parquet 64195016 / 64115182 / +0.1% 75366190 / 73707959 / +2.2% 0.85 / 0.87 / -2.1%
tpch_q21/duckdb:parquet 108004560 / 108525558 / -0.5% 118927675 / 116925506 / +1.7% 0.91 / 0.93 / -2.2%
tpch_q22/duckdb:parquet 51524006 / 51338913 / +0.4% 60438346 / 59925342 / +0.9% 0.85 / 0.86 / -0.5%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 475b320a vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-1.8%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.985x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90769804 / 89255051 / +1.7% 144833723 / 151798817 / -4.6% 0.63 / 0.59 / +6.6%
tpch_q02/datafusion:vortex-file-compressed 64618469 / 65015788 / -0.6% 96862395 / 94942848 / +2.0% 0.67 / 0.68 / -2.6%
tpch_q03/datafusion:vortex-file-compressed 63763867 / 63658261 / +0.2% 111546782 / 111980694 / -0.4% 0.57 / 0.57 / +0.6%
tpch_q04/datafusion:vortex-file-compressed 34184942 / 34921471 / -2.1% 68175329 / 74731673 / -8.8% 0.50 / 0.47 / +7.3%
tpch_q05/datafusion:vortex-file-compressed 117775256 / 118970563 / -1.0% 177085282 / 186045364 / -4.8% 0.67 / 0.64 / +4.0%
tpch_q06/datafusion:vortex-file-compressed 10347598 / 10394960 / -0.5% 56837421 / 58729342 / -3.2% 0.18 / 0.18 / +2.9%
tpch_q07/datafusion:vortex-file-compressed 133945427 / 131980165 / +1.5% 204197175 / 199639612 / +2.3% 0.66 / 0.66 / -0.8%
tpch_q08/datafusion:vortex-file-compressed 140808128 / 142366362 / -1.1% 243782171 / 219277583 / +11.2% 🔴 0.58 / 0.65 / -11.0%
tpch_q09/datafusion:vortex-file-compressed 183193558 / 187171657 / -2.1% 271663146 / 257992349 / +5.3% 0.67 / 0.73 / -7.1%
tpch_q10/datafusion:vortex-file-compressed 69505746 / 70744077 / -1.8% 134883908 / 137653868 / -2.0% 0.52 / 0.51 / +0.3%
tpch_q11/datafusion:vortex-file-compressed 43222842 / 43769055 / -1.2% 69249916 / 70094330 / -1.2% 0.62 / 0.62 / -0.0%
tpch_q12/datafusion:vortex-file-compressed 34775456 / 35277279 / -1.4% 79299688 / 79113006 / +0.2% 0.44 / 0.45 / -1.7%
tpch_q13/datafusion:vortex-file-compressed 47682360 / 48858778 / -2.4% 79443824 / 83565410 / -4.9% 0.60 / 0.58 / +2.7%
tpch_q14/datafusion:vortex-file-compressed 20826174 / 21868695 / -4.8% 87793172 / 86598582 / +1.4% 0.24 / 0.25 / -6.1%
tpch_q15/datafusion:vortex-file-compressed 33788239 / 33975185 / -0.6% 90893322 / 92668034 / -1.9% 0.37 / 0.37 / +1.4%
tpch_q16/datafusion:vortex-file-compressed 37004034 / 37287766 / -0.8% 67065642 / 67877977 / -1.2% 0.55 / 0.55 / +0.4%
tpch_q17/datafusion:vortex-file-compressed 176557639 / 175172740 / +0.8% 315271944 / 220666595 / +42.9% 🔴 0.56 / 0.79 / -29.5%
tpch_q18/datafusion:vortex-file-compressed 205883315 / 206146884 / -0.1% 269921494 / 273649921 / -1.4% 0.76 / 0.75 / +1.3%
tpch_q19/datafusion:vortex-file-compressed 25660655 / 30422100 / -15.7% 🟢 86008027 / 92046105 / -6.6% 0.30 / 0.33 / -9.7%
tpch_q20/datafusion:vortex-file-compressed 60077863 / 61082053 / -1.6% 116648378 / 118547042 / -1.6% 0.52 / 0.52 / -0.0%
tpch_q21/datafusion:vortex-file-compressed 179771918 / 178607107 / +0.7% 241194310 / 241924423 / -0.3% 0.75 / 0.74 / +1.0%
tpch_q22/datafusion:vortex-file-compressed 25081237 / 24864567 / +0.9% 53349152 / 53580925 / -0.4% 0.47 / 0.46 / +1.3%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87839222 / 87368696 / +0.5% 126354071 / 127861995 / -1.2% 0.70 / 0.68 / +1.7%
tpch_q02/datafusion:parquet 175722972 / 174083826 / +0.9% 199585892 / 198946077 / +0.3% 0.88 / 0.88 / +0.6%
tpch_q03/datafusion:parquet 138028986 / 137844778 / +0.1% 179688994 / 183410886 / -2.0% 0.77 / 0.75 / +2.2%
tpch_q04/datafusion:parquet 59210505 / 58571544 / +1.1% 93477790 / 92920319 / +0.6% 0.63 / 0.63 / +0.5%
tpch_q05/datafusion:parquet 170077649 / 169683774 / +0.2% 225804748 / 224735109 / +0.5% 0.75 / 0.76 / -0.2%
tpch_q06/datafusion:parquet 37172669 / 37122976 / +0.1% 75238378 / 74947577 / +0.4% 0.49 / 0.50 / -0.3%
tpch_q07/datafusion:parquet 219861719 / 219518387 / +0.2% 268371440 / 275445618 / -2.6% 0.82 / 0.80 / +2.8%
tpch_q08/datafusion:parquet 221403012 / 222240942 / -0.4% 286849998 / 291393698 / -1.6% 0.77 / 0.76 / +1.2%
tpch_q09/datafusion:parquet 314857514 / 315267250 / -0.1% 378016831 / 378803120 / -0.2% 0.83 / 0.83 / +0.1%
tpch_q10/datafusion:parquet 320883665 / 321445702 / -0.2% 374517099 / 378830252 / -1.1% 0.86 / 0.85 / +1.0%
tpch_q11/datafusion:parquet 127553164 / 126573780 / +0.8% 151324411 / 151706161 / -0.3% 0.84 / 0.83 / +1.0%
tpch_q12/datafusion:parquet 84883158 / 84151856 / +0.9% 119458284 / 119202767 / +0.2% 0.71 / 0.71 / +0.7%
tpch_q13/datafusion:parquet 217019502 / 216495289 / +0.2% 245453281 / 244560647 / +0.4% 0.88 / 0.89 / -0.1%
tpch_q14/datafusion:parquet 88079498 / 88496640 / -0.5% 191440784 / 201728581 / -5.1% 0.46 / 0.44 / +4.9%
tpch_q15/datafusion:parquet 106126005 / 106076789 / +0.0% 155919407 / 155328519 / +0.4% 0.68 / 0.68 / -0.3%
tpch_q16/datafusion:parquet 97646599 / 95964632 / +1.8% 120764559 / 120010701 / +0.6% 0.81 / 0.80 / +1.1%
tpch_q17/datafusion:parquet 213887068 / 213016847 / +0.4% 261975924 / 258511536 / +1.3% 0.82 / 0.82 / -0.9%
tpch_q18/datafusion:parquet 268451404 / 271451611 / -1.1% 318234163 / 314651552 / +1.1% 0.84 / 0.86 / -2.2%
tpch_q19/datafusion:parquet 108894954 / 108017781 / +0.8% 164802658 / 169517847 / -2.8% 0.66 / 0.64 / +3.7%
tpch_q20/datafusion:parquet 189566843 / 190210191 / -0.3% 264739763 / 240188488 / +10.2% 🔴 0.72 / 0.79 / -9.6%
tpch_q21/datafusion:parquet 245500665 / 244828138 / +0.3% 307710273 / 308775289 / -0.3% 0.80 / 0.79 / +0.6%
tpch_q22/datafusion:parquet 153807899 / 153559494 / +0.2% 179386975 / 178194678 / +0.7% 0.86 / 0.86 / -0.5%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33847017 / 34628583 / -2.3% 66910241 / 63148371 / +6.0% 0.51 / 0.55 / -7.8%
tpch_q02/duckdb:vortex-file-compressed 28456394 / 28265284 / +0.7% 42408688 / 42869080 / -1.1% 0.67 / 0.66 / +1.8%
tpch_q03/duckdb:vortex-file-compressed 52824071 / 52134304 / +1.3% 97033444 / 97373188 / -0.3% 0.54 / 0.54 / +1.7%
tpch_q04/duckdb:vortex-file-compressed 51112749 / 50388682 / +1.4% 83420978 / 82805613 / +0.7% 0.61 / 0.61 / +0.7%
tpch_q05/duckdb:vortex-file-compressed 68225949 / 69552039 / -1.9% 103875068 / 105896848 / -1.9% 0.66 / 0.66 / +0.0%
tpch_q06/duckdb:vortex-file-compressed 15462594 / 15655028 / -1.2% 48286242 / 49233880 / -1.9% 0.32 / 0.32 / +0.7%
tpch_q07/duckdb:vortex-file-compressed 55505978 / 55924649 / -0.7% 101414525 / 102703022 / -1.3% 0.55 / 0.54 / +0.5%
tpch_q08/duckdb:vortex-file-compressed 87929485 / 87648586 / +0.3% 126739285 / 128820535 / -1.6% 0.69 / 0.68 / +2.0%
tpch_q09/duckdb:vortex-file-compressed 102096291 / 101895414 / +0.2% 150174291 / 153843362 / -2.4% 0.68 / 0.66 / +2.6%
tpch_q10/duckdb:vortex-file-compressed 94629203 / 95578746 / -1.0% 141164237 / 138864358 / +1.7% 0.67 / 0.69 / -2.6%
tpch_q11/duckdb:vortex-file-compressed 13238639 / 13359125 / -0.9% 28535999 / 29133955 / -2.1% 0.46 / 0.46 / +1.2%
tpch_q12/duckdb:vortex-file-compressed 45248226 / 44778474 / +1.0% 77144558 / 80033923 / -3.6% 0.59 / 0.56 / +4.8%
tpch_q13/duckdb:vortex-file-compressed 71849359 / 73185545 / -1.8% 96404768 / 95541761 / +0.9% 0.75 / 0.77 / -2.7%
tpch_q14/duckdb:vortex-file-compressed 28658262 / 28694401 / -0.1% 70828768 / 69184778 / +2.4% 0.40 / 0.41 / -2.4%
tpch_q15/duckdb:vortex-file-compressed 24858448 / 24917046 / -0.2% 60210632 / 61375732 / -1.9% 0.41 / 0.41 / +1.7%
tpch_q16/duckdb:vortex-file-compressed 49089864 / 47849508 / +2.6% 58267671 / 58544628 / -0.5% 0.84 / 0.82 / +3.1%
tpch_q17/duckdb:vortex-file-compressed 34571986 / 35386705 / -2.3% 66198433 / 65592778 / +0.9% 0.52 / 0.54 / -3.2%
tpch_q18/duckdb:vortex-file-compressed 105504001 / 105387928 / +0.1% 118870931 / 120554783 / -1.4% 0.89 / 0.87 / +1.5%
tpch_q19/duckdb:vortex-file-compressed 27888854 / 27879632 / +0.0% 73096454 / 72375475 / +1.0% 0.38 / 0.39 / -1.0%
tpch_q20/duckdb:vortex-file-compressed 41785373 / 41873332 / -0.2% 86959943 / 89530338 / -2.9% 0.48 / 0.47 / +2.7%
tpch_q21/duckdb:vortex-file-compressed 93982674 / 96352501 / -2.5% 143715483 / 143914571 / -0.1% 0.65 / 0.67 / -2.3%
tpch_q22/duckdb:vortex-file-compressed 32765574 / 32234491 / +1.6% 49462950 / 48211625 / +2.6% 0.66 / 0.67 / -0.9%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68722357 / 68884852 / -0.2% 89701510 / 90032929 / -0.4% 0.77 / 0.77 / +0.1%
tpch_q02/duckdb:parquet 87544046 / 87634295 / -0.1% 97507677 / 98800141 / -1.3% 0.90 / 0.89 / +1.2%
tpch_q03/duckdb:parquet 111180681 / 111393685 / -0.2% 142563555 / 143939319 / -1.0% 0.78 / 0.77 / +0.8%
tpch_q04/duckdb:parquet 77078832 / 78761710 / -2.1% 98069239 / 96907681 / +1.2% 0.79 / 0.81 / -3.3%
tpch_q05/duckdb:parquet 123551622 / 125473048 / -1.5% 159169180 / 157708809 / +0.9% 0.78 / 0.80 / -2.4%
tpch_q06/duckdb:parquet 36538687 / 36143926 / +1.1% 57447937 / 57665594 / -0.4% 0.64 / 0.63 / +1.5%
tpch_q07/duckdb:parquet 118780229 / 117157091 / +1.4% 155997615 / 155070011 / +0.6% 0.76 / 0.76 / +0.8%
tpch_q08/duckdb:parquet 148628961 / 149051786 / -0.3% 190442108 / 190406433 / +0.0% 0.78 / 0.78 / -0.3%
tpch_q09/duckdb:parquet 238360863 / 241388962 / -1.3% 279981265 / 284144788 / -1.5% 0.85 / 0.85 / +0.2%
tpch_q10/duckdb:parquet 317314692 / 316818482 / +0.2% 336726405 / 340358055 / -1.1% 0.94 / 0.93 / +1.2%
tpch_q11/duckdb:parquet 44323628 / 44058957 / +0.6% 51634696 / 51642228 / -0.0% 0.86 / 0.85 / +0.6%
tpch_q12/duckdb:parquet 71042793 / 72613282 / -2.2% 91140698 / 92369855 / -1.3% 0.78 / 0.79 / -0.8%
tpch_q13/duckdb:parquet 293876848 / 295602456 / -0.6% 309699259 / 311037836 / -0.4% 0.95 / 0.95 / -0.2%
tpch_q14/duckdb:parquet 104718554 / 102641437 / +2.0% 138338898 / 137537356 / +0.6% 0.76 / 0.75 / +1.4%
tpch_q15/duckdb:parquet 58978443 / 58562796 / +0.7% 86790412 / 87341612 / -0.6% 0.68 / 0.67 / +1.3%
tpch_q16/duckdb:parquet 101722602 / 101516941 / +0.2% 108926966 / 107924096 / +0.9% 0.93 / 0.94 / -0.7%
tpch_q17/duckdb:parquet 82701821 / 82982497 / -0.3% 113040329 / 116477291 / -3.0% 0.73 / 0.71 / +2.7%
tpch_q18/duckdb:parquet 158761073 / 162781413 / -2.5% 172113596 / 176107872 / -2.3% 0.92 / 0.92 / -0.2%
tpch_q19/duckdb:parquet 100608737 / 100644327 / -0.0% 130863051 / 129160526 / +1.3% 0.77 / 0.78 / -1.3%
tpch_q20/duckdb:parquet 147854975 / 147762874 / +0.1% 184344788 / 181776837 / +1.4% 0.80 / 0.81 / -1.3%
tpch_q21/duckdb:parquet 253158657 / 256842317 / -1.4% 281338180 / 275377695 / +2.2% 0.90 / 0.93 / -3.5%
tpch_q22/duckdb:parquet 170004269 / 169184411 / +0.5% 183904531 / 183870885 / +0.0% 0.92 / 0.92 / +0.5%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 475b320a vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Engines: DataFusion No clear signal (-1.5%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.008x ➖ · cold 1.001x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21290771 / 20662877 / +3.0% 38522034 / 38388298 / +0.3% 0.55 / 0.54 / +2.7%
tpcds_q02/datafusion:vortex-file-compressed 45259132 / 44071682 / +2.7% 65120326 / 64203849 / +1.4% 0.70 / 0.69 / +1.2%
tpcds_q03/datafusion:vortex-file-compressed 11155184 / 11095395 / +0.5% 27094795 / 26770394 / +1.2% 0.41 / 0.41 / -0.7%
tpcds_q04/datafusion:vortex-file-compressed 87910706 / 85937970 / +2.3% 117048627 / 120762373 / -3.1% 0.75 / 0.71 / +5.5%
tpcds_q05/datafusion:vortex-file-compressed 56935080 / 56220694 / +1.3% 84653752 / 76967535 / +10.0% 0.67 / 0.73 / -7.9%
tpcds_q06/datafusion:vortex-file-compressed 22400692 / 21976346 / +1.9% 45065315 / 43424391 / +3.8% 0.50 / 0.51 / -1.8%
tpcds_q07/datafusion:vortex-file-compressed 29144337 / 28753308 / +1.4% 51711524 / 51675554 / +0.1% 0.56 / 0.56 / +1.3%
tpcds_q08/datafusion:vortex-file-compressed 24610506 / 24541650 / +0.3% 42541604 / 43475451 / -2.1% 0.58 / 0.56 / +2.5%
tpcds_q09/datafusion:vortex-file-compressed 19009566 / 20105705 / -5.5% 34524844 / 37029178 / -6.8% 0.55 / 0.54 / +1.4%
tpcds_q10/datafusion:vortex-file-compressed 26427738 / 26771250 / -1.3% 49476678 / 50455373 / -1.9% 0.53 / 0.53 / +0.7%
tpcds_q11/datafusion:vortex-file-compressed 53891838 / 51942594 / +3.8% 83442209 / 83041366 / +0.5% 0.65 / 0.63 / +3.3%
tpcds_q12/datafusion:vortex-file-compressed 14836652 / 14909005 / -0.5% 32268734 / 32866199 / -1.8% 0.46 / 0.45 / +1.4%
tpcds_q13/datafusion:vortex-file-compressed 30681974 / 31125908 / -1.4% 56854969 / 56678644 / +0.3% 0.54 / 0.55 / -1.7%
tpcds_q14/datafusion:vortex-file-compressed 488331789 / 487173892 / +0.2% 549754268 / 549971662 / -0.0% 0.89 / 0.89 / +0.3%
tpcds_q15/datafusion:vortex-file-compressed 12102173 / 12454406 / -2.8% 34142301 / 33623513 / +1.5% 0.35 / 0.37 / -4.3%
tpcds_q16/datafusion:vortex-file-compressed 18203132 / 18526448 / -1.7% 38557906 / 38010837 / +1.4% 0.47 / 0.49 / -3.1%
tpcds_q17/datafusion:vortex-file-compressed 54018182 / 50769293 / +6.4% 79184493 / 75447269 / +5.0% 0.68 / 0.67 / +1.4%
tpcds_q18/datafusion:vortex-file-compressed 63780037 / 63588463 / +0.3% 85536201 / 85468521 / +0.1% 0.75 / 0.74 / +0.2%
tpcds_q19/datafusion:vortex-file-compressed 16498098 / 17047396 / -3.2% 39222404 / 38742283 / +1.2% 0.42 / 0.44 / -4.4%
tpcds_q20/datafusion:vortex-file-compressed 15839906 / 16464230 / -3.8% 36752499 / 35800079 / +2.7% 0.43 / 0.46 / -6.3%
tpcds_q21/datafusion:vortex-file-compressed 16716966 / 15940484 / +4.9% 37544635 / 37502958 / +0.1% 0.45 / 0.43 / +4.8%
tpcds_q22/datafusion:vortex-file-compressed 49675287 / 49830978 / -0.3% 71917625 / 73429530 / -2.1% 0.69 / 0.68 / +1.8%
tpcds_q23/datafusion:vortex-file-compressed 69524030 / 71127504 / -2.3% 97160362 / 95266102 / +2.0% 0.72 / 0.75 / -4.2%
tpcds_q24/datafusion:vortex-file-compressed 64511014 / 65827480 / -2.0% 85833231 / 87950060 / -2.4% 0.75 / 0.75 / +0.4%
tpcds_q25/datafusion:vortex-file-compressed 47740873 / 48552602 / -1.7% 76205290 / 69532625 / +9.6% 0.63 / 0.70 / -10.3%
tpcds_q26/datafusion:vortex-file-compressed 25772508 / 25883028 / -0.4% 46567130 / 45868290 / +1.5% 0.55 / 0.56 / -1.9%
tpcds_q27/datafusion:vortex-file-compressed 63075026 / 63281436 / -0.3% 82139271 / 80805852 / +1.7% 0.77 / 0.78 / -1.9%
tpcds_q28/datafusion:vortex-file-compressed 18869508 / 26229064 / -28.1% 🟢 38561611 / 40810592 / -5.5% 0.49 / 0.64 / -23.9%
tpcds_q29/datafusion:vortex-file-compressed 54000694 / 53880442 / +0.2% 75863257 / 75632558 / +0.3% 0.71 / 0.71 / -0.1%
tpcds_q30/datafusion:vortex-file-compressed 26296448 / 25882580 / +1.6% 44034579 / 45306891 / -2.8% 0.60 / 0.57 / +4.5%
tpcds_q31/datafusion:vortex-file-compressed 58467716 / 58167868 / +0.5% 82557930 / 83805563 / -1.5% 0.71 / 0.69 / +2.0%
tpcds_q32/datafusion:vortex-file-compressed 12180736 / 12486154 / -2.4% 29723975 / 29878584 / -0.5% 0.41 / 0.42 / -1.9%
tpcds_q33/datafusion:vortex-file-compressed 27265556 / 27470150 / -0.7% 48016122 / 50803280 / -5.5% 0.57 / 0.54 / +5.0%
tpcds_q34/datafusion:vortex-file-compressed 17232876 / 17355034 / -0.7% 35639702 / 37376510 / -4.6% 0.48 / 0.46 / +4.1%
tpcds_q35/datafusion:vortex-file-compressed 29931460 / 30165718 / -0.8% 52275502 / 54544146 / -4.2% 0.57 / 0.55 / +3.5%
tpcds_q36/datafusion:vortex-file-compressed 47545500 / 48307158 / -1.6% 69577754 / 67264121 / +3.4% 0.68 / 0.72 / -4.8%
tpcds_q37/datafusion:vortex-file-compressed 11952738 / 11857472 / +0.8% 33121856 / 34111657 / -2.9% 0.36 / 0.35 / +3.8%
tpcds_q38/datafusion:vortex-file-compressed 25301878 / 25514558 / -0.8% 47453712 / 48241747 / -1.6% 0.53 / 0.53 / +0.8%
tpcds_q39/datafusion:vortex-file-compressed 64347957 / 64890302 / -0.8% 88616271 / 89633580 / -1.1% 0.73 / 0.72 / +0.3%
tpcds_q40/datafusion:vortex-file-compressed 23176904 / 23494010 / -1.3% 44360183 / 43948484 / +0.9% 0.52 / 0.53 / -2.3%
tpcds_q41/datafusion:vortex-file-compressed 20033687 / 20495924 / -2.3% 34362235 / 32839414 / +4.6% 0.58 / 0.62 / -6.6%
tpcds_q42/datafusion:vortex-file-compressed 10851261 / 10944217 / -0.8% 28375839 / 26800473 / +5.9% 0.38 / 0.41 / -6.4%
tpcds_q43/datafusion:vortex-file-compressed 12229672 / 12235502 / -0.0% 31942015 / 32362966 / -1.3% 0.38 / 0.38 / +1.3%
tpcds_q44/datafusion:vortex-file-compressed 27030602 / 28950501 / -6.6% 50930473 / 53633308 / -5.0% 0.53 / 0.54 / -1.7%
tpcds_q45/datafusion:vortex-file-compressed 16088967 / 16086212 / +0.0% 35921169 / 36240197 / -0.9% 0.45 / 0.44 / +0.9%
tpcds_q46/datafusion:vortex-file-compressed 23032957 / 23330782 / -1.3% 45547797 / 46023788 / -1.0% 0.51 / 0.51 / -0.2%
tpcds_q47/datafusion:vortex-file-compressed 74668009 / 74638130 / +0.0% 103967816 / 104471851 / -0.5% 0.72 / 0.71 / +0.5%
tpcds_q48/datafusion:vortex-file-compressed 28021344 / 28355408 / -1.2% 53010081 / 52242427 / +1.5% 0.53 / 0.54 / -2.6%
tpcds_q49/datafusion:vortex-file-compressed 57609798 / 57975552 / -0.6% 78296382 / 80249136 / -2.4% 0.74 / 0.72 / +1.8%
tpcds_q50/datafusion:vortex-file-compressed 30562566 / 30773469 / -0.7% 54193715 / 53329113 / +1.6% 0.56 / 0.58 / -2.3%
tpcds_q51/datafusion:vortex-file-compressed 65817926 / 66370124 / -0.8% 88024421 / 87949849 / +0.1% 0.75 / 0.75 / -0.9%
tpcds_q52/datafusion:vortex-file-compressed 11225727 / 11303700 / -0.7% 29664970 / 28114971 / +5.5% 0.38 / 0.40 / -5.9%
tpcds_q53/datafusion:vortex-file-compressed 17719654 / 17817615 / -0.5% 39231161 / 39106120 / +0.3% 0.45 / 0.46 / -0.9%
tpcds_q54/datafusion:vortex-file-compressed 31067812 / 30815867 / +0.8% 54893277 / 53633024 / +2.3% 0.57 / 0.57 / -1.5%
tpcds_q55/datafusion:vortex-file-compressed 10729737 / 10947926 / -2.0% 26767603 / 26268641 / +1.9% 0.40 / 0.42 / -3.8%
tpcds_q56/datafusion:vortex-file-compressed 26357008 / 25893575 / +1.8% 46433585 / 48418478 / -4.1% 0.57 / 0.53 / +6.1%
tpcds_q57/datafusion:vortex-file-compressed 61505578 / 61658540 / -0.2% 85726648 / 88488887 / -3.1% 0.72 / 0.70 / +3.0%
tpcds_q58/datafusion:vortex-file-compressed 37993640 / 38139050 / -0.4% 64556442 / 62952715 / +2.5% 0.59 / 0.61 / -2.9%
tpcds_q59/datafusion:vortex-file-compressed 29581862 / 29773657 / -0.6% 54075803 / 54576681 / -0.9% 0.55 / 0.55 / +0.3%
tpcds_q60/datafusion:vortex-file-compressed 26439300 / 25763284 / +2.6% 46395218 / 47311516 / -1.9% 0.57 / 0.54 / +4.7%
tpcds_q61/datafusion:vortex-file-compressed 21280231 / 21212998 / +0.3% 43056628 / 43808218 / -1.7% 0.49 / 0.48 / +2.1%
tpcds_q62/datafusion:vortex-file-compressed 16300272 / 16226768 / +0.5% 35482609 / 34675741 / +2.3% 0.46 / 0.47 / -1.8%
tpcds_q63/datafusion:vortex-file-compressed 17431368 / 17479711 / -0.3% 38744871 / 38987535 / -0.6% 0.45 / 0.45 / +0.3%
tpcds_q64/datafusion:vortex-file-compressed 211008789 / 212632786 / -0.8% 244777029 / 245822306 / -0.4% 0.86 / 0.86 / -0.3%
tpcds_q65/datafusion:vortex-file-compressed 73159864 / 72326343 / +1.2% 93998590 / 92518043 / +1.6% 0.78 / 0.78 / -0.4%
tpcds_q66/datafusion:vortex-file-compressed 50351982 / 50841554 / -1.0% 74698379 / 72759471 / +2.7% 0.67 / 0.70 / -3.5%
tpcds_q67/datafusion:vortex-file-compressed 50207674 / 51321318 / -2.2% 83594133 / 84264967 / -0.8% 0.60 / 0.61 / -1.4%
tpcds_q68/datafusion:vortex-file-compressed 22920472 / 22754568 / +0.7% 49017975 / 46535563 / +5.3% 0.47 / 0.49 / -4.4%
tpcds_q69/datafusion:vortex-file-compressed 25180646 / 25748720 / -2.2% 46943126 / 47728418 / -1.6% 0.54 / 0.54 / -0.6%
tpcds_q70/datafusion:vortex-file-compressed 70400336 / 70768666 / -0.5% 93915391 / 94483406 / -0.6% 0.75 / 0.75 / +0.1%
tpcds_q71/datafusion:vortex-file-compressed 19513668 / 19265814 / +1.3% 40069964 / 40165351 / -0.2% 0.49 / 0.48 / +1.5%
tpcds_q72/datafusion:vortex-file-compressed 339394564 / 346150522 / -2.0% 412025119 / 397297658 / +3.7% 0.82 / 0.87 / -5.5%
tpcds_q73/datafusion:vortex-file-compressed 16065756 / 15934651 / +0.8% 36260902 / 35011866 / +3.6% 0.44 / 0.46 / -2.7%
tpcds_q74/datafusion:vortex-file-compressed 39764996 / 39780041 / -0.0% 66084157 / 66803203 / -1.1% 0.60 / 0.60 / +1.0%
tpcds_q75/datafusion:vortex-file-compressed 134317054 / 135714753 / -1.0% 166107931 / 162660370 / +2.1% 0.81 / 0.83 / -3.1%
tpcds_q76/datafusion:vortex-file-compressed 30012938 / 29291308 / +2.5% 49182476 / 47924547 / +2.6% 0.61 / 0.61 / -0.2%
tpcds_q77/datafusion:vortex-file-compressed 44763246 / 44660360 / +0.2% 66757935 / 65734489 / +1.6% 0.67 / 0.68 / -1.3%
tpcds_q78/datafusion:vortex-file-compressed 64156422 / 63632236 / +0.8% 93109442 / 94010583 / -1.0% 0.69 / 0.68 / +1.8%
tpcds_q79/datafusion:vortex-file-compressed 19753050 / 19924334 / -0.9% 42988482 / 42878743 / +0.3% 0.46 / 0.46 / -1.1%
tpcds_q80/datafusion:vortex-file-compressed 73510542 / 72991048 / +0.7% 102510852 / 100489903 / +2.0% 0.72 / 0.73 / -1.3%
tpcds_q81/datafusion:vortex-file-compressed 26493484 / 26190294 / +1.2% 45521449 / 44415165 / +2.5% 0.58 / 0.59 / -1.3%
tpcds_q82/datafusion:vortex-file-compressed 11796158 / 12373004 / -4.7% 33844734 / 33916690 / -0.2% 0.35 / 0.36 / -4.5%
tpcds_q83/datafusion:vortex-file-compressed 32584781 / 32776157 / -0.6% 53460922 / 50511779 / +5.8% 0.61 / 0.65 / -6.1%
tpcds_q84/datafusion:vortex-file-compressed 10207550 / 10014122 / +1.9% 26982888 / 26553087 / +1.6% 0.38 / 0.38 / +0.3%
tpcds_q85/datafusion:vortex-file-compressed 53330718 / 53044578 / +0.5% 79829469 / 80954298 / -1.4% 0.67 / 0.66 / +2.0%
tpcds_q86/datafusion:vortex-file-compressed 15837982 / 15658548 / +1.1% 33476383 / 32311558 / +3.6% 0.47 / 0.48 / -2.4%
tpcds_q87/datafusion:vortex-file-compressed 25086414 / 25551026 / -1.8% 48107221 / 46861588 / +2.7% 0.52 / 0.55 / -4.4%
tpcds_q88/datafusion:vortex-file-compressed 31080251 / 31550716 / -1.5% 51225274 / 54227953 / -5.5% 0.61 / 0.58 / +4.3%
tpcds_q89/datafusion:vortex-file-compressed 21133400 / 21217704 / -0.4% 43586659 / 40149772 / +8.6% 0.48 / 0.53 / -8.3%
tpcds_q90/datafusion:vortex-file-compressed 10018862 / 9912202 / +1.1% 25517947 / 24923081 / +2.4% 0.39 / 0.40 / -1.3%
tpcds_q91/datafusion:vortex-file-compressed 15092491 / 16331088 / -7.6% 36844537 / 36210118 / +1.8% 0.41 / 0.45 / -9.2%
tpcds_q92/datafusion:vortex-file-compressed 13052974 / 12712254 / +2.7% 29103998 / 29043054 / +0.2% 0.45 / 0.44 / +2.5%
tpcds_q93/datafusion:vortex-file-compressed 20442158 / 20005716 / +2.2% 41847230 / 40530909 / +3.2% 0.49 / 0.49 / -1.0%
tpcds_q94/datafusion:vortex-file-compressed 18012060 / 18455416 / -2.4% 36873752 / 37274216 / -1.1% 0.49 / 0.50 / -1.3%
tpcds_q95/datafusion:vortex-file-compressed 42273408 / 42223247 / +0.1% 62355331 / 61088035 / +2.1% 0.68 / 0.69 / -1.9%
tpcds_q96/datafusion:vortex-file-compressed 7448422 / 7643602 / -2.6% 24488959 / 24204839 / +1.2% 0.30 / 0.32 / -3.7%
tpcds_q97/datafusion:vortex-file-compressed 16478477 / 17142063 / -3.9% 37230399 / 36143924 / +3.0% 0.44 / 0.47 / -6.7%
tpcds_q98/datafusion:vortex-file-compressed 16259092 / 16025235 / +1.5% 38412636 / 36067472 / +6.5% 0.42 / 0.44 / -4.7%
tpcds_q99/datafusion:vortex-file-compressed 15898496 / 15816152 / +0.5% 36579070 / 35033983 / +4.4% 0.43 / 0.45 / -3.7%
datafusion / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43856792 / 41037398 / +6.9% 60553370 / 60468031 / +0.1% 0.72 / 0.68 / +6.7%
tpcds_q02/datafusion:parquet 55528369 / 55294162 / +0.4% 73182839 / 72584598 / +0.8% 0.76 / 0.76 / -0.4%
tpcds_q03/datafusion:parquet 19200460 / 19145511 / +0.3% 32574864 / 31737576 / +2.6% 0.59 / 0.60 / -2.3%
tpcds_q04/datafusion:parquet 181017493 / 179148961 / +1.0% 205969320 / 207193262 / -0.6% 0.88 / 0.86 / +1.6%
tpcds_q05/datafusion:parquet 68321390 / 67866314 / +0.7% 89710833 / 93269797 / -3.8% 0.76 / 0.73 / +4.7%
tpcds_q06/datafusion:parquet 33892768 / 34548628 / -1.9% 46449367 / 48650311 / -4.5% 0.73 / 0.71 / +2.8%
tpcds_q07/datafusion:parquet 47649898 / 47252786 / +0.8% 67268928 / 68512135 / -1.8% 0.71 / 0.69 / +2.7%
tpcds_q08/datafusion:parquet 31687144 / 31369000 / +1.0% 47917997 / 45820766 / +4.6% 0.66 / 0.68 / -3.4%
tpcds_q09/datafusion:parquet 33799636 / 34307494 / -1.5% 44673831 / 43105925 / +3.6% 0.76 / 0.80 / -4.9%
tpcds_q10/datafusion:parquet 44885148 / 44551387 / +0.7% 58649463 / 60617616 / -3.2% 0.77 / 0.73 / +4.1%
tpcds_q11/datafusion:parquet 97360021 / 98283752 / -0.9% 119745002 / 121127398 / -1.1% 0.81 / 0.81 / +0.2%
tpcds_q12/datafusion:parquet 24345058 / 24266474 / +0.3% 35343497 / 36327580 / -2.7% 0.69 / 0.67 / +3.1%
tpcds_q13/datafusion:parquet 48160982 / 46580310 / +3.4% 68535031 / 67994465 / +0.8% 0.70 / 0.69 / +2.6%
tpcds_q14/datafusion:parquet 537287756 / 535803457 / +0.3% 585788550 / 576399589 / +1.6% 0.92 / 0.93 / -1.3%
tpcds_q15/datafusion:parquet 23699310 / 23987052 / -1.2% 38247247 / 38772857 / -1.4% 0.62 / 0.62 / +0.2%
tpcds_q16/datafusion:parquet 37044986 / 37385275 / -0.9% 52081233 / 50808144 / +2.5% 0.71 / 0.74 / -3.3%
tpcds_q17/datafusion:parquet 76725320 / 74179220 / +3.4% 97061227 / 99947249 / -2.9% 0.79 / 0.74 / +6.5%
tpcds_q18/datafusion:parquet 68958690 / 68176314 / +1.1% 95666380 / 90601495 / +5.6% 0.72 / 0.75 / -4.2%
tpcds_q19/datafusion:parquet 29921082 / 29979450 / -0.2% 45336324 / 42461266 / +6.8% 0.66 / 0.71 / -6.5%
tpcds_q20/datafusion:parquet 25674326 / 25299084 / +1.5% 37672797 / 38763993 / -2.8% 0.68 / 0.65 / +4.4%
tpcds_q21/datafusion:parquet 20755824 / 20143853 / +3.0% 33368954 / 32533897 / +2.6% 0.62 / 0.62 / +0.5%
tpcds_q22/datafusion:parquet 77902291 / 77992354 / -0.1% 90078291 / 88630266 / +1.6% 0.86 / 0.88 / -1.7%
tpcds_q23/datafusion:parquet 92653693 / 92070006 / +0.6% 113840537 / 115685844 / -1.6% 0.81 / 0.80 / +2.3%
tpcds_q24/datafusion:parquet 91049146 / 91320906 / -0.3% 116773741 / 114776797 / +1.7% 0.78 / 0.80 / -2.0%
tpcds_q25/datafusion:parquet 82758730 / 80147062 / +3.3% 103508982 / 100467329 / +3.0% 0.80 / 0.80 / +0.2%
tpcds_q26/datafusion:parquet 43202150 / 43368406 / -0.4% 60971443 / 62993503 / -3.2% 0.71 / 0.69 / +2.9%
tpcds_q27/datafusion:parquet 76643026 / 77766271 / -1.4% 106259345 / 95385028 / +11.4% 🔴 0.72 / 0.82 / -11.5%
tpcds_q28/datafusion:parquet 28545900 / 28898218 / -1.2% 43014731 / 41658255 / +3.3% 0.66 / 0.69 / -4.3%
tpcds_q29/datafusion:parquet 76935160 / 74946869 / +2.7% 97553786 / 95881548 / +1.7% 0.79 / 0.78 / +0.9%
tpcds_q30/datafusion:parquet 46048040 / 43893362 / +4.9% 61867500 / 59749504 / +3.5% 0.74 / 0.73 / +1.3%
tpcds_q31/datafusion:parquet 80839877 / 81440329 / -0.7% 102562618 / 100055168 / +2.5% 0.79 / 0.81 / -3.2%
tpcds_q32/datafusion:parquet 26746746 / 27143890 / -1.5% 40402788 / 40303899 / +0.2% 0.66 / 0.67 / -1.7%
tpcds_q33/datafusion:parquet 37768154 / 37398043 / +1.0% 55870643 / 54795235 / +2.0% 0.68 / 0.68 / -1.0%
tpcds_q34/datafusion:parquet 24700284 / 24635061 / +0.3% 36931477 / 36342546 / +1.6% 0.67 / 0.68 / -1.3%
tpcds_q35/datafusion:parquet 51404568 / 50802148 / +1.2% 62692843 / 64573709 / -2.9% 0.82 / 0.79 / +4.2%
tpcds_q36/datafusion:parquet 52866662 / 52685074 / +0.3% 78762920 / 74511270 / +5.7% 0.67 / 0.71 / -5.1%
tpcds_q37/datafusion:parquet 21531866 / 21130209 / +1.9% 34364845 / 32955418 / +4.3% 0.63 / 0.64 / -2.3%
tpcds_q38/datafusion:parquet 44378818 / 45074440 / -1.5% 61423272 / 61169495 / +0.4% 0.72 / 0.74 / -2.0%
tpcds_q39/datafusion:parquet 67894910 / 67143299 / +1.1% 85336293 / 87798285 / -2.8% 0.80 / 0.76 / +4.0%
tpcds_q40/datafusion:parquet 30354372 / 31732224 / -4.3% 51304516 / 51366919 / -0.1% 0.59 / 0.62 / -4.2%
tpcds_q41/datafusion:parquet 19902090 / 19560677 / +1.7% 32741087 / 30927269 / +5.9% 0.61 / 0.63 / -3.9%
tpcds_q42/datafusion:parquet 18198556 / 18303020 / -0.6% 30503362 / 30195041 / +1.0% 0.60 / 0.61 / -1.6%
tpcds_q43/datafusion:parquet 19601037 / 19552828 / +0.2% 32128467 / 32452403 / -1.0% 0.61 / 0.60 / +1.3%
tpcds_q44/datafusion:parquet 35560171 / 35238887 / +0.9% 49910643 / 50018816 / -0.2% 0.71 / 0.70 / +1.1%
tpcds_q45/datafusion:parquet 26542946 / 27571686 / -3.7% 43017644 / 42507478 / +1.2% 0.62 / 0.65 / -4.9%
tpcds_q46/datafusion:parquet 29641476 / 29861832 / -0.7% 46788063 / 46926615 / -0.3% 0.63 / 0.64 / -0.4%
tpcds_q47/datafusion:parquet 98892342 / 98146604 / +0.8% 124326251 / 122067336 / +1.9% 0.80 / 0.80 / -1.1%
tpcds_q48/datafusion:parquet 42602608 / 42447005 / +0.4% 60321769 / 59145720 / +2.0% 0.71 / 0.72 / -1.6%
tpcds_q49/datafusion:parquet 72432684 / 72220930 / +0.3% 93153087 / 96046791 / -3.0% 0.78 / 0.75 / +3.4%
tpcds_q50/datafusion:parquet 48406986 / 47512774 / +1.9% 70412544 / 71800733 / -1.9% 0.69 / 0.66 / +3.9%
tpcds_q51/datafusion:parquet 76444456 / 75603896 / +1.1% 96190372 / 96356391 / -0.2% 0.79 / 0.78 / +1.3%
tpcds_q52/datafusion:parquet 18704918 / 18667056 / +0.2% 30162876 / 29454574 / +2.4% 0.62 / 0.63 / -2.2%
tpcds_q53/datafusion:parquet 23117565 / 23176485 / -0.3% 39549830 / 39182736 / +0.9% 0.58 / 0.59 / -1.2%
tpcds_q54/datafusion:parquet 52456570 / 51885012 / +1.1% 69846767 / 69416818 / +0.6% 0.75 / 0.75 / +0.5%
tpcds_q55/datafusion:parquet 18611312 / 18301546 / +1.7% 29114100 / 31877199 / -8.7% 0.64 / 0.57 / +11.3%
tpcds_q56/datafusion:parquet 40831972 / 39632970 / +3.0% 57122251 / 55628203 / +2.7% 0.71 / 0.71 / +0.3%
tpcds_q57/datafusion:parquet 103518186 / 100454820 / +3.0% 117283657 / 121808907 / -3.7% 0.88 / 0.82 / +7.0%
tpcds_q58/datafusion:parquet 66734881 / 65082382 / +2.5% 86490053 / 84884800 / +1.9% 0.77 / 0.77 / +0.6%
tpcds_q59/datafusion:parquet 47786130 / 47924398 / -0.3% 66803895 / 68304504 / -2.2% 0.72 / 0.70 / +2.0%
tpcds_q60/datafusion:parquet 41837150 / 42313918 / -1.1% 54664351 / 60333944 / -9.4% 0.77 / 0.70 / +9.1%
tpcds_q61/datafusion:parquet 37556790 / 36404834 / +3.2% 54511602 / 50470158 / +8.0% 0.69 / 0.72 / -4.5%
tpcds_q62/datafusion:parquet 25490620 / 25240186 / +1.0% 38787813 / 37930554 / +2.3% 0.66 / 0.67 / -1.2%
tpcds_q63/datafusion:parquet 22594514 / 22274464 / +1.4% 38516378 / 40137287 / -4.0% 0.59 / 0.55 / +5.7%
tpcds_q64/datafusion:parquet 288640748 / 291825881 / -1.1% 325482108 / 326894100 / -0.4% 0.89 / 0.89 / -0.7%
tpcds_q65/datafusion:parquet 122922938 / 121713454 / +1.0% 136699848 / 142669978 / -4.2% 0.90 / 0.85 / +5.4%
tpcds_q66/datafusion:parquet 60468396 / 59440828 / +1.7% 76696682 / 75640564 / +1.4% 0.79 / 0.79 / +0.3%
tpcds_q67/datafusion:parquet 68850986 / 68348957 / +0.7% 96008466 / 93585303 / +2.6% 0.72 / 0.73 / -1.8%
tpcds_q68/datafusion:parquet 29837478 / 29525206 / +1.1% 49214838 / 49365427 / -0.3% 0.61 / 0.60 / +1.4%
tpcds_q69/datafusion:parquet 44788123 / 42326063 / +5.8% 59790462 / 56487138 / +5.8% 0.75 / 0.75 / -0.0%
tpcds_q70/datafusion:parquet 83966866 / 80186448 / +4.7% 99959313 / 98784851 / +1.2% 0.84 / 0.81 / +3.5%
tpcds_q71/datafusion:parquet 24981312 / 26321141 / -5.1% 41047808 / 36794416 / +11.6% 🔴 0.61 / 0.72 / -14.9%
tpcds_q72/datafusion:parquet 520325868 / 524180635 / -0.7% 548564616 / 558063742 / -1.7% 0.95 / 0.94 / +1.0%
tpcds_q73/datafusion:parquet 24051101 / 24084504 / -0.1% 36786495 / 36840445 / -0.1% 0.65 / 0.65 / +0.0%
tpcds_q74/datafusion:parquet 70938690 / 70174123 / +1.1% 89936536 / 90258255 / -0.4% 0.79 / 0.78 / +1.5%
tpcds_q75/datafusion:parquet 152411901 / 156896393 / -2.9% 182086548 / 184038891 / -1.1% 0.84 / 0.85 / -1.8%
tpcds_q76/datafusion:parquet 34155681 / 34224952 / -0.2% 48438767 / 50692625 / -4.4% 0.71 / 0.68 / +4.4%
tpcds_q77/datafusion:parquet 57562575 / 58233668 / -1.2% 74449128 / 76077433 / -2.1% 0.77 / 0.77 / +1.0%
tpcds_q78/datafusion:parquet 87200038 / 85428305 / +2.1% 119625877 / 118447829 / +1.0% 0.73 / 0.72 / +1.1%
tpcds_q79/datafusion:parquet 27411744 / 27134527 / +1.0% 42983811 / 42881579 / +0.2% 0.64 / 0.63 / +0.8%
tpcds_q80/datafusion:parquet 81795994 / 80657915 / +1.4% 111323507 / 110802292 / +0.5% 0.73 / 0.73 / +0.9%
tpcds_q81/datafusion:parquet 40364030 / 37777232 / +6.8% 52617243 / 53177596 / -1.1% 0.77 / 0.71 / +8.0%
tpcds_q82/datafusion:parquet 22991610 / 21830275 / +5.3% 36985345 / 35544461 / +4.1% 0.62 / 0.61 / +1.2%
tpcds_q83/datafusion:parquet 59419512 / 58296937 / +1.9% 76417114 / 74616736 / +2.4% 0.78 / 0.78 / -0.5%
tpcds_q84/datafusion:parquet 27186012 / 26330226 / +3.3% 42173528 / 42384381 / -0.5% 0.64 / 0.62 / +3.8%
tpcds_q85/datafusion:parquet 81429918 / 81149270 / +0.3% 103387437 / 105837872 / -2.3% 0.79 / 0.77 / +2.7%
tpcds_q86/datafusion:parquet 20991376 / 21226134 / -1.1% 34176905 / 33972858 / +0.6% 0.61 / 0.62 / -1.7%
tpcds_q87/datafusion:parquet 44872526 / 43655820 / +2.8% 63613750 / 61819470 / +2.9% 0.71 / 0.71 / -0.1%
tpcds_q88/datafusion:parquet 37074230 / 37317510 / -0.7% 51472230 / 52037306 / -1.1% 0.72 / 0.72 / +0.4%
tpcds_q89/datafusion:parquet 26215891 / 25620515 / +2.3% 42731123 / 43168659 / -1.0% 0.61 / 0.59 / +3.4%
tpcds_q90/datafusion:parquet 15185443 / 14700265 / +3.3% 27208738 / 26744264 / +1.7% 0.56 / 0.55 / +1.5%
tpcds_q91/datafusion:parquet 33066870 / 32536375 / +1.6% 49595569 / 46834523 / +5.9% 0.67 / 0.69 / -4.0%
tpcds_q92/datafusion:parquet 27451728 / 26925968 / +2.0% 42779633 / 41562779 / +2.9% 0.64 / 0.65 / -0.9%
tpcds_q93/datafusion:parquet 28172868 / 27737618 / +1.6% 47128538 / 47560036 / -0.9% 0.60 / 0.58 / +2.5%
tpcds_q94/datafusion:parquet 35964292 / 34987990 / +2.8% 49522536 / 49838089 / -0.6% 0.73 / 0.70 / +3.4%
tpcds_q95/datafusion:parquet 64857694 / 63986628 / +1.4% 78070165 / 82628090 / -5.5% 0.83 / 0.77 / +7.3%
tpcds_q96/datafusion:parquet 12626012 / 12515555 / +0.9% 25104751 / 24364474 / +3.0% 0.50 / 0.51 / -2.1%
tpcds_q97/datafusion:parquet 35934578 / 35645164 / +0.8% 53278610 / 49168462 / +8.4% 0.67 / 0.72 / -7.0%
tpcds_q98/datafusion:parquet 24944819 / 24769713 / +0.7% 40779227 / 39883907 / +2.2% 0.61 / 0.62 / -1.5%
tpcds_q99/datafusion:parquet 30004056 / 29456394 / +1.9% 43181634 / 42511842 / +1.6% 0.69 / 0.69 / +0.3%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16213607 / 16444475 / -1.4% 24762390 / 25468340 / -2.8% 0.65 / 0.65 / +1.4%
tpcds_q02/duckdb:vortex-file-compressed 17703578 / 16460483 / +7.6% 22869371 / 23822245 / -4.0% 0.77 / 0.69 / +12.0%
tpcds_q03/duckdb:vortex-file-compressed 6889387 / 7076496 / -2.6% 15612747 / 16811089 / -7.1% 0.44 / 0.42 / +4.8%
tpcds_q04/duckdb:vortex-file-compressed 45504846 / 45671773 / -0.4% 57784630 / 56795457 / +1.7% 0.79 / 0.80 / -2.1%
tpcds_q05/duckdb:vortex-file-compressed 23109356 / 23444196 / -1.4% 33645906 / 33922893 / -0.8% 0.69 / 0.69 / -0.6%
tpcds_q06/duckdb:vortex-file-compressed 24442580 / 24544822 / -0.4% 37934645 / 39101350 / -3.0% 0.64 / 0.63 / +2.6%
tpcds_q07/duckdb:vortex-file-compressed 13658510 / 13574572 / +0.6% 23857067 / 23853354 / +0.0% 0.57 / 0.57 / +0.6%
tpcds_q08/duckdb:vortex-file-compressed 17641430 / 17694292 / -0.3% 26351395 / 27427836 / -3.9% 0.67 / 0.65 / +3.8%
tpcds_q09/duckdb:vortex-file-compressed 19335637 / 19230780 / +0.5% 29385004 / 29232867 / +0.5% 0.66 / 0.66 / +0.0%
tpcds_q10/duckdb:vortex-file-compressed 27644272 / 28127254 / -1.7% 41015665 / 41633782 / -1.5% 0.67 / 0.68 / -0.2%
tpcds_q11/duckdb:vortex-file-compressed 37380155 / 36907482 / +1.3% 45764536 / 45373610 / +0.9% 0.82 / 0.81 / +0.4%
tpcds_q12/duckdb:vortex-file-compressed 10272952 / 10175710 / +1.0% 16615154 / 17230057 / -3.6% 0.62 / 0.59 / +4.7%
tpcds_q13/duckdb:vortex-file-compressed 20841912 / 21038962 / -0.9% 31256475 / 34714581 / -10.0% 0.67 / 0.61 / +10.0%
tpcds_q14/duckdb:vortex-file-compressed 57907222 / 57724936 / +0.3% 68184788 / 68632960 / -0.7% 0.85 / 0.84 / +1.0%
tpcds_q15/duckdb:vortex-file-compressed 11480234 / 11248794 / +2.1% 17971434 / 18537256 / -3.1% 0.64 / 0.61 / +5.3%
tpcds_q16/duckdb:vortex-file-compressed 24542978 / 24567762 / -0.1% 35206241 / 35296980 / -0.3% 0.70 / 0.70 / +0.2%
tpcds_q17/duckdb:vortex-file-compressed 24763014 / 24773062 / -0.0% 36542890 / 36689010 / -0.4% 0.68 / 0.68 / +0.4%
tpcds_q18/duckdb:vortex-file-compressed 32038482 / 31704231 / +1.1% 42895364 / 41795055 / +2.6% 0.75 / 0.76 / -1.5%
tpcds_q19/duckdb:vortex-file-compressed 79533468 / 78453346 / +1.4% 89867110 / 88861136 / +1.1% 0.89 / 0.88 / +0.2%
tpcds_q20/duckdb:vortex-file-compressed 11144712 / 11302434 / -1.4% 17016264 / 17921560 / -5.1% 0.65 / 0.63 / +3.9%
tpcds_q21/duckdb:vortex-file-compressed 10085792 / 9613981 / +4.9% 21978250 / 21618546 / +1.7% 0.46 / 0.44 / +3.2%
tpcds_q22/duckdb:vortex-file-compressed 17805744 / 17475264 / +1.9% 28057788 / 29801515 / -5.9% 0.63 / 0.59 / +8.2%
tpcds_q23/duckdb:vortex-file-compressed 38632194 / 38469427 / +0.4% 49598840 / 50493626 / -1.8% 0.78 / 0.76 / +2.2%
tpcds_q24/duckdb:vortex-file-compressed 27092772 / 27034658 / +0.2% 36508762 / 38258066 / -4.6% 0.74 / 0.71 / +5.0%
tpcds_q25/duckdb:vortex-file-compressed 23663449 / 23233486 / +1.9% 33254756 / 35619880 / -6.6% 0.71 / 0.65 / +9.1%
tpcds_q26/duckdb:vortex-file-compressed 13044628 / 13489824 / -3.3% 20896600 / 21359876 / -2.2% 0.62 / 0.63 / -1.2%
tpcds_q27/duckdb:vortex-file-compressed 16052886 / 16130987 / -0.5% 27000718 / 27091120 / -0.3% 0.59 / 0.60 / -0.2%
tpcds_q28/duckdb:vortex-file-compressed 15173348 / 15571143 / -2.6% 24918051 / 26383560 / -5.6% 0.61 / 0.59 / +3.2%
tpcds_q29/duckdb:vortex-file-compressed 23179631 / 23097506 / +0.4% 34060687 / 35788503 / -4.8% 0.68 / 0.65 / +5.4%
tpcds_q30/duckdb:vortex-file-compressed 16369920 / 16286234 / +0.5% 25601308 / 24987373 / +2.5% 0.64 / 0.65 / -1.9%
tpcds_q31/duckdb:vortex-file-compressed 18532052 / 18038853 / +2.7% 26087836 / 26835741 / -2.8% 0.71 / 0.67 / +5.7%
tpcds_q32/duckdb:vortex-file-compressed 11983946 / 12118126 / -1.1% 21301654 / 21035329 / +1.3% 0.56 / 0.58 / -2.3%
tpcds_q33/duckdb:vortex-file-compressed 19073404 / 19145275 / -0.4% 26725832 / 28982771 / -7.8% 0.71 / 0.66 / +8.0%
tpcds_q34/duckdb:vortex-file-compressed 13080981 / 13291362 / -1.6% 22439674 / 23346380 / -3.9% 0.58 / 0.57 / +2.4%
tpcds_q35/duckdb:vortex-file-compressed 28559056 / 29057151 / -1.7% 40507350 / 41060035 / -1.3% 0.71 / 0.71 / -0.4%
tpcds_q36/duckdb:vortex-file-compressed 14676672 / 14673114 / +0.0% 24886005 / 25300723 / -1.6% 0.59 / 0.58 / +1.7%
tpcds_q37/duckdb:vortex-file-compressed 9760896 / 9811254 / -0.5% 23680383 / 24475303 / -3.2% 0.41 / 0.40 / +2.8%
tpcds_q38/duckdb:vortex-file-compressed 24711426 / 24605265 / +0.4% 31634973 / 32323829 / -2.1% 0.78 / 0.76 / +2.6%
tpcds_q39/duckdb:vortex-file-compressed 18875246 / 18754580 / +0.6% 30042613 / 31312343 / -4.1% 0.63 / 0.60 / +4.9%
tpcds_q40/duckdb:vortex-file-compressed 14301310 / 14358350 / -0.4% 20819175 / 21137017 / -1.5% 0.69 / 0.68 / +1.1%
tpcds_q41/duckdb:vortex-file-compressed 18870602 / 19083947 / -1.1% 25979441 / 26661569 / -2.6% 0.73 / 0.72 / +1.5%
tpcds_q42/duckdb:vortex-file-compressed 7257032 / 7055646 / +2.9% 16098061 / 15785619 / +2.0% 0.45 / 0.45 / +0.9%
tpcds_q43/duckdb:vortex-file-compressed 10086780 / 10468877 / -3.6% 19219290 / 20047716 / -4.1% 0.52 / 0.52 / +0.5%
tpcds_q44/duckdb:vortex-file-compressed 12681234 / 12765054 / -0.7% 23576735 / 24035788 / -1.9% 0.54 / 0.53 / +1.3%
tpcds_q45/duckdb:vortex-file-compressed 23915418 / 24095519 / -0.7% 30997453 / 31439773 / -1.4% 0.77 / 0.77 / +0.7%
tpcds_q46/duckdb:vortex-file-compressed 19861338 / 19944214 / -0.4% 28004566 / 28498573 / -1.7% 0.71 / 0.70 / +1.3%
tpcds_q47/duckdb:vortex-file-compressed 35256420 / 34362920 / +2.6% 43734850 / 45200024 / -3.2% 0.81 / 0.76 / +6.0%
tpcds_q48/duckdb:vortex-file-compressed 23360944 / 23537748 / -0.8% 34925926 / 35171768 / -0.7% 0.67 / 0.67 / -0.1%
tpcds_q49/duckdb:vortex-file-compressed 20145842 / 20061539 / +0.4% 30143821 / 31020788 / -2.8% 0.67 / 0.65 / +3.3%
tpcds_q50/duckdb:vortex-file-compressed 17594333 / 17224026 / +2.1% 28395291 / 28249732 / +0.5% 0.62 / 0.61 / +1.6%
tpcds_q51/duckdb:vortex-file-compressed 49843610 / 49558842 / +0.6% 59564561 / 59142497 / +0.7% 0.84 / 0.84 / -0.1%
tpcds_q52/duckdb:vortex-file-compressed 7136752 / 7471124 / -4.5% 15942754 / 16155821 / -1.3% 0.45 / 0.46 / -3.2%
tpcds_q53/duckdb:vortex-file-compressed 11583969 / 11708613 / -1.1% 20414482 / 20430202 / -0.1% 0.57 / 0.57 / -1.0%
tpcds_q54/duckdb:vortex-file-compressed 20308901 / 20517178 / -1.0% 29934253 / 30341791 / -1.3% 0.68 / 0.68 / +0.3%
tpcds_q55/duckdb:vortex-file-compressed 6886974 / 7086945 / -2.8% 15672963 / 16614933 / -5.7% 0.44 / 0.43 / +3.0%
tpcds_q56/duckdb:vortex-file-compressed 18106861 / 18390555 / -1.5% 28204563 / 28690113 / -1.7% 0.64 / 0.64 / +0.2%
tpcds_q57/duckdb:vortex-file-compressed 26192403 / 26501728 / -1.2% 33819678 / 35075063 / -3.6% 0.77 / 0.76 / +2.5%
tpcds_q58/duckdb:vortex-file-compressed 20613087 / 20471580 / +0.7% 29256268 / 30978872 / -5.6% 0.70 / 0.66 / +6.6%
tpcds_q59/duckdb:vortex-file-compressed 19920402 / 20144962 / -1.1% 27637360 / 28840927 / -4.2% 0.72 / 0.70 / +3.2%
tpcds_q60/duckdb:vortex-file-compressed 19157882 / 18663288 / +2.7% 28815103 / 29105972 / -1.0% 0.66 / 0.64 / +3.7%
tpcds_q61/duckdb:vortex-file-compressed 25165106 / 25454070 / -1.1% 33502350 / 35467454 / -5.5% 0.75 / 0.72 / +4.7%
tpcds_q62/duckdb:vortex-file-compressed 11975957 / 12066966 / -0.8% 19114292 / 19142635 / -0.1% 0.63 / 0.63 / -0.6%
tpcds_q63/duckdb:vortex-file-compressed 11083118 / 11315712 / -2.1% 19452430 / 20240474 / -3.9% 0.57 / 0.56 / +1.9%
tpcds_q64/duckdb:vortex-file-compressed 49370294 / 50298476 / -1.8% 65980841 / 68843128 / -4.2% 0.75 / 0.73 / +2.4%
tpcds_q65/duckdb:vortex-file-compressed 13200674 / 13261522 / -0.5% 22544922 / 23640025 / -4.6% 0.59 / 0.56 / +4.4%
tpcds_q66/duckdb:vortex-file-compressed 31690619 / 29356364 / +8.0% 39202726 / 38953267 / +0.6% 0.81 / 0.75 / +7.3%
tpcds_q67/duckdb:vortex-file-compressed 59193048 / 58699637 / +0.8% 67111256 / 67480625 / -0.5% 0.88 / 0.87 / +1.4%
tpcds_q68/duckdb:vortex-file-compressed 19926864 / 19803436 / +0.6% 27404723 / 28546143 / -4.0% 0.73 / 0.69 / +4.8%
tpcds_q69/duckdb:vortex-file-compressed 22979652 / 23406440 / -1.8% 37793749 / 38019199 / -0.6% 0.61 / 0.62 / -1.2%
tpcds_q70/duckdb:vortex-file-compressed 15963888 / 16057534 / -0.6% 28190277 / 28434674 / -0.9% 0.57 / 0.56 / +0.3%
tpcds_q71/duckdb:vortex-file-compressed 13201507 / 13083326 / +0.9% 23452063 / 24266057 / -3.4% 0.56 / 0.54 / +4.4%
tpcds_q72/duckdb:vortex-file-compressed 53297814 / 53306598 / -0.0% 65564123 / 66841585 / -1.9% 0.81 / 0.80 / +1.9%
tpcds_q73/duckdb:vortex-file-compressed 12188536 / 12089608 / +0.8% 20906099 / 21036740 / -0.6% 0.58 / 0.57 / +1.4%
tpcds_q74/duckdb:vortex-file-compressed 26360606 / 26070268 / +1.1% 33810374 / 34365954 / -1.6% 0.78 / 0.76 / +2.8%
tpcds_q75/duckdb:vortex-file-compressed 28068460 / 28699944 / -2.2% 39296085 / 39734586 / -1.1% 0.71 / 0.72 / -1.1%
tpcds_q76/duckdb:vortex-file-compressed 13509664 / 13454318 / +0.4% 24729400 / 25508048 / -3.1% 0.55 / 0.53 / +3.6%
tpcds_q77/duckdb:vortex-file-compressed 20978835 / 21028818 / -0.2% 32655029 / 32628785 / +0.1% 0.64 / 0.64 / -0.3%
tpcds_q78/duckdb:vortex-file-compressed 43704219 / 43216690 / +1.1% 54960724 / 54126335 / +1.5% 0.80 / 0.80 / -0.4%
tpcds_q79/duckdb:vortex-file-compressed 13634304 / 13435902 / +1.5% 22685365 / 23432828 / -3.2% 0.60 / 0.57 / +4.8%
tpcds_q80/duckdb:vortex-file-compressed 37045770 / 37202952 / -0.4% 49897769 / 51588198 / -3.3% 0.74 / 0.72 / +3.0%
tpcds_q81/duckdb:vortex-file-compressed 21685500 / 21286061 / +1.9% 30232482 / 30091464 / +0.5% 0.72 / 0.71 / +1.4%
tpcds_q82/duckdb:vortex-file-compressed 9675634 / 9434022 / +2.6% 24806226 / 25789878 / -3.8% 0.39 / 0.37 / +6.6%
tpcds_q83/duckdb:vortex-file-compressed 18077020 / 18050168 / +0.1% 24544879 / 24595920 / -0.2% 0.74 / 0.73 / +0.4%
tpcds_q84/duckdb:vortex-file-compressed 15305309 / 15788435 / -3.1% 22448928 / 23186803 / -3.2% 0.68 / 0.68 / +0.1%
tpcds_q85/duckdb:vortex-file-compressed 24150681 / 24704460 / -2.2% 35978834 / 36707520 / -2.0% 0.67 / 0.67 / -0.3%
tpcds_q86/duckdb:vortex-file-compressed 10019732 / 9966084 / +0.5% 17007186 / 16937119 / +0.4% 0.59 / 0.59 / +0.1%
tpcds_q87/duckdb:vortex-file-compressed 26249268 / 26271254 / -0.1% 33353802 / 33892892 / -1.6% 0.79 / 0.78 / +1.5%
tpcds_q88/duckdb:vortex-file-compressed 31293086 / 31419104 / -0.4% 39979960 / 39845592 / +0.3% 0.78 / 0.79 / -0.7%
tpcds_q89/duckdb:vortex-file-compressed 12208292 / 12523714 / -2.5% 21325948 / 22366688 / -4.7% 0.57 / 0.56 / +2.2%
tpcds_q90/duckdb:vortex-file-compressed 8308036 / 8234150 / +0.9% 15923981 / 16219806 / -1.8% 0.52 / 0.51 / +2.8%
tpcds_q91/duckdb:vortex-file-compressed 14747338 / 14875414 / -0.9% 23449436 / 23432472 / +0.1% 0.63 / 0.63 / -0.9%
tpcds_q92/duckdb:vortex-file-compressed 12270078 / 12185658 / +0.7% 20892727 / 21289808 / -1.9% 0.59 / 0.57 / +2.6%
tpcds_q93/duckdb:vortex-file-compressed 10198649 / 10200146 / -0.0% 22861575 / 24307062 / -5.9% 0.45 / 0.42 / +6.3%
tpcds_q94/duckdb:vortex-file-compressed 22202432 / 22700503 / -2.2% 32380669 / 32522349 / -0.4% 0.69 / 0.70 / -1.8%
tpcds_q95/duckdb:vortex-file-compressed 62007994 / 63017334 / -1.6% 70782122 / 71429073 / -0.9% 0.88 / 0.88 / -0.7%
tpcds_q96/duckdb:vortex-file-compressed 6973332 / 7044906 / -1.0% 15460070 / 16074625 / -3.8% 0.45 / 0.44 / +2.9%
tpcds_q97/duckdb:vortex-file-compressed 23601146 / 23644552 / -0.2% 30889064 / 32299442 / -4.4% 0.76 / 0.73 / +4.4%
tpcds_q98/duckdb:vortex-file-compressed 11368038 / 11336208 / +0.3% 19104767 / 21107734 / -9.5% 0.60 / 0.54 / +10.8%
tpcds_q99/duckdb:vortex-file-compressed 14930462 / 15282436 / -2.3% 23367871 / 24087996 / -3.0% 0.64 / 0.63 / +0.7%
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24502089 / 24461415 / +0.2% 30723392 / 31889119 / -3.7% 0.80 / 0.77 / +4.0%
tpcds_q02/duckdb:parquet 18573404 / 18477803 / +0.5% 24932325 / 24904542 / +0.1% 0.74 / 0.74 / +0.4%
tpcds_q03/duckdb:parquet 9980996 / 9885219 / +1.0% 15896544 / 15716141 / +1.1% 0.63 / 0.63 / -0.2%
tpcds_q04/duckdb:parquet 119155032 / 118340878 / +0.7% 126505253 / 127118353 / -0.5% 0.94 / 0.93 / +1.2%
tpcds_q05/duckdb:parquet 29309923 / 28904132 / +1.4% 34168673 / 34074757 / +0.3% 0.86 / 0.85 / +1.1%
tpcds_q06/duckdb:parquet 26847026 / 26612744 / +0.9% 36207081 / 36038010 / +0.5% 0.74 / 0.74 / +0.4%
tpcds_q07/duckdb:parquet 32473608 / 30889214 / +5.1% 38919746 / 39478001 / -1.4% 0.83 / 0.78 / +6.6%
tpcds_q08/duckdb:parquet 20236733 / 20187230 / +0.2% 26443516 / 26525878 / -0.3% 0.77 / 0.76 / +0.6%
tpcds_q09/duckdb:parquet 27669194 / 27513464 / +0.6% 30158180 / 31524831 / -4.3% 0.92 / 0.87 / +5.1%
tpcds_q10/duckdb:parquet 33593742 / 33222414 / +1.1% 41505233 / 40837713 / +1.6% 0.81 / 0.81 / -0.5%
tpcds_q11/duckdb:parquet 68859068 / 68731161 / +0.2% 76487853 / 76879564 / -0.5% 0.90 / 0.89 / +0.7%
tpcds_q12/duckdb:parquet 14277832 / 14144158 / +0.9% 18981611 / 19819277 / -4.2% 0.75 / 0.71 / +5.4%
tpcds_q13/duckdb:parquet 33411681 / 31292196 / +6.8% 39736191 / 40289029 / -1.4% 0.84 / 0.78 / +8.3%
tpcds_q14/duckdb:parquet 66031816 / 64338646 / +2.6% 71067418 / 71335260 / -0.4% 0.93 / 0.90 / +3.0%
tpcds_q15/duckdb:parquet 17030364 / 17339696 / -1.8% 22664357 / 23248232 / -2.5% 0.75 / 0.75 / +0.7%
tpcds_q16/duckdb:parquet 30730340 / 30578287 / +0.5% 37722728 / 37670788 / +0.1% 0.81 / 0.81 / +0.4%
tpcds_q17/duckdb:parquet 35363870 / 35393214 / -0.1% 40763093 / 41074208 / -0.8% 0.87 / 0.86 / +0.7%
tpcds_q18/duckdb:parquet 48368434 / 47513666 / +1.8% 55715656 / 55915480 / -0.4% 0.87 / 0.85 / +2.2%
tpcds_q19/duckdb:parquet 19032184 / 18908272 / +0.7% 25632398 / 25869161 / -0.9% 0.74 / 0.73 / +1.6%
tpcds_q20/duckdb:parquet 15216325 / 15117726 / +0.7% 19635286 / 20319039 / -3.4% 0.77 / 0.74 / +4.2%
tpcds_q21/duckdb:parquet 10874336 / 10958786 / -0.8% 17040769 / 16915770 / +0.7% 0.64 / 0.65 / -1.5%
tpcds_q22/duckdb:parquet 20938184 / 21167452 / -1.1% 26994992 / 27090109 / -0.4% 0.78 / 0.78 / -0.7%
tpcds_q23/duckdb:parquet 44535824 / 42076472 / +5.8% 47890359 / 50375183 / -4.9% 0.93 / 0.84 / +11.3%
tpcds_q24/duckdb:parquet 30814111 / 30720912 / +0.3% 37214575 / 36885762 / +0.9% 0.83 / 0.83 / -0.6%
tpcds_q25/duckdb:parquet 31362092 / 30979612 / +1.2% 37308329 / 38374618 / -2.8% 0.84 / 0.81 / +4.1%
tpcds_q26/duckdb:parquet 29564756 / 29260556 / +1.0% 35628760 / 35609138 / +0.1% 0.83 / 0.82 / +1.0%
tpcds_q27/duckdb:parquet 33477286 / 33134471 / +1.0% 42432076 / 43669624 / -2.8% 0.79 / 0.76 / +4.0%
tpcds_q28/duckdb:parquet 26151206 / 26638018 / -1.8% 32744209 / 32338357 / +1.3% 0.80 / 0.82 / -3.0%
tpcds_q29/duckdb:parquet 33621342 / 32629098 / +3.0% 39521948 / 40449665 / -2.3% 0.85 / 0.81 / +5.5%
tpcds_q30/duckdb:parquet 36312157 / 36216204 / +0.3% 45321062 / 44941640 / +0.8% 0.80 / 0.81 / -0.6%
tpcds_q31/duckdb:parquet 35825470 / 36054844 / -0.6% 43309408 / 43183235 / +0.3% 0.83 / 0.83 / -0.9%
tpcds_q32/duckdb:parquet 14501140 / 14508078 / -0.0% 21399861 / 21278004 / +0.6% 0.68 / 0.68 / -0.6%
tpcds_q33/duckdb:parquet 24854516 / 23632444 / +5.2% 28785385 / 29707542 / -3.1% 0.86 / 0.80 / +8.5%
tpcds_q34/duckdb:parquet 17477386 / 17264167 / +1.2% 24300697 / 24340721 / -0.2% 0.72 / 0.71 / +1.4%
tpcds_q35/duckdb:parquet 35702884 / 35442622 / +0.7% 43835444 / 44681249 / -1.9% 0.81 / 0.79 / +2.7%
tpcds_q36/duckdb:parquet 40585509 / 40503322 / +0.2% 48108383 / 48119798 / -0.0% 0.84 / 0.84 / +0.2%
tpcds_q37/duckdb:parquet 13143816 / 13397750 / -1.9% 19413044 / 20708401 / -6.3% 0.68 / 0.65 / +4.7%
tpcds_q38/duckdb:parquet 30056465 / 29717562 / +1.1% 33554887 / 34213448 / -1.9% 0.90 / 0.87 / +3.1%
tpcds_q39/duckdb:parquet 23868384 / 23829380 / +0.2% 29834072 / 30449128 / -2.0% 0.80 / 0.78 / +2.2%
tpcds_q40/duckdb:parquet 16373196 / 16238836 / +0.8% 21083048 / 22101711 / -4.6% 0.78 / 0.73 / +5.7%
tpcds_q41/duckdb:parquet 12505740 / 12288706 / +1.8% 18813507 / 18367545 / +2.4% 0.66 / 0.67 / -0.6%
tpcds_q42/duckdb:parquet 9677404 / 9703324 / -0.3% 15460015 / 16110618 / -4.0% 0.63 / 0.60 / +3.9%
tpcds_q43/duckdb:parquet 12531364 / 12636840 / -0.8% 18509036 / 19017623 / -2.7% 0.68 / 0.66 / +1.9%
tpcds_q44/duckdb:parquet 21511341 / 20847950 / +3.2% 27816499 / 27075740 / +2.7% 0.77 / 0.77 / +0.4%
tpcds_q45/duckdb:parquet 21482157 / 21206582 / +1.3% 28012125 / 28532503 / -1.8% 0.77 / 0.74 / +3.2%
tpcds_q46/duckdb:parquet 37260700 / 36380140 / +2.4% 43593855 / 44539173 / -2.1% 0.85 / 0.82 / +4.6%
tpcds_q47/duckdb:parquet 34739256 / 34586680 / +0.4% 42086845 / 42107682 / -0.0% 0.83 / 0.82 / +0.5%
tpcds_q48/duckdb:parquet 29411552 / 30210846 / -2.6% 37234062 / 39878588 / -6.6% 0.79 / 0.76 / +4.3%
tpcds_q49/duckdb:parquet 30269392 / 30182184 / +0.3% 35758005 / 38576647 / -7.3% 0.85 / 0.78 / +8.2%
tpcds_q50/duckdb:parquet 20168708 / 19863609 / +1.5% 25850059 / 25976470 / -0.5% 0.78 / 0.76 / +2.0%
tpcds_q51/duckdb:parquet 53460802 / 52434272 / +2.0% 62530903 / 60969027 / +2.6% 0.85 / 0.86 / -0.6%
tpcds_q52/duckdb:parquet 9824333 / 9779850 / +0.5% 15687416 / 15736745 / -0.3% 0.63 / 0.62 / +0.8%
tpcds_q53/duckdb:parquet 13967504 / 13933530 / +0.2% 20775054 / 21080535 / -1.4% 0.67 / 0.66 / +1.7%
tpcds_q54/duckdb:parquet 25335498 / 25205726 / +0.5% 32315777 / 32379265 / -0.2% 0.78 / 0.78 / +0.7%
tpcds_q55/duckdb:parquet 9621722 / 9660020 / -0.4% 15324269 / 15334710 / -0.1% 0.63 / 0.63 / -0.3%
tpcds_q56/duckdb:parquet 25015898 / 26182610 / -4.5% 30323882 / 30957666 / -2.0% 0.82 / 0.85 / -2.5%
tpcds_q57/duckdb:parquet 31160838 / 30862125 / +1.0% 36106243 / 36547991 / -1.2% 0.86 / 0.84 / +2.2%
tpcds_q58/duckdb:parquet 24095148 / 24194040 / -0.4% 30277172 / 30112757 / +0.5% 0.80 / 0.80 / -0.9%
tpcds_q59/duckdb:parquet 23542542 / 23510052 / +0.1% 29692890 / 29836645 / -0.5% 0.79 / 0.79 / +0.6%
tpcds_q60/duckdb:parquet 27029761 / 26534511 / +1.9% 32640058 / 32916450 / -0.8% 0.83 / 0.81 / +2.7%
tpcds_q61/duckdb:parquet 25263526 / 24342124 / +3.8% 29678955 / 29132643 / +1.9% 0.85 / 0.84 / +1.9%
tpcds_q62/duckdb:parquet 13300511 / 13237418 / +0.5% 18140790 / 18208809 / -0.4% 0.73 / 0.73 / +0.9%
tpcds_q63/duckdb:parquet 13452160 / 13446420 / +0.0% 19856257 / 20085179 / -1.1% 0.68 / 0.67 / +1.2%
tpcds_q64/duckdb:parquet 71659166 / 71414432 / +0.3% 82149649 / 83765544 / -1.9% 0.87 / 0.85 / +2.3%
tpcds_q65/duckdb:parquet 19792050 / 19600975 / +1.0% 28067060 / 25574005 / +9.7% 0.71 / 0.77 / -8.0%
tpcds_q66/duckdb:parquet 35729370 / 35508789 / +0.6% 41780074 / 42329909 / -1.3% 0.86 / 0.84 / +1.9%
tpcds_q67/duckdb:parquet 61729392 / 64194316 / -3.8% 68476892 / 68576216 / -0.1% 0.90 / 0.94 / -3.7%
tpcds_q68/duckdb:parquet 31137434 / 28915509 / +7.7% 37420853 / 37384155 / +0.1% 0.83 / 0.77 / +7.6%
tpcds_q69/duckdb:parquet 26441640 / 26301866 / +0.5% 34617193 / 34493925 / +0.4% 0.76 / 0.76 / +0.2%
tpcds_q70/duckdb:parquet 20151731 / 19675632 / +2.4% 28251075 / 27386182 / +3.2% 0.71 / 0.72 / -0.7%
tpcds_q71/duckdb:parquet 17239293 / 17448006 / -1.2% 23554531 / 23990855 / -1.8% 0.73 / 0.73 / +0.6%
tpcds_q72/duckdb:parquet 54957694 / 54660460 / +0.5% 62081032 / 62275059 / -0.3% 0.89 / 0.88 / +0.9%
tpcds_q73/duckdb:parquet 15514450 / 15029432 / +3.2% 22204539 / 22152164 / +0.2% 0.70 / 0.68 / +3.0%
tpcds_q74/duckdb:parquet 85617483 / 84385634 / +1.5% 93093496 / 92185818 / +1.0% 0.92 / 0.92 / +0.5%
tpcds_q75/duckdb:parquet 44003396 / 45624206 / -3.6% 51503269 / 51356188 / +0.3% 0.85 / 0.89 / -3.8%
tpcds_q76/duckdb:parquet 20162522 / 18870968 / +6.8% 25716720 / 24356332 / +5.6% 0.78 / 0.77 / +1.2%
tpcds_q77/duckdb:parquet 24652710 / 24975692 / -1.3% 33894345 / 32645863 / +3.8% 0.73 / 0.77 / -4.9%
tpcds_q78/duckdb:parquet 79752968 / 78898743 / +1.1% 87147072 / 87809925 / -0.8% 0.92 / 0.90 / +1.9%
tpcds_q79/duckdb:parquet 21994662 / 22444963 / -2.0% 29329915 / 29362751 / -0.1% 0.75 / 0.76 / -1.9%
tpcds_q80/duckdb:parquet 36430382 / 36329628 / +0.3% 44777319 / 45211720 / -1.0% 0.81 / 0.80 / +1.3%
tpcds_q81/duckdb:parquet 37268158 / 36806600 / +1.3% 45440572 / 45327130 / +0.3% 0.82 / 0.81 / +1.0%
tpcds_q82/duckdb:parquet 13893142 / 13701072 / +1.4% 20551075 / 20843699 / -1.4% 0.68 / 0.66 / +2.8%
tpcds_q83/duckdb:parquet 20500659 / 20663900 / -0.8% 26080063 / 25360106 / +2.8% 0.79 / 0.81 / -3.5%
tpcds_q84/duckdb:parquet 23452966 / 23496624 / -0.2% 28993239 / 28978214 / +0.1% 0.81 / 0.81 / -0.2%
tpcds_q85/duckdb:parquet 33148868 / 32590619 / +1.7% 40477151 / 39990406 / +1.2% 0.82 / 0.81 / +0.5%
tpcds_q86/duckdb:parquet 12135864 / 12013802 / +1.0% 17142184 / 17020865 / +0.7% 0.71 / 0.71 / +0.3%
tpcds_q87/duckdb:parquet 31491217 / 31554158 / -0.2% 35013406 / 35597054 / -1.6% 0.90 / 0.89 / +1.5%
tpcds_q88/duckdb:parquet 39563897 / 39290797 / +0.7% 46535399 / 45373845 / +2.6% 0.85 / 0.87 / -1.8%
tpcds_q89/duckdb:parquet 14490950 / 14373810 / +0.8% 21617920 / 21425400 / +0.9% 0.67 / 0.67 / -0.1%
tpcds_q90/duckdb:parquet 10274572 / 10363688 / -0.9% 19066498 / 15705175 / +21.4% 🔴 0.54 / 0.66 / -18.3%
tpcds_q91/duckdb:parquet 21422669 / 21451967 / -0.1% 28625272 / 28956635 / -1.1% 0.75 / 0.74 / +1.0%
tpcds_q92/duckdb:parquet 16046237 / 15754876 / +1.8% 22598488 / 23375593 / -3.3% 0.71 / 0.67 / +5.4%
tpcds_q93/duckdb:parquet 14316970 / 14160048 / +1.1% 20208873 / 20900109 / -3.3% 0.71 / 0.68 / +4.6%
tpcds_q94/duckdb:parquet 25883333 / 25906744 / -0.1% 33348433 / 33051190 / +0.9% 0.78 / 0.78 / -1.0%
tpcds_q95/duckdb:parquet 43921950 / 44138026 / -0.5% 49693675 / 49404315 / +0.6% 0.88 / 0.89 / -1.1%
tpcds_q96/duckdb:parquet 8381844 / 8380358 / +0.0% 13906138 / 14018596 / -0.8% 0.60 / 0.60 / +0.8%
tpcds_q97/duckdb:parquet 27661930 / 27546754 / +0.4% 34501839 / 34328255 / +0.5% 0.80 / 0.80 / -0.1%
tpcds_q98/duckdb:parquet 16806398 / 16864316 / -0.3% 23693229 / 23676181 / +0.1% 0.71 / 0.71 / -0.4%
tpcds_q99/duckdb:parquet 19262962 / 19262517 / +0.0% 25477018 / 25183158 / +1.2% 0.76 / 0.76 / -1.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 475b320a vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Engines: DataFusion No clear signal (-1.2%, low confidence) · DuckDB No clear signal (-3.2%, low confidence)
Vortex (geomean): hot 0.980x ➖ · cold 0.980x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.001x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.983x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1236127 / 1222020 / +1.2% 23374059 / 25360366 / -7.8% 0.05 / 0.05 / +9.8%
clickbench_q01/datafusion:vortex-file-compressed 6023496 / 6291710 / -4.3% 31441309 / 31998400 / -1.7% 0.19 / 0.20 / -2.6%
clickbench_q02/datafusion:vortex-file-compressed 11146764 / 10743920 / +3.7% 40581603 / 48726078 / -16.7% 🟢 0.27 / 0.22 / +24.6%
clickbench_q03/datafusion:vortex-file-compressed 12527297 / 13578266 / -7.7% 56902588 / 60406156 / -5.8% 0.22 / 0.22 / -2.1%
clickbench_q04/datafusion:vortex-file-compressed 57408520 / 58875622 / -2.5% 99880141 / 104057010 / -4.0% 0.57 / 0.57 / +1.6%
clickbench_q05/datafusion:vortex-file-compressed 75709966 / 78364650 / -3.4% 127629706 / 125165765 / +2.0% 0.59 / 0.63 / -5.3%
clickbench_q06/datafusion:vortex-file-compressed 1252704 / 1245802 / +0.6% 23942416 / 24916123 / -3.9% 0.05 / 0.05 / +4.6%
clickbench_q07/datafusion:vortex-file-compressed 9169980 / 9440024 / -2.9% 35090170 / 36665765 / -4.3% 0.26 / 0.26 / +1.5%
clickbench_q08/datafusion:vortex-file-compressed 77850514 / 79572816 / -2.2% 124967273 / 128596494 / -2.8% 0.62 / 0.62 / +0.7%
clickbench_q09/datafusion:vortex-file-compressed 168678448 / 176945813 / -4.7% 219846057 / 220521609 / -0.3% 0.77 / 0.80 / -4.4%
clickbench_q10/datafusion:vortex-file-compressed 22225884 / 23324689 / -4.7% 70616422 / 75508962 / -6.5% 0.31 / 0.31 / +1.9%
clickbench_q11/datafusion:vortex-file-compressed 24549700 / 26075788 / -5.9% 66676453 / 77361491 / -13.8% 🟢 0.37 / 0.34 / +9.2%
clickbench_q12/datafusion:vortex-file-compressed 73140180 / 72198817 / +1.3% 125300348 / 127734875 / -1.9% 0.58 / 0.57 / +3.3%
clickbench_q13/datafusion:vortex-file-compressed 117466118 / 117074480 / +0.3% 181280087 / 185295836 / -2.2% 0.65 / 0.63 / +2.6%
clickbench_q14/datafusion:vortex-file-compressed 75311238 / 76569906 / -1.6% 127264974 / 133017726 / -4.3% 0.59 / 0.58 / +2.8%
clickbench_q15/datafusion:vortex-file-compressed 62561902 / 63096343 / -0.8% 102465347 / 103450927 / -1.0% 0.61 / 0.61 / +0.1%
clickbench_q16/datafusion:vortex-file-compressed 152094608 / 153318888 / -0.8% 211518809 / 222694391 / -5.0% 0.72 / 0.69 / +4.4%
clickbench_q17/datafusion:vortex-file-compressed 152834447 / 153766540 / -0.6% 219292986 / 233396981 / -6.0% 0.70 / 0.66 / +5.8%
clickbench_q18/datafusion:vortex-file-compressed 296113068 / 295032098 / +0.4% 376722654 / 398720609 / -5.5% 0.79 / 0.74 / +6.2%
clickbench_q19/datafusion:vortex-file-compressed 7877202 / 8264734 / -4.7% 47550326 / 52445244 / -9.3% 0.17 / 0.16 / +5.1%
clickbench_q20/datafusion:vortex-file-compressed 68735069 / 69601585 / -1.2% 248070796 / 255050274 / -2.7% 0.28 / 0.27 / +1.5%
clickbench_q21/datafusion:vortex-file-compressed 77814915 / 79545494 / -2.2% 285118179 / 303920860 / -6.2% 0.27 / 0.26 / +4.3%
clickbench_q22/datafusion:vortex-file-compressed 92550304 / 92281360 / +0.3% 386737731 / 409072596 / -5.5% 0.24 / 0.23 / +6.1%
clickbench_q23/datafusion:vortex-file-compressed 190124162 / 186630780 / +1.9% 571134491 / 582812959 / -2.0% 0.33 / 0.32 / +4.0%
clickbench_q24/datafusion:vortex-file-compressed 15478643 / 15971598 / -3.1% 71962688 / 75248446 / -4.4% 0.22 / 0.21 / +1.3%
clickbench_q25/datafusion:vortex-file-compressed 19374554 / 19327944 / +0.2% 63036317 / 65544239 / -3.8% 0.31 / 0.29 / +4.2%
clickbench_q26/datafusion:vortex-file-compressed 15741995 / 16570822 / -5.0% 72754736 / 69223643 / +5.1% 0.22 / 0.24 / -9.6%
clickbench_q27/datafusion:vortex-file-compressed 101607546 / 104236139 / -2.5% 255275952 / 267629648 / -4.6% 0.40 / 0.39 / +2.2%
clickbench_q28/datafusion:vortex-file-compressed 557523884 / 554970976 / +0.5% 642910870 / 640981632 / +0.3% 0.87 / 0.87 / +0.2%
clickbench_q29/datafusion:vortex-file-compressed 24350443 / 24996223 / -2.6% 56703450 / 58416640 / -2.9% 0.43 / 0.43 / +0.4%
clickbench_q30/datafusion:vortex-file-compressed 57166709 / 58566897 / -2.4% 114384827 / 115415423 / -0.9% 0.50 / 0.51 / -1.5%
clickbench_q31/datafusion:vortex-file-compressed 65495666 / 66520857 / -1.5% 157223877 / 163467318 / -3.8% 0.42 / 0.41 / +2.4%
clickbench_q32/datafusion:vortex-file-compressed 288467654 / 288811144 / -0.1% 388428207 / 398601613 / -2.6% 0.74 / 0.72 / +2.5%
clickbench_q33/datafusion:vortex-file-compressed 324134378 / 323220982 / +0.3% 431270679 / 442745470 / -2.6% 0.75 / 0.73 / +3.0%
clickbench_q34/datafusion:vortex-file-compressed 321017966 / 323787036 / -0.9% 439108394 / 439727390 / -0.1% 0.73 / 0.74 / -0.7%
clickbench_q35/datafusion:vortex-file-compressed 57589359 / 56474642 / +2.0% 91228076 / 95239632 / -4.2% 0.63 / 0.59 / +6.5%
clickbench_q36/datafusion:vortex-file-compressed 37588484 / 37786497 / -0.5% 69859435 / 70220251 / -0.5% 0.54 / 0.54 / -0.0%
clickbench_q37/datafusion:vortex-file-compressed 21299348 / 21112899 / +0.9% 48501320 / 52236069 / -7.1% 0.44 / 0.40 / +8.7%
clickbench_q38/datafusion:vortex-file-compressed 12902015 / 13238210 / -2.5% 42342920 / 45728369 / -7.4% 0.30 / 0.29 / +5.3%
clickbench_q39/datafusion:vortex-file-compressed 78853167 / 79489746 / -0.8% 112545974 / 117000884 / -3.8% 0.70 / 0.68 / +3.1%
clickbench_q40/datafusion:vortex-file-compressed 10199027 / 10678944 / -4.5% 37849657 / 38994551 / -2.9% 0.27 / 0.27 / -1.6%
clickbench_q41/datafusion:vortex-file-compressed 9837079 / 10146938 / -3.1% 35776605 / 37697537 / -5.1% 0.27 / 0.27 / +2.2%
clickbench_q42/datafusion:vortex-file-compressed 9907670 / 10580150 / -6.4% 38825414 / 40151466 / -3.3% 0.26 / 0.26 / -3.2%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1269160 / 1252390 / +1.3% 51203327 / 49858886 / +2.7% 0.02 / 0.03 / -1.3%
clickbench_q01/datafusion:parquet 15961278 / 15787223 / +1.1% 67253954 / 67905785 / -1.0% 0.24 / 0.23 / +2.1%
clickbench_q02/datafusion:parquet 19060128 / 19202549 / -0.7% 82704784 / 80765269 / +2.4% 0.23 / 0.24 / -3.1%
clickbench_q03/datafusion:parquet 16865949 / 16825988 / +0.2% 84145064 / 79107161 / +6.4% 0.20 / 0.21 / -5.8%
clickbench_q04/datafusion:parquet 63904840 / 64070752 / -0.3% 125502214 / 123746561 / +1.4% 0.51 / 0.52 / -1.7%
clickbench_q05/datafusion:parquet 87927674 / 89193812 / -1.4% 153832592 / 155866707 / -1.3% 0.57 / 0.57 / -0.1%
clickbench_q06/datafusion:parquet 1252276 / 1271545 / -1.5% 49791184 / 50022393 / -0.5% 0.03 / 0.03 / -1.1%
clickbench_q07/datafusion:parquet 16635954 / 16725616 / -0.5% 68888876 / 67183619 / +2.5% 0.24 / 0.25 / -3.0%
clickbench_q08/datafusion:parquet 83624323 / 86360220 / -3.2% 162962088 / 161677570 / +0.8% 0.51 / 0.53 / -3.9%
clickbench_q09/datafusion:parquet 186940174 / 189811070 / -1.5% 266985411 / 272037328 / -1.9% 0.70 / 0.70 / +0.4%
clickbench_q10/datafusion:parquet 35938544 / 35867330 / +0.2% 100710495 / 99994609 / +0.7% 0.36 / 0.36 / -0.5%
clickbench_q11/datafusion:parquet 42965262 / 41799902 / +2.8% 108267989 / 107840232 / +0.4% 0.40 / 0.39 / +2.4%
clickbench_q12/datafusion:parquet 96132252 / 95834502 / +0.3% 162259294 / 164548538 / -1.4% 0.59 / 0.58 / +1.7%
clickbench_q13/datafusion:parquet 146213428 / 145974546 / +0.2% 230318680 / 229047253 / +0.6% 0.63 / 0.64 / -0.4%
clickbench_q14/datafusion:parquet 101747078 / 102005408 / -0.3% 174266007 / 171671822 / +1.5% 0.58 / 0.59 / -1.7%
clickbench_q15/datafusion:parquet 69716672 / 71461450 / -2.4% 136382454 / 130790451 / +4.3% 0.51 / 0.55 / -6.4%
clickbench_q16/datafusion:parquet 154761956 / 156397034 / -1.0% 230314703 / 233902360 / -1.5% 0.67 / 0.67 / +0.5%
clickbench_q17/datafusion:parquet 155707096 / 157819059 / -1.3% 235097381 / 236051334 / -0.4% 0.66 / 0.67 / -0.9%
clickbench_q18/datafusion:parquet 310787722 / 307951774 / +0.9% 421045051 / 413174846 / +1.9% 0.74 / 0.75 / -1.0%
clickbench_q19/datafusion:parquet 19022902 / 19050488 / -0.1% 79677029 / 77455643 / +2.9% 0.24 / 0.25 / -2.9%
clickbench_q20/datafusion:parquet 179647262 / 179151449 / +0.3% 283576534 / 286433806 / -1.0% 0.63 / 0.63 / +1.3%
clickbench_q21/datafusion:parquet 170175134 / 172313051 / -1.2% 299307677 / 303072635 / -1.2% 0.57 / 0.57 / +0.0%
clickbench_q22/datafusion:parquet 258647159 / 263455818 / -1.8% 420197323 / 429668613 / -2.2% 0.62 / 0.61 / +0.4%
clickbench_q23/datafusion:parquet 1015351358 / 1015026952 / +0.0% 1191591800 / 1186808838 / +0.4% 0.85 / 0.86 / -0.4%
clickbench_q24/datafusion:parquet 30013106 / 30571946 / -1.8% 89326188 / 89809691 / -0.5% 0.34 / 0.34 / -1.3%
clickbench_q25/datafusion:parquet 36883312 / 37111422 / -0.6% 104048570 / 102893012 / +1.1% 0.35 / 0.36 / -1.7%
clickbench_q26/datafusion:parquet 30688230 / 31127172 / -1.4% 91052036 / 89186979 / +2.1% 0.34 / 0.35 / -3.4%
clickbench_q27/datafusion:parquet 190517084 / 193620522 / -1.6% 291916954 / 289723884 / +0.8% 0.65 / 0.67 / -2.3%
clickbench_q28/datafusion:parquet 617208549 / 617527624 / -0.1% 703442532 / 702331735 / +0.2% 0.88 / 0.88 / -0.2%
clickbench_q29/datafusion:parquet 30066548 / 28774798 / +4.5% 90920201 / 90223686 / +0.8% 0.33 / 0.32 / +3.7%
clickbench_q30/datafusion:parquet 89672290 / 89604524 / +0.1% 171623618 / 173512200 / -1.1% 0.52 / 0.52 / +1.2%
clickbench_q31/datafusion:parquet 102468626 / 103528343 / -1.0% 196729261 / 200819036 / -2.0% 0.52 / 0.52 / +1.0%
clickbench_q32/datafusion:parquet 305200226 / 308568780 / -1.1% 429213200 / 431256499 / -0.5% 0.71 / 0.72 / -0.6%
clickbench_q33/datafusion:parquet 375632452 / 377940900 / -0.6% 474551834 / 479131033 / -1.0% 0.79 / 0.79 / +0.3%
clickbench_q34/datafusion:parquet 374301238 / 379057750 / -1.3% 481696877 / 480750972 / +0.2% 0.78 / 0.79 / -1.4%
clickbench_q35/datafusion:parquet 64459418 / 65543578 / -1.7% 124070363 / 124134655 / -0.1% 0.52 / 0.53 / -1.6%
clickbench_q36/datafusion:parquet 73305499 / 73387590 / -0.1% 136272591 / 135774569 / +0.4% 0.54 / 0.54 / -0.5%
clickbench_q37/datafusion:parquet 35050080 / 35617999 / -1.6% 93189845 / 91810520 / +1.5% 0.38 / 0.39 / -3.1%
clickbench_q38/datafusion:parquet 47344822 / 47860311 / -1.1% 108562714 / 110026773 / -1.3% 0.44 / 0.43 / +0.3%
clickbench_q39/datafusion:parquet 143022668 / 143836521 / -0.6% 208765116 / 214263836 / -2.6% 0.69 / 0.67 / +2.1%
clickbench_q40/datafusion:parquet 19951981 / 20048918 / -0.5% 78443993 / 78849852 / -0.5% 0.25 / 0.25 / +0.0%
clickbench_q41/datafusion:parquet 18638801 / 18839682 / -1.1% 75861538 / 78602562 / -3.5% 0.25 / 0.24 / +2.5%
clickbench_q42/datafusion:parquet 18962217 / 19448928 / -2.5% 75579138 / 80271917 / -5.8% 0.25 / 0.24 / +3.6%
duckdb / vortex-file-compressed / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2171069 / 2316356 / -6.3% 23589887 / 23309937 / +1.2% 0.09 / 0.10 / -7.4%
clickbench_q01/duckdb:vortex-file-compressed 7622374 / 7539062 / +1.1% 28172426 / 26697318 / +5.5% 0.27 / 0.28 / -4.2%
clickbench_q02/duckdb:vortex-file-compressed 9034224 / 8955982 / +0.9% 36703385 / 35695040 / +2.8% 0.25 / 0.25 / -1.9%
clickbench_q03/duckdb:vortex-file-compressed 13777561 / 13975386 / -1.4% 48391070 / 49335517 / -1.9% 0.28 / 0.28 / +0.5%
clickbench_q04/duckdb:vortex-file-compressed 56219798 / 58896211 / -4.5% 92731160 / 92282346 / +0.5% 0.61 / 0.64 / -5.0%
clickbench_q05/duckdb:vortex-file-compressed 64273948 / 67206239 / -4.4% 96721809 / 96372538 / +0.4% 0.66 / 0.70 / -4.7%
clickbench_q06/duckdb:vortex-file-compressed 2646260 / 2622598 / +0.9% 30710594 / 29238338 / +5.0% 0.09 / 0.09 / -3.9%
clickbench_q07/duckdb:vortex-file-compressed 9070298 / 9600068 / -5.5% 30768676 / 29770566 / +3.4% 0.29 / 0.32 / -8.6%
clickbench_q08/duckdb:vortex-file-compressed 69930665 / 70062960 / -0.2% 104991252 / 105800127 / -0.8% 0.67 / 0.66 / +0.6%
clickbench_q09/duckdb:vortex-file-compressed 94211022 / 94451218 / -0.3% 128528932 / 127163205 / +1.1% 0.73 / 0.74 / -1.3%
clickbench_q10/duckdb:vortex-file-compressed 27441790 / 27782772 / -1.2% 71004837 / 72279743 / -1.8% 0.39 / 0.38 / +0.5%
clickbench_q11/duckdb:vortex-file-compressed 30883908 / 30687561 / +0.6% 75201527 / 74359750 / +1.1% 0.41 / 0.41 / -0.5%
clickbench_q12/duckdb:vortex-file-compressed 72107323 / 72237397 / -0.2% 100941939 / 103652304 / -2.6% 0.71 / 0.70 / +2.5%
clickbench_q13/duckdb:vortex-file-compressed 127068597 / 127851810 / -0.6% 167629778 / 168822427 / -0.7% 0.76 / 0.76 / +0.1%
clickbench_q14/duckdb:vortex-file-compressed 74962095 / 76230723 / -1.7% 104303436 / 106914135 / -2.4% 0.72 / 0.71 / +0.8%
clickbench_q15/duckdb:vortex-file-compressed 75753801 / 76408312 / -0.9% 110590090 / 108616047 / +1.8% 0.68 / 0.70 / -2.6%
clickbench_q16/duckdb:vortex-file-compressed 138026694 / 140833212 / -2.0% 175417169 / 178949293 / -2.0% 0.79 / 0.79 / -0.0%
clickbench_q17/duckdb:vortex-file-compressed 139386452 / 145359782 / -4.1% 174275950 / 181211144 / -3.8% 0.80 / 0.80 / -0.3%
clickbench_q18/duckdb:vortex-file-compressed 259924056 / 256850284 / +1.2% 306350841 / 313893640 / -2.4% 0.85 / 0.82 / +3.7%
clickbench_q19/duckdb:vortex-file-compressed 9461721 / 9464116 / -0.0% 39227931 / 37478588 / +4.7% 0.24 / 0.25 / -4.5%
clickbench_q20/duckdb:vortex-file-compressed 67310578 / 69316572 / -2.9% 167736881 / 170472456 / -1.6% 0.40 / 0.41 / -1.3%
clickbench_q21/duckdb:vortex-file-compressed 84903779 / 87218998 / -2.7% 190630754 / 201513382 / -5.4% 0.45 / 0.43 / +2.9%
clickbench_q22/duckdb:vortex-file-compressed 173695268 / 174846654 / -0.7% 352122906 / 367208660 / -4.1% 0.49 / 0.48 / +3.6%
clickbench_q23/duckdb:vortex-file-compressed 41014802 / 41038768 / -0.1% 83996796 / 82961725 / +1.2% 0.49 / 0.49 / -1.3%
clickbench_q24/duckdb:vortex-file-compressed 14056514 / 15160866 / -7.3% 34751581 / 34968266 / -0.6% 0.40 / 0.43 / -6.7%
clickbench_q25/duckdb:vortex-file-compressed 19298822 / 19345222 / -0.2% 53026422 / 52265793 / +1.5% 0.36 / 0.37 / -1.7%
clickbench_q26/duckdb:vortex-file-compressed 11328640 / 11666164 / -2.9% 37437238 / 37230065 / +0.6% 0.30 / 0.31 / -3.4%
clickbench_q27/duckdb:vortex-file-compressed 53597584 / 54071963 / -0.9% 173114209 / 179248733 / -3.4% 0.31 / 0.30 / +2.6%
clickbench_q28/duckdb:vortex-file-compressed 515477944 / 521783236 / -1.2% 569070910 / 584919271 / -2.7% 0.91 / 0.89 / +1.5%
clickbench_q29/duckdb:vortex-file-compressed 17793288 / 18144333 / -1.9% 50373799 / 41948890 / +20.1% 🔴 0.35 / 0.43 / -18.3%
clickbench_q30/duckdb:vortex-file-compressed 61183336 / 61457455 / -0.4% 111036921 / 112065220 / -0.9% 0.55 / 0.55 / +0.5%
clickbench_q31/duckdb:vortex-file-compressed 111487068 / 112605193 / -1.0% 199403761 / 176967995 / +12.7% 🔴 0.56 / 0.64 / -12.1%
clickbench_q32/duckdb:vortex-file-compressed 373225456 / 376110058 / -0.8% 417184565 / 406967585 / +2.5% 0.89 / 0.92 / -3.2%
clickbench_q33/duckdb:vortex-file-compressed 340433930 / 341811647 / -0.4% 408959742 / 401498204 / +1.9% 0.83 / 0.85 / -2.2%
clickbench_q34/duckdb:vortex-file-compressed 354400977 / 359692298 / -1.5% 419441980 / 421374281 / -0.5% 0.84 / 0.85 / -1.0%
clickbench_q35/duckdb:vortex-file-compressed 58024164 / 59653987 / -2.7% 87061165 / 90891251 / -4.2% 0.67 / 0.66 / +1.5%
clickbench_q36/duckdb:vortex-file-compressed 11543398 / 11699479 / -1.3% 31555355 / 31365789 / +0.6% 0.37 / 0.37 / -1.9%
clickbench_q37/duckdb:vortex-file-compressed 7705638 / 8226245 / -6.3% 27411203 / 27060925 / +1.3% 0.28 / 0.30 / -7.5%
clickbench_q38/duckdb:vortex-file-compressed 8313485 / 8761657 / -5.1% 29870950 / 28743146 / +3.9% 0.28 / 0.30 / -8.7%
clickbench_q39/duckdb:vortex-file-compressed 18930247 / 18934137 / -0.0% 38795229 / 41063311 / -5.5% 0.49 / 0.46 / +5.8%
clickbench_q40/duckdb:vortex-file-compressed 6917168 / 7565950 / -8.6% 26617153 / 27136661 / -1.9% 0.26 / 0.28 / -6.8%
clickbench_q41/duckdb:vortex-file-compressed 7698094 / 8713054 / -11.6% 🟢 28410768 / 29103500 / -2.4% 0.27 / 0.30 / -9.5%
clickbench_q42/duckdb:vortex-file-compressed 7142666 / 7453789 / -4.2% 26601167 / 29052559 / -8.4% 0.27 / 0.26 / +4.7%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 11150156 / 10659744 / +4.6% 18711866 / 18978727 / -1.4% 0.60 / 0.56 / +6.1%
clickbench_q01/duckdb:parquet 17973606 / 16886617 / +6.4% 24013269 / 25296916 / -5.1% 0.75 / 0.67 / +12.1%
clickbench_q02/duckdb:parquet 24096620 / 24098232 / -0.0% 40154067 / 37071171 / +8.3% 0.60 / 0.65 / -7.7%
clickbench_q03/duckdb:parquet 25311768 / 24782620 / +2.1% 40732325 / 39824349 / +2.3% 0.62 / 0.62 / -0.1%
clickbench_q04/duckdb:parquet 63987706 / 63683324 / +0.5% 79938653 / 77506227 / +3.1% 0.80 / 0.82 / -2.6%
clickbench_q05/duckdb:parquet 86639880 / 85826466 / +0.9% 106117972 / 107119166 / -0.9% 0.82 / 0.80 / +1.9%
clickbench_q06/duckdb:parquet 22368183 / 22226085 / +0.6% 31456521 / 33590690 / -6.4% 0.71 / 0.66 / +7.5%
clickbench_q07/duckdb:parquet 18734132 / 19221367 / -2.5% 27997490 / 25706882 / +8.9% 0.67 / 0.75 / -10.5%
clickbench_q08/duckdb:parquet 77779444 / 77522808 / +0.3% 93657070 / 92848832 / +0.9% 0.83 / 0.83 / -0.5%
clickbench_q09/duckdb:parquet 106882274 / 104704682 / +2.1% 126986542 / 125363634 / +1.3% 0.84 / 0.84 / +0.8%
clickbench_q10/duckdb:parquet 42800810 / 42519106 / +0.7% 60897870 / 59927647 / +1.6% 0.70 / 0.71 / -0.9%
clickbench_q11/duckdb:parquet 48655593 / 47981428 / +1.4% 68607100 / 65672662 / +4.5% 0.71 / 0.73 / -2.9%
clickbench_q12/duckdb:parquet 95144968 / 95665316 / -0.5% 116214757 / 114826720 / +1.2% 0.82 / 0.83 / -1.7%
clickbench_q13/duckdb:parquet 155636802 / 153472152 / +1.4% 174246761 / 175809711 / -0.9% 0.89 / 0.87 / +2.3%
clickbench_q14/duckdb:parquet 104751411 / 102001694 / +2.7% 124753844 / 130684375 / -4.5% 0.84 / 0.78 / +7.6%
clickbench_q15/duckdb:parquet 89810475 / 90067308 / -0.3% 107314505 / 104927022 / +2.3% 0.84 / 0.86 / -2.5%
clickbench_q16/duckdb:parquet 168402436 / 176342836 / -4.5% 187506306 / 188023501 / -0.3% 0.90 / 0.94 / -4.2%
clickbench_q17/duckdb:parquet 170159320 / 177250039 / -4.0% 191663002 / 192559334 / -0.5% 0.89 / 0.92 / -3.6%
clickbench_q18/duckdb:parquet 306498928 / 308633344 / -0.7% 349269140 / 337205069 / +3.6% 0.88 / 0.92 / -4.1%
clickbench_q19/duckdb:parquet 21753748 / 22413691 / -2.9% 31954805 / 29637447 / +7.8% 0.68 / 0.76 / -10.0%
clickbench_q20/duckdb:parquet 196928452 / 186276237 / +5.7% 234232388 / 238066293 / -1.6% 0.84 / 0.78 / +7.4%
clickbench_q21/duckdb:parquet 226623884 / 227868066 / -0.5% 269104708 / 270418878 / -0.5% 0.84 / 0.84 / -0.1%
clickbench_q22/duckdb:parquet 324474296 / 309103402 / +5.0% 360370050 / 367922241 / -2.1% 0.90 / 0.84 / +7.2%
clickbench_q23/duckdb:parquet 176650301 / 170096610 / +3.9% 243855396 / 249917834 / -2.4% 0.72 / 0.68 / +6.4%
clickbench_q24/duckdb:parquet 32126716 / 32568394 / -1.4% 52437519 / 50429952 / +4.0% 0.61 / 0.65 / -5.1%
clickbench_q25/duckdb:parquet 44765285 / 45180834 / -0.9% 64837287 / 65172683 / -0.5% 0.69 / 0.69 / -0.4%
clickbench_q26/duckdb:parquet 34031572 / 33653694 / +1.1% 43474447 / 48840762 / -11.0% 🟢 0.78 / 0.69 / +13.6%
clickbench_q27/duckdb:parquet 195889069 / 194425344 / +0.8% 232098555 / 234323287 / -0.9% 0.84 / 0.83 / +1.7%
clickbench_q28/duckdb:parquet 1008033954 / 993376018 / +1.5% 978361596 / 978268921 / +0.0% 1.03 / 1.02 / +1.5%
clickbench_q29/duckdb:parquet 26212924 / 26075564 / +0.5% 35701129 / 35006863 / +2.0% 0.73 / 0.74 / -1.4%
clickbench_q30/duckdb:parquet 109004092 / 109086891 / -0.1% 141921771 / 141744231 / +0.1% 0.77 / 0.77 / -0.2%
clickbench_q31/duckdb:parquet 162643857 / 149473362 / +8.8% 184579950 / 181919472 / +1.5% 0.88 / 0.82 / +7.2%
clickbench_q32/duckdb:parquet 386657434 / 407535979 / -5.1% 429445428 / 415126757 / +3.4% 0.90 / 0.98 / -8.3%
clickbench_q33/duckdb:parquet 480436484 / 487845054 / -1.5% 469007024 / 477973659 / -1.9% 1.02 / 1.02 / +0.4%
clickbench_q34/duckdb:parquet 471423568 / 483134955 / -2.4% 475688164 / 474109910 / +0.3% 0.99 / 1.02 / -2.7%
clickbench_q35/duckdb:parquet 63736515 / 64853068 / -1.7% 74653989 / 78830710 / -5.3% 0.85 / 0.82 / +3.8%
clickbench_q36/duckdb:parquet 33624852 / 31689553 / +6.1% 41790096 / 40649108 / +2.8% 0.80 / 0.78 / +3.2%
clickbench_q37/duckdb:parquet 26262384 / 25055420 / +4.8% 34126322 / 33971986 / +0.5% 0.77 / 0.74 / +4.3%
clickbench_q38/duckdb:parquet 25491958 / 25376014 / +0.5% 34521460 / 34548555 / -0.1% 0.74 / 0.73 / +0.5%
clickbench_q39/duckdb:parquet 55569203 / 55054473 / +0.9% 66037420 / 65475996 / +0.9% 0.84 / 0.84 / +0.1%
clickbench_q40/duckdb:parquet 16514644 / 16160134 / +2.2% 24576904 / 25043946 / -1.9% 0.67 / 0.65 / +4.1%
clickbench_q41/duckdb:parquet 17817090 / 16865376 / +5.6% 24323474 / 24902932 / -2.3% 0.73 / 0.68 / +8.2%
clickbench_q42/duckdb:parquet 16752722 / 15796464 / +6.1% 25348791 / 26446483 / -4.2% 0.66 / 0.60 / +10.6%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 475b320a vs base 19dcd2f2
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.3%
Engines: DataFusion No clear signal (+2.9%, environment too noisy confidence) · DuckDB No clear signal (+11.9%, environment too noisy confidence)
Vortex (geomean): hot 1.080x ➖ · cold 1.011x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +2.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.071x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 209049478 / 225101151 / -7.1% 703693824 / 819874295 / -14.2% 0.30 / 0.27 / +8.2%
tpch_q02/datafusion:vortex-file-compressed 305280057 / 318534689 / -4.2% 699418932 / 723751029 / -3.4% 0.44 / 0.44 / -0.8%
tpch_q03/datafusion:vortex-file-compressed 342525217 / 377368788 / -9.2% 1046653385 / 999232984 / +4.7% 0.33 / 0.38 / -13.3%
tpch_q04/datafusion:vortex-file-compressed 217102389 / 198635278 / +9.3% 471097386 / 477424781 / -1.3% 0.46 / 0.42 / +10.8%
tpch_q05/datafusion:vortex-file-compressed 566452213 / 393827139 / +43.8% 🔴 645870030 / 629883322 / +2.5% 0.88 / 0.63 / +40.3%
tpch_q06/datafusion:vortex-file-compressed 170542927 / 143980039 / +18.4% 299221677 / 326680898 / -8.4% 0.57 / 0.44 / +29.3%
tpch_q07/datafusion:vortex-file-compressed 387806413 / 459619010 / -15.6% 555656293 / 603682077 / -8.0% 0.70 / 0.76 / -8.3%
tpch_q08/datafusion:vortex-file-compressed 564227000 / 480151339 / +17.5% 690781974 / 646130135 / +6.9% 0.82 / 0.74 / +9.9%
tpch_q09/datafusion:vortex-file-compressed 332798074 / 280196019 / +18.8% 488208861 / 569775944 / -14.3% 0.68 / 0.49 / +38.6%
tpch_q10/datafusion:vortex-file-compressed 412781793 / 335800983 / +22.9% 758017619 / 563854563 / +34.4% 🔴 0.54 / 0.60 / -8.6%
tpch_q11/datafusion:vortex-file-compressed 271740852 / 253028894 / +7.4% 413784369 / 411167746 / +0.6% 0.66 / 0.62 / +6.7%
tpch_q12/datafusion:vortex-file-compressed 399136403 / 247200676 / +61.5% 🔴 730685060 / 424206320 / +72.2% 🔴 0.55 / 0.58 / -6.3%
tpch_q13/datafusion:vortex-file-compressed 139922637 / 135457122 / +3.3% 365256239 / 327371805 / +11.6% 0.38 / 0.41 / -7.4%
tpch_q14/datafusion:vortex-file-compressed 192523490 / 168918289 / +14.0% 355079702 / 339885825 / +4.5% 0.54 / 0.50 / +9.1%
tpch_q15/datafusion:vortex-file-compressed 309023783 / 313396373 / -1.4% 467812172 / 671975736 / -30.4% 🟢 0.66 / 0.47 / +41.6%
tpch_q16/datafusion:vortex-file-compressed 137498568 / 154269699 / -10.9% 256045149 / 342273739 / -25.2% 0.54 / 0.45 / +19.1%
tpch_q17/datafusion:vortex-file-compressed 235695058 / 235285287 / +0.2% 419595989 / 448085308 / -6.4% 0.56 / 0.53 / +7.0%
tpch_q18/datafusion:vortex-file-compressed 321187997 / 577341508 / -44.4% 🟢 488296995 / 832055263 / -41.3% 🟢 0.66 / 0.69 / -5.2%
tpch_q19/datafusion:vortex-file-compressed 1854360174 / 276418853 / +570.9% 🔴 411775397 / 444435959 / -7.3% 4.50 / 0.62 / +624.1%
tpch_q20/datafusion:vortex-file-compressed 267343064 / 306719206 / -12.8% 445111720 / 675470284 / -34.1% 🟢 0.60 / 0.45 / +32.3%
tpch_q21/datafusion:vortex-file-compressed 504487979 / 599463599 / -15.8% 556961795 / 958500706 / -41.9% 🟢 0.91 / 0.63 / +44.8%
tpch_q22/datafusion:vortex-file-compressed 174448041 / 415277462 / -58.0% 🟢 421534786 / 1050283869 / -59.9% 🟢 0.41 / 0.40 / +4.7%
datafusion / parquet / ns (1.041x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 180054033 / 241682856 / -25.5% 588900760 / 487531007 / +20.8% 0.31 / 0.50 / -38.3%
tpch_q02/datafusion:parquet 283321634 / 269956217 / +5.0% 613105029 / 609423406 / +0.6% 0.46 / 0.44 / +4.3%
tpch_q03/datafusion:parquet 536193034 / 251068913 / +113.6% 🔴 1151931821 / 663935581 / +73.5% 🔴 0.47 / 0.38 / +23.1%
tpch_q04/datafusion:parquet 149624994 / 144199922 / +3.8% 338331278 / 450930959 / -25.0% 0.44 / 0.32 / +38.3%
tpch_q05/datafusion:parquet 368887172 / 355148108 / +3.9% 487747245 / 521470490 / -6.5% 0.76 / 0.68 / +11.1%
tpch_q06/datafusion:parquet 117063701 / 123561347 / -5.3% 266790102 / 220313766 / +21.1% 0.44 / 0.56 / -21.8%
tpch_q07/datafusion:parquet 323280316 / 374411551 / -13.7% 411309956 / 517618666 / -20.5% 0.79 / 0.72 / +8.7%
tpch_q08/datafusion:parquet 436958459 / 425276503 / +2.7% 585942673 / 533330822 / +9.9% 0.75 / 0.80 / -6.5%
tpch_q09/datafusion:parquet 434244387 / 396498657 / +9.5% 610658072 / 623882092 / -2.1% 0.71 / 0.64 / +11.9%
tpch_q10/datafusion:parquet 353822580 / 311949145 / +13.4% 632219140 / 452955570 / +39.6% 🔴 0.56 / 0.69 / -18.7%
tpch_q11/datafusion:parquet 257318727 / 247927590 / +3.8% 417584676 / 351353202 / +18.9% 0.62 / 0.71 / -12.7%
tpch_q12/datafusion:parquet 192041960 / 165576091 / +16.0% 328836114 / 290563979 / +13.2% 0.58 / 0.57 / +2.5%
tpch_q13/datafusion:parquet 294389655 / 278650002 / +5.6% 510555055 / 475941381 / +7.3% 0.58 / 0.59 / -1.5%
tpch_q14/datafusion:parquet 177654369 / 215575299 / -17.6% 321272881 / 465756460 / -31.0% 🟢 0.55 / 0.46 / +19.5%
tpch_q15/datafusion:parquet 305827601 / 314097726 / -2.6% 517456361 / 437056563 / +18.4% 0.59 / 0.72 / -17.8%
tpch_q16/datafusion:parquet 102979450 / 102227252 / +0.7% 216955588 / 196549578 / +10.4% 0.47 / 0.52 / -8.7%
tpch_q17/datafusion:parquet 311773611 / 295249476 / +5.6% 423531439 / 424664867 / -0.3% 0.74 / 0.70 / +5.9%
tpch_q18/datafusion:parquet 374576926 / 315661264 / +18.7% 458042164 / 534625462 / -14.3% 0.82 / 0.59 / +38.5%
tpch_q19/datafusion:parquet 180937604 / 160275591 / +12.9% 364517297 / 288539952 / +26.3% 0.50 / 0.56 / -10.6%
tpch_q20/datafusion:parquet 241066012 / 259105255 / -7.0% 334747452 / 375574076 / -10.9% 0.72 / 0.69 / +4.4%
tpch_q21/datafusion:parquet 317592104 / 328233636 / -3.2% 458857196 / 595891416 / -23.0% 0.69 / 0.55 / +25.7%
tpch_q22/datafusion:parquet 148672811 / 151945497 / -2.2% 352205311 / 336477683 / +4.7% 0.42 / 0.45 / -6.5%
duckdb / vortex-file-compressed / ns (1.089x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 248181743 / 242713738 / +2.3% 390536505 / 290906301 / +34.2% 🔴 0.64 / 0.83 / -23.8%
tpch_q02/duckdb:vortex-file-compressed 592124961 / 395133430 / +49.9% 🔴 504930322 / 503306863 / +0.3% 1.17 / 0.79 / +49.4%
tpch_q03/duckdb:vortex-file-compressed 495247579 / 403958513 / +22.6% 478785125 / 506631264 / -5.5% 1.03 / 0.80 / +29.7%
tpch_q04/duckdb:vortex-file-compressed 300705136 / 275371920 / +9.2% 346068323 / 264656780 / +30.8% 🔴 0.87 / 1.04 / -16.5%
tpch_q05/duckdb:vortex-file-compressed 569931006 / 554927492 / +2.7% 611109081 / 635027040 / -3.8% 0.93 / 0.87 / +6.7%
tpch_q06/duckdb:vortex-file-compressed 242618114 / 264305141 / -8.2% 271174778 / 217836159 / +24.5% 0.89 / 1.21 / -26.3%
tpch_q07/duckdb:vortex-file-compressed 474816692 / 470551583 / +0.9% 529763783 / 591002499 / -10.4% 0.90 / 0.80 / +12.6%
tpch_q08/duckdb:vortex-file-compressed 722485501 / 677708070 / +6.6% 640900525 / 790424730 / -18.9% 1.13 / 0.86 / +31.5%
tpch_q09/duckdb:vortex-file-compressed 414061596 / 414257896 / -0.0% 440992165 / 421773998 / +4.6% 0.94 / 0.98 / -4.4%
tpch_q10/duckdb:vortex-file-compressed 565304854 / 565809056 / -0.1% 703331283 / 532322473 / +32.1% 🔴 0.80 / 1.06 / -24.4%
tpch_q11/duckdb:vortex-file-compressed 293189025 / 331444316 / -11.5% 333243115 / 326000481 / +2.2% 0.88 / 1.02 / -13.5%
tpch_q12/duckdb:vortex-file-compressed 420373245 / 300240325 / +40.0% 🔴 317794182 / 293824998 / +8.2% 1.32 / 1.02 / +29.5%
tpch_q13/duckdb:vortex-file-compressed 206978759 / 234634397 / -11.8% 254997709 / 285599348 / -10.7% 0.81 / 0.82 / -1.2%
tpch_q14/duckdb:vortex-file-compressed 270489278 / 226387254 / +19.5% 303110410 / 250340989 / +21.1% 0.89 / 0.90 / -1.3%
tpch_q15/duckdb:vortex-file-compressed 293787005 / 244667904 / +20.1% 328160279 / 274125844 / +19.7% 0.90 / 0.89 / +0.3%
tpch_q16/duckdb:vortex-file-compressed 218136576 / 207480636 / +5.1% 238205682 / 212283893 / +12.2% 0.92 / 0.98 / -6.3%
tpch_q17/duckdb:vortex-file-compressed 613184091 / 304429247 / +101.4% 🔴 1351490091 / 400945885 / +237.1% 🔴 0.45 / 0.76 / -40.2%
tpch_q18/duckdb:vortex-file-compressed 440547406 / 442479898 / -0.4% 408194118 / 396598793 / +2.9% 1.08 / 1.12 / -3.3%
tpch_q19/duckdb:vortex-file-compressed 351305382 / 347257411 / +1.2% 391339255 / 333079622 / +17.5% 0.90 / 1.04 / -13.9%
tpch_q20/duckdb:vortex-file-compressed 347895947 / 356522154 / -2.4% 572076162 / 525593522 / +8.8% 0.61 / 0.68 / -10.3%
tpch_q21/duckdb:vortex-file-compressed 784496250 / 669563383 / +17.2% 1212284245 / 768477162 / +57.8% 🔴 0.65 / 0.87 / -25.7%
tpch_q22/duckdb:vortex-file-compressed 234949598 / 288118977 / -18.5% 309120425 / 321455013 / -3.8% 0.76 / 0.90 / -15.2%
duckdb / parquet / ns (0.973x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 172079791 / 157928349 / +9.0% 247827000 / 272690714 / -9.1% 0.69 / 0.58 / +19.9%
tpch_q02/duckdb:parquet 462216887 / 466918592 / -1.0% 1130139828 / 471472543 / +139.7% 🔴 0.41 / 0.99 / -58.7%
tpch_q03/duckdb:parquet 381840153 / 467561365 / -18.3% 473466828 / 447868293 / +5.7% 0.81 / 1.04 / -22.7%
tpch_q04/duckdb:parquet 225591292 / 241132863 / -6.4% 285020145 / 346699496 / -17.8% 0.79 / 0.70 / +13.8%
tpch_q05/duckdb:parquet 631722222 / 601681209 / +5.0% 758041609 / 642800358 / +17.9% 0.83 / 0.94 / -11.0%
tpch_q06/duckdb:parquet 139340714 / 157205162 / -11.4% 213511163 / 194250011 / +9.9% 0.65 / 0.81 / -19.4%
tpch_q07/duckdb:parquet 458224741 / 483254002 / -5.2% 508471398 / 1107993230 / -54.1% 🟢 0.90 / 0.44 / +106.6%
tpch_q08/duckdb:parquet 559677785 / 654285856 / -14.5% 630897468 / 669007016 / -5.7% 0.89 / 0.98 / -9.3%
tpch_q09/duckdb:parquet 632661372 / 644494164 / -1.8% 706386154 / 718771676 / -1.7% 0.90 / 0.90 / -0.1%
tpch_q10/duckdb:parquet 697584499 / 530902132 / +31.4% 🔴 777354719 / 637249426 / +22.0% 0.90 / 0.83 / +7.7%
tpch_q11/duckdb:parquet 312341613 / 303673870 / +2.9% 375342132 / 325318246 / +15.4% 0.83 / 0.93 / -10.9%
tpch_q12/duckdb:parquet 231651461 / 215585071 / +7.5% 316678769 / 266896912 / +18.7% 0.73 / 0.81 / -9.4%
tpch_q13/duckdb:parquet 356273468 / 358775974 / -0.7% 422924370 / 449605311 / -5.9% 0.84 / 0.80 / +5.6%
tpch_q14/duckdb:parquet 239672514 / 328300491 / -27.0% 268207721 / 540192412 / -50.3% 🟢 0.89 / 0.61 / +47.0%
tpch_q15/duckdb:parquet 206595885 / 193853728 / +6.6% 255081749 / 275208554 / -7.3% 0.81 / 0.70 / +15.0%
tpch_q16/duckdb:parquet 275477799 / 265133880 / +3.9% 285788745 / 323161613 / -11.6% 0.96 / 0.82 / +17.5%
tpch_q17/duckdb:parquet 297764351 / 350853382 / -15.1% 336911394 / 381556280 / -11.7% 0.88 / 0.92 / -3.9%
tpch_q18/duckdb:parquet 378932077 / 345691529 / +9.6% 355239482 / 368650896 / -3.6% 1.07 / 0.94 / +13.8%
tpch_q19/duckdb:parquet 304621760 / 299979187 / +1.5% 407305562 / 345698365 / +17.8% 0.75 / 0.87 / -13.8%
tpch_q20/duckdb:parquet 507444505 / 506822076 / +0.1% 575776816 / 594115221 / -3.1% 0.88 / 0.85 / +3.3%
tpch_q21/duckdb:parquet 467595756 / 478529087 / -2.3% 621464091 / 523115452 / +18.8% 0.75 / 0.91 / -17.7%
tpch_q22/duckdb:parquet 292989489 / 351512104 / -16.6% 342220153 / 431678340 / -20.7% 0.86 / 0.81 / +5.1%

Copy link
Copy Markdown
Contributor Author

Closing: this benchmark-only isolation PR is the same pack.rs change as #11060. That change (lazy struct-root expansion) is ported to the combined branch ji/charming-cray-28l167.


Generated by Claude Code

@robert3005
robert3005 deleted the ji/v2-isolate-lazy-pack-root branch November 10, 2026 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant