Skip to content

Push down array_sum in DataFusion - #10854

Merged
mhk197 merged 6 commits into
developfrom
mk/datafusion-array-sum
Nov 4, 2026
Merged

mhk197 merged 6 commits into
developfrom
mk/datafusion-array-sum

Conversation

@mhk197

@mhk197 mhk197 commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Summary

The DataFusion expression converter now pushes array_sum (list_sum) down to Vortex's list_sum.

Changes

Local A/B, pushdown vs DataFusion (time ratio) geomean
42 synthetic shapes (7 element types × list length 4/64/4096 × 0%/50% nulls) 0.80

@mhk197 mhk197 added the changelog/performance A performance improvement label Oct 27, 2026
@joseph-isaacs

Copy link
Copy Markdown
Contributor

How did you convince datafusion to do this?

@codspeed

codspeed Bot commented Oct 27, 2026 •

Copy link
Copy Markdown

Merging this PR will not alter performance

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

✅ 1765 untouched benchmarks
⏩ 130 skipped benchmarks1


Comparing mk/datafusion-array-sum (5e526f3) with develop (bf3cfd0)

Open in CodSpeed

Footnotes

  1. 130 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@mhk197

mhk197 commented Nov 3, 2026

Copy link
Copy Markdown
Contributor Author

@joseph-isaacs not sure what you mean? This is just scalarfn pushdown

@mhk197
mhk197 force-pushed the mk/datafusion-array-sum branch from a106698 to 6e12746 Compare November 3, 2026 19:16
@mhk197 mhk197 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6e12746 fineweb 1 Explore Profiling Data
🟢 Done 6e12746 clickbench-nvme 1 Explore Profiling Data
🟢 Done 6e12746 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 6e12746 tpch-s3 1 Explore Profiling Data
🟢 Done 6e12746 tpch-nvme 1 Explore Profiling Data
🟢 Done 6e12746 polarsignals 1 Explore Profiling Data
🟢 Done 6e12746 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 6e12746c vs base 1ec5a1b1
Vortex (geomean): hot 1.045x ➖ · cold 0.936x ➖


datafusion / vortex-file-compressed / ns (1.045x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44539278 / 44154989 / +0.9% 81092682 / 84113080 / -3.6% 0.55 / 0.52 / +4.6%
polarsignals_q01/datafusion:vortex-file-compressed 80147514 / 52923566 / +51.4% 🔴 106993719 / 109038421 / -1.9% 0.75 / 0.49 / +54.3%
polarsignals_q02/datafusion:vortex-file-compressed 11923950 / 12175145 / -2.1% 43239233 / 45086878 / -4.1% 0.28 / 0.27 / +2.1%
polarsignals_q03/datafusion:vortex-file-compressed 55843842 / 55796934 / +0.1% 108483867 / 111642964 / -2.8% 0.51 / 0.50 / +3.0%
polarsignals_q04/datafusion:vortex-file-compressed 9213081 / 9103886 / +1.2% 36120881 / 38659947 / -6.6% 0.26 / 0.24 / +8.3%
polarsignals_q05/datafusion:vortex-file-compressed 11454035 / 11357554 / +0.8% 39333663 / 43010590 / -8.5% 0.29 / 0.26 / +10.3%
polarsignals_q06/datafusion:vortex-file-compressed 23324527 / 22903315 / +1.8% 49428123 / 51947193 / -4.8% 0.47 / 0.44 / +7.0%
polarsignals_q07/datafusion:vortex-file-compressed 10624725 / 10676102 / -0.5% 36965945 / 42865726 / -13.8% 🟢 0.29 / 0.25 / +15.4%
polarsignals_q08/datafusion:vortex-file-compressed 97456914 / 97425064 / +0.0% 151534500 / 168031110 / -9.8% 0.64 / 0.58 / +10.9%
polarsignals_q09/datafusion:vortex-file-compressed 9995388 / 9964159 / +0.3% 35096205 / 38027497 / -7.7% 0.28 / 0.26 / +8.7%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 6e12746c vs base 1ec5a1b1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.007x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.007x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15808579 / 15860777 / -0.3% 42898247 / 41452040 / +3.5% 0.37 / 0.38 / -3.7%
tpch_q02/datafusion:vortex-file-compressed 16904690 / 16806182 / +0.6% 38458842 / 36134100 / +6.4% 0.44 / 0.47 / -5.5%
tpch_q03/datafusion:vortex-file-compressed 19734178 / 19616912 / +0.6% 49408486 / 47530243 / +4.0% 0.40 / 0.41 / -3.2%
tpch_q04/datafusion:vortex-file-compressed 11124591 / 10114376 / +10.0% 35246136 / 34765999 / +1.4% 0.32 / 0.29 / +8.5%
tpch_q05/datafusion:vortex-file-compressed 36711092 / 36986362 / -0.7% 75087701 / 68288004 / +10.0% 0.49 / 0.54 / -9.7%
tpch_q06/datafusion:vortex-file-compressed 5971720 / 5800414 / +3.0% 27641858 / 28543060 / -3.2% 0.22 / 0.20 / +6.3%
tpch_q07/datafusion:vortex-file-compressed 51738077 / 51851547 / -0.2% 80857186 / 79411273 / +1.8% 0.64 / 0.65 / -2.0%
tpch_q08/datafusion:vortex-file-compressed 51669199 / 50938127 / +1.4% 82696924 / 81719248 / +1.2% 0.62 / 0.62 / +0.2%
tpch_q09/datafusion:vortex-file-compressed 47125670 / 47513175 / -0.8% 74753517 / 74964036 / -0.3% 0.63 / 0.63 / -0.5%
tpch_q10/datafusion:vortex-file-compressed 17433697 / 16730622 / +4.2% 52229141 / 51233715 / +1.9% 0.33 / 0.33 / +2.2%
tpch_q11/datafusion:vortex-file-compressed 14148246 / 14286367 / -1.0% 34887021 / 32518707 / +7.3% 0.41 / 0.44 / -7.7%
tpch_q12/datafusion:vortex-file-compressed 18286554 / 18526813 / -1.3% 47688191 / 43035514 / +10.8% 🔴 0.38 / 0.43 / -10.9%
tpch_q13/datafusion:vortex-file-compressed 18869630 / 18925638 / -0.3% 39112193 / 40989559 / -4.6% 0.48 / 0.46 / +4.5%
tpch_q14/datafusion:vortex-file-compressed 14690706 / 14583069 / +0.7% 40150686 / 40591548 / -1.1% 0.37 / 0.36 / +1.8%
tpch_q15/datafusion:vortex-file-compressed 18766156 / 18970351 / -1.1% 44834471 / 44803214 / +0.1% 0.42 / 0.42 / -1.1%
tpch_q16/datafusion:vortex-file-compressed 18522647 / 18130585 / +2.2% 38819110 / 38720705 / +0.3% 0.48 / 0.47 / +1.9%
tpch_q17/datafusion:vortex-file-compressed 28208779 / 28291447 / -0.3% 58313250 / 58006467 / +0.5% 0.48 / 0.49 / -0.8%
tpch_q18/datafusion:vortex-file-compressed 35873234 / 36061306 / -0.5% 60236496 / 60908115 / -1.1% 0.60 / 0.59 / +0.6%
tpch_q19/datafusion:vortex-file-compressed 11981955 / 11291424 / +6.1% 40179351 / 40351172 / -0.4% 0.30 / 0.28 / +6.6%
tpch_q20/datafusion:vortex-file-compressed 20253199 / 20138467 / +0.6% 45063697 / 44026295 / +2.4% 0.45 / 0.46 / -1.7%
tpch_q21/datafusion:vortex-file-compressed 39601393 / 38454345 / +3.0% 72787128 / 70619882 / +3.1% 0.54 / 0.54 / -0.1%
tpch_q22/datafusion:vortex-file-compressed 10716843 / 10692585 / +0.2% 31017421 / 30920513 / +0.3% 0.35 / 0.35 / -0.1%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71808660 / 71814798 / -0.0% 91361217 / 90848682 / +0.6% 0.79 / 0.79 / -0.6%
tpch_q02/datafusion:parquet 75934777 / 75943748 / -0.0% 93561021 / 92928139 / +0.7% 0.81 / 0.82 / -0.7%
tpch_q03/datafusion:parquet 81816434 / 81976510 / -0.2% 105597257 / 106550147 / -0.9% 0.77 / 0.77 / +0.7%
tpch_q04/datafusion:parquet 39412489 / 39592328 / -0.5% 62306179 / 57779076 / +7.8% 0.63 / 0.69 / -7.7%
tpch_q05/datafusion:parquet 110230252 / 110147619 / +0.1% 140900746 / 136331130 / +3.4% 0.78 / 0.81 / -3.2%
tpch_q06/datafusion:parquet 31273409 / 31440063 / -0.5% 52937555 / 49120626 / +7.8% 0.59 / 0.64 / -7.7%
tpch_q07/datafusion:parquet 113412298 / 112974819 / +0.4% 142291432 / 139762605 / +1.8% 0.80 / 0.81 / -1.4%
tpch_q08/datafusion:parquet 117262477 / 117321660 / -0.1% 145548412 / 144698143 / +0.6% 0.81 / 0.81 / -0.6%
tpch_q09/datafusion:parquet 136920318 / 137541741 / -0.5% 169388309 / 166930383 / +1.5% 0.81 / 0.82 / -1.9%
tpch_q10/datafusion:parquet 103637142 / 103920661 / -0.3% 131092536 / 128697193 / +1.9% 0.79 / 0.81 / -2.1%
tpch_q11/datafusion:parquet 62303164 / 61355104 / +1.5% 82652270 / 82909661 / -0.3% 0.75 / 0.74 / +1.9%
tpch_q12/datafusion:parquet 63846667 / 63470032 / +0.6% 83546587 / 85123748 / -1.9% 0.76 / 0.75 / +2.5%
tpch_q13/datafusion:parquet 143603516 / 143421612 / +0.1% 164085535 / 163836975 / +0.2% 0.88 / 0.88 / -0.0%
tpch_q14/datafusion:parquet 47189449 / 47558221 / -0.8% 70910485 / 70494593 / +0.6% 0.67 / 0.67 / -1.4%
tpch_q15/datafusion:parquet 73446757 / 74137835 / -0.9% 94884423 / 95347300 / -0.5% 0.77 / 0.78 / -0.4%
tpch_q16/datafusion:parquet 43468238 / 43324946 / +0.3% 63813148 / 61744246 / +3.4% 0.68 / 0.70 / -2.9%
tpch_q17/datafusion:parquet 124497633 / 124937537 / -0.4% 148671480 / 148282726 / +0.3% 0.84 / 0.84 / -0.6%
tpch_q18/datafusion:parquet 120944413 / 121196820 / -0.2% 143317384 / 142163605 / +0.8% 0.84 / 0.85 / -1.0%
tpch_q19/datafusion:parquet 56845824 / 56791904 / +0.1% 87795922 / 83995195 / +4.5% 0.65 / 0.68 / -4.2%
tpch_q20/datafusion:parquet 78113675 / 78292204 / -0.2% 102989947 / 102853607 / +0.1% 0.76 / 0.76 / -0.4%
tpch_q21/datafusion:parquet 114100357 / 113523507 / +0.5% 143776655 / 140342399 / +2.4% 0.79 / 0.81 / -1.9%
tpch_q22/datafusion:parquet 51545542 / 51105432 / +0.9% 72032629 / 68934619 / +4.5% 0.72 / 0.74 / -3.5%
duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8995665 / 9641630 / -6.7% 19393828 / 18813641 / +3.1% 0.46 / 0.51 / -9.5%
tpch_q02/duckdb:vortex-file-compressed 15167723 / 15087991 / +0.5% 24870126 / 25235518 / -1.4% 0.61 / 0.60 / +2.0%
tpch_q03/duckdb:vortex-file-compressed 18927941 / 18858563 / +0.4% 34469206 / 34177768 / +0.9% 0.55 / 0.55 / -0.5%
tpch_q04/duckdb:vortex-file-compressed 12453052 / 12542833 / -0.7% 27466131 / 25982780 / +5.7% 0.45 / 0.48 / -6.1%
tpch_q05/duckdb:vortex-file-compressed 20224454 / 20996374 / -3.7% 35696536 / 37156840 / -3.9% 0.57 / 0.57 / +0.3%
tpch_q06/duckdb:vortex-file-compressed 4820192 / 4709168 / +2.4% 14697473 / 15809213 / -7.0% 0.33 / 0.30 / +10.1%
tpch_q07/duckdb:vortex-file-compressed 24631962 / 24306031 / +1.3% 39814511 / 39918435 / -0.3% 0.62 / 0.61 / +1.6%
tpch_q08/duckdb:vortex-file-compressed 21001563 / 21546814 / -2.5% 38857871 / 38265743 / +1.5% 0.54 / 0.56 / -4.0%
tpch_q09/duckdb:vortex-file-compressed 22954411 / 22700823 / +1.1% 38579658 / 39143079 / -1.4% 0.59 / 0.58 / +2.6%
tpch_q10/duckdb:vortex-file-compressed 27336882 / 27605774 / -1.0% 44183392 / 45230704 / -2.3% 0.62 / 0.61 / +1.4%
tpch_q11/duckdb:vortex-file-compressed 8185251 / 8441014 / -3.0% 17582850 / 17587078 / -0.0% 0.47 / 0.48 / -3.0%
tpch_q12/duckdb:vortex-file-compressed 14726631 / 14614946 / +0.8% 28580474 / 28978405 / -1.4% 0.52 / 0.50 / +2.2%
tpch_q13/duckdb:vortex-file-compressed 19369742 / 19588697 / -1.1% 33506503 / 31487092 / +6.4% 0.58 / 0.62 / -7.1%
tpch_q14/duckdb:vortex-file-compressed 11485734 / 11424173 / +0.5% 24429627 / 24031483 / +1.7% 0.47 / 0.48 / -1.1%
tpch_q15/duckdb:vortex-file-compressed 9006425 / 8772070 / +2.7% 21029584 / 21239945 / -1.0% 0.43 / 0.41 / +3.7%
tpch_q16/duckdb:vortex-file-compressed 16617583 / 16745018 / -0.8% 23106282 / 23389248 / -1.2% 0.72 / 0.72 / +0.5%
tpch_q17/duckdb:vortex-file-compressed 12644215 / 12803886 / -1.2% 28183679 / 27657126 / +1.9% 0.45 / 0.46 / -3.1%
tpch_q18/duckdb:vortex-file-compressed 24367949 / 24255169 / +0.5% 34405643 / 35528630 / -3.2% 0.71 / 0.68 / +3.7%
tpch_q19/duckdb:vortex-file-compressed 11799216 / 12180445 / -3.1% 27035536 / 28082468 / -3.7% 0.44 / 0.43 / +0.6%
tpch_q20/duckdb:vortex-file-compressed 14329561 / 14483691 / -1.1% 30713127 / 30514021 / +0.7% 0.47 / 0.47 / -1.7%
tpch_q21/duckdb:vortex-file-compressed 48838386 / 48988314 / -0.3% 64123106 / 65833044 / -2.6% 0.76 / 0.74 / +2.4%
tpch_q22/duckdb:vortex-file-compressed 16715338 / 16910162 / -1.2% 26388289 / 26945027 / -2.1% 0.63 / 0.63 / +0.9%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47466288 / 47573799 / -0.2% 53864336 / 53873496 / -0.0% 0.88 / 0.88 / -0.2%
tpch_q02/duckdb:parquet 48128987 / 48297933 / -0.3% 54873787 / 55748801 / -1.6% 0.88 / 0.87 / +1.2%
tpch_q03/duckdb:parquet 59993348 / 60549517 / -0.9% 68577887 / 68745278 / -0.2% 0.87 / 0.88 / -0.7%
tpch_q04/duckdb:parquet 34780418 / 34789747 / -0.0% 43346204 / 43749298 / -0.9% 0.80 / 0.80 / +0.9%
tpch_q05/duckdb:parquet 66912333 / 67208043 / -0.4% 78400728 / 77053340 / +1.7% 0.85 / 0.87 / -2.2%
tpch_q06/duckdb:parquet 21862226 / 21901899 / -0.2% 27637617 / 27238231 / +1.5% 0.79 / 0.80 / -1.6%
tpch_q07/duckdb:parquet 63825290 / 63291180 / +0.8% 73486804 / 73442911 / +0.1% 0.87 / 0.86 / +0.8%
tpch_q08/duckdb:parquet 75726573 / 75922359 / -0.3% 86676312 / 86148170 / +0.6% 0.87 / 0.88 / -0.9%
tpch_q09/duckdb:parquet 107616228 / 107760820 / -0.1% 119501510 / 118716145 / +0.7% 0.90 / 0.91 / -0.8%
tpch_q10/duckdb:parquet 105680651 / 105812027 / -0.1% 117169430 / 117432415 / -0.2% 0.90 / 0.90 / +0.1%
tpch_q11/duckdb:parquet 29382715 / 29488307 / -0.4% 34244702 / 34796072 / -1.6% 0.86 / 0.85 / +1.2%
tpch_q12/duckdb:parquet 37220750 / 37156480 / +0.2% 44193588 / 44325078 / -0.3% 0.84 / 0.84 / +0.5%
tpch_q13/duckdb:parquet 174498324 / 175312086 / -0.5% 181895389 / 182504003 / -0.3% 0.96 / 0.96 / -0.1%
tpch_q14/duckdb:parquet 42370405 / 42391659 / -0.1% 50103053 / 51056634 / -1.9% 0.85 / 0.83 / +1.9%
tpch_q15/duckdb:parquet 32594930 / 32599809 / -0.0% 40860955 / 41128444 / -0.7% 0.80 / 0.79 / +0.6%
tpch_q16/duckdb:parquet 47328627 / 47403694 / -0.2% 52218435 / 52857976 / -1.2% 0.91 / 0.90 / +1.1%
tpch_q17/duckdb:parquet 47905798 / 47846308 / +0.1% 56770607 / 57780263 / -1.7% 0.84 / 0.83 / +1.9%
tpch_q18/duckdb:parquet 74167827 / 74587103 / -0.6% 81602512 / 80825803 / +1.0% 0.91 / 0.92 / -1.5%
tpch_q19/duckdb:parquet 48705653 / 49696973 / -2.0% 56417430 / 57415584 / -1.7% 0.86 / 0.87 / -0.3%
tpch_q20/duckdb:parquet 63445749 / 63431345 / +0.0% 73350286 / 74127567 / -1.0% 0.86 / 0.86 / +1.1%
tpch_q21/duckdb:parquet 106941381 / 106897881 / +0.0% 115393703 / 115496282 / -0.1% 0.93 / 0.93 / +0.1%
tpch_q22/duckdb:parquet 50431087 / 50471095 / -0.1% 59059362 / 58455084 / +1.0% 0.85 / 0.86 / -1.1%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 6e12746c vs base 1ec5a1b1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.7%
Engines: DataFusion No clear signal (-4.2%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.977x ➖ · cold 1.023x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.011x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.968x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6046351 / 6157448 / -1.8% 21136251 / 19971042 / +5.8% 0.29 / 0.31 / -7.2%
fineweb_q01/datafusion:vortex-file-compressed 10458552 / 9888656 / +5.8% 44545104 / 39235547 / +13.5% 🔴 0.23 / 0.25 / -6.8%
fineweb_q02/datafusion:vortex-file-compressed 11529615 / 11502010 / +0.2% 42562466 / 42759719 / -0.5% 0.27 / 0.27 / +0.7%
fineweb_q03/datafusion:vortex-file-compressed 17530920 / 17172967 / +2.1% 105193142 / 109896878 / -4.3% 0.17 / 0.16 / +6.6%
fineweb_q04/datafusion:vortex-file-compressed 66465200 / 67125352 / -1.0% 143813911 / 147342086 / -2.4% 0.46 / 0.46 / +1.4%
fineweb_q05/datafusion:vortex-file-compressed 63798610 / 62072346 / +2.8% 137224139 / 140520080 / -2.3% 0.46 / 0.44 / +5.2%
fineweb_q06/datafusion:vortex-file-compressed 17667676 / 17399066 / +1.5% 105918379 / 106657464 / -0.7% 0.17 / 0.16 / +2.3%
fineweb_q07/datafusion:vortex-file-compressed 17254634 / 18657168 / -7.5% 105570262 / 105861569 / -0.3% 0.16 / 0.18 / -7.3%
fineweb_q08/datafusion:vortex-file-compressed 9009318 / 12254318 / -26.5% 🟢 34549277 / 28847054 / +19.8% 🔴 0.26 / 0.42 / -38.6%
datafusion / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9571895 / 9259370 / +3.4% 33334415 / 34407065 / -3.1% 0.29 / 0.27 / +6.7%
fineweb_q01/datafusion:parquet 74215132 / 75024436 / -1.1% 153386074 / 146270796 / +4.9% 0.48 / 0.51 / -5.7%
fineweb_q02/datafusion:parquet 74667048 / 74221015 / +0.6% 150395067 / 149644833 / +0.5% 0.50 / 0.50 / +0.1%
fineweb_q03/datafusion:parquet 75550117 / 73313342 / +3.1% 142726784 / 143902055 / -0.8% 0.53 / 0.51 / +3.9%
fineweb_q04/datafusion:parquet 82269932 / 81225428 / +1.3% 151583492 / 150552614 / +0.7% 0.54 / 0.54 / +0.6%
fineweb_q05/datafusion:parquet 80344170 / 79638974 / +0.9% 157034164 / 149102499 / +5.3% 0.51 / 0.53 / -4.2%
fineweb_q06/datafusion:parquet 75470146 / 74118524 / +1.8% 156811502 / 147852842 / +6.1% 0.48 / 0.50 / -4.0%
fineweb_q07/datafusion:parquet 75786498 / 74852362 / +1.2% 148820517 / 146491577 / +1.6% 0.51 / 0.51 / -0.3%
fineweb_q08/datafusion:parquet 72401821 / 73722490 / -1.8% 153599567 / 144710219 / +6.1% 0.47 / 0.51 / -7.5%
duckdb / vortex-file-compressed / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2168614 / 2297346 / -5.6% 7143018 / 8128468 / -12.1% 🟢 0.30 / 0.28 / +7.4%
fineweb_q01/duckdb:vortex-file-compressed 7636888 / 8040522 / -5.0% 28020480 / 28629574 / -2.1% 0.27 / 0.28 / -3.0%
fineweb_q02/duckdb:vortex-file-compressed 9259993 / 9443466 / -1.9% 29676075 / 28966101 / +2.5% 0.31 / 0.33 / -4.3%
fineweb_q03/duckdb:vortex-file-compressed 18929912 / 19286536 / -1.8% 97117532 / 94041318 / +3.3% 0.19 / 0.21 / -5.0%
fineweb_q04/duckdb:vortex-file-compressed 65915614 / 65500698 / +0.6% 109966092 / 106916663 / +2.9% 0.60 / 0.61 / -2.2%
fineweb_q05/duckdb:vortex-file-compressed 64565490 / 65615164 / -1.6% 108795544 / 104779595 / +3.8% 0.59 / 0.63 / -5.2%
fineweb_q06/duckdb:vortex-file-compressed 18848182 / 18221974 / +3.4% 97507029 / 90996460 / +7.2% 0.19 / 0.20 / -3.5%
fineweb_q07/duckdb:vortex-file-compressed 17082641 / 17525496 / -2.5% 98936943 / 92461035 / +7.0% 0.17 / 0.19 / -8.9%
fineweb_q08/duckdb:vortex-file-compressed 4730688 / 4615968 / +2.5% 12944827 / 12348264 / +4.8% 0.37 / 0.37 / -2.2%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23910264 / 23645470 / +1.1% 28289673 / 28365888 / -0.3% 0.85 / 0.83 / +1.4%
fineweb_q01/duckdb:parquet 53966770 / 54364398 / -0.7% 72280591 / 74157810 / -2.5% 0.75 / 0.73 / +1.8%
fineweb_q02/duckdb:parquet 58990836 / 58826740 / +0.3% 79819463 / 82744285 / -3.5% 0.74 / 0.71 / +4.0%
fineweb_q03/duckdb:parquet 119299404 / 119856294 / -0.5% 187726437 / 182243877 / +3.0% 0.64 / 0.66 / -3.4%
fineweb_q04/duckdb:parquet 162144970 / 161120188 / +0.6% 207691035 / 208783643 / -0.5% 0.78 / 0.77 / +1.2%
fineweb_q05/duckdb:parquet 157416618 / 160854510 / -2.1% 198907925 / 199229637 / -0.2% 0.79 / 0.81 / -2.0%
fineweb_q06/duckdb:parquet 87800510 / 86756665 / +1.2% 150725774 / 146251483 / +3.1% 0.58 / 0.59 / -1.8%
fineweb_q07/duckdb:parquet 89804053 / 89812806 / -0.0% 147649555 / 142502824 / +3.6% 0.61 / 0.63 / -3.5%
fineweb_q08/duckdb:parquet 28936477 / 29132278 / -0.7% 30302236 / 31086537 / -2.5% 0.95 / 0.94 / +1.9%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 6e12746c vs base e59b236d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93677001 / 92507078 / +1.3% 161731691 / 145316572 / +11.3% 🔴 0.58 / 0.64 / -9.0%
tpch_q02/datafusion:vortex-file-compressed 64094075 / 65426886 / -2.0% 95761336 / 97616208 / -1.9% 0.67 / 0.67 / -0.1%
tpch_q03/datafusion:vortex-file-compressed 63405074 / 63016974 / +0.6% 117191440 / 120850829 / -3.0% 0.54 / 0.52 / +3.8%
tpch_q04/datafusion:vortex-file-compressed 34181439 / 33985844 / +0.6% 71625708 / 72314828 / -1.0% 0.48 / 0.47 / +1.5%
tpch_q05/datafusion:vortex-file-compressed 116582238 / 116547038 / +0.0% 176807715 / 174117798 / +1.5% 0.66 / 0.67 / -1.5%
tpch_q06/datafusion:vortex-file-compressed 9922164 / 10553706 / -6.0% 61183697 / 57103139 / +7.1% 0.16 / 0.18 / -12.3%
tpch_q07/datafusion:vortex-file-compressed 134783461 / 135172188 / -0.3% 202262121 / 204459363 / -1.1% 0.67 / 0.66 / +0.8%
tpch_q08/datafusion:vortex-file-compressed 143236730 / 140133034 / +2.2% 217439856 / 220247695 / -1.3% 0.66 / 0.64 / +3.5%
tpch_q09/datafusion:vortex-file-compressed 181879707 / 183338936 / -0.8% 250929449 / 266299714 / -5.8% 0.72 / 0.69 / +5.3%
tpch_q10/datafusion:vortex-file-compressed 69003896 / 69655659 / -0.9% 133296585 / 136677037 / -2.5% 0.52 / 0.51 / +1.6%
tpch_q11/datafusion:vortex-file-compressed 43121361 / 43370320 / -0.6% 69720013 / 71470362 / -2.4% 0.62 / 0.61 / +1.9%
tpch_q12/datafusion:vortex-file-compressed 36694503 / 34756927 / +5.6% 81869981 / 77825890 / +5.2% 0.45 / 0.45 / +0.4%
tpch_q13/datafusion:vortex-file-compressed 46240788 / 48734410 / -5.1% 82554401 / 83925140 / -1.6% 0.56 / 0.58 / -3.5%
tpch_q14/datafusion:vortex-file-compressed 21364099 / 21362799 / +0.0% 84582651 / 87673963 / -3.5% 0.25 / 0.24 / +3.7%
tpch_q15/datafusion:vortex-file-compressed 34421567 / 33938848 / +1.4% 90024795 / 93783910 / -4.0% 0.38 / 0.36 / +5.7%
tpch_q16/datafusion:vortex-file-compressed 36768660 / 37238193 / -1.3% 66689242 / 65040656 / +2.5% 0.55 / 0.57 / -3.7%
tpch_q17/datafusion:vortex-file-compressed 174468930 / 178773643 / -2.4% 226917750 / 223418525 / +1.6% 0.77 / 0.80 / -3.9%
tpch_q18/datafusion:vortex-file-compressed 202520604 / 202653101 / -0.1% 265575776 / 272906891 / -2.7% 0.76 / 0.74 / +2.7%
tpch_q19/datafusion:vortex-file-compressed 29418778 / 29932820 / -1.7% 89166050 / 87130666 / +2.3% 0.33 / 0.34 / -4.0%
tpch_q20/datafusion:vortex-file-compressed 59949609 / 60766041 / -1.3% 115074798 / 118331052 / -2.8% 0.52 / 0.51 / +1.4%
tpch_q21/datafusion:vortex-file-compressed 178191074 / 179806767 / -0.9% 244067556 / 244385897 / -0.1% 0.73 / 0.74 / -0.8%
tpch_q22/datafusion:vortex-file-compressed 24865560 / 25402890 / -2.1% 55409366 / 51850775 / +6.9% 0.45 / 0.49 / -8.4%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87785961 / 87164161 / +0.7% 128084521 / 127956637 / +0.1% 0.69 / 0.68 / +0.6%
tpch_q02/datafusion:parquet 173166058 / 173906589 / -0.4% 199702857 / 197778339 / +1.0% 0.87 / 0.88 / -1.4%
tpch_q03/datafusion:parquet 135303163 / 135551875 / -0.2% 183540749 / 179878874 / +2.0% 0.74 / 0.75 / -2.2%
tpch_q04/datafusion:parquet 57234586 / 57503891 / -0.5% 95398309 / 94073982 / +1.4% 0.60 / 0.61 / -1.9%
tpch_q05/datafusion:parquet 166976668 / 167834530 / -0.5% 225213749 / 227989162 / -1.2% 0.74 / 0.74 / +0.7%
tpch_q06/datafusion:parquet 36499409 / 36624948 / -0.3% 77954171 / 80255830 / -2.9% 0.47 / 0.46 / +2.6%
tpch_q07/datafusion:parquet 217846875 / 217633276 / +0.1% 267472498 / 271999860 / -1.7% 0.81 / 0.80 / +1.8%
tpch_q08/datafusion:parquet 216836651 / 219170905 / -1.1% 288992066 / 285974542 / +1.1% 0.75 / 0.77 / -2.1%
tpch_q09/datafusion:parquet 307656014 / 308891929 / -0.4% 376622588 / 381972124 / -1.4% 0.82 / 0.81 / +1.0%
tpch_q10/datafusion:parquet 312316293 / 311881369 / +0.1% 377966057 / 377748109 / +0.1% 0.83 / 0.83 / +0.1%
tpch_q11/datafusion:parquet 127491708 / 127361550 / +0.1% 152951826 / 153242744 / -0.2% 0.83 / 0.83 / +0.3%
tpch_q12/datafusion:parquet 82443073 / 82592868 / -0.2% 121075864 / 122327301 / -1.0% 0.68 / 0.68 / +0.9%
tpch_q13/datafusion:parquet 210863040 / 210962798 / -0.0% 241009263 / 243962917 / -1.2% 0.87 / 0.86 / +1.2%
tpch_q14/datafusion:parquet 85963671 / 87015206 / -1.2% 198245739 / 196122353 / +1.1% 0.43 / 0.44 / -2.3%
tpch_q15/datafusion:parquet 106369430 / 107374159 / -0.9% 159261954 / 159690631 / -0.3% 0.67 / 0.67 / -0.7%
tpch_q16/datafusion:parquet 95391037 / 95509196 / -0.1% 120081863 / 122967901 / -2.3% 0.79 / 0.78 / +2.3%
tpch_q17/datafusion:parquet 212654756 / 216027651 / -1.6% 264205135 / 261658528 / +1.0% 0.80 / 0.83 / -2.5%
tpch_q18/datafusion:parquet 267127000 / 268864486 / -0.6% 320192987 / 316104513 / +1.3% 0.83 / 0.85 / -1.9%
tpch_q19/datafusion:parquet 108380902 / 108705611 / -0.3% 167413074 / 166427994 / +0.6% 0.65 / 0.65 / -0.9%
tpch_q20/datafusion:parquet 185744945 / 185661298 / +0.0% 246638199 / 241396864 / +2.2% 0.75 / 0.77 / -2.1%
tpch_q21/datafusion:parquet 243764127 / 246067548 / -0.9% 306516463 / 308865989 / -0.8% 0.80 / 0.80 / -0.2%
tpch_q22/datafusion:parquet 150021874 / 149363891 / +0.4% 175894196 / 175224454 / +0.4% 0.85 / 0.85 / +0.1%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33310334 / 33137711 / +0.5% 66942371 / 71104122 / -5.9% 0.50 / 0.47 / +6.8%
tpch_q02/duckdb:vortex-file-compressed 28094558 / 28356316 / -0.9% 41831203 / 43661490 / -4.2% 0.67 / 0.65 / +3.4%
tpch_q03/duckdb:vortex-file-compressed 52506997 / 52682998 / -0.3% 102892011 / 104815031 / -1.8% 0.51 / 0.50 / +1.5%
tpch_q04/duckdb:vortex-file-compressed 51692615 / 51555679 / +0.3% 91423800 / 88881114 / +2.9% 0.57 / 0.58 / -2.5%
tpch_q05/duckdb:vortex-file-compressed 68103921 / 67999465 / +0.2% 109331422 / 111896398 / -2.3% 0.62 / 0.61 / +2.5%
tpch_q06/duckdb:vortex-file-compressed 15244508 / 15587302 / -2.2% 53741103 / 51326652 / +4.7% 0.28 / 0.30 / -6.6%
tpch_q07/duckdb:vortex-file-compressed 55535996 / 55893057 / -0.6% 110553409 / 111368801 / -0.7% 0.50 / 0.50 / +0.1%
tpch_q08/duckdb:vortex-file-compressed 84646600 / 84744224 / -0.1% 127727525 / 131317037 / -2.7% 0.66 / 0.65 / +2.7%
tpch_q09/duckdb:vortex-file-compressed 102568765 / 102938449 / -0.4% 156409251 / 163635635 / -4.4% 0.66 / 0.63 / +4.2%
tpch_q10/duckdb:vortex-file-compressed 95779339 / 94990409 / +0.8% 146412943 / 145204581 / +0.8% 0.65 / 0.65 / -0.0%
tpch_q11/duckdb:vortex-file-compressed 13026685 / 13659057 / -4.6% 27825536 / 28334599 / -1.8% 0.47 / 0.48 / -2.9%
tpch_q12/duckdb:vortex-file-compressed 44717760 / 45408851 / -1.5% 83688992 / 82629220 / +1.3% 0.53 / 0.55 / -2.8%
tpch_q13/duckdb:vortex-file-compressed 71166312 / 71045208 / +0.2% 101079688 / 102721672 / -1.6% 0.70 / 0.69 / +1.8%
tpch_q14/duckdb:vortex-file-compressed 28094268 / 28604708 / -1.8% 71927534 / 74802412 / -3.8% 0.39 / 0.38 / +2.1%
tpch_q15/duckdb:vortex-file-compressed 24888201 / 25103894 / -0.9% 65190561 / 63101092 / +3.3% 0.38 / 0.40 / -4.0%
tpch_q16/duckdb:vortex-file-compressed 48464229 / 48699724 / -0.5% 57929443 / 57922003 / +0.0% 0.84 / 0.84 / -0.5%
tpch_q17/duckdb:vortex-file-compressed 35032378 / 34380352 / +1.9% 67967871 / 68313369 / -0.5% 0.52 / 0.50 / +2.4%
tpch_q18/duckdb:vortex-file-compressed 106664096 / 107436907 / -0.7% 120843824 / 122881537 / -1.7% 0.88 / 0.87 / +1.0%
tpch_q19/duckdb:vortex-file-compressed 27467274 / 27829378 / -1.3% 76624785 / 76498470 / +0.2% 0.36 / 0.36 / -1.5%
tpch_q20/duckdb:vortex-file-compressed 42389609 / 42429198 / -0.1% 89507031 / 90570466 / -1.2% 0.47 / 0.47 / +1.1%
tpch_q21/duckdb:vortex-file-compressed 94522115 / 96259653 / -1.8% 146148346 / 150482135 / -2.9% 0.65 / 0.64 / +1.1%
tpch_q22/duckdb:vortex-file-compressed 32999094 / 33720987 / -2.1% 48257910 / 49248152 / -2.0% 0.68 / 0.68 / -0.1%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67393897 / 67790239 / -0.6% 90077075 / 91178631 / -1.2% 0.75 / 0.74 / +0.6%
tpch_q02/duckdb:parquet 86625679 / 87395284 / -0.9% 97093912 / 98507724 / -1.4% 0.89 / 0.89 / +0.6%
tpch_q03/duckdb:parquet 109016340 / 111096728 / -1.9% 145499061 / 143739804 / +1.2% 0.75 / 0.77 / -3.1%
tpch_q04/duckdb:parquet 76981806 / 76309480 / +0.9% 101653381 / 98900259 / +2.8% 0.76 / 0.77 / -1.9%
tpch_q05/duckdb:parquet 123065744 / 123030173 / +0.0% 156718296 / 156083359 / +0.4% 0.79 / 0.79 / -0.4%
tpch_q06/duckdb:parquet 35046852 / 34946343 / +0.3% 60992066 / 60027033 / +1.6% 0.57 / 0.58 / -1.3%
tpch_q07/duckdb:parquet 118278897 / 116812510 / +1.3% 154882362 / 153668398 / +0.8% 0.76 / 0.76 / +0.5%
tpch_q08/duckdb:parquet 146559977 / 148353081 / -1.2% 189682723 / 189385104 / +0.2% 0.77 / 0.78 / -1.4%
tpch_q09/duckdb:parquet 236601823 / 239056495 / -1.0% 275489327 / 276743451 / -0.5% 0.86 / 0.86 / -0.6%
tpch_q10/duckdb:parquet 312124152 / 314055511 / -0.6% 338858116 / 339111001 / -0.1% 0.92 / 0.93 / -0.5%
tpch_q11/duckdb:parquet 43264441 / 43592645 / -0.8% 50202672 / 50691109 / -1.0% 0.86 / 0.86 / +0.2%
tpch_q12/duckdb:parquet 69991095 / 69910488 / +0.1% 90887387 / 89609865 / +1.4% 0.77 / 0.78 / -1.3%
tpch_q13/duckdb:parquet 291589766 / 292157409 / -0.2% 307951556 / 306285071 / +0.5% 0.95 / 0.95 / -0.7%
tpch_q14/duckdb:parquet 100445448 / 101196614 / -0.7% 140065849 / 140951708 / -0.6% 0.72 / 0.72 / -0.1%
tpch_q15/duckdb:parquet 57501012 / 56577824 / +1.6% 86937941 / 85291617 / +1.9% 0.66 / 0.66 / -0.3%
tpch_q16/duckdb:parquet 99911322 / 100824064 / -0.9% 107331924 / 107980839 / -0.6% 0.93 / 0.93 / -0.3%
tpch_q17/duckdb:parquet 83127631 / 81365055 / +2.2% 115907433 / 117571978 / -1.4% 0.72 / 0.69 / +3.6%
tpch_q18/duckdb:parquet 153597730 / 158108281 / -2.9% 170259401 / 175415078 / -2.9% 0.90 / 0.90 / +0.1%
tpch_q19/duckdb:parquet 97596726 / 99185658 / -1.6% 131300788 / 127270412 / +3.2% 0.74 / 0.78 / -4.6%
tpch_q20/duckdb:parquet 146453730 / 146510684 / -0.0% 191027847 / 188113537 / +1.5% 0.77 / 0.78 / -1.6%
tpch_q21/duckdb:parquet 250240724 / 251005145 / -0.3% 276278992 / 277058829 / -0.3% 0.91 / 0.91 / -0.0%
tpch_q22/duckdb:parquet 168107266 / 168585461 / -0.3% 179871888 / 179622858 / +0.1% 0.93 / 0.94 / -0.4%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 6e12746c vs base e59b236d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.028x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21362447 / 21350509 / +0.1% 38577340 / 37357796 / +3.3% 0.55 / 0.57 / -3.1%
tpcds_q02/datafusion:vortex-file-compressed 43615844 / 43630973 / -0.0% 64982677 / 63592800 / +2.2% 0.67 / 0.69 / -2.2%
tpcds_q03/datafusion:vortex-file-compressed 11069648 / 11255684 / -1.7% 28568528 / 25535393 / +11.9% 🔴 0.39 / 0.44 / -12.1%
tpcds_q04/datafusion:vortex-file-compressed 86852896 / 87784870 / -1.1% 120030349 / 118063436 / +1.7% 0.72 / 0.74 / -2.7%
tpcds_q05/datafusion:vortex-file-compressed 60160794 / 56407208 / +6.7% 77929698 / 78206636 / -0.4% 0.77 / 0.72 / +7.0%
tpcds_q06/datafusion:vortex-file-compressed 22807254 / 22206396 / +2.7% 43395867 / 41091157 / +5.6% 0.53 / 0.54 / -2.7%
tpcds_q07/datafusion:vortex-file-compressed 28791399 / 28854421 / -0.2% 51133849 / 49720636 / +2.8% 0.56 / 0.58 / -3.0%
tpcds_q08/datafusion:vortex-file-compressed 24784260 / 24205438 / +2.4% 44196924 / 42509863 / +4.0% 0.56 / 0.57 / -1.5%
tpcds_q09/datafusion:vortex-file-compressed 20498048 / 21682384 / -5.5% 36931711 / 38367246 / -3.7% 0.56 / 0.57 / -1.8%
tpcds_q10/datafusion:vortex-file-compressed 27221616 / 26351496 / +3.3% 49136419 / 45965095 / +6.9% 0.55 / 0.57 / -3.4%
tpcds_q11/datafusion:vortex-file-compressed 52022444 / 50937118 / +2.1% 80541451 / 81298624 / -0.9% 0.65 / 0.63 / +3.1%
tpcds_q12/datafusion:vortex-file-compressed 14839423 / 14651682 / +1.3% 30968799 / 29951468 / +3.4% 0.48 / 0.49 / -2.0%
tpcds_q13/datafusion:vortex-file-compressed 31533060 / 31881571 / -1.1% 56428172 / 51622987 / +9.3% 0.56 / 0.62 / -9.5%
tpcds_q14/datafusion:vortex-file-compressed 485654486 / 486461144 / -0.2% 547233616 / 542940060 / +0.8% 0.89 / 0.90 / -0.9%
tpcds_q15/datafusion:vortex-file-compressed 12388358 / 12425464 / -0.3% 32077663 / 30395465 / +5.5% 0.39 / 0.41 / -5.5%
tpcds_q16/datafusion:vortex-file-compressed 18188640 / 18453011 / -1.4% 37556960 / 35612554 / +5.5% 0.48 / 0.52 / -6.5%
tpcds_q17/datafusion:vortex-file-compressed 53860054 / 52476262 / +2.6% 76487113 / 67735523 / +12.9% 🔴 0.70 / 0.77 / -9.1%
tpcds_q18/datafusion:vortex-file-compressed 62739870 / 62875193 / -0.2% 86275106 / 84376735 / +2.2% 0.73 / 0.75 / -2.4%
tpcds_q19/datafusion:vortex-file-compressed 16657422 / 16635228 / +0.1% 38018926 / 35167576 / +8.1% 0.44 / 0.47 / -7.4%
tpcds_q20/datafusion:vortex-file-compressed 16533418 / 16152470 / +2.4% 36036719 / 33852506 / +6.5% 0.46 / 0.48 / -3.8%
tpcds_q21/datafusion:vortex-file-compressed 15426783 / 16333312 / -5.6% 36326896 / 34580930 / +5.0% 0.42 / 0.47 / -10.1%
tpcds_q22/datafusion:vortex-file-compressed 48837444 / 49445272 / -1.2% 71389599 / 70765835 / +0.9% 0.68 / 0.70 / -2.1%
tpcds_q23/datafusion:vortex-file-compressed 70622672 / 70475671 / +0.2% 96384574 / 96935306 / -0.6% 0.73 / 0.73 / +0.8%
tpcds_q24/datafusion:vortex-file-compressed 64508442 / 64758180 / -0.4% 86876039 / 82615774 / +5.2% 0.74 / 0.78 / -5.3%
tpcds_q25/datafusion:vortex-file-compressed 49042858 / 48381956 / +1.4% 73486657 / 63304126 / +16.1% 🔴 0.67 / 0.76 / -12.7%
tpcds_q26/datafusion:vortex-file-compressed 25540090 / 25717229 / -0.7% 46217151 / 45260595 / +2.1% 0.55 / 0.57 / -2.7%
tpcds_q27/datafusion:vortex-file-compressed 58925028 / 56749647 / +3.8% 81917503 / 79919958 / +2.5% 0.72 / 0.71 / +1.3%
tpcds_q28/datafusion:vortex-file-compressed 25052245 / 23891294 / +4.9% 39143581 / 40897993 / -4.3% 0.64 / 0.58 / +9.6%
tpcds_q29/datafusion:vortex-file-compressed 53682763 / 53577942 / +0.2% 74968748 / 65670140 / +14.2% 🔴 0.72 / 0.82 / -12.2%
tpcds_q30/datafusion:vortex-file-compressed 26278631 / 26145644 / +0.5% 45042275 / 41907492 / +7.5% 0.58 / 0.62 / -6.5%
tpcds_q31/datafusion:vortex-file-compressed 58208646 / 58810241 / -1.0% 82500979 / 81261728 / +1.5% 0.71 / 0.72 / -2.5%
tpcds_q32/datafusion:vortex-file-compressed 12632716 / 12505447 / +1.0% 29382266 / 29134951 / +0.8% 0.43 / 0.43 / +0.2%
tpcds_q33/datafusion:vortex-file-compressed 27357978 / 27528952 / -0.6% 48893277 / 48685596 / +0.4% 0.56 / 0.57 / -1.0%
tpcds_q34/datafusion:vortex-file-compressed 17378304 / 17375689 / +0.0% 35753907 / 35805606 / -0.1% 0.49 / 0.49 / +0.2%
tpcds_q35/datafusion:vortex-file-compressed 30341086 / 29957335 / +1.3% 54711795 / 53578900 / +2.1% 0.55 / 0.56 / -0.8%
tpcds_q36/datafusion:vortex-file-compressed 46269856 / 47253474 / -2.1% 76839309 / 65272629 / +17.7% 🔴 0.60 / 0.72 / -16.8%
tpcds_q37/datafusion:vortex-file-compressed 11478122 / 11740648 / -2.2% 33922182 / 31186949 / +8.8% 0.34 / 0.38 / -10.1%
tpcds_q38/datafusion:vortex-file-compressed 25244172 / 25631338 / -1.5% 45780410 / 43700654 / +4.8% 0.55 / 0.59 / -6.0%
tpcds_q39/datafusion:vortex-file-compressed 64930244 / 64450064 / +0.7% 90010156 / 84450477 / +6.6% 0.72 / 0.76 / -5.5%
tpcds_q40/datafusion:vortex-file-compressed 23171094 / 22932458 / +1.0% 42946517 / 41672568 / +3.1% 0.54 / 0.55 / -2.0%
tpcds_q41/datafusion:vortex-file-compressed 20542190 / 20389780 / +0.7% 33065108 / 31998669 / +3.3% 0.62 / 0.64 / -2.5%
tpcds_q42/datafusion:vortex-file-compressed 10919630 / 10979152 / -0.5% 27056529 / 24830958 / +9.0% 0.40 / 0.44 / -8.7%
tpcds_q43/datafusion:vortex-file-compressed 12279152 / 12517680 / -1.9% 33045007 / 29125868 / +13.5% 🔴 0.37 / 0.43 / -13.5%
tpcds_q44/datafusion:vortex-file-compressed 28935404 / 28873920 / +0.2% 51828812 / 50068951 / +3.5% 0.56 / 0.58 / -3.2%
tpcds_q45/datafusion:vortex-file-compressed 15927008 / 15927127 / -0.0% 33697745 / 32153841 / +4.8% 0.47 / 0.50 / -4.6%
tpcds_q46/datafusion:vortex-file-compressed 23510352 / 23126858 / +1.7% 44943957 / 44710550 / +0.5% 0.52 / 0.52 / +1.1%
tpcds_q47/datafusion:vortex-file-compressed 73823028 / 76205444 / -3.1% 102901321 / 102596462 / +0.3% 0.72 / 0.74 / -3.4%
tpcds_q48/datafusion:vortex-file-compressed 28424245 / 28953414 / -1.8% 51058961 / 48983866 / +4.2% 0.56 / 0.59 / -5.8%
tpcds_q49/datafusion:vortex-file-compressed 56346519 / 55758122 / +1.1% 78490694 / 82805699 / -5.2% 0.72 / 0.67 / +6.6%
tpcds_q50/datafusion:vortex-file-compressed 30592882 / 30200848 / +1.3% 52898002 / 51806890 / +2.1% 0.58 / 0.58 / -0.8%
tpcds_q51/datafusion:vortex-file-compressed 66131153 / 65753230 / +0.6% 86165630 / 84885039 / +1.5% 0.77 / 0.77 / -0.9%
tpcds_q52/datafusion:vortex-file-compressed 11483750 / 11221720 / +2.3% 27253046 / 25939045 / +5.1% 0.42 / 0.43 / -2.6%
tpcds_q53/datafusion:vortex-file-compressed 17577944 / 17991312 / -2.3% 38009830 / 35622091 / +6.7% 0.46 / 0.51 / -8.4%
tpcds_q54/datafusion:vortex-file-compressed 31616418 / 31337422 / +0.9% 53164310 / 51598759 / +3.0% 0.59 / 0.61 / -2.1%
tpcds_q55/datafusion:vortex-file-compressed 10847860 / 10810838 / +0.3% 26304956 / 24868147 / +5.8% 0.41 / 0.43 / -5.1%
tpcds_q56/datafusion:vortex-file-compressed 26307656 / 26512630 / -0.8% 46208953 / 45080896 / +2.5% 0.57 / 0.59 / -3.2%
tpcds_q57/datafusion:vortex-file-compressed 61922454 / 61166143 / +1.2% 86040973 / 83196856 / +3.4% 0.72 / 0.74 / -2.1%
tpcds_q58/datafusion:vortex-file-compressed 38083222 / 38382390 / -0.8% 60858233 / 61059262 / -0.3% 0.63 / 0.63 / -0.5%
tpcds_q59/datafusion:vortex-file-compressed 29783870 / 29439580 / +1.2% 55716358 / 53484566 / +4.2% 0.53 / 0.55 / -2.9%
tpcds_q60/datafusion:vortex-file-compressed 25893410 / 25963358 / -0.3% 46422368 / 44457933 / +4.4% 0.56 / 0.58 / -4.5%
tpcds_q61/datafusion:vortex-file-compressed 20826075 / 21758260 / -4.3% 42941299 / 41758696 / +2.8% 0.48 / 0.52 / -6.9%
tpcds_q62/datafusion:vortex-file-compressed 16231558 / 16404438 / -1.1% 34051997 / 32989612 / +3.2% 0.48 / 0.50 / -4.1%
tpcds_q63/datafusion:vortex-file-compressed 17775014 / 17713876 / +0.3% 38677038 / 37779575 / +2.4% 0.46 / 0.47 / -2.0%
tpcds_q64/datafusion:vortex-file-compressed 209308926 / 210444956 / -0.5% 242910164 / 243380332 / -0.2% 0.86 / 0.86 / -0.3%
tpcds_q65/datafusion:vortex-file-compressed 72742382 / 73070062 / -0.4% 94340825 / 92311155 / +2.2% 0.77 / 0.79 / -2.6%
tpcds_q66/datafusion:vortex-file-compressed 50432738 / 50272774 / +0.3% 74312166 / 70657252 / +5.2% 0.68 / 0.71 / -4.6%
tpcds_q67/datafusion:vortex-file-compressed 51176792 / 50211742 / +1.9% 80322691 / 79117752 / +1.5% 0.64 / 0.63 / +0.4%
tpcds_q68/datafusion:vortex-file-compressed 22705344 / 23093180 / -1.7% 47017178 / 43486058 / +8.1% 0.48 / 0.53 / -9.1%
tpcds_q69/datafusion:vortex-file-compressed 25394528 / 25241548 / +0.6% 46574994 / 43989365 / +5.9% 0.55 / 0.57 / -5.0%
tpcds_q70/datafusion:vortex-file-compressed 71849652 / 71093402 / +1.1% 93206975 / 90261328 / +3.3% 0.77 / 0.79 / -2.1%
tpcds_q71/datafusion:vortex-file-compressed 19138828 / 18657318 / +2.6% 39706339 / 38175671 / +4.0% 0.48 / 0.49 / -1.4%
tpcds_q72/datafusion:vortex-file-compressed 346695992 / 353321122 / -1.9% 406822755 / 397234206 / +2.4% 0.85 / 0.89 / -4.2%
tpcds_q73/datafusion:vortex-file-compressed 16128890 / 16319120 / -1.2% 37474396 / 35634250 / +5.2% 0.43 / 0.46 / -6.0%
tpcds_q74/datafusion:vortex-file-compressed 40558603 / 39752122 / +2.0% 67360463 / 65015220 / +3.6% 0.60 / 0.61 / -1.5%
tpcds_q75/datafusion:vortex-file-compressed 134161668 / 133745046 / +0.3% 159044971 / 156878440 / +1.4% 0.84 / 0.85 / -1.1%
tpcds_q76/datafusion:vortex-file-compressed 29218038 / 29342506 / -0.4% 47876099 / 46589091 / +2.8% 0.61 / 0.63 / -3.1%
tpcds_q77/datafusion:vortex-file-compressed 44108898 / 44004712 / +0.2% 65814224 / 63689882 / +3.3% 0.67 / 0.69 / -3.0%
tpcds_q78/datafusion:vortex-file-compressed 62922460 / 63275219 / -0.6% 91259533 / 91753451 / -0.5% 0.69 / 0.69 / -0.0%
tpcds_q79/datafusion:vortex-file-compressed 19509862 / 19534848 / -0.1% 41178723 / 41166051 / +0.0% 0.47 / 0.47 / -0.2%
tpcds_q80/datafusion:vortex-file-compressed 72376380 / 73681805 / -1.8% 100146820 / 97709283 / +2.5% 0.72 / 0.75 / -4.2%
tpcds_q81/datafusion:vortex-file-compressed 25944125 / 26037220 / -0.4% 43681011 / 42973253 / +1.6% 0.59 / 0.61 / -2.0%
tpcds_q82/datafusion:vortex-file-compressed 11842472 / 12271704 / -3.5% 34895400 / 30968407 / +12.7% 🔴 0.34 / 0.40 / -14.4%
tpcds_q83/datafusion:vortex-file-compressed 32761765 / 33032601 / -0.8% 52270919 / 50180764 / +4.2% 0.63 / 0.66 / -4.8%
tpcds_q84/datafusion:vortex-file-compressed 10086434 / 10391722 / -2.9% 25562277 / 23451840 / +9.0% 0.39 / 0.44 / -11.0%
tpcds_q85/datafusion:vortex-file-compressed 53215160 / 53450955 / -0.4% 78342071 / 77514571 / +1.1% 0.68 / 0.69 / -1.5%
tpcds_q86/datafusion:vortex-file-compressed 15581385 / 15619925 / -0.2% 33234717 / 30993570 / +7.2% 0.47 / 0.50 / -7.0%
tpcds_q87/datafusion:vortex-file-compressed 26323548 / 26517394 / -0.7% 48729391 / 47245944 / +3.1% 0.54 / 0.56 / -3.8%
tpcds_q88/datafusion:vortex-file-compressed 31699900 / 31073040 / +2.0% 50361378 / 50143691 / +0.4% 0.63 / 0.62 / +1.6%
tpcds_q89/datafusion:vortex-file-compressed 21124243 / 21036494 / +0.4% 40564792 / 38476982 / +5.4% 0.52 / 0.55 / -4.8%
tpcds_q90/datafusion:vortex-file-compressed 9896142 / 9964241 / -0.7% 24621575 / 23075122 / +6.7% 0.40 / 0.43 / -6.9%
tpcds_q91/datafusion:vortex-file-compressed 15575004 / 16093932 / -3.2% 36131154 / 33785715 / +6.9% 0.43 / 0.48 / -9.5%
tpcds_q92/datafusion:vortex-file-compressed 12831874 / 12775158 / +0.4% 29070667 / 27323411 / +6.4% 0.44 / 0.47 / -5.6%
tpcds_q93/datafusion:vortex-file-compressed 20242593 / 20154052 / +0.4% 42547985 / 38520181 / +10.5% 🔴 0.48 / 0.52 / -9.1%
tpcds_q94/datafusion:vortex-file-compressed 18433064 / 18032050 / +2.2% 37235288 / 35540476 / +4.8% 0.50 / 0.51 / -2.4%
tpcds_q95/datafusion:vortex-file-compressed 41944010 / 42496918 / -1.3% 62063422 / 60715601 / +2.2% 0.68 / 0.70 / -3.4%
tpcds_q96/datafusion:vortex-file-compressed 7481156 / 7424299 / +0.8% 24659601 / 23152992 / +6.5% 0.30 / 0.32 / -5.4%
tpcds_q97/datafusion:vortex-file-compressed 17117522 / 17292924 / -1.0% 36048660 / 35153604 / +2.5% 0.47 / 0.49 / -3.5%
tpcds_q98/datafusion:vortex-file-compressed 16171962 / 16428127 / -1.6% 35917680 / 35315039 / +1.7% 0.45 / 0.47 / -3.2%
tpcds_q99/datafusion:vortex-file-compressed 15718074 / 15798438 / -0.5% 34650758 / 32280966 / +7.3% 0.45 / 0.49 / -7.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43230714 / 41839880 / +3.3% 60915006 / 58108153 / +4.8% 0.71 / 0.72 / -1.4%
tpcds_q02/datafusion:parquet 54384544 / 54346157 / +0.1% 70688439 / 69855929 / +1.2% 0.77 / 0.78 / -1.1%
tpcds_q03/datafusion:parquet 19097530 / 19165138 / -0.4% 31090635 / 28193684 / +10.3% 🔴 0.61 / 0.68 / -9.6%
tpcds_q04/datafusion:parquet 179625962 / 176622286 / +1.7% 206607992 / 199670295 / +3.5% 0.87 / 0.88 / -1.7%
tpcds_q05/datafusion:parquet 67144774 / 66042094 / +1.7% 89176911 / 84886535 / +5.1% 0.75 / 0.78 / -3.2%
tpcds_q06/datafusion:parquet 33947077 / 33996918 / -0.1% 46221112 / 44061251 / +4.9% 0.73 / 0.77 / -4.8%
tpcds_q07/datafusion:parquet 46793142 / 47236607 / -0.9% 64572923 / 61535430 / +4.9% 0.72 / 0.77 / -5.6%
tpcds_q08/datafusion:parquet 31118167 / 31250455 / -0.4% 48101339 / 45488391 / +5.7% 0.65 / 0.69 / -5.8%
tpcds_q09/datafusion:parquet 32271245 / 31773241 / +1.6% 40553953 / 48607366 / -16.6% 🟢 0.80 / 0.65 / +21.7%
tpcds_q10/datafusion:parquet 43843274 / 45123562 / -2.8% 59410106 / 59172011 / +0.4% 0.74 / 0.76 / -3.2%
tpcds_q11/datafusion:parquet 96675453 / 96345480 / +0.3% 117953042 / 114876038 / +2.7% 0.82 / 0.84 / -2.3%
tpcds_q12/datafusion:parquet 23275355 / 23589604 / -1.3% 38014170 / 34664396 / +9.7% 0.61 / 0.68 / -10.0%
tpcds_q13/datafusion:parquet 45958668 / 46684864 / -1.6% 68125494 / 64637322 / +5.4% 0.67 / 0.72 / -6.6%
tpcds_q14/datafusion:parquet 535720489 / 533636978 / +0.4% 573094233 / 584851719 / -2.0% 0.93 / 0.91 / +2.5%
tpcds_q15/datafusion:parquet 23620294 / 23180538 / +1.9% 37472766 / 36516909 / +2.6% 0.63 / 0.63 / -0.7%
tpcds_q16/datafusion:parquet 36603878 / 36899086 / -0.8% 50242906 / 48136179 / +4.4% 0.73 / 0.77 / -5.0%
tpcds_q17/datafusion:parquet 74263466 / 76121614 / -2.4% 99176550 / 93439667 / +6.1% 0.75 / 0.81 / -8.1%
tpcds_q18/datafusion:parquet 66752748 / 69579238 / -4.1% 87548225 / 82940908 / +5.6% 0.76 / 0.84 / -9.1%
tpcds_q19/datafusion:parquet 29279608 / 29436256 / -0.5% 43958840 / 42681039 / +3.0% 0.67 / 0.69 / -3.4%
tpcds_q20/datafusion:parquet 24498281 / 24912263 / -1.7% 36722701 / 37503177 / -2.1% 0.67 / 0.66 / +0.4%
tpcds_q21/datafusion:parquet 20307344 / 20037050 / +1.3% 31379620 / 30066331 / +4.4% 0.65 / 0.67 / -2.9%
tpcds_q22/datafusion:parquet 77446161 / 77561177 / -0.1% 88374095 / 88654622 / -0.3% 0.88 / 0.87 / +0.2%
tpcds_q23/datafusion:parquet 92303412 / 90766884 / +1.7% 113614274 / 112223765 / +1.2% 0.81 / 0.81 / +0.4%
tpcds_q24/datafusion:parquet 89518241 / 90221810 / -0.8% 115571277 / 110518692 / +4.6% 0.77 / 0.82 / -5.1%
tpcds_q25/datafusion:parquet 80495022 / 80788266 / -0.4% 100543528 / 100435444 / +0.1% 0.80 / 0.80 / -0.5%
tpcds_q26/datafusion:parquet 44019876 / 44281274 / -0.6% 59301746 / 59401937 / -0.2% 0.74 / 0.75 / -0.4%
tpcds_q27/datafusion:parquet 77672594 / 74550208 / +4.2% 99933182 / 92473021 / +8.1% 0.78 / 0.81 / -3.6%
tpcds_q28/datafusion:parquet 28587876 / 28877994 / -1.0% 42200909 / 42532209 / -0.8% 0.68 / 0.68 / -0.2%
tpcds_q29/datafusion:parquet 74996754 / 76417526 / -1.9% 98701883 / 96334119 / +2.5% 0.76 / 0.79 / -4.2%
tpcds_q30/datafusion:parquet 45498610 / 44927704 / +1.3% 60612566 / 56098155 / +8.0% 0.75 / 0.80 / -6.3%
tpcds_q31/datafusion:parquet 80471236 / 79118386 / +1.7% 101572907 / 97268174 / +4.4% 0.79 / 0.81 / -2.6%
tpcds_q32/datafusion:parquet 26784358 / 26306961 / +1.8% 41680134 / 38007793 / +9.7% 0.64 / 0.69 / -7.2%
tpcds_q33/datafusion:parquet 37978904 / 38281670 / -0.8% 54990969 / 51080732 / +7.7% 0.69 / 0.75 / -7.8%
tpcds_q34/datafusion:parquet 24150136 / 24488204 / -1.4% 34955840 / 34462479 / +1.4% 0.69 / 0.71 / -2.8%
tpcds_q35/datafusion:parquet 50803616 / 49903016 / +1.8% 62521273 / 61538052 / +1.6% 0.81 / 0.81 / +0.2%
tpcds_q36/datafusion:parquet 52760788 / 51923620 / +1.6% 70740520 / 70468881 / +0.4% 0.75 / 0.74 / +1.2%
tpcds_q37/datafusion:parquet 21256302 / 21209146 / +0.2% 33776228 / 31779677 / +6.3% 0.63 / 0.67 / -5.7%
tpcds_q38/datafusion:parquet 45265542 / 45570807 / -0.7% 62892151 / 60912045 / +3.3% 0.72 / 0.75 / -3.8%
tpcds_q39/datafusion:parquet 68673942 / 67429314 / +1.8% 84031364 / 83732878 / +0.4% 0.82 / 0.81 / +1.5%
tpcds_q40/datafusion:parquet 30320418 / 31425184 / -3.5% 49910923 / 47917839 / +4.2% 0.61 / 0.66 / -7.4%
tpcds_q41/datafusion:parquet 19668098 / 20246584 / -2.9% 31944727 / 29912590 / +6.8% 0.62 / 0.68 / -9.0%
tpcds_q42/datafusion:parquet 17996704 / 17976320 / +0.1% 29044515 / 27741256 / +4.7% 0.62 / 0.65 / -4.4%
tpcds_q43/datafusion:parquet 19462972 / 19287025 / +0.9% 32045113 / 30160800 / +6.2% 0.61 / 0.64 / -5.0%
tpcds_q44/datafusion:parquet 34712304 / 33706332 / +3.0% 49315696 / 49271185 / +0.1% 0.70 / 0.68 / +2.9%
tpcds_q45/datafusion:parquet 27932779 / 27355158 / +2.1% 42235286 / 40885862 / +3.3% 0.66 / 0.67 / -1.2%
tpcds_q46/datafusion:parquet 28765607 / 28895254 / -0.4% 45513555 / 43587868 / +4.4% 0.63 / 0.66 / -4.7%
tpcds_q47/datafusion:parquet 96154791 / 97539807 / -1.4% 111990289 / 118094519 / -5.2% 0.86 / 0.83 / +4.0%
tpcds_q48/datafusion:parquet 42346574 / 42222560 / +0.3% 61062609 / 56286853 / +8.5% 0.69 / 0.75 / -7.6%
tpcds_q49/datafusion:parquet 73347518 / 71338796 / +2.8% 91650863 / 93352935 / -1.8% 0.80 / 0.76 / +4.7%
tpcds_q50/datafusion:parquet 47039400 / 47807246 / -1.6% 65335131 / 64458702 / +1.4% 0.72 / 0.74 / -2.9%
tpcds_q51/datafusion:parquet 74764402 / 75088638 / -0.4% 93497494 / 94668396 / -1.2% 0.80 / 0.79 / +0.8%
tpcds_q52/datafusion:parquet 18741396 / 18498206 / +1.3% 30750110 / 27883575 / +10.3% 🔴 0.61 / 0.66 / -8.1%
tpcds_q53/datafusion:parquet 23014038 / 21832722 / +5.4% 38856802 / 36937519 / +5.2% 0.59 / 0.59 / +0.2%
tpcds_q54/datafusion:parquet 52783845 / 54443240 / -3.0% 65983129 / 62813867 / +5.0% 0.80 / 0.87 / -7.7%
tpcds_q55/datafusion:parquet 18096292 / 18258518 / -0.9% 28319278 / 28564646 / -0.9% 0.64 / 0.64 / -0.0%
tpcds_q56/datafusion:parquet 41128819 / 41505630 / -0.9% 55463403 / 55468815 / -0.0% 0.74 / 0.75 / -0.9%
tpcds_q57/datafusion:parquet 100398341 / 101555104 / -1.1% 115194230 / 117599740 / -2.0% 0.87 / 0.86 / +0.9%
tpcds_q58/datafusion:parquet 64852888 / 65502094 / -1.0% 82941570 / 82122187 / +1.0% 0.78 / 0.80 / -2.0%
tpcds_q59/datafusion:parquet 48213440 / 48339840 / -0.3% 64655578 / 64902455 / -0.4% 0.75 / 0.74 / +0.1%
tpcds_q60/datafusion:parquet 40951012 / 39916218 / +2.6% 53883557 / 49339711 / +9.2% 0.76 / 0.81 / -6.1%
tpcds_q61/datafusion:parquet 34890894 / 35919987 / -2.9% 51574853 / 49545015 / +4.1% 0.68 / 0.72 / -6.7%
tpcds_q62/datafusion:parquet 25181168 / 25021335 / +0.6% 37931072 / 36702937 / +3.3% 0.66 / 0.68 / -2.6%
tpcds_q63/datafusion:parquet 21977302 / 22152924 / -0.8% 36958657 / 36344048 / +1.7% 0.59 / 0.61 / -2.4%
tpcds_q64/datafusion:parquet 285387166 / 288693460 / -1.1% 320333968 / 323149574 / -0.9% 0.89 / 0.89 / -0.3%
tpcds_q65/datafusion:parquet 125456996 / 119698744 / +4.8% 143056852 / 135279537 / +5.7% 0.88 / 0.88 / -0.9%
tpcds_q66/datafusion:parquet 60614154 / 59279388 / +2.3% 76826371 / 75402995 / +1.9% 0.79 / 0.79 / +0.4%
tpcds_q67/datafusion:parquet 69136526 / 68645544 / +0.7% 92503584 / 92025951 / +0.5% 0.75 / 0.75 / +0.2%
tpcds_q68/datafusion:parquet 28922310 / 29033539 / -0.4% 47378880 / 46183039 / +2.6% 0.61 / 0.63 / -2.9%
tpcds_q69/datafusion:parquet 44123799 / 43828923 / +0.7% 58197978 / 57552575 / +1.1% 0.76 / 0.76 / -0.4%
tpcds_q70/datafusion:parquet 80644022 / 80309094 / +0.4% 97604665 / 96205564 / +1.5% 0.83 / 0.83 / -1.0%
tpcds_q71/datafusion:parquet 26047903 / 26378794 / -1.3% 38059780 / 36535778 / +4.2% 0.68 / 0.72 / -5.2%
tpcds_q72/datafusion:parquet 521822076 / 523601413 / -0.3% 559942484 / 583436914 / -4.0% 0.93 / 0.90 / +3.8%
tpcds_q73/datafusion:parquet 23873407 / 23839158 / +0.1% 35373844 / 34355275 / +3.0% 0.67 / 0.69 / -2.7%
tpcds_q74/datafusion:parquet 69188790 / 70856549 / -2.4% 90028674 / 88061670 / +2.2% 0.77 / 0.80 / -4.5%
tpcds_q75/datafusion:parquet 149739938 / 150404746 / -0.4% 183474957 / 177753680 / +3.2% 0.82 / 0.85 / -3.5%
tpcds_q76/datafusion:parquet 33225962 / 33225043 / +0.0% 46517531 / 45549452 / +2.1% 0.71 / 0.73 / -2.1%
tpcds_q77/datafusion:parquet 55493450 / 57303634 / -3.2% 70737370 / 73782792 / -4.1% 0.78 / 0.78 / +1.0%
tpcds_q78/datafusion:parquet 86808011 / 85105878 / +2.0% 119266492 / 116225473 / +2.6% 0.73 / 0.73 / -0.6%
tpcds_q79/datafusion:parquet 26626478 / 26704074 / -0.3% 41509086 / 40212229 / +3.2% 0.64 / 0.66 / -3.4%
tpcds_q80/datafusion:parquet 80211333 / 83477592 / -3.9% 108892594 / 107192135 / +1.6% 0.74 / 0.78 / -5.4%
tpcds_q81/datafusion:parquet 39055615 / 39686977 / -1.6% 49551663 / 51747166 / -4.2% 0.79 / 0.77 / +2.8%
tpcds_q82/datafusion:parquet 22342802 / 23009388 / -2.9% 36574299 / 34614799 / +5.7% 0.61 / 0.66 / -8.1%
tpcds_q83/datafusion:parquet 58241293 / 58909965 / -1.1% 76468917 / 73826332 / +3.6% 0.76 / 0.80 / -4.6%
tpcds_q84/datafusion:parquet 25650070 / 25918893 / -1.0% 38627794 / 40622201 / -4.9% 0.66 / 0.64 / +4.1%
tpcds_q85/datafusion:parquet 80418088 / 80694970 / -0.3% 102192414 / 101077867 / +1.1% 0.79 / 0.80 / -1.4%
tpcds_q86/datafusion:parquet 20868770 / 20530568 / +1.6% 33171618 / 31857609 / +4.1% 0.63 / 0.64 / -2.4%
tpcds_q87/datafusion:parquet 43731408 / 44781386 / -2.3% 60129191 / 60416390 / -0.5% 0.73 / 0.74 / -1.9%
tpcds_q88/datafusion:parquet 37188570 / 37861734 / -1.8% 50695418 / 49846716 / +1.7% 0.73 / 0.76 / -3.4%
tpcds_q89/datafusion:parquet 25997022 / 25769675 / +0.9% 41350663 / 39909037 / +3.6% 0.63 / 0.65 / -2.6%
tpcds_q90/datafusion:parquet 15663440 / 15570166 / +0.6% 28005816 / 24744978 / +13.2% 🔴 0.56 / 0.63 / -11.1%
tpcds_q91/datafusion:parquet 32863818 / 32211806 / +2.0% 47128673 / 45217706 / +4.2% 0.70 / 0.71 / -2.1%
tpcds_q92/datafusion:parquet 26854776 / 26828536 / +0.1% 39731123 / 38993510 / +1.9% 0.68 / 0.69 / -1.8%
tpcds_q93/datafusion:parquet 26944970 / 27430758 / -1.8% 44037504 / 45210717 / -2.6% 0.61 / 0.61 / +0.8%
tpcds_q94/datafusion:parquet 35227390 / 35546988 / -0.9% 49309339 / 47243010 / +4.4% 0.71 / 0.75 / -5.1%
tpcds_q95/datafusion:parquet 65944796 / 64134564 / +2.8% 80437723 / 78226307 / +2.8% 0.82 / 0.82 / -0.0%
tpcds_q96/datafusion:parquet 13049112 / 12824312 / +1.8% 23784851 / 23084977 / +3.0% 0.55 / 0.56 / -1.2%
tpcds_q97/datafusion:parquet 35393780 / 34894822 / +1.4% 51549833 / 50454775 / +2.2% 0.69 / 0.69 / -0.7%
tpcds_q98/datafusion:parquet 24683090 / 25115166 / -1.7% 38869819 / 36482859 / +6.5% 0.64 / 0.69 / -7.8%
tpcds_q99/datafusion:parquet 30257705 / 29768986 / +1.6% 42335098 / 40563375 / +4.4% 0.71 / 0.73 / -2.6%
duckdb / vortex-file-compressed / ns (0.997x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16063109 / 15953772 / +0.7% 24679284 / 25013125 / -1.3% 0.65 / 0.64 / +2.0%
tpcds_q02/duckdb:vortex-file-compressed 15217688 / 17121584 / -11.1% 🟢 22641936 / 22443822 / +0.9% 0.67 / 0.76 / -11.9%
tpcds_q03/duckdb:vortex-file-compressed 7074638 / 7124044 / -0.7% 16016014 / 15560714 / +2.9% 0.44 / 0.46 / -3.5%
tpcds_q04/duckdb:vortex-file-compressed 59535217 / 58861696 / +1.1% 70739200 / 72542009 / -2.5% 0.84 / 0.81 / +3.7%
tpcds_q05/duckdb:vortex-file-compressed 22961167 / 22944917 / +0.1% 32546684 / 32600827 / -0.2% 0.71 / 0.70 / +0.2%
tpcds_q06/duckdb:vortex-file-compressed 24670378 / 24598978 / +0.3% 37658205 / 38160211 / -1.3% 0.66 / 0.64 / +1.6%
tpcds_q07/duckdb:vortex-file-compressed 22435286 / 22402274 / +0.1% 35084128 / 34328161 / +2.2% 0.64 / 0.65 / -2.0%
tpcds_q08/duckdb:vortex-file-compressed 17317114 / 17520329 / -1.2% 25527493 / 25556791 / -0.1% 0.68 / 0.69 / -1.0%
tpcds_q09/duckdb:vortex-file-compressed 18840608 / 19142297 / -1.6% 30850992 / 29546038 / +4.4% 0.61 / 0.65 / -5.7%
tpcds_q10/duckdb:vortex-file-compressed 27238658 / 27522976 / -1.0% 41887989 / 39860781 / +5.1% 0.65 / 0.69 / -5.8%
tpcds_q11/duckdb:vortex-file-compressed 36824473 / 36196408 / +1.7% 44899913 / 45253189 / -0.8% 0.82 / 0.80 / +2.5%
tpcds_q12/duckdb:vortex-file-compressed 9833044 / 9840502 / -0.1% 16678305 / 16244582 / +2.7% 0.59 / 0.61 / -2.7%
tpcds_q13/duckdb:vortex-file-compressed 21223298 / 21208502 / +0.1% 33078741 / 32816040 / +0.8% 0.64 / 0.65 / -0.7%
tpcds_q14/duckdb:vortex-file-compressed 56024440 / 56631440 / -1.1% 66664283 / 66372102 / +0.4% 0.84 / 0.85 / -1.5%
tpcds_q15/duckdb:vortex-file-compressed 11261004 / 11362904 / -0.9% 18667452 / 17561053 / +6.3% 0.60 / 0.65 / -6.8%
tpcds_q16/duckdb:vortex-file-compressed 24688853 / 24521268 / +0.7% 35538968 / 34812969 / +2.1% 0.69 / 0.70 / -1.4%
tpcds_q17/duckdb:vortex-file-compressed 20812074 / 20950260 / -0.7% 32804693 / 31929671 / +2.7% 0.63 / 0.66 / -3.3%
tpcds_q18/duckdb:vortex-file-compressed 32562364 / 32759293 / -0.6% 43575698 / 44163439 / -1.3% 0.75 / 0.74 / +0.7%
tpcds_q19/duckdb:vortex-file-compressed 20794706 / 20976120 / -0.9% 30006885 / 28736782 / +4.4% 0.69 / 0.73 / -5.1%
tpcds_q20/duckdb:vortex-file-compressed 10619981 / 10664722 / -0.4% 17649832 / 16950874 / +4.1% 0.60 / 0.63 / -4.4%
tpcds_q21/duckdb:vortex-file-compressed 9244450 / 9024054 / +2.4% 22277936 / 21277408 / +4.7% 0.41 / 0.42 / -2.2%
tpcds_q22/duckdb:vortex-file-compressed 17576926 / 17673086 / -0.5% 30537964 / 29117361 / +4.9% 0.58 / 0.61 / -5.2%
tpcds_q23/duckdb:vortex-file-compressed 36928601 / 37560876 / -1.7% 48756777 / 48143340 / +1.3% 0.76 / 0.78 / -2.9%
tpcds_q24/duckdb:vortex-file-compressed 26733280 / 26376876 / +1.4% 36427147 / 37035515 / -1.6% 0.73 / 0.71 / +3.0%
tpcds_q25/duckdb:vortex-file-compressed 19806955 / 19674266 / +0.7% 32747718 / 31184656 / +5.0% 0.60 / 0.63 / -4.1%
tpcds_q26/duckdb:vortex-file-compressed 21883142 / 21904666 / -0.1% 32917902 / 31441626 / +4.7% 0.66 / 0.70 / -4.6%
tpcds_q27/duckdb:vortex-file-compressed 25075871 / 25168732 / -0.4% 37217439 / 35423992 / +5.1% 0.67 / 0.71 / -5.2%
tpcds_q28/duckdb:vortex-file-compressed 15287399 / 15740020 / -2.9% 25463870 / 25043044 / +1.7% 0.60 / 0.63 / -4.5%
tpcds_q29/duckdb:vortex-file-compressed 18934293 / 19007762 / -0.4% 30706938 / 30740769 / -0.1% 0.62 / 0.62 / -0.3%
tpcds_q30/duckdb:vortex-file-compressed 18648367 / 18629136 / +0.1% 27041595 / 26664191 / +1.4% 0.69 / 0.70 / -1.3%
tpcds_q31/duckdb:vortex-file-compressed 17745374 / 17813425 / -0.4% 26831465 / 26551593 / +1.1% 0.66 / 0.67 / -1.4%
tpcds_q32/duckdb:vortex-file-compressed 10138388 / 10440628 / -2.9% 18447973 / 18071214 / +2.1% 0.55 / 0.58 / -4.9%
tpcds_q33/duckdb:vortex-file-compressed 17584779 / 17837255 / -1.4% 27992982 / 28222694 / -0.8% 0.63 / 0.63 / -0.6%
tpcds_q34/duckdb:vortex-file-compressed 13122062 / 13079182 / +0.3% 22764968 / 22080488 / +3.1% 0.58 / 0.59 / -2.7%
tpcds_q35/duckdb:vortex-file-compressed 31654072 / 31877513 / -0.7% 44393671 / 43658264 / +1.7% 0.71 / 0.73 / -2.3%
tpcds_q36/duckdb:vortex-file-compressed 14156183 / 14403142 / -1.7% 24233775 / 23712304 / +2.2% 0.58 / 0.61 / -3.8%
tpcds_q37/duckdb:vortex-file-compressed 9328120 / 9503477 / -1.8% 23865704 / 23575821 / +1.2% 0.39 / 0.40 / -3.0%
tpcds_q38/duckdb:vortex-file-compressed 24550202 / 24340566 / +0.9% 32556316 / 31392218 / +3.7% 0.75 / 0.78 / -2.7%
tpcds_q39/duckdb:vortex-file-compressed 18361580 / 19049525 / -3.6% 32362425 / 31695660 / +2.1% 0.57 / 0.60 / -5.6%
tpcds_q40/duckdb:vortex-file-compressed 11354340 / 11414688 / -0.5% 19441922 / 19532067 / -0.5% 0.58 / 0.58 / -0.1%
tpcds_q41/duckdb:vortex-file-compressed 18751444 / 18734954 / +0.1% 25427923 / 25638904 / -0.8% 0.74 / 0.73 / +0.9%
tpcds_q42/duckdb:vortex-file-compressed 7023290 / 7099938 / -1.1% 15980387 / 15867910 / +0.7% 0.44 / 0.45 / -1.8%
tpcds_q43/duckdb:vortex-file-compressed 9766552 / 9868636 / -1.0% 19026898 / 18750869 / +1.5% 0.51 / 0.53 / -2.5%
tpcds_q44/duckdb:vortex-file-compressed 12668250 / 12677898 / -0.1% 24625730 / 23646044 / +4.1% 0.51 / 0.54 / -4.1%
tpcds_q45/duckdb:vortex-file-compressed 23655516 / 23796971 / -0.6% 31675324 / 29954426 / +5.7% 0.75 / 0.79 / -6.0%
tpcds_q46/duckdb:vortex-file-compressed 32051887 / 31814412 / +0.7% 44678016 / 43142831 / +3.6% 0.72 / 0.74 / -2.7%
tpcds_q47/duckdb:vortex-file-compressed 31311480 / 31401817 / -0.3% 41759524 / 40598592 / +2.9% 0.75 / 0.77 / -3.1%
tpcds_q48/duckdb:vortex-file-compressed 23221928 / 23490103 / -1.1% 36214029 / 34780709 / +4.1% 0.64 / 0.68 / -5.1%
tpcds_q49/duckdb:vortex-file-compressed 18987994 / 18877164 / +0.6% 30016097 / 29466551 / +1.9% 0.63 / 0.64 / -1.3%
tpcds_q50/duckdb:vortex-file-compressed 15442749 / 15388245 / +0.4% 25588468 / 25270579 / +1.3% 0.60 / 0.61 / -0.9%
tpcds_q51/duckdb:vortex-file-compressed 49426355 / 49002644 / +0.9% 58170754 / 76789180 / -24.2% 🟢 0.85 / 0.64 / +33.1%
tpcds_q52/duckdb:vortex-file-compressed 7244866 / 7119720 / +1.8% 15565976 / 15727256 / -1.0% 0.47 / 0.45 / +2.8%
tpcds_q53/duckdb:vortex-file-compressed 11548024 / 11405624 / +1.2% 20473718 / 20444917 / +0.1% 0.56 / 0.56 / +1.1%
tpcds_q54/duckdb:vortex-file-compressed 19768351 / 20086938 / -1.6% 31071966 / 29306434 / +6.0% 0.64 / 0.69 / -7.2%
tpcds_q55/duckdb:vortex-file-compressed 6943425 / 6800165 / +2.1% 15422466 / 15006336 / +2.8% 0.45 / 0.45 / -0.6%
tpcds_q56/duckdb:vortex-file-compressed 17901960 / 17929666 / -0.2% 27696706 / 28163968 / -1.7% 0.65 / 0.64 / +1.5%
tpcds_q57/duckdb:vortex-file-compressed 25981758 / 25849308 / +0.5% 34916516 / 34499824 / +1.2% 0.74 / 0.75 / -0.7%
tpcds_q58/duckdb:vortex-file-compressed 20688520 / 20284668 / +2.0% 29957420 / 30646112 / -2.2% 0.69 / 0.66 / +4.3%
tpcds_q59/duckdb:vortex-file-compressed 19897864 / 19640982 / +1.3% 27142706 / 26574424 / +2.1% 0.73 / 0.74 / -0.8%
tpcds_q60/duckdb:vortex-file-compressed 18349526 / 18265058 / +0.5% 29756357 / 28149215 / +5.7% 0.62 / 0.65 / -5.0%
tpcds_q61/duckdb:vortex-file-compressed 20211104 / 19639240 / +2.9% 30023418 / 30432532 / -1.3% 0.67 / 0.65 / +4.3%
tpcds_q62/duckdb:vortex-file-compressed 10951446 / 11077652 / -1.1% 17596339 / 17730136 / -0.8% 0.62 / 0.62 / -0.4%
tpcds_q63/duckdb:vortex-file-compressed 11085145 / 11033870 / +0.5% 19861114 / 19183256 / +3.5% 0.56 / 0.58 / -3.0%
tpcds_q64/duckdb:vortex-file-compressed 53261231 / 53230326 / +0.1% 71328176 / 68679000 / +3.9% 0.75 / 0.78 / -3.7%
tpcds_q65/duckdb:vortex-file-compressed 13223397 / 13200120 / +0.2% 23811382 / 22840801 / +4.2% 0.56 / 0.58 / -3.9%
tpcds_q66/duckdb:vortex-file-compressed 31116213 / 31871876 / -2.4% 39449222 / 37479910 / +5.3% 0.79 / 0.85 / -7.2%
tpcds_q67/duckdb:vortex-file-compressed 55461782 / 55089795 / +0.7% 64552439 / 65493052 / -1.4% 0.86 / 0.84 / +2.1%
tpcds_q68/duckdb:vortex-file-compressed 23054118 / 23225652 / -0.7% 36036025 / 34562447 / +4.3% 0.64 / 0.67 / -4.8%
tpcds_q69/duckdb:vortex-file-compressed 23065165 / 22783279 / +1.2% 37555877 / 36970911 / +1.6% 0.61 / 0.62 / -0.3%
tpcds_q70/duckdb:vortex-file-compressed 14677569 / 15103216 / -2.8% 26540138 / 25794081 / +2.9% 0.55 / 0.59 / -5.6%
tpcds_q71/duckdb:vortex-file-compressed 13188843 / 14357722 / -8.1% 23866918 / 23194397 / +2.9% 0.55 / 0.62 / -10.7%
tpcds_q72/duckdb:vortex-file-compressed 42954100 / 43660776 / -1.6% 57502530 / 55122871 / +4.3% 0.75 / 0.79 / -5.7%
tpcds_q73/duckdb:vortex-file-compressed 12017348 / 12236326 / -1.8% 21210454 / 20728732 / +2.3% 0.57 / 0.59 / -4.0%
tpcds_q74/duckdb:vortex-file-compressed 31278132 / 30890622 / +1.3% 39975978 / 40641900 / -1.6% 0.78 / 0.76 / +2.9%
tpcds_q75/duckdb:vortex-file-compressed 37936546 / 37418102 / +1.4% 50599535 / 49772663 / +1.7% 0.75 / 0.75 / -0.3%
tpcds_q76/duckdb:vortex-file-compressed 13005454 / 12701282 / +2.4% 22694150 / 22292205 / +1.8% 0.57 / 0.57 / +0.6%
tpcds_q77/duckdb:vortex-file-compressed 20162958 / 20491981 / -1.6% 32129916 / 31223717 / +2.9% 0.63 / 0.66 / -4.4%
tpcds_q78/duckdb:vortex-file-compressed 43157712 / 43625494 / -1.1% 55399763 / 53198491 / +4.1% 0.78 / 0.82 / -5.0%
tpcds_q79/duckdb:vortex-file-compressed 17445224 / 17361032 / +0.5% 28365668 / 27561528 / +2.9% 0.62 / 0.63 / -2.4%
tpcds_q80/duckdb:vortex-file-compressed 29628339 / 29495045 / +0.5% 44971880 / 42433212 / +6.0% 0.66 / 0.70 / -5.2%
tpcds_q81/duckdb:vortex-file-compressed 21446485 / 21219116 / +1.1% 30564079 / 30136965 / +1.4% 0.70 / 0.70 / -0.3%
tpcds_q82/duckdb:vortex-file-compressed 9591461 / 9474252 / +1.2% 24284489 / 23668075 / +2.6% 0.39 / 0.40 / -1.3%
tpcds_q83/duckdb:vortex-file-compressed 17789500 / 17683760 / +0.6% 24699383 / 24635984 / +0.3% 0.72 / 0.72 / +0.3%
tpcds_q84/duckdb:vortex-file-compressed 15597045 / 15284074 / +2.0% 23441380 / 23572165 / -0.6% 0.67 / 0.65 / +2.6%
tpcds_q85/duckdb:vortex-file-compressed 26015918 / 26204141 / -0.7% 37634575 / 37405717 / +0.6% 0.69 / 0.70 / -1.3%
tpcds_q86/duckdb:vortex-file-compressed 9763818 / 9812106 / -0.5% 16858663 / 16480721 / +2.3% 0.58 / 0.60 / -2.7%
tpcds_q87/duckdb:vortex-file-compressed 26017080 / 25892313 / +0.5% 33788244 / 34048349 / -0.8% 0.77 / 0.76 / +1.3%
tpcds_q88/duckdb:vortex-file-compressed 30359836 / 30251614 / +0.4% 37515816 / 37429514 / +0.2% 0.81 / 0.81 / +0.1%
tpcds_q89/duckdb:vortex-file-compressed 11942540 / 11979299 / -0.3% 20796546 / 20832354 / -0.2% 0.57 / 0.58 / -0.1%
tpcds_q90/duckdb:vortex-file-compressed 8074511 / 8058578 / +0.2% 15464659 / 15298660 / +1.1% 0.52 / 0.53 / -0.9%
tpcds_q91/duckdb:vortex-file-compressed 15323684 / 15119958 / +1.3% 24141690 / 23284748 / +3.7% 0.63 / 0.65 / -2.3%
tpcds_q92/duckdb:vortex-file-compressed 10400561 / 10506476 / -1.0% 18123366 / 17936968 / +1.0% 0.57 / 0.59 / -2.0%
tpcds_q93/duckdb:vortex-file-compressed 10284748 / 10449056 / -1.6% 23813095 / 22884891 / +4.1% 0.43 / 0.46 / -5.4%
tpcds_q94/duckdb:vortex-file-compressed 22195191 / 22130758 / +0.3% 33142871 / 31984780 / +3.6% 0.67 / 0.69 / -3.2%
tpcds_q95/duckdb:vortex-file-compressed 60985816 / 61071074 / -0.1% 68462711 / 68603704 / -0.2% 0.89 / 0.89 / +0.1%
tpcds_q96/duckdb:vortex-file-compressed 7063836 / 6914928 / +2.2% 15173137 / 15066854 / +0.7% 0.47 / 0.46 / +1.4%
tpcds_q97/duckdb:vortex-file-compressed 23458970 / 23370455 / +0.4% 32936145 / 32787742 / +0.5% 0.71 / 0.71 / -0.1%
tpcds_q98/duckdb:vortex-file-compressed 10976841 / 10993800 / -0.2% 19616319 / 19750801 / -0.7% 0.56 / 0.56 / +0.5%
tpcds_q99/duckdb:vortex-file-compressed 14552667 / 14480050 / +0.5% 22522769 / 22268001 / +1.1% 0.65 / 0.65 / -0.6%
duckdb / parquet / ns (0.999x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23821942 / 24070956 / -1.0% 30749091 / 30859035 / -0.4% 0.77 / 0.78 / -0.7%
tpcds_q02/duckdb:parquet 17677492 / 17921268 / -1.4% 24072560 / 23828838 / +1.0% 0.73 / 0.75 / -2.4%
tpcds_q03/duckdb:parquet 9680157 / 9942168 / -2.6% 15468526 / 15647896 / -1.1% 0.63 / 0.64 / -1.5%
tpcds_q04/duckdb:parquet 117624975 / 118090616 / -0.4% 127092037 / 127628955 / -0.4% 0.93 / 0.93 / +0.0%
tpcds_q05/duckdb:parquet 28224542 / 28294228 / -0.2% 32538956 / 33187125 / -2.0% 0.87 / 0.85 / +1.7%
tpcds_q06/duckdb:parquet 26585897 / 26338990 / +0.9% 35321877 / 35810585 / -1.4% 0.75 / 0.74 / +2.3%
tpcds_q07/duckdb:parquet 30801152 / 33172784 / -7.1% 38893604 / 38107452 / +2.1% 0.79 / 0.87 / -9.0%
tpcds_q08/duckdb:parquet 19668471 / 19785004 / -0.6% 24516502 / 26130734 / -6.2% 0.80 / 0.76 / +6.0%
tpcds_q09/duckdb:parquet 27034096 / 26841492 / +0.7% 30213137 / 30248636 / -0.1% 0.89 / 0.89 / +0.8%
tpcds_q10/duckdb:parquet 32503532 / 32351796 / +0.5% 40216102 / 39977609 / +0.6% 0.81 / 0.81 / -0.1%
tpcds_q11/duckdb:parquet 68648254 / 70568704 / -2.7% 77233964 / 74038155 / +4.3% 0.89 / 0.95 / -6.7%
tpcds_q12/duckdb:parquet 13875224 / 13935627 / -0.4% 19081733 / 18959477 / +0.6% 0.73 / 0.74 / -1.1%
tpcds_q13/duckdb:parquet 30171035 / 31860206 / -5.3% 39426988 / 39121931 / +0.8% 0.77 / 0.81 / -6.0%
tpcds_q14/duckdb:parquet 63541642 / 64968352 / -2.2% 68172326 / 68712195 / -0.8% 0.93 / 0.95 / -1.4%
tpcds_q15/duckdb:parquet 16629432 / 16576300 / +0.3% 22468138 / 22748885 / -1.2% 0.74 / 0.73 / +1.6%
tpcds_q16/duckdb:parquet 30004410 / 30361750 / -1.2% 37136831 / 36932337 / +0.6% 0.81 / 0.82 / -1.7%
tpcds_q17/duckdb:parquet 34487142 / 34647794 / -0.5% 39942890 / 39978582 / -0.1% 0.86 / 0.87 / -0.4%
tpcds_q18/duckdb:parquet 47208792 / 47208678 / +0.0% 54629855 / 54812018 / -0.3% 0.86 / 0.86 / +0.3%
tpcds_q19/duckdb:parquet 20134680 / 19104286 / +5.4% 25672440 / 25501981 / +0.7% 0.78 / 0.75 / +4.7%
tpcds_q20/duckdb:parquet 14652460 / 14962390 / -2.1% 19445162 / 19750299 / -1.5% 0.75 / 0.76 / -0.5%
tpcds_q21/duckdb:parquet 10411800 / 10312510 / +1.0% 17142631 / 16683658 / +2.8% 0.61 / 0.62 / -1.7%
tpcds_q22/duckdb:parquet 20627595 / 20523702 / +0.5% 26356196 / 26521182 / -0.6% 0.78 / 0.77 / +1.1%
tpcds_q23/duckdb:parquet 46169762 / 43507112 / +6.1% 46793432 / 47136764 / -0.7% 0.99 / 0.92 / +6.9%
tpcds_q24/duckdb:parquet 30063068 / 30370492 / -1.0% 36277757 / 36341377 / -0.2% 0.83 / 0.84 / -0.8%
tpcds_q25/duckdb:parquet 30415344 / 30303134 / +0.4% 36914547 / 36838435 / +0.2% 0.82 / 0.82 / +0.2%
tpcds_q26/duckdb:parquet 28760684 / 29119819 / -1.2% 35666753 / 34567982 / +3.2% 0.81 / 0.84 / -4.3%
tpcds_q27/duckdb:parquet 35155080 / 32980272 / +6.6% 41695437 / 41249906 / +1.1% 0.84 / 0.80 / +5.5%
tpcds_q28/duckdb:parquet 26356688 / 26647724 / -1.1% 32863610 / 33453479 / -1.8% 0.80 / 0.80 / +0.7%
tpcds_q29/duckdb:parquet 32302580 / 32332114 / -0.1% 39005749 / 39139817 / -0.3% 0.83 / 0.83 / +0.3%
tpcds_q30/duckdb:parquet 35471782 / 35467023 / +0.0% 44507507 / 43891986 / +1.4% 0.80 / 0.81 / -1.4%
tpcds_q31/duckdb:parquet 36979628 / 35584535 / +3.9% 43259539 / 42704335 / +1.3% 0.85 / 0.83 / +2.6%
tpcds_q32/duckdb:parquet 14227726 / 14089456 / +1.0% 20709623 / 20702073 / +0.0% 0.69 / 0.68 / +0.9%
tpcds_q33/duckdb:parquet 23543444 / 23357331 / +0.8% 28937785 / 28431939 / +1.8% 0.81 / 0.82 / -1.0%
tpcds_q34/duckdb:parquet 16781714 / 19897332 / -15.7% 🟢 24401135 / 23952667 / +1.9% 0.69 / 0.83 / -17.2%
tpcds_q35/duckdb:parquet 35058343 / 35431210 / -1.1% 44410578 / 43942782 / +1.1% 0.79 / 0.81 / -2.1%
tpcds_q36/duckdb:parquet 42263443 / 39748434 / +6.3% 47654372 / 47143136 / +1.1% 0.89 / 0.84 / +5.2%
tpcds_q37/duckdb:parquet 12547578 / 12739226 / -1.5% 19357389 / 19112499 / +1.3% 0.65 / 0.67 / -2.8%
tpcds_q38/duckdb:parquet 29744208 / 29544976 / +0.7% 33531210 / 33148852 / +1.2% 0.89 / 0.89 / -0.5%
tpcds_q39/duckdb:parquet 23229302 / 23368743 / -0.6% 29900883 / 28610715 / +4.5% 0.78 / 0.82 / -4.9%
tpcds_q40/duckdb:parquet 15892685 / 15911014 / -0.1% 21190182 / 21387442 / -0.9% 0.75 / 0.74 / +0.8%
tpcds_q41/duckdb:parquet 11939844 / 11956386 / -0.1% 17809457 / 18201423 / -2.2% 0.67 / 0.66 / +2.1%
tpcds_q42/duckdb:parquet 10131774 / 9522857 / +6.4% 15365041 / 15612245 / -1.6% 0.66 / 0.61 / +8.1%
tpcds_q43/duckdb:parquet 11896352 / 12065858 / -1.4% 17996171 / 18349058 / -1.9% 0.66 / 0.66 / +0.5%
tpcds_q44/duckdb:parquet 20657368 / 21128538 / -2.2% 26850362 / 27025632 / -0.6% 0.77 / 0.78 / -1.6%
tpcds_q45/duckdb:parquet 20851244 / 21025461 / -0.8% 27407410 / 27702115 / -1.1% 0.76 / 0.76 / +0.2%
tpcds_q46/duckdb:parquet 36730494 / 35248552 / +4.2% 43967782 / 43381315 / +1.4% 0.84 / 0.81 / +2.8%
tpcds_q47/duckdb:parquet 34296500 / 34917200 / -1.8% 41705823 / 40990081 / +1.7% 0.82 / 0.85 / -3.5%
tpcds_q48/duckdb:parquet 30245364 / 29122536 / +3.9% 36525835 / 37555584 / -2.7% 0.83 / 0.78 / +6.8%
tpcds_q49/duckdb:parquet 31410891 / 31270839 / +0.4% 36195465 / 35904304 / +0.8% 0.87 / 0.87 / -0.4%
tpcds_q50/duckdb:parquet 19115549 / 19337722 / -1.1% 25579547 / 25415678 / +0.6% 0.75 / 0.76 / -1.8%
tpcds_q51/duckdb:parquet 51943606 / 52435530 / -0.9% 78053005 / 59966205 / +30.2% 🔴 0.67 / 0.87 / -23.9%
tpcds_q52/duckdb:parquet 10229926 / 9581956 / +6.8% 15649085 / 15590548 / +0.4% 0.65 / 0.61 / +6.4%
tpcds_q53/duckdb:parquet 13918344 / 13979666 / -0.4% 20802934 / 20710381 / +0.4% 0.67 / 0.68 / -0.9%
tpcds_q54/duckdb:parquet 24677409 / 24951378 / -1.1% 32152271 / 32112905 / +0.1% 0.77 / 0.78 / -1.2%
tpcds_q55/duckdb:parquet 9392692 / 9475078 / -0.9% 15199342 / 15041904 / +1.0% 0.62 / 0.63 / -1.9%
tpcds_q56/duckdb:parquet 25040694 / 26731006 / -6.3% 30537662 / 30323232 / +0.7% 0.82 / 0.88 / -7.0%
tpcds_q57/duckdb:parquet 30479595 / 30719723 / -0.8% 36681614 / 35707723 / +2.7% 0.83 / 0.86 / -3.4%
tpcds_q58/duckdb:parquet 24316891 / 23757554 / +2.4% 29590221 / 29570423 / +0.1% 0.82 / 0.80 / +2.3%
tpcds_q59/duckdb:parquet 22721158 / 22919332 / -0.9% 29188992 / 28835585 / +1.2% 0.78 / 0.79 / -2.1%
tpcds_q60/duckdb:parquet 27563868 / 27219899 / +1.3% 32295941 / 31977324 / +1.0% 0.85 / 0.85 / +0.3%
tpcds_q61/duckdb:parquet 24735315 / 23685158 / +4.4% 28729033 / 29346610 / -2.1% 0.86 / 0.81 / +6.7%
tpcds_q62/duckdb:parquet 12629655 / 12657429 / -0.2% 18095489 / 17725403 / +2.1% 0.70 / 0.71 / -2.3%
tpcds_q63/duckdb:parquet 13216756 / 13215819 / +0.0% 19917011 / 19974092 / -0.3% 0.66 / 0.66 / +0.3%
tpcds_q64/duckdb:parquet 70343256 / 69896589 / +0.6% 80687706 / 78769253 / +2.4% 0.87 / 0.89 / -1.8%
tpcds_q65/duckdb:parquet 20998726 / 18668131 / +12.5% 🔴 25721144 / 26157537 / -1.7% 0.82 / 0.71 / +14.4%
tpcds_q66/duckdb:parquet 33029918 / 32929260 / +0.3% 37645005 / 37815986 / -0.5% 0.88 / 0.87 / +0.8%
tpcds_q67/duckdb:parquet 60620480 / 61308414 / -1.1% 67394585 / 68582776 / -1.7% 0.90 / 0.89 / +0.6%
tpcds_q68/duckdb:parquet 27994592 / 30340937 / -7.7% 36411248 / 35484920 / +2.6% 0.77 / 0.86 / -10.1%
tpcds_q69/duckdb:parquet 26125280 / 26128396 / -0.0% 34302732 / 34075457 / +0.7% 0.76 / 0.77 / -0.7%
tpcds_q70/duckdb:parquet 19136444 / 19202630 / -0.3% 26648292 / 26899209 / -0.9% 0.72 / 0.71 / +0.6%
tpcds_q71/duckdb:parquet 17062213 / 17676427 / -3.5% 23947623 / 23540304 / +1.7% 0.71 / 0.75 / -5.1%
tpcds_q72/duckdb:parquet 52651264 / 53451211 / -1.5% 59595704 / 59511416 / +0.1% 0.88 / 0.90 / -1.6%
tpcds_q73/duckdb:parquet 14792866 / 14787876 / +0.0% 21666719 / 21563141 / +0.5% 0.68 / 0.69 / -0.4%
tpcds_q74/duckdb:parquet 84660070 / 85227503 / -0.7% 91390280 / 90864591 / +0.6% 0.93 / 0.94 / -1.2%
tpcds_q75/duckdb:parquet 42735739 / 43355311 / -1.4% 49763639 / 50260228 / -1.0% 0.86 / 0.86 / -0.4%
tpcds_q76/duckdb:parquet 18028149 / 17845388 / +1.0% 22633628 / 23831646 / -5.0% 0.80 / 0.75 / +6.4%
tpcds_q77/duckdb:parquet 25956606 / 25360026 / +2.4% 30970374 / 30494833 / +1.6% 0.84 / 0.83 / +0.8%
tpcds_q78/duckdb:parquet 78216982 / 78016011 / +0.3% 84259039 / 85486024 / -1.4% 0.93 / 0.91 / +1.7%
tpcds_q79/duckdb:parquet 22594908 / 23799300 / -5.1% 28903564 / 28667630 / +0.8% 0.78 / 0.83 / -5.8%
tpcds_q80/duckdb:parquet 37101380 / 37165228 / -0.2% 44059959 / 43933389 / +0.3% 0.84 / 0.85 / -0.5%
tpcds_q81/duckdb:parquet 36038661 / 36148564 / -0.3% 44744497 / 44616019 / +0.3% 0.81 / 0.81 / -0.6%
tpcds_q82/duckdb:parquet 13381982 / 13343395 / +0.3% 20581385 / 20395034 / +0.9% 0.65 / 0.65 / -0.6%
tpcds_q83/duckdb:parquet 20131526 / 20106906 / +0.1% 25000470 / 24719855 / +1.1% 0.81 / 0.81 / -1.0%
tpcds_q84/duckdb:parquet 22762542 / 23063076 / -1.3% 28768374 / 28658235 / +0.4% 0.79 / 0.80 / -1.7%
tpcds_q85/duckdb:parquet 32044068 / 32373871 / -1.0% 39173776 / 39169632 / +0.0% 0.82 / 0.83 / -1.0%
tpcds_q86/duckdb:parquet 11707138 / 11865449 / -1.3% 17053125 / 16685674 / +2.2% 0.69 / 0.71 / -3.5%
tpcds_q87/duckdb:parquet 31320632 / 31336628 / -0.1% 35265732 / 34964257 / +0.9% 0.89 / 0.90 / -0.9%
tpcds_q88/duckdb:parquet 38546646 / 38083140 / +1.2% 42905888 / 41359240 / +3.7% 0.90 / 0.92 / -2.4%
tpcds_q89/duckdb:parquet 14907748 / 14417820 / +3.4% 21178188 / 21195171 / -0.1% 0.70 / 0.68 / +3.5%
tpcds_q90/duckdb:parquet 10017963 / 10062314 / -0.4% 14600056 / 15319330 / -4.7% 0.69 / 0.66 / +4.5%
tpcds_q91/duckdb:parquet 20979997 / 20977450 / +0.0% 28257900 / 28009436 / +0.9% 0.74 / 0.75 / -0.9%
tpcds_q92/duckdb:parquet 15510468 / 15613113 / -0.7% 21620586 / 22847976 / -5.4% 0.72 / 0.68 / +5.0%
tpcds_q93/duckdb:parquet 14123750 / 14097048 / +0.2% 20198072 / 20489281 / -1.4% 0.70 / 0.69 / +1.6%
tpcds_q94/duckdb:parquet 25516196 / 25307830 / +0.8% 32223172 / 32640247 / -1.3% 0.79 / 0.78 / +2.1%
tpcds_q95/duckdb:parquet 43755328 / 43918900 / -0.4% 49223913 / 49659201 / -0.9% 0.89 / 0.88 / +0.5%
tpcds_q96/duckdb:parquet 8284132 / 8184672 / +1.2% 13624040 / 14295524 / -4.7% 0.61 / 0.57 / +6.2%
tpcds_q97/duckdb:parquet 27493019 / 27464337 / +0.1% 33748015 / 33638061 / +0.3% 0.81 / 0.82 / -0.2%
tpcds_q98/duckdb:parquet 16367573 / 16539982 / -1.0% 23089954 / 23014936 / +0.3% 0.71 / 0.72 / -1.4%
tpcds_q99/duckdb:parquet 18595712 / 18797336 / -1.1% 24374315 / 24650910 / -1.1% 0.76 / 0.76 / +0.0%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 6e12746c vs base e59b236d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.008x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1235542 / 1242955 / -0.6% 23697122 / 23512749 / +0.8% 0.05 / 0.05 / -1.4%
clickbench_q01/datafusion:vortex-file-compressed 6208256 / 6244992 / -0.6% 31059432 / 30402955 / +2.2% 0.20 / 0.21 / -2.7%
clickbench_q02/datafusion:vortex-file-compressed 11042213 / 10875360 / +1.5% 48206188 / 43516242 / +10.8% 🔴 0.23 / 0.25 / -8.3%
clickbench_q03/datafusion:vortex-file-compressed 13373278 / 12621620 / +6.0% 55552530 / 55919858 / -0.7% 0.24 / 0.23 / +6.7%
clickbench_q04/datafusion:vortex-file-compressed 58030826 / 59085652 / -1.8% 103467146 / 102995400 / +0.5% 0.56 / 0.57 / -2.2%
clickbench_q05/datafusion:vortex-file-compressed 78262218 / 77061886 / +1.6% 127296003 / 127875225 / -0.5% 0.61 / 0.60 / +2.0%
clickbench_q06/datafusion:vortex-file-compressed 1221966 / 1251039 / -2.3% 22500426 / 23181006 / -2.9% 0.05 / 0.05 / +0.6%
clickbench_q07/datafusion:vortex-file-compressed 9243236 / 9702751 / -4.7% 34791194 / 34299707 / +1.4% 0.27 / 0.28 / -6.1%
clickbench_q08/datafusion:vortex-file-compressed 77666467 / 79747512 / -2.6% 125174539 / 125184654 / -0.0% 0.62 / 0.64 / -2.6%
clickbench_q09/datafusion:vortex-file-compressed 171522951 / 173851242 / -1.3% 205651930 / 214054641 / -3.9% 0.83 / 0.81 / +2.7%
clickbench_q10/datafusion:vortex-file-compressed 22763928 / 22847122 / -0.4% 69278479 / 71828577 / -3.6% 0.33 / 0.32 / +3.3%
clickbench_q11/datafusion:vortex-file-compressed 26343965 / 26347954 / -0.0% 72094750 / 72933575 / -1.2% 0.37 / 0.36 / +1.1%
clickbench_q12/datafusion:vortex-file-compressed 73013257 / 73525472 / -0.7% 127227574 / 126054250 / +0.9% 0.57 / 0.58 / -1.6%
clickbench_q13/datafusion:vortex-file-compressed 115255722 / 117237814 / -1.7% 181695461 / 188803464 / -3.8% 0.63 / 0.62 / +2.2%
clickbench_q14/datafusion:vortex-file-compressed 75715604 / 77180996 / -1.9% 128632488 / 128375762 / +0.2% 0.59 / 0.60 / -2.1%
clickbench_q15/datafusion:vortex-file-compressed 61930916 / 63160858 / -1.9% 102275453 / 104563007 / -2.2% 0.61 / 0.60 / +0.2%
clickbench_q16/datafusion:vortex-file-compressed 154531047 / 157108092 / -1.6% 214327199 / 220273728 / -2.7% 0.72 / 0.71 / +1.1%
clickbench_q17/datafusion:vortex-file-compressed 154047474 / 153061882 / +0.6% 222337979 / 223830754 / -0.7% 0.69 / 0.68 / +1.3%
clickbench_q18/datafusion:vortex-file-compressed 297800296 / 295506543 / +0.8% 383162500 / 385667944 / -0.6% 0.78 / 0.77 / +1.4%
clickbench_q19/datafusion:vortex-file-compressed 8233258 / 7813500 / +5.4% 51036322 / 47127278 / +8.3% 0.16 / 0.17 / -2.7%
clickbench_q20/datafusion:vortex-file-compressed 64972257 / 68266002 / -4.8% 248353066 / 251210339 / -1.1% 0.26 / 0.27 / -3.7%
clickbench_q21/datafusion:vortex-file-compressed 77978060 / 78116954 / -0.2% 290640752 / 290360506 / +0.1% 0.27 / 0.27 / -0.3%
clickbench_q22/datafusion:vortex-file-compressed 91934156 / 94040450 / -2.2% 392925781 / 397641889 / -1.2% 0.23 / 0.24 / -1.1%
clickbench_q23/datafusion:vortex-file-compressed 190610962 / 189535200 / +0.6% 548564647 / 557661210 / -1.6% 0.35 / 0.34 / +2.2%
clickbench_q24/datafusion:vortex-file-compressed 15535800 / 16307114 / -4.7% 69642270 / 72244414 / -3.6% 0.22 / 0.23 / -1.2%
clickbench_q25/datafusion:vortex-file-compressed 18638595 / 19770676 / -5.7% 62869577 / 65560635 / -4.1% 0.30 / 0.30 / -1.7%
clickbench_q26/datafusion:vortex-file-compressed 15418566 / 16054286 / -4.0% 70971479 / 71940283 / -1.3% 0.22 / 0.22 / -2.6%
clickbench_q27/datafusion:vortex-file-compressed 102451935 / 103297357 / -0.8% 260328727 / 257556842 / +1.1% 0.39 / 0.40 / -1.9%
clickbench_q28/datafusion:vortex-file-compressed 557862592 / 554543218 / +0.6% 639926038 / 674413163 / -5.1% 0.87 / 0.82 / +6.0%
clickbench_q29/datafusion:vortex-file-compressed 24087658 / 24279292 / -0.8% 58811588 / 54067929 / +8.8% 0.41 / 0.45 / -8.8%
clickbench_q30/datafusion:vortex-file-compressed 55115284 / 56520422 / -2.5% 110576299 / 118384741 / -6.6% 0.50 / 0.48 / +4.4%
clickbench_q31/datafusion:vortex-file-compressed 66682693 / 67031684 / -0.5% 160624676 / 160322155 / +0.2% 0.42 / 0.42 / -0.7%
clickbench_q32/datafusion:vortex-file-compressed 290539911 / 289277162 / +0.4% 382513863 / 386439689 / -1.0% 0.76 / 0.75 / +1.5%
clickbench_q33/datafusion:vortex-file-compressed 323336350 / 327736213 / -1.3% 436970363 / 442610672 / -1.3% 0.74 / 0.74 / -0.1%
clickbench_q34/datafusion:vortex-file-compressed 322316974 / 323009506 / -0.2% 436784931 / 433482809 / +0.8% 0.74 / 0.75 / -1.0%
clickbench_q35/datafusion:vortex-file-compressed 57341072 / 56654259 / +1.2% 95657079 / 95001872 / +0.7% 0.60 / 0.60 / +0.5%
clickbench_q36/datafusion:vortex-file-compressed 37891738 / 37560710 / +0.9% 69319432 / 68416613 / +1.3% 0.55 / 0.55 / -0.4%
clickbench_q37/datafusion:vortex-file-compressed 21024318 / 21322074 / -1.4% 48602096 / 47409031 / +2.5% 0.43 / 0.45 / -3.8%
clickbench_q38/datafusion:vortex-file-compressed 13078532 / 13565444 / -3.6% 42527965 / 41664694 / +2.1% 0.31 / 0.33 / -5.5%
clickbench_q39/datafusion:vortex-file-compressed 78415214 / 78988042 / -0.7% 113794673 / 112033544 / +1.6% 0.69 / 0.71 / -2.3%
clickbench_q40/datafusion:vortex-file-compressed 10753864 / 10771866 / -0.2% 36961434 / 37937410 / -2.6% 0.29 / 0.28 / +2.5%
clickbench_q41/datafusion:vortex-file-compressed 10046554 / 9820860 / +2.3% 36615738 / 35511644 / +3.1% 0.27 / 0.28 / -0.8%
clickbench_q42/datafusion:vortex-file-compressed 9970106 / 10264866 / -2.9% 37235056 / 36396066 / +2.3% 0.27 / 0.28 / -5.1%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1235492 / 1227152 / +0.7% 51007656 / 51700834 / -1.3% 0.02 / 0.02 / +2.0%
clickbench_q01/datafusion:parquet 16360654 / 16114996 / +1.5% 67804668 / 72554436 / -6.5% 0.24 / 0.22 / +8.6%
clickbench_q02/datafusion:parquet 18825712 / 18838890 / -0.1% 81782645 / 83280558 / -1.8% 0.23 / 0.23 / +1.8%
clickbench_q03/datafusion:parquet 16739513 / 17191384 / -2.6% 80803752 / 84730348 / -4.6% 0.21 / 0.20 / +2.1%
clickbench_q04/datafusion:parquet 63717959 / 64492746 / -1.2% 127958789 / 127815119 / +0.1% 0.50 / 0.50 / -1.3%
clickbench_q05/datafusion:parquet 88845684 / 88734590 / +0.1% 159566363 / 159841538 / -0.2% 0.56 / 0.56 / +0.3%
clickbench_q06/datafusion:parquet 1227074 / 1247832 / -1.7% 50214568 / 52208510 / -3.8% 0.02 / 0.02 / +2.2%
clickbench_q07/datafusion:parquet 16987794 / 17169600 / -1.1% 67719994 / 70823977 / -4.4% 0.25 / 0.24 / +3.5%
clickbench_q08/datafusion:parquet 85869719 / 84417224 / +1.7% 167530088 / 170512263 / -1.7% 0.51 / 0.50 / +3.5%
clickbench_q09/datafusion:parquet 185118670 / 189854110 / -2.5% 276666633 / 269389181 / +2.7% 0.67 / 0.70 / -5.1%
clickbench_q10/datafusion:parquet 35417953 / 36280391 / -2.4% 105648486 / 104136376 / +1.5% 0.34 / 0.35 / -3.8%
clickbench_q11/datafusion:parquet 42789118 / 43141239 / -0.8% 113599563 / 114008098 / -0.4% 0.38 / 0.38 / -0.5%
clickbench_q12/datafusion:parquet 95731494 / 96297858 / -0.6% 164369465 / 165975280 / -1.0% 0.58 / 0.58 / +0.4%
clickbench_q13/datafusion:parquet 149685579 / 147645650 / +1.4% 228361114 / 229982935 / -0.7% 0.66 / 0.64 / +2.1%
clickbench_q14/datafusion:parquet 102315998 / 100957322 / +1.3% 174009005 / 174797829 / -0.5% 0.59 / 0.58 / +1.8%
clickbench_q15/datafusion:parquet 71666646 / 70944676 / +1.0% 130599747 / 135363002 / -3.5% 0.55 / 0.52 / +4.7%
clickbench_q16/datafusion:parquet 157633437 / 156933628 / +0.4% 233150493 / 240530006 / -3.1% 0.68 / 0.65 / +3.6%
clickbench_q17/datafusion:parquet 155095841 / 157897523 / -1.8% 237805364 / 238191008 / -0.2% 0.65 / 0.66 / -1.6%
clickbench_q18/datafusion:parquet 311342539 / 314904853 / -1.1% 422967701 / 423401650 / -0.1% 0.74 / 0.74 / -1.0%
clickbench_q19/datafusion:parquet 19266789 / 19187194 / +0.4% 77432516 / 80783774 / -4.1% 0.25 / 0.24 / +4.8%
clickbench_q20/datafusion:parquet 177346436 / 177928444 / -0.3% 297108787 / 297631020 / -0.2% 0.60 / 0.60 / -0.2%
clickbench_q21/datafusion:parquet 173061128 / 174690317 / -0.9% 316155267 / 314732152 / +0.5% 0.55 / 0.56 / -1.4%
clickbench_q22/datafusion:parquet 259807255 / 263055240 / -1.2% 455820794 / 457268723 / -0.3% 0.57 / 0.58 / -0.9%
clickbench_q23/datafusion:parquet 1004341300 / 1009200611 / -0.5% 1192009042 / 1208861107 / -1.4% 0.84 / 0.83 / +0.9%
clickbench_q24/datafusion:parquet 29690888 / 30159720 / -1.6% 91533461 / 93775000 / -2.4% 0.32 / 0.32 / +0.9%
clickbench_q25/datafusion:parquet 36607006 / 37061024 / -1.2% 104808781 / 106508482 / -1.6% 0.35 / 0.35 / +0.4%
clickbench_q26/datafusion:parquet 30496814 / 30841734 / -1.1% 91763548 / 94696772 / -3.1% 0.33 / 0.33 / +2.0%
clickbench_q27/datafusion:parquet 191870233 / 194491500 / -1.3% 300064902 / 303365504 / -1.1% 0.64 / 0.64 / -0.3%
clickbench_q28/datafusion:parquet 614417902 / 619817921 / -0.9% 712323415 / 713444541 / -0.2% 0.86 / 0.87 / -0.7%
clickbench_q29/datafusion:parquet 28676385 / 28686998 / -0.0% 91434886 / 92367829 / -1.0% 0.31 / 0.31 / +1.0%
clickbench_q30/datafusion:parquet 90851738 / 89898863 / +1.1% 175381034 / 176775177 / -0.8% 0.52 / 0.51 / +1.9%
clickbench_q31/datafusion:parquet 101313787 / 102462564 / -1.1% 200750874 / 200487523 / +0.1% 0.50 / 0.51 / -1.3%
clickbench_q32/datafusion:parquet 305089009 / 308786712 / -1.2% 435623429 / 429095307 / +1.5% 0.70 / 0.72 / -2.7%
clickbench_q33/datafusion:parquet 378165170 / 378659744 / -0.1% 479511299 / 475500712 / +0.8% 0.79 / 0.80 / -1.0%
clickbench_q34/datafusion:parquet 377221640 / 379482618 / -0.6% 477777451 / 476572067 / +0.3% 0.79 / 0.80 / -0.8%
clickbench_q35/datafusion:parquet 65353118 / 65997039 / -1.0% 126226200 / 124340407 / +1.5% 0.52 / 0.53 / -2.5%
clickbench_q36/datafusion:parquet 73702836 / 74067976 / -0.5% 135775070 / 135615208 / +0.1% 0.54 / 0.55 / -0.6%
clickbench_q37/datafusion:parquet 35546114 / 35758964 / -0.6% 91780687 / 91778606 / +0.0% 0.39 / 0.39 / -0.6%
clickbench_q38/datafusion:parquet 47898535 / 47753278 / +0.3% 109028027 / 108817747 / +0.2% 0.44 / 0.44 / +0.1%
clickbench_q39/datafusion:parquet 143926970 / 144660523 / -0.5% 213575393 / 211135202 / +1.2% 0.67 / 0.69 / -1.6%
clickbench_q40/datafusion:parquet 19624100 / 20145830 / -2.6% 76618918 / 78192268 / -2.0% 0.26 / 0.26 / -0.6%
clickbench_q41/datafusion:parquet 18799268 / 18848192 / -0.3% 75446635 / 77116950 / -2.2% 0.25 / 0.24 / +1.9%
clickbench_q42/datafusion:parquet 19240174 / 19241459 / -0.0% 74307934 / 75108291 / -1.1% 0.26 / 0.26 / +1.1%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2304554 / 2216050 / +4.0% 25357016 / 24473085 / +3.6% 0.09 / 0.09 / +0.4%
clickbench_q01/duckdb:vortex-file-compressed 7575400 / 7636720 / -0.8% 28999318 / 28423960 / +2.0% 0.26 / 0.27 / -2.8%
clickbench_q02/duckdb:vortex-file-compressed 9154443 / 8977933 / +2.0% 40573413 / 35666612 / +13.8% 🔴 0.23 / 0.25 / -10.4%
clickbench_q03/duckdb:vortex-file-compressed 13916900 / 13806456 / +0.8% 51579067 / 51720215 / -0.3% 0.27 / 0.27 / +1.1%
clickbench_q04/duckdb:vortex-file-compressed 58965838 / 56163165 / +5.0% 91447124 / 89546325 / +2.1% 0.64 / 0.63 / +2.8%
clickbench_q05/duckdb:vortex-file-compressed 64590976 / 63989240 / +0.9% 95701121 / 94628080 / +1.1% 0.67 / 0.68 / -0.2%
clickbench_q06/duckdb:vortex-file-compressed 2601804 / 2596790 / +0.2% 29528459 / 30712767 / -3.9% 0.09 / 0.08 / +4.2%
clickbench_q07/duckdb:vortex-file-compressed 9638810 / 9507178 / +1.4% 31012024 / 31164060 / -0.5% 0.31 / 0.31 / +1.9%
clickbench_q08/duckdb:vortex-file-compressed 70185502 / 68484640 / +2.5% 111216992 / 105627201 / +5.3% 0.63 / 0.65 / -2.7%
clickbench_q09/duckdb:vortex-file-compressed 93876222 / 93141240 / +0.8% 130681286 / 129548645 / +0.9% 0.72 / 0.72 / -0.1%
clickbench_q10/duckdb:vortex-file-compressed 28111910 / 27640227 / +1.7% 69571315 / 72714806 / -4.3% 0.40 / 0.38 / +6.3%
clickbench_q11/duckdb:vortex-file-compressed 30886638 / 30623786 / +0.9% 74916842 / 74973690 / -0.1% 0.41 / 0.41 / +0.9%
clickbench_q12/duckdb:vortex-file-compressed 70786378 / 69729675 / +1.5% 101885241 / 101095376 / +0.8% 0.69 / 0.69 / +0.7%
clickbench_q13/duckdb:vortex-file-compressed 127499877 / 125483860 / +1.6% 166939160 / 167459883 / -0.3% 0.76 / 0.75 / +1.9%
clickbench_q14/duckdb:vortex-file-compressed 75418332 / 73764860 / +2.2% 104146616 / 104617110 / -0.4% 0.72 / 0.71 / +2.7%
clickbench_q15/duckdb:vortex-file-compressed 76374422 / 75820930 / +0.7% 112752404 / 109010715 / +3.4% 0.68 / 0.70 / -2.6%
clickbench_q16/duckdb:vortex-file-compressed 136292146 / 134145470 / +1.6% 172347076 / 173168414 / -0.5% 0.79 / 0.77 / +2.1%
clickbench_q17/duckdb:vortex-file-compressed 140657375 / 137330816 / +2.4% 171252373 / 172726027 / -0.9% 0.82 / 0.80 / +3.3%
clickbench_q18/duckdb:vortex-file-compressed 254769565 / 250193304 / +1.8% 304339471 / 296599845 / +2.6% 0.84 / 0.84 / -0.8%
clickbench_q19/duckdb:vortex-file-compressed 9570192 / 9225528 / +3.7% 40666111 / 38086321 / +6.8% 0.24 / 0.24 / -2.8%
clickbench_q20/duckdb:vortex-file-compressed 68441645 / 69696838 / -1.8% 169767458 / 168799926 / +0.6% 0.40 / 0.41 / -2.4%
clickbench_q21/duckdb:vortex-file-compressed 83098934 / 83890718 / -0.9% 191707233 / 193567207 / -1.0% 0.43 / 0.43 / +0.0%
clickbench_q22/duckdb:vortex-file-compressed 174586724 / 177251157 / -1.5% 355048236 / 357118223 / -0.6% 0.49 / 0.50 / -0.9%
clickbench_q23/duckdb:vortex-file-compressed 42854624 / 40391694 / +6.1% 84803559 / 86555515 / -2.0% 0.51 / 0.47 / +8.3%
clickbench_q24/duckdb:vortex-file-compressed 13966918 / 14041564 / -0.5% 38457613 / 38059996 / +1.0% 0.36 / 0.37 / -1.6%
clickbench_q25/duckdb:vortex-file-compressed 19483250 / 19342167 / +0.7% 55188546 / 53806716 / +2.6% 0.35 / 0.36 / -1.8%
clickbench_q26/duckdb:vortex-file-compressed 11182490 / 11451028 / -2.3% 36103623 / 34462550 / +4.8% 0.31 / 0.33 / -6.8%
clickbench_q27/duckdb:vortex-file-compressed 54212160 / 53663670 / +1.0% 178127426 / 172568304 / +3.2% 0.30 / 0.31 / -2.1%
clickbench_q28/duckdb:vortex-file-compressed 513987973 / 511084248 / +0.6% 569405379 / 567971288 / +0.3% 0.90 / 0.90 / +0.3%
clickbench_q29/duckdb:vortex-file-compressed 17368376 / 16972628 / +2.3% 46281259 / 41718574 / +10.9% 🔴 0.38 / 0.41 / -7.8%
clickbench_q30/duckdb:vortex-file-compressed 60343811 / 60250426 / +0.2% 112358950 / 112109861 / +0.2% 0.54 / 0.54 / -0.1%
clickbench_q31/duckdb:vortex-file-compressed 110554972 / 109746972 / +0.7% 196599735 / 202134272 / -2.7% 0.56 / 0.54 / +3.6%
clickbench_q32/duckdb:vortex-file-compressed 368653194 / 373082029 / -1.2% 398896163 / 397795285 / +0.3% 0.92 / 0.94 / -1.5%
clickbench_q33/duckdb:vortex-file-compressed 344829240 / 345340464 / -0.1% 412439080 / 410098662 / +0.6% 0.84 / 0.84 / -0.7%
clickbench_q34/duckdb:vortex-file-compressed 351669696 / 356040592 / -1.2% 416899435 / 415048790 / +0.4% 0.84 / 0.86 / -1.7%
clickbench_q35/duckdb:vortex-file-compressed 57854842 / 57502388 / +0.6% 90145931 / 88216977 / +2.2% 0.64 / 0.65 / -1.5%
clickbench_q36/duckdb:vortex-file-compressed 11523672 / 11892538 / -3.1% 32964615 / 32890597 / +0.2% 0.35 / 0.36 / -3.3%
clickbench_q37/duckdb:vortex-file-compressed 8235260 / 8157658 / +1.0% 29508157 / 27512167 / +7.3% 0.28 / 0.30 / -5.9%
clickbench_q38/duckdb:vortex-file-compressed 8631262 / 8733087 / -1.2% 31044310 / 29021940 / +7.0% 0.28 / 0.30 / -7.6%
clickbench_q39/duckdb:vortex-file-compressed 19472483 / 18780248 / +3.7% 39561999 / 38493307 / +2.8% 0.49 / 0.49 / +0.9%
clickbench_q40/duckdb:vortex-file-compressed 7551888 / 7515736 / +0.5% 29067849 / 28967879 / +0.3% 0.26 / 0.26 / +0.1%
clickbench_q41/duckdb:vortex-file-compressed 8520226 / 8268941 / +3.0% 29885182 / 29926428 / -0.1% 0.29 / 0.28 / +3.2%
clickbench_q42/duckdb:vortex-file-compressed 7593954 / 7547077 / +0.6% 29674595 / 27031323 / +9.8% 0.26 / 0.28 / -8.3%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9075125 / 10078738 / -10.0% 13813305 / 14303150 / -3.4% 0.66 / 0.70 / -6.8%
clickbench_q01/duckdb:parquet 15177301 / 15245837 / -0.4% 20213798 / 22020677 / -8.2% 0.75 / 0.69 / +8.4%
clickbench_q02/duckdb:parquet 22046092 / 22432483 / -1.7% 30459764 / 31347727 / -2.8% 0.72 / 0.72 / +1.1%
clickbench_q03/duckdb:parquet 22521619 / 23226499 / -3.0% 33553421 / 36254859 / -7.5% 0.67 / 0.64 / +4.8%
clickbench_q04/duckdb:parquet 61465471 / 61581680 / -0.2% 70805572 / 75453919 / -6.2% 0.87 / 0.82 / +6.4%
clickbench_q05/duckdb:parquet 83486506 / 84419526 / -1.1% 95545758 / 96541060 / -1.0% 0.87 / 0.87 / -0.1%
clickbench_q06/duckdb:parquet 20861100 / 20611205 / +1.2% 28028689 / 29710623 / -5.7% 0.74 / 0.69 / +7.3%
clickbench_q07/duckdb:parquet 17244565 / 17579062 / -1.9% 23396536 / 23076151 / +1.4% 0.74 / 0.76 / -3.2%
clickbench_q08/duckdb:parquet 74585555 / 75437762 / -1.1% 89199700 / 88128859 / +1.2% 0.84 / 0.86 / -2.3%
clickbench_q09/duckdb:parquet 102547075 / 102193712 / +0.3% 118811564 / 120995931 / -1.8% 0.86 / 0.84 / +2.2%
clickbench_q10/duckdb:parquet 41417422 / 40936938 / +1.2% 56463455 / 54294509 / +4.0% 0.73 / 0.75 / -2.7%
clickbench_q11/duckdb:parquet 46591672 / 47362828 / -1.6% 63414342 / 60402851 / +5.0% 0.73 / 0.78 / -6.3%
clickbench_q12/duckdb:parquet 93597508 / 91221512 / +2.6% 106616153 / 106113616 / +0.5% 0.88 / 0.86 / +2.1%
clickbench_q13/duckdb:parquet 150207148 / 149380527 / +0.6% 168293164 / 169772917 / -0.9% 0.89 / 0.88 / +1.4%
clickbench_q14/duckdb:parquet 100762183 / 101245392 / -0.5% 115649293 / 118337999 / -2.3% 0.87 / 0.86 / +1.8%
clickbench_q15/duckdb:parquet 86182480 / 86115814 / +0.1% 99642997 / 97566731 / +2.1% 0.86 / 0.88 / -2.0%
clickbench_q16/duckdb:parquet 161265025 / 163036044 / -1.1% 177841665 / 179498115 / -0.9% 0.91 / 0.91 / -0.2%
clickbench_q17/duckdb:parquet 165728738 / 163583974 / +1.3% 179270317 / 179573524 / -0.2% 0.92 / 0.91 / +1.5%
clickbench_q18/duckdb:parquet 297220216 / 290884076 / +2.2% 319128058 / 317569698 / +0.5% 0.93 / 0.92 / +1.7%
clickbench_q19/duckdb:parquet 19768602 / 19786145 / -0.1% 27017018 / 25117433 / +7.6% 0.73 / 0.79 / -7.1%
clickbench_q20/duckdb:parquet 182684004 / 183949647 / -0.7% 236788698 / 226717649 / +4.4% 0.77 / 0.81 / -4.9%
clickbench_q21/duckdb:parquet 220652448 / 218625611 / +0.9% 267456293 / 266488901 / +0.4% 0.83 / 0.82 / +0.6%
clickbench_q22/duckdb:parquet 308557620 / 308142937 / +0.1% 353773461 / 354700371 / -0.3% 0.87 / 0.87 / +0.4%
clickbench_q23/duckdb:parquet 168804282 / 168641448 / +0.1% 243763784 / 241279721 / +1.0% 0.69 / 0.70 / -0.9%
clickbench_q24/duckdb:parquet 31304140 / 29924854 / +4.6% 44241970 / 32276726 / +37.1% 🔴 0.71 / 0.93 / -23.7%
clickbench_q25/duckdb:parquet 42114656 / 41950072 / +0.4% 56957075 / 55434002 / +2.7% 0.74 / 0.76 / -2.3%
clickbench_q26/duckdb:parquet 30315977 / 30622715 / -1.0% 47469485 / 45811618 / +3.6% 0.64 / 0.67 / -4.5%
clickbench_q27/duckdb:parquet 197382415 / 190426976 / +3.7% 230161676 / 227343957 / +1.2% 0.86 / 0.84 / +2.4%
clickbench_q28/duckdb:parquet 956820778 / 961052774 / -0.4% 944244135 / 937089524 / +0.8% 1.01 / 1.03 / -1.2%
clickbench_q29/duckdb:parquet 24047492 / 24448463 / -1.6% 31492412 / 32094183 / -1.9% 0.76 / 0.76 / +0.2%
clickbench_q30/duckdb:parquet 105362930 / 105471394 / -0.1% 127385294 / 128098666 / -0.6% 0.83 / 0.82 / +0.5%
clickbench_q31/duckdb:parquet 158961205 / 161095308 / -1.3% 173506671 / 174332811 / -0.5% 0.92 / 0.92 / -0.9%
clickbench_q32/duckdb:parquet 390991568 / 393235069 / -0.6% 419405607 / 417391333 / +0.5% 0.93 / 0.94 / -1.0%
clickbench_q33/duckdb:parquet 490702574 / 479732041 / +2.3% 444453146 / 470776421 / -5.6% 1.10 / 1.02 / +8.3%
clickbench_q34/duckdb:parquet 478859593 / 471786272 / +1.5% 459960124 / 453620777 / +1.4% 1.04 / 1.04 / +0.1%
clickbench_q35/duckdb:parquet 61420450 / 61092004 / +0.5% 74408571 / 74744580 / -0.4% 0.83 / 0.82 / +1.0%
clickbench_q36/duckdb:parquet 30930200 / 30325630 / +2.0% 36425917 / 36153776 / +0.8% 0.85 / 0.84 / +1.2%
clickbench_q37/duckdb:parquet 23337020 / 23384838 / -0.2% 29667680 / 30166789 / -1.7% 0.79 / 0.78 / +1.5%
clickbench_q38/duckdb:parquet 23384257 / 23783937 / -1.7% 29490175 / 30109737 / -2.1% 0.79 / 0.79 / +0.4%
clickbench_q39/duckdb:parquet 52380602 / 53397671 / -1.9% 59319140 / 61015193 / -2.8% 0.88 / 0.88 / +0.9%
clickbench_q40/duckdb:parquet 15674022 / 14404048 / +8.8% 19574791 / 19603905 / -0.1% 0.80 / 0.73 / +9.0%
clickbench_q41/duckdb:parquet 15449500 / 15189584 / +1.7% 20116867 / 20719892 / -2.9% 0.77 / 0.73 / +4.8%
clickbench_q42/duckdb:parquet 14284406 / 14421763 / -1.0% 20662940 / 20747757 / -0.4% 0.69 / 0.70 / -0.5%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 6e12746c vs base e59b236d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.6%
Engines: DataFusion No clear signal (+14.3%, environment too noisy confidence) · DuckDB No clear signal (+7.1%, environment too noisy confidence)
Vortex (geomean): hot 1.032x ➖ · cold 0.948x ➖
Parquet (geomean): hot 0.933x ➖ · cold 0.952x ➖
Shifts: Parquet (control) -6.7% · Median polish -5.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.076x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 221503728 / 225561561 / -1.8% 722474306 / 1202805016 / -39.9% 🟢 0.31 / 0.19 / +63.5%
tpch_q02/datafusion:vortex-file-compressed 387636829 / 328423638 / +18.0% 641999334 / 798007696 / -19.5% 0.60 / 0.41 / +46.7%
tpch_q03/datafusion:vortex-file-compressed 379262422 / 395899402 / -4.2% 1065818253 / 1062975705 / +0.3% 0.36 / 0.37 / -4.5%
tpch_q04/datafusion:vortex-file-compressed 390596554 / 223468534 / +74.8% 🔴 956268916 / 432806500 / +120.9% 🔴 0.41 / 0.52 / -20.9%
tpch_q05/datafusion:vortex-file-compressed 889381203 / 399921973 / +122.4% 🔴 859478608 / 799374410 / +7.5% 1.03 / 0.50 / +106.8%
tpch_q06/datafusion:vortex-file-compressed 207108675 / 155365353 / +33.3% 🔴 405839162 / 305315522 / +32.9% 🔴 0.51 / 0.51 / +0.3%
tpch_q07/datafusion:vortex-file-compressed 410512165 / 417762287 / -1.7% 612542438 / 667066964 / -8.2% 0.67 / 0.63 / +7.0%
tpch_q08/datafusion:vortex-file-compressed 598047531 / 476701085 / +25.5% 637778937 / 701023740 / -9.0% 0.94 / 0.68 / +37.9%
tpch_q09/datafusion:vortex-file-compressed 751700571 / 544771751 / +38.0% 🔴 841420808 / 644727895 / +30.5% 🔴 0.89 / 0.84 / +5.7%
tpch_q10/datafusion:vortex-file-compressed 709824876 / 395926899 / +79.3% 🔴 907139937 / 604268183 / +50.1% 🔴 0.78 / 0.66 / +19.4%
tpch_q11/datafusion:vortex-file-compressed 268294256 / 306186593 / -12.4% 449027069 / 531413631 / -15.5% 0.60 / 0.58 / +3.7%
tpch_q12/datafusion:vortex-file-compressed 228549993 / 292625942 / -21.9% 453661471 / 474101991 / -4.3% 0.50 / 0.62 / -18.4%
tpch_q13/datafusion:vortex-file-compressed 138441546 / 136115765 / +1.7% 344124131 / 408545243 / -15.8% 0.40 / 0.33 / +20.7%
tpch_q14/datafusion:vortex-file-compressed 203935441 / 180545638 / +13.0% 339508463 / 433782913 / -21.7% 0.60 / 0.42 / +44.3%
tpch_q15/datafusion:vortex-file-compressed 353399913 / 372603278 / -5.2% 561956240 / 642347277 / -12.5% 0.63 / 0.58 / +8.4%
tpch_q16/datafusion:vortex-file-compressed 144332679 / 163646712 / -11.8% 292040383 / 401219096 / -27.2% 0.49 / 0.41 / +21.2%
tpch_q17/datafusion:vortex-file-compressed 264538215 / 297767556 / -11.2% 442092792 / 493859191 / -10.5% 0.60 / 0.60 / -0.8%
tpch_q18/datafusion:vortex-file-compressed 259534249 / 298571166 / -13.1% 555730055 / 561059796 / -0.9% 0.47 / 0.53 / -12.2%
tpch_q19/datafusion:vortex-file-compressed 248950894 / 288481800 / -13.7% 384387669 / 557902082 / -31.1% 🟢 0.65 / 0.52 / +25.3%
tpch_q20/datafusion:vortex-file-compressed 293782751 / 317095679 / -7.4% 428799475 / 569355797 / -24.7% 0.69 / 0.56 / +23.0%
tpch_q21/datafusion:vortex-file-compressed 449192217 / 553782898 / -18.9% 686490005 / 858746175 / -20.1% 0.65 / 0.64 / +1.5%
tpch_q22/datafusion:vortex-file-compressed 160096184 / 184429721 / -13.2% 406259423 / 514196245 / -21.0% 0.39 / 0.36 / +9.9%
datafusion / parquet / ns (0.941x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 165076938 / 153497348 / +7.5% 505352633 / 487211387 / +3.7% 0.33 / 0.32 / +3.7%
tpch_q02/datafusion:parquet 285497676 / 306102484 / -6.7% 642813047 / 578232235 / +11.2% 0.44 / 0.53 / -16.1%
tpch_q03/datafusion:parquet 237114138 / 294983369 / -19.6% 803738203 / 809289043 / -0.7% 0.30 / 0.36 / -19.1%
tpch_q04/datafusion:parquet 179126069 / 151595398 / +18.2% 353316472 / 343091597 / +3.0% 0.51 / 0.44 / +14.7%
tpch_q05/datafusion:parquet 384591542 / 436440631 / -11.9% 500981860 / 726020753 / -31.0% 🟢 0.77 / 0.60 / +27.7%
tpch_q06/datafusion:parquet 128224031 / 138190804 / -7.2% 254506371 / 331100021 / -23.1% 0.50 / 0.42 / +20.7%
tpch_q07/datafusion:parquet 377194315 / 429436192 / -12.2% 454226285 / 559762552 / -18.9% 0.83 / 0.77 / +8.2%
tpch_q08/datafusion:parquet 490018734 / 1793381954 / -72.7% 🟢 542509979 / 2544726928 / -78.7% 🟢 0.90 / 0.70 / +28.2%
tpch_q09/datafusion:parquet 430148330 / 566432150 / -24.1% 623736531 / 813535883 / -23.3% 0.69 / 0.70 / -1.0%
tpch_q10/datafusion:parquet 352332417 / 340406469 / +3.5% 459032522 / 496699900 / -7.6% 0.77 / 0.69 / +12.0%
tpch_q11/datafusion:parquet 255700393 / 448873720 / -43.0% 🟢 393374138 / 497971227 / -21.0% 0.65 / 0.90 / -27.9%
tpch_q12/datafusion:parquet 159001818 / 174507745 / -8.9% 378710045 / 331343860 / +14.3% 0.42 / 0.53 / -20.3%
tpch_q13/datafusion:parquet 280836097 / 282742677 / -0.7% 528690437 / 429669197 / +23.0% 0.53 / 0.66 / -19.3%
tpch_q14/datafusion:parquet 448782264 / 205861943 / +118.0% 🔴 972312027 / 362500090 / +168.2% 🔴 0.46 / 0.57 / -18.7%
tpch_q15/datafusion:parquet 323794002 / 323034374 / +0.2% 628180217 / 473912998 / +32.6% 🔴 0.52 / 0.68 / -24.4%
tpch_q16/datafusion:parquet 116375522 / 115421917 / +0.8% 376489614 / 288445282 / +30.5% 🔴 0.31 / 0.40 / -22.8%
tpch_q17/datafusion:parquet 300202999 / 301327765 / -0.4% 468082363 / 427803701 / +9.4% 0.64 / 0.70 / -8.9%
tpch_q18/datafusion:parquet 320098008 / 347242507 / -7.8% 454031894 / 495575167 / -8.4% 0.71 / 0.70 / +0.6%
tpch_q19/datafusion:parquet 215009089 / 203292224 / +5.8% 285640081 / 337278486 / -15.3% 0.75 / 0.60 / +24.9%
tpch_q20/datafusion:parquet 283871517 / 275931913 / +2.9% 460849151 / 451034046 / +2.2% 0.62 / 0.61 / +0.7%
tpch_q21/datafusion:parquet 350457297 / 336070691 / +4.3% 495095788 / 542674238 / -8.8% 0.71 / 0.62 / +14.3%
tpch_q22/datafusion:parquet 237295091 / 155831757 / +52.3% 🔴 487222912 / 367985350 / +32.4% 🔴 0.49 / 0.42 / +15.0%
duckdb / vortex-file-compressed / ns (0.989x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 270360705 / 256476401 / +5.4% 297883176 / 296611785 / +0.4% 0.91 / 0.86 / +5.0%
tpch_q02/duckdb:vortex-file-compressed 456477844 / 467028976 / -2.3% 450066930 / 544422384 / -17.3% 1.01 / 0.86 / +18.2%
tpch_q03/duckdb:vortex-file-compressed 410804829 / 456129927 / -9.9% 493531302 / 593903673 / -16.9% 0.83 / 0.77 / +8.4%
tpch_q04/duckdb:vortex-file-compressed 281560689 / 331216319 / -15.0% 343601694 / 344809301 / -0.4% 0.82 / 0.96 / -14.7%
tpch_q05/duckdb:vortex-file-compressed 1319043112 / 613284706 / +115.1% 🔴 962360044 / 755657032 / +27.4% 1.37 / 0.81 / +68.9%
tpch_q06/duckdb:vortex-file-compressed 177359856 / 322337840 / -45.0% 🟢 186862813 / 302751995 / -38.3% 🟢 0.95 / 1.06 / -10.9%
tpch_q07/duckdb:vortex-file-compressed 407828647 / 487606370 / -16.4% 429346138 / 532677991 / -19.4% 0.95 / 0.92 / +3.8%
tpch_q08/duckdb:vortex-file-compressed 651817344 / 923361942 / -29.4% 739191737 / 854488069 / -13.5% 0.88 / 1.08 / -18.4%
tpch_q09/duckdb:vortex-file-compressed 420031420 / 434780620 / -3.4% 485057119 / 456822263 / +6.2% 0.87 / 0.95 / -9.0%
tpch_q10/duckdb:vortex-file-compressed 528990844 / 605579939 / -12.6% 584734173 / 666438240 / -12.3% 0.90 / 0.91 / -0.4%
tpch_q11/duckdb:vortex-file-compressed 301138669 / 320635346 / -6.1% 308710474 / 335755676 / -8.1% 0.98 / 0.95 / +2.1%
tpch_q12/duckdb:vortex-file-compressed 429814050 / 263712806 / +63.0% 🔴 317581228 / 311476841 / +2.0% 1.35 / 0.85 / +59.9%
tpch_q13/duckdb:vortex-file-compressed 219304314 / 233405462 / -6.0% 413708645 / 308836787 / +34.0% 🔴 0.53 / 0.76 / -29.9%
tpch_q14/duckdb:vortex-file-compressed 296778514 / 270139468 / +9.9% 370615201 / 384320153 / -3.6% 0.80 / 0.70 / +13.9%
tpch_q15/duckdb:vortex-file-compressed 268470245 / 265105538 / +1.3% 340953797 / 288359453 / +18.2% 0.79 / 0.92 / -14.4%
tpch_q16/duckdb:vortex-file-compressed 212530462 / 284087008 / -25.2% 248147663 / 273795052 / -9.4% 0.86 / 1.04 / -17.5%
tpch_q17/duckdb:vortex-file-compressed 318235032 / 345186785 / -7.8% 354923386 / 414017501 / -14.3% 0.90 / 0.83 / +7.5%
tpch_q18/duckdb:vortex-file-compressed 422933510 / 344110441 / +22.9% 501094701 / 331002253 / +51.4% 🔴 0.84 / 1.04 / -18.8%
tpch_q19/duckdb:vortex-file-compressed 311898275 / 374954954 / -16.8% 341554756 / 324148961 / +5.4% 0.91 / 1.16 / -21.1%
tpch_q20/duckdb:vortex-file-compressed 567162866 / 382508829 / +48.3% 🔴 536994694 / 489729089 / +9.7% 1.06 / 0.78 / +35.2%
tpch_q21/duckdb:vortex-file-compressed 860183116 / 800514405 / +7.5% 718975040 / 985991193 / -27.1% 1.20 / 0.81 / +47.4%
tpch_q22/duckdb:vortex-file-compressed 231387777 / 245646840 / -5.8% 280026862 / 356620035 / -21.5% 0.83 / 0.69 / +20.0%
duckdb / parquet / ns (0.924x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 211342145 / 183658090 / +15.1% 364324850 / 232283276 / +56.8% 🔴 0.58 / 0.79 / -26.6%
tpch_q02/duckdb:parquet 501188084 / 514054575 / -2.5% 498333922 / 619631165 / -19.6% 1.01 / 0.83 / +21.2%
tpch_q03/duckdb:parquet 353770203 / 398427599 / -11.2% 366306152 / 435817220 / -15.9% 0.97 / 0.91 / +5.6%
tpch_q04/duckdb:parquet 232513766 / 250327957 / -7.1% 372581753 / 364501466 / +2.2% 0.62 / 0.69 / -9.1%
tpch_q05/duckdb:parquet 608844657 / 564945477 / +7.8% 744057774 / 603956056 / +23.2% 0.82 / 0.94 / -12.5%
tpch_q06/duckdb:parquet 177945496 / 205265286 / -13.3% 236252714 / 240655381 / -1.8% 0.75 / 0.85 / -11.7%
tpch_q07/duckdb:parquet 445615567 / 436746686 / +2.0% 527532574 / 523329949 / +0.8% 0.84 / 0.83 / +1.2%
tpch_q08/duckdb:parquet 664136588 / 808737360 / -17.9% 685953362 / 802202878 / -14.5% 0.97 / 1.01 / -4.0%
tpch_q09/duckdb:parquet 734108798 / 683385290 / +7.4% 899587368 / 657404393 / +36.8% 🔴 0.82 / 1.04 / -21.5%
tpch_q10/duckdb:parquet 652014651 / 722376167 / -9.7% 613468856 / 713040120 / -14.0% 1.06 / 1.01 / +4.9%
tpch_q11/duckdb:parquet 295964638 / 327497179 / -9.6% 369342013 / 331542419 / +11.4% 0.80 / 0.99 / -18.9%
tpch_q12/duckdb:parquet 224715036 / 373659150 / -39.9% 🟢 258022642 / 569385726 / -54.7% 🟢 0.87 / 0.66 / +32.7%
tpch_q13/duckdb:parquet 392319685 / 493523315 / -20.5% 463929451 / 775374544 / -40.2% 🟢 0.85 / 0.64 / +32.9%
tpch_q14/duckdb:parquet 243410807 / 320555353 / -24.1% 334111706 / 309786272 / +7.9% 0.73 / 1.03 / -29.6%
tpch_q15/duckdb:parquet 220990085 / 247529554 / -10.7% 294845263 / 318399716 / -7.4% 0.75 / 0.78 / -3.6%
tpch_q16/duckdb:parquet 274551219 / 319127695 / -14.0% 279355339 / 366173995 / -23.7% 0.98 / 0.87 / +12.8%
tpch_q17/duckdb:parquet 283705881 / 345545921 / -17.9% 346845715 / 451839517 / -23.2% 0.82 / 0.76 / +7.0%
tpch_q18/duckdb:parquet 418240860 / 416908555 / +0.3% 434043835 / 367138215 / +18.2% 0.96 / 1.14 / -15.1%
tpch_q19/duckdb:parquet 280970506 / 239400726 / +17.4% 361001439 / 323158941 / +11.7% 0.78 / 0.74 / +5.1%
tpch_q20/duckdb:parquet 484887536 / 459274955 / +5.6% 504400781 / 463643138 / +8.8% 0.96 / 0.99 / -3.0%
tpch_q21/duckdb:parquet 469918373 / 520026527 / -9.6% 531325780 / 683999755 / -22.3% 0.88 / 0.76 / +16.3%
tpch_q22/duckdb:parquet 343806607 / 319320177 / +7.7% 333288159 / 308096946 / +8.2% 1.03 / 1.04 / -0.5%

@mhk197
mhk197 marked this pull request as ready for review November 3, 2026 19:48
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@mhk197
mhk197 force-pushed the mk/datafusion-array-sum branch from 3196f13 to 5e526f3 Compare November 4, 2026 16:45
@mhk197
mhk197 merged commit a720e52 into develop Nov 4, 2026
76 checks passed
@mhk197
mhk197 deleted the mk/datafusion-array-sum branch November 4, 2026 18:50
robert3005 pushed a commit that referenced this pull request Nov 6, 2026
## Summary

Stacked on #10854. DataFusion evaluates `array_transform` above the
Vortex scan, and a projection containing a lambda skips projection
pushdown entirely (#10215).

This converts `array_transform` to Vortex's `list_transform`.

## Changes

- `array_transform(list, (x) -> body)` converts to `list_transform` when
the lambda has one parameter.
- The body is converted in the lambda's own scope, where `$` is the
struct of its parameters, as Vortex runs a body: `x` reads `$.x`, which
becomes `@x` once the body is converted. In that scope a column or an
enclosing lambda's parameter is unsupported, and outside it so is any
lambda parameter.
- Filters push down too: a conjunct with `array_transform` converts like
any other, so DataFusion drops its `FilterExec` and the scan evaluates
it.
- The #10215 guard that turned off projection pushdown for any lambda is
removed: the split is all-or-nothing, so a lambda left for DataFusion
always runs over the raw columns.

---------

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants