Skip to content

Reserve DuckDB Scan V2 work under the global lock before joining a file - #11148

Draft
joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-duckdb-reserve-work
Draft

joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-duckdb-reserve-work

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Split out of #10964 as an independently measurable piece.

A thread joined a V2 file whenever the file's queue was not yet exhausted, then took its first chunk after DuckDB released the global lock. Several threads could join for the last chunk. The losers found no work, returned to DuckDB empty-handed, and only moved on to the next file after another round through the scheduler.

Changes

  • reader_try_initialize_scan takes the thread's first chunk while DuckDB still holds the global lock, so a thread joins a file only with work in hand.
  • The reserved chunk runs outside the lock before the thread takes more. Threads with no work left move straight to the next file.
  • New test: reserved and queued work, with and without sparse selections and dynamic filters, return every selected row exactly once.

Local validation

4 vCPU cloud VM, TPC-H SF10 Vortex files, Scan V2, 2 alternating (ABBA) rounds × 5 iterations against develop (246a397). Base-vs-base noise: +1.3% geomean, up to ±8% per query.

Engine Geomean of medians Geomean of mins
DuckDB -1.2% 0.0%

The TPC-H tables are single files at SF10, so there is little cross-file contention. The multi-file ClickBench run is still in progress locally.

  • cargo nextest run -p vortex-duckdb: 284 passed, 2 skipped.
  • Pinned-nightly rustfmt --check on changed files: clean.
  • cargo clippy: not yet run.

Generated by Claude Code

A thread joined a V2 file whenever its queue was not yet exhausted, then took its first chunk
after DuckDB released the global lock. Several threads could join for the last chunk; the
losers found no work, returned to DuckDB empty-handed, and moved on to the next file only
after another round through the scheduler.

Take the thread's first chunk while DuckDB still holds the global lock, so a thread joins a
file only with work in hand, and run it outside the lock before taking more. Threads with no
work left in the file move straight on to the next one.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 3, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a29c280 clickbench-nvme 1 Explore Profiling Data
🟢 Done a29c280 fineweb 1 Explore Profiling Data
🟢 Done a29c280 polarsignals 1 Explore Profiling Data
🟢 Done a29c280 tpch-nvme-10 1 Explore Profiling Data
🟢 Done a29c280 tpch-nvme 1 Explore Profiling Data
🟢 Done a29c280 tpch-s3 1 Explore Profiling Data
🟢 Done a29c280 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR a29c280d vs base 246a397e
Vortex (geomean): hot 0.995x ➖ · cold 0.999x ➖


datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44219728 / 44174877 / +0.1% 84431102 / 83381591 / +1.3% 0.52 / 0.53 / -1.1%
polarsignals_q01/datafusion:vortex-file-compressed 53768718 / 59498684 / -9.6% 109456834 / 113392846 / -3.5% 0.49 / 0.52 / -6.4%
polarsignals_q02/datafusion:vortex-file-compressed 11553852 / 11978216 / -3.5% 47717006 / 49588551 / -3.8% 0.24 / 0.24 / +0.2%
polarsignals_q03/datafusion:vortex-file-compressed 54469799 / 54233533 / +0.4% 112255202 / 112439358 / -0.2% 0.49 / 0.48 / +0.6%
polarsignals_q04/datafusion:vortex-file-compressed 9216538 / 9157702 / +0.6% 40852896 / 40279396 / +1.4% 0.23 / 0.23 / -0.8%
polarsignals_q05/datafusion:vortex-file-compressed 11562912 / 11581688 / -0.2% 43265921 / 44512288 / -2.8% 0.27 / 0.26 / +2.7%
polarsignals_q06/datafusion:vortex-file-compressed 22710989 / 23169506 / -2.0% 54255537 / 52769004 / +2.8% 0.42 / 0.44 / -4.7%
polarsignals_q07/datafusion:vortex-file-compressed 10799873 / 10570672 / +2.2% 42636095 / 41644590 / +2.4% 0.25 / 0.25 / -0.2%
polarsignals_q08/datafusion:vortex-file-compressed 102691922 / 97258934 / +5.6% 155232283 / 150877578 / +2.9% 0.66 / 0.64 / +2.6%
polarsignals_q09/datafusion:vortex-file-compressed 9952336 / 9737686 / +2.2% 38640169 / 39267571 / -1.6% 0.26 / 0.25 / +3.9%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR a29c280d vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+6.1%, low confidence) · DuckDB No clear signal (-1.8%, low confidence)
Vortex (geomean): hot 1.026x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.5% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.066x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6206769 / 6024191 / +3.0% 20311665 / 21309376 / -4.7% 0.31 / 0.28 / +8.1%
fineweb_q01/datafusion:vortex-file-compressed 10076591 / 9747476 / +3.4% 40499982 / 42020755 / -3.6% 0.25 / 0.23 / +7.3%
fineweb_q02/datafusion:vortex-file-compressed 11862590 / 11618604 / +2.1% 42001914 / 41766392 / +0.6% 0.28 / 0.28 / +1.5%
fineweb_q03/datafusion:vortex-file-compressed 17250777 / 17329895 / -0.5% 104806417 / 108086646 / -3.0% 0.16 / 0.16 / +2.7%
fineweb_q04/datafusion:vortex-file-compressed 67526780 / 65737414 / +2.7% 144727909 / 145352776 / -0.4% 0.47 / 0.45 / +3.2%
fineweb_q05/datafusion:vortex-file-compressed 63745190 / 61795532 / +3.2% 138519779 / 137019662 / +1.1% 0.46 / 0.45 / +2.0%
fineweb_q06/datafusion:vortex-file-compressed 17651726 / 18066823 / -2.3% 101636898 / 104665880 / -2.9% 0.17 / 0.17 / +0.6%
fineweb_q07/datafusion:vortex-file-compressed 18282394 / 18844782 / -3.0% 100354870 / 103604493 / -3.1% 0.18 / 0.18 / +0.2%
fineweb_q08/datafusion:vortex-file-compressed 12136666 / 7447691 / +63.0% 🔴 30815378 / 30345802 / +1.5% 0.39 / 0.25 / +60.5%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9302780 / 9347190 / -0.5% 33899212 / 33061275 / +2.5% 0.27 / 0.28 / -2.9%
fineweb_q01/datafusion:parquet 73225516 / 74932425 / -2.3% 146861793 / 150742572 / -2.6% 0.50 / 0.50 / +0.3%
fineweb_q02/datafusion:parquet 77261617 / 74583498 / +3.6% 157986722 / 163418319 / -3.3% 0.49 / 0.46 / +7.2%
fineweb_q03/datafusion:parquet 75312373 / 73245926 / +2.8% 154282088 / 146136322 / +5.6% 0.49 / 0.50 / -2.6%
fineweb_q04/datafusion:parquet 83101258 / 81855403 / +1.5% 142537520 / 149348852 / -4.6% 0.58 / 0.55 / +6.4%
fineweb_q05/datafusion:parquet 80823867 / 79554145 / +1.6% 155978691 / 154855107 / +0.7% 0.52 / 0.51 / +0.9%
fineweb_q06/datafusion:parquet 74680207 / 75032262 / -0.5% 149062272 / 149137469 / -0.1% 0.50 / 0.50 / -0.4%
fineweb_q07/datafusion:parquet 73371089 / 73707845 / -0.5% 154404833 / 147218019 / +4.9% 0.48 / 0.50 / -5.1%
fineweb_q08/datafusion:parquet 72574510 / 73897006 / -1.8% 150093039 / 148685620 / +0.9% 0.48 / 0.50 / -2.7%
duckdb / vortex-file-compressed / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2222242 / 2054080 / +8.2% 7562653 / 8030872 / -5.8% 0.29 / 0.26 / +14.9%
fineweb_q01/duckdb:vortex-file-compressed 7799870 / 8039040 / -3.0% 27793248 / 27088970 / +2.6% 0.28 / 0.30 / -5.4%
fineweb_q02/duckdb:vortex-file-compressed 9274012 / 9083977 / +2.1% 28756370 / 31774590 / -9.5% 0.32 / 0.29 / +12.8%
fineweb_q03/duckdb:vortex-file-compressed 19418894 / 19157832 / +1.4% 102615449 / 98793352 / +3.9% 0.19 / 0.19 / -2.4%
fineweb_q04/duckdb:vortex-file-compressed 65102092 / 65255572 / -0.2% 111482817 / 112260318 / -0.7% 0.58 / 0.58 / +0.5%
fineweb_q05/duckdb:vortex-file-compressed 65609874 / 65341412 / +0.4% 107342715 / 108297733 / -0.9% 0.61 / 0.60 / +1.3%
fineweb_q06/duckdb:vortex-file-compressed 17613960 / 18257114 / -3.5% 97382514 / 91068935 / +6.9% 0.18 / 0.20 / -9.8%
fineweb_q07/duckdb:vortex-file-compressed 17450508 / 17490810 / -0.2% 96664886 / 91425750 / +5.7% 0.18 / 0.19 / -5.6%
fineweb_q08/duckdb:vortex-file-compressed 4243028 / 4946861 / -14.2% 🟢 12025749 / 13182286 / -8.8% 0.35 / 0.38 / -6.0%
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23583697 / 23445777 / +0.6% 28246014 / 28195844 / +0.2% 0.83 / 0.83 / +0.4%
fineweb_q01/duckdb:parquet 52705833 / 53982162 / -2.4% 74540932 / 71997604 / +3.5% 0.71 / 0.75 / -5.7%
fineweb_q02/duckdb:parquet 58899620 / 57294482 / +2.8% 77009130 / 77346633 / -0.4% 0.76 / 0.74 / +3.3%
fineweb_q03/duckdb:parquet 120700418 / 117275600 / +2.9% 182678821 / 177695815 / +2.8% 0.66 / 0.66 / +0.1%
fineweb_q04/duckdb:parquet 163185740 / 162362744 / +0.5% 209201916 / 207889629 / +0.6% 0.78 / 0.78 / -0.1%
fineweb_q05/duckdb:parquet 158297264 / 154398161 / +2.5% 198902522 / 198729928 / +0.1% 0.80 / 0.78 / +2.4%
fineweb_q06/duckdb:parquet 88889278 / 87783252 / +1.3% 143797393 / 145322183 / -1.0% 0.62 / 0.60 / +2.3%
fineweb_q07/duckdb:parquet 90798892 / 91502205 / -0.8% 145771238 / 144300475 / +1.0% 0.62 / 0.63 / -1.8%
fineweb_q08/duckdb:parquet 28829790 / 29233083 / -1.4% 30739836 / 29945779 / +2.7% 0.94 / 0.98 / -3.9%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR a29c280d vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (-2.1%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.985x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.994x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.977x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15640560 / 16263915 / -3.8% 42077487 / 44263199 / -4.9% 0.37 / 0.37 / +1.2%
tpch_q02/datafusion:vortex-file-compressed 17101120 / 16894974 / +1.2% 34871879 / 36611616 / -4.8% 0.49 / 0.46 / +6.3%
tpch_q03/datafusion:vortex-file-compressed 19812978 / 19527766 / +1.5% 47158863 / 49847443 / -5.4% 0.42 / 0.39 / +7.2%
tpch_q04/datafusion:vortex-file-compressed 11106807 / 10188611 / +9.0% 32896504 / 35817404 / -8.2% 0.34 / 0.28 / +18.7%
tpch_q05/datafusion:vortex-file-compressed 37173911 / 37541382 / -1.0% 67232186 / 67849249 / -0.9% 0.55 / 0.55 / -0.1%
tpch_q06/datafusion:vortex-file-compressed 4281745 / 5955274 / -28.1% 🟢 26156009 / 28481717 / -8.2% 0.16 / 0.21 / -21.7%
tpch_q07/datafusion:vortex-file-compressed 51509967 / 51398304 / +0.2% 80013140 / 82045194 / -2.5% 0.64 / 0.63 / +2.8%
tpch_q08/datafusion:vortex-file-compressed 50695833 / 51875388 / -2.3% 80820920 / 80701452 / +0.1% 0.63 / 0.64 / -2.4%
tpch_q09/datafusion:vortex-file-compressed 47158031 / 47995869 / -1.7% 76839597 / 80826300 / -4.9% 0.61 / 0.59 / +3.4%
tpch_q10/datafusion:vortex-file-compressed 16877680 / 17741482 / -4.9% 49790928 / 53082340 / -6.2% 0.34 / 0.33 / +1.4%
tpch_q11/datafusion:vortex-file-compressed 14068885 / 14031627 / +0.3% 33226656 / 33512469 / -0.9% 0.42 / 0.42 / +1.1%
tpch_q12/datafusion:vortex-file-compressed 18633244 / 18328359 / +1.7% 42488335 / 45157861 / -5.9% 0.44 / 0.41 / +8.1%
tpch_q13/datafusion:vortex-file-compressed 19530769 / 19616934 / -0.4% 41662497 / 38185157 / +9.1% 0.47 / 0.51 / -8.7%
tpch_q14/datafusion:vortex-file-compressed 14664715 / 14594152 / +0.5% 36329188 / 39735581 / -8.6% 0.40 / 0.37 / +9.9%
tpch_q15/datafusion:vortex-file-compressed 18627162 / 18763971 / -0.7% 41058638 / 43533246 / -5.7% 0.45 / 0.43 / +5.3%
tpch_q16/datafusion:vortex-file-compressed 18188475 / 18234276 / -0.3% 39324904 / 37635522 / +4.5% 0.46 / 0.48 / -4.5%
tpch_q17/datafusion:vortex-file-compressed 28478699 / 28378421 / +0.4% 60804021 / 61847418 / -1.7% 0.47 / 0.46 / +2.1%
tpch_q18/datafusion:vortex-file-compressed 35010805 / 35305543 / -0.8% 58614718 / 61599150 / -4.8% 0.60 / 0.57 / +4.2%
tpch_q19/datafusion:vortex-file-compressed 10551963 / 11827307 / -10.8% 🟢 39426246 / 35891404 / +9.8% 0.27 / 0.33 / -18.8%
tpch_q20/datafusion:vortex-file-compressed 19986887 / 20441467 / -2.2% 44513305 / 46957425 / -5.2% 0.45 / 0.44 / +3.1%
tpch_q21/datafusion:vortex-file-compressed 39143682 / 38735030 / +1.1% 68969331 / 69895942 / -1.3% 0.57 / 0.55 / +2.4%
tpch_q22/datafusion:vortex-file-compressed 10545023 / 10820078 / -2.5% 31104343 / 29933093 / +3.9% 0.34 / 0.36 / -6.2%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72074432 / 71895679 / +0.2% 88304365 / 90101832 / -2.0% 0.82 / 0.80 / +2.3%
tpch_q02/datafusion:parquet 76160268 / 76098843 / +0.1% 92007041 / 90855700 / +1.3% 0.83 / 0.84 / -1.2%
tpch_q03/datafusion:parquet 81354082 / 81802859 / -0.5% 104186353 / 104624570 / -0.4% 0.78 / 0.78 / -0.1%
tpch_q04/datafusion:parquet 39086967 / 39443450 / -0.9% 58199410 / 56105007 / +3.7% 0.67 / 0.70 / -4.5%
tpch_q05/datafusion:parquet 110483227 / 110243073 / +0.2% 138598672 / 137233632 / +1.0% 0.80 / 0.80 / -0.8%
tpch_q06/datafusion:parquet 31158681 / 31285870 / -0.4% 47304465 / 48958203 / -3.4% 0.66 / 0.64 / +3.1%
tpch_q07/datafusion:parquet 112218138 / 112628638 / -0.4% 138952062 / 140164965 / -0.9% 0.81 / 0.80 / +0.5%
tpch_q08/datafusion:parquet 117418805 / 117365432 / +0.0% 144090137 / 144858333 / -0.5% 0.81 / 0.81 / +0.6%
tpch_q09/datafusion:parquet 137496895 / 137648335 / -0.1% 165628730 / 165675523 / -0.0% 0.83 / 0.83 / -0.1%
tpch_q10/datafusion:parquet 104024292 / 104232599 / -0.2% 127082714 / 131557659 / -3.4% 0.82 / 0.79 / +3.3%
tpch_q11/datafusion:parquet 62207692 / 61117621 / +1.8% 80830714 / 83469534 / -3.2% 0.77 / 0.73 / +5.1%
tpch_q12/datafusion:parquet 63703195 / 63935260 / -0.4% 85051378 / 85713684 / -0.8% 0.75 / 0.75 / +0.4%
tpch_q13/datafusion:parquet 142910504 / 143039529 / -0.1% 162449428 / 163205266 / -0.5% 0.88 / 0.88 / +0.4%
tpch_q14/datafusion:parquet 47426834 / 47461665 / -0.1% 67766697 / 70523444 / -3.9% 0.70 / 0.67 / +4.0%
tpch_q15/datafusion:parquet 73676958 / 73406392 / +0.4% 92492714 / 92742867 / -0.3% 0.80 / 0.79 / +0.6%
tpch_q16/datafusion:parquet 43829698 / 43563928 / +0.6% 61759069 / 63270122 / -2.4% 0.71 / 0.69 / +3.1%
tpch_q17/datafusion:parquet 122539859 / 123301020 / -0.6% 146452004 / 147211074 / -0.5% 0.84 / 0.84 / -0.1%
tpch_q18/datafusion:parquet 121061016 / 121046192 / +0.0% 140069213 / 142737474 / -1.9% 0.86 / 0.85 / +1.9%
tpch_q19/datafusion:parquet 56584426 / 57598916 / -1.8% 81789290 / 84233107 / -2.9% 0.69 / 0.68 / +1.2%
tpch_q20/datafusion:parquet 78172832 / 77933849 / +0.3% 102634661 / 103206085 / -0.6% 0.76 / 0.76 / +0.9%
tpch_q21/datafusion:parquet 112972807 / 113408807 / -0.4% 138007568 / 138663269 / -0.5% 0.82 / 0.82 / +0.1%
tpch_q22/datafusion:parquet 51892994 / 52165988 / -0.5% 66933587 / 67936274 / -1.5% 0.78 / 0.77 / +1.0%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8793750 / 9761332 / -9.9% 19345718 / 18912466 / +2.3% 0.45 / 0.52 / -11.9%
tpch_q02/duckdb:vortex-file-compressed 15454202 / 15133618 / +2.1% 25030117 / 25240568 / -0.8% 0.62 / 0.60 / +3.0%
tpch_q03/duckdb:vortex-file-compressed 18598897 / 18478693 / +0.7% 34678935 / 35420760 / -2.1% 0.54 / 0.52 / +2.8%
tpch_q04/duckdb:vortex-file-compressed 12499790 / 12526559 / -0.2% 28123713 / 26797289 / +4.9% 0.44 / 0.47 / -4.9%
tpch_q05/duckdb:vortex-file-compressed 20119859 / 19984330 / +0.7% 35919953 / 35135251 / +2.2% 0.56 / 0.57 / -1.5%
tpch_q06/duckdb:vortex-file-compressed 4695480 / 4707229 / -0.2% 15197198 / 14897236 / +2.0% 0.31 / 0.32 / -2.2%
tpch_q07/duckdb:vortex-file-compressed 24359480 / 24433501 / -0.3% 41603561 / 40669053 / +2.3% 0.59 / 0.60 / -2.5%
tpch_q08/duckdb:vortex-file-compressed 21038929 / 21158117 / -0.6% 36783098 / 37360088 / -1.5% 0.57 / 0.57 / +1.0%
tpch_q09/duckdb:vortex-file-compressed 22016341 / 21780886 / +1.1% 39033584 / 39377115 / -0.9% 0.56 / 0.55 / +2.0%
tpch_q10/duckdb:vortex-file-compressed 22490622 / 23061494 / -2.5% 39575378 / 40021706 / -1.1% 0.57 / 0.58 / -1.4%
tpch_q11/duckdb:vortex-file-compressed 8300855 / 8190706 / +1.3% 17248949 / 17311375 / -0.4% 0.48 / 0.47 / +1.7%
tpch_q12/duckdb:vortex-file-compressed 14752639 / 14552453 / +1.4% 26824497 / 27518794 / -2.5% 0.55 / 0.53 / +4.0%
tpch_q13/duckdb:vortex-file-compressed 19665882 / 19645042 / +0.1% 31775986 / 32940206 / -3.5% 0.62 / 0.60 / +3.8%
tpch_q14/duckdb:vortex-file-compressed 11250892 / 11380023 / -1.1% 23682349 / 24837163 / -4.6% 0.48 / 0.46 / +3.7%
tpch_q15/duckdb:vortex-file-compressed 8796462 / 8545626 / +2.9% 20936125 / 20629863 / +1.5% 0.42 / 0.41 / +1.4%
tpch_q16/duckdb:vortex-file-compressed 16642645 / 16616443 / +0.2% 23345819 / 22882070 / +2.0% 0.71 / 0.73 / -1.8%
tpch_q17/duckdb:vortex-file-compressed 12459376 / 12625912 / -1.3% 28881068 / 26443070 / +9.2% 0.43 / 0.48 / -9.6%
tpch_q18/duckdb:vortex-file-compressed 24396493 / 24532908 / -0.6% 35088979 / 34479790 / +1.8% 0.70 / 0.71 / -2.3%
tpch_q19/duckdb:vortex-file-compressed 11399573 / 12047148 / -5.4% 26196985 / 25716209 / +1.9% 0.44 / 0.47 / -7.1%
tpch_q20/duckdb:vortex-file-compressed 14107274 / 14345954 / -1.7% 31637447 / 30444524 / +3.9% 0.45 / 0.47 / -5.4%
tpch_q21/duckdb:vortex-file-compressed 37258262 / 37122052 / +0.4% 57181820 / 57121904 / +0.1% 0.65 / 0.65 / +0.3%
tpch_q22/duckdb:vortex-file-compressed 16683336 / 16816566 / -0.8% 27049860 / 25979595 / +4.1% 0.62 / 0.65 / -4.7%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47699258 / 47858045 / -0.3% 54352379 / 54404459 / -0.1% 0.88 / 0.88 / -0.2%
tpch_q02/duckdb:parquet 48156969 / 48336474 / -0.4% 55020177 / 55353685 / -0.6% 0.88 / 0.87 / +0.2%
tpch_q03/duckdb:parquet 60416561 / 60227192 / +0.3% 68586281 / 68349323 / +0.3% 0.88 / 0.88 / -0.0%
tpch_q04/duckdb:parquet 34776413 / 34720265 / +0.2% 43359663 / 43310065 / +0.1% 0.80 / 0.80 / +0.0%
tpch_q05/duckdb:parquet 67120631 / 67254941 / -0.2% 76755009 / 77626992 / -1.1% 0.87 / 0.87 / +0.9%
tpch_q06/duckdb:parquet 21698487 / 21944900 / -1.1% 27107732 / 27248080 / -0.5% 0.80 / 0.81 / -0.6%
tpch_q07/duckdb:parquet 63939452 / 63950143 / -0.0% 73245246 / 73664982 / -0.6% 0.87 / 0.87 / +0.6%
tpch_q08/duckdb:parquet 75641731 / 75776774 / -0.2% 87096632 / 86626463 / +0.5% 0.87 / 0.87 / -0.7%
tpch_q09/duckdb:parquet 107971981 / 107707033 / +0.2% 119695722 / 119514067 / +0.2% 0.90 / 0.90 / +0.1%
tpch_q10/duckdb:parquet 105704485 / 105854709 / -0.1% 117939808 / 118365462 / -0.4% 0.90 / 0.89 / +0.2%
tpch_q11/duckdb:parquet 29360579 / 29396110 / -0.1% 34519243 / 34577937 / -0.2% 0.85 / 0.85 / +0.0%
tpch_q12/duckdb:parquet 37234472 / 37190745 / +0.1% 44667945 / 44080916 / +1.3% 0.83 / 0.84 / -1.2%
tpch_q13/duckdb:parquet 175149782 / 174943548 / +0.1% 183887433 / 181832631 / +1.1% 0.95 / 0.96 / -1.0%
tpch_q14/duckdb:parquet 42349299 / 42368298 / -0.0% 50420831 / 51640657 / -2.4% 0.84 / 0.82 / +2.4%
tpch_q15/duckdb:parquet 32681776 / 32604664 / +0.2% 41151766 / 41186217 / -0.1% 0.79 / 0.79 / +0.3%
tpch_q16/duckdb:parquet 47688571 / 47438886 / +0.5% 52490250 / 52839714 / -0.7% 0.91 / 0.90 / +1.2%
tpch_q17/duckdb:parquet 47951628 / 47948653 / +0.0% 57311393 / 56916284 / +0.7% 0.84 / 0.84 / -0.7%
tpch_q18/duckdb:parquet 74365255 / 74218067 / +0.2% 80457370 / 81836806 / -1.7% 0.92 / 0.91 / +1.9%
tpch_q19/duckdb:parquet 49869842 / 47859814 / +4.2% 54675151 / 54599501 / +0.1% 0.91 / 0.88 / +4.1%
tpch_q20/duckdb:parquet 63571633 / 63470737 / +0.2% 75093869 / 74451035 / +0.9% 0.85 / 0.85 / -0.7%
tpch_q21/duckdb:parquet 106694811 / 106811631 / -0.1% 116517988 / 115756341 / +0.7% 0.92 / 0.92 / -0.8%
tpch_q22/duckdb:parquet 50491922 / 50510487 / -0.0% 58730922 / 58832593 / -0.2% 0.86 / 0.86 / +0.1%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR a29c280d vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92526813 / 92421374 / +0.1% 147118590 / 147337644 / -0.1% 0.63 / 0.63 / +0.3%
tpch_q02/datafusion:vortex-file-compressed 64918997 / 65027104 / -0.2% 98769233 / 94796662 / +4.2% 0.66 / 0.69 / -4.2%
tpch_q03/datafusion:vortex-file-compressed 63246345 / 63028520 / +0.3% 118183319 / 120349559 / -1.8% 0.54 / 0.52 / +2.2%
tpch_q04/datafusion:vortex-file-compressed 33748066 / 33815475 / -0.2% 74366748 / 69506239 / +7.0% 0.45 / 0.49 / -6.7%
tpch_q05/datafusion:vortex-file-compressed 118435146 / 117313380 / +1.0% 173907102 / 176710106 / -1.6% 0.68 / 0.66 / +2.6%
tpch_q06/datafusion:vortex-file-compressed 10431341 / 10725012 / -2.7% 58820390 / 57362676 / +2.5% 0.18 / 0.19 / -5.1%
tpch_q07/datafusion:vortex-file-compressed 134895372 / 134275774 / +0.5% 202189711 / 209952759 / -3.7% 0.67 / 0.64 / +4.3%
tpch_q08/datafusion:vortex-file-compressed 143218567 / 142650106 / +0.4% 204513614 / 221708280 / -7.8% 0.70 / 0.64 / +8.8%
tpch_q09/datafusion:vortex-file-compressed 182582240 / 184132835 / -0.8% 246293792 / 257568148 / -4.4% 0.74 / 0.71 / +3.7%
tpch_q10/datafusion:vortex-file-compressed 69654213 / 69455539 / +0.3% 138703475 / 134716861 / +3.0% 0.50 / 0.52 / -2.6%
tpch_q11/datafusion:vortex-file-compressed 42727428 / 43143661 / -1.0% 72631539 / 67640381 / +7.4% 0.59 / 0.64 / -7.8%
tpch_q12/datafusion:vortex-file-compressed 34883582 / 35061881 / -0.5% 78872067 / 85227270 / -7.5% 0.44 / 0.41 / +7.5%
tpch_q13/datafusion:vortex-file-compressed 48307834 / 48574220 / -0.5% 82021835 / 87462734 / -6.2% 0.59 / 0.56 / +6.0%
tpch_q14/datafusion:vortex-file-compressed 21272940 / 21632584 / -1.7% 87230025 / 86011756 / +1.4% 0.24 / 0.25 / -3.0%
tpch_q15/datafusion:vortex-file-compressed 33400349 / 33883815 / -1.4% 89061267 / 91939519 / -3.1% 0.38 / 0.37 / +1.8%
tpch_q16/datafusion:vortex-file-compressed 37426766 / 37360931 / +0.2% 66535550 / 67235326 / -1.0% 0.56 / 0.56 / +1.2%
tpch_q17/datafusion:vortex-file-compressed 176051071 / 179258740 / -1.8% 227560570 / 225548853 / +0.9% 0.77 / 0.79 / -2.7%
tpch_q18/datafusion:vortex-file-compressed 202856771 / 208064713 / -2.5% 278792634 / 265841334 / +4.9% 0.73 / 0.78 / -7.0%
tpch_q19/datafusion:vortex-file-compressed 29900877 / 30852811 / -3.1% 89670241 / 90459069 / -0.9% 0.33 / 0.34 / -2.2%
tpch_q20/datafusion:vortex-file-compressed 60152352 / 60119739 / +0.1% 120693491 / 116242771 / +3.8% 0.50 / 0.52 / -3.6%
tpch_q21/datafusion:vortex-file-compressed 177086612 / 179920903 / -1.6% 243489649 / 236016105 / +3.2% 0.73 / 0.76 / -4.6%
tpch_q22/datafusion:vortex-file-compressed 25415416 / 24937759 / +1.9% 52541720 / 53553354 / -1.9% 0.48 / 0.47 / +3.9%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87679111 / 87372046 / +0.4% 124938172 / 127117134 / -1.7% 0.70 / 0.69 / +2.1%
tpch_q02/datafusion:parquet 173947632 / 173541457 / +0.2% 195388452 / 200787531 / -2.7% 0.89 / 0.86 / +3.0%
tpch_q03/datafusion:parquet 135490601 / 135400852 / +0.1% 182659137 / 177515979 / +2.9% 0.74 / 0.76 / -2.8%
tpch_q04/datafusion:parquet 56993774 / 57301728 / -0.5% 90696549 / 90634805 / +0.1% 0.63 / 0.63 / -0.6%
tpch_q05/datafusion:parquet 166722478 / 167450726 / -0.4% 219784219 / 216918602 / +1.3% 0.76 / 0.77 / -1.7%
tpch_q06/datafusion:parquet 36550957 / 36759711 / -0.6% 72774894 / 73377160 / -0.8% 0.50 / 0.50 / +0.3%
tpch_q07/datafusion:parquet 214997391 / 217452485 / -1.1% 263095125 / 278757728 / -5.6% 0.82 / 0.78 / +4.8%
tpch_q08/datafusion:parquet 218044621 / 217547432 / +0.2% 282212749 / 281050041 / +0.4% 0.77 / 0.77 / -0.2%
tpch_q09/datafusion:parquet 311009305 / 309992739 / +0.3% 374100337 / 377617099 / -0.9% 0.83 / 0.82 / +1.3%
tpch_q10/datafusion:parquet 311501726 / 312607055 / -0.4% 369336688 / 374635413 / -1.4% 0.84 / 0.83 / +1.1%
tpch_q11/datafusion:parquet 126860197 / 126904955 / -0.0% 152635155 / 152092729 / +0.4% 0.83 / 0.83 / -0.4%
tpch_q12/datafusion:parquet 81941753 / 82490217 / -0.7% 118888415 / 119609598 / -0.6% 0.69 / 0.69 / -0.1%
tpch_q13/datafusion:parquet 210444222 / 210792627 / -0.2% 239489277 / 238505978 / +0.4% 0.88 / 0.88 / -0.6%
tpch_q14/datafusion:parquet 84957129 / 86178289 / -1.4% 188184859 / 190854700 / -1.4% 0.45 / 0.45 / -0.0%
tpch_q15/datafusion:parquet 106053817 / 106397081 / -0.3% 152525636 / 152062782 / +0.3% 0.70 / 0.70 / -0.6%
tpch_q16/datafusion:parquet 95229777 / 95891635 / -0.7% 118698551 / 122835240 / -3.4% 0.80 / 0.78 / +2.8%
tpch_q17/datafusion:parquet 214489962 / 215828919 / -0.6% 261281147 / 258232254 / +1.2% 0.82 / 0.84 / -1.8%
tpch_q18/datafusion:parquet 269648344 / 267911042 / +0.6% 306294250 / 315891179 / -3.0% 0.88 / 0.85 / +3.8%
tpch_q19/datafusion:parquet 109190639 / 108165843 / +0.9% 167107441 / 161949085 / +3.2% 0.65 / 0.67 / -2.2%
tpch_q20/datafusion:parquet 185837446 / 185545816 / +0.2% 249071220 / 247539770 / +0.6% 0.75 / 0.75 / -0.5%
tpch_q21/datafusion:parquet 243880739 / 244526968 / -0.3% 309317385 / 313261935 / -1.3% 0.79 / 0.78 / +1.0%
tpch_q22/datafusion:parquet 149687620 / 150249864 / -0.4% 175603222 / 175023324 / +0.3% 0.85 / 0.86 / -0.7%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33067082 / 33717250 / -1.9% 75562587 / 72546071 / +4.2% 0.44 / 0.46 / -5.8%
tpch_q02/duckdb:vortex-file-compressed 28314619 / 28535483 / -0.8% 43623383 / 42812168 / +1.9% 0.65 / 0.67 / -2.6%
tpch_q03/duckdb:vortex-file-compressed 53066048 / 52395190 / +1.3% 106152349 / 107856916 / -1.6% 0.50 / 0.49 / +2.9%
tpch_q04/duckdb:vortex-file-compressed 51740791 / 51642374 / +0.2% 88008372 / 90715191 / -3.0% 0.59 / 0.57 / +3.3%
tpch_q05/duckdb:vortex-file-compressed 69413032 / 68284064 / +1.7% 110901600 / 112287453 / -1.2% 0.63 / 0.61 / +2.9%
tpch_q06/duckdb:vortex-file-compressed 15506191 / 15523980 / -0.1% 51442574 / 54001994 / -4.7% 0.30 / 0.29 / +4.9%
tpch_q07/duckdb:vortex-file-compressed 56014135 / 56289317 / -0.5% 109292154 / 109517607 / -0.2% 0.51 / 0.51 / -0.3%
tpch_q08/duckdb:vortex-file-compressed 87754403 / 87993665 / -0.3% 134907465 / 136034326 / -0.8% 0.65 / 0.65 / +0.6%
tpch_q09/duckdb:vortex-file-compressed 103131926 / 104478542 / -1.3% 152734547 / 160545830 / -4.9% 0.68 / 0.65 / +3.8%
tpch_q10/duckdb:vortex-file-compressed 95414067 / 96530974 / -1.2% 146888592 / 149480239 / -1.7% 0.65 / 0.65 / +0.6%
tpch_q11/duckdb:vortex-file-compressed 13424758 / 13271624 / +1.2% 28731623 / 28437282 / +1.0% 0.47 / 0.47 / +0.1%
tpch_q12/duckdb:vortex-file-compressed 44767756 / 44829286 / -0.1% 83268989 / 82101250 / +1.4% 0.54 / 0.55 / -1.5%
tpch_q13/duckdb:vortex-file-compressed 71285611 / 73482635 / -3.0% 101394450 / 100644151 / +0.7% 0.70 / 0.73 / -3.7%
tpch_q14/duckdb:vortex-file-compressed 28294396 / 28597524 / -1.1% 73490701 / 75301257 / -2.4% 0.39 / 0.38 / +1.4%
tpch_q15/duckdb:vortex-file-compressed 24859557 / 24850425 / +0.0% 64773019 / 64680737 / +0.1% 0.38 / 0.38 / -0.1%
tpch_q16/duckdb:vortex-file-compressed 49002722 / 48665139 / +0.7% 58302981 / 57917111 / +0.7% 0.84 / 0.84 / +0.0%
tpch_q17/duckdb:vortex-file-compressed 35455265 / 35017407 / +1.3% 68266893 / 68787564 / -0.8% 0.52 / 0.51 / +2.0%
tpch_q18/duckdb:vortex-file-compressed 110132488 / 101349193 / +8.7% 126399992 / 121104468 / +4.4% 0.87 / 0.84 / +4.1%
tpch_q19/duckdb:vortex-file-compressed 27749046 / 27586274 / +0.6% 77346567 / 75468750 / +2.5% 0.36 / 0.37 / -1.9%
tpch_q20/duckdb:vortex-file-compressed 42462313 / 42028653 / +1.0% 96414676 / 94143242 / +2.4% 0.44 / 0.45 / -1.3%
tpch_q21/duckdb:vortex-file-compressed 94893237 / 92926669 / +2.1% 150037850 / 149459387 / +0.4% 0.63 / 0.62 / +1.7%
tpch_q22/duckdb:vortex-file-compressed 33544622 / 32967821 / +1.7% 47817876 / 50673568 / -5.6% 0.70 / 0.65 / +7.8%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67692803 / 68059780 / -0.5% 86117798 / 89550266 / -3.8% 0.79 / 0.76 / +3.4%
tpch_q02/duckdb:parquet 86953121 / 87335480 / -0.4% 97228069 / 97718209 / -0.5% 0.89 / 0.89 / +0.1%
tpch_q03/duckdb:parquet 109730749 / 110511015 / -0.7% 142320820 / 142463897 / -0.1% 0.77 / 0.78 / -0.6%
tpch_q04/duckdb:parquet 76607040 / 76502436 / +0.1% 98892574 / 99440715 / -0.6% 0.77 / 0.77 / +0.7%
tpch_q05/duckdb:parquet 123156664 / 124172926 / -0.8% 157425763 / 157124433 / +0.2% 0.78 / 0.79 / -1.0%
tpch_q06/duckdb:parquet 35058301 / 35619223 / -1.6% 58103758 / 66005123 / -12.0% 🟢 0.60 / 0.54 / +11.8%
tpch_q07/duckdb:parquet 116692811 / 117398526 / -0.6% 153268975 / 154106673 / -0.5% 0.76 / 0.76 / -0.1%
tpch_q08/duckdb:parquet 146977647 / 147136506 / -0.1% 192471872 / 191273949 / +0.6% 0.76 / 0.77 / -0.7%
tpch_q09/duckdb:parquet 236497973 / 236712079 / -0.1% 276164193 / 283406742 / -2.6% 0.86 / 0.84 / +2.5%
tpch_q10/duckdb:parquet 313480018 / 314185931 / -0.2% 339306986 / 343372079 / -1.2% 0.92 / 0.92 / +1.0%
tpch_q11/duckdb:parquet 43703004 / 43742423 / -0.1% 50582958 / 50965528 / -0.8% 0.86 / 0.86 / +0.7%
tpch_q12/duckdb:parquet 70228390 / 71137236 / -1.3% 90992054 / 91779500 / -0.9% 0.77 / 0.78 / -0.4%
tpch_q13/duckdb:parquet 293595668 / 293366910 / +0.1% 307714469 / 308621731 / -0.3% 0.95 / 0.95 / +0.4%
tpch_q14/duckdb:parquet 101884477 / 102273386 / -0.4% 136895522 / 141851063 / -3.5% 0.74 / 0.72 / +3.2%
tpch_q15/duckdb:parquet 57822226 / 57070305 / +1.3% 85739387 / 86533692 / -0.9% 0.67 / 0.66 / +2.3%
tpch_q16/duckdb:parquet 100517517 / 100916878 / -0.4% 107227327 / 107993358 / -0.7% 0.94 / 0.93 / +0.3%
tpch_q17/duckdb:parquet 81538153 / 82884448 / -1.6% 115584480 / 124989202 / -7.5% 0.71 / 0.66 / +6.4%
tpch_q18/duckdb:parquet 157879109 / 157350187 / +0.3% 181949736 / 174516370 / +4.3% 0.87 / 0.90 / -3.8%
tpch_q19/duckdb:parquet 97892587 / 98221882 / -0.3% 124982308 / 134004453 / -6.7% 0.78 / 0.73 / +6.9%
tpch_q20/duckdb:parquet 147264291 / 147378796 / -0.1% 184214695 / 187264562 / -1.6% 0.80 / 0.79 / +1.6%
tpch_q21/duckdb:parquet 253243808 / 251811968 / +0.6% 279796130 / 275521800 / +1.6% 0.91 / 0.91 / -1.0%
tpch_q22/duckdb:parquet 168541168 / 168385842 / +0.1% 179918214 / 180610188 / -0.4% 0.94 / 0.93 / +0.5%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR a29c280d vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.004x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21004381 / 21075930 / -0.3% 36998350 / 38638247 / -4.2% 0.57 / 0.55 / +4.1%
tpcds_q02/datafusion:vortex-file-compressed 44413426 / 44337330 / +0.2% 64296339 / 64322678 / -0.0% 0.69 / 0.69 / +0.2%
tpcds_q03/datafusion:vortex-file-compressed 11344850 / 11162676 / +1.6% 27833440 / 27874319 / -0.1% 0.41 / 0.40 / +1.8%
tpcds_q04/datafusion:vortex-file-compressed 87143076 / 86734277 / +0.5% 122162126 / 118451152 / +3.1% 0.71 / 0.73 / -2.6%
tpcds_q05/datafusion:vortex-file-compressed 56952000 / 56827797 / +0.2% 80795399 / 76114099 / +6.2% 0.70 / 0.75 / -5.6%
tpcds_q06/datafusion:vortex-file-compressed 22975636 / 22692446 / +1.2% 42149888 / 42045614 / +0.2% 0.55 / 0.54 / +1.0%
tpcds_q07/datafusion:vortex-file-compressed 28390569 / 28756891 / -1.3% 51084082 / 50270298 / +1.6% 0.56 / 0.57 / -2.8%
tpcds_q08/datafusion:vortex-file-compressed 24522056 / 24565008 / -0.2% 45793607 / 44075611 / +3.9% 0.54 / 0.56 / -3.9%
tpcds_q09/datafusion:vortex-file-compressed 20471229 / 21207415 / -3.5% 35331504 / 35851284 / -1.4% 0.58 / 0.59 / -2.1%
tpcds_q10/datafusion:vortex-file-compressed 27002631 / 27171788 / -0.6% 48487344 / 48716984 / -0.5% 0.56 / 0.56 / -0.2%
tpcds_q11/datafusion:vortex-file-compressed 52797596 / 52909560 / -0.2% 78120160 / 79987379 / -2.3% 0.68 / 0.66 / +2.2%
tpcds_q12/datafusion:vortex-file-compressed 14633330 / 14883221 / -1.7% 31418238 / 31358319 / +0.2% 0.47 / 0.47 / -1.9%
tpcds_q13/datafusion:vortex-file-compressed 30779962 / 31185554 / -1.3% 55925262 / 56269502 / -0.6% 0.55 / 0.55 / -0.7%
tpcds_q14/datafusion:vortex-file-compressed 483957802 / 489067088 / -1.0% 543215843 / 543494011 / -0.1% 0.89 / 0.90 / -1.0%
tpcds_q15/datafusion:vortex-file-compressed 12612136 / 12361730 / +2.0% 32229767 / 32624708 / -1.2% 0.39 / 0.38 / +3.3%
tpcds_q16/datafusion:vortex-file-compressed 17941418 / 18767600 / -4.4% 37241286 / 37497209 / -0.7% 0.48 / 0.50 / -3.7%
tpcds_q17/datafusion:vortex-file-compressed 54157071 / 54689321 / -1.0% 74727780 / 71444295 / +4.6% 0.72 / 0.77 / -5.3%
tpcds_q18/datafusion:vortex-file-compressed 62898981 / 62745430 / +0.2% 85458825 / 84923290 / +0.6% 0.74 / 0.74 / -0.4%
tpcds_q19/datafusion:vortex-file-compressed 16676667 / 16953830 / -1.6% 36017816 / 38328755 / -6.0% 0.46 / 0.44 / +4.7%
tpcds_q20/datafusion:vortex-file-compressed 16120296 / 15971812 / +0.9% 36265822 / 36958911 / -1.9% 0.44 / 0.43 / +2.9%
tpcds_q21/datafusion:vortex-file-compressed 16444321 / 16341850 / +0.6% 35645791 / 37152728 / -4.1% 0.46 / 0.44 / +4.9%
tpcds_q22/datafusion:vortex-file-compressed 49232754 / 49281792 / -0.1% 71635795 / 72884478 / -1.7% 0.69 / 0.68 / +1.6%
tpcds_q23/datafusion:vortex-file-compressed 70565467 / 70660138 / -0.1% 97376861 / 98187087 / -0.8% 0.72 / 0.72 / +0.7%
tpcds_q24/datafusion:vortex-file-compressed 65197216 / 64849742 / +0.5% 85829780 / 85912267 / -0.1% 0.76 / 0.75 / +0.6%
tpcds_q25/datafusion:vortex-file-compressed 44725430 / 48102446 / -7.0% 74508660 / 73606543 / +1.2% 0.60 / 0.65 / -8.1%
tpcds_q26/datafusion:vortex-file-compressed 25454788 / 25675571 / -0.9% 46109273 / 46144233 / -0.1% 0.55 / 0.56 / -0.8%
tpcds_q27/datafusion:vortex-file-compressed 62327000 / 57037719 / +9.3% 83667293 / 79256017 / +5.6% 0.74 / 0.72 / +3.5%
tpcds_q28/datafusion:vortex-file-compressed 24514909 / 24421590 / +0.4% 41165199 / 41637022 / -1.1% 0.60 / 0.59 / +1.5%
tpcds_q29/datafusion:vortex-file-compressed 52905304 / 53192800 / -0.5% 77292999 / 75657345 / +2.2% 0.68 / 0.70 / -2.6%
tpcds_q30/datafusion:vortex-file-compressed 26806298 / 25828708 / +3.8% 44189114 / 43291925 / +2.1% 0.61 / 0.60 / +1.7%
tpcds_q31/datafusion:vortex-file-compressed 58437666 / 58867606 / -0.7% 82847595 / 83455412 / -0.7% 0.71 / 0.71 / -0.0%
tpcds_q32/datafusion:vortex-file-compressed 12511882 / 12386412 / +1.0% 29109266 / 28927311 / +0.6% 0.43 / 0.43 / +0.4%
tpcds_q33/datafusion:vortex-file-compressed 27431128 / 27251526 / +0.7% 50595882 / 48738507 / +3.8% 0.54 / 0.56 / -3.0%
tpcds_q34/datafusion:vortex-file-compressed 17198992 / 17480834 / -1.6% 36482434 / 34421823 / +6.0% 0.47 / 0.51 / -7.2%
tpcds_q35/datafusion:vortex-file-compressed 30312896 / 30075320 / +0.8% 55038919 / 53053102 / +3.7% 0.55 / 0.57 / -2.8%
tpcds_q36/datafusion:vortex-file-compressed 47487864 / 46675208 / +1.7% 67483179 / 69079110 / -2.3% 0.70 / 0.68 / +4.1%
tpcds_q37/datafusion:vortex-file-compressed 11783602 / 11904318 / -1.0% 32216048 / 33415021 / -3.6% 0.37 / 0.36 / +2.7%
tpcds_q38/datafusion:vortex-file-compressed 25200586 / 25706742 / -2.0% 47933476 / 46753111 / +2.5% 0.53 / 0.55 / -4.4%
tpcds_q39/datafusion:vortex-file-compressed 65412084 / 64869784 / +0.8% 91547908 / 89570934 / +2.2% 0.71 / 0.72 / -1.3%
tpcds_q40/datafusion:vortex-file-compressed 23088404 / 23325174 / -1.0% 41851260 / 42047023 / -0.5% 0.55 / 0.55 / -0.6%
tpcds_q41/datafusion:vortex-file-compressed 20912330 / 20342688 / +2.8% 32502895 / 31695807 / +2.5% 0.64 / 0.64 / +0.2%
tpcds_q42/datafusion:vortex-file-compressed 10952874 / 10755524 / +1.8% 26174665 / 26462137 / -1.1% 0.42 / 0.41 / +3.0%
tpcds_q43/datafusion:vortex-file-compressed 12605542 / 12549322 / +0.4% 32086105 / 31280405 / +2.6% 0.39 / 0.40 / -2.1%
tpcds_q44/datafusion:vortex-file-compressed 28550177 / 28515654 / +0.1% 51838301 / 50995861 / +1.7% 0.55 / 0.56 / -1.5%
tpcds_q45/datafusion:vortex-file-compressed 16450994 / 16298120 / +0.9% 32884094 / 33457337 / -1.7% 0.50 / 0.49 / +2.7%
tpcds_q46/datafusion:vortex-file-compressed 22997944 / 23229427 / -1.0% 47249234 / 44755548 / +5.6% 0.49 / 0.52 / -6.2%
tpcds_q47/datafusion:vortex-file-compressed 74815996 / 74695810 / +0.2% 104404377 / 101833669 / +2.5% 0.72 / 0.73 / -2.3%
tpcds_q48/datafusion:vortex-file-compressed 28650224 / 28485442 / +0.6% 51781806 / 50825432 / +1.9% 0.55 / 0.56 / -1.3%
tpcds_q49/datafusion:vortex-file-compressed 56921080 / 56616678 / +0.5% 80236782 / 79193807 / +1.3% 0.71 / 0.71 / -0.8%
tpcds_q50/datafusion:vortex-file-compressed 30278419 / 30225275 / +0.2% 50966716 / 51542216 / -1.1% 0.59 / 0.59 / +1.3%
tpcds_q51/datafusion:vortex-file-compressed 66492437 / 66238316 / +0.4% 86538870 / 85961923 / +0.7% 0.77 / 0.77 / -0.3%
tpcds_q52/datafusion:vortex-file-compressed 11159405 / 11173757 / -0.1% 27946224 / 26707892 / +4.6% 0.40 / 0.42 / -4.6%
tpcds_q53/datafusion:vortex-file-compressed 17744508 / 17815272 / -0.4% 38253304 / 38592794 / -0.9% 0.46 / 0.46 / +0.5%
tpcds_q54/datafusion:vortex-file-compressed 31784159 / 31294044 / +1.6% 53933150 / 54411096 / -0.9% 0.59 / 0.58 / +2.5%
tpcds_q55/datafusion:vortex-file-compressed 10936587 / 10977064 / -0.4% 25441876 / 26445815 / -3.8% 0.43 / 0.42 / +3.6%
tpcds_q56/datafusion:vortex-file-compressed 26305554 / 26267608 / +0.1% 46498297 / 47242232 / -1.6% 0.57 / 0.56 / +1.7%
tpcds_q57/datafusion:vortex-file-compressed 61953133 / 61853212 / +0.2% 87279787 / 86088207 / +1.4% 0.71 / 0.72 / -1.2%
tpcds_q58/datafusion:vortex-file-compressed 38313481 / 38380444 / -0.2% 64337642 / 63376054 / +1.5% 0.60 / 0.61 / -1.7%
tpcds_q59/datafusion:vortex-file-compressed 29944862 / 29424571 / +1.8% 53965684 / 53366384 / +1.1% 0.55 / 0.55 / +0.6%
tpcds_q60/datafusion:vortex-file-compressed 26351060 / 25428852 / +3.6% 47686839 / 46248957 / +3.1% 0.55 / 0.55 / +0.5%
tpcds_q61/datafusion:vortex-file-compressed 21668902 / 21069785 / +2.8% 44679049 / 42650322 / +4.8% 0.48 / 0.49 / -1.8%
tpcds_q62/datafusion:vortex-file-compressed 16365737 / 16464280 / -0.6% 34207901 / 34481569 / -0.8% 0.48 / 0.48 / +0.2%
tpcds_q63/datafusion:vortex-file-compressed 17809922 / 17537600 / +1.6% 38156619 / 37514994 / +1.7% 0.47 / 0.47 / -0.2%
tpcds_q64/datafusion:vortex-file-compressed 211497092 / 209658176 / +0.9% 244881721 / 244014821 / +0.4% 0.86 / 0.86 / +0.5%
tpcds_q65/datafusion:vortex-file-compressed 73009319 / 71931186 / +1.5% 93987745 / 93293623 / +0.7% 0.78 / 0.77 / +0.7%
tpcds_q66/datafusion:vortex-file-compressed 49578290 / 50314022 / -1.5% 73332335 / 73443461 / -0.2% 0.68 / 0.69 / -1.3%
tpcds_q67/datafusion:vortex-file-compressed 50187340 / 50809885 / -1.2% 81571862 / 80439935 / +1.4% 0.62 / 0.63 / -2.6%
tpcds_q68/datafusion:vortex-file-compressed 22587800 / 22935066 / -1.5% 45546673 / 46212376 / -1.4% 0.50 / 0.50 / -0.1%
tpcds_q69/datafusion:vortex-file-compressed 25133252 / 25957220 / -3.2% 47325690 / 48199065 / -1.8% 0.53 / 0.54 / -1.4%
tpcds_q70/datafusion:vortex-file-compressed 71324088 / 70921686 / +0.6% 92719205 / 91526378 / +1.3% 0.77 / 0.77 / -0.7%
tpcds_q71/datafusion:vortex-file-compressed 18262206 / 19479654 / -6.2% 40414841 / 39385822 / +2.6% 0.45 / 0.49 / -8.6%
tpcds_q72/datafusion:vortex-file-compressed 344891512 / 349635619 / -1.4% 394866911 / 390053124 / +1.2% 0.87 / 0.90 / -2.6%
tpcds_q73/datafusion:vortex-file-compressed 16176050 / 16370256 / -1.2% 34695939 / 35825318 / -3.2% 0.47 / 0.46 / +2.0%
tpcds_q74/datafusion:vortex-file-compressed 40815442 / 40729710 / +0.2% 66958136 / 66101755 / +1.3% 0.61 / 0.62 / -1.1%
tpcds_q75/datafusion:vortex-file-compressed 136753950 / 133231577 / +2.6% 170087422 / 159508865 / +6.6% 0.80 / 0.84 / -3.7%
tpcds_q76/datafusion:vortex-file-compressed 29422781 / 29878010 / -1.5% 48651559 / 49131830 / -1.0% 0.60 / 0.61 / -0.6%
tpcds_q77/datafusion:vortex-file-compressed 44925410 / 44794824 / +0.3% 68955643 / 68725579 / +0.3% 0.65 / 0.65 / -0.0%
tpcds_q78/datafusion:vortex-file-compressed 64106632 / 64149016 / -0.1% 90594406 / 91826652 / -1.3% 0.71 / 0.70 / +1.3%
tpcds_q79/datafusion:vortex-file-compressed 19604562 / 19747138 / -0.7% 41623322 / 41330856 / +0.7% 0.47 / 0.48 / -1.4%
tpcds_q80/datafusion:vortex-file-compressed 72903864 / 73516756 / -0.8% 100531342 / 103399339 / -2.8% 0.73 / 0.71 / +2.0%
tpcds_q81/datafusion:vortex-file-compressed 26400320 / 26433507 / -0.1% 43872120 / 44049315 / -0.4% 0.60 / 0.60 / +0.3%
tpcds_q82/datafusion:vortex-file-compressed 11908842 / 12061347 / -1.3% 32632593 / 33334269 / -2.1% 0.36 / 0.36 / +0.9%
tpcds_q83/datafusion:vortex-file-compressed 32977313 / 32437804 / +1.7% 49326332 / 52048289 / -5.2% 0.67 / 0.62 / +7.3%
tpcds_q84/datafusion:vortex-file-compressed 10068160 / 10107068 / -0.4% 25572399 / 25586667 / -0.1% 0.39 / 0.40 / -0.3%
tpcds_q85/datafusion:vortex-file-compressed 52778489 / 53327322 / -1.0% 78920804 / 79919547 / -1.2% 0.67 / 0.67 / +0.2%
tpcds_q86/datafusion:vortex-file-compressed 15675950 / 15658314 / +0.1% 32853361 / 32167556 / +2.1% 0.48 / 0.49 / -2.0%
tpcds_q87/datafusion:vortex-file-compressed 25862000 / 26232334 / -1.4% 46779515 / 48269535 / -3.1% 0.55 / 0.54 / +1.7%
tpcds_q88/datafusion:vortex-file-compressed 31450089 / 31404654 / +0.1% 51136547 / 50217706 / +1.8% 0.62 / 0.63 / -1.7%
tpcds_q89/datafusion:vortex-file-compressed 20930004 / 20857143 / +0.3% 40363501 / 40998842 / -1.5% 0.52 / 0.51 / +1.9%
tpcds_q90/datafusion:vortex-file-compressed 10003140 / 9857710 / +1.5% 24740485 / 24004775 / +3.1% 0.40 / 0.41 / -1.5%
tpcds_q91/datafusion:vortex-file-compressed 16730872 / 16590985 / +0.8% 35417197 / 36406808 / -2.7% 0.47 / 0.46 / +3.7%
tpcds_q92/datafusion:vortex-file-compressed 13398918 / 12785642 / +4.8% 28159119 / 28212901 / -0.2% 0.48 / 0.45 / +5.0%
tpcds_q93/datafusion:vortex-file-compressed 20241844 / 20514612 / -1.3% 40957061 / 39172325 / +4.6% 0.49 / 0.52 / -5.6%
tpcds_q94/datafusion:vortex-file-compressed 17900382 / 18329141 / -2.3% 36332049 / 37017769 / -1.9% 0.49 / 0.50 / -0.5%
tpcds_q95/datafusion:vortex-file-compressed 42294178 / 41892583 / +1.0% 62174803 / 60792282 / +2.3% 0.68 / 0.69 / -1.3%
tpcds_q96/datafusion:vortex-file-compressed 7530320 / 7680347 / -2.0% 23555962 / 24590568 / -4.2% 0.32 / 0.31 / +2.4%
tpcds_q97/datafusion:vortex-file-compressed 16863786 / 16976546 / -0.7% 37124257 / 36962622 / +0.4% 0.45 / 0.46 / -1.1%
tpcds_q98/datafusion:vortex-file-compressed 16595544 / 16323012 / +1.7% 36262865 / 35491744 / +2.2% 0.46 / 0.46 / -0.5%
tpcds_q99/datafusion:vortex-file-compressed 15793396 / 16055726 / -1.6% 35021046 / 34645287 / +1.1% 0.45 / 0.46 / -2.7%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43087190 / 42790168 / +0.7% 57269303 / 57645148 / -0.7% 0.75 / 0.74 / +1.4%
tpcds_q02/datafusion:parquet 54386236 / 54765044 / -0.7% 69479425 / 70421354 / -1.3% 0.78 / 0.78 / +0.7%
tpcds_q03/datafusion:parquet 18953730 / 19097265 / -0.8% 31468607 / 30445091 / +3.4% 0.60 / 0.63 / -4.0%
tpcds_q04/datafusion:parquet 177121390 / 178887614 / -1.0% 206680537 / 202039145 / +2.3% 0.86 / 0.89 / -3.2%
tpcds_q05/datafusion:parquet 64994029 / 67878001 / -4.2% 90399894 / 89709488 / +0.8% 0.72 / 0.76 / -5.0%
tpcds_q06/datafusion:parquet 33737614 / 33778804 / -0.1% 45827064 / 45692699 / +0.3% 0.74 / 0.74 / -0.4%
tpcds_q07/datafusion:parquet 46969662 / 47393786 / -0.9% 66849851 / 65545052 / +2.0% 0.70 / 0.72 / -2.8%
tpcds_q08/datafusion:parquet 31766939 / 30786170 / +3.2% 47487983 / 43159155 / +10.0% 🔴 0.67 / 0.71 / -6.2%
tpcds_q09/datafusion:parquet 31886632 / 30591208 / +4.2% 47517660 / 42974319 / +10.6% 🔴 0.67 / 0.71 / -5.7%
tpcds_q10/datafusion:parquet 43928234 / 43909954 / +0.0% 58576606 / 58393927 / +0.3% 0.75 / 0.75 / -0.3%
tpcds_q11/datafusion:parquet 98475072 / 97359220 / +1.1% 120668212 / 119001225 / +1.4% 0.82 / 0.82 / -0.3%
tpcds_q12/datafusion:parquet 23909755 / 23515044 / +1.7% 35500820 / 34010680 / +4.4% 0.67 / 0.69 / -2.6%
tpcds_q13/datafusion:parquet 47569316 / 46313484 / +2.7% 68647716 / 68018563 / +0.9% 0.69 / 0.68 / +1.8%
tpcds_q14/datafusion:parquet 533968686 / 534683184 / -0.1% 585868661 / 582375794 / +0.6% 0.91 / 0.92 / -0.7%
tpcds_q15/datafusion:parquet 23915330 / 24175697 / -1.1% 38300850 / 36583322 / +4.7% 0.62 / 0.66 / -5.5%
tpcds_q16/datafusion:parquet 36912525 / 37052644 / -0.4% 48906774 / 49572893 / -1.3% 0.75 / 0.75 / +1.0%
tpcds_q17/datafusion:parquet 73586780 / 75207760 / -2.2% 98150188 / 98319183 / -0.2% 0.75 / 0.76 / -2.0%
tpcds_q18/datafusion:parquet 63622575 / 67278429 / -5.4% 90944558 / 89472378 / +1.6% 0.70 / 0.75 / -7.0%
tpcds_q19/datafusion:parquet 29619446 / 29426323 / +0.7% 45234209 / 42286597 / +7.0% 0.65 / 0.70 / -5.9%
tpcds_q20/datafusion:parquet 25757860 / 24728196 / +4.2% 36968755 / 35453048 / +4.3% 0.70 / 0.70 / -0.1%
tpcds_q21/datafusion:parquet 20076793 / 19988597 / +0.4% 34687642 / 33163707 / +4.6% 0.58 / 0.60 / -4.0%
tpcds_q22/datafusion:parquet 77049635 / 77207674 / -0.2% 88489080 / 87517272 / +1.1% 0.87 / 0.88 / -1.3%
tpcds_q23/datafusion:parquet 91513304 / 91103138 / +0.5% 113735341 / 115810894 / -1.8% 0.80 / 0.79 / +2.3%
tpcds_q24/datafusion:parquet 91033662 / 90312194 / +0.8% 113090912 / 114753768 / -1.4% 0.80 / 0.79 / +2.3%
tpcds_q25/datafusion:parquet 80620242 / 82183728 / -1.9% 97332781 / 101090115 / -3.7% 0.83 / 0.81 / +1.9%
tpcds_q26/datafusion:parquet 42977388 / 43975604 / -2.3% 58895590 / 60140227 / -2.1% 0.73 / 0.73 / -0.2%
tpcds_q27/datafusion:parquet 76111095 / 75256415 / +1.1% 98571953 / 96796596 / +1.8% 0.77 / 0.78 / -0.7%
tpcds_q28/datafusion:parquet 28385305 / 28282492 / +0.4% 42179357 / 40540051 / +4.0% 0.67 / 0.70 / -3.5%
tpcds_q29/datafusion:parquet 75389502 / 76327373 / -1.2% 94853553 / 95497789 / -0.7% 0.79 / 0.80 / -0.6%
tpcds_q30/datafusion:parquet 44663482 / 44172996 / +1.1% 58424313 / 56428909 / +3.5% 0.76 / 0.78 / -2.3%
tpcds_q31/datafusion:parquet 79854570 / 81059734 / -1.5% 98859865 / 97847034 / +1.0% 0.81 / 0.83 / -2.5%
tpcds_q32/datafusion:parquet 26295942 / 26106716 / +0.7% 37692753 / 38996408 / -3.3% 0.70 / 0.67 / +4.2%
tpcds_q33/datafusion:parquet 38298912 / 36632188 / +4.5% 53107607 / 51696853 / +2.7% 0.72 / 0.71 / +1.8%
tpcds_q34/datafusion:parquet 24145700 / 24283762 / -0.6% 35090293 / 35496823 / -1.1% 0.69 / 0.68 / +0.6%
tpcds_q35/datafusion:parquet 49788454 / 51092331 / -2.6% 63441700 / 63128294 / +0.5% 0.78 / 0.81 / -3.0%
tpcds_q36/datafusion:parquet 52903324 / 52133216 / +1.5% 73540164 / 73276361 / +0.4% 0.72 / 0.71 / +1.1%
tpcds_q37/datafusion:parquet 21572488 / 21186441 / +1.8% 34082346 / 32501720 / +4.9% 0.63 / 0.65 / -2.9%
tpcds_q38/datafusion:parquet 44876516 / 44473320 / +0.9% 59458437 / 60661224 / -2.0% 0.75 / 0.73 / +2.9%
tpcds_q39/datafusion:parquet 68077562 / 67893870 / +0.3% 85954797 / 85512997 / +0.5% 0.79 / 0.79 / -0.2%
tpcds_q40/datafusion:parquet 30422242 / 30116612 / +1.0% 50077613 / 50944751 / -1.7% 0.61 / 0.59 / +2.8%
tpcds_q41/datafusion:parquet 19884637 / 19875884 / +0.0% 31068940 / 30988887 / +0.3% 0.64 / 0.64 / -0.2%
tpcds_q42/datafusion:parquet 18091610 / 18263912 / -0.9% 29069634 / 31580411 / -8.0% 0.62 / 0.58 / +7.6%
tpcds_q43/datafusion:parquet 19144098 / 19328598 / -1.0% 32167600 / 32363765 / -0.6% 0.60 / 0.60 / -0.4%
tpcds_q44/datafusion:parquet 34934704 / 34729506 / +0.6% 49379605 / 49650609 / -0.5% 0.71 / 0.70 / +1.1%
tpcds_q45/datafusion:parquet 27958874 / 27674712 / +1.0% 40327118 / 40581829 / -0.6% 0.69 / 0.68 / +1.7%
tpcds_q46/datafusion:parquet 28917850 / 28849347 / +0.2% 45378337 / 44446206 / +2.1% 0.64 / 0.65 / -1.8%
tpcds_q47/datafusion:parquet 97937359 / 97767068 / +0.2% 117003874 / 116071791 / +0.8% 0.84 / 0.84 / -0.6%
tpcds_q48/datafusion:parquet 41759604 / 42223134 / -1.1% 58011830 / 58362840 / -0.6% 0.72 / 0.72 / -0.5%
tpcds_q49/datafusion:parquet 70927535 / 71584984 / -0.9% 92888765 / 93559482 / -0.7% 0.76 / 0.77 / -0.2%
tpcds_q50/datafusion:parquet 47923232 / 47188732 / +1.6% 65788790 / 65957634 / -0.3% 0.73 / 0.72 / +1.8%
tpcds_q51/datafusion:parquet 75400894 / 75687516 / -0.4% 93998961 / 93987537 / +0.0% 0.80 / 0.81 / -0.4%
tpcds_q52/datafusion:parquet 18573896 / 18477546 / +0.5% 29619568 / 30516528 / -2.9% 0.63 / 0.61 / +3.6%
tpcds_q53/datafusion:parquet 22517375 / 22069787 / +2.0% 37253094 / 37394397 / -0.4% 0.60 / 0.59 / +2.4%
tpcds_q54/datafusion:parquet 52817647 / 53068499 / -0.5% 67836704 / 66798825 / +1.6% 0.78 / 0.79 / -2.0%
tpcds_q55/datafusion:parquet 18373636 / 18177591 / +1.1% 29343353 / 29615062 / -0.9% 0.63 / 0.61 / +2.0%
tpcds_q56/datafusion:parquet 41445022 / 40536538 / +2.2% 53078610 / 51702806 / +2.7% 0.78 / 0.78 / -0.4%
tpcds_q57/datafusion:parquet 100065488 / 100992704 / -0.9% 118295977 / 119321534 / -0.9% 0.85 / 0.85 / -0.1%
tpcds_q58/datafusion:parquet 65998465 / 65003510 / +1.5% 82214277 / 81993727 / +0.3% 0.80 / 0.79 / +1.3%
tpcds_q59/datafusion:parquet 47828728 / 47142071 / +1.5% 65081415 / 64332209 / +1.2% 0.73 / 0.73 / +0.3%
tpcds_q60/datafusion:parquet 40154070 / 41143805 / -2.4% 55443926 / 56528494 / -1.9% 0.72 / 0.73 / -0.5%
tpcds_q61/datafusion:parquet 35282475 / 37070528 / -4.8% 49866860 / 50658408 / -1.6% 0.71 / 0.73 / -3.3%
tpcds_q62/datafusion:parquet 25052354 / 25299585 / -1.0% 37000753 / 37400865 / -1.1% 0.68 / 0.68 / +0.1%
tpcds_q63/datafusion:parquet 22219257 / 22137338 / +0.4% 38780076 / 37267059 / +4.1% 0.57 / 0.59 / -3.5%
tpcds_q64/datafusion:parquet 285292457 / 283491307 / +0.6% 324977950 / 324365594 / +0.2% 0.88 / 0.87 / +0.4%
tpcds_q65/datafusion:parquet 119165556 / 121796900 / -2.2% 140767491 / 140340790 / +0.3% 0.85 / 0.87 / -2.5%
tpcds_q66/datafusion:parquet 59690304 / 60159790 / -0.8% 78360990 / 74271493 / +5.5% 0.76 / 0.81 / -6.0%
tpcds_q67/datafusion:parquet 68855562 / 69200688 / -0.5% 92410052 / 92158955 / +0.3% 0.75 / 0.75 / -0.8%
tpcds_q68/datafusion:parquet 28680744 / 28638674 / +0.1% 47773096 / 47694525 / +0.2% 0.60 / 0.60 / -0.0%
tpcds_q69/datafusion:parquet 44075247 / 43345552 / +1.7% 57825569 / 54686235 / +5.7% 0.76 / 0.79 / -3.8%
tpcds_q70/datafusion:parquet 81406574 / 80271896 / +1.4% 96464504 / 100088952 / -3.6% 0.84 / 0.80 / +5.2%
tpcds_q71/datafusion:parquet 23855320 / 24373552 / -2.1% 38081410 / 38366867 / -0.7% 0.63 / 0.64 / -1.4%
tpcds_q72/datafusion:parquet 522149854 / 527329837 / -1.0% 544733010 / 560736807 / -2.9% 0.96 / 0.94 / +1.9%
tpcds_q73/datafusion:parquet 23838730 / 23675195 / +0.7% 36184626 / 35651529 / +1.5% 0.66 / 0.66 / -0.8%
tpcds_q74/datafusion:parquet 69481665 / 69750544 / -0.4% 84329381 / 88419484 / -4.6% 0.82 / 0.79 / +4.4%
tpcds_q75/datafusion:parquet 148701396 / 154280426 / -3.6% 176259615 / 175992735 / +0.2% 0.84 / 0.88 / -3.8%
tpcds_q76/datafusion:parquet 34032109 / 32552642 / +4.5% 47049142 / 46197310 / +1.8% 0.72 / 0.70 / +2.7%
tpcds_q77/datafusion:parquet 56293142 / 55912258 / +0.7% 71591389 / 75401961 / -5.1% 0.79 / 0.74 / +6.0%
tpcds_q78/datafusion:parquet 84734384 / 86298158 / -1.8% 118217436 / 119573989 / -1.1% 0.72 / 0.72 / -0.7%
tpcds_q79/datafusion:parquet 26865212 / 26941018 / -0.3% 40953448 / 41670899 / -1.7% 0.66 / 0.65 / +1.5%
tpcds_q80/datafusion:parquet 79742788 / 79571648 / +0.2% 109611335 / 107798298 / +1.7% 0.73 / 0.74 / -1.4%
tpcds_q81/datafusion:parquet 36761850 / 37708022 / -2.5% 52675138 / 49644780 / +6.1% 0.70 / 0.76 / -8.1%
tpcds_q82/datafusion:parquet 21905322 / 22862742 / -4.2% 35153592 / 35659042 / -1.4% 0.62 / 0.64 / -2.8%
tpcds_q83/datafusion:parquet 58264710 / 58728850 / -0.8% 72848868 / 73572759 / -1.0% 0.80 / 0.80 / +0.2%
tpcds_q84/datafusion:parquet 26103828 / 27588446 / -5.4% 40327092 / 37424130 / +7.8% 0.65 / 0.74 / -12.2%
tpcds_q85/datafusion:parquet 80241318 / 80037900 / +0.3% 103625986 / 103303133 / +0.3% 0.77 / 0.77 / -0.1%
tpcds_q86/datafusion:parquet 20499856 / 20803682 / -1.5% 32873681 / 32694603 / +0.5% 0.62 / 0.64 / -2.0%
tpcds_q87/datafusion:parquet 43887228 / 44953774 / -2.4% 58095354 / 58673543 / -1.0% 0.76 / 0.77 / -1.4%
tpcds_q88/datafusion:parquet 37083366 / 37194222 / -0.3% 50021633 / 51481242 / -2.8% 0.74 / 0.72 / +2.6%
tpcds_q89/datafusion:parquet 25589512 / 25767740 / -0.7% 41310618 / 40885679 / +1.0% 0.62 / 0.63 / -1.7%
tpcds_q90/datafusion:parquet 15207480 / 15051543 / +1.0% 26614998 / 27168268 / -2.0% 0.57 / 0.55 / +3.1%
tpcds_q91/datafusion:parquet 32213941 / 32426770 / -0.7% 46106868 / 45756299 / +0.8% 0.70 / 0.71 / -1.4%
tpcds_q92/datafusion:parquet 26514549 / 26788312 / -1.0% 39255725 / 39570067 / -0.8% 0.68 / 0.68 / -0.2%
tpcds_q93/datafusion:parquet 27868260 / 26826836 / +3.9% 46593241 / 45720426 / +1.9% 0.60 / 0.59 / +1.9%
tpcds_q94/datafusion:parquet 35024362 / 35612212 / -1.7% 47884482 / 47235641 / +1.4% 0.73 / 0.75 / -3.0%
tpcds_q95/datafusion:parquet 63039591 / 64407442 / -2.1% 78538110 / 79417285 / -1.1% 0.80 / 0.81 / -1.0%
tpcds_q96/datafusion:parquet 12813947 / 13109518 / -2.3% 23836165 / 25052704 / -4.9% 0.54 / 0.52 / +2.7%
tpcds_q97/datafusion:parquet 35168847 / 35212817 / -0.1% 51652028 / 51110766 / +1.1% 0.68 / 0.69 / -1.2%
tpcds_q98/datafusion:parquet 24192708 / 24928664 / -3.0% 38024353 / 36311664 / +4.7% 0.64 / 0.69 / -7.3%
tpcds_q99/datafusion:parquet 29581756 / 29956348 / -1.3% 40586151 / 41613620 / -2.5% 0.73 / 0.72 / +1.2%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16451088 / 16142117 / +1.9% 25150719 / 24883739 / +1.1% 0.65 / 0.65 / +0.8%
tpcds_q02/duckdb:vortex-file-compressed 15865504 / 16709276 / -5.0% 22592118 / 22051108 / +2.5% 0.70 / 0.76 / -7.3%
tpcds_q03/duckdb:vortex-file-compressed 7122720 / 7045657 / +1.1% 15706815 / 16301596 / -3.6% 0.45 / 0.43 / +4.9%
tpcds_q04/duckdb:vortex-file-compressed 46783758 / 45758252 / +2.2% 57176944 / 56479163 / +1.2% 0.82 / 0.81 / +1.0%
tpcds_q05/duckdb:vortex-file-compressed 23012886 / 23036528 / -0.1% 33172800 / 32578849 / +1.8% 0.69 / 0.71 / -1.9%
tpcds_q06/duckdb:vortex-file-compressed 24383678 / 24423028 / -0.2% 38397978 / 38193338 / +0.5% 0.64 / 0.64 / -0.7%
tpcds_q07/duckdb:vortex-file-compressed 13460176 / 13353038 / +0.8% 24246969 / 24712568 / -1.9% 0.56 / 0.54 / +2.7%
tpcds_q08/duckdb:vortex-file-compressed 17364178 / 17520489 / -0.9% 25622024 / 25721441 / -0.4% 0.68 / 0.68 / -0.5%
tpcds_q09/duckdb:vortex-file-compressed 19479818 / 19111982 / +1.9% 31860304 / 29348465 / +8.6% 0.61 / 0.65 / -6.1%
tpcds_q10/duckdb:vortex-file-compressed 27618226 / 27612226 / +0.0% 40793320 / 40320225 / +1.2% 0.68 / 0.68 / -1.1%
tpcds_q11/duckdb:vortex-file-compressed 37038908 / 36903964 / +0.4% 46416162 / 46177346 / +0.5% 0.80 / 0.80 / -0.2%
tpcds_q12/duckdb:vortex-file-compressed 10206466 / 10200694 / +0.1% 17511109 / 17187152 / +1.9% 0.58 / 0.59 / -1.8%
tpcds_q13/duckdb:vortex-file-compressed 21055968 / 21263297 / -1.0% 32949953 / 32547269 / +1.2% 0.64 / 0.65 / -2.2%
tpcds_q14/duckdb:vortex-file-compressed 55977226 / 57809828 / -3.2% 70090306 / 68046783 / +3.0% 0.80 / 0.85 / -6.0%
tpcds_q15/duckdb:vortex-file-compressed 11317608 / 11119113 / +1.8% 18233561 / 18816176 / -3.1% 0.62 / 0.59 / +5.0%
tpcds_q16/duckdb:vortex-file-compressed 24270106 / 24266849 / +0.0% 35271286 / 34786209 / +1.4% 0.69 / 0.70 / -1.4%
tpcds_q17/duckdb:vortex-file-compressed 24495402 / 24227736 / +1.1% 37074876 / 36525117 / +1.5% 0.66 / 0.66 / -0.4%
tpcds_q18/duckdb:vortex-file-compressed 31978433 / 31509080 / +1.5% 43761938 / 41766543 / +4.8% 0.73 / 0.75 / -3.1%
tpcds_q19/duckdb:vortex-file-compressed 78555510 / 77960863 / +0.8% 88285037 / 89377861 / -1.2% 0.89 / 0.87 / +2.0%
tpcds_q20/duckdb:vortex-file-compressed 11013291 / 10971804 / +0.4% 17563461 / 17747764 / -1.0% 0.63 / 0.62 / +1.4%
tpcds_q21/duckdb:vortex-file-compressed 9662660 / 9745305 / -0.8% 21686098 / 20923879 / +3.6% 0.45 / 0.47 / -4.3%
tpcds_q22/duckdb:vortex-file-compressed 17561250 / 17585292 / -0.1% 30451960 / 29572488 / +3.0% 0.58 / 0.59 / -3.0%
tpcds_q23/duckdb:vortex-file-compressed 37877844 / 38130006 / -0.7% 51405765 / 49924896 / +3.0% 0.74 / 0.76 / -3.5%
tpcds_q24/duckdb:vortex-file-compressed 26950962 / 26574018 / +1.4% 38609252 / 36642246 / +5.4% 0.70 / 0.73 / -3.7%
tpcds_q25/duckdb:vortex-file-compressed 23283067 / 23695962 / -1.7% 35143563 / 36381968 / -3.4% 0.66 / 0.65 / +1.7%
tpcds_q26/duckdb:vortex-file-compressed 12924256 / 13100696 / -1.3% 21772840 / 21291607 / +2.3% 0.59 / 0.62 / -3.5%
tpcds_q27/duckdb:vortex-file-compressed 15989649 / 15963922 / +0.2% 27043400 / 27540444 / -1.8% 0.59 / 0.58 / +2.0%
tpcds_q28/duckdb:vortex-file-compressed 15682882 / 15588588 / +0.6% 27353766 / 26167172 / +4.5% 0.57 / 0.60 / -3.8%
tpcds_q29/duckdb:vortex-file-compressed 22905407 / 22710729 / +0.9% 34683819 / 34899355 / -0.6% 0.66 / 0.65 / +1.5%
tpcds_q30/duckdb:vortex-file-compressed 16111738 / 15872199 / +1.5% 24367863 / 24336692 / +0.1% 0.66 / 0.65 / +1.4%
tpcds_q31/duckdb:vortex-file-compressed 17761664 / 18069675 / -1.7% 26374026 / 26891648 / -1.9% 0.67 / 0.67 / +0.2%
tpcds_q32/duckdb:vortex-file-compressed 12145662 / 11623212 / +4.5% 21055175 / 20950684 / +0.5% 0.58 / 0.55 / +4.0%
tpcds_q33/duckdb:vortex-file-compressed 18610422 / 18357493 / +1.4% 28477294 / 28185569 / +1.0% 0.65 / 0.65 / +0.3%
tpcds_q34/duckdb:vortex-file-compressed 12931916 / 13014242 / -0.6% 22590120 / 23047270 / -2.0% 0.57 / 0.56 / +1.4%
tpcds_q35/duckdb:vortex-file-compressed 28504924 / 27929879 / +2.1% 39285739 / 39014716 / +0.7% 0.73 / 0.72 / +1.4%
tpcds_q36/duckdb:vortex-file-compressed 14303629 / 13908706 / +2.8% 24314914 / 23970044 / +1.4% 0.59 / 0.58 / +1.4%
tpcds_q37/duckdb:vortex-file-compressed 9418034 / 9515167 / -1.0% 24800848 / 24340830 / +1.9% 0.38 / 0.39 / -2.9%
tpcds_q38/duckdb:vortex-file-compressed 24790983 / 24300837 / +2.0% 32610631 / 32361884 / +0.8% 0.76 / 0.75 / +1.2%
tpcds_q39/duckdb:vortex-file-compressed 18973380 / 18334157 / +3.5% 33476454 / 33896858 / -1.2% 0.57 / 0.54 / +4.8%
tpcds_q40/duckdb:vortex-file-compressed 14053434 / 14107318 / -0.4% 20512710 / 20388858 / +0.6% 0.69 / 0.69 / -1.0%
tpcds_q41/duckdb:vortex-file-compressed 18856108 / 18789802 / +0.4% 25716994 / 25592058 / +0.5% 0.73 / 0.73 / -0.1%
tpcds_q42/duckdb:vortex-file-compressed 7035514 / 7115361 / -1.1% 16243855 / 16445425 / -1.2% 0.43 / 0.43 / +0.1%
tpcds_q43/duckdb:vortex-file-compressed 9698759 / 9847942 / -1.5% 19093596 / 19094789 / -0.0% 0.51 / 0.52 / -1.5%
tpcds_q44/duckdb:vortex-file-compressed 12684167 / 12546484 / +1.1% 24776771 / 24279354 / +2.0% 0.51 / 0.52 / -0.9%
tpcds_q45/duckdb:vortex-file-compressed 23731076 / 23264362 / +2.0% 31283311 / 31280867 / +0.0% 0.76 / 0.74 / +2.0%
tpcds_q46/duckdb:vortex-file-compressed 19425827 / 19680982 / -1.3% 28148323 / 27352411 / +2.9% 0.69 / 0.72 / -4.1%
tpcds_q47/duckdb:vortex-file-compressed 34837024 / 34836730 / +0.0% 45002057 / 45045037 / -0.1% 0.77 / 0.77 / +0.1%
tpcds_q48/duckdb:vortex-file-compressed 23774123 / 23197005 / +2.5% 36921065 / 36376826 / +1.5% 0.64 / 0.64 / +1.0%
tpcds_q49/duckdb:vortex-file-compressed 19047414 / 18947468 / +0.5% 30555771 / 31460092 / -2.9% 0.62 / 0.60 / +3.5%
tpcds_q50/duckdb:vortex-file-compressed 16838983 / 16868396 / -0.2% 26812724 / 27316563 / -1.8% 0.63 / 0.62 / +1.7%
tpcds_q51/duckdb:vortex-file-compressed 49193515 / 48747450 / +0.9% 77197753 / 76407317 / +1.0% 0.64 / 0.64 / -0.1%
tpcds_q52/duckdb:vortex-file-compressed 7180126 / 7223788 / -0.6% 16108453 / 16544978 / -2.6% 0.45 / 0.44 / +2.1%
tpcds_q53/duckdb:vortex-file-compressed 11433882 / 11580455 / -1.3% 21166251 / 20950001 / +1.0% 0.54 / 0.55 / -2.3%
tpcds_q54/duckdb:vortex-file-compressed 20990654 / 20288914 / +3.5% 31221542 / 30647003 / +1.9% 0.67 / 0.66 / +1.6%
tpcds_q55/duckdb:vortex-file-compressed 7070636 / 6902994 / +2.4% 15370421 / 15931120 / -3.5% 0.46 / 0.43 / +6.2%
tpcds_q56/duckdb:vortex-file-compressed 18286218 / 17960990 / +1.8% 28344814 / 27713372 / +2.3% 0.65 / 0.65 / -0.5%
tpcds_q57/duckdb:vortex-file-compressed 26254094 / 26098614 / +0.6% 34276732 / 34582639 / -0.9% 0.77 / 0.75 / +1.5%
tpcds_q58/duckdb:vortex-file-compressed 20361726 / 20331842 / +0.1% 30210197 / 30877019 / -2.2% 0.67 / 0.66 / +2.4%
tpcds_q59/duckdb:vortex-file-compressed 19478902 / 19688060 / -1.1% 27150631 / 27058532 / +0.3% 0.72 / 0.73 / -1.4%
tpcds_q60/duckdb:vortex-file-compressed 18655854 / 18617518 / +0.2% 29824254 / 29659067 / +0.6% 0.63 / 0.63 / -0.3%
tpcds_q61/duckdb:vortex-file-compressed 25949816 / 25605872 / +1.3% 34397217 / 34595872 / -0.6% 0.75 / 0.74 / +1.9%
tpcds_q62/duckdb:vortex-file-compressed 11759127 / 11685066 / +0.6% 18196091 / 18455703 / -1.4% 0.65 / 0.63 / +2.1%
tpcds_q63/duckdb:vortex-file-compressed 11111192 / 10996244 / +1.0% 20021004 / 20737428 / -3.5% 0.55 / 0.53 / +4.7%
tpcds_q64/duckdb:vortex-file-compressed 49654193 / 49381384 / +0.6% 67353277 / 66047661 / +2.0% 0.74 / 0.75 / -1.4%
tpcds_q65/duckdb:vortex-file-compressed 13004174 / 13292210 / -2.2% 23529984 / 23558633 / -0.1% 0.55 / 0.56 / -2.0%
tpcds_q66/duckdb:vortex-file-compressed 29210274 / 29707612 / -1.7% 36443237 / 35612347 / +2.3% 0.80 / 0.83 / -3.9%
tpcds_q67/duckdb:vortex-file-compressed 58430798 / 58292138 / +0.2% 66795298 / 66652555 / +0.2% 0.87 / 0.87 / +0.0%
tpcds_q68/duckdb:vortex-file-compressed 19415039 / 19064728 / +1.8% 27633870 / 27773620 / -0.5% 0.70 / 0.69 / +2.4%
tpcds_q69/duckdb:vortex-file-compressed 22860886 / 22826429 / +0.2% 36613080 / 37192445 / -1.6% 0.62 / 0.61 / +1.7%
tpcds_q70/duckdb:vortex-file-compressed 16177846 / 16314066 / -0.8% 26989897 / 27191282 / -0.7% 0.60 / 0.60 / -0.1%
tpcds_q71/duckdb:vortex-file-compressed 13318934 / 12617499 / +5.6% 23147065 / 23746617 / -2.5% 0.58 / 0.53 / +8.3%
tpcds_q72/duckdb:vortex-file-compressed 52443443 / 51945424 / +1.0% 63062535 / 62476510 / +0.9% 0.83 / 0.83 / +0.0%
tpcds_q73/duckdb:vortex-file-compressed 11841907 / 11909118 / -0.6% 21133015 / 21101470 / +0.1% 0.56 / 0.56 / -0.7%
tpcds_q74/duckdb:vortex-file-compressed 26468258 / 26041908 / +1.6% 34240317 / 34022832 / +0.6% 0.77 / 0.77 / +1.0%
tpcds_q75/duckdb:vortex-file-compressed 28102508 / 28133652 / -0.1% 38098233 / 38375865 / -0.7% 0.74 / 0.73 / +0.6%
tpcds_q76/duckdb:vortex-file-compressed 12736470 / 12764356 / -0.2% 22733830 / 22963071 / -1.0% 0.56 / 0.56 / +0.8%
tpcds_q77/duckdb:vortex-file-compressed 20836242 / 21418045 / -2.7% 32100184 / 32708962 / -1.9% 0.65 / 0.65 / -0.9%
tpcds_q78/duckdb:vortex-file-compressed 43500541 / 43337642 / +0.4% 52831378 / 53885227 / -2.0% 0.82 / 0.80 / +2.4%
tpcds_q79/duckdb:vortex-file-compressed 13226588 / 13232534 / -0.0% 22001295 / 21910779 / +0.4% 0.60 / 0.60 / -0.5%
tpcds_q80/duckdb:vortex-file-compressed 37413530 / 36847054 / +1.5% 49810330 / 49501801 / +0.6% 0.75 / 0.74 / +0.9%
tpcds_q81/duckdb:vortex-file-compressed 21555852 / 21429800 / +0.6% 29480333 / 30095533 / -2.0% 0.73 / 0.71 / +2.7%
tpcds_q82/duckdb:vortex-file-compressed 9616084 / 9708050 / -0.9% 24232587 / 25061879 / -3.3% 0.40 / 0.39 / +2.4%
tpcds_q83/duckdb:vortex-file-compressed 17488060 / 17427131 / +0.3% 25086631 / 24376519 / +2.9% 0.70 / 0.71 / -2.5%
tpcds_q84/duckdb:vortex-file-compressed 15722262 / 15770181 / -0.3% 23061542 / 23129342 / -0.3% 0.68 / 0.68 / -0.0%
tpcds_q85/duckdb:vortex-file-compressed 24956996 / 24403894 / +2.3% 36920399 / 36380296 / +1.5% 0.68 / 0.67 / +0.8%
tpcds_q86/duckdb:vortex-file-compressed 9844747 / 9717139 / +1.3% 16619514 / 15906721 / +4.5% 0.59 / 0.61 / -3.0%
tpcds_q87/duckdb:vortex-file-compressed 26201008 / 26017050 / +0.7% 34042184 / 33396290 / +1.9% 0.77 / 0.78 / -1.2%
tpcds_q88/duckdb:vortex-file-compressed 30577653 / 30324574 / +0.8% 37916115 / 38572757 / -1.7% 0.81 / 0.79 / +2.6%
tpcds_q89/duckdb:vortex-file-compressed 12189630 / 12106472 / +0.7% 22099752 / 20820791 / +6.1% 0.55 / 0.58 / -5.1%
tpcds_q90/duckdb:vortex-file-compressed 8126286 / 7989972 / +1.7% 15390510 / 15308508 / +0.5% 0.53 / 0.52 / +1.2%
tpcds_q91/duckdb:vortex-file-compressed 14532767 / 14428822 / +0.7% 22143422 / 23070665 / -4.0% 0.66 / 0.63 / +4.9%
tpcds_q92/duckdb:vortex-file-compressed 12218520 / 12093567 / +1.0% 20499451 / 20435129 / +0.3% 0.60 / 0.59 / +0.7%
tpcds_q93/duckdb:vortex-file-compressed 10486284 / 10489510 / -0.0% 21942336 / 23114016 / -5.1% 0.48 / 0.45 / +5.3%
tpcds_q94/duckdb:vortex-file-compressed 22261236 / 21924813 / +1.5% 32115667 / 32104172 / +0.0% 0.69 / 0.68 / +1.5%
tpcds_q95/duckdb:vortex-file-compressed 62734554 / 62938576 / -0.3% 71753721 / 71963612 / -0.3% 0.87 / 0.87 / -0.0%
tpcds_q96/duckdb:vortex-file-compressed 6872121 / 6838084 / +0.5% 15226013 / 14762606 / +3.1% 0.45 / 0.46 / -2.6%
tpcds_q97/duckdb:vortex-file-compressed 23268784 / 23163218 / +0.5% 33295131 / 31012754 / +7.4% 0.70 / 0.75 / -6.4%
tpcds_q98/duckdb:vortex-file-compressed 11489598 / 11360176 / +1.1% 20150453 / 19475284 / +3.5% 0.57 / 0.58 / -2.2%
tpcds_q99/duckdb:vortex-file-compressed 14644122 / 14668948 / -0.2% 22904011 / 22813440 / +0.4% 0.64 / 0.64 / -0.6%
duckdb / parquet / ns (1.007x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23920854 / 23966969 / -0.2% 30782364 / 30829019 / -0.2% 0.78 / 0.78 / -0.0%
tpcds_q02/duckdb:parquet 17955128 / 17973470 / -0.1% 24155819 / 23889142 / +1.1% 0.74 / 0.75 / -1.2%
tpcds_q03/duckdb:parquet 9823232 / 9784454 / +0.4% 15665798 / 15698965 / -0.2% 0.63 / 0.62 / +0.6%
tpcds_q04/duckdb:parquet 118171952 / 117912489 / +0.2% 125548753 / 126089418 / -0.4% 0.94 / 0.94 / +0.7%
tpcds_q05/duckdb:parquet 28225880 / 28395371 / -0.6% 33215185 / 32582262 / +1.9% 0.85 / 0.87 / -2.5%
tpcds_q06/duckdb:parquet 26382684 / 26216986 / +0.6% 35945675 / 35588221 / +1.0% 0.73 / 0.74 / -0.4%
tpcds_q07/duckdb:parquet 32240040 / 33420428 / -3.5% 38788494 / 38430436 / +0.9% 0.83 / 0.87 / -4.4%
tpcds_q08/duckdb:parquet 19820470 / 19585998 / +1.2% 25841650 / 26172260 / -1.3% 0.77 / 0.75 / +2.5%
tpcds_q09/duckdb:parquet 27025594 / 27371152 / -1.3% 30947275 / 29649948 / +4.4% 0.87 / 0.92 / -5.4%
tpcds_q10/duckdb:parquet 32547622 / 32361482 / +0.6% 39967852 / 40184705 / -0.5% 0.81 / 0.81 / +1.1%
tpcds_q11/duckdb:parquet 68719663 / 68514487 / +0.3% 76254733 / 76389272 / -0.2% 0.90 / 0.90 / +0.5%
tpcds_q12/duckdb:parquet 14124826 / 13876876 / +1.8% 19077386 / 19186188 / -0.6% 0.74 / 0.72 / +2.4%
tpcds_q13/duckdb:parquet 32419898 / 30368470 / +6.8% 39876979 / 40187836 / -0.8% 0.81 / 0.76 / +7.6%
tpcds_q14/duckdb:parquet 64426166 / 63510142 / +1.4% 68325496 / 67941108 / +0.6% 0.94 / 0.93 / +0.9%
tpcds_q15/duckdb:parquet 16613170 / 16546332 / +0.4% 22392847 / 22895550 / -2.2% 0.74 / 0.72 / +2.7%
tpcds_q16/duckdb:parquet 30087896 / 30007520 / +0.3% 36811491 / 36406547 / +1.1% 0.82 / 0.82 / -0.8%
tpcds_q17/duckdb:parquet 34536044 / 34177397 / +1.0% 39685786 / 40441172 / -1.9% 0.87 / 0.85 / +3.0%
tpcds_q18/duckdb:parquet 47023058 / 47042055 / -0.0% 55456386 / 54456240 / +1.8% 0.85 / 0.86 / -1.8%
tpcds_q19/duckdb:parquet 18827994 / 18502952 / +1.8% 25721764 / 25759438 / -0.1% 0.73 / 0.72 / +1.9%
tpcds_q20/duckdb:parquet 14980433 / 14883558 / +0.7% 19583623 / 19539428 / +0.2% 0.76 / 0.76 / +0.4%
tpcds_q21/duckdb:parquet 10674122 / 10610768 / +0.6% 16843148 / 17113867 / -1.6% 0.63 / 0.62 / +2.2%
tpcds_q22/duckdb:parquet 20780711 / 20553610 / +1.1% 26508355 / 26725059 / -0.8% 0.78 / 0.77 / +1.9%
tpcds_q23/duckdb:parquet 44048128 / 43575614 / +1.1% 49966794 / 46598579 / +7.2% 0.88 / 0.94 / -5.7%
tpcds_q24/duckdb:parquet 30531474 / 30367457 / +0.5% 36997487 / 36478211 / +1.4% 0.83 / 0.83 / -0.9%
tpcds_q25/duckdb:parquet 30387166 / 30221780 / +0.5% 36831915 / 36937818 / -0.3% 0.83 / 0.82 / +0.8%
tpcds_q26/duckdb:parquet 28850092 / 28776880 / +0.3% 35711671 / 35302112 / +1.2% 0.81 / 0.82 / -0.9%
tpcds_q27/duckdb:parquet 34862129 / 35523786 / -1.9% 41674036 / 41611405 / +0.2% 0.84 / 0.85 / -2.0%
tpcds_q28/duckdb:parquet 26390056 / 26328432 / +0.2% 32591984 / 34309155 / -5.0% 0.81 / 0.77 / +5.5%
tpcds_q29/duckdb:parquet 31938434 / 31825925 / +0.4% 39591497 / 38870785 / +1.9% 0.81 / 0.82 / -1.5%
tpcds_q30/duckdb:parquet 35510728 / 35121615 / +1.1% 44149677 / 44712118 / -1.3% 0.80 / 0.79 / +2.4%
tpcds_q31/duckdb:parquet 35765526 / 35271778 / +1.4% 42766720 / 42481930 / +0.7% 0.84 / 0.83 / +0.7%
tpcds_q32/duckdb:parquet 14176108 / 14057028 / +0.8% 20653340 / 20598153 / +0.3% 0.69 / 0.68 / +0.6%
tpcds_q33/duckdb:parquet 24153507 / 23124152 / +4.5% 29230982 / 29167207 / +0.2% 0.83 / 0.79 / +4.2%
tpcds_q34/duckdb:parquet 18244736 / 16934344 / +7.7% 24136303 / 24303526 / -0.7% 0.76 / 0.70 / +8.5%
tpcds_q35/duckdb:parquet 35042651 / 35187535 / -0.4% 43906382 / 43708254 / +0.5% 0.80 / 0.81 / -0.9%
tpcds_q36/duckdb:parquet 40977075 / 39353736 / +4.1% 47337848 / 47971471 / -1.3% 0.87 / 0.82 / +5.5%
tpcds_q37/duckdb:parquet 12599984 / 12699916 / -0.8% 19311125 / 19775516 / -2.3% 0.65 / 0.64 / +1.6%
tpcds_q38/duckdb:parquet 29784720 / 29409083 / +1.3% 33490478 / 33644782 / -0.5% 0.89 / 0.87 / +1.7%
tpcds_q39/duckdb:parquet 23416166 / 23268776 / +0.6% 29511434 / 30173448 / -2.2% 0.79 / 0.77 / +2.9%
tpcds_q40/duckdb:parquet 15952425 / 15818668 / +0.8% 21271797 / 21350935 / -0.4% 0.75 / 0.74 / +1.2%
tpcds_q41/duckdb:parquet 11985768 / 11937368 / +0.4% 17895061 / 17654837 / +1.4% 0.67 / 0.68 / -0.9%
tpcds_q42/duckdb:parquet 9561293 / 9467242 / +1.0% 15062171 / 15390992 / -2.1% 0.63 / 0.62 / +3.2%
tpcds_q43/duckdb:parquet 12001956 / 13469714 / -10.9% 🟢 17976406 / 18054883 / -0.4% 0.67 / 0.75 / -10.5%
tpcds_q44/duckdb:parquet 21547342 / 21728390 / -0.8% 27244515 / 27212840 / +0.1% 0.79 / 0.80 / -0.9%
tpcds_q45/duckdb:parquet 21004328 / 20743408 / +1.3% 27747725 / 27840154 / -0.3% 0.76 / 0.75 / +1.6%
tpcds_q46/duckdb:parquet 36872752 / 36989149 / -0.3% 43823137 / 44071441 / -0.6% 0.84 / 0.84 / +0.3%
tpcds_q47/duckdb:parquet 34710912 / 34549854 / +0.5% 41113912 / 41188971 / -0.2% 0.84 / 0.84 / +0.6%
tpcds_q48/duckdb:parquet 29636908 / 30458733 / -2.7% 37000959 / 37126578 / -0.3% 0.80 / 0.82 / -2.4%
tpcds_q49/duckdb:parquet 31169428 / 30077962 / +3.6% 36273687 / 35486466 / +2.2% 0.86 / 0.85 / +1.4%
tpcds_q50/duckdb:parquet 19330972 / 19303932 / +0.1% 25583695 / 25663854 / -0.3% 0.76 / 0.75 / +0.5%
tpcds_q51/duckdb:parquet 52474938 / 51972089 / +1.0% 59822545 / 60028308 / -0.3% 0.88 / 0.87 / +1.3%
tpcds_q52/duckdb:parquet 9644430 / 9584687 / +0.6% 15526153 / 15536302 / -0.1% 0.62 / 0.62 / +0.7%
tpcds_q53/duckdb:parquet 14122191 / 13859535 / +1.9% 20944238 / 21051270 / -0.5% 0.67 / 0.66 / +2.4%
tpcds_q54/duckdb:parquet 24841294 / 24769012 / +0.3% 32033737 / 32317507 / -0.9% 0.78 / 0.77 / +1.2%
tpcds_q55/duckdb:parquet 9464027 / 9458322 / +0.1% 15320713 / 15628508 / -2.0% 0.62 / 0.61 / +2.1%
tpcds_q56/duckdb:parquet 25618138 / 24451846 / +4.8% 30966564 / 30263945 / +2.3% 0.83 / 0.81 / +2.4%
tpcds_q57/duckdb:parquet 30624587 / 30496694 / +0.4% 36618630 / 36082806 / +1.5% 0.84 / 0.85 / -1.1%
tpcds_q58/duckdb:parquet 23561225 / 24048685 / -2.0% 29349758 / 29574418 / -0.8% 0.80 / 0.81 / -1.3%
tpcds_q59/duckdb:parquet 22700180 / 22781209 / -0.4% 28705412 / 28822798 / -0.4% 0.79 / 0.79 / +0.1%
tpcds_q60/duckdb:parquet 28732371 / 26326926 / +9.1% 32635711 / 32439784 / +0.6% 0.88 / 0.81 / +8.5%
tpcds_q61/duckdb:parquet 24933206 / 24386621 / +2.2% 28441623 / 28840820 / -1.4% 0.88 / 0.85 / +3.7%
tpcds_q62/duckdb:parquet 12924460 / 12837852 / +0.7% 18002537 / 18021543 / -0.1% 0.72 / 0.71 / +0.8%
tpcds_q63/duckdb:parquet 13366872 / 13411461 / -0.3% 19797487 / 20165946 / -1.8% 0.68 / 0.67 / +1.5%
tpcds_q64/duckdb:parquet 69862437 / 70200230 / -0.5% 79333853 / 80412181 / -1.3% 0.88 / 0.87 / +0.9%
tpcds_q65/duckdb:parquet 19540839 / 18687231 / +4.6% 26333595 / 26192155 / +0.5% 0.74 / 0.71 / +4.0%
tpcds_q66/duckdb:parquet 33369342 / 33369771 / -0.0% 38069513 / 37725314 / +0.9% 0.88 / 0.88 / -0.9%
tpcds_q67/duckdb:parquet 61592640 / 60819089 / +1.3% 67892968 / 67228661 / +1.0% 0.91 / 0.90 / +0.3%
tpcds_q68/duckdb:parquet 28350536 / 29259984 / -3.1% 36674108 / 36839271 / -0.4% 0.77 / 0.79 / -2.7%
tpcds_q69/duckdb:parquet 25918130 / 25569940 / +1.4% 34202054 / 34423942 / -0.6% 0.76 / 0.74 / +2.0%
tpcds_q70/duckdb:parquet 19295078 / 19192084 / +0.5% 26833946 / 26739741 / +0.4% 0.72 / 0.72 / +0.2%
tpcds_q71/duckdb:parquet 16937935 / 17054927 / -0.7% 23868223 / 23954836 / -0.4% 0.71 / 0.71 / -0.3%
tpcds_q72/duckdb:parquet 53031355 / 52932942 / +0.2% 59487611 / 59845214 / -0.6% 0.89 / 0.88 / +0.8%
tpcds_q73/duckdb:parquet 14981340 / 14661652 / +2.2% 21319359 / 21893138 / -2.6% 0.70 / 0.67 / +4.9%
tpcds_q74/duckdb:parquet 84931356 / 84390668 / +0.6% 91033341 / 91452584 / -0.5% 0.93 / 0.92 / +1.1%
tpcds_q75/duckdb:parquet 44486732 / 44687585 / -0.4% 49904934 / 50609140 / -1.4% 0.89 / 0.88 / +1.0%
tpcds_q76/duckdb:parquet 19176612 / 19040094 / +0.7% 22922204 / 23607159 / -2.9% 0.84 / 0.81 / +3.7%
tpcds_q77/duckdb:parquet 25775253 / 25425972 / +1.4% 31181438 / 32155175 / -3.0% 0.83 / 0.79 / +4.5%
tpcds_q78/duckdb:parquet 78725531 / 77093010 / +2.1% 83435416 / 84250182 / -1.0% 0.94 / 0.92 / +3.1%
tpcds_q79/duckdb:parquet 22712632 / 21130690 / +7.5% 29139057 / 29307556 / -0.6% 0.78 / 0.72 / +8.1%
tpcds_q80/duckdb:parquet 37944592 / 37184819 / +2.0% 43761781 / 43847529 / -0.2% 0.87 / 0.85 / +2.2%
tpcds_q81/duckdb:parquet 36215078 / 35976995 / +0.7% 44370144 / 44333291 / +0.1% 0.82 / 0.81 / +0.6%
tpcds_q82/duckdb:parquet 13358723 / 13373336 / -0.1% 20204592 / 20170460 / +0.2% 0.66 / 0.66 / -0.3%
tpcds_q83/duckdb:parquet 20065512 / 20056018 / +0.0% 25052678 / 24832676 / +0.9% 0.80 / 0.81 / -0.8%
tpcds_q84/duckdb:parquet 22907516 / 22552006 / +1.6% 29205619 / 28863502 / +1.2% 0.78 / 0.78 / +0.4%
tpcds_q85/duckdb:parquet 32225610 / 32295063 / -0.2% 39550967 / 39757757 / -0.5% 0.81 / 0.81 / +0.3%
tpcds_q86/duckdb:parquet 11709193 / 11671840 / +0.3% 17107350 / 17041774 / +0.4% 0.68 / 0.68 / -0.1%
tpcds_q87/duckdb:parquet 31195734 / 31295030 / -0.3% 34931973 / 35573309 / -1.8% 0.89 / 0.88 / +1.5%
tpcds_q88/duckdb:parquet 38575392 / 38174937 / +1.0% 42622444 / 41231775 / +3.4% 0.91 / 0.93 / -2.2%
tpcds_q89/duckdb:parquet 14237686 / 15086220 / -5.6% 21546713 / 21158011 / +1.8% 0.66 / 0.71 / -7.3%
tpcds_q90/duckdb:parquet 10006950 / 9834406 / +1.8% 15164793 / 15371268 / -1.3% 0.66 / 0.64 / +3.1%
tpcds_q91/duckdb:parquet 20963747 / 20811260 / +0.7% 28381613 / 28789486 / -1.4% 0.74 / 0.72 / +2.2%
tpcds_q92/duckdb:parquet 15572000 / 15505942 / +0.4% 22014172 / 21884251 / +0.6% 0.71 / 0.71 / -0.2%
tpcds_q93/duckdb:parquet 14109018 / 14008072 / +0.7% 20464860 / 20243382 / +1.1% 0.69 / 0.69 / -0.4%
tpcds_q94/duckdb:parquet 25301873 / 25514996 / -0.8% 32225145 / 32909651 / -2.1% 0.79 / 0.78 / +1.3%
tpcds_q95/duckdb:parquet 43887382 / 43842982 / +0.1% 49375565 / 49538887 / -0.3% 0.89 / 0.89 / +0.4%
tpcds_q96/duckdb:parquet 8180046 / 8142782 / +0.5% 13592226 / 13576831 / +0.1% 0.60 / 0.60 / +0.3%
tpcds_q97/duckdb:parquet 27455324 / 27093344 / +1.3% 33955793 / 32358898 / +4.9% 0.81 / 0.84 / -3.4%
tpcds_q98/duckdb:parquet 16564658 / 16374839 / +1.2% 23155207 / 23141567 / +0.1% 0.72 / 0.71 / +1.1%
tpcds_q99/duckdb:parquet 18779223 / 18656013 / +0.7% 24675995 / 24696138 / -0.1% 0.76 / 0.76 / +0.7%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR a29c280d vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.990x ➖
Parquet (geomean): hot 0.990x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -1.0% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1217874 / 1223583 / -0.5% 22325146 / 22393554 / -0.3% 0.05 / 0.05 / -0.2%
clickbench_q01/datafusion:vortex-file-compressed 5921814 / 6046842 / -2.1% 29553300 / 29592395 / -0.1% 0.20 / 0.20 / -1.9%
clickbench_q02/datafusion:vortex-file-compressed 10718035 / 10531240 / +1.8% 45937153 / 46036487 / -0.2% 0.23 / 0.23 / +2.0%
clickbench_q03/datafusion:vortex-file-compressed 13207587 / 12387916 / +6.6% 53804705 / 56727916 / -5.2% 0.25 / 0.22 / +12.4%
clickbench_q04/datafusion:vortex-file-compressed 57775026 / 58081216 / -0.5% 102686441 / 103589636 / -0.9% 0.56 / 0.56 / +0.3%
clickbench_q05/datafusion:vortex-file-compressed 76510586 / 79014320 / -3.2% 130420190 / 128484768 / +1.5% 0.59 / 0.61 / -4.6%
clickbench_q06/datafusion:vortex-file-compressed 1274330 / 1263943 / +0.8% 23030845 / 22422362 / +2.7% 0.06 / 0.06 / -1.8%
clickbench_q07/datafusion:vortex-file-compressed 9433813 / 9508768 / -0.8% 33643420 / 33881448 / -0.7% 0.28 / 0.28 / -0.1%
clickbench_q08/datafusion:vortex-file-compressed 76199046 / 79137674 / -3.7% 123778041 / 128803436 / -3.9% 0.62 / 0.61 / +0.2%
clickbench_q09/datafusion:vortex-file-compressed 168574102 / 173755480 / -3.0% 216415968 / 207375596 / +4.4% 0.78 / 0.84 / -7.0%
clickbench_q10/datafusion:vortex-file-compressed 23707378 / 23479735 / +1.0% 71367707 / 69620750 / +2.5% 0.33 / 0.34 / -1.5%
clickbench_q11/datafusion:vortex-file-compressed 25587174 / 26005739 / -1.6% 72428843 / 70384896 / +2.9% 0.35 / 0.37 / -4.4%
clickbench_q12/datafusion:vortex-file-compressed 72768844 / 75527217 / -3.7% 125082141 / 123896189 / +1.0% 0.58 / 0.61 / -4.6%
clickbench_q13/datafusion:vortex-file-compressed 118937042 / 115900178 / +2.6% 178964070 / 187353692 / -4.5% 0.66 / 0.62 / +7.4%
clickbench_q14/datafusion:vortex-file-compressed 74530280 / 75510882 / -1.3% 126330877 / 125936863 / +0.3% 0.59 / 0.60 / -1.6%
clickbench_q15/datafusion:vortex-file-compressed 62061278 / 63030918 / -1.5% 98914082 / 100187136 / -1.3% 0.63 / 0.63 / -0.3%
clickbench_q16/datafusion:vortex-file-compressed 155567024 / 155538995 / +0.0% 211080387 / 217221220 / -2.8% 0.74 / 0.72 / +2.9%
clickbench_q17/datafusion:vortex-file-compressed 153508750 / 155207311 / -1.1% 221829093 / 226552616 / -2.1% 0.69 / 0.69 / +1.0%
clickbench_q18/datafusion:vortex-file-compressed 293831056 / 294130736 / -0.1% 377486979 / 390830976 / -3.4% 0.78 / 0.75 / +3.4%
clickbench_q19/datafusion:vortex-file-compressed 7990146 / 8303792 / -3.8% 51621755 / 48242070 / +7.0% 0.15 / 0.17 / -10.1%
clickbench_q20/datafusion:vortex-file-compressed 68686092 / 71745774 / -4.3% 244199756 / 248435282 / -1.7% 0.28 / 0.29 / -2.6%
clickbench_q21/datafusion:vortex-file-compressed 78297712 / 79455405 / -1.5% 289712465 / 288506255 / +0.4% 0.27 / 0.28 / -1.9%
clickbench_q22/datafusion:vortex-file-compressed 92276470 / 91696814 / +0.6% 397943670 / 390845073 / +1.8% 0.23 / 0.23 / -1.2%
clickbench_q23/datafusion:vortex-file-compressed 182437890 / 183993637 / -0.8% 540465877 / 539539151 / +0.2% 0.34 / 0.34 / -1.0%
clickbench_q24/datafusion:vortex-file-compressed 15280282 / 15307686 / -0.2% 71831366 / 70032970 / +2.6% 0.21 / 0.22 / -2.7%
clickbench_q25/datafusion:vortex-file-compressed 20099832 / 19863486 / +1.2% 65023965 / 62923085 / +3.3% 0.31 / 0.32 / -2.1%
clickbench_q26/datafusion:vortex-file-compressed 15630032 / 16533236 / -5.5% 70770963 / 70743668 / +0.0% 0.22 / 0.23 / -5.5%
clickbench_q27/datafusion:vortex-file-compressed 102752302 / 101740724 / +1.0% 254387356 / 251569553 / +1.1% 0.40 / 0.40 / -0.1%
clickbench_q28/datafusion:vortex-file-compressed 558347944 / 562333160 / -0.7% 659895869 / 643537242 / +2.5% 0.85 / 0.87 / -3.2%
clickbench_q29/datafusion:vortex-file-compressed 24644920 / 24245137 / +1.6% 55462756 / 53670057 / +3.3% 0.44 / 0.45 / -1.6%
clickbench_q30/datafusion:vortex-file-compressed 54952115 / 57397381 / -4.3% 115879162 / 112998342 / +2.5% 0.47 / 0.51 / -6.6%
clickbench_q31/datafusion:vortex-file-compressed 65424396 / 65356445 / +0.1% 169347525 / 163081172 / +3.8% 0.39 / 0.40 / -3.6%
clickbench_q32/datafusion:vortex-file-compressed 293086728 / 290282297 / +1.0% 383699911 / 393223115 / -2.4% 0.76 / 0.74 / +3.5%
clickbench_q33/datafusion:vortex-file-compressed 319264746 / 324626808 / -1.7% 436399027 / 432328318 / +0.9% 0.73 / 0.75 / -2.6%
clickbench_q34/datafusion:vortex-file-compressed 323890534 / 324894899 / -0.3% 432631204 / 444404496 / -2.6% 0.75 / 0.73 / +2.4%
clickbench_q35/datafusion:vortex-file-compressed 56859163 / 56027504 / +1.5% 91776566 / 93654723 / -2.0% 0.62 / 0.60 / +3.6%
clickbench_q36/datafusion:vortex-file-compressed 37803202 / 37622886 / +0.5% 69202185 / 67872658 / +2.0% 0.55 / 0.55 / -1.5%
clickbench_q37/datafusion:vortex-file-compressed 21131350 / 21259280 / -0.6% 47259233 / 47424626 / -0.3% 0.45 / 0.45 / -0.3%
clickbench_q38/datafusion:vortex-file-compressed 13003814 / 13259514 / -1.9% 41614741 / 41723747 / -0.3% 0.31 / 0.32 / -1.7%
clickbench_q39/datafusion:vortex-file-compressed 79128408 / 78839799 / +0.4% 112080406 / 111367852 / +0.6% 0.71 / 0.71 / -0.3%
clickbench_q40/datafusion:vortex-file-compressed 10493120 / 10378568 / +1.1% 36128602 / 36528657 / -1.1% 0.29 / 0.28 / +2.2%
clickbench_q41/datafusion:vortex-file-compressed 10021010 / 9976754 / +0.4% 34188025 / 34471787 / -0.8% 0.29 / 0.29 / +1.3%
clickbench_q42/datafusion:vortex-file-compressed 10405448 / 10423952 / -0.2% 35866608 / 35196628 / +1.9% 0.29 / 0.30 / -2.0%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1233540 / 1245842 / -1.0% 50049735 / 49718186 / +0.7% 0.02 / 0.03 / -1.6%
clickbench_q01/datafusion:parquet 15820462 / 15975198 / -1.0% 64932328 / 66883453 / -2.9% 0.24 / 0.24 / +2.0%
clickbench_q02/datafusion:parquet 19015558 / 19024956 / -0.0% 81694593 / 81292366 / +0.5% 0.23 / 0.23 / -0.5%
clickbench_q03/datafusion:parquet 16489032 / 17560503 / -6.1% 79579447 / 79048536 / +0.7% 0.21 / 0.22 / -6.7%
clickbench_q04/datafusion:parquet 63957926 / 62657254 / +2.1% 126980822 / 129056405 / -1.6% 0.50 / 0.49 / +3.7%
clickbench_q05/datafusion:parquet 89204879 / 89388218 / -0.2% 156043166 / 157935497 / -1.2% 0.57 / 0.57 / +1.0%
clickbench_q06/datafusion:parquet 1282282 / 1247492 / +2.8% 50527044 / 49860473 / +1.3% 0.03 / 0.03 / +1.4%
clickbench_q07/datafusion:parquet 16860896 / 16844414 / +0.1% 66166651 / 67110170 / -1.4% 0.25 / 0.25 / +1.5%
clickbench_q08/datafusion:parquet 86264155 / 85805378 / +0.5% 163019667 / 160618520 / +1.5% 0.53 / 0.53 / -0.9%
clickbench_q09/datafusion:parquet 187209944 / 187483740 / -0.1% 259780422 / 273970246 / -5.2% 0.72 / 0.68 / +5.3%
clickbench_q10/datafusion:parquet 35926522 / 35933968 / -0.0% 97749165 / 99356253 / -1.6% 0.37 / 0.36 / +1.6%
clickbench_q11/datafusion:parquet 42899022 / 42619872 / +0.7% 110356969 / 107756386 / +2.4% 0.39 / 0.40 / -1.7%
clickbench_q12/datafusion:parquet 96334963 / 96266114 / +0.1% 161411852 / 162038776 / -0.4% 0.60 / 0.59 / +0.5%
clickbench_q13/datafusion:parquet 145649044 / 146539911 / -0.6% 230021611 / 227411999 / +1.1% 0.63 / 0.64 / -1.7%
clickbench_q14/datafusion:parquet 101974761 / 102721975 / -0.7% 172036616 / 174323102 / -1.3% 0.59 / 0.59 / +0.6%
clickbench_q15/datafusion:parquet 71214424 / 72072821 / -1.2% 132127168 / 130369029 / +1.3% 0.54 / 0.55 / -2.5%
clickbench_q16/datafusion:parquet 154127119 / 155655536 / -1.0% 233247300 / 242072681 / -3.6% 0.66 / 0.64 / +2.8%
clickbench_q17/datafusion:parquet 154164516 / 156748302 / -1.6% 236498895 / 234690281 / +0.8% 0.65 / 0.67 / -2.4%
clickbench_q18/datafusion:parquet 311151770 / 311937038 / -0.3% 419732876 / 429885360 / -2.4% 0.74 / 0.73 / +2.2%
clickbench_q19/datafusion:parquet 18927014 / 18985055 / -0.3% 78978551 / 76428879 / +3.3% 0.24 / 0.25 / -3.5%
clickbench_q20/datafusion:parquet 178765991 / 178201950 / +0.3% 281894433 / 277984119 / +1.4% 0.63 / 0.64 / -1.1%
clickbench_q21/datafusion:parquet 172651136 / 174353110 / -1.0% 299019950 / 298763106 / +0.1% 0.58 / 0.58 / -1.1%
clickbench_q22/datafusion:parquet 259698318 / 264644574 / -1.9% 425167240 / 427231380 / -0.5% 0.61 / 0.62 / -1.4%
clickbench_q23/datafusion:parquet 1010596486 / 1015310230 / -0.5% 1191666762 / 1186767292 / +0.4% 0.85 / 0.86 / -0.9%
clickbench_q24/datafusion:parquet 29749384 / 30461840 / -2.3% 87321595 / 89550560 / -2.5% 0.34 / 0.34 / +0.2%
clickbench_q25/datafusion:parquet 36274126 / 36461936 / -0.5% 102360279 / 103796692 / -1.4% 0.35 / 0.35 / +0.9%
clickbench_q26/datafusion:parquet 30359564 / 30640387 / -0.9% 88631989 / 89946311 / -1.5% 0.34 / 0.34 / +0.6%
clickbench_q27/datafusion:parquet 194286406 / 192726410 / +0.8% 294972674 / 288972174 / +2.1% 0.66 / 0.67 / -1.2%
clickbench_q28/datafusion:parquet 616822645 / 621473269 / -0.7% 704214855 / 715604342 / -1.6% 0.88 / 0.87 / +0.9%
clickbench_q29/datafusion:parquet 29140167 / 28657065 / +1.7% 90600231 / 90415523 / +0.2% 0.32 / 0.32 / +1.5%
clickbench_q30/datafusion:parquet 90621215 / 91351340 / -0.8% 171633789 / 172111509 / -0.3% 0.53 / 0.53 / -0.5%
clickbench_q31/datafusion:parquet 101974395 / 102634058 / -0.6% 200826417 / 198577852 / +1.1% 0.51 / 0.52 / -1.8%
clickbench_q32/datafusion:parquet 307496361 / 311819602 / -1.4% 422354115 / 434802281 / -2.9% 0.73 / 0.72 / +1.5%
clickbench_q33/datafusion:parquet 377379601 / 380089808 / -0.7% 477890239 / 473796518 / +0.9% 0.79 / 0.80 / -1.6%
clickbench_q34/datafusion:parquet 378543723 / 376914011 / +0.4% 476063976 / 477819866 / -0.4% 0.80 / 0.79 / +0.8%
clickbench_q35/datafusion:parquet 65153339 / 65520001 / -0.6% 122985330 / 122720394 / +0.2% 0.53 / 0.53 / -0.8%
clickbench_q36/datafusion:parquet 73160302 / 73697400 / -0.7% 136849920 / 136472185 / +0.3% 0.53 / 0.54 / -1.0%
clickbench_q37/datafusion:parquet 35714090 / 35543201 / +0.5% 91483228 / 91265731 / +0.2% 0.39 / 0.39 / +0.2%
clickbench_q38/datafusion:parquet 47624554 / 48184051 / -1.2% 107666327 / 110190286 / -2.3% 0.44 / 0.44 / +1.2%
clickbench_q39/datafusion:parquet 143721662 / 143896086 / -0.1% 209610427 / 213345420 / -1.8% 0.69 / 0.67 / +1.7%
clickbench_q40/datafusion:parquet 20088684 / 20053370 / +0.2% 76333255 / 78117633 / -2.3% 0.26 / 0.26 / +2.5%
clickbench_q41/datafusion:parquet 18606118 / 18881718 / -1.5% 75391009 / 76285755 / -1.2% 0.25 / 0.25 / -0.3%
clickbench_q42/datafusion:parquet 19241300 / 19347004 / -0.5% 74509681 / 74154859 / +0.5% 0.26 / 0.26 / -1.0%
duckdb / vortex-file-compressed / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2166936 / 2237106 / -3.1% 25389657 / 25307876 / +0.3% 0.09 / 0.09 / -3.4%
clickbench_q01/duckdb:vortex-file-compressed 7546354 / 7655398 / -1.4% 28933467 / 30911132 / -6.4% 0.26 / 0.25 / +5.3%
clickbench_q02/duckdb:vortex-file-compressed 8687468 / 9039239 / -3.9% 36844520 / 38103656 / -3.3% 0.24 / 0.24 / -0.6%
clickbench_q03/duckdb:vortex-file-compressed 14053176 / 14038454 / +0.1% 49597247 / 51361504 / -3.4% 0.28 / 0.27 / +3.7%
clickbench_q04/duckdb:vortex-file-compressed 55782890 / 55959632 / -0.3% 91477614 / 90702001 / +0.9% 0.61 / 0.62 / -1.2%
clickbench_q05/duckdb:vortex-file-compressed 63776762 / 63897903 / -0.2% 94771802 / 96923586 / -2.2% 0.67 / 0.66 / +2.1%
clickbench_q06/duckdb:vortex-file-compressed 2638831 / 2644494 / -0.2% 27013367 / 29217110 / -7.5% 0.10 / 0.09 / +7.9%
clickbench_q07/duckdb:vortex-file-compressed 9429755 / 9511088 / -0.9% 28533264 / 30810489 / -7.4% 0.33 / 0.31 / +7.1%
clickbench_q08/duckdb:vortex-file-compressed 68588497 / 69255778 / -1.0% 107546308 / 107914279 / -0.3% 0.64 / 0.64 / -0.6%
clickbench_q09/duckdb:vortex-file-compressed 92008559 / 92548142 / -0.6% 132399819 / 128409391 / +3.1% 0.69 / 0.72 / -3.6%
clickbench_q10/duckdb:vortex-file-compressed 27254239 / 27689274 / -1.6% 68808585 / 72148281 / -4.6% 0.40 / 0.38 / +3.2%
clickbench_q11/duckdb:vortex-file-compressed 30084902 / 30540370 / -1.5% 73173764 / 79204582 / -7.6% 0.41 / 0.39 / +6.6%
clickbench_q12/duckdb:vortex-file-compressed 69113350 / 69892491 / -1.1% 100175528 / 100654921 / -0.5% 0.69 / 0.69 / -0.6%
clickbench_q13/duckdb:vortex-file-compressed 124074364 / 127172012 / -2.4% 167725177 / 169732824 / -1.2% 0.74 / 0.75 / -1.3%
clickbench_q14/duckdb:vortex-file-compressed 73730438 / 74951316 / -1.6% 106480930 / 108241821 / -1.6% 0.69 / 0.69 / -0.0%
clickbench_q15/duckdb:vortex-file-compressed 75321444 / 75857344 / -0.7% 107893925 / 109421143 / -1.4% 0.70 / 0.69 / +0.7%
clickbench_q16/duckdb:vortex-file-compressed 133652798 / 133718120 / -0.0% 170191753 / 172972559 / -1.6% 0.79 / 0.77 / +1.6%
clickbench_q17/duckdb:vortex-file-compressed 135694796 / 139145834 / -2.5% 173395062 / 176256527 / -1.6% 0.78 / 0.79 / -0.9%
clickbench_q18/duckdb:vortex-file-compressed 248138318 / 261284120 / -5.0% 299234776 / 305972300 / -2.2% 0.83 / 0.85 / -2.9%
clickbench_q19/duckdb:vortex-file-compressed 9434584 / 9433455 / +0.0% 36935545 / 38621943 / -4.4% 0.26 / 0.24 / +4.6%
clickbench_q20/duckdb:vortex-file-compressed 67385471 / 67552078 / -0.2% 166092744 / 169737178 / -2.1% 0.41 / 0.40 / +1.9%
clickbench_q21/duckdb:vortex-file-compressed 84240148 / 85506677 / -1.5% 187985928 / 194027861 / -3.1% 0.45 / 0.44 / +1.7%
clickbench_q22/duckdb:vortex-file-compressed 172524875 / 176474637 / -2.2% 357767542 / 345523729 / +3.5% 0.48 / 0.51 / -5.6%
clickbench_q23/duckdb:vortex-file-compressed 40283180 / 41929978 / -3.9% 88356899 / 90293247 / -2.1% 0.46 / 0.46 / -1.8%
clickbench_q24/duckdb:vortex-file-compressed 14330466 / 14160536 / +1.2% 37792891 / 39660096 / -4.7% 0.38 / 0.36 / +6.2%
clickbench_q25/duckdb:vortex-file-compressed 18862957 / 19419968 / -2.9% 54502047 / 54403251 / +0.2% 0.35 / 0.36 / -3.0%
clickbench_q26/duckdb:vortex-file-compressed 11550394 / 11388071 / +1.4% 33939235 / 39205981 / -13.4% 🟢 0.34 / 0.29 / +17.2%
clickbench_q27/duckdb:vortex-file-compressed 53260156 / 55108350 / -3.4% 170147019 / 180380940 / -5.7% 0.31 / 0.31 / +2.5%
clickbench_q28/duckdb:vortex-file-compressed 512996766 / 516077988 / -0.6% 571946482 / 559514013 / +2.2% 0.90 / 0.92 / -2.8%
clickbench_q29/duckdb:vortex-file-compressed 16347138 / 16801554 / -2.7% 43010898 / 43120020 / -0.3% 0.38 / 0.39 / -2.5%
clickbench_q30/duckdb:vortex-file-compressed 60297668 / 60694336 / -0.7% 109891975 / 112438538 / -2.3% 0.55 / 0.54 / +1.6%
clickbench_q31/duckdb:vortex-file-compressed 110417761 / 110928932 / -0.5% 198625507 / 200481515 / -0.9% 0.56 / 0.55 / +0.5%
clickbench_q32/duckdb:vortex-file-compressed 352779642 / 376905062 / -6.4% 388407469 / 411978991 / -5.7% 0.91 / 0.91 / -0.7%
clickbench_q33/duckdb:vortex-file-compressed 341402850 / 346800168 / -1.6% 399760611 / 400039829 / -0.1% 0.85 / 0.87 / -1.5%
clickbench_q34/duckdb:vortex-file-compressed 350513395 / 358757820 / -2.3% 410207377 / 415394371 / -1.2% 0.85 / 0.86 / -1.1%
clickbench_q35/duckdb:vortex-file-compressed 56284087 / 57165394 / -1.5% 91420665 / 89565873 / +2.1% 0.62 / 0.64 / -3.5%
clickbench_q36/duckdb:vortex-file-compressed 11545352 / 11736720 / -1.6% 32530030 / 31701737 / +2.6% 0.35 / 0.37 / -4.1%
clickbench_q37/duckdb:vortex-file-compressed 7866151 / 8307028 / -5.3% 28719430 / 28390029 / +1.2% 0.27 / 0.29 / -6.4%
clickbench_q38/duckdb:vortex-file-compressed 8777328 / 9089105 / -3.4% 28775905 / 28411635 / +1.3% 0.31 / 0.32 / -4.7%
clickbench_q39/duckdb:vortex-file-compressed 18600260 / 18985566 / -2.0% 38207346 / 41519995 / -8.0% 0.49 / 0.46 / +6.5%
clickbench_q40/duckdb:vortex-file-compressed 7216794 / 7541189 / -4.3% 26776651 / 26930257 / -0.6% 0.27 / 0.28 / -3.8%
clickbench_q41/duckdb:vortex-file-compressed 8255124 / 8447401 / -2.3% 28177926 / 30600085 / -7.9% 0.29 / 0.28 / +6.1%
clickbench_q42/duckdb:vortex-file-compressed 7180242 / 7460622 / -3.8% 28768057 / 28688927 / +0.3% 0.25 / 0.26 / -4.0%
duckdb / parquet / ns (0.985x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9099712 / 9718106 / -6.4% 14033437 / 14404944 / -2.6% 0.65 / 0.67 / -3.9%
clickbench_q01/duckdb:parquet 14963525 / 15834801 / -5.5% 21590625 / 20779530 / +3.9% 0.69 / 0.76 / -9.1%
clickbench_q02/duckdb:parquet 21980896 / 22998262 / -4.4% 29271806 / 30933941 / -5.4% 0.75 / 0.74 / +1.0%
clickbench_q03/duckdb:parquet 23149990 / 22952789 / +0.9% 33854781 / 36373798 / -6.9% 0.68 / 0.63 / +8.4%
clickbench_q04/duckdb:parquet 60227058 / 61553110 / -2.2% 70002133 / 78571229 / -10.9% 🟢 0.86 / 0.78 / +9.8%
clickbench_q05/duckdb:parquet 83199553 / 82357820 / +1.0% 96441047 / 96778532 / -0.3% 0.86 / 0.85 / +1.4%
clickbench_q06/duckdb:parquet 20316626 / 20631596 / -1.5% 30509017 / 27932745 / +9.2% 0.67 / 0.74 / -9.8%
clickbench_q07/duckdb:parquet 17183642 / 17411882 / -1.3% 22643707 / 23086324 / -1.9% 0.76 / 0.75 / +0.6%
clickbench_q08/duckdb:parquet 74592616 / 74193970 / +0.5% 87170059 / 88499093 / -1.5% 0.86 / 0.84 / +2.1%
clickbench_q09/duckdb:parquet 102059123 / 102344946 / -0.3% 121217989 / 118287242 / +2.5% 0.84 / 0.87 / -2.7%
clickbench_q10/duckdb:parquet 41879494 / 41585957 / +0.7% 52696232 / 53914290 / -2.3% 0.79 / 0.77 / +3.0%
clickbench_q11/duckdb:parquet 45898766 / 46376690 / -1.0% 60129221 / 62469950 / -3.7% 0.76 / 0.74 / +2.8%
clickbench_q12/duckdb:parquet 92384234 / 93246466 / -0.9% 104843767 / 106709132 / -1.7% 0.88 / 0.87 / +0.8%
clickbench_q13/duckdb:parquet 149923920 / 151353115 / -0.9% 165836954 / 168774480 / -1.7% 0.90 / 0.90 / +0.8%
clickbench_q14/duckdb:parquet 100221713 / 101132109 / -0.9% 117162122 / 121484338 / -3.6% 0.86 / 0.83 / +2.8%
clickbench_q15/duckdb:parquet 86366516 / 87152113 / -0.9% 99934969 / 99157583 / +0.8% 0.86 / 0.88 / -1.7%
clickbench_q16/duckdb:parquet 165950828 / 161518198 / +2.7% 176088466 / 177677559 / -0.9% 0.94 / 0.91 / +3.7%
clickbench_q17/duckdb:parquet 159513576 / 163501751 / -2.4% 179685908 / 179044078 / +0.4% 0.89 / 0.91 / -2.8%
clickbench_q18/duckdb:parquet 291013402 / 297760434 / -2.3% 310149095 / 317638716 / -2.4% 0.94 / 0.94 / +0.1%
clickbench_q19/duckdb:parquet 19837878 / 20044906 / -1.0% 24913871 / 26219883 / -5.0% 0.80 / 0.76 / +4.2%
clickbench_q20/duckdb:parquet 178157469 / 190656931 / -6.6% 226234207 / 223372775 / +1.3% 0.79 / 0.85 / -7.7%
clickbench_q21/duckdb:parquet 218190771 / 221775748 / -1.6% 269652463 / 270636772 / -0.4% 0.81 / 0.82 / -1.3%
clickbench_q22/duckdb:parquet 305234078 / 316494844 / -3.6% 359003603 / 356496439 / +0.7% 0.85 / 0.89 / -4.2%
clickbench_q23/duckdb:parquet 169248082 / 172903391 / -2.1% 235846696 / 233746562 / +0.9% 0.72 / 0.74 / -3.0%
clickbench_q24/duckdb:parquet 30113176 / 30525626 / -1.4% 33140029 / 44919682 / -26.2% 🟢 0.91 / 0.68 / +33.7%
clickbench_q25/duckdb:parquet 42373839 / 43279324 / -2.1% 56095830 / 55176174 / +1.7% 0.76 / 0.78 / -3.7%
clickbench_q26/duckdb:parquet 29312313 / 29909380 / -2.0% 44228748 / 47593911 / -7.1% 0.66 / 0.63 / +5.5%
clickbench_q27/duckdb:parquet 191638498 / 190317469 / +0.7% 221467641 / 230460935 / -3.9% 0.87 / 0.83 / +4.8%
clickbench_q28/duckdb:parquet 953387789 / 966912630 / -1.4% 937476162 / 939906810 / -0.3% 1.02 / 1.03 / -1.1%
clickbench_q29/duckdb:parquet 23588704 / 23708308 / -0.5% 31352918 / 31487776 / -0.4% 0.75 / 0.75 / -0.1%
clickbench_q30/duckdb:parquet 105572728 / 107434616 / -1.7% 126467544 / 126651318 / -0.1% 0.83 / 0.85 / -1.6%
clickbench_q31/duckdb:parquet 145561776 / 146264200 / -0.5% 171227054 / 172955499 / -1.0% 0.85 / 0.85 / +0.5%
clickbench_q32/duckdb:parquet 390855112 / 392919146 / -0.5% 409497126 / 417034375 / -1.8% 0.95 / 0.94 / +1.3%
clickbench_q33/duckdb:parquet 482677883 / 489452036 / -1.4% 447667586 / 442277693 / +1.2% 1.08 / 1.11 / -2.6%
clickbench_q34/duckdb:parquet 465883298 / 466236417 / -0.1% 488880830 / 469010681 / +4.2% 0.95 / 0.99 / -4.1%
clickbench_q35/duckdb:parquet 60927279 / 61471326 / -0.9% 76267383 / 75534239 / +1.0% 0.80 / 0.81 / -1.8%
clickbench_q36/duckdb:parquet 30347873 / 30715884 / -1.2% 35530099 / 36664389 / -3.1% 0.85 / 0.84 / +2.0%
clickbench_q37/duckdb:parquet 22887786 / 23465799 / -2.5% 29935216 / 29463089 / +1.6% 0.76 / 0.80 / -4.0%
clickbench_q38/duckdb:parquet 23501350 / 23803284 / -1.3% 29735555 / 30067802 / -1.1% 0.79 / 0.79 / -0.2%
clickbench_q39/duckdb:parquet 52014928 / 53454965 / -2.7% 61115601 / 60267957 / +1.4% 0.85 / 0.89 / -4.0%
clickbench_q40/duckdb:parquet 15021790 / 14620130 / +2.7% 19918022 / 20417625 / -2.4% 0.75 / 0.72 / +5.3%
clickbench_q41/duckdb:parquet 14929782 / 15522580 / -3.8% 20330445 / 20561068 / -1.1% 0.73 / 0.75 / -2.7%
clickbench_q42/duckdb:parquet 13798676 / 14508395 / -4.9% 20534533 / 21329381 / -3.7% 0.67 / 0.68 / -1.2%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR a29c280d vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-1.7%, environment too noisy confidence) · DuckDB No clear signal (+2.6%, environment too noisy confidence)
Vortex (geomean): hot 1.050x ➖ · cold 1.027x ➖
Parquet (geomean): hot 1.045x ➖ · cold 1.059x ➖
Shifts: Parquet (control) +4.5% · Median polish +5.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.053x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 223534751 / 220831264 / +1.2% 845503300 / 576458480 / +46.7% 🔴 0.26 / 0.38 / -31.0%
tpch_q02/datafusion:vortex-file-compressed 384754513 / 308669932 / +24.6% 830872576 / 674528013 / +23.2% 0.46 / 0.46 / +1.2%
tpch_q03/datafusion:vortex-file-compressed 351351233 / 347086704 / +1.2% 959507283 / 871608881 / +10.1% 0.37 / 0.40 / -8.0%
tpch_q04/datafusion:vortex-file-compressed 188121213 / 207021749 / -9.1% 444488072 / 422384755 / +5.2% 0.42 / 0.49 / -13.6%
tpch_q05/datafusion:vortex-file-compressed 525611260 / 425586511 / +23.5% 669302749 / 613441206 / +9.1% 0.79 / 0.69 / +13.2%
tpch_q06/datafusion:vortex-file-compressed 168761788 / 141424151 / +19.3% 316254905 / 371254228 / -14.8% 0.53 / 0.38 / +40.1%
tpch_q07/datafusion:vortex-file-compressed 488077076 / 462415225 / +5.5% 769699623 / 582547518 / +32.1% 🔴 0.63 / 0.79 / -20.1%
tpch_q08/datafusion:vortex-file-compressed 515225132 / 427390773 / +20.6% 576184579 / 601931393 / -4.3% 0.89 / 0.71 / +25.9%
tpch_q09/datafusion:vortex-file-compressed 489037120 / 268529658 / +82.1% 🔴 758423260 / 473357724 / +60.2% 🔴 0.64 / 0.57 / +13.7%
tpch_q10/datafusion:vortex-file-compressed 394485782 / 348508035 / +13.2% 802001432 / 528499094 / +51.8% 🔴 0.49 / 0.66 / -25.4%
tpch_q11/datafusion:vortex-file-compressed 289303528 / 257327413 / +12.4% 445036796 / 420659524 / +5.8% 0.65 / 0.61 / +6.3%
tpch_q12/datafusion:vortex-file-compressed 229804816 / 210715328 / +9.1% 334061923 / 429074710 / -22.1% 0.69 / 0.49 / +40.1%
tpch_q13/datafusion:vortex-file-compressed 137593657 / 131309055 / +4.8% 371372409 / 370354402 / +0.3% 0.37 / 0.35 / +4.5%
tpch_q14/datafusion:vortex-file-compressed 204350289 / 211521200 / -3.4% 348505131 / 383637559 / -9.2% 0.59 / 0.55 / +6.3%
tpch_q15/datafusion:vortex-file-compressed 303659971 / 292649172 / +3.8% 565668792 / 520914480 / +8.6% 0.54 / 0.56 / -4.4%
tpch_q16/datafusion:vortex-file-compressed 144015252 / 158770515 / -9.3% 330038735 / 318188188 / +3.7% 0.44 / 0.50 / -12.6%
tpch_q17/datafusion:vortex-file-compressed 249476037 / 307709054 / -18.9% 426755393 / 454845057 / -6.2% 0.58 / 0.68 / -13.6%
tpch_q18/datafusion:vortex-file-compressed 254482198 / 590427775 / -56.9% 🟢 412011085 / 723635830 / -43.1% 🟢 0.62 / 0.82 / -24.3%
tpch_q19/datafusion:vortex-file-compressed 236794051 / 216120746 / +9.6% 512209789 / 356996489 / +43.5% 🔴 0.46 / 0.61 / -23.6%
tpch_q20/datafusion:vortex-file-compressed 363750890 / 292443661 / +24.4% 508584949 / 509890552 / -0.3% 0.72 / 0.57 / +24.7%
tpch_q21/datafusion:vortex-file-compressed 531834208 / 456400316 / +16.5% 782482643 / 730212380 / +7.2% 0.68 / 0.63 / +8.7%
tpch_q22/datafusion:vortex-file-compressed 177769858 / 167024301 / +6.4% 426598946 / 388209621 / +9.9% 0.42 / 0.43 / -3.1%
datafusion / parquet / ns (1.071x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 179248539 / 150351198 / +19.2% 577106682 / 460460005 / +25.3% 0.31 / 0.33 / -4.9%
tpch_q02/datafusion:parquet 314452360 / 284014916 / +10.7% 602431223 / 458008198 / +31.5% 🔴 0.52 / 0.62 / -15.8%
tpch_q03/datafusion:parquet 245368739 / 271007543 / -9.5% 704835933 / 753951884 / -6.5% 0.35 / 0.36 / -3.2%
tpch_q04/datafusion:parquet 127700644 / 133714329 / -4.5% 291078108 / 322406865 / -9.7% 0.44 / 0.41 / +5.8%
tpch_q05/datafusion:parquet 374346040 / 342356608 / +9.3% 769279550 / 468240904 / +64.3% 🔴 0.49 / 0.73 / -33.4%
tpch_q06/datafusion:parquet 109736626 / 112055911 / -2.1% 250049497 / 226141107 / +10.6% 0.44 / 0.50 / -11.4%
tpch_q07/datafusion:parquet 354205969 / 329957349 / +7.3% 629198107 / 516179984 / +21.9% 0.56 / 0.64 / -11.9%
tpch_q08/datafusion:parquet 531621094 / 432763020 / +22.8% 593561215 / 536690978 / +10.6% 0.90 / 0.81 / +11.1%
tpch_q09/datafusion:parquet 387278992 / 373806384 / +3.6% 526341581 / 539014441 / -2.4% 0.74 / 0.69 / +6.1%
tpch_q10/datafusion:parquet 320622011 / 309340609 / +3.6% 404701797 / 417479206 / -3.1% 0.79 / 0.74 / +6.9%
tpch_q11/datafusion:parquet 247126037 / 261901027 / -5.6% 346750797 / 373704730 / -7.2% 0.71 / 0.70 / +1.7%
tpch_q12/datafusion:parquet 186003371 / 162342440 / +14.6% 330037565 / 309500458 / +6.6% 0.56 / 0.52 / +7.4%
tpch_q13/datafusion:parquet 277001532 / 276376623 / +0.2% 650258467 / 436081873 / +49.1% 🔴 0.43 / 0.63 / -32.8%
tpch_q14/datafusion:parquet 188385975 / 157906152 / +19.3% 290981138 / 273555838 / +6.4% 0.65 / 0.58 / +12.2%
tpch_q15/datafusion:parquet 328532407 / 317865748 / +3.4% 457528503 / 523121657 / -12.5% 0.72 / 0.61 / +18.2%
tpch_q16/datafusion:parquet 106851856 / 111322386 / -4.0% 216873920 / 231410953 / -6.3% 0.49 / 0.48 / +2.4%
tpch_q17/datafusion:parquet 262378528 / 272274209 / -3.6% 434816772 / 526187695 / -17.4% 0.60 / 0.52 / +16.6%
tpch_q18/datafusion:parquet 385621633 / 341966792 / +12.8% 507063111 / 503106611 / +0.8% 0.76 / 0.68 / +11.9%
tpch_q19/datafusion:parquet 196542500 / 157601017 / +24.7% 301013838 / 273426259 / +10.1% 0.65 / 0.58 / +13.3%
tpch_q20/datafusion:parquet 276854228 / 235515300 / +17.6% 458604536 / 397076072 / +15.5% 0.60 / 0.59 / +1.8%
tpch_q21/datafusion:parquet 377989061 / 292874917 / +29.1% 504947049 / 463033836 / +9.1% 0.75 / 0.63 / +18.3%
tpch_q22/datafusion:parquet 158421248 / 160199804 / -1.1% 344714960 / 388871374 / -11.4% 0.46 / 0.41 / +11.6%
duckdb / vortex-file-compressed / ns (1.047x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 249531673 / 247509334 / +0.8% 329385992 / 267181463 / +23.3% 0.76 / 0.93 / -18.2%
tpch_q02/duckdb:vortex-file-compressed 439043417 / 408988212 / +7.3% 428948726 / 495524216 / -13.4% 1.02 / 0.83 / +24.0%
tpch_q03/duckdb:vortex-file-compressed 464369522 / 416179552 / +11.6% 480534982 / 484765981 / -0.9% 0.97 / 0.86 / +12.6%
tpch_q04/duckdb:vortex-file-compressed 296790088 / 273734107 / +8.4% 382884466 / 309747374 / +23.6% 0.78 / 0.88 / -12.3%
tpch_q05/duckdb:vortex-file-compressed 599279947 / 585375507 / +2.4% 607256187 / 657952067 / -7.7% 0.99 / 0.89 / +10.9%
tpch_q06/duckdb:vortex-file-compressed 260216908 / 203012163 / +28.2% 257168153 / 217053599 / +18.5% 1.01 / 0.94 / +8.2%
tpch_q07/duckdb:vortex-file-compressed 472024369 / 433499388 / +8.9% 554895821 / 491006362 / +13.0% 0.85 / 0.88 / -3.7%
tpch_q08/duckdb:vortex-file-compressed 649348232 / 856662362 / -24.2% 803976841 / 924712147 / -13.1% 0.81 / 0.93 / -12.8%
tpch_q09/duckdb:vortex-file-compressed 453604042 / 430063376 / +5.5% 446757178 / 472261724 / -5.4% 1.02 / 0.91 / +11.5%
tpch_q10/duckdb:vortex-file-compressed 546719069 / 562615415 / -2.8% 580729714 / 577179328 / +0.6% 0.94 / 0.97 / -3.4%
tpch_q11/duckdb:vortex-file-compressed 580396774 / 295453825 / +96.4% 🔴 275483870 / 295294530 / -6.7% 2.11 / 1.00 / +110.6%
tpch_q12/duckdb:vortex-file-compressed 263363976 / 281391065 / -6.4% 330244800 / 342314564 / -3.5% 0.80 / 0.82 / -3.0%
tpch_q13/duckdb:vortex-file-compressed 216061600 / 257839733 / -16.2% 324978692 / 337095202 / -3.6% 0.66 / 0.76 / -13.1%
tpch_q14/duckdb:vortex-file-compressed 251443471 / 215999117 / +16.4% 286660916 / 312373489 / -8.2% 0.88 / 0.69 / +26.9%
tpch_q15/duckdb:vortex-file-compressed 276125995 / 339636073 / -18.7% 355838196 / 292926502 / +21.5% 0.78 / 1.16 / -33.1%
tpch_q16/duckdb:vortex-file-compressed 202576640 / 210376153 / -3.7% 224038339 / 230946559 / -3.0% 0.90 / 0.91 / -0.7%
tpch_q17/duckdb:vortex-file-compressed 360005344 / 324970756 / +10.8% 353948665 / 357086182 / -0.9% 1.02 / 0.91 / +11.8%
tpch_q18/duckdb:vortex-file-compressed 526975962 / 431733303 / +22.1% 407162202 / 402106068 / +1.3% 1.29 / 1.07 / +20.5%
tpch_q19/duckdb:vortex-file-compressed 348100654 / 303395982 / +14.7% 307587459 / 339697179 / -9.5% 1.13 / 0.89 / +26.7%
tpch_q20/duckdb:vortex-file-compressed 326353033 / 385636006 / -15.4% 392197569 / 483758671 / -18.9% 0.83 / 0.80 / +4.4%
tpch_q21/duckdb:vortex-file-compressed 697461073 / 656583605 / +6.2% 782051041 / 782358666 / -0.0% 0.89 / 0.84 / +6.3%
tpch_q22/duckdb:vortex-file-compressed 241138440 / 251855732 / -4.3% 260205486 / 334512025 / -22.2% 0.93 / 0.75 / +23.1%
duckdb / parquet / ns (1.020x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 180648336 / 152166910 / +18.7% 228964326 / 211204649 / +8.4% 0.79 / 0.72 / +9.5%
tpch_q02/duckdb:parquet 444532746 / 453471368 / -2.0% 495022235 / 426327264 / +16.1% 0.90 / 1.06 / -15.6%
tpch_q03/duckdb:parquet 340353797 / 358243434 / -5.0% 428714971 / 423368603 / +1.3% 0.79 / 0.85 / -6.2%
tpch_q04/duckdb:parquet 219792032 / 281717280 / -22.0% 333926995 / 332953926 / +0.3% 0.66 / 0.85 / -22.2%
tpch_q05/duckdb:parquet 555764282 / 536493872 / +3.6% 624426525 / 570606274 / +9.4% 0.89 / 0.94 / -5.3%
tpch_q06/duckdb:parquet 133579120 / 161239284 / -17.2% 205268579 / 206658661 / -0.7% 0.65 / 0.78 / -16.6%
tpch_q07/duckdb:parquet 410615575 / 436361603 / -5.9% 415950739 / 493434333 / -15.7% 0.99 / 0.88 / +11.6%
tpch_q08/duckdb:parquet 691894991 / 631844333 / +9.5% 723315712 / 652757052 / +10.8% 0.96 / 0.97 / -1.2%
tpch_q09/duckdb:parquet 584818224 / 564743109 / +3.6% 579708158 / 620443574 / -6.6% 1.01 / 0.91 / +10.8%
tpch_q10/duckdb:parquet 585501742 / 581110821 / +0.8% 557231798 / 636456873 / -12.4% 1.05 / 0.91 / +15.1%
tpch_q11/duckdb:parquet 272034181 / 285994921 / -4.9% 282766660 / 263711609 / +7.2% 0.96 / 1.08 / -11.3%
tpch_q12/duckdb:parquet 306150378 / 252866750 / +21.1% 293632991 / 291902719 / +0.6% 1.04 / 0.87 / +20.4%
tpch_q13/duckdb:parquet 376143350 / 369355879 / +1.8% 449471788 / 429176067 / +4.7% 0.84 / 0.86 / -2.8%
tpch_q14/duckdb:parquet 358984900 / 269935408 / +33.0% 🔴 335169876 / 344984516 / -2.8% 1.07 / 0.78 / +36.9%
tpch_q15/duckdb:parquet 220925532 / 212505719 / +4.0% 366961392 / 228893439 / +60.3% 🔴 0.60 / 0.93 / -35.2%
tpch_q16/duckdb:parquet 283980721 / 275747511 / +3.0% 245543121 / 327100698 / -24.9% 1.16 / 0.84 / +37.2%
tpch_q17/duckdb:parquet 307361532 / 263952606 / +16.4% 358485093 / 331901361 / +8.0% 0.86 / 0.80 / +7.8%
tpch_q18/duckdb:parquet 337455539 / 382490629 / -11.8% 351777910 / 393794532 / -10.7% 0.96 / 0.97 / -1.2%
tpch_q19/duckdb:parquet 293410675 / 266061746 / +10.3% 365722377 / 345007366 / +6.0% 0.80 / 0.77 / +4.0%
tpch_q20/duckdb:parquet 447083011 / 448150426 / -0.2% 949363303 / 480087501 / +97.7% 🔴 0.47 / 0.93 / -49.6%
tpch_q21/duckdb:parquet 461276550 / 418893862 / +10.1% 524207290 / 454759125 / +15.3% 0.88 / 0.92 / -4.5%
tpch_q22/duckdb:parquet 300405367 / 323115195 / -7.0% 300312981 / 335134028 / -10.4% 1.00 / 0.96 / +3.8%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant