Skip to content

[Benchmark only] Plan each DuckDB V2 part as one chunk - #11064

Closed
joseph-isaacs wants to merge 1 commit into
developfrom
ji/v2-isolate-single-chunk
Closed

joseph-isaacs wants to merge 1 commit into
developfrom
ji/v2-isolate-single-chunk

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

One of the three changes in #11060, on its own, so CI can benchmark it in isolation. Do not merge; this draft is closed once its benchmark results are in.

Adds ChunkPlanner::single, and the DuckDB V2 driver plans each part as one chunk instead of cutting it on the chunk grid.

It has the same base as #11060 (19dcd2f2d).

🤖 Generated with Claude Code

https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM

One of the three changes of #11060, on its own, to benchmark it in isolation.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 30, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@github-actions

github-actions Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done b423d20 tpch-nvme-10 1 Explore Profiling Data
🟢 Done b423d20 tpch-nvme 1 Explore Profiling Data
🟢 Done b423d20 polarsignals 1 Explore Profiling Data
🟢 Done b423d20 clickbench-nvme 1 Explore Profiling Data
🟢 Done b423d20 fineweb 1 Explore Profiling Data
🟢 Done b423d20 tpch-s3 1 Explore Profiling Data
🟢 Done b423d20 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR b423d204 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-1.8%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.951x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.944x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.986x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7140954 / 6914164 / +3.3% 16055602 / 15894016 / +1.0% 0.44 / 0.44 / +2.2%
fineweb_q01/datafusion:vortex-file-compressed 7259696 / 8207537 / -11.5% 🟢 40565009 / 42273090 / -4.0% 0.18 / 0.19 / -7.8%
fineweb_q02/datafusion:vortex-file-compressed 9603278 / 9825386 / -2.3% 44527313 / 45991505 / -3.2% 0.22 / 0.21 / +1.0%
fineweb_q03/datafusion:vortex-file-compressed 18864197 / 19985364 / -5.6% 96035999 / 112849457 / -14.9% 🟢 0.20 / 0.18 / +10.9%
fineweb_q04/datafusion:vortex-file-compressed 66910773 / 67072209 / -0.2% 141295218 / 154793659 / -8.7% 0.47 / 0.43 / +9.3%
fineweb_q05/datafusion:vortex-file-compressed 66796002 / 67066206 / -0.4% 139076460 / 152013803 / -8.5% 0.48 / 0.44 / +8.9%
fineweb_q06/datafusion:vortex-file-compressed 19412699 / 19077528 / +1.8% 101733258 / 116530631 / -12.7% 🟢 0.19 / 0.16 / +16.6%
fineweb_q07/datafusion:vortex-file-compressed 18495870 / 19804552 / -6.6% 99065771 / 111729640 / -11.3% 🟢 0.19 / 0.18 / +5.3%
fineweb_q08/datafusion:vortex-file-compressed 10197649 / 9231922 / +10.5% 🔴 40548025 / 44729078 / -9.3% 0.25 / 0.21 / +21.9%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9738764 / 9298051 / +4.7% 32679564 / 32161720 / +1.6% 0.30 / 0.29 / +3.1%
fineweb_q01/datafusion:parquet 75338784 / 75948676 / -0.8% 149413925 / 158050833 / -5.5% 0.50 / 0.48 / +4.9%
fineweb_q02/datafusion:parquet 76334260 / 74828561 / +2.0% 148588435 / 169180315 / -12.2% 🟢 0.51 / 0.44 / +16.1%
fineweb_q03/datafusion:parquet 75147843 / 75375235 / -0.3% 138907923 / 164650672 / -15.6% 🟢 0.54 / 0.46 / +18.2%
fineweb_q04/datafusion:parquet 82569190 / 82536988 / +0.0% 142063810 / 162124376 / -12.4% 🟢 0.58 / 0.51 / +14.2%
fineweb_q05/datafusion:parquet 80037668 / 80616398 / -0.7% 147884569 / 162946673 / -9.2% 0.54 / 0.49 / +9.4%
fineweb_q06/datafusion:parquet 74371732 / 74993748 / -0.8% 156917742 / 167327373 / -6.2% 0.47 / 0.45 / +5.7%
fineweb_q07/datafusion:parquet 74411096 / 74703466 / -0.4% 145631254 / 161875074 / -10.0% 🟢 0.51 / 0.46 / +10.7%
fineweb_q08/datafusion:parquet 73852298 / 73652338 / +0.3% 151291223 / 166993254 / -9.4% 0.49 / 0.44 / +10.7%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2024641 / 1992354 / +1.6% 7147938 / 7167288 / -0.3% 0.28 / 0.28 / +1.9%
fineweb_q01/duckdb:vortex-file-compressed 9297727 / 9302676 / -0.1% 33138027 / 33383961 / -0.7% 0.28 / 0.28 / +0.7%
fineweb_q02/duckdb:vortex-file-compressed 10748576 / 11086372 / -3.0% 32673122 / 32959285 / -0.9% 0.33 / 0.34 / -2.2%
fineweb_q03/duckdb:vortex-file-compressed 19748386 / 20108287 / -1.8% 90881529 / 93189312 / -2.5% 0.22 / 0.22 / +0.7%
fineweb_q04/duckdb:vortex-file-compressed 67505597 / 67281247 / +0.3% 105642055 / 109561330 / -3.6% 0.64 / 0.61 / +4.1%
fineweb_q05/duckdb:vortex-file-compressed 66357644 / 66431544 / -0.1% 104032293 / 106341165 / -2.2% 0.64 / 0.62 / +2.1%
fineweb_q06/duckdb:vortex-file-compressed 18840753 / 19036190 / -1.0% 92878902 / 93820093 / -1.0% 0.20 / 0.20 / -0.0%
fineweb_q07/duckdb:vortex-file-compressed 19298804 / 18786800 / +2.7% 85105858 / 90565938 / -6.0% 0.23 / 0.21 / +9.3%
fineweb_q08/duckdb:vortex-file-compressed 5390614 / 5376968 / +0.3% 13661555 / 13261327 / +3.0% 0.39 / 0.41 / -2.7%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23652488 / 23973552 / -1.3% 27897040 / 28107016 / -0.7% 0.85 / 0.85 / -0.6%
fineweb_q01/duckdb:parquet 54136001 / 56632112 / -4.4% 76737083 / 75490626 / +1.7% 0.71 / 0.75 / -6.0%
fineweb_q02/duckdb:parquet 60435926 / 61085010 / -1.1% 77540013 / 84868736 / -8.6% 0.78 / 0.72 / +8.3%
fineweb_q03/duckdb:parquet 119472854 / 119366500 / +0.1% 177028195 / 185364019 / -4.5% 0.67 / 0.64 / +4.8%
fineweb_q04/duckdb:parquet 166747258 / 161989686 / +2.9% 212235874 / 214789038 / -1.2% 0.79 / 0.75 / +4.2%
fineweb_q05/duckdb:parquet 158243620 / 160108938 / -1.2% 204829190 / 209160474 / -2.1% 0.77 / 0.77 / +0.9%
fineweb_q06/duckdb:parquet 90600700 / 87576319 / +3.5% 152528733 / 148207180 / +2.9% 0.59 / 0.59 / +0.5%
fineweb_q07/duckdb:parquet 94356832 / 92192530 / +2.3% 143171040 / 148218580 / -3.4% 0.66 / 0.62 / +6.0%
fineweb_q08/duckdb:parquet 29728988 / 30171232 / -1.5% 30770731 / 31697555 / -2.9% 0.97 / 0.95 / +1.5%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR b423d204 vs base 19dcd2f2
Vortex (geomean): hot 0.992x ➖ · cold 0.925x ➖


datafusion / vortex-file-compressed / ns (0.992x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44187266 / 44198107 / -0.0% 84689802 / 89439370 / -5.3% 0.52 / 0.49 / +5.6%
polarsignals_q01/datafusion:vortex-file-compressed 53308313 / 53423409 / -0.2% 110674009 / 135084640 / -18.1% 🟢 0.48 / 0.40 / +21.8%
polarsignals_q02/datafusion:vortex-file-compressed 14102889 / 11887196 / +18.6% 🔴 48339583 / 50980997 / -5.2% 0.29 / 0.23 / +25.1%
polarsignals_q03/datafusion:vortex-file-compressed 55082846 / 71391736 / -22.8% 🟢 113824161 / 117694461 / -3.3% 0.48 / 0.61 / -20.2%
polarsignals_q04/datafusion:vortex-file-compressed 9524581 / 9044253 / +5.3% 38026259 / 44519732 / -14.6% 🟢 0.25 / 0.20 / +23.3%
polarsignals_q05/datafusion:vortex-file-compressed 11522007 / 11570807 / -0.4% 42103418 / 46066653 / -8.6% 0.27 / 0.25 / +9.0%
polarsignals_q06/datafusion:vortex-file-compressed 23188278 / 23543970 / -1.5% 53073613 / 55935271 / -5.1% 0.44 / 0.42 / +3.8%
polarsignals_q07/datafusion:vortex-file-compressed 10874264 / 10790669 / +0.8% 41231999 / 43925484 / -6.1% 0.26 / 0.25 / +7.4%
polarsignals_q08/datafusion:vortex-file-compressed 98286882 / 104038217 / -5.5% 158048918 / 159248816 / -0.8% 0.62 / 0.65 / -4.8%
polarsignals_q09/datafusion:vortex-file-compressed 10078748 / 9853164 / +2.3% 37979077 / 40771950 / -6.8% 0.27 / 0.24 / +9.8%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR b423d204 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.008x ➖ · cold 0.996x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20802955 / 20662877 / +0.7% 38375806 / 38388298 / -0.0% 0.54 / 0.54 / +0.7%
tpcds_q02/datafusion:vortex-file-compressed 44635428 / 44071682 / +1.3% 65734567 / 64203849 / +2.4% 0.68 / 0.69 / -1.1%
tpcds_q03/datafusion:vortex-file-compressed 11284763 / 11095395 / +1.7% 27584539 / 26770394 / +3.0% 0.41 / 0.41 / -1.3%
tpcds_q04/datafusion:vortex-file-compressed 85922640 / 85937970 / -0.0% 120282577 / 120762373 / -0.4% 0.71 / 0.71 / +0.4%
tpcds_q05/datafusion:vortex-file-compressed 58387471 / 56220694 / +3.9% 77942453 / 76967535 / +1.3% 0.75 / 0.73 / +2.6%
tpcds_q06/datafusion:vortex-file-compressed 22450808 / 21976346 / +2.2% 42111326 / 43424391 / -3.0% 0.53 / 0.51 / +5.3%
tpcds_q07/datafusion:vortex-file-compressed 28636497 / 28753308 / -0.4% 50249867 / 51675554 / -2.8% 0.57 / 0.56 / +2.4%
tpcds_q08/datafusion:vortex-file-compressed 24533512 / 24541650 / -0.0% 43462812 / 43475451 / -0.0% 0.56 / 0.56 / -0.0%
tpcds_q09/datafusion:vortex-file-compressed 19292542 / 20105705 / -4.0% 37015793 / 37029178 / -0.0% 0.52 / 0.54 / -4.0%
tpcds_q10/datafusion:vortex-file-compressed 26618423 / 26771250 / -0.6% 48198175 / 50455373 / -4.5% 0.55 / 0.53 / +4.1%
tpcds_q11/datafusion:vortex-file-compressed 52805418 / 51942594 / +1.7% 80328967 / 83041366 / -3.3% 0.66 / 0.63 / +5.1%
tpcds_q12/datafusion:vortex-file-compressed 14685122 / 14909005 / -1.5% 31228390 / 32866199 / -5.0% 0.47 / 0.45 / +3.7%
tpcds_q13/datafusion:vortex-file-compressed 30927120 / 31125908 / -0.6% 55965213 / 56678644 / -1.3% 0.55 / 0.55 / +0.6%
tpcds_q14/datafusion:vortex-file-compressed 489113008 / 487173892 / +0.4% 549693245 / 549971662 / -0.1% 0.89 / 0.89 / +0.4%
tpcds_q15/datafusion:vortex-file-compressed 12372550 / 12454406 / -0.7% 32993144 / 33623513 / -1.9% 0.38 / 0.37 / +1.2%
tpcds_q16/datafusion:vortex-file-compressed 19001963 / 18526448 / +2.6% 37481430 / 38010837 / -1.4% 0.51 / 0.49 / +4.0%
tpcds_q17/datafusion:vortex-file-compressed 54732481 / 50769293 / +7.8% 75876810 / 75447269 / +0.6% 0.72 / 0.67 / +7.2%
tpcds_q18/datafusion:vortex-file-compressed 63733254 / 63588463 / +0.2% 85420342 / 85468521 / -0.1% 0.75 / 0.74 / +0.3%
tpcds_q19/datafusion:vortex-file-compressed 16651646 / 17047396 / -2.3% 38683475 / 38742283 / -0.2% 0.43 / 0.44 / -2.2%
tpcds_q20/datafusion:vortex-file-compressed 15907157 / 16464230 / -3.4% 37090851 / 35800079 / +3.6% 0.43 / 0.46 / -6.7%
tpcds_q21/datafusion:vortex-file-compressed 15500348 / 15940484 / -2.8% 38642438 / 37502958 / +3.0% 0.40 / 0.43 / -5.6%
tpcds_q22/datafusion:vortex-file-compressed 49298918 / 49830978 / -1.1% 72410233 / 73429530 / -1.4% 0.68 / 0.68 / +0.3%
tpcds_q23/datafusion:vortex-file-compressed 70282148 / 71127504 / -1.2% 95116651 / 95266102 / -0.2% 0.74 / 0.75 / -1.0%
tpcds_q24/datafusion:vortex-file-compressed 64820086 / 65827480 / -1.5% 85204489 / 87950060 / -3.1% 0.76 / 0.75 / +1.6%
tpcds_q25/datafusion:vortex-file-compressed 48473049 / 48552602 / -0.2% 65601465 / 69532625 / -5.7% 0.74 / 0.70 / +5.8%
tpcds_q26/datafusion:vortex-file-compressed 25714721 / 25883028 / -0.7% 46019983 / 45868290 / +0.3% 0.56 / 0.56 / -1.0%
tpcds_q27/datafusion:vortex-file-compressed 63067919 / 63281436 / -0.3% 79254654 / 80805852 / -1.9% 0.80 / 0.78 / +1.6%
tpcds_q28/datafusion:vortex-file-compressed 25337510 / 26229064 / -3.4% 41133277 / 40810592 / +0.8% 0.62 / 0.64 / -4.2%
tpcds_q29/datafusion:vortex-file-compressed 53612640 / 53880442 / -0.5% 75513491 / 75632558 / -0.2% 0.71 / 0.71 / -0.3%
tpcds_q30/datafusion:vortex-file-compressed 26589286 / 25882580 / +2.7% 43899485 / 45306891 / -3.1% 0.61 / 0.57 / +6.0%
tpcds_q31/datafusion:vortex-file-compressed 58221236 / 58167868 / +0.1% 83001808 / 83805563 / -1.0% 0.70 / 0.69 / +1.1%
tpcds_q32/datafusion:vortex-file-compressed 12416658 / 12486154 / -0.6% 29374345 / 29878584 / -1.7% 0.42 / 0.42 / +1.2%
tpcds_q33/datafusion:vortex-file-compressed 27607010 / 27470150 / +0.5% 47460903 / 50803280 / -6.6% 0.58 / 0.54 / +7.6%
tpcds_q34/datafusion:vortex-file-compressed 17388478 / 17355034 / +0.2% 35136019 / 37376510 / -6.0% 0.49 / 0.46 / +6.6%
tpcds_q35/datafusion:vortex-file-compressed 29962358 / 30165718 / -0.7% 53008249 / 54544146 / -2.8% 0.57 / 0.55 / +2.2%
tpcds_q36/datafusion:vortex-file-compressed 47614066 / 48307158 / -1.4% 68455377 / 67264121 / +1.8% 0.70 / 0.72 / -3.1%
tpcds_q37/datafusion:vortex-file-compressed 11911689 / 11857472 / +0.5% 32935321 / 34111657 / -3.4% 0.36 / 0.35 / +4.0%
tpcds_q38/datafusion:vortex-file-compressed 25429107 / 25514558 / -0.3% 46369351 / 48241747 / -3.9% 0.55 / 0.53 / +3.7%
tpcds_q39/datafusion:vortex-file-compressed 64372914 / 64890302 / -0.8% 89078432 / 89633580 / -0.6% 0.72 / 0.72 / -0.2%
tpcds_q40/datafusion:vortex-file-compressed 22998602 / 23494010 / -2.1% 44315894 / 43948484 / +0.8% 0.52 / 0.53 / -2.9%
tpcds_q41/datafusion:vortex-file-compressed 20539796 / 20495924 / +0.2% 34176732 / 32839414 / +4.1% 0.60 / 0.62 / -3.7%
tpcds_q42/datafusion:vortex-file-compressed 10790046 / 10944217 / -1.4% 26995043 / 26800473 / +0.7% 0.40 / 0.41 / -2.1%
tpcds_q43/datafusion:vortex-file-compressed 12263152 / 12235502 / +0.2% 32542132 / 32362966 / +0.6% 0.38 / 0.38 / -0.3%
tpcds_q44/datafusion:vortex-file-compressed 29075244 / 28950501 / +0.4% 50159483 / 53633308 / -6.5% 0.58 / 0.54 / +7.4%
tpcds_q45/datafusion:vortex-file-compressed 15958904 / 16086212 / -0.8% 34037857 / 36240197 / -6.1% 0.47 / 0.44 / +5.6%
tpcds_q46/datafusion:vortex-file-compressed 23295148 / 23330782 / -0.2% 48399498 / 46023788 / +5.2% 0.48 / 0.51 / -5.1%
tpcds_q47/datafusion:vortex-file-compressed 75188580 / 74638130 / +0.7% 105382145 / 104471851 / +0.9% 0.71 / 0.71 / -0.1%
tpcds_q48/datafusion:vortex-file-compressed 28282382 / 28355408 / -0.3% 48722774 / 52242427 / -6.7% 0.58 / 0.54 / +6.9%
tpcds_q49/datafusion:vortex-file-compressed 57977170 / 57975552 / +0.0% 80486430 / 80249136 / +0.3% 0.72 / 0.72 / -0.3%
tpcds_q50/datafusion:vortex-file-compressed 30888382 / 30773469 / +0.4% 50870720 / 53329113 / -4.6% 0.61 / 0.58 / +5.2%
tpcds_q51/datafusion:vortex-file-compressed 66240798 / 66370124 / -0.2% 87355160 / 87949849 / -0.7% 0.76 / 0.75 / +0.5%
tpcds_q52/datafusion:vortex-file-compressed 11295502 / 11303700 / -0.1% 26659005 / 28114971 / -5.2% 0.42 / 0.40 / +5.4%
tpcds_q53/datafusion:vortex-file-compressed 17829424 / 17817615 / +0.1% 38703214 / 39106120 / -1.0% 0.46 / 0.46 / +1.1%
tpcds_q54/datafusion:vortex-file-compressed 30907258 / 30815867 / +0.3% 52573724 / 53633024 / -2.0% 0.59 / 0.57 / +2.3%
tpcds_q55/datafusion:vortex-file-compressed 10837320 / 10947926 / -1.0% 25878882 / 26268641 / -1.5% 0.42 / 0.42 / +0.5%
tpcds_q56/datafusion:vortex-file-compressed 26097171 / 25893575 / +0.8% 46898618 / 48418478 / -3.1% 0.56 / 0.53 / +4.1%
tpcds_q57/datafusion:vortex-file-compressed 61845468 / 61658540 / +0.3% 87223771 / 88488887 / -1.4% 0.71 / 0.70 / +1.8%
tpcds_q58/datafusion:vortex-file-compressed 38549830 / 38139050 / +1.1% 62009776 / 62952715 / -1.5% 0.62 / 0.61 / +2.6%
tpcds_q59/datafusion:vortex-file-compressed 30048180 / 29773657 / +0.9% 53886106 / 54576681 / -1.3% 0.56 / 0.55 / +2.2%
tpcds_q60/datafusion:vortex-file-compressed 26505579 / 25763284 / +2.9% 47781770 / 47311516 / +1.0% 0.55 / 0.54 / +1.9%
tpcds_q61/datafusion:vortex-file-compressed 21062036 / 21212998 / -0.7% 43308331 / 43808218 / -1.1% 0.49 / 0.48 / +0.4%
tpcds_q62/datafusion:vortex-file-compressed 16165552 / 16226768 / -0.4% 34684918 / 34675741 / +0.0% 0.47 / 0.47 / -0.4%
tpcds_q63/datafusion:vortex-file-compressed 17667540 / 17479711 / +1.1% 37644910 / 38987535 / -3.4% 0.47 / 0.45 / +4.7%
tpcds_q64/datafusion:vortex-file-compressed 212277284 / 212632786 / -0.2% 247480914 / 245822306 / +0.7% 0.86 / 0.86 / -0.8%
tpcds_q65/datafusion:vortex-file-compressed 71988753 / 72326343 / -0.5% 93299500 / 92518043 / +0.8% 0.77 / 0.78 / -1.3%
tpcds_q66/datafusion:vortex-file-compressed 50868736 / 50841554 / +0.1% 74368303 / 72759471 / +2.2% 0.68 / 0.70 / -2.1%
tpcds_q67/datafusion:vortex-file-compressed 50562548 / 51321318 / -1.5% 82527026 / 84264967 / -2.1% 0.61 / 0.61 / +0.6%
tpcds_q68/datafusion:vortex-file-compressed 22916024 / 22754568 / +0.7% 45643532 / 46535563 / -1.9% 0.50 / 0.49 / +2.7%
tpcds_q69/datafusion:vortex-file-compressed 25377526 / 25748720 / -1.4% 46857542 / 47728418 / -1.8% 0.54 / 0.54 / +0.4%
tpcds_q70/datafusion:vortex-file-compressed 69965638 / 70768666 / -1.1% 94184541 / 94483406 / -0.3% 0.74 / 0.75 / -0.8%
tpcds_q71/datafusion:vortex-file-compressed 18693700 / 19265814 / -3.0% 38442586 / 40165351 / -4.3% 0.49 / 0.48 / +1.4%
tpcds_q72/datafusion:vortex-file-compressed 363498896 / 346150522 / +5.0% 395282831 / 397297658 / -0.5% 0.92 / 0.87 / +5.5%
tpcds_q73/datafusion:vortex-file-compressed 16202710 / 15934651 / +1.7% 35084094 / 35011866 / +0.2% 0.46 / 0.46 / +1.5%
tpcds_q74/datafusion:vortex-file-compressed 40680687 / 39780041 / +2.3% 65772968 / 66803203 / -1.5% 0.62 / 0.60 / +3.9%
tpcds_q75/datafusion:vortex-file-compressed 135824734 / 135714753 / +0.1% 166444916 / 162660370 / +2.3% 0.82 / 0.83 / -2.2%
tpcds_q76/datafusion:vortex-file-compressed 29258419 / 29291308 / -0.1% 45521018 / 47924547 / -5.0% 0.64 / 0.61 / +5.2%
tpcds_q77/datafusion:vortex-file-compressed 45167290 / 44660360 / +1.1% 66909907 / 65734489 / +1.8% 0.68 / 0.68 / -0.6%
tpcds_q78/datafusion:vortex-file-compressed 63568192 / 63632236 / -0.1% 91001494 / 94010583 / -3.2% 0.70 / 0.68 / +3.2%
tpcds_q79/datafusion:vortex-file-compressed 19784592 / 19924334 / -0.7% 42486144 / 42878743 / -0.9% 0.47 / 0.46 / +0.2%
tpcds_q80/datafusion:vortex-file-compressed 72875316 / 72991048 / -0.2% 102477113 / 100489903 / +2.0% 0.71 / 0.73 / -2.1%
tpcds_q81/datafusion:vortex-file-compressed 26267410 / 26190294 / +0.3% 42211427 / 44415165 / -5.0% 0.62 / 0.59 / +5.5%
tpcds_q82/datafusion:vortex-file-compressed 12367246 / 12373004 / -0.0% 33407362 / 33916690 / -1.5% 0.37 / 0.36 / +1.5%
tpcds_q83/datafusion:vortex-file-compressed 33421696 / 32776157 / +2.0% 52223197 / 50511779 / +3.4% 0.64 / 0.65 / -1.4%
tpcds_q84/datafusion:vortex-file-compressed 10298958 / 10014122 / +2.8% 26626112 / 26553087 / +0.3% 0.39 / 0.38 / +2.6%
tpcds_q85/datafusion:vortex-file-compressed 53027026 / 53044578 / -0.0% 77528454 / 80954298 / -4.2% 0.68 / 0.66 / +4.4%
tpcds_q86/datafusion:vortex-file-compressed 15852260 / 15658548 / +1.2% 33379720 / 32311558 / +3.3% 0.47 / 0.48 / -2.0%
tpcds_q87/datafusion:vortex-file-compressed 25211460 / 25551026 / -1.3% 47420934 / 46861588 / +1.2% 0.53 / 0.55 / -2.5%
tpcds_q88/datafusion:vortex-file-compressed 31709818 / 31550716 / +0.5% 51005502 / 54227953 / -5.9% 0.62 / 0.58 / +6.9%
tpcds_q89/datafusion:vortex-file-compressed 21363466 / 21217704 / +0.7% 43382095 / 40149772 / +8.1% 0.49 / 0.53 / -6.8%
tpcds_q90/datafusion:vortex-file-compressed 9869836 / 9912202 / -0.4% 24525004 / 24923081 / -1.6% 0.40 / 0.40 / +1.2%
tpcds_q91/datafusion:vortex-file-compressed 16501452 / 16331088 / +1.0% 37150105 / 36210118 / +2.6% 0.44 / 0.45 / -1.5%
tpcds_q92/datafusion:vortex-file-compressed 12916224 / 12712254 / +1.6% 27991028 / 29043054 / -3.6% 0.46 / 0.44 / +5.4%
tpcds_q93/datafusion:vortex-file-compressed 20353437 / 20005716 / +1.7% 42141214 / 40530909 / +4.0% 0.48 / 0.49 / -2.1%
tpcds_q94/datafusion:vortex-file-compressed 18489942 / 18455416 / +0.2% 37010325 / 37274216 / -0.7% 0.50 / 0.50 / +0.9%
tpcds_q95/datafusion:vortex-file-compressed 42058156 / 42223247 / -0.4% 62090743 / 61088035 / +1.6% 0.68 / 0.69 / -2.0%
tpcds_q96/datafusion:vortex-file-compressed 7503128 / 7643602 / -1.8% 25293455 / 24204839 / +4.5% 0.30 / 0.32 / -6.1%
tpcds_q97/datafusion:vortex-file-compressed 16934846 / 17142063 / -1.2% 37182528 / 36143924 / +2.9% 0.46 / 0.47 / -4.0%
tpcds_q98/datafusion:vortex-file-compressed 16235867 / 16025235 / +1.3% 36197314 / 36067472 / +0.4% 0.45 / 0.44 / +1.0%
tpcds_q99/datafusion:vortex-file-compressed 15932280 / 15816152 / +0.7% 34923507 / 35033983 / -0.3% 0.46 / 0.45 / +1.1%
datafusion / parquet / ns (1.005x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43273632 / 41037398 / +5.4% 62194613 / 60468031 / +2.9% 0.70 / 0.68 / +2.5%
tpcds_q02/datafusion:parquet 56371587 / 55294162 / +1.9% 71362856 / 72584598 / -1.7% 0.79 / 0.76 / +3.7%
tpcds_q03/datafusion:parquet 19172852 / 19145511 / +0.1% 29832324 / 31737576 / -6.0% 0.64 / 0.60 / +6.5%
tpcds_q04/datafusion:parquet 181290502 / 179148961 / +1.2% 201787917 / 207193262 / -2.6% 0.90 / 0.86 / +3.9%
tpcds_q05/datafusion:parquet 68723134 / 67866314 / +1.3% 89032530 / 93269797 / -4.5% 0.77 / 0.73 / +6.1%
tpcds_q06/datafusion:parquet 32671980 / 34548628 / -5.4% 48084204 / 48650311 / -1.2% 0.68 / 0.71 / -4.3%
tpcds_q07/datafusion:parquet 47076232 / 47252786 / -0.4% 66752454 / 68512135 / -2.6% 0.71 / 0.69 / +2.3%
tpcds_q08/datafusion:parquet 31602542 / 31369000 / +0.7% 46121719 / 45820766 / +0.7% 0.69 / 0.68 / +0.1%
tpcds_q09/datafusion:parquet 30446325 / 34307494 / -11.3% 🟢 43183230 / 43105925 / +0.2% 0.71 / 0.80 / -11.4%
tpcds_q10/datafusion:parquet 44923472 / 44551387 / +0.8% 60016889 / 60617616 / -1.0% 0.75 / 0.73 / +1.8%
tpcds_q11/datafusion:parquet 98499698 / 98283752 / +0.2% 121922811 / 121127398 / +0.7% 0.81 / 0.81 / -0.4%
tpcds_q12/datafusion:parquet 23961598 / 24266474 / -1.3% 35228796 / 36327580 / -3.0% 0.68 / 0.67 / +1.8%
tpcds_q13/datafusion:parquet 47662128 / 46580310 / +2.3% 66918403 / 67994465 / -1.6% 0.71 / 0.69 / +4.0%
tpcds_q14/datafusion:parquet 539877558 / 535803457 / +0.8% 584233076 / 576399589 / +1.4% 0.92 / 0.93 / -0.6%
tpcds_q15/datafusion:parquet 23792375 / 23987052 / -0.8% 37455088 / 38772857 / -3.4% 0.64 / 0.62 / +2.7%
tpcds_q16/datafusion:parquet 37280336 / 37385275 / -0.3% 51129829 / 50808144 / +0.6% 0.73 / 0.74 / -0.9%
tpcds_q17/datafusion:parquet 73909197 / 74179220 / -0.4% 99380050 / 99947249 / -0.6% 0.74 / 0.74 / +0.2%
tpcds_q18/datafusion:parquet 66139006 / 68176314 / -3.0% 90717276 / 90601495 / +0.1% 0.73 / 0.75 / -3.1%
tpcds_q19/datafusion:parquet 29954105 / 29979450 / -0.1% 43626332 / 42461266 / +2.7% 0.69 / 0.71 / -2.8%
tpcds_q20/datafusion:parquet 25730944 / 25299084 / +1.7% 35414649 / 38763993 / -8.6% 0.73 / 0.65 / +11.3%
tpcds_q21/datafusion:parquet 20604554 / 20143853 / +2.3% 32973426 / 32533897 / +1.4% 0.62 / 0.62 / +0.9%
tpcds_q22/datafusion:parquet 77737194 / 77992354 / -0.3% 89170910 / 88630266 / +0.6% 0.87 / 0.88 / -0.9%
tpcds_q23/datafusion:parquet 93808787 / 92070006 / +1.9% 114917683 / 115685844 / -0.7% 0.82 / 0.80 / +2.6%
tpcds_q24/datafusion:parquet 90954528 / 91320906 / -0.4% 113158914 / 114776797 / -1.4% 0.80 / 0.80 / +1.0%
tpcds_q25/datafusion:parquet 81090317 / 80147062 / +1.2% 94354583 / 100467329 / -6.1% 0.86 / 0.80 / +7.7%
tpcds_q26/datafusion:parquet 43377987 / 43368406 / +0.0% 59837671 / 62993503 / -5.0% 0.72 / 0.69 / +5.3%
tpcds_q27/datafusion:parquet 75699834 / 77766271 / -2.7% 97028031 / 95385028 / +1.7% 0.78 / 0.82 / -4.3%
tpcds_q28/datafusion:parquet 28093996 / 28898218 / -2.8% 42365134 / 41658255 / +1.7% 0.66 / 0.69 / -4.4%
tpcds_q29/datafusion:parquet 74830899 / 74946869 / -0.2% 97608291 / 95881548 / +1.8% 0.77 / 0.78 / -1.9%
tpcds_q30/datafusion:parquet 45102107 / 43893362 / +2.8% 60176636 / 59749504 / +0.7% 0.75 / 0.73 / +2.0%
tpcds_q31/datafusion:parquet 82148756 / 81440329 / +0.9% 98126916 / 100055168 / -1.9% 0.84 / 0.81 / +2.9%
tpcds_q32/datafusion:parquet 26246294 / 27143890 / -3.3% 40026513 / 40303899 / -0.7% 0.66 / 0.67 / -2.6%
tpcds_q33/datafusion:parquet 38177176 / 37398043 / +2.1% 53698782 / 54795235 / -2.0% 0.71 / 0.68 / +4.2%
tpcds_q34/datafusion:parquet 24984340 / 24635061 / +1.4% 35970656 / 36342546 / -1.0% 0.69 / 0.68 / +2.5%
tpcds_q35/datafusion:parquet 50746394 / 50802148 / -0.1% 64360919 / 64573709 / -0.3% 0.79 / 0.79 / +0.2%
tpcds_q36/datafusion:parquet 52069604 / 52685074 / -1.2% 69383579 / 74511270 / -6.9% 0.75 / 0.71 / +6.1%
tpcds_q37/datafusion:parquet 21397615 / 21130209 / +1.3% 34945774 / 32955418 / +6.0% 0.61 / 0.64 / -4.5%
tpcds_q38/datafusion:parquet 45709660 / 45074440 / +1.4% 60192548 / 61169495 / -1.6% 0.76 / 0.74 / +3.1%
tpcds_q39/datafusion:parquet 68679629 / 67143299 / +2.3% 85422170 / 87798285 / -2.7% 0.80 / 0.76 / +5.1%
tpcds_q40/datafusion:parquet 30841226 / 31732224 / -2.8% 50702884 / 51366919 / -1.3% 0.61 / 0.62 / -1.5%
tpcds_q41/datafusion:parquet 20162503 / 19560677 / +3.1% 32263705 / 30927269 / +4.3% 0.62 / 0.63 / -1.2%
tpcds_q42/datafusion:parquet 18525508 / 18303020 / +1.2% 31539244 / 30195041 / +4.5% 0.59 / 0.61 / -3.1%
tpcds_q43/datafusion:parquet 19469324 / 19552828 / -0.4% 32425282 / 32452403 / -0.1% 0.60 / 0.60 / -0.3%
tpcds_q44/datafusion:parquet 35402890 / 35238887 / +0.5% 50016219 / 50018816 / -0.0% 0.71 / 0.70 / +0.5%
tpcds_q45/datafusion:parquet 26937610 / 27571686 / -2.3% 38904352 / 42507478 / -8.5% 0.69 / 0.65 / +6.7%
tpcds_q46/datafusion:parquet 29182912 / 29861832 / -2.3% 45656811 / 46926615 / -2.7% 0.64 / 0.64 / +0.4%
tpcds_q47/datafusion:parquet 98335532 / 98146604 / +0.2% 120372213 / 122067336 / -1.4% 0.82 / 0.80 / +1.6%
tpcds_q48/datafusion:parquet 41822744 / 42447005 / -1.5% 57887423 / 59145720 / -2.1% 0.72 / 0.72 / +0.7%
tpcds_q49/datafusion:parquet 70897958 / 72220930 / -1.8% 93143973 / 96046791 / -3.0% 0.76 / 0.75 / +1.2%
tpcds_q50/datafusion:parquet 48475974 / 47512774 / +2.0% 67260726 / 71800733 / -6.3% 0.72 / 0.66 / +8.9%
tpcds_q51/datafusion:parquet 75477235 / 75603896 / -0.2% 95422556 / 96356391 / -1.0% 0.79 / 0.78 / +0.8%
tpcds_q52/datafusion:parquet 18881975 / 18667056 / +1.2% 32349468 / 29454574 / +9.8% 0.58 / 0.63 / -7.9%
tpcds_q53/datafusion:parquet 23422846 / 23176485 / +1.1% 38241542 / 39182736 / -2.4% 0.61 / 0.59 / +3.6%
tpcds_q54/datafusion:parquet 52086516 / 51885012 / +0.4% 68806949 / 69416818 / -0.9% 0.76 / 0.75 / +1.3%
tpcds_q55/datafusion:parquet 18398997 / 18301546 / +0.5% 29517863 / 31877199 / -7.4% 0.62 / 0.57 / +8.6%
tpcds_q56/datafusion:parquet 41034240 / 39632970 / +3.5% 57499637 / 55628203 / +3.4% 0.71 / 0.71 / +0.2%
tpcds_q57/datafusion:parquet 102116826 / 100454820 / +1.7% 114478174 / 121808907 / -6.0% 0.89 / 0.82 / +8.2%
tpcds_q58/datafusion:parquet 64945576 / 65082382 / -0.2% 83920450 / 84884800 / -1.1% 0.77 / 0.77 / +0.9%
tpcds_q59/datafusion:parquet 48807412 / 47924398 / +1.8% 66634525 / 68304504 / -2.4% 0.73 / 0.70 / +4.4%
tpcds_q60/datafusion:parquet 41030936 / 42313918 / -3.0% 54717650 / 60333944 / -9.3% 0.75 / 0.70 / +6.9%
tpcds_q61/datafusion:parquet 37100206 / 36404834 / +1.9% 54281628 / 50470158 / +7.6% 0.68 / 0.72 / -5.2%
tpcds_q62/datafusion:parquet 25609564 / 25240186 / +1.5% 38528207 / 37930554 / +1.6% 0.66 / 0.67 / -0.1%
tpcds_q63/datafusion:parquet 22338072 / 22274464 / +0.3% 39559564 / 40137287 / -1.4% 0.56 / 0.55 / +1.8%
tpcds_q64/datafusion:parquet 289221603 / 291825881 / -0.9% 324204020 / 326894100 / -0.8% 0.89 / 0.89 / -0.1%
tpcds_q65/datafusion:parquet 121641056 / 121713454 / -0.1% 139471383 / 142669978 / -2.2% 0.87 / 0.85 / +2.2%
tpcds_q66/datafusion:parquet 60973020 / 59440828 / +2.6% 78407432 / 75640564 / +3.7% 0.78 / 0.79 / -1.0%
tpcds_q67/datafusion:parquet 69181576 / 68348957 / +1.2% 93920780 / 93585303 / +0.4% 0.74 / 0.73 / +0.9%
tpcds_q68/datafusion:parquet 30004064 / 29525206 / +1.6% 49613838 / 49365427 / +0.5% 0.60 / 0.60 / +1.1%
tpcds_q69/datafusion:parquet 44650542 / 42326063 / +5.5% 57126625 / 56487138 / +1.1% 0.78 / 0.75 / +4.3%
tpcds_q70/datafusion:parquet 81673908 / 80186448 / +1.9% 98419802 / 98784851 / -0.4% 0.83 / 0.81 / +2.2%
tpcds_q71/datafusion:parquet 26217708 / 26321141 / -0.4% 38108014 / 36794416 / +3.6% 0.69 / 0.72 / -3.8%
tpcds_q72/datafusion:parquet 522151668 / 524180635 / -0.4% 548937826 / 558063742 / -1.6% 0.95 / 0.94 / +1.3%
tpcds_q73/datafusion:parquet 24051394 / 24084504 / -0.1% 36260987 / 36840445 / -1.6% 0.66 / 0.65 / +1.5%
tpcds_q74/datafusion:parquet 71664938 / 70174123 / +2.1% 89337671 / 90258255 / -1.0% 0.80 / 0.78 / +3.2%
tpcds_q75/datafusion:parquet 154935594 / 156896393 / -1.2% 180454905 / 184038891 / -1.9% 0.86 / 0.85 / +0.7%
tpcds_q76/datafusion:parquet 33652224 / 34224952 / -1.7% 47878111 / 50692625 / -5.6% 0.70 / 0.68 / +4.1%
tpcds_q77/datafusion:parquet 56647352 / 58233668 / -2.7% 74665732 / 76077433 / -1.9% 0.76 / 0.77 / -0.9%
tpcds_q78/datafusion:parquet 87634878 / 85428305 / +2.6% 116272194 / 118447829 / -1.8% 0.75 / 0.72 / +4.5%
tpcds_q79/datafusion:parquet 27636490 / 27134527 / +1.8% 42773231 / 42881579 / -0.3% 0.65 / 0.63 / +2.1%
tpcds_q80/datafusion:parquet 81587646 / 80657915 / +1.2% 109240211 / 110802292 / -1.4% 0.75 / 0.73 / +2.6%
tpcds_q81/datafusion:parquet 38979988 / 37777232 / +3.2% 50101393 / 53177596 / -5.8% 0.78 / 0.71 / +9.5%
tpcds_q82/datafusion:parquet 22679032 / 21830275 / +3.9% 36686355 / 35544461 / +3.2% 0.62 / 0.61 / +0.7%
tpcds_q83/datafusion:parquet 58352010 / 58296937 / +0.1% 71245850 / 74616736 / -4.5% 0.82 / 0.78 / +4.8%
tpcds_q84/datafusion:parquet 27303107 / 26330226 / +3.7% 40455236 / 42384381 / -4.6% 0.67 / 0.62 / +8.6%
tpcds_q85/datafusion:parquet 81623140 / 81149270 / +0.6% 104598934 / 105837872 / -1.2% 0.78 / 0.77 / +1.8%
tpcds_q86/datafusion:parquet 21185306 / 21226134 / -0.2% 34072245 / 33972858 / +0.3% 0.62 / 0.62 / -0.5%
tpcds_q87/datafusion:parquet 45846637 / 43655820 / +5.0% 62205935 / 61819470 / +0.6% 0.74 / 0.71 / +4.4%
tpcds_q88/datafusion:parquet 37182664 / 37317510 / -0.4% 49738007 / 52037306 / -4.4% 0.75 / 0.72 / +4.2%
tpcds_q89/datafusion:parquet 26155507 / 25620515 / +2.1% 43145556 / 43168659 / -0.1% 0.61 / 0.59 / +2.1%
tpcds_q90/datafusion:parquet 15483572 / 14700265 / +5.3% 28724276 / 26744264 / +7.4% 0.54 / 0.55 / -1.9%
tpcds_q91/datafusion:parquet 32327408 / 32536375 / -0.6% 46960782 / 46834523 / +0.3% 0.69 / 0.69 / -0.9%
tpcds_q92/datafusion:parquet 27382713 / 26925968 / +1.7% 41421578 / 41562779 / -0.3% 0.66 / 0.65 / +2.0%
tpcds_q93/datafusion:parquet 27605178 / 27737618 / -0.5% 47676739 / 47560036 / +0.2% 0.58 / 0.58 / -0.7%
tpcds_q94/datafusion:parquet 36083664 / 34987990 / +3.1% 49825261 / 49838089 / -0.0% 0.72 / 0.70 / +3.2%
tpcds_q95/datafusion:parquet 65055033 / 63986628 / +1.7% 78034463 / 82628090 / -5.6% 0.83 / 0.77 / +7.7%
tpcds_q96/datafusion:parquet 12877199 / 12515555 / +2.9% 24809236 / 24364474 / +1.8% 0.52 / 0.51 / +1.0%
tpcds_q97/datafusion:parquet 35933606 / 35645164 / +0.8% 52151394 / 49168462 / +6.1% 0.69 / 0.72 / -5.0%
tpcds_q98/datafusion:parquet 24992978 / 24769713 / +0.9% 37497889 / 39883907 / -6.0% 0.67 / 0.62 / +7.3%
tpcds_q99/datafusion:parquet 29503212 / 29456394 / +0.2% 42819254 / 42511842 / +0.7% 0.69 / 0.69 / -0.6%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16610516 / 16444475 / +1.0% 25373275 / 25468340 / -0.4% 0.65 / 0.65 / +1.4%
tpcds_q02/duckdb:vortex-file-compressed 17232428 / 16460483 / +4.7% 23890301 / 23822245 / +0.3% 0.72 / 0.69 / +4.4%
tpcds_q03/duckdb:vortex-file-compressed 7258954 / 7076496 / +2.6% 15441712 / 16811089 / -8.1% 0.47 / 0.42 / +11.7%
tpcds_q04/duckdb:vortex-file-compressed 45647100 / 45671773 / -0.1% 56623480 / 56795457 / -0.3% 0.81 / 0.80 / +0.2%
tpcds_q05/duckdb:vortex-file-compressed 23808850 / 23444196 / +1.6% 33546690 / 33922893 / -1.1% 0.71 / 0.69 / +2.7%
tpcds_q06/duckdb:vortex-file-compressed 24607485 / 24544822 / +0.3% 38725005 / 39101350 / -1.0% 0.64 / 0.63 / +1.2%
tpcds_q07/duckdb:vortex-file-compressed 13735998 / 13574572 / +1.2% 23780526 / 23853354 / -0.3% 0.58 / 0.57 / +1.5%
tpcds_q08/duckdb:vortex-file-compressed 17696840 / 17694292 / +0.0% 26863954 / 27427836 / -2.1% 0.66 / 0.65 / +2.1%
tpcds_q09/duckdb:vortex-file-compressed 19601772 / 19230780 / +1.9% 30049919 / 29232867 / +2.8% 0.65 / 0.66 / -0.8%
tpcds_q10/duckdb:vortex-file-compressed 28165456 / 28127254 / +0.1% 41938226 / 41633782 / +0.7% 0.67 / 0.68 / -0.6%
tpcds_q11/duckdb:vortex-file-compressed 37070710 / 36907482 / +0.4% 45522023 / 45373610 / +0.3% 0.81 / 0.81 / +0.1%
tpcds_q12/duckdb:vortex-file-compressed 10345652 / 10175710 / +1.7% 17084071 / 17230057 / -0.8% 0.61 / 0.59 / +2.5%
tpcds_q13/duckdb:vortex-file-compressed 20957796 / 21038962 / -0.4% 32564736 / 34714581 / -6.2% 0.64 / 0.61 / +6.2%
tpcds_q14/duckdb:vortex-file-compressed 56302516 / 57724936 / -2.5% 67984751 / 68632960 / -0.9% 0.83 / 0.84 / -1.5%
tpcds_q15/duckdb:vortex-file-compressed 11518074 / 11248794 / +2.4% 17606294 / 18537256 / -5.0% 0.65 / 0.61 / +7.8%
tpcds_q16/duckdb:vortex-file-compressed 24594152 / 24567762 / +0.1% 35191018 / 35296980 / -0.3% 0.70 / 0.70 / +0.4%
tpcds_q17/duckdb:vortex-file-compressed 24901866 / 24773062 / +0.5% 36378561 / 36689010 / -0.8% 0.68 / 0.68 / +1.4%
tpcds_q18/duckdb:vortex-file-compressed 32225549 / 31704231 / +1.6% 42032010 / 41795055 / +0.6% 0.77 / 0.76 / +1.1%
tpcds_q19/duckdb:vortex-file-compressed 78933904 / 78453346 / +0.6% 88805377 / 88861136 / -0.1% 0.89 / 0.88 / +0.7%
tpcds_q20/duckdb:vortex-file-compressed 11060912 / 11302434 / -2.1% 17966273 / 17921560 / +0.2% 0.62 / 0.63 / -2.4%
tpcds_q21/duckdb:vortex-file-compressed 9694033 / 9613981 / +0.8% 21081252 / 21618546 / -2.5% 0.46 / 0.44 / +3.4%
tpcds_q22/duckdb:vortex-file-compressed 17660468 / 17475264 / +1.1% 28460775 / 29801515 / -4.5% 0.62 / 0.59 / +5.8%
tpcds_q23/duckdb:vortex-file-compressed 38638555 / 38469427 / +0.4% 50065135 / 50493626 / -0.8% 0.77 / 0.76 / +1.3%
tpcds_q24/duckdb:vortex-file-compressed 26744358 / 27034658 / -1.1% 36837920 / 38258066 / -3.7% 0.73 / 0.71 / +2.7%
tpcds_q25/duckdb:vortex-file-compressed 23845124 / 23233486 / +2.6% 34251887 / 35619880 / -3.8% 0.70 / 0.65 / +6.7%
tpcds_q26/duckdb:vortex-file-compressed 13092086 / 13489824 / -2.9% 21126601 / 21359876 / -1.1% 0.62 / 0.63 / -1.9%
tpcds_q27/duckdb:vortex-file-compressed 16183623 / 16130987 / +0.3% 27004168 / 27091120 / -0.3% 0.60 / 0.60 / +0.6%
tpcds_q28/duckdb:vortex-file-compressed 15436868 / 15571143 / -0.9% 26315432 / 26383560 / -0.3% 0.59 / 0.59 / -0.6%
tpcds_q29/duckdb:vortex-file-compressed 23011005 / 23097506 / -0.4% 33777503 / 35788503 / -5.6% 0.68 / 0.65 / +5.6%
tpcds_q30/duckdb:vortex-file-compressed 16375156 / 16286234 / +0.5% 25231467 / 24987373 / +1.0% 0.65 / 0.65 / -0.4%
tpcds_q31/duckdb:vortex-file-compressed 18115680 / 18038853 / +0.4% 25830715 / 26835741 / -3.7% 0.70 / 0.67 / +4.3%
tpcds_q32/duckdb:vortex-file-compressed 11994810 / 12118126 / -1.0% 21959110 / 21035329 / +4.4% 0.55 / 0.58 / -5.2%
tpcds_q33/duckdb:vortex-file-compressed 19384545 / 19145275 / +1.2% 28766457 / 28982771 / -0.7% 0.67 / 0.66 / +2.0%
tpcds_q34/duckdb:vortex-file-compressed 13045565 / 13291362 / -1.8% 22857474 / 23346380 / -2.1% 0.57 / 0.57 / +0.3%
tpcds_q35/duckdb:vortex-file-compressed 29396034 / 29057151 / +1.2% 40358828 / 41060035 / -1.7% 0.73 / 0.71 / +2.9%
tpcds_q36/duckdb:vortex-file-compressed 14999309 / 14673114 / +2.2% 26932147 / 25300723 / +6.4% 0.56 / 0.58 / -4.0%
tpcds_q37/duckdb:vortex-file-compressed 9609064 / 9811254 / -2.1% 24356960 / 24475303 / -0.5% 0.39 / 0.40 / -1.6%
tpcds_q38/duckdb:vortex-file-compressed 24700370 / 24605265 / +0.4% 33216734 / 32323829 / +2.8% 0.74 / 0.76 / -2.3%
tpcds_q39/duckdb:vortex-file-compressed 19020364 / 18754580 / +1.4% 31253232 / 31312343 / -0.2% 0.61 / 0.60 / +1.6%
tpcds_q40/duckdb:vortex-file-compressed 14389880 / 14358350 / +0.2% 21590782 / 21137017 / +2.1% 0.67 / 0.68 / -1.9%
tpcds_q41/duckdb:vortex-file-compressed 19213932 / 19083947 / +0.7% 26405089 / 26661569 / -1.0% 0.73 / 0.72 / +1.7%
tpcds_q42/duckdb:vortex-file-compressed 7281924 / 7055646 / +3.2% 15826906 / 15785619 / +0.3% 0.46 / 0.45 / +2.9%
tpcds_q43/duckdb:vortex-file-compressed 10149539 / 10468877 / -3.1% 19624866 / 20047716 / -2.1% 0.52 / 0.52 / -1.0%
tpcds_q44/duckdb:vortex-file-compressed 12733056 / 12765054 / -0.3% 24448388 / 24035788 / +1.7% 0.52 / 0.53 / -1.9%
tpcds_q45/duckdb:vortex-file-compressed 24465593 / 24095519 / +1.5% 31579579 / 31439773 / +0.4% 0.77 / 0.77 / +1.1%
tpcds_q46/duckdb:vortex-file-compressed 19807032 / 19944214 / -0.7% 28173599 / 28498573 / -1.1% 0.70 / 0.70 / +0.5%
tpcds_q47/duckdb:vortex-file-compressed 35197107 / 34362920 / +2.4% 45230612 / 45200024 / +0.1% 0.78 / 0.76 / +2.4%
tpcds_q48/duckdb:vortex-file-compressed 23824156 / 23537748 / +1.2% 36040939 / 35171768 / +2.5% 0.66 / 0.67 / -1.2%
tpcds_q49/duckdb:vortex-file-compressed 19219984 / 20061539 / -4.2% 29986531 / 31020788 / -3.3% 0.64 / 0.65 / -0.9%
tpcds_q50/duckdb:vortex-file-compressed 17375598 / 17224026 / +0.9% 28391727 / 28249732 / +0.5% 0.61 / 0.61 / +0.4%
tpcds_q51/duckdb:vortex-file-compressed 49965464 / 49558842 / +0.8% 77653799 / 59142497 / +31.3% 🔴 0.64 / 0.84 / -23.2%
tpcds_q52/duckdb:vortex-file-compressed 7299570 / 7471124 / -2.3% 15909836 / 16155821 / -1.5% 0.46 / 0.46 / -0.8%
tpcds_q53/duckdb:vortex-file-compressed 11717682 / 11708613 / +0.1% 21199474 / 20430202 / +3.8% 0.55 / 0.57 / -3.6%
tpcds_q54/duckdb:vortex-file-compressed 20707564 / 20517178 / +0.9% 30243298 / 30341791 / -0.3% 0.68 / 0.68 / +1.3%
tpcds_q55/duckdb:vortex-file-compressed 6985758 / 7086945 / -1.4% 15655757 / 16614933 / -5.8% 0.45 / 0.43 / +4.6%
tpcds_q56/duckdb:vortex-file-compressed 18701346 / 18390555 / +1.7% 28040988 / 28690113 / -2.3% 0.67 / 0.64 / +4.0%
tpcds_q57/duckdb:vortex-file-compressed 26147744 / 26501728 / -1.3% 34561606 / 35075063 / -1.5% 0.76 / 0.76 / +0.1%
tpcds_q58/duckdb:vortex-file-compressed 20996744 / 20471580 / +2.6% 30216147 / 30978872 / -2.5% 0.69 / 0.66 / +5.2%
tpcds_q59/duckdb:vortex-file-compressed 19998942 / 20144962 / -0.7% 27955467 / 28840927 / -3.1% 0.72 / 0.70 / +2.4%
tpcds_q60/duckdb:vortex-file-compressed 19212952 / 18663288 / +2.9% 28227221 / 29105972 / -3.0% 0.68 / 0.64 / +6.1%
tpcds_q61/duckdb:vortex-file-compressed 25530230 / 25454070 / +0.3% 34765663 / 35467454 / -2.0% 0.73 / 0.72 / +2.3%
tpcds_q62/duckdb:vortex-file-compressed 12076620 / 12066966 / +0.1% 18472583 / 19142635 / -3.5% 0.65 / 0.63 / +3.7%
tpcds_q63/duckdb:vortex-file-compressed 11082857 / 11315712 / -2.1% 20257208 / 20240474 / +0.1% 0.55 / 0.56 / -2.1%
tpcds_q64/duckdb:vortex-file-compressed 50008928 / 50298476 / -0.6% 66787760 / 68843128 / -3.0% 0.75 / 0.73 / +2.5%
tpcds_q65/duckdb:vortex-file-compressed 13309068 / 13261522 / +0.4% 22758907 / 23640025 / -3.7% 0.58 / 0.56 / +4.2%
tpcds_q66/duckdb:vortex-file-compressed 29807712 / 29356364 / +1.5% 40317300 / 38953267 / +3.5% 0.74 / 0.75 / -1.9%
tpcds_q67/duckdb:vortex-file-compressed 59377567 / 58699637 / +1.2% 68156732 / 67480625 / +1.0% 0.87 / 0.87 / +0.2%
tpcds_q68/duckdb:vortex-file-compressed 19794971 / 19803436 / -0.0% 28188709 / 28546143 / -1.3% 0.70 / 0.69 / +1.2%
tpcds_q69/duckdb:vortex-file-compressed 23329610 / 23406440 / -0.3% 38239508 / 38019199 / +0.6% 0.61 / 0.62 / -0.9%
tpcds_q70/duckdb:vortex-file-compressed 15853314 / 16057534 / -1.3% 27632588 / 28434674 / -2.8% 0.57 / 0.56 / +1.6%
tpcds_q71/duckdb:vortex-file-compressed 13186305 / 13083326 / +0.8% 23664143 / 24266057 / -2.5% 0.56 / 0.54 / +3.4%
tpcds_q72/duckdb:vortex-file-compressed 53620202 / 53306598 / +0.6% 66263095 / 66841585 / -0.9% 0.81 / 0.80 / +1.5%
tpcds_q73/duckdb:vortex-file-compressed 12067187 / 12089608 / -0.2% 21221566 / 21036740 / +0.9% 0.57 / 0.57 / -1.1%
tpcds_q74/duckdb:vortex-file-compressed 26545186 / 26070268 / +1.8% 34329822 / 34365954 / -0.1% 0.77 / 0.76 / +1.9%
tpcds_q75/duckdb:vortex-file-compressed 28457276 / 28699944 / -0.8% 38360046 / 39734586 / -3.5% 0.74 / 0.72 / +2.7%
tpcds_q76/duckdb:vortex-file-compressed 13106881 / 13454318 / -2.6% 24791082 / 25508048 / -2.8% 0.53 / 0.53 / +0.2%
tpcds_q77/duckdb:vortex-file-compressed 21261658 / 21028818 / +1.1% 32966254 / 32628785 / +1.0% 0.64 / 0.64 / +0.1%
tpcds_q78/duckdb:vortex-file-compressed 43634438 / 43216690 / +1.0% 54154880 / 54126335 / +0.1% 0.81 / 0.80 / +0.9%
tpcds_q79/duckdb:vortex-file-compressed 13667228 / 13435902 / +1.7% 22418963 / 23432828 / -4.3% 0.61 / 0.57 / +6.3%
tpcds_q80/duckdb:vortex-file-compressed 36805836 / 37202952 / -1.1% 50839086 / 51588198 / -1.5% 0.72 / 0.72 / +0.4%
tpcds_q81/duckdb:vortex-file-compressed 21801745 / 21286061 / +2.4% 30257768 / 30091464 / +0.6% 0.72 / 0.71 / +1.9%
tpcds_q82/duckdb:vortex-file-compressed 9895294 / 9434022 / +4.9% 25133633 / 25789878 / -2.5% 0.39 / 0.37 / +7.6%
tpcds_q83/duckdb:vortex-file-compressed 17914402 / 18050168 / -0.8% 24685610 / 24595920 / +0.4% 0.73 / 0.73 / -1.1%
tpcds_q84/duckdb:vortex-file-compressed 15700136 / 15788435 / -0.6% 22224007 / 23186803 / -4.2% 0.71 / 0.68 / +3.7%
tpcds_q85/duckdb:vortex-file-compressed 24837734 / 24704460 / +0.5% 36713523 / 36707520 / +0.0% 0.68 / 0.67 / +0.5%
tpcds_q86/duckdb:vortex-file-compressed 9906406 / 9966084 / -0.6% 16680049 / 16937119 / -1.5% 0.59 / 0.59 / +0.9%
tpcds_q87/duckdb:vortex-file-compressed 26314480 / 26271254 / +0.2% 34113239 / 33892892 / +0.7% 0.77 / 0.78 / -0.5%
tpcds_q88/duckdb:vortex-file-compressed 31486242 / 31419104 / +0.2% 40291218 / 39845592 / +1.1% 0.78 / 0.79 / -0.9%
tpcds_q89/duckdb:vortex-file-compressed 12450344 / 12523714 / -0.6% 21425108 / 22366688 / -4.2% 0.58 / 0.56 / +3.8%
tpcds_q90/duckdb:vortex-file-compressed 8362972 / 8234150 / +1.6% 16384150 / 16219806 / +1.0% 0.51 / 0.51 / +0.5%
tpcds_q91/duckdb:vortex-file-compressed 14952828 / 14875414 / +0.5% 22733710 / 23432472 / -3.0% 0.66 / 0.63 / +3.6%
tpcds_q92/duckdb:vortex-file-compressed 12279183 / 12185658 / +0.8% 21412847 / 21289808 / +0.6% 0.57 / 0.57 / +0.2%
tpcds_q93/duckdb:vortex-file-compressed 10390578 / 10200146 / +1.9% 23602917 / 24307062 / -2.9% 0.44 / 0.42 / +4.9%
tpcds_q94/duckdb:vortex-file-compressed 22618984 / 22700503 / -0.4% 32215290 / 32522349 / -0.9% 0.70 / 0.70 / +0.6%
tpcds_q95/duckdb:vortex-file-compressed 62995337 / 63017334 / -0.0% 71854902 / 71429073 / +0.6% 0.88 / 0.88 / -0.6%
tpcds_q96/duckdb:vortex-file-compressed 7269034 / 7044906 / +3.2% 16061222 / 16074625 / -0.1% 0.45 / 0.44 / +3.3%
tpcds_q97/duckdb:vortex-file-compressed 23606386 / 23644552 / -0.2% 32379012 / 32299442 / +0.2% 0.73 / 0.73 / -0.4%
tpcds_q98/duckdb:vortex-file-compressed 11664622 / 11336208 / +2.9% 19939898 / 21107734 / -5.5% 0.58 / 0.54 / +8.9%
tpcds_q99/duckdb:vortex-file-compressed 15066613 / 15282436 / -1.4% 22988180 / 24087996 / -4.6% 0.66 / 0.63 / +3.3%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24514720 / 24461415 / +0.2% 31422583 / 31889119 / -1.5% 0.78 / 0.77 / +1.7%
tpcds_q02/duckdb:parquet 18418876 / 18477803 / -0.3% 24752837 / 24904542 / -0.6% 0.74 / 0.74 / +0.3%
tpcds_q03/duckdb:parquet 10041991 / 9885219 / +1.6% 16026817 / 15716141 / +2.0% 0.63 / 0.63 / -0.4%
tpcds_q04/duckdb:parquet 119528614 / 118340878 / +1.0% 126956030 / 127118353 / -0.1% 0.94 / 0.93 / +1.1%
tpcds_q05/duckdb:parquet 29190116 / 28904132 / +1.0% 33846447 / 34074757 / -0.7% 0.86 / 0.85 / +1.7%
tpcds_q06/duckdb:parquet 26949430 / 26612744 / +1.3% 36370879 / 36038010 / +0.9% 0.74 / 0.74 / +0.3%
tpcds_q07/duckdb:parquet 33660454 / 30889214 / +9.0% 40577429 / 39478001 / +2.8% 0.83 / 0.78 / +6.0%
tpcds_q08/duckdb:parquet 20340063 / 20187230 / +0.8% 25724583 / 26525878 / -3.0% 0.79 / 0.76 / +3.9%
tpcds_q09/duckdb:parquet 26691696 / 27513464 / -3.0% 30260082 / 31524831 / -4.0% 0.88 / 0.87 / +1.1%
tpcds_q10/duckdb:parquet 33148503 / 33222414 / -0.2% 40861486 / 40837713 / +0.1% 0.81 / 0.81 / -0.3%
tpcds_q11/duckdb:parquet 69372482 / 68731161 / +0.9% 76820251 / 76879564 / -0.1% 0.90 / 0.89 / +1.0%
tpcds_q12/duckdb:parquet 14416342 / 14144158 / +1.9% 19681775 / 19819277 / -0.7% 0.73 / 0.71 / +2.6%
tpcds_q13/duckdb:parquet 32679968 / 31292196 / +4.4% 39677922 / 40289029 / -1.5% 0.82 / 0.78 / +6.0%
tpcds_q14/duckdb:parquet 64686204 / 64338646 / +0.5% 70869934 / 71335260 / -0.7% 0.91 / 0.90 / +1.2%
tpcds_q15/duckdb:parquet 17099944 / 17339696 / -1.4% 23314178 / 23248232 / +0.3% 0.73 / 0.75 / -1.7%
tpcds_q16/duckdb:parquet 30939877 / 30578287 / +1.2% 37789884 / 37670788 / +0.3% 0.82 / 0.81 / +0.9%
tpcds_q17/duckdb:parquet 35351744 / 35393214 / -0.1% 40735355 / 41074208 / -0.8% 0.87 / 0.86 / +0.7%
tpcds_q18/duckdb:parquet 48871787 / 47513666 / +2.9% 55802349 / 55915480 / -0.2% 0.88 / 0.85 / +3.1%
tpcds_q19/duckdb:parquet 19026558 / 18908272 / +0.6% 25865033 / 25869161 / -0.0% 0.74 / 0.73 / +0.6%
tpcds_q20/duckdb:parquet 15181190 / 15117726 / +0.4% 20329271 / 20319039 / +0.1% 0.75 / 0.74 / +0.4%
tpcds_q21/duckdb:parquet 10994493 / 10958786 / +0.3% 17327422 / 16915770 / +2.4% 0.63 / 0.65 / -2.1%
tpcds_q22/duckdb:parquet 21127497 / 21167452 / -0.2% 27029237 / 27090109 / -0.2% 0.78 / 0.78 / +0.0%
tpcds_q23/duckdb:parquet 42872852 / 42076472 / +1.9% 48181089 / 50375183 / -4.4% 0.89 / 0.84 / +6.5%
tpcds_q24/duckdb:parquet 30683838 / 30720912 / -0.1% 37492847 / 36885762 / +1.6% 0.82 / 0.83 / -1.7%
tpcds_q25/duckdb:parquet 31306164 / 30979612 / +1.1% 37923000 / 38374618 / -1.2% 0.83 / 0.81 / +2.3%
tpcds_q26/duckdb:parquet 29380784 / 29260556 / +0.4% 35609922 / 35609138 / +0.0% 0.83 / 0.82 / +0.4%
tpcds_q27/duckdb:parquet 35117456 / 33134471 / +6.0% 41803641 / 43669624 / -4.3% 0.84 / 0.76 / +10.7%
tpcds_q28/duckdb:parquet 26708810 / 26638018 / +0.3% 34091303 / 32338357 / +5.4% 0.78 / 0.82 / -4.9%
tpcds_q29/duckdb:parquet 32991220 / 32629098 / +1.1% 39730219 / 40449665 / -1.8% 0.83 / 0.81 / +2.9%
tpcds_q30/duckdb:parquet 36709031 / 36216204 / +1.4% 45489225 / 44941640 / +1.2% 0.81 / 0.81 / +0.1%
tpcds_q31/duckdb:parquet 36203930 / 36054844 / +0.4% 43087461 / 43183235 / -0.2% 0.84 / 0.83 / +0.6%
tpcds_q32/duckdb:parquet 14648760 / 14508078 / +1.0% 21571467 / 21278004 / +1.4% 0.68 / 0.68 / -0.4%
tpcds_q33/duckdb:parquet 24566700 / 23632444 / +4.0% 29437664 / 29707542 / -0.9% 0.83 / 0.80 / +4.9%
tpcds_q34/duckdb:parquet 17448732 / 17264167 / +1.1% 24754086 / 24340721 / +1.7% 0.70 / 0.71 / -0.6%
tpcds_q35/duckdb:parquet 35569509 / 35442622 / +0.4% 43938469 / 44681249 / -1.7% 0.81 / 0.79 / +2.1%
tpcds_q36/duckdb:parquet 40194717 / 40503322 / -0.8% 48636825 / 48119798 / +1.1% 0.83 / 0.84 / -1.8%
tpcds_q37/duckdb:parquet 12954804 / 13397750 / -3.3% 19880937 / 20708401 / -4.0% 0.65 / 0.65 / +0.7%
tpcds_q38/duckdb:parquet 30353448 / 29717562 / +2.1% 35594781 / 34213448 / +4.0% 0.85 / 0.87 / -1.8%
tpcds_q39/duckdb:parquet 24178919 / 23829380 / +1.5% 30892474 / 30449128 / +1.5% 0.78 / 0.78 / +0.0%
tpcds_q40/duckdb:parquet 16770649 / 16238836 / +3.3% 21835600 / 22101711 / -1.2% 0.77 / 0.73 / +4.5%
tpcds_q41/duckdb:parquet 12443202 / 12288706 / +1.3% 18774408 / 18367545 / +2.2% 0.66 / 0.67 / -0.9%
tpcds_q42/duckdb:parquet 9804724 / 9703324 / +1.0% 15826807 / 16110618 / -1.8% 0.62 / 0.60 / +2.9%
tpcds_q43/duckdb:parquet 12604752 / 12636840 / -0.3% 18840095 / 19017623 / -0.9% 0.67 / 0.66 / +0.7%
tpcds_q44/duckdb:parquet 20955424 / 20847950 / +0.5% 28197722 / 27075740 / +4.1% 0.74 / 0.77 / -3.5%
tpcds_q45/duckdb:parquet 21624390 / 21206582 / +2.0% 28467442 / 28532503 / -0.2% 0.76 / 0.74 / +2.2%
tpcds_q46/duckdb:parquet 37619911 / 36380140 / +3.4% 44210354 / 44539173 / -0.7% 0.85 / 0.82 / +4.2%
tpcds_q47/duckdb:parquet 34999176 / 34586680 / +1.2% 41858159 / 42107682 / -0.6% 0.84 / 0.82 / +1.8%
tpcds_q48/duckdb:parquet 29438234 / 30210846 / -2.6% 37888880 / 39878588 / -5.0% 0.78 / 0.76 / +2.6%
tpcds_q49/duckdb:parquet 30014900 / 30182184 / -0.6% 37450077 / 38576647 / -2.9% 0.80 / 0.78 / +2.4%
tpcds_q50/duckdb:parquet 19935048 / 19863609 / +0.4% 26344991 / 25976470 / +1.4% 0.76 / 0.76 / -1.0%
tpcds_q51/duckdb:parquet 52571108 / 52434272 / +0.3% 62399214 / 60969027 / +2.3% 0.84 / 0.86 / -2.0%
tpcds_q52/duckdb:parquet 9820519 / 9779850 / +0.4% 15934133 / 15736745 / +1.3% 0.62 / 0.62 / -0.8%
tpcds_q53/duckdb:parquet 14454950 / 13933530 / +3.7% 21369374 / 21080535 / +1.4% 0.68 / 0.66 / +2.3%
tpcds_q54/duckdb:parquet 25602640 / 25205726 / +1.6% 32476861 / 32379265 / +0.3% 0.79 / 0.78 / +1.3%
tpcds_q55/duckdb:parquet 9877800 / 9660020 / +2.3% 15633121 / 15334710 / +1.9% 0.63 / 0.63 / +0.3%
tpcds_q56/duckdb:parquet 26828418 / 26182610 / +2.5% 31049997 / 30957666 / +0.3% 0.86 / 0.85 / +2.2%
tpcds_q57/duckdb:parquet 31124704 / 30862125 / +0.9% 36413391 / 36547991 / -0.4% 0.85 / 0.84 / +1.2%
tpcds_q58/duckdb:parquet 24459314 / 24194040 / +1.1% 30421694 / 30112757 / +1.0% 0.80 / 0.80 / +0.1%
tpcds_q59/duckdb:parquet 23705080 / 23510052 / +0.8% 29639525 / 29836645 / -0.7% 0.80 / 0.79 / +1.5%
tpcds_q60/duckdb:parquet 28815150 / 26534511 / +8.6% 32363996 / 32916450 / -1.7% 0.89 / 0.81 / +10.4%
tpcds_q61/duckdb:parquet 25644106 / 24342124 / +5.3% 30319352 / 29132643 / +4.1% 0.85 / 0.84 / +1.2%
tpcds_q62/duckdb:parquet 13378616 / 13237418 / +1.1% 18398422 / 18208809 / +1.0% 0.73 / 0.73 / +0.0%
tpcds_q63/duckdb:parquet 13742834 / 13446420 / +2.2% 20309556 / 20085179 / +1.1% 0.68 / 0.67 / +1.1%
tpcds_q64/duckdb:parquet 71828174 / 71414432 / +0.6% 84294285 / 83765544 / +0.6% 0.85 / 0.85 / -0.1%
tpcds_q65/duckdb:parquet 19559798 / 19600975 / -0.2% 26494825 / 25574005 / +3.6% 0.74 / 0.77 / -3.7%
tpcds_q66/duckdb:parquet 35958337 / 35508789 / +1.3% 43809807 / 42329909 / +3.5% 0.82 / 0.84 / -2.2%
tpcds_q67/duckdb:parquet 62060842 / 64194316 / -3.3% 68172315 / 68576216 / -0.6% 0.91 / 0.94 / -2.8%
tpcds_q68/duckdb:parquet 28804823 / 28915509 / -0.4% 36953123 / 37384155 / -1.2% 0.78 / 0.77 / +0.8%
tpcds_q69/duckdb:parquet 26786400 / 26301866 / +1.8% 34889516 / 34493925 / +1.1% 0.77 / 0.76 / +0.7%
tpcds_q70/duckdb:parquet 19676626 / 19675632 / +0.0% 27514761 / 27386182 / +0.5% 0.72 / 0.72 / -0.5%
tpcds_q71/duckdb:parquet 17442676 / 17448006 / -0.0% 24242750 / 23990855 / +1.0% 0.72 / 0.73 / -1.1%
tpcds_q72/duckdb:parquet 54909232 / 54660460 / +0.5% 62833461 / 62275059 / +0.9% 0.87 / 0.88 / -0.4%
tpcds_q73/duckdb:parquet 15242098 / 15029432 / +1.4% 21908985 / 22152164 / -1.1% 0.70 / 0.68 / +2.5%
tpcds_q74/duckdb:parquet 84780228 / 84385634 / +0.5% 92515081 / 92185818 / +0.4% 0.92 / 0.92 / +0.1%
tpcds_q75/duckdb:parquet 47491991 / 45624206 / +4.1% 51549674 / 51356188 / +0.4% 0.92 / 0.89 / +3.7%
tpcds_q76/duckdb:parquet 17781978 / 18870968 / -5.8% 23751849 / 24356332 / -2.5% 0.75 / 0.77 / -3.4%
tpcds_q77/duckdb:parquet 27175931 / 24975692 / +8.8% 35664325 / 32645863 / +9.2% 0.76 / 0.77 / -0.4%
tpcds_q78/duckdb:parquet 79179656 / 78898743 / +0.4% 86263894 / 87809925 / -1.8% 0.92 / 0.90 / +2.2%
tpcds_q79/duckdb:parquet 23175241 / 22444963 / +3.3% 29649477 / 29362751 / +1.0% 0.78 / 0.76 / +2.3%
tpcds_q80/duckdb:parquet 37650407 / 36329628 / +3.6% 45538658 / 45211720 / +0.7% 0.83 / 0.80 / +2.9%
tpcds_q81/duckdb:parquet 37413954 / 36806600 / +1.7% 45945412 / 45327130 / +1.4% 0.81 / 0.81 / +0.3%
tpcds_q82/duckdb:parquet 13822962 / 13701072 / +0.9% 20666623 / 20843699 / -0.8% 0.67 / 0.66 / +1.8%
tpcds_q83/duckdb:parquet 20660835 / 20663900 / -0.0% 25883794 / 25360106 / +2.1% 0.80 / 0.81 / -2.0%
tpcds_q84/duckdb:parquet 23675974 / 23496624 / +0.8% 29481687 / 28978214 / +1.7% 0.80 / 0.81 / -1.0%
tpcds_q85/duckdb:parquet 33229640 / 32590619 / +2.0% 40712692 / 39990406 / +1.8% 0.82 / 0.81 / +0.2%
tpcds_q86/duckdb:parquet 12135304 / 12013802 / +1.0% 17572283 / 17020865 / +3.2% 0.69 / 0.71 / -2.2%
tpcds_q87/duckdb:parquet 32016533 / 31554158 / +1.5% 36111306 / 35597054 / +1.4% 0.89 / 0.89 / +0.0%
tpcds_q88/duckdb:parquet 39472704 / 39290797 / +0.5% 45187111 / 45373845 / -0.4% 0.87 / 0.87 / +0.9%
tpcds_q89/duckdb:parquet 14750974 / 14373810 / +2.6% 21686034 / 21425400 / +1.2% 0.68 / 0.67 / +1.4%
tpcds_q90/duckdb:parquet 10373011 / 10363688 / +0.1% 15870997 / 15705175 / +1.1% 0.65 / 0.66 / -1.0%
tpcds_q91/duckdb:parquet 21573596 / 21451967 / +0.6% 28498270 / 28956635 / -1.6% 0.76 / 0.74 / +2.2%
tpcds_q92/duckdb:parquet 16008794 / 15754876 / +1.6% 23043737 / 23375593 / -1.4% 0.69 / 0.67 / +3.1%
tpcds_q93/duckdb:parquet 14411706 / 14160048 / +1.8% 20597259 / 20900109 / -1.4% 0.70 / 0.68 / +3.3%
tpcds_q94/duckdb:parquet 25821634 / 25906744 / -0.3% 32698609 / 33051190 / -1.1% 0.79 / 0.78 / +0.7%
tpcds_q95/duckdb:parquet 44374474 / 44138026 / +0.5% 50532648 / 49404315 / +2.3% 0.88 / 0.89 / -1.7%
tpcds_q96/duckdb:parquet 8403194 / 8380358 / +0.3% 14256817 / 14018596 / +1.7% 0.59 / 0.60 / -1.4%
tpcds_q97/duckdb:parquet 27701344 / 27546754 / +0.6% 34649441 / 34328255 / +0.9% 0.80 / 0.80 / -0.4%
tpcds_q98/duckdb:parquet 16867669 / 16864316 / +0.0% 23640322 / 23676181 / -0.2% 0.71 / 0.71 / +0.2%
tpcds_q99/duckdb:parquet 19214554 / 19262517 / -0.2% 25096422 / 25183158 / -0.3% 0.77 / 0.76 / +0.1%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR b423d204 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.979x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.994x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15356431 / 15244796 / +0.7% 39697774 / 43107623 / -7.9% 0.39 / 0.35 / +9.4%
tpch_q02/datafusion:vortex-file-compressed 16812290 / 16785369 / +0.2% 33927081 / 35606088 / -4.7% 0.50 / 0.47 / +5.1%
tpch_q03/datafusion:vortex-file-compressed 19648538 / 19704057 / -0.3% 44111137 / 46014863 / -4.1% 0.45 / 0.43 / +4.0%
tpch_q04/datafusion:vortex-file-compressed 10458403 / 10379829 / +0.8% 31735502 / 32939078 / -3.7% 0.33 / 0.32 / +4.6%
tpch_q05/datafusion:vortex-file-compressed 36711033 / 37109828 / -1.1% 67183506 / 66535663 / +1.0% 0.55 / 0.56 / -2.0%
tpch_q06/datafusion:vortex-file-compressed 6064156 / 5996442 / +1.1% 25805387 / 25090471 / +2.8% 0.23 / 0.24 / -1.7%
tpch_q07/datafusion:vortex-file-compressed 52088838 / 51590471 / +1.0% 75187249 / 75221258 / -0.0% 0.69 / 0.69 / +1.0%
tpch_q08/datafusion:vortex-file-compressed 51426629 / 51934499 / -1.0% 80918775 / 79965898 / +1.2% 0.64 / 0.65 / -2.1%
tpch_q09/datafusion:vortex-file-compressed 47254898 / 47546136 / -0.6% 75985737 / 79942083 / -4.9% 0.62 / 0.59 / +4.6%
tpch_q10/datafusion:vortex-file-compressed 17343279 / 17645205 / -1.7% 46459880 / 47530092 / -2.3% 0.37 / 0.37 / +0.6%
tpch_q11/datafusion:vortex-file-compressed 13939273 / 14039900 / -0.7% 32984162 / 33161470 / -0.5% 0.42 / 0.42 / -0.2%
tpch_q12/datafusion:vortex-file-compressed 18325675 / 18302956 / +0.1% 40615174 / 43729009 / -7.1% 0.45 / 0.42 / +7.8%
tpch_q13/datafusion:vortex-file-compressed 20064485 / 19620384 / +2.3% 38936534 / 41663145 / -6.5% 0.52 / 0.47 / +9.4%
tpch_q14/datafusion:vortex-file-compressed 14597678 / 14553341 / +0.3% 38358159 / 37184545 / +3.2% 0.38 / 0.39 / -2.8%
tpch_q15/datafusion:vortex-file-compressed 18461717 / 18610835 / -0.8% 42285697 / 43225258 / -2.2% 0.44 / 0.43 / +1.4%
tpch_q16/datafusion:vortex-file-compressed 18707510 / 18329773 / +2.1% 39667629 / 40570847 / -2.2% 0.47 / 0.45 / +4.4%
tpch_q17/datafusion:vortex-file-compressed 27860625 / 27783290 / +0.3% 57398668 / 58070075 / -1.2% 0.49 / 0.48 / +1.5%
tpch_q18/datafusion:vortex-file-compressed 35773081 / 36366608 / -1.6% 58160799 / 60484474 / -3.8% 0.62 / 0.60 / +2.3%
tpch_q19/datafusion:vortex-file-compressed 12116194 / 12404911 / -2.3% 35482982 / 37955343 / -6.5% 0.34 / 0.33 / +4.5%
tpch_q20/datafusion:vortex-file-compressed 20297545 / 20323772 / -0.1% 43418169 / 45113470 / -3.8% 0.47 / 0.45 / +3.8%
tpch_q21/datafusion:vortex-file-compressed 39596182 / 40850950 / -3.1% 70890739 / 69381261 / +2.2% 0.56 / 0.59 / -5.1%
tpch_q22/datafusion:vortex-file-compressed 10752543 / 10664079 / +0.8% 29897535 / 31422514 / -4.9% 0.36 / 0.34 / +6.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72408786 / 72197453 / +0.3% 87341185 / 88021582 / -0.8% 0.83 / 0.82 / +1.1%
tpch_q02/datafusion:parquet 76301827 / 76113619 / +0.2% 92599117 / 91783594 / +0.9% 0.82 / 0.83 / -0.6%
tpch_q03/datafusion:parquet 84081314 / 83587244 / +0.6% 102459593 / 104079904 / -1.6% 0.82 / 0.80 / +2.2%
tpch_q04/datafusion:parquet 41083578 / 41074548 / +0.0% 58726951 / 58708424 / +0.0% 0.70 / 0.70 / -0.0%
tpch_q05/datafusion:parquet 111917728 / 111873269 / +0.0% 135855786 / 138232292 / -1.7% 0.82 / 0.81 / +1.8%
tpch_q06/datafusion:parquet 32247671 / 32164141 / +0.3% 46588499 / 48132854 / -3.2% 0.69 / 0.67 / +3.6%
tpch_q07/datafusion:parquet 114773227 / 115287140 / -0.4% 138852072 / 138852302 / -0.0% 0.83 / 0.83 / -0.4%
tpch_q08/datafusion:parquet 119675711 / 119975551 / -0.2% 143948118 / 146061083 / -1.4% 0.83 / 0.82 / +1.2%
tpch_q09/datafusion:parquet 139675739 / 140206080 / -0.4% 166552043 / 167370100 / -0.5% 0.84 / 0.84 / +0.1%
tpch_q10/datafusion:parquet 107046529 / 106687730 / +0.3% 129459583 / 129115049 / +0.3% 0.83 / 0.83 / +0.1%
tpch_q11/datafusion:parquet 61813008 / 60132019 / +2.8% 79744656 / 80765575 / -1.3% 0.78 / 0.74 / +4.1%
tpch_q12/datafusion:parquet 64967490 / 65627851 / -1.0% 83675469 / 87684783 / -4.6% 0.78 / 0.75 / +3.7%
tpch_q13/datafusion:parquet 147598276 / 147425213 / +0.1% 165781990 / 165702279 / +0.0% 0.89 / 0.89 / +0.1%
tpch_q14/datafusion:parquet 47911475 / 47798012 / +0.2% 70327576 / 69229230 / +1.6% 0.68 / 0.69 / -1.3%
tpch_q15/datafusion:parquet 74769739 / 74426434 / +0.5% 92305174 / 92888867 / -0.6% 0.81 / 0.80 / +1.1%
tpch_q16/datafusion:parquet 43911758 / 43982597 / -0.2% 60247049 / 60662108 / -0.7% 0.73 / 0.73 / +0.5%
tpch_q17/datafusion:parquet 125082755 / 123982033 / +0.9% 146990655 / 146222630 / +0.5% 0.85 / 0.85 / +0.4%
tpch_q18/datafusion:parquet 123458083 / 123784690 / -0.3% 143419537 / 145985967 / -1.8% 0.86 / 0.85 / +1.5%
tpch_q19/datafusion:parquet 57911791 / 58291246 / -0.7% 79932147 / 82910665 / -3.6% 0.72 / 0.70 / +3.1%
tpch_q20/datafusion:parquet 78526708 / 78072120 / +0.6% 100691546 / 104292926 / -3.5% 0.78 / 0.75 / +4.2%
tpch_q21/datafusion:parquet 116889464 / 116406825 / +0.4% 140329021 / 140577249 / -0.2% 0.83 / 0.83 / +0.6%
tpch_q22/datafusion:parquet 52328348 / 51648092 / +1.3% 69730854 / 70957245 / -1.7% 0.75 / 0.73 / +3.1%
duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9820995 / 9331715 / +5.2% 19984566 / 22301445 / -10.4% 🟢 0.49 / 0.42 / +17.4%
tpch_q02/duckdb:vortex-file-compressed 15237616 / 15484601 / -1.6% 25705660 / 25552226 / +0.6% 0.59 / 0.61 / -2.2%
tpch_q03/duckdb:vortex-file-compressed 19189086 / 19032979 / +0.8% 35439962 / 34316634 / +3.3% 0.54 / 0.55 / -2.4%
tpch_q04/duckdb:vortex-file-compressed 12353398 / 12472751 / -1.0% 25520571 / 26219641 / -2.7% 0.48 / 0.48 / +1.8%
tpch_q05/duckdb:vortex-file-compressed 20788035 / 20655679 / +0.6% 36484817 / 36659669 / -0.5% 0.57 / 0.56 / +1.1%
tpch_q06/duckdb:vortex-file-compressed 4933890 / 4857931 / +1.6% 14014685 / 14308025 / -2.1% 0.35 / 0.34 / +3.7%
tpch_q07/duckdb:vortex-file-compressed 24575988 / 24022009 / +2.3% 39576547 / 42111704 / -6.0% 0.62 / 0.57 / +8.9%
tpch_q08/duckdb:vortex-file-compressed 21549853 / 20985996 / +2.7% 37390071 / 37397733 / -0.0% 0.58 / 0.56 / +2.7%
tpch_q09/duckdb:vortex-file-compressed 22495362 / 23200613 / -3.0% 38919940 / 39713549 / -2.0% 0.58 / 0.58 / -1.1%
tpch_q10/duckdb:vortex-file-compressed 23002798 / 22845856 / +0.7% 37187549 / 37304677 / -0.3% 0.62 / 0.61 / +1.0%
tpch_q11/duckdb:vortex-file-compressed 8292004 / 8326778 / -0.4% 17334844 / 17727782 / -2.2% 0.48 / 0.47 / +1.8%
tpch_q12/duckdb:vortex-file-compressed 15079073 / 14696796 / +2.6% 25729492 / 26761598 / -3.9% 0.59 / 0.55 / +6.7%
tpch_q13/duckdb:vortex-file-compressed 19907087 / 19458653 / +2.3% 33087477 / 31940922 / +3.6% 0.60 / 0.61 / -1.2%
tpch_q14/duckdb:vortex-file-compressed 11544664 / 11617118 / -0.6% 25807017 / 24005548 / +7.5% 0.45 / 0.48 / -7.6%
tpch_q15/duckdb:vortex-file-compressed 8915072 / 8531969 / +4.5% 20766560 / 19674383 / +5.6% 0.43 / 0.43 / -1.0%
tpch_q16/duckdb:vortex-file-compressed 17042392 / 16840450 / +1.2% 23959687 / 23631828 / +1.4% 0.71 / 0.71 / -0.2%
tpch_q17/duckdb:vortex-file-compressed 12524050 / 12519740 / +0.0% 27095498 / 28338798 / -4.4% 0.46 / 0.44 / +4.6%
tpch_q18/duckdb:vortex-file-compressed 24743010 / 24609179 / +0.5% 32054941 / 33693817 / -4.9% 0.77 / 0.73 / +5.7%
tpch_q19/duckdb:vortex-file-compressed 12105233 / 12334808 / -1.9% 26468913 / 30730234 / -13.9% 🟢 0.46 / 0.40 / +13.9%
tpch_q20/duckdb:vortex-file-compressed 14397187 / 14293355 / +0.7% 30201195 / 30174689 / +0.1% 0.48 / 0.47 / +0.6%
tpch_q21/duckdb:vortex-file-compressed 37701425 / 37652395 / +0.1% 56699622 / 58206800 / -2.6% 0.66 / 0.65 / +2.8%
tpch_q22/duckdb:vortex-file-compressed 17141071 / 16837835 / +1.8% 26719912 / 26922218 / -0.8% 0.64 / 0.63 / +2.6%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48396046 / 48307040 / +0.2% 54733032 / 54616876 / +0.2% 0.88 / 0.88 / -0.0%
tpch_q02/duckdb:parquet 48917274 / 48896101 / +0.0% 56101756 / 56077374 / +0.0% 0.87 / 0.87 / -0.0%
tpch_q03/duckdb:parquet 60898695 / 60904244 / -0.0% 69677628 / 68371951 / +1.9% 0.87 / 0.89 / -1.9%
tpch_q04/duckdb:parquet 35355023 / 35226993 / +0.4% 42748367 / 44130480 / -3.1% 0.83 / 0.80 / +3.6%
tpch_q05/duckdb:parquet 68016140 / 68007656 / +0.0% 77977110 / 77731599 / +0.3% 0.87 / 0.87 / -0.3%
tpch_q06/duckdb:parquet 22148792 / 21889190 / +1.2% 27037777 / 27655555 / -2.2% 0.82 / 0.79 / +3.5%
tpch_q07/duckdb:parquet 64971308 / 64584662 / +0.6% 73853723 / 73435438 / +0.6% 0.88 / 0.88 / +0.0%
tpch_q08/duckdb:parquet 76940655 / 76297906 / +0.8% 87637245 / 87034681 / +0.7% 0.88 / 0.88 / +0.1%
tpch_q09/duckdb:parquet 108663363 / 108722543 / -0.1% 120207709 / 120496821 / -0.2% 0.90 / 0.90 / +0.2%
tpch_q10/duckdb:parquet 107450718 / 106897948 / +0.5% 118307340 / 116850249 / +1.2% 0.91 / 0.91 / -0.7%
tpch_q11/duckdb:parquet 29996733 / 29838442 / +0.5% 35648608 / 35529130 / +0.3% 0.84 / 0.84 / +0.2%
tpch_q12/duckdb:parquet 38162293 / 38296481 / -0.4% 45209469 / 45197180 / +0.0% 0.84 / 0.85 / -0.4%
tpch_q13/duckdb:parquet 176110733 / 175842570 / +0.2% 183090213 / 182383123 / +0.4% 0.96 / 0.96 / -0.2%
tpch_q14/duckdb:parquet 43287325 / 43217986 / +0.2% 51627696 / 52537443 / -1.7% 0.84 / 0.82 / +1.9%
tpch_q15/duckdb:parquet 33149590 / 33055371 / +0.3% 42361311 / 41534637 / +2.0% 0.78 / 0.80 / -1.7%
tpch_q16/duckdb:parquet 48572771 / 48446976 / +0.3% 54357205 / 53452908 / +1.7% 0.89 / 0.91 / -1.4%
tpch_q17/duckdb:parquet 48489699 / 48382020 / +0.2% 57963908 / 57851431 / +0.2% 0.84 / 0.84 / +0.0%
tpch_q18/duckdb:parquet 75191138 / 75180930 / +0.0% 82141056 / 83106544 / -1.2% 0.92 / 0.90 / +1.2%
tpch_q19/duckdb:parquet 48980001 / 50581915 / -3.2% 59143531 / 60744521 / -2.6% 0.83 / 0.83 / -0.5%
tpch_q20/duckdb:parquet 64194500 / 64115182 / +0.1% 74155417 / 73707959 / +0.6% 0.87 / 0.87 / -0.5%
tpch_q21/duckdb:parquet 107938080 / 108525558 / -0.5% 117382303 / 116925506 / +0.4% 0.92 / 0.93 / -0.9%
tpch_q22/duckdb:parquet 51453080 / 51338913 / +0.2% 59836200 / 59925342 / -0.1% 0.86 / 0.86 / +0.4%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR b423d204 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.959x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1241981 / 1222020 / +1.6% 21697611 / 25360366 / -14.4% 🟢 0.06 / 0.05 / +18.8%
clickbench_q01/datafusion:vortex-file-compressed 6027922 / 6291710 / -4.2% 28918332 / 31998400 / -9.6% 0.21 / 0.20 / +6.0%
clickbench_q02/datafusion:vortex-file-compressed 10647798 / 10743920 / -0.9% 44378920 / 48726078 / -8.9% 0.24 / 0.22 / +8.8%
clickbench_q03/datafusion:vortex-file-compressed 12292096 / 13578266 / -9.5% 56364424 / 60406156 / -6.7% 0.22 / 0.22 / -3.0%
clickbench_q04/datafusion:vortex-file-compressed 57869116 / 58875622 / -1.7% 104405842 / 104057010 / +0.3% 0.55 / 0.57 / -2.0%
clickbench_q05/datafusion:vortex-file-compressed 76188818 / 78364650 / -2.8% 125207197 / 125165765 / +0.0% 0.61 / 0.63 / -2.8%
clickbench_q06/datafusion:vortex-file-compressed 1245107 / 1245802 / -0.1% 22527388 / 24916123 / -9.6% 0.06 / 0.05 / +10.5%
clickbench_q07/datafusion:vortex-file-compressed 9214442 / 9440024 / -2.4% 34224205 / 36665765 / -6.7% 0.27 / 0.26 / +4.6%
clickbench_q08/datafusion:vortex-file-compressed 79637983 / 79572816 / +0.1% 123700200 / 128596494 / -3.8% 0.64 / 0.62 / +4.0%
clickbench_q09/datafusion:vortex-file-compressed 172977710 / 176945813 / -2.2% 207575820 / 220521609 / -5.9% 0.83 / 0.80 / +3.9%
clickbench_q10/datafusion:vortex-file-compressed 22603325 / 23324689 / -3.1% 68642048 / 75508962 / -9.1% 0.33 / 0.31 / +6.6%
clickbench_q11/datafusion:vortex-file-compressed 26174804 / 26075788 / +0.4% 70918579 / 77361491 / -8.3% 0.37 / 0.34 / +9.5%
clickbench_q12/datafusion:vortex-file-compressed 71732578 / 72198817 / -0.6% 126606674 / 127734875 / -0.9% 0.57 / 0.57 / +0.2%
clickbench_q13/datafusion:vortex-file-compressed 119085383 / 117074480 / +1.7% 181465541 / 185295836 / -2.1% 0.66 / 0.63 / +3.9%
clickbench_q14/datafusion:vortex-file-compressed 73944040 / 76569906 / -3.4% 135032647 / 133017726 / +1.5% 0.55 / 0.58 / -4.9%
clickbench_q15/datafusion:vortex-file-compressed 62191485 / 63096343 / -1.4% 97774759 / 103450927 / -5.5% 0.64 / 0.61 / +4.3%
clickbench_q16/datafusion:vortex-file-compressed 153744683 / 153318888 / +0.3% 210847026 / 222694391 / -5.3% 0.73 / 0.69 / +5.9%
clickbench_q17/datafusion:vortex-file-compressed 155117756 / 153766540 / +0.9% 221319567 / 233396981 / -5.2% 0.70 / 0.66 / +6.4%
clickbench_q18/datafusion:vortex-file-compressed 295880798 / 295032098 / +0.3% 371306311 / 398720609 / -6.9% 0.80 / 0.74 / +7.7%
clickbench_q19/datafusion:vortex-file-compressed 8161073 / 8264734 / -1.3% 46989451 / 52445244 / -10.4% 🟢 0.17 / 0.16 / +10.2%
clickbench_q20/datafusion:vortex-file-compressed 69040424 / 69601585 / -0.8% 247757229 / 255050274 / -2.9% 0.28 / 0.27 / +2.1%
clickbench_q21/datafusion:vortex-file-compressed 79238578 / 79545494 / -0.4% 288202509 / 303920860 / -5.2% 0.27 / 0.26 / +5.0%
clickbench_q22/datafusion:vortex-file-compressed 92553489 / 92281360 / +0.3% 393639896 / 409072596 / -3.8% 0.24 / 0.23 / +4.2%
clickbench_q23/datafusion:vortex-file-compressed 193747592 / 186630780 / +3.8% 591284396 / 582812959 / +1.5% 0.33 / 0.32 / +2.3%
clickbench_q24/datafusion:vortex-file-compressed 16852560 / 15971598 / +5.5% 64959633 / 75248446 / -13.7% 🟢 0.26 / 0.21 / +22.2%
clickbench_q25/datafusion:vortex-file-compressed 19059982 / 19327944 / -1.4% 62479187 / 65544239 / -4.7% 0.31 / 0.29 / +3.5%
clickbench_q26/datafusion:vortex-file-compressed 16132946 / 16570822 / -2.6% 62707383 / 69223643 / -9.4% 0.26 / 0.24 / +7.5%
clickbench_q27/datafusion:vortex-file-compressed 101089246 / 104236139 / -3.0% 254677179 / 267629648 / -4.8% 0.40 / 0.39 / +1.9%
clickbench_q28/datafusion:vortex-file-compressed 557901939 / 554970976 / +0.5% 644124533 / 640981632 / +0.5% 0.87 / 0.87 / +0.0%
clickbench_q29/datafusion:vortex-file-compressed 24600998 / 24996223 / -1.6% 55742826 / 58416640 / -4.6% 0.44 / 0.43 / +3.1%
clickbench_q30/datafusion:vortex-file-compressed 59273834 / 58566897 / +1.2% 109721262 / 115415423 / -4.9% 0.54 / 0.51 / +6.5%
clickbench_q31/datafusion:vortex-file-compressed 65473168 / 66520857 / -1.6% 155030911 / 163467318 / -5.2% 0.42 / 0.41 / +3.8%
clickbench_q32/datafusion:vortex-file-compressed 287262289 / 288811144 / -0.5% 381067059 / 398601613 / -4.4% 0.75 / 0.72 / +4.0%
clickbench_q33/datafusion:vortex-file-compressed 321104706 / 323220982 / -0.7% 427039359 / 442745470 / -3.5% 0.75 / 0.73 / +3.0%
clickbench_q34/datafusion:vortex-file-compressed 320272762 / 323787036 / -1.1% 432304645 / 439727390 / -1.7% 0.74 / 0.74 / +0.6%
clickbench_q35/datafusion:vortex-file-compressed 57642795 / 56474642 / +2.1% 91375354 / 95239632 / -4.1% 0.63 / 0.59 / +6.4%
clickbench_q36/datafusion:vortex-file-compressed 37538086 / 37786497 / -0.7% 66030308 / 70220251 / -6.0% 0.57 / 0.54 / +5.6%
clickbench_q37/datafusion:vortex-file-compressed 21396344 / 21112899 / +1.3% 47551402 / 52236069 / -9.0% 0.45 / 0.40 / +11.3%
clickbench_q38/datafusion:vortex-file-compressed 13253614 / 13238210 / +0.1% 41094305 / 45728369 / -10.1% 🟢 0.32 / 0.29 / +11.4%
clickbench_q39/datafusion:vortex-file-compressed 78824622 / 79489746 / -0.8% 111554300 / 117000884 / -4.7% 0.71 / 0.68 / +4.0%
clickbench_q40/datafusion:vortex-file-compressed 10704631 / 10678944 / +0.2% 35651369 / 38994551 / -8.6% 0.30 / 0.27 / +9.6%
clickbench_q41/datafusion:vortex-file-compressed 10036621 / 10146938 / -1.1% 33629240 / 37697537 / -10.8% 🟢 0.30 / 0.27 / +10.9%
clickbench_q42/datafusion:vortex-file-compressed 10381884 / 10580150 / -1.9% 34177327 / 40151466 / -14.9% 🟢 0.30 / 0.26 / +15.3%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1226113 / 1252390 / -2.1% 49338510 / 49858886 / -1.0% 0.02 / 0.03 / -1.1%
clickbench_q01/datafusion:parquet 16271790 / 15787223 / +3.1% 71546058 / 67905785 / +5.4% 0.23 / 0.23 / -2.2%
clickbench_q02/datafusion:parquet 18732133 / 19202549 / -2.4% 84007924 / 80765269 / +4.0% 0.22 / 0.24 / -6.2%
clickbench_q03/datafusion:parquet 16749128 / 16825988 / -0.5% 79138317 / 79107161 / +0.0% 0.21 / 0.21 / -0.5%
clickbench_q04/datafusion:parquet 62234868 / 64070752 / -2.9% 123835537 / 123746561 / +0.1% 0.50 / 0.52 / -2.9%
clickbench_q05/datafusion:parquet 87756274 / 89193812 / -1.6% 154018013 / 155866707 / -1.2% 0.57 / 0.57 / -0.4%
clickbench_q06/datafusion:parquet 1224525 / 1271545 / -3.7% 49687027 / 50022393 / -0.7% 0.02 / 0.03 / -3.0%
clickbench_q07/datafusion:parquet 17111657 / 16725616 / +2.3% 69203399 / 67183619 / +3.0% 0.25 / 0.25 / -0.7%
clickbench_q08/datafusion:parquet 85365647 / 86360220 / -1.2% 155332012 / 161677570 / -3.9% 0.55 / 0.53 / +2.9%
clickbench_q09/datafusion:parquet 189833342 / 189811070 / +0.0% 269254286 / 272037328 / -1.0% 0.71 / 0.70 / +1.0%
clickbench_q10/datafusion:parquet 36040198 / 35867330 / +0.5% 98883416 / 99994609 / -1.1% 0.36 / 0.36 / +1.6%
clickbench_q11/datafusion:parquet 43097736 / 41799902 / +3.1% 107574703 / 107840232 / -0.2% 0.40 / 0.39 / +3.4%
clickbench_q12/datafusion:parquet 94846406 / 95834502 / -1.0% 158819526 / 164548538 / -3.5% 0.60 / 0.58 / +2.5%
clickbench_q13/datafusion:parquet 146563620 / 145974546 / +0.4% 225320345 / 229047253 / -1.6% 0.65 / 0.64 / +2.1%
clickbench_q14/datafusion:parquet 100911699 / 102005408 / -1.1% 171384898 / 171671822 / -0.2% 0.59 / 0.59 / -0.9%
clickbench_q15/datafusion:parquet 72901258 / 71461450 / +2.0% 127565459 / 130790451 / -2.5% 0.57 / 0.55 / +4.6%
clickbench_q16/datafusion:parquet 154788226 / 156397034 / -1.0% 231208377 / 233902360 / -1.2% 0.67 / 0.67 / +0.1%
clickbench_q17/datafusion:parquet 154605564 / 157819059 / -2.0% 233264481 / 236051334 / -1.2% 0.66 / 0.67 / -0.9%
clickbench_q18/datafusion:parquet 310598224 / 307951774 / +0.9% 408722856 / 413174846 / -1.1% 0.76 / 0.75 / +2.0%
clickbench_q19/datafusion:parquet 18471927 / 19050488 / -3.0% 71439093 / 77455643 / -7.8% 0.26 / 0.25 / +5.1%
clickbench_q20/datafusion:parquet 177005437 / 179151449 / -1.2% 275527449 / 286433806 / -3.8% 0.64 / 0.63 / +2.7%
clickbench_q21/datafusion:parquet 172124745 / 172313051 / -0.1% 289313223 / 303072635 / -4.5% 0.59 / 0.57 / +4.6%
clickbench_q22/datafusion:parquet 256462776 / 263455818 / -2.7% 412581881 / 429668613 / -4.0% 0.62 / 0.61 / +1.4%
clickbench_q23/datafusion:parquet 1002204876 / 1015026952 / -1.3% 1178641795 / 1186808838 / -0.7% 0.85 / 0.86 / -0.6%
clickbench_q24/datafusion:parquet 29524020 / 30571946 / -3.4% 86425475 / 89809691 / -3.8% 0.34 / 0.34 / +0.4%
clickbench_q25/datafusion:parquet 37061674 / 37111422 / -0.1% 98950936 / 102893012 / -3.8% 0.37 / 0.36 / +3.8%
clickbench_q26/datafusion:parquet 30066198 / 31127172 / -3.4% 85671829 / 89186979 / -3.9% 0.35 / 0.35 / +0.6%
clickbench_q27/datafusion:parquet 191567514 / 193620522 / -1.1% 277997331 / 289723884 / -4.0% 0.69 / 0.67 / +3.1%
clickbench_q28/datafusion:parquet 613020925 / 617527624 / -0.7% 690920878 / 702331735 / -1.6% 0.89 / 0.88 / +0.9%
clickbench_q29/datafusion:parquet 29961553 / 28774798 / +4.1% 89620844 / 90223686 / -0.7% 0.33 / 0.32 / +4.8%
clickbench_q30/datafusion:parquet 89966526 / 89604524 / +0.4% 165280672 / 173512200 / -4.7% 0.54 / 0.52 / +5.4%
clickbench_q31/datafusion:parquet 102547789 / 103528343 / -0.9% 186007478 / 200819036 / -7.4% 0.55 / 0.52 / +6.9%
clickbench_q32/datafusion:parquet 308094310 / 308568780 / -0.2% 417911818 / 431256499 / -3.1% 0.74 / 0.72 / +3.0%
clickbench_q33/datafusion:parquet 374026826 / 377940900 / -1.0% 471383153 / 479131033 / -1.6% 0.79 / 0.79 / +0.6%
clickbench_q34/datafusion:parquet 376323572 / 379057750 / -0.7% 470350538 / 480750972 / -2.2% 0.80 / 0.79 / +1.5%
clickbench_q35/datafusion:parquet 64071312 / 65543578 / -2.2% 123090722 / 124134655 / -0.8% 0.52 / 0.53 / -1.4%
clickbench_q36/datafusion:parquet 73352048 / 73387590 / -0.0% 133773379 / 135774569 / -1.5% 0.55 / 0.54 / +1.4%
clickbench_q37/datafusion:parquet 35207858 / 35617999 / -1.2% 90831587 / 91810520 / -1.1% 0.39 / 0.39 / -0.1%
clickbench_q38/datafusion:parquet 47406546 / 47860311 / -0.9% 106666493 / 110026773 / -3.1% 0.44 / 0.43 / +2.2%
clickbench_q39/datafusion:parquet 143336092 / 143836521 / -0.3% 205671339 / 214263836 / -4.0% 0.70 / 0.67 / +3.8%
clickbench_q40/datafusion:parquet 19790932 / 20048918 / -1.3% 77251236 / 78849852 / -2.0% 0.26 / 0.25 / +0.8%
clickbench_q41/datafusion:parquet 18545319 / 18839682 / -1.6% 76265185 / 78602562 / -3.0% 0.24 / 0.24 / +1.5%
clickbench_q42/datafusion:parquet 19203118 / 19448928 / -1.3% 74835139 / 80271917 / -6.8% 0.26 / 0.24 / +5.9%
duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2161592 / 2316356 / -6.7% 25089149 / 23309937 / +7.6% 0.09 / 0.10 / -13.3%
clickbench_q01/duckdb:vortex-file-compressed 7571186 / 7539062 / +0.4% 26995517 / 26697318 / +1.1% 0.28 / 0.28 / -0.7%
clickbench_q02/duckdb:vortex-file-compressed 9102720 / 8955982 / +1.6% 35500344 / 35695040 / -0.5% 0.26 / 0.25 / +2.2%
clickbench_q03/duckdb:vortex-file-compressed 13783342 / 13975386 / -1.4% 45239824 / 49335517 / -8.3% 0.30 / 0.28 / +7.6%
clickbench_q04/duckdb:vortex-file-compressed 55898401 / 58896211 / -5.1% 89573170 / 92282346 / -2.9% 0.62 / 0.64 / -2.2%
clickbench_q05/duckdb:vortex-file-compressed 66630332 / 67206239 / -0.9% 95586453 / 96372538 / -0.8% 0.70 / 0.70 / -0.0%
clickbench_q06/duckdb:vortex-file-compressed 2638992 / 2622598 / +0.6% 31098078 / 29238338 / +6.4% 0.08 / 0.09 / -5.4%
clickbench_q07/duckdb:vortex-file-compressed 9557635 / 9600068 / -0.4% 30833958 / 29770566 / +3.6% 0.31 / 0.32 / -3.9%
clickbench_q08/duckdb:vortex-file-compressed 69420112 / 70062960 / -0.9% 103080617 / 105800127 / -2.6% 0.67 / 0.66 / +1.7%
clickbench_q09/duckdb:vortex-file-compressed 94414086 / 94451218 / -0.0% 128195882 / 127163205 / +0.8% 0.74 / 0.74 / -0.8%
clickbench_q10/duckdb:vortex-file-compressed 27781882 / 27782772 / -0.0% 64166185 / 72279743 / -11.2% 🟢 0.43 / 0.38 / +12.6%
clickbench_q11/duckdb:vortex-file-compressed 30343665 / 30687561 / -1.1% 66489852 / 74359750 / -10.6% 🟢 0.46 / 0.41 / +10.6%
clickbench_q12/duckdb:vortex-file-compressed 72501146 / 72237397 / +0.4% 101827694 / 103652304 / -1.8% 0.71 / 0.70 / +2.2%
clickbench_q13/duckdb:vortex-file-compressed 128791472 / 127851810 / +0.7% 163279846 / 168822427 / -3.3% 0.79 / 0.76 / +4.2%
clickbench_q14/duckdb:vortex-file-compressed 76215389 / 76230723 / -0.0% 105803665 / 106914135 / -1.0% 0.72 / 0.71 / +1.0%
clickbench_q15/duckdb:vortex-file-compressed 76319362 / 76408312 / -0.1% 106932959 / 108616047 / -1.5% 0.71 / 0.70 / +1.5%
clickbench_q16/duckdb:vortex-file-compressed 137951051 / 140833212 / -2.0% 171066519 / 178949293 / -4.4% 0.81 / 0.79 / +2.5%
clickbench_q17/duckdb:vortex-file-compressed 140002564 / 145359782 / -3.7% 172712507 / 181211144 / -4.7% 0.81 / 0.80 / +1.1%
clickbench_q18/duckdb:vortex-file-compressed 260336938 / 256850284 / +1.4% 309677410 / 313893640 / -1.3% 0.84 / 0.82 / +2.7%
clickbench_q19/duckdb:vortex-file-compressed 9864521 / 9464116 / +4.2% 35734909 / 37478588 / -4.7% 0.28 / 0.25 / +9.3%
clickbench_q20/duckdb:vortex-file-compressed 68438308 / 69316572 / -1.3% 163633773 / 170472456 / -4.0% 0.42 / 0.41 / +2.9%
clickbench_q21/duckdb:vortex-file-compressed 83203188 / 87218998 / -4.6% 184124290 / 201513382 / -8.6% 0.45 / 0.43 / +4.4%
clickbench_q22/duckdb:vortex-file-compressed 174922926 / 174846654 / +0.0% 329845031 / 367208660 / -10.2% 🟢 0.53 / 0.48 / +11.4%
clickbench_q23/duckdb:vortex-file-compressed 40946678 / 41038768 / -0.2% 88248643 / 82961725 / +6.4% 0.46 / 0.49 / -6.2%
clickbench_q24/duckdb:vortex-file-compressed 14759238 / 15160866 / -2.6% 34364299 / 34968266 / -1.7% 0.43 / 0.43 / -0.9%
clickbench_q25/duckdb:vortex-file-compressed 19379380 / 19345222 / +0.2% 51989559 / 52265793 / -0.5% 0.37 / 0.37 / +0.7%
clickbench_q26/duckdb:vortex-file-compressed 11383574 / 11666164 / -2.4% 34044934 / 37230065 / -8.6% 0.33 / 0.31 / +6.7%
clickbench_q27/duckdb:vortex-file-compressed 53346050 / 54071963 / -1.3% 169051371 / 179248733 / -5.7% 0.32 / 0.30 / +4.6%
clickbench_q28/duckdb:vortex-file-compressed 523131330 / 521783236 / +0.3% 562465101 / 584919271 / -3.8% 0.93 / 0.89 / +4.3%
clickbench_q29/duckdb:vortex-file-compressed 17564878 / 18144333 / -3.2% 45349529 / 41948890 / +8.1% 0.39 / 0.43 / -10.5%
clickbench_q30/duckdb:vortex-file-compressed 60515261 / 61457455 / -1.5% 103821791 / 112065220 / -7.4% 0.58 / 0.55 / +6.3%
clickbench_q31/duckdb:vortex-file-compressed 111418577 / 112605193 / -1.1% 187490030 / 176967995 / +5.9% 0.59 / 0.64 / -6.6%
clickbench_q32/duckdb:vortex-file-compressed 362643446 / 376110058 / -3.6% 399855174 / 406967585 / -1.7% 0.91 / 0.92 / -1.9%
clickbench_q33/duckdb:vortex-file-compressed 351260856 / 341811647 / +2.8% 411663890 / 401498204 / +2.5% 0.85 / 0.85 / +0.2%
clickbench_q34/duckdb:vortex-file-compressed 359363636 / 359692298 / -0.1% 428239727 / 421374281 / +1.6% 0.84 / 0.85 / -1.7%
clickbench_q35/duckdb:vortex-file-compressed 57014526 / 59653987 / -4.4% 85493012 / 90891251 / -5.9% 0.67 / 0.66 / +1.6%
clickbench_q36/duckdb:vortex-file-compressed 11545502 / 11699479 / -1.3% 30589379 / 31365789 / -2.5% 0.38 / 0.37 / +1.2%
clickbench_q37/duckdb:vortex-file-compressed 8291640 / 8226245 / +0.8% 27609749 / 27060925 / +2.0% 0.30 / 0.30 / -1.2%
clickbench_q38/duckdb:vortex-file-compressed 9104711 / 8761657 / +3.9% 27831141 / 28743146 / -3.2% 0.33 / 0.30 / +7.3%
clickbench_q39/duckdb:vortex-file-compressed 19221430 / 18934137 / +1.5% 39454941 / 41063311 / -3.9% 0.49 / 0.46 / +5.7%
clickbench_q40/duckdb:vortex-file-compressed 7416120 / 7565950 / -2.0% 26719175 / 27136661 / -1.5% 0.28 / 0.28 / -0.4%
clickbench_q41/duckdb:vortex-file-compressed 8521585 / 8713054 / -2.2% 28961811 / 29103500 / -0.5% 0.29 / 0.30 / -1.7%
clickbench_q42/duckdb:vortex-file-compressed 7460040 / 7453789 / +0.1% 27254550 / 29052559 / -6.2% 0.27 / 0.26 / +6.7%
duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 10736850 / 10659744 / +0.7% 17905823 / 18978727 / -5.7% 0.60 / 0.56 / +6.8%
clickbench_q01/duckdb:parquet 17353581 / 16886617 / +2.8% 23517450 / 25296916 / -7.0% 0.74 / 0.67 / +10.5%
clickbench_q02/duckdb:parquet 24628356 / 24098232 / +2.2% 37426580 / 37071171 / +1.0% 0.66 / 0.65 / +1.2%
clickbench_q03/duckdb:parquet 24791054 / 24782620 / +0.0% 38206248 / 39824349 / -4.1% 0.65 / 0.62 / +4.3%
clickbench_q04/duckdb:parquet 64830532 / 63683324 / +1.8% 75481014 / 77506227 / -2.6% 0.86 / 0.82 / +4.5%
clickbench_q05/duckdb:parquet 85654698 / 85826466 / -0.2% 104523030 / 107119166 / -2.4% 0.82 / 0.80 / +2.3%
clickbench_q06/duckdb:parquet 22354728 / 22226085 / +0.6% 32450713 / 33590690 / -3.4% 0.69 / 0.66 / +4.1%
clickbench_q07/duckdb:parquet 19168356 / 19221367 / -0.3% 26473982 / 25706882 / +3.0% 0.72 / 0.75 / -3.2%
clickbench_q08/duckdb:parquet 78072711 / 77522808 / +0.7% 93181093 / 92848832 / +0.4% 0.84 / 0.83 / +0.4%
clickbench_q09/duckdb:parquet 107868070 / 104704682 / +3.0% 124401577 / 125363634 / -0.8% 0.87 / 0.84 / +3.8%
clickbench_q10/duckdb:parquet 42712684 / 42519106 / +0.5% 57848186 / 59927647 / -3.5% 0.74 / 0.71 / +4.1%
clickbench_q11/duckdb:parquet 48314149 / 47981428 / +0.7% 68680147 / 65672662 / +4.6% 0.70 / 0.73 / -3.7%
clickbench_q12/duckdb:parquet 96257164 / 95665316 / +0.6% 117473296 / 114826720 / +2.3% 0.82 / 0.83 / -1.6%
clickbench_q13/duckdb:parquet 157867403 / 153472152 / +2.9% 177283205 / 175809711 / +0.8% 0.89 / 0.87 / +2.0%
clickbench_q14/duckdb:parquet 105369111 / 102001694 / +3.3% 126616769 / 130684375 / -3.1% 0.83 / 0.78 / +6.6%
clickbench_q15/duckdb:parquet 90693723 / 90067308 / +0.7% 106052813 / 104927022 / +1.1% 0.86 / 0.86 / -0.4%
clickbench_q16/duckdb:parquet 167355869 / 176342836 / -5.1% 194437275 / 188023501 / +3.4% 0.86 / 0.94 / -8.2%
clickbench_q17/duckdb:parquet 168262550 / 177250039 / -5.1% 193963749 / 192559334 / +0.7% 0.87 / 0.92 / -5.8%
clickbench_q18/duckdb:parquet 308984302 / 308633344 / +0.1% 341776741 / 337205069 / +1.4% 0.90 / 0.92 / -1.2%
clickbench_q19/duckdb:parquet 21830795 / 22413691 / -2.6% 29656297 / 29637447 / +0.1% 0.74 / 0.76 / -2.7%
clickbench_q20/duckdb:parquet 196189274 / 186276237 / +5.3% 231926059 / 238066293 / -2.6% 0.85 / 0.78 / +8.1%
clickbench_q21/duckdb:parquet 229077412 / 227868066 / +0.5% 273542192 / 270418878 / +1.2% 0.84 / 0.84 / -0.6%
clickbench_q22/duckdb:parquet 322535603 / 309103402 / +4.3% 357412954 / 367922241 / -2.9% 0.90 / 0.84 / +7.4%
clickbench_q23/duckdb:parquet 177369528 / 170096610 / +4.3% 241384748 / 249917834 / -3.4% 0.73 / 0.68 / +8.0%
clickbench_q24/duckdb:parquet 32238050 / 32568394 / -1.0% 48696832 / 50429952 / -3.4% 0.66 / 0.65 / +2.5%
clickbench_q25/duckdb:parquet 45111622 / 45180834 / -0.2% 69269823 / 65172683 / +6.3% 0.65 / 0.69 / -6.1%
clickbench_q26/duckdb:parquet 34018128 / 33653694 / +1.1% 47811184 / 48840762 / -2.1% 0.71 / 0.69 / +3.3%
clickbench_q27/duckdb:parquet 207852062 / 194425344 / +6.9% 234653863 / 234323287 / +0.1% 0.89 / 0.83 / +6.8%
clickbench_q28/duckdb:parquet 978133438 / 993376018 / -1.5% 980652575 / 978268921 / +0.2% 1.00 / 1.02 / -1.8%
clickbench_q29/duckdb:parquet 26391480 / 26075564 / +1.2% 35303085 / 35006863 / +0.8% 0.75 / 0.74 / +0.4%
clickbench_q30/duckdb:parquet 110383703 / 109086891 / +1.2% 139527059 / 141744231 / -1.6% 0.79 / 0.77 / +2.8%
clickbench_q31/duckdb:parquet 149482695 / 149473362 / +0.0% 184585791 / 181919472 / +1.5% 0.81 / 0.82 / -1.4%
clickbench_q32/duckdb:parquet 392693960 / 407535979 / -3.6% 424208169 / 415126757 / +2.2% 0.93 / 0.98 / -5.7%
clickbench_q33/duckdb:parquet 492340096 / 487845054 / +0.9% 459747329 / 477973659 / -3.8% 1.07 / 1.02 / +4.9%
clickbench_q34/duckdb:parquet 485240708 / 483134955 / +0.4% 476651783 / 474109910 / +0.5% 1.02 / 1.02 / -0.1%
clickbench_q35/duckdb:parquet 63981480 / 64853068 / -1.3% 80561310 / 78830710 / +2.2% 0.79 / 0.82 / -3.5%
clickbench_q36/duckdb:parquet 32575782 / 31689553 / +2.8% 40842558 / 40649108 / +0.5% 0.80 / 0.78 / +2.3%
clickbench_q37/duckdb:parquet 25931748 / 25055420 / +3.5% 33550933 / 33971986 / -1.2% 0.77 / 0.74 / +4.8%
clickbench_q38/duckdb:parquet 25252973 / 25376014 / -0.5% 34220205 / 34548555 / -1.0% 0.74 / 0.73 / +0.5%
clickbench_q39/duckdb:parquet 54741943 / 55054473 / -0.6% 64512232 / 65475996 / -1.5% 0.85 / 0.84 / +0.9%
clickbench_q40/duckdb:parquet 15729958 / 16160134 / -2.7% 23822187 / 25043946 / -4.9% 0.66 / 0.65 / +2.3%
clickbench_q41/duckdb:parquet 16893064 / 16865376 / +0.2% 23893363 / 24902932 / -4.1% 0.71 / 0.68 / +4.4%
clickbench_q42/duckdb:parquet 15755123 / 15796464 / -0.3% 24890193 / 26446483 / -5.9% 0.63 / 0.60 / +6.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR b423d204 vs base 19dcd2f2
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.7%
Engines: DataFusion No clear signal (+3.0%, environment too noisy confidence) · DuckDB No clear signal (+4.3%, environment too noisy confidence)
Vortex (geomean): hot 1.046x ➖ · cold 1.010x ➖
Parquet (geomean): hot 1.009x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.9% · Median polish +5.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.010x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 221304268 / 225101151 / -1.7% 962635148 / 819874295 / +17.4% 0.23 / 0.27 / -16.3%
tpch_q02/datafusion:vortex-file-compressed 686490426 / 318534689 / +115.5% 🔴 864822352 / 723751029 / +19.5% 0.79 / 0.44 / +80.4%
tpch_q03/datafusion:vortex-file-compressed 439542318 / 377368788 / +16.5% 1075884035 / 999232984 / +7.7% 0.41 / 0.38 / +8.2%
tpch_q04/datafusion:vortex-file-compressed 266618985 / 198635278 / +34.2% 🔴 439676641 / 477424781 / -7.9% 0.61 / 0.42 / +45.7%
tpch_q05/datafusion:vortex-file-compressed 414532004 / 393827139 / +5.3% 615007436 / 629883322 / -2.4% 0.67 / 0.63 / +7.8%
tpch_q06/datafusion:vortex-file-compressed 153247266 / 143980039 / +6.4% 293653867 / 326680898 / -10.1% 0.52 / 0.44 / +18.4%
tpch_q07/datafusion:vortex-file-compressed 470080181 / 459619010 / +2.3% 677375850 / 603682077 / +12.2% 0.69 / 0.76 / -8.9%
tpch_q08/datafusion:vortex-file-compressed 429257149 / 480151339 / -10.6% 625856598 / 646130135 / -3.1% 0.69 / 0.74 / -7.7%
tpch_q09/datafusion:vortex-file-compressed 331124926 / 280196019 / +18.2% 505193947 / 569775944 / -11.3% 0.66 / 0.49 / +33.3%
tpch_q10/datafusion:vortex-file-compressed 347404860 / 335800983 / +3.5% 517461241 / 563854563 / -8.2% 0.67 / 0.60 / +12.7%
tpch_q11/datafusion:vortex-file-compressed 282980272 / 253028894 / +11.8% 444326347 / 411167746 / +8.1% 0.64 / 0.62 / +3.5%
tpch_q12/datafusion:vortex-file-compressed 211822737 / 247200676 / -14.3% 465364544 / 424206320 / +9.7% 0.46 / 0.58 / -21.9%
tpch_q13/datafusion:vortex-file-compressed 133815356 / 135457122 / -1.2% 350352487 / 327371805 / +7.0% 0.38 / 0.41 / -7.7%
tpch_q14/datafusion:vortex-file-compressed 179329272 / 168918289 / +6.2% 333863225 / 339885825 / -1.8% 0.54 / 0.50 / +8.1%
tpch_q15/datafusion:vortex-file-compressed 308004747 / 313396373 / -1.7% 612043864 / 671975736 / -8.9% 0.50 / 0.47 / +7.9%
tpch_q16/datafusion:vortex-file-compressed 131532767 / 154269699 / -14.7% 274651816 / 342273739 / -19.8% 0.48 / 0.45 / +6.3%
tpch_q17/datafusion:vortex-file-compressed 313211280 / 235285287 / +33.1% 🔴 658191142 / 448085308 / +46.9% 🔴 0.48 / 0.53 / -9.4%
tpch_q18/datafusion:vortex-file-compressed 387422960 / 577341508 / -32.9% 🟢 382930368 / 832055263 / -54.0% 🟢 1.01 / 0.69 / +45.8%
tpch_q19/datafusion:vortex-file-compressed 250110890 / 276418853 / -9.5% 402151016 / 444435959 / -9.5% 0.62 / 0.62 / -0.0%
tpch_q20/datafusion:vortex-file-compressed 297471554 / 306719206 / -3.0% 476186062 / 675470284 / -29.5% 0.62 / 0.45 / +37.6%
tpch_q21/datafusion:vortex-file-compressed 602728006 / 599463599 / +0.5% 833745569 / 958500706 / -13.0% 0.72 / 0.63 / +15.6%
tpch_q22/datafusion:vortex-file-compressed 186818185 / 415277462 / -55.0% 🟢 427820785 / 1050283869 / -59.3% 🟢 0.44 / 0.40 / +10.4%
datafusion / parquet / ns (0.981x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 145609892 / 241682856 / -39.8% 🟢 574871329 / 487531007 / +17.9% 0.25 / 0.50 / -48.9%
tpch_q02/datafusion:parquet 275695507 / 269956217 / +2.1% 459266054 / 609423406 / -24.6% 0.60 / 0.44 / +35.5%
tpch_q03/datafusion:parquet 234265412 / 251068913 / -6.7% 748252609 / 663935581 / +12.7% 0.31 / 0.38 / -17.2%
tpch_q04/datafusion:parquet 142898512 / 144199922 / -0.9% 290615204 / 450930959 / -35.6% 🟢 0.49 / 0.32 / +53.8%
tpch_q05/datafusion:parquet 403200059 / 355148108 / +13.5% 517435077 / 521470490 / -0.8% 0.78 / 0.68 / +14.4%
tpch_q06/datafusion:parquet 114045729 / 123561347 / -7.7% 219120326 / 220313766 / -0.5% 0.52 / 0.56 / -7.2%
tpch_q07/datafusion:parquet 329283008 / 374411551 / -12.1% 511606131 / 517618666 / -1.2% 0.64 / 0.72 / -11.0%
tpch_q08/datafusion:parquet 403350655 / 425276503 / -5.2% 533437846 / 533330822 / +0.0% 0.76 / 0.80 / -5.2%
tpch_q09/datafusion:parquet 400838386 / 396498657 / +1.1% 525548753 / 623882092 / -15.8% 0.76 / 0.64 / +20.0%
tpch_q10/datafusion:parquet 330597647 / 311949145 / +6.0% 463350129 / 452955570 / +2.3% 0.71 / 0.69 / +3.6%
tpch_q11/datafusion:parquet 263462176 / 247927590 / +6.3% 380239996 / 351353202 / +8.2% 0.69 / 0.71 / -1.8%
tpch_q12/datafusion:parquet 185659104 / 165576091 / +12.1% 371192382 / 290563979 / +27.7% 0.50 / 0.57 / -12.2%
tpch_q13/datafusion:parquet 274415929 / 278650002 / -1.5% 440080910 / 475941381 / -7.5% 0.62 / 0.59 / +6.5%
tpch_q14/datafusion:parquet 170305887 / 215575299 / -21.0% 272633172 / 465756460 / -41.5% 🟢 0.62 / 0.46 / +35.0%
tpch_q15/datafusion:parquet 369363790 / 314097726 / +17.6% 526764256 / 437056563 / +20.5% 0.70 / 0.72 / -2.4%
tpch_q16/datafusion:parquet 102712261 / 102227252 / +0.5% 246210164 / 196549578 / +25.3% 0.42 / 0.52 / -19.8%
tpch_q17/datafusion:parquet 282466473 / 295249476 / -4.3% 403887507 / 424664867 / -4.9% 0.70 / 0.70 / +0.6%
tpch_q18/datafusion:parquet 320653108 / 315661264 / +1.6% 524519501 / 534625462 / -1.9% 0.61 / 0.59 / +3.5%
tpch_q19/datafusion:parquet 177023709 / 160275591 / +10.4% 300096211 / 288539952 / +4.0% 0.59 / 0.56 / +6.2%
tpch_q20/datafusion:parquet 237101862 / 259105255 / -8.5% 388980313 / 375574076 / +3.6% 0.61 / 0.69 / -11.6%
tpch_q21/datafusion:parquet 368901676 / 328233636 / +12.4% 819726867 / 595891416 / +37.6% 🔴 0.45 / 0.55 / -18.3%
tpch_q22/datafusion:parquet 153531064 / 151945497 / +1.0% 344774042 / 336477683 / +2.5% 0.45 / 0.45 / -1.4%
duckdb / vortex-file-compressed / ns (1.083x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 256408140 / 242713738 / +5.6% 332980266 / 290906301 / +14.5% 0.77 / 0.83 / -7.7%
tpch_q02/duckdb:vortex-file-compressed 444210736 / 395133430 / +12.4% 476543072 / 503306863 / -5.3% 0.93 / 0.79 / +18.7%
tpch_q03/duckdb:vortex-file-compressed 593376116 / 403958513 / +46.9% 🔴 493678150 / 506631264 / -2.6% 1.20 / 0.80 / +50.7%
tpch_q04/duckdb:vortex-file-compressed 395346660 / 275371920 / +43.6% 🔴 349041969 / 264656780 / +31.9% 🔴 1.13 / 1.04 / +8.9%
tpch_q05/duckdb:vortex-file-compressed 576790323 / 554927492 / +3.9% 637252911 / 635027040 / +0.4% 0.91 / 0.87 / +3.6%
tpch_q06/duckdb:vortex-file-compressed 356655999 / 264305141 / +34.9% 🔴 373192093 / 217836159 / +71.3% 🔴 0.96 / 1.21 / -21.2%
tpch_q07/duckdb:vortex-file-compressed 433042336 / 470551583 / -8.0% 630942533 / 591002499 / +6.8% 0.69 / 0.80 / -13.8%
tpch_q08/duckdb:vortex-file-compressed 643826650 / 677708070 / -5.0% 710885533 / 790424730 / -10.1% 0.91 / 0.86 / +5.6%
tpch_q09/duckdb:vortex-file-compressed 407806521 / 414257896 / -1.6% 455142722 / 421773998 / +7.9% 0.90 / 0.98 / -8.8%
tpch_q10/duckdb:vortex-file-compressed 527043456 / 565809056 / -6.9% 541148418 / 532322473 / +1.7% 0.97 / 1.06 / -8.4%
tpch_q11/duckdb:vortex-file-compressed 299981414 / 331444316 / -9.5% 310054481 / 326000481 / -4.9% 0.97 / 1.02 / -4.8%
tpch_q12/duckdb:vortex-file-compressed 264486959 / 300240325 / -11.9% 349293630 / 293824998 / +18.9% 0.76 / 1.02 / -25.9%
tpch_q13/duckdb:vortex-file-compressed 248119347 / 234634397 / +5.7% 296559478 / 285599348 / +3.8% 0.84 / 0.82 / +1.8%
tpch_q14/duckdb:vortex-file-compressed 277333511 / 226387254 / +22.5% 522424700 / 250340989 / +108.7% 🔴 0.53 / 0.90 / -41.3%
tpch_q15/duckdb:vortex-file-compressed 265283709 / 244667904 / +8.4% 281119591 / 274125844 / +2.6% 0.94 / 0.89 / +5.7%
tpch_q16/duckdb:vortex-file-compressed 199049578 / 207480636 / -4.1% 260285720 / 212283893 / +22.6% 0.76 / 0.98 / -21.8%
tpch_q17/duckdb:vortex-file-compressed 383979944 / 304429247 / +26.1% 404119907 / 400945885 / +0.8% 0.95 / 0.76 / +25.1%
tpch_q18/duckdb:vortex-file-compressed 372122533 / 442479898 / -15.9% 529372545 / 396598793 / +33.5% 🔴 0.70 / 1.12 / -37.0%
tpch_q19/duckdb:vortex-file-compressed 289913979 / 347257411 / -16.5% 319761285 / 333079622 / -4.0% 0.91 / 1.04 / -13.0%
tpch_q20/duckdb:vortex-file-compressed 510008110 / 356522154 / +43.1% 🔴 465354713 / 525593522 / -11.5% 1.10 / 0.68 / +61.6%
tpch_q21/duckdb:vortex-file-compressed 835351297 / 669563383 / +24.8% 888165494 / 768477162 / +15.6% 0.94 / 0.87 / +7.9%
tpch_q22/duckdb:vortex-file-compressed 351563601 / 288118977 / +22.0% 322483647 / 321455013 / +0.3% 1.09 / 0.90 / +21.6%
duckdb / parquet / ns (1.038x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 185412742 / 157928349 / +17.4% 236356110 / 272690714 / -13.3% 0.78 / 0.58 / +35.5%
tpch_q02/duckdb:parquet 496785349 / 466918592 / +6.4% 454571098 / 471472543 / -3.6% 1.09 / 0.99 / +10.4%
tpch_q03/duckdb:parquet 333223390 / 467561365 / -28.7% 396520031 / 447868293 / -11.5% 0.84 / 1.04 / -19.5%
tpch_q04/duckdb:parquet 344459770 / 241132863 / +42.9% 🔴 478216816 / 346699496 / +37.9% 🔴 0.72 / 0.70 / +3.6%
tpch_q05/duckdb:parquet 608812049 / 601681209 / +1.2% 687889804 / 642800358 / +7.0% 0.89 / 0.94 / -5.4%
tpch_q06/duckdb:parquet 205998800 / 157205162 / +31.0% 🔴 204649527 / 194250011 / +5.4% 1.01 / 0.81 / +24.4%
tpch_q07/duckdb:parquet 445361965 / 483254002 / -7.8% 629568570 / 1107993230 / -43.2% 🟢 0.71 / 0.44 / +62.2%
tpch_q08/duckdb:parquet 637130518 / 654285856 / -2.6% 758659478 / 669007016 / +13.4% 0.84 / 0.98 / -14.1%
tpch_q09/duckdb:parquet 569887228 / 644494164 / -11.6% 779437418 / 718771676 / +8.4% 0.73 / 0.90 / -18.5%
tpch_q10/duckdb:parquet 578316844 / 530902132 / +8.9% 651464059 / 637249426 / +2.2% 0.89 / 0.83 / +6.6%
tpch_q11/duckdb:parquet 328801230 / 303673870 / +8.3% 340349899 / 325318246 / +4.6% 0.97 / 0.93 / +3.5%
tpch_q12/duckdb:parquet 264608631 / 215585071 / +22.7% 326778788 / 266896912 / +22.4% 0.81 / 0.81 / +0.2%
tpch_q13/duckdb:parquet 397523966 / 358775974 / +10.8% 460867421 / 449605311 / +2.5% 0.86 / 0.80 / +8.1%
tpch_q14/duckdb:parquet 370340303 / 328300491 / +12.8% 724776692 / 540192412 / +34.2% 🔴 0.51 / 0.61 / -15.9%
tpch_q15/duckdb:parquet 221742995 / 193853728 / +14.4% 296385888 / 275208554 / +7.7% 0.75 / 0.70 / +6.2%
tpch_q16/duckdb:parquet 276861827 / 265133880 / +4.4% 256552276 / 323161613 / -20.6% 1.08 / 0.82 / +31.5%
tpch_q17/duckdb:parquet 283027830 / 350853382 / -19.3% 370158813 / 381556280 / -3.0% 0.76 / 0.92 / -16.8%
tpch_q18/duckdb:parquet 550549969 / 345691529 / +59.3% 🔴 688058283 / 368650896 / +86.6% 🔴 0.80 / 0.94 / -14.7%
tpch_q19/duckdb:parquet 236965399 / 299979187 / -21.0% 272434029 / 345698365 / -21.2% 0.87 / 0.87 / +0.2%
tpch_q20/duckdb:parquet 445986364 / 506822076 / -12.0% 511550924 / 594115221 / -13.9% 0.87 / 0.85 / +2.2%
tpch_q21/duckdb:parquet 455300080 / 478529087 / -4.9% 613844885 / 523115452 / +17.3% 0.74 / 0.91 / -18.9%
tpch_q22/duckdb:parquet 327516097 / 351512104 / -6.8% 342869199 / 431678340 / -20.6% 0.96 / 0.81 / +17.3%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR b423d204 vs base 19dcd2f2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.024x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.033x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 89380484 / 89255051 / +0.1% 153074620 / 151798817 / +0.8% 0.58 / 0.59 / -0.7%
tpch_q02/datafusion:vortex-file-compressed 65156493 / 65015788 / +0.2% 95636491 / 94942848 / +0.7% 0.68 / 0.68 / -0.5%
tpch_q03/datafusion:vortex-file-compressed 63200789 / 63658261 / -0.7% 115390632 / 111980694 / +3.0% 0.55 / 0.57 / -3.7%
tpch_q04/datafusion:vortex-file-compressed 34323541 / 34921471 / -1.7% 73754814 / 74731673 / -1.3% 0.47 / 0.47 / -0.4%
tpch_q05/datafusion:vortex-file-compressed 118376732 / 118970563 / -0.5% 175819438 / 186045364 / -5.5% 0.67 / 0.64 / +5.3%
tpch_q06/datafusion:vortex-file-compressed 10720107 / 10394960 / +3.1% 57258029 / 58729342 / -2.5% 0.19 / 0.18 / +5.8%
tpch_q07/datafusion:vortex-file-compressed 133821391 / 131980165 / +1.4% 194539161 / 199639612 / -2.6% 0.69 / 0.66 / +4.1%
tpch_q08/datafusion:vortex-file-compressed 144153471 / 142366362 / +1.3% 197864182 / 219277583 / -9.8% 0.73 / 0.65 / +12.2%
tpch_q09/datafusion:vortex-file-compressed 185057144 / 187171657 / -1.1% 262923829 / 257992349 / +1.9% 0.70 / 0.73 / -3.0%
tpch_q10/datafusion:vortex-file-compressed 70144280 / 70744077 / -0.8% 136121318 / 137653868 / -1.1% 0.52 / 0.51 / +0.3%
tpch_q11/datafusion:vortex-file-compressed 42905930 / 43769055 / -2.0% 65356498 / 70094330 / -6.8% 0.66 / 0.62 / +5.1%
tpch_q12/datafusion:vortex-file-compressed 34536232 / 35277279 / -2.1% 80289693 / 79113006 / +1.5% 0.43 / 0.45 / -3.5%
tpch_q13/datafusion:vortex-file-compressed 46480730 / 48858778 / -4.9% 83606277 / 83565410 / +0.0% 0.56 / 0.58 / -4.9%
tpch_q14/datafusion:vortex-file-compressed 21118615 / 21868695 / -3.4% 89108010 / 86598582 / +2.9% 0.24 / 0.25 / -6.1%
tpch_q15/datafusion:vortex-file-compressed 34087648 / 33975185 / +0.3% 91279254 / 92668034 / -1.5% 0.37 / 0.37 / +1.9%
tpch_q16/datafusion:vortex-file-compressed 37013847 / 37287766 / -0.7% 66955352 / 67877977 / -1.4% 0.55 / 0.55 / +0.6%
tpch_q17/datafusion:vortex-file-compressed 175327914 / 175172740 / +0.1% 243007477 / 220666595 / +10.1% 🔴 0.72 / 0.79 / -9.1%
tpch_q18/datafusion:vortex-file-compressed 205758989 / 206146884 / -0.2% 279918664 / 273649921 / +2.3% 0.74 / 0.75 / -2.4%
tpch_q19/datafusion:vortex-file-compressed 30519165 / 30422100 / +0.3% 89465170 / 92046105 / -2.8% 0.34 / 0.33 / +3.2%
tpch_q20/datafusion:vortex-file-compressed 60440491 / 61082053 / -1.1% 120964817 / 118547042 / +2.0% 0.50 / 0.52 / -3.0%
tpch_q21/datafusion:vortex-file-compressed 180050648 / 178607107 / +0.8% 239074024 / 241924423 / -1.2% 0.75 / 0.74 / +2.0%
tpch_q22/datafusion:vortex-file-compressed 25294825 / 24864567 / +1.7% 53436255 / 53580925 / -0.3% 0.47 / 0.46 / +2.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87719636 / 87368696 / +0.4% 129198778 / 127861995 / +1.0% 0.68 / 0.68 / -0.6%
tpch_q02/datafusion:parquet 175811931 / 174083826 / +1.0% 199276111 / 198946077 / +0.2% 0.88 / 0.88 / +0.8%
tpch_q03/datafusion:parquet 138002209 / 137844778 / +0.1% 187877958 / 183410886 / +2.4% 0.73 / 0.75 / -2.3%
tpch_q04/datafusion:parquet 58445650 / 58571544 / -0.2% 94079685 / 92920319 / +1.2% 0.62 / 0.63 / -1.4%
tpch_q05/datafusion:parquet 169573624 / 169683774 / -0.1% 226534602 / 224735109 / +0.8% 0.75 / 0.76 / -0.9%
tpch_q06/datafusion:parquet 37142950 / 37122976 / +0.1% 80726508 / 74947577 / +7.7% 0.46 / 0.50 / -7.1%
tpch_q07/datafusion:parquet 217366130 / 219518387 / -1.0% 276865543 / 275445618 / +0.5% 0.79 / 0.80 / -1.5%
tpch_q08/datafusion:parquet 221374843 / 222240942 / -0.4% 294793051 / 291393698 / +1.2% 0.75 / 0.76 / -1.5%
tpch_q09/datafusion:parquet 315491232 / 315267250 / +0.1% 388172002 / 378803120 / +2.5% 0.81 / 0.83 / -2.3%
tpch_q10/datafusion:parquet 321819063 / 321445702 / +0.1% 384709273 / 378830252 / +1.6% 0.84 / 0.85 / -1.4%
tpch_q11/datafusion:parquet 126671441 / 126573780 / +0.1% 150938116 / 151706161 / -0.5% 0.84 / 0.83 / +0.6%
tpch_q12/datafusion:parquet 84515559 / 84151856 / +0.4% 126392964 / 119202767 / +6.0% 0.67 / 0.71 / -5.3%
tpch_q13/datafusion:parquet 216584032 / 216495289 / +0.0% 246942589 / 244560647 / +1.0% 0.88 / 0.89 / -0.9%
tpch_q14/datafusion:parquet 89273721 / 88496640 / +0.9% 190456140 / 201728581 / -5.6% 0.47 / 0.44 / +6.8%
tpch_q15/datafusion:parquet 106057926 / 106076789 / -0.0% 156828203 / 155328519 / +1.0% 0.68 / 0.68 / -1.0%
tpch_q16/datafusion:parquet 98013546 / 95964632 / +2.1% 122441689 / 120010701 / +2.0% 0.80 / 0.80 / +0.1%
tpch_q17/datafusion:parquet 212029863 / 213016847 / -0.5% 263788280 / 258511536 / +2.0% 0.80 / 0.82 / -2.5%
tpch_q18/datafusion:parquet 269658356 / 271451611 / -0.7% 314819070 / 314651552 / +0.1% 0.86 / 0.86 / -0.7%
tpch_q19/datafusion:parquet 108798424 / 108017781 / +0.7% 173381319 / 169517847 / +2.3% 0.63 / 0.64 / -1.5%
tpch_q20/datafusion:parquet 188904132 / 190210191 / -0.7% 271352462 / 240188488 / +13.0% 🔴 0.70 / 0.79 / -12.1%
tpch_q21/datafusion:parquet 245803432 / 244828138 / +0.4% 313329602 / 308775289 / +1.5% 0.78 / 0.79 / -1.1%
tpch_q22/datafusion:parquet 153410956 / 153559494 / -0.1% 180110571 / 178194678 / +1.1% 0.85 / 0.86 / -1.2%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32590331 / 34628583 / -5.9% 71734151 / 63148371 / +13.6% 🔴 0.45 / 0.55 / -17.2%
tpch_q02/duckdb:vortex-file-compressed 28030336 / 28265284 / -0.8% 42682294 / 42869080 / -0.4% 0.66 / 0.66 / -0.4%
tpch_q03/duckdb:vortex-file-compressed 52610502 / 52134304 / +0.9% 107681473 / 97373188 / +10.6% 🔴 0.49 / 0.54 / -8.7%
tpch_q04/duckdb:vortex-file-compressed 51327152 / 50388682 / +1.9% 88881779 / 82805613 / +7.3% 0.58 / 0.61 / -5.1%
tpch_q05/duckdb:vortex-file-compressed 69288732 / 69552039 / -0.4% 112473797 / 105896848 / +6.2% 0.62 / 0.66 / -6.2%
tpch_q06/duckdb:vortex-file-compressed 15499701 / 15655028 / -1.0% 52334468 / 49233880 / +6.3% 0.30 / 0.32 / -6.9%
tpch_q07/duckdb:vortex-file-compressed 55272721 / 55924649 / -1.2% 111526502 / 102703022 / +8.6% 0.50 / 0.54 / -9.0%
tpch_q08/duckdb:vortex-file-compressed 86780253 / 87648586 / -1.0% 133214486 / 128820535 / +3.4% 0.65 / 0.68 / -4.3%
tpch_q09/duckdb:vortex-file-compressed 103088880 / 101895414 / +1.2% 157623507 / 153843362 / +2.5% 0.65 / 0.66 / -1.3%
tpch_q10/duckdb:vortex-file-compressed 95083575 / 95578746 / -0.5% 148740020 / 138864358 / +7.1% 0.64 / 0.69 / -7.1%
tpch_q11/duckdb:vortex-file-compressed 13365156 / 13359125 / +0.0% 29907159 / 29133955 / +2.7% 0.45 / 0.46 / -2.5%
tpch_q12/duckdb:vortex-file-compressed 44861462 / 44778474 / +0.2% 84598510 / 80033923 / +5.7% 0.53 / 0.56 / -5.2%
tpch_q13/duckdb:vortex-file-compressed 72540401 / 73185545 / -0.9% 103124556 / 95541761 / +7.9% 0.70 / 0.77 / -8.2%
tpch_q14/duckdb:vortex-file-compressed 28646205 / 28694401 / -0.2% 73555185 / 69184778 / +6.3% 0.39 / 0.41 / -6.1%
tpch_q15/duckdb:vortex-file-compressed 25101005 / 24917046 / +0.7% 63943111 / 61375732 / +4.2% 0.39 / 0.41 / -3.3%
tpch_q16/duckdb:vortex-file-compressed 48123444 / 47849508 / +0.6% 60262791 / 58544628 / +2.9% 0.80 / 0.82 / -2.3%
tpch_q17/duckdb:vortex-file-compressed 34851988 / 35386705 / -1.5% 69026213 / 65592778 / +5.2% 0.50 / 0.54 / -6.4%
tpch_q18/duckdb:vortex-file-compressed 103669758 / 105387928 / -1.6% 123776412 / 120554783 / +2.7% 0.84 / 0.87 / -4.2%
tpch_q19/duckdb:vortex-file-compressed 27965600 / 27879632 / +0.3% 78664425 / 72375475 / +8.7% 0.36 / 0.39 / -7.7%
tpch_q20/duckdb:vortex-file-compressed 42316391 / 41873332 / +1.1% 93068848 / 89530338 / +4.0% 0.45 / 0.47 / -2.8%
tpch_q21/duckdb:vortex-file-compressed 93109827 / 96352501 / -3.4% 148913105 / 143914571 / +3.5% 0.63 / 0.67 / -6.6%
tpch_q22/duckdb:vortex-file-compressed 33061224 / 32234491 / +2.6% 49808862 / 48211625 / +3.3% 0.66 / 0.67 / -0.7%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68866807 / 68884852 / -0.0% 101084442 / 90032929 / +12.3% 🔴 0.68 / 0.77 / -11.0%
tpch_q02/duckdb:parquet 87668544 / 87634295 / +0.0% 97859772 / 98800141 / -1.0% 0.90 / 0.89 / +1.0%
tpch_q03/duckdb:parquet 111798347 / 111393685 / +0.4% 149262754 / 143939319 / +3.7% 0.75 / 0.77 / -3.2%
tpch_q04/duckdb:parquet 77702149 / 78761710 / -1.3% 106038586 / 96907681 / +9.4% 0.73 / 0.81 / -9.8%
tpch_q05/duckdb:parquet 123114595 / 125473048 / -1.9% 162982606 / 157708809 / +3.3% 0.76 / 0.80 / -5.1%
tpch_q06/duckdb:parquet 35850732 / 36143926 / -0.8% 68425211 / 57665594 / +18.7% 🔴 0.52 / 0.63 / -16.4%
tpch_q07/duckdb:parquet 118958485 / 117157091 / +1.5% 158284790 / 155070011 / +2.1% 0.75 / 0.76 / -0.5%
tpch_q08/duckdb:parquet 147757387 / 149051786 / -0.9% 203875462 / 190406433 / +7.1% 0.72 / 0.78 / -7.4%
tpch_q09/duckdb:parquet 239854921 / 241388962 / -0.6% 289602102 / 284144788 / +1.9% 0.83 / 0.85 / -2.5%
tpch_q10/duckdb:parquet 314932726 / 316818482 / -0.6% 348262177 / 340358055 / +2.3% 0.90 / 0.93 / -2.9%
tpch_q11/duckdb:parquet 44026210 / 44058957 / -0.1% 50969828 / 51642228 / -1.3% 0.86 / 0.85 / +1.2%
tpch_q12/duckdb:parquet 72814848 / 72613282 / +0.3% 96324880 / 92369855 / +4.3% 0.76 / 0.79 / -3.8%
tpch_q13/duckdb:parquet 294083735 / 295602456 / -0.5% 310068660 / 311037836 / -0.3% 0.95 / 0.95 / -0.2%
tpch_q14/duckdb:parquet 102059568 / 102641437 / -0.6% 152487666 / 137537356 / +10.9% 🔴 0.67 / 0.75 / -10.3%
tpch_q15/duckdb:parquet 57835900 / 58562796 / -1.2% 88391517 / 87341612 / +1.2% 0.65 / 0.67 / -2.4%
tpch_q16/duckdb:parquet 101495241 / 101516941 / -0.0% 108885651 / 107924096 / +0.9% 0.93 / 0.94 / -0.9%
tpch_q17/duckdb:parquet 83346165 / 82982497 / +0.4% 122161807 / 116477291 / +4.9% 0.68 / 0.71 / -4.2%
tpch_q18/duckdb:parquet 157665943 / 162781413 / -3.1% 180315027 / 176107872 / +2.4% 0.87 / 0.92 / -5.4%
tpch_q19/duckdb:parquet 98882591 / 100644327 / -1.8% 149212980 / 129160526 / +15.5% 🔴 0.66 / 0.78 / -15.0%
tpch_q20/duckdb:parquet 147785546 / 147762874 / +0.0% 196645683 / 181776837 / +8.2% 0.75 / 0.81 / -7.5%
tpch_q21/duckdb:parquet 252630891 / 256842317 / -1.6% 275641153 / 275377695 / +0.1% 0.92 / 0.93 / -1.7%
tpch_q22/duckdb:parquet 169656385 / 169184411 / +0.3% 184813096 / 183870885 / +0.5% 0.92 / 0.92 / -0.2%

Copy link
Copy Markdown
Contributor Author

Closing: this benchmark-only isolation PR is part of #11060. On the combined branch ji/charming-cray-28l167, DuckDB V2 parts are sized by #10964's chunk budgets instead of ChunkPlanner::single, so this change is not carried forward.


Generated by Claude Code

@robert3005
robert3005 deleted the ji/v2-isolate-single-chunk branch November 10, 2026 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant