Skip to content

fix: Convert V2 scan batches to Arrow on the driver's tasks - #10861

Merged
joseph-isaacs merged 2 commits into
developfrom
ji/epic-ride-kqmige
Oct 27, 2026
Merged

joseph-isaacs merged 2 commits into
developfrom
ji/epic-ride-kqmige

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Fixes the decompress benchmark regression from #10708. That PR moved compress-bench onto ScanDriver::run, which yields lazy ArrayRefs, and the benchmark then executed each batch to Arrow on the single task polling the stream. Executing to Arrow is where the batches are decompressed, so decompression became serial. The V2 into_record_batch_stream it replaced converted each batch on the chunk task that produced it.

This is a temporary fix, that will be improved on later..

#10708 moved the decompress benchmark onto `ScanDriver`, which yields
lazy `ArrayRef`s, and the benchmark then executed each one to Arrow on
the single task polling the stream. Execution to Arrow is where the
batches are decompressed, so decompression became serial, where the
V2 `into_record_batch_stream` it replaced converted each batch on the
chunk task that produced it.

`ScanDriver::run_record_batches(builder, schema)` makes the driver the
one place that maps batches: the caller names the Arrow schema it wants
(or `None` to derive it from the scan's dtype) and the driver executes
each batch to it on the producing task, in parallel across chunks. The
decompress benchmark uses it.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBC5bWEJrRAdTA8Z5Bz
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-compress Run only the compression benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 27, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-compress Run only the compression benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 27, 2026
The CUDA decompress path in `gpu/vortex.rs` still uses it, which only
builds with the `cuda` feature, so dropping it broke the all-features
build.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBC5bWEJrRAdTA8Z5Bz
@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ada0b66 compress-bench 1 Explore Profiling Data
Previous Runs (8)
Status Commit Job Attempt Link
🟢 Done 26f9ea1 compress-bench 1 Explore Profiling Data
🟢 Done 26f9ea1 clickbench-nvme 1 Explore Profiling Data
🟢 Done 26f9ea1 polarsignals 1 Explore Profiling Data
🟢 Done 26f9ea1 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 26f9ea1 tpch-s3 1 Explore Profiling Data
🟢 Done 26f9ea1 fineweb 1 Explore Profiling Data
🟢 Done 26f9ea1 tpch-nvme 1 Explore Profiling Data
🟢 Done 26f9ea1 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 26f9ea13 vs base 18c2340b
Vortex (geomean): hot 0.999x ➖ · cold 1.134x ❌


datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45081942 / 44425514 / +1.5% 91976456 / 82314898 / +11.7% 🔴 0.49 / 0.54 / -9.2%
polarsignals_q01/datafusion:vortex-file-compressed 50908818 / 51037520 / -0.3% 114375527 / 105775338 / +8.1% 0.45 / 0.48 / -7.8%
polarsignals_q02/datafusion:vortex-file-compressed 43421200 / 43727755 / -0.7% 90451849 / 81919254 / +10.4% 🔴 0.48 / 0.53 / -10.1%
polarsignals_q03/datafusion:vortex-file-compressed 53244456 / 54947764 / -3.1% 118290531 / 107754334 / +9.8% 0.45 / 0.51 / -11.7%
polarsignals_q04/datafusion:vortex-file-compressed 9225533 / 9346274 / -1.3% 47725285 / 41728840 / +14.4% 🔴 0.19 / 0.22 / -13.7%
polarsignals_q05/datafusion:vortex-file-compressed 11778911 / 11789708 / -0.1% 53358865 / 43634695 / +22.3% 🔴 0.22 / 0.27 / -18.3%
polarsignals_q06/datafusion:vortex-file-compressed 23295892 / 23185150 / +0.5% 63014777 / 54841922 / +14.9% 🔴 0.37 / 0.42 / -12.6%
polarsignals_q07/datafusion:vortex-file-compressed 11120352 / 11154074 / -0.3% 50730721 / 41684451 / +21.7% 🔴 0.22 / 0.27 / -18.1%
polarsignals_q08/datafusion:vortex-file-compressed 97606970 / 98136501 / -0.5% 159042574 / 154379265 / +3.0% 0.61 / 0.64 / -3.5%
polarsignals_q09/datafusion:vortex-file-compressed 10287378 / 9989954 / +3.0% 47378345 / 39845263 / +18.9% 🔴 0.22 / 0.25 / -13.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 26f9ea13 vs base 18c2340b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (+1.3%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): hot 1.010x ➖ · cold 0.957x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.014x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6780796 / 6735802 / +0.7% 16928464 / 17731404 / -4.5% 0.40 / 0.38 / +5.4%
fineweb_q01/datafusion:vortex-file-compressed 7712333 / 7000434 / +10.2% 🔴 45085473 / 46245316 / -2.5% 0.17 / 0.15 / +13.0%
fineweb_q02/datafusion:vortex-file-compressed 9796838 / 9745711 / +0.5% 48275901 / 52524529 / -8.1% 0.20 / 0.19 / +9.4%
fineweb_q03/datafusion:vortex-file-compressed 20172544 / 20513178 / -1.7% 111687562 / 113122042 / -1.3% 0.18 / 0.18 / -0.4%
fineweb_q04/datafusion:vortex-file-compressed 66458710 / 67057387 / -0.9% 150718722 / 158146218 / -4.7% 0.44 / 0.42 / +4.0%
fineweb_q05/datafusion:vortex-file-compressed 67261517 / 67083692 / +0.3% 152037753 / 159526182 / -4.7% 0.44 / 0.42 / +5.2%
fineweb_q06/datafusion:vortex-file-compressed 18858955 / 19774663 / -4.6% 111310714 / 115352296 / -3.5% 0.17 / 0.17 / -1.2%
fineweb_q07/datafusion:vortex-file-compressed 17558880 / 18789636 / -6.6% 110753894 / 116755119 / -5.1% 0.16 / 0.16 / -1.5%
fineweb_q08/datafusion:vortex-file-compressed 10338456 / 8865928 / +16.6% 🔴 47596513 / 47005031 / +1.3% 0.22 / 0.19 / +15.2%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9503680 / 9239380 / +2.9% 29781951 / 31966762 / -6.8% 0.32 / 0.29 / +10.4%
fineweb_q01/datafusion:parquet 75253494 / 75573902 / -0.4% 156859117 / 163748884 / -4.2% 0.48 / 0.46 / +3.9%
fineweb_q02/datafusion:parquet 75787310 / 75539364 / +0.3% 155856113 / 159057249 / -2.0% 0.49 / 0.47 / +2.4%
fineweb_q03/datafusion:parquet 73477850 / 74986772 / -2.0% 156797445 / 170232905 / -7.9% 0.47 / 0.44 / +6.4%
fineweb_q04/datafusion:parquet 82302252 / 81972116 / +0.4% 158012059 / 159873597 / -1.2% 0.52 / 0.51 / +1.6%
fineweb_q05/datafusion:parquet 79538346 / 79780005 / -0.3% 154103293 / 161824806 / -4.8% 0.52 / 0.49 / +4.7%
fineweb_q06/datafusion:parquet 77248172 / 77037104 / +0.3% 161059678 / 161434190 / -0.2% 0.48 / 0.48 / +0.5%
fineweb_q07/datafusion:parquet 74609170 / 74930312 / -0.4% 159217179 / 150806387 / +5.6% 0.47 / 0.50 / -5.7%
fineweb_q08/datafusion:parquet 73772776 / 73824026 / -0.1% 156350633 / 154398677 / +1.3% 0.47 / 0.48 / -1.3%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2027986 / 2036970 / -0.4% 7203239 / 7103143 / +1.4% 0.28 / 0.29 / -1.8%
fineweb_q01/duckdb:vortex-file-compressed 9762676 / 9459021 / +3.2% 35731157 / 40007027 / -10.7% 🟢 0.27 / 0.24 / +15.6%
fineweb_q02/duckdb:vortex-file-compressed 10498590 / 10351848 / +1.4% 34926179 / 40766821 / -14.3% 🟢 0.30 / 0.25 / +18.4%
fineweb_q03/duckdb:vortex-file-compressed 18724582 / 19157858 / -2.3% 103626943 / 111438244 / -7.0% 0.18 / 0.17 / +5.1%
fineweb_q04/duckdb:vortex-file-compressed 66341731 / 66334694 / +0.0% 119757401 / 119216474 / +0.5% 0.55 / 0.56 / -0.4%
fineweb_q05/duckdb:vortex-file-compressed 66803729 / 66888973 / -0.1% 113719596 / 119761108 / -5.0% 0.59 / 0.56 / +5.2%
fineweb_q06/duckdb:vortex-file-compressed 18823340 / 19176627 / -1.8% 101522568 / 111644360 / -9.1% 0.19 / 0.17 / +7.9%
fineweb_q07/duckdb:vortex-file-compressed 18261424 / 18020972 / +1.3% 100629659 / 101595932 / -1.0% 0.18 / 0.18 / +2.3%
fineweb_q08/duckdb:vortex-file-compressed 5376885 / 5153572 / +4.3% 14639755 / 14167245 / +3.3% 0.37 / 0.36 / +1.0%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23532280 / 23807957 / -1.2% 30444489 / 27665887 / +10.0% 🔴 0.77 / 0.86 / -10.2%
fineweb_q01/duckdb:parquet 56489957 / 56489480 / +0.0% 83308564 / 82453415 / +1.0% 0.68 / 0.69 / -1.0%
fineweb_q02/duckdb:parquet 60452326 / 60833588 / -0.6% 86031916 / 83984975 / +2.4% 0.70 / 0.72 / -3.0%
fineweb_q03/duckdb:parquet 117849548 / 120340980 / -2.1% 186257290 / 184392208 / +1.0% 0.63 / 0.65 / -3.1%
fineweb_q04/duckdb:parquet 163171838 / 162795799 / +0.2% 213614044 / 220086426 / -2.9% 0.76 / 0.74 / +3.3%
fineweb_q05/duckdb:parquet 158381132 / 159987474 / -1.0% 216550889 / 210815004 / +2.7% 0.73 / 0.76 / -3.6%
fineweb_q06/duckdb:parquet 87979643 / 88808838 / -0.9% 155693616 / 160807312 / -3.2% 0.57 / 0.55 / +2.3%
fineweb_q07/duckdb:parquet 91162830 / 92007740 / -0.9% 151515741 / 152773315 / -0.8% 0.60 / 0.60 / -0.1%
fineweb_q08/duckdb:parquet 29327516 / 29419851 / -0.3% 33156732 / 31094699 / +6.6% 0.88 / 0.95 / -6.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 26f9ea13 vs base 18c2340b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (-1.1%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.000x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 17366453 / 17411638 / -0.3% 45121688 / 41089620 / +9.8% 0.38 / 0.42 / -9.2%
tpch_q02/datafusion:vortex-file-compressed 18054106 / 18171065 / -0.6% 34625191 / 35499883 / -2.5% 0.52 / 0.51 / +1.9%
tpch_q03/datafusion:vortex-file-compressed 21845773 / 22154537 / -1.4% 47776078 / 48220621 / -0.9% 0.46 / 0.46 / -0.5%
tpch_q04/datafusion:vortex-file-compressed 13666358 / 13004095 / +5.1% 33278878 / 34772228 / -4.3% 0.41 / 0.37 / +9.8%
tpch_q05/datafusion:vortex-file-compressed 39694332 / 39275569 / +1.1% 67841236 / 69187491 / -1.9% 0.59 / 0.57 / +3.1%
tpch_q06/datafusion:vortex-file-compressed 8648691 / 8592495 / +0.7% 26750813 / 27517885 / -2.8% 0.32 / 0.31 / +3.5%
tpch_q07/datafusion:vortex-file-compressed 55190323 / 55429841 / -0.4% 79515713 / 77947856 / +2.0% 0.69 / 0.71 / -2.4%
tpch_q08/datafusion:vortex-file-compressed 55153469 / 55465334 / -0.6% 80939866 / 77706446 / +4.2% 0.68 / 0.71 / -4.5%
tpch_q09/datafusion:vortex-file-compressed 49129753 / 48637523 / +1.0% 75013097 / 81637038 / -8.1% 0.65 / 0.60 / +9.9%
tpch_q10/datafusion:vortex-file-compressed 20852760 / 20897953 / -0.2% 47766978 / 48206711 / -0.9% 0.44 / 0.43 / +0.7%
tpch_q11/datafusion:vortex-file-compressed 15285752 / 15458030 / -1.1% 32298764 / 32010192 / +0.9% 0.47 / 0.48 / -2.0%
tpch_q12/datafusion:vortex-file-compressed 25460817 / 25196979 / +1.0% 42494651 / 41832084 / +1.6% 0.60 / 0.60 / -0.5%
tpch_q13/datafusion:vortex-file-compressed 20213286 / 20412112 / -1.0% 39143999 / 37664646 / +3.9% 0.52 / 0.54 / -4.7%
tpch_q14/datafusion:vortex-file-compressed 15075901 / 15313636 / -1.6% 36229717 / 37726938 / -4.0% 0.42 / 0.41 / +2.5%
tpch_q15/datafusion:vortex-file-compressed 21028847 / 21031903 / -0.0% 44715768 / 45501195 / -1.7% 0.47 / 0.46 / +1.7%
tpch_q16/datafusion:vortex-file-compressed 18675259 / 18576461 / +0.5% 40187266 / 40823824 / -1.6% 0.46 / 0.46 / +2.1%
tpch_q17/datafusion:vortex-file-compressed 30628926 / 29319749 / +4.5% 57845485 / 60115009 / -3.8% 0.53 / 0.49 / +8.6%
tpch_q18/datafusion:vortex-file-compressed 37747216 / 37731405 / +0.0% 58570245 / 57669551 / +1.6% 0.64 / 0.65 / -1.5%
tpch_q19/datafusion:vortex-file-compressed 18296303 / 17923851 / +2.1% 39721089 / 38160926 / +4.1% 0.46 / 0.47 / -1.9%
tpch_q20/datafusion:vortex-file-compressed 23145632 / 23592014 / -1.9% 45243004 / 46934334 / -3.6% 0.51 / 0.50 / +1.8%
tpch_q21/datafusion:vortex-file-compressed 44627177 / 43659490 / +2.2% 72363123 / 73290756 / -1.3% 0.62 / 0.60 / +3.5%
tpch_q22/datafusion:vortex-file-compressed 10934181 / 11061890 / -1.2% 30345740 / 29543331 / +2.7% 0.36 / 0.37 / -3.8%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71979317 / 71785005 / +0.3% 89191178 / 89296857 / -0.1% 0.81 / 0.80 / +0.4%
tpch_q02/datafusion:parquet 75665620 / 76264137 / -0.8% 94612686 / 93045268 / +1.7% 0.80 / 0.82 / -2.4%
tpch_q03/datafusion:parquet 83664730 / 83364071 / +0.4% 104450671 / 105378307 / -0.9% 0.80 / 0.79 / +1.3%
tpch_q04/datafusion:parquet 40550401 / 40732161 / -0.4% 58739777 / 60324834 / -2.6% 0.69 / 0.68 / +2.2%
tpch_q05/datafusion:parquet 112531090 / 112173953 / +0.3% 139304642 / 142373549 / -2.2% 0.81 / 0.79 / +2.5%
tpch_q06/datafusion:parquet 32046608 / 32304930 / -0.8% 50221814 / 50823740 / -1.2% 0.64 / 0.64 / +0.4%
tpch_q07/datafusion:parquet 115361612 / 115094368 / +0.2% 140352855 / 145791101 / -3.7% 0.82 / 0.79 / +4.1%
tpch_q08/datafusion:parquet 119331275 / 119919636 / -0.5% 147708461 / 149375171 / -1.1% 0.81 / 0.80 / +0.6%
tpch_q09/datafusion:parquet 139365096 / 140369134 / -0.7% 168549739 / 169050282 / -0.3% 0.83 / 0.83 / -0.4%
tpch_q10/datafusion:parquet 106071918 / 106706397 / -0.6% 129154268 / 131268013 / -1.6% 0.82 / 0.81 / +1.0%
tpch_q11/datafusion:parquet 61502448 / 61334200 / +0.3% 79141357 / 82166098 / -3.7% 0.78 / 0.75 / +4.1%
tpch_q12/datafusion:parquet 65260943 / 65503674 / -0.4% 85619898 / 85715885 / -0.1% 0.76 / 0.76 / -0.3%
tpch_q13/datafusion:parquet 147111370 / 147273360 / -0.1% 164676200 / 166350902 / -1.0% 0.89 / 0.89 / +0.9%
tpch_q14/datafusion:parquet 47963814 / 47979503 / -0.0% 70092932 / 75099923 / -6.7% 0.68 / 0.64 / +7.1%
tpch_q15/datafusion:parquet 74388885 / 74670732 / -0.4% 96919956 / 94201746 / +2.9% 0.77 / 0.79 / -3.2%
tpch_q16/datafusion:parquet 43646439 / 43873810 / -0.5% 59903748 / 59703138 / +0.3% 0.73 / 0.73 / -0.9%
tpch_q17/datafusion:parquet 124048098 / 124554593 / -0.4% 144990553 / 145553890 / -0.4% 0.86 / 0.86 / -0.0%
tpch_q18/datafusion:parquet 123819328 / 123872783 / -0.0% 144386151 / 145356292 / -0.7% 0.86 / 0.85 / +0.6%
tpch_q19/datafusion:parquet 58762687 / 58038655 / +1.2% 80560636 / 81545347 / -1.2% 0.73 / 0.71 / +2.5%
tpch_q20/datafusion:parquet 78076285 / 79465284 / -1.7% 99086227 / 102338584 / -3.2% 0.79 / 0.78 / +1.5%
tpch_q21/datafusion:parquet 115533026 / 116656332 / -1.0% 140660127 / 142738163 / -1.5% 0.82 / 0.82 / +0.5%
tpch_q22/datafusion:parquet 51204939 / 51352104 / -0.3% 66477465 / 67695085 / -1.8% 0.77 / 0.76 / +1.5%
duckdb / vortex-file-compressed / ns (0.989x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8065369 / 9085457 / -11.2% 🟢 19894620 / 19157998 / +3.8% 0.41 / 0.47 / -14.5%
tpch_q02/duckdb:vortex-file-compressed 15104194 / 15055041 / +0.3% 24073131 / 23422200 / +2.8% 0.63 / 0.64 / -2.4%
tpch_q03/duckdb:vortex-file-compressed 17903533 / 18279247 / -2.1% 32657956 / 32478746 / +0.6% 0.55 / 0.56 / -2.6%
tpch_q04/duckdb:vortex-file-compressed 11937865 / 12196264 / -2.1% 24659657 / 23836443 / +3.5% 0.48 / 0.51 / -5.4%
tpch_q05/duckdb:vortex-file-compressed 20067083 / 19966146 / +0.5% 33046274 / 32292869 / +2.3% 0.61 / 0.62 / -1.8%
tpch_q06/duckdb:vortex-file-compressed 4463815 / 4705489 / -5.1% 12995221 / 12940165 / +0.4% 0.34 / 0.36 / -5.5%
tpch_q07/duckdb:vortex-file-compressed 23536005 / 23699407 / -0.7% 38033861 / 38080989 / -0.1% 0.62 / 0.62 / -0.6%
tpch_q08/duckdb:vortex-file-compressed 21291884 / 21661990 / -1.7% 36120159 / 36735755 / -1.7% 0.59 / 0.59 / -0.0%
tpch_q09/duckdb:vortex-file-compressed 20921917 / 21601858 / -3.1% 35622260 / 37109280 / -4.0% 0.59 / 0.58 / +0.9%
tpch_q10/duckdb:vortex-file-compressed 26742623 / 26994765 / -0.9% 41368114 / 41144299 / +0.5% 0.65 / 0.66 / -1.5%
tpch_q11/duckdb:vortex-file-compressed 7971585 / 7954058 / +0.2% 14679686 / 15258322 / -3.8% 0.54 / 0.52 / +4.2%
tpch_q12/duckdb:vortex-file-compressed 13696652 / 13874128 / -1.3% 24988262 / 25100729 / -0.4% 0.55 / 0.55 / -0.8%
tpch_q13/duckdb:vortex-file-compressed 23112996 / 23161917 / -0.2% 32591910 / 31737270 / +2.7% 0.71 / 0.73 / -2.8%
tpch_q14/duckdb:vortex-file-compressed 11427799 / 11415030 / +0.1% 22113145 / 22625672 / -2.3% 0.52 / 0.50 / +2.4%
tpch_q15/duckdb:vortex-file-compressed 8320682 / 8447597 / -1.5% 18474308 / 18584864 / -0.6% 0.45 / 0.45 / -0.9%
tpch_q16/duckdb:vortex-file-compressed 16557109 / 16497097 / +0.4% 23843548 / 22791722 / +4.6% 0.69 / 0.72 / -4.1%
tpch_q17/duckdb:vortex-file-compressed 12302436 / 11978410 / +2.7% 24076110 / 24626071 / -2.2% 0.51 / 0.49 / +5.1%
tpch_q18/duckdb:vortex-file-compressed 24599517 / 24178507 / +1.7% 33645454 / 33557202 / +0.3% 0.73 / 0.72 / +1.5%
tpch_q19/duckdb:vortex-file-compressed 10353674 / 10257688 / +0.9% 21145658 / 21133808 / +0.1% 0.49 / 0.49 / +0.9%
tpch_q20/duckdb:vortex-file-compressed 13716839 / 13704812 / +0.1% 28225472 / 27876384 / +1.3% 0.49 / 0.49 / -1.2%
tpch_q21/duckdb:vortex-file-compressed 36185869 / 36893241 / -1.9% 53136376 / 52033656 / +2.1% 0.68 / 0.71 / -4.0%
tpch_q22/duckdb:vortex-file-compressed 19172090 / 18942472 / +1.2% 28124449 / 28369787 / -0.9% 0.68 / 0.67 / +2.1%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48403828 / 48385369 / +0.0% 54660546 / 54411004 / +0.5% 0.89 / 0.89 / -0.4%
tpch_q02/duckdb:parquet 48725061 / 49174788 / -0.9% 55682639 / 55848814 / -0.3% 0.88 / 0.88 / -0.6%
tpch_q03/duckdb:parquet 60455553 / 60544051 / -0.1% 69282377 / 69089579 / +0.3% 0.87 / 0.88 / -0.4%
tpch_q04/duckdb:parquet 35159173 / 35315533 / -0.4% 43814688 / 43350480 / +1.1% 0.80 / 0.81 / -1.5%
tpch_q05/duckdb:parquet 67470565 / 67972809 / -0.7% 77514549 / 76320997 / +1.6% 0.87 / 0.89 / -2.3%
tpch_q06/duckdb:parquet 22054041 / 22093485 / -0.2% 27330230 / 28004104 / -2.4% 0.81 / 0.79 / +2.3%
tpch_q07/duckdb:parquet 64543218 / 64736304 / -0.3% 74083707 / 74321243 / -0.3% 0.87 / 0.87 / +0.0%
tpch_q08/duckdb:parquet 76134514 / 76485141 / -0.5% 87380874 / 87105770 / +0.3% 0.87 / 0.88 / -0.8%
tpch_q09/duckdb:parquet 108498923 / 108770342 / -0.2% 119650791 / 119917271 / -0.2% 0.91 / 0.91 / -0.0%
tpch_q10/duckdb:parquet 106378075 / 106420465 / -0.0% 117537048 / 118412927 / -0.7% 0.91 / 0.90 / +0.7%
tpch_q11/duckdb:parquet 29860324 / 29969609 / -0.4% 35542468 / 35218747 / +0.9% 0.84 / 0.85 / -1.3%
tpch_q12/duckdb:parquet 38105640 / 38019079 / +0.2% 44996916 / 44427139 / +1.3% 0.85 / 0.86 / -1.0%
tpch_q13/duckdb:parquet 175640458 / 175881140 / -0.1% 182020915 / 183106771 / -0.6% 0.96 / 0.96 / +0.5%
tpch_q14/duckdb:parquet 42956607 / 42970633 / -0.0% 51463903 / 51363071 / +0.2% 0.83 / 0.84 / -0.2%
tpch_q15/duckdb:parquet 33061123 / 33094985 / -0.1% 41563301 / 40953486 / +1.5% 0.80 / 0.81 / -1.6%
tpch_q16/duckdb:parquet 47910492 / 48041177 / -0.3% 53897812 / 53622205 / +0.5% 0.89 / 0.90 / -0.8%
tpch_q17/duckdb:parquet 48656534 / 48527233 / +0.3% 57821098 / 57879490 / -0.1% 0.84 / 0.84 / +0.4%
tpch_q18/duckdb:parquet 74764135 / 74936978 / -0.2% 80843421 / 81548182 / -0.9% 0.92 / 0.92 / +0.6%
tpch_q19/duckdb:parquet 49395092 / 47814600 / +3.3% 57820355 / 53999029 / +7.1% 0.85 / 0.89 / -3.5%
tpch_q20/duckdb:parquet 63906326 / 64099308 / -0.3% 74177375 / 73695092 / +0.7% 0.86 / 0.87 / -0.9%
tpch_q21/duckdb:parquet 107859744 / 107410913 / +0.4% 116126360 / 117222420 / -0.9% 0.93 / 0.92 / +1.4%
tpch_q22/duckdb:parquet 50827228 / 51134549 / -0.6% 59859806 / 58781625 / +1.8% 0.85 / 0.87 / -2.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 26f9ea13 vs base 18c2340b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.968x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.985x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90271634 / 88916963 / +1.5% 147629794 / 147155746 / +0.3% 0.61 / 0.60 / +1.2%
tpch_q02/datafusion:vortex-file-compressed 67654875 / 66459322 / +1.8% 100074614 / 97118273 / +3.0% 0.68 / 0.68 / -1.2%
tpch_q03/datafusion:vortex-file-compressed 67204446 / 68123226 / -1.3% 112715653 / 124437763 / -9.4% 0.60 / 0.55 / +8.9%
tpch_q04/datafusion:vortex-file-compressed 35132873 / 36019416 / -2.5% 67226258 / 73145151 / -8.1% 0.52 / 0.49 / +6.1%
tpch_q05/datafusion:vortex-file-compressed 119524691 / 119614842 / -0.1% 205379654 / 169754153 / +21.0% 🔴 0.58 / 0.70 / -17.4%
tpch_q06/datafusion:vortex-file-compressed 11341535 / 11233017 / +1.0% 54876675 / 58386840 / -6.0% 0.21 / 0.19 / +7.4%
tpch_q07/datafusion:vortex-file-compressed 136292866 / 136609268 / -0.2% 201527806 / 189260312 / +6.5% 0.68 / 0.72 / -6.3%
tpch_q08/datafusion:vortex-file-compressed 145760938 / 146826622 / -0.7% 210034113 / 209432332 / +0.3% 0.69 / 0.70 / -1.0%
tpch_q09/datafusion:vortex-file-compressed 187360970 / 184866629 / +1.3% 262958863 / 268103558 / -1.9% 0.71 / 0.69 / +3.3%
tpch_q10/datafusion:vortex-file-compressed 74828125 / 74778140 / +0.1% 130381213 / 134538105 / -3.1% 0.57 / 0.56 / +3.3%
tpch_q11/datafusion:vortex-file-compressed 45281360 / 44880203 / +0.9% 65463062 / 69435371 / -5.7% 0.69 / 0.65 / +7.0%
tpch_q12/datafusion:vortex-file-compressed 37553272 / 36984662 / +1.5% 77404603 / 80061929 / -3.3% 0.49 / 0.46 / +5.0%
tpch_q13/datafusion:vortex-file-compressed 41815689 / 42830360 / -2.4% 81881086 / 84544141 / -3.1% 0.51 / 0.51 / +0.8%
tpch_q14/datafusion:vortex-file-compressed 22161634 / 22070292 / +0.4% 81977155 / 84743371 / -3.3% 0.27 / 0.26 / +3.8%
tpch_q15/datafusion:vortex-file-compressed 35314202 / 35097938 / +0.6% 90211127 / 89305905 / +1.0% 0.39 / 0.39 / -0.4%
tpch_q16/datafusion:vortex-file-compressed 39890763 / 40308964 / -1.0% 68161322 / 69672923 / -2.2% 0.59 / 0.58 / +1.2%
tpch_q17/datafusion:vortex-file-compressed 180908303 / 179734085 / +0.7% 224691268 / 228733629 / -1.8% 0.81 / 0.79 / +2.5%
tpch_q18/datafusion:vortex-file-compressed 211955825 / 207158384 / +2.3% 269058884 / 267281908 / +0.7% 0.79 / 0.78 / +1.6%
tpch_q19/datafusion:vortex-file-compressed 35105140 / 35910200 / -2.2% 86759927 / 88577487 / -2.1% 0.40 / 0.41 / -0.2%
tpch_q20/datafusion:vortex-file-compressed 63935646 / 64538166 / -0.9% 115817627 / 122308556 / -5.3% 0.55 / 0.53 / +4.6%
tpch_q21/datafusion:vortex-file-compressed 183388613 / 182880559 / +0.3% 238209280 / 234127483 / +1.7% 0.77 / 0.78 / -1.4%
tpch_q22/datafusion:vortex-file-compressed 27908688 / 27714273 / +0.7% 52058764 / 53240787 / -2.2% 0.54 / 0.52 / +3.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87906248 / 88424140 / -0.6% 123363234 / 133979402 / -7.9% 0.71 / 0.66 / +8.0%
tpch_q02/datafusion:parquet 176084409 / 175051873 / +0.6% 196404600 / 205514980 / -4.4% 0.90 / 0.85 / +5.3%
tpch_q03/datafusion:parquet 137796324 / 138592554 / -0.6% 183701906 / 182977195 / +0.4% 0.75 / 0.76 / -1.0%
tpch_q04/datafusion:parquet 59437486 / 59254589 / +0.3% 90554255 / 91193133 / -0.7% 0.66 / 0.65 / +1.0%
tpch_q05/datafusion:parquet 170587156 / 171059818 / -0.3% 223048543 / 224683368 / -0.7% 0.76 / 0.76 / +0.5%
tpch_q06/datafusion:parquet 37128239 / 37169914 / -0.1% 76447431 / 75218361 / +1.6% 0.49 / 0.49 / -1.7%
tpch_q07/datafusion:parquet 219166104 / 218948403 / +0.1% 282343471 / 263506759 / +7.1% 0.78 / 0.83 / -6.6%
tpch_q08/datafusion:parquet 221990713 / 222664090 / -0.3% 289350489 / 285559005 / +1.3% 0.77 / 0.78 / -1.6%
tpch_q09/datafusion:parquet 314567748 / 311991462 / +0.8% 387274801 / 386438808 / +0.2% 0.81 / 0.81 / +0.6%
tpch_q10/datafusion:parquet 320966706 / 322781935 / -0.6% 393822152 / 386911013 / +1.8% 0.82 / 0.83 / -2.3%
tpch_q11/datafusion:parquet 126705697 / 126443152 / +0.2% 146785966 / 150775776 / -2.6% 0.86 / 0.84 / +2.9%
tpch_q12/datafusion:parquet 84004036 / 84153308 / -0.2% 122995739 / 119699562 / +2.8% 0.68 / 0.70 / -2.9%
tpch_q13/datafusion:parquet 216740120 / 216334192 / +0.2% 245766691 / 247256524 / -0.6% 0.88 / 0.87 / +0.8%
tpch_q14/datafusion:parquet 88584643 / 86711618 / +2.2% 197705727 / 191953239 / +3.0% 0.45 / 0.45 / -0.8%
tpch_q15/datafusion:parquet 107350359 / 106569801 / +0.7% 151601451 / 156687234 / -3.2% 0.71 / 0.68 / +4.1%
tpch_q16/datafusion:parquet 97286344 / 96450863 / +0.9% 120048099 / 123197252 / -2.6% 0.81 / 0.78 / +3.5%
tpch_q17/datafusion:parquet 213984759 / 211932347 / +1.0% 257978284 / 264213788 / -2.4% 0.83 / 0.80 / +3.4%
tpch_q18/datafusion:parquet 269253825 / 271094876 / -0.7% 315423127 / 315185235 / +0.1% 0.85 / 0.86 / -0.8%
tpch_q19/datafusion:parquet 109181658 / 109362271 / -0.2% 164497294 / 166844034 / -1.4% 0.66 / 0.66 / +1.3%
tpch_q20/datafusion:parquet 188772200 / 190316578 / -0.8% 242823084 / 252807731 / -3.9% 0.78 / 0.75 / +3.3%
tpch_q21/datafusion:parquet 246277790 / 247973149 / -0.7% 307666446 / 314470312 / -2.2% 0.80 / 0.79 / +1.5%
tpch_q22/datafusion:parquet 153303493 / 153496823 / -0.1% 173536863 / 179671995 / -3.4% 0.88 / 0.85 / +3.4%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33134735 / 34062510 / -2.7% 62167415 / 72736611 / -14.5% 🟢 0.53 / 0.47 / +13.8%
tpch_q02/duckdb:vortex-file-compressed 31353801 / 31212769 / +0.5% 45301768 / 44343348 / +2.2% 0.69 / 0.70 / -1.7%
tpch_q03/duckdb:vortex-file-compressed 51911415 / 52829811 / -1.7% 94567638 / 102324235 / -7.6% 0.55 / 0.52 / +6.3%
tpch_q04/duckdb:vortex-file-compressed 51147852 / 51334268 / -0.4% 81850951 / 87440972 / -6.4% 0.62 / 0.59 / +6.4%
tpch_q05/duckdb:vortex-file-compressed 67786492 / 68419482 / -0.9% 100997933 / 107772305 / -6.3% 0.67 / 0.63 / +5.7%
tpch_q06/duckdb:vortex-file-compressed 14287756 / 14457359 / -1.2% 50507324 / 53522260 / -5.6% 0.28 / 0.27 / +4.7%
tpch_q07/duckdb:vortex-file-compressed 54297077 / 54579238 / -0.5% 100234045 / 108324806 / -7.5% 0.54 / 0.50 / +7.5%
tpch_q08/duckdb:vortex-file-compressed 88568556 / 86924914 / +1.9% 126544946 / 132541107 / -4.5% 0.70 / 0.66 / +6.7%
tpch_q09/duckdb:vortex-file-compressed 96656544 / 97937232 / -1.3% 152996801 / 155938342 / -1.9% 0.63 / 0.63 / +0.6%
tpch_q10/duckdb:vortex-file-compressed 87334009 / 86347212 / +1.1% 133348795 / 138840492 / -4.0% 0.65 / 0.62 / +5.3%
tpch_q11/duckdb:vortex-file-compressed 14401976 / 13943589 / +3.3% 25454903 / 25310722 / +0.6% 0.57 / 0.55 / +2.7%
tpch_q12/duckdb:vortex-file-compressed 42668691 / 43225021 / -1.3% 75640412 / 82441700 / -8.2% 0.56 / 0.52 / +7.6%
tpch_q13/duckdb:vortex-file-compressed 66959299 / 67564728 / -0.9% 84757337 / 89089548 / -4.9% 0.79 / 0.76 / +4.2%
tpch_q14/duckdb:vortex-file-compressed 27970882 / 28666978 / -2.4% 67051176 / 70213564 / -4.5% 0.42 / 0.41 / +2.2%
tpch_q15/duckdb:vortex-file-compressed 24285121 / 24651847 / -1.5% 57969915 / 63892620 / -9.3% 0.42 / 0.39 / +8.6%
tpch_q16/duckdb:vortex-file-compressed 49932520 / 50043017 / -0.2% 57725538 / 57939650 / -0.4% 0.86 / 0.86 / +0.1%
tpch_q17/duckdb:vortex-file-compressed 34124295 / 34395241 / -0.8% 62093227 / 67304141 / -7.7% 0.55 / 0.51 / +7.5%
tpch_q18/duckdb:vortex-file-compressed 100308475 / 96297536 / +4.2% 118417175 / 119878716 / -1.2% 0.85 / 0.80 / +5.5%
tpch_q19/duckdb:vortex-file-compressed 24404617 / 24895616 / -2.0% 71575711 / 74011322 / -3.3% 0.34 / 0.34 / +1.4%
tpch_q20/duckdb:vortex-file-compressed 38629646 / 38577860 / +0.1% 82641027 / 90167692 / -8.3% 0.47 / 0.43 / +9.3%
tpch_q21/duckdb:vortex-file-compressed 95726258 / 94496073 / +1.3% 135592596 / 142489518 / -4.8% 0.71 / 0.66 / +6.5%
tpch_q22/duckdb:vortex-file-compressed 34461333 / 34699589 / -0.7% 51015935 / 51860355 / -1.6% 0.68 / 0.67 / +1.0%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68184953 / 68603461 / -0.6% 92501730 / 90519851 / +2.2% 0.74 / 0.76 / -2.7%
tpch_q02/duckdb:parquet 87594043 / 87653553 / -0.1% 98792982 / 99432019 / -0.6% 0.89 / 0.88 / +0.6%
tpch_q03/duckdb:parquet 111845408 / 110445179 / +1.3% 139685978 / 144477030 / -3.3% 0.80 / 0.76 / +4.7%
tpch_q04/duckdb:parquet 77291873 / 76916422 / +0.5% 98844326 / 102403674 / -3.5% 0.78 / 0.75 / +4.1%
tpch_q05/duckdb:parquet 124397345 / 125270168 / -0.7% 155420009 / 160429234 / -3.1% 0.80 / 0.78 / +2.5%
tpch_q06/duckdb:parquet 36247822 / 35773562 / +1.3% 58601557 / 64321000 / -8.9% 0.62 / 0.56 / +11.2%
tpch_q07/duckdb:parquet 118667189 / 118109117 / +0.5% 155999530 / 155305976 / +0.4% 0.76 / 0.76 / +0.0%
tpch_q08/duckdb:parquet 149771659 / 148463873 / +0.9% 192756933 / 193125185 / -0.2% 0.78 / 0.77 / +1.1%
tpch_q09/duckdb:parquet 239442818 / 239052123 / +0.2% 280491581 / 282953000 / -0.9% 0.85 / 0.84 / +1.0%
tpch_q10/duckdb:parquet 314885187 / 317146015 / -0.7% 335558931 / 342166984 / -1.9% 0.94 / 0.93 / +1.2%
tpch_q11/duckdb:parquet 43834891 / 44099637 / -0.6% 52001073 / 52141073 / -0.3% 0.84 / 0.85 / -0.3%
tpch_q12/duckdb:parquet 72401106 / 73495727 / -1.5% 91049701 / 93382196 / -2.5% 0.80 / 0.79 / +1.0%
tpch_q13/duckdb:parquet 294755243 / 295063226 / -0.1% 309970210 / 308722920 / +0.4% 0.95 / 0.96 / -0.5%
tpch_q14/duckdb:parquet 101986987 / 101610710 / +0.4% 138025526 / 139441849 / -1.0% 0.74 / 0.73 / +1.4%
tpch_q15/duckdb:parquet 57382388 / 59037622 / -2.8% 87891197 / 87033020 / +1.0% 0.65 / 0.68 / -3.8%
tpch_q16/duckdb:parquet 101187849 / 101144040 / +0.0% 108797522 / 109370494 / -0.5% 0.93 / 0.92 / +0.6%
tpch_q17/duckdb:parquet 83229868 / 82030490 / +1.5% 116592416 / 117828223 / -1.0% 0.71 / 0.70 / +2.5%
tpch_q18/duckdb:parquet 156835654 / 159303113 / -1.5% 149216427 / 177158166 / -15.8% 🟢 1.05 / 0.90 / +16.9%
tpch_q19/duckdb:parquet 100608982 / 101525150 / -0.9% 134028657 / 135420314 / -1.0% 0.75 / 0.75 / +0.1%
tpch_q20/duckdb:parquet 147878257 / 147921818 / -0.0% 183914404 / 190351300 / -3.4% 0.80 / 0.78 / +3.5%
tpch_q21/duckdb:parquet 258018672 / 253908809 / +1.6% 277613673 / 283830818 / -2.2% 0.93 / 0.89 / +3.9%
tpch_q22/duckdb:parquet 169267737 / 169081613 / +0.1% 182862545 / 184547164 / -0.9% 0.93 / 0.92 / +1.0%

No file size changes detected.

@joseph-isaacs joseph-isaacs added the action/bench-compress Run only the compression benchmark on this PR label Oct 27, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 26f9ea13 vs base 18c2340b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.980x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24654650 / 24616588 / +0.2% 40242865 / 41878902 / -3.9% 0.61 / 0.59 / +4.2%
tpcds_q02/datafusion:vortex-file-compressed 47675440 / 47365722 / +0.7% 63826445 / 64488515 / -1.0% 0.75 / 0.73 / +1.7%
tpcds_q03/datafusion:vortex-file-compressed 11677956 / 11620638 / +0.5% 27231202 / 27826985 / -2.1% 0.43 / 0.42 / +2.7%
tpcds_q04/datafusion:vortex-file-compressed 123821706 / 123049716 / +0.6% 152940769 / 154002501 / -0.7% 0.81 / 0.80 / +1.3%
tpcds_q05/datafusion:vortex-file-compressed 59234490 / 59362054 / -0.2% 80588641 / 79837248 / +0.9% 0.74 / 0.74 / -1.1%
tpcds_q06/datafusion:vortex-file-compressed 22942162 / 22874384 / +0.3% 40584710 / 41618438 / -2.5% 0.57 / 0.55 / +2.9%
tpcds_q07/datafusion:vortex-file-compressed 31887483 / 31446992 / +1.4% 53519183 / 52605374 / +1.7% 0.60 / 0.60 / -0.3%
tpcds_q08/datafusion:vortex-file-compressed 24430580 / 24306650 / +0.5% 41211189 / 42847843 / -3.8% 0.59 / 0.57 / +4.5%
tpcds_q09/datafusion:vortex-file-compressed 17038728 / 17070564 / -0.2% 31292770 / 31089339 / +0.7% 0.54 / 0.55 / -0.8%
tpcds_q10/datafusion:vortex-file-compressed 27098374 / 27440915 / -1.2% 47180481 / 49530778 / -4.7% 0.57 / 0.55 / +3.7%
tpcds_q11/datafusion:vortex-file-compressed 64893137 / 66072454 / -1.8% 90604666 / 91605561 / -1.1% 0.72 / 0.72 / -0.7%
tpcds_q12/datafusion:vortex-file-compressed 16632183 / 16647642 / -0.1% 32727993 / 32337375 / +1.2% 0.51 / 0.51 / -1.3%
tpcds_q13/datafusion:vortex-file-compressed 31986761 / 32265334 / -0.9% 52051788 / 53918133 / -3.5% 0.61 / 0.60 / +2.7%
tpcds_q14/datafusion:vortex-file-compressed 498768746 / 498242801 / +0.1% 549771383 / 552093763 / -0.4% 0.91 / 0.90 / +0.5%
tpcds_q15/datafusion:vortex-file-compressed 15372854 / 15520497 / -1.0% 34020035 / 34344659 / -0.9% 0.45 / 0.45 / -0.0%
tpcds_q16/datafusion:vortex-file-compressed 20384232 / 20308314 / +0.4% 36702489 / 37934210 / -3.2% 0.56 / 0.54 / +3.7%
tpcds_q17/datafusion:vortex-file-compressed 57485596 / 59713803 / -3.7% 73128122 / 83187593 / -12.1% 🟢 0.79 / 0.72 / +9.5%
tpcds_q18/datafusion:vortex-file-compressed 69291670 / 67743588 / +2.3% 89995613 / 91992270 / -2.2% 0.77 / 0.74 / +4.6%
tpcds_q19/datafusion:vortex-file-compressed 16847394 / 18049064 / -6.7% 35645243 / 38317513 / -7.0% 0.47 / 0.47 / +0.3%
tpcds_q20/datafusion:vortex-file-compressed 17921882 / 17661193 / +1.5% 33933050 / 34928710 / -2.9% 0.53 / 0.51 / +4.5%
tpcds_q21/datafusion:vortex-file-compressed 15751830 / 16428272 / -4.1% 35934430 / 38305367 / -6.2% 0.44 / 0.43 / +2.2%
tpcds_q22/datafusion:vortex-file-compressed 57517370 / 57910158 / -0.7% 77644356 / 80522131 / -3.6% 0.74 / 0.72 / +3.0%
tpcds_q23/datafusion:vortex-file-compressed 74621456 / 70671334 / +5.6% 97466904 / 104448696 / -6.7% 0.77 / 0.68 / +13.2%
tpcds_q24/datafusion:vortex-file-compressed 67736086 / 68222276 / -0.7% 90109207 / 88536512 / +1.8% 0.75 / 0.77 / -2.4%
tpcds_q25/datafusion:vortex-file-compressed 54105972 / 54539372 / -0.8% 75230847 / 78918677 / -4.7% 0.72 / 0.69 / +4.1%
tpcds_q26/datafusion:vortex-file-compressed 30612864 / 31239590 / -2.0% 49270034 / 50083529 / -1.6% 0.62 / 0.62 / -0.4%
tpcds_q27/datafusion:vortex-file-compressed 61165593 / 61611590 / -0.7% 84054943 / 85365048 / -1.5% 0.73 / 0.72 / +0.8%
tpcds_q28/datafusion:vortex-file-compressed 18121642 / 17834850 / +1.6% 33871733 / 34457699 / -1.7% 0.54 / 0.52 / +3.4%
tpcds_q29/datafusion:vortex-file-compressed 58285712 / 54700639 / +6.6% 71903007 / 80652307 / -10.8% 🟢 0.81 / 0.68 / +19.5%
tpcds_q30/datafusion:vortex-file-compressed 27155356 / 26709372 / +1.7% 44924118 / 45675274 / -1.6% 0.60 / 0.58 / +3.4%
tpcds_q31/datafusion:vortex-file-compressed 58944152 / 58407630 / +0.9% 83341548 / 80705313 / +3.3% 0.71 / 0.72 / -2.3%
tpcds_q32/datafusion:vortex-file-compressed 13627799 / 13467503 / +1.2% 29304247 / 29506109 / -0.7% 0.47 / 0.46 / +1.9%
tpcds_q33/datafusion:vortex-file-compressed 27823490 / 27219920 / +2.2% 49203124 / 48720121 / +1.0% 0.57 / 0.56 / +1.2%
tpcds_q34/datafusion:vortex-file-compressed 17274101 / 17022214 / +1.5% 35162234 / 34669197 / +1.4% 0.49 / 0.49 / +0.1%
tpcds_q35/datafusion:vortex-file-compressed 34111936 / 34122830 / -0.0% 56074213 / 57045213 / -1.7% 0.61 / 0.60 / +1.7%
tpcds_q36/datafusion:vortex-file-compressed 48630299 / 47689116 / +2.0% 70222278 / 72483659 / -3.1% 0.69 / 0.66 / +5.3%
tpcds_q37/datafusion:vortex-file-compressed 12615964 / 13184060 / -4.3% 31373511 / 33752039 / -7.0% 0.40 / 0.39 / +2.9%
tpcds_q38/datafusion:vortex-file-compressed 29921316 / 29939132 / -0.1% 48453758 / 49131101 / -1.4% 0.62 / 0.61 / +1.3%
tpcds_q39/datafusion:vortex-file-compressed 61235188 / 61564950 / -0.5% 86566858 / 87269813 / -0.8% 0.71 / 0.71 / +0.3%
tpcds_q40/datafusion:vortex-file-compressed 24086334 / 24159170 / -0.3% 44165691 / 44080545 / +0.2% 0.55 / 0.55 / -0.5%
tpcds_q41/datafusion:vortex-file-compressed 17524034 / 17643458 / -0.7% 31131318 / 31109568 / +0.1% 0.56 / 0.57 / -0.7%
tpcds_q42/datafusion:vortex-file-compressed 11199544 / 11247794 / -0.4% 25493251 / 26775909 / -4.8% 0.44 / 0.42 / +4.6%
tpcds_q43/datafusion:vortex-file-compressed 12600874 / 12910730 / -2.4% 28604916 / 29134357 / -1.8% 0.44 / 0.44 / -0.6%
tpcds_q44/datafusion:vortex-file-compressed 26125612 / 26151736 / -0.1% 45413960 / 46531520 / -2.4% 0.58 / 0.56 / +2.4%
tpcds_q45/datafusion:vortex-file-compressed 18476603 / 18287770 / +1.0% 35414941 / 36332454 / -2.5% 0.52 / 0.50 / +3.7%
tpcds_q46/datafusion:vortex-file-compressed 23069998 / 23320018 / -1.1% 45117560 / 46291617 / -2.5% 0.51 / 0.50 / +1.5%
tpcds_q47/datafusion:vortex-file-compressed 77769211 / 77804548 / -0.0% 104295644 / 106000381 / -1.6% 0.75 / 0.73 / +1.6%
tpcds_q48/datafusion:vortex-file-compressed 29568929 / 29381211 / +0.6% 48482082 / 49449969 / -2.0% 0.61 / 0.59 / +2.6%
tpcds_q49/datafusion:vortex-file-compressed 57377444 / 55916600 / +2.6% 79037275 / 80351230 / -1.6% 0.73 / 0.70 / +4.3%
tpcds_q50/datafusion:vortex-file-compressed 32694430 / 32170742 / +1.6% 52187386 / 54676423 / -4.6% 0.63 / 0.59 / +6.5%
tpcds_q51/datafusion:vortex-file-compressed 67608528 / 66991198 / +0.9% 85901279 / 89558682 / -4.1% 0.79 / 0.75 / +5.2%
tpcds_q52/datafusion:vortex-file-compressed 11658108 / 11718838 / -0.5% 26185921 / 27095423 / -3.4% 0.45 / 0.43 / +2.9%
tpcds_q53/datafusion:vortex-file-compressed 18150281 / 17825942 / +1.8% 36058129 / 38002533 / -5.1% 0.50 / 0.47 / +7.3%
tpcds_q54/datafusion:vortex-file-compressed 33136150 / 32828488 / +0.9% 53441730 / 55151186 / -3.1% 0.62 / 0.60 / +4.2%
tpcds_q55/datafusion:vortex-file-compressed 11382503 / 11445370 / -0.5% 25500920 / 25403208 / +0.4% 0.45 / 0.45 / -0.9%
tpcds_q56/datafusion:vortex-file-compressed 26627782 / 26477882 / +0.6% 47956851 / 48225589 / -0.6% 0.56 / 0.55 / +1.1%
tpcds_q57/datafusion:vortex-file-compressed 78048324 / 77496259 / +0.7% 101373229 / 102653451 / -1.2% 0.77 / 0.75 / +2.0%
tpcds_q58/datafusion:vortex-file-compressed 40817743 / 40762580 / +0.1% 64551087 / 67400005 / -4.2% 0.63 / 0.60 / +4.6%
tpcds_q59/datafusion:vortex-file-compressed 30872639 / 30762858 / +0.4% 52432096 / 52594096 / -0.3% 0.59 / 0.58 / +0.7%
tpcds_q60/datafusion:vortex-file-compressed 25994506 / 26897363 / -3.4% 45983149 / 45576420 / +0.9% 0.57 / 0.59 / -4.2%
tpcds_q61/datafusion:vortex-file-compressed 23681349 / 23067076 / +2.7% 43626822 / 44051750 / -1.0% 0.54 / 0.52 / +3.7%
tpcds_q62/datafusion:vortex-file-compressed 18054718 / 18420236 / -2.0% 33037511 / 33652522 / -1.8% 0.55 / 0.55 / -0.2%
tpcds_q63/datafusion:vortex-file-compressed 17547677 / 17605496 / -0.3% 36447747 / 38180162 / -4.5% 0.48 / 0.46 / +4.4%
tpcds_q64/datafusion:vortex-file-compressed 225737143 / 226541025 / -0.4% 258793304 / 260703931 / -0.7% 0.87 / 0.87 / +0.4%
tpcds_q65/datafusion:vortex-file-compressed 74998262 / 74606865 / +0.5% 93061940 / 95098121 / -2.1% 0.81 / 0.78 / +2.7%
tpcds_q66/datafusion:vortex-file-compressed 52324015 / 52491658 / -0.3% 70609046 / 72033226 / -2.0% 0.74 / 0.73 / +1.7%
tpcds_q67/datafusion:vortex-file-compressed 58111788 / 58717745 / -1.0% 86212299 / 85963432 / +0.3% 0.67 / 0.68 / -1.3%
tpcds_q68/datafusion:vortex-file-compressed 22364870 / 22240440 / +0.6% 45381800 / 45637792 / -0.6% 0.49 / 0.49 / +1.1%
tpcds_q69/datafusion:vortex-file-compressed 27965845 / 27171411 / +2.9% 45330164 / 47666155 / -4.9% 0.62 / 0.57 / +8.2%
tpcds_q70/datafusion:vortex-file-compressed 70212066 / 70774176 / -0.8% 88874279 / 89356119 / -0.5% 0.79 / 0.79 / -0.3%
tpcds_q71/datafusion:vortex-file-compressed 19341122 / 18842001 / +2.6% 36006814 / 37213484 / -3.2% 0.54 / 0.51 / +6.1%
tpcds_q72/datafusion:vortex-file-compressed 351195454 / 347542621 / +1.1% 382792200 / 404651320 / -5.4% 0.92 / 0.86 / +6.8%
tpcds_q73/datafusion:vortex-file-compressed 16537516 / 16112925 / +2.6% 34031965 / 33591185 / +1.3% 0.49 / 0.48 / +1.3%
tpcds_q74/datafusion:vortex-file-compressed 45335251 / 46095968 / -1.7% 69842604 / 70737713 / -1.3% 0.65 / 0.65 / -0.4%
tpcds_q75/datafusion:vortex-file-compressed 138160416 / 136797002 / +1.0% 158833782 / 160304899 / -0.9% 0.87 / 0.85 / +1.9%
tpcds_q76/datafusion:vortex-file-compressed 26529324 / 26627068 / -0.4% 44079016 / 45940042 / -4.1% 0.60 / 0.58 / +3.8%
tpcds_q77/datafusion:vortex-file-compressed 45294047 / 45296456 / -0.0% 68750192 / 65647430 / +4.7% 0.66 / 0.69 / -4.5%
tpcds_q78/datafusion:vortex-file-compressed 68559884 / 69124342 / -0.8% 95022997 / 97368143 / -2.4% 0.72 / 0.71 / +1.6%
tpcds_q79/datafusion:vortex-file-compressed 19850240 / 19655434 / +1.0% 41019189 / 42588141 / -3.7% 0.48 / 0.46 / +4.9%
tpcds_q80/datafusion:vortex-file-compressed 74349198 / 73943684 / +0.5% 108201965 / 104704449 / +3.3% 0.69 / 0.71 / -2.7%
tpcds_q81/datafusion:vortex-file-compressed 27262735 / 27199422 / +0.2% 43990587 / 44513918 / -1.2% 0.62 / 0.61 / +1.4%
tpcds_q82/datafusion:vortex-file-compressed 12740118 / 12454426 / +2.3% 32858847 / 34380113 / -4.4% 0.39 / 0.36 / +7.0%
tpcds_q83/datafusion:vortex-file-compressed 36121385 / 35364994 / +2.1% 51636678 / 54458182 / -5.2% 0.70 / 0.65 / +7.7%
tpcds_q84/datafusion:vortex-file-compressed 11810094 / 11960466 / -1.3% 25265496 / 26663548 / -5.2% 0.47 / 0.45 / +4.2%
tpcds_q85/datafusion:vortex-file-compressed 57401162 / 57861038 / -0.8% 80285270 / 82059580 / -2.2% 0.71 / 0.71 / +1.4%
tpcds_q86/datafusion:vortex-file-compressed 16437965 / 16749823 / -1.9% 33645201 / 32536016 / +3.4% 0.49 / 0.51 / -5.1%
tpcds_q87/datafusion:vortex-file-compressed 29569842 / 29679898 / -0.4% 48472252 / 49150992 / -1.4% 0.61 / 0.60 / +1.0%
tpcds_q88/datafusion:vortex-file-compressed 31437394 / 32884166 / -4.4% 76394734 / 60205888 / +26.9% 🔴 0.41 / 0.55 / -24.7%
tpcds_q89/datafusion:vortex-file-compressed 20573338 / 20571562 / +0.0% 38971461 / 40010986 / -2.6% 0.53 / 0.51 / +2.7%
tpcds_q90/datafusion:vortex-file-compressed 10268432 / 10601036 / -3.1% 24274403 / 24675963 / -1.6% 0.42 / 0.43 / -1.5%
tpcds_q91/datafusion:vortex-file-compressed 15671670 / 15764700 / -0.6% 33515186 / 34346959 / -2.4% 0.47 / 0.46 / +1.9%
tpcds_q92/datafusion:vortex-file-compressed 13521665 / 13314054 / +1.6% 28644203 / 27730480 / +3.3% 0.47 / 0.48 / -1.7%
tpcds_q93/datafusion:vortex-file-compressed 22460348 / 21771474 / +3.2% 40009169 / 42378737 / -5.6% 0.56 / 0.51 / +9.3%
tpcds_q94/datafusion:vortex-file-compressed 18979231 / 19155938 / -0.9% 34756474 / 36244769 / -4.1% 0.55 / 0.53 / +3.3%
tpcds_q95/datafusion:vortex-file-compressed 44563837 / 45106592 / -1.2% 63110093 / 64011723 / -1.4% 0.71 / 0.70 / +0.2%
tpcds_q96/datafusion:vortex-file-compressed 8481824 / 8370742 / +1.3% 21448473 / 21668949 / -1.0% 0.40 / 0.39 / +2.4%
tpcds_q97/datafusion:vortex-file-compressed 21117424 / 21087610 / +0.1% 39567393 / 40853189 / -3.1% 0.53 / 0.52 / +3.4%
tpcds_q98/datafusion:vortex-file-compressed 17135651 / 16933328 / +1.2% 35416276 / 37246525 / -4.9% 0.48 / 0.45 / +6.4%
tpcds_q99/datafusion:vortex-file-compressed 20676309 / 20819807 / -0.7% 35756533 / 36531285 / -2.1% 0.58 / 0.57 / +1.5%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42865852 / 44070800 / -2.7% 59601442 / 62342209 / -4.4% 0.72 / 0.71 / +1.7%
tpcds_q02/datafusion:parquet 55789723 / 55144865 / +1.2% 70851920 / 72381741 / -2.1% 0.79 / 0.76 / +3.4%
tpcds_q03/datafusion:parquet 19122464 / 19104180 / +0.1% 31541427 / 32526488 / -3.0% 0.61 / 0.59 / +3.2%
tpcds_q04/datafusion:parquet 179770895 / 181070002 / -0.7% 208855461 / 208916184 / -0.0% 0.86 / 0.87 / -0.7%
tpcds_q05/datafusion:parquet 67815694 / 68397435 / -0.9% 88783156 / 92139953 / -3.6% 0.76 / 0.74 / +2.9%
tpcds_q06/datafusion:parquet 33666807 / 34040739 / -1.1% 48478252 / 47712317 / +1.6% 0.69 / 0.71 / -2.7%
tpcds_q07/datafusion:parquet 47484358 / 46926847 / +1.2% 68252029 / 67673708 / +0.9% 0.70 / 0.69 / +0.3%
tpcds_q08/datafusion:parquet 31589443 / 32006116 / -1.3% 49135299 / 49099907 / +0.1% 0.64 / 0.65 / -1.4%
tpcds_q09/datafusion:parquet 31612455 / 31248098 / +1.2% 37932789 / 44778136 / -15.3% 🟢 0.83 / 0.70 / +19.4%
tpcds_q10/datafusion:parquet 43208830 / 43856364 / -1.5% 60282284 / 61702203 / -2.3% 0.72 / 0.71 / +0.8%
tpcds_q11/datafusion:parquet 99414114 / 98225238 / +1.2% 120874183 / 122898210 / -1.6% 0.82 / 0.80 / +2.9%
tpcds_q12/datafusion:parquet 24501868 / 24516268 / -0.1% 37411373 / 38227393 / -2.1% 0.65 / 0.64 / +2.1%
tpcds_q13/datafusion:parquet 47356698 / 46793496 / +1.2% 68335544 / 69696049 / -2.0% 0.69 / 0.67 / +3.2%
tpcds_q14/datafusion:parquet 536365438 / 537781666 / -0.3% 578433580 / 587666029 / -1.6% 0.93 / 0.92 / +1.3%
tpcds_q15/datafusion:parquet 23679786 / 23647376 / +0.1% 38353590 / 40016555 / -4.2% 0.62 / 0.59 / +4.5%
tpcds_q16/datafusion:parquet 37115820 / 36838670 / +0.8% 50516611 / 51794553 / -2.5% 0.73 / 0.71 / +3.3%
tpcds_q17/datafusion:parquet 73070821 / 74057377 / -1.3% 98329949 / 97503175 / +0.8% 0.74 / 0.76 / -2.2%
tpcds_q18/datafusion:parquet 66107348 / 64990430 / +1.7% 88019772 / 89376255 / -1.5% 0.75 / 0.73 / +3.3%
tpcds_q19/datafusion:parquet 29838978 / 29673478 / +0.6% 43940386 / 45278154 / -3.0% 0.68 / 0.66 / +3.6%
tpcds_q20/datafusion:parquet 26446413 / 25098546 / +5.4% 37935753 / 38949797 / -2.6% 0.70 / 0.64 / +8.2%
tpcds_q21/datafusion:parquet 20413462 / 20469080 / -0.3% 32491421 / 35218653 / -7.7% 0.63 / 0.58 / +8.1%
tpcds_q22/datafusion:parquet 77280093 / 77158440 / +0.2% 88362198 / 89966190 / -1.8% 0.87 / 0.86 / +2.0%
tpcds_q23/datafusion:parquet 92584890 / 91517886 / +1.2% 111521606 / 115239968 / -3.2% 0.83 / 0.79 / +4.5%
tpcds_q24/datafusion:parquet 91307745 / 92134911 / -0.9% 116717884 / 117357596 / -0.5% 0.78 / 0.79 / -0.4%
tpcds_q25/datafusion:parquet 81741241 / 82410792 / -0.8% 105495024 / 103863984 / +1.6% 0.77 / 0.79 / -2.3%
tpcds_q26/datafusion:parquet 43156426 / 43357340 / -0.5% 57040160 / 61114738 / -6.7% 0.76 / 0.71 / +6.6%
tpcds_q27/datafusion:parquet 76189183 / 77099840 / -1.2% 95324962 / 103579428 / -8.0% 0.80 / 0.74 / +7.4%
tpcds_q28/datafusion:parquet 29093010 / 28747674 / +1.2% 42680299 / 45714433 / -6.6% 0.68 / 0.63 / +8.4%
tpcds_q29/datafusion:parquet 75138644 / 75514865 / -0.5% 96933515 / 100152614 / -3.2% 0.78 / 0.75 / +2.8%
tpcds_q30/datafusion:parquet 44866531 / 45133740 / -0.6% 59884192 / 59969489 / -0.1% 0.75 / 0.75 / -0.5%
tpcds_q31/datafusion:parquet 80938066 / 80986886 / -0.1% 100064844 / 97974266 / +2.1% 0.81 / 0.83 / -2.1%
tpcds_q32/datafusion:parquet 26040934 / 26670102 / -2.4% 39777875 / 41209222 / -3.5% 0.65 / 0.65 / +1.2%
tpcds_q33/datafusion:parquet 36735354 / 37406380 / -1.8% 51064848 / 55790861 / -8.5% 0.72 / 0.67 / +7.3%
tpcds_q34/datafusion:parquet 24398152 / 24552927 / -0.6% 35582486 / 37211615 / -4.4% 0.69 / 0.66 / +3.9%
tpcds_q35/datafusion:parquet 51061573 / 51452363 / -0.8% 65713943 / 65296842 / +0.6% 0.78 / 0.79 / -1.4%
tpcds_q36/datafusion:parquet 50960116 / 52523156 / -3.0% 67643707 / 74881184 / -9.7% 0.75 / 0.70 / +7.4%
tpcds_q37/datafusion:parquet 21065254 / 21539628 / -2.2% 33951383 / 36515199 / -7.0% 0.62 / 0.59 / +5.2%
tpcds_q38/datafusion:parquet 44408338 / 44544202 / -0.3% 60232158 / 65384689 / -7.9% 0.74 / 0.68 / +8.2%
tpcds_q39/datafusion:parquet 67817288 / 68674446 / -1.2% 83000930 / 86726470 / -4.3% 0.82 / 0.79 / +3.2%
tpcds_q40/datafusion:parquet 31714124 / 31991835 / -0.9% 49735866 / 51949894 / -4.3% 0.64 / 0.62 / +3.5%
tpcds_q41/datafusion:parquet 19433581 / 20434208 / -4.9% 31588519 / 32417799 / -2.6% 0.62 / 0.63 / -2.4%
tpcds_q42/datafusion:parquet 18188410 / 18260310 / -0.4% 32142807 / 31935293 / +0.6% 0.57 / 0.57 / -1.0%
tpcds_q43/datafusion:parquet 19840392 / 19717090 / +0.6% 31599772 / 31783440 / -0.6% 0.63 / 0.62 / +1.2%
tpcds_q44/datafusion:parquet 34638060 / 33572072 / +3.2% 50613142 / 49295480 / +2.7% 0.68 / 0.68 / +0.5%
tpcds_q45/datafusion:parquet 27442160 / 27784118 / -1.2% 40173093 / 41106697 / -2.3% 0.68 / 0.68 / +1.1%
tpcds_q46/datafusion:parquet 29665990 / 29586955 / +0.3% 45558945 / 47461761 / -4.0% 0.65 / 0.62 / +4.5%
tpcds_q47/datafusion:parquet 97041073 / 99448328 / -2.4% 121597977 / 122428005 / -0.7% 0.80 / 0.81 / -1.8%
tpcds_q48/datafusion:parquet 42981369 / 41689249 / +3.1% 59612135 / 58686277 / +1.6% 0.72 / 0.71 / +1.5%
tpcds_q49/datafusion:parquet 71816921 / 71281506 / +0.8% 96414017 / 102432833 / -5.9% 0.74 / 0.70 / +7.0%
tpcds_q50/datafusion:parquet 47676260 / 47934014 / -0.5% 66852295 / 70379753 / -5.0% 0.71 / 0.68 / +4.7%
tpcds_q51/datafusion:parquet 75913526 / 76073943 / -0.2% 95453667 / 94475299 / +1.0% 0.80 / 0.81 / -1.2%
tpcds_q52/datafusion:parquet 18786614 / 18812654 / -0.1% 28609151 / 32157873 / -11.0% 🟢 0.66 / 0.59 / +12.2%
tpcds_q53/datafusion:parquet 22298542 / 22479616 / -0.8% 37553456 / 38224829 / -1.8% 0.59 / 0.59 / +1.0%
tpcds_q54/datafusion:parquet 52651763 / 53281289 / -1.2% 64319336 / 66322735 / -3.0% 0.82 / 0.80 / +1.9%
tpcds_q55/datafusion:parquet 18317235 / 18433464 / -0.6% 29761084 / 30203811 / -1.5% 0.62 / 0.61 / +0.8%
tpcds_q56/datafusion:parquet 41615722 / 40383246 / +3.1% 54490245 / 59310731 / -8.1% 0.76 / 0.68 / +12.2%
tpcds_q57/datafusion:parquet 102911028 / 102892210 / +0.0% 115472896 / 114586138 / +0.8% 0.89 / 0.90 / -0.7%
tpcds_q58/datafusion:parquet 65885568 / 65567866 / +0.5% 83081912 / 84629487 / -1.8% 0.79 / 0.77 / +2.4%
tpcds_q59/datafusion:parquet 48697153 / 47865568 / +1.7% 64583748 / 66916288 / -3.5% 0.75 / 0.72 / +5.4%
tpcds_q60/datafusion:parquet 40084175 / 41141948 / -2.6% 55550383 / 54646352 / +1.7% 0.72 / 0.75 / -4.2%
tpcds_q61/datafusion:parquet 36221644 / 35842514 / +1.1% 50680876 / 52791717 / -4.0% 0.71 / 0.68 / +5.3%
tpcds_q62/datafusion:parquet 25137458 / 25363897 / -0.9% 38199720 / 39002518 / -2.1% 0.66 / 0.65 / +1.2%
tpcds_q63/datafusion:parquet 22382306 / 22307752 / +0.3% 38412840 / 39597819 / -3.0% 0.58 / 0.56 / +3.4%
tpcds_q64/datafusion:parquet 289573784 / 290080964 / -0.2% 330100011 / 331614556 / -0.5% 0.88 / 0.87 / +0.3%
tpcds_q65/datafusion:parquet 122300826 / 123899920 / -1.3% 137252417 / 138894488 / -1.2% 0.89 / 0.89 / -0.1%
tpcds_q66/datafusion:parquet 60454928 / 61041652 / -1.0% 76416261 / 75358258 / +1.4% 0.79 / 0.81 / -2.3%
tpcds_q67/datafusion:parquet 69362934 / 69190603 / +0.2% 93139257 / 91534163 / +1.8% 0.74 / 0.76 / -1.5%
tpcds_q68/datafusion:parquet 29556976 / 29771409 / -0.7% 47590007 / 48543001 / -2.0% 0.62 / 0.61 / +1.3%
tpcds_q69/datafusion:parquet 43942852 / 44788653 / -1.9% 57804870 / 56213916 / +2.8% 0.76 / 0.80 / -4.6%
tpcds_q70/datafusion:parquet 82111627 / 80878255 / +1.5% 98265250 / 97750927 / +0.5% 0.84 / 0.83 / +1.0%
tpcds_q71/datafusion:parquet 25354936 / 27101444 / -6.4% 37695416 / 37031808 / +1.8% 0.67 / 0.73 / -8.1%
tpcds_q72/datafusion:parquet 518979620 / 524156743 / -1.0% 548412610 / 538072446 / +1.9% 0.95 / 0.97 / -2.9%
tpcds_q73/datafusion:parquet 24009692 / 24138453 / -0.5% 36225366 / 35948525 / +0.8% 0.66 / 0.67 / -1.3%
tpcds_q74/datafusion:parquet 70591274 / 70510907 / +0.1% 87526534 / 88470973 / -1.1% 0.81 / 0.80 / +1.2%
tpcds_q75/datafusion:parquet 153909477 / 156553697 / -1.7% 177007227 / 184756735 / -4.2% 0.87 / 0.85 / +2.6%
tpcds_q76/datafusion:parquet 34003908 / 33358374 / +1.9% 46241674 / 46634867 / -0.8% 0.74 / 0.72 / +2.8%
tpcds_q77/datafusion:parquet 56496478 / 58576008 / -3.6% 75814866 / 74025561 / +2.4% 0.75 / 0.79 / -5.8%
tpcds_q78/datafusion:parquet 85217400 / 86725578 / -1.7% 115478042 / 119589053 / -3.4% 0.74 / 0.73 / +1.8%
tpcds_q79/datafusion:parquet 27506054 / 27039310 / +1.7% 41732494 / 42173227 / -1.0% 0.66 / 0.64 / +2.8%
tpcds_q80/datafusion:parquet 79468330 / 81386366 / -2.4% 111572436 / 110296262 / +1.2% 0.71 / 0.74 / -3.5%
tpcds_q81/datafusion:parquet 37574750 / 39698666 / -5.4% 51202611 / 51597038 / -0.8% 0.73 / 0.77 / -4.6%
tpcds_q82/datafusion:parquet 21810338 / 21634616 / +0.8% 35772855 / 34500940 / +3.7% 0.61 / 0.63 / -2.8%
tpcds_q83/datafusion:parquet 59395057 / 57892486 / +2.6% 77025254 / 73864322 / +4.3% 0.77 / 0.78 / -1.6%
tpcds_q84/datafusion:parquet 26472120 / 27195574 / -2.7% 40617292 / 42981972 / -5.5% 0.65 / 0.63 / +3.0%
tpcds_q85/datafusion:parquet 80816068 / 80580436 / +0.3% 103486001 / 104349924 / -0.8% 0.78 / 0.77 / +1.1%
tpcds_q86/datafusion:parquet 20913848 / 20691870 / +1.1% 33497690 / 32936369 / +1.7% 0.62 / 0.63 / -0.6%
tpcds_q87/datafusion:parquet 45995018 / 44697262 / +2.9% 62650164 / 64839714 / -3.4% 0.73 / 0.69 / +6.5%
tpcds_q88/datafusion:parquet 37376916 / 38412733 / -2.7% 52315162 / 51109201 / +2.4% 0.71 / 0.75 / -4.9%
tpcds_q89/datafusion:parquet 25964447 / 25889262 / +0.3% 41275657 / 41499837 / -0.5% 0.63 / 0.62 / +0.8%
tpcds_q90/datafusion:parquet 15308558 / 14966094 / +2.3% 26560997 / 25845522 / +2.8% 0.58 / 0.58 / -0.5%
tpcds_q91/datafusion:parquet 32920104 / 32097284 / +2.6% 46760957 / 46467332 / +0.6% 0.70 / 0.69 / +1.9%
tpcds_q92/datafusion:parquet 27037671 / 26644216 / +1.5% 39727306 / 41020726 / -3.2% 0.68 / 0.65 / +4.8%
tpcds_q93/datafusion:parquet 27537418 / 27361279 / +0.6% 46869839 / 47715220 / -1.8% 0.59 / 0.57 / +2.5%
tpcds_q94/datafusion:parquet 35463324 / 35419876 / +0.1% 48941896 / 49051898 / -0.2% 0.72 / 0.72 / +0.3%
tpcds_q95/datafusion:parquet 65669600 / 65249186 / +0.6% 75362712 / 80508646 / -6.4% 0.87 / 0.81 / +7.5%
tpcds_q96/datafusion:parquet 12796525 / 12547794 / +2.0% 23916033 / 23704588 / +0.9% 0.54 / 0.53 / +1.1%
tpcds_q97/datafusion:parquet 35597387 / 35669844 / -0.2% 51200170 / 49577241 / +3.3% 0.70 / 0.72 / -3.4%
tpcds_q98/datafusion:parquet 24774776 / 24667440 / +0.4% 39173148 / 39098289 / +0.2% 0.63 / 0.63 / +0.2%
tpcds_q99/datafusion:parquet 29558484 / 29917320 / -1.2% 41378160 / 41939730 / -1.3% 0.71 / 0.71 / +0.1%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15841318 / 15810472 / +0.2% 24361002 / 25021761 / -2.6% 0.65 / 0.63 / +2.9%
tpcds_q02/duckdb:vortex-file-compressed 15703906 / 15397694 / +2.0% 23945115 / 22141894 / +8.1% 0.66 / 0.70 / -5.7%
tpcds_q03/duckdb:vortex-file-compressed 6877834 / 6948716 / -1.0% 14908945 / 15243241 / -2.2% 0.46 / 0.46 / +1.2%
tpcds_q04/duckdb:vortex-file-compressed 44752423 / 45121538 / -0.8% 53990208 / 54055574 / -0.1% 0.83 / 0.83 / -0.7%
tpcds_q05/duckdb:vortex-file-compressed 22872796 / 22924990 / -0.2% 30070383 / 30426652 / -1.2% 0.76 / 0.75 / +1.0%
tpcds_q06/duckdb:vortex-file-compressed 23480294 / 23517306 / -0.2% 35961197 / 37475317 / -4.0% 0.65 / 0.63 / +4.0%
tpcds_q07/duckdb:vortex-file-compressed 13687728 / 13657032 / +0.2% 23408795 / 23740448 / -1.4% 0.58 / 0.58 / +1.6%
tpcds_q08/duckdb:vortex-file-compressed 17018268 / 17229108 / -1.2% 24089803 / 24444771 / -1.5% 0.71 / 0.70 / +0.2%
tpcds_q09/duckdb:vortex-file-compressed 18010734 / 18204575 / -1.1% 27484722 / 27828279 / -1.2% 0.66 / 0.65 / +0.2%
tpcds_q10/duckdb:vortex-file-compressed 26393905 / 26864857 / -1.8% 39855893 / 39827136 / +0.1% 0.66 / 0.67 / -1.8%
tpcds_q11/duckdb:vortex-file-compressed 36289504 / 36210454 / +0.2% 43999092 / 44044428 / -0.1% 0.82 / 0.82 / +0.3%
tpcds_q12/duckdb:vortex-file-compressed 9669222 / 9995874 / -3.3% 16302980 / 16231301 / +0.4% 0.59 / 0.62 / -3.7%
tpcds_q13/duckdb:vortex-file-compressed 20699314 / 20714306 / -0.1% 33134354 / 33953357 / -2.4% 0.62 / 0.61 / +2.4%
tpcds_q14/duckdb:vortex-file-compressed 54487332 / 54454662 / +0.1% 64238316 / 65254871 / -1.6% 0.85 / 0.83 / +1.6%
tpcds_q15/duckdb:vortex-file-compressed 10812982 / 10685645 / +1.2% 17368715 / 17937021 / -3.2% 0.62 / 0.60 / +4.5%
tpcds_q16/duckdb:vortex-file-compressed 23816422 / 23786406 / +0.1% 33975890 / 35217844 / -3.5% 0.70 / 0.68 / +3.8%
tpcds_q17/duckdb:vortex-file-compressed 25363608 / 25455422 / -0.4% 36869115 / 39762242 / -7.3% 0.69 / 0.64 / +7.5%
tpcds_q18/duckdb:vortex-file-compressed 30718254 / 31370250 / -2.1% 40412031 / 41598438 / -2.9% 0.76 / 0.75 / +0.8%
tpcds_q19/duckdb:vortex-file-compressed 77401867 / 78418982 / -1.3% 89834541 / 89266451 / +0.6% 0.86 / 0.88 / -1.9%
tpcds_q20/duckdb:vortex-file-compressed 10570460 / 10612912 / -0.4% 17385020 / 17775578 / -2.2% 0.61 / 0.60 / +1.8%
tpcds_q21/duckdb:vortex-file-compressed 10617920 / 10677371 / -0.6% 23530221 / 21752717 / +8.2% 0.45 / 0.49 / -8.1%
tpcds_q22/duckdb:vortex-file-compressed 17854830 / 17830125 / +0.1% 28099184 / 28920195 / -2.8% 0.64 / 0.62 / +3.1%
tpcds_q23/duckdb:vortex-file-compressed 37181549 / 36842714 / +0.9% 47065369 / 48439086 / -2.8% 0.79 / 0.76 / +3.9%
tpcds_q24/duckdb:vortex-file-compressed 27027636 / 27284828 / -0.9% 37435300 / 39197907 / -4.5% 0.72 / 0.70 / +3.7%
tpcds_q25/duckdb:vortex-file-compressed 23203044 / 23550070 / -1.5% 34987235 / 37036145 / -5.5% 0.66 / 0.64 / +4.3%
tpcds_q26/duckdb:vortex-file-compressed 12989007 / 12845158 / +1.1% 20711100 / 22413166 / -7.6% 0.63 / 0.57 / +9.4%
tpcds_q27/duckdb:vortex-file-compressed 16254495 / 16184575 / +0.4% 26116272 / 27530116 / -5.1% 0.62 / 0.59 / +5.9%
tpcds_q28/duckdb:vortex-file-compressed 14454644 / 14680312 / -1.5% 23164174 / 22611085 / +2.4% 0.62 / 0.65 / -3.9%
tpcds_q29/duckdb:vortex-file-compressed 23056194 / 23396601 / -1.5% 34647174 / 37394989 / -7.3% 0.67 / 0.63 / +6.4%
tpcds_q30/duckdb:vortex-file-compressed 15574028 / 16024043 / -2.8% 23294792 / 22954977 / +1.5% 0.67 / 0.70 / -4.2%
tpcds_q31/duckdb:vortex-file-compressed 17729700 / 17624829 / +0.6% 25287332 / 25775609 / -1.9% 0.70 / 0.68 / +2.5%
tpcds_q32/duckdb:vortex-file-compressed 11303711 / 11781862 / -4.1% 20503746 / 19886176 / +3.1% 0.55 / 0.59 / -6.9%
tpcds_q33/duckdb:vortex-file-compressed 17617360 / 17505354 / +0.6% 25905311 / 25802490 / +0.4% 0.68 / 0.68 / +0.2%
tpcds_q34/duckdb:vortex-file-compressed 12217092 / 12317664 / -0.8% 20921630 / 22074113 / -5.2% 0.58 / 0.56 / +4.6%
tpcds_q35/duckdb:vortex-file-compressed 27957146 / 28137100 / -0.6% 37730199 / 39600256 / -4.7% 0.74 / 0.71 / +4.3%
tpcds_q36/duckdb:vortex-file-compressed 14491258 / 14325258 / +1.2% 24022783 / 24215566 / -0.8% 0.60 / 0.59 / +2.0%
tpcds_q37/duckdb:vortex-file-compressed 9226202 / 9379638 / -1.6% 21377896 / 22146192 / -3.5% 0.43 / 0.42 / +1.9%
tpcds_q38/duckdb:vortex-file-compressed 23666172 / 23689103 / -0.1% 29795214 / 30323275 / -1.7% 0.79 / 0.78 / +1.7%
tpcds_q39/duckdb:vortex-file-compressed 20378198 / 19234652 / +5.9% 31253227 / 31165314 / +0.3% 0.65 / 0.62 / +5.6%
tpcds_q40/duckdb:vortex-file-compressed 13998054 / 13788342 / +1.5% 20680871 / 20991897 / -1.5% 0.68 / 0.66 / +3.0%
tpcds_q41/duckdb:vortex-file-compressed 14346956 / 14259201 / +0.6% 21569416 / 21340958 / +1.1% 0.67 / 0.67 / -0.5%
tpcds_q42/duckdb:vortex-file-compressed 7031470 / 6869403 / +2.4% 15446948 / 15755595 / -2.0% 0.46 / 0.44 / +4.4%
tpcds_q43/duckdb:vortex-file-compressed 9969560 / 9807487 / +1.7% 17961640 / 18163234 / -1.1% 0.56 / 0.54 / +2.8%
tpcds_q44/duckdb:vortex-file-compressed 14644244 / 14519612 / +0.9% 24439552 / 25440550 / -3.9% 0.60 / 0.57 / +5.0%
tpcds_q45/duckdb:vortex-file-compressed 23432934 / 23034182 / +1.7% 30178665 / 31760359 / -5.0% 0.78 / 0.73 / +7.1%
tpcds_q46/duckdb:vortex-file-compressed 19170237 / 19120454 / +0.3% 26603415 / 26824899 / -0.8% 0.72 / 0.71 / +1.1%
tpcds_q47/duckdb:vortex-file-compressed 33754732 / 33895070 / -0.4% 42504786 / 43434867 / -2.1% 0.79 / 0.78 / +1.8%
tpcds_q48/duckdb:vortex-file-compressed 23104407 / 23401376 / -1.3% 34542864 / 35965434 / -4.0% 0.67 / 0.65 / +2.8%
tpcds_q49/duckdb:vortex-file-compressed 20015662 / 20028024 / -0.1% 32612246 / 33374698 / -2.3% 0.61 / 0.60 / +2.3%
tpcds_q50/duckdb:vortex-file-compressed 16892395 / 17049134 / -0.9% 27653446 / 28916058 / -4.4% 0.61 / 0.59 / +3.6%
tpcds_q51/duckdb:vortex-file-compressed 48686998 / 49008442 / -0.7% 75845172 / 77429607 / -2.0% 0.64 / 0.63 / +1.4%
tpcds_q52/duckdb:vortex-file-compressed 6985278 / 7057948 / -1.0% 15041880 / 15521326 / -3.1% 0.46 / 0.45 / +2.1%
tpcds_q53/duckdb:vortex-file-compressed 11613190 / 11506466 / +0.9% 19484144 / 20175696 / -3.4% 0.60 / 0.57 / +4.5%
tpcds_q54/duckdb:vortex-file-compressed 20093046 / 20004576 / +0.4% 29785780 / 29283643 / +1.7% 0.67 / 0.68 / -1.3%
tpcds_q55/duckdb:vortex-file-compressed 6732688 / 6994697 / -3.7% 15080630 / 15387707 / -2.0% 0.45 / 0.45 / -1.8%
tpcds_q56/duckdb:vortex-file-compressed 18010644 / 17599270 / +2.3% 26755280 / 26285542 / +1.8% 0.67 / 0.67 / +0.5%
tpcds_q57/duckdb:vortex-file-compressed 25488014 / 25421032 / +0.3% 33006903 / 3366968 / -2.0% 0.77 / 0.76 / +2.3%
tpcds_q58/duckdb:vortex-file-compressed 19682314 / 19845490 / -0.8% 29099549 / 29272194 / -0.6% 0.68 / 0.68 / -0.2%
tpcds_q59/duckdb:vortex-file-compressed 19365059 / 19597640 / -1.2% 27343171 / 27412425 / -0.3% 0.71 / 0.71 / -0.9%
tpcds_q60/duckdb:vortex-file-compressed 18575138 / 18525298 / +0.3% 27363274 / 27594717 / -0.8% 0.68 / 0.67 / +1.1%
tpcds_q61/duckdb:vortex-file-compressed 23326464 / 23552347 / -1.0% 33382447 / 33578933 / -0.6% 0.70 / 0.70 / -0.4%
tpcds_q62/duckdb:vortex-file-compressed 11716804 / 11600934 / +1.0% 18423405 / 19496629 / -5.5% 0.64 / 0.60 / +6.9%
tpcds_q63/duckdb:vortex-file-compressed 11064362 / 10904724 / +1.5% 18823793 / 19420594 / -3.1% 0.59 / 0.56 / +4.7%
tpcds_q64/duckdb:vortex-file-compressed 49001793 / 49472292 / -1.0% 66023860 / 71244885 / -7.3% 0.74 / 0.69 / +6.9%
tpcds_q65/duckdb:vortex-file-compressed 14902737 / 14820303 / +0.6% 23966195 / 24034848 / -0.3% 0.62 / 0.62 / +0.8%
tpcds_q66/duckdb:vortex-file-compressed 30210551 / 28752794 / +5.1% 37818209 / 39353247 / -3.9% 0.80 / 0.73 / +9.3%
tpcds_q67/duckdb:vortex-file-compressed 57728687 / 57601924 / +0.2% 66154641 / 67966556 / -2.7% 0.87 / 0.85 / +3.0%
tpcds_q68/duckdb:vortex-file-compressed 18742892 / 18912868 / -0.9% 26263429 / 27115315 / -3.1% 0.71 / 0.70 / +2.3%
tpcds_q69/duckdb:vortex-file-compressed 21804886 / 21889694 / -0.4% 36312167 / 37150073 / -2.3% 0.60 / 0.59 / +1.9%
tpcds_q70/duckdb:vortex-file-compressed 15502732 / 15154084 / +2.3% 24881695 / 25463125 / -2.3% 0.62 / 0.60 / +4.7%
tpcds_q71/duckdb:vortex-file-compressed 13249234 / 13140692 / +0.8% 22013492 / 22609145 / -2.6% 0.60 / 0.58 / +3.6%
tpcds_q72/duckdb:vortex-file-compressed 54251818 / 54571606 / -0.6% 67163246 / 69680597 / -3.6% 0.81 / 0.78 / +3.1%
tpcds_q73/duckdb:vortex-file-compressed 11254474 / 11292456 / -0.3% 19619220 / 21579728 / -9.1% 0.57 / 0.52 / +9.6%
tpcds_q74/duckdb:vortex-file-compressed 25665127 / 25744138 / -0.3% 32609156 / 32639486 / -0.1% 0.79 / 0.79 / -0.2%
tpcds_q75/duckdb:vortex-file-compressed 28476418 / 28381128 / +0.3% 37801822 / 39723409 / -4.8% 0.75 / 0.71 / +5.4%
tpcds_q76/duckdb:vortex-file-compressed 12679302 / 12749266 / -0.5% 22473970 / 22164127 / +1.4% 0.56 / 0.58 / -1.9%
tpcds_q77/duckdb:vortex-file-compressed 20668700 / 20805642 / -0.7% 30409448 / 31017687 / -2.0% 0.68 / 0.67 / +1.3%
tpcds_q78/duckdb:vortex-file-compressed 43116861 / 43049532 / +0.2% 52241686 / 52905077 / -1.3% 0.83 / 0.81 / +1.4%
tpcds_q79/duckdb:vortex-file-compressed 12894377 / 13172228 / -2.1% 20727774 / 21482943 / -3.5% 0.62 / 0.61 / +1.5%
tpcds_q80/duckdb:vortex-file-compressed 36537562 / 36839727 / -0.8% 48306279 / 50065187 / -3.5% 0.76 / 0.74 / +2.8%
tpcds_q81/duckdb:vortex-file-compressed 20876448 / 21514548 / -3.0% 28604627 / 28088892 / +1.8% 0.73 / 0.77 / -4.7%
tpcds_q82/duckdb:vortex-file-compressed 9447585 / 9471068 / -0.2% 21450960 / 23305170 / -8.0% 0.44 / 0.41 / +8.4%
tpcds_q83/duckdb:vortex-file-compressed 17539166 / 17361868 / +1.0% 23546557 / 23934156 / -1.6% 0.74 / 0.73 / +2.7%
tpcds_q84/duckdb:vortex-file-compressed 15678307 / 15386896 / +1.9% 22777444 / 23920445 / -4.8% 0.69 / 0.64 / +7.0%
tpcds_q85/duckdb:vortex-file-compressed 24231568 / 23984764 / +1.0% 36124899 / 37479466 / -3.6% 0.67 / 0.64 / +4.8%
tpcds_q86/duckdb:vortex-file-compressed 9627701 / 9413486 / +2.3% 16756412 / 16759264 / -0.0% 0.57 / 0.56 / +2.3%
tpcds_q87/duckdb:vortex-file-compressed 25638604 / 25191540 / +1.8% 31140965 / 31132252 / +0.0% 0.82 / 0.81 / +1.7%
tpcds_q88/duckdb:vortex-file-compressed 37368431 / 36712856 / +1.8% 46626685 / 46579526 / +0.1% 0.80 / 0.79 / +1.7%
tpcds_q89/duckdb:vortex-file-compressed 11874873 / 12007304 / -1.1% 20367415 / 20833756 / -2.2% 0.58 / 0.58 / +1.2%
tpcds_q90/duckdb:vortex-file-compressed 8697832 / 8620174 / +0.9% 15034016 / 15498606 / -3.0% 0.58 / 0.56 / +4.0%
tpcds_q91/duckdb:vortex-file-compressed 13813142 / 13973633 / -1.1% 21138212 / 21091410 / +0.2% 0.65 / 0.66 / -1.4%
tpcds_q92/duckdb:vortex-file-compressed 11890120 / 11724999 / +1.4% 20374190 / 20578922 / -1.0% 0.58 / 0.57 / +2.4%
tpcds_q93/duckdb:vortex-file-compressed 10259801 / 10528320 / -2.6% 23013990 / 24921362 / -7.7% 0.45 / 0.42 / +5.5%
tpcds_q94/duckdb:vortex-file-compressed 21406496 / 21658296 / -1.2% 30712777 / 31235926 / -1.7% 0.70 / 0.69 / +0.5%
tpcds_q95/duckdb:vortex-file-compressed 40037950 / 40274731 / -0.6% 50602782 / 51831700 / -2.4% 0.79 / 0.78 / +1.8%
tpcds_q96/duckdb:vortex-file-compressed 6741341 / 6586216 / +2.4% 15680959 / 14929825 / +5.0% 0.43 / 0.44 / -2.5%
tpcds_q97/duckdb:vortex-file-compressed 22969792 / 23084140 / -0.5% 30041104 / 31742024 / -5.4% 0.76 / 0.73 / +5.1%
tpcds_q98/duckdb:vortex-file-compressed 11040446 / 11462822 / -3.7% 19111959 / 19310281 / -1.0% 0.58 / 0.59 / -2.7%
tpcds_q99/duckdb:vortex-file-compressed 14658252 / 14665620 / -0.1% 21761991 / 22234533 / -2.1% 0.67 / 0.66 / +2.1%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24083622 / 24137240 / -0.2% 30721148 / 31106568 / -1.2% 0.78 / 0.78 / +1.0%
tpcds_q02/duckdb:parquet 18439038 / 18341780 / +0.5% 24745381 / 24750369 / -0.0% 0.75 / 0.74 / +0.6%
tpcds_q03/duckdb:parquet 9888379 / 9741306 / +1.5% 15707544 / 15842140 / -0.8% 0.63 / 0.61 / +2.4%
tpcds_q04/duckdb:parquet 117793374 / 117738968 / +0.0% 123614366 / 128219587 / -3.6% 0.95 / 0.92 / +3.8%
tpcds_q05/duckdb:parquet 28713688 / 28846035 / -0.5% 33075492 / 33874399 / -2.4% 0.87 / 0.85 / +1.9%
tpcds_q06/duckdb:parquet 26623682 / 26900399 / -1.0% 36175703 / 35406046 / +2.2% 0.74 / 0.76 / -3.1%
tpcds_q07/duckdb:parquet 31311036 / 30840116 / +1.5% 39619849 / 39337682 / +0.7% 0.79 / 0.78 / +0.8%
tpcds_q08/duckdb:parquet 20212835 / 20158254 / +0.3% 25315119 / 25940507 / -2.4% 0.80 / 0.78 / +2.7%
tpcds_q09/duckdb:parquet 26838262 / 28248982 / -5.0% 30136312 / 30799906 / -2.2% 0.89 / 0.92 / -2.9%
tpcds_q10/duckdb:parquet 33536488 / 33066728 / +1.4% 40624964 / 41410598 / -1.9% 0.83 / 0.80 / +3.4%
tpcds_q11/duckdb:parquet 68818718 / 69073192 / -0.4% 74830054 / 75223795 / -0.5% 0.92 / 0.92 / +0.2%
tpcds_q12/duckdb:parquet 14132112 / 14259942 / -0.9% 19054146 / 19118924 / -0.3% 0.74 / 0.75 / -0.6%
tpcds_q13/duckdb:parquet 31177552 / 30964112 / +0.7% 39607189 / 41677816 / -5.0% 0.79 / 0.74 / +6.0%
tpcds_q14/duckdb:parquet 65331296 / 66946814 / -2.4% 69650661 / 69368416 / +0.4% 0.94 / 0.97 / -2.8%
tpcds_q15/duckdb:parquet 17034844 / 17120932 / -0.5% 23271631 / 23567616 / -1.3% 0.73 / 0.73 / +0.8%
tpcds_q16/duckdb:parquet 30475736 / 30825758 / -1.1% 37308216 / 37246456 / +0.2% 0.82 / 0.83 / -1.3%
tpcds_q17/duckdb:parquet 35160358 / 34797808 / +1.0% 40664018 / 40769994 / -0.3% 0.86 / 0.85 / +1.3%
tpcds_q18/duckdb:parquet 47815786 / 48205478 / -0.8% 55008734 / 55993189 / -1.8% 0.87 / 0.86 / +1.0%
tpcds_q19/duckdb:parquet 19206182 / 19210684 / -0.0% 25295823 / 26556131 / -4.7% 0.76 / 0.72 / +5.0%
tpcds_q20/duckdb:parquet 15402108 / 15199752 / +1.3% 19897215 / 19836977 / +0.3% 0.77 / 0.77 / +1.0%
tpcds_q21/duckdb:parquet 10896760 / 10767006 / +1.2% 16965730 / 17163881 / -1.2% 0.64 / 0.63 / +2.4%
tpcds_q22/duckdb:parquet 20803676 / 20693328 / +0.5% 26652413 / 26817093 / -0.6% 0.78 / 0.77 / +1.2%
tpcds_q23/duckdb:parquet 43103014 / 43556469 / -1.0% 48290500 / 48787111 / -1.0% 0.89 / 0.89 / -0.0%
tpcds_q24/duckdb:parquet 30549616 / 30484028 / +0.2% 36753189 / 37166768 / -1.1% 0.83 / 0.82 / +1.3%
tpcds_q25/duckdb:parquet 30736426 / 30668946 / +0.2% 37599416 / 37543671 / +0.1% 0.82 / 0.82 / +0.1%
tpcds_q26/duckdb:parquet 29186256 / 28984240 / +0.7% 34714568 / 35587823 / -2.5% 0.84 / 0.81 / +3.2%
tpcds_q27/duckdb:parquet 35222938 / 34608499 / +1.8% 41058294 / 42444067 / -3.3% 0.86 / 0.82 / +5.2%
tpcds_q28/duckdb:parquet 26982171 / 26975736 / +0.0% 36003919 / 35678324 / +0.9% 0.75 / 0.76 / -0.9%
tpcds_q29/duckdb:parquet 32230809 / 32782302 / -1.7% 39360245 / 40169323 / -2.0% 0.82 / 0.82 / +0.3%
tpcds_q30/duckdb:parquet 36175090 / 35846363 / +0.9% 44064117 / 45340946 / -2.8% 0.82 / 0.79 / +3.8%
tpcds_q31/duckdb:parquet 36133451 / 36114406 / +0.1% 43305523 / 43048356 / +0.6% 0.83 / 0.84 / -0.5%
tpcds_q32/duckdb:parquet 14582513 / 14505292 / +0.5% 21360542 / 21072806 / +1.4% 0.68 / 0.69 / -0.8%
tpcds_q33/duckdb:parquet 23759199 / 24405488 / -2.6% 29747626 / 29191183 / +1.9% 0.80 / 0.84 / -4.5%
tpcds_q34/duckdb:parquet 17885534 / 19425683 / -7.9% 24269688 / 24547777 / -1.1% 0.74 / 0.79 / -6.9%
tpcds_q35/duckdb:parquet 35883632 / 35464912 / +1.2% 44524807 / 44732832 / -0.5% 0.81 / 0.79 / +1.7%
tpcds_q36/duckdb:parquet 40051431 / 40470278 / -1.0% 48936110 / 48471617 / +1.0% 0.82 / 0.83 / -2.0%
tpcds_q37/duckdb:parquet 12704741 / 13032772 / -2.5% 19360883 / 20079974 / -3.6% 0.66 / 0.65 / +1.1%
tpcds_q38/duckdb:parquet 29698055 / 29834502 / -0.5% 33727151 / 34029735 / -0.9% 0.88 / 0.88 / +0.4%
tpcds_q39/duckdb:parquet 23495553 / 23637584 / -0.6% 29651525 / 30660029 / -3.3% 0.79 / 0.77 / +2.8%
tpcds_q40/duckdb:parquet 16478229 / 16368608 / +0.7% 22060141 / 22010712 / +0.2% 0.75 / 0.74 / +0.4%
tpcds_q41/duckdb:parquet 12206280 / 12265138 / -0.5% 18567502 / 18864399 / -1.6% 0.66 / 0.65 / +1.1%
tpcds_q42/duckdb:parquet 9614354 / 9709730 / -1.0% 15519120 / 16094206 / -3.6% 0.62 / 0.60 / +2.7%
tpcds_q43/duckdb:parquet 12412240 / 12390418 / +0.2% 18251759 / 18494602 / -1.3% 0.68 / 0.67 / +1.5%
tpcds_q44/duckdb:parquet 20929080 / 21291904 / -1.7% 26812536 / 28575104 / -6.2% 0.78 / 0.75 / +4.8%
tpcds_q45/duckdb:parquet 21326220 / 21224904 / +0.5% 27699632 / 28612804 / -3.2% 0.77 / 0.74 / +3.8%
tpcds_q46/duckdb:parquet 38054989 / 35903852 / +6.0% 44804994 / 45579293 / -1.7% 0.85 / 0.79 / +7.8%
tpcds_q47/duckdb:parquet 34630318 / 34339106 / +0.8% 41773333 / 41411913 / +0.9% 0.83 / 0.83 / -0.0%
tpcds_q48/duckdb:parquet 31783600 / 30076157 / +5.7% 37401573 / 36835992 / +1.5% 0.85 / 0.82 / +4.1%
tpcds_q49/duckdb:parquet 31633190 / 29917978 / +5.7% 36384563 / 36930925 / -1.5% 0.87 / 0.81 / +7.3%
tpcds_q50/duckdb:parquet 21167435 / 19850992 / +6.6% 25958366 / 26423927 / -1.8% 0.82 / 0.75 / +8.5%
tpcds_q51/duckdb:parquet 52174920 / 52724599 / -1.0% 59855919 / 60694565 / -1.4% 0.87 / 0.87 / +0.3%
tpcds_q52/duckdb:parquet 9720628 / 9859995 / -1.4% 15895649 / 15926365 / -0.2% 0.61 / 0.62 / -1.2%
tpcds_q53/duckdb:parquet 13997408 / 13926978 / +0.5% 21024859 / 21029207 / -0.0% 0.67 / 0.66 / +0.5%
tpcds_q54/duckdb:parquet 25235692 / 24999888 / +0.9% 32508838 / 32335342 / +0.5% 0.78 / 0.77 / +0.4%
tpcds_q55/duckdb:parquet 9592267 / 9578370 / +0.1% 15186839 / 15401629 / -1.4% 0.63 / 0.62 / +1.6%
tpcds_q56/duckdb:parquet 24901222 / 25098134 / -0.8% 30661258 / 31138621 / -1.5% 0.81 / 0.81 / +0.8%
tpcds_q57/duckdb:parquet 30713243 / 30772733 / -0.2% 36149495 / 36591093 / -1.2% 0.85 / 0.84 / +1.0%
tpcds_q58/duckdb:parquet 23958014 / 24150128 / -0.8% 30549560 / 30219328 / +1.1% 0.78 / 0.80 / -1.9%
tpcds_q59/duckdb:parquet 23382982 / 23259648 / +0.5% 29333189 / 29836012 / -1.7% 0.80 / 0.78 / +2.3%
tpcds_q60/duckdb:parquet 27946442 / 28573051 / -2.2% 31972799 / 33228607 / -3.8% 0.87 / 0.86 / +1.6%
tpcds_q61/duckdb:parquet 24940294 / 25700450 / -3.0% 30411083 / 30175991 / +0.8% 0.82 / 0.85 / -3.7%
tpcds_q62/duckdb:parquet 13200672 / 13405379 / -1.5% 18772148 / 18564135 / +1.1% 0.70 / 0.72 / -2.6%
tpcds_q63/duckdb:parquet 13654524 / 13620689 / +0.2% 20160189 / 19960917 / +1.0% 0.68 / 0.68 / -0.7%
tpcds_q64/duckdb:parquet 71744574 / 71721958 / +0.0% 81325405 / 82988801 / -2.0% 0.88 / 0.86 / +2.1%
tpcds_q65/duckdb:parquet 19155491 / 19976169 / -4.1% 24784006 / 25227312 / -1.8% 0.77 / 0.79 / -2.4%
tpcds_q66/duckdb:parquet 35752824 / 35689882 / +0.2% 42125101 / 42966969 / -2.0% 0.85 / 0.83 / +2.2%
tpcds_q67/duckdb:parquet 61006442 / 61142266 / -0.2% 67170461 / 68189052 / -1.5% 0.91 / 0.90 / +1.3%
tpcds_q68/duckdb:parquet 28664580 / 28514917 / +0.5% 36680309 / 36765703 / -0.2% 0.78 / 0.78 / +0.8%
tpcds_q69/duckdb:parquet 26371498 / 26084482 / +1.1% 34120688 / 35120124 / -2.8% 0.77 / 0.74 / +4.1%
tpcds_q70/duckdb:parquet 19743618 / 19723657 / +0.1% 26507313 / 26703384 / -0.7% 0.74 / 0.74 / +0.8%
tpcds_q71/duckdb:parquet 17130390 / 18335095 / -6.6% 24446348 / 23850665 / +2.5% 0.70 / 0.77 / -8.8%
tpcds_q72/duckdb:parquet 54515328 / 54848072 / -0.6% 61831489 / 62781673 / -1.5% 0.88 / 0.87 / +0.9%
tpcds_q73/duckdb:parquet 14932372 / 15044029 / -0.7% 21567724 / 21654952 / -0.4% 0.69 / 0.69 / -0.3%
tpcds_q74/duckdb:parquet 84004925 / 84941164 / -1.1% 91796675 / 90837980 / +1.1% 0.92 / 0.94 / -2.1%
tpcds_q75/duckdb:parquet 44967330 / 44271124 / +1.6% 50733290 / 50693544 / +0.1% 0.89 / 0.87 / +1.5%
tpcds_q76/duckdb:parquet 19571358 / 19544563 / +0.1% 23970152 / 24840008 / -3.5% 0.82 / 0.79 / +3.8%
tpcds_q77/duckdb:parquet 24677340 / 24755394 / -0.3% 32555130 / 31607990 / +3.0% 0.76 / 0.78 / -3.2%
tpcds_q78/duckdb:parquet 78138320 / 78814118 / -0.9% 86370814 / 89905217 / -3.9% 0.90 / 0.88 / +3.2%
tpcds_q79/duckdb:parquet 24582110 / 23518358 / +4.5% 29606094 / 29600410 / +0.0% 0.83 / 0.79 / +4.5%
tpcds_q80/duckdb:parquet 38605356 / 38110159 / +1.3% 43843329 / 45201885 / -3.0% 0.88 / 0.84 / +4.4%
tpcds_q81/duckdb:parquet 37133060 / 37230314 / -0.3% 45504107 / 45563789 / -0.1% 0.82 / 0.82 / -0.1%
tpcds_q82/duckdb:parquet 13718114 / 13661076 / +0.4% 20699451 / 20797112 / -0.5% 0.66 / 0.66 / +0.9%
tpcds_q83/duckdb:parquet 20699797 / 20613156 / +0.4% 25508657 / 25599193 / -0.4% 0.81 / 0.81 / +0.8%
tpcds_q84/duckdb:parquet 23331654 / 23447440 / -0.5% 28796518 / 28707000 / +0.3% 0.81 / 0.82 / -0.8%
tpcds_q85/duckdb:parquet 32859461 / 32953146 / -0.3% 40281459 / 39897923 / +1.0% 0.82 / 0.83 / -1.2%
tpcds_q86/duckdb:parquet 12268800 / 11986698 / +2.4% 16750199 / 17400001 / -3.7% 0.73 / 0.69 / +6.3%
tpcds_q87/duckdb:parquet 31452623 / 31391772 / +0.2% 35746589 / 36393865 / -1.8% 0.88 / 0.86 / +2.0%
tpcds_q88/duckdb:parquet 39750144 / 39511926 / +0.6% 46123277 / 47634668 / -3.2% 0.86 / 0.83 / +3.9%
tpcds_q89/duckdb:parquet 14630939 / 14385866 / +1.7% 21359780 / 21278238 / +0.4% 0.68 / 0.68 / +1.3%
tpcds_q90/duckdb:parquet 10125026 / 10117288 / +0.1% 15619467 / 15313553 / +2.0% 0.65 / 0.66 / -1.9%
tpcds_q91/duckdb:parquet 21265914 / 21292276 / -0.1% 28606452 / 29030445 / -1.5% 0.74 / 0.73 / +1.4%
tpcds_q92/duckdb:parquet 16060445 / 16096365 / -0.2% 22276016 / 22288192 / -0.1% 0.72 / 0.72 / -0.2%
tpcds_q93/duckdb:parquet 14217132 / 14346761 / -0.9% 20801170 / 20920455 / -0.6% 0.68 / 0.69 / -0.3%
tpcds_q94/duckdb:parquet 26226704 / 25770942 / +1.8% 32599450 / 32981083 / -1.2% 0.80 / 0.78 / +3.0%
tpcds_q95/duckdb:parquet 43639538 / 43807662 / -0.4% 49318629 / 50765309 / -2.8% 0.88 / 0.86 / +2.5%
tpcds_q96/duckdb:parquet 8402552 / 8360992 / +0.5% 13974514 / 14494716 / -3.6% 0.60 / 0.58 / +4.2%
tpcds_q97/duckdb:parquet 27549974 / 27739248 / -0.7% 34422446 / 33285643 / +3.4% 0.80 / 0.83 / -4.0%
tpcds_q98/duckdb:parquet 16603155 / 16573026 / +0.2% 23552655 / 24054895 / -2.1% 0.70 / 0.69 / +2.3%
tpcds_q99/duckdb:parquet 19321205 / 19255336 / +0.3% 24152314 / 24406556 / -1.0% 0.80 / 0.79 / +1.4%

No file size changes detected.

@github-actions github-actions Bot removed the action/bench-compress Run only the compression benchmark on this PR label Oct 27, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 26f9ea13 vs base 18c2340b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-1.0%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.985x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1219855 / 1260290 / -3.2% 22945862 / 22764332 / +0.8% 0.05 / 0.06 / -4.0%
clickbench_q01/datafusion:vortex-file-compressed 5937180 / 5917404 / +0.3% 33286353 / 32646523 / +2.0% 0.18 / 0.18 / -1.6%
clickbench_q02/datafusion:vortex-file-compressed 9133066 / 9836288 / -7.1% 37763223 / 38685013 / -2.4% 0.24 / 0.25 / -4.9%
clickbench_q03/datafusion:vortex-file-compressed 11064588 / 11890403 / -6.9% 51346030 / 51991014 / -1.2% 0.22 / 0.23 / -5.8%
clickbench_q04/datafusion:vortex-file-compressed 54429274 / 56290126 / -3.3% 92559768 / 93326414 / -0.8% 0.59 / 0.60 / -2.5%
clickbench_q05/datafusion:vortex-file-compressed 73314156 / 74159052 / -1.1% 115864083 / 120164591 / -3.6% 0.63 / 0.62 / +2.5%
clickbench_q06/datafusion:vortex-file-compressed 1237938 / 1292200 / -4.2% 22124791 / 21946407 / +0.8% 0.06 / 0.06 / -5.0%
clickbench_q07/datafusion:vortex-file-compressed 9176156 / 9307312 / -1.4% 32660808 / 32009042 / +2.0% 0.28 / 0.29 / -3.4%
clickbench_q08/datafusion:vortex-file-compressed 76223036 / 74943964 / +1.7% 122047596 / 114040649 / +7.0% 0.62 / 0.66 / -5.0%
clickbench_q09/datafusion:vortex-file-compressed 170687867 / 168069554 / +1.6% 209178368 / 209534411 / -0.2% 0.82 / 0.80 / +1.7%
clickbench_q10/datafusion:vortex-file-compressed 22401348 / 22905842 / -2.2% 66268905 / 66666596 / -0.6% 0.34 / 0.34 / -1.6%
clickbench_q11/datafusion:vortex-file-compressed 24636142 / 26226935 / -6.1% 68023068 / 66844079 / +1.8% 0.36 / 0.39 / -7.7%
clickbench_q12/datafusion:vortex-file-compressed 72129876 / 71599082 / +0.7% 119259918 / 119842785 / -0.5% 0.60 / 0.60 / +1.2%
clickbench_q13/datafusion:vortex-file-compressed 115214855 / 121975666 / -5.5% 174709110 / 177637875 / -1.6% 0.66 / 0.69 / -4.0%
clickbench_q14/datafusion:vortex-file-compressed 73379958 / 73885058 / -0.7% 120312470 / 121455129 / -0.9% 0.61 / 0.61 / +0.3%
clickbench_q15/datafusion:vortex-file-compressed 60172682 / 59919566 / +0.4% 95046176 / 94631372 / +0.4% 0.63 / 0.63 / -0.0%
clickbench_q16/datafusion:vortex-file-compressed 148296860 / 150654760 / -1.6% 202931106 / 208312625 / -2.6% 0.73 / 0.72 / +1.0%
clickbench_q17/datafusion:vortex-file-compressed 148368709 / 149325788 / -0.6% 214498914 / 210360576 / +2.0% 0.69 / 0.71 / -2.6%
clickbench_q18/datafusion:vortex-file-compressed 301062409 / 301888285 / -0.3% 374133637 / 366240380 / +2.2% 0.80 / 0.82 / -2.4%
clickbench_q19/datafusion:vortex-file-compressed 7880112 / 7476606 / +5.4% 48595947 / 49941763 / -2.7% 0.16 / 0.15 / +8.3%
clickbench_q20/datafusion:vortex-file-compressed 60202665 / 62526300 / -3.7% 232075184 / 222489274 / +4.3% 0.26 / 0.28 / -7.7%
clickbench_q21/datafusion:vortex-file-compressed 86706364 / 89979732 / -3.6% 269744309 / 267671930 / +0.8% 0.32 / 0.34 / -4.4%
clickbench_q22/datafusion:vortex-file-compressed 95500722 / 97127888 / -1.7% 344718750 / 343333629 / +0.4% 0.28 / 0.28 / -2.1%
clickbench_q23/datafusion:vortex-file-compressed 185632560 / 191966634 / -3.3% 399902643 / 423004301 / -5.5% 0.46 / 0.45 / +2.3%
clickbench_q24/datafusion:vortex-file-compressed 15338034 / 15773672 / -2.8% 65853469 / 64967967 / +1.4% 0.23 / 0.24 / -4.1%
clickbench_q25/datafusion:vortex-file-compressed 17896545 / 18440641 / -3.0% 56863988 / 55258287 / +2.9% 0.31 / 0.33 / -5.7%
clickbench_q26/datafusion:vortex-file-compressed 15285482 / 15588456 / -1.9% 63761194 / 68178457 / -6.5% 0.24 / 0.23 / +4.8%
clickbench_q27/datafusion:vortex-file-compressed 96967939 / 94658384 / +2.4% 241344494 / 243249493 / -0.8% 0.40 / 0.39 / +3.2%
clickbench_q28/datafusion:vortex-file-compressed 554423500 / 557171286 / -0.5% 619057507 / 621151215 / -0.3% 0.90 / 0.90 / -0.2%
clickbench_q29/datafusion:vortex-file-compressed 22913456 / 23200752 / -1.2% 50365999 / 48175698 / +4.5% 0.45 / 0.48 / -5.5%
clickbench_q30/datafusion:vortex-file-compressed 56411048 / 56553364 / -0.3% 102853604 / 104905927 / -2.0% 0.55 / 0.54 / +1.7%
clickbench_q31/datafusion:vortex-file-compressed 67843516 / 67065034 / +1.2% 151285589 / 151411821 / -0.1% 0.45 / 0.44 / +1.2%
clickbench_q32/datafusion:vortex-file-compressed 286070145 / 288170404 / -0.7% 386562083 / 377715260 / +2.3% 0.74 / 0.76 / -3.0%
clickbench_q33/datafusion:vortex-file-compressed 315444650 / 315388322 / +0.0% 423389862 / 421356769 / +0.5% 0.75 / 0.75 / -0.5%
clickbench_q34/datafusion:vortex-file-compressed 314937960 / 316966526 / -0.6% 418493442 / 437348138 / -4.3% 0.75 / 0.72 / +3.8%
clickbench_q35/datafusion:vortex-file-compressed 54046204 / 53806543 / +0.4% 89570180 / 86599649 / +3.4% 0.60 / 0.62 / -2.9%
clickbench_q36/datafusion:vortex-file-compressed 37291878 / 37173324 / +0.3% 66069020 / 64841417 / +1.9% 0.56 / 0.57 / -1.5%
clickbench_q37/datafusion:vortex-file-compressed 21431616 / 21525502 / -0.4% 47098768 / 48215304 / -2.3% 0.46 / 0.45 / +1.9%
clickbench_q38/datafusion:vortex-file-compressed 11175718 / 11508674 / -2.9% 39887505 / 37535171 / +6.3% 0.28 / 0.31 / -8.6%
clickbench_q39/datafusion:vortex-file-compressed 77320592 / 77714798 / -0.5% 109460842 / 109320042 / +0.1% 0.71 / 0.71 / -0.6%
clickbench_q40/datafusion:vortex-file-compressed 10866860 / 11199104 / -3.0% 37104310 / 37235564 / -0.4% 0.29 / 0.30 / -2.6%
clickbench_q41/datafusion:vortex-file-compressed 10238392 / 10746804 / -4.7% 36646075 / 37035161 / -1.1% 0.28 / 0.29 / -3.7%
clickbench_q42/datafusion:vortex-file-compressed 11006286 / 11019819 / -0.1% 37165834 / 36717475 / +1.2% 0.30 / 0.30 / -1.3%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1246740 / 1269415 / -1.8% 48276827 / 49909518 / -3.3% 0.03 / 0.03 / +1.5%
clickbench_q01/datafusion:parquet 15790878 / 16167106 / -2.3% 70841426 / 66666333 / +6.3% 0.22 / 0.24 / -8.1%
clickbench_q02/datafusion:parquet 18556816 / 18423731 / +0.7% 78368223 / 79715185 / -1.7% 0.24 / 0.23 / +2.5%
clickbench_q03/datafusion:parquet 16666694 / 17322046 / -3.8% 78220930 / 80434246 / -2.8% 0.21 / 0.22 / -1.1%
clickbench_q04/datafusion:parquet 63266452 / 64187586 / -1.4% 123285698 / 127995520 / -3.7% 0.51 / 0.50 / +2.3%
clickbench_q05/datafusion:parquet 88822926 / 88425984 / +0.4% 154524736 / 157925765 / -2.2% 0.57 / 0.56 / +2.7%
clickbench_q06/datafusion:parquet 1259330 / 1288868 / -2.3% 47928988 / 49208813 / -2.6% 0.03 / 0.03 / +0.3%
clickbench_q07/datafusion:parquet 17214775 / 16636052 / +3.5% 66994843 / 67936676 / -1.4% 0.26 / 0.24 / +4.9%
clickbench_q08/datafusion:parquet 86030836 / 86898988 / -1.0% 157405918 / 163733121 / -3.9% 0.55 / 0.53 / +3.0%
clickbench_q09/datafusion:parquet 189173814 / 185072722 / +2.2% 269258414 / 267949042 / +0.5% 0.70 / 0.69 / +1.7%
clickbench_q10/datafusion:parquet 36471648 / 36087968 / +1.1% 99786703 / 101168937 / -1.4% 0.37 / 0.36 / +2.5%
clickbench_q11/datafusion:parquet 42589336 / 43223942 / -1.5% 107803550 / 110784704 / -2.7% 0.40 / 0.39 / +1.3%
clickbench_q12/datafusion:parquet 96849486 / 95340401 / +1.6% 161659122 / 163066656 / -0.9% 0.60 / 0.58 / +2.5%
clickbench_q13/datafusion:parquet 147308047 / 149579272 / -1.5% 226568847 / 226902810 / -0.1% 0.65 / 0.66 / -1.4%
clickbench_q14/datafusion:parquet 101796103 / 102904147 / -1.1% 169978676 / 172752942 / -1.6% 0.60 / 0.60 / +0.5%
clickbench_q15/datafusion:parquet 71176676 / 70844776 / +0.5% 130796491 / 130694291 / +0.1% 0.54 / 0.54 / +0.4%
clickbench_q16/datafusion:parquet 157217408 / 156228421 / +0.6% 232105973 / 237429600 / -2.2% 0.68 / 0.66 / +2.9%
clickbench_q17/datafusion:parquet 157356888 / 157572748 / -0.1% 236425323 / 240151572 / -1.6% 0.67 / 0.66 / +1.4%
clickbench_q18/datafusion:parquet 308905840 / 311093780 / -0.7% 421680041 / 417916424 / +0.9% 0.73 / 0.74 / -1.6%
clickbench_q19/datafusion:parquet 19336910 / 19666154 / -1.7% 77528938 / 77675201 / -0.2% 0.25 / 0.25 / -1.5%
clickbench_q20/datafusion:parquet 178039594 / 181581086 / -2.0% 283975830 / 299215692 / -5.1% 0.63 / 0.61 / +3.3%
clickbench_q21/datafusion:parquet 172073300 / 173692752 / -0.9% 302576366 / 314697920 / -3.9% 0.57 / 0.55 / +3.0%
clickbench_q22/datafusion:parquet 260017148 / 259991548 / +0.0% 427315156 / 454472747 / -6.0% 0.61 / 0.57 / +6.4%
clickbench_q23/datafusion:parquet 1009780655 / 1012003723 / -0.2% 1197201470 / 1214426868 / -1.4% 0.84 / 0.83 / +1.2%
clickbench_q24/datafusion:parquet 29997302 / 30578612 / -1.9% 87073775 / 90344835 / -3.6% 0.34 / 0.34 / +1.8%
clickbench_q25/datafusion:parquet 37201666 / 37289176 / -0.2% 102483242 / 106187086 / -3.5% 0.36 / 0.35 / +3.4%
clickbench_q26/datafusion:parquet 30381692 / 30948474 / -1.8% 88532655 / 91344191 / -3.1% 0.34 / 0.34 / +1.3%
clickbench_q27/datafusion:parquet 192326021 / 193661324 / -0.7% 290059544 / 301780291 / -3.9% 0.66 / 0.64 / +3.3%
clickbench_q28/datafusion:parquet 612479116 / 622527664 / -1.6% 697704138 / 710362808 / -1.8% 0.88 / 0.88 / +0.2%
clickbench_q29/datafusion:parquet 29352336 / 28922266 / +1.5% 89007764 / 89028337 / -0.0% 0.33 / 0.32 / +1.5%
clickbench_q30/datafusion:parquet 89311308 / 90541170 / -1.4% 171130948 / 174862893 / -2.1% 0.52 / 0.52 / +0.8%
clickbench_q31/datafusion:parquet 101833308 / 104529353 / -2.6% 194190928 / 197301844 / -1.6% 0.52 / 0.53 / -1.0%
clickbench_q32/datafusion:parquet 306604621 / 311886295 / -1.7% 432227927 / 429591192 / +0.6% 0.71 / 0.73 / -2.3%
clickbench_q33/datafusion:parquet 375706992 / 379855112 / -1.1% 477040197 / 476420256 / +0.1% 0.79 / 0.80 / -1.2%
clickbench_q34/datafusion:parquet 376340886 / 379854352 / -0.9% 473459604 / 476892321 / -0.7% 0.79 / 0.80 / -0.2%
clickbench_q35/datafusion:parquet 64700532 / 64808676 / -0.2% 123362194 / 122721260 / +0.5% 0.52 / 0.53 / -0.7%
clickbench_q36/datafusion:parquet 73020948 / 73760523 / -1.0% 134043708 / 133574882 / +0.4% 0.54 / 0.55 / -1.3%
clickbench_q37/datafusion:parquet 35412078 / 35226114 / +0.5% 89026392 / 89754154 / -0.8% 0.40 / 0.39 / +1.3%
clickbench_q38/datafusion:parquet 47398144 / 47823760 / -0.9% 106470122 / 107839493 / -1.3% 0.45 / 0.44 / +0.4%
clickbench_q39/datafusion:parquet 144484427 / 143447452 / +0.7% 209435349 / 210511767 / -0.5% 0.69 / 0.68 / +1.2%
clickbench_q40/datafusion:parquet 19989706 / 20086129 / -0.5% 75727032 / 76605973 / -1.1% 0.26 / 0.26 / +0.7%
clickbench_q41/datafusion:parquet 18653770 / 18452871 / +1.1% 75451830 / 74570430 / +1.2% 0.25 / 0.25 / -0.1%
clickbench_q42/datafusion:parquet 18983940 / 18876772 / +0.6% 74206069 / 75266533 / -1.4% 0.26 / 0.25 / +2.0%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2214263 / 2290450 / -3.3% 23842802 / 24419378 / -2.4% 0.09 / 0.09 / -1.0%
clickbench_q01/duckdb:vortex-file-compressed 7018458 / 6979582 / +0.6% 26943985 / 26564703 / +1.4% 0.26 / 0.26 / -0.9%
clickbench_q02/duckdb:vortex-file-compressed 8045621 / 7901401 / +1.8% 34717668 / 37286784 / -6.9% 0.23 / 0.21 / +9.4%
clickbench_q03/duckdb:vortex-file-compressed 13955938 / 14181185 / -1.6% 58891704 / 57624311 / +2.2% 0.24 / 0.25 / -3.7%
clickbench_q04/duckdb:vortex-file-compressed 55894690 / 57266712 / -2.4% 101975990 / 98978242 / +3.0% 0.55 / 0.58 / -5.3%
clickbench_q05/duckdb:vortex-file-compressed 64097248 / 63853338 / +0.4% 94293081 / 96618199 / -2.4% 0.68 / 0.66 / +2.9%
clickbench_q06/duckdb:vortex-file-compressed 2693660 / 2638184 / +2.1% 28136145 / 29627264 / -5.0% 0.10 / 0.09 / +7.5%
clickbench_q07/duckdb:vortex-file-compressed 8265677 / 8289530 / -0.3% 30219207 / 29057792 / +4.0% 0.27 / 0.29 / -4.1%
clickbench_q08/duckdb:vortex-file-compressed 69634099 / 66971360 / +4.0% 113956191 / 109727460 / +3.9% 0.61 / 0.61 / +0.1%
clickbench_q09/duckdb:vortex-file-compressed 89875016 / 89382352 / +0.6% 128686888 / 127641063 / +0.8% 0.70 / 0.70 / -0.3%
clickbench_q10/duckdb:vortex-file-compressed 26142214 / 26192691 / -0.2% 72158949 / 71759860 / +0.6% 0.36 / 0.37 / -0.7%
clickbench_q11/duckdb:vortex-file-compressed 28276632 / 28692499 / -1.4% 73315893 / 74445954 / -1.5% 0.39 / 0.39 / +0.1%
clickbench_q12/duckdb:vortex-file-compressed 70056981 / 69448134 / +0.9% 99373161 / 100111498 / -0.7% 0.70 / 0.69 / +1.6%
clickbench_q13/duckdb:vortex-file-compressed 125085914 / 125517960 / -0.3% 166671006 / 166538839 / +0.1% 0.75 / 0.75 / -0.4%
clickbench_q14/duckdb:vortex-file-compressed 73242160 / 74437824 / -1.6% 104974528 / 103254440 / +1.7% 0.70 / 0.72 / -3.2%
clickbench_q15/duckdb:vortex-file-compressed 74932840 / 75280712 / -0.5% 116739306 / 117745869 / -0.9% 0.64 / 0.64 / +0.4%
clickbench_q16/duckdb:vortex-file-compressed 136746242 / 137136246 / -0.3% 183075788 / 180045582 / +1.7% 0.75 / 0.76 / -1.9%
clickbench_q17/duckdb:vortex-file-compressed 142350216 / 139861059 / +1.8% 176314766 / 177724546 / -0.8% 0.81 / 0.79 / +2.6%
clickbench_q18/duckdb:vortex-file-compressed 254972422 / 254612998 / +0.1% 318145838 / 314325300 / +1.2% 0.80 / 0.81 / -1.1%
clickbench_q19/duckdb:vortex-file-compressed 9195673 / 9304701 / -1.2% 44228240 / 44714893 / -1.1% 0.21 / 0.21 / -0.1%
clickbench_q20/duckdb:vortex-file-compressed 65143520 / 63970238 / +1.8% 172747385 / 164094015 / +5.3% 0.38 / 0.39 / -3.3%
clickbench_q21/duckdb:vortex-file-compressed 96217550 / 96138959 / +0.1% 283987971 / 281122088 / +1.0% 0.34 / 0.34 / -0.9%
clickbench_q22/duckdb:vortex-file-compressed 172896224 / 173477940 / -0.3% 436384956 / 435563252 / +0.2% 0.40 / 0.40 / -0.5%
clickbench_q23/duckdb:vortex-file-compressed 32847074 / 35339356 / -7.1% 86403446 / 84846695 / +1.8% 0.38 / 0.42 / -8.7%
clickbench_q24/duckdb:vortex-file-compressed 13517214 / 14192194 / -4.8% 35162224 / 36516145 / -3.7% 0.38 / 0.39 / -1.1%
clickbench_q25/duckdb:vortex-file-compressed 18465856 / 18700420 / -1.3% 51089063 / 50142193 / +1.9% 0.36 / 0.37 / -3.1%
clickbench_q26/duckdb:vortex-file-compressed 11285721 / 11208584 / +0.7% 35853020 / 34960252 / +2.6% 0.31 / 0.32 / -1.8%
clickbench_q27/duckdb:vortex-file-compressed 53788344 / 54087599 / -0.6% 222572558 / 220891548 / +0.8% 0.24 / 0.24 / -1.3%
clickbench_q28/duckdb:vortex-file-compressed 510698422 / 508969963 / +0.3% 580668292 / 584265502 / -0.6% 0.88 / 0.87 / +1.0%
clickbench_q29/duckdb:vortex-file-compressed 17077214 / 17013793 / +0.4% 44472480 / 45556732 / -2.4% 0.38 / 0.37 / +2.8%
clickbench_q30/duckdb:vortex-file-compressed 59598305 / 59283464 / +0.5% 111019326 / 108942368 / +1.9% 0.54 / 0.54 / -1.3%
clickbench_q31/duckdb:vortex-file-compressed 109468224 / 108913202 / +0.5% 197698756 / 194696506 / +1.5% 0.55 / 0.56 / -1.0%
clickbench_q32/duckdb:vortex-file-compressed 372387594 / 366972409 / +1.5% 400323334 / 407167798 / -1.7% 0.93 / 0.90 / +3.2%
clickbench_q33/duckdb:vortex-file-compressed 352440102 / 346739188 / +1.6% 442170323 / 442801717 / -0.1% 0.80 / 0.78 / +1.8%
clickbench_q34/duckdb:vortex-file-compressed 355469704 / 363730090 / -2.3% 454318475 / 462139681 / -1.7% 0.78 / 0.79 / -0.6%
clickbench_q35/duckdb:vortex-file-compressed 57201667 / 55952162 / +2.2% 91379669 / 93264985 / -2.0% 0.63 / 0.60 / +4.3%
clickbench_q36/duckdb:vortex-file-compressed 11848957 / 11421911 / +3.7% 32722050 / 33226336 / -1.5% 0.36 / 0.34 / +5.3%
clickbench_q37/duckdb:vortex-file-compressed 7930182 / 8117178 / -2.3% 30038905 / 28947379 / +3.8% 0.26 / 0.28 / -5.9%
clickbench_q38/duckdb:vortex-file-compressed 8503224 / 8408544 / +1.1% 30654557 / 29331338 / +4.5% 0.28 / 0.29 / -3.2%
clickbench_q39/duckdb:vortex-file-compressed 19480522 / 19465959 / +0.1% 40716947 / 38425414 / +6.0% 0.48 / 0.51 / -5.6%
clickbench_q40/duckdb:vortex-file-compressed 6880442 / 6988231 / -1.5% 29033478 / 27827592 / +4.3% 0.24 / 0.25 / -5.6%
clickbench_q41/duckdb:vortex-file-compressed 7758374 / 7747622 / +0.1% 29379809 / 29480353 / -0.3% 0.26 / 0.26 / +0.5%
clickbench_q42/duckdb:vortex-file-compressed 7100205 / 7020338 / +1.1% 28870610 / 27812123 / +3.8% 0.25 / 0.25 / -2.6%
duckdb / parquet / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9892425 / 11529126 / -14.2% 🟢 18762792 / 18076743 / +3.8% 0.53 / 0.64 / -17.3%
clickbench_q01/duckdb:parquet 17256614 / 17290644 / -0.2% 23583221 / 24420663 / -3.4% 0.73 / 0.71 / +3.3%
clickbench_q02/duckdb:parquet 23756372 / 24079778 / -1.3% 34474391 / 34722239 / -0.7% 0.69 / 0.69 / -0.6%
clickbench_q03/duckdb:parquet 24561564 / 24276945 / +1.2% 38018185 / 38352231 / -0.9% 0.65 / 0.63 / +2.1%
clickbench_q04/duckdb:parquet 63268068 / 63737882 / -0.7% 79716345 / 76688238 / +3.9% 0.79 / 0.83 / -4.5%
clickbench_q05/duckdb:parquet 84005315 / 86212391 / -2.6% 104713807 / 100761528 / +3.9% 0.80 / 0.86 / -6.2%
clickbench_q06/duckdb:parquet 22135996 / 22406575 / -1.2% 30739433 / 31153768 / -1.3% 0.72 / 0.72 / +0.1%
clickbench_q07/duckdb:parquet 18665078 / 18239734 / +2.3% 27348986 / 29498561 / -7.3% 0.68 / 0.62 / +10.4%
clickbench_q08/duckdb:parquet 76742544 / 78051887 / -1.7% 90449215 / 91597392 / -1.3% 0.85 / 0.85 / -0.4%
clickbench_q09/duckdb:parquet 105553509 / 103609995 / +1.9% 125551115 / 127067405 / -1.2% 0.84 / 0.82 / +3.1%
clickbench_q10/duckdb:parquet 42241146 / 42510372 / -0.6% 58335174 / 61145413 / -4.6% 0.72 / 0.70 / +4.2%
clickbench_q11/duckdb:parquet 47695466 / 48010534 / -0.7% 66275516 / 66548522 / -0.4% 0.72 / 0.72 / -0.2%
clickbench_q12/duckdb:parquet 94579856 / 94928676 / -0.4% 114885525 / 114243904 / +0.6% 0.82 / 0.83 / -0.9%
clickbench_q13/duckdb:parquet 154697438 / 155918680 / -0.8% 180234573 / 174731684 / +3.1% 0.86 / 0.89 / -3.8%
clickbench_q14/duckdb:parquet 103301392 / 103857154 / -0.5% 129304809 / 123652899 / +4.6% 0.80 / 0.84 / -4.9%
clickbench_q15/duckdb:parquet 88811162 / 89166059 / -0.4% 107033404 / 101548942 / +5.4% 0.83 / 0.88 / -5.5%
clickbench_q16/duckdb:parquet 171912497 / 172219193 / -0.2% 189644260 / 188759406 / +0.5% 0.91 / 0.91 / -0.6%
clickbench_q17/duckdb:parquet 177548304 / 173307210 / +2.4% 192551836 / 188462548 / +2.2% 0.92 / 0.92 / +0.3%
clickbench_q18/duckdb:parquet 319909860 / 308669277 / +3.6% 333397519 / 347090808 / -3.9% 0.96 / 0.89 / +7.9%
clickbench_q19/duckdb:parquet 21818184 / 21109800 / +3.4% 30952137 / 30426135 / +1.7% 0.70 / 0.69 / +1.6%
clickbench_q20/duckdb:parquet 184064900 / 184590750 / -0.3% 220682052 / 232741641 / -5.2% 0.83 / 0.79 / +5.2%
clickbench_q21/duckdb:parquet 226356676 / 225872686 / +0.2% 263310488 / 262335061 / +0.4% 0.86 / 0.86 / -0.2%
clickbench_q22/duckdb:parquet 326518053 / 314230188 / +3.9% 373248158 / 364566197 / +2.4% 0.87 / 0.86 / +1.5%
clickbench_q23/duckdb:parquet 169682549 / 167255030 / +1.5% 242214761 / 246464193 / -1.7% 0.70 / 0.68 / +3.2%
clickbench_q24/duckdb:parquet 33842514 / 32960618 / +2.7% 47821750 / 52874646 / -9.6% 0.71 / 0.62 / +13.5%
clickbench_q25/duckdb:parquet 45255504 / 44171132 / +2.5% 64353034 / 59938387 / +7.4% 0.70 / 0.74 / -4.6%
clickbench_q26/duckdb:parquet 33705445 / 32601054 / +3.4% 52444964 / 48001561 / +9.3% 0.64 / 0.68 / -5.4%
clickbench_q27/duckdb:parquet 195013790 / 185396910 / +5.2% 233411241 / 227697353 / +2.5% 0.84 / 0.81 / +2.6%
clickbench_q28/duckdb:parquet 1001830100 / 993609170 / +0.8% 975048766 / 975942532 / -0.1% 1.03 / 1.02 / +0.9%
clickbench_q29/duckdb:parquet 26010620 / 25841442 / +0.7% 35109448 / 36174610 / -2.9% 0.74 / 0.71 / +3.7%
clickbench_q30/duckdb:parquet 108762872 / 107718313 / +1.0% 136169361 / 134424986 / +1.3% 0.80 / 0.80 / -0.3%
clickbench_q31/duckdb:parquet 162644460 / 161295004 / +0.8% 185015545 / 184732921 / +0.2% 0.88 / 0.87 / +0.7%
clickbench_q32/duckdb:parquet 404205330 / 389621039 / +3.7% 422889569 / 423315501 / -0.1% 0.96 / 0.92 / +3.8%
clickbench_q33/duckdb:parquet 482327011 / 493705422 / -2.3% 463141414 / 455420649 / +1.7% 1.04 / 1.08 / -3.9%
clickbench_q34/duckdb:parquet 475971977 / 475457076 / +0.1% 461339845 / 478197740 / -3.5% 1.03 / 0.99 / +3.8%
clickbench_q35/duckdb:parquet 64067682 / 63102746 / +1.5% 79240994 / 79638805 / -0.5% 0.81 / 0.79 / +2.0%
clickbench_q36/duckdb:parquet 32221729 / 32469286 / -0.8% 41626340 / 40783264 / +2.1% 0.77 / 0.80 / -2.8%
clickbench_q37/duckdb:parquet 25462119 / 25885208 / -1.6% 34747837 / 33897371 / +2.5% 0.73 / 0.76 / -4.0%
clickbench_q38/duckdb:parquet 25128554 / 26300148 / -4.5% 34520376 / 35243400 / -2.1% 0.73 / 0.75 / -2.5%
clickbench_q39/duckdb:parquet 53984771 / 54138808 / -0.3% 64939262 / 65218920 / -0.4% 0.83 / 0.83 / +0.1%
clickbench_q40/duckdb:parquet 16017694 / 16163056 / -0.9% 24579247 / 24626685 / -0.2% 0.65 / 0.66 / -0.7%
clickbench_q41/duckdb:parquet 15896262 / 16828336 / -5.5% 25235896 / 24732303 / +2.0% 0.63 / 0.68 / -7.4%
clickbench_q42/duckdb:parquet 15526483 / 16684064 / -6.9% 25082153 / 25401467 / -1.3% 0.62 / 0.66 / -5.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 26f9ea13 vs base 18c2340b
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.7%
Engines: DataFusion No clear signal (+8.2%, environment too noisy confidence) · DuckDB No clear signal (-2.5%, environment too noisy confidence)
Vortex (geomean): hot 1.086x ➖ · cold 1.110x ➖
Parquet (geomean): hot 1.057x ➖ · cold 1.046x ➖
Shifts: Parquet (control) +5.7% · Median polish +6.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.137x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 217183854 / 251697417 / -13.7% 960451887 / 920272200 / +4.4% 0.23 / 0.27 / -17.3%
tpch_q02/datafusion:vortex-file-compressed 361587629 / 312607297 / +15.7% 833533586 / 678032303 / +22.9% 0.43 / 0.46 / -5.9%
tpch_q03/datafusion:vortex-file-compressed 356128474 / 376916757 / -5.5% 859718890 / 944067135 / -8.9% 0.41 / 0.40 / +3.8%
tpch_q04/datafusion:vortex-file-compressed 390640665 / 206530158 / +89.1% 🔴 922381244 / 541732578 / +70.3% 🔴 0.42 / 0.38 / +11.1%
tpch_q05/datafusion:vortex-file-compressed 438838044 / 407063101 / +7.8% 652470517 / 552991544 / +18.0% 0.67 / 0.74 / -8.6%
tpch_q06/datafusion:vortex-file-compressed 150731452 / 137793447 / +9.4% 311039639 / 283143174 / +9.9% 0.48 / 0.49 / -0.4%
tpch_q07/datafusion:vortex-file-compressed 549436603 / 397829046 / +38.1% 🔴 674856291 / 581450238 / +16.1% 0.81 / 0.68 / +19.0%
tpch_q08/datafusion:vortex-file-compressed 617257772 / 422542994 / +46.1% 🔴 830378170 / 577397594 / +43.8% 🔴 0.74 / 0.73 / +1.6%
tpch_q09/datafusion:vortex-file-compressed 319287119 / 298858121 / +6.8% 487631810 / 587470714 / -17.0% 0.65 / 0.51 / +28.7%
tpch_q10/datafusion:vortex-file-compressed 660389296 / 339275688 / +94.6% 🔴 955702412 / 507580664 / +88.3% 🔴 0.69 / 0.67 / +3.4%
tpch_q11/datafusion:vortex-file-compressed 284367060 / 294255244 / -3.4% 426055859 / 497850065 / -14.4% 0.67 / 0.59 / +12.9%
tpch_q12/datafusion:vortex-file-compressed 203932807 / 297228893 / -31.4% 🟢 473424074 / 441533602 / +7.2% 0.43 / 0.67 / -36.0%
tpch_q13/datafusion:vortex-file-compressed 158614783 / 141520626 / +12.1% 353291352 / 339470087 / +4.1% 0.45 / 0.42 / +7.7%
tpch_q14/datafusion:vortex-file-compressed 173420731 / 177804775 / -2.5% 373047306 / 382779467 / -2.5% 0.46 / 0.46 / +0.1%
tpch_q15/datafusion:vortex-file-compressed 320192245 / 308718140 / +3.7% 547896002 / 551622865 / -0.7% 0.58 / 0.56 / +4.4%
tpch_q16/datafusion:vortex-file-compressed 160628743 / 141896686 / +13.2% 437360859 / 265346235 / +64.8% 🔴 0.37 / 0.53 / -31.3%
tpch_q17/datafusion:vortex-file-compressed 285487190 / 283832922 / +0.6% 471960851 / 461298689 / +2.3% 0.60 / 0.62 / -1.7%
tpch_q18/datafusion:vortex-file-compressed 461314549 / 282552962 / +63.3% 🔴 973793253 / 459657823 / +111.9% 🔴 0.47 / 0.61 / -22.9%
tpch_q19/datafusion:vortex-file-compressed 311956249 / 301624249 / +3.4% 430399765 / 379157594 / +13.5% 0.72 / 0.80 / -8.9%
tpch_q20/datafusion:vortex-file-compressed 312707564 / 294815938 / +6.1% 473120104 / 468020446 / +1.1% 0.66 / 0.63 / +4.9%
tpch_q21/datafusion:vortex-file-compressed 617909486 / 554003780 / +11.5% 920368163 / 755941945 / +21.8% 0.67 / 0.73 / -8.4%
tpch_q22/datafusion:vortex-file-compressed 179026415 / 160778066 / +11.4% 518875338 / 378031683 / +37.3% 🔴 0.35 / 0.43 / -18.9%
datafusion / parquet / ns (1.050x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 160527847 / 177193386 / -9.4% 533585121 / 493113004 / +8.2% 0.30 / 0.36 / -16.3%
tpch_q02/datafusion:parquet 303274529 / 281762440 / +7.6% 558106404 / 474954449 / +17.5% 0.54 / 0.59 / -8.4%
tpch_q03/datafusion:parquet 280736860 / 249521919 / +12.5% 795342743 / 586280711 / +35.7% 🔴 0.35 / 0.43 / -17.1%
tpch_q04/datafusion:parquet 162899746 / 148295413 / +9.8% 313846692 / 340618358 / -7.9% 0.52 / 0.44 / +19.2%
tpch_q05/datafusion:parquet 341824810 / 370307068 / -7.7% 539989771 / 474961126 / +13.7% 0.63 / 0.78 / -18.8%
tpch_q06/datafusion:parquet 119657601 / 122201018 / -2.1% 218566671 / 220707354 / -1.0% 0.55 / 0.55 / -1.1%
tpch_q07/datafusion:parquet 359998144 / 347669219 / +3.5% 462982238 / 466896084 / -0.8% 0.78 / 0.74 / +4.4%
tpch_q08/datafusion:parquet 630002817 / 422664473 / +49.1% 🔴 705760026 / 723914746 / -2.5% 0.89 / 0.58 / +52.9%
tpch_q09/datafusion:parquet 406215282 / 384883107 / +5.5% 568356070 / 523526803 / +8.6% 0.71 / 0.74 / -2.8%
tpch_q10/datafusion:parquet 316015355 / 323913684 / -2.4% 577665890 / 484606862 / +19.2% 0.55 / 0.67 / -18.2%
tpch_q11/datafusion:parquet 282362523 / 250894273 / +12.5% 388319396 / 355363984 / +9.3% 0.73 / 0.71 / +3.0%
tpch_q12/datafusion:parquet 173156592 / 171974291 / +0.7% 319034483 / 430708802 / -25.9% 0.54 / 0.40 / +35.9%
tpch_q13/datafusion:parquet 278855445 / 278689392 / +0.1% 440567007 / 397878277 / +10.7% 0.63 / 0.70 / -9.6%
tpch_q14/datafusion:parquet 171551096 / 172236201 / -0.4% 304761608 / 344465733 / -11.5% 0.56 / 0.50 / +12.6%
tpch_q15/datafusion:parquet 315489468 / 324654048 / -2.8% 556981216 / 513080096 / +8.6% 0.57 / 0.63 / -10.5%
tpch_q16/datafusion:parquet 110902668 / 104324144 / +6.3% 275425830 / 201256240 / +36.9% 🔴 0.40 / 0.52 / -22.3%
tpch_q17/datafusion:parquet 288185471 / 380986683 / -24.4% 423091588 / 569406664 / -25.7% 0.68 / 0.67 / +1.8%
tpch_q18/datafusion:parquet 502333960 / 331916456 / +51.3% 🔴 710755578 / 572395205 / +24.2% 0.71 / 0.58 / +21.9%
tpch_q19/datafusion:parquet 178775278 / 169069286 / +5.7% 335106835 / 305876916 / +9.6% 0.53 / 0.55 / -3.5%
tpch_q20/datafusion:parquet 277986302 / 281208740 / -1.1% 426483202 / 435165649 / -2.0% 0.65 / 0.65 / +0.9%
tpch_q21/datafusion:parquet 343362762 / 301384227 / +13.9% 541627877 / 555687442 / -2.5% 0.63 / 0.54 / +16.9%
tpch_q22/datafusion:parquet 170645297 / 159137037 / +7.2% 344587464 / 298052757 / +15.6% 0.50 / 0.53 / -7.2%
duckdb / vortex-file-compressed / ns (1.037x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 247062000 / 247642309 / -0.2% 266945172 / 254271143 / +5.0% 0.93 / 0.97 / -5.0%
tpch_q02/duckdb:vortex-file-compressed 446396920 / 453034761 / -1.5% 482344115 / 532576782 / -9.4% 0.93 / 0.85 / +8.8%
tpch_q03/duckdb:vortex-file-compressed 424057861 / 406672458 / +4.3% 493563243 / 500000202 / -1.3% 0.86 / 0.81 / +5.6%
tpch_q04/duckdb:vortex-file-compressed 249474678 / 238315672 / +4.7% 307145224 / 258836806 / +18.7% 0.81 / 0.92 / -11.8%
tpch_q05/duckdb:vortex-file-compressed 537539806 / 504192706 / +6.6% 587338619 / 598804529 / -1.9% 0.92 / 0.84 / +8.7%
tpch_q06/duckdb:vortex-file-compressed 186744244 / 167810134 / +11.3% 236815355 / 198328060 / +19.4% 0.79 / 0.85 / -6.8%
tpch_q07/duckdb:vortex-file-compressed 441221923 / 452328711 / -2.5% 529077955 / 526059031 / +0.6% 0.83 / 0.86 / -3.0%
tpch_q08/duckdb:vortex-file-compressed 636049588 / 618935340 / +2.8% 815828538 / 646314494 / +26.2% 0.78 / 0.96 / -18.6%
tpch_q09/duckdb:vortex-file-compressed 420201078 / 400586327 / +4.9% 515902851 / 444467771 / +16.1% 0.81 / 0.90 / -9.6%
tpch_q10/duckdb:vortex-file-compressed 543041354 / 534563693 / +1.6% 561625467 / 525715908 / +6.8% 0.97 / 1.02 / -4.9%
tpch_q11/duckdb:vortex-file-compressed 335868939 / 505690526 / -33.6% 🟢 407682898 / 429406209 / -5.1% 0.82 / 1.18 / -30.0%
tpch_q12/duckdb:vortex-file-compressed 265977968 / 247169720 / +7.6% 280360074 / 280334186 / +0.0% 0.95 / 0.88 / +7.6%
tpch_q13/duckdb:vortex-file-compressed 288565391 / 269015694 / +7.3% 294353523 / 229156427 / +28.5% 0.98 / 1.17 / -16.5%
tpch_q14/duckdb:vortex-file-compressed 241242063 / 216848279 / +11.2% 282182266 / 327484203 / -13.8% 0.85 / 0.66 / +29.1%
tpch_q15/duckdb:vortex-file-compressed 250217586 / 247698975 / +1.0% 319707361 / 317347857 / +0.7% 0.78 / 0.78 / +0.3%
tpch_q16/duckdb:vortex-file-compressed 253242149 / 208677113 / +21.4% 267290222 / 219122995 / +22.0% 0.95 / 0.95 / -0.5%
tpch_q17/duckdb:vortex-file-compressed 343620371 / 513983798 / -33.1% 🟢 361426367 / 431345351 / -16.2% 0.95 / 1.19 / -20.2%
tpch_q18/duckdb:vortex-file-compressed 404634477 / 357066391 / +13.3% 542140878 / 467681563 / +15.9% 0.75 / 0.76 / -2.2%
tpch_q19/duckdb:vortex-file-compressed 362001708 / 266637396 / +35.8% 🔴 354622732 / 298646656 / +18.7% 1.02 / 0.89 / +14.3%
tpch_q20/duckdb:vortex-file-compressed 526421548 / 377623705 / +39.4% 🔴 667211375 / 672753379 / -0.8% 0.79 / 0.56 / +40.6%
tpch_q21/duckdb:vortex-file-compressed 665393698 / 608082200 / +9.4% 765653020 / 1002392816 / -23.6% 0.87 / 0.61 / +43.3%
tpch_q22/duckdb:vortex-file-compressed 246373242 / 246760890 / -0.2% 288218407 / 290932144 / -0.9% 0.85 / 0.85 / +0.8%
duckdb / parquet / ns (1.064x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 214299538 / 184729340 / +16.0% 275527598 / 250957062 / +9.8% 0.78 / 0.74 / +5.7%
tpch_q02/duckdb:parquet 543554435 / 388873683 / +39.8% 🔴 691328627 / 448902589 / +54.0% 🔴 0.79 / 0.87 / -9.2%
tpch_q03/duckdb:parquet 383354392 / 418328872 / -8.4% 446904578 / 515461278 / -13.3% 0.86 / 0.81 / +5.7%
tpch_q04/duckdb:parquet 294466304 / 315490988 / -6.7% 314724492 / 468956614 / -32.9% 🟢 0.94 / 0.67 / +39.1%
tpch_q05/duckdb:parquet 524135647 / 667237705 / -21.4% 630451154 / 726225585 / -13.2% 0.83 / 0.92 / -9.5%
tpch_q06/duckdb:parquet 153573408 / 141093286 / +8.8% 402185987 / 199067038 / +102.0% 🔴 0.38 / 0.71 / -46.1%
tpch_q07/duckdb:parquet 468216175 / 479737803 / -2.4% 482799624 / 516188894 / -6.5% 0.97 / 0.93 / +4.3%
tpch_q08/duckdb:parquet 658794378 / 575422021 / +14.5% 750009458 / 781604787 / -4.0% 0.88 / 0.74 / +19.3%
tpch_q09/duckdb:parquet 598018715 / 588596545 / +1.6% 561013555 / 583498450 / -3.9% 1.07 / 1.01 / +5.7%
tpch_q10/duckdb:parquet 672595979 / 610571486 / +10.2% 700757683 / 616633689 / +13.6% 0.96 / 0.99 / -3.1%
tpch_q11/duckdb:parquet 287919543 / 290884202 / -1.0% 313177472 / 336674420 / -7.0% 0.92 / 0.86 / +6.4%
tpch_q12/duckdb:parquet 362771682 / 274712440 / +32.1% 🔴 378749408 / 290219507 / +30.5% 🔴 0.96 / 0.95 / +1.2%
tpch_q13/duckdb:parquet 393696870 / 378474349 / +4.0% 499640758 / 510226938 / -2.1% 0.79 / 0.74 / +6.2%
tpch_q14/duckdb:parquet 261865999 / 241559282 / +8.4% 339427545 / 318048297 / +6.7% 0.77 / 0.76 / +1.6%
tpch_q15/duckdb:parquet 231330214 / 200785602 / +15.2% 269061400 / 220902987 / +21.8% 0.86 / 0.91 / -5.4%
tpch_q16/duckdb:parquet 562570894 / 289489008 / +94.3% 🔴 598242098 / 319025868 / +87.5% 🔴 0.94 / 0.91 / +3.6%
tpch_q17/duckdb:parquet 292704537 / 265849994 / +10.1% 386769990 / 330988318 / +16.9% 0.76 / 0.80 / -5.8%
tpch_q18/duckdb:parquet 321133676 / 463936613 / -30.8% 🟢 347464644 / 632208913 / -45.0% 🟢 0.92 / 0.73 / +25.9%
tpch_q19/duckdb:parquet 273176369 / 311578121 / -12.3% 340943013 / 388740024 / -12.3% 0.80 / 0.80 / -0.0%
tpch_q20/duckdb:parquet 457766491 / 435663782 / +5.1% 507443248 / 544071451 / -6.7% 0.90 / 0.80 / +12.7%
tpch_q21/duckdb:parquet 472610365 / 476891896 / -0.9% 516828034 / 530063516 / -2.5% 0.91 / 0.90 / +1.6%
tpch_q22/duckdb:parquet 329002656 / 285182660 / +15.4% 310748634 / 313610828 / -0.9% 1.06 / 0.91 / +16.4%

@codspeed

codspeed Bot commented Oct 27, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 18.98%

3 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

❌ 1 regressed benchmark
✅ 2428 untouched benchmarks
⏩ 126 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation test_repeated_scan_scalar_at[int_str_float] 411.8 µs 508.3 µs -18.98%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/epic-ride-kqmige (26f9ea1) with develop (d610673)

Open in CodSpeed

Footnotes

  1. 126 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR ada0b667 vs base 92bee27d


vortex / vortex-file-compressed / ns (0.448x ✅, 25↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 1100609497 / 1859211983 / -40.8% 🟢
compress time/Bimbo 3408321507 / 3736686637 / -8.8%
compress time/CMSprovider 3685248498 / 7118805139 / -48.2% 🟢
compress time/Euro2016 345446897 / 585833304 / -41.0% 🟢
compress time/Food 352715613 / 611357511 / -42.3% 🟢
compress time/HashTags 645956252 / 1096389177 / -41.1% 🟢
compress time/TPC-H l_comment canonical 1062270014 / 1761690084 / -39.7% 🟢
compress time/TPC-H l_comment chunked 1056612528 / 1761276884 / -40.0% 🟢
compress time/taxi 416381691 / 547873527 / -24.0% 🟢
compress time/wide table cols=100 chunks=1 rows=1000 5420224 / 7252169 / -25.3% 🟢
compress time/wide table cols=100 chunks=50 rows=1000 5476185 / 7139963 / -23.3% 🟢
compress time/wide table cols=1000 chunks=1 rows=1000 53118876 / 70503315 / -24.7% 🟢
compress time/wide table cols=1000 chunks=50 rows=1000 53473643 / 71706091 / -25.4% 🟢
compress time/wide table cols=10000 chunks=1 rows=1000 594419660 / 758098238 / -21.6% 🟢
compress time/wide table cols=10000 chunks=50 rows=1000 584133769 / 767882505 / -23.9% 🟢
decompress time/Arade 13699924 / 77308645 / -82.3% 🟢
decompress time/Bimbo 64028112 / 460831504 / -86.1% 🟢
decompress time/CMSprovider 37703739 / 331432888 / -88.6% 🟢
decompress time/Euro2016 12600546 / 109816074 / -88.5% 🟢
decompress time/Food 3586796 / 24505718 / -85.4% 🟢
decompress time/HashTags 35497281 / 301321507 / -88.2% 🟢
decompress time/TPC-H l_comment canonical 14032981 / 107309593 / -86.9% 🟢
decompress time/TPC-H l_comment chunked 13989113 / 108247307 / -87.1% 🟢
decompress time/taxi 9412160 / 57068795 / -83.5% 🟢
decompress time/wide table cols=100 chunks=1 rows=1000 1365945 / 1619313 / -15.6% 🟢
decompress time/wide table cols=100 chunks=50 rows=1000 1393842 / 1620873 / -14.0% 🟢
decompress time/wide table cols=1000 chunks=1 rows=1000 13317503 / 13299299 / +0.1%
decompress time/wide table cols=1000 chunks=50 rows=1000 13265978 / 12843529 / +3.3%
decompress time/wide table cols=10000 chunks=1 rows=1000 140962606 / 138670847 / +1.7%
decompress time/wide table cols=10000 chunks=50 rows=1000 141622936 / 139872612 / +1.3%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142214220 / 142214220 / +0.0%
vortex-file-compressed size/Bimbo 458581412 / 458581412 / +0.0%
vortex-file-compressed size/CMSprovider 420795628 / 420795628 / +0.0%
vortex-file-compressed size/Euro2016 164131948 / 164130956 / +0.0%
vortex-file-compressed size/Food 38951184 / 38951184 / +0.0%
vortex-file-compressed size/HashTags 196174300 / 196174300 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 178688872 / 178688872 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 178688872 / 178688872 / +0.0%
vortex-file-compressed size/taxi 49998508 / 49998508 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 935376 / 935376 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 935376 / 935376 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9336872 / 9336872 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9336872 / 9336872 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93387872 / 93387872 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93387872 / 93387872 / +0.0%
vortex / vortex-file-compressed / ratio (0.586x ✅, 25↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 1.50117824 / 2.53349933 / -40.7% 🟢
vortex:parquet-zstd ratio compress time/Bimbo 1.72671725 / 1.88556161 / -8.4%
vortex:parquet-zstd ratio compress time/CMSprovider 3.48056481 / 6.70596059 / -48.1% 🟢
vortex:parquet-zstd ratio compress time/Euro2016 0.53731057 / 0.911304304 / -41.0% 🟢
vortex:parquet-zstd ratio compress time/Food 1.10747739 / 1.92034798 / -42.3% 🟢
vortex:parquet-zstd ratio compress time/HashTags 1.89363616 / 3.1872624 / -40.6% 🟢
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 1.00712964 / 1.67395883 / -39.8% 🟢
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 1.00280611 / 1.67176652 / -40.0% 🟢
vortex:parquet-zstd ratio compress time/taxi 2.15278946 / 2.83478089 / -24.1% 🟢
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.50173413 / 1.99630285 / -24.8% 🟢
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.60459427 / 2.15566292 / -25.6% 🟢
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.49144363 / 1.94792685 / -23.4% 🟢
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.50239421 / 1.98002146 / -24.1% 🟢
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.58935726 / 2.02741956 / -21.6% 🟢
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.576396 / 2.05719179 / -23.4% 🟢
vortex:parquet-zstd ratio decompress time/Arade 0.278938781 / 1.5830989 / -82.4% 🟢
vortex:parquet-zstd ratio decompress time/Bimbo 0.722159084 / 5.1624633 / -86.0% 🟢
vortex:parquet-zstd ratio decompress time/CMSprovider 0.366717804 / 3.21914538 / -88.6% 🟢
vortex:parquet-zstd ratio decompress time/Euro2016 0.0841654273 / 0.732123843 / -88.5% 🟢
vortex:parquet-zstd ratio decompress time/Food 0.143358879 / 0.976069804 / -85.3% 🟢
vortex:parquet-zstd ratio decompress time/HashTags 0.0848950142 / 0.719683415 / -88.2% 🟢
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.170250408 / 1.29784135 / -86.9% 🟢
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.171198562 / 1.31419287 / -87.0% 🟢
vortex:parquet-zstd ratio decompress time/taxi 0.160933747 / 0.973463261 / -83.5% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.674230095 / 0.794590664 / -15.1% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.68858499 / 0.797835094 / -13.7% 🟢
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.560377029 / 0.565358193 / -0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.559516576 / 0.543034551 / +3.0%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.541068258 / 0.543348655 / -0.4%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.551862969 / 0.549570354 / +0.4%
vortex:parquet-zstd size/Arade 0.551187395 / 0.551187395 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19261584 / 1.19261584 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11650073 / 1.11650073 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33463341 / 1.33462535 / +0.0%
vortex:parquet-zstd size/Food 1.09108486 / 1.09108486 / -0.0%
vortex:parquet-zstd size/HashTags 1.46949694 / 1.46949694 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.12838381 / 1.12838381 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.12838381 / 1.12838381 / +0.0%
vortex:parquet-zstd size/taxi 0.904399792 / 0.904399792 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00318746 / 1.00318746 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00318746 / 1.00318746 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1.00138009 / 1.00138009 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1.00138009 / 1.00138009 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 1.00158589 / 1.00158589 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 1.00158589 / 1.00158589 / -0.0%
vortex / parquet / ns (0.999x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 733163769 / 733851381 / -0.1%
parquet_rs-zstd compress time/Bimbo 1973873552 / 1981736696 / -0.4%
parquet_rs-zstd compress time/CMSprovider 1058807607 / 1061563820 / -0.3%
parquet_rs-zstd compress time/Euro2016 642918484 / 642851462 / +0.0%
parquet_rs-zstd compress time/Food 318485612 / 318357671 / +0.0%
parquet_rs-zstd compress time/HashTags 341119516 / 343990873 / -0.8%
parquet_rs-zstd compress time/TPC-H l_comment canonical 1054750022 / 1052409447 / +0.2%
parquet_rs-zstd compress time/TPC-H l_comment chunked 1053655854 / 1053542385 / +0.0%
parquet_rs-zstd compress time/taxi 193414962 / 193268386 / +0.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3609310 / 3632800 / -0.6%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3412816 / 3312189 / +3.0%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 35615745 / 36194026 / -1.6%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 35592285 / 36214805 / -1.7%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 374000027 / 373922721 / +0.0%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 370550146 / 373267339 / -0.7%
parquet_rs-zstd decompress time/Arade 49114447 / 48833743 / +0.6%
parquet_rs-zstd decompress time/Bimbo 88662060 / 89265817 / -0.7%
parquet_rs-zstd decompress time/CMSprovider 102814040 / 102956794 / -0.1%
parquet_rs-zstd decompress time/Euro2016 149711662 / 149996582 / -0.2%
parquet_rs-zstd decompress time/Food 25019699 / 25106522 / -0.3%
parquet_rs-zstd decompress time/HashTags 418131516 / 418686190 / -0.1%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 82425535 / 82683136 / -0.3%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 81712795 / 82367900 / -0.8%
parquet_rs-zstd decompress time/taxi 58484688 / 58624498 / -0.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2025933 / 2037921 / -0.6%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2024212 / 2031589 / -0.4%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23765255 / 23523669 / +1.0%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23709714 / 23651403 / +0.2%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 260526475 / 255215221 / +2.1%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 256626996 / 254512659 / +0.8%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.993x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 95697116 / 96633398 / -1.0%
arrow-ipc compress time/Bimbo 601620873 / 608602408 / -1.1%
arrow-ipc compress time/CMSprovider 378788794 / 381298522 / -0.7%
arrow-ipc compress time/Euro2016 38250436 / 38531658 / -0.7%
arrow-ipc compress time/Food 40214829 / 40376602 / -0.4%
arrow-ipc compress time/HashTags 78263220 / 78106951 / +0.2%
arrow-ipc compress time/TPC-H l_comment canonical 129813151 / 129030035 / +0.6%
arrow-ipc compress time/TPC-H l_comment chunked 128732030 / 128967896 / -0.2%
arrow-ipc compress time/taxi 59139945 / 59702341 / -0.9%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 194754 / 194124 / +0.3%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 198305 / 195697 / +1.3%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2205394 / 2205895 / -0.0%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2173440 / 2163083 / +0.5%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 24665933 / 24694492 / -0.1%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 24683450 / 24549076 / +0.5%
arrow-ipc decompress time/Arade 218135135 / 217987981 / +0.1%
arrow-ipc decompress time/Bimbo 404593569 / 415690819 / -2.7%
arrow-ipc decompress time/CMSprovider 673701761 / 676776913 / -0.5%
arrow-ipc decompress time/Euro2016 83455507 / 85658349 / -2.6%
arrow-ipc decompress time/Food 67304884 / 67425139 / -0.2%
arrow-ipc decompress time/HashTags 160325835 / 164760576 / -2.7%
arrow-ipc decompress time/TPC-H l_comment canonical 191661780 / 191738801 / -0.0%
arrow-ipc decompress time/TPC-H l_comment chunked 191479361 / 191779100 / -0.2%
arrow-ipc decompress time/taxi 51208478 / 51164832 / +0.1%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 316506 / 318466 / -0.6%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 319298 / 318293 / +0.3%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3431899 / 3639519 / -5.7%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3538416 / 3603878 / -1.8%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 36100706 / 37035261 / -2.5%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 36213742 / 36705657 / -1.3%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 680639722 / 680639722 / +0.0%
arrow-ipc size/Bimbo 3168319202 / 3168319202 / +0.0%
arrow-ipc size/CMSprovider 2394412322 / 2394412322 / +0.0%
arrow-ipc size/Euro2016 359300042 / 359300042 / +0.0%
arrow-ipc size/Food 252069442 / 252069442 / +0.0%
arrow-ipc size/HashTags 700364562 / 700364562 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 1021072290 / 1021072290 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 1021072290 / 1021072290 / +0.0%
arrow-ipc size/taxi 474481242 / 474481242 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 123192506 / 123192506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 123192506 / 123192506 / +0.0%

@joseph-isaacs joseph-isaacs changed the title Convert V2 scan batches to Arrow on the driver's tasks fix: Convert V2 scan batches to Arrow on the driver's tasks Oct 27, 2026
@joseph-isaacs
joseph-isaacs merged commit f024b10 into develop Oct 27, 2026
119 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/epic-ride-kqmige branch October 27, 2026 15:23
joseph-isaacs pushed a commit that referenced this pull request Oct 27, 2026
Resolve vortex-file's ScanDriver against #10861, which maps batches on
the driver's tasks: keep develop's map_fn plumbing and reapply the
per-root IO sessions, the inline-at-concurrency-one gate and the scan
builder's concurrency.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GwhHqFVpQqPgQQkkK2y9kX
@joseph-isaacs joseph-isaacs mentioned this pull request Nov 9, 2026
16 of 46 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants