Skip to content

perf(duckdb): avoid redundant legacy layout pruning in V2 scans - #11340

Draft
joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-04-duck-file-pruning
Draft

joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-04-duck-file-pruning

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Draft with a full-suite landing concern: DuckDB Q7 requires follow-up despite the focused wins below.

Stack dependency: #11334. This PR targets that branch so its diff contains only this change.

Summary

For DuckDB V2 scans that project input fields, evaluate whole-file footer statistics during reader initialization and leave zone and row filtering to V2. Count-only and constant projections keep the existing layout probe, which starts their zone reads during initialization.

Based on ji/clickbench-v2-20261109-01-io-wakeups, the shared-segment wakeup fix used by this V2 series.

Changes

  • Add VortexFile::can_prune_bound for an already bound predicate, with root-schema validation before reading statistics.
  • Retain the opened VortexFile alongside its layout reader and select the pruning path from the scan mode and projected input fields.
  • Add schema-mismatch and count/constant-projection regression cases; preserve the V1 pruning path.

Benchmark evidence

Warm ClickBench timings against this branch's exact dependency parent. Query IDs are zero-based; these are individual query gains, not whole-suite or additive gains.

Engine Query Parent median (ms) Candidate median (ms) Paired latency reduction 99% interval
DuckDB Q37 5.4458 5.1967 4.44% 4.16–4.68%
DuckDB Q38 7.3751 7.1538 2.86% 2.49–3.24%
DuckDB Q42 5.0270 4.8289 3.81% 3.43–4.16%

24 fresh adjacent process pairs in balanced order; 100 executions/query, first 20 discarded; 8 interspersed identical-binary A/A pairs. Effects use mean paired log ratios of process warm medians. Displayed times are medians across processes, so their ratio need not exactly equal the paired estimate. Intervals are pointwise 99% bootstrap intervals. Each listed gain passes both the >1% interval rule and the exact paired sign test with Holm 1% correction across all 76 planned latency directions. Both execution orders and chronological sensitivity were reviewed; no post-warmup observations were excluded or controls subtracted. The sign test concerns how often a paired improvement exceeds 1%; the displayed interval estimates the mean log effect.

The focused Q1 guard is inconclusive: −0.35% latency reduction, 99% interval −1.07% to +0.37%. This does not prove absence of a small count-query regression.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads, DuckDB --reuse. DataFusion 55.2 retains enable_topk_aggregation=true. Compiler, Cargo feature union, profile and runtime environment are fixed across parent/candidate. Executable and library hashes, canonical SQL and fixture identities are recorded.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

The focused Q37/Q38/Q42 gains remain scoped to their long-warm protocol. All43 DuckDB Q7 medians are 4.91% slower in every pair; means rise 3.53%, with one favorable pair. Matching controls are variable, so this is a landing concern rather than a proved regression. Q11 and Q29 remain secondary observations. Broad resource changes are small and mixed. Keep Q7 visible in dependent branches s05, s06, and s07; draft publication does not require another campaign.

Validation

  • 12 targeted test executions passed on this exact source tree: scan_v2::tests, test_vortex_scan_v2_matches_v1.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate); strict types, floating tolerance, tied-row membership and independent oracles included.
  • Both benchmark packages built together with --locked, the release_debug profile, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust changes were formatted with pinned nightly; patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local source commit: 0fbf06a77da9e1cfe226913262e601d90829a45a; full source tree: be4e97c235b2101c52a466b63bcdf51adf454b94. Measured parent: a2765d42438062db73d431ef6d296930e69f5b28.

PR source commit: 2bc5703c632f9bdeca16cde41b222ea48d1dde35; mapped parent: da10665e5b0fad748a1e0e6550cc19880edd0317. The complete source tree and mapped parent graph match the measured source. GitHub regenerated commit metadata/timestamps, so the measured local commit and executable hashes remain the benchmark identities. The complete remote Git object, original message and author/committer signoffs were verified.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. 1 suite(s) required one failed-jobs-only retry after EC2 capacity failures before checkout; the head stayed unchanged. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

Retain the opened VortexFile and evaluate a dtype-checked file-statistics proof before V2 execution. V2 continues to evaluate its own zone and row predicates; V1 keeps its existing layout-reader pruning path. Cover bound predicate schema validation and retained versus excluded files.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-01-io-wakeups to develop November 9, 2026 11:56
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-01-io-wakeups November 9, 2026 11:56
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2bc5703 tpch-s3 2 Explore Profiling Data
🟢 Done 2bc5703 polarsignals 1 Explore Profiling Data
🟢 Done 2bc5703 fineweb 1 Explore Profiling Data
🟢 Done 2bc5703 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 2bc5703 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 2bc5703 tpch-nvme 1 Explore Profiling Data
🟢 Done 2bc5703 tpcds-nvme 1 Explore Profiling Data
🟢 Done 2bc5703 clickbench-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 2bc5703c vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.969x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.983x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1275202 / 1277762 / -0.2% 22197141 / 22701905 / -2.2% 0.06 / 0.06 / +2.1%
clickbench_q01/datafusion:vortex-file-compressed 5810573 / 5701054 / +1.9% 28758834 / 34133473 / -15.7% 🟢 0.20 / 0.17 / +21.0%
clickbench_q02/datafusion:vortex-file-compressed 10872764 / 11059978 / -1.7% 45865237 / 45727346 / +0.3% 0.24 / 0.24 / -2.0%
clickbench_q03/datafusion:vortex-file-compressed 12495400 / 12962152 / -3.6% 55884348 / 59966511 / -6.8% 0.22 / 0.22 / +3.4%
clickbench_q04/datafusion:vortex-file-compressed 57410977 / 58491492 / -1.8% 101681043 / 107265399 / -5.2% 0.56 / 0.55 / +3.5%
clickbench_q05/datafusion:vortex-file-compressed 76842563 / 75324188 / +2.0% 126086917 / 127176489 / -0.9% 0.61 / 0.59 / +2.9%
clickbench_q06/datafusion:vortex-file-compressed 1262886 / 1281209 / -1.4% 21518985 / 22762946 / -5.5% 0.06 / 0.06 / +4.3%
clickbench_q07/datafusion:vortex-file-compressed 9300425 / 9121962 / +2.0% 32847067 / 36679638 / -10.4% 🟢 0.28 / 0.25 / +13.9%
clickbench_q08/datafusion:vortex-file-compressed 78264897 / 79202689 / -1.2% 119672882 / 130034036 / -8.0% 0.65 / 0.61 / +7.4%
clickbench_q09/datafusion:vortex-file-compressed 172605604 / 169891930 / +1.6% 221724110 / 215849640 / +2.7% 0.78 / 0.79 / -1.1%
clickbench_q10/datafusion:vortex-file-compressed 22872857 / 23576041 / -3.0% 68587356 / 71620517 / -4.2% 0.33 / 0.33 / +1.3%
clickbench_q11/datafusion:vortex-file-compressed 24379091 / 25595211 / -4.8% 71266284 / 73456297 / -3.0% 0.34 / 0.35 / -1.8%
clickbench_q12/datafusion:vortex-file-compressed 71425944 / 72340317 / -1.3% 125546510 / 126525748 / -0.8% 0.57 / 0.57 / -0.5%
clickbench_q13/datafusion:vortex-file-compressed 120282032 / 114454353 / +5.1% 181172517 / 187159194 / -3.2% 0.66 / 0.61 / +8.6%
clickbench_q14/datafusion:vortex-file-compressed 75001847 / 75015054 / -0.0% 128329595 / 128127094 / +0.2% 0.58 / 0.59 / -0.2%
clickbench_q15/datafusion:vortex-file-compressed 61775726 / 63035252 / -2.0% 106829141 / 102527113 / +4.2% 0.58 / 0.61 / -5.9%
clickbench_q16/datafusion:vortex-file-compressed 153868258 / 154339830 / -0.3% 210558704 / 220216995 / -4.4% 0.73 / 0.70 / +4.3%
clickbench_q17/datafusion:vortex-file-compressed 152394098 / 153975190 / -1.0% 232937740 / 221571282 / +5.1% 0.65 / 0.69 / -5.9%
clickbench_q18/datafusion:vortex-file-compressed 288994702 / 297646745 / -2.9% 369487615 / 388335753 / -4.9% 0.78 / 0.77 / +2.0%
clickbench_q19/datafusion:vortex-file-compressed 7752626 / 7750414 / +0.0% 44835376 / 48721099 / -8.0% 0.17 / 0.16 / +8.7%
clickbench_q20/datafusion:vortex-file-compressed 66951521 / 68136855 / -1.7% 241377286 / 256425057 / -5.9% 0.28 / 0.27 / +4.4%
clickbench_q21/datafusion:vortex-file-compressed 77892244 / 80037805 / -2.7% 290501097 / 300737630 / -3.4% 0.27 / 0.27 / +0.7%
clickbench_q22/datafusion:vortex-file-compressed 92987886 / 95054287 / -2.2% 386418046 / 395336147 / -2.3% 0.24 / 0.24 / +0.1%
clickbench_q23/datafusion:vortex-file-compressed 80044554 / 80171206 / -0.2% 404453020 / 416246090 / -2.8% 0.20 / 0.19 / +2.8%
clickbench_q24/datafusion:vortex-file-compressed 8548473 / 8409700 / +1.7% 63760840 / 57093319 / +11.7% 🔴 0.13 / 0.15 / -9.0%
clickbench_q25/datafusion:vortex-file-compressed 19351040 / 18152158 / +6.6% 58582938 / 63410099 / -7.6% 0.33 / 0.29 / +15.4%
clickbench_q26/datafusion:vortex-file-compressed 13918226 / 15624998 / -10.9% 🟢 58385760 / 69615012 / -16.1% 🟢 0.24 / 0.22 / +6.2%
clickbench_q27/datafusion:vortex-file-compressed 99028578 / 100553100 / -1.5% 253961778 / 266070098 / -4.6% 0.39 / 0.38 / +3.2%
clickbench_q28/datafusion:vortex-file-compressed 560500578 / 561882003 / -0.2% 639530654 / 634483917 / +0.8% 0.88 / 0.89 / -1.0%
clickbench_q29/datafusion:vortex-file-compressed 24314791 / 24813306 / -2.0% 51384807 / 53938850 / -4.7% 0.47 / 0.46 / +2.9%
clickbench_q30/datafusion:vortex-file-compressed 54460634 / 54469824 / -0.0% 111546330 / 110322321 / +1.1% 0.49 / 0.49 / -1.1%
clickbench_q31/datafusion:vortex-file-compressed 64744222 / 63713036 / +1.6% 156087089 / 165094546 / -5.5% 0.41 / 0.39 / +7.5%
clickbench_q32/datafusion:vortex-file-compressed 287518408 / 287471359 / +0.0% 384769969 / 395194655 / -2.6% 0.75 / 0.73 / +2.7%
clickbench_q33/datafusion:vortex-file-compressed 316080219 / 318812426 / -0.9% 422680933 / 434359824 / -2.7% 0.75 / 0.73 / +1.9%
clickbench_q34/datafusion:vortex-file-compressed 320457472 / 319825400 / +0.2% 432487298 / 438643717 / -1.4% 0.74 / 0.73 / +1.6%
clickbench_q35/datafusion:vortex-file-compressed 57408642 / 56594294 / +1.4% 91469658 / 89838837 / +1.8% 0.63 / 0.63 / -0.4%
clickbench_q36/datafusion:vortex-file-compressed 37029410 / 37371240 / -0.9% 66528843 / 69504069 / -4.3% 0.56 / 0.54 / +3.5%
clickbench_q37/datafusion:vortex-file-compressed 20441860 / 20731798 / -1.4% 45641797 / 48713358 / -6.3% 0.45 / 0.43 / +5.2%
clickbench_q38/datafusion:vortex-file-compressed 12587258 / 12866674 / -2.2% 39550638 / 41261053 / -4.1% 0.32 / 0.31 / +2.1%
clickbench_q39/datafusion:vortex-file-compressed 79026145 / 78717482 / +0.4% 109228264 / 110822448 / -1.4% 0.72 / 0.71 / +1.9%
clickbench_q40/datafusion:vortex-file-compressed 9993534 / 10368860 / -3.6% 34565764 / 36576948 / -5.5% 0.29 / 0.28 / +2.0%
clickbench_q41/datafusion:vortex-file-compressed 9598480 / 9655634 / -0.6% 33593595 / 35212183 / -4.6% 0.29 / 0.27 / +4.2%
clickbench_q42/datafusion:vortex-file-compressed 9786583 / 9562990 / +2.3% 34392079 / 37134881 / -7.4% 0.28 / 0.26 / +10.5%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1259968 / 1245508 / +1.2% 48842088 / 49111389 / -0.5% 0.03 / 0.03 / +1.7%
clickbench_q01/datafusion:parquet 16052055 / 16128558 / -0.5% 68066951 / 65974016 / +3.2% 0.24 / 0.24 / -3.5%
clickbench_q02/datafusion:parquet 19161309 / 18679866 / +2.6% 80036874 / 81045048 / -1.2% 0.24 / 0.23 / +3.9%
clickbench_q03/datafusion:parquet 17838134 / 17636144 / +1.1% 78194403 / 78906984 / -0.9% 0.23 / 0.22 / +2.1%
clickbench_q04/datafusion:parquet 65447868 / 63147200 / +3.6% 122515834 / 123651426 / -0.9% 0.53 / 0.51 / +4.6%
clickbench_q05/datafusion:parquet 89676976 / 89173734 / +0.6% 151181435 / 155684349 / -2.9% 0.59 / 0.57 / +3.6%
clickbench_q06/datafusion:parquet 1274894 / 1267736 / +0.6% 48960618 / 49808656 / -1.7% 0.03 / 0.03 / +2.3%
clickbench_q07/datafusion:parquet 16669272 / 16815682 / -0.9% 67492113 / 68530680 / -1.5% 0.25 / 0.25 / +0.7%
clickbench_q08/datafusion:parquet 84197292 / 84420552 / -0.3% 158845325 / 159615748 / -0.5% 0.53 / 0.53 / +0.2%
clickbench_q09/datafusion:parquet 188365558 / 189340200 / -0.5% 261266935 / 270568486 / -3.4% 0.72 / 0.70 / +3.0%
clickbench_q10/datafusion:parquet 35871208 / 35838825 / +0.1% 99308264 / 101351871 / -2.0% 0.36 / 0.35 / +2.2%
clickbench_q11/datafusion:parquet 42721592 / 43388606 / -1.5% 107968102 / 110234963 / -2.1% 0.40 / 0.39 / +0.5%
clickbench_q12/datafusion:parquet 95325964 / 96400254 / -1.1% 157777031 / 164380304 / -4.0% 0.60 / 0.59 / +3.0%
clickbench_q13/datafusion:parquet 147831537 / 149050407 / -0.8% 226655900 / 229020286 / -1.0% 0.65 / 0.65 / +0.2%
clickbench_q14/datafusion:parquet 101053450 / 101751008 / -0.7% 168945235 / 173752765 / -2.8% 0.60 / 0.59 / +2.1%
clickbench_q15/datafusion:parquet 72431848 / 74751018 / -3.1% 127341388 / 132562825 / -3.9% 0.57 / 0.56 / +0.9%
clickbench_q16/datafusion:parquet 156297128 / 157130106 / -0.5% 231417995 / 235404102 / -1.7% 0.68 / 0.67 / +1.2%
clickbench_q17/datafusion:parquet 157234274 / 158408130 / -0.7% 235122404 / 232535206 / +1.1% 0.67 / 0.68 / -1.8%
clickbench_q18/datafusion:parquet 306950816 / 311659828 / -1.5% 419573720 / 428769037 / -2.1% 0.73 / 0.73 / +0.6%
clickbench_q19/datafusion:parquet 18842894 / 18808941 / +0.2% 73322391 / 76943382 / -4.7% 0.26 / 0.24 / +5.1%
clickbench_q20/datafusion:parquet 179810946 / 178190524 / +0.9% 276028937 / 283067790 / -2.5% 0.65 / 0.63 / +3.5%
clickbench_q21/datafusion:parquet 172066518 / 174542982 / -1.4% 290530144 / 303338278 / -4.2% 0.59 / 0.58 / +2.9%
clickbench_q22/datafusion:parquet 259900766 / 260781561 / -0.3% 416634863 / 433914101 / -4.0% 0.62 / 0.60 / +3.8%
clickbench_q23/datafusion:parquet 1010451520 / 1007396844 / +0.3% 1184027404 / 1196675958 / -1.1% 0.85 / 0.84 / +1.4%
clickbench_q24/datafusion:parquet 29829779 / 30726530 / -2.9% 86803979 / 88445505 / -1.9% 0.34 / 0.35 / -1.1%
clickbench_q25/datafusion:parquet 35938029 / 37097776 / -3.1% 97817105 / 103458997 / -5.5% 0.37 / 0.36 / +2.5%
clickbench_q26/datafusion:parquet 30424530 / 30667637 / -0.8% 86420697 / 89958756 / -3.9% 0.35 / 0.34 / +3.3%
clickbench_q27/datafusion:parquet 191751946 / 193541858 / -0.9% 280003170 / 294014301 / -4.8% 0.68 / 0.66 / +4.0%
clickbench_q28/datafusion:parquet 616883216 / 622381386 / -0.9% 701746951 / 709605194 / -1.1% 0.88 / 0.88 / +0.2%
clickbench_q29/datafusion:parquet 29337018 / 28382270 / +3.4% 89281967 / 89726118 / -0.5% 0.33 / 0.32 / +3.9%
clickbench_q30/datafusion:parquet 90085044 / 90292652 / -0.2% 166770175 / 173921114 / -4.1% 0.54 / 0.52 / +4.0%
clickbench_q31/datafusion:parquet 101855542 / 103509501 / -1.6% 188738132 / 200971596 / -6.1% 0.54 / 0.52 / +4.8%
clickbench_q32/datafusion:parquet 306481508 / 311115870 / -1.5% 419307553 / 428727602 / -2.2% 0.73 / 0.73 / +0.7%
clickbench_q33/datafusion:parquet 378142142 / 380048496 / -0.5% 476087946 / 479600127 / -0.7% 0.79 / 0.79 / +0.2%
clickbench_q34/datafusion:parquet 377469978 / 378557524 / -0.3% 474613403 / 477936899 / -0.7% 0.80 / 0.79 / +0.4%
clickbench_q35/datafusion:parquet 64175422 / 64249088 / -0.1% 122962741 / 123443405 / -0.4% 0.52 / 0.52 / +0.3%
clickbench_q36/datafusion:parquet 73509540 / 73977852 / -0.6% 135224220 / 136178878 / -0.7% 0.54 / 0.54 / +0.1%
clickbench_q37/datafusion:parquet 35696482 / 35633496 / +0.2% 90929765 / 91419997 / -0.5% 0.39 / 0.39 / +0.7%
clickbench_q38/datafusion:parquet 47921359 / 47903072 / +0.0% 105706318 / 108411604 / -2.5% 0.45 / 0.44 / +2.6%
clickbench_q39/datafusion:parquet 143352764 / 144526362 / -0.8% 206005920 / 212015185 / -2.8% 0.70 / 0.68 / +2.1%
clickbench_q40/datafusion:parquet 19872890 / 20349552 / -2.3% 76603568 / 77770096 / -1.5% 0.26 / 0.26 / -0.9%
clickbench_q41/datafusion:parquet 18677034 / 18824178 / -0.8% 76102082 / 74972994 / +1.5% 0.25 / 0.25 / -2.3%
clickbench_q42/datafusion:parquet 19161160 / 19068224 / +0.5% 74651322 / 75207188 / -0.7% 0.26 / 0.25 / +1.2%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2213421 / 2239520 / -1.2% 25287238 / 25410828 / -0.5% 0.09 / 0.09 / -0.7%
clickbench_q01/duckdb:vortex-file-compressed 7674548 / 7612362 / +0.8% 31344155 / 27570446 / +13.7% 🔴 0.24 / 0.28 / -11.3%
clickbench_q02/duckdb:vortex-file-compressed 9219561 / 8955066 / +3.0% 35119392 / 35286118 / -0.5% 0.26 / 0.25 / +3.4%
clickbench_q03/duckdb:vortex-file-compressed 13882214 / 14248936 / -2.6% 46509943 / 52216942 / -10.9% 🟢 0.30 / 0.27 / +9.4%
clickbench_q04/duckdb:vortex-file-compressed 57039239 / 58104275 / -1.8% 86781595 / 92470080 / -6.2% 0.66 / 0.63 / +4.6%
clickbench_q05/duckdb:vortex-file-compressed 63324099 / 64657906 / -2.1% 91443256 / 95177701 / -3.9% 0.69 / 0.68 / +1.9%
clickbench_q06/duckdb:vortex-file-compressed 2680694 / 2703474 / -0.8% 32457930 / 31007170 / +4.7% 0.08 / 0.09 / -5.3%
clickbench_q07/duckdb:vortex-file-compressed 9428725 / 9579114 / -1.6% 32175139 / 31815161 / +1.1% 0.29 / 0.30 / -2.7%
clickbench_q08/duckdb:vortex-file-compressed 69599810 / 69709164 / -0.2% 102934995 / 106513332 / -3.4% 0.68 / 0.65 / +3.3%
clickbench_q09/duckdb:vortex-file-compressed 93000084 / 91790526 / +1.3% 120440142 / 128038059 / -5.9% 0.77 / 0.72 / +7.7%
clickbench_q10/duckdb:vortex-file-compressed 26995802 / 27449552 / -1.7% 65857035 / 70633742 / -6.8% 0.41 / 0.39 / +5.5%
clickbench_q11/duckdb:vortex-file-compressed 29822895 / 29742802 / +0.3% 68737628 / 74580099 / -7.8% 0.43 / 0.40 / +8.8%
clickbench_q12/duckdb:vortex-file-compressed 69951040 / 68314645 / +2.4% 102065383 / 101588585 / +0.5% 0.69 / 0.67 / +1.9%
clickbench_q13/duckdb:vortex-file-compressed 119604496 / 117681350 / +1.6% 159221240 / 167304335 / -4.8% 0.75 / 0.70 / +6.8%
clickbench_q14/duckdb:vortex-file-compressed 73043560 / 71707574 / +1.9% 103924177 / 104097981 / -0.2% 0.70 / 0.69 / +2.0%
clickbench_q15/duckdb:vortex-file-compressed 76791382 / 76256368 / +0.7% 106325672 / 109430960 / -2.8% 0.72 / 0.70 / +3.6%
clickbench_q16/duckdb:vortex-file-compressed 134493600 / 136865666 / -1.7% 171469424 / 173157180 / -1.0% 0.78 / 0.79 / -0.8%
clickbench_q17/duckdb:vortex-file-compressed 140119391 / 136309250 / +2.8% 168334568 / 167679771 / +0.4% 0.83 / 0.81 / +2.4%
clickbench_q18/duckdb:vortex-file-compressed 256743668 / 253680418 / +1.2% 298020979 / 304490936 / -2.1% 0.86 / 0.83 / +3.4%
clickbench_q19/duckdb:vortex-file-compressed 9240018 / 9195282 / +0.5% 35406429 / 41073291 / -13.8% 🟢 0.26 / 0.22 / +16.6%
clickbench_q20/duckdb:vortex-file-compressed 68293598 / 68396690 / -0.2% 157005141 / 175446093 / -10.5% 🟢 0.43 / 0.39 / +11.6%
clickbench_q21/duckdb:vortex-file-compressed 77788285 / 78139710 / -0.4% 203913805 / 193510866 / +5.4% 0.38 / 0.40 / -5.5%
clickbench_q22/duckdb:vortex-file-compressed 131890028 / 130674448 / +0.9% 322733384 / 331574805 / -2.7% 0.41 / 0.39 / +3.7%
clickbench_q23/duckdb:vortex-file-compressed 61693703 / 59653655 / +3.4% 183549371 / 184899542 / -0.7% 0.34 / 0.32 / +4.2%
clickbench_q24/duckdb:vortex-file-compressed 16364353 / 17394194 / -5.9% 42371518 / 48703041 / -13.0% 🟢 0.39 / 0.36 / +8.1%
clickbench_q25/duckdb:vortex-file-compressed 18408615 / 18446944 / -0.2% 52487670 / 54178597 / -3.1% 0.35 / 0.34 / +3.0%
clickbench_q26/duckdb:vortex-file-compressed 13995568 / 14287748 / -2.0% 39507043 / 49047912 / -19.5% 🟢 0.35 / 0.29 / +21.6%
clickbench_q27/duckdb:vortex-file-compressed 54916710 / 53905176 / +1.9% 182312080 / 177354906 / +2.8% 0.30 / 0.30 / -0.9%
clickbench_q28/duckdb:vortex-file-compressed 511527113 / 514093187 / -0.5% 554907377 / 559504615 / -0.8% 0.92 / 0.92 / +0.3%
clickbench_q29/duckdb:vortex-file-compressed 17176941 / 17208508 / -0.2% 38571895 / 42958313 / -10.2% 🟢 0.45 / 0.40 / +11.2%
clickbench_q30/duckdb:vortex-file-compressed 59902816 / 59435691 / +0.8% 101085685 / 108956696 / -7.2% 0.59 / 0.55 / +8.6%
clickbench_q31/duckdb:vortex-file-compressed 109943761 / 109401092 / +0.5% 165528988 / 174239306 / -5.0% 0.66 / 0.63 / +5.8%
clickbench_q32/duckdb:vortex-file-compressed 368224993 / 385910546 / -4.6% 412397813 / 410231765 / +0.5% 0.89 / 0.94 / -5.1%
clickbench_q33/duckdb:vortex-file-compressed 340006266 / 342599656 / -0.8% 394307751 / 396100171 / -0.5% 0.86 / 0.86 / -0.3%
clickbench_q34/duckdb:vortex-file-compressed 353862867 / 353396204 / +0.1% 407358165 / 412222797 / -1.2% 0.87 / 0.86 / +1.3%
clickbench_q35/duckdb:vortex-file-compressed 57445891 / 57161666 / +0.5% 88685145 / 88929172 / -0.3% 0.65 / 0.64 / +0.8%
clickbench_q36/duckdb:vortex-file-compressed 11163746 / 11640787 / -4.1% 34537407 / 33117280 / +4.3% 0.32 / 0.35 / -8.0%
clickbench_q37/duckdb:vortex-file-compressed 7652024 / 7579217 / +1.0% 29726151 / 29023829 / +2.4% 0.26 / 0.26 / -1.4%
clickbench_q38/duckdb:vortex-file-compressed 8016913 / 8249762 / -2.8% 29198103 / 27872473 / +4.8% 0.27 / 0.30 / -7.2%
clickbench_q39/duckdb:vortex-file-compressed 18239850 / 18512246 / -1.5% 40265575 / 39648155 / +1.6% 0.45 / 0.47 / -3.0%
clickbench_q40/duckdb:vortex-file-compressed 6651498 / 6788686 / -2.0% 28581493 / 29122522 / -1.9% 0.23 / 0.23 / -0.2%
clickbench_q41/duckdb:vortex-file-compressed 7525972 / 7935220 / -5.2% 29763776 / 31671742 / -6.0% 0.25 / 0.25 / +0.9%
clickbench_q42/duckdb:vortex-file-compressed 7021216 / 7022668 / -0.0% 27996230 / 27458837 / +2.0% 0.25 / 0.26 / -1.9%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9266700 / 9394832 / -1.4% 14081519 / 14721122 / -4.3% 0.66 / 0.64 / +3.1%
clickbench_q01/duckdb:parquet 15159016 / 15255306 / -0.6% 20080026 / 20612271 / -2.6% 0.75 / 0.74 / +2.0%
clickbench_q02/duckdb:parquet 22409104 / 23202924 / -3.4% 31989508 / 34409503 / -7.0% 0.70 / 0.67 / +3.9%
clickbench_q03/duckdb:parquet 22359202 / 22805660 / -2.0% 33797329 / 37416814 / -9.7% 0.66 / 0.61 / +8.5%
clickbench_q04/duckdb:parquet 61363128 / 62729622 / -2.2% 74109966 / 74237821 / -0.2% 0.83 / 0.84 / -2.0%
clickbench_q05/duckdb:parquet 83876750 / 82553121 / +1.6% 98147246 / 95555827 / +2.7% 0.85 / 0.86 / -1.1%
clickbench_q06/duckdb:parquet 20263320 / 20223452 / +0.2% 29208108 / 27478087 / +6.3% 0.69 / 0.74 / -5.7%
clickbench_q07/duckdb:parquet 17337698 / 17993160 / -3.6% 23687561 / 22337709 / +6.0% 0.73 / 0.81 / -9.1%
clickbench_q08/duckdb:parquet 74672644 / 75074766 / -0.5% 86491883 / 93024452 / -7.0% 0.86 / 0.81 / +7.0%
clickbench_q09/duckdb:parquet 102095355 / 103794619 / -1.6% 120589235 / 121917219 / -1.1% 0.85 / 0.85 / -0.6%
clickbench_q10/duckdb:parquet 40959878 / 41383818 / -1.0% 56959241 / 53619651 / +6.2% 0.72 / 0.77 / -6.8%
clickbench_q11/duckdb:parquet 46259168 / 46643339 / -0.8% 63502991 / 61615297 / +3.1% 0.73 / 0.76 / -3.8%
clickbench_q12/duckdb:parquet 91644300 / 93595602 / -2.1% 106973094 / 108115697 / -1.1% 0.86 / 0.87 / -1.0%
clickbench_q13/duckdb:parquet 149762364 / 148244281 / +1.0% 165373250 / 168231324 / -1.7% 0.91 / 0.88 / +2.8%
clickbench_q14/duckdb:parquet 100983064 / 101682435 / -0.7% 115577601 / 114164311 / +1.2% 0.87 / 0.89 / -1.9%
clickbench_q15/duckdb:parquet 86913420 / 85946628 / +1.1% 99748846 / 100644448 / -0.9% 0.87 / 0.85 / +2.0%
clickbench_q16/duckdb:parquet 165240184 / 165498386 / -0.2% 176414593 / 179975882 / -2.0% 0.94 / 0.92 / +1.9%
clickbench_q17/duckdb:parquet 162997874 / 171531960 / -5.0% 179992462 / 178665714 / +0.7% 0.91 / 0.96 / -5.7%
clickbench_q18/duckdb:parquet 291078904 / 291016272 / +0.0% 315344426 / 315607081 / -0.1% 0.92 / 0.92 / +0.1%
clickbench_q19/duckdb:parquet 19258051 / 19859715 / -3.0% 25941839 / 25786255 / +0.6% 0.74 / 0.77 / -3.6%
clickbench_q20/duckdb:parquet 189800060 / 180420120 / +5.2% 229085325 / 232480084 / -1.5% 0.83 / 0.78 / +6.8%
clickbench_q21/duckdb:parquet 218249044 / 218477350 / -0.1% 261501030 / 262983512 / -0.6% 0.83 / 0.83 / +0.5%
clickbench_q22/duckdb:parquet 313768713 / 304926990 / +2.9% 364941537 / 357379579 / +2.1% 0.86 / 0.85 / +0.8%
clickbench_q23/duckdb:parquet 167630278 / 171775762 / -2.4% 244629616 / 253121056 / -3.4% 0.69 / 0.68 / +1.0%
clickbench_q24/duckdb:parquet 30199974 / 29958716 / +0.8% 41193735 / 42482462 / -3.0% 0.73 / 0.71 / +4.0%
clickbench_q25/duckdb:parquet 41776358 / 42463750 / -1.6% 57054600 / 60982131 / -6.4% 0.73 / 0.70 / +5.2%
clickbench_q26/duckdb:parquet 30042270 / 32739711 / -8.2% 45644835 / 47017556 / -2.9% 0.66 / 0.70 / -5.5%
clickbench_q27/duckdb:parquet 196525874 / 191541398 / +2.6% 230317101 / 230295986 / +0.0% 0.85 / 0.83 / +2.6%
clickbench_q28/duckdb:parquet 972733232 / 950006560 / +2.4% 939495084 / 983079731 / -4.4% 1.04 / 0.97 / +7.1%
clickbench_q29/duckdb:parquet 23965193 / 24317362 / -1.4% 31850790 / 30925214 / +3.0% 0.75 / 0.79 / -4.3%
clickbench_q30/duckdb:parquet 105485317 / 104622488 / +0.8% 125651062 / 129419189 / -2.9% 0.84 / 0.81 / +3.8%
clickbench_q31/duckdb:parquet 157927412 / 160480217 / -1.6% 197196320 / 174417616 / +13.1% 🔴 0.80 / 0.92 / -13.0%
clickbench_q32/duckdb:parquet 386218940 / 385925739 / +0.1% 418978177 / 407659843 / +2.8% 0.92 / 0.95 / -2.6%
clickbench_q33/duckdb:parquet 466194219 / 468922366 / -0.6% 438111358 / 442695781 / -1.0% 1.06 / 1.06 / +0.5%
clickbench_q34/duckdb:parquet 465620356 / 462238432 / +0.7% 444507523 / 447629696 / -0.7% 1.05 / 1.03 / +1.4%
clickbench_q35/duckdb:parquet 60636779 / 61543474 / -1.5% 71965169 / 77479685 / -7.1% 0.84 / 0.79 / +6.1%
clickbench_q36/duckdb:parquet 30575078 / 30172014 / +1.3% 35524436 / 36925558 / -3.8% 0.86 / 0.82 / +5.3%
clickbench_q37/duckdb:parquet 23301374 / 23204022 / +0.4% 28929034 / 30425350 / -4.9% 0.81 / 0.76 / +5.6%
clickbench_q38/duckdb:parquet 23937912 / 23431136 / +2.2% 28925143 / 30912378 / -6.4% 0.83 / 0.76 / +9.2%
clickbench_q39/duckdb:parquet 53366590 / 52956229 / +0.8% 59504829 / 60047399 / -0.9% 0.90 / 0.88 / +1.7%
clickbench_q40/duckdb:parquet 15086136 / 14924840 / +1.1% 19573714 / 20066747 / -2.5% 0.77 / 0.74 / +3.6%
clickbench_q41/duckdb:parquet 15664018 / 15331596 / +2.2% 20327304 / 23069987 / -11.9% 🟢 0.77 / 0.66 / +16.0%
clickbench_q42/duckdb:parquet 14323247 / 14130908 / +1.4% 20342595 / 20120985 / +1.1% 0.70 / 0.70 / +0.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 2bc5703c vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.024x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.016x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21834824 / 21999911 / -0.8% 41323522 / 39946370 / +3.4% 0.53 / 0.55 / -4.1%
tpcds_q02/datafusion:vortex-file-compressed 42823039 / 42893253 / -0.2% 66166763 / 62914880 / +5.2% 0.65 / 0.68 / -5.1%
tpcds_q03/datafusion:vortex-file-compressed 11780579 / 11605178 / +1.5% 29949833 / 26609156 / +12.6% 🔴 0.39 / 0.44 / -9.8%
tpcds_q04/datafusion:vortex-file-compressed 81355612 / 78951654 / +3.0% 113457259 / 104564818 / +8.5% 0.72 / 0.76 / -5.0%
tpcds_q05/datafusion:vortex-file-compressed 56897818 / 55941465 / +1.7% 79131238 / 74124262 / +6.8% 0.72 / 0.75 / -4.7%
tpcds_q06/datafusion:vortex-file-compressed 21698792 / 21333720 / +1.7% 43380685 / 41069841 / +5.6% 0.50 / 0.52 / -3.7%
tpcds_q07/datafusion:vortex-file-compressed 26579090 / 26386390 / +0.7% 49963214 / 48176326 / +3.7% 0.53 / 0.55 / -2.9%
tpcds_q08/datafusion:vortex-file-compressed 25272354 / 25587712 / -1.2% 45648101 / 43682364 / +4.5% 0.55 / 0.59 / -5.5%
tpcds_q09/datafusion:vortex-file-compressed 20012262 / 19896226 / +0.6% 39348971 / 37474977 / +5.0% 0.51 / 0.53 / -4.2%
tpcds_q10/datafusion:vortex-file-compressed 30297466 / 29546889 / +2.5% 52253135 / 51180613 / +2.1% 0.58 / 0.58 / +0.4%
tpcds_q11/datafusion:vortex-file-compressed 48057270 / 49121194 / -2.2% 77613672 / 75394766 / +2.9% 0.62 / 0.65 / -5.0%
tpcds_q12/datafusion:vortex-file-compressed 15164374 / 14946749 / +1.5% 32557397 / 31749886 / +2.5% 0.47 / 0.47 / -1.1%
tpcds_q13/datafusion:vortex-file-compressed 31722244 / 31860550 / -0.4% 57554528 / 53865238 / +6.8% 0.55 / 0.59 / -6.8%
tpcds_q14/datafusion:vortex-file-compressed 486673524 / 487421370 / -0.2% 545243231 / 542474028 / +0.5% 0.89 / 0.90 / -0.7%
tpcds_q15/datafusion:vortex-file-compressed 12849978 / 12586756 / +2.1% 31998626 / 29869991 / +7.1% 0.40 / 0.42 / -4.7%
tpcds_q16/datafusion:vortex-file-compressed 18733117 / 18761618 / -0.2% 39905067 / 37089591 / +7.6% 0.47 / 0.51 / -7.2%
tpcds_q17/datafusion:vortex-file-compressed 53308758 / 53607682 / -0.6% 75597997 / 70072689 / +7.9% 0.71 / 0.77 / -7.8%
tpcds_q18/datafusion:vortex-file-compressed 64246008 / 62349632 / +3.0% 75380121 / 88633124 / -15.0% 🟢 0.85 / 0.70 / +21.2%
tpcds_q19/datafusion:vortex-file-compressed 17226946 / 17064877 / +0.9% 41020631 / 38137570 / +7.6% 0.42 / 0.45 / -6.1%
tpcds_q20/datafusion:vortex-file-compressed 16787922 / 16875604 / -0.5% 34911990 / 33398462 / +4.5% 0.48 / 0.51 / -4.8%
tpcds_q21/datafusion:vortex-file-compressed 14780147 / 14801170 / -0.1% 36262798 / 32973615 / +10.0% 0.41 / 0.45 / -9.2%
tpcds_q22/datafusion:vortex-file-compressed 49172108 / 49325762 / -0.3% 74259343 / 67699156 / +9.7% 0.66 / 0.73 / -9.1%
tpcds_q23/datafusion:vortex-file-compressed 71299952 / 72276124 / -1.4% 98680224 / 97272882 / +1.4% 0.72 / 0.74 / -2.8%
tpcds_q24/datafusion:vortex-file-compressed 63496164 / 63926868 / -0.7% 88417682 / 83129432 / +6.4% 0.72 / 0.77 / -6.6%
tpcds_q25/datafusion:vortex-file-compressed 45782778 / 44475855 / +2.9% 72290330 / 66779639 / +8.3% 0.63 / 0.67 / -4.9%
tpcds_q26/datafusion:vortex-file-compressed 26438025 / 26101808 / +1.3% 48698859 / 45977400 / +5.9% 0.54 / 0.57 / -4.4%
tpcds_q27/datafusion:vortex-file-compressed 55963757 / 53289153 / +5.0% 72188372 / 76338183 / -5.4% 0.78 / 0.70 / +11.1%
tpcds_q28/datafusion:vortex-file-compressed 19022780 / 19381416 / -1.9% 39399273 / 39922526 / -1.3% 0.48 / 0.49 / -0.5%
tpcds_q29/datafusion:vortex-file-compressed 51909047 / 52347589 / -0.8% 71213121 / 73566264 / -3.2% 0.73 / 0.71 / +2.4%
tpcds_q30/datafusion:vortex-file-compressed 27407475 / 27661427 / -0.9% 46274199 / 45075272 / +2.7% 0.59 / 0.61 / -3.5%
tpcds_q31/datafusion:vortex-file-compressed 62269488 / 62516696 / -0.4% 89545254 / 87634339 / +2.2% 0.70 / 0.71 / -2.5%
tpcds_q32/datafusion:vortex-file-compressed 13052971 / 13025350 / +0.2% 32193060 / 30062663 / +7.1% 0.41 / 0.43 / -6.4%
tpcds_q33/datafusion:vortex-file-compressed 28160507 / 27991706 / +0.6% 49969707 / 50078992 / -0.2% 0.56 / 0.56 / +0.8%
tpcds_q34/datafusion:vortex-file-compressed 17743078 / 17855906 / -0.6% 38466999 / 36650085 / +5.0% 0.46 / 0.49 / -5.3%
tpcds_q35/datafusion:vortex-file-compressed 30490875 / 31075584 / -1.9% 54038246 / 54010849 / +0.1% 0.56 / 0.58 / -1.9%
tpcds_q36/datafusion:vortex-file-compressed 48067575 / 46691248 / +2.9% 67863372 / 69134076 / -1.8% 0.71 / 0.68 / +4.9%
tpcds_q37/datafusion:vortex-file-compressed 12641626 / 12935278 / -2.3% 34584086 / 33965509 / +1.8% 0.37 / 0.38 / -4.0%
tpcds_q38/datafusion:vortex-file-compressed 26300140 / 26436550 / -0.5% 49657804 / 46500479 / +6.8% 0.53 / 0.57 / -6.8%
tpcds_q39/datafusion:vortex-file-compressed 65460150 / 64408856 / +1.6% 86306712 / 87056639 / -0.9% 0.76 / 0.74 / +2.5%
tpcds_q40/datafusion:vortex-file-compressed 22816816 / 22195258 / +2.8% 41370857 / 39059042 / +5.9% 0.55 / 0.57 / -2.9%
tpcds_q41/datafusion:vortex-file-compressed 20314564 / 20181415 / +0.7% 33974615 / 32305841 / +5.2% 0.60 / 0.62 / -4.3%
tpcds_q42/datafusion:vortex-file-compressed 11565293 / 11610268 / -0.4% 30217714 / 27549864 / +9.7% 0.38 / 0.42 / -9.2%
tpcds_q43/datafusion:vortex-file-compressed 13419780 / 13251107 / +1.3% 34222573 / 31511768 / +8.6% 0.39 / 0.42 / -6.7%
tpcds_q44/datafusion:vortex-file-compressed 27680878 / 27407222 / +1.0% 51096491 / 49901538 / +2.4% 0.54 / 0.55 / -1.4%
tpcds_q45/datafusion:vortex-file-compressed 17656204 / 17168016 / +2.8% 36528398 / 34200247 / +6.8% 0.48 / 0.50 / -3.7%
tpcds_q46/datafusion:vortex-file-compressed 23706232 / 23558210 / +0.6% 47754304 / 45525195 / +4.9% 0.50 / 0.52 / -4.1%
tpcds_q47/datafusion:vortex-file-compressed 75453348 / 75593490 / -0.2% 105182276 / 103395942 / +1.7% 0.72 / 0.73 / -1.9%
tpcds_q48/datafusion:vortex-file-compressed 28625024 / 28579330 / +0.2% 52956500 / 51250463 / +3.3% 0.54 / 0.56 / -3.1%
tpcds_q49/datafusion:vortex-file-compressed 60264478 / 57212074 / +5.3% 77183660 / 74563681 / +3.5% 0.78 / 0.77 / +1.8%
tpcds_q50/datafusion:vortex-file-compressed 30368441 / 31077502 / -2.3% 51913202 / 51768133 / +0.3% 0.58 / 0.60 / -2.6%
tpcds_q51/datafusion:vortex-file-compressed 66230138 / 67219460 / -1.5% 92784619 / 89984116 / +3.1% 0.71 / 0.75 / -4.4%
tpcds_q52/datafusion:vortex-file-compressed 12011820 / 11829058 / +1.5% 29358933 / 28624926 / +2.6% 0.41 / 0.41 / -1.0%
tpcds_q53/datafusion:vortex-file-compressed 18555209 / 18240894 / +1.7% 42378316 / 37934996 / +11.7% 🔴 0.44 / 0.48 / -8.9%
tpcds_q54/datafusion:vortex-file-compressed 31921558 / 32073801 / -0.5% 54724432 / 53625583 / +2.0% 0.58 / 0.60 / -2.5%
tpcds_q55/datafusion:vortex-file-compressed 11645316 / 11528832 / +1.0% 29370944 / 27437884 / +7.0% 0.40 / 0.42 / -5.6%
tpcds_q56/datafusion:vortex-file-compressed 26843022 / 26666916 / +0.7% 49330815 / 47448670 / +4.0% 0.54 / 0.56 / -3.2%
tpcds_q57/datafusion:vortex-file-compressed 62116910 / 62012122 / +0.2% 89453636 / 87267119 / +2.5% 0.69 / 0.71 / -2.3%
tpcds_q58/datafusion:vortex-file-compressed 40811108 / 40818922 / -0.0% 69529746 / 64518211 / +7.8% 0.59 / 0.63 / -7.2%
tpcds_q59/datafusion:vortex-file-compressed 27628796 / 27906409 / -1.0% 55684503 / 53781464 / +3.5% 0.50 / 0.52 / -4.4%
tpcds_q60/datafusion:vortex-file-compressed 27467094 / 27726237 / -0.9% 50150604 / 47532249 / +5.5% 0.55 / 0.58 / -6.1%
tpcds_q61/datafusion:vortex-file-compressed 20725940 / 20214066 / +2.5% 41838448 / 39682747 / +5.4% 0.50 / 0.51 / -2.8%
tpcds_q62/datafusion:vortex-file-compressed 16550146 / 16850174 / -1.8% 35713745 / 34396629 / +3.8% 0.46 / 0.49 / -5.4%
tpcds_q63/datafusion:vortex-file-compressed 18542316 / 18192128 / +1.9% 40262106 / 37641254 / +7.0% 0.46 / 0.48 / -4.7%
tpcds_q64/datafusion:vortex-file-compressed 188649784 / 188561892 / +0.0% 221149791 / 229680212 / -3.7% 0.85 / 0.82 / +3.9%
tpcds_q65/datafusion:vortex-file-compressed 74248098 / 73066724 / +1.6% 97787661 / 96562612 / +1.3% 0.76 / 0.76 / +0.3%
tpcds_q66/datafusion:vortex-file-compressed 50425802 / 50096568 / +0.7% 73166957 / 69306342 / +5.6% 0.69 / 0.72 / -4.7%
tpcds_q67/datafusion:vortex-file-compressed 50720028 / 51663640 / -1.8% 84082951 / 83492505 / +0.7% 0.60 / 0.62 / -2.5%
tpcds_q68/datafusion:vortex-file-compressed 23055615 / 22888054 / +0.7% 45424933 / 44101071 / +3.0% 0.51 / 0.52 / -2.2%
tpcds_q69/datafusion:vortex-file-compressed 27295969 / 27546142 / -0.9% 53535222 / 47372016 / +13.0% 🔴 0.51 / 0.58 / -12.3%
tpcds_q70/datafusion:vortex-file-compressed 73276040 / 73486667 / -0.3% 96100067 / 97916702 / -1.9% 0.76 / 0.75 / +1.6%
tpcds_q71/datafusion:vortex-file-compressed 18516720 / 19173117 / -3.4% 38946170 / 37641700 / +3.5% 0.48 / 0.51 / -6.7%
tpcds_q72/datafusion:vortex-file-compressed 280348717 / 247376824 / +13.3% 🔴 348934056 / 279389691 / +24.9% 🔴 0.80 / 0.89 / -9.3%
tpcds_q73/datafusion:vortex-file-compressed 16358498 / 16283788 / +0.5% 38143879 / 37287301 / +2.3% 0.43 / 0.44 / -1.8%
tpcds_q74/datafusion:vortex-file-compressed 40603080 / 40826743 / -0.5% 67300498 / 66742487 / +0.8% 0.60 / 0.61 / -1.4%
tpcds_q75/datafusion:vortex-file-compressed 136460641 / 133968630 / +1.9% 161549231 / 162666038 / -0.7% 0.84 / 0.82 / +2.6%
tpcds_q76/datafusion:vortex-file-compressed 29556634 / 28638050 / +3.2% 51157246 / 48545831 / +5.4% 0.58 / 0.59 / -2.1%
tpcds_q77/datafusion:vortex-file-compressed 45467580 / 44422120 / +2.4% 68988179 / 65708594 / +5.0% 0.66 / 0.68 / -2.5%
tpcds_q78/datafusion:vortex-file-compressed 60176494 / 60965657 / -1.3% 90679753 / 86015972 / +5.4% 0.66 / 0.71 / -6.4%
tpcds_q79/datafusion:vortex-file-compressed 20562809 / 20279438 / +1.4% 42476904 / 42110377 / +0.9% 0.48 / 0.48 / +0.5%
tpcds_q80/datafusion:vortex-file-compressed 67941438 / 68766030 / -1.2% 94533792 / 93570722 / +1.0% 0.72 / 0.73 / -2.2%
tpcds_q81/datafusion:vortex-file-compressed 28384502 / 28260648 / +0.4% 47592660 / 45300560 / +5.1% 0.60 / 0.62 / -4.4%
tpcds_q82/datafusion:vortex-file-compressed 12461986 / 12807434 / -2.7% 37714930 / 35626130 / +5.9% 0.33 / 0.36 / -8.1%
tpcds_q83/datafusion:vortex-file-compressed 35203642 / 35376074 / -0.5% 53147217 / 52093141 / +2.0% 0.66 / 0.68 / -2.5%
tpcds_q84/datafusion:vortex-file-compressed 10738514 / 10461540 / +2.6% 27651798 / 25885722 / +6.8% 0.39 / 0.40 / -3.9%
tpcds_q85/datafusion:vortex-file-compressed 52368866 / 51809666 / +1.1% 78554494 / 75574697 / +3.9% 0.67 / 0.69 / -2.8%
tpcds_q86/datafusion:vortex-file-compressed 16133008 / 16113415 / +0.1% 36398771 / 34409002 / +5.8% 0.44 / 0.47 / -5.4%
tpcds_q87/datafusion:vortex-file-compressed 26396793 / 26499568 / -0.4% 48592604 / 48598250 / -0.0% 0.54 / 0.55 / -0.4%
tpcds_q88/datafusion:vortex-file-compressed 32508206 / 32357568 / +0.5% 53248913 / 50858837 / +4.7% 0.61 / 0.64 / -4.0%
tpcds_q89/datafusion:vortex-file-compressed 21583742 / 21807304 / -1.0% 43814793 / 42407282 / +3.3% 0.49 / 0.51 / -4.2%
tpcds_q90/datafusion:vortex-file-compressed 10657191 / 10365216 / +2.8% 27461805 / 24066050 / +14.1% 🔴 0.39 / 0.43 / -9.9%
tpcds_q91/datafusion:vortex-file-compressed 15548542 / 16048840 / -3.1% 37989945 / 36604324 / +3.8% 0.41 / 0.44 / -6.7%
tpcds_q92/datafusion:vortex-file-compressed 13168470 / 13198902 / -0.2% 31358481 / 29685220 / +5.6% 0.42 / 0.44 / -5.6%
tpcds_q93/datafusion:vortex-file-compressed 20181472 / 20150414 / +0.2% 42733089 / 40148939 / +6.4% 0.47 / 0.50 / -5.9%
tpcds_q94/datafusion:vortex-file-compressed 18890994 / 18552985 / +1.8% 39038152 / 37927246 / +2.9% 0.48 / 0.49 / -1.1%
tpcds_q95/datafusion:vortex-file-compressed 41787294 / 41763500 / +0.1% 62719570 / 60866535 / +3.0% 0.67 / 0.69 / -2.9%
tpcds_q96/datafusion:vortex-file-compressed 7663035 / 7859994 / -2.5% 26220723 / 23576532 / +11.2% 🔴 0.29 / 0.33 / -12.3%
tpcds_q97/datafusion:vortex-file-compressed 17261509 / 17259486 / +0.0% 40305246 / 37350276 / +7.9% 0.43 / 0.46 / -7.3%
tpcds_q98/datafusion:vortex-file-compressed 16139030 / 16185816 / -0.3% 36412562 / 32671739 / +11.4% 🔴 0.44 / 0.50 / -10.5%
tpcds_q99/datafusion:vortex-file-compressed 16474938 / 16384194 / +0.6% 35314083 / 33993322 / +3.9% 0.47 / 0.48 / -3.2%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42885381 / 43046149 / -0.4% 60771471 / 59333915 / +2.4% 0.71 / 0.73 / -2.7%
tpcds_q02/datafusion:parquet 54952216 / 55017496 / -0.1% 69936387 / 69006470 / +1.3% 0.79 / 0.80 / -1.4%
tpcds_q03/datafusion:parquet 18839705 / 19078092 / -1.2% 30859537 / 32968281 / -6.4% 0.61 / 0.58 / +5.5%
tpcds_q04/datafusion:parquet 180743756 / 179731768 / +0.6% 207931807 / 199226926 / +4.4% 0.87 / 0.90 / -3.6%
tpcds_q05/datafusion:parquet 68189560 / 68363662 / -0.3% 89062532 / 88310082 / +0.9% 0.77 / 0.77 / -1.1%
tpcds_q06/datafusion:parquet 33681131 / 35133400 / -4.1% 46234139 / 44032369 / +5.0% 0.73 / 0.80 / -8.7%
tpcds_q07/datafusion:parquet 46994988 / 47015244 / -0.0% 66538736 / 63060866 / +5.5% 0.71 / 0.75 / -5.3%
tpcds_q08/datafusion:parquet 31156816 / 31108916 / +0.2% 47191180 / 46407336 / +1.7% 0.66 / 0.67 / -1.5%
tpcds_q09/datafusion:parquet 32153352 / 32235404 / -0.3% 42996568 / 38162448 / +12.7% 🔴 0.75 / 0.84 / -11.5%
tpcds_q10/datafusion:parquet 43823444 / 45810956 / -4.3% 59530929 / 55821116 / +6.6% 0.74 / 0.82 / -10.3%
tpcds_q11/datafusion:parquet 97581888 / 97324552 / +0.3% 120037527 / 116986930 / +2.6% 0.81 / 0.83 / -2.3%
tpcds_q12/datafusion:parquet 23694516 / 23829389 / -0.6% 36660217 / 34561700 / +6.1% 0.65 / 0.69 / -6.3%
tpcds_q13/datafusion:parquet 46866294 / 47205746 / -0.7% 69619720 / 66519722 / +4.7% 0.67 / 0.71 / -5.1%
tpcds_q14/datafusion:parquet 535933832 / 536062596 / -0.0% 593617063 / 573875357 / +3.4% 0.90 / 0.93 / -3.3%
tpcds_q15/datafusion:parquet 23437210 / 23467316 / -0.1% 38049907 / 36912696 / +3.1% 0.62 / 0.64 / -3.1%
tpcds_q16/datafusion:parquet 36760186 / 36797934 / -0.1% 48881824 / 49093338 / -0.4% 0.75 / 0.75 / +0.3%
tpcds_q17/datafusion:parquet 72847978 / 77417738 / -5.9% 96770500 / 94152957 / +2.8% 0.75 / 0.82 / -8.4%
tpcds_q18/datafusion:parquet 65330391 / 67730459 / -3.5% 90005723 / 89015478 / +1.1% 0.73 / 0.76 / -4.6%
tpcds_q19/datafusion:parquet 29545814 / 29767255 / -0.7% 43793458 / 40859608 / +7.2% 0.67 / 0.73 / -7.4%
tpcds_q20/datafusion:parquet 25365642 / 24985466 / +1.5% 36486907 / 37149008 / -1.8% 0.70 / 0.67 / +3.4%
tpcds_q21/datafusion:parquet 20321548 / 20098942 / +1.1% 33017091 / 31199048 / +5.8% 0.62 / 0.64 / -4.5%
tpcds_q22/datafusion:parquet 76199034 / 78225004 / -2.6% 89679372 / 88011450 / +1.9% 0.85 / 0.89 / -4.4%
tpcds_q23/datafusion:parquet 92341442 / 93465786 / -1.2% 114030990 / 115763272 / -1.5% 0.81 / 0.81 / +0.3%
tpcds_q24/datafusion:parquet 91783862 / 90530880 / +1.4% 114245086 / 112774834 / +1.3% 0.80 / 0.80 / +0.1%
tpcds_q25/datafusion:parquet 81500641 / 78942378 / +3.2% 98570707 / 100286343 / -1.7% 0.83 / 0.79 / +5.0%
tpcds_q26/datafusion:parquet 43704171 / 42985690 / +1.7% 61494396 / 59286646 / +3.7% 0.71 / 0.73 / -2.0%
tpcds_q27/datafusion:parquet 75165311 / 78387144 / -4.1% 98520346 / 99975873 / -1.5% 0.76 / 0.78 / -2.7%
tpcds_q28/datafusion:parquet 28226888 / 28355490 / -0.5% 42822950 / 41055918 / +4.3% 0.66 / 0.69 / -4.6%
tpcds_q29/datafusion:parquet 75665324 / 74275574 / +1.9% 97204677 / 99075419 / -1.9% 0.78 / 0.75 / +3.8%
tpcds_q30/datafusion:parquet 45150642 / 44266542 / +2.0% 57995587 / 55134805 / +5.2% 0.78 / 0.80 / -3.0%
tpcds_q31/datafusion:parquet 82710170 / 80991932 / +2.1% 97560837 / 100088488 / -2.5% 0.85 / 0.81 / +4.8%
tpcds_q32/datafusion:parquet 26866049 / 27160338 / -1.1% 39798959 / 37888363 / +5.0% 0.68 / 0.72 / -5.8%
tpcds_q33/datafusion:parquet 37711956 / 37472210 / +0.6% 54723937 / 52784833 / +3.7% 0.69 / 0.71 / -2.9%
tpcds_q34/datafusion:parquet 24163395 / 24223199 / -0.2% 35536165 / 34925847 / +1.7% 0.68 / 0.69 / -2.0%
tpcds_q35/datafusion:parquet 50130929 / 50061658 / +0.1% 63461596 / 66186392 / -4.1% 0.79 / 0.76 / +4.4%
tpcds_q36/datafusion:parquet 53001912 / 53863620 / -1.6% 73109452 / 72008538 / +1.5% 0.72 / 0.75 / -3.1%
tpcds_q37/datafusion:parquet 21713454 / 21492292 / +1.0% 33215349 / 33965178 / -2.2% 0.65 / 0.63 / +3.3%
tpcds_q38/datafusion:parquet 45096788 / 43738358 / +3.1% 61400264 / 58984516 / +4.1% 0.73 / 0.74 / -1.0%
tpcds_q39/datafusion:parquet 68541648 / 68451454 / +0.1% 85471826 / 84694449 / +0.9% 0.80 / 0.81 / -0.8%
tpcds_q40/datafusion:parquet 31214796 / 29898065 / +4.4% 51725332 / 49416081 / +4.7% 0.60 / 0.61 / -0.3%
tpcds_q41/datafusion:parquet 19869449 / 19725044 / +0.7% 32835084 / 31567276 / +4.0% 0.61 / 0.62 / -3.2%
tpcds_q42/datafusion:parquet 18025954 / 18410036 / -2.1% 30200395 / 29096386 / +3.8% 0.60 / 0.63 / -5.7%
tpcds_q43/datafusion:parquet 19481935 / 19482850 / -0.0% 32363260 / 30496940 / +6.1% 0.60 / 0.64 / -5.8%
tpcds_q44/datafusion:parquet 35973464 / 35289568 / +1.9% 49493246 / 48402674 / +2.3% 0.73 / 0.73 / -0.3%
tpcds_q45/datafusion:parquet 28040553 / 28034722 / +0.0% 41772222 / 38421721 / +8.7% 0.67 / 0.73 / -8.0%
tpcds_q46/datafusion:parquet 28810204 / 29018574 / -0.7% 46853648 / 44678861 / +4.9% 0.61 / 0.65 / -5.3%
tpcds_q47/datafusion:parquet 97597814 / 96614053 / +1.0% 120966497 / 119575121 / +1.2% 0.81 / 0.81 / -0.1%
tpcds_q48/datafusion:parquet 42029380 / 42307228 / -0.7% 59324212 / 57749935 / +2.7% 0.71 / 0.73 / -3.3%
tpcds_q49/datafusion:parquet 71834439 / 72427164 / -0.8% 94516493 / 91585118 / +3.2% 0.76 / 0.79 / -3.9%
tpcds_q50/datafusion:parquet 46931838 / 47500422 / -1.2% 66579076 / 68227695 / -2.4% 0.70 / 0.70 / +1.2%
tpcds_q51/datafusion:parquet 74966204 / 74856850 / +0.1% 95738541 / 94480088 / +1.3% 0.78 / 0.79 / -1.2%
tpcds_q52/datafusion:parquet 18722034 / 18570137 / +0.8% 31487508 / 28281276 / +11.3% 🔴 0.59 / 0.66 / -9.4%
tpcds_q53/datafusion:parquet 22527114 / 21996628 / +2.4% 38676542 / 37632392 / +2.8% 0.58 / 0.58 / -0.4%
tpcds_q54/datafusion:parquet 54012850 / 53403201 / +1.1% 68065433 / 65412957 / +4.1% 0.79 / 0.82 / -2.8%
tpcds_q55/datafusion:parquet 18205452 / 18094322 / +0.6% 30316365 / 28452535 / +6.6% 0.60 / 0.64 / -5.6%
tpcds_q56/datafusion:parquet 41985037 / 42064521 / -0.2% 53623986 / 52494093 / +2.2% 0.78 / 0.80 / -2.3%
tpcds_q57/datafusion:parquet 101616146 / 98531152 / +3.1% 117506506 / 115051750 / +2.1% 0.86 / 0.86 / +1.0%
tpcds_q58/datafusion:parquet 65540784 / 66028114 / -0.7% 86578781 / 80484923 / +7.6% 0.76 / 0.82 / -7.7%
tpcds_q59/datafusion:parquet 46749352 / 48124550 / -2.9% 65023991 / 63375622 / +2.6% 0.72 / 0.76 / -5.3%
tpcds_q60/datafusion:parquet 42337139 / 41774428 / +1.3% 52185171 / 52913053 / -1.4% 0.81 / 0.79 / +2.8%
tpcds_q61/datafusion:parquet 37184061 / 36568854 / +1.7% 54471017 / 53842276 / +1.2% 0.68 / 0.68 / +0.5%
tpcds_q62/datafusion:parquet 25394515 / 25168784 / +0.9% 37554038 / 38657488 / -2.9% 0.68 / 0.65 / +3.9%
tpcds_q63/datafusion:parquet 22226394 / 22467320 / -1.1% 38238780 / 36224907 / +5.6% 0.58 / 0.62 / -6.3%
tpcds_q64/datafusion:parquet 285667392 / 285654170 / +0.0% 323957099 / 321241476 / +0.8% 0.88 / 0.89 / -0.8%
tpcds_q65/datafusion:parquet 120488030 / 119227688 / +1.1% 138392991 / 139579808 / -0.9% 0.87 / 0.85 / +1.9%
tpcds_q66/datafusion:parquet 61437194 / 61287888 / +0.2% 79766826 / 75163315 / +6.1% 0.77 / 0.82 / -5.5%
tpcds_q67/datafusion:parquet 68476876 / 69044428 / -0.8% 93449642 / 91696967 / +1.9% 0.73 / 0.75 / -2.7%
tpcds_q68/datafusion:parquet 28919103 / 29075160 / -0.5% 48738060 / 47405672 / +2.8% 0.59 / 0.61 / -3.3%
tpcds_q69/datafusion:parquet 43894103 / 43304174 / +1.4% 58668149 / 58652073 / +0.0% 0.75 / 0.74 / +1.3%
tpcds_q70/datafusion:parquet 80412814 / 80027439 / +0.5% 97967379 / 97604918 / +0.4% 0.82 / 0.82 / +0.1%
tpcds_q71/datafusion:parquet 24996540 / 25732466 / -2.9% 38445727 / 40528677 / -5.1% 0.65 / 0.63 / +2.4%
tpcds_q72/datafusion:parquet 527107346 / 527634840 / -0.1% 549564886 / 554349016 / -0.9% 0.96 / 0.95 / +0.8%
tpcds_q73/datafusion:parquet 24054604 / 23762050 / +1.2% 37120876 / 35077300 / +5.8% 0.65 / 0.68 / -4.3%
tpcds_q74/datafusion:parquet 70654416 / 69999536 / +0.9% 86369629 / 88289509 / -2.2% 0.82 / 0.79 / +3.2%
tpcds_q75/datafusion:parquet 152524798 / 152662930 / -0.1% 181201739 / 180450074 / +0.4% 0.84 / 0.85 / -0.5%
tpcds_q76/datafusion:parquet 33597493 / 33132911 / +1.4% 48335665 / 44935481 / +7.6% 0.70 / 0.74 / -5.7%
tpcds_q77/datafusion:parquet 56645144 / 56979256 / -0.6% 73809843 / 72969812 / +1.2% 0.77 / 0.78 / -1.7%
tpcds_q78/datafusion:parquet 85562806 / 85272162 / +0.3% 121275946 / 115614404 / +4.9% 0.71 / 0.74 / -4.3%
tpcds_q79/datafusion:parquet 26866696 / 26735792 / +0.5% 42631220 / 39769716 / +7.2% 0.63 / 0.67 / -6.3%
tpcds_q80/datafusion:parquet 81875436 / 78680880 / +4.1% 111829550 / 107863155 / +3.7% 0.73 / 0.73 / +0.4%
tpcds_q81/datafusion:parquet 38971520 / 39558134 / -1.5% 51333428 / 51081109 / +0.5% 0.76 / 0.77 / -2.0%
tpcds_q82/datafusion:parquet 22890822 / 22190428 / +3.2% 35231382 / 34291795 / +2.7% 0.65 / 0.65 / +0.4%
tpcds_q83/datafusion:parquet 59345292 / 58307740 / +1.8% 76552215 / 73002134 / +4.9% 0.78 / 0.80 / -2.9%
tpcds_q84/datafusion:parquet 25299157 / 27313596 / -7.4% 41324175 / 40041516 / +3.2% 0.61 / 0.68 / -10.3%
tpcds_q85/datafusion:parquet 80492384 / 79983598 / +0.6% 103153427 / 102306985 / +0.8% 0.78 / 0.78 / -0.2%
tpcds_q86/datafusion:parquet 21193176 / 21058438 / +0.6% 34055716 / 32574181 / +4.5% 0.62 / 0.65 / -3.7%
tpcds_q87/datafusion:parquet 45148894 / 45280914 / -0.3% 61126236 / 62384128 / -2.0% 0.74 / 0.73 / +1.8%
tpcds_q88/datafusion:parquet 38094520 / 37757294 / +0.9% 52490991 / 51820809 / +1.3% 0.73 / 0.73 / -0.4%
tpcds_q89/datafusion:parquet 25425586 / 26318301 / -3.4% 42013983 / 39991728 / +5.1% 0.61 / 0.66 / -8.0%
tpcds_q90/datafusion:parquet 15103591 / 15087966 / +0.1% 26213859 / 26597960 / -1.4% 0.58 / 0.57 / +1.6%
tpcds_q91/datafusion:parquet 32328442 / 32625398 / -0.9% 49348384 / 45196471 / +9.2% 0.66 / 0.72 / -9.2%
tpcds_q92/datafusion:parquet 27106364 / 26834922 / +1.0% 40713520 / 38063167 / +7.0% 0.67 / 0.71 / -5.6%
tpcds_q93/datafusion:parquet 27678198 / 26735974 / +3.5% 46893439 / 42486273 / +10.4% 🔴 0.59 / 0.63 / -6.2%
tpcds_q94/datafusion:parquet 35013680 / 35393988 / -1.1% 49762403 / 47118664 / +5.6% 0.70 / 0.75 / -6.3%
tpcds_q95/datafusion:parquet 64424272 / 64212454 / +0.3% 79480059 / 79492966 / -0.0% 0.81 / 0.81 / +0.3%
tpcds_q96/datafusion:parquet 12997344 / 12723054 / +2.2% 25407103 / 23429883 / +8.4% 0.51 / 0.54 / -5.8%
tpcds_q97/datafusion:parquet 35261908 / 35098156 / +0.5% 50351860 / 49335860 / +2.1% 0.70 / 0.71 / -1.6%
tpcds_q98/datafusion:parquet 24449078 / 25139323 / -2.7% 39173078 / 36349537 / +7.8% 0.62 / 0.69 / -9.8%
tpcds_q99/datafusion:parquet 29922276 / 29673968 / +0.8% 43172948 / 41366470 / +4.4% 0.69 / 0.72 / -3.4%
duckdb / vortex-file-compressed / ns (0.989x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15931782 / 15890239 / +0.3% 24926176 / 24196641 / +3.0% 0.64 / 0.66 / -2.7%
tpcds_q02/duckdb:vortex-file-compressed 15501914 / 18657920 / -16.9% 🟢 22975012 / 22422968 / +2.5% 0.67 / 0.83 / -18.9%
tpcds_q03/duckdb:vortex-file-compressed 7189966 / 7149274 / +0.6% 17147774 / 16220757 / +5.7% 0.42 / 0.44 / -4.9%
tpcds_q04/duckdb:vortex-file-compressed 58704950 / 58862208 / -0.3% 71642661 / 71856038 / -0.3% 0.82 / 0.82 / +0.0%
tpcds_q05/duckdb:vortex-file-compressed 22729086 / 23117854 / -1.7% 32794717 / 32942130 / -0.4% 0.69 / 0.70 / -1.2%
tpcds_q06/duckdb:vortex-file-compressed 23831592 / 24164680 / -1.4% 38896660 / 37874428 / +2.7% 0.61 / 0.64 / -4.0%
tpcds_q07/duckdb:vortex-file-compressed 21990437 / 22109802 / -0.5% 34497479 / 32504438 / +6.1% 0.64 / 0.68 / -6.3%
tpcds_q08/duckdb:vortex-file-compressed 17113290 / 17492722 / -2.2% 25459253 / 25089879 / +1.5% 0.67 / 0.70 / -3.6%
tpcds_q09/duckdb:vortex-file-compressed 19066190 / 19005454 / +0.3% 28856151 / 29541405 / -2.3% 0.66 / 0.64 / +2.7%
tpcds_q10/duckdb:vortex-file-compressed 27382686 / 27533383 / -0.5% 40813675 / 41135181 / -0.8% 0.67 / 0.67 / +0.2%
tpcds_q11/duckdb:vortex-file-compressed 35573940 / 36618646 / -2.9% 44565500 / 44343100 / +0.5% 0.80 / 0.83 / -3.3%
tpcds_q12/duckdb:vortex-file-compressed 9623008 / 9679752 / -0.6% 15552440 / 17229625 / -9.7% 0.62 / 0.56 / +10.1%
tpcds_q13/duckdb:vortex-file-compressed 19224354 / 19843352 / -3.1% 32732139 / 31995768 / +2.3% 0.59 / 0.62 / -5.3%
tpcds_q14/duckdb:vortex-file-compressed 54870468 / 55297112 / -0.8% 65499106 / 64955646 / +0.8% 0.84 / 0.85 / -1.6%
tpcds_q15/duckdb:vortex-file-compressed 11129975 / 11325009 / -1.7% 18011162 / 18325444 / -1.7% 0.62 / 0.62 / -0.0%
tpcds_q16/duckdb:vortex-file-compressed 24622424 / 24731064 / -0.4% 35330190 / 34853379 / +1.4% 0.70 / 0.71 / -1.8%
tpcds_q17/duckdb:vortex-file-compressed 20378763 / 20396798 / -0.1% 32844035 / 32338231 / +1.6% 0.62 / 0.63 / -1.6%
tpcds_q18/duckdb:vortex-file-compressed 31778626 / 32346349 / -1.8% 42646986 / 43278488 / -1.5% 0.75 / 0.75 / -0.3%
tpcds_q19/duckdb:vortex-file-compressed 20346766 / 20786617 / -2.1% 29246662 / 29101806 / +0.5% 0.70 / 0.71 / -2.6%
tpcds_q20/duckdb:vortex-file-compressed 10453038 / 10704608 / -2.4% 17702590 / 17476285 / +1.3% 0.59 / 0.61 / -3.6%
tpcds_q21/duckdb:vortex-file-compressed 9190130 / 9371898 / -1.9% 22554350 / 21703364 / +3.9% 0.41 / 0.43 / -5.6%
tpcds_q22/duckdb:vortex-file-compressed 17551476 / 17643249 / -0.5% 29559354 / 29161310 / +1.4% 0.59 / 0.61 / -1.9%
tpcds_q23/duckdb:vortex-file-compressed 37366172 / 37431455 / -0.2% 47540430 / 48459168 / -1.9% 0.79 / 0.77 / +1.8%
tpcds_q24/duckdb:vortex-file-compressed 25880766 / 26441519 / -2.1% 38006076 / 36595428 / +3.9% 0.68 / 0.72 / -5.8%
tpcds_q25/duckdb:vortex-file-compressed 19206703 / 19221668 / -0.1% 31307378 / 30221864 / +3.6% 0.61 / 0.64 / -3.5%
tpcds_q26/duckdb:vortex-file-compressed 21253402 / 21300105 / -0.2% 31808610 / 31212707 / +1.9% 0.67 / 0.68 / -2.1%
tpcds_q27/duckdb:vortex-file-compressed 24621869 / 24807916 / -0.7% 37106901 / 35637087 / +4.1% 0.66 / 0.70 / -4.7%
tpcds_q28/duckdb:vortex-file-compressed 14961450 / 15090790 / -0.9% 25066769 / 25912108 / -3.3% 0.60 / 0.58 / +2.5%
tpcds_q29/duckdb:vortex-file-compressed 18343978 / 18678136 / -1.8% 30057341 / 29174081 / +3.0% 0.61 / 0.64 / -4.7%
tpcds_q30/duckdb:vortex-file-compressed 18318218 / 18682425 / -1.9% 27174223 / 27172488 / +0.0% 0.67 / 0.69 / -2.0%
tpcds_q31/duckdb:vortex-file-compressed 17887210 / 17961668 / -0.4% 26900871 / 26844104 / +0.2% 0.66 / 0.67 / -0.6%
tpcds_q32/duckdb:vortex-file-compressed 10398397 / 10237077 / +1.6% 18381503 / 18081369 / +1.7% 0.57 / 0.57 / -0.1%
tpcds_q33/duckdb:vortex-file-compressed 18061278 / 17651904 / +2.3% 27854832 / 27599437 / +0.9% 0.65 / 0.64 / +1.4%
tpcds_q34/duckdb:vortex-file-compressed 13001737 / 12881700 / +0.9% 22735347 / 21645185 / +5.0% 0.57 / 0.60 / -3.9%
tpcds_q35/duckdb:vortex-file-compressed 30770353 / 31119364 / -1.1% 43963916 / 42566508 / +3.3% 0.70 / 0.73 / -4.3%
tpcds_q36/duckdb:vortex-file-compressed 13897798 / 14037150 / -1.0% 24842055 / 23560362 / +5.4% 0.56 / 0.60 / -6.1%
tpcds_q37/duckdb:vortex-file-compressed 9358448 / 9278629 / +0.9% 24754542 / 24238961 / +2.1% 0.38 / 0.38 / -1.2%
tpcds_q38/duckdb:vortex-file-compressed 24333069 / 24606434 / -1.1% 31788189 / 31179343 / +2.0% 0.77 / 0.79 / -3.0%
tpcds_q39/duckdb:vortex-file-compressed 18606399 / 18495272 / +0.6% 32812976 / 30737214 / +6.8% 0.57 / 0.60 / -5.8%
tpcds_q40/duckdb:vortex-file-compressed 10991250 / 11167876 / -1.6% 19863836 / 19316090 / +2.8% 0.55 / 0.58 / -4.3%
tpcds_q41/duckdb:vortex-file-compressed 14532542 / 17305600 / -16.0% 🟢 20952528 / 24395246 / -14.1% 🟢 0.69 / 0.71 / -2.2%
tpcds_q42/duckdb:vortex-file-compressed 6665352 / 6914912 / -3.6% 16485153 / 15064464 / +9.4% 0.40 / 0.46 / -11.9%
tpcds_q43/duckdb:vortex-file-compressed 9570929 / 9643249 / -0.7% 19866176 / 18160250 / +9.4% 0.48 / 0.53 / -9.3%
tpcds_q44/duckdb:vortex-file-compressed 12387342 / 12476409 / -0.7% 25046523 / 23821756 / +5.1% 0.49 / 0.52 / -5.6%
tpcds_q45/duckdb:vortex-file-compressed 23315760 / 23587638 / -1.2% 30091779 / 30430270 / -1.1% 0.77 / 0.78 / -0.0%
tpcds_q46/duckdb:vortex-file-compressed 31518222 / 31418024 / +0.3% 44161593 / 43171545 / +2.3% 0.71 / 0.73 / -1.9%
tpcds_q47/duckdb:vortex-file-compressed 30496606 / 31264494 / -2.5% 40658350 / 41141020 / -1.2% 0.75 / 0.76 / -1.3%
tpcds_q48/duckdb:vortex-file-compressed 21524110 / 22472531 / -4.2% 34655528 / 35469142 / -2.3% 0.62 / 0.63 / -2.0%
tpcds_q49/duckdb:vortex-file-compressed 18167112 / 18985566 / -4.3% 29296421 / 29722088 / -1.4% 0.62 / 0.64 / -2.9%
tpcds_q50/duckdb:vortex-file-compressed 14597650 / 14896845 / -2.0% 25625412 / 25687406 / -0.2% 0.57 / 0.58 / -1.8%
tpcds_q51/duckdb:vortex-file-compressed 48283942 / 48063878 / +0.5% 57592739 / 76334322 / -24.6% 🟢 0.84 / 0.63 / +33.1%
tpcds_q52/duckdb:vortex-file-compressed 7000065 / 7171716 / -2.4% 16565608 / 15978547 / +3.7% 0.42 / 0.45 / -5.9%
tpcds_q53/duckdb:vortex-file-compressed 11072209 / 11319189 / -2.2% 20960136 / 21681207 / -3.3% 0.53 / 0.52 / +1.2%
tpcds_q54/duckdb:vortex-file-compressed 19381834 / 19748759 / -1.9% 30906593 / 29438540 / +5.0% 0.63 / 0.67 / -6.5%
tpcds_q55/duckdb:vortex-file-compressed 6727570 / 6847788 / -1.8% 16395928 / 15285422 / +7.3% 0.41 / 0.45 / -8.4%
tpcds_q56/duckdb:vortex-file-compressed 17891954 / 17817582 / +0.4% 27859843 / 28613711 / -2.6% 0.64 / 0.62 / +3.1%
tpcds_q57/duckdb:vortex-file-compressed 25069264 / 25308086 / -0.9% 34197861 / 33487780 / +2.1% 0.73 / 0.76 / -3.0%
tpcds_q58/duckdb:vortex-file-compressed 20235072 / 20359384 / -0.6% 29848244 / 29241349 / +2.1% 0.68 / 0.70 / -2.6%
tpcds_q59/duckdb:vortex-file-compressed 19385591 / 19485481 / -0.5% 26711667 / 26442217 / +1.0% 0.73 / 0.74 / -1.5%
tpcds_q60/duckdb:vortex-file-compressed 18716020 / 18504610 / +1.1% 28939334 / 28842068 / +0.3% 0.65 / 0.64 / +0.8%
tpcds_q61/duckdb:vortex-file-compressed 19656768 / 19922872 / -1.3% 31131580 / 30039600 / +3.6% 0.63 / 0.66 / -4.8%
tpcds_q62/duckdb:vortex-file-compressed 11003518 / 10937722 / +0.6% 17627654 / 17144486 / +2.8% 0.62 / 0.64 / -2.2%
tpcds_q63/duckdb:vortex-file-compressed 10672740 / 10809960 / -1.3% 19369231 / 20560158 / -5.8% 0.55 / 0.53 / +4.8%
tpcds_q64/duckdb:vortex-file-compressed 52013540 / 52513062 / -1.0% 69678590 / 68406502 / +1.9% 0.75 / 0.77 / -2.8%
tpcds_q65/duckdb:vortex-file-compressed 13035291 / 13060742 / -0.2% 23397723 / 23236608 / +0.7% 0.56 / 0.56 / -0.9%
tpcds_q66/duckdb:vortex-file-compressed 31239876 / 31272590 / -0.1% 38360167 / 39351988 / -2.5% 0.81 / 0.79 / +2.5%
tpcds_q67/duckdb:vortex-file-compressed 57640007 / 55266268 / +4.3% 64211738 / 64683896 / -0.7% 0.90 / 0.85 / +5.1%
tpcds_q68/duckdb:vortex-file-compressed 22821237 / 23009998 / -0.8% 35971509 / 35296552 / +1.9% 0.63 / 0.65 / -2.7%
tpcds_q69/duckdb:vortex-file-compressed 21976466 / 22017648 / -0.2% 36209003 / 36691775 / -1.3% 0.61 / 0.60 / +1.1%
tpcds_q70/duckdb:vortex-file-compressed 14391950 / 14724129 / -2.3% 26272435 / 25052861 / +4.9% 0.55 / 0.59 / -6.8%
tpcds_q71/duckdb:vortex-file-compressed 13369130 / 13347567 / +0.2% 23759665 / 23409485 / +1.5% 0.56 / 0.57 / -1.3%
tpcds_q72/duckdb:vortex-file-compressed 42371384 / 43060600 / -1.6% 56718610 / 56269909 / +0.8% 0.75 / 0.77 / -2.4%
tpcds_q73/duckdb:vortex-file-compressed 11826371 / 11829364 / -0.0% 21669796 / 21106781 / +2.7% 0.55 / 0.56 / -2.6%
tpcds_q74/duckdb:vortex-file-compressed 30275314 / 30874616 / -1.9% 38829164 / 39304395 / -1.2% 0.78 / 0.79 / -0.7%
tpcds_q75/duckdb:vortex-file-compressed 37206364 / 37067086 / +0.4% 48617913 / 48402666 / +0.4% 0.77 / 0.77 / -0.1%
tpcds_q76/duckdb:vortex-file-compressed 12724584 / 12879005 / -1.2% 22113709 / 22058251 / +0.3% 0.58 / 0.58 / -1.4%
tpcds_q77/duckdb:vortex-file-compressed 20914406 / 20386666 / +2.6% 31044675 / 31298903 / -0.8% 0.67 / 0.65 / +3.4%
tpcds_q78/duckdb:vortex-file-compressed 42954846 / 42921238 / +0.1% 53662655 / 52920959 / +1.4% 0.80 / 0.81 / -1.3%
tpcds_q79/duckdb:vortex-file-compressed 16899083 / 17204298 / -1.8% 28482165 / 26915068 / +5.8% 0.59 / 0.64 / -7.2%
tpcds_q80/duckdb:vortex-file-compressed 29821078 / 29835128 / -0.0% 44640879 / 43751968 / +2.0% 0.67 / 0.68 / -2.0%
tpcds_q81/duckdb:vortex-file-compressed 20999678 / 21403570 / -1.9% 30859859 / 30302750 / +1.8% 0.68 / 0.71 / -3.7%
tpcds_q82/duckdb:vortex-file-compressed 9524983 / 9601288 / -0.8% 24726154 / 23700733 / +4.3% 0.39 / 0.41 / -4.9%
tpcds_q83/duckdb:vortex-file-compressed 17546277 / 17487681 / +0.3% 24576225 / 24391032 / +0.8% 0.71 / 0.72 / -0.4%
tpcds_q84/duckdb:vortex-file-compressed 15460900 / 15474432 / -0.1% 21848929 / 23926919 / -8.7% 0.71 / 0.65 / +9.4%
tpcds_q85/duckdb:vortex-file-compressed 23638266 / 25015558 / -5.5% 35482140 / 36358715 / -2.4% 0.67 / 0.69 / -3.2%
tpcds_q86/duckdb:vortex-file-compressed 9709028 / 9625184 / +0.9% 16332419 / 16115124 / +1.3% 0.59 / 0.60 / -0.5%
tpcds_q87/duckdb:vortex-file-compressed 25834862 / 26050646 / -0.8% 33725176 / 33749194 / -0.1% 0.77 / 0.77 / -0.8%
tpcds_q88/duckdb:vortex-file-compressed 30266238 / 30341066 / -0.2% 39135661 / 40666123 / -3.8% 0.77 / 0.75 / +3.7%
tpcds_q89/duckdb:vortex-file-compressed 11801452 / 11880278 / -0.7% 21246390 / 21020275 / +1.1% 0.56 / 0.57 / -1.7%
tpcds_q90/duckdb:vortex-file-compressed 7853210 / 7873380 / -0.3% 15095959 / 15793821 / -4.4% 0.52 / 0.50 / +4.4%
tpcds_q91/duckdb:vortex-file-compressed 14193555 / 14680431 / -3.3% 22820108 / 23432754 / -2.6% 0.62 / 0.63 / -0.7%
tpcds_q92/duckdb:vortex-file-compressed 10315649 / 10362186 / -0.4% 17744313 / 17798675 / -0.3% 0.58 / 0.58 / -0.1%
tpcds_q93/duckdb:vortex-file-compressed 10137149 / 10321070 / -1.8% 21727386 / 22416155 / -3.1% 0.47 / 0.46 / +1.3%
tpcds_q94/duckdb:vortex-file-compressed 22123482 / 22085020 / +0.2% 32190667 / 31715817 / +1.5% 0.69 / 0.70 / -1.3%
tpcds_q95/duckdb:vortex-file-compressed 60930788 / 60520896 / +0.7% 68196991 / 67458992 / +1.1% 0.89 / 0.90 / -0.4%
tpcds_q96/duckdb:vortex-file-compressed 6447782 / 6497133 / -0.8% 15312565 / 15310655 / +0.0% 0.42 / 0.42 / -0.8%
tpcds_q97/duckdb:vortex-file-compressed 23266294 / 22917520 / +1.5% 31689078 / 31822045 / -0.4% 0.73 / 0.72 / +1.9%
tpcds_q98/duckdb:vortex-file-compressed 10886735 / 10919490 / -0.3% 19711798 / 19425955 / +1.5% 0.55 / 0.56 / -1.7%
tpcds_q99/duckdb:vortex-file-compressed 14476644 / 14421880 / +0.4% 22828527 / 22012689 / +3.7% 0.63 / 0.66 / -3.2%
duckdb / parquet / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24139774 / 24093628 / +0.2% 30905961 / 30609636 / +1.0% 0.78 / 0.79 / -0.8%
tpcds_q02/duckdb:parquet 17718480 / 17984803 / -1.5% 23785032 / 24025915 / -1.0% 0.74 / 0.75 / -0.5%
tpcds_q03/duckdb:parquet 9759363 / 9812261 / -0.5% 15723092 / 15610845 / +0.7% 0.62 / 0.63 / -1.2%
tpcds_q04/duckdb:parquet 116502384 / 118053322 / -1.3% 127204157 / 125451786 / +1.4% 0.92 / 0.94 / -2.7%
tpcds_q05/duckdb:parquet 28135984 / 28431532 / -1.0% 32557942 / 33184023 / -1.9% 0.86 / 0.86 / +0.9%
tpcds_q06/duckdb:parquet 26637938 / 26561266 / +0.3% 35598199 / 34919227 / +1.9% 0.75 / 0.76 / -1.6%
tpcds_q07/duckdb:parquet 32817732 / 31458600 / +4.3% 38467000 / 38910397 / -1.1% 0.85 / 0.81 / +5.5%
tpcds_q08/duckdb:parquet 19724360 / 19835614 / -0.6% 25288370 / 26315778 / -3.9% 0.78 / 0.75 / +3.5%
tpcds_q09/duckdb:parquet 26404426 / 27590826 / -4.3% 30208473 / 29561025 / +2.2% 0.87 / 0.93 / -6.4%
tpcds_q10/duckdb:parquet 32514686 / 32550451 / -0.1% 40317083 / 40051128 / +0.7% 0.81 / 0.81 / -0.8%
tpcds_q11/duckdb:parquet 68813915 / 68928280 / -0.2% 75667085 / 76188001 / -0.7% 0.91 / 0.90 / +0.5%
tpcds_q12/duckdb:parquet 13755450 / 13995176 / -1.7% 19272692 / 19053083 / +1.2% 0.71 / 0.73 / -2.8%
tpcds_q13/duckdb:parquet 31589152 / 33308439 / -5.2% 39422785 / 39541391 / -0.3% 0.80 / 0.84 / -4.9%
tpcds_q14/duckdb:parquet 63490596 / 64769091 / -2.0% 66803379 / 68114003 / -1.9% 0.95 / 0.95 / -0.1%
tpcds_q15/duckdb:parquet 16587580 / 16637540 / -0.3% 22615373 / 22243900 / +1.7% 0.73 / 0.75 / -1.9%
tpcds_q16/duckdb:parquet 30019338 / 30104670 / -0.3% 40266097 / 37135181 / +8.4% 0.75 / 0.81 / -8.0%
tpcds_q17/duckdb:parquet 34010972 / 34477460 / -1.4% 40128006 / 40356696 / -0.6% 0.85 / 0.85 / -0.8%
tpcds_q18/duckdb:parquet 46547444 / 47148372 / -1.3% 54705550 / 54249081 / +0.8% 0.85 / 0.87 / -2.1%
tpcds_q19/duckdb:parquet 18668456 / 19018304 / -1.8% 25557690 / 25382414 / +0.7% 0.73 / 0.75 / -2.5%
tpcds_q20/duckdb:parquet 14856836 / 14902117 / -0.3% 19437184 / 19412123 / +0.1% 0.76 / 0.77 / -0.4%
tpcds_q21/duckdb:parquet 10350127 / 10731116 / -3.6% 17151689 / 17030686 / +0.7% 0.60 / 0.63 / -4.2%
tpcds_q22/duckdb:parquet 20648019 / 20507718 / +0.7% 26646179 / 26762155 / -0.4% 0.77 / 0.77 / +1.1%
tpcds_q23/duckdb:parquet 46380500 / 42833082 / +8.3% 46716905 / 49424056 / -5.5% 0.99 / 0.87 / +14.6%
tpcds_q24/duckdb:parquet 30282390 / 29943294 / +1.1% 36836918 / 36464447 / +1.0% 0.82 / 0.82 / +0.1%
tpcds_q25/duckdb:parquet 30252274 / 30514354 / -0.9% 36701332 / 37025273 / -0.9% 0.82 / 0.82 / +0.0%
tpcds_q26/duckdb:parquet 28697128 / 29252328 / -1.9% 34993626 / 35038512 / -0.1% 0.82 / 0.83 / -1.8%
tpcds_q27/duckdb:parquet 34886590 / 34872377 / +0.0% 41130730 / 41229992 / -0.2% 0.85 / 0.85 / +0.3%
tpcds_q28/duckdb:parquet 26529441 / 25185258 / +5.3% 34582941 / 31104212 / +11.2% 🔴 0.77 / 0.81 / -5.3%
tpcds_q29/duckdb:parquet 31893664 / 32150195 / -0.8% 39302217 / 38969206 / +0.9% 0.81 / 0.83 / -1.6%
tpcds_q30/duckdb:parquet 35424552 / 35528874 / -0.3% 44884564 / 44172843 / +1.6% 0.79 / 0.80 / -1.9%
tpcds_q31/duckdb:parquet 36638284 / 35529000 / +3.1% 43187492 / 42639874 / +1.3% 0.85 / 0.83 / +1.8%
tpcds_q32/duckdb:parquet 14011412 / 14179243 / -1.2% 20372777 / 21025962 / -3.1% 0.69 / 0.67 / +2.0%
tpcds_q33/duckdb:parquet 24777984 / 23095442 / +7.3% 28972461 / 28549004 / +1.5% 0.86 / 0.81 / +5.7%
tpcds_q34/duckdb:parquet 19865808 / 16952271 / +17.2% 🔴 24415813 / 24176719 / +1.0% 0.81 / 0.70 / +16.0%
tpcds_q35/duckdb:parquet 35150354 / 34975734 / +0.5% 43655929 / 43207543 / +1.0% 0.81 / 0.81 / -0.5%
tpcds_q36/duckdb:parquet 39185354 / 39485050 / -0.8% 46948419 / 47479406 / -1.1% 0.83 / 0.83 / +0.4%
tpcds_q37/duckdb:parquet 12888498 / 12797622 / +0.7% 19313626 / 19277008 / +0.2% 0.67 / 0.66 / +0.5%
tpcds_q38/duckdb:parquet 29436894 / 29621006 / -0.6% 33337381 / 33433489 / -0.3% 0.88 / 0.89 / -0.3%
tpcds_q39/duckdb:parquet 23319875 / 23128167 / +0.8% 29123192 / 29595365 / -1.6% 0.80 / 0.78 / +2.5%
tpcds_q40/duckdb:parquet 15860096 / 16054940 / -1.2% 21408756 / 21235777 / +0.8% 0.74 / 0.76 / -2.0%
tpcds_q41/duckdb:parquet 11900700 / 11966633 / -0.6% 18337041 / 18065700 / +1.5% 0.65 / 0.66 / -2.0%
tpcds_q42/duckdb:parquet 9564102 / 9626178 / -0.6% 15605469 / 15525610 / +0.5% 0.61 / 0.62 / -1.2%
tpcds_q43/duckdb:parquet 12172356 / 12048868 / +1.0% 17853474 / 18128038 / -1.5% 0.68 / 0.66 / +2.6%
tpcds_q44/duckdb:parquet 20594497 / 21607511 / -4.7% 27083976 / 26196804 / +3.4% 0.76 / 0.82 / -7.8%
tpcds_q45/duckdb:parquet 20823410 / 20908743 / -0.4% 27489598 / 27486675 / +0.0% 0.76 / 0.76 / -0.4%
tpcds_q46/duckdb:parquet 37532291 / 35288508 / +6.4% 43404882 / 43320711 / +0.2% 0.86 / 0.81 / +6.2%
tpcds_q47/duckdb:parquet 34575253 / 34531498 / +0.1% 41376842 / 41336316 / +0.1% 0.84 / 0.84 / +0.0%
tpcds_q48/duckdb:parquet 30397708 / 29103170 / +4.4% 36486892 / 36426435 / +0.2% 0.83 / 0.80 / +4.3%
tpcds_q49/duckdb:parquet 28978946 / 30233053 / -4.1% 36356949 / 36303817 / +0.1% 0.80 / 0.83 / -4.3%
tpcds_q50/duckdb:parquet 19629815 / 20388898 / -3.7% 25280504 / 25331399 / -0.2% 0.78 / 0.80 / -3.5%
tpcds_q51/duckdb:parquet 51731528 / 52104356 / -0.7% 60178109 / 61245199 / -1.7% 0.86 / 0.85 / +1.0%
tpcds_q52/duckdb:parquet 9576469 / 9659180 / -0.9% 15438797 / 15499988 / -0.4% 0.62 / 0.62 / -0.5%
tpcds_q53/duckdb:parquet 13661774 / 14537118 / -6.0% 21111358 / 20752143 / +1.7% 0.65 / 0.70 / -7.6%
tpcds_q54/duckdb:parquet 24700180 / 24733616 / -0.1% 32200101 / 31908376 / +0.9% 0.77 / 0.78 / -1.0%
tpcds_q55/duckdb:parquet 9358330 / 9489484 / -1.4% 15300436 / 15341981 / -0.3% 0.61 / 0.62 / -1.1%
tpcds_q56/duckdb:parquet 25571532 / 27141406 / -5.8% 29789034 / 30419221 / -2.1% 0.86 / 0.89 / -3.8%
tpcds_q57/duckdb:parquet 30209491 / 30693180 / -1.6% 36083587 / 36167354 / -0.2% 0.84 / 0.85 / -1.3%
tpcds_q58/duckdb:parquet 23943621 / 23919381 / +0.1% 29570269 / 29814453 / -0.8% 0.81 / 0.80 / +0.9%
tpcds_q59/duckdb:parquet 22503084 / 22867650 / -1.6% 28658005 / 28707391 / -0.2% 0.79 / 0.80 / -1.4%
tpcds_q60/duckdb:parquet 28706547 / 26316208 / +9.1% 32644352 / 31957179 / +2.2% 0.88 / 0.82 / +6.8%
tpcds_q61/duckdb:parquet 24166377 / 24749493 / -2.4% 28739632 / 29026258 / -1.0% 0.84 / 0.85 / -1.4%
tpcds_q62/duckdb:parquet 12688372 / 12721642 / -0.3% 17827953 / 17771445 / +0.3% 0.71 / 0.72 / -0.6%
tpcds_q63/duckdb:parquet 13372252 / 14341675 / -6.8% 19969412 / 20011856 / -0.2% 0.67 / 0.72 / -6.6%
tpcds_q64/duckdb:parquet 69727281 / 70307914 / -0.8% 79875903 / 79575965 / +0.4% 0.87 / 0.88 / -1.2%
tpcds_q65/duckdb:parquet 20141702 / 20569484 / -2.1% 26390880 / 25477560 / +3.6% 0.76 / 0.81 / -5.5%
tpcds_q66/duckdb:parquet 32993564 / 33045765 / -0.2% 37996317 / 38019443 / -0.1% 0.87 / 0.87 / -0.1%
tpcds_q67/duckdb:parquet 60447312 / 61027914 / -1.0% 66681152 / 66818321 / -0.2% 0.91 / 0.91 / -0.7%
tpcds_q68/duckdb:parquet 28034732 / 30834914 / -9.1% 35809949 / 35993030 / -0.5% 0.78 / 0.86 / -8.6%
tpcds_q69/duckdb:parquet 25723937 / 25794512 / -0.3% 33874012 / 33964184 / -0.3% 0.76 / 0.76 / -0.0%
tpcds_q70/duckdb:parquet 18988439 / 19255869 / -1.4% 27225496 / 26582665 / +2.4% 0.70 / 0.72 / -3.7%
tpcds_q71/duckdb:parquet 16675336 / 16803522 / -0.8% 23708829 / 23382022 / +1.4% 0.70 / 0.72 / -2.1%
tpcds_q72/duckdb:parquet 52932906 / 53014220 / -0.2% 59494301 / 59449489 / +0.1% 0.89 / 0.89 / -0.2%
tpcds_q73/duckdb:parquet 15949043 / 15895421 / +0.3% 21285808 / 21585777 / -1.4% 0.75 / 0.74 / +1.8%
tpcds_q74/duckdb:parquet 84135884 / 85004257 / -1.0% 91307454 / 89575448 / +1.9% 0.92 / 0.95 / -2.9%
tpcds_q75/duckdb:parquet 44491587 / 44183878 / +0.7% 50209786 / 49282250 / +1.9% 0.89 / 0.90 / -1.2%
tpcds_q76/duckdb:parquet 19204888 / 18510097 / +3.8% 23556596 / 22802776 / +3.3% 0.82 / 0.81 / +0.4%
tpcds_q77/duckdb:parquet 26586931 / 25530442 / +4.1% 31501684 / 31441226 / +0.2% 0.84 / 0.81 / +3.9%
tpcds_q78/duckdb:parquet 77900936 / 78229121 / -0.4% 85527903 / 85641462 / -0.1% 0.91 / 0.91 / -0.3%
tpcds_q79/duckdb:parquet 22665875 / 24067906 / -5.8% 28635474 / 28358044 / +1.0% 0.79 / 0.85 / -6.7%
tpcds_q80/duckdb:parquet 38120386 / 38479893 / -0.9% 44106652 / 43843592 / +0.6% 0.86 / 0.88 / -1.5%
tpcds_q81/duckdb:parquet 36043390 / 36125748 / -0.2% 44396785 / 44907713 / -1.1% 0.81 / 0.80 / +0.9%
tpcds_q82/duckdb:parquet 13515432 / 13496682 / +0.1% 20561795 / 20103202 / +2.3% 0.66 / 0.67 / -2.1%
tpcds_q83/duckdb:parquet 20063680 / 19941274 / +0.6% 24962875 / 24813592 / +0.6% 0.80 / 0.80 / +0.0%
tpcds_q84/duckdb:parquet 22975360 / 23090262 / -0.5% 28657080 / 28462809 / +0.7% 0.80 / 0.81 / -1.2%
tpcds_q85/duckdb:parquet 32432097 / 32217004 / +0.7% 39629402 / 38985194 / +1.7% 0.82 / 0.83 / -1.0%
tpcds_q86/duckdb:parquet 11615430 / 11811458 / -1.7% 16977714 / 16496302 / +2.9% 0.68 / 0.72 / -4.4%
tpcds_q87/duckdb:parquet 30840483 / 31436775 / -1.9% 35489897 / 35185024 / +0.9% 0.87 / 0.89 / -2.7%
tpcds_q88/duckdb:parquet 37980482 / 38059442 / -0.2% 43671525 / 41928306 / +4.2% 0.87 / 0.91 / -4.2%
tpcds_q89/duckdb:parquet 14099588 / 14206404 / -0.8% 21095449 / 21172421 / -0.4% 0.67 / 0.67 / -0.4%
tpcds_q90/duckdb:parquet 9944214 / 10080660 / -1.4% 14736905 / 15448563 / -4.6% 0.67 / 0.65 / +3.4%
tpcds_q91/duckdb:parquet 20909961 / 21048574 / -0.7% 28270687 / 28220317 / +0.2% 0.74 / 0.75 / -0.8%
tpcds_q92/duckdb:parquet 15585636 / 15572126 / +0.1% 22058585 / 22096515 / -0.2% 0.71 / 0.70 / +0.3%
tpcds_q93/duckdb:parquet 13995278 / 14091483 / -0.7% 20285267 / 20175447 / +0.5% 0.69 / 0.70 / -1.2%
tpcds_q94/duckdb:parquet 25301649 / 25392360 / -0.4% 32957299 / 32388339 / +1.8% 0.77 / 0.78 / -2.1%
tpcds_q95/duckdb:parquet 43695309 / 43748374 / -0.1% 49263916 / 49895274 / -1.3% 0.89 / 0.88 / +1.2%
tpcds_q96/duckdb:parquet 8160498 / 8272491 / -1.4% 13495538 / 13988491 / -3.5% 0.60 / 0.59 / +2.2%
tpcds_q97/duckdb:parquet 27308418 / 27667050 / -1.3% 32690454 / 32852985 / -0.5% 0.84 / 0.84 / -0.8%
tpcds_q98/duckdb:parquet 16501350 / 16378365 / +0.8% 23388194 / 22777602 / +2.7% 0.71 / 0.72 / -1.9%
tpcds_q99/duckdb:parquet 18750508 / 18807829 / -0.3% 24730983 / 24915617 / -0.7% 0.76 / 0.75 / +0.4%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 2bc5703c vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.962x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15782441 / 15688950 / +0.6% 41486412 / 42044683 / -1.3% 0.38 / 0.37 / +1.9%
tpch_q02/datafusion:vortex-file-compressed 17610355 / 17642963 / -0.2% 36102505 / 38300817 / -5.7% 0.49 / 0.46 / +5.9%
tpch_q03/datafusion:vortex-file-compressed 19108589 / 19065844 / +0.2% 43721892 / 48397388 / -9.7% 0.44 / 0.39 / +10.9%
tpch_q04/datafusion:vortex-file-compressed 10495996 / 11164861 / -6.0% 31374717 / 35072742 / -10.5% 🟢 0.33 / 0.32 / +5.1%
tpch_q05/datafusion:vortex-file-compressed 37823247 / 37464731 / +1.0% 67326103 / 67783021 / -0.7% 0.56 / 0.55 / +1.6%
tpch_q06/datafusion:vortex-file-compressed 4454569 / 4339682 / +2.6% 25395088 / 24863986 / +2.1% 0.18 / 0.17 / +0.5%
tpch_q07/datafusion:vortex-file-compressed 52912633 / 52692511 / +0.4% 80330394 / 85054942 / -5.6% 0.66 / 0.62 / +6.3%
tpch_q08/datafusion:vortex-file-compressed 51336871 / 52605829 / -2.4% 81805896 / 84709539 / -3.4% 0.63 / 0.62 / +1.1%
tpch_q09/datafusion:vortex-file-compressed 49944519 / 48498381 / +3.0% 81824745 / 84507228 / -3.2% 0.61 / 0.57 / +6.4%
tpch_q10/datafusion:vortex-file-compressed 18185814 / 17830636 / +2.0% 48981353 / 50418361 / -2.9% 0.37 / 0.35 / +5.0%
tpch_q11/datafusion:vortex-file-compressed 14627269 / 14797088 / -1.1% 32883599 / 34636066 / -5.1% 0.44 / 0.43 / +4.1%
tpch_q12/datafusion:vortex-file-compressed 18486766 / 18367682 / +0.6% 42669750 / 44324157 / -3.7% 0.43 / 0.41 / +4.6%
tpch_q13/datafusion:vortex-file-compressed 19232380 / 19445378 / -1.1% 38893226 / 43547559 / -10.7% 🟢 0.49 / 0.45 / +10.7%
tpch_q14/datafusion:vortex-file-compressed 14507383 / 14501344 / +0.0% 38237242 / 38502171 / -0.7% 0.38 / 0.38 / +0.7%
tpch_q15/datafusion:vortex-file-compressed 18381663 / 18611040 / -1.2% 43378503 / 47147954 / -8.0% 0.42 / 0.39 / +7.4%
tpch_q16/datafusion:vortex-file-compressed 18320464 / 18720655 / -2.1% 37624161 / 39847079 / -5.6% 0.49 / 0.47 / +3.6%
tpch_q17/datafusion:vortex-file-compressed 28939659 / 28917794 / +0.1% 58291200 / 58954760 / -1.1% 0.50 / 0.49 / +1.2%
tpch_q18/datafusion:vortex-file-compressed 36622561 / 36473671 / +0.4% 60655262 / 59803246 / +1.4% 0.60 / 0.61 / -1.0%
tpch_q19/datafusion:vortex-file-compressed 9494807 / 9988295 / -4.9% 35941566 / 36396214 / -1.2% 0.26 / 0.27 / -3.7%
tpch_q20/datafusion:vortex-file-compressed 20814916 / 21253874 / -2.1% 46298630 / 52124094 / -11.2% 🟢 0.45 / 0.41 / +10.3%
tpch_q21/datafusion:vortex-file-compressed 34825367 / 35502918 / -1.9% 64272065 / 66036777 / -2.7% 0.54 / 0.54 / +0.8%
tpch_q22/datafusion:vortex-file-compressed 10929557 / 10854425 / +0.7% 29246637 / 31535557 / -7.3% 0.37 / 0.34 / +8.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71345511 / 71385078 / -0.1% 86849501 / 87261585 / -0.5% 0.82 / 0.82 / +0.4%
tpch_q02/datafusion:parquet 76621124 / 76624116 / -0.0% 89959202 / 91913452 / -2.1% 0.85 / 0.83 / +2.2%
tpch_q03/datafusion:parquet 81511190 / 82108255 / -0.7% 101420248 / 104243587 / -2.7% 0.80 / 0.79 / +2.0%
tpch_q04/datafusion:parquet 38958769 / 39117802 / -0.4% 56508662 / 58381793 / -3.2% 0.69 / 0.67 / +2.9%
tpch_q05/datafusion:parquet 110536765 / 110097915 / +0.4% 134231852 / 137152327 / -2.1% 0.82 / 0.80 / +2.6%
tpch_q06/datafusion:parquet 31231320 / 31364851 / -0.4% 46377878 / 46559945 / -0.4% 0.67 / 0.67 / -0.0%
tpch_q07/datafusion:parquet 112593481 / 113603354 / -0.9% 136183350 / 139063930 / -2.1% 0.83 / 0.82 / +1.2%
tpch_q08/datafusion:parquet 117261915 / 118351864 / -0.9% 142578320 / 143663582 / -0.8% 0.82 / 0.82 / -0.2%
tpch_q09/datafusion:parquet 138315180 / 137262432 / +0.8% 163777964 / 166772416 / -1.8% 0.84 / 0.82 / +2.6%
tpch_q10/datafusion:parquet 103326834 / 103456749 / -0.1% 125334291 / 126729504 / -1.1% 0.82 / 0.82 / +1.0%
tpch_q11/datafusion:parquet 61435942 / 62363006 / -1.5% 78769595 / 82069278 / -4.0% 0.78 / 0.76 / +2.6%
tpch_q12/datafusion:parquet 63295105 / 63533745 / -0.4% 83045572 / 85351184 / -2.7% 0.76 / 0.74 / +2.4%
tpch_q13/datafusion:parquet 143270428 / 142477870 / +0.6% 161522469 / 161849930 / -0.2% 0.89 / 0.88 / +0.8%
tpch_q14/datafusion:parquet 47512247 / 47624060 / -0.2% 68701761 / 68804881 / -0.1% 0.69 / 0.69 / -0.1%
tpch_q15/datafusion:parquet 73227826 / 74880432 / -2.2% 90609510 / 92266259 / -1.8% 0.81 / 0.81 / -0.4%
tpch_q16/datafusion:parquet 43604119 / 43181694 / +1.0% 60686440 / 59549382 / +1.9% 0.72 / 0.73 / -0.9%
tpch_q17/datafusion:parquet 122998981 / 123682757 / -0.6% 142120714 / 147020505 / -3.3% 0.87 / 0.84 / +2.9%
tpch_q18/datafusion:parquet 121029684 / 121104227 / -0.1% 140719624 / 142447395 / -1.2% 0.86 / 0.85 / +1.2%
tpch_q19/datafusion:parquet 56336073 / 57774413 / -2.5% 78776054 / 82236501 / -4.2% 0.72 / 0.70 / +1.8%
tpch_q20/datafusion:parquet 78494064 / 78510463 / -0.0% 101310433 / 101516128 / -0.2% 0.77 / 0.77 / +0.2%
tpch_q21/datafusion:parquet 112632885 / 113088915 / -0.4% 137640062 / 139363438 / -1.2% 0.82 / 0.81 / +0.8%
tpch_q22/datafusion:parquet 52203076 / 51831048 / +0.7% 65683553 / 67131696 / -2.2% 0.79 / 0.77 / +2.9%
duckdb / vortex-file-compressed / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9451915 / 9046497 / +4.5% 18406629 / 20027987 / -8.1% 0.51 / 0.45 / +13.7%
tpch_q02/duckdb:vortex-file-compressed 15056401 / 15124900 / -0.5% 25108190 / 25341316 / -0.9% 0.60 / 0.60 / +0.5%
tpch_q03/duckdb:vortex-file-compressed 18583830 / 18447734 / +0.7% 33966997 / 34750008 / -2.3% 0.55 / 0.53 / +3.1%
tpch_q04/duckdb:vortex-file-compressed 12143396 / 12448707 / -2.5% 24732597 / 26846587 / -7.9% 0.49 / 0.46 / +5.9%
tpch_q05/duckdb:vortex-file-compressed 20282603 / 20254666 / +0.1% 36824635 / 35776065 / +2.9% 0.55 / 0.57 / -2.7%
tpch_q06/duckdb:vortex-file-compressed 4469017 / 4488820 / -0.4% 14749995 / 15022696 / -1.8% 0.30 / 0.30 / +1.4%
tpch_q07/duckdb:vortex-file-compressed 23996978 / 23909987 / +0.4% 37762157 / 41780280 / -9.6% 0.64 / 0.57 / +11.0%
tpch_q08/duckdb:vortex-file-compressed 20899071 / 20744171 / +0.7% 35876010 / 37318055 / -3.9% 0.58 / 0.56 / +4.8%
tpch_q09/duckdb:vortex-file-compressed 21200664 / 23055861 / -8.0% 37310136 / 38487753 / -3.1% 0.57 / 0.60 / -5.1%
tpch_q10/duckdb:vortex-file-compressed 26909451 / 26815462 / +0.4% 43282780 / 45530635 / -4.9% 0.62 / 0.59 / +5.6%
tpch_q11/duckdb:vortex-file-compressed 7893914 / 7968318 / -0.9% 16693423 / 18104165 / -7.8% 0.47 / 0.44 / +7.4%
tpch_q12/duckdb:vortex-file-compressed 14381880 / 14764927 / -2.6% 26262785 / 27095283 / -3.1% 0.55 / 0.54 / +0.5%
tpch_q13/duckdb:vortex-file-compressed 19730249 / 19378947 / +1.8% 32125541 / 31743144 / +1.2% 0.61 / 0.61 / +0.6%
tpch_q14/duckdb:vortex-file-compressed 11288817 / 11181264 / +1.0% 25369940 / 25354587 / +0.1% 0.44 / 0.44 / +0.9%
tpch_q15/duckdb:vortex-file-compressed 8403564 / 8381204 / +0.3% 19245144 / 20995174 / -8.3% 0.44 / 0.40 / +9.4%
tpch_q16/duckdb:vortex-file-compressed 16506135 / 16413233 / +0.6% 23332753 / 23979720 / -2.7% 0.71 / 0.68 / +3.4%
tpch_q17/duckdb:vortex-file-compressed 12508008 / 12592677 / -0.7% 30715319 / 28445363 / +8.0% 0.41 / 0.44 / -8.0%
tpch_q18/duckdb:vortex-file-compressed 24213482 / 24316808 / -0.4% 34462879 / 34951044 / -1.4% 0.70 / 0.70 / +1.0%
tpch_q19/duckdb:vortex-file-compressed 10270688 / 11426195 / -10.1% 🟢 23597062 / 25766839 / -8.4% 0.44 / 0.44 / -1.8%
tpch_q20/duckdb:vortex-file-compressed 14144645 / 14325643 / -1.3% 29972782 / 30552986 / -1.9% 0.47 / 0.47 / +0.6%
tpch_q21/duckdb:vortex-file-compressed 48139621 / 48281048 / -0.3% 64748354 / 66017908 / -1.9% 0.74 / 0.73 / +1.7%
tpch_q22/duckdb:vortex-file-compressed 16778548 / 16702790 / +0.5% 26271380 / 26800262 / -2.0% 0.64 / 0.62 / +2.5%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47515950 / 47547581 / -0.1% 53231227 / 54112740 / -1.6% 0.89 / 0.88 / +1.6%
tpch_q02/duckdb:parquet 48228186 / 48312217 / -0.2% 55471834 / 55151190 / +0.6% 0.87 / 0.88 / -0.8%
tpch_q03/duckdb:parquet 60134611 / 60217500 / -0.1% 67415725 / 69288935 / -2.7% 0.89 / 0.87 / +2.6%
tpch_q04/duckdb:parquet 34766083 / 34656547 / +0.3% 42126619 / 43053263 / -2.2% 0.83 / 0.80 / +2.5%
tpch_q05/duckdb:parquet 67090000 / 67091722 / -0.0% 76896755 / 77316587 / -0.5% 0.87 / 0.87 / +0.5%
tpch_q06/duckdb:parquet 21473356 / 21601570 / -0.6% 27084166 / 27249425 / -0.6% 0.79 / 0.79 / +0.0%
tpch_q07/duckdb:parquet 63578794 / 63799205 / -0.3% 72683167 / 72405251 / +0.4% 0.87 / 0.88 / -0.7%
tpch_q08/duckdb:parquet 75523421 / 75667269 / -0.2% 85841637 / 86769393 / -1.1% 0.88 / 0.87 / +0.9%
tpch_q09/duckdb:parquet 106906066 / 107847179 / -0.9% 117931886 / 118570948 / -0.5% 0.91 / 0.91 / -0.3%
tpch_q10/duckdb:parquet 106181233 / 105720936 / +0.4% 116700194 / 117200993 / -0.4% 0.91 / 0.90 / +0.9%
tpch_q11/duckdb:parquet 29572354 / 29439572 / +0.5% 35188665 / 34922812 / +0.8% 0.84 / 0.84 / -0.3%
tpch_q12/duckdb:parquet 37160132 / 37121505 / +0.1% 43549692 / 43764563 / -0.5% 0.85 / 0.85 / +0.6%
tpch_q13/duckdb:parquet 174322814 / 174812670 / -0.3% 181702997 / 184970583 / -1.8% 0.96 / 0.95 / +1.5%
tpch_q14/duckdb:parquet 42261037 / 42356235 / -0.2% 50427241 / 51063051 / -1.2% 0.84 / 0.83 / +1.0%
tpch_q15/duckdb:parquet 32584893 / 32503990 / +0.2% 40856896 / 41334737 / -1.2% 0.80 / 0.79 / +1.4%
tpch_q16/duckdb:parquet 47477293 / 47147798 / +0.7% 53211242 / 52668299 / +1.0% 0.89 / 0.90 / -0.3%
tpch_q17/duckdb:parquet 47834131 / 47964459 / -0.3% 57078675 / 56795941 / +0.5% 0.84 / 0.84 / -0.8%
tpch_q18/duckdb:parquet 74433176 / 73982405 / +0.6% 81061315 / 80482798 / +0.7% 0.92 / 0.92 / -0.1%
tpch_q19/duckdb:parquet 49026365 / 49071842 / -0.1% 57267947 / 55601512 / +3.0% 0.86 / 0.88 / -3.0%
tpch_q20/duckdb:parquet 63256407 / 63412118 / -0.2% 72732192 / 73364368 / -0.9% 0.87 / 0.86 / +0.6%
tpch_q21/duckdb:parquet 106448263 / 106560704 / -0.1% 117099614 / 116038695 / +0.9% 0.91 / 0.92 / -1.0%
tpch_q22/duckdb:parquet 50515410 / 50470913 / +0.1% 58476239 / 59155611 / -1.1% 0.86 / 0.85 / +1.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 2bc5703c vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35661474 / 35836658 / -0.5% 61549780 / 59839649 / +2.9% 0.58 / 0.60 / -3.3%
tpcds_q02/datafusion:vortex-file-compressed 50775435 / 51540980 / -1.5% 74831213 / 75356430 / -0.7% 0.68 / 0.68 / -0.8%
tpcds_q03/datafusion:vortex-file-compressed 20467738 / 20246396 / +1.1% 47419164 / 46166223 / +2.7% 0.43 / 0.44 / -1.6%
tpcds_q04/datafusion:vortex-file-compressed 293462232 / 293432920 / +0.0% 352985111 / 354050198 / -0.3% 0.83 / 0.83 / +0.3%
tpcds_q05/datafusion:vortex-file-compressed 72651660 / 71656747 / +1.4% 97076058 / 107692212 / -9.9% 0.75 / 0.67 / +12.5%
tpcds_q06/datafusion:vortex-file-compressed 42165308 / 42258217 / -0.2% 73303201 / 70535607 / +3.9% 0.58 / 0.60 / -4.0%
tpcds_q07/datafusion:vortex-file-compressed 42294800 / 42156216 / +0.3% 79003639 / 80613054 / -2.0% 0.54 / 0.52 / +2.4%
tpcds_q08/datafusion:vortex-file-compressed 28328576 / 28614063 / -1.0% 55871456 / 57730721 / -3.2% 0.51 / 0.50 / +2.3%
tpcds_q09/datafusion:vortex-file-compressed 44101718 / 44012164 / +0.2% 78120636 / 77101674 / +1.3% 0.56 / 0.57 / -1.1%
tpcds_q10/datafusion:vortex-file-compressed 36260486 / 37189576 / -2.5% 65206306 / 63021635 / +3.5% 0.56 / 0.59 / -5.8%
tpcds_q11/datafusion:vortex-file-compressed 174692210 / 174495550 / +0.1% 218493337 / 221987691 / -1.6% 0.80 / 0.79 / +1.7%
tpcds_q12/datafusion:vortex-file-compressed 17629280 / 17549844 / +0.5% 36026715 / 38571171 / -6.6% 0.49 / 0.45 / +7.5%
tpcds_q13/datafusion:vortex-file-compressed 39585120 / 38899632 / +1.8% 84516716 / 85520203 / -1.2% 0.47 / 0.45 / +3.0%
tpcds_q14/datafusion:vortex-file-compressed 229920342 / 231725092 / -0.8% 273201814 / 271215982 / +0.7% 0.84 / 0.85 / -1.5%
tpcds_q15/datafusion:vortex-file-compressed 39971152 / 40095029 / -0.3% 61062085 / 54164984 / +12.7% 🔴 0.65 / 0.74 / -11.6%
tpcds_q16/datafusion:vortex-file-compressed 23006781 / 22869641 / +0.6% 42284783 / 42034772 / +0.6% 0.54 / 0.54 / +0.0%
tpcds_q17/datafusion:vortex-file-compressed 63323428 / 64808376 / -2.3% 90748216 / 89558176 / +1.3% 0.70 / 0.72 / -3.6%
tpcds_q18/datafusion:vortex-file-compressed 69907554 / 69097730 / +1.2% 98235141 / 94787906 / +3.6% 0.71 / 0.73 / -2.4%
tpcds_q19/datafusion:vortex-file-compressed 22727506 / 22408799 / +1.4% 53454821 / 55496169 / -3.7% 0.43 / 0.40 / +5.3%
tpcds_q20/datafusion:vortex-file-compressed 24020658 / 23702741 / +1.3% 40315829 / 40220803 / +0.2% 0.60 / 0.59 / +1.1%
tpcds_q21/datafusion:vortex-file-compressed 48551986 / 47542674 / +2.1% 63424030 / 64058585 / -1.0% 0.77 / 0.74 / +3.1%
tpcds_q22/datafusion:vortex-file-compressed 438786150 / 431366016 / +1.7% 455706831 / 465284097 / -2.1% 0.96 / 0.93 / +3.9%
tpcds_q23/datafusion:vortex-file-compressed 301454449 / 299587271 / +0.6% 354136926 / 351318540 / +0.8% 0.85 / 0.85 / -0.2%
tpcds_q24/datafusion:vortex-file-compressed 118163726 / 120023524 / -1.5% 163556296 / 159982078 / +2.2% 0.72 / 0.75 / -3.7%
tpcds_q25/datafusion:vortex-file-compressed 62676451 / 63311010 / -1.0% 104351816 / 102454935 / +1.9% 0.60 / 0.62 / -2.8%
tpcds_q26/datafusion:vortex-file-compressed 37378854 / 37429288 / -0.1% 59585767 / 59331611 / +0.4% 0.63 / 0.63 / -0.6%
tpcds_q27/datafusion:vortex-file-compressed 73603312 / 72377160 / +1.7% 105494700 / 104225546 / +1.2% 0.70 / 0.69 / +0.5%
tpcds_q28/datafusion:vortex-file-compressed 42318832 / 42296916 / +0.1% 87713998 / 82755038 / +6.0% 0.48 / 0.51 / -5.6%
tpcds_q29/datafusion:vortex-file-compressed 66820296 / 61922299 / +7.9% 105709952 / 97201813 / +8.8% 0.63 / 0.64 / -0.8%
tpcds_q30/datafusion:vortex-file-compressed 52355362 / 51311054 / +2.0% 76744025 / 79114003 / -3.0% 0.68 / 0.65 / +5.2%
tpcds_q31/datafusion:vortex-file-compressed 200108427 / 196557266 / +1.8% 234180427 / 235875877 / -0.7% 0.85 / 0.83 / +2.5%
tpcds_q32/datafusion:vortex-file-compressed 15306000 / 15236954 / +0.5% 31285933 / 31554300 / -0.9% 0.49 / 0.48 / +1.3%
tpcds_q33/datafusion:vortex-file-compressed 32675663 / 33321710 / -1.9% 69868591 / 67027574 / +4.2% 0.47 / 0.50 / -5.9%
tpcds_q34/datafusion:vortex-file-compressed 40907310 / 41148345 / -0.6% 68013542 / 68234625 / -0.3% 0.60 / 0.60 / -0.3%
tpcds_q35/datafusion:vortex-file-compressed 93822802 / 92443260 / +1.5% 122642274 / 120652799 / +1.6% 0.77 / 0.77 / -0.2%
tpcds_q36/datafusion:vortex-file-compressed 68149947 / 65946206 / +3.3% 100942447 / 100250170 / +0.7% 0.68 / 0.66 / +2.6%
tpcds_q37/datafusion:vortex-file-compressed 22955230 / 23553139 / -2.5% 42264452 / 43598667 / -3.1% 0.54 / 0.54 / +0.5%
tpcds_q38/datafusion:vortex-file-compressed 79663866 / 76507711 / +4.1% 113483247 / 106221269 / +6.8% 0.70 / 0.72 / -2.5%
tpcds_q39/datafusion:vortex-file-compressed 884919318 / 887680404 / -0.3% 910678472 / 906829393 / +0.4% 0.97 / 0.98 / -0.7%
tpcds_q40/datafusion:vortex-file-compressed 28483386 / 28735451 / -0.9% 47879397 / 47789817 / +0.2% 0.59 / 0.60 / -1.1%
tpcds_q41/datafusion:vortex-file-compressed 20458693 / 19056672 / +7.4% 31710048 / 30560191 / +3.8% 0.65 / 0.62 / +3.5%
tpcds_q42/datafusion:vortex-file-compressed 13706092 / 14306364 / -4.2% 38469499 / 39330916 / -2.2% 0.36 / 0.36 / -2.1%
tpcds_q43/datafusion:vortex-file-compressed 17255382 / 17123520 / +0.8% 42144603 / 40887604 / +3.1% 0.41 / 0.42 / -2.2%
tpcds_q44/datafusion:vortex-file-compressed 42772650 / 42841783 / -0.2% 76451203 / 73034215 / +4.7% 0.56 / 0.59 / -4.6%
tpcds_q45/datafusion:vortex-file-compressed 43851029 / 42716522 / +2.7% 68532016 / 64325351 / +6.5% 0.64 / 0.66 / -3.6%
tpcds_q46/datafusion:vortex-file-compressed 70683978 / 70770951 / -0.1% 101995941 / 103002911 / -1.0% 0.69 / 0.69 / +0.9%
tpcds_q47/datafusion:vortex-file-compressed 173880278 / 176930862 / -1.7% 222112814 / 217533458 / +2.1% 0.78 / 0.81 / -3.8%
tpcds_q48/datafusion:vortex-file-compressed 36043679 / 35477019 / +1.6% 70189980 / 70167195 / +0.0% 0.51 / 0.51 / +1.6%
tpcds_q49/datafusion:vortex-file-compressed 78697292 / 79901468 / -1.5% 121909305 / 120233831 / +1.4% 0.65 / 0.66 / -2.9%
tpcds_q50/datafusion:vortex-file-compressed 55809128 / 56310110 / -0.9% 86346272 / 89046429 / -3.0% 0.65 / 0.63 / +2.2%
tpcds_q51/datafusion:vortex-file-compressed 245589814 / 241461239 / +1.7% 280329117 / 280306123 / +0.0% 0.88 / 0.86 / +1.7%
tpcds_q52/datafusion:vortex-file-compressed 14223236 / 14942948 / -4.8% 42141645 / 41146983 / +2.4% 0.34 / 0.36 / -7.1%
tpcds_q53/datafusion:vortex-file-compressed 23726467 / 23025893 / +3.0% 49992767 / 52394142 / -4.6% 0.47 / 0.44 / +8.0%
tpcds_q54/datafusion:vortex-file-compressed 59854339 / 59630808 / +0.4% 91776745 / 92798502 / -1.1% 0.65 / 0.64 / +1.5%
tpcds_q55/datafusion:vortex-file-compressed 14773696 / 15209610 / -2.9% 38404352 / 39200802 / -2.0% 0.38 / 0.39 / -0.9%
tpcds_q56/datafusion:vortex-file-compressed 33294172 / 34211642 / -2.7% 63627755 / 63579406 / +0.1% 0.52 / 0.54 / -2.8%
tpcds_q57/datafusion:vortex-file-compressed 131566790 / 130827096 / +0.6% 161256931 / 162474233 / -0.7% 0.82 / 0.81 / +1.3%
tpcds_q58/datafusion:vortex-file-compressed 48360515 / 49071762 / -1.4% 87166267 / 84738612 / +2.9% 0.55 / 0.58 / -4.2%
tpcds_q59/datafusion:vortex-file-compressed 56102426 / 54936949 / +2.1% 81030160 / 85696270 / -5.4% 0.69 / 0.64 / +8.0%
tpcds_q60/datafusion:vortex-file-compressed 35148905 / 34485962 / +1.9% 66594566 / 66114270 / +0.7% 0.53 / 0.52 / +1.2%
tpcds_q61/datafusion:vortex-file-compressed 46246456 / 45202724 / +2.3% 71092319 / 70916447 / +0.2% 0.65 / 0.64 / +2.1%
tpcds_q62/datafusion:vortex-file-compressed 19727218 / 19841460 / -0.6% 41292430 / 43084349 / -4.2% 0.48 / 0.46 / +3.7%
tpcds_q63/datafusion:vortex-file-compressed 23059352 / 22619521 / +1.9% 50163093 / 49716174 / +0.9% 0.46 / 0.45 / +1.0%
tpcds_q64/datafusion:vortex-file-compressed 334479852 / 332776120 / +0.5% 416956722 / 399340320 / +4.4% 0.80 / 0.83 / -3.7%
tpcds_q65/datafusion:vortex-file-compressed 74050638 / 73751860 / +0.4% 110302212 / 110569158 / -0.2% 0.67 / 0.67 / +0.6%
tpcds_q66/datafusion:vortex-file-compressed 52725063 / 52486634 / +0.5% 77693835 / 77837826 / -0.2% 0.68 / 0.67 / +0.6%
tpcds_q67/datafusion:vortex-file-compressed 422601577 / 420503111 / +0.5% 515812893 / 528828691 / -2.5% 0.82 / 0.80 / +3.0%
tpcds_q68/datafusion:vortex-file-compressed 68472514 / 66831493 / +2.5% 103349946 / 99391180 / +4.0% 0.66 / 0.67 / -1.5%
tpcds_q69/datafusion:vortex-file-compressed 35688681 / 36278824 / -1.6% 63080130 / 63625322 / -0.9% 0.57 / 0.57 / -0.8%
tpcds_q70/datafusion:vortex-file-compressed 196125402 / 194497137 / +0.8% 229249913 / 232217411 / -1.3% 0.86 / 0.84 / +2.1%
tpcds_q71/datafusion:vortex-file-compressed 25481112 / 25424784 / +0.2% 57882121 / 61267492 / -5.5% 0.44 / 0.41 / +6.1%
tpcds_q72/datafusion:vortex-file-compressed 1571468232 / 1575229677 / -0.2% 1739968246 / 1696144047 / +2.6% 0.90 / 0.93 / -2.8%
tpcds_q73/datafusion:vortex-file-compressed 38018849 / 38589712 / -1.5% 65876925 / 62969996 / +4.6% 0.58 / 0.61 / -5.8%
tpcds_q74/datafusion:vortex-file-compressed 133604428 / 134601274 / -0.7% 169552349 / 173765353 / -2.4% 0.79 / 0.77 / +1.7%
tpcds_q75/datafusion:vortex-file-compressed 156714410 / 155633299 / +0.7% 204643426 / 198511793 / +3.1% 0.77 / 0.78 / -2.3%
tpcds_q76/datafusion:vortex-file-compressed 34300280 / 34722660 / -1.2% 72479993 / 73189101 / -1.0% 0.47 / 0.47 / -0.2%
tpcds_q77/datafusion:vortex-file-compressed 54928436 / 54175824 / +1.4% 88721179 / 87493805 / +1.4% 0.62 / 0.62 / -0.0%
tpcds_q78/datafusion:vortex-file-compressed 140921593 / 140889933 / +0.0% 192891054 / 191779256 / +0.6% 0.73 / 0.73 / -0.6%
tpcds_q79/datafusion:vortex-file-compressed 53505266 / 53408896 / +0.2% 84853743 / 83137730 / +2.1% 0.63 / 0.64 / -1.8%
tpcds_q80/datafusion:vortex-file-compressed 80763826 / 80795658 / -0.0% 125661026 / 127799771 / -1.7% 0.64 / 0.63 / +1.7%
tpcds_q81/datafusion:vortex-file-compressed 56351132 / 55975548 / +0.7% 83018122 / 83846761 / -1.0% 0.68 / 0.67 / +1.7%
tpcds_q82/datafusion:vortex-file-compressed 30457542 / 30549740 / -0.3% 58284445 / 48106493 / +21.2% 🔴 0.52 / 0.64 / -17.7%
tpcds_q83/datafusion:vortex-file-compressed 42312018 / 42358020 / -0.1% 66102633 / 65597866 / +0.8% 0.64 / 0.65 / -0.9%
tpcds_q84/datafusion:vortex-file-compressed 12854560 / 12799204 / +0.4% 31521189 / 30970538 / +1.8% 0.41 / 0.41 / -1.3%
tpcds_q85/datafusion:vortex-file-compressed 59879941 / 60660052 / -1.3% 90758851 / 90654953 / +0.1% 0.66 / 0.67 / -1.4%
tpcds_q86/datafusion:vortex-file-compressed 18503238 / 18272155 / +1.3% 39177792 / 40425570 / -3.1% 0.47 / 0.45 / +4.5%
tpcds_q87/datafusion:vortex-file-compressed 78550765 / 79615489 / -1.3% 109422498 / 107689679 / +1.6% 0.72 / 0.74 / -2.9%
tpcds_q88/datafusion:vortex-file-compressed 53231466 / 56206700 / -5.3% 91800373 / 93094539 / -1.4% 0.58 / 0.60 / -4.0%
tpcds_q89/datafusion:vortex-file-compressed 27714448 / 26931306 / +2.9% 55764031 / 56072635 / -0.6% 0.50 / 0.48 / +3.5%
tpcds_q90/datafusion:vortex-file-compressed 13103506 / 12758200 / +2.7% 31538645 / 34107490 / -7.5% 0.42 / 0.37 / +11.1%
tpcds_q91/datafusion:vortex-file-compressed 19368770 / 19519254 / -0.8% 43986658 / 42141655 / +4.4% 0.44 / 0.46 / -4.9%
tpcds_q92/datafusion:vortex-file-compressed 15043696 / 15245025 / -1.3% 36513148 / 33922326 / +7.6% 0.41 / 0.45 / -8.3%
tpcds_q93/datafusion:vortex-file-compressed 54758410 / 54842766 / -0.2% 97031152 / 88696680 / +9.4% 0.56 / 0.62 / -8.7%
tpcds_q94/datafusion:vortex-file-compressed 21693347 / 21620928 / +0.3% 47476220 / 46231785 / +2.7% 0.46 / 0.47 / -2.3%
tpcds_q95/datafusion:vortex-file-compressed 95385124 / 95000299 / +0.4% 127434989 / 123858370 / +2.9% 0.75 / 0.77 / -2.4%
tpcds_q96/datafusion:vortex-file-compressed 11486814 / 11533278 / -0.4% 31500011 / 31102793 / +1.3% 0.36 / 0.37 / -1.7%
tpcds_q97/datafusion:vortex-file-compressed 40201976 / 39467840 / +1.9% 66690811 / 66425488 / +0.4% 0.60 / 0.59 / +1.5%
tpcds_q98/datafusion:vortex-file-compressed 20958490 / 20665282 / +1.4% 46281199 / 48509099 / -4.6% 0.45 / 0.43 / +6.3%
tpcds_q99/datafusion:vortex-file-compressed 29804241 / 29545800 / +0.9% 49643373 / 48862458 / +1.6% 0.60 / 0.60 / -0.7%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59666007 / 59408052 / +0.4% 79613249 / 82373568 / -3.4% 0.75 / 0.72 / +3.9%
tpcds_q02/datafusion:parquet 68579014 / 69761366 / -1.7% 92457794 / 90812813 / +1.8% 0.74 / 0.77 / -3.4%
tpcds_q03/datafusion:parquet 28684431 / 28478768 / +0.7% 51267903 / 49334251 / +3.9% 0.56 / 0.58 / -3.1%
tpcds_q04/datafusion:parquet 640322338 / 642610250 / -0.4% 711663849 / 708231753 / +0.5% 0.90 / 0.91 / -0.8%
tpcds_q05/datafusion:parquet 82933292 / 81388832 / +1.9% 117320492 / 113800720 / +3.1% 0.71 / 0.72 / -1.2%
tpcds_q06/datafusion:parquet 88868162 / 90852955 / -2.2% 114129294 / 115952402 / -1.6% 0.78 / 0.78 / -0.6%
tpcds_q07/datafusion:parquet 102983213 / 101418282 / +1.5% 132450113 / 133695330 / -0.9% 0.78 / 0.76 / +2.5%
tpcds_q08/datafusion:parquet 48815311 / 48684130 / +0.3% 74503124 / 74133519 / +0.5% 0.66 / 0.66 / -0.2%
tpcds_q09/datafusion:parquet 76523489 / 75160834 / +1.8% 104717148 / 102849415 / +1.8% 0.73 / 0.73 / -0.0%
tpcds_q10/datafusion:parquet 59844926 / 60416750 / -0.9% 84670920 / 84947233 / -0.3% 0.71 / 0.71 / -0.6%
tpcds_q11/datafusion:parquet 410827051 / 412444870 / -0.4% 456602339 / 461294550 / -1.0% 0.90 / 0.89 / +0.6%
tpcds_q12/datafusion:parquet 39551814 / 39871562 / -0.8% 57973564 / 57128529 / +1.5% 0.68 / 0.70 / -2.2%
tpcds_q13/datafusion:parquet 85345964 / 84637846 / +0.8% 130193661 / 130466094 / -0.2% 0.66 / 0.65 / +1.0%
tpcds_q14/datafusion:parquet 394367550 / 378360104 / +4.2% 415691985 / 433388374 / -4.1% 0.95 / 0.87 / +8.7%
tpcds_q15/datafusion:parquet 52321190 / 51502606 / +1.6% 71596114 / 72303263 / -1.0% 0.73 / 0.71 / +2.6%
tpcds_q16/datafusion:parquet 44701426 / 45710882 / -2.2% 64133525 / 63650471 / +0.8% 0.70 / 0.72 / -2.9%
tpcds_q17/datafusion:parquet 136666384 / 138067928 / -1.0% 169765549 / 172187136 / -1.4% 0.81 / 0.80 / +0.4%
tpcds_q18/datafusion:parquet 108496228 / 110369917 / -1.7% 143166936 / 144952536 / -1.2% 0.76 / 0.76 / -0.5%
tpcds_q19/datafusion:parquet 47888580 / 48384048 / -1.0% 77045977 / 75539146 / +2.0% 0.62 / 0.64 / -3.0%
tpcds_q20/datafusion:parquet 41802392 / 41512735 / +0.7% 54423319 / 55090816 / -1.2% 0.77 / 0.75 / +1.9%
tpcds_q21/datafusion:parquet 60896354 / 61141701 / -0.4% 73380680 / 73095747 / +0.4% 0.83 / 0.84 / -0.8%
tpcds_q22/datafusion:parquet 463609406 / 464195324 / -0.1% 479961758 / 478139930 / +0.4% 0.97 / 0.97 / -0.5%
tpcds_q23/datafusion:parquet 367005261 / 357626356 / +2.6% 407267463 / 417833459 / -2.5% 0.90 / 0.86 / +5.3%
tpcds_q24/datafusion:parquet 240705743 / 241331307 / -0.3% 276439659 / 278266611 / -0.7% 0.87 / 0.87 / +0.4%
tpcds_q25/datafusion:parquet 145204550 / 146902811 / -1.2% 186441810 / 196039200 / -4.9% 0.78 / 0.75 / +3.9%
tpcds_q26/datafusion:parquet 54726840 / 53821080 / +1.7% 78606000 / 80565923 / -2.4% 0.70 / 0.67 / +4.2%
tpcds_q27/datafusion:parquet 205754760 / 210089836 / -2.1% 247934490 / 235911774 / +5.1% 0.83 / 0.89 / -6.8%
tpcds_q28/datafusion:parquet 87264392 / 86784142 / +0.6% 117901137 / 119280232 / -1.2% 0.74 / 0.73 / +1.7%
tpcds_q29/datafusion:parquet 143208598 / 145820741 / -1.8% 183740464 / 175411233 / +4.7% 0.78 / 0.83 / -6.2%
tpcds_q30/datafusion:parquet 98175722 / 99608501 / -1.4% 120919089 / 120071149 / +0.7% 0.81 / 0.83 / -2.1%
tpcds_q31/datafusion:parquet 315728324 / 319058792 / -1.0% 345044860 / 344041143 / +0.3% 0.92 / 0.93 / -1.3%
tpcds_q32/datafusion:parquet 29595146 / 29399552 / +0.7% 44184573 / 43643939 / +1.2% 0.67 / 0.67 / -0.6%
tpcds_q33/datafusion:parquet 54943434 / 51971680 / +5.7% 80737556 / 76538194 / +5.5% 0.68 / 0.68 / +0.2%
tpcds_q34/datafusion:parquet 63297478 / 65511648 / -3.4% 86339299 / 85276600 / +1.2% 0.73 / 0.77 / -4.6%
tpcds_q35/datafusion:parquet 125829528 / 126922984 / -0.9% 157624079 / 150646646 / +4.6% 0.80 / 0.84 / -5.3%
tpcds_q36/datafusion:parquet 99033166 / 97863638 / +1.2% 125147673 / 126419427 / -1.0% 0.79 / 0.77 / +2.2%
tpcds_q37/datafusion:parquet 50602600 / 50046237 / +1.1% 64061544 / 65033749 / -1.5% 0.79 / 0.77 / +2.6%
tpcds_q38/datafusion:parquet 121914488 / 122147195 / -0.2% 147196367 / 145034869 / +1.5% 0.83 / 0.84 / -1.7%
tpcds_q39/datafusion:parquet 848350836 / 846526498 / +0.2% 871943684 / 859437879 / +1.5% 0.97 / 0.98 / -1.2%
tpcds_q40/datafusion:parquet 35370578 / 35936465 / -1.6% 54901477 / 54650564 / +0.5% 0.64 / 0.66 / -2.0%
tpcds_q41/datafusion:parquet 32021590 / 31200319 / +2.6% 42983575 / 42657926 / +0.8% 0.74 / 0.73 / +1.9%
tpcds_q42/datafusion:parquet 25718532 / 25952126 / -0.9% 48221913 / 43716014 / +10.3% 🔴 0.53 / 0.59 / -10.2%
tpcds_q43/datafusion:parquet 26765927 / 27372783 / -2.2% 50535765 / 46844617 / +7.9% 0.53 / 0.58 / -9.4%
tpcds_q44/datafusion:parquet 64033818 / 65006033 / -1.5% 87286500 / 87803178 / -0.6% 0.73 / 0.74 / -0.9%
tpcds_q45/datafusion:parquet 65218685 / 66536274 / -2.0% 87812677 / 87212845 / +0.7% 0.74 / 0.76 / -2.6%
tpcds_q46/datafusion:parquet 107072830 / 106805720 / +0.3% 151265284 / 153607976 / -1.5% 0.71 / 0.70 / +1.8%
tpcds_q47/datafusion:parquet 237937256 / 237808994 / +0.1% 274191159 / 273252482 / +0.3% 0.87 / 0.87 / -0.3%
tpcds_q48/datafusion:parquet 77686604 / 76955857 / +0.9% 104712333 / 105870247 / -1.1% 0.74 / 0.73 / +2.1%
tpcds_q49/datafusion:parquet 117196739 / 118898020 / -1.4% 153496641 / 170084458 / -9.8% 0.76 / 0.70 / +9.2%
tpcds_q50/datafusion:parquet 91254044 / 92705258 / -1.6% 119341445 / 120435148 / -0.9% 0.76 / 0.77 / -0.7%
tpcds_q51/datafusion:parquet 254933373 / 254091982 / +0.3% 286259483 / 289211985 / -1.0% 0.89 / 0.88 / +1.4%
tpcds_q52/datafusion:parquet 26277030 / 26889958 / -2.3% 46713499 / 45469536 / +2.7% 0.56 / 0.59 / -4.9%
tpcds_q53/datafusion:parquet 36956524 / 36382336 / +1.6% 58817988 / 57842390 / +1.7% 0.63 / 0.63 / -0.1%
tpcds_q54/datafusion:parquet 85018318 / 85254806 / -0.3% 111163746 / 109551589 / +1.5% 0.76 / 0.78 / -1.7%
tpcds_q55/datafusion:parquet 26634754 / 26510566 / +0.5% 46531540 / 46645823 / -0.2% 0.57 / 0.57 / +0.7%
tpcds_q56/datafusion:parquet 52989494 / 54094848 / -2.0% 74174363 / 77335323 / -4.1% 0.71 / 0.70 / +2.1%
tpcds_q57/datafusion:parquet 169224185 / 171894920 / -1.6% 192072921 / 193978047 / -1.0% 0.88 / 0.89 / -0.6%
tpcds_q58/datafusion:parquet 96403680 / 98465482 / -2.1% 126080239 / 125032548 / +0.8% 0.76 / 0.79 / -2.9%
tpcds_q59/datafusion:parquet 104232210 / 103659830 / +0.6% 129988960 / 130225505 / -0.2% 0.80 / 0.80 / +0.7%
tpcds_q60/datafusion:parquet 56411432 / 55741260 / +1.2% 77084113 / 78220449 / -1.5% 0.73 / 0.71 / +2.7%
tpcds_q61/datafusion:parquet 74719710 / 78001000 / -4.2% 101472980 / 106432779 / -4.7% 0.74 / 0.73 / +0.5%
tpcds_q62/datafusion:parquet 27304824 / 27762318 / -1.6% 44280802 / 44527940 / -0.6% 0.62 / 0.62 / -1.1%
tpcds_q63/datafusion:parquet 36285374 / 36196190 / +0.2% 58043571 / 58834211 / -1.3% 0.63 / 0.62 / +1.6%
tpcds_q64/datafusion:parquet 663799084 / 659557758 / +0.6% 735681627 / 742173662 / -0.9% 0.90 / 0.89 / +1.5%
tpcds_q65/datafusion:parquet 103163250 / 100715906 / +2.4% 135036176 / 133981634 / +0.8% 0.76 / 0.75 / +1.6%
tpcds_q66/datafusion:parquet 76652602 / 76575936 / +0.1% 101745640 / 104374000 / -2.5% 0.75 / 0.73 / +2.7%
tpcds_q67/datafusion:parquet 431854224 / 430912350 / +0.2% 501438470 / 500297658 / +0.2% 0.86 / 0.86 / -0.0%
tpcds_q68/datafusion:parquet 110807309 / 108700552 / +1.9% 154405572 / 156742031 / -1.5% 0.72 / 0.69 / +3.5%
tpcds_q69/datafusion:parquet 58878615 / 61003348 / -3.5% 78469205 / 84325988 / -6.9% 0.75 / 0.72 / +3.7%
tpcds_q70/datafusion:parquet 211007056 / 212975306 / -0.9% 241435021 / 246017700 / -1.9% 0.87 / 0.87 / +1.0%
tpcds_q71/datafusion:parquet 38616208 / 39083124 / -1.2% 63015963 / 64662143 / -2.5% 0.61 / 0.60 / +1.4%
tpcds_q72/datafusion:parquet 1802450322 / 1794732356 / +0.4% 1943054931 / 1806078341 / +7.6% 0.93 / 0.99 / -6.6%
tpcds_q73/datafusion:parquet 62287346 / 62856255 / -0.9% 86206271 / 84855052 / +1.6% 0.72 / 0.74 / -2.5%
tpcds_q74/datafusion:parquet 293136426 / 292768250 / +0.1% 326163459 / 331483495 / -1.6% 0.90 / 0.88 / +1.8%
tpcds_q75/datafusion:parquet 194815282 / 193794623 / +0.5% 235542986 / 239131737 / -1.5% 0.83 / 0.81 / +2.1%
tpcds_q76/datafusion:parquet 49712086 / 49958244 / -0.5% 82586793 / 78897199 / +4.7% 0.60 / 0.63 / -4.9%
tpcds_q77/datafusion:parquet 71887480 / 73280301 / -1.9% 103900116 / 98096657 / +5.9% 0.69 / 0.75 / -7.4%
tpcds_q78/datafusion:parquet 207032380 / 211119866 / -1.9% 279955140 / 273491694 / +2.4% 0.74 / 0.77 / -4.2%
tpcds_q79/datafusion:parquet 76695795 / 77375078 / -0.9% 119172117 / 112413871 / +6.0% 0.64 / 0.69 / -6.5%
tpcds_q80/datafusion:parquet 142284152 / 143104068 / -0.6% 194131257 / 191975662 / +1.1% 0.73 / 0.75 / -1.7%
tpcds_q81/datafusion:parquet 108352088 / 106756472 / +1.5% 127114339 / 129378123 / -1.7% 0.85 / 0.83 / +3.3%
tpcds_q82/datafusion:parquet 54574568 / 53582485 / +1.9% 71768152 / 70410662 / +1.9% 0.76 / 0.76 / -0.1%
tpcds_q83/datafusion:parquet 66861231 / 66630048 / +0.3% 81699081 / 85136032 / -4.0% 0.82 / 0.78 / +4.6%
tpcds_q84/datafusion:parquet 35667820 / 36220898 / -1.5% 51203452 / 49805351 / +2.8% 0.70 / 0.73 / -4.2%
tpcds_q85/datafusion:parquet 106528886 / 103848480 / +2.6% 132728936 / 129149354 / +2.8% 0.80 / 0.80 / -0.2%
tpcds_q86/datafusion:parquet 21925772 / 22112695 / -0.8% 40502040 / 39672664 / +2.1% 0.54 / 0.56 / -2.9%
tpcds_q87/datafusion:parquet 120482120 / 122470358 / -1.6% 142387933 / 148224625 / -3.9% 0.85 / 0.83 / +2.4%
tpcds_q88/datafusion:parquet 85216932 / 86047137 / -1.0% 109035326 / 108358632 / +0.6% 0.78 / 0.79 / -1.6%
tpcds_q89/datafusion:parquet 39512096 / 38401756 / +2.9% 62901078 / 64923770 / -3.1% 0.63 / 0.59 / +6.2%
tpcds_q90/datafusion:parquet 17646766 / 18100802 / -2.5% 35113528 / 32273520 / +8.8% 0.50 / 0.56 / -10.4%
tpcds_q91/datafusion:parquet 43020458 / 41738000 / +3.1% 60307234 / 57454843 / +5.0% 0.71 / 0.73 / -1.8%
tpcds_q92/datafusion:parquet 29178668 / 28604120 / +2.0% 45038419 / 47460689 / -5.1% 0.65 / 0.60 / +7.5%
tpcds_q93/datafusion:parquet 63559934 / 63722030 / -0.3% 94216406 / 87405909 / +7.8% 0.67 / 0.73 / -7.5%
tpcds_q94/datafusion:parquet 39865736 / 37847109 / +5.3% 57768286 / 58549059 / -1.3% 0.69 / 0.65 / +6.8%
tpcds_q95/datafusion:parquet 126095122 / 128012922 / -1.5% 151074043 / 149910916 / +0.8% 0.83 / 0.85 / -2.3%
tpcds_q96/datafusion:parquet 21982382 / 20691258 / +6.2% 37154842 / 36951345 / +0.6% 0.59 / 0.56 / +5.7%
tpcds_q97/datafusion:parquet 54214526 / 54645566 / -0.8% 78297591 / 80351616 / -2.6% 0.69 / 0.68 / +1.8%
tpcds_q98/datafusion:parquet 61128439 / 61965680 / -1.4% 86639573 / 83775704 / +3.4% 0.71 / 0.74 / -4.6%
tpcds_q99/datafusion:parquet 42460438 / 42461627 / -0.0% 58299797 / 57802802 / +0.9% 0.73 / 0.73 / -0.9%
duckdb / vortex-file-compressed / ns (0.998x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32900626 / 32726779 / +0.5% 46227431 / 45377689 / +1.9% 0.71 / 0.72 / -1.3%
tpcds_q02/duckdb:vortex-file-compressed 30344756 / 30267290 / +0.3% 41892227 / 44087004 / -5.0% 0.72 / 0.69 / +5.5%
tpcds_q03/duckdb:vortex-file-compressed 13728726 / 13779130 / -0.4% 30016386 / 30718899 / -2.3% 0.46 / 0.45 / +2.0%
tpcds_q04/duckdb:vortex-file-compressed 128655568 / 130206338 / -1.2% 158261147 / 157201556 / +0.7% 0.81 / 0.83 / -1.9%
tpcds_q05/duckdb:vortex-file-compressed 55836788 / 53727511 / +3.9% 81983378 / 83478676 / -1.8% 0.68 / 0.64 / +5.8%
tpcds_q06/duckdb:vortex-file-compressed 58746168 / 58800986 / -0.1% 79427716 / 79094008 / +0.4% 0.74 / 0.74 / -0.5%
tpcds_q07/duckdb:vortex-file-compressed 30861034 / 31168844 / -1.0% 53261490 / 54099517 / -1.5% 0.58 / 0.58 / +0.6%
tpcds_q08/duckdb:vortex-file-compressed 31205109 / 31134683 / +0.2% 41526219 / 41772800 / -0.6% 0.75 / 0.75 / +0.8%
tpcds_q09/duckdb:vortex-file-compressed 57908117 / 55235330 / +4.8% 79068548 / 79107779 / -0.0% 0.73 / 0.70 / +4.9%
tpcds_q10/duckdb:vortex-file-compressed 39240530 / 39038430 / +0.5% 57916004 / 58236826 / -0.6% 0.68 / 0.67 / +1.1%
tpcds_q11/duckdb:vortex-file-compressed 95564450 / 96226126 / -0.7% 113127614 / 112266994 / +0.8% 0.84 / 0.86 / -1.4%
tpcds_q12/duckdb:vortex-file-compressed 16948128 / 17276975 / -1.9% 29826881 / 30254952 / -1.4% 0.57 / 0.57 / -0.5%
tpcds_q13/duckdb:vortex-file-compressed 36879272 / 38940578 / -5.3% 74288910 / 71103229 / +4.5% 0.50 / 0.55 / -9.4%
tpcds_q14/duckdb:vortex-file-compressed 122223084 / 119983268 / +1.9% 141798198 / 140641737 / +0.8% 0.86 / 0.85 / +1.0%
tpcds_q15/duckdb:vortex-file-compressed 61041208 / 60759281 / +0.5% 70400647 / 76171754 / -7.6% 0.87 / 0.80 / +8.7%
tpcds_q16/duckdb:vortex-file-compressed 35103122 / 34771337 / +1.0% 53441700 / 53890958 / -0.8% 0.66 / 0.65 / +1.8%
tpcds_q17/duckdb:vortex-file-compressed 56530224 / 57289182 / -1.3% 82009122 / 81955246 / +0.1% 0.69 / 0.70 / -1.4%
tpcds_q18/duckdb:vortex-file-compressed 82716669 / 82993345 / -0.3% 102385882 / 104424434 / -2.0% 0.81 / 0.79 / +1.7%
tpcds_q19/duckdb:vortex-file-compressed 44691712 / 43899722 / +1.8% 63141401 / 65276395 / -3.3% 0.71 / 0.67 / +5.2%
tpcds_q20/duckdb:vortex-file-compressed 21929644 / 21520304 / +1.9% 35183702 / 34931964 / +0.7% 0.62 / 0.62 / +1.2%
tpcds_q21/duckdb:vortex-file-compressed 28130109 / 28120830 / +0.0% 65096292 / 62004166 / +5.0% 0.43 / 0.45 / -4.7%
tpcds_q22/duckdb:vortex-file-compressed 164752839 / 165099230 / -0.2% 172130845 / 170541662 / +0.9% 0.96 / 0.97 / -1.1%
tpcds_q23/duckdb:vortex-file-compressed 179886295 / 185876490 / -3.2% 199459274 / 199673618 / -0.1% 0.90 / 0.93 / -3.1%
tpcds_q24/duckdb:vortex-file-compressed 51950094 / 52636914 / -1.3% 76345104 / 77254623 / -1.2% 0.68 / 0.68 / -0.1%
tpcds_q25/duckdb:vortex-file-compressed 53368414 / 53220034 / +0.3% 77567792 / 75302591 / +3.0% 0.69 / 0.71 / -2.6%
tpcds_q26/duckdb:vortex-file-compressed 26404804 / 26713063 / -1.2% 42605682 / 42934826 / -0.8% 0.62 / 0.62 / -0.4%
tpcds_q27/duckdb:vortex-file-compressed 31520566 / 32585874 / -3.3% 53308240 / 53424233 / -0.2% 0.59 / 0.61 / -3.1%
tpcds_q28/duckdb:vortex-file-compressed 40888458 / 41342696 / -1.1% 63548492 / 66089322 / -3.8% 0.64 / 0.63 / +2.9%
tpcds_q29/duckdb:vortex-file-compressed 51753840 / 51866994 / -0.2% 76061207 / 74066949 / +2.7% 0.68 / 0.70 / -2.8%
tpcds_q30/duckdb:vortex-file-compressed 38153005 / 37914817 / +0.6% 50935682 / 52960815 / -3.8% 0.75 / 0.72 / +4.6%
tpcds_q31/duckdb:vortex-file-compressed 37560532 / 37512062 / +0.1% 52749834 / 53392186 / -1.2% 0.71 / 0.70 / +1.3%
tpcds_q32/duckdb:vortex-file-compressed 14041044 / 13855892 / +1.3% 28568407 / 28855272 / -1.0% 0.49 / 0.48 / +2.4%
tpcds_q33/duckdb:vortex-file-compressed 34497892 / 33813963 / +2.0% 57645655 / 59046480 / -2.4% 0.60 / 0.57 / +4.5%
tpcds_q34/duckdb:vortex-file-compressed 22606625 / 22811725 / -0.9% 39215172 / 39776812 / -1.4% 0.58 / 0.57 / +0.5%
tpcds_q35/duckdb:vortex-file-compressed 67480833 / 66786588 / +1.0% 88846900 / 85242000 / +4.2% 0.76 / 0.78 / -3.1%
tpcds_q36/duckdb:vortex-file-compressed 28401172 / 29806828 / -4.7% 49509448 / 49308472 / +0.4% 0.57 / 0.60 / -5.1%
tpcds_q37/duckdb:vortex-file-compressed 25455016 / 25605208 / -0.6% 72224622 / 74457214 / -3.0% 0.35 / 0.34 / +2.5%
tpcds_q38/duckdb:vortex-file-compressed 61280638 / 62408870 / -1.8% 80082434 / 81156842 / -1.3% 0.77 / 0.77 / -0.5%
tpcds_q39/duckdb:vortex-file-compressed 55012602 / 56168904 / -2.1% 85812917 / 85127364 / +0.8% 0.64 / 0.66 / -2.8%
tpcds_q40/duckdb:vortex-file-compressed 18693730 / 19238372 / -2.8% 34570375 / 35099919 / -1.5% 0.54 / 0.55 / -1.3%
tpcds_q41/duckdb:vortex-file-compressed 16675979 / 18720698 / -10.9% 🟢 23175233 / 25500417 / -9.1% 0.72 / 0.73 / -2.0%
tpcds_q42/duckdb:vortex-file-compressed 14270121 / 14015144 / +1.8% 31595544 / 30966847 / +2.0% 0.45 / 0.45 / -0.2%
tpcds_q43/duckdb:vortex-file-compressed 19662954 / 19403602 / +1.3% 32167732 / 32011378 / +0.5% 0.61 / 0.61 / +0.8%
tpcds_q44/duckdb:vortex-file-compressed 29038633 / 28307018 / +2.6% 49283433 / 51668551 / -4.6% 0.59 / 0.55 / +7.5%
tpcds_q45/duckdb:vortex-file-compressed 46115626 / 46586273 / -1.0% 59554872 / 60370446 / -1.4% 0.77 / 0.77 / +0.3%
tpcds_q46/duckdb:vortex-file-compressed 50900775 / 51192653 / -0.6% 75821732 / 75043524 / +1.0% 0.67 / 0.68 / -1.6%
tpcds_q47/duckdb:vortex-file-compressed 80853338 / 80927444 / -0.1% 94887615 / 97094785 / -2.3% 0.85 / 0.83 / +2.2%
tpcds_q48/duckdb:vortex-file-compressed 52940584 / 53155386 / -0.4% 80763266 / 81823473 / -1.3% 0.66 / 0.65 / +0.9%
tpcds_q49/duckdb:vortex-file-compressed 39264951 / 37950044 / +3.5% 80845541 / 78847393 / +2.5% 0.49 / 0.48 / +0.9%
tpcds_q50/duckdb:vortex-file-compressed 32374814 / 32675461 / -0.9% 56111714 / 57051911 / -1.6% 0.58 / 0.57 / +0.7%
tpcds_q51/duckdb:vortex-file-compressed 203213721 / 204779876 / -0.8% 221390615 / 217736852 / +1.7% 0.92 / 0.94 / -2.4%
tpcds_q52/duckdb:vortex-file-compressed 14919183 / 15384257 / -3.0% 31100695 / 31876748 / -2.4% 0.48 / 0.48 / -0.6%
tpcds_q53/duckdb:vortex-file-compressed 22028815 / 22960290 / -4.1% 39321398 / 39000657 / +0.8% 0.56 / 0.59 / -4.8%
tpcds_q54/duckdb:vortex-file-compressed 43716124 / 44886930 / -2.6% 66171246 / 65481173 / +1.1% 0.66 / 0.69 / -3.6%
tpcds_q55/duckdb:vortex-file-compressed 14872424 / 14612501 / +1.8% 33246064 / 30570651 / +8.8% 0.45 / 0.48 / -6.4%
tpcds_q56/duckdb:vortex-file-compressed 32421105 / 32462078 / -0.1% 57347429 / 57717193 / -0.6% 0.57 / 0.56 / +0.5%
tpcds_q57/duckdb:vortex-file-compressed 64382409 / 64171452 / +0.3% 77932727 / 78496038 / -0.7% 0.83 / 0.82 / +1.1%
tpcds_q58/duckdb:vortex-file-compressed 37719852 / 37835588 / -0.3% 60168359 / 64016051 / -6.0% 0.63 / 0.59 / +6.1%
tpcds_q59/duckdb:vortex-file-compressed 52276958 / 53810956 / -2.9% 63327750 / 71107629 / -10.9% 🟢 0.83 / 0.76 / +9.1%
tpcds_q60/duckdb:vortex-file-compressed 34818768 / 35369636 / -1.6% 58404795 / 59793701 / -2.3% 0.60 / 0.59 / +0.8%
tpcds_q61/duckdb:vortex-file-compressed 34192736 / 34298255 / -0.3% 53623148 / 53069753 / +1.0% 0.64 / 0.65 / -1.3%
tpcds_q62/duckdb:vortex-file-compressed 17065550 / 14822514 / +15.1% 🔴 26977785 / 26421769 / +2.1% 0.63 / 0.56 / +12.8%
tpcds_q63/duckdb:vortex-file-compressed 21333714 / 20828409 / +2.4% 37268418 / 38114655 / -2.2% 0.57 / 0.55 / +4.8%
tpcds_q64/duckdb:vortex-file-compressed 118653752 / 118342334 / +0.3% 155006343 / 152181613 / +1.9% 0.77 / 0.78 / -1.6%
tpcds_q65/duckdb:vortex-file-compressed 48648462 / 51466061 / -5.5% 60985871 / 58907342 / +3.5% 0.80 / 0.87 / -8.7%
tpcds_q66/duckdb:vortex-file-compressed 41785570 / 40998564 / +1.9% 57386412 / 58858579 / -2.5% 0.73 / 0.70 / +4.5%
tpcds_q67/duckdb:vortex-file-compressed 275048704 / 277425812 / -0.9% 277066538 / 283678837 / -2.3% 0.99 / 0.98 / +1.5%
tpcds_q68/duckdb:vortex-file-compressed 44690590 / 44593714 / +0.2% 72398183 / 72079771 / +0.4% 0.62 / 0.62 / -0.2%
tpcds_q69/duckdb:vortex-file-compressed 38077317 / 38356528 / -0.7% 62140517 / 59755970 / +4.0% 0.61 / 0.64 / -4.5%
tpcds_q70/duckdb:vortex-file-compressed 25245862 / 25085070 / +0.6% 42563684 / 41516746 / +2.5% 0.59 / 0.60 / -1.8%
tpcds_q71/duckdb:vortex-file-compressed 28735520 / 27715436 / +3.7% 51927246 / 50902781 / +2.0% 0.55 / 0.54 / +1.6%
tpcds_q72/duckdb:vortex-file-compressed 138698211 / 135900823 / +2.1% 160415333 / 164226936 / -2.3% 0.86 / 0.83 / +4.5%
tpcds_q73/duckdb:vortex-file-compressed 20337392 / 20089200 / +1.2% 35398356 / 37315276 / -5.1% 0.57 / 0.54 / +6.7%
tpcds_q74/duckdb:vortex-file-compressed 82938758 / 82722980 / +0.3% 100064667 / 99629718 / +0.4% 0.83 / 0.83 / -0.2%
tpcds_q75/duckdb:vortex-file-compressed 112236347 / 111929736 / +0.3% 136487778 / 139908352 / -2.4% 0.82 / 0.80 / +2.8%
tpcds_q76/duckdb:vortex-file-compressed 27267442 / 27219565 / +0.2% 57406465 / 58492855 / -1.9% 0.47 / 0.47 / +2.1%
tpcds_q77/duckdb:vortex-file-compressed 36048986 / 36316546 / -0.7% 60872521 / 62103115 / -2.0% 0.59 / 0.58 / +1.3%
tpcds_q78/duckdb:vortex-file-compressed 135808066 / 137442428 / -1.2% 159511332 / 159793923 / -0.2% 0.85 / 0.86 / -1.0%
tpcds_q79/duckdb:vortex-file-compressed 37241304 / 37665982 / -1.1% 63833994 / 59874325 / +6.6% 0.58 / 0.63 / -7.3%
tpcds_q80/duckdb:vortex-file-compressed 58885418 / 57541290 / +2.3% 92394216 / 89399248 / +3.4% 0.64 / 0.64 / -1.0%
tpcds_q81/duckdb:vortex-file-compressed 56745396 / 57777750 / -1.8% 69934344 / 71231569 / -1.8% 0.81 / 0.81 / +0.0%
tpcds_q82/duckdb:vortex-file-compressed 26635761 / 26860434 / -0.8% 77678970 / 77804956 / -0.2% 0.34 / 0.35 / -0.7%
tpcds_q83/duckdb:vortex-file-compressed 21584486 / 21694036 / -0.5% 31741842 / 32263861 / -1.6% 0.68 / 0.67 / +1.1%
tpcds_q84/duckdb:vortex-file-compressed 13529070 / 13366814 / +1.2% 24226395 / 23226339 / +4.3% 0.56 / 0.58 / -3.0%
tpcds_q85/duckdb:vortex-file-compressed 35628264 / 36707151 / -2.9% 55765307 / 56348206 / -1.0% 0.64 / 0.65 / -1.9%
tpcds_q86/duckdb:vortex-file-compressed 16695569 / 16411782 / +1.7% 27481073 / 28182293 / -2.5% 0.61 / 0.58 / +4.3%
tpcds_q87/duckdb:vortex-file-compressed 82308161 / 75201770 / +9.4% 88941952 / 87749398 / +1.4% 0.93 / 0.86 / +8.0%
tpcds_q88/duckdb:vortex-file-compressed 38473450 / 37878092 / +1.6% 50334495 / 49979733 / +0.7% 0.76 / 0.76 / +0.9%
tpcds_q89/duckdb:vortex-file-compressed 25115056 / 24974289 / +0.6% 38960379 / 41888285 / -7.0% 0.64 / 0.60 / +8.1%
tpcds_q90/duckdb:vortex-file-compressed 9899880 / 9843474 / +0.6% 22136938 / 20353435 / +8.8% 0.45 / 0.48 / -7.5%
tpcds_q91/duckdb:vortex-file-compressed 19254880 / 19617013 / -1.8% 31230538 / 29081972 / +7.4% 0.62 / 0.67 / -8.6%
tpcds_q92/duckdb:vortex-file-compressed 13479564 / 13643566 / -1.2% 27086777 / 27682975 / -2.2% 0.50 / 0.49 / +1.0%
tpcds_q93/duckdb:vortex-file-compressed 25167218 / 25876894 / -2.7% 53267349 / 52613864 / +1.2% 0.47 / 0.49 / -3.9%
tpcds_q94/duckdb:vortex-file-compressed 32285024 / 32152022 / +0.4% 47230401 / 47204449 / +0.1% 0.68 / 0.68 / +0.4%
tpcds_q95/duckdb:vortex-file-compressed 95717859 / 97513786 / -1.8% 102926315 / 117615692 / -12.5% 🟢 0.93 / 0.83 / +12.2%
tpcds_q96/duckdb:vortex-file-compressed 12211816 / 11752061 / +3.9% 27197029 / 24570663 / +10.7% 🔴 0.45 / 0.48 / -6.1%
tpcds_q97/duckdb:vortex-file-compressed 60921499 / 62178961 / -2.0% 80598419 / 82766588 / -2.6% 0.76 / 0.75 / +0.6%
tpcds_q98/duckdb:vortex-file-compressed 27277563 / 26889542 / +1.4% 43258627 / 43917859 / -1.5% 0.63 / 0.61 / +3.0%
tpcds_q99/duckdb:vortex-file-compressed 23243127 / 26072871 / -10.9% 🟢 34271574 / 35980286 / -4.7% 0.68 / 0.72 / -6.4%
duckdb / parquet / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 42678980 / 43748750 / -2.4% 50394265 / 50433867 / -0.1% 0.85 / 0.87 / -2.4%
tpcds_q02/duckdb:parquet 38271256 / 39630168 / -3.4% 47663867 / 50715675 / -6.0% 0.80 / 0.78 / +2.8%
tpcds_q03/duckdb:parquet 24338024 / 25995732 / -6.4% 36306159 / 36796166 / -1.3% 0.67 / 0.71 / -5.1%
tpcds_q04/duckdb:parquet 204283018 / 203957459 / +0.2% 226838810 / 234181220 / -3.1% 0.90 / 0.87 / +3.4%
tpcds_q05/duckdb:parquet 69126880 / 68357342 / +1.1% 87094755 / 87464497 / -0.4% 0.79 / 0.78 / +1.6%
tpcds_q06/duckdb:parquet 75666608 / 75115975 / +0.7% 84985823 / 89166769 / -4.7% 0.89 / 0.84 / +5.7%
tpcds_q07/duckdb:parquet 61942798 / 62193874 / -0.4% 76208251 / 76707973 / -0.7% 0.81 / 0.81 / +0.2%
tpcds_q08/duckdb:parquet 38977151 / 38663366 / +0.8% 47774286 / 46394278 / +3.0% 0.82 / 0.83 / -2.1%
tpcds_q09/duckdb:parquet 84979437 / 87080988 / -2.4% 96276689 / 101981323 / -5.6% 0.88 / 0.85 / +3.4%
tpcds_q10/duckdb:parquet 52723666 / 52520572 / +0.4% 62749488 / 62695229 / +0.1% 0.84 / 0.84 / +0.3%
tpcds_q11/duckdb:parquet 158919969 / 159415788 / -0.3% 169363866 / 164104249 / +3.2% 0.94 / 0.97 / -3.4%
tpcds_q12/duckdb:parquet 40012892 / 40814548 / -2.0% 47938999 / 48941959 / -2.0% 0.83 / 0.83 / +0.1%
tpcds_q13/duckdb:parquet 68421148 / 69804706 / -2.0% 88371036 / 87793121 / +0.7% 0.77 / 0.80 / -2.6%
tpcds_q14/duckdb:parquet 186528341 / 185753765 / +0.4% 196839380 / 202864595 / -3.0% 0.95 / 0.92 / +3.5%
tpcds_q15/duckdb:parquet 60925389 / 60934452 / -0.0% 68873088 / 69050398 / -0.3% 0.88 / 0.88 / +0.2%
tpcds_q16/duckdb:parquet 38171758 / 37850674 / +0.8% 46102253 / 45839434 / +0.6% 0.83 / 0.83 / +0.3%
tpcds_q17/duckdb:parquet 82706218 / 84076050 / -1.6% 89566839 / 89860905 / -0.3% 0.92 / 0.94 / -1.3%
tpcds_q18/duckdb:parquet 87987629 / 87775860 / +0.2% 97334587 / 98136096 / -0.8% 0.90 / 0.89 / +1.1%
tpcds_q19/duckdb:parquet 47498826 / 47466565 / +0.1% 61395352 / 63007623 / -2.6% 0.77 / 0.75 / +2.7%
tpcds_q20/duckdb:parquet 41356740 / 42342882 / -2.3% 48720482 / 48573403 / +0.3% 0.85 / 0.87 / -2.6%
tpcds_q21/duckdb:parquet 23895476 / 23962194 / -0.3% 28288408 / 28440652 / -0.5% 0.84 / 0.84 / +0.3%
tpcds_q22/duckdb:parquet 162511280 / 166072912 / -2.1% 167254298 / 167098902 / +0.1% 0.97 / 0.99 / -2.2%
tpcds_q23/duckdb:parquet 183918879 / 188036546 / -2.2% 196271215 / 193148517 / +1.6% 0.94 / 0.97 / -3.7%
tpcds_q24/duckdb:parquet 69501722 / 71146241 / -2.3% 83988708 / 82487151 / +1.8% 0.83 / 0.86 / -4.1%
tpcds_q25/duckdb:parquet 50748226 / 51215258 / -0.9% 60542322 / 61288817 / -1.2% 0.84 / 0.84 / +0.3%
tpcds_q26/duckdb:parquet 42608030 / 42361802 / +0.6% 52593853 / 51343370 / +2.4% 0.81 / 0.83 / -1.8%
tpcds_q27/duckdb:parquet 58277090 / 57111037 / +2.0% 74662007 / 81608147 / -8.5% 0.78 / 0.70 / +11.5%
tpcds_q28/duckdb:parquet 92939692 / 93252698 / -0.3% 110968825 / 112178597 / -1.1% 0.84 / 0.83 / +0.8%
tpcds_q29/duckdb:parquet 86173669 / 83041768 / +3.8% 98437907 / 96583021 / +1.9% 0.88 / 0.86 / +1.8%
tpcds_q30/duckdb:parquet 72519034 / 72470468 / +0.1% 82272296 / 81148208 / +1.4% 0.88 / 0.89 / -1.3%
tpcds_q31/duckdb:parquet 98684986 / 98601462 / +0.1% 109571749 / 111465299 / -1.7% 0.90 / 0.88 / +1.8%
tpcds_q32/duckdb:parquet 18244594 / 18353748 / -0.6% 26805361 / 26590155 / +0.8% 0.68 / 0.69 / -1.4%
tpcds_q33/duckdb:parquet 63457216 / 62367010 / +1.7% 76423932 / 73989561 / +3.3% 0.83 / 0.84 / -1.5%
tpcds_q34/duckdb:parquet 32532278 / 33006494 / -1.4% 41079092 / 41889230 / -1.9% 0.79 / 0.79 / +0.5%
tpcds_q35/duckdb:parquet 77848126 / 77399391 / +0.6% 85805034 / 86087567 / -0.3% 0.91 / 0.90 / +0.9%
tpcds_q36/duckdb:parquet 99103506 / 99335950 / -0.2% 112692632 / 112263590 / +0.4% 0.88 / 0.88 / -0.6%
tpcds_q37/duckdb:parquet 41565535 / 41378236 / +0.5% 49320937 / 47554095 / +3.7% 0.84 / 0.87 / -3.1%
tpcds_q38/duckdb:parquet 75565256 / 76468258 / -1.2% 86391193 / 85294747 / +1.3% 0.87 / 0.90 / -2.4%
tpcds_q39/duckdb:parquet 61274787 / 61661639 / -0.6% 67119088 / 67797634 / -1.0% 0.91 / 0.91 / +0.4%
tpcds_q40/duckdb:parquet 27887524 / 27952642 / -0.2% 35320003 / 36118029 / -2.2% 0.79 / 0.77 / +2.0%
tpcds_q41/duckdb:parquet 20626390 / 20143537 / +2.4% 26768271 / 26266476 / +1.9% 0.77 / 0.77 / +0.5%
tpcds_q42/duckdb:parquet 25123986 / 26999602 / -6.9% 36824082 / 36451419 / +1.0% 0.68 / 0.74 / -7.9%
tpcds_q43/duckdb:parquet 26636700 / 28272378 / -5.8% 33507740 / 35793884 / -6.4% 0.79 / 0.79 / +0.6%
tpcds_q44/duckdb:parquet 59595263 / 60736375 / -1.9% 73911802 / 74562633 / -0.9% 0.81 / 0.81 / -1.0%
tpcds_q45/duckdb:parquet 61077218 / 60622120 / +0.8% 69283028 / 67027287 / +3.4% 0.88 / 0.90 / -2.5%
tpcds_q46/duckdb:parquet 72155234 / 72394963 / -0.3% 86738294 / 88023341 / -1.5% 0.83 / 0.82 / +1.1%
tpcds_q47/duckdb:parquet 90166876 / 90830810 / -0.7% 101908740 / 105146923 / -3.1% 0.88 / 0.86 / +2.4%
tpcds_q48/duckdb:parquet 66962850 / 67648746 / -1.0% 80537358 / 85359866 / -5.6% 0.83 / 0.79 / +4.9%
tpcds_q49/duckdb:parquet 69006996 / 67399774 / +2.4% 87522497 / 92020170 / -4.9% 0.79 / 0.73 / +7.6%
tpcds_q50/duckdb:parquet 43489174 / 45228659 / -3.8% 56898330 / 50910629 / +11.8% 🔴 0.76 / 0.89 / -14.0%
tpcds_q51/duckdb:parquet 217203555 / 217340788 / -0.1% 219938197 / 225257376 / -2.4% 0.99 / 0.96 / +2.4%
tpcds_q52/duckdb:parquet 26833517 / 26490668 / +1.3% 39898699 / 37218058 / +7.2% 0.67 / 0.71 / -5.5%
tpcds_q53/duckdb:parquet 34979256 / 34202255 / +2.3% 45048998 / 48232701 / -6.6% 0.78 / 0.71 / +9.5%
tpcds_q54/duckdb:parquet 56089904 / 55357348 / +1.3% 66137581 / 63307482 / +4.5% 0.85 / 0.87 / -3.0%
tpcds_q55/duckdb:parquet 26148774 / 26580602 / -1.6% 36243176 / 38734658 / -6.4% 0.72 / 0.69 / +5.1%
tpcds_q56/duckdb:parquet 68689458 / 68450543 / +0.3% 80890460 / 84208264 / -3.9% 0.85 / 0.81 / +4.5%
tpcds_q57/duckdb:parquet 68529866 / 67905272 / +0.9% 75780359 / 75530496 / +0.3% 0.90 / 0.90 / +0.6%
tpcds_q58/duckdb:parquet 55640921 / 55351262 / +0.5% 65626223 / 67300961 / -2.5% 0.85 / 0.82 / +3.1%
tpcds_q59/duckdb:parquet 61301448 / 61543058 / -0.4% 66012140 / 67498896 / -2.2% 0.93 / 0.91 / +1.9%
tpcds_q60/duckdb:parquet 82868361 / 81154691 / +2.1% 93059675 / 95719978 / -2.8% 0.89 / 0.85 / +5.0%
tpcds_q61/duckdb:parquet 80742664 / 78725636 / +2.6% 91727466 / 94693948 / -3.1% 0.88 / 0.83 / +5.9%
tpcds_q62/duckdb:parquet 19097402 / 21271646 / -10.2% 🟢 26670111 / 24742108 / +7.8% 0.72 / 0.86 / -16.7%
tpcds_q63/duckdb:parquet 32556491 / 33973322 / -4.2% 44298578 / 44293841 / +0.0% 0.73 / 0.77 / -4.2%
tpcds_q64/duckdb:parquet 134031656 / 134987804 / -0.7% 154242439 / 149714203 / +3.0% 0.87 / 0.90 / -3.6%
tpcds_q65/duckdb:parquet 93143112 / 92507762 / +0.7% 93643418 / 106732283 / -12.3% 🟢 0.99 / 0.87 / +14.8%
tpcds_q66/duckdb:parquet 45562641 / 45574203 / -0.0% 52628410 / 52408182 / +0.4% 0.87 / 0.87 / -0.4%
tpcds_q67/duckdb:parquet 292138531 / 294181831 / -0.7% 300266787 / 294225942 / +2.1% 0.97 / 1.00 / -2.7%
tpcds_q68/duckdb:parquet 62008458 / 61610444 / +0.6% 83651735 / 77643526 / +7.7% 0.74 / 0.79 / -6.6%
tpcds_q69/duckdb:parquet 65783850 / 65821270 / -0.1% 76096860 / 75369095 / +1.0% 0.86 / 0.87 / -1.0%
tpcds_q70/duckdb:parquet 42477229 / 42560156 / -0.2% 51773451 / 50824609 / +1.9% 0.82 / 0.84 / -2.0%
tpcds_q71/duckdb:parquet 41099172 / 41353862 / -0.6% 54542971 / 54241063 / +0.6% 0.75 / 0.76 / -1.2%
tpcds_q72/duckdb:parquet 172549868 / 172146606 / +0.2% 189156543 / 189350126 / -0.1% 0.91 / 0.91 / +0.3%
tpcds_q73/duckdb:parquet 27522542 / 27072398 / +1.7% 36073545 / 37030456 / -2.6% 0.76 / 0.73 / +4.4%
tpcds_q74/duckdb:parquet 214104596 / 216089249 / -0.9% 221084893 / 223017657 / -0.9% 0.97 / 0.97 / -0.1%
tpcds_q75/duckdb:parquet 133971952 / 131891024 / +1.6% 151714639 / 152249842 / -0.4% 0.88 / 0.87 / +1.9%
tpcds_q76/duckdb:parquet 50877874 / 51285484 / -0.8% 65207783 / 65205448 / +0.0% 0.78 / 0.79 / -0.8%
tpcds_q77/duckdb:parquet 51247461 / 54841040 / -6.6% 67767444 / 67440836 / +0.5% 0.76 / 0.81 / -7.0%
tpcds_q78/duckdb:parquet 156758276 / 155747874 / +0.6% 171320244 / 168363678 / +1.8% 0.92 / 0.93 / -1.1%
tpcds_q79/duckdb:parquet 52134248 / 51430181 / +1.4% 64357900 / 64568583 / -0.3% 0.81 / 0.80 / +1.7%
tpcds_q80/duckdb:parquet 82707142 / 82941310 / -0.3% 105420381 / 103690804 / +1.7% 0.78 / 0.80 / -1.9%
tpcds_q81/duckdb:parquet 98911086 / 98572923 / +0.3% 105757645 / 104274293 / +1.4% 0.94 / 0.95 / -1.1%
tpcds_q82/duckdb:parquet 46631924 / 46604344 / +0.1% 55245622 / 52315928 / +5.6% 0.84 / 0.89 / -5.2%
tpcds_q83/duckdb:parquet 28019510 / 28152398 / -0.5% 33598322 / 33185714 / +1.2% 0.83 / 0.85 / -1.7%
tpcds_q84/duckdb:parquet 22882934 / 22751552 / +0.6% 29384356 / 29406408 / -0.1% 0.78 / 0.77 / +0.7%
tpcds_q85/duckdb:parquet 51837722 / 52752074 / -1.7% 63491618 / 62960389 / +0.8% 0.82 / 0.84 / -2.6%
tpcds_q86/duckdb:parquet 25800153 / 25146913 / +2.6% 31341871 / 33004413 / -5.0% 0.82 / 0.76 / +8.0%
tpcds_q87/duckdb:parquet 85042014 / 88695797 / -4.1% 98659286 / 92564858 / +6.6% 0.86 / 0.96 / -10.0%
tpcds_q88/duckdb:parquet 104522687 / 106796080 / -2.1% 114719328 / 111229279 / +3.1% 0.91 / 0.96 / -5.1%
tpcds_q89/duckdb:parquet 36605856 / 37846748 / -3.3% 46988237 / 48196620 / -2.5% 0.78 / 0.79 / -0.8%
tpcds_q90/duckdb:parquet 15967149 / 15015242 / +6.3% 19979636 / 20928242 / -4.5% 0.80 / 0.72 / +11.4%
tpcds_q91/duckdb:parquet 25644490 / 25515043 / +0.5% 32940293 / 33274247 / -1.0% 0.78 / 0.77 / +1.5%
tpcds_q92/duckdb:parquet 23578620 / 22329364 / +5.6% 30383748 / 31995562 / -5.0% 0.78 / 0.70 / +11.2%
tpcds_q93/duckdb:parquet 35323825 / 35799040 / -1.3% 50200470 / 49479404 / +1.5% 0.70 / 0.72 / -2.7%
tpcds_q94/duckdb:parquet 39153818 / 38247234 / +2.4% 50102776 / 46965479 / +6.7% 0.78 / 0.81 / -4.0%
tpcds_q95/duckdb:parquet 86961656 / 81409130 / +6.8% 90576317 / 86595751 / +4.6% 0.96 / 0.94 / +2.1%
tpcds_q96/duckdb:parquet 17224469 / 17012262 / +1.2% 24134107 / 24425947 / -1.2% 0.71 / 0.70 / +2.5%
tpcds_q97/duckdb:parquet 72531457 / 73153984 / -0.9% 79547125 / 78153554 / +1.8% 0.91 / 0.94 / -2.6%
tpcds_q98/duckdb:parquet 55183485 / 55289756 / -0.2% 63867439 / 66788134 / -4.4% 0.86 / 0.83 / +4.4%
tpcds_q99/duckdb:parquet 24189896 / 24402862 / -0.9% 32587306 / 30438057 / +7.1% 0.74 / 0.80 / -7.4%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 2bc5703c vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Engines: DataFusion No clear signal (+5.5%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.028x ➖ · cold 0.962x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.970x ➖
Shifts: Parquet (control) +0.0% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.051x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6101208 / 6250168 / -2.4% 20632799 / 19751173 / +4.5% 0.30 / 0.32 / -6.6%
fineweb_q01/datafusion:vortex-file-compressed 8501190 / 9285400 / -8.4% 38371577 / 35575139 / +7.9% 0.22 / 0.26 / -15.1%
fineweb_q02/datafusion:vortex-file-compressed 11177520 / 10567512 / +5.8% 41294072 / 40643432 / +1.6% 0.27 / 0.26 / +4.1%
fineweb_q03/datafusion:vortex-file-compressed 17509388 / 17539240 / -0.2% 96985529 / 102692107 / -5.6% 0.18 / 0.17 / +5.7%
fineweb_q04/datafusion:vortex-file-compressed 66137638 / 64090120 / +3.2% 140323574 / 144508483 / -2.9% 0.47 / 0.44 / +6.3%
fineweb_q05/datafusion:vortex-file-compressed 62892467 / 63203121 / -0.5% 133261565 / 139485427 / -4.5% 0.47 / 0.45 / +4.2%
fineweb_q06/datafusion:vortex-file-compressed 16259554 / 17269226 / -5.8% 102228489 / 106346388 / -3.9% 0.16 / 0.16 / -2.1%
fineweb_q07/datafusion:vortex-file-compressed 19622086 / 16748794 / +17.2% 🔴 98426966 / 103498538 / -4.9% 0.20 / 0.16 / +23.2%
fineweb_q08/datafusion:vortex-file-compressed 12427731 / 8455804 / +47.0% 🔴 26265880 / 26524896 / -1.0% 0.47 / 0.32 / +48.4%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9337610 / 9321344 / +0.2% 33821110 / 32543553 / +3.9% 0.28 / 0.29 / -3.6%
fineweb_q01/datafusion:parquet 76625886 / 75943192 / +0.9% 142608134 / 168115168 / -15.2% 🟢 0.54 / 0.45 / +18.9%
fineweb_q02/datafusion:parquet 74836880 / 75797688 / -1.3% 145219581 / 156430678 / -7.2% 0.52 / 0.48 / +6.4%
fineweb_q03/datafusion:parquet 73442790 / 73828035 / -0.5% 152877069 / 151042261 / +1.2% 0.48 / 0.49 / -1.7%
fineweb_q04/datafusion:parquet 82871828 / 82454360 / +0.5% 144039932 / 161665686 / -10.9% 🟢 0.58 / 0.51 / +12.8%
fineweb_q05/datafusion:parquet 79892590 / 81339953 / -1.8% 140757896 / 155427779 / -9.4% 0.57 / 0.52 / +8.5%
fineweb_q06/datafusion:parquet 76075835 / 76823475 / -1.0% 146213288 / 164720545 / -11.2% 🟢 0.52 / 0.47 / +11.6%
fineweb_q07/datafusion:parquet 74279132 / 73784924 / +0.7% 145637076 / 154776922 / -5.9% 0.51 / 0.48 / +7.0%
fineweb_q08/datafusion:parquet 73103312 / 73667172 / -0.8% 145130660 / 153339658 / -5.4% 0.50 / 0.48 / +4.8%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2035796 / 2129396 / -4.4% 6971781 / 8430467 / -17.3% 🟢 0.29 / 0.25 / +15.6%
fineweb_q01/duckdb:vortex-file-compressed 7687230 / 7609840 / +1.0% 24431333 / 27699884 / -11.8% 🟢 0.31 / 0.27 / +14.5%
fineweb_q02/duckdb:vortex-file-compressed 9214414 / 8999654 / +2.4% 27009927 / 32238453 / -16.2% 🟢 0.34 / 0.28 / +22.2%
fineweb_q03/duckdb:vortex-file-compressed 18112222 / 17999961 / +0.6% 84710928 / 89729159 / -5.6% 0.21 / 0.20 / +6.6%
fineweb_q04/duckdb:vortex-file-compressed 65269048 / 64895256 / +0.6% 102059541 / 105319449 / -3.1% 0.64 / 0.62 / +3.8%
fineweb_q05/duckdb:vortex-file-compressed 64639272 / 64576607 / +0.1% 101310935 / 100642505 / +0.7% 0.64 / 0.64 / -0.6%
fineweb_q06/duckdb:vortex-file-compressed 17319120 / 17451004 / -0.8% 89502718 / 90997772 / -1.6% 0.19 / 0.19 / +0.9%
fineweb_q07/duckdb:vortex-file-compressed 17211584 / 17567882 / -2.0% 86806755 / 90262327 / -3.8% 0.20 / 0.19 / +1.9%
fineweb_q08/duckdb:vortex-file-compressed 4787721 / 4479276 / +6.9% 12953508 / 12680631 / +2.2% 0.37 / 0.35 / +4.6%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23446297 / 23575786 / -0.5% 27556576 / 27901054 / -1.2% 0.85 / 0.84 / +0.7%
fineweb_q01/duckdb:parquet 54622388 / 53435612 / +2.2% 71030304 / 71035947 / -0.0% 0.77 / 0.75 / +2.2%
fineweb_q02/duckdb:parquet 58857796 / 58133262 / +1.2% 72312380 / 71614459 / +1.0% 0.81 / 0.81 / +0.3%
fineweb_q03/duckdb:parquet 120279998 / 119431288 / +0.7% 181586622 / 174813976 / +3.9% 0.66 / 0.68 / -3.0%
fineweb_q04/duckdb:parquet 161498010 / 160054805 / +0.9% 209112536 / 201506963 / +3.8% 0.77 / 0.79 / -2.8%
fineweb_q05/duckdb:parquet 156224787 / 159362006 / -2.0% 199121674 / 199292933 / -0.1% 0.78 / 0.80 / -1.9%
fineweb_q06/duckdb:parquet 88716568 / 88786282 / -0.1% 148919416 / 152544283 / -2.4% 0.60 / 0.58 / +2.4%
fineweb_q07/duckdb:parquet 92287740 / 90890989 / +1.5% 147616060 / 143350764 / +3.0% 0.63 / 0.63 / -1.4%
fineweb_q08/duckdb:parquet 28799986 / 28981936 / -0.6% 30197730 / 30002232 / +0.7% 0.95 / 0.97 / -1.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 2bc5703c vs base b2f8d0f9
Vortex (geomean): hot 1.049x ➖ · cold 0.931x ➖


datafusion / vortex-file-compressed / ns (1.049x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44008740 / 44247398 / -0.5% 84257864 / 86756764 / -2.9% 0.52 / 0.51 / +2.4%
polarsignals_q01/datafusion:vortex-file-compressed 69100878 / 53190033 / +29.9% 🔴 106901260 / 111620562 / -4.2% 0.65 / 0.48 / +35.6%
polarsignals_q02/datafusion:vortex-file-compressed 16687748 / 14308001 / +16.6% 🔴 41466914 / 50938846 / -18.6% 🟢 0.40 / 0.28 / +43.3%
polarsignals_q03/datafusion:vortex-file-compressed 66575082 / 69231543 / -3.8% 110964262 / 116022576 / -4.4% 0.60 / 0.60 / +0.5%
polarsignals_q04/datafusion:vortex-file-compressed 9315260 / 9324230 / -0.1% 38911282 / 43390473 / -10.3% 🟢 0.24 / 0.21 / +11.4%
polarsignals_q05/datafusion:vortex-file-compressed 11844328 / 11645938 / +1.7% 42163299 / 46740242 / -9.8% 0.28 / 0.25 / +12.7%
polarsignals_q06/datafusion:vortex-file-compressed 23110968 / 22759316 / +1.5% 51863807 / 56616878 / -8.4% 0.45 / 0.40 / +10.9%
polarsignals_q07/datafusion:vortex-file-compressed 10682190 / 10826504 / -1.3% 40253660 / 45422058 / -11.4% 🟢 0.27 / 0.24 / +11.3%
polarsignals_q08/datafusion:vortex-file-compressed 110855904 / 96763190 / +14.6% 🔴 173246539 / 161828007 / +7.1% 0.64 / 0.60 / +7.0%
polarsignals_q09/datafusion:vortex-file-compressed 10113316 / 9924556 / +1.9% 38707297 / 41195204 / -6.0% 0.26 / 0.24 / +8.5%
polarsignals_q10/datafusion:vortex-file-compressed 54462338 / 55401320 / -1.7% 110804261 / 116674031 / -5.0% 0.49 / 0.47 / +3.5%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 2bc5703c vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.025x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91812979 / 92177346 / -0.4% 158510270 / 156197099 / +1.5% 0.58 / 0.59 / -1.8%
tpch_q02/datafusion:vortex-file-compressed 64498474 / 64428754 / +0.1% 93736929 / 94872596 / -1.2% 0.69 / 0.68 / +1.3%
tpch_q03/datafusion:vortex-file-compressed 62930574 / 64151894 / -1.9% 125058739 / 126780702 / -1.4% 0.50 / 0.51 / -0.6%
tpch_q04/datafusion:vortex-file-compressed 34344188 / 35028676 / -2.0% 72521331 / 68466710 / +5.9% 0.47 / 0.51 / -7.4%
tpch_q05/datafusion:vortex-file-compressed 117443472 / 118900162 / -1.2% 186208650 / 185439522 / +0.4% 0.63 / 0.64 / -1.6%
tpch_q06/datafusion:vortex-file-compressed 9936473 / 9649196 / +3.0% 58950496 / 57652551 / +2.3% 0.17 / 0.17 / +0.7%
tpch_q07/datafusion:vortex-file-compressed 97722735 / 97449767 / +0.3% 160114085 / 161011516 / -0.6% 0.61 / 0.61 / +0.8%
tpch_q08/datafusion:vortex-file-compressed 141608177 / 142206475 / -0.4% 204542476 / 226695985 / -9.8% 0.69 / 0.63 / +10.4%
tpch_q09/datafusion:vortex-file-compressed 186083272 / 182840408 / +1.8% 265725649 / 275147335 / -3.4% 0.70 / 0.66 / +5.4%
tpch_q10/datafusion:vortex-file-compressed 70075825 / 70621645 / -0.8% 131549938 / 136262721 / -3.5% 0.53 / 0.52 / +2.8%
tpch_q11/datafusion:vortex-file-compressed 45171728 / 45658051 / -1.1% 72119330 / 72364105 / -0.3% 0.63 / 0.63 / -0.7%
tpch_q12/datafusion:vortex-file-compressed 34990151 / 35235879 / -0.7% 79954552 / 79705799 / +0.3% 0.44 / 0.44 / -1.0%
tpch_q13/datafusion:vortex-file-compressed 49346893 / 48598467 / +1.5% 86387213 / 87210304 / -0.9% 0.57 / 0.56 / +2.5%
tpch_q14/datafusion:vortex-file-compressed 20164070 / 20650370 / -2.4% 87308727 / 88048054 / -0.8% 0.23 / 0.23 / -1.5%
tpch_q15/datafusion:vortex-file-compressed 32336816 / 33753614 / -4.2% 89629508 / 90785220 / -1.3% 0.36 / 0.37 / -3.0%
tpch_q16/datafusion:vortex-file-compressed 36583072 / 36919743 / -0.9% 68737477 / 65843812 / +4.4% 0.53 / 0.56 / -5.1%
tpch_q17/datafusion:vortex-file-compressed 177532691 / 176998771 / +0.3% 221262298 / 239755261 / -7.7% 0.80 / 0.74 / +8.7%
tpch_q18/datafusion:vortex-file-compressed 206897301 / 207996354 / -0.5% 278319000 / 275106107 / +1.2% 0.74 / 0.76 / -1.7%
tpch_q19/datafusion:vortex-file-compressed 29007078 / 28526869 / +1.7% 85692631 / 87666580 / -2.3% 0.34 / 0.33 / +4.0%
tpch_q20/datafusion:vortex-file-compressed 61385159 / 61936223 / -0.9% 119368212 / 118852369 / +0.4% 0.51 / 0.52 / -1.3%
tpch_q21/datafusion:vortex-file-compressed 179367608 / 182704046 / -1.8% 239759100 / 234984863 / +2.0% 0.75 / 0.78 / -3.8%
tpch_q22/datafusion:vortex-file-compressed 25349271 / 25513774 / -0.6% 55403718 / 55406439 / -0.0% 0.46 / 0.46 / -0.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87284516 / 87311538 / -0.0% 125080983 / 122516163 / +2.1% 0.70 / 0.71 / -2.1%
tpch_q02/datafusion:parquet 173654864 / 174735537 / -0.6% 199119950 / 198265824 / +0.4% 0.87 / 0.88 / -1.0%
tpch_q03/datafusion:parquet 134859953 / 135233090 / -0.3% 180091117 / 179364012 / +0.4% 0.75 / 0.75 / -0.7%
tpch_q04/datafusion:parquet 56841348 / 56985913 / -0.3% 94661451 / 85885070 / +10.2% 🔴 0.60 / 0.66 / -9.5%
tpch_q05/datafusion:parquet 168123671 / 166291221 / +1.1% 226690763 / 214896169 / +5.5% 0.74 / 0.77 / -4.2%
tpch_q06/datafusion:parquet 36064217 / 36510562 / -1.2% 75029185 / 72908306 / +2.9% 0.48 / 0.50 / -4.0%
tpch_q07/datafusion:parquet 216011060 / 215778947 / +0.1% 262639379 / 260314182 / +0.9% 0.82 / 0.83 / -0.8%
tpch_q08/datafusion:parquet 218011255 / 216791369 / +0.6% 284605510 / 278971702 / +2.0% 0.77 / 0.78 / -1.4%
tpch_q09/datafusion:parquet 309033429 / 307685989 / +0.4% 373985378 / 369588127 / +1.2% 0.83 / 0.83 / -0.7%
tpch_q10/datafusion:parquet 311418130 / 311954014 / -0.2% 364646342 / 359417304 / +1.5% 0.85 / 0.87 / -1.6%
tpch_q11/datafusion:parquet 125886783 / 127035714 / -0.9% 149190660 / 149936598 / -0.5% 0.84 / 0.85 / -0.4%
tpch_q12/datafusion:parquet 81584925 / 82433202 / -1.0% 118182635 / 116835758 / +1.2% 0.69 / 0.71 / -2.2%
tpch_q13/datafusion:parquet 210693343 / 210618688 / +0.0% 240126662 / 238788117 / +0.6% 0.88 / 0.88 / -0.5%
tpch_q14/datafusion:parquet 86317800 / 85602024 / +0.8% 195205914 / 186569859 / +4.6% 0.44 / 0.46 / -3.6%
tpch_q15/datafusion:parquet 105467287 / 106606603 / -1.1% 150577245 / 154598932 / -2.6% 0.70 / 0.69 / +1.6%
tpch_q16/datafusion:parquet 95616971 / 94683007 / +1.0% 121112972 / 123221265 / -1.7% 0.79 / 0.77 / +2.7%
tpch_q17/datafusion:parquet 215016549 / 215630850 / -0.3% 262394615 / 257798988 / +1.8% 0.82 / 0.84 / -2.0%
tpch_q18/datafusion:parquet 268840194 / 267541314 / +0.5% 313292751 / 318452912 / -1.6% 0.86 / 0.84 / +2.1%
tpch_q19/datafusion:parquet 107767629 / 108282497 / -0.5% 165397894 / 164045798 / +0.8% 0.65 / 0.66 / -1.3%
tpch_q20/datafusion:parquet 185024601 / 185298197 / -0.1% 238637030 / 237189433 / +0.6% 0.78 / 0.78 / -0.8%
tpch_q21/datafusion:parquet 241264908 / 244268713 / -1.2% 310548658 / 306493573 / +1.3% 0.78 / 0.80 / -2.5%
tpch_q22/datafusion:parquet 149828841 / 149723897 / +0.1% 175055990 / 171986203 / +1.8% 0.86 / 0.87 / -1.7%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33110388 / 33162813 / -0.2% 70672423 / 60965941 / +15.9% 🔴 0.47 / 0.54 / -13.9%
tpch_q02/duckdb:vortex-file-compressed 28389614 / 28441284 / -0.2% 43000409 / 42490796 / +1.2% 0.66 / 0.67 / -1.4%
tpch_q03/duckdb:vortex-file-compressed 52351827 / 51806352 / +1.1% 105520714 / 96181102 / +9.7% 0.50 / 0.54 / -7.9%
tpch_q04/duckdb:vortex-file-compressed 51358175 / 51520893 / -0.3% 89380253 / 83080389 / +7.6% 0.57 / 0.62 / -7.3%
tpch_q05/duckdb:vortex-file-compressed 69386202 / 68278233 / +1.6% 109860103 / 110549285 / -0.6% 0.63 / 0.62 / +2.3%
tpch_q06/duckdb:vortex-file-compressed 15222383 / 14995905 / +1.5% 55348015 / 49678736 / +11.4% 🔴 0.28 / 0.30 / -8.9%
tpch_q07/duckdb:vortex-file-compressed 54370607 / 55095502 / -1.3% 108627085 / 99927713 / +8.7% 0.50 / 0.55 / -9.2%
tpch_q08/duckdb:vortex-file-compressed 84984397 / 84730600 / +0.3% 130953984 / 128300677 / +2.1% 0.65 / 0.66 / -1.7%
tpch_q09/duckdb:vortex-file-compressed 103012336 / 102680463 / +0.3% 157214306 / 149752209 / +5.0% 0.66 / 0.69 / -4.4%
tpch_q10/duckdb:vortex-file-compressed 96424462 / 95736829 / +0.7% 151483238 / 145772381 / +3.9% 0.64 / 0.66 / -3.1%
tpch_q11/duckdb:vortex-file-compressed 13407587 / 13161487 / +1.9% 29649738 / 28614710 / +3.6% 0.45 / 0.46 / -1.7%
tpch_q12/duckdb:vortex-file-compressed 45589684 / 45171630 / +0.9% 88043725 / 74559415 / +18.1% 🔴 0.52 / 0.61 / -14.5%
tpch_q13/duckdb:vortex-file-compressed 70591603 / 71277113 / -1.0% 99193506 / 98751212 / +0.4% 0.71 / 0.72 / -1.4%
tpch_q14/duckdb:vortex-file-compressed 27980770 / 27742167 / +0.9% 73750756 / 68588058 / +7.5% 0.38 / 0.40 / -6.2%
tpch_q15/duckdb:vortex-file-compressed 24163876 / 24169914 / -0.0% 65434000 / 62760479 / +4.3% 0.37 / 0.39 / -4.1%
tpch_q16/duckdb:vortex-file-compressed 49526108 / 49823920 / -0.6% 58975203 / 58191998 / +1.3% 0.84 / 0.86 / -1.9%
tpch_q17/duckdb:vortex-file-compressed 35515341 / 34928738 / +1.7% 69238207 / 64550565 / +7.3% 0.51 / 0.54 / -5.2%
tpch_q18/duckdb:vortex-file-compressed 104820602 / 102866087 / +1.9% 123731807 / 121696816 / +1.7% 0.85 / 0.85 / +0.2%
tpch_q19/duckdb:vortex-file-compressed 27369137 / 27489534 / -0.4% 83165063 / 76106199 / +9.3% 0.33 / 0.36 / -8.9%
tpch_q20/duckdb:vortex-file-compressed 41945894 / 41385355 / +1.4% 92666434 / 88937430 / +4.2% 0.45 / 0.47 / -2.7%
tpch_q21/duckdb:vortex-file-compressed 92326544 / 92643489 / -0.3% 148700270 / 140692444 / +5.7% 0.62 / 0.66 / -5.7%
tpch_q22/duckdb:vortex-file-compressed 32755392 / 33019958 / -0.8% 49152003 / 47168881 / +4.2% 0.67 / 0.70 / -4.8%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67414033 / 68061708 / -1.0% 88267536 / 88188170 / +0.1% 0.76 / 0.77 / -1.0%
tpch_q02/duckdb:parquet 87012975 / 87254980 / -0.3% 97956253 / 98880371 / -0.9% 0.89 / 0.88 / +0.7%
tpch_q03/duckdb:parquet 109264477 / 110221645 / -0.9% 142338367 / 141238280 / +0.8% 0.77 / 0.78 / -1.6%
tpch_q04/duckdb:parquet 76263650 / 76532636 / -0.4% 98895441 / 97762896 / +1.2% 0.77 / 0.78 / -1.5%
tpch_q05/duckdb:parquet 122673702 / 123479542 / -0.7% 157449872 / 155668079 / +1.1% 0.78 / 0.79 / -1.8%
tpch_q06/duckdb:parquet 35090319 / 35931981 / -2.3% 62842600 / 56977323 / +10.3% 🔴 0.56 / 0.63 / -11.5%
tpch_q07/duckdb:parquet 119460033 / 119339250 / +0.1% 153344963 / 153627189 / -0.2% 0.78 / 0.78 / +0.3%
tpch_q08/duckdb:parquet 148025147 / 147255450 / +0.5% 190569597 / 190628929 / -0.0% 0.78 / 0.77 / +0.6%
tpch_q09/duckdb:parquet 236566894 / 235578554 / +0.4% 280207590 / 276803702 / +1.2% 0.84 / 0.85 / -0.8%
tpch_q10/duckdb:parquet 315455151 / 313587478 / +0.6% 340716180 / 337403692 / +1.0% 0.93 / 0.93 / -0.4%
tpch_q11/duckdb:parquet 43770876 / 43490479 / +0.6% 51287114 / 50005616 / +2.6% 0.85 / 0.87 / -1.9%
tpch_q12/duckdb:parquet 70377973 / 70505417 / -0.2% 90920976 / 90007679 / +1.0% 0.77 / 0.78 / -1.2%
tpch_q13/duckdb:parquet 293669993 / 293441858 / +0.1% 307951435 / 310736944 / -0.9% 0.95 / 0.94 / +1.0%
tpch_q14/duckdb:parquet 100505860 / 101133653 / -0.6% 138657682 / 136327535 / +1.7% 0.72 / 0.74 / -2.3%
tpch_q15/duckdb:parquet 57200944 / 57306184 / -0.2% 84294714 / 84972419 / -0.8% 0.68 / 0.67 / +0.6%
tpch_q16/duckdb:parquet 100682238 / 100633707 / +0.0% 107394310 / 107203047 / +0.2% 0.94 / 0.94 / -0.1%
tpch_q17/duckdb:parquet 83289228 / 83962666 / -0.8% 115366006 / 110031995 / +4.8% 0.72 / 0.76 / -5.4%
tpch_q18/duckdb:parquet 157909882 / 157083225 / +0.5% 173219181 / 172862922 / +0.2% 0.91 / 0.91 / +0.3%
tpch_q19/duckdb:parquet 97308500 / 98792583 / -1.5% 135006629 / 130377546 / +3.6% 0.72 / 0.76 / -4.9%
tpch_q20/duckdb:parquet 146884909 / 146971997 / -0.1% 183930838 / 181619680 / +1.3% 0.80 / 0.81 / -1.3%
tpch_q21/duckdb:parquet 250379949 / 254756250 / -1.7% 276627682 / 271034790 / +2.1% 0.91 / 0.94 / -3.7%
tpch_q22/duckdb:parquet 168442882 / 168406469 / +0.0% 180561882 / 179252698 / +0.7% 0.93 / 0.94 / -0.7%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 2bc5703c vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+4.8%, environment too noisy confidence) · DuckDB No clear signal (-3.6%, environment too noisy confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.040x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.049x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 231004838 / 213717821 / +8.1% 865239658 / 764398977 / +13.2% 0.27 / 0.28 / -4.5%
tpch_q02/datafusion:vortex-file-compressed 337464761 / 320984758 / +5.1% 679107175 / 553448858 / +22.7% 0.50 / 0.58 / -14.3%
tpch_q03/datafusion:vortex-file-compressed 308658963 / 310450262 / -0.6% 848336406 / 854530904 / -0.7% 0.36 / 0.36 / +0.1%
tpch_q04/datafusion:vortex-file-compressed 182567302 / 159007585 / +14.8% 413833901 / 372572808 / +11.1% 0.44 / 0.43 / +3.4%
tpch_q05/datafusion:vortex-file-compressed 353698151 / 344078558 / +2.8% 565090089 / 546047746 / +3.5% 0.63 / 0.63 / -0.7%
tpch_q06/datafusion:vortex-file-compressed 125604235 / 123668516 / +1.6% 292243021 / 317073449 / -7.8% 0.43 / 0.39 / +10.2%
tpch_q07/datafusion:vortex-file-compressed 410328960 / 426177142 / -3.7% 575117809 / 586012416 / -1.9% 0.71 / 0.73 / -1.9%
tpch_q08/datafusion:vortex-file-compressed 412115166 / 410714646 / +0.3% 597669133 / 541459260 / +10.4% 0.69 / 0.76 / -9.1%
tpch_q09/datafusion:vortex-file-compressed 387219056 / 301899395 / +28.3% 523667230 / 455403137 / +15.0% 0.74 / 0.66 / +11.5%
tpch_q10/datafusion:vortex-file-compressed 369327927 / 361036359 / +2.3% 527108524 / 525406226 / +0.3% 0.70 / 0.69 / +2.0%
tpch_q11/datafusion:vortex-file-compressed 273374610 / 272228443 / +0.4% 440153055 / 382260665 / +15.1% 0.62 / 0.71 / -12.8%
tpch_q12/datafusion:vortex-file-compressed 210668897 / 203460731 / +3.5% 556964657 / 338106908 / +64.7% 🔴 0.38 / 0.60 / -37.1%
tpch_q13/datafusion:vortex-file-compressed 109147957 / 116217877 / -6.1% 321827223 / 309114444 / +4.1% 0.34 / 0.38 / -9.8%
tpch_q14/datafusion:vortex-file-compressed 184627140 / 181074526 / +2.0% 333416897 / 354128334 / -5.8% 0.55 / 0.51 / +8.3%
tpch_q15/datafusion:vortex-file-compressed 287342941 / 306125584 / -6.1% 534696568 / 727209626 / -26.5% 0.54 / 0.42 / +27.7%
tpch_q16/datafusion:vortex-file-compressed 139734144 / 134848492 / +3.6% 297569388 / 285978767 / +4.1% 0.47 / 0.47 / -0.4%
tpch_q17/datafusion:vortex-file-compressed 253869850 / 252865916 / +0.4% 443148199 / 494400127 / -10.4% 0.57 / 0.51 / +12.0%
tpch_q18/datafusion:vortex-file-compressed 248247255 / 222278514 / +11.7% 451677352 / 389005809 / +16.1% 0.55 / 0.57 / -3.8%
tpch_q19/datafusion:vortex-file-compressed 255714252 / 226209017 / +13.0% 402290371 / 296515885 / +35.7% 🔴 0.64 / 0.76 / -16.7%
tpch_q20/datafusion:vortex-file-compressed 272258648 / 248686849 / +9.5% 444792990 / 477297666 / -6.8% 0.61 / 0.52 / +17.5%
tpch_q21/datafusion:vortex-file-compressed 438482140 / 384422617 / +14.1% 815319176 / 739838656 / +10.2% 0.54 / 0.52 / +3.5%
tpch_q22/datafusion:vortex-file-compressed 160214848 / 147475449 / +8.6% 389307906 / 337385924 / +15.4% 0.41 / 0.44 / -5.9%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 145075888 / 143033960 / +1.4% 443654924 / 425422516 / +4.3% 0.33 / 0.34 / -2.7%
tpch_q02/datafusion:parquet 270193988 / 274389077 / -1.5% 474252517 / 421418541 / +12.5% 0.57 / 0.65 / -12.5%
tpch_q03/datafusion:parquet 223058611 / 240153039 / -7.1% 658992529 / 656104536 / +0.4% 0.34 / 0.37 / -7.5%
tpch_q04/datafusion:parquet 121941985 / 129091170 / -5.5% 318122823 / 262434371 / +21.2% 0.38 / 0.49 / -22.1%
tpch_q05/datafusion:parquet 346179852 / 325560808 / +6.3% 512124228 / 708712744 / -27.7% 0.68 / 0.46 / +47.2%
tpch_q06/datafusion:parquet 106478630 / 104623731 / +1.8% 297051147 / 202039421 / +47.0% 🔴 0.36 / 0.52 / -30.8%
tpch_q07/datafusion:parquet 319263591 / 326115720 / -2.1% 483606831 / 439408571 / +10.1% 0.66 / 0.74 / -11.0%
tpch_q08/datafusion:parquet 450853561 / 383031456 / +17.7% 536144251 / 487777150 / +9.9% 0.84 / 0.79 / +7.1%
tpch_q09/datafusion:parquet 374746761 / 507741508 / -26.2% 498558357 / 948722124 / -47.4% 🟢 0.75 / 0.54 / +40.4%
tpch_q10/datafusion:parquet 292396347 / 318225993 / -8.1% 469611107 / 431490793 / +8.8% 0.62 / 0.74 / -15.6%
tpch_q11/datafusion:parquet 238347621 / 245309101 / -2.8% 340207340 / 324804219 / +4.7% 0.70 / 0.76 / -7.2%
tpch_q12/datafusion:parquet 155503151 / 160703746 / -3.2% 316838583 / 262477140 / +20.7% 0.49 / 0.61 / -19.8%
tpch_q13/datafusion:parquet 270656756 / 274764633 / -1.5% 489826040 / 387802001 / +26.3% 0.55 / 0.71 / -22.0%
tpch_q14/datafusion:parquet 159190255 / 141590102 / +12.4% 284852616 / 264823133 / +7.6% 0.56 / 0.53 / +4.5%
tpch_q15/datafusion:parquet 310273475 / 297935495 / +4.1% 491088208 / 444599102 / +10.5% 0.63 / 0.67 / -5.7%
tpch_q16/datafusion:parquet 99491096 / 96864793 / +2.7% 204460036 / 207092637 / -1.3% 0.49 / 0.47 / +4.0%
tpch_q17/datafusion:parquet 263997946 / 268630342 / -1.7% 420365719 / 416939497 / +0.8% 0.63 / 0.64 / -2.5%
tpch_q18/datafusion:parquet 293659521 / 305302634 / -3.8% 426134168 / 465639400 / -8.5% 0.69 / 0.66 / +5.1%
tpch_q19/datafusion:parquet 164073077 / 149310744 / +9.9% 308699967 / 274137368 / +12.6% 0.53 / 0.54 / -2.4%
tpch_q20/datafusion:parquet 231581347 / 228071243 / +1.5% 352707606 / 424446687 / -16.9% 0.66 / 0.54 / +22.2%
tpch_q21/datafusion:parquet 317019210 / 291483866 / +8.8% 422983208 / 469762099 / -10.0% 0.75 / 0.62 / +20.8%
tpch_q22/datafusion:parquet 155405541 / 145366900 / +6.9% 335127520 / 299750221 / +11.8% 0.46 / 0.48 / -4.4%
duckdb / vortex-file-compressed / ns (0.953x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 251003957 / 237695207 / +5.6% 239413541 / 298096331 / -19.7% 1.05 / 0.80 / +31.5%
tpch_q02/duckdb:vortex-file-compressed 398057725 / 394665672 / +0.9% 515484124 / 474795024 / +8.6% 0.77 / 0.83 / -7.1%
tpch_q03/duckdb:vortex-file-compressed 376049126 / 398939371 / -5.7% 454092971 / 460688509 / -1.4% 0.83 / 0.87 / -4.4%
tpch_q04/duckdb:vortex-file-compressed 251420660 / 255227345 / -1.5% 307081777 / 296337544 / +3.6% 0.82 / 0.86 / -4.9%
tpch_q05/duckdb:vortex-file-compressed 504954493 / 709957932 / -28.9% 564516804 / 785337665 / -28.1% 0.89 / 0.90 / -1.1%
tpch_q06/duckdb:vortex-file-compressed 153248285 / 148777224 / +3.0% 211345361 / 208058114 / +1.6% 0.73 / 0.72 / +1.4%
tpch_q07/duckdb:vortex-file-compressed 404050047 / 387859027 / +4.2% 413485927 / 510621725 / -19.0% 0.98 / 0.76 / +28.6%
tpch_q08/duckdb:vortex-file-compressed 575886282 / 617848086 / -6.8% 637017741 / 732855328 / -13.1% 0.90 / 0.84 / +7.2%
tpch_q09/duckdb:vortex-file-compressed 401683393 / 392528875 / +2.3% 449661862 / 482201706 / -6.7% 0.89 / 0.81 / +9.7%
tpch_q10/duckdb:vortex-file-compressed 518845237 / 526138612 / -1.4% 625826576 / 576801469 / +8.5% 0.83 / 0.91 / -9.1%
tpch_q11/duckdb:vortex-file-compressed 306621469 / 288496302 / +6.3% 327325351 / 270775100 / +20.9% 0.94 / 1.07 / -12.1%
tpch_q12/duckdb:vortex-file-compressed 220089627 / 271105721 / -18.8% 257147440 / 407392913 / -36.9% 🟢 0.86 / 0.67 / +28.6%
tpch_q13/duckdb:vortex-file-compressed 229134977 / 247871881 / -7.6% 256371342 / 208806747 / +22.8% 0.89 / 1.19 / -24.7%
tpch_q14/duckdb:vortex-file-compressed 213599297 / 224785869 / -5.0% 271238478 / 273953898 / -1.0% 0.79 / 0.82 / -4.0%
tpch_q15/duckdb:vortex-file-compressed 238943883 / 237917836 / +0.4% 310176150 / 453417020 / -31.6% 🟢 0.77 / 0.52 / +46.8%
tpch_q16/duckdb:vortex-file-compressed 188469907 / 206543544 / -8.8% 265565896 / 287344280 / -7.6% 0.71 / 0.72 / -1.3%
tpch_q17/duckdb:vortex-file-compressed 264436914 / 454602893 / -41.8% 🟢 339435762 / 443734007 / -23.5% 0.78 / 1.02 / -24.0%
tpch_q18/duckdb:vortex-file-compressed 342946470 / 339736454 / +0.9% 366383360 / 418339259 / -12.4% 0.94 / 0.81 / +15.3%
tpch_q19/duckdb:vortex-file-compressed 282744692 / 320978677 / -11.9% 312205472 / 349847295 / -10.8% 0.91 / 0.92 / -1.3%
tpch_q20/duckdb:vortex-file-compressed 316149462 / 334782469 / -5.6% 461346234 / 412936083 / +11.7% 0.69 / 0.81 / -15.5%
tpch_q21/duckdb:vortex-file-compressed 946741286 / 558602915 / +69.5% 🔴 730641453 / 630439819 / +15.9% 1.30 / 0.89 / +46.2%
tpch_q22/duckdb:vortex-file-compressed 215832448 / 253794094 / -15.0% 303431263 / 269551763 / +12.6% 0.71 / 0.94 / -24.5%
duckdb / parquet / ns (0.989x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 170597274 / 178327142 / -4.3% 274901356 / 188180852 / +46.1% 🔴 0.62 / 0.95 / -34.5%
tpch_q02/duckdb:parquet 425858250 / 428571834 / -0.6% 439968372 / 421258354 / +4.4% 0.97 / 1.02 / -4.9%
tpch_q03/duckdb:parquet 348360695 / 384797319 / -9.5% 419076581 / 402689855 / +4.1% 0.83 / 0.96 / -13.0%
tpch_q04/duckdb:parquet 498426581 / 278868438 / +78.7% 🔴 642382315 / 290411092 / +121.2% 🔴 0.78 / 0.96 / -19.2%
tpch_q05/duckdb:parquet 493108857 / 512960026 / -3.9% 544885155 / 589908823 / -7.6% 0.90 / 0.87 / +4.1%
tpch_q06/duckdb:parquet 124246274 / 154774655 / -19.7% 165179967 / 188086085 / -12.2% 0.75 / 0.82 / -8.6%
tpch_q07/duckdb:parquet 490595263 / 419672939 / +16.9% 756544098 / 421853390 / +79.3% 🔴 0.65 / 0.99 / -34.8%
tpch_q08/duckdb:parquet 562409578 / 588960652 / -4.5% 646168264 / 658661231 / -1.9% 0.87 / 0.89 / -2.7%
tpch_q09/duckdb:parquet 511515961 / 557378838 / -8.2% 558145894 / 656390425 / -15.0% 0.92 / 0.85 / +7.9%
tpch_q10/duckdb:parquet 581019270 / 517349035 / +12.3% 601234013 / 581884894 / +3.3% 0.97 / 0.89 / +8.7%
tpch_q11/duckdb:parquet 249006979 / 279247336 / -10.8% 259493272 / 301469405 / -13.9% 0.96 / 0.93 / +3.6%
tpch_q12/duckdb:parquet 216531802 / 244321025 / -11.4% 279825097 / 281145014 / -0.5% 0.77 / 0.87 / -11.0%
tpch_q13/duckdb:parquet 343456609 / 382703043 / -10.3% 431997160 / 463219570 / -6.7% 0.80 / 0.83 / -3.8%
tpch_q14/duckdb:parquet 216804764 / 255047143 / -15.0% 280840812 / 301222259 / -6.8% 0.77 / 0.85 / -8.8%
tpch_q15/duckdb:parquet 203400657 / 191438501 / +6.2% 230031729 / 220554518 / +4.3% 0.88 / 0.87 / +1.9%
tpch_q16/duckdb:parquet 260465268 / 287313946 / -9.3% 268613151 / 301984087 / -11.1% 0.97 / 0.95 / +1.9%
tpch_q17/duckdb:parquet 251078202 / 258007938 / -2.7% 322633743 / 314199718 / +2.7% 0.78 / 0.82 / -5.2%
tpch_q18/duckdb:parquet 333388020 / 306425002 / +8.8% 361201865 / 355418381 / +1.6% 0.92 / 0.86 / +7.1%
tpch_q19/duckdb:parquet 241783916 / 241485587 / +0.1% 280451395 / 285468394 / -1.8% 0.86 / 0.85 / +1.9%
tpch_q20/duckdb:parquet 420175187 / 432599380 / -2.9% 468784051 / 540117093 / -13.2% 0.90 / 0.80 / +11.9%
tpch_q21/duckdb:parquet 409313122 / 417617294 / -2.0% 522282184 / 463876894 / +12.6% 0.78 / 0.90 / -12.9%
tpch_q22/duckdb:parquet 282285427 / 287438341 / -1.8% 275946883 / 253402369 / +8.9% 1.02 / 1.13 / -9.8%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant