Skip to content

perf(duckdb): group small filtered V2 scan parts on layout boundaries - #11343

Draft
joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-04-duck-file-pruningfrom
ji/clickbench-v2-20261109-07-duck-filtered-parts
Draft

joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-04-duck-file-pruningfrom
ji/clickbench-v2-20261109-07-duck-filtered-parts

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Draft with confirmed focused gains; Q42 distribution and the dependency's Q7 concern remain unresolved.

Stack dependency: #11340. This PR targets that branch so its diff contains only this change.

Summary

Static filtered V2 scans currently create a pruning task for each layout part. Group small adjacent parts while preserving layout boundaries, and use exact binary-flag statistics to choose larger groups for selective filters.

Depends on ji/clickbench-v2-20261109-04-duck-file-pruning for access to the opened file’s footer. It does not require the prepared-proof or pre-open-pruning branches.

Changes

  • Group adjacent ranges without bridging gaps or splitting layout parts; keep dynamic filters on their existing planning path.
  • Use exact bounds, sums, and null counts only to select task granularity; row filtering still evaluates the predicate.
  • Add range-coverage and nullable binary-flag cases, plus a serialized V1/V2 comparison helper that restores the previous scan mode.

Benchmark evidence

Warm ClickBench timings against this branch's exact dependency parent. Query IDs are zero-based; these are individual query gains, not whole-suite or additive gains.

Engine Query Parent median (ms) Candidate median (ms) Paired latency reduction 99% interval
DuckDB Q36 9.4814 9.1758 3.20% 2.76–3.64%
DuckDB Q38 7.1925 6.7488 6.05% 5.81–6.30%
DuckDB Q39 16.6229 16.1297 2.90% 2.61–3.15%

24 fresh adjacent process pairs in balanced order; 100 executions/query, first 20 discarded; 8 interspersed identical-binary A/A pairs. Effects use mean paired log ratios of process warm medians. Displayed times are medians across processes, so their ratio need not exactly equal the paired estimate. Intervals are pointwise 99% bootstrap intervals. Each listed gain passes both the >1% interval rule and the exact paired sign test with Holm 1% correction across all 76 planned latency directions. Both execution orders and chronological sensitivity were reviewed; no post-warmup observations were excluded or controls subtracted. The sign test concerns how often a paired improvement exceeds 1%; the displayed interval estimates the mean log effect.

DuckDB Q38 has an A/A drift warning: identical binaries show -0.630% apparent reduction. The main effect remains above 1% in both orders and all six chronological groups. This qualification is retained.

DuckDB Q39 has an A/A drift warning: identical binaries show -0.223% apparent reduction. The main effect remains above 1% in both orders and all six chronological groups. This qualification is retained.

Whole-process user+system CPU reductions on the same focused query set: DuckDB 5.32% (99% interval 5.10–5.53%). These pass the separately corrected CPU family and include setup and warmups; they are not measurements of isolated Vortex CPU.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads, DuckDB --reuse. DataFusion 55.2 retains enable_topk_aggregation=true. Compiler, Cargo feature union, profile and runtime environment are fixed across parent/candidate. Executable and library hashes, canonical SQL and fixture identities are recorded.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

The focused Q36/Q38/Q39 gains remain valid with their disclosed control warnings. All43 DuckDB Q42 medians are 9.65% slower in every pair, but means rise only 1.49%, and the candidate has fewer extreme events. Describe a median/distribution concern, not worse extreme tails; matching mean controls are very noisy. Q4/Q7 are secondary observations, and the s04 dependency concern remains. Favorable all43 latency sums are descriptive and do not create an additional gain claim.

Validation

  • 39 targeted test executions passed on this exact source tree: scan_v2::tests, test_vortex_scan_v2_groups_nullable_binary_flag_parts, test_vortex_scan_v2_matches_v1.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate); strict types, floating tolerance, tied-row membership and independent oracles included.
  • Both benchmark packages built together with --locked, the release_debug profile, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust changes were formatted with pinned nightly; patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local source commit: 9390b632a282f0b4facbc8b25944941ccd7c947c; full source tree: bc746c57847ca56c006ca170e4ba068947030b20. Measured parent: 0fbf06a77da9e1cfe226913262e601d90829a45a.

PR source commit: 1d56e333cd4b1c3bafbe2bab77e6a1c266bb2c6a; mapped parent: 2bc5703c632f9bdeca16cde41b222ea48d1dde35. The complete source tree and mapped parent graph match the measured source. GitHub regenerated commit metadata/timestamps, so the measured local commit and executable hashes remain the benchmark identities. The complete remote Git object, original message and author/committer signoffs were verified.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. 3 suite(s) required one failed-jobs-only retry after EC2 capacity failures before checkout; the head stayed unchanged. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

Amortize static filter planning over adjacent layout splits. Use exact binary-flag statistics to choose larger parts for selective filters, preserving gaps and leaving dynamic-filter scheduling unchanged.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-04-duck-file-pruning to develop November 9, 2026 12:00
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-04-duck-file-pruning November 9, 2026 12:00
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 1d56e33 tpch-nvme-10 2 Explore Profiling Data
🟢 Done 1d56e33 fineweb 2 Explore Profiling Data
🟢 Done 1d56e33 tpcds-nvme 2 Explore Profiling Data
🟢 Done 1d56e33 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 1d56e33 tpch-s3 1 Explore Profiling Data
🟢 Done 1d56e33 polarsignals 1 Explore Profiling Data
🟢 Done 1d56e33 clickbench-nvme 1 Explore Profiling Data
🟢 Done 1d56e33 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 1d56e333 vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.962x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16417991 / 15688950 / +4.6% 41063034 / 42044683 / -2.3% 0.40 / 0.37 / +7.1%
tpch_q02/datafusion:vortex-file-compressed 17421977 / 17642963 / -1.3% 37472834 / 38300817 / -2.2% 0.46 / 0.46 / +0.9%
tpch_q03/datafusion:vortex-file-compressed 19410885 / 19065844 / +1.8% 47110511 / 48397388 / -2.7% 0.41 / 0.39 / +4.6%
tpch_q04/datafusion:vortex-file-compressed 10505060 / 11164861 / -5.9% 34951984 / 35072742 / -0.3% 0.30 / 0.32 / -5.6%
tpch_q05/datafusion:vortex-file-compressed 37607030 / 37464731 / +0.4% 64432247 / 67783021 / -4.9% 0.58 / 0.55 / +5.6%
tpch_q06/datafusion:vortex-file-compressed 4381601 / 4339682 / +1.0% 25424774 / 24863986 / +2.3% 0.17 / 0.17 / -1.3%
tpch_q07/datafusion:vortex-file-compressed 53119307 / 52692511 / +0.8% 82536293 / 85054942 / -3.0% 0.64 / 0.62 / +3.9%
tpch_q08/datafusion:vortex-file-compressed 52289805 / 52605829 / -0.6% 81670625 / 84709539 / -3.6% 0.64 / 0.62 / +3.1%
tpch_q09/datafusion:vortex-file-compressed 47921827 / 48498381 / -1.2% 78432814 / 84507228 / -7.2% 0.61 / 0.57 / +6.5%
tpch_q10/datafusion:vortex-file-compressed 17691265 / 17830636 / -0.8% 48643854 / 50418361 / -3.5% 0.36 / 0.35 / +2.8%
tpch_q11/datafusion:vortex-file-compressed 14713482 / 14797088 / -0.6% 34750719 / 34636066 / +0.3% 0.42 / 0.43 / -0.9%
tpch_q12/datafusion:vortex-file-compressed 18874145 / 18367682 / +2.8% 41930518 / 44324157 / -5.4% 0.45 / 0.41 / +8.6%
tpch_q13/datafusion:vortex-file-compressed 19555331 / 19445378 / +0.6% 40890242 / 43547559 / -6.1% 0.48 / 0.45 / +7.1%
tpch_q14/datafusion:vortex-file-compressed 14505588 / 14501344 / +0.0% 38101946 / 38502171 / -1.0% 0.38 / 0.38 / +1.1%
tpch_q15/datafusion:vortex-file-compressed 18166830 / 18611040 / -2.4% 44874917 / 47147954 / -4.8% 0.40 / 0.39 / +2.6%
tpch_q16/datafusion:vortex-file-compressed 18526528 / 18720655 / -1.0% 37173679 / 39847079 / -6.7% 0.50 / 0.47 / +6.1%
tpch_q17/datafusion:vortex-file-compressed 28907718 / 28917794 / -0.0% 58029071 / 58954760 / -1.6% 0.50 / 0.49 / +1.6%
tpch_q18/datafusion:vortex-file-compressed 36568385 / 36473671 / +0.3% 60579439 / 59803246 / +1.3% 0.60 / 0.61 / -1.0%
tpch_q19/datafusion:vortex-file-compressed 9687054 / 9988295 / -3.0% 35813332 / 36396214 / -1.6% 0.27 / 0.27 / -1.4%
tpch_q20/datafusion:vortex-file-compressed 20606159 / 21253874 / -3.0% 47402460 / 52124094 / -9.1% 0.43 / 0.41 / +6.6%
tpch_q21/datafusion:vortex-file-compressed 34987235 / 35502918 / -1.5% 64372721 / 66036777 / -2.5% 0.54 / 0.54 / +1.1%
tpch_q22/datafusion:vortex-file-compressed 10849773 / 10854425 / -0.0% 30231502 / 31535557 / -4.1% 0.36 / 0.34 / +4.3%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71454857 / 71385078 / +0.1% 86071368 / 87261585 / -1.4% 0.83 / 0.82 / +1.5%
tpch_q02/datafusion:parquet 76535420 / 76624116 / -0.1% 92433002 / 91913452 / +0.6% 0.83 / 0.83 / -0.7%
tpch_q03/datafusion:parquet 81592652 / 82108255 / -0.6% 101830300 / 104243587 / -2.3% 0.80 / 0.79 / +1.7%
tpch_q04/datafusion:parquet 39374086 / 39117802 / +0.7% 57371081 / 58381793 / -1.7% 0.69 / 0.67 / +2.4%
tpch_q05/datafusion:parquet 1102973 / 110097915 / +0.2% 135306039 / 137152327 / -1.3% 0.82 / 0.80 / +1.5%
tpch_q06/datafusion:parquet 31578442 / 31364851 / +0.7% 46116253 / 46559945 / -1.0% 0.68 / 0.67 / +1.6%
tpch_q07/datafusion:parquet 112842724 / 113603354 / -0.7% 136109744 / 139063930 / -2.1% 0.83 / 0.82 / +1.5%
tpch_q08/datafusion:parquet 117016584 / 118351864 / -1.1% 141945482 / 143663582 / -1.2% 0.82 / 0.82 / +0.1%
tpch_q09/datafusion:parquet 138346523 / 137262432 / +0.8% 163590673 / 166772416 / -1.9% 0.85 / 0.82 / +2.8%
tpch_q10/datafusion:parquet 103429792 / 103456749 / -0.0% 125004528 / 126729504 / -1.4% 0.83 / 0.82 / +1.4%
tpch_q11/datafusion:parquet 61417881 / 62363006 / -1.5% 81058570 / 82069278 / -1.2% 0.76 / 0.76 / -0.3%
tpch_q12/datafusion:parquet 63984115 / 63533745 / +0.7% 81705897 / 85351184 / -4.3% 0.78 / 0.74 / +5.2%
tpch_q13/datafusion:parquet 142740508 / 142477870 / +0.2% 161390828 / 161849930 / -0.3% 0.88 / 0.88 / +0.5%
tpch_q14/datafusion:parquet 47476703 / 47624060 / -0.3% 67224440 / 68804881 / -2.3% 0.71 / 0.69 / +2.0%
tpch_q15/datafusion:parquet 73861629 / 74880432 / -1.4% 91944719 / 92266259 / -0.3% 0.80 / 0.81 / -1.0%
tpch_q16/datafusion:parquet 43775101 / 43181694 / +1.4% 59824579 / 59549382 / +0.5% 0.73 / 0.73 / +0.9%
tpch_q17/datafusion:parquet 123298845 / 123682757 / -0.3% 144311038 / 147020505 / -1.8% 0.85 / 0.84 / +1.6%
tpch_q18/datafusion:parquet 120651039 / 121104227 / -0.4% 140247697 / 142447395 / -1.5% 0.86 / 0.85 / +1.2%
tpch_q19/datafusion:parquet 57178821 / 57774413 / -1.0% 80070098 / 82236501 / -2.6% 0.71 / 0.70 / +1.6%
tpch_q20/datafusion:parquet 77690160 / 78510463 / -1.0% 96684670 / 101516128 / -4.8% 0.80 / 0.77 / +3.9%
tpch_q21/datafusion:parquet 112970998 / 113088915 / -0.1% 137414902 / 139363438 / -1.4% 0.82 / 0.81 / +1.3%
tpch_q22/datafusion:parquet 51273001 / 51831048 / -1.1% 67063477 / 67131696 / -0.1% 0.76 / 0.77 / -1.0%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9125862 / 9046497 / +0.9% 18250243 / 20027987 / -8.9% 0.50 / 0.45 / +10.7%
tpch_q02/duckdb:vortex-file-compressed 14898047 / 15124900 / -1.5% 24638427 / 25341316 / -2.8% 0.60 / 0.60 / +1.3%
tpch_q03/duckdb:vortex-file-compressed 18594589 / 18447734 / +0.8% 33052652 / 34750008 / -4.9% 0.56 / 0.53 / +6.0%
tpch_q04/duckdb:vortex-file-compressed 11978255 / 12448707 / -3.8% 25129786 / 26846587 / -6.4% 0.48 / 0.46 / +2.8%
tpch_q05/duckdb:vortex-file-compressed 19814230 / 20254666 / -2.2% 35162816 / 35776065 / -1.7% 0.56 / 0.57 / -0.5%
tpch_q06/duckdb:vortex-file-compressed 4607076 / 4488820 / +2.6% 14787805 / 15022696 / -1.6% 0.31 / 0.30 / +4.3%
tpch_q07/duckdb:vortex-file-compressed 23905901 / 23909987 / -0.0% 38475681 / 41780280 / -7.9% 0.62 / 0.57 / +8.6%
tpch_q08/duckdb:vortex-file-compressed 20878298 / 20744171 / +0.6% 36405898 / 37318055 / -2.4% 0.57 / 0.56 / +3.2%
tpch_q09/duckdb:vortex-file-compressed 22390685 / 23055861 / -2.9% 37821422 / 38487753 / -1.7% 0.59 / 0.60 / -1.2%
tpch_q10/duckdb:vortex-file-compressed 26814460 / 26815462 / -0.0% 42679319 / 45530635 / -6.3% 0.63 / 0.59 / +6.7%
tpch_q11/duckdb:vortex-file-compressed 7954341 / 7968318 / -0.2% 16971683 / 18104165 / -6.3% 0.47 / 0.44 / +6.5%
tpch_q12/duckdb:vortex-file-compressed 14447276 / 14764927 / -2.2% 25633014 / 27095283 / -5.4% 0.56 / 0.54 / +3.4%
tpch_q13/duckdb:vortex-file-compressed 19630950 / 19378947 / +1.3% 31733650 / 31743144 / -0.0% 0.62 / 0.61 / +1.3%
tpch_q14/duckdb:vortex-file-compressed 11271327 / 11181264 / +0.8% 24161116 / 25354587 / -4.7% 0.47 / 0.44 / +5.8%
tpch_q15/duckdb:vortex-file-compressed 8275462 / 8381204 / -1.3% 19163519 / 20995174 / -8.7% 0.43 / 0.40 / +8.2%
tpch_q16/duckdb:vortex-file-compressed 16532482 / 16413233 / +0.7% 23603575 / 23979720 / -1.6% 0.70 / 0.68 / +2.3%
tpch_q17/duckdb:vortex-file-compressed 12571002 / 12592677 / -0.2% 28059136 / 28445363 / -1.4% 0.45 / 0.44 / +1.2%
tpch_q18/duckdb:vortex-file-compressed 24292843 / 24316808 / -0.1% 34370702 / 34951044 / -1.7% 0.71 / 0.70 / +1.6%
tpch_q19/duckdb:vortex-file-compressed 10440818 / 11426195 / -8.6% 24138291 / 25766839 / -6.3% 0.43 / 0.44 / -2.5%
tpch_q20/duckdb:vortex-file-compressed 14190192 / 14325643 / -0.9% 29405379 / 30552986 / -3.8% 0.48 / 0.47 / +2.9%
tpch_q21/duckdb:vortex-file-compressed 48715294 / 48281048 / +0.9% 63134176 / 66017908 / -4.4% 0.77 / 0.73 / +5.5%
tpch_q22/duckdb:vortex-file-compressed 16890777 / 16702790 / +1.1% 24937562 / 26800262 / -7.0% 0.68 / 0.62 / +8.7%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47518761 / 47547581 / -0.1% 53467470 / 54112740 / -1.2% 0.89 / 0.88 / +1.1%
tpch_q02/duckdb:parquet 48344221 / 48312217 / +0.1% 54935258 / 55151190 / -0.4% 0.88 / 0.88 / +0.5%
tpch_q03/duckdb:parquet 60282816 / 60217500 / +0.1% 67628068 / 69288935 / -2.4% 0.89 / 0.87 / +2.6%
tpch_q04/duckdb:parquet 34665335 / 34656547 / +0.0% 42126433 / 43053263 / -2.2% 0.82 / 0.80 / +2.2%
tpch_q05/duckdb:parquet 67014149 / 67091722 / -0.1% 76456741 / 77316587 / -1.1% 0.88 / 0.87 / +1.0%
tpch_q06/duckdb:parquet 21578579 / 21601570 / -0.1% 27059056 / 27249425 / -0.7% 0.80 / 0.79 / +0.6%
tpch_q07/duckdb:parquet 63639077 / 63799205 / -0.3% 72518677 / 72405251 / +0.2% 0.88 / 0.88 / -0.4%
tpch_q08/duckdb:parquet 75527691 / 75667269 / -0.2% 86175106 / 86769393 / -0.7% 0.88 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 107627385 / 107847179 / -0.2% 118593419 / 118570948 / +0.0% 0.91 / 0.91 / -0.2%
tpch_q10/duckdb:parquet 105424527 / 105720936 / -0.3% 116178616 / 117200993 / -0.9% 0.91 / 0.90 / +0.6%
tpch_q11/duckdb:parquet 29376756 / 29439572 / -0.2% 34340993 / 34922812 / -1.7% 0.86 / 0.84 / +1.5%
tpch_q12/duckdb:parquet 37195393 / 37121505 / +0.2% 43365033 / 43764563 / -0.9% 0.86 / 0.85 / +1.1%
tpch_q13/duckdb:parquet 175782022 / 174812670 / +0.6% 183199374 / 184970583 / -1.0% 0.96 / 0.95 / +1.5%
tpch_q14/duckdb:parquet 42359967 / 42356235 / +0.0% 50975491 / 51063051 / -0.2% 0.83 / 0.83 / +0.2%
tpch_q15/duckdb:parquet 32576192 / 32503990 / +0.2% 40824786 / 41334737 / -1.2% 0.80 / 0.79 / +1.5%
tpch_q16/duckdb:parquet 47191999 / 47147798 / +0.1% 53315490 / 52668299 / +1.2% 0.89 / 0.90 / -1.1%
tpch_q17/duckdb:parquet 47889730 / 47964459 / -0.2% 56785171 / 56795941 / -0.0% 0.84 / 0.84 / -0.1%
tpch_q18/duckdb:parquet 74023816 / 73982405 / +0.1% 80006976 / 80482798 / -0.6% 0.93 / 0.92 / +0.7%
tpch_q19/duckdb:parquet 48132380 / 49071842 / -1.9% 57208586 / 55601512 / +2.9% 0.84 / 0.88 / -4.7%
tpch_q20/duckdb:parquet 63326538 / 63412118 / -0.1% 73028390 / 73364368 / -0.5% 0.87 / 0.86 / +0.3%
tpch_q21/duckdb:parquet 106775736 / 106560704 / +0.2% 115970864 / 116038695 / -0.1% 0.92 / 0.92 / +0.3%
tpch_q22/duckdb:parquet 50526847 / 50470913 / +0.1% 58014517 / 59155611 / -1.9% 0.87 / 0.85 / +2.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 1d56e333 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.986x ➖ · cold 0.996x ➖
Parquet (geomean): hot 0.991x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.9% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1224450 / 1277762 / -4.2% 22646621 / 22701905 / -0.2% 0.05 / 0.06 / -3.9%
clickbench_q01/datafusion:vortex-file-compressed 5688426 / 5701054 / -0.2% 28724722 / 34133473 / -15.8% 🟢 0.20 / 0.17 / +18.6%
clickbench_q02/datafusion:vortex-file-compressed 10642446 / 11059978 / -3.8% 46524894 / 45727346 / +1.7% 0.23 / 0.24 / -5.4%
clickbench_q03/datafusion:vortex-file-compressed 12330358 / 12962152 / -4.9% 56846460 / 59966511 / -5.2% 0.22 / 0.22 / +0.3%
clickbench_q04/datafusion:vortex-file-compressed 59249548 / 58491492 / +1.3% 105622472 / 107265399 / -1.5% 0.56 / 0.55 / +2.9%
clickbench_q05/datafusion:vortex-file-compressed 74212976 / 75324188 / -1.5% 127387724 / 127176489 / +0.2% 0.58 / 0.59 / -1.6%
clickbench_q06/datafusion:vortex-file-compressed 1241974 / 1281209 / -3.1% 22733093 / 22762946 / -0.1% 0.05 / 0.06 / -2.9%
clickbench_q07/datafusion:vortex-file-compressed 9060742 / 9121962 / -0.7% 34109017 / 36679638 / -7.0% 0.27 / 0.25 / +6.8%
clickbench_q08/datafusion:vortex-file-compressed 77096778 / 79202689 / -2.7% 128796710 / 130034036 / -1.0% 0.60 / 0.61 / -1.7%
clickbench_q09/datafusion:vortex-file-compressed 168131312 / 169891930 / -1.0% 211820580 / 215849640 / -1.9% 0.79 / 0.79 / +0.8%
clickbench_q10/datafusion:vortex-file-compressed 22723476 / 23576041 / -3.6% 71228831 / 71620517 / -0.5% 0.32 / 0.33 / -3.1%
clickbench_q11/datafusion:vortex-file-compressed 24668752 / 25595211 / -3.6% 73300206 / 73456297 / -0.2% 0.34 / 0.35 / -3.4%
clickbench_q12/datafusion:vortex-file-compressed 71131322 / 72340317 / -1.7% 125558185 / 126525748 / -0.8% 0.57 / 0.57 / -0.9%
clickbench_q13/datafusion:vortex-file-compressed 115057816 / 114454353 / +0.5% 185955773 / 187159194 / -0.6% 0.62 / 0.61 / +1.2%
clickbench_q14/datafusion:vortex-file-compressed 73734944 / 75015054 / -1.7% 129792379 / 128127094 / +1.3% 0.57 / 0.59 / -3.0%
clickbench_q15/datafusion:vortex-file-compressed 62057896 / 63035252 / -1.6% 101137350 / 102527113 / -1.4% 0.61 / 0.61 / -0.2%
clickbench_q16/datafusion:vortex-file-compressed 151254878 / 154339830 / -2.0% 215524374 / 220216995 / -2.1% 0.70 / 0.70 / +0.1%
clickbench_q17/datafusion:vortex-file-compressed 152576128 / 153975190 / -0.9% 218145229 / 221571282 / -1.5% 0.70 / 0.69 / +0.6%
clickbench_q18/datafusion:vortex-file-compressed 296911440 / 297646745 / -0.2% 379092106 / 388335753 / -2.4% 0.78 / 0.77 / +2.2%
clickbench_q19/datafusion:vortex-file-compressed 7669501 / 7750414 / -1.0% 48866614 / 48721099 / +0.3% 0.16 / 0.16 / -1.3%
clickbench_q20/datafusion:vortex-file-compressed 71249485 / 68136855 / +4.6% 250266574 / 256425057 / -2.4% 0.28 / 0.27 / +7.1%
clickbench_q21/datafusion:vortex-file-compressed 79173838 / 80037805 / -1.1% 296163972 / 300737630 / -1.5% 0.27 / 0.27 / +0.4%
clickbench_q22/datafusion:vortex-file-compressed 90187542 / 95054287 / -5.1% 398827673 / 395336147 / +0.9% 0.23 / 0.24 / -6.0%
clickbench_q23/datafusion:vortex-file-compressed 85050913 / 80171206 / +6.1% 396088777 / 416246090 / -4.8% 0.21 / 0.19 / +11.5%
clickbench_q24/datafusion:vortex-file-compressed 9006344 / 8409700 / +7.1% 57499846 / 57093319 / +0.7% 0.16 / 0.15 / +6.3%
clickbench_q25/datafusion:vortex-file-compressed 18902873 / 18152158 / +4.1% 63190335 / 63410099 / -0.3% 0.30 / 0.29 / +4.5%
clickbench_q26/datafusion:vortex-file-compressed 14643804 / 15624998 / -6.3% 66983267 / 69615012 / -3.8% 0.22 / 0.22 / -2.6%
clickbench_q27/datafusion:vortex-file-compressed 97058534 / 100553100 / -3.5% 253897022 / 266070098 / -4.6% 0.38 / 0.38 / +1.2%
clickbench_q28/datafusion:vortex-file-compressed 556242687 / 561882003 / -1.0% 649288687 / 634483917 / +2.3% 0.86 / 0.89 / -3.3%
clickbench_q29/datafusion:vortex-file-compressed 23844340 / 24813306 / -3.9% 56441199 / 53938850 / +4.6% 0.42 / 0.46 / -8.2%
clickbench_q30/datafusion:vortex-file-compressed 54574746 / 54469824 / +0.2% 111601317 / 110322321 / +1.2% 0.49 / 0.49 / -1.0%
clickbench_q31/datafusion:vortex-file-compressed 64066572 / 63713036 / +0.6% 154503221 / 165094546 / -6.4% 0.41 / 0.39 / +7.4%
clickbench_q32/datafusion:vortex-file-compressed 291270356 / 287471359 / +1.3% 384603776 / 395194655 / -2.7% 0.76 / 0.73 / +4.1%
clickbench_q33/datafusion:vortex-file-compressed 316990694 / 318812426 / -0.6% 430650559 / 434359824 / -0.9% 0.74 / 0.73 / +0.3%
clickbench_q34/datafusion:vortex-file-compressed 318876904 / 319825400 / -0.3% 425426723 / 438643717 / -3.0% 0.75 / 0.73 / +2.8%
clickbench_q35/datafusion:vortex-file-compressed 56837284 / 56594294 / +0.4% 91943473 / 89838837 / +2.3% 0.62 / 0.63 / -1.9%
clickbench_q36/datafusion:vortex-file-compressed 36797215 / 37371240 / -1.5% 69874217 / 69504069 / +0.5% 0.53 / 0.54 / -2.1%
clickbench_q37/datafusion:vortex-file-compressed 20996038 / 20731798 / +1.3% 48684366 / 48713358 / -0.1% 0.43 / 0.43 / +1.3%
clickbench_q38/datafusion:vortex-file-compressed 12608794 / 12866674 / -2.0% 42038928 / 41261053 / +1.9% 0.30 / 0.31 / -3.8%
clickbench_q39/datafusion:vortex-file-compressed 78302816 / 78717482 / -0.5% 114456696 / 110822448 / +3.3% 0.68 / 0.71 / -3.7%
clickbench_q40/datafusion:vortex-file-compressed 10088774 / 10368860 / -2.7% 37814762 / 36576948 / +3.4% 0.27 / 0.28 / -5.9%
clickbench_q41/datafusion:vortex-file-compressed 9464598 / 9655634 / -2.0% 35693595 / 35212183 / +1.4% 0.27 / 0.27 / -3.3%
clickbench_q42/datafusion:vortex-file-compressed 9679281 / 9562990 / +1.2% 38017430 / 37134881 / +2.4% 0.25 / 0.26 / -1.1%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1274005 / 1245508 / +2.3% 51368738 / 49111389 / +4.6% 0.02 / 0.03 / -2.2%
clickbench_q01/datafusion:parquet 16132783 / 16128558 / +0.0% 72706986 / 65974016 / +10.2% 🔴 0.22 / 0.24 / -9.2%
clickbench_q02/datafusion:parquet 18808669 / 18679866 / +0.7% 81757104 / 81045048 / +0.9% 0.23 / 0.23 / -0.2%
clickbench_q03/datafusion:parquet 17301364 / 17636144 / -1.9% 82510108 / 78906984 / +4.6% 0.21 / 0.22 / -6.2%
clickbench_q04/datafusion:parquet 62418008 / 63147200 / -1.2% 127254471 / 123651426 / +2.9% 0.49 / 0.51 / -4.0%
clickbench_q05/datafusion:parquet 88453089 / 89173734 / -0.8% 159469749 / 155684349 / +2.4% 0.55 / 0.57 / -3.2%
clickbench_q06/datafusion:parquet 1259246 / 1267736 / -0.7% 51153742 / 49808656 / +2.7% 0.02 / 0.03 / -3.3%
clickbench_q07/datafusion:parquet 16827988 / 16815682 / +0.1% 70243239 / 68530680 / +2.5% 0.24 / 0.25 / -2.4%
clickbench_q08/datafusion:parquet 89294073 / 84420552 / +5.8% 170144783 / 159615748 / +6.6% 0.52 / 0.53 / -0.8%
clickbench_q09/datafusion:parquet 188503142 / 189340200 / -0.4% 267211305 / 270568486 / -1.2% 0.71 / 0.70 / +0.8%
clickbench_q10/datafusion:parquet 35687474 / 35838825 / -0.4% 103121066 / 101351871 / +1.7% 0.35 / 0.35 / -2.1%
clickbench_q11/datafusion:parquet 42548374 / 43388606 / -1.9% 112935498 / 110234963 / +2.4% 0.38 / 0.39 / -4.3%
clickbench_q12/datafusion:parquet 96067397 / 96400254 / -0.3% 165283419 / 164380304 / +0.5% 0.58 / 0.59 / -0.9%
clickbench_q13/datafusion:parquet 147794593 / 149050407 / -0.8% 226940505 / 229020286 / -0.9% 0.65 / 0.65 / +0.1%
clickbench_q14/datafusion:parquet 100995464 / 101751008 / -0.7% 173899510 / 173752765 / +0.1% 0.58 / 0.59 / -0.8%
clickbench_q15/datafusion:parquet 72022959 / 74751018 / -3.6% 133116908 / 132562825 / +0.4% 0.54 / 0.56 / -4.1%
clickbench_q16/datafusion:parquet 154804290 / 157130106 / -1.5% 237768039 / 235404102 / +1.0% 0.65 / 0.67 / -2.5%
clickbench_q17/datafusion:parquet 155286316 / 158408130 / -2.0% 239029813 / 232535206 / +2.8% 0.65 / 0.68 / -4.6%
clickbench_q18/datafusion:parquet 309766222 / 311659828 / -0.6% 423542692 / 428769037 / -1.2% 0.73 / 0.73 / +0.6%
clickbench_q19/datafusion:parquet 18983112 / 18808941 / +0.9% 80167427 / 76943382 / +4.2% 0.24 / 0.24 / -3.1%
clickbench_q20/datafusion:parquet 179221602 / 178190524 / +0.6% 297398440 / 283067790 / +5.1% 0.60 / 0.63 / -4.3%
clickbench_q21/datafusion:parquet 175134956 / 174542982 / +0.3% 313943220 / 303338278 / +3.5% 0.56 / 0.58 / -3.1%
clickbench_q22/datafusion:parquet 260478907 / 260781561 / -0.1% 460266203 / 433914101 / +6.1% 0.57 / 0.60 / -5.8%
clickbench_q23/datafusion:parquet 1002653380 / 1007396844 / -0.5% 1185789614 / 1196675958 / -0.9% 0.85 / 0.84 / +0.4%
clickbench_q24/datafusion:parquet 29656240 / 30726530 / -3.5% 94148360 / 88445505 / +6.4% 0.31 / 0.35 / -9.3%
clickbench_q25/datafusion:parquet 36561752 / 37097776 / -1.4% 105074326 / 103458997 / +1.6% 0.35 / 0.36 / -3.0%
clickbench_q26/datafusion:parquet 30029168 / 30667637 / -2.1% 91051068 / 89958756 / +1.2% 0.33 / 0.34 / -3.3%
clickbench_q27/datafusion:parquet 192023838 / 193541858 / -0.8% 299338119 / 294014301 / +1.8% 0.64 / 0.66 / -2.5%
clickbench_q28/datafusion:parquet 618084556 / 622381386 / -0.7% 714582047 / 709605194 / +0.7% 0.86 / 0.88 / -1.4%
clickbench_q29/datafusion:parquet 28440471 / 28382270 / +0.2% 92462924 / 89726118 / +3.1% 0.31 / 0.32 / -2.8%
clickbench_q30/datafusion:parquet 89531345 / 90292652 / -0.8% 179777322 / 173921114 / +3.4% 0.50 / 0.52 / -4.1%
clickbench_q31/datafusion:parquet 101467093 / 103509501 / -2.0% 206912191 / 200971596 / +3.0% 0.49 / 0.52 / -4.8%
clickbench_q32/datafusion:parquet 302972747 / 311115870 / -2.6% 437842138 / 428727602 / +2.1% 0.69 / 0.73 / -4.6%
clickbench_q33/datafusion:parquet 374146975 / 380048496 / -1.6% 475043551 / 479600127 / -1.0% 0.79 / 0.79 / -0.6%
clickbench_q34/datafusion:parquet 376988725 / 378557524 / -0.4% 473498031 / 477936899 / -0.9% 0.80 / 0.79 / +0.5%
clickbench_q35/datafusion:parquet 63434949 / 64249088 / -1.3% 124922080 / 123443405 / +1.2% 0.51 / 0.52 / -2.4%
clickbench_q36/datafusion:parquet 73512252 / 73977852 / -0.6% 135027632 / 136178878 / -0.8% 0.54 / 0.54 / +0.2%
clickbench_q37/datafusion:parquet 35762072 / 35633496 / +0.4% 92025184 / 91419997 / +0.7% 0.39 / 0.39 / -0.3%
clickbench_q38/datafusion:parquet 47483309 / 47903072 / -0.9% 107506047 / 108411604 / -0.8% 0.44 / 0.44 / -0.0%
clickbench_q39/datafusion:parquet 144637318 / 144526362 / +0.1% 210669835 / 212015185 / -0.6% 0.69 / 0.68 / +0.7%
clickbench_q40/datafusion:parquet 19793258 / 20349552 / -2.7% 77009791 / 77770096 / -1.0% 0.26 / 0.26 / -1.8%
clickbench_q41/datafusion:parquet 18717624 / 18824178 / -0.6% 75545188 / 74972994 / +0.8% 0.25 / 0.25 / -1.3%
clickbench_q42/datafusion:parquet 19135456 / 19068224 / +0.4% 75393106 / 75207188 / +0.2% 0.25 / 0.25 / +0.1%
duckdb / vortex-file-compressed / ns (0.981x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2201674 / 2239520 / -1.7% 27130606 / 25410828 / +6.8% 0.08 / 0.09 / -7.9%
clickbench_q01/duckdb:vortex-file-compressed 7268850 / 7612362 / -4.5% 27615024 / 27570446 / +0.2% 0.26 / 0.28 / -4.7%
clickbench_q02/duckdb:vortex-file-compressed 9194962 / 8955066 / +2.7% 36397833 / 35286118 / +3.2% 0.25 / 0.25 / -0.5%
clickbench_q03/duckdb:vortex-file-compressed 13991796 / 14248936 / -1.8% 52548881 / 52216942 / +0.6% 0.27 / 0.27 / -2.4%
clickbench_q04/duckdb:vortex-file-compressed 56034014 / 58104275 / -3.6% 91888012 / 92470080 / -0.6% 0.61 / 0.63 / -3.0%
clickbench_q05/duckdb:vortex-file-compressed 64159567 / 64657906 / -0.8% 95882177 / 95177701 / +0.7% 0.67 / 0.68 / -1.5%
clickbench_q06/duckdb:vortex-file-compressed 2607739 / 2703474 / -3.5% 29684765 / 31007170 / -4.3% 0.09 / 0.09 / +0.8%
clickbench_q07/duckdb:vortex-file-compressed 9176336 / 9579114 / -4.2% 31199176 / 31815161 / -1.9% 0.29 / 0.30 / -2.3%
clickbench_q08/duckdb:vortex-file-compressed 69916303 / 69709164 / +0.3% 105750060 / 106513332 / -0.7% 0.66 / 0.65 / +1.0%
clickbench_q09/duckdb:vortex-file-compressed 92261478 / 91790526 / +0.5% 126792976 / 128038059 / -1.0% 0.73 / 0.72 / +1.5%
clickbench_q10/duckdb:vortex-file-compressed 27194430 / 27449552 / -0.9% 72300365 / 70633742 / +2.4% 0.38 / 0.39 / -3.2%
clickbench_q11/duckdb:vortex-file-compressed 29504423 / 29742802 / -0.8% 76596289 / 74580099 / +2.7% 0.39 / 0.40 / -3.4%
clickbench_q12/duckdb:vortex-file-compressed 67951161 / 68314645 / -0.5% 101952960 / 101588585 / +0.4% 0.67 / 0.67 / -0.9%
clickbench_q13/duckdb:vortex-file-compressed 120803302 / 117681350 / +2.7% 167494854 / 167304335 / +0.1% 0.72 / 0.70 / +2.5%
clickbench_q14/duckdb:vortex-file-compressed 72296652 / 71707574 / +0.8% 103908473 / 104097981 / -0.2% 0.70 / 0.69 / +1.0%
clickbench_q15/duckdb:vortex-file-compressed 75510658 / 76256368 / -1.0% 110418880 / 109430960 / +0.9% 0.68 / 0.70 / -1.9%
clickbench_q16/duckdb:vortex-file-compressed 133392766 / 136865666 / -2.5% 171043169 / 173157180 / -1.2% 0.78 / 0.79 / -1.3%
clickbench_q17/duckdb:vortex-file-compressed 135582055 / 136309250 / -0.5% 172456715 / 167679771 / +2.8% 0.79 / 0.81 / -3.3%
clickbench_q18/duckdb:vortex-file-compressed 260445952 / 253680418 / +2.7% 300867822 / 304490936 / -1.2% 0.87 / 0.83 / +3.9%
clickbench_q19/duckdb:vortex-file-compressed 9486449 / 9195282 / +3.2% 42472224 / 41073291 / +3.4% 0.22 / 0.22 / -0.2%
clickbench_q20/duckdb:vortex-file-compressed 64404210 / 68396690 / -5.8% 163033275 / 175446093 / -7.1% 0.40 / 0.39 / +1.3%
clickbench_q21/duckdb:vortex-file-compressed 73298774 / 78139710 / -6.2% 210906014 / 193510866 / +9.0% 0.35 / 0.40 / -13.9%
clickbench_q22/duckdb:vortex-file-compressed 111639102 / 130674448 / -14.6% 🟢 327127382 / 331574805 / -1.3% 0.34 / 0.39 / -13.4%
clickbench_q23/duckdb:vortex-file-compressed 67981834 / 59653655 / +14.0% 🔴 177170605 / 184899542 / -4.2% 0.38 / 0.32 / +18.9%
clickbench_q24/duckdb:vortex-file-compressed 16255611 / 17394194 / -6.5% 40384091 / 48703041 / -17.1% 🟢 0.40 / 0.36 / +12.7%
clickbench_q25/duckdb:vortex-file-compressed 18033647 / 18446944 / -2.2% 53904744 / 54178597 / -0.5% 0.33 / 0.34 / -1.7%
clickbench_q26/duckdb:vortex-file-compressed 13118948 / 14287748 / -8.2% 47042821 / 49047912 / -4.1% 0.28 / 0.29 / -4.3%
clickbench_q27/duckdb:vortex-file-compressed 50864158 / 53905176 / -5.6% 187938450 / 177354906 / +6.0% 0.27 / 0.30 / -11.0%
clickbench_q28/duckdb:vortex-file-compressed 515427174 / 514093187 / +0.3% 562938724 / 559504615 / +0.6% 0.92 / 0.92 / -0.4%
clickbench_q29/duckdb:vortex-file-compressed 16903452 / 17208508 / -1.8% 40411993 / 42958313 / -5.9% 0.42 / 0.40 / +4.4%
clickbench_q30/duckdb:vortex-file-compressed 58560162 / 59435691 / -1.5% 110051253 / 108956696 / +1.0% 0.53 / 0.55 / -2.5%
clickbench_q31/duckdb:vortex-file-compressed 109103242 / 109401092 / -0.3% 201288440 / 174239306 / +15.5% 🔴 0.54 / 0.63 / -13.7%
clickbench_q32/duckdb:vortex-file-compressed 363584447 / 385910546 / -5.8% 389874071 / 410231765 / -5.0% 0.93 / 0.94 / -0.9%
clickbench_q33/duckdb:vortex-file-compressed 338508636 / 342599656 / -1.2% 393647805 / 396100171 / -0.6% 0.86 / 0.86 / -0.6%
clickbench_q34/duckdb:vortex-file-compressed 353845123 / 353396204 / +0.1% 417804244 / 412222797 / +1.4% 0.85 / 0.86 / -1.2%
clickbench_q35/duckdb:vortex-file-compressed 58058272 / 57161666 / +1.6% 91426255 / 88929172 / +2.8% 0.64 / 0.64 / -1.2%
clickbench_q36/duckdb:vortex-file-compressed 11086942 / 11640787 / -4.8% 33205642 / 33117280 / +0.3% 0.33 / 0.35 / -5.0%
clickbench_q37/duckdb:vortex-file-compressed 7462696 / 7579217 / -1.5% 28998838 / 29023829 / -0.1% 0.26 / 0.26 / -1.5%
clickbench_q38/duckdb:vortex-file-compressed 8378368 / 8249762 / +1.6% 29709396 / 27872473 / +6.6% 0.28 / 0.30 / -4.7%
clickbench_q39/duckdb:vortex-file-compressed 17384269 / 18512246 / -6.1% 43115812 / 39648155 / +8.7% 0.40 / 0.47 / -13.6%
clickbench_q40/duckdb:vortex-file-compressed 6642748 / 6788686 / -2.1% 29084310 / 29122522 / -0.1% 0.23 / 0.23 / -2.0%
clickbench_q41/duckdb:vortex-file-compressed 7512586 / 7935220 / -5.3% 30424478 / 31671742 / -3.9% 0.25 / 0.25 / -1.4%
clickbench_q42/duckdb:vortex-file-compressed 7014396 / 7022668 / -0.1% 29405515 / 27458837 / +7.1% 0.24 / 0.26 / -6.7%
duckdb / parquet / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9537266 / 9394832 / +1.5% 14896648 / 14721122 / +1.2% 0.64 / 0.64 / +0.3%
clickbench_q01/duckdb:parquet 15238571 / 15255306 / -0.1% 20172127 / 20612271 / -2.1% 0.76 / 0.74 / +2.1%
clickbench_q02/duckdb:parquet 21722552 / 23202924 / -6.4% 31372770 / 34409503 / -8.8% 0.69 / 0.67 / +2.7%
clickbench_q03/duckdb:parquet 22141711 / 22805660 / -2.9% 35282662 / 37416814 / -5.7% 0.63 / 0.61 / +3.0%
clickbench_q04/duckdb:parquet 61039888 / 62729622 / -2.7% 72617212 / 74237821 / -2.2% 0.84 / 0.84 / -0.5%
clickbench_q05/duckdb:parquet 83064502 / 82553121 / +0.6% 92975210 / 95555827 / -2.7% 0.89 / 0.86 / +3.4%
clickbench_q06/duckdb:parquet 20569306 / 20223452 / +1.7% 29602823 / 27478087 / +7.7% 0.69 / 0.74 / -5.6%
clickbench_q07/duckdb:parquet 17032836 / 17993160 / -5.3% 22996271 / 22337709 / +2.9% 0.74 / 0.81 / -8.0%
clickbench_q08/duckdb:parquet 73919803 / 75074766 / -1.5% 90973009 / 93024452 / -2.2% 0.81 / 0.81 / +0.7%
clickbench_q09/duckdb:parquet 102150240 / 103794619 / -1.6% 116509231 / 121917219 / -4.4% 0.88 / 0.85 / +3.0%
clickbench_q10/duckdb:parquet 40544538 / 41383818 / -2.0% 54981535 / 53619651 / +2.5% 0.74 / 0.77 / -4.5%
clickbench_q11/duckdb:parquet 46030718 / 46643339 / -1.3% 60833684 / 61615297 / -1.3% 0.76 / 0.76 / -0.0%
clickbench_q12/duckdb:parquet 90076600 / 93595602 / -3.8% 103852399 / 108115697 / -3.9% 0.87 / 0.87 / +0.2%
clickbench_q13/duckdb:parquet 149952600 / 148244281 / +1.2% 164114141 / 168231324 / -2.4% 0.91 / 0.88 / +3.7%
clickbench_q14/duckdb:parquet 99733164 / 101682435 / -1.9% 115883599 / 114164311 / +1.5% 0.86 / 0.89 / -3.4%
clickbench_q15/duckdb:parquet 85144448 / 85946628 / -0.9% 99102486 / 100644448 / -1.5% 0.86 / 0.85 / +0.6%
clickbench_q16/duckdb:parquet 158216018 / 165498386 / -4.4% 176521330 / 179975882 / -1.9% 0.90 / 0.92 / -2.5%
clickbench_q17/duckdb:parquet 163164745 / 171531960 / -4.9% 176391690 / 178665714 / -1.3% 0.93 / 0.96 / -3.7%
clickbench_q18/duckdb:parquet 292267311 / 291016272 / +0.4% 315313468 / 315607081 / -0.1% 0.93 / 0.92 / +0.5%
clickbench_q19/duckdb:parquet 19721704 / 19859715 / -0.7% 26933367 / 25786255 / +4.4% 0.73 / 0.77 / -4.9%
clickbench_q20/duckdb:parquet 189182966 / 180420120 / +4.9% 232045090 / 232480084 / -0.2% 0.82 / 0.78 / +5.1%
clickbench_q21/duckdb:parquet 219359797 / 218477350 / +0.4% 270505899 / 262983512 / +2.9% 0.81 / 0.83 / -2.4%
clickbench_q22/duckdb:parquet 309092504 / 304926990 / +1.4% 353064591 / 357379579 / -1.2% 0.88 / 0.85 / +2.6%
clickbench_q23/duckdb:parquet 174032014 / 171775762 / +1.3% 238235535 / 253121056 / -5.9% 0.73 / 0.68 / +7.6%
clickbench_q24/duckdb:parquet 29974144 / 29958716 / +0.1% 42962247 / 42482462 / +1.1% 0.70 / 0.71 / -1.1%
clickbench_q25/duckdb:parquet 41649508 / 42463750 / -1.9% 62083210 / 60982131 / +1.8% 0.67 / 0.70 / -3.7%
clickbench_q26/duckdb:parquet 30477326 / 32739711 / -6.9% 49831554 / 47017556 / +6.0% 0.61 / 0.70 / -12.2%
clickbench_q27/duckdb:parquet 186739350 / 191541398 / -2.5% 226634914 / 230295986 / -1.6% 0.82 / 0.83 / -0.9%
clickbench_q28/duckdb:parquet 945880636 / 950006560 / -0.4% 935042100 / 983079731 / -4.9% 1.01 / 0.97 / +4.7%
clickbench_q29/duckdb:parquet 24229752 / 24317362 / -0.4% 31976957 / 30925214 / +3.4% 0.76 / 0.79 / -3.6%
clickbench_q30/duckdb:parquet 104352610 / 104622488 / -0.3% 122536919 / 129419189 / -5.3% 0.85 / 0.81 / +5.3%
clickbench_q31/duckdb:parquet 143141956 / 160480217 / -10.8% 🟢 172883318 / 174417616 / -0.9% 0.83 / 0.92 / -10.0%
clickbench_q32/duckdb:parquet 387476375 / 385925739 / +0.4% 434278387 / 407659843 / +6.5% 0.89 / 0.95 / -5.8%
clickbench_q33/duckdb:parquet 466729239 / 468922366 / -0.5% 436151594 / 442695781 / -1.5% 1.07 / 1.06 / +1.0%
clickbench_q34/duckdb:parquet 460421640 / 462238432 / -0.4% 448009265 / 447629696 / +0.1% 1.03 / 1.03 / -0.5%
clickbench_q35/duckdb:parquet 60447608 / 61543474 / -1.8% 75697647 / 77479685 / -2.3% 0.80 / 0.79 / +0.5%
clickbench_q36/duckdb:parquet 29981011 / 30172014 / -0.6% 36125795 / 36925558 / -2.2% 0.83 / 0.82 / +1.6%
clickbench_q37/duckdb:parquet 23837796 / 23204022 / +2.7% 29413115 / 30425350 / -3.3% 0.81 / 0.76 / +6.3%
clickbench_q38/duckdb:parquet 23230485 / 23431136 / -0.9% 30093644 / 30912378 / -2.6% 0.77 / 0.76 / +1.8%
clickbench_q39/duckdb:parquet 52183264 / 52956229 / -1.5% 58753878 / 60047399 / -2.2% 0.89 / 0.88 / +0.7%
clickbench_q40/duckdb:parquet 14924168 / 14924840 / -0.0% 19857542 / 20066747 / -1.0% 0.75 / 0.74 / +1.0%
clickbench_q41/duckdb:parquet 15521426 / 15331596 / +1.2% 20544895 / 23069987 / -10.9% 🟢 0.76 / 0.66 / +13.7%
clickbench_q42/duckdb:parquet 14154432 / 14130908 / +0.2% 21345743 / 20120985 / +6.1% 0.66 / 0.70 / -5.6%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 1d56e333 vs base b2f8d0f9
Vortex (geomean): hot 1.024x ➖ · cold 0.940x ➖


datafusion / vortex-file-compressed / ns (1.024x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44182614 / 44247398 / -0.1% 85100660 / 86756764 / -1.9% 0.52 / 0.51 / +1.8%
polarsignals_q01/datafusion:vortex-file-compressed 72361732 / 53190033 / +36.0% 🔴 110483884 / 111620562 / -1.0% 0.65 / 0.48 / +37.4%
polarsignals_q02/datafusion:vortex-file-compressed 11970954 / 14308001 / -16.3% 🟢 43657750 / 50938846 / -14.3% 🟢 0.27 / 0.28 / -2.4%
polarsignals_q03/datafusion:vortex-file-compressed 54857980 / 69231543 / -20.8% 🟢 113918691 / 116022576 / -1.8% 0.48 / 0.60 / -19.3%
polarsignals_q04/datafusion:vortex-file-compressed 9281504 / 9324230 / -0.5% 41183168 / 43390473 / -5.1% 0.23 / 0.21 / +4.9%
polarsignals_q05/datafusion:vortex-file-compressed 11507948 / 11645938 / -1.2% 43283287 / 46740242 / -7.4% 0.27 / 0.25 / +6.7%
polarsignals_q06/datafusion:vortex-file-compressed 22854798 / 22759316 / +0.4% 53016458 / 56616878 / -6.4% 0.43 / 0.40 / +7.2%
polarsignals_q07/datafusion:vortex-file-compressed 10788942 / 10826504 / -0.3% 38841434 / 45422058 / -14.5% 🟢 0.28 / 0.24 / +16.5%
polarsignals_q08/datafusion:vortex-file-compressed 108072878 / 96763190 / +11.7% 🔴 158999228 / 161828007 / -1.7% 0.68 / 0.60 / +13.7%
polarsignals_q09/datafusion:vortex-file-compressed 10312848 / 9924556 / +3.9% 37435438 / 41195204 / -9.1% 0.28 / 0.24 / +14.3%
polarsignals_q10/datafusion:vortex-file-compressed 70180796 / 55401320 / +26.7% 🔴 115182928 / 116674031 / -1.3% 0.61 / 0.47 / +28.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 1d56e333 vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.9%
Engines: DataFusion No clear signal (+12.0%, environment too noisy confidence) · DuckDB No clear signal (-3.7%, environment too noisy confidence)
Vortex (geomean): hot 1.064x ➖ · cold 1.019x ➖
Parquet (geomean): hot 1.025x ➖ · cold 1.056x ➖
Shifts: Parquet (control) +2.5% · Median polish +2.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.146x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 214389400 / 213717821 / +0.3% 846309665 / 764398977 / +10.7% 0.25 / 0.28 / -9.4%
tpch_q02/datafusion:vortex-file-compressed 344764000 / 320984758 / +7.4% 630480951 / 553448858 / +13.9% 0.55 / 0.58 / -5.7%
tpch_q03/datafusion:vortex-file-compressed 330417727 / 310450262 / +6.4% 859718620 / 854530904 / +0.6% 0.38 / 0.36 / +5.8%
tpch_q04/datafusion:vortex-file-compressed 189763014 / 159007585 / +19.3% 462274842 / 372572808 / +24.1% 0.41 / 0.43 / -3.8%
tpch_q05/datafusion:vortex-file-compressed 375787568 / 344078558 / +9.2% 583731797 / 546047746 / +6.9% 0.64 / 0.63 / +2.2%
tpch_q06/datafusion:vortex-file-compressed 164094740 / 123668516 / +32.7% 🔴 326586631 / 317073449 / +3.0% 0.50 / 0.39 / +28.8%
tpch_q07/datafusion:vortex-file-compressed 433552887 / 426177142 / +1.7% 579373990 / 586012416 / -1.1% 0.75 / 0.73 / +2.9%
tpch_q08/datafusion:vortex-file-compressed 425017163 / 410714646 / +3.5% 612281107 / 541459260 / +13.1% 0.69 / 0.76 / -8.5%
tpch_q09/datafusion:vortex-file-compressed 405932555 / 301899395 / +34.5% 🔴 652144119 / 455403137 / +43.2% 🔴 0.62 / 0.66 / -6.1%
tpch_q10/datafusion:vortex-file-compressed 362220863 / 361036359 / +0.3% 539034904 / 525406226 / +2.6% 0.67 / 0.69 / -2.2%
tpch_q11/datafusion:vortex-file-compressed 289391061 / 272228443 / +6.3% 465818370 / 382260665 / +21.9% 0.62 / 0.71 / -12.8%
tpch_q12/datafusion:vortex-file-compressed 211597940 / 203460731 / +4.0% 391162611 / 338106908 / +15.7% 0.54 / 0.60 / -10.1%
tpch_q13/datafusion:vortex-file-compressed 241180490 / 116217877 / +107.5% 🔴 370868531 / 309114444 / +20.0% 0.65 / 0.38 / +73.0%
tpch_q14/datafusion:vortex-file-compressed 176576232 / 181074526 / -2.5% 340771707 / 354128334 / -3.8% 0.52 / 0.51 / +1.3%
tpch_q15/datafusion:vortex-file-compressed 298729974 / 306125584 / -2.4% 551481868 / 727209626 / -24.2% 0.54 / 0.42 / +28.7%
tpch_q16/datafusion:vortex-file-compressed 137608135 / 134848492 / +2.0% 276927563 / 285978767 / -3.2% 0.50 / 0.47 / +5.4%
tpch_q17/datafusion:vortex-file-compressed 468826094 / 252865916 / +85.4% 🔴 545436347 / 494400127 / +10.3% 0.86 / 0.51 / +68.1%
tpch_q18/datafusion:vortex-file-compressed 290300087 / 222278514 / +30.6% 🔴 493563393 / 389005809 / +26.9% 0.59 / 0.57 / +2.9%
tpch_q19/datafusion:vortex-file-compressed 225167110 / 226209017 / -0.5% 372665155 / 296515885 / +25.7% 0.60 / 0.76 / -20.8%
tpch_q20/datafusion:vortex-file-compressed 260628968 / 248686849 / +4.8% 439933398 / 477297666 / -7.8% 0.59 / 0.52 / +13.7%
tpch_q21/datafusion:vortex-file-compressed 445838666 / 384422617 / +16.0% 632563962 / 739838656 / -14.5% 0.70 / 0.52 / +35.6%
tpch_q22/datafusion:vortex-file-compressed 161739139 / 147475449 / +9.7% 348460503 / 337385924 / +3.3% 0.46 / 0.44 / +6.2%
datafusion / parquet / ns (1.023x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 164516417 / 143033960 / +15.0% 507998147 / 425422516 / +19.4% 0.32 / 0.34 / -3.7%
tpch_q02/datafusion:parquet 288722665 / 274389077 / +5.2% 483853355 / 421418541 / +14.8% 0.60 / 0.65 / -8.4%
tpch_q03/datafusion:parquet 224060183 / 240153039 / -6.7% 673725980 / 656104536 / +2.7% 0.33 / 0.37 / -9.1%
tpch_q04/datafusion:parquet 131006301 / 129091170 / +1.5% 330222624 / 262434371 / +25.8% 0.40 / 0.49 / -19.3%
tpch_q05/datafusion:parquet 332681313 / 325560808 / +2.2% 522908549 / 708712744 / -26.2% 0.64 / 0.46 / +38.5%
tpch_q06/datafusion:parquet 104736234 / 104623731 / +0.1% 243793818 / 202039421 / +20.7% 0.43 / 0.52 / -17.0%
tpch_q07/datafusion:parquet 329967318 / 326115720 / +1.2% 486917759 / 439408571 / +10.8% 0.68 / 0.74 / -8.7%
tpch_q08/datafusion:parquet 390461545 / 383031456 / +1.9% 501452759 / 487777150 / +2.8% 0.78 / 0.79 / -0.8%
tpch_q09/datafusion:parquet 394814118 / 507741508 / -22.2% 522946604 / 948722124 / -44.9% 🟢 0.75 / 0.54 / +41.1%
tpch_q10/datafusion:parquet 369437012 / 318225993 / +16.1% 464641801 / 431490793 / +7.7% 0.80 / 0.74 / +7.8%
tpch_q11/datafusion:parquet 276129214 / 245309101 / +12.6% 360209924 / 324804219 / +10.9% 0.77 / 0.76 / +1.5%
tpch_q12/datafusion:parquet 166582290 / 160703746 / +3.7% 433028365 / 262477140 / +65.0% 🔴 0.38 / 0.61 / -37.2%
tpch_q13/datafusion:parquet 273564996 / 274764633 / -0.4% 520896959 / 387802001 / +34.3% 🔴 0.53 / 0.71 / -25.9%
tpch_q14/datafusion:parquet 149956727 / 141590102 / +5.9% 272948401 / 264823133 / +3.1% 0.55 / 0.53 / +2.8%
tpch_q15/datafusion:parquet 299276744 / 297935495 / +0.5% 433442965 / 444599102 / -2.5% 0.69 / 0.67 / +3.0%
tpch_q16/datafusion:parquet 102847107 / 96864793 / +6.2% 191445575 / 207092637 / -7.6% 0.54 / 0.47 / +14.9%
tpch_q17/datafusion:parquet 263180069 / 268630342 / -2.0% 436376796 / 416939497 / +4.7% 0.60 / 0.64 / -6.4%
tpch_q18/datafusion:parquet 303963096 / 305302634 / -0.4% 435465125 / 465639400 / -6.5% 0.70 / 0.66 / +6.5%
tpch_q19/datafusion:parquet 166761621 / 149310744 / +11.7% 265345741 / 274137368 / -3.2% 0.63 / 0.54 / +15.4%
tpch_q20/datafusion:parquet 233228657 / 228071243 / +2.3% 415677387 / 424446687 / -2.1% 0.56 / 0.54 / +4.4%
tpch_q21/datafusion:parquet 292494561 / 291483866 / +0.3% 526815283 / 469762099 / +12.1% 0.56 / 0.62 / -10.5%
tpch_q22/datafusion:parquet 150894140 / 145366900 / +3.8% 324563779 / 299750221 / +8.3% 0.46 / 0.48 / -4.1%
duckdb / vortex-file-compressed / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 258152167 / 237695207 / +8.6% 260482242 / 298096331 / -12.6% 0.99 / 0.80 / +24.3%
tpch_q02/duckdb:vortex-file-compressed 398645857 / 394665672 / +1.0% 485981632 / 474795024 / +2.4% 0.82 / 0.83 / -1.3%
tpch_q03/duckdb:vortex-file-compressed 389379865 / 398939371 / -2.4% 440688796 / 460688509 / -4.3% 0.88 / 0.87 / +2.0%
tpch_q04/duckdb:vortex-file-compressed 266023144 / 255227345 / +4.2% 428178163 / 296337544 / +44.5% 🔴 0.62 / 0.86 / -27.9%
tpch_q05/duckdb:vortex-file-compressed 755506450 / 709957932 / +6.4% 565002275 / 785337665 / -28.1% 1.34 / 0.90 / +47.9%
tpch_q06/duckdb:vortex-file-compressed 175603248 / 148777224 / +18.0% 263809697 / 208058114 / +26.8% 0.67 / 0.72 / -6.9%
tpch_q07/duckdb:vortex-file-compressed 394961530 / 387859027 / +1.8% 397486647 / 510621725 / -22.2% 0.99 / 0.76 / +30.8%
tpch_q08/duckdb:vortex-file-compressed 608231611 / 617848086 / -1.6% 628362844 / 732855328 / -14.3% 0.97 / 0.84 / +14.8%
tpch_q09/duckdb:vortex-file-compressed 379959385 / 392528875 / -3.2% 437659796 / 482201706 / -9.2% 0.87 / 0.81 / +6.6%
tpch_q10/duckdb:vortex-file-compressed 525186089 / 526138612 / -0.2% 619866684 / 576801469 / +7.5% 0.85 / 0.91 / -7.1%
tpch_q11/duckdb:vortex-file-compressed 281180065 / 288496302 / -2.5% 291738410 / 270775100 / +7.7% 0.96 / 1.07 / -9.5%
tpch_q12/duckdb:vortex-file-compressed 224240410 / 271105721 / -17.3% 425745103 / 407392913 / +4.5% 0.53 / 0.67 / -20.9%
tpch_q13/duckdb:vortex-file-compressed 255549217 / 247871881 / +3.1% 297416542 / 208806747 / +42.4% 🔴 0.86 / 1.19 / -27.6%
tpch_q14/duckdb:vortex-file-compressed 222007375 / 224785869 / -1.2% 304912978 / 273953898 / +11.3% 0.73 / 0.82 / -11.3%
tpch_q15/duckdb:vortex-file-compressed 241095548 / 237917836 / +1.3% 279350819 / 453417020 / -38.4% 🟢 0.86 / 0.52 / +64.5%
tpch_q16/duckdb:vortex-file-compressed 187537345 / 206543544 / -9.2% 230717109 / 287344280 / -19.7% 0.81 / 0.72 / +13.1%
tpch_q17/duckdb:vortex-file-compressed 402694522 / 454602893 / -11.4% 386046795 / 443734007 / -13.0% 1.04 / 1.02 / +1.8%
tpch_q18/duckdb:vortex-file-compressed 346691883 / 339736454 / +2.0% 379270500 / 418339259 / -9.3% 0.91 / 0.81 / +12.6%
tpch_q19/duckdb:vortex-file-compressed 275316582 / 320978677 / -14.2% 304494456 / 349847295 / -13.0% 0.90 / 0.92 / -1.5%
tpch_q20/duckdb:vortex-file-compressed 331518171 / 334782469 / -1.0% 431012183 / 412936083 / +4.4% 0.77 / 0.81 / -5.1%
tpch_q21/duckdb:vortex-file-compressed 552985449 / 558602915 / -1.0% 588613283 / 630439819 / -6.6% 0.94 / 0.89 / +6.0%
tpch_q22/duckdb:vortex-file-compressed 249558947 / 253794094 / -1.7% 288742443 / 269551763 / +7.1% 0.86 / 0.94 / -8.2%
duckdb / parquet / ns (1.026x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 203639646 / 178327142 / +14.2% 239500635 / 188180852 / +27.3% 0.85 / 0.95 / -10.3%
tpch_q02/duckdb:parquet 448035331 / 428571834 / +4.5% 466265583 / 421258354 / +10.7% 0.96 / 1.02 / -5.5%
tpch_q03/duckdb:parquet 329728559 / 384797319 / -14.3% 462513375 / 402689855 / +14.9% 0.71 / 0.96 / -25.4%
tpch_q04/duckdb:parquet 262964991 / 278868438 / -5.7% 290185330 / 290411092 / -0.1% 0.91 / 0.96 / -5.6%
tpch_q05/duckdb:parquet 490628347 / 512960026 / -4.4% 1013412283 / 589908823 / +71.8% 🔴 0.48 / 0.87 / -44.3%
tpch_q06/duckdb:parquet 166523696 / 154774655 / +7.6% 173951088 / 188086085 / -7.5% 0.96 / 0.82 / +16.3%
tpch_q07/duckdb:parquet 431463587 / 419672939 / +2.8% 483087765 / 421853390 / +14.5% 0.89 / 0.99 / -10.2%
tpch_q08/duckdb:parquet 588771270 / 588960652 / -0.0% 679638352 / 658661231 / +3.2% 0.87 / 0.89 / -3.1%
tpch_q09/duckdb:parquet 576294921 / 557378838 / +3.4% 566270586 / 656390425 / -13.7% 1.02 / 0.85 / +19.8%
tpch_q10/duckdb:parquet 538459785 / 517349035 / +4.1% 652439930 / 581884894 / +12.1% 0.83 / 0.89 / -7.2%
tpch_q11/duckdb:parquet 276375174 / 279247336 / -1.0% 259256533 / 301469405 / -14.0% 1.07 / 0.93 / +15.1%
tpch_q12/duckdb:parquet 255117693 / 244321025 / +4.4% 287603895 / 281145014 / +2.3% 0.89 / 0.87 / +2.1%
tpch_q13/duckdb:parquet 414698878 / 382703043 / +8.4% 522161016 / 463219570 / +12.7% 0.79 / 0.83 / -3.9%
tpch_q14/duckdb:parquet 262580786 / 255047143 / +3.0% 289961687 / 301222259 / -3.7% 0.91 / 0.85 / +7.0%
tpch_q15/duckdb:parquet 204195464 / 191438501 / +6.7% 249688051 / 220554518 / +13.2% 0.82 / 0.87 / -5.8%
tpch_q16/duckdb:parquet 269748560 / 287313946 / -6.1% 309432722 / 301984087 / +2.5% 0.87 / 0.95 / -8.4%
tpch_q17/duckdb:parquet 267006172 / 258007938 / +3.5% 317081113 / 314199718 / +0.9% 0.84 / 0.82 / +2.5%
tpch_q18/duckdb:parquet 354611087 / 306425002 / +15.7% 364217066 / 355418381 / +2.5% 0.97 / 0.86 / +12.9%
tpch_q19/duckdb:parquet 271382293 / 241485587 / +12.4% 268151872 / 285468394 / -6.1% 1.01 / 0.85 / +19.6%
tpch_q20/duckdb:parquet 434090289 / 432599380 / +0.3% 527312517 / 540117093 / -2.4% 0.82 / 0.80 / +2.8%
tpch_q21/duckdb:parquet 426612172 / 417617294 / +2.2% 469133506 / 463876894 / +1.1% 0.91 / 0.90 / +1.0%
tpch_q22/duckdb:parquet 287839585 / 287438341 / +0.1% 321937146 / 253402369 / +27.0% 0.89 / 1.13 / -21.2%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 1d56e333 vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35379297 / 35836658 / -1.3% 62262424 / 59839649 / +4.0% 0.57 / 0.60 / -5.1%
tpcds_q02/datafusion:vortex-file-compressed 51309559 / 51540980 / -0.4% 76459944 / 75356430 / +1.5% 0.67 / 0.68 / -1.9%
tpcds_q03/datafusion:vortex-file-compressed 19831914 / 20246396 / -2.0% 46195965 / 46166223 / +0.1% 0.43 / 0.44 / -2.1%
tpcds_q04/datafusion:vortex-file-compressed 293126112 / 293432920 / -0.1% 357985019 / 354050198 / +1.1% 0.82 / 0.83 / -1.2%
tpcds_q05/datafusion:vortex-file-compressed 72666788 / 71656747 / +1.4% 103802481 / 107692212 / -3.6% 0.70 / 0.67 / +5.2%
tpcds_q06/datafusion:vortex-file-compressed 42645460 / 42258217 / +0.9% 74499394 / 70535607 / +5.6% 0.57 / 0.60 / -4.5%
tpcds_q07/datafusion:vortex-file-compressed 42029734 / 42156216 / -0.3% 81314488 / 80613054 / +0.9% 0.52 / 0.52 / -1.2%
tpcds_q08/datafusion:vortex-file-compressed 28824978 / 28614063 / +0.7% 57435036 / 57730721 / -0.5% 0.50 / 0.50 / +1.3%
tpcds_q09/datafusion:vortex-file-compressed 43642432 / 44012164 / -0.8% 73826735 / 77101674 / -4.2% 0.59 / 0.57 / +3.6%
tpcds_q10/datafusion:vortex-file-compressed 37042211 / 37189576 / -0.4% 64186412 / 63021635 / +1.8% 0.58 / 0.59 / -2.2%
tpcds_q11/datafusion:vortex-file-compressed 175083288 / 174495550 / +0.3% 216176635 / 221987691 / -2.6% 0.81 / 0.79 / +3.0%
tpcds_q12/datafusion:vortex-file-compressed 17879944 / 17549844 / +1.9% 37240712 / 38571171 / -3.4% 0.48 / 0.45 / +5.5%
tpcds_q13/datafusion:vortex-file-compressed 39368488 / 38899632 / +1.2% 80188314 / 85520203 / -6.2% 0.49 / 0.45 / +7.9%
tpcds_q14/datafusion:vortex-file-compressed 234029790 / 231725092 / +1.0% 271301393 / 271215982 / +0.0% 0.86 / 0.85 / +1.0%
tpcds_q15/datafusion:vortex-file-compressed 39922274 / 40095029 / -0.4% 61339008 / 54164984 / +13.2% 🔴 0.65 / 0.74 / -12.1%
tpcds_q16/datafusion:vortex-file-compressed 23418538 / 22869641 / +2.4% 41622289 / 42034772 / -1.0% 0.56 / 0.54 / +3.4%
tpcds_q17/datafusion:vortex-file-compressed 64546410 / 64808376 / -0.4% 90102723 / 89558176 / +0.6% 0.72 / 0.72 / -1.0%
tpcds_q18/datafusion:vortex-file-compressed 69296247 / 69097730 / +0.3% 94933467 / 94787906 / +0.2% 0.73 / 0.73 / +0.1%
tpcds_q19/datafusion:vortex-file-compressed 23211326 / 22408799 / +3.6% 53607916 / 55496169 / -3.4% 0.43 / 0.40 / +7.2%
tpcds_q20/datafusion:vortex-file-compressed 23871040 / 23702741 / +0.7% 40616948 / 40220803 / +1.0% 0.59 / 0.59 / -0.3%
tpcds_q21/datafusion:vortex-file-compressed 48166578 / 47542674 / +1.3% 71973892 / 64058585 / +12.4% 🔴 0.67 / 0.74 / -9.8%
tpcds_q22/datafusion:vortex-file-compressed 440557462 / 431366016 / +2.1% 456479868 / 465284097 / -1.9% 0.97 / 0.93 / +4.1%
tpcds_q23/datafusion:vortex-file-compressed 291541432 / 299587271 / -2.7% 355050065 / 351318540 / +1.1% 0.82 / 0.85 / -3.7%
tpcds_q24/datafusion:vortex-file-compressed 121005450 / 120023524 / +0.8% 160035774 / 159982078 / +0.0% 0.76 / 0.75 / +0.8%
tpcds_q25/datafusion:vortex-file-compressed 63335079 / 63311010 / +0.0% 101808154 / 102454935 / -0.6% 0.62 / 0.62 / +0.7%
tpcds_q26/datafusion:vortex-file-compressed 37512856 / 37429288 / +0.2% 59985816 / 59331611 / +1.1% 0.63 / 0.63 / -0.9%
tpcds_q27/datafusion:vortex-file-compressed 71085830 / 72377160 / -1.8% 105359494 / 104225546 / +1.1% 0.67 / 0.69 / -2.8%
tpcds_q28/datafusion:vortex-file-compressed 43615186 / 42296916 / +3.1% 101450835 / 82755038 / +22.6% 🔴 0.43 / 0.51 / -15.9%
tpcds_q29/datafusion:vortex-file-compressed 59162802 / 61922299 / -4.5% 101799970 / 97201813 / +4.7% 0.58 / 0.64 / -8.8%
tpcds_q30/datafusion:vortex-file-compressed 52391546 / 51311054 / +2.1% 80290246 / 79114003 / +1.5% 0.65 / 0.65 / +0.6%
tpcds_q31/datafusion:vortex-file-compressed 199189746 / 196557266 / +1.3% 238652060 / 235875877 / +1.2% 0.83 / 0.83 / +0.2%
tpcds_q32/datafusion:vortex-file-compressed 15234890 / 15236954 / -0.0% 30889767 / 31554300 / -2.1% 0.49 / 0.48 / +2.1%
tpcds_q33/datafusion:vortex-file-compressed 32634355 / 33321710 / -2.1% 71875212 / 67027574 / +7.2% 0.45 / 0.50 / -8.7%
tpcds_q34/datafusion:vortex-file-compressed 40087342 / 41148345 / -2.6% 68671294 / 68234625 / +0.6% 0.58 / 0.60 / -3.2%
tpcds_q35/datafusion:vortex-file-compressed 91896707 / 92443260 / -0.6% 122472282 / 120652799 / +1.5% 0.75 / 0.77 / -2.1%
tpcds_q36/datafusion:vortex-file-compressed 67182146 / 65946206 / +1.9% 100638302 / 100250170 / +0.4% 0.67 / 0.66 / +1.5%
tpcds_q37/datafusion:vortex-file-compressed 23877624 / 23553139 / +1.4% 41254295 / 43598667 / -5.4% 0.58 / 0.54 / +7.1%
tpcds_q38/datafusion:vortex-file-compressed 78114598 / 76507711 / +2.1% 108498055 / 106221269 / +2.1% 0.72 / 0.72 / -0.0%
tpcds_q39/datafusion:vortex-file-compressed 888141958 / 887680404 / +0.1% 901924696 / 906829393 / -0.5% 0.98 / 0.98 / +0.6%
tpcds_q40/datafusion:vortex-file-compressed 28781182 / 28735451 / +0.2% 49226769 / 47789817 / +3.0% 0.58 / 0.60 / -2.8%
tpcds_q41/datafusion:vortex-file-compressed 19316758 / 19056672 / +1.4% 31857458 / 30560191 / +4.2% 0.61 / 0.62 / -2.8%
tpcds_q42/datafusion:vortex-file-compressed 14159412 / 14306364 / -1.0% 39548080 / 39330916 / +0.6% 0.36 / 0.36 / -1.6%
tpcds_q43/datafusion:vortex-file-compressed 17564448 / 17123520 / +2.6% 39402464 / 40887604 / -3.6% 0.45 / 0.42 / +6.4%
tpcds_q44/datafusion:vortex-file-compressed 43120530 / 42841783 / +0.7% 76666593 / 73034215 / +5.0% 0.56 / 0.59 / -4.1%
tpcds_q45/datafusion:vortex-file-compressed 43021855 / 42716522 / +0.7% 59638844 / 64325351 / -7.3% 0.72 / 0.66 / +8.6%
tpcds_q46/datafusion:vortex-file-compressed 71275676 / 70770951 / +0.7% 103278400 / 103002911 / +0.3% 0.69 / 0.69 / +0.4%
tpcds_q47/datafusion:vortex-file-compressed 174058194 / 176930862 / -1.6% 221323854 / 217533458 / +1.7% 0.79 / 0.81 / -3.3%
tpcds_q48/datafusion:vortex-file-compressed 36475600 / 35477019 / +2.8% 69498517 / 70167195 / -1.0% 0.52 / 0.51 / +3.8%
tpcds_q49/datafusion:vortex-file-compressed 80357854 / 79901468 / +0.6% 118897230 / 120233831 / -1.1% 0.68 / 0.66 / +1.7%
tpcds_q50/datafusion:vortex-file-compressed 56668376 / 56310110 / +0.6% 89394230 / 89046429 / +0.4% 0.63 / 0.63 / +0.2%
tpcds_q51/datafusion:vortex-file-compressed 242729507 / 241461239 / +0.5% 279343269 / 280306123 / -0.3% 0.87 / 0.86 / +0.9%
tpcds_q52/datafusion:vortex-file-compressed 14855779 / 14942948 / -0.6% 38776277 / 41146983 / -5.8% 0.38 / 0.36 / +5.5%
tpcds_q53/datafusion:vortex-file-compressed 23146450 / 23025893 / +0.5% 50572029 / 52394142 / -3.5% 0.46 / 0.44 / +4.1%
tpcds_q54/datafusion:vortex-file-compressed 59333981 / 59630808 / -0.5% 91582697 / 92798502 / -1.3% 0.65 / 0.64 / +0.8%
tpcds_q55/datafusion:vortex-file-compressed 14535758 / 15209610 / -4.4% 39254124 / 39200802 / +0.1% 0.37 / 0.39 / -4.6%
tpcds_q56/datafusion:vortex-file-compressed 33173189 / 34211642 / -3.0% 62966026 / 63579406 / -1.0% 0.53 / 0.54 / -2.1%
tpcds_q57/datafusion:vortex-file-compressed 132353836 / 130827096 / +1.2% 160719236 / 162474233 / -1.1% 0.82 / 0.81 / +2.3%
tpcds_q58/datafusion:vortex-file-compressed 48673830 / 49071762 / -0.8% 87519021 / 84738612 / +3.3% 0.56 / 0.58 / -4.0%
tpcds_q59/datafusion:vortex-file-compressed 54700910 / 54936949 / -0.4% 81028653 / 85696270 / -5.4% 0.68 / 0.64 / +5.3%
tpcds_q60/datafusion:vortex-file-compressed 34439383 / 34485962 / -0.1% 65386983 / 66114270 / -1.1% 0.53 / 0.52 / +1.0%
tpcds_q61/datafusion:vortex-file-compressed 46163278 / 45202724 / +2.1% 72613706 / 70916447 / +2.4% 0.64 / 0.64 / -0.3%
tpcds_q62/datafusion:vortex-file-compressed 19188212 / 19841460 / -3.3% 42373133 / 43084349 / -1.7% 0.45 / 0.46 / -1.7%
tpcds_q63/datafusion:vortex-file-compressed 22532338 / 22619521 / -0.4% 50868796 / 49716174 / +2.3% 0.44 / 0.45 / -2.6%
tpcds_q64/datafusion:vortex-file-compressed 333319300 / 332776120 / +0.2% 404951416 / 399340320 / +1.4% 0.82 / 0.83 / -1.2%
tpcds_q65/datafusion:vortex-file-compressed 74344176 / 73751860 / +0.8% 110426852 / 110569158 / -0.1% 0.67 / 0.67 / +0.9%
tpcds_q66/datafusion:vortex-file-compressed 52955732 / 52486634 / +0.9% 79322133 / 77837826 / +1.9% 0.67 / 0.67 / -1.0%
tpcds_q67/datafusion:vortex-file-compressed 418387138 / 420503111 / -0.5% 521213006 / 528828691 / -1.4% 0.80 / 0.80 / +1.0%
tpcds_q68/datafusion:vortex-file-compressed 66054876 / 66831493 / -1.2% 101832877 / 99391180 / +2.5% 0.65 / 0.67 / -3.5%
tpcds_q69/datafusion:vortex-file-compressed 37132490 / 36278824 / +2.4% 64750215 / 63625322 / +1.8% 0.57 / 0.57 / +0.6%
tpcds_q70/datafusion:vortex-file-compressed 195204345 / 194497137 / +0.4% 230263527 / 232217411 / -0.8% 0.85 / 0.84 / +1.2%
tpcds_q71/datafusion:vortex-file-compressed 25347226 / 25424784 / -0.3% 57710606 / 61267492 / -5.8% 0.44 / 0.41 / +5.8%
tpcds_q72/datafusion:vortex-file-compressed 1576106317 / 1575229677 / +0.1% 1871250041 / 1696144047 / +10.3% 🔴 0.84 / 0.93 / -9.3%
tpcds_q73/datafusion:vortex-file-compressed 37997240 / 38589712 / -1.5% 64027239 / 62969996 / +1.7% 0.59 / 0.61 / -3.2%
tpcds_q74/datafusion:vortex-file-compressed 133822253 / 134601274 / -0.6% 172810991 / 173765353 / -0.5% 0.77 / 0.77 / -0.0%
tpcds_q75/datafusion:vortex-file-compressed 155500432 / 155633299 / -0.1% 197661867 / 198511793 / -0.4% 0.79 / 0.78 / +0.3%
tpcds_q76/datafusion:vortex-file-compressed 34100392 / 34722660 / -1.8% 73275292 / 73189101 / +0.1% 0.47 / 0.47 / -1.9%
tpcds_q77/datafusion:vortex-file-compressed 54885596 / 54175824 / +1.3% 89268961 / 87493805 / +2.0% 0.61 / 0.62 / -0.7%
tpcds_q78/datafusion:vortex-file-compressed 141875465 / 140889933 / +0.7% 192492036 / 191779256 / +0.4% 0.74 / 0.73 / +0.3%
tpcds_q79/datafusion:vortex-file-compressed 53242978 / 53408896 / -0.3% 86063148 / 83137730 / +3.5% 0.62 / 0.64 / -3.7%
tpcds_q80/datafusion:vortex-file-compressed 81862430 / 80795658 / +1.3% 125513731 / 127799771 / -1.8% 0.65 / 0.63 / +3.2%
tpcds_q81/datafusion:vortex-file-compressed 55749972 / 55975548 / -0.4% 82650312 / 83846761 / -1.4% 0.67 / 0.67 / +1.0%
tpcds_q82/datafusion:vortex-file-compressed 30261072 / 30549740 / -0.9% 54397586 / 48106493 / +13.1% 🔴 0.56 / 0.64 / -12.4%
tpcds_q83/datafusion:vortex-file-compressed 42037129 / 42358020 / -0.8% 67474122 / 65597866 / +2.9% 0.62 / 0.65 / -3.5%
tpcds_q84/datafusion:vortex-file-compressed 12735630 / 12799204 / -0.5% 32484749 / 30970538 / +4.9% 0.39 / 0.41 / -5.1%
tpcds_q85/datafusion:vortex-file-compressed 59980738 / 60660052 / -1.1% 90125126 / 90654953 / -0.6% 0.67 / 0.67 / -0.5%
tpcds_q86/datafusion:vortex-file-compressed 18375558 / 18272155 / +0.6% 39899781 / 40425570 / -1.3% 0.46 / 0.45 / +1.9%
tpcds_q87/datafusion:vortex-file-compressed 78806545 / 79615489 / -1.0% 109740303 / 107689679 / +1.9% 0.72 / 0.74 / -2.9%
tpcds_q88/datafusion:vortex-file-compressed 53573340 / 56206700 / -4.7% 90757429 / 93094539 / -2.5% 0.59 / 0.60 / -2.2%
tpcds_q89/datafusion:vortex-file-compressed 27117718 / 26931306 / +0.7% 55003038 / 56072635 / -1.9% 0.49 / 0.48 / +2.7%
tpcds_q90/datafusion:vortex-file-compressed 12549912 / 12758200 / -1.6% 31854561 / 34107490 / -6.6% 0.39 / 0.37 / +5.3%
tpcds_q91/datafusion:vortex-file-compressed 19362310 / 19519254 / -0.8% 42372399 / 42141655 / +0.5% 0.46 / 0.46 / -1.3%
tpcds_q92/datafusion:vortex-file-compressed 15419324 / 15245025 / +1.1% 34990187 / 33922326 / +3.1% 0.44 / 0.45 / -1.9%
tpcds_q93/datafusion:vortex-file-compressed 55002677 / 54842766 / +0.3% 87062726 / 88696680 / -1.8% 0.63 / 0.62 / +2.2%
tpcds_q94/datafusion:vortex-file-compressed 21517791 / 21620928 / -0.5% 47227796 / 46231785 / +2.2% 0.46 / 0.47 / -2.6%
tpcds_q95/datafusion:vortex-file-compressed 95255150 / 95000299 / +0.3% 125964697 / 123858370 / +1.7% 0.76 / 0.77 / -1.4%
tpcds_q96/datafusion:vortex-file-compressed 11878421 / 11533278 / +3.0% 31136503 / 31102793 / +0.1% 0.38 / 0.37 / +2.9%
tpcds_q97/datafusion:vortex-file-compressed 40676620 / 39467840 / +3.1% 67964542 / 66425488 / +2.3% 0.60 / 0.59 / +0.7%
tpcds_q98/datafusion:vortex-file-compressed 20609742 / 20665282 / -0.3% 47090647 / 48509099 / -2.9% 0.44 / 0.43 / +2.7%
tpcds_q99/datafusion:vortex-file-compressed 30087170 / 29545800 / +1.8% 48506122 / 48862458 / -0.7% 0.62 / 0.60 / +2.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59435362 / 59408052 / +0.0% 80064903 / 82373568 / -2.8% 0.74 / 0.72 / +2.9%
tpcds_q02/datafusion:parquet 69254230 / 69761366 / -0.7% 96340074 / 90812813 / +6.1% 0.72 / 0.77 / -6.4%
tpcds_q03/datafusion:parquet 28276934 / 28478768 / -0.7% 52806086 / 49334251 / +7.0% 0.54 / 0.58 / -7.2%
tpcds_q04/datafusion:parquet 641255314 / 642610250 / -0.2% 704893298 / 708231753 / -0.5% 0.91 / 0.91 / +0.3%
tpcds_q05/datafusion:parquet 80449983 / 81388832 / -1.2% 118992512 / 113800720 / +4.6% 0.68 / 0.72 / -5.5%
tpcds_q06/datafusion:parquet 90319952 / 90852955 / -0.6% 117035301 / 115952402 / +0.9% 0.77 / 0.78 / -1.5%
tpcds_q07/datafusion:parquet 102557213 / 101418282 / +1.1% 133577671 / 133695330 / -0.1% 0.77 / 0.76 / +1.2%
tpcds_q08/datafusion:parquet 48261338 / 48684130 / -0.9% 73982685 / 74133519 / -0.2% 0.65 / 0.66 / -0.7%
tpcds_q09/datafusion:parquet 74766454 / 75160834 / -0.5% 105571909 / 102849415 / +2.6% 0.71 / 0.73 / -3.1%
tpcds_q10/datafusion:parquet 59487924 / 60416750 / -1.5% 84811918 / 84947233 / -0.2% 0.70 / 0.71 / -1.4%
tpcds_q11/datafusion:parquet 411946662 / 412444870 / -0.1% 454309263 / 461294550 / -1.5% 0.91 / 0.89 / +1.4%
tpcds_q12/datafusion:parquet 39815038 / 39871562 / -0.1% 58066458 / 57128529 / +1.6% 0.69 / 0.70 / -1.8%
tpcds_q13/datafusion:parquet 84126725 / 84637846 / -0.6% 140321408 / 130466094 / +7.6% 0.60 / 0.65 / -7.6%
tpcds_q14/datafusion:parquet 383920006 / 378360104 / +1.5% 423095585 / 433388374 / -2.4% 0.91 / 0.87 / +3.9%
tpcds_q15/datafusion:parquet 50409742 / 51502606 / -2.1% 73019570 / 72303263 / +1.0% 0.69 / 0.71 / -3.1%
tpcds_q16/datafusion:parquet 45289064 / 45710882 / -0.9% 62272059 / 63650471 / -2.2% 0.73 / 0.72 / +1.3%
tpcds_q17/datafusion:parquet 136492694 / 138067928 / -1.1% 174647601 / 172187136 / +1.4% 0.78 / 0.80 / -2.5%
tpcds_q18/datafusion:parquet 109055842 / 110369917 / -1.2% 144143234 / 144952536 / -0.6% 0.76 / 0.76 / -0.6%
tpcds_q19/datafusion:parquet 49210265 / 48384048 / +1.7% 79013536 / 75539146 / +4.6% 0.62 / 0.64 / -2.8%
tpcds_q20/datafusion:parquet 41478917 / 41512735 / -0.1% 54342163 / 55090816 / -1.4% 0.76 / 0.75 / +1.3%
tpcds_q21/datafusion:parquet 61356307 / 61141701 / +0.4% 73683252 / 73095747 / +0.8% 0.83 / 0.84 / -0.4%
tpcds_q22/datafusion:parquet 462494869 / 464195324 / -0.4% 481359967 / 478139930 / +0.7% 0.96 / 0.97 / -1.0%
tpcds_q23/datafusion:parquet 363950966 / 357626356 / +1.8% 422176120 / 417833459 / +1.0% 0.86 / 0.86 / +0.7%
tpcds_q24/datafusion:parquet 238473642 / 241331307 / -1.2% 278553135 / 278266611 / +0.1% 0.86 / 0.87 / -1.3%
tpcds_q25/datafusion:parquet 145793022 / 146902811 / -0.8% 189127938 / 196039200 / -3.5% 0.77 / 0.75 / +2.9%
tpcds_q26/datafusion:parquet 55718352 / 53821080 / +3.5% 79824656 / 80565923 / -0.9% 0.70 / 0.67 / +4.5%
tpcds_q27/datafusion:parquet 208456154 / 210089836 / -0.8% 232896944 / 235911774 / -1.3% 0.90 / 0.89 / +0.5%
tpcds_q28/datafusion:parquet 89026619 / 86784142 / +2.6% 118727193 / 119280232 / -0.5% 0.75 / 0.73 / +3.1%
tpcds_q29/datafusion:parquet 143327934 / 145820741 / -1.7% 173358627 / 175411233 / -1.2% 0.83 / 0.83 / -0.5%
tpcds_q30/datafusion:parquet 97676460 / 99608501 / -1.9% 118862734 / 120071149 / -1.0% 0.82 / 0.83 / -0.9%
tpcds_q31/datafusion:parquet 320548372 / 319058792 / +0.5% 338595454 / 344041143 / -1.6% 0.95 / 0.93 / +2.1%
tpcds_q32/datafusion:parquet 29567683 / 29399552 / +0.6% 43332262 / 43643939 / -0.7% 0.68 / 0.67 / +1.3%
tpcds_q33/datafusion:parquet 52030733 / 51971680 / +0.1% 79755167 / 76538194 / +4.2% 0.65 / 0.68 / -3.9%
tpcds_q34/datafusion:parquet 63843201 / 65511648 / -2.5% 87014573 / 85276600 / +2.0% 0.73 / 0.77 / -4.5%
tpcds_q35/datafusion:parquet 125390516 / 126922984 / -1.2% 155363559 / 150646646 / +3.1% 0.81 / 0.84 / -4.2%
tpcds_q36/datafusion:parquet 98311036 / 97863638 / +0.5% 128975952 / 126419427 / +2.0% 0.76 / 0.77 / -1.5%
tpcds_q37/datafusion:parquet 49272703 / 50046237 / -1.5% 63611896 / 65033749 / -2.2% 0.77 / 0.77 / +0.7%
tpcds_q38/datafusion:parquet 121341484 / 122147195 / -0.7% 150188587 / 145034869 / +3.6% 0.81 / 0.84 / -4.1%
tpcds_q39/datafusion:parquet 845689330 / 846526498 / -0.1% 870671963 / 859437879 / +1.3% 0.97 / 0.98 / -1.4%
tpcds_q40/datafusion:parquet 34962712 / 35936465 / -2.7% 55145704 / 54650564 / +0.9% 0.63 / 0.66 / -3.6%
tpcds_q41/datafusion:parquet 31268346 / 31200319 / +0.2% 42444804 / 42657926 / -0.5% 0.74 / 0.73 / +0.7%
tpcds_q42/datafusion:parquet 26188984 / 25952126 / +0.9% 48550932 / 43716014 / +11.1% 🔴 0.54 / 0.59 / -9.1%
tpcds_q43/datafusion:parquet 28673774 / 27372783 / +4.8% 48439829 / 46844617 / +3.4% 0.59 / 0.58 / +1.3%
tpcds_q44/datafusion:parquet 66123084 / 65006033 / +1.7% 88685005 / 87803178 / +1.0% 0.75 / 0.74 / +0.7%
tpcds_q45/datafusion:parquet 66230089 / 66536274 / -0.5% 89193893 / 87212845 / +2.3% 0.74 / 0.76 / -2.7%
tpcds_q46/datafusion:parquet 107859042 / 106805720 / +1.0% 152323800 / 153607976 / -0.8% 0.71 / 0.70 / +1.8%
tpcds_q47/datafusion:parquet 236691122 / 237808994 / -0.5% 271411193 / 273252482 / -0.7% 0.87 / 0.87 / +0.2%
tpcds_q48/datafusion:parquet 77222512 / 76955857 / +0.3% 106722204 / 105870247 / +0.8% 0.72 / 0.73 / -0.5%
tpcds_q49/datafusion:parquet 116620130 / 118898020 / -1.9% 169272284 / 170084458 / -0.5% 0.69 / 0.70 / -1.4%
tpcds_q50/datafusion:parquet 92652968 / 92705258 / -0.1% 123119181 / 120435148 / +2.2% 0.75 / 0.77 / -2.2%
tpcds_q51/datafusion:parquet 256296701 / 254091982 / +0.9% 281825335 / 289211985 / -2.6% 0.91 / 0.88 / +3.5%
tpcds_q52/datafusion:parquet 27196940 / 26889958 / +1.1% 47506834 / 45469536 / +4.5% 0.57 / 0.59 / -3.2%
tpcds_q53/datafusion:parquet 36512886 / 36382336 / +0.4% 57290520 / 57842390 / -1.0% 0.64 / 0.63 / +1.3%
tpcds_q54/datafusion:parquet 86815739 / 85254806 / +1.8% 112347414 / 109551589 / +2.6% 0.77 / 0.78 / -0.7%
tpcds_q55/datafusion:parquet 26982984 / 26510566 / +1.8% 47918096 / 46645823 / +2.7% 0.56 / 0.57 / -0.9%
tpcds_q56/datafusion:parquet 53248466 / 54094848 / -1.6% 75885616 / 77335323 / -1.9% 0.70 / 0.70 / +0.3%
tpcds_q57/datafusion:parquet 170307464 / 171894920 / -0.9% 196044024 / 193978047 / +1.1% 0.87 / 0.89 / -2.0%
tpcds_q58/datafusion:parquet 96884234 / 98465482 / -1.6% 124455511 / 125032548 / -0.5% 0.78 / 0.79 / -1.1%
tpcds_q59/datafusion:parquet 105354388 / 103659830 / +1.6% 129923533 / 130225505 / -0.2% 0.81 / 0.80 / +1.9%
tpcds_q60/datafusion:parquet 54758595 / 55741260 / -1.8% 76684351 / 78220449 / -2.0% 0.71 / 0.71 / +0.2%
tpcds_q61/datafusion:parquet 76631378 / 78001000 / -1.8% 101541318 / 106432779 / -4.6% 0.75 / 0.73 / +3.0%
tpcds_q62/datafusion:parquet 27380971 / 27762318 / -1.4% 44772443 / 44527940 / +0.5% 0.61 / 0.62 / -1.9%
tpcds_q63/datafusion:parquet 36162711 / 36196190 / -0.1% 61935844 / 58834211 / +5.3% 0.58 / 0.62 / -5.1%
tpcds_q64/datafusion:parquet 661722834 / 659557758 / +0.3% 738277879 / 742173662 / -0.5% 0.90 / 0.89 / +0.9%
tpcds_q65/datafusion:parquet 101811798 / 100715906 / +1.1% 133886225 / 133981634 / -0.1% 0.76 / 0.75 / +1.2%
tpcds_q66/datafusion:parquet 76669056 / 76575936 / +0.1% 103085158 / 104374000 / -1.2% 0.74 / 0.73 / +1.4%
tpcds_q67/datafusion:parquet 433659222 / 430912350 / +0.6% 497347289 / 500297658 / -0.6% 0.87 / 0.86 / +1.2%
tpcds_q68/datafusion:parquet 110923858 / 108700552 / +2.0% 158196719 / 156742031 / +0.9% 0.70 / 0.69 / +1.1%
tpcds_q69/datafusion:parquet 59363770 / 61003348 / -2.7% 85665554 / 84325988 / +1.6% 0.69 / 0.72 / -4.2%
tpcds_q70/datafusion:parquet 211383690 / 212975306 / -0.7% 242141976 / 246017700 / -1.6% 0.87 / 0.87 / +0.8%
tpcds_q71/datafusion:parquet 38936458 / 39083124 / -0.4% 64936679 / 64662143 / +0.4% 0.60 / 0.60 / -0.8%
tpcds_q72/datafusion:parquet 1747856210 / 1794732356 / -2.6% 1761945619 / 1806078341 / -2.4% 0.99 / 0.99 / -0.2%
tpcds_q73/datafusion:parquet 62874078 / 62856255 / +0.0% 88431014 / 84855052 / +4.2% 0.71 / 0.74 / -4.0%
tpcds_q74/datafusion:parquet 291962308 / 292768250 / -0.3% 326753972 / 331483495 / -1.4% 0.89 / 0.88 / +1.2%
tpcds_q75/datafusion:parquet 195115374 / 193794623 / +0.7% 239677562 / 239131737 / +0.2% 0.81 / 0.81 / +0.5%
tpcds_q76/datafusion:parquet 50276234 / 49958244 / +0.6% 81748929 / 78897199 / +3.6% 0.62 / 0.63 / -2.9%
tpcds_q77/datafusion:parquet 74245386 / 73280301 / +1.3% 103251289 / 98096657 / +5.3% 0.72 / 0.75 / -3.7%
tpcds_q78/datafusion:parquet 209561202 / 211119866 / -0.7% 272156180 / 273491694 / -0.5% 0.77 / 0.77 / -0.3%
tpcds_q79/datafusion:parquet 77422776 / 77375078 / +0.1% 125887054 / 112413871 / +12.0% 🔴 0.62 / 0.69 / -10.6%
tpcds_q80/datafusion:parquet 143463976 / 143104068 / +0.3% 193029697 / 191975662 / +0.5% 0.74 / 0.75 / -0.3%
tpcds_q81/datafusion:parquet 107001568 / 106756472 / +0.2% 131505674 / 129378123 / +1.6% 0.81 / 0.83 / -1.4%
tpcds_q82/datafusion:parquet 54463750 / 53582485 / +1.6% 70926500 / 70410662 / +0.7% 0.77 / 0.76 / +0.9%
tpcds_q83/datafusion:parquet 65824859 / 66630048 / -1.2% 82853042 / 85136032 / -2.7% 0.79 / 0.78 / +1.5%
tpcds_q84/datafusion:parquet 36119408 / 36220898 / -0.3% 49334097 / 49805351 / -0.9% 0.73 / 0.73 / +0.7%
tpcds_q85/datafusion:parquet 105550322 / 103848480 / +1.6% 131147917 / 129149354 / +1.5% 0.80 / 0.80 / +0.1%
tpcds_q86/datafusion:parquet 21974325 / 22112695 / -0.6% 40939656 / 39672664 / +3.2% 0.54 / 0.56 / -3.7%
tpcds_q87/datafusion:parquet 119544582 / 122470358 / -2.4% 141281445 / 148224625 / -4.7% 0.85 / 0.83 / +2.4%
tpcds_q88/datafusion:parquet 85515147 / 86047137 / -0.6% 112029393 / 108358632 / +3.4% 0.76 / 0.79 / -3.9%
tpcds_q89/datafusion:parquet 39525218 / 38401756 / +2.9% 66074034 / 64923770 / +1.8% 0.60 / 0.59 / +1.1%
tpcds_q90/datafusion:parquet 17796488 / 18100802 / -1.7% 34532086 / 32273520 / +7.0% 0.52 / 0.56 / -8.1%
tpcds_q91/datafusion:parquet 41820642 / 41738000 / +0.2% 59867798 / 57454843 / +4.2% 0.70 / 0.73 / -3.8%
tpcds_q92/datafusion:parquet 28354044 / 28604120 / -0.9% 47251577 / 47460689 / -0.4% 0.60 / 0.60 / -0.4%
tpcds_q93/datafusion:parquet 61876668 / 63722030 / -2.9% 91624380 / 87405909 / +4.8% 0.68 / 0.73 / -7.4%
tpcds_q94/datafusion:parquet 38685504 / 37847109 / +2.2% 59198449 / 58549059 / +1.1% 0.65 / 0.65 / +1.1%
tpcds_q95/datafusion:parquet 128235170 / 128012922 / +0.2% 147750425 / 149910916 / -1.4% 0.87 / 0.85 / +1.6%
tpcds_q96/datafusion:parquet 20841686 / 20691258 / +0.7% 36447032 / 36951345 / -1.4% 0.57 / 0.56 / +2.1%
tpcds_q97/datafusion:parquet 55135239 / 54645566 / +0.9% 78037998 / 80351616 / -2.9% 0.71 / 0.68 / +3.9%
tpcds_q98/datafusion:parquet 61768793 / 61965680 / -0.3% 83750996 / 83775704 / -0.0% 0.74 / 0.74 / -0.3%
tpcds_q99/datafusion:parquet 43103420 / 42461627 / +1.5% 58157234 / 57802802 / +0.6% 0.74 / 0.73 / +0.9%
duckdb / vortex-file-compressed / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32272059 / 32726779 / -1.4% 45619625 / 45377689 / +0.5% 0.71 / 0.72 / -1.9%
tpcds_q02/duckdb:vortex-file-compressed 30009703 / 30267290 / -0.9% 43136606 / 44087004 / -2.2% 0.70 / 0.69 / +1.3%
tpcds_q03/duckdb:vortex-file-compressed 13565623 / 13779130 / -1.5% 28777957 / 30718899 / -6.3% 0.47 / 0.45 / +5.1%
tpcds_q04/duckdb:vortex-file-compressed 127998620 / 130206338 / -1.7% 156046118 / 157201556 / -0.7% 0.82 / 0.83 / -1.0%
tpcds_q05/duckdb:vortex-file-compressed 54469042 / 53727511 / +1.4% 82077088 / 83478676 / -1.7% 0.66 / 0.64 / +3.1%
tpcds_q06/duckdb:vortex-file-compressed 57984646 / 58800986 / -1.4% 77238213 / 79094008 / -2.3% 0.75 / 0.74 / +1.0%
tpcds_q07/duckdb:vortex-file-compressed 30322628 / 31168844 / -2.7% 53825642 / 54099517 / -0.5% 0.56 / 0.58 / -2.2%
tpcds_q08/duckdb:vortex-file-compressed 31447232 / 31134683 / +1.0% 40963870 / 41772800 / -1.9% 0.77 / 0.75 / +3.0%
tpcds_q09/duckdb:vortex-file-compressed 57747362 / 55235330 / +4.5% 79026767 / 79107779 / -0.1% 0.73 / 0.70 / +4.7%
tpcds_q10/duckdb:vortex-file-compressed 39173478 / 39038430 / +0.3% 59421571 / 58236826 / +2.0% 0.66 / 0.67 / -1.7%
tpcds_q11/duckdb:vortex-file-compressed 96014536 / 96226126 / -0.2% 114902790 / 112266994 / +2.3% 0.84 / 0.86 / -2.5%
tpcds_q12/duckdb:vortex-file-compressed 17144558 / 17276975 / -0.8% 29786011 / 30254952 / -1.5% 0.58 / 0.57 / +0.8%
tpcds_q13/duckdb:vortex-file-compressed 38372362 / 38940578 / -1.5% 71063481 / 71103229 / -0.1% 0.54 / 0.55 / -1.4%
tpcds_q14/duckdb:vortex-file-compressed 122192694 / 119983268 / +1.8% 134487219 / 140641737 / -4.4% 0.91 / 0.85 / +6.5%
tpcds_q15/duckdb:vortex-file-compressed 61273192 / 60759281 / +0.8% 71919835 / 76171754 / -5.6% 0.85 / 0.80 / +6.8%
tpcds_q16/duckdb:vortex-file-compressed 34223810 / 34771337 / -1.6% 54723489 / 53890958 / +1.5% 0.63 / 0.65 / -3.1%
tpcds_q17/duckdb:vortex-file-compressed 57432987 / 57289182 / +0.3% 80408337 / 81955246 / -1.9% 0.71 / 0.70 / +2.2%
tpcds_q18/duckdb:vortex-file-compressed 83098619 / 82993345 / +0.1% 101200038 / 104424434 / -3.1% 0.82 / 0.79 / +3.3%
tpcds_q19/duckdb:vortex-file-compressed 44780038 / 43899722 / +2.0% 61012746 / 65276395 / -6.5% 0.73 / 0.67 / +9.1%
tpcds_q20/duckdb:vortex-file-compressed 22049771 / 21520304 / +2.5% 34758546 / 34931964 / -0.5% 0.63 / 0.62 / +3.0%
tpcds_q21/duckdb:vortex-file-compressed 27955406 / 28120830 / -0.6% 59312497 / 62004166 / -4.3% 0.47 / 0.45 / +3.9%
tpcds_q22/duckdb:vortex-file-compressed 160105082 / 165099230 / -3.0% 177057322 / 170541662 / +3.8% 0.90 / 0.97 / -6.6%
tpcds_q23/duckdb:vortex-file-compressed 182543503 / 185876490 / -1.8% 197373600 / 199673618 / -1.2% 0.92 / 0.93 / -0.6%
tpcds_q24/duckdb:vortex-file-compressed 52199288 / 52636914 / -0.8% 75991310 / 77254623 / -1.6% 0.69 / 0.68 / +0.8%
tpcds_q25/duckdb:vortex-file-compressed 52851558 / 53220034 / -0.7% 74778690 / 75302591 / -0.7% 0.71 / 0.71 / +0.0%
tpcds_q26/duckdb:vortex-file-compressed 26079472 / 26713063 / -2.4% 41654888 / 42934826 / -3.0% 0.63 / 0.62 / +0.6%
tpcds_q27/duckdb:vortex-file-compressed 32277808 / 32585874 / -0.9% 55988990 / 53424233 / +4.8% 0.58 / 0.61 / -5.5%
tpcds_q28/duckdb:vortex-file-compressed 41195483 / 41342696 / -0.4% 63020757 / 66089322 / -4.6% 0.65 / 0.63 / +4.5%
tpcds_q29/duckdb:vortex-file-compressed 51630713 / 51866994 / -0.5% 75267294 / 74066949 / +1.6% 0.69 / 0.70 / -2.0%
tpcds_q30/duckdb:vortex-file-compressed 38466354 / 37914817 / +1.5% 52620766 / 52960815 / -0.6% 0.73 / 0.72 / +2.1%
tpcds_q31/duckdb:vortex-file-compressed 37571300 / 37512062 / +0.2% 51825465 / 53392186 / -2.9% 0.72 / 0.70 / +3.2%
tpcds_q32/duckdb:vortex-file-compressed 14126057 / 13855892 / +1.9% 29423838 / 28855272 / +2.0% 0.48 / 0.48 / -0.0%
tpcds_q33/duckdb:vortex-file-compressed 33859244 / 33813963 / +0.1% 58088893 / 59046480 / -1.6% 0.58 / 0.57 / +1.8%
tpcds_q34/duckdb:vortex-file-compressed 22734026 / 22811725 / -0.3% 40065552 / 39776812 / +0.7% 0.57 / 0.57 / -1.1%
tpcds_q35/duckdb:vortex-file-compressed 67400490 / 66786588 / +0.9% 88115251 / 85242000 / +3.4% 0.76 / 0.78 / -2.4%
tpcds_q36/duckdb:vortex-file-compressed 29341026 / 29806828 / -1.6% 49958711 / 49308472 / +1.3% 0.59 / 0.60 / -2.8%
tpcds_q37/duckdb:vortex-file-compressed 25703534 / 25605208 / +0.4% 70474333 / 74457214 / -5.3% 0.36 / 0.34 / +6.1%
tpcds_q38/duckdb:vortex-file-compressed 60925686 / 62408870 / -2.4% 78716498 / 81156842 / -3.0% 0.77 / 0.77 / +0.6%
tpcds_q39/duckdb:vortex-file-compressed 54592509 / 56168904 / -2.8% 84861548 / 85127364 / -0.3% 0.64 / 0.66 / -2.5%
tpcds_q40/duckdb:vortex-file-compressed 18525810 / 19238372 / -3.7% 34566405 / 35099919 / -1.5% 0.54 / 0.55 / -2.2%
tpcds_q41/duckdb:vortex-file-compressed 16382550 / 18720698 / -12.5% 🟢 24333393 / 25500417 / -4.6% 0.67 / 0.73 / -8.3%
tpcds_q42/duckdb:vortex-file-compressed 14143002 / 14015144 / +0.9% 31094074 / 30966847 / +0.4% 0.45 / 0.45 / +0.5%
tpcds_q43/duckdb:vortex-file-compressed 19571616 / 19403602 / +0.9% 34347181 / 32011378 / +7.3% 0.57 / 0.61 / -6.0%
tpcds_q44/duckdb:vortex-file-compressed 28576264 / 28307018 / +1.0% 51458734 / 51668551 / -0.4% 0.56 / 0.55 / +1.4%
tpcds_q45/duckdb:vortex-file-compressed 46158570 / 46586273 / -0.9% 59737940 / 60370446 / -1.0% 0.77 / 0.77 / +0.1%
tpcds_q46/duckdb:vortex-file-compressed 51502128 / 51192653 / +0.6% 74103726 / 75043524 / -1.3% 0.70 / 0.68 / +1.9%
tpcds_q47/duckdb:vortex-file-compressed 81159470 / 80927444 / +0.3% 99049348 / 97094785 / +2.0% 0.82 / 0.83 / -1.7%
tpcds_q48/duckdb:vortex-file-compressed 53001776 / 53155386 / -0.3% 78845641 / 81823473 / -3.6% 0.67 / 0.65 / +3.5%
tpcds_q49/duckdb:vortex-file-compressed 38471410 / 37950044 / +1.4% 77719316 / 78847393 / -1.4% 0.50 / 0.48 / +2.8%
tpcds_q50/duckdb:vortex-file-compressed 32291066 / 32675461 / -1.2% 55686245 / 57051911 / -2.4% 0.58 / 0.57 / +1.2%
tpcds_q51/duckdb:vortex-file-compressed 204095846 / 204779876 / -0.3% 220107343 / 217736852 / +1.1% 0.93 / 0.94 / -1.4%
tpcds_q52/duckdb:vortex-file-compressed 14880228 / 15384257 / -3.3% 31436977 / 31876748 / -1.4% 0.47 / 0.48 / -1.9%
tpcds_q53/duckdb:vortex-file-compressed 22025682 / 22960290 / -4.1% 38319047 / 39000657 / -1.7% 0.57 / 0.59 / -2.4%
tpcds_q54/duckdb:vortex-file-compressed 44326982 / 44886930 / -1.2% 65750242 / 65481173 / +0.4% 0.67 / 0.69 / -1.7%
tpcds_q55/duckdb:vortex-file-compressed 14188174 / 14612501 / -2.9% 31959360 / 30570651 / +4.5% 0.44 / 0.48 / -7.1%
tpcds_q56/duckdb:vortex-file-compressed 32585360 / 32462078 / +0.4% 57926357 / 57717193 / +0.4% 0.56 / 0.56 / +0.0%
tpcds_q57/duckdb:vortex-file-compressed 63706374 / 64171452 / -0.7% 76286407 / 78496038 / -2.8% 0.84 / 0.82 / +2.2%
tpcds_q58/duckdb:vortex-file-compressed 37416428 / 37835588 / -1.1% 58144641 / 64016051 / -9.2% 0.64 / 0.59 / +8.9%
tpcds_q59/duckdb:vortex-file-compressed 52783005 / 53810956 / -1.9% 63978926 / 71107629 / -10.0% 🟢 0.83 / 0.76 / +9.0%
tpcds_q60/duckdb:vortex-file-compressed 35913400 / 35369636 / +1.5% 58773735 / 59793701 / -1.7% 0.61 / 0.59 / +3.3%
tpcds_q61/duckdb:vortex-file-compressed 34510116 / 34298255 / +0.6% 52155931 / 53069753 / -1.7% 0.66 / 0.65 / +2.4%
tpcds_q62/duckdb:vortex-file-compressed 14741686 / 14822514 / -0.5% 26414075 / 26421769 / -0.0% 0.56 / 0.56 / -0.5%
tpcds_q63/duckdb:vortex-file-compressed 21048020 / 20828409 / +1.1% 37947148 / 38114655 / -0.4% 0.55 / 0.55 / +1.5%
tpcds_q64/duckdb:vortex-file-compressed 121299380 / 118342334 / +2.5% 153947963 / 152181613 / +1.2% 0.79 / 0.78 / +1.3%
tpcds_q65/duckdb:vortex-file-compressed 49731154 / 51466061 / -3.4% 58987895 / 58907342 / +0.1% 0.84 / 0.87 / -3.5%
tpcds_q66/duckdb:vortex-file-compressed 40524063 / 40998564 / -1.2% 57032733 / 58858579 / -3.1% 0.71 / 0.70 / +2.0%
tpcds_q67/duckdb:vortex-file-compressed 275627250 / 277425812 / -0.6% 288900878 / 283678837 / +1.8% 0.95 / 0.98 / -2.4%
tpcds_q68/duckdb:vortex-file-compressed 44957608 / 44593714 / +0.8% 70365089 / 72079771 / -2.4% 0.64 / 0.62 / +3.3%
tpcds_q69/duckdb:vortex-file-compressed 38287200 / 38356528 / -0.2% 60602971 / 59755970 / +1.4% 0.63 / 0.64 / -1.6%
tpcds_q70/duckdb:vortex-file-compressed 24981318 / 25085070 / -0.4% 41724012 / 41516746 / +0.5% 0.60 / 0.60 / -0.9%
tpcds_q71/duckdb:vortex-file-compressed 28289600 / 27715436 / +2.1% 51164362 / 50902781 / +0.5% 0.55 / 0.54 / +1.5%
tpcds_q72/duckdb:vortex-file-compressed 134828772 / 135900823 / -0.8% 157920330 / 164226936 / -3.8% 0.85 / 0.83 / +3.2%
tpcds_q73/duckdb:vortex-file-compressed 20382686 / 20089200 / +1.5% 38313270 / 37315276 / +2.7% 0.53 / 0.54 / -1.2%
tpcds_q74/duckdb:vortex-file-compressed 82508366 / 82722980 / -0.3% 97832699 / 99629718 / -1.8% 0.84 / 0.83 / +1.6%
tpcds_q75/duckdb:vortex-file-compressed 110254515 / 111929736 / -1.5% 135401644 / 139908352 / -3.2% 0.81 / 0.80 / +1.8%
tpcds_q76/duckdb:vortex-file-compressed 28118222 / 27219565 / +3.3% 58006135 / 58492855 / -0.8% 0.48 / 0.47 / +4.2%
tpcds_q77/duckdb:vortex-file-compressed 35468454 / 36316546 / -2.3% 61101585 / 62103115 / -1.6% 0.58 / 0.58 / -0.7%
tpcds_q78/duckdb:vortex-file-compressed 134827730 / 137442428 / -1.9% 160067112 / 159793923 / +0.2% 0.84 / 0.86 / -2.1%
tpcds_q79/duckdb:vortex-file-compressed 37021284 / 37665982 / -1.7% 63258284 / 59874325 / +5.7% 0.59 / 0.63 / -7.0%
tpcds_q80/duckdb:vortex-file-compressed 57585226 / 57541290 / +0.1% 92498500 / 89399248 / +3.5% 0.62 / 0.64 / -3.3%
tpcds_q81/duckdb:vortex-file-compressed 57161923 / 57777750 / -1.1% 70604094 / 71231569 / -0.9% 0.81 / 0.81 / -0.2%
tpcds_q82/duckdb:vortex-file-compressed 26776182 / 26860434 / -0.3% 75097990 / 77804956 / -3.5% 0.36 / 0.35 / +3.3%
tpcds_q83/duckdb:vortex-file-compressed 21353870 / 21694036 / -1.6% 31930379 / 32263861 / -1.0% 0.67 / 0.67 / -0.5%
tpcds_q84/duckdb:vortex-file-compressed 13554306 / 13366814 / +1.4% 23839898 / 23226339 / +2.6% 0.57 / 0.58 / -1.2%
tpcds_q85/duckdb:vortex-file-compressed 35755822 / 36707151 / -2.6% 53969943 / 56348206 / -4.2% 0.66 / 0.65 / +1.7%
tpcds_q86/duckdb:vortex-file-compressed 16566502 / 16411782 / +0.9% 28053570 / 28182293 / -0.5% 0.59 / 0.58 / +1.4%
tpcds_q87/duckdb:vortex-file-compressed 75049839 / 75201770 / -0.2% 85519124 / 87749398 / -2.5% 0.88 / 0.86 / +2.4%
tpcds_q88/duckdb:vortex-file-compressed 38175604 / 37878092 / +0.8% 49644290 / 49979733 / -0.7% 0.77 / 0.76 / +1.5%
tpcds_q89/duckdb:vortex-file-compressed 24993304 / 24974289 / +0.1% 40583578 / 41888285 / -3.1% 0.62 / 0.60 / +3.3%
tpcds_q90/duckdb:vortex-file-compressed 9740305 / 9843474 / -1.0% 20598013 / 20353435 / +1.2% 0.47 / 0.48 / -2.2%
tpcds_q91/duckdb:vortex-file-compressed 19482976 / 19617013 / -0.7% 27993507 / 29081972 / -3.7% 0.70 / 0.67 / +3.2%
tpcds_q92/duckdb:vortex-file-compressed 13201470 / 13643566 / -3.2% 28256903 / 27682975 / +2.1% 0.47 / 0.49 / -5.2%
tpcds_q93/duckdb:vortex-file-compressed 25962506 / 25876894 / +0.3% 52068925 / 52613864 / -1.0% 0.50 / 0.49 / +1.4%
tpcds_q94/duckdb:vortex-file-compressed 32509191 / 32152022 / +1.1% 47589579 / 47204449 / +0.8% 0.68 / 0.68 / +0.3%
tpcds_q95/duckdb:vortex-file-compressed 96712128 / 97513786 / -0.8% 104017607 / 117615692 / -11.6% 🟢 0.93 / 0.83 / +12.1%
tpcds_q96/duckdb:vortex-file-compressed 11753344 / 11752061 / +0.0% 25516222 / 24570663 / +3.8% 0.46 / 0.48 / -3.7%
tpcds_q97/duckdb:vortex-file-compressed 60469684 / 62178961 / -2.7% 80959889 / 82766588 / -2.2% 0.75 / 0.75 / -0.6%
tpcds_q98/duckdb:vortex-file-compressed 27009802 / 26889542 / +0.4% 43802239 / 43917859 / -0.3% 0.62 / 0.61 / +0.7%
tpcds_q99/duckdb:vortex-file-compressed 23465667 / 26072871 / -10.0% 36961917 / 35980286 / +2.7% 0.63 / 0.72 / -12.4%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41846407 / 43748750 / -4.3% 50591883 / 50433867 / +0.3% 0.83 / 0.87 / -4.6%
tpcds_q02/duckdb:parquet 39023707 / 39630168 / -1.5% 48406784 / 50715675 / -4.6% 0.81 / 0.78 / +3.2%
tpcds_q03/duckdb:parquet 25291228 / 25995732 / -2.7% 38760254 / 36796166 / +5.3% 0.65 / 0.71 / -7.6%
tpcds_q04/duckdb:parquet 202250172 / 203957459 / -0.8% 228445785 / 234181220 / -2.4% 0.89 / 0.87 / +1.7%
tpcds_q05/duckdb:parquet 70042990 / 68357342 / +2.5% 85762461 / 87464497 / -1.9% 0.82 / 0.78 / +4.5%
tpcds_q06/duckdb:parquet 75372704 / 75115975 / +0.3% 86930691 / 89166769 / -2.5% 0.87 / 0.84 / +2.9%
tpcds_q07/duckdb:parquet 59036237 / 62193874 / -5.1% 77207189 / 76707973 / +0.7% 0.76 / 0.81 / -5.7%
tpcds_q08/duckdb:parquet 38866176 / 38663366 / +0.5% 46655801 / 46394278 / +0.6% 0.83 / 0.83 / -0.0%
tpcds_q09/duckdb:parquet 84768148 / 87080988 / -2.7% 104665228 / 101981323 / +2.6% 0.81 / 0.85 / -5.2%
tpcds_q10/duckdb:parquet 52495408 / 52520572 / -0.0% 62223824 / 62695229 / -0.8% 0.84 / 0.84 / +0.7%
tpcds_q11/duckdb:parquet 158729597 / 159415788 / -0.4% 166404979 / 164104249 / +1.4% 0.95 / 0.97 / -1.8%
tpcds_q12/duckdb:parquet 41164091 / 40814548 / +0.9% 47680925 / 48941959 / -2.6% 0.86 / 0.83 / +3.5%
tpcds_q13/duckdb:parquet 71456602 / 69804706 / +2.4% 91007854 / 87793121 / +3.7% 0.79 / 0.80 / -1.2%
tpcds_q14/duckdb:parquet 189563212 / 185753765 / +2.1% 194471743 / 202864595 / -4.1% 0.97 / 0.92 / +6.5%
tpcds_q15/duckdb:parquet 60598490 / 60934452 / -0.6% 67716238 / 69050398 / -1.9% 0.89 / 0.88 / +1.4%
tpcds_q16/duckdb:parquet 38182676 / 37850674 / +0.9% 46665940 / 45839434 / +1.8% 0.82 / 0.83 / -0.9%
tpcds_q17/duckdb:parquet 83425264 / 84076050 / -0.8% 90105858 / 89860905 / +0.3% 0.93 / 0.94 / -1.0%
tpcds_q18/duckdb:parquet 87375858 / 87775860 / -0.5% 96939126 / 98136096 / -1.2% 0.90 / 0.89 / +0.8%
tpcds_q19/duckdb:parquet 47703368 / 47466565 / +0.5% 64547086 / 63007623 / +2.4% 0.74 / 0.75 / -1.9%
tpcds_q20/duckdb:parquet 42369756 / 42342882 / +0.1% 49681536 / 48573403 / +2.3% 0.85 / 0.87 / -2.2%
tpcds_q21/duckdb:parquet 23896380 / 23962194 / -0.3% 28153316 / 28440652 / -1.0% 0.85 / 0.84 / +0.7%
tpcds_q22/duckdb:parquet 165193686 / 166072912 / -0.5% 164997294 / 167098902 / -1.3% 1.00 / 0.99 / +0.7%
tpcds_q23/duckdb:parquet 185027022 / 188036546 / -1.6% 193199461 / 193148517 / +0.0% 0.96 / 0.97 / -1.6%
tpcds_q24/duckdb:parquet 72709802 / 71146241 / +2.2% 87187364 / 82487151 / +5.7% 0.83 / 0.86 / -3.3%
tpcds_q25/duckdb:parquet 51499678 / 51215258 / +0.6% 60551976 / 61288817 / -1.2% 0.85 / 0.84 / +1.8%
tpcds_q26/duckdb:parquet 42519442 / 42361802 / +0.4% 53183822 / 51343370 / +3.6% 0.80 / 0.83 / -3.1%
tpcds_q27/duckdb:parquet 57723605 / 57111037 / +1.1% 76466465 / 81608147 / -6.3% 0.75 / 0.70 / +7.9%
tpcds_q28/duckdb:parquet 92102568 / 93252698 / -1.2% 115844305 / 112178597 / +3.3% 0.80 / 0.83 / -4.4%
tpcds_q29/duckdb:parquet 84610194 / 83041768 / +1.9% 92774523 / 96583021 / -3.9% 0.91 / 0.86 / +6.1%
tpcds_q30/duckdb:parquet 72132098 / 72470468 / -0.5% 81349526 / 81148208 / +0.2% 0.89 / 0.89 / -0.7%
tpcds_q31/duckdb:parquet 98495328 / 98601462 / -0.1% 111321379 / 111465299 / -0.1% 0.88 / 0.88 / +0.0%
tpcds_q32/duckdb:parquet 18109354 / 18353748 / -1.3% 27256339 / 26590155 / +2.5% 0.66 / 0.69 / -3.7%
tpcds_q33/duckdb:parquet 61356919 / 62367010 / -1.6% 73976024 / 73989561 / -0.0% 0.83 / 0.84 / -1.6%
tpcds_q34/duckdb:parquet 32936992 / 33006494 / -0.2% 38680567 / 41889230 / -7.7% 0.85 / 0.79 / +8.1%
tpcds_q35/duckdb:parquet 77595788 / 77399391 / +0.3% 87520178 / 86087567 / +1.7% 0.89 / 0.90 / -1.4%
tpcds_q36/duckdb:parquet 98113920 / 99335950 / -1.2% 112731443 / 112263590 / +0.4% 0.87 / 0.88 / -1.6%
tpcds_q37/duckdb:parquet 41425996 / 41378236 / +0.1% 48396676 / 47554095 / +1.8% 0.86 / 0.87 / -1.6%
tpcds_q38/duckdb:parquet 74972710 / 76468258 / -2.0% 82810343 / 85294747 / -2.9% 0.91 / 0.90 / +1.0%
tpcds_q39/duckdb:parquet 61115034 / 61661639 / -0.9% 67459274 / 67797634 / -0.5% 0.91 / 0.91 / -0.4%
tpcds_q40/duckdb:parquet 28025237 / 27952642 / +0.3% 35411356 / 36118029 / -2.0% 0.79 / 0.77 / +2.3%
tpcds_q41/duckdb:parquet 20078281 / 20143537 / -0.3% 26247887 / 26266476 / -0.1% 0.76 / 0.77 / -0.3%
tpcds_q42/duckdb:parquet 26268454 / 26999602 / -2.7% 37644104 / 36451419 / +3.3% 0.70 / 0.74 / -5.8%
tpcds_q43/duckdb:parquet 27375408 / 28272378 / -3.2% 33941143 / 35793884 / -5.2% 0.81 / 0.79 / +2.1%
tpcds_q44/duckdb:parquet 59300928 / 60736375 / -2.4% 77130386 / 74562633 / +3.4% 0.77 / 0.81 / -5.6%
tpcds_q45/duckdb:parquet 60763678 / 60622120 / +0.2% 67716821 / 67027287 / +1.0% 0.90 / 0.90 / -0.8%
tpcds_q46/duckdb:parquet 73150464 / 72394963 / +1.0% 86950211 / 88023341 / -1.2% 0.84 / 0.82 / +2.3%
tpcds_q47/duckdb:parquet 91852954 / 90830810 / +1.1% 99786995 / 105146923 / -5.1% 0.92 / 0.86 / +6.6%
tpcds_q48/duckdb:parquet 67671236 / 67648746 / +0.0% 78961444 / 85359866 / -7.5% 0.86 / 0.79 / +8.1%
tpcds_q49/duckdb:parquet 69775036 / 67399774 / +3.5% 90464280 / 92020170 / -1.7% 0.77 / 0.73 / +5.3%
tpcds_q50/duckdb:parquet 43272062 / 45228659 / -4.3% 53928750 / 50910629 / +5.9% 0.80 / 0.89 / -9.7%
tpcds_q51/duckdb:parquet 215155860 / 217340788 / -1.0% 229833405 / 225257376 / +2.0% 0.94 / 0.96 / -3.0%
tpcds_q52/duckdb:parquet 25923168 / 26490668 / -2.1% 38526449 / 37218058 / +3.5% 0.67 / 0.71 / -5.5%
tpcds_q53/duckdb:parquet 33298131 / 34202255 / -2.6% 44450012 / 48232701 / -7.8% 0.75 / 0.71 / +5.6%
tpcds_q54/duckdb:parquet 55781359 / 55357348 / +0.8% 64272852 / 63307482 / +1.5% 0.87 / 0.87 / -0.7%
tpcds_q55/duckdb:parquet 27201148 / 26580602 / +2.3% 36428650 / 38734658 / -6.0% 0.75 / 0.69 / +8.8%
tpcds_q56/duckdb:parquet 67554946 / 68450543 / -1.3% 78214788 / 84208264 / -7.1% 0.86 / 0.81 / +6.3%
tpcds_q57/duckdb:parquet 67140751 / 67905272 / -1.1% 75188808 / 75530496 / -0.5% 0.89 / 0.90 / -0.7%
tpcds_q58/duckdb:parquet 55369907 / 55351262 / +0.0% 69415932 / 67300961 / +3.1% 0.80 / 0.82 / -3.0%
tpcds_q59/duckdb:parquet 60368918 / 61543058 / -1.9% 66364019 / 67498896 / -1.7% 0.91 / 0.91 / -0.2%
tpcds_q60/duckdb:parquet 82446080 / 81154691 / +1.6% 95772483 / 95719978 / +0.1% 0.86 / 0.85 / +1.5%
tpcds_q61/duckdb:parquet 80347280 / 78725636 / +2.1% 93735468 / 94693948 / -1.0% 0.86 / 0.83 / +3.1%
tpcds_q62/duckdb:parquet 22408704 / 21271646 / +5.3% 26943721 / 24742108 / +8.9% 0.83 / 0.86 / -3.3%
tpcds_q63/duckdb:parquet 33755617 / 33973322 / -0.6% 44814856 / 44293841 / +1.2% 0.75 / 0.77 / -1.8%
tpcds_q64/duckdb:parquet 137025172 / 134987804 / +1.5% 153343523 / 149714203 / +2.4% 0.89 / 0.90 / -0.9%
tpcds_q65/duckdb:parquet 84081546 / 92507762 / -9.1% 105457449 / 106732283 / -1.2% 0.80 / 0.87 / -8.0%
tpcds_q66/duckdb:parquet 44679692 / 45574203 / -2.0% 52101193 / 52408182 / -0.6% 0.86 / 0.87 / -1.4%
tpcds_q67/duckdb:parquet 293512258 / 294181831 / -0.2% 298897077 / 294225942 / +1.6% 0.98 / 1.00 / -1.8%
tpcds_q68/duckdb:parquet 63085930 / 61610444 / +2.4% 77691582 / 77643526 / +0.1% 0.81 / 0.79 / +2.3%
tpcds_q69/duckdb:parquet 64808525 / 65821270 / -1.5% 74214038 / 75369095 / -1.5% 0.87 / 0.87 / -0.0%
tpcds_q70/duckdb:parquet 42653214 / 42560156 / +0.2% 56722840 / 50824609 / +11.6% 🔴 0.75 / 0.84 / -10.2%
tpcds_q71/duckdb:parquet 40998880 / 41353862 / -0.9% 55672633 / 54241063 / +2.6% 0.74 / 0.76 / -3.4%
tpcds_q72/duckdb:parquet 170294144 / 172146606 / -1.1% 184954175 / 189350126 / -2.3% 0.92 / 0.91 / +1.3%
tpcds_q73/duckdb:parquet 28310810 / 27072398 / +4.6% 36673267 / 37030456 / -1.0% 0.77 / 0.73 / +5.6%
tpcds_q74/duckdb:parquet 214753839 / 216089249 / -0.6% 226028735 / 223017657 / +1.4% 0.95 / 0.97 / -1.9%
tpcds_q75/duckdb:parquet 133036340 / 131891024 / +0.9% 151416325 / 152249842 / -0.5% 0.88 / 0.87 / +1.4%
tpcds_q76/duckdb:parquet 51772010 / 51285484 / +0.9% 65046891 / 65205448 / -0.2% 0.80 / 0.79 / +1.2%
tpcds_q77/duckdb:parquet 55257848 / 54841040 / +0.8% 69196045 / 67440836 / +2.6% 0.80 / 0.81 / -1.8%
tpcds_q78/duckdb:parquet 155540632 / 155747874 / -0.1% 164538727 / 168363678 / -2.3% 0.95 / 0.93 / +2.2%
tpcds_q79/duckdb:parquet 52765111 / 51430181 / +2.6% 68754818 / 64568583 / +6.5% 0.77 / 0.80 / -3.7%
tpcds_q80/duckdb:parquet 82666938 / 82941310 / -0.3% 102467779 / 103690804 / -1.2% 0.81 / 0.80 / +0.9%
tpcds_q81/duckdb:parquet 97611230 / 98572923 / -1.0% 105774455 / 104274293 / +1.4% 0.92 / 0.95 / -2.4%
tpcds_q82/duckdb:parquet 45926150 / 46604344 / -1.5% 55612455 / 52315928 / +6.3% 0.83 / 0.89 / -7.3%
tpcds_q83/duckdb:parquet 28006483 / 28152398 / -0.5% 33261300 / 33185714 / +0.2% 0.84 / 0.85 / -0.7%
tpcds_q84/duckdb:parquet 22727918 / 22751552 / -0.1% 29635618 / 29406408 / +0.8% 0.77 / 0.77 / -0.9%
tpcds_q85/duckdb:parquet 51317992 / 52752074 / -2.7% 63321882 / 62960389 / +0.6% 0.81 / 0.84 / -3.3%
tpcds_q86/duckdb:parquet 24453100 / 25146913 / -2.8% 31791775 / 33004413 / -3.7% 0.77 / 0.76 / +1.0%
tpcds_q87/duckdb:parquet 87147130 / 88695797 / -1.7% 93279512 / 92564858 / +0.8% 0.93 / 0.96 / -2.5%
tpcds_q88/duckdb:parquet 103121456 / 106796080 / -3.4% 117133756 / 111229279 / +5.3% 0.88 / 0.96 / -8.3%
tpcds_q89/duckdb:parquet 36299788 / 37846748 / -4.1% 48012471 / 48196620 / -0.4% 0.76 / 0.79 / -3.7%
tpcds_q90/duckdb:parquet 15260910 / 15015242 / +1.6% 20996570 / 20928242 / +0.3% 0.73 / 0.72 / +1.3%
tpcds_q91/duckdb:parquet 25801022 / 25515043 / +1.1% 32640510 / 33274247 / -1.9% 0.79 / 0.77 / +3.1%
tpcds_q92/duckdb:parquet 23261843 / 22329364 / +4.2% 32698213 / 31995562 / +2.2% 0.71 / 0.70 / +1.9%
tpcds_q93/duckdb:parquet 37355434 / 35799040 / +4.3% 48675468 / 49479404 / -1.6% 0.77 / 0.72 / +6.1%
tpcds_q94/duckdb:parquet 38589491 / 38247234 / +0.9% 45966528 / 46965479 / -2.1% 0.84 / 0.81 / +3.1%
tpcds_q95/duckdb:parquet 81347120 / 81409130 / -0.1% 86772510 / 86595751 / +0.2% 0.94 / 0.94 / -0.3%
tpcds_q96/duckdb:parquet 16474652 / 17012262 / -3.2% 24034217 / 24425947 / -1.6% 0.69 / 0.70 / -1.6%
tpcds_q97/duckdb:parquet 72665774 / 73153984 / -0.7% 80905144 / 78153554 / +3.5% 0.90 / 0.94 / -4.0%
tpcds_q98/duckdb:parquet 54500896 / 55289756 / -1.4% 65298116 / 66788134 / -2.2% 0.83 / 0.83 / +0.8%
tpcds_q99/duckdb:parquet 24502287 / 24402862 / +0.4% 32629818 / 30438057 / +7.2% 0.75 / 0.80 / -6.3%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 1d56e333 vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.009x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93238124 / 92177346 / +1.2% 154191628 / 156197099 / -1.3% 0.60 / 0.59 / +2.5%
tpch_q02/datafusion:vortex-file-compressed 65953182 / 64428754 / +2.4% 93800895 / 94872596 / -1.1% 0.70 / 0.68 / +3.5%
tpch_q03/datafusion:vortex-file-compressed 62788658 / 64151894 / -2.1% 128620855 / 126780702 / +1.5% 0.49 / 0.51 / -3.5%
tpch_q04/datafusion:vortex-file-compressed 34126523 / 35028676 / -2.6% 71335026 / 68466710 / +4.2% 0.48 / 0.51 / -6.5%
tpch_q05/datafusion:vortex-file-compressed 119160400 / 118900162 / +0.2% 186446130 / 185439522 / +0.5% 0.64 / 0.64 / -0.3%
tpch_q06/datafusion:vortex-file-compressed 9431967 / 9649196 / -2.3% 60031058 / 57652551 / +4.1% 0.16 / 0.17 / -6.1%
tpch_q07/datafusion:vortex-file-compressed 97544346 / 97449767 / +0.1% 167268210 / 161011516 / +3.9% 0.58 / 0.61 / -3.6%
tpch_q08/datafusion:vortex-file-compressed 143697770 / 142206475 / +1.0% 208709624 / 226695985 / -7.9% 0.69 / 0.63 / +9.8%
tpch_q09/datafusion:vortex-file-compressed 186236504 / 182840408 / +1.9% 266969862 / 275147335 / -3.0% 0.70 / 0.66 / +5.0%
tpch_q10/datafusion:vortex-file-compressed 69754497 / 70621645 / -1.2% 134332817 / 136262721 / -1.4% 0.52 / 0.52 / +0.2%
tpch_q11/datafusion:vortex-file-compressed 45368233 / 45658051 / -0.6% 73314122 / 72364105 / +1.3% 0.62 / 0.63 / -1.9%
tpch_q12/datafusion:vortex-file-compressed 35347141 / 35235879 / +0.3% 76535456 / 79705799 / -4.0% 0.46 / 0.44 / +4.5%
tpch_q13/datafusion:vortex-file-compressed 49109056 / 48598467 / +1.1% 82517164 / 87210304 / -5.4% 0.60 / 0.56 / +6.8%
tpch_q14/datafusion:vortex-file-compressed 19820056 / 20650370 / -4.0% 90038812 / 88048054 / +2.3% 0.22 / 0.23 / -6.1%
tpch_q15/datafusion:vortex-file-compressed 33035296 / 33753614 / -2.1% 90494610 / 90785220 / -0.3% 0.37 / 0.37 / -1.8%
tpch_q16/datafusion:vortex-file-compressed 36872627 / 36919743 / -0.1% 65108841 / 65843812 / -1.1% 0.57 / 0.56 / +1.0%
tpch_q17/datafusion:vortex-file-compressed 179299612 / 176998771 / +1.3% 222800264 / 239755261 / -7.1% 0.80 / 0.74 / +9.0%
tpch_q18/datafusion:vortex-file-compressed 204033173 / 207996354 / -1.9% 270555060 / 275106107 / -1.7% 0.75 / 0.76 / -0.3%
tpch_q19/datafusion:vortex-file-compressed 27754032 / 28526869 / -2.7% 89040013 / 87666580 / +1.6% 0.31 / 0.33 / -4.2%
tpch_q20/datafusion:vortex-file-compressed 60362515 / 61936223 / -2.5% 116399561 / 118852369 / -2.1% 0.52 / 0.52 / -0.5%
tpch_q21/datafusion:vortex-file-compressed 181944004 / 182704046 / -0.4% 235808709 / 234984863 / +0.4% 0.77 / 0.78 / -0.8%
tpch_q22/datafusion:vortex-file-compressed 25444711 / 25513774 / -0.3% 53222140 / 55406439 / -3.9% 0.48 / 0.46 / +3.8%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87209963 / 87311538 / -0.1% 123116049 / 122516163 / +0.5% 0.71 / 0.71 / -0.6%
tpch_q02/datafusion:parquet 173775858 / 174735537 / -0.5% 193869612 / 198265824 / -2.2% 0.90 / 0.88 / +1.7%
tpch_q03/datafusion:parquet 134918788 / 135233090 / -0.2% 181684488 / 179364012 / +1.3% 0.74 / 0.75 / -1.5%
tpch_q04/datafusion:parquet 56685015 / 56985913 / -0.5% 86883599 / 85885070 / +1.2% 0.65 / 0.66 / -1.7%
tpch_q05/datafusion:parquet 167205233 / 166291221 / +0.5% 214900740 / 214896169 / +0.0% 0.78 / 0.77 / +0.5%
tpch_q06/datafusion:parquet 36405944 / 36510562 / -0.3% 72648404 / 72908306 / -0.4% 0.50 / 0.50 / +0.1%
tpch_q07/datafusion:parquet 217491259 / 215778947 / +0.8% 277072410 / 260314182 / +6.4% 0.78 / 0.83 / -5.3%
tpch_q08/datafusion:parquet 217787198 / 216791369 / +0.5% 284106779 / 278971702 / +1.8% 0.77 / 0.78 / -1.4%
tpch_q09/datafusion:parquet 308762753 / 307685989 / +0.3% 375695331 / 369588127 / +1.7% 0.82 / 0.83 / -1.3%
tpch_q10/datafusion:parquet 310977007 / 311954014 / -0.3% 366212936 / 359417304 / +1.9% 0.85 / 0.87 / -2.2%
tpch_q11/datafusion:parquet 127727607 / 127035714 / +0.5% 148209299 / 149936598 / -1.2% 0.86 / 0.85 / +1.7%
tpch_q12/datafusion:parquet 82358380 / 82433202 / -0.1% 115732504 / 116835758 / -0.9% 0.71 / 0.71 / +0.9%
tpch_q13/datafusion:parquet 210767979 / 210618688 / +0.1% 238681833 / 238788117 / -0.0% 0.88 / 0.88 / +0.1%
tpch_q14/datafusion:parquet 86013428 / 85602024 / +0.5% 198053007 / 186569859 / +6.2% 0.43 / 0.46 / -5.3%
tpch_q15/datafusion:parquet 105355515 / 106606603 / -1.2% 156506844 / 154598932 / +1.2% 0.67 / 0.69 / -2.4%
tpch_q16/datafusion:parquet 97222272 / 94683007 / +2.7% 122146342 / 123221265 / -0.9% 0.80 / 0.77 / +3.6%
tpch_q17/datafusion:parquet 214801456 / 215630850 / -0.4% 261052150 / 257798988 / +1.3% 0.82 / 0.84 / -1.6%
tpch_q18/datafusion:parquet 268675092 / 267541314 / +0.4% 315058892 / 318452912 / -1.1% 0.85 / 0.84 / +1.5%
tpch_q19/datafusion:parquet 108704189 / 108282497 / +0.4% 165740409 / 164045798 / +1.0% 0.66 / 0.66 / -0.6%
tpch_q20/datafusion:parquet 187118323 / 185298197 / +1.0% 239453546 / 237189433 / +1.0% 0.78 / 0.78 / +0.0%
tpch_q21/datafusion:parquet 243860831 / 244268713 / -0.2% 308019067 / 306493573 / +0.5% 0.79 / 0.80 / -0.7%
tpch_q22/datafusion:parquet 149724642 / 149723897 / +0.0% 174102953 / 171986203 / +1.2% 0.86 / 0.87 / -1.2%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33505286 / 33162813 / +1.0% 66738624 / 60965941 / +9.5% 0.50 / 0.54 / -7.7%
tpch_q02/duckdb:vortex-file-compressed 28273751 / 28441284 / -0.6% 41439952 / 42490796 / -2.5% 0.68 / 0.67 / +1.9%
tpch_q03/duckdb:vortex-file-compressed 52081480 / 51806352 / +0.5% 100673919 / 96181102 / +4.7% 0.52 / 0.54 / -4.0%
tpch_q04/duckdb:vortex-file-compressed 51625101 / 51520893 / +0.2% 81674910 / 83080389 / -1.7% 0.63 / 0.62 / +1.9%
tpch_q05/duckdb:vortex-file-compressed 69176226 / 68278233 / +1.3% 105675708 / 110549285 / -4.4% 0.65 / 0.62 / +6.0%
tpch_q06/duckdb:vortex-file-compressed 15004936 / 14995905 / +0.1% 51154028 / 49678736 / +3.0% 0.29 / 0.30 / -2.8%
tpch_q07/duckdb:vortex-file-compressed 54873000 / 55095502 / -0.4% 107113377 / 99927713 / +7.2% 0.51 / 0.55 / -7.1%
tpch_q08/duckdb:vortex-file-compressed 84000346 / 84730600 / -0.9% 123155487 / 128300677 / -4.0% 0.68 / 0.66 / +3.3%
tpch_q09/duckdb:vortex-file-compressed 102845153 / 102680463 / +0.2% 155842148 / 149752209 / +4.1% 0.66 / 0.69 / -3.8%
tpch_q10/duckdb:vortex-file-compressed 96837628 / 95736829 / +1.1% 144569613 / 145772381 / -0.8% 0.67 / 0.66 / +2.0%
tpch_q11/duckdb:vortex-file-compressed 13278450 / 13161487 / +0.9% 28051040 / 28614710 / -2.0% 0.47 / 0.46 / +2.9%
tpch_q12/duckdb:vortex-file-compressed 44889157 / 45171630 / -0.6% 79759101 / 74559415 / +7.0% 0.56 / 0.61 / -7.1%
tpch_q13/duckdb:vortex-file-compressed 71377333 / 71277113 / +0.1% 96456700 / 98751212 / -2.3% 0.74 / 0.72 / +2.5%
tpch_q14/duckdb:vortex-file-compressed 28424541 / 27742167 / +2.5% 70737998 / 68588058 / +3.1% 0.40 / 0.40 / -0.7%
tpch_q15/duckdb:vortex-file-compressed 24144010 / 24169914 / -0.1% 63102209 / 62760479 / +0.5% 0.38 / 0.39 / -0.6%
tpch_q16/duckdb:vortex-file-compressed 49499876 / 49823920 / -0.7% 58959914 / 58191998 / +1.3% 0.84 / 0.86 / -1.9%
tpch_q17/duckdb:vortex-file-compressed 34798190 / 34928738 / -0.4% 65267894 / 64550565 / +1.1% 0.53 / 0.54 / -1.5%
tpch_q18/duckdb:vortex-file-compressed 109628080 / 102866087 / +6.6% 118726731 / 121696816 / -2.4% 0.92 / 0.85 / +9.2%
tpch_q19/duckdb:vortex-file-compressed 27305302 / 27489534 / -0.7% 77889723 / 76106199 / +2.3% 0.35 / 0.36 / -2.9%
tpch_q20/duckdb:vortex-file-compressed 41480565 / 41385355 / +0.2% 90583249 / 88937430 / +1.9% 0.46 / 0.47 / -1.6%
tpch_q21/duckdb:vortex-file-compressed 95048376 / 92643489 / +2.6% 141566957 / 140692444 / +0.6% 0.67 / 0.66 / +2.0%
tpch_q22/duckdb:vortex-file-compressed 33307523 / 33019958 / +0.9% 48176330 / 47168881 / +2.1% 0.69 / 0.70 / -1.2%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67513726 / 68061708 / -0.8% 91279524 / 88188170 / +3.5% 0.74 / 0.77 / -4.2%
tpch_q02/duckdb:parquet 86681393 / 87254980 / -0.7% 97450500 / 98880371 / -1.4% 0.89 / 0.88 / +0.8%
tpch_q03/duckdb:parquet 110475352 / 110221645 / +0.2% 140826981 / 141238280 / -0.3% 0.78 / 0.78 / +0.5%
tpch_q04/duckdb:parquet 76340012 / 76532636 / -0.3% 96199905 / 97762896 / -1.6% 0.79 / 0.78 / +1.4%
tpch_q05/duckdb:parquet 123414068 / 123479542 / -0.1% 156983275 / 155668079 / +0.8% 0.79 / 0.79 / -0.9%
tpch_q06/duckdb:parquet 35265268 / 35931981 / -1.9% 58126774 / 56977323 / +2.0% 0.61 / 0.63 / -3.8%
tpch_q07/duckdb:parquet 117492494 / 119339250 / -1.5% 156341311 / 153627189 / +1.8% 0.75 / 0.78 / -3.3%
tpch_q08/duckdb:parquet 148622244 / 147255450 / +0.9% 194301465 / 190628929 / +1.9% 0.76 / 0.77 / -1.0%
tpch_q09/duckdb:parquet 235591456 / 235578554 / +0.0% 276681990 / 276803702 / -0.0% 0.85 / 0.85 / +0.0%
tpch_q10/duckdb:parquet 312233280 / 313587478 / -0.4% 336738431 / 337403692 / -0.2% 0.93 / 0.93 / -0.2%
tpch_q11/duckdb:parquet 43734316 / 43490479 / +0.6% 50736560 / 50005616 / +1.5% 0.86 / 0.87 / -0.9%
tpch_q12/duckdb:parquet 69872570 / 70505417 / -0.9% 90248321 / 90007679 / +0.3% 0.77 / 0.78 / -1.2%
tpch_q13/duckdb:parquet 293838473 / 293441858 / +0.1% 310567262 / 310736944 / -0.1% 0.95 / 0.94 / +0.2%
tpch_q14/duckdb:parquet 100560432 / 101133653 / -0.6% 138889428 / 136327535 / +1.9% 0.72 / 0.74 / -2.4%
tpch_q15/duckdb:parquet 58118245 / 57306184 / +1.4% 88689841 / 84972419 / +4.4% 0.66 / 0.67 / -2.8%
tpch_q16/duckdb:parquet 100470041 / 100633707 / -0.2% 107709736 / 107203047 / +0.5% 0.93 / 0.94 / -0.6%
tpch_q17/duckdb:parquet 83541280 / 83962666 / -0.5% 114746970 / 110031995 / +4.3% 0.73 / 0.76 / -4.6%
tpch_q18/duckdb:parquet 158143601 / 157083225 / +0.7% 175398021 / 172862922 / +1.5% 0.90 / 0.91 / -0.8%
tpch_q19/duckdb:parquet 98869866 / 98792583 / +0.1% 126470007 / 130377546 / -3.0% 0.78 / 0.76 / +3.2%
tpch_q20/duckdb:parquet 147119663 / 146971997 / +0.1% 183686154 / 181619680 / +1.1% 0.80 / 0.81 / -1.0%
tpch_q21/duckdb:parquet 251473165 / 254756250 / -1.3% 274651085 / 271034790 / +1.3% 0.92 / 0.94 / -2.6%
tpch_q22/duckdb:parquet 168731587 / 168406469 / +0.2% 179652109 / 179252698 / +0.2% 0.94 / 0.94 / -0.0%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 1d56e333 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): hot 1.019x ➖ · cold 0.968x ➖
Parquet (geomean): hot 1.005x ➖ · cold 0.968x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.008x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6118150 / 6250168 / -2.1% 19216683 / 19751173 / -2.7% 0.32 / 0.32 / +0.6%
fineweb_q01/datafusion:vortex-file-compressed 9427304 / 9285400 / +1.5% 35319385 / 35575139 / -0.7% 0.27 / 0.26 / +2.3%
fineweb_q02/datafusion:vortex-file-compressed 10554665 / 10567512 / -0.1% 39329175 / 40643432 / -3.2% 0.27 / 0.26 / +3.2%
fineweb_q03/datafusion:vortex-file-compressed 16742256 / 17539240 / -4.5% 103247067 / 102692107 / +0.5% 0.16 / 0.17 / -5.1%
fineweb_q04/datafusion:vortex-file-compressed 66153451 / 64090120 / +3.2% 142042571 / 144508483 / -1.7% 0.47 / 0.44 / +5.0%
fineweb_q05/datafusion:vortex-file-compressed 61768146 / 63203121 / -2.3% 137356512 / 139485427 / -1.5% 0.45 / 0.45 / -0.8%
fineweb_q06/datafusion:vortex-file-compressed 16399754 / 17269226 / -5.0% 97287376 / 106346388 / -8.5% 0.17 / 0.16 / +3.8%
fineweb_q07/datafusion:vortex-file-compressed 16448806 / 16748794 / -1.8% 103333071 / 103498538 / -0.2% 0.16 / 0.16 / -1.6%
fineweb_q08/datafusion:vortex-file-compressed 10227457 / 8455804 / +21.0% 🔴 29128804 / 26524896 / +9.8% 0.35 / 0.32 / +10.1%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9402271 / 9321344 / +0.9% 31385322 / 32543553 / -3.6% 0.30 / 0.29 / +4.6%
fineweb_q01/datafusion:parquet 74863198 / 75943192 / -1.4% 145931880 / 168115168 / -13.2% 🟢 0.51 / 0.45 / +13.6%
fineweb_q02/datafusion:parquet 75466716 / 75797688 / -0.4% 146477867 / 156430678 / -6.4% 0.52 / 0.48 / +6.3%
fineweb_q03/datafusion:parquet 75538142 / 73828035 / +2.3% 145581318 / 151042261 / -3.6% 0.52 / 0.49 / +6.2%
fineweb_q04/datafusion:parquet 82328332 / 82454360 / -0.2% 144823362 / 161665686 / -10.4% 🟢 0.57 / 0.51 / +11.5%
fineweb_q05/datafusion:parquet 81455516 / 81339953 / +0.1% 142573827 / 155427779 / -8.3% 0.57 / 0.52 / +9.2%
fineweb_q06/datafusion:parquet 76402747 / 76823475 / -0.5% 147971031 / 164720545 / -10.2% 🟢 0.52 / 0.47 / +10.7%
fineweb_q07/datafusion:parquet 72804998 / 73784924 / -1.3% 145940232 / 154776922 / -5.7% 0.50 / 0.48 / +4.6%
fineweb_q08/datafusion:parquet 73072626 / 73667172 / -0.8% 141703959 / 153339658 / -7.6% 0.52 / 0.48 / +7.3%
duckdb / vortex-file-compressed / ns (1.030x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2159432 / 2129396 / +1.4% 7269060 / 8430467 / -13.8% 🟢 0.30 / 0.25 / +17.6%
fineweb_q01/duckdb:vortex-file-compressed 8295202 / 7609840 / +9.0% 26055574 / 27699884 / -5.9% 0.32 / 0.27 / +15.9%
fineweb_q02/duckdb:vortex-file-compressed 10660324 / 8999654 / +18.5% 🔴 28159380 / 32238453 / -12.7% 🟢 0.38 / 0.28 / +35.6%
fineweb_q03/duckdb:vortex-file-compressed 17153646 / 17999961 / -4.7% 85874741 / 89729159 / -4.3% 0.20 / 0.20 / -0.4%
fineweb_q04/duckdb:vortex-file-compressed 61555244 / 64895256 / -5.1% 102569477 / 105319449 / -2.6% 0.60 / 0.62 / -2.6%
fineweb_q05/duckdb:vortex-file-compressed 63920865 / 64576607 / -1.0% 102202573 / 100642505 / +1.6% 0.63 / 0.64 / -2.5%
fineweb_q06/duckdb:vortex-file-compressed 18889462 / 17451004 / +8.2% 86944651 / 90997772 / -4.5% 0.22 / 0.19 / +13.3%
fineweb_q07/duckdb:vortex-file-compressed 18995302 / 17567882 / +8.1% 87953534 / 90262327 / -2.6% 0.22 / 0.19 / +11.0%
fineweb_q08/duckdb:vortex-file-compressed 4274924 / 4479276 / -4.6% 12385304 / 12680631 / -2.3% 0.35 / 0.35 / -2.3%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23868326 / 23575786 / +1.2% 27803881 / 27901054 / -0.3% 0.86 / 0.84 / +1.6%
fineweb_q01/duckdb:parquet 55787094 / 53435612 / +4.4% 72611045 / 71035947 / +2.2% 0.77 / 0.75 / +2.1%
fineweb_q02/duckdb:parquet 58938060 / 58133262 / +1.4% 79818331 / 71614459 / +11.5% 🔴 0.74 / 0.81 / -9.0%
fineweb_q03/duckdb:parquet 120434012 / 119431288 / +0.8% 180387483 / 174813976 / +3.2% 0.67 / 0.68 / -2.3%
fineweb_q04/duckdb:parquet 159608133 / 160054805 / -0.3% 208468097 / 201506963 / +3.5% 0.77 / 0.79 / -3.6%
fineweb_q05/duckdb:parquet 158558936 / 159362006 / -0.5% 192979883 / 199292933 / -3.2% 0.82 / 0.80 / +2.8%
fineweb_q06/duckdb:parquet 90411506 / 88786282 / +1.8% 146933135 / 152544283 / -3.7% 0.62 / 0.58 / +5.7%
fineweb_q07/duckdb:parquet 90437656 / 90890989 / -0.5% 140956937 / 143350764 / -1.7% 0.64 / 0.63 / +1.2%
fineweb_q08/duckdb:parquet 29434420 / 28981936 / +1.6% 30656119 / 30002232 / +2.2% 0.96 / 0.97 / -0.6%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 1d56e333 vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.020x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21802468 / 21999911 / -0.9% 41726735 / 39946370 / +4.5% 0.52 / 0.55 / -5.1%
tpcds_q02/datafusion:vortex-file-compressed 43576530 / 42893253 / +1.6% 66516567 / 62914880 / +5.7% 0.66 / 0.68 / -3.9%
tpcds_q03/datafusion:vortex-file-compressed 11737524 / 11605178 / +1.1% 27911033 / 26609156 / +4.9% 0.42 / 0.44 / -3.6%
tpcds_q04/datafusion:vortex-file-compressed 79414066 / 78951654 / +0.6% 112840977 / 104564818 / +7.9% 0.70 / 0.76 / -6.8%
tpcds_q05/datafusion:vortex-file-compressed 57883464 / 55941465 / +3.5% 77810645 / 74124262 / +5.0% 0.74 / 0.75 / -1.4%
tpcds_q06/datafusion:vortex-file-compressed 22048993 / 21333720 / +3.4% 41173197 / 41069841 / +0.3% 0.54 / 0.52 / +3.1%
tpcds_q07/datafusion:vortex-file-compressed 26334944 / 26386390 / -0.2% 51778865 / 48176326 / +7.5% 0.51 / 0.55 / -7.1%
tpcds_q08/datafusion:vortex-file-compressed 25773746 / 25587712 / +0.7% 43758183 / 43682364 / +0.2% 0.59 / 0.59 / +0.6%
tpcds_q09/datafusion:vortex-file-compressed 19883946 / 19896226 / -0.1% 38286940 / 37474977 / +2.2% 0.52 / 0.53 / -2.2%
tpcds_q10/datafusion:vortex-file-compressed 29673318 / 29546889 / +0.4% 53275332 / 51180613 / +4.1% 0.56 / 0.58 / -3.5%
tpcds_q11/datafusion:vortex-file-compressed 48879560 / 49121194 / -0.5% 77506763 / 75394766 / +2.8% 0.63 / 0.65 / -3.2%
tpcds_q12/datafusion:vortex-file-compressed 15039246 / 14946749 / +0.6% 34907261 / 31749886 / +9.9% 0.43 / 0.47 / -8.5%
tpcds_q13/datafusion:vortex-file-compressed 31722073 / 31860550 / -0.4% 58010730 / 53865238 / +7.7% 0.55 / 0.59 / -7.5%
tpcds_q14/datafusion:vortex-file-compressed 491037320 / 487421370 / +0.7% 543290151 / 542474028 / +0.2% 0.90 / 0.90 / +0.6%
tpcds_q15/datafusion:vortex-file-compressed 12513060 / 12586756 / -0.6% 32029482 / 29869991 / +7.2% 0.39 / 0.42 / -7.3%
tpcds_q16/datafusion:vortex-file-compressed 18873510 / 18761618 / +0.6% 39419591 / 37089591 / +6.3% 0.48 / 0.51 / -5.3%
tpcds_q17/datafusion:vortex-file-compressed 52623674 / 53607682 / -1.8% 76936917 / 70072689 / +9.8% 0.68 / 0.77 / -10.6%
tpcds_q18/datafusion:vortex-file-compressed 63422536 / 62349632 / +1.7% 75709359 / 88633124 / -14.6% 🟢 0.84 / 0.70 / +19.1%
tpcds_q19/datafusion:vortex-file-compressed 17143548 / 17064877 / +0.5% 40029625 / 38137570 / +5.0% 0.43 / 0.45 / -4.3%
tpcds_q20/datafusion:vortex-file-compressed 16743032 / 16875604 / -0.8% 33535979 / 33398462 / +0.4% 0.50 / 0.51 / -1.2%
tpcds_q21/datafusion:vortex-file-compressed 15103640 / 14801170 / +2.0% 34888239 / 32973615 / +5.8% 0.43 / 0.45 / -3.6%
tpcds_q22/datafusion:vortex-file-compressed 49091324 / 49325762 / -0.5% 72486946 / 67699156 / +7.1% 0.68 / 0.73 / -7.0%
tpcds_q23/datafusion:vortex-file-compressed 72017579 / 72276124 / -0.4% 101446041 / 97272882 / +4.3% 0.71 / 0.74 / -4.5%
tpcds_q24/datafusion:vortex-file-compressed 63708980 / 63926868 / -0.3% 87403621 / 83129432 / +5.1% 0.73 / 0.77 / -5.2%
tpcds_q25/datafusion:vortex-file-compressed 45427003 / 44475855 / +2.1% 71552986 / 66779639 / +7.1% 0.63 / 0.67 / -4.7%
tpcds_q26/datafusion:vortex-file-compressed 27264719 / 26101808 / +4.5% 46008286 / 45977400 / +0.1% 0.59 / 0.57 / +4.4%
tpcds_q27/datafusion:vortex-file-compressed 50830568 / 53289153 / -4.6% 71881091 / 76338183 / -5.8% 0.71 / 0.70 / +1.3%
tpcds_q28/datafusion:vortex-file-compressed 20003914 / 19381416 / +3.2% 37716768 / 39922526 / -5.5% 0.53 / 0.49 / +9.2%
tpcds_q29/datafusion:vortex-file-compressed 52617057 / 52347589 / +0.5% 77683650 / 73566264 / +5.6% 0.68 / 0.71 / -4.8%
tpcds_q30/datafusion:vortex-file-compressed 27714277 / 27661427 / +0.2% 46849502 / 45075272 / +3.9% 0.59 / 0.61 / -3.6%
tpcds_q31/datafusion:vortex-file-compressed 62754574 / 62516696 / +0.4% 91175129 / 87634339 / +4.0% 0.69 / 0.71 / -3.5%
tpcds_q32/datafusion:vortex-file-compressed 12915035 / 13025350 / -0.8% 30201797 / 30062663 / +0.5% 0.43 / 0.43 / -1.3%
tpcds_q33/datafusion:vortex-file-compressed 28327626 / 27991706 / +1.2% 51471792 / 50078992 / +2.8% 0.55 / 0.56 / -1.5%
tpcds_q34/datafusion:vortex-file-compressed 17585742 / 17855906 / -1.5% 39839354 / 36650085 / +8.7% 0.44 / 0.49 / -9.4%
tpcds_q35/datafusion:vortex-file-compressed 30763717 / 31075584 / -1.0% 53876395 / 54010849 / -0.2% 0.57 / 0.58 / -0.8%
tpcds_q36/datafusion:vortex-file-compressed 47526210 / 46691248 / +1.8% 70989702 / 69134076 / +2.7% 0.67 / 0.68 / -0.9%
tpcds_q37/datafusion:vortex-file-compressed 12183807 / 12935278 / -5.8% 36988836 / 33965509 / +8.9% 0.33 / 0.38 / -13.5%
tpcds_q38/datafusion:vortex-file-compressed 25900970 / 26436550 / -2.0% 50379978 / 46500479 / +8.3% 0.51 / 0.57 / -9.6%
tpcds_q39/datafusion:vortex-file-compressed 64582614 / 64408856 / +0.3% 89088332 / 87056639 / +2.3% 0.72 / 0.74 / -2.0%
tpcds_q40/datafusion:vortex-file-compressed 23036241 / 22195258 / +3.8% 40521624 / 39059042 / +3.7% 0.57 / 0.57 / +0.0%
tpcds_q41/datafusion:vortex-file-compressed 19965661 / 20181415 / -1.1% 33233139 / 32305841 / +2.9% 0.60 / 0.62 / -3.8%
tpcds_q42/datafusion:vortex-file-compressed 11551874 / 11610268 / -0.5% 28825762 / 27549864 / +4.6% 0.40 / 0.42 / -4.9%
tpcds_q43/datafusion:vortex-file-compressed 13187572 / 13251107 / -0.5% 35164459 / 31511768 / +11.6% 🔴 0.38 / 0.42 / -10.8%
tpcds_q44/datafusion:vortex-file-compressed 27575940 / 27407222 / +0.6% 51698610 / 49901538 / +3.6% 0.53 / 0.55 / -2.9%
tpcds_q45/datafusion:vortex-file-compressed 16820079 / 17168016 / -2.0% 35646555 / 34200247 / +4.2% 0.47 / 0.50 / -6.0%
tpcds_q46/datafusion:vortex-file-compressed 24022240 / 23558210 / +2.0% 47266109 / 45525195 / +3.8% 0.51 / 0.52 / -1.8%
tpcds_q47/datafusion:vortex-file-compressed 74696289 / 75593490 / -1.2% 105507965 / 103395942 / +2.0% 0.71 / 0.73 / -3.2%
tpcds_q48/datafusion:vortex-file-compressed 28834858 / 28579330 / +0.9% 54988743 / 51250463 / +7.3% 0.52 / 0.56 / -6.0%
tpcds_q49/datafusion:vortex-file-compressed 58754258 / 57212074 / +2.7% 76707473 / 74563681 / +2.9% 0.77 / 0.77 / -0.2%
tpcds_q50/datafusion:vortex-file-compressed 30721327 / 31077502 / -1.1% 54014238 / 51768133 / +4.3% 0.57 / 0.60 / -5.3%
tpcds_q51/datafusion:vortex-file-compressed 67790616 / 67219460 / +0.8% 92628775 / 89984116 / +2.9% 0.73 / 0.75 / -2.0%
tpcds_q52/datafusion:vortex-file-compressed 11838688 / 11829058 / +0.1% 27870123 / 28624926 / -2.6% 0.42 / 0.41 / +2.8%
tpcds_q53/datafusion:vortex-file-compressed 18292564 / 18240894 / +0.3% 39681999 / 37934996 / +4.6% 0.46 / 0.48 / -4.1%
tpcds_q54/datafusion:vortex-file-compressed 32593510 / 32073801 / +1.6% 56873882 / 53625583 / +6.1% 0.57 / 0.60 / -4.2%
tpcds_q55/datafusion:vortex-file-compressed 11462084 / 11528832 / -0.6% 28391459 / 27437884 / +3.5% 0.40 / 0.42 / -3.9%
tpcds_q56/datafusion:vortex-file-compressed 26867748 / 26666916 / +0.8% 47407730 / 47448670 / -0.1% 0.57 / 0.56 / +0.8%
tpcds_q57/datafusion:vortex-file-compressed 62308210 / 62012122 / +0.5% 89139659 / 87267119 / +2.1% 0.70 / 0.71 / -1.6%
tpcds_q58/datafusion:vortex-file-compressed 40608956 / 40818922 / -0.5% 68107663 / 64518211 / +5.6% 0.60 / 0.63 / -5.8%
tpcds_q59/datafusion:vortex-file-compressed 27498426 / 27906409 / -1.5% 55287435 / 53781464 / +2.8% 0.50 / 0.52 / -4.1%
tpcds_q60/datafusion:vortex-file-compressed 26891724 / 27726237 / -3.0% 48530146 / 47532249 / +2.1% 0.55 / 0.58 / -5.0%
tpcds_q61/datafusion:vortex-file-compressed 20465466 / 20214066 / +1.2% 42032553 / 39682747 / +5.9% 0.49 / 0.51 / -4.4%
tpcds_q62/datafusion:vortex-file-compressed 16524504 / 16850174 / -1.9% 36305236 / 34396629 / +5.5% 0.46 / 0.49 / -7.1%
tpcds_q63/datafusion:vortex-file-compressed 18058478 / 18192128 / -0.7% 40293750 / 37641254 / +7.0% 0.45 / 0.48 / -7.3%
tpcds_q64/datafusion:vortex-file-compressed 189619070 / 188561892 / +0.6% 221308930 / 229680212 / -3.6% 0.86 / 0.82 / +4.4%
tpcds_q65/datafusion:vortex-file-compressed 73762882 / 73066724 / +1.0% 96831082 / 96562612 / +0.3% 0.76 / 0.76 / +0.7%
tpcds_q66/datafusion:vortex-file-compressed 49886599 / 50096568 / -0.4% 71646808 / 69306342 / +3.4% 0.70 / 0.72 / -3.7%
tpcds_q67/datafusion:vortex-file-compressed 51256734 / 51663640 / -0.8% 84955751 / 83492505 / +1.8% 0.60 / 0.62 / -2.5%
tpcds_q68/datafusion:vortex-file-compressed 23192995 / 22888054 / +1.3% 44690537 / 44101071 / +1.3% 0.52 / 0.52 / -0.0%
tpcds_q69/datafusion:vortex-file-compressed 28087703 / 27546142 / +2.0% 48219615 / 47372016 / +1.8% 0.58 / 0.58 / +0.2%
tpcds_q70/datafusion:vortex-file-compressed 73568304 / 73486667 / +0.1% 96614057 / 97916702 / -1.3% 0.76 / 0.75 / +1.5%
tpcds_q71/datafusion:vortex-file-compressed 19077114 / 19173117 / -0.5% 38443545 / 37641700 / +2.1% 0.50 / 0.51 / -2.6%
tpcds_q72/datafusion:vortex-file-compressed 264784364 / 247376824 / +7.0% 278955514 / 279389691 / -0.2% 0.95 / 0.89 / +7.2%
tpcds_q73/datafusion:vortex-file-compressed 16398522 / 16283788 / +0.7% 37889539 / 37287301 / +1.6% 0.43 / 0.44 / -0.9%
tpcds_q74/datafusion:vortex-file-compressed 40816423 / 40826743 / -0.0% 65570024 / 66742487 / -1.8% 0.62 / 0.61 / +1.8%
tpcds_q75/datafusion:vortex-file-compressed 134726557 / 133968630 / +0.6% 162383430 / 162666038 / -0.2% 0.83 / 0.82 / +0.7%
tpcds_q76/datafusion:vortex-file-compressed 29514686 / 28638050 / +3.1% 49581703 / 48545831 / +2.1% 0.60 / 0.59 / +0.9%
tpcds_q77/datafusion:vortex-file-compressed 44978760 / 44422120 / +1.3% 69857429 / 65708594 / +6.3% 0.64 / 0.68 / -4.8%
tpcds_q78/datafusion:vortex-file-compressed 61201798 / 60965657 / +0.4% 89510514 / 86015972 / +4.1% 0.68 / 0.71 / -3.5%
tpcds_q79/datafusion:vortex-file-compressed 20358606 / 20279438 / +0.4% 45018828 / 42110377 / +6.9% 0.45 / 0.48 / -6.1%
tpcds_q80/datafusion:vortex-file-compressed 69501288 / 68766030 / +1.1% 100429869 / 93570722 / +7.3% 0.69 / 0.73 / -5.8%
tpcds_q81/datafusion:vortex-file-compressed 28540371 / 28260648 / +1.0% 47891044 / 45300560 / +5.7% 0.60 / 0.62 / -4.5%
tpcds_q82/datafusion:vortex-file-compressed 12296835 / 12807434 / -4.0% 35655179 / 35626130 / +0.1% 0.34 / 0.36 / -4.1%
tpcds_q83/datafusion:vortex-file-compressed 35089679 / 35376074 / -0.8% 53711215 / 52093141 / +3.1% 0.65 / 0.68 / -3.8%
tpcds_q84/datafusion:vortex-file-compressed 11207986 / 10461540 / +7.1% 28019603 / 25885722 / +8.2% 0.40 / 0.40 / -1.0%
tpcds_q85/datafusion:vortex-file-compressed 52370599 / 51809666 / +1.1% 81237093 / 75574697 / +7.5% 0.64 / 0.69 / -6.0%
tpcds_q86/datafusion:vortex-file-compressed 16359148 / 16113415 / +1.5% 35274916 / 34409002 / +2.5% 0.46 / 0.47 / -1.0%
tpcds_q87/datafusion:vortex-file-compressed 26428640 / 26499568 / -0.3% 51584683 / 48598250 / +6.1% 0.51 / 0.55 / -6.0%
tpcds_q88/datafusion:vortex-file-compressed 32642176 / 32357568 / +0.9% 53116853 / 50858837 / +4.4% 0.61 / 0.64 / -3.4%
tpcds_q89/datafusion:vortex-file-compressed 21802394 / 21807304 / -0.0% 44522422 / 42407282 / +5.0% 0.49 / 0.51 / -4.8%
tpcds_q90/datafusion:vortex-file-compressed 10240374 / 10365216 / -1.2% 26252731 / 24066050 / +9.1% 0.39 / 0.43 / -9.4%
tpcds_q91/datafusion:vortex-file-compressed 15507474 / 16048840 / -3.4% 37415802 / 36604324 / +2.2% 0.41 / 0.44 / -5.5%
tpcds_q92/datafusion:vortex-file-compressed 13255583 / 13198902 / +0.4% 29758823 / 29685220 / +0.2% 0.45 / 0.44 / +0.2%
tpcds_q93/datafusion:vortex-file-compressed 20565572 / 20150414 / +2.1% 42847075 / 40148939 / +6.7% 0.48 / 0.50 / -4.4%
tpcds_q94/datafusion:vortex-file-compressed 18873734 / 18552985 / +1.7% 39462923 / 37927246 / +4.0% 0.48 / 0.49 / -2.2%
tpcds_q95/datafusion:vortex-file-compressed 42248242 / 41763500 / +1.2% 62807939 / 60866535 / +3.2% 0.67 / 0.69 / -2.0%
tpcds_q96/datafusion:vortex-file-compressed 7908164 / 7859994 / +0.6% 27315062 / 23576532 / +15.9% 🔴 0.29 / 0.33 / -13.2%
tpcds_q97/datafusion:vortex-file-compressed 17676251 / 17259486 / +2.4% 42184356 / 37350276 / +12.9% 🔴 0.42 / 0.46 / -9.3%
tpcds_q98/datafusion:vortex-file-compressed 16289180 / 16185816 / +0.6% 35717668 / 32671739 / +9.3% 0.46 / 0.50 / -7.9%
tpcds_q99/datafusion:vortex-file-compressed 16540960 / 16384194 / +1.0% 35512296 / 33993322 / +4.5% 0.47 / 0.48 / -3.4%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42646641 / 43046149 / -0.9% 61178631 / 59333915 / +3.1% 0.70 / 0.73 / -3.9%
tpcds_q02/datafusion:parquet 55121161 / 55017496 / +0.2% 69904278 / 69006470 / +1.3% 0.79 / 0.80 / -1.1%
tpcds_q03/datafusion:parquet 19120902 / 19078092 / +0.2% 30426386 / 32968281 / -7.7% 0.63 / 0.58 / +8.6%
tpcds_q04/datafusion:parquet 179463754 / 179731768 / -0.1% 203932721 / 199226926 / +2.4% 0.88 / 0.90 / -2.5%
tpcds_q05/datafusion:parquet 68527983 / 68363662 / +0.2% 87323470 / 88310082 / -1.1% 0.78 / 0.77 / +1.4%
tpcds_q06/datafusion:parquet 33151810 / 35133400 / -5.6% 47532437 / 44032369 / +7.9% 0.70 / 0.80 / -12.6%
tpcds_q07/datafusion:parquet 47490468 / 47015244 / +1.0% 65577593 / 63060866 / +4.0% 0.72 / 0.75 / -2.9%
tpcds_q08/datafusion:parquet 31602744 / 31108916 / +1.6% 45132693 / 46407336 / -2.7% 0.70 / 0.67 / +4.5%
tpcds_q09/datafusion:parquet 32023861 / 32235404 / -0.7% 48028467 / 38162448 / +25.9% 🔴 0.67 / 0.84 / -21.1%
tpcds_q10/datafusion:parquet 43648894 / 45810956 / -4.7% 59591293 / 55821116 / +6.8% 0.73 / 0.82 / -10.7%
tpcds_q11/datafusion:parquet 96589403 / 97324552 / -0.8% 119651696 / 116986930 / +2.3% 0.81 / 0.83 / -3.0%
tpcds_q12/datafusion:parquet 23783860 / 23829389 / -0.2% 36307735 / 34561700 / +5.1% 0.66 / 0.69 / -5.0%
tpcds_q13/datafusion:parquet 46517338 / 47205746 / -1.5% 66776487 / 66519722 / +0.4% 0.70 / 0.71 / -1.8%
tpcds_q14/datafusion:parquet 535078648 / 536062596 / -0.2% 577655956 / 573875357 / +0.7% 0.93 / 0.93 / -0.8%
tpcds_q15/datafusion:parquet 24174484 / 23467316 / +3.0% 38451301 / 36912696 / +4.2% 0.63 / 0.64 / -1.1%
tpcds_q16/datafusion:parquet 36755388 / 36797934 / -0.1% 49956856 / 49093338 / +1.8% 0.74 / 0.75 / -1.8%
tpcds_q17/datafusion:parquet 74309546 / 77417738 / -4.0% 96304504 / 94152957 / +2.3% 0.77 / 0.82 / -6.2%
tpcds_q18/datafusion:parquet 65736507 / 67730459 / -2.9% 92004149 / 89015478 / +3.4% 0.71 / 0.76 / -6.1%
tpcds_q19/datafusion:parquet 29489302 / 29767255 / -0.9% 43104722 / 40859608 / +5.5% 0.68 / 0.73 / -6.1%
tpcds_q20/datafusion:parquet 25053264 / 24985466 / +0.3% 37912430 / 37149008 / +2.1% 0.66 / 0.67 / -1.7%
tpcds_q21/datafusion:parquet 20274832 / 20098942 / +0.9% 32102751 / 31199048 / +2.9% 0.63 / 0.64 / -2.0%
tpcds_q22/datafusion:parquet 77280511 / 78225004 / -1.2% 88873676 / 88011450 / +1.0% 0.87 / 0.89 / -2.2%
tpcds_q23/datafusion:parquet 93590098 / 93465786 / +0.1% 117712025 / 115763272 / +1.7% 0.80 / 0.81 / -1.5%
tpcds_q24/datafusion:parquet 90964023 / 90530880 / +0.5% 114823719 / 112774834 / +1.8% 0.79 / 0.80 / -1.3%
tpcds_q25/datafusion:parquet 82084519 / 78942378 / +4.0% 98001374 / 100286343 / -2.3% 0.84 / 0.79 / +6.4%
tpcds_q26/datafusion:parquet 43189958 / 42985690 / +0.5% 59656007 / 59286646 / +0.6% 0.72 / 0.73 / -0.1%
tpcds_q27/datafusion:parquet 74332470 / 78387144 / -5.2% 99476605 / 99975873 / -0.5% 0.75 / 0.78 / -4.7%
tpcds_q28/datafusion:parquet 28360982 / 28355490 / +0.0% 43538188 / 41055918 / +6.0% 0.65 / 0.69 / -5.7%
tpcds_q29/datafusion:parquet 75335322 / 74275574 / +1.4% 96093652 / 99075419 / -3.0% 0.78 / 0.75 / +4.6%
tpcds_q30/datafusion:parquet 45508512 / 44266542 / +2.8% 58493123 / 55134805 / +6.1% 0.78 / 0.80 / -3.1%
tpcds_q31/datafusion:parquet 81242600 / 80991932 / +0.3% 96551187 / 100088488 / -3.5% 0.84 / 0.81 / +4.0%
tpcds_q32/datafusion:parquet 26289490 / 27160338 / -3.2% 36869042 / 37888363 / -2.7% 0.71 / 0.72 / -0.5%
tpcds_q33/datafusion:parquet 37171432 / 37472210 / -0.8% 55271283 / 52784833 / +4.7% 0.67 / 0.71 / -5.3%
tpcds_q34/datafusion:parquet 24206998 / 24223199 / -0.1% 35880134 / 34925847 / +2.7% 0.67 / 0.69 / -2.7%
tpcds_q35/datafusion:parquet 50548734 / 50061658 / +1.0% 64414462 / 66186392 / -2.7% 0.78 / 0.76 / +3.8%
tpcds_q36/datafusion:parquet 52592254 / 53863620 / -2.4% 76002651 / 72008538 / +5.5% 0.69 / 0.75 / -7.5%
tpcds_q37/datafusion:parquet 21509190 / 21492292 / +0.1% 33931735 / 33965178 / -0.1% 0.63 / 0.63 / +0.2%
tpcds_q38/datafusion:parquet 43639876 / 43738358 / -0.2% 63294894 / 58984516 / +7.3% 0.69 / 0.74 / -7.0%
tpcds_q39/datafusion:parquet 68325378 / 68451454 / -0.2% 84940773 / 84694449 / +0.3% 0.80 / 0.81 / -0.5%
tpcds_q40/datafusion:parquet 31185176 / 29898065 / +4.3% 49717947 / 49416081 / +0.6% 0.63 / 0.61 / +3.7%
tpcds_q41/datafusion:parquet 19878246 / 19725044 / +0.8% 31552622 / 31567276 / -0.0% 0.63 / 0.62 / +0.8%
tpcds_q42/datafusion:parquet 18239628 / 18410036 / -0.9% 31945498 / 29096386 / +9.8% 0.57 / 0.63 / -9.8%
tpcds_q43/datafusion:parquet 19517752 / 19482850 / +0.2% 31610831 / 30496940 / +3.7% 0.62 / 0.64 / -3.4%
tpcds_q44/datafusion:parquet 35999824 / 35289568 / +2.0% 49156448 / 48402674 / +1.6% 0.73 / 0.73 / +0.4%
tpcds_q45/datafusion:parquet 27892352 / 28034722 / -0.5% 40821545 / 38421721 / +6.2% 0.68 / 0.73 / -6.4%
tpcds_q46/datafusion:parquet 29019407 / 29018574 / +0.0% 45222564 / 44678861 / +1.2% 0.64 / 0.65 / -1.2%
tpcds_q47/datafusion:parquet 98153781 / 96614053 / +1.6% 120134100 / 119575121 / +0.5% 0.82 / 0.81 / +1.1%
tpcds_q48/datafusion:parquet 42912618 / 42307228 / +1.4% 60322205 / 57749935 / +4.5% 0.71 / 0.73 / -2.9%
tpcds_q49/datafusion:parquet 72514660 / 72427164 / +0.1% 93920373 / 91585118 / +2.5% 0.77 / 0.79 / -2.4%
tpcds_q50/datafusion:parquet 47119088 / 47500422 / -0.8% 67282549 / 68227695 / -1.4% 0.70 / 0.70 / +0.6%
tpcds_q51/datafusion:parquet 75204001 / 74856850 / +0.5% 94757330 / 94480088 / +0.3% 0.79 / 0.79 / +0.2%
tpcds_q52/datafusion:parquet 18607379 / 18570137 / +0.2% 30152339 / 28281276 / +6.6% 0.62 / 0.66 / -6.0%
tpcds_q53/datafusion:parquet 22429182 / 21996628 / +2.0% 39063042 / 37632392 / +3.8% 0.57 / 0.58 / -1.8%
tpcds_q54/datafusion:parquet 52902142 / 53403201 / -0.9% 68313829 / 65412957 / +4.4% 0.77 / 0.82 / -5.1%
tpcds_q55/datafusion:parquet 18300398 / 18094322 / +1.1% 30528672 / 28452535 / +7.3% 0.60 / 0.64 / -5.7%
tpcds_q56/datafusion:parquet 40563517 / 42064521 / -3.6% 55254449 / 52494093 / +5.3% 0.73 / 0.80 / -8.4%
tpcds_q57/datafusion:parquet 101875522 / 98531152 / +3.4% 120020810 / 115051750 / +4.3% 0.85 / 0.86 / -0.9%
tpcds_q58/datafusion:parquet 65272176 / 66028114 / -1.1% 82670309 / 80484923 / +2.7% 0.79 / 0.82 / -3.8%
tpcds_q59/datafusion:parquet 47114824 / 48124550 / -2.1% 65837672 / 63375622 / +3.9% 0.72 / 0.76 / -5.8%
tpcds_q60/datafusion:parquet 40949577 / 41774428 / -2.0% 51671304 / 52913053 / -2.3% 0.79 / 0.79 / +0.4%
tpcds_q61/datafusion:parquet 37563140 / 36568854 / +2.7% 53066097 / 53842276 / -1.4% 0.71 / 0.68 / +4.2%
tpcds_q62/datafusion:parquet 25328882 / 25168784 / +0.6% 38249600 / 38657488 / -1.1% 0.66 / 0.65 / +1.7%
tpcds_q63/datafusion:parquet 22282566 / 22467320 / -0.8% 38078848 / 36224907 / +5.1% 0.59 / 0.62 / -5.7%
tpcds_q64/datafusion:parquet 287272845 / 285654170 / +0.6% 324014799 / 321241476 / +0.9% 0.89 / 0.89 / -0.3%
tpcds_q65/datafusion:parquet 119759726 / 119227688 / +0.4% 142181899 / 139579808 / +1.9% 0.84 / 0.85 / -1.4%
tpcds_q66/datafusion:parquet 61016088 / 61287888 / -0.4% 78675312 / 75163315 / +4.7% 0.78 / 0.82 / -4.9%
tpcds_q67/datafusion:parquet 69069416 / 69044428 / +0.0% 92258453 / 91696967 / +0.6% 0.75 / 0.75 / -0.6%
tpcds_q68/datafusion:parquet 29062128 / 29075160 / -0.0% 47660511 / 47405672 / +0.5% 0.61 / 0.61 / -0.6%
tpcds_q69/datafusion:parquet 44714892 / 43304174 / +3.3% 58178435 / 58652073 / -0.8% 0.77 / 0.74 / +4.1%
tpcds_q70/datafusion:parquet 82445192 / 80027439 / +3.0% 97554082 / 97604918 / -0.1% 0.85 / 0.82 / +3.1%
tpcds_q71/datafusion:parquet 25090523 / 25732466 / -2.5% 40132416 / 40528677 / -1.0% 0.63 / 0.63 / -1.5%
tpcds_q72/datafusion:parquet 522630789 / 527634840 / -0.9% 556567487 / 554349016 / +0.4% 0.94 / 0.95 / -1.3%
tpcds_q73/datafusion:parquet 23799480 / 23762050 / +0.2% 36436351 / 35077300 / +3.9% 0.65 / 0.68 / -3.6%
tpcds_q74/datafusion:parquet 69879314 / 69999536 / -0.2% 89512731 / 88289509 / +1.4% 0.78 / 0.79 / -1.5%
tpcds_q75/datafusion:parquet 154410414 / 152662930 / +1.1% 175854801 / 180450074 / -2.5% 0.88 / 0.85 / +3.8%
tpcds_q76/datafusion:parquet 33612048 / 33132911 / +1.4% 48444620 / 44935481 / +7.8% 0.69 / 0.74 / -5.9%
tpcds_q77/datafusion:parquet 56829018 / 56979256 / -0.3% 71622774 / 72969812 / -1.8% 0.79 / 0.78 / +1.6%
tpcds_q78/datafusion:parquet 84208940 / 85272162 / -1.2% 118302861 / 115614404 / +2.3% 0.71 / 0.74 / -3.5%
tpcds_q79/datafusion:parquet 26555100 / 26735792 / -0.7% 41552671 / 39769716 / +4.5% 0.64 / 0.67 / -4.9%
tpcds_q80/datafusion:parquet 78731700 / 78680880 / +0.1% 109690853 / 107863155 / +1.7% 0.72 / 0.73 / -1.6%
tpcds_q81/datafusion:parquet 39196374 / 39558134 / -0.9% 52627764 / 51081109 / +3.0% 0.74 / 0.77 / -3.8%
tpcds_q82/datafusion:parquet 21937980 / 22190428 / -1.1% 35341310 / 34291795 / +3.1% 0.62 / 0.65 / -4.1%
tpcds_q83/datafusion:parquet 58585912 / 58307740 / +0.5% 76824702 / 73002134 / +5.2% 0.76 / 0.80 / -4.5%
tpcds_q84/datafusion:parquet 27007754 / 27313596 / -1.1% 40911139 / 40041516 / +2.2% 0.66 / 0.68 / -3.2%
tpcds_q85/datafusion:parquet 80847325 / 79983598 / +1.1% 102198860 / 102306985 / -0.1% 0.79 / 0.78 / +1.2%
tpcds_q86/datafusion:parquet 20756083 / 21058438 / -1.4% 32871824 / 32574181 / +0.9% 0.63 / 0.65 / -2.3%
tpcds_q87/datafusion:parquet 44109112 / 45280914 / -2.6% 60989093 / 62384128 / -2.2% 0.72 / 0.73 / -0.4%
tpcds_q88/datafusion:parquet 37907835 / 37757294 / +0.4% 50314290 / 51820809 / -2.9% 0.75 / 0.73 / +3.4%
tpcds_q89/datafusion:parquet 25698391 / 26318301 / -2.4% 41033353 / 39991728 / +2.6% 0.63 / 0.66 / -4.8%
tpcds_q90/datafusion:parquet 15540148 / 15087966 / +3.0% 27437967 / 26597960 / +3.2% 0.57 / 0.57 / -0.2%
tpcds_q91/datafusion:parquet 31866736 / 32625398 / -2.3% 47588546 / 45196471 / +5.3% 0.67 / 0.72 / -7.2%
tpcds_q92/datafusion:parquet 26849173 / 26834922 / +0.1% 40033581 / 38063167 / +5.2% 0.67 / 0.71 / -4.9%
tpcds_q93/datafusion:parquet 27343686 / 26735974 / +2.3% 46761959 / 42486273 / +10.1% 🔴 0.58 / 0.63 / -7.1%
tpcds_q94/datafusion:parquet 35000052 / 35393988 / -1.1% 48496518 / 47118664 / +2.9% 0.72 / 0.75 / -3.9%
tpcds_q95/datafusion:parquet 65075236 / 64212454 / +1.3% 81665446 / 79492966 / +2.7% 0.80 / 0.81 / -1.4%
tpcds_q96/datafusion:parquet 12971468 / 12723054 / +2.0% 24605996 / 23429883 / +5.0% 0.53 / 0.54 / -2.9%
tpcds_q97/datafusion:parquet 35345950 / 35098156 / +0.7% 51559751 / 49335860 / +4.5% 0.69 / 0.71 / -3.6%
tpcds_q98/datafusion:parquet 24616868 / 25139323 / -2.1% 38171817 / 36349537 / +5.0% 0.64 / 0.69 / -6.8%
tpcds_q99/datafusion:parquet 29625018 / 29673968 / -0.2% 41778382 / 41366470 / +1.0% 0.71 / 0.72 / -1.1%
duckdb / vortex-file-compressed / ns (0.986x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15637648 / 15890239 / -1.6% 24343536 / 24196641 / +0.6% 0.64 / 0.66 / -2.2%
tpcds_q02/duckdb:vortex-file-compressed 15077136 / 18657920 / -19.2% 🟢 22304836 / 22422968 / -0.5% 0.68 / 0.83 / -18.8%
tpcds_q03/duckdb:vortex-file-compressed 6983144 / 7149274 / -2.3% 16441601 / 16220757 / +1.4% 0.42 / 0.44 / -3.6%
tpcds_q04/duckdb:vortex-file-compressed 58919584 / 58862208 / +0.1% 70230765 / 71856038 / -2.3% 0.84 / 0.82 / +2.4%
tpcds_q05/duckdb:vortex-file-compressed 22749162 / 23117854 / -1.6% 32039240 / 32942130 / -2.7% 0.71 / 0.70 / +1.2%
tpcds_q06/duckdb:vortex-file-compressed 23781373 / 24164680 / -1.6% 38616336 / 37874428 / +2.0% 0.62 / 0.64 / -3.5%
tpcds_q07/duckdb:vortex-file-compressed 22080338 / 22109802 / -0.1% 34072388 / 32504438 / +4.8% 0.65 / 0.68 / -4.7%
tpcds_q08/duckdb:vortex-file-compressed 17270157 / 17492722 / -1.3% 25226625 / 25089879 / +0.5% 0.68 / 0.70 / -1.8%
tpcds_q09/duckdb:vortex-file-compressed 18758850 / 19005454 / -1.3% 29427071 / 29541405 / -0.4% 0.64 / 0.64 / -0.9%
tpcds_q10/duckdb:vortex-file-compressed 27015394 / 27533383 / -1.9% 41216226 / 41135181 / +0.2% 0.66 / 0.67 / -2.1%
tpcds_q11/duckdb:vortex-file-compressed 36139304 / 36618646 / -1.3% 45113159 / 44343100 / +1.7% 0.80 / 0.83 / -3.0%
tpcds_q12/duckdb:vortex-file-compressed 9695752 / 9679752 / +0.2% 15239597 / 17229625 / -11.6% 🟢 0.64 / 0.56 / +13.2%
tpcds_q13/duckdb:vortex-file-compressed 19040986 / 19843352 / -4.0% 31529036 / 31995768 / -1.5% 0.60 / 0.62 / -2.6%
tpcds_q14/duckdb:vortex-file-compressed 54835561 / 55297112 / -0.8% 64377299 / 64955646 / -0.9% 0.85 / 0.85 / +0.1%
tpcds_q15/duckdb:vortex-file-compressed 11048244 / 11325009 / -2.4% 17023244 / 18325444 / -7.1% 0.65 / 0.62 / +5.0%
tpcds_q16/duckdb:vortex-file-compressed 24465230 / 24731064 / -1.1% 35866316 / 34853379 / +2.9% 0.68 / 0.71 / -3.9%
tpcds_q17/duckdb:vortex-file-compressed 20080828 / 20396798 / -1.5% 32821985 / 32338231 / +1.5% 0.61 / 0.63 / -3.0%
tpcds_q18/duckdb:vortex-file-compressed 31808300 / 32346349 / -1.7% 42962312 / 43278488 / -0.7% 0.74 / 0.75 / -0.9%
tpcds_q19/duckdb:vortex-file-compressed 20411379 / 20786617 / -1.8% 30211833 / 29101806 / +3.8% 0.68 / 0.71 / -5.4%
tpcds_q20/duckdb:vortex-file-compressed 10512866 / 10704608 / -1.8% 17233450 / 17476285 / -1.4% 0.61 / 0.61 / -0.4%
tpcds_q21/duckdb:vortex-file-compressed 9353046 / 9371898 / -0.2% 22078816 / 21703364 / +1.7% 0.42 / 0.43 / -1.9%
tpcds_q22/duckdb:vortex-file-compressed 17440035 / 17643249 / -1.2% 29231127 / 29161310 / +0.2% 0.60 / 0.61 / -1.4%
tpcds_q23/duckdb:vortex-file-compressed 37489569 / 37431455 / +0.2% 49237776 / 48459168 / +1.6% 0.76 / 0.77 / -1.4%
tpcds_q24/duckdb:vortex-file-compressed 26331202 / 26441519 / -0.4% 36580604 / 36595428 / -0.0% 0.72 / 0.72 / -0.4%
tpcds_q25/duckdb:vortex-file-compressed 18901554 / 19221668 / -1.7% 32248529 / 30221864 / +6.7% 0.59 / 0.64 / -7.8%
tpcds_q26/duckdb:vortex-file-compressed 20984594 / 21300105 / -1.5% 31703223 / 31212707 / +1.6% 0.66 / 0.68 / -3.0%
tpcds_q27/duckdb:vortex-file-compressed 24349524 / 24807916 / -1.8% 37087493 / 35637087 / +4.1% 0.66 / 0.70 / -5.7%
tpcds_q28/duckdb:vortex-file-compressed 15037895 / 15090790 / -0.4% 26481738 / 25912108 / +2.2% 0.57 / 0.58 / -2.5%
tpcds_q29/duckdb:vortex-file-compressed 18601762 / 18678136 / -0.4% 30886900 / 29174081 / +5.9% 0.60 / 0.64 / -5.9%
tpcds_q30/duckdb:vortex-file-compressed 18278564 / 18682425 / -2.2% 27905185 / 27172488 / +2.7% 0.66 / 0.69 / -4.7%
tpcds_q31/duckdb:vortex-file-compressed 17708224 / 17961668 / -1.4% 26570489 / 26844104 / -1.0% 0.67 / 0.67 / -0.4%
tpcds_q32/duckdb:vortex-file-compressed 10374972 / 10237077 / +1.3% 18830110 / 18081369 / +4.1% 0.55 / 0.57 / -2.7%
tpcds_q33/duckdb:vortex-file-compressed 17650943 / 17651904 / -0.0% 27964372 / 27599437 / +1.3% 0.63 / 0.64 / -1.3%
tpcds_q34/duckdb:vortex-file-compressed 12782196 / 12881700 / -0.8% 22709516 / 21645185 / +4.9% 0.56 / 0.60 / -5.4%
tpcds_q35/duckdb:vortex-file-compressed 30960552 / 31119364 / -0.5% 44175687 / 42566508 / +3.8% 0.70 / 0.73 / -4.1%
tpcds_q36/duckdb:vortex-file-compressed 13806440 / 14037150 / -1.6% 24404834 / 23560362 / +3.6% 0.57 / 0.60 / -5.0%
tpcds_q37/duckdb:vortex-file-compressed 9471398 / 9278629 / +2.1% 23759834 / 24238961 / -2.0% 0.40 / 0.38 / +4.1%
tpcds_q38/duckdb:vortex-file-compressed 24421738 / 24606434 / -0.8% 31393881 / 31179343 / +0.7% 0.78 / 0.79 / -1.4%
tpcds_q39/duckdb:vortex-file-compressed 18182101 / 18495272 / -1.7% 30946078 / 30737214 / +0.7% 0.59 / 0.60 / -2.4%
tpcds_q40/duckdb:vortex-file-compressed 10983962 / 11167876 / -1.6% 19567098 / 19316090 / +1.3% 0.56 / 0.58 / -2.9%
tpcds_q41/duckdb:vortex-file-compressed 14725939 / 17305600 / -14.9% 🟢 20767785 / 24395246 / -14.9% 🟢 0.71 / 0.71 / -0.0%
tpcds_q42/duckdb:vortex-file-compressed 6879398 / 6914912 / -0.5% 16157888 / 15064464 / +7.3% 0.43 / 0.46 / -7.2%
tpcds_q43/duckdb:vortex-file-compressed 9734487 / 9643249 / +0.9% 18958080 / 18160250 / +4.4% 0.51 / 0.53 / -3.3%
tpcds_q44/duckdb:vortex-file-compressed 12371444 / 12476409 / -0.8% 25158768 / 23821756 / +5.6% 0.49 / 0.52 / -6.1%
tpcds_q45/duckdb:vortex-file-compressed 23137504 / 23587638 / -1.9% 30759608 / 30430270 / +1.1% 0.75 / 0.78 / -3.0%
tpcds_q46/duckdb:vortex-file-compressed 31326494 / 31418024 / -0.3% 43819277 / 43171545 / +1.5% 0.71 / 0.73 / -1.8%
tpcds_q47/duckdb:vortex-file-compressed 30667522 / 31264494 / -1.9% 40946292 / 41141020 / -0.5% 0.75 / 0.76 / -1.4%
tpcds_q48/duckdb:vortex-file-compressed 21947517 / 22472531 / -2.3% 35668644 / 35469142 / +0.6% 0.62 / 0.63 / -2.9%
tpcds_q49/duckdb:vortex-file-compressed 18311138 / 18985566 / -3.6% 30901822 / 29722088 / +4.0% 0.59 / 0.64 / -7.2%
tpcds_q50/duckdb:vortex-file-compressed 14358844 / 14896845 / -3.6% 24939355 / 25687406 / -2.9% 0.58 / 0.58 / -0.7%
tpcds_q51/duckdb:vortex-file-compressed 48586031 / 48063878 / +1.1% 55397821 / 76334322 / -27.4% 🟢 0.88 / 0.63 / +39.3%
tpcds_q52/duckdb:vortex-file-compressed 7184336 / 7171716 / +0.2% 15873783 / 15978547 / -0.7% 0.45 / 0.45 / +0.8%
tpcds_q53/duckdb:vortex-file-compressed 11156311 / 11319189 / -1.4% 20328979 / 21681207 / -6.2% 0.55 / 0.52 / +5.1%
tpcds_q54/duckdb:vortex-file-compressed 19753325 / 19748759 / +0.0% 30803199 / 29438540 / +4.6% 0.64 / 0.67 / -4.4%
tpcds_q55/duckdb:vortex-file-compressed 6741236 / 6847788 / -1.6% 16368737 / 15285422 / +7.1% 0.41 / 0.45 / -8.1%
tpcds_q56/duckdb:vortex-file-compressed 17734924 / 17817582 / -0.5% 28398968 / 28613711 / -0.8% 0.62 / 0.62 / +0.3%
tpcds_q57/duckdb:vortex-file-compressed 24895936 / 25308086 / -1.6% 33954118 / 33487780 / +1.4% 0.73 / 0.76 / -3.0%
tpcds_q58/duckdb:vortex-file-compressed 20058330 / 20359384 / -1.5% 30821744 / 29241349 / +5.4% 0.65 / 0.70 / -6.5%
tpcds_q59/duckdb:vortex-file-compressed 19678964 / 19485481 / +1.0% 26663370 / 26442217 / +0.8% 0.74 / 0.74 / +0.2%
tpcds_q60/duckdb:vortex-file-compressed 18331458 / 18504610 / -0.9% 28906589 / 28842068 / +0.2% 0.63 / 0.64 / -1.2%
tpcds_q61/duckdb:vortex-file-compressed 19367007 / 19922872 / -2.8% 31302763 / 30039600 / +4.2% 0.62 / 0.66 / -6.7%
tpcds_q62/duckdb:vortex-file-compressed 10958462 / 10937722 / +0.2% 17924031 / 17144486 / +4.5% 0.61 / 0.64 / -4.2%
tpcds_q63/duckdb:vortex-file-compressed 10689322 / 10809960 / -1.1% 18746849 / 20560158 / -8.8% 0.57 / 0.53 / +8.4%
tpcds_q64/duckdb:vortex-file-compressed 51869828 / 52513062 / -1.2% 67056387 / 68406502 / -2.0% 0.77 / 0.77 / +0.8%
tpcds_q65/duckdb:vortex-file-compressed 12748309 / 13060742 / -2.4% 23436927 / 23236608 / +0.9% 0.54 / 0.56 / -3.2%
tpcds_q66/duckdb:vortex-file-compressed 31121281 / 31272590 / -0.5% 39274348 / 39351988 / -0.2% 0.79 / 0.79 / -0.3%
tpcds_q67/duckdb:vortex-file-compressed 54727501 / 55266268 / -1.0% 64518756 / 64683896 / -0.3% 0.85 / 0.85 / -0.7%
tpcds_q68/duckdb:vortex-file-compressed 22506808 / 23009998 / -2.2% 35744291 / 35296552 / +1.3% 0.63 / 0.65 / -3.4%
tpcds_q69/duckdb:vortex-file-compressed 21786289 / 22017648 / -1.1% 36288462 / 36691775 / -1.1% 0.60 / 0.60 / +0.0%
tpcds_q70/duckdb:vortex-file-compressed 14527332 / 14724129 / -1.3% 26829592 / 25052861 / +7.1% 0.54 / 0.59 / -7.9%
tpcds_q71/duckdb:vortex-file-compressed 13858329 / 13347567 / +3.8% 23355323 / 23409485 / -0.2% 0.59 / 0.57 / +4.1%
tpcds_q72/duckdb:vortex-file-compressed 42703650 / 43060600 / -0.8% 55788855 / 56269909 / -0.9% 0.77 / 0.77 / +0.0%
tpcds_q73/duckdb:vortex-file-compressed 11814437 / 11829364 / -0.1% 21050489 / 21106781 / -0.3% 0.56 / 0.56 / +0.1%
tpcds_q74/duckdb:vortex-file-compressed 30299856 / 30874616 / -1.9% 38946256 / 39304395 / -0.9% 0.78 / 0.79 / -1.0%
tpcds_q75/duckdb:vortex-file-compressed 37459355 / 37067086 / +1.1% 50346766 / 48402666 / +4.0% 0.74 / 0.77 / -2.8%
tpcds_q76/duckdb:vortex-file-compressed 12771532 / 12879005 / -0.8% 22229114 / 22058251 / +0.8% 0.57 / 0.58 / -1.6%
tpcds_q77/duckdb:vortex-file-compressed 20367772 / 20386666 / -0.1% 30426204 / 31298903 / -2.8% 0.67 / 0.65 / +2.8%
tpcds_q78/duckdb:vortex-file-compressed 43408576 / 42921238 / +1.1% 53655507 / 52920959 / +1.4% 0.81 / 0.81 / -0.2%
tpcds_q79/duckdb:vortex-file-compressed 16766535 / 17204298 / -2.5% 28183694 / 26915068 / +4.7% 0.59 / 0.64 / -6.9%
tpcds_q80/duckdb:vortex-file-compressed 29116704 / 29835128 / -2.4% 44007690 / 43751968 / +0.6% 0.66 / 0.68 / -3.0%
tpcds_q81/duckdb:vortex-file-compressed 21132250 / 21403570 / -1.3% 29756283 / 30302750 / -1.8% 0.71 / 0.71 / +0.5%
tpcds_q82/duckdb:vortex-file-compressed 9510590 / 9601288 / -0.9% 24625466 / 23700733 / +3.9% 0.39 / 0.41 / -4.7%
tpcds_q83/duckdb:vortex-file-compressed 17726910 / 17487681 / +1.4% 25321765 / 24391032 / +3.8% 0.70 / 0.72 / -2.4%
tpcds_q84/duckdb:vortex-file-compressed 15457842 / 15474432 / -0.1% 22375406 / 23926919 / -6.5% 0.69 / 0.65 / +6.8%
tpcds_q85/duckdb:vortex-file-compressed 23979724 / 25015558 / -4.1% 35701322 / 36358715 / -1.8% 0.67 / 0.69 / -2.4%
tpcds_q86/duckdb:vortex-file-compressed 9597457 / 9625184 / -0.3% 16304960 / 16115124 / +1.2% 0.59 / 0.60 / -1.4%
tpcds_q87/duckdb:vortex-file-compressed 25795783 / 26050646 / -1.0% 33156850 / 33749194 / -1.8% 0.78 / 0.77 / +0.8%
tpcds_q88/duckdb:vortex-file-compressed 30032346 / 30341066 / -1.0% 39428092 / 40666123 / -3.0% 0.76 / 0.75 / +2.1%
tpcds_q89/duckdb:vortex-file-compressed 11746562 / 11880278 / -1.1% 20498562 / 21020275 / -2.5% 0.57 / 0.57 / +1.4%
tpcds_q90/duckdb:vortex-file-compressed 7623576 / 7873380 / -3.2% 14561374 / 15793821 / -7.8% 0.52 / 0.50 / +5.0%
tpcds_q91/duckdb:vortex-file-compressed 14156944 / 14680431 / -3.6% 22598120 / 23432754 / -3.6% 0.63 / 0.63 / -0.0%
tpcds_q92/duckdb:vortex-file-compressed 10516074 / 10362186 / +1.5% 18326421 / 17798675 / +3.0% 0.57 / 0.58 / -1.4%
tpcds_q93/duckdb:vortex-file-compressed 10111170 / 10321070 / -2.0% 23171078 / 22416155 / +3.4% 0.44 / 0.46 / -5.2%
tpcds_q94/duckdb:vortex-file-compressed 21867459 / 22085020 / -1.0% 33004872 / 31715817 / +4.1% 0.66 / 0.70 / -4.9%
tpcds_q95/duckdb:vortex-file-compressed 60615949 / 60520896 / +0.2% 68894829 / 67458992 / +2.1% 0.88 / 0.90 / -1.9%
tpcds_q96/duckdb:vortex-file-compressed 6345868 / 6497133 / -2.3% 16569990 / 15310655 / +8.2% 0.38 / 0.42 / -9.8%
tpcds_q97/duckdb:vortex-file-compressed 23090466 / 22917520 / +0.8% 31842944 / 31822045 / +0.1% 0.73 / 0.72 / +0.7%
tpcds_q98/duckdb:vortex-file-compressed 10832426 / 10919490 / -0.8% 18951299 / 19425955 / -2.4% 0.57 / 0.56 / +1.7%
tpcds_q99/duckdb:vortex-file-compressed 14428132 / 14421880 / +0.0% 21846071 / 22012689 / -0.8% 0.66 / 0.66 / +0.8%
duckdb / parquet / ns (0.996x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24102135 / 24093628 / +0.0% 30983547 / 30609636 / +1.2% 0.78 / 0.79 / -1.2%
tpcds_q02/duckdb:parquet 17862429 / 17984803 / -0.7% 24172756 / 24025915 / +0.6% 0.74 / 0.75 / -1.3%
tpcds_q03/duckdb:parquet 9720472 / 9812261 / -0.9% 15561212 / 15610845 / -0.3% 0.62 / 0.63 / -0.6%
tpcds_q04/duckdb:parquet 117209339 / 118053322 / -0.7% 126581670 / 125451786 / +0.9% 0.93 / 0.94 / -1.6%
tpcds_q05/duckdb:parquet 28219512 / 28431532 / -0.7% 33370356 / 33184023 / +0.6% 0.85 / 0.86 / -1.3%
tpcds_q06/duckdb:parquet 26211656 / 26561266 / -1.3% 35105042 / 34919227 / +0.5% 0.75 / 0.76 / -1.8%
tpcds_q07/duckdb:parquet 30616552 / 31458600 / -2.7% 38874787 / 38910397 / -0.1% 0.79 / 0.81 / -2.6%
tpcds_q08/duckdb:parquet 19600038 / 19835614 / -1.2% 26045530 / 26315778 / -1.0% 0.75 / 0.75 / -0.2%
tpcds_q09/duckdb:parquet 26350250 / 27590826 / -4.5% 30197344 / 29561025 / +2.2% 0.87 / 0.93 / -6.5%
tpcds_q10/duckdb:parquet 32729468 / 32550451 / +0.5% 40095554 / 40051128 / +0.1% 0.82 / 0.81 / +0.4%
tpcds_q11/duckdb:parquet 68215220 / 68928280 / -1.0% 75380501 / 76188001 / -1.1% 0.90 / 0.90 / +0.0%
tpcds_q12/duckdb:parquet 14024543 / 13995176 / +0.2% 18961376 / 19053083 / -0.5% 0.74 / 0.73 / +0.7%
tpcds_q13/duckdb:parquet 31160190 / 33308439 / -6.4% 38931799 / 39541391 / -1.5% 0.80 / 0.84 / -5.0%
tpcds_q14/duckdb:parquet 62925144 / 64769091 / -2.8% 67910502 / 68114003 / -0.3% 0.93 / 0.95 / -2.6%
tpcds_q15/duckdb:parquet 16525260 / 16637540 / -0.7% 22636744 / 22243900 / +1.8% 0.73 / 0.75 / -2.4%
tpcds_q16/duckdb:parquet 30071938 / 30104670 / -0.1% 37483140 / 37135181 / +0.9% 0.80 / 0.81 / -1.0%
tpcds_q17/duckdb:parquet 34205980 / 34477460 / -0.8% 40119106 / 40356696 / -0.6% 0.85 / 0.85 / -0.2%
tpcds_q18/duckdb:parquet 46897774 / 47148372 / -0.5% 54602570 / 54249081 / +0.7% 0.86 / 0.87 / -1.2%
tpcds_q19/duckdb:parquet 20018804 / 19018304 / +5.3% 25983552 / 25382414 / +2.4% 0.77 / 0.75 / +2.8%
tpcds_q20/duckdb:parquet 14781633 / 14902117 / -0.8% 19673570 / 19412123 / +1.3% 0.75 / 0.77 / -2.1%
tpcds_q21/duckdb:parquet 10252384 / 10731116 / -4.5% 16664479 / 17030686 / -2.2% 0.62 / 0.63 / -2.4%
tpcds_q22/duckdb:parquet 20593780 / 20507718 / +0.4% 26342305 / 26762155 / -1.6% 0.78 / 0.77 / +2.0%
tpcds_q23/duckdb:parquet 43688666 / 42833082 / +2.0% 46487481 / 49424056 / -5.9% 0.94 / 0.87 / +8.4%
tpcds_q24/duckdb:parquet 30017614 / 29943294 / +0.2% 36656912 / 36464447 / +0.5% 0.82 / 0.82 / -0.3%
tpcds_q25/duckdb:parquet 30362787 / 30514354 / -0.5% 37095704 / 37025273 / +0.2% 0.82 / 0.82 / -0.7%
tpcds_q26/duckdb:parquet 28907160 / 29252328 / -1.2% 35758221 / 35038512 / +2.1% 0.81 / 0.83 / -3.2%
tpcds_q27/duckdb:parquet 37678123 / 34872377 / +8.0% 40982982 / 41229992 / -0.6% 0.92 / 0.85 / +8.7%
tpcds_q28/duckdb:parquet 25910116 / 25185258 / +2.9% 32956643 / 31104212 / +6.0% 0.79 / 0.81 / -2.9%
tpcds_q29/duckdb:parquet 32721900 / 32150195 / +1.8% 39672010 / 38969206 / +1.8% 0.82 / 0.83 / -0.0%
tpcds_q30/duckdb:parquet 35272062 / 35528874 / -0.7% 44402188 / 44172843 / +0.5% 0.79 / 0.80 / -1.2%
tpcds_q31/duckdb:parquet 35445578 / 35529000 / -0.2% 42554437 / 42639874 / -0.2% 0.83 / 0.83 / -0.0%
tpcds_q32/duckdb:parquet 14036552 / 14179243 / -1.0% 20676373 / 21025962 / -1.7% 0.68 / 0.67 / +0.7%
tpcds_q33/duckdb:parquet 25199652 / 23095442 / +9.1% 29717461 / 28549004 / +4.1% 0.85 / 0.81 / +4.8%
tpcds_q34/duckdb:parquet 19691588 / 16952271 / +16.2% 🔴 24053199 / 24176719 / -0.5% 0.82 / 0.70 / +16.8%
tpcds_q35/duckdb:parquet 35660360 / 34975734 / +2.0% 43461606 / 43207543 / +0.6% 0.82 / 0.81 / +1.4%
tpcds_q36/duckdb:parquet 40632714 / 39485050 / +2.9% 47295985 / 47479406 / -0.4% 0.86 / 0.83 / +3.3%
tpcds_q37/duckdb:parquet 12681790 / 12797622 / -0.9% 19483540 / 19277008 / +1.1% 0.65 / 0.66 / -2.0%
tpcds_q38/duckdb:parquet 29528590 / 29621006 / -0.3% 33882080 / 33433489 / +1.3% 0.87 / 0.89 / -1.6%
tpcds_q39/duckdb:parquet 23265614 / 23128167 / +0.6% 30181213 / 29595365 / +2.0% 0.77 / 0.78 / -1.4%
tpcds_q40/duckdb:parquet 15927233 / 16054940 / -0.8% 21233967 / 21235777 / -0.0% 0.75 / 0.76 / -0.8%
tpcds_q41/duckdb:parquet 11920696 / 11966633 / -0.4% 18127927 / 18065700 / +0.3% 0.66 / 0.66 / -0.7%
tpcds_q42/duckdb:parquet 9599320 / 9626178 / -0.3% 15125004 / 15525610 / -2.6% 0.63 / 0.62 / +2.4%
tpcds_q43/duckdb:parquet 11868166 / 12048868 / -1.5% 17850808 / 18128038 / -1.5% 0.66 / 0.66 / +0.0%
tpcds_q44/duckdb:parquet 21269628 / 21607511 / -1.6% 27568902 / 26196804 / +5.2% 0.77 / 0.82 / -6.5%
tpcds_q45/duckdb:parquet 20918490 / 20908743 / +0.0% 27329405 / 27486675 / -0.6% 0.77 / 0.76 / +0.6%
tpcds_q46/duckdb:parquet 37783192 / 35288508 / +7.1% 43635619 / 43320711 / +0.7% 0.87 / 0.81 / +6.3%
tpcds_q47/duckdb:parquet 34102274 / 34531498 / -1.2% 41481374 / 41336316 / +0.4% 0.82 / 0.84 / -1.6%
tpcds_q48/duckdb:parquet 30300022 / 29103170 / +4.1% 36985782 / 36426435 / +1.5% 0.82 / 0.80 / +2.5%
tpcds_q49/duckdb:parquet 30939278 / 30233053 / +2.3% 36772008 / 36303817 / +1.3% 0.84 / 0.83 / +1.0%
tpcds_q50/duckdb:parquet 20194190 / 20388898 / -1.0% 25335818 / 25331399 / +0.0% 0.80 / 0.80 / -1.0%
tpcds_q51/duckdb:parquet 51690464 / 52104356 / -0.8% 60970086 / 61245199 / -0.4% 0.85 / 0.85 / -0.3%
tpcds_q52/duckdb:parquet 9610984 / 9659180 / -0.5% 15301719 / 15499988 / -1.3% 0.63 / 0.62 / +0.8%
tpcds_q53/duckdb:parquet 13734856 / 14537118 / -5.5% 20867914 / 20752143 / +0.6% 0.66 / 0.70 / -6.0%
tpcds_q54/duckdb:parquet 24850354 / 24733616 / +0.5% 32968665 / 31908376 / +3.3% 0.75 / 0.78 / -2.8%
tpcds_q55/duckdb:parquet 9437886 / 9489484 / -0.5% 15321351 / 15341981 / -0.1% 0.62 / 0.62 / -0.4%
tpcds_q56/duckdb:parquet 25738970 / 27141406 / -5.2% 30450817 / 30419221 / +0.1% 0.85 / 0.89 / -5.3%
tpcds_q57/duckdb:parquet 30474110 / 30693180 / -0.7% 36408805 / 36167354 / +0.7% 0.84 / 0.85 / -1.4%
tpcds_q58/duckdb:parquet 24464868 / 23919381 / +2.3% 29922034 / 29814453 / +0.4% 0.82 / 0.80 / +1.9%
tpcds_q59/duckdb:parquet 22406208 / 22867650 / -2.0% 28632855 / 28707391 / -0.3% 0.78 / 0.80 / -1.8%
tpcds_q60/duckdb:parquet 26595641 / 26316208 / +1.1% 31879966 / 31957179 / -0.2% 0.83 / 0.82 / +1.3%
tpcds_q61/duckdb:parquet 24164624 / 24749493 / -2.4% 28625231 / 29026258 / -1.4% 0.84 / 0.85 / -1.0%
tpcds_q62/duckdb:parquet 12632565 / 12721642 / -0.7% 17760416 / 17771445 / -0.1% 0.71 / 0.72 / -0.6%
tpcds_q63/duckdb:parquet 13096966 / 14341675 / -8.7% 19740201 / 20011856 / -1.4% 0.66 / 0.72 / -7.4%
tpcds_q64/duckdb:parquet 70525318 / 70307914 / +0.3% 79406580 / 79575965 / -0.2% 0.89 / 0.88 / +0.5%
tpcds_q65/duckdb:parquet 21095372 / 20569484 / +2.6% 25901059 / 25477560 / +1.7% 0.81 / 0.81 / +0.9%
tpcds_q66/duckdb:parquet 33124954 / 33045765 / +0.2% 38259268 / 38019443 / +0.6% 0.87 / 0.87 / -0.4%
tpcds_q67/duckdb:parquet 60408450 / 61027914 / -1.0% 66821158 / 66818321 / +0.0% 0.90 / 0.91 / -1.0%
tpcds_q68/duckdb:parquet 28290097 / 30834914 / -8.3% 36132547 / 35993030 / +0.4% 0.78 / 0.86 / -8.6%
tpcds_q69/duckdb:parquet 25739964 / 25794512 / -0.2% 34698634 / 33964184 / +2.2% 0.74 / 0.76 / -2.3%
tpcds_q70/duckdb:parquet 19089660 / 19255869 / -0.9% 26668805 / 26582665 / +0.3% 0.72 / 0.72 / -1.2%
tpcds_q71/duckdb:parquet 16764768 / 16803522 / -0.2% 24085618 / 23382022 / +3.0% 0.70 / 0.72 / -3.1%
tpcds_q72/duckdb:parquet 52549634 / 53014220 / -0.9% 59838747 / 59449489 / +0.7% 0.88 / 0.89 / -1.5%
tpcds_q73/duckdb:parquet 15812818 / 15895421 / -0.5% 21603230 / 21585777 / +0.1% 0.73 / 0.74 / -0.6%
tpcds_q74/duckdb:parquet 83026890 / 85004257 / -2.3% 91437152 / 89575448 / +2.1% 0.91 / 0.95 / -4.3%
tpcds_q75/duckdb:parquet 45415581 / 44183878 / +2.8% 49338571 / 49282250 / +0.1% 0.92 / 0.90 / +2.7%
tpcds_q76/duckdb:parquet 17628844 / 18510097 / -4.8% 23398207 / 22802776 / +2.6% 0.75 / 0.81 / -7.2%
tpcds_q77/duckdb:parquet 25292504 / 25530442 / -0.9% 31240325 / 31441226 / -0.6% 0.81 / 0.81 / -0.3%
tpcds_q78/duckdb:parquet 78621336 / 78229121 / +0.5% 85313687 / 85641462 / -0.4% 0.92 / 0.91 / +0.9%
tpcds_q79/duckdb:parquet 22521797 / 24067906 / -6.4% 28645980 / 28358044 / +1.0% 0.79 / 0.85 / -7.4%
tpcds_q80/duckdb:parquet 37498050 / 38479893 / -2.6% 44680510 / 43843592 / +1.9% 0.84 / 0.88 / -4.4%
tpcds_q81/duckdb:parquet 36118918 / 36125748 / -0.0% 44672221 / 44907713 / -0.5% 0.81 / 0.80 / +0.5%
tpcds_q82/duckdb:parquet 13236148 / 13496682 / -1.9% 20310234 / 20103202 / +1.0% 0.65 / 0.67 / -2.9%
tpcds_q83/duckdb:parquet 19927571 / 19941274 / -0.1% 25276081 / 24813592 / +1.9% 0.79 / 0.80 / -1.9%
tpcds_q84/duckdb:parquet 22980404 / 23090262 / -0.5% 28903956 / 28462809 / +1.5% 0.80 / 0.81 / -2.0%
tpcds_q85/duckdb:parquet 32059286 / 32217004 / -0.5% 38989038 / 38985194 / +0.0% 0.82 / 0.83 / -0.5%
tpcds_q86/duckdb:parquet 11780903 / 11811458 / -0.3% 16833844 / 16496302 / +2.0% 0.70 / 0.72 / -2.3%
tpcds_q87/duckdb:parquet 31099700 / 31436775 / -1.1% 34830311 / 35185024 / -1.0% 0.89 / 0.89 / -0.1%
tpcds_q88/duckdb:parquet 38536904 / 38059442 / +1.3% 42761944 / 41928306 / +2.0% 0.90 / 0.91 / -0.7%
tpcds_q89/duckdb:parquet 14263348 / 14206404 / +0.4% 21498446 / 21172421 / +1.5% 0.66 / 0.67 / -1.1%
tpcds_q90/duckdb:parquet 9954085 / 10080660 / -1.3% 15139774 / 15448563 / -2.0% 0.66 / 0.65 / +0.8%
tpcds_q91/duckdb:parquet 20890265 / 21048574 / -0.8% 28332149 / 28220317 / +0.4% 0.74 / 0.75 / -1.1%
tpcds_q92/duckdb:parquet 15463100 / 15572126 / -0.7% 22006742 / 22096515 / -0.4% 0.70 / 0.70 / -0.3%
tpcds_q93/duckdb:parquet 13885760 / 14091483 / -1.5% 19956057 / 20175447 / -1.1% 0.70 / 0.70 / -0.4%
tpcds_q94/duckdb:parquet 25207708 / 25392360 / -0.7% 32301960 / 32388339 / -0.3% 0.78 / 0.78 / -0.5%
tpcds_q95/duckdb:parquet 43980660 / 43748374 / +0.5% 49552578 / 49895274 / -0.7% 0.89 / 0.88 / +1.2%
tpcds_q96/duckdb:parquet 8089820 / 8272491 / -2.2% 13831206 / 13988491 / -1.1% 0.58 / 0.59 / -1.1%
tpcds_q97/duckdb:parquet 27547429 / 27667050 / -0.4% 34014998 / 32852985 / +3.5% 0.81 / 0.84 / -3.8%
tpcds_q98/duckdb:parquet 16354070 / 16378365 / -0.1% 22974247 / 22777602 / +0.9% 0.71 / 0.72 / -1.0%
tpcds_q99/duckdb:parquet 18702593 / 18807829 / -0.6% 24760081 / 24915617 / -0.6% 0.76 / 0.75 / +0.1%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant