Skip to content

perf(file): prepare static pruning proofs for multi-file scans - #11341

Draft
joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-04-duck-file-pruningfrom
ji/clickbench-v2-20261109-05-prepared-file-proofs
Draft

joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-04-duck-file-pruningfrom
ji/clickbench-v2-20261109-05-prepared-file-proofs

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Draft with confirmed focused gains; it inherits the file-pruning dependency's unresolved Q7 concern.

Stack dependency: #11340. This PR targets that branch so its diff contains only this change.

Summary

DuckDB applies the same static filter to multiple files. Prepare its file-statistics proof once, then evaluate that proof against each file’s footer. Simple comparisons and Boolean combinations use scalar statistics; other expressions use the existing evaluator.

Depends on ji/clickbench-v2-20261109-04-duck-file-pruning for the footer-pruning integration and bound-predicate fallback.

Changes

  • Add the public FilePruningPredicate API with preparation, opened-file evaluation, and cached-footer evaluation.
  • Reject dynamic predicates during preparation, validate the bound root schema, and keep unavailable statistics unknown.
  • Add coverage for proof reuse across files, missing statistics, schema mismatches, nullable truncated string bounds, and three-valued Boolean logic.

Benchmark evidence

Warm ClickBench timings against this branch's exact dependency parent. Query IDs are zero-based; these are individual query gains, not whole-suite or additive gains.

Engine Query Parent median (ms) Candidate median (ms) Paired latency reduction 99% interval
DuckDB Q38 7.0594 6.8405 3.02% 2.38–3.44%
DuckDB Q41 5.2419 4.9938 4.60% 3.97–5.05%
DuckDB Q42 4.8203 4.5823 4.87% 4.38–5.29%

24 fresh adjacent process pairs in balanced order; 100 executions/query, first 20 discarded; 8 interspersed identical-binary A/A pairs. Effects use mean paired log ratios of process warm medians. Displayed times are medians across processes, so their ratio need not exactly equal the paired estimate. Intervals are pointwise 99% bootstrap intervals. Each listed gain passes both the >1% interval rule and the exact paired sign test with Holm 1% correction across all 76 planned latency directions. Both execution orders and chronological sensitivity were reviewed; no post-warmup observations were excluded or controls subtracted. The sign test concerns how often a paired improvement exceeds 1%; the displayed interval estimates the mean log effect.

DuckDB Q38 has an A/A drift warning: identical binaries show +0.436% apparent reduction. The main effect remains above 1% in both orders and all six chronological groups. This qualification is retained.

Whole-process user+system CPU reductions on the same focused query set: DuckDB 10.88% (99% interval 10.52–11.22%). These pass the separately corrected CPU family and include setup and warmups; they are not measurements of isolated Vortex CPU.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads, DuckDB --reuse. DataFusion 55.2 retains enable_topk_aggregation=true. Compiler, Cargo feature union, profile and runtime environment are fixed across parent/candidate. Executable and library hashes, canonical SQL and fixture identities are recorded.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

No new independent landing hold emerges from the all43 screen, but the s04 dependency's Q7 concern remains. DuckDB Q42 medians/means rise 3.15%/5.41%; both baseline-first pairs are adverse and both candidate-first pairs favorable, with large mixed controls. This order/chronology split does not establish causation or clear history-sensitive behavior. Retain the focused Q38/Q41/Q42 gains and their control caveat; the 10.88% focused CPU reduction is not an all43 CPU claim.

Validation

  • 21 targeted test executions passed on this exact source tree: prepared_file_pruning, scalar_proofs_preserve_three_valued_logic, test_can_prune.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate); strict types, floating tolerance, tied-row membership and independent oracles included.
  • Both benchmark packages built together with --locked, the release_debug profile, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust changes were formatted with pinned nightly; patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local source commit: b9d988cae18a03f88689353b81a3e6b3fd94a879; full source tree: 6720a94ed0f9e69f3d03089556c83ac32aeeb81b. Measured parent: 0fbf06a77da9e1cfe226913262e601d90829a45a.

PR source commit: 7fb2efcfb1ea8f751e9e31d60109de325ecc420e; mapped parent: 2bc5703c632f9bdeca16cde41b222ea48d1dde35. The complete source tree and mapped parent graph match the measured source. GitHub regenerated commit metadata/timestamps, so the measured local commit and executable hashes remain the benchmark identities. The complete remote Git object, original message and author/committer signoffs were verified.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. 1 suite(s) required one failed-jobs-only retry after EC2 capacity failures before checkout; the head stayed unchanged. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

Prepare file-statistics proofs once for DuckDB V2 scans and evaluate supported comparisons directly from footer scalars. Preserve three-valued logic, a general-expression fallback, root dtype validation, and rejection of dynamic predicates. Missing statistics remain unknown; each file supplies its own statistics.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-04-duck-file-pruning to develop November 9, 2026 11:56
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-04-duck-file-pruning November 9, 2026 11:56
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7fb2efc polarsignals 2 Explore Profiling Data
🟢 Done 7fb2efc tpcds-nvme 1 Explore Profiling Data
🟢 Done 7fb2efc fineweb 1 Explore Profiling Data
🟢 Done 7fb2efc clickbench-nvme 1 Explore Profiling Data
🟢 Done 7fb2efc tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 7fb2efc tpch-nvme-10 1 Explore Profiling Data
🟢 Done 7fb2efc tpch-s3 1 Explore Profiling Data
🟢 Done 7fb2efc tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 7fb2efcf vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.986x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15776887 / 15688950 / +0.6% 42605358 / 42044683 / +1.3% 0.37 / 0.37 / -0.8%
tpch_q02/datafusion:vortex-file-compressed 17433035 / 17642963 / -1.2% 37736851 / 38300817 / -1.5% 0.46 / 0.46 / +0.3%
tpch_q03/datafusion:vortex-file-compressed 19151626 / 19065844 / +0.4% 46503336 / 48397388 / -3.9% 0.41 / 0.39 / +4.5%
tpch_q04/datafusion:vortex-file-compressed 10308647 / 11164861 / -7.7% 35375000 / 35072742 / +0.9% 0.29 / 0.32 / -8.5%
tpch_q05/datafusion:vortex-file-compressed 38039743 / 37464731 / +1.5% 66177091 / 67783021 / -2.4% 0.57 / 0.55 / +4.0%
tpch_q06/datafusion:vortex-file-compressed 4478151 / 4339682 / +3.2% 26172481 / 24863986 / +5.3% 0.17 / 0.17 / -2.0%
tpch_q07/datafusion:vortex-file-compressed 52849359 / 52692511 / +0.3% 81754384 / 85054942 / -3.9% 0.65 / 0.62 / +4.3%
tpch_q08/datafusion:vortex-file-compressed 52241930 / 52605829 / -0.7% 82316772 / 84709539 / -2.8% 0.63 / 0.62 / +2.2%
tpch_q09/datafusion:vortex-file-compressed 51268883 / 48498381 / +5.7% 86748903 / 84507228 / +2.7% 0.59 / 0.57 / +3.0%
tpch_q10/datafusion:vortex-file-compressed 17869288 / 17830636 / +0.2% 51011390 / 50418361 / +1.2% 0.35 / 0.35 / -0.9%
tpch_q11/datafusion:vortex-file-compressed 14683424 / 14797088 / -0.8% 34100309 / 34636066 / -1.5% 0.43 / 0.43 / +0.8%
tpch_q12/datafusion:vortex-file-compressed 18423838 / 18367682 / +0.3% 45919092 / 44324157 / +3.6% 0.40 / 0.41 / -3.2%
tpch_q13/datafusion:vortex-file-compressed 19421296 / 19445378 / -0.1% 41491654 / 43547559 / -4.7% 0.47 / 0.45 / +4.8%
tpch_q14/datafusion:vortex-file-compressed 14223137 / 14501344 / -1.9% 39489170 / 38502171 / +2.6% 0.36 / 0.38 / -4.4%
tpch_q15/datafusion:vortex-file-compressed 18203922 / 18611040 / -2.2% 46113101 / 47147954 / -2.2% 0.39 / 0.39 / +0.0%
tpch_q16/datafusion:vortex-file-compressed 18213880 / 18720655 / -2.7% 37985638 / 39847079 / -4.7% 0.48 / 0.47 / +2.1%
tpch_q17/datafusion:vortex-file-compressed 29607653 / 28917794 / +2.4% 59476417 / 58954760 / +0.9% 0.50 / 0.49 / +1.5%
tpch_q18/datafusion:vortex-file-compressed 36780946 / 36473671 / +0.8% 59760001 / 59803246 / -0.1% 0.62 / 0.61 / +0.9%
tpch_q19/datafusion:vortex-file-compressed 9584456 / 9988295 / -4.0% 39971576 / 36396214 / +9.8% 0.24 / 0.27 / -12.6%
tpch_q20/datafusion:vortex-file-compressed 20701356 / 21253874 / -2.6% 48214630 / 52124094 / -7.5% 0.43 / 0.41 / +5.3%
tpch_q21/datafusion:vortex-file-compressed 35346156 / 35502918 / -0.4% 65936417 / 66036777 / -0.2% 0.54 / 0.54 / -0.3%
tpch_q22/datafusion:vortex-file-compressed 10984607 / 10854425 / +1.2% 31719552 / 31535557 / +0.6% 0.35 / 0.34 / +0.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71419285 / 71385078 / +0.0% 88299784 / 87261585 / +1.2% 0.81 / 0.82 / -1.1%
tpch_q02/datafusion:parquet 75808471 / 76624116 / -1.1% 91923784 / 91913452 / +0.0% 0.82 / 0.83 / -1.1%
tpch_q03/datafusion:parquet 81468832 / 82108255 / -0.8% 103899401 / 104243587 / -0.3% 0.78 / 0.79 / -0.5%
tpch_q04/datafusion:parquet 39315682 / 39117802 / +0.5% 57112432 / 58381793 / -2.2% 0.69 / 0.67 / +2.7%
tpch_q05/datafusion:parquet 110478664 / 110097915 / +0.3% 136855762 / 137152327 / -0.2% 0.81 / 0.80 / +0.6%
tpch_q06/datafusion:parquet 31124325 / 31364851 / -0.8% 47523029 / 46559945 / +2.1% 0.65 / 0.67 / -2.8%
tpch_q07/datafusion:parquet 112756331 / 113603354 / -0.7% 138659585 / 139063930 / -0.3% 0.81 / 0.82 / -0.5%
tpch_q08/datafusion:parquet 117003510 / 118351864 / -1.1% 144595146 / 143663582 / +0.6% 0.81 / 0.82 / -1.8%
tpch_q09/datafusion:parquet 137500912 / 137262432 / +0.2% 166689430 / 166772416 / -0.0% 0.82 / 0.82 / +0.2%
tpch_q10/datafusion:parquet 103706449 / 103456749 / +0.2% 128081040 / 126729504 / +1.1% 0.81 / 0.82 / -0.8%
tpch_q11/datafusion:parquet 61983180 / 62363006 / -0.6% 82947818 / 82069278 / +1.1% 0.75 / 0.76 / -1.7%
tpch_q12/datafusion:parquet 63222415 / 63533745 / -0.5% 84041747 / 85351184 / -1.5% 0.75 / 0.74 / +1.1%
tpch_q13/datafusion:parquet 143516038 / 142477870 / +0.7% 164251158 / 161849930 / +1.5% 0.87 / 0.88 / -0.7%
tpch_q14/datafusion:parquet 47590834 / 47624060 / -0.1% 73251019 / 68804881 / +6.5% 0.65 / 0.69 / -6.1%
tpch_q15/datafusion:parquet 74086402 / 74880432 / -1.1% 93151001 / 92266259 / +1.0% 0.80 / 0.81 / -2.0%
tpch_q16/datafusion:parquet 43404306 / 43181694 / +0.5% 60959090 / 59549382 / +2.4% 0.71 / 0.73 / -1.8%
tpch_q17/datafusion:parquet 123218370 / 123682757 / -0.4% 144714778 / 147020505 / -1.6% 0.85 / 0.84 / +1.2%
tpch_q18/datafusion:parquet 120514731 / 121104227 / -0.5% 137522855 / 142447395 / -3.5% 0.88 / 0.85 / +3.1%
tpch_q19/datafusion:parquet 57020309 / 57774413 / -1.3% 81699781 / 82236501 / -0.7% 0.70 / 0.70 / -0.7%
tpch_q20/datafusion:parquet 77438206 / 78510463 / -1.4% 102432381 / 101516128 / +0.9% 0.76 / 0.77 / -2.2%
tpch_q21/datafusion:parquet 113767562 / 113088915 / +0.6% 136359743 / 139363438 / -2.2% 0.83 / 0.81 / +2.8%
tpch_q22/datafusion:parquet 51526481 / 51831048 / -0.6% 69178652 / 67131696 / +3.0% 0.74 / 0.77 / -3.5%
duckdb / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9217490 / 9046497 / +1.9% 19209269 / 20027987 / -4.1% 0.48 / 0.45 / +6.2%
tpch_q02/duckdb:vortex-file-compressed 14927000 / 15124900 / -1.3% 25065486 / 25341316 / -1.1% 0.60 / 0.60 / -0.2%
tpch_q03/duckdb:vortex-file-compressed 18187326 / 18447734 / -1.4% 35940602 / 34750008 / +3.4% 0.51 / 0.53 / -4.7%
tpch_q04/duckdb:vortex-file-compressed 12074854 / 12448707 / -3.0% 26676989 / 26846587 / -0.6% 0.45 / 0.46 / -2.4%
tpch_q05/duckdb:vortex-file-compressed 20027976 / 20254666 / -1.1% 37301664 / 35776065 / +4.3% 0.54 / 0.57 / -5.2%
tpch_q06/duckdb:vortex-file-compressed 4545873 / 4488820 / +1.3% 14602533 / 15022696 / -2.8% 0.31 / 0.30 / +4.2%
tpch_q07/duckdb:vortex-file-compressed 24060538 / 23909987 / +0.6% 38709155 / 41780280 / -7.4% 0.62 / 0.57 / +8.6%
tpch_q08/duckdb:vortex-file-compressed 20854710 / 20744171 / +0.5% 37419632 / 37318055 / +0.3% 0.56 / 0.56 / +0.3%
tpch_q09/duckdb:vortex-file-compressed 22792692 / 23055861 / -1.1% 37073833 / 38487753 / -3.7% 0.61 / 0.60 / +2.6%
tpch_q10/duckdb:vortex-file-compressed 27014680 / 26815462 / +0.7% 44601113 / 45530635 / -2.0% 0.61 / 0.59 / +2.8%
tpch_q11/duckdb:vortex-file-compressed 7861428 / 7968318 / -1.3% 17240424 / 18104165 / -4.8% 0.46 / 0.44 / +3.6%
tpch_q12/duckdb:vortex-file-compressed 14161100 / 14764927 / -4.1% 26854198 / 27095283 / -0.9% 0.53 / 0.54 / -3.2%
tpch_q13/duckdb:vortex-file-compressed 19503780 / 19378947 / +0.6% 32432022 / 31743144 / +2.2% 0.60 / 0.61 / -1.5%
tpch_q14/duckdb:vortex-file-compressed 11216503 / 11181264 / +0.3% 22892919 / 25354587 / -9.7% 0.49 / 0.44 / +11.1%
tpch_q15/duckdb:vortex-file-compressed 8081767 / 8381204 / -3.6% 19114114 / 20995174 / -9.0% 0.42 / 0.40 / +5.9%
tpch_q16/duckdb:vortex-file-compressed 16499995 / 16413233 / +0.5% 22581426 / 23979720 / -5.8% 0.73 / 0.68 / +6.8%
tpch_q17/duckdb:vortex-file-compressed 12369185 / 12592677 / -1.8% 27918579 / 28445363 / -1.9% 0.44 / 0.44 / +0.1%
tpch_q18/duckdb:vortex-file-compressed 24225955 / 24316808 / -0.4% 34299150 / 34951044 / -1.9% 0.71 / 0.70 / +1.5%
tpch_q19/duckdb:vortex-file-compressed 10596763 / 11426195 / -7.3% 24838952 / 25766839 / -3.6% 0.43 / 0.44 / -3.8%
tpch_q20/duckdb:vortex-file-compressed 13849668 / 14325643 / -3.3% 30551769 / 30552986 / -0.0% 0.45 / 0.47 / -3.3%
tpch_q21/duckdb:vortex-file-compressed 48628069 / 48281048 / +0.7% 64447094 / 66017908 / -2.4% 0.75 / 0.73 / +3.2%
tpch_q22/duckdb:vortex-file-compressed 16597644 / 16702790 / -0.6% 26513168 / 26800262 / -1.1% 0.63 / 0.62 / +0.4%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47452223 / 47547581 / -0.2% 53918071 / 54112740 / -0.4% 0.88 / 0.88 / +0.2%
tpch_q02/duckdb:parquet 48131801 / 48312217 / -0.4% 55349588 / 55151190 / +0.4% 0.87 / 0.88 / -0.7%
tpch_q03/duckdb:parquet 60340024 / 60217500 / +0.2% 68827538 / 69288935 / -0.7% 0.88 / 0.87 / +0.9%
tpch_q04/duckdb:parquet 34572093 / 34656547 / -0.2% 43110058 / 43053263 / +0.1% 0.80 / 0.80 / -0.4%
tpch_q05/duckdb:parquet 66940688 / 67091722 / -0.2% 77091821 / 77316587 / -0.3% 0.87 / 0.87 / +0.1%
tpch_q06/duckdb:parquet 21638673 / 21601570 / +0.2% 27377514 / 27249425 / +0.5% 0.79 / 0.79 / -0.3%
tpch_q07/duckdb:parquet 63802085 / 63799205 / +0.0% 74107553 / 72405251 / +2.4% 0.86 / 0.88 / -2.3%
tpch_q08/duckdb:parquet 75402743 / 75667269 / -0.3% 86983020 / 86769393 / +0.2% 0.87 / 0.87 / -0.6%
tpch_q09/duckdb:parquet 107593974 / 107847179 / -0.2% 119495968 / 118570948 / +0.8% 0.90 / 0.91 / -1.0%
tpch_q10/duckdb:parquet 105543998 / 105720936 / -0.2% 117608112 / 117200993 / +0.3% 0.90 / 0.90 / -0.5%
tpch_q11/duckdb:parquet 29348159 / 29439572 / -0.3% 34852706 / 34922812 / -0.2% 0.84 / 0.84 / -0.1%
tpch_q12/duckdb:parquet 37108317 / 37121505 / -0.0% 43908863 / 43764563 / +0.3% 0.85 / 0.85 / -0.4%
tpch_q13/duckdb:parquet 174626701 / 174812670 / -0.1% 182772128 / 184970583 / -1.2% 0.96 / 0.95 / +1.1%
tpch_q14/duckdb:parquet 42302724 / 42356235 / -0.1% 51343690 / 51063051 / +0.5% 0.82 / 0.83 / -0.7%
tpch_q15/duckdb:parquet 32631803 / 32503990 / +0.4% 40892845 / 41334737 / -1.1% 0.80 / 0.79 / +1.5%
tpch_q16/duckdb:parquet 47498105 / 47147798 / +0.7% 51971974 / 52668299 / -1.3% 0.91 / 0.90 / +2.1%
tpch_q17/duckdb:parquet 47784885 / 47964459 / -0.4% 57914657 / 56795941 / +2.0% 0.83 / 0.84 / -2.3%
tpch_q18/duckdb:parquet 74014848 / 73982405 / +0.0% 79893316 / 80482798 / -0.7% 0.93 / 0.92 / +0.8%
tpch_q19/duckdb:parquet 48310288 / 49071842 / -1.6% 62442048 / 55601512 / +12.3% 🔴 0.77 / 0.88 / -12.3%
tpch_q20/duckdb:parquet 63311985 / 63412118 / -0.2% 74094753 / 73364368 / +1.0% 0.85 / 0.86 / -1.1%
tpch_q21/duckdb:parquet 106710514 / 106560704 / +0.1% 116808000 / 116038695 / +0.7% 0.91 / 0.92 / -0.5%
tpch_q22/duckdb:parquet 50310441 / 50470913 / -0.3% 59068126 / 59155611 / -0.1% 0.85 / 0.85 / -0.2%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 7fb2efcf vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.037x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91620664 / 92177346 / -0.6% 155048118 / 156197099 / -0.7% 0.59 / 0.59 / +0.1%
tpch_q02/datafusion:vortex-file-compressed 64514122 / 64428754 / +0.1% 94905196 / 94872596 / +0.0% 0.68 / 0.68 / +0.1%
tpch_q03/datafusion:vortex-file-compressed 62040939 / 64151894 / -3.3% 119174085 / 126780702 / -6.0% 0.52 / 0.51 / +2.9%
tpch_q04/datafusion:vortex-file-compressed 34036009 / 35028676 / -2.8% 73287500 / 68466710 / +7.0% 0.46 / 0.51 / -9.2%
tpch_q05/datafusion:vortex-file-compressed 120223257 / 118900162 / +1.1% 193277654 / 185439522 / +4.2% 0.62 / 0.64 / -3.0%
tpch_q06/datafusion:vortex-file-compressed 9871162 / 9649196 / +2.3% 58886813 / 57652551 / +2.1% 0.17 / 0.17 / +0.2%
tpch_q07/datafusion:vortex-file-compressed 98334233 / 97449767 / +0.9% 164618367 / 161011516 / +2.2% 0.60 / 0.61 / -1.3%
tpch_q08/datafusion:vortex-file-compressed 142655416 / 142206475 / +0.3% 235800335 / 226695985 / +4.0% 0.60 / 0.63 / -3.6%
tpch_q09/datafusion:vortex-file-compressed 185527111 / 182840408 / +1.5% 280106217 / 275147335 / +1.8% 0.66 / 0.66 / -0.3%
tpch_q10/datafusion:vortex-file-compressed 70441406 / 70621645 / -0.3% 134777618 / 136262721 / -1.1% 0.52 / 0.52 / +0.8%
tpch_q11/datafusion:vortex-file-compressed 45671909 / 45658051 / +0.0% 74095536 / 72364105 / +2.4% 0.62 / 0.63 / -2.3%
tpch_q12/datafusion:vortex-file-compressed 36556155 / 35235879 / +3.7% 82462517 / 79705799 / +3.5% 0.44 / 0.44 / +0.3%
tpch_q13/datafusion:vortex-file-compressed 48781203 / 48598467 / +0.4% 83852631 / 87210304 / -3.9% 0.58 / 0.56 / +4.4%
tpch_q14/datafusion:vortex-file-compressed 20125553 / 20650370 / -2.5% 88597671 / 88048054 / +0.6% 0.23 / 0.23 / -3.1%
tpch_q15/datafusion:vortex-file-compressed 33470073 / 33753614 / -0.8% 89724364 / 90785220 / -1.2% 0.37 / 0.37 / +0.3%
tpch_q16/datafusion:vortex-file-compressed 36776054 / 36919743 / -0.4% 66077585 / 65843812 / +0.4% 0.56 / 0.56 / -0.7%
tpch_q17/datafusion:vortex-file-compressed 177579585 / 176998771 / +0.3% 226686385 / 239755261 / -5.5% 0.78 / 0.74 / +6.1%
tpch_q18/datafusion:vortex-file-compressed 205843801 / 207996354 / -1.0% 275683431 / 275106107 / +0.2% 0.75 / 0.76 / -1.2%
tpch_q19/datafusion:vortex-file-compressed 27753582 / 28526869 / -2.7% 86630978 / 87666580 / -1.2% 0.32 / 0.33 / -1.5%
tpch_q20/datafusion:vortex-file-compressed 60977240 / 61936223 / -1.5% 118133671 / 118852369 / -0.6% 0.52 / 0.52 / -0.9%
tpch_q21/datafusion:vortex-file-compressed 180619751 / 182704046 / -1.1% 231258963 / 234984863 / -1.6% 0.78 / 0.78 / +0.5%
tpch_q22/datafusion:vortex-file-compressed 25506417 / 25513774 / -0.0% 55536840 / 55406439 / +0.2% 0.46 / 0.46 / -0.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86926400 / 87311538 / -0.4% 126927042 / 122516163 / +3.6% 0.68 / 0.71 / -3.9%
tpch_q02/datafusion:parquet 173510128 / 174735537 / -0.7% 202103899 / 198265824 / +1.9% 0.86 / 0.88 / -2.6%
tpch_q03/datafusion:parquet 134995956 / 135233090 / -0.2% 179228703 / 179364012 / -0.1% 0.75 / 0.75 / -0.1%
tpch_q04/datafusion:parquet 57204844 / 56985913 / +0.4% 89249188 / 85885070 / +3.9% 0.64 / 0.66 / -3.4%
tpch_q05/datafusion:parquet 167247188 / 166291221 / +0.6% 220736102 / 214896169 / +2.7% 0.76 / 0.77 / -2.1%
tpch_q06/datafusion:parquet 36387182 / 36510562 / -0.3% 74918425 / 72908306 / +2.8% 0.49 / 0.50 / -3.0%
tpch_q07/datafusion:parquet 214876268 / 215778947 / -0.4% 265536792 / 260314182 / +2.0% 0.81 / 0.83 / -2.4%
tpch_q08/datafusion:parquet 217801585 / 216791369 / +0.5% 281759240 / 278971702 / +1.0% 0.77 / 0.78 / -0.5%
tpch_q09/datafusion:parquet 308543665 / 307685989 / +0.3% 371045191 / 369588127 / +0.4% 0.83 / 0.83 / -0.1%
tpch_q10/datafusion:parquet 311661469 / 311954014 / -0.1% 373084235 / 359417304 / +3.8% 0.84 / 0.87 / -3.8%
tpch_q11/datafusion:parquet 127260275 / 127035714 / +0.2% 147196694 / 149936598 / -1.8% 0.86 / 0.85 / +2.0%
tpch_q12/datafusion:parquet 82128156 / 82433202 / -0.4% 120492567 / 116835758 / +3.1% 0.68 / 0.71 / -3.4%
tpch_q13/datafusion:parquet 210273445 / 210618688 / -0.2% 240210029 / 238788117 / +0.6% 0.88 / 0.88 / -0.8%
tpch_q14/datafusion:parquet 85227982 / 85602024 / -0.4% 190919263 / 186569859 / +2.3% 0.45 / 0.46 / -2.7%
tpch_q15/datafusion:parquet 105398025 / 106606603 / -1.1% 152715116 / 154598932 / -1.2% 0.69 / 0.69 / +0.1%
tpch_q16/datafusion:parquet 97344484 / 94683007 / +2.8% 118019952 / 123221265 / -4.2% 0.82 / 0.77 / +7.3%
tpch_q17/datafusion:parquet 213702409 / 215630850 / -0.9% 261372092 / 257798988 / +1.4% 0.82 / 0.84 / -2.2%
tpch_q18/datafusion:parquet 271982063 / 267541314 / +1.7% 313942759 / 318452912 / -1.4% 0.87 / 0.84 / +3.1%
tpch_q19/datafusion:parquet 108023862 / 108282497 / -0.2% 164100262 / 164045798 / +0.0% 0.66 / 0.66 / -0.3%
tpch_q20/datafusion:parquet 184545173 / 185298197 / -0.4% 243579402 / 237189433 / +2.7% 0.76 / 0.78 / -3.0%
tpch_q21/datafusion:parquet 240437050 / 244268713 / -1.6% 315342384 / 306493573 / +2.9% 0.76 / 0.80 / -4.3%
tpch_q22/datafusion:parquet 150082068 / 149723897 / +0.2% 175949403 / 171986203 / +2.3% 0.85 / 0.87 / -2.0%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33044143 / 33162813 / -0.4% 73653663 / 60965941 / +20.8% 🔴 0.45 / 0.54 / -17.5%
tpch_q02/duckdb:vortex-file-compressed 28166135 / 28441284 / -1.0% 42310590 / 42490796 / -0.4% 0.67 / 0.67 / -0.5%
tpch_q03/duckdb:vortex-file-compressed 51677822 / 51806352 / -0.2% 105083527 / 96181102 / +9.3% 0.49 / 0.54 / -8.7%
tpch_q04/duckdb:vortex-file-compressed 51884231 / 51520893 / +0.7% 90252018 / 83080389 / +8.6% 0.57 / 0.62 / -7.3%
tpch_q05/duckdb:vortex-file-compressed 69362350 / 68278233 / +1.6% 112691155 / 110549285 / +1.9% 0.62 / 0.62 / -0.3%
tpch_q06/duckdb:vortex-file-compressed 15295424 / 14995905 / +2.0% 53175944 / 49678736 / +7.0% 0.29 / 0.30 / -4.7%
tpch_q07/duckdb:vortex-file-compressed 54517418 / 55095502 / -1.0% 109552107 / 99927713 / +9.6% 0.50 / 0.55 / -9.7%
tpch_q08/duckdb:vortex-file-compressed 85074723 / 84730600 / +0.4% 134453420 / 128300677 / +4.8% 0.63 / 0.66 / -4.2%
tpch_q09/duckdb:vortex-file-compressed 102472686 / 102680463 / -0.2% 157264454 / 149752209 / +5.0% 0.65 / 0.69 / -5.0%
tpch_q10/duckdb:vortex-file-compressed 95664592 / 95736829 / -0.1% 169542337 / 145772381 / +16.3% 🔴 0.56 / 0.66 / -14.1%
tpch_q11/duckdb:vortex-file-compressed 13226357 / 13161487 / +0.5% 27966902 / 28614710 / -2.3% 0.47 / 0.46 / +2.8%
tpch_q12/duckdb:vortex-file-compressed 45214006 / 45171630 / +0.1% 88709932 / 74559415 / +19.0% 🔴 0.51 / 0.61 / -15.9%
tpch_q13/duckdb:vortex-file-compressed 70796151 / 71277113 / -0.7% 100938970 / 98751212 / +2.2% 0.70 / 0.72 / -2.8%
tpch_q14/duckdb:vortex-file-compressed 27846389 / 27742167 / +0.4% 74452533 / 68588058 / +8.6% 0.37 / 0.40 / -7.5%
tpch_q15/duckdb:vortex-file-compressed 24183414 / 24169914 / +0.1% 67549015 / 62760479 / +7.6% 0.36 / 0.39 / -7.0%
tpch_q16/duckdb:vortex-file-compressed 48459369 / 49823920 / -2.7% 60533327 / 58191998 / +4.0% 0.80 / 0.86 / -6.5%
tpch_q17/duckdb:vortex-file-compressed 35063634 / 34928738 / +0.4% 68949889 / 64550565 / +6.8% 0.51 / 0.54 / -6.0%
tpch_q18/duckdb:vortex-file-compressed 106845199 / 102866087 / +3.9% 122145862 / 121696816 / +0.4% 0.87 / 0.85 / +3.5%
tpch_q19/duckdb:vortex-file-compressed 26842090 / 27489534 / -2.4% 82820282 / 76106199 / +8.8% 0.32 / 0.36 / -10.3%
tpch_q20/duckdb:vortex-file-compressed 41006797 / 41385355 / -0.9% 97123853 / 88937430 / +9.2% 0.42 / 0.47 / -9.3%
tpch_q21/duckdb:vortex-file-compressed 93336149 / 92643489 / +0.7% 151796092 / 140692444 / +7.9% 0.61 / 0.66 / -6.6%
tpch_q22/duckdb:vortex-file-compressed 33409676 / 33019958 / +1.2% 50788327 / 47168881 / +7.7% 0.66 / 0.70 / -6.0%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67483339 / 68061708 / -0.8% 87444952 / 88188170 / -0.8% 0.77 / 0.77 / -0.0%
tpch_q02/duckdb:parquet 86723801 / 87254980 / -0.6% 97118949 / 98880371 / -1.8% 0.89 / 0.88 / +1.2%
tpch_q03/duckdb:parquet 110591758 / 110221645 / +0.3% 145157127 / 141238280 / +2.8% 0.76 / 0.78 / -2.4%
tpch_q04/duckdb:parquet 76657220 / 76532636 / +0.2% 100994099 / 97762896 / +3.3% 0.76 / 0.78 / -3.0%
tpch_q05/duckdb:parquet 122591222 / 123479542 / -0.7% 159673460 / 155668079 / +2.6% 0.77 / 0.79 / -3.2%
tpch_q06/duckdb:parquet 35214841 / 35931981 / -2.0% 65330207 / 56977323 / +14.7% 🔴 0.54 / 0.63 / -14.5%
tpch_q07/duckdb:parquet 116171329 / 119339250 / -2.7% 155246580 / 153627189 / +1.1% 0.75 / 0.78 / -3.7%
tpch_q08/duckdb:parquet 148649662 / 147255450 / +0.9% 195423785 / 190628929 / +2.5% 0.76 / 0.77 / -1.5%
tpch_q09/duckdb:parquet 236716097 / 235578554 / +0.5% 281864357 / 276803702 / +1.8% 0.84 / 0.85 / -1.3%
tpch_q10/duckdb:parquet 312011206 / 313587478 / -0.5% 341519439 / 337403692 / +1.2% 0.91 / 0.93 / -1.7%
tpch_q11/duckdb:parquet 43294109 / 43490479 / -0.5% 50471050 / 50005616 / +0.9% 0.86 / 0.87 / -1.4%
tpch_q12/duckdb:parquet 69653962 / 70505417 / -1.2% 92181913 / 90007679 / +2.4% 0.76 / 0.78 / -3.5%
tpch_q13/duckdb:parquet 291685947 / 293441858 / -0.6% 306031578 / 310736944 / -1.5% 0.95 / 0.94 / +0.9%
tpch_q14/duckdb:parquet 101280017 / 101133653 / +0.1% 137150135 / 136327535 / +0.6% 0.74 / 0.74 / -0.5%
tpch_q15/duckdb:parquet 57975343 / 57306184 / +1.2% 87888945 / 84972419 / +3.4% 0.66 / 0.67 / -2.2%
tpch_q16/duckdb:parquet 100980565 / 100633707 / +0.3% 107523398 / 107203047 / +0.3% 0.94 / 0.94 / +0.0%
tpch_q17/duckdb:parquet 81956551 / 83962666 / -2.4% 113227436 / 110031995 / +2.9% 0.72 / 0.76 / -5.1%
tpch_q18/duckdb:parquet 153618404 / 157083225 / -2.2% 171995689 / 172862922 / -0.5% 0.89 / 0.91 / -1.7%
tpch_q19/duckdb:parquet 98292296 / 98792583 / -0.5% 128877858 / 130377546 / -1.2% 0.76 / 0.76 / +0.7%
tpch_q20/duckdb:parquet 146720983 / 146971997 / -0.2% 188001907 / 181619680 / +3.5% 0.78 / 0.81 / -3.6%
tpch_q21/duckdb:parquet 251129674 / 254756250 / -1.4% 269696844 / 271034790 / -0.5% 0.93 / 0.94 / -0.9%
tpch_q22/duckdb:parquet 168051294 / 168406469 / -0.2% 179546448 / 179252698 / +0.2% 0.94 / 0.94 / -0.4%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 7fb2efcf vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.0%
Engines: DataFusion No clear signal (+11.8%, environment too noisy confidence) · DuckDB No clear signal (-3.3%, environment too noisy confidence)
Vortex (geomean): hot 1.081x ➖ · cold 1.025x ➖
Parquet (geomean): hot 1.040x ➖ · cold 1.077x ➖
Shifts: Parquet (control) +4.0% · Median polish +3.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.157x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 217274803 / 213717821 / +1.7% 888324046 / 764398977 / +16.2% 0.24 / 0.28 / -12.5%
tpch_q02/datafusion:vortex-file-compressed 373948087 / 320984758 / +16.5% 646361693 / 553448858 / +16.8% 0.58 / 0.58 / -0.2%
tpch_q03/datafusion:vortex-file-compressed 321608132 / 310450262 / +3.6% 866473095 / 854530904 / +1.4% 0.37 / 0.36 / +2.2%
tpch_q04/datafusion:vortex-file-compressed 345092425 / 159007585 / +117.0% 🔴 409357892 / 372572808 / +9.9% 0.84 / 0.43 / +97.5%
tpch_q05/datafusion:vortex-file-compressed 383467405 / 344078558 / +11.4% 567464967 / 546047746 / +3.9% 0.68 / 0.63 / +7.2%
tpch_q06/datafusion:vortex-file-compressed 144446080 / 123668516 / +16.8% 350510195 / 317073449 / +10.5% 0.41 / 0.39 / +5.7%
tpch_q07/datafusion:vortex-file-compressed 434192502 / 426177142 / +1.9% 653812447 / 586012416 / +11.6% 0.66 / 0.73 / -8.7%
tpch_q08/datafusion:vortex-file-compressed 463327473 / 410714646 / +12.8% 609854807 / 541459260 / +12.6% 0.76 / 0.76 / +0.2%
tpch_q09/datafusion:vortex-file-compressed 309276636 / 301899395 / +2.4% 470930966 / 455403137 / +3.4% 0.66 / 0.66 / -0.9%
tpch_q10/datafusion:vortex-file-compressed 376668035 / 361036359 / +4.3% 610174204 / 525406226 / +16.1% 0.62 / 0.69 / -10.2%
tpch_q11/datafusion:vortex-file-compressed 290650740 / 272228443 / +6.8% 473799053 / 382260665 / +23.9% 0.61 / 0.71 / -13.9%
tpch_q12/datafusion:vortex-file-compressed 259623862 / 203460731 / +27.6% 385237478 / 338106908 / +13.9% 0.67 / 0.60 / +12.0%
tpch_q13/datafusion:vortex-file-compressed 106838178 / 116217877 / -8.1% 332574132 / 309114444 / +7.6% 0.32 / 0.38 / -14.6%
tpch_q14/datafusion:vortex-file-compressed 183900452 / 181074526 / +1.6% 359765106 / 354128334 / +1.6% 0.51 / 0.51 / -0.0%
tpch_q15/datafusion:vortex-file-compressed 294337470 / 306125584 / -3.9% 474030837 / 727209626 / -34.8% 🟢 0.62 / 0.42 / +47.5%
tpch_q16/datafusion:vortex-file-compressed 159854911 / 134848492 / +18.5% 305197255 / 285978767 / +6.7% 0.52 / 0.47 / +11.1%
tpch_q17/datafusion:vortex-file-compressed 264435767 / 252865916 / +4.6% 503173591 / 494400127 / +1.8% 0.53 / 0.51 / +2.8%
tpch_q18/datafusion:vortex-file-compressed 283151500 / 222278514 / +27.4% 435228898 / 389005809 / +11.9% 0.65 / 0.57 / +13.9%
tpch_q19/datafusion:vortex-file-compressed 235286261 / 226209017 / +4.0% 384512176 / 296515885 / +29.7% 0.61 / 0.76 / -19.8%
tpch_q20/datafusion:vortex-file-compressed 279501609 / 248686849 / +12.4% 445685347 / 477297666 / -6.6% 0.63 / 0.52 / +20.4%
tpch_q21/datafusion:vortex-file-compressed 1013094781 / 384422617 / +163.5% 🔴 790271361 / 739838656 / +6.8% 1.28 / 0.52 / +146.7%
tpch_q22/datafusion:vortex-file-compressed 144722917 / 147475449 / -1.9% 415983605 / 337385924 / +23.3% 0.35 / 0.44 / -20.4%
datafusion / parquet / ns (1.035x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 153336142 / 143033960 / +7.2% 463610629 / 425422516 / +9.0% 0.33 / 0.34 / -1.6%
tpch_q02/datafusion:parquet 284129065 / 274389077 / +3.5% 563458043 / 421418541 / +33.7% 🔴 0.50 / 0.65 / -22.6%
tpch_q03/datafusion:parquet 230505400 / 240153039 / -4.0% 673601315 / 656104536 / +2.7% 0.34 / 0.37 / -6.5%
tpch_q04/datafusion:parquet 146935842 / 129091170 / +13.8% 323871089 / 262434371 / +23.4% 0.45 / 0.49 / -7.8%
tpch_q05/datafusion:parquet 338664448 / 325560808 / +4.0% 509581499 / 708712744 / -28.1% 0.66 / 0.46 / +44.7%
tpch_q06/datafusion:parquet 111682812 / 104623731 / +6.7% 216317912 / 202039421 / +7.1% 0.52 / 0.52 / -0.3%
tpch_q07/datafusion:parquet 319917719 / 326115720 / -1.9% 431382611 / 439408571 / -1.8% 0.74 / 0.74 / -0.1%
tpch_q08/datafusion:parquet 411336457 / 383031456 / +7.4% 613522009 / 487777150 / +25.8% 0.67 / 0.79 / -14.6%
tpch_q09/datafusion:parquet 383799980 / 507741508 / -24.4% 571216257 / 948722124 / -39.8% 🟢 0.67 / 0.54 / +25.5%
tpch_q10/datafusion:parquet 315217578 / 318225993 / -0.9% 428873198 / 431490793 / -0.6% 0.73 / 0.74 / -0.3%
tpch_q11/datafusion:parquet 252103916 / 245309101 / +2.8% 361741286 / 324804219 / +11.4% 0.70 / 0.76 / -7.7%
tpch_q12/datafusion:parquet 174563615 / 160703746 / +8.6% 289741282 / 262477140 / +10.4% 0.60 / 0.61 / -1.6%
tpch_q13/datafusion:parquet 278825994 / 274764633 / +1.5% 437331526 / 387802001 / +12.8% 0.64 / 0.71 / -10.0%
tpch_q14/datafusion:parquet 157595537 / 141590102 / +11.3% 329485987 / 264823133 / +24.4% 0.48 / 0.53 / -10.5%
tpch_q15/datafusion:parquet 304480992 / 297935495 / +2.2% 522786074 / 444599102 / +17.6% 0.58 / 0.67 / -13.1%
tpch_q16/datafusion:parquet 99977778 / 96864793 / +3.2% 219177691 / 207092637 / +5.8% 0.46 / 0.47 / -2.5%
tpch_q17/datafusion:parquet 278141114 / 268630342 / +3.5% 436678870 / 416939497 / +4.7% 0.64 / 0.64 / -1.1%
tpch_q18/datafusion:parquet 294254910 / 305302634 / -3.6% 490200879 / 465639400 / +5.3% 0.60 / 0.66 / -8.4%
tpch_q19/datafusion:parquet 170992038 / 149310744 / +14.5% 290698489 / 274137368 / +6.0% 0.59 / 0.54 / +8.0%
tpch_q20/datafusion:parquet 247834820 / 228071243 / +8.7% 359959227 / 424446687 / -15.2% 0.69 / 0.54 / +28.1%
tpch_q21/datafusion:parquet 307791613 / 291483866 / +5.6% 518688090 / 469762099 / +10.4% 0.59 / 0.62 / -4.4%
tpch_q22/datafusion:parquet 168660618 / 145366900 / +16.0% 520791378 / 299750221 / +73.7% 🔴 0.32 / 0.48 / -33.2%
duckdb / vortex-file-compressed / ns (1.010x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 253670421 / 237695207 / +6.7% 293315835 / 298096331 / -1.6% 0.86 / 0.80 / +8.5%
tpch_q02/duckdb:vortex-file-compressed 390992754 / 394665672 / -0.9% 463451519 / 474795024 / -2.4% 0.84 / 0.83 / +1.5%
tpch_q03/duckdb:vortex-file-compressed 428409104 / 398939371 / +7.4% 540983207 / 460688509 / +17.4% 0.79 / 0.87 / -8.6%
tpch_q04/duckdb:vortex-file-compressed 285498192 / 255227345 / +11.9% 284178135 / 296337544 / -4.1% 1.00 / 0.86 / +16.6%
tpch_q05/duckdb:vortex-file-compressed 564454613 / 709957932 / -20.5% 661204455 / 785337665 / -15.8% 0.85 / 0.90 / -5.6%
tpch_q06/duckdb:vortex-file-compressed 198341111 / 148777224 / +33.3% 🔴 264927725 / 208058114 / +27.3% 0.75 / 0.72 / +4.7%
tpch_q07/duckdb:vortex-file-compressed 422047556 / 387859027 / +8.8% 461402628 / 510621725 / -9.6% 0.91 / 0.76 / +20.4%
tpch_q08/duckdb:vortex-file-compressed 617570422 / 617848086 / -0.0% 809340105 / 732855328 / +10.4% 0.76 / 0.84 / -9.5%
tpch_q09/duckdb:vortex-file-compressed 383301722 / 392528875 / -2.4% 428893160 / 482201706 / -11.1% 0.89 / 0.81 / +9.8%
tpch_q10/duckdb:vortex-file-compressed 525166417 / 526138612 / -0.2% 574849025 / 576801469 / -0.3% 0.91 / 0.91 / +0.2%
tpch_q11/duckdb:vortex-file-compressed 317777458 / 288496302 / +10.1% 310552878 / 270775100 / +14.7% 1.02 / 1.07 / -4.0%
tpch_q12/duckdb:vortex-file-compressed 231396994 / 271105721 / -14.6% 336152560 / 407392913 / -17.5% 0.69 / 0.67 / +3.4%
tpch_q13/duckdb:vortex-file-compressed 224385093 / 247871881 / -9.5% 215915929 / 208806747 / +3.4% 1.04 / 1.19 / -12.5%
tpch_q14/duckdb:vortex-file-compressed 270987831 / 224785869 / +20.6% 281022985 / 273953898 / +2.6% 0.96 / 0.82 / +17.5%
tpch_q15/duckdb:vortex-file-compressed 244425121 / 237917836 / +2.7% 264376064 / 453417020 / -41.7% 🟢 0.92 / 0.52 / +76.2%
tpch_q16/duckdb:vortex-file-compressed 238493455 / 206543544 / +15.5% 241820302 / 287344280 / -15.8% 0.99 / 0.72 / +37.2%
tpch_q17/duckdb:vortex-file-compressed 314504026 / 454602893 / -30.8% 🟢 322150442 / 443734007 / -27.4% 0.98 / 1.02 / -4.7%
tpch_q18/duckdb:vortex-file-compressed 379278485 / 339736454 / +11.6% 526490917 / 418339259 / +25.9% 0.72 / 0.81 / -11.3%
tpch_q19/duckdb:vortex-file-compressed 335280843 / 320978677 / +4.5% 347800576 / 349847295 / -0.6% 0.96 / 0.92 / +5.1%
tpch_q20/duckdb:vortex-file-compressed 332846306 / 334782469 / -0.6% 475775453 / 412936083 / +15.2% 0.70 / 0.81 / -13.7%
tpch_q21/duckdb:vortex-file-compressed 557908826 / 558602915 / -0.1% 684446187 / 630439819 / +8.6% 0.82 / 0.89 / -8.0%
tpch_q22/duckdb:vortex-file-compressed 225849366 / 253794094 / -11.0% 271424434 / 269551763 / +0.7% 0.83 / 0.94 / -11.6%
duckdb / parquet / ns (1.044x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 199986499 / 178327142 / +12.1% 251018293 / 188180852 / +33.4% 🔴 0.80 / 0.95 / -15.9%
tpch_q02/duckdb:parquet 459912786 / 428571834 / +7.3% 546434614 / 421258354 / +29.7% 0.84 / 1.02 / -17.3%
tpch_q03/duckdb:parquet 333152528 / 384797319 / -13.4% 418311164 / 402689855 / +3.9% 0.80 / 0.96 / -16.7%
tpch_q04/duckdb:parquet 237247000 / 278868438 / -14.9% 440439656 / 290411092 / +51.7% 🔴 0.54 / 0.96 / -43.9%
tpch_q05/duckdb:parquet 535286929 / 512960026 / +4.4% 552285434 / 589908823 / -6.4% 0.97 / 0.87 / +11.5%
tpch_q06/duckdb:parquet 176539743 / 154774655 / +14.1% 197158181 / 188086085 / +4.8% 0.90 / 0.82 / +8.8%
tpch_q07/duckdb:parquet 421963975 / 419672939 / +0.5% 509522798 / 421853390 / +20.8% 0.83 / 0.99 / -16.8%
tpch_q08/duckdb:parquet 591839956 / 588960652 / +0.5% 602311263 / 658661231 / -8.6% 0.98 / 0.89 / +9.9%
tpch_q09/duckdb:parquet 534747246 / 557378838 / -4.1% 639348244 / 656390425 / -2.6% 0.84 / 0.85 / -1.5%
tpch_q10/duckdb:parquet 562169670 / 517349035 / +8.7% 572944945 / 581884894 / -1.5% 0.98 / 0.89 / +10.4%
tpch_q11/duckdb:parquet 296343140 / 279247336 / +6.1% 353501082 / 301469405 / +17.3% 0.84 / 0.93 / -9.5%
tpch_q12/duckdb:parquet 281988943 / 244321025 / +15.4% 304364633 / 281145014 / +8.3% 0.93 / 0.87 / +6.6%
tpch_q13/duckdb:parquet 398078457 / 382703043 / +4.0% 474188793 / 463219570 / +2.4% 0.84 / 0.83 / +1.6%
tpch_q14/duckdb:parquet 285202676 / 255047143 / +11.8% 344217799 / 301222259 / +14.3% 0.83 / 0.85 / -2.1%
tpch_q15/duckdb:parquet 209809067 / 191438501 / +9.6% 298537120 / 220554518 / +35.4% 🔴 0.70 / 0.87 / -19.0%
tpch_q16/duckdb:parquet 280817464 / 287313946 / -2.3% 283735653 / 301984087 / -6.0% 0.99 / 0.95 / +4.0%
tpch_q17/duckdb:parquet 257095599 / 258007938 / -0.4% 285166298 / 314199718 / -9.2% 0.90 / 0.82 / +9.8%
tpch_q18/duckdb:parquet 351103813 / 306425002 / +14.6% 386487055 / 355418381 / +8.7% 0.91 / 0.86 / +5.4%
tpch_q19/duckdb:parquet 244996784 / 241485587 / +1.5% 307895939 / 285468394 / +7.9% 0.80 / 0.85 / -5.9%
tpch_q20/duckdb:parquet 427084813 / 432599380 / -1.3% 435949896 / 540117093 / -19.3% 0.98 / 0.80 / +22.3%
tpch_q21/duckdb:parquet 502850104 / 417617294 / +20.4% 525540085 / 463876894 / +13.3% 0.96 / 0.90 / +6.3%
tpch_q22/duckdb:parquet 318934011 / 287438341 / +11.0% 301807351 / 253402369 / +19.1% 1.06 / 1.13 / -6.8%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 7fb2efcf vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.003x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35738852 / 35836658 / -0.3% 60942402 / 59839649 / +1.8% 0.59 / 0.60 / -2.1%
tpcds_q02/datafusion:vortex-file-compressed 50585219 / 51540980 / -1.9% 76301368 / 75356430 / +1.3% 0.66 / 0.68 / -3.1%
tpcds_q03/datafusion:vortex-file-compressed 20210810 / 20246396 / -0.2% 48572102 / 46166223 / +5.2% 0.42 / 0.44 / -5.1%
tpcds_q04/datafusion:vortex-file-compressed 290627674 / 293432920 / -1.0% 353320626 / 354050198 / -0.2% 0.82 / 0.83 / -0.8%
tpcds_q05/datafusion:vortex-file-compressed 73032600 / 71656747 / +1.9% 113338895 / 107692212 / +5.2% 0.64 / 0.67 / -3.2%
tpcds_q06/datafusion:vortex-file-compressed 42502696 / 42258217 / +0.6% 69690006 / 70535607 / -1.2% 0.61 / 0.60 / +1.8%
tpcds_q07/datafusion:vortex-file-compressed 40973196 / 42156216 / -2.8% 83794438 / 80613054 / +3.9% 0.49 / 0.52 / -6.5%
tpcds_q08/datafusion:vortex-file-compressed 28056239 / 28614063 / -1.9% 55616107 / 57730721 / -3.7% 0.50 / 0.50 / +1.8%
tpcds_q09/datafusion:vortex-file-compressed 43827434 / 44012164 / -0.4% 78402319 / 77101674 / +1.7% 0.56 / 0.57 / -2.1%
tpcds_q10/datafusion:vortex-file-compressed 37559515 / 37189576 / +1.0% 66543385 / 63021635 / +5.6% 0.56 / 0.59 / -4.4%
tpcds_q11/datafusion:vortex-file-compressed 173963279 / 174495550 / -0.3% 215141604 / 221987691 / -3.1% 0.81 / 0.79 / +2.9%
tpcds_q12/datafusion:vortex-file-compressed 17845574 / 17549844 / +1.7% 36903609 / 38571171 / -4.3% 0.48 / 0.45 / +6.3%
tpcds_q13/datafusion:vortex-file-compressed 40331142 / 38899632 / +3.7% 84715545 / 85520203 / -0.9% 0.48 / 0.45 / +4.7%
tpcds_q14/datafusion:vortex-file-compressed 237839332 / 231725092 / +2.6% 266721094 / 271215982 / -1.7% 0.89 / 0.85 / +4.4%
tpcds_q15/datafusion:vortex-file-compressed 40425753 / 40095029 / +0.8% 60911219 / 54164984 / +12.5% 🔴 0.66 / 0.74 / -10.3%
tpcds_q16/datafusion:vortex-file-compressed 23188231 / 22869641 / +1.4% 42821564 / 42034772 / +1.9% 0.54 / 0.54 / -0.5%
tpcds_q17/datafusion:vortex-file-compressed 64576863 / 64808376 / -0.4% 99016319 / 89558176 / +10.6% 🔴 0.65 / 0.72 / -9.9%
tpcds_q18/datafusion:vortex-file-compressed 69416287 / 69097730 / +0.5% 98018901 / 94787906 / +3.4% 0.71 / 0.73 / -2.9%
tpcds_q19/datafusion:vortex-file-compressed 23816888 / 22408799 / +6.3% 55240628 / 55496169 / -0.5% 0.43 / 0.40 / +6.8%
tpcds_q20/datafusion:vortex-file-compressed 23814636 / 23702741 / +0.5% 41027828 / 40220803 / +2.0% 0.58 / 0.59 / -1.5%
tpcds_q21/datafusion:vortex-file-compressed 46799577 / 47542674 / -1.6% 68481786 / 64058585 / +6.9% 0.68 / 0.74 / -7.9%
tpcds_q22/datafusion:vortex-file-compressed 440964281 / 431366016 / +2.2% 463363679 / 465284097 / -0.4% 0.95 / 0.93 / +2.6%
tpcds_q23/datafusion:vortex-file-compressed 298019788 / 299587271 / -0.5% 347541281 / 351318540 / -1.1% 0.86 / 0.85 / +0.6%
tpcds_q24/datafusion:vortex-file-compressed 117924876 / 120023524 / -1.7% 153258057 / 159982078 / -4.2% 0.77 / 0.75 / +2.6%
tpcds_q25/datafusion:vortex-file-compressed 58836574 / 63311010 / -7.1% 90703829 / 102454935 / -11.5% 🟢 0.65 / 0.62 / +5.0%
tpcds_q26/datafusion:vortex-file-compressed 36981990 / 37429288 / -1.2% 60923013 / 59331611 / +2.7% 0.61 / 0.63 / -3.8%
tpcds_q27/datafusion:vortex-file-compressed 72004989 / 72377160 / -0.5% 107609696 / 104225546 / +3.2% 0.67 / 0.69 / -3.6%
tpcds_q28/datafusion:vortex-file-compressed 42316784 / 42296916 / +0.0% 85641773 / 82755038 / +3.5% 0.49 / 0.51 / -3.3%
tpcds_q29/datafusion:vortex-file-compressed 66115764 / 61922299 / +6.8% 104360026 / 97201813 / +7.4% 0.63 / 0.64 / -0.6%
tpcds_q30/datafusion:vortex-file-compressed 51871422 / 51311054 / +1.1% 79713702 / 79114003 / +0.8% 0.65 / 0.65 / +0.3%
tpcds_q31/datafusion:vortex-file-compressed 199155166 / 196557266 / +1.3% 233586820 / 235875877 / -1.0% 0.85 / 0.83 / +2.3%
tpcds_q32/datafusion:vortex-file-compressed 14929412 / 15236954 / -2.0% 31174850 / 31554300 / -1.2% 0.48 / 0.48 / -0.8%
tpcds_q33/datafusion:vortex-file-compressed 33511480 / 33321710 / +0.6% 68594081 / 67027574 / +2.3% 0.49 / 0.50 / -1.7%
tpcds_q34/datafusion:vortex-file-compressed 40947388 / 41148345 / -0.5% 67316392 / 68234625 / -1.3% 0.61 / 0.60 / +0.9%
tpcds_q35/datafusion:vortex-file-compressed 92948639 / 92443260 / +0.5% 122059552 / 120652799 / +1.2% 0.76 / 0.77 / -0.6%
tpcds_q36/datafusion:vortex-file-compressed 65567672 / 65946206 / -0.6% 99180258 / 100250170 / -1.1% 0.66 / 0.66 / +0.5%
tpcds_q37/datafusion:vortex-file-compressed 24648182 / 23553139 / +4.6% 50458206 / 43598667 / +15.7% 🔴 0.49 / 0.54 / -9.6%
tpcds_q38/datafusion:vortex-file-compressed 79124086 / 76507711 / +3.4% 110434558 / 106221269 / +4.0% 0.72 / 0.72 / -0.5%
tpcds_q39/datafusion:vortex-file-compressed 893851021 / 887680404 / +0.7% 898243523 / 906829393 / -0.9% 1.00 / 0.98 / +1.7%
tpcds_q40/datafusion:vortex-file-compressed 28701624 / 28735451 / -0.1% 48971913 / 47789817 / +2.5% 0.59 / 0.60 / -2.5%
tpcds_q41/datafusion:vortex-file-compressed 19344804 / 19056672 / +1.5% 31093055 / 30560191 / +1.7% 0.62 / 0.62 / -0.2%
tpcds_q42/datafusion:vortex-file-compressed 13624064 / 14306364 / -4.8% 38948036 / 39330916 / -1.0% 0.35 / 0.36 / -3.8%
tpcds_q43/datafusion:vortex-file-compressed 17398240 / 17123520 / +1.6% 40444413 / 40887604 / -1.1% 0.43 / 0.42 / +2.7%
tpcds_q44/datafusion:vortex-file-compressed 43628606 / 42841783 / +1.8% 74787429 / 73034215 / +2.4% 0.58 / 0.59 / -0.6%
tpcds_q45/datafusion:vortex-file-compressed 43625786 / 42716522 / +2.1% 64399386 / 64325351 / +0.1% 0.68 / 0.66 / +2.0%
tpcds_q46/datafusion:vortex-file-compressed 70117506 / 70770951 / -0.9% 111385639 / 103002911 / +8.1% 0.63 / 0.69 / -8.4%
tpcds_q47/datafusion:vortex-file-compressed 175946396 / 176930862 / -0.6% 220897233 / 217533458 / +1.5% 0.80 / 0.81 / -2.1%
tpcds_q48/datafusion:vortex-file-compressed 35884956 / 35477019 / +1.1% 74051869 / 70167195 / +5.5% 0.48 / 0.51 / -4.2%
tpcds_q49/datafusion:vortex-file-compressed 79376378 / 79901468 / -0.7% 125167378 / 120233831 / +4.1% 0.63 / 0.66 / -4.6%
tpcds_q50/datafusion:vortex-file-compressed 56638034 / 56310110 / +0.6% 87202249 / 89046429 / -2.1% 0.65 / 0.63 / +2.7%
tpcds_q51/datafusion:vortex-file-compressed 240951984 / 241461239 / -0.2% 285718876 / 280306123 / +1.9% 0.84 / 0.86 / -2.1%
tpcds_q52/datafusion:vortex-file-compressed 14247749 / 14942948 / -4.7% 39713616 / 41146983 / -3.5% 0.36 / 0.36 / -1.2%
tpcds_q53/datafusion:vortex-file-compressed 23354687 / 23025893 / +1.4% 51671250 / 52394142 / -1.4% 0.45 / 0.44 / +2.8%
tpcds_q54/datafusion:vortex-file-compressed 58438728 / 59630808 / -2.0% 95186837 / 92798502 / +2.6% 0.61 / 0.64 / -4.5%
tpcds_q55/datafusion:vortex-file-compressed 13576650 / 15209610 / -10.7% 🟢 40307425 / 39200802 / +2.8% 0.34 / 0.39 / -13.2%
tpcds_q56/datafusion:vortex-file-compressed 32988478 / 34211642 / -3.6% 63616858 / 63579406 / +0.1% 0.52 / 0.54 / -3.6%
tpcds_q57/datafusion:vortex-file-compressed 132015280 / 130827096 / +0.9% 161481242 / 162474233 / -0.6% 0.82 / 0.81 / +1.5%
tpcds_q58/datafusion:vortex-file-compressed 48375266 / 49071762 / -1.4% 86245978 / 84738612 / +1.8% 0.56 / 0.58 / -3.1%
tpcds_q59/datafusion:vortex-file-compressed 54519710 / 54936949 / -0.8% 81488505 / 85696270 / -4.9% 0.67 / 0.64 / +4.4%
tpcds_q60/datafusion:vortex-file-compressed 34760402 / 34485962 / +0.8% 63499921 / 66114270 / -4.0% 0.55 / 0.52 / +4.9%
tpcds_q61/datafusion:vortex-file-compressed 45231372 / 45202724 / +0.1% 72013410 / 70916447 / +1.5% 0.63 / 0.64 / -1.5%
tpcds_q62/datafusion:vortex-file-compressed 19351584 / 19841460 / -2.5% 41866785 / 43084349 / -2.8% 0.46 / 0.46 / +0.4%
tpcds_q63/datafusion:vortex-file-compressed 22636464 / 22619521 / +0.1% 51793231 / 49716174 / +4.2% 0.44 / 0.45 / -3.9%
tpcds_q64/datafusion:vortex-file-compressed 336744010 / 332776120 / +1.2% 402489396 / 399340320 / +0.8% 0.84 / 0.83 / +0.4%
tpcds_q65/datafusion:vortex-file-compressed 75564602 / 73751860 / +2.5% 109249491 / 110569158 / -1.2% 0.69 / 0.67 / +3.7%
tpcds_q66/datafusion:vortex-file-compressed 53600502 / 52486634 / +2.1% 77816597 / 77837826 / -0.0% 0.69 / 0.67 / +2.2%
tpcds_q67/datafusion:vortex-file-compressed 423485246 / 420503111 / +0.7% 527546144 / 528828691 / -0.2% 0.80 / 0.80 / +1.0%
tpcds_q68/datafusion:vortex-file-compressed 66894302 / 66831493 / +0.1% 102386663 / 99391180 / +3.0% 0.65 / 0.67 / -2.8%
tpcds_q69/datafusion:vortex-file-compressed 35399158 / 36278824 / -2.4% 62500885 / 63625322 / -1.8% 0.57 / 0.57 / -0.7%
tpcds_q70/datafusion:vortex-file-compressed 195950984 / 194497137 / +0.7% 229638773 / 232217411 / -1.1% 0.85 / 0.84 / +1.9%
tpcds_q71/datafusion:vortex-file-compressed 25767730 / 25424784 / +1.3% 58167294 / 61267492 / -5.1% 0.44 / 0.41 / +6.8%
tpcds_q72/datafusion:vortex-file-compressed 1580907348 / 1575229677 / +0.4% 1644698264 / 1696144047 / -3.0% 0.96 / 0.93 / +3.5%
tpcds_q73/datafusion:vortex-file-compressed 37330730 / 38589712 / -3.3% 64384413 / 62969996 / +2.2% 0.58 / 0.61 / -5.4%
tpcds_q74/datafusion:vortex-file-compressed 134636101 / 134601274 / +0.0% 171112498 / 173765353 / -1.5% 0.79 / 0.77 / +1.6%
tpcds_q75/datafusion:vortex-file-compressed 157548322 / 155633299 / +1.2% 202407986 / 198511793 / +2.0% 0.78 / 0.78 / -0.7%
tpcds_q76/datafusion:vortex-file-compressed 34124458 / 34722660 / -1.7% 73974875 / 73189101 / +1.1% 0.46 / 0.47 / -2.8%
tpcds_q77/datafusion:vortex-file-compressed 54803320 / 54175824 / +1.2% 89098573 / 87493805 / +1.8% 0.62 / 0.62 / -0.7%
tpcds_q78/datafusion:vortex-file-compressed 141296114 / 140889933 / +0.3% 194501481 / 191779256 / +1.4% 0.73 / 0.73 / -1.1%
tpcds_q79/datafusion:vortex-file-compressed 53415350 / 53408896 / +0.0% 86777481 / 83137730 / +4.4% 0.62 / 0.64 / -4.2%
tpcds_q80/datafusion:vortex-file-compressed 81217908 / 80795658 / +0.5% 128903288 / 127799771 / +0.9% 0.63 / 0.63 / -0.3%
tpcds_q81/datafusion:vortex-file-compressed 55587776 / 55975548 / -0.7% 84638243 / 83846761 / +0.9% 0.66 / 0.67 / -1.6%
tpcds_q82/datafusion:vortex-file-compressed 30742794 / 30549740 / +0.6% 48879583 / 48106493 / +1.6% 0.63 / 0.64 / -1.0%
tpcds_q83/datafusion:vortex-file-compressed 42249304 / 42358020 / -0.3% 68311981 / 65597866 / +4.1% 0.62 / 0.65 / -4.2%
tpcds_q84/datafusion:vortex-file-compressed 12896981 / 12799204 / +0.8% 32418518 / 30970538 / +4.7% 0.40 / 0.41 / -3.7%
tpcds_q85/datafusion:vortex-file-compressed 58921475 / 60660052 / -2.9% 92167449 / 90654953 / +1.7% 0.64 / 0.67 / -4.5%
tpcds_q86/datafusion:vortex-file-compressed 18607556 / 18272155 / +1.8% 41703966 / 40425570 / +3.2% 0.45 / 0.45 / -1.3%
tpcds_q87/datafusion:vortex-file-compressed 78921000 / 79615489 / -0.9% 108883466 / 107689679 / +1.1% 0.72 / 0.74 / -2.0%
tpcds_q88/datafusion:vortex-file-compressed 54055760 / 56206700 / -3.8% 92334929 / 93094539 / -0.8% 0.59 / 0.60 / -3.0%
tpcds_q89/datafusion:vortex-file-compressed 27082096 / 26931306 / +0.6% 55891031 / 56072635 / -0.3% 0.48 / 0.48 / +0.9%
tpcds_q90/datafusion:vortex-file-compressed 12915052 / 12758200 / +1.2% 30382796 / 34107490 / -10.9% 🟢 0.43 / 0.37 / +13.6%
tpcds_q91/datafusion:vortex-file-compressed 18617269 / 19519254 / -4.6% 42352308 / 42141655 / +0.5% 0.44 / 0.46 / -5.1%
tpcds_q92/datafusion:vortex-file-compressed 14981906 / 15245025 / -1.7% 35721468 / 33922326 / +5.3% 0.42 / 0.45 / -6.7%
tpcds_q93/datafusion:vortex-file-compressed 55703036 / 54842766 / +1.6% 89862039 / 88696680 / +1.3% 0.62 / 0.62 / +0.3%
tpcds_q94/datafusion:vortex-file-compressed 22380142 / 21620928 / +3.5% 45244873 / 46231785 / -2.1% 0.49 / 0.47 / +5.8%
tpcds_q95/datafusion:vortex-file-compressed 97498226 / 95000299 / +2.6% 128186557 / 123858370 / +3.5% 0.76 / 0.77 / -0.8%
tpcds_q96/datafusion:vortex-file-compressed 12120888 / 11533278 / +5.1% 32556347 / 31102793 / +4.7% 0.37 / 0.37 / +0.4%
tpcds_q97/datafusion:vortex-file-compressed 39521166 / 39467840 / +0.1% 66790760 / 66425488 / +0.5% 0.59 / 0.59 / -0.4%
tpcds_q98/datafusion:vortex-file-compressed 20645907 / 20665282 / -0.1% 45419686 / 48509099 / -6.4% 0.45 / 0.43 / +6.7%
tpcds_q99/datafusion:vortex-file-compressed 29461365 / 29545800 / -0.3% 48335690 / 48862458 / -1.1% 0.61 / 0.60 / +0.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59846104 / 59408052 / +0.7% 79110250 / 82373568 / -4.0% 0.76 / 0.72 / +4.9%
tpcds_q02/datafusion:parquet 69585170 / 69761366 / -0.3% 94115948 / 90812813 / +3.6% 0.74 / 0.77 / -3.8%
tpcds_q03/datafusion:parquet 28424740 / 28478768 / -0.2% 49120062 / 49334251 / -0.4% 0.58 / 0.58 / +0.2%
tpcds_q04/datafusion:parquet 644066924 / 642610250 / +0.2% 706644845 / 708231753 / -0.2% 0.91 / 0.91 / +0.5%
tpcds_q05/datafusion:parquet 84055312 / 81388832 / +3.3% 115372626 / 113800720 / +1.4% 0.73 / 0.72 / +1.9%
tpcds_q06/datafusion:parquet 91666878 / 90852955 / +0.9% 112691291 / 115952402 / -2.8% 0.81 / 0.78 / +3.8%
tpcds_q07/datafusion:parquet 101971482 / 101418282 / +0.5% 135409136 / 133695330 / +1.3% 0.75 / 0.76 / -0.7%
tpcds_q08/datafusion:parquet 48601425 / 48684130 / -0.2% 77266923 / 74133519 / +4.2% 0.63 / 0.66 / -4.2%
tpcds_q09/datafusion:parquet 74230223 / 75160834 / -1.2% 106914172 / 102849415 / +4.0% 0.69 / 0.73 / -5.0%
tpcds_q10/datafusion:parquet 59025714 / 60416750 / -2.3% 77340933 / 84947233 / -9.0% 0.76 / 0.71 / +7.3%
tpcds_q11/datafusion:parquet 410909698 / 412444870 / -0.4% 449629747 / 461294550 / -2.5% 0.91 / 0.89 / +2.2%
tpcds_q12/datafusion:parquet 39830347 / 39871562 / -0.1% 58260109 / 57128529 / +2.0% 0.68 / 0.70 / -2.0%
tpcds_q13/datafusion:parquet 86514126 / 84637846 / +2.2% 131266406 / 130466094 / +0.6% 0.66 / 0.65 / +1.6%
tpcds_q14/datafusion:parquet 382545518 / 378360104 / +1.1% 441720172 / 433388374 / +1.9% 0.87 / 0.87 / -0.8%
tpcds_q15/datafusion:parquet 51193307 / 51502606 / -0.6% 72059376 / 72303263 / -0.3% 0.71 / 0.71 / -0.3%
tpcds_q16/datafusion:parquet 46095394 / 45710882 / +0.8% 60751580 / 63650471 / -4.6% 0.76 / 0.72 / +5.7%
tpcds_q17/datafusion:parquet 135367896 / 138067928 / -2.0% 170992111 / 172187136 / -0.7% 0.79 / 0.80 / -1.3%
tpcds_q18/datafusion:parquet 110270906 / 110369917 / -0.1% 144014950 / 144952536 / -0.6% 0.77 / 0.76 / +0.6%
tpcds_q19/datafusion:parquet 49042920 / 48384048 / +1.4% 74584137 / 75539146 / -1.3% 0.66 / 0.64 / +2.7%
tpcds_q20/datafusion:parquet 42058825 / 41512735 / +1.3% 54770028 / 55090816 / -0.6% 0.77 / 0.75 / +1.9%
tpcds_q21/datafusion:parquet 61272172 / 61141701 / +0.2% 74269631 / 73095747 / +1.6% 0.82 / 0.84 / -1.4%
tpcds_q22/datafusion:parquet 463401700 / 464195324 / -0.2% 478154436 / 478139930 / +0.0% 0.97 / 0.97 / -0.2%
tpcds_q23/datafusion:parquet 364902468 / 357626356 / +2.0% 419760805 / 417833459 / +0.5% 0.87 / 0.86 / +1.6%
tpcds_q24/datafusion:parquet 239960956 / 241331307 / -0.6% 278939258 / 278266611 / +0.2% 0.86 / 0.87 / -0.8%
tpcds_q25/datafusion:parquet 143801972 / 146902811 / -2.1% 179605180 / 196039200 / -8.4% 0.80 / 0.75 / +6.8%
tpcds_q26/datafusion:parquet 54740102 / 53821080 / +1.7% 78627267 / 80565923 / -2.4% 0.70 / 0.67 / +4.2%
tpcds_q27/datafusion:parquet 210770400 / 210089836 / +0.3% 238395421 / 235911774 / +1.1% 0.88 / 0.89 / -0.7%
tpcds_q28/datafusion:parquet 86339088 / 86784142 / -0.5% 114899880 / 119280232 / -3.7% 0.75 / 0.73 / +3.3%
tpcds_q29/datafusion:parquet 143913894 / 145820741 / -1.3% 178010153 / 175411233 / +1.5% 0.81 / 0.83 / -2.7%
tpcds_q30/datafusion:parquet 97098671 / 99608501 / -2.5% 122160106 / 120071149 / +1.7% 0.79 / 0.83 / -4.2%
tpcds_q31/datafusion:parquet 320531178 / 319058792 / +0.5% 350925436 / 344041143 / +2.0% 0.91 / 0.93 / -1.5%
tpcds_q32/datafusion:parquet 29100096 / 29399552 / -1.0% 44499065 / 43643939 / +2.0% 0.65 / 0.67 / -2.9%
tpcds_q33/datafusion:parquet 52268631 / 51971680 / +0.6% 81777060 / 76538194 / +6.8% 0.64 / 0.68 / -5.9%
tpcds_q34/datafusion:parquet 64615578 / 65511648 / -1.4% 86261858 / 85276600 / +1.2% 0.75 / 0.77 / -2.5%
tpcds_q35/datafusion:parquet 124111274 / 126922984 / -2.2% 149720922 / 150646646 / -0.6% 0.83 / 0.84 / -1.6%
tpcds_q36/datafusion:parquet 97740988 / 97863638 / -0.1% 126168472 / 126419427 / -0.2% 0.77 / 0.77 / +0.1%
tpcds_q37/datafusion:parquet 49981466 / 50046237 / -0.1% 66074518 / 65033749 / +1.6% 0.76 / 0.77 / -1.7%
tpcds_q38/datafusion:parquet 122379443 / 122147195 / +0.2% 144840034 / 145034869 / -0.1% 0.84 / 0.84 / +0.3%
tpcds_q39/datafusion:parquet 848634404 / 846526498 / +0.2% 868654262 / 859437879 / +1.1% 0.98 / 0.98 / -0.8%
tpcds_q40/datafusion:parquet 35323022 / 35936465 / -1.7% 57104225 / 54650564 / +4.5% 0.62 / 0.66 / -5.9%
tpcds_q41/datafusion:parquet 32384036 / 31200319 / +3.8% 42928264 / 42657926 / +0.6% 0.75 / 0.73 / +3.1%
tpcds_q42/datafusion:parquet 26267024 / 25952126 / +1.2% 45183220 / 43716014 / +3.4% 0.58 / 0.59 / -2.1%
tpcds_q43/datafusion:parquet 27066464 / 27372783 / -1.1% 47913681 / 46844617 / +2.3% 0.56 / 0.58 / -3.3%
tpcds_q44/datafusion:parquet 65974502 / 65006033 / +1.5% 88815320 / 87803178 / +1.2% 0.74 / 0.74 / +0.3%
tpcds_q45/datafusion:parquet 65260081 / 66536274 / -1.9% 88550410 / 87212845 / +1.5% 0.74 / 0.76 / -3.4%
tpcds_q46/datafusion:parquet 106070562 / 106805720 / -0.7% 149304923 / 153607976 / -2.8% 0.71 / 0.70 / +2.2%
tpcds_q47/datafusion:parquet 235263802 / 237808994 / -1.1% 277774977 / 273252482 / +1.7% 0.85 / 0.87 / -2.7%
tpcds_q48/datafusion:parquet 79596834 / 76955857 / +3.4% 107195207 / 105870247 / +1.3% 0.74 / 0.73 / +2.2%
tpcds_q49/datafusion:parquet 118513122 / 118898020 / -0.3% 163572274 / 170084458 / -3.8% 0.72 / 0.70 / +3.6%
tpcds_q50/datafusion:parquet 91543628 / 92705258 / -1.3% 127873567 / 120435148 / +6.2% 0.72 / 0.77 / -7.0%
tpcds_q51/datafusion:parquet 254073824 / 254091982 / -0.0% 280715489 / 289211985 / -2.9% 0.91 / 0.88 / +3.0%
tpcds_q52/datafusion:parquet 26756704 / 26889958 / -0.5% 49053938 / 45469536 / +7.9% 0.55 / 0.59 / -7.8%
tpcds_q53/datafusion:parquet 36860408 / 36382336 / +1.3% 60697199 / 57842390 / +4.9% 0.61 / 0.63 / -3.5%
tpcds_q54/datafusion:parquet 87118548 / 85254806 / +2.2% 110862140 / 109551589 / +1.2% 0.79 / 0.78 / +1.0%
tpcds_q55/datafusion:parquet 26120426 / 26510566 / -1.5% 46675290 / 46645823 / +0.1% 0.56 / 0.57 / -1.5%
tpcds_q56/datafusion:parquet 52559214 / 54094848 / -2.8% 71418106 / 77335323 / -7.7% 0.74 / 0.70 / +5.2%
tpcds_q57/datafusion:parquet 171470728 / 171894920 / -0.2% 198776509 / 193978047 / +2.5% 0.86 / 0.89 / -2.7%
tpcds_q58/datafusion:parquet 95173786 / 98465482 / -3.3% 120750408 / 125032548 / -3.4% 0.79 / 0.79 / +0.1%
tpcds_q59/datafusion:parquet 104281068 / 103659830 / +0.6% 132833410 / 130225505 / +2.0% 0.79 / 0.80 / -1.4%
tpcds_q60/datafusion:parquet 54937190 / 55741260 / -1.4% 76412537 / 78220449 / -2.3% 0.72 / 0.71 / +0.9%
tpcds_q61/datafusion:parquet 75890964 / 78001000 / -2.7% 104837037 / 106432779 / -1.5% 0.72 / 0.73 / -1.2%
tpcds_q62/datafusion:parquet 27984463 / 27762318 / +0.8% 44431477 / 44527940 / -0.2% 0.63 / 0.62 / +1.0%
tpcds_q63/datafusion:parquet 36192717 / 36196190 / -0.0% 57661302 / 58834211 / -2.0% 0.63 / 0.62 / +2.0%
tpcds_q64/datafusion:parquet 658224862 / 659557758 / -0.2% 738585084 / 742173662 / -0.5% 0.89 / 0.89 / +0.3%
tpcds_q65/datafusion:parquet 102515377 / 100715906 / +1.8% 134648853 / 133981634 / +0.5% 0.76 / 0.75 / +1.3%
tpcds_q66/datafusion:parquet 76770357 / 76575936 / +0.3% 103857739 / 104374000 / -0.5% 0.74 / 0.73 / +0.8%
tpcds_q67/datafusion:parquet 433841712 / 430912350 / +0.7% 498367301 / 500297658 / -0.4% 0.87 / 0.86 / +1.1%
tpcds_q68/datafusion:parquet 109598996 / 108700552 / +0.8% 154844737 / 156742031 / -1.2% 0.71 / 0.69 / +2.1%
tpcds_q69/datafusion:parquet 58775068 / 61003348 / -3.7% 75477183 / 84325988 / -10.5% 🟢 0.78 / 0.72 / +7.6%
tpcds_q70/datafusion:parquet 211583896 / 212975306 / -0.7% 242519297 / 246017700 / -1.4% 0.87 / 0.87 / +0.8%
tpcds_q71/datafusion:parquet 38320680 / 39083124 / -2.0% 63926350 / 64662143 / -1.1% 0.60 / 0.60 / -0.8%
tpcds_q72/datafusion:parquet 1780182057 / 1794732356 / -0.8% 1765749160 / 1806078341 / -2.2% 1.01 / 0.99 / +1.5%
tpcds_q73/datafusion:parquet 62006290 / 62856255 / -1.4% 85764633 / 84855052 / +1.1% 0.72 / 0.74 / -2.4%
tpcds_q74/datafusion:parquet 293925644 / 292768250 / +0.4% 328927949 / 331483495 / -0.8% 0.89 / 0.88 / +1.2%
tpcds_q75/datafusion:parquet 199460189 / 193794623 / +2.9% 235134530 / 239131737 / -1.7% 0.85 / 0.81 / +4.7%
tpcds_q76/datafusion:parquet 49604548 / 49958244 / -0.7% 80275244 / 78897199 / +1.7% 0.62 / 0.63 / -2.4%
tpcds_q77/datafusion:parquet 72292465 / 73280301 / -1.3% 99229950 / 98096657 / +1.2% 0.73 / 0.75 / -2.5%
tpcds_q78/datafusion:parquet 214115465 / 211119866 / +1.4% 267282401 / 273491694 / -2.3% 0.80 / 0.77 / +3.8%
tpcds_q79/datafusion:parquet 77792948 / 77375078 / +0.5% 122062124 / 112413871 / +8.6% 0.64 / 0.69 / -7.4%
tpcds_q80/datafusion:parquet 146089488 / 143104068 / +2.1% 195176358 / 191975662 / +1.7% 0.75 / 0.75 / +0.4%
tpcds_q81/datafusion:parquet 107533851 / 106756472 / +0.7% 128150027 / 129378123 / -0.9% 0.84 / 0.83 / +1.7%
tpcds_q82/datafusion:parquet 54215888 / 53582485 / +1.2% 72670354 / 70410662 / +3.2% 0.75 / 0.76 / -2.0%
tpcds_q83/datafusion:parquet 68058199 / 66630048 / +2.1% 79764340 / 85136032 / -6.3% 0.85 / 0.78 / +9.0%
tpcds_q84/datafusion:parquet 35973428 / 36220898 / -0.7% 50574301 / 49805351 / +1.5% 0.71 / 0.73 / -2.2%
tpcds_q85/datafusion:parquet 106428132 / 103848480 / +2.5% 132012638 / 129149354 / +2.2% 0.81 / 0.80 / +0.3%
tpcds_q86/datafusion:parquet 22225321 / 22112695 / +0.5% 38647701 / 39672664 / -2.6% 0.58 / 0.56 / +3.2%
tpcds_q87/datafusion:parquet 122340477 / 122470358 / -0.1% 143348369 / 148224625 / -3.3% 0.85 / 0.83 / +3.3%
tpcds_q88/datafusion:parquet 85508723 / 86047137 / -0.6% 114165675 / 108358632 / +5.4% 0.75 / 0.79 / -5.7%
tpcds_q89/datafusion:parquet 39213468 / 38401756 / +2.1% 63083337 / 64923770 / -2.8% 0.62 / 0.59 / +5.1%
tpcds_q90/datafusion:parquet 17583594 / 18100802 / -2.9% 33409048 / 32273520 / +3.5% 0.53 / 0.56 / -6.2%
tpcds_q91/datafusion:parquet 42415560 / 41738000 / +1.6% 59163040 / 57454843 / +3.0% 0.72 / 0.73 / -1.3%
tpcds_q92/datafusion:parquet 29215138 / 28604120 / +2.1% 48380487 / 47460689 / +1.9% 0.60 / 0.60 / +0.2%
tpcds_q93/datafusion:parquet 62722501 / 63722030 / -1.6% 98511610 / 87405909 / +12.7% 🔴 0.64 / 0.73 / -12.7%
tpcds_q94/datafusion:parquet 38521244 / 37847109 / +1.8% 58340933 / 58549059 / -0.4% 0.66 / 0.65 / +2.1%
tpcds_q95/datafusion:parquet 125365954 / 128012922 / -2.1% 153727156 / 149910916 / +2.5% 0.82 / 0.85 / -4.5%
tpcds_q96/datafusion:parquet 21397767 / 20691258 / +3.4% 37537456 / 36951345 / +1.6% 0.57 / 0.56 / +1.8%
tpcds_q97/datafusion:parquet 54578504 / 54645566 / -0.1% 79346085 / 80351616 / -1.3% 0.69 / 0.68 / +1.1%
tpcds_q98/datafusion:parquet 61283423 / 61965680 / -1.1% 86197421 / 83775704 / +2.9% 0.71 / 0.74 / -3.9%
tpcds_q99/datafusion:parquet 42262939 / 42461627 / -0.5% 57872012 / 57802802 / +0.1% 0.73 / 0.73 / -0.6%
duckdb / vortex-file-compressed / ns (1.002x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 33111682 / 32726779 / +1.2% 44976729 / 45377689 / -0.9% 0.74 / 0.72 / +2.1%
tpcds_q02/duckdb:vortex-file-compressed 30756228 / 30267290 / +1.6% 42206977 / 44087004 / -4.3% 0.73 / 0.69 / +6.1%
tpcds_q03/duckdb:vortex-file-compressed 13673730 / 13779130 / -0.8% 31056906 / 30718899 / +1.1% 0.44 / 0.45 / -1.8%
tpcds_q04/duckdb:vortex-file-compressed 129069014 / 130206338 / -0.9% 158985499 / 157201556 / +1.1% 0.81 / 0.83 / -2.0%
tpcds_q05/duckdb:vortex-file-compressed 55278610 / 53727511 / +2.9% 79442207 / 83478676 / -4.8% 0.70 / 0.64 / +8.1%
tpcds_q06/duckdb:vortex-file-compressed 58866816 / 58800986 / +0.1% 78727936 / 79094008 / -0.5% 0.75 / 0.74 / +0.6%
tpcds_q07/duckdb:vortex-file-compressed 31159140 / 31168844 / -0.0% 50522117 / 54099517 / -6.6% 0.62 / 0.58 / +7.0%
tpcds_q08/duckdb:vortex-file-compressed 31768082 / 31134683 / +2.0% 42082266 / 41772800 / +0.7% 0.75 / 0.75 / +1.3%
tpcds_q09/duckdb:vortex-file-compressed 57364490 / 55235330 / +3.9% 79200719 / 79107779 / +0.1% 0.72 / 0.70 / +3.7%
tpcds_q10/duckdb:vortex-file-compressed 39764721 / 39038430 / +1.9% 58165704 / 58236826 / -0.1% 0.68 / 0.67 / +2.0%
tpcds_q11/duckdb:vortex-file-compressed 95188370 / 96226126 / -1.1% 112962215 / 112266994 / +0.6% 0.84 / 0.86 / -1.7%
tpcds_q12/duckdb:vortex-file-compressed 17133262 / 17276975 / -0.8% 28437755 / 30254952 / -6.0% 0.60 / 0.57 / +5.5%
tpcds_q13/duckdb:vortex-file-compressed 38021080 / 38940578 / -2.4% 69387977 / 71103229 / -2.4% 0.55 / 0.55 / +0.1%
tpcds_q14/duckdb:vortex-file-compressed 120402346 / 119983268 / +0.3% 132254838 / 140641737 / -6.0% 0.91 / 0.85 / +6.7%
tpcds_q15/duckdb:vortex-file-compressed 56835388 / 60759281 / -6.5% 73214375 / 76171754 / -3.9% 0.78 / 0.80 / -2.7%
tpcds_q16/duckdb:vortex-file-compressed 34750035 / 34771337 / -0.1% 54387004 / 53890958 / +0.9% 0.64 / 0.65 / -1.0%
tpcds_q17/duckdb:vortex-file-compressed 57994144 / 57289182 / +1.2% 82057963 / 81955246 / +0.1% 0.71 / 0.70 / +1.1%
tpcds_q18/duckdb:vortex-file-compressed 83255975 / 82993345 / +0.3% 103999085 / 104424434 / -0.4% 0.80 / 0.79 / +0.7%
tpcds_q19/duckdb:vortex-file-compressed 44800756 / 43899722 / +2.1% 64456302 / 65276395 / -1.3% 0.70 / 0.67 / +3.4%
tpcds_q20/duckdb:vortex-file-compressed 21898552 / 21520304 / +1.8% 35988954 / 34931964 / +3.0% 0.61 / 0.62 / -1.2%
tpcds_q21/duckdb:vortex-file-compressed 28446710 / 28120830 / +1.2% 60045231 / 62004166 / -3.2% 0.47 / 0.45 / +4.5%
tpcds_q22/duckdb:vortex-file-compressed 164136868 / 165099230 / -0.6% 171707676 / 170541662 / +0.7% 0.96 / 0.97 / -1.3%
tpcds_q23/duckdb:vortex-file-compressed 184335631 / 185876490 / -0.8% 201689179 / 199673618 / +1.0% 0.91 / 0.93 / -1.8%
tpcds_q24/duckdb:vortex-file-compressed 53016202 / 52636914 / +0.7% 76383549 / 77254623 / -1.1% 0.69 / 0.68 / +1.9%
tpcds_q25/duckdb:vortex-file-compressed 52979506 / 53220034 / -0.5% 78634765 / 75302591 / +4.4% 0.67 / 0.71 / -4.7%
tpcds_q26/duckdb:vortex-file-compressed 26813881 / 26713063 / +0.4% 42727868 / 42934826 / -0.5% 0.63 / 0.62 / +0.9%
tpcds_q27/duckdb:vortex-file-compressed 33539589 / 32585874 / +2.9% 55004795 / 53424233 / +3.0% 0.61 / 0.61 / -0.0%
tpcds_q28/duckdb:vortex-file-compressed 41717567 / 41342696 / +0.9% 63240400 / 66089322 / -4.3% 0.66 / 0.63 / +5.5%
tpcds_q29/duckdb:vortex-file-compressed 52507840 / 51866994 / +1.2% 76289875 / 74066949 / +3.0% 0.69 / 0.70 / -1.7%
tpcds_q30/duckdb:vortex-file-compressed 38383678 / 37914817 / +1.2% 50290318 / 52960815 / -5.0% 0.76 / 0.72 / +6.6%
tpcds_q31/duckdb:vortex-file-compressed 37199897 / 37512062 / -0.8% 55623603 / 53392186 / +4.2% 0.67 / 0.70 / -4.8%
tpcds_q32/duckdb:vortex-file-compressed 14057064 / 13855892 / +1.5% 28859005 / 28855272 / +0.0% 0.49 / 0.48 / +1.4%
tpcds_q33/duckdb:vortex-file-compressed 34819894 / 33813963 / +3.0% 60132373 / 59046480 / +1.8% 0.58 / 0.57 / +1.1%
tpcds_q34/duckdb:vortex-file-compressed 22901896 / 22811725 / +0.4% 40488263 / 39776812 / +1.8% 0.57 / 0.57 / -1.4%
tpcds_q35/duckdb:vortex-file-compressed 66854769 / 66786588 / +0.1% 89910762 / 85242000 / +5.5% 0.74 / 0.78 / -5.1%
tpcds_q36/duckdb:vortex-file-compressed 28964908 / 29806828 / -2.8% 49912986 / 49308472 / +1.2% 0.58 / 0.60 / -4.0%
tpcds_q37/duckdb:vortex-file-compressed 25286630 / 25605208 / -1.2% 72157565 / 74457214 / -3.1% 0.35 / 0.34 / +1.9%
tpcds_q38/duckdb:vortex-file-compressed 63290221 / 62408870 / +1.4% 74135667 / 81156842 / -8.7% 0.85 / 0.77 / +11.0%
tpcds_q39/duckdb:vortex-file-compressed 54884513 / 56168904 / -2.3% 87256020 / 85127364 / +2.5% 0.63 / 0.66 / -4.7%
tpcds_q40/duckdb:vortex-file-compressed 19153293 / 19238372 / -0.4% 34984020 / 35099919 / -0.3% 0.55 / 0.55 / -0.1%
tpcds_q41/duckdb:vortex-file-compressed 16372544 / 18720698 / -12.5% 🟢 22760990 / 25500417 / -10.7% 🟢 0.72 / 0.73 / -2.0%
tpcds_q42/duckdb:vortex-file-compressed 15200112 / 14015144 / +8.5% 30515932 / 30966847 / -1.5% 0.50 / 0.45 / +10.1%
tpcds_q43/duckdb:vortex-file-compressed 19097236 / 19403602 / -1.6% 32754245 / 32011378 / +2.3% 0.58 / 0.61 / -3.8%
tpcds_q44/duckdb:vortex-file-compressed 28745259 / 28307018 / +1.5% 50804828 / 51668551 / -1.7% 0.57 / 0.55 / +3.3%
tpcds_q45/duckdb:vortex-file-compressed 46649436 / 46586273 / +0.1% 59255633 / 60370446 / -1.8% 0.79 / 0.77 / +2.0%
tpcds_q46/duckdb:vortex-file-compressed 50745606 / 51192653 / -0.9% 77299739 / 75043524 / +3.0% 0.66 / 0.68 / -3.8%
tpcds_q47/duckdb:vortex-file-compressed 81349672 / 80927444 / +0.5% 95085739 / 97094785 / -2.1% 0.86 / 0.83 / +2.6%
tpcds_q48/duckdb:vortex-file-compressed 52975890 / 53155386 / -0.3% 79843103 / 81823473 / -2.4% 0.66 / 0.65 / +2.1%
tpcds_q49/duckdb:vortex-file-compressed 38467294 / 37950044 / +1.4% 80200233 / 78847393 / +1.7% 0.48 / 0.48 / -0.3%
tpcds_q50/duckdb:vortex-file-compressed 33280972 / 32675461 / +1.9% 56165834 / 57051911 / -1.6% 0.59 / 0.57 / +3.5%
tpcds_q51/duckdb:vortex-file-compressed 204977777 / 204779876 / +0.1% 220921579 / 217736852 / +1.5% 0.93 / 0.94 / -1.3%
tpcds_q52/duckdb:vortex-file-compressed 15009502 / 15384257 / -2.4% 31500247 / 31876748 / -1.2% 0.48 / 0.48 / -1.3%
tpcds_q53/duckdb:vortex-file-compressed 22049628 / 22960290 / -4.0% 38227585 / 39000657 / -2.0% 0.58 / 0.59 / -2.0%
tpcds_q54/duckdb:vortex-file-compressed 44412348 / 44886930 / -1.1% 64701766 / 65481173 / -1.2% 0.69 / 0.69 / +0.1%
tpcds_q55/duckdb:vortex-file-compressed 14753466 / 14612501 / +1.0% 29871141 / 30570651 / -2.3% 0.49 / 0.48 / +3.3%
tpcds_q56/duckdb:vortex-file-compressed 33442874 / 32462078 / +3.0% 56687061 / 57717193 / -1.8% 0.59 / 0.56 / +4.9%
tpcds_q57/duckdb:vortex-file-compressed 66915400 / 64171452 / +4.3% 77969206 / 78496038 / -0.7% 0.86 / 0.82 / +5.0%
tpcds_q58/duckdb:vortex-file-compressed 37310785 / 37835588 / -1.4% 59163860 / 64016051 / -7.6% 0.63 / 0.59 / +6.7%
tpcds_q59/duckdb:vortex-file-compressed 53109774 / 53810956 / -1.3% 67232487 / 71107629 / -5.4% 0.79 / 0.76 / +4.4%
tpcds_q60/duckdb:vortex-file-compressed 34896668 / 35369636 / -1.3% 57470985 / 59793701 / -3.9% 0.61 / 0.59 / +2.7%
tpcds_q61/duckdb:vortex-file-compressed 33601170 / 34298255 / -2.0% 55348784 / 53069753 / +4.3% 0.61 / 0.65 / -6.1%
tpcds_q62/duckdb:vortex-file-compressed 15219286 / 14822514 / +2.7% 26628635 / 26421769 / +0.8% 0.57 / 0.56 / +1.9%
tpcds_q63/duckdb:vortex-file-compressed 21108652 / 20828409 / +1.3% 37306822 / 38114655 / -2.1% 0.57 / 0.55 / +3.5%
tpcds_q64/duckdb:vortex-file-compressed 118959124 / 118342334 / +0.5% 151647515 / 152181613 / -0.4% 0.78 / 0.78 / +0.9%
tpcds_q65/duckdb:vortex-file-compressed 51924247 / 51466061 / +0.9% 59974060 / 58907342 / +1.8% 0.87 / 0.87 / -0.9%
tpcds_q66/duckdb:vortex-file-compressed 41523018 / 40998564 / +1.3% 57323387 / 58858579 / -2.6% 0.72 / 0.70 / +4.0%
tpcds_q67/duckdb:vortex-file-compressed 278124286 / 277425812 / +0.3% 292429500 / 283678837 / +3.1% 0.95 / 0.98 / -2.7%
tpcds_q68/duckdb:vortex-file-compressed 44835978 / 44593714 / +0.5% 72266598 / 72079771 / +0.3% 0.62 / 0.62 / +0.3%
tpcds_q69/duckdb:vortex-file-compressed 38221056 / 38356528 / -0.4% 62543325 / 59755970 / +4.7% 0.61 / 0.64 / -4.8%
tpcds_q70/duckdb:vortex-file-compressed 25743048 / 25085070 / +2.6% 40785479 / 41516746 / -1.8% 0.63 / 0.60 / +4.5%
tpcds_q71/duckdb:vortex-file-compressed 28528180 / 27715436 / +2.9% 49963217 / 50902781 / -1.8% 0.57 / 0.54 / +4.9%
tpcds_q72/duckdb:vortex-file-compressed 139246408 / 135900823 / +2.5% 162681346 / 164226936 / -0.9% 0.86 / 0.83 / +3.4%
tpcds_q73/duckdb:vortex-file-compressed 20061566 / 20089200 / -0.1% 37667957 / 37315276 / +0.9% 0.53 / 0.54 / -1.1%
tpcds_q74/duckdb:vortex-file-compressed 85036986 / 82722980 / +2.8% 100849319 / 99629718 / +1.2% 0.84 / 0.83 / +1.6%
tpcds_q75/duckdb:vortex-file-compressed 115680086 / 111929736 / +3.4% 136213083 / 139908352 / -2.6% 0.85 / 0.80 / +6.2%
tpcds_q76/duckdb:vortex-file-compressed 27686292 / 27219565 / +1.7% 59281430 / 58492855 / +1.3% 0.47 / 0.47 / +0.4%
tpcds_q77/duckdb:vortex-file-compressed 36172250 / 36316546 / -0.4% 60414251 / 62103115 / -2.7% 0.60 / 0.58 / +2.4%
tpcds_q78/duckdb:vortex-file-compressed 136633452 / 137442428 / -0.6% 161357654 / 159793923 / +1.0% 0.85 / 0.86 / -1.6%
tpcds_q79/duckdb:vortex-file-compressed 37550715 / 37665982 / -0.3% 63080369 / 59874325 / +5.4% 0.60 / 0.63 / -5.4%
tpcds_q80/duckdb:vortex-file-compressed 58945852 / 57541290 / +2.4% 92366822 / 89399248 / +3.3% 0.64 / 0.64 / -0.9%
tpcds_q81/duckdb:vortex-file-compressed 58687864 / 57777750 / +1.6% 70216589 / 71231569 / -1.4% 0.84 / 0.81 / +3.0%
tpcds_q82/duckdb:vortex-file-compressed 26322112 / 26860434 / -2.0% 73581421 / 77804956 / -5.4% 0.36 / 0.35 / +3.6%
tpcds_q83/duckdb:vortex-file-compressed 21775470 / 21694036 / +0.4% 32497869 / 32263861 / +0.7% 0.67 / 0.67 / -0.3%
tpcds_q84/duckdb:vortex-file-compressed 13714273 / 13366814 / +2.6% 24089047 / 23226339 / +3.7% 0.57 / 0.58 / -1.1%
tpcds_q85/duckdb:vortex-file-compressed 36264560 / 36707151 / -1.2% 54063963 / 56348206 / -4.1% 0.67 / 0.65 / +3.0%
tpcds_q86/duckdb:vortex-file-compressed 16975624 / 16411782 / +3.4% 28207222 / 28182293 / +0.1% 0.60 / 0.58 / +3.3%
tpcds_q87/duckdb:vortex-file-compressed 72367748 / 75201770 / -3.8% 87048336 / 87749398 / -0.8% 0.83 / 0.86 / -3.0%
tpcds_q88/duckdb:vortex-file-compressed 38609384 / 37878092 / +1.9% 51107134 / 49979733 / +2.3% 0.76 / 0.76 / -0.3%
tpcds_q89/duckdb:vortex-file-compressed 24756712 / 24974289 / -0.9% 39080856 / 41888285 / -6.7% 0.63 / 0.60 / +6.2%
tpcds_q90/duckdb:vortex-file-compressed 9962960 / 9843474 / +1.2% 21209067 / 20353435 / +4.2% 0.47 / 0.48 / -2.9%
tpcds_q91/duckdb:vortex-file-compressed 19469693 / 19617013 / -0.8% 29295514 / 29081972 / +0.7% 0.66 / 0.67 / -1.5%
tpcds_q92/duckdb:vortex-file-compressed 13220796 / 13643566 / -3.1% 26667269 / 27682975 / -3.7% 0.50 / 0.49 / +0.6%
tpcds_q93/duckdb:vortex-file-compressed 25992740 / 25876894 / +0.4% 51528255 / 52613864 / -2.1% 0.50 / 0.49 / +2.6%
tpcds_q94/duckdb:vortex-file-compressed 31855451 / 32152022 / -0.9% 46966016 / 47204449 / -0.5% 0.68 / 0.68 / -0.4%
tpcds_q95/duckdb:vortex-file-compressed 93079776 / 97513786 / -4.5% 118785175 / 117615692 / +1.0% 0.78 / 0.83 / -5.5%
tpcds_q96/duckdb:vortex-file-compressed 11982772 / 11752061 / +2.0% 25042628 / 24570663 / +1.9% 0.48 / 0.48 / +0.0%
tpcds_q97/duckdb:vortex-file-compressed 61089412 / 62178961 / -1.8% 79041667 / 82766588 / -4.5% 0.77 / 0.75 / +2.9%
tpcds_q98/duckdb:vortex-file-compressed 26988812 / 26889542 / +0.4% 45997318 / 43917859 / +4.7% 0.59 / 0.61 / -4.2%
tpcds_q99/duckdb:vortex-file-compressed 25756464 / 26072871 / -1.2% 36127939 / 35980286 / +0.4% 0.71 / 0.72 / -1.6%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 42004546 / 43748750 / -4.0% 51718079 / 50433867 / +2.5% 0.81 / 0.87 / -6.4%
tpcds_q02/duckdb:parquet 40410604 / 39630168 / +2.0% 49638957 / 50715675 / -2.1% 0.81 / 0.78 / +4.2%
tpcds_q03/duckdb:parquet 25667980 / 25995732 / -1.3% 35055852 / 36796166 / -4.7% 0.73 / 0.71 / +3.6%
tpcds_q04/duckdb:parquet 205012766 / 203957459 / +0.5% 227471201 / 234181220 / -2.9% 0.90 / 0.87 / +3.5%
tpcds_q05/duckdb:parquet 69062474 / 68357342 / +1.0% 86021299 / 87464497 / -1.7% 0.80 / 0.78 / +2.7%
tpcds_q06/duckdb:parquet 74968161 / 75115975 / -0.2% 87759864 / 89166769 / -1.6% 0.85 / 0.84 / +1.4%
tpcds_q07/duckdb:parquet 62675809 / 62193874 / +0.8% 78835096 / 76707973 / +2.8% 0.80 / 0.81 / -1.9%
tpcds_q08/duckdb:parquet 40130842 / 38663366 / +3.8% 47866899 / 46394278 / +3.2% 0.84 / 0.83 / +0.6%
tpcds_q09/duckdb:parquet 85102988 / 87080988 / -2.3% 96633841 / 101981323 / -5.2% 0.88 / 0.85 / +3.1%
tpcds_q10/duckdb:parquet 52614556 / 52520572 / +0.2% 63405546 / 62695229 / +1.1% 0.83 / 0.84 / -0.9%
tpcds_q11/duckdb:parquet 159677390 / 159415788 / +0.2% 170048124 / 164104249 / +3.6% 0.94 / 0.97 / -3.3%
tpcds_q12/duckdb:parquet 39939362 / 40814548 / -2.1% 47340721 / 48941959 / -3.3% 0.84 / 0.83 / +1.2%
tpcds_q13/duckdb:parquet 71570830 / 69804706 / +2.5% 92378470 / 87793121 / +5.2% 0.77 / 0.80 / -2.6%
tpcds_q14/duckdb:parquet 189320046 / 185753765 / +1.9% 199604342 / 202864595 / -1.6% 0.95 / 0.92 / +3.6%
tpcds_q15/duckdb:parquet 61118128 / 60934452 / +0.3% 68797656 / 69050398 / -0.4% 0.89 / 0.88 / +0.7%
tpcds_q16/duckdb:parquet 38359493 / 37850674 / +1.3% 46717080 / 45839434 / +1.9% 0.82 / 0.83 / -0.6%
tpcds_q17/duckdb:parquet 84755576 / 84076050 / +0.8% 91243686 / 89860905 / +1.5% 0.93 / 0.94 / -0.7%
tpcds_q18/duckdb:parquet 88418379 / 87775860 / +0.7% 97813353 / 98136096 / -0.3% 0.90 / 0.89 / +1.1%
tpcds_q19/duckdb:parquet 49096741 / 47466565 / +3.4% 59255969 / 63007623 / -6.0% 0.83 / 0.75 / +10.0%
tpcds_q20/duckdb:parquet 43105066 / 42342882 / +1.8% 48809440 / 48573403 / +0.5% 0.88 / 0.87 / +1.3%
tpcds_q21/duckdb:parquet 23837668 / 23962194 / -0.5% 28885650 / 28440652 / +1.6% 0.83 / 0.84 / -2.1%
tpcds_q22/duckdb:parquet 162806693 / 166072912 / -2.0% 168596139 / 167098902 / +0.9% 0.97 / 0.99 / -2.8%
tpcds_q23/duckdb:parquet 185263559 / 188036546 / -1.5% 193392523 / 193148517 / +0.1% 0.96 / 0.97 / -1.6%
tpcds_q24/duckdb:parquet 70175208 / 71146241 / -1.4% 83214399 / 82487151 / +0.9% 0.84 / 0.86 / -2.2%
tpcds_q25/duckdb:parquet 51086693 / 51215258 / -0.3% 60892363 / 61288817 / -0.6% 0.84 / 0.84 / +0.4%
tpcds_q26/duckdb:parquet 42751616 / 42361802 / +0.9% 51531128 / 51343370 / +0.4% 0.83 / 0.83 / +0.6%
tpcds_q27/duckdb:parquet 57374276 / 57111037 / +0.5% 76189513 / 81608147 / -6.6% 0.75 / 0.70 / +7.6%
tpcds_q28/duckdb:parquet 93103960 / 93252698 / -0.2% 111811845 / 112178597 / -0.3% 0.83 / 0.83 / +0.2%
tpcds_q29/duckdb:parquet 82905186 / 83041768 / -0.2% 98570002 / 96583021 / +2.1% 0.84 / 0.86 / -2.2%
tpcds_q30/duckdb:parquet 73209911 / 72470468 / +1.0% 82201002 / 81148208 / +1.3% 0.89 / 0.89 / -0.3%
tpcds_q31/duckdb:parquet 99590552 / 98601462 / +1.0% 112407566 / 111465299 / +0.8% 0.89 / 0.88 / +0.2%
tpcds_q32/duckdb:parquet 18540646 / 18353748 / +1.0% 27078372 / 26590155 / +1.8% 0.68 / 0.69 / -0.8%
tpcds_q33/duckdb:parquet 61834209 / 62367010 / -0.9% 75215965 / 73989561 / +1.7% 0.82 / 0.84 / -2.5%
tpcds_q34/duckdb:parquet 32406430 / 33006494 / -1.8% 41072159 / 41889230 / -2.0% 0.79 / 0.79 / +0.1%
tpcds_q35/duckdb:parquet 78143024 / 77399391 / +1.0% 88078344 / 86087567 / +2.3% 0.89 / 0.90 / -1.3%
tpcds_q36/duckdb:parquet 97315534 / 99335950 / -2.0% 111350667 / 112263590 / -0.8% 0.87 / 0.88 / -1.2%
tpcds_q37/duckdb:parquet 41553586 / 41378236 / +0.4% 47908378 / 47554095 / +0.7% 0.87 / 0.87 / -0.3%
tpcds_q38/duckdb:parquet 74971260 / 76468258 / -2.0% 83322031 / 85294747 / -2.3% 0.90 / 0.90 / +0.4%
tpcds_q39/duckdb:parquet 61534760 / 61661639 / -0.2% 68077911 / 67797634 / +0.4% 0.90 / 0.91 / -0.6%
tpcds_q40/duckdb:parquet 28419377 / 27952642 / +1.7% 36098561 / 36118029 / -0.1% 0.79 / 0.77 / +1.7%
tpcds_q41/duckdb:parquet 20609679 / 20143537 / +2.3% 26319851 / 26266476 / +0.2% 0.78 / 0.77 / +2.1%
tpcds_q42/duckdb:parquet 26833794 / 26999602 / -0.6% 37549960 / 36451419 / +3.0% 0.71 / 0.74 / -3.5%
tpcds_q43/duckdb:parquet 28411165 / 28272378 / +0.5% 33824685 / 35793884 / -5.5% 0.84 / 0.79 / +6.3%
tpcds_q44/duckdb:parquet 60557546 / 60736375 / -0.3% 76205124 / 74562633 / +2.2% 0.79 / 0.81 / -2.4%
tpcds_q45/duckdb:parquet 61390315 / 60622120 / +1.3% 70269121 / 67027287 / +4.8% 0.87 / 0.90 / -3.4%
tpcds_q46/duckdb:parquet 71810724 / 72394963 / -0.8% 84219208 / 88023341 / -4.3% 0.85 / 0.82 / +3.7%
tpcds_q47/duckdb:parquet 90620512 / 90830810 / -0.2% 104306724 / 105146923 / -0.8% 0.87 / 0.86 / +0.6%
tpcds_q48/duckdb:parquet 66694135 / 67648746 / -1.4% 81167789 / 85359866 / -4.9% 0.82 / 0.79 / +3.7%
tpcds_q49/duckdb:parquet 69268690 / 67399774 / +2.8% 96795291 / 92020170 / +5.2% 0.72 / 0.73 / -2.3%
tpcds_q50/duckdb:parquet 41828578 / 45228659 / -7.5% 54912818 / 50910629 / +7.9% 0.76 / 0.89 / -14.3%
tpcds_q51/duckdb:parquet 217422175 / 217340788 / +0.0% 221709161 / 225257376 / -1.6% 0.98 / 0.96 / +1.6%
tpcds_q52/duckdb:parquet 26667724 / 26490668 / +0.7% 40115453 / 37218058 / +7.8% 0.66 / 0.71 / -6.6%
tpcds_q53/duckdb:parquet 34610818 / 34202255 / +1.2% 46153860 / 48232701 / -4.3% 0.75 / 0.71 / +5.8%
tpcds_q54/duckdb:parquet 55113174 / 55357348 / -0.4% 64477011 / 63307482 / +1.8% 0.85 / 0.87 / -2.2%
tpcds_q55/duckdb:parquet 27479320 / 26580602 / +3.4% 38235901 / 38734658 / -1.3% 0.72 / 0.69 / +4.7%
tpcds_q56/duckdb:parquet 68769164 / 68450543 / +0.5% 84976193 / 84208264 / +0.9% 0.81 / 0.81 / -0.4%
tpcds_q57/duckdb:parquet 68474590 / 67905272 / +0.8% 75536849 / 75530496 / +0.0% 0.91 / 0.90 / +0.8%
tpcds_q58/duckdb:parquet 56135996 / 55351262 / +1.4% 65649904 / 67300961 / -2.5% 0.86 / 0.82 / +4.0%
tpcds_q59/duckdb:parquet 62354368 / 61543058 / +1.3% 69042378 / 67498896 / +2.3% 0.90 / 0.91 / -0.9%
tpcds_q60/duckdb:parquet 82141170 / 81154691 / +1.2% 96066728 / 95719978 / +0.4% 0.86 / 0.85 / +0.9%
tpcds_q61/duckdb:parquet 79125261 / 78725636 / +0.5% 94506488 / 94693948 / -0.2% 0.84 / 0.83 / +0.7%
tpcds_q62/duckdb:parquet 21382228 / 21271646 / +0.5% 25234158 / 24742108 / +2.0% 0.85 / 0.86 / -1.4%
tpcds_q63/duckdb:parquet 34755886 / 33973322 / +2.3% 43679301 / 44293841 / -1.4% 0.80 / 0.77 / +3.7%
tpcds_q64/duckdb:parquet 137425938 / 134987804 / +1.8% 153038981 / 149714203 / +2.2% 0.90 / 0.90 / -0.4%
tpcds_q65/duckdb:parquet 95438262 / 92507762 / +3.2% 109162033 / 106732283 / +2.3% 0.87 / 0.87 / +0.9%
tpcds_q66/duckdb:parquet 47068631 / 45574203 / +3.3% 51631517 / 52408182 / -1.5% 0.91 / 0.87 / +4.8%
tpcds_q67/duckdb:parquet 290618290 / 294181831 / -1.2% 298681436 / 294225942 / +1.5% 0.97 / 1.00 / -2.7%
tpcds_q68/duckdb:parquet 63170258 / 61610444 / +2.5% 77576640 / 77643526 / -0.1% 0.81 / 0.79 / +2.6%
tpcds_q69/duckdb:parquet 66982635 / 65821270 / +1.8% 77616668 / 75369095 / +3.0% 0.86 / 0.87 / -1.2%
tpcds_q70/duckdb:parquet 42846170 / 42560156 / +0.7% 55548142 / 50824609 / +9.3% 0.77 / 0.84 / -7.9%
tpcds_q71/duckdb:parquet 41299434 / 41353862 / -0.1% 54581534 / 54241063 / +0.6% 0.76 / 0.76 / -0.8%
tpcds_q72/duckdb:parquet 172775078 / 172146606 / +0.4% 186711774 / 189350126 / -1.4% 0.93 / 0.91 / +1.8%
tpcds_q73/duckdb:parquet 26466762 / 27072398 / -2.2% 35483070 / 37030456 / -4.2% 0.75 / 0.73 / +2.0%
tpcds_q74/duckdb:parquet 215380617 / 216089249 / -0.3% 223224450 / 223017657 / +0.1% 0.96 / 0.97 / -0.4%
tpcds_q75/duckdb:parquet 133084578 / 131891024 / +0.9% 152789019 / 152249842 / +0.4% 0.87 / 0.87 / +0.5%
tpcds_q76/duckdb:parquet 51278536 / 51285484 / -0.0% 67882412 / 65205448 / +4.1% 0.76 / 0.79 / -4.0%
tpcds_q77/duckdb:parquet 55667039 / 54841040 / +1.5% 75101705 / 67440836 / +11.4% 🔴 0.74 / 0.81 / -8.8%
tpcds_q78/duckdb:parquet 147396638 / 155747874 / -5.4% 163522157 / 168363678 / -2.9% 0.90 / 0.93 / -2.6%
tpcds_q79/duckdb:parquet 50736084 / 51430181 / -1.3% 64733750 / 64568583 / +0.3% 0.78 / 0.80 / -1.6%
tpcds_q80/duckdb:parquet 80799052 / 82941310 / -2.6% 105180869 / 103690804 / +1.4% 0.77 / 0.80 / -4.0%
tpcds_q81/duckdb:parquet 98327321 / 98572923 / -0.2% 106724801 / 104274293 / +2.4% 0.92 / 0.95 / -2.5%
tpcds_q82/duckdb:parquet 47336101 / 46604344 / +1.6% 54618200 / 52315928 / +4.4% 0.87 / 0.89 / -2.7%
tpcds_q83/duckdb:parquet 28534012 / 28152398 / +1.4% 33697037 / 33185714 / +1.5% 0.85 / 0.85 / -0.2%
tpcds_q84/duckdb:parquet 22782214 / 22751552 / +0.1% 29834766 / 29406408 / +1.5% 0.76 / 0.77 / -1.3%
tpcds_q85/duckdb:parquet 53438664 / 52752074 / +1.3% 62796396 / 62960389 / -0.3% 0.85 / 0.84 / +1.6%
tpcds_q86/duckdb:parquet 25450076 / 25146913 / +1.2% 32666191 / 33004413 / -1.0% 0.78 / 0.76 / +2.3%
tpcds_q87/duckdb:parquet 87869758 / 88695797 / -0.9% 89511180 / 92564858 / -3.3% 0.98 / 0.96 / +2.4%
tpcds_q88/duckdb:parquet 102894646 / 106796080 / -3.7% 112706251 / 111229279 / +1.3% 0.91 / 0.96 / -4.9%
tpcds_q89/duckdb:parquet 37857084 / 37846748 / +0.0% 49085185 / 48196620 / +1.8% 0.77 / 0.79 / -1.8%
tpcds_q90/duckdb:parquet 15426782 / 15015242 / +2.7% 20740513 / 20928242 / -0.9% 0.74 / 0.72 / +3.7%
tpcds_q91/duckdb:parquet 25995150 / 25515043 / +1.9% 33109983 / 33274247 / -0.5% 0.79 / 0.77 / +2.4%
tpcds_q92/duckdb:parquet 22077876 / 22329364 / -1.1% 31540906 / 31995562 / -1.4% 0.70 / 0.70 / +0.3%
tpcds_q93/duckdb:parquet 37678542 / 35799040 / +5.3% 48491274 / 49479404 / -2.0% 0.78 / 0.72 / +7.4%
tpcds_q94/duckdb:parquet 38528154 / 38247234 / +0.7% 45078183 / 46965479 / -4.0% 0.85 / 0.81 / +5.0%
tpcds_q95/duckdb:parquet 82160442 / 81409130 / +0.9% 86448169 / 86595751 / -0.2% 0.95 / 0.94 / +1.1%
tpcds_q96/duckdb:parquet 17888923 / 17012262 / +5.2% 23472854 / 24425947 / -3.9% 0.76 / 0.70 / +9.4%
tpcds_q97/duckdb:parquet 73836352 / 73153984 / +0.9% 81859788 / 78153554 / +4.7% 0.90 / 0.94 / -3.6%
tpcds_q98/duckdb:parquet 55160240 / 55289756 / -0.2% 65325617 / 66788134 / -2.2% 0.84 / 0.83 / +2.0%
tpcds_q99/duckdb:parquet 24397960 / 24402862 / -0.0% 32987018 / 30438057 / +8.4% 0.74 / 0.80 / -7.7%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 7fb2efcf vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-2.0%, low confidence) · DuckDB No clear signal (+1.7%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.981x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.981x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6124628 / 6250168 / -2.0% 16982057 / 19751173 / -14.0% 🟢 0.36 / 0.32 / +14.0%
fineweb_q01/datafusion:vortex-file-compressed 8558010 / 9285400 / -7.8% 39828133 / 35575139 / +12.0% 🔴 0.21 / 0.26 / -17.7%
fineweb_q02/datafusion:vortex-file-compressed 10916742 / 10567512 / +3.3% 37772621 / 40643432 / -7.1% 0.29 / 0.26 / +11.2%
fineweb_q03/datafusion:vortex-file-compressed 17173830 / 17539240 / -2.1% 105960382 / 102692107 / +3.2% 0.16 / 0.17 / -5.1%
fineweb_q04/datafusion:vortex-file-compressed 64469988 / 64090120 / +0.6% 138858130 / 144508483 / -3.9% 0.46 / 0.44 / +4.7%
fineweb_q05/datafusion:vortex-file-compressed 61783899 / 63203121 / -2.2% 140892463 / 139485427 / +1.0% 0.44 / 0.45 / -3.2%
fineweb_q06/datafusion:vortex-file-compressed 16736926 / 17269226 / -3.1% 103526752 / 106346388 / -2.7% 0.16 / 0.16 / -0.4%
fineweb_q07/datafusion:vortex-file-compressed 16778646 / 16748794 / +0.2% 106488445 / 103498538 / +2.9% 0.16 / 0.16 / -2.6%
fineweb_q08/datafusion:vortex-file-compressed 8151277 / 8455804 / -3.6% 27019337 / 26524896 / +1.9% 0.30 / 0.32 / -5.4%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9338967 / 9321344 / +0.2% 31914930 / 32543553 / -1.9% 0.29 / 0.29 / +2.2%
fineweb_q01/datafusion:parquet 75218928 / 75943192 / -1.0% 152700100 / 168115168 / -9.2% 0.49 / 0.45 / +9.0%
fineweb_q02/datafusion:parquet 77096625 / 75797688 / +1.7% 152475852 / 156430678 / -2.5% 0.51 / 0.48 / +4.4%
fineweb_q03/datafusion:parquet 75343309 / 73828035 / +2.1% 157641266 / 151042261 / +4.4% 0.48 / 0.49 / -2.2%
fineweb_q04/datafusion:parquet 82340474 / 82454360 / -0.1% 151614736 / 161665686 / -6.2% 0.54 / 0.51 / +6.5%
fineweb_q05/datafusion:parquet 80163794 / 81339953 / -1.4% 153564531 / 155427779 / -1.2% 0.52 / 0.52 / -0.3%
fineweb_q06/datafusion:parquet 74465762 / 76823475 / -3.1% 156094207 / 164720545 / -5.2% 0.48 / 0.47 / +2.3%
fineweb_q07/datafusion:parquet 73872680 / 73784924 / +0.1% 156564000 / 154776922 / +1.2% 0.47 / 0.48 / -1.0%
fineweb_q08/datafusion:parquet 75556678 / 73667172 / +2.6% 152242133 / 153339658 / -0.7% 0.50 / 0.48 / +3.3%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2046466 / 2129396 / -3.9% 7268518 / 8430467 / -13.8% 🟢 0.28 / 0.25 / +11.5%
fineweb_q01/duckdb:vortex-file-compressed 7768577 / 7609840 / +2.1% 26749518 / 27699884 / -3.4% 0.29 / 0.27 / +5.7%
fineweb_q02/duckdb:vortex-file-compressed 9106932 / 8999654 / +1.2% 28213393 / 32238453 / -12.5% 🟢 0.32 / 0.28 / +15.6%
fineweb_q03/duckdb:vortex-file-compressed 18419175 / 17999961 / +2.3% 90991391 / 89729159 / +1.4% 0.20 / 0.20 / +0.9%
fineweb_q04/duckdb:vortex-file-compressed 65715600 / 64895256 / +1.3% 105515078 / 105319449 / +0.2% 0.62 / 0.62 / +1.1%
fineweb_q05/duckdb:vortex-file-compressed 65223966 / 64576607 / +1.0% 103007245 / 100642505 / +2.3% 0.63 / 0.64 / -1.3%
fineweb_q06/duckdb:vortex-file-compressed 17342892 / 17451004 / -0.6% 91875881 / 90997772 / +1.0% 0.19 / 0.19 / -1.6%
fineweb_q07/duckdb:vortex-file-compressed 18333248 / 17567882 / +4.4% 91940222 / 90262327 / +1.9% 0.20 / 0.19 / +2.5%
fineweb_q08/duckdb:vortex-file-compressed 4526972 / 4479276 / +1.1% 12652964 / 12680631 / -0.2% 0.36 / 0.35 / +1.3%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23680309 / 23575786 / +0.4% 27837243 / 27901054 / -0.2% 0.85 / 0.84 / +0.7%
fineweb_q01/duckdb:parquet 53210753 / 53435612 / -0.4% 71351200 / 71035947 / +0.4% 0.75 / 0.75 / -0.9%
fineweb_q02/duckdb:parquet 57415706 / 58133262 / -1.2% 76681595 / 71614459 / +7.1% 0.75 / 0.81 / -7.8%
fineweb_q03/duckdb:parquet 119264708 / 119431288 / -0.1% 176618640 / 174813976 / +1.0% 0.68 / 0.68 / -1.2%
fineweb_q04/duckdb:parquet 159560184 / 160054805 / -0.3% 206912236 / 201506963 / +2.7% 0.77 / 0.79 / -2.9%
fineweb_q05/duckdb:parquet 159315706 / 159362006 / -0.0% 207261276 / 199292933 / +4.0% 0.77 / 0.80 / -3.9%
fineweb_q06/duckdb:parquet 87219382 / 88786282 / -1.8% 143449078 / 152544283 / -6.0% 0.61 / 0.58 / +4.5%
fineweb_q07/duckdb:parquet 88140515 / 90890989 / -3.0% 145047211 / 143350764 / +1.2% 0.61 / 0.63 / -4.2%
fineweb_q08/duckdb:parquet 28984754 / 28981936 / +0.0% 30654183 / 30002232 / +2.2% 0.95 / 0.97 / -2.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 7fb2efcf vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.995x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1284942 / 1277762 / +0.6% 22716848 / 22701905 / +0.1% 0.06 / 0.06 / +0.5%
clickbench_q01/datafusion:vortex-file-compressed 5852136 / 5701054 / +2.7% 33237364 / 34133473 / -2.6% 0.18 / 0.17 / +5.4%
clickbench_q02/datafusion:vortex-file-compressed 10666479 / 11059978 / -3.6% 44618442 / 45727346 / -2.4% 0.24 / 0.24 / -1.2%
clickbench_q03/datafusion:vortex-file-compressed 12255404 / 12962152 / -5.5% 56957886 / 59966511 / -5.0% 0.22 / 0.22 / -0.5%
clickbench_q04/datafusion:vortex-file-compressed 57884542 / 58491492 / -1.0% 107383700 / 107265399 / +0.1% 0.54 / 0.55 / -1.1%
clickbench_q05/datafusion:vortex-file-compressed 75850806 / 75324188 / +0.7% 128649074 / 127176489 / +1.2% 0.59 / 0.59 / -0.5%
clickbench_q06/datafusion:vortex-file-compressed 1266120 / 1281209 / -1.2% 22008821 / 22762946 / -3.3% 0.06 / 0.06 / +2.2%
clickbench_q07/datafusion:vortex-file-compressed 8949615 / 9121962 / -1.9% 34155535 / 36679638 / -6.9% 0.26 / 0.25 / +5.4%
clickbench_q08/datafusion:vortex-file-compressed 78821202 / 79202689 / -0.5% 121593131 / 130034036 / -6.5% 0.65 / 0.61 / +6.4%
clickbench_q09/datafusion:vortex-file-compressed 173554162 / 169891930 / +2.2% 216395344 / 215849640 / +0.3% 0.80 / 0.79 / +1.9%
clickbench_q10/datafusion:vortex-file-compressed 22600412 / 23576041 / -4.1% 70864328 / 71620517 / -1.1% 0.32 / 0.33 / -3.1%
clickbench_q11/datafusion:vortex-file-compressed 24361376 / 25595211 / -4.8% 71979404 / 73456297 / -2.0% 0.34 / 0.35 / -2.9%
clickbench_q12/datafusion:vortex-file-compressed 71987599 / 72340317 / -0.5% 123713011 / 126525748 / -2.2% 0.58 / 0.57 / +1.8%
clickbench_q13/datafusion:vortex-file-compressed 115084651 / 114454353 / +0.6% 181092925 / 187159194 / -3.2% 0.64 / 0.61 / +3.9%
clickbench_q14/datafusion:vortex-file-compressed 74310067 / 75015054 / -0.9% 126490871 / 128127094 / -1.3% 0.59 / 0.59 / +0.3%
clickbench_q15/datafusion:vortex-file-compressed 62885680 / 63035252 / -0.2% 97907179 / 102527113 / -4.5% 0.64 / 0.61 / +4.5%
clickbench_q16/datafusion:vortex-file-compressed 152385814 / 154339830 / -1.3% 214805358 / 220216995 / -2.5% 0.71 / 0.70 / +1.2%
clickbench_q17/datafusion:vortex-file-compressed 152706292 / 153975190 / -0.8% 222861711 / 221571282 / +0.6% 0.69 / 0.69 / -1.4%
clickbench_q18/datafusion:vortex-file-compressed 289065888 / 297646745 / -2.9% 382628374 / 388335753 / -1.5% 0.76 / 0.77 / -1.4%
clickbench_q19/datafusion:vortex-file-compressed 7431318 / 7750414 / -4.1% 51518648 / 48721099 / +5.7% 0.14 / 0.16 / -9.3%
clickbench_q20/datafusion:vortex-file-compressed 69110944 / 68136855 / +1.4% 247923298 / 256425057 / -3.3% 0.28 / 0.27 / +4.9%
clickbench_q21/datafusion:vortex-file-compressed 77947540 / 80037805 / -2.6% 290726273 / 300737630 / -3.3% 0.27 / 0.27 / +0.7%
clickbench_q22/datafusion:vortex-file-compressed 91191157 / 95054287 / -4.1% 397657336 / 395336147 / +0.6% 0.23 / 0.24 / -4.6%
clickbench_q23/datafusion:vortex-file-compressed 86514399 / 80171206 / +7.9% 424870903 / 416246090 / +2.1% 0.20 / 0.19 / +5.7%
clickbench_q24/datafusion:vortex-file-compressed 8670069 / 8409700 / +3.1% 57748197 / 57093319 / +1.1% 0.15 / 0.15 / +1.9%
clickbench_q25/datafusion:vortex-file-compressed 17862780 / 18152158 / -1.6% 61697250 / 63410099 / -2.7% 0.29 / 0.29 / +1.1%
clickbench_q26/datafusion:vortex-file-compressed 14640066 / 15624998 / -6.3% 69853785 / 69615012 / +0.3% 0.21 / 0.22 / -6.6%
clickbench_q27/datafusion:vortex-file-compressed 98633646 / 100553100 / -1.9% 257677845 / 266070098 / -3.2% 0.38 / 0.38 / +1.3%
clickbench_q28/datafusion:vortex-file-compressed 562477166 / 561882003 / +0.1% 651185824 / 634483917 / +2.6% 0.86 / 0.89 / -2.5%
clickbench_q29/datafusion:vortex-file-compressed 24244630 / 24813306 / -2.3% 55814639 / 53938850 / +3.5% 0.43 / 0.46 / -5.6%
clickbench_q30/datafusion:vortex-file-compressed 57127693 / 54469824 / +4.9% 119903612 / 110322321 / +8.7% 0.48 / 0.49 / -3.5%
clickbench_q31/datafusion:vortex-file-compressed 65144072 / 63713036 / +2.2% 158543451 / 165094546 / -4.0% 0.41 / 0.39 / +6.5%
clickbench_q32/datafusion:vortex-file-compressed 287260230 / 287471359 / -0.1% 387081471 / 395194655 / -2.1% 0.74 / 0.73 / +2.0%
clickbench_q33/datafusion:vortex-file-compressed 317707692 / 318812426 / -0.3% 426255575 / 434359824 / -1.9% 0.75 / 0.73 / +1.5%
clickbench_q34/datafusion:vortex-file-compressed 318780742 / 319825400 / -0.3% 436192688 / 438643717 / -0.6% 0.73 / 0.73 / +0.2%
clickbench_q35/datafusion:vortex-file-compressed 57618568 / 56594294 / +1.8% 90293280 / 89838837 / +0.5% 0.64 / 0.63 / +1.3%
clickbench_q36/datafusion:vortex-file-compressed 37731203 / 37371240 / +1.0% 68658469 / 69504069 / -1.2% 0.55 / 0.54 / +2.2%
clickbench_q37/datafusion:vortex-file-compressed 21438774 / 20731798 / +3.4% 48269808 / 48713358 / -0.9% 0.44 / 0.43 / +4.4%
clickbench_q38/datafusion:vortex-file-compressed 12684608 / 12866674 / -1.4% 40837944 / 41261053 / -1.0% 0.31 / 0.31 / -0.4%
clickbench_q39/datafusion:vortex-file-compressed 78624388 / 78717482 / -0.1% 113075536 / 110822448 / +2.0% 0.70 / 0.71 / -2.1%
clickbench_q40/datafusion:vortex-file-compressed 10214436 / 10368860 / -1.5% 36781427 / 36576948 / +0.6% 0.28 / 0.28 / -2.0%
clickbench_q41/datafusion:vortex-file-compressed 9633174 / 9655634 / -0.2% 35858830 / 35212183 / +1.8% 0.27 / 0.27 / -2.0%
clickbench_q42/datafusion:vortex-file-compressed 9801004 / 9562990 / +2.5% 36649265 / 37134881 / -1.3% 0.27 / 0.26 / +3.8%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1280680 / 1245508 / +2.8% 49354323 / 49111389 / +0.5% 0.03 / 0.03 / +2.3%
clickbench_q01/datafusion:parquet 15894656 / 16128558 / -1.5% 66225605 / 65974016 / +0.4% 0.24 / 0.24 / -1.8%
clickbench_q02/datafusion:parquet 19336872 / 18679866 / +3.5% 79401347 / 81045048 / -2.0% 0.24 / 0.23 / +5.7%
clickbench_q03/datafusion:parquet 17326480 / 17636144 / -1.8% 79320738 / 78906984 / +0.5% 0.22 / 0.22 / -2.3%
clickbench_q04/datafusion:parquet 64361526 / 63147200 / +1.9% 126335097 / 123651426 / +2.2% 0.51 / 0.51 / -0.2%
clickbench_q05/datafusion:parquet 88517298 / 89173734 / -0.7% 156730660 / 155684349 / +0.7% 0.56 / 0.57 / -1.4%
clickbench_q06/datafusion:parquet 1297118 / 1267736 / +2.3% 50257802 / 49808656 / +0.9% 0.03 / 0.03 / +1.4%
clickbench_q07/datafusion:parquet 16560507 / 16815682 / -1.5% 67739626 / 68530680 / -1.2% 0.24 / 0.25 / -0.4%
clickbench_q08/datafusion:parquet 86596149 / 84420552 / +2.6% 160264479 / 159615748 / +0.4% 0.54 / 0.53 / +2.2%
clickbench_q09/datafusion:parquet 188377083 / 189340200 / -0.5% 261629169 / 270568486 / -3.3% 0.72 / 0.70 / +2.9%
clickbench_q10/datafusion:parquet 35747332 / 35838825 / -0.3% 100638287 / 101351871 / -0.7% 0.36 / 0.35 / +0.5%
clickbench_q11/datafusion:parquet 42921120 / 43388606 / -1.1% 112073231 / 110234963 / +1.7% 0.38 / 0.39 / -2.7%
clickbench_q12/datafusion:parquet 95713900 / 96400254 / -0.7% 162265062 / 164380304 / -1.3% 0.59 / 0.59 / +0.6%
clickbench_q13/datafusion:parquet 147565179 / 149050407 / -1.0% 225955951 / 229020286 / -1.3% 0.65 / 0.65 / +0.3%
clickbench_q14/datafusion:parquet 101932042 / 101751008 / +0.2% 175548753 / 173752765 / +1.0% 0.58 / 0.59 / -0.8%
clickbench_q15/datafusion:parquet 70270502 / 74751018 / -6.0% 131761005 / 132562825 / -0.6% 0.53 / 0.56 / -5.4%
clickbench_q16/datafusion:parquet 155903366 / 157130106 / -0.8% 235478249 / 235404102 / +0.0% 0.66 / 0.67 / -0.8%
clickbench_q17/datafusion:parquet 154148704 / 158408130 / -2.7% 235971915 / 232535206 / +1.5% 0.65 / 0.68 / -4.1%
clickbench_q18/datafusion:parquet 306062111 / 311659828 / -1.8% 426860368 / 428769037 / -0.4% 0.72 / 0.73 / -1.4%
clickbench_q19/datafusion:parquet 19338039 / 18808941 / +2.8% 76704922 / 76943382 / -0.3% 0.25 / 0.24 / +3.1%
clickbench_q20/datafusion:parquet 180346584 / 178190524 / +1.2% 284862114 / 283067790 / +0.6% 0.63 / 0.63 / +0.6%
clickbench_q21/datafusion:parquet 172230433 / 174542982 / -1.3% 300965634 / 303338278 / -0.8% 0.57 / 0.58 / -0.5%
clickbench_q22/datafusion:parquet 261785689 / 260781561 / +0.4% 428575469 / 433914101 / -1.2% 0.61 / 0.60 / +1.6%
clickbench_q23/datafusion:parquet 1009716809 / 1007396844 / +0.2% 1190561595 / 1196675958 / -0.5% 0.85 / 0.84 / +0.7%
clickbench_q24/datafusion:parquet 29545714 / 30726530 / -3.8% 89005822 / 88445505 / +0.6% 0.33 / 0.35 / -4.4%
clickbench_q25/datafusion:parquet 36728426 / 37097776 / -1.0% 103531202 / 103458997 / +0.1% 0.35 / 0.36 / -1.1%
clickbench_q26/datafusion:parquet 30034156 / 30667637 / -2.1% 89675673 / 89958756 / -0.3% 0.33 / 0.34 / -1.8%
clickbench_q27/datafusion:parquet 192183324 / 193541858 / -0.7% 285235261 / 294014301 / -3.0% 0.67 / 0.66 / +2.4%
clickbench_q28/datafusion:parquet 618885956 / 622381386 / -0.6% 704565572 / 709605194 / -0.7% 0.88 / 0.88 / +0.1%
clickbench_q29/datafusion:parquet 28666200 / 28382270 / +1.0% 90700584 / 89726118 / +1.1% 0.32 / 0.32 / -0.1%
clickbench_q30/datafusion:parquet 88407344 / 90292652 / -2.1% 174992623 / 173921114 / +0.6% 0.51 / 0.52 / -2.7%
clickbench_q31/datafusion:parquet 102577388 / 103509501 / -0.9% 200013912 / 200971596 / -0.5% 0.51 / 0.52 / -0.4%
clickbench_q32/datafusion:parquet 304953046 / 311115870 / -2.0% 421953985 / 428727602 / -1.6% 0.72 / 0.73 / -0.4%
clickbench_q33/datafusion:parquet 376008840 / 380048496 / -1.1% 472409600 / 479600127 / -1.5% 0.80 / 0.79 / +0.4%
clickbench_q34/datafusion:parquet 376455754 / 378557524 / -0.6% 480570221 / 477936899 / +0.6% 0.78 / 0.79 / -1.1%
clickbench_q35/datafusion:parquet 63269971 / 64249088 / -1.5% 128596754 / 123443405 / +4.2% 0.49 / 0.52 / -5.5%
clickbench_q36/datafusion:parquet 73675034 / 73977852 / -0.4% 138178783 / 136178878 / +1.5% 0.53 / 0.54 / -1.9%
clickbench_q37/datafusion:parquet 35570101 / 35633496 / -0.2% 92591111 / 91419997 / +1.3% 0.38 / 0.39 / -1.4%
clickbench_q38/datafusion:parquet 47971700 / 47903072 / +0.1% 108631049 / 108411604 / +0.2% 0.44 / 0.44 / -0.1%
clickbench_q39/datafusion:parquet 143843426 / 144526362 / -0.5% 212128996 / 212015185 / +0.1% 0.68 / 0.68 / -0.5%
clickbench_q40/datafusion:parquet 20030520 / 20349552 / -1.6% 77515841 / 77770096 / -0.3% 0.26 / 0.26 / -1.2%
clickbench_q41/datafusion:parquet 18696744 / 18824178 / -0.7% 75602116 / 74972994 / +0.8% 0.25 / 0.25 / -1.5%
clickbench_q42/datafusion:parquet 19322603 / 19068224 / +1.3% 74703492 / 75207188 / -0.7% 0.26 / 0.25 / +2.0%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2306956 / 2239520 / +3.0% 26054641 / 25410828 / +2.5% 0.09 / 0.09 / +0.5%
clickbench_q01/duckdb:vortex-file-compressed 7286952 / 7612362 / -4.3% 27431875 / 27570446 / -0.5% 0.27 / 0.28 / -3.8%
clickbench_q02/duckdb:vortex-file-compressed 9314477 / 8955066 / +4.0% 36798276 / 35286118 / +4.3% 0.25 / 0.25 / -0.3%
clickbench_q03/duckdb:vortex-file-compressed 14107018 / 14248936 / -1.0% 51427479 / 52216942 / -1.5% 0.27 / 0.27 / +0.5%
clickbench_q04/duckdb:vortex-file-compressed 56854101 / 58104275 / -2.2% 88037471 / 92470080 / -4.8% 0.65 / 0.63 / +2.8%
clickbench_q05/duckdb:vortex-file-compressed 64002862 / 64657906 / -1.0% 95972317 / 95177701 / +0.8% 0.67 / 0.68 / -1.8%
clickbench_q06/duckdb:vortex-file-compressed 2751012 / 2703474 / +1.8% 29282456 / 31007170 / -5.6% 0.09 / 0.09 / +7.8%
clickbench_q07/duckdb:vortex-file-compressed 9658339 / 9579114 / +0.8% 31665214 / 31815161 / -0.5% 0.31 / 0.30 / +1.3%
clickbench_q08/duckdb:vortex-file-compressed 70641730 / 69709164 / +1.3% 106137529 / 106513332 / -0.4% 0.67 / 0.65 / +1.7%
clickbench_q09/duckdb:vortex-file-compressed 93941110 / 91790526 / +2.3% 130387438 / 128038059 / +1.8% 0.72 / 0.72 / +0.5%
clickbench_q10/duckdb:vortex-file-compressed 27877602 / 27449552 / +1.6% 72590734 / 70633742 / +2.8% 0.38 / 0.39 / -1.2%
clickbench_q11/duckdb:vortex-file-compressed 30134966 / 29742802 / +1.3% 72353784 / 74580099 / -3.0% 0.42 / 0.40 / +4.4%
clickbench_q12/duckdb:vortex-file-compressed 69157778 / 68314645 / +1.2% 100887186 / 101588585 / -0.7% 0.69 / 0.67 / +1.9%
clickbench_q13/duckdb:vortex-file-compressed 119903015 / 117681350 / +1.9% 166508532 / 167304335 / -0.5% 0.72 / 0.70 / +2.4%
clickbench_q14/duckdb:vortex-file-compressed 72503574 / 71707574 / +1.1% 102825820 / 104097981 / -1.2% 0.71 / 0.69 / +2.4%
clickbench_q15/duckdb:vortex-file-compressed 75717660 / 76256368 / -0.7% 111048997 / 109430960 / +1.5% 0.68 / 0.70 / -2.2%
clickbench_q16/duckdb:vortex-file-compressed 133799670 / 136865666 / -2.2% 174212789 / 173157180 / +0.6% 0.77 / 0.79 / -2.8%
clickbench_q17/duckdb:vortex-file-compressed 138870555 / 136309250 / +1.9% 174883255 / 167679771 / +4.3% 0.79 / 0.81 / -2.3%
clickbench_q18/duckdb:vortex-file-compressed 256188662 / 253680418 / +1.0% 306840190 / 304490936 / +0.8% 0.83 / 0.83 / +0.2%
clickbench_q19/duckdb:vortex-file-compressed 9322266 / 9195282 / +1.4% 38979154 / 41073291 / -5.1% 0.24 / 0.22 / +6.8%
clickbench_q20/duckdb:vortex-file-compressed 68033299 / 68396690 / -0.5% 175894136 / 175446093 / +0.3% 0.39 / 0.39 / -0.8%
clickbench_q21/duckdb:vortex-file-compressed 78752486 / 78139710 / +0.8% 210454830 / 193510866 / +8.8% 0.37 / 0.40 / -7.3%
clickbench_q22/duckdb:vortex-file-compressed 132356136 / 130674448 / +1.3% 336490994 / 331574805 / +1.5% 0.39 / 0.39 / -0.2%
clickbench_q23/duckdb:vortex-file-compressed 63748646 / 59653655 / +6.9% 188228617 / 184899542 / +1.8% 0.34 / 0.32 / +5.0%
clickbench_q24/duckdb:vortex-file-compressed 16793792 / 17394194 / -3.5% 47253319 / 48703041 / -3.0% 0.36 / 0.36 / -0.5%
clickbench_q25/duckdb:vortex-file-compressed 18171731 / 18446944 / -1.5% 53043058 / 54178597 / -2.1% 0.34 / 0.34 / +0.6%
clickbench_q26/duckdb:vortex-file-compressed 13584152 / 14287748 / -4.9% 41539541 / 49047912 / -15.3% 🟢 0.33 / 0.29 / +12.3%
clickbench_q27/duckdb:vortex-file-compressed 53988378 / 53905176 / +0.2% 194912532 / 177354906 / +9.9% 0.28 / 0.30 / -8.9%
clickbench_q28/duckdb:vortex-file-compressed 513915574 / 514093187 / -0.0% 563516189 / 559504615 / +0.7% 0.91 / 0.92 / -0.7%
clickbench_q29/duckdb:vortex-file-compressed 17334751 / 17208508 / +0.7% 44531415 / 42958313 / +3.7% 0.39 / 0.40 / -2.8%
clickbench_q30/duckdb:vortex-file-compressed 60349826 / 59435691 / +1.5% 111833119 / 108956696 / +2.6% 0.54 / 0.55 / -1.1%
clickbench_q31/duckdb:vortex-file-compressed 110437022 / 109401092 / +0.9% 181991749 / 174239306 / +4.4% 0.61 / 0.63 / -3.4%
clickbench_q32/duckdb:vortex-file-compressed 361821537 / 385910546 / -6.2% 394283770 / 410231765 / -3.9% 0.92 / 0.94 / -2.4%
clickbench_q33/duckdb:vortex-file-compressed 343394711 / 342599656 / +0.2% 404310911 / 396100171 / +2.1% 0.85 / 0.86 / -1.8%
clickbench_q34/duckdb:vortex-file-compressed 348232166 / 353396204 / -1.5% 405228662 / 412222797 / -1.7% 0.86 / 0.86 / +0.2%
clickbench_q35/duckdb:vortex-file-compressed 57826042 / 57161666 / +1.2% 88247101 / 88929172 / -0.8% 0.66 / 0.64 / +1.9%
clickbench_q36/duckdb:vortex-file-compressed 11109380 / 11640787 / -4.6% 34002315 / 33117280 / +2.7% 0.33 / 0.35 / -7.0%
clickbench_q37/duckdb:vortex-file-compressed 7294926 / 7579217 / -3.8% 28521226 / 29023829 / -1.7% 0.26 / 0.26 / -2.1%
clickbench_q38/duckdb:vortex-file-compressed 7960280 / 8249762 / -3.5% 29856380 / 27872473 / +7.1% 0.27 / 0.30 / -9.9%
clickbench_q39/duckdb:vortex-file-compressed 18412688 / 18512246 / -0.5% 41746322 / 39648155 / +5.3% 0.44 / 0.47 / -5.5%
clickbench_q40/duckdb:vortex-file-compressed 6731134 / 6788686 / -0.8% 29938156 / 29122522 / +2.8% 0.22 / 0.23 / -3.5%
clickbench_q41/duckdb:vortex-file-compressed 7428288 / 7935220 / -6.4% 28498562 / 31671742 / -10.0% 🟢 0.26 / 0.25 / +4.0%
clickbench_q42/duckdb:vortex-file-compressed 6841623 / 7022668 / -2.6% 29350550 / 27458837 / +6.9% 0.23 / 0.26 / -8.9%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9366260 / 9394832 / -0.3% 14461925 / 14721122 / -1.8% 0.65 / 0.64 / +1.5%
clickbench_q01/duckdb:parquet 15328564 / 15255306 / +0.5% 21630307 / 20612271 / +4.9% 0.71 / 0.74 / -4.2%
clickbench_q02/duckdb:parquet 22320004 / 23202924 / -3.8% 30761749 / 34409503 / -10.6% 🟢 0.73 / 0.67 / +7.6%
clickbench_q03/duckdb:parquet 22660184 / 22805660 / -0.6% 35173227 / 37416814 / -6.0% 0.64 / 0.61 / +5.7%
clickbench_q04/duckdb:parquet 61444344 / 62729622 / -2.0% 74575385 / 74237821 / +0.5% 0.82 / 0.84 / -2.5%
clickbench_q05/duckdb:parquet 83266808 / 82553121 / +0.9% 102010045 / 95555827 / +6.8% 0.82 / 0.86 / -5.5%
clickbench_q06/duckdb:parquet 20834828 / 20223452 / +3.0% 27720179 / 27478087 / +0.9% 0.75 / 0.74 / +2.1%
clickbench_q07/duckdb:parquet 17241648 / 17993160 / -4.2% 21746788 / 22337709 / -2.6% 0.79 / 0.81 / -1.6%
clickbench_q08/duckdb:parquet 75231156 / 75074766 / +0.2% 86056706 / 93024452 / -7.5% 0.87 / 0.81 / +8.3%
clickbench_q09/duckdb:parquet 102223360 / 103794619 / -1.5% 125075597 / 121917219 / +2.6% 0.82 / 0.85 / -4.0%
clickbench_q10/duckdb:parquet 42027436 / 41383818 / +1.6% 53536089 / 53619651 / -0.2% 0.79 / 0.77 / +1.7%
clickbench_q11/duckdb:parquet 46808280 / 46643339 / +0.4% 61172481 / 61615297 / -0.7% 0.77 / 0.76 / +1.1%
clickbench_q12/duckdb:parquet 92258632 / 93595602 / -1.4% 106929979 / 108115697 / -1.1% 0.86 / 0.87 / -0.3%
clickbench_q13/duckdb:parquet 149789772 / 148244281 / +1.0% 163964199 / 168231324 / -2.5% 0.91 / 0.88 / +3.7%
clickbench_q14/duckdb:parquet 100609558 / 101682435 / -1.1% 118615255 / 114164311 / +3.9% 0.85 / 0.89 / -4.8%
clickbench_q15/duckdb:parquet 86812758 / 85946628 / +1.0% 98160061 / 100644448 / -2.5% 0.88 / 0.85 / +3.6%
clickbench_q16/duckdb:parquet 170150462 / 165498386 / +2.8% 176637841 / 179975882 / -1.9% 0.96 / 0.92 / +4.8%
clickbench_q17/duckdb:parquet 166887333 / 171531960 / -2.7% 180511325 / 178665714 / +1.0% 0.92 / 0.96 / -3.7%
clickbench_q18/duckdb:parquet 289488855 / 291016272 / -0.5% 322769227 / 315607081 / +2.3% 0.90 / 0.92 / -2.7%
clickbench_q19/duckdb:parquet 20172650 / 19859715 / +1.6% 27077063 / 25786255 / +5.0% 0.75 / 0.77 / -3.3%
clickbench_q20/duckdb:parquet 182343840 / 180420120 / +1.1% 225540808 / 232480084 / -3.0% 0.81 / 0.78 / +4.2%
clickbench_q21/duckdb:parquet 220751776 / 218477350 / +1.0% 261162093 / 262983512 / -0.7% 0.85 / 0.83 / +1.7%
clickbench_q22/duckdb:parquet 313029666 / 304926990 / +2.7% 367759276 / 357379579 / +2.9% 0.85 / 0.85 / -0.2%
clickbench_q23/duckdb:parquet 169501694 / 171775762 / -1.3% 237621677 / 253121056 / -6.1% 0.71 / 0.68 / +5.1%
clickbench_q24/duckdb:parquet 29441540 / 29958716 / -1.7% 43718474 / 42482462 / +2.9% 0.67 / 0.71 / -4.5%
clickbench_q25/duckdb:parquet 41713056 / 42463750 / -1.8% 57367251 / 60982131 / -5.9% 0.73 / 0.70 / +4.4%
clickbench_q26/duckdb:parquet 32051852 / 32739711 / -2.1% 45966764 / 47017556 / -2.2% 0.70 / 0.70 / +0.1%
clickbench_q27/duckdb:parquet 194237984 / 191541398 / +1.4% 228693451 / 230295986 / -0.7% 0.85 / 0.83 / +2.1%
clickbench_q28/duckdb:parquet 968949648 / 950006560 / +2.0% 978940144 / 983079731 / -0.4% 0.99 / 0.97 / +2.4%
clickbench_q29/duckdb:parquet 24083952 / 24317362 / -1.0% 30683966 / 30925214 / -0.8% 0.78 / 0.79 / -0.2%
clickbench_q30/duckdb:parquet 107158718 / 104622488 / +2.4% 129333692 / 129419189 / -0.1% 0.83 / 0.81 / +2.5%
clickbench_q31/duckdb:parquet 158003894 / 160480217 / -1.5% 172851718 / 174417616 / -0.9% 0.91 / 0.92 / -0.7%
clickbench_q32/duckdb:parquet 390564469 / 385925739 / +1.2% 413060365 / 407659843 / +1.3% 0.95 / 0.95 / -0.1%
clickbench_q33/duckdb:parquet 468395442 / 468922366 / -0.1% 434436670 / 442695781 / -1.9% 1.08 / 1.06 / +1.8%
clickbench_q34/duckdb:parquet 464340264 / 462238432 / +0.5% 475125426 / 447629696 / +6.1% 0.98 / 1.03 / -5.4%
clickbench_q35/duckdb:parquet 61108289 / 61543474 / -0.7% 73668603 / 77479685 / -4.9% 0.83 / 0.79 / +4.4%
clickbench_q36/duckdb:parquet 30128951 / 30172014 / -0.1% 36596585 / 36925558 / -0.9% 0.82 / 0.82 / +0.8%
clickbench_q37/duckdb:parquet 23600328 / 23204022 / +1.7% 29697376 / 30425350 / -2.4% 0.79 / 0.76 / +4.2%
clickbench_q38/duckdb:parquet 24293480 / 23431136 / +3.7% 29602862 / 30912378 / -4.2% 0.82 / 0.76 / +8.3%
clickbench_q39/duckdb:parquet 54127328 / 52956229 / +2.2% 61263140 / 60047399 / +2.0% 0.88 / 0.88 / +0.2%
clickbench_q40/duckdb:parquet 14938449 / 14924840 / +0.1% 20136142 / 20066747 / +0.3% 0.74 / 0.74 / -0.3%
clickbench_q41/duckdb:parquet 15323735 / 15331596 / -0.1% 21541048 / 23069987 / -6.6% 0.71 / 0.66 / +7.0%
clickbench_q42/duckdb:parquet 14876333 / 14130908 / +5.3% 20351433 / 20120985 / +1.1% 0.73 / 0.70 / +4.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 7fb2efcf vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.021x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.011x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21803786 / 21999911 / -0.9% 41092720 / 39946370 / +2.9% 0.53 / 0.55 / -3.7%
tpcds_q02/datafusion:vortex-file-compressed 43294271 / 42893253 / +0.9% 64398779 / 62914880 / +2.4% 0.67 / 0.68 / -1.4%
tpcds_q03/datafusion:vortex-file-compressed 11621934 / 11605178 / +0.1% 29486329 / 26609156 / +10.8% 🔴 0.39 / 0.44 / -9.6%
tpcds_q04/datafusion:vortex-file-compressed 81990414 / 78951654 / +3.8% 111324292 / 104564818 / +6.5% 0.74 / 0.76 / -2.5%
tpcds_q05/datafusion:vortex-file-compressed 57314319 / 55941465 / +2.5% 78514681 / 74124262 / +5.9% 0.73 / 0.75 / -3.3%
tpcds_q06/datafusion:vortex-file-compressed 22076114 / 21333720 / +3.5% 43800534 / 41069841 / +6.6% 0.50 / 0.52 / -3.0%
tpcds_q07/datafusion:vortex-file-compressed 26635296 / 26386390 / +0.9% 49713305 / 48176326 / +3.2% 0.54 / 0.55 / -2.2%
tpcds_q08/datafusion:vortex-file-compressed 25993138 / 25587712 / +1.6% 46797474 / 43682364 / +7.1% 0.56 / 0.59 / -5.2%
tpcds_q09/datafusion:vortex-file-compressed 20027414 / 19896226 / +0.7% 39076907 / 37474977 / +4.3% 0.51 / 0.53 / -3.5%
tpcds_q10/datafusion:vortex-file-compressed 29654210 / 29546889 / +0.4% 51485382 / 51180613 / +0.6% 0.58 / 0.58 / -0.2%
tpcds_q11/datafusion:vortex-file-compressed 49232456 / 49121194 / +0.2% 75495240 / 75394766 / +0.1% 0.65 / 0.65 / +0.1%
tpcds_q12/datafusion:vortex-file-compressed 15428016 / 14946749 / +3.2% 34395600 / 31749886 / +8.3% 0.45 / 0.47 / -4.7%
tpcds_q13/datafusion:vortex-file-compressed 32515830 / 31860550 / +2.1% 56449588 / 53865238 / +4.8% 0.58 / 0.59 / -2.6%
tpcds_q14/datafusion:vortex-file-compressed 489081360 / 487421370 / +0.3% 547915670 / 542474028 / +1.0% 0.89 / 0.90 / -0.7%
tpcds_q15/datafusion:vortex-file-compressed 12730949 / 12586756 / +1.1% 31403303 / 29869991 / +5.1% 0.41 / 0.42 / -3.8%
tpcds_q16/datafusion:vortex-file-compressed 18525352 / 18761618 / -1.3% 38905575 / 37089591 / +4.9% 0.48 / 0.51 / -5.9%
tpcds_q17/datafusion:vortex-file-compressed 54352562 / 53607682 / +1.4% 71315858 / 70072689 / +1.8% 0.76 / 0.77 / -0.4%
tpcds_q18/datafusion:vortex-file-compressed 63615374 / 62349632 / +2.0% 92867521 / 88633124 / +4.8% 0.69 / 0.70 / -2.6%
tpcds_q19/datafusion:vortex-file-compressed 17564895 / 17064877 / +2.9% 40432993 / 38137570 / +6.0% 0.43 / 0.45 / -2.9%
tpcds_q20/datafusion:vortex-file-compressed 16693507 / 16875604 / -1.1% 33928697 / 33398462 / +1.6% 0.49 / 0.51 / -2.6%
tpcds_q21/datafusion:vortex-file-compressed 14790212 / 14801170 / -0.1% 34870276 / 32973615 / +5.8% 0.42 / 0.45 / -5.5%
tpcds_q22/datafusion:vortex-file-compressed 48917224 / 49325762 / -0.8% 70992034 / 67699156 / +4.9% 0.69 / 0.73 / -5.4%
tpcds_q23/datafusion:vortex-file-compressed 71467580 / 72276124 / -1.1% 98015851 / 97272882 / +0.8% 0.73 / 0.74 / -1.9%
tpcds_q24/datafusion:vortex-file-compressed 64099246 / 63926868 / +0.3% 90623010 / 83129432 / +9.0% 0.71 / 0.77 / -8.0%
tpcds_q25/datafusion:vortex-file-compressed 44978734 / 44475855 / +1.1% 72767789 / 66779639 / +9.0% 0.62 / 0.67 / -7.2%
tpcds_q26/datafusion:vortex-file-compressed 26642168 / 26101808 / +2.1% 45952333 / 45977400 / -0.1% 0.58 / 0.57 / +2.1%
tpcds_q27/datafusion:vortex-file-compressed 51135411 / 53289153 / -4.0% 73279499 / 76338183 / -4.0% 0.70 / 0.70 / -0.0%
tpcds_q28/datafusion:vortex-file-compressed 19012207 / 19381416 / -1.9% 39521819 / 39922526 / -1.0% 0.48 / 0.49 / -0.9%
tpcds_q29/datafusion:vortex-file-compressed 51732955 / 52347589 / -1.2% 75348410 / 73566264 / +2.4% 0.69 / 0.71 / -3.5%
tpcds_q30/datafusion:vortex-file-compressed 27978196 / 27661427 / +1.1% 47505045 / 45075272 / +5.4% 0.59 / 0.61 / -4.0%
tpcds_q31/datafusion:vortex-file-compressed 61709222 / 62516696 / -1.3% 88639097 / 87634339 / +1.1% 0.70 / 0.71 / -2.4%
tpcds_q32/datafusion:vortex-file-compressed 12894041 / 13025350 / -1.0% 31043179 / 30062663 / +3.3% 0.42 / 0.43 / -4.1%
tpcds_q33/datafusion:vortex-file-compressed 28334391 / 27991706 / +1.2% 51433812 / 50078992 / +2.7% 0.55 / 0.56 / -1.4%
tpcds_q34/datafusion:vortex-file-compressed 17664608 / 17855906 / -1.1% 39284885 / 36650085 / +7.2% 0.45 / 0.49 / -7.7%
tpcds_q35/datafusion:vortex-file-compressed 30467324 / 31075584 / -2.0% 54094401 / 54010849 / +0.2% 0.56 / 0.58 / -2.1%
tpcds_q36/datafusion:vortex-file-compressed 47524110 / 46691248 / +1.8% 69962641 / 69134076 / +1.2% 0.68 / 0.68 / +0.6%
tpcds_q37/datafusion:vortex-file-compressed 12756112 / 12935278 / -1.4% 35623991 / 33965509 / +4.9% 0.36 / 0.38 / -6.0%
tpcds_q38/datafusion:vortex-file-compressed 25916498 / 26436550 / -2.0% 48904031 / 46500479 / +5.2% 0.53 / 0.57 / -6.8%
tpcds_q39/datafusion:vortex-file-compressed 65233416 / 64408856 / +1.3% 89275302 / 87056639 / +2.5% 0.73 / 0.74 / -1.2%
tpcds_q40/datafusion:vortex-file-compressed 22829838 / 22195258 / +2.9% 41344234 / 39059042 / +5.9% 0.55 / 0.57 / -2.8%
tpcds_q41/datafusion:vortex-file-compressed 20183928 / 20181415 / +0.0% 32026241 / 32305841 / -0.9% 0.63 / 0.62 / +0.9%
tpcds_q42/datafusion:vortex-file-compressed 11582534 / 11610268 / -0.2% 28474107 / 27549864 / +3.4% 0.41 / 0.42 / -3.5%
tpcds_q43/datafusion:vortex-file-compressed 13317618 / 13251107 / +0.5% 34208729 / 31511768 / +8.6% 0.39 / 0.42 / -7.4%
tpcds_q44/datafusion:vortex-file-compressed 27274434 / 27407222 / -0.5% 51642301 / 49901538 / +3.5% 0.53 / 0.55 / -3.8%
tpcds_q45/datafusion:vortex-file-compressed 17019822 / 17168016 / -0.9% 34997447 / 34200247 / +2.3% 0.49 / 0.50 / -3.1%
tpcds_q46/datafusion:vortex-file-compressed 24148320 / 23558210 / +2.5% 46965584 / 45525195 / +3.2% 0.51 / 0.52 / -0.6%
tpcds_q47/datafusion:vortex-file-compressed 74694849 / 75593490 / -1.2% 105073019 / 103395942 / +1.6% 0.71 / 0.73 / -2.8%
tpcds_q48/datafusion:vortex-file-compressed 28542454 / 28579330 / -0.1% 53949935 / 51250463 / +5.3% 0.53 / 0.56 / -5.1%
tpcds_q49/datafusion:vortex-file-compressed 56675404 / 57212074 / -0.9% 78258141 / 74563681 / +5.0% 0.72 / 0.77 / -5.6%
tpcds_q50/datafusion:vortex-file-compressed 30435040 / 31077502 / -2.1% 55752892 / 51768133 / +7.7% 0.55 / 0.60 / -9.1%
tpcds_q51/datafusion:vortex-file-compressed 67676666 / 67219460 / +0.7% 91194491 / 89984116 / +1.3% 0.74 / 0.75 / -0.7%
tpcds_q52/datafusion:vortex-file-compressed 12181579 / 11829058 / +3.0% 29750640 / 28624926 / +3.9% 0.41 / 0.41 / -0.9%
tpcds_q53/datafusion:vortex-file-compressed 18471590 / 18240894 / +1.3% 39661707 / 37934996 / +4.6% 0.47 / 0.48 / -3.1%
tpcds_q54/datafusion:vortex-file-compressed 32096077 / 32073801 / +0.1% 56386561 / 53625583 / +5.1% 0.57 / 0.60 / -4.8%
tpcds_q55/datafusion:vortex-file-compressed 11483893 / 11528832 / -0.4% 27172403 / 27437884 / -1.0% 0.42 / 0.42 / +0.6%
tpcds_q56/datafusion:vortex-file-compressed 26875962 / 26666916 / +0.8% 48668219 / 47448670 / +2.6% 0.55 / 0.56 / -1.7%
tpcds_q57/datafusion:vortex-file-compressed 62011623 / 62012122 / -0.0% 90354931 / 87267119 / +3.5% 0.69 / 0.71 / -3.4%
tpcds_q58/datafusion:vortex-file-compressed 40352114 / 40818922 / -1.1% 69246226 / 64518211 / +7.3% 0.58 / 0.63 / -7.9%
tpcds_q59/datafusion:vortex-file-compressed 27881512 / 27906409 / -0.1% 54120581 / 53781464 / +0.6% 0.52 / 0.52 / -0.7%
tpcds_q60/datafusion:vortex-file-compressed 26992036 / 27726237 / -2.6% 49510809 / 47532249 / +4.2% 0.55 / 0.58 / -6.5%
tpcds_q61/datafusion:vortex-file-compressed 20642494 / 20214066 / +2.1% 42874041 / 39682747 / +8.0% 0.48 / 0.51 / -5.5%
tpcds_q62/datafusion:vortex-file-compressed 16839172 / 16850174 / -0.1% 35703605 / 34396629 / +3.8% 0.47 / 0.49 / -3.7%
tpcds_q63/datafusion:vortex-file-compressed 18343053 / 18192128 / +0.8% 41823032 / 37641254 / +11.1% 🔴 0.44 / 0.48 / -9.3%
tpcds_q64/datafusion:vortex-file-compressed 189098850 / 188561892 / +0.3% 223415426 / 229680212 / -2.7% 0.85 / 0.82 / +3.1%
tpcds_q65/datafusion:vortex-file-compressed 73910854 / 73066724 / +1.2% 95908221 / 96562612 / -0.7% 0.77 / 0.76 / +1.8%
tpcds_q66/datafusion:vortex-file-compressed 50484810 / 50096568 / +0.8% 72138803 / 69306342 / +4.1% 0.70 / 0.72 / -3.2%
tpcds_q67/datafusion:vortex-file-compressed 52088836 / 51663640 / +0.8% 85132934 / 83492505 / +2.0% 0.61 / 0.62 / -1.1%
tpcds_q68/datafusion:vortex-file-compressed 23083208 / 22888054 / +0.9% 47383073 / 44101071 / +7.4% 0.49 / 0.52 / -6.1%
tpcds_q69/datafusion:vortex-file-compressed 26617700 / 27546142 / -3.4% 49174693 / 47372016 / +3.8% 0.54 / 0.58 / -6.9%
tpcds_q70/datafusion:vortex-file-compressed 74284683 / 73486667 / +1.1% 95888280 / 97916702 / -2.1% 0.77 / 0.75 / +3.2%
tpcds_q71/datafusion:vortex-file-compressed 19324148 / 19173117 / +0.8% 40996966 / 37641700 / +8.9% 0.47 / 0.51 / -7.5%
tpcds_q72/datafusion:vortex-file-compressed 274663552 / 247376824 / +11.0% 🔴 282402068 / 279389691 / +1.1% 0.97 / 0.89 / +9.8%
tpcds_q73/datafusion:vortex-file-compressed 16543848 / 16283788 / +1.6% 37480138 / 37287301 / +0.5% 0.44 / 0.44 / +1.1%
tpcds_q74/datafusion:vortex-file-compressed 40382821 / 40826743 / -1.1% 69373700 / 66742487 / +3.9% 0.58 / 0.61 / -4.8%
tpcds_q75/datafusion:vortex-file-compressed 136058429 / 133968630 / +1.6% 159736687 / 162666038 / -1.8% 0.85 / 0.82 / +3.4%
tpcds_q76/datafusion:vortex-file-compressed 29417638 / 28638050 / +2.7% 47167896 / 48545831 / -2.8% 0.62 / 0.59 / +5.7%
tpcds_q77/datafusion:vortex-file-compressed 45161250 / 44422120 / +1.7% 68888067 / 65708594 / +4.8% 0.66 / 0.68 / -3.0%
tpcds_q78/datafusion:vortex-file-compressed 60383440 / 60965657 / -1.0% 90713998 / 86015972 / +5.5% 0.67 / 0.71 / -6.1%
tpcds_q79/datafusion:vortex-file-compressed 20134590 / 20279438 / -0.7% 41200006 / 42110377 / -2.2% 0.49 / 0.48 / +1.5%
tpcds_q80/datafusion:vortex-file-compressed 68722600 / 68766030 / -0.1% 93976557 / 93570722 / +0.4% 0.73 / 0.73 / -0.5%
tpcds_q81/datafusion:vortex-file-compressed 28456957 / 28260648 / +0.7% 45972582 / 45300560 / +1.5% 0.62 / 0.62 / -0.8%
tpcds_q82/datafusion:vortex-file-compressed 12047562 / 12807434 / -5.9% 36677017 / 35626130 / +2.9% 0.33 / 0.36 / -8.6%
tpcds_q83/datafusion:vortex-file-compressed 35549319 / 35376074 / +0.5% 53662050 / 52093141 / +3.0% 0.66 / 0.68 / -2.4%
tpcds_q84/datafusion:vortex-file-compressed 10558725 / 10461540 / +0.9% 27296960 / 25885722 / +5.5% 0.39 / 0.40 / -4.3%
tpcds_q85/datafusion:vortex-file-compressed 51749712 / 51809666 / -0.1% 79376044 / 75574697 / +5.0% 0.65 / 0.69 / -4.9%
tpcds_q86/datafusion:vortex-file-compressed 16142246 / 16113415 / +0.2% 35485565 / 34409002 / +3.1% 0.45 / 0.47 / -2.9%
tpcds_q87/datafusion:vortex-file-compressed 26737258 / 26499568 / +0.9% 49409764 / 48598250 / +1.7% 0.54 / 0.55 / -0.8%
tpcds_q88/datafusion:vortex-file-compressed 32652502 / 32357568 / +0.9% 50686893 / 50858837 / -0.3% 0.64 / 0.64 / +1.3%
tpcds_q89/datafusion:vortex-file-compressed 21785225 / 21807304 / -0.1% 43791231 / 42407282 / +3.3% 0.50 / 0.51 / -3.3%
tpcds_q90/datafusion:vortex-file-compressed 10463702 / 10365216 / +1.0% 26831111 / 24066050 / +11.5% 🔴 0.39 / 0.43 / -9.5%
tpcds_q91/datafusion:vortex-file-compressed 16078975 / 16048840 / +0.2% 36904816 / 36604324 / +0.8% 0.44 / 0.44 / -0.6%
tpcds_q92/datafusion:vortex-file-compressed 13322864 / 13198902 / +0.9% 30706660 / 29685220 / +3.4% 0.43 / 0.44 / -2.4%
tpcds_q93/datafusion:vortex-file-compressed 20537558 / 20150414 / +1.9% 41843363 / 40148939 / +4.2% 0.49 / 0.50 / -2.2%
tpcds_q94/datafusion:vortex-file-compressed 18635154 / 18552985 / +0.4% 39591955 / 37927246 / +4.4% 0.47 / 0.49 / -3.8%
tpcds_q95/datafusion:vortex-file-compressed 42390479 / 41763500 / +1.5% 63984921 / 60866535 / +5.1% 0.66 / 0.69 / -3.4%
tpcds_q96/datafusion:vortex-file-compressed 7787250 / 7859994 / -0.9% 25324501 / 23576532 / +7.4% 0.31 / 0.33 / -7.8%
tpcds_q97/datafusion:vortex-file-compressed 17686485 / 17259486 / +2.5% 41421119 / 37350276 / +10.9% 🔴 0.43 / 0.46 / -7.6%
tpcds_q98/datafusion:vortex-file-compressed 16084930 / 16185816 / -0.6% 35295731 / 32671739 / +8.0% 0.46 / 0.50 / -8.0%
tpcds_q99/datafusion:vortex-file-compressed 16446967 / 16384194 / +0.4% 34924500 / 33993322 / +2.7% 0.47 / 0.48 / -2.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43345567 / 43046149 / +0.7% 64683828 / 59333915 / +9.0% 0.67 / 0.73 / -7.6%
tpcds_q02/datafusion:parquet 54875354 / 55017496 / -0.3% 70299966 / 69006470 / +1.9% 0.78 / 0.80 / -2.1%
tpcds_q03/datafusion:parquet 18936866 / 19078092 / -0.7% 31234482 / 32968281 / -5.3% 0.61 / 0.58 / +4.8%
tpcds_q04/datafusion:parquet 179730326 / 179731768 / -0.0% 208127570 / 199226926 / +4.5% 0.86 / 0.90 / -4.3%
tpcds_q05/datafusion:parquet 67098922 / 68363662 / -1.9% 87450073 / 88310082 / -1.0% 0.77 / 0.77 / -0.9%
tpcds_q06/datafusion:parquet 33602926 / 35133400 / -4.4% 48331765 / 44032369 / +9.8% 0.70 / 0.80 / -12.9%
tpcds_q07/datafusion:parquet 47314326 / 47015244 / +0.6% 67921592 / 63060866 / +7.7% 0.70 / 0.75 / -6.6%
tpcds_q08/datafusion:parquet 31111787 / 31108916 / +0.0% 45273728 / 46407336 / -2.4% 0.69 / 0.67 / +2.5%
tpcds_q09/datafusion:parquet 31748235 / 32235404 / -1.5% 36798136 / 38162448 / -3.6% 0.86 / 0.84 / +2.1%
tpcds_q10/datafusion:parquet 44225562 / 45810956 / -3.5% 56510185 / 55821116 / +1.2% 0.78 / 0.82 / -4.6%
tpcds_q11/datafusion:parquet 97490420 / 97324552 / +0.2% 121251840 / 116986930 / +3.6% 0.80 / 0.83 / -3.4%
tpcds_q12/datafusion:parquet 24167472 / 23829389 / +1.4% 35293118 / 34561700 / +2.1% 0.68 / 0.69 / -0.7%
tpcds_q13/datafusion:parquet 47168734 / 47205746 / -0.1% 68165336 / 66519722 / +2.5% 0.69 / 0.71 / -2.5%
tpcds_q14/datafusion:parquet 535145073 / 536062596 / -0.2% 584164624 / 573875357 / +1.8% 0.92 / 0.93 / -1.9%
tpcds_q15/datafusion:parquet 23637998 / 23467316 / +0.7% 38507998 / 36912696 / +4.3% 0.61 / 0.64 / -3.4%
tpcds_q16/datafusion:parquet 37131754 / 36797934 / +0.9% 49915236 / 49093338 / +1.7% 0.74 / 0.75 / -0.8%
tpcds_q17/datafusion:parquet 73578870 / 77417738 / -5.0% 97914136 / 94152957 / +4.0% 0.75 / 0.82 / -8.6%
tpcds_q18/datafusion:parquet 67849928 / 67730459 / +0.2% 92660426 / 89015478 / +4.1% 0.73 / 0.76 / -3.8%
tpcds_q19/datafusion:parquet 29517928 / 29767255 / -0.8% 43059881 / 40859608 / +5.4% 0.69 / 0.73 / -5.9%
tpcds_q20/datafusion:parquet 25608467 / 24985466 / +2.5% 38234390 / 37149008 / +2.9% 0.67 / 0.67 / -0.4%
tpcds_q21/datafusion:parquet 20238644 / 20098942 / +0.7% 32504477 / 31199048 / +4.2% 0.62 / 0.64 / -3.3%
tpcds_q22/datafusion:parquet 76929936 / 78225004 / -1.7% 89125789 / 88011450 / +1.3% 0.86 / 0.89 / -2.9%
tpcds_q23/datafusion:parquet 92824912 / 93465786 / -0.7% 115186096 / 115763272 / -0.5% 0.81 / 0.81 / -0.2%
tpcds_q24/datafusion:parquet 91412648 / 90530880 / +1.0% 114480727 / 112774834 / +1.5% 0.80 / 0.80 / -0.5%
tpcds_q25/datafusion:parquet 82368858 / 78942378 / +4.3% 98757571 / 100286343 / -1.5% 0.83 / 0.79 / +6.0%
tpcds_q26/datafusion:parquet 44547284 / 42985690 / +3.6% 60436522 / 59286646 / +1.9% 0.74 / 0.73 / +1.7%
tpcds_q27/datafusion:parquet 77264429 / 78387144 / -1.4% 94626539 / 99975873 / -5.4% 0.82 / 0.78 / +4.1%
tpcds_q28/datafusion:parquet 28401754 / 28355490 / +0.2% 41882140 / 41055918 / +2.0% 0.68 / 0.69 / -1.8%
tpcds_q29/datafusion:parquet 76507170 / 74275574 / +3.0% 97214907 / 99075419 / -1.9% 0.79 / 0.75 / +5.0%
tpcds_q30/datafusion:parquet 46333744 / 44266542 / +4.7% 58410262 / 55134805 / +5.9% 0.79 / 0.80 / -1.2%
tpcds_q31/datafusion:parquet 79565806 / 80991932 / -1.8% 98534478 / 100088488 / -1.6% 0.81 / 0.81 / -0.2%
tpcds_q32/datafusion:parquet 26206766 / 27160338 / -3.5% 40587965 / 37888363 / +7.1% 0.65 / 0.72 / -9.9%
tpcds_q33/datafusion:parquet 38120609 / 37472210 / +1.7% 53991901 / 52784833 / +2.3% 0.71 / 0.71 / -0.5%
tpcds_q34/datafusion:parquet 24207120 / 24223199 / -0.1% 35367489 / 34925847 / +1.3% 0.68 / 0.69 / -1.3%
tpcds_q35/datafusion:parquet 50028060 / 50061658 / -0.1% 65236178 / 66186392 / -1.4% 0.77 / 0.76 / +1.4%
tpcds_q36/datafusion:parquet 52750772 / 53863620 / -2.1% 73539891 / 72008538 / +2.1% 0.72 / 0.75 / -4.1%
tpcds_q37/datafusion:parquet 21319023 / 21492292 / -0.8% 32835081 / 33965178 / -3.3% 0.65 / 0.63 / +2.6%
tpcds_q38/datafusion:parquet 44205411 / 43738358 / +1.1% 61649852 / 58984516 / +4.5% 0.72 / 0.74 / -3.3%
tpcds_q39/datafusion:parquet 68403558 / 68451454 / -0.1% 86144392 / 84694449 / +1.7% 0.79 / 0.81 / -1.8%
tpcds_q40/datafusion:parquet 30522220 / 29898065 / +2.1% 48130410 / 49416081 / -2.6% 0.63 / 0.61 / +4.8%
tpcds_q41/datafusion:parquet 19755143 / 19725044 / +0.2% 32034740 / 31567276 / +1.5% 0.62 / 0.62 / -1.3%
tpcds_q42/datafusion:parquet 18007331 / 18410036 / -2.2% 29382335 / 29096386 / +1.0% 0.61 / 0.63 / -3.1%
tpcds_q43/datafusion:parquet 19285712 / 19482850 / -1.0% 32483070 / 30496940 / +6.5% 0.59 / 0.64 / -7.1%
tpcds_q44/datafusion:parquet 36353224 / 35289568 / +3.0% 50674835 / 48402674 / +4.7% 0.72 / 0.73 / -1.6%
tpcds_q45/datafusion:parquet 27834884 / 28034722 / -0.7% 39801743 / 38421721 / +3.6% 0.70 / 0.73 / -4.2%
tpcds_q46/datafusion:parquet 29316291 / 29018574 / +1.0% 44865982 / 44678861 / +0.4% 0.65 / 0.65 / +0.6%
tpcds_q47/datafusion:parquet 98455592 / 96614053 / +1.9% 120807052 / 119575121 / +1.0% 0.81 / 0.81 / +0.9%
tpcds_q48/datafusion:parquet 41994806 / 42307228 / -0.7% 59597529 / 57749935 / +3.2% 0.70 / 0.73 / -3.8%
tpcds_q49/datafusion:parquet 71987824 / 72427164 / -0.6% 95146825 / 91585118 / +3.9% 0.76 / 0.79 / -4.3%
tpcds_q50/datafusion:parquet 47554882 / 47500422 / +0.1% 69719430 / 68227695 / +2.2% 0.68 / 0.70 / -2.0%
tpcds_q51/datafusion:parquet 75747260 / 74856850 / +1.2% 94309414 / 94480088 / -0.2% 0.80 / 0.79 / +1.4%
tpcds_q52/datafusion:parquet 18625611 / 18570137 / +0.3% 30641134 / 28281276 / +8.3% 0.61 / 0.66 / -7.4%
tpcds_q53/datafusion:parquet 23124202 / 21996628 / +5.1% 38700573 / 37632392 / +2.8% 0.60 / 0.58 / +2.2%
tpcds_q54/datafusion:parquet 53668287 / 53403201 / +0.5% 67160079 / 65412957 / +2.7% 0.80 / 0.82 / -2.1%
tpcds_q55/datafusion:parquet 18134762 / 18094322 / +0.2% 29258393 / 28452535 / +2.8% 0.62 / 0.64 / -2.5%
tpcds_q56/datafusion:parquet 40037278 / 42064521 / -4.8% 57183292 / 52494093 / +8.9% 0.70 / 0.80 / -12.6%
tpcds_q57/datafusion:parquet 101072002 / 98531152 / +2.6% 115802118 / 115051750 / +0.7% 0.87 / 0.86 / +1.9%
tpcds_q58/datafusion:parquet 65470054 / 66028114 / -0.8% 81711088 / 80484923 / +1.5% 0.80 / 0.82 / -2.3%
tpcds_q59/datafusion:parquet 46541526 / 48124550 / -3.3% 65235156 / 63375622 / +2.9% 0.71 / 0.76 / -6.0%
tpcds_q60/datafusion:parquet 40134965 / 41774428 / -3.9% 51602240 / 52913053 / -2.5% 0.78 / 0.79 / -1.5%
tpcds_q61/datafusion:parquet 37290349 / 36568854 / +2.0% 51607216 / 53842276 / -4.2% 0.72 / 0.68 / +6.4%
tpcds_q62/datafusion:parquet 25396222 / 25168784 / +0.9% 37030103 / 38657488 / -4.2% 0.69 / 0.65 / +5.3%
tpcds_q63/datafusion:parquet 22168218 / 22467320 / -1.3% 37835266 / 36224907 / +4.4% 0.59 / 0.62 / -5.5%
tpcds_q64/datafusion:parquet 288494766 / 285654170 / +1.0% 323878095 / 321241476 / +0.8% 0.89 / 0.89 / +0.2%
tpcds_q65/datafusion:parquet 120623645 / 119227688 / +1.2% 139878974 / 139579808 / +0.2% 0.86 / 0.85 / +1.0%
tpcds_q66/datafusion:parquet 60030542 / 61287888 / -2.1% 75885778 / 75163315 / +1.0% 0.79 / 0.82 / -3.0%
tpcds_q67/datafusion:parquet 68405812 / 69044428 / -0.9% 93830050 / 91696967 / +2.3% 0.73 / 0.75 / -3.2%
tpcds_q68/datafusion:parquet 28804450 / 29075160 / -0.9% 48536056 / 47405672 / +2.4% 0.59 / 0.61 / -3.2%
tpcds_q69/datafusion:parquet 43303084 / 43304174 / -0.0% 59073342 / 58652073 / +0.7% 0.73 / 0.74 / -0.7%
tpcds_q70/datafusion:parquet 79678164 / 80027439 / -0.4% 97616793 / 97604918 / +0.0% 0.82 / 0.82 / -0.4%
tpcds_q71/datafusion:parquet 25441802 / 25732466 / -1.1% 41708242 / 40528677 / +2.9% 0.61 / 0.63 / -3.9%
tpcds_q72/datafusion:parquet 524738100 / 527634840 / -0.5% 557163608 / 554349016 / +0.5% 0.94 / 0.95 / -1.1%
tpcds_q73/datafusion:parquet 24187483 / 23762050 / +1.8% 35952984 / 35077300 / +2.5% 0.67 / 0.68 / -0.7%
tpcds_q74/datafusion:parquet 69106438 / 69999536 / -1.3% 87157342 / 88289509 / -1.3% 0.79 / 0.79 / +0.0%
tpcds_q75/datafusion:parquet 153272590 / 152662930 / +0.4% 178735842 / 180450074 / -0.9% 0.86 / 0.85 / +1.4%
tpcds_q76/datafusion:parquet 33366363 / 33132911 / +0.7% 46958373 / 44935481 / +4.5% 0.71 / 0.74 / -3.6%
tpcds_q77/datafusion:parquet 56456364 / 56979256 / -0.9% 78263340 / 72969812 / +7.3% 0.72 / 0.78 / -7.6%
tpcds_q78/datafusion:parquet 87859576 / 85272162 / +3.0% 117448336 / 115614404 / +1.6% 0.75 / 0.74 / +1.4%
tpcds_q79/datafusion:parquet 26746616 / 26735792 / +0.0% 42878707 / 39769716 / +7.8% 0.62 / 0.67 / -7.2%
tpcds_q80/datafusion:parquet 79886830 / 78680880 / +1.5% 108624544 / 107863155 / +0.7% 0.74 / 0.73 / +0.8%
tpcds_q81/datafusion:parquet 37859747 / 39558134 / -4.3% 53374266 / 51081109 / +4.5% 0.71 / 0.77 / -8.4%
tpcds_q82/datafusion:parquet 22747703 / 22190428 / +2.5% 35583161 / 34291795 / +3.8% 0.64 / 0.65 / -1.2%
tpcds_q83/datafusion:parquet 58846891 / 58307740 / +0.9% 72481084 / 73002134 / -0.7% 0.81 / 0.80 / +1.7%
tpcds_q84/datafusion:parquet 25640106 / 27313596 / -6.1% 40864589 / 40041516 / +2.1% 0.63 / 0.68 / -8.0%
tpcds_q85/datafusion:parquet 80822934 / 79983598 / +1.0% 104379765 / 102306985 / +2.0% 0.77 / 0.78 / -1.0%
tpcds_q86/datafusion:parquet 20813516 / 21058438 / -1.2% 33110185 / 32574181 / +1.6% 0.63 / 0.65 / -2.8%
tpcds_q87/datafusion:parquet 45318114 / 45280914 / +0.1% 61303235 / 62384128 / -1.7% 0.74 / 0.73 / +1.8%
tpcds_q88/datafusion:parquet 37599646 / 37757294 / -0.4% 51241563 / 51820809 / -1.1% 0.73 / 0.73 / +0.7%
tpcds_q89/datafusion:parquet 25872784 / 26318301 / -1.7% 41506370 / 39991728 / +3.8% 0.62 / 0.66 / -5.3%
tpcds_q90/datafusion:parquet 16202968 / 15087966 / +7.4% 27824614 / 26597960 / +4.6% 0.58 / 0.57 / +2.7%
tpcds_q91/datafusion:parquet 32620453 / 32625398 / -0.0% 45612015 / 45196471 / +0.9% 0.72 / 0.72 / -0.9%
tpcds_q92/datafusion:parquet 26549012 / 26834922 / -1.1% 41524874 / 38063167 / +9.1% 0.64 / 0.71 / -9.3%
tpcds_q93/datafusion:parquet 27279944 / 26735974 / +2.0% 46084499 / 42486273 / +8.5% 0.59 / 0.63 / -5.9%
tpcds_q94/datafusion:parquet 35286054 / 35393988 / -0.3% 48881587 / 47118664 / +3.7% 0.72 / 0.75 / -3.9%
tpcds_q95/datafusion:parquet 63858834 / 64212454 / -0.6% 79597115 / 79492966 / +0.1% 0.80 / 0.81 / -0.7%
tpcds_q96/datafusion:parquet 13053451 / 12723054 / +2.6% 23590510 / 23429883 / +0.7% 0.55 / 0.54 / +1.9%
tpcds_q97/datafusion:parquet 35344496 / 35098156 / +0.7% 51606900 / 49335860 / +4.6% 0.68 / 0.71 / -3.7%
tpcds_q98/datafusion:parquet 24663341 / 25139323 / -1.9% 37766285 / 36349537 / +3.9% 0.65 / 0.69 / -5.6%
tpcds_q99/datafusion:parquet 29736907 / 29673968 / +0.2% 42373745 / 41366470 / +2.4% 0.70 / 0.72 / -2.2%
duckdb / vortex-file-compressed / ns (0.989x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15875622 / 15890239 / -0.1% 24447197 / 24196641 / +1.0% 0.65 / 0.66 / -1.1%
tpcds_q02/duckdb:vortex-file-compressed 16216459 / 18657920 / -13.1% 🟢 22135259 / 22422968 / -1.3% 0.73 / 0.83 / -12.0%
tpcds_q03/duckdb:vortex-file-compressed 6976034 / 7149274 / -2.4% 16909786 / 16220757 / +4.2% 0.41 / 0.44 / -6.4%
tpcds_q04/duckdb:vortex-file-compressed 58830525 / 58862208 / -0.1% 71740251 / 71856038 / -0.2% 0.82 / 0.82 / +0.1%
tpcds_q05/duckdb:vortex-file-compressed 22944052 / 23117854 / -0.8% 31897782 / 32942130 / -3.2% 0.72 / 0.70 / +2.5%
tpcds_q06/duckdb:vortex-file-compressed 24098824 / 24164680 / -0.3% 37571003 / 37874428 / -0.8% 0.64 / 0.64 / +0.5%
tpcds_q07/duckdb:vortex-file-compressed 22089211 / 22109802 / -0.1% 34538205 / 32504438 / +6.3% 0.64 / 0.68 / -6.0%
tpcds_q08/duckdb:vortex-file-compressed 17140212 / 17492722 / -2.0% 25807269 / 25089879 / +2.9% 0.66 / 0.70 / -4.7%
tpcds_q09/duckdb:vortex-file-compressed 19176016 / 19005454 / +0.9% 28563370 / 29541405 / -3.3% 0.67 / 0.64 / +4.4%
tpcds_q10/duckdb:vortex-file-compressed 27402956 / 27533383 / -0.5% 41487123 / 41135181 / +0.9% 0.66 / 0.67 / -1.3%
tpcds_q11/duckdb:vortex-file-compressed 36364601 / 36618646 / -0.7% 44367926 / 44343100 / +0.1% 0.82 / 0.83 / -0.7%
tpcds_q12/duckdb:vortex-file-compressed 9556204 / 9679752 / -1.3% 16101294 / 17229625 / -6.5% 0.59 / 0.56 / +5.6%
tpcds_q13/duckdb:vortex-file-compressed 18961476 / 19843352 / -4.4% 31153019 / 31995768 / -2.6% 0.61 / 0.62 / -1.9%
tpcds_q14/duckdb:vortex-file-compressed 55858668 / 55297112 / +1.0% 64735518 / 64955646 / -0.3% 0.86 / 0.85 / +1.4%
tpcds_q15/duckdb:vortex-file-compressed 11239682 / 11325009 / -0.8% 17479591 / 18325444 / -4.6% 0.64 / 0.62 / +4.0%
tpcds_q16/duckdb:vortex-file-compressed 24381807 / 24731064 / -1.4% 35387042 / 34853379 / +1.5% 0.69 / 0.71 / -2.9%
tpcds_q17/duckdb:vortex-file-compressed 20007771 / 20396798 / -1.9% 33540886 / 32338231 / +3.7% 0.60 / 0.63 / -5.4%
tpcds_q18/duckdb:vortex-file-compressed 31991566 / 32346349 / -1.1% 43392347 / 43278488 / +0.3% 0.74 / 0.75 / -1.4%
tpcds_q19/duckdb:vortex-file-compressed 20572516 / 20786617 / -1.0% 30015082 / 29101806 / +3.1% 0.69 / 0.71 / -4.0%
tpcds_q20/duckdb:vortex-file-compressed 10597976 / 10704608 / -1.0% 17664688 / 17476285 / +1.1% 0.60 / 0.61 / -2.1%
tpcds_q21/duckdb:vortex-file-compressed 9043958 / 9371898 / -3.5% 22341391 / 21703364 / +2.9% 0.40 / 0.43 / -6.3%
tpcds_q22/duckdb:vortex-file-compressed 17529045 / 17643249 / -0.6% 30641408 / 29161310 / +5.1% 0.57 / 0.61 / -5.4%
tpcds_q23/duckdb:vortex-file-compressed 38327728 / 37431455 / +2.4% 48892747 / 48459168 / +0.9% 0.78 / 0.77 / +1.5%
tpcds_q24/duckdb:vortex-file-compressed 26352390 / 26441519 / -0.3% 38014778 / 36595428 / +3.9% 0.69 / 0.72 / -4.1%
tpcds_q25/duckdb:vortex-file-compressed 18997460 / 19221668 / -1.2% 31941702 / 30221864 / +5.7% 0.59 / 0.64 / -6.5%
tpcds_q26/duckdb:vortex-file-compressed 21057198 / 21300105 / -1.1% 32473624 / 31212707 / +4.0% 0.65 / 0.68 / -5.0%
tpcds_q27/duckdb:vortex-file-compressed 24598135 / 24807916 / -0.8% 37216867 / 35637087 / +4.4% 0.66 / 0.70 / -5.1%
tpcds_q28/duckdb:vortex-file-compressed 14702570 / 15090790 / -2.6% 25162341 / 25912108 / -2.9% 0.58 / 0.58 / +0.3%
tpcds_q29/duckdb:vortex-file-compressed 18606570 / 18678136 / -0.4% 30803549 / 29174081 / +5.6% 0.60 / 0.64 / -5.7%
tpcds_q30/duckdb:vortex-file-compressed 17951768 / 18682425 / -3.9% 27477977 / 27172488 / +1.1% 0.65 / 0.69 / -5.0%
tpcds_q31/duckdb:vortex-file-compressed 17709604 / 17961668 / -1.4% 27043608 / 26844104 / +0.7% 0.65 / 0.67 / -2.1%
tpcds_q32/duckdb:vortex-file-compressed 10292566 / 10237077 / +0.5% 18205947 / 18081369 / +0.7% 0.57 / 0.57 / -0.1%
tpcds_q33/duckdb:vortex-file-compressed 17988283 / 17651904 / +1.9% 28097087 / 27599437 / +1.8% 0.64 / 0.64 / +0.1%
tpcds_q34/duckdb:vortex-file-compressed 12873408 / 12881700 / -0.1% 22388588 / 21645185 / +3.4% 0.57 / 0.60 / -3.4%
tpcds_q35/duckdb:vortex-file-compressed 31131837 / 31119364 / +0.0% 44445848 / 42566508 / +4.4% 0.70 / 0.73 / -4.2%
tpcds_q36/duckdb:vortex-file-compressed 14181712 / 14037150 / +1.0% 24815405 / 23560362 / +5.3% 0.57 / 0.60 / -4.1%
tpcds_q37/duckdb:vortex-file-compressed 9319742 / 9278629 / +0.4% 23276712 / 24238961 / -4.0% 0.40 / 0.38 / +4.6%
tpcds_q38/duckdb:vortex-file-compressed 24235508 / 24606434 / -1.5% 31689809 / 31179343 / +1.6% 0.76 / 0.79 / -3.1%
tpcds_q39/duckdb:vortex-file-compressed 18370100 / 18495272 / -0.7% 31196230 / 30737214 / +1.5% 0.59 / 0.60 / -2.1%
tpcds_q40/duckdb:vortex-file-compressed 10931149 / 11167876 / -2.1% 19941423 / 19316090 / +3.2% 0.55 / 0.58 / -5.2%
tpcds_q41/duckdb:vortex-file-compressed 14138426 / 17305600 / -18.3% 🟢 20404498 / 24395246 / -16.4% 🟢 0.69 / 0.71 / -2.3%
tpcds_q42/duckdb:vortex-file-compressed 6746686 / 6914912 / -2.4% 15860755 / 15064464 / +5.3% 0.43 / 0.46 / -7.3%
tpcds_q43/duckdb:vortex-file-compressed 9412926 / 9643249 / -2.4% 18930156 / 18160250 / +4.2% 0.50 / 0.53 / -6.4%
tpcds_q44/duckdb:vortex-file-compressed 12465961 / 12476409 / -0.1% 24620516 / 23821756 / +3.4% 0.51 / 0.52 / -3.3%
tpcds_q45/duckdb:vortex-file-compressed 23207851 / 23587638 / -1.6% 31044082 / 30430270 / +2.0% 0.75 / 0.78 / -3.6%
tpcds_q46/duckdb:vortex-file-compressed 31512534 / 31418024 / +0.3% 43977427 / 43171545 / +1.9% 0.72 / 0.73 / -1.5%
tpcds_q47/duckdb:vortex-file-compressed 30499573 / 31264494 / -2.4% 39972954 / 41141020 / -2.8% 0.76 / 0.76 / +0.4%
tpcds_q48/duckdb:vortex-file-compressed 21589266 / 22472531 / -3.9% 34670389 / 35469142 / -2.3% 0.62 / 0.63 / -1.7%
tpcds_q49/duckdb:vortex-file-compressed 18209822 / 18985566 / -4.1% 30696661 / 29722088 / +3.3% 0.59 / 0.64 / -7.1%
tpcds_q50/duckdb:vortex-file-compressed 14363421 / 14896845 / -3.6% 25179086 / 25687406 / -2.0% 0.57 / 0.58 / -1.6%
tpcds_q51/duckdb:vortex-file-compressed 48929502 / 48063878 / +1.8% 76243875 / 76334322 / -0.1% 0.64 / 0.63 / +1.9%
tpcds_q52/duckdb:vortex-file-compressed 6970256 / 7171716 / -2.8% 16600322 / 15978547 / +3.9% 0.42 / 0.45 / -6.4%
tpcds_q53/duckdb:vortex-file-compressed 11336672 / 11319189 / +0.2% 20528214 / 21681207 / -5.3% 0.55 / 0.52 / +5.8%
tpcds_q54/duckdb:vortex-file-compressed 19393630 / 19748759 / -1.8% 29983530 / 29438540 / +1.9% 0.65 / 0.67 / -3.6%
tpcds_q55/duckdb:vortex-file-compressed 6872364 / 6847788 / +0.4% 15897267 / 15285422 / +4.0% 0.43 / 0.45 / -3.5%
tpcds_q56/duckdb:vortex-file-compressed 17988608 / 17817582 / +1.0% 28011992 / 28613711 / -2.1% 0.64 / 0.62 / +3.1%
tpcds_q57/duckdb:vortex-file-compressed 25204892 / 25308086 / -0.4% 33959032 / 33487780 / +1.4% 0.74 / 0.76 / -1.8%
tpcds_q58/duckdb:vortex-file-compressed 20431509 / 20359384 / +0.4% 30046774 / 29241349 / +2.8% 0.68 / 0.70 / -2.3%
tpcds_q59/duckdb:vortex-file-compressed 19250682 / 19485481 / -1.2% 27150585 / 26442217 / +2.7% 0.71 / 0.74 / -3.8%
tpcds_q60/duckdb:vortex-file-compressed 18881677 / 18504610 / +2.0% 28118227 / 28842068 / -2.5% 0.67 / 0.64 / +4.7%
tpcds_q61/duckdb:vortex-file-compressed 19650824 / 19922872 / -1.4% 30819873 / 30039600 / +2.6% 0.64 / 0.66 / -3.9%
tpcds_q62/duckdb:vortex-file-compressed 11144608 / 10937722 / +1.9% 17726264 / 17144486 / +3.4% 0.63 / 0.64 / -1.5%
tpcds_q63/duckdb:vortex-file-compressed 10682173 / 10809960 / -1.2% 19052350 / 20560158 / -7.3% 0.56 / 0.53 / +6.6%
tpcds_q64/duckdb:vortex-file-compressed 52045722 / 52513062 / -0.9% 68496542 / 68406502 / +0.1% 0.76 / 0.77 / -1.0%
tpcds_q65/duckdb:vortex-file-compressed 12857486 / 13060742 / -1.6% 23197499 / 23236608 / -0.2% 0.55 / 0.56 / -1.4%
tpcds_q66/duckdb:vortex-file-compressed 31253128 / 31272590 / -0.1% 38633042 / 39351988 / -1.8% 0.81 / 0.79 / +1.8%
tpcds_q67/duckdb:vortex-file-compressed 55133268 / 55266268 / -0.2% 64866589 / 64683896 / +0.3% 0.85 / 0.85 / -0.5%
tpcds_q68/duckdb:vortex-file-compressed 22624435 / 23009998 / -1.7% 35854798 / 35296552 / +1.6% 0.63 / 0.65 / -3.2%
tpcds_q69/duckdb:vortex-file-compressed 22048624 / 22017648 / +0.1% 37669995 / 36691775 / +2.7% 0.59 / 0.60 / -2.5%
tpcds_q70/duckdb:vortex-file-compressed 14468744 / 14724129 / -1.7% 25465946 / 25052861 / +1.6% 0.57 / 0.59 / -3.3%
tpcds_q71/duckdb:vortex-file-compressed 13889491 / 13347567 / +4.1% 22893791 / 23409485 / -2.2% 0.61 / 0.57 / +6.4%
tpcds_q72/duckdb:vortex-file-compressed 42348384 / 43060600 / -1.7% 55836319 / 56269909 / -0.8% 0.76 / 0.77 / -0.9%
tpcds_q73/duckdb:vortex-file-compressed 11808871 / 11829364 / -0.2% 21494110 / 21106781 / +1.8% 0.55 / 0.56 / -2.0%
tpcds_q74/duckdb:vortex-file-compressed 30679782 / 30874616 / -0.6% 39132041 / 39304395 / -0.4% 0.78 / 0.79 / -0.2%
tpcds_q75/duckdb:vortex-file-compressed 36658766 / 37067086 / -1.1% 50617676 / 48402666 / +4.6% 0.72 / 0.77 / -5.4%
tpcds_q76/duckdb:vortex-file-compressed 12685354 / 12879005 / -1.5% 22791750 / 22058251 / +3.3% 0.56 / 0.58 / -4.7%
tpcds_q77/duckdb:vortex-file-compressed 20606539 / 20386666 / +1.1% 31338251 / 31298903 / +0.1% 0.66 / 0.65 / +1.0%
tpcds_q78/duckdb:vortex-file-compressed 43153852 / 42921238 / +0.5% 54563288 / 52920959 / +3.1% 0.79 / 0.81 / -2.5%
tpcds_q79/duckdb:vortex-file-compressed 16805168 / 17204298 / -2.3% 27335249 / 26915068 / +1.6% 0.61 / 0.64 / -3.8%
tpcds_q80/duckdb:vortex-file-compressed 29153977 / 29835128 / -2.3% 43841813 / 43751968 / +0.2% 0.66 / 0.68 / -2.5%
tpcds_q81/duckdb:vortex-file-compressed 20838892 / 21403570 / -2.6% 29944658 / 30302750 / -1.2% 0.70 / 0.71 / -1.5%
tpcds_q82/duckdb:vortex-file-compressed 9550245 / 9601288 / -0.5% 24789607 / 23700733 / +4.6% 0.39 / 0.41 / -4.9%
tpcds_q83/duckdb:vortex-file-compressed 17511998 / 17487681 / +0.1% 24449429 / 24391032 / +0.2% 0.72 / 0.72 / -0.1%
tpcds_q84/duckdb:vortex-file-compressed 15656876 / 15474432 / +1.2% 22299420 / 23926919 / -6.8% 0.70 / 0.65 / +8.6%
tpcds_q85/duckdb:vortex-file-compressed 23854898 / 25015558 / -4.6% 35923952 / 36358715 / -1.2% 0.66 / 0.69 / -3.5%
tpcds_q86/duckdb:vortex-file-compressed 9586186 / 9625184 / -0.4% 16436142 / 16115124 / +2.0% 0.58 / 0.60 / -2.4%
tpcds_q87/duckdb:vortex-file-compressed 25968600 / 26050646 / -0.3% 33638173 / 33749194 / -0.3% 0.77 / 0.77 / +0.0%
tpcds_q88/duckdb:vortex-file-compressed 29824179 / 30341066 / -1.7% 39373861 / 40666123 / -3.2% 0.76 / 0.75 / +1.5%
tpcds_q89/duckdb:vortex-file-compressed 11832717 / 11880278 / -0.4% 21605902 / 21020275 / +2.8% 0.55 / 0.57 / -3.1%
tpcds_q90/duckdb:vortex-file-compressed 7597541 / 7873380 / -3.5% 14452882 / 15793821 / -8.5% 0.53 / 0.50 / +5.4%
tpcds_q91/duckdb:vortex-file-compressed 14256572 / 14680431 / -2.9% 22901455 / 23432754 / -2.3% 0.62 / 0.63 / -0.6%
tpcds_q92/duckdb:vortex-file-compressed 10341043 / 10362186 / -0.2% 18263194 / 17798675 / +2.6% 0.57 / 0.58 / -2.7%
tpcds_q93/duckdb:vortex-file-compressed 10251714 / 10321070 / -0.7% 23222934 / 22416155 / +3.6% 0.44 / 0.46 / -4.1%
tpcds_q94/duckdb:vortex-file-compressed 22170454 / 22085020 / +0.4% 31581918 / 31715817 / -0.4% 0.70 / 0.70 / +0.8%
tpcds_q95/duckdb:vortex-file-compressed 60992886 / 60520896 / +0.8% 68232953 / 67458992 / +1.1% 0.89 / 0.90 / -0.4%
tpcds_q96/duckdb:vortex-file-compressed 6565058 / 6497133 / +1.0% 15900818 / 15310655 / +3.9% 0.41 / 0.42 / -2.7%
tpcds_q97/duckdb:vortex-file-compressed 23020028 / 22917520 / +0.4% 31001464 / 31822045 / -2.6% 0.74 / 0.72 / +3.1%
tpcds_q98/duckdb:vortex-file-compressed 10924704 / 10919490 / +0.0% 19830719 / 19425955 / +2.1% 0.55 / 0.56 / -2.0%
tpcds_q99/duckdb:vortex-file-compressed 14495082 / 14421880 / +0.5% 22814861 / 22012689 / +3.6% 0.64 / 0.66 / -3.0%
duckdb / parquet / ns (0.997x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23762192 / 24093628 / -1.4% 30782834 / 30609636 / +0.6% 0.77 / 0.79 / -1.9%
tpcds_q02/duckdb:parquet 17759230 / 17984803 / -1.3% 23642446 / 24025915 / -1.6% 0.75 / 0.75 / +0.3%
tpcds_q03/duckdb:parquet 9662404 / 9812261 / -1.5% 15321014 / 15610845 / -1.9% 0.63 / 0.63 / +0.3%
tpcds_q04/duckdb:parquet 117720180 / 118053322 / -0.3% 125585312 / 125451786 / +0.1% 0.94 / 0.94 / -0.4%
tpcds_q05/duckdb:parquet 28101714 / 28431532 / -1.2% 32579037 / 33184023 / -1.8% 0.86 / 0.86 / +0.7%
tpcds_q06/duckdb:parquet 26195456 / 26561266 / -1.4% 35579047 / 34919227 / +1.9% 0.74 / 0.76 / -3.2%
tpcds_q07/duckdb:parquet 32117722 / 31458600 / +2.1% 38453270 / 38910397 / -1.2% 0.84 / 0.81 / +3.3%
tpcds_q08/duckdb:parquet 19797452 / 19835614 / -0.2% 25729246 / 26315778 / -2.2% 0.77 / 0.75 / +2.1%
tpcds_q09/duckdb:parquet 26797684 / 27590826 / -2.9% 29305592 / 29561025 / -0.9% 0.91 / 0.93 / -2.0%
tpcds_q10/duckdb:parquet 32390510 / 32550451 / -0.5% 39847076 / 40051128 / -0.5% 0.81 / 0.81 / +0.0%
tpcds_q11/duckdb:parquet 68600384 / 68928280 / -0.5% 75785408 / 76188001 / -0.5% 0.91 / 0.90 / +0.1%
tpcds_q12/duckdb:parquet 13898669 / 13995176 / -0.7% 19244658 / 19053083 / +1.0% 0.72 / 0.73 / -1.7%
tpcds_q13/duckdb:parquet 31332121 / 33308439 / -5.9% 39446625 / 39541391 / -0.2% 0.79 / 0.84 / -5.7%
tpcds_q14/duckdb:parquet 63632456 / 64769091 / -1.8% 70150821 / 68114003 / +3.0% 0.91 / 0.95 / -4.6%
tpcds_q15/duckdb:parquet 16544239 / 16637540 / -0.6% 22414813 / 22243900 / +0.8% 0.74 / 0.75 / -1.3%
tpcds_q16/duckdb:parquet 30127410 / 30104670 / +0.1% 36928778 / 37135181 / -0.6% 0.82 / 0.81 / +0.6%
tpcds_q17/duckdb:parquet 34291726 / 34477460 / -0.5% 39916979 / 40356696 / -1.1% 0.86 / 0.85 / +0.6%
tpcds_q18/duckdb:parquet 46660360 / 47148372 / -1.0% 54655478 / 54249081 / +0.7% 0.85 / 0.87 / -1.8%
tpcds_q19/duckdb:parquet 18755172 / 19018304 / -1.4% 25798634 / 25382414 / +1.6% 0.73 / 0.75 / -3.0%
tpcds_q20/duckdb:parquet 14969257 / 14902117 / +0.5% 19306163 / 19412123 / -0.5% 0.78 / 0.77 / +1.0%
tpcds_q21/duckdb:parquet 10532458 / 10731116 / -1.9% 17033814 / 17030686 / +0.0% 0.62 / 0.63 / -1.9%
tpcds_q22/duckdb:parquet 20532516 / 20507718 / +0.1% 26592650 / 26762155 / -0.6% 0.77 / 0.77 / +0.8%
tpcds_q23/duckdb:parquet 42619351 / 42833082 / -0.5% 46516302 / 49424056 / -5.9% 0.92 / 0.87 / +5.7%
tpcds_q24/duckdb:parquet 29920446 / 29943294 / -0.1% 36584415 / 36464447 / +0.3% 0.82 / 0.82 / -0.4%
tpcds_q25/duckdb:parquet 30113061 / 30514354 / -1.3% 36918918 / 37025273 / -0.3% 0.82 / 0.82 / -1.0%
tpcds_q26/duckdb:parquet 28970990 / 29252328 / -1.0% 35038720 / 35038512 / +0.0% 0.83 / 0.83 / -1.0%
tpcds_q27/duckdb:parquet 33304180 / 34872377 / -4.5% 41460378 / 41229992 / +0.6% 0.80 / 0.85 / -5.0%
tpcds_q28/duckdb:parquet 26791794 / 25185258 / +6.4% 35076125 / 31104212 / +12.8% 🔴 0.76 / 0.81 / -5.7%
tpcds_q29/duckdb:parquet 31835930 / 32150195 / -1.0% 38869616 / 38969206 / -0.3% 0.82 / 0.83 / -0.7%
tpcds_q30/duckdb:parquet 35272037 / 35528874 / -0.7% 44346366 / 44172843 / +0.4% 0.80 / 0.80 / -1.1%
tpcds_q31/duckdb:parquet 35532426 / 35529000 / +0.0% 42349055 / 42639874 / -0.7% 0.84 / 0.83 / +0.7%
tpcds_q32/duckdb:parquet 14134996 / 14179243 / -0.3% 20982251 / 21025962 / -0.2% 0.67 / 0.67 / -0.1%
tpcds_q33/duckdb:parquet 24622464 / 23095442 / +6.6% 28532320 / 28549004 / -0.1% 0.86 / 0.81 / +6.7%
tpcds_q34/duckdb:parquet 19196662 / 16952271 / +13.2% 🔴 23984785 / 24176719 / -0.8% 0.80 / 0.70 / +14.1%
tpcds_q35/duckdb:parquet 35179843 / 34975734 / +0.6% 43853107 / 43207543 / +1.5% 0.80 / 0.81 / -0.9%
tpcds_q36/duckdb:parquet 39307612 / 39485050 / -0.4% 47456840 / 47479406 / -0.0% 0.83 / 0.83 / -0.4%
tpcds_q37/duckdb:parquet 12772961 / 12797622 / -0.2% 19228790 / 19277008 / -0.3% 0.66 / 0.66 / +0.1%
tpcds_q38/duckdb:parquet 29415966 / 29621006 / -0.7% 34045678 / 33433489 / +1.8% 0.86 / 0.89 / -2.5%
tpcds_q39/duckdb:parquet 23075108 / 23128167 / -0.2% 29972817 / 29595365 / +1.3% 0.77 / 0.78 / -1.5%
tpcds_q40/duckdb:parquet 15796882 / 16054940 / -1.6% 20928246 / 21235777 / -1.4% 0.75 / 0.76 / -0.2%
tpcds_q41/duckdb:parquet 11985990 / 11966633 / +0.2% 18151790 / 18065700 / +0.5% 0.66 / 0.66 / -0.3%
tpcds_q42/duckdb:parquet 9497251 / 9626178 / -1.3% 15559232 / 15525610 / +0.2% 0.61 / 0.62 / -1.6%
tpcds_q43/duckdb:parquet 12049684 / 12048868 / +0.0% 17900613 / 18128038 / -1.3% 0.67 / 0.66 / +1.3%
tpcds_q44/duckdb:parquet 20859646 / 21607511 / -3.5% 27035191 / 26196804 / +3.2% 0.77 / 0.82 / -6.5%
tpcds_q45/duckdb:parquet 20971040 / 20908743 / +0.3% 27681115 / 27486675 / +0.7% 0.76 / 0.76 / -0.4%
tpcds_q46/duckdb:parquet 37397148 / 35288508 / +6.0% 43496894 / 43320711 / +0.4% 0.86 / 0.81 / +5.5%
tpcds_q47/duckdb:parquet 34489828 / 34531498 / -0.1% 40772646 / 41336316 / -1.4% 0.85 / 0.84 / +1.3%
tpcds_q48/duckdb:parquet 29890920 / 29103170 / +2.7% 36829652 / 36426435 / +1.1% 0.81 / 0.80 / +1.6%
tpcds_q49/duckdb:parquet 30191908 / 30233053 / -0.1% 36381540 / 36303817 / +0.2% 0.83 / 0.83 / -0.3%
tpcds_q50/duckdb:parquet 19294878 / 20388898 / -5.4% 25426886 / 25331399 / +0.4% 0.76 / 0.80 / -5.7%
tpcds_q51/duckdb:parquet 51902635 / 52104356 / -0.4% 60854997 / 61245199 / -0.6% 0.85 / 0.85 / +0.3%
tpcds_q52/duckdb:parquet 9594996 / 9659180 / -0.7% 15445757 / 15499988 / -0.3% 0.62 / 0.62 / -0.3%
tpcds_q53/duckdb:parquet 14982050 / 14537118 / +3.1% 20954516 / 20752143 / +1.0% 0.71 / 0.70 / +2.1%
tpcds_q54/duckdb:parquet 24733042 / 24733616 / -0.0% 31642247 / 31908376 / -0.8% 0.78 / 0.78 / +0.8%
tpcds_q55/duckdb:parquet 9433913 / 9489484 / -0.6% 15617604 / 15341981 / +1.8% 0.60 / 0.62 / -2.3%
tpcds_q56/duckdb:parquet 26664197 / 27141406 / -1.8% 30388155 / 30419221 / -0.1% 0.88 / 0.89 / -1.7%
tpcds_q57/duckdb:parquet 30521954 / 30693180 / -0.6% 35828274 / 36167354 / -0.9% 0.85 / 0.85 / +0.4%
tpcds_q58/duckdb:parquet 24261382 / 23919381 / +1.4% 29466437 / 29814453 / -1.2% 0.82 / 0.80 / +2.6%
tpcds_q59/duckdb:parquet 22436576 / 22867650 / -1.9% 28397227 / 28707391 / -1.1% 0.79 / 0.80 / -0.8%
tpcds_q60/duckdb:parquet 27523634 / 26316208 / +4.6% 32298509 / 31957179 / +1.1% 0.85 / 0.82 / +3.5%
tpcds_q61/duckdb:parquet 25275074 / 24749493 / +2.1% 29062746 / 29026258 / +0.1% 0.87 / 0.85 / +2.0%
tpcds_q62/duckdb:parquet 12750071 / 12721642 / +0.2% 17628610 / 17771445 / -0.8% 0.72 / 0.72 / +1.0%
tpcds_q63/duckdb:parquet 13100744 / 14341675 / -8.7% 19971954 / 20011856 / -0.2% 0.66 / 0.72 / -8.5%
tpcds_q64/duckdb:parquet 69868848 / 70307914 / -0.6% 79049586 / 79575965 / -0.7% 0.88 / 0.88 / +0.0%
tpcds_q65/duckdb:parquet 20126221 / 20569484 / -2.2% 25925745 / 25477560 / +1.8% 0.78 / 0.81 / -3.8%
tpcds_q66/duckdb:parquet 33174742 / 33045765 / +0.4% 37460591 / 38019443 / -1.5% 0.89 / 0.87 / +1.9%
tpcds_q67/duckdb:parquet 60525230 / 61027914 / -0.8% 68974523 / 66818321 / +3.2% 0.88 / 0.91 / -3.9%
tpcds_q68/duckdb:parquet 27932274 / 30834914 / -9.4% 36658386 / 35993030 / +1.8% 0.76 / 0.86 / -11.1%
tpcds_q69/duckdb:parquet 25755396 / 25794512 / -0.2% 33983081 / 33964184 / +0.1% 0.76 / 0.76 / -0.2%
tpcds_q70/duckdb:parquet 20792063 / 19255869 / +8.0% 28192138 / 26582665 / +6.1% 0.74 / 0.72 / +1.8%
tpcds_q71/duckdb:parquet 16867578 / 16803522 / +0.4% 23875896 / 23382022 / +2.1% 0.71 / 0.72 / -1.7%
tpcds_q72/duckdb:parquet 52897888 / 53014220 / -0.2% 58864622 / 59449489 / -1.0% 0.90 / 0.89 / +0.8%
tpcds_q73/duckdb:parquet 17107981 / 15895421 / +7.6% 21172761 / 21585777 / -1.9% 0.81 / 0.74 / +9.7%
tpcds_q74/duckdb:parquet 86187896 / 85004257 / +1.4% 90746348 / 89575448 / +1.3% 0.95 / 0.95 / +0.1%
tpcds_q75/duckdb:parquet 45322866 / 44183878 / +2.6% 49655739 / 49282250 / +0.8% 0.91 / 0.90 / +1.8%
tpcds_q76/duckdb:parquet 18146141 / 18510097 / -2.0% 23139831 / 22802776 / +1.5% 0.78 / 0.81 / -3.4%
tpcds_q77/duckdb:parquet 26517766 / 25530442 / +3.9% 30856603 / 31441226 / -1.9% 0.86 / 0.81 / +5.8%
tpcds_q78/duckdb:parquet 78529441 / 78229121 / +0.4% 85189547 / 85641462 / -0.5% 0.92 / 0.91 / +0.9%
tpcds_q79/duckdb:parquet 21301330 / 24067906 / -11.5% 🟢 28677033 / 28358044 / +1.1% 0.74 / 0.85 / -12.5%
tpcds_q80/duckdb:parquet 37948036 / 38479893 / -1.4% 43981234 / 43843592 / +0.3% 0.86 / 0.88 / -1.7%
tpcds_q81/duckdb:parquet 36205886 / 36125748 / +0.2% 44648791 / 44907713 / -0.6% 0.81 / 0.80 / +0.8%
tpcds_q82/duckdb:parquet 13300108 / 13496682 / -1.5% 20228067 / 20103202 / +0.6% 0.66 / 0.67 / -2.1%
tpcds_q83/duckdb:parquet 20128778 / 19941274 / +0.9% 24625478 / 24813592 / -0.8% 0.82 / 0.80 / +1.7%
tpcds_q84/duckdb:parquet 22524215 / 23090262 / -2.5% 28273338 / 28462809 / -0.7% 0.80 / 0.81 / -1.8%
tpcds_q85/duckdb:parquet 32254702 / 32217004 / +0.1% 39543114 / 38985194 / +1.4% 0.82 / 0.83 / -1.3%
tpcds_q86/duckdb:parquet 11830423 / 11811458 / +0.2% 16630866 / 16496302 / +0.8% 0.71 / 0.72 / -0.6%
tpcds_q87/duckdb:parquet 31171781 / 31436775 / -0.8% 35268061 / 35185024 / +0.2% 0.88 / 0.89 / -1.1%
tpcds_q88/duckdb:parquet 38157872 / 38059442 / +0.3% 42646423 / 41928306 / +1.7% 0.89 / 0.91 / -1.4%
tpcds_q89/duckdb:parquet 14156354 / 14206404 / -0.4% 21610669 / 21172421 / +2.1% 0.66 / 0.67 / -2.4%
tpcds_q90/duckdb:parquet 10077915 / 10080660 / -0.0% 15127566 / 15448563 / -2.1% 0.67 / 0.65 / +2.1%
tpcds_q91/duckdb:parquet 20948562 / 21048574 / -0.5% 28234475 / 28220317 / +0.1% 0.74 / 0.75 / -0.5%
tpcds_q92/duckdb:parquet 15540142 / 15572126 / -0.2% 21918115 / 22096515 / -0.8% 0.71 / 0.70 / +0.6%
tpcds_q93/duckdb:parquet 14171632 / 14091483 / +0.6% 19995805 / 20175447 / -0.9% 0.71 / 0.70 / +1.5%
tpcds_q94/duckdb:parquet 25351440 / 25392360 / -0.2% 32569754 / 32388339 / +0.6% 0.78 / 0.78 / -0.7%
tpcds_q95/duckdb:parquet 43861100 / 43748374 / +0.3% 49841738 / 49895274 / -0.1% 0.88 / 0.88 / +0.4%
tpcds_q96/duckdb:parquet 8210418 / 8272491 / -0.8% 13887176 / 13988491 / -0.7% 0.59 / 0.59 / -0.0%
tpcds_q97/duckdb:parquet 27406009 / 27667050 / -0.9% 32847399 / 32852985 / -0.0% 0.83 / 0.84 / -0.9%
tpcds_q98/duckdb:parquet 16268913 / 16378365 / -0.7% 23245842 / 22777602 / +2.1% 0.70 / 0.72 / -2.7%
tpcds_q99/duckdb:parquet 18670467 / 18807829 / -0.7% 24888987 / 24915617 / -0.1% 0.75 / 0.75 / -0.6%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 7fb2efcf vs base b2f8d0f9
Vortex (geomean): hot 1.063x ➖ · cold 0.936x ➖


datafusion / vortex-file-compressed / ns (1.063x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 43994934 / 44247398 / -0.6% 83370112 / 86756764 / -3.9% 0.53 / 0.51 / +3.5%
polarsignals_q01/datafusion:vortex-file-compressed 84958863 / 53190033 / +59.7% 🔴 141444645 / 111620562 / +26.7% 🔴 0.60 / 0.48 / +26.0%
polarsignals_q02/datafusion:vortex-file-compressed 14287238 / 14308001 / -0.1% 44777833 / 50938846 / -12.1% 🟢 0.32 / 0.28 / +13.6%
polarsignals_q03/datafusion:vortex-file-compressed 54943403 / 69231543 / -20.6% 🟢 108946940 / 116022576 / -6.1% 0.50 / 0.60 / -15.5%
polarsignals_q04/datafusion:vortex-file-compressed 9238026 / 9324230 / -0.9% 36373019 / 43390473 / -16.2% 🟢 0.25 / 0.21 / +18.2%
polarsignals_q05/datafusion:vortex-file-compressed 11638746 / 11645938 / -0.1% 39558693 / 46740242 / -15.4% 🟢 0.29 / 0.25 / +18.1%
polarsignals_q06/datafusion:vortex-file-compressed 23028290 / 22759316 / +1.2% 49639503 / 56616878 / -12.3% 🟢 0.46 / 0.40 / +15.4%
polarsignals_q07/datafusion:vortex-file-compressed 10600660 / 10826504 / -2.1% 38300219 / 45422058 / -15.7% 🟢 0.28 / 0.24 / +16.1%
polarsignals_q08/datafusion:vortex-file-compressed 98308836 / 96763190 / +1.6% 151276301 / 161828007 / -6.5% 0.65 / 0.60 / +8.7%
polarsignals_q09/datafusion:vortex-file-compressed 10122760 / 9924556 / +2.0% 34469115 / 41195204 / -16.3% 🟢 0.29 / 0.24 / +21.9%
polarsignals_q10/datafusion:vortex-file-compressed 84866032 / 55401320 / +53.2% 🔴 136514658 / 116674031 / +17.0% 🔴 0.62 / 0.47 / +30.9%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant