Skip to content

Prune static V2 DataFusion files before assigning scan partitions - #11344

Draft
joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-08-df-prune-before-partition
Draft

joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-08-df-prune-before-partition

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Draft with a confirmed CPU-regression hold: whole-process CPU increases 13.31%. The latency tradeoff below is not approved for landing.

Stack dependency: #11334. This PR targets that branch so its diff contains only this change.

Summary

DataFusion currently assigns byte-range partitions before its opener can exclude files. For eligible static V2 scans, prune from available file statistics during repartitioning so the retained files determine the scan groups. Files with unknown statistics remain eligible to scan.

Based on ji/clickbench-v2-20261109-01-io-wakeups, the shared-segment wakeup fix. This change is independent of the DuckDB pruning branches.

Changes

  • Prepare and reuse the DataFusion pruning predicate, invalidating it when filters are added; retain existing handling for dynamic, ordered, and partition-column scans.
  • Build typed null bounds for files with missing, inexact, null, or incompatible statistics, and downgrade table statistics after files are removed.
  • Add coverage for unknown-file ordering, repeated repartitioning, empty results, predicate-cache invalidation, and schema evolution.

Benchmark evidence and hold

Whole-process user+system CPU increases 13.31% (99% interval 12.83–13.65%). Every one of the 24 primary process pairs increases CPU, and the corrected CPU regression test passes. CPU includes setup and warmups; it is not isolated Vortex CPU. This source-level hold remains despite the latency reductions.

Observed warm latency reductions against the exact dependency parent (zero-based query IDs):

Query Parent median (ms) Candidate median (ms) Paired reduction 99% interval
Q36 27.6901 14.5293 47.55% 47.45–47.65%
Q37 13.7629 7.2966 47.01% 46.95–47.08%
Q39 60.4181 30.0019 50.41% 50.27–50.66%
Q42 5.8179 4.3524 25.15% 24.86–25.39%

24 fresh adjacent process pairs in balanced order; 100 executions/query, first 20 discarded; 8 interspersed identical-binary A/A pairs. Effects use mean paired log ratios of process warm medians; displayed time medians need not have exactly that ratio. Intervals are pointwise 99% bootstrap intervals. The focused latency family contains all 76 planned directions and the CPU family contains 24 directions, each with Holm 1% correction. No post-warmup observations were excluded or controls subtracted. These latency effects do not override the CPU hold and are not additive with other branches.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads. DataFusion 55.2 retains enable_topk_aggregation=true.

Source inspection found an inherited automatic scan-concurrency multiplier as a possible contributor to the extra CPU. That hypothesis is unproven; no proposed tuning patch is included in this PR.

The matching CPU A/A control shows +0.309% apparent reduction (99% interval +0.073% to +0.532%). This small drift warning is retained; it does not explain the 13.31% measured CPU increase, and the control is not subtracted.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

Keep this as a held latency/CPU trade-off. The corrected focused CPU increase is 13.31% (99% interval 12.83–13.65%), despite substantial focused latency gains. All43 CPU is 0.33% lower and latency sums are favorable, but this different workload composition cannot overturn the focused cost or establish equivalence. The small Q24 screen signal is control-sized and adds no independent hold. Publication is authorized; the existing CPU evidence already explains why landing needs further judgment.

Validation

  • 26 targeted test executions passed: persistent::source::tests, test_filter_with_schema_evolution, test_filter_schema_evolution_order.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate), including strict types, floating tolerance and tied-row oracles.
  • Both benchmark packages built together with --locked, release_debug, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust formatting and patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local commit: 3d81b7b8e2b48752de3332c4283aa0e6089500fc; full source tree: e227923037de048e9e851f6b91283378789533a4; measured parent: a2765d42438062db73d431ef6d296930e69f5b28.

PR source commit: 768b49f9fe012ae9ef8e7ca72d6ea2cbff335c15; mapped parent: da10665e5b0fad748a1e0e6550cc19880edd0317. Complete source-tree equality, mapped parent, raw Git object, original message and author/committer signoffs were verified. GitHub regenerated commit metadata, so measured local commits and executable hashes remain the benchmark identities.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

Use available file statistics before byte-range partitioning so workers share the surviving files. Preserve unknown files, leave dynamic and ordered scans on the existing path, and downgrade table statistics after pruning.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-01-io-wakeups to develop November 9, 2026 12:00
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-01-io-wakeups November 9, 2026 12:00
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 768b49f tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 768b49f tpcds-nvme 1 Explore Profiling Data
🟢 Done 768b49f clickbench-nvme 1 Explore Profiling Data
🟢 Done 768b49f fineweb 1 Explore Profiling Data
🟢 Done 768b49f tpch-s3 1 Explore Profiling Data
🟢 Done 768b49f tpch-nvme-10 1 Explore Profiling Data
🟢 Done 768b49f tpch-nvme 1 Explore Profiling Data
🟢 Done 768b49f polarsignals 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 768b49f9 vs base b2f8d0f9
Vortex (geomean): hot 1.008x ➖ · cold 0.887x ✅


datafusion / vortex-file-compressed / ns (1.008x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44369371 / 44247398 / +0.3% 83528335 / 86756764 / -3.7% 0.53 / 0.51 / +4.2%
polarsignals_q01/datafusion:vortex-file-compressed 83840944 / 53190033 / +57.6% 🔴 104272945 / 111620562 / -6.6% 0.80 / 0.48 / +68.7%
polarsignals_q02/datafusion:vortex-file-compressed 11920386 / 14308001 / -16.7% 🟢 39983203 / 50938846 / -21.5% 🟢 0.30 / 0.28 / +6.1%
polarsignals_q03/datafusion:vortex-file-compressed 54711224 / 69231543 / -21.0% 🟢 108889997 / 116022576 / -6.1% 0.50 / 0.60 / -15.8%
polarsignals_q04/datafusion:vortex-file-compressed 9121056 / 9324230 / -2.2% 35931897 / 43390473 / -17.2% 🟢 0.25 / 0.21 / +18.1%
polarsignals_q05/datafusion:vortex-file-compressed 11409271 / 11645938 / -2.0% 39385006 / 46740242 / -15.7% 🟢 0.29 / 0.25 / +16.3%
polarsignals_q06/datafusion:vortex-file-compressed 22938282 / 22759316 / +0.8% 49335310 / 56616878 / -12.9% 🟢 0.46 / 0.40 / +15.7%
polarsignals_q07/datafusion:vortex-file-compressed 10735294 / 10826504 / -0.8% 37529098 / 45422058 / -17.4% 🟢 0.29 / 0.24 / +20.0%
polarsignals_q08/datafusion:vortex-file-compressed 104958243 / 96763190 / +8.5% 160355888 / 161828007 / -0.9% 0.65 / 0.60 / +9.5%
polarsignals_q09/datafusion:vortex-file-compressed 10130951 / 9924556 / +2.1% 35655992 / 41195204 / -13.4% 🟢 0.28 / 0.24 / +17.9%
polarsignals_q10/datafusion:vortex-file-compressed 54867674 / 55401320 / -1.0% 109159521 / 116674031 / -6.4% 0.50 / 0.47 / +5.9%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 768b49f9 vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.972x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15861898 / 15688950 / +1.1% 42529291 / 42044683 / +1.2% 0.37 / 0.37 / -0.0%
tpch_q02/datafusion:vortex-file-compressed 17560145 / 17642963 / -0.5% 38748049 / 38300817 / +1.2% 0.45 / 0.46 / -1.6%
tpch_q03/datafusion:vortex-file-compressed 19072032 / 19065844 / +0.0% 45124912 / 48397388 / -6.8% 0.42 / 0.39 / +7.3%
tpch_q04/datafusion:vortex-file-compressed 10179589 / 11164861 / -8.8% 35025417 / 35072742 / -0.1% 0.29 / 0.32 / -8.7%
tpch_q05/datafusion:vortex-file-compressed 37781641 / 37464731 / +0.8% 66631770 / 67783021 / -1.7% 0.57 / 0.55 / +2.6%
tpch_q06/datafusion:vortex-file-compressed 4431821 / 4339682 / +2.1% 24691223 / 24863986 / -0.7% 0.18 / 0.17 / +2.8%
tpch_q07/datafusion:vortex-file-compressed 52543291 / 52692511 / -0.3% 82146429 / 85054942 / -3.4% 0.64 / 0.62 / +3.2%
tpch_q08/datafusion:vortex-file-compressed 52521174 / 52605829 / -0.2% 78664878 / 84709539 / -7.1% 0.67 / 0.62 / +7.5%
tpch_q09/datafusion:vortex-file-compressed 47777647 / 48498381 / -1.5% 78317749 / 84507228 / -7.3% 0.61 / 0.57 / +6.3%
tpch_q10/datafusion:vortex-file-compressed 17831621 / 17830636 / +0.0% 49105065 / 50418361 / -2.6% 0.36 / 0.35 / +2.7%
tpch_q11/datafusion:vortex-file-compressed 14619025 / 14797088 / -1.2% 33478375 / 34636066 / -3.3% 0.44 / 0.43 / +2.2%
tpch_q12/datafusion:vortex-file-compressed 18500793 / 18367682 / +0.7% 41864083 / 44324157 / -5.6% 0.44 / 0.41 / +6.6%
tpch_q13/datafusion:vortex-file-compressed 19906241 / 19445378 / +2.4% 40578577 / 43547559 / -6.8% 0.49 / 0.45 / +9.9%
tpch_q14/datafusion:vortex-file-compressed 14342993 / 14501344 / -1.1% 36398826 / 38502171 / -5.5% 0.39 / 0.38 / +4.6%
tpch_q15/datafusion:vortex-file-compressed 18322417 / 18611040 / -1.6% 44389870 / 47147954 / -5.8% 0.41 / 0.39 / +4.6%
tpch_q16/datafusion:vortex-file-compressed 18730216 / 18720655 / +0.1% 40490969 / 39847079 / +1.6% 0.46 / 0.47 / -1.5%
tpch_q17/datafusion:vortex-file-compressed 29014921 / 28917794 / +0.3% 58973064 / 58954760 / +0.0% 0.49 / 0.49 / +0.3%
tpch_q18/datafusion:vortex-file-compressed 37244271 / 36473671 / +2.1% 61389344 / 59803246 / +2.7% 0.61 / 0.61 / -0.5%
tpch_q19/datafusion:vortex-file-compressed 9533902 / 9988295 / -4.5% 37180229 / 36396214 / +2.2% 0.26 / 0.27 / -6.6%
tpch_q20/datafusion:vortex-file-compressed 21350372 / 21253874 / +0.5% 46893231 / 52124094 / -10.0% 🟢 0.46 / 0.41 / +11.7%
tpch_q21/datafusion:vortex-file-compressed 34819661 / 35502918 / -1.9% 66504132 / 66036777 / +0.7% 0.52 / 0.54 / -2.6%
tpch_q22/datafusion:vortex-file-compressed 11309463 / 10854425 / +4.2% 30174706 / 31535557 / -4.3% 0.37 / 0.34 / +8.9%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71250058 / 71385078 / -0.2% 87458514 / 87261585 / +0.2% 0.81 / 0.82 / -0.4%
tpch_q02/datafusion:parquet 75581674 / 76624116 / -1.4% 92437386 / 91913452 / +0.6% 0.82 / 0.83 / -1.9%
tpch_q03/datafusion:parquet 81541632 / 82108255 / -0.7% 102906796 / 104243587 / -1.3% 0.79 / 0.79 / +0.6%
tpch_q04/datafusion:parquet 39116837 / 39117802 / -0.0% 56928638 / 58381793 / -2.5% 0.69 / 0.67 / +2.6%
tpch_q05/datafusion:parquet 110097161 / 110097915 / -0.0% 133266751 / 137152327 / -2.8% 0.83 / 0.80 / +2.9%
tpch_q06/datafusion:parquet 31308707 / 31364851 / -0.2% 46913822 / 46559945 / +0.8% 0.67 / 0.67 / -0.9%
tpch_q07/datafusion:parquet 113073992 / 113603354 / -0.5% 137807877 / 139063930 / -0.9% 0.82 / 0.82 / +0.4%
tpch_q08/datafusion:parquet 116886869 / 118351864 / -1.2% 142329637 / 143663582 / -0.9% 0.82 / 0.82 / -0.3%
tpch_q09/datafusion:parquet 137539791 / 137262432 / +0.2% 164808196 / 166772416 / -1.2% 0.83 / 0.82 / +1.4%
tpch_q10/datafusion:parquet 103602975 / 103456749 / +0.1% 126051708 / 126729504 / -0.5% 0.82 / 0.82 / +0.7%
tpch_q11/datafusion:parquet 61951058 / 62363006 / -0.7% 80201620 / 82069278 / -2.3% 0.77 / 0.76 / +1.7%
tpch_q12/datafusion:parquet 63547163 / 63533745 / +0.0% 83440282 / 85351184 / -2.2% 0.76 / 0.74 / +2.3%
tpch_q13/datafusion:parquet 143744568 / 142477870 / +0.9% 162560506 / 161849930 / +0.4% 0.88 / 0.88 / +0.4%
tpch_q14/datafusion:parquet 47538415 / 47624060 / -0.2% 69160111 / 68804881 / +0.5% 0.69 / 0.69 / -0.7%
tpch_q15/datafusion:parquet 73541967 / 74880432 / -1.8% 92523320 / 92266259 / +0.3% 0.79 / 0.81 / -2.1%
tpch_q16/datafusion:parquet 43365742 / 43181694 / +0.4% 60789286 / 59549382 / +2.1% 0.71 / 0.73 / -1.6%
tpch_q17/datafusion:parquet 122623540 / 123682757 / -0.9% 144869591 / 147020505 / -1.5% 0.85 / 0.84 / +0.6%
tpch_q18/datafusion:parquet 120854412 / 121104227 / -0.2% 139281897 / 142447395 / -2.2% 0.87 / 0.85 / +2.1%
tpch_q19/datafusion:parquet 56399224 / 57774413 / -2.4% 80069626 / 82236501 / -2.6% 0.70 / 0.70 / +0.3%
tpch_q20/datafusion:parquet 78706441 / 78510463 / +0.2% 99782385 / 101516128 / -1.7% 0.79 / 0.77 / +2.0%
tpch_q21/datafusion:parquet 112836562 / 113088915 / -0.2% 138135096 / 139363438 / -0.9% 0.82 / 0.81 / +0.7%
tpch_q22/datafusion:parquet 52137526 / 51831048 / +0.6% 66301248 / 67131696 / -1.2% 0.79 / 0.77 / +1.9%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9686839 / 9046497 / +7.1% 21914179 / 20027987 / +9.4% 0.44 / 0.45 / -2.1%
tpch_q02/duckdb:vortex-file-compressed 15182116 / 15124900 / +0.4% 25516660 / 25341316 / +0.7% 0.59 / 0.60 / -0.3%
tpch_q03/duckdb:vortex-file-compressed 18750008 / 18447734 / +1.6% 34240061 / 34750008 / -1.5% 0.55 / 0.53 / +3.2%
tpch_q04/duckdb:vortex-file-compressed 12238153 / 12448707 / -1.7% 25386784 / 26846587 / -5.4% 0.48 / 0.46 / +4.0%
tpch_q05/duckdb:vortex-file-compressed 20199821 / 20254666 / -0.3% 35129594 / 35776065 / -1.8% 0.58 / 0.57 / +1.6%
tpch_q06/duckdb:vortex-file-compressed 4774414 / 4488820 / +6.4% 14806140 / 15022696 / -1.4% 0.32 / 0.30 / +7.9%
tpch_q07/duckdb:vortex-file-compressed 24136677 / 23909987 / +0.9% 38492335 / 41780280 / -7.9% 0.63 / 0.57 / +9.6%
tpch_q08/duckdb:vortex-file-compressed 21077585 / 20744171 / +1.6% 36401670 / 37318055 / -2.5% 0.58 / 0.56 / +4.2%
tpch_q09/duckdb:vortex-file-compressed 22353423 / 23055861 / -3.0% 39706868 / 38487753 / +3.2% 0.56 / 0.60 / -6.0%
tpch_q10/duckdb:vortex-file-compressed 26939709 / 26815462 / +0.5% 43143599 / 45530635 / -5.2% 0.62 / 0.59 / +6.0%
tpch_q11/duckdb:vortex-file-compressed 8046062 / 7968318 / +1.0% 16761468 / 18104165 / -7.4% 0.48 / 0.44 / +9.1%
tpch_q12/duckdb:vortex-file-compressed 14611487 / 14764927 / -1.0% 25872037 / 27095283 / -4.5% 0.56 / 0.54 / +3.6%
tpch_q13/duckdb:vortex-file-compressed 19625641 / 19378947 / +1.3% 32861341 / 31743144 / +3.5% 0.60 / 0.61 / -2.2%
tpch_q14/duckdb:vortex-file-compressed 11374367 / 11181264 / +1.7% 23453894 / 25354587 / -7.5% 0.48 / 0.44 / +10.0%
tpch_q15/duckdb:vortex-file-compressed 8376707 / 8381204 / -0.1% 18666235 / 20995174 / -11.1% 🟢 0.45 / 0.40 / +12.4%
tpch_q16/duckdb:vortex-file-compressed 16551835 / 16413233 / +0.8% 23151836 / 23979720 / -3.5% 0.71 / 0.68 / +4.5%
tpch_q17/duckdb:vortex-file-compressed 12976483 / 12592677 / +3.0% 27987553 / 28445363 / -1.6% 0.46 / 0.44 / +4.7%
tpch_q18/duckdb:vortex-file-compressed 24213645 / 24316808 / -0.4% 33531685 / 34951044 / -4.1% 0.72 / 0.70 / +3.8%
tpch_q19/duckdb:vortex-file-compressed 11135906 / 11426195 / -2.5% 25193051 / 25766839 / -2.2% 0.44 / 0.44 / -0.3%
tpch_q20/duckdb:vortex-file-compressed 14305892 / 14325643 / -0.1% 30172437 / 30552986 / -1.2% 0.47 / 0.47 / +1.1%
tpch_q21/duckdb:vortex-file-compressed 48828716 / 48281048 / +1.1% 64039194 / 66017908 / -3.0% 0.76 / 0.73 / +4.3%
tpch_q22/duckdb:vortex-file-compressed 16810174 / 16702790 / +0.6% 26011567 / 26800262 / -2.9% 0.65 / 0.62 / +3.7%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47570621 / 47547581 / +0.0% 53584951 / 54112740 / -1.0% 0.89 / 0.88 / +1.0%
tpch_q02/duckdb:parquet 48398047 / 48312217 / +0.2% 55280090 / 55151190 / +0.2% 0.88 / 0.88 / -0.1%
tpch_q03/duckdb:parquet 60373501 / 60217500 / +0.3% 67780537 / 69288935 / -2.2% 0.89 / 0.87 / +2.5%
tpch_q04/duckdb:parquet 34906919 / 34656547 / +0.7% 42631149 / 43053263 / -1.0% 0.82 / 0.80 / +1.7%
tpch_q05/duckdb:parquet 67241129 / 67091722 / +0.2% 76379687 / 77316587 / -1.2% 0.88 / 0.87 / +1.5%
tpch_q06/duckdb:parquet 21959583 / 21601570 / +1.7% 26982670 / 27249425 / -1.0% 0.81 / 0.79 / +2.7%
tpch_q07/duckdb:parquet 63529052 / 63799205 / -0.4% 73332448 / 72405251 / +1.3% 0.87 / 0.88 / -1.7%
tpch_q08/duckdb:parquet 75843060 / 75667269 / +0.2% 86519869 / 86769393 / -0.3% 0.88 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 107085477 / 107847179 / -0.7% 117721462 / 118570948 / -0.7% 0.91 / 0.91 / +0.0%
tpch_q10/duckdb:parquet 105597996 / 105720936 / -0.1% 116363654 / 117200993 / -0.7% 0.91 / 0.90 / +0.6%
tpch_q11/duckdb:parquet 29315573 / 29439572 / -0.4% 34887014 / 34922812 / -0.1% 0.84 / 0.84 / -0.3%
tpch_q12/duckdb:parquet 37158908 / 37121505 / +0.1% 43401062 / 43764563 / -0.8% 0.86 / 0.85 / +0.9%
tpch_q13/duckdb:parquet 175096830 / 174812670 / +0.2% 184539786 / 184970583 / -0.2% 0.95 / 0.95 / +0.4%
tpch_q14/duckdb:parquet 42402237 / 42356235 / +0.1% 50731895 / 51063051 / -0.6% 0.84 / 0.83 / +0.8%
tpch_q15/duckdb:parquet 32757041 / 32503990 / +0.8% 41040761 / 41334737 / -0.7% 0.80 / 0.79 / +1.5%
tpch_q16/duckdb:parquet 47670100 / 47147798 / +1.1% 52577105 / 52668299 / -0.2% 0.91 / 0.90 / +1.3%
tpch_q17/duckdb:parquet 47924716 / 47964459 / -0.1% 56955352 / 56795941 / +0.3% 0.84 / 0.84 / -0.4%
tpch_q18/duckdb:parquet 74498365 / 73982405 / +0.7% 81273224 / 80482798 / +1.0% 0.92 / 0.92 / -0.3%
tpch_q19/duckdb:parquet 48607460 / 49071842 / -0.9% 56351936 / 55601512 / +1.3% 0.86 / 0.88 / -2.3%
tpch_q20/duckdb:parquet 63525315 / 63412118 / +0.2% 73037870 / 73364368 / -0.4% 0.87 / 0.86 / +0.6%
tpch_q21/duckdb:parquet 106460176 / 106560704 / -0.1% 115728524 / 116038695 / -0.3% 0.92 / 0.92 / +0.2%
tpch_q22/duckdb:parquet 50840267 / 50470913 / +0.7% 58994464 / 59155611 / -0.3% 0.86 / 0.85 / +1.0%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 768b49f9 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.0%
Engines: DataFusion No clear signal (+4.1%, low confidence) · DuckDB No clear signal (+3.9%, low confidence)
Vortex (geomean): hot 1.035x ➖ · cold 0.971x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.960x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.043x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6141464 / 6250168 / -1.7% 19596161 / 19751173 / -0.8% 0.31 / 0.32 / -1.0%
fineweb_q01/datafusion:vortex-file-compressed 9496036 / 9285400 / +2.3% 36315077 / 35575139 / +2.1% 0.26 / 0.26 / +0.2%
fineweb_q02/datafusion:vortex-file-compressed 10994977 / 10567512 / +4.0% 39917431 / 40643432 / -1.8% 0.28 / 0.26 / +5.9%
fineweb_q03/datafusion:vortex-file-compressed 17776246 / 17539240 / +1.4% 101668369 / 102692107 / -1.0% 0.17 / 0.17 / +2.4%
fineweb_q04/datafusion:vortex-file-compressed 65938924 / 64090120 / +2.9% 135502499 / 144508483 / -6.2% 0.49 / 0.44 / +9.7%
fineweb_q05/datafusion:vortex-file-compressed 62543640 / 63203121 / -1.0% 138444052 / 139485427 / -0.7% 0.45 / 0.45 / -0.3%
fineweb_q06/datafusion:vortex-file-compressed 16764049 / 17269226 / -2.9% 96636768 / 106346388 / -9.1% 0.17 / 0.16 / +6.8%
fineweb_q07/datafusion:vortex-file-compressed 17150340 / 16748794 / +2.4% 97735319 / 103498538 / -5.6% 0.18 / 0.16 / +8.4%
fineweb_q08/datafusion:vortex-file-compressed 11470988 / 8455804 / +35.7% 🔴 30163174 / 26524896 / +13.7% 🔴 0.38 / 0.32 / +19.3%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9504722 / 9321344 / +2.0% 32273357 / 32543553 / -0.8% 0.29 / 0.29 / +2.8%
fineweb_q01/datafusion:parquet 74619835 / 75943192 / -1.7% 146760196 / 168115168 / -12.7% 🟢 0.51 / 0.45 / +12.6%
fineweb_q02/datafusion:parquet 74297193 / 75797688 / -2.0% 144626677 / 156430678 / -7.5% 0.51 / 0.48 / +6.0%
fineweb_q03/datafusion:parquet 75695376 / 73828035 / +2.5% 142471940 / 151042261 / -5.7% 0.53 / 0.49 / +8.7%
fineweb_q04/datafusion:parquet 82581136 / 82454360 / +0.2% 139722195 / 161665686 / -13.6% 🟢 0.59 / 0.51 / +15.9%
fineweb_q05/datafusion:parquet 80966828 / 81339953 / -0.5% 146490855 / 155427779 / -5.7% 0.55 / 0.52 / +5.6%
fineweb_q06/datafusion:parquet 74914349 / 76823475 / -2.5% 150966505 / 164720545 / -8.3% 0.50 / 0.47 / +6.4%
fineweb_q07/datafusion:parquet 74579122 / 73784924 / +1.1% 147160692 / 154776922 / -4.9% 0.51 / 0.48 / +6.3%
fineweb_q08/datafusion:parquet 75773060 / 73667172 / +2.9% 143305595 / 153339658 / -6.5% 0.53 / 0.48 / +10.1%
duckdb / vortex-file-compressed / ns (1.027x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2052084 / 2129396 / -3.6% 7187622 / 8430467 / -14.7% 🟢 0.29 / 0.25 / +13.0%
fineweb_q01/duckdb:vortex-file-compressed 7785612 / 7609840 / +2.3% 25571201 / 27699884 / -7.7% 0.30 / 0.27 / +10.8%
fineweb_q02/duckdb:vortex-file-compressed 9149072 / 8999654 / +1.7% 29906478 / 32238453 / -7.2% 0.31 / 0.28 / +9.6%
fineweb_q03/duckdb:vortex-file-compressed 18587106 / 17999961 / +3.3% 86260924 / 89729159 / -3.9% 0.22 / 0.20 / +7.4%
fineweb_q04/duckdb:vortex-file-compressed 64891282 / 64895256 / -0.0% 102435205 / 105319449 / -2.7% 0.63 / 0.62 / +2.8%
fineweb_q05/duckdb:vortex-file-compressed 65232164 / 64576607 / +1.0% 100203927 / 100642505 / -0.4% 0.65 / 0.64 / +1.5%
fineweb_q06/duckdb:vortex-file-compressed 17968477 / 17451004 / +3.0% 88218351 / 90997772 / -3.1% 0.20 / 0.19 / +6.2%
fineweb_q07/duckdb:vortex-file-compressed 17851666 / 17567882 / +1.6% 87639817 / 90262327 / -2.9% 0.20 / 0.19 / +4.7%
fineweb_q08/duckdb:vortex-file-compressed 5196526 / 4479276 / +16.0% 🔴 13050973 / 12680631 / +2.9% 0.40 / 0.35 / +12.7%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22828706 / 23575786 / -3.2% 27565205 / 27901054 / -1.2% 0.83 / 0.84 / -2.0%
fineweb_q01/duckdb:parquet 53289386 / 53435612 / -0.3% 76191884 / 71035947 / +7.3% 0.70 / 0.75 / -7.0%
fineweb_q02/duckdb:parquet 57118920 / 58133262 / -1.7% 72625575 / 71614459 / +1.4% 0.79 / 0.81 / -3.1%
fineweb_q03/duckdb:parquet 117460236 / 119431288 / -1.7% 166048103 / 174813976 / -5.0% 0.71 / 0.68 / +3.5%
fineweb_q04/duckdb:parquet 161301445 / 160054805 / +0.8% 199935752 / 201506963 / -0.8% 0.81 / 0.79 / +1.6%
fineweb_q05/duckdb:parquet 159631958 / 159362006 / +0.2% 199348106 / 199292933 / +0.0% 0.80 / 0.80 / +0.1%
fineweb_q06/duckdb:parquet 86283937 / 88786282 / -2.8% 140274173 / 152544283 / -8.0% 0.62 / 0.58 / +5.7%
fineweb_q07/duckdb:parquet 89400498 / 90890989 / -1.6% 145773383 / 143350764 / +1.7% 0.61 / 0.63 / -3.3%
fineweb_q08/duckdb:parquet 28987996 / 28981936 / +0.0% 30453938 / 30002232 / +1.5% 0.95 / 0.97 / -1.5%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 768b49f9 vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.021x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.025x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91035241 / 92177346 / -1.2% 160428104 / 156197099 / +2.7% 0.57 / 0.59 / -3.8%
tpch_q02/datafusion:vortex-file-compressed 67020831 / 64428754 / +4.0% 95292220 / 94872596 / +0.4% 0.70 / 0.68 / +3.6%
tpch_q03/datafusion:vortex-file-compressed 62557964 / 64151894 / -2.5% 125143571 / 126780702 / -1.3% 0.50 / 0.51 / -1.2%
tpch_q04/datafusion:vortex-file-compressed 33663772 / 35028676 / -3.9% 70808621 / 68466710 / +3.4% 0.48 / 0.51 / -7.1%
tpch_q05/datafusion:vortex-file-compressed 119824220 / 118900162 / +0.8% 200517599 / 185439522 / +8.1% 0.60 / 0.64 / -6.8%
tpch_q06/datafusion:vortex-file-compressed 10212174 / 9649196 / +5.8% 57529395 / 57652551 / -0.2% 0.18 / 0.17 / +6.1%
tpch_q07/datafusion:vortex-file-compressed 95471984 / 97449767 / -2.0% 158230027 / 161011516 / -1.7% 0.60 / 0.61 / -0.3%
tpch_q08/datafusion:vortex-file-compressed 141756882 / 142206475 / -0.3% 210565148 / 226695985 / -7.1% 0.67 / 0.63 / +7.3%
tpch_q09/datafusion:vortex-file-compressed 186276140 / 182840408 / +1.9% 268935050 / 275147335 / -2.3% 0.69 / 0.66 / +4.2%
tpch_q10/datafusion:vortex-file-compressed 70273288 / 70621645 / -0.5% 133735678 / 136262721 / -1.9% 0.53 / 0.52 / +1.4%
tpch_q11/datafusion:vortex-file-compressed 45492536 / 45658051 / -0.4% 73316297 / 72364105 / +1.3% 0.62 / 0.63 / -1.7%
tpch_q12/datafusion:vortex-file-compressed 35943889 / 35235879 / +2.0% 79829194 / 79705799 / +0.2% 0.45 / 0.44 / +1.9%
tpch_q13/datafusion:vortex-file-compressed 48216022 / 48598467 / -0.8% 88018586 / 87210304 / +0.9% 0.55 / 0.56 / -1.7%
tpch_q14/datafusion:vortex-file-compressed 20114881 / 20650370 / -2.6% 87278913 / 88048054 / -0.9% 0.23 / 0.23 / -1.7%
tpch_q15/datafusion:vortex-file-compressed 32828180 / 33753614 / -2.7% 94975306 / 90785220 / +4.6% 0.35 / 0.37 / -7.0%
tpch_q16/datafusion:vortex-file-compressed 36823092 / 36919743 / -0.3% 63740066 / 65843812 / -3.2% 0.58 / 0.56 / +3.0%
tpch_q17/datafusion:vortex-file-compressed 181953636 / 176998771 / +2.8% 221620232 / 239755261 / -7.6% 0.82 / 0.74 / +11.2%
tpch_q18/datafusion:vortex-file-compressed 202948369 / 207996354 / -2.4% 270737949 / 275106107 / -1.6% 0.75 / 0.76 / -0.9%
tpch_q19/datafusion:vortex-file-compressed 28015776 / 28526869 / -1.8% 90156678 / 87666580 / +2.8% 0.31 / 0.33 / -4.5%
tpch_q20/datafusion:vortex-file-compressed 60750631 / 61936223 / -1.9% 118806638 / 118852369 / -0.0% 0.51 / 0.52 / -1.9%
tpch_q21/datafusion:vortex-file-compressed 179212976 / 182704046 / -1.9% 237834763 / 234984863 / +1.2% 0.75 / 0.78 / -3.1%
tpch_q22/datafusion:vortex-file-compressed 25106937 / 25513774 / -1.6% 53095633 / 55406439 / -4.2% 0.47 / 0.46 / +2.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86719867 / 87311538 / -0.7% 124389014 / 122516163 / +1.5% 0.70 / 0.71 / -2.2%
tpch_q02/datafusion:parquet 174110062 / 174735537 / -0.4% 197737329 / 198265824 / -0.3% 0.88 / 0.88 / -0.1%
tpch_q03/datafusion:parquet 135426806 / 135233090 / +0.1% 183557742 / 179364012 / +2.3% 0.74 / 0.75 / -2.1%
tpch_q04/datafusion:parquet 57166948 / 56985913 / +0.3% 95385769 / 85885070 / +11.1% 🔴 0.60 / 0.66 / -9.7%
tpch_q05/datafusion:parquet 166440768 / 166291221 / +0.1% 226509900 / 214896169 / +5.4% 0.73 / 0.77 / -5.0%
tpch_q06/datafusion:parquet 36345854 / 36510562 / -0.5% 75399814 / 72908306 / +3.4% 0.48 / 0.50 / -3.7%
tpch_q07/datafusion:parquet 215553534 / 215778947 / -0.1% 275796635 / 260314182 / +5.9% 0.78 / 0.83 / -5.7%
tpch_q08/datafusion:parquet 218268309 / 216791369 / +0.7% 285323303 / 278971702 / +2.3% 0.76 / 0.78 / -1.6%
tpch_q09/datafusion:parquet 309753571 / 307685989 / +0.7% 380274420 / 369588127 / +2.9% 0.81 / 0.83 / -2.2%
tpch_q10/datafusion:parquet 311583993 / 311954014 / -0.1% 370608326 / 359417304 / +3.1% 0.84 / 0.87 / -3.1%
tpch_q11/datafusion:parquet 126751223 / 127035714 / -0.2% 151012812 / 149936598 / +0.7% 0.84 / 0.85 / -0.9%
tpch_q12/datafusion:parquet 82091454 / 82433202 / -0.4% 116767330 / 116835758 / -0.1% 0.70 / 0.71 / -0.4%
tpch_q13/datafusion:parquet 210326222 / 210618688 / -0.1% 241022811 / 238788117 / +0.9% 0.87 / 0.88 / -1.1%
tpch_q14/datafusion:parquet 86451637 / 85602024 / +1.0% 188583272 / 186569859 / +1.1% 0.46 / 0.46 / -0.1%
tpch_q15/datafusion:parquet 105870434 / 106606603 / -0.7% 154520833 / 154598932 / -0.1% 0.69 / 0.69 / -0.6%
tpch_q16/datafusion:parquet 95142958 / 94683007 / +0.5% 120709118 / 123221265 / -2.0% 0.79 / 0.77 / +2.6%
tpch_q17/datafusion:parquet 215300410 / 215630850 / -0.2% 262257965 / 257798988 / +1.7% 0.82 / 0.84 / -1.9%
tpch_q18/datafusion:parquet 267471488 / 267541314 / -0.0% 326901023 / 318452912 / +2.7% 0.82 / 0.84 / -2.6%
tpch_q19/datafusion:parquet 108551649 / 108282497 / +0.2% 164767923 / 164045798 / +0.4% 0.66 / 0.66 / -0.2%
tpch_q20/datafusion:parquet 185156410 / 185298197 / -0.1% 242737222 / 237189433 / +2.3% 0.76 / 0.78 / -2.4%
tpch_q21/datafusion:parquet 242013521 / 244268713 / -0.9% 308246487 / 306493573 / +0.6% 0.79 / 0.80 / -1.5%
tpch_q22/datafusion:parquet 150087462 / 149723897 / +0.2% 174295467 / 171986203 / +1.3% 0.86 / 0.87 / -1.1%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33410973 / 33162813 / +0.7% 71900913 / 60965941 / +17.9% 🔴 0.46 / 0.54 / -14.6%
tpch_q02/duckdb:vortex-file-compressed 28718799 / 28441284 / +1.0% 43009191 / 42490796 / +1.2% 0.67 / 0.67 / -0.2%
tpch_q03/duckdb:vortex-file-compressed 52360274 / 51806352 / +1.1% 106169058 / 96181102 / +10.4% 🔴 0.49 / 0.54 / -8.4%
tpch_q04/duckdb:vortex-file-compressed 51195791 / 51520893 / -0.6% 90421964 / 83080389 / +8.8% 0.57 / 0.62 / -8.7%
tpch_q05/duckdb:vortex-file-compressed 68567940 / 68278233 / +0.4% 112180000 / 110549285 / +1.5% 0.61 / 0.62 / -1.0%
tpch_q06/duckdb:vortex-file-compressed 14559236 / 14995905 / -2.9% 52391043 / 49678736 / +5.5% 0.28 / 0.30 / -7.9%
tpch_q07/duckdb:vortex-file-compressed 53841512 / 55095502 / -2.3% 108117215 / 99927713 / +8.2% 0.50 / 0.55 / -9.7%
tpch_q08/duckdb:vortex-file-compressed 85502571 / 84730600 / +0.9% 130147372 / 128300677 / +1.4% 0.66 / 0.66 / -0.5%
tpch_q09/duckdb:vortex-file-compressed 102723877 / 102680463 / +0.0% 155442495 / 149752209 / +3.8% 0.66 / 0.69 / -3.6%
tpch_q10/duckdb:vortex-file-compressed 95230963 / 95736829 / -0.5% 152745781 / 145772381 / +4.8% 0.62 / 0.66 / -5.1%
tpch_q11/duckdb:vortex-file-compressed 13442579 / 13161487 / +2.1% 28920033 / 28614710 / +1.1% 0.46 / 0.46 / +1.1%
tpch_q12/duckdb:vortex-file-compressed 44854187 / 45171630 / -0.7% 83547585 / 74559415 / +12.1% 🔴 0.54 / 0.61 / -11.4%
tpch_q13/duckdb:vortex-file-compressed 71816553 / 71277113 / +0.8% 98983344 / 98751212 / +0.2% 0.73 / 0.72 / +0.5%
tpch_q14/duckdb:vortex-file-compressed 27816059 / 27742167 / +0.3% 73718661 / 68588058 / +7.5% 0.38 / 0.40 / -6.7%
tpch_q15/duckdb:vortex-file-compressed 23839925 / 24169914 / -1.4% 64555785 / 62760479 / +2.9% 0.37 / 0.39 / -4.1%
tpch_q16/duckdb:vortex-file-compressed 48251473 / 49823920 / -3.2% 57735949 / 58191998 / -0.8% 0.84 / 0.86 / -2.4%
tpch_q17/duckdb:vortex-file-compressed 35805136 / 34928738 / +2.5% 68042714 / 64550565 / +5.4% 0.53 / 0.54 / -2.8%
tpch_q18/duckdb:vortex-file-compressed 108481564 / 102866087 / +5.5% 119711119 / 121696816 / -1.6% 0.91 / 0.85 / +7.2%
tpch_q19/duckdb:vortex-file-compressed 27675144 / 27489534 / +0.7% 77164417 / 76106199 / +1.4% 0.36 / 0.36 / -0.7%
tpch_q20/duckdb:vortex-file-compressed 41611566 / 41385355 / +0.5% 92396092 / 88937430 / +3.9% 0.45 / 0.47 / -3.2%
tpch_q21/duckdb:vortex-file-compressed 93846669 / 92643489 / +1.3% 145616071 / 140692444 / +3.5% 0.64 / 0.66 / -2.1%
tpch_q22/duckdb:vortex-file-compressed 33217156 / 33019958 / +0.6% 49777155 / 47168881 / +5.5% 0.67 / 0.70 / -4.7%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67491026 / 68061708 / -0.8% 95507007 / 88188170 / +8.3% 0.71 / 0.77 / -8.4%
tpch_q02/duckdb:parquet 86527812 / 87254980 / -0.8% 97894078 / 98880371 / -1.0% 0.88 / 0.88 / +0.2%
tpch_q03/duckdb:parquet 109528642 / 110221645 / -0.6% 144962759 / 141238280 / +2.6% 0.76 / 0.78 / -3.2%
tpch_q04/duckdb:parquet 76237576 / 76532636 / -0.4% 101222406 / 97762896 / +3.5% 0.75 / 0.78 / -3.8%
tpch_q05/duckdb:parquet 123367168 / 123479542 / -0.1% 156898158 / 155668079 / +0.8% 0.79 / 0.79 / -0.9%
tpch_q06/duckdb:parquet 35658070 / 35931981 / -0.8% 62423443 / 56977323 / +9.6% 0.57 / 0.63 / -9.4%
tpch_q07/duckdb:parquet 116883491 / 119339250 / -2.1% 153639454 / 153627189 / +0.0% 0.76 / 0.78 / -2.1%
tpch_q08/duckdb:parquet 147781738 / 147255450 / +0.4% 189328387 / 190628929 / -0.7% 0.78 / 0.77 / +1.0%
tpch_q09/duckdb:parquet 237626515 / 235578554 / +0.9% 284061587 / 276803702 / +2.6% 0.84 / 0.85 / -1.7%
tpch_q10/duckdb:parquet 313093604 / 313587478 / -0.2% 341331389 / 337403692 / +1.2% 0.92 / 0.93 / -1.3%
tpch_q11/duckdb:parquet 43410887 / 43490479 / -0.2% 50750276 / 50005616 / +1.5% 0.86 / 0.87 / -1.6%
tpch_q12/duckdb:parquet 70546499 / 70505417 / +0.1% 92326003 / 90007679 / +2.6% 0.76 / 0.78 / -2.5%
tpch_q13/duckdb:parquet 291647066 / 293441858 / -0.6% 309136403 / 310736944 / -0.5% 0.94 / 0.94 / -0.1%
tpch_q14/duckdb:parquet 102108611 / 101133653 / +1.0% 142339170 / 136327535 / +4.4% 0.72 / 0.74 / -3.3%
tpch_q15/duckdb:parquet 57428338 / 57306184 / +0.2% 87164865 / 84972419 / +2.6% 0.66 / 0.67 / -2.3%
tpch_q16/duckdb:parquet 100264651 / 100633707 / -0.4% 107227512 / 107203047 / +0.0% 0.94 / 0.94 / -0.4%
tpch_q17/duckdb:parquet 83856929 / 83962666 / -0.1% 128368451 / 110031995 / +16.7% 🔴 0.65 / 0.76 / -14.4%
tpch_q18/duckdb:parquet 160745941 / 157083225 / +2.3% 174678870 / 172862922 / +1.1% 0.92 / 0.91 / +1.3%
tpch_q19/duckdb:parquet 96830155 / 98792583 / -2.0% 134950677 / 130377546 / +3.5% 0.72 / 0.76 / -5.3%
tpch_q20/duckdb:parquet 147175780 / 146971997 / +0.1% 184729775 / 181619680 / +1.7% 0.80 / 0.81 / -1.5%
tpch_q21/duckdb:parquet 251012546 / 254756250 / -1.5% 278858843 / 271034790 / +2.9% 0.90 / 0.94 / -4.2%
tpch_q22/duckdb:parquet 167934580 / 168406469 / -0.3% 180015514 / 179252698 / +0.4% 0.93 / 0.94 / -0.7%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 768b49f9 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.0%
Engines: DataFusion No clear signal (-7.5%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.955x ➖ · cold 0.951x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.919x ➖, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1292414 / 1277762 / +1.1% 22311418 / 22701905 / -1.7% 0.06 / 0.06 / +2.9%
clickbench_q01/datafusion:vortex-file-compressed 5597772 / 5701054 / -1.8% 33689453 / 34133473 / -1.3% 0.17 / 0.17 / -0.5%
clickbench_q02/datafusion:vortex-file-compressed 10227286 / 11059978 / -7.5% 43712754 / 45727346 / -4.4% 0.23 / 0.24 / -3.3%
clickbench_q03/datafusion:vortex-file-compressed 12977974 / 12962152 / +0.1% 54601191 / 59966511 / -8.9% 0.24 / 0.22 / +10.0%
clickbench_q04/datafusion:vortex-file-compressed 58041490 / 58491492 / -0.8% 104353590 / 107265399 / -2.7% 0.56 / 0.55 / +2.0%
clickbench_q05/datafusion:vortex-file-compressed 80272126 / 75324188 / +6.6% 122620128 / 127176489 / -3.6% 0.65 / 0.59 / +10.5%
clickbench_q06/datafusion:vortex-file-compressed 1264538 / 1281209 / -1.3% 21469091 / 22762946 / -5.7% 0.06 / 0.06 / +4.6%
clickbench_q07/datafusion:vortex-file-compressed 9082880 / 9121962 / -0.4% 34368889 / 36679638 / -6.3% 0.26 / 0.25 / +6.3%
clickbench_q08/datafusion:vortex-file-compressed 79644276 / 79202689 / +0.6% 122265036 / 130034036 / -6.0% 0.65 / 0.61 / +6.9%
clickbench_q09/datafusion:vortex-file-compressed 168062650 / 169891930 / -1.1% 207053733 / 215849640 / -4.1% 0.81 / 0.79 / +3.1%
clickbench_q10/datafusion:vortex-file-compressed 22770482 / 23576041 / -3.4% 68186236 / 71620517 / -4.8% 0.33 / 0.33 / +1.4%
clickbench_q11/datafusion:vortex-file-compressed 24796456 / 25595211 / -3.1% 69351771 / 73456297 / -5.6% 0.36 / 0.35 / +2.6%
clickbench_q12/datafusion:vortex-file-compressed 72472766 / 72340317 / +0.2% 117815731 / 126525748 / -6.9% 0.62 / 0.57 / +7.6%
clickbench_q13/datafusion:vortex-file-compressed 116615294 / 114454353 / +1.9% 183918188 / 187159194 / -1.7% 0.63 / 0.61 / +3.7%
clickbench_q14/datafusion:vortex-file-compressed 75637043 / 75015054 / +0.8% 125580727 / 128127094 / -2.0% 0.60 / 0.59 / +2.9%
clickbench_q15/datafusion:vortex-file-compressed 64424674 / 63035252 / +2.2% 100175030 / 102527113 / -2.3% 0.64 / 0.61 / +4.6%
clickbench_q16/datafusion:vortex-file-compressed 153840757 / 154339830 / -0.3% 212003880 / 220216995 / -3.7% 0.73 / 0.70 / +3.5%
clickbench_q17/datafusion:vortex-file-compressed 151429848 / 153975190 / -1.7% 223331398 / 221571282 / +0.8% 0.68 / 0.69 / -2.4%
clickbench_q18/datafusion:vortex-file-compressed 290409340 / 297646745 / -2.4% 375940678 / 388335753 / -3.2% 0.77 / 0.77 / +0.8%
clickbench_q19/datafusion:vortex-file-compressed 7456814 / 7750414 / -3.8% 45275025 / 48721099 / -7.1% 0.16 / 0.16 / +3.5%
clickbench_q20/datafusion:vortex-file-compressed 65704444 / 68136855 / -3.6% 243699597 / 256425057 / -5.0% 0.27 / 0.27 / +1.5%
clickbench_q21/datafusion:vortex-file-compressed 77401118 / 80037805 / -3.3% 287344857 / 300737630 / -4.5% 0.27 / 0.27 / +1.2%
clickbench_q22/datafusion:vortex-file-compressed 90227346 / 95054287 / -5.1% 390358178 / 395336147 / -1.3% 0.23 / 0.24 / -3.9%
clickbench_q23/datafusion:vortex-file-compressed 65759622 / 80171206 / -18.0% 🟢 423823582 / 416246090 / +1.8% 0.16 / 0.19 / -19.4%
clickbench_q24/datafusion:vortex-file-compressed 8496911 / 8409700 / +1.0% 55130056 / 57093319 / -3.4% 0.15 / 0.15 / +4.6%
clickbench_q25/datafusion:vortex-file-compressed 19112456 / 18152158 / +5.3% 60929632 / 63410099 / -3.9% 0.31 / 0.29 / +9.6%
clickbench_q26/datafusion:vortex-file-compressed 14719534 / 15624998 / -5.8% 57867333 / 69615012 / -16.9% 🟢 0.25 / 0.22 / +13.3%
clickbench_q27/datafusion:vortex-file-compressed 98748483 / 100553100 / -1.8% 259223734 / 266070098 / -2.6% 0.38 / 0.38 / +0.8%
clickbench_q28/datafusion:vortex-file-compressed 559835662 / 561882003 / -0.4% 644026211 / 634483917 / +1.5% 0.87 / 0.89 / -1.8%
clickbench_q29/datafusion:vortex-file-compressed 24420934 / 24813306 / -1.6% 55861130 / 53938850 / +3.6% 0.44 / 0.46 / -5.0%
clickbench_q30/datafusion:vortex-file-compressed 56248228 / 54469824 / +3.3% 106825001 / 110322321 / -3.2% 0.53 / 0.49 / +6.6%
clickbench_q31/datafusion:vortex-file-compressed 65611310 / 63713036 / +3.0% 153443996 / 165094546 / -7.1% 0.43 / 0.39 / +10.8%
clickbench_q32/datafusion:vortex-file-compressed 286303948 / 287471359 / -0.4% 379785681 / 395194655 / -3.9% 0.75 / 0.73 / +3.6%
clickbench_q33/datafusion:vortex-file-compressed 317908118 / 318812426 / -0.3% 430270113 / 434359824 / -0.9% 0.74 / 0.73 / +0.7%
clickbench_q34/datafusion:vortex-file-compressed 322249774 / 319825400 / +0.8% 431276990 / 438643717 / -1.7% 0.75 / 0.73 / +2.5%
clickbench_q35/datafusion:vortex-file-compressed 57427852 / 56594294 / +1.5% 89166227 / 89838837 / -0.7% 0.64 / 0.63 / +2.2%
clickbench_q36/datafusion:vortex-file-compressed 14560689 / 37371240 / -61.0% 🟢 44457916 / 69504069 / -36.0% 🟢 0.33 / 0.54 / -39.1%
clickbench_q37/datafusion:vortex-file-compressed 9997060 / 20731798 / -51.8% 🟢 35564771 / 48713358 / -27.0% 🟢 0.28 / 0.43 / -34.0%
clickbench_q38/datafusion:vortex-file-compressed 10784921 / 12866674 / -16.2% 🟢 37913693 / 41261053 / -8.1% 0.28 / 0.31 / -8.8%
clickbench_q39/datafusion:vortex-file-compressed 23664796 / 78717482 / -69.9% 🟢 55411118 / 110822448 / -50.0% 🟢 0.43 / 0.71 / -39.9%
clickbench_q40/datafusion:vortex-file-compressed 9562984 / 10368860 / -7.8% 34565536 / 36576948 / -5.5% 0.28 / 0.28 / -2.4%
clickbench_q41/datafusion:vortex-file-compressed 9604708 / 9655634 / -0.5% 35876433 / 35212183 / +1.9% 0.27 / 0.27 / -2.4%
clickbench_q42/datafusion:vortex-file-compressed 9018037 / 9562990 / -5.7% 34779925 / 37134881 / -6.3% 0.26 / 0.26 / +0.7%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1242415 / 1245508 / -0.2% 49435697 / 49111389 / +0.7% 0.03 / 0.03 / -0.9%
clickbench_q01/datafusion:parquet 16203516 / 16128558 / +0.5% 69373194 / 65974016 / +5.2% 0.23 / 0.24 / -4.5%
clickbench_q02/datafusion:parquet 19309154 / 18679866 / +3.4% 83873918 / 81045048 / +3.5% 0.23 / 0.23 / -0.1%
clickbench_q03/datafusion:parquet 16867830 / 17636144 / -4.4% 80690841 / 78906984 / +2.3% 0.21 / 0.22 / -6.5%
clickbench_q04/datafusion:parquet 63174351 / 63147200 / +0.0% 127451872 / 123651426 / +3.1% 0.50 / 0.51 / -2.9%
clickbench_q05/datafusion:parquet 88136353 / 89173734 / -1.2% 153358851 / 155684349 / -1.5% 0.57 / 0.57 / +0.3%
clickbench_q06/datafusion:parquet 1268990 / 1267736 / +0.1% 49147288 / 49808656 / -1.3% 0.03 / 0.03 / +1.4%
clickbench_q07/datafusion:parquet 16934264 / 16815682 / +0.7% 69123310 / 68530680 / +0.9% 0.24 / 0.25 / -0.2%
clickbench_q08/datafusion:parquet 84879985 / 84420552 / +0.5% 173338626 / 159615748 / +8.6% 0.49 / 0.53 / -7.4%
clickbench_q09/datafusion:parquet 186775156 / 189340200 / -1.4% 261728557 / 270568486 / -3.3% 0.71 / 0.70 / +2.0%
clickbench_q10/datafusion:parquet 35895054 / 35838825 / +0.2% 97899518 / 101351871 / -3.4% 0.37 / 0.35 / +3.7%
clickbench_q11/datafusion:parquet 43013908 / 43388606 / -0.9% 108612520 / 110234963 / -1.5% 0.40 / 0.39 / +0.6%
clickbench_q12/datafusion:parquet 94360292 / 96400254 / -2.1% 160657865 / 164380304 / -2.3% 0.59 / 0.59 / +0.2%
clickbench_q13/datafusion:parquet 146226602 / 149050407 / -1.9% 225485751 / 229020286 / -1.5% 0.65 / 0.65 / -0.4%
clickbench_q14/datafusion:parquet 100298114 / 101751008 / -1.4% 171026784 / 173752765 / -1.6% 0.59 / 0.59 / +0.1%
clickbench_q15/datafusion:parquet 71268294 / 74751018 / -4.7% 135337814 / 132562825 / +2.1% 0.53 / 0.56 / -6.6%
clickbench_q16/datafusion:parquet 155566248 / 157130106 / -1.0% 231655885 / 235404102 / -1.6% 0.67 / 0.67 / +0.6%
clickbench_q17/datafusion:parquet 155977190 / 158408130 / -1.5% 236136760 / 232535206 / +1.5% 0.66 / 0.68 / -3.0%
clickbench_q18/datafusion:parquet 310414226 / 311659828 / -0.4% 416541915 / 428769037 / -2.9% 0.75 / 0.73 / +2.5%
clickbench_q19/datafusion:parquet 19187715 / 18808941 / +2.0% 77552188 / 76943382 / +0.8% 0.25 / 0.24 / +1.2%
clickbench_q20/datafusion:parquet 177726648 / 178190524 / -0.3% 273081246 / 283067790 / -3.5% 0.65 / 0.63 / +3.4%
clickbench_q21/datafusion:parquet 173241038 / 174542982 / -0.7% 293240644 / 303338278 / -3.3% 0.59 / 0.58 / +2.7%
clickbench_q22/datafusion:parquet 260774878 / 260781561 / -0.0% 413811978 / 433914101 / -4.6% 0.63 / 0.60 / +4.9%
clickbench_q23/datafusion:parquet 1013710560 / 1007396844 / +0.6% 1183043229 / 1196675958 / -1.1% 0.86 / 0.84 / +1.8%
clickbench_q24/datafusion:parquet 29580678 / 30726530 / -3.7% 87708215 / 88445505 / -0.8% 0.34 / 0.35 / -2.9%
clickbench_q25/datafusion:parquet 36847527 / 37097776 / -0.7% 95633822 / 103458997 / -7.6% 0.39 / 0.36 / +7.5%
clickbench_q26/datafusion:parquet 30580990 / 30667637 / -0.3% 87546262 / 89958756 / -2.7% 0.35 / 0.34 / +2.5%
clickbench_q27/datafusion:parquet 192320486 / 193541858 / -0.6% 281794355 / 294014301 / -4.2% 0.68 / 0.66 / +3.7%
clickbench_q28/datafusion:parquet 625854179 / 622381386 / +0.6% 691757453 / 709605194 / -2.5% 0.90 / 0.88 / +3.2%
clickbench_q29/datafusion:parquet 28496862 / 28382270 / +0.4% 90045619 / 89726118 / +0.4% 0.32 / 0.32 / +0.0%
clickbench_q30/datafusion:parquet 90744468 / 90292652 / +0.5% 167612179 / 173921114 / -3.6% 0.54 / 0.52 / +4.3%
clickbench_q31/datafusion:parquet 102156484 / 103509501 / -1.3% 185531773 / 200971596 / -7.7% 0.55 / 0.52 / +6.9%
clickbench_q32/datafusion:parquet 309889169 / 311115870 / -0.4% 419865144 / 428727602 / -2.1% 0.74 / 0.73 / +1.7%
clickbench_q33/datafusion:parquet 377968499 / 380048496 / -0.5% 469152602 / 479600127 / -2.2% 0.81 / 0.79 / +1.7%
clickbench_q34/datafusion:parquet 377621692 / 378557524 / -0.2% 474683839 / 477936899 / -0.7% 0.80 / 0.79 / +0.4%
clickbench_q35/datafusion:parquet 63862168 / 64249088 / -0.6% 128579151 / 123443405 / +4.2% 0.50 / 0.52 / -4.6%
clickbench_q36/datafusion:parquet 73766072 / 73977852 / -0.3% 134382243 / 136178878 / -1.3% 0.55 / 0.54 / +1.0%
clickbench_q37/datafusion:parquet 35648750 / 35633496 / +0.0% 90679593 / 91419997 / -0.8% 0.39 / 0.39 / +0.9%
clickbench_q38/datafusion:parquet 47730010 / 47903072 / -0.4% 105832639 / 108411604 / -2.4% 0.45 / 0.44 / +2.1%
clickbench_q39/datafusion:parquet 143231147 / 144526362 / -0.9% 205800720 / 212015185 / -2.9% 0.70 / 0.68 / +2.1%
clickbench_q40/datafusion:parquet 19826262 / 20349552 / -2.6% 75670459 / 77770096 / -2.7% 0.26 / 0.26 / +0.1%
clickbench_q41/datafusion:parquet 18693580 / 18824178 / -0.7% 75394540 / 74972994 / +0.6% 0.25 / 0.25 / -1.2%
clickbench_q42/datafusion:parquet 19185943 / 19068224 / +0.6% 74099267 / 75207188 / -1.5% 0.26 / 0.25 / +2.1%
duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2202608 / 2239520 / -1.6% 24644868 / 25410828 / -3.0% 0.09 / 0.09 / +1.4%
clickbench_q01/duckdb:vortex-file-compressed 7228116 / 7612362 / -5.0% 27630005 / 27570446 / +0.2% 0.26 / 0.28 / -5.3%
clickbench_q02/duckdb:vortex-file-compressed 9114862 / 8955066 / +1.8% 33827187 / 35286118 / -4.1% 0.27 / 0.25 / +6.2%
clickbench_q03/duckdb:vortex-file-compressed 13839462 / 14248936 / -2.9% 48154433 / 52216942 / -7.8% 0.29 / 0.27 / +5.3%
clickbench_q04/duckdb:vortex-file-compressed 58702139 / 58104275 / +1.0% 89900036 / 92470080 / -2.8% 0.65 / 0.63 / +3.9%
clickbench_q05/duckdb:vortex-file-compressed 64614342 / 64657906 / -0.1% 95935031 / 95177701 / +0.8% 0.67 / 0.68 / -0.9%
clickbench_q06/duckdb:vortex-file-compressed 2636050 / 2703474 / -2.5% 31623464 / 31007170 / +2.0% 0.08 / 0.09 / -4.4%
clickbench_q07/duckdb:vortex-file-compressed 8731558 / 9579114 / -8.8% 29182015 / 31815161 / -8.3% 0.30 / 0.30 / -0.6%
clickbench_q08/duckdb:vortex-file-compressed 68790593 / 69709164 / -1.3% 102326926 / 106513332 / -3.9% 0.67 / 0.65 / +2.7%
clickbench_q09/duckdb:vortex-file-compressed 91186448 / 91790526 / -0.7% 126141112 / 128038059 / -1.5% 0.72 / 0.72 / +0.8%
clickbench_q10/duckdb:vortex-file-compressed 27329736 / 27449552 / -0.4% 64759837 / 70633742 / -8.3% 0.42 / 0.39 / +8.6%
clickbench_q11/duckdb:vortex-file-compressed 29633565 / 29742802 / -0.4% 65977498 / 74580099 / -11.5% 🟢 0.45 / 0.40 / +12.6%
clickbench_q12/duckdb:vortex-file-compressed 67290740 / 68314645 / -1.5% 97228352 / 101588585 / -4.3% 0.69 / 0.67 / +2.9%
clickbench_q13/duckdb:vortex-file-compressed 117779713 / 117681350 / +0.1% 157792334 / 167304335 / -5.7% 0.75 / 0.70 / +6.1%
clickbench_q14/duckdb:vortex-file-compressed 73844341 / 71707574 / +3.0% 98251941 / 104097981 / -5.6% 0.75 / 0.69 / +9.1%
clickbench_q15/duckdb:vortex-file-compressed 75737322 / 76256368 / -0.7% 106036380 / 109430960 / -3.1% 0.71 / 0.70 / +2.5%
clickbench_q16/duckdb:vortex-file-compressed 133401796 / 136865666 / -2.5% 170602575 / 173157180 / -1.5% 0.78 / 0.79 / -1.1%
clickbench_q17/duckdb:vortex-file-compressed 142625880 / 136309250 / +4.6% 167212235 / 167679771 / -0.3% 0.85 / 0.81 / +4.9%
clickbench_q18/duckdb:vortex-file-compressed 255877812 / 253680418 / +0.9% 297684170 / 304490936 / -2.2% 0.86 / 0.83 / +3.2%
clickbench_q19/duckdb:vortex-file-compressed 9099305 / 9195282 / -1.0% 37560082 / 41073291 / -8.6% 0.24 / 0.22 / +8.2%
clickbench_q20/duckdb:vortex-file-compressed 67408148 / 68396690 / -1.4% 162571067 / 175446093 / -7.3% 0.41 / 0.39 / +6.4%
clickbench_q21/duckdb:vortex-file-compressed 77866545 / 78139710 / -0.3% 181956534 / 193510866 / -6.0% 0.43 / 0.40 / +6.0%
clickbench_q22/duckdb:vortex-file-compressed 128466740 / 130674448 / -1.7% 307009681 / 331574805 / -7.4% 0.42 / 0.39 / +6.2%
clickbench_q23/duckdb:vortex-file-compressed 60839289 / 59653655 / +2.0% 185682278 / 184899542 / +0.4% 0.33 / 0.32 / +1.6%
clickbench_q24/duckdb:vortex-file-compressed 16699948 / 17394194 / -4.0% 42718672 / 48703041 / -12.3% 🟢 0.39 / 0.36 / +9.5%
clickbench_q25/duckdb:vortex-file-compressed 18475499 / 18446944 / +0.2% 53018052 / 54178597 / -2.1% 0.35 / 0.34 / +2.3%
clickbench_q26/duckdb:vortex-file-compressed 13490254 / 14287748 / -5.6% 45551772 / 49047912 / -7.1% 0.30 / 0.29 / +1.7%
clickbench_q27/duckdb:vortex-file-compressed 53183606 / 53905176 / -1.3% 169748350 / 177354906 / -4.3% 0.31 / 0.30 / +3.1%
clickbench_q28/duckdb:vortex-file-compressed 511097515 / 514093187 / -0.6% 545000703 / 559504615 / -2.6% 0.94 / 0.92 / +2.1%
clickbench_q29/duckdb:vortex-file-compressed 17214578 / 17208508 / +0.0% 41105869 / 42958313 / -4.3% 0.42 / 0.40 / +4.5%
clickbench_q30/duckdb:vortex-file-compressed 59877300 / 59435691 / +0.7% 103629114 / 108956696 / -4.9% 0.58 / 0.55 / +5.9%
clickbench_q31/duckdb:vortex-file-compressed 108447652 / 109401092 / -0.9% 182969508 / 174239306 / +5.0% 0.59 / 0.63 / -5.6%
clickbench_q32/duckdb:vortex-file-compressed 379598328 / 385910546 / -1.6% 407066697 / 410231765 / -0.8% 0.93 / 0.94 / -0.9%
clickbench_q33/duckdb:vortex-file-compressed 345334829 / 342599656 / +0.8% 404334590 / 396100171 / +2.1% 0.85 / 0.86 / -1.3%
clickbench_q34/duckdb:vortex-file-compressed 360427295 / 353396204 / +2.0% 414983744 / 412222797 / +0.7% 0.87 / 0.86 / +1.3%
clickbench_q35/duckdb:vortex-file-compressed 57683891 / 57161666 / +0.9% 85318708 / 88929172 / -4.1% 0.68 / 0.64 / +5.2%
clickbench_q36/duckdb:vortex-file-compressed 10888276 / 11640787 / -6.5% 33219478 / 33117280 / +0.3% 0.33 / 0.35 / -6.8%
clickbench_q37/duckdb:vortex-file-compressed 7704230 / 7579217 / +1.6% 29781691 / 29023829 / +2.6% 0.26 / 0.26 / -0.9%
clickbench_q38/duckdb:vortex-file-compressed 8054834 / 8249762 / -2.4% 28184061 / 27872473 / +1.1% 0.29 / 0.30 / -3.4%
clickbench_q39/duckdb:vortex-file-compressed 18448101 / 18512246 / -0.3% 41972169 / 39648155 / +5.9% 0.44 / 0.47 / -5.9%
clickbench_q40/duckdb:vortex-file-compressed 6829524 / 6788686 / +0.6% 28927671 / 29122522 / -0.7% 0.24 / 0.23 / +1.3%
clickbench_q41/duckdb:vortex-file-compressed 7844661 / 7935220 / -1.1% 30104182 / 31671742 / -4.9% 0.26 / 0.25 / +4.0%
clickbench_q42/duckdb:vortex-file-compressed 7206790 / 7022668 / +2.6% 28017132 / 27458837 / +2.0% 0.26 / 0.26 / +0.6%
duckdb / parquet / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9568435 / 9394832 / +1.8% 14597205 / 14721122 / -0.8% 0.66 / 0.64 / +2.7%
clickbench_q01/duckdb:parquet 14574069 / 15255306 / -4.5% 20205937 / 20612271 / -2.0% 0.72 / 0.74 / -2.5%
clickbench_q02/duckdb:parquet 22136734 / 23202924 / -4.6% 30579292 / 34409503 / -11.1% 🟢 0.72 / 0.67 / +7.4%
clickbench_q03/duckdb:parquet 22439864 / 22805660 / -1.6% 36546277 / 37416814 / -2.3% 0.61 / 0.61 / +0.7%
clickbench_q04/duckdb:parquet 61376554 / 62729622 / -2.2% 70737152 / 74237821 / -4.7% 0.87 / 0.84 / +2.7%
clickbench_q05/duckdb:parquet 82782918 / 82553121 / +0.3% 95330288 / 95555827 / -0.2% 0.87 / 0.86 / +0.5%
clickbench_q06/duckdb:parquet 20951870 / 20223452 / +3.6% 25919904 / 27478087 / -5.7% 0.81 / 0.74 / +9.8%
clickbench_q07/duckdb:parquet 17070628 / 17993160 / -5.1% 23024444 / 22337709 / +3.1% 0.74 / 0.81 / -8.0%
clickbench_q08/duckdb:parquet 74125549 / 75074766 / -1.3% 88528810 / 93024452 / -4.8% 0.84 / 0.81 / +3.7%
clickbench_q09/duckdb:parquet 103408454 / 103794619 / -0.4% 122293388 / 121917219 / +0.3% 0.85 / 0.85 / -0.7%
clickbench_q10/duckdb:parquet 41256192 / 41383818 / -0.3% 55309564 / 53619651 / +3.2% 0.75 / 0.77 / -3.4%
clickbench_q11/duckdb:parquet 47170453 / 46643339 / +1.1% 63578701 / 61615297 / +3.2% 0.74 / 0.76 / -2.0%
clickbench_q12/duckdb:parquet 92320972 / 93595602 / -1.4% 106645114 / 108115697 / -1.4% 0.87 / 0.87 / -0.0%
clickbench_q13/duckdb:parquet 153123912 / 148244281 / +3.3% 171285737 / 168231324 / +1.8% 0.89 / 0.88 / +1.4%
clickbench_q14/duckdb:parquet 101308508 / 101682435 / -0.4% 117962609 / 114164311 / +3.3% 0.86 / 0.89 / -3.6%
clickbench_q15/duckdb:parquet 87352494 / 85946628 / +1.6% 101057489 / 100644448 / +0.4% 0.86 / 0.85 / +1.2%
clickbench_q16/duckdb:parquet 168730808 / 165498386 / +2.0% 177616482 / 179975882 / -1.3% 0.95 / 0.92 / +3.3%
clickbench_q17/duckdb:parquet 165699866 / 171531960 / -3.4% 179830372 / 178665714 / +0.7% 0.92 / 0.96 / -4.0%
clickbench_q18/duckdb:parquet 293332550 / 291016272 / +0.8% 318995741 / 315607081 / +1.1% 0.92 / 0.92 / -0.3%
clickbench_q19/duckdb:parquet 19868541 / 19859715 / +0.0% 25300246 / 25786255 / -1.9% 0.79 / 0.77 / +2.0%
clickbench_q20/duckdb:parquet 184516554 / 180420120 / +2.3% 227426076 / 232480084 / -2.2% 0.81 / 0.78 / +4.5%
clickbench_q21/duckdb:parquet 221535572 / 218477350 / +1.4% 273802442 / 262983512 / +4.1% 0.81 / 0.83 / -2.6%
clickbench_q22/duckdb:parquet 319356854 / 304926990 / +4.7% 354168541 / 357379579 / -0.9% 0.90 / 0.85 / +5.7%
clickbench_q23/duckdb:parquet 179522790 / 171775762 / +4.5% 237535863 / 253121056 / -6.2% 0.76 / 0.68 / +11.4%
clickbench_q24/duckdb:parquet 30152683 / 29958716 / +0.6% 44117972 / 42482462 / +3.8% 0.68 / 0.71 / -3.1%
clickbench_q25/duckdb:parquet 41839412 / 42463750 / -1.5% 57979622 / 60982131 / -4.9% 0.72 / 0.70 / +3.6%
clickbench_q26/duckdb:parquet 30092808 / 32739711 / -8.1% 49220345 / 47017556 / +4.7% 0.61 / 0.70 / -12.2%
clickbench_q27/duckdb:parquet 187208461 / 191541398 / -2.3% 230450544 / 230295986 / +0.1% 0.81 / 0.83 / -2.3%
clickbench_q28/duckdb:parquet 956000008 / 950006560 / +0.6% 942309993 / 983079731 / -4.1% 1.01 / 0.97 / +5.0%
clickbench_q29/duckdb:parquet 23861899 / 24317362 / -1.9% 30387533 / 30925214 / -1.7% 0.79 / 0.79 / -0.1%
clickbench_q30/duckdb:parquet 105257696 / 104622488 / +0.6% 127381895 / 129419189 / -1.6% 0.83 / 0.81 / +2.2%
clickbench_q31/duckdb:parquet 133067711 / 160480217 / -17.1% 🟢 171285368 / 174417616 / -1.8% 0.78 / 0.92 / -15.6%
clickbench_q32/duckdb:parquet 394608296 / 385925739 / +2.2% 414499496 / 407659843 / +1.7% 0.95 / 0.95 / +0.6%
clickbench_q33/duckdb:parquet 470705871 / 468922366 / +0.4% 463293218 / 442695781 / +4.7% 1.02 / 1.06 / -4.1%
clickbench_q34/duckdb:parquet 486797072 / 462238432 / +5.3% 464814486 / 447629696 / +3.8% 1.05 / 1.03 / +1.4%
clickbench_q35/duckdb:parquet 61305567 / 61543474 / -0.4% 76574429 / 77479685 / -1.2% 0.80 / 0.79 / +0.8%
clickbench_q36/duckdb:parquet 30058574 / 30172014 / -0.4% 35348337 / 36925558 / -4.3% 0.85 / 0.82 / +4.1%
clickbench_q37/duckdb:parquet 23079266 / 23204022 / -0.5% 29410835 / 30425350 / -3.3% 0.78 / 0.76 / +2.9%
clickbench_q38/duckdb:parquet 23630155 / 23431136 / +0.8% 29292678 / 30912378 / -5.2% 0.81 / 0.76 / +6.4%
clickbench_q39/duckdb:parquet 53113202 / 52956229 / +0.3% 59548742 / 60047399 / -0.8% 0.89 / 0.88 / +1.1%
clickbench_q40/duckdb:parquet 15018601 / 14924840 / +0.6% 19452567 / 20066747 / -3.1% 0.77 / 0.74 / +3.8%
clickbench_q41/duckdb:parquet 15411816 / 15331596 / +0.5% 20422347 / 23069987 / -11.5% 🟢 0.75 / 0.66 / +13.6%
clickbench_q42/duckdb:parquet 14392211 / 14130908 / +1.8% 20037172 / 20120985 / -0.4% 0.72 / 0.70 / +2.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 768b49f9 vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.7%
Engines: DataFusion No clear signal (+6.3%, environment too noisy confidence) · DuckDB No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): hot 1.067x ➖ · cold 1.046x ➖
Parquet (geomean): hot 1.040x ➖ · cold 1.043x ➖
Shifts: Parquet (control) +4.0% · Median polish +2.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.111x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 218728028 / 213717821 / +2.3% 611768521 / 764398977 / -20.0% 0.36 / 0.28 / +27.9%
tpch_q02/datafusion:vortex-file-compressed 344706509 / 320984758 / +7.4% 719916529 / 553448858 / +30.1% 🔴 0.48 / 0.58 / -17.4%
tpch_q03/datafusion:vortex-file-compressed 323472334 / 310450262 / +4.2% 898446708 / 854530904 / +5.1% 0.36 / 0.36 / -0.9%
tpch_q04/datafusion:vortex-file-compressed 180987874 / 159007585 / +13.8% 419664017 / 372572808 / +12.6% 0.43 / 0.43 / +1.1%
tpch_q05/datafusion:vortex-file-compressed 375763019 / 344078558 / +9.2% 686407772 / 546047746 / +25.7% 0.55 / 0.63 / -13.1%
tpch_q06/datafusion:vortex-file-compressed 136722319 / 123668516 / +10.6% 285365516 / 317073449 / -10.0% 0.48 / 0.39 / +22.8%
tpch_q07/datafusion:vortex-file-compressed 429366703 / 426177142 / +0.7% 731370407 / 586012416 / +24.8% 0.59 / 0.73 / -19.3%
tpch_q08/datafusion:vortex-file-compressed 446589982 / 410714646 / +8.7% 633720155 / 541459260 / +17.0% 0.70 / 0.76 / -7.1%
tpch_q09/datafusion:vortex-file-compressed 313002426 / 301899395 / +3.7% 472370063 / 455403137 / +3.7% 0.66 / 0.66 / -0.0%
tpch_q10/datafusion:vortex-file-compressed 404230783 / 361036359 / +12.0% 784884063 / 525406226 / +49.4% 🔴 0.52 / 0.69 / -25.1%
tpch_q11/datafusion:vortex-file-compressed 278864669 / 272228443 / +2.4% 503947364 / 382260665 / +31.8% 🔴 0.55 / 0.71 / -22.3%
tpch_q12/datafusion:vortex-file-compressed 198980506 / 203460731 / -2.2% 367192990 / 338106908 / +8.6% 0.54 / 0.60 / -9.9%
tpch_q13/datafusion:vortex-file-compressed 110267697 / 116217877 / -5.1% 341188972 / 309114444 / +10.4% 0.32 / 0.38 / -14.0%
tpch_q14/datafusion:vortex-file-compressed 186722708 / 181074526 / +3.1% 349767926 / 354128334 / -1.2% 0.53 / 0.51 / +4.4%
tpch_q15/datafusion:vortex-file-compressed 439848210 / 306125584 / +43.7% 🔴 896208935 / 727209626 / +23.2% 0.49 / 0.42 / +16.6%
tpch_q16/datafusion:vortex-file-compressed 139008661 / 134848492 / +3.1% 293751586 / 285978767 / +2.7% 0.47 / 0.47 / +0.4%
tpch_q17/datafusion:vortex-file-compressed 258305379 / 252865916 / +2.2% 383434706 / 494400127 / -22.4% 0.67 / 0.51 / +31.7%
tpch_q18/datafusion:vortex-file-compressed 483774593 / 222278514 / +117.6% 🔴 487729978 / 389005809 / +25.4% 0.99 / 0.57 / +73.6%
tpch_q19/datafusion:vortex-file-compressed 252274017 / 226209017 / +11.5% 423133705 / 296515885 / +42.7% 🔴 0.60 / 0.76 / -21.8%
tpch_q20/datafusion:vortex-file-compressed 295934001 / 248686849 / +19.0% 445515851 / 477297666 / -6.7% 0.66 / 0.52 / +27.5%
tpch_q21/datafusion:vortex-file-compressed 423276930 / 384422617 / +10.1% 639190049 / 739838656 / -13.6% 0.66 / 0.52 / +27.4%
tpch_q22/datafusion:vortex-file-compressed 158249518 / 147475449 / +7.3% 531535844 / 337385924 / +57.5% 🔴 0.30 / 0.44 / -31.9%
datafusion / parquet / ns (1.045x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 160266318 / 143033960 / +12.0% 430008801 / 425422516 / +1.1% 0.37 / 0.34 / +10.9%
tpch_q02/datafusion:parquet 281320065 / 274389077 / +2.5% 611506497 / 421418541 / +45.1% 🔴 0.46 / 0.65 / -29.3%
tpch_q03/datafusion:parquet 240103267 / 240153039 / -0.0% 652147099 / 656104536 / -0.6% 0.37 / 0.37 / +0.6%
tpch_q04/datafusion:parquet 137794163 / 129091170 / +6.7% 274717731 / 262434371 / +4.7% 0.50 / 0.49 / +2.0%
tpch_q05/datafusion:parquet 381192087 / 325560808 / +17.1% 574796393 / 708712744 / -18.9% 0.66 / 0.46 / +44.4%
tpch_q06/datafusion:parquet 105885411 / 104623731 / +1.2% 203800200 / 202039421 / +0.9% 0.52 / 0.52 / +0.3%
tpch_q07/datafusion:parquet 324265418 / 326115720 / -0.6% 456551021 / 439408571 / +3.9% 0.71 / 0.74 / -4.3%
tpch_q08/datafusion:parquet 419081033 / 383031456 / +9.4% 537653522 / 487777150 / +10.2% 0.78 / 0.79 / -0.7%
tpch_q09/datafusion:parquet 385099220 / 507741508 / -24.2% 572155731 / 948722124 / -39.7% 🟢 0.67 / 0.54 / +25.8%
tpch_q10/datafusion:parquet 307910756 / 318225993 / -3.2% 424344980 / 431490793 / -1.7% 0.73 / 0.74 / -1.6%
tpch_q11/datafusion:parquet 255753465 / 245309101 / +4.3% 368787503 / 324804219 / +13.5% 0.69 / 0.76 / -8.2%
tpch_q12/datafusion:parquet 150559096 / 160703746 / -6.3% 298037446 / 262477140 / +13.5% 0.51 / 0.61 / -17.5%
tpch_q13/datafusion:parquet 271531604 / 274764633 / -1.2% 469432979 / 387802001 / +21.0% 0.58 / 0.71 / -18.4%
tpch_q14/datafusion:parquet 149732856 / 141590102 / +5.8% 274046306 / 264823133 / +3.5% 0.55 / 0.53 / +2.2%
tpch_q15/datafusion:parquet 304443599 / 297935495 / +2.2% 500547289 / 444599102 / +12.6% 0.61 / 0.67 / -9.2%
tpch_q16/datafusion:parquet 95224598 / 96864793 / -1.7% 248178525 / 207092637 / +19.8% 0.38 / 0.47 / -18.0%
tpch_q17/datafusion:parquet 479089946 / 268630342 / +78.3% 🔴 440385109 / 416939497 / +5.6% 1.09 / 0.64 / +68.9%
tpch_q18/datafusion:parquet 316505237 / 305302634 / +3.7% 527498573 / 465639400 / +13.3% 0.60 / 0.66 / -8.5%
tpch_q19/datafusion:parquet 155337167 / 149310744 / +4.0% 333469091 / 274137368 / +21.6% 0.47 / 0.54 / -14.5%
tpch_q20/datafusion:parquet 235596222 / 228071243 / +3.3% 360265283 / 424446687 / -15.1% 0.65 / 0.54 / +21.7%
tpch_q21/datafusion:parquet 291773546 / 291483866 / +0.1% 456733852 / 469762099 / -2.8% 0.64 / 0.62 / +3.0%
tpch_q22/datafusion:parquet 161260757 / 145366900 / +10.9% 322285173 / 299750221 / +7.5% 0.50 / 0.48 / +3.2%
duckdb / vortex-file-compressed / ns (1.025x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 246957451 / 237695207 / +3.9% 215457745 / 298096331 / -27.7% 1.15 / 0.80 / +43.7%
tpch_q02/duckdb:vortex-file-compressed 392891742 / 394665672 / -0.4% 450964117 / 474795024 / -5.0% 0.87 / 0.83 / +4.8%
tpch_q03/duckdb:vortex-file-compressed 477840633 / 398939371 / +19.8% 484340072 / 460688509 / +5.1% 0.99 / 0.87 / +13.9%
tpch_q04/duckdb:vortex-file-compressed 275419597 / 255227345 / +7.9% 315208584 / 296337544 / +6.4% 0.87 / 0.86 / +1.5%
tpch_q05/duckdb:vortex-file-compressed 532826511 / 709957932 / -24.9% 616659211 / 785337665 / -21.5% 0.86 / 0.90 / -4.4%
tpch_q06/duckdb:vortex-file-compressed 289949626 / 148777224 / +94.9% 🔴 178918642 / 208058114 / -14.0% 1.62 / 0.72 / +126.6%
tpch_q07/duckdb:vortex-file-compressed 403423210 / 387859027 / +4.0% 518288460 / 510621725 / +1.5% 0.78 / 0.76 / +2.5%
tpch_q08/duckdb:vortex-file-compressed 668744463 / 617848086 / +8.2% 711243268 / 732855328 / -2.9% 0.94 / 0.84 / +11.5%
tpch_q09/duckdb:vortex-file-compressed 379566170 / 392528875 / -3.3% 453673021 / 482201706 / -5.9% 0.84 / 0.81 / +2.8%
tpch_q10/duckdb:vortex-file-compressed 530339123 / 526138612 / +0.8% 555250940 / 576801469 / -3.7% 0.96 / 0.91 / +4.7%
tpch_q11/duckdb:vortex-file-compressed 322298389 / 288496302 / +11.7% 326452731 / 270775100 / +20.6% 0.99 / 1.07 / -7.3%
tpch_q12/duckdb:vortex-file-compressed 250448309 / 271105721 / -7.6% 522903705 / 407392913 / +28.4% 0.48 / 0.67 / -28.0%
tpch_q13/duckdb:vortex-file-compressed 260586236 / 247871881 / +5.1% 313104674 / 208806747 / +49.9% 🔴 0.83 / 1.19 / -29.9%
tpch_q14/duckdb:vortex-file-compressed 245304577 / 224785869 / +9.1% 285232374 / 273953898 / +4.1% 0.86 / 0.82 / +4.8%
tpch_q15/duckdb:vortex-file-compressed 241468055 / 237917836 / +1.5% 256964621 / 453417020 / -43.3% 🟢 0.94 / 0.52 / +79.1%
tpch_q16/duckdb:vortex-file-compressed 220411392 / 206543544 / +6.7% 292259976 / 287344280 / +1.7% 0.75 / 0.72 / +4.9%
tpch_q17/duckdb:vortex-file-compressed 313648794 / 454602893 / -31.0% 🟢 431892846 / 443734007 / -2.7% 0.73 / 1.02 / -29.1%
tpch_q18/duckdb:vortex-file-compressed 368388084 / 339736454 / +8.4% 413114893 / 418339259 / -1.2% 0.89 / 0.81 / +9.8%
tpch_q19/duckdb:vortex-file-compressed 276882739 / 320978677 / -13.7% 352921158 / 349847295 / +0.9% 0.78 / 0.92 / -14.5%
tpch_q20/duckdb:vortex-file-compressed 384409397 / 334782469 / +14.8% 433532811 / 412936083 / +5.0% 0.89 / 0.81 / +9.4%
tpch_q21/duckdb:vortex-file-compressed 562945234 / 558602915 / +0.8% 616332650 / 630439819 / -2.2% 0.91 / 0.89 / +3.1%
tpch_q22/duckdb:vortex-file-compressed 214751164 / 253794094 / -15.4% 271541669 / 269551763 / +0.7% 0.79 / 0.94 / -16.0%
duckdb / parquet / ns (1.034x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 197308391 / 178327142 / +10.6% 216317005 / 188180852 / +15.0% 0.91 / 0.95 / -3.7%
tpch_q02/duckdb:parquet 429246548 / 428571834 / +0.2% 415351748 / 421258354 / -1.4% 1.03 / 1.02 / +1.6%
tpch_q03/duckdb:parquet 372731588 / 384797319 / -3.1% 429087073 / 402689855 / +6.6% 0.87 / 0.96 / -9.1%
tpch_q04/duckdb:parquet 267675594 / 278868438 / -4.0% 352010636 / 290411092 / +21.2% 0.76 / 0.96 / -20.8%
tpch_q05/duckdb:parquet 490380849 / 512960026 / -4.4% 592822093 / 589908823 / +0.5% 0.83 / 0.87 / -4.9%
tpch_q06/duckdb:parquet 147637251 / 154774655 / -4.6% 219701166 / 188086085 / +16.8% 0.67 / 0.82 / -18.3%
tpch_q07/duckdb:parquet 458042415 / 419672939 / +9.1% 486727575 / 421853390 / +15.4% 0.94 / 0.99 / -5.4%
tpch_q08/duckdb:parquet 586196850 / 588960652 / -0.5% 606790771 / 658661231 / -7.9% 0.97 / 0.89 / +8.0%
tpch_q09/duckdb:parquet 539572541 / 557378838 / -3.2% 546104758 / 656390425 / -16.8% 0.99 / 0.85 / +16.4%
tpch_q10/duckdb:parquet 563911098 / 517349035 / +9.0% 621510441 / 581884894 / +6.8% 0.91 / 0.89 / +2.1%
tpch_q11/duckdb:parquet 287687418 / 279247336 / +3.0% 311973132 / 301469405 / +3.5% 0.92 / 0.93 / -0.4%
tpch_q12/duckdb:parquet 241058041 / 244321025 / -1.3% 278490545 / 281145014 / -0.9% 0.87 / 0.87 / -0.4%
tpch_q13/duckdb:parquet 392780924 / 382703043 / +2.6% 439342718 / 463219570 / -5.2% 0.89 / 0.83 / +8.2%
tpch_q14/duckdb:parquet 228091436 / 255047143 / -10.6% 310889533 / 301222259 / +3.2% 0.73 / 0.85 / -13.3%
tpch_q15/duckdb:parquet 221936338 / 191438501 / +15.9% 331027945 / 220554518 / +50.1% 🔴 0.67 / 0.87 / -22.8%
tpch_q16/duckdb:parquet 286323050 / 287313946 / -0.3% 281241629 / 301984087 / -6.9% 1.02 / 0.95 / +7.0%
tpch_q17/duckdb:parquet 320152204 / 258007938 / +24.1% 310785654 / 314199718 / -1.1% 1.03 / 0.82 / +25.4%
tpch_q18/duckdb:parquet 330235663 / 306425002 / +7.8% 355218209 / 355418381 / -0.1% 0.93 / 0.86 / +7.8%
tpch_q19/duckdb:parquet 277134342 / 241485587 / +14.8% 295850355 / 285468394 / +3.6% 0.94 / 0.85 / +10.7%
tpch_q20/duckdb:parquet 469485385 / 432599380 / +8.5% 484146529 / 540117093 / -10.4% 0.97 / 0.80 / +21.1%
tpch_q21/duckdb:parquet 460053679 / 417617294 / +10.2% 524512128 / 463876894 / +13.1% 0.88 / 0.90 / -2.6%
tpch_q22/duckdb:parquet 283670220 / 287438341 / -1.3% 285133448 / 253402369 / +12.5% 0.99 / 1.13 / -12.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 768b49f9 vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.015x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21891485 / 21999911 / -0.5% 42014837 / 39946370 / +5.2% 0.52 / 0.55 / -5.4%
tpcds_q02/datafusion:vortex-file-compressed 43111281 / 42893253 / +0.5% 64069403 / 62914880 / +1.8% 0.67 / 0.68 / -1.3%
tpcds_q03/datafusion:vortex-file-compressed 11642042 / 11605178 / +0.3% 29685844 / 26609156 / +11.6% 🔴 0.39 / 0.44 / -10.1%
tpcds_q04/datafusion:vortex-file-compressed 79959432 / 78951654 / +1.3% 109292170 / 104564818 / +4.5% 0.73 / 0.76 / -3.1%
tpcds_q05/datafusion:vortex-file-compressed 56361887 / 55941465 / +0.8% 77633217 / 74124262 / +4.7% 0.73 / 0.75 / -3.8%
tpcds_q06/datafusion:vortex-file-compressed 21827500 / 21333720 / +2.3% 41628611 / 41069841 / +1.4% 0.52 / 0.52 / +0.9%
tpcds_q07/datafusion:vortex-file-compressed 26680544 / 26386390 / +1.1% 47977813 / 48176326 / -0.4% 0.56 / 0.55 / +1.5%
tpcds_q08/datafusion:vortex-file-compressed 25967487 / 25587712 / +1.5% 43325767 / 43682364 / -0.8% 0.60 / 0.59 / +2.3%
tpcds_q09/datafusion:vortex-file-compressed 19445705 / 19896226 / -2.3% 36541273 / 37474977 / -2.5% 0.53 / 0.53 / +0.2%
tpcds_q10/datafusion:vortex-file-compressed 30008700 / 29546889 / +1.6% 49211623 / 51180613 / -3.8% 0.61 / 0.58 / +5.6%
tpcds_q11/datafusion:vortex-file-compressed 48261070 / 49121194 / -1.8% 74169102 / 75394766 / -1.6% 0.65 / 0.65 / -0.1%
tpcds_q12/datafusion:vortex-file-compressed 15139512 / 14946749 / +1.3% 32723527 / 31749886 / +3.1% 0.46 / 0.47 / -1.7%
tpcds_q13/datafusion:vortex-file-compressed 29734590 / 31860550 / -6.7% 57320612 / 53865238 / +6.4% 0.52 / 0.59 / -12.3%
tpcds_q14/datafusion:vortex-file-compressed 486839240 / 487421370 / -0.1% 543331415 / 542474028 / +0.2% 0.90 / 0.90 / -0.3%
tpcds_q15/datafusion:vortex-file-compressed 12789932 / 12586756 / +1.6% 31353399 / 29869991 / +5.0% 0.41 / 0.42 / -3.2%
tpcds_q16/datafusion:vortex-file-compressed 18731076 / 18761618 / -0.2% 39162126 / 37089591 / +5.6% 0.48 / 0.51 / -5.4%
tpcds_q17/datafusion:vortex-file-compressed 52425475 / 53607682 / -2.2% 75806242 / 70072689 / +8.2% 0.69 / 0.77 / -9.6%
tpcds_q18/datafusion:vortex-file-compressed 63127958 / 62349632 / +1.2% 71631404 / 88633124 / -19.2% 🟢 0.88 / 0.70 / +25.3%
tpcds_q19/datafusion:vortex-file-compressed 17005704 / 17064877 / -0.3% 39258086 / 38137570 / +2.9% 0.43 / 0.45 / -3.2%
tpcds_q20/datafusion:vortex-file-compressed 16935480 / 16875604 / +0.4% 33993459 / 33398462 / +1.8% 0.50 / 0.51 / -1.4%
tpcds_q21/datafusion:vortex-file-compressed 15036536 / 14801170 / +1.6% 34107673 / 32973615 / +3.4% 0.44 / 0.45 / -1.8%
tpcds_q22/datafusion:vortex-file-compressed 49697143 / 49325762 / +0.8% 71488523 / 67699156 / +5.6% 0.70 / 0.73 / -4.6%
tpcds_q23/datafusion:vortex-file-compressed 72693520 / 72276124 / +0.6% 97844134 / 97272882 / +0.6% 0.74 / 0.74 / -0.0%
tpcds_q24/datafusion:vortex-file-compressed 63737271 / 63926868 / -0.3% 84467653 / 83129432 / +1.6% 0.75 / 0.77 / -1.9%
tpcds_q25/datafusion:vortex-file-compressed 45759802 / 44475855 / +2.9% 79408502 / 66779639 / +18.9% 🔴 0.58 / 0.67 / -13.5%
tpcds_q26/datafusion:vortex-file-compressed 25966122 / 26101808 / -0.5% 46581255 / 45977400 / +1.3% 0.56 / 0.57 / -1.8%
tpcds_q27/datafusion:vortex-file-compressed 51949666 / 53289153 / -2.5% 72845977 / 76338183 / -4.6% 0.71 / 0.70 / +2.2%
tpcds_q28/datafusion:vortex-file-compressed 19212220 / 19381416 / -0.9% 37360141 / 39922526 / -6.4% 0.51 / 0.49 / +5.9%
tpcds_q29/datafusion:vortex-file-compressed 51533311 / 52347589 / -1.6% 67295613 / 73566264 / -8.5% 0.77 / 0.71 / +7.6%
tpcds_q30/datafusion:vortex-file-compressed 27959541 / 27661427 / +1.1% 46162029 / 45075272 / +2.4% 0.61 / 0.61 / -1.3%
tpcds_q31/datafusion:vortex-file-compressed 62055648 / 62516696 / -0.7% 88758370 / 87634339 / +1.3% 0.70 / 0.71 / -2.0%
tpcds_q32/datafusion:vortex-file-compressed 12979962 / 13025350 / -0.3% 29863165 / 30062663 / -0.7% 0.43 / 0.43 / +0.3%
tpcds_q33/datafusion:vortex-file-compressed 28957804 / 27991706 / +3.5% 50874283 / 50078992 / +1.6% 0.57 / 0.56 / +1.8%
tpcds_q34/datafusion:vortex-file-compressed 17672255 / 17855906 / -1.0% 37941294 / 36650085 / +3.5% 0.47 / 0.49 / -4.4%
tpcds_q35/datafusion:vortex-file-compressed 30643766 / 31075584 / -1.4% 54025463 / 54010849 / +0.0% 0.57 / 0.58 / -1.4%
tpcds_q36/datafusion:vortex-file-compressed 47488448 / 46691248 / +1.7% 68935140 / 69134076 / -0.3% 0.69 / 0.68 / +2.0%
tpcds_q37/datafusion:vortex-file-compressed 11989506 / 12935278 / -7.3% 35523429 / 33965509 / +4.6% 0.34 / 0.38 / -11.4%
tpcds_q38/datafusion:vortex-file-compressed 26609872 / 26436550 / +0.7% 46810429 / 46500479 / +0.7% 0.57 / 0.57 / -0.0%
tpcds_q39/datafusion:vortex-file-compressed 65085258 / 64408856 / +1.1% 87630083 / 87056639 / +0.7% 0.74 / 0.74 / +0.4%
tpcds_q40/datafusion:vortex-file-compressed 22857276 / 22195258 / +3.0% 40053878 / 39059042 / +2.5% 0.57 / 0.57 / +0.4%
tpcds_q41/datafusion:vortex-file-compressed 20416834 / 20181415 / +1.2% 34163001 / 32305841 / +5.7% 0.60 / 0.62 / -4.3%
tpcds_q42/datafusion:vortex-file-compressed 11732084 / 11610268 / +1.0% 28979074 / 27549864 / +5.2% 0.40 / 0.42 / -3.9%
tpcds_q43/datafusion:vortex-file-compressed 13149613 / 13251107 / -0.8% 34458010 / 31511768 / +9.3% 0.38 / 0.42 / -9.3%
tpcds_q44/datafusion:vortex-file-compressed 27291752 / 27407222 / -0.4% 50728591 / 49901538 / +1.7% 0.54 / 0.55 / -2.0%
tpcds_q45/datafusion:vortex-file-compressed 17055932 / 17168016 / -0.7% 34472988 / 34200247 / +0.8% 0.49 / 0.50 / -1.4%
tpcds_q46/datafusion:vortex-file-compressed 23827254 / 23558210 / +1.1% 45536793 / 45525195 / +0.0% 0.52 / 0.52 / +1.1%
tpcds_q47/datafusion:vortex-file-compressed 75195396 / 75593490 / -0.5% 105624947 / 103395942 / +2.2% 0.71 / 0.73 / -2.6%
tpcds_q48/datafusion:vortex-file-compressed 29935864 / 28579330 / +4.7% 51383191 / 51250463 / +0.3% 0.58 / 0.56 / +4.5%
tpcds_q49/datafusion:vortex-file-compressed 56191524 / 57212074 / -1.8% 75782758 / 74563681 / +1.6% 0.74 / 0.77 / -3.4%
tpcds_q50/datafusion:vortex-file-compressed 30266400 / 31077502 / -2.6% 51906413 / 51768133 / +0.3% 0.58 / 0.60 / -2.9%
tpcds_q51/datafusion:vortex-file-compressed 66659118 / 67219460 / -0.8% 89701636 / 89984116 / -0.3% 0.74 / 0.75 / -0.5%
tpcds_q52/datafusion:vortex-file-compressed 12093305 / 11829058 / +2.2% 30062784 / 28624926 / +5.0% 0.40 / 0.41 / -2.7%
tpcds_q53/datafusion:vortex-file-compressed 18405308 / 18240894 / +0.9% 40806494 / 37934996 / +7.6% 0.45 / 0.48 / -6.2%
tpcds_q54/datafusion:vortex-file-compressed 31800742 / 32073801 / -0.9% 54960330 / 53625583 / +2.5% 0.58 / 0.60 / -3.3%
tpcds_q55/datafusion:vortex-file-compressed 11784866 / 11528832 / +2.2% 29375953 / 27437884 / +7.1% 0.40 / 0.42 / -4.5%
tpcds_q56/datafusion:vortex-file-compressed 27270348 / 26666916 / +2.3% 49146167 / 47448670 / +3.6% 0.55 / 0.56 / -1.3%
tpcds_q57/datafusion:vortex-file-compressed 62054796 / 62012122 / +0.1% 88129911 / 87267119 / +1.0% 0.70 / 0.71 / -0.9%
tpcds_q58/datafusion:vortex-file-compressed 40567614 / 40818922 / -0.6% 65779299 / 64518211 / +2.0% 0.62 / 0.63 / -2.5%
tpcds_q59/datafusion:vortex-file-compressed 27349473 / 27906409 / -2.0% 53169558 / 53781464 / -1.1% 0.51 / 0.52 / -0.9%
tpcds_q60/datafusion:vortex-file-compressed 27583688 / 27726237 / -0.5% 49219018 / 47532249 / +3.5% 0.56 / 0.58 / -3.9%
tpcds_q61/datafusion:vortex-file-compressed 21409164 / 20214066 / +5.9% 42261881 / 39682747 / +6.5% 0.51 / 0.51 / -0.6%
tpcds_q62/datafusion:vortex-file-compressed 17083756 / 16850174 / +1.4% 35360447 / 34396629 / +2.8% 0.48 / 0.49 / -1.4%
tpcds_q63/datafusion:vortex-file-compressed 18480489 / 18192128 / +1.6% 40874266 / 37641254 / +8.6% 0.45 / 0.48 / -6.4%
tpcds_q64/datafusion:vortex-file-compressed 189484926 / 188561892 / +0.5% 220512949 / 229680212 / -4.0% 0.86 / 0.82 / +4.7%
tpcds_q65/datafusion:vortex-file-compressed 73974124 / 73066724 / +1.2% 92096117 / 96562612 / -4.6% 0.80 / 0.76 / +6.2%
tpcds_q66/datafusion:vortex-file-compressed 50361698 / 50096568 / +0.5% 70185758 / 69306342 / +1.3% 0.72 / 0.72 / -0.7%
tpcds_q67/datafusion:vortex-file-compressed 51720677 / 51663640 / +0.1% 84847632 / 83492505 / +1.6% 0.61 / 0.62 / -1.5%
tpcds_q68/datafusion:vortex-file-compressed 23112345 / 22888054 / +1.0% 45096854 / 44101071 / +2.3% 0.51 / 0.52 / -1.2%
tpcds_q69/datafusion:vortex-file-compressed 27043774 / 27546142 / -1.8% 48568298 / 47372016 / +2.5% 0.56 / 0.58 / -4.2%
tpcds_q70/datafusion:vortex-file-compressed 73658152 / 73486667 / +0.2% 97044354 / 97916702 / -0.9% 0.76 / 0.75 / +1.1%
tpcds_q71/datafusion:vortex-file-compressed 19864232 / 19173117 / +3.6% 40215604 / 37641700 / +6.8% 0.49 / 0.51 / -3.0%
tpcds_q72/datafusion:vortex-file-compressed 261224748 / 247376824 / +5.6% 314528872 / 279389691 / +12.6% 🔴 0.83 / 0.89 / -6.2%
tpcds_q73/datafusion:vortex-file-compressed 16339810 / 16283788 / +0.3% 35383312 / 37287301 / -5.1% 0.46 / 0.44 / +5.7%
tpcds_q74/datafusion:vortex-file-compressed 40709970 / 40826743 / -0.3% 67411601 / 66742487 / +1.0% 0.60 / 0.61 / -1.3%
tpcds_q75/datafusion:vortex-file-compressed 135981410 / 133968630 / +1.5% 163579197 / 162666038 / +0.6% 0.83 / 0.82 / +0.9%
tpcds_q76/datafusion:vortex-file-compressed 28891069 / 28638050 / +0.9% 48238055 / 48545831 / -0.6% 0.60 / 0.59 / +1.5%
tpcds_q77/datafusion:vortex-file-compressed 46203702 / 44422120 / +4.0% 66805958 / 65708594 / +1.7% 0.69 / 0.68 / +2.3%
tpcds_q78/datafusion:vortex-file-compressed 61157126 / 60965657 / +0.3% 86315246 / 86015972 / +0.3% 0.71 / 0.71 / -0.0%
tpcds_q79/datafusion:vortex-file-compressed 20278796 / 20279438 / -0.0% 42173564 / 42110377 / +0.2% 0.48 / 0.48 / -0.2%
tpcds_q80/datafusion:vortex-file-compressed 68618262 / 68766030 / -0.2% 93316427 / 93570722 / -0.3% 0.74 / 0.73 / +0.1%
tpcds_q81/datafusion:vortex-file-compressed 28203798 / 28260648 / -0.2% 46258495 / 45300560 / +2.1% 0.61 / 0.62 / -2.3%
tpcds_q82/datafusion:vortex-file-compressed 12357145 / 12807434 / -3.5% 35236074 / 35626130 / -1.1% 0.35 / 0.36 / -2.4%
tpcds_q83/datafusion:vortex-file-compressed 34580880 / 35376074 / -2.2% 55078169 / 52093141 / +5.7% 0.63 / 0.68 / -7.5%
tpcds_q84/datafusion:vortex-file-compressed 10758950 / 10461540 / +2.8% 27263649 / 25885722 / +5.3% 0.39 / 0.40 / -2.4%
tpcds_q85/datafusion:vortex-file-compressed 51990991 / 51809666 / +0.3% 77776573 / 75574697 / +2.9% 0.67 / 0.69 / -2.5%
tpcds_q86/datafusion:vortex-file-compressed 16647010 / 16113415 / +3.3% 34864534 / 34409002 / +1.3% 0.48 / 0.47 / +2.0%
tpcds_q87/datafusion:vortex-file-compressed 26096062 / 26499568 / -1.5% 49243121 / 48598250 / +1.3% 0.53 / 0.55 / -2.8%
tpcds_q88/datafusion:vortex-file-compressed 32195622 / 32357568 / -0.5% 53229355 / 50858837 / +4.7% 0.60 / 0.64 / -4.9%
tpcds_q89/datafusion:vortex-file-compressed 21563472 / 21807304 / -1.1% 44877686 / 42407282 / +5.8% 0.48 / 0.51 / -6.6%
tpcds_q90/datafusion:vortex-file-compressed 10303845 / 10365216 / -0.6% 26113651 / 24066050 / +8.5% 0.39 / 0.43 / -8.4%
tpcds_q91/datafusion:vortex-file-compressed 15801752 / 16048840 / -1.5% 38426527 / 36604324 / +5.0% 0.41 / 0.44 / -6.2%
tpcds_q92/datafusion:vortex-file-compressed 12966271 / 13198902 / -1.8% 30804089 / 29685220 / +3.8% 0.42 / 0.44 / -5.3%
tpcds_q93/datafusion:vortex-file-compressed 20435048 / 20150414 / +1.4% 41766817 / 40148939 / +4.0% 0.49 / 0.50 / -2.5%
tpcds_q94/datafusion:vortex-file-compressed 18923452 / 18552985 / +2.0% 38488527 / 37927246 / +1.5% 0.49 / 0.49 / +0.5%
tpcds_q95/datafusion:vortex-file-compressed 41768252 / 41763500 / +0.0% 63931959 / 60866535 / +5.0% 0.65 / 0.69 / -4.8%
tpcds_q96/datafusion:vortex-file-compressed 7810962 / 7859994 / -0.6% 27117843 / 23576532 / +15.0% 🔴 0.29 / 0.33 / -13.6%
tpcds_q97/datafusion:vortex-file-compressed 17347040 / 17259486 / +0.5% 39535458 / 37350276 / +5.9% 0.44 / 0.46 / -5.0%
tpcds_q98/datafusion:vortex-file-compressed 16023455 / 16185816 / -1.0% 35175471 / 32671739 / +7.7% 0.46 / 0.50 / -8.0%
tpcds_q99/datafusion:vortex-file-compressed 16257107 / 16384194 / -0.8% 34374349 / 33993322 / +1.1% 0.47 / 0.48 / -1.9%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43406146 / 43046149 / +0.8% 58625089 / 59333915 / -1.2% 0.74 / 0.73 / +2.1%
tpcds_q02/datafusion:parquet 54482191 / 55017496 / -1.0% 70042177 / 69006470 / +1.5% 0.78 / 0.80 / -2.4%
tpcds_q03/datafusion:parquet 19027972 / 19078092 / -0.3% 32042972 / 32968281 / -2.8% 0.59 / 0.58 / +2.6%
tpcds_q04/datafusion:parquet 179148593 / 179731768 / -0.3% 205479420 / 199226926 / +3.1% 0.87 / 0.90 / -3.4%
tpcds_q05/datafusion:parquet 67994500 / 68363662 / -0.5% 86833983 / 88310082 / -1.7% 0.78 / 0.77 / +1.2%
tpcds_q06/datafusion:parquet 34057171 / 35133400 / -3.1% 48205248 / 44032369 / +9.5% 0.71 / 0.80 / -11.5%
tpcds_q07/datafusion:parquet 46506758 / 47015244 / -1.1% 63535559 / 63060866 / +0.8% 0.73 / 0.75 / -1.8%
tpcds_q08/datafusion:parquet 30953748 / 31108916 / -0.5% 46208794 / 46407336 / -0.4% 0.67 / 0.67 / -0.1%
tpcds_q09/datafusion:parquet 29771640 / 32235404 / -7.6% 45826259 / 38162448 / +20.1% 🔴 0.65 / 0.84 / -23.1%
tpcds_q10/datafusion:parquet 44777538 / 45810956 / -2.3% 59030315 / 55821116 / +5.7% 0.76 / 0.82 / -7.6%
tpcds_q11/datafusion:parquet 96390600 / 97324552 / -1.0% 118906548 / 116986930 / +1.6% 0.81 / 0.83 / -2.6%
tpcds_q12/datafusion:parquet 23801812 / 23829389 / -0.1% 35903888 / 34561700 / +3.9% 0.66 / 0.69 / -3.8%
tpcds_q13/datafusion:parquet 45544962 / 47205746 / -3.5% 66797004 / 66519722 / +0.4% 0.68 / 0.71 / -3.9%
tpcds_q14/datafusion:parquet 534061626 / 536062596 / -0.4% 583674852 / 573875357 / +1.7% 0.91 / 0.93 / -2.0%
tpcds_q15/datafusion:parquet 23640015 / 23467316 / +0.7% 38254481 / 36912696 / +3.6% 0.62 / 0.64 / -2.8%
tpcds_q16/datafusion:parquet 36814614 / 36797934 / +0.0% 49828234 / 49093338 / +1.5% 0.74 / 0.75 / -1.4%
tpcds_q17/datafusion:parquet 74779132 / 77417738 / -3.4% 97037876 / 94152957 / +3.1% 0.77 / 0.82 / -6.3%
tpcds_q18/datafusion:parquet 69422536 / 67730459 / +2.5% 86715144 / 89015478 / -2.6% 0.80 / 0.76 / +5.2%
tpcds_q19/datafusion:parquet 29629588 / 29767255 / -0.5% 41680618 / 40859608 / +2.0% 0.71 / 0.73 / -2.4%
tpcds_q20/datafusion:parquet 24961905 / 24985466 / -0.1% 35977042 / 37149008 / -3.2% 0.69 / 0.67 / +3.2%
tpcds_q21/datafusion:parquet 19889394 / 20098942 / -1.0% 30779023 / 31199048 / -1.3% 0.65 / 0.64 / +0.3%
tpcds_q22/datafusion:parquet 78327458 / 78225004 / +0.1% 88047310 / 88011450 / +0.0% 0.89 / 0.89 / +0.1%
tpcds_q23/datafusion:parquet 92881816 / 93465786 / -0.6% 110014201 / 115763272 / -5.0% 0.84 / 0.81 / +4.6%
tpcds_q24/datafusion:parquet 91120975 / 90530880 / +0.7% 112224884 / 112774834 / -0.5% 0.81 / 0.80 / +1.1%
tpcds_q25/datafusion:parquet 78707750 / 78942378 / -0.3% 98561734 / 100286343 / -1.7% 0.80 / 0.79 / +1.4%
tpcds_q26/datafusion:parquet 43447946 / 42985690 / +1.1% 58656092 / 59286646 / -1.1% 0.74 / 0.73 / +2.2%
tpcds_q27/datafusion:parquet 75364011 / 78387144 / -3.9% 94632366 / 99975873 / -5.3% 0.80 / 0.78 / +1.6%
tpcds_q28/datafusion:parquet 28311307 / 28355490 / -0.2% 42988854 / 41055918 / +4.7% 0.66 / 0.69 / -4.6%
tpcds_q29/datafusion:parquet 75268495 / 74275574 / +1.3% 97078119 / 99075419 / -2.0% 0.78 / 0.75 / +3.4%
tpcds_q30/datafusion:parquet 43591038 / 44266542 / -1.5% 57617847 / 55134805 / +4.5% 0.76 / 0.80 / -5.8%
tpcds_q31/datafusion:parquet 81081916 / 80991932 / +0.1% 98087780 / 100088488 / -2.0% 0.83 / 0.81 / +2.2%
tpcds_q32/datafusion:parquet 26203432 / 27160338 / -3.5% 38777184 / 37888363 / +2.3% 0.68 / 0.72 / -5.7%
tpcds_q33/datafusion:parquet 37734196 / 37472210 / +0.7% 52681452 / 52784833 / -0.2% 0.72 / 0.71 / +0.9%
tpcds_q34/datafusion:parquet 24089444 / 24223199 / -0.6% 34521022 / 34925847 / -1.2% 0.70 / 0.69 / +0.6%
tpcds_q35/datafusion:parquet 49859327 / 50061658 / -0.4% 63845035 / 66186392 / -3.5% 0.78 / 0.76 / +3.2%
tpcds_q36/datafusion:parquet 52757786 / 53863620 / -2.1% 71078670 / 72008538 / -1.3% 0.74 / 0.75 / -0.8%
tpcds_q37/datafusion:parquet 21204606 / 21492292 / -1.3% 33116454 / 33965178 / -2.5% 0.64 / 0.63 / +1.2%
tpcds_q38/datafusion:parquet 45093233 / 43738358 / +3.1% 59963502 / 58984516 / +1.7% 0.75 / 0.74 / +1.4%
tpcds_q39/datafusion:parquet 67933532 / 68451454 / -0.8% 84027268 / 84694449 / -0.8% 0.81 / 0.81 / +0.0%
tpcds_q40/datafusion:parquet 29745272 / 29898065 / -0.5% 48432534 / 49416081 / -2.0% 0.61 / 0.61 / +1.5%
tpcds_q41/datafusion:parquet 19952968 / 19725044 / +1.2% 31828966 / 31567276 / +0.8% 0.63 / 0.62 / +0.3%
tpcds_q42/datafusion:parquet 18072020 / 18410036 / -1.8% 30306062 / 29096386 / +4.2% 0.60 / 0.63 / -5.8%
tpcds_q43/datafusion:parquet 19028088 / 19482850 / -2.3% 31704909 / 30496940 / +4.0% 0.60 / 0.64 / -6.1%
tpcds_q44/datafusion:parquet 34526804 / 35289568 / -2.2% 49319531 / 48402674 / +1.9% 0.70 / 0.73 / -4.0%
tpcds_q45/datafusion:parquet 27785548 / 28034722 / -0.9% 39167408 / 38421721 / +1.9% 0.71 / 0.73 / -2.8%
tpcds_q46/datafusion:parquet 28784429 / 29018574 / -0.8% 44988409 / 44678861 / +0.7% 0.64 / 0.65 / -1.5%
tpcds_q47/datafusion:parquet 97537392 / 96614053 / +1.0% 116052816 / 119575121 / -2.9% 0.84 / 0.81 / +4.0%
tpcds_q48/datafusion:parquet 42264753 / 42307228 / -0.1% 61096759 / 57749935 / +5.8% 0.69 / 0.73 / -5.6%
tpcds_q49/datafusion:parquet 71663981 / 72427164 / -1.1% 92279589 / 91585118 / +0.8% 0.78 / 0.79 / -1.8%
tpcds_q50/datafusion:parquet 46506782 / 47500422 / -2.1% 67415349 / 68227695 / -1.2% 0.69 / 0.70 / -0.9%
tpcds_q51/datafusion:parquet 74695144 / 74856850 / -0.2% 93638603 / 94480088 / -0.9% 0.80 / 0.79 / +0.7%
tpcds_q52/datafusion:parquet 18510938 / 18570137 / -0.3% 29310639 / 28281276 / +3.6% 0.63 / 0.66 / -3.8%
tpcds_q53/datafusion:parquet 22157594 / 21996628 / +0.7% 37635625 / 37632392 / +0.0% 0.59 / 0.58 / +0.7%
tpcds_q54/datafusion:parquet 52720507 / 53403201 / -1.3% 67671701 / 65412957 / +3.5% 0.78 / 0.82 / -4.6%
tpcds_q55/datafusion:parquet 17928280 / 18094322 / -0.9% 32251953 / 28452535 / +13.4% 🔴 0.56 / 0.64 / -12.6%
tpcds_q56/datafusion:parquet 40291684 / 42064521 / -4.2% 55003164 / 52494093 / +4.8% 0.73 / 0.80 / -8.6%
tpcds_q57/datafusion:parquet 101312302 / 98531152 / +2.8% 113035831 / 115051750 / -1.8% 0.90 / 0.86 / +4.7%
tpcds_q58/datafusion:parquet 65929462 / 66028114 / -0.1% 81272881 / 80484923 / +1.0% 0.81 / 0.82 / -1.1%
tpcds_q59/datafusion:parquet 47292512 / 48124550 / -1.7% 64702609 / 63375622 / +2.1% 0.73 / 0.76 / -3.7%
tpcds_q60/datafusion:parquet 39781189 / 41774428 / -4.8% 55551367 / 52913053 / +5.0% 0.72 / 0.79 / -9.3%
tpcds_q61/datafusion:parquet 35583596 / 36568854 / -2.7% 50619179 / 53842276 / -6.0% 0.70 / 0.68 / +3.5%
tpcds_q62/datafusion:parquet 25341424 / 25168784 / +0.7% 38203833 / 38657488 / -1.2% 0.66 / 0.65 / +1.9%
tpcds_q63/datafusion:parquet 21904816 / 22467320 / -2.5% 38214344 / 36224907 / +5.5% 0.57 / 0.62 / -7.6%
tpcds_q64/datafusion:parquet 285630902 / 285654170 / -0.0% 320260274 / 321241476 / -0.3% 0.89 / 0.89 / +0.3%
tpcds_q65/datafusion:parquet 121800668 / 119227688 / +2.2% 136509656 / 139579808 / -2.2% 0.89 / 0.85 / +4.5%
tpcds_q66/datafusion:parquet 61233417 / 61287888 / -0.1% 76202105 / 75163315 / +1.4% 0.80 / 0.82 / -1.5%
tpcds_q67/datafusion:parquet 68864832 / 69044428 / -0.3% 92146164 / 91696967 / +0.5% 0.75 / 0.75 / -0.7%
tpcds_q68/datafusion:parquet 29023509 / 29075160 / -0.2% 47458720 / 47405672 / +0.1% 0.61 / 0.61 / -0.3%
tpcds_q69/datafusion:parquet 44601825 / 43304174 / +3.0% 54180775 / 58652073 / -7.6% 0.82 / 0.74 / +11.5%
tpcds_q70/datafusion:parquet 80558920 / 80027439 / +0.7% 97113291 / 97604918 / -0.5% 0.83 / 0.82 / +1.2%
tpcds_q71/datafusion:parquet 25476292 / 25732466 / -1.0% 37055521 / 40528677 / -8.6% 0.69 / 0.63 / +8.3%
tpcds_q72/datafusion:parquet 518061860 / 527634840 / -1.8% 539942935 / 554349016 / -2.6% 0.96 / 0.95 / +0.8%
tpcds_q73/datafusion:parquet 23466500 / 23762050 / -1.2% 35237073 / 35077300 / +0.5% 0.67 / 0.68 / -1.7%
tpcds_q74/datafusion:parquet 69808123 / 69999536 / -0.3% 89829039 / 88289509 / +1.7% 0.78 / 0.79 / -2.0%
tpcds_q75/datafusion:parquet 153075816 / 152662930 / +0.3% 174360068 / 180450074 / -3.4% 0.88 / 0.85 / +3.8%
tpcds_q76/datafusion:parquet 33233763 / 33132911 / +0.3% 45836134 / 44935481 / +2.0% 0.73 / 0.74 / -1.7%
tpcds_q77/datafusion:parquet 55822573 / 56979256 / -2.0% 73044024 / 72969812 / +0.1% 0.76 / 0.78 / -2.1%
tpcds_q78/datafusion:parquet 85051896 / 85272162 / -0.3% 116062625 / 115614404 / +0.4% 0.73 / 0.74 / -0.6%
tpcds_q79/datafusion:parquet 27151234 / 26735792 / +1.6% 41003815 / 39769716 / +3.1% 0.66 / 0.67 / -1.5%
tpcds_q80/datafusion:parquet 79857388 / 78680880 / +1.5% 108189181 / 107863155 / +0.3% 0.74 / 0.73 / +1.2%
tpcds_q81/datafusion:parquet 38153565 / 39558134 / -3.6% 51670768 / 51081109 / +1.2% 0.74 / 0.77 / -4.7%
tpcds_q82/datafusion:parquet 22584175 / 22190428 / +1.8% 33571966 / 34291795 / -2.1% 0.67 / 0.65 / +4.0%
tpcds_q83/datafusion:parquet 58952874 / 58307740 / +1.1% 73008351 / 73002134 / +0.0% 0.81 / 0.80 / +1.1%
tpcds_q84/datafusion:parquet 25770734 / 27313596 / -5.6% 40133999 / 40041516 / +0.2% 0.64 / 0.68 / -5.9%
tpcds_q85/datafusion:parquet 79688211 / 79983598 / -0.4% 101272408 / 102306985 / -1.0% 0.79 / 0.78 / +0.6%
tpcds_q86/datafusion:parquet 20748160 / 21058438 / -1.5% 32900805 / 32574181 / +1.0% 0.63 / 0.65 / -2.5%
tpcds_q87/datafusion:parquet 44772543 / 45280914 / -1.1% 59482490 / 62384128 / -4.7% 0.75 / 0.73 / +3.7%
tpcds_q88/datafusion:parquet 36754184 / 37757294 / -2.7% 49369548 / 51820809 / -4.7% 0.74 / 0.73 / +2.2%
tpcds_q89/datafusion:parquet 25621507 / 26318301 / -2.6% 39868441 / 39991728 / -0.3% 0.64 / 0.66 / -2.3%
tpcds_q90/datafusion:parquet 15508932 / 15087966 / +2.8% 25551013 / 26597960 / -3.9% 0.61 / 0.57 / +7.0%
tpcds_q91/datafusion:parquet 32290582 / 32625398 / -1.0% 46255214 / 45196471 / +2.3% 0.70 / 0.72 / -3.3%
tpcds_q92/datafusion:parquet 25649340 / 26834922 / -4.4% 39149510 / 38063167 / +2.9% 0.66 / 0.71 / -7.1%
tpcds_q93/datafusion:parquet 26698420 / 26735974 / -0.1% 46285478 / 42486273 / +8.9% 0.58 / 0.63 / -8.3%
tpcds_q94/datafusion:parquet 35177931 / 35393988 / -0.6% 48393563 / 47118664 / +2.7% 0.73 / 0.75 / -3.2%
tpcds_q95/datafusion:parquet 64962322 / 64212454 / +1.2% 78817885 / 79492966 / -0.8% 0.82 / 0.81 / +2.0%
tpcds_q96/datafusion:parquet 12903366 / 12723054 / +1.4% 23443021 / 23429883 / +0.1% 0.55 / 0.54 / +1.4%
tpcds_q97/datafusion:parquet 35200616 / 35098156 / +0.3% 47325147 / 49335860 / -4.1% 0.74 / 0.71 / +4.6%
tpcds_q98/datafusion:parquet 24587516 / 25139323 / -2.2% 37485962 / 36349537 / +3.1% 0.66 / 0.69 / -5.2%
tpcds_q99/datafusion:parquet 29428126 / 29673968 / -0.8% 41523303 / 41366470 / +0.4% 0.71 / 0.72 / -1.2%
duckdb / vortex-file-compressed / ns (1.011x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16070280 / 15890239 / +1.1% 24557421 / 24196641 / +1.5% 0.65 / 0.66 / -0.4%
tpcds_q02/duckdb:vortex-file-compressed 15541128 / 18657920 / -16.7% 🟢 22403546 / 22422968 / -0.1% 0.69 / 0.83 / -16.6%
tpcds_q03/duckdb:vortex-file-compressed 7049924 / 7149274 / -1.4% 15691868 / 16220757 / -3.3% 0.45 / 0.44 / +1.9%
tpcds_q04/duckdb:vortex-file-compressed 59107269 / 58862208 / +0.4% 70148347 / 71856038 / -2.4% 0.84 / 0.82 / +2.9%
tpcds_q05/duckdb:vortex-file-compressed 23187272 / 23117854 / +0.3% 32427451 / 32942130 / -1.6% 0.72 / 0.70 / +1.9%
tpcds_q06/duckdb:vortex-file-compressed 24494640 / 24164680 / +1.4% 38185253 / 37874428 / +0.8% 0.64 / 0.64 / +0.5%
tpcds_q07/duckdb:vortex-file-compressed 22625034 / 22109802 / +2.3% 34424598 / 32504438 / +5.9% 0.66 / 0.68 / -3.4%
tpcds_q08/duckdb:vortex-file-compressed 17407261 / 17492722 / -0.5% 25580333 / 25089879 / +2.0% 0.68 / 0.70 / -2.4%
tpcds_q09/duckdb:vortex-file-compressed 19195330 / 19005454 / +1.0% 30274364 / 29541405 / +2.5% 0.63 / 0.64 / -1.4%
tpcds_q10/duckdb:vortex-file-compressed 27808604 / 27533383 / +1.0% 41289705 / 41135181 / +0.4% 0.67 / 0.67 / +0.6%
tpcds_q11/duckdb:vortex-file-compressed 36780044 / 36618646 / +0.4% 44941688 / 44343100 / +1.3% 0.82 / 0.83 / -0.9%
tpcds_q12/duckdb:vortex-file-compressed 9804618 / 9679752 / +1.3% 16503209 / 17229625 / -4.2% 0.59 / 0.56 / +5.7%
tpcds_q13/duckdb:vortex-file-compressed 19887672 / 19843352 / +0.2% 32145481 / 31995768 / +0.5% 0.62 / 0.62 / -0.2%
tpcds_q14/duckdb:vortex-file-compressed 55931102 / 55297112 / +1.1% 65289575 / 64955646 / +0.5% 0.86 / 0.85 / +0.6%
tpcds_q15/duckdb:vortex-file-compressed 11400028 / 11325009 / +0.7% 17355842 / 18325444 / -5.3% 0.66 / 0.62 / +6.3%
tpcds_q16/duckdb:vortex-file-compressed 24921890 / 24731064 / +0.8% 35854285 / 34853379 / +2.9% 0.70 / 0.71 / -2.0%
tpcds_q17/duckdb:vortex-file-compressed 20298082 / 20396798 / -0.5% 32417028 / 32338231 / +0.2% 0.63 / 0.63 / -0.7%
tpcds_q18/duckdb:vortex-file-compressed 32504740 / 32346349 / +0.5% 42234943 / 43278488 / -2.4% 0.77 / 0.75 / +3.0%
tpcds_q19/duckdb:vortex-file-compressed 20938256 / 20786617 / +0.7% 29896000 / 29101806 / +2.7% 0.70 / 0.71 / -1.9%
tpcds_q20/duckdb:vortex-file-compressed 10942955 / 10704608 / +2.2% 17598222 / 17476285 / +0.7% 0.62 / 0.61 / +1.5%
tpcds_q21/duckdb:vortex-file-compressed 9454442 / 9371898 / +0.9% 22290666 / 21703364 / +2.7% 0.42 / 0.43 / -1.8%
tpcds_q22/duckdb:vortex-file-compressed 17807778 / 17643249 / +0.9% 30032698 / 29161310 / +3.0% 0.59 / 0.61 / -2.0%
tpcds_q23/duckdb:vortex-file-compressed 37692594 / 37431455 / +0.7% 48211511 / 48459168 / -0.5% 0.78 / 0.77 / +1.2%
tpcds_q24/duckdb:vortex-file-compressed 26639378 / 26441519 / +0.7% 37245202 / 36595428 / +1.8% 0.72 / 0.72 / -1.0%
tpcds_q25/duckdb:vortex-file-compressed 19769150 / 19221668 / +2.8% 30869519 / 30221864 / +2.1% 0.64 / 0.64 / +0.7%
tpcds_q26/duckdb:vortex-file-compressed 21508440 / 21300105 / +1.0% 32067144 / 31212707 / +2.7% 0.67 / 0.68 / -1.7%
tpcds_q27/duckdb:vortex-file-compressed 24850378 / 24807916 / +0.2% 36774607 / 35637087 / +3.2% 0.68 / 0.70 / -2.9%
tpcds_q28/duckdb:vortex-file-compressed 15456899 / 15090790 / +2.4% 25397654 / 25912108 / -2.0% 0.61 / 0.58 / +4.5%
tpcds_q29/duckdb:vortex-file-compressed 18911219 / 18678136 / +1.2% 30116736 / 29174081 / +3.2% 0.63 / 0.64 / -1.9%
tpcds_q30/duckdb:vortex-file-compressed 18535166 / 18682425 / -0.8% 27278494 / 27172488 / +0.4% 0.68 / 0.69 / -1.2%
tpcds_q31/duckdb:vortex-file-compressed 18263082 / 17961668 / +1.7% 26153112 / 26844104 / -2.6% 0.70 / 0.67 / +4.4%
tpcds_q32/duckdb:vortex-file-compressed 10379583 / 10237077 / +1.4% 18537032 / 18081369 / +2.5% 0.56 / 0.57 / -1.1%
tpcds_q33/duckdb:vortex-file-compressed 18340219 / 17651904 / +3.9% 27771959 / 27599437 / +0.6% 0.66 / 0.64 / +3.3%
tpcds_q34/duckdb:vortex-file-compressed 13234428 / 12881700 / +2.7% 23022350 / 21645185 / +6.4% 0.57 / 0.60 / -3.4%
tpcds_q35/duckdb:vortex-file-compressed 31215280 / 31119364 / +0.3% 43346517 / 42566508 / +1.8% 0.72 / 0.73 / -1.5%
tpcds_q36/duckdb:vortex-file-compressed 14279038 / 14037150 / +1.7% 24795871 / 23560362 / +5.2% 0.58 / 0.60 / -3.3%
tpcds_q37/duckdb:vortex-file-compressed 9330682 / 9278629 / +0.6% 22714023 / 24238961 / -6.3% 0.41 / 0.38 / +7.3%
tpcds_q38/duckdb:vortex-file-compressed 24772589 / 24606434 / +0.7% 32553629 / 31179343 / +4.4% 0.76 / 0.79 / -3.6%
tpcds_q39/duckdb:vortex-file-compressed 18899386 / 18495272 / +2.2% 31409495 / 30737214 / +2.2% 0.60 / 0.60 / -0.0%
tpcds_q40/duckdb:vortex-file-compressed 11356956 / 11167876 / +1.7% 19977185 / 19316090 / +3.4% 0.57 / 0.58 / -1.7%
tpcds_q41/duckdb:vortex-file-compressed 17323742 / 17305600 / +0.1% 23981676 / 24395246 / -1.7% 0.72 / 0.71 / +1.8%
tpcds_q42/duckdb:vortex-file-compressed 6984206 / 6914912 / +1.0% 16412895 / 15064464 / +9.0% 0.43 / 0.46 / -7.3%
tpcds_q43/duckdb:vortex-file-compressed 9721650 / 9643249 / +0.8% 19124089 / 18160250 / +5.3% 0.51 / 0.53 / -4.3%
tpcds_q44/duckdb:vortex-file-compressed 12886306 / 12476409 / +3.3% 23820912 / 23821756 / -0.0% 0.54 / 0.52 / +3.3%
tpcds_q45/duckdb:vortex-file-compressed 23723346 / 23587638 / +0.6% 30336990 / 30430270 / -0.3% 0.78 / 0.78 / +0.9%
tpcds_q46/duckdb:vortex-file-compressed 32031718 / 31418024 / +2.0% 44408659 / 43171545 / +2.9% 0.72 / 0.73 / -0.9%
tpcds_q47/duckdb:vortex-file-compressed 31046380 / 31264494 / -0.7% 39965762 / 41141020 / -2.9% 0.78 / 0.76 / +2.2%
tpcds_q48/duckdb:vortex-file-compressed 22735910 / 22472531 / +1.2% 35318316 / 35469142 / -0.4% 0.64 / 0.63 / +1.6%
tpcds_q49/duckdb:vortex-file-compressed 18658361 / 18985566 / -1.7% 30062275 / 29722088 / +1.1% 0.62 / 0.64 / -2.8%
tpcds_q50/duckdb:vortex-file-compressed 15149428 / 14896845 / +1.7% 25069794 / 25687406 / -2.4% 0.60 / 0.58 / +4.2%
tpcds_q51/duckdb:vortex-file-compressed 49453226 / 48063878 / +2.9% 78201799 / 76334322 / +2.4% 0.63 / 0.63 / +0.4%
tpcds_q52/duckdb:vortex-file-compressed 7244206 / 7171716 / +1.0% 16116961 / 15978547 / +0.9% 0.45 / 0.45 / +0.1%
tpcds_q53/duckdb:vortex-file-compressed 11504429 / 11319189 / +1.6% 19900433 / 21681207 / -8.2% 0.58 / 0.52 / +10.7%
tpcds_q54/duckdb:vortex-file-compressed 20050314 / 19748759 / +1.5% 31067405 / 29438540 / +5.5% 0.65 / 0.67 / -3.8%
tpcds_q55/duckdb:vortex-file-compressed 6895371 / 6847788 / +0.7% 16032050 / 15285422 / +4.9% 0.43 / 0.45 / -4.0%
tpcds_q56/duckdb:vortex-file-compressed 18234118 / 17817582 / +2.3% 28014744 / 28613711 / -2.1% 0.65 / 0.62 / +4.5%
tpcds_q57/duckdb:vortex-file-compressed 25871884 / 25308086 / +2.2% 33463395 / 33487780 / -0.1% 0.77 / 0.76 / +2.3%
tpcds_q58/duckdb:vortex-file-compressed 20933632 / 20359384 / +2.8% 30917017 / 29241349 / +5.7% 0.68 / 0.70 / -2.8%
tpcds_q59/duckdb:vortex-file-compressed 19714346 / 19485481 / +1.2% 27316812 / 26442217 / +3.3% 0.72 / 0.74 / -2.1%
tpcds_q60/duckdb:vortex-file-compressed 18713056 / 18504610 / +1.1% 29353441 / 28842068 / +1.8% 0.64 / 0.64 / -0.6%
tpcds_q61/duckdb:vortex-file-compressed 19918916 / 19922872 / -0.0% 30143797 / 30039600 / +0.3% 0.66 / 0.66 / -0.4%
tpcds_q62/duckdb:vortex-file-compressed 11110798 / 10937722 / +1.6% 17957472 / 17144486 / +4.7% 0.62 / 0.64 / -3.0%
tpcds_q63/duckdb:vortex-file-compressed 10915792 / 10809960 / +1.0% 19601163 / 20560158 / -4.7% 0.56 / 0.53 / +5.9%
tpcds_q64/duckdb:vortex-file-compressed 53537572 / 52513062 / +2.0% 67902571 / 68406502 / -0.7% 0.79 / 0.77 / +2.7%
tpcds_q65/duckdb:vortex-file-compressed 13307794 / 13060742 / +1.9% 22799583 / 23236608 / -1.9% 0.58 / 0.56 / +3.8%
tpcds_q66/duckdb:vortex-file-compressed 31724556 / 31272590 / +1.4% 38858763 / 39351988 / -1.3% 0.82 / 0.79 / +2.7%
tpcds_q67/duckdb:vortex-file-compressed 56230369 / 55266268 / +1.7% 66089430 / 64683896 / +2.2% 0.85 / 0.85 / -0.4%
tpcds_q68/duckdb:vortex-file-compressed 23224592 / 23009998 / +0.9% 35176693 / 35296552 / -0.3% 0.66 / 0.65 / +1.3%
tpcds_q69/duckdb:vortex-file-compressed 22511293 / 22017648 / +2.2% 36660565 / 36691775 / -0.1% 0.61 / 0.60 / +2.3%
tpcds_q70/duckdb:vortex-file-compressed 14910426 / 14724129 / +1.3% 25871599 / 25052861 / +3.3% 0.58 / 0.59 / -1.9%
tpcds_q71/duckdb:vortex-file-compressed 14741550 / 13347567 / +10.4% 🔴 22701482 / 23409485 / -3.0% 0.65 / 0.57 / +13.9%
tpcds_q72/duckdb:vortex-file-compressed 42824286 / 43060600 / -0.5% 56006475 / 56269909 / -0.5% 0.76 / 0.77 / -0.1%
tpcds_q73/duckdb:vortex-file-compressed 12201047 / 11829364 / +3.1% 20831568 / 21106781 / -1.3% 0.59 / 0.56 / +4.5%
tpcds_q74/duckdb:vortex-file-compressed 30909098 / 30874616 / +0.1% 39508193 / 39304395 / +0.5% 0.78 / 0.79 / -0.4%
tpcds_q75/duckdb:vortex-file-compressed 38268409 / 37067086 / +3.2% 50110312 / 48402666 / +3.5% 0.76 / 0.77 / -0.3%
tpcds_q76/duckdb:vortex-file-compressed 12916683 / 12879005 / +0.3% 21430584 / 22058251 / -2.8% 0.60 / 0.58 / +3.2%
tpcds_q77/duckdb:vortex-file-compressed 20933688 / 20386666 / +2.7% 31579182 / 31298903 / +0.9% 0.66 / 0.65 / +1.8%
tpcds_q78/duckdb:vortex-file-compressed 43005244 / 42921238 / +0.2% 55049513 / 52920959 / +4.0% 0.78 / 0.81 / -3.7%
tpcds_q79/duckdb:vortex-file-compressed 17367078 / 17204298 / +0.9% 27900687 / 26915068 / +3.7% 0.62 / 0.64 / -2.6%
tpcds_q80/duckdb:vortex-file-compressed 30626000 / 29835128 / +2.7% 43083436 / 43751968 / -1.5% 0.71 / 0.68 / +4.2%
tpcds_q81/duckdb:vortex-file-compressed 21386497 / 21403570 / -0.1% 29742195 / 30302750 / -1.8% 0.72 / 0.71 / +1.8%
tpcds_q82/duckdb:vortex-file-compressed 9780700 / 9601288 / +1.9% 24418273 / 23700733 / +3.0% 0.40 / 0.41 / -1.1%
tpcds_q83/duckdb:vortex-file-compressed 17867264 / 17487681 / +2.2% 25487877 / 24391032 / +4.5% 0.70 / 0.72 / -2.2%
tpcds_q84/duckdb:vortex-file-compressed 15575259 / 15474432 / +0.7% 22965301 / 23926919 / -4.0% 0.68 / 0.65 / +4.9%
tpcds_q85/duckdb:vortex-file-compressed 25360044 / 25015558 / +1.4% 36517573 / 36358715 / +0.4% 0.69 / 0.69 / +0.9%
tpcds_q86/duckdb:vortex-file-compressed 9788594 / 9625184 / +1.7% 16159438 / 16115124 / +0.3% 0.61 / 0.60 / +1.4%
tpcds_q87/duckdb:vortex-file-compressed 26410107 / 26050646 / +1.4% 34075194 / 33749194 / +1.0% 0.78 / 0.77 / +0.4%
tpcds_q88/duckdb:vortex-file-compressed 30710562 / 30341066 / +1.2% 39151078 / 40666123 / -3.7% 0.78 / 0.75 / +5.1%
tpcds_q89/duckdb:vortex-file-compressed 11995617 / 11880278 / +1.0% 20847792 / 21020275 / -0.8% 0.58 / 0.57 / +1.8%
tpcds_q90/duckdb:vortex-file-compressed 7880555 / 7873380 / +0.1% 15077443 / 15793821 / -4.5% 0.52 / 0.50 / +4.8%
tpcds_q91/duckdb:vortex-file-compressed 15091271 / 14680431 / +2.8% 23210905 / 23432754 / -0.9% 0.65 / 0.63 / +3.8%
tpcds_q92/duckdb:vortex-file-compressed 10479346 / 10362186 / +1.1% 18427797 / 17798675 / +3.5% 0.57 / 0.58 / -2.3%
tpcds_q93/duckdb:vortex-file-compressed 10315100 / 10321070 / -0.1% 23226231 / 22416155 / +3.6% 0.44 / 0.46 / -3.5%
tpcds_q94/duckdb:vortex-file-compressed 22173471 / 22085020 / +0.4% 31630185 / 31715817 / -0.3% 0.70 / 0.70 / +0.7%
tpcds_q95/duckdb:vortex-file-compressed 61192638 / 60520896 / +1.1% 68095340 / 67458992 / +0.9% 0.90 / 0.90 / +0.2%
tpcds_q96/duckdb:vortex-file-compressed 6629887 / 6497133 / +2.0% 16330062 / 15310655 / +6.7% 0.41 / 0.42 / -4.3%
tpcds_q97/duckdb:vortex-file-compressed 23624815 / 22917520 / +3.1% 34388425 / 31822045 / +8.1% 0.69 / 0.72 / -4.6%
tpcds_q98/duckdb:vortex-file-compressed 11143420 / 10919490 / +2.1% 19117086 / 19425955 / -1.6% 0.58 / 0.56 / +3.7%
tpcds_q99/duckdb:vortex-file-compressed 14760914 / 14421880 / +2.4% 21971589 / 22012689 / -0.2% 0.67 / 0.66 / +2.5%
duckdb / parquet / ns (1.009x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24445181 / 24093628 / +1.5% 30795828 / 30609636 / +0.6% 0.79 / 0.79 / +0.8%
tpcds_q02/duckdb:parquet 17966230 / 17984803 / -0.1% 24174267 / 24025915 / +0.6% 0.74 / 0.75 / -0.7%
tpcds_q03/duckdb:parquet 9727218 / 9812261 / -0.9% 15353832 / 15610845 / -1.6% 0.63 / 0.63 / +0.8%
tpcds_q04/duckdb:parquet 119402775 / 118053322 / +1.1% 125098194 / 125451786 / -0.3% 0.95 / 0.94 / +1.4%
tpcds_q05/duckdb:parquet 28820354 / 28431532 / +1.4% 33215468 / 33184023 / +0.1% 0.87 / 0.86 / +1.3%
tpcds_q06/duckdb:parquet 26547502 / 26561266 / -0.1% 36415565 / 34919227 / +4.3% 0.73 / 0.76 / -4.2%
tpcds_q07/duckdb:parquet 31246808 / 31458600 / -0.7% 38383198 / 38910397 / -1.4% 0.81 / 0.81 / +0.7%
tpcds_q08/duckdb:parquet 19986276 / 19835614 / +0.8% 26265366 / 26315778 / -0.2% 0.76 / 0.75 / +1.0%
tpcds_q09/duckdb:parquet 27840004 / 27590826 / +0.9% 30547948 / 29561025 / +3.3% 0.91 / 0.93 / -2.4%
tpcds_q10/duckdb:parquet 33195192 / 32550451 / +2.0% 40891199 / 40051128 / +2.1% 0.81 / 0.81 / -0.1%
tpcds_q11/duckdb:parquet 68852164 / 68928280 / -0.1% 75512327 / 76188001 / -0.9% 0.91 / 0.90 / +0.8%
tpcds_q12/duckdb:parquet 14079638 / 13995176 / +0.6% 18913215 / 19053083 / -0.7% 0.74 / 0.73 / +1.3%
tpcds_q13/duckdb:parquet 30428672 / 33308439 / -8.6% 39627249 / 39541391 / +0.2% 0.77 / 0.84 / -8.8%
tpcds_q14/duckdb:parquet 64513553 / 64769091 / -0.4% 69473340 / 68114003 / +2.0% 0.93 / 0.95 / -2.3%
tpcds_q15/duckdb:parquet 16732502 / 16637540 / +0.6% 22555935 / 22243900 / +1.4% 0.74 / 0.75 / -0.8%
tpcds_q16/duckdb:parquet 30699450 / 30104670 / +2.0% 37554723 / 37135181 / +1.1% 0.82 / 0.81 / +0.8%
tpcds_q17/duckdb:parquet 34783016 / 34477460 / +0.9% 39998671 / 40356696 / -0.9% 0.87 / 0.85 / +1.8%
tpcds_q18/duckdb:parquet 47527616 / 47148372 / +0.8% 55700727 / 54249081 / +2.7% 0.85 / 0.87 / -1.8%
tpcds_q19/duckdb:parquet 19072814 / 19018304 / +0.3% 25877877 / 25382414 / +2.0% 0.74 / 0.75 / -1.6%
tpcds_q20/duckdb:parquet 14956157 / 14902117 / +0.4% 19654308 / 19412123 / +1.2% 0.76 / 0.77 / -0.9%
tpcds_q21/duckdb:parquet 10639623 / 10731116 / -0.9% 16796493 / 17030686 / -1.4% 0.63 / 0.63 / +0.5%
tpcds_q22/duckdb:parquet 20936276 / 20507718 / +2.1% 26450533 / 26762155 / -1.2% 0.79 / 0.77 / +3.3%
tpcds_q23/duckdb:parquet 44854014 / 42833082 / +4.7% 47100785 / 49424056 / -4.7% 0.95 / 0.87 / +9.9%
tpcds_q24/duckdb:parquet 30420140 / 29943294 / +1.6% 37059366 / 36464447 / +1.6% 0.82 / 0.82 / -0.0%
tpcds_q25/duckdb:parquet 30680584 / 30514354 / +0.5% 37097975 / 37025273 / +0.2% 0.83 / 0.82 / +0.3%
tpcds_q26/duckdb:parquet 29268382 / 29252328 / +0.1% 34888193 / 35038512 / -0.4% 0.84 / 0.83 / +0.5%
tpcds_q27/duckdb:parquet 33739814 / 34872377 / -3.2% 41415733 / 41229992 / +0.5% 0.81 / 0.85 / -3.7%
tpcds_q28/duckdb:parquet 26650700 / 25185258 / +5.8% 34638462 / 31104212 / +11.4% 🔴 0.77 / 0.81 / -5.0%
tpcds_q29/duckdb:parquet 32470868 / 32150195 / +1.0% 38735363 / 38969206 / -0.6% 0.84 / 0.83 / +1.6%
tpcds_q30/duckdb:parquet 35639050 / 35528874 / +0.3% 44691662 / 44172843 / +1.2% 0.80 / 0.80 / -0.9%
tpcds_q31/duckdb:parquet 35935692 / 35529000 / +1.1% 43110767 / 42639874 / +1.1% 0.83 / 0.83 / +0.0%
tpcds_q32/duckdb:parquet 14358704 / 14179243 / +1.3% 21303899 / 21025962 / +1.3% 0.67 / 0.67 / -0.1%
tpcds_q33/duckdb:parquet 26004457 / 23095442 / +12.6% 🔴 29598808 / 28549004 / +3.7% 0.88 / 0.81 / +8.6%
tpcds_q34/duckdb:parquet 17213862 / 16952271 / +1.5% 24439581 / 24176719 / +1.1% 0.70 / 0.70 / +0.5%
tpcds_q35/duckdb:parquet 35556406 / 34975734 / +1.7% 44167010 / 43207543 / +2.2% 0.81 / 0.81 / -0.5%
tpcds_q36/duckdb:parquet 41924840 / 39485050 / +6.2% 47469911 / 47479406 / -0.0% 0.88 / 0.83 / +6.2%
tpcds_q37/duckdb:parquet 12664971 / 12797622 / -1.0% 19263998 / 19277008 / -0.1% 0.66 / 0.66 / -1.0%
tpcds_q38/duckdb:parquet 30056226 / 29621006 / +1.5% 33998079 / 33433489 / +1.7% 0.88 / 0.89 / -0.2%
tpcds_q39/duckdb:parquet 23442003 / 23128167 / +1.4% 30456936 / 29595365 / +2.9% 0.77 / 0.78 / -1.5%
tpcds_q40/duckdb:parquet 16056263 / 16054940 / +0.0% 20803674 / 21235777 / -2.0% 0.77 / 0.76 / +2.1%
tpcds_q41/duckdb:parquet 12025182 / 11966633 / +0.5% 18055300 / 18065700 / -0.1% 0.67 / 0.66 / +0.5%
tpcds_q42/duckdb:parquet 9557242 / 9626178 / -0.7% 15357475 / 15525610 / -1.1% 0.62 / 0.62 / +0.4%
tpcds_q43/duckdb:parquet 12151270 / 12048868 / +0.8% 18591598 / 18128038 / +2.6% 0.65 / 0.66 / -1.7%
tpcds_q44/duckdb:parquet 21522936 / 21607511 / -0.4% 27412792 / 26196804 / +4.6% 0.79 / 0.82 / -4.8%
tpcds_q45/duckdb:parquet 21258750 / 20908743 / +1.7% 28084635 / 27486675 / +2.2% 0.76 / 0.76 / -0.5%
tpcds_q46/duckdb:parquet 36961964 / 35288508 / +4.7% 43667246 / 43320711 / +0.8% 0.85 / 0.81 / +3.9%
tpcds_q47/duckdb:parquet 34726852 / 34531498 / +0.6% 41637307 / 41336316 / +0.7% 0.83 / 0.84 / -0.2%
tpcds_q48/duckdb:parquet 28821322 / 29103170 / -1.0% 36767551 / 36426435 / +0.9% 0.78 / 0.80 / -1.9%
tpcds_q49/duckdb:parquet 30464139 / 30233053 / +0.8% 36049515 / 36303817 / -0.7% 0.85 / 0.83 / +1.5%
tpcds_q50/duckdb:parquet 19640106 / 20388898 / -3.7% 25782104 / 25331399 / +1.8% 0.76 / 0.80 / -5.4%
tpcds_q51/duckdb:parquet 52762229 / 52104356 / +1.3% 60137584 / 61245199 / -1.8% 0.88 / 0.85 / +3.1%
tpcds_q52/duckdb:parquet 9786760 / 9659180 / +1.3% 15747537 / 15499988 / +1.6% 0.62 / 0.62 / -0.3%
tpcds_q53/duckdb:parquet 14173958 / 14537118 / -2.5% 21115200 / 20752143 / +1.7% 0.67 / 0.70 / -4.2%
tpcds_q54/duckdb:parquet 25259370 / 24733616 / +2.1% 32165419 / 31908376 / +0.8% 0.79 / 0.78 / +1.3%
tpcds_q55/duckdb:parquet 10752576 / 9489484 / +13.3% 🔴 15517664 / 15341981 / +1.1% 0.69 / 0.62 / +12.0%
tpcds_q56/duckdb:parquet 27071108 / 27141406 / -0.3% 30889188 / 30419221 / +1.5% 0.88 / 0.89 / -1.8%
tpcds_q57/duckdb:parquet 30919654 / 30693180 / +0.7% 35855985 / 36167354 / -0.9% 0.86 / 0.85 / +1.6%
tpcds_q58/duckdb:parquet 24429619 / 23919381 / +2.1% 30032053 / 29814453 / +0.7% 0.81 / 0.80 / +1.4%
tpcds_q59/duckdb:parquet 23042356 / 22867650 / +0.8% 29032571 / 28707391 / +1.1% 0.79 / 0.80 / -0.4%
tpcds_q60/duckdb:parquet 27618730 / 26316208 / +4.9% 32701471 / 31957179 / +2.3% 0.84 / 0.82 / +2.6%
tpcds_q61/duckdb:parquet 25487104 / 24749493 / +3.0% 29391118 / 29026258 / +1.3% 0.87 / 0.85 / +1.7%
tpcds_q62/duckdb:parquet 13082070 / 12721642 / +2.8% 18165268 / 17771445 / +2.2% 0.72 / 0.72 / +0.6%
tpcds_q63/duckdb:parquet 14717400 / 14341675 / +2.6% 20083708 / 20011856 / +0.4% 0.73 / 0.72 / +2.3%
tpcds_q64/duckdb:parquet 71197031 / 70307914 / +1.3% 79603305 / 79575965 / +0.0% 0.89 / 0.88 / +1.2%
tpcds_q65/duckdb:parquet 19159641 / 20569484 / -6.9% 25769701 / 25477560 / +1.1% 0.74 / 0.81 / -7.9%
tpcds_q66/duckdb:parquet 33441474 / 33045765 / +1.2% 39026693 / 38019443 / +2.6% 0.86 / 0.87 / -1.4%
tpcds_q67/duckdb:parquet 61477545 / 61027914 / +0.7% 67581823 / 66818321 / +1.1% 0.91 / 0.91 / -0.4%
tpcds_q68/duckdb:parquet 28264840 / 30834914 / -8.3% 35853393 / 35993030 / -0.4% 0.79 / 0.86 / -8.0%
tpcds_q69/duckdb:parquet 26536566 / 25794512 / +2.9% 34790198 / 33964184 / +2.4% 0.76 / 0.76 / +0.4%
tpcds_q70/duckdb:parquet 19334085 / 19255869 / +0.4% 26678733 / 26582665 / +0.4% 0.72 / 0.72 / +0.0%
tpcds_q71/duckdb:parquet 17207612 / 16803522 / +2.4% 24309704 / 23382022 / +4.0% 0.71 / 0.72 / -1.5%
tpcds_q72/duckdb:parquet 53367607 / 53014220 / +0.7% 59255960 / 59449489 / -0.3% 0.90 / 0.89 / +1.0%
tpcds_q73/duckdb:parquet 15019758 / 15895421 / -5.5% 21824614 / 21585777 / +1.1% 0.69 / 0.74 / -6.5%
tpcds_q74/duckdb:parquet 84947994 / 85004257 / -0.1% 90926294 / 89575448 / +1.5% 0.93 / 0.95 / -1.6%
tpcds_q75/duckdb:parquet 46162316 / 44183878 / +4.5% 50382971 / 49282250 / +2.2% 0.92 / 0.90 / +2.2%
tpcds_q76/duckdb:parquet 19006266 / 18510097 / +2.7% 23481748 / 22802776 / +3.0% 0.81 / 0.81 / -0.3%
tpcds_q77/duckdb:parquet 24805094 / 25530442 / -2.8% 31813496 / 31441226 / +1.2% 0.78 / 0.81 / -4.0%
tpcds_q78/duckdb:parquet 78402146 / 78229121 / +0.2% 84756978 / 85641462 / -1.0% 0.93 / 0.91 / +1.3%
tpcds_q79/duckdb:parquet 21461474 / 24067906 / -10.8% 🟢 28753939 / 28358044 / +1.4% 0.75 / 0.85 / -12.1%
tpcds_q80/duckdb:parquet 37830376 / 38479893 / -1.7% 44486371 / 43843592 / +1.5% 0.85 / 0.88 / -3.1%
tpcds_q81/duckdb:parquet 36647174 / 36125748 / +1.4% 45512565 / 44907713 / +1.3% 0.81 / 0.80 / +0.1%
tpcds_q82/duckdb:parquet 13748768 / 13496682 / +1.9% 20070221 / 20103202 / -0.2% 0.69 / 0.67 / +2.0%
tpcds_q83/duckdb:parquet 20778008 / 19941274 / +4.2% 25721246 / 24813592 / +3.7% 0.81 / 0.80 / +0.5%
tpcds_q84/duckdb:parquet 23210450 / 23090262 / +0.5% 29417312 / 28462809 / +3.4% 0.79 / 0.81 / -2.7%
tpcds_q85/duckdb:parquet 32596894 / 32217004 / +1.2% 39535223 / 38985194 / +1.4% 0.82 / 0.83 / -0.2%
tpcds_q86/duckdb:parquet 11863735 / 11811458 / +0.4% 17297306 / 16496302 / +4.9% 0.69 / 0.72 / -4.2%
tpcds_q87/duckdb:parquet 31712180 / 31436775 / +0.9% 36714216 / 35185024 / +4.3% 0.86 / 0.89 / -3.3%
tpcds_q88/duckdb:parquet 39303955 / 38059442 / +3.3% 43670233 / 41928306 / +4.2% 0.90 / 0.91 / -0.8%
tpcds_q89/duckdb:parquet 15760742 / 14206404 / +10.9% 🔴 21194162 / 21172421 / +0.1% 0.74 / 0.67 / +10.8%
tpcds_q90/duckdb:parquet 10375960 / 10080660 / +2.9% 15720355 / 15448563 / +1.8% 0.66 / 0.65 / +1.1%
tpcds_q91/duckdb:parquet 21472068 / 21048574 / +2.0% 28605023 / 28220317 / +1.4% 0.75 / 0.75 / +0.6%
tpcds_q92/duckdb:parquet 15800405 / 15572126 / +1.5% 22279915 / 22096515 / +0.8% 0.71 / 0.70 / +0.6%
tpcds_q93/duckdb:parquet 14290302 / 14091483 / +1.4% 20255333 / 20175447 / +0.4% 0.71 / 0.70 / +1.0%
tpcds_q94/duckdb:parquet 25891927 / 25392360 / +2.0% 33263785 / 32388339 / +2.7% 0.78 / 0.78 / -0.7%
tpcds_q95/duckdb:parquet 44351161 / 43748374 / +1.4% 49336054 / 49895274 / -1.1% 0.90 / 0.88 / +2.5%
tpcds_q96/duckdb:parquet 8430584 / 8272491 / +1.9% 14192867 / 13988491 / +1.5% 0.59 / 0.59 / +0.4%
tpcds_q97/duckdb:parquet 27750946 / 27667050 / +0.3% 32864834 / 32852985 / +0.0% 0.84 / 0.84 / +0.3%
tpcds_q98/duckdb:parquet 16538500 / 16378365 / +1.0% 22564292 / 22777602 / -0.9% 0.73 / 0.72 / +1.9%
tpcds_q99/duckdb:parquet 18840759 / 18807829 / +0.2% 24789074 / 24915617 / -0.5% 0.76 / 0.75 / +0.7%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 768b49f9 vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35785000 / 35836658 / -0.1% 61703174 / 59839649 / +3.1% 0.58 / 0.60 / -3.2%
tpcds_q02/datafusion:vortex-file-compressed 50202619 / 51540980 / -2.6% 76397042 / 75356430 / +1.4% 0.66 / 0.68 / -3.9%
tpcds_q03/datafusion:vortex-file-compressed 20672296 / 20246396 / +2.1% 44126534 / 46166223 / -4.4% 0.47 / 0.44 / +6.8%
tpcds_q04/datafusion:vortex-file-compressed 293179744 / 293432920 / -0.1% 354671835 / 354050198 / +0.2% 0.83 / 0.83 / -0.3%
tpcds_q05/datafusion:vortex-file-compressed 71601264 / 71656747 / -0.1% 107114120 / 107692212 / -0.5% 0.67 / 0.67 / +0.5%
tpcds_q06/datafusion:vortex-file-compressed 42521880 / 42258217 / +0.6% 72698679 / 70535607 / +3.1% 0.58 / 0.60 / -2.4%
tpcds_q07/datafusion:vortex-file-compressed 41854609 / 42156216 / -0.7% 78955049 / 80613054 / -2.1% 0.53 / 0.52 / +1.4%
tpcds_q08/datafusion:vortex-file-compressed 29193286 / 28614063 / +2.0% 56232339 / 57730721 / -2.6% 0.52 / 0.50 / +4.7%
tpcds_q09/datafusion:vortex-file-compressed 43141162 / 44012164 / -2.0% 78326479 / 77101674 / +1.6% 0.55 / 0.57 / -3.5%
tpcds_q10/datafusion:vortex-file-compressed 37773564 / 37189576 / +1.6% 64665270 / 63021635 / +2.6% 0.58 / 0.59 / -1.0%
tpcds_q11/datafusion:vortex-file-compressed 175919836 / 174495550 / +0.8% 216640026 / 221987691 / -2.4% 0.81 / 0.79 / +3.3%
tpcds_q12/datafusion:vortex-file-compressed 17795396 / 17549844 / +1.4% 38458862 / 38571171 / -0.3% 0.46 / 0.45 / +1.7%
tpcds_q13/datafusion:vortex-file-compressed 38690012 / 38899632 / -0.5% 83235897 / 85520203 / -2.7% 0.46 / 0.45 / +2.2%
tpcds_q14/datafusion:vortex-file-compressed 232211006 / 231725092 / +0.2% 278636041 / 271215982 / +2.7% 0.83 / 0.85 / -2.5%
tpcds_q15/datafusion:vortex-file-compressed 40436833 / 40095029 / +0.9% 54422959 / 54164984 / +0.5% 0.74 / 0.74 / +0.4%
tpcds_q16/datafusion:vortex-file-compressed 24588263 / 22869641 / +7.5% 43648866 / 42034772 / +3.8% 0.56 / 0.54 / +3.5%
tpcds_q17/datafusion:vortex-file-compressed 64599902 / 64808376 / -0.3% 96976914 / 89558176 / +8.3% 0.67 / 0.72 / -7.9%
tpcds_q18/datafusion:vortex-file-compressed 69106052 / 69097730 / +0.0% 98225800 / 94787906 / +3.6% 0.70 / 0.73 / -3.5%
tpcds_q19/datafusion:vortex-file-compressed 23272102 / 22408799 / +3.9% 55634894 / 55496169 / +0.2% 0.42 / 0.40 / +3.6%
tpcds_q20/datafusion:vortex-file-compressed 24182694 / 23702741 / +2.0% 41405139 / 40220803 / +2.9% 0.58 / 0.59 / -0.9%
tpcds_q21/datafusion:vortex-file-compressed 47357014 / 47542674 / -0.4% 63755614 / 64058585 / -0.5% 0.74 / 0.74 / +0.1%
tpcds_q22/datafusion:vortex-file-compressed 436060244 / 431366016 / +1.1% 466566384 / 465284097 / +0.3% 0.93 / 0.93 / +0.8%
tpcds_q23/datafusion:vortex-file-compressed 300488115 / 299587271 / +0.3% 349346461 / 351318540 / -0.6% 0.86 / 0.85 / +0.9%
tpcds_q24/datafusion:vortex-file-compressed 119266144 / 120023524 / -0.6% 152513525 / 159982078 / -4.7% 0.78 / 0.75 / +4.2%
tpcds_q25/datafusion:vortex-file-compressed 63071444 / 63311010 / -0.4% 99910463 / 102454935 / -2.5% 0.63 / 0.62 / +2.2%
tpcds_q26/datafusion:vortex-file-compressed 37090760 / 37429288 / -0.9% 60048437 / 59331611 / +1.2% 0.62 / 0.63 / -2.1%
tpcds_q27/datafusion:vortex-file-compressed 75032510 / 72377160 / +3.7% 105258833 / 104225546 / +1.0% 0.71 / 0.69 / +2.7%
tpcds_q28/datafusion:vortex-file-compressed 42624706 / 42296916 / +0.8% 85589569 / 82755038 / +3.4% 0.50 / 0.51 / -2.6%
tpcds_q29/datafusion:vortex-file-compressed 65021584 / 61922299 / +5.0% 105975609 / 97201813 / +9.0% 0.61 / 0.64 / -3.7%
tpcds_q30/datafusion:vortex-file-compressed 51803166 / 51311054 / +1.0% 78232476 / 79114003 / -1.1% 0.66 / 0.65 / +2.1%
tpcds_q31/datafusion:vortex-file-compressed 198264593 / 196557266 / +0.9% 232891411 / 235875877 / -1.3% 0.85 / 0.83 / +2.2%
tpcds_q32/datafusion:vortex-file-compressed 15089236 / 15236954 / -1.0% 32289680 / 31554300 / +2.3% 0.47 / 0.48 / -3.2%
tpcds_q33/datafusion:vortex-file-compressed 33155598 / 33321710 / -0.5% 68727932 / 67027574 / +2.5% 0.48 / 0.50 / -3.0%
tpcds_q34/datafusion:vortex-file-compressed 40719318 / 41148345 / -1.0% 67857001 / 68234625 / -0.6% 0.60 / 0.60 / -0.5%
tpcds_q35/datafusion:vortex-file-compressed 92303377 / 92443260 / -0.2% 121282326 / 120652799 / +0.5% 0.76 / 0.77 / -0.7%
tpcds_q36/datafusion:vortex-file-compressed 65724629 / 65946206 / -0.3% 100408223 / 100250170 / +0.2% 0.65 / 0.66 / -0.5%
tpcds_q37/datafusion:vortex-file-compressed 24754922 / 23553139 / +5.1% 43033377 / 43598667 / -1.3% 0.58 / 0.54 / +6.5%
tpcds_q38/datafusion:vortex-file-compressed 79202364 / 76507711 / +3.5% 111384124 / 106221269 / +4.9% 0.71 / 0.72 / -1.3%
tpcds_q39/datafusion:vortex-file-compressed 886600878 / 887680404 / -0.1% 904858405 / 906829393 / -0.2% 0.98 / 0.98 / +0.1%
tpcds_q40/datafusion:vortex-file-compressed 28774516 / 28735451 / +0.1% 49415277 / 47789817 / +3.4% 0.58 / 0.60 / -3.2%
tpcds_q41/datafusion:vortex-file-compressed 20726922 / 19056672 / +8.8% 31893810 / 30560191 / +4.4% 0.65 / 0.62 / +4.2%
tpcds_q42/datafusion:vortex-file-compressed 14381164 / 14306364 / +0.5% 39986745 / 39330916 / +1.7% 0.36 / 0.36 / -1.1%
tpcds_q43/datafusion:vortex-file-compressed 17498878 / 17123520 / +2.2% 41098665 / 40887604 / +0.5% 0.43 / 0.42 / +1.7%
tpcds_q44/datafusion:vortex-file-compressed 43391877 / 42841783 / +1.3% 72524485 / 73034215 / -0.7% 0.60 / 0.59 / +2.0%
tpcds_q45/datafusion:vortex-file-compressed 42315917 / 42716522 / -0.9% 68766338 / 64325351 / +6.9% 0.62 / 0.66 / -7.3%
tpcds_q46/datafusion:vortex-file-compressed 72711088 / 70770951 / +2.7% 103554576 / 103002911 / +0.5% 0.70 / 0.69 / +2.2%
tpcds_q47/datafusion:vortex-file-compressed 172134317 / 176930862 / -2.7% 220294044 / 217533458 / +1.3% 0.78 / 0.81 / -3.9%
tpcds_q48/datafusion:vortex-file-compressed 35914361 / 35477019 / +1.2% 70727540 / 70167195 / +0.8% 0.51 / 0.51 / +0.4%
tpcds_q49/datafusion:vortex-file-compressed 78625248 / 79901468 / -1.6% 120206646 / 120233831 / -0.0% 0.65 / 0.66 / -1.6%
tpcds_q50/datafusion:vortex-file-compressed 56216874 / 56310110 / -0.2% 84976344 / 89046429 / -4.6% 0.66 / 0.63 / +4.6%
tpcds_q51/datafusion:vortex-file-compressed 242087990 / 241461239 / +0.3% 276047005 / 280306123 / -1.5% 0.88 / 0.86 / +1.8%
tpcds_q52/datafusion:vortex-file-compressed 14747560 / 14942948 / -1.3% 40696619 / 41146983 / -1.1% 0.36 / 0.36 / -0.2%
tpcds_q53/datafusion:vortex-file-compressed 22769926 / 23025893 / -1.1% 53931637 / 52394142 / +2.9% 0.42 / 0.44 / -3.9%
tpcds_q54/datafusion:vortex-file-compressed 59827137 / 59630808 / +0.3% 90519007 / 92798502 / -2.5% 0.66 / 0.64 / +2.9%
tpcds_q55/datafusion:vortex-file-compressed 14173136 / 15209610 / -6.8% 39166081 / 39200802 / -0.1% 0.36 / 0.39 / -6.7%
tpcds_q56/datafusion:vortex-file-compressed 33395460 / 34211642 / -2.4% 64022919 / 63579406 / +0.7% 0.52 / 0.54 / -3.1%
tpcds_q57/datafusion:vortex-file-compressed 131869960 / 130827096 / +0.8% 159187680 / 162474233 / -2.0% 0.83 / 0.81 / +2.9%
tpcds_q58/datafusion:vortex-file-compressed 48284144 / 49071762 / -1.6% 85030243 / 84738612 / +0.3% 0.57 / 0.58 / -1.9%
tpcds_q59/datafusion:vortex-file-compressed 55803230 / 54936949 / +1.6% 83103870 / 85696270 / -3.0% 0.67 / 0.64 / +4.7%
tpcds_q60/datafusion:vortex-file-compressed 34306463 / 34485962 / -0.5% 67407061 / 66114270 / +2.0% 0.51 / 0.52 / -2.4%
tpcds_q61/datafusion:vortex-file-compressed 45260171 / 45202724 / +0.1% 74231112 / 70916447 / +4.7% 0.61 / 0.64 / -4.3%
tpcds_q62/datafusion:vortex-file-compressed 19176780 / 19841460 / -3.3% 43107069 / 43084349 / +0.1% 0.44 / 0.46 / -3.4%
tpcds_q63/datafusion:vortex-file-compressed 22969314 / 22619521 / +1.5% 52391010 / 49716174 / +5.4% 0.44 / 0.45 / -3.6%
tpcds_q64/datafusion:vortex-file-compressed 334156106 / 332776120 / +0.4% 402278819 / 399340320 / +0.7% 0.83 / 0.83 / -0.3%
tpcds_q65/datafusion:vortex-file-compressed 73274232 / 73751860 / -0.6% 111243879 / 110569158 / +0.6% 0.66 / 0.67 / -1.3%
tpcds_q66/datafusion:vortex-file-compressed 52139434 / 52486634 / -0.7% 78165611 / 77837826 / +0.4% 0.67 / 0.67 / -1.1%
tpcds_q67/datafusion:vortex-file-compressed 422850058 / 420503111 / +0.6% 517156086 / 528828691 / -2.2% 0.82 / 0.80 / +2.8%
tpcds_q68/datafusion:vortex-file-compressed 66273870 / 66831493 / -0.8% 102953565 / 99391180 / +3.6% 0.64 / 0.67 / -4.3%
tpcds_q69/datafusion:vortex-file-compressed 36234010 / 36278824 / -0.1% 64094599 / 63625322 / +0.7% 0.57 / 0.57 / -0.9%
tpcds_q70/datafusion:vortex-file-compressed 196875068 / 194497137 / +1.2% 230785350 / 232217411 / -0.6% 0.85 / 0.84 / +1.9%
tpcds_q71/datafusion:vortex-file-compressed 26363020 / 25424784 / +3.7% 58490589 / 61267492 / -4.5% 0.45 / 0.41 / +8.6%
tpcds_q72/datafusion:vortex-file-compressed 1635760662 / 1575229677 / +3.8% 1675382308 / 1696144047 / -1.2% 0.98 / 0.93 / +5.1%
tpcds_q73/datafusion:vortex-file-compressed 38412907 / 38589712 / -0.5% 64724342 / 62969996 / +2.8% 0.59 / 0.61 / -3.2%
tpcds_q74/datafusion:vortex-file-compressed 134376089 / 134601274 / -0.2% 174852148 / 173765353 / +0.6% 0.77 / 0.77 / -0.8%
tpcds_q75/datafusion:vortex-file-compressed 155269516 / 155633299 / -0.2% 204610560 / 198511793 / +3.1% 0.76 / 0.78 / -3.2%
tpcds_q76/datafusion:vortex-file-compressed 34069684 / 34722660 / -1.9% 77534195 / 73189101 / +5.9% 0.44 / 0.47 / -7.4%
tpcds_q77/datafusion:vortex-file-compressed 54649053 / 54175824 / +0.9% 90461722 / 87493805 / +3.4% 0.60 / 0.62 / -2.4%
tpcds_q78/datafusion:vortex-file-compressed 141897338 / 140889933 / +0.7% 192119013 / 191779256 / +0.2% 0.74 / 0.73 / +0.5%
tpcds_q79/datafusion:vortex-file-compressed 53900343 / 53408896 / +0.9% 86943297 / 83137730 / +4.6% 0.62 / 0.64 / -3.5%
tpcds_q80/datafusion:vortex-file-compressed 81355907 / 80795658 / +0.7% 131632348 / 127799771 / +3.0% 0.62 / 0.63 / -2.2%
tpcds_q81/datafusion:vortex-file-compressed 55623776 / 55975548 / -0.6% 84643114 / 83846761 / +0.9% 0.66 / 0.67 / -1.6%
tpcds_q82/datafusion:vortex-file-compressed 30308356 / 30549740 / -0.8% 53611080 / 48106493 / +11.4% 🔴 0.57 / 0.64 / -11.0%
tpcds_q83/datafusion:vortex-file-compressed 42422312 / 42358020 / +0.2% 65560746 / 65597866 / -0.1% 0.65 / 0.65 / +0.2%
tpcds_q84/datafusion:vortex-file-compressed 13419356 / 12799204 / +4.8% 32564674 / 30970538 / +5.1% 0.41 / 0.41 / -0.3%
tpcds_q85/datafusion:vortex-file-compressed 59655578 / 60660052 / -1.7% 95240767 / 90654953 / +5.1% 0.63 / 0.67 / -6.4%
tpcds_q86/datafusion:vortex-file-compressed 18161884 / 18272155 / -0.6% 39652096 / 40425570 / -1.9% 0.46 / 0.45 / +1.3%
tpcds_q87/datafusion:vortex-file-compressed 78789696 / 79615489 / -1.0% 109152551 / 107689679 / +1.4% 0.72 / 0.74 / -2.4%
tpcds_q88/datafusion:vortex-file-compressed 53866310 / 56206700 / -4.2% 92974873 / 93094539 / -0.1% 0.58 / 0.60 / -4.0%
tpcds_q89/datafusion:vortex-file-compressed 26508296 / 26931306 / -1.6% 56211285 / 56072635 / +0.2% 0.47 / 0.48 / -1.8%
tpcds_q90/datafusion:vortex-file-compressed 12188458 / 12758200 / -4.5% 30329967 / 34107490 / -11.1% 🟢 0.40 / 0.37 / +7.4%
tpcds_q91/datafusion:vortex-file-compressed 19410838 / 19519254 / -0.6% 41465687 / 42141655 / -1.6% 0.47 / 0.46 / +1.1%
tpcds_q92/datafusion:vortex-file-compressed 15378316 / 15245025 / +0.9% 36958987 / 33922326 / +9.0% 0.42 / 0.45 / -7.4%
tpcds_q93/datafusion:vortex-file-compressed 55241194 / 54842766 / +0.7% 91993102 / 88696680 / +3.7% 0.60 / 0.62 / -2.9%
tpcds_q94/datafusion:vortex-file-compressed 21573776 / 21620928 / -0.2% 45833170 / 46231785 / -0.9% 0.47 / 0.47 / +0.6%
tpcds_q95/datafusion:vortex-file-compressed 95558764 / 95000299 / +0.6% 129798149 / 123858370 / +4.8% 0.74 / 0.77 / -4.0%
tpcds_q96/datafusion:vortex-file-compressed 11663347 / 11533278 / +1.1% 30900673 / 31102793 / -0.6% 0.38 / 0.37 / +1.8%
tpcds_q97/datafusion:vortex-file-compressed 39212356 / 39467840 / -0.6% 68624539 / 66425488 / +3.3% 0.57 / 0.59 / -3.8%
tpcds_q98/datafusion:vortex-file-compressed 20496858 / 20665282 / -0.8% 50580980 / 48509099 / +4.3% 0.41 / 0.43 / -4.9%
tpcds_q99/datafusion:vortex-file-compressed 29682580 / 29545800 / +0.5% 49470386 / 48862458 / +1.2% 0.60 / 0.60 / -0.8%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 58895734 / 59408052 / -0.9% 77820686 / 82373568 / -5.5% 0.76 / 0.72 / +4.9%
tpcds_q02/datafusion:parquet 69290879 / 69761366 / -0.7% 90703933 / 90812813 / -0.1% 0.76 / 0.77 / -0.6%
tpcds_q03/datafusion:parquet 28463554 / 28478768 / -0.1% 50134830 / 49334251 / +1.6% 0.57 / 0.58 / -1.6%
tpcds_q04/datafusion:parquet 647286520 / 642610250 / +0.7% 712292252 / 708231753 / +0.6% 0.91 / 0.91 / +0.2%
tpcds_q05/datafusion:parquet 82701928 / 81388832 / +1.6% 116404173 / 113800720 / +2.3% 0.71 / 0.72 / -0.7%
tpcds_q06/datafusion:parquet 90624525 / 90852955 / -0.3% 112933378 / 115952402 / -2.6% 0.80 / 0.78 / +2.4%
tpcds_q07/datafusion:parquet 101612748 / 101418282 / +0.2% 135221366 / 133695330 / +1.1% 0.75 / 0.76 / -0.9%
tpcds_q08/datafusion:parquet 48885728 / 48684130 / +0.4% 77908791 / 74133519 / +5.1% 0.63 / 0.66 / -4.5%
tpcds_q09/datafusion:parquet 75029644 / 75160834 / -0.2% 106580889 / 102849415 / +3.6% 0.70 / 0.73 / -3.7%
tpcds_q10/datafusion:parquet 61236734 / 60416750 / +1.4% 87522612 / 84947233 / +3.0% 0.70 / 0.71 / -1.6%
tpcds_q11/datafusion:parquet 409554167 / 412444870 / -0.7% 449914689 / 461294550 / -2.5% 0.91 / 0.89 / +1.8%
tpcds_q12/datafusion:parquet 39766096 / 39871562 / -0.3% 59344430 / 57128529 / +3.9% 0.67 / 0.70 / -4.0%
tpcds_q13/datafusion:parquet 84701000 / 84637846 / +0.1% 137448651 / 130466094 / +5.4% 0.62 / 0.65 / -5.0%
tpcds_q14/datafusion:parquet 385189613 / 378360104 / +1.8% 416703617 / 433388374 / -3.8% 0.92 / 0.87 / +5.9%
tpcds_q15/datafusion:parquet 50705942 / 51502606 / -1.5% 73178310 / 72303263 / +1.2% 0.69 / 0.71 / -2.7%
tpcds_q16/datafusion:parquet 45468428 / 45710882 / -0.5% 62790608 / 63650471 / -1.4% 0.72 / 0.72 / +0.8%
tpcds_q17/datafusion:parquet 135156194 / 138067928 / -2.1% 163338671 / 172187136 / -5.1% 0.83 / 0.80 / +3.2%
tpcds_q18/datafusion:parquet 109475908 / 110369917 / -0.8% 140858359 / 144952536 / -2.8% 0.78 / 0.76 / +2.1%
tpcds_q19/datafusion:parquet 47374702 / 48384048 / -2.1% 79461210 / 75539146 / +5.2% 0.60 / 0.64 / -6.9%
tpcds_q20/datafusion:parquet 41423270 / 41512735 / -0.2% 56756627 / 55090816 / +3.0% 0.73 / 0.75 / -3.1%
tpcds_q21/datafusion:parquet 61514406 / 61141701 / +0.6% 76494995 / 73095747 / +4.7% 0.80 / 0.84 / -3.9%
tpcds_q22/datafusion:parquet 464489424 / 464195324 / +0.1% 480314075 / 478139930 / +0.5% 0.97 / 0.97 / -0.4%
tpcds_q23/datafusion:parquet 362788830 / 357626356 / +1.4% 413933093 / 417833459 / -0.9% 0.88 / 0.86 / +2.4%
tpcds_q24/datafusion:parquet 241691924 / 241331307 / +0.1% 279946770 / 278266611 / +0.6% 0.86 / 0.87 / -0.5%
tpcds_q25/datafusion:parquet 145541718 / 146902811 / -0.9% 182636860 / 196039200 / -6.8% 0.80 / 0.75 / +6.3%
tpcds_q26/datafusion:parquet 54802098 / 53821080 / +1.8% 79777863 / 80565923 / -1.0% 0.69 / 0.67 / +2.8%
tpcds_q27/datafusion:parquet 207064130 / 210089836 / -1.4% 240362840 / 235911774 / +1.9% 0.86 / 0.89 / -3.3%
tpcds_q28/datafusion:parquet 86626738 / 86784142 / -0.2% 117965861 / 119280232 / -1.1% 0.73 / 0.73 / +0.9%
tpcds_q29/datafusion:parquet 140740124 / 145820741 / -3.5% 173358074 / 175411233 / -1.2% 0.81 / 0.83 / -2.3%
tpcds_q30/datafusion:parquet 97087104 / 99608501 / -2.5% 117816916 / 120071149 / -1.9% 0.82 / 0.83 / -0.7%
tpcds_q31/datafusion:parquet 321191122 / 319058792 / +0.7% 349437155 / 344041143 / +1.6% 0.92 / 0.93 / -0.9%
tpcds_q32/datafusion:parquet 28972686 / 29399552 / -1.5% 43430272 / 43643939 / -0.5% 0.67 / 0.67 / -1.0%
tpcds_q33/datafusion:parquet 53266099 / 51971680 / +2.5% 77468684 / 76538194 / +1.2% 0.69 / 0.68 / +1.3%
tpcds_q34/datafusion:parquet 63756164 / 65511648 / -2.7% 86227123 / 85276600 / +1.1% 0.74 / 0.77 / -3.8%
tpcds_q35/datafusion:parquet 125290484 / 126922984 / -1.3% 150408837 / 150646646 / -0.2% 0.83 / 0.84 / -1.1%
tpcds_q36/datafusion:parquet 99878666 / 97863638 / +2.1% 129875295 / 126419427 / +2.7% 0.77 / 0.77 / -0.7%
tpcds_q37/datafusion:parquet 49106640 / 50046237 / -1.9% 63594501 / 65033749 / -2.2% 0.77 / 0.77 / +0.3%
tpcds_q38/datafusion:parquet 125487270 / 122147195 / +2.7% 148633732 / 145034869 / +2.5% 0.84 / 0.84 / +0.2%
tpcds_q39/datafusion:parquet 845579737 / 846526498 / -0.1% 863723126 / 859437879 / +0.5% 0.98 / 0.98 / -0.6%
tpcds_q40/datafusion:parquet 35480870 / 35936465 / -1.3% 54980551 / 54650564 / +0.6% 0.65 / 0.66 / -1.9%
tpcds_q41/datafusion:parquet 31732576 / 31200319 / +1.7% 42148452 / 42657926 / -1.2% 0.75 / 0.73 / +2.9%
tpcds_q42/datafusion:parquet 25961352 / 25952126 / +0.0% 44498658 / 43716014 / +1.8% 0.58 / 0.59 / -1.7%
tpcds_q43/datafusion:parquet 26718270 / 27372783 / -2.4% 48458391 / 46844617 / +3.4% 0.55 / 0.58 / -5.6%
tpcds_q44/datafusion:parquet 65627908 / 65006033 / +1.0% 85834542 / 87803178 / -2.2% 0.76 / 0.74 / +3.3%
tpcds_q45/datafusion:parquet 65781070 / 66536274 / -1.1% 85900954 / 87212845 / -1.5% 0.77 / 0.76 / +0.4%
tpcds_q46/datafusion:parquet 107942015 / 106805720 / +1.1% 149391197 / 153607976 / -2.7% 0.72 / 0.70 / +3.9%
tpcds_q47/datafusion:parquet 236459400 / 237808994 / -0.6% 273995371 / 273252482 / +0.3% 0.86 / 0.87 / -0.8%
tpcds_q48/datafusion:parquet 76489370 / 76955857 / -0.6% 112305071 / 105870247 / +6.1% 0.68 / 0.73 / -6.3%
tpcds_q49/datafusion:parquet 120457528 / 118898020 / +1.3% 147539357 / 170084458 / -13.3% 🟢 0.82 / 0.70 / +16.8%
tpcds_q50/datafusion:parquet 90930868 / 92705258 / -1.9% 122725715 / 120435148 / +1.9% 0.74 / 0.77 / -3.7%
tpcds_q51/datafusion:parquet 249886537 / 254091982 / -1.7% 286643984 / 289211985 / -0.9% 0.87 / 0.88 / -0.8%
tpcds_q52/datafusion:parquet 25858535 / 26889958 / -3.8% 48272750 / 45469536 / +6.2% 0.54 / 0.59 / -9.4%
tpcds_q53/datafusion:parquet 36891688 / 36382336 / +1.4% 58765610 / 57842390 / +1.6% 0.63 / 0.63 / -0.2%
tpcds_q54/datafusion:parquet 86819836 / 85254806 / +1.8% 110824958 / 109551589 / +1.2% 0.78 / 0.78 / +0.7%
tpcds_q55/datafusion:parquet 26506493 / 26510566 / -0.0% 48338653 / 46645823 / +3.6% 0.55 / 0.57 / -3.5%
tpcds_q56/datafusion:parquet 51895126 / 54094848 / -4.1% 78297433 / 77335323 / +1.2% 0.66 / 0.70 / -5.2%
tpcds_q57/datafusion:parquet 172856706 / 171894920 / +0.6% 196338509 / 193978047 / +1.2% 0.88 / 0.89 / -0.6%
tpcds_q58/datafusion:parquet 94110881 / 98465482 / -4.4% 122838917 / 125032548 / -1.8% 0.77 / 0.79 / -2.7%
tpcds_q59/datafusion:parquet 104423935 / 103659830 / +0.7% 131234086 / 130225505 / +0.8% 0.80 / 0.80 / -0.0%
tpcds_q60/datafusion:parquet 52776198 / 55741260 / -5.3% 75736317 / 78220449 / -3.2% 0.70 / 0.71 / -2.2%
tpcds_q61/datafusion:parquet 75918322 / 78001000 / -2.7% 104592367 / 106432779 / -1.7% 0.73 / 0.73 / -1.0%
tpcds_q62/datafusion:parquet 27508242 / 27762318 / -0.9% 46077893 / 44527940 / +3.5% 0.60 / 0.62 / -4.2%
tpcds_q63/datafusion:parquet 35814448 / 36196190 / -1.1% 59942277 / 58834211 / +1.9% 0.60 / 0.62 / -2.9%
tpcds_q64/datafusion:parquet 663461524 / 659557758 / +0.6% 740776342 / 742173662 / -0.2% 0.90 / 0.89 / +0.8%
tpcds_q65/datafusion:parquet 101285433 / 100715906 / +0.6% 134019170 / 133981634 / +0.0% 0.76 / 0.75 / +0.5%
tpcds_q66/datafusion:parquet 77743237 / 76575936 / +1.5% 102187856 / 104374000 / -2.1% 0.76 / 0.73 / +3.7%
tpcds_q67/datafusion:parquet 432962991 / 430912350 / +0.5% 502694623 / 500297658 / +0.5% 0.86 / 0.86 / -0.0%
tpcds_q68/datafusion:parquet 107968576 / 108700552 / -0.7% 159316743 / 156742031 / +1.6% 0.68 / 0.69 / -2.3%
tpcds_q69/datafusion:parquet 59415764 / 61003348 / -2.6% 85349264 / 84325988 / +1.2% 0.70 / 0.72 / -3.8%
tpcds_q70/datafusion:parquet 212219328 / 212975306 / -0.4% 239535426 / 246017700 / -2.6% 0.89 / 0.87 / +2.3%
tpcds_q71/datafusion:parquet 39289930 / 39083124 / +0.5% 64595629 / 64662143 / -0.1% 0.61 / 0.60 / +0.6%
tpcds_q72/datafusion:parquet 1779112816 / 1794732356 / -0.9% 1775150393 / 1806078341 / -1.7% 1.00 / 0.99 / +0.9%
tpcds_q73/datafusion:parquet 63119322 / 62856255 / +0.4% 86211946 / 84855052 / +1.6% 0.73 / 0.74 / -1.2%
tpcds_q74/datafusion:parquet 291263365 / 292768250 / -0.5% 323200503 / 331483495 / -2.5% 0.90 / 0.88 / +2.0%
tpcds_q75/datafusion:parquet 199607804 / 193794623 / +3.0% 233980039 / 239131737 / -2.2% 0.85 / 0.81 / +5.3%
tpcds_q76/datafusion:parquet 51030525 / 49958244 / +2.1% 82720559 / 78897199 / +4.8% 0.62 / 0.63 / -2.6%
tpcds_q77/datafusion:parquet 72244224 / 73280301 / -1.4% 101130785 / 98096657 / +3.1% 0.71 / 0.75 / -4.4%
tpcds_q78/datafusion:parquet 209167940 / 211119866 / -0.9% 278124359 / 273491694 / +1.7% 0.75 / 0.77 / -2.6%
tpcds_q79/datafusion:parquet 77959417 / 77375078 / +0.8% 111312677 / 112413871 / -1.0% 0.70 / 0.69 / +1.8%
tpcds_q80/datafusion:parquet 144073312 / 143104068 / +0.7% 189560694 / 191975662 / -1.3% 0.76 / 0.75 / +2.0%
tpcds_q81/datafusion:parquet 107004755 / 106756472 / +0.2% 127573944 / 129378123 / -1.4% 0.84 / 0.83 / +1.7%
tpcds_q82/datafusion:parquet 54281660 / 53582485 / +1.3% 72579186 / 70410662 / +3.1% 0.75 / 0.76 / -1.7%
tpcds_q83/datafusion:parquet 66683604 / 66630048 / +0.1% 83195830 / 85136032 / -2.3% 0.80 / 0.78 / +2.4%
tpcds_q84/datafusion:parquet 35796010 / 36220898 / -1.2% 51214242 / 49805351 / +2.8% 0.70 / 0.73 / -3.9%
tpcds_q85/datafusion:parquet 105571767 / 103848480 / +1.7% 130843313 / 129149354 / +1.3% 0.81 / 0.80 / +0.3%
tpcds_q86/datafusion:parquet 21594862 / 22112695 / -2.3% 38981350 / 39672664 / -1.7% 0.55 / 0.56 / -0.6%
tpcds_q87/datafusion:parquet 120820311 / 122470358 / -1.3% 143631360 / 148224625 / -3.1% 0.84 / 0.83 / +1.8%
tpcds_q88/datafusion:parquet 85834236 / 86047137 / -0.2% 109004783 / 108358632 / +0.6% 0.79 / 0.79 / -0.8%
tpcds_q89/datafusion:parquet 38761176 / 38401756 / +0.9% 63292098 / 64923770 / -2.5% 0.61 / 0.59 / +3.5%
tpcds_q90/datafusion:parquet 17572158 / 18100802 / -2.9% 32882633 / 32273520 / +1.9% 0.53 / 0.56 / -4.7%
tpcds_q91/datafusion:parquet 42567064 / 41738000 / +2.0% 59872318 / 57454843 / +4.2% 0.71 / 0.73 / -2.1%
tpcds_q92/datafusion:parquet 28180523 / 28604120 / -1.5% 48952748 / 47460689 / +3.1% 0.58 / 0.60 / -4.5%
tpcds_q93/datafusion:parquet 61439862 / 63722030 / -3.6% 94082911 / 87405909 / +7.6% 0.65 / 0.73 / -10.4%
tpcds_q94/datafusion:parquet 38434556 / 37847109 / +1.6% 57461492 / 58549059 / -1.9% 0.67 / 0.65 / +3.5%
tpcds_q95/datafusion:parquet 125044852 / 128012922 / -2.3% 162438244 / 149910916 / +8.4% 0.77 / 0.85 / -9.9%
tpcds_q96/datafusion:parquet 21335330 / 20691258 / +3.1% 36329559 / 36951345 / -1.7% 0.59 / 0.56 / +4.9%
tpcds_q97/datafusion:parquet 54964146 / 54645566 / +0.6% 78602608 / 80351616 / -2.2% 0.70 / 0.68 / +2.8%
tpcds_q98/datafusion:parquet 61400774 / 61965680 / -0.9% 84585863 / 83775704 / +1.0% 0.73 / 0.74 / -1.9%
tpcds_q99/datafusion:parquet 42301441 / 42461627 / -0.4% 58404787 / 57802802 / +1.0% 0.72 / 0.73 / -1.4%
duckdb / vortex-file-compressed / ns (1.004x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 33146288 / 32726779 / +1.3% 45844010 / 45377689 / +1.0% 0.72 / 0.72 / +0.3%
tpcds_q02/duckdb:vortex-file-compressed 30339206 / 30267290 / +0.2% 44577497 / 44087004 / +1.1% 0.68 / 0.69 / -0.9%
tpcds_q03/duckdb:vortex-file-compressed 13368267 / 13779130 / -3.0% 29985282 / 30718899 / -2.4% 0.45 / 0.45 / -0.6%
tpcds_q04/duckdb:vortex-file-compressed 127226874 / 130206338 / -2.3% 150901164 / 157201556 / -4.0% 0.84 / 0.83 / +1.8%
tpcds_q05/duckdb:vortex-file-compressed 55912302 / 53727511 / +4.1% 83332182 / 83478676 / -0.2% 0.67 / 0.64 / +4.2%
tpcds_q06/duckdb:vortex-file-compressed 58893216 / 58800986 / +0.2% 77990248 / 79094008 / -1.4% 0.76 / 0.74 / +1.6%
tpcds_q07/duckdb:vortex-file-compressed 31948944 / 31168844 / +2.5% 52581653 / 54099517 / -2.8% 0.61 / 0.58 / +5.5%
tpcds_q08/duckdb:vortex-file-compressed 31103125 / 31134683 / -0.1% 41748242 / 41772800 / -0.1% 0.75 / 0.75 / -0.0%
tpcds_q09/duckdb:vortex-file-compressed 56235732 / 55235330 / +1.8% 79805513 / 79107779 / +0.9% 0.70 / 0.70 / +0.9%
tpcds_q10/duckdb:vortex-file-compressed 40193668 / 39038430 / +3.0% 58274269 / 58236826 / +0.1% 0.69 / 0.67 / +2.9%
tpcds_q11/duckdb:vortex-file-compressed 95918334 / 96226126 / -0.3% 111332254 / 112266994 / -0.8% 0.86 / 0.86 / +0.5%
tpcds_q12/duckdb:vortex-file-compressed 17113384 / 17276975 / -0.9% 29873386 / 30254952 / -1.3% 0.57 / 0.57 / +0.3%
tpcds_q13/duckdb:vortex-file-compressed 38527924 / 38940578 / -1.1% 71243428 / 71103229 / +0.2% 0.54 / 0.55 / -1.3%
tpcds_q14/duckdb:vortex-file-compressed 116317246 / 119983268 / -3.1% 142082267 / 140641737 / +1.0% 0.82 / 0.85 / -4.0%
tpcds_q15/duckdb:vortex-file-compressed 61630012 / 60759281 / +1.4% 75195039 / 76171754 / -1.3% 0.82 / 0.80 / +2.8%
tpcds_q16/duckdb:vortex-file-compressed 35251662 / 34771337 / +1.4% 53989917 / 53890958 / +0.2% 0.65 / 0.65 / +1.2%
tpcds_q17/duckdb:vortex-file-compressed 58193440 / 57289182 / +1.6% 79775083 / 81955246 / -2.7% 0.73 / 0.70 / +4.4%
tpcds_q18/duckdb:vortex-file-compressed 82931584 / 82993345 / -0.1% 102731409 / 104424434 / -1.6% 0.81 / 0.79 / +1.6%
tpcds_q19/duckdb:vortex-file-compressed 45844577 / 43899722 / +4.4% 62481013 / 65276395 / -4.3% 0.73 / 0.67 / +9.1%
tpcds_q20/duckdb:vortex-file-compressed 21851608 / 21520304 / +1.5% 35197023 / 34931964 / +0.8% 0.62 / 0.62 / +0.8%
tpcds_q21/duckdb:vortex-file-compressed 28018987 / 28120830 / -0.4% 59459298 / 62004166 / -4.1% 0.47 / 0.45 / +3.9%
tpcds_q22/duckdb:vortex-file-compressed 159424964 / 165099230 / -3.4% 172370712 / 170541662 / +1.1% 0.92 / 0.97 / -4.5%
tpcds_q23/duckdb:vortex-file-compressed 182784526 / 185876490 / -1.7% 203637714 / 199673618 / +2.0% 0.90 / 0.93 / -3.6%
tpcds_q24/duckdb:vortex-file-compressed 52577184 / 52636914 / -0.1% 75687285 / 77254623 / -2.0% 0.69 / 0.68 / +2.0%
tpcds_q25/duckdb:vortex-file-compressed 53516254 / 53220034 / +0.6% 76400009 / 75302591 / +1.5% 0.70 / 0.71 / -0.9%
tpcds_q26/duckdb:vortex-file-compressed 26740004 / 26713063 / +0.1% 42075932 / 42934826 / -2.0% 0.64 / 0.62 / +2.1%
tpcds_q27/duckdb:vortex-file-compressed 32743435 / 32585874 / +0.5% 55154826 / 53424233 / +3.2% 0.59 / 0.61 / -2.7%
tpcds_q28/duckdb:vortex-file-compressed 41783252 / 41342696 / +1.1% 64070840 / 66089322 / -3.1% 0.65 / 0.63 / +4.2%
tpcds_q29/duckdb:vortex-file-compressed 51959828 / 51866994 / +0.2% 75225621 / 74066949 / +1.6% 0.69 / 0.70 / -1.4%
tpcds_q30/duckdb:vortex-file-compressed 38556650 / 37914817 / +1.7% 52042856 / 52960815 / -1.7% 0.74 / 0.72 / +3.5%
tpcds_q31/duckdb:vortex-file-compressed 37083103 / 37512062 / -1.1% 56586220 / 53392186 / +6.0% 0.66 / 0.70 / -6.7%
tpcds_q32/duckdb:vortex-file-compressed 13961188 / 13855892 / +0.8% 30395514 / 28855272 / +5.3% 0.46 / 0.48 / -4.3%
tpcds_q33/duckdb:vortex-file-compressed 34139181 / 33813963 / +1.0% 60136946 / 59046480 / +1.8% 0.57 / 0.57 / -0.9%
tpcds_q34/duckdb:vortex-file-compressed 22844168 / 22811725 / +0.1% 41564797 / 39776812 / +4.5% 0.55 / 0.57 / -4.2%
tpcds_q35/duckdb:vortex-file-compressed 67540536 / 66786588 / +1.1% 89305296 / 85242000 / +4.8% 0.76 / 0.78 / -3.5%
tpcds_q36/duckdb:vortex-file-compressed 29486525 / 29806828 / -1.1% 48745225 / 49308472 / -1.1% 0.60 / 0.60 / +0.1%
tpcds_q37/duckdb:vortex-file-compressed 25609880 / 25605208 / +0.0% 73899377 / 74457214 / -0.7% 0.35 / 0.34 / +0.8%
tpcds_q38/duckdb:vortex-file-compressed 62169078 / 62408870 / -0.4% 75598538 / 81156842 / -6.8% 0.82 / 0.77 / +6.9%
tpcds_q39/duckdb:vortex-file-compressed 55585610 / 56168904 / -1.0% 88486189 / 85127364 / +3.9% 0.63 / 0.66 / -4.8%
tpcds_q40/duckdb:vortex-file-compressed 19077422 / 19238372 / -0.8% 36122240 / 35099919 / +2.9% 0.53 / 0.55 / -3.6%
tpcds_q41/duckdb:vortex-file-compressed 19338946 / 18720698 / +3.3% 25851077 / 25500417 / +1.4% 0.75 / 0.73 / +1.9%
tpcds_q42/duckdb:vortex-file-compressed 14417238 / 14015144 / +2.9% 31482049 / 30966847 / +1.7% 0.46 / 0.45 / +1.2%
tpcds_q43/duckdb:vortex-file-compressed 20409512 / 19403602 / +5.2% 33585999 / 32011378 / +4.9% 0.61 / 0.61 / +0.3%
tpcds_q44/duckdb:vortex-file-compressed 28284526 / 28307018 / -0.1% 48419259 / 51668551 / -6.3% 0.58 / 0.55 / +6.6%
tpcds_q45/duckdb:vortex-file-compressed 46825607 / 46586273 / +0.5% 59851219 / 60370446 / -0.9% 0.78 / 0.77 / +1.4%
tpcds_q46/duckdb:vortex-file-compressed 51519604 / 51192653 / +0.6% 76463703 / 75043524 / +1.9% 0.67 / 0.68 / -1.2%
tpcds_q47/duckdb:vortex-file-compressed 80001758 / 80927444 / -1.1% 94819429 / 97094785 / -2.3% 0.84 / 0.83 / +1.2%
tpcds_q48/duckdb:vortex-file-compressed 53955148 / 53155386 / +1.5% 80558255 / 81823473 / -1.5% 0.67 / 0.65 / +3.1%
tpcds_q49/duckdb:vortex-file-compressed 38959603 / 37950044 / +2.7% 80538619 / 78847393 / +2.1% 0.48 / 0.48 / +0.5%
tpcds_q50/duckdb:vortex-file-compressed 32799606 / 32675461 / +0.4% 57412616 / 57051911 / +0.6% 0.57 / 0.57 / -0.3%
tpcds_q51/duckdb:vortex-file-compressed 205311930 / 204779876 / +0.3% 218712748 / 217736852 / +0.4% 0.94 / 0.94 / -0.2%
tpcds_q52/duckdb:vortex-file-compressed 15738622 / 15384257 / +2.3% 31785393 / 31876748 / -0.3% 0.50 / 0.48 / +2.6%
tpcds_q53/duckdb:vortex-file-compressed 22805780 / 22960290 / -0.7% 41321267 / 39000657 / +6.0% 0.55 / 0.59 / -6.3%
tpcds_q54/duckdb:vortex-file-compressed 44201866 / 44886930 / -1.5% 65366409 / 65481173 / -0.2% 0.68 / 0.69 / -1.4%
tpcds_q55/duckdb:vortex-file-compressed 14591070 / 14612501 / -0.1% 31963924 / 30570651 / +4.6% 0.46 / 0.48 / -4.5%
tpcds_q56/duckdb:vortex-file-compressed 33284501 / 32462078 / +2.5% 57419279 / 57717193 / -0.5% 0.58 / 0.56 / +3.1%
tpcds_q57/duckdb:vortex-file-compressed 70986688 / 64171452 / +10.6% 🔴 76321347 / 78496038 / -2.8% 0.93 / 0.82 / +13.8%
tpcds_q58/duckdb:vortex-file-compressed 37483122 / 37835588 / -0.9% 60104563 / 64016051 / -6.1% 0.62 / 0.59 / +5.5%
tpcds_q59/duckdb:vortex-file-compressed 55583512 / 53810956 / +3.3% 64747715 / 71107629 / -8.9% 0.86 / 0.76 / +13.4%
tpcds_q60/duckdb:vortex-file-compressed 35422900 / 35369636 / +0.2% 59933195 / 59793701 / +0.2% 0.59 / 0.59 / -0.1%
tpcds_q61/duckdb:vortex-file-compressed 34341176 / 34298255 / +0.1% 52866725 / 53069753 / -0.4% 0.65 / 0.65 / +0.5%
tpcds_q62/duckdb:vortex-file-compressed 15134700 / 14822514 / +2.1% 27076322 / 26421769 / +2.5% 0.56 / 0.56 / -0.4%
tpcds_q63/duckdb:vortex-file-compressed 20697780 / 20828409 / -0.6% 36392774 / 38114655 / -4.5% 0.57 / 0.55 / +4.1%
tpcds_q64/duckdb:vortex-file-compressed 120656208 / 118342334 / +2.0% 153345652 / 152181613 / +0.8% 0.79 / 0.78 / +1.2%
tpcds_q65/duckdb:vortex-file-compressed 50068640 / 51466061 / -2.7% 60146367 / 58907342 / +2.1% 0.83 / 0.87 / -4.7%
tpcds_q66/duckdb:vortex-file-compressed 41533134 / 40998564 / +1.3% 56838441 / 58858579 / -3.4% 0.73 / 0.70 / +4.9%
tpcds_q67/duckdb:vortex-file-compressed 276662332 / 277425812 / -0.3% 293294671 / 283678837 / +3.4% 0.94 / 0.98 / -3.5%
tpcds_q68/duckdb:vortex-file-compressed 44953961 / 44593714 / +0.8% 73843102 / 72079771 / +2.4% 0.61 / 0.62 / -1.6%
tpcds_q69/duckdb:vortex-file-compressed 38556242 / 38356528 / +0.5% 58142946 / 59755970 / -2.7% 0.66 / 0.64 / +3.3%
tpcds_q70/duckdb:vortex-file-compressed 25839099 / 25085070 / +3.0% 41926223 / 41516746 / +1.0% 0.62 / 0.60 / +2.0%
tpcds_q71/duckdb:vortex-file-compressed 27497614 / 27715436 / -0.8% 50342509 / 50902781 / -1.1% 0.55 / 0.54 / +0.3%
tpcds_q72/duckdb:vortex-file-compressed 138479402 / 135900823 / +1.9% 162978301 / 164226936 / -0.8% 0.85 / 0.83 / +2.7%
tpcds_q73/duckdb:vortex-file-compressed 20245100 / 20089200 / +0.8% 39010967 / 37315276 / +4.5% 0.52 / 0.54 / -3.6%
tpcds_q74/duckdb:vortex-file-compressed 82264329 / 82722980 / -0.6% 99316974 / 99629718 / -0.3% 0.83 / 0.83 / -0.2%
tpcds_q75/duckdb:vortex-file-compressed 112966591 / 111929736 / +0.9% 138764325 / 139908352 / -0.8% 0.81 / 0.80 / +1.8%
tpcds_q76/duckdb:vortex-file-compressed 27629507 / 27219565 / +1.5% 56901401 / 58492855 / -2.7% 0.49 / 0.47 / +4.3%
tpcds_q77/duckdb:vortex-file-compressed 37706618 / 36316546 / +3.8% 58686953 / 62103115 / -5.5% 0.64 / 0.58 / +9.9%
tpcds_q78/duckdb:vortex-file-compressed 136916523 / 137442428 / -0.4% 162152045 / 159793923 / +1.5% 0.84 / 0.86 / -1.8%
tpcds_q79/duckdb:vortex-file-compressed 37676300 / 37665982 / +0.0% 62425061 / 59874325 / +4.3% 0.60 / 0.63 / -4.1%
tpcds_q80/duckdb:vortex-file-compressed 58022432 / 57541290 / +0.8% 88497989 / 89399248 / -1.0% 0.66 / 0.64 / +1.9%
tpcds_q81/duckdb:vortex-file-compressed 58935559 / 57777750 / +2.0% 72189025 / 71231569 / +1.3% 0.82 / 0.81 / +0.7%
tpcds_q82/duckdb:vortex-file-compressed 26819345 / 26860434 / -0.2% 75869373 / 77804956 / -2.5% 0.35 / 0.35 / +2.4%
tpcds_q83/duckdb:vortex-file-compressed 21842058 / 21694036 / +0.7% 31452878 / 32263861 / -2.5% 0.69 / 0.67 / +3.3%
tpcds_q84/duckdb:vortex-file-compressed 13675228 / 13366814 / +2.3% 25027842 / 23226339 / +7.8% 0.55 / 0.58 / -5.1%
tpcds_q85/duckdb:vortex-file-compressed 36769152 / 36707151 / +0.2% 55311890 / 56348206 / -1.8% 0.66 / 0.65 / +2.0%
tpcds_q86/duckdb:vortex-file-compressed 16283614 / 16411782 / -0.8% 29284119 / 28182293 / +3.9% 0.56 / 0.58 / -4.5%
tpcds_q87/duckdb:vortex-file-compressed 74531872 / 75201770 / -0.9% 85917281 / 87749398 / -2.1% 0.87 / 0.86 / +1.2%
tpcds_q88/duckdb:vortex-file-compressed 38902588 / 37878092 / +2.7% 49999263 / 49979733 / +0.0% 0.78 / 0.76 / +2.7%
tpcds_q89/duckdb:vortex-file-compressed 25148324 / 24974289 / +0.7% 39715123 / 41888285 / -5.2% 0.63 / 0.60 / +6.2%
tpcds_q90/duckdb:vortex-file-compressed 9882787 / 9843474 / +0.4% 19808601 / 20353435 / -2.7% 0.50 / 0.48 / +3.2%
tpcds_q91/duckdb:vortex-file-compressed 19575178 / 19617013 / -0.2% 29333573 / 29081972 / +0.9% 0.67 / 0.67 / -1.1%
tpcds_q92/duckdb:vortex-file-compressed 13239614 / 13643566 / -3.0% 27039263 / 27682975 / -2.3% 0.49 / 0.49 / -0.7%
tpcds_q93/duckdb:vortex-file-compressed 25901601 / 25876894 / +0.1% 52274844 / 52613864 / -0.6% 0.50 / 0.49 / +0.7%
tpcds_q94/duckdb:vortex-file-compressed 32969626 / 32152022 / +2.5% 46910645 / 47204449 / -0.6% 0.70 / 0.68 / +3.2%
tpcds_q95/duckdb:vortex-file-compressed 93777512 / 97513786 / -3.8% 103962634 / 117615692 / -11.6% 🟢 0.90 / 0.83 / +8.8%
tpcds_q96/duckdb:vortex-file-compressed 11805000 / 11752061 / +0.5% 25524319 / 24570663 / +3.9% 0.46 / 0.48 / -3.3%
tpcds_q97/duckdb:vortex-file-compressed 61473536 / 62178961 / -1.1% 82901738 / 82766588 / +0.2% 0.74 / 0.75 / -1.3%
tpcds_q98/duckdb:vortex-file-compressed 27184161 / 26889542 / +1.1% 44692754 / 43917859 / +1.8% 0.61 / 0.61 / -0.7%
tpcds_q99/duckdb:vortex-file-compressed 21553185 / 26072871 / -17.3% 🟢 36047267 / 35980286 / +0.2% 0.60 / 0.72 / -17.5%
duckdb / parquet / ns (1.002x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 43684022 / 43748750 / -0.1% 50103711 / 50433867 / -0.7% 0.87 / 0.87 / +0.5%
tpcds_q02/duckdb:parquet 40749646 / 39630168 / +2.8% 51677702 / 50715675 / +1.9% 0.79 / 0.78 / +0.9%
tpcds_q03/duckdb:parquet 25660995 / 25995732 / -1.3% 37811037 / 36796166 / +2.8% 0.68 / 0.71 / -3.9%
tpcds_q04/duckdb:parquet 205006694 / 203957459 / +0.5% 231639339 / 234181220 / -1.1% 0.89 / 0.87 / +1.6%
tpcds_q05/duckdb:parquet 68417974 / 68357342 / +0.1% 84294406 / 87464497 / -3.6% 0.81 / 0.78 / +3.9%
tpcds_q06/duckdb:parquet 74993233 / 75115975 / -0.2% 87599807 / 89166769 / -1.8% 0.86 / 0.84 / +1.6%
tpcds_q07/duckdb:parquet 59841748 / 62193874 / -3.8% 80649534 / 76707973 / +5.1% 0.74 / 0.81 / -8.5%
tpcds_q08/duckdb:parquet 37955658 / 38663366 / -1.8% 46030379 / 46394278 / -0.8% 0.82 / 0.83 / -1.1%
tpcds_q09/duckdb:parquet 84785188 / 87080988 / -2.6% 99528098 / 101981323 / -2.4% 0.85 / 0.85 / -0.2%
tpcds_q10/duckdb:parquet 52637320 / 52520572 / +0.2% 62216483 / 62695229 / -0.8% 0.85 / 0.84 / +1.0%
tpcds_q11/duckdb:parquet 160274995 / 159415788 / +0.5% 167441783 / 164104249 / +2.0% 0.96 / 0.97 / -1.5%
tpcds_q12/duckdb:parquet 41272478 / 40814548 / +1.1% 46844811 / 48941959 / -4.3% 0.88 / 0.83 / +5.6%
tpcds_q13/duckdb:parquet 71487242 / 69804706 / +2.4% 91502547 / 87793121 / +4.2% 0.78 / 0.80 / -1.7%
tpcds_q14/duckdb:parquet 189432980 / 185753765 / +2.0% 202139385 / 202864595 / -0.4% 0.94 / 0.92 / +2.3%
tpcds_q15/duckdb:parquet 61213503 / 60934452 / +0.5% 69026049 / 69050398 / -0.0% 0.89 / 0.88 / +0.5%
tpcds_q16/duckdb:parquet 38083722 / 37850674 / +0.6% 47126002 / 45839434 / +2.8% 0.81 / 0.83 / -2.1%
tpcds_q17/duckdb:parquet 82949058 / 84076050 / -1.3% 91676175 / 89860905 / +2.0% 0.90 / 0.94 / -3.3%
tpcds_q18/duckdb:parquet 88991636 / 87775860 / +1.4% 97813209 / 98136096 / -0.3% 0.91 / 0.89 / +1.7%
tpcds_q19/duckdb:parquet 49044453 / 47466565 / +3.3% 61043802 / 63007623 / -3.1% 0.80 / 0.75 / +6.6%
tpcds_q20/duckdb:parquet 43241926 / 42342882 / +2.1% 48674332 / 48573403 / +0.2% 0.89 / 0.87 / +1.9%
tpcds_q21/duckdb:parquet 24321959 / 23962194 / +1.5% 28856156 / 28440652 / +1.5% 0.84 / 0.84 / +0.0%
tpcds_q22/duckdb:parquet 162640840 / 166072912 / -2.1% 165901486 / 167098902 / -0.7% 0.98 / 0.99 / -1.4%
tpcds_q23/duckdb:parquet 187491997 / 188036546 / -0.3% 197151347 / 193148517 / +2.1% 0.95 / 0.97 / -2.3%
tpcds_q24/duckdb:parquet 72619110 / 71146241 / +2.1% 88397841 / 82487151 / +7.2% 0.82 / 0.86 / -4.8%
tpcds_q25/duckdb:parquet 50681816 / 51215258 / -1.0% 61299886 / 61288817 / +0.0% 0.83 / 0.84 / -1.1%
tpcds_q26/duckdb:parquet 42778918 / 42361802 / +1.0% 51731565 / 51343370 / +0.8% 0.83 / 0.83 / +0.2%
tpcds_q27/duckdb:parquet 58092858 / 57111037 / +1.7% 78243360 / 81608147 / -4.1% 0.74 / 0.70 / +6.1%
tpcds_q28/duckdb:parquet 94394627 / 93252698 / +1.2% 107556101 / 112178597 / -4.1% 0.88 / 0.83 / +5.6%
tpcds_q29/duckdb:parquet 84345780 / 83041768 / +1.6% 95299347 / 96583021 / -1.3% 0.89 / 0.86 / +2.9%
tpcds_q30/duckdb:parquet 72629548 / 72470468 / +0.2% 81722572 / 81148208 / +0.7% 0.89 / 0.89 / -0.5%
tpcds_q31/duckdb:parquet 99579380 / 98601462 / +1.0% 111764421 / 111465299 / +0.3% 0.89 / 0.88 / +0.7%
tpcds_q32/duckdb:parquet 18274631 / 18353748 / -0.4% 26307592 / 26590155 / -1.1% 0.69 / 0.69 / +0.6%
tpcds_q33/duckdb:parquet 62574194 / 62367010 / +0.3% 74392071 / 73989561 / +0.5% 0.84 / 0.84 / -0.2%
tpcds_q34/duckdb:parquet 33118574 / 33006494 / +0.3% 42004328 / 41889230 / +0.3% 0.79 / 0.79 / +0.1%
tpcds_q35/duckdb:parquet 77732480 / 77399391 / +0.4% 86115873 / 86087567 / +0.0% 0.90 / 0.90 / +0.4%
tpcds_q36/duckdb:parquet 99332509 / 99335950 / -0.0% 112855891 / 112263590 / +0.5% 0.88 / 0.88 / -0.5%
tpcds_q37/duckdb:parquet 40933436 / 41378236 / -1.1% 48707829 / 47554095 / +2.4% 0.84 / 0.87 / -3.4%
tpcds_q38/duckdb:parquet 78523400 / 76468258 / +2.7% 83021191 / 85294747 / -2.7% 0.95 / 0.90 / +5.5%
tpcds_q39/duckdb:parquet 62182677 / 61661639 / +0.8% 68414395 / 67797634 / +0.9% 0.91 / 0.91 / -0.1%
tpcds_q40/duckdb:parquet 27992393 / 27952642 / +0.1% 35517307 / 36118029 / -1.7% 0.79 / 0.77 / +1.8%
tpcds_q41/duckdb:parquet 20658734 / 20143537 / +2.6% 26574349 / 26266476 / +1.2% 0.78 / 0.77 / +1.4%
tpcds_q42/duckdb:parquet 25855974 / 26999602 / -4.2% 36761771 / 36451419 / +0.9% 0.70 / 0.74 / -5.0%
tpcds_q43/duckdb:parquet 27034640 / 28272378 / -4.4% 33665952 / 35793884 / -5.9% 0.80 / 0.79 / +1.7%
tpcds_q44/duckdb:parquet 61083718 / 60736375 / +0.6% 77299238 / 74562633 / +3.7% 0.79 / 0.81 / -3.0%
tpcds_q45/duckdb:parquet 62054762 / 60622120 / +2.4% 69981146 / 67027287 / +4.4% 0.89 / 0.90 / -2.0%
tpcds_q46/duckdb:parquet 73274743 / 72394963 / +1.2% 87515328 / 88023341 / -0.6% 0.84 / 0.82 / +1.8%
tpcds_q47/duckdb:parquet 91408206 / 90830810 / +0.6% 108211225 / 105146923 / +2.9% 0.84 / 0.86 / -2.2%
tpcds_q48/duckdb:parquet 66114282 / 67648746 / -2.3% 81949175 / 85359866 / -4.0% 0.81 / 0.79 / +1.8%
tpcds_q49/duckdb:parquet 68739693 / 67399774 / +2.0% 97762952 / 92020170 / +6.2% 0.70 / 0.73 / -4.0%
tpcds_q50/duckdb:parquet 44297862 / 45228659 / -2.1% 53931855 / 50910629 / +5.9% 0.82 / 0.89 / -7.5%
tpcds_q51/duckdb:parquet 214463598 / 217340788 / -1.3% 224611384 / 225257376 / -0.3% 0.95 / 0.96 / -1.0%
tpcds_q52/duckdb:parquet 26730104 / 26490668 / +0.9% 38424588 / 37218058 / +3.2% 0.70 / 0.71 / -2.3%
tpcds_q53/duckdb:parquet 35280342 / 34202255 / +3.2% 45752934 / 48232701 / -5.1% 0.77 / 0.71 / +8.7%
tpcds_q54/duckdb:parquet 54974114 / 55357348 / -0.7% 64099389 / 63307482 / +1.3% 0.86 / 0.87 / -1.9%
tpcds_q55/duckdb:parquet 27315164 / 26580602 / +2.8% 35742451 / 38734658 / -7.7% 0.76 / 0.69 / +11.4%
tpcds_q56/duckdb:parquet 69212953 / 68450543 / +1.1% 84575832 / 84208264 / +0.4% 0.82 / 0.81 / +0.7%
tpcds_q57/duckdb:parquet 68496794 / 67905272 / +0.9% 75404292 / 75530496 / -0.2% 0.91 / 0.90 / +1.0%
tpcds_q58/duckdb:parquet 55874962 / 55351262 / +0.9% 70824844 / 67300961 / +5.2% 0.79 / 0.82 / -4.1%
tpcds_q59/duckdb:parquet 60838390 / 61543058 / -1.1% 71251357 / 67498896 / +5.6% 0.85 / 0.91 / -6.4%
tpcds_q60/duckdb:parquet 82743813 / 81154691 / +2.0% 94260323 / 95719978 / -1.5% 0.88 / 0.85 / +3.5%
tpcds_q61/duckdb:parquet 80877704 / 78725636 / +2.7% 91991494 / 94693948 / -2.9% 0.88 / 0.83 / +5.8%
tpcds_q62/duckdb:parquet 18942591 / 21271646 / -10.9% 🟢 24848677 / 24742108 / +0.4% 0.76 / 0.86 / -11.3%
tpcds_q63/duckdb:parquet 33950566 / 33973322 / -0.1% 44619223 / 44293841 / +0.7% 0.76 / 0.77 / -0.8%
tpcds_q64/duckdb:parquet 136445220 / 134987804 / +1.1% 152495264 / 149714203 / +1.9% 0.89 / 0.90 / -0.8%
tpcds_q65/duckdb:parquet 94476643 / 92507762 / +2.1% 103440980 / 106732283 / -3.1% 0.91 / 0.87 / +5.4%
tpcds_q66/duckdb:parquet 47883062 / 45574203 / +5.1% 52661680 / 52408182 / +0.5% 0.91 / 0.87 / +4.6%
tpcds_q67/duckdb:parquet 295634998 / 294181831 / +0.5% 297923069 / 294225942 / +1.3% 0.99 / 1.00 / -0.8%
tpcds_q68/duckdb:parquet 62042699 / 61610444 / +0.7% 74988382 / 77643526 / -3.4% 0.83 / 0.79 / +4.3%
tpcds_q69/duckdb:parquet 65909264 / 65821270 / +0.1% 77110808 / 75369095 / +2.3% 0.85 / 0.87 / -2.1%
tpcds_q70/duckdb:parquet 41704807 / 42560156 / -2.0% 53479189 / 50824609 / +5.2% 0.78 / 0.84 / -6.9%
tpcds_q71/duckdb:parquet 42041952 / 41353862 / +1.7% 54300557 / 54241063 / +0.1% 0.77 / 0.76 / +1.6%
tpcds_q72/duckdb:parquet 172775569 / 172146606 / +0.4% 187470842 / 189350126 / -1.0% 0.92 / 0.91 / +1.4%
tpcds_q73/duckdb:parquet 28343225 / 27072398 / +4.7% 37351139 / 37030456 / +0.9% 0.76 / 0.73 / +3.8%
tpcds_q74/duckdb:parquet 214039076 / 216089249 / -0.9% 227093728 / 223017657 / +1.8% 0.94 / 0.97 / -2.7%
tpcds_q75/duckdb:parquet 134942394 / 131891024 / +2.3% 152709525 / 152249842 / +0.3% 0.88 / 0.87 / +2.0%
tpcds_q76/duckdb:parquet 53703813 / 51285484 / +4.7% 65559101 / 65205448 / +0.5% 0.82 / 0.79 / +4.2%
tpcds_q77/duckdb:parquet 56299564 / 54841040 / +2.7% 70828806 / 67440836 / +5.0% 0.79 / 0.81 / -2.3%
tpcds_q78/duckdb:parquet 150570482 / 155747874 / -3.3% 162561613 / 168363678 / -3.4% 0.93 / 0.93 / +0.1%
tpcds_q79/duckdb:parquet 50817818 / 51430181 / -1.2% 65416630 / 64568583 / +1.3% 0.78 / 0.80 / -2.5%
tpcds_q80/duckdb:parquet 80700447 / 82941310 / -2.7% 103850428 / 103690804 / +0.2% 0.78 / 0.80 / -2.9%
tpcds_q81/duckdb:parquet 97621854 / 98572923 / -1.0% 108172163 / 104274293 / +3.7% 0.90 / 0.95 / -4.5%
tpcds_q82/duckdb:parquet 45532902 / 46604344 / -2.3% 53611936 / 52315928 / +2.5% 0.85 / 0.89 / -4.7%
tpcds_q83/duckdb:parquet 28327084 / 28152398 / +0.6% 33720150 / 33185714 / +1.6% 0.84 / 0.85 / -1.0%
tpcds_q84/duckdb:parquet 22729422 / 22751552 / -0.1% 29490521 / 29406408 / +0.3% 0.77 / 0.77 / -0.4%
tpcds_q85/duckdb:parquet 51387455 / 52752074 / -2.6% 62594960 / 62960389 / -0.6% 0.82 / 0.84 / -2.0%
tpcds_q86/duckdb:parquet 24934074 / 25146913 / -0.8% 31776718 / 33004413 / -3.7% 0.78 / 0.76 / +3.0%
tpcds_q87/duckdb:parquet 89807286 / 88695797 / +1.3% 94401353 / 92564858 / +2.0% 0.95 / 0.96 / -0.7%
tpcds_q88/duckdb:parquet 104284026 / 106796080 / -2.4% 113028954 / 111229279 / +1.6% 0.92 / 0.96 / -3.9%
tpcds_q89/duckdb:parquet 37787159 / 37846748 / -0.2% 50554124 / 48196620 / +4.9% 0.75 / 0.79 / -4.8%
tpcds_q90/duckdb:parquet 15745644 / 15015242 / +4.9% 20880449 / 20928242 / -0.2% 0.75 / 0.72 / +5.1%
tpcds_q91/duckdb:parquet 25589432 / 25515043 / +0.3% 33659290 / 33274247 / +1.2% 0.76 / 0.77 / -0.9%
tpcds_q92/duckdb:parquet 22022647 / 22329364 / -1.4% 30890470 / 31995562 / -3.5% 0.71 / 0.70 / +2.2%
tpcds_q93/duckdb:parquet 35478668 / 35799040 / -0.9% 49155713 / 49479404 / -0.7% 0.72 / 0.72 / -0.2%
tpcds_q94/duckdb:parquet 38556174 / 38247234 / +0.8% 45168910 / 46965479 / -3.8% 0.85 / 0.81 / +4.8%
tpcds_q95/duckdb:parquet 81672280 / 81409130 / +0.3% 87768636 / 86595751 / +1.4% 0.93 / 0.94 / -1.0%
tpcds_q96/duckdb:parquet 17718492 / 17012262 / +4.2% 24058648 / 24425947 / -1.5% 0.74 / 0.70 / +5.7%
tpcds_q97/duckdb:parquet 70681192 / 73153984 / -3.4% 82416675 / 78153554 / +5.5% 0.86 / 0.94 / -8.4%
tpcds_q98/duckdb:parquet 55132318 / 55289756 / -0.3% 65889166 / 66788134 / -1.3% 0.84 / 0.83 / +1.1%
tpcds_q99/duckdb:parquet 24143006 / 24402862 / -1.1% 32947793 / 30438057 / +8.2% 0.73 / 0.80 / -8.6%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant