Skip to content

perf(duckdb): prune excluded files from cached footers before opening - #11342

Draft
joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-05-prepared-file-proofsfrom
ji/clickbench-v2-20261109-06-duck-prune-before-open
Draft

joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-05-prepared-file-proofsfrom
ji/clickbench-v2-20261109-06-duck-prune-before-open

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Draft with confirmed focused gains; Q26/Q42 and the dependency's Q7 concern remain unresolved.

Stack dependency: #11341. This PR targets that branch so its diff contains only this change.

Summary

When a cached footer proves that a static V2 filter excludes a file, return a pruned-reader marker before opening its file source. DuckDB consumes that marker during reader initialization.

Depends on ji/clickbench-v2-20261109-05-prepared-file-proofs for the prepared predicate and cached-footer evaluation API.

Changes

  • Pass the global prepared predicate through the reader-open FFI and handle the pruned marker before reader setup.
  • Reuse the existing footer cache; keep planning opens, uncached files, and unknown proofs on the ordinary open path.
  • Cover retained and excluded cached files and unavailable-file behavior. An excluded cached file is not reopened, so its potential open error is not reported.

Benchmark evidence

Warm ClickBench timings against this branch's exact dependency parent. Query IDs are zero-based; these are individual query gains, not whole-suite or additive gains.

Engine Query Parent median (ms) Candidate median (ms) Paired latency reduction 99% interval
DuckDB Q37 4.9079 4.5925 6.42% 6.12–6.74%
DuckDB Q38 6.9159 6.3023 8.97% 8.67–9.28%
DuckDB Q42 4.5929 4.1351 10.10% 9.78–10.44%

24 fresh adjacent process pairs in balanced order; 100 executions/query, first 20 discarded; 8 interspersed identical-binary A/A pairs. Effects use mean paired log ratios of process warm medians. Displayed times are medians across processes, so their ratio need not exactly equal the paired estimate. Intervals are pointwise 99% bootstrap intervals. Each listed gain passes both the >1% interval rule and the exact paired sign test with Holm 1% correction across all 76 planned latency directions. Both execution orders and chronological sensitivity were reviewed; no post-warmup observations were excluded or controls subtracted. The sign test concerns how often a paired improvement exceeds 1%; the displayed interval estimates the mean log effect.

Whole-process user+system CPU reductions on the same focused query set: DuckDB 21.73% (99% interval 21.51–21.96%). These pass the separately corrected CPU family and include setup and warmups; they are not measurements of isolated Vortex CPU.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads, DuckDB --reuse. DataFusion 55.2 retains enable_topk_aggregation=true. Compiler, Cargo feature union, profile and runtime environment are fixed across parent/candidate. Executable and library hashes, canonical SQL and fixture identities are recorded.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

Focused Q37/Q38/Q42 gains do not settle the full-history concerns. DuckDB Q26 is 4.79% slower by median and 2.00% by mean, with three adverse pairs after a favorable first pair. Q42 means rise 14.22%, including a 17.97 ms candidate event; controls themselves vary substantially. These are unresolved landing concerns, not proved regressions. All43 CPU is nearly flat, so the focused 21.73% CPU reduction stays workload-specific. The s04 dependency concern also remains.

Validation

  • 11 targeted test executions passed on this exact source tree: file_reader::tests, test_vortex_scan_prunes_multiple_cached_files, test_vortex_scan_v2_matches_v1.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate); strict types, floating tolerance, tied-row membership and independent oracles included.
  • Both benchmark packages built together with --locked, the release_debug profile, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust changes were formatted with pinned nightly; patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local source commit: baf05cc29b5125d250113332ce8c20d94d9b61d3; full source tree: 9bb1f1ed623a657e8836347e15f98e887d3f1d8b. Measured parent: b9d988cae18a03f88689353b81a3e6b3fd94a879.

PR source commit: e6ec8c58732f5fb49666c3fa4a066ff1408f1a5d; mapped parent: 7fb2efcfb1ea8f751e9e31d60109de325ecc420e. The complete source tree and mapped parent graph match the measured source. GitHub regenerated commit metadata/timestamps, so the measured local commit and executable hashes remain the benchmark identities. The complete remote Git object, original message and author/committer signoffs were verified.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

Pass the prepared static V2 predicate through the reader FFI and use the existing multi-file footer cache to skip excluded files before creating their readers. Keep planning opens and unknown footers on the ordinary open path. Cover excluded, retained, absent, and uncached files with a regression test.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-05-prepared-file-proofs to develop November 9, 2026 11:56
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-05-prepared-file-proofs November 9, 2026 11:56
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done e6ec8c5 fineweb 1 Explore Profiling Data
🟢 Done e6ec8c5 clickbench-nvme 1 Explore Profiling Data
🟢 Done e6ec8c5 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done e6ec8c5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done e6ec8c5 polarsignals 1 Explore Profiling Data
🟢 Done e6ec8c5 tpch-s3 1 Explore Profiling Data
🟢 Done e6ec8c5 tpch-nvme 1 Explore Profiling Data
🟢 Done e6ec8c5 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR e6ec8c58 vs base b2f8d0f9
Vortex (geomean): hot 1.030x ➖ · cold 0.980x ➖


datafusion / vortex-file-compressed / ns (1.030x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 43960186 / 44247398 / -0.6% 88630461 / 86756764 / +2.2% 0.50 / 0.51 / -2.7%
polarsignals_q01/datafusion:vortex-file-compressed 80268064 / 53190033 / +50.9% 🔴 111468579 / 111620562 / -0.1% 0.72 / 0.48 / +51.1%
polarsignals_q02/datafusion:vortex-file-compressed 11553258 / 14308001 / -19.3% 🟢 48861468 / 50938846 / -4.1% 0.24 / 0.28 / -15.8%
polarsignals_q03/datafusion:vortex-file-compressed 54539564 / 69231543 / -21.2% 🟢 114961212 / 116022576 / -0.9% 0.47 / 0.60 / -20.5%
polarsignals_q04/datafusion:vortex-file-compressed 9281270 / 9324230 / -0.5% 44108712 / 43390473 / +1.7% 0.21 / 0.21 / -2.1%
polarsignals_q05/datafusion:vortex-file-compressed 11639574 / 11645938 / -0.1% 46013570 / 46740242 / -1.6% 0.25 / 0.25 / +1.5%
polarsignals_q06/datafusion:vortex-file-compressed 22714409 / 22759316 / -0.2% 55435688 / 56616878 / -2.1% 0.41 / 0.40 / +1.9%
polarsignals_q07/datafusion:vortex-file-compressed 10881178 / 10826504 / +0.5% 44330390 / 45422058 / -2.4% 0.25 / 0.24 / +3.0%
polarsignals_q08/datafusion:vortex-file-compressed 104330459 / 96763190 / +7.8% 157385524 / 161828007 / -2.7% 0.66 / 0.60 / +10.9%
polarsignals_q09/datafusion:vortex-file-compressed 10107578 / 9924556 / +1.8% 37458557 / 41195204 / -9.1% 0.27 / 0.24 / +12.0%
polarsignals_q10/datafusion:vortex-file-compressed 73754129 / 55401320 / +33.1% 🔴 113689048 / 116674031 / -2.6% 0.65 / 0.47 / +36.6%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR e6ec8c58 vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15711120 / 15688950 / +0.1% 46502289 / 42044683 / +10.6% 🔴 0.34 / 0.37 / -9.5%
tpch_q02/datafusion:vortex-file-compressed 17406937 / 17642963 / -1.3% 39278645 / 38300817 / +2.6% 0.44 / 0.46 / -3.8%
tpch_q03/datafusion:vortex-file-compressed 19351630 / 19065844 / +1.5% 49982634 / 48397388 / +3.3% 0.39 / 0.39 / -1.7%
tpch_q04/datafusion:vortex-file-compressed 10421489 / 11164861 / -6.7% 35928217 / 35072742 / +2.4% 0.29 / 0.32 / -8.9%
tpch_q05/datafusion:vortex-file-compressed 37795747 / 37464731 / +0.9% 70455486 / 67783021 / +3.9% 0.54 / 0.55 / -2.9%
tpch_q06/datafusion:vortex-file-compressed 4418627 / 4339682 / +1.8% 28985628 / 24863986 / +16.6% 🔴 0.15 / 0.17 / -12.7%
tpch_q07/datafusion:vortex-file-compressed 53068835 / 52692511 / +0.7% 83661444 / 85054942 / -1.6% 0.63 / 0.62 / +2.4%
tpch_q08/datafusion:vortex-file-compressed 51937641 / 52605829 / -1.3% 87239408 / 84709539 / +3.0% 0.60 / 0.62 / -4.1%
tpch_q09/datafusion:vortex-file-compressed 48676412 / 48498381 / +0.4% 81823002 / 84507228 / -3.2% 0.59 / 0.57 / +3.7%
tpch_q10/datafusion:vortex-file-compressed 17756433 / 17830636 / -0.4% 55628327 / 50418361 / +10.3% 🔴 0.32 / 0.35 / -9.7%
tpch_q11/datafusion:vortex-file-compressed 14559079 / 14797088 / -1.6% 35687356 / 34636066 / +3.0% 0.41 / 0.43 / -4.5%
tpch_q12/datafusion:vortex-file-compressed 18747629 / 18367682 / +2.1% 48281501 / 44324157 / +8.9% 0.39 / 0.41 / -6.3%
tpch_q13/datafusion:vortex-file-compressed 19274464 / 19445378 / -0.9% 41348791 / 43547559 / -5.0% 0.47 / 0.45 / +4.4%
tpch_q14/datafusion:vortex-file-compressed 14507757 / 14501344 / +0.0% 40995397 / 38502171 / +6.5% 0.35 / 0.38 / -6.0%
tpch_q15/datafusion:vortex-file-compressed 18757127 / 18611040 / +0.8% 44444253 / 47147954 / -5.7% 0.42 / 0.39 / +6.9%
tpch_q16/datafusion:vortex-file-compressed 18295461 / 18720655 / -2.3% 39707604 / 39847079 / -0.4% 0.46 / 0.47 / -1.9%
tpch_q17/datafusion:vortex-file-compressed 29212009 / 28917794 / +1.0% 60074496 / 58954760 / +1.9% 0.49 / 0.49 / -0.9%
tpch_q18/datafusion:vortex-file-compressed 36480894 / 36473671 / +0.0% 61607267 / 59803246 / +3.0% 0.59 / 0.61 / -2.9%
tpch_q19/datafusion:vortex-file-compressed 10003331 / 9988295 / +0.2% 39927635 / 36396214 / +9.7% 0.25 / 0.27 / -8.7%
tpch_q20/datafusion:vortex-file-compressed 21307788 / 21253874 / +0.3% 50860967 / 52124094 / -2.4% 0.42 / 0.41 / +2.7%
tpch_q21/datafusion:vortex-file-compressed 34874415 / 35502918 / -1.8% 64672208 / 66036777 / -2.1% 0.54 / 0.54 / +0.3%
tpch_q22/datafusion:vortex-file-compressed 11105190 / 10854425 / +2.3% 31569268 / 31535557 / +0.1% 0.35 / 0.34 / +2.2%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71344240 / 71385078 / -0.1% 90648913 / 87261585 / +3.9% 0.79 / 0.82 / -3.8%
tpch_q02/datafusion:parquet 76167446 / 76624116 / -0.6% 93461860 / 91913452 / +1.7% 0.81 / 0.83 / -2.2%
tpch_q03/datafusion:parquet 81597955 / 82108255 / -0.6% 106906402 / 104243587 / +2.6% 0.76 / 0.79 / -3.1%
tpch_q04/datafusion:parquet 39475707 / 39117802 / +0.9% 58361435 / 58381793 / -0.0% 0.68 / 0.67 / +1.0%
tpch_q05/datafusion:parquet 110159241 / 110097915 / +0.1% 138291894 / 137152327 / +0.8% 0.80 / 0.80 / -0.8%
tpch_q06/datafusion:parquet 31329055 / 31364851 / -0.1% 49587824 / 46559945 / +6.5% 0.63 / 0.67 / -6.2%
tpch_q07/datafusion:parquet 113080357 / 113603354 / -0.5% 141075399 / 139063930 / +1.4% 0.80 / 0.82 / -1.9%
tpch_q08/datafusion:parquet 117562237 / 118351864 / -0.7% 145159613 / 143663582 / +1.0% 0.81 / 0.82 / -1.7%
tpch_q09/datafusion:parquet 137616406 / 137262432 / +0.3% 168515752 / 166772416 / +1.0% 0.82 / 0.82 / -0.8%
tpch_q10/datafusion:parquet 103299841 / 103456749 / -0.2% 129254774 / 126729504 / +2.0% 0.80 / 0.82 / -2.1%
tpch_q11/datafusion:parquet 61134765 / 62363006 / -2.0% 82556389 / 82069278 / +0.6% 0.74 / 0.76 / -2.5%
tpch_q12/datafusion:parquet 63295398 / 63533745 / -0.4% 85865635 / 85351184 / +0.6% 0.74 / 0.74 / -1.0%
tpch_q13/datafusion:parquet 143274963 / 142477870 / +0.6% 166289304 / 161849930 / +2.7% 0.86 / 0.88 / -2.1%
tpch_q14/datafusion:parquet 47614328 / 47624060 / -0.0% 73997366 / 68804881 / +7.5% 0.64 / 0.69 / -7.0%
tpch_q15/datafusion:parquet 73950915 / 74880432 / -1.2% 94810084 / 92266259 / +2.8% 0.78 / 0.81 / -3.9%
tpch_q16/datafusion:parquet 43291755 / 43181694 / +0.3% 63739111 / 59549382 / +7.0% 0.68 / 0.73 / -6.3%
tpch_q17/datafusion:parquet 123624526 / 123682757 / -0.0% 150951602 / 147020505 / +2.7% 0.82 / 0.84 / -2.7%
tpch_q18/datafusion:parquet 120106658 / 121104227 / -0.8% 143142544 / 142447395 / +0.5% 0.84 / 0.85 / -1.3%
tpch_q19/datafusion:parquet 56680220 / 57774413 / -1.9% 84164235 / 82236501 / +2.3% 0.67 / 0.70 / -4.1%
tpch_q20/datafusion:parquet 78529456 / 78510463 / +0.0% 103431485 / 101516128 / +1.9% 0.76 / 0.77 / -1.8%
tpch_q21/datafusion:parquet 113284201 / 113088915 / +0.2% 138823044 / 139363438 / -0.4% 0.82 / 0.81 / +0.6%
tpch_q22/datafusion:parquet 51857598 / 51831048 / +0.1% 70128074 / 67131696 / +4.5% 0.74 / 0.77 / -4.2%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9432070 / 9046497 / +4.3% 18683593 / 20027987 / -6.7% 0.50 / 0.45 / +11.8%
tpch_q02/duckdb:vortex-file-compressed 15079982 / 15124900 / -0.3% 24667085 / 25341316 / -2.7% 0.61 / 0.60 / +2.4%
tpch_q03/duckdb:vortex-file-compressed 18435909 / 18447734 / -0.1% 35259368 / 34750008 / +1.5% 0.52 / 0.53 / -1.5%
tpch_q04/duckdb:vortex-file-compressed 11986816 / 12448707 / -3.7% 26879472 / 26846587 / +0.1% 0.45 / 0.46 / -3.8%
tpch_q05/duckdb:vortex-file-compressed 19844007 / 20254666 / -2.0% 35076539 / 35776065 / -2.0% 0.57 / 0.57 / -0.1%
tpch_q06/duckdb:vortex-file-compressed 4608811 / 4488820 / +2.7% 14661086 / 15022696 / -2.4% 0.31 / 0.30 / +5.2%
tpch_q07/duckdb:vortex-file-compressed 23810596 / 23909987 / -0.4% 42424787 / 41780280 / +1.5% 0.56 / 0.57 / -1.9%
tpch_q08/duckdb:vortex-file-compressed 21359786 / 20744171 / +3.0% 37274184 / 37318055 / -0.1% 0.57 / 0.56 / +3.1%
tpch_q09/duckdb:vortex-file-compressed 22047687 / 23055861 / -4.4% 38442305 / 38487753 / -0.1% 0.57 / 0.60 / -4.3%
tpch_q10/duckdb:vortex-file-compressed 26827650 / 26815462 / +0.0% 44724009 / 45530635 / -1.8% 0.60 / 0.59 / +1.8%
tpch_q11/duckdb:vortex-file-compressed 7849284 / 7968318 / -1.5% 17180537 / 18104165 / -5.1% 0.46 / 0.44 / +3.8%
tpch_q12/duckdb:vortex-file-compressed 14422301 / 14764927 / -2.3% 26723798 / 27095283 / -1.4% 0.54 / 0.54 / -1.0%
tpch_q13/duckdb:vortex-file-compressed 19392529 / 19378947 / +0.1% 32574811 / 31743144 / +2.6% 0.60 / 0.61 / -2.5%
tpch_q14/duckdb:vortex-file-compressed 11186646 / 11181264 / +0.0% 24016299 / 25354587 / -5.3% 0.47 / 0.44 / +5.6%
tpch_q15/duckdb:vortex-file-compressed 8168791 / 8381204 / -2.5% 19885890 / 20995174 / -5.3% 0.41 / 0.40 / +2.9%
tpch_q16/duckdb:vortex-file-compressed 16412362 / 16413233 / -0.0% 23698682 / 23979720 / -1.2% 0.69 / 0.68 / +1.2%
tpch_q17/duckdb:vortex-file-compressed 12451399 / 12592677 / -1.1% 27499647 / 28445363 / -3.3% 0.45 / 0.44 / +2.3%
tpch_q18/duckdb:vortex-file-compressed 24281504 / 24316808 / -0.1% 34722211 / 34951044 / -0.7% 0.70 / 0.70 / +0.5%
tpch_q19/duckdb:vortex-file-compressed 10289535 / 11426195 / -9.9% 25585478 / 25766839 / -0.7% 0.40 / 0.44 / -9.3%
tpch_q20/duckdb:vortex-file-compressed 14237151 / 14325643 / -0.6% 30407364 / 30552986 / -0.5% 0.47 / 0.47 / -0.1%
tpch_q21/duckdb:vortex-file-compressed 48252904 / 48281048 / -0.1% 64340072 / 66017908 / -2.5% 0.75 / 0.73 / +2.5%
tpch_q22/duckdb:vortex-file-compressed 16795505 / 16702790 / +0.6% 26927911 / 26800262 / +0.5% 0.62 / 0.62 / +0.1%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47479811 / 47547581 / -0.1% 54208971 / 54112740 / +0.2% 0.88 / 0.88 / -0.3%
tpch_q02/duckdb:parquet 48216019 / 48312217 / -0.2% 55063076 / 55151190 / -0.2% 0.88 / 0.88 / -0.0%
tpch_q03/duckdb:parquet 60182884 / 60217500 / -0.1% 69001858 / 69288935 / -0.4% 0.87 / 0.87 / +0.4%
tpch_q04/duckdb:parquet 34747750 / 34656547 / +0.3% 44074146 / 43053263 / +2.4% 0.79 / 0.80 / -2.1%
tpch_q05/duckdb:parquet 67008286 / 67091722 / -0.1% 77590384 / 77316587 / +0.4% 0.86 / 0.87 / -0.5%
tpch_q06/duckdb:parquet 21834170 / 21601570 / +1.1% 27900632 / 27249425 / +2.4% 0.78 / 0.79 / -1.3%
tpch_q07/duckdb:parquet 63697527 / 63799205 / -0.2% 72954434 / 72405251 / +0.8% 0.87 / 0.88 / -0.9%
tpch_q08/duckdb:parquet 75716398 / 75667269 / +0.1% 87545183 / 86769393 / +0.9% 0.86 / 0.87 / -0.8%
tpch_q09/duckdb:parquet 107984122 / 107847179 / +0.1% 120619124 / 118570948 / +1.7% 0.90 / 0.91 / -1.6%
tpch_q10/duckdb:parquet 105636469 / 105720936 / -0.1% 117687699 / 117200993 / +0.4% 0.90 / 0.90 / -0.5%
tpch_q11/duckdb:parquet 29448414 / 29439572 / +0.0% 34762701 / 34922812 / -0.5% 0.85 / 0.84 / +0.5%
tpch_q12/duckdb:parquet 37145759 / 37121505 / +0.1% 44601580 / 43764563 / +1.9% 0.83 / 0.85 / -1.8%
tpch_q13/duckdb:parquet 176259830 / 174812670 / +0.8% 184049877 / 184970583 / -0.5% 0.96 / 0.95 / +1.3%
tpch_q14/duckdb:parquet 42308122 / 42356235 / -0.1% 50989597 / 51063051 / -0.1% 0.83 / 0.83 / +0.0%
tpch_q15/duckdb:parquet 32479530 / 32503990 / -0.1% 41126988 / 41334737 / -0.5% 0.79 / 0.79 / +0.4%
tpch_q16/duckdb:parquet 47251903 / 47147798 / +0.2% 52804508 / 52668299 / +0.3% 0.89 / 0.90 / -0.0%
tpch_q17/duckdb:parquet 47896345 / 47964459 / -0.1% 57385580 / 56795941 / +1.0% 0.83 / 0.84 / -1.2%
tpch_q18/duckdb:parquet 74663983 / 73982405 / +0.9% 81550326 / 80482798 / +1.3% 0.92 / 0.92 / -0.4%
tpch_q19/duckdb:parquet 48495278 / 49071842 / -1.2% 55880819 / 55601512 / +0.5% 0.87 / 0.88 / -1.7%
tpch_q20/duckdb:parquet 63434004 / 63412118 / +0.0% 74807755 / 73364368 / +2.0% 0.85 / 0.86 / -1.9%
tpch_q21/duckdb:parquet 106229391 / 106560704 / -0.3% 117143292 / 116038695 / +1.0% 0.91 / 0.92 / -1.3%
tpch_q22/duckdb:parquet 50375647 / 50470913 / -0.2% 59202350 / 59155611 / +0.1% 0.85 / 0.85 / -0.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR e6ec8c58 vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.035x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.027x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93049220 / 92177346 / +0.9% 161548469 / 156197099 / +3.4% 0.58 / 0.59 / -2.4%
tpch_q02/datafusion:vortex-file-compressed 63879482 / 64428754 / -0.9% 95133975 / 94872596 / +0.3% 0.67 / 0.68 / -1.1%
tpch_q03/datafusion:vortex-file-compressed 62868508 / 64151894 / -2.0% 122798003 / 126780702 / -3.1% 0.51 / 0.51 / +1.2%
tpch_q04/datafusion:vortex-file-compressed 34543768 / 35028676 / -1.4% 71868363 / 68466710 / +5.0% 0.48 / 0.51 / -6.1%
tpch_q05/datafusion:vortex-file-compressed 123723043 / 118900162 / +4.1% 187111439 / 185439522 / +0.9% 0.66 / 0.64 / +3.1%
tpch_q06/datafusion:vortex-file-compressed 9928226 / 9649196 / +2.9% 57746113 / 57652551 / +0.2% 0.17 / 0.17 / +2.7%
tpch_q07/datafusion:vortex-file-compressed 96526701 / 97449767 / -0.9% 165437444 / 161011516 / +2.7% 0.58 / 0.61 / -3.6%
tpch_q08/datafusion:vortex-file-compressed 141523263 / 142206475 / -0.5% 219766002 / 226695985 / -3.1% 0.64 / 0.63 / +2.7%
tpch_q09/datafusion:vortex-file-compressed 184136499 / 182840408 / +0.7% 274230353 / 275147335 / -0.3% 0.67 / 0.66 / +1.0%
tpch_q10/datafusion:vortex-file-compressed 70164307 / 70621645 / -0.6% 135376405 / 136262721 / -0.7% 0.52 / 0.52 / +0.0%
tpch_q11/datafusion:vortex-file-compressed 45599790 / 45658051 / -0.1% 73651821 / 72364105 / +1.8% 0.62 / 0.63 / -1.9%
tpch_q12/datafusion:vortex-file-compressed 35261954 / 35235879 / +0.1% 80683071 / 79705799 / +1.2% 0.44 / 0.44 / -1.1%
tpch_q13/datafusion:vortex-file-compressed 50011106 / 48598467 / +2.9% 80847430 / 87210304 / -7.3% 0.62 / 0.56 / +11.0%
tpch_q14/datafusion:vortex-file-compressed 20379478 / 20650370 / -1.3% 87415344 / 88048054 / -0.7% 0.23 / 0.23 / -0.6%
tpch_q15/datafusion:vortex-file-compressed 33074468 / 33753614 / -2.0% 93009742 / 90785220 / +2.5% 0.36 / 0.37 / -4.4%
tpch_q16/datafusion:vortex-file-compressed 36719763 / 36919743 / -0.5% 67118139 / 65843812 / +1.9% 0.55 / 0.56 / -2.4%
tpch_q17/datafusion:vortex-file-compressed 178491709 / 176998771 / +0.8% 228451916 / 239755261 / -4.7% 0.78 / 0.74 / +5.8%
tpch_q18/datafusion:vortex-file-compressed 207024804 / 207996354 / -0.5% 283699412 / 275106107 / +3.1% 0.73 / 0.76 / -3.5%
tpch_q19/datafusion:vortex-file-compressed 29380609 / 28526869 / +3.0% 90778841 / 87666580 / +3.6% 0.32 / 0.33 / -0.5%
tpch_q20/datafusion:vortex-file-compressed 60058032 / 61936223 / -3.0% 115050868 / 118852369 / -3.2% 0.52 / 0.52 / +0.2%
tpch_q21/datafusion:vortex-file-compressed 178835741 / 182704046 / -2.1% 231204439 / 234984863 / -1.6% 0.77 / 0.78 / -0.5%
tpch_q22/datafusion:vortex-file-compressed 25808171 / 25513774 / +1.2% 54358225 / 55406439 / -1.9% 0.47 / 0.46 / +3.1%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87900967 / 87311538 / +0.7% 128212401 / 122516163 / +4.6% 0.69 / 0.71 / -3.8%
tpch_q02/datafusion:parquet 173604932 / 174735537 / -0.6% 196979024 / 198265824 / -0.6% 0.88 / 0.88 / +0.0%
tpch_q03/datafusion:parquet 135703692 / 135233090 / +0.3% 181089915 / 179364012 / +1.0% 0.75 / 0.75 / -0.6%
tpch_q04/datafusion:parquet 57514321 / 56985913 / +0.9% 89230184 / 85885070 / +3.9% 0.64 / 0.66 / -2.9%
tpch_q05/datafusion:parquet 167721295 / 166291221 / +0.9% 224717454 / 214896169 / +4.6% 0.75 / 0.77 / -3.5%
tpch_q06/datafusion:parquet 36358649 / 36510562 / -0.4% 73770125 / 72908306 / +1.2% 0.49 / 0.50 / -1.6%
tpch_q07/datafusion:parquet 220167798 / 215778947 / +2.0% 265509483 / 260314182 / +2.0% 0.83 / 0.83 / +0.0%
tpch_q08/datafusion:parquet 218263076 / 216791369 / +0.7% 289128284 / 278971702 / +3.6% 0.75 / 0.78 / -2.9%
tpch_q09/datafusion:parquet 311570541 / 307685989 / +1.3% 381440947 / 369588127 / +3.2% 0.82 / 0.83 / -1.9%
tpch_q10/datafusion:parquet 311748725 / 311954014 / -0.1% 373094514 / 359417304 / +3.8% 0.84 / 0.87 / -3.7%
tpch_q11/datafusion:parquet 126568885 / 127035714 / -0.4% 151744313 / 149936598 / +1.2% 0.83 / 0.85 / -1.6%
tpch_q12/datafusion:parquet 82042589 / 82433202 / -0.5% 119246019 / 116835758 / +2.1% 0.69 / 0.71 / -2.5%
tpch_q13/datafusion:parquet 210556038 / 210618688 / -0.0% 240059716 / 238788117 / +0.5% 0.88 / 0.88 / -0.6%
tpch_q14/datafusion:parquet 84916550 / 85602024 / -0.8% 194057175 / 186569859 / +4.0% 0.44 / 0.46 / -4.6%
tpch_q15/datafusion:parquet 106419175 / 106606603 / -0.2% 154290993 / 154598932 / -0.2% 0.69 / 0.69 / +0.0%
tpch_q16/datafusion:parquet 95249753 / 94683007 / +0.6% 123994759 / 123221265 / +0.6% 0.77 / 0.77 / -0.0%
tpch_q17/datafusion:parquet 215066335 / 215630850 / -0.3% 264411805 / 257798988 / +2.6% 0.81 / 0.84 / -2.8%
tpch_q18/datafusion:parquet 266637304 / 267541314 / -0.3% 325930434 / 318452912 / +2.3% 0.82 / 0.84 / -2.6%
tpch_q19/datafusion:parquet 107993596 / 108282497 / -0.3% 164903792 / 164045798 / +0.5% 0.65 / 0.66 / -0.8%
tpch_q20/datafusion:parquet 185162192 / 185298197 / -0.1% 239595134 / 237189433 / +1.0% 0.77 / 0.78 / -1.1%
tpch_q21/datafusion:parquet 241620843 / 244268713 / -1.1% 318238576 / 306493573 / +3.8% 0.76 / 0.80 / -4.7%
tpch_q22/datafusion:parquet 149475288 / 149723897 / -0.2% 174884183 / 171986203 / +1.7% 0.85 / 0.87 / -1.8%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33635440 / 33162813 / +1.4% 76196827 / 60965941 / +25.0% 🔴 0.44 / 0.54 / -18.8%
tpch_q02/duckdb:vortex-file-compressed 27862864 / 28441284 / -2.0% 42292835 / 42490796 / -0.5% 0.66 / 0.67 / -1.6%
tpch_q03/duckdb:vortex-file-compressed 52338126 / 51806352 / +1.0% 107686475 / 96181102 / +12.0% 🔴 0.49 / 0.54 / -9.8%
tpch_q04/duckdb:vortex-file-compressed 51555174 / 51520893 / +0.1% 91006933 / 83080389 / +9.5% 0.57 / 0.62 / -8.6%
tpch_q05/duckdb:vortex-file-compressed 68390803 / 68278233 / +0.2% 114753408 / 110549285 / +3.8% 0.60 / 0.62 / -3.5%
tpch_q06/duckdb:vortex-file-compressed 15060960 / 14995905 / +0.4% 56218603 / 49678736 / +13.2% 🔴 0.27 / 0.30 / -11.2%
tpch_q07/duckdb:vortex-file-compressed 54774874 / 55095502 / -0.6% 109334862 / 99927713 / +9.4% 0.50 / 0.55 / -9.1%
tpch_q08/duckdb:vortex-file-compressed 84607196 / 84730600 / -0.1% 133831687 / 128300677 / +4.3% 0.63 / 0.66 / -4.3%
tpch_q09/duckdb:vortex-file-compressed 102301149 / 102680463 / -0.4% 160594941 / 149752209 / +7.2% 0.64 / 0.69 / -7.1%
tpch_q10/duckdb:vortex-file-compressed 97127977 / 95736829 / +1.5% 160671573 / 145772381 / +10.2% 🔴 0.60 / 0.66 / -8.0%
tpch_q11/duckdb:vortex-file-compressed 13216099 / 13161487 / +0.4% 28618461 / 28614710 / +0.0% 0.46 / 0.46 / +0.4%
tpch_q12/duckdb:vortex-file-compressed 45624998 / 45171630 / +1.0% 86417197 / 74559415 / +15.9% 🔴 0.53 / 0.61 / -12.9%
tpch_q13/duckdb:vortex-file-compressed 72307380 / 71277113 / +1.4% 103843826 / 98751212 / +5.2% 0.70 / 0.72 / -3.5%
tpch_q14/duckdb:vortex-file-compressed 27760820 / 27742167 / +0.1% 75597335 / 68588058 / +10.2% 🔴 0.37 / 0.40 / -9.2%
tpch_q15/duckdb:vortex-file-compressed 23905735 / 24169914 / -1.1% 64616818 / 62760479 / +3.0% 0.37 / 0.39 / -3.9%
tpch_q16/duckdb:vortex-file-compressed 49838563 / 49823920 / +0.0% 58912769 / 58191998 / +1.2% 0.85 / 0.86 / -1.2%
tpch_q17/duckdb:vortex-file-compressed 34777363 / 34928738 / -0.4% 67242714 / 64550565 / +4.2% 0.52 / 0.54 / -4.4%
tpch_q18/duckdb:vortex-file-compressed 108282747 / 102866087 / +5.3% 125868736 / 121696816 / +3.4% 0.86 / 0.85 / +1.8%
tpch_q19/duckdb:vortex-file-compressed 26921728 / 27489534 / -2.1% 81412694 / 76106199 / +7.0% 0.33 / 0.36 / -8.4%
tpch_q20/duckdb:vortex-file-compressed 41016251 / 41385355 / -0.9% 92905234 / 88937430 / +4.5% 0.44 / 0.47 / -5.1%
tpch_q21/duckdb:vortex-file-compressed 92926012 / 92643489 / +0.3% 148029636 / 140692444 / +5.2% 0.63 / 0.66 / -4.7%
tpch_q22/duckdb:vortex-file-compressed 33005178 / 33019958 / -0.0% 49572311 / 47168881 / +5.1% 0.67 / 0.70 / -4.9%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67611876 / 68061708 / -0.7% 89365111 / 88188170 / +1.3% 0.76 / 0.77 / -2.0%
tpch_q02/duckdb:parquet 86791419 / 87254980 / -0.5% 97716910 / 98880371 / -1.2% 0.89 / 0.88 / +0.7%
tpch_q03/duckdb:parquet 109444685 / 110221645 / -0.7% 149197473 / 141238280 / +5.6% 0.73 / 0.78 / -6.0%
tpch_q04/duckdb:parquet 76479670 / 76532636 / -0.1% 100541041 / 97762896 / +2.8% 0.76 / 0.78 / -2.8%
tpch_q05/duckdb:parquet 122962546 / 123479542 / -0.4% 158765213 / 155668079 / +2.0% 0.77 / 0.79 / -2.4%
tpch_q06/duckdb:parquet 35447710 / 35931981 / -1.3% 69710256 / 56977323 / +22.3% 🔴 0.51 / 0.63 / -19.4%
tpch_q07/duckdb:parquet 117837153 / 119339250 / -1.3% 155158756 / 153627189 / +1.0% 0.76 / 0.78 / -2.2%
tpch_q08/duckdb:parquet 148168944 / 147255450 / +0.6% 191923000 / 190628929 / +0.7% 0.77 / 0.77 / -0.1%
tpch_q09/duckdb:parquet 236902297 / 235578554 / +0.6% 280492044 / 276803702 / +1.3% 0.84 / 0.85 / -0.8%
tpch_q10/duckdb:parquet 313600815 / 313587478 / +0.0% 337651810 / 337403692 / +0.1% 0.93 / 0.93 / -0.1%
tpch_q11/duckdb:parquet 43394374 / 43490479 / -0.2% 51129834 / 50005616 / +2.2% 0.85 / 0.87 / -2.4%
tpch_q12/duckdb:parquet 70699291 / 70505417 / +0.3% 92515995 / 90007679 / +2.8% 0.76 / 0.78 / -2.4%
tpch_q13/duckdb:parquet 294682091 / 293441858 / +0.4% 308208877 / 310736944 / -0.8% 0.96 / 0.94 / +1.2%
tpch_q14/duckdb:parquet 102268583 / 101133653 / +1.1% 152374719 / 136327535 / +11.8% 🔴 0.67 / 0.74 / -9.5%
tpch_q15/duckdb:parquet 57584724 / 57306184 / +0.5% 85938111 / 84972419 / +1.1% 0.67 / 0.67 / -0.6%
tpch_q16/duckdb:parquet 100661429 / 100633707 / +0.0% 107040353 / 107203047 / -0.2% 0.94 / 0.94 / +0.2%
tpch_q17/duckdb:parquet 82705441 / 83962666 / -1.5% 121253467 / 110031995 / +10.2% 🔴 0.68 / 0.76 / -10.6%
tpch_q18/duckdb:parquet 154854965 / 157083225 / -1.4% 173716200 / 172862922 / +0.5% 0.89 / 0.91 / -1.9%
tpch_q19/duckdb:parquet 99197890 / 98792583 / +0.4% 139912572 / 130377546 / +7.3% 0.71 / 0.76 / -6.4%
tpch_q20/duckdb:parquet 147147578 / 146971997 / +0.1% 186436764 / 181619680 / +2.7% 0.79 / 0.81 / -2.5%
tpch_q21/duckdb:parquet 255193957 / 254756250 / +0.2% 274296455 / 271034790 / +1.2% 0.93 / 0.94 / -1.0%
tpch_q22/duckdb:parquet 168411339 / 168406469 / +0.0% 180646798 / 179252698 / +0.8% 0.93 / 0.94 / -0.8%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR e6ec8c58 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+4.6%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 1.031x ➖ · cold 0.982x ➖
Parquet (geomean): hot 1.011x ➖ · cold 0.959x ➖
Shifts: Parquet (control) +1.1% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.055x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6051748 / 6250168 / -3.2% 20172588 / 19751173 / +2.1% 0.30 / 0.32 / -5.2%
fineweb_q01/datafusion:vortex-file-compressed 8997602 / 9285400 / -3.1% 36583056 / 35575139 / +2.8% 0.25 / 0.26 / -5.8%
fineweb_q02/datafusion:vortex-file-compressed 11546836 / 10567512 / +9.3% 41325470 / 40643432 / +1.7% 0.28 / 0.26 / +7.5%
fineweb_q03/datafusion:vortex-file-compressed 18024296 / 17539240 / +2.8% 105468533 / 102692107 / +2.7% 0.17 / 0.17 / +0.1%
fineweb_q04/datafusion:vortex-file-compressed 66067304 / 64090120 / +3.1% 137967536 / 144508483 / -4.5% 0.48 / 0.44 / +8.0%
fineweb_q05/datafusion:vortex-file-compressed 62226366 / 63203121 / -1.5% 141150971 / 139485427 / +1.2% 0.44 / 0.45 / -2.7%
fineweb_q06/datafusion:vortex-file-compressed 16812130 / 17269226 / -2.6% 103795633 / 106346388 / -2.4% 0.16 / 0.16 / -0.3%
fineweb_q07/datafusion:vortex-file-compressed 17964699 / 16748794 / +7.3% 99311042 / 103498538 / -4.0% 0.18 / 0.16 / +11.8%
fineweb_q08/datafusion:vortex-file-compressed 12242306 / 8455804 / +44.8% 🔴 29034655 / 26524896 / +9.5% 0.42 / 0.32 / +32.3%
datafusion / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9761730 / 9321344 / +4.7% 29524935 / 32543553 / -9.3% 0.33 / 0.29 / +15.4%
fineweb_q01/datafusion:parquet 75000772 / 75943192 / -1.2% 145555795 / 168115168 / -13.4% 🟢 0.52 / 0.45 / +14.1%
fineweb_q02/datafusion:parquet 75400252 / 75797688 / -0.5% 144427924 / 156430678 / -7.7% 0.52 / 0.48 / +7.7%
fineweb_q03/datafusion:parquet 74621440 / 73828035 / +1.1% 137935405 / 151042261 / -8.7% 0.54 / 0.49 / +10.7%
fineweb_q04/datafusion:parquet 82313820 / 82454360 / -0.2% 140321710 / 161665686 / -13.2% 🟢 0.59 / 0.51 / +15.0%
fineweb_q05/datafusion:parquet 82562272 / 81339953 / +1.5% 144908178 / 155427779 / -6.8% 0.57 / 0.52 / +8.9%
fineweb_q06/datafusion:parquet 76016399 / 76823475 / -1.1% 145539416 / 164720545 / -11.6% 🟢 0.52 / 0.47 / +12.0%
fineweb_q07/datafusion:parquet 75947296 / 73784924 / +2.9% 139403128 / 154776922 / -9.9% 0.54 / 0.48 / +14.3%
fineweb_q08/datafusion:parquet 74337158 / 73667172 / +0.9% 140186280 / 153339658 / -8.6% 0.53 / 0.48 / +10.4%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2075073 / 2129396 / -2.6% 7128817 / 8430467 / -15.4% 🟢 0.29 / 0.25 / +15.2%
fineweb_q01/duckdb:vortex-file-compressed 7244770 / 7609840 / -4.8% 25418184 / 27699884 / -8.2% 0.29 / 0.27 / +3.7%
fineweb_q02/duckdb:vortex-file-compressed 9614165 / 8999654 / +6.8% 30130743 / 32238453 / -6.5% 0.32 / 0.28 / +14.3%
fineweb_q03/duckdb:vortex-file-compressed 18007890 / 17999961 / +0.0% 87583245 / 89729159 / -2.4% 0.21 / 0.20 / +2.5%
fineweb_q04/duckdb:vortex-file-compressed 64890946 / 64895256 / -0.0% 101867545 / 105319449 / -3.3% 0.64 / 0.62 / +3.4%
fineweb_q05/duckdb:vortex-file-compressed 64896449 / 64576607 / +0.5% 100727613 / 100642505 / +0.1% 0.64 / 0.64 / +0.4%
fineweb_q06/duckdb:vortex-file-compressed 17890570 / 17451004 / +2.5% 87300621 / 90997772 / -4.1% 0.20 / 0.19 / +6.9%
fineweb_q07/duckdb:vortex-file-compressed 17112838 / 17567882 / -2.6% 87459574 / 90262327 / -3.1% 0.20 / 0.19 / +0.5%
fineweb_q08/duckdb:vortex-file-compressed 4836526 / 4479276 / +8.0% 13125599 / 12680631 / +3.5% 0.37 / 0.35 / +4.3%
duckdb / parquet / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23762089 / 23575786 / +0.8% 28095817 / 27901054 / +0.7% 0.85 / 0.84 / +0.1%
fineweb_q01/duckdb:parquet 56768073 / 53435612 / +6.2% 69813108 / 71035947 / -1.7% 0.81 / 0.75 / +8.1%
fineweb_q02/duckdb:parquet 59258101 / 58133262 / +1.9% 78291785 / 71614459 / +9.3% 0.76 / 0.81 / -6.8%
fineweb_q03/duckdb:parquet 118455835 / 119431288 / -0.8% 180072726 / 174813976 / +3.0% 0.66 / 0.68 / -3.7%
fineweb_q04/duckdb:parquet 161793950 / 160054805 / +1.1% 208983134 / 201506963 / +3.7% 0.77 / 0.79 / -2.5%
fineweb_q05/duckdb:parquet 159592269 / 159362006 / +0.1% 196889491 / 199292933 / -1.2% 0.81 / 0.80 / +1.4%
fineweb_q06/duckdb:parquet 88732673 / 88786282 / -0.1% 150667017 / 152544283 / -1.2% 0.59 / 0.58 / +1.2%
fineweb_q07/duckdb:parquet 92960668 / 90890989 / +2.3% 149743162 / 143350764 / +4.5% 0.62 / 0.63 / -2.1%
fineweb_q08/duckdb:parquet 28999297 / 28981936 / +0.1% 30626282 / 30002232 / +2.1% 0.95 / 0.97 / -2.0%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR e6ec8c58 vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.022x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.016x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21843612 / 21999911 / -0.7% 40912940 / 39946370 / +2.4% 0.53 / 0.55 / -3.1%
tpcds_q02/datafusion:vortex-file-compressed 43390520 / 42893253 / +1.2% 64682502 / 62914880 / +2.8% 0.67 / 0.68 / -1.6%
tpcds_q03/datafusion:vortex-file-compressed 11937662 / 11605178 / +2.9% 29900746 / 26609156 / +12.4% 🔴 0.40 / 0.44 / -8.5%
tpcds_q04/datafusion:vortex-file-compressed 80753023 / 78951654 / +2.3% 108717638 / 104564818 / +4.0% 0.74 / 0.76 / -1.6%
tpcds_q05/datafusion:vortex-file-compressed 60904464 / 55941465 / +8.9% 77595796 / 74124262 / +4.7% 0.78 / 0.75 / +4.0%
tpcds_q06/datafusion:vortex-file-compressed 22064422 / 21333720 / +3.4% 43386919 / 41069841 / +5.6% 0.51 / 0.52 / -2.1%
tpcds_q07/datafusion:vortex-file-compressed 26250738 / 26386390 / -0.5% 50759600 / 48176326 / +5.4% 0.52 / 0.55 / -5.6%
tpcds_q08/datafusion:vortex-file-compressed 25884425 / 25587712 / +1.2% 44601420 / 43682364 / +2.1% 0.58 / 0.59 / -0.9%
tpcds_q09/datafusion:vortex-file-compressed 20491130 / 19896226 / +3.0% 37347881 / 37474977 / -0.3% 0.55 / 0.53 / +3.3%
tpcds_q10/datafusion:vortex-file-compressed 29250856 / 29546889 / -1.0% 51312092 / 51180613 / +0.3% 0.57 / 0.58 / -1.3%
tpcds_q11/datafusion:vortex-file-compressed 49007884 / 49121194 / -0.2% 77554563 / 75394766 / +2.9% 0.63 / 0.65 / -3.0%
tpcds_q12/datafusion:vortex-file-compressed 15257756 / 14946749 / +2.1% 32895760 / 31749886 / +3.6% 0.46 / 0.47 / -1.5%
tpcds_q13/datafusion:vortex-file-compressed 31644846 / 31860550 / -0.7% 56363259 / 53865238 / +4.6% 0.56 / 0.59 / -5.1%
tpcds_q14/datafusion:vortex-file-compressed 488839538 / 487421370 / +0.3% 547446641 / 542474028 / +0.9% 0.89 / 0.90 / -0.6%
tpcds_q15/datafusion:vortex-file-compressed 12311477 / 12586756 / -2.2% 31777109 / 29869991 / +6.4% 0.39 / 0.42 / -8.1%
tpcds_q16/datafusion:vortex-file-compressed 18974634 / 18761618 / +1.1% 39205825 / 37089591 / +5.7% 0.48 / 0.51 / -4.3%
tpcds_q17/datafusion:vortex-file-compressed 52695685 / 53607682 / -1.7% 80978973 / 70072689 / +15.6% 🔴 0.65 / 0.77 / -14.9%
tpcds_q18/datafusion:vortex-file-compressed 63685142 / 62349632 / +2.1% 89828761 / 88633124 / +1.3% 0.71 / 0.70 / +0.8%
tpcds_q19/datafusion:vortex-file-compressed 17454196 / 17064877 / +2.3% 40552403 / 38137570 / +6.3% 0.43 / 0.45 / -3.8%
tpcds_q20/datafusion:vortex-file-compressed 16603745 / 16875604 / -1.6% 35164887 / 33398462 / +5.3% 0.47 / 0.51 / -6.6%
tpcds_q21/datafusion:vortex-file-compressed 14819498 / 14801170 / +0.1% 35454506 / 32973615 / +7.5% 0.42 / 0.45 / -6.9%
tpcds_q22/datafusion:vortex-file-compressed 48633816 / 49325762 / -1.4% 71369814 / 67699156 / +5.4% 0.68 / 0.73 / -6.5%
tpcds_q23/datafusion:vortex-file-compressed 72674856 / 72276124 / +0.6% 98908471 / 97272882 / +1.7% 0.73 / 0.74 / -1.1%
tpcds_q24/datafusion:vortex-file-compressed 63709486 / 63926868 / -0.3% 85847817 / 83129432 / +3.3% 0.74 / 0.77 / -3.5%
tpcds_q25/datafusion:vortex-file-compressed 44988450 / 44475855 / +1.2% 75006404 / 66779639 / +12.3% 🔴 0.60 / 0.67 / -9.9%
tpcds_q26/datafusion:vortex-file-compressed 26841922 / 26101808 / +2.8% 46826743 / 45977400 / +1.8% 0.57 / 0.57 / +1.0%
tpcds_q27/datafusion:vortex-file-compressed 53779650 / 53289153 / +0.9% 71696751 / 76338183 / -6.1% 0.75 / 0.70 / +7.5%
tpcds_q28/datafusion:vortex-file-compressed 19045933 / 19381416 / -1.7% 37499687 / 39922526 / -6.1% 0.51 / 0.49 / +4.6%
tpcds_q29/datafusion:vortex-file-compressed 52973808 / 52347589 / +1.2% 79509717 / 73566264 / +8.1% 0.67 / 0.71 / -6.4%
tpcds_q30/datafusion:vortex-file-compressed 27944156 / 27661427 / +1.0% 49591266 / 45075272 / +10.0% 🔴 0.56 / 0.61 / -8.2%
tpcds_q31/datafusion:vortex-file-compressed 62928505 / 62516696 / +0.7% 90320614 / 87634339 / +3.1% 0.70 / 0.71 / -2.3%
tpcds_q32/datafusion:vortex-file-compressed 12874281 / 13025350 / -1.2% 30347535 / 30062663 / +0.9% 0.42 / 0.43 / -2.1%
tpcds_q33/datafusion:vortex-file-compressed 28550474 / 27991706 / +2.0% 51743143 / 50078992 / +3.3% 0.55 / 0.56 / -1.3%
tpcds_q34/datafusion:vortex-file-compressed 17865172 / 17855906 / +0.1% 38647298 / 36650085 / +5.4% 0.46 / 0.49 / -5.1%
tpcds_q35/datafusion:vortex-file-compressed 30701116 / 31075584 / -1.2% 55065053 / 54010849 / +2.0% 0.56 / 0.58 / -3.1%
tpcds_q36/datafusion:vortex-file-compressed 48308124 / 46691248 / +3.5% 73670721 / 69134076 / +6.6% 0.66 / 0.68 / -2.9%
tpcds_q37/datafusion:vortex-file-compressed 12494484 / 12935278 / -3.4% 33529435 / 33965509 / -1.3% 0.37 / 0.38 / -2.2%
tpcds_q38/datafusion:vortex-file-compressed 26123386 / 26436550 / -1.2% 49729889 / 46500479 / +6.9% 0.53 / 0.57 / -7.6%
tpcds_q39/datafusion:vortex-file-compressed 64004074 / 64408856 / -0.6% 88136357 / 87056639 / +1.2% 0.73 / 0.74 / -1.8%
tpcds_q40/datafusion:vortex-file-compressed 22887798 / 22195258 / +3.1% 41095089 / 39059042 / +5.2% 0.56 / 0.57 / -2.0%
tpcds_q41/datafusion:vortex-file-compressed 20293202 / 20181415 / +0.6% 32901618 / 32305841 / +1.8% 0.62 / 0.62 / -1.3%
tpcds_q42/datafusion:vortex-file-compressed 11650319 / 11610268 / +0.3% 28556655 / 27549864 / +3.7% 0.41 / 0.42 / -3.2%
tpcds_q43/datafusion:vortex-file-compressed 13185351 / 13251107 / -0.5% 34304464 / 31511768 / +8.9% 0.38 / 0.42 / -8.6%
tpcds_q44/datafusion:vortex-file-compressed 27234110 / 27407222 / -0.6% 51452168 / 49901538 / +3.1% 0.53 / 0.55 / -3.6%
tpcds_q45/datafusion:vortex-file-compressed 16862856 / 17168016 / -1.8% 35855092 / 34200247 / +4.8% 0.47 / 0.50 / -6.3%
tpcds_q46/datafusion:vortex-file-compressed 24033598 / 23558210 / +2.0% 46705987 / 45525195 / +2.6% 0.51 / 0.52 / -0.6%
tpcds_q47/datafusion:vortex-file-compressed 75200120 / 75593490 / -0.5% 108464036 / 103395942 / +4.9% 0.69 / 0.73 / -5.2%
tpcds_q48/datafusion:vortex-file-compressed 28796530 / 28579330 / +0.8% 53337176 / 51250463 / +4.1% 0.54 / 0.56 / -3.2%
tpcds_q49/datafusion:vortex-file-compressed 57697389 / 57212074 / +0.8% 75945461 / 74563681 / +1.9% 0.76 / 0.77 / -1.0%
tpcds_q50/datafusion:vortex-file-compressed 30563122 / 31077502 / -1.7% 52901581 / 51768133 / +2.2% 0.58 / 0.60 / -3.8%
tpcds_q51/datafusion:vortex-file-compressed 66429423 / 67219460 / -1.2% 91481909 / 89984116 / +1.7% 0.73 / 0.75 / -2.8%
tpcds_q52/datafusion:vortex-file-compressed 11848740 / 11829058 / +0.2% 30416232 / 28624926 / +6.3% 0.39 / 0.41 / -5.7%
tpcds_q53/datafusion:vortex-file-compressed 18514350 / 18240894 / +1.5% 41209586 / 37934996 / +8.6% 0.45 / 0.48 / -6.6%
tpcds_q54/datafusion:vortex-file-compressed 31998434 / 32073801 / -0.2% 55374620 / 53625583 / +3.3% 0.58 / 0.60 / -3.4%
tpcds_q55/datafusion:vortex-file-compressed 11511266 / 11528832 / -0.2% 28567844 / 27437884 / +4.1% 0.40 / 0.42 / -4.1%
tpcds_q56/datafusion:vortex-file-compressed 27399673 / 26666916 / +2.7% 48322940 / 47448670 / +1.8% 0.57 / 0.56 / +0.9%
tpcds_q57/datafusion:vortex-file-compressed 61773450 / 62012122 / -0.4% 88754212 / 87267119 / +1.7% 0.70 / 0.71 / -2.1%
tpcds_q58/datafusion:vortex-file-compressed 40428614 / 40818922 / -1.0% 67657822 / 64518211 / +4.9% 0.60 / 0.63 / -5.6%
tpcds_q59/datafusion:vortex-file-compressed 27709710 / 27906409 / -0.7% 54575652 / 53781464 / +1.5% 0.51 / 0.52 / -2.1%
tpcds_q60/datafusion:vortex-file-compressed 27093610 / 27726237 / -2.3% 47335290 / 47532249 / -0.4% 0.57 / 0.58 / -1.9%
tpcds_q61/datafusion:vortex-file-compressed 20735466 / 20214066 / +2.6% 42467296 / 39682747 / +7.0% 0.49 / 0.51 / -4.1%
tpcds_q62/datafusion:vortex-file-compressed 16513410 / 16850174 / -2.0% 35685879 / 34396629 / +3.7% 0.46 / 0.49 / -5.5%
tpcds_q63/datafusion:vortex-file-compressed 18517530 / 18192128 / +1.8% 40254056 / 37641254 / +6.9% 0.46 / 0.48 / -4.8%
tpcds_q64/datafusion:vortex-file-compressed 188845053 / 188561892 / +0.2% 224045151 / 229680212 / -2.5% 0.84 / 0.82 / +2.7%
tpcds_q65/datafusion:vortex-file-compressed 74321708 / 73066724 / +1.7% 96464438 / 96562612 / -0.1% 0.77 / 0.76 / +1.8%
tpcds_q66/datafusion:vortex-file-compressed 50554372 / 50096568 / +0.9% 71573359 / 69306342 / +3.3% 0.71 / 0.72 / -2.3%
tpcds_q67/datafusion:vortex-file-compressed 51233536 / 51663640 / -0.8% 83950564 / 83492505 / +0.5% 0.61 / 0.62 / -1.4%
tpcds_q68/datafusion:vortex-file-compressed 23329672 / 22888054 / +1.9% 46127454 / 44101071 / +4.6% 0.51 / 0.52 / -2.5%
tpcds_q69/datafusion:vortex-file-compressed 27505196 / 27546142 / -0.1% 48527987 / 47372016 / +2.4% 0.57 / 0.58 / -2.5%
tpcds_q70/datafusion:vortex-file-compressed 72896950 / 73486667 / -0.8% 96118337 / 97916702 / -1.8% 0.76 / 0.75 / +1.1%
tpcds_q71/datafusion:vortex-file-compressed 19208646 / 19173117 / +0.2% 40531321 / 37641700 / +7.7% 0.47 / 0.51 / -7.0%
tpcds_q72/datafusion:vortex-file-compressed 264259516 / 247376824 / +6.8% 285620451 / 279389691 / +2.2% 0.93 / 0.89 / +4.5%
tpcds_q73/datafusion:vortex-file-compressed 16455306 / 16283788 / +1.1% 39396335 / 37287301 / +5.7% 0.42 / 0.44 / -4.4%
tpcds_q74/datafusion:vortex-file-compressed 40775022 / 40826743 / -0.1% 66123512 / 66742487 / -0.9% 0.62 / 0.61 / +0.8%
tpcds_q75/datafusion:vortex-file-compressed 136807726 / 133968630 / +2.1% 163964872 / 162666038 / +0.8% 0.83 / 0.82 / +1.3%
tpcds_q76/datafusion:vortex-file-compressed 29847459 / 28638050 / +4.2% 50976656 / 48545831 / +5.0% 0.59 / 0.59 / -0.7%
tpcds_q77/datafusion:vortex-file-compressed 45652902 / 44422120 / +2.8% 66752905 / 65708594 / +1.6% 0.68 / 0.68 / +1.2%
tpcds_q78/datafusion:vortex-file-compressed 60832992 / 60965657 / -0.2% 91320919 / 86015972 / +6.2% 0.67 / 0.71 / -6.0%
tpcds_q79/datafusion:vortex-file-compressed 20089934 / 20279438 / -0.9% 43020381 / 42110377 / +2.2% 0.47 / 0.48 / -3.0%
tpcds_q80/datafusion:vortex-file-compressed 68503148 / 68766030 / -0.4% 95008735 / 93570722 / +1.5% 0.72 / 0.73 / -1.9%
tpcds_q81/datafusion:vortex-file-compressed 27761757 / 28260648 / -1.8% 47259967 / 45300560 / +4.3% 0.59 / 0.62 / -5.8%
tpcds_q82/datafusion:vortex-file-compressed 11799390 / 12807434 / -7.9% 36327285 / 35626130 / +2.0% 0.32 / 0.36 / -9.6%
tpcds_q83/datafusion:vortex-file-compressed 35282764 / 35376074 / -0.3% 54291159 / 52093141 / +4.2% 0.65 / 0.68 / -4.3%
tpcds_q84/datafusion:vortex-file-compressed 10552424 / 10461540 / +0.9% 26350574 / 25885722 / +1.8% 0.40 / 0.40 / -0.9%
tpcds_q85/datafusion:vortex-file-compressed 51676540 / 51809666 / -0.3% 78256113 / 75574697 / +3.5% 0.66 / 0.69 / -3.7%
tpcds_q86/datafusion:vortex-file-compressed 16167700 / 16113415 / +0.3% 35155247 / 34409002 / +2.2% 0.46 / 0.47 / -1.8%
tpcds_q87/datafusion:vortex-file-compressed 26339200 / 26499568 / -0.6% 49168661 / 48598250 / +1.2% 0.54 / 0.55 / -1.8%
tpcds_q88/datafusion:vortex-file-compressed 32407250 / 32357568 / +0.2% 55079765 / 50858837 / +8.3% 0.59 / 0.64 / -7.5%
tpcds_q89/datafusion:vortex-file-compressed 21543262 / 21807304 / -1.2% 43866966 / 42407282 / +3.4% 0.49 / 0.51 / -4.5%
tpcds_q90/datafusion:vortex-file-compressed 10369863 / 10365216 / +0.0% 25752172 / 24066050 / +7.0% 0.40 / 0.43 / -6.5%
tpcds_q91/datafusion:vortex-file-compressed 15612353 / 16048840 / -2.7% 38965841 / 36604324 / +6.5% 0.40 / 0.44 / -8.6%
tpcds_q92/datafusion:vortex-file-compressed 13207024 / 13198902 / +0.1% 31637355 / 29685220 / +6.6% 0.42 / 0.44 / -6.1%
tpcds_q93/datafusion:vortex-file-compressed 19813654 / 20150414 / -1.7% 41820930 / 40148939 / +4.2% 0.47 / 0.50 / -5.6%
tpcds_q94/datafusion:vortex-file-compressed 18389583 / 18552985 / -0.9% 37734925 / 37927246 / -0.5% 0.49 / 0.49 / -0.4%
tpcds_q95/datafusion:vortex-file-compressed 41482985 / 41763500 / -0.7% 62349453 / 60866535 / +2.4% 0.67 / 0.69 / -3.0%
tpcds_q96/datafusion:vortex-file-compressed 7741607 / 7859994 / -1.5% 25046593 / 23576532 / +6.2% 0.31 / 0.33 / -7.3%
tpcds_q97/datafusion:vortex-file-compressed 17423306 / 17259486 / +0.9% 40587874 / 37350276 / +8.7% 0.43 / 0.46 / -7.1%
tpcds_q98/datafusion:vortex-file-compressed 16268103 / 16185816 / +0.5% 35008718 / 32671739 / +7.2% 0.46 / 0.50 / -6.2%
tpcds_q99/datafusion:vortex-file-compressed 16467967 / 16384194 / +0.5% 35905866 / 33993322 / +5.6% 0.46 / 0.48 / -4.8%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42974380 / 43046149 / -0.2% 59752329 / 59333915 / +0.7% 0.72 / 0.73 / -0.9%
tpcds_q02/datafusion:parquet 55077004 / 55017496 / +0.1% 69920285 / 69006470 / +1.3% 0.79 / 0.80 / -1.2%
tpcds_q03/datafusion:parquet 18935996 / 19078092 / -0.7% 30009280 / 32968281 / -9.0% 0.63 / 0.58 / +9.0%
tpcds_q04/datafusion:parquet 179224851 / 179731768 / -0.3% 202830602 / 199226926 / +1.8% 0.88 / 0.90 / -2.1%
tpcds_q05/datafusion:parquet 68432254 / 68363662 / +0.1% 89168385 / 88310082 / +1.0% 0.77 / 0.77 / -0.9%
tpcds_q06/datafusion:parquet 34032583 / 35133400 / -3.1% 46361311 / 44032369 / +5.3% 0.73 / 0.80 / -8.0%
tpcds_q07/datafusion:parquet 46752163 / 47015244 / -0.6% 65280857 / 63060866 / +3.5% 0.72 / 0.75 / -3.9%
tpcds_q08/datafusion:parquet 31222865 / 31108916 / +0.4% 47716978 / 46407336 / +2.8% 0.65 / 0.67 / -2.4%
tpcds_q09/datafusion:parquet 33237240 / 32235404 / +3.1% 44241259 / 38162448 / +15.9% 🔴 0.75 / 0.84 / -11.1%
tpcds_q10/datafusion:parquet 44872228 / 45810956 / -2.0% 57424433 / 55821116 / +2.9% 0.78 / 0.82 / -4.8%
tpcds_q11/datafusion:parquet 96818438 / 97324552 / -0.5% 119814535 / 116986930 / +2.4% 0.81 / 0.83 / -2.9%
tpcds_q12/datafusion:parquet 24020846 / 23829389 / +0.8% 35244008 / 34561700 / +2.0% 0.68 / 0.69 / -1.1%
tpcds_q13/datafusion:parquet 46890716 / 47205746 / -0.7% 67464777 / 66519722 / +1.4% 0.70 / 0.71 / -2.1%
tpcds_q14/datafusion:parquet 535775480 / 536062596 / -0.1% 588940651 / 573875357 / +2.6% 0.91 / 0.93 / -2.6%
tpcds_q15/datafusion:parquet 23760318 / 23467316 / +1.2% 37236426 / 36912696 / +0.9% 0.64 / 0.64 / +0.4%
tpcds_q16/datafusion:parquet 36437103 / 36797934 / -1.0% 49210668 / 49093338 / +0.2% 0.74 / 0.75 / -1.2%
tpcds_q17/datafusion:parquet 74288112 / 77417738 / -4.0% 98938714 / 94152957 / +5.1% 0.75 / 0.82 / -8.7%
tpcds_q18/datafusion:parquet 67409736 / 67730459 / -0.5% 89262280 / 89015478 / +0.3% 0.76 / 0.76 / -0.7%
tpcds_q19/datafusion:parquet 29621000 / 29767255 / -0.5% 43170049 / 40859608 / +5.7% 0.69 / 0.73 / -5.8%
tpcds_q20/datafusion:parquet 24404273 / 24985466 / -2.3% 37313398 / 37149008 / +0.4% 0.65 / 0.67 / -2.8%
tpcds_q21/datafusion:parquet 20087662 / 20098942 / -0.1% 32573506 / 31199048 / +4.4% 0.62 / 0.64 / -4.3%
tpcds_q22/datafusion:parquet 76664085 / 78225004 / -2.0% 88874074 / 88011450 / +1.0% 0.86 / 0.89 / -2.9%
tpcds_q23/datafusion:parquet 91459578 / 93465786 / -2.1% 114035896 / 115763272 / -1.5% 0.80 / 0.81 / -0.7%
tpcds_q24/datafusion:parquet 90859614 / 90530880 / +0.4% 114319969 / 112774834 / +1.4% 0.79 / 0.80 / -1.0%
tpcds_q25/datafusion:parquet 81519270 / 78942378 / +3.3% 95873648 / 100286343 / -4.4% 0.85 / 0.79 / +8.0%
tpcds_q26/datafusion:parquet 43647270 / 42985690 / +1.5% 57280869 / 59286646 / -3.4% 0.76 / 0.73 / +5.1%
tpcds_q27/datafusion:parquet 76796460 / 78387144 / -2.0% 103005078 / 99975873 / +3.0% 0.75 / 0.78 / -4.9%
tpcds_q28/datafusion:parquet 28485857 / 28355490 / +0.5% 45441204 / 41055918 / +10.7% 🔴 0.63 / 0.69 / -9.2%
tpcds_q29/datafusion:parquet 75810490 / 74275574 / +2.1% 97116199 / 99075419 / -2.0% 0.78 / 0.75 / +4.1%
tpcds_q30/datafusion:parquet 44888457 / 44266542 / +1.4% 57763020 / 55134805 / +4.8% 0.78 / 0.80 / -3.2%
tpcds_q31/datafusion:parquet 82093530 / 80991932 / +1.4% 98338699 / 100088488 / -1.7% 0.83 / 0.81 / +3.2%
tpcds_q32/datafusion:parquet 26592281 / 27160338 / -2.1% 41050445 / 37888363 / +8.3% 0.65 / 0.72 / -9.6%
tpcds_q33/datafusion:parquet 38369344 / 37472210 / +2.4% 55001063 / 52784833 / +4.2% 0.70 / 0.71 / -1.7%
tpcds_q34/datafusion:parquet 24329083 / 24223199 / +0.4% 36464950 / 34925847 / +4.4% 0.67 / 0.69 / -3.8%
tpcds_q35/datafusion:parquet 50798388 / 50061658 / +1.5% 64212753 / 66186392 / -3.0% 0.79 / 0.76 / +4.6%
tpcds_q36/datafusion:parquet 53148245 / 53863620 / -1.3% 71754849 / 72008538 / -0.4% 0.74 / 0.75 / -1.0%
tpcds_q37/datafusion:parquet 21258992 / 21492292 / -1.1% 33522644 / 33965178 / -1.3% 0.63 / 0.63 / +0.2%
tpcds_q38/datafusion:parquet 45489270 / 43738358 / +4.0% 65313380 / 58984516 / +10.7% 🔴 0.70 / 0.74 / -6.1%
tpcds_q39/datafusion:parquet 68373052 / 68451454 / -0.1% 84508902 / 84694449 / -0.2% 0.81 / 0.81 / +0.1%
tpcds_q40/datafusion:parquet 30135256 / 29898065 / +0.8% 50247346 / 49416081 / +1.7% 0.60 / 0.61 / -0.9%
tpcds_q41/datafusion:parquet 20037738 / 19725044 / +1.6% 32592729 / 31567276 / +3.2% 0.61 / 0.62 / -1.6%
tpcds_q42/datafusion:parquet 18166852 / 18410036 / -1.3% 30158395 / 29096386 / +3.6% 0.60 / 0.63 / -4.8%
tpcds_q43/datafusion:parquet 19432430 / 19482850 / -0.3% 32017584 / 30496940 / +5.0% 0.61 / 0.64 / -5.0%
tpcds_q44/datafusion:parquet 35411028 / 35289568 / +0.3% 50098682 / 48402674 / +3.5% 0.71 / 0.73 / -3.1%
tpcds_q45/datafusion:parquet 28022772 / 28034722 / -0.0% 40413581 / 38421721 / +5.2% 0.69 / 0.73 / -5.0%
tpcds_q46/datafusion:parquet 28952355 / 29018574 / -0.2% 45481875 / 44678861 / +1.8% 0.64 / 0.65 / -2.0%
tpcds_q47/datafusion:parquet 97411114 / 96614053 / +0.8% 122821712 / 119575121 / +2.7% 0.79 / 0.81 / -1.8%
tpcds_q48/datafusion:parquet 41523076 / 42307228 / -1.9% 59838065 / 57749935 / +3.6% 0.69 / 0.73 / -5.3%
tpcds_q49/datafusion:parquet 72714742 / 72427164 / +0.4% 94697188 / 91585118 / +3.4% 0.77 / 0.79 / -2.9%
tpcds_q50/datafusion:parquet 48631702 / 47500422 / +2.4% 69139935 / 68227695 / +1.3% 0.70 / 0.70 / +1.0%
tpcds_q51/datafusion:parquet 74838776 / 74856850 / -0.0% 94475688 / 94480088 / -0.0% 0.79 / 0.79 / -0.0%
tpcds_q52/datafusion:parquet 18495306 / 18570137 / -0.4% 31285704 / 28281276 / +10.6% 🔴 0.59 / 0.66 / -10.0%
tpcds_q53/datafusion:parquet 23008141 / 21996628 / +4.6% 38614981 / 37632392 / +2.6% 0.60 / 0.58 / +1.9%
tpcds_q54/datafusion:parquet 53123428 / 53403201 / -0.5% 69185262 / 65412957 / +5.8% 0.77 / 0.82 / -5.9%
tpcds_q55/datafusion:parquet 18196034 / 18094322 / +0.6% 30308700 / 28452535 / +6.5% 0.60 / 0.64 / -5.6%
tpcds_q56/datafusion:parquet 41055884 / 42064521 / -2.4% 54216708 / 52494093 / +3.3% 0.76 / 0.80 / -5.5%
tpcds_q57/datafusion:parquet 101881575 / 98531152 / +3.4% 113240963 / 115051750 / -1.6% 0.90 / 0.86 / +5.1%
tpcds_q58/datafusion:parquet 65230606 / 66028114 / -1.2% 81891982 / 80484923 / +1.7% 0.80 / 0.82 / -2.9%
tpcds_q59/datafusion:parquet 47551737 / 48124550 / -1.2% 64368924 / 63375622 / +1.6% 0.74 / 0.76 / -2.7%
tpcds_q60/datafusion:parquet 41933136 / 41774428 / +0.4% 53659007 / 52913053 / +1.4% 0.78 / 0.79 / -1.0%
tpcds_q61/datafusion:parquet 36385108 / 36568854 / -0.5% 50419491 / 53842276 / -6.4% 0.72 / 0.68 / +6.3%
tpcds_q62/datafusion:parquet 25232444 / 25168784 / +0.3% 37853805 / 38657488 / -2.1% 0.67 / 0.65 / +2.4%
tpcds_q63/datafusion:parquet 22413353 / 22467320 / -0.2% 38730898 / 36224907 / +6.9% 0.58 / 0.62 / -6.7%
tpcds_q64/datafusion:parquet 285170180 / 285654170 / -0.2% 326538247 / 321241476 / +1.6% 0.87 / 0.89 / -1.8%
tpcds_q65/datafusion:parquet 123702176 / 119227688 / +3.8% 139194745 / 139579808 / -0.3% 0.89 / 0.85 / +4.0%
tpcds_q66/datafusion:parquet 60577532 / 61287888 / -1.2% 76892447 / 75163315 / +2.3% 0.79 / 0.82 / -3.4%
tpcds_q67/datafusion:parquet 69169421 / 69044428 / +0.2% 92352965 / 91696967 / +0.7% 0.75 / 0.75 / -0.5%
tpcds_q68/datafusion:parquet 28752840 / 29075160 / -1.1% 47524472 / 47405672 / +0.3% 0.61 / 0.61 / -1.4%
tpcds_q69/datafusion:parquet 43730439 / 43304174 / +1.0% 56350328 / 58652073 / -3.9% 0.78 / 0.74 / +5.1%
tpcds_q70/datafusion:parquet 80631720 / 80027439 / +0.8% 97248980 / 97604918 / -0.4% 0.83 / 0.82 / +1.1%
tpcds_q71/datafusion:parquet 25173708 / 25732466 / -2.2% 38838722 / 40528677 / -4.2% 0.65 / 0.63 / +2.1%
tpcds_q72/datafusion:parquet 524180113 / 527634840 / -0.7% 547286018 / 554349016 / -1.3% 0.96 / 0.95 / +0.6%
tpcds_q73/datafusion:parquet 24086348 / 23762050 / +1.4% 36981252 / 35077300 / +5.4% 0.65 / 0.68 / -3.9%
tpcds_q74/datafusion:parquet 71245984 / 69999536 / +1.8% 93000709 / 88289509 / +5.3% 0.77 / 0.79 / -3.4%
tpcds_q75/datafusion:parquet 154552222 / 152662930 / +1.2% 177495262 / 180450074 / -1.6% 0.87 / 0.85 / +2.9%
tpcds_q76/datafusion:parquet 34005340 / 33132911 / +2.6% 48377714 / 44935481 / +7.7% 0.70 / 0.74 / -4.7%
tpcds_q77/datafusion:parquet 56950318 / 56979256 / -0.1% 73044285 / 72969812 / +0.1% 0.78 / 0.78 / -0.2%
tpcds_q78/datafusion:parquet 86029606 / 85272162 / +0.9% 116699418 / 115614404 / +0.9% 0.74 / 0.74 / -0.0%
tpcds_q79/datafusion:parquet 26514304 / 26735792 / -0.8% 41548186 / 39769716 / +4.5% 0.64 / 0.67 / -5.1%
tpcds_q80/datafusion:parquet 81071666 / 78680880 / +3.0% 109452946 / 107863155 / +1.5% 0.74 / 0.73 / +1.5%
tpcds_q81/datafusion:parquet 38312160 / 39558134 / -3.1% 51647966 / 51081109 / +1.1% 0.74 / 0.77 / -4.2%
tpcds_q82/datafusion:parquet 22995932 / 22190428 / +3.6% 36523054 / 34291795 / +6.5% 0.63 / 0.65 / -2.7%
tpcds_q83/datafusion:parquet 59098238 / 58307740 / +1.4% 74572633 / 73002134 / +2.2% 0.79 / 0.80 / -0.8%
tpcds_q84/datafusion:parquet 25566430 / 27313596 / -6.4% 40178565 / 40041516 / +0.3% 0.64 / 0.68 / -6.7%
tpcds_q85/datafusion:parquet 80430108 / 79983598 / +0.6% 103861400 / 102306985 / +1.5% 0.77 / 0.78 / -0.9%
tpcds_q86/datafusion:parquet 21244172 / 21058438 / +0.9% 33312988 / 32574181 / +2.3% 0.64 / 0.65 / -1.4%
tpcds_q87/datafusion:parquet 45907784 / 45280914 / +1.4% 62008341 / 62384128 / -0.6% 0.74 / 0.73 / +2.0%
tpcds_q88/datafusion:parquet 38108618 / 37757294 / +0.9% 53126264 / 51820809 / +2.5% 0.72 / 0.73 / -1.5%
tpcds_q89/datafusion:parquet 25898225 / 26318301 / -1.6% 42328220 / 39991728 / +5.8% 0.61 / 0.66 / -7.0%
tpcds_q90/datafusion:parquet 15475854 / 15087966 / +2.6% 25752634 / 26597960 / -3.2% 0.60 / 0.57 / +5.9%
tpcds_q91/datafusion:parquet 32242350 / 32625398 / -1.2% 46442473 / 45196471 / +2.8% 0.69 / 0.72 / -3.8%
tpcds_q92/datafusion:parquet 26825608 / 26834922 / -0.0% 41504215 / 38063167 / +9.0% 0.65 / 0.71 / -8.3%
tpcds_q93/datafusion:parquet 27157438 / 26735974 / +1.6% 46543159 / 42486273 / +9.5% 0.58 / 0.63 / -7.3%
tpcds_q94/datafusion:parquet 35711868 / 35393988 / +0.9% 47851370 / 47118664 / +1.6% 0.75 / 0.75 / -0.6%
tpcds_q95/datafusion:parquet 63475448 / 64212454 / -1.1% 81454663 / 79492966 / +2.5% 0.78 / 0.81 / -3.5%
tpcds_q96/datafusion:parquet 12981718 / 12723054 / +2.0% 24335949 / 23429883 / +3.9% 0.53 / 0.54 / -1.8%
tpcds_q97/datafusion:parquet 35860540 / 35098156 / +2.2% 51614389 / 49335860 / +4.6% 0.69 / 0.71 / -2.3%
tpcds_q98/datafusion:parquet 24985176 / 25139323 / -0.6% 39619492 / 36349537 / +9.0% 0.63 / 0.69 / -8.8%
tpcds_q99/datafusion:parquet 29773078 / 29673968 / +0.3% 42093683 / 41366470 / +1.8% 0.71 / 0.72 / -1.4%
duckdb / vortex-file-compressed / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15784802 / 15890239 / -0.7% 24373414 / 24196641 / +0.7% 0.65 / 0.66 / -1.4%
tpcds_q02/duckdb:vortex-file-compressed 17746478 / 18657920 / -4.9% 22535669 / 22422968 / +0.5% 0.79 / 0.83 / -5.4%
tpcds_q03/duckdb:vortex-file-compressed 7017012 / 7149274 / -1.9% 15686320 / 16220757 / -3.3% 0.45 / 0.44 / +1.5%
tpcds_q04/duckdb:vortex-file-compressed 58479982 / 58862208 / -0.6% 73078631 / 71856038 / +1.7% 0.80 / 0.82 / -2.3%
tpcds_q05/duckdb:vortex-file-compressed 22892020 / 23117854 / -1.0% 32603463 / 32942130 / -1.0% 0.70 / 0.70 / +0.1%
tpcds_q06/duckdb:vortex-file-compressed 24166476 / 24164680 / +0.0% 38778272 / 37874428 / +2.4% 0.62 / 0.64 / -2.3%
tpcds_q07/duckdb:vortex-file-compressed 21821327 / 22109802 / -1.3% 35022490 / 32504438 / +7.7% 0.62 / 0.68 / -8.4%
tpcds_q08/duckdb:vortex-file-compressed 17202284 / 17492722 / -1.7% 25105966 / 25089879 / +0.1% 0.69 / 0.70 / -1.7%
tpcds_q09/duckdb:vortex-file-compressed 18994804 / 19005454 / -0.1% 29312904 / 29541405 / -0.8% 0.65 / 0.64 / +0.7%
tpcds_q10/duckdb:vortex-file-compressed 27155737 / 27533383 / -1.4% 41424312 / 41135181 / +0.7% 0.66 / 0.67 / -2.1%
tpcds_q11/duckdb:vortex-file-compressed 37028376 / 36618646 / +1.1% 45716046 / 44343100 / +3.1% 0.81 / 0.83 / -1.9%
tpcds_q12/duckdb:vortex-file-compressed 9746290 / 9679752 / +0.7% 16493951 / 17229625 / -4.3% 0.59 / 0.56 / +5.2%
tpcds_q13/duckdb:vortex-file-compressed 18991776 / 19843352 / -4.3% 32607764 / 31995768 / +1.9% 0.58 / 0.62 / -6.1%
tpcds_q14/duckdb:vortex-file-compressed 55052346 / 55297112 / -0.4% 64844448 / 64955646 / -0.2% 0.85 / 0.85 / -0.3%
tpcds_q15/duckdb:vortex-file-compressed 11218884 / 11325009 / -0.9% 18356493 / 18325444 / +0.2% 0.61 / 0.62 / -1.1%
tpcds_q16/duckdb:vortex-file-compressed 24399764 / 24731064 / -1.3% 35558283 / 34853379 / +2.0% 0.69 / 0.71 / -3.3%
tpcds_q17/duckdb:vortex-file-compressed 20362670 / 20396798 / -0.2% 31721117 / 32338231 / -1.9% 0.64 / 0.63 / +1.8%
tpcds_q18/duckdb:vortex-file-compressed 32026588 / 32346349 / -1.0% 43600293 / 43278488 / +0.7% 0.73 / 0.75 / -1.7%
tpcds_q19/duckdb:vortex-file-compressed 20619940 / 20786617 / -0.8% 30768775 / 29101806 / +5.7% 0.67 / 0.71 / -6.2%
tpcds_q20/duckdb:vortex-file-compressed 10776580 / 10704608 / +0.7% 17642066 / 17476285 / +0.9% 0.61 / 0.61 / -0.3%
tpcds_q21/duckdb:vortex-file-compressed 9162466 / 9371898 / -2.2% 22697138 / 21703364 / +4.6% 0.40 / 0.43 / -6.5%
tpcds_q22/duckdb:vortex-file-compressed 17410190 / 17643249 / -1.3% 29912704 / 29161310 / +2.6% 0.58 / 0.61 / -3.8%
tpcds_q23/duckdb:vortex-file-compressed 37243314 / 37431455 / -0.5% 48939990 / 48459168 / +1.0% 0.76 / 0.77 / -1.5%
tpcds_q24/duckdb:vortex-file-compressed 26507289 / 26441519 / +0.2% 37518933 / 36595428 / +2.5% 0.71 / 0.72 / -2.2%
tpcds_q25/duckdb:vortex-file-compressed 19373394 / 19221668 / +0.8% 31359436 / 30221864 / +3.8% 0.62 / 0.64 / -2.9%
tpcds_q26/duckdb:vortex-file-compressed 21596128 / 21300105 / +1.4% 32170881 / 31212707 / +3.1% 0.67 / 0.68 / -1.6%
tpcds_q27/duckdb:vortex-file-compressed 24508466 / 24807916 / -1.2% 37867092 / 35637087 / +6.3% 0.65 / 0.70 / -7.0%
tpcds_q28/duckdb:vortex-file-compressed 14778070 / 15090790 / -2.1% 25445604 / 25912108 / -1.8% 0.58 / 0.58 / -0.3%
tpcds_q29/duckdb:vortex-file-compressed 18813651 / 18678136 / +0.7% 29953042 / 29174081 / +2.7% 0.63 / 0.64 / -1.9%
tpcds_q30/duckdb:vortex-file-compressed 18480180 / 18682425 / -1.1% 27688443 / 27172488 / +1.9% 0.67 / 0.69 / -2.9%
tpcds_q31/duckdb:vortex-file-compressed 17970120 / 17961668 / +0.0% 26740971 / 26844104 / -0.4% 0.67 / 0.67 / +0.4%
tpcds_q32/duckdb:vortex-file-compressed 10205145 / 10237077 / -0.3% 18382256 / 18081369 / +1.7% 0.56 / 0.57 / -1.9%
tpcds_q33/duckdb:vortex-file-compressed 17898787 / 17651904 / +1.4% 26807704 / 27599437 / -2.9% 0.67 / 0.64 / +4.4%
tpcds_q34/duckdb:vortex-file-compressed 12795214 / 12881700 / -0.7% 23106284 / 21645185 / +6.8% 0.55 / 0.60 / -7.0%
tpcds_q35/duckdb:vortex-file-compressed 30879251 / 31119364 / -0.8% 45084091 / 42566508 / +5.9% 0.68 / 0.73 / -6.3%
tpcds_q36/duckdb:vortex-file-compressed 14001168 / 14037150 / -0.3% 24868920 / 23560362 / +5.6% 0.56 / 0.60 / -5.5%
tpcds_q37/duckdb:vortex-file-compressed 9304930 / 9278629 / +0.3% 24555206 / 24238961 / +1.3% 0.38 / 0.38 / -1.0%
tpcds_q38/duckdb:vortex-file-compressed 24603568 / 24606434 / -0.0% 31320617 / 31179343 / +0.5% 0.79 / 0.79 / -0.5%
tpcds_q39/duckdb:vortex-file-compressed 18468425 / 18495272 / -0.1% 31369457 / 30737214 / +2.1% 0.59 / 0.60 / -2.2%
tpcds_q40/duckdb:vortex-file-compressed 11031860 / 11167876 / -1.2% 20253751 / 19316090 / +4.9% 0.54 / 0.58 / -5.8%
tpcds_q41/duckdb:vortex-file-compressed 14113800 / 17305600 / -18.4% 🟢 21178559 / 24395246 / -13.2% 🟢 0.67 / 0.71 / -6.1%
tpcds_q42/duckdb:vortex-file-compressed 6769366 / 6914912 / -2.1% 15291329 / 15064464 / +1.5% 0.44 / 0.46 / -3.6%
tpcds_q43/duckdb:vortex-file-compressed 9391436 / 9643249 / -2.6% 18856085 / 18160250 / +3.8% 0.50 / 0.53 / -6.2%
tpcds_q44/duckdb:vortex-file-compressed 12424543 / 12476409 / -0.4% 24174499 / 23821756 / +1.5% 0.51 / 0.52 / -1.9%
tpcds_q45/duckdb:vortex-file-compressed 23488570 / 23587638 / -0.4% 31657158 / 30430270 / +4.0% 0.74 / 0.78 / -4.3%
tpcds_q46/duckdb:vortex-file-compressed 31535420 / 31418024 / +0.4% 43847909 / 43171545 / +1.6% 0.72 / 0.73 / -1.2%
tpcds_q47/duckdb:vortex-file-compressed 30885364 / 31264494 / -1.2% 40603400 / 41141020 / -1.3% 0.76 / 0.76 / +0.1%
tpcds_q48/duckdb:vortex-file-compressed 21803117 / 22472531 / -3.0% 35367354 / 35469142 / -0.3% 0.62 / 0.63 / -2.7%
tpcds_q49/duckdb:vortex-file-compressed 18435276 / 18985566 / -2.9% 30283517 / 29722088 / +1.9% 0.61 / 0.64 / -4.7%
tpcds_q50/duckdb:vortex-file-compressed 14488046 / 14896845 / -2.7% 25343109 / 25687406 / -1.3% 0.57 / 0.58 / -1.4%
tpcds_q51/duckdb:vortex-file-compressed 48494275 / 48063878 / +0.9% 56843784 / 76334322 / -25.5% 🟢 0.85 / 0.63 / +35.5%
tpcds_q52/duckdb:vortex-file-compressed 6968272 / 7171716 / -2.8% 16615696 / 15978547 / +4.0% 0.42 / 0.45 / -6.6%
tpcds_q53/duckdb:vortex-file-compressed 11286633 / 11319189 / -0.3% 20667098 / 21681207 / -4.7% 0.55 / 0.52 / +4.6%
tpcds_q54/duckdb:vortex-file-compressed 19406774 / 19748759 / -1.7% 30093963 / 29438540 / +2.2% 0.64 / 0.67 / -3.9%
tpcds_q55/duckdb:vortex-file-compressed 6807276 / 6847788 / -0.6% 16073245 / 15285422 / +5.2% 0.42 / 0.45 / -5.5%
tpcds_q56/duckdb:vortex-file-compressed 18113288 / 17817582 / +1.7% 29104057 / 28613711 / +1.7% 0.62 / 0.62 / -0.1%
tpcds_q57/duckdb:vortex-file-compressed 25209670 / 25308086 / -0.4% 33092852 / 33487780 / -1.2% 0.76 / 0.76 / +0.8%
tpcds_q58/duckdb:vortex-file-compressed 19876471 / 20359384 / -2.4% 30756374 / 29241349 / +5.2% 0.65 / 0.70 / -7.2%
tpcds_q59/duckdb:vortex-file-compressed 19551504 / 19485481 / +0.3% 26601054 / 26442217 / +0.6% 0.73 / 0.74 / -0.3%
tpcds_q60/duckdb:vortex-file-compressed 18820456 / 18504610 / +1.7% 28963072 / 28842068 / +0.4% 0.65 / 0.64 / +1.3%
tpcds_q61/duckdb:vortex-file-compressed 19834435 / 19922872 / -0.4% 30364717 / 30039600 / +1.1% 0.65 / 0.66 / -1.5%
tpcds_q62/duckdb:vortex-file-compressed 11136934 / 10937722 / +1.8% 17306704 / 17144486 / +0.9% 0.64 / 0.64 / +0.9%
tpcds_q63/duckdb:vortex-file-compressed 10848742 / 10809960 / +0.4% 19561633 / 20560158 / -4.9% 0.55 / 0.53 / +5.5%
tpcds_q64/duckdb:vortex-file-compressed 52221060 / 52513062 / -0.6% 69793634 / 68406502 / +2.0% 0.75 / 0.77 / -2.5%
tpcds_q65/duckdb:vortex-file-compressed 13116269 / 13060742 / +0.4% 22850407 / 23236608 / -1.7% 0.57 / 0.56 / +2.1%
tpcds_q66/duckdb:vortex-file-compressed 31677970 / 31272590 / +1.3% 38466329 / 39351988 / -2.3% 0.82 / 0.79 / +3.6%
tpcds_q67/duckdb:vortex-file-compressed 55436870 / 55266268 / +0.3% 64781318 / 64683896 / +0.2% 0.86 / 0.85 / +0.2%
tpcds_q68/duckdb:vortex-file-compressed 22683589 / 23009998 / -1.4% 35909573 / 35296552 / +1.7% 0.63 / 0.65 / -3.1%
tpcds_q69/duckdb:vortex-file-compressed 21884210 / 22017648 / -0.6% 36020271 / 36691775 / -1.8% 0.61 / 0.60 / +1.2%
tpcds_q70/duckdb:vortex-file-compressed 14618146 / 14724129 / -0.7% 25203158 / 25052861 / +0.6% 0.58 / 0.59 / -1.3%
tpcds_q71/duckdb:vortex-file-compressed 13604510 / 13347567 / +1.9% 23135105 / 23409485 / -1.2% 0.59 / 0.57 / +3.1%
tpcds_q72/duckdb:vortex-file-compressed 42819574 / 43060600 / -0.6% 54784827 / 56269909 / -2.6% 0.78 / 0.77 / +2.1%
tpcds_q73/duckdb:vortex-file-compressed 11923196 / 11829364 / +0.8% 21734703 / 21106781 / +3.0% 0.55 / 0.56 / -2.1%
tpcds_q74/duckdb:vortex-file-compressed 30831012 / 30874616 / -0.1% 39266972 / 39304395 / -0.1% 0.79 / 0.79 / -0.0%
tpcds_q75/duckdb:vortex-file-compressed 36909058 / 37067086 / -0.4% 50282082 / 48402666 / +3.9% 0.73 / 0.77 / -4.1%
tpcds_q76/duckdb:vortex-file-compressed 12757918 / 12879005 / -0.9% 22563837 / 22058251 / +2.3% 0.57 / 0.58 / -3.2%
tpcds_q77/duckdb:vortex-file-compressed 20900810 / 20386666 / +2.5% 31848547 / 31298903 / +1.8% 0.66 / 0.65 / +0.8%
tpcds_q78/duckdb:vortex-file-compressed 43266555 / 42921238 / +0.8% 53374661 / 52920959 / +0.9% 0.81 / 0.81 / -0.1%
tpcds_q79/duckdb:vortex-file-compressed 16773765 / 17204298 / -2.5% 28168036 / 26915068 / +4.7% 0.60 / 0.64 / -6.8%
tpcds_q80/duckdb:vortex-file-compressed 29852462 / 29835128 / +0.1% 43033748 / 43751968 / -1.6% 0.69 / 0.68 / +1.7%
tpcds_q81/duckdb:vortex-file-compressed 21353502 / 21403570 / -0.2% 29908293 / 30302750 / -1.3% 0.71 / 0.71 / +1.1%
tpcds_q82/duckdb:vortex-file-compressed 9247107 / 9601288 / -3.7% 24166313 / 23700733 / +2.0% 0.38 / 0.41 / -5.5%
tpcds_q83/duckdb:vortex-file-compressed 17345294 / 17487681 / -0.8% 24380304 / 24391032 / -0.0% 0.71 / 0.72 / -0.8%
tpcds_q84/duckdb:vortex-file-compressed 15595746 / 15474432 / +0.8% 23385259 / 23926919 / -2.3% 0.67 / 0.65 / +3.1%
tpcds_q85/duckdb:vortex-file-compressed 24105520 / 25015558 / -3.6% 36057664 / 36358715 / -0.8% 0.67 / 0.69 / -2.8%
tpcds_q86/duckdb:vortex-file-compressed 9761899 / 9625184 / +1.4% 17051650 / 16115124 / +5.8% 0.57 / 0.60 / -4.1%
tpcds_q87/duckdb:vortex-file-compressed 25939178 / 26050646 / -0.4% 34004988 / 33749194 / +0.8% 0.76 / 0.77 / -1.2%
tpcds_q88/duckdb:vortex-file-compressed 29897088 / 30341066 / -1.5% 37007172 / 40666123 / -9.0% 0.81 / 0.75 / +8.3%
tpcds_q89/duckdb:vortex-file-compressed 11720575 / 11880278 / -1.3% 21498801 / 21020275 / +2.3% 0.55 / 0.57 / -3.5%
tpcds_q90/duckdb:vortex-file-compressed 7697800 / 7873380 / -2.2% 14273074 / 15793821 / -9.6% 0.54 / 0.50 / +8.2%
tpcds_q91/duckdb:vortex-file-compressed 14070570 / 14680431 / -4.2% 23722786 / 23432754 / +1.2% 0.59 / 0.63 / -5.3%
tpcds_q92/duckdb:vortex-file-compressed 10332634 / 10362186 / -0.3% 18219830 / 17798675 / +2.4% 0.57 / 0.58 / -2.6%
tpcds_q93/duckdb:vortex-file-compressed 10096757 / 10321070 / -2.2% 22728597 / 22416155 / +1.4% 0.44 / 0.46 / -3.5%
tpcds_q94/duckdb:vortex-file-compressed 22092352 / 22085020 / +0.0% 32221072 / 31715817 / +1.6% 0.69 / 0.70 / -1.5%
tpcds_q95/duckdb:vortex-file-compressed 60819406 / 60520896 / +0.5% 69444243 / 67458992 / +2.9% 0.88 / 0.90 / -2.4%
tpcds_q96/duckdb:vortex-file-compressed 6390607 / 6497133 / -1.6% 16453265 / 15310655 / +7.5% 0.39 / 0.42 / -8.5%
tpcds_q97/duckdb:vortex-file-compressed 23052971 / 22917520 / +0.6% 32447896 / 31822045 / +2.0% 0.71 / 0.72 / -1.3%
tpcds_q98/duckdb:vortex-file-compressed 10948411 / 10919490 / +0.3% 19716182 / 19425955 / +1.5% 0.56 / 0.56 / -1.2%
tpcds_q99/duckdb:vortex-file-compressed 14526786 / 14421880 / +0.7% 22868669 / 22012689 / +3.9% 0.64 / 0.66 / -3.0%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24091403 / 24093628 / -0.0% 31115434 / 30609636 / +1.7% 0.77 / 0.79 / -1.6%
tpcds_q02/duckdb:parquet 17857032 / 17984803 / -0.7% 23632060 / 24025915 / -1.6% 0.76 / 0.75 / +0.9%
tpcds_q03/duckdb:parquet 9702904 / 9812261 / -1.1% 16103861 / 15610845 / +3.2% 0.60 / 0.63 / -4.1%
tpcds_q04/duckdb:parquet 117223409 / 118053322 / -0.7% 126362612 / 125451786 / +0.7% 0.93 / 0.94 / -1.4%
tpcds_q05/duckdb:parquet 28498258 / 28431532 / +0.2% 33083457 / 33184023 / -0.3% 0.86 / 0.86 / +0.5%
tpcds_q06/duckdb:parquet 26672169 / 26561266 / +0.4% 35727368 / 34919227 / +2.3% 0.75 / 0.76 / -1.9%
tpcds_q07/duckdb:parquet 30971008 / 31458600 / -1.5% 38836963 / 38910397 / -0.2% 0.80 / 0.81 / -1.4%
tpcds_q08/duckdb:parquet 19838052 / 19835614 / +0.0% 26201666 / 26315778 / -0.4% 0.76 / 0.75 / +0.4%
tpcds_q09/duckdb:parquet 27303030 / 27590826 / -1.0% 28721823 / 29561025 / -2.8% 0.95 / 0.93 / +1.8%
tpcds_q10/duckdb:parquet 32617595 / 32550451 / +0.2% 40860303 / 40051128 / +2.0% 0.80 / 0.81 / -1.8%
tpcds_q11/duckdb:parquet 68722050 / 68928280 / -0.3% 74820766 / 76188001 / -1.8% 0.92 / 0.90 / +1.5%
tpcds_q12/duckdb:parquet 14012002 / 13995176 / +0.1% 19209448 / 19053083 / +0.8% 0.73 / 0.73 / -0.7%
tpcds_q13/duckdb:parquet 30703634 / 33308439 / -7.8% 38808012 / 39541391 / -1.9% 0.79 / 0.84 / -6.1%
tpcds_q14/duckdb:parquet 65455396 / 64769091 / +1.1% 68816570 / 68114003 / +1.0% 0.95 / 0.95 / +0.0%
tpcds_q15/duckdb:parquet 16569078 / 16637540 / -0.4% 22778923 / 22243900 / +2.4% 0.73 / 0.75 / -2.8%
tpcds_q16/duckdb:parquet 30212474 / 30104670 / +0.4% 37322806 / 37135181 / +0.5% 0.81 / 0.81 / -0.1%
tpcds_q17/duckdb:parquet 34391937 / 34477460 / -0.2% 40650277 / 40356696 / +0.7% 0.85 / 0.85 / -1.0%
tpcds_q18/duckdb:parquet 47328698 / 47148372 / +0.4% 55332715 / 54249081 / +2.0% 0.86 / 0.87 / -1.6%
tpcds_q19/duckdb:parquet 18900666 / 19018304 / -0.6% 25941823 / 25382414 / +2.2% 0.73 / 0.75 / -2.8%
tpcds_q20/duckdb:parquet 14794198 / 14902117 / -0.7% 19729721 / 19412123 / +1.6% 0.75 / 0.77 / -2.3%
tpcds_q21/duckdb:parquet 10549425 / 10731116 / -1.7% 17211150 / 17030686 / +1.1% 0.61 / 0.63 / -2.7%
tpcds_q22/duckdb:parquet 20785928 / 20507718 / +1.4% 26945308 / 26762155 / +0.7% 0.77 / 0.77 / +0.7%
tpcds_q23/duckdb:parquet 41665928 / 42833082 / -2.7% 46934419 / 49424056 / -5.0% 0.89 / 0.87 / +2.4%
tpcds_q24/duckdb:parquet 30176592 / 29943294 / +0.8% 36935254 / 36464447 / +1.3% 0.82 / 0.82 / -0.5%
tpcds_q25/duckdb:parquet 30644910 / 30514354 / +0.4% 37384817 / 37025273 / +1.0% 0.82 / 0.82 / -0.5%
tpcds_q26/duckdb:parquet 28739328 / 29252328 / -1.8% 35322444 / 35038512 / +0.8% 0.81 / 0.83 / -2.5%
tpcds_q27/duckdb:parquet 33326215 / 34872377 / -4.4% 41110664 / 41229992 / -0.3% 0.81 / 0.85 / -4.2%
tpcds_q28/duckdb:parquet 25730443 / 25185258 / +2.2% 35168265 / 31104212 / +13.1% 🔴 0.73 / 0.81 / -9.6%
tpcds_q29/duckdb:parquet 32500182 / 32150195 / +1.1% 39446530 / 38969206 / +1.2% 0.82 / 0.83 / -0.1%
tpcds_q30/duckdb:parquet 35803177 / 35528874 / +0.8% 44294410 / 44172843 / +0.3% 0.81 / 0.80 / +0.5%
tpcds_q31/duckdb:parquet 36226824 / 35529000 / +2.0% 42722497 / 42639874 / +0.2% 0.85 / 0.83 / +1.8%
tpcds_q32/duckdb:parquet 14140020 / 14179243 / -0.3% 20730126 / 21025962 / -1.4% 0.68 / 0.67 / +1.1%
tpcds_q33/duckdb:parquet 23425748 / 23095442 / +1.4% 29871145 / 28549004 / +4.6% 0.78 / 0.81 / -3.1%
tpcds_q34/duckdb:parquet 17016436 / 16952271 / +0.4% 23958763 / 24176719 / -0.9% 0.71 / 0.70 / +1.3%
tpcds_q35/duckdb:parquet 35126820 / 34975734 / +0.4% 43747402 / 43207543 / +1.2% 0.80 / 0.81 / -0.8%
tpcds_q36/duckdb:parquet 39402974 / 39485050 / -0.2% 48121396 / 47479406 / +1.4% 0.82 / 0.83 / -1.5%
tpcds_q37/duckdb:parquet 12844596 / 12797622 / +0.4% 19715702 / 19277008 / +2.3% 0.65 / 0.66 / -1.9%
tpcds_q38/duckdb:parquet 29523762 / 29621006 / -0.3% 34244654 / 33433489 / +2.4% 0.86 / 0.89 / -2.7%
tpcds_q39/duckdb:parquet 23424510 / 23128167 / +1.3% 29564566 / 29595365 / -0.1% 0.79 / 0.78 / +1.4%
tpcds_q40/duckdb:parquet 15900061 / 16054940 / -1.0% 21431908 / 21235777 / +0.9% 0.74 / 0.76 / -1.9%
tpcds_q41/duckdb:parquet 12000354 / 11966633 / +0.3% 17436590 / 18065700 / -3.5% 0.69 / 0.66 / +3.9%
tpcds_q42/duckdb:parquet 9674116 / 9626178 / +0.5% 15780245 / 15525610 / +1.6% 0.61 / 0.62 / -1.1%
tpcds_q43/duckdb:parquet 12030358 / 12048868 / -0.2% 17869848 / 18128038 / -1.4% 0.67 / 0.66 / +1.3%
tpcds_q44/duckdb:parquet 21049182 / 21607511 / -2.6% 27089238 / 26196804 / +3.4% 0.78 / 0.82 / -5.8%
tpcds_q45/duckdb:parquet 20961314 / 20908743 / +0.3% 27900479 / 27486675 / +1.5% 0.75 / 0.76 / -1.2%
tpcds_q46/duckdb:parquet 37938388 / 35288508 / +7.5% 43610786 / 43320711 / +0.7% 0.87 / 0.81 / +6.8%
tpcds_q47/duckdb:parquet 34332141 / 34531498 / -0.6% 40924466 / 41336316 / -1.0% 0.84 / 0.84 / +0.4%
tpcds_q48/duckdb:parquet 29976325 / 29103170 / +3.0% 36939895 / 36426435 / +1.4% 0.81 / 0.80 / +1.6%
tpcds_q49/duckdb:parquet 31578878 / 30233053 / +4.5% 36053215 / 36303817 / -0.7% 0.88 / 0.83 / +5.2%
tpcds_q50/duckdb:parquet 19350805 / 20388898 / -5.1% 25747442 / 25331399 / +1.6% 0.75 / 0.80 / -6.6%
tpcds_q51/duckdb:parquet 51711093 / 52104356 / -0.8% 76399773 / 61245199 / +24.7% 🔴 0.68 / 0.85 / -20.4%
tpcds_q52/duckdb:parquet 9683820 / 9659180 / +0.3% 15314029 / 15499988 / -1.2% 0.63 / 0.62 / +1.5%
tpcds_q53/duckdb:parquet 14128791 / 14537118 / -2.8% 20838219 / 20752143 / +0.4% 0.68 / 0.70 / -3.2%
tpcds_q54/duckdb:parquet 24993698 / 24733616 / +1.1% 32090460 / 31908376 / +0.6% 0.78 / 0.78 / +0.5%
tpcds_q55/duckdb:parquet 9469867 / 9489484 / -0.2% 15258059 / 15341981 / -0.5% 0.62 / 0.62 / +0.3%
tpcds_q56/duckdb:parquet 24959751 / 27141406 / -8.0% 30938289 / 30419221 / +1.7% 0.81 / 0.89 / -9.6%
tpcds_q57/duckdb:parquet 30530736 / 30693180 / -0.5% 36234820 / 36167354 / +0.2% 0.84 / 0.85 / -0.7%
tpcds_q58/duckdb:parquet 24399578 / 23919381 / +2.0% 29611676 / 29814453 / -0.7% 0.82 / 0.80 / +2.7%
tpcds_q59/duckdb:parquet 22568182 / 22867650 / -1.3% 28914551 / 28707391 / +0.7% 0.78 / 0.80 / -2.0%
tpcds_q60/duckdb:parquet 26164131 / 26316208 / -0.6% 32777650 / 31957179 / +2.6% 0.80 / 0.82 / -3.1%
tpcds_q61/duckdb:parquet 25124552 / 24749493 / +1.5% 29499678 / 29026258 / +1.6% 0.85 / 0.85 / -0.1%
tpcds_q62/duckdb:parquet 12777047 / 12721642 / +0.4% 17899551 / 17771445 / +0.7% 0.71 / 0.72 / -0.3%
tpcds_q63/duckdb:parquet 13388564 / 14341675 / -6.6% 19628378 / 20011856 / -1.9% 0.68 / 0.72 / -4.8%
tpcds_q64/duckdb:parquet 70969463 / 70307914 / +0.9% 80788850 / 79575965 / +1.5% 0.88 / 0.88 / -0.6%
tpcds_q65/duckdb:parquet 20400678 / 20569484 / -0.8% 25781151 / 25477560 / +1.2% 0.79 / 0.81 / -2.0%
tpcds_q66/duckdb:parquet 33033260 / 33045765 / -0.0% 38402328 / 38019443 / +1.0% 0.86 / 0.87 / -1.0%
tpcds_q67/duckdb:parquet 60426961 / 61027914 / -1.0% 67969682 / 66818321 / +1.7% 0.89 / 0.91 / -2.7%
tpcds_q68/duckdb:parquet 28600786 / 30834914 / -7.2% 36422140 / 35993030 / +1.2% 0.79 / 0.86 / -8.3%
tpcds_q69/duckdb:parquet 25862160 / 25794512 / +0.3% 34067247 / 33964184 / +0.3% 0.76 / 0.76 / -0.0%
tpcds_q70/duckdb:parquet 19314128 / 19255869 / +0.3% 27250516 / 26582665 / +2.5% 0.71 / 0.72 / -2.2%
tpcds_q71/duckdb:parquet 18212499 / 16803522 / +8.4% 23797976 / 23382022 / +1.8% 0.77 / 0.72 / +6.5%
tpcds_q72/duckdb:parquet 53013434 / 53014220 / -0.0% 59332538 / 59449489 / -0.2% 0.89 / 0.89 / +0.2%
tpcds_q73/duckdb:parquet 15262156 / 15895421 / -4.0% 21653116 / 21585777 / +0.3% 0.70 / 0.74 / -4.3%
tpcds_q74/duckdb:parquet 84349060 / 85004257 / -0.8% 90810238 / 89575448 / +1.4% 0.93 / 0.95 / -2.1%
tpcds_q75/duckdb:parquet 44302900 / 44183878 / +0.3% 49798623 / 49282250 / +1.0% 0.89 / 0.90 / -0.8%
tpcds_q76/duckdb:parquet 17902613 / 18510097 / -3.3% 23078528 / 22802776 / +1.2% 0.78 / 0.81 / -4.4%
tpcds_q77/duckdb:parquet 24692144 / 25530442 / -3.3% 31138673 / 31441226 / -1.0% 0.79 / 0.81 / -2.3%
tpcds_q78/duckdb:parquet 78631120 / 78229121 / +0.5% 84651094 / 85641462 / -1.2% 0.93 / 0.91 / +1.7%
tpcds_q79/duckdb:parquet 23288960 / 24067906 / -3.2% 29499058 / 28358044 / +4.0% 0.79 / 0.85 / -7.0%
tpcds_q80/duckdb:parquet 36785110 / 38479893 / -4.4% 43844706 / 43843592 / +0.0% 0.84 / 0.88 / -4.4%
tpcds_q81/duckdb:parquet 36240617 / 36125748 / +0.3% 44659369 / 44907713 / -0.6% 0.81 / 0.80 / +0.9%
tpcds_q82/duckdb:parquet 13545302 / 13496682 / +0.4% 20638312 / 20103202 / +2.7% 0.66 / 0.67 / -2.2%
tpcds_q83/duckdb:parquet 20102864 / 19941274 / +0.8% 25182763 / 24813592 / +1.5% 0.80 / 0.80 / -0.7%
tpcds_q84/duckdb:parquet 22984174 / 23090262 / -0.5% 28884802 / 28462809 / +1.5% 0.80 / 0.81 / -1.9%
tpcds_q85/duckdb:parquet 32104524 / 32217004 / -0.3% 39423407 / 38985194 / +1.1% 0.81 / 0.83 / -1.5%
tpcds_q86/duckdb:parquet 11762734 / 11811458 / -0.4% 16991169 / 16496302 / +3.0% 0.69 / 0.72 / -3.3%
tpcds_q87/duckdb:parquet 31409597 / 31436775 / -0.1% 35057680 / 35185024 / -0.4% 0.90 / 0.89 / +0.3%
tpcds_q88/duckdb:parquet 37891210 / 38059442 / -0.4% 44389554 / 41928306 / +5.9% 0.85 / 0.91 / -6.0%
tpcds_q89/duckdb:parquet 14066000 / 14206404 / -1.0% 21445768 / 21172421 / +1.3% 0.66 / 0.67 / -2.3%
tpcds_q90/duckdb:parquet 10027892 / 10080660 / -0.5% 15146282 / 15448563 / -2.0% 0.66 / 0.65 / +1.5%
tpcds_q91/duckdb:parquet 21015808 / 21048574 / -0.2% 28229033 / 28220317 / +0.0% 0.74 / 0.75 / -0.2%
tpcds_q92/duckdb:parquet 15498084 / 15572126 / -0.5% 22159268 / 22096515 / +0.3% 0.70 / 0.70 / -0.8%
tpcds_q93/duckdb:parquet 14072602 / 14091483 / -0.1% 20336887 / 20175447 / +0.8% 0.69 / 0.70 / -0.9%
tpcds_q94/duckdb:parquet 25458638 / 25392360 / +0.3% 32365311 / 32388339 / -0.1% 0.79 / 0.78 / +0.3%
tpcds_q95/duckdb:parquet 44197830 / 43748374 / +1.0% 49560254 / 49895274 / -0.7% 0.89 / 0.88 / +1.7%
tpcds_q96/duckdb:parquet 8345160 / 8272491 / +0.9% 13850823 / 13988491 / -1.0% 0.60 / 0.59 / +1.9%
tpcds_q97/duckdb:parquet 27573559 / 27667050 / -0.3% 34333882 / 32852985 / +4.5% 0.80 / 0.84 / -4.6%
tpcds_q98/duckdb:parquet 16517606 / 16378365 / +0.9% 23296619 / 22777602 / +2.3% 0.71 / 0.72 / -1.4%
tpcds_q99/duckdb:parquet 18758686 / 18807829 / -0.3% 24460977 / 24915617 / -1.8% 0.77 / 0.75 / +1.6%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR e6ec8c58 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1274996 / 1277762 / -0.2% 22946271 / 22701905 / +1.1% 0.06 / 0.06 / -1.3%
clickbench_q01/datafusion:vortex-file-compressed 5707138 / 5701054 / +0.1% 28933602 / 34133473 / -15.2% 🟢 0.20 / 0.17 / +18.1%
clickbench_q02/datafusion:vortex-file-compressed 11228768 / 11059978 / +1.5% 48095109 / 45727346 / +5.2% 0.23 / 0.24 / -3.5%
clickbench_q03/datafusion:vortex-file-compressed 12655802 / 12962152 / -2.4% 54894338 / 59966511 / -8.5% 0.23 / 0.22 / +6.7%
clickbench_q04/datafusion:vortex-file-compressed 58183525 / 58491492 / -0.5% 101390495 / 107265399 / -5.5% 0.57 / 0.55 / +5.2%
clickbench_q05/datafusion:vortex-file-compressed 76871607 / 75324188 / +2.1% 126525160 / 127176489 / -0.5% 0.61 / 0.59 / +2.6%
clickbench_q06/datafusion:vortex-file-compressed 1254980 / 1281209 / -2.0% 22952958 / 22762946 / +0.8% 0.05 / 0.06 / -2.9%
clickbench_q07/datafusion:vortex-file-compressed 8917018 / 9121962 / -2.2% 33361125 / 36679638 / -9.0% 0.27 / 0.25 / +7.5%
clickbench_q08/datafusion:vortex-file-compressed 80798045 / 79202689 / +2.0% 121973814 / 130034036 / -6.2% 0.66 / 0.61 / +8.8%
clickbench_q09/datafusion:vortex-file-compressed 173597687 / 169891930 / +2.2% 213558098 / 215849640 / -1.1% 0.81 / 0.79 / +3.3%
clickbench_q10/datafusion:vortex-file-compressed 22229766 / 23576041 / -5.7% 69425667 / 71620517 / -3.1% 0.32 / 0.33 / -2.7%
clickbench_q11/datafusion:vortex-file-compressed 24283349 / 25595211 / -5.1% 72699092 / 73456297 / -1.0% 0.33 / 0.35 / -4.1%
clickbench_q12/datafusion:vortex-file-compressed 71024218 / 72340317 / -1.8% 124764550 / 126525748 / -1.4% 0.57 / 0.57 / -0.4%
clickbench_q13/datafusion:vortex-file-compressed 115071206 / 114454353 / +0.5% 182741745 / 187159194 / -2.4% 0.63 / 0.61 / +3.0%
clickbench_q14/datafusion:vortex-file-compressed 74600866 / 75015054 / -0.6% 131060605 / 128127094 / +2.3% 0.57 / 0.59 / -2.8%
clickbench_q15/datafusion:vortex-file-compressed 63593958 / 63035252 / +0.9% 105543202 / 102527113 / +2.9% 0.60 / 0.61 / -2.0%
clickbench_q16/datafusion:vortex-file-compressed 156718664 / 154339830 / +1.5% 214431112 / 220216995 / -2.6% 0.73 / 0.70 / +4.3%
clickbench_q17/datafusion:vortex-file-compressed 155434791 / 153975190 / +0.9% 223610568 / 221571282 / +0.9% 0.70 / 0.69 / +0.0%
clickbench_q18/datafusion:vortex-file-compressed 292904688 / 297646745 / -1.6% 375689546 / 388335753 / -3.3% 0.78 / 0.77 / +1.7%
clickbench_q19/datafusion:vortex-file-compressed 7555402 / 7750414 / -2.5% 49050533 / 48721099 / +0.7% 0.15 / 0.16 / -3.2%
clickbench_q20/datafusion:vortex-file-compressed 66404194 / 68136855 / -2.5% 247987250 / 256425057 / -3.3% 0.27 / 0.27 / +0.8%
clickbench_q21/datafusion:vortex-file-compressed 78619824 / 80037805 / -1.8% 287624448 / 300737630 / -4.4% 0.27 / 0.27 / +2.7%
clickbench_q22/datafusion:vortex-file-compressed 93714510 / 95054287 / -1.4% 388885044 / 395336147 / -1.6% 0.24 / 0.24 / +0.2%
clickbench_q23/datafusion:vortex-file-compressed 75824656 / 80171206 / -5.4% 405686840 / 416246090 / -2.5% 0.19 / 0.19 / -3.0%
clickbench_q24/datafusion:vortex-file-compressed 8122404 / 8409700 / -3.4% 70050065 / 57093319 / +22.7% 🔴 0.12 / 0.15 / -21.3%
clickbench_q25/datafusion:vortex-file-compressed 19632118 / 18152158 / +8.2% 66375911 / 63410099 / +4.7% 0.30 / 0.29 / +3.3%
clickbench_q26/datafusion:vortex-file-compressed 13903272 / 15624998 / -11.0% 🟢 68402215 / 69615012 / -1.7% 0.20 / 0.22 / -9.4%
clickbench_q27/datafusion:vortex-file-compressed 99791952 / 100553100 / -0.8% 256214867 / 266070098 / -3.7% 0.39 / 0.38 / +3.1%
clickbench_q28/datafusion:vortex-file-compressed 556322322 / 561882003 / -1.0% 638308210 / 634483917 / +0.6% 0.87 / 0.89 / -1.6%
clickbench_q29/datafusion:vortex-file-compressed 24001336 / 24813306 / -3.3% 56512765 / 53938850 / +4.8% 0.42 / 0.46 / -7.7%
clickbench_q30/datafusion:vortex-file-compressed 56607778 / 54469824 / +3.9% 111914029 / 110322321 / +1.4% 0.51 / 0.49 / +2.4%
clickbench_q31/datafusion:vortex-file-compressed 66093618 / 63713036 / +3.7% 154295894 / 165094546 / -6.5% 0.43 / 0.39 / +11.0%
clickbench_q32/datafusion:vortex-file-compressed 293742250 / 287471359 / +2.2% 388175633 / 395194655 / -1.8% 0.76 / 0.73 / +4.0%
clickbench_q33/datafusion:vortex-file-compressed 319994302 / 318812426 / +0.4% 422064180 / 434359824 / -2.8% 0.76 / 0.73 / +3.3%
clickbench_q34/datafusion:vortex-file-compressed 317719788 / 319825400 / -0.7% 432913301 / 438643717 / -1.3% 0.73 / 0.73 / +0.7%
clickbench_q35/datafusion:vortex-file-compressed 57630188 / 56594294 / +1.8% 89353929 / 89838837 / -0.5% 0.64 / 0.63 / +2.4%
clickbench_q36/datafusion:vortex-file-compressed 37382022 / 37371240 / +0.0% 67725571 / 69504069 / -2.6% 0.55 / 0.54 / +2.7%
clickbench_q37/datafusion:vortex-file-compressed 20868328 / 20731798 / +0.7% 48259145 / 48713358 / -0.9% 0.43 / 0.43 / +1.6%
clickbench_q38/datafusion:vortex-file-compressed 13217282 / 12866674 / +2.7% 41937310 / 41261053 / +1.6% 0.32 / 0.31 / +1.1%
clickbench_q39/datafusion:vortex-file-compressed 77923176 / 78717482 / -1.0% 113812455 / 110822448 / +2.7% 0.68 / 0.71 / -3.6%
clickbench_q40/datafusion:vortex-file-compressed 9950354 / 10368860 / -4.0% 37403215 / 36576948 / +2.3% 0.27 / 0.28 / -6.2%
clickbench_q41/datafusion:vortex-file-compressed 9728533 / 9655634 / +0.8% 35482475 / 35212183 / +0.8% 0.27 / 0.27 / -0.0%
clickbench_q42/datafusion:vortex-file-compressed 9824864 / 9562990 / +2.7% 35365189 / 37134881 / -4.8% 0.28 / 0.26 / +7.9%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1274645 / 1245508 / +2.3% 50786417 / 49111389 / +3.4% 0.03 / 0.03 / -1.0%
clickbench_q01/datafusion:parquet 15899333 / 16128558 / -1.4% 68282682 / 65974016 / +3.5% 0.23 / 0.24 / -4.8%
clickbench_q02/datafusion:parquet 18444106 / 18679866 / -1.3% 83736186 / 81045048 / +3.3% 0.22 / 0.23 / -4.4%
clickbench_q03/datafusion:parquet 17610219 / 17636144 / -0.1% 83741998 / 78906984 / +6.1% 0.21 / 0.22 / -5.9%
clickbench_q04/datafusion:parquet 63694032 / 63147200 / +0.9% 128622033 / 123651426 / +4.0% 0.50 / 0.51 / -3.0%
clickbench_q05/datafusion:parquet 87399169 / 89173734 / -2.0% 160419953 / 155684349 / +3.0% 0.54 / 0.57 / -4.9%
clickbench_q06/datafusion:parquet 1257464 / 1267736 / -0.8% 50731708 / 49808656 / +1.9% 0.02 / 0.03 / -2.6%
clickbench_q07/datafusion:parquet 16795166 / 16815682 / -0.1% 69554166 / 68530680 / +1.5% 0.24 / 0.25 / -1.6%
clickbench_q08/datafusion:parquet 85907302 / 84420552 / +1.8% 162630803 / 159615748 / +1.9% 0.53 / 0.53 / -0.1%
clickbench_q09/datafusion:parquet 189821334 / 189340200 / +0.3% 265816813 / 270568486 / -1.8% 0.71 / 0.70 / +2.0%
clickbench_q10/datafusion:parquet 36452812 / 35838825 / +1.7% 102441025 / 101351871 / +1.1% 0.36 / 0.35 / +0.6%
clickbench_q11/datafusion:parquet 42736762 / 43388606 / -1.5% 111987319 / 110234963 / +1.6% 0.38 / 0.39 / -3.0%
clickbench_q12/datafusion:parquet 94667824 / 96400254 / -1.8% 162364719 / 164380304 / -1.2% 0.58 / 0.59 / -0.6%
clickbench_q13/datafusion:parquet 148751350 / 149050407 / -0.2% 225584894 / 229020286 / -1.5% 0.66 / 0.65 / +1.3%
clickbench_q14/datafusion:parquet 100899708 / 101751008 / -0.8% 174667630 / 173752765 / +0.5% 0.58 / 0.59 / -1.4%
clickbench_q15/datafusion:parquet 72788646 / 74751018 / -2.6% 133569728 / 132562825 / +0.8% 0.54 / 0.56 / -3.4%
clickbench_q16/datafusion:parquet 156432362 / 157130106 / -0.4% 236796808 / 235404102 / +0.6% 0.66 / 0.67 / -1.0%
clickbench_q17/datafusion:parquet 155213992 / 158408130 / -2.0% 239063277 / 232535206 / +2.8% 0.65 / 0.68 / -4.7%
clickbench_q18/datafusion:parquet 309472665 / 311659828 / -0.7% 417113112 / 428769037 / -2.7% 0.74 / 0.73 / +2.1%
clickbench_q19/datafusion:parquet 18992214 / 18808941 / +1.0% 79651733 / 76943382 / +3.5% 0.24 / 0.24 / -2.5%
clickbench_q20/datafusion:parquet 178372246 / 178190524 / +0.1% 296949880 / 283067790 / +4.9% 0.60 / 0.63 / -4.6%
clickbench_q21/datafusion:parquet 172019638 / 174542982 / -1.4% 316363927 / 303338278 / +4.3% 0.54 / 0.58 / -5.5%
clickbench_q22/datafusion:parquet 259911297 / 260781561 / -0.3% 455810700 / 433914101 / +5.0% 0.57 / 0.60 / -5.1%
clickbench_q23/datafusion:parquet 1006307782 / 1007396844 / -0.1% 1202721939 / 1196675958 / +0.5% 0.84 / 0.84 / -0.6%
clickbench_q24/datafusion:parquet 29380479 / 30726530 / -4.4% 91379916 / 88445505 / +3.3% 0.32 / 0.35 / -7.5%
clickbench_q25/datafusion:parquet 36631656 / 37097776 / -1.3% 103546759 / 103458997 / +0.1% 0.35 / 0.36 / -1.3%
clickbench_q26/datafusion:parquet 30286395 / 30667637 / -1.2% 91507309 / 89958756 / +1.7% 0.33 / 0.34 / -2.9%
clickbench_q27/datafusion:parquet 191128268 / 193541858 / -1.2% 306347943 / 294014301 / +4.2% 0.62 / 0.66 / -5.2%
clickbench_q28/datafusion:parquet 618311374 / 622381386 / -0.7% 710760004 / 709605194 / +0.2% 0.87 / 0.88 / -0.8%
clickbench_q29/datafusion:parquet 28948778 / 28382270 / +2.0% 90234132 / 89726118 / +0.6% 0.32 / 0.32 / +1.4%
clickbench_q30/datafusion:parquet 90015760 / 90292652 / -0.3% 178848810 / 173921114 / +2.8% 0.50 / 0.52 / -3.1%
clickbench_q31/datafusion:parquet 103060346 / 103509501 / -0.4% 206297824 / 200971596 / +2.7% 0.50 / 0.52 / -3.0%
clickbench_q32/datafusion:parquet 310162492 / 311115870 / -0.3% 432738487 / 428727602 / +0.9% 0.72 / 0.73 / -1.2%
clickbench_q33/datafusion:parquet 374511616 / 380048496 / -1.5% 477511424 / 479600127 / -0.4% 0.78 / 0.79 / -1.0%
clickbench_q34/datafusion:parquet 377107190 / 378557524 / -0.4% 486855423 / 477936899 / +1.9% 0.77 / 0.79 / -2.2%
clickbench_q35/datafusion:parquet 65484748 / 64249088 / +1.9% 123949634 / 123443405 / +0.4% 0.53 / 0.52 / +1.5%
clickbench_q36/datafusion:parquet 73669281 / 73977852 / -0.4% 137081607 / 136178878 / +0.7% 0.54 / 0.54 / -1.1%
clickbench_q37/datafusion:parquet 35452800 / 35633496 / -0.5% 92025803 / 91419997 / +0.7% 0.39 / 0.39 / -1.2%
clickbench_q38/datafusion:parquet 47969996 / 47903072 / +0.1% 110061466 / 108411604 / +1.5% 0.44 / 0.44 / -1.4%
clickbench_q39/datafusion:parquet 143744094 / 144526362 / -0.5% 209639884 / 212015185 / -1.1% 0.69 / 0.68 / +0.6%
clickbench_q40/datafusion:parquet 19514522 / 20349552 / -4.1% 77990352 / 77770096 / +0.3% 0.25 / 0.26 / -4.4%
clickbench_q41/datafusion:parquet 18770127 / 18824178 / -0.3% 76040406 / 74972994 / +1.4% 0.25 / 0.25 / -1.7%
clickbench_q42/datafusion:parquet 19088786 / 19068224 / +0.1% 74502376 / 75207188 / -0.9% 0.26 / 0.25 / +1.1%
duckdb / vortex-file-compressed / ns (0.981x ➖, 6↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2219557 / 2239520 / -0.9% 25231843 / 25410828 / -0.7% 0.09 / 0.09 / -0.2%
clickbench_q01/duckdb:vortex-file-compressed 7341458 / 7612362 / -3.6% 27000749 / 27570446 / -2.1% 0.27 / 0.28 / -1.5%
clickbench_q02/duckdb:vortex-file-compressed 9340572 / 8955066 / +4.3% 38542118 / 35286118 / +9.2% 0.24 / 0.25 / -4.5%
clickbench_q03/duckdb:vortex-file-compressed 13876552 / 14248936 / -2.6% 51473969 / 52216942 / -1.4% 0.27 / 0.27 / -1.2%
clickbench_q04/duckdb:vortex-file-compressed 56853194 / 58104275 / -2.2% 91053557 / 92470080 / -1.5% 0.62 / 0.63 / -0.6%
clickbench_q05/duckdb:vortex-file-compressed 64484726 / 64657906 / -0.3% 95890178 / 95177701 / +0.7% 0.67 / 0.68 / -1.0%
clickbench_q06/duckdb:vortex-file-compressed 2682774 / 2703474 / -0.8% 28538966 / 31007170 / -8.0% 0.09 / 0.09 / +7.8%
clickbench_q07/duckdb:vortex-file-compressed 9539791 / 9579114 / -0.4% 30520880 / 31815161 / -4.1% 0.31 / 0.30 / +3.8%
clickbench_q08/duckdb:vortex-file-compressed 69695514 / 69709164 / -0.0% 105502780 / 106513332 / -0.9% 0.66 / 0.65 / +0.9%
clickbench_q09/duckdb:vortex-file-compressed 95471454 / 91790526 / +4.0% 128013533 / 128038059 / -0.0% 0.75 / 0.72 / +4.0%
clickbench_q10/duckdb:vortex-file-compressed 27876469 / 27449552 / +1.6% 73964748 / 70633742 / +4.7% 0.38 / 0.39 / -3.0%
clickbench_q11/duckdb:vortex-file-compressed 30307006 / 29742802 / +1.9% 76840430 / 74580099 / +3.0% 0.39 / 0.40 / -1.1%
clickbench_q12/duckdb:vortex-file-compressed 68239618 / 68314645 / -0.1% 97451926 / 101588585 / -4.1% 0.70 / 0.67 / +4.1%
clickbench_q13/duckdb:vortex-file-compressed 119850015 / 117681350 / +1.8% 169622191 / 167304335 / +1.4% 0.71 / 0.70 / +0.5%
clickbench_q14/duckdb:vortex-file-compressed 73125332 / 71707574 / +2.0% 102200276 / 104097981 / -1.8% 0.72 / 0.69 / +3.9%
clickbench_q15/duckdb:vortex-file-compressed 76317331 / 76256368 / +0.1% 110096864 / 109430960 / +0.6% 0.69 / 0.70 / -0.5%
clickbench_q16/duckdb:vortex-file-compressed 135656139 / 136865666 / -0.9% 172709364 / 173157180 / -0.3% 0.79 / 0.79 / -0.6%
clickbench_q17/duckdb:vortex-file-compressed 136806157 / 136309250 / +0.4% 169518708 / 167679771 / +1.1% 0.81 / 0.81 / -0.7%
clickbench_q18/duckdb:vortex-file-compressed 257205216 / 253680418 / +1.4% 305820585 / 304490936 / +0.4% 0.84 / 0.83 / +0.9%
clickbench_q19/duckdb:vortex-file-compressed 9494247 / 9195282 / +3.3% 39660656 / 41073291 / -3.4% 0.24 / 0.22 / +6.9%
clickbench_q20/duckdb:vortex-file-compressed 66872225 / 68396690 / -2.2% 166384796 / 175446093 / -5.2% 0.40 / 0.39 / +3.1%
clickbench_q21/duckdb:vortex-file-compressed 80732220 / 78139710 / +3.3% 214990782 / 193510866 / +11.1% 🔴 0.38 / 0.40 / -7.0%
clickbench_q22/duckdb:vortex-file-compressed 132432516 / 130674448 / +1.3% 346347388 / 331574805 / +4.5% 0.38 / 0.39 / -3.0%
clickbench_q23/duckdb:vortex-file-compressed 62159872 / 59653655 / +4.2% 184693666 / 184899542 / -0.1% 0.34 / 0.32 / +4.3%
clickbench_q24/duckdb:vortex-file-compressed 16836008 / 17394194 / -3.2% 42916237 / 48703041 / -11.9% 🟢 0.39 / 0.36 / +9.8%
clickbench_q25/duckdb:vortex-file-compressed 17967412 / 18446944 / -2.6% 53122640 / 54178597 / -1.9% 0.34 / 0.34 / -0.7%
clickbench_q26/duckdb:vortex-file-compressed 13472572 / 14287748 / -5.7% 42523735 / 49047912 / -13.3% 🟢 0.32 / 0.29 / +8.8%
clickbench_q27/duckdb:vortex-file-compressed 54543405 / 53905176 / +1.2% 192772069 / 177354906 / +8.7% 0.28 / 0.30 / -6.9%
clickbench_q28/duckdb:vortex-file-compressed 512231038 / 514093187 / -0.4% 568556688 / 559504615 / +1.6% 0.90 / 0.92 / -1.9%
clickbench_q29/duckdb:vortex-file-compressed 17310388 / 17208508 / +0.6% 43103911 / 42958313 / +0.3% 0.40 / 0.40 / +0.3%
clickbench_q30/duckdb:vortex-file-compressed 59589116 / 59435691 / +0.3% 110622576 / 108956696 / +1.5% 0.54 / 0.55 / -1.3%
clickbench_q31/duckdb:vortex-file-compressed 109729601 / 109401092 / +0.3% 206079532 / 174239306 / +18.3% 🔴 0.53 / 0.63 / -15.2%
clickbench_q32/duckdb:vortex-file-compressed 367722647 / 385910546 / -4.7% 409884869 / 410231765 / -0.1% 0.90 / 0.94 / -4.6%
clickbench_q33/duckdb:vortex-file-compressed 350880585 / 342599656 / +2.4% 408442670 / 396100171 / +3.1% 0.86 / 0.86 / -0.7%
clickbench_q34/duckdb:vortex-file-compressed 350804434 / 353396204 / -0.7% 410292262 / 412222797 / -0.5% 0.86 / 0.86 / -0.3%
clickbench_q35/duckdb:vortex-file-compressed 57804200 / 57161666 / +1.1% 87753124 / 88929172 / -1.3% 0.66 / 0.64 / +2.5%
clickbench_q36/duckdb:vortex-file-compressed 10464159 / 11640787 / -10.1% 🟢 33700771 / 33117280 / +1.8% 0.31 / 0.35 / -11.7%
clickbench_q37/duckdb:vortex-file-compressed 6503988 / 7579217 / -14.2% 🟢 27584740 / 29023829 / -5.0% 0.24 / 0.26 / -9.7%
clickbench_q38/duckdb:vortex-file-compressed 7269530 / 8249762 / -11.9% 🟢 31312696 / 27872473 / +12.3% 🔴 0.23 / 0.30 / -21.6%
clickbench_q39/duckdb:vortex-file-compressed 18255617 / 18512246 / -1.4% 39226522 / 39648155 / -1.1% 0.47 / 0.47 / -0.3%
clickbench_q40/duckdb:vortex-file-compressed 5869154 / 6788686 / -13.5% 🟢 29502327 / 29122522 / +1.3% 0.20 / 0.23 / -14.7%
clickbench_q41/duckdb:vortex-file-compressed 6763758 / 7935220 / -14.8% 🟢 30387744 / 31671742 / -4.1% 0.22 / 0.25 / -11.2%
clickbench_q42/duckdb:vortex-file-compressed 6075556 / 7022668 / -13.5% 🟢 27660000 / 27458837 / +0.7% 0.22 / 0.26 / -14.1%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9206156 / 9394832 / -2.0% 14775323 / 14721122 / +0.4% 0.62 / 0.64 / -2.4%
clickbench_q01/duckdb:parquet 15034220 / 15255306 / -1.4% 20756247 / 20612271 / +0.7% 0.72 / 0.74 / -2.1%
clickbench_q02/duckdb:parquet 22206378 / 23202924 / -4.3% 31875314 / 34409503 / -7.4% 0.70 / 0.67 / +3.3%
clickbench_q03/duckdb:parquet 22724393 / 22805660 / -0.4% 32519381 / 37416814 / -13.1% 🟢 0.70 / 0.61 / +14.7%
clickbench_q04/duckdb:parquet 61274806 / 62729622 / -2.3% 71162332 / 74237821 / -4.1% 0.86 / 0.84 / +1.9%
clickbench_q05/duckdb:parquet 83771592 / 82553121 / +1.5% 95982768 / 95555827 / +0.4% 0.87 / 0.86 / +1.0%
clickbench_q06/duckdb:parquet 20603114 / 20223452 / +1.9% 28857616 / 27478087 / +5.0% 0.71 / 0.74 / -3.0%
clickbench_q07/duckdb:parquet 17018586 / 17993160 / -5.4% 23629426 / 22337709 / +5.8% 0.72 / 0.81 / -10.6%
clickbench_q08/duckdb:parquet 75785224 / 75074766 / +0.9% 88999054 / 93024452 / -4.3% 0.85 / 0.81 / +5.5%
clickbench_q09/duckdb:parquet 102121926 / 103794619 / -1.6% 117459279 / 121917219 / -3.7% 0.87 / 0.85 / +2.1%
clickbench_q10/duckdb:parquet 41871476 / 41383818 / +1.2% 52723050 / 53619651 / -1.7% 0.79 / 0.77 / +2.9%
clickbench_q11/duckdb:parquet 46934952 / 46643339 / +0.6% 60809910 / 61615297 / -1.3% 0.77 / 0.76 / +2.0%
clickbench_q12/duckdb:parquet 93276846 / 93595602 / -0.3% 107591829 / 108115697 / -0.5% 0.87 / 0.87 / +0.1%
clickbench_q13/duckdb:parquet 150759324 / 148244281 / +1.7% 169718710 / 168231324 / +0.9% 0.89 / 0.88 / +0.8%
clickbench_q14/duckdb:parquet 100972708 / 101682435 / -0.7% 116905575 / 114164311 / +2.4% 0.86 / 0.89 / -3.0%
clickbench_q15/duckdb:parquet 86094175 / 85946628 / +0.2% 101832921 / 100644448 / +1.2% 0.85 / 0.85 / -1.0%
clickbench_q16/duckdb:parquet 158541162 / 165498386 / -4.2% 179418445 / 179975882 / -0.3% 0.88 / 0.92 / -3.9%
clickbench_q17/duckdb:parquet 166523430 / 171531960 / -2.9% 180039562 / 178665714 / +0.8% 0.92 / 0.96 / -3.7%
clickbench_q18/duckdb:parquet 293508369 / 291016272 / +0.9% 317192313 / 315607081 / +0.5% 0.93 / 0.92 / +0.4%
clickbench_q19/duckdb:parquet 19744426 / 19859715 / -0.6% 27396562 / 25786255 / +6.2% 0.72 / 0.77 / -6.4%
clickbench_q20/duckdb:parquet 181474398 / 180420120 / +0.6% 228431058 / 232480084 / -1.7% 0.79 / 0.78 / +2.4%
clickbench_q21/duckdb:parquet 222034964 / 218477350 / +1.6% 268878108 / 262983512 / +2.2% 0.83 / 0.83 / -0.6%
clickbench_q22/duckdb:parquet 319516898 / 304926990 / +4.8% 361977502 / 357379579 / +1.3% 0.88 / 0.85 / +3.5%
clickbench_q23/duckdb:parquet 172169020 / 171775762 / +0.2% 246335304 / 253121056 / -2.7% 0.70 / 0.68 / +3.0%
clickbench_q24/duckdb:parquet 30778948 / 29958716 / +2.7% 47271562 / 42482462 / +11.3% 🔴 0.65 / 0.71 / -7.7%
clickbench_q25/duckdb:parquet 42245840 / 42463750 / -0.5% 60237827 / 60982131 / -1.2% 0.70 / 0.70 / +0.7%
clickbench_q26/duckdb:parquet 30611800 / 32739711 / -6.5% 49271749 / 47017556 / +4.8% 0.62 / 0.70 / -10.8%
clickbench_q27/duckdb:parquet 196416952 / 191541398 / +2.5% 231394973 / 230295986 / +0.5% 0.85 / 0.83 / +2.1%
clickbench_q28/duckdb:parquet 969490630 / 950006560 / +2.1% 944163949 / 983079731 / -4.0% 1.03 / 0.97 / +6.3%
clickbench_q29/duckdb:parquet 23982812 / 24317362 / -1.4% 31349660 / 30925214 / +1.4% 0.77 / 0.79 / -2.7%
clickbench_q30/duckdb:parquet 105652127 / 104622488 / +1.0% 128461469 / 129419189 / -0.7% 0.82 / 0.81 / +1.7%
clickbench_q31/duckdb:parquet 147120356 / 160480217 / -8.3% 173568256 / 174417616 / -0.5% 0.85 / 0.92 / -7.9%
clickbench_q32/duckdb:parquet 383636450 / 385925739 / -0.6% 408403420 / 407659843 / +0.2% 0.94 / 0.95 / -0.8%
clickbench_q33/duckdb:parquet 483165953 / 468922366 / +3.0% 443044784 / 442695781 / +0.1% 1.09 / 1.06 / +3.0%
clickbench_q34/duckdb:parquet 470094992 / 462238432 / +1.7% 459213867 / 447629696 / +2.6% 1.02 / 1.03 / -0.9%
clickbench_q35/duckdb:parquet 60960848 / 61543474 / -0.9% 77469318 / 77479685 / -0.0% 0.79 / 0.79 / -0.9%
clickbench_q36/duckdb:parquet 30236151 / 30172014 / +0.2% 35662934 / 36925558 / -3.4% 0.85 / 0.82 / +3.8%
clickbench_q37/duckdb:parquet 23316724 / 23204022 / +0.5% 30283075 / 30425350 / -0.5% 0.77 / 0.76 / +1.0%
clickbench_q38/duckdb:parquet 24480255 / 23431136 / +4.5% 29403692 / 30912378 / -4.9% 0.83 / 0.76 / +9.8%
clickbench_q39/duckdb:parquet 52242025 / 52956229 / -1.3% 59834152 / 60047399 / -0.4% 0.87 / 0.88 / -1.0%
clickbench_q40/duckdb:parquet 14298296 / 14924840 / -4.2% 20662601 / 20066747 / +3.0% 0.69 / 0.74 / -7.0%
clickbench_q41/duckdb:parquet 15657162 / 15331596 / +2.1% 21222706 / 23069987 / -8.0% 0.74 / 0.66 / +11.0%
clickbench_q42/duckdb:parquet 14026404 / 14130908 / -0.7% 20611420 / 20120985 / +2.4% 0.68 / 0.70 / -3.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR e6ec8c58 vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+5.6%, environment too noisy confidence) · DuckDB No clear signal (-5.9%, environment too noisy confidence)
Vortex (geomean): hot 1.049x ➖ · cold 1.070x ➖
Parquet (geomean): hot 1.052x ➖ · cold 1.063x ➖
Shifts: Parquet (control) +5.2% · Median polish +5.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.107x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 216637134 / 213717821 / +1.4% 874339821 / 764398977 / +14.4% 0.25 / 0.28 / -11.4%
tpch_q02/datafusion:vortex-file-compressed 329797149 / 320984758 / +2.7% 607232857 / 553448858 / +9.7% 0.54 / 0.58 / -6.4%
tpch_q03/datafusion:vortex-file-compressed 318397841 / 310450262 / +2.6% 808189843 / 854530904 / -5.4% 0.39 / 0.36 / +8.4%
tpch_q04/datafusion:vortex-file-compressed 215316150 / 159007585 / +35.4% 🔴 484894173 / 372572808 / +30.1% 🔴 0.44 / 0.43 / +4.0%
tpch_q05/datafusion:vortex-file-compressed 369734710 / 344078558 / +7.5% 593279933 / 546047746 / +8.6% 0.62 / 0.63 / -1.1%
tpch_q06/datafusion:vortex-file-compressed 156934969 / 123668516 / +26.9% 371397145 / 317073449 / +17.1% 0.42 / 0.39 / +8.3%
tpch_q07/datafusion:vortex-file-compressed 457308785 / 426177142 / +7.3% 712524357 / 586012416 / +21.6% 0.64 / 0.73 / -11.7%
tpch_q08/datafusion:vortex-file-compressed 595111055 / 410714646 / +44.9% 🔴 912746550 / 541459260 / +68.6% 🔴 0.65 / 0.76 / -14.0%
tpch_q09/datafusion:vortex-file-compressed 308900170 / 301899395 / +2.3% 539314190 / 455403137 / +18.4% 0.57 / 0.66 / -13.6%
tpch_q10/datafusion:vortex-file-compressed 376675276 / 361036359 / +4.3% 533662581 / 525406226 / +1.6% 0.71 / 0.69 / +2.7%
tpch_q11/datafusion:vortex-file-compressed 274243127 / 272228443 / +0.7% 434175183 / 382260665 / +13.6% 0.63 / 0.71 / -11.3%
tpch_q12/datafusion:vortex-file-compressed 203012754 / 203460731 / -0.2% 381581114 / 338106908 / +12.9% 0.53 / 0.60 / -11.6%
tpch_q13/datafusion:vortex-file-compressed 147878286 / 116217877 / +27.2% 295868262 / 309114444 / -4.3% 0.50 / 0.38 / +32.9%
tpch_q14/datafusion:vortex-file-compressed 210214223 / 181074526 / +16.1% 413242748 / 354128334 / +16.7% 0.51 / 0.51 / -0.5%
tpch_q15/datafusion:vortex-file-compressed 308467163 / 306125584 / +0.8% 988240374 / 727209626 / +35.9% 🔴 0.31 / 0.42 / -25.9%
tpch_q16/datafusion:vortex-file-compressed 133662522 / 134848492 / -0.9% 300115269 / 285978767 / +4.9% 0.45 / 0.47 / -5.5%
tpch_q17/datafusion:vortex-file-compressed 271255191 / 252865916 / +7.3% 438246591 / 494400127 / -11.4% 0.62 / 0.51 / +21.0%
tpch_q18/datafusion:vortex-file-compressed 257911739 / 222278514 / +16.0% 479026627 / 389005809 / +23.1% 0.54 / 0.57 / -5.8%
tpch_q19/datafusion:vortex-file-compressed 241800204 / 226209017 / +6.9% 414618675 / 296515885 / +39.8% 🔴 0.58 / 0.76 / -23.6%
tpch_q20/datafusion:vortex-file-compressed 265171073 / 248686849 / +6.6% 502522312 / 477297666 / +5.3% 0.53 / 0.52 / +1.3%
tpch_q21/datafusion:vortex-file-compressed 412190641 / 384422617 / +7.2% 720866839 / 739838656 / -2.6% 0.57 / 0.52 / +10.0%
tpch_q22/datafusion:vortex-file-compressed 185756724 / 147475449 / +26.0% 492870328 / 337385924 / +46.1% 🔴 0.38 / 0.44 / -13.8%
datafusion / parquet / ns (1.048x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 145096474 / 143033960 / +1.4% 478217442 / 425422516 / +12.4% 0.30 / 0.34 / -9.8%
tpch_q02/datafusion:parquet 282820592 / 274389077 / +3.1% 485635606 / 421418541 / +15.2% 0.58 / 0.65 / -10.6%
tpch_q03/datafusion:parquet 253485546 / 240153039 / +5.6% 662687229 / 656104536 / +1.0% 0.38 / 0.37 / +4.5%
tpch_q04/datafusion:parquet 168678754 / 129091170 / +30.7% 🔴 298457596 / 262434371 / +13.7% 0.57 / 0.49 / +14.9%
tpch_q05/datafusion:parquet 339361964 / 325560808 / +4.2% 441783949 / 708712744 / -37.7% 🟢 0.77 / 0.46 / +67.2%
tpch_q06/datafusion:parquet 104913510 / 104623731 / +0.3% 233390415 / 202039421 / +15.5% 0.45 / 0.52 / -13.2%
tpch_q07/datafusion:parquet 339653486 / 326115720 / +4.2% 457139827 / 439408571 / +4.0% 0.74 / 0.74 / +0.1%
tpch_q08/datafusion:parquet 396395658 / 383031456 / +3.5% 540421679 / 487777150 / +10.8% 0.73 / 0.79 / -6.6%
tpch_q09/datafusion:parquet 431829770 / 507741508 / -15.0% 515080837 / 948722124 / -45.7% 🟢 0.84 / 0.54 / +56.7%
tpch_q10/datafusion:parquet 328555226 / 318225993 / +3.2% 443585757 / 431490793 / +2.8% 0.74 / 0.74 / +0.4%
tpch_q11/datafusion:parquet 259005168 / 245309101 / +5.6% 461257758 / 324804219 / +42.0% 🔴 0.56 / 0.76 / -25.7%
tpch_q12/datafusion:parquet 154485798 / 160703746 / -3.9% 283633955 / 262477140 / +8.1% 0.54 / 0.61 / -11.0%
tpch_q13/datafusion:parquet 278861817 / 274764633 / +1.5% 484314817 / 387802001 / +24.9% 0.58 / 0.71 / -18.7%
tpch_q14/datafusion:parquet 165846555 / 141590102 / +17.1% 411862442 / 264823133 / +55.5% 🔴 0.40 / 0.53 / -24.7%
tpch_q15/datafusion:parquet 297183730 / 297935495 / -0.3% 456771124 / 444599102 / +2.7% 0.65 / 0.67 / -2.9%
tpch_q16/datafusion:parquet 96862785 / 96864793 / -0.0% 234042792 / 207092637 / +13.0% 0.41 / 0.47 / -11.5%
tpch_q17/datafusion:parquet 285628933 / 268630342 / +6.3% 467487944 / 416939497 / +12.1% 0.61 / 0.64 / -5.2%
tpch_q18/datafusion:parquet 337458904 / 305302634 / +10.5% 546796618 / 465639400 / +17.4% 0.62 / 0.66 / -5.9%
tpch_q19/datafusion:parquet 171695285 / 149310744 / +15.0% 266598733 / 274137368 / -2.7% 0.64 / 0.54 / +18.2%
tpch_q20/datafusion:parquet 245882099 / 228071243 / +7.8% 414038450 / 424446687 / -2.5% 0.59 / 0.54 / +10.5%
tpch_q21/datafusion:parquet 293800166 / 291483866 / +0.8% 487241520 / 469762099 / +3.7% 0.60 / 0.62 / -2.8%
tpch_q22/datafusion:parquet 160149555 / 145366900 / +10.2% 310929734 / 299750221 / +3.7% 0.52 / 0.48 / +6.2%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 280821155 / 237695207 / +18.1% 272641189 / 298096331 / -8.5% 1.03 / 0.80 / +29.2%
tpch_q02/duckdb:vortex-file-compressed 416738698 / 394665672 / +5.6% 442711960 / 474795024 / -6.8% 0.94 / 0.83 / +13.2%
tpch_q03/duckdb:vortex-file-compressed 410945746 / 398939371 / +3.0% 467043777 / 460688509 / +1.4% 0.88 / 0.87 / +1.6%
tpch_q04/duckdb:vortex-file-compressed 275549366 / 255227345 / +8.0% 329962756 / 296337544 / +11.3% 0.84 / 0.86 / -3.0%
tpch_q05/duckdb:vortex-file-compressed 574417018 / 709957932 / -19.1% 561075269 / 785337665 / -28.6% 1.02 / 0.90 / +13.2%
tpch_q06/duckdb:vortex-file-compressed 160565280 / 148777224 / +7.9% 231927525 / 208058114 / +11.5% 0.69 / 0.72 / -3.2%
tpch_q07/duckdb:vortex-file-compressed 408088875 / 387859027 / +5.2% 505319946 / 510621725 / -1.0% 0.81 / 0.76 / +6.3%
tpch_q08/duckdb:vortex-file-compressed 611962851 / 617848086 / -1.0% 627853947 / 732855328 / -14.3% 0.97 / 0.84 / +15.6%
tpch_q09/duckdb:vortex-file-compressed 396235624 / 392528875 / +0.9% 434028913 / 482201706 / -10.0% 0.91 / 0.81 / +12.1%
tpch_q10/duckdb:vortex-file-compressed 526686193 / 526138612 / +0.1% 614018846 / 576801469 / +6.5% 0.86 / 0.91 / -6.0%
tpch_q11/duckdb:vortex-file-compressed 335588555 / 288496302 / +16.3% 289354600 / 270775100 / +6.9% 1.16 / 1.07 / +8.9%
tpch_q12/duckdb:vortex-file-compressed 226653302 / 271105721 / -16.4% 259126065 / 407392913 / -36.4% 🟢 0.87 / 0.67 / +31.4%
tpch_q13/duckdb:vortex-file-compressed 260583251 / 247871881 / +5.1% 321396765 / 208806747 / +53.9% 🔴 0.81 / 1.19 / -31.7%
tpch_q14/duckdb:vortex-file-compressed 222712801 / 224785869 / -0.9% 256089256 / 273953898 / -6.5% 0.87 / 0.82 / +6.0%
tpch_q15/duckdb:vortex-file-compressed 271464701 / 237917836 / +14.1% 299546290 / 453417020 / -33.9% 🟢 0.91 / 0.52 / +72.7%
tpch_q16/duckdb:vortex-file-compressed 203783441 / 206543544 / -1.3% 309807492 / 287344280 / +7.8% 0.66 / 0.72 / -8.5%
tpch_q17/duckdb:vortex-file-compressed 328976707 / 454602893 / -27.6% 409208377 / 443734007 / -7.8% 0.80 / 1.02 / -21.5%
tpch_q18/duckdb:vortex-file-compressed 363617527 / 339736454 / +7.0% 444235508 / 418339259 / +6.2% 0.82 / 0.81 / +0.8%
tpch_q19/duckdb:vortex-file-compressed 270808775 / 320978677 / -15.6% 372247047 / 349847295 / +6.4% 0.73 / 0.92 / -20.7%
tpch_q20/duckdb:vortex-file-compressed 320935187 / 334782469 / -4.1% 531987127 / 412936083 / +28.8% 0.60 / 0.81 / -25.6%
tpch_q21/duckdb:vortex-file-compressed 615262327 / 558602915 / +10.1% 699733287 / 630439819 / +11.0% 0.88 / 0.89 / -0.8%
tpch_q22/duckdb:vortex-file-compressed 222650181 / 253794094 / -12.3% 354415406 / 269551763 / +31.5% 🔴 0.63 / 0.94 / -33.3%
duckdb / parquet / ns (1.056x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 174585929 / 178327142 / -2.1% 250517872 / 188180852 / +33.1% 🔴 0.70 / 0.95 / -26.5%
tpch_q02/duckdb:parquet 446255191 / 428571834 / +4.1% 410212124 / 421258354 / -2.6% 1.09 / 1.02 / +6.9%
tpch_q03/duckdb:parquet 394865385 / 384797319 / +2.6% 411407648 / 402689855 / +2.2% 0.96 / 0.96 / +0.4%
tpch_q04/duckdb:parquet 235603301 / 278868438 / -15.5% 306878570 / 290411092 / +5.7% 0.77 / 0.96 / -20.0%
tpch_q05/duckdb:parquet 546132312 / 512960026 / +6.5% 635057632 / 589908823 / +7.7% 0.86 / 0.87 / -1.1%
tpch_q06/duckdb:parquet 153103456 / 154774655 / -1.1% 196431323 / 188086085 / +4.4% 0.78 / 0.82 / -5.3%
tpch_q07/duckdb:parquet 574093645 / 419672939 / +36.8% 🔴 502080876 / 421853390 / +19.0% 1.14 / 0.99 / +14.9%
tpch_q08/duckdb:parquet 551868663 / 588960652 / -6.3% 608195901 / 658661231 / -7.7% 0.91 / 0.89 / +1.5%
tpch_q09/duckdb:parquet 499478029 / 557378838 / -10.4% 517513515 / 656390425 / -21.2% 0.97 / 0.85 / +13.7%
tpch_q10/duckdb:parquet 587281717 / 517349035 / +13.5% 595976952 / 581884894 / +2.4% 0.99 / 0.89 / +10.8%
tpch_q11/duckdb:parquet 306616984 / 279247336 / +9.8% 316381733 / 301469405 / +4.9% 0.97 / 0.93 / +4.6%
tpch_q12/duckdb:parquet 261393630 / 244321025 / +7.0% 314647214 / 281145014 / +11.9% 0.83 / 0.87 / -4.4%
tpch_q13/duckdb:parquet 390563808 / 382703043 / +2.1% 446546198 / 463219570 / -3.6% 0.87 / 0.83 / +5.9%
tpch_q14/duckdb:parquet 239888020 / 255047143 / -5.9% 321607931 / 301222259 / +6.8% 0.75 / 0.85 / -11.9%
tpch_q15/duckdb:parquet 264489674 / 191438501 / +38.2% 🔴 300063670 / 220554518 / +36.0% 🔴 0.88 / 0.87 / +1.6%
tpch_q16/duckdb:parquet 276431420 / 287313946 / -3.8% 289383977 / 301984087 / -4.2% 0.96 / 0.95 / +0.4%
tpch_q17/duckdb:parquet 278867915 / 258007938 / +8.1% 341766702 / 314199718 / +8.8% 0.82 / 0.82 / -0.6%
tpch_q18/duckdb:parquet 352736141 / 306425002 / +15.1% 413851330 / 355418381 / +16.4% 0.85 / 0.86 / -1.1%
tpch_q19/duckdb:parquet 261516878 / 241485587 / +8.3% 326903628 / 285468394 / +14.5% 0.80 / 0.85 / -5.4%
tpch_q20/duckdb:parquet 508688037 / 432599380 / +17.6% 624283556 / 540117093 / +15.6% 0.81 / 0.80 / +1.7%
tpch_q21/duckdb:parquet 440542148 / 417617294 / +5.5% 464560474 / 463876894 / +0.1% 0.95 / 0.90 / +5.3%
tpch_q22/duckdb:parquet 315107638 / 287438341 / +9.6% 319390870 / 253402369 / +26.0% 0.99 / 1.13 / -13.0%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR e6ec8c58 vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35393258 / 35836658 / -1.2% 61065398 / 59839649 / +2.0% 0.58 / 0.60 / -3.2%
tpcds_q02/datafusion:vortex-file-compressed 49379988 / 51540980 / -4.2% 76117085 / 75356430 / +1.0% 0.65 / 0.68 / -5.2%
tpcds_q03/datafusion:vortex-file-compressed 19766662 / 20246396 / -2.4% 46855947 / 46166223 / +1.5% 0.42 / 0.44 / -3.8%
tpcds_q04/datafusion:vortex-file-compressed 292346042 / 293432920 / -0.4% 349554436 / 354050198 / -1.3% 0.84 / 0.83 / +0.9%
tpcds_q05/datafusion:vortex-file-compressed 71811258 / 71656747 / +0.2% 103198514 / 107692212 / -4.2% 0.70 / 0.67 / +4.6%
tpcds_q06/datafusion:vortex-file-compressed 42197009 / 42258217 / -0.1% 73155231 / 70535607 / +3.7% 0.58 / 0.60 / -3.7%
tpcds_q07/datafusion:vortex-file-compressed 41817830 / 42156216 / -0.8% 81487257 / 80613054 / +1.1% 0.51 / 0.52 / -1.9%
tpcds_q08/datafusion:vortex-file-compressed 28501528 / 28614063 / -0.4% 54341846 / 57730721 / -5.9% 0.52 / 0.50 / +5.8%
tpcds_q09/datafusion:vortex-file-compressed 44062948 / 44012164 / +0.1% 72854158 / 77101674 / -5.5% 0.60 / 0.57 / +6.0%
tpcds_q10/datafusion:vortex-file-compressed 36985138 / 37189576 / -0.5% 61409696 / 63021635 / -2.6% 0.60 / 0.59 / +2.1%
tpcds_q11/datafusion:vortex-file-compressed 174580642 / 174495550 / +0.0% 222253517 / 221987691 / +0.1% 0.79 / 0.79 / -0.1%
tpcds_q12/datafusion:vortex-file-compressed 17643955 / 17549844 / +0.5% 38944631 / 38571171 / +1.0% 0.45 / 0.45 / -0.4%
tpcds_q13/datafusion:vortex-file-compressed 40227947 / 38899632 / +3.4% 83249582 / 85520203 / -2.7% 0.48 / 0.45 / +6.2%
tpcds_q14/datafusion:vortex-file-compressed 226488522 / 231725092 / -2.3% 273127458 / 271215982 / +0.7% 0.83 / 0.85 / -2.9%
tpcds_q15/datafusion:vortex-file-compressed 40063264 / 40095029 / -0.1% 56784763 / 54164984 / +4.8% 0.71 / 0.74 / -4.7%
tpcds_q16/datafusion:vortex-file-compressed 23386952 / 22869641 / +2.3% 42366227 / 42034772 / +0.8% 0.55 / 0.54 / +1.5%
tpcds_q17/datafusion:vortex-file-compressed 64778842 / 64808376 / -0.0% 88028398 / 89558176 / -1.7% 0.74 / 0.72 / +1.7%
tpcds_q18/datafusion:vortex-file-compressed 69765824 / 69097730 / +1.0% 96689019 / 94787906 / +2.0% 0.72 / 0.73 / -1.0%
tpcds_q19/datafusion:vortex-file-compressed 23060092 / 22408799 / +2.9% 52133124 / 55496169 / -6.1% 0.44 / 0.40 / +9.5%
tpcds_q20/datafusion:vortex-file-compressed 23895058 / 23702741 / +0.8% 40206965 / 40220803 / -0.0% 0.59 / 0.59 / +0.8%
tpcds_q21/datafusion:vortex-file-compressed 47209170 / 47542674 / -0.7% 62902231 / 64058585 / -1.8% 0.75 / 0.74 / +1.1%
tpcds_q22/datafusion:vortex-file-compressed 433005812 / 431366016 / +0.4% 461121924 / 465284097 / -0.9% 0.94 / 0.93 / +1.3%
tpcds_q23/datafusion:vortex-file-compressed 296987869 / 299587271 / -0.9% 344628016 / 351318540 / -1.9% 0.86 / 0.85 / +1.1%
tpcds_q24/datafusion:vortex-file-compressed 120350158 / 120023524 / +0.3% 161337730 / 159982078 / +0.8% 0.75 / 0.75 / -0.6%
tpcds_q25/datafusion:vortex-file-compressed 63213026 / 63311010 / -0.2% 98137605 / 102454935 / -4.2% 0.64 / 0.62 / +4.2%
tpcds_q26/datafusion:vortex-file-compressed 36377780 / 37429288 / -2.8% 60360553 / 59331611 / +1.7% 0.60 / 0.63 / -4.5%
tpcds_q27/datafusion:vortex-file-compressed 69947890 / 72377160 / -3.4% 113854920 / 104225546 / +9.2% 0.61 / 0.69 / -11.5%
tpcds_q28/datafusion:vortex-file-compressed 43805089 / 42296916 / +3.6% 83503857 / 82755038 / +0.9% 0.52 / 0.51 / +2.6%
tpcds_q29/datafusion:vortex-file-compressed 65771963 / 61922299 / +6.2% 98172943 / 97201813 / +1.0% 0.67 / 0.64 / +5.2%
tpcds_q30/datafusion:vortex-file-compressed 52769548 / 51311054 / +2.8% 79903287 / 79114003 / +1.0% 0.66 / 0.65 / +1.8%
tpcds_q31/datafusion:vortex-file-compressed 199668608 / 196557266 / +1.6% 232137323 / 235875877 / -1.6% 0.86 / 0.83 / +3.2%
tpcds_q32/datafusion:vortex-file-compressed 14923091 / 15236954 / -2.1% 30929848 / 31554300 / -2.0% 0.48 / 0.48 / -0.1%
tpcds_q33/datafusion:vortex-file-compressed 32711794 / 33321710 / -1.8% 69092215 / 67027574 / +3.1% 0.47 / 0.50 / -4.8%
tpcds_q34/datafusion:vortex-file-compressed 40814436 / 41148345 / -0.8% 67472096 / 68234625 / -1.1% 0.60 / 0.60 / +0.3%
tpcds_q35/datafusion:vortex-file-compressed 92426162 / 92443260 / -0.0% 125705133 / 120652799 / +4.2% 0.74 / 0.77 / -4.0%
tpcds_q36/datafusion:vortex-file-compressed 66091080 / 65946206 / +0.2% 101591488 / 100250170 / +1.3% 0.65 / 0.66 / -1.1%
tpcds_q37/datafusion:vortex-file-compressed 23248906 / 23553139 / -1.3% 40871566 / 43598667 / -6.3% 0.57 / 0.54 / +5.3%
tpcds_q38/datafusion:vortex-file-compressed 79021325 / 76507711 / +3.3% 110090227 / 106221269 / +3.6% 0.72 / 0.72 / -0.3%
tpcds_q39/datafusion:vortex-file-compressed 885735498 / 887680404 / -0.2% 899029239 / 906829393 / -0.9% 0.99 / 0.98 / +0.6%
tpcds_q40/datafusion:vortex-file-compressed 28825047 / 28735451 / +0.3% 48161604 / 47789817 / +0.8% 0.60 / 0.60 / -0.5%
tpcds_q41/datafusion:vortex-file-compressed 19316263 / 19056672 / +1.4% 31213186 / 30560191 / +2.1% 0.62 / 0.62 / -0.8%
tpcds_q42/datafusion:vortex-file-compressed 13556404 / 14306364 / -5.2% 40166229 / 39330916 / +2.1% 0.34 / 0.36 / -7.2%
tpcds_q43/datafusion:vortex-file-compressed 17265268 / 17123520 / +0.8% 42345442 / 40887604 / +3.6% 0.41 / 0.42 / -2.6%
tpcds_q44/datafusion:vortex-file-compressed 43664802 / 42841783 / +1.9% 73439657 / 73034215 / +0.6% 0.59 / 0.59 / +1.4%
tpcds_q45/datafusion:vortex-file-compressed 43466620 / 42716522 / +1.8% 58681725 / 64325351 / -8.8% 0.74 / 0.66 / +11.5%
tpcds_q46/datafusion:vortex-file-compressed 70593215 / 70770951 / -0.3% 109260898 / 103002911 / +6.1% 0.65 / 0.69 / -6.0%
tpcds_q47/datafusion:vortex-file-compressed 174993548 / 176930862 / -1.1% 224257659 / 217533458 / +3.1% 0.78 / 0.81 / -4.1%
tpcds_q48/datafusion:vortex-file-compressed 35629056 / 35477019 / +0.4% 70326702 / 70167195 / +0.2% 0.51 / 0.51 / +0.2%
tpcds_q49/datafusion:vortex-file-compressed 78772242 / 79901468 / -1.4% 120477045 / 120233831 / +0.2% 0.65 / 0.66 / -1.6%
tpcds_q50/datafusion:vortex-file-compressed 55418466 / 56310110 / -1.6% 89466428 / 89046429 / +0.5% 0.62 / 0.63 / -2.0%
tpcds_q51/datafusion:vortex-file-compressed 249466328 / 241461239 / +3.3% 275998713 / 280306123 / -1.5% 0.90 / 0.86 / +4.9%
tpcds_q52/datafusion:vortex-file-compressed 15344408 / 14942948 / +2.7% 39633901 / 41146983 / -3.7% 0.39 / 0.36 / +6.6%
tpcds_q53/datafusion:vortex-file-compressed 22397274 / 23025893 / -2.7% 50768927 / 52394142 / -3.1% 0.44 / 0.44 / +0.4%
tpcds_q54/datafusion:vortex-file-compressed 58950386 / 59630808 / -1.1% 92766416 / 92798502 / -0.0% 0.64 / 0.64 / -1.1%
tpcds_q55/datafusion:vortex-file-compressed 13929768 / 15209610 / -8.4% 37646026 / 39200802 / -4.0% 0.37 / 0.39 / -4.6%
tpcds_q56/datafusion:vortex-file-compressed 33306814 / 34211642 / -2.6% 62801270 / 63579406 / -1.2% 0.53 / 0.54 / -1.4%
tpcds_q57/datafusion:vortex-file-compressed 133047936 / 130827096 / +1.7% 161612517 / 162474233 / -0.5% 0.82 / 0.81 / +2.2%
tpcds_q58/datafusion:vortex-file-compressed 48264982 / 49071762 / -1.6% 87596576 / 84738612 / +3.4% 0.55 / 0.58 / -4.9%
tpcds_q59/datafusion:vortex-file-compressed 54541390 / 54936949 / -0.7% 83936238 / 85696270 / -2.1% 0.65 / 0.64 / +1.4%
tpcds_q60/datafusion:vortex-file-compressed 33844866 / 34485962 / -1.9% 67118455 / 66114270 / +1.5% 0.50 / 0.52 / -3.3%
tpcds_q61/datafusion:vortex-file-compressed 45231556 / 45202724 / +0.1% 70499542 / 70916447 / -0.6% 0.64 / 0.64 / +0.7%
tpcds_q62/datafusion:vortex-file-compressed 19012520 / 19841460 / -4.2% 42591800 / 43084349 / -1.1% 0.45 / 0.46 / -3.1%
tpcds_q63/datafusion:vortex-file-compressed 23568916 / 22619521 / +4.2% 51668923 / 49716174 / +3.9% 0.46 / 0.45 / +0.3%
tpcds_q64/datafusion:vortex-file-compressed 332790883 / 332776120 / +0.0% 403322381 / 399340320 / +1.0% 0.83 / 0.83 / -1.0%
tpcds_q65/datafusion:vortex-file-compressed 73187543 / 73751860 / -0.8% 110051726 / 110569158 / -0.5% 0.67 / 0.67 / -0.3%
tpcds_q66/datafusion:vortex-file-compressed 52852049 / 52486634 / +0.7% 80387019 / 77837826 / +3.3% 0.66 / 0.67 / -2.5%
tpcds_q67/datafusion:vortex-file-compressed 418806333 / 420503111 / -0.4% 518332822 / 528828691 / -2.0% 0.81 / 0.80 / +1.6%
tpcds_q68/datafusion:vortex-file-compressed 69771789 / 66831493 / +4.4% 105899139 / 99391180 / +6.5% 0.66 / 0.67 / -2.0%
tpcds_q69/datafusion:vortex-file-compressed 36729216 / 36278824 / +1.2% 64893116 / 63625322 / +2.0% 0.57 / 0.57 / -0.7%
tpcds_q70/datafusion:vortex-file-compressed 195336870 / 194497137 / +0.4% 228895169 / 232217411 / -1.4% 0.85 / 0.84 / +1.9%
tpcds_q71/datafusion:vortex-file-compressed 25718878 / 25424784 / +1.2% 58277017 / 61267492 / -4.9% 0.44 / 0.41 / +6.3%
tpcds_q72/datafusion:vortex-file-compressed 1565096584 / 1575229677 / -0.6% 1576174821 / 1696144047 / -7.1% 0.99 / 0.93 / +6.9%
tpcds_q73/datafusion:vortex-file-compressed 38967246 / 38589712 / +1.0% 64703189 / 62969996 / +2.8% 0.60 / 0.61 / -1.7%
tpcds_q74/datafusion:vortex-file-compressed 134043084 / 134601274 / -0.4% 179535234 / 173765353 / +3.3% 0.75 / 0.77 / -3.6%
tpcds_q75/datafusion:vortex-file-compressed 155439398 / 155633299 / -0.1% 196050554 / 198511793 / -1.2% 0.79 / 0.78 / +1.1%
tpcds_q76/datafusion:vortex-file-compressed 33333570 / 34722660 / -4.0% 75175868 / 73189101 / +2.7% 0.44 / 0.47 / -6.5%
tpcds_q77/datafusion:vortex-file-compressed 54294127 / 54175824 / +0.2% 87989879 / 87493805 / +0.6% 0.62 / 0.62 / -0.3%
tpcds_q78/datafusion:vortex-file-compressed 140726652 / 140889933 / -0.1% 193332109 / 191779256 / +0.8% 0.73 / 0.73 / -0.9%
tpcds_q79/datafusion:vortex-file-compressed 54129533 / 53408896 / +1.3% 84036158 / 83137730 / +1.1% 0.64 / 0.64 / +0.3%
tpcds_q80/datafusion:vortex-file-compressed 80566613 / 80795658 / -0.3% 124589669 / 127799771 / -2.5% 0.65 / 0.63 / +2.3%
tpcds_q81/datafusion:vortex-file-compressed 56213535 / 55975548 / +0.4% 85314897 / 83846761 / +1.8% 0.66 / 0.67 / -1.3%
tpcds_q82/datafusion:vortex-file-compressed 29899722 / 30549740 / -2.1% 53013838 / 48106493 / +10.2% 🔴 0.56 / 0.64 / -11.2%
tpcds_q83/datafusion:vortex-file-compressed 42714442 / 42358020 / +0.8% 66904685 / 65597866 / +2.0% 0.64 / 0.65 / -1.1%
tpcds_q84/datafusion:vortex-file-compressed 12870282 / 12799204 / +0.6% 32378576 / 30970538 / +4.5% 0.40 / 0.41 / -3.8%
tpcds_q85/datafusion:vortex-file-compressed 59874622 / 60660052 / -1.3% 90383966 / 90654953 / -0.3% 0.66 / 0.67 / -1.0%
tpcds_q86/datafusion:vortex-file-compressed 18418502 / 18272155 / +0.8% 39939043 / 40425570 / -1.2% 0.46 / 0.45 / +2.0%
tpcds_q87/datafusion:vortex-file-compressed 79385120 / 79615489 / -0.3% 109125432 / 107689679 / +1.3% 0.73 / 0.74 / -1.6%
tpcds_q88/datafusion:vortex-file-compressed 53980182 / 56206700 / -4.0% 90649964 / 93094539 / -2.6% 0.60 / 0.60 / -1.4%
tpcds_q89/datafusion:vortex-file-compressed 26890349 / 26931306 / -0.2% 54095750 / 56072635 / -3.5% 0.50 / 0.48 / +3.5%
tpcds_q90/datafusion:vortex-file-compressed 12486258 / 12758200 / -2.1% 31227983 / 34107490 / -8.4% 0.40 / 0.37 / +6.9%
tpcds_q91/datafusion:vortex-file-compressed 19410904 / 19519254 / -0.6% 42647660 / 42141655 / +1.2% 0.46 / 0.46 / -1.7%
tpcds_q92/datafusion:vortex-file-compressed 15011268 / 15245025 / -1.5% 34951209 / 33922326 / +3.0% 0.43 / 0.45 / -4.4%
tpcds_q93/datafusion:vortex-file-compressed 54944316 / 54842766 / +0.2% 91125562 / 88696680 / +2.7% 0.60 / 0.62 / -2.5%
tpcds_q94/datafusion:vortex-file-compressed 21395957 / 21620928 / -1.0% 45198201 / 46231785 / -2.2% 0.47 / 0.47 / +1.2%
tpcds_q95/datafusion:vortex-file-compressed 97361042 / 95000299 / +2.5% 124247725 / 123858370 / +0.3% 0.78 / 0.77 / +2.2%
tpcds_q96/datafusion:vortex-file-compressed 11673374 / 11533278 / +1.2% 30997612 / 31102793 / -0.3% 0.38 / 0.37 / +1.6%
tpcds_q97/datafusion:vortex-file-compressed 39511456 / 39467840 / +0.1% 65777815 / 66425488 / -1.0% 0.60 / 0.59 / +1.1%
tpcds_q98/datafusion:vortex-file-compressed 21062694 / 20665282 / +1.9% 47888901 / 48509099 / -1.3% 0.44 / 0.43 / +3.2%
tpcds_q99/datafusion:vortex-file-compressed 29490714 / 29545800 / -0.2% 48425801 / 48862458 / -0.9% 0.61 / 0.60 / +0.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59682818 / 59408052 / +0.5% 78143267 / 82373568 / -5.1% 0.76 / 0.72 / +5.9%
tpcds_q02/datafusion:parquet 68757840 / 69761366 / -1.4% 92718195 / 90812813 / +2.1% 0.74 / 0.77 / -3.5%
tpcds_q03/datafusion:parquet 28540807 / 28478768 / +0.2% 50062975 / 49334251 / +1.5% 0.57 / 0.58 / -1.2%
tpcds_q04/datafusion:parquet 640694764 / 642610250 / -0.3% 703708986 / 708231753 / -0.6% 0.91 / 0.91 / +0.3%
tpcds_q05/datafusion:parquet 80310365 / 81388832 / -1.3% 117106495 / 113800720 / +2.9% 0.69 / 0.72 / -4.1%
tpcds_q06/datafusion:parquet 92418823 / 90852955 / +1.7% 112792023 / 115952402 / -2.7% 0.82 / 0.78 / +4.6%
tpcds_q07/datafusion:parquet 101964315 / 101418282 / +0.5% 134353654 / 133695330 / +0.5% 0.76 / 0.76 / +0.0%
tpcds_q08/datafusion:parquet 47922054 / 48684130 / -1.6% 71326868 / 74133519 / -3.8% 0.67 / 0.66 / +2.3%
tpcds_q09/datafusion:parquet 75061114 / 75160834 / -0.1% 108594371 / 102849415 / +5.6% 0.69 / 0.73 / -5.4%
tpcds_q10/datafusion:parquet 60197250 / 60416750 / -0.4% 82854372 / 84947233 / -2.5% 0.73 / 0.71 / +2.2%
tpcds_q11/datafusion:parquet 412384848 / 412444870 / -0.0% 452866751 / 461294550 / -1.8% 0.91 / 0.89 / +1.8%
tpcds_q12/datafusion:parquet 40317234 / 39871562 / +1.1% 57950475 / 57128529 / +1.4% 0.70 / 0.70 / -0.3%
tpcds_q13/datafusion:parquet 86770918 / 84637846 / +2.5% 129112288 / 130466094 / -1.0% 0.67 / 0.65 / +3.6%
tpcds_q14/datafusion:parquet 372636084 / 378360104 / -1.5% 421758983 / 433388374 / -2.7% 0.88 / 0.87 / +1.2%
tpcds_q15/datafusion:parquet 51135858 / 51502606 / -0.7% 70898207 / 72303263 / -1.9% 0.72 / 0.71 / +1.3%
tpcds_q16/datafusion:parquet 45072687 / 45710882 / -1.4% 62394373 / 63650471 / -2.0% 0.72 / 0.72 / +0.6%
tpcds_q17/datafusion:parquet 136619004 / 138067928 / -1.0% 173457200 / 172187136 / +0.7% 0.79 / 0.80 / -1.8%
tpcds_q18/datafusion:parquet 109089667 / 110369917 / -1.2% 143158291 / 144952536 / -1.2% 0.76 / 0.76 / +0.1%
tpcds_q19/datafusion:parquet 48493500 / 48384048 / +0.2% 82127894 / 75539146 / +8.7% 0.59 / 0.64 / -7.8%
tpcds_q20/datafusion:parquet 41117300 / 41512735 / -1.0% 54535175 / 55090816 / -1.0% 0.75 / 0.75 / +0.1%
tpcds_q21/datafusion:parquet 60937328 / 61141701 / -0.3% 73930565 / 73095747 / +1.1% 0.82 / 0.84 / -1.5%
tpcds_q22/datafusion:parquet 464758824 / 464195324 / +0.1% 479056679 / 478139930 / +0.2% 0.97 / 0.97 / -0.1%
tpcds_q23/datafusion:parquet 357619176 / 357626356 / -0.0% 424318303 / 417833459 / +1.6% 0.84 / 0.86 / -1.5%
tpcds_q24/datafusion:parquet 241804089 / 241331307 / +0.2% 280214648 / 278266611 / +0.7% 0.86 / 0.87 / -0.5%
tpcds_q25/datafusion:parquet 146703433 / 146902811 / -0.1% 191735244 / 196039200 / -2.2% 0.77 / 0.75 / +2.1%
tpcds_q26/datafusion:parquet 56222038 / 53821080 / +4.5% 78578393 / 80565923 / -2.5% 0.72 / 0.67 / +7.1%
tpcds_q27/datafusion:parquet 210646007 / 210089836 / +0.3% 245009678 / 235911774 / +3.9% 0.86 / 0.89 / -3.5%
tpcds_q28/datafusion:parquet 85529914 / 86784142 / -1.4% 119753573 / 119280232 / +0.4% 0.71 / 0.73 / -1.8%
tpcds_q29/datafusion:parquet 143909016 / 145820741 / -1.3% 171929158 / 175411233 / -2.0% 0.84 / 0.83 / +0.7%
tpcds_q30/datafusion:parquet 98414626 / 99608501 / -1.2% 117698164 / 120071149 / -2.0% 0.84 / 0.83 / +0.8%
tpcds_q31/datafusion:parquet 323483004 / 319058792 / +1.4% 346325156 / 344041143 / +0.7% 0.93 / 0.93 / +0.7%
tpcds_q32/datafusion:parquet 29786988 / 29399552 / +1.3% 44231580 / 43643939 / +1.3% 0.67 / 0.67 / -0.0%
tpcds_q33/datafusion:parquet 54087814 / 51971680 / +4.1% 76923519 / 76538194 / +0.5% 0.70 / 0.68 / +3.6%
tpcds_q34/datafusion:parquet 64038040 / 65511648 / -2.2% 85398843 / 85276600 / +0.1% 0.75 / 0.77 / -2.4%
tpcds_q35/datafusion:parquet 124873753 / 126922984 / -1.6% 151407782 / 150646646 / +0.5% 0.82 / 0.84 / -2.1%
tpcds_q36/datafusion:parquet 99310850 / 97863638 / +1.5% 124593353 / 126419427 / -1.4% 0.80 / 0.77 / +3.0%
tpcds_q37/datafusion:parquet 49990436 / 50046237 / -0.1% 63731468 / 65033749 / -2.0% 0.78 / 0.77 / +1.9%
tpcds_q38/datafusion:parquet 122998544 / 122147195 / +0.7% 146659023 / 145034869 / +1.1% 0.84 / 0.84 / -0.4%
tpcds_q39/datafusion:parquet 846686434 / 846526498 / +0.0% 862530662 / 859437879 / +0.4% 0.98 / 0.98 / -0.3%
tpcds_q40/datafusion:parquet 34956162 / 35936465 / -2.7% 55827121 / 54650564 / +2.2% 0.63 / 0.66 / -4.8%
tpcds_q41/datafusion:parquet 31800190 / 31200319 / +1.9% 42784425 / 42657926 / +0.3% 0.74 / 0.73 / +1.6%
tpcds_q42/datafusion:parquet 26223512 / 25952126 / +1.0% 44384965 / 43716014 / +1.5% 0.59 / 0.59 / -0.5%
tpcds_q43/datafusion:parquet 27686360 / 27372783 / +1.1% 49230212 / 46844617 / +5.1% 0.56 / 0.58 / -3.8%
tpcds_q44/datafusion:parquet 65880035 / 65006033 / +1.3% 88734689 / 87803178 / +1.1% 0.74 / 0.74 / +0.3%
tpcds_q45/datafusion:parquet 66654452 / 66536274 / +0.2% 87569292 / 87212845 / +0.4% 0.76 / 0.76 / -0.2%
tpcds_q46/datafusion:parquet 107831770 / 106805720 / +1.0% 149187127 / 153607976 / -2.9% 0.72 / 0.70 / +4.0%
tpcds_q47/datafusion:parquet 234884104 / 237808994 / -1.2% 280104015 / 273252482 / +2.5% 0.84 / 0.87 / -3.6%
tpcds_q48/datafusion:parquet 77534934 / 76955857 / +0.8% 112433497 / 105870247 / +6.2% 0.69 / 0.73 / -5.1%
tpcds_q49/datafusion:parquet 116413888 / 118898020 / -2.1% 165961612 / 170084458 / -2.4% 0.70 / 0.70 / +0.3%
tpcds_q50/datafusion:parquet 90721798 / 92705258 / -2.1% 120150509 / 120435148 / -0.2% 0.76 / 0.77 / -1.9%
tpcds_q51/datafusion:parquet 253788918 / 254091982 / -0.1% 283079581 / 289211985 / -2.1% 0.90 / 0.88 / +2.0%
tpcds_q52/datafusion:parquet 26496784 / 26889958 / -1.5% 46897145 / 45469536 / +3.1% 0.56 / 0.59 / -4.5%
tpcds_q53/datafusion:parquet 35914024 / 36382336 / -1.3% 58340802 / 57842390 / +0.9% 0.62 / 0.63 / -2.1%
tpcds_q54/datafusion:parquet 87906820 / 85254806 / +3.1% 108912659 / 109551589 / -0.6% 0.81 / 0.78 / +3.7%
tpcds_q55/datafusion:parquet 25703630 / 26510566 / -3.0% 47879453 / 46645823 / +2.6% 0.54 / 0.57 / -5.5%
tpcds_q56/datafusion:parquet 52913997 / 54094848 / -2.2% 72148378 / 77335323 / -6.7% 0.73 / 0.70 / +4.8%
tpcds_q57/datafusion:parquet 171934048 / 171894920 / +0.0% 198194370 / 193978047 / +2.2% 0.87 / 0.89 / -2.1%
tpcds_q58/datafusion:parquet 95761448 / 98465482 / -2.7% 125841265 / 125032548 / +0.6% 0.76 / 0.79 / -3.4%
tpcds_q59/datafusion:parquet 104456709 / 103659830 / +0.8% 130504807 / 130225505 / +0.2% 0.80 / 0.80 / +0.6%
tpcds_q60/datafusion:parquet 56663162 / 55741260 / +1.7% 77215026 / 78220449 / -1.3% 0.73 / 0.71 / +3.0%
tpcds_q61/datafusion:parquet 74524488 / 78001000 / -4.5% 98479287 / 106432779 / -7.5% 0.76 / 0.73 / +3.3%
tpcds_q62/datafusion:parquet 27662673 / 27762318 / -0.4% 44716328 / 44527940 / +0.4% 0.62 / 0.62 / -0.8%
tpcds_q63/datafusion:parquet 36322555 / 36196190 / +0.3% 61197596 / 58834211 / +4.0% 0.59 / 0.62 / -3.5%
tpcds_q64/datafusion:parquet 661565638 / 659557758 / +0.3% 738380483 / 742173662 / -0.5% 0.90 / 0.89 / +0.8%
tpcds_q65/datafusion:parquet 102369018 / 100715906 / +1.6% 133010625 / 133981634 / -0.7% 0.77 / 0.75 / +2.4%
tpcds_q66/datafusion:parquet 75587983 / 76575936 / -1.3% 101983505 / 104374000 / -2.3% 0.74 / 0.73 / +1.0%
tpcds_q67/datafusion:parquet 431521964 / 430912350 / +0.1% 497185353 / 500297658 / -0.6% 0.87 / 0.86 / +0.8%
tpcds_q68/datafusion:parquet 108068319 / 108700552 / -0.6% 154906395 / 156742031 / -1.2% 0.70 / 0.69 / +0.6%
tpcds_q69/datafusion:parquet 59963084 / 61003348 / -1.7% 78885270 / 84325988 / -6.5% 0.76 / 0.72 / +5.1%
tpcds_q70/datafusion:parquet 212491459 / 212975306 / -0.2% 243476613 / 246017700 / -1.0% 0.87 / 0.87 / +0.8%
tpcds_q71/datafusion:parquet 38531290 / 39083124 / -1.4% 63664146 / 64662143 / -1.5% 0.61 / 0.60 / +0.1%
tpcds_q72/datafusion:parquet 1802102478 / 1794732356 / +0.4% 1775973235 / 1806078341 / -1.7% 1.01 / 0.99 / +2.1%
tpcds_q73/datafusion:parquet 62387610 / 62856255 / -0.7% 88063882 / 84855052 / +3.8% 0.71 / 0.74 / -4.4%
tpcds_q74/datafusion:parquet 293904076 / 292768250 / +0.4% 330098483 / 331483495 / -0.4% 0.89 / 0.88 / +0.8%
tpcds_q75/datafusion:parquet 196378900 / 193794623 / +1.3% 234955864 / 239131737 / -1.7% 0.84 / 0.81 / +3.1%
tpcds_q76/datafusion:parquet 50164664 / 49958244 / +0.4% 78574107 / 78897199 / -0.4% 0.64 / 0.63 / +0.8%
tpcds_q77/datafusion:parquet 73104644 / 73280301 / -0.2% 102175080 / 98096657 / +4.2% 0.72 / 0.75 / -4.2%
tpcds_q78/datafusion:parquet 211684192 / 211119866 / +0.3% 271719989 / 273491694 / -0.6% 0.78 / 0.77 / +0.9%
tpcds_q79/datafusion:parquet 77822776 / 77375078 / +0.6% 113724860 / 112413871 / +1.2% 0.68 / 0.69 / -0.6%
tpcds_q80/datafusion:parquet 145369306 / 143104068 / +1.6% 192369449 / 191975662 / +0.2% 0.76 / 0.75 / +1.4%
tpcds_q81/datafusion:parquet 109361102 / 106756472 / +2.4% 133144533 / 129378123 / +2.9% 0.82 / 0.83 / -0.5%
tpcds_q82/datafusion:parquet 54969678 / 53582485 / +2.6% 73566511 / 70410662 / +4.5% 0.75 / 0.76 / -1.8%
tpcds_q83/datafusion:parquet 66356800 / 66630048 / -0.4% 83033283 / 85136032 / -2.5% 0.80 / 0.78 / +2.1%
tpcds_q84/datafusion:parquet 35327828 / 36220898 / -2.5% 49196573 / 49805351 / -1.2% 0.72 / 0.73 / -1.3%
tpcds_q85/datafusion:parquet 106136390 / 103848480 / +2.2% 131826385 / 129149354 / +2.1% 0.81 / 0.80 / +0.1%
tpcds_q86/datafusion:parquet 21947677 / 22112695 / -0.7% 38824673 / 39672664 / -2.1% 0.57 / 0.56 / +1.4%
tpcds_q87/datafusion:parquet 121797870 / 122470358 / -0.5% 142206896 / 148224625 / -4.1% 0.86 / 0.83 / +3.7%
tpcds_q88/datafusion:parquet 85377660 / 86047137 / -0.8% 102091045 / 108358632 / -5.8% 0.84 / 0.79 / +5.3%
tpcds_q89/datafusion:parquet 39967745 / 38401756 / +4.1% 64625093 / 64923770 / -0.5% 0.62 / 0.59 / +4.6%
tpcds_q90/datafusion:parquet 17749420 / 18100802 / -1.9% 33574722 / 32273520 / +4.0% 0.53 / 0.56 / -5.7%
tpcds_q91/datafusion:parquet 42810049 / 41738000 / +2.6% 59613775 / 57454843 / +3.8% 0.72 / 0.73 / -1.1%
tpcds_q92/datafusion:parquet 28633040 / 28604120 / +0.1% 46396216 / 47460689 / -2.2% 0.62 / 0.60 / +2.4%
tpcds_q93/datafusion:parquet 63276611 / 63722030 / -0.7% 88985109 / 87405909 / +1.8% 0.71 / 0.73 / -2.5%
tpcds_q94/datafusion:parquet 38280828 / 37847109 / +1.1% 57046945 / 58549059 / -2.6% 0.67 / 0.65 / +3.8%
tpcds_q95/datafusion:parquet 120995620 / 128012922 / -5.5% 152011995 / 149910916 / +1.4% 0.80 / 0.85 / -6.8%
tpcds_q96/datafusion:parquet 21362026 / 20691258 / +3.2% 35853302 / 36951345 / -3.0% 0.60 / 0.56 / +6.4%
tpcds_q97/datafusion:parquet 55494608 / 54645566 / +1.6% 83149659 / 80351616 / +3.5% 0.67 / 0.68 / -1.9%
tpcds_q98/datafusion:parquet 61311172 / 61965680 / -1.1% 85458901 / 83775704 / +2.0% 0.72 / 0.74 / -3.0%
tpcds_q99/datafusion:parquet 42675546 / 42461627 / +0.5% 57800081 / 57802802 / -0.0% 0.74 / 0.73 / +0.5%
duckdb / vortex-file-compressed / ns (0.994x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 33115520 / 32726779 / +1.2% 44862872 / 45377689 / -1.1% 0.74 / 0.72 / +2.3%
tpcds_q02/duckdb:vortex-file-compressed 30192774 / 30267290 / -0.2% 43877689 / 44087004 / -0.5% 0.69 / 0.69 / +0.2%
tpcds_q03/duckdb:vortex-file-compressed 13225133 / 13779130 / -4.0% 30089390 / 30718899 / -2.0% 0.44 / 0.45 / -2.0%
tpcds_q04/duckdb:vortex-file-compressed 129629056 / 130206338 / -0.4% 153483676 / 157201556 / -2.4% 0.84 / 0.83 / +2.0%
tpcds_q05/duckdb:vortex-file-compressed 54550748 / 53727511 / +1.5% 80981478 / 83478676 / -3.0% 0.67 / 0.64 / +4.7%
tpcds_q06/duckdb:vortex-file-compressed 58497092 / 58800986 / -0.5% 77665694 / 79094008 / -1.8% 0.75 / 0.74 / +1.3%
tpcds_q07/duckdb:vortex-file-compressed 30046582 / 31168844 / -3.6% 54548413 / 54099517 / +0.8% 0.55 / 0.58 / -4.4%
tpcds_q08/duckdb:vortex-file-compressed 31104090 / 31134683 / -0.1% 41927805 / 41772800 / +0.4% 0.74 / 0.75 / -0.5%
tpcds_q09/duckdb:vortex-file-compressed 57841090 / 55235330 / +4.7% 78608464 / 79107779 / -0.6% 0.74 / 0.70 / +5.4%
tpcds_q10/duckdb:vortex-file-compressed 39734039 / 39038430 / +1.8% 57703003 / 58236826 / -0.9% 0.69 / 0.67 / +2.7%
tpcds_q11/duckdb:vortex-file-compressed 95281156 / 96226126 / -1.0% 114392955 / 112266994 / +1.9% 0.83 / 0.86 / -2.8%
tpcds_q12/duckdb:vortex-file-compressed 17296040 / 17276975 / +0.1% 29694063 / 30254952 / -1.9% 0.58 / 0.57 / +2.0%
tpcds_q13/duckdb:vortex-file-compressed 37319660 / 38940578 / -4.2% 72065570 / 71103229 / +1.4% 0.52 / 0.55 / -5.4%
tpcds_q14/duckdb:vortex-file-compressed 120789344 / 119983268 / +0.7% 144814100 / 140641737 / +3.0% 0.83 / 0.85 / -2.2%
tpcds_q15/duckdb:vortex-file-compressed 58951491 / 60759281 / -3.0% 71341196 / 76171754 / -6.3% 0.83 / 0.80 / +3.6%
tpcds_q16/duckdb:vortex-file-compressed 34942920 / 34771337 / +0.5% 51889649 / 53890958 / -3.7% 0.67 / 0.65 / +4.4%
tpcds_q17/duckdb:vortex-file-compressed 57113819 / 57289182 / -0.3% 79064170 / 81955246 / -3.5% 0.72 / 0.70 / +3.3%
tpcds_q18/duckdb:vortex-file-compressed 83162674 / 82993345 / +0.2% 104068068 / 104424434 / -0.3% 0.80 / 0.79 / +0.5%
tpcds_q19/duckdb:vortex-file-compressed 44704851 / 43899722 / +1.8% 65059361 / 65276395 / -0.3% 0.69 / 0.67 / +2.2%
tpcds_q20/duckdb:vortex-file-compressed 21449562 / 21520304 / -0.3% 35915294 / 34931964 / +2.8% 0.60 / 0.62 / -3.1%
tpcds_q21/duckdb:vortex-file-compressed 28306360 / 28120830 / +0.7% 61190586 / 62004166 / -1.3% 0.46 / 0.45 / +2.0%
tpcds_q22/duckdb:vortex-file-compressed 164065096 / 165099230 / -0.6% 172926358 / 170541662 / +1.4% 0.95 / 0.97 / -2.0%
tpcds_q23/duckdb:vortex-file-compressed 183138930 / 185876490 / -1.5% 199688023 / 199673618 / +0.0% 0.92 / 0.93 / -1.5%
tpcds_q24/duckdb:vortex-file-compressed 52717954 / 52636914 / +0.2% 77298332 / 77254623 / +0.1% 0.68 / 0.68 / +0.1%
tpcds_q25/duckdb:vortex-file-compressed 52974916 / 53220034 / -0.5% 77500944 / 75302591 / +2.9% 0.68 / 0.71 / -3.3%
tpcds_q26/duckdb:vortex-file-compressed 26400264 / 26713063 / -1.2% 41716434 / 42934826 / -2.8% 0.63 / 0.62 / +1.7%
tpcds_q27/duckdb:vortex-file-compressed 31617042 / 32585874 / -3.0% 54007877 / 53424233 / +1.1% 0.59 / 0.61 / -4.0%
tpcds_q28/duckdb:vortex-file-compressed 41286242 / 41342696 / -0.1% 65109206 / 66089322 / -1.5% 0.63 / 0.63 / +1.4%
tpcds_q29/duckdb:vortex-file-compressed 51539408 / 51866994 / -0.6% 76019519 / 74066949 / +2.6% 0.68 / 0.70 / -3.2%
tpcds_q30/duckdb:vortex-file-compressed 38262954 / 37914817 / +0.9% 51828153 / 52960815 / -2.1% 0.74 / 0.72 / +3.1%
tpcds_q31/duckdb:vortex-file-compressed 37229893 / 37512062 / -0.8% 56351151 / 53392186 / +5.5% 0.66 / 0.70 / -6.0%
tpcds_q32/duckdb:vortex-file-compressed 14109126 / 13855892 / +1.8% 30015611 / 28855272 / +4.0% 0.47 / 0.48 / -2.1%
tpcds_q33/duckdb:vortex-file-compressed 34469803 / 33813963 / +1.9% 56930111 / 59046480 / -3.6% 0.61 / 0.57 / +5.7%
tpcds_q34/duckdb:vortex-file-compressed 23438464 / 22811725 / +2.7% 39685345 / 39776812 / -0.2% 0.59 / 0.57 / +3.0%
tpcds_q35/duckdb:vortex-file-compressed 66594366 / 66786588 / -0.3% 86548050 / 85242000 / +1.5% 0.77 / 0.78 / -1.8%
tpcds_q36/duckdb:vortex-file-compressed 28787955 / 29806828 / -3.4% 48972364 / 49308472 / -0.7% 0.59 / 0.60 / -2.8%
tpcds_q37/duckdb:vortex-file-compressed 24959444 / 25605208 / -2.5% 71332511 / 74457214 / -4.2% 0.35 / 0.34 / +1.7%
tpcds_q38/duckdb:vortex-file-compressed 59424704 / 62408870 / -4.8% 73819479 / 81156842 / -9.0% 0.81 / 0.77 / +4.7%
tpcds_q39/duckdb:vortex-file-compressed 54859036 / 56168904 / -2.3% 85733784 / 85127364 / +0.7% 0.64 / 0.66 / -3.0%
tpcds_q40/duckdb:vortex-file-compressed 18916284 / 19238372 / -1.7% 35645063 / 35099919 / +1.6% 0.53 / 0.55 / -3.2%
tpcds_q41/duckdb:vortex-file-compressed 16008212 / 18720698 / -14.5% 🟢 22538453 / 25500417 / -11.6% 🟢 0.71 / 0.73 / -3.3%
tpcds_q42/duckdb:vortex-file-compressed 14226244 / 14015144 / +1.5% 30296936 / 30966847 / -2.2% 0.47 / 0.45 / +3.8%
tpcds_q43/duckdb:vortex-file-compressed 19395281 / 19403602 / -0.0% 33989433 / 32011378 / +6.2% 0.57 / 0.61 / -5.9%
tpcds_q44/duckdb:vortex-file-compressed 28442226 / 28307018 / +0.5% 48979769 / 51668551 / -5.2% 0.58 / 0.55 / +6.0%
tpcds_q45/duckdb:vortex-file-compressed 46191878 / 46586273 / -0.8% 58870323 / 60370446 / -2.5% 0.78 / 0.77 / +1.7%
tpcds_q46/duckdb:vortex-file-compressed 51753017 / 51192653 / +1.1% 77879741 / 75043524 / +3.8% 0.66 / 0.68 / -2.6%
tpcds_q47/duckdb:vortex-file-compressed 81083070 / 80927444 / +0.2% 96980092 / 97094785 / -0.1% 0.84 / 0.83 / +0.3%
tpcds_q48/duckdb:vortex-file-compressed 52561618 / 53155386 / -1.1% 78223152 / 81823473 / -4.4% 0.67 / 0.65 / +3.4%
tpcds_q49/duckdb:vortex-file-compressed 39035146 / 37950044 / +2.9% 76472424 / 78847393 / -3.0% 0.51 / 0.48 / +6.1%
tpcds_q50/duckdb:vortex-file-compressed 31591366 / 32675461 / -3.3% 54678356 / 57051911 / -4.2% 0.58 / 0.57 / +0.9%
tpcds_q51/duckdb:vortex-file-compressed 205371204 / 204779876 / +0.3% 219127229 / 217736852 / +0.6% 0.94 / 0.94 / -0.3%
tpcds_q52/duckdb:vortex-file-compressed 15097306 / 15384257 / -1.9% 30901210 / 31876748 / -3.1% 0.49 / 0.48 / +1.2%
tpcds_q53/duckdb:vortex-file-compressed 22108054 / 22960290 / -3.7% 38446852 / 39000657 / -1.4% 0.58 / 0.59 / -2.3%
tpcds_q54/duckdb:vortex-file-compressed 44148750 / 44886930 / -1.6% 64962425 / 65481173 / -0.8% 0.68 / 0.69 / -0.9%
tpcds_q55/duckdb:vortex-file-compressed 14352328 / 14612501 / -1.8% 30515354 / 30570651 / -0.2% 0.47 / 0.48 / -1.6%
tpcds_q56/duckdb:vortex-file-compressed 32401151 / 32462078 / -0.2% 55267393 / 57717193 / -4.2% 0.59 / 0.56 / +4.2%
tpcds_q57/duckdb:vortex-file-compressed 74368487 / 64171452 / +15.9% 🔴 79339878 / 78496038 / +1.1% 0.94 / 0.82 / +14.7%
tpcds_q58/duckdb:vortex-file-compressed 37306712 / 37835588 / -1.4% 58412410 / 64016051 / -8.8% 0.64 / 0.59 / +8.1%
tpcds_q59/duckdb:vortex-file-compressed 53383882 / 53810956 / -0.8% 66294854 / 71107629 / -6.8% 0.81 / 0.76 / +6.4%
tpcds_q60/duckdb:vortex-file-compressed 34274824 / 35369636 / -3.1% 58739867 / 59793701 / -1.8% 0.58 / 0.59 / -1.4%
tpcds_q61/duckdb:vortex-file-compressed 34254712 / 34298255 / -0.1% 53836930 / 53069753 / +1.4% 0.64 / 0.65 / -1.6%
tpcds_q62/duckdb:vortex-file-compressed 15423962 / 14822514 / +4.1% 26337970 / 26421769 / -0.3% 0.59 / 0.56 / +4.4%
tpcds_q63/duckdb:vortex-file-compressed 21381642 / 20828409 / +2.7% 38432585 / 38114655 / +0.8% 0.56 / 0.55 / +1.8%
tpcds_q64/duckdb:vortex-file-compressed 118019692 / 118342334 / -0.3% 154780827 / 152181613 / +1.7% 0.76 / 0.78 / -1.9%
tpcds_q65/duckdb:vortex-file-compressed 46265426 / 51466061 / -10.1% 🟢 66524876 / 58907342 / +12.9% 🔴 0.70 / 0.87 / -20.4%
tpcds_q66/duckdb:vortex-file-compressed 40910884 / 40998564 / -0.2% 57923524 / 58858579 / -1.6% 0.71 / 0.70 / +1.4%
tpcds_q67/duckdb:vortex-file-compressed 273826779 / 277425812 / -1.3% 289327766 / 283678837 / +2.0% 0.95 / 0.98 / -3.2%
tpcds_q68/duckdb:vortex-file-compressed 44275938 / 44593714 / -0.7% 74476645 / 72079771 / +3.3% 0.59 / 0.62 / -3.9%
tpcds_q69/duckdb:vortex-file-compressed 37487932 / 38356528 / -2.3% 61685269 / 59755970 / +3.2% 0.61 / 0.64 / -5.3%
tpcds_q70/duckdb:vortex-file-compressed 25494944 / 25085070 / +1.6% 41332785 / 41516746 / -0.4% 0.62 / 0.60 / +2.1%
tpcds_q71/duckdb:vortex-file-compressed 27682307 / 27715436 / -0.1% 51124250 / 50902781 / +0.4% 0.54 / 0.54 / -0.6%
tpcds_q72/duckdb:vortex-file-compressed 136693347 / 135900823 / +0.6% 160481034 / 164226936 / -2.3% 0.85 / 0.83 / +2.9%
tpcds_q73/duckdb:vortex-file-compressed 19984392 / 20089200 / -0.5% 37307177 / 37315276 / -0.0% 0.54 / 0.54 / -0.5%
tpcds_q74/duckdb:vortex-file-compressed 83559294 / 82722980 / +1.0% 100771830 / 99629718 / +1.1% 0.83 / 0.83 / -0.1%
tpcds_q75/duckdb:vortex-file-compressed 112945766 / 111929736 / +0.9% 139741736 / 139908352 / -0.1% 0.81 / 0.80 / +1.0%
tpcds_q76/duckdb:vortex-file-compressed 28050724 / 27219565 / +3.1% 61206292 / 58492855 / +4.6% 0.46 / 0.47 / -1.5%
tpcds_q77/duckdb:vortex-file-compressed 35373232 / 36316546 / -2.6% 63798149 / 62103115 / +2.7% 0.55 / 0.58 / -5.2%
tpcds_q78/duckdb:vortex-file-compressed 134566488 / 137442428 / -2.1% 160942019 / 159793923 / +0.7% 0.84 / 0.86 / -2.8%
tpcds_q79/duckdb:vortex-file-compressed 38188788 / 37665982 / +1.4% 62974929 / 59874325 / +5.2% 0.61 / 0.63 / -3.6%
tpcds_q80/duckdb:vortex-file-compressed 57349822 / 57541290 / -0.3% 92106290 / 89399248 / +3.0% 0.62 / 0.64 / -3.3%
tpcds_q81/duckdb:vortex-file-compressed 57693022 / 57777750 / -0.1% 72600433 / 71231569 / +1.9% 0.79 / 0.81 / -2.0%
tpcds_q82/duckdb:vortex-file-compressed 26055879 / 26860434 / -3.0% 80976625 / 77804956 / +4.1% 0.32 / 0.35 / -6.8%
tpcds_q83/duckdb:vortex-file-compressed 21892446 / 21694036 / +0.9% 31738529 / 32263861 / -1.6% 0.69 / 0.67 / +2.6%
tpcds_q84/duckdb:vortex-file-compressed 13328728 / 13366814 / -0.3% 24497289 / 23226339 / +5.5% 0.54 / 0.58 / -5.5%
tpcds_q85/duckdb:vortex-file-compressed 35825765 / 36707151 / -2.4% 54562128 / 56348206 / -3.2% 0.66 / 0.65 / +0.8%
tpcds_q86/duckdb:vortex-file-compressed 16610375 / 16411782 / +1.2% 28866023 / 28182293 / +2.4% 0.58 / 0.58 / -1.2%
tpcds_q87/duckdb:vortex-file-compressed 78554608 / 75201770 / +4.5% 87612593 / 87749398 / -0.2% 0.90 / 0.86 / +4.6%
tpcds_q88/duckdb:vortex-file-compressed 37967912 / 37878092 / +0.2% 49082128 / 49979733 / -1.8% 0.77 / 0.76 / +2.1%
tpcds_q89/duckdb:vortex-file-compressed 24418956 / 24974289 / -2.2% 40196630 / 41888285 / -4.0% 0.61 / 0.60 / +1.9%
tpcds_q90/duckdb:vortex-file-compressed 9517521 / 9843474 / -3.3% 20674246 / 20353435 / +1.6% 0.46 / 0.48 / -4.8%
tpcds_q91/duckdb:vortex-file-compressed 19162686 / 19617013 / -2.3% 29940255 / 29081972 / +3.0% 0.64 / 0.67 / -5.1%
tpcds_q92/duckdb:vortex-file-compressed 13300193 / 13643566 / -2.5% 27899711 / 27682975 / +0.8% 0.48 / 0.49 / -3.3%
tpcds_q93/duckdb:vortex-file-compressed 25246856 / 25876894 / -2.4% 53087579 / 52613864 / +0.9% 0.48 / 0.49 / -3.3%
tpcds_q94/duckdb:vortex-file-compressed 32294214 / 32152022 / +0.4% 46513206 / 47204449 / -1.5% 0.69 / 0.68 / +1.9%
tpcds_q95/duckdb:vortex-file-compressed 95981881 / 97513786 / -1.6% 108878017 / 117615692 / -7.4% 0.88 / 0.83 / +6.3%
tpcds_q96/duckdb:vortex-file-compressed 11961170 / 11752061 / +1.8% 25271689 / 24570663 / +2.9% 0.47 / 0.48 / -1.0%
tpcds_q97/duckdb:vortex-file-compressed 60339758 / 62178961 / -3.0% 81811733 / 82766588 / -1.2% 0.74 / 0.75 / -1.8%
tpcds_q98/duckdb:vortex-file-compressed 26841004 / 26889542 / -0.2% 44449887 / 43917859 / +1.2% 0.60 / 0.61 / -1.4%
tpcds_q99/duckdb:vortex-file-compressed 25156718 / 26072871 / -3.5% 35375740 / 35980286 / -1.7% 0.71 / 0.72 / -1.9%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 43268735 / 43748750 / -1.1% 50206333 / 50433867 / -0.5% 0.86 / 0.87 / -0.6%
tpcds_q02/duckdb:parquet 39312800 / 39630168 / -0.8% 49409415 / 50715675 / -2.6% 0.80 / 0.78 / +1.8%
tpcds_q03/duckdb:parquet 25137932 / 25995732 / -3.3% 34808197 / 36796166 / -5.4% 0.72 / 0.71 / +2.2%
tpcds_q04/duckdb:parquet 205092061 / 203957459 / +0.6% 228908625 / 234181220 / -2.3% 0.90 / 0.87 / +2.9%
tpcds_q05/duckdb:parquet 69327733 / 68357342 / +1.4% 85357751 / 87464497 / -2.4% 0.81 / 0.78 / +3.9%
tpcds_q06/duckdb:parquet 74526915 / 75115975 / -0.8% 86844397 / 89166769 / -2.6% 0.86 / 0.84 / +1.9%
tpcds_q07/duckdb:parquet 62516872 / 62193874 / +0.5% 78250216 / 76707973 / +2.0% 0.80 / 0.81 / -1.5%
tpcds_q08/duckdb:parquet 37892086 / 38663366 / -2.0% 46645286 / 46394278 / +0.5% 0.81 / 0.83 / -2.5%
tpcds_q09/duckdb:parquet 86611693 / 87080988 / -0.5% 98902364 / 101981323 / -3.0% 0.88 / 0.85 / +2.6%
tpcds_q10/duckdb:parquet 52353056 / 52520572 / -0.3% 62033983 / 62695229 / -1.1% 0.84 / 0.84 / +0.7%
tpcds_q11/duckdb:parquet 159476035 / 159415788 / +0.0% 165408382 / 164104249 / +0.8% 0.96 / 0.97 / -0.8%
tpcds_q12/duckdb:parquet 40680018 / 40814548 / -0.3% 46335890 / 48941959 / -5.3% 0.88 / 0.83 / +5.3%
tpcds_q13/duckdb:parquet 71117565 / 69804706 / +1.9% 88208508 / 87793121 / +0.5% 0.81 / 0.80 / +1.4%
tpcds_q14/duckdb:parquet 188305612 / 185753765 / +1.4% 198242585 / 202864595 / -2.3% 0.95 / 0.92 / +3.7%
tpcds_q15/duckdb:parquet 60404984 / 60934452 / -0.9% 68901608 / 69050398 / -0.2% 0.88 / 0.88 / -0.7%
tpcds_q16/duckdb:parquet 37908339 / 37850674 / +0.2% 46728963 / 45839434 / +1.9% 0.81 / 0.83 / -1.8%
tpcds_q17/duckdb:parquet 83636060 / 84076050 / -0.5% 90605453 / 89860905 / +0.8% 0.92 / 0.94 / -1.3%
tpcds_q18/duckdb:parquet 87142378 / 87775860 / -0.7% 95952113 / 98136096 / -2.2% 0.91 / 0.89 / +1.5%
tpcds_q19/duckdb:parquet 49133620 / 47466565 / +3.5% 62565309 / 63007623 / -0.7% 0.79 / 0.75 / +4.2%
tpcds_q20/duckdb:parquet 41277132 / 42342882 / -2.5% 49230112 / 48573403 / +1.4% 0.84 / 0.87 / -3.8%
tpcds_q21/duckdb:parquet 24357762 / 23962194 / +1.7% 28957426 / 28440652 / +1.8% 0.84 / 0.84 / -0.2%
tpcds_q22/duckdb:parquet 163436724 / 166072912 / -1.6% 168402450 / 167098902 / +0.8% 0.97 / 0.99 / -2.3%
tpcds_q23/duckdb:parquet 183956316 / 188036546 / -2.2% 198404400 / 193148517 / +2.7% 0.93 / 0.97 / -4.8%
tpcds_q24/duckdb:parquet 72468234 / 71146241 / +1.9% 82129880 / 82487151 / -0.4% 0.88 / 0.86 / +2.3%
tpcds_q25/duckdb:parquet 49911309 / 51215258 / -2.5% 60717552 / 61288817 / -0.9% 0.82 / 0.84 / -1.6%
tpcds_q26/duckdb:parquet 42239495 / 42361802 / -0.3% 53308764 / 51343370 / +3.8% 0.79 / 0.83 / -4.0%
tpcds_q27/duckdb:parquet 58293348 / 57111037 / +2.1% 70923783 / 81608147 / -13.1% 🟢 0.82 / 0.70 / +17.4%
tpcds_q28/duckdb:parquet 92073326 / 93252698 / -1.3% 105786242 / 112178597 / -5.7% 0.87 / 0.83 / +4.7%
tpcds_q29/duckdb:parquet 83960244 / 83041768 / +1.1% 96955226 / 96583021 / +0.4% 0.87 / 0.86 / +0.7%
tpcds_q30/duckdb:parquet 72028690 / 72470468 / -0.6% 80422078 / 81148208 / -0.9% 0.90 / 0.89 / +0.3%
tpcds_q31/duckdb:parquet 98365800 / 98601462 / -0.2% 111124848 / 111465299 / -0.3% 0.89 / 0.88 / +0.1%
tpcds_q32/duckdb:parquet 18066714 / 18353748 / -1.6% 26889275 / 26590155 / +1.1% 0.67 / 0.69 / -2.7%
tpcds_q33/duckdb:parquet 62335700 / 62367010 / -0.1% 71114588 / 73989561 / -3.9% 0.88 / 0.84 / +4.0%
tpcds_q34/duckdb:parquet 32893640 / 33006494 / -0.3% 40809373 / 41889230 / -2.6% 0.81 / 0.79 / +2.3%
tpcds_q35/duckdb:parquet 76531030 / 77399391 / -1.1% 85388219 / 86087567 / -0.8% 0.90 / 0.90 / -0.3%
tpcds_q36/duckdb:parquet 98488529 / 99335950 / -0.9% 112079784 / 112263590 / -0.2% 0.88 / 0.88 / -0.7%
tpcds_q37/duckdb:parquet 41434553 / 41378236 / +0.1% 47317829 / 47554095 / -0.5% 0.88 / 0.87 / +0.6%
tpcds_q38/duckdb:parquet 77427994 / 76468258 / +1.3% 78469066 / 85294747 / -8.0% 0.99 / 0.90 / +10.1%
tpcds_q39/duckdb:parquet 61574368 / 61661639 / -0.1% 67712249 / 67797634 / -0.1% 0.91 / 0.91 / -0.0%
tpcds_q40/duckdb:parquet 27746875 / 27952642 / -0.7% 35670379 / 36118029 / -1.2% 0.78 / 0.77 / +0.5%
tpcds_q41/duckdb:parquet 19847098 / 20143537 / -1.5% 25975637 / 26266476 / -1.1% 0.76 / 0.77 / -0.4%
tpcds_q42/duckdb:parquet 26155224 / 26999602 / -3.1% 34990987 / 36451419 / -4.0% 0.75 / 0.74 / +0.9%
tpcds_q43/duckdb:parquet 27195794 / 28272378 / -3.8% 33657898 / 35793884 / -6.0% 0.81 / 0.79 / +2.3%
tpcds_q44/duckdb:parquet 60240067 / 60736375 / -0.8% 75815512 / 74562633 / +1.7% 0.79 / 0.81 / -2.5%
tpcds_q45/duckdb:parquet 61226410 / 60622120 / +1.0% 68336507 / 67027287 / +2.0% 0.90 / 0.90 / -0.9%
tpcds_q46/duckdb:parquet 73556934 / 72394963 / +1.6% 85519974 / 88023341 / -2.8% 0.86 / 0.82 / +4.6%
tpcds_q47/duckdb:parquet 90065106 / 90830810 / -0.8% 104199459 / 105146923 / -0.9% 0.86 / 0.86 / +0.1%
tpcds_q48/duckdb:parquet 66578556 / 67648746 / -1.6% 79355937 / 85359866 / -7.0% 0.84 / 0.79 / +5.9%
tpcds_q49/duckdb:parquet 68694864 / 67399774 / +1.9% 93549611 / 92020170 / +1.7% 0.73 / 0.73 / +0.3%
tpcds_q50/duckdb:parquet 41230236 / 45228659 / -8.8% 56112461 / 50910629 / +10.2% 🔴 0.73 / 0.89 / -17.3%
tpcds_q51/duckdb:parquet 218240966 / 217340788 / +0.4% 230705939 / 225257376 / +2.4% 0.95 / 0.96 / -2.0%
tpcds_q52/duckdb:parquet 26872106 / 26490668 / +1.4% 38404348 / 37218058 / +3.2% 0.70 / 0.71 / -1.7%
tpcds_q53/duckdb:parquet 34898365 / 34202255 / +2.0% 47181815 / 48232701 / -2.2% 0.74 / 0.71 / +4.3%
tpcds_q54/duckdb:parquet 56160954 / 55357348 / +1.5% 64469948 / 63307482 / +1.8% 0.87 / 0.87 / -0.4%
tpcds_q55/duckdb:parquet 27141511 / 26580602 / +2.1% 36926058 / 38734658 / -4.7% 0.74 / 0.69 / +7.1%
tpcds_q56/duckdb:parquet 69239057 / 68450543 / +1.2% 83984059 / 84208264 / -0.3% 0.82 / 0.81 / +1.4%
tpcds_q57/duckdb:parquet 68579030 / 67905272 / +1.0% 75466680 / 75530496 / -0.1% 0.91 / 0.90 / +1.1%
tpcds_q58/duckdb:parquet 55949808 / 55351262 / +1.1% 69988548 / 67300961 / +4.0% 0.80 / 0.82 / -2.8%
tpcds_q59/duckdb:parquet 61817932 / 61543058 / +0.4% 68453687 / 67498896 / +1.4% 0.90 / 0.91 / -1.0%
tpcds_q60/duckdb:parquet 84190298 / 81154691 / +3.7% 94695948 / 95719978 / -1.1% 0.89 / 0.85 / +4.9%
tpcds_q61/duckdb:parquet 79467230 / 78725636 / +0.9% 94006337 / 94693948 / -0.7% 0.85 / 0.83 / +1.7%
tpcds_q62/duckdb:parquet 19964580 / 21271646 / -6.1% 26359909 / 24742108 / +6.5% 0.76 / 0.86 / -11.9%
tpcds_q63/duckdb:parquet 33516573 / 33973322 / -1.3% 43532769 / 44293841 / -1.7% 0.77 / 0.77 / +0.4%
tpcds_q64/duckdb:parquet 136676004 / 134987804 / +1.3% 152843411 / 149714203 / +2.1% 0.89 / 0.90 / -0.8%
tpcds_q65/duckdb:parquet 93076462 / 92507762 / +0.6% 101380697 / 106732283 / -5.0% 0.92 / 0.87 / +5.9%
tpcds_q66/duckdb:parquet 49372038 / 45574203 / +8.3% 53337451 / 52408182 / +1.8% 0.93 / 0.87 / +6.4%
tpcds_q67/duckdb:parquet 293802614 / 294181831 / -0.1% 298902788 / 294225942 / +1.6% 0.98 / 1.00 / -1.7%
tpcds_q68/duckdb:parquet 61813573 / 61610444 / +0.3% 77368574 / 77643526 / -0.4% 0.80 / 0.79 / +0.7%
tpcds_q69/duckdb:parquet 66270776 / 65821270 / +0.7% 75030327 / 75369095 / -0.4% 0.88 / 0.87 / +1.1%
tpcds_q70/duckdb:parquet 42244437 / 42560156 / -0.7% 52013194 / 50824609 / +2.3% 0.81 / 0.84 / -3.0%
tpcds_q71/duckdb:parquet 41115024 / 41353862 / -0.6% 53888981 / 54241063 / -0.6% 0.76 / 0.76 / +0.1%
tpcds_q72/duckdb:parquet 173249133 / 172146606 / +0.6% 186861626 / 189350126 / -1.3% 0.93 / 0.91 / +2.0%
tpcds_q73/duckdb:parquet 27850026 / 27072398 / +2.9% 35167696 / 37030456 / -5.0% 0.79 / 0.73 / +8.3%
tpcds_q74/duckdb:parquet 214217558 / 216089249 / -0.9% 225178126 / 223017657 / +1.0% 0.95 / 0.97 / -1.8%
tpcds_q75/duckdb:parquet 132782401 / 131891024 / +0.7% 152909575 / 152249842 / +0.4% 0.87 / 0.87 / +0.2%
tpcds_q76/duckdb:parquet 50831850 / 51285484 / -0.9% 68715988 / 65205448 / +5.4% 0.74 / 0.79 / -5.9%
tpcds_q77/duckdb:parquet 56333534 / 54841040 / +2.7% 73074444 / 67440836 / +8.4% 0.77 / 0.81 / -5.2%
tpcds_q78/duckdb:parquet 156047354 / 155747874 / +0.2% 165078766 / 168363678 / -2.0% 0.95 / 0.93 / +2.2%
tpcds_q79/duckdb:parquet 52078572 / 51430181 / +1.3% 65570097 / 64568583 / +1.6% 0.79 / 0.80 / -0.3%
tpcds_q80/duckdb:parquet 83375631 / 82941310 / +0.5% 102724652 / 103690804 / -0.9% 0.81 / 0.80 / +1.5%
tpcds_q81/duckdb:parquet 97492653 / 98572923 / -1.1% 106444941 / 104274293 / +2.1% 0.92 / 0.95 / -3.1%
tpcds_q82/duckdb:parquet 45366780 / 46604344 / -2.7% 51455559 / 52315928 / -1.6% 0.88 / 0.89 / -1.0%
tpcds_q83/duckdb:parquet 28097805 / 28152398 / -0.2% 33488707 / 33185714 / +0.9% 0.84 / 0.85 / -1.1%
tpcds_q84/duckdb:parquet 22659758 / 22751552 / -0.4% 29096007 / 29406408 / -1.1% 0.78 / 0.77 / +0.7%
tpcds_q85/duckdb:parquet 50712400 / 52752074 / -3.9% 61604154 / 62960389 / -2.2% 0.82 / 0.84 / -1.8%
tpcds_q86/duckdb:parquet 25712476 / 25146913 / +2.2% 32402050 / 33004413 / -1.8% 0.79 / 0.76 / +4.1%
tpcds_q87/duckdb:parquet 86937916 / 88695797 / -2.0% 95627494 / 92564858 / +3.3% 0.91 / 0.96 / -5.1%
tpcds_q88/duckdb:parquet 103983510 / 106796080 / -2.6% 112310183 / 111229279 / +1.0% 0.93 / 0.96 / -3.6%
tpcds_q89/duckdb:parquet 37070063 / 37846748 / -2.1% 49709625 / 48196620 / +3.1% 0.75 / 0.79 / -5.0%
tpcds_q90/duckdb:parquet 15743685 / 15015242 / +4.9% 19661615 / 20928242 / -6.1% 0.80 / 0.72 / +11.6%
tpcds_q91/duckdb:parquet 25532134 / 25515043 / +0.1% 32812995 / 33274247 / -1.4% 0.78 / 0.77 / +1.5%
tpcds_q92/duckdb:parquet 23307223 / 22329364 / +4.4% 30712669 / 31995562 / -4.0% 0.76 / 0.70 / +8.7%
tpcds_q93/duckdb:parquet 36861360 / 35799040 / +3.0% 50961007 / 49479404 / +3.0% 0.72 / 0.72 / -0.0%
tpcds_q94/duckdb:parquet 39078021 / 38247234 / +2.2% 44312336 / 46965479 / -5.6% 0.88 / 0.81 / +8.3%
tpcds_q95/duckdb:parquet 81903340 / 81409130 / +0.6% 86005717 / 86595751 / -0.7% 0.95 / 0.94 / +1.3%
tpcds_q96/duckdb:parquet 16905654 / 17012262 / -0.6% 22062591 / 24425947 / -9.7% 0.77 / 0.70 / +10.0%
tpcds_q97/duckdb:parquet 68504466 / 73153984 / -6.4% 83918185 / 78153554 / +7.4% 0.82 / 0.94 / -12.8%
tpcds_q98/duckdb:parquet 53932976 / 55289756 / -2.5% 67666540 / 66788134 / +1.3% 0.80 / 0.83 / -3.7%
tpcds_q99/duckdb:parquet 24397211 / 24402862 / -0.0% 33095474 / 30438057 / +8.7% 0.74 / 0.80 / -8.1%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant