Skip to content

Preserve pruned V2 file groups without collapsing unpruned scans - #11345

Draft
joseph-isaacs wants to merge 2 commits into
ji/clickbench-v2-20261109-08-df-prune-before-partitionfrom
ji/clickbench-v2-20261109-09-df-whole-files
Draft

joseph-isaacs wants to merge 2 commits into
ji/clickbench-v2-20261109-08-df-prune-before-partitionfrom
ji/clickbench-v2-20261109-09-df-whole-files

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Held draft: the narrowed policy still increases focused ClickBench process CPU by 22.97%. The latency gains do not clear that cost or the remaining full-suite observations.

Summary

When eligible static pruning actually excludes an input and fewer file entries remain than the target partition count, keep each retained entry in a separate scan group without further splitting its existing range. Scans that retain every input use DataFusion's ordinary partitioner. This narrows the earlier policy, which also reduced grouping when a static predicate could not exclude anything.

Depends on #11344. Grouping after actual pruning can still limit scan and downstream parallelism; the CPU hold remains.

Changes

  • Apply the grouping decision only after actual exclusion, including a matching earlier pruning pass on the same inputs.
  • Preserve that history across optimizer passes only for the same object store and ordered object/range sequence. Added filters clear the updated source's history. Returning a pruned configuration does not mutate the original source.
  • Preserve existing ranges, empty scans and row coverage through repeated repartitioning and target-partition threshold changes. Add regression coverage for no-exclusion scans and history invalidation.

Local candidate evidence and hold

Measured local candidate 58c7b519fd4c54a31b3133973108cbeca6a48ff3 (tree 5c239cd927f012509270c5af3629bfb18df28e59) against exact s08 parent 3d81b7b8e2b48752de3332c4283aa0e6089500fc:

ClickBench query Parent median (ms) Candidate median (ms) Paired latency reduction Pointwise 99% interval
Q36 14.5298 10.7248 26.29% 25.86–26.78%
Q37 7.3202 5.0462 31.24% 30.36–32.07%
Q39 29.9919 21.4818 28.44% 28.21–28.74%
Q42 4.4074 3.8899 11.79% 11.40–12.23%

Query IDs are zero-based. These are paired effects from process warm medians; displayed time medians need not have exactly that ratio. All four pass the prespecified >1% statistical threshold. They do not override the hold.

For the selected ClickBench process workload, user+system CPU increases 22.97% (pointwise 99% interval 22.35–23.57%), passing the corrected CPU regression threshold. Peak RSS increases 12.99%, descriptively. CPU and RSS include process setup and all selected queries/iterations; they are not per-query or Vortex-only measurements.

The focused run completed 96 serial processes across TPC-H SF10 Q3/Q13, FineWeb Q0/Q4 and the four ClickBench queries: 12 balanced adjacent primary pairs plus four identical-candidate A/A pairs per suite, 31 iterations/query, first six discarded. All observations are retained. Paired-log bootstrap intervals are pointwise; exact >1% sign tests use Holm 1% correction across 16 latency directions and a separate six-direction CPU family. Ordinary local V2 reads use 32 workers/partitions and no mmap. DataFusion 55.2 keeps enable_topk_aggregation=true. The fixtures are the full 100-file partitioned ClickBench dataset, TPC-H SF10, and the existing 1,048,576-row FineWeb sample.

Q37's identical-candidate A/A control shows 1.05% apparent reduction (99% interval 0.52–1.59%), indicating drift or chance imbalance. No control is subtracted. Four A/A pairs provide limited calibration and do not establish equivalence. TPC-H/FineWeb's earlier large penalties were not reproduced in these selected local comparisons; the current small differences remain inconclusive.

The separate full43 screen completed 12/12 processes: four balanced parent/candidate pairs and two identical-candidate A/A pairs, 10 iterations/query with the first three discarded. Sum of query warm medians changed −0.04%, whole-process CPU +0.03%, and process wall time −0.22%, descriptively. This workload composition does not overturn the focused CPU or RSS cost, and the screen establishes neither equivalence nor a general no-regression claim.

The earlier Q12/Q25/Q27 median penalties were not reproduced at their prior magnitude: −0.07% / +0.09% / +0.11%. Remaining observations are retained for follow-up before landing:

  • Q20: median +2.52%, mean +2.07%, adverse in three of four pairs. Controls are smaller; dismissing this as noise is not justified.
  • Q30: median +1.17%, mean +0.68%, adverse in three of four pairs; a weaker watchpoint.
  • Q25: mean +0.85%, adverse in all four pairs despite its near-flat median.

These are unconfirmed screen signals, not additional confirmed regressions. No extra query gains were promoted from the screen.

Validation and publication status

  • 39 targeted tests passed. Four new no-exclusion cases fail on the original s09 policy and pass on this candidate.
  • 47 result comparisons passed: all 43 ClickBench queries and two TPC-H queries against Parquet references using the recorded semantic rules; two FineWeb queries agree with the parent.
  • Both benchmark packages were built together from the clean candidate with the same locked build command, feature union, native flags and compiler as s08. Scoped Rust formatting and patch whitespace checks passed; workspace-wide clippy was not run.

Published source commit: aea8f377061e38ef47b58b99726a318f80416fa0. Its complete tree matches the measured local candidate above. The remote parent is the previously published s09 commit a112c0edb4125646e68b683a6101db6046c3eb7c; the PR still targets s08 (768b49f9fe012ae9ef8e7ca72d6ea2cbff335c15). Full source-tree equality, ordered parent, raw Git object, unchanged message and author/committer sign-offs were verified. GitHub regenerated metadata, so the local compiled commit and executable hash remain the measurement identity.

Repository SQL benchmarks for this revised source are running on the published head. The build completed; eight benchmark suites are queued as of 2026-11-09 14:20:37 UTC. Completed SQL comments for the previous a112c0ed... head used suite-specific historical develop baselines; those results are historical evidence, not validation of the revised source. Local measurements above compare the exact s08 dependency source. CI status is separate.

Let V2 parallelize chunks within each surviving file instead of repeating setup and dictionary decoding across tiny byte ranges. This includes filtered scans with unknown statistics. Keep the scheduling policy separate from early pruning because lower latency can trade against higher total CPU.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-08-df-prune-before-partition to develop November 9, 2026 12:00
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-08-df-prune-before-partition November 9, 2026 12:00
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done aea8f37 clickbench-nvme 1 Explore Profiling Data
🟢 Done aea8f37 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done aea8f37 fineweb 1 Explore Profiling Data
🟢 Done aea8f37 tpch-nvme-10 1 Explore Profiling Data
🟢 Done aea8f37 polarsignals 1 Explore Profiling Data
🟢 Done aea8f37 tpch-s3 1 Explore Profiling Data
🟢 Done aea8f37 tpch-nvme 1 Explore Profiling Data
🟢 Done aea8f37 tpcds-nvme 1 Explore Profiling Data
Previous Runs (8)
Status Commit Job Attempt Link
🟢 Done a112c0e tpch-nvme 2 Explore Profiling Data
🟢 Done a112c0e tpcds-nvme 2 Explore Profiling Data
🟢 Done a112c0e fineweb 1 Explore Profiling Data
🟢 Done a112c0e tpcds-nvme-10 1 Explore Profiling Data
🟢 Done a112c0e clickbench-nvme 1 Explore Profiling Data
🟢 Done a112c0e polarsignals 1 Explore Profiling Data
🟢 Done a112c0e tpch-s3 1 Explore Profiling Data
🟢 Done a112c0e tpch-nvme-10 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR aea8f377 vs base b2f8d0f9
Vortex (geomean): hot 1.055x ➖ · cold 0.931x ➖


datafusion / vortex-file-compressed / ns (1.055x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44501474 / 44247398 / +0.6% 84204395 / 86756764 / -2.9% 0.53 / 0.51 / +3.6%
polarsignals_q01/datafusion:vortex-file-compressed 86527277 / 53190033 / +62.7% 🔴 108437141 / 111620562 / -2.9% 0.80 / 0.48 / +67.5%
polarsignals_q02/datafusion:vortex-file-compressed 11967984 / 14308001 / -16.4% 🟢 44256996 / 50938846 / -13.1% 🟢 0.27 / 0.28 / -3.7%
polarsignals_q03/datafusion:vortex-file-compressed 69822342 / 69231543 / +0.9% 110984177 / 116022576 / -4.3% 0.63 / 0.60 / +5.4%
polarsignals_q04/datafusion:vortex-file-compressed 9238918 / 9324230 / -0.9% 37844937 / 43390473 / -12.8% 🟢 0.24 / 0.21 / +13.6%
polarsignals_q05/datafusion:vortex-file-compressed 11477768 / 11645938 / -1.4% 42218737 / 46740242 / -9.7% 0.27 / 0.25 / +9.1%
polarsignals_q06/datafusion:vortex-file-compressed 23053039 / 22759316 / +1.3% 52552419 / 56616878 / -7.2% 0.44 / 0.40 / +9.1%
polarsignals_q07/datafusion:vortex-file-compressed 10453832 / 10826504 / -3.4% 41171317 / 45422058 / -9.4% 0.25 / 0.24 / +6.5%
polarsignals_q08/datafusion:vortex-file-compressed 102653030 / 96763190 / +6.1% 154292465 / 161828007 / -4.7% 0.67 / 0.60 / +11.3%
polarsignals_q09/datafusion:vortex-file-compressed 9916813 / 9924556 / -0.1% 39145587 / 41195204 / -5.0% 0.25 / 0.24 / +5.2%
polarsignals_q10/datafusion:vortex-file-compressed 71335805 / 55401320 / +28.8% 🔴 112709035 / 116674031 / -3.4% 0.63 / 0.47 / +33.3%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR aea8f377 vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.034x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.012x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91101085 / 92177346 / -1.2% 153676624 / 156197099 / -1.6% 0.59 / 0.59 / +0.5%
tpch_q02/datafusion:vortex-file-compressed 64821131 / 64428754 / +0.6% 100012884 / 94872596 / +5.4% 0.65 / 0.68 / -4.6%
tpch_q03/datafusion:vortex-file-compressed 63120344 / 64151894 / -1.6% 125280163 / 126780702 / -1.2% 0.50 / 0.51 / -0.4%
tpch_q04/datafusion:vortex-file-compressed 34127810 / 35028676 / -2.6% 75962805 / 68466710 / +10.9% 🔴 0.45 / 0.51 / -12.2%
tpch_q05/datafusion:vortex-file-compressed 118110961 / 118900162 / -0.7% 197051644 / 185439522 / +6.3% 0.60 / 0.64 / -6.5%
tpch_q06/datafusion:vortex-file-compressed 9609565 / 9649196 / -0.4% 56584718 / 57652551 / -1.9% 0.17 / 0.17 / +1.5%
tpch_q07/datafusion:vortex-file-compressed 96213487 / 97449767 / -1.3% 166022734 / 161011516 / +3.1% 0.58 / 0.61 / -4.2%
tpch_q08/datafusion:vortex-file-compressed 139987457 / 142206475 / -1.6% 216441014 / 226695985 / -4.5% 0.65 / 0.63 / +3.1%
tpch_q09/datafusion:vortex-file-compressed 184942680 / 182840408 / +1.1% 275159279 / 275147335 / +0.0% 0.67 / 0.66 / +1.1%
tpch_q10/datafusion:vortex-file-compressed 70183777 / 70621645 / -0.6% 139123362 / 136262721 / +2.1% 0.50 / 0.52 / -2.7%
tpch_q11/datafusion:vortex-file-compressed 45514707 / 45658051 / -0.3% 73630972 / 72364105 / +1.8% 0.62 / 0.63 / -2.0%
tpch_q12/datafusion:vortex-file-compressed 35475766 / 35235879 / +0.7% 85791429 / 79705799 / +7.6% 0.41 / 0.44 / -6.5%
tpch_q13/datafusion:vortex-file-compressed 49969264 / 48598467 / +2.8% 85856216 / 87210304 / -1.6% 0.58 / 0.56 / +4.4%
tpch_q14/datafusion:vortex-file-compressed 19881919 / 20650370 / -3.7% 85411878 / 88048054 / -3.0% 0.23 / 0.23 / -0.7%
tpch_q15/datafusion:vortex-file-compressed 32627049 / 33753614 / -3.3% 91356454 / 90785220 / +0.6% 0.36 / 0.37 / -3.9%
tpch_q16/datafusion:vortex-file-compressed 37342030 / 36919743 / +1.1% 68982910 / 65843812 / +4.8% 0.54 / 0.56 / -3.5%
tpch_q17/datafusion:vortex-file-compressed 177568602 / 176998771 / +0.3% 251965078 / 239755261 / +5.1% 0.70 / 0.74 / -4.5%
tpch_q18/datafusion:vortex-file-compressed 206239484 / 207996354 / -0.8% 279662100 / 275106107 / +1.7% 0.74 / 0.76 / -2.5%
tpch_q19/datafusion:vortex-file-compressed 29037748 / 28526869 / +1.8% 88545939 / 87666580 / +1.0% 0.33 / 0.33 / +0.8%
tpch_q20/datafusion:vortex-file-compressed 61681734 / 61936223 / -0.4% 118332372 / 118852369 / -0.4% 0.52 / 0.52 / +0.0%
tpch_q21/datafusion:vortex-file-compressed 180073935 / 182704046 / -1.4% 234159323 / 234984863 / -0.4% 0.77 / 0.78 / -1.1%
tpch_q22/datafusion:vortex-file-compressed 25401737 / 25513774 / -0.4% 55274210 / 55406439 / -0.2% 0.46 / 0.46 / -0.2%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87625628 / 87311538 / +0.4% 127461434 / 122516163 / +4.0% 0.69 / 0.71 / -3.5%
tpch_q02/datafusion:parquet 173074884 / 174735537 / -1.0% 201087013 / 198265824 / +1.4% 0.86 / 0.88 / -2.3%
tpch_q03/datafusion:parquet 136212696 / 135233090 / +0.7% 184284708 / 179364012 / +2.7% 0.74 / 0.75 / -2.0%
tpch_q04/datafusion:parquet 57195068 / 56985913 / +0.4% 91426153 / 85885070 / +6.5% 0.63 / 0.66 / -5.7%
tpch_q05/datafusion:parquet 167735259 / 166291221 / +0.9% 216664734 / 214896169 / +0.8% 0.77 / 0.77 / +0.0%
tpch_q06/datafusion:parquet 36313050 / 36510562 / -0.5% 75492169 / 72908306 / +3.5% 0.48 / 0.50 / -3.9%
tpch_q07/datafusion:parquet 216846500 / 215778947 / +0.5% 270729503 / 260314182 / +4.0% 0.80 / 0.83 / -3.4%
tpch_q08/datafusion:parquet 217292216 / 216791369 / +0.2% 285087667 / 278971702 / +2.2% 0.76 / 0.78 / -1.9%
tpch_q09/datafusion:parquet 308678583 / 307685989 / +0.3% 376070100 / 369588127 / +1.8% 0.82 / 0.83 / -1.4%
tpch_q10/datafusion:parquet 312414831 / 311954014 / +0.1% 374383049 / 359417304 / +4.2% 0.83 / 0.87 / -3.9%
tpch_q11/datafusion:parquet 126705018 / 127035714 / -0.3% 150478836 / 149936598 / +0.4% 0.84 / 0.85 / -0.6%
tpch_q12/datafusion:parquet 82224073 / 82433202 / -0.3% 120710141 / 116835758 / +3.3% 0.68 / 0.71 / -3.5%
tpch_q13/datafusion:parquet 210527425 / 210618688 / -0.0% 242374490 / 238788117 / +1.5% 0.87 / 0.88 / -1.5%
tpch_q14/datafusion:parquet 86117750 / 85602024 / +0.6% 187307422 / 186569859 / +0.4% 0.46 / 0.46 / +0.2%
tpch_q15/datafusion:parquet 105401839 / 106606603 / -1.1% 152945571 / 154598932 / -1.1% 0.69 / 0.69 / -0.1%
tpch_q16/datafusion:parquet 94732750 / 94683007 / +0.1% 120545484 / 123221265 / -2.2% 0.79 / 0.77 / +2.3%
tpch_q17/datafusion:parquet 214811821 / 215630850 / -0.4% 261808420 / 257798988 / +1.6% 0.82 / 0.84 / -1.9%
tpch_q18/datafusion:parquet 266681107 / 267541314 / -0.3% 315185228 / 318452912 / -1.0% 0.85 / 0.84 / +0.7%
tpch_q19/datafusion:parquet 108764137 / 108282497 / +0.4% 166672784 / 164045798 / +1.6% 0.65 / 0.66 / -1.1%
tpch_q20/datafusion:parquet 186715529 / 185298197 / +0.8% 251725292 / 237189433 / +6.1% 0.74 / 0.78 / -5.1%
tpch_q21/datafusion:parquet 241839337 / 244268713 / -1.0% 305203143 / 306493573 / -0.4% 0.79 / 0.80 / -0.6%
tpch_q22/datafusion:parquet 150289000 / 149723897 / +0.4% 174936149 / 171986203 / +1.7% 0.86 / 0.87 / -1.3%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33053755 / 33162813 / -0.3% 70945078 / 60965941 / +16.4% 🔴 0.47 / 0.54 / -14.3%
tpch_q02/duckdb:vortex-file-compressed 28823411 / 28441284 / +1.3% 43262026 / 42490796 / +1.8% 0.67 / 0.67 / -0.5%
tpch_q03/duckdb:vortex-file-compressed 51698190 / 51806352 / -0.2% 105462477 / 96181102 / +9.6% 0.49 / 0.54 / -9.0%
tpch_q04/duckdb:vortex-file-compressed 51201739 / 51520893 / -0.6% 92608524 / 83080389 / +11.5% 🔴 0.55 / 0.62 / -10.8%
tpch_q05/duckdb:vortex-file-compressed 68723457 / 68278233 / +0.7% 112774864 / 110549285 / +2.0% 0.61 / 0.62 / -1.3%
tpch_q06/duckdb:vortex-file-compressed 15062921 / 14995905 / +0.4% 52328875 / 49678736 / +5.3% 0.29 / 0.30 / -4.6%
tpch_q07/duckdb:vortex-file-compressed 54540487 / 55095502 / -1.0% 110002697 / 99927713 / +10.1% 🔴 0.50 / 0.55 / -10.1%
tpch_q08/duckdb:vortex-file-compressed 83846164 / 84730600 / -1.0% 133215592 / 128300677 / +3.8% 0.63 / 0.66 / -4.7%
tpch_q09/duckdb:vortex-file-compressed 102972418 / 102680463 / +0.3% 157378687 / 149752209 / +5.1% 0.65 / 0.69 / -4.6%
tpch_q10/duckdb:vortex-file-compressed 95348077 / 95736829 / -0.4% 154470962 / 145772381 / +6.0% 0.62 / 0.66 / -6.0%
tpch_q11/duckdb:vortex-file-compressed 13209186 / 13161487 / +0.4% 27853558 / 28614710 / -2.7% 0.47 / 0.46 / +3.1%
tpch_q12/duckdb:vortex-file-compressed 45039313 / 45171630 / -0.3% 83680349 / 74559415 / +12.2% 🔴 0.54 / 0.61 / -11.2%
tpch_q13/duckdb:vortex-file-compressed 73154283 / 71277113 / +2.6% 100497616 / 98751212 / +1.8% 0.73 / 0.72 / +0.9%
tpch_q14/duckdb:vortex-file-compressed 28248002 / 27742167 / +1.8% 75032792 / 68588058 / +9.4% 0.38 / 0.40 / -6.9%
tpch_q15/duckdb:vortex-file-compressed 23651976 / 24169914 / -2.1% 63422480 / 62760479 / +1.1% 0.37 / 0.39 / -3.2%
tpch_q16/duckdb:vortex-file-compressed 49777787 / 49823920 / -0.1% 60780785 / 58191998 / +4.4% 0.82 / 0.86 / -4.3%
tpch_q17/duckdb:vortex-file-compressed 35155375 / 34928738 / +0.6% 67976302 / 64550565 / +5.3% 0.52 / 0.54 / -4.4%
tpch_q18/duckdb:vortex-file-compressed 108753625 / 102866087 / +5.7% 119662177 / 121696816 / -1.7% 0.91 / 0.85 / +7.5%
tpch_q19/duckdb:vortex-file-compressed 26846544 / 27489534 / -2.3% 74463821 / 76106199 / -2.2% 0.36 / 0.36 / -0.2%
tpch_q20/duckdb:vortex-file-compressed 41438975 / 41385355 / +0.1% 97082421 / 88937430 / +9.2% 0.43 / 0.47 / -8.3%
tpch_q21/duckdb:vortex-file-compressed 93478285 / 92643489 / +0.9% 150036740 / 140692444 / +6.6% 0.62 / 0.66 / -5.4%
tpch_q22/duckdb:vortex-file-compressed 33267026 / 33019958 / +0.7% 49529209 / 47168881 / +5.0% 0.67 / 0.70 / -4.1%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67818400 / 68061708 / -0.4% 87987822 / 88188170 / -0.2% 0.77 / 0.77 / -0.1%
tpch_q02/duckdb:parquet 86855106 / 87254980 / -0.5% 98082446 / 98880371 / -0.8% 0.89 / 0.88 / +0.4%
tpch_q03/duckdb:parquet 109437366 / 110221645 / -0.7% 142549562 / 141238280 / +0.9% 0.77 / 0.78 / -1.6%
tpch_q04/duckdb:parquet 76430251 / 76532636 / -0.1% 97705513 / 97762896 / -0.1% 0.78 / 0.78 / -0.1%
tpch_q05/duckdb:parquet 122290442 / 123479542 / -1.0% 153798598 / 155668079 / -1.2% 0.80 / 0.79 / +0.2%
tpch_q06/duckdb:parquet 35202791 / 35931981 / -2.0% 60918555 / 56977323 / +6.9% 0.58 / 0.63 / -8.4%
tpch_q07/duckdb:parquet 118494292 / 119339250 / -0.7% 154739671 / 153627189 / +0.7% 0.77 / 0.78 / -1.4%
tpch_q08/duckdb:parquet 148094217 / 147255450 / +0.6% 190057869 / 190628929 / -0.3% 0.78 / 0.77 / +0.9%
tpch_q09/duckdb:parquet 237447819 / 235578554 / +0.8% 279176217 / 276803702 / +0.9% 0.85 / 0.85 / -0.1%
tpch_q10/duckdb:parquet 312875093 / 313587478 / -0.2% 341445332 / 337403692 / +1.2% 0.92 / 0.93 / -1.4%
tpch_q11/duckdb:parquet 43761449 / 43490479 / +0.6% 50680978 / 50005616 / +1.4% 0.86 / 0.87 / -0.7%
tpch_q12/duckdb:parquet 70167516 / 70505417 / -0.5% 90945802 / 90007679 / +1.0% 0.77 / 0.78 / -1.5%
tpch_q13/duckdb:parquet 293858952 / 293441858 / +0.1% 310605555 / 310736944 / -0.0% 0.95 / 0.94 / +0.2%
tpch_q14/duckdb:parquet 101431642 / 101133653 / +0.3% 135671058 / 136327535 / -0.5% 0.75 / 0.74 / +0.8%
tpch_q15/duckdb:parquet 56848480 / 57306184 / -0.8% 84514563 / 84972419 / -0.5% 0.67 / 0.67 / -0.3%
tpch_q16/duckdb:parquet 101174506 / 100633707 / +0.5% 108844928 / 107203047 / +1.5% 0.93 / 0.94 / -1.0%
tpch_q17/duckdb:parquet 82408565 / 83962666 / -1.9% 111395973 / 110031995 / +1.2% 0.74 / 0.76 / -3.1%
tpch_q18/duckdb:parquet 155275530 / 157083225 / -1.2% 170703743 / 172862922 / -1.2% 0.91 / 0.91 / +0.1%
tpch_q19/duckdb:parquet 96588217 / 98792583 / -2.2% 125077106 / 130377546 / -4.1% 0.77 / 0.76 / +1.9%
tpch_q20/duckdb:parquet 146914146 / 146971997 / -0.0% 184276449 / 181619680 / +1.5% 0.80 / 0.81 / -1.5%
tpch_q21/duckdb:parquet 255981038 / 254756250 / +0.5% 278497084 / 271034790 / +2.8% 0.92 / 0.94 / -2.2%
tpch_q22/duckdb:parquet 168956140 / 168406469 / +0.3% 180335339 / 179252698 / +0.6% 0.94 / 0.94 / -0.3%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR aea8f377 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.6%
Engines: DataFusion No clear signal (-6.6%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.958x ➖ · cold 0.974x ➖
Parquet (geomean): hot 0.994x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.927x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1251526 / 1277762 / -2.1% 24156532 / 22701905 / +6.4% 0.05 / 0.06 / -8.0%
clickbench_q01/datafusion:vortex-file-compressed 5781287 / 5701054 / +1.4% 30858834 / 34133473 / -9.6% 0.19 / 0.17 / +12.2%
clickbench_q02/datafusion:vortex-file-compressed 10668828 / 11059978 / -3.5% 43299888 / 45727346 / -5.3% 0.25 / 0.24 / +1.9%
clickbench_q03/datafusion:vortex-file-compressed 13169702 / 12962152 / +1.6% 55830793 / 59966511 / -6.9% 0.24 / 0.22 / +9.1%
clickbench_q04/datafusion:vortex-file-compressed 58768831 / 58491492 / +0.5% 103057631 / 107265399 / -3.9% 0.57 / 0.55 / +4.6%
clickbench_q05/datafusion:vortex-file-compressed 76437562 / 75324188 / +1.5% 127299020 / 127176489 / +0.1% 0.60 / 0.59 / +1.4%
clickbench_q06/datafusion:vortex-file-compressed 1255936 / 1281209 / -2.0% 23587220 / 22762946 / +3.6% 0.05 / 0.06 / -5.4%
clickbench_q07/datafusion:vortex-file-compressed 9053012 / 9121962 / -0.8% 36224531 / 36679638 / -1.2% 0.25 / 0.25 / +0.5%
clickbench_q08/datafusion:vortex-file-compressed 78474978 / 79202689 / -0.9% 128872418 / 130034036 / -0.9% 0.61 / 0.61 / -0.0%
clickbench_q09/datafusion:vortex-file-compressed 168684018 / 169891930 / -0.7% 219554378 / 215849640 / +1.7% 0.77 / 0.79 / -2.4%
clickbench_q10/datafusion:vortex-file-compressed 22069364 / 23576041 / -6.4% 71864527 / 71620517 / +0.3% 0.31 / 0.33 / -6.7%
clickbench_q11/datafusion:vortex-file-compressed 24380834 / 25595211 / -4.7% 73182660 / 73456297 / -0.4% 0.33 / 0.35 / -4.4%
clickbench_q12/datafusion:vortex-file-compressed 71080864 / 72340317 / -1.7% 117757819 / 126525748 / -6.9% 0.60 / 0.57 / +5.6%
clickbench_q13/datafusion:vortex-file-compressed 114696101 / 114454353 / +0.2% 181976835 / 187159194 / -2.8% 0.63 / 0.61 / +3.1%
clickbench_q14/datafusion:vortex-file-compressed 73449928 / 75015054 / -2.1% 123303821 / 128127094 / -3.8% 0.60 / 0.59 / +1.7%
clickbench_q15/datafusion:vortex-file-compressed 61901421 / 63035252 / -1.8% 104799902 / 102527113 / +2.2% 0.59 / 0.61 / -3.9%
clickbench_q16/datafusion:vortex-file-compressed 153435654 / 154339830 / -0.6% 214305079 / 220216995 / -2.7% 0.72 / 0.70 / +2.2%
clickbench_q17/datafusion:vortex-file-compressed 152989169 / 153975190 / -0.6% 219530819 / 221571282 / -0.9% 0.70 / 0.69 / +0.3%
clickbench_q18/datafusion:vortex-file-compressed 292493467 / 297646745 / -1.7% 380228715 / 388335753 / -2.1% 0.77 / 0.77 / +0.4%
clickbench_q19/datafusion:vortex-file-compressed 7461434 / 7750414 / -3.7% 51157049 / 48721099 / +5.0% 0.15 / 0.16 / -8.3%
clickbench_q20/datafusion:vortex-file-compressed 68464948 / 68136855 / +0.5% 248213026 / 256425057 / -3.2% 0.28 / 0.27 / +3.8%
clickbench_q21/datafusion:vortex-file-compressed 81348598 / 80037805 / +1.6% 282776670 / 300737630 / -6.0% 0.29 / 0.27 / +8.1%
clickbench_q22/datafusion:vortex-file-compressed 91140722 / 95054287 / -4.1% 386033910 / 395336147 / -2.4% 0.24 / 0.24 / -1.8%
clickbench_q23/datafusion:vortex-file-compressed 96695306 / 80171206 / +20.6% 🔴 392596768 / 416246090 / -5.7% 0.25 / 0.19 / +27.9%
clickbench_q24/datafusion:vortex-file-compressed 8600968 / 8409700 / +2.3% 55046811 / 57093319 / -3.6% 0.16 / 0.15 / +6.1%
clickbench_q25/datafusion:vortex-file-compressed 19130968 / 18152158 / +5.4% 64843946 / 63410099 / +2.3% 0.30 / 0.29 / +3.1%
clickbench_q26/datafusion:vortex-file-compressed 13943448 / 15624998 / -10.8% 🟢 61475673 / 69615012 / -11.7% 🟢 0.23 / 0.22 / +1.1%
clickbench_q27/datafusion:vortex-file-compressed 99318907 / 100553100 / -1.2% 259449543 / 266070098 / -2.5% 0.38 / 0.38 / +1.3%
clickbench_q28/datafusion:vortex-file-compressed 558791589 / 561882003 / -0.6% 638734480 / 634483917 / +0.7% 0.87 / 0.89 / -1.2%
clickbench_q29/datafusion:vortex-file-compressed 24466572 / 24813306 / -1.4% 56891387 / 53938850 / +5.5% 0.43 / 0.46 / -6.5%
clickbench_q30/datafusion:vortex-file-compressed 57632858 / 54469824 / +5.8% 110189432 / 110322321 / -0.1% 0.52 / 0.49 / +5.9%
clickbench_q31/datafusion:vortex-file-compressed 65402260 / 63713036 / +2.7% 156315472 / 165094546 / -5.3% 0.42 / 0.39 / +8.4%
clickbench_q32/datafusion:vortex-file-compressed 288368762 / 287471359 / +0.3% 387600762 / 395194655 / -1.9% 0.74 / 0.73 / +2.3%
clickbench_q33/datafusion:vortex-file-compressed 318825894 / 318812426 / +0.0% 426615821 / 434359824 / -1.8% 0.75 / 0.73 / +1.8%
clickbench_q34/datafusion:vortex-file-compressed 320890454 / 319825400 / +0.3% 431063336 / 438643717 / -1.7% 0.74 / 0.73 / +2.1%
clickbench_q35/datafusion:vortex-file-compressed 56922552 / 56594294 / +0.6% 92960216 / 89838837 / +3.5% 0.61 / 0.63 / -2.8%
clickbench_q36/datafusion:vortex-file-compressed 13987649 / 37371240 / -62.6% 🟢 46911534 / 69504069 / -32.5% 🟢 0.30 / 0.54 / -44.5%
clickbench_q37/datafusion:vortex-file-compressed 10426490 / 20731798 / -49.7% 🟢 40034987 / 48713358 / -17.8% 🟢 0.26 / 0.43 / -38.8%
clickbench_q38/datafusion:vortex-file-compressed 12578444 / 12866674 / -2.2% 46164404 / 41261053 / +11.9% 🔴 0.27 / 0.31 / -12.6%
clickbench_q39/datafusion:vortex-file-compressed 21138882 / 78717482 / -73.1% 🟢 57357613 / 110822448 / -48.2% 🟢 0.37 / 0.71 / -48.1%
clickbench_q40/datafusion:vortex-file-compressed 9468738 / 10368860 / -8.7% 39149384 / 36576948 / +7.0% 0.24 / 0.28 / -14.7%
clickbench_q41/datafusion:vortex-file-compressed 9403180 / 9655634 / -2.6% 38889825 / 35212183 / +10.4% 🔴 0.24 / 0.27 / -11.8%
clickbench_q42/datafusion:vortex-file-compressed 9060344 / 9562990 / -5.3% 37553440 / 37134881 / +1.1% 0.24 / 0.26 / -6.3%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1231509 / 1245508 / -1.1% 52805779 / 49111389 / +7.5% 0.02 / 0.03 / -8.0%
clickbench_q01/datafusion:parquet 16169603 / 16128558 / +0.3% 67867768 / 65974016 / +2.9% 0.24 / 0.24 / -2.5%
clickbench_q02/datafusion:parquet 18520688 / 18679866 / -0.9% 83717451 / 81045048 / +3.3% 0.22 / 0.23 / -4.0%
clickbench_q03/datafusion:parquet 16791333 / 17636144 / -4.8% 80443303 / 78906984 / +1.9% 0.21 / 0.22 / -6.6%
clickbench_q04/datafusion:parquet 63323678 / 63147200 / +0.3% 126812685 / 123651426 / +2.6% 0.50 / 0.51 / -2.2%
clickbench_q05/datafusion:parquet 88197506 / 89173734 / -1.1% 158478791 / 155684349 / +1.8% 0.56 / 0.57 / -2.8%
clickbench_q06/datafusion:parquet 1229226 / 1267736 / -3.0% 51033325 / 49808656 / +2.5% 0.02 / 0.03 / -5.4%
clickbench_q07/datafusion:parquet 16832178 / 16815682 / +0.1% 70873360 / 68530680 / +3.4% 0.24 / 0.25 / -3.2%
clickbench_q08/datafusion:parquet 85041114 / 84420552 / +0.7% 166849199 / 159615748 / +4.5% 0.51 / 0.53 / -3.6%
clickbench_q09/datafusion:parquet 188885859 / 189340200 / -0.2% 271538063 / 270568486 / +0.4% 0.70 / 0.70 / -0.6%
clickbench_q10/datafusion:parquet 35641004 / 35838825 / -0.6% 103713275 / 101351871 / +2.3% 0.34 / 0.35 / -2.8%
clickbench_q11/datafusion:parquet 42586125 / 43388606 / -1.8% 112000880 / 110234963 / +1.6% 0.38 / 0.39 / -3.4%
clickbench_q12/datafusion:parquet 95695208 / 96400254 / -0.7% 164226538 / 164380304 / -0.1% 0.58 / 0.59 / -0.6%
clickbench_q13/datafusion:parquet 144715877 / 149050407 / -2.9% 232081443 / 229020286 / +1.3% 0.62 / 0.65 / -4.2%
clickbench_q14/datafusion:parquet 101893717 / 101751008 / +0.1% 174949970 / 173752765 / +0.7% 0.58 / 0.59 / -0.5%
clickbench_q15/datafusion:parquet 71899609 / 74751018 / -3.8% 132102703 / 132562825 / -0.3% 0.54 / 0.56 / -3.5%
clickbench_q16/datafusion:parquet 156516800 / 157130106 / -0.4% 238800925 / 235404102 / +1.4% 0.66 / 0.67 / -1.8%
clickbench_q17/datafusion:parquet 156400276 / 158408130 / -1.3% 241395583 / 232535206 / +3.8% 0.65 / 0.68 / -4.9%
clickbench_q18/datafusion:parquet 311306374 / 311659828 / -0.1% 419586152 / 428769037 / -2.1% 0.74 / 0.73 / +2.1%
clickbench_q19/datafusion:parquet 18724548 / 18808941 / -0.4% 81646653 / 76943382 / +6.1% 0.23 / 0.24 / -6.2%
clickbench_q20/datafusion:parquet 177453640 / 178190524 / -0.4% 298321088 / 283067790 / +5.4% 0.59 / 0.63 / -5.5%
clickbench_q21/datafusion:parquet 173111937 / 174542982 / -0.8% 316197544 / 303338278 / +4.2% 0.55 / 0.58 / -4.9%
clickbench_q22/datafusion:parquet 261458411 / 260781561 / +0.3% 459280072 / 433914101 / +5.8% 0.57 / 0.60 / -5.3%
clickbench_q23/datafusion:parquet 1004465683 / 1007396844 / -0.3% 1206385451 / 1196675958 / +0.8% 0.83 / 0.84 / -1.1%
clickbench_q24/datafusion:parquet 29948120 / 30726530 / -2.5% 93537931 / 88445505 / +5.8% 0.32 / 0.35 / -7.8%
clickbench_q25/datafusion:parquet 36573042 / 37097776 / -1.4% 106524124 / 103458997 / +3.0% 0.34 / 0.36 / -4.3%
clickbench_q26/datafusion:parquet 30684050 / 30667637 / +0.1% 94302664 / 89958756 / +4.8% 0.33 / 0.34 / -4.6%
clickbench_q27/datafusion:parquet 192275164 / 193541858 / -0.7% 299808793 / 294014301 / +2.0% 0.64 / 0.66 / -2.6%
clickbench_q28/datafusion:parquet 622268350 / 622381386 / -0.0% 706082294 / 709605194 / -0.5% 0.88 / 0.88 / +0.5%
clickbench_q29/datafusion:parquet 29182612 / 28382270 / +2.8% 92617773 / 89726118 / +3.2% 0.32 / 0.32 / -0.4%
clickbench_q30/datafusion:parquet 89504084 / 90292652 / -0.9% 180139018 / 173921114 / +3.6% 0.50 / 0.52 / -4.3%
clickbench_q31/datafusion:parquet 102290926 / 103509501 / -1.2% 203666308 / 200971596 / +1.3% 0.50 / 0.52 / -2.5%
clickbench_q32/datafusion:parquet 305193682 / 311115870 / -1.9% 434713858 / 428727602 / +1.4% 0.70 / 0.73 / -3.3%
clickbench_q33/datafusion:parquet 377471852 / 380048496 / -0.7% 476206642 / 479600127 / -0.7% 0.79 / 0.79 / +0.0%
clickbench_q34/datafusion:parquet 376023686 / 378557524 / -0.7% 475043900 / 477936899 / -0.6% 0.79 / 0.79 / -0.1%
clickbench_q35/datafusion:parquet 64177293 / 64249088 / -0.1% 123483909 / 123443405 / +0.0% 0.52 / 0.52 / -0.1%
clickbench_q36/datafusion:parquet 73875034 / 73977852 / -0.1% 137416789 / 136178878 / +0.9% 0.54 / 0.54 / -1.0%
clickbench_q37/datafusion:parquet 35598704 / 35633496 / -0.1% 92427681 / 91419997 / +1.1% 0.39 / 0.39 / -1.2%
clickbench_q38/datafusion:parquet 47731036 / 47903072 / -0.4% 107739089 / 108411604 / -0.6% 0.44 / 0.44 / +0.3%
clickbench_q39/datafusion:parquet 142899012 / 144526362 / -1.1% 210600272 / 212015185 / -0.7% 0.68 / 0.68 / -0.5%
clickbench_q40/datafusion:parquet 19766388 / 20349552 / -2.9% 77655530 / 77770096 / -0.1% 0.25 / 0.26 / -2.7%
clickbench_q41/datafusion:parquet 18659923 / 18824178 / -0.9% 75561411 / 74972994 / +0.8% 0.25 / 0.25 / -1.6%
clickbench_q42/datafusion:parquet 19081678 / 19068224 / +0.1% 75289024 / 75207188 / +0.1% 0.25 / 0.25 / -0.0%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2177232 / 2239520 / -2.8% 24702433 / 25410828 / -2.8% 0.09 / 0.09 / +0.0%
clickbench_q01/duckdb:vortex-file-compressed 7185736 / 7612362 / -5.6% 26916858 / 27570446 / -2.4% 0.27 / 0.28 / -3.3%
clickbench_q02/duckdb:vortex-file-compressed 8933358 / 8955066 / -0.2% 34128386 / 35286118 / -3.3% 0.26 / 0.25 / +3.1%
clickbench_q03/duckdb:vortex-file-compressed 14086432 / 14248936 / -1.1% 50385891 / 52216942 / -3.5% 0.28 / 0.27 / +2.5%
clickbench_q04/duckdb:vortex-file-compressed 56926422 / 58104275 / -2.0% 92684039 / 92470080 / +0.2% 0.61 / 0.63 / -2.3%
clickbench_q05/duckdb:vortex-file-compressed 64478610 / 64657906 / -0.3% 95123953 / 95177701 / -0.1% 0.68 / 0.68 / -0.2%
clickbench_q06/duckdb:vortex-file-compressed 2603971 / 2703474 / -3.7% 30000970 / 31007170 / -3.2% 0.09 / 0.09 / -0.5%
clickbench_q07/duckdb:vortex-file-compressed 8879097 / 9579114 / -7.3% 30191245 / 31815161 / -5.1% 0.29 / 0.30 / -2.3%
clickbench_q08/duckdb:vortex-file-compressed 70159244 / 69709164 / +0.6% 105121876 / 106513332 / -1.3% 0.67 / 0.65 / +2.0%
clickbench_q09/duckdb:vortex-file-compressed 94321116 / 91790526 / +2.8% 126877572 / 128038059 / -0.9% 0.74 / 0.72 / +3.7%
clickbench_q10/duckdb:vortex-file-compressed 27218000 / 27449552 / -0.8% 68991100 / 70633742 / -2.3% 0.39 / 0.39 / +1.5%
clickbench_q11/duckdb:vortex-file-compressed 29637599 / 29742802 / -0.4% 74180482 / 74580099 / -0.5% 0.40 / 0.40 / +0.2%
clickbench_q12/duckdb:vortex-file-compressed 68990827 / 68314645 / +1.0% 99252567 / 101588585 / -2.3% 0.70 / 0.67 / +3.4%
clickbench_q13/duckdb:vortex-file-compressed 118614510 / 117681350 / +0.8% 168138548 / 167304335 / +0.5% 0.71 / 0.70 / +0.3%
clickbench_q14/duckdb:vortex-file-compressed 73449794 / 71707574 / +2.4% 100450928 / 104097981 / -3.5% 0.73 / 0.69 / +6.1%
clickbench_q15/duckdb:vortex-file-compressed 77411088 / 76256368 / +1.5% 112029000 / 109430960 / +2.4% 0.69 / 0.70 / -0.8%
clickbench_q16/duckdb:vortex-file-compressed 132847883 / 136865666 / -2.9% 168498649 / 173157180 / -2.7% 0.79 / 0.79 / -0.3%
clickbench_q17/duckdb:vortex-file-compressed 136873814 / 136309250 / +0.4% 171133947 / 167679771 / +2.1% 0.80 / 0.81 / -1.6%
clickbench_q18/duckdb:vortex-file-compressed 255574798 / 253680418 / +0.7% 301177145 / 304490936 / -1.1% 0.85 / 0.83 / +1.9%
clickbench_q19/duckdb:vortex-file-compressed 8817043 / 9195282 / -4.1% 37171902 / 41073291 / -9.5% 0.24 / 0.22 / +6.0%
clickbench_q20/duckdb:vortex-file-compressed 67787778 / 68396690 / -0.9% 168564999 / 175446093 / -3.9% 0.40 / 0.39 / +3.2%
clickbench_q21/duckdb:vortex-file-compressed 78598986 / 78139710 / +0.6% 189953023 / 193510866 / -1.8% 0.41 / 0.40 / +2.5%
clickbench_q22/duckdb:vortex-file-compressed 129114278 / 130674448 / -1.2% 332792124 / 331574805 / +0.4% 0.39 / 0.39 / -1.6%
clickbench_q23/duckdb:vortex-file-compressed 62128564 / 59653655 / +4.1% 184043601 / 184899542 / -0.5% 0.34 / 0.32 / +4.6%
clickbench_q24/duckdb:vortex-file-compressed 17010076 / 17394194 / -2.2% 43953505 / 48703041 / -9.8% 0.39 / 0.36 / +8.4%
clickbench_q25/duckdb:vortex-file-compressed 18445027 / 18446944 / -0.0% 50611154 / 54178597 / -6.6% 0.36 / 0.34 / +7.0%
clickbench_q26/duckdb:vortex-file-compressed 13623614 / 14287748 / -4.6% 40924730 / 49047912 / -16.6% 🟢 0.33 / 0.29 / +14.3%
clickbench_q27/duckdb:vortex-file-compressed 54709415 / 53905176 / +1.5% 177009171 / 177354906 / -0.2% 0.31 / 0.30 / +1.7%
clickbench_q28/duckdb:vortex-file-compressed 506001398 / 514093187 / -1.6% 560800104 / 559504615 / +0.2% 0.90 / 0.92 / -1.8%
clickbench_q29/duckdb:vortex-file-compressed 17107422 / 17208508 / -0.6% 47344862 / 42958313 / +10.2% 🔴 0.36 / 0.40 / -9.8%
clickbench_q30/duckdb:vortex-file-compressed 60038520 / 59435691 / +1.0% 108505457 / 108956696 / -0.4% 0.55 / 0.55 / +1.4%
clickbench_q31/duckdb:vortex-file-compressed 108840146 / 109401092 / -0.5% 175788076 / 174239306 / +0.9% 0.62 / 0.63 / -1.4%
clickbench_q32/duckdb:vortex-file-compressed 364941240 / 385910546 / -5.4% 405078316 / 410231765 / -1.3% 0.90 / 0.94 / -4.2%
clickbench_q33/duckdb:vortex-file-compressed 342746348 / 342599656 / +0.0% 404867304 / 396100171 / +2.2% 0.85 / 0.86 / -2.1%
clickbench_q34/duckdb:vortex-file-compressed 363239666 / 353396204 / +2.8% 426139383 / 412222797 / +3.4% 0.85 / 0.86 / -0.6%
clickbench_q35/duckdb:vortex-file-compressed 57482514 / 57161666 / +0.6% 86697939 / 88929172 / -2.5% 0.66 / 0.64 / +3.1%
clickbench_q36/duckdb:vortex-file-compressed 11463970 / 11640787 / -1.5% 32781988 / 33117280 / -1.0% 0.35 / 0.35 / -0.5%
clickbench_q37/duckdb:vortex-file-compressed 7458994 / 7579217 / -1.6% 29285619 / 29023829 / +0.9% 0.25 / 0.26 / -2.5%
clickbench_q38/duckdb:vortex-file-compressed 8039362 / 8249762 / -2.6% 30753895 / 27872473 / +10.3% 🔴 0.26 / 0.30 / -11.7%
clickbench_q39/duckdb:vortex-file-compressed 18340020 / 18512246 / -0.9% 38892126 / 39648155 / -1.9% 0.47 / 0.47 / +1.0%
clickbench_q40/duckdb:vortex-file-compressed 6815729 / 6788686 / +0.4% 29151463 / 29122522 / +0.1% 0.23 / 0.23 / +0.3%
clickbench_q41/duckdb:vortex-file-compressed 7684985 / 7935220 / -3.2% 28929466 / 31671742 / -8.7% 0.27 / 0.25 / +6.0%
clickbench_q42/duckdb:vortex-file-compressed 7036900 / 7022668 / +0.2% 28876281 / 27458837 / +5.2% 0.24 / 0.26 / -4.7%
duckdb / parquet / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9559960 / 9394832 / +1.8% 14001470 / 14721122 / -4.9% 0.68 / 0.64 / +7.0%
clickbench_q01/duckdb:parquet 14861906 / 15255306 / -2.6% 20606764 / 20612271 / -0.0% 0.72 / 0.74 / -2.6%
clickbench_q02/duckdb:parquet 22555310 / 23202924 / -2.8% 30050815 / 34409503 / -12.7% 🟢 0.75 / 0.67 / +11.3%
clickbench_q03/duckdb:parquet 22589197 / 22805660 / -0.9% 37256458 / 37416814 / -0.4% 0.61 / 0.61 / -0.5%
clickbench_q04/duckdb:parquet 61466236 / 62729622 / -2.0% 72013879 / 74237821 / -3.0% 0.85 / 0.84 / +1.0%
clickbench_q05/duckdb:parquet 81530912 / 82553121 / -1.2% 93741754 / 95555827 / -1.9% 0.87 / 0.86 / +0.7%
clickbench_q06/duckdb:parquet 20367687 / 20223452 / +0.7% 28165651 / 27478087 / +2.5% 0.72 / 0.74 / -1.7%
clickbench_q07/duckdb:parquet 17153476 / 17993160 / -4.7% 23884033 / 22337709 / +6.9% 0.72 / 0.81 / -10.8%
clickbench_q08/duckdb:parquet 74229498 / 75074766 / -1.1% 90562835 / 93024452 / -2.6% 0.82 / 0.81 / +1.6%
clickbench_q09/duckdb:parquet 102531023 / 103794619 / -1.2% 119179951 / 121917219 / -2.2% 0.86 / 0.85 / +1.1%
clickbench_q10/duckdb:parquet 41589380 / 41383818 / +0.5% 54887439 / 53619651 / +2.4% 0.76 / 0.77 / -1.8%
clickbench_q11/duckdb:parquet 46678448 / 46643339 / +0.1% 62208327 / 61615297 / +1.0% 0.75 / 0.76 / -0.9%
clickbench_q12/duckdb:parquet 92353412 / 93595602 / -1.3% 104402392 / 108115697 / -3.4% 0.88 / 0.87 / +2.2%
clickbench_q13/duckdb:parquet 150303872 / 148244281 / +1.4% 170363850 / 168231324 / +1.3% 0.88 / 0.88 / +0.1%
clickbench_q14/duckdb:parquet 101145180 / 101682435 / -0.5% 118073446 / 114164311 / +3.4% 0.86 / 0.89 / -3.8%
clickbench_q15/duckdb:parquet 86811936 / 85946628 / +1.0% 102738418 / 100644448 / +2.1% 0.84 / 0.85 / -1.1%
clickbench_q16/duckdb:parquet 165972562 / 165498386 / +0.3% 174877635 / 179975882 / -2.8% 0.95 / 0.92 / +3.2%
clickbench_q17/duckdb:parquet 169134671 / 171531960 / -1.4% 179212130 / 178665714 / +0.3% 0.94 / 0.96 / -1.7%
clickbench_q18/duckdb:parquet 288275584 / 291016272 / -0.9% 318154943 / 315607081 / +0.8% 0.91 / 0.92 / -1.7%
clickbench_q19/duckdb:parquet 19790758 / 19859715 / -0.3% 26244955 / 25786255 / +1.8% 0.75 / 0.77 / -2.1%
clickbench_q20/duckdb:parquet 181032322 / 180420120 / +0.3% 229344055 / 232480084 / -1.3% 0.79 / 0.78 / +1.7%
clickbench_q21/duckdb:parquet 220832008 / 218477350 / +1.1% 264590906 / 262983512 / +0.6% 0.83 / 0.83 / +0.5%
clickbench_q22/duckdb:parquet 330241533 / 304926990 / +8.3% 369716519 / 357379579 / +3.5% 0.89 / 0.85 / +4.7%
clickbench_q23/duckdb:parquet 171132397 / 171775762 / -0.4% 238241950 / 253121056 / -5.9% 0.72 / 0.68 / +5.8%
clickbench_q24/duckdb:parquet 30483064 / 29958716 / +1.8% 43525497 / 42482462 / +2.5% 0.70 / 0.71 / -0.7%
clickbench_q25/duckdb:parquet 42603669 / 42463750 / +0.3% 55741574 / 60982131 / -8.6% 0.76 / 0.70 / +9.8%
clickbench_q26/duckdb:parquet 32243996 / 32739711 / -1.5% 38627296 / 47017556 / -17.8% 🟢 0.83 / 0.70 / +19.9%
clickbench_q27/duckdb:parquet 193505166 / 191541398 / +1.0% 227168390 / 230295986 / -1.4% 0.85 / 0.83 / +2.4%
clickbench_q28/duckdb:parquet 965970383 / 950006560 / +1.7% 938450640 / 983079731 / -4.5% 1.03 / 0.97 / +6.5%
clickbench_q29/duckdb:parquet 24126664 / 24317362 / -0.8% 31586584 / 30925214 / +2.1% 0.76 / 0.79 / -2.9%
clickbench_q30/duckdb:parquet 106297654 / 104622488 / +1.6% 124794963 / 129419189 / -3.6% 0.85 / 0.81 / +5.4%
clickbench_q31/duckdb:parquet 134438526 / 160480217 / -16.2% 🟢 198717887 / 174417616 / +13.9% 🔴 0.68 / 0.92 / -26.5%
clickbench_q32/duckdb:parquet 377219004 / 385925739 / -2.3% 400662099 / 407659843 / -1.7% 0.94 / 0.95 / -0.5%
clickbench_q33/duckdb:parquet 482351960 / 468922366 / +2.9% 458096964 / 442695781 / +3.5% 1.05 / 1.06 / -0.6%
clickbench_q34/duckdb:parquet 477401298 / 462238432 / +3.3% 464123171 / 447629696 / +3.7% 1.03 / 1.03 / -0.4%
clickbench_q35/duckdb:parquet 61139786 / 61543474 / -0.7% 76531790 / 77479685 / -1.2% 0.80 / 0.79 / +0.6%
clickbench_q36/duckdb:parquet 29775648 / 30172014 / -1.3% 35520970 / 36925558 / -3.8% 0.84 / 0.82 / +2.6%
clickbench_q37/duckdb:parquet 23118354 / 23204022 / -0.4% 29510877 / 30425350 / -3.0% 0.78 / 0.76 / +2.7%
clickbench_q38/duckdb:parquet 23607557 / 23431136 / +0.8% 29959535 / 30912378 / -3.1% 0.79 / 0.76 / +4.0%
clickbench_q39/duckdb:parquet 52862985 / 52956229 / -0.2% 59563020 / 60047399 / -0.8% 0.89 / 0.88 / +0.6%
clickbench_q40/duckdb:parquet 15019822 / 14924840 / +0.6% 19765110 / 20066747 / -1.5% 0.76 / 0.74 / +2.2%
clickbench_q41/duckdb:parquet 15703359 / 15331596 / +2.4% 21393328 / 23069987 / -7.3% 0.73 / 0.66 / +10.5%
clickbench_q42/duckdb:parquet 14139266 / 14130908 / +0.1% 20457868 / 20120985 / +1.7% 0.69 / 0.70 / -1.6%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR aea8f377 vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.0%
Engines: DataFusion No clear signal (+14.7%, environment too noisy confidence) · DuckDB No clear signal (+5.5%, environment too noisy confidence)
Vortex (geomean): hot 1.143x ➖ · cold 1.087x ➖
Parquet (geomean): hot 1.039x ➖ · cold 1.086x ➖
Shifts: Parquet (control) +3.9% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.214x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 234452152 / 213717821 / +9.7% 818482963 / 764398977 / +7.1% 0.29 / 0.28 / +2.5%
tpch_q02/datafusion:vortex-file-compressed 326552680 / 320984758 / +1.7% 806319928 / 553448858 / +45.7% 🔴 0.40 / 0.58 / -30.2%
tpch_q03/datafusion:vortex-file-compressed 3024407247 / 310450262 / +874.2% 🔴 2969286567 / 854530904 / +247.5% 🔴 1.02 / 0.36 / +180.4%
tpch_q04/datafusion:vortex-file-compressed 196475710 / 159007585 / +23.6% 388163134 / 372572808 / +4.2% 0.51 / 0.43 / +18.6%
tpch_q05/datafusion:vortex-file-compressed 363929022 / 344078558 / +5.8% 606230093 / 546047746 / +11.0% 0.60 / 0.63 / -4.7%
tpch_q06/datafusion:vortex-file-compressed 147102670 / 123668516 / +18.9% 304052166 / 317073449 / -4.1% 0.48 / 0.39 / +24.0%
tpch_q07/datafusion:vortex-file-compressed 461213876 / 426177142 / +8.2% 687526071 / 586012416 / +17.3% 0.67 / 0.73 / -7.8%
tpch_q08/datafusion:vortex-file-compressed 421663036 / 410714646 / +2.7% 555146658 / 541459260 / +2.5% 0.76 / 0.76 / +0.1%
tpch_q09/datafusion:vortex-file-compressed 344321997 / 301899395 / +14.1% 608069120 / 455403137 / +33.5% 🔴 0.57 / 0.66 / -14.6%
tpch_q10/datafusion:vortex-file-compressed 359742246 / 361036359 / -0.4% 543301671 / 525406226 / +3.4% 0.66 / 0.69 / -3.6%
tpch_q11/datafusion:vortex-file-compressed 322577401 / 272228443 / +18.5% 453717814 / 382260665 / +18.7% 0.71 / 0.71 / -0.2%
tpch_q12/datafusion:vortex-file-compressed 195885662 / 203460731 / -3.7% 410135861 / 338106908 / +21.3% 0.48 / 0.60 / -20.6%
tpch_q13/datafusion:vortex-file-compressed 142399594 / 116217877 / +22.5% 407346976 / 309114444 / +31.8% 🔴 0.35 / 0.38 / -7.0%
tpch_q14/datafusion:vortex-file-compressed 192515540 / 181074526 / +6.3% 350892604 / 354128334 / -0.9% 0.55 / 0.51 / +7.3%
tpch_q15/datafusion:vortex-file-compressed 296188579 / 306125584 / -3.2% 556567006 / 727209626 / -23.5% 0.53 / 0.42 / +26.4%
tpch_q16/datafusion:vortex-file-compressed 145670729 / 134848492 / +8.0% 286685223 / 285978767 / +0.2% 0.51 / 0.47 / +7.8%
tpch_q17/datafusion:vortex-file-compressed 257670615 / 252865916 / +1.9% 471284228 / 494400127 / -4.7% 0.55 / 0.51 / +6.9%
tpch_q18/datafusion:vortex-file-compressed 263926030 / 222278514 / +18.7% 519256976 / 389005809 / +33.5% 🔴 0.51 / 0.57 / -11.0%
tpch_q19/datafusion:vortex-file-compressed 238003757 / 226209017 / +5.2% 415718597 / 296515885 / +40.2% 🔴 0.57 / 0.76 / -25.0%
tpch_q20/datafusion:vortex-file-compressed 273274858 / 248686849 / +9.9% 525182398 / 477297666 / +10.0% 0.52 / 0.52 / -0.1%
tpch_q21/datafusion:vortex-file-compressed 560574908 / 384422617 / +45.8% 🔴 689265488 / 739838656 / -6.8% 0.81 / 0.52 / +56.5%
tpch_q22/datafusion:vortex-file-compressed 155160825 / 147475449 / +5.2% 366403211 / 337385924 / +8.6% 0.42 / 0.44 / -3.1%
datafusion / parquet / ns (1.059x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 180115567 / 143033960 / +25.9% 656437260 / 425422516 / +54.3% 🔴 0.27 / 0.34 / -18.4%
tpch_q02/datafusion:parquet 274130096 / 274389077 / -0.1% 531654901 / 421418541 / +26.2% 0.52 / 0.65 / -20.8%
tpch_q03/datafusion:parquet 236087903 / 240153039 / -1.7% 609167260 / 656104536 / -7.2% 0.39 / 0.37 / +5.9%
tpch_q04/datafusion:parquet 116754443 / 129091170 / -9.6% 336430754 / 262434371 / +28.2% 0.35 / 0.49 / -29.4%
tpch_q05/datafusion:parquet 328751191 / 325560808 / +1.0% 501437467 / 708712744 / -29.2% 0.66 / 0.46 / +42.7%
tpch_q06/datafusion:parquet 127675644 / 104623731 / +22.0% 232204957 / 202039421 / +14.9% 0.55 / 0.52 / +6.2%
tpch_q07/datafusion:parquet 336435166 / 326115720 / +3.2% 780862737 / 439408571 / +77.7% 🔴 0.43 / 0.74 / -41.9%
tpch_q08/datafusion:parquet 396387197 / 383031456 / +3.5% 543212936 / 487777150 / +11.4% 0.73 / 0.79 / -7.1%
tpch_q09/datafusion:parquet 382161285 / 507741508 / -24.7% 661794601 / 948722124 / -30.2% 🟢 0.58 / 0.54 / +7.9%
tpch_q10/datafusion:parquet 301724775 / 318225993 / -5.2% 437707680 / 431490793 / +1.4% 0.69 / 0.74 / -6.5%
tpch_q11/datafusion:parquet 246650884 / 245309101 / +0.5% 411585430 / 324804219 / +26.7% 0.60 / 0.76 / -20.7%
tpch_q12/datafusion:parquet 180360262 / 160703746 / +12.2% 477718801 / 262477140 / +82.0% 🔴 0.38 / 0.61 / -38.3%
tpch_q13/datafusion:parquet 278022425 / 274764633 / +1.2% 457094392 / 387802001 / +17.9% 0.61 / 0.71 / -14.2%
tpch_q14/datafusion:parquet 168444371 / 141590102 / +19.0% 267417860 / 264823133 / +1.0% 0.63 / 0.53 / +17.8%
tpch_q15/datafusion:parquet 304703194 / 297935495 / +2.3% 474598105 / 444599102 / +6.7% 0.64 / 0.67 / -4.2%
tpch_q16/datafusion:parquet 119930960 / 96864793 / +23.8% 247703152 / 207092637 / +19.6% 0.48 / 0.47 / +3.5%
tpch_q17/datafusion:parquet 421039669 / 268630342 / +56.7% 🔴 769297996 / 416939497 / +84.5% 🔴 0.55 / 0.64 / -15.1%
tpch_q18/datafusion:parquet 307927897 / 305302634 / +0.9% 458916075 / 465639400 / -1.4% 0.67 / 0.66 / +2.3%
tpch_q19/datafusion:parquet 154645138 / 149310744 / +3.6% 340385413 / 274137368 / +24.2% 0.45 / 0.54 / -16.6%
tpch_q20/datafusion:parquet 248282247 / 228071243 / +8.9% 382996636 / 424446687 / -9.8% 0.65 / 0.54 / +20.6%
tpch_q21/datafusion:parquet 296530767 / 291483866 / +1.7% 449229070 / 469762099 / -4.4% 0.66 / 0.62 / +6.4%
tpch_q22/datafusion:parquet 155587380 / 145366900 / +7.0% 289344581 / 299750221 / -3.5% 0.54 / 0.48 / +10.9%
duckdb / vortex-file-compressed / ns (1.077x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 263615806 / 237695207 / +10.9% 273244246 / 298096331 / -8.3% 0.96 / 0.80 / +21.0%
tpch_q02/duckdb:vortex-file-compressed 413788437 / 394665672 / +4.8% 484236153 / 474795024 / +2.0% 0.85 / 0.83 / +2.8%
tpch_q03/duckdb:vortex-file-compressed 393141699 / 398939371 / -1.5% 477647159 / 460688509 / +3.7% 0.82 / 0.87 / -5.0%
tpch_q04/duckdb:vortex-file-compressed 299907758 / 255227345 / +17.5% 287669739 / 296337544 / -2.9% 1.04 / 0.86 / +21.0%
tpch_q05/duckdb:vortex-file-compressed 531900343 / 709957932 / -25.1% 611546880 / 785337665 / -22.1% 0.87 / 0.90 / -3.8%
tpch_q06/duckdb:vortex-file-compressed 242746221 / 148777224 / +63.2% 🔴 193635367 / 208058114 / -6.9% 1.25 / 0.72 / +75.3%
tpch_q07/duckdb:vortex-file-compressed 385141800 / 387859027 / -0.7% 603978803 / 510621725 / +18.3% 0.64 / 0.76 / -16.0%
tpch_q08/duckdb:vortex-file-compressed 591257680 / 617848086 / -4.3% 716043327 / 732855328 / -2.3% 0.83 / 0.84 / -2.1%
tpch_q09/duckdb:vortex-file-compressed 395878208 / 392528875 / +0.9% 500992809 / 482201706 / +3.9% 0.79 / 0.81 / -2.9%
tpch_q10/duckdb:vortex-file-compressed 529587002 / 526138612 / +0.7% 527703088 / 576801469 / -8.5% 1.00 / 0.91 / +10.0%
tpch_q11/duckdb:vortex-file-compressed 307514248 / 288496302 / +6.6% 315564624 / 270775100 / +16.5% 0.97 / 1.07 / -8.5%
tpch_q12/duckdb:vortex-file-compressed 247480948 / 271105721 / -8.7% 289611086 / 407392913 / -28.9% 0.85 / 0.67 / +28.4%
tpch_q13/duckdb:vortex-file-compressed 236171462 / 247871881 / -4.7% 257190771 / 208806747 / +23.2% 0.92 / 1.19 / -22.6%
tpch_q14/duckdb:vortex-file-compressed 222659058 / 224785869 / -0.9% 296946371 / 273953898 / +8.4% 0.75 / 0.82 / -8.6%
tpch_q15/duckdb:vortex-file-compressed 230837670 / 237917836 / -3.0% 305783724 / 453417020 / -32.6% 🟢 0.75 / 0.52 / +43.9%
tpch_q16/duckdb:vortex-file-compressed 189780374 / 206543544 / -8.1% 217370553 / 287344280 / -24.4% 0.87 / 0.72 / +21.5%
tpch_q17/duckdb:vortex-file-compressed 1845107117 / 454602893 / +305.9% 🔴 1584933788 / 443734007 / +257.2% 🔴 1.16 / 1.02 / +13.6%
tpch_q18/duckdb:vortex-file-compressed 357252881 / 339736454 / +5.2% 407827709 / 418339259 / -2.5% 0.88 / 0.81 / +7.9%
tpch_q19/duckdb:vortex-file-compressed 290089026 / 320978677 / -9.6% 323881919 / 349847295 / -7.4% 0.90 / 0.92 / -2.4%
tpch_q20/duckdb:vortex-file-compressed 343641295 / 334782469 / +2.6% 392613738 / 412936083 / -4.9% 0.88 / 0.81 / +8.0%
tpch_q21/duckdb:vortex-file-compressed 572727969 / 558602915 / +2.5% 605072256 / 630439819 / -4.0% 0.95 / 0.89 / +6.8%
tpch_q22/duckdb:vortex-file-compressed 243659845 / 253794094 / -4.0% 297712605 / 269551763 / +10.4% 0.82 / 0.94 / -13.1%
duckdb / parquet / ns (1.020x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 157696692 / 178327142 / -11.6% 216249090 / 188180852 / +14.9% 0.73 / 0.95 / -23.0%
tpch_q02/duckdb:parquet 481566363 / 428571834 / +12.4% 428776307 / 421258354 / +1.8% 1.12 / 1.02 / +10.4%
tpch_q03/duckdb:parquet 352084815 / 384797319 / -8.5% 407535666 / 402689855 / +1.2% 0.86 / 0.96 / -9.6%
tpch_q04/duckdb:parquet 314273493 / 278868438 / +12.7% 354170766 / 290411092 / +22.0% 0.89 / 0.96 / -7.6%
tpch_q05/duckdb:parquet 527751545 / 512960026 / +2.9% 569037474 / 589908823 / -3.5% 0.93 / 0.87 / +6.7%
tpch_q06/duckdb:parquet 146173710 / 154774655 / -5.6% 149273075 / 188086085 / -20.6% 0.98 / 0.82 / +19.0%
tpch_q07/duckdb:parquet 420312101 / 419672939 / +0.2% 442047132 / 421853390 / +4.8% 0.95 / 0.99 / -4.4%
tpch_q08/duckdb:parquet 636789353 / 588960652 / +8.1% 696661055 / 658661231 / +5.8% 0.91 / 0.89 / +2.2%
tpch_q09/duckdb:parquet 549824021 / 557378838 / -1.4% 681373232 / 656390425 / +3.8% 0.81 / 0.85 / -5.0%
tpch_q10/duckdb:parquet 550011761 / 517349035 / +6.3% 646289683 / 581884894 / +11.1% 0.85 / 0.89 / -4.3%
tpch_q11/duckdb:parquet 320383823 / 279247336 / +14.7% 336736614 / 301469405 / +11.7% 0.95 / 0.93 / +2.7%
tpch_q12/duckdb:parquet 239310691 / 244321025 / -2.1% 278825551 / 281145014 / -0.8% 0.86 / 0.87 / -1.2%
tpch_q13/duckdb:parquet 371197769 / 382703043 / -3.0% 442009287 / 463219570 / -4.6% 0.84 / 0.83 / +1.6%
tpch_q14/duckdb:parquet 241704618 / 255047143 / -5.2% 335230546 / 301222259 / +11.3% 0.72 / 0.85 / -14.8%
tpch_q15/duckdb:parquet 184340519 / 191438501 / -3.7% 183107408 / 220554518 / -17.0% 1.01 / 0.87 / +16.0%
tpch_q16/duckdb:parquet 249197478 / 287313946 / -13.3% 298750907 / 301984087 / -1.1% 0.83 / 0.95 / -12.3%
tpch_q17/duckdb:parquet 291205949 / 258007938 / +12.9% 353594328 / 314199718 / +12.5% 0.82 / 0.82 / +0.3%
tpch_q18/duckdb:parquet 319890359 / 306425002 / +4.4% 366989887 / 355418381 / +3.3% 0.87 / 0.86 / +1.1%
tpch_q19/duckdb:parquet 268479646 / 241485587 / +11.2% 310186600 / 285468394 / +8.7% 0.87 / 0.85 / +2.3%
tpch_q20/duckdb:parquet 491472245 / 432599380 / +13.6% 558641093 / 540117093 / +3.4% 0.88 / 0.80 / +9.8%
tpch_q21/duckdb:parquet 414224969 / 417617294 / -0.8% 460852572 / 463876894 / -0.7% 0.90 / 0.90 / -0.2%
tpch_q22/duckdb:parquet 310360418 / 287438341 / +8.0% 311035263 / 253402369 / +22.7% 1.00 / 1.13 / -12.0%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR aea8f377 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+4.8%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 1.022x ➖ · cold 0.980x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.973x ➖
Shifts: Parquet (control) +0.2% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.044x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6128272 / 6250168 / -2.0% 20514711 / 19751173 / +3.9% 0.30 / 0.32 / -5.6%
fineweb_q01/datafusion:vortex-file-compressed 9752338 / 9285400 / +5.0% 35503685 / 35575139 / -0.2% 0.27 / 0.26 / +5.2%
fineweb_q02/datafusion:vortex-file-compressed 11508672 / 10567512 / +8.9% 41535257 / 40643432 / +2.2% 0.28 / 0.26 / +6.6%
fineweb_q03/datafusion:vortex-file-compressed 17536130 / 17539240 / -0.0% 101795256 / 102692107 / -0.9% 0.17 / 0.17 / +0.9%
fineweb_q04/datafusion:vortex-file-compressed 64616680 / 64090120 / +0.8% 144995532 / 144508483 / +0.3% 0.45 / 0.44 / +0.5%
fineweb_q05/datafusion:vortex-file-compressed 62787140 / 63203121 / -0.7% 141340657 / 139485427 / +1.3% 0.44 / 0.45 / -2.0%
fineweb_q06/datafusion:vortex-file-compressed 16529280 / 17269226 / -4.3% 101110112 / 106346388 / -4.9% 0.16 / 0.16 / +0.7%
fineweb_q07/datafusion:vortex-file-compressed 17724083 / 16748794 / +5.8% 99589889 / 103498538 / -3.8% 0.18 / 0.16 / +10.0%
fineweb_q08/datafusion:vortex-file-compressed 10947749 / 8455804 / +29.5% 🔴 30077558 / 26524896 / +13.4% 🔴 0.36 / 0.32 / +14.2%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9601608 / 9321344 / +3.0% 34046617 / 32543553 / +4.6% 0.28 / 0.29 / -1.5%
fineweb_q01/datafusion:parquet 75187499 / 75943192 / -1.0% 143639383 / 168115168 / -14.6% 🟢 0.52 / 0.45 / +15.9%
fineweb_q02/datafusion:parquet 74403889 / 75797688 / -1.8% 151779048 / 156430678 / -3.0% 0.49 / 0.48 / +1.2%
fineweb_q03/datafusion:parquet 73821067 / 73828035 / -0.0% 143544673 / 151042261 / -5.0% 0.51 / 0.49 / +5.2%
fineweb_q04/datafusion:parquet 81073172 / 82454360 / -1.7% 148937648 / 161665686 / -7.9% 0.54 / 0.51 / +6.7%
fineweb_q05/datafusion:parquet 80641762 / 81339953 / -0.9% 145072570 / 155427779 / -6.7% 0.56 / 0.52 / +6.2%
fineweb_q06/datafusion:parquet 74290264 / 76823475 / -3.3% 142632900 / 164720545 / -13.4% 🟢 0.52 / 0.47 / +11.7%
fineweb_q07/datafusion:parquet 74466680 / 73784924 / +0.9% 145311881 / 154776922 / -6.1% 0.51 / 0.48 / +7.5%
fineweb_q08/datafusion:parquet 74533930 / 73667172 / +1.2% 145861952 / 153339658 / -4.9% 0.51 / 0.48 / +6.4%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2082422 / 2129396 / -2.2% 7175952 / 8430467 / -14.9% 🟢 0.29 / 0.25 / +14.9%
fineweb_q01/duckdb:vortex-file-compressed 7758402 / 7609840 / +2.0% 25325599 / 27699884 / -8.6% 0.31 / 0.27 / +11.5%
fineweb_q02/duckdb:vortex-file-compressed 8985760 / 8999654 / -0.2% 27741399 / 32238453 / -13.9% 🟢 0.32 / 0.28 / +16.0%
fineweb_q03/duckdb:vortex-file-compressed 18299081 / 17999961 / +1.7% 87457399 / 89729159 / -2.5% 0.21 / 0.20 / +4.3%
fineweb_q04/duckdb:vortex-file-compressed 64727198 / 64895256 / -0.3% 101163933 / 105319449 / -3.9% 0.64 / 0.62 / +3.8%
fineweb_q05/duckdb:vortex-file-compressed 64907000 / 64576607 / +0.5% 101541697 / 100642505 / +0.9% 0.64 / 0.64 / -0.4%
fineweb_q06/duckdb:vortex-file-compressed 17617175 / 17451004 / +1.0% 88898218 / 90997772 / -2.3% 0.20 / 0.19 / +3.3%
fineweb_q07/duckdb:vortex-file-compressed 16787572 / 17567882 / -4.4% 86667757 / 90262327 / -4.0% 0.19 / 0.19 / -0.5%
fineweb_q08/duckdb:vortex-file-compressed 4633797 / 4479276 / +3.4% 13400701 / 12680631 / +5.7% 0.35 / 0.35 / -2.1%
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23714752 / 23575786 / +0.6% 28570561 / 27901054 / +2.4% 0.83 / 0.84 / -1.8%
fineweb_q01/duckdb:parquet 54267616 / 53435612 / +1.6% 70180430 / 71035947 / -1.2% 0.77 / 0.75 / +2.8%
fineweb_q02/duckdb:parquet 59307334 / 58133262 / +2.0% 74249638 / 71614459 / +3.7% 0.80 / 0.81 / -1.6%
fineweb_q03/duckdb:parquet 120648524 / 119431288 / +1.0% 181089506 / 174813976 / +3.6% 0.67 / 0.68 / -2.5%
fineweb_q04/duckdb:parquet 163537694 / 160054805 / +2.2% 212844708 / 201506963 / +5.6% 0.77 / 0.79 / -3.3%
fineweb_q05/duckdb:parquet 158843377 / 159362006 / -0.3% 196388565 / 199292933 / -1.5% 0.81 / 0.80 / +1.1%
fineweb_q06/duckdb:parquet 88964766 / 88786282 / +0.2% 141966968 / 152544283 / -6.9% 0.63 / 0.58 / +7.7%
fineweb_q07/duckdb:parquet 89916656 / 90890989 / -1.1% 146838801 / 143350764 / +2.4% 0.61 / 0.63 / -3.4%
fineweb_q08/duckdb:parquet 29305002 / 28981936 / +1.1% 31021385 / 30002232 / +3.4% 0.94 / 0.97 / -2.2%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR aea8f377 vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.002x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35306288 / 35836658 / -1.5% 62507278 / 59839649 / +4.5% 0.56 / 0.60 / -5.7%
tpcds_q02/datafusion:vortex-file-compressed 48975114 / 51540980 / -5.0% 76282971 / 75356430 / +1.2% 0.64 / 0.68 / -6.1%
tpcds_q03/datafusion:vortex-file-compressed 20275201 / 20246396 / +0.1% 46980644 / 46166223 / +1.8% 0.43 / 0.44 / -1.6%
tpcds_q04/datafusion:vortex-file-compressed 291217868 / 293432920 / -0.8% 358640088 / 354050198 / +1.3% 0.81 / 0.83 / -2.0%
tpcds_q05/datafusion:vortex-file-compressed 73568110 / 71656747 / +2.7% 106880959 / 107692212 / -0.8% 0.69 / 0.67 / +3.4%
tpcds_q06/datafusion:vortex-file-compressed 42100286 / 42258217 / -0.4% 71389221 / 70535607 / +1.2% 0.59 / 0.60 / -1.6%
tpcds_q07/datafusion:vortex-file-compressed 41691562 / 42156216 / -1.1% 77068000 / 80613054 / -4.4% 0.54 / 0.52 / +3.4%
tpcds_q08/datafusion:vortex-file-compressed 28422604 / 28614063 / -0.7% 54822300 / 57730721 / -5.0% 0.52 / 0.50 / +4.6%
tpcds_q09/datafusion:vortex-file-compressed 44935547 / 44012164 / +2.1% 80691332 / 77101674 / +4.7% 0.56 / 0.57 / -2.4%
tpcds_q10/datafusion:vortex-file-compressed 35639852 / 37189576 / -4.2% 62724111 / 63021635 / -0.5% 0.57 / 0.59 / -3.7%
tpcds_q11/datafusion:vortex-file-compressed 174414046 / 174495550 / -0.0% 218207258 / 221987691 / -1.7% 0.80 / 0.79 / +1.7%
tpcds_q12/datafusion:vortex-file-compressed 17656636 / 17549844 / +0.6% 38993416 / 38571171 / +1.1% 0.45 / 0.45 / -0.5%
tpcds_q13/datafusion:vortex-file-compressed 39159042 / 38899632 / +0.7% 80407256 / 85520203 / -6.0% 0.49 / 0.45 / +7.1%
tpcds_q14/datafusion:vortex-file-compressed 235005464 / 231725092 / +1.4% 279186428 / 271215982 / +2.9% 0.84 / 0.85 / -1.5%
tpcds_q15/datafusion:vortex-file-compressed 39923339 / 40095029 / -0.4% 60855921 / 54164984 / +12.4% 🔴 0.66 / 0.74 / -11.4%
tpcds_q16/datafusion:vortex-file-compressed 22960113 / 22869641 / +0.4% 42475988 / 42034772 / +1.0% 0.54 / 0.54 / -0.6%
tpcds_q17/datafusion:vortex-file-compressed 64471496 / 64808376 / -0.5% 94830248 / 89558176 / +5.9% 0.68 / 0.72 / -6.1%
tpcds_q18/datafusion:vortex-file-compressed 68844053 / 69097730 / -0.4% 96803175 / 94787906 / +2.1% 0.71 / 0.73 / -2.4%
tpcds_q19/datafusion:vortex-file-compressed 22802886 / 22408799 / +1.8% 55354809 / 55496169 / -0.3% 0.41 / 0.40 / +2.0%
tpcds_q20/datafusion:vortex-file-compressed 23858687 / 23702741 / +0.7% 40431909 / 40220803 / +0.5% 0.59 / 0.59 / +0.1%
tpcds_q21/datafusion:vortex-file-compressed 46915192 / 47542674 / -1.3% 64087097 / 64058585 / +0.0% 0.73 / 0.74 / -1.4%
tpcds_q22/datafusion:vortex-file-compressed 441947268 / 431366016 / +2.5% 468540525 / 465284097 / +0.7% 0.94 / 0.93 / +1.7%
tpcds_q23/datafusion:vortex-file-compressed 300250346 / 299587271 / +0.2% 357095644 / 351318540 / +1.6% 0.84 / 0.85 / -1.4%
tpcds_q24/datafusion:vortex-file-compressed 117857023 / 120023524 / -1.8% 159233745 / 159982078 / -0.5% 0.74 / 0.75 / -1.3%
tpcds_q25/datafusion:vortex-file-compressed 63058595 / 63311010 / -0.4% 100184243 / 102454935 / -2.2% 0.63 / 0.62 / +1.9%
tpcds_q26/datafusion:vortex-file-compressed 37028632 / 37429288 / -1.1% 62118259 / 59331611 / +4.7% 0.60 / 0.63 / -5.5%
tpcds_q27/datafusion:vortex-file-compressed 75085224 / 72377160 / +3.7% 113357212 / 104225546 / +8.8% 0.66 / 0.69 / -4.6%
tpcds_q28/datafusion:vortex-file-compressed 42379820 / 42296916 / +0.2% 86787338 / 82755038 / +4.9% 0.49 / 0.51 / -4.5%
tpcds_q29/datafusion:vortex-file-compressed 64796132 / 61922299 / +4.6% 101175030 / 97201813 / +4.1% 0.64 / 0.64 / +0.5%
tpcds_q30/datafusion:vortex-file-compressed 51782256 / 51311054 / +0.9% 79811639 / 79114003 / +0.9% 0.65 / 0.65 / +0.0%
tpcds_q31/datafusion:vortex-file-compressed 197298425 / 196557266 / +0.4% 236393072 / 235875877 / +0.2% 0.83 / 0.83 / +0.2%
tpcds_q32/datafusion:vortex-file-compressed 15097861 / 15236954 / -0.9% 32518516 / 31554300 / +3.1% 0.46 / 0.48 / -3.9%
tpcds_q33/datafusion:vortex-file-compressed 33202547 / 33321710 / -0.4% 74018131 / 67027574 / +10.4% 🔴 0.45 / 0.50 / -9.8%
tpcds_q34/datafusion:vortex-file-compressed 39835781 / 41148345 / -3.2% 68005482 / 68234625 / -0.3% 0.59 / 0.60 / -2.9%
tpcds_q35/datafusion:vortex-file-compressed 92791154 / 92443260 / +0.4% 120944519 / 120652799 / +0.2% 0.77 / 0.77 / +0.1%
tpcds_q36/datafusion:vortex-file-compressed 66223835 / 65946206 / +0.4% 98086366 / 100250170 / -2.2% 0.68 / 0.66 / +2.6%
tpcds_q37/datafusion:vortex-file-compressed 24656797 / 23553139 / +4.7% 42285984 / 43598667 / -3.0% 0.58 / 0.54 / +7.9%
tpcds_q38/datafusion:vortex-file-compressed 78490619 / 76507711 / +2.6% 106647905 / 106221269 / +0.4% 0.74 / 0.72 / +2.2%
tpcds_q39/datafusion:vortex-file-compressed 888249700 / 887680404 / +0.1% 915962799 / 906829393 / +1.0% 0.97 / 0.98 / -0.9%
tpcds_q40/datafusion:vortex-file-compressed 28350901 / 28735451 / -1.3% 48582586 / 47789817 / +1.7% 0.58 / 0.60 / -2.9%
tpcds_q41/datafusion:vortex-file-compressed 20047790 / 19056672 / +5.2% 32495349 / 30560191 / +6.3% 0.62 / 0.62 / -1.1%
tpcds_q42/datafusion:vortex-file-compressed 14266858 / 14306364 / -0.3% 39701324 / 39330916 / +0.9% 0.36 / 0.36 / -1.2%
tpcds_q43/datafusion:vortex-file-compressed 17571919 / 17123520 / +2.6% 41343269 / 40887604 / +1.1% 0.43 / 0.42 / +1.5%
tpcds_q44/datafusion:vortex-file-compressed 42609066 / 42841783 / -0.5% 72844797 / 73034215 / -0.3% 0.58 / 0.59 / -0.3%
tpcds_q45/datafusion:vortex-file-compressed 42970199 / 42716522 / +0.6% 64712141 / 64325351 / +0.6% 0.66 / 0.66 / -0.0%
tpcds_q46/datafusion:vortex-file-compressed 70361898 / 70770951 / -0.6% 102782867 / 103002911 / -0.2% 0.68 / 0.69 / -0.4%
tpcds_q47/datafusion:vortex-file-compressed 175750348 / 176930862 / -0.7% 221252596 / 217533458 / +1.7% 0.79 / 0.81 / -2.3%
tpcds_q48/datafusion:vortex-file-compressed 36828684 / 35477019 / +3.8% 72721946 / 70167195 / +3.6% 0.51 / 0.51 / +0.2%
tpcds_q49/datafusion:vortex-file-compressed 79150855 / 79901468 / -0.9% 120095792 / 120233831 / -0.1% 0.66 / 0.66 / -0.8%
tpcds_q50/datafusion:vortex-file-compressed 55131562 / 56310110 / -2.1% 89313559 / 89046429 / +0.3% 0.62 / 0.63 / -2.4%
tpcds_q51/datafusion:vortex-file-compressed 244156656 / 241461239 / +1.1% 286945846 / 280306123 / +2.4% 0.85 / 0.86 / -1.2%
tpcds_q52/datafusion:vortex-file-compressed 14537215 / 14942948 / -2.7% 42358442 / 41146983 / +2.9% 0.34 / 0.36 / -5.5%
tpcds_q53/datafusion:vortex-file-compressed 22874129 / 23025893 / -0.7% 54030463 / 52394142 / +3.1% 0.42 / 0.44 / -3.7%
tpcds_q54/datafusion:vortex-file-compressed 57304806 / 59630808 / -3.9% 93183897 / 92798502 / +0.4% 0.61 / 0.64 / -4.3%
tpcds_q55/datafusion:vortex-file-compressed 14071283 / 15209610 / -7.5% 40288859 / 39200802 / +2.8% 0.35 / 0.39 / -10.0%
tpcds_q56/datafusion:vortex-file-compressed 33054125 / 34211642 / -3.4% 63924640 / 63579406 / +0.5% 0.52 / 0.54 / -3.9%
tpcds_q57/datafusion:vortex-file-compressed 131612873 / 130827096 / +0.6% 161960018 / 162474233 / -0.3% 0.81 / 0.81 / +0.9%
tpcds_q58/datafusion:vortex-file-compressed 48593086 / 49071762 / -1.0% 85738825 / 84738612 / +1.2% 0.57 / 0.58 / -2.1%
tpcds_q59/datafusion:vortex-file-compressed 54450364 / 54936949 / -0.9% 84344660 / 85696270 / -1.6% 0.65 / 0.64 / +0.7%
tpcds_q60/datafusion:vortex-file-compressed 33992459 / 34485962 / -1.4% 66863425 / 66114270 / +1.1% 0.51 / 0.52 / -2.5%
tpcds_q61/datafusion:vortex-file-compressed 45444216 / 45202724 / +0.5% 73898085 / 70916447 / +4.2% 0.61 / 0.64 / -3.5%
tpcds_q62/datafusion:vortex-file-compressed 19243678 / 19841460 / -3.0% 42911637 / 43084349 / -0.4% 0.45 / 0.46 / -2.6%
tpcds_q63/datafusion:vortex-file-compressed 22695869 / 22619521 / +0.3% 51852503 / 49716174 / +4.3% 0.44 / 0.45 / -3.8%
tpcds_q64/datafusion:vortex-file-compressed 330840927 / 332776120 / -0.6% 395747693 / 399340320 / -0.9% 0.84 / 0.83 / +0.3%
tpcds_q65/datafusion:vortex-file-compressed 73374490 / 73751860 / -0.5% 111171097 / 110569158 / +0.5% 0.66 / 0.67 / -1.1%
tpcds_q66/datafusion:vortex-file-compressed 53450893 / 52486634 / +1.8% 78039565 / 77837826 / +0.3% 0.68 / 0.67 / +1.6%
tpcds_q67/datafusion:vortex-file-compressed 420354390 / 420503111 / -0.0% 522369950 / 528828691 / -1.2% 0.80 / 0.80 / +1.2%
tpcds_q68/datafusion:vortex-file-compressed 65673308 / 66831493 / -1.7% 102722799 / 99391180 / +3.4% 0.64 / 0.67 / -4.9%
tpcds_q69/datafusion:vortex-file-compressed 34773950 / 36278824 / -4.1% 63426968 / 63625322 / -0.3% 0.55 / 0.57 / -3.8%
tpcds_q70/datafusion:vortex-file-compressed 195872056 / 194497137 / +0.7% 224178624 / 232217411 / -3.5% 0.87 / 0.84 / +4.3%
tpcds_q71/datafusion:vortex-file-compressed 25597434 / 25424784 / +0.7% 60781846 / 61267492 / -0.8% 0.42 / 0.41 / +1.5%
tpcds_q72/datafusion:vortex-file-compressed 1674414237 / 1575229677 / +6.3% 1660739648 / 1696144047 / -2.1% 1.01 / 0.93 / +8.6%
tpcds_q73/datafusion:vortex-file-compressed 38375888 / 38589712 / -0.6% 66163400 / 62969996 / +5.1% 0.58 / 0.61 / -5.4%
tpcds_q74/datafusion:vortex-file-compressed 134097144 / 134601274 / -0.4% 170916581 / 173765353 / -1.6% 0.78 / 0.77 / +1.3%
tpcds_q75/datafusion:vortex-file-compressed 154656184 / 155633299 / -0.6% 196724494 / 198511793 / -0.9% 0.79 / 0.78 / +0.3%
tpcds_q76/datafusion:vortex-file-compressed 33681014 / 34722660 / -3.0% 74765283 / 73189101 / +2.2% 0.45 / 0.47 / -5.0%
tpcds_q77/datafusion:vortex-file-compressed 55127562 / 54175824 / +1.8% 92136165 / 87493805 / +5.3% 0.60 / 0.62 / -3.4%
tpcds_q78/datafusion:vortex-file-compressed 141288667 / 140889933 / +0.3% 193080965 / 191779256 / +0.7% 0.73 / 0.73 / -0.4%
tpcds_q79/datafusion:vortex-file-compressed 52939520 / 53408896 / -0.9% 83224505 / 83137730 / +0.1% 0.64 / 0.64 / -1.0%
tpcds_q80/datafusion:vortex-file-compressed 80202911 / 80795658 / -0.7% 132866904 / 127799771 / +4.0% 0.60 / 0.63 / -4.5%
tpcds_q81/datafusion:vortex-file-compressed 56016496 / 55975548 / +0.1% 85821587 / 83846761 / +2.4% 0.65 / 0.67 / -2.2%
tpcds_q82/datafusion:vortex-file-compressed 30905960 / 30549740 / +1.2% 62712455 / 48106493 / +30.4% 🔴 0.49 / 0.64 / -22.4%
tpcds_q83/datafusion:vortex-file-compressed 42175814 / 42358020 / -0.4% 66227577 / 65597866 / +1.0% 0.64 / 0.65 / -1.4%
tpcds_q84/datafusion:vortex-file-compressed 12830511 / 12799204 / +0.2% 32452802 / 30970538 / +4.8% 0.40 / 0.41 / -4.3%
tpcds_q85/datafusion:vortex-file-compressed 60154960 / 60660052 / -0.8% 88110986 / 90654953 / -2.8% 0.68 / 0.67 / +2.0%
tpcds_q86/datafusion:vortex-file-compressed 18438622 / 18272155 / +0.9% 39034016 / 40425570 / -3.4% 0.47 / 0.45 / +4.5%
tpcds_q87/datafusion:vortex-file-compressed 78776699 / 79615489 / -1.1% 107314831 / 107689679 / -0.3% 0.73 / 0.74 / -0.7%
tpcds_q88/datafusion:vortex-file-compressed 54126797 / 56206700 / -3.7% 92983512 / 93094539 / -0.1% 0.58 / 0.60 / -3.6%
tpcds_q89/datafusion:vortex-file-compressed 26644511 / 26931306 / -1.1% 54958574 / 56072635 / -2.0% 0.48 / 0.48 / +0.9%
tpcds_q90/datafusion:vortex-file-compressed 12885552 / 12758200 / +1.0% 32976258 / 34107490 / -3.3% 0.39 / 0.37 / +4.5%
tpcds_q91/datafusion:vortex-file-compressed 19168012 / 19519254 / -1.8% 44993407 / 42141655 / +6.8% 0.43 / 0.46 / -8.0%
tpcds_q92/datafusion:vortex-file-compressed 14959417 / 15245025 / -1.9% 35903694 / 33922326 / +5.8% 0.42 / 0.45 / -7.3%
tpcds_q93/datafusion:vortex-file-compressed 55615678 / 54842766 / +1.4% 91680990 / 88696680 / +3.4% 0.61 / 0.62 / -1.9%
tpcds_q94/datafusion:vortex-file-compressed 21976200 / 21620928 / +1.6% 47354329 / 46231785 / +2.4% 0.46 / 0.47 / -0.8%
tpcds_q95/datafusion:vortex-file-compressed 94060446 / 95000299 / -1.0% 130299276 / 123858370 / +5.2% 0.72 / 0.77 / -5.9%
tpcds_q96/datafusion:vortex-file-compressed 11270907 / 11533278 / -2.3% 32207039 / 31102793 / +3.6% 0.35 / 0.37 / -5.6%
tpcds_q97/datafusion:vortex-file-compressed 39583906 / 39467840 / +0.3% 67142986 / 66425488 / +1.1% 0.59 / 0.59 / -0.8%
tpcds_q98/datafusion:vortex-file-compressed 20832242 / 20665282 / +0.8% 50887051 / 48509099 / +4.9% 0.41 / 0.43 / -3.9%
tpcds_q99/datafusion:vortex-file-compressed 29538248 / 29545800 / -0.0% 48647677 / 48862458 / -0.4% 0.61 / 0.60 / +0.4%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59182724 / 59408052 / -0.4% 78619862 / 82373568 / -4.6% 0.75 / 0.72 / +4.4%
tpcds_q02/datafusion:parquet 68105584 / 69761366 / -2.4% 92047961 / 90812813 / +1.4% 0.74 / 0.77 / -3.7%
tpcds_q03/datafusion:parquet 29079134 / 28478768 / +2.1% 48740618 / 49334251 / -1.2% 0.60 / 0.58 / +3.4%
tpcds_q04/datafusion:parquet 644311906 / 642610250 / +0.3% 711349088 / 708231753 / +0.4% 0.91 / 0.91 / -0.2%
tpcds_q05/datafusion:parquet 82739134 / 81388832 / +1.7% 107077913 / 113800720 / -5.9% 0.77 / 0.72 / +8.0%
tpcds_q06/datafusion:parquet 91066763 / 90852955 / +0.2% 113934663 / 115952402 / -1.7% 0.80 / 0.78 / +2.0%
tpcds_q07/datafusion:parquet 100864019 / 101418282 / -0.5% 131116576 / 133695330 / -1.9% 0.77 / 0.76 / +1.4%
tpcds_q08/datafusion:parquet 49299356 / 48684130 / +1.3% 70936470 / 74133519 / -4.3% 0.69 / 0.66 / +5.8%
tpcds_q09/datafusion:parquet 76198521 / 75160834 / +1.4% 101890036 / 102849415 / -0.9% 0.75 / 0.73 / +2.3%
tpcds_q10/datafusion:parquet 59087925 / 60416750 / -2.2% 81256649 / 84947233 / -4.3% 0.73 / 0.71 / +2.2%
tpcds_q11/datafusion:parquet 411005305 / 412444870 / -0.3% 455199770 / 461294550 / -1.3% 0.90 / 0.89 / +1.0%
tpcds_q12/datafusion:parquet 39857328 / 39871562 / -0.0% 58042835 / 57128529 / +1.6% 0.69 / 0.70 / -1.6%
tpcds_q13/datafusion:parquet 85792428 / 84637846 / +1.4% 132484018 / 130466094 / +1.5% 0.65 / 0.65 / -0.2%
tpcds_q14/datafusion:parquet 382716562 / 378360104 / +1.2% 406596436 / 433388374 / -6.2% 0.94 / 0.87 / +7.8%
tpcds_q15/datafusion:parquet 50369214 / 51502606 / -2.2% 71966940 / 72303263 / -0.5% 0.70 / 0.71 / -1.7%
tpcds_q16/datafusion:parquet 45166480 / 45710882 / -1.2% 63326588 / 63650471 / -0.5% 0.71 / 0.72 / -0.7%
tpcds_q17/datafusion:parquet 138093422 / 138067928 / +0.0% 169706752 / 172187136 / -1.4% 0.81 / 0.80 / +1.5%
tpcds_q18/datafusion:parquet 107902424 / 110369917 / -2.2% 142067508 / 144952536 / -2.0% 0.76 / 0.76 / -0.3%
tpcds_q19/datafusion:parquet 48025118 / 48384048 / -0.7% 77750430 / 75539146 / +2.9% 0.62 / 0.64 / -3.6%
tpcds_q20/datafusion:parquet 41557082 / 41512735 / +0.1% 54368420 / 55090816 / -1.3% 0.76 / 0.75 / +1.4%
tpcds_q21/datafusion:parquet 60704610 / 61141701 / -0.7% 74124237 / 73095747 / +1.4% 0.82 / 0.84 / -2.1%
tpcds_q22/datafusion:parquet 465825135 / 464195324 / +0.4% 496244325 / 478139930 / +3.8% 0.94 / 0.97 / -3.3%
tpcds_q23/datafusion:parquet 366248672 / 357626356 / +2.4% 411536157 / 417833459 / -1.5% 0.89 / 0.86 / +4.0%
tpcds_q24/datafusion:parquet 242855520 / 241331307 / +0.6% 277469508 / 278266611 / -0.3% 0.88 / 0.87 / +0.9%
tpcds_q25/datafusion:parquet 144278918 / 146902811 / -1.8% 189380445 / 196039200 / -3.4% 0.76 / 0.75 / +1.7%
tpcds_q26/datafusion:parquet 55035842 / 53821080 / +2.3% 78404554 / 80565923 / -2.7% 0.70 / 0.67 / +5.1%
tpcds_q27/datafusion:parquet 211757619 / 210089836 / +0.8% 238493917 / 235911774 / +1.1% 0.89 / 0.89 / -0.3%
tpcds_q28/datafusion:parquet 86328554 / 86784142 / -0.5% 121505909 / 119280232 / +1.9% 0.71 / 0.73 / -2.3%
tpcds_q29/datafusion:parquet 140228450 / 145820741 / -3.8% 182615035 / 175411233 / +4.1% 0.77 / 0.83 / -7.6%
tpcds_q30/datafusion:parquet 98907209 / 99608501 / -0.7% 123082630 / 120071149 / +2.5% 0.80 / 0.83 / -3.1%
tpcds_q31/datafusion:parquet 317094120 / 319058792 / -0.6% 343543471 / 344041143 / -0.1% 0.92 / 0.93 / -0.5%
tpcds_q32/datafusion:parquet 29447866 / 29399552 / +0.2% 43391224 / 43643939 / -0.6% 0.68 / 0.67 / +0.7%
tpcds_q33/datafusion:parquet 51787642 / 51971680 / -0.4% 75532972 / 76538194 / -1.3% 0.69 / 0.68 / +1.0%
tpcds_q34/datafusion:parquet 63478760 / 65511648 / -3.1% 85862049 / 85276600 / +0.7% 0.74 / 0.77 / -3.8%
tpcds_q35/datafusion:parquet 123949888 / 126922984 / -2.3% 153269179 / 150646646 / +1.7% 0.81 / 0.84 / -4.0%
tpcds_q36/datafusion:parquet 98195157 / 97863638 / +0.3% 128409813 / 126419427 / +1.6% 0.76 / 0.77 / -1.2%
tpcds_q37/datafusion:parquet 49232524 / 50046237 / -1.6% 64251140 / 65033749 / -1.2% 0.77 / 0.77 / -0.4%
tpcds_q38/datafusion:parquet 121722424 / 122147195 / -0.3% 147916641 / 145034869 / +2.0% 0.82 / 0.84 / -2.3%
tpcds_q39/datafusion:parquet 852427862 / 846526498 / +0.7% 859932774 / 859437879 / +0.1% 0.99 / 0.98 / +0.6%
tpcds_q40/datafusion:parquet 35004722 / 35936465 / -2.6% 56851534 / 54650564 / +4.0% 0.62 / 0.66 / -6.4%
tpcds_q41/datafusion:parquet 31766830 / 31200319 / +1.8% 43427135 / 42657926 / +1.8% 0.73 / 0.73 / +0.0%
tpcds_q42/datafusion:parquet 25844462 / 25952126 / -0.4% 47340758 / 43716014 / +8.3% 0.55 / 0.59 / -8.0%
tpcds_q43/datafusion:parquet 27443286 / 27372783 / +0.3% 49872177 / 46844617 / +6.5% 0.55 / 0.58 / -5.8%
tpcds_q44/datafusion:parquet 66143155 / 65006033 / +1.7% 86092843 / 87803178 / -1.9% 0.77 / 0.74 / +3.8%
tpcds_q45/datafusion:parquet 65587727 / 66536274 / -1.4% 87154007 / 87212845 / -0.1% 0.75 / 0.76 / -1.4%
tpcds_q46/datafusion:parquet 108421090 / 106805720 / +1.5% 150129473 / 153607976 / -2.3% 0.72 / 0.70 / +3.9%
tpcds_q47/datafusion:parquet 236847980 / 237808994 / -0.4% 274659381 / 273252482 / +0.5% 0.86 / 0.87 / -0.9%
tpcds_q48/datafusion:parquet 78754770 / 76955857 / +2.3% 106341458 / 105870247 / +0.4% 0.74 / 0.73 / +1.9%
tpcds_q49/datafusion:parquet 113867026 / 118898020 / -4.2% 163994652 / 170084458 / -3.6% 0.69 / 0.70 / -0.7%
tpcds_q50/datafusion:parquet 92425186 / 92705258 / -0.3% 124744266 / 120435148 / +3.6% 0.74 / 0.77 / -3.7%
tpcds_q51/datafusion:parquet 255509810 / 254091982 / +0.6% 276872728 / 289211985 / -4.3% 0.92 / 0.88 / +5.0%
tpcds_q52/datafusion:parquet 26660078 / 26889958 / -0.9% 47612027 / 45469536 / +4.7% 0.56 / 0.59 / -5.3%
tpcds_q53/datafusion:parquet 36337076 / 36382336 / -0.1% 58847190 / 57842390 / +1.7% 0.62 / 0.63 / -1.8%
tpcds_q54/datafusion:parquet 86528704 / 85254806 / +1.5% 106677186 / 109551589 / -2.6% 0.81 / 0.78 / +4.2%
tpcds_q55/datafusion:parquet 26123370 / 26510566 / -1.5% 45842429 / 46645823 / -1.7% 0.57 / 0.57 / +0.3%
tpcds_q56/datafusion:parquet 53487254 / 54094848 / -1.1% 74823265 / 77335323 / -3.2% 0.71 / 0.70 / +2.2%
tpcds_q57/datafusion:parquet 170948638 / 171894920 / -0.6% 194975091 / 193978047 / +0.5% 0.88 / 0.89 / -1.1%
tpcds_q58/datafusion:parquet 96996608 / 98465482 / -1.5% 124641700 / 125032548 / -0.3% 0.78 / 0.79 / -1.2%
tpcds_q59/datafusion:parquet 105056078 / 103659830 / +1.3% 132628677 / 130225505 / +1.8% 0.79 / 0.80 / -0.5%
tpcds_q60/datafusion:parquet 55665791 / 55741260 / -0.1% 78985759 / 78220449 / +1.0% 0.70 / 0.71 / -1.1%
tpcds_q61/datafusion:parquet 72766908 / 78001000 / -6.7% 98160738 / 106432779 / -7.8% 0.74 / 0.73 / +1.2%
tpcds_q62/datafusion:parquet 27647072 / 27762318 / -0.4% 46249565 / 44527940 / +3.9% 0.60 / 0.62 / -4.1%
tpcds_q63/datafusion:parquet 35983744 / 36196190 / -0.6% 60320137 / 58834211 / +2.5% 0.60 / 0.62 / -3.0%
tpcds_q64/datafusion:parquet 657476070 / 659557758 / -0.3% 737172727 / 742173662 / -0.7% 0.89 / 0.89 / +0.4%
tpcds_q65/datafusion:parquet 101314336 / 100715906 / +0.6% 136866079 / 133981634 / +2.2% 0.74 / 0.75 / -1.5%
tpcds_q66/datafusion:parquet 76120646 / 76575936 / -0.6% 103015614 / 104374000 / -1.3% 0.74 / 0.73 / +0.7%
tpcds_q67/datafusion:parquet 431917774 / 430912350 / +0.2% 501454630 / 500297658 / +0.2% 0.86 / 0.86 / +0.0%
tpcds_q68/datafusion:parquet 108940017 / 108700552 / +0.2% 155291075 / 156742031 / -0.9% 0.70 / 0.69 / +1.2%
tpcds_q69/datafusion:parquet 60431269 / 61003348 / -0.9% 79476561 / 84325988 / -5.8% 0.76 / 0.72 / +5.1%
tpcds_q70/datafusion:parquet 210804617 / 212975306 / -1.0% 244967193 / 246017700 / -0.4% 0.86 / 0.87 / -0.6%
tpcds_q71/datafusion:parquet 37421012 / 39083124 / -4.3% 66164420 / 64662143 / +2.3% 0.57 / 0.60 / -6.4%
tpcds_q72/datafusion:parquet 1855046728 / 1794732356 / +3.4% 2005829260 / 1806078341 / +11.1% 🔴 0.92 / 0.99 / -6.9%
tpcds_q73/datafusion:parquet 63319674 / 62856255 / +0.7% 87311305 / 84855052 / +2.9% 0.73 / 0.74 / -2.1%
tpcds_q74/datafusion:parquet 293823457 / 292768250 / +0.4% 329378683 / 331483495 / -0.6% 0.89 / 0.88 / +1.0%
tpcds_q75/datafusion:parquet 192649650 / 193794623 / -0.6% 235929501 / 239131737 / -1.3% 0.82 / 0.81 / +0.8%
tpcds_q76/datafusion:parquet 51207020 / 49958244 / +2.5% 82406209 / 78897199 / +4.4% 0.62 / 0.63 / -1.9%
tpcds_q77/datafusion:parquet 72225245 / 73280301 / -1.4% 107038650 / 98096657 / +9.1% 0.67 / 0.75 / -9.7%
tpcds_q78/datafusion:parquet 210223658 / 211119866 / -0.4% 276943908 / 273491694 / +1.3% 0.76 / 0.77 / -1.7%
tpcds_q79/datafusion:parquet 77151868 / 77375078 / -0.3% 112532891 / 112413871 / +0.1% 0.69 / 0.69 / -0.4%
tpcds_q80/datafusion:parquet 146105969 / 143104068 / +2.1% 196361243 / 191975662 / +2.3% 0.74 / 0.75 / -0.2%
tpcds_q81/datafusion:parquet 109215358 / 106756472 / +2.3% 129256135 / 129378123 / -0.1% 0.84 / 0.83 / +2.4%
tpcds_q82/datafusion:parquet 53802714 / 53582485 / +0.4% 66892328 / 70410662 / -5.0% 0.80 / 0.76 / +5.7%
tpcds_q83/datafusion:parquet 66436966 / 66630048 / -0.3% 84538937 / 85136032 / -0.7% 0.79 / 0.78 / +0.4%
tpcds_q84/datafusion:parquet 35423152 / 36220898 / -2.2% 51043002 / 49805351 / +2.5% 0.69 / 0.73 / -4.6%
tpcds_q85/datafusion:parquet 105497848 / 103848480 / +1.6% 132393625 / 129149354 / +2.5% 0.80 / 0.80 / -0.9%
tpcds_q86/datafusion:parquet 21806996 / 22112695 / -1.4% 38747768 / 39672664 / -2.3% 0.56 / 0.56 / +1.0%
tpcds_q87/datafusion:parquet 123326720 / 122470358 / +0.7% 142825220 / 148224625 / -3.6% 0.86 / 0.83 / +4.5%
tpcds_q88/datafusion:parquet 84707242 / 86047137 / -1.6% 107156409 / 108358632 / -1.1% 0.79 / 0.79 / -0.5%
tpcds_q89/datafusion:parquet 39297254 / 38401756 / +2.3% 63334328 / 64923770 / -2.4% 0.62 / 0.59 / +4.9%
tpcds_q90/datafusion:parquet 17135332 / 18100802 / -5.3% 32553266 / 32273520 / +0.9% 0.53 / 0.56 / -6.1%
tpcds_q91/datafusion:parquet 42522186 / 41738000 / +1.9% 60186209 / 57454843 / +4.8% 0.71 / 0.73 / -2.7%
tpcds_q92/datafusion:parquet 29347430 / 28604120 / +2.6% 47596142 / 47460689 / +0.3% 0.62 / 0.60 / +2.3%
tpcds_q93/datafusion:parquet 63738489 / 63722030 / +0.0% 92226520 / 87405909 / +5.5% 0.69 / 0.73 / -5.2%
tpcds_q94/datafusion:parquet 38258866 / 37847109 / +1.1% 57100830 / 58549059 / -2.5% 0.67 / 0.65 / +3.7%
tpcds_q95/datafusion:parquet 123553015 / 128012922 / -3.5% 153236843 / 149910916 / +2.2% 0.81 / 0.85 / -5.6%
tpcds_q96/datafusion:parquet 21021679 / 20691258 / +1.6% 36406495 / 36951345 / -1.5% 0.58 / 0.56 / +3.1%
tpcds_q97/datafusion:parquet 54574630 / 54645566 / -0.1% 79740530 / 80351616 / -0.8% 0.68 / 0.68 / +0.6%
tpcds_q98/datafusion:parquet 61974031 / 61965680 / +0.0% 85535208 / 83775704 / +2.1% 0.72 / 0.74 / -2.0%
tpcds_q99/datafusion:parquet 42441934 / 42461627 / -0.0% 57515406 / 57802802 / -0.5% 0.74 / 0.73 / +0.5%
duckdb / vortex-file-compressed / ns (0.995x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32434950 / 32726779 / -0.9% 45153562 / 45377689 / -0.5% 0.72 / 0.72 / -0.4%
tpcds_q02/duckdb:vortex-file-compressed 29237316 / 30267290 / -3.4% 42029564 / 44087004 / -4.7% 0.70 / 0.69 / +1.3%
tpcds_q03/duckdb:vortex-file-compressed 14047393 / 13779130 / +1.9% 30070122 / 30718899 / -2.1% 0.47 / 0.45 / +4.1%
tpcds_q04/duckdb:vortex-file-compressed 128975501 / 130206338 / -0.9% 152131053 / 157201556 / -3.2% 0.85 / 0.83 / +2.4%
tpcds_q05/duckdb:vortex-file-compressed 54387996 / 53727511 / +1.2% 79946856 / 83478676 / -4.2% 0.68 / 0.64 / +5.7%
tpcds_q06/duckdb:vortex-file-compressed 57823442 / 58800986 / -1.7% 78376462 / 79094008 / -0.9% 0.74 / 0.74 / -0.8%
tpcds_q07/duckdb:vortex-file-compressed 30169761 / 31168844 / -3.2% 54486333 / 54099517 / +0.7% 0.55 / 0.58 / -3.9%
tpcds_q08/duckdb:vortex-file-compressed 30998188 / 31134683 / -0.4% 42782030 / 41772800 / +2.4% 0.72 / 0.75 / -2.8%
tpcds_q09/duckdb:vortex-file-compressed 57042680 / 55235330 / +3.3% 79379597 / 79107779 / +0.3% 0.72 / 0.70 / +2.9%
tpcds_q10/duckdb:vortex-file-compressed 39367178 / 39038430 / +0.8% 57967735 / 58236826 / -0.5% 0.68 / 0.67 / +1.3%
tpcds_q11/duckdb:vortex-file-compressed 95818518 / 96226126 / -0.4% 113434963 / 112266994 / +1.0% 0.84 / 0.86 / -1.4%
tpcds_q12/duckdb:vortex-file-compressed 16893058 / 17276975 / -2.2% 29611842 / 30254952 / -2.1% 0.57 / 0.57 / -0.1%
tpcds_q13/duckdb:vortex-file-compressed 38251209 / 38940578 / -1.8% 71697016 / 71103229 / +0.8% 0.53 / 0.55 / -2.6%
tpcds_q14/duckdb:vortex-file-compressed 117629824 / 119983268 / -2.0% 136480738 / 140641737 / -3.0% 0.86 / 0.85 / +1.0%
tpcds_q15/duckdb:vortex-file-compressed 60680839 / 60759281 / -0.1% 73217889 / 76171754 / -3.9% 0.83 / 0.80 / +3.9%
tpcds_q16/duckdb:vortex-file-compressed 34762704 / 34771337 / -0.0% 52589955 / 53890958 / -2.4% 0.66 / 0.65 / +2.4%
tpcds_q17/duckdb:vortex-file-compressed 57452953 / 57289182 / +0.3% 80072416 / 81955246 / -2.3% 0.72 / 0.70 / +2.6%
tpcds_q18/duckdb:vortex-file-compressed 82984892 / 82993345 / -0.0% 101966315 / 104424434 / -2.4% 0.81 / 0.79 / +2.4%
tpcds_q19/duckdb:vortex-file-compressed 44604920 / 43899722 / +1.6% 63140992 / 65276395 / -3.3% 0.71 / 0.67 / +5.0%
tpcds_q20/duckdb:vortex-file-compressed 21815831 / 21520304 / +1.4% 35004943 / 34931964 / +0.2% 0.62 / 0.62 / +1.2%
tpcds_q21/duckdb:vortex-file-compressed 28101778 / 28120830 / -0.1% 63722446 / 62004166 / +2.8% 0.44 / 0.45 / -2.8%
tpcds_q22/duckdb:vortex-file-compressed 162162110 / 165099230 / -1.8% 175625362 / 170541662 / +3.0% 0.92 / 0.97 / -4.6%
tpcds_q23/duckdb:vortex-file-compressed 180388080 / 185876490 / -3.0% 197273345 / 199673618 / -1.2% 0.91 / 0.93 / -1.8%
tpcds_q24/duckdb:vortex-file-compressed 52136146 / 52636914 / -1.0% 75831634 / 77254623 / -1.8% 0.69 / 0.68 / +0.9%
tpcds_q25/duckdb:vortex-file-compressed 53524045 / 53220034 / +0.6% 76180404 / 75302591 / +1.2% 0.70 / 0.71 / -0.6%
tpcds_q26/duckdb:vortex-file-compressed 26140172 / 26713063 / -2.1% 42355800 / 42934826 / -1.3% 0.62 / 0.62 / -0.8%
tpcds_q27/duckdb:vortex-file-compressed 32359908 / 32585874 / -0.7% 53327973 / 53424233 / -0.2% 0.61 / 0.61 / -0.5%
tpcds_q28/duckdb:vortex-file-compressed 42012210 / 41342696 / +1.6% 62414663 / 66089322 / -5.6% 0.67 / 0.63 / +7.6%
tpcds_q29/duckdb:vortex-file-compressed 51637578 / 51866994 / -0.4% 76050613 / 74066949 / +2.7% 0.68 / 0.70 / -3.0%
tpcds_q30/duckdb:vortex-file-compressed 38088626 / 37914817 / +0.5% 53529085 / 52960815 / +1.1% 0.71 / 0.72 / -0.6%
tpcds_q31/duckdb:vortex-file-compressed 37091988 / 37512062 / -1.1% 52971676 / 53392186 / -0.8% 0.70 / 0.70 / -0.3%
tpcds_q32/duckdb:vortex-file-compressed 13516884 / 13855892 / -2.4% 28497515 / 28855272 / -1.2% 0.47 / 0.48 / -1.2%
tpcds_q33/duckdb:vortex-file-compressed 34582548 / 33813963 / +2.3% 58033237 / 59046480 / -1.7% 0.60 / 0.57 / +4.1%
tpcds_q34/duckdb:vortex-file-compressed 22860422 / 22811725 / +0.2% 40189605 / 39776812 / +1.0% 0.57 / 0.57 / -0.8%
tpcds_q35/duckdb:vortex-file-compressed 67542356 / 66786588 / +1.1% 88561567 / 85242000 / +3.9% 0.76 / 0.78 / -2.7%
tpcds_q36/duckdb:vortex-file-compressed 28892576 / 29806828 / -3.1% 48092627 / 49308472 / -2.5% 0.60 / 0.60 / -0.6%
tpcds_q37/duckdb:vortex-file-compressed 25463922 / 25605208 / -0.6% 73139290 / 74457214 / -1.8% 0.35 / 0.34 / +1.2%
tpcds_q38/duckdb:vortex-file-compressed 63450650 / 62408870 / +1.7% 74523116 / 81156842 / -8.2% 0.85 / 0.77 / +10.7%
tpcds_q39/duckdb:vortex-file-compressed 54570334 / 56168904 / -2.8% 83119604 / 85127364 / -2.4% 0.66 / 0.66 / -0.5%
tpcds_q40/duckdb:vortex-file-compressed 18652743 / 19238372 / -3.0% 34575727 / 35099919 / -1.5% 0.54 / 0.55 / -1.6%
tpcds_q41/duckdb:vortex-file-compressed 19200234 / 18720698 / +2.6% 25784654 / 25500417 / +1.1% 0.74 / 0.73 / +1.4%
tpcds_q42/duckdb:vortex-file-compressed 14532074 / 14015144 / +3.7% 33191356 / 30966847 / +7.2% 0.44 / 0.45 / -3.3%
tpcds_q43/duckdb:vortex-file-compressed 19345243 / 19403602 / -0.3% 30566141 / 32011378 / -4.5% 0.63 / 0.61 / +4.4%
tpcds_q44/duckdb:vortex-file-compressed 27943114 / 28307018 / -1.3% 47846303 / 51668551 / -7.4% 0.58 / 0.55 / +6.6%
tpcds_q45/duckdb:vortex-file-compressed 45814932 / 46586273 / -1.7% 59233923 / 60370446 / -1.9% 0.77 / 0.77 / +0.2%
tpcds_q46/duckdb:vortex-file-compressed 51196960 / 51192653 / +0.0% 75090055 / 75043524 / +0.1% 0.68 / 0.68 / -0.1%
tpcds_q47/duckdb:vortex-file-compressed 79879729 / 80927444 / -1.3% 94041073 / 97094785 / -3.1% 0.85 / 0.83 / +1.9%
tpcds_q48/duckdb:vortex-file-compressed 53028322 / 53155386 / -0.2% 78686113 / 81823473 / -3.8% 0.67 / 0.65 / +3.7%
tpcds_q49/duckdb:vortex-file-compressed 38108070 / 37950044 / +0.4% 77922871 / 78847393 / -1.2% 0.49 / 0.48 / +1.6%
tpcds_q50/duckdb:vortex-file-compressed 32143327 / 32675461 / -1.6% 56374976 / 57051911 / -1.2% 0.57 / 0.57 / -0.4%
tpcds_q51/duckdb:vortex-file-compressed 206145043 / 204779876 / +0.7% 219710505 / 217736852 / +0.9% 0.94 / 0.94 / -0.2%
tpcds_q52/duckdb:vortex-file-compressed 14818612 / 15384257 / -3.7% 30270450 / 31876748 / -5.0% 0.49 / 0.48 / +1.4%
tpcds_q53/duckdb:vortex-file-compressed 22238830 / 22960290 / -3.1% 38960538 / 39000657 / -0.1% 0.57 / 0.59 / -3.0%
tpcds_q54/duckdb:vortex-file-compressed 44622982 / 44886930 / -0.6% 64425656 / 65481173 / -1.6% 0.69 / 0.69 / +1.0%
tpcds_q55/duckdb:vortex-file-compressed 14186370 / 14612501 / -2.9% 30989435 / 30570651 / +1.4% 0.46 / 0.48 / -4.2%
tpcds_q56/duckdb:vortex-file-compressed 32859066 / 32462078 / +1.2% 57599500 / 57717193 / -0.2% 0.57 / 0.56 / +1.4%
tpcds_q57/duckdb:vortex-file-compressed 67557500 / 64171452 / +5.3% 76041750 / 78496038 / -3.1% 0.89 / 0.82 / +8.7%
tpcds_q58/duckdb:vortex-file-compressed 37158534 / 37835588 / -1.8% 59105233 / 64016051 / -7.7% 0.63 / 0.59 / +6.4%
tpcds_q59/duckdb:vortex-file-compressed 56386590 / 53810956 / +4.8% 65014646 / 71107629 / -8.6% 0.87 / 0.76 / +14.6%
tpcds_q60/duckdb:vortex-file-compressed 34424250 / 35369636 / -2.7% 59435427 / 59793701 / -0.6% 0.58 / 0.59 / -2.1%
tpcds_q61/duckdb:vortex-file-compressed 34217896 / 34298255 / -0.2% 53518570 / 53069753 / +0.8% 0.64 / 0.65 / -1.1%
tpcds_q62/duckdb:vortex-file-compressed 16832534 / 14822514 / +13.6% 🔴 26203542 / 26421769 / -0.8% 0.64 / 0.56 / +14.5%
tpcds_q63/duckdb:vortex-file-compressed 21431693 / 20828409 / +2.9% 37910914 / 38114655 / -0.5% 0.57 / 0.55 / +3.4%
tpcds_q64/duckdb:vortex-file-compressed 119157222 / 118342334 / +0.7% 160324205 / 152181613 / +5.4% 0.74 / 0.78 / -4.4%
tpcds_q65/duckdb:vortex-file-compressed 51775908 / 51466061 / +0.6% 60739712 / 58907342 / +3.1% 0.85 / 0.87 / -2.4%
tpcds_q66/duckdb:vortex-file-compressed 40587187 / 40998564 / -1.0% 56957486 / 58858579 / -3.2% 0.71 / 0.70 / +2.3%
tpcds_q67/duckdb:vortex-file-compressed 272264542 / 277425812 / -1.9% 281125526 / 283678837 / -0.9% 0.97 / 0.98 / -1.0%
tpcds_q68/duckdb:vortex-file-compressed 43969234 / 44593714 / -1.4% 71793486 / 72079771 / -0.4% 0.61 / 0.62 / -1.0%
tpcds_q69/duckdb:vortex-file-compressed 37859674 / 38356528 / -1.3% 60608777 / 59755970 / +1.4% 0.62 / 0.64 / -2.7%
tpcds_q70/duckdb:vortex-file-compressed 25160413 / 25085070 / +0.3% 42035461 / 41516746 / +1.2% 0.60 / 0.60 / -0.9%
tpcds_q71/duckdb:vortex-file-compressed 27982048 / 27715436 / +1.0% 50458919 / 50902781 / -0.9% 0.55 / 0.54 / +1.9%
tpcds_q72/duckdb:vortex-file-compressed 138489754 / 135900823 / +1.9% 159661358 / 164226936 / -2.8% 0.87 / 0.83 / +4.8%
tpcds_q73/duckdb:vortex-file-compressed 20187516 / 20089200 / +0.5% 36100718 / 37315276 / -3.3% 0.56 / 0.54 / +3.9%
tpcds_q74/duckdb:vortex-file-compressed 83144968 / 82722980 / +0.5% 103599852 / 99629718 / +4.0% 0.80 / 0.83 / -3.3%
tpcds_q75/duckdb:vortex-file-compressed 110284998 / 111929736 / -1.5% 134726458 / 139908352 / -3.7% 0.82 / 0.80 / +2.3%
tpcds_q76/duckdb:vortex-file-compressed 26849638 / 27219565 / -1.4% 56133825 / 58492855 / -4.0% 0.48 / 0.47 / +2.8%
tpcds_q77/duckdb:vortex-file-compressed 35447884 / 36316546 / -2.4% 60381686 / 62103115 / -2.8% 0.59 / 0.58 / +0.4%
tpcds_q78/duckdb:vortex-file-compressed 135840311 / 137442428 / -1.2% 158425004 / 159793923 / -0.9% 0.86 / 0.86 / -0.3%
tpcds_q79/duckdb:vortex-file-compressed 39518454 / 37665982 / +4.9% 62012718 / 59874325 / +3.6% 0.64 / 0.63 / +1.3%
tpcds_q80/duckdb:vortex-file-compressed 58331748 / 57541290 / +1.4% 92895728 / 89399248 / +3.9% 0.63 / 0.64 / -2.4%
tpcds_q81/duckdb:vortex-file-compressed 56560172 / 57777750 / -2.1% 71417428 / 71231569 / +0.3% 0.79 / 0.81 / -2.4%
tpcds_q82/duckdb:vortex-file-compressed 27030028 / 26860434 / +0.6% 77839259 / 77804956 / +0.0% 0.35 / 0.35 / +0.6%
tpcds_q83/duckdb:vortex-file-compressed 21633312 / 21694036 / -0.3% 30665357 / 32263861 / -5.0% 0.71 / 0.67 / +4.9%
tpcds_q84/duckdb:vortex-file-compressed 13739269 / 13366814 / +2.8% 24626058 / 23226339 / +6.0% 0.56 / 0.58 / -3.1%
tpcds_q85/duckdb:vortex-file-compressed 36736776 / 36707151 / +0.1% 56296897 / 56348206 / -0.1% 0.65 / 0.65 / +0.2%
tpcds_q86/duckdb:vortex-file-compressed 17024112 / 16411782 / +3.7% 27925005 / 28182293 / -0.9% 0.61 / 0.58 / +4.7%
tpcds_q87/duckdb:vortex-file-compressed 72747354 / 75201770 / -3.3% 85621113 / 87749398 / -2.4% 0.85 / 0.86 / -0.9%
tpcds_q88/duckdb:vortex-file-compressed 37575666 / 37878092 / -0.8% 48761439 / 49979733 / -2.4% 0.77 / 0.76 / +1.7%
tpcds_q89/duckdb:vortex-file-compressed 24441632 / 24974289 / -2.1% 40018795 / 41888285 / -4.5% 0.61 / 0.60 / +2.4%
tpcds_q90/duckdb:vortex-file-compressed 9671011 / 9843474 / -1.8% 21104521 / 20353435 / +3.7% 0.46 / 0.48 / -5.2%
tpcds_q91/duckdb:vortex-file-compressed 19654833 / 19617013 / +0.2% 28879169 / 29081972 / -0.7% 0.68 / 0.67 / +0.9%
tpcds_q92/duckdb:vortex-file-compressed 12692499 / 13643566 / -7.0% 26340111 / 27682975 / -4.9% 0.48 / 0.49 / -2.2%
tpcds_q93/duckdb:vortex-file-compressed 24888468 / 25876894 / -3.8% 54830550 / 52613864 / +4.2% 0.45 / 0.49 / -7.7%
tpcds_q94/duckdb:vortex-file-compressed 32320104 / 32152022 / +0.5% 47330267 / 47204449 / +0.3% 0.68 / 0.68 / +0.3%
tpcds_q95/duckdb:vortex-file-compressed 93369006 / 97513786 / -4.3% 105113586 / 117615692 / -10.6% 🟢 0.89 / 0.83 / +7.1%
tpcds_q96/duckdb:vortex-file-compressed 11843614 / 11752061 / +0.8% 24032486 / 24570663 / -2.2% 0.49 / 0.48 / +3.0%
tpcds_q97/duckdb:vortex-file-compressed 61028082 / 62178961 / -1.9% 80497772 / 82766588 / -2.7% 0.76 / 0.75 / +0.9%
tpcds_q98/duckdb:vortex-file-compressed 26973262 / 26889542 / +0.3% 43702344 / 43917859 / -0.5% 0.62 / 0.61 / +0.8%
tpcds_q99/duckdb:vortex-file-compressed 21545572 / 26072871 / -17.4% 🟢 34573491 / 35980286 / -3.9% 0.62 / 0.72 / -14.0%
duckdb / parquet / ns (0.996x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41325282 / 43748750 / -5.5% 49838769 / 50433867 / -1.2% 0.83 / 0.87 / -4.4%
tpcds_q02/duckdb:parquet 38906760 / 39630168 / -1.8% 48818783 / 50715675 / -3.7% 0.80 / 0.78 / +2.0%
tpcds_q03/duckdb:parquet 25091645 / 25995732 / -3.5% 36543338 / 36796166 / -0.7% 0.69 / 0.71 / -2.8%
tpcds_q04/duckdb:parquet 204318100 / 203957459 / +0.2% 232601952 / 234181220 / -0.7% 0.88 / 0.87 / +0.9%
tpcds_q05/duckdb:parquet 68254464 / 68357342 / -0.2% 90626669 / 87464497 / +3.6% 0.75 / 0.78 / -3.6%
tpcds_q06/duckdb:parquet 73893766 / 75115975 / -1.6% 87207234 / 89166769 / -2.2% 0.85 / 0.84 / +0.6%
tpcds_q07/duckdb:parquet 59706126 / 62193874 / -4.0% 81982073 / 76707973 / +6.9% 0.73 / 0.81 / -10.2%
tpcds_q08/duckdb:parquet 37985280 / 38663366 / -1.8% 44200400 / 46394278 / -4.7% 0.86 / 0.83 / +3.1%
tpcds_q09/duckdb:parquet 85870354 / 87080988 / -1.4% 98797918 / 101981323 / -3.1% 0.87 / 0.85 / +1.8%
tpcds_q10/duckdb:parquet 52062300 / 52520572 / -0.9% 63389237 / 62695229 / +1.1% 0.82 / 0.84 / -2.0%
tpcds_q11/duckdb:parquet 157926015 / 159415788 / -0.9% 166865379 / 164104249 / +1.7% 0.95 / 0.97 / -2.6%
tpcds_q12/duckdb:parquet 39716972 / 40814548 / -2.7% 47525536 / 48941959 / -2.9% 0.84 / 0.83 / +0.2%
tpcds_q13/duckdb:parquet 70643828 / 69804706 / +1.2% 91283034 / 87793121 / +4.0% 0.77 / 0.80 / -2.7%
tpcds_q14/duckdb:parquet 185796223 / 185753765 / +0.0% 204312844 / 202864595 / +0.7% 0.91 / 0.92 / -0.7%
tpcds_q15/duckdb:parquet 60879362 / 60934452 / -0.1% 68310061 / 69050398 / -1.1% 0.89 / 0.88 / +1.0%
tpcds_q16/duckdb:parquet 37722325 / 37850674 / -0.3% 46212933 / 45839434 / +0.8% 0.82 / 0.83 / -1.1%
tpcds_q17/duckdb:parquet 82970123 / 84076050 / -1.3% 89418022 / 89860905 / -0.5% 0.93 / 0.94 / -0.8%
tpcds_q18/duckdb:parquet 87461935 / 87775860 / -0.4% 98036050 / 98136096 / -0.1% 0.89 / 0.89 / -0.3%
tpcds_q19/duckdb:parquet 48264620 / 47466565 / +1.7% 58404461 / 63007623 / -7.3% 0.83 / 0.75 / +9.7%
tpcds_q20/duckdb:parquet 42707676 / 42342882 / +0.9% 49459980 / 48573403 / +1.8% 0.86 / 0.87 / -0.9%
tpcds_q21/duckdb:parquet 23886314 / 23962194 / -0.3% 30048246 / 28440652 / +5.7% 0.79 / 0.84 / -5.6%
tpcds_q22/duckdb:parquet 163010871 / 166072912 / -1.8% 161761630 / 167098902 / -3.2% 1.01 / 0.99 / +1.4%
tpcds_q23/duckdb:parquet 184024250 / 188036546 / -2.1% 191335553 / 193148517 / -0.9% 0.96 / 0.97 / -1.2%
tpcds_q24/duckdb:parquet 72028494 / 71146241 / +1.2% 82783664 / 82487151 / +0.4% 0.87 / 0.86 / +0.9%
tpcds_q25/duckdb:parquet 51126160 / 51215258 / -0.2% 60599029 / 61288817 / -1.1% 0.84 / 0.84 / +1.0%
tpcds_q26/duckdb:parquet 42374014 / 42361802 / +0.0% 51226645 / 51343370 / -0.2% 0.83 / 0.83 / +0.3%
tpcds_q27/duckdb:parquet 58008262 / 57111037 / +1.6% 72691716 / 81608147 / -10.9% 🟢 0.80 / 0.70 / +14.0%
tpcds_q28/duckdb:parquet 93260424 / 93252698 / +0.0% 107504820 / 112178597 / -4.2% 0.87 / 0.83 / +4.4%
tpcds_q29/duckdb:parquet 84578744 / 83041768 / +1.9% 101880862 / 96583021 / +5.5% 0.83 / 0.86 / -3.4%
tpcds_q30/duckdb:parquet 71464094 / 72470468 / -1.4% 81118797 / 81148208 / -0.0% 0.88 / 0.89 / -1.4%
tpcds_q31/duckdb:parquet 97643838 / 98601462 / -1.0% 110240238 / 111465299 / -1.1% 0.89 / 0.88 / +0.1%
tpcds_q32/duckdb:parquet 18011518 / 18353748 / -1.9% 25272067 / 26590155 / -5.0% 0.71 / 0.69 / +3.3%
tpcds_q33/duckdb:parquet 59868056 / 62367010 / -4.0% 71847501 / 73989561 / -2.9% 0.83 / 0.84 / -1.1%
tpcds_q34/duckdb:parquet 33243728 / 33006494 / +0.7% 41315724 / 41889230 / -1.4% 0.80 / 0.79 / +2.1%
tpcds_q35/duckdb:parquet 76960339 / 77399391 / -0.6% 87466823 / 86087567 / +1.6% 0.88 / 0.90 / -2.1%
tpcds_q36/duckdb:parquet 96946394 / 99335950 / -2.4% 113411343 / 112263590 / +1.0% 0.85 / 0.88 / -3.4%
tpcds_q37/duckdb:parquet 41220520 / 41378236 / -0.4% 46060978 / 47554095 / -3.1% 0.89 / 0.87 / +2.8%
tpcds_q38/duckdb:parquet 73304446 / 76468258 / -4.1% 81322436 / 85294747 / -4.7% 0.90 / 0.90 / +0.5%
tpcds_q39/duckdb:parquet 60901264 / 61661639 / -1.2% 67173881 / 67797634 / -0.9% 0.91 / 0.91 / -0.3%
tpcds_q40/duckdb:parquet 27792388 / 27952642 / -0.6% 35638952 / 36118029 / -1.3% 0.78 / 0.77 / +0.8%
tpcds_q41/duckdb:parquet 20749840 / 20143537 / +3.0% 26580830 / 26266476 / +1.2% 0.78 / 0.77 / +1.8%
tpcds_q42/duckdb:parquet 26493100 / 26999602 / -1.9% 38772961 / 36451419 / +6.4% 0.68 / 0.74 / -7.8%
tpcds_q43/duckdb:parquet 26804838 / 28272378 / -5.2% 34184873 / 35793884 / -4.5% 0.78 / 0.79 / -0.7%
tpcds_q44/duckdb:parquet 61150752 / 60736375 / +0.7% 77276811 / 74562633 / +3.6% 0.79 / 0.81 / -2.9%
tpcds_q45/duckdb:parquet 61744356 / 60622120 / +1.9% 69430633 / 67027287 / +3.6% 0.89 / 0.90 / -1.7%
tpcds_q46/duckdb:parquet 74326618 / 72394963 / +2.7% 85609390 / 88023341 / -2.7% 0.87 / 0.82 / +5.6%
tpcds_q47/duckdb:parquet 90677550 / 90830810 / -0.2% 108251301 / 105146923 / +3.0% 0.84 / 0.86 / -3.0%
tpcds_q48/duckdb:parquet 65759804 / 67648746 / -2.8% 84575088 / 85359866 / -0.9% 0.78 / 0.79 / -1.9%
tpcds_q49/duckdb:parquet 70563466 / 67399774 / +4.7% 92271028 / 92020170 / +0.3% 0.76 / 0.73 / +4.4%
tpcds_q50/duckdb:parquet 43166046 / 45228659 / -4.6% 53320359 / 50910629 / +4.7% 0.81 / 0.89 / -8.9%
tpcds_q51/duckdb:parquet 214490368 / 217340788 / -1.3% 227945075 / 225257376 / +1.2% 0.94 / 0.96 / -2.5%
tpcds_q52/duckdb:parquet 26559716 / 26490668 / +0.3% 38531969 / 37218058 / +3.5% 0.69 / 0.71 / -3.2%
tpcds_q53/duckdb:parquet 35245406 / 34202255 / +3.0% 47143515 / 48232701 / -2.3% 0.75 / 0.71 / +5.4%
tpcds_q54/duckdb:parquet 55065738 / 55357348 / -0.5% 65393516 / 63307482 / +3.3% 0.84 / 0.87 / -3.7%
tpcds_q55/duckdb:parquet 26605290 / 26580602 / +0.1% 37073738 / 38734658 / -4.3% 0.72 / 0.69 / +4.6%
tpcds_q56/duckdb:parquet 70057932 / 68450543 / +2.3% 77618622 / 84208264 / -7.8% 0.90 / 0.81 / +11.0%
tpcds_q57/duckdb:parquet 68147626 / 67905272 / +0.4% 75556820 / 75530496 / +0.0% 0.90 / 0.90 / +0.3%
tpcds_q58/duckdb:parquet 55191093 / 55351262 / -0.3% 64049823 / 67300961 / -4.8% 0.86 / 0.82 / +4.8%
tpcds_q59/duckdb:parquet 60613427 / 61543058 / -1.5% 69466624 / 67498896 / +2.9% 0.87 / 0.91 / -4.3%
tpcds_q60/duckdb:parquet 81808353 / 81154691 / +0.8% 91204475 / 95719978 / -4.7% 0.90 / 0.85 / +5.8%
tpcds_q61/duckdb:parquet 80165387 / 78725636 / +1.8% 93255353 / 94693948 / -1.5% 0.86 / 0.83 / +3.4%
tpcds_q62/duckdb:parquet 19096720 / 21271646 / -10.2% 🟢 27281639 / 24742108 / +10.3% 🔴 0.70 / 0.86 / -18.6%
tpcds_q63/duckdb:parquet 34323668 / 33973322 / +1.0% 45626535 / 44293841 / +3.0% 0.75 / 0.77 / -1.9%
tpcds_q64/duckdb:parquet 133493299 / 134987804 / -1.1% 155304491 / 149714203 / +3.7% 0.86 / 0.90 / -4.7%
tpcds_q65/duckdb:parquet 97960392 / 92507762 / +5.9% 105238753 / 106732283 / -1.4% 0.93 / 0.87 / +7.4%
tpcds_q66/duckdb:parquet 45391970 / 45574203 / -0.4% 51944481 / 52408182 / -0.9% 0.87 / 0.87 / +0.5%
tpcds_q67/duckdb:parquet 292713742 / 294181831 / -0.5% 299892378 / 294225942 / +1.9% 0.98 / 1.00 / -2.4%
tpcds_q68/duckdb:parquet 62723443 / 61610444 / +1.8% 76816843 / 77643526 / -1.1% 0.82 / 0.79 / +2.9%
tpcds_q69/duckdb:parquet 65877686 / 65821270 / +0.1% 77011419 / 75369095 / +2.2% 0.86 / 0.87 / -2.0%
tpcds_q70/duckdb:parquet 41748740 / 42560156 / -1.9% 54558190 / 50824609 / +7.3% 0.77 / 0.84 / -8.6%
tpcds_q71/duckdb:parquet 39590686 / 41353862 / -4.3% 56375856 / 54241063 / +3.9% 0.70 / 0.76 / -7.9%
tpcds_q72/duckdb:parquet 171417056 / 172146606 / -0.4% 187064622 / 189350126 / -1.2% 0.92 / 0.91 / +0.8%
tpcds_q73/duckdb:parquet 28244238 / 27072398 / +4.3% 36429165 / 37030456 / -1.6% 0.78 / 0.73 / +6.1%
tpcds_q74/duckdb:parquet 214807580 / 216089249 / -0.6% 219681641 / 223017657 / -1.5% 0.98 / 0.97 / +0.9%
tpcds_q75/duckdb:parquet 132708074 / 131891024 / +0.6% 151307870 / 152249842 / -0.6% 0.88 / 0.87 / +1.2%
tpcds_q76/duckdb:parquet 52025342 / 51285484 / +1.4% 63916637 / 65205448 / -2.0% 0.81 / 0.79 / +3.5%
tpcds_q77/duckdb:parquet 54435135 / 54841040 / -0.7% 74921159 / 67440836 / +11.1% 🔴 0.73 / 0.81 / -10.7%
tpcds_q78/duckdb:parquet 144025226 / 155747874 / -7.5% 170822729 / 168363678 / +1.5% 0.84 / 0.93 / -8.9%
tpcds_q79/duckdb:parquet 55332392 / 51430181 / +7.6% 60582084 / 64568583 / -6.2% 0.91 / 0.80 / +14.7%
tpcds_q80/duckdb:parquet 84126694 / 82941310 / +1.4% 102055279 / 103690804 / -1.6% 0.82 / 0.80 / +3.1%
tpcds_q81/duckdb:parquet 97626568 / 98572923 / -1.0% 105331928 / 104274293 / +1.0% 0.93 / 0.95 / -2.0%
tpcds_q82/duckdb:parquet 45389486 / 46604344 / -2.6% 52254043 / 52315928 / -0.1% 0.87 / 0.89 / -2.5%
tpcds_q83/duckdb:parquet 27435048 / 28152398 / -2.5% 32946487 / 33185714 / -0.7% 0.83 / 0.85 / -1.8%
tpcds_q84/duckdb:parquet 22513610 / 22751552 / -1.0% 29451182 / 29406408 / +0.2% 0.76 / 0.77 / -1.2%
tpcds_q85/duckdb:parquet 52197070 / 52752074 / -1.1% 63174808 / 62960389 / +0.3% 0.83 / 0.84 / -1.4%
tpcds_q86/duckdb:parquet 24463068 / 25146913 / -2.7% 33006051 / 33004413 / +0.0% 0.74 / 0.76 / -2.7%
tpcds_q87/duckdb:parquet 87643997 / 88695797 / -1.2% 93601983 / 92564858 / +1.1% 0.94 / 0.96 / -2.3%
tpcds_q88/duckdb:parquet 103704072 / 106796080 / -2.9% 111931485 / 111229279 / +0.6% 0.93 / 0.96 / -3.5%
tpcds_q89/duckdb:parquet 37084145 / 37846748 / -2.0% 46519324 / 48196620 / -3.5% 0.80 / 0.79 / +1.5%
tpcds_q90/duckdb:parquet 15955851 / 15015242 / +6.3% 20320542 / 20928242 / -2.9% 0.79 / 0.72 / +9.4%
tpcds_q91/duckdb:parquet 25603158 / 25515043 / +0.3% 33423329 / 33274247 / +0.4% 0.77 / 0.77 / -0.1%
tpcds_q92/duckdb:parquet 21683836 / 22329364 / -2.9% 32268404 / 31995562 / +0.9% 0.67 / 0.70 / -3.7%
tpcds_q93/duckdb:parquet 37248396 / 35799040 / +4.0% 47746703 / 49479404 / -3.5% 0.78 / 0.72 / +7.8%
tpcds_q94/duckdb:parquet 38766686 / 38247234 / +1.4% 47302152 / 46965479 / +0.7% 0.82 / 0.81 / +0.6%
tpcds_q95/duckdb:parquet 83700798 / 81409130 / +2.8% 87837238 / 86595751 / +1.4% 0.95 / 0.94 / +1.4%
tpcds_q96/duckdb:parquet 17549464 / 17012262 / +3.2% 22687766 / 24425947 / -7.1% 0.77 / 0.70 / +11.1%
tpcds_q97/duckdb:parquet 71291369 / 73153984 / -2.5% 80208341 / 78153554 / +2.6% 0.89 / 0.94 / -5.0%
tpcds_q98/duckdb:parquet 53885592 / 55289756 / -2.5% 65795550 / 66788134 / -1.5% 0.82 / 0.83 / -1.1%
tpcds_q99/duckdb:parquet 28073694 / 24402862 / +15.0% 🔴 32425904 / 30438057 / +6.5% 0.87 / 0.80 / +8.0%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR aea8f377 vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.037x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.021x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21471594 / 21999911 / -2.4% 43137200 / 39946370 / +8.0% 0.50 / 0.55 / -9.6%
tpcds_q02/datafusion:vortex-file-compressed 43319140 / 42893253 / +1.0% 64812670 / 62914880 / +3.0% 0.67 / 0.68 / -2.0%
tpcds_q03/datafusion:vortex-file-compressed 11656522 / 11605178 / +0.4% 32256821 / 26609156 / +21.2% 🔴 0.36 / 0.44 / -17.1%
tpcds_q04/datafusion:vortex-file-compressed 79356860 / 78951654 / +0.5% 110294886 / 104564818 / +5.5% 0.72 / 0.76 / -4.7%
tpcds_q05/datafusion:vortex-file-compressed 56048965 / 55941465 / +0.2% 86551690 / 74124262 / +16.8% 🔴 0.65 / 0.75 / -14.2%
tpcds_q06/datafusion:vortex-file-compressed 21758302 / 21333720 / +2.0% 43397653 / 41069841 / +5.7% 0.50 / 0.52 / -3.5%
tpcds_q07/datafusion:vortex-file-compressed 26616340 / 26386390 / +0.9% 49294761 / 48176326 / +2.3% 0.54 / 0.55 / -1.4%
tpcds_q08/datafusion:vortex-file-compressed 25606809 / 25587712 / +0.1% 45795822 / 43682364 / +4.8% 0.56 / 0.59 / -4.5%
tpcds_q09/datafusion:vortex-file-compressed 20575819 / 19896226 / +3.4% 39017536 / 37474977 / +4.1% 0.53 / 0.53 / -0.7%
tpcds_q10/datafusion:vortex-file-compressed 29970328 / 29546889 / +1.4% 50004739 / 51180613 / -2.3% 0.60 / 0.58 / +3.8%
tpcds_q11/datafusion:vortex-file-compressed 49202178 / 49121194 / +0.2% 76723076 / 75394766 / +1.8% 0.64 / 0.65 / -1.6%
tpcds_q12/datafusion:vortex-file-compressed 14797570 / 14946749 / -1.0% 34141958 / 31749886 / +7.5% 0.43 / 0.47 / -7.9%
tpcds_q13/datafusion:vortex-file-compressed 31427223 / 31860550 / -1.4% 59912605 / 53865238 / +11.2% 🔴 0.52 / 0.59 / -11.3%
tpcds_q14/datafusion:vortex-file-compressed 488741141 / 487421370 / +0.3% 545512630 / 542474028 / +0.6% 0.90 / 0.90 / -0.3%
tpcds_q15/datafusion:vortex-file-compressed 12593680 / 12586756 / +0.1% 32893287 / 29869991 / +10.1% 🔴 0.38 / 0.42 / -9.1%
tpcds_q16/datafusion:vortex-file-compressed 19050770 / 18761618 / +1.5% 39076862 / 37089591 / +5.4% 0.49 / 0.51 / -3.6%
tpcds_q17/datafusion:vortex-file-compressed 52689702 / 53607682 / -1.7% 78235933 / 70072689 / +11.6% 🔴 0.67 / 0.77 / -12.0%
tpcds_q18/datafusion:vortex-file-compressed 63599852 / 62349632 / +2.0% 92647470 / 88633124 / +4.5% 0.69 / 0.70 / -2.4%
tpcds_q19/datafusion:vortex-file-compressed 17198056 / 17064877 / +0.8% 43784332 / 38137570 / +14.8% 🔴 0.39 / 0.45 / -12.2%
tpcds_q20/datafusion:vortex-file-compressed 16982514 / 16875604 / +0.6% 34899522 / 33398462 / +4.5% 0.49 / 0.51 / -3.7%
tpcds_q21/datafusion:vortex-file-compressed 15402226 / 14801170 / +4.1% 35735228 / 32973615 / +8.4% 0.43 / 0.45 / -4.0%
tpcds_q22/datafusion:vortex-file-compressed 48954470 / 49325762 / -0.8% 71246989 / 67699156 / +5.2% 0.69 / 0.73 / -5.7%
tpcds_q23/datafusion:vortex-file-compressed 70923447 / 72276124 / -1.9% 98729631 / 97272882 / +1.5% 0.72 / 0.74 / -3.3%
tpcds_q24/datafusion:vortex-file-compressed 64047959 / 63926868 / +0.2% 86897829 / 83129432 / +4.5% 0.74 / 0.77 / -4.2%
tpcds_q25/datafusion:vortex-file-compressed 44600493 / 44475855 / +0.3% 72607397 / 66779639 / +8.7% 0.61 / 0.67 / -7.8%
tpcds_q26/datafusion:vortex-file-compressed 26187511 / 26101808 / +0.3% 46680710 / 45977400 / +1.5% 0.56 / 0.57 / -1.2%
tpcds_q27/datafusion:vortex-file-compressed 53866407 / 53289153 / +1.1% 72243568 / 76338183 / -5.4% 0.75 / 0.70 / +6.8%
tpcds_q28/datafusion:vortex-file-compressed 19138008 / 19381416 / -1.3% 37234771 / 39922526 / -6.7% 0.51 / 0.49 / +5.9%
tpcds_q29/datafusion:vortex-file-compressed 52131112 / 52347589 / -0.4% 76008621 / 73566264 / +3.3% 0.69 / 0.71 / -3.6%
tpcds_q30/datafusion:vortex-file-compressed 27629468 / 27661427 / -0.1% 47763471 / 45075272 / +6.0% 0.58 / 0.61 / -5.7%
tpcds_q31/datafusion:vortex-file-compressed 62753519 / 62516696 / +0.4% 93437863 / 87634339 / +6.6% 0.67 / 0.71 / -5.9%
tpcds_q32/datafusion:vortex-file-compressed 12952868 / 13025350 / -0.6% 30892309 / 30062663 / +2.8% 0.42 / 0.43 / -3.2%
tpcds_q33/datafusion:vortex-file-compressed 27912606 / 27991706 / -0.3% 53737363 / 50078992 / +7.3% 0.52 / 0.56 / -7.1%
tpcds_q34/datafusion:vortex-file-compressed 17675390 / 17855906 / -1.0% 37527386 / 36650085 / +2.4% 0.47 / 0.49 / -3.3%
tpcds_q35/datafusion:vortex-file-compressed 30608666 / 31075584 / -1.5% 55483777 / 54010849 / +2.7% 0.55 / 0.58 / -4.1%
tpcds_q36/datafusion:vortex-file-compressed 47222328 / 46691248 / +1.1% 70024142 / 69134076 / +1.3% 0.67 / 0.68 / -0.1%
tpcds_q37/datafusion:vortex-file-compressed 12464250 / 12935278 / -3.6% 38444858 / 33965509 / +13.2% 🔴 0.32 / 0.38 / -14.9%
tpcds_q38/datafusion:vortex-file-compressed 26976927 / 26436550 / +2.0% 46996802 / 46500479 / +1.1% 0.57 / 0.57 / +1.0%
tpcds_q39/datafusion:vortex-file-compressed 63875471 / 64408856 / -0.8% 89982817 / 87056639 / +3.4% 0.71 / 0.74 / -4.1%
tpcds_q40/datafusion:vortex-file-compressed 22628566 / 22195258 / +2.0% 42151523 / 39059042 / +7.9% 0.54 / 0.57 / -5.5%
tpcds_q41/datafusion:vortex-file-compressed 21096934 / 20181415 / +4.5% 33110549 / 32305841 / +2.5% 0.64 / 0.62 / +2.0%
tpcds_q42/datafusion:vortex-file-compressed 11476820 / 11610268 / -1.1% 29614724 / 27549864 / +7.5% 0.39 / 0.42 / -8.0%
tpcds_q43/datafusion:vortex-file-compressed 13528818 / 13251107 / +2.1% 35425715 / 31511768 / +12.4% 🔴 0.38 / 0.42 / -9.2%
tpcds_q44/datafusion:vortex-file-compressed 27357188 / 27407222 / -0.2% 52213805 / 49901538 / +4.6% 0.52 / 0.55 / -4.6%
tpcds_q45/datafusion:vortex-file-compressed 17301099 / 17168016 / +0.8% 37013042 / 34200247 / +8.2% 0.47 / 0.50 / -6.9%
tpcds_q46/datafusion:vortex-file-compressed 24082852 / 23558210 / +2.2% 48013837 / 45525195 / +5.5% 0.50 / 0.52 / -3.1%
tpcds_q47/datafusion:vortex-file-compressed 75122684 / 75593490 / -0.6% 108650361 / 103395942 / +5.1% 0.69 / 0.73 / -5.4%
tpcds_q48/datafusion:vortex-file-compressed 28464255 / 28579330 / -0.4% 53867625 / 51250463 / +5.1% 0.53 / 0.56 / -5.2%
tpcds_q49/datafusion:vortex-file-compressed 56480014 / 57212074 / -1.3% 78365252 / 74563681 / +5.1% 0.72 / 0.77 / -6.1%
tpcds_q50/datafusion:vortex-file-compressed 31475122 / 31077502 / +1.3% 54540035 / 51768133 / +5.4% 0.58 / 0.60 / -3.9%
tpcds_q51/datafusion:vortex-file-compressed 67821049 / 67219460 / +0.9% 91344258 / 89984116 / +1.5% 0.74 / 0.75 / -0.6%
tpcds_q52/datafusion:vortex-file-compressed 12062966 / 11829058 / +2.0% 30735125 / 28624926 / +7.4% 0.39 / 0.41 / -5.0%
tpcds_q53/datafusion:vortex-file-compressed 18322368 / 18240894 / +0.4% 41632780 / 37934996 / +9.7% 0.44 / 0.48 / -8.5%
tpcds_q54/datafusion:vortex-file-compressed 32264485 / 32073801 / +0.6% 56927747 / 53625583 / +6.2% 0.57 / 0.60 / -5.2%
tpcds_q55/datafusion:vortex-file-compressed 11687877 / 11528832 / +1.4% 30785422 / 27437884 / +12.2% 🔴 0.38 / 0.42 / -9.6%
tpcds_q56/datafusion:vortex-file-compressed 26979136 / 26666916 / +1.2% 51414567 / 47448670 / +8.4% 0.52 / 0.56 / -6.6%
tpcds_q57/datafusion:vortex-file-compressed 61712804 / 62012122 / -0.5% 92413391 / 87267119 / +5.9% 0.67 / 0.71 / -6.0%
tpcds_q58/datafusion:vortex-file-compressed 40185545 / 40818922 / -1.6% 69055802 / 64518211 / +7.0% 0.58 / 0.63 / -8.0%
tpcds_q59/datafusion:vortex-file-compressed 27404880 / 27906409 / -1.8% 54978298 / 53781464 / +2.2% 0.50 / 0.52 / -3.9%
tpcds_q60/datafusion:vortex-file-compressed 26823400 / 27726237 / -3.3% 50416946 / 47532249 / +6.1% 0.53 / 0.58 / -8.8%
tpcds_q61/datafusion:vortex-file-compressed 20961246 / 20214066 / +3.7% 43349778 / 39682747 / +9.2% 0.48 / 0.51 / -5.1%
tpcds_q62/datafusion:vortex-file-compressed 16511032 / 16850174 / -2.0% 35744002 / 34396629 / +3.9% 0.46 / 0.49 / -5.7%
tpcds_q63/datafusion:vortex-file-compressed 18167804 / 18192128 / -0.1% 41518096 / 37641254 / +10.3% 🔴 0.44 / 0.48 / -9.5%
tpcds_q64/datafusion:vortex-file-compressed 191547164 / 188561892 / +1.6% 224898621 / 229680212 / -2.1% 0.85 / 0.82 / +3.7%
tpcds_q65/datafusion:vortex-file-compressed 74101629 / 73066724 / +1.4% 100277264 / 96562612 / +3.8% 0.74 / 0.76 / -2.3%
tpcds_q66/datafusion:vortex-file-compressed 50280754 / 50096568 / +0.4% 73171934 / 69306342 / +5.6% 0.69 / 0.72 / -4.9%
tpcds_q67/datafusion:vortex-file-compressed 51338993 / 51663640 / -0.6% 86678593 / 83492505 / +3.8% 0.59 / 0.62 / -4.3%
tpcds_q68/datafusion:vortex-file-compressed 22772874 / 22888054 / -0.5% 47942975 / 44101071 / +8.7% 0.47 / 0.52 / -8.5%
tpcds_q69/datafusion:vortex-file-compressed 26266262 / 27546142 / -4.6% 50235721 / 47372016 / +6.0% 0.52 / 0.58 / -10.1%
tpcds_q70/datafusion:vortex-file-compressed 74034306 / 73486667 / +0.7% 98096532 / 97916702 / +0.2% 0.75 / 0.75 / +0.6%
tpcds_q71/datafusion:vortex-file-compressed 19203656 / 19173117 / +0.2% 43570024 / 37641700 / +15.7% 🔴 0.44 / 0.51 / -13.5%
tpcds_q72/datafusion:vortex-file-compressed 249949554 / 247376824 / +1.0% 278629127 / 279389691 / -0.3% 0.90 / 0.89 / +1.3%
tpcds_q73/datafusion:vortex-file-compressed 16552510 / 16283788 / +1.7% 37623934 / 37287301 / +0.9% 0.44 / 0.44 / +0.7%
tpcds_q74/datafusion:vortex-file-compressed 40406480 / 40826743 / -1.0% 67962919 / 66742487 / +1.8% 0.59 / 0.61 / -2.8%
tpcds_q75/datafusion:vortex-file-compressed 135197596 / 133968630 / +0.9% 167355467 / 162666038 / +2.9% 0.81 / 0.82 / -1.9%
tpcds_q76/datafusion:vortex-file-compressed 28854888 / 28638050 / +0.8% 50835211 / 48545831 / +4.7% 0.57 / 0.59 / -3.8%
tpcds_q77/datafusion:vortex-file-compressed 44721127 / 44422120 / +0.7% 69891721 / 65708594 / +6.4% 0.64 / 0.68 / -5.4%
tpcds_q78/datafusion:vortex-file-compressed 60647517 / 60965657 / -0.5% 90297842 / 86015972 / +5.0% 0.67 / 0.71 / -5.2%
tpcds_q79/datafusion:vortex-file-compressed 19737146 / 20279438 / -2.7% 43353677 / 42110377 / +3.0% 0.46 / 0.48 / -5.5%
tpcds_q80/datafusion:vortex-file-compressed 69027692 / 68766030 / +0.4% 98752653 / 93570722 / +5.5% 0.70 / 0.73 / -4.9%
tpcds_q81/datafusion:vortex-file-compressed 28321360 / 28260648 / +0.2% 46946049 / 45300560 / +3.6% 0.60 / 0.62 / -3.3%
tpcds_q82/datafusion:vortex-file-compressed 12458237 / 12807434 / -2.7% 34859535 / 35626130 / -2.2% 0.36 / 0.36 / -0.6%
tpcds_q83/datafusion:vortex-file-compressed 35105033 / 35376074 / -0.8% 54494018 / 52093141 / +4.6% 0.64 / 0.68 / -5.1%
tpcds_q84/datafusion:vortex-file-compressed 10200916 / 10461540 / -2.5% 27867691 / 25885722 / +7.7% 0.37 / 0.40 / -9.4%
tpcds_q85/datafusion:vortex-file-compressed 52778464 / 51809666 / +1.9% 78940221 / 75574697 / +4.5% 0.67 / 0.69 / -2.5%
tpcds_q86/datafusion:vortex-file-compressed 15883176 / 16113415 / -1.4% 34865002 / 34409002 / +1.3% 0.46 / 0.47 / -2.7%
tpcds_q87/datafusion:vortex-file-compressed 26415319 / 26499568 / -0.3% 48257499 / 48598250 / -0.7% 0.55 / 0.55 / +0.4%
tpcds_q88/datafusion:vortex-file-compressed 32722416 / 32357568 / +1.1% 54665032 / 50858837 / +7.5% 0.60 / 0.64 / -5.9%
tpcds_q89/datafusion:vortex-file-compressed 21711418 / 21807304 / -0.4% 45568817 / 42407282 / +7.5% 0.48 / 0.51 / -7.3%
tpcds_q90/datafusion:vortex-file-compressed 10441888 / 10365216 / +0.7% 26264574 / 24066050 / +9.1% 0.40 / 0.43 / -7.7%
tpcds_q91/datafusion:vortex-file-compressed 15412118 / 16048840 / -4.0% 37484880 / 36604324 / +2.4% 0.41 / 0.44 / -6.2%
tpcds_q92/datafusion:vortex-file-compressed 13156142 / 13198902 / -0.3% 32050204 / 29685220 / +8.0% 0.41 / 0.44 / -7.7%
tpcds_q93/datafusion:vortex-file-compressed 20541159 / 20150414 / +1.9% 41606196 / 40148939 / +3.6% 0.49 / 0.50 / -1.6%
tpcds_q94/datafusion:vortex-file-compressed 18798330 / 18552985 / +1.3% 39355652 / 37927246 / +3.8% 0.48 / 0.49 / -2.4%
tpcds_q95/datafusion:vortex-file-compressed 42364590 / 41763500 / +1.4% 64058907 / 60866535 / +5.2% 0.66 / 0.69 / -3.6%
tpcds_q96/datafusion:vortex-file-compressed 7776027 / 7859994 / -1.1% 27205347 / 23576532 / +15.4% 🔴 0.29 / 0.33 / -14.3%
tpcds_q97/datafusion:vortex-file-compressed 17314272 / 17259486 / +0.3% 40021589 / 37350276 / +7.2% 0.43 / 0.46 / -6.4%
tpcds_q98/datafusion:vortex-file-compressed 16089278 / 16185816 / -0.6% 34694717 / 32671739 / +6.2% 0.46 / 0.50 / -6.4%
tpcds_q99/datafusion:vortex-file-compressed 16515794 / 16384194 / +0.8% 34100431 / 33993322 / +0.3% 0.48 / 0.48 / +0.5%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41528010 / 43046149 / -3.5% 59598793 / 59333915 / +0.4% 0.70 / 0.73 / -4.0%
tpcds_q02/datafusion:parquet 54990451 / 55017496 / -0.0% 71057972 / 69006470 / +3.0% 0.77 / 0.80 / -2.9%
tpcds_q03/datafusion:parquet 18973822 / 19078092 / -0.5% 31515184 / 32968281 / -4.4% 0.60 / 0.58 / +4.0%
tpcds_q04/datafusion:parquet 178505437 / 179731768 / -0.7% 208045115 / 199226926 / +4.4% 0.86 / 0.90 / -4.9%
tpcds_q05/datafusion:parquet 66916556 / 68363662 / -2.1% 90328377 / 88310082 / +2.3% 0.74 / 0.77 / -4.3%
tpcds_q06/datafusion:parquet 33184526 / 35133400 / -5.5% 48246950 / 44032369 / +9.6% 0.69 / 0.80 / -13.8%
tpcds_q07/datafusion:parquet 46595603 / 47015244 / -0.9% 65335845 / 63060866 / +3.6% 0.71 / 0.75 / -4.3%
tpcds_q08/datafusion:parquet 30839646 / 31108916 / -0.9% 49433584 / 46407336 / +6.5% 0.62 / 0.67 / -6.9%
tpcds_q09/datafusion:parquet 32553548 / 32235404 / +1.0% 44368470 / 38162448 / +16.3% 🔴 0.73 / 0.84 / -13.1%
tpcds_q10/datafusion:parquet 44154668 / 45810956 / -3.6% 59941861 / 55821116 / +7.4% 0.74 / 0.82 / -10.2%
tpcds_q11/datafusion:parquet 96627858 / 97324552 / -0.7% 119708874 / 116986930 / +2.3% 0.81 / 0.83 / -3.0%
tpcds_q12/datafusion:parquet 23579422 / 23829389 / -1.0% 35941776 / 34561700 / +4.0% 0.66 / 0.69 / -4.8%
tpcds_q13/datafusion:parquet 47685136 / 47205746 / +1.0% 67989320 / 66519722 / +2.2% 0.70 / 0.71 / -1.2%
tpcds_q14/datafusion:parquet 534169794 / 536062596 / -0.4% 582847145 / 573875357 / +1.6% 0.92 / 0.93 / -1.9%
tpcds_q15/datafusion:parquet 24192325 / 23467316 / +3.1% 38528785 / 36912696 / +4.4% 0.63 / 0.64 / -1.2%
tpcds_q16/datafusion:parquet 36272711 / 36797934 / -1.4% 50442564 / 49093338 / +2.7% 0.72 / 0.75 / -4.1%
tpcds_q17/datafusion:parquet 74979695 / 77417738 / -3.1% 98053212 / 94152957 / +4.1% 0.76 / 0.82 / -7.0%
tpcds_q18/datafusion:parquet 66304789 / 67730459 / -2.1% 91186418 / 89015478 / +2.4% 0.73 / 0.76 / -4.4%
tpcds_q19/datafusion:parquet 29620582 / 29767255 / -0.5% 44208036 / 40859608 / +8.2% 0.67 / 0.73 / -8.0%
tpcds_q20/datafusion:parquet 25262633 / 24985466 / +1.1% 39592888 / 37149008 / +6.6% 0.64 / 0.67 / -5.1%
tpcds_q21/datafusion:parquet 20158003 / 20098942 / +0.3% 33322608 / 31199048 / +6.8% 0.60 / 0.64 / -6.1%
tpcds_q22/datafusion:parquet 76898353 / 78225004 / -1.7% 89418850 / 88011450 / +1.6% 0.86 / 0.89 / -3.2%
tpcds_q23/datafusion:parquet 95338526 / 93465786 / +2.0% 119764783 / 115763272 / +3.5% 0.80 / 0.81 / -1.4%
tpcds_q24/datafusion:parquet 89355036 / 90530880 / -1.3% 110137453 / 112774834 / -2.3% 0.81 / 0.80 / +1.1%
tpcds_q25/datafusion:parquet 81460736 / 78942378 / +3.2% 97378795 / 100286343 / -2.9% 0.84 / 0.79 / +6.3%
tpcds_q26/datafusion:parquet 42580482 / 42985690 / -0.9% 62024007 / 59286646 / +4.6% 0.69 / 0.73 / -5.3%
tpcds_q27/datafusion:parquet 74624103 / 78387144 / -4.8% 95235979 / 99975873 / -4.7% 0.78 / 0.78 / -0.1%
tpcds_q28/datafusion:parquet 28389527 / 28355490 / +0.1% 44244779 / 41055918 / +7.8% 0.64 / 0.69 / -7.1%
tpcds_q29/datafusion:parquet 74668954 / 74275574 / +0.5% 97950229 / 99075419 / -1.1% 0.76 / 0.75 / +1.7%
tpcds_q30/datafusion:parquet 43245444 / 44266542 / -2.3% 58937982 / 55134805 / +6.9% 0.73 / 0.80 / -8.6%
tpcds_q31/datafusion:parquet 80858656 / 80991932 / -0.2% 104746892 / 100088488 / +4.7% 0.77 / 0.81 / -4.6%
tpcds_q32/datafusion:parquet 26597264 / 27160338 / -2.1% 40282956 / 37888363 / +6.3% 0.66 / 0.72 / -7.9%
tpcds_q33/datafusion:parquet 38735954 / 37472210 / +3.4% 51940798 / 52784833 / -1.6% 0.75 / 0.71 / +5.1%
tpcds_q34/datafusion:parquet 24199634 / 24223199 / -0.1% 35864315 / 34925847 / +2.7% 0.67 / 0.69 / -2.7%
tpcds_q35/datafusion:parquet 49692412 / 50061658 / -0.7% 62555209 / 66186392 / -5.5% 0.79 / 0.76 / +5.0%
tpcds_q36/datafusion:parquet 51531968 / 53863620 / -4.3% 71595046 / 72008538 / -0.6% 0.72 / 0.75 / -3.8%
tpcds_q37/datafusion:parquet 21347170 / 21492292 / -0.7% 34573944 / 33965178 / +1.8% 0.62 / 0.63 / -2.4%
tpcds_q38/datafusion:parquet 44711770 / 43738358 / +2.2% 60914110 / 58984516 / +3.3% 0.73 / 0.74 / -1.0%
tpcds_q39/datafusion:parquet 68206302 / 68451454 / -0.4% 85524889 / 84694449 / +1.0% 0.80 / 0.81 / -1.3%
tpcds_q40/datafusion:parquet 30347228 / 29898065 / +1.5% 50040460 / 49416081 / +1.3% 0.61 / 0.61 / +0.2%
tpcds_q41/datafusion:parquet 19758078 / 19725044 / +0.2% 33107877 / 31567276 / +4.9% 0.60 / 0.62 / -4.5%
tpcds_q42/datafusion:parquet 18124751 / 18410036 / -1.5% 32378277 / 29096386 / +11.3% 🔴 0.56 / 0.63 / -11.5%
tpcds_q43/datafusion:parquet 19232486 / 19482850 / -1.3% 32706675 / 30496940 / +7.2% 0.59 / 0.64 / -8.0%
tpcds_q44/datafusion:parquet 35488340 / 35289568 / +0.6% 51391435 / 48402674 / +6.2% 0.69 / 0.73 / -5.3%
tpcds_q45/datafusion:parquet 27994898 / 28034722 / -0.1% 41780365 / 38421721 / +8.7% 0.67 / 0.73 / -8.2%
tpcds_q46/datafusion:parquet 29399355 / 29018574 / +1.3% 45485723 / 44678861 / +1.8% 0.65 / 0.65 / -0.5%
tpcds_q47/datafusion:parquet 97259744 / 96614053 / +0.7% 119829281 / 119575121 / +0.2% 0.81 / 0.81 / +0.5%
tpcds_q48/datafusion:parquet 41002118 / 42307228 / -3.1% 60545010 / 57749935 / +4.8% 0.68 / 0.73 / -7.6%
tpcds_q49/datafusion:parquet 71262304 / 72427164 / -1.6% 94363110 / 91585118 / +3.0% 0.76 / 0.79 / -4.5%
tpcds_q50/datafusion:parquet 46275104 / 47500422 / -2.6% 65625253 / 68227695 / -3.8% 0.71 / 0.70 / +1.3%
tpcds_q51/datafusion:parquet 75143434 / 74856850 / +0.4% 95746084 / 94480088 / +1.3% 0.78 / 0.79 / -0.9%
tpcds_q52/datafusion:parquet 18658455 / 18570137 / +0.5% 30424139 / 28281276 / +7.6% 0.61 / 0.66 / -6.6%
tpcds_q53/datafusion:parquet 22708615 / 21996628 / +3.2% 39868206 / 37632392 / +5.9% 0.57 / 0.58 / -2.6%
tpcds_q54/datafusion:parquet 53042180 / 53403201 / -0.7% 69313411 / 65412957 / +6.0% 0.77 / 0.82 / -6.3%
tpcds_q55/datafusion:parquet 17915774 / 18094322 / -1.0% 30169734 / 28452535 / +6.0% 0.59 / 0.64 / -6.6%
tpcds_q56/datafusion:parquet 42273876 / 42064521 / +0.5% 61428753 / 52494093 / +17.0% 🔴 0.69 / 0.80 / -14.1%
tpcds_q57/datafusion:parquet 102393006 / 98531152 / +3.9% 118611778 / 115051750 / +3.1% 0.86 / 0.86 / +0.8%
tpcds_q58/datafusion:parquet 65375492 / 66028114 / -1.0% 84244912 / 80484923 / +4.7% 0.78 / 0.82 / -5.4%
tpcds_q59/datafusion:parquet 47432272 / 48124550 / -1.4% 64102189 / 63375622 / +1.1% 0.74 / 0.76 / -2.6%
tpcds_q60/datafusion:parquet 39464689 / 41774428 / -5.5% 56533229 / 52913053 / +6.8% 0.70 / 0.79 / -11.6%
tpcds_q61/datafusion:parquet 36731751 / 36568854 / +0.4% 52784775 / 53842276 / -2.0% 0.70 / 0.68 / +2.5%
tpcds_q62/datafusion:parquet 25019292 / 25168784 / -0.6% 38592850 / 38657488 / -0.2% 0.65 / 0.65 / -0.4%
tpcds_q63/datafusion:parquet 22217854 / 22467320 / -1.1% 39309754 / 36224907 / +8.5% 0.57 / 0.62 / -8.9%
tpcds_q64/datafusion:parquet 287106190 / 285654170 / +0.5% 327053612 / 321241476 / +1.8% 0.88 / 0.89 / -1.3%
tpcds_q65/datafusion:parquet 121641514 / 119227688 / +2.0% 143415593 / 139579808 / +2.7% 0.85 / 0.85 / -0.7%
tpcds_q66/datafusion:parquet 59479498 / 61287888 / -3.0% 77498110 / 75163315 / +3.1% 0.77 / 0.82 / -5.9%
tpcds_q67/datafusion:parquet 68631361 / 69044428 / -0.6% 93763698 / 91696967 / +2.3% 0.73 / 0.75 / -2.8%
tpcds_q68/datafusion:parquet 28739630 / 29075160 / -1.2% 48699533 / 47405672 / +2.7% 0.59 / 0.61 / -3.8%
tpcds_q69/datafusion:parquet 43905478 / 43304174 / +1.4% 59066036 / 58652073 / +0.7% 0.74 / 0.74 / +0.7%
tpcds_q70/datafusion:parquet 79761296 / 80027439 / -0.3% 101255216 / 97604918 / +3.7% 0.79 / 0.82 / -3.9%
tpcds_q71/datafusion:parquet 26314152 / 25732466 / +2.3% 38560900 / 40528677 / -4.9% 0.68 / 0.63 / +7.5%
tpcds_q72/datafusion:parquet 524722252 / 527634840 / -0.6% 536784062 / 554349016 / -3.2% 0.98 / 0.95 / +2.7%
tpcds_q73/datafusion:parquet 24015186 / 23762050 / +1.1% 37875369 / 35077300 / +8.0% 0.63 / 0.68 / -6.4%
tpcds_q74/datafusion:parquet 71098042 / 69999536 / +1.6% 88613526 / 88289509 / +0.4% 0.80 / 0.79 / +1.2%
tpcds_q75/datafusion:parquet 152009386 / 152662930 / -0.4% 181341342 / 180450074 / +0.5% 0.84 / 0.85 / -0.9%
tpcds_q76/datafusion:parquet 34338811 / 33132911 / +3.6% 48227540 / 44935481 / +7.3% 0.71 / 0.74 / -3.4%
tpcds_q77/datafusion:parquet 56694203 / 56979256 / -0.5% 78581267 / 72969812 / +7.7% 0.72 / 0.78 / -7.6%
tpcds_q78/datafusion:parquet 85483432 / 85272162 / +0.2% 118989895 / 115614404 / +2.9% 0.72 / 0.74 / -2.6%
tpcds_q79/datafusion:parquet 26742518 / 26735792 / +0.0% 42865036 / 39769716 / +7.8% 0.62 / 0.67 / -7.2%
tpcds_q80/datafusion:parquet 80627657 / 78680880 / +2.5% 111957664 / 107863155 / +3.8% 0.72 / 0.73 / -1.3%
tpcds_q81/datafusion:parquet 38339944 / 39558134 / -3.1% 52943064 / 51081109 / +3.6% 0.72 / 0.77 / -6.5%
tpcds_q82/datafusion:parquet 22446349 / 22190428 / +1.2% 34896704 / 34291795 / +1.8% 0.64 / 0.65 / -0.6%
tpcds_q83/datafusion:parquet 59510656 / 58307740 / +2.1% 76311079 / 73002134 / +4.5% 0.78 / 0.80 / -2.4%
tpcds_q84/datafusion:parquet 27323188 / 27313596 / +0.0% 41027162 / 40041516 / +2.5% 0.67 / 0.68 / -2.4%
tpcds_q85/datafusion:parquet 79399770 / 79983598 / -0.7% 103505515 / 102306985 / +1.2% 0.77 / 0.78 / -1.9%
tpcds_q86/datafusion:parquet 20843676 / 21058438 / -1.0% 34599032 / 32574181 / +6.2% 0.60 / 0.65 / -6.8%
tpcds_q87/datafusion:parquet 44960214 / 45280914 / -0.7% 60531266 / 62384128 / -3.0% 0.74 / 0.73 / +2.3%
tpcds_q88/datafusion:parquet 37037694 / 37757294 / -1.9% 50397215 / 51820809 / -2.7% 0.73 / 0.73 / +0.9%
tpcds_q89/datafusion:parquet 25767425 / 26318301 / -2.1% 42601506 / 39991728 / +6.5% 0.60 / 0.66 / -8.1%
tpcds_q90/datafusion:parquet 15251684 / 15087966 / +1.1% 27072201 / 26597960 / +1.8% 0.56 / 0.57 / -0.7%
tpcds_q91/datafusion:parquet 32147533 / 32625398 / -1.5% 48323776 / 45196471 / +6.9% 0.67 / 0.72 / -7.8%
tpcds_q92/datafusion:parquet 27318060 / 26834922 / +1.8% 41124821 / 38063167 / +8.0% 0.66 / 0.71 / -5.8%
tpcds_q93/datafusion:parquet 26824984 / 26735974 / +0.3% 43948742 / 42486273 / +3.4% 0.61 / 0.63 / -3.0%
tpcds_q94/datafusion:parquet 35179596 / 35393988 / -0.6% 49189917 / 47118664 / +4.4% 0.72 / 0.75 / -4.8%
tpcds_q95/datafusion:parquet 62565887 / 64212454 / -2.6% 80785845 / 79492966 / +1.6% 0.77 / 0.81 / -4.1%
tpcds_q96/datafusion:parquet 12681152 / 12723054 / -0.3% 24888934 / 23429883 / +6.2% 0.51 / 0.54 / -6.2%
tpcds_q97/datafusion:parquet 34975506 / 35098156 / -0.3% 52894233 / 49335860 / +7.2% 0.66 / 0.71 / -7.1%
tpcds_q98/datafusion:parquet 24468521 / 25139323 / -2.7% 38865271 / 36349537 / +6.9% 0.63 / 0.69 / -9.0%
tpcds_q99/datafusion:parquet 29698857 / 29673968 / +0.1% 42818163 / 41366470 / +3.5% 0.69 / 0.72 / -3.3%
duckdb / vortex-file-compressed / ns (1.000x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15826127 / 15890239 / -0.4% 24556926 / 24196641 / +1.5% 0.64 / 0.66 / -1.9%
tpcds_q02/duckdb:vortex-file-compressed 16714156 / 18657920 / -10.4% 🟢 22409049 / 22422968 / -0.1% 0.75 / 0.83 / -10.4%
tpcds_q03/duckdb:vortex-file-compressed 6929872 / 7149274 / -3.1% 16283650 / 16220757 / +0.4% 0.43 / 0.44 / -3.4%
tpcds_q04/duckdb:vortex-file-compressed 58632120 / 58862208 / -0.4% 72148394 / 71856038 / +0.4% 0.81 / 0.82 / -0.8%
tpcds_q05/duckdb:vortex-file-compressed 22828214 / 23117854 / -1.3% 31779925 / 32942130 / -3.5% 0.72 / 0.70 / +2.4%
tpcds_q06/duckdb:vortex-file-compressed 24120717 / 24164680 / -0.2% 38112816 / 37874428 / +0.6% 0.63 / 0.64 / -0.8%
tpcds_q07/duckdb:vortex-file-compressed 22365312 / 22109802 / +1.2% 34827025 / 32504438 / +7.1% 0.64 / 0.68 / -5.6%
tpcds_q08/duckdb:vortex-file-compressed 17287936 / 17492722 / -1.2% 25803657 / 25089879 / +2.8% 0.67 / 0.70 / -3.9%
tpcds_q09/duckdb:vortex-file-compressed 19227632 / 19005454 / +1.2% 30593433 / 29541405 / +3.6% 0.63 / 0.64 / -2.3%
tpcds_q10/duckdb:vortex-file-compressed 27581504 / 27533383 / +0.2% 40935987 / 41135181 / -0.5% 0.67 / 0.67 / +0.7%
tpcds_q11/duckdb:vortex-file-compressed 36489598 / 36618646 / -0.4% 45288594 / 44343100 / +2.1% 0.81 / 0.83 / -2.4%
tpcds_q12/duckdb:vortex-file-compressed 9790896 / 9679752 / +1.1% 16331985 / 17229625 / -5.2% 0.60 / 0.56 / +6.7%
tpcds_q13/duckdb:vortex-file-compressed 19944250 / 19843352 / +0.5% 31985281 / 31995768 / -0.0% 0.62 / 0.62 / +0.5%
tpcds_q14/duckdb:vortex-file-compressed 55994629 / 55297112 / +1.3% 64753519 / 64955646 / -0.3% 0.86 / 0.85 / +1.6%
tpcds_q15/duckdb:vortex-file-compressed 11097517 / 11325009 / -2.0% 17159346 / 18325444 / -6.4% 0.65 / 0.62 / +4.7%
tpcds_q16/duckdb:vortex-file-compressed 24358478 / 24731064 / -1.5% 36299238 / 34853379 / +4.1% 0.67 / 0.71 / -5.4%
tpcds_q17/duckdb:vortex-file-compressed 20515604 / 20396798 / +0.6% 32800524 / 32338231 / +1.4% 0.63 / 0.63 / -0.8%
tpcds_q18/duckdb:vortex-file-compressed 32363646 / 32346349 / +0.1% 43970186 / 43278488 / +1.6% 0.74 / 0.75 / -1.5%
tpcds_q19/duckdb:vortex-file-compressed 20819088 / 20786617 / +0.2% 29914702 / 29101806 / +2.8% 0.70 / 0.71 / -2.6%
tpcds_q20/duckdb:vortex-file-compressed 10625920 / 10704608 / -0.7% 18354682 / 17476285 / +5.0% 0.58 / 0.61 / -5.5%
tpcds_q21/duckdb:vortex-file-compressed 9079594 / 9371898 / -3.1% 23577339 / 21703364 / +8.6% 0.39 / 0.43 / -10.8%
tpcds_q22/duckdb:vortex-file-compressed 17498026 / 17643249 / -0.8% 30547148 / 29161310 / +4.8% 0.57 / 0.61 / -5.3%
tpcds_q23/duckdb:vortex-file-compressed 37479260 / 37431455 / +0.1% 50030859 / 48459168 / +3.2% 0.75 / 0.77 / -3.0%
tpcds_q24/duckdb:vortex-file-compressed 26473578 / 26441519 / +0.1% 38224531 / 36595428 / +4.5% 0.69 / 0.72 / -4.1%
tpcds_q25/duckdb:vortex-file-compressed 19430574 / 19221668 / +1.1% 32547249 / 30221864 / +7.7% 0.60 / 0.64 / -6.1%
tpcds_q26/duckdb:vortex-file-compressed 21458836 / 21300105 / +0.7% 32647295 / 31212707 / +4.6% 0.66 / 0.68 / -3.7%
tpcds_q27/duckdb:vortex-file-compressed 25154564 / 24807916 / +1.4% 37996443 / 35637087 / +6.6% 0.66 / 0.70 / -4.9%
tpcds_q28/duckdb:vortex-file-compressed 15049237 / 15090790 / -0.3% 25809749 / 25912108 / -0.4% 0.58 / 0.58 / +0.1%
tpcds_q29/duckdb:vortex-file-compressed 18810791 / 18678136 / +0.7% 31516052 / 29174081 / +8.0% 0.60 / 0.64 / -6.8%
tpcds_q30/duckdb:vortex-file-compressed 18386353 / 18682425 / -1.6% 28527351 / 27172488 / +5.0% 0.64 / 0.69 / -6.3%
tpcds_q31/duckdb:vortex-file-compressed 17633522 / 17961668 / -1.8% 27157175 / 26844104 / +1.2% 0.65 / 0.67 / -3.0%
tpcds_q32/duckdb:vortex-file-compressed 10103954 / 10237077 / -1.3% 18703528 / 18081369 / +3.4% 0.54 / 0.57 / -4.6%
tpcds_q33/duckdb:vortex-file-compressed 18006137 / 17651904 / +2.0% 28144739 / 27599437 / +2.0% 0.64 / 0.64 / +0.0%
tpcds_q34/duckdb:vortex-file-compressed 13049664 / 12881700 / +1.3% 23713528 / 21645185 / +9.6% 0.55 / 0.60 / -7.5%
tpcds_q35/duckdb:vortex-file-compressed 30583496 / 31119364 / -1.7% 43774532 / 42566508 / +2.8% 0.70 / 0.73 / -4.4%
tpcds_q36/duckdb:vortex-file-compressed 14024715 / 14037150 / -0.1% 24662577 / 23560362 / +4.7% 0.57 / 0.60 / -4.6%
tpcds_q37/duckdb:vortex-file-compressed 9453346 / 9278629 / +1.9% 25117891 / 24238961 / +3.6% 0.38 / 0.38 / -1.7%
tpcds_q38/duckdb:vortex-file-compressed 24626152 / 24606434 / +0.1% 31486007 / 31179343 / +1.0% 0.78 / 0.79 / -0.9%
tpcds_q39/duckdb:vortex-file-compressed 18922464 / 18495272 / +2.3% 33299820 / 30737214 / +8.3% 0.57 / 0.60 / -5.6%
tpcds_q40/duckdb:vortex-file-compressed 11203632 / 11167876 / +0.3% 20263036 / 19316090 / +4.9% 0.55 / 0.58 / -4.4%
tpcds_q41/duckdb:vortex-file-compressed 17389962 / 17305600 / +0.5% 23573538 / 24395246 / -3.4% 0.74 / 0.71 / +4.0%
tpcds_q42/duckdb:vortex-file-compressed 7182480 / 6914912 / +3.9% 16453925 / 15064464 / +9.2% 0.44 / 0.46 / -4.9%
tpcds_q43/duckdb:vortex-file-compressed 9617412 / 9643249 / -0.3% 19104199 / 18160250 / +5.2% 0.50 / 0.53 / -5.2%
tpcds_q44/duckdb:vortex-file-compressed 12545546 / 12476409 / +0.6% 25076145 / 23821756 / +5.3% 0.50 / 0.52 / -4.5%
tpcds_q45/duckdb:vortex-file-compressed 23461744 / 23587638 / -0.5% 31233172 / 30430270 / +2.6% 0.75 / 0.78 / -3.1%
tpcds_q46/duckdb:vortex-file-compressed 31622540 / 31418024 / +0.7% 44371887 / 43171545 / +2.8% 0.71 / 0.73 / -2.1%
tpcds_q47/duckdb:vortex-file-compressed 31106622 / 31264494 / -0.5% 41162915 / 41141020 / +0.1% 0.76 / 0.76 / -0.6%
tpcds_q48/duckdb:vortex-file-compressed 22859301 / 22472531 / +1.7% 36890810 / 35469142 / +4.0% 0.62 / 0.63 / -2.2%
tpcds_q49/duckdb:vortex-file-compressed 18921712 / 18985566 / -0.3% 31228878 / 29722088 / +5.1% 0.61 / 0.64 / -5.1%
tpcds_q50/duckdb:vortex-file-compressed 14764996 / 14896845 / -0.9% 25987920 / 25687406 / +1.2% 0.57 / 0.58 / -2.0%
tpcds_q51/duckdb:vortex-file-compressed 48822856 / 48063878 / +1.6% 77943166 / 76334322 / +2.1% 0.63 / 0.63 / -0.5%
tpcds_q52/duckdb:vortex-file-compressed 7088733 / 7171716 / -1.2% 16578330 / 15978547 / +3.8% 0.43 / 0.45 / -4.7%
tpcds_q53/duckdb:vortex-file-compressed 11401445 / 11319189 / +0.7% 20666711 / 21681207 / -4.7% 0.55 / 0.52 / +5.7%
tpcds_q54/duckdb:vortex-file-compressed 19671140 / 19748759 / -0.4% 31940477 / 29438540 / +8.5% 0.62 / 0.67 / -8.2%
tpcds_q55/duckdb:vortex-file-compressed 6829510 / 6847788 / -0.3% 15849670 / 15285422 / +3.7% 0.43 / 0.45 / -3.8%
tpcds_q56/duckdb:vortex-file-compressed 18389956 / 17817582 / +3.2% 27558948 / 28613711 / -3.7% 0.67 / 0.62 / +7.2%
tpcds_q57/duckdb:vortex-file-compressed 25411410 / 25308086 / +0.4% 33862380 / 33487780 / +1.1% 0.75 / 0.76 / -0.7%
tpcds_q58/duckdb:vortex-file-compressed 20572526 / 20359384 / +1.0% 30156951 / 29241349 / +3.1% 0.68 / 0.70 / -2.0%
tpcds_q59/duckdb:vortex-file-compressed 19564410 / 19485481 / +0.4% 26594622 / 26442217 / +0.6% 0.74 / 0.74 / -0.2%
tpcds_q60/duckdb:vortex-file-compressed 18518006 / 18504610 / +0.1% 28329464 / 28842068 / -1.8% 0.65 / 0.64 / +1.9%
tpcds_q61/duckdb:vortex-file-compressed 19666140 / 19922872 / -1.3% 31183576 / 30039600 / +3.8% 0.63 / 0.66 / -4.9%
tpcds_q62/duckdb:vortex-file-compressed 10917325 / 10937722 / -0.2% 17674419 / 17144486 / +3.1% 0.62 / 0.64 / -3.2%
tpcds_q63/duckdb:vortex-file-compressed 10952131 / 10809960 / +1.3% 20190151 / 20560158 / -1.8% 0.54 / 0.53 / +3.2%
tpcds_q64/duckdb:vortex-file-compressed 52633670 / 52513062 / +0.2% 68469851 / 68406502 / +0.1% 0.77 / 0.77 / +0.1%
tpcds_q65/duckdb:vortex-file-compressed 12962218 / 13060742 / -0.8% 23279287 / 23236608 / +0.2% 0.56 / 0.56 / -0.9%
tpcds_q66/duckdb:vortex-file-compressed 31839230 / 31272590 / +1.8% 39491103 / 39351988 / +0.4% 0.81 / 0.79 / +1.5%
tpcds_q67/duckdb:vortex-file-compressed 55811578 / 55266268 / +1.0% 64881844 / 64683896 / +0.3% 0.86 / 0.85 / +0.7%
tpcds_q68/duckdb:vortex-file-compressed 22738870 / 23009998 / -1.2% 35723400 / 35296552 / +1.2% 0.64 / 0.65 / -2.4%
tpcds_q69/duckdb:vortex-file-compressed 22140160 / 22017648 / +0.6% 37228526 / 36691775 / +1.5% 0.59 / 0.60 / -0.9%
tpcds_q70/duckdb:vortex-file-compressed 14636303 / 14724129 / -0.6% 26314327 / 25052861 / +5.0% 0.56 / 0.59 / -5.4%
tpcds_q71/duckdb:vortex-file-compressed 13764958 / 13347567 / +3.1% 23664301 / 23409485 / +1.1% 0.58 / 0.57 / +2.0%
tpcds_q72/duckdb:vortex-file-compressed 43125715 / 43060600 / +0.2% 56630384 / 56269909 / +0.6% 0.76 / 0.77 / -0.5%
tpcds_q73/duckdb:vortex-file-compressed 11825514 / 11829364 / -0.0% 21235027 / 21106781 / +0.6% 0.56 / 0.56 / -0.6%
tpcds_q74/duckdb:vortex-file-compressed 30836278 / 30874616 / -0.1% 38571632 / 39304395 / -1.9% 0.80 / 0.79 / +1.8%
tpcds_q75/duckdb:vortex-file-compressed 37280924 / 37067086 / +0.6% 49937128 / 48402666 / +3.2% 0.75 / 0.77 / -2.5%
tpcds_q76/duckdb:vortex-file-compressed 12663900 / 12879005 / -1.7% 22383096 / 22058251 / +1.5% 0.57 / 0.58 / -3.1%
tpcds_q77/duckdb:vortex-file-compressed 20772776 / 20386666 / +1.9% 31318222 / 31298903 / +0.1% 0.66 / 0.65 / +1.8%
tpcds_q78/duckdb:vortex-file-compressed 42973105 / 42921238 / +0.1% 54738107 / 52920959 / +3.4% 0.79 / 0.81 / -3.2%
tpcds_q79/duckdb:vortex-file-compressed 17310806 / 17204298 / +0.6% 28619632 / 26915068 / +6.3% 0.60 / 0.64 / -5.4%
tpcds_q80/duckdb:vortex-file-compressed 29825283 / 29835128 / -0.0% 43755303 / 43751968 / +0.0% 0.68 / 0.68 / -0.0%
tpcds_q81/duckdb:vortex-file-compressed 21163214 / 21403570 / -1.1% 30093965 / 30302750 / -0.7% 0.70 / 0.71 / -0.4%
tpcds_q82/duckdb:vortex-file-compressed 9563740 / 9601288 / -0.4% 25972895 / 23700733 / +9.6% 0.37 / 0.41 / -9.1%
tpcds_q83/duckdb:vortex-file-compressed 17627396 / 17487681 / +0.8% 24660794 / 24391032 / +1.1% 0.71 / 0.72 / -0.3%
tpcds_q84/duckdb:vortex-file-compressed 15478130 / 15474432 / +0.0% 23027134 / 23926919 / -3.8% 0.67 / 0.65 / +3.9%
tpcds_q85/duckdb:vortex-file-compressed 25000063 / 25015558 / -0.1% 37590275 / 36358715 / +3.4% 0.67 / 0.69 / -3.3%
tpcds_q86/duckdb:vortex-file-compressed 9897273 / 9625184 / +2.8% 16624134 / 16115124 / +3.2% 0.60 / 0.60 / -0.3%
tpcds_q87/duckdb:vortex-file-compressed 25812496 / 26050646 / -0.9% 33066644 / 33749194 / -2.0% 0.78 / 0.77 / +1.1%
tpcds_q88/duckdb:vortex-file-compressed 30295530 / 30341066 / -0.2% 39832280 / 40666123 / -2.1% 0.76 / 0.75 / +1.9%
tpcds_q89/duckdb:vortex-file-compressed 12039910 / 11880278 / +1.3% 21576719 / 21020275 / +2.6% 0.56 / 0.57 / -1.3%
tpcds_q90/duckdb:vortex-file-compressed 7863500 / 7873380 / -0.1% 14814829 / 15793821 / -6.2% 0.53 / 0.50 / +6.5%
tpcds_q91/duckdb:vortex-file-compressed 14441591 / 14680431 / -1.6% 23609631 / 23432754 / +0.8% 0.61 / 0.63 / -2.4%
tpcds_q92/duckdb:vortex-file-compressed 10404430 / 10362186 / +0.4% 18375363 / 17798675 / +3.2% 0.57 / 0.58 / -2.7%
tpcds_q93/duckdb:vortex-file-compressed 10084079 / 10321070 / -2.3% 23451524 / 22416155 / +4.6% 0.43 / 0.46 / -6.6%
tpcds_q94/duckdb:vortex-file-compressed 22308954 / 22085020 / +1.0% 32712750 / 31715817 / +3.1% 0.68 / 0.70 / -2.1%
tpcds_q95/duckdb:vortex-file-compressed 61351988 / 60520896 / +1.4% 69204238 / 67458992 / +2.6% 0.89 / 0.90 / -1.2%
tpcds_q96/duckdb:vortex-file-compressed 6546898 / 6497133 / +0.8% 15383385 / 15310655 / +0.5% 0.43 / 0.42 / +0.3%
tpcds_q97/duckdb:vortex-file-compressed 23043240 / 22917520 / +0.5% 32634144 / 31822045 / +2.6% 0.71 / 0.72 / -2.0%
tpcds_q98/duckdb:vortex-file-compressed 10844078 / 10919490 / -0.7% 20048159 / 19425955 / +3.2% 0.54 / 0.56 / -3.8%
tpcds_q99/duckdb:vortex-file-compressed 14415756 / 14421880 / -0.0% 22783586 / 22012689 / +3.5% 0.63 / 0.66 / -3.4%
duckdb / parquet / ns (1.000x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23983665 / 24093628 / -0.5% 30687531 / 30609636 / +0.3% 0.78 / 0.79 / -0.7%
tpcds_q02/duckdb:parquet 17782829 / 17984803 / -1.1% 24020700 / 24025915 / -0.0% 0.74 / 0.75 / -1.1%
tpcds_q03/duckdb:parquet 11606818 / 9812261 / +18.3% 🔴 15640097 / 15610845 / +0.2% 0.74 / 0.63 / +18.1%
tpcds_q04/duckdb:parquet 117879246 / 118053322 / -0.1% 126236114 / 125451786 / +0.6% 0.93 / 0.94 / -0.8%
tpcds_q05/duckdb:parquet 28365752 / 28431532 / -0.2% 33011216 / 33184023 / -0.5% 0.86 / 0.86 / +0.3%
tpcds_q06/duckdb:parquet 26368933 / 26561266 / -0.7% 35587960 / 34919227 / +1.9% 0.74 / 0.76 / -2.6%
tpcds_q07/duckdb:parquet 31114845 / 31458600 / -1.1% 38990013 / 38910397 / +0.2% 0.80 / 0.81 / -1.3%
tpcds_q08/duckdb:parquet 19781695 / 19835614 / -0.3% 24959489 / 26315778 / -5.2% 0.79 / 0.75 / +5.1%
tpcds_q09/duckdb:parquet 26469368 / 27590826 / -4.1% 30610643 / 29561025 / +3.6% 0.86 / 0.93 / -7.4%
tpcds_q10/duckdb:parquet 32570198 / 32550451 / +0.1% 40338135 / 40051128 / +0.7% 0.81 / 0.81 / -0.7%
tpcds_q11/duckdb:parquet 68597917 / 68928280 / -0.5% 75064480 / 76188001 / -1.5% 0.91 / 0.90 / +1.0%
tpcds_q12/duckdb:parquet 14044028 / 13995176 / +0.3% 19202336 / 19053083 / +0.8% 0.73 / 0.73 / -0.4%
tpcds_q13/duckdb:parquet 32287454 / 33308439 / -3.1% 39933242 / 39541391 / +1.0% 0.81 / 0.84 / -4.0%
tpcds_q14/duckdb:parquet 65159404 / 64769091 / +0.6% 68166062 / 68114003 / +0.1% 0.96 / 0.95 / +0.5%
tpcds_q15/duckdb:parquet 16417308 / 16637540 / -1.3% 22546284 / 22243900 / +1.4% 0.73 / 0.75 / -2.6%
tpcds_q16/duckdb:parquet 30136250 / 30104670 / +0.1% 37418129 / 37135181 / +0.8% 0.81 / 0.81 / -0.7%
tpcds_q17/duckdb:parquet 34319378 / 34477460 / -0.5% 40403118 / 40356696 / +0.1% 0.85 / 0.85 / -0.6%
tpcds_q18/duckdb:parquet 47035788 / 47148372 / -0.2% 54735234 / 54249081 / +0.9% 0.86 / 0.87 / -1.1%
tpcds_q19/duckdb:parquet 18786698 / 19018304 / -1.2% 26002390 / 25382414 / +2.4% 0.72 / 0.75 / -3.6%
tpcds_q20/duckdb:parquet 15032265 / 14902117 / +0.9% 19755611 / 19412123 / +1.8% 0.76 / 0.77 / -0.9%
tpcds_q21/duckdb:parquet 10451210 / 10731116 / -2.6% 16817347 / 17030686 / -1.3% 0.62 / 0.63 / -1.4%
tpcds_q22/duckdb:parquet 20617360 / 20507718 / +0.5% 26707979 / 26762155 / -0.2% 0.77 / 0.77 / +0.7%
tpcds_q23/duckdb:parquet 43071660 / 42833082 / +0.6% 47506186 / 49424056 / -3.9% 0.91 / 0.87 / +4.6%
tpcds_q24/duckdb:parquet 30072742 / 29943294 / +0.4% 37044957 / 36464447 / +1.6% 0.81 / 0.82 / -1.1%
tpcds_q25/duckdb:parquet 30699138 / 30514354 / +0.6% 36667865 / 37025273 / -1.0% 0.84 / 0.82 / +1.6%
tpcds_q26/duckdb:parquet 28852866 / 29252328 / -1.4% 35611308 / 35038512 / +1.6% 0.81 / 0.83 / -3.0%
tpcds_q27/duckdb:parquet 36181731 / 34872377 / +3.8% 41437199 / 41229992 / +0.5% 0.87 / 0.85 / +3.2%
tpcds_q28/duckdb:parquet 26397260 / 25185258 / +4.8% 31599008 / 31104212 / +1.6% 0.84 / 0.81 / +3.2%
tpcds_q29/duckdb:parquet 32247346 / 32150195 / +0.3% 39471593 / 38969206 / +1.3% 0.82 / 0.83 / -1.0%
tpcds_q30/duckdb:parquet 35297400 / 35528874 / -0.7% 44562450 / 44172843 / +0.9% 0.79 / 0.80 / -1.5%
tpcds_q31/duckdb:parquet 36649790 / 35529000 / +3.2% 42977269 / 42639874 / +0.8% 0.85 / 0.83 / +2.3%
tpcds_q32/duckdb:parquet 14322109 / 14179243 / +1.0% 21034570 / 21025962 / +0.0% 0.68 / 0.67 / +1.0%
tpcds_q33/duckdb:parquet 25529837 / 23095442 / +10.5% 🔴 29554314 / 28549004 / +3.5% 0.86 / 0.81 / +6.8%
tpcds_q34/duckdb:parquet 17067442 / 16952271 / +0.7% 24206138 / 24176719 / +0.1% 0.71 / 0.70 / +0.6%
tpcds_q35/duckdb:parquet 34987374 / 34975734 / +0.0% 43854391 / 43207543 / +1.5% 0.80 / 0.81 / -1.4%
tpcds_q36/duckdb:parquet 39248328 / 39485050 / -0.6% 48159262 / 47479406 / +1.4% 0.81 / 0.83 / -2.0%
tpcds_q37/duckdb:parquet 12767208 / 12797622 / -0.2% 19593727 / 19277008 / +1.6% 0.65 / 0.66 / -1.9%
tpcds_q38/duckdb:parquet 29901971 / 29621006 / +0.9% 34640108 / 33433489 / +3.6% 0.86 / 0.89 / -2.6%
tpcds_q39/duckdb:parquet 23134100 / 23128167 / +0.0% 29505308 / 29595365 / -0.3% 0.78 / 0.78 / +0.3%
tpcds_q40/duckdb:parquet 15962998 / 16054940 / -0.6% 21587050 / 21235777 / +1.7% 0.74 / 0.76 / -2.2%
tpcds_q41/duckdb:parquet 11957740 / 11966633 / -0.1% 17699834 / 18065700 / -2.0% 0.68 / 0.66 / +2.0%
tpcds_q42/duckdb:parquet 9513086 / 9626178 / -1.2% 15304470 / 15525610 / -1.4% 0.62 / 0.62 / +0.3%
tpcds_q43/duckdb:parquet 12066316 / 12048868 / +0.1% 18092758 / 18128038 / -0.2% 0.67 / 0.66 / +0.3%
tpcds_q44/duckdb:parquet 21211607 / 21607511 / -1.8% 27151115 / 26196804 / +3.6% 0.78 / 0.82 / -5.3%
tpcds_q45/duckdb:parquet 20876996 / 20908743 / -0.2% 27534024 / 27486675 / +0.2% 0.76 / 0.76 / -0.3%
tpcds_q46/duckdb:parquet 36691252 / 35288508 / +4.0% 43241833 / 43320711 / -0.2% 0.85 / 0.81 / +4.2%
tpcds_q47/duckdb:parquet 34702760 / 34531498 / +0.5% 41057101 / 41336316 / -0.7% 0.85 / 0.84 / +1.2%
tpcds_q48/duckdb:parquet 29927249 / 29103170 / +2.8% 36674727 / 36426435 / +0.7% 0.82 / 0.80 / +2.1%
tpcds_q49/duckdb:parquet 29833325 / 30233053 / -1.3% 37345667 / 36303817 / +2.9% 0.80 / 0.83 / -4.1%
tpcds_q50/duckdb:parquet 19353400 / 20388898 / -5.1% 25862090 / 25331399 / +2.1% 0.75 / 0.80 / -7.0%
tpcds_q51/duckdb:parquet 52723328 / 52104356 / +1.2% 60102844 / 61245199 / -1.9% 0.88 / 0.85 / +3.1%
tpcds_q52/duckdb:parquet 9632002 / 9659180 / -0.3% 15578873 / 15499988 / +0.5% 0.62 / 0.62 / -0.8%
tpcds_q53/duckdb:parquet 13790185 / 14537118 / -5.1% 20857617 / 20752143 / +0.5% 0.66 / 0.70 / -5.6%
tpcds_q54/duckdb:parquet 25250642 / 24733616 / +2.1% 32340774 / 31908376 / +1.4% 0.78 / 0.78 / +0.7%
tpcds_q55/duckdb:parquet 9426133 / 9489484 / -0.7% 15218642 / 15341981 / -0.8% 0.62 / 0.62 / +0.1%
tpcds_q56/duckdb:parquet 27203182 / 27141406 / +0.2% 31311985 / 30419221 / +2.9% 0.87 / 0.89 / -2.6%
tpcds_q57/duckdb:parquet 30545958 / 30693180 / -0.5% 35910939 / 36167354 / -0.7% 0.85 / 0.85 / +0.2%
tpcds_q58/duckdb:parquet 24979696 / 23919381 / +4.4% 29880265 / 29814453 / +0.2% 0.84 / 0.80 / +4.2%
tpcds_q59/duckdb:parquet 22804539 / 22867650 / -0.3% 28749714 / 28707391 / +0.1% 0.79 / 0.80 / -0.4%
tpcds_q60/duckdb:parquet 27385984 / 26316208 / +4.1% 32748914 / 31957179 / +2.5% 0.84 / 0.82 / +1.5%
tpcds_q61/duckdb:parquet 25923702 / 24749493 / +4.7% 29122721 / 29026258 / +0.3% 0.89 / 0.85 / +4.4%
tpcds_q62/duckdb:parquet 12787804 / 12721642 / +0.5% 17752251 / 17771445 / -0.1% 0.72 / 0.72 / +0.6%
tpcds_q63/duckdb:parquet 13261624 / 14341675 / -7.5% 19979658 / 20011856 / -0.2% 0.66 / 0.72 / -7.4%
tpcds_q64/duckdb:parquet 70518403 / 70307914 / +0.3% 80601361 / 79575965 / +1.3% 0.87 / 0.88 / -1.0%
tpcds_q65/duckdb:parquet 20273229 / 20569484 / -1.4% 25836573 / 25477560 / +1.4% 0.78 / 0.81 / -2.8%
tpcds_q66/duckdb:parquet 33320904 / 33045765 / +0.8% 38553503 / 38019443 / +1.4% 0.86 / 0.87 / -0.6%
tpcds_q67/duckdb:parquet 60959642 / 61027914 / -0.1% 69392743 / 66818321 / +3.9% 0.88 / 0.91 / -3.8%
tpcds_q68/duckdb:parquet 29545244 / 30834914 / -4.2% 36051689 / 35993030 / +0.2% 0.82 / 0.86 / -4.3%
tpcds_q69/duckdb:parquet 25789812 / 25794512 / -0.0% 34563579 / 33964184 / +1.8% 0.75 / 0.76 / -1.8%
tpcds_q70/duckdb:parquet 19205322 / 19255869 / -0.3% 27370297 / 26582665 / +3.0% 0.70 / 0.72 / -3.1%
tpcds_q71/duckdb:parquet 16940245 / 16803522 / +0.8% 24332485 / 23382022 / +4.1% 0.70 / 0.72 / -3.1%
tpcds_q72/duckdb:parquet 52624550 / 53014220 / -0.7% 59484789 / 59449489 / +0.1% 0.88 / 0.89 / -0.8%
tpcds_q73/duckdb:parquet 15488862 / 15895421 / -2.6% 21645185 / 21585777 / +0.3% 0.72 / 0.74 / -2.8%
tpcds_q74/duckdb:parquet 84144912 / 85004257 / -1.0% 90910967 / 89575448 / +1.5% 0.93 / 0.95 / -2.5%
tpcds_q75/duckdb:parquet 44722796 / 44183878 / +1.2% 50366091 / 49282250 / +2.2% 0.89 / 0.90 / -1.0%
tpcds_q76/duckdb:parquet 17748158 / 18510097 / -4.1% 23513437 / 22802776 / +3.1% 0.75 / 0.81 / -7.0%
tpcds_q77/duckdb:parquet 26142014 / 25530442 / +2.4% 31565095 / 31441226 / +0.4% 0.83 / 0.81 / +2.0%
tpcds_q78/duckdb:parquet 77866505 / 78229121 / -0.5% 85185131 / 85641462 / -0.5% 0.91 / 0.91 / +0.1%
tpcds_q79/duckdb:parquet 23799749 / 24067906 / -1.1% 28443660 / 28358044 / +0.3% 0.84 / 0.85 / -1.4%
tpcds_q80/duckdb:parquet 37332250 / 38479893 / -3.0% 44299166 / 43843592 / +1.0% 0.84 / 0.88 / -4.0%
tpcds_q81/duckdb:parquet 36363539 / 36125748 / +0.7% 44417554 / 44907713 / -1.1% 0.82 / 0.80 / +1.8%
tpcds_q82/duckdb:parquet 13302574 / 13496682 / -1.4% 20361342 / 20103202 / +1.3% 0.65 / 0.67 / -2.7%
tpcds_q83/duckdb:parquet 20122026 / 19941274 / +0.9% 25231774 / 24813592 / +1.7% 0.80 / 0.80 / -0.8%
tpcds_q84/duckdb:parquet 22620121 / 23090262 / -2.0% 28446111 / 28462809 / -0.1% 0.80 / 0.81 / -2.0%
tpcds_q85/duckdb:parquet 32265460 / 32217004 / +0.2% 39324042 / 38985194 / +0.9% 0.82 / 0.83 / -0.7%
tpcds_q86/duckdb:parquet 11781980 / 11811458 / -0.2% 17092673 / 16496302 / +3.6% 0.69 / 0.72 / -3.7%
tpcds_q87/duckdb:parquet 31157118 / 31436775 / -0.9% 35141989 / 35185024 / -0.1% 0.89 / 0.89 / -0.8%
tpcds_q88/duckdb:parquet 38238457 / 38059442 / +0.5% 43623929 / 41928306 / +4.0% 0.88 / 0.91 / -3.4%
tpcds_q89/duckdb:parquet 14244007 / 14206404 / +0.3% 21286651 / 21172421 / +0.5% 0.67 / 0.67 / -0.3%
tpcds_q90/duckdb:parquet 9962877 / 10080660 / -1.2% 15201830 / 15448563 / -1.6% 0.66 / 0.65 / +0.4%
tpcds_q91/duckdb:parquet 20976603 / 21048574 / -0.3% 28315788 / 28220317 / +0.3% 0.74 / 0.75 / -0.7%
tpcds_q92/duckdb:parquet 15623022 / 15572126 / +0.3% 21864291 / 22096515 / -1.1% 0.71 / 0.70 / +1.4%
tpcds_q93/duckdb:parquet 14022367 / 14091483 / -0.5% 20591708 / 20175447 / +2.1% 0.68 / 0.70 / -2.5%
tpcds_q94/duckdb:parquet 25362667 / 25392360 / -0.1% 32703190 / 32388339 / +1.0% 0.78 / 0.78 / -1.1%
tpcds_q95/duckdb:parquet 44026824 / 43748374 / +0.6% 49796053 / 49895274 / -0.2% 0.88 / 0.88 / +0.8%
tpcds_q96/duckdb:parquet 8202920 / 8272491 / -0.8% 13777822 / 13988491 / -1.5% 0.60 / 0.59 / +0.7%
tpcds_q97/duckdb:parquet 27537025 / 27667050 / -0.5% 33122923 / 32852985 / +0.8% 0.83 / 0.84 / -1.3%
tpcds_q98/duckdb:parquet 16232899 / 16378365 / -0.9% 22962051 / 22777602 / +0.8% 0.71 / 0.72 / -1.7%
tpcds_q99/duckdb:parquet 18732917 / 18807829 / -0.4% 24620803 / 24915617 / -1.2% 0.76 / 0.75 / +0.8%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR aea8f377 vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.013x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.010x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16035906 / 15688950 / +2.2% 44066117 / 42044683 / +4.8% 0.36 / 0.37 / -2.5%
tpch_q02/datafusion:vortex-file-compressed 17726514 / 17642963 / +0.5% 40838691 / 38300817 / +6.6% 0.43 / 0.46 / -5.8%
tpch_q03/datafusion:vortex-file-compressed 19317483 / 19065844 / +1.3% 44604499 / 48397388 / -7.8% 0.43 / 0.39 / +9.9%
tpch_q04/datafusion:vortex-file-compressed 10301525 / 11164861 / -7.7% 36124446 / 35072742 / +3.0% 0.29 / 0.32 / -10.4%
tpch_q05/datafusion:vortex-file-compressed 37635147 / 37464731 / +0.5% 70360177 / 67783021 / +3.8% 0.53 / 0.55 / -3.2%
tpch_q06/datafusion:vortex-file-compressed 4587528 / 4339682 / +5.7% 29353235 / 24863986 / +18.1% 🔴 0.16 / 0.17 / -10.5%
tpch_q07/datafusion:vortex-file-compressed 52996248 / 52692511 / +0.6% 81919774 / 85054942 / -3.7% 0.65 / 0.62 / +4.4%
tpch_q08/datafusion:vortex-file-compressed 52859702 / 52605829 / +0.5% 86350380 / 84709539 / +1.9% 0.61 / 0.62 / -1.4%
tpch_q09/datafusion:vortex-file-compressed 49120519 / 48498381 / +1.3% 81367683 / 84507228 / -3.7% 0.60 / 0.57 / +5.2%
tpch_q10/datafusion:vortex-file-compressed 17591490 / 17830636 / -1.3% 50547666 / 50418361 / +0.3% 0.35 / 0.35 / -1.6%
tpch_q11/datafusion:vortex-file-compressed 14577259 / 14797088 / -1.5% 35557861 / 34636066 / +2.7% 0.41 / 0.43 / -4.0%
tpch_q12/datafusion:vortex-file-compressed 18772701 / 18367682 / +2.2% 44043570 / 44324157 / -0.6% 0.43 / 0.41 / +2.9%
tpch_q13/datafusion:vortex-file-compressed 19561452 / 19445378 / +0.6% 42922104 / 43547559 / -1.4% 0.46 / 0.45 / +2.1%
tpch_q14/datafusion:vortex-file-compressed 14294205 / 14501344 / -1.4% 38401645 / 38502171 / -0.3% 0.37 / 0.38 / -1.2%
tpch_q15/datafusion:vortex-file-compressed 18535266 / 18611040 / -0.4% 46336684 / 47147954 / -1.7% 0.40 / 0.39 / +1.3%
tpch_q16/datafusion:vortex-file-compressed 18055954 / 18720655 / -3.6% 41903256 / 39847079 / +5.2% 0.43 / 0.47 / -8.3%
tpch_q17/datafusion:vortex-file-compressed 29056630 / 28917794 / +0.5% 60826466 / 58954760 / +3.2% 0.48 / 0.49 / -2.6%
tpch_q18/datafusion:vortex-file-compressed 36241823 / 36473671 / -0.6% 59229792 / 59803246 / -1.0% 0.61 / 0.61 / +0.3%
tpch_q19/datafusion:vortex-file-compressed 10384070 / 9988295 / +4.0% 37559177 / 36396214 / +3.2% 0.28 / 0.27 / +0.7%
tpch_q20/datafusion:vortex-file-compressed 20683970 / 21253874 / -2.7% 49579739 / 52124094 / -4.9% 0.42 / 0.41 / +2.3%
tpch_q21/datafusion:vortex-file-compressed 35187185 / 35502918 / -0.9% 69342094 / 66036777 / +5.0% 0.51 / 0.54 / -5.6%
tpch_q22/datafusion:vortex-file-compressed 10894146 / 10854425 / +0.4% 32483550 / 31535557 / +3.0% 0.34 / 0.34 / -2.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71728538 / 71385078 / +0.5% 91491623 / 87261585 / +4.8% 0.78 / 0.82 / -4.2%
tpch_q02/datafusion:parquet 76148207 / 76624116 / -0.6% 94265456 / 91913452 / +2.6% 0.81 / 0.83 / -3.1%
tpch_q03/datafusion:parquet 81813131 / 82108255 / -0.4% 103870817 / 104243587 / -0.4% 0.79 / 0.79 / -0.0%
tpch_q04/datafusion:parquet 39622720 / 39117802 / +1.3% 59201792 / 58381793 / +1.4% 0.67 / 0.67 / -0.1%
tpch_q05/datafusion:parquet 110996227 / 110097915 / +0.8% 137275729 / 137152327 / +0.1% 0.81 / 0.80 / +0.7%
tpch_q06/datafusion:parquet 31469555 / 31364851 / +0.3% 48999714 / 46559945 / +5.2% 0.64 / 0.67 / -4.7%
tpch_q07/datafusion:parquet 112221887 / 113603354 / -1.2% 140348801 / 139063930 / +0.9% 0.80 / 0.82 / -2.1%
tpch_q08/datafusion:parquet 116271425 / 118351864 / -1.8% 143758190 / 143663582 / +0.1% 0.81 / 0.82 / -1.8%
tpch_q09/datafusion:parquet 137979302 / 137262432 / +0.5% 166903213 / 166772416 / +0.1% 0.83 / 0.82 / +0.4%
tpch_q10/datafusion:parquet 103927152 / 103456749 / +0.5% 129875224 / 126729504 / +2.5% 0.80 / 0.82 / -2.0%
tpch_q11/datafusion:parquet 62200847 / 62363006 / -0.3% 83195663 / 82069278 / +1.4% 0.75 / 0.76 / -1.6%
tpch_q12/datafusion:parquet 63672495 / 63533745 / +0.2% 84760403 / 85351184 / -0.7% 0.75 / 0.74 / +0.9%
tpch_q13/datafusion:parquet 142606333 / 142477870 / +0.1% 163976767 / 161849930 / +1.3% 0.87 / 0.88 / -1.2%
tpch_q14/datafusion:parquet 47380758 / 47624060 / -0.5% 71750317 / 68804881 / +4.3% 0.66 / 0.69 / -4.6%
tpch_q15/datafusion:parquet 74448678 / 74880432 / -0.6% 95098404 / 92266259 / +3.1% 0.78 / 0.81 / -3.5%
tpch_q16/datafusion:parquet 43006880 / 43181694 / -0.4% 62855938 / 59549382 / +5.6% 0.68 / 0.73 / -5.6%
tpch_q17/datafusion:parquet 123574893 / 123682757 / -0.1% 144960685 / 147020505 / -1.4% 0.85 / 0.84 / +1.3%
tpch_q18/datafusion:parquet 120821173 / 121104227 / -0.2% 144183423 / 142447395 / +1.2% 0.84 / 0.85 / -1.4%
tpch_q19/datafusion:parquet 57151229 / 57774413 / -1.1% 82247101 / 82236501 / +0.0% 0.69 / 0.70 / -1.1%
tpch_q20/datafusion:parquet 78282713 / 78510463 / -0.3% 99768278 / 101516128 / -1.7% 0.78 / 0.77 / +1.5%
tpch_q21/datafusion:parquet 113290886 / 113088915 / +0.2% 139794568 / 139363438 / +0.3% 0.81 / 0.81 / -0.1%
tpch_q22/datafusion:parquet 52317305 / 51831048 / +0.9% 67786519 / 67131696 / +1.0% 0.77 / 0.77 / -0.0%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8656427 / 9046497 / -4.3% 19827233 / 20027987 / -1.0% 0.44 / 0.45 / -3.3%
tpch_q02/duckdb:vortex-file-compressed 15151276 / 15124900 / +0.2% 25358768 / 25341316 / +0.1% 0.60 / 0.60 / +0.1%
tpch_q03/duckdb:vortex-file-compressed 18622227 / 18447734 / +0.9% 36304113 / 34750008 / +4.5% 0.51 / 0.53 / -3.4%
tpch_q04/duckdb:vortex-file-compressed 11969702 / 12448707 / -3.8% 26998696 / 26846587 / +0.6% 0.44 / 0.46 / -4.4%
tpch_q05/duckdb:vortex-file-compressed 20089420 / 20254666 / -0.8% 38207478 / 35776065 / +6.8% 0.53 / 0.57 / -7.1%
tpch_q06/duckdb:vortex-file-compressed 5030866 / 4488820 / +12.1% 🔴 16060535 / 15022696 / +6.9% 0.31 / 0.30 / +4.8%
tpch_q07/duckdb:vortex-file-compressed 24266933 / 23909987 / +1.5% 42594636 / 41780280 / +1.9% 0.57 / 0.57 / -0.4%
tpch_q08/duckdb:vortex-file-compressed 21365947 / 20744171 / +3.0% 37833172 / 37318055 / +1.4% 0.56 / 0.56 / +1.6%
tpch_q09/duckdb:vortex-file-compressed 22048899 / 23055861 / -4.4% 38362096 / 38487753 / -0.3% 0.57 / 0.60 / -4.1%
tpch_q10/duckdb:vortex-file-compressed 26895113 / 26815462 / +0.3% 44617526 / 45530635 / -2.0% 0.60 / 0.59 / +2.3%
tpch_q11/duckdb:vortex-file-compressed 8101782 / 7968318 / +1.7% 17929724 / 18104165 / -1.0% 0.45 / 0.44 / +2.7%
tpch_q12/duckdb:vortex-file-compressed 14781934 / 14764927 / +0.1% 27697319 / 27095283 / +2.2% 0.53 / 0.54 / -2.1%
tpch_q13/duckdb:vortex-file-compressed 19333638 / 19378947 / -0.2% 32201147 / 31743144 / +1.4% 0.60 / 0.61 / -1.7%
tpch_q14/duckdb:vortex-file-compressed 11280179 / 11181264 / +0.9% 25303826 / 25354587 / -0.2% 0.45 / 0.44 / +1.1%
tpch_q15/duckdb:vortex-file-compressed 8348242 / 8381204 / -0.4% 21541850 / 20995174 / +2.6% 0.39 / 0.40 / -2.9%
tpch_q16/duckdb:vortex-file-compressed 16724812 / 16413233 / +1.9% 22580457 / 23979720 / -5.8% 0.74 / 0.68 / +8.2%
tpch_q17/duckdb:vortex-file-compressed 12917366 / 12592677 / +2.6% 28728286 / 28445363 / +1.0% 0.45 / 0.44 / +1.6%
tpch_q18/duckdb:vortex-file-compressed 24151938 / 24316808 / -0.7% 35428336 / 34951044 / +1.4% 0.68 / 0.70 / -2.0%
tpch_q19/duckdb:vortex-file-compressed 11733084 / 11426195 / +2.7% 26588577 / 25766839 / +3.2% 0.44 / 0.44 / -0.5%
tpch_q20/duckdb:vortex-file-compressed 14239990 / 14325643 / -0.6% 31241115 / 30552986 / +2.3% 0.46 / 0.47 / -2.8%
tpch_q21/duckdb:vortex-file-compressed 48887383 / 48281048 / +1.3% 66016653 / 66017908 / -0.0% 0.74 / 0.73 / +1.3%
tpch_q22/duckdb:vortex-file-compressed 16884306 / 16702790 / +1.1% 26965699 / 26800262 / +0.6% 0.63 / 0.62 / +0.5%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47460458 / 47547581 / -0.2% 54775443 / 54112740 / +1.2% 0.87 / 0.88 / -1.4%
tpch_q02/duckdb:parquet 48306951 / 48312217 / -0.0% 55264045 / 55151190 / +0.2% 0.87 / 0.88 / -0.2%
tpch_q03/duckdb:parquet 59965675 / 60217500 / -0.4% 69457521 / 69288935 / +0.2% 0.86 / 0.87 / -0.7%
tpch_q04/duckdb:parquet 34666558 / 34656547 / +0.0% 43952321 / 43053263 / +2.1% 0.79 / 0.80 / -2.0%
tpch_q05/duckdb:parquet 67083962 / 67091722 / -0.0% 77974686 / 77316587 / +0.9% 0.86 / 0.87 / -0.9%
tpch_q06/duckdb:parquet 21623309 / 21601570 / +0.1% 27198256 / 27249425 / -0.2% 0.80 / 0.79 / +0.3%
tpch_q07/duckdb:parquet 63806985 / 63799205 / +0.0% 72930294 / 72405251 / +0.7% 0.87 / 0.88 / -0.7%
tpch_q08/duckdb:parquet 75731537 / 75667269 / +0.1% 87405826 / 86769393 / +0.7% 0.87 / 0.87 / -0.6%
tpch_q09/duckdb:parquet 107867911 / 107847179 / +0.0% 120072650 / 118570948 / +1.3% 0.90 / 0.91 / -1.2%
tpch_q10/duckdb:parquet 106030847 / 105720936 / +0.3% 118064050 / 117200993 / +0.7% 0.90 / 0.90 / -0.4%
tpch_q11/duckdb:parquet 29466512 / 29439572 / +0.1% 34916934 / 34922812 / -0.0% 0.84 / 0.84 / +0.1%
tpch_q12/duckdb:parquet 37173371 / 37121505 / +0.1% 44526061 / 43764563 / +1.7% 0.83 / 0.85 / -1.6%
tpch_q13/duckdb:parquet 174302702 / 174812670 / -0.3% 182172293 / 184970583 / -1.5% 0.96 / 0.95 / +1.2%
tpch_q14/duckdb:parquet 42233387 / 42356235 / -0.3% 51574682 / 51063051 / +1.0% 0.82 / 0.83 / -1.3%
tpch_q15/duckdb:parquet 32530785 / 32503990 / +0.1% 41022998 / 41334737 / -0.8% 0.79 / 0.79 / +0.8%
tpch_q16/duckdb:parquet 47234789 / 47147798 / +0.2% 52412463 / 52668299 / -0.5% 0.90 / 0.90 / +0.7%
tpch_q17/duckdb:parquet 47881038 / 47964459 / -0.2% 57610959 / 56795941 / +1.4% 0.83 / 0.84 / -1.6%
tpch_q18/duckdb:parquet 74033119 / 73982405 / +0.1% 81055637 / 80482798 / +0.7% 0.91 / 0.92 / -0.6%
tpch_q19/duckdb:parquet 49193911 / 49071842 / +0.2% 55266005 / 55601512 / -0.6% 0.89 / 0.88 / +0.9%
tpch_q20/duckdb:parquet 63472005 / 63412118 / +0.1% 74476715 / 73364368 / +1.5% 0.85 / 0.86 / -1.4%
tpch_q21/duckdb:parquet 107001498 / 106560704 / +0.4% 116346225 / 116038695 / +0.3% 0.92 / 0.92 / +0.1%
tpch_q22/duckdb:parquet 50387418 / 50470913 / -0.2% 59150812 / 59155611 / -0.0% 0.85 / 0.85 / -0.2%

Restrict the V2 whole-file grouping preference to configurations where
static statistics actually excluded input entries. Keep immutable input
provenance on the returned source so repeated optimizer passes retain the
preference without affecting sibling sources or changed inputs.

Use ordinary byte-range partitioning when no inputs were excluded. Cover
unknown and inclusive statistics, changed inputs and predicates, repeated
target changes, and preservation of existing ranges.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs changed the title Keep filtered V2 DataFusion files whole below target parallelism Preserve pruned V2 file groups without collapsing unpruned scans Nov 9, 2026
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-08-df-prune-before-partition to develop November 9, 2026 14:16
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-08-df-prune-before-partition November 9, 2026 14:16
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@joseph-isaacs joseph-isaacs reopened this Nov 9, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant