Skip to content

Share dictionary values between V2 filters and projections - #11098

Draft
joseph-isaacs wants to merge 1 commit into
developfrom
ji/practical-hypatia-bnlt9j
Draft

joseph-isaacs wants to merge 1 commit into
developfrom
ji/practical-hypatia-bnlt9j

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

ClickBench Q22–Q27 on DataFusion + vortex-compact regressed when DataFusion ClickBench moved to the V2 scan in 705911c (#10799). For example, Q23 went from 258 to 653 ms and Q27 from 102 to 173 ms. The default vortex format was unaffected. The same jump appears on ClickBench-sorted at 9085458, when that suite moved to V2.

When a query filters and projects the same dictionary column, the V2 scan decodes the dictionary values once for the filter and again for the projection. In compact files those values are Zstd-compressed, so the duplicate decode is expensive. V1 does not have this problem because its dictionary reader keeps one decoded copy per dictionary.

Changes

lower_dict lowered a dictionary to Take(codes, values). A filter on the column is rewritten to Take(codes, Eval(pred, values)), while the projection stays Take(codes, values). ValueCache is keyed by plan pointer, so the two cached different things and neither reused the other's decoded values.

Share was built for exactly this, and ExpressionTakeRule already keeps predicates above it, but nothing ever created a Share. lower_dict now puts the values under a Share. Because lazy plan children are memoized and the optimizer keeps the pointer of any subtree it doesn't rewrite, the filter and the projection now point at the same Share and decode the values once. Struct-valued dictionaries keep bare values so field selections still push through their pack.

Local results on 3 ClickBench files (4 cores):

  • Zstd values decoded now match V1 for every Q20–Q28 except Q23 (Q25: 840K → 413K; Q27: 3.25M → 1.61M).
  • A same-binary comparison on compact, toggling only this change: Q22 ×0.51, Q24 ×0.78, Q25 ×0.73, Q26 ×0.76, Q27 ×0.69. The default format is neutral.

Q23 is still unresolved. The sparse-take branch in operators/take.rs re-decodes whole Zstd dictionaries per batch: V2 decodes 5.0M values against V1's 3.6M. Disabling that branch hurts FSST, so fixing it properly needs an encoding-aware condition. That is left for a follow-up. Q23's 2.6× regression in CI also did not reproduce at 3 files, which is part of why this PR asks for the CI benchmark.

Tests:

  • New predicate_and_projection_share_dictionary_values test in plan/physical/pipeline/tests.rs. It fails without the fix (the projection reads the values again) and passes with it.
  • 7 inline plan-tree snapshots updated; each diff is only the inserted share node.
  • cargo test -p vortex-layout --lib (736 passed), cargo test -p vortex-datafusion (788 + 14 passed), and cargo clippy -p vortex-layout --all-targets --all-features -- -D warnings are all clean.

Generated by Claude Code

The V2 scan lowered a dictionary layout to `Take(codes, values)` with no
`Share` above the values. A filter on a dictionary column is rewritten to
`Take(codes, Eval(predicate, values))`, and the projection of the same column
stays `Take(codes, values)`. The value cache is keyed by plan pointer, so the
two plans cached different things and each decoded the dictionary values
separately. V1's dictionary reader shares one decode between them.

Lower the values under a `Share`, as its docs and `ExpressionTakeRule` already
assume, so the predicate evaluates above the share and the projection reuses
the values it canonicalized. Struct-valued dictionaries keep bare values so
field selections still push through their pack.

On a 3-file ClickBench subset with vortex-compact (Zstd dictionary values),
the V2 scan now decodes the same number of values as V1, and Q22, Q24-Q27 run
22-49% faster.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBD8uUsB4hozGEcuCv
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR label Nov 2, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR label Nov 2, 2026
@github-actions

ghost commented Nov 2, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 57027fb clickbench-nvme 1 Explore Profiling Data
🟢 Done 57027fb fineweb 1 Explore Profiling Data
🟢 Done 57027fb tpcds-nvme 1 Explore Profiling Data
🟢 Done 57027fb polarsignals 1 Explore Profiling Data
🟢 Done 57027fb tpch-s3 1 Explore Profiling Data
🟢 Done 57027fb tpch-nvme-10 1 Explore Profiling Data
🟢 Done 57027fb tpch-nvme 1 Explore Profiling Data
🟢 Done 57027fb clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 57027fb tpch-s3-10 1 Explore Profiling Data
🟢 Done 57027fb fineweb-s3 1 Explore Profiling Data
🟢 Done 57027fb appian-nvme 1 Explore Profiling Data
🟢 Done 57027fb statpopgen 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.997x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.002x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6105211 / 6057903 / +0.8% 19407970 / 19501907 / -0.5% 0.31 / 0.31 / +1.3%
fineweb_q01/datafusion:vortex-compact 102357058 / 102241018 / +0.1% 132192576 / 134926703 / -2.0% 0.77 / 0.76 / +2.2%
fineweb_q02/datafusion:vortex-compact 103187680 / 103112566 / +0.1% 134983030 / 134113317 / +0.6% 0.76 / 0.77 / -0.6%
fineweb_q03/datafusion:vortex-compact 180829357 / 188171164 / -3.9% 252919069 / 245930601 / +2.8% 0.71 / 0.77 / -6.6%
fineweb_q04/datafusion:vortex-compact 193227031 / 194339299 / -0.6% 271529430 / 262583816 / +3.4% 0.71 / 0.74 / -3.8%
fineweb_q05/datafusion:vortex-compact 179180246 / 180077760 / -0.5% 251436254 / 258001544 / -2.5% 0.71 / 0.70 / +2.1%
fineweb_q06/datafusion:vortex-compact 124617886 / 129815784 / -4.0% 193138620 / 190761388 / +1.2% 0.65 / 0.68 / -5.2%
fineweb_q07/datafusion:vortex-compact 125274580 / 125795394 / -0.4% 214199029 / 210274600 / +1.9% 0.58 / 0.60 / -2.2%
fineweb_q08/datafusion:vortex-compact 8039105 / 7250662 / +10.9% 🔴 25048598 / 23108225 / +8.4% 0.32 / 0.31 / +2.3%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9561821 / 9445881 / +1.2% 33931331 / 35756574 / -5.1% 0.28 / 0.26 / +6.7%
fineweb_q01/datafusion:parquet 75309525 / 73776822 / +2.1% 142612033 / 143715891 / -0.8% 0.53 / 0.51 / +2.9%
fineweb_q02/datafusion:parquet 73918201 / 74944838 / -1.4% 146714181 / 149250453 / -1.7% 0.50 / 0.50 / +0.3%
fineweb_q03/datafusion:parquet 73994544 / 74953016 / -1.3% 146274250 / 143231311 / +2.1% 0.51 / 0.52 / -3.3%
fineweb_q04/datafusion:parquet 81969594 / 82510514 / -0.7% 139725052 / 150615871 / -7.2% 0.59 / 0.55 / +7.1%
fineweb_q05/datafusion:parquet 81291752 / 80879871 / +0.5% 144980961 / 140893931 / +2.9% 0.56 / 0.57 / -2.3%
fineweb_q06/datafusion:parquet 75042490 / 74536840 / +0.7% 148047991 / 152689177 / -3.0% 0.51 / 0.49 / +3.8%
fineweb_q07/datafusion:parquet 74867488 / 73961480 / +1.2% 141322263 / 144583470 / -2.3% 0.53 / 0.51 / +3.6%
fineweb_q08/datafusion:parquet 73639522 / 74136670 / -0.7% 145481160 / 146360956 / -0.6% 0.51 / 0.51 / -0.1%
duckdb / vortex-compact / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2401044 / 2202041 / +9.0% 7219295 / 8178854 / -11.7% 🟢 0.33 / 0.27 / +23.5%
fineweb_q01/duckdb:vortex-compact 38352454 / 38255213 / +0.3% 54866361 / 56038760 / -2.1% 0.70 / 0.68 / +2.4%
fineweb_q02/duckdb:vortex-compact 39680241 / 39220346 / +1.2% 56859149 / 57870203 / -1.7% 0.70 / 0.68 / +3.0%
fineweb_q03/duckdb:vortex-compact 151135755 / 155640996 / -2.9% 181880966 / 183450298 / -0.9% 0.83 / 0.85 / -2.1%
fineweb_q04/duckdb:vortex-compact 158340011 / 157794010 / +0.3% 194549609 / 189053619 / +2.9% 0.81 / 0.83 / -2.5%
fineweb_q05/duckdb:vortex-compact 153497748 / 151994704 / +1.0% 184569344 / 184904026 / -0.2% 0.83 / 0.82 / +1.2%
fineweb_q06/duckdb:vortex-compact 83569028 / 82897288 / +0.8% 121836075 / 122867204 / -0.8% 0.69 / 0.67 / +1.7%
fineweb_q07/duckdb:vortex-compact 84163900 / 83617248 / +0.7% 126168698 / 125966372 / +0.2% 0.67 / 0.66 / +0.5%
fineweb_q08/duckdb:vortex-compact 4665166 / 4492824 / +3.8% 11045034 / 10627879 / +3.9% 0.42 / 0.42 / -0.1%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23898072 / 23660946 / +1.0% 27805827 / 27861332 / -0.2% 0.86 / 0.85 / +1.2%
fineweb_q01/duckdb:parquet 54187318 / 54069339 / +0.2% 73638919 / 69758151 / +5.6% 0.74 / 0.78 / -5.1%
fineweb_q02/duckdb:parquet 57209238 / 58759396 / -2.6% 76290255 / 74218713 / +2.8% 0.75 / 0.79 / -5.3%
fineweb_q03/duckdb:parquet 120339722 / 118385959 / +1.7% 177027475 / 178494225 / -0.8% 0.68 / 0.66 / +2.5%
fineweb_q04/duckdb:parquet 162940780 / 162392902 / +0.3% 204044897 / 201669774 / +1.2% 0.80 / 0.81 / -0.8%
fineweb_q05/duckdb:parquet 159759468 / 158225448 / +1.0% 201306054 / 197729378 / +1.8% 0.79 / 0.80 / -0.8%
fineweb_q06/duckdb:parquet 88975356 / 89978513 / -1.1% 144964821 / 145808758 / -0.6% 0.61 / 0.62 / -0.5%
fineweb_q07/duckdb:parquet 91158276 / 90363170 / +0.9% 145629572 / 145706304 / -0.1% 0.63 / 0.62 / +0.9%
fineweb_q08/duckdb:parquet 29005892 / 28922509 / +0.3% 30824909 / 30555260 / +0.9% 0.94 / 0.95 / -0.6%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.1%
Engines: DataFusion No clear signal (-7.5%, low confidence) · DuckDB No clear signal (-4.7%, low confidence)
Vortex (geomean): hot 0.934x ➖ · cold 0.942x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.981x ➖
Shifts: Parquet (control) -0.5% · Median polish -2.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.928x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 322341857 / 376715341 / -14.4% 🟢 564639547 / 592597266 / -4.7% 0.57 / 0.64 / -10.2%
clickbench-sorted_q24/datafusion:vortex-compact 17386230 / 18448586 / -5.8% 54495000 / 58746332 / -7.2% 0.32 / 0.31 / +1.6%
clickbench-sorted_q26/datafusion:vortex-compact 16905996 / 19202416 / -12.0% 🟢 59752525 / 59705011 / +0.1% 0.28 / 0.32 / -12.0%
clickbench-sorted_q36/datafusion:vortex-compact 28326740 / 33447792 / -15.3% 🟢 65645041 / 76173474 / -13.8% 🟢 0.43 / 0.44 / -1.7%
clickbench-sorted_q37/datafusion:vortex-compact 23578182 / 31570408 / -25.3% 🟢 63824144 / 74569059 / -14.4% 🟢 0.37 / 0.42 / -12.7%
clickbench-sorted_q38/datafusion:vortex-compact 23228792 / 22434867 / +3.5% 63740569 / 68125633 / -6.4% 0.36 / 0.33 / +10.7%
clickbench-sorted_q39/datafusion:vortex-compact 44348808 / 44904277 / -1.2% 93042075 / 100149804 / -7.1% 0.48 / 0.45 / +6.3%
clickbench-sorted_q40/datafusion:vortex-compact 13850924 / 13539108 / +2.3% 40412239 / 44941723 / -10.1% 🟢 0.34 / 0.30 / +13.8%
clickbench-sorted_q41/datafusion:vortex-compact 13281120 / 12896440 / +3.0% 42376747 / 43742178 / -3.1% 0.31 / 0.29 / +6.3%
clickbench-sorted_q42/datafusion:vortex-compact 10036718 / 10246420 / -2.0% 33946557 / 36794158 / -7.7% 0.30 / 0.28 / +6.2%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 741576026 / 743486582 / -0.3% 942373821 / 953717459 / -1.2% 0.79 / 0.78 / +0.9%
clickbench-sorted_q24/datafusion:parquet 8691890 / 8812304 / -1.4% 70116624 / 73381307 / -4.4% 0.12 / 0.12 / +3.2%
clickbench-sorted_q26/datafusion:parquet 9530290 / 8811899 / +8.2% 71457633 / 71588525 / -0.2% 0.13 / 0.12 / +8.4%
clickbench-sorted_q36/datafusion:parquet 89745006 / 89912382 / -0.2% 159278825 / 165849249 / -4.0% 0.56 / 0.54 / +3.9%
clickbench-sorted_q37/datafusion:parquet 60972907 / 61102879 / -0.2% 124572876 / 126227040 / -1.3% 0.49 / 0.48 / +1.1%
clickbench-sorted_q38/datafusion:parquet 82792824 / 83148480 / -0.4% 152501245 / 158602670 / -3.8% 0.54 / 0.52 / +3.6%
clickbench-sorted_q39/datafusion:parquet 151623822 / 152558096 / -0.6% 222153469 / 231933377 / -4.2% 0.68 / 0.66 / +3.8%
clickbench-sorted_q40/datafusion:parquet 41355732 / 41523352 / -0.4% 105655381 / 111837530 / -5.5% 0.39 / 0.37 / +5.4%
clickbench-sorted_q41/datafusion:parquet 39006130 / 39148410 / -0.4% 104541192 / 107665962 / -2.9% 0.37 / 0.36 / +2.6%
clickbench-sorted_q42/datafusion:parquet 24716322 / 24845324 / -0.5% 85598823 / 84256350 / +1.6% 0.29 / 0.29 / -2.1%
duckdb / vortex-compact / ns (0.940x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 41090278 / 40431882 / +1.6% 75996440 / 76695245 / -0.9% 0.54 / 0.53 / +2.6%
clickbench-sorted_q24/duckdb:vortex-compact 11033618 / 11708320 / -5.8% 32955587 / 32299854 / +2.0% 0.33 / 0.36 / -7.6%
clickbench-sorted_q26/duckdb:vortex-compact 10981768 / 11874290 / -7.5% 34179675 / 32568530 / +4.9% 0.32 / 0.36 / -11.9%
clickbench-sorted_q36/duckdb:vortex-compact 25469027 / 29899717 / -14.8% 🟢 49128656 / 53617035 / -8.4% 0.52 / 0.56 / -7.0%
clickbench-sorted_q37/duckdb:vortex-compact 20263834 / 26376106 / -23.2% 🟢 43884412 / 50038240 / -12.3% 🟢 0.46 / 0.53 / -12.4%
clickbench-sorted_q38/duckdb:vortex-compact 21009966 / 22019476 / -4.6% 49457806 / 52968106 / -6.6% 0.42 / 0.42 / +2.2%
clickbench-sorted_q39/duckdb:vortex-compact 51143870 / 50706296 / +0.9% 78681596 / 82163942 / -4.2% 0.65 / 0.62 / +5.3%
clickbench-sorted_q40/duckdb:vortex-compact 12172940 / 12489896 / -2.5% 32219925 / 34911525 / -7.7% 0.38 / 0.36 / +5.6%
clickbench-sorted_q41/duckdb:vortex-compact 13669532 / 13000216 / +5.1% 37067874 / 37884226 / -2.2% 0.37 / 0.34 / +7.5%
clickbench-sorted_q42/duckdb:vortex-compact 9858468 / 10487596 / -6.0% 30035977 / 30850079 / -2.6% 0.33 / 0.34 / -3.5%
duckdb / parquet / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 140737126 / 141949628 / -0.9% 161851661 / 172478296 / -6.2% 0.87 / 0.82 / +5.7%
clickbench-sorted_q24/duckdb:parquet 14356265 / 15396114 / -6.8% 19367453 / 20727935 / -6.6% 0.74 / 0.74 / -0.2%
clickbench-sorted_q26/duckdb:parquet 15109354 / 15390833 / -1.8% 24083434 / 22803049 / +5.6% 0.63 / 0.67 / -7.0%
clickbench-sorted_q36/duckdb:parquet 46275390 / 45837152 / +1.0% 55210285 / 58129272 / -5.0% 0.84 / 0.79 / +6.3%
clickbench-sorted_q37/duckdb:parquet 36400537 / 36786309 / -1.0% 42965859 / 44677122 / -3.8% 0.85 / 0.82 / +2.9%
clickbench-sorted_q38/duckdb:parquet 41690440 / 41407918 / +0.7% 54501545 / 55379401 / -1.6% 0.76 / 0.75 / +2.3%
clickbench-sorted_q39/duckdb:parquet 73388638 / 72399766 / +1.4% 81977159 / 80653657 / +1.6% 0.90 / 0.90 / -0.3%
clickbench-sorted_q40/duckdb:parquet 22218248 / 22000698 / +1.0% 29151080 / 27293063 / +6.8% 0.76 / 0.81 / -5.4%
clickbench-sorted_q41/duckdb:parquet 21680586 / 22403562 / -3.2% 28806980 / 28334251 / +1.7% 0.75 / 0.79 / -4.8%
clickbench-sorted_q42/duckdb:parquet 16975392 / 17715080 / -4.2% 22139817 / 23009998 / -3.8% 0.77 / 0.77 / -0.4%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.020x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.016x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16678523 / 16155629 / +3.2% 45550255 / 40412978 / +12.7% 🔴 0.37 / 0.40 / -8.4%
tpch_q02/datafusion:vortex-compact 18299910 / 18083490 / +1.2% 35606569 / 35841857 / -0.7% 0.51 / 0.50 / +1.9%
tpch_q03/datafusion:vortex-compact 20124706 / 20349027 / -1.1% 46576871 / 44623358 / +4.4% 0.43 / 0.46 / -5.3%
tpch_q04/datafusion:vortex-compact 11868101 / 11089618 / +7.0% 32718131 / 31613401 / +3.5% 0.36 / 0.35 / +3.4%
tpch_q05/datafusion:vortex-compact 37030163 / 37868612 / -2.2% 65610980 / 61984750 / +5.9% 0.56 / 0.61 / -7.6%
tpch_q06/datafusion:vortex-compact 7019300 / 6761812 / +3.8% 26900573 / 24317645 / +10.6% 🔴 0.26 / 0.28 / -6.2%
tpch_q07/datafusion:vortex-compact 52800314 / 52670847 / +0.2% 78257767 / 76818942 / +1.9% 0.67 / 0.69 / -1.6%
tpch_q08/datafusion:vortex-compact 51710157 / 51123974 / +1.1% 80354886 / 79085568 / +1.6% 0.64 / 0.65 / -0.5%
tpch_q09/datafusion:vortex-compact 47862272 / 47166078 / +1.5% 76932069 / 78945288 / -2.6% 0.62 / 0.60 / +4.1%
tpch_q10/datafusion:vortex-compact 19137808 / 19118084 / +0.1% 47628369 / 45790712 / +4.0% 0.40 / 0.42 / -3.8%
tpch_q11/datafusion:vortex-compact 14468249 / 14561680 / -0.6% 33546105 / 32746873 / +2.4% 0.43 / 0.44 / -3.0%
tpch_q12/datafusion:vortex-compact 19947200 / 19399152 / +2.8% 42574107 / 44046643 / -3.3% 0.47 / 0.44 / +6.4%
tpch_q13/datafusion:vortex-compact 20502027 / 19986523 / +2.6% 37957803 / 42022275 / -9.7% 0.54 / 0.48 / +13.6%
tpch_q14/datafusion:vortex-compact 15416380 / 15115716 / +2.0% 40364179 / 37935278 / +6.4% 0.38 / 0.40 / -4.1%
tpch_q15/datafusion:vortex-compact 20424801 / 20295009 / +0.6% 44808399 / 44343018 / +1.0% 0.46 / 0.46 / -0.4%
tpch_q16/datafusion:vortex-compact 18637748 / 18702696 / -0.3% 37640846 / 38629741 / -2.6% 0.50 / 0.48 / +2.3%
tpch_q17/datafusion:vortex-compact 28953912 / 28890971 / +0.2% 59052383 / 59099515 / -0.1% 0.49 / 0.49 / +0.3%
tpch_q18/datafusion:vortex-compact 35916102 / 35877540 / +0.1% 58193320 / 57403240 / +1.4% 0.62 / 0.63 / -1.3%
tpch_q19/datafusion:vortex-compact 13679178 / 13973449 / -2.1% 38999329 / 36132764 / +7.9% 0.35 / 0.39 / -9.3%
tpch_q20/datafusion:vortex-compact 20992734 / 21220471 / -1.1% 45128979 / 42507498 / +6.2% 0.47 / 0.50 / -6.8%
tpch_q21/datafusion:vortex-compact 40264617 / 41753134 / -3.6% 68343637 / 69611177 / -1.8% 0.59 / 0.60 / -1.8%
tpch_q22/datafusion:vortex-compact 10841459 / 11111382 / -2.4% 30654668 / 29963028 / +2.3% 0.35 / 0.37 / -4.6%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71473492 / 71429034 / +0.1% 89462946 / 85012595 / +5.2% 0.80 / 0.84 / -4.9%
tpch_q02/datafusion:parquet 75377047 / 76510196 / -1.5% 91581143 / 92141672 / -0.6% 0.82 / 0.83 / -0.9%
tpch_q03/datafusion:parquet 81515105 / 82027227 / -0.6% 102594198 / 102451813 / +0.1% 0.79 / 0.80 / -0.8%
tpch_q04/datafusion:parquet 38973811 / 39374266 / -1.0% 57509598 / 56219353 / +2.3% 0.68 / 0.70 / -3.2%
tpch_q05/datafusion:parquet 110369812 / 110706098 / -0.3% 136930552 / 133201812 / +2.8% 0.81 / 0.83 / -3.0%
tpch_q06/datafusion:parquet 31235829 / 31325622 / -0.3% 48279919 / 46029345 / +4.9% 0.65 / 0.68 / -4.9%
tpch_q07/datafusion:parquet 112100093 / 113135471 / -0.9% 137319690 / 135722594 / +1.2% 0.82 / 0.83 / -2.1%
tpch_q08/datafusion:parquet 117029695 / 117236658 / -0.2% 146871442 / 140448253 / +4.6% 0.80 / 0.83 / -4.5%
tpch_q09/datafusion:parquet 137431295 / 137264892 / +0.1% 166433178 / 163400857 / +1.9% 0.83 / 0.84 / -1.7%
tpch_q10/datafusion:parquet 103543514 / 103003805 / +0.5% 129290298 / 124363032 / +4.0% 0.80 / 0.83 / -3.3%
tpch_q11/datafusion:parquet 61910413 / 61169448 / +1.2% 81726818 / 80841141 / +1.1% 0.76 / 0.76 / +0.1%
tpch_q12/datafusion:parquet 63225796 / 64170949 / -1.5% 83296253 / 82291764 / +1.2% 0.76 / 0.78 / -2.7%
tpch_q13/datafusion:parquet 142850807 / 143508193 / -0.5% 161467867 / 159967764 / +0.9% 0.88 / 0.90 / -1.4%
tpch_q14/datafusion:parquet 47474052 / 47599355 / -0.3% 70395742 / 65507004 / +7.5% 0.67 / 0.73 / -7.2%
tpch_q15/datafusion:parquet 73157124 / 73861604 / -1.0% 91885702 / 91121777 / +0.8% 0.80 / 0.81 / -1.8%
tpch_q16/datafusion:parquet 42829051 / 43445611 / -1.4% 60142234 / 60816428 / -1.1% 0.71 / 0.71 / -0.3%
tpch_q17/datafusion:parquet 122767312 / 123419841 / -0.5% 146454530 / 144817260 / +1.1% 0.84 / 0.85 / -1.6%
tpch_q18/datafusion:parquet 120894263 / 120960924 / -0.1% 142339199 / 139093100 / +2.3% 0.85 / 0.87 / -2.3%
tpch_q19/datafusion:parquet 57158441 / 56347368 / +1.4% 83563206 / 81151617 / +3.0% 0.68 / 0.69 / -1.5%
tpch_q20/datafusion:parquet 78138538 / 77819071 / +0.4% 101020418 / 100323040 / +0.7% 0.77 / 0.78 / -0.3%
tpch_q21/datafusion:parquet 113010616 / 113782248 / -0.7% 137952492 / 137691926 / +0.2% 0.82 / 0.83 / -0.9%
tpch_q22/datafusion:parquet 52001020 / 51552673 / +0.9% 68404366 / 67489377 / +1.4% 0.76 / 0.76 / -0.5%
duckdb / vortex-compact / ns (0.993x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 9588854 / 11110884 / -13.7% 🟢 19589967 / 20913721 / -6.3% 0.49 / 0.53 / -7.9%
tpch_q02/duckdb:vortex-compact 18737760 / 18529800 / +1.1% 26737462 / 26125676 / +2.3% 0.70 / 0.71 / -1.2%
tpch_q03/duckdb:vortex-compact 19767515 / 19924965 / -0.8% 35029963 / 33673987 / +4.0% 0.56 / 0.59 / -4.6%
tpch_q04/duckdb:vortex-compact 13254512 / 13371440 / -0.9% 25611193 / 24960119 / +2.6% 0.52 / 0.54 / -3.4%
tpch_q05/duckdb:vortex-compact 20728897 / 21124629 / -1.9% 35360297 / 33989909 / +4.0% 0.59 / 0.62 / -5.7%
tpch_q06/duckdb:vortex-compact 5535901 / 5141192 / +7.7% 14079204 / 14715794 / -4.3% 0.39 / 0.35 / +12.5%
tpch_q07/duckdb:vortex-compact 25375490 / 25430970 / -0.2% 39178387 / 39935916 / -1.9% 0.65 / 0.64 / +1.7%
tpch_q08/duckdb:vortex-compact 21886971 / 21725140 / +0.7% 37488333 / 36337568 / +3.2% 0.58 / 0.60 / -2.3%
tpch_q09/duckdb:vortex-compact 24554176 / 24008528 / +2.3% 37351835 / 39317059 / -5.0% 0.66 / 0.61 / +7.7%
tpch_q10/duckdb:vortex-compact 26179878 / 26017817 / +0.6% 41056234 / 38641678 / +6.2% 0.64 / 0.67 / -5.3%
tpch_q11/duckdb:vortex-compact 8728863 / 8620903 / +1.3% 17800934 / 17034521 / +4.5% 0.49 / 0.51 / -3.1%
tpch_q12/duckdb:vortex-compact 17385070 / 17522968 / -0.8% 26616186 / 26879990 / -1.0% 0.65 / 0.65 / +0.2%
tpch_q13/duckdb:vortex-compact 20087411 / 20527160 / -2.1% 32849340 / 30819931 / +6.6% 0.61 / 0.67 / -8.2%
tpch_q14/duckdb:vortex-compact 12392547 / 12647800 / -2.0% 27049359 / 25027532 / +8.1% 0.46 / 0.51 / -9.3%
tpch_q15/duckdb:vortex-compact 9910920 / 9591538 / +3.3% 21209647 / 21460244 / -1.2% 0.47 / 0.45 / +4.6%
tpch_q16/duckdb:vortex-compact 17205623 / 17376515 / -1.0% 23186410 / 23184208 / +0.0% 0.74 / 0.75 / -1.0%
tpch_q17/duckdb:vortex-compact 13349471 / 13972707 / -4.5% 28246366 / 28336672 / -0.3% 0.47 / 0.49 / -4.2%
tpch_q18/duckdb:vortex-compact 24541382 / 24851420 / -1.2% 33473675 / 34208158 / -2.1% 0.73 / 0.73 / +0.9%
tpch_q19/duckdb:vortex-compact 15151652 / 14924918 / +1.5% 31934493 / 28312680 / +12.8% 🔴 0.47 / 0.53 / -10.0%
tpch_q20/duckdb:vortex-compact 16946339 / 17419395 / -2.7% 32555308 / 31928893 / +2.0% 0.52 / 0.55 / -4.6%
tpch_q21/duckdb:vortex-compact 38587724 / 38613253 / -0.1% 57749658 / 55753882 / +3.6% 0.67 / 0.69 / -3.5%
tpch_q22/duckdb:vortex-compact 19698482 / 19579063 / +0.6% 28845607 / 28500407 / +1.2% 0.68 / 0.69 / -0.6%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47476974 / 47568370 / -0.2% 53697491 / 53830805 / -0.2% 0.88 / 0.88 / +0.1%
tpch_q02/duckdb:parquet 48162766 / 48329340 / -0.3% 55799695 / 55319753 / +0.9% 0.86 / 0.87 / -1.2%
tpch_q03/duckdb:parquet 60058330 / 59997886 / +0.1% 69146955 / 67206638 / +2.9% 0.87 / 0.89 / -2.7%
tpch_q04/duckdb:parquet 34734310 / 34773771 / -0.1% 43845326 / 42562062 / +3.0% 0.79 / 0.82 / -3.0%
tpch_q05/duckdb:parquet 66967465 / 67129183 / -0.2% 78663073 / 77275794 / +1.8% 0.85 / 0.87 / -2.0%
tpch_q06/duckdb:parquet 21807354 / 21605472 / +0.9% 27699914 / 26971759 / +2.7% 0.79 / 0.80 / -1.7%
tpch_q07/duckdb:parquet 63674201 / 63901817 / -0.4% 74211092 / 73063960 / +1.6% 0.86 / 0.87 / -1.9%
tpch_q08/duckdb:parquet 75553288 / 75522038 / +0.0% 87437866 / 86388767 / +1.2% 0.86 / 0.87 / -1.2%
tpch_q09/duckdb:parquet 107640602 / 106810390 / +0.8% 119441663 / 118828847 / +0.5% 0.90 / 0.90 / +0.3%
tpch_q10/duckdb:parquet 105573561 / 105522969 / +0.0% 118566287 / 116402645 / +1.9% 0.89 / 0.91 / -1.8%
tpch_q11/duckdb:parquet 29453357 / 29199745 / +0.9% 35263115 / 35148524 / +0.3% 0.84 / 0.83 / +0.5%
tpch_q12/duckdb:parquet 37058421 / 37120537 / -0.2% 44059930 / 43539567 / +1.2% 0.84 / 0.85 / -1.3%
tpch_q13/duckdb:parquet 174351658 / 174363675 / -0.0% 181618041 / 181038362 / +0.3% 0.96 / 0.96 / -0.3%
tpch_q14/duckdb:parquet 42293888 / 42423027 / -0.3% 51041174 / 51210722 / -0.3% 0.83 / 0.83 / +0.0%
tpch_q15/duckdb:parquet 32583972 / 32551871 / +0.1% 41298975 / 41147909 / +0.4% 0.79 / 0.79 / -0.3%
tpch_q16/duckdb:parquet 46828061 / 46696967 / +0.3% 52687045 / 52182059 / +1.0% 0.89 / 0.89 / -0.7%
tpch_q17/duckdb:parquet 47760379 / 47894656 / -0.3% 57790619 / 57347292 / +0.8% 0.83 / 0.84 / -1.0%
tpch_q18/duckdb:parquet 73781481 / 73775421 / +0.0% 80771828 / 80205896 / +0.7% 0.91 / 0.92 / -0.7%
tpch_q19/duckdb:parquet 49029682 / 47726448 / +2.7% 56863231 / 58938889 / -3.5% 0.86 / 0.81 / +6.5%
tpch_q20/duckdb:parquet 63387503 / 63693606 / -0.5% 74493634 / 72802043 / +2.3% 0.85 / 0.87 / -2.7%
tpch_q21/duckdb:parquet 106281935 / 106304050 / -0.0% 117887354 / 113835026 / +3.6% 0.90 / 0.93 / -3.5%
tpch_q22/duckdb:parquet 50430645 / 50349974 / +0.2% 59415642 / 57666857 / +3.0% 0.85 / 0.87 / -2.8%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.982x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1780641 / 1803117 / -1.2% 7257373 / 7475622 / -2.9% 0.25 / 0.24 / +1.7%
statpopgen_q01/datafusion:vortex-compact 4423938 / 3804378 / +16.3% 🔴 13355127 / 12913402 / +3.4% 0.33 / 0.29 / +12.4%
statpopgen_q02/datafusion:vortex-compact 43899901 / 44013488 / -0.3% 64418240 / 65286814 / -1.3% 0.68 / 0.67 / +1.1%
statpopgen_q03/datafusion:vortex-compact 118726025 / 118079950 / +0.5% 152278754 / 151970457 / +0.2% 0.78 / 0.78 / +0.3%
statpopgen_q04/datafusion:vortex-compact 118692640 / 118708956 / -0.0% 153254102 / 155579474 / -1.5% 0.77 / 0.76 / +1.5%
statpopgen_q05/datafusion:vortex-compact 72273976 / 72915598 / -0.9% 105221591 / 110789206 / -5.0% 0.69 / 0.66 / +4.4%
statpopgen_q06/datafusion:vortex-compact 199816948 / 194150914 / +2.9% 233523625 / 232063220 / +0.6% 0.86 / 0.84 / +2.3%
statpopgen_q07/datafusion:vortex-compact 346693874 / 350337547 / -1.0% 373583845 / 373219769 / +0.1% 0.93 / 0.94 / -1.1%
statpopgen_q08/datafusion:vortex-compact 358174430 / 354961396 / +0.9% 379817503 / 416103917 / -8.7% 0.94 / 0.85 / +10.5%
statpopgen_q09/datafusion:vortex-compact 100010540 / 99902864 / +0.1% 131118237 / 131676892 / -0.4% 0.76 / 0.76 / +0.5%
statpopgen_q10/datafusion:vortex-compact 255867706 / 257730580 / -0.7% 301375362 / 299772985 / +0.5% 0.85 / 0.86 / -1.3%
datafusion / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1963133 / 1929260 / +1.8% 89869294 / 91211430 / -1.5% 0.02 / 0.02 / +3.3%
statpopgen_q01/datafusion:parquet 161305735 / 162950728 / -1.0% 174244792 / 171156932 / +1.8% 0.93 / 0.95 / -2.8%
statpopgen_q02/datafusion:parquet 289408942 / 276020453 / +4.9% 413830461 / 418391859 / -1.1% 0.70 / 0.66 / +6.0%
statpopgen_q03/datafusion:parquet 387811349 / 389086320 / -0.3% 517288864 / 519669833 / -0.5% 0.75 / 0.75 / +0.1%
statpopgen_q04/datafusion:parquet 399085676 / 388857796 / +2.6% 528400959 / 538517679 / -1.9% 0.76 / 0.72 / +4.6%
statpopgen_q05/datafusion:parquet 321247813 / 314763407 / +2.1% 453526296 / 440254001 / +3.0% 0.71 / 0.71 / -0.9%
statpopgen_q06/datafusion:parquet 476442790 / 482550679 / -1.3% 636150974 / 573190042 / +11.0% 🔴 0.75 / 0.84 / -11.0%
statpopgen_q07/datafusion:parquet 421588054 / 420628788 / +0.2% 549442559 / 544172844 / +1.0% 0.77 / 0.77 / -0.7%
statpopgen_q08/datafusion:parquet 418969704 / 420897892 / -0.5% 546601626 / 542683083 / +0.7% 0.77 / 0.78 / -1.2%
statpopgen_q09/datafusion:parquet 363817297 / 363554841 / +0.1% 496244576 / 491320306 / +1.0% 0.73 / 0.74 / -0.9%
statpopgen_q10/datafusion:parquet 557098264 / 545444054 / +2.1% 683503169 / 699615183 / -2.3% 0.82 / 0.78 / +4.5%
duckdb / vortex-compact / ns (0.985x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 12963536 / 12863779 / +0.8% 14959137 / 14825289 / +0.9% 0.87 / 0.87 / -0.1%
statpopgen_q01/duckdb:vortex-compact 13971510 / 13876800 / +0.7% 17423711 / 17729600 / -1.7% 0.80 / 0.78 / +2.5%
statpopgen_q02/duckdb:vortex-compact 131571895 / 142856587 / -7.9% 148053940 / 164663841 / -10.1% 🟢 0.89 / 0.87 / +2.4%
statpopgen_q03/duckdb:vortex-compact 288414122 / 286823177 / +0.6% 346389570 / 347716241 / -0.4% 0.83 / 0.82 / +0.9%
statpopgen_q04/duckdb:vortex-compact 301424954 / 306312598 / -1.6% 363945140 / 360761214 / +0.9% 0.83 / 0.85 / -2.5%
statpopgen_q05/duckdb:vortex-compact 99244932 / 100507062 / -1.3% 120452780 / 119570677 / +0.7% 0.82 / 0.84 / -2.0%
statpopgen_q06/duckdb:vortex-compact 231152575 / 232454903 / -0.6% 247911834 / 249863342 / -0.8% 0.93 / 0.93 / +0.2%
statpopgen_q07/duckdb:vortex-compact 199445603 / 200814185 / -0.7% 211822222 / 216814137 / -2.3% 0.94 / 0.93 / +1.7%
statpopgen_q08/duckdb:vortex-compact 210822604 / 212849794 / -1.0% 229797578 / 234651067 / -2.1% 0.92 / 0.91 / +1.1%
statpopgen_q09/duckdb:vortex-compact 293197062 / 304770960 / -3.8% 313646423 / 324060861 / -3.2% 0.93 / 0.94 / -0.6%
statpopgen_q10/duckdb:vortex-compact 705415492 / 719268638 / -1.9% 760039707 / 800298566 / -5.0% 0.93 / 0.90 / +3.3%
duckdb / parquet / ns (0.985x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 244320751 / 250204290 / -2.4% 244393940 / 250598708 / -2.5% 1.00 / 1.00 / +0.1%
statpopgen_q01/duckdb:parquet 304205474 / 309812498 / -1.8% 304117348 / 308990057 / -1.6% 1.00 / 1.00 / -0.2%
statpopgen_q02/duckdb:parquet 562400189 / 569212217 / -1.2% 550983906 / 575897038 / -4.3% 1.02 / 0.99 / +3.3%
statpopgen_q03/duckdb:parquet 753772088 / 741558186 / +1.6% 805384214 / 828111874 / -2.7% 0.94 / 0.90 / +4.5%
statpopgen_q04/duckdb:parquet 746732535 / 756828486 / -1.3% 811764284 / 822323621 / -1.3% 0.92 / 0.92 / -0.1%
statpopgen_q05/duckdb:parquet 533771871 / 543045098 / -1.7% 577079439 / 581498297 / -0.8% 0.92 / 0.93 / -1.0%
statpopgen_q06/duckdb:parquet 646059393 / 641674732 / +0.7% 678329703 / 694599826 / -2.3% 0.95 / 0.92 / +3.1%
statpopgen_q07/duckdb:parquet 561028320 / 566999104 / -1.1% 557695431 / 571880208 / -2.5% 1.01 / 0.99 / +1.5%
statpopgen_q08/duckdb:parquet 568318702 / 571557774 / -0.6% 562682869 / 564611329 / -0.3% 1.01 / 1.01 / -0.2%
statpopgen_q09/duckdb:parquet 694816434 / 724292268 / -4.1% 749649183 / 777949512 / -3.6% 0.93 / 0.93 / -0.4%
statpopgen_q10/duckdb:parquet 1010963282 / 1056214627 / -4.3% 1071736715 / 1161555498 / -7.7% 0.94 / 0.91 / +3.7%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.8%
Engines: DataFusion No clear signal (-9.3%, environment too noisy confidence) · DuckDB No clear signal (-6.3%, environment too noisy confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.061x ➖
Parquet (geomean): hot 1.085x ➖ · cold 1.168x ➖
Shifts: Parquet (control) +8.5% · Median polish +4.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 37800036 / 33420512 / +13.1% 127551327 / 120598549 / +5.8% 0.30 / 0.28 / +6.9%
fineweb_q01/datafusion:vortex-compact 342285203 / 375633854 / -8.9% 672026889 / 507995806 / +32.3% 🔴 0.51 / 0.74 / -31.1%
fineweb_q02/datafusion:vortex-compact 320211788 / 314253456 / +1.9% 401499699 / 452017305 / -11.2% 0.80 / 0.70 / +14.7%
fineweb_q03/datafusion:vortex-compact 504626646 / 502692106 / +0.4% 575236371 / 561505195 / +2.4% 0.88 / 0.90 / -2.0%
fineweb_q04/datafusion:vortex-compact 511363432 / 502631538 / +1.7% 608116553 / 532275670 / +14.2% 0.84 / 0.94 / -11.0%
fineweb_q05/datafusion:vortex-compact 624170804 / 484874986 / +28.7% 610867797 / 502391526 / +21.6% 1.02 / 0.97 / +5.9%
fineweb_q06/datafusion:vortex-compact 596944320 / 538706607 / +10.8% 675917448 / 625321566 / +8.1% 0.88 / 0.86 / +2.5%
fineweb_q07/datafusion:vortex-compact 558803588 / 773250928 / -27.7% 655780707 / 515207565 / +27.3% 0.85 / 1.50 / -43.2%
fineweb_q08/datafusion:vortex-compact 153741052 / 154338666 / -0.4% 188580255 / 158510188 / +19.0% 0.82 / 0.97 / -16.3%
datafusion / parquet / ns (1.114x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 408658226 / 362123088 / +12.9% 748900477 / 755861632 / -0.9% 0.55 / 0.48 / +13.9%
fineweb_q01/datafusion:parquet 793669144 / 735400064 / +7.9% 1115144221 / 655035795 / +70.2% 🔴 0.71 / 1.12 / -36.6%
fineweb_q02/datafusion:parquet 862876912 / 702427285 / +22.8% 1012504370 / 657634993 / +54.0% 🔴 0.85 / 1.07 / -20.2%
fineweb_q03/datafusion:parquet 933100995 / 709561564 / +31.5% 🔴 864123152 / 806108975 / +7.2% 1.08 / 0.88 / +22.7%
fineweb_q04/datafusion:parquet 762964292 / 722420714 / +5.6% 857334141 / 675601317 / +26.9% 0.89 / 1.07 / -16.8%
fineweb_q05/datafusion:parquet 859259992 / 754737860 / +13.8% 844530059 / 806533741 / +4.7% 1.02 / 0.94 / +8.7%
fineweb_q06/datafusion:parquet 746936150 / 745127153 / +0.2% 717264036 / 702351073 / +2.1% 1.04 / 1.06 / -1.8%
fineweb_q07/datafusion:parquet 741367406 / 720898904 / +2.8% 778902779 / 639963843 / +21.7% 0.95 / 1.13 / -15.5%
fineweb_q08/datafusion:parquet 750379292 / 690777835 / +8.6% 921160392 / 630081696 / +46.2% 🔴 0.81 / 1.10 / -25.7%
duckdb / vortex-compact / ns (0.989x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 53930749 / 66307661 / -18.7% 97145871 / 85097365 / +14.2% 0.56 / 0.78 / -28.8%
fineweb_q01/duckdb:vortex-compact 358974874 / 288040774 / +24.6% 346877605 / 327664202 / +5.9% 1.03 / 0.88 / +17.7%
fineweb_q02/duckdb:vortex-compact 324622028 / 544600278 / -40.4% 🟢 343738516 / 395625261 / -13.1% 0.94 / 1.38 / -31.4%
fineweb_q03/duckdb:vortex-compact 882864316 / 849447528 / +3.9% 889859392 / 927991475 / -4.1% 0.99 / 0.92 / +8.4%
fineweb_q04/duckdb:vortex-compact 902239632 / 855786559 / +5.4% 975504208 / 896418411 / +8.8% 0.92 / 0.95 / -3.1%
fineweb_q05/duckdb:vortex-compact 863165785 / 893117106 / -3.4% 992217343 / 954658806 / +3.9% 0.87 / 0.94 / -7.0%
fineweb_q06/duckdb:vortex-compact 869366571 / 870691656 / -0.2% 895538592 / 1096280031 / -18.3% 0.97 / 0.79 / +22.2%
fineweb_q07/duckdb:vortex-compact 897137091 / 828824668 / +8.2% 911731851 / 835117845 / +9.2% 0.98 / 0.99 / -0.9%
fineweb_q08/duckdb:vortex-compact 195698109 / 149045615 / +31.3% 🔴 231477320 / 232648985 / -0.5% 0.85 / 0.64 / +32.0%
duckdb / parquet / ns (1.056x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 296807337 / 295110286 / +0.6% 357874863 / 347251084 / +3.1% 0.83 / 0.85 / -2.4%
fineweb_q01/duckdb:parquet 553777769 / 524008291 / +5.7% 614395819 / 506191808 / +21.4% 0.90 / 1.04 / -12.9%
fineweb_q02/duckdb:parquet 543592116 / 538218450 / +1.0% 591475952 / 553491242 / +6.9% 0.92 / 0.97 / -5.5%
fineweb_q03/duckdb:parquet 832474062 / 655126317 / +27.1% 889061379 / 742457974 / +19.7% 0.94 / 0.88 / +6.1%
fineweb_q04/duckdb:parquet 724648276 / 669895810 / +8.2% 688498336 / 764993525 / -10.0% 1.05 / 0.88 / +20.2%
fineweb_q05/duckdb:parquet 687111304 / 976271026 / -29.6% 794405634 / 833264585 / -4.7% 0.86 / 1.17 / -26.2%
fineweb_q06/duckdb:parquet 877398270 / 719887626 / +21.9% 1060950161 / 735597393 / +44.2% 🔴 0.83 / 0.98 / -15.5%
fineweb_q07/duckdb:parquet 747778552 / 712383864 / +5.0% 804922709 / 781610309 / +3.0% 0.93 / 0.91 / +1.9%
fineweb_q08/duckdb:parquet 349814971 / 284683699 / +22.9% 393146223 / 326906288 / +20.3% 0.89 / 0.87 / +2.2%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.991x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.975x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 102080603 / 102130133 / -0.0% 156969451 / 148829730 / +5.5% 0.65 / 0.69 / -5.2%
tpch_q02/datafusion:vortex-compact 64351714 / 64607128 / -0.4% 93552924 / 92553441 / +1.1% 0.69 / 0.70 / -1.5%
tpch_q03/datafusion:vortex-compact 66951622 / 66834561 / +0.2% 109928687 / 114100160 / -3.7% 0.61 / 0.59 / +4.0%
tpch_q04/datafusion:vortex-compact 37877870 / 38690364 / -2.1% 66414177 / 69654819 / -4.7% 0.57 / 0.56 / +2.7%
tpch_q05/datafusion:vortex-compact 119229114 / 119486744 / -0.2% 172602730 / 176062460 / -2.0% 0.69 / 0.68 / +1.8%
tpch_q06/datafusion:vortex-compact 15294031 / 15774803 / -3.0% 56533110 / 51286684 / +10.2% 🔴 0.27 / 0.31 / -12.0%
tpch_q07/datafusion:vortex-compact 140425312 / 139872782 / +0.4% 199671676 / 194579140 / +2.6% 0.70 / 0.72 / -2.2%
tpch_q08/datafusion:vortex-compact 145924099 / 144484037 / +1.0% 206194521 / 211974835 / -2.7% 0.71 / 0.68 / +3.8%
tpch_q09/datafusion:vortex-compact 187835523 / 185927636 / +1.0% 247363986 / 267065856 / -7.4% 0.76 / 0.70 / +9.1%
tpch_q10/datafusion:vortex-compact 78065860 / 77991193 / +0.1% 129688807 / 131315259 / -1.2% 0.60 / 0.59 / +1.4%
tpch_q11/datafusion:vortex-compact 44078811 / 43999655 / +0.2% 65375118 / 73543859 / -11.1% 🟢 0.67 / 0.60 / +12.7%
tpch_q12/datafusion:vortex-compact 46919217 / 47188316 / -0.6% 75615245 / 78194059 / -3.3% 0.62 / 0.60 / +2.8%
tpch_q13/datafusion:vortex-compact 55333703 / 57747988 / -4.2% 85946178 / 89633295 / -4.1% 0.64 / 0.64 / -0.1%
tpch_q14/datafusion:vortex-compact 25028224 / 26034970 / -3.9% 86108663 / 86778150 / -0.8% 0.29 / 0.30 / -3.1%
tpch_q15/datafusion:vortex-compact 45983976 / 46906600 / -2.0% 98531294 / 95844048 / +2.8% 0.47 / 0.49 / -4.6%
tpch_q16/datafusion:vortex-compact 39664220 / 38972185 / +1.8% 64236715 / 66790306 / -3.8% 0.62 / 0.58 / +5.8%
tpch_q17/datafusion:vortex-compact 176481809 / 178849702 / -1.3% 215201254 / 217186930 / -0.9% 0.82 / 0.82 / -0.4%
tpch_q18/datafusion:vortex-compact 207697051 / 208329722 / -0.3% 261026672 / 270043902 / -3.3% 0.80 / 0.77 / +3.1%
tpch_q19/datafusion:vortex-compact 35131140 / 36059829 / -2.6% 80116916 / 79455861 / +0.8% 0.44 / 0.45 / -3.4%
tpch_q20/datafusion:vortex-compact 64533861 / 65380724 / -1.3% 115471405 / 121374506 / -4.9% 0.56 / 0.54 / +3.8%
tpch_q21/datafusion:vortex-compact 185579656 / 185286634 / +0.2% 241966400 / 251351915 / -3.7% 0.77 / 0.74 / +4.0%
tpch_q22/datafusion:vortex-compact 26603650 / 26408302 / +0.7% 56805870 / 58768757 / -3.3% 0.47 / 0.45 / +4.2%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87936640 / 86930274 / +1.2% 122897553 / 129197942 / -4.9% 0.72 / 0.67 / +6.3%
tpch_q02/datafusion:parquet 172729905 / 173162246 / -0.2% 196314422 / 200544839 / -2.1% 0.88 / 0.86 / +1.9%
tpch_q03/datafusion:parquet 134642717 / 134615206 / +0.0% 182525912 / 187479051 / -2.6% 0.74 / 0.72 / +2.7%
tpch_q04/datafusion:parquet 56597396 / 57360711 / -1.3% 87642806 / 97242167 / -9.9% 0.65 / 0.59 / +9.5%
tpch_q05/datafusion:parquet 166420947 / 167314852 / -0.5% 221379648 / 226466897 / -2.2% 0.75 / 0.74 / +1.8%
tpch_q06/datafusion:parquet 36408961 / 36452283 / -0.1% 72522596 / 77868492 / -6.9% 0.50 / 0.47 / +7.2%
tpch_q07/datafusion:parquet 216308324 / 214809269 / +0.7% 271595698 / 267366936 / +1.6% 0.80 / 0.80 / -0.9%
tpch_q08/datafusion:parquet 218276612 / 218678416 / -0.2% 281037339 / 293093121 / -4.1% 0.78 / 0.75 / +4.1%
tpch_q09/datafusion:parquet 309152554 / 309815205 / -0.2% 368070773 / 381379603 / -3.5% 0.84 / 0.81 / +3.4%
tpch_q10/datafusion:parquet 311399637 / 312320112 / -0.3% 370652104 / 373079659 / -0.7% 0.84 / 0.84 / +0.4%
tpch_q11/datafusion:parquet 126883347 / 126696322 / +0.1% 149831231 / 153052404 / -2.1% 0.85 / 0.83 / +2.3%
tpch_q12/datafusion:parquet 81940150 / 82652551 / -0.9% 115435620 / 122846137 / -6.0% 0.71 / 0.67 / +5.5%
tpch_q13/datafusion:parquet 210420970 / 210450787 / -0.0% 240251562 / 247055550 / -2.8% 0.88 / 0.85 / +2.8%
tpch_q14/datafusion:parquet 85909393 / 86768341 / -1.0% 182142287 / 186217635 / -2.2% 0.47 / 0.47 / +1.2%
tpch_q15/datafusion:parquet 105271665 / 105116914 / +0.1% 151372801 / 157766209 / -4.1% 0.70 / 0.67 / +4.4%
tpch_q16/datafusion:parquet 96807329 / 95958138 / +0.9% 116295160 / 125595225 / -7.4% 0.83 / 0.76 / +9.0%
tpch_q17/datafusion:parquet 214930625 / 214442711 / +0.2% 257289959 / 266035143 / -3.3% 0.84 / 0.81 / +3.6%
tpch_q18/datafusion:parquet 268690794 / 269029755 / -0.1% 313915557 / 315632987 / -0.5% 0.86 / 0.85 / +0.4%
tpch_q19/datafusion:parquet 107653806 / 108088106 / -0.4% 163034905 / 170849163 / -4.6% 0.66 / 0.63 / +4.4%
tpch_q20/datafusion:parquet 184490098 / 185198278 / -0.4% 241861692 / 245174702 / -1.4% 0.76 / 0.76 / +1.0%
tpch_q21/datafusion:parquet 242978114 / 244416050 / -0.6% 302473417 / 307604428 / -1.7% 0.80 / 0.79 / +1.1%
tpch_q22/datafusion:parquet 149424150 / 149783339 / -0.2% 174848548 / 174738178 / +0.1% 0.85 / 0.86 / -0.3%
duckdb / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 45952768 / 47891635 / -4.0% 74529301 / 74270295 / +0.3% 0.62 / 0.64 / -4.4%
tpch_q02/duckdb:vortex-compact 30960836 / 31697914 / -2.3% 44346219 / 45671852 / -2.9% 0.70 / 0.69 / +0.6%
tpch_q03/duckdb:vortex-compact 58073998 / 59045172 / -1.6% 96933329 / 96089318 / +0.9% 0.60 / 0.61 / -2.5%
tpch_q04/duckdb:vortex-compact 54706651 / 54206385 / +0.9% 79398932 / 79611279 / -0.3% 0.69 / 0.68 / +1.2%
tpch_q05/duckdb:vortex-compact 71179460 / 70989967 / +0.3% 102802437 / 104104044 / -1.3% 0.69 / 0.68 / +1.5%
tpch_q06/duckdb:vortex-compact 20372582 / 19658439 / +3.6% 51001959 / 50906642 / +0.2% 0.40 / 0.39 / +3.4%
tpch_q07/duckdb:vortex-compact 63269151 / 63535832 / -0.4% 105165018 / 106004504 / -0.8% 0.60 / 0.60 / +0.4%
tpch_q08/duckdb:vortex-compact 92292090 / 91121828 / +1.3% 130886086 / 125174310 / +4.6% 0.71 / 0.73 / -3.1%
tpch_q09/duckdb:vortex-compact 111468894 / 109225020 / +2.1% 154249064 / 149107005 / +3.4% 0.72 / 0.73 / -1.3%
tpch_q10/duckdb:vortex-compact 104025136 / 104605396 / -0.6% 141606801 / 146673838 / -3.5% 0.73 / 0.71 / +3.0%
tpch_q11/duckdb:vortex-compact 14272640 / 14329508 / -0.4% 28889385 / 28571715 / +1.1% 0.49 / 0.50 / -1.5%
tpch_q12/duckdb:vortex-compact 60642552 / 60162681 / +0.8% 81456667 / 81242357 / +0.3% 0.74 / 0.74 / +0.5%
tpch_q13/duckdb:vortex-compact 77130798 / 77251600 / -0.2% 103288754 / 101618172 / +1.6% 0.75 / 0.76 / -1.8%
tpch_q14/duckdb:vortex-compact 33603893 / 32903817 / +2.1% 69662435 / 72114471 / -3.4% 0.48 / 0.46 / +5.7%
tpch_q15/duckdb:vortex-compact 31392431 / 31641138 / -0.8% 66687539 / 68061995 / -2.0% 0.47 / 0.46 / +1.3%
tpch_q16/duckdb:vortex-compact 49829962 / 50326281 / -1.0% 60809093 / 58786150 / +3.4% 0.82 / 0.86 / -4.3%
tpch_q17/duckdb:vortex-compact 37263626 / 37138666 / +0.3% 66256378 / 66201498 / +0.1% 0.56 / 0.56 / +0.3%
tpch_q18/duckdb:vortex-compact 109103290 / 106777778 / +2.2% 119354214 / 120754397 / -1.2% 0.91 / 0.88 / +3.4%
tpch_q19/duckdb:vortex-compact 34981908 / 34928103 / +0.2% 76093668 / 75698895 / +0.5% 0.46 / 0.46 / -0.4%
tpch_q20/duckdb:vortex-compact 52030871 / 51533846 / +1.0% 97677101 / 94022800 / +3.9% 0.53 / 0.55 / -2.8%
tpch_q21/duckdb:vortex-compact 105989658 / 104550302 / +1.4% 148102135 / 147057660 / +0.7% 0.72 / 0.71 / +0.7%
tpch_q22/duckdb:vortex-compact 35306879 / 35655314 / -1.0% 51103176 / 52867324 / -3.3% 0.69 / 0.67 / +2.4%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67448980 / 67488522 / -0.1% 85983846 / 87994521 / -2.3% 0.78 / 0.77 / +2.3%
tpch_q02/duckdb:parquet 86779108 / 87150720 / -0.4% 96079026 / 97640418 / -1.6% 0.90 / 0.89 / +1.2%
tpch_q03/duckdb:parquet 110151609 / 109891372 / +0.2% 141569397 / 144768408 / -2.2% 0.78 / 0.76 / +2.5%
tpch_q04/duckdb:parquet 76755365 / 76718478 / +0.0% 97361950 / 100403176 / -3.0% 0.79 / 0.76 / +3.2%
tpch_q05/duckdb:parquet 123808807 / 124220963 / -0.3% 155110686 / 156529881 / -0.9% 0.80 / 0.79 / +0.6%
tpch_q06/duckdb:parquet 35667660 / 35381091 / +0.8% 56633810 / 59598034 / -5.0% 0.63 / 0.59 / +6.1%
tpch_q07/duckdb:parquet 117028145 / 116753165 / +0.2% 153127970 / 153761131 / -0.4% 0.76 / 0.76 / +0.6%
tpch_q08/duckdb:parquet 148562874 / 147621649 / +0.6% 190123923 / 192203967 / -1.1% 0.78 / 0.77 / +1.7%
tpch_q09/duckdb:parquet 236709474 / 236951307 / -0.1% 279844038 / 280167328 / -0.1% 0.85 / 0.85 / +0.0%
tpch_q10/duckdb:parquet 311812026 / 313709777 / -0.6% 339245671 / 338881273 / +0.1% 0.92 / 0.93 / -0.7%
tpch_q11/duckdb:parquet 43438517 / 43453207 / -0.0% 50478483 / 50598502 / -0.2% 0.86 / 0.86 / +0.2%
tpch_q12/duckdb:parquet 70611617 / 70614976 / -0.0% 88620324 / 92966048 / -4.7% 0.80 / 0.76 / +4.9%
tpch_q13/duckdb:parquet 292315308 / 292028125 / +0.1% 305878598 / 309657130 / -1.2% 0.96 / 0.94 / +1.3%
tpch_q14/duckdb:parquet 100650517 / 101195889 / -0.5% 135451588 / 139757131 / -3.1% 0.74 / 0.72 / +2.6%
tpch_q15/duckdb:parquet 57345552 / 56804838 / +1.0% 84898156 / 88570061 / -4.1% 0.68 / 0.64 / +5.3%
tpch_q16/duckdb:parquet 100485774 / 100534813 / -0.0% 107137562 / 107531818 / -0.4% 0.94 / 0.93 / +0.3%
tpch_q17/duckdb:parquet 81584259 / 83144052 / -1.9% 109436531 / 116042379 / -5.7% 0.75 / 0.72 / +4.0%
tpch_q18/duckdb:parquet 155491127 / 155056716 / +0.3% 177364756 / 170916811 / +3.8% 0.88 / 0.91 / -3.4%
tpch_q19/duckdb:parquet 97290682 / 98078605 / -0.8% 133456814 / 130833441 / +2.0% 0.73 / 0.75 / -2.8%
tpch_q20/duckdb:parquet 147238293 / 146774743 / +0.3% 181119614 / 187425875 / -3.4% 0.81 / 0.78 / +3.8%
tpch_q21/duckdb:parquet 250768874 / 254432944 / -1.4% 277786799 / 284546267 / -2.4% 0.90 / 0.89 / +1.0%
tpch_q22/duckdb:parquet 168162298 / 168348134 / -0.1% 179642299 / 180384896 / -0.4% 0.94 / 0.93 / +0.3%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.1%
Engines: DataFusion No clear signal (-3.8%, low confidence) · DuckDB No clear signal (-2.4%, low confidence)
Vortex (geomean): hot 0.966x ➖ · cold 0.976x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.957x ➖, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1241682 / 1245477 / -0.3% 20867351 / 23226462 / -10.2% 🟢 0.06 / 0.05 / +11.0%
clickbench_q01/datafusion:vortex-compact 7109930 / 7117244 / -0.1% 32415742 / 31320896 / +3.5% 0.22 / 0.23 / -3.5%
clickbench_q02/datafusion:vortex-compact 14132102 / 13531964 / +4.4% 37221764 / 45139435 / -17.5% 🟢 0.38 / 0.30 / +26.6%
clickbench_q03/datafusion:vortex-compact 13485228 / 13766044 / -2.0% 46139201 / 48681946 / -5.2% 0.29 / 0.28 / +3.4%
clickbench_q04/datafusion:vortex-compact 59706396 / 58190786 / +2.6% 98898407 / 102572682 / -3.6% 0.60 / 0.57 / +6.4%
clickbench_q05/datafusion:vortex-compact 83738338 / 85874918 / -2.5% 141548747 / 132717326 / +6.7% 0.59 / 0.65 / -8.6%
clickbench_q06/datafusion:vortex-compact 1229473 / 1231148 / -0.1% 21433866 / 21933586 / -2.3% 0.06 / 0.06 / +2.2%
clickbench_q07/datafusion:vortex-compact 12072111 / 11947310 / +1.0% 35863593 / 35341304 / +1.5% 0.34 / 0.34 / -0.4%
clickbench_q08/datafusion:vortex-compact 81415565 / 78709426 / +3.4% 126252165 / 120695703 / +4.6% 0.64 / 0.65 / -1.1%
clickbench_q09/datafusion:vortex-compact 179710580 / 174464742 / +3.0% 208978962 / 221698879 / -5.7% 0.86 / 0.79 / +9.3%
clickbench_q10/datafusion:vortex-compact 26972619 / 27288730 / -1.2% 62865597 / 62516865 / +0.6% 0.43 / 0.44 / -1.7%
clickbench_q11/datafusion:vortex-compact 28827276 / 29548630 / -2.4% 61746014 / 63488169 / -2.7% 0.47 / 0.47 / +0.3%
clickbench_q12/datafusion:vortex-compact 82538988 / 90178136 / -8.5% 134460038 / 136177900 / -1.3% 0.61 / 0.66 / -7.3%
clickbench_q13/datafusion:vortex-compact 126552886 / 129877784 / -2.6% 189318919 / 192109123 / -1.5% 0.67 / 0.68 / -1.1%
clickbench_q14/datafusion:vortex-compact 89588078 / 93329808 / -4.0% 139005216 / 147438242 / -5.7% 0.64 / 0.63 / +1.8%
clickbench_q15/datafusion:vortex-compact 64560676 / 64168311 / +0.6% 98331299 / 98302157 / +0.0% 0.66 / 0.65 / +0.6%
clickbench_q16/datafusion:vortex-compact 163360542 / 162759954 / +0.4% 215121599 / 216696135 / -0.7% 0.76 / 0.75 / +1.1%
clickbench_q17/datafusion:vortex-compact 163789004 / 162010909 / +1.1% 228517570 / 232227027 / -1.6% 0.72 / 0.70 / +2.7%
clickbench_q18/datafusion:vortex-compact 294413810 / 296085638 / -0.6% 384415894 / 379236013 / +1.4% 0.77 / 0.78 / -1.9%
clickbench_q19/datafusion:vortex-compact 10189026 / 10113182 / +0.7% 39876638 / 38599410 / +3.3% 0.26 / 0.26 / -2.5%
clickbench_q20/datafusion:vortex-compact 93626803 / 85121278 / +10.0% 226819810 / 225175853 / +0.7% 0.41 / 0.38 / +9.2%
clickbench_q21/datafusion:vortex-compact 108419254 / 116029214 / -6.6% 252254385 / 257921434 / -2.2% 0.43 / 0.45 / -4.5%
clickbench_q22/datafusion:vortex-compact 153392952 / 220775073 / -30.5% 🟢 319879921 / 361621266 / -11.5% 🟢 0.48 / 0.61 / -21.5%
clickbench_q23/datafusion:vortex-compact 596904936 / 619454966 / -3.6% 749148162 / 779542689 / -3.9% 0.80 / 0.79 / +0.3%
clickbench_q24/datafusion:vortex-compact 23260868 / 32206898 / -27.8% 🟢 66895814 / 80040223 / -16.4% 🟢 0.35 / 0.40 / -13.6%
clickbench_q25/datafusion:vortex-compact 31367270 / 37929688 / -17.3% 🟢 71651934 / 78586932 / -8.8% 0.44 / 0.48 / -9.3%
clickbench_q26/datafusion:vortex-compact 24000520 / 32996124 / -27.3% 🟢 65408175 / 73736297 / -11.3% 🟢 0.37 / 0.45 / -18.0%
clickbench_q27/datafusion:vortex-compact 116051334 / 168638568 / -31.2% 🟢 234627928 / 264190012 / -11.2% 🟢 0.49 / 0.64 / -22.5%
clickbench_q28/datafusion:vortex-compact 576631516 / 610120250 / -5.5% 638625644 / 668138594 / -4.4% 0.90 / 0.91 / -1.1%
clickbench_q29/datafusion:vortex-compact 26798540 / 25927718 / +3.4% 52222184 / 57711877 / -9.5% 0.51 / 0.45 / +14.2%
clickbench_q30/datafusion:vortex-compact 72571395 / 74196522 / -2.2% 117910993 / 121291488 / -2.8% 0.62 / 0.61 / +0.6%
clickbench_q31/datafusion:vortex-compact 79809217 / 79008488 / +1.0% 157524927 / 155646953 / +1.2% 0.51 / 0.51 / -0.2%
clickbench_q32/datafusion:vortex-compact 288142620 / 290111024 / -0.7% 384960082 / 388869860 / -1.0% 0.75 / 0.75 / +0.3%
clickbench_q33/datafusion:vortex-compact 335589090 / 339228850 / -1.1% 436400825 / 427879223 / +2.0% 0.77 / 0.79 / -3.0%
clickbench_q34/datafusion:vortex-compact 330006260 / 344065654 / -4.1% 430895592 / 432992786 / -0.5% 0.77 / 0.79 / -3.6%
clickbench_q35/datafusion:vortex-compact 59015348 / 59896698 / -1.5% 90769858 / 94102942 / -3.5% 0.65 / 0.64 / +2.1%
clickbench_q36/datafusion:vortex-compact 39789312 / 44096222 / -9.8% 68915098 / 72812767 / -5.4% 0.58 / 0.61 / -4.7%
clickbench_q37/datafusion:vortex-compact 22284124 / 22856349 / -2.5% 46549152 / 49320425 / -5.6% 0.48 / 0.46 / +3.3%
clickbench_q38/datafusion:vortex-compact 19073610 / 19283688 / -1.1% 45148594 / 47157784 / -4.3% 0.42 / 0.41 / +3.3%
clickbench_q39/datafusion:vortex-compact 84357338 / 84366338 / -0.0% 117318149 / 114202792 / +2.7% 0.72 / 0.74 / -2.7%
clickbench_q40/datafusion:vortex-compact 12180945 / 12406686 / -1.8% 36355231 / 37373436 / -2.7% 0.34 / 0.33 / +0.9%
clickbench_q41/datafusion:vortex-compact 11414617 / 11484171 / -0.6% 35502570 / 35585523 / -0.2% 0.32 / 0.32 / -0.4%
clickbench_q42/datafusion:vortex-compact 10812628 / 10518346 / +2.8% 35760266 / 37533091 / -4.7% 0.30 / 0.28 / +7.9%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1241898 / 1224136 / +1.5% 50757754 / 51128868 / -0.7% 0.02 / 0.02 / +2.2%
clickbench_q01/datafusion:parquet 16048657 / 15712850 / +2.1% 72711832 / 68185502 / +6.6% 0.22 / 0.23 / -4.2%
clickbench_q02/datafusion:parquet 18832080 / 18942766 / -0.6% 83654191 / 83298184 / +0.4% 0.23 / 0.23 / -1.0%
clickbench_q03/datafusion:parquet 16652778 / 17361388 / -4.1% 80535047 / 80587099 / -0.1% 0.21 / 0.22 / -4.0%
clickbench_q04/datafusion:parquet 63869985 / 63557084 / +0.5% 127243768 / 128527721 / -1.0% 0.50 / 0.49 / +1.5%
clickbench_q05/datafusion:parquet 87823645 / 89341952 / -1.7% 156774488 / 161499890 / -2.9% 0.56 / 0.55 / +1.3%
clickbench_q06/datafusion:parquet 1239232 / 1242974 / -0.3% 50687274 / 50836376 / -0.3% 0.02 / 0.02 / -0.0%
clickbench_q07/datafusion:parquet 16746704 / 16971310 / -1.3% 68562428 / 68985704 / -0.6% 0.24 / 0.25 / -0.7%
clickbench_q08/datafusion:parquet 86186970 / 85006131 / +1.4% 159331810 / 168644772 / -5.5% 0.54 / 0.50 / +7.3%
clickbench_q09/datafusion:parquet 185929706 / 188984232 / -1.6% 271911173 / 273567647 / -0.6% 0.68 / 0.69 / -1.0%
clickbench_q10/datafusion:parquet 35911304 / 36921950 / -2.7% 102146301 / 102568795 / -0.4% 0.35 / 0.36 / -2.3%
clickbench_q11/datafusion:parquet 42510984 / 42279092 / +0.5% 112236459 / 112694224 / -0.4% 0.38 / 0.38 / +1.0%
clickbench_q12/datafusion:parquet 94978819 / 96058502 / -1.1% 165252116 / 165054615 / +0.1% 0.57 / 0.58 / -1.2%
clickbench_q13/datafusion:parquet 147362542 / 149782503 / -1.6% 228355485 / 230335674 / -0.9% 0.65 / 0.65 / -0.8%
clickbench_q14/datafusion:parquet 100810055 / 101454956 / -0.6% 173747090 / 176574213 / -1.6% 0.58 / 0.57 / +1.0%
clickbench_q15/datafusion:parquet 71372278 / 72454257 / -1.5% 132533470 / 132786999 / -0.2% 0.54 / 0.55 / -1.3%
clickbench_q16/datafusion:parquet 155515011 / 155773974 / -0.2% 235901370 / 241723842 / -2.4% 0.66 / 0.64 / +2.3%
clickbench_q17/datafusion:parquet 156707203 / 156008920 / +0.4% 235925001 / 236871394 / -0.4% 0.66 / 0.66 / +0.9%
clickbench_q18/datafusion:parquet 308443605 / 311380915 / -0.9% 417120541 / 428990716 / -2.8% 0.74 / 0.73 / +1.9%
clickbench_q19/datafusion:parquet 19072309 / 19110656 / -0.2% 79547835 / 77709581 / +2.4% 0.24 / 0.25 / -2.5%
clickbench_q20/datafusion:parquet 177289734 / 181728894 / -2.4% 295722013 / 296669846 / -0.3% 0.60 / 0.61 / -2.1%
clickbench_q21/datafusion:parquet 174250429 / 173470796 / +0.4% 311551653 / 312816147 / -0.4% 0.56 / 0.55 / +0.9%
clickbench_q22/datafusion:parquet 260943494 / 262677480 / -0.7% 450656318 / 452696809 / -0.5% 0.58 / 0.58 / -0.2%
clickbench_q23/datafusion:parquet 1003228352 / 1003596600 / -0.0% 1193309211 / 1191722344 / +0.1% 0.84 / 0.84 / -0.2%
clickbench_q24/datafusion:parquet 30023874 / 30220771 / -0.7% 89461081 / 92145962 / -2.9% 0.34 / 0.33 / +2.3%
clickbench_q25/datafusion:parquet 36355346 / 36261200 / +0.3% 104421789 / 102634123 / +1.7% 0.35 / 0.35 / -1.5%
clickbench_q26/datafusion:parquet 30136739 / 30878933 / -2.4% 90318647 / 94470656 / -4.4% 0.33 / 0.33 / +2.1%
clickbench_q27/datafusion:parquet 193309756 / 192341656 / +0.5% 303908607 / 306612829 / -0.9% 0.64 / 0.63 / +1.4%
clickbench_q28/datafusion:parquet 613221352 / 621810476 / -1.4% 707254832 / 716541980 / -1.3% 0.87 / 0.87 / -0.1%
clickbench_q29/datafusion:parquet 28231824 / 28415514 / -0.6% 94888373 / 92685220 / +2.4% 0.30 / 0.31 / -3.0%
clickbench_q30/datafusion:parquet 89032718 / 90583681 / -1.7% 178391634 / 174033083 / +2.5% 0.50 / 0.52 / -4.1%
clickbench_q31/datafusion:parquet 102100452 / 104293878 / -2.1% 202806521 / 201134701 / +0.8% 0.50 / 0.52 / -2.9%
clickbench_q32/datafusion:parquet 306131014 / 306089478 / +0.0% 434709127 / 424915718 / +2.3% 0.70 / 0.72 / -2.2%
clickbench_q33/datafusion:parquet 376877574 / 377783599 / -0.2% 475291798 / 481246723 / -1.2% 0.79 / 0.79 / +1.0%
clickbench_q34/datafusion:parquet 376048844 / 377048659 / -0.3% 476592428 / 479639417 / -0.6% 0.79 / 0.79 / +0.4%
clickbench_q35/datafusion:parquet 65334702 / 63563220 / +2.8% 123347103 / 123325988 / +0.0% 0.53 / 0.52 / +2.8%
clickbench_q36/datafusion:parquet 73235460 / 73501280 / -0.4% 134535820 / 136532787 / -1.5% 0.54 / 0.54 / +1.1%
clickbench_q37/datafusion:parquet 35372046 / 35498334 / -0.4% 90144315 / 93131468 / -3.2% 0.39 / 0.38 / +2.9%
clickbench_q38/datafusion:parquet 47876180 / 47950282 / -0.2% 107681547 / 110172051 / -2.3% 0.44 / 0.44 / +2.2%
clickbench_q39/datafusion:parquet 143484101 / 143972169 / -0.3% 211061858 / 209821263 / +0.6% 0.68 / 0.69 / -0.9%
clickbench_q40/datafusion:parquet 19909992 / 20060919 / -0.8% 76868181 / 77890361 / -1.3% 0.26 / 0.26 / +0.6%
clickbench_q41/datafusion:parquet 18580434 / 18810111 / -1.2% 74628929 / 76909402 / -3.0% 0.25 / 0.24 / +1.8%
clickbench_q42/datafusion:parquet 18714262 / 18867186 / -0.8% 74670292 / 76225072 / -2.0% 0.25 / 0.25 / +1.3%
duckdb / vortex-compact / ns (0.975x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 2197058 / 2185250 / +0.5% 27052250 / 26471581 / +2.2% 0.08 / 0.08 / -1.6%
clickbench_q01/duckdb:vortex-compact 7709712 / 7603978 / +1.4% 31015318 / 31785883 / -2.4% 0.25 / 0.24 / +3.9%
clickbench_q02/duckdb:vortex-compact 14013149 / 14164897 / -1.1% 38765929 / 39413705 / -1.6% 0.36 / 0.36 / +0.6%
clickbench_q03/duckdb:vortex-compact 14972898 / 15345184 / -2.4% 46670307 / 46176779 / +1.1% 0.32 / 0.33 / -3.5%
clickbench_q04/duckdb:vortex-compact 59196156 / 59849357 / -1.1% 90801885 / 89618828 / +1.3% 0.65 / 0.67 / -2.4%
clickbench_q05/duckdb:vortex-compact 70061015 / 69600071 / +0.7% 100485696 / 97886043 / +2.7% 0.70 / 0.71 / -1.9%
clickbench_q06/duckdb:vortex-compact 2612498 / 2551674 / +2.4% 32017320 / 30176601 / +6.1% 0.08 / 0.08 / -3.5%
clickbench_q07/duckdb:vortex-compact 9811707 / 9640508 / +1.8% 31539024 / 30992931 / +1.8% 0.31 / 0.31 / +0.0%
clickbench_q08/duckdb:vortex-compact 73540232 / 75089655 / -2.1% 106882571 / 106293069 / +0.6% 0.69 / 0.71 / -2.6%
clickbench_q09/duckdb:vortex-compact 102695014 / 103942614 / -1.2% 139604711 / 138294635 / +0.9% 0.74 / 0.75 / -2.1%
clickbench_q10/duckdb:vortex-compact 33174368 / 33192158 / -0.1% 71592809 / 72758989 / -1.6% 0.46 / 0.46 / +1.6%
clickbench_q11/duckdb:vortex-compact 37839612 / 37252496 / +1.6% 76245679 / 74005837 / +3.0% 0.50 / 0.50 / -1.4%
clickbench_q12/duckdb:vortex-compact 77234517 / 83099776 / -7.1% 104806656 / 118301025 / -11.4% 🟢 0.74 / 0.70 / +4.9%
clickbench_q13/duckdb:vortex-compact 138395936 / 150745695 / -8.2% 177295608 / 189686141 / -6.5% 0.78 / 0.79 / -1.8%
clickbench_q14/duckdb:vortex-compact 81705772 / 91471759 / -10.7% 🟢 111314445 / 119628397 / -6.9% 0.73 / 0.76 / -4.0%
clickbench_q15/duckdb:vortex-compact 78280696 / 79071405 / -1.0% 108325147 / 110886393 / -2.3% 0.72 / 0.71 / +1.3%
clickbench_q16/duckdb:vortex-compact 148712986 / 145205528 / +2.4% 177003499 / 179803359 / -1.6% 0.84 / 0.81 / +4.0%
clickbench_q17/duckdb:vortex-compact 150463775 / 151940962 / -1.0% 179443047 / 180222194 / -0.4% 0.84 / 0.84 / -0.5%
clickbench_q18/duckdb:vortex-compact 262143560 / 266262739 / -1.5% 302284950 / 304686662 / -0.8% 0.87 / 0.87 / -0.8%
clickbench_q19/duckdb:vortex-compact 10498971 / 10419848 / +0.8% 36807987 / 36278396 / +1.5% 0.29 / 0.29 / -0.7%
clickbench_q20/duckdb:vortex-compact 83756129 / 81120929 / +3.2% 154606991 / 149441313 / +3.5% 0.54 / 0.54 / -0.2%
clickbench_q21/duckdb:vortex-compact 113255864 / 120981042 / -6.4% 191094847 / 196184139 / -2.6% 0.59 / 0.62 / -3.9%
clickbench_q22/duckdb:vortex-compact 244258482 / 298912889 / -18.3% 🟢 365194248 / 407568115 / -10.4% 🟢 0.67 / 0.73 / -8.8%
clickbench_q23/duckdb:vortex-compact 52867050 / 50663849 / +4.3% 85262465 / 84996359 / +0.3% 0.62 / 0.60 / +4.0%
clickbench_q24/duckdb:vortex-compact 17614740 / 17868364 / -1.4% 35830989 / 42515773 / -15.7% 🟢 0.49 / 0.42 / +17.0%
clickbench_q25/duckdb:vortex-compact 31015815 / 42541504 / -27.1% 🟢 63100332 / 75650066 / -16.6% 🟢 0.49 / 0.56 / -12.6%
clickbench_q26/duckdb:vortex-compact 13808157 / 15726210 / -12.2% 🟢 38425610 / 40777432 / -5.8% 0.36 / 0.39 / -6.8%
clickbench_q27/duckdb:vortex-compact 140483228 / 134772918 / +4.2% 213080762 / 198352232 / +7.4% 0.66 / 0.68 / -3.0%
clickbench_q28/duckdb:vortex-compact 538529358 / 571186775 / -5.7% 578997176 / 622054879 / -6.9% 0.93 / 0.92 / +1.3%
clickbench_q29/duckdb:vortex-compact 20762528 / 20681936 / +0.4% 49051858 / 46675027 / +5.1% 0.42 / 0.44 / -4.5%
clickbench_q30/duckdb:vortex-compact 82825610 / 81859486 / +1.2% 126074795 / 124910222 / +0.9% 0.66 / 0.66 / +0.2%
clickbench_q31/duckdb:vortex-compact 131127333 / 131778967 / -0.5% 206542369 / 189209360 / +9.2% 0.63 / 0.70 / -8.8%
clickbench_q32/duckdb:vortex-compact 359577783 / 363748624 / -1.1% 398388587 / 395868811 / +0.6% 0.90 / 0.92 / -1.8%
clickbench_q33/duckdb:vortex-compact 346110456 / 343427724 / +0.8% 391103352 / 383973365 / +1.9% 0.88 / 0.89 / -1.1%
clickbench_q34/duckdb:vortex-compact 362826198 / 358050266 / +1.3% 411908301 / 406843962 / +1.2% 0.88 / 0.88 / +0.1%
clickbench_q35/duckdb:vortex-compact 63391068 / 61629000 / +2.9% 96472835 / 93463806 / +3.2% 0.66 / 0.66 / -0.3%
clickbench_q36/duckdb:vortex-compact 11907695 / 12891656 / -7.6% 32435032 / 35197010 / -7.8% 0.37 / 0.37 / +0.2%
clickbench_q37/duckdb:vortex-compact 9602364 / 10506379 / -8.6% 30990177 / 30054078 / +3.1% 0.31 / 0.35 / -11.4%
clickbench_q38/duckdb:vortex-compact 9595784 / 9536902 / +0.6% 29354703 / 30162887 / -2.7% 0.33 / 0.32 / +3.4%
clickbench_q39/duckdb:vortex-compact 19890209 / 19873972 / +0.1% 39150680 / 41634659 / -6.0% 0.51 / 0.48 / +6.4%
clickbench_q40/duckdb:vortex-compact 8273560 / 8211261 / +0.8% 27540348 / 27375714 / +0.6% 0.30 / 0.30 / +0.2%
clickbench_q41/duckdb:vortex-compact 8819910 / 8936319 / -1.3% 28742304 / 29072282 / -1.1% 0.31 / 0.31 / -0.2%
clickbench_q42/duckdb:vortex-compact 7624745 / 7656424 / -0.4% 28337101 / 29514652 / -4.0% 0.27 / 0.26 / +3.7%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9720583 / 9129318 / +6.5% 14499102 / 14159030 / +2.4% 0.67 / 0.64 / +4.0%
clickbench_q01/duckdb:parquet 14749928 / 15125244 / -2.5% 21517196 / 20259313 / +6.2% 0.69 / 0.75 / -8.2%
clickbench_q02/duckdb:parquet 22972673 / 23320520 / -1.5% 32212218 / 31916374 / +0.9% 0.71 / 0.73 / -2.4%
clickbench_q03/duckdb:parquet 22425068 / 23233908 / -3.5% 34816120 / 35016050 / -0.6% 0.64 / 0.66 / -2.9%
clickbench_q04/duckdb:parquet 61717286 / 62267798 / -0.9% 72439003 / 73696819 / -1.7% 0.85 / 0.84 / +0.8%
clickbench_q05/duckdb:parquet 83085302 / 82635100 / +0.5% 96205801 / 95512019 / +0.7% 0.86 / 0.87 / -0.2%
clickbench_q06/duckdb:parquet 20877334 / 20076128 / +4.0% 32286366 / 28389281 / +13.7% 🔴 0.65 / 0.71 / -8.6%
clickbench_q07/duckdb:parquet 17384448 / 17682087 / -1.7% 23550396 / 25119487 / -6.2% 0.74 / 0.70 / +4.9%
clickbench_q08/duckdb:parquet 74762602 / 74898321 / -0.2% 88621682 / 89726067 / -1.2% 0.84 / 0.83 / +1.1%
clickbench_q09/duckdb:parquet 101346872 / 104325660 / -2.9% 116909310 / 120646528 / -3.1% 0.87 / 0.86 / +0.3%
clickbench_q10/duckdb:parquet 41664946 / 42126392 / -1.1% 53842175 / 57563624 / -6.5% 0.77 / 0.73 / +5.7%
clickbench_q11/duckdb:parquet 46025272 / 46938701 / -1.9% 62126895 / 61202585 / +1.5% 0.74 / 0.77 / -3.4%
clickbench_q12/duckdb:parquet 92544277 / 93887979 / -1.4% 104942457 / 108298425 / -3.1% 0.88 / 0.87 / +1.7%
clickbench_q13/duckdb:parquet 150602704 / 151469124 / -0.6% 166195970 / 168361815 / -1.3% 0.91 / 0.90 / +0.7%
clickbench_q14/duckdb:parquet 100509319 / 101254117 / -0.7% 115603570 / 118687199 / -2.6% 0.87 / 0.85 / +1.9%
clickbench_q15/duckdb:parquet 86301834 / 86748712 / -0.5% 104293662 / 98560763 / +5.8% 0.83 / 0.88 / -6.0%
clickbench_q16/duckdb:parquet 166256460 / 170707998 / -2.6% 180938556 / 177029538 / +2.2% 0.92 / 0.96 / -4.7%
clickbench_q17/duckdb:parquet 165457828 / 169668887 / -2.5% 183370510 / 197977988 / -7.4% 0.90 / 0.86 / +5.3%
clickbench_q18/duckdb:parquet 302772028 / 292642620 / +3.5% 316666463 / 326079575 / -2.9% 0.96 / 0.90 / +6.5%
clickbench_q19/duckdb:parquet 19925572 / 19700643 / +1.1% 27120158 / 27773014 / -2.4% 0.73 / 0.71 / +3.6%
clickbench_q20/duckdb:parquet 183135861 / 190978920 / -4.1% 228582891 / 232055023 / -1.5% 0.80 / 0.82 / -2.7%
clickbench_q21/duckdb:parquet 218565128 / 228062810 / -4.2% 271784708 / 266936760 / +1.8% 0.80 / 0.85 / -5.9%
clickbench_q22/duckdb:parquet 317973639 / 302797804 / +5.0% 363310900 / 355978566 / +2.1% 0.88 / 0.85 / +2.9%
clickbench_q23/duckdb:parquet 175178966 / 167862938 / +4.4% 230936601 / 237729479 / -2.9% 0.76 / 0.71 / +7.4%
clickbench_q24/duckdb:parquet 31305370 / 29541872 / +6.0% 38498024 / 43381087 / -11.3% 🟢 0.81 / 0.68 / +19.4%
clickbench_q25/duckdb:parquet 42682942 / 41991583 / +1.6% 60327904 / 56599903 / +6.6% 0.71 / 0.74 / -4.6%
clickbench_q26/duckdb:parquet 30222986 / 30369279 / -0.5% 43592649 / 46209417 / -5.7% 0.69 / 0.66 / +5.5%
clickbench_q27/duckdb:parquet 188610228 / 190065975 / -0.8% 225073290 / 230120626 / -2.2% 0.84 / 0.83 / +1.5%
clickbench_q28/duckdb:parquet 974542086 / 949899074 / +2.6% 940496614 / 948990336 / -0.9% 1.04 / 1.00 / +3.5%
clickbench_q29/duckdb:parquet 23983387 / 23737236 / +1.0% 30101342 / 31245091 / -3.7% 0.80 / 0.76 / +4.9%
clickbench_q30/duckdb:parquet 105404097 / 106011664 / -0.6% 127868816 / 127444228 / +0.3% 0.82 / 0.83 / -0.9%
clickbench_q31/duckdb:parquet 147646863 / 146634672 / +0.7% 173286418 / 172976489 / +0.2% 0.85 / 0.85 / +0.5%
clickbench_q32/duckdb:parquet 381093212 / 390260086 / -2.3% 413810965 / 411244685 / +0.6% 0.92 / 0.95 / -3.0%
clickbench_q33/duckdb:parquet 491895504 / 493471552 / -0.3% 444062881 / 461210119 / -3.7% 1.11 / 1.07 / +3.5%
clickbench_q34/duckdb:parquet 469664490 / 488116724 / -3.8% 457183193 / 469439609 / -2.6% 1.03 / 1.04 / -1.2%
clickbench_q35/duckdb:parquet 61352620 / 61500952 / -0.2% 75082430 / 73216515 / +2.5% 0.82 / 0.84 / -2.7%
clickbench_q36/duckdb:parquet 29899768 / 30105450 / -0.7% 35727666 / 35436995 / +0.8% 0.84 / 0.85 / -1.5%
clickbench_q37/duckdb:parquet 23230064 / 23151636 / +0.3% 29547623 / 29761032 / -0.7% 0.79 / 0.78 / +1.1%
clickbench_q38/duckdb:parquet 23361300 / 23786144 / -1.8% 29514722 / 30304768 / -2.6% 0.79 / 0.78 / +0.8%
clickbench_q39/duckdb:parquet 52372954 / 53006585 / -1.2% 60278706 / 59664972 / +1.0% 0.87 / 0.89 / -2.2%
clickbench_q40/duckdb:parquet 15571906 / 14810280 / +5.1% 20858877 / 20397616 / +2.3% 0.75 / 0.73 / +2.8%
clickbench_q41/duckdb:parquet 15672602 / 15582676 / +0.6% 20536229 / 20201301 / +1.7% 0.76 / 0.77 / -1.1%
clickbench_q42/duckdb:parquet 14127300 / 14224534 / -0.7% 20785464 / 20270735 / +2.5% 0.68 / 0.70 / -3.1%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 20913097 / 21028856 / -0.6% 39678392 / 38646062 / +2.7% 0.53 / 0.54 / -3.1%
tpcds_q02/datafusion:vortex-compact 44289915 / 43627026 / +1.5% 65505340 / 66003955 / -0.8% 0.68 / 0.66 / +2.3%
tpcds_q03/datafusion:vortex-compact 11704617 / 11405109 / +2.6% 30958180 / 31318652 / -1.2% 0.38 / 0.36 / +3.8%
tpcds_q04/datafusion:vortex-compact 92648476 / 91233562 / +1.6% 126092997 / 127398326 / -1.0% 0.73 / 0.72 / +2.6%
tpcds_q05/datafusion:vortex-compact 56705406 / 56517573 / +0.3% 79453173 / 80195622 / -0.9% 0.71 / 0.70 / +1.3%
tpcds_q06/datafusion:vortex-compact 23429700 / 23504708 / -0.3% 45021605 / 46743338 / -3.7% 0.52 / 0.50 / +3.5%
tpcds_q07/datafusion:vortex-compact 32175575 / 31185869 / +3.2% 52203270 / 56619613 / -7.8% 0.62 / 0.55 / +11.9%
tpcds_q08/datafusion:vortex-compact 27025142 / 27119422 / -0.3% 48583784 / 49813934 / -2.5% 0.56 / 0.54 / +2.2%
tpcds_q09/datafusion:vortex-compact 22259062 / 22607062 / -1.5% 41574277 / 41670044 / -0.2% 0.54 / 0.54 / -1.3%
tpcds_q10/datafusion:vortex-compact 29671240 / 30440718 / -2.5% 51947536 / 52611322 / -1.3% 0.57 / 0.58 / -1.3%
tpcds_q11/datafusion:vortex-compact 55362858 / 54582258 / +1.4% 82025614 / 82371336 / -0.4% 0.67 / 0.66 / +1.9%
tpcds_q12/datafusion:vortex-compact 18529456 / 18470608 / +0.3% 37097521 / 37432237 / -0.9% 0.50 / 0.49 / +1.2%
tpcds_q13/datafusion:vortex-compact 51869246 / 47240990 / +9.8% 68867901 / 67376654 / +2.2% 0.75 / 0.70 / +7.4%
tpcds_q14/datafusion:vortex-compact 631371036 / 630113306 / +0.2% 692811525 / 687489290 / +0.8% 0.91 / 0.92 / -0.6%
tpcds_q15/datafusion:vortex-compact 13858872 / 13889140 / -0.2% 34286763 / 35265303 / -2.8% 0.40 / 0.39 / +2.6%
tpcds_q16/datafusion:vortex-compact 19287336 / 19080778 / +1.1% 41091121 / 41133204 / -0.1% 0.47 / 0.46 / +1.2%
tpcds_q17/datafusion:vortex-compact 57063304 / 57653142 / -1.0% 79775354 / 71920624 / +10.9% 🔴 0.72 / 0.80 / -10.8%
tpcds_q18/datafusion:vortex-compact 60772212 / 60836306 / -0.1% 81561541 / 82128398 / -0.7% 0.75 / 0.74 / +0.6%
tpcds_q19/datafusion:vortex-compact 18857332 / 19028160 / -0.9% 39635459 / 42283586 / -6.3% 0.48 / 0.45 / +5.7%
tpcds_q20/datafusion:vortex-compact 19866679 / 20464973 / -2.9% 40518350 / 40011774 / +1.3% 0.49 / 0.51 / -4.1%
tpcds_q21/datafusion:vortex-compact 17448424 / 17713974 / -1.5% 41203788 / 42612529 / -3.3% 0.42 / 0.42 / +1.9%
tpcds_q22/datafusion:vortex-compact 49584066 / 50249068 / -1.3% 72142004 / 75378570 / -4.3% 0.69 / 0.67 / +3.1%
tpcds_q23/datafusion:vortex-compact 72623018 / 72831325 / -0.3% 95976653 / 98058697 / -2.1% 0.76 / 0.74 / +1.9%
tpcds_q24/datafusion:vortex-compact 71633735 / 71178932 / +0.6% 92020878 / 94585315 / -2.7% 0.78 / 0.75 / +3.4%
tpcds_q25/datafusion:vortex-compact 51383873 / 51261774 / +0.2% 81389393 / 79429979 / +2.5% 0.63 / 0.65 / -2.2%
tpcds_q26/datafusion:vortex-compact 27887885 / 27747038 / +0.5% 47805102 / 47433758 / +0.8% 0.58 / 0.58 / -0.3%
tpcds_q27/datafusion:vortex-compact 58186680 / 59767950 / -2.6% 81582529 / 77405153 / +5.4% 0.71 / 0.77 / -7.6%
tpcds_q28/datafusion:vortex-compact 26559634 / 26486208 / +0.3% 45414154 / 46346383 / -2.0% 0.58 / 0.57 / +2.3%
tpcds_q29/datafusion:vortex-compact 55568658 / 55539340 / +0.1% 77678467 / 82114263 / -5.4% 0.72 / 0.68 / +5.8%
tpcds_q30/datafusion:vortex-compact 27749848 / 28016194 / -1.0% 44859666 / 46134549 / -2.8% 0.62 / 0.61 / +1.9%
tpcds_q31/datafusion:vortex-compact 60769602 / 60838342 / -0.1% 87128289 / 87312508 / -0.2% 0.70 / 0.70 / +0.1%
tpcds_q32/datafusion:vortex-compact 13540248 / 13627612 / -0.6% 33532261 / 33959251 / -1.3% 0.40 / 0.40 / +0.6%
tpcds_q33/datafusion:vortex-compact 27580929 / 28385619 / -2.8% 51159910 / 51764944 / -1.2% 0.54 / 0.55 / -1.7%
tpcds_q34/datafusion:vortex-compact 18223308 / 18630627 / -2.2% 37401864 / 37280971 / +0.3% 0.49 / 0.50 / -2.5%
tpcds_q35/datafusion:vortex-compact 33137002 / 33348068 / -0.6% 55842159 / 58851482 / -5.1% 0.59 / 0.57 / +4.7%
tpcds_q36/datafusion:vortex-compact 48053234 / 48364976 / -0.6% 70821061 / 72452826 / -2.3% 0.68 / 0.67 / +1.6%
tpcds_q37/datafusion:vortex-compact 14874820 / 14420868 / +3.1% 35984463 / 36398809 / -1.1% 0.41 / 0.40 / +4.3%
tpcds_q38/datafusion:vortex-compact 25945408 / 26317884 / -1.4% 47415191 / 49476476 / -4.2% 0.55 / 0.53 / +2.9%
tpcds_q39/datafusion:vortex-compact 65512531 / 65997238 / -0.7% 85525135 / 91056619 / -6.1% 0.77 / 0.72 / +5.7%
tpcds_q40/datafusion:vortex-compact 24234770 / 24050317 / +0.8% 44910859 / 49793460 / -9.8% 0.54 / 0.48 / +11.7%
tpcds_q41/datafusion:vortex-compact 20780574 / 21115099 / -1.6% 35217878 / 35667123 / -1.3% 0.59 / 0.59 / -0.3%
tpcds_q42/datafusion:vortex-compact 11445398 / 11024310 / +3.8% 29524810 / 32566914 / -9.3% 0.39 / 0.34 / +14.5%
tpcds_q43/datafusion:vortex-compact 12941938 / 13008764 / -0.5% 31690243 / 33016573 / -4.0% 0.41 / 0.39 / +3.7%
tpcds_q44/datafusion:vortex-compact 28546884 / 28338416 / +0.7% 49588807 / 48943677 / +1.3% 0.58 / 0.58 / -0.6%
tpcds_q45/datafusion:vortex-compact 17609254 / 17720718 / -0.6% 37522060 / 37260981 / +0.7% 0.47 / 0.48 / -1.3%
tpcds_q46/datafusion:vortex-compact 25182404 / 24039548 / +4.8% 47900627 / 47242987 / +1.4% 0.53 / 0.51 / +3.3%
tpcds_q47/datafusion:vortex-compact 78415456 / 79341734 / -1.2% 110936327 / 110829439 / +0.1% 0.71 / 0.72 / -1.3%
tpcds_q48/datafusion:vortex-compact 43350849 / 43828592 / -1.1% 61986425 / 63119666 / -1.8% 0.70 / 0.69 / +0.7%
tpcds_q49/datafusion:vortex-compact 59124394 / 58783296 / +0.6% 83828727 / 83542413 / +0.3% 0.71 / 0.70 / +0.2%
tpcds_q50/datafusion:vortex-compact 30852800 / 30605093 / +0.8% 50755145 / 52559992 / -3.4% 0.61 / 0.58 / +4.4%
tpcds_q51/datafusion:vortex-compact 66523174 / 65707646 / +1.2% 88704974 / 87277134 / +1.6% 0.75 / 0.75 / -0.4%
tpcds_q52/datafusion:vortex-compact 11540986 / 11549640 / -0.1% 30509793 / 30815338 / -1.0% 0.38 / 0.37 / +0.9%
tpcds_q53/datafusion:vortex-compact 20542866 / 20569691 / -0.1% 43488530 / 42449479 / +2.4% 0.47 / 0.48 / -2.5%
tpcds_q54/datafusion:vortex-compact 33693280 / 33212670 / +1.4% 58205844 / 59918128 / -2.9% 0.58 / 0.55 / +4.4%
tpcds_q55/datafusion:vortex-compact 10974146 / 10958401 / +0.1% 30604940 / 30255325 / +1.2% 0.36 / 0.36 / -1.0%
tpcds_q56/datafusion:vortex-compact 26150206 / 26179274 / -0.1% 48723363 / 49526820 / -1.6% 0.54 / 0.53 / +1.5%
tpcds_q57/datafusion:vortex-compact 65614820 / 65643568 / -0.0% 94129227 / 91871514 / +2.5% 0.70 / 0.71 / -2.4%
tpcds_q58/datafusion:vortex-compact 41682476 / 41846868 / -0.4% 70497118 / 68240430 / +3.3% 0.59 / 0.61 / -3.6%
tpcds_q59/datafusion:vortex-compact 32748972 / 31455992 / +4.1% 56728908 / 57651990 / -1.6% 0.58 / 0.55 / +5.8%
tpcds_q60/datafusion:vortex-compact 25878348 / 25723848 / +0.6% 48042637 / 49083881 / -2.1% 0.54 / 0.52 / +2.8%
tpcds_q61/datafusion:vortex-compact 22932092 / 23035168 / -0.4% 43390363 / 44324672 / -2.1% 0.53 / 0.52 / +1.7%
tpcds_q62/datafusion:vortex-compact 16383941 / 16373966 / +0.1% 34221106 / 34709874 / -1.4% 0.48 / 0.47 / +1.5%
tpcds_q63/datafusion:vortex-compact 20523516 / 20589996 / -0.3% 42142949 / 42793833 / -1.5% 0.49 / 0.48 / +1.2%
tpcds_q64/datafusion:vortex-compact 300812636 / 300079126 / +0.2% 334232042 / 336278369 / -0.6% 0.90 / 0.89 / +0.9%
tpcds_q65/datafusion:vortex-compact 75991826 / 75185132 / +1.1% 99858867 / 98079916 / +1.8% 0.76 / 0.77 / -0.7%
tpcds_q66/datafusion:vortex-compact 50422252 / 50291744 / +0.3% 73898134 / 74421350 / -0.7% 0.68 / 0.68 / +1.0%
tpcds_q67/datafusion:vortex-compact 52194912 / 52267141 / -0.1% 82756728 / 84904381 / -2.5% 0.63 / 0.62 / +2.5%
tpcds_q68/datafusion:vortex-compact 24720972 / 24823203 / -0.4% 47069858 / 48849322 / -3.6% 0.53 / 0.51 / +3.4%
tpcds_q69/datafusion:vortex-compact 29679797 / 28617808 / +3.7% 50189183 / 52731006 / -4.8% 0.59 / 0.54 / +9.0%
tpcds_q70/datafusion:vortex-compact 72024070 / 72582880 / -0.8% 92148480 / 93034539 / -1.0% 0.78 / 0.78 / +0.2%
tpcds_q71/datafusion:vortex-compact 18306678 / 19169013 / -4.5% 41381942 / 41714414 / -0.8% 0.44 / 0.46 / -3.7%
tpcds_q72/datafusion:vortex-compact 362045833 / 350805997 / +3.2% 394174261 / 380650300 / +3.6% 0.92 / 0.92 / -0.3%
tpcds_q73/datafusion:vortex-compact 17913528 / 17528685 / +2.2% 39008171 / 38098350 / +2.4% 0.46 / 0.46 / -0.2%
tpcds_q74/datafusion:vortex-compact 40616033 / 42917735 / -5.4% 67592332 / 67625384 / -0.0% 0.60 / 0.63 / -5.3%
tpcds_q75/datafusion:vortex-compact 139526468 / 139567638 / -0.0% 164213757 / 166723097 / -1.5% 0.85 / 0.84 / +1.5%
tpcds_q76/datafusion:vortex-compact 29502809 / 29882984 / -1.3% 49428541 / 51355128 / -3.8% 0.60 / 0.58 / +2.6%
tpcds_q77/datafusion:vortex-compact 45053807 / 45081442 / -0.1% 67594272 / 66415186 / +1.8% 0.67 / 0.68 / -1.8%
tpcds_q78/datafusion:vortex-compact 65495399 / 65291960 / +0.3% 90589850 / 93383836 / -3.0% 0.72 / 0.70 / +3.4%
tpcds_q79/datafusion:vortex-compact 21111650 / 21084339 / +0.1% 39767704 / 40809744 / -2.6% 0.53 / 0.52 / +2.8%
tpcds_q80/datafusion:vortex-compact 73846853 / 74217240 / -0.5% 102989240 / 105658354 / -2.5% 0.72 / 0.70 / +2.1%
tpcds_q81/datafusion:vortex-compact 27107068 / 26335613 / +2.9% 44711338 / 44574558 / +0.3% 0.61 / 0.59 / +2.6%
tpcds_q82/datafusion:vortex-compact 13307932 / 13963202 / -4.7% 37375106 / 37624239 / -0.7% 0.36 / 0.37 / -4.1%
tpcds_q83/datafusion:vortex-compact 33364016 / 32887616 / +1.4% 54279378 / 52082782 / +4.2% 0.61 / 0.63 / -2.7%
tpcds_q84/datafusion:vortex-compact 11020748 / 10772568 / +2.3% 26160115 / 26488368 / -1.2% 0.42 / 0.41 / +3.6%
tpcds_q85/datafusion:vortex-compact 94924118 / 94765216 / +0.2% 118876531 / 120806188 / -1.6% 0.80 / 0.78 / +1.8%
tpcds_q86/datafusion:vortex-compact 15844468 / 15518876 / +2.1% 33330261 / 34338298 / -2.9% 0.48 / 0.45 / +5.2%
tpcds_q87/datafusion:vortex-compact 26549175 / 26137760 / +1.6% 49097687 / 48904060 / +0.4% 0.54 / 0.53 / +1.2%
tpcds_q88/datafusion:vortex-compact 35851013 / 35806066 / +0.1% 61102170 / 54982134 / +11.1% 🔴 0.59 / 0.65 / -9.9%
tpcds_q89/datafusion:vortex-compact 22613766 / 22843072 / -1.0% 43916262 / 45900531 / -4.3% 0.51 / 0.50 / +3.5%
tpcds_q90/datafusion:vortex-compact 10324212 / 10537978 / -2.0% 25311926 / 25639285 / -1.3% 0.41 / 0.41 / -0.8%
tpcds_q91/datafusion:vortex-compact 23837084 / 24390728 / -2.3% 43403424 / 43584605 / -0.4% 0.55 / 0.56 / -1.9%
tpcds_q92/datafusion:vortex-compact 13781624 / 13669896 / +0.8% 30069822 / 30013686 / +0.2% 0.46 / 0.46 / +0.6%
tpcds_q93/datafusion:vortex-compact 20649188 / 20750792 / -0.5% 39161496 / 40218185 / -2.6% 0.53 / 0.52 / +2.2%
tpcds_q94/datafusion:vortex-compact 18829222 / 19071961 / -1.3% 38097141 / 37841723 / +0.7% 0.49 / 0.50 / -1.9%
tpcds_q95/datafusion:vortex-compact 42937376 / 43363758 / -1.0% 61608992 / 63475303 / -2.9% 0.70 / 0.68 / +2.0%
tpcds_q96/datafusion:vortex-compact 8462123 / 8655629 / -2.2% 26081469 / 26694460 / -2.3% 0.32 / 0.32 / +0.1%
tpcds_q97/datafusion:vortex-compact 17074344 / 17365808 / -1.7% 37238308 / 38647883 / -3.6% 0.46 / 0.45 / +2.0%
tpcds_q98/datafusion:vortex-compact 20338548 / 20564602 / -1.1% 41069513 / 42102059 / -2.5% 0.50 / 0.49 / +1.4%
tpcds_q99/datafusion:vortex-compact 16306832 / 16459006 / -0.9% 34494300 / 35431532 / -2.6% 0.47 / 0.46 / +1.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43584928 / 42553468 / +2.4% 61093168 / 61508272 / -0.7% 0.71 / 0.69 / +3.1%
tpcds_q02/datafusion:parquet 54753758 / 54436116 / +0.6% 70149724 / 71234695 / -1.5% 0.78 / 0.76 / +2.1%
tpcds_q03/datafusion:parquet 19016666 / 18724904 / +1.6% 30506328 / 30839274 / -1.1% 0.62 / 0.61 / +2.7%
tpcds_q04/datafusion:parquet 180106645 / 177541472 / +1.4% 208520609 / 209353199 / -0.4% 0.86 / 0.85 / +1.8%
tpcds_q05/datafusion:parquet 67918794 / 67844002 / +0.1% 90657512 / 86674810 / +4.6% 0.75 / 0.78 / -4.3%
tpcds_q06/datafusion:parquet 33627544 / 33910348 / -0.8% 46776459 / 47093178 / -0.7% 0.72 / 0.72 / -0.2%
tpcds_q07/datafusion:parquet 46612560 / 46911540 / -0.6% 63535136 / 66833722 / -4.9% 0.73 / 0.70 / +4.5%
tpcds_q08/datafusion:parquet 31428808 / 30980170 / +1.4% 48055142 / 48698102 / -1.3% 0.65 / 0.64 / +2.8%
tpcds_q09/datafusion:parquet 31332793 / 31410922 / -0.2% 41664269 / 43117808 / -3.4% 0.75 / 0.73 / +3.2%
tpcds_q10/datafusion:parquet 40995496 / 43920208 / -6.7% 56933481 / 58235007 / -2.2% 0.72 / 0.75 / -4.5%
tpcds_q11/datafusion:parquet 96330414 / 95981002 / +0.4% 118359577 / 114955676 / +3.0% 0.81 / 0.83 / -2.5%
tpcds_q12/datafusion:parquet 23776000 / 23723244 / +0.2% 34562191 / 37401200 / -7.6% 0.69 / 0.63 / +8.5%
tpcds_q13/datafusion:parquet 46538400 / 46622766 / -0.2% 65315440 / 67855042 / -3.7% 0.71 / 0.69 / +3.7%
tpcds_q14/datafusion:parquet 529765746 / 535582938 / -1.1% 582660777 / 581817002 / +0.1% 0.91 / 0.92 / -1.2%
tpcds_q15/datafusion:parquet 23890335 / 23786430 / +0.4% 37639808 / 38645340 / -2.6% 0.63 / 0.62 / +3.1%
tpcds_q16/datafusion:parquet 36718542 / 36352896 / +1.0% 51470546 / 52028387 / -1.1% 0.71 / 0.70 / +2.1%
tpcds_q17/datafusion:parquet 73656350 / 74200498 / -0.7% 96565564 / 101401992 / -4.8% 0.76 / 0.73 / +4.2%
tpcds_q18/datafusion:parquet 68569888 / 65971439 / +3.9% 88435497 / 88054194 / +0.4% 0.78 / 0.75 / +3.5%
tpcds_q19/datafusion:parquet 29650568 / 29270140 / +1.3% 42005351 / 43607438 / -3.7% 0.71 / 0.67 / +5.2%
tpcds_q20/datafusion:parquet 25228714 / 24820696 / +1.6% 36476472 / 38304536 / -4.8% 0.69 / 0.65 / +6.7%
tpcds_q21/datafusion:parquet 19909006 / 20002098 / -0.5% 30448160 / 33919886 / -10.2% 🟢 0.65 / 0.59 / +10.9%
tpcds_q22/datafusion:parquet 76983188 / 77320398 / -0.4% 89121378 / 89292857 / -0.2% 0.86 / 0.87 / -0.2%
tpcds_q23/datafusion:parquet 91798348 / 92525832 / -0.8% 114441608 / 114195875 / +0.2% 0.80 / 0.81 / -1.0%
tpcds_q24/datafusion:parquet 90453956 / 89311501 / +1.3% 112278667 / 115471003 / -2.8% 0.81 / 0.77 / +4.2%
tpcds_q25/datafusion:parquet 81310156 / 81505657 / -0.2% 98529544 / 101648520 / -3.1% 0.83 / 0.80 / +2.9%
tpcds_q26/datafusion:parquet 43797752 / 43423748 / +0.9% 59010695 / 61538470 / -4.1% 0.74 / 0.71 / +5.2%
tpcds_q27/datafusion:parquet 75210382 / 79620338 / -5.5% 98315379 / 97948902 / +0.4% 0.76 / 0.81 / -5.9%
tpcds_q28/datafusion:parquet 28447578 / 28348610 / +0.3% 41704420 / 44664375 / -6.6% 0.68 / 0.63 / +7.5%
tpcds_q29/datafusion:parquet 74654927 / 75213046 / -0.7% 97838286 / 98371104 / -0.5% 0.76 / 0.76 / -0.2%
tpcds_q30/datafusion:parquet 44323944 / 42169774 / +5.1% 57767735 / 60307379 / -4.2% 0.77 / 0.70 / +9.7%
tpcds_q31/datafusion:parquet 79111876 / 82361952 / -3.9% 102165784 / 100496583 / +1.7% 0.77 / 0.82 / -5.5%
tpcds_q32/datafusion:parquet 26203881 / 26591342 / -1.5% 40680452 / 41298146 / -1.5% 0.64 / 0.64 / +0.0%
tpcds_q33/datafusion:parquet 37975436 / 37691810 / +0.8% 52901856 / 52125007 / +1.5% 0.72 / 0.72 / -0.7%
tpcds_q34/datafusion:parquet 23907873 / 23986917 / -0.3% 34956754 / 35499490 / -1.5% 0.68 / 0.68 / +1.2%
tpcds_q35/datafusion:parquet 47982524 / 49296060 / -2.7% 62549371 / 63017284 / -0.7% 0.77 / 0.78 / -1.9%
tpcds_q36/datafusion:parquet 52265897 / 51684038 / +1.1% 68700407 / 72210818 / -4.9% 0.76 / 0.72 / +6.3%
tpcds_q37/datafusion:parquet 21100202 / 21446941 / -1.6% 33661914 / 33942784 / -0.8% 0.63 / 0.63 / -0.8%
tpcds_q38/datafusion:parquet 44231866 / 44820684 / -1.3% 60721401 / 64689017 / -6.1% 0.73 / 0.69 / +5.1%
tpcds_q39/datafusion:parquet 67397090 / 67699316 / -0.4% 84748811 / 85621293 / -1.0% 0.80 / 0.79 / +0.6%
tpcds_q40/datafusion:parquet 31254120 / 30000794 / +4.2% 48532917 / 50879079 / -4.6% 0.64 / 0.59 / +9.2%
tpcds_q41/datafusion:parquet 20374029 / 19946452 / +2.1% 31695054 / 33044523 / -4.1% 0.64 / 0.60 / +6.5%
tpcds_q42/datafusion:parquet 18120308 / 18308191 / -1.0% 29636751 / 29437985 / +0.7% 0.61 / 0.62 / -1.7%
tpcds_q43/datafusion:parquet 18965534 / 19214094 / -1.3% 31407119 / 32772151 / -4.2% 0.60 / 0.59 / +3.0%
tpcds_q44/datafusion:parquet 36144929 / 36340908 / -0.5% 47539193 / 50486207 / -5.8% 0.76 / 0.72 / +5.6%
tpcds_q45/datafusion:parquet 27599648 / 27936952 / -1.2% 39591438 / 41010369 / -3.5% 0.70 / 0.68 / +2.3%
tpcds_q46/datafusion:parquet 28913884 / 28826922 / +0.3% 45308669 / 45636859 / -0.7% 0.64 / 0.63 / +1.0%
tpcds_q47/datafusion:parquet 96561200 / 96258910 / +0.3% 118430076 / 121179574 / -2.3% 0.82 / 0.79 / +2.6%
tpcds_q48/datafusion:parquet 41532722 / 41744890 / -0.5% 57955468 / 60514557 / -4.2% 0.72 / 0.69 / +3.9%
tpcds_q49/datafusion:parquet 70298804 / 71447943 / -1.6% 92640279 / 95643903 / -3.1% 0.76 / 0.75 / +1.6%
tpcds_q50/datafusion:parquet 47177224 / 46692792 / +1.0% 68891982 / 66443234 / +3.7% 0.68 / 0.70 / -2.6%
tpcds_q51/datafusion:parquet 74987065 / 74751852 / +0.3% 92945069 / 95188004 / -2.4% 0.81 / 0.79 / +2.7%
tpcds_q52/datafusion:parquet 18414078 / 18505499 / -0.5% 29721032 / 29947465 / -0.8% 0.62 / 0.62 / +0.3%
tpcds_q53/datafusion:parquet 22627830 / 22157468 / +2.1% 37052856 / 38528177 / -3.8% 0.61 / 0.58 / +6.2%
tpcds_q54/datafusion:parquet 52716744 / 53529878 / -1.5% 69044879 / 67031326 / +3.0% 0.76 / 0.80 / -4.4%
tpcds_q55/datafusion:parquet 18115383 / 18220436 / -0.6% 29006746 / 29095284 / -0.3% 0.62 / 0.63 / -0.3%
tpcds_q56/datafusion:parquet 41101873 / 40381978 / +1.8% 55315232 / 53095997 / +4.2% 0.74 / 0.76 / -2.3%
tpcds_q57/datafusion:parquet 102071302 / 100584148 / +1.5% 114906043 / 118053564 / -2.7% 0.89 / 0.85 / +4.3%
tpcds_q58/datafusion:parquet 65622236 / 66427576 / -1.2% 81851831 / 83659276 / -2.2% 0.80 / 0.79 / +1.0%
tpcds_q59/datafusion:parquet 47970145 / 48221440 / -0.5% 65818417 / 65794875 / +0.0% 0.73 / 0.73 / -0.6%
tpcds_q60/datafusion:parquet 40804472 / 42417197 / -3.8% 57505972 / 57825521 / -0.6% 0.71 / 0.73 / -3.3%
tpcds_q61/datafusion:parquet 36409210 / 35831609 / +1.6% 51732287 / 49811571 / +3.9% 0.70 / 0.72 / -2.2%
tpcds_q62/datafusion:parquet 25126748 / 24971228 / +0.6% 36746237 / 38219191 / -3.9% 0.68 / 0.65 / +4.7%
tpcds_q63/datafusion:parquet 22034055 / 21960166 / +0.3% 37228291 / 38357620 / -2.9% 0.59 / 0.57 / +3.4%
tpcds_q64/datafusion:parquet 287540937 / 284502649 / +1.1% 321414814 / 323959594 / -0.8% 0.89 / 0.88 / +1.9%
tpcds_q65/datafusion:parquet 121017464 / 123423916 / -1.9% 136802877 / 140942042 / -2.9% 0.88 / 0.88 / +1.0%
tpcds_q66/datafusion:parquet 59656788 / 60140036 / -0.8% 75836837 / 74724577 / +1.5% 0.79 / 0.80 / -2.3%
tpcds_q67/datafusion:parquet 68198783 / 68723312 / -0.8% 91409963 / 91987388 / -0.6% 0.75 / 0.75 / -0.1%
tpcds_q68/datafusion:parquet 28576176 / 28935146 / -1.2% 46497227 / 48036163 / -3.2% 0.61 / 0.60 / +2.0%
tpcds_q69/datafusion:parquet 42083878 / 42476883 / -0.9% 55635515 / 60097084 / -7.4% 0.76 / 0.71 / +7.0%
tpcds_q70/datafusion:parquet 80285892 / 79887880 / +0.5% 97348546 / 97537013 / -0.2% 0.82 / 0.82 / +0.7%
tpcds_q71/datafusion:parquet 25825585 / 24129452 / +7.0% 36332233 / 40401907 / -10.1% 🟢 0.71 / 0.60 / +19.0%
tpcds_q72/datafusion:parquet 522094130 / 519359136 / +0.5% 559440818 / 536618280 / +4.3% 0.93 / 0.97 / -3.6%
tpcds_q73/datafusion:parquet 23574256 / 23466324 / +0.5% 35645788 / 36243461 / -1.6% 0.66 / 0.65 / +2.1%
tpcds_q74/datafusion:parquet 71124779 / 69848585 / +1.8% 87507948 / 91259366 / -4.1% 0.81 / 0.77 / +6.2%
tpcds_q75/datafusion:parquet 151295020 / 152735996 / -0.9% 177777617 / 179231792 / -0.8% 0.85 / 0.85 / -0.1%
tpcds_q76/datafusion:parquet 34117394 / 32972460 / +3.5% 46711039 / 47824608 / -2.3% 0.73 / 0.69 / +5.9%
tpcds_q77/datafusion:parquet 56783783 / 57387964 / -1.1% 74270864 / 74387316 / -0.2% 0.76 / 0.77 / -0.9%
tpcds_q78/datafusion:parquet 84595198 / 86956888 / -2.7% 117915322 / 118587712 / -0.6% 0.72 / 0.73 / -2.2%
tpcds_q79/datafusion:parquet 26455122 / 26990804 / -2.0% 40877595 / 41210483 / -0.8% 0.65 / 0.65 / -1.2%
tpcds_q80/datafusion:parquet 80169654 / 78200446 / +2.5% 111313559 / 109323641 / +1.8% 0.72 / 0.72 / +0.7%
tpcds_q81/datafusion:parquet 38149226 / 37209420 / +2.5% 51024273 / 51617816 / -1.1% 0.75 / 0.72 / +3.7%
tpcds_q82/datafusion:parquet 22376844 / 22874962 / -2.2% 34960101 / 35708586 / -2.1% 0.64 / 0.64 / -0.1%
tpcds_q83/datafusion:parquet 57559844 / 58708558 / -2.0% 68779131 / 72828600 / -5.6% 0.84 / 0.81 / +3.8%
tpcds_q84/datafusion:parquet 27442000 / 26558336 / +3.3% 39965287 / 40013451 / -0.1% 0.69 / 0.66 / +3.5%
tpcds_q85/datafusion:parquet 81091112 / 80108087 / +1.2% 100606057 / 101416520 / -0.8% 0.81 / 0.79 / +2.0%
tpcds_q86/datafusion:parquet 20654006 / 20797778 / -0.7% 32338292 / 32549020 / -0.6% 0.64 / 0.64 / -0.0%
tpcds_q87/datafusion:parquet 44484919 / 44699589 / -0.5% 58630106 / 60405826 / -2.9% 0.76 / 0.74 / +2.5%
tpcds_q88/datafusion:parquet 36133205 / 36326275 / -0.5% 47913419 / 49299582 / -2.8% 0.75 / 0.74 / +2.3%
tpcds_q89/datafusion:parquet 25932070 / 25828823 / +0.4% 40469411 / 42119541 / -3.9% 0.64 / 0.61 / +4.5%
tpcds_q90/datafusion:parquet 14954409 / 15845292 / -5.6% 27672101 / 26616034 / +4.0% 0.54 / 0.60 / -9.2%
tpcds_q91/datafusion:parquet 31570787 / 31904989 / -1.0% 46735014 / 46092911 / +1.4% 0.68 / 0.69 / -2.4%
tpcds_q92/datafusion:parquet 26531253 / 26792150 / -1.0% 37407359 / 40347548 / -7.3% 0.71 / 0.66 / +6.8%
tpcds_q93/datafusion:parquet 27040410 / 27212198 / -0.6% 45640556 / 46035787 / -0.9% 0.59 / 0.59 / +0.2%
tpcds_q94/datafusion:parquet 35189060 / 35005805 / +0.5% 49877923 / 48298824 / +3.3% 0.71 / 0.72 / -2.7%
tpcds_q95/datafusion:parquet 64919462 / 64204052 / +1.1% 78043341 / 80763136 / -3.4% 0.83 / 0.79 / +4.6%
tpcds_q96/datafusion:parquet 12918840 / 12754800 / +1.3% 23493944 / 24973882 / -5.9% 0.55 / 0.51 / +7.7%
tpcds_q97/datafusion:parquet 35652704 / 35401358 / +0.7% 51643001 / 50688711 / +1.9% 0.69 / 0.70 / -1.2%
tpcds_q98/datafusion:parquet 24851425 / 24555935 / +1.2% 37788128 / 37543398 / +0.7% 0.66 / 0.65 / +0.5%
tpcds_q99/datafusion:parquet 29772154 / 29519639 / +0.9% 41842441 / 40841538 / +2.5% 0.71 / 0.72 / -1.6%
duckdb / vortex-compact / ns (0.997x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17550222 / 17454306 / +0.5% 25607408 / 25954078 / -1.3% 0.69 / 0.67 / +1.9%
tpcds_q02/duckdb:vortex-compact 19238657 / 19961586 / -3.6% 23568054 / 23425665 / +0.6% 0.82 / 0.85 / -4.2%
tpcds_q03/duckdb:vortex-compact 8224590 / 8367828 / -1.7% 17263545 / 17255470 / +0.0% 0.48 / 0.48 / -1.8%
tpcds_q04/duckdb:vortex-compact 47402605 / 46803957 / +1.3% 59177405 / 58059409 / +1.9% 0.80 / 0.81 / -0.6%
tpcds_q05/duckdb:vortex-compact 24819266 / 25070530 / -1.0% 34463196 / 34086690 / +1.1% 0.72 / 0.74 / -2.1%
tpcds_q06/duckdb:vortex-compact 25961869 / 26068826 / -0.4% 40319130 / 39890505 / +1.1% 0.64 / 0.65 / -1.5%
tpcds_q07/duckdb:vortex-compact 18383643 / 18497364 / -0.6% 27525121 / 27929759 / -1.4% 0.67 / 0.66 / +0.8%
tpcds_q08/duckdb:vortex-compact 22304638 / 22228095 / +0.3% 29854732 / 29244746 / +2.1% 0.75 / 0.76 / -1.7%
tpcds_q09/duckdb:vortex-compact 21915996 / 21635313 / +1.3% 31311351 / 31141697 / +0.5% 0.70 / 0.69 / +0.7%
tpcds_q10/duckdb:vortex-compact 32244192 / 32230576 / +0.0% 45028731 / 45197026 / -0.4% 0.72 / 0.71 / +0.4%
tpcds_q11/duckdb:vortex-compact 38255253 / 38300530 / -0.1% 47305722 / 46977414 / +0.7% 0.81 / 0.82 / -0.8%
tpcds_q12/duckdb:vortex-compact 12829689 / 12791337 / +0.3% 19236467 / 19517429 / -1.4% 0.67 / 0.66 / +1.8%
tpcds_q13/duckdb:vortex-compact 37234621 / 36883250 / +1.0% 46909991 / 48804141 / -3.9% 0.79 / 0.76 / +5.0%
tpcds_q14/duckdb:vortex-compact 59780704 / 60611639 / -1.4% 67835430 / 69405561 / -2.3% 0.88 / 0.87 / +0.9%
tpcds_q15/duckdb:vortex-compact 14735264 / 14772861 / -0.3% 22331867 / 21761215 / +2.6% 0.66 / 0.68 / -2.8%
tpcds_q16/duckdb:vortex-compact 25615877 / 27101351 / -5.5% 36160333 / 35579344 / +1.6% 0.71 / 0.76 / -7.0%
tpcds_q17/duckdb:vortex-compact 28159722 / 28150382 / +0.0% 41665388 / 39028823 / +6.8% 0.68 / 0.72 / -6.3%
tpcds_q18/duckdb:vortex-compact 38872886 / 35970160 / +8.1% 45201703 / 45764630 / -1.2% 0.86 / 0.79 / +9.4%
tpcds_q19/duckdb:vortex-compact 82983830 / 82398688 / +0.7% 93163458 / 91913218 / +1.4% 0.89 / 0.90 / -0.6%
tpcds_q20/duckdb:vortex-compact 13649336 / 13772084 / -0.9% 20262845 / 19866330 / +2.0% 0.67 / 0.69 / -2.8%
tpcds_q21/duckdb:vortex-compact 11477317 / 11639917 / -1.4% 23358821 / 23524646 / -0.7% 0.49 / 0.49 / -0.7%
tpcds_q22/duckdb:vortex-compact 20489236 / 20183366 / +1.5% 32187072 / 31440036 / +2.4% 0.64 / 0.64 / -0.8%
tpcds_q23/duckdb:vortex-compact 44987492 / 41710699 / +7.9% 53397003 / 52998654 / +0.8% 0.84 / 0.79 / +7.1%
tpcds_q24/duckdb:vortex-compact 28406558 / 28411837 / -0.0% 37367105 / 38167225 / -2.1% 0.76 / 0.74 / +2.1%
tpcds_q25/duckdb:vortex-compact 27097350 / 27186862 / -0.3% 39571218 / 38740055 / +2.1% 0.68 / 0.70 / -2.4%
tpcds_q26/duckdb:vortex-compact 17839945 / 17960986 / -0.7% 25222499 / 25593787 / -1.5% 0.71 / 0.70 / +0.8%
tpcds_q27/duckdb:vortex-compact 20955562 / 20759390 / +0.9% 30140547 / 29913040 / +0.8% 0.70 / 0.69 / +0.2%
tpcds_q28/duckdb:vortex-compact 21057991 / 22084286 / -4.6% 33041724 / 29955575 / +10.3% 🔴 0.64 / 0.74 / -13.6%
tpcds_q29/duckdb:vortex-compact 27072460 / 27103814 / -0.1% 37775612 / 37859210 / -0.2% 0.72 / 0.72 / +0.1%
tpcds_q30/duckdb:vortex-compact 18342346 / 18201820 / +0.8% 27467742 / 26442450 / +3.9% 0.67 / 0.69 / -3.0%
tpcds_q31/duckdb:vortex-compact 20332296 / 19927863 / +2.0% 27967549 / 28657756 / -2.4% 0.73 / 0.70 / +4.5%
tpcds_q32/duckdb:vortex-compact 13808274 / 13785903 / +0.2% 22756232 / 22893298 / -0.6% 0.61 / 0.60 / +0.8%
tpcds_q33/duckdb:vortex-compact 20543052 / 20663716 / -0.6% 30553253 / 30257061 / +1.0% 0.67 / 0.68 / -1.5%
tpcds_q34/duckdb:vortex-compact 14373047 / 14431914 / -0.4% 24902749 / 24044796 / +3.6% 0.58 / 0.60 / -3.8%
tpcds_q35/duckdb:vortex-compact 31555506 / 31385688 / +0.5% 42717445 / 43285740 / -1.3% 0.74 / 0.73 / +1.9%
tpcds_q36/duckdb:vortex-compact 15734826 / 15781320 / -0.3% 25385087 / 24713419 / +2.7% 0.62 / 0.64 / -2.9%
tpcds_q37/duckdb:vortex-compact 13238982 / 13122109 / +0.9% 27630073 / 26197580 / +5.5% 0.48 / 0.50 / -4.3%
tpcds_q38/duckdb:vortex-compact 25230918 / 25187649 / +0.2% 33085792 / 33132512 / -0.1% 0.76 / 0.76 / +0.3%
tpcds_q39/duckdb:vortex-compact 20042957 / 20077759 / -0.2% 32721332 / 33880050 / -3.4% 0.61 / 0.59 / +3.4%
tpcds_q40/duckdb:vortex-compact 16142783 / 16258962 / -0.7% 21889628 / 21395000 / +2.3% 0.74 / 0.76 / -3.0%
tpcds_q41/duckdb:vortex-compact 20383208 / 20563437 / -0.9% 27264730 / 28140902 / -3.1% 0.75 / 0.73 / +2.3%
tpcds_q42/duckdb:vortex-compact 8320326 / 8302648 / +0.2% 16781305 / 16684327 / +0.6% 0.50 / 0.50 / -0.4%
tpcds_q43/duckdb:vortex-compact 10854219 / 10961156 / -1.0% 20543690 / 19549094 / +5.1% 0.53 / 0.56 / -5.8%
tpcds_q44/duckdb:vortex-compact 14719586 / 15676999 / -6.1% 27629905 / 26925700 / +2.6% 0.53 / 0.58 / -8.5%
tpcds_q45/duckdb:vortex-compact 26025964 / 26652618 / -2.4% 33096720 / 33195020 / -0.3% 0.79 / 0.80 / -2.1%
tpcds_q46/duckdb:vortex-compact 20200198 / 20291438 / -0.4% 28833794 / 29076276 / -0.8% 0.70 / 0.70 / +0.4%
tpcds_q47/duckdb:vortex-compact 39480630 / 36597372 / +7.9% 45322820 / 45268676 / +0.1% 0.87 / 0.81 / +7.7%
tpcds_q48/duckdb:vortex-compact 38202022 / 37905292 / +0.8% 48621941 / 48449902 / +0.4% 0.79 / 0.78 / +0.4%
tpcds_q49/duckdb:vortex-compact 22611760 / 21919457 / +3.2% 33207437 / 34032670 / -2.4% 0.68 / 0.64 / +5.7%
tpcds_q50/duckdb:vortex-compact 18487502 / 18590690 / -0.6% 27465202 / 27329696 / +0.5% 0.67 / 0.68 / -1.0%
tpcds_q51/duckdb:vortex-compact 50756137 / 49916986 / +1.7% 60155476 / 61716643 / -2.5% 0.84 / 0.81 / +4.3%
tpcds_q52/duckdb:vortex-compact 8300772 / 8446220 / -1.7% 17215261 / 16707495 / +3.0% 0.48 / 0.51 / -4.6%
tpcds_q53/duckdb:vortex-compact 13664445 / 13700884 / -0.3% 23790947 / 23934445 / -0.6% 0.57 / 0.57 / +0.3%
tpcds_q54/duckdb:vortex-compact 22043089 / 21904312 / +0.6% 32288336 / 32808059 / -1.6% 0.68 / 0.67 / +2.3%
tpcds_q55/duckdb:vortex-compact 8317477 / 8310643 / +0.1% 16622936 / 16336789 / +1.8% 0.50 / 0.51 / -1.6%
tpcds_q56/duckdb:vortex-compact 21167144 / 21421238 / -1.2% 29600133 / 30149136 / -1.8% 0.72 / 0.71 / +0.6%
tpcds_q57/duckdb:vortex-compact 27254388 / 27145606 / +0.4% 35442357 / 35031690 / +1.2% 0.77 / 0.77 / -0.8%
tpcds_q58/duckdb:vortex-compact 22462526 / 22395530 / +0.3% 31915799 / 31258369 / +2.1% 0.70 / 0.72 / -1.8%
tpcds_q59/duckdb:vortex-compact 20819532 / 20639244 / +0.9% 28453507 / 29309356 / -2.9% 0.73 / 0.70 / +3.9%
tpcds_q60/duckdb:vortex-compact 21217572 / 23829452 / -11.0% 🟢 30494313 / 31316931 / -2.6% 0.70 / 0.76 / -8.6%
tpcds_q61/duckdb:vortex-compact 27105936 / 27078554 / +0.1% 35658848 / 35417750 / +0.7% 0.76 / 0.76 / -0.6%
tpcds_q62/duckdb:vortex-compact 13171757 / 12898646 / +2.1% 19615651 / 19868013 / -1.3% 0.67 / 0.65 / +3.4%
tpcds_q63/duckdb:vortex-compact 12924028 / 13215054 / -2.2% 21918803 / 22087709 / -0.8% 0.59 / 0.60 / -1.4%
tpcds_q64/duckdb:vortex-compact 56805850 / 56297016 / +0.9% 70437062 / 70394589 / +0.1% 0.81 / 0.80 / +0.8%
tpcds_q65/duckdb:vortex-compact 14555394 / 14438242 / +0.8% 24381255 / 24259174 / +0.5% 0.60 / 0.60 / +0.3%
tpcds_q66/duckdb:vortex-compact 32734372 / 35000727 / -6.5% 37173537 / 37736901 / -1.5% 0.88 / 0.93 / -5.1%
tpcds_q67/duckdb:vortex-compact 61213606 / 63273368 / -3.3% 69822488 / 70328564 / -0.7% 0.88 / 0.90 / -2.6%
tpcds_q68/duckdb:vortex-compact 19942874 / 20003730 / -0.3% 28599159 / 28879060 / -1.0% 0.70 / 0.69 / +0.7%
tpcds_q69/duckdb:vortex-compact 28352148 / 28719624 / -1.3% 42368445 / 43027037 / -1.5% 0.67 / 0.67 / +0.3%
tpcds_q70/duckdb:vortex-compact 18973742 / 18797391 / +0.9% 30030203 / 30682407 / -2.1% 0.63 / 0.61 / +3.1%
tpcds_q71/duckdb:vortex-compact 15077564 / 14785986 / +2.0% 24116190 / 25086127 / -3.9% 0.63 / 0.59 / +6.1%
tpcds_q72/duckdb:vortex-compact 56371106 / 57110562 / -1.3% 66202774 / 67200347 / -1.5% 0.85 / 0.85 / +0.2%
tpcds_q73/duckdb:vortex-compact 13133700 / 13348670 / -1.6% 22556459 / 22738149 / -0.8% 0.58 / 0.59 / -0.8%
tpcds_q74/duckdb:vortex-compact 26695750 / 26810308 / -0.4% 34802750 / 35219083 / -1.2% 0.77 / 0.76 / +0.8%
tpcds_q75/duckdb:vortex-compact 30315074 / 29634930 / +2.3% 40306073 / 40446198 / -0.3% 0.75 / 0.73 / +2.7%
tpcds_q76/duckdb:vortex-compact 14016940 / 14066982 / -0.4% 23039550 / 23120059 / -0.3% 0.61 / 0.61 / -0.0%
tpcds_q77/duckdb:vortex-compact 24050674 / 24042216 / +0.0% 32834981 / 32622990 / +0.6% 0.73 / 0.74 / -0.6%
tpcds_q78/duckdb:vortex-compact 43781972 / 44459136 / -1.5% 54693662 / 54948499 / -0.5% 0.80 / 0.81 / -1.1%
tpcds_q79/duckdb:vortex-compact 13707037 / 13541881 / +1.2% 21353413 / 21077454 / +1.3% 0.64 / 0.64 / -0.1%
tpcds_q80/duckdb:vortex-compact 40312465 / 41306502 / -2.4% 52205854 / 51225060 / +1.9% 0.77 / 0.81 / -4.2%
tpcds_q81/duckdb:vortex-compact 24327302 / 23902400 / +1.8% 31678460 / 31430119 / +0.8% 0.77 / 0.76 / +1.0%
tpcds_q82/duckdb:vortex-compact 12708690 / 12868328 / -1.2% 25861495 / 25381747 / +1.9% 0.49 / 0.51 / -3.1%
tpcds_q83/duckdb:vortex-compact 18569774 / 18703496 / -0.7% 25110269 / 25338416 / -0.9% 0.74 / 0.74 / +0.2%
tpcds_q84/duckdb:vortex-compact 17483361 / 17336057 / +0.8% 23611887 / 23415473 / +0.8% 0.74 / 0.74 / +0.0%
tpcds_q85/duckdb:vortex-compact 38992159 / 38928866 / +0.2% 50638941 / 51363279 / -1.4% 0.77 / 0.76 / +1.6%
tpcds_q86/duckdb:vortex-compact 10868974 / 10870008 / -0.0% 16873124 / 17105161 / -1.4% 0.64 / 0.64 / +1.4%
tpcds_q87/duckdb:vortex-compact 26930576 / 26873040 / +0.2% 34918420 / 35485271 / -1.6% 0.77 / 0.76 / +1.8%
tpcds_q88/duckdb:vortex-compact 31963423 / 32319860 / -1.1% 39157541 / 38885963 / +0.7% 0.82 / 0.83 / -1.8%
tpcds_q89/duckdb:vortex-compact 15377275 / 15584967 / -1.3% 23528283 / 23503361 / +0.1% 0.65 / 0.66 / -1.4%
tpcds_q90/duckdb:vortex-compact 8576384 / 8693172 / -1.3% 15599338 / 15555497 / +0.3% 0.55 / 0.56 / -1.6%
tpcds_q91/duckdb:vortex-compact 23393731 / 23581188 / -0.8% 31608472 / 31272769 / +1.1% 0.74 / 0.75 / -1.8%
tpcds_q92/duckdb:vortex-compact 14084786 / 14247453 / -1.1% 22960097 / 22237013 / +3.3% 0.61 / 0.64 / -4.3%
tpcds_q93/duckdb:vortex-compact 12639999 / 13052200 / -3.2% 26369221 / 24045651 / +9.7% 0.48 / 0.54 / -11.7%
tpcds_q94/duckdb:vortex-compact 23739868 / 23860891 / -0.5% 33145557 / 33472132 / -1.0% 0.72 / 0.71 / +0.5%
tpcds_q95/duckdb:vortex-compact 64770579 / 64232166 / +0.8% 73574190 / 73073201 / +0.7% 0.88 / 0.88 / +0.2%
tpcds_q96/duckdb:vortex-compact 8764588 / 8680080 / +1.0% 16635710 / 16851088 / -1.3% 0.53 / 0.52 / +2.3%
tpcds_q97/duckdb:vortex-compact 23752857 / 23873354 / -0.5% 31648582 / 34788009 / -9.0% 0.75 / 0.69 / +9.4%
tpcds_q98/duckdb:vortex-compact 14135132 / 14363620 / -1.6% 22766043 / 22922447 / -0.7% 0.62 / 0.63 / -0.9%
tpcds_q99/duckdb:vortex-compact 15685273 / 15550240 / +0.9% 23933100 / 23743288 / +0.8% 0.66 / 0.65 / +0.1%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23929095 / 23991418 / -0.3% 30835895 / 31303493 / -1.5% 0.78 / 0.77 / +1.3%
tpcds_q02/duckdb:parquet 17704724 / 17870072 / -0.9% 23286195 / 23812799 / -2.2% 0.76 / 0.75 / +1.3%
tpcds_q03/duckdb:parquet 9614924 / 9771028 / -1.6% 15550675 / 15930937 / -2.4% 0.62 / 0.61 / +0.8%
tpcds_q04/duckdb:parquet 117498369 / 117298258 / +0.2% 125740998 / 125266440 / +0.4% 0.93 / 0.94 / -0.2%
tpcds_q05/duckdb:parquet 28451840 / 28151253 / +1.1% 33138609 / 32850554 / +0.9% 0.86 / 0.86 / +0.2%
tpcds_q06/duckdb:parquet 26280913 / 26088532 / +0.7% 35270033 / 35857674 / -1.6% 0.75 / 0.73 / +2.4%
tpcds_q07/duckdb:parquet 31254326 / 31819584 / -1.8% 39175444 / 38738638 / +1.1% 0.80 / 0.82 / -2.9%
tpcds_q08/duckdb:parquet 19755172 / 19747625 / +0.0% 26017055 / 26064678 / -0.2% 0.76 / 0.76 / +0.2%
tpcds_q09/duckdb:parquet 26159622 / 26985850 / -3.1% 30133312 / 29327410 / +2.7% 0.87 / 0.92 / -5.7%
tpcds_q10/duckdb:parquet 32350378 / 32280394 / +0.2% 39869266 / 39864518 / +0.0% 0.81 / 0.81 / +0.2%
tpcds_q11/duckdb:parquet 68306122 / 69816852 / -2.2% 74835340 / 75462384 / -0.8% 0.91 / 0.93 / -1.3%
tpcds_q12/duckdb:parquet 13976420 / 13880364 / +0.7% 18919785 / 18944616 / -0.1% 0.74 / 0.73 / +0.8%
tpcds_q13/duckdb:parquet 31476064 / 30550909 / +3.0% 39449924 / 39518052 / -0.2% 0.80 / 0.77 / +3.2%
tpcds_q14/duckdb:parquet 64783985 / 64234690 / +0.9% 69891786 / 68101452 / +2.6% 0.93 / 0.94 / -1.7%
tpcds_q15/duckdb:parquet 16570939 / 16563408 / +0.0% 22253249 / 22655888 / -1.8% 0.74 / 0.73 / +1.9%
tpcds_q16/duckdb:parquet 30065996 / 30016538 / +0.2% 37063135 / 36617291 / +1.2% 0.81 / 0.82 / -1.0%
tpcds_q17/duckdb:parquet 33989036 / 34463794 / -1.4% 39486110 / 40986660 / -3.7% 0.86 / 0.84 / +2.4%
tpcds_q18/duckdb:parquet 46888986 / 46842042 / +0.1% 55480659 / 53913416 / +2.9% 0.85 / 0.87 / -2.7%
tpcds_q19/duckdb:parquet 18620941 / 18764471 / -0.8% 25822920 / 25493925 / +1.3% 0.72 / 0.74 / -2.0%
tpcds_q20/duckdb:parquet 14757200 / 14844872 / -0.6% 19448941 / 19956262 / -2.5% 0.76 / 0.74 / +2.0%
tpcds_q21/duckdb:parquet 10572379 / 10537404 / +0.3% 16968390 / 16911208 / +0.3% 0.62 / 0.62 / -0.0%
tpcds_q22/duckdb:parquet 20545522 / 20589960 / -0.2% 26547952 / 26226190 / +1.2% 0.77 / 0.79 / -1.4%
tpcds_q23/duckdb:parquet 43151740 / 42324622 / +2.0% 46663306 / 47324184 / -1.4% 0.92 / 0.89 / +3.4%
tpcds_q24/duckdb:parquet 30319808 / 31202588 / -2.8% 36590348 / 36666983 / -0.2% 0.83 / 0.85 / -2.6%
tpcds_q25/duckdb:parquet 30193353 / 30250744 / -0.2% 37012118 / 36990251 / +0.1% 0.82 / 0.82 / -0.2%
tpcds_q26/duckdb:parquet 28723272 / 28761158 / -0.1% 35290151 / 35522161 / -0.7% 0.81 / 0.81 / +0.5%
tpcds_q27/duckdb:parquet 33675774 / 34361744 / -2.0% 41231671 / 41442006 / -0.5% 0.82 / 0.83 / -1.5%
tpcds_q28/duckdb:parquet 25874620 / 26004045 / -0.5% 32617253 / 34434761 / -5.3% 0.79 / 0.76 / +5.0%
tpcds_q29/duckdb:parquet 32828225 / 32131450 / +2.2% 39398773 / 39113475 / +0.7% 0.83 / 0.82 / +1.4%
tpcds_q30/duckdb:parquet 35160692 / 35461758 / -0.8% 44126650 / 44282495 / -0.4% 0.80 / 0.80 / -0.5%
tpcds_q31/duckdb:parquet 35817635 / 35333364 / +1.4% 43256378 / 42131699 / +2.7% 0.83 / 0.84 / -1.3%
tpcds_q32/duckdb:parquet 14050868 / 14111128 / -0.4% 21355642 / 20663604 / +3.3% 0.66 / 0.68 / -3.7%
tpcds_q33/duckdb:parquet 23301725 / 24564094 / -5.1% 28418221 / 29234497 / -2.8% 0.82 / 0.84 / -2.4%
tpcds_q34/duckdb:parquet 16989254 / 17096462 / -0.6% 24116475 / 24465230 / -1.4% 0.70 / 0.70 / +0.8%
tpcds_q35/duckdb:parquet 35064658 / 34630190 / +1.3% 43897990 / 43469634 / +1.0% 0.80 / 0.80 / +0.3%
tpcds_q36/duckdb:parquet 41132602 / 40846450 / +0.7% 48153049 / 47506409 / +1.4% 0.85 / 0.86 / -0.7%
tpcds_q37/duckdb:parquet 12521321 / 12676082 / -1.2% 19303494 / 19540586 / -1.2% 0.65 / 0.65 / -0.0%
tpcds_q38/duckdb:parquet 29652464 / 29481648 / +0.6% 33682693 / 34110270 / -1.3% 0.88 / 0.86 / +1.9%
tpcds_q39/duckdb:parquet 23052092 / 23210768 / -0.7% 30169103 / 30425359 / -0.8% 0.76 / 0.76 / +0.2%
tpcds_q40/duckdb:parquet 15926381 / 15727370 / +1.3% 21144082 / 21062180 / +0.4% 0.75 / 0.75 / +0.9%
tpcds_q41/duckdb:parquet 11764614 / 11886569 / -1.0% 18091933 / 17809187 / +1.6% 0.65 / 0.67 / -2.6%
tpcds_q42/duckdb:parquet 9456331 / 9459704 / -0.0% 15310194 / 15506199 / -1.3% 0.62 / 0.61 / +1.2%
tpcds_q43/duckdb:parquet 12071492 / 12756449 / -5.4% 17820318 / 17901609 / -0.5% 0.68 / 0.71 / -4.9%
tpcds_q44/duckdb:parquet 20475658 / 21844211 / -6.3% 27482565 / 27657071 / -0.6% 0.75 / 0.79 / -5.7%
tpcds_q45/duckdb:parquet 20896704 / 20637802 / +1.3% 27486441 / 27527217 / -0.1% 0.76 / 0.75 / +1.4%
tpcds_q46/duckdb:parquet 37863970 / 36742192 / +3.1% 43481704 / 43548493 / -0.2% 0.87 / 0.84 / +3.2%
tpcds_q47/duckdb:parquet 34533396 / 34297077 / +0.7% 41445927 / 40980257 / +1.1% 0.83 / 0.84 / -0.4%
tpcds_q48/duckdb:parquet 31081988 / 29828322 / +4.2% 37014231 / 37351336 / -0.9% 0.84 / 0.80 / +5.2%
tpcds_q49/duckdb:parquet 28947429 / 28881757 / +0.2% 36233564 / 36683786 / -1.2% 0.80 / 0.79 / +1.5%
tpcds_q50/duckdb:parquet 19421095 / 19365490 / +0.3% 25553138 / 25741583 / -0.7% 0.76 / 0.75 / +1.0%
tpcds_q51/duckdb:parquet 51326853 / 52016744 / -1.3% 60562323 / 60023274 / +0.9% 0.85 / 0.87 / -2.2%
tpcds_q52/duckdb:parquet 9460945 / 9638384 / -1.8% 15839772 / 15165722 / +4.4% 0.60 / 0.64 / -6.0%
tpcds_q53/duckdb:parquet 13766910 / 13755711 / +0.1% 20952498 / 21194092 / -1.1% 0.66 / 0.65 / +1.2%
tpcds_q54/duckdb:parquet 24673803 / 24694837 / -0.1% 31971025 / 32311821 / -1.1% 0.77 / 0.76 / +1.0%
tpcds_q55/duckdb:parquet 9404814 / 9373036 / +0.3% 15706381 / 15536325 / +1.1% 0.60 / 0.60 / -0.7%
tpcds_q56/duckdb:parquet 24890502 / 24731111 / +0.6% 30324814 / 30811363 / -1.6% 0.82 / 0.80 / +2.3%
tpcds_q57/duckdb:parquet 30189573 / 30440317 / -0.8% 36001813 / 35881155 / +0.3% 0.84 / 0.85 / -1.2%
tpcds_q58/duckdb:parquet 24591827 / 24572890 / +0.1% 29923775 / 30190140 / -0.9% 0.82 / 0.81 / +1.0%
tpcds_q59/duckdb:parquet 23130328 / 22786116 / +1.5% 29097363 / 29736954 / -2.2% 0.79 / 0.77 / +3.7%
tpcds_q60/duckdb:parquet 26694499 / 28099942 / -5.0% 31823341 / 32524166 / -2.2% 0.84 / 0.86 / -2.9%
tpcds_q61/duckdb:parquet 25331032 / 24764448 / +2.3% 28182487 / 29071965 / -3.1% 0.90 / 0.85 / +5.5%
tpcds_q62/duckdb:parquet 12629404 / 12671951 / -0.3% 17745885 / 17830792 / -0.5% 0.71 / 0.71 / +0.1%
tpcds_q63/duckdb:parquet 13077547 / 13308449 / -1.7% 19860195 / 19857393 / +0.0% 0.66 / 0.67 / -1.7%
tpcds_q64/duckdb:parquet 70060650 / 69513742 / +0.8% 80082370 / 79883262 / +0.2% 0.87 / 0.87 / +0.5%
tpcds_q65/duckdb:parquet 19866506 / 20614424 / -3.6% 25762057 / 25975089 / -0.8% 0.77 / 0.79 / -2.8%
tpcds_q66/duckdb:parquet 32930196 / 33186476 / -0.8% 37446393 / 38032595 / -1.5% 0.88 / 0.87 / +0.8%
tpcds_q67/duckdb:parquet 60908856 / 60736160 / +0.3% 69728757 / 69608648 / +0.2% 0.87 / 0.87 / +0.1%
tpcds_q68/duckdb:parquet 27827166 / 30230622 / -8.0% 36632247 / 36255506 / +1.0% 0.76 / 0.83 / -8.9%
tpcds_q69/duckdb:parquet 25579394 / 25494866 / +0.3% 34056854 / 34378414 / -0.9% 0.75 / 0.74 / +1.3%
tpcds_q70/duckdb:parquet 19063258 / 19297473 / -1.2% 26986981 / 27004999 / -0.1% 0.71 / 0.71 / -1.1%
tpcds_q71/duckdb:parquet 16703934 / 16905394 / -1.2% 23943331 / 24090232 / -0.6% 0.70 / 0.70 / -0.6%
tpcds_q72/duckdb:parquet 53619042 / 52628211 / +1.9% 59616393 / 59595937 / +0.0% 0.90 / 0.88 / +1.8%
tpcds_q73/duckdb:parquet 14559481 / 14974636 / -2.8% 21214433 / 21479552 / -1.2% 0.69 / 0.70 / -1.6%
tpcds_q74/duckdb:parquet 83837835 / 84356164 / -0.6% 90490502 / 91319660 / -0.9% 0.93 / 0.92 / +0.3%
tpcds_q75/duckdb:parquet 43887509 / 43714748 / +0.4% 50012401 / 50402019 / -0.8% 0.88 / 0.87 / +1.2%
tpcds_q76/duckdb:parquet 17171058 / 17802862 / -3.5% 23354465 / 24422046 / -4.4% 0.74 / 0.73 / +0.9%
tpcds_q77/duckdb:parquet 26123090 / 25359830 / +3.0% 30756618 / 31383116 / -2.0% 0.85 / 0.81 / +5.1%
tpcds_q78/duckdb:parquet 77705260 / 77858992 / -0.2% 85433178 / 84702101 / +0.9% 0.91 / 0.92 / -1.1%
tpcds_q79/duckdb:parquet 21413262 / 22936182 / -6.6% 28480322 / 28793210 / -1.1% 0.75 / 0.80 / -5.6%
tpcds_q80/duckdb:parquet 36790607 / 35978293 / +2.3% 44240195 / 43783887 / +1.0% 0.83 / 0.82 / +1.2%
tpcds_q81/duckdb:parquet 35983702 / 36077628 / -0.3% 44989973 / 44249896 / +1.7% 0.80 / 0.82 / -1.9%
tpcds_q82/duckdb:parquet 13496342 / 13469570 / +0.2% 20175843 / 20137169 / +0.2% 0.67 / 0.67 / +0.0%
tpcds_q83/duckdb:parquet 19979976 / 19927112 / +0.3% 24897924 / 24943787 / -0.2% 0.80 / 0.80 / +0.4%
tpcds_q84/duckdb:parquet 22710037 / 22637024 / +0.3% 28979580 / 28824726 / +0.5% 0.78 / 0.79 / -0.2%
tpcds_q85/duckdb:parquet 31795580 / 32017786 / -0.7% 39124379 / 39822222 / -1.8% 0.81 / 0.80 / +1.1%
tpcds_q86/duckdb:parquet 11705206 / 11778566 / -0.6% 16780751 / 16811435 / -0.2% 0.70 / 0.70 / -0.4%
tpcds_q87/duckdb:parquet 30937624 / 30879162 / +0.2% 35098182 / 35066428 / +0.1% 0.88 / 0.88 / +0.1%
tpcds_q88/duckdb:parquet 38155097 / 38559304 / -1.0% 44140519 / 41020830 / +7.6% 0.86 / 0.94 / -8.0%
tpcds_q89/duckdb:parquet 13957784 / 14125693 / -1.2% 21390416 / 20982520 / +1.9% 0.65 / 0.67 / -3.1%
tpcds_q90/duckdb:parquet 10052482 / 9888925 / +1.7% 15133279 / 14764358 / +2.5% 0.66 / 0.67 / -0.8%
tpcds_q91/duckdb:parquet 20835329 / 21056556 / -1.1% 28423636 / 28696576 / -1.0% 0.73 / 0.73 / -0.1%
tpcds_q92/duckdb:parquet 15440156 / 15384720 / +0.4% 21930604 / 22114116 / -0.8% 0.70 / 0.70 / +1.2%
tpcds_q93/duckdb:parquet 14065358 / 14060095 / +0.0% 20285704 / 20360582 / -0.4% 0.69 / 0.69 / +0.4%
tpcds_q94/duckdb:parquet 25351678 / 25327767 / +0.1% 33290798 / 32082951 / +3.8% 0.76 / 0.79 / -3.5%
tpcds_q95/duckdb:parquet 43834552 / 43992885 / -0.4% 49188286 / 48703101 / +1.0% 0.89 / 0.90 / -1.3%
tpcds_q96/duckdb:parquet 8090758 / 8238565 / -1.8% 13700041 / 13472121 / +1.7% 0.59 / 0.61 / -3.4%
tpcds_q97/duckdb:parquet 27340776 / 27377650 / -0.1% 34184806 / 33882921 / +0.9% 0.80 / 0.81 / -1.0%
tpcds_q98/duckdb:parquet 16419424 / 16429658 / -0.1% 23092234 / 23366744 / -1.2% 0.71 / 0.70 / +1.1%
tpcds_q99/duckdb:parquet 18650888 / 18608798 / +0.2% 24503371 / 24568802 / -0.3% 0.76 / 0.76 / +0.5%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.983x ➖
Parquet (geomean): hot 0.993x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52341549 / 52087873 / +0.5% 74776808 / 77369568 / -3.4% 0.70 / 0.67 / +4.0%
appian_q02/datafusion:vortex-compact 228336920 / 226407768 / +0.9% 262360834 / 266960557 / -1.7% 0.87 / 0.85 / +2.6%
appian_q03/datafusion:vortex-compact 142555939 / 143601432 / -0.7% 187393549 / 191065789 / -1.9% 0.76 / 0.75 / +1.2%
appian_q04/datafusion:vortex-compact 9636682067 / 9642894050 / -0.1% 9752409783 / 9771275569 / -0.2% 0.99 / 0.99 / +0.1%
appian_q05/datafusion:vortex-compact 133323243 / 132229545 / +0.8% 166107255 / 165291867 / +0.5% 0.80 / 0.80 / +0.3%
appian_q06/datafusion:vortex-compact 139852366 / 138537231 / +0.9% 162807776 / 166949152 / -2.5% 0.86 / 0.83 / +3.5%
appian_q07/datafusion:vortex-compact 155872268 / 155201070 / +0.4% 197632428 / 190945014 / +3.5% 0.79 / 0.81 / -3.0%
appian_q08/datafusion:vortex-compact 528214748 / 530640418 / -0.5% 602264251 / 605550533 / -0.5% 0.88 / 0.88 / +0.1%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 71617498 / 72858380 / -1.7% 94630506 / 91942684 / +2.9% 0.76 / 0.79 / -4.5%
appian_q02/datafusion:parquet 291465294 / 289792842 / +0.6% 333856462 / 325316353 / +2.6% 0.87 / 0.89 / -2.0%
appian_q03/datafusion:parquet 184536248 / 183393443 / +0.6% 227575841 / 230446022 / -1.2% 0.81 / 0.80 / +1.9%
appian_q04/datafusion:parquet 9673293423 / 9685666825 / -0.1% 9716722075 / 9713184887 / +0.0% 1.00 / 1.00 / -0.2%
appian_q05/datafusion:parquet 191733524 / 190691625 / +0.5% 220313829 / 223778500 / -1.5% 0.87 / 0.85 / +2.1%
appian_q06/datafusion:parquet 163270703 / 164350740 / -0.7% 186504048 / 188158121 / -0.9% 0.88 / 0.87 / +0.2%
appian_q07/datafusion:parquet 203372928 / 204052672 / -0.3% 238585331 / 237581147 / +0.4% 0.85 / 0.86 / -0.8%
appian_q08/datafusion:parquet 630564757 / 629401929 / +0.2% 689777101 / 687793015 / +0.3% 0.91 / 0.92 / -0.1%
duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 83660768 / 84272367 / -0.7% 95973459 / 98151019 / -2.2% 0.87 / 0.86 / +1.5%
appian_q02/duckdb:vortex-compact 237029368 / 233610170 / +1.5% 249087817 / 267329104 / -6.8% 0.95 / 0.87 / +8.9%
appian_q03/duckdb:vortex-compact 117526889 / 118113796 / -0.5% 132529620 / 137612129 / -3.7% 0.89 / 0.86 / +3.3%
appian_q04/duckdb:vortex-compact 621157229 / 634894153 / -2.2% 619043108 / 658324251 / -6.0% 1.00 / 0.96 / +4.0%
appian_q05/duckdb:vortex-compact 118809948 / 121435744 / -2.2% 129314268 / 128683910 / +0.5% 0.92 / 0.94 / -2.6%
appian_q06/duckdb:vortex-compact 196513069 / 197772431 / -0.6% 203025113 / 202987415 / +0.0% 0.97 / 0.97 / -0.7%
appian_q07/duckdb:vortex-compact 119694485 / 120708656 / -0.8% 130795135 / 137170282 / -4.6% 0.92 / 0.88 / +4.0%
appian_q08/duckdb:vortex-compact 342096547 / 343843241 / -0.5% 355986765 / 344627630 / +3.3% 0.96 / 1.00 / -3.7%
duckdb / parquet / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 93957493 / 97097669 / -3.2% 100301886 / 101123754 / -0.8% 0.94 / 0.96 / -2.4%
appian_q02/duckdb:parquet 242994185 / 241973606 / +0.4% 261706368 / 252024540 / +3.8% 0.93 / 0.96 / -3.3%
appian_q03/duckdb:parquet 130063912 / 131515263 / -1.1% 136353488 / 137103880 / -0.5% 0.95 / 0.96 / -0.6%
appian_q04/duckdb:parquet 484384666 / 489876906 / -1.1% 496097486 / 490611029 / +1.1% 0.98 / 1.00 / -2.2%
appian_q05/duckdb:parquet 132255738 / 133382864 / -0.8% 134389245 / 137692353 / -2.4% 0.98 / 0.97 / +1.6%
appian_q06/duckdb:parquet 113621622 / 116375019 / -2.4% 121195156 / 121418648 / -0.2% 0.94 / 0.96 / -2.2%
appian_q07/duckdb:parquet 107395732 / 109436309 / -1.9% 122479366 / 116396974 / +5.2% 0.88 / 0.94 / -6.7%
appian_q08/duckdb:parquet 360565256 / 363740093 / -0.9% 344568843 / 346029084 / -0.4% 1.05 / 1.05 / -0.5%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.3%
Engines: DataFusion No clear signal (+4.5%, environment too noisy confidence) · DuckDB No clear signal (+0.1%, environment too noisy confidence)
Vortex (geomean): hot 1.084x ➖ · cold 1.081x ➖
Parquet (geomean): hot 1.060x ➖ · cold 1.073x ➖
Shifts: Parquet (control) +6.0% · Median polish +8.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.117x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 234260512 / 232757792 / +0.6% 599130456 / 746368243 / -19.7% 0.39 / 0.31 / +25.4%
tpch_q02/datafusion:vortex-compact 294678800 / 314664238 / -6.4% 606400723 / 617573385 / -1.8% 0.49 / 0.51 / -4.6%
tpch_q03/datafusion:vortex-compact 319149635 / 322913667 / -1.2% 652861200 / 657931172 / -0.8% 0.49 / 0.49 / -0.4%
tpch_q04/datafusion:vortex-compact 226604106 / 163668984 / +38.5% 🔴 368972689 / 315204572 / +17.1% 0.61 / 0.52 / +18.3%
tpch_q05/datafusion:vortex-compact 438436657 / 352416004 / +24.4% 516127860 / 490888536 / +5.1% 0.85 / 0.72 / +18.3%
tpch_q06/datafusion:vortex-compact 136398617 / 123785907 / +10.2% 286496482 / 368505291 / -22.3% 0.48 / 0.34 / +41.7%
tpch_q07/datafusion:vortex-compact 380556160 / 387206212 / -1.7% 541072427 / 538316095 / +0.5% 0.70 / 0.72 / -2.2%
tpch_q08/datafusion:vortex-compact 399226294 / 360018895 / +10.9% 598773073 / 571510553 / +4.8% 0.67 / 0.63 / +5.8%
tpch_q09/datafusion:vortex-compact 344718263 / 239117347 / +44.2% 🔴 455679410 / 433538478 / +5.1% 0.76 / 0.55 / +37.2%
tpch_q10/datafusion:vortex-compact 340338626 / 295827479 / +15.0% 465180067 / 426715909 / +9.0% 0.73 / 0.69 / +5.5%
tpch_q11/datafusion:vortex-compact 279662099 / 248107030 / +12.7% 408493511 / 391265611 / +4.4% 0.68 / 0.63 / +8.0%
tpch_q12/datafusion:vortex-compact 186299657 / 168365839 / +10.7% 340403481 / 329423222 / +3.3% 0.55 / 0.51 / +7.1%
tpch_q13/datafusion:vortex-compact 128073981 / 106280098 / +20.5% 353378895 / 274800386 / +28.6% 0.36 / 0.39 / -6.3%
tpch_q14/datafusion:vortex-compact 177053190 / 177425219 / -0.2% 388460938 / 356670692 / +8.9% 0.46 / 0.50 / -8.4%
tpch_q15/datafusion:vortex-compact 295463586 / 290221246 / +1.8% 476850280 / 576457699 / -17.3% 0.62 / 0.50 / +23.1%
tpch_q16/datafusion:vortex-compact 123320839 / 130377887 / -5.4% 239446221 / 300709591 / -20.4% 0.52 / 0.43 / +18.8%
tpch_q17/datafusion:vortex-compact 302420743 / 209852016 / +44.1% 🔴 826969195 / 384918224 / +114.8% 🔴 0.37 / 0.55 / -32.9%
tpch_q18/datafusion:vortex-compact 240489380 / 209978882 / +14.5% 712639094 / 402569338 / +77.0% 🔴 0.34 / 0.52 / -35.3%
tpch_q19/datafusion:vortex-compact 259925934 / 228930074 / +13.5% 413755659 / 491358008 / -15.8% 0.63 / 0.47 / +34.8%
tpch_q20/datafusion:vortex-compact 277873942 / 251505008 / +10.5% 433777233 / 455352809 / -4.7% 0.64 / 0.55 / +16.0%
tpch_q21/datafusion:vortex-compact 430308069 / 393245651 / +9.4% 701452199 / 522729998 / +34.2% 🔴 0.61 / 0.75 / -18.5%
tpch_q22/datafusion:vortex-compact 183154963 / 167436795 / +9.4% 405060921 / 411949656 / -1.7% 0.45 / 0.41 / +11.2%
datafusion / parquet / ns (1.070x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 150137568 / 147968900 / +1.5% 468619037 / 463170520 / +1.2% 0.32 / 0.32 / +0.3%
tpch_q02/datafusion:parquet 270198714 / 280184159 / -3.6% 444870345 / 469220440 / -5.2% 0.61 / 0.60 / +1.7%
tpch_q03/datafusion:parquet 230518920 / 248575117 / -7.3% 647354824 / 656311588 / -1.4% 0.36 / 0.38 / -6.0%
tpch_q04/datafusion:parquet 145989417 / 148727502 / -1.8% 322076223 / 276282923 / +16.6% 0.45 / 0.54 / -15.8%
tpch_q05/datafusion:parquet 373489871 / 355735540 / +5.0% 690824773 / 464161741 / +48.8% 🔴 0.54 / 0.77 / -29.5%
tpch_q06/datafusion:parquet 117587944 / 105354607 / +11.6% 231909998 / 248901795 / -6.8% 0.51 / 0.42 / +19.8%
tpch_q07/datafusion:parquet 368373386 / 339714675 / +8.4% 512214505 / 445154186 / +15.1% 0.72 / 0.76 / -5.8%
tpch_q08/datafusion:parquet 414871297 / 393245180 / +5.5% 508918167 / 540823140 / -5.9% 0.82 / 0.73 / +12.1%
tpch_q09/datafusion:parquet 398805348 / 384215404 / +3.8% 532541082 / 519268821 / +2.6% 0.75 / 0.74 / +1.2%
tpch_q10/datafusion:parquet 318212091 / 301813599 / +5.4% 469307238 / 457806999 / +2.5% 0.68 / 0.66 / +2.8%
tpch_q11/datafusion:parquet 258671308 / 266572566 / -3.0% 365309175 / 353666488 / +3.3% 0.71 / 0.75 / -6.1%
tpch_q12/datafusion:parquet 172960462 / 156042001 / +10.8% 389986988 / 355990026 / +9.5% 0.44 / 0.44 / +1.2%
tpch_q13/datafusion:parquet 275664647 / 271386451 / +1.6% 440111815 / 470367184 / -6.4% 0.63 / 0.58 / +8.6%
tpch_q14/datafusion:parquet 186347819 / 148636707 / +25.4% 310131405 / 269458259 / +15.1% 0.60 / 0.55 / +8.9%
tpch_q15/datafusion:parquet 297987353 / 315301915 / -5.5% 443470467 / 531316869 / -16.5% 0.67 / 0.59 / +13.2%
tpch_q16/datafusion:parquet 109648308 / 101389193 / +8.1% 183087566 / 197694415 / -7.4% 0.60 / 0.51 / +16.8%
tpch_q17/datafusion:parquet 298650401 / 265137437 / +12.6% 425667428 / 401388740 / +6.0% 0.70 / 0.66 / +6.2%
tpch_q18/datafusion:parquet 421712463 / 300416226 / +40.4% 🔴 482175183 / 434023003 / +11.1% 0.87 / 0.69 / +26.4%
tpch_q19/datafusion:parquet 177512307 / 150756706 / +17.7% 425777564 / 277938322 / +53.2% 🔴 0.42 / 0.54 / -23.1%
tpch_q20/datafusion:parquet 276420224 / 230827464 / +19.8% 413337737 / 402782137 / +2.6% 0.67 / 0.57 / +16.7%
tpch_q21/datafusion:parquet 308314382 / 286754908 / +7.5% 493719306 / 413215347 / +19.5% 0.62 / 0.69 / -10.0%
tpch_q22/datafusion:parquet 146944221 / 146853162 / +0.1% 324070471 / 320581571 / +1.1% 0.45 / 0.46 / -1.0%
duckdb / vortex-compact / ns (1.052x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 209331030 / 258872640 / -19.1% 217497476 / 269550883 / -19.3% 0.96 / 0.96 / +0.2%
tpch_q02/duckdb:vortex-compact 440153530 / 811704236 / -45.8% 🟢 514841228 / 671457936 / -23.3% 0.85 / 1.21 / -29.3%
tpch_q03/duckdb:vortex-compact 401554950 / 355746936 / +12.9% 418615776 / 390654180 / +7.2% 0.96 / 0.91 / +5.3%
tpch_q04/duckdb:vortex-compact 236022713 / 220673674 / +7.0% 338735823 / 261095084 / +29.7% 0.70 / 0.85 / -17.6%
tpch_q05/duckdb:vortex-compact 528875010 / 474871969 / +11.4% 574094978 / 547959146 / +4.8% 0.92 / 0.87 / +6.3%
tpch_q06/duckdb:vortex-compact 234949831 / 199990156 / +17.5% 942814597 / 233209485 / +304.3% 🔴 0.25 / 0.86 / -70.9%
tpch_q07/duckdb:vortex-compact 614673605 / 383677593 / +60.2% 🔴 488852455 / 473979650 / +3.1% 1.26 / 0.81 / +55.3%
tpch_q08/duckdb:vortex-compact 549379131 / 570700425 / -3.7% 599189192 / 720786766 / -16.9% 0.92 / 0.79 / +15.8%
tpch_q09/duckdb:vortex-compact 452189601 / 426043437 / +6.1% 576742791 / 420785634 / +37.1% 🔴 0.78 / 1.01 / -22.6%
tpch_q10/duckdb:vortex-compact 479571010 / 453946453 / +5.6% 572884716 / 519103160 / +10.4% 0.84 / 0.87 / -4.3%
tpch_q11/duckdb:vortex-compact 305648868 / 276903196 / +10.4% 315277305 / 310435834 / +1.6% 0.97 / 0.89 / +8.7%
tpch_q12/duckdb:vortex-compact 189011937 / 181056747 / +4.4% 267181865 / 218814055 / +22.1% 0.71 / 0.83 / -14.5%
tpch_q13/duckdb:vortex-compact 219049542 / 228845927 / -4.3% 220334009 / 375872463 / -41.4% 🟢 0.99 / 0.61 / +63.3%
tpch_q14/duckdb:vortex-compact 266675676 / 224424593 / +18.8% 375561452 / 288429779 / +30.2% 🔴 0.71 / 0.78 / -8.7%
tpch_q15/duckdb:vortex-compact 262906950 / 245595594 / +7.0% 285880702 / 323150291 / -11.5% 0.92 / 0.76 / +21.0%
tpch_q16/duckdb:vortex-compact 199533020 / 186986610 / +6.7% 251058595 / 228594949 / +9.8% 0.79 / 0.82 / -2.8%
tpch_q17/duckdb:vortex-compact 591935922 / 308915672 / +91.6% 🔴 429269448 / 363432488 / +18.1% 1.38 / 0.85 / +62.2%
tpch_q18/duckdb:vortex-compact 324367108 / 310309922 / +4.5% 634269274 / 359078759 / +76.6% 🔴 0.51 / 0.86 / -40.8%
tpch_q19/duckdb:vortex-compact 323765423 / 274835918 / +17.8% 389815569 / 342660795 / +13.8% 0.83 / 0.80 / +3.6%
tpch_q20/duckdb:vortex-compact 350792555 / 486534817 / -27.9% 414595995 / 492896030 / -15.9% 0.85 / 0.99 / -14.3%
tpch_q21/duckdb:vortex-compact 613174683 / 608578557 / +0.8% 633013145 / 699125488 / -9.5% 0.97 / 0.87 / +11.3%
tpch_q22/duckdb:vortex-compact 226215929 / 227890820 / -0.7% 274939542 / 251644095 / +9.3% 0.82 / 0.91 / -9.1%
duckdb / parquet / ns (1.051x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 196430938 / 153207646 / +28.2% 225281710 / 227625449 / -1.0% 0.87 / 0.67 / +29.5%
tpch_q02/duckdb:parquet 453906315 / 433870316 / +4.6% 677719280 / 432172789 / +56.8% 🔴 0.67 / 1.00 / -33.3%
tpch_q03/duckdb:parquet 345111912 / 355566261 / -2.9% 475967118 / 432747178 / +10.0% 0.73 / 0.82 / -11.8%
tpch_q04/duckdb:parquet 313752062 / 267063892 / +17.5% 369443681 / 299170237 / +23.5% 0.85 / 0.89 / -4.9%
tpch_q05/duckdb:parquet 538587115 / 491344281 / +9.6% 629467063 / 622376678 / +1.1% 0.86 / 0.79 / +8.4%
tpch_q06/duckdb:parquet 188384760 / 155837045 / +20.9% 206557641 / 176574885 / +17.0% 0.91 / 0.88 / +3.3%
tpch_q07/duckdb:parquet 467149195 / 386085161 / +21.0% 625358236 / 410618912 / +52.3% 🔴 0.75 / 0.94 / -20.6%
tpch_q08/duckdb:parquet 618515625 / 604412430 / +2.3% 736423324 / 642103875 / +14.7% 0.84 / 0.94 / -10.8%
tpch_q09/duckdb:parquet 598252121 / 577358986 / +3.6% 640757723 / 634801195 / +0.9% 0.93 / 0.91 / +2.7%
tpch_q10/duckdb:parquet 574640380 / 561042418 / +2.4% 624603329 / 718115083 / -13.0% 0.92 / 0.78 / +17.8%
tpch_q11/duckdb:parquet 315629520 / 257091552 / +22.8% 329171189 / 274199218 / +20.0% 0.96 / 0.94 / +2.3%
tpch_q12/duckdb:parquet 297646896 / 236969674 / +25.6% 322225365 / 239892417 / +34.3% 🔴 0.92 / 0.99 / -6.5%
tpch_q13/duckdb:parquet 405560186 / 525605015 / -22.8% 482041046 / 490165225 / -1.7% 0.84 / 1.07 / -21.5%
tpch_q14/duckdb:parquet 231573910 / 493494580 / -53.1% 🟢 303176098 / 510192638 / -40.6% 🟢 0.76 / 0.97 / -21.0%
tpch_q15/duckdb:parquet 257640113 / 193796646 / +32.9% 🔴 284460286 / 220263839 / +29.1% 0.91 / 0.88 / +2.9%
tpch_q16/duckdb:parquet 294196647 / 275422143 / +6.8% 305136133 / 265041459 / +15.1% 0.96 / 1.04 / -7.2%
tpch_q17/duckdb:parquet 277920033 / 268673114 / +3.4% 323547717 / 314417743 / +2.9% 0.86 / 0.85 / +0.5%
tpch_q18/duckdb:parquet 341818289 / 354347910 / -3.5% 355949690 / 378358673 / -5.9% 0.96 / 0.94 / +2.5%
tpch_q19/duckdb:parquet 256666429 / 254948633 / +0.7% 300192313 / 319652714 / -6.1% 0.86 / 0.80 / +7.2%
tpch_q20/duckdb:parquet 495846034 / 436174651 / +13.7% 540306575 / 509291626 / +6.1% 0.92 / 0.86 / +7.2%
tpch_q21/duckdb:parquet 508314295 / 450386069 / +12.9% 608074657 / 568007400 / +7.1% 0.84 / 0.79 / +5.4%
tpch_q22/duckdb:parquet 328494705 / 301691271 / +8.9% 371333928 / 333965999 / +11.2% 0.88 / 0.90 / -2.1%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.4%
Engines: DataFusion No clear signal (-7.0%, environment too noisy confidence) · DuckDB No clear signal (+2.4%, environment too noisy confidence)
Vortex (geomean): hot 1.038x ➖ · cold 1.045x ➖
Parquet (geomean): hot 1.064x ➖ · cold 1.043x ➖
Shifts: Parquet (control) +6.4% · Median polish +6.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.972x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 338486631 / 346747460 / -2.4% 965183711 / 939306199 / +2.8% 0.35 / 0.37 / -5.0%
tpch_q02/datafusion:vortex-compact 506963280 / 443421302 / +14.3% 1277651314 / 987032658 / +29.4% 0.40 / 0.45 / -11.7%
tpch_q03/datafusion:vortex-compact 497099236 / 550389610 / -9.7% 1227377631 / 1357366259 / -9.6% 0.41 / 0.41 / -0.1%
tpch_q04/datafusion:vortex-compact 420909781 / 412514267 / +2.0% 611257532 / 609440090 / +0.3% 0.69 / 0.68 / +1.7%
tpch_q05/datafusion:vortex-compact 697001946 / 671887416 / +3.7% 921589959 / 1070699749 / -13.9% 0.76 / 0.63 / +20.5%
tpch_q06/datafusion:vortex-compact 251770458 / 217864748 / +15.6% 452328018 / 428811789 / +5.5% 0.56 / 0.51 / +9.6%
tpch_q07/datafusion:vortex-compact 581768501 / 585300327 / -0.6% 911895208 / 850115423 / +7.3% 0.64 / 0.69 / -7.3%
tpch_q08/datafusion:vortex-compact 861911160 / 1231317544 / -30.0% 🟢 1134281662 / 1420220696 / -20.1% 0.76 / 0.87 / -12.4%
tpch_q09/datafusion:vortex-compact 914892562 / 778478636 / +17.5% 1323264001 / 1154470770 / +14.6% 0.69 / 0.67 / +2.5%
tpch_q10/datafusion:vortex-compact 533417379 / 582501727 / -8.4% 822434107 / 796859107 / +3.2% 0.65 / 0.73 / -11.3%
tpch_q11/datafusion:vortex-compact 438363614 / 327686263 / +33.8% 🔴 826428760 / 623399859 / +32.6% 🔴 0.53 / 0.53 / +0.9%
tpch_q12/datafusion:vortex-compact 291802049 / 352787849 / -17.3% 766741995 / 449889316 / +70.4% 🔴 0.38 / 0.78 / -51.5%
tpch_q13/datafusion:vortex-compact 283667200 / 489016119 / -42.0% 🟢 591691227 / 535377340 / +10.5% 0.48 / 0.91 / -47.5%
tpch_q14/datafusion:vortex-compact 312466346 / 276426527 / +13.0% 494728063 / 509321043 / -2.9% 0.63 / 0.54 / +16.4%
tpch_q15/datafusion:vortex-compact 627396610 / 620961101 / +1.0% 930002740 / 881599270 / +5.5% 0.67 / 0.70 / -4.2%
tpch_q16/datafusion:vortex-compact 250933665 / 253039359 / -0.8% 478604194 / 429316181 / +11.5% 0.52 / 0.59 / -11.0%
tpch_q17/datafusion:vortex-compact 776080720 / 774905870 / +0.2% 953800694 / 955042142 / -0.1% 0.81 / 0.81 / +0.3%
tpch_q18/datafusion:vortex-compact 711293744 / 588652955 / +20.8% 815071624 / 651521731 / +25.1% 0.87 / 0.90 / -3.4%
tpch_q19/datafusion:vortex-compact 430835281 / 457692743 / -5.9% 668304318 / 724667870 / -7.8% 0.64 / 0.63 / +2.1%
tpch_q20/datafusion:vortex-compact 718341751 / 731125332 / -1.7% 952031382 / 1150336737 / -17.2% 0.75 / 0.64 / +18.7%
tpch_q21/datafusion:vortex-compact 936227733 / 1318049299 / -29.0% 983262440 / 1392298989 / -29.4% 0.95 / 0.95 / +0.6%
tpch_q22/datafusion:vortex-compact 265813693 / 262913627 / +1.1% 767665676 / 541813468 / +41.7% 🔴 0.35 / 0.49 / -28.6%
datafusion / parquet / ns (1.046x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 230138921 / 236380883 / -2.6% 686062440 / 569393629 / +20.5% 0.34 / 0.42 / -19.2%
tpch_q02/datafusion:parquet 500282778 / 431205821 / +16.0% 1107404446 / 918878074 / +20.5% 0.45 / 0.47 / -3.7%
tpch_q03/datafusion:parquet 529593335 / 421412230 / +25.7% 957328825 / 881444901 / +8.6% 0.55 / 0.48 / +15.7%
tpch_q04/datafusion:parquet 369744463 / 336431713 / +9.9% 541571751 / 475524527 / +13.9% 0.68 / 0.71 / -3.5%
tpch_q05/datafusion:parquet 600740657 / 810224560 / -25.9% 1166520179 / 1175188536 / -0.7% 0.51 / 0.69 / -25.3%
tpch_q06/datafusion:parquet 186536408 / 209110057 / -10.8% 330028644 / 312071036 / +5.8% 0.57 / 0.67 / -15.6%
tpch_q07/datafusion:parquet 676394630 / 655658720 / +3.2% 763632352 / 952651019 / -19.8% 0.89 / 0.69 / +28.7%
tpch_q08/datafusion:parquet 693410626 / 748180276 / -7.3% 957139413 / 1112396543 / -14.0% 0.72 / 0.67 / +7.7%
tpch_q09/datafusion:parquet 923991140 / 945060106 / -2.2% 1033125514 / 1242769465 / -16.9% 0.89 / 0.76 / +17.6%
tpch_q10/datafusion:parquet 1238766190 / 1083773520 / +14.3% 1272372613 / 1287039775 / -1.1% 0.97 / 0.84 / +15.6%
tpch_q11/datafusion:parquet 376069520 / 384730791 / -2.3% 569093752 / 609450531 / -6.6% 0.66 / 0.63 / +4.7%
tpch_q12/datafusion:parquet 401457392 / 396664210 / +1.2% 719147514 / 593906160 / +21.1% 0.56 / 0.67 / -16.4%
tpch_q13/datafusion:parquet 396586089 / 403430337 / -1.7% 850646125 / 715016559 / +19.0% 0.47 / 0.56 / -17.4%
tpch_q14/datafusion:parquet 412810168 / 505881420 / -18.4% 710828227 / 711234846 / -0.1% 0.58 / 0.71 / -18.4%
tpch_q15/datafusion:parquet 1673252011 / 665087084 / +151.6% 🔴 2097059264 / 931824358 / +125.0% 🔴 0.80 / 0.71 / +11.8%
tpch_q16/datafusion:parquet 214117596 / 218726695 / -2.1% 417097939 / 460622204 / -9.4% 0.51 / 0.47 / +8.1%
tpch_q17/datafusion:parquet 634755752 / 712763351 / -10.9% 934694704 / 831495521 / +12.4% 0.68 / 0.86 / -20.8%
tpch_q18/datafusion:parquet 545283133 / 548053833 / -0.5% 774894358 / 781067655 / -0.8% 0.70 / 0.70 / +0.3%
tpch_q19/datafusion:parquet 444199103 / 466140785 / -4.7% 529256753 / 645666440 / -18.0% 0.84 / 0.72 / +16.3%
tpch_q20/datafusion:parquet 678413475 / 680059365 / -0.2% 842282139 / 832031636 / +1.2% 0.81 / 0.82 / -1.5%
tpch_q21/datafusion:parquet 1121442685 / 918683939 / +22.1% 1212042214 / 1094453858 / +10.7% 0.93 / 0.84 / +10.2%
tpch_q22/datafusion:parquet 469527354 / 389781454 / +20.5% 850277029 / 716776465 / +18.6% 0.55 / 0.54 / +1.5%
duckdb / vortex-compact / ns (1.108x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1087953180 / 917037796 / +18.6% 1634576075 / 1242645399 / +31.5% 🔴 0.67 / 0.74 / -9.8%
tpch_q02/duckdb:vortex-compact 653882121 / 518424369 / +26.1% 800539607 / 638896787 / +25.3% 0.82 / 0.81 / +0.7%
tpch_q03/duckdb:vortex-compact 1250835672 / 1114833463 / +12.2% 1518157335 / 1426810254 / +6.4% 0.82 / 0.78 / +5.4%
tpch_q04/duckdb:vortex-compact 887604303 / 833298885 / +6.5% 1087833037 / 1099548242 / -1.1% 0.82 / 0.76 / +7.7%
tpch_q05/duckdb:vortex-compact 1135360302 / 929613570 / +22.1% 1622424864 / 1222480635 / +32.7% 🔴 0.70 / 0.76 / -8.0%
tpch_q06/duckdb:vortex-compact 784779366 / 734508271 / +6.8% 878789276 / 926475818 / -5.1% 0.89 / 0.79 / +12.6%
tpch_q07/duckdb:vortex-compact 1180542065 / 1076783185 / +9.6% 1430389113 / 1238418722 / +15.5% 0.83 / 0.87 / -5.1%
tpch_q08/duckdb:vortex-compact 1281583447 / 1263702710 / +1.4% 1345403512 / 1554331640 / -13.4% 0.95 / 0.81 / +17.2%
tpch_q09/duckdb:vortex-compact 1334603166 / 1340434385 / -0.4% 1547464547 / 1548431355 / -0.1% 0.86 / 0.87 / -0.4%
tpch_q10/duckdb:vortex-compact 1522043782 / 1280036348 / +18.9% 1639757052 / 1419791965 / +15.5% 0.93 / 0.90 / +3.0%
tpch_q11/duckdb:vortex-compact 452301066 / 352412816 / +28.3% 618796432 / 528731795 / +17.0% 0.73 / 0.67 / +9.7%
tpch_q12/duckdb:vortex-compact 856892202 / 837168329 / +2.4% 1029929754 / 1006286181 / +2.3% 0.83 / 0.83 / +0.0%
tpch_q13/duckdb:vortex-compact 761864195 / 704968839 / +8.1% 1061357698 / 941036966 / +12.8% 0.72 / 0.75 / -4.2%
tpch_q14/duckdb:vortex-compact 1006966891 / 899682443 / +11.9% 1034608887 / 1051532381 / -1.6% 0.97 / 0.86 / +13.8%
tpch_q15/duckdb:vortex-compact 907112292 / 770463722 / +17.7% 946930961 / 952599431 / -0.6% 0.96 / 0.81 / +18.4%
tpch_q16/duckdb:vortex-compact 297201419 / 275624021 / +7.8% 340619349 / 320665553 / +6.2% 0.87 / 0.86 / +1.5%
tpch_q17/duckdb:vortex-compact 1047633565 / 926372375 / +13.1% 1047469392 / 1399759711 / -25.2% 1.00 / 0.66 / +51.1%
tpch_q18/duckdb:vortex-compact 1048080663 / 1027214175 / +2.0% 1208161465 / 1210297165 / -0.2% 0.87 / 0.85 / +2.2%
tpch_q19/duckdb:vortex-compact 1023576133 / 1007300969 / +1.6% 1141344056 / 1133611938 / +0.7% 0.90 / 0.89 / +0.9%
tpch_q20/duckdb:vortex-compact 1080970113 / 1025159417 / +5.4% 1228516792 / 1286737497 / -4.5% 0.88 / 0.80 / +10.4%
tpch_q21/duckdb:vortex-compact 2307314942 / 2084244122 / +10.7% 2467764121 / 2350488050 / +5.0% 0.93 / 0.89 / +5.4%
tpch_q22/duckdb:vortex-compact 438884724 / 389812400 / +12.6% 617205068 / 729892715 / -15.4% 0.71 / 0.53 / +33.1%
duckdb / parquet / ns (1.082x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 433586827 / 312098424 / +38.9% 🔴 313358336 / 358459303 / -12.6% 1.38 / 0.87 / +58.9%
tpch_q02/duckdb:parquet 585007116 / 636528215 / -8.1% 651857211 / 791609034 / -17.7% 0.90 / 0.80 / +11.6%
tpch_q03/duckdb:parquet 1148807635 / 564715231 / +103.4% 🔴 1731946480 / 951276790 / +82.1% 🔴 0.66 / 0.59 / +11.7%
tpch_q04/duckdb:parquet 470340713 / 423566988 / +11.0% 572677874 / 555984055 / +3.0% 0.82 / 0.76 / +7.8%
tpch_q05/duckdb:parquet 887932992 / 715138788 / +24.2% 1091478639 / 919462716 / +18.7% 0.81 / 0.78 / +4.6%
tpch_q06/duckdb:parquet 255880883 / 512127195 / -50.0% 🟢 298264177 / 833375961 / -64.2% 🟢 0.86 / 0.61 / +39.6%
tpch_q07/duckdb:parquet 781980473 / 858420610 / -8.9% 799964756 / 949374855 / -15.7% 0.98 / 0.90 / +8.1%
tpch_q08/duckdb:parquet 1004807040 / 1019058483 / -1.4% 1141201269 / 1078132284 / +5.8% 0.88 / 0.95 / -6.8%
tpch_q09/duckdb:parquet 1037302603 / 988842062 / +4.9% 1255104761 / 1190478445 / +5.4% 0.83 / 0.83 / -0.5%
tpch_q10/duckdb:parquet 872713013 / 791907452 / +10.2% 1153516359 / 1039928428 / +10.9% 0.76 / 0.76 / -0.6%
tpch_q11/duckdb:parquet 373962707 / 343474468 / +8.9% 423912934 / 426635222 / -0.6% 0.88 / 0.81 / +9.6%
tpch_q12/duckdb:parquet 479908797 / 382892738 / +25.3% 512916277 / 523710794 / -2.1% 0.94 / 0.73 / +28.0%
tpch_q13/duckdb:parquet 643814889 / 599892871 / +7.3% 770845259 / 645951502 / +19.3% 0.84 / 0.93 / -10.1%
tpch_q14/duckdb:parquet 618681860 / 588010498 / +5.2% 570290760 / 515393602 / +10.7% 1.08 / 1.14 / -4.9%
tpch_q15/duckdb:parquet 510868119 / 366276931 / +39.5% 🔴 573028255 / 390475021 / +46.8% 🔴 0.89 / 0.94 / -5.0%
tpch_q16/duckdb:parquet 378140459 / 337498552 / +12.0% 382389902 / 351655320 / +8.7% 0.99 / 0.96 / +3.0%
tpch_q17/duckdb:parquet 602396498 / 547932539 / +9.9% 475585964 / 462923133 / +2.7% 1.27 / 1.18 / +7.0%
tpch_q18/duckdb:parquet 548660397 / 534945780 / +2.6% 539086412 / 580045288 / -7.1% 1.02 / 0.92 / +10.4%
tpch_q19/duckdb:parquet 595579178 / 611117240 / -2.5% 670772568 / 485045900 / +38.3% 🔴 0.89 / 1.26 / -29.5%
tpch_q20/duckdb:parquet 820118799 / 848851578 / -3.4% 894426100 / 881950643 / +1.4% 0.92 / 0.96 / -4.7%
tpch_q21/duckdb:parquet 850911677 / 746907767 / +13.9% 793538099 / 735078130 / +8.0% 1.07 / 1.02 / +5.5%
tpch_q22/duckdb:parquet 512099743 / 485116014 / +5.6% 518178760 / 503321755 / +3.0% 0.99 / 0.96 / +2.5%

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 2, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 2, 2026
@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 57027fbc vs base e3e7a4eb
Vortex (geomean): hot 1.009x ➖ · cold 1.027x ➖


datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44092541 / 43931760 / +0.4% 87661365 / 87760772 / -0.1% 0.50 / 0.50 / +0.5%
polarsignals_q01/datafusion:vortex-file-compressed 67749057 / 67098640 / +1.0% 112624094 / 109370490 / +3.0% 0.60 / 0.61 / -1.9%
polarsignals_q02/datafusion:vortex-file-compressed 11767821 / 11890521 / -1.0% 44816831 / 47705580 / -6.1% 0.26 / 0.25 / +5.3%
polarsignals_q03/datafusion:vortex-file-compressed 54777990 / 54983087 / -0.4% 114728110 / 110543474 / +3.8% 0.48 / 0.50 / -4.0%
polarsignals_q04/datafusion:vortex-file-compressed 9305014 / 9336401 / -0.3% 41134918 / 38007855 / +8.2% 0.23 / 0.25 / -7.9%
polarsignals_q05/datafusion:vortex-file-compressed 11490592 / 11501107 / -0.1% 44831221 / 42460459 / +5.6% 0.26 / 0.27 / -5.4%
polarsignals_q06/datafusion:vortex-file-compressed 22943230 / 22719728 / +1.0% 54285446 / 54752234 / -0.9% 0.42 / 0.41 / +1.9%
polarsignals_q07/datafusion:vortex-file-compressed 10527176 / 10468380 / +0.6% 42730112 / 42494271 / +0.6% 0.25 / 0.25 / +0.0%
polarsignals_q08/datafusion:vortex-file-compressed 104541408 / 98068349 / +6.6% 173705467 / 155566810 / +11.7% 🔴 0.60 / 0.63 / -4.5%
polarsignals_q09/datafusion:vortex-file-compressed 10269863 / 10077005 / +1.9% 42064082 / 40938807 / +2.7% 0.24 / 0.25 / -0.8%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-1.9%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.032x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.014x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.981x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15844764 / 15606834 / +1.5% 41532594 / 40977347 / +1.4% 0.38 / 0.38 / +0.2%
tpch_q02/datafusion:vortex-file-compressed 16718476 / 16743803 / -0.2% 34605613 / 33905955 / +2.1% 0.48 / 0.49 / -2.2%
tpch_q03/datafusion:vortex-file-compressed 19372472 / 19517273 / -0.7% 47905000 / 44071292 / +8.7% 0.40 / 0.44 / -8.7%
tpch_q04/datafusion:vortex-file-compressed 10485648 / 11024424 / -4.9% 34714066 / 31850124 / +9.0% 0.30 / 0.35 / -12.7%
tpch_q05/datafusion:vortex-file-compressed 36783373 / 37008335 / -0.6% 69235268 / 65352333 / +5.9% 0.53 / 0.57 / -6.2%
tpch_q06/datafusion:vortex-file-compressed 4133148 / 5831370 / -29.1% 🟢 27714359 / 25468122 / +8.8% 0.15 / 0.23 / -34.9%
tpch_q07/datafusion:vortex-file-compressed 50982851 / 50450484 / +1.1% 79412089 / 78418366 / +1.3% 0.64 / 0.64 / -0.2%
tpch_q08/datafusion:vortex-file-compressed 51811990 / 52036109 / -0.4% 83363925 / 81696404 / +2.0% 0.62 / 0.64 / -2.4%
tpch_q09/datafusion:vortex-file-compressed 47921324 / 47252639 / +1.4% 79747925 / 76287825 / +4.5% 0.60 / 0.62 / -3.0%
tpch_q10/datafusion:vortex-file-compressed 17080939 / 17294797 / -1.2% 50578769 / 47291140 / +7.0% 0.34 / 0.37 / -7.7%
tpch_q11/datafusion:vortex-file-compressed 14047003 / 13992959 / +0.4% 33464855 / 32617568 / +2.6% 0.42 / 0.43 / -2.2%
tpch_q12/datafusion:vortex-file-compressed 18469823 / 18522825 / -0.3% 43588322 / 40759194 / +6.9% 0.42 / 0.45 / -6.8%
tpch_q13/datafusion:vortex-file-compressed 19165768 / 19327421 / -0.8% 38995841 / 39335549 / -0.9% 0.49 / 0.49 / +0.0%
tpch_q14/datafusion:vortex-file-compressed 14609660 / 14413585 / +1.4% 36758136 / 34343875 / +7.0% 0.40 / 0.42 / -5.3%
tpch_q15/datafusion:vortex-file-compressed 18815684 / 18886499 / -0.4% 42763907 / 41085406 / +4.1% 0.44 / 0.46 / -4.3%
tpch_q16/datafusion:vortex-file-compressed 18299571 / 18619503 / -1.7% 37590796 / 38439254 / -2.2% 0.49 / 0.48 / +0.5%
tpch_q17/datafusion:vortex-file-compressed 28070048 / 27747221 / +1.2% 61241282 / 57835139 / +5.9% 0.46 / 0.48 / -4.5%
tpch_q18/datafusion:vortex-file-compressed 35423489 / 35656035 / -0.7% 59739684 / 59663009 / +0.1% 0.59 / 0.60 / -0.8%
tpch_q19/datafusion:vortex-file-compressed 11618721 / 11487727 / +1.1% 37056278 / 37083640 / -0.1% 0.31 / 0.31 / +1.2%
tpch_q20/datafusion:vortex-file-compressed 20184591 / 20156301 / +0.1% 45090481 / 41063403 / +9.8% 0.45 / 0.49 / -8.8%
tpch_q21/datafusion:vortex-file-compressed 39003391 / 39374076 / -0.9% 70804895 / 69103224 / +2.5% 0.55 / 0.57 / -3.3%
tpch_q22/datafusion:vortex-file-compressed 10610058 / 10857321 / -2.3% 30674895 / 28934415 / +6.0% 0.35 / 0.38 / -7.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71545010 / 71429034 / +0.2% 89283403 / 85012595 / +5.0% 0.80 / 0.84 / -4.6%
tpch_q02/datafusion:parquet 75526770 / 76510196 / -1.3% 91273932 / 92141672 / -0.9% 0.83 / 0.83 / -0.3%
tpch_q03/datafusion:parquet 81630081 / 82027227 / -0.5% 104098046 / 102451813 / +1.6% 0.78 / 0.80 / -2.1%
tpch_q04/datafusion:parquet 39327850 / 39374266 / -0.1% 58386200 / 56219353 / +3.9% 0.67 / 0.70 / -3.8%
tpch_q05/datafusion:parquet 110315136 / 110706098 / -0.4% 136236980 / 133201812 / +2.3% 0.81 / 0.83 / -2.6%
tpch_q06/datafusion:parquet 31504429 / 31325622 / +0.6% 47162748 / 46029345 / +2.5% 0.67 / 0.68 / -1.8%
tpch_q07/datafusion:parquet 112825746 / 113135471 / -0.3% 138790229 / 135722594 / +2.3% 0.81 / 0.83 / -2.5%
tpch_q08/datafusion:parquet 116908272 / 117236658 / -0.3% 142791799 / 140448253 / +1.7% 0.82 / 0.83 / -1.9%
tpch_q09/datafusion:parquet 137376490 / 137264892 / +0.1% 165919209 / 163400857 / +1.5% 0.83 / 0.84 / -1.4%
tpch_q10/datafusion:parquet 103259948 / 103003805 / +0.2% 126402333 / 124363032 / +1.6% 0.82 / 0.83 / -1.4%
tpch_q11/datafusion:parquet 61990032 / 61169448 / +1.3% 81352405 / 80841141 / +0.6% 0.76 / 0.76 / +0.7%
tpch_q12/datafusion:parquet 63273010 / 64170949 / -1.4% 83958409 / 82291764 / +2.0% 0.75 / 0.78 / -3.4%
tpch_q13/datafusion:parquet 143383777 / 143508193 / -0.1% 163650283 / 159967764 / +2.3% 0.88 / 0.90 / -2.3%
tpch_q14/datafusion:parquet 47678460 / 47599355 / +0.2% 67974382 / 65507004 / +3.8% 0.70 / 0.73 / -3.5%
tpch_q15/datafusion:parquet 73207655 / 73861604 / -0.9% 92652868 / 91121777 / +1.7% 0.79 / 0.81 / -2.5%
tpch_q16/datafusion:parquet 42997971 / 43445611 / -1.0% 60935966 / 60816428 / +0.2% 0.71 / 0.71 / -1.2%
tpch_q17/datafusion:parquet 123294333 / 123419841 / -0.1% 145822120 / 144817260 / +0.7% 0.85 / 0.85 / -0.8%
tpch_q18/datafusion:parquet 120774279 / 120960924 / -0.2% 143819647 / 139093100 / +3.4% 0.84 / 0.87 / -3.4%
tpch_q19/datafusion:parquet 57523472 / 56347368 / +2.1% 80200186 / 81151617 / -1.2% 0.72 / 0.69 / +3.3%
tpch_q20/datafusion:parquet 78506394 / 77819071 / +0.9% 102858764 / 100323040 / +2.5% 0.76 / 0.78 / -1.6%
tpch_q21/datafusion:parquet 113617334 / 113782248 / -0.1% 138268031 / 137691926 / +0.4% 0.82 / 0.83 / -0.6%
tpch_q22/datafusion:parquet 52168081 / 51552673 / +1.2% 67471059 / 67489377 / -0.0% 0.77 / 0.76 / +1.2%
duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9570885 / 9102704 / +5.1% 19133839 / 17558917 / +9.0% 0.50 / 0.52 / -3.5%
tpch_q02/duckdb:vortex-file-compressed 15126645 / 15213750 / -0.6% 25528313 / 24783233 / +3.0% 0.59 / 0.61 / -3.5%
tpch_q03/duckdb:vortex-file-compressed 18863779 / 18815604 / +0.3% 34388379 / 34951037 / -1.6% 0.55 / 0.54 / +1.9%
tpch_q04/duckdb:vortex-file-compressed 12515663 / 12359727 / +1.3% 26515416 / 25827467 / +2.7% 0.47 / 0.48 / -1.4%
tpch_q05/duckdb:vortex-file-compressed 20658425 / 19550128 / +5.7% 36902971 / 35868757 / +2.9% 0.56 / 0.55 / +2.7%
tpch_q06/duckdb:vortex-file-compressed 4834714 / 4715756 / +2.5% 14542945 / 14604783 / -0.4% 0.33 / 0.32 / +3.0%
tpch_q07/duckdb:vortex-file-compressed 24171036 / 24622675 / -1.8% 39621212 / 38515083 / +2.9% 0.61 / 0.64 / -4.6%
tpch_q08/duckdb:vortex-file-compressed 21615680 / 20940125 / +3.2% 36346292 / 37192243 / -2.3% 0.59 / 0.56 / +5.6%
tpch_q09/duckdb:vortex-file-compressed 22511326 / 21935465 / +2.6% 40428063 / 38589831 / +4.8% 0.56 / 0.57 / -2.0%
tpch_q10/duckdb:vortex-file-compressed 22769827 / 22463541 / +1.4% 39338924 / 39149283 / +0.5% 0.58 / 0.57 / +0.9%
tpch_q11/duckdb:vortex-file-compressed 8067573 / 8107904 / -0.5% 17503359 / 17109682 / +2.3% 0.46 / 0.47 / -2.7%
tpch_q12/duckdb:vortex-file-compressed 14917699 / 14570129 / +2.4% 26761008 / 25855682 / +3.5% 0.56 / 0.56 / -1.1%
tpch_q13/duckdb:vortex-file-compressed 19581745 / 19595341 / -0.1% 32785618 / 31547275 / +3.9% 0.60 / 0.62 / -3.8%
tpch_q14/duckdb:vortex-file-compressed 11204892 / 11340419 / -1.2% 25217945 / 24328111 / +3.7% 0.44 / 0.47 / -4.7%
tpch_q15/duckdb:vortex-file-compressed 8644043 / 8396391 / +2.9% 20294366 / 20426115 / -0.6% 0.43 / 0.41 / +3.6%
tpch_q16/duckdb:vortex-file-compressed 16604624 / 16693888 / -0.5% 23232465 / 22605413 / +2.8% 0.71 / 0.74 / -3.2%
tpch_q17/duckdb:vortex-file-compressed 12689411 / 12657266 / +0.3% 28473761 / 27321772 / +4.2% 0.45 / 0.46 / -3.8%
tpch_q18/duckdb:vortex-file-compressed 24092088 / 23985904 / +0.4% 34291212 / 33611999 / +2.0% 0.70 / 0.71 / -1.5%
tpch_q19/duckdb:vortex-file-compressed 11789065 / 11764050 / +0.2% 27446704 / 28093657 / -2.3% 0.43 / 0.42 / +2.6%
tpch_q20/duckdb:vortex-file-compressed 14781244 / 14223089 / +3.9% 31254226 / 30298891 / +3.2% 0.47 / 0.47 / +0.7%
tpch_q21/duckdb:vortex-file-compressed 37446247 / 36915425 / +1.4% 57081168 / 56021908 / +1.9% 0.66 / 0.66 / -0.4%
tpch_q22/duckdb:vortex-file-compressed 16743245 / 16679454 / +0.4% 26981540 / 26176772 / +3.1% 0.62 / 0.64 / -2.6%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47546604 / 47568370 / -0.0% 54194874 / 53830805 / +0.7% 0.88 / 0.88 / -0.7%
tpch_q02/duckdb:parquet 48270637 / 48329340 / -0.1% 55500687 / 55319753 / +0.3% 0.87 / 0.87 / -0.4%
tpch_q03/duckdb:parquet 60317375 / 59997886 / +0.5% 68552203 / 67206638 / +2.0% 0.88 / 0.89 / -1.4%
tpch_q04/duckdb:parquet 34653034 / 34773771 / -0.3% 43479669 / 42562062 / +2.2% 0.80 / 0.82 / -2.5%
tpch_q05/duckdb:parquet 67003644 / 67129183 / -0.2% 77705581 / 77275794 / +0.6% 0.86 / 0.87 / -0.7%
tpch_q06/duckdb:parquet 21745502 / 21605472 / +0.6% 28363866 / 26971759 / +5.2% 0.77 / 0.80 / -4.3%
tpch_q07/duckdb:parquet 63895092 / 63901817 / -0.0% 74417318 / 73063960 / +1.9% 0.86 / 0.87 / -1.8%
tpch_q08/duckdb:parquet 75968018 / 75522038 / +0.6% 86674694 / 86388767 / +0.3% 0.88 / 0.87 / +0.3%
tpch_q09/duckdb:parquet 107761556 / 106810390 / +0.9% 118893024 / 118828847 / +0.1% 0.91 / 0.90 / +0.8%
tpch_q10/duckdb:parquet 106062302 / 105522969 / +0.5% 117291706 / 116402645 / +0.8% 0.90 / 0.91 / -0.3%
tpch_q11/duckdb:parquet 29370551 / 29199745 / +0.6% 34722044 / 35148524 / -1.2% 0.85 / 0.83 / +1.8%
tpch_q12/duckdb:parquet 37180073 / 37120537 / +0.2% 44434200 / 43539567 / +2.1% 0.84 / 0.85 / -1.9%
tpch_q13/duckdb:parquet 174972804 / 174363675 / +0.3% 182268086 / 181038362 / +0.7% 0.96 / 0.96 / -0.3%
tpch_q14/duckdb:parquet 42406051 / 42423027 / -0.0% 51717217 / 51210722 / +1.0% 0.82 / 0.83 / -1.0%
tpch_q15/duckdb:parquet 32782798 / 32551871 / +0.7% 41302827 / 41147909 / +0.4% 0.79 / 0.79 / +0.3%
tpch_q16/duckdb:parquet 47735233 / 46696967 / +2.2% 53152792 / 52182059 / +1.9% 0.90 / 0.89 / +0.4%
tpch_q17/duckdb:parquet 48173972 / 47894656 / +0.6% 57508820 / 57347292 / +0.3% 0.84 / 0.84 / +0.3%
tpch_q18/duckdb:parquet 74521440 / 73775421 / +1.0% 82380002 / 80205896 / +2.7% 0.90 / 0.92 / -1.7%
tpch_q19/duckdb:parquet 49109848 / 47726448 / +2.9% 58009363 / 58938889 / -1.6% 0.85 / 0.81 / +4.5%
tpch_q20/duckdb:parquet 63471551 / 63693606 / -0.3% 73837152 / 72802043 / +1.4% 0.86 / 0.87 / -1.7%
tpch_q21/duckdb:parquet 106690135 / 106304050 / +0.4% 115923023 / 113835026 / +1.8% 0.92 / 0.93 / -1.4%
tpch_q22/duckdb:parquet 50624244 / 50349974 / +0.5% 59049081 / 57666857 / +2.4% 0.86 / 0.87 / -1.8%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (-3.4%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 0.982x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.973x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6089041 / 6081771 / +0.1% 19272303 / 21506835 / -10.4% 🟢 0.32 / 0.28 / +11.7%
fineweb_q01/datafusion:vortex-file-compressed 9110094 / 9425930 / -3.4% 39439201 / 39948743 / -1.3% 0.23 / 0.24 / -2.1%
fineweb_q02/datafusion:vortex-file-compressed 10832442 / 11566887 / -6.3% 38091340 / 39388823 / -3.3% 0.28 / 0.29 / -3.2%
fineweb_q03/datafusion:vortex-file-compressed 17405289 / 18528552 / -6.1% 96918459 / 104815244 / -7.5% 0.18 / 0.18 / +1.6%
fineweb_q04/datafusion:vortex-file-compressed 65914734 / 65100626 / +1.3% 140544980 / 141044260 / -0.4% 0.47 / 0.46 / +1.6%
fineweb_q05/datafusion:vortex-file-compressed 64686922 / 63698174 / +1.6% 141756106 / 136164858 / +4.1% 0.46 / 0.47 / -2.5%
fineweb_q06/datafusion:vortex-file-compressed 17329966 / 18444629 / -6.0% 97185521 / 100605806 / -3.4% 0.18 / 0.18 / -2.7%
fineweb_q07/datafusion:vortex-file-compressed 17656038 / 17665174 / -0.1% 97991479 / 98784987 / -0.8% 0.18 / 0.18 / +0.8%
fineweb_q08/datafusion:vortex-file-compressed 10514548 / 11093226 / -5.2% 29305907 / 26717903 / +9.7% 0.36 / 0.42 / -13.6%
datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9479646 / 9445881 / +0.4% 33304207 / 35756574 / -6.9% 0.28 / 0.26 / +7.7%
fineweb_q01/datafusion:parquet 75198448 / 73776822 / +1.9% 150665533 / 143715891 / +4.8% 0.50 / 0.51 / -2.8%
fineweb_q02/datafusion:parquet 74813898 / 74944838 / -0.2% 147542533 / 149250453 / -1.1% 0.51 / 0.50 / +1.0%
fineweb_q03/datafusion:parquet 73582206 / 74953016 / -1.8% 144213942 / 143231311 / +0.7% 0.51 / 0.52 / -2.5%
fineweb_q04/datafusion:parquet 83295237 / 82510514 / +1.0% 144859336 / 150615871 / -3.8% 0.58 / 0.55 / +5.0%
fineweb_q05/datafusion:parquet 82569461 / 80879871 / +2.1% 146168624 / 140893931 / +3.7% 0.56 / 0.57 / -1.6%
fineweb_q06/datafusion:parquet 75653268 / 74536840 / +1.5% 147499671 / 152689177 / -3.4% 0.51 / 0.49 / +5.1%
fineweb_q07/datafusion:parquet 73923232 / 73961480 / -0.1% 153024136 / 144583470 / +5.8% 0.48 / 0.51 / -5.6%
fineweb_q08/datafusion:parquet 75550202 / 74136670 / +1.9% 148516401 / 146360956 / +1.5% 0.51 / 0.51 / +0.4%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2194380 / 2060638 / +6.5% 7208660 / 8175883 / -11.8% 🟢 0.30 / 0.25 / +20.8%
fineweb_q01/duckdb:vortex-file-compressed 7920050 / 7604186 / +4.2% 25925589 / 27023724 / -4.1% 0.31 / 0.28 / +8.6%
fineweb_q02/duckdb:vortex-file-compressed 9535388 / 9617484 / -0.9% 27800832 / 26925940 / +3.2% 0.34 / 0.36 / -4.0%
fineweb_q03/duckdb:vortex-file-compressed 19025570 / 19454330 / -2.2% 88293276 / 88874344 / -0.7% 0.22 / 0.22 / -1.6%
fineweb_q04/duckdb:vortex-file-compressed 64822818 / 65204338 / -0.6% 102473640 / 102939973 / -0.5% 0.63 / 0.63 / -0.1%
fineweb_q05/duckdb:vortex-file-compressed 64548769 / 65348452 / -1.2% 102549069 / 102333124 / +0.2% 0.63 / 0.64 / -1.4%
fineweb_q06/duckdb:vortex-file-compressed 18461101 / 17975647 / +2.7% 86139419 / 88366982 / -2.5% 0.21 / 0.20 / +5.4%
fineweb_q07/duckdb:vortex-file-compressed 17688069 / 18826118 / -6.0% 86257644 / 87020629 / -0.9% 0.21 / 0.22 / -5.2%
fineweb_q08/duckdb:vortex-file-compressed 5032051 / 4882117 / +3.1% 12875760 / 12923910 / -0.4% 0.39 / 0.38 / +3.5%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23792737 / 23660946 / +0.6% 27548944 / 27861332 / -1.1% 0.86 / 0.85 / +1.7%
fineweb_q01/duckdb:parquet 55182420 / 54069339 / +2.1% 73632718 / 69758151 / +5.6% 0.75 / 0.78 / -3.3%
fineweb_q02/duckdb:parquet 59021453 / 58759396 / +0.4% 78199997 / 74218713 / +5.4% 0.75 / 0.79 / -4.7%
fineweb_q03/duckdb:parquet 118515267 / 118385959 / +0.1% 177396798 / 178494225 / -0.6% 0.67 / 0.66 / +0.7%
fineweb_q04/duckdb:parquet 160492170 / 162392902 / -1.2% 205350255 / 201669774 / +1.8% 0.78 / 0.81 / -2.9%
fineweb_q05/duckdb:parquet 157339106 / 158225448 / -0.6% 200840817 / 197729378 / +1.6% 0.78 / 0.80 / -2.1%
fineweb_q06/duckdb:parquet 88745154 / 89978513 / -1.4% 141763091 / 145808758 / -2.8% 0.63 / 0.62 / +1.4%
fineweb_q07/duckdb:parquet 91436466 / 90363170 / +1.2% 144204691 / 145706304 / -1.0% 0.63 / 0.62 / +2.2%
fineweb_q08/duckdb:parquet 28988548 / 28922509 / +0.2% 30396327 / 30555260 / -0.5% 0.95 / 0.95 / +0.8%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.952x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.976x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92646995 / 92712359 / -0.1% 153432923 / 155579151 / -1.4% 0.60 / 0.60 / +1.3%
tpch_q02/datafusion:vortex-file-compressed 64661852 / 64998074 / -0.5% 98458853 / 94493034 / +4.2% 0.66 / 0.69 / -4.5%
tpch_q03/datafusion:vortex-file-compressed 62452378 / 63502104 / -1.7% 116051433 / 126151877 / -8.0% 0.54 / 0.50 / +6.9%
tpch_q04/datafusion:vortex-file-compressed 33847094 / 34722523 / -2.5% 68515619 / 75409397 / -9.1% 0.49 / 0.46 / +7.3%
tpch_q05/datafusion:vortex-file-compressed 117663992 / 117971569 / -0.3% 171487811 / 180298687 / -4.9% 0.69 / 0.65 / +4.9%
tpch_q06/datafusion:vortex-file-compressed 10092789 / 10866916 / -7.1% 55356261 / 62118356 / -10.9% 🟢 0.18 / 0.17 / +4.2%
tpch_q07/datafusion:vortex-file-compressed 133068477 / 132873720 / +0.1% 204026463 / 195040719 / +4.6% 0.65 / 0.68 / -4.3%
tpch_q08/datafusion:vortex-file-compressed 141931631 / 142499520 / -0.4% 214052366 / 227961819 / -6.1% 0.66 / 0.63 / +6.1%
tpch_q09/datafusion:vortex-file-compressed 182967835 / 185791437 / -1.5% 268335693 / 262567029 / +2.2% 0.68 / 0.71 / -3.6%
tpch_q10/datafusion:vortex-file-compressed 68698097 / 69896914 / -1.7% 129321389 / 139155497 / -7.1% 0.53 / 0.50 / +5.8%
tpch_q11/datafusion:vortex-file-compressed 43157439 / 43601448 / -1.0% 65937833 / 69597954 / -5.3% 0.65 / 0.63 / +4.5%
tpch_q12/datafusion:vortex-file-compressed 34785549 / 34788290 / -0.0% 75190741 / 81550881 / -7.8% 0.46 / 0.43 / +8.5%
tpch_q13/datafusion:vortex-file-compressed 49197888 / 47722155 / +3.1% 75783921 / 84006778 / -9.8% 0.65 / 0.57 / +14.3%
tpch_q14/datafusion:vortex-file-compressed 20734688 / 21143428 / -1.9% 84157521 / 85589519 / -1.7% 0.25 / 0.25 / -0.3%
tpch_q15/datafusion:vortex-file-compressed 33514391 / 33680405 / -0.5% 91126786 / 91931205 / -0.9% 0.37 / 0.37 / +0.4%
tpch_q16/datafusion:vortex-file-compressed 37060768 / 37104745 / -0.1% 61493326 / 64098060 / -4.1% 0.60 / 0.58 / +4.1%
tpch_q17/datafusion:vortex-file-compressed 176095486 / 178847149 / -1.5% 220615271 / 232335888 / -5.0% 0.80 / 0.77 / +3.7%
tpch_q18/datafusion:vortex-file-compressed 205900711 / 204601998 / +0.6% 266187365 / 278564558 / -4.4% 0.77 / 0.73 / +5.3%
tpch_q19/datafusion:vortex-file-compressed 30147050 / 30671682 / -1.7% 87286424 / 87770960 / -0.6% 0.35 / 0.35 / -1.2%
tpch_q20/datafusion:vortex-file-compressed 59079755 / 60611620 / -2.5% 119022257 / 119965325 / -0.8% 0.50 / 0.51 / -1.8%
tpch_q21/datafusion:vortex-file-compressed 179624008 / 178468910 / +0.6% 239418381 / 244291010 / -2.0% 0.75 / 0.73 / +2.7%
tpch_q22/datafusion:vortex-file-compressed 25285940 / 25202027 / +0.3% 51849088 / 52505379 / -1.2% 0.49 / 0.48 / +1.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87422232 / 86930274 / +0.6% 122245620 / 129197942 / -5.4% 0.72 / 0.67 / +6.3%
tpch_q02/datafusion:parquet 172690472 / 173162246 / -0.3% 200528249 / 200544839 / -0.0% 0.86 / 0.86 / -0.3%
tpch_q03/datafusion:parquet 134410450 / 134615206 / -0.2% 179255526 / 187479051 / -4.4% 0.75 / 0.72 / +4.4%
tpch_q04/datafusion:parquet 57017651 / 57360711 / -0.6% 88319656 / 97242167 / -9.2% 0.65 / 0.59 / +9.4%
tpch_q05/datafusion:parquet 164627511 / 167314852 / -1.6% 213945402 / 226466897 / -5.5% 0.77 / 0.74 / +4.2%
tpch_q06/datafusion:parquet 36762243 / 36452283 / +0.9% 72929764 / 77868492 / -6.3% 0.50 / 0.47 / +7.7%
tpch_q07/datafusion:parquet 214955805 / 214809269 / +0.1% 260795268 / 267366936 / -2.5% 0.82 / 0.80 / +2.6%
tpch_q08/datafusion:parquet 219817826 / 218678416 / +0.5% 279881197 / 293093121 / -4.5% 0.79 / 0.75 / +5.3%
tpch_q09/datafusion:parquet 308026922 / 309815205 / -0.6% 373085671 / 381379603 / -2.2% 0.83 / 0.81 / +1.6%
tpch_q10/datafusion:parquet 312686214 / 312320112 / +0.1% 367627166 / 373079659 / -1.5% 0.85 / 0.84 / +1.6%
tpch_q11/datafusion:parquet 127085078 / 126696322 / +0.3% 146529606 / 153052404 / -4.3% 0.87 / 0.83 / +4.8%
tpch_q12/datafusion:parquet 82442550 / 82652551 / -0.3% 114683908 / 122846137 / -6.6% 0.72 / 0.67 / +6.8%
tpch_q13/datafusion:parquet 209976459 / 210450787 / -0.2% 237238105 / 247055550 / -4.0% 0.89 / 0.85 / +3.9%
tpch_q14/datafusion:parquet 85685651 / 86768341 / -1.2% 181396143 / 186217635 / -2.6% 0.47 / 0.47 / +1.4%
tpch_q15/datafusion:parquet 105740312 / 105116914 / +0.6% 152511403 / 157766209 / -3.3% 0.69 / 0.67 / +4.1%
tpch_q16/datafusion:parquet 95376258 / 95958138 / -0.6% 119460014 / 125595225 / -4.9% 0.80 / 0.76 / +4.5%
tpch_q17/datafusion:parquet 215299930 / 214442711 / +0.4% 258251832 / 266035143 / -2.9% 0.83 / 0.81 / +3.4%
tpch_q18/datafusion:parquet 268808359 / 269029755 / -0.1% 310607261 / 315632987 / -1.6% 0.87 / 0.85 / +1.5%
tpch_q19/datafusion:parquet 108195260 / 108088106 / +0.1% 160779432 / 170849163 / -5.9% 0.67 / 0.63 / +6.4%
tpch_q20/datafusion:parquet 185431658 / 185198278 / +0.1% 239155363 / 245174702 / -2.5% 0.78 / 0.76 / +2.6%
tpch_q21/datafusion:parquet 244781628 / 244416050 / +0.1% 304629922 / 307604428 / -1.0% 0.80 / 0.79 / +1.1%
tpch_q22/datafusion:parquet 149950443 / 149783339 / +0.1% 170533649 / 174738178 / -2.4% 0.88 / 0.86 / +2.6%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33176720 / 33191072 / -0.0% 62278532 / 68163061 / -8.6% 0.53 / 0.49 / +9.4%
tpch_q02/duckdb:vortex-file-compressed 28407281 / 28504029 / -0.3% 42104295 / 43114464 / -2.3% 0.67 / 0.66 / +2.1%
tpch_q03/duckdb:vortex-file-compressed 52984961 / 53150089 / -0.3% 97009028 / 103163895 / -6.0% 0.55 / 0.52 / +6.0%
tpch_q04/duckdb:vortex-file-compressed 51455872 / 51927219 / -0.9% 81894225 / 93007723 / -11.9% 🟢 0.63 / 0.56 / +12.5%
tpch_q05/duckdb:vortex-file-compressed 68050456 / 68156695 / -0.2% 107527676 / 111563186 / -3.6% 0.63 / 0.61 / +3.6%
tpch_q06/duckdb:vortex-file-compressed 15475251 / 15611965 / -0.9% 46812869 / 52879034 / -11.5% 🟢 0.33 / 0.30 / +12.0%
tpch_q07/duckdb:vortex-file-compressed 56089783 / 55558345 / +1.0% 99387036 / 106752180 / -6.9% 0.56 / 0.52 / +8.4%
tpch_q08/duckdb:vortex-file-compressed 88434397 / 87952479 / +0.5% 126770401 / 135217735 / -6.2% 0.70 / 0.65 / +7.2%
tpch_q09/duckdb:vortex-file-compressed 102991398 / 103296253 / -0.3% 151180435 / 161268031 / -6.3% 0.68 / 0.64 / +6.4%
tpch_q10/duckdb:vortex-file-compressed 96849793 / 96471530 / +0.4% 143317691 / 145471611 / -1.5% 0.68 / 0.66 / +1.9%
tpch_q11/duckdb:vortex-file-compressed 13251678 / 13405238 / -1.1% 28084624 / 28114186 / -0.1% 0.47 / 0.48 / -1.0%
tpch_q12/duckdb:vortex-file-compressed 44763864 / 45060033 / -0.7% 75082776 / 80653584 / -6.9% 0.60 / 0.56 / +6.7%
tpch_q13/duckdb:vortex-file-compressed 71517218 / 71463172 / +0.1% 95870119 / 102416703 / -6.4% 0.75 / 0.70 / +6.9%
tpch_q14/duckdb:vortex-file-compressed 28053504 / 28421832 / -1.3% 69960764 / 72865379 / -4.0% 0.40 / 0.39 / +2.8%
tpch_q15/duckdb:vortex-file-compressed 24895050 / 25085745 / -0.8% 58590894 / 62993253 / -7.0% 0.42 / 0.40 / +6.7%
tpch_q16/duckdb:vortex-file-compressed 48642940 / 49581931 / -1.9% 57221102 / 58163048 / -1.6% 0.85 / 0.85 / -0.3%
tpch_q17/duckdb:vortex-file-compressed 34953962 / 35256272 / -0.9% 63744246 / 69133494 / -7.8% 0.55 / 0.51 / +7.5%
tpch_q18/duckdb:vortex-file-compressed 107488014 / 107064891 / +0.4% 121165411 / 126717014 / -4.4% 0.89 / 0.84 / +5.0%
tpch_q19/duckdb:vortex-file-compressed 27304736 / 27845227 / -1.9% 72390563 / 79844815 / -9.3% 0.38 / 0.35 / +8.2%
tpch_q20/duckdb:vortex-file-compressed 41993323 / 42327045 / -0.8% 86860792 / 93808791 / -7.4% 0.48 / 0.45 / +7.1%
tpch_q21/duckdb:vortex-file-compressed 95106761 / 96190633 / -1.1% 140986928 / 150237639 / -6.2% 0.67 / 0.64 / +5.4%
tpch_q22/duckdb:vortex-file-compressed 32822287 / 33339479 / -1.6% 46834676 / 48404514 / -3.2% 0.70 / 0.69 / +1.7%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67278547 / 67488522 / -0.3% 87195106 / 87994521 / -0.9% 0.77 / 0.77 / +0.6%
tpch_q02/duckdb:parquet 86418497 / 87150720 / -0.8% 95180568 / 97640418 / -2.5% 0.91 / 0.89 / +1.7%
tpch_q03/duckdb:parquet 109818979 / 109891372 / -0.1% 141111424 / 144768408 / -2.5% 0.78 / 0.76 / +2.5%
tpch_q04/duckdb:parquet 76850908 / 76718478 / +0.2% 98187817 / 100403176 / -2.2% 0.78 / 0.76 / +2.4%
tpch_q05/duckdb:parquet 126371063 / 124220963 / +1.7% 157611927 / 156529881 / +0.7% 0.80 / 0.79 / +1.0%
tpch_q06/duckdb:parquet 34971326 / 35381091 / -1.2% 57514678 / 59598034 / -3.5% 0.61 / 0.59 / +2.4%
tpch_q07/duckdb:parquet 120075130 / 116753165 / +2.8% 155431142 / 153761131 / +1.1% 0.77 / 0.76 / +1.7%
tpch_q08/duckdb:parquet 148700615 / 147621649 / +0.7% 192526652 / 192203967 / +0.2% 0.77 / 0.77 / +0.6%
tpch_q09/duckdb:parquet 237940766 / 236951307 / +0.4% 280634914 / 280167328 / +0.2% 0.85 / 0.85 / +0.3%
tpch_q10/duckdb:parquet 313090714 / 313709777 / -0.2% 335855746 / 338881273 / -0.9% 0.93 / 0.93 / +0.7%
tpch_q11/duckdb:parquet 43493591 / 43453207 / +0.1% 50341759 / 50598502 / -0.5% 0.86 / 0.86 / +0.6%
tpch_q12/duckdb:parquet 70489944 / 70614976 / -0.2% 90855471 / 92966048 / -2.3% 0.78 / 0.76 / +2.1%
tpch_q13/duckdb:parquet 292848417 / 292028125 / +0.3% 308564370 / 309657130 / -0.4% 0.95 / 0.94 / +0.6%
tpch_q14/duckdb:parquet 101024720 / 101195889 / -0.2% 138968851 / 139757131 / -0.6% 0.73 / 0.72 / +0.4%
tpch_q15/duckdb:parquet 57517197 / 56804838 / +1.3% 87340067 / 88570061 / -1.4% 0.66 / 0.64 / +2.7%
tpch_q16/duckdb:parquet 100286455 / 100534813 / -0.2% 106374782 / 107531818 / -1.1% 0.94 / 0.93 / +0.8%
tpch_q17/duckdb:parquet 81884547 / 83144052 / -1.5% 112794717 / 116042379 / -2.8% 0.73 / 0.72 / +1.3%
tpch_q18/duckdb:parquet 157970787 / 155056716 / +1.9% 177484242 / 170916811 / +3.8% 0.89 / 0.91 / -1.9%
tpch_q19/duckdb:parquet 97504264 / 98078605 / -0.6% 131704795 / 130833441 / +0.7% 0.74 / 0.75 / -1.2%
tpch_q20/duckdb:parquet 146898647 / 146774743 / +0.1% 183122964 / 187425875 / -2.3% 0.80 / 0.78 / +2.4%
tpch_q21/duckdb:parquet 251769997 / 254432944 / -1.0% 279342963 / 284546267 / -1.8% 0.90 / 0.89 / +0.8%
tpch_q22/duckdb:parquet 168211196 / 168348134 / -0.1% 179320250 / 180384896 / -0.6% 0.94 / 0.93 / +0.5%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.973x ➖
Parquet (geomean): hot 1.005x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21241873 / 21035242 / +1.0% 38322249 / 38730397 / -1.1% 0.55 / 0.54 / +2.1%
tpcds_q02/datafusion:vortex-file-compressed 43176836 / 43870746 / -1.6% 63619463 / 65711367 / -3.2% 0.68 / 0.67 / +1.7%
tpcds_q03/datafusion:vortex-file-compressed 10975375 / 11157016 / -1.6% 27120277 / 28477564 / -4.8% 0.40 / 0.39 / +3.3%
tpcds_q04/datafusion:vortex-file-compressed 86781838 / 87254702 / -0.5% 118601678 / 118792465 / -0.2% 0.73 / 0.73 / -0.4%
tpcds_q05/datafusion:vortex-file-compressed 56102304 / 55982656 / +0.2% 76349054 / 77879496 / -2.0% 0.73 / 0.72 / +2.2%
tpcds_q06/datafusion:vortex-file-compressed 22627900 / 22558667 / +0.3% 41154193 / 43375315 / -5.1% 0.55 / 0.52 / +5.7%
tpcds_q07/datafusion:vortex-file-compressed 28597587 / 29125244 / -1.8% 49912247 / 51608078 / -3.3% 0.57 / 0.56 / +1.5%
tpcds_q08/datafusion:vortex-file-compressed 24742660 / 24275335 / +1.9% 43374217 / 43666821 / -0.7% 0.57 / 0.56 / +2.6%
tpcds_q09/datafusion:vortex-file-compressed 22239623 / 21989176 / +1.1% 37478045 / 38318957 / -2.2% 0.59 / 0.57 / +3.4%
tpcds_q10/datafusion:vortex-file-compressed 26858199 / 26486224 / +1.4% 47794893 / 49784144 / -4.0% 0.56 / 0.53 / +5.6%
tpcds_q11/datafusion:vortex-file-compressed 52497452 / 52973140 / -0.9% 86205855 / 81660261 / +5.6% 0.61 / 0.65 / -6.1%
tpcds_q12/datafusion:vortex-file-compressed 14833110 / 14988567 / -1.0% 31006354 / 33025999 / -6.1% 0.48 / 0.45 / +5.4%
tpcds_q13/datafusion:vortex-file-compressed 30890294 / 30680768 / +0.7% 54713768 / 56487876 / -3.1% 0.56 / 0.54 / +3.9%
tpcds_q14/datafusion:vortex-file-compressed 486129317 / 486420404 / -0.1% 543290316 / 546632197 / -0.6% 0.89 / 0.89 / +0.6%
tpcds_q15/datafusion:vortex-file-compressed 12364762 / 12237327 / +1.0% 31754331 / 33812731 / -6.1% 0.39 / 0.36 / +7.6%
tpcds_q16/datafusion:vortex-file-compressed 18034324 / 18098601 / -0.4% 37662661 / 38742356 / -2.8% 0.48 / 0.47 / +2.5%
tpcds_q17/datafusion:vortex-file-compressed 54166453 / 51792423 / +4.6% 69408179 / 82438883 / -15.8% 🟢 0.78 / 0.63 / +24.2%
tpcds_q18/datafusion:vortex-file-compressed 62873955 / 63174482 / -0.5% 84666588 / 85774598 / -1.3% 0.74 / 0.74 / +0.8%
tpcds_q19/datafusion:vortex-file-compressed 16281355 / 16506713 / -1.4% 35798459 / 37647468 / -4.9% 0.45 / 0.44 / +3.7%
tpcds_q20/datafusion:vortex-file-compressed 16011864 / 16181752 / -1.0% 34212473 / 36564031 / -6.4% 0.47 / 0.44 / +5.8%
tpcds_q21/datafusion:vortex-file-compressed 15365234 / 16857866 / -8.9% 35000296 / 39272919 / -10.9% 🟢 0.44 / 0.43 / +2.3%
tpcds_q22/datafusion:vortex-file-compressed 49052327 / 49158794 / -0.2% 70414474 / 73668217 / -4.4% 0.70 / 0.67 / +4.4%
tpcds_q23/datafusion:vortex-file-compressed 71244349 / 68782058 / +3.6% 95615064 / 96920249 / -1.3% 0.75 / 0.71 / +5.0%
tpcds_q24/datafusion:vortex-file-compressed 64197835 / 65095488 / -1.4% 86382076 / 87164422 / -0.9% 0.74 / 0.75 / -0.5%
tpcds_q25/datafusion:vortex-file-compressed 47695076 / 47589292 / +0.2% 63826972 / 67064988 / -4.8% 0.75 / 0.71 / +5.3%
tpcds_q26/datafusion:vortex-file-compressed 25681454 / 25272928 / +1.6% 44486587 / 45453594 / -2.1% 0.58 / 0.56 / +3.8%
tpcds_q27/datafusion:vortex-file-compressed 57587898 / 61450748 / -6.3% 87101427 / 82680613 / +5.3% 0.66 / 0.74 / -11.0%
tpcds_q28/datafusion:vortex-file-compressed 26250899 / 27046414 / -2.9% 40038001 / 46902850 / -14.6% 🟢 0.66 / 0.58 / +13.7%
tpcds_q29/datafusion:vortex-file-compressed 53095686 / 53153057 / -0.1% 65751286 / 75454024 / -12.9% 🟢 0.81 / 0.70 / +14.6%
tpcds_q30/datafusion:vortex-file-compressed 25849776 / 26512752 / -2.5% 41954697 / 43987580 / -4.6% 0.62 / 0.60 / +2.2%
tpcds_q31/datafusion:vortex-file-compressed 58048198 / 59005569 / -1.6% 82355678 / 84244928 / -2.2% 0.70 / 0.70 / +0.6%
tpcds_q32/datafusion:vortex-file-compressed 12345744 / 12373726 / -0.2% 28591339 / 30199258 / -5.3% 0.43 / 0.41 / +5.4%
tpcds_q33/datafusion:vortex-file-compressed 27773402 / 27037673 / +2.7% 48872787 / 49607735 / -1.5% 0.57 / 0.55 / +4.3%
tpcds_q34/datafusion:vortex-file-compressed 17419460 / 17532291 / -0.6% 35543637 / 36442654 / -2.5% 0.49 / 0.48 / +1.9%
tpcds_q35/datafusion:vortex-file-compressed 30149980 / 30487478 / -1.1% 52432912 / 53528333 / -2.0% 0.58 / 0.57 / +1.0%
tpcds_q36/datafusion:vortex-file-compressed 46507920 / 47253590 / -1.6% 66494192 / 68791022 / -3.3% 0.70 / 0.69 / +1.8%
tpcds_q37/datafusion:vortex-file-compressed 11858769 / 11871456 / -0.1% 31082545 / 33654663 / -7.6% 0.38 / 0.35 / +8.2%
tpcds_q38/datafusion:vortex-file-compressed 25393936 / 25532457 / -0.5% 45483162 / 47712567 / -4.7% 0.56 / 0.54 / +4.3%
tpcds_q39/datafusion:vortex-file-compressed 64718213 / 64415350 / +0.5% 90658247 / 87926301 / +3.1% 0.71 / 0.73 / -2.6%
tpcds_q40/datafusion:vortex-file-compressed 23265475 / 23419307 / -0.7% 39670957 / 43795761 / -9.4% 0.59 / 0.53 / +9.7%
tpcds_q41/datafusion:vortex-file-compressed 20342421 / 20251034 / +0.5% 32367674 / 32003635 / +1.1% 0.63 / 0.63 / -0.7%
tpcds_q42/datafusion:vortex-file-compressed 11115526 / 10957274 / +1.4% 25028151 / 28150113 / -11.1% 🟢 0.44 / 0.39 / +14.1%
tpcds_q43/datafusion:vortex-file-compressed 12831996 / 12471290 / +2.9% 29412686 / 33444050 / -12.1% 🟢 0.44 / 0.37 / +17.0%
tpcds_q44/datafusion:vortex-file-compressed 29450272 / 29643483 / -0.7% 48699777 / 53025440 / -8.2% 0.60 / 0.56 / +8.2%
tpcds_q45/datafusion:vortex-file-compressed 15732122 / 15648074 / +0.5% 34384942 / 35246693 / -2.4% 0.46 / 0.44 / +3.1%
tpcds_q46/datafusion:vortex-file-compressed 22988816 / 23028218 / -0.2% 45861149 / 47247214 / -2.9% 0.50 / 0.49 / +2.8%
tpcds_q47/datafusion:vortex-file-compressed 76086588 / 74217882 / +2.5% 104392194 / 102514076 / +1.8% 0.73 / 0.72 / +0.7%
tpcds_q48/datafusion:vortex-file-compressed 29006658 / 28712670 / +1.0% 49946836 / 51952460 / -3.9% 0.58 / 0.55 / +5.1%
tpcds_q49/datafusion:vortex-file-compressed 57351760 / 57417076 / -0.1% 77272633 / 86812784 / -11.0% 🟢 0.74 / 0.66 / +12.2%
tpcds_q50/datafusion:vortex-file-compressed 30571876 / 31112092 / -1.7% 50179524 / 51420993 / -2.4% 0.61 / 0.61 / +0.7%
tpcds_q51/datafusion:vortex-file-compressed 65584482 / 65679744 / -0.1% 85499294 / 87308924 / -2.1% 0.77 / 0.75 / +2.0%
tpcds_q52/datafusion:vortex-file-compressed 11472848 / 11225670 / +2.2% 25136540 / 29343635 / -14.3% 🟢 0.46 / 0.38 / +19.3%
tpcds_q53/datafusion:vortex-file-compressed 17706566 / 17720664 / -0.1% 37990359 / 37600207 / +1.0% 0.47 / 0.47 / -1.1%
tpcds_q54/datafusion:vortex-file-compressed 31650002 / 31797978 / -0.5% 52708865 / 55131673 / -4.4% 0.60 / 0.58 / +4.1%
tpcds_q55/datafusion:vortex-file-compressed 10790516 / 10766848 / +0.2% 24747031 / 27745018 / -10.8% 🟢 0.44 / 0.39 / +12.4%
tpcds_q56/datafusion:vortex-file-compressed 26617323 / 25787234 / +3.2% 45316213 / 46401375 / -2.3% 0.59 / 0.56 / +5.7%
tpcds_q57/datafusion:vortex-file-compressed 62104143 / 61692109 / +0.7% 84509325 / 87525253 / -3.4% 0.73 / 0.70 / +4.3%
tpcds_q58/datafusion:vortex-file-compressed 38546806 / 37854476 / +1.8% 60959417 / 62314092 / -2.2% 0.63 / 0.61 / +4.1%
tpcds_q59/datafusion:vortex-file-compressed 29395450 / 29888842 / -1.7% 53860028 / 54406080 / -1.0% 0.55 / 0.55 / -0.7%
tpcds_q60/datafusion:vortex-file-compressed 25529965 / 25518051 / +0.0% 43820615 / 46964412 / -6.7% 0.58 / 0.54 / +7.2%
tpcds_q61/datafusion:vortex-file-compressed 21095882 / 21737292 / -3.0% 42717089 / 42939332 / -0.5% 0.49 / 0.51 / -2.4%
tpcds_q62/datafusion:vortex-file-compressed 16249472 / 16317307 / -0.4% 32363826 / 35832840 / -9.7% 0.50 / 0.46 / +10.3%
tpcds_q63/datafusion:vortex-file-compressed 17793100 / 17396603 / +2.3% 38160181 / 38736621 / -1.5% 0.47 / 0.45 / +3.8%
tpcds_q64/datafusion:vortex-file-compressed 211465695 / 211383022 / +0.0% 249671917 / 249256233 / +0.2% 0.85 / 0.85 / -0.1%
tpcds_q65/datafusion:vortex-file-compressed 72774813 / 72475136 / +0.4% 90759330 / 93557841 / -3.0% 0.80 / 0.77 / +3.5%
tpcds_q66/datafusion:vortex-file-compressed 49980667 / 49465070 / +1.0% 71502563 / 74179765 / -3.6% 0.70 / 0.67 / +4.8%
tpcds_q67/datafusion:vortex-file-compressed 50062292 / 51038332 / -1.9% 80001229 / 81969602 / -2.4% 0.63 / 0.62 / +0.5%
tpcds_q68/datafusion:vortex-file-compressed 22644664 / 22609380 / +0.2% 44106323 / 47712533 / -7.6% 0.51 / 0.47 / +8.3%
tpcds_q69/datafusion:vortex-file-compressed 25557856 / 24985927 / +2.3% 45846831 / 47771423 / -4.0% 0.56 / 0.52 / +6.6%
tpcds_q70/datafusion:vortex-file-compressed 71760818 / 71372088 / +0.5% 91921571 / 91677054 / +0.3% 0.78 / 0.78 / +0.3%
tpcds_q71/datafusion:vortex-file-compressed 18463500 / 18979997 / -2.7% 39316966 / 39007007 / +0.8% 0.47 / 0.49 / -3.5%
tpcds_q72/datafusion:vortex-file-compressed 344358236 / 351491568 / -2.0% 408702761 / 398945813 / +2.4% 0.84 / 0.88 / -4.4%
tpcds_q73/datafusion:vortex-file-compressed 16069350 / 15919071 / +0.9% 35906731 / 36883883 / -2.6% 0.45 / 0.43 / +3.7%
tpcds_q74/datafusion:vortex-file-compressed 40125666 / 40261966 / -0.3% 67309568 / 66963896 / +0.5% 0.60 / 0.60 / -0.9%
tpcds_q75/datafusion:vortex-file-compressed 136886444 / 133489750 / +2.5% 157409984 / 164773518 / -4.5% 0.87 / 0.81 / +7.3%
tpcds_q76/datafusion:vortex-file-compressed 29177780 / 29266467 / -0.3% 47955809 / 48547438 / -1.2% 0.61 / 0.60 / +0.9%
tpcds_q77/datafusion:vortex-file-compressed 43986522 / 44282320 / -0.7% 65615401 / 67066823 / -2.2% 0.67 / 0.66 / +1.5%
tpcds_q78/datafusion:vortex-file-compressed 64025796 / 63928746 / +0.2% 89851709 / 92683476 / -3.1% 0.71 / 0.69 / +3.3%
tpcds_q79/datafusion:vortex-file-compressed 19785188 / 19728964 / +0.3% 41616931 / 43991960 / -5.4% 0.48 / 0.45 / +6.0%
tpcds_q80/datafusion:vortex-file-compressed 72766953 / 73015336 / -0.3% 101150673 / 101720130 / -0.6% 0.72 / 0.72 / +0.2%
tpcds_q81/datafusion:vortex-file-compressed 26093419 / 26520660 / -1.6% 42867648 / 44564668 / -3.8% 0.61 / 0.60 / +2.3%
tpcds_q82/datafusion:vortex-file-compressed 12295480 / 11835346 / +3.9% 29889858 / 34112096 / -12.4% 🟢 0.41 / 0.35 / +18.6%
tpcds_q83/datafusion:vortex-file-compressed 32157924 / 32852504 / -2.1% 49678008 / 52620675 / -5.6% 0.65 / 0.62 / +3.7%
tpcds_q84/datafusion:vortex-file-compressed 10050736 / 10260730 / -2.0% 24408300 / 25627033 / -4.8% 0.41 / 0.40 / +2.8%
tpcds_q85/datafusion:vortex-file-compressed 52865870 / 52986012 / -0.2% 78876350 / 81427937 / -3.1% 0.67 / 0.65 / +3.0%
tpcds_q86/datafusion:vortex-file-compressed 15936556 / 15835456 / +0.6% 31528761 / 33812851 / -6.8% 0.51 / 0.47 / +7.9%
tpcds_q87/datafusion:vortex-file-compressed 25753407 / 25906397 / -0.6% 48130809 / 49540188 / -2.8% 0.54 / 0.52 / +2.3%
tpcds_q88/datafusion:vortex-file-compressed 31380286 / 31389734 / -0.0% 53200658 / 52045939 / +2.2% 0.59 / 0.60 / -2.2%
tpcds_q89/datafusion:vortex-file-compressed 21513218 / 20702484 / +3.9% 39638113 / 42769483 / -7.3% 0.54 / 0.48 / +12.1%
tpcds_q90/datafusion:vortex-file-compressed 9842559 / 9833419 / +0.1% 23064145 / 24571113 / -6.1% 0.43 / 0.40 / +6.6%
tpcds_q91/datafusion:vortex-file-compressed 18324054 / 16661287 / +10.0% 35653450 / 36390423 / -2.0% 0.51 / 0.46 / +12.3%
tpcds_q92/datafusion:vortex-file-compressed 12731520 / 12795467 / -0.5% 27717637 / 28671659 / -3.3% 0.46 / 0.45 / +2.9%
tpcds_q93/datafusion:vortex-file-compressed 20287545 / 20673057 / -1.9% 39074729 / 42937519 / -9.0% 0.52 / 0.48 / +7.8%
tpcds_q94/datafusion:vortex-file-compressed 17938022 / 18222300 / -1.6% 35959274 / 36700867 / -2.0% 0.50 / 0.50 / +0.5%
tpcds_q95/datafusion:vortex-file-compressed 42395697 / 41764724 / +1.5% 60836372 / 63315407 / -3.9% 0.70 / 0.66 / +5.6%
tpcds_q96/datafusion:vortex-file-compressed 7495406 / 7573562 / -1.0% 23675755 / 25397707 / -6.8% 0.32 / 0.30 / +6.2%
tpcds_q97/datafusion:vortex-file-compressed 16931886 / 17109824 / -1.0% 35280585 / 36975426 / -4.6% 0.48 / 0.46 / +3.7%
tpcds_q98/datafusion:vortex-file-compressed 16368283 / 16200846 / +1.0% 35338346 / 38388313 / -7.9% 0.46 / 0.42 / +9.8%
tpcds_q99/datafusion:vortex-file-compressed 15886546 / 15972352 / -0.5% 33926129 / 34216443 / -0.8% 0.47 / 0.47 / +0.3%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42990306 / 42553468 / +1.0% 57736568 / 61508272 / -6.1% 0.74 / 0.69 / +7.6%
tpcds_q02/datafusion:parquet 54299680 / 54436116 / -0.3% 69650827 / 71234695 / -2.2% 0.78 / 0.76 / +2.0%
tpcds_q03/datafusion:parquet 19023068 / 18724904 / +1.6% 29110422 / 30839274 / -5.6% 0.65 / 0.61 / +7.6%
tpcds_q04/datafusion:parquet 178505250 / 177541472 / +0.5% 202216588 / 209353199 / -3.4% 0.88 / 0.85 / +4.1%
tpcds_q05/datafusion:parquet 68118082 / 67844002 / +0.4% 86913115 / 86674810 / +0.3% 0.78 / 0.78 / +0.1%
tpcds_q06/datafusion:parquet 33508072 / 33910348 / -1.2% 45721016 / 47093178 / -2.9% 0.73 / 0.72 / +1.8%
tpcds_q07/datafusion:parquet 47147095 / 46911540 / +0.5% 61422907 / 66833722 / -8.1% 0.77 / 0.70 / +9.4%
tpcds_q08/datafusion:parquet 30881561 / 30980170 / -0.3% 45907151 / 48698102 / -5.7% 0.67 / 0.64 / +5.7%
tpcds_q09/datafusion:parquet 32151272 / 31410922 / +2.4% 42061996 / 43117808 / -2.4% 0.76 / 0.73 / +4.9%
tpcds_q10/datafusion:parquet 45048339 / 43920208 / +2.6% 57353540 / 58235007 / -1.5% 0.79 / 0.75 / +4.1%
tpcds_q11/datafusion:parquet 96297999 / 95981002 / +0.3% 117535317 / 114955676 / +2.2% 0.82 / 0.83 / -1.9%
tpcds_q12/datafusion:parquet 23357149 / 23723244 / -1.5% 34641832 / 37401200 / -7.4% 0.67 / 0.63 / +6.3%
tpcds_q13/datafusion:parquet 45601682 / 46622766 / -2.2% 65570016 / 67855042 / -3.4% 0.70 / 0.69 / +1.2%
tpcds_q14/datafusion:parquet 534939000 / 535582938 / -0.1% 589256705 / 581817002 / +1.3% 0.91 / 0.92 / -1.4%
tpcds_q15/datafusion:parquet 23717627 / 23786430 / -0.3% 38629050 / 38645340 / -0.0% 0.61 / 0.62 / -0.2%
tpcds_q16/datafusion:parquet 36702505 / 36352896 / +1.0% 49307767 / 52028387 / -5.2% 0.74 / 0.70 / +6.5%
tpcds_q17/datafusion:parquet 73267520 / 74200498 / -1.3% 94360038 / 101401992 / -6.9% 0.78 / 0.73 / +6.1%
tpcds_q18/datafusion:parquet 65993550 / 65971439 / +0.0% 86964870 / 88054194 / -1.2% 0.76 / 0.75 / +1.3%
tpcds_q19/datafusion:parquet 29419064 / 29270140 / +0.5% 42297693 / 43607438 / -3.0% 0.70 / 0.67 / +3.6%
tpcds_q20/datafusion:parquet 24808896 / 24820696 / -0.0% 34728911 / 38304536 / -9.3% 0.71 / 0.65 / +10.2%
tpcds_q21/datafusion:parquet 19829981 / 20002098 / -0.9% 33917051 / 33919886 / -0.0% 0.58 / 0.59 / -0.9%
tpcds_q22/datafusion:parquet 77230791 / 77320398 / -0.1% 87393962 / 89292857 / -2.1% 0.88 / 0.87 / +2.1%
tpcds_q23/datafusion:parquet 91136938 / 92525832 / -1.5% 114262582 / 114195875 / +0.1% 0.80 / 0.81 / -1.6%
tpcds_q24/datafusion:parquet 90019720 / 89311501 / +0.8% 111689619 / 115471003 / -3.3% 0.81 / 0.77 / +4.2%
tpcds_q25/datafusion:parquet 75939500 / 81505657 / -6.8% 101175605 / 101648520 / -0.5% 0.75 / 0.80 / -6.4%
tpcds_q26/datafusion:parquet 43075248 / 43423748 / -0.8% 58711150 / 61538470 / -4.6% 0.73 / 0.71 / +4.0%
tpcds_q27/datafusion:parquet 75247134 / 79620338 / -5.5% 100339711 / 97948902 / +2.4% 0.75 / 0.81 / -7.7%
tpcds_q28/datafusion:parquet 28002726 / 28348610 / -1.2% 41057287 / 44664375 / -8.1% 0.68 / 0.63 / +7.5%
tpcds_q29/datafusion:parquet 74586012 / 75213046 / -0.8% 95542760 / 98371104 / -2.9% 0.78 / 0.76 / +2.1%
tpcds_q30/datafusion:parquet 45776686 / 42169774 / +8.6% 57324258 / 60307379 / -4.9% 0.80 / 0.70 / +14.2%
tpcds_q31/datafusion:parquet 82565033 / 82361952 / +0.2% 97270285 / 100496583 / -3.2% 0.85 / 0.82 / +3.6%
tpcds_q32/datafusion:parquet 26762712 / 26591342 / +0.6% 37862698 / 41298146 / -8.3% 0.71 / 0.64 / +9.8%
tpcds_q33/datafusion:parquet 39037741 / 37691810 / +3.6% 51209563 / 52125007 / -1.8% 0.76 / 0.72 / +5.4%
tpcds_q34/datafusion:parquet 24167434 / 23986917 / +0.8% 34831683 / 35499490 / -1.9% 0.69 / 0.68 / +2.7%
tpcds_q35/datafusion:parquet 50283842 / 49296060 / +2.0% 62487131 / 63017284 / -0.8% 0.80 / 0.78 / +2.9%
tpcds_q36/datafusion:parquet 53017000 / 51684038 / +2.6% 72932530 / 72210818 / +1.0% 0.73 / 0.72 / +1.6%
tpcds_q37/datafusion:parquet 21364758 / 21446941 / -0.4% 32151915 / 33942784 / -5.3% 0.66 / 0.63 / +5.2%
tpcds_q38/datafusion:parquet 45426374 / 44820684 / +1.4% 63521746 / 64689017 / -1.8% 0.72 / 0.69 / +3.2%
tpcds_q39/datafusion:parquet 68624484 / 67699316 / +1.4% 83241154 / 85621293 / -2.8% 0.82 / 0.79 / +4.3%
tpcds_q40/datafusion:parquet 30380522 / 30000794 / +1.3% 49623986 / 50879079 / -2.5% 0.61 / 0.59 / +3.8%
tpcds_q41/datafusion:parquet 20485910 / 19946452 / +2.7% 31312385 / 33044523 / -5.2% 0.65 / 0.60 / +8.4%
tpcds_q42/datafusion:parquet 18221454 / 18308191 / -0.5% 28442605 / 29437985 / -3.4% 0.64 / 0.62 / +3.0%
tpcds_q43/datafusion:parquet 19281936 / 19214094 / +0.4% 31275930 / 32772151 / -4.6% 0.62 / 0.59 / +5.2%
tpcds_q44/datafusion:parquet 35189938 / 36340908 / -3.2% 47474508 / 50486207 / -6.0% 0.74 / 0.72 / +3.0%
tpcds_q45/datafusion:parquet 27819346 / 27936952 / -0.4% 47041331 / 41010369 / +14.7% 🔴 0.59 / 0.68 / -13.2%
tpcds_q46/datafusion:parquet 29206885 / 28826922 / +1.3% 44123882 / 45636859 / -3.3% 0.66 / 0.63 / +4.8%
tpcds_q47/datafusion:parquet 95600763 / 96258910 / -0.7% 117884956 / 121179574 / -2.7% 0.81 / 0.79 / +2.1%
tpcds_q48/datafusion:parquet 41554662 / 41744890 / -0.5% 58798511 / 60514557 / -2.8% 0.71 / 0.69 / +2.4%
tpcds_q49/datafusion:parquet 70166282 / 71447943 / -1.8% 89621029 / 95643903 / -6.3% 0.78 / 0.75 / +4.8%
tpcds_q50/datafusion:parquet 47789344 / 46692792 / +2.3% 64700062 / 66443234 / -2.6% 0.74 / 0.70 / +5.1%
tpcds_q51/datafusion:parquet 74796176 / 74751852 / +0.1% 92365938 / 95188004 / -3.0% 0.81 / 0.79 / +3.1%
tpcds_q52/datafusion:parquet 18507779 / 18505499 / +0.0% 28970010 / 29947465 / -3.3% 0.64 / 0.62 / +3.4%
tpcds_q53/datafusion:parquet 22272996 / 22157468 / +0.5% 37436419 / 38528177 / -2.8% 0.59 / 0.58 / +3.5%
tpcds_q54/datafusion:parquet 53409840 / 53529878 / -0.2% 65745400 / 67031326 / -1.9% 0.81 / 0.80 / +1.7%
tpcds_q55/datafusion:parquet 18103326 / 18220436 / -0.6% 27483704 / 29095284 / -5.5% 0.66 / 0.63 / +5.2%
tpcds_q56/datafusion:parquet 41722682 / 40381978 / +3.3% 54909505 / 53095997 / +3.4% 0.76 / 0.76 / -0.1%
tpcds_q57/datafusion:parquet 98283547 / 100584148 / -2.3% 118835165 / 118053564 / +0.7% 0.83 / 0.85 / -2.9%
tpcds_q58/datafusion:parquet 65116340 / 66427576 / -2.0% 81190564 / 83659276 / -3.0% 0.80 / 0.79 / +1.0%
tpcds_q59/datafusion:parquet 47576131 / 48221440 / -1.3% 64444130 / 65794875 / -2.1% 0.74 / 0.73 / +0.7%
tpcds_q60/datafusion:parquet 42296458 / 42417197 / -0.3% 53997966 / 57825521 / -6.6% 0.78 / 0.73 / +6.8%
tpcds_q61/datafusion:parquet 36807387 / 35831609 / +2.7% 48457711 / 49811571 / -2.7% 0.76 / 0.72 / +5.6%
tpcds_q62/datafusion:parquet 25039526 / 24971228 / +0.3% 36890293 / 38219191 / -3.5% 0.68 / 0.65 / +3.9%
tpcds_q63/datafusion:parquet 22272594 / 21960166 / +1.4% 37748281 / 38357620 / -1.6% 0.59 / 0.57 / +3.1%
tpcds_q64/datafusion:parquet 284705470 / 284502649 / +0.1% 319859183 / 323959594 / -1.3% 0.89 / 0.88 / +1.4%
tpcds_q65/datafusion:parquet 122865737 / 123423916 / -0.5% 141589779 / 140942042 / +0.5% 0.87 / 0.88 / -0.9%
tpcds_q66/datafusion:parquet 60315377 / 60140036 / +0.3% 76185577 / 74724577 / +2.0% 0.79 / 0.80 / -1.6%
tpcds_q67/datafusion:parquet 68747898 / 68723312 / +0.0% 90411535 / 91987388 / -1.7% 0.76 / 0.75 / +1.8%
tpcds_q68/datafusion:parquet 28954698 / 28935146 / +0.1% 46235260 / 48036163 / -3.7% 0.63 / 0.60 / +4.0%
tpcds_q69/datafusion:parquet 43851265 / 42476883 / +3.2% 57236676 / 60097084 / -4.8% 0.77 / 0.71 / +8.4%
tpcds_q70/datafusion:parquet 80128992 / 79887880 / +0.3% 96290288 / 97537013 / -1.3% 0.83 / 0.82 / +1.6%
tpcds_q71/datafusion:parquet 26443922 / 24129452 / +9.6% 37966503 / 40401907 / -6.0% 0.70 / 0.60 / +16.6%
tpcds_q72/datafusion:parquet 517170768 / 519359136 / -0.4% 542230289 / 536618280 / +1.0% 0.95 / 0.97 / -1.5%
tpcds_q73/datafusion:parquet 23611550 / 23466324 / +0.6% 34761384 / 36243461 / -4.1% 0.68 / 0.65 / +4.9%
tpcds_q74/datafusion:parquet 69686208 / 69848585 / -0.2% 88637147 / 91259366 / -2.9% 0.79 / 0.77 / +2.7%
tpcds_q75/datafusion:parquet 155979580 / 152735996 / +2.1% 175392947 / 179231792 / -2.1% 0.89 / 0.85 / +4.4%
tpcds_q76/datafusion:parquet 33206718 / 32972460 / +0.7% 45520039 / 47824608 / -4.8% 0.73 / 0.69 / +5.8%
tpcds_q77/datafusion:parquet 56910824 / 57387964 / -0.8% 70988441 / 74387316 / -4.6% 0.80 / 0.77 / +3.9%
tpcds_q78/datafusion:parquet 85890212 / 86956888 / -1.2% 115519405 / 118587712 / -2.6% 0.74 / 0.73 / +1.4%
tpcds_q79/datafusion:parquet 26556930 / 26990804 / -1.6% 40506398 / 41210483 / -1.7% 0.66 / 0.65 / +0.1%
tpcds_q80/datafusion:parquet 80679208 / 78200446 / +3.2% 108566887 / 109323641 / -0.7% 0.74 / 0.72 / +3.9%
tpcds_q81/datafusion:parquet 39365018 / 37209420 / +5.8% 49161668 / 51617816 / -4.8% 0.80 / 0.72 / +11.1%
tpcds_q82/datafusion:parquet 22332808 / 22874962 / -2.4% 34057251 / 35708586 / -4.6% 0.66 / 0.64 / +2.4%
tpcds_q83/datafusion:parquet 57657036 / 58708558 / -1.8% 73489685 / 72828600 / +0.9% 0.78 / 0.81 / -2.7%
tpcds_q84/datafusion:parquet 25727191 / 26558336 / -3.1% 38630513 / 40013451 / -3.5% 0.67 / 0.66 / +0.3%
tpcds_q85/datafusion:parquet 79209372 / 80108087 / -1.1% 103744512 / 101416520 / +2.3% 0.76 / 0.79 / -3.3%
tpcds_q86/datafusion:parquet 20707746 / 20797778 / -0.4% 31738437 / 32549020 / -2.5% 0.65 / 0.64 / +2.1%
tpcds_q87/datafusion:parquet 45325884 / 44699589 / +1.4% 59326876 / 60405826 / -1.8% 0.76 / 0.74 / +3.2%
tpcds_q88/datafusion:parquet 36777181 / 36326275 / +1.2% 51800672 / 49299582 / +5.1% 0.71 / 0.74 / -3.6%
tpcds_q89/datafusion:parquet 25185184 / 25828823 / -2.5% 39703101 / 42119541 / -5.7% 0.63 / 0.61 / +3.4%
tpcds_q90/datafusion:parquet 14960884 / 15845292 / -5.6% 25184402 / 26616034 / -5.4% 0.59 / 0.60 / -0.2%
tpcds_q91/datafusion:parquet 32616466 / 31904989 / +2.2% 45466299 / 46092911 / -1.4% 0.72 / 0.69 / +3.6%
tpcds_q92/datafusion:parquet 26836012 / 26792150 / +0.2% 38688685 / 40347548 / -4.1% 0.69 / 0.66 / +4.5%
tpcds_q93/datafusion:parquet 27557696 / 27212198 / +1.3% 44239752 / 46035787 / -3.9% 0.62 / 0.59 / +5.4%
tpcds_q94/datafusion:parquet 34647165 / 35005805 / -1.0% 47337769 / 48298824 / -2.0% 0.73 / 0.72 / +1.0%
tpcds_q95/datafusion:parquet 62796497 / 64204052 / -2.2% 77982171 / 80763136 / -3.4% 0.81 / 0.79 / +1.3%
tpcds_q96/datafusion:parquet 12802998 / 12754800 / +0.4% 23255784 / 24973882 / -6.9% 0.55 / 0.51 / +7.8%
tpcds_q97/datafusion:parquet 35364529 / 35401358 / -0.1% 50402484 / 50688711 / -0.6% 0.70 / 0.70 / +0.5%
tpcds_q98/datafusion:parquet 24586806 / 24555935 / +0.1% 37174531 / 37543398 / -1.0% 0.66 / 0.65 / +1.1%
tpcds_q99/datafusion:parquet 29708280 / 29519639 / +0.6% 39804209 / 40841538 / -2.5% 0.75 / 0.72 / +3.3%
duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16286700 / 15856088 / +2.7% 25494708 / 25053451 / +1.8% 0.64 / 0.63 / +0.9%
tpcds_q02/duckdb:vortex-file-compressed 18569664 / 19161901 / -3.1% 22283769 / 22566417 / -1.3% 0.83 / 0.85 / -1.9%
tpcds_q03/duckdb:vortex-file-compressed 7217738 / 6923925 / +4.2% 15562918 / 15802868 / -1.5% 0.46 / 0.44 / +5.9%
tpcds_q04/duckdb:vortex-file-compressed 45776378 / 46066010 / -0.6% 56594796 / 56337964 / +0.5% 0.81 / 0.82 / -1.1%
tpcds_q05/duckdb:vortex-file-compressed 23178928 / 22937691 / +1.1% 33050834 / 32805765 / +0.7% 0.70 / 0.70 / +0.3%
tpcds_q06/duckdb:vortex-file-compressed 24529556 / 24098967 / +1.8% 38170852 / 38748364 / -1.5% 0.64 / 0.62 / +3.3%
tpcds_q07/duckdb:vortex-file-compressed 13519364 / 13240300 / +2.1% 23575092 / 23146083 / +1.9% 0.57 / 0.57 / +0.2%
tpcds_q08/duckdb:vortex-file-compressed 17481135 / 17525884 / -0.3% 25245855 / 25409775 / -0.6% 0.69 / 0.69 / +0.4%
tpcds_q09/duckdb:vortex-file-compressed 18877283 / 18848022 / +0.2% 29649970 / 29029188 / +2.1% 0.64 / 0.65 / -1.9%
tpcds_q10/duckdb:vortex-file-compressed 27904806 / 27673388 / +0.8% 39876285 / 40630397 / -1.9% 0.70 / 0.68 / +2.7%
tpcds_q11/duckdb:vortex-file-compressed 37217224 / 37025190 / +0.5% 45629251 / 45894852 / -0.6% 0.82 / 0.81 / +1.1%
tpcds_q12/duckdb:vortex-file-compressed 10256255 / 10177222 / +0.8% 16528982 / 17036172 / -3.0% 0.62 / 0.60 / +3.9%
tpcds_q13/duckdb:vortex-file-compressed 21114061 / 20638850 / +2.3% 33574486 / 33537878 / +0.1% 0.63 / 0.62 / +2.2%
tpcds_q14/duckdb:vortex-file-compressed 56772952 / 56133344 / +1.1% 67245137 / 68587843 / -2.0% 0.84 / 0.82 / +3.2%
tpcds_q15/duckdb:vortex-file-compressed 11246504 / 11136378 / +1.0% 17858432 / 18556850 / -3.8% 0.63 / 0.60 / +4.9%
tpcds_q16/duckdb:vortex-file-compressed 24354062 / 24330088 / +0.1% 35223768 / 35073151 / +0.4% 0.69 / 0.69 / -0.3%
tpcds_q17/duckdb:vortex-file-compressed 24622304 / 24781396 / -0.6% 35089127 / 37307945 / -5.9% 0.70 / 0.66 / +5.6%
tpcds_q18/duckdb:vortex-file-compressed 31991645 / 31387516 / +1.9% 41937135 / 42472987 / -1.3% 0.76 / 0.74 / +3.2%
tpcds_q19/duckdb:vortex-file-compressed 79059139 / 76796560 / +2.9% 88649477 / 88426588 / +0.3% 0.89 / 0.87 / +2.7%
tpcds_q20/duckdb:vortex-file-compressed 10990614 / 10935068 / +0.5% 17609970 / 18958024 / -7.1% 0.62 / 0.58 / +8.2%
tpcds_q21/duckdb:vortex-file-compressed 9298076 / 9039398 / +2.9% 21726626 / 22117662 / -1.8% 0.43 / 0.41 / +4.7%
tpcds_q22/duckdb:vortex-file-compressed 17729587 / 17311503 / +2.4% 30808228 / 29575934 / +4.2% 0.58 / 0.59 / -1.7%
tpcds_q23/duckdb:vortex-file-compressed 39172848 / 37518967 / +4.4% 49081266 / 50664416 / -3.1% 0.80 / 0.74 / +7.8%
tpcds_q24/duckdb:vortex-file-compressed 27102004 / 26396148 / +2.7% 36800189 / 36761790 / +0.1% 0.74 / 0.72 / +2.6%
tpcds_q25/duckdb:vortex-file-compressed 23249822 / 23654808 / -1.7% 33337842 / 35365687 / -5.7% 0.70 / 0.67 / +4.3%
tpcds_q26/duckdb:vortex-file-compressed 12987924 / 13105318 / -0.9% 20923659 / 20853557 / +0.3% 0.62 / 0.63 / -1.2%
tpcds_q27/duckdb:vortex-file-compressed 16004306 / 16192056 / -1.2% 26509837 / 26009137 / +1.9% 0.60 / 0.62 / -3.0%
tpcds_q28/duckdb:vortex-file-compressed 15501665 / 15258501 / +1.6% 25960198 / 26159336 / -0.8% 0.60 / 0.58 / +2.4%
tpcds_q29/duckdb:vortex-file-compressed 22758554 / 22552766 / +0.9% 33810378 / 36151766 / -6.5% 0.67 / 0.62 / +7.9%
tpcds_q30/duckdb:vortex-file-compressed 15960442 / 16057784 / -0.6% 24308456 / 24518383 / -0.9% 0.66 / 0.65 / +0.3%
tpcds_q31/duckdb:vortex-file-compressed 17833948 / 17561867 / +1.5% 26735378 / 26943510 / -0.8% 0.67 / 0.65 / +2.3%
tpcds_q32/duckdb:vortex-file-compressed 12127482 / 11757203 / +3.1% 20803074 / 21387558 / -2.7% 0.58 / 0.55 / +6.0%
tpcds_q33/duckdb:vortex-file-compressed 18883910 / 18942878 / -0.3% 28923099 / 28103051 / +2.9% 0.65 / 0.67 / -3.1%
tpcds_q34/duckdb:vortex-file-compressed 13408408 / 13067921 / +2.6% 22235214 / 22317619 / -0.4% 0.60 / 0.59 / +3.0%
tpcds_q35/duckdb:vortex-file-compressed 28232409 / 28196462 / +0.1% 38527162 / 39356511 / -2.1% 0.73 / 0.72 / +2.3%
tpcds_q36/duckdb:vortex-file-compressed 14149814 / 14106033 / +0.3% 23908961 / 24274035 / -1.5% 0.59 / 0.58 / +1.8%
tpcds_q37/duckdb:vortex-file-compressed 9329666 / 9480925 / -1.6% 22104317 / 24542446 / -9.9% 0.42 / 0.39 / +9.3%
tpcds_q38/duckdb:vortex-file-compressed 24991052 / 24496132 / +2.0% 32350994 / 31447339 / +2.9% 0.77 / 0.78 / -0.8%
tpcds_q39/duckdb:vortex-file-compressed 18582868 / 19335637 / -3.9% 31530644 / 31674394 / -0.5% 0.59 / 0.61 / -3.5%
tpcds_q40/duckdb:vortex-file-compressed 14381548 / 13918782 / +3.3% 20871457 / 20528669 / +1.7% 0.69 / 0.68 / +1.6%
tpcds_q41/duckdb:vortex-file-compressed 18696086 / 18563744 / +0.7% 24769537 / 25543494 / -3.0% 0.75 / 0.73 / +3.9%
tpcds_q42/duckdb:vortex-file-compressed 7160028 / 6985344 / +2.5% 15343991 / 16484312 / -6.9% 0.47 / 0.42 / +10.1%
tpcds_q43/duckdb:vortex-file-compressed 9845615 / 9573853 / +2.8% 17944843 / 18798288 / -4.5% 0.55 / 0.51 / +7.7%
tpcds_q44/duckdb:vortex-file-compressed 12569692 / 12490448 / +0.6% 23891681 / 24726065 / -3.4% 0.53 / 0.51 / +4.1%
tpcds_q45/duckdb:vortex-file-compressed 23724752 / 23449598 / +1.2% 30350259 / 30647398 / -1.0% 0.78 / 0.77 / +2.2%
tpcds_q46/duckdb:vortex-file-compressed 19822584 / 19475824 / +1.8% 28253745 / 28211532 / +0.1% 0.70 / 0.69 / +1.6%
tpcds_q47/duckdb:vortex-file-compressed 35137786 / 34771754 / +1.1% 43889688 / 44713718 / -1.8% 0.80 / 0.78 / +2.9%
tpcds_q48/duckdb:vortex-file-compressed 23550093 / 23169150 / +1.6% 34696872 / 36523870 / -5.0% 0.68 / 0.63 / +7.0%
tpcds_q49/duckdb:vortex-file-compressed 18928110 / 19020638 / -0.5% 30001834 / 31029780 / -3.3% 0.63 / 0.61 / +2.9%
tpcds_q50/duckdb:vortex-file-compressed 17117797 / 16847584 / +1.6% 26432478 / 28332192 / -6.7% 0.65 / 0.59 / +8.9%
tpcds_q51/duckdb:vortex-file-compressed 49637883 / 48823098 / +1.7% 77934449 / 58577013 / +33.0% 🔴 0.64 / 0.83 / -23.6%
tpcds_q52/duckdb:vortex-file-compressed 7285153 / 7197295 / +1.2% 15381789 / 15963488 / -3.6% 0.47 / 0.45 / +5.0%
tpcds_q53/duckdb:vortex-file-compressed 11507026 / 11450736 / +0.5% 20707330 / 20712215 / -0.0% 0.56 / 0.55 / +0.5%
tpcds_q54/duckdb:vortex-file-compressed 20473027 / 20597293 / -0.6% 29544278 / 31755351 / -7.0% 0.69 / 0.65 / +6.8%
tpcds_q55/duckdb:vortex-file-compressed 7213353 / 6980760 / +3.3% 15499617 / 16487811 / -6.0% 0.47 / 0.42 / +9.9%
tpcds_q56/duckdb:vortex-file-compressed 17924774 / 18367170 / -2.4% 28721937 / 28869849 / -0.5% 0.62 / 0.64 / -1.9%
tpcds_q57/duckdb:vortex-file-compressed 26416597 / 25799272 / +2.4% 34463251 / 34938346 / -1.4% 0.77 / 0.74 / +3.8%
tpcds_q58/duckdb:vortex-file-compressed 20555294 / 20446416 / +0.5% 30732753 / 30745536 / -0.0% 0.67 / 0.67 / +0.6%
tpcds_q59/duckdb:vortex-file-compressed 19783501 / 19340362 / +2.3% 26899670 / 27752497 / -3.1% 0.74 / 0.70 / +5.5%
tpcds_q60/duckdb:vortex-file-compressed 18898636 / 18593026 / +1.6% 28855880 / 29926264 / -3.6% 0.65 / 0.62 / +5.4%
tpcds_q61/duckdb:vortex-file-compressed 25654283 / 25371032 / +1.1% 34093902 / 34497649 / -1.2% 0.75 / 0.74 / +2.3%
tpcds_q62/duckdb:vortex-file-compressed 11878008 / 11673792 / +1.7% 18442632 / 18582947 / -0.8% 0.64 / 0.63 / +2.5%
tpcds_q63/duckdb:vortex-file-compressed 11052663 / 10995616 / +0.5% 19954311 / 20311505 / -1.8% 0.55 / 0.54 / +2.3%
tpcds_q64/duckdb:vortex-file-compressed 49944464 / 49554919 / +0.8% 63896546 / 66193456 / -3.5% 0.78 / 0.75 / +4.4%
tpcds_q65/duckdb:vortex-file-compressed 13457722 / 13036144 / +3.2% 22901820 / 23328760 / -1.8% 0.59 / 0.56 / +5.2%
tpcds_q66/duckdb:vortex-file-compressed 29735367 / 29527026 / +0.7% 35436870 / 35996660 / -1.6% 0.84 / 0.82 / +2.3%
tpcds_q67/duckdb:vortex-file-compressed 58923259 / 58225040 / +1.2% 67087004 / 68761667 / -2.4% 0.88 / 0.85 / +3.7%
tpcds_q68/duckdb:vortex-file-compressed 19379547 / 19310678 / +0.4% 28308179 / 27449820 / +3.1% 0.68 / 0.70 / -2.7%
tpcds_q69/duckdb:vortex-file-compressed 23467370 / 22490548 / +4.3% 36167072 / 38222052 / -5.4% 0.65 / 0.59 / +10.3%
tpcds_q70/duckdb:vortex-file-compressed 16253647 / 15902052 / +2.2% 27467790 / 28094291 / -2.2% 0.59 / 0.57 / +4.5%
tpcds_q71/duckdb:vortex-file-compressed 13335397 / 12864372 / +3.7% 23649674 / 23691650 / -0.2% 0.56 / 0.54 / +3.8%
tpcds_q72/duckdb:vortex-file-compressed 52395545 / 52192596 / +0.4% 63326503 / 62803433 / +0.8% 0.83 / 0.83 / -0.4%
tpcds_q73/duckdb:vortex-file-compressed 12002130 / 11985728 / +0.1% 20290123 / 21038053 / -3.6% 0.59 / 0.57 / +3.8%
tpcds_q74/duckdb:vortex-file-compressed 26426214 / 25972796 / +1.7% 33918997 / 34801978 / -2.5% 0.78 / 0.75 / +4.4%
tpcds_q75/duckdb:vortex-file-compressed 28262710 / 28398132 / -0.5% 38058686 / 39071847 / -2.6% 0.74 / 0.73 / +2.2%
tpcds_q76/duckdb:vortex-file-compressed 12944358 / 12640882 / +2.4% 22343296 / 23437794 / -4.7% 0.58 / 0.54 / +7.4%
tpcds_q77/duckdb:vortex-file-compressed 21186146 / 21361244 / -0.8% 31214735 / 31773802 / -1.8% 0.68 / 0.67 / +1.0%
tpcds_q78/duckdb:vortex-file-compressed 43000916 / 43014688 / -0.0% 53048631 / 54279156 / -2.3% 0.81 / 0.79 / +2.3%
tpcds_q79/duckdb:vortex-file-compressed 13167489 / 13165252 / +0.0% 21619768 / 21465346 / +0.7% 0.61 / 0.61 / -0.7%
tpcds_q80/duckdb:vortex-file-compressed 37879484 / 37179209 / +1.9% 49464705 / 50099411 / -1.3% 0.77 / 0.74 / +3.2%
tpcds_q81/duckdb:vortex-file-compressed 21416928 / 21328864 / +0.4% 29008594 / 29865176 / -2.9% 0.74 / 0.71 / +3.4%
tpcds_q82/duckdb:vortex-file-compressed 9567771 / 9307188 / +2.8% 23539274 / 23746264 / -0.9% 0.41 / 0.39 / +3.7%
tpcds_q83/duckdb:vortex-file-compressed 17658537 / 17435072 / +1.3% 24690730 / 24694128 / -0.0% 0.72 / 0.71 / +1.3%
tpcds_q84/duckdb:vortex-file-compressed 15620704 / 15376800 / +1.6% 22066452 / 22875689 / -3.5% 0.71 / 0.67 / +5.3%
tpcds_q85/duckdb:vortex-file-compressed 24618525 / 24242724 / +1.6% 35820557 / 36287303 / -1.3% 0.69 / 0.67 / +2.9%
tpcds_q86/duckdb:vortex-file-compressed 9884595 / 9819846 / +0.7% 16322940 / 16677715 / -2.1% 0.61 / 0.59 / +2.8%
tpcds_q87/duckdb:vortex-file-compressed 26326548 / 25757864 / +2.2% 35099239 / 34004788 / +3.2% 0.75 / 0.76 / -1.0%
tpcds_q88/duckdb:vortex-file-compressed 31211634 / 30514060 / +2.3% 37816245 / 37967033 / -0.4% 0.83 / 0.80 / +2.7%
tpcds_q89/duckdb:vortex-file-compressed 12194404 / 11975458 / +1.8% 21627177 / 21898946 / -1.2% 0.56 / 0.55 / +3.1%
tpcds_q90/duckdb:vortex-file-compressed 8456904 / 8229943 / +2.8% 15819022 / 15235306 / +3.8% 0.53 / 0.54 / -1.0%
tpcds_q91/duckdb:vortex-file-compressed 14766378 / 14475234 / +2.0% 23129674 / 23105745 / +0.1% 0.64 / 0.63 / +1.9%
tpcds_q92/duckdb:vortex-file-compressed 12272192 / 12106742 / +1.4% 20032063 / 20388405 / -1.7% 0.61 / 0.59 / +3.2%
tpcds_q93/duckdb:vortex-file-compressed 10639708 / 10887218 / -2.3% 22108103 / 23211830 / -4.8% 0.48 / 0.47 / +2.6%
tpcds_q94/duckdb:vortex-file-compressed 22320224 / 22226289 / +0.4% 31722672 / 31960792 / -0.7% 0.70 / 0.70 / +1.2%
tpcds_q95/duckdb:vortex-file-compressed 62795056 / 62707764 / +0.1% 71576716 / 71766492 / -0.3% 0.88 / 0.87 / +0.4%
tpcds_q96/duckdb:vortex-file-compressed 6998658 / 6863949 / +2.0% 15145988 / 15163784 / -0.1% 0.46 / 0.45 / +2.1%
tpcds_q97/duckdb:vortex-file-compressed 23419582 / 23194232 / +1.0% 32982504 / 32123785 / +2.7% 0.71 / 0.72 / -1.7%
tpcds_q98/duckdb:vortex-file-compressed 11537894 / 11328344 / +1.8% 19783112 / 20694316 / -4.4% 0.58 / 0.55 / +6.5%
tpcds_q99/duckdb:vortex-file-compressed 14950803 / 14610098 / +2.3% 22331279 / 22938779 / -2.6% 0.67 / 0.64 / +5.1%
duckdb / parquet / ns (1.008x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24264220 / 23991418 / +1.1% 30933861 / 31303493 / -1.2% 0.78 / 0.77 / +2.3%
tpcds_q02/duckdb:parquet 18073881 / 17870072 / +1.1% 24384695 / 23812799 / +2.4% 0.74 / 0.75 / -1.2%
tpcds_q03/duckdb:parquet 9831280 / 9771028 / +0.6% 15883879 / 15930937 / -0.3% 0.62 / 0.61 / +0.9%
tpcds_q04/duckdb:parquet 118032298 / 117298258 / +0.6% 125873975 / 125266440 / +0.5% 0.94 / 0.94 / +0.1%
tpcds_q05/duckdb:parquet 28531776 / 28151253 / +1.4% 33571078 / 32850554 / +2.2% 0.85 / 0.86 / -0.8%
tpcds_q06/duckdb:parquet 27082252 / 26088532 / +3.8% 35397981 / 35857674 / -1.3% 0.77 / 0.73 / +5.2%
tpcds_q07/duckdb:parquet 35783112 / 31819584 / +12.5% 🔴 39257205 / 38738638 / +1.3% 0.91 / 0.82 / +11.0%
tpcds_q08/duckdb:parquet 19848729 / 19747625 / +0.5% 25874275 / 26064678 / -0.7% 0.77 / 0.76 / +1.3%
tpcds_q09/duckdb:parquet 26681762 / 26985850 / -1.1% 29962879 / 29327410 / +2.2% 0.89 / 0.92 / -3.2%
tpcds_q10/duckdb:parquet 32645390 / 32280394 / +1.1% 39942389 / 39864518 / +0.2% 0.82 / 0.81 / +0.9%
tpcds_q11/duckdb:parquet 68460694 / 69816852 / -1.9% 76845034 / 75462384 / +1.8% 0.89 / 0.93 / -3.7%
tpcds_q12/duckdb:parquet 13948419 / 13880364 / +0.5% 19294114 / 18944616 / +1.8% 0.72 / 0.73 / -1.3%
tpcds_q13/duckdb:parquet 31752336 / 30550909 / +3.9% 39880090 / 39518052 / +0.9% 0.80 / 0.77 / +3.0%
tpcds_q14/duckdb:parquet 64286862 / 64234690 / +0.1% 68943842 / 68101452 / +1.2% 0.93 / 0.94 / -1.1%
tpcds_q15/duckdb:parquet 16744920 / 16563408 / +1.1% 22764533 / 22655888 / +0.5% 0.74 / 0.73 / +0.6%
tpcds_q16/duckdb:parquet 30381917 / 30016538 / +1.2% 37667552 / 36617291 / +2.9% 0.81 / 0.82 / -1.6%
tpcds_q17/duckdb:parquet 34738317 / 34463794 / +0.8% 40441462 / 40986660 / -1.3% 0.86 / 0.84 / +2.2%
tpcds_q18/duckdb:parquet 47716873 / 46842042 / +1.9% 55017780 / 53913416 / +2.0% 0.87 / 0.87 / -0.2%
tpcds_q19/duckdb:parquet 18798409 / 18764471 / +0.2% 25936884 / 25493925 / +1.7% 0.72 / 0.74 / -1.5%
tpcds_q20/duckdb:parquet 14998060 / 14844872 / +1.0% 19699553 / 19956262 / -1.3% 0.76 / 0.74 / +2.3%
tpcds_q21/duckdb:parquet 10588688 / 10537404 / +0.5% 16492204 / 16911208 / -2.5% 0.64 / 0.62 / +3.0%
tpcds_q22/duckdb:parquet 20627963 / 20589960 / +0.2% 26728837 / 26226190 / +1.9% 0.77 / 0.79 / -1.7%
tpcds_q23/duckdb:parquet 43074752 / 42324622 / +1.8% 47081063 / 47324184 / -0.5% 0.91 / 0.89 / +2.3%
tpcds_q24/duckdb:parquet 30596954 / 31202588 / -1.9% 37174940 / 36666983 / +1.4% 0.82 / 0.85 / -3.3%
tpcds_q25/duckdb:parquet 30752440 / 30250744 / +1.7% 36677124 / 36990251 / -0.8% 0.84 / 0.82 / +2.5%
tpcds_q26/duckdb:parquet 29327970 / 28761158 / +2.0% 35559133 / 35522161 / +0.1% 0.82 / 0.81 / +1.9%
tpcds_q27/duckdb:parquet 36616028 / 34361744 / +6.6% 41547290 / 41442006 / +0.3% 0.88 / 0.83 / +6.3%
tpcds_q28/duckdb:parquet 26753792 / 26004045 / +2.9% 33974105 / 34434761 / -1.3% 0.79 / 0.76 / +4.3%
tpcds_q29/duckdb:parquet 32248204 / 32131450 / +0.4% 39259585 / 39113475 / +0.4% 0.82 / 0.82 / -0.0%
tpcds_q30/duckdb:parquet 35779362 / 35461758 / +0.9% 44910595 / 44282495 / +1.4% 0.80 / 0.80 / -0.5%
tpcds_q31/duckdb:parquet 37393740 / 35333364 / +5.8% 43283066 / 42131699 / +2.7% 0.86 / 0.84 / +3.0%
tpcds_q32/duckdb:parquet 14247548 / 14111128 / +1.0% 20680429 / 20663604 / +0.1% 0.69 / 0.68 / +0.9%
tpcds_q33/duckdb:parquet 23541805 / 24564094 / -4.2% 29381978 / 29234497 / +0.5% 0.80 / 0.84 / -4.6%
tpcds_q34/duckdb:parquet 18457870 / 17096462 / +8.0% 24263560 / 24465230 / -0.8% 0.76 / 0.70 / +8.9%
tpcds_q35/duckdb:parquet 35429440 / 34630190 / +2.3% 43578624 / 43469634 / +0.3% 0.81 / 0.80 / +2.1%
tpcds_q36/duckdb:parquet 39880244 / 40846450 / -2.4% 47848859 / 47506409 / +0.7% 0.83 / 0.86 / -3.1%
tpcds_q37/duckdb:parquet 12771000 / 12676082 / +0.7% 18985908 / 19540586 / -2.8% 0.67 / 0.65 / +3.7%
tpcds_q38/duckdb:parquet 29706881 / 29481648 / +0.8% 33344407 / 34110270 / -2.2% 0.89 / 0.86 / +3.1%
tpcds_q39/duckdb:parquet 23432036 / 23210768 / +1.0% 29922751 / 30425359 / -1.7% 0.78 / 0.76 / +2.6%
tpcds_q40/duckdb:parquet 16083974 / 15727370 / +2.3% 21771589 / 21062180 / +3.4% 0.74 / 0.75 / -1.1%
tpcds_q41/duckdb:parquet 12027652 / 11886569 / +1.2% 18462523 / 17809187 / +3.7% 0.65 / 0.67 / -2.4%
tpcds_q42/duckdb:parquet 9667932 / 9459704 / +2.2% 15745483 / 15506199 / +1.5% 0.61 / 0.61 / +0.6%
tpcds_q43/duckdb:parquet 12090074 / 12756449 / -5.2% 18235943 / 17901609 / +1.9% 0.66 / 0.71 / -7.0%
tpcds_q44/duckdb:parquet 20715767 / 21844211 / -5.2% 27336786 / 27657071 / -1.2% 0.76 / 0.79 / -4.1%
tpcds_q45/duckdb:parquet 21170129 / 20637802 / +2.6% 27413981 / 27527217 / -0.4% 0.77 / 0.75 / +3.0%
tpcds_q46/duckdb:parquet 37499192 / 36742192 / +2.1% 43676263 / 43548493 / +0.3% 0.86 / 0.84 / +1.8%
tpcds_q47/duckdb:parquet 34462102 / 34297077 / +0.5% 40966179 / 40980257 / -0.0% 0.84 / 0.84 / +0.5%
tpcds_q48/duckdb:parquet 29057746 / 29828322 / -2.6% 37451911 / 37351336 / +0.3% 0.78 / 0.80 / -2.8%
tpcds_q49/duckdb:parquet 28849571 / 28881757 / -0.1% 35757206 / 36683786 / -2.5% 0.81 / 0.79 / +2.5%
tpcds_q50/duckdb:parquet 19457889 / 19365490 / +0.5% 25396817 / 25741583 / -1.3% 0.77 / 0.75 / +1.8%
tpcds_q51/duckdb:parquet 52496073 / 52016744 / +0.9% 60585531 / 60023274 / +0.9% 0.87 / 0.87 / -0.0%
tpcds_q52/duckdb:parquet 9758510 / 9638384 / +1.2% 15842419 / 15165722 / +4.5% 0.62 / 0.64 / -3.1%
tpcds_q53/duckdb:parquet 13991739 / 13755711 / +1.7% 20706569 / 21194092 / -2.3% 0.68 / 0.65 / +4.1%
tpcds_q54/duckdb:parquet 25863027 / 24694837 / +4.7% 31996465 / 32311821 / -1.0% 0.81 / 0.76 / +5.8%
tpcds_q55/duckdb:parquet 9471993 / 9373036 / +1.1% 15429696 / 15536325 / -0.7% 0.61 / 0.60 / +1.8%
tpcds_q56/duckdb:parquet 25176170 / 24731111 / +1.8% 30645592 / 30811363 / -0.5% 0.82 / 0.80 / +2.4%
tpcds_q57/duckdb:parquet 30755964 / 30440317 / +1.0% 36852031 / 35881155 / +2.7% 0.83 / 0.85 / -1.6%
tpcds_q58/duckdb:parquet 24264700 / 24572890 / -1.3% 30326398 / 30190140 / +0.5% 0.80 / 0.81 / -1.7%
tpcds_q59/duckdb:parquet 22774460 / 22786116 / -0.1% 28741907 / 29736954 / -3.3% 0.79 / 0.77 / +3.4%
tpcds_q60/duckdb:parquet 26084846 / 28099942 / -7.2% 32439554 / 32524166 / -0.3% 0.80 / 0.86 / -6.9%
tpcds_q61/duckdb:parquet 25148262 / 24764448 / +1.5% 29116791 / 29071965 / +0.2% 0.86 / 0.85 / +1.4%
tpcds_q62/duckdb:parquet 12847828 / 12671951 / +1.4% 17630137 / 17830792 / -1.1% 0.73 / 0.71 / +2.5%
tpcds_q63/duckdb:parquet 13316928 / 13308449 / +0.1% 20279603 / 19857393 / +2.1% 0.66 / 0.67 / -2.0%
tpcds_q64/duckdb:parquet 70784610 / 69513742 / +1.8% 79379915 / 79883262 / -0.6% 0.89 / 0.87 / +2.5%
tpcds_q65/duckdb:parquet 19886824 / 20614424 / -3.5% 26090609 / 25975089 / +0.4% 0.76 / 0.79 / -4.0%
tpcds_q66/duckdb:parquet 33499917 / 33186476 / +0.9% 38076675 / 38032595 / +0.1% 0.88 / 0.87 / +0.8%
tpcds_q67/duckdb:parquet 61281435 / 60736160 / +0.9% 67743023 / 69608648 / -2.7% 0.90 / 0.87 / +3.7%
tpcds_q68/duckdb:parquet 28118564 / 30230622 / -7.0% 36414597 / 36255506 / +0.4% 0.77 / 0.83 / -7.4%
tpcds_q69/duckdb:parquet 25890328 / 25494866 / +1.6% 34471807 / 34378414 / +0.3% 0.75 / 0.74 / +1.3%
tpcds_q70/duckdb:parquet 19188464 / 19297473 / -0.6% 27180873 / 27004999 / +0.7% 0.71 / 0.71 / -1.2%
tpcds_q71/duckdb:parquet 16977152 / 16905394 / +0.4% 23941337 / 24090232 / -0.6% 0.71 / 0.70 / +1.0%
tpcds_q72/duckdb:parquet 52764461 / 52628211 / +0.3% 59322905 / 59595937 / -0.5% 0.89 / 0.88 / +0.7%
tpcds_q73/duckdb:parquet 14851044 / 14974636 / -0.8% 21553529 / 21479552 / +0.3% 0.69 / 0.70 / -1.2%
tpcds_q74/duckdb:parquet 84539502 / 84356164 / +0.2% 92057181 / 91319660 / +0.8% 0.92 / 0.92 / -0.6%
tpcds_q75/duckdb:parquet 46174642 / 43714748 / +5.6% 49954877 / 50402019 / -0.9% 0.92 / 0.87 / +6.6%
tpcds_q76/duckdb:parquet 18136451 / 17802862 / +1.9% 23888237 / 24422046 / -2.2% 0.76 / 0.73 / +4.2%
tpcds_q77/duckdb:parquet 25634734 / 25359830 / +1.1% 31511053 / 31383116 / +0.4% 0.81 / 0.81 / +0.7%
tpcds_q78/duckdb:parquet 78963370 / 77858992 / +1.4% 84187018 / 84702101 / -0.6% 0.94 / 0.92 / +2.0%
tpcds_q79/duckdb:parquet 21369008 / 22936182 / -6.8% 28560391 / 28793210 / -0.8% 0.75 / 0.80 / -6.1%
tpcds_q80/duckdb:parquet 35943304 / 35978293 / -0.1% 43829819 / 43783887 / +0.1% 0.82 / 0.82 / -0.2%
tpcds_q81/duckdb:parquet 36370330 / 36077628 / +0.8% 44189796 / 44249896 / -0.1% 0.82 / 0.82 / +0.9%
tpcds_q82/duckdb:parquet 13330584 / 13469570 / -1.0% 20286550 / 20137169 / +0.7% 0.66 / 0.67 / -1.8%
tpcds_q83/duckdb:parquet 20477627 / 19927112 / +2.8% 25351090 / 24943787 / +1.6% 0.81 / 0.80 / +1.1%
tpcds_q84/duckdb:parquet 23055478 / 22637024 / +1.8% 28777348 / 28824726 / -0.2% 0.80 / 0.79 / +2.0%
tpcds_q85/duckdb:parquet 32365346 / 32017786 / +1.1% 39108639 / 39822222 / -1.8% 0.83 / 0.80 / +2.9%
tpcds_q86/duckdb:parquet 11885154 / 11778566 / +0.9% 17031525 / 16811435 / +1.3% 0.70 / 0.70 / -0.4%
tpcds_q87/duckdb:parquet 31508172 / 30879162 / +2.0% 36805083 / 35066428 / +5.0% 0.86 / 0.88 / -2.8%
tpcds_q88/duckdb:parquet 38526412 / 38559304 / -0.1% 45627720 / 41020830 / +11.2% 🔴 0.84 / 0.94 / -10.2%
tpcds_q89/duckdb:parquet 14226682 / 14125693 / +0.7% 21231118 / 20982520 / +1.2% 0.67 / 0.67 / -0.5%
tpcds_q90/duckdb:parquet 10144566 / 9888925 / +2.6% 15802172 / 14764358 / +7.0% 0.64 / 0.67 / -4.2%
tpcds_q91/duckdb:parquet 21111438 / 21056556 / +0.3% 28200272 / 28696576 / -1.7% 0.75 / 0.73 / +2.0%
tpcds_q92/duckdb:parquet 15851228 / 15384720 / +3.0% 22236219 / 22114116 / +0.6% 0.71 / 0.70 / +2.5%
tpcds_q93/duckdb:parquet 14237836 / 14060095 / +1.3% 19983410 / 20360582 / -1.9% 0.71 / 0.69 / +3.2%
tpcds_q94/duckdb:parquet 25268134 / 25327767 / -0.2% 33254500 / 32082951 / +3.7% 0.76 / 0.79 / -3.8%
tpcds_q95/duckdb:parquet 44032576 / 43992885 / +0.1% 49347470 / 48703101 / +1.3% 0.89 / 0.90 / -1.2%
tpcds_q96/duckdb:parquet 8347176 / 8238565 / +1.3% 14101068 / 13472121 / +4.7% 0.59 / 0.61 / -3.2%
tpcds_q97/duckdb:parquet 27722410 / 27377650 / +1.3% 34827846 / 33882921 / +2.8% 0.80 / 0.81 / -1.5%
tpcds_q98/duckdb:parquet 16541378 / 16429658 / +0.7% 23088170 / 23366744 / -1.2% 0.72 / 0.70 / +1.9%
tpcds_q99/duckdb:parquet 18822140 / 18608798 / +1.1% 24887009 / 24568802 / +1.3% 0.76 / 0.76 / -0.1%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): hot 1.012x ➖ · cold 0.992x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1253916 / 1217030 / +3.0% 22465706 / 23062282 / -2.6% 0.06 / 0.05 / +5.8%
clickbench_q01/datafusion:vortex-file-compressed 5938502 / 6158256 / -3.6% 29929356 / 30147317 / -0.7% 0.20 / 0.20 / -2.9%
clickbench_q02/datafusion:vortex-file-compressed 10552954 / 11234970 / -6.1% 45178937 / 46894833 / -3.7% 0.23 / 0.24 / -2.5%
clickbench_q03/datafusion:vortex-file-compressed 13135502 / 13245814 / -0.8% 54819131 / 54776512 / +0.1% 0.24 / 0.24 / -0.9%
clickbench_q04/datafusion:vortex-file-compressed 58125569 / 58502851 / -0.6% 102271684 / 103855265 / -1.5% 0.57 / 0.56 / +0.9%
clickbench_q05/datafusion:vortex-file-compressed 76111365 / 77486542 / -1.8% 126230401 / 127078107 / -0.7% 0.60 / 0.61 / -1.1%
clickbench_q06/datafusion:vortex-file-compressed 1265202 / 1227727 / +3.1% 22988251 / 24236616 / -5.2% 0.06 / 0.05 / +8.6%
clickbench_q07/datafusion:vortex-file-compressed 9818364 / 9618421 / +2.1% 33051252 / 36344640 / -9.1% 0.30 / 0.26 / +12.3%
clickbench_q08/datafusion:vortex-file-compressed 78069393 / 79765154 / -2.1% 121608239 / 129964680 / -6.4% 0.64 / 0.61 / +4.6%
clickbench_q09/datafusion:vortex-file-compressed 169949190 / 170604572 / -0.4% 210754745 / 217245266 / -3.0% 0.81 / 0.79 / +2.7%
clickbench_q10/datafusion:vortex-file-compressed 22285368 / 23902232 / -6.8% 67577281 / 73925465 / -8.6% 0.33 / 0.32 / +2.0%
clickbench_q11/datafusion:vortex-file-compressed 26274876 / 25750814 / +2.0% 68979832 / 74461033 / -7.4% 0.38 / 0.35 / +10.1%
clickbench_q12/datafusion:vortex-file-compressed 73979850 / 74621196 / -0.9% 127367435 / 124681926 / +2.2% 0.58 / 0.60 / -2.9%
clickbench_q13/datafusion:vortex-file-compressed 116586226 / 117161766 / -0.5% 184486777 / 185329299 / -0.5% 0.63 / 0.63 / -0.0%
clickbench_q14/datafusion:vortex-file-compressed 74514996 / 75254398 / -1.0% 126831635 / 130630014 / -2.9% 0.59 / 0.58 / +2.0%
clickbench_q15/datafusion:vortex-file-compressed 62196141 / 62055160 / +0.2% 97697121 / 109234109 / -10.6% 🟢 0.64 / 0.57 / +12.1%
clickbench_q16/datafusion:vortex-file-compressed 155508050 / 153258017 / +1.5% 212748361 / 219075089 / -2.9% 0.73 / 0.70 / +4.5%
clickbench_q17/datafusion:vortex-file-compressed 153352328 / 151961198 / +0.9% 223572061 / 223857241 / -0.1% 0.69 / 0.68 / +1.0%
clickbench_q18/datafusion:vortex-file-compressed 295298461 / 297203012 / -0.6% 376137996 / 386041999 / -2.6% 0.79 / 0.77 / +2.0%
clickbench_q19/datafusion:vortex-file-compressed 7739190 / 8027272 / -3.6% 48854957 / 49458262 / -1.2% 0.16 / 0.16 / -2.4%
clickbench_q20/datafusion:vortex-file-compressed 79514194 / 70049744 / +13.5% 🔴 251343325 / 247307250 / +1.6% 0.32 / 0.28 / +11.7%
clickbench_q21/datafusion:vortex-file-compressed 92894612 / 80318393 / +15.7% 🔴 286186626 / 292674526 / -2.2% 0.32 / 0.27 / +18.3%
clickbench_q22/datafusion:vortex-file-compressed 104875078 / 92466300 / +13.4% 🔴 393699231 / 383547007 / +2.6% 0.27 / 0.24 / +10.5%
clickbench_q23/datafusion:vortex-file-compressed 198213707 / 196639796 / +0.8% 554452183 / 562036520 / -1.3% 0.36 / 0.35 / +2.2%
clickbench_q24/datafusion:vortex-file-compressed 14557593 / 15230168 / -4.4% 70041530 / 72633736 / -3.6% 0.21 / 0.21 / -0.9%
clickbench_q25/datafusion:vortex-file-compressed 19650122 / 19190324 / +2.4% 71688599 / 64095772 / +11.8% 🔴 0.27 / 0.30 / -8.4%
clickbench_q26/datafusion:vortex-file-compressed 16311278 / 16156488 / +1.0% 69566376 / 71345843 / -2.5% 0.23 / 0.23 / +3.5%
clickbench_q27/datafusion:vortex-file-compressed 101908054 / 101749080 / +0.2% 255397250 / 259112399 / -1.4% 0.40 / 0.39 / +1.6%
clickbench_q28/datafusion:vortex-file-compressed 554124560 / 560724097 / -1.2% 680042658 / 653292769 / +4.1% 0.81 / 0.86 / -5.1%
clickbench_q29/datafusion:vortex-file-compressed 24140272 / 24175256 / -0.1% 56025015 / 56801286 / -1.4% 0.43 / 0.43 / +1.2%
clickbench_q30/datafusion:vortex-file-compressed 61979999 / 56559530 / +9.6% 109899834 / 115037937 / -4.5% 0.56 / 0.49 / +14.7%
clickbench_q31/datafusion:vortex-file-compressed 70737445 / 67012656 / +5.6% 155994371 / 162779706 / -4.2% 0.45 / 0.41 / +10.1%
clickbench_q32/datafusion:vortex-file-compressed 286964412 / 292607342 / -1.9% 382202699 / 394949534 / -3.2% 0.75 / 0.74 / +1.3%
clickbench_q33/datafusion:vortex-file-compressed 323117526 / 328373580 / -1.6% 430637960 / 446674036 / -3.6% 0.75 / 0.74 / +2.1%
clickbench_q34/datafusion:vortex-file-compressed 323978065 / 322172413 / +0.6% 443970176 / 433916535 / +2.3% 0.73 / 0.74 / -1.7%
clickbench_q35/datafusion:vortex-file-compressed 56618120 / 57919962 / -2.2% 95435322 / 93637212 / +1.9% 0.59 / 0.62 / -4.1%
clickbench_q36/datafusion:vortex-file-compressed 37949567 / 37560134 / +1.0% 66179294 / 67794896 / -2.4% 0.57 / 0.55 / +3.5%
clickbench_q37/datafusion:vortex-file-compressed 21026317 / 21029888 / -0.0% 46735430 / 48515273 / -3.7% 0.45 / 0.43 / +3.8%
clickbench_q38/datafusion:vortex-file-compressed 13366435 / 13101421 / +2.0% 41925780 / 42849765 / -2.2% 0.32 / 0.31 / +4.3%
clickbench_q39/datafusion:vortex-file-compressed 79258513 / 78536499 / +0.9% 112350607 / 114019221 / -1.5% 0.71 / 0.69 / +2.4%
clickbench_q40/datafusion:vortex-file-compressed 10359256 / 10436200 / -0.7% 36611512 / 36781402 / -0.5% 0.28 / 0.28 / -0.3%
clickbench_q41/datafusion:vortex-file-compressed 10073316 / 10260998 / -1.8% 36024027 / 36165492 / -0.4% 0.28 / 0.28 / -1.4%
clickbench_q42/datafusion:vortex-file-compressed 10081080 / 10240018 / -1.6% 36550832 / 37548514 / -2.7% 0.28 / 0.27 / +1.1%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1255882 / 1224136 / +2.6% 50201038 / 51128868 / -1.8% 0.03 / 0.02 / +4.5%
clickbench_q01/datafusion:parquet 15933875 / 15712850 / +1.4% 67939309 / 68185502 / -0.4% 0.23 / 0.23 / +1.8%
clickbench_q02/datafusion:parquet 19229396 / 18942766 / +1.5% 80873244 / 83298184 / -2.9% 0.24 / 0.23 / +4.6%
clickbench_q03/datafusion:parquet 16838270 / 17361388 / -3.0% 80148543 / 80587099 / -0.5% 0.21 / 0.22 / -2.5%
clickbench_q04/datafusion:parquet 62710550 / 63557084 / -1.3% 124926743 / 128527721 / -2.8% 0.50 / 0.49 / +1.5%
clickbench_q05/datafusion:parquet 88561382 / 89341952 / -0.9% 156108875 / 161499890 / -3.3% 0.57 / 0.55 / +2.5%
clickbench_q06/datafusion:parquet 1270166 / 1242974 / +2.2% 49543535 / 50836376 / -2.5% 0.03 / 0.02 / +4.9%
clickbench_q07/datafusion:parquet 16769416 / 16971310 / -1.2% 67658349 / 68985704 / -1.9% 0.25 / 0.25 / +0.7%
clickbench_q08/datafusion:parquet 85138098 / 85006131 / +0.2% 167001824 / 168644772 / -1.0% 0.51 / 0.50 / +1.1%
clickbench_q09/datafusion:parquet 187931750 / 188984232 / -0.6% 273951237 / 273567647 / +0.1% 0.69 / 0.69 / -0.7%
clickbench_q10/datafusion:parquet 36055452 / 36921950 / -2.3% 100067819 / 102568795 / -2.4% 0.36 / 0.36 / +0.1%
clickbench_q11/datafusion:parquet 43005940 / 42279092 / +1.7% 111642894 / 112694224 / -0.9% 0.39 / 0.38 / +2.7%
clickbench_q12/datafusion:parquet 95131900 / 96058502 / -1.0% 163877543 / 165054615 / -0.7% 0.58 / 0.58 / -0.3%
clickbench_q13/datafusion:parquet 146906377 / 149782503 / -1.9% 229531761 / 230335674 / -0.3% 0.64 / 0.65 / -1.6%
clickbench_q14/datafusion:parquet 102330795 / 101454956 / +0.9% 175222906 / 176574213 / -0.8% 0.58 / 0.57 / +1.6%
clickbench_q15/datafusion:parquet 71167578 / 72454257 / -1.8% 132049236 / 132786999 / -0.6% 0.54 / 0.55 / -1.2%
clickbench_q16/datafusion:parquet 156873897 / 155773974 / +0.7% 234866967 / 241723842 / -2.8% 0.67 / 0.64 / +3.6%
clickbench_q17/datafusion:parquet 156848935 / 156008920 / +0.5% 240052124 / 236871394 / +1.3% 0.65 / 0.66 / -0.8%
clickbench_q18/datafusion:parquet 310523426 / 311380915 / -0.3% 426578829 / 428990716 / -0.6% 0.73 / 0.73 / +0.3%
clickbench_q19/datafusion:parquet 19227643 / 19110656 / +0.6% 79066028 / 77709581 / +1.7% 0.24 / 0.25 / -1.1%
clickbench_q20/datafusion:parquet 177983590 / 181728894 / -2.1% 299914026 / 296669846 / +1.1% 0.59 / 0.61 / -3.1%
clickbench_q21/datafusion:parquet 172739382 / 173470796 / -0.4% 312102806 / 312816147 / -0.2% 0.55 / 0.55 / -0.2%
clickbench_q22/datafusion:parquet 259214094 / 262677480 / -1.3% 456112759 / 452696809 / +0.8% 0.57 / 0.58 / -2.1%
clickbench_q23/datafusion:parquet 1002434353 / 1003596600 / -0.1% 1190783231 / 1191722344 / -0.1% 0.84 / 0.84 / -0.0%
clickbench_q24/datafusion:parquet 29521876 / 30220771 / -2.3% 90298114 / 92145962 / -2.0% 0.33 / 0.33 / -0.3%
clickbench_q25/datafusion:parquet 36119219 / 36261200 / -0.4% 104998590 / 102634123 / +2.3% 0.34 / 0.35 / -2.6%
clickbench_q26/datafusion:parquet 30310692 / 30878933 / -1.8% 92370255 / 94470656 / -2.2% 0.33 / 0.33 / +0.4%
clickbench_q27/datafusion:parquet 193352566 / 192341656 / +0.5% 299492778 / 306612829 / -2.3% 0.65 / 0.63 / +2.9%
clickbench_q28/datafusion:parquet 615223898 / 621810476 / -1.1% 708224912 / 716541980 / -1.2% 0.87 / 0.87 / +0.1%
clickbench_q29/datafusion:parquet 28485587 / 28415514 / +0.2% 90119529 / 92685220 / -2.8% 0.32 / 0.31 / +3.1%
clickbench_q30/datafusion:parquet 89380226 / 90583681 / -1.3% 173031208 / 174033083 / -0.6% 0.52 / 0.52 / -0.8%
clickbench_q31/datafusion:parquet 102424410 / 104293878 / -1.8% 200300115 / 201134701 / -0.4% 0.51 / 0.52 / -1.4%
clickbench_q32/datafusion:parquet 305530462 / 306089478 / -0.2% 428773717 / 424915718 / +0.9% 0.71 / 0.72 / -1.1%
clickbench_q33/datafusion:parquet 373776598 / 377783599 / -1.1% 476040875 / 481246723 / -1.1% 0.79 / 0.79 / +0.0%
clickbench_q34/datafusion:parquet 376056608 / 377048659 / -0.3% 475213553 / 479639417 / -0.9% 0.79 / 0.79 / +0.7%
clickbench_q35/datafusion:parquet 65090044 / 63563220 / +2.4% 124282855 / 123325988 / +0.8% 0.52 / 0.52 / +1.6%
clickbench_q36/datafusion:parquet 73666358 / 73501280 / +0.2% 135342303 / 136532787 / -0.9% 0.54 / 0.54 / +1.1%
clickbench_q37/datafusion:parquet 35677190 / 35498334 / +0.5% 89735094 / 93131468 / -3.6% 0.40 / 0.38 / +4.3%
clickbench_q38/datafusion:parquet 47416540 / 47950282 / -1.1% 106607514 / 110172051 / -3.2% 0.44 / 0.44 / +2.2%
clickbench_q39/datafusion:parquet 143777770 / 143972169 / -0.1% 212192801 / 209821263 / +1.1% 0.68 / 0.69 / -1.3%
clickbench_q40/datafusion:parquet 19934974 / 20060919 / -0.6% 75791957 / 77890361 / -2.7% 0.26 / 0.26 / +2.1%
clickbench_q41/datafusion:parquet 18636562 / 18810111 / -0.9% 73238788 / 76909402 / -4.8% 0.25 / 0.24 / +4.0%
clickbench_q42/datafusion:parquet 19195676 / 18867186 / +1.7% 73246279 / 76225072 / -3.9% 0.26 / 0.25 / +5.9%
duckdb / vortex-file-compressed / ns (1.017x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2177758 / 2188209 / -0.5% 25849825 / 24556184 / +5.3% 0.08 / 0.09 / -5.5%
clickbench_q01/duckdb:vortex-file-compressed 7560151 / 7442721 / +1.6% 28739424 / 27998064 / +2.6% 0.26 / 0.27 / -1.0%
clickbench_q02/duckdb:vortex-file-compressed 9071379 / 9133224 / -0.7% 35931306 / 36597231 / -1.8% 0.25 / 0.25 / +1.2%
clickbench_q03/duckdb:vortex-file-compressed 13783171 / 14059888 / -2.0% 51319336 / 51358438 / -0.1% 0.27 / 0.27 / -1.9%
clickbench_q04/duckdb:vortex-file-compressed 56079820 / 56436078 / -0.6% 88663509 / 89736120 / -1.2% 0.63 / 0.63 / +0.6%
clickbench_q05/duckdb:vortex-file-compressed 65452998 / 64331934 / +1.7% 96846412 / 95184873 / +1.7% 0.68 / 0.68 / -0.0%
clickbench_q06/duckdb:vortex-file-compressed 2751292 / 2669851 / +3.1% 33051897 / 29337961 / +12.7% 🔴 0.08 / 0.09 / -8.5%
clickbench_q07/duckdb:vortex-file-compressed 9722294 / 9830624 / -1.1% 31145449 / 31205709 / -0.2% 0.31 / 0.32 / -0.9%
clickbench_q08/duckdb:vortex-file-compressed 70010564 / 69838881 / +0.2% 105237898 / 103253919 / +1.9% 0.67 / 0.68 / -1.6%
clickbench_q09/duckdb:vortex-file-compressed 94500108 / 93299509 / +1.3% 126832434 / 123846797 / +2.4% 0.75 / 0.75 / -1.1%
clickbench_q10/duckdb:vortex-file-compressed 27535492 / 28100660 / -2.0% 70462275 / 72526573 / -2.8% 0.39 / 0.39 / +0.9%
clickbench_q11/duckdb:vortex-file-compressed 31079706 / 31116402 / -0.1% 74308583 / 76600166 / -3.0% 0.42 / 0.41 / +3.0%
clickbench_q12/duckdb:vortex-file-compressed 68809725 / 70442182 / -2.3% 98270832 / 103172329 / -4.8% 0.70 / 0.68 / +2.6%
clickbench_q13/duckdb:vortex-file-compressed 126669928 / 125600145 / +0.9% 167292629 / 169215187 / -1.1% 0.76 / 0.74 / +2.0%
clickbench_q14/duckdb:vortex-file-compressed 74724845 / 74275254 / +0.6% 104099425 / 106539193 / -2.3% 0.72 / 0.70 / +3.0%
clickbench_q15/duckdb:vortex-file-compressed 76088428 / 76585102 / -0.6% 108753056 / 110044450 / -1.2% 0.70 / 0.70 / +0.5%
clickbench_q16/duckdb:vortex-file-compressed 135106528 / 136159082 / -0.8% 174225593 / 172222074 / +1.2% 0.78 / 0.79 / -1.9%
clickbench_q17/duckdb:vortex-file-compressed 138674617 / 139277210 / -0.4% 165222287 / 171845765 / -3.9% 0.84 / 0.81 / +3.6%
clickbench_q18/duckdb:vortex-file-compressed 254586060 / 253088790 / +0.6% 304631025 / 306865630 / -0.7% 0.84 / 0.82 / +1.3%
clickbench_q19/duckdb:vortex-file-compressed 9352048 / 9359452 / -0.1% 40594321 / 36955355 / +9.8% 0.23 / 0.25 / -9.0%
clickbench_q20/duckdb:vortex-file-compressed 77791041 / 67362522 / +15.5% 🔴 177819843 / 168982051 / +5.2% 0.44 / 0.40 / +9.7%
clickbench_q21/duckdb:vortex-file-compressed 91821218 / 85430538 / +7.5% 198872411 / 194926875 / +2.0% 0.46 / 0.44 / +5.3%
clickbench_q22/duckdb:vortex-file-compressed 156678480 / 172644084 / -9.2% 344978767 / 348457252 / -1.0% 0.45 / 0.50 / -8.3%
clickbench_q23/duckdb:vortex-file-compressed 40805602 / 40644354 / +0.4% 89235175 / 84983358 / +5.0% 0.46 / 0.48 / -4.4%
clickbench_q24/duckdb:vortex-file-compressed 15169459 / 14342731 / +5.8% 40897454 / 38965533 / +5.0% 0.37 / 0.37 / +0.8%
clickbench_q25/duckdb:vortex-file-compressed 18806990 / 19094219 / -1.5% 53458155 / 53631866 / -0.3% 0.35 / 0.36 / -1.2%
clickbench_q26/duckdb:vortex-file-compressed 11581900 / 11606280 / -0.2% 35150496 / 34216852 / +2.7% 0.33 / 0.34 / -2.9%
clickbench_q27/duckdb:vortex-file-compressed 90564910 / 53818840 / +68.3% 🔴 193404944 / 182606962 / +5.9% 0.47 / 0.29 / +58.9%
clickbench_q28/duckdb:vortex-file-compressed 508630699 / 506615462 / +0.4% 566688987 / 562365085 / +0.8% 0.90 / 0.90 / -0.4%
clickbench_q29/duckdb:vortex-file-compressed 16960088 / 17151741 / -1.1% 45304703 / 46663005 / -2.9% 0.37 / 0.37 / +1.8%
clickbench_q30/duckdb:vortex-file-compressed 65419814 / 61534303 / +6.3% 116788996 / 111826971 / +4.4% 0.56 / 0.55 / +1.8%
clickbench_q31/duckdb:vortex-file-compressed 115639688 / 111052913 / +4.1% 202721579 / 198163021 / +2.3% 0.57 / 0.56 / +1.8%
clickbench_q32/duckdb:vortex-file-compressed 354977712 / 362086490 / -2.0% 388481636 / 396384033 / -2.0% 0.91 / 0.91 / +0.0%
clickbench_q33/duckdb:vortex-file-compressed 341321410 / 342068842 / -0.2% 403856913 / 399572100 / +1.1% 0.85 / 0.86 / -1.3%
clickbench_q34/duckdb:vortex-file-compressed 350177811 / 352681171 / -0.7% 407513228 / 416878624 / -2.2% 0.86 / 0.85 / +1.6%
clickbench_q35/duckdb:vortex-file-compressed 58668098 / 58452586 / +0.4% 87607496 / 88109790 / -0.6% 0.67 / 0.66 / +0.9%
clickbench_q36/duckdb:vortex-file-compressed 11675036 / 11693611 / -0.2% 31687518 / 33521662 / -5.5% 0.37 / 0.35 / +5.6%
clickbench_q37/duckdb:vortex-file-compressed 8409460 / 8117459 / +3.6% 29126767 / 30363400 / -4.1% 0.29 / 0.27 / +8.0%
clickbench_q38/duckdb:vortex-file-compressed 8764403 / 9032632 / -3.0% 28648993 / 27827598 / +3.0% 0.31 / 0.32 / -5.8%
clickbench_q39/duckdb:vortex-file-compressed 18860148 / 19217858 / -1.9% 40661188 / 39507984 / +2.9% 0.46 / 0.49 / -4.6%
clickbench_q40/duckdb:vortex-file-compressed 7358918 / 7513924 / -2.1% 28581115 / 28838963 / -0.9% 0.26 / 0.26 / -1.2%
clickbench_q41/duckdb:vortex-file-compressed 8423102 / 8328864 / +1.1% 28824174 / 31260188 / -7.8% 0.29 / 0.27 / +9.7%
clickbench_q42/duckdb:vortex-file-compressed 7605320 / 7654281 / -0.6% 27153410 / 28422725 / -4.5% 0.28 / 0.27 / +4.0%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9564604 / 9129318 / +4.8% 14361834 / 14159030 / +1.4% 0.67 / 0.64 / +3.3%
clickbench_q01/duckdb:parquet 15304566 / 15125244 / +1.2% 20896001 / 20259313 / +3.1% 0.73 / 0.75 / -1.9%
clickbench_q02/duckdb:parquet 22689060 / 23320520 / -2.7% 31141192 / 31916374 / -2.4% 0.73 / 0.73 / -0.3%
clickbench_q03/duckdb:parquet 23179660 / 23233908 / -0.2% 36177093 / 35016050 / +3.3% 0.64 / 0.66 / -3.4%
clickbench_q04/duckdb:parquet 61366510 / 62267798 / -1.4% 76890822 / 73696819 / +4.3% 0.80 / 0.84 / -5.5%
clickbench_q05/duckdb:parquet 82996767 / 82635100 / +0.4% 97591070 / 95512019 / +2.2% 0.85 / 0.87 / -1.7%
clickbench_q06/duckdb:parquet 20779684 / 20076128 / +3.5% 30147215 / 28389281 / +6.2% 0.69 / 0.71 / -2.5%
clickbench_q07/duckdb:parquet 16841548 / 17682087 / -4.8% 23412935 / 25119487 / -6.8% 0.72 / 0.70 / +2.2%
clickbench_q08/duckdb:parquet 74726076 / 74898321 / -0.2% 89971123 / 89726067 / +0.3% 0.83 / 0.83 / -0.5%
clickbench_q09/duckdb:parquet 102002152 / 104325660 / -2.2% 116115079 / 120646528 / -3.8% 0.88 / 0.86 / +1.6%
clickbench_q10/duckdb:parquet 41269716 / 42126392 / -2.0% 53663960 / 57563624 / -6.8% 0.77 / 0.73 / +5.1%
clickbench_q11/duckdb:parquet 46224704 / 46938701 / -1.5% 60433108 / 61202585 / -1.3% 0.76 / 0.77 / -0.3%
clickbench_q12/duckdb:parquet 91519360 / 93887979 / -2.5% 104354329 / 108298425 / -3.6% 0.88 / 0.87 / +1.2%
clickbench_q13/duckdb:parquet 150380118 / 151469124 / -0.7% 166508110 / 168361815 / -1.1% 0.90 / 0.90 / +0.4%
clickbench_q14/duckdb:parquet 100998230 / 101254117 / -0.3% 117245612 / 118687199 / -1.2% 0.86 / 0.85 / +1.0%
clickbench_q15/duckdb:parquet 86138132 / 86748712 / -0.7% 98487282 / 98560763 / -0.1% 0.87 / 0.88 / -0.6%
clickbench_q16/duckdb:parquet 163740184 / 170707998 / -4.1% 178716026 / 177029538 / +1.0% 0.92 / 0.96 / -5.0%
clickbench_q17/duckdb:parquet 164280368 / 169668887 / -3.2% 182051813 / 197977988 / -8.0% 0.90 / 0.86 / +5.3%
clickbench_q18/duckdb:parquet 297471030 / 292642620 / +1.6% 314856390 / 326079575 / -3.4% 0.94 / 0.90 / +5.3%
clickbench_q19/duckdb:parquet 19723502 / 19700643 / +0.1% 27921751 / 27773014 / +0.5% 0.71 / 0.71 / -0.4%
clickbench_q20/duckdb:parquet 176958086 / 190978920 / -7.3% 227568011 / 232055023 / -1.9% 0.78 / 0.82 / -5.5%
clickbench_q21/duckdb:parquet 213510280 / 228062810 / -6.4% 251641639 / 266936760 / -5.7% 0.85 / 0.85 / -0.7%
clickbench_q22/duckdb:parquet 310384746 / 302797804 / +2.5% 353088283 / 355978566 / -0.8% 0.88 / 0.85 / +3.3%
clickbench_q23/duckdb:parquet 175652072 / 167862938 / +4.6% 228683335 / 237729479 / -3.8% 0.77 / 0.71 / +8.8%
clickbench_q24/duckdb:parquet 30156102 / 29541872 / +2.1% 42688258 / 43381087 / -1.6% 0.71 / 0.68 / +3.7%
clickbench_q25/duckdb:parquet 42613943 / 41991583 / +1.5% 57155164 / 56599903 / +1.0% 0.75 / 0.74 / +0.5%
clickbench_q26/duckdb:parquet 30068169 / 30369279 / -1.0% 44670123 / 46209417 / -3.3% 0.67 / 0.66 / +2.4%
clickbench_q27/duckdb:parquet 195476586 / 190065975 / +2.8% 230930035 / 230120626 / +0.4% 0.85 / 0.83 / +2.5%
clickbench_q28/duckdb:parquet 955243610 / 949899074 / +0.6% 939995389 / 948990336 / -0.9% 1.02 / 1.00 / +1.5%
clickbench_q29/duckdb:parquet 24422730 / 23737236 / +2.9% 31313901 / 31245091 / +0.2% 0.78 / 0.76 / +2.7%
clickbench_q30/duckdb:parquet 105325098 / 106011664 / -0.6% 124960668 / 127444228 / -1.9% 0.84 / 0.83 / +1.3%
clickbench_q31/duckdb:parquet 158522743 / 146634672 / +8.1% 198559674 / 172976489 / +14.8% 🔴 0.80 / 0.85 / -5.8%
clickbench_q32/duckdb:parquet 395860222 / 390260086 / +1.4% 401798949 / 411244685 / -2.3% 0.99 / 0.95 / +3.8%
clickbench_q33/duckdb:parquet 474013799 / 493471552 / -3.9% 458636832 / 461210119 / -0.6% 1.03 / 1.07 / -3.4%
clickbench_q34/duckdb:parquet 485611388 / 488116724 / -0.5% 470923544 / 469439609 / +0.3% 1.03 / 1.04 / -0.8%
clickbench_q35/duckdb:parquet 62314216 / 61500952 / +1.3% 71894723 / 73216515 / -1.8% 0.87 / 0.84 / +3.2%
clickbench_q36/duckdb:parquet 30482557 / 30105450 / +1.3% 38062353 / 35436995 / +7.4% 0.80 / 0.85 / -5.7%
clickbench_q37/duckdb:parquet 23485264 / 23151636 / +1.4% 29156734 / 29761032 / -2.0% 0.81 / 0.78 / +3.5%
clickbench_q38/duckdb:parquet 23306231 / 23786144 / -2.0% 30047215 / 30304768 / -0.8% 0.78 / 0.78 / -1.2%
clickbench_q39/duckdb:parquet 52959254 / 53006585 / -0.1% 60147878 / 59664972 / +0.8% 0.88 / 0.89 / -0.9%
clickbench_q40/duckdb:parquet 14759555 / 14810280 / -0.3% 19773950 / 20397616 / -3.1% 0.75 / 0.73 / +2.8%
clickbench_q41/duckdb:parquet 15398209 / 15582676 / -1.2% 20419893 / 20201301 / +1.1% 0.75 / 0.77 / -2.2%
clickbench_q42/duckdb:parquet 14379473 / 14224534 / +1.1% 20784885 / 20270735 / +2.5% 0.69 / 0.70 / -1.4%

@github-actions

ghost commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 57027fbc vs base e3e7a4eb
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.8%
Engines: DataFusion No clear signal (+8.4%, environment too noisy confidence) · DuckDB No clear signal (+5.2%, environment too noisy confidence)
Vortex (geomean): hot 1.129x ➖ · cold 1.101x ➖
Parquet (geomean): hot 1.057x ➖ · cold 1.100x ➖
Shifts: Parquet (control) +5.7% · Median polish +6.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.146x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 220776624 / 220908128 / -0.1% 655130869 / 798665481 / -18.0% 0.34 / 0.28 / +21.8%
tpch_q02/datafusion:vortex-file-compressed 336748223 / 302929101 / +11.2% 680394361 / 726768701 / -6.4% 0.49 / 0.42 / +18.7%
tpch_q03/datafusion:vortex-file-compressed 381321226 / 344118759 / +10.8% 1275130632 / 884519384 / +44.2% 🔴 0.30 / 0.39 / -23.1%
tpch_q04/datafusion:vortex-file-compressed 207332688 / 180720721 / +14.7% 418905046 / 439484787 / -4.7% 0.49 / 0.41 / +20.4%
tpch_q05/datafusion:vortex-file-compressed 450385509 / 453681767 / -0.7% 666696089 / 737227671 / -9.6% 0.68 / 0.62 / +9.8%
tpch_q06/datafusion:vortex-file-compressed 158226199 / 144951972 / +9.2% 335901219 / 309759858 / +8.4% 0.47 / 0.47 / +0.7%
tpch_q07/datafusion:vortex-file-compressed 384780691 / 399672404 / -3.7% 588339156 / 569229337 / +3.4% 0.65 / 0.70 / -6.9%
tpch_q08/datafusion:vortex-file-compressed 432389368 / 383673357 / +12.7% 605662317 / 554382923 / +9.2% 0.71 / 0.69 / +3.2%
tpch_q09/datafusion:vortex-file-compressed 287521493 / 260879130 / +10.2% 469290892 / 453227127 / +3.5% 0.61 / 0.58 / +6.4%
tpch_q10/datafusion:vortex-file-compressed 361180850 / 340833241 / +6.0% 522418899 / 690999187 / -24.4% 0.69 / 0.49 / +40.2%
tpch_q11/datafusion:vortex-file-compressed 265748688 / 249947519 / +6.3% 464810523 / 402413070 / +15.5% 0.57 / 0.62 / -8.0%
tpch_q12/datafusion:vortex-file-compressed 226911015 / 195468755 / +16.1% 466431601 / 418339198 / +11.5% 0.49 / 0.47 / +4.1%
tpch_q13/datafusion:vortex-file-compressed 140833300 / 137027333 / +2.8% 438068672 / 321133042 / +36.4% 🔴 0.32 / 0.43 / -24.7%
tpch_q14/datafusion:vortex-file-compressed 189038977 / 170972408 / +10.6% 371572680 / 334321639 / +11.1% 0.51 / 0.51 / -0.5%
tpch_q15/datafusion:vortex-file-compressed 306891054 / 283561215 / +8.2% 528158569 / 475383935 / +11.1% 0.58 / 0.60 / -2.6%
tpch_q16/datafusion:vortex-file-compressed 145183563 / 139827826 / +3.8% 338118230 / 285108116 / +18.6% 0.43 / 0.49 / -12.4%
tpch_q17/datafusion:vortex-file-compressed 523349796 / 209636688 / +149.6% 🔴 696346929 / 376657691 / +84.9% 🔴 0.75 / 0.56 / +35.0%
tpch_q18/datafusion:vortex-file-compressed 240317213 / 281376162 / -14.6% 507697061 / 592454334 / -14.3% 0.47 / 0.47 / -0.3%
tpch_q19/datafusion:vortex-file-compressed 234713912 / 227665383 / +3.1% 371067587 / 356639713 / +4.0% 0.63 / 0.64 / -0.9%
tpch_q20/datafusion:vortex-file-compressed 278240315 / 282703985 / -1.6% 457922955 / 484207509 / -5.4% 0.61 / 0.58 / +4.1%
tpch_q21/datafusion:vortex-file-compressed 805587357 / 430128480 / +87.3% 🔴 949781249 / 739919001 / +28.4% 0.85 / 0.58 / +45.9%
tpch_q22/datafusion:vortex-file-compressed 226115121 / 138813562 / +62.9% 🔴 713754512 / 351537383 / +103.0% 🔴 0.32 / 0.39 / -19.8%
datafusion / parquet / ns (1.058x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 156305925 / 147968900 / +5.6% 484339308 / 463170520 / +4.6% 0.32 / 0.32 / +1.0%
tpch_q02/datafusion:parquet 272693510 / 280184159 / -2.7% 512033965 / 469220440 / +9.1% 0.53 / 0.60 / -10.8%
tpch_q03/datafusion:parquet 266095539 / 248575117 / +7.0% 656580576 / 656311588 / +0.0% 0.41 / 0.38 / +7.0%
tpch_q04/datafusion:parquet 127246871 / 148727502 / -14.4% 327083551 / 276282923 / +18.4% 0.39 / 0.54 / -27.7%
tpch_q05/datafusion:parquet 368308221 / 355735540 / +3.5% 524717849 / 464161741 / +13.0% 0.70 / 0.77 / -8.4%
tpch_q06/datafusion:parquet 133051380 / 105354607 / +26.3% 273441803 / 248901795 / +9.9% 0.49 / 0.42 / +15.0%
tpch_q07/datafusion:parquet 347229389 / 339714675 / +2.2% 510320264 / 445154186 / +14.6% 0.68 / 0.76 / -10.8%
tpch_q08/datafusion:parquet 416772287 / 393245180 / +6.0% 548340526 / 540823140 / +1.4% 0.76 / 0.73 / +4.5%
tpch_q09/datafusion:parquet 369519004 / 384215404 / -3.8% 584926581 / 519268821 / +12.6% 0.63 / 0.74 / -14.6%
tpch_q10/datafusion:parquet 295473227 / 301813599 / -2.1% 446151258 / 457806999 / -2.5% 0.66 / 0.66 / +0.5%
tpch_q11/datafusion:parquet 259270791 / 266572566 / -2.7% 403406738 / 353666488 / +14.1% 0.64 / 0.75 / -14.7%
tpch_q12/datafusion:parquet 162858072 / 156042001 / +4.4% 343900300 / 355990026 / -3.4% 0.47 / 0.44 / +8.0%
tpch_q13/datafusion:parquet 280990819 / 271386451 / +3.5% 431228934 / 470367184 / -8.3% 0.65 / 0.58 / +12.9%
tpch_q14/datafusion:parquet 187375898 / 148636707 / +26.1% 319062379 / 269458259 / +18.4% 0.59 / 0.55 / +6.5%
tpch_q15/datafusion:parquet 360215016 / 315301915 / +14.2% 516657883 / 531316869 / -2.8% 0.70 / 0.59 / +17.5%
tpch_q16/datafusion:parquet 104798955 / 101389193 / +3.4% 257188555 / 197694415 / +30.1% 🔴 0.41 / 0.51 / -20.5%
tpch_q17/datafusion:parquet 288494295 / 265137437 / +8.8% 445060294 / 401388740 / +10.9% 0.65 / 0.66 / -1.9%
tpch_q18/datafusion:parquet 327032613 / 300416226 / +8.9% 555502989 / 434023003 / +28.0% 0.59 / 0.69 / -14.9%
tpch_q19/datafusion:parquet 158448868 / 150756706 / +5.1% 291895499 / 277938322 / +5.0% 0.54 / 0.54 / +0.1%
tpch_q20/datafusion:parquet 247069347 / 230827464 / +7.0% 379816803 / 402782137 / -5.7% 0.65 / 0.57 / +13.5%
tpch_q21/datafusion:parquet 360654719 / 286754908 / +25.8% 483939294 / 413215347 / +17.1% 0.75 / 0.69 / +7.4%
tpch_q22/datafusion:parquet 152882110 / 146853162 / +4.1% 317492081 / 320581571 / -1.0% 0.48 / 0.46 / +5.1%
duckdb / vortex-file-compressed / ns (1.112x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 260612622 / 251547517 / +3.6% 346060200 / 322561728 / +7.3% 0.75 / 0.78 / -3.4%
tpch_q02/duckdb:vortex-file-compressed 416891943 / 369061128 / +13.0% 468045635 / 543710855 / -13.9% 0.89 / 0.68 / +31.2%
tpch_q03/duckdb:vortex-file-compressed 482814908 / 402472953 / +20.0% 524792314 / 462553475 / +13.5% 0.92 / 0.87 / +5.7%
tpch_q04/duckdb:vortex-file-compressed 376176432 / 262481952 / +43.3% 🔴 465926066 / 268787264 / +73.3% 🔴 0.81 / 0.98 / -17.3%
tpch_q05/duckdb:vortex-file-compressed 587662530 / 587316296 / +0.1% 894359434 / 548780951 / +63.0% 🔴 0.66 / 1.07 / -38.6%
tpch_q06/duckdb:vortex-file-compressed 183534001 / 150858866 / +21.7% 239538996 / 207014811 / +15.7% 0.77 / 0.73 / +5.1%
tpch_q07/duckdb:vortex-file-compressed 412589710 / 410683683 / +0.5% 517630253 / 479426075 / +8.0% 0.80 / 0.86 / -7.0%
tpch_q08/duckdb:vortex-file-compressed 672573103 / 671183763 / +0.2% 626888804 / 744395145 / -15.8% 1.07 / 0.90 / +19.0%
tpch_q09/duckdb:vortex-file-compressed 423733638 / 490657713 / -13.6% 464469906 / 636224115 / -27.0% 0.91 / 0.77 / +18.3%
tpch_q10/duckdb:vortex-file-compressed 595711365 / 528675038 / +12.7% 670765151 / 595645973 / +12.6% 0.89 / 0.89 / +0.1%
tpch_q11/duckdb:vortex-file-compressed 331000643 / 285739994 / +15.8% 340221511 / 296647119 / +14.7% 0.97 / 0.96 / +1.0%
tpch_q12/duckdb:vortex-file-compressed 271124742 / 225553685 / +20.2% 341214071 / 316202457 / +7.9% 0.79 / 0.71 / +11.4%
tpch_q13/duckdb:vortex-file-compressed 280975761 / 255625797 / +9.9% 227109301 / 231139436 / -1.7% 1.24 / 1.11 / +11.9%
tpch_q14/duckdb:vortex-file-compressed 247776746 / 234076746 / +5.9% 314891139 / 253956435 / +24.0% 0.79 / 0.92 / -14.6%
tpch_q15/duckdb:vortex-file-compressed 253273007 / 244545564 / +3.6% 268499279 / 307304937 / -12.6% 0.94 / 0.80 / +18.5%
tpch_q16/duckdb:vortex-file-compressed 297159679 / 203121865 / +46.3% 🔴 223395639 / 201516433 / +10.9% 1.33 / 1.01 / +32.0%
tpch_q17/duckdb:vortex-file-compressed 345573510 / 314521993 / +9.9% 378669553 / 348296231 / +8.7% 0.91 / 0.90 / +1.1%
tpch_q18/duckdb:vortex-file-compressed 381624126 / 437212184 / -12.7% 712215285 / 400107108 / +78.0% 🔴 0.54 / 1.09 / -51.0%
tpch_q19/duckdb:vortex-file-compressed 305387233 / 293381061 / +4.1% 334564845 / 355162351 / -5.8% 0.91 / 0.83 / +10.5%
tpch_q20/duckdb:vortex-file-compressed 564118703 / 351619976 / +60.4% 🔴 677772242 / 455932338 / +48.7% 🔴 0.83 / 0.77 / +7.9%
tpch_q21/duckdb:vortex-file-compressed 708682811 / 631385912 / +12.2% 758831730 / 644481724 / +17.7% 0.93 / 0.98 / -4.7%
tpch_q22/duckdb:vortex-file-compressed 239308239 / 242912440 / -1.5% 287844667 / 478815187 / -39.9% 🟢 0.83 / 0.51 / +63.9%
duckdb / parquet / ns (1.057x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 185101757 / 153207646 / +20.8% 217599913 / 227625449 / -4.4% 0.85 / 0.67 / +26.4%
tpch_q02/duckdb:parquet 466114714 / 433870316 / +7.4% 464013897 / 432172789 / +7.4% 1.00 / 1.00 / +0.1%
tpch_q03/duckdb:parquet 534061412 / 355566261 / +50.2% 🔴 1098262602 / 432747178 / +153.8% 🔴 0.49 / 0.82 / -40.8%
tpch_q04/duckdb:parquet 246078670 / 267063892 / -7.9% 348320617 / 299170237 / +16.4% 0.71 / 0.89 / -20.9%
tpch_q05/duckdb:parquet 564492167 / 491344281 / +14.9% 642941124 / 622376678 / +3.3% 0.88 / 0.79 / +11.2%
tpch_q06/duckdb:parquet 168644155 / 155837045 / +8.2% 199213423 / 176574885 / +12.8% 0.85 / 0.88 / -4.1%
tpch_q07/duckdb:parquet 546796070 / 386085161 / +41.6% 🔴 769649659 / 410618912 / +87.4% 🔴 0.71 / 0.94 / -24.4%
tpch_q08/duckdb:parquet 643929949 / 604412430 / +6.5% 811677795 / 642103875 / +26.4% 0.79 / 0.94 / -15.7%
tpch_q09/duckdb:parquet 606875802 / 577358986 / +5.1% 627924177 / 634801195 / -1.1% 0.97 / 0.91 / +6.3%
tpch_q10/duckdb:parquet 621432856 / 561042418 / +10.8% 664577746 / 718115083 / -7.5% 0.94 / 0.78 / +19.7%
tpch_q11/duckdb:parquet 316168796 / 257091552 / +23.0% 373936022 / 274199218 / +36.4% 🔴 0.85 / 0.94 / -9.8%
tpch_q12/duckdb:parquet 249838800 / 236969674 / +5.4% 295557886 / 239892417 / +23.2% 0.85 / 0.99 / -14.4%
tpch_q13/duckdb:parquet 342761340 / 525605015 / -34.8% 🟢 477000827 / 490165225 / -2.7% 0.72 / 1.07 / -33.0%
tpch_q14/duckdb:parquet 289741125 / 493494580 / -41.3% 🟢 340638026 / 510192638 / -33.2% 🟢 0.85 / 0.97 / -12.1%
tpch_q15/duckdb:parquet 224030392 / 193796646 / +15.6% 234625107 / 220263839 / +6.5% 0.95 / 0.88 / +8.5%
tpch_q16/duckdb:parquet 291213223 / 275422143 / +5.7% 299291282 / 265041459 / +12.9% 0.97 / 1.04 / -6.4%
tpch_q17/duckdb:parquet 284700628 / 268673114 / +6.0% 354682859 / 314417743 / +12.8% 0.80 / 0.85 / -6.1%
tpch_q18/duckdb:parquet 341189409 / 354347910 / -3.7% 372378706 / 378358673 / -1.6% 0.92 / 0.94 / -2.2%
tpch_q19/duckdb:parquet 283008321 / 254948633 / +11.0% 334266251 / 319652714 / +4.6% 0.85 / 0.80 / +6.2%
tpch_q20/duckdb:parquet 497957384 / 436174651 / +14.2% 540828313 / 509291626 / +6.2% 0.92 / 0.86 / +7.5%
tpch_q21/duckdb:parquet 468329251 / 450386069 / +4.0% 522230051 / 568007400 / -8.1% 0.90 / 0.79 / +13.1%
tpch_q22/duckdb:parquet 321419741 / 301691271 / +6.5% 362083196 / 333965999 / +8.4% 0.89 / 0.90 / -1.7%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant