Skip to content

Fix DataFusion expression conversion and pushdown semantics - #9785

Merged
robert3005 merged 8 commits into
developfrom
adamg/df-fix-bugs-conversion
Oct 12, 2026
Merged

robert3005 merged 8 commits into
developfrom
adamg/df-fix-bugs-conversion

Conversation

@AdamGS

@AdamGS AdamGS commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Fix native pushdown in vortex-datafusion to preserve DataFusion semantics and fall back for unsupported expressions. Replace separate eligibility and conversion checks with schema-aware try_convert, preserving SQL null semantics for IN/NOT IN and rejecting pushdown where casts, short-circuit evaluation, or nullable struct access could differ. Partially supported projections now run entirely in DataFusion over deduplicated raw columns.

  • Re-split filters after each file’s schema adaptation: Vortex evaluates supported conjuncts, and DataFusion evaluates residuals before projection and limit. Disable scan limits whenever filters exist, include file and predicate context in errors, and fix v2 pushdown after projection swapping.

  • Add conversion and residual-filter regression tests, plus 16 SQL cases compared against an Arrow MemTable with pushdown enabled and disabled.

  • Rename Convertor to Converter

LLMS were used as part of this work

@AdamGS AdamGS added the changelog/fix A bug fix label Sep 7, 2026
@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 01bc390 to 47d4415 Compare September 7, 2026 11:57
@codspeed

codspeed Bot commented Sep 7, 2026 •

Copy link
Copy Markdown

Merging this PR will regress 1 benchmark

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ 12 benchmarks spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
❌ 1 regressed benchmark
✅ 2202 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime bitpack_blocked_compress_avx512 4.9 µs 5.6 µs -13.27%
⚡ WallTime threshold_neon[8] 4 µs 2.9 µs +38.49%
⚡ WallTime threshold_neon[80] 5.8 µs 4.7 µs +21.98%
⚡ WallTime threshold_neon[64] 5.3 µs 4.4 µs +21.54%
⚡ WallTime filter_neon[64] 3.5 µs 3 µs +15.82%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/df-fix-bugs-conversion (7bb0bd5) with develop (9d5a844)

Open in CodSpeed

@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 47d4415 to 4d7f747 Compare September 7, 2026 11:58
@AdamGS AdamGS added ext/datafusion Relates to the DataFusion integration action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Sep 7, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 7, 2026
@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done c31dafb statpopgen 1 Explore Profiling Data
🟢 Done c31dafb clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done c31dafb fineweb-s3 1 Explore Profiling Data
🟢 Done c31dafb fineweb 1 Explore Profiling Data
🟢 Done c31dafb tpch-nvme-10 1 Explore Profiling Data
🟢 Done c31dafb tpcds-nvme 1 Explore Profiling Data
🟢 Done c31dafb clickbench-nvme 1 Explore Profiling Data
🟢 Done c31dafb polarsignals 1 Explore Profiling Data
🟢 Done c31dafb tpch-s3 1 Explore Profiling Data
🟢 Done c31dafb tpch-nvme 1 Explore Profiling Data
Previous Runs (40)
Status Commit Job Attempt Link
🟢 Done 26fd045 clickbench-nvme 1 Explore Profiling Data
🟢 Done 26fd045 polarsignals 1 Explore Profiling Data
🟢 Done 26fd045 tpch-nvme 1 Explore Profiling Data
🟢 Done 26fd045 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 26fd045 statpopgen 1 Explore Profiling Data
🟢 Done 26fd045 fineweb-s3 1 Explore Profiling Data
🟢 Done 26fd045 fineweb 1 Explore Profiling Data
🟢 Done 26fd045 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 26fd045 tpcds-nvme 1 Explore Profiling Data
🟢 Done 26fd045 tpch-s3 1 Explore Profiling Data
🟢 Done d37c4e1 tpch-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 tpch-s3 1 Explore Profiling Data
🟢 Done d37c4e1 statpopgen 1 Explore Profiling Data
🟢 Done d37c4e1 tpch-nvme-10 1 Explore Profiling Data
🟢 Done d37c4e1 fineweb-s3 1 Explore Profiling Data
🟢 Done d37c4e1 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 fineweb 1 Explore Profiling Data
🟢 Done d37c4e1 clickbench-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 tpcds-nvme 1 Explore Profiling Data
🟢 Done d37c4e1 polarsignals 1 Explore Profiling Data
🟢 Done 55e1679 statpopgen 1 Explore Profiling Data
🟢 Done 55e1679 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 55e1679 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 55e1679 fineweb 1 Explore Profiling Data
🟢 Done 55e1679 fineweb-s3 1 Explore Profiling Data
🟢 Done 55e1679 clickbench-nvme 1 Explore Profiling Data
🟢 Done 55e1679 tpcds-nvme 1 Explore Profiling Data
🟢 Done 55e1679 polarsignals 1 Explore Profiling Data
🟢 Done 55e1679 tpch-s3 1 Explore Profiling Data
🟢 Done 55e1679 tpch-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 statpopgen 1 Explore Profiling Data
🟢 Done 095b9a4 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 095b9a4 fineweb 1 Explore Profiling Data
🟢 Done 095b9a4 fineweb-s3 1 Explore Profiling Data
🟢 Done 095b9a4 tpcds-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 clickbench-nvme 1 Explore Profiling Data
🟢 Done 095b9a4 polarsignals 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-s3 1 Explore Profiling Data
🟢 Done 095b9a4 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR c31dafbf vs base 138c2802
Vortex (geomean): hot 1.006x ➖ · cold 0.976x ➖


datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45024306 / 45117837 / -0.2% 89989697 / 92821478 / -3.1% 0.50 / 0.49 / +2.9%
polarsignals_q01/datafusion:vortex-file-compressed 50564856 / 50924376 / -0.7% 116164477 / 124348489 / -6.6% 0.44 / 0.41 / +6.3%
polarsignals_q02/datafusion:vortex-file-compressed 35238323 / 35251762 / -0.0% 81012269 / 87430694 / -7.3% 0.43 / 0.40 / +7.9%
polarsignals_q03/datafusion:vortex-file-compressed 53986194 / 54081278 / -0.2% 123684721 / 121500000 / +1.8% 0.44 / 0.45 / -1.9%
polarsignals_q04/datafusion:vortex-file-compressed 9699337 / 9483878 / +2.3% 52015627 / 52628598 / -1.2% 0.19 / 0.18 / +3.5%
polarsignals_q05/datafusion:vortex-file-compressed 11891610 / 11496956 / +3.4% 56663915 / 57785618 / -1.9% 0.21 / 0.20 / +5.5%
polarsignals_q06/datafusion:vortex-file-compressed 20979302 / 20919970 / +0.3% 64483860 / 65715434 / -1.9% 0.33 / 0.32 / +2.2%
polarsignals_q07/datafusion:vortex-file-compressed 11766939 / 11393235 / +3.3% 56102739 / 57401886 / -2.3% 0.21 / 0.20 / +5.7%
polarsignals_q08/datafusion:vortex-file-compressed 98069276 / 98409502 / -0.3% 165801469 / 166909896 / -0.7% 0.59 / 0.59 / +0.3%
polarsignals_q09/datafusion:vortex-file-compressed 10072490 / 10245370 / -1.7% 51689134 / 51843504 / -0.3% 0.19 / 0.20 / -1.4%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.958x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.987x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16291690 / 16180961 / +0.7% 44078944 / 48007442 / -8.2% 0.37 / 0.34 / +9.7%
tpch_q02/datafusion:vortex-file-compressed 17441235 / 17581109 / -0.8% 37034901 / 38635643 / -4.1% 0.47 / 0.46 / +3.5%
tpch_q03/datafusion:vortex-file-compressed 19228340 / 19256628 / -0.1% 50188032 / 47324454 / +6.1% 0.38 / 0.41 / -5.8%
tpch_q04/datafusion:vortex-file-compressed 10584104 / 9800144 / +8.0% 33048012 / 33919427 / -2.6% 0.32 / 0.29 / +10.8%
tpch_q05/datafusion:vortex-file-compressed 37376431 / 37220254 / +0.4% 63487319 / 65460833 / -3.0% 0.59 / 0.57 / +3.5%
tpch_q06/datafusion:vortex-file-compressed 6293942 / 6279825 / +0.2% 28933291 / 31196095 / -7.3% 0.22 / 0.20 / +8.1%
tpch_q07/datafusion:vortex-file-compressed 52165449 / 51697017 / +0.9% 80889546 / 83520843 / -3.2% 0.64 / 0.62 / +4.2%
tpch_q08/datafusion:vortex-file-compressed 52513323 / 51405301 / +2.2% 81360918 / 83632585 / -2.7% 0.65 / 0.61 / +5.0%
tpch_q09/datafusion:vortex-file-compressed 49740223 / 48982586 / +1.5% 78093480 / 76936851 / +1.5% 0.64 / 0.64 / +0.0%
tpch_q10/datafusion:vortex-file-compressed 16994016 / 16846770 / +0.9% 47792994 / 50098371 / -4.6% 0.36 / 0.34 / +5.7%
tpch_q11/datafusion:vortex-file-compressed 15226820 / 15169252 / +0.4% 33794060 / 34322387 / -1.5% 0.45 / 0.44 / +1.9%
tpch_q12/datafusion:vortex-file-compressed 22575729 / 22682157 / -0.5% 45580802 / 47268786 / -3.6% 0.50 / 0.48 / +3.2%
tpch_q13/datafusion:vortex-file-compressed 20100054 / 20093525 / +0.0% 40307354 / 42495517 / -5.1% 0.50 / 0.47 / +5.5%
tpch_q14/datafusion:vortex-file-compressed 14937749 / 15110230 / -1.1% 39482883 / 40869925 / -3.4% 0.38 / 0.37 / +2.3%
tpch_q15/datafusion:vortex-file-compressed 18805519 / 18606313 / +1.1% 46908506 / 46274198 / +1.4% 0.40 / 0.40 / -0.3%
tpch_q16/datafusion:vortex-file-compressed 18851701 / 18519312 / +1.8% 37290030 / 39212611 / -4.9% 0.51 / 0.47 / +7.0%
tpch_q17/datafusion:vortex-file-compressed 27908608 / 28233163 / -1.1% 56688671 / 60037028 / -5.6% 0.49 / 0.47 / +4.7%
tpch_q18/datafusion:vortex-file-compressed 37145173 / 36966283 / +0.5% 60341698 / 59198124 / +1.9% 0.62 / 0.62 / -1.4%
tpch_q19/datafusion:vortex-file-compressed 13879598 / 13670607 / +1.5% 39363654 / 39416891 / -0.1% 0.35 / 0.35 / +1.7%
tpch_q20/datafusion:vortex-file-compressed 21059057 / 20788401 / +1.3% 45429484 / 46102879 / -1.5% 0.46 / 0.45 / +2.8%
tpch_q21/datafusion:vortex-file-compressed 38588228 / 39166957 / -1.5% 67860482 / 68613489 / -1.1% 0.57 / 0.57 / -0.4%
tpch_q22/datafusion:vortex-file-compressed 11268985 / 11230815 / +0.3% 31817326 / 32889262 / -3.3% 0.35 / 0.34 / +3.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67530517 / 67460315 / +0.1% 84039821 / 88046309 / -4.6% 0.80 / 0.77 / +4.9%
tpch_q02/datafusion:parquet 53271094 / 53648488 / -0.7% 71150019 / 73426513 / -3.1% 0.75 / 0.73 / +2.5%
tpch_q03/datafusion:parquet 72608184 / 72871109 / -0.4% 96160787 / 99871851 / -3.7% 0.76 / 0.73 / +3.5%
tpch_q04/datafusion:parquet 40279603 / 39845203 / +1.1% 60818616 / 63136844 / -3.7% 0.66 / 0.63 / +4.9%
tpch_q05/datafusion:parquet 88110916 / 88974311 / -1.0% 116552203 / 118654277 / -1.8% 0.76 / 0.75 / +0.8%
tpch_q06/datafusion:parquet 28429536 / 28184346 / +0.9% 46328843 / 50049031 / -7.4% 0.61 / 0.56 / +9.0%
tpch_q07/datafusion:parquet 94021009 / 94762897 / -0.8% 122263533 / 125509199 / -2.6% 0.77 / 0.76 / +1.9%
tpch_q08/datafusion:parquet 94956746 / 94555026 / +0.4% 122038317 / 131689831 / -7.3% 0.78 / 0.72 / +8.4%
tpch_q09/datafusion:parquet 114811535 / 113643597 / +1.0% 144227393 / 148812797 / -3.1% 0.80 / 0.76 / +4.2%
tpch_q10/datafusion:parquet 80610548 / 80599342 / +0.0% 112078094 / 114121174 / -1.8% 0.72 / 0.71 / +1.8%
tpch_q11/datafusion:parquet 39064169 / 39001511 / +0.2% 60654426 / 64759274 / -6.3% 0.64 / 0.60 / +6.9%
tpch_q12/datafusion:parquet 62025014 / 62122921 / -0.2% 89158460 / 88018614 / +1.3% 0.70 / 0.71 / -1.4%
tpch_q13/datafusion:parquet 160081567 / 159561945 / +0.3% 182113018 / 181356503 / +0.4% 0.88 / 0.88 / -0.1%
tpch_q14/datafusion:parquet 40256952 / 39829986 / +1.1% 65433255 / 66300455 / -1.3% 0.62 / 0.60 / +2.4%
tpch_q15/datafusion:parquet 46943947 / 46656148 / +0.6% 67713413 / 68686940 / -1.4% 0.69 / 0.68 / +2.1%
tpch_q16/datafusion:parquet 38259545 / 38436293 / -0.5% 58781559 / 59480330 / -1.2% 0.65 / 0.65 / +0.7%
tpch_q17/datafusion:parquet 117222415 / 116996182 / +0.2% 143748929 / 143479647 / +0.2% 0.82 / 0.82 / +0.0%
tpch_q18/datafusion:parquet 115512623 / 115637691 / -0.1% 139812125 / 136696518 / +2.3% 0.83 / 0.85 / -2.3%
tpch_q19/datafusion:parquet 50419417 / 50285540 / +0.3% 76586654 / 79044087 / -3.1% 0.66 / 0.64 / +3.5%
tpch_q20/datafusion:parquet 58095645 / 59400523 / -2.2% 85020481 / 85808463 / -0.9% 0.68 / 0.69 / -1.3%
tpch_q21/datafusion:parquet 99118271 / 98736129 / +0.4% 124685004 / 123370631 / +1.1% 0.79 / 0.80 / -0.7%
tpch_q22/datafusion:parquet 41555748 / 41248028 / +0.7% 60940950 / 58537896 / +4.1% 0.68 / 0.70 / -3.2%
duckdb / vortex-file-compressed / ns (0.981x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11081367 / 9304635 / +19.1% 🔴 21316821 / 17223003 / +23.8% 🔴 0.52 / 0.54 / -3.8%
tpch_q02/duckdb:vortex-file-compressed 17344985 / 17576866 / -1.3% 27434264 / 27908490 / -1.7% 0.63 / 0.63 / +0.4%
tpch_q03/duckdb:vortex-file-compressed 18107055 / 21321823 / -15.1% 🟢 31751729 / 35603211 / -10.8% 🟢 0.57 / 0.60 / -4.8%
tpch_q04/duckdb:vortex-file-compressed 17001648 / 16924395 / +0.5% 29910138 / 29913643 / -0.0% 0.57 / 0.57 / +0.5%
tpch_q05/duckdb:vortex-file-compressed 21528201 / 21772494 / -1.1% 38081820 / 36488351 / +4.4% 0.57 / 0.60 / -5.3%
tpch_q06/duckdb:vortex-file-compressed 5527457 / 5629831 / -1.8% 14498442 / 17923227 / -19.1% 🟢 0.38 / 0.31 / +21.4%
tpch_q07/duckdb:vortex-file-compressed 21268999 / 21526450 / -1.2% 36585971 / 41636020 / -12.1% 🟢 0.58 / 0.52 / +12.4%
tpch_q08/duckdb:vortex-file-compressed 23081255 / 23493293 / -1.8% 36810667 / 39701942 / -7.3% 0.63 / 0.59 / +6.0%
tpch_q09/duckdb:vortex-file-compressed 30148573 / 29920058 / +0.8% 45424341 / 50850253 / -10.7% 🟢 0.66 / 0.59 / +12.8%
tpch_q10/duckdb:vortex-file-compressed 28064509 / 28142083 / -0.3% 46076492 / 45163879 / +2.0% 0.61 / 0.62 / -2.3%
tpch_q11/duckdb:vortex-file-compressed 8718487 / 8813233 / -1.1% 14420408 / 14213389 / +1.5% 0.60 / 0.62 / -2.5%
tpch_q12/duckdb:vortex-file-compressed 16638945 / 16386784 / +1.5% 32910498 / 30073296 / +9.4% 0.51 / 0.54 / -7.2%
tpch_q13/duckdb:vortex-file-compressed 22140967 / 22423279 / -1.3% 39400898 / 43152238 / -8.7% 0.56 / 0.52 / +8.1%
tpch_q14/duckdb:vortex-file-compressed 13039961 / 13421655 / -2.8% 24054587 / 24559884 / -2.1% 0.54 / 0.55 / -0.8%
tpch_q15/duckdb:vortex-file-compressed 8812567 / 11036418 / -20.2% 🟢 17494087 / 23491133 / -25.5% 🟢 0.50 / 0.47 / +7.2%
tpch_q16/duckdb:vortex-file-compressed 18232903 / 18488211 / -1.4% 23771691 / 27451372 / -13.4% 🟢 0.77 / 0.67 / +13.9%
tpch_q17/duckdb:vortex-file-compressed 15830159 / 16564529 / -4.4% 30975941 / 39928291 / -22.4% 🟢 0.51 / 0.41 / +23.2%
tpch_q18/duckdb:vortex-file-compressed 24405527 / 25017667 / -2.4% 33557156 / 38639204 / -13.2% 🟢 0.73 / 0.65 / +12.3%
tpch_q19/duckdb:vortex-file-compressed 23131141 / 23534297 / -1.7% 37040946 / 37262096 / -0.6% 0.62 / 0.63 / -1.1%
tpch_q20/duckdb:vortex-file-compressed 17109190 / 17465480 / -2.0% 37204624 / 37130322 / +0.2% 0.46 / 0.47 / -2.2%
tpch_q21/duckdb:vortex-file-compressed 67239824 / 66225812 / +1.5% 83165776 / 81567173 / +2.0% 0.81 / 0.81 / -0.4%
tpch_q22/duckdb:vortex-file-compressed 12115931 / 12067966 / +0.4% 20358183 / 23113905 / -11.9% 🟢 0.60 / 0.52 / +14.0%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60034579 / 60127350 / -0.2% 66793239 / 65963731 / +1.3% 0.90 / 0.91 / -1.4%
tpch_q02/duckdb:parquet 34685720 / 34802346 / -0.3% 44141788 / 43496751 / +1.5% 0.79 / 0.80 / -1.8%
tpch_q03/duckdb:parquet 62072051 / 62777931 / -1.1% 73127875 / 74475244 / -1.8% 0.85 / 0.84 / +0.7%
tpch_q04/duckdb:parquet 43095437 / 43626697 / -1.2% 53169364 / 53674020 / -0.9% 0.81 / 0.81 / -0.3%
tpch_q05/duckdb:parquet 60496024 / 61202393 / -1.2% 72070044 / 73227925 / -1.6% 0.84 / 0.84 / +0.4%
tpch_q06/duckdb:parquet 20248850 / 20265952 / -0.1% 25007442 / 24306006 / +2.9% 0.81 / 0.83 / -2.9%
tpch_q07/duckdb:parquet 60663984 / 61055640 / -0.6% 71431442 / 71654580 / -0.3% 0.85 / 0.85 / -0.3%
tpch_q08/duckdb:parquet 73217793 / 73501389 / -0.4% 85807170 / 87398614 / -1.8% 0.85 / 0.84 / +1.5%
tpch_q09/duckdb:parquet 113626731 / 114488706 / -0.8% 127260485 / 126616287 / +0.5% 0.89 / 0.90 / -1.3%
tpch_q10/duckdb:parquet 108193883 / 109220150 / -0.9% 121260752 / 123186840 / -1.6% 0.89 / 0.89 / +0.6%
tpch_q11/duckdb:parquet 19780625 / 20215634 / -2.2% 24128861 / 24598723 / -1.9% 0.82 / 0.82 / -0.2%
tpch_q12/duckdb:parquet 41087237 / 41483156 / -1.0% 49053695 / 50034261 / -2.0% 0.84 / 0.83 / +1.0%
tpch_q13/duckdb:parquet 238707175 / 239291726 / -0.2% 247473681 / 247676181 / -0.1% 0.96 / 0.97 / -0.2%
tpch_q14/duckdb:parquet 43424895 / 43824332 / -0.9% 51594973 / 51490997 / +0.2% 0.84 / 0.85 / -1.1%
tpch_q15/duckdb:parquet 25201086 / 25006288 / +0.8% 30724667 / 31259893 / -1.7% 0.82 / 0.80 / +2.5%
tpch_q16/duckdb:parquet 50610880 / 49977726 / +1.3% 57285290 / 58550248 / -2.2% 0.88 / 0.85 / +3.5%
tpch_q17/duckdb:parquet 44246604 / 44625169 / -0.8% 53882273 / 54135128 / -0.5% 0.82 / 0.82 / -0.4%
tpch_q18/duckdb:parquet 89402708 / 90408714 / -1.1% 96662618 / 98746989 / -2.1% 0.92 / 0.92 / +1.0%
tpch_q19/duckdb:parquet 61053027 / 61305899 / -0.4% 71216707 / 71364210 / -0.2% 0.86 / 0.86 / -0.2%
tpch_q20/duckdb:parquet 58341999 / 58893370 / -0.9% 70716695 / 71600232 / -1.2% 0.83 / 0.82 / +0.3%
tpch_q21/duckdb:parquet 136330564 / 137587611 / -0.9% 153801805 / 148476427 / +3.6% 0.89 / 0.93 / -4.3%
tpch_q22/duckdb:parquet 50361632 / 50638246 / -0.5% 57949018 / 57933443 / +0.0% 0.87 / 0.87 / -0.6%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.2%
Engines: DataFusion No clear signal (+3.5%, low confidence) · DuckDB No clear signal (+6.9%, medium confidence)
Vortex (geomean): hot 1.049x ➖ · cold 0.980x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.978x ➖
Shifts: Parquet (control) -0.3% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.027x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6723765 / 6724472 / -0.0% 21252175 / 22149152 / -4.0% 0.32 / 0.30 / +4.2%
fineweb_q01/datafusion:vortex-file-compressed 13692126 / 12987320 / +5.4% 51470738 / 52436297 / -1.8% 0.27 / 0.25 / +7.4%
fineweb_q02/datafusion:vortex-file-compressed 12973476 / 12581472 / +3.1% 55837218 / 57924714 / -3.6% 0.23 / 0.22 / +7.0%
fineweb_q03/datafusion:vortex-file-compressed 20097111 / 20174838 / -0.4% 104955398 / 115977407 / -9.5% 0.19 / 0.17 / +10.1%
fineweb_q04/datafusion:vortex-file-compressed 76858671 / 77095780 / -0.3% 159503036 / 164387751 / -3.0% 0.48 / 0.47 / +2.7%
fineweb_q05/datafusion:vortex-file-compressed 60686898 / 60750653 / -0.1% 138351737 / 138769770 / -0.3% 0.44 / 0.44 / +0.2%
fineweb_q06/datafusion:vortex-file-compressed 18273794 / 18539704 / -1.4% 112610717 / 107451485 / +4.8% 0.16 / 0.17 / -6.0%
fineweb_q07/datafusion:vortex-file-compressed 18289144 / 17137146 / +6.7% 103651815 / 102770797 / +0.9% 0.18 / 0.17 / +5.8%
fineweb_q08/datafusion:vortex-file-compressed 10826912 / 9667249 / +12.0% 🔴 51547203 / 44198994 / +16.6% 🔴 0.21 / 0.22 / -4.0%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9217232 / 9596814 / -4.0% 37591160 / 34399987 / +9.3% 0.25 / 0.28 / -12.1%
fineweb_q01/datafusion:parquet 75513274 / 74653642 / +1.2% 157125199 / 173769337 / -9.6% 0.48 / 0.43 / +11.9%
fineweb_q02/datafusion:parquet 74183916 / 74718486 / -0.7% 151134062 / 162534073 / -7.0% 0.49 / 0.46 / +6.8%
fineweb_q03/datafusion:parquet 73627976 / 74556488 / -1.2% 152123289 / 168351521 / -9.6% 0.48 / 0.44 / +9.3%
fineweb_q04/datafusion:parquet 81928316 / 82492793 / -0.7% 150260529 / 166711560 / -9.9% 0.55 / 0.49 / +10.2%
fineweb_q05/datafusion:parquet 80419461 / 80936380 / -0.6% 153144859 / 166937110 / -8.3% 0.53 / 0.48 / +8.3%
fineweb_q06/datafusion:parquet 75713463 / 76579112 / -1.1% 148361205 / 169204598 / -12.3% 🟢 0.51 / 0.45 / +12.8%
fineweb_q07/datafusion:parquet 74474482 / 74612688 / -0.2% 153223240 / 170460825 / -10.1% 🟢 0.49 / 0.44 / +11.0%
fineweb_q08/datafusion:parquet 72784348 / 72581208 / +0.3% 157533653 / 159984794 / -1.5% 0.46 / 0.45 / +1.8%
duckdb / vortex-file-compressed / ns (1.071x ➖, 2↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2683484 / 3036466 / -11.6% 🟢 5098261 / 7428023 / -31.4% 🟢 0.53 / 0.41 / +28.8%
fineweb_q01/duckdb:vortex-file-compressed 17857740 / 19264682 / -7.3% 56078776 / 61724061 / -9.1% 0.32 / 0.31 / +2.0%
fineweb_q02/duckdb:vortex-file-compressed 20790430 / 17681002 / +17.6% 🔴 63236623 / 58447292 / +8.2% 0.33 / 0.30 / +8.7%
fineweb_q03/duckdb:vortex-file-compressed 29197362 / 26882284 / +8.6% 124202229 / 110709726 / +12.2% 🔴 0.24 / 0.24 / -3.2%
fineweb_q04/duckdb:vortex-file-compressed 75831609 / 98104279 / -22.7% 🟢 123275780 / 254922570 / -51.6% 🟢 0.62 / 0.38 / +59.8%
fineweb_q05/duckdb:vortex-file-compressed 69810197 / 60604728 / +15.2% 🔴 169343681 / 105958261 / +59.8% 🔴 0.41 / 0.57 / -27.9%
fineweb_q06/duckdb:vortex-file-compressed 51928629 / 42714656 / +21.6% 🔴 151065093 / 144176885 / +4.8% 0.34 / 0.30 / +16.0%
fineweb_q07/duckdb:vortex-file-compressed 30276272 / 25058628 / +20.8% 🔴 112666517 / 96534811 / +16.7% 🔴 0.27 / 0.26 / +3.5%
fineweb_q08/duckdb:vortex-file-compressed 8495546 / 6265480 / +35.6% 🔴 15175684 / 15222516 / -0.3% 0.56 / 0.41 / +36.0%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21641507 / 21815033 / -0.8% 24876124 / 23127662 / +7.6% 0.87 / 0.94 / -7.8%
fineweb_q01/duckdb:parquet 44676830 / 44591290 / +0.2% 56879883 / 55584569 / +2.3% 0.79 / 0.80 / -2.1%
fineweb_q02/duckdb:parquet 43569785 / 43112578 / +1.1% 57362433 / 53416900 / +7.4% 0.76 / 0.81 / -5.9%
fineweb_q03/duckdb:parquet 95421304 / 94687098 / +0.8% 175224759 / 178795210 / -2.0% 0.54 / 0.53 / +2.8%
fineweb_q04/duckdb:parquet 152266546 / 154934118 / -1.7% 216002404 / 200511849 / +7.7% 0.70 / 0.77 / -8.8%
fineweb_q05/duckdb:parquet 141956460 / 142716326 / -0.5% 206529637 / 192496737 / +7.3% 0.69 / 0.74 / -7.3%
fineweb_q06/duckdb:parquet 71115795 / 70625576 / +0.7% 129052342 / 128812055 / +0.2% 0.55 / 0.55 / +0.5%
fineweb_q07/duckdb:parquet 71826707 / 72114024 / -0.4% 160460133 / 154442838 / +3.9% 0.45 / 0.47 / -4.1%
fineweb_q08/duckdb:parquet 23864260 / 23322832 / +2.3% 24959016 / 27815969 / -10.3% 🟢 0.96 / 0.84 / +14.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Engines: DataFusion No clear signal (+1.6%, low confidence) · DuckDB No clear signal (+3.9%, low confidence)
Vortex (geomean): hot 1.018x ➖ · cold 1.027x ➖
Parquet (geomean): hot 0.991x ➖ · cold 1.073x ➖
Shifts: Parquet (control) -0.9% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.018x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 210967676 / 188035257 / +12.2% 🔴 507909526 / 646319077 / -21.4% 🟢 0.42 / 0.29 / +42.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed 9907904 / 10956427 / -9.6% 50605621 / 46635447 / +8.5% 0.20 / 0.23 / -16.7%
clickbench-sorted_q26/datafusion:vortex-file-compressed 12019943 / 11183345 / +7.5% 51836730 / 49773625 / +4.1% 0.23 / 0.22 / +3.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22836144 / 22784422 / +0.2% 69553172 / 68181905 / +2.0% 0.33 / 0.33 / -1.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18614910 / 18299398 / +1.7% 62468864 / 56634969 / +10.3% 🔴 0.30 / 0.32 / -7.8%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17324230 / 17325948 / -0.0% 62950914 / 59047845 / +6.6% 0.28 / 0.29 / -6.2%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40274386 / 41020019 / -1.8% 92526710 / 88863401 / +4.1% 0.44 / 0.46 / -5.7%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12739873 / 11961342 / +6.5% 43846592 / 41894782 / +4.7% 0.29 / 0.29 / +1.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12201364 / 11914326 / +2.4% 43336387 / 40957376 / +5.8% 0.28 / 0.29 / -3.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10412076 / 10348993 / +0.6% 35669719 / 35245285 / +1.2% 0.29 / 0.29 / -0.6%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 758821520 / 762400586 / -0.5% 967381570 / 968542856 / -0.1% 0.78 / 0.79 / -0.3%
clickbench-sorted_q24/datafusion:parquet 9046685 / 9232806 / -2.0% 72390689 / 71225536 / +1.6% 0.12 / 0.13 / -3.6%
clickbench-sorted_q26/datafusion:parquet 8923849 / 8939170 / -0.2% 72566373 / 70814820 / +2.5% 0.12 / 0.13 / -2.6%
clickbench-sorted_q36/datafusion:parquet 94714440 / 93646506 / +1.1% 171165881 / 167277850 / +2.3% 0.55 / 0.56 / -1.2%
clickbench-sorted_q37/datafusion:parquet 64229948 / 63978324 / +0.4% 132409053 / 133838331 / -1.1% 0.49 / 0.48 / +1.5%
clickbench-sorted_q38/datafusion:parquet 87916688 / 86771031 / +1.3% 164532547 / 160338206 / +2.6% 0.53 / 0.54 / -1.3%
clickbench-sorted_q39/datafusion:parquet 160591821 / 159643442 / +0.6% 235945342 / 230845916 / +2.2% 0.68 / 0.69 / -1.6%
clickbench-sorted_q40/datafusion:parquet 44660460 / 44382127 / +0.6% 113295774 / 109842452 / +3.1% 0.39 / 0.40 / -2.4%
clickbench-sorted_q41/datafusion:parquet 42606056 / 41796082 / +1.9% 112233808 / 106983281 / +4.9% 0.38 / 0.39 / -2.8%
clickbench-sorted_q42/datafusion:parquet 26022648 / 26385627 / -1.4% 86507753 / 86713637 / -0.2% 0.30 / 0.30 / -1.1%
duckdb / vortex-file-compressed / ns (1.019x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 60832829 / 59209998 / +2.7% 93873275 / 79187512 / +18.5% 🔴 0.65 / 0.75 / -13.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed 19770170 / 18848882 / +4.9% 29172499 / 32763620 / -11.0% 🟢 0.68 / 0.58 / +17.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed 17741053 / 15704130 / +13.0% 🔴 28171560 / 30086811 / -6.4% 0.63 / 0.52 / +20.7%
clickbench-sorted_q36/duckdb:vortex-file-compressed 28432724 / 29279738 / -2.9% 63448600 / 64720553 / -2.0% 0.45 / 0.45 / -0.9%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23452526 / 24384484 / -3.8% 51011992 / 51856385 / -1.6% 0.46 / 0.47 / -2.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25059763 / 24970996 / +0.4% 61034492 / 54456297 / +12.1% 🔴 0.41 / 0.46 / -10.5%
clickbench-sorted_q39/duckdb:vortex-file-compressed 49035578 / 46979207 / +4.4% 100869059 / 91826477 / +9.8% 0.49 / 0.51 / -5.0%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15531384 / 15166085 / +2.4% 43722425 / 36312042 / +20.4% 🔴 0.36 / 0.42 / -14.9%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15238080 / 15334860 / -0.6% 39144106 / 35978335 / +8.8% 0.39 / 0.43 / -8.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12206786 / 12289064 / -0.7% 30271291 / 33703956 / -10.2% 🟢 0.40 / 0.36 / +10.6%
duckdb / parquet / ns (0.980x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 123367422 / 127512820 / -3.3% 158264789 / 139820678 / +13.2% 🔴 0.78 / 0.91 / -14.5%
clickbench-sorted_q24/duckdb:parquet 18160768 / 17177806 / +5.7% 28206329 / 26724384 / +5.5% 0.64 / 0.64 / +0.2%
clickbench-sorted_q26/duckdb:parquet 12446796 / 12744064 / -2.3% 23415968 / 23152582 / +1.1% 0.53 / 0.55 / -3.4%
clickbench-sorted_q36/duckdb:parquet 44900960 / 45433153 / -1.2% 66390416 / 60114870 / +10.4% 🔴 0.68 / 0.76 / -10.5%
clickbench-sorted_q37/duckdb:parquet 30510561 / 30665088 / -0.5% 51896599 / 44953042 / +15.4% 🔴 0.59 / 0.68 / -13.8%
clickbench-sorted_q38/duckdb:parquet 38973666 / 40421958 / -3.6% 66531732 / 56331697 / +18.1% 🔴 0.59 / 0.72 / -18.4%
clickbench-sorted_q39/duckdb:parquet 70593725 / 71193578 / -0.8% 91602562 / 85360043 / +7.3% 0.77 / 0.83 / -7.6%
clickbench-sorted_q40/duckdb:parquet 16733660 / 17173826 / -2.6% 47100844 / 35917165 / +31.1% 🔴 0.36 / 0.48 / -25.7%
clickbench-sorted_q41/duckdb:parquet 16522700 / 17503830 / -5.6% 49773063 / 36391185 / +36.8% 🔴 0.33 / 0.48 / -31.0%
clickbench-sorted_q42/duckdb:parquet 11302255 / 11933069 / -5.3% 22958668 / 23582934 / -2.6% 0.49 / 0.51 / -2.7%

File Size Changes (100 files changed, -0.0% overall, 48↑ 52↓)
File Scale Format Base HEAD Change %
hits_033.vortex 1.0 vortex-file-compressed 199.67 MB 201.12 MB +1.45 MB +0.7%
hits_081.vortex 1.0 vortex-file-compressed 199.66 MB 201.11 MB +1.45 MB +0.7%
hits_096.vortex 1.0 vortex-file-compressed 199.05 MB 200.32 MB +1.27 MB +0.6%
hits_074.vortex 1.0 vortex-file-compressed 199.19 MB 200.19 MB +1.00 MB +0.5%
hits_008.vortex 1.0 vortex-file-compressed 139.35 MB 140.04 MB +706.95 KB +0.5%
hits_077.vortex 1.0 vortex-file-compressed 172.91 MB 173.71 MB +826.05 KB +0.5%
hits_010.vortex 1.0 vortex-file-compressed 169.07 MB 169.84 MB +782.48 KB +0.5%
hits_056.vortex 1.0 vortex-file-compressed 134.99 MB 135.33 MB +354.75 KB +0.3%
hits_020.vortex 1.0 vortex-file-compressed 159.81 MB 160.18 MB +377.40 KB +0.2%
hits_015.vortex 1.0 vortex-file-compressed 130.21 MB 130.46 MB +258.26 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 179.82 MB 180.12 MB +301.52 KB +0.2%
hits_094.vortex 1.0 vortex-file-compressed 158.27 MB 158.50 MB +236.18 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.41 MB 190.68 MB +275.30 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 139.99 MB 140.16 MB +167.26 KB +0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.22 MB 160.40 MB +182.66 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.98 MB 178.13 MB +148.49 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 200.89 MB 201.03 MB +139.81 KB +0.1%
hits_053.vortex 1.0 vortex-file-compressed 189.44 MB 189.56 MB +130.37 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.97 MB 101.04 MB +67.66 KB +0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.50 MB 136.59 MB +89.73 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 153.92 MB 154.02 MB +99.66 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.06 MB 152.15 MB +92.85 KB +0.1%
hits_071.vortex 1.0 vortex-file-compressed 139.34 MB 139.42 MB +84.09 KB +0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.79 MB 159.88 MB +91.83 KB +0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.74 MB 172.84 MB +97.57 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.65 MB 130.72 MB +72.84 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.74 MB 130.81 MB +72.79 KB +0.1%
hits_054.vortex 1.0 vortex-file-compressed 147.28 MB 147.36 MB +81.79 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.21 MB 156.30 MB +86.23 KB +0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.03 MB 191.13 MB +104.62 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.12 MB 167.21 MB +88.81 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.18 MB 130.24 MB +68.95 KB +0.1%
hits_092.vortex 1.0 vortex-file-compressed 200.54 MB 200.63 MB +88.66 KB +0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.78 MB 101.83 MB +43.40 KB +0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.24 MB 192.31 MB +79.71 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 139.18 MB 139.23 MB +52.80 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.67 MB 172.73 MB +65.46 KB +0.0%
hits_007.vortex 1.0 vortex-file-compressed 201.14 MB 201.21 MB +70.53 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.25 MB 172.30 MB +53.02 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 173.01 MB 173.06 MB +47.68 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.66 MB 130.69 MB +33.80 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.96 MB 171.99 MB +34.36 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.52 MB 161.54 MB +20.24 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 161.02 MB 161.04 MB +17.33 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.60 MB 126.62 MB +10.89 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.25 MB 102.26 MB +7.78 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.63 MB 161.64 MB +7.58 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.17 MB 147.18 MB +1.19 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.63 MB 126.63 MB 400 B -0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.88 MB 200.87 MB 11.12 KB -0.0%
hits_062.vortex 1.0 vortex-file-compressed 171.47 MB 171.46 MB 10.09 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.48 MB 190.47 MB 11.54 KB -0.0%
hits_022.vortex 1.0 vortex-file-compressed 200.02 MB 200.01 MB 15.44 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.20 MB 202.17 MB 25.07 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 143.16 MB 143.14 MB 20.11 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 200.96 MB 200.93 MB 31.55 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.71 MB 153.68 MB 30.83 KB -0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.53 MB 189.49 MB 43.64 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.52 MB 189.47 MB 50.12 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.86 MB 130.82 MB 35.44 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.10 MB 189.04 MB 56.51 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.62 MB 192.56 MB 57.66 KB -0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.00 MB 162.95 MB 49.84 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.36 MB 147.32 MB 46.09 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.69 MB 153.65 MB 48.30 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.00 MB 153.95 MB 54.68 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.85 MB 161.79 MB 60.55 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.88 MB 194.80 MB 81.44 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.63 MB 161.56 MB 72.48 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.76 MB 161.69 MB 74.42 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.11 MB 127.05 MB 61.37 KB -0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.74 MB 137.65 MB 92.08 KB -0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.56 MB 161.46 MB 108.38 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 200.80 MB 200.67 MB 139.74 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.21 MB 131.11 MB 93.16 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 143.99 MB 143.89 MB 105.10 KB -0.1%
hits_055.vortex 1.0 vortex-file-compressed 200.84 MB 200.69 MB 148.81 KB -0.1%
hits_029.vortex 1.0 vortex-file-compressed 201.05 MB 200.89 MB 170.90 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.94 MB 130.82 MB 119.29 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.76 MB 100.67 MB 100.89 KB -0.1%
hits_065.vortex 1.0 vortex-file-compressed 162.05 MB 161.88 MB 168.34 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 172.07 MB 171.86 MB 221.24 KB -0.1%
hits_048.vortex 1.0 vortex-file-compressed 200.99 MB 200.73 MB 260.91 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.93 MB 180.68 MB 254.39 KB -0.1%
hits_051.vortex 1.0 vortex-file-compressed 173.48 MB 173.24 MB 248.55 KB -0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.89 MB 130.67 MB 220.15 KB -0.2%
hits_061.vortex 1.0 vortex-file-compressed 161.67 MB 161.39 MB 282.80 KB -0.2%
hits_093.vortex 1.0 vortex-file-compressed 131.03 MB 130.81 MB 230.53 KB -0.2%
hits_058.vortex 1.0 vortex-file-compressed 154.69 MB 154.41 MB 279.43 KB -0.2%
hits_047.vortex 1.0 vortex-file-compressed 154.20 MB 153.78 MB 439.98 KB -0.3%
hits_052.vortex 1.0 vortex-file-compressed 130.44 MB 130.03 MB 423.77 KB -0.3%
hits_078.vortex 1.0 vortex-file-compressed 130.70 MB 130.25 MB 460.98 KB -0.3%
hits_031.vortex 1.0 vortex-file-compressed 159.70 MB 159.07 MB 641.80 KB -0.4%
hits_060.vortex 1.0 vortex-file-compressed 193.75 MB 192.77 MB 1000.87 KB -0.5%
hits_045.vortex 1.0 vortex-file-compressed 140.18 MB 139.45 MB 747.67 KB -0.5%
hits_011.vortex 1.0 vortex-file-compressed 200.16 MB 199.05 MB 1.11 MB -0.6%
hits_059.vortex 1.0 vortex-file-compressed 200.15 MB 198.89 MB 1.26 MB -0.6%
hits_034.vortex 1.0 vortex-file-compressed 183.36 MB 181.71 MB 1.65 MB -0.9%
hits_001.vortex 1.0 vortex-file-compressed 193.04 MB 190.97 MB 2.07 MB -1.1%
hits_086.vortex 1.0 vortex-file-compressed 194.48 MB 191.79 MB 2.69 MB -1.4%

Totals:

  • vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +44.7%
Engines: DataFusion No clear signal (+68.3%, environment too noisy confidence) · DuckDB No clear signal (+24.4%, environment too noisy confidence)
Vortex (geomean): hot 0.866x ➖ · cold 0.785x ➖
Parquet (geomean): hot 0.598x ✅ · cold 0.602x ✅
Shifts: Parquet (control) -40.2% · Median polish -22.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.812x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 44747988 / 38508722 / +16.2% 114109792 / 162213629 / -29.7% 0.39 / 0.24 / +65.2%
fineweb_q01/datafusion:vortex-file-compressed 405128844 / 510477961 / -20.6% 544608485 / 807433725 / -32.6% 🟢 0.74 / 0.63 / +17.7%
fineweb_q02/datafusion:vortex-file-compressed 433031908 / 607211666 / -28.7% 555982130 / 785000803 / -29.2% 0.78 / 0.77 / +0.7%
fineweb_q03/datafusion:vortex-file-compressed 622508782 / 569706322 / +9.3% 709422890 / 1371854193 / -48.3% 🟢 0.88 / 0.42 / +111.3%
fineweb_q04/datafusion:vortex-file-compressed 437896862 / 509726700 / -14.1% 429526856 / 551524239 / -22.1% 1.02 / 0.92 / +10.3%
fineweb_q05/datafusion:vortex-file-compressed 379236821 / 632971698 / -40.1% 🟢 403885585 / 723423456 / -44.2% 🟢 0.94 / 0.87 / +7.3%
fineweb_q06/datafusion:vortex-file-compressed 745153272 / 745775017 / -0.1% 734348752 / 886242031 / -17.1% 1.01 / 0.84 / +20.6%
fineweb_q07/datafusion:vortex-file-compressed 485461823 / 705057472 / -31.1% 🟢 486787383 / 812816373 / -40.1% 🟢 1.00 / 0.87 / +15.0%
fineweb_q08/datafusion:vortex-file-compressed 172901253 / 287372202 / -39.8% 🟢 191738048 / 348603337 / -45.0% 🟢 0.90 / 0.82 / +9.4%
datafusion / parquet / ns (0.482x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 370997036 / 1288901954 / -71.2% 🟢 712121675 / 1258299565 / -43.4% 🟢 0.52 / 1.02 / -49.1%
fineweb_q01/datafusion:parquet 718291669 / 1569288450 / -54.2% 🟢 706928172 / 2075946855 / -65.9% 🟢 1.02 / 0.76 / +34.4%
fineweb_q02/datafusion:parquet 678505888 / 1217121230 / -44.3% 🟢 682794236 / 1179972407 / -42.1% 🟢 0.99 / 1.03 / -3.7%
fineweb_q03/datafusion:parquet 792211492 / 1525002950 / -48.1% 🟢 757432576 / 1458166281 / -48.1% 🟢 1.05 / 1.05 / +0.0%
fineweb_q04/datafusion:parquet 705654229 / 2180767531 / -67.6% 🟢 840249588 / 1994006624 / -57.9% 🟢 0.84 / 1.09 / -23.2%
fineweb_q05/datafusion:parquet 670023140 / 1677079219 / -60.0% 🟢 636128536 / 2388782327 / -73.4% 🟢 1.05 / 0.70 / +50.0%
fineweb_q06/datafusion:parquet 701946514 / 1319726403 / -46.8% 🟢 613510707 / 1261985846 / -51.4% 🟢 1.14 / 1.05 / +9.4%
fineweb_q07/datafusion:parquet 803026591 / 1191182457 / -32.6% 🟢 794289772 / 1055691921 / -24.8% 1.01 / 1.13 / -10.4%
fineweb_q08/datafusion:parquet 734126528 / 916644429 / -19.9% 795058466 / 934094305 / -14.9% 0.92 / 0.98 / -5.9%
duckdb / vortex-file-compressed / ns (0.923x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 53452480 / 49088373 / +8.9% 81015118 / 60655502 / +33.6% 🔴 0.66 / 0.81 / -18.5%
fineweb_q01/duckdb:vortex-file-compressed 398505752 / 477016012 / -16.5% 450008647 / 511706413 / -12.1% 0.89 / 0.93 / -5.0%
fineweb_q02/duckdb:vortex-file-compressed 560775004 / 660561662 / -15.1% 595612852 / 698490803 / -14.7% 0.94 / 0.95 / -0.4%
fineweb_q03/duckdb:vortex-file-compressed 946078369 / 951994004 / -0.6% 1017790750 / 1156170099 / -12.0% 0.93 / 0.82 / +12.9%
fineweb_q04/duckdb:vortex-file-compressed 992836319 / 1067381700 / -7.0% 936226178 / 1038481481 / -9.8% 1.06 / 1.03 / +3.2%
fineweb_q05/duckdb:vortex-file-compressed 932036138 / 940830832 / -0.9% 1019674930 / 945210864 / +7.9% 0.91 / 1.00 / -8.2%
fineweb_q06/duckdb:vortex-file-compressed 1197533262 / 1266707218 / -5.5% 1231092538 / 1169580204 / +5.3% 0.97 / 1.08 / -10.2%
fineweb_q07/duckdb:vortex-file-compressed 973702232 / 1063980536 / -8.5% 1032794694 / 1256041994 / -17.8% 0.94 / 0.85 / +11.3%
fineweb_q08/duckdb:vortex-file-compressed 392755552 / 492197973 / -20.2% 450438251 / 543194744 / -17.1% 0.87 / 0.91 / -3.8%
duckdb / parquet / ns (0.742x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 481088910 / 588739834 / -18.3% 503374255 / 587653438 / -14.3% 0.96 / 1.00 / -4.6%
fineweb_q01/duckdb:parquet 655641524 / 947156966 / -30.8% 🟢 535787412 / 744021386 / -28.0% 1.22 / 1.27 / -3.9%
fineweb_q02/duckdb:parquet 655431556 / 712584067 / -8.0% 597329812 / 913342533 / -34.6% 🟢 1.10 / 0.78 / +40.6%
fineweb_q03/duckdb:parquet 1239857966 / 1684201484 / -26.4% 1272440344 / 1826511872 / -30.3% 🟢 0.97 / 0.92 / +5.7%
fineweb_q04/duckdb:parquet 711625015 / 1075834890 / -33.9% 🟢 713144113 / 808375491 / -11.8% 1.00 / 1.33 / -25.0%
fineweb_q05/duckdb:parquet 798653488 / 1153356519 / -30.8% 🟢 815773128 / 1255251643 / -35.0% 🟢 0.98 / 0.92 / +6.6%
fineweb_q06/duckdb:parquet 1546686774 / 2327820040 / -33.6% 🟢 1586187891 / 2236540653 / -29.1% 0.98 / 1.04 / -6.3%
fineweb_q07/duckdb:parquet 1054544058 / 1503152223 / -29.8% 1337447565 / 2396506179 / -44.2% 🟢 0.79 / 0.63 / +25.7%
fineweb_q08/duckdb:parquet 498560496 / 595586026 / -16.3% 586641474 / 704182804 / -16.7% 0.85 / 0.85 / +0.5%

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.019x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1227190 / 1233885 / -0.5% 20355463 / 21582143 / -5.7% 0.06 / 0.06 / +5.5%
clickbench_q01/datafusion:vortex-file-compressed 6180928 / 5757187 / +7.4% 34697967 / 37367248 / -7.1% 0.18 / 0.15 / +15.6%
clickbench_q02/datafusion:vortex-file-compressed 10460836 / 11010536 / -5.0% 39084329 / 40772653 / -4.1% 0.27 / 0.27 / -0.9%
clickbench_q03/datafusion:vortex-file-compressed 11653558 / 11718254 / -0.6% 54726491 / 54807445 / -0.1% 0.21 / 0.21 / -0.4%
clickbench_q04/datafusion:vortex-file-compressed 57597266 / 55830844 / +3.2% 94223343 / 94940622 / -0.8% 0.61 / 0.59 / +3.9%
clickbench_q05/datafusion:vortex-file-compressed 74808044 / 75276846 / -0.6% 119543921 / 120238043 / -0.6% 0.63 / 0.63 / -0.0%
clickbench_q06/datafusion:vortex-file-compressed 1246672 / 1276737 / -2.4% 21212859 / 21186484 / +0.1% 0.06 / 0.06 / -2.5%
clickbench_q07/datafusion:vortex-file-compressed 9946695 / 9925276 / +0.2% 36365977 / 34892498 / +4.2% 0.27 / 0.28 / -3.8%
clickbench_q08/datafusion:vortex-file-compressed 76373714 / 77992422 / -2.1% 119038957 / 118267279 / +0.7% 0.64 / 0.66 / -2.7%
clickbench_q09/datafusion:vortex-file-compressed 170097533 / 172929002 / -1.6% 207441635 / 209231415 / -0.9% 0.82 / 0.83 / -0.8%
clickbench_q10/datafusion:vortex-file-compressed 23643724 / 22915416 / +3.2% 71874064 / 65918737 / +9.0% 0.33 / 0.35 / -5.4%
clickbench_q11/datafusion:vortex-file-compressed 26592870 / 26226323 / +1.4% 68807020 / 68697128 / +0.2% 0.39 / 0.38 / +1.2%
clickbench_q12/datafusion:vortex-file-compressed 71416238 / 71913376 / -0.7% 114083807 / 122368414 / -6.8% 0.63 / 0.59 / +6.5%
clickbench_q13/datafusion:vortex-file-compressed 116962378 / 119199936 / -1.9% 182130157 / 181256899 / +0.5% 0.64 / 0.66 / -2.3%
clickbench_q14/datafusion:vortex-file-compressed 75075108 / 75114698 / -0.1% 126384150 / 125208001 / +0.9% 0.59 / 0.60 / -1.0%
clickbench_q15/datafusion:vortex-file-compressed 62624311 / 61446350 / +1.9% 96522470 / 96311254 / +0.2% 0.65 / 0.64 / +1.7%
clickbench_q16/datafusion:vortex-file-compressed 151897447 / 150703803 / +0.8% 206531172 / 209601599 / -1.5% 0.74 / 0.72 / +2.3%
clickbench_q17/datafusion:vortex-file-compressed 147773496 / 148653616 / -0.6% 213165443 / 210053205 / +1.5% 0.69 / 0.71 / -2.0%
clickbench_q18/datafusion:vortex-file-compressed 296659198 / 305648892 / -2.9% 397790414 / 364467334 / +9.1% 0.75 / 0.84 / -11.1%
clickbench_q19/datafusion:vortex-file-compressed 7588552 / 8085240 / -6.1% 50929997 / 46552761 / +9.4% 0.15 / 0.17 / -14.2%
clickbench_q20/datafusion:vortex-file-compressed 62285060 / 63187620 / -1.4% 227538280 / 230481441 / -1.3% 0.27 / 0.27 / -0.2%
clickbench_q21/datafusion:vortex-file-compressed 89309154 / 88241548 / +1.2% 266126918 / 274524119 / -3.1% 0.34 / 0.32 / +4.4%
clickbench_q22/datafusion:vortex-file-compressed 103033261 / 103421919 / -0.4% 342865045 / 346844943 / -1.1% 0.30 / 0.30 / +0.8%
clickbench_q23/datafusion:vortex-file-compressed 211230167 / 212864660 / -0.8% 512825331 / 496696526 / +3.2% 0.41 / 0.43 / -3.9%
clickbench_q24/datafusion:vortex-file-compressed 16015249 / 16594200 / -3.5% 71811855 / 60525937 / +18.6% 🔴 0.22 / 0.27 / -18.7%
clickbench_q25/datafusion:vortex-file-compressed 17690910 / 17345370 / +2.0% 57781816 / 56493802 / +2.3% 0.31 / 0.31 / -0.3%
clickbench_q26/datafusion:vortex-file-compressed 16603407 / 16409354 / +1.2% 65868618 / 68533768 / -3.9% 0.25 / 0.24 / +5.3%
clickbench_q27/datafusion:vortex-file-compressed 95814640 / 97259832 / -1.5% 240460384 / 242977831 / -1.0% 0.40 / 0.40 / -0.5%
clickbench_q28/datafusion:vortex-file-compressed 564247260 / 563520074 / +0.1% 622873179 / 624688041 / -0.3% 0.91 / 0.90 / +0.4%
clickbench_q29/datafusion:vortex-file-compressed 23613296 / 23735709 / -0.5% 50945294 / 51252816 / -0.6% 0.46 / 0.46 / +0.1%
clickbench_q30/datafusion:vortex-file-compressed 58099334 / 58436803 / -0.6% 101016130 / 108190870 / -6.6% 0.58 / 0.54 / +6.5%
clickbench_q31/datafusion:vortex-file-compressed 70830308 / 71886269 / -1.5% 153616670 / 152200952 / +0.9% 0.46 / 0.47 / -2.4%
clickbench_q32/datafusion:vortex-file-compressed 308561812 / 300480018 / +2.7% 385167950 / 384901998 / +0.1% 0.80 / 0.78 / +2.6%
clickbench_q33/datafusion:vortex-file-compressed 324428779 / 334746508 / -3.1% 424281888 / 419895843 / +1.0% 0.76 / 0.80 / -4.1%
clickbench_q34/datafusion:vortex-file-compressed 326716897 / 330369112 / -1.1% 442246963 / 432910412 / +2.2% 0.74 / 0.76 / -3.2%
clickbench_q35/datafusion:vortex-file-compressed 55659745 / 57492658 / -3.2% 87640480 / 90633767 / -3.3% 0.64 / 0.63 / +0.1%
clickbench_q36/datafusion:vortex-file-compressed 37399982 / 37383671 / +0.0% 66144016 / 66301401 / -0.2% 0.57 / 0.56 / +0.3%
clickbench_q37/datafusion:vortex-file-compressed 21852282 / 21873082 / -0.1% 49298648 / 47878747 / +3.0% 0.44 / 0.46 / -3.0%
clickbench_q38/datafusion:vortex-file-compressed 11902568 / 11614866 / +2.5% 40671563 / 39769229 / +2.3% 0.29 / 0.29 / +0.2%
clickbench_q39/datafusion:vortex-file-compressed 78047762 / 77812956 / +0.3% 110059554 / 111553138 / -1.3% 0.71 / 0.70 / +1.7%
clickbench_q40/datafusion:vortex-file-compressed 11244694 / 11472368 / -2.0% 39438449 / 36774482 / +7.2% 0.29 / 0.31 / -8.6%
clickbench_q41/datafusion:vortex-file-compressed 10716011 / 10744093 / -0.3% 37756050 / 36150864 / +4.4% 0.28 / 0.30 / -4.5%
clickbench_q42/datafusion:vortex-file-compressed 10814757 / 10871317 / -0.5% 36623080 / 36414390 / +0.6% 0.30 / 0.30 / -1.1%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1272188 / 1229668 / +3.5% 49114454 / 47560956 / +3.3% 0.03 / 0.03 / +0.2%
clickbench_q01/datafusion:parquet 15972932 / 15998770 / -0.2% 69599396 / 68612999 / +1.4% 0.23 / 0.23 / -1.6%
clickbench_q02/datafusion:parquet 19548178 / 18683103 / +4.6% 82118208 / 82498783 / -0.5% 0.24 / 0.23 / +5.1%
clickbench_q03/datafusion:parquet 16853664 / 17646212 / -4.5% 82260359 / 81186954 / +1.3% 0.20 / 0.22 / -5.7%
clickbench_q04/datafusion:parquet 63747007 / 63927617 / -0.3% 128399385 / 126251932 / +1.7% 0.50 / 0.51 / -2.0%
clickbench_q05/datafusion:parquet 89037978 / 88374724 / +0.8% 160379217 / 159244161 / +0.7% 0.56 / 0.55 / +0.0%
clickbench_q06/datafusion:parquet 1267978 / 1265341 / +0.2% 49578049 / 49109257 / +1.0% 0.03 / 0.03 / -0.7%
clickbench_q07/datafusion:parquet 16848514 / 16989144 / -0.8% 68818438 / 68486777 / +0.5% 0.24 / 0.25 / -1.3%
clickbench_q08/datafusion:parquet 85157517 / 85363949 / -0.2% 166250489 / 159590479 / +4.2% 0.51 / 0.53 / -4.2%
clickbench_q09/datafusion:parquet 187847160 / 183577138 / +2.3% 266288128 / 254557541 / +4.6% 0.71 / 0.72 / -2.2%
clickbench_q10/datafusion:parquet 36509102 / 36818660 / -0.8% 101521846 / 102944244 / -1.4% 0.36 / 0.36 / +0.5%
clickbench_q11/datafusion:parquet 42922110 / 43250916 / -0.8% 114111248 / 108742947 / +4.9% 0.38 / 0.40 / -5.4%
clickbench_q12/datafusion:parquet 95597823 / 95209950 / +0.4% 164389120 / 158454945 / +3.7% 0.58 / 0.60 / -3.2%
clickbench_q13/datafusion:parquet 150858028 / 148834538 / +1.4% 229171600 / 225641051 / +1.6% 0.66 / 0.66 / -0.2%
clickbench_q14/datafusion:parquet 101940072 / 102103418 / -0.2% 173251641 / 171314106 / +1.1% 0.59 / 0.60 / -1.3%
clickbench_q15/datafusion:parquet 70089826 / 70679316 / -0.8% 132766562 / 130791338 / +1.5% 0.53 / 0.54 / -2.3%
clickbench_q16/datafusion:parquet 157480270 / 156150120 / +0.9% 239894910 / 231458163 / +3.6% 0.66 / 0.67 / -2.7%
clickbench_q17/datafusion:parquet 156500308 / 155900356 / +0.4% 238247336 / 240192104 / -0.8% 0.66 / 0.65 / +1.2%
clickbench_q18/datafusion:parquet 315139632 / 314616948 / +0.2% 420273451 / 419886334 / +0.1% 0.75 / 0.75 / +0.1%
clickbench_q19/datafusion:parquet 18893308 / 19426681 / -2.7% 78341346 / 76260758 / +2.7% 0.24 / 0.25 / -5.3%
clickbench_q20/datafusion:parquet 179081132 / 179719774 / -0.4% 286747119 / 277192557 / +3.4% 0.62 / 0.65 / -3.7%
clickbench_q21/datafusion:parquet 174154066 / 174195058 / -0.0% 299589361 / 292460233 / +2.4% 0.58 / 0.60 / -2.4%
clickbench_q22/datafusion:parquet 262582438 / 261251022 / +0.5% 426237773 / 412388944 / +3.4% 0.62 / 0.63 / -2.8%
clickbench_q23/datafusion:parquet 1155978992 / 1138986102 / +1.5% 1229501721 / 1236365742 / -0.6% 0.94 / 0.92 / +2.1%
clickbench_q24/datafusion:parquet 30444870 / 30110536 / +1.1% 88756316 / 86525139 / +2.6% 0.34 / 0.35 / -1.4%
clickbench_q25/datafusion:parquet 37399438 / 36604428 / +2.2% 103323565 / 100409743 / +2.9% 0.36 / 0.36 / -0.7%
clickbench_q26/datafusion:parquet 31179704 / 30860431 / +1.0% 91208973 / 87649759 / +4.1% 0.34 / 0.35 / -2.9%
clickbench_q27/datafusion:parquet 192670653 / 191793915 / +0.5% 292680455 / 284813125 / +2.8% 0.66 / 0.67 / -2.2%
clickbench_q28/datafusion:parquet 626998842 / 623121178 / +0.6% 709442146 / 702306210 / +1.0% 0.88 / 0.89 / -0.4%
clickbench_q29/datafusion:parquet 28979400 / 29403430 / -1.4% 91961414 / 93039744 / -1.2% 0.32 / 0.32 / -0.3%
clickbench_q30/datafusion:parquet 90678769 / 91171132 / -0.5% 173487252 / 171109951 / +1.4% 0.52 / 0.53 / -1.9%
clickbench_q31/datafusion:parquet 104182228 / 103111872 / +1.0% 197510101 / 191030614 / +3.4% 0.53 / 0.54 / -2.3%
clickbench_q32/datafusion:parquet 328468550 / 329392910 / -0.3% 428997119 / 431607711 / -0.6% 0.77 / 0.76 / +0.3%
clickbench_q33/datafusion:parquet 383638382 / 381484200 / +0.6% 476450603 / 475236706 / +0.3% 0.81 / 0.80 / +0.3%
clickbench_q34/datafusion:parquet 383001138 / 384591038 / -0.4% 480728905 / 476082678 / +1.0% 0.80 / 0.81 / -1.4%
clickbench_q35/datafusion:parquet 63925487 / 65475410 / -2.4% 129091833 / 124334464 / +3.8% 0.50 / 0.53 / -6.0%
clickbench_q36/datafusion:parquet 73588744 / 73677012 / -0.1% 136037510 / 134832110 / +0.9% 0.54 / 0.55 / -1.0%
clickbench_q37/datafusion:parquet 35517274 / 35435372 / +0.2% 91888544 / 92257056 / -0.4% 0.39 / 0.38 / +0.6%
clickbench_q38/datafusion:parquet 47541026 / 47716903 / -0.4% 109918044 / 105870964 / +3.8% 0.43 / 0.45 / -4.0%
clickbench_q39/datafusion:parquet 143594734 / 143866610 / -0.2% 212829335 / 206900659 / +2.9% 0.67 / 0.70 / -3.0%
clickbench_q40/datafusion:parquet 19830975 / 19870287 / -0.2% 76892637 / 77739389 / -1.1% 0.26 / 0.26 / +0.9%
clickbench_q41/datafusion:parquet 18680768 / 19052634 / -2.0% 75085145 / 76937323 / -2.4% 0.25 / 0.25 / +0.5%
clickbench_q42/datafusion:parquet 19463624 / 19464796 / -0.0% 75693064 / 75472661 / +0.3% 0.26 / 0.26 / -0.3%
duckdb / vortex-file-compressed / ns (1.002x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1607398 / 1490046 / +7.9% 25267651 / 23234043 / +8.8% 0.06 / 0.06 / -0.8%
clickbench_q01/duckdb:vortex-file-compressed 14662436 / 12097669 / +21.2% 🔴 29798491 / 31147651 / -4.3% 0.49 / 0.39 / +26.7%
clickbench_q02/duckdb:vortex-file-compressed 15557406 / 15073936 / +3.2% 36145771 / 32798682 / +10.2% 🔴 0.43 / 0.46 / -6.3%
clickbench_q03/duckdb:vortex-file-compressed 16547904 / 19232224 / -14.0% 🟢 49564960 / 44888532 / +10.4% 🔴 0.33 / 0.43 / -22.1%
clickbench_q04/duckdb:vortex-file-compressed 68112548 / 68137868 / -0.0% 104974347 / 110719097 / -5.2% 0.65 / 0.62 / +5.4%
clickbench_q05/duckdb:vortex-file-compressed 68934710 / 70153453 / -1.7% 96076934 / 92650843 / +3.7% 0.72 / 0.76 / -5.2%
clickbench_q06/duckdb:vortex-file-compressed 1910522 / 1829402 / +4.4% 27761227 / 32816104 / -15.4% 🟢 0.07 / 0.06 / +23.5%
clickbench_q07/duckdb:vortex-file-compressed 14180622 / 14048016 / +0.9% 35117813 / 30794859 / +14.0% 🔴 0.40 / 0.46 / -11.5%
clickbench_q08/duckdb:vortex-file-compressed 81858633 / 83357584 / -1.8% 124052700 / 121842748 / +1.8% 0.66 / 0.68 / -3.5%
clickbench_q09/duckdb:vortex-file-compressed 108010132 / 107144104 / +0.8% 164134427 / 144573788 / +13.5% 🔴 0.66 / 0.74 / -11.2%
clickbench_q10/duckdb:vortex-file-compressed 32337455 / 35859100 / -9.8% 73054094 / 64137515 / +13.9% 🔴 0.44 / 0.56 / -20.8%
clickbench_q11/duckdb:vortex-file-compressed 36579163 / 35280814 / +3.7% 76012940 / 73482959 / +3.4% 0.48 / 0.48 / +0.2%
clickbench_q12/duckdb:vortex-file-compressed 74805886 / 74183308 / +0.8% 108005011 / 107135077 / +0.8% 0.69 / 0.69 / +0.0%
clickbench_q13/duckdb:vortex-file-compressed 134470308 / 138086322 / -2.6% 188232217 / 178098315 / +5.7% 0.71 / 0.78 / -7.9%
clickbench_q14/duckdb:vortex-file-compressed 78863449 / 79275146 / -0.5% 110190901 / 107949582 / +2.1% 0.72 / 0.73 / -2.5%
clickbench_q15/duckdb:vortex-file-compressed 91976954 / 90058997 / +2.1% 131663678 / 129636038 / +1.6% 0.70 / 0.69 / +0.6%
clickbench_q16/duckdb:vortex-file-compressed 161055850 / 164677382 / -2.2% 212316887 / 206621810 / +2.8% 0.76 / 0.80 / -4.8%
clickbench_q17/duckdb:vortex-file-compressed 162343080 / 164154799 / -1.1% 216100595 / 208831930 / +3.5% 0.75 / 0.79 / -4.4%
clickbench_q18/duckdb:vortex-file-compressed 313664926 / 308181218 / +1.8% 377051333 / 365627252 / +3.1% 0.83 / 0.84 / -1.3%
clickbench_q19/duckdb:vortex-file-compressed 16928684 / 16484145 / +2.7% 42477046 / 39331867 / +8.0% 0.40 / 0.42 / -4.9%
clickbench_q20/duckdb:vortex-file-compressed 112576368 / 111013562 / +1.4% 199819735 / 191129319 / +4.5% 0.56 / 0.58 / -3.0%
clickbench_q21/duckdb:vortex-file-compressed 159122769 / 158626996 / +0.3% 309769298 / 284808531 / +8.8% 0.51 / 0.56 / -7.8%
clickbench_q22/duckdb:vortex-file-compressed 235983258 / 234861972 / +0.5% 462538563 / 414351729 / +11.6% 🔴 0.51 / 0.57 / -10.0%
clickbench_q23/duckdb:vortex-file-compressed 59486341 / 60243460 / -1.3% 97636249 / 105640939 / -7.6% 0.61 / 0.57 / +6.8%
clickbench_q24/duckdb:vortex-file-compressed 24231584 / 27312782 / -11.3% 🟢 46257434 / 43831875 / +5.5% 0.52 / 0.62 / -15.9%
clickbench_q25/duckdb:vortex-file-compressed 32181393 / 31796615 / +1.2% 55961351 / 56486042 / -0.9% 0.58 / 0.56 / +2.2%
clickbench_q26/duckdb:vortex-file-compressed 18885394 / 20880519 / -9.6% 39911629 / 34800467 / +14.7% 🔴 0.47 / 0.60 / -21.1%
clickbench_q27/duckdb:vortex-file-compressed 148129658 / 143479463 / +3.2% 254570718 / 234960055 / +8.3% 0.58 / 0.61 / -4.7%
clickbench_q28/duckdb:vortex-file-compressed 623726353 / 715548744 / -12.8% 🟢 700785618 / 685551437 / +2.2% 0.89 / 1.04 / -14.7%
clickbench_q29/duckdb:vortex-file-compressed 18326338 / 16772316 / +9.3% 38124303 / 37571244 / +1.5% 0.48 / 0.45 / +7.7%
clickbench_q30/duckdb:vortex-file-compressed 65575018 / 66125444 / -0.8% 116430747 / 107125492 / +8.7% 0.56 / 0.62 / -8.8%
clickbench_q31/duckdb:vortex-file-compressed 125944875 / 127374912 / -1.1% 207927323 / 194030813 / +7.2% 0.61 / 0.66 / -7.7%
clickbench_q32/duckdb:vortex-file-compressed 463005956 / 439586093 / +5.3% 502171867 / 487321578 / +3.0% 0.92 / 0.90 / +2.2%
clickbench_q33/duckdb:vortex-file-compressed 391027548 / 386322598 / +1.2% 503743655 / 496484705 / +1.5% 0.78 / 0.78 / -0.2%
clickbench_q34/duckdb:vortex-file-compressed 416190943 / 413373634 / +0.7% 547214128 / 526583389 / +3.9% 0.76 / 0.79 / -3.1%
clickbench_q35/duckdb:vortex-file-compressed 101632872 / 101099147 / +0.5% 157672330 / 143845661 / +9.6% 0.64 / 0.70 / -8.3%
clickbench_q36/duckdb:vortex-file-compressed 16425140 / 15473581 / +6.1% 33448015 / 33639498 / -0.6% 0.49 / 0.46 / +6.8%
clickbench_q37/duckdb:vortex-file-compressed 11081778 / 11723250 / -5.5% 26949213 / 30563253 / -11.8% 🟢 0.41 / 0.38 / +7.2%
clickbench_q38/duckdb:vortex-file-compressed 13166036 / 13144790 / +0.2% 29245204 / 30148102 / -3.0% 0.45 / 0.44 / +3.3%
clickbench_q39/duckdb:vortex-file-compressed 22298730 / 22731023 / -1.9% 43054533 / 43062520 / -0.0% 0.52 / 0.53 / -1.9%
clickbench_q40/duckdb:vortex-file-compressed 11195222 / 10439044 / +7.2% 27134520 / 26429877 / +2.7% 0.41 / 0.39 / +4.5%
clickbench_q41/duckdb:vortex-file-compressed 12133505 / 11010928 / +10.2% 🔴 27014190 / 28115824 / -3.9% 0.45 / 0.39 / +14.7%
clickbench_q42/duckdb:vortex-file-compressed 11506416 / 12026414 / -4.3% 27967752 / 29150841 / -4.1% 0.41 / 0.41 / -0.3%
duckdb / parquet / ns (0.997x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8481500 / 8920028 / -4.9% 18570481 / 20941058 / -11.3% 🟢 0.46 / 0.43 / +7.2%
clickbench_q01/duckdb:parquet 8762139 / 9932064 / -11.8% 🟢 18865001 / 20829812 / -9.4% 0.46 / 0.48 / -2.6%
clickbench_q02/duckdb:parquet 16996286 / 15062577 / +12.8% 🔴 33155444 / 29847746 / +11.1% 🔴 0.51 / 0.50 / +1.6%
clickbench_q03/duckdb:parquet 17638282 / 15852450 / +11.3% 🔴 53687678 / 52106335 / +3.0% 0.33 / 0.30 / +8.0%
clickbench_q04/duckdb:parquet 70373267 / 69606723 / +1.1% 91356738 / 108070266 / -15.5% 🟢 0.77 / 0.64 / +19.6%
clickbench_q05/duckdb:parquet 80022738 / 83439376 / -4.1% 119187667 / 121067381 / -1.6% 0.67 / 0.69 / -2.6%
clickbench_q06/duckdb:parquet 14690391 / 14911332 / -1.5% 26085879 / 25594837 / +1.9% 0.56 / 0.58 / -3.3%
clickbench_q07/duckdb:parquet 12152722 / 11423011 / +6.4% 25645000 / 20876148 / +22.8% 🔴 0.47 / 0.55 / -13.4%
clickbench_q08/duckdb:parquet 82498352 / 83692912 / -1.4% 130670616 / 135508534 / -3.6% 0.63 / 0.62 / +2.2%
clickbench_q09/duckdb:parquet 112742201 / 114654556 / -1.7% 158052557 / 157684998 / +0.2% 0.71 / 0.73 / -1.9%
clickbench_q10/duckdb:parquet 34994840 / 32203228 / +8.7% 67885795 / 69010099 / -1.6% 0.52 / 0.47 / +10.5%
clickbench_q11/duckdb:parquet 36841658 / 36651136 / +0.5% 76455572 / 74851950 / +2.1% 0.48 / 0.49 / -1.6%
clickbench_q12/duckdb:parquet 91230470 / 90751549 / +0.5% 132892036 / 127349116 / +4.4% 0.69 / 0.71 / -3.7%
clickbench_q13/duckdb:parquet 141617890 / 146633574 / -3.4% 211759637 / 210226671 / +0.7% 0.67 / 0.70 / -4.1%
clickbench_q14/duckdb:parquet 101794710 / 104403540 / -2.5% 147785912 / 140365213 / +5.3% 0.69 / 0.74 / -7.4%
clickbench_q15/duckdb:parquet 91852506 / 92255850 / -0.4% 119262063 / 126800882 / -5.9% 0.77 / 0.73 / +5.9%
clickbench_q16/duckdb:parquet 180903016 / 182353508 / -0.8% 223684903 / 228722144 / -2.2% 0.81 / 0.80 / +1.4%
clickbench_q17/duckdb:parquet 173606486 / 178505708 / -2.7% 226020500 / 227994070 / -0.9% 0.77 / 0.78 / -1.9%
clickbench_q18/duckdb:parquet 323384924 / 322681466 / +0.2% 408739175 / 409118362 / -0.1% 0.79 / 0.79 / +0.3%
clickbench_q19/duckdb:parquet 13362308 / 13455064 / -0.7% 43530523 / 39843685 / +9.3% 0.31 / 0.34 / -9.1%
clickbench_q20/duckdb:parquet 137001020 / 133902191 / +2.3% 243397348 / 243297683 / +0.0% 0.56 / 0.55 / +2.3%
clickbench_q21/duckdb:parquet 182304513 / 177873378 / +2.5% 318353650 / 323293293 / -1.5% 0.57 / 0.55 / +4.1%
clickbench_q22/duckdb:parquet 238804440 / 253467041 / -5.8% 409002501 / 406746995 / +0.6% 0.58 / 0.62 / -6.3%
clickbench_q23/duckdb:parquet 146491172 / 144271195 / +1.5% 166123501 / 165379047 / +0.5% 0.88 / 0.87 / +1.1%
clickbench_q24/duckdb:parquet 43013458 / 42512062 / +1.2% 67329512 / 59920789 / +12.4% 🔴 0.64 / 0.71 / -10.0%
clickbench_q25/duckdb:parquet 40208555 / 40057978 / +0.4% 94827110 / 87928289 / +7.8% 0.42 / 0.46 / -6.9%
clickbench_q26/duckdb:parquet 29665644 / 29927184 / -0.9% 51160511 / 43771029 / +16.9% 🔴 0.58 / 0.68 / -15.2%
clickbench_q27/duckdb:parquet 143986126 / 143566023 / +0.3% 258556687 / 256157591 / +0.9% 0.56 / 0.56 / -0.6%
clickbench_q28/duckdb:parquet 901356680 / 905997668 / -0.5% 979518876 / 999857295 / -2.0% 0.92 / 0.91 / +1.6%
clickbench_q29/duckdb:parquet 17629860 / 17412812 / +1.2% 31572201 / 32326716 / -2.3% 0.56 / 0.54 / +3.7%
clickbench_q30/duckdb:parquet 89962575 / 91044258 / -1.2% 174729476 / 171493639 / +1.9% 0.51 / 0.53 / -3.0%
clickbench_q31/duckdb:parquet 143472578 / 143422186 / +0.0% 261521951 / 289650347 / -9.7% 0.55 / 0.50 / +10.8%
clickbench_q32/duckdb:parquet 455293978 / 464858255 / -2.1% 551538060 / 490381805 / +12.5% 🔴 0.83 / 0.95 / -12.9%
clickbench_q33/duckdb:parquet 462395386 / 447225100 / +3.4% 541003289 / 483470151 / +11.9% 🔴 0.85 / 0.93 / -7.6%
clickbench_q34/duckdb:parquet 454108586 / 457518169 / -0.7% 473794780 / 497250742 / -4.7% 0.96 / 0.92 / +4.2%
clickbench_q35/duckdb:parquet 99330342 / 102479764 / -3.1% 121410961 / 119072034 / +2.0% 0.82 / 0.86 / -4.9%
clickbench_q36/duckdb:parquet 30362518 / 31236635 / -2.8% 43834915 / 41247121 / +6.3% 0.69 / 0.76 / -8.5%
clickbench_q37/duckdb:parquet 22485054 / 22548870 / -0.3% 31694647 / 32636865 / -2.9% 0.71 / 0.69 / +2.7%
clickbench_q38/duckdb:parquet 23405339 / 24026800 / -2.6% 34539298 / 33877131 / +2.0% 0.68 / 0.71 / -4.5%
clickbench_q39/duckdb:parquet 56118983 / 56452532 / -0.6% 66411263 / 65872380 / +0.8% 0.85 / 0.86 / -1.4%
clickbench_q40/duckdb:parquet 12719235 / 12505952 / +1.7% 22532174 / 22658536 / -0.6% 0.56 / 0.55 / +2.3%
clickbench_q41/duckdb:parquet 12800763 / 13320900 / -3.9% 21711292 / 22737096 / -4.5% 0.59 / 0.59 / +0.6%
clickbench_q42/duckdb:parquet 13800934 / 14424346 / -4.3% 24872652 / 24946784 / -0.3% 0.55 / 0.58 / -4.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.8%, environment too noisy confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.971x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.991x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24295696 / 23718127 / +2.4% 43788017 / 43417210 / +0.9% 0.55 / 0.55 / +1.6%
tpcds_q02/datafusion:vortex-file-compressed 45127252 / 45419562 / -0.6% 61936760 / 64358817 / -3.8% 0.73 / 0.71 / +3.2%
tpcds_q03/datafusion:vortex-file-compressed 11947859 / 11761394 / +1.6% 29480571 / 28571387 / +3.2% 0.41 / 0.41 / -1.5%
tpcds_q04/datafusion:vortex-file-compressed 111126217 / 114490626 / -2.9% 144256088 / 146048278 / -1.2% 0.77 / 0.78 / -1.7%
tpcds_q05/datafusion:vortex-file-compressed 61360696 / 60109975 / +2.1% 80745695 / 83725973 / -3.6% 0.76 / 0.72 / +5.8%
tpcds_q06/datafusion:vortex-file-compressed 24408928 / 23853946 / +2.3% 46652990 / 45651015 / +2.2% 0.52 / 0.52 / +0.1%
tpcds_q07/datafusion:vortex-file-compressed 33034704 / 32828396 / +0.6% 56775852 / 58279280 / -2.6% 0.58 / 0.56 / +3.3%
tpcds_q08/datafusion:vortex-file-compressed 25533820 / 25879174 / -1.3% 44553110 / 46752823 / -4.7% 0.57 / 0.55 / +3.5%
tpcds_q09/datafusion:vortex-file-compressed 17295426 / 16963184 / +2.0% 35356271 / 35214277 / +0.4% 0.49 / 0.48 / +1.5%
tpcds_q10/datafusion:vortex-file-compressed 28920226 / 29021770 / -0.3% 50351785 / 50655826 / -0.6% 0.57 / 0.57 / +0.3%
tpcds_q11/datafusion:vortex-file-compressed 62586748 / 63096734 / -0.8% 88751812 / 92844254 / -4.4% 0.71 / 0.68 / +3.8%
tpcds_q12/datafusion:vortex-file-compressed 16392980 / 16160908 / +1.4% 32913492 / 32751779 / +0.5% 0.50 / 0.49 / +0.9%
tpcds_q13/datafusion:vortex-file-compressed 34393246 / 34171998 / +0.6% 55861272 / 55555152 / +0.6% 0.62 / 0.62 / +0.1%
tpcds_q14/datafusion:vortex-file-compressed 91605364 / 91333062 / +0.3% 121906060 / 119656520 / +1.9% 0.75 / 0.76 / -1.6%
tpcds_q15/datafusion:vortex-file-compressed 23965335 / 24013543 / -0.2% 43971831 / 45376754 / -3.1% 0.55 / 0.53 / +3.0%
tpcds_q16/datafusion:vortex-file-compressed 20591640 / 20534854 / +0.3% 40830171 / 43346284 / -5.8% 0.50 / 0.47 / +6.5%
tpcds_q17/datafusion:vortex-file-compressed 58094102 / 62029074 / -6.3% 83455752 / 80855667 / +3.2% 0.70 / 0.77 / -9.3%
tpcds_q18/datafusion:vortex-file-compressed 68452875 / 69177954 / -1.0% 91039573 / 95190532 / -4.4% 0.75 / 0.73 / +3.5%
tpcds_q19/datafusion:vortex-file-compressed 18323944 / 18315794 / +0.0% 40236151 / 41283423 / -2.5% 0.46 / 0.44 / +2.6%
tpcds_q20/datafusion:vortex-file-compressed 17621535 / 17378255 / +1.4% 35214953 / 36244496 / -2.8% 0.50 / 0.48 / +4.4%
tpcds_q21/datafusion:vortex-file-compressed 16770072 / 17067066 / -1.7% 38551416 / 42078651 / -8.4% 0.44 / 0.41 / +7.3%
tpcds_q22/datafusion:vortex-file-compressed 50381616 / 49963947 / +0.8% 70176600 / 71046139 / -1.2% 0.72 / 0.70 / +2.1%
tpcds_q23/datafusion:vortex-file-compressed 72387158 / 72498648 / -0.2% 103772678 / 105391367 / -1.5% 0.70 / 0.69 / +1.4%
tpcds_q24/datafusion:vortex-file-compressed 70588179 / 70364590 / +0.3% 94162078 / 95331026 / -1.2% 0.75 / 0.74 / +1.6%
tpcds_q25/datafusion:vortex-file-compressed 56394792 / 52450900 / +7.5% 79706539 / 87350845 / -8.8% 0.71 / 0.60 / +17.8%
tpcds_q26/datafusion:vortex-file-compressed 30374826 / 30165270 / +0.7% 52952829 / 53128689 / -0.3% 0.57 / 0.57 / +1.0%
tpcds_q27/datafusion:vortex-file-compressed 63128454 / 65067631 / -3.0% 86720098 / 88968139 / -2.5% 0.73 / 0.73 / -0.5%
tpcds_q28/datafusion:vortex-file-compressed 18277398 / 18247104 / +0.2% 38493013 / 37957168 / +1.4% 0.47 / 0.48 / -1.2%
tpcds_q29/datafusion:vortex-file-compressed 61527135 / 57767390 / +6.5% 75589200 / 87797016 / -13.9% 🟢 0.81 / 0.66 / +23.7%
tpcds_q30/datafusion:vortex-file-compressed 27105936 / 27882026 / -2.8% 44449338 / 47840574 / -7.1% 0.61 / 0.58 / +4.6%
tpcds_q31/datafusion:vortex-file-compressed 64078299 / 64721373 / -1.0% 91648898 / 92934873 / -1.4% 0.70 / 0.70 / +0.4%
tpcds_q32/datafusion:vortex-file-compressed 13716946 / 13736497 / -0.1% 31530124 / 31912039 / -1.2% 0.44 / 0.43 / +1.1%
tpcds_q33/datafusion:vortex-file-compressed 27143170 / 27441083 / -1.1% 49486225 / 50546469 / -2.1% 0.55 / 0.54 / +1.0%
tpcds_q34/datafusion:vortex-file-compressed 18938229 / 18644566 / +1.6% 36903556 / 39181913 / -5.8% 0.51 / 0.48 / +7.8%
tpcds_q35/datafusion:vortex-file-compressed 36154528 / 35527642 / +1.8% 57590271 / 58155829 / -1.0% 0.63 / 0.61 / +2.8%
tpcds_q36/datafusion:vortex-file-compressed 48120152 / 48168623 / -0.1% 72893863 / 75860843 / -3.9% 0.66 / 0.63 / +4.0%
tpcds_q37/datafusion:vortex-file-compressed 12949120 / 14127287 / -8.3% 34242666 / 36432504 / -6.0% 0.38 / 0.39 / -2.5%
tpcds_q38/datafusion:vortex-file-compressed 29991252 / 29813370 / +0.6% 52051710 / 53788789 / -3.2% 0.58 / 0.55 / +4.0%
tpcds_q39/datafusion:vortex-file-compressed 65466100 / 66346694 / -1.3% 90830236 / 92526069 / -1.8% 0.72 / 0.72 / +0.5%
tpcds_q40/datafusion:vortex-file-compressed 25002297 / 24929534 / +0.3% 46547453 / 46532238 / +0.0% 0.54 / 0.54 / +0.3%
tpcds_q41/datafusion:vortex-file-compressed 17321922 / 16585780 / +4.4% 31752171 / 31916010 / -0.5% 0.55 / 0.52 / +5.0%
tpcds_q42/datafusion:vortex-file-compressed 11098762 / 11254273 / -1.4% 27832092 / 28433639 / -2.1% 0.40 / 0.40 / +0.7%
tpcds_q43/datafusion:vortex-file-compressed 13490316 / 13318352 / +1.3% 32593105 / 32655365 / -0.2% 0.41 / 0.41 / +1.5%
tpcds_q44/datafusion:vortex-file-compressed 26550586 / 25896604 / +2.5% 50257224 / 52497997 / -4.3% 0.53 / 0.49 / +7.1%
tpcds_q45/datafusion:vortex-file-compressed 27589464 / 27663166 / -0.3% 47902140 / 49343635 / -2.9% 0.58 / 0.56 / +2.7%
tpcds_q46/datafusion:vortex-file-compressed 24537006 / 24822040 / -1.1% 47665067 / 48603227 / -1.9% 0.51 / 0.51 / +0.8%
tpcds_q47/datafusion:vortex-file-compressed 78705392 / 78229510 / +0.6% 106968505 / 107863522 / -0.8% 0.74 / 0.73 / +1.5%
tpcds_q48/datafusion:vortex-file-compressed 31978570 / 31411867 / +1.8% 51107751 / 54683106 / -6.5% 0.63 / 0.57 / +8.9%
tpcds_q49/datafusion:vortex-file-compressed 59562831 / 59656564 / -0.2% 81539132 / 86382932 / -5.6% 0.73 / 0.69 / +5.8%
tpcds_q50/datafusion:vortex-file-compressed 34456160 / 35208827 / -2.1% 55209120 / 56828080 / -2.8% 0.62 / 0.62 / +0.7%
tpcds_q51/datafusion:vortex-file-compressed 60517494 / 61783690 / -2.0% 85355942 / 85313508 / +0.0% 0.71 / 0.72 / -2.1%
tpcds_q52/datafusion:vortex-file-compressed 11866387 / 11888165 / -0.2% 28306034 / 29451189 / -3.9% 0.42 / 0.40 / +3.9%
tpcds_q53/datafusion:vortex-file-compressed 18837349 / 18581216 / +1.4% 39318638 / 39576378 / -0.7% 0.48 / 0.47 / +2.0%
tpcds_q54/datafusion:vortex-file-compressed 34967010 / 34169000 / +2.3% 59589805 / 62638555 / -4.9% 0.59 / 0.55 / +7.6%
tpcds_q55/datafusion:vortex-file-compressed 11381000 / 11436793 / -0.5% 28995824 / 29141126 / -0.5% 0.39 / 0.39 / +0.0%
tpcds_q56/datafusion:vortex-file-compressed 27018500 / 26431133 / +2.2% 48709124 / 49114960 / -0.8% 0.55 / 0.54 / +3.1%
tpcds_q57/datafusion:vortex-file-compressed 73652790 / 73867919 / -0.3% 98335780 / 97901768 / +0.4% 0.75 / 0.75 / -0.7%
tpcds_q58/datafusion:vortex-file-compressed 40826923 / 40798312 / +0.1% 66806768 / 68287581 / -2.2% 0.61 / 0.60 / +2.3%
tpcds_q59/datafusion:vortex-file-compressed 32108310 / 32332538 / -0.7% 52295396 / 54205749 / -3.5% 0.61 / 0.60 / +2.9%
tpcds_q60/datafusion:vortex-file-compressed 26574803 / 26501822 / +0.3% 48492192 / 49619000 / -2.3% 0.55 / 0.53 / +2.6%
tpcds_q61/datafusion:vortex-file-compressed 25138682 / 23919800 / +5.1% 47987603 / 50085017 / -4.2% 0.52 / 0.48 / +9.7%
tpcds_q62/datafusion:vortex-file-compressed 17273102 / 17130420 / +0.8% 35821534 / 37199609 / -3.7% 0.48 / 0.46 / +4.7%
tpcds_q63/datafusion:vortex-file-compressed 18830170 / 18343190 / +2.7% 38431747 / 40006858 / -3.9% 0.49 / 0.46 / +6.9%
tpcds_q64/datafusion:vortex-file-compressed 328766994 / 322524934 / +1.9% 360373701 / 362694590 / -0.6% 0.91 / 0.89 / +2.6%
tpcds_q65/datafusion:vortex-file-compressed 75737372 / 74892428 / +1.1% 95702382 / 97161827 / -1.5% 0.79 / 0.77 / +2.7%
tpcds_q66/datafusion:vortex-file-compressed 53362996 / 52590474 / +1.5% 75353648 / 76617194 / -1.6% 0.71 / 0.69 / +3.2%
tpcds_q67/datafusion:vortex-file-compressed 56050672 / 55452281 / +1.1% 85731896 / 86060557 / -0.4% 0.65 / 0.64 / +1.5%
tpcds_q68/datafusion:vortex-file-compressed 24408954 / 24064200 / +1.4% 47650234 / 49206762 / -3.2% 0.51 / 0.49 / +4.7%
tpcds_q69/datafusion:vortex-file-compressed 28499204 / 29230564 / -2.5% 48894905 / 49377155 / -1.0% 0.58 / 0.59 / -1.5%
tpcds_q70/datafusion:vortex-file-compressed 72381780 / 70937778 / +2.0% 94731596 / 93481019 / +1.3% 0.76 / 0.76 / +0.7%
tpcds_q71/datafusion:vortex-file-compressed 18957299 / 19289225 / -1.7% 39717364 / 39489244 / +0.6% 0.48 / 0.49 / -2.3%
tpcds_q72/datafusion:vortex-file-compressed 451825676 / 467748804 / -3.4% 489985588 / 532887928 / -8.1% 0.92 / 0.88 / +5.1%
tpcds_q73/datafusion:vortex-file-compressed 17246028 / 17463107 / -1.2% 36735697 / 38882109 / -5.5% 0.47 / 0.45 / +4.5%
tpcds_q74/datafusion:vortex-file-compressed 45594510 / 45732550 / -0.3% 69259614 / 71316633 / -2.9% 0.66 / 0.64 / +2.7%
tpcds_q75/datafusion:vortex-file-compressed 127807652 / 134317883 / -4.8% 161107026 / 158419049 / +1.7% 0.79 / 0.85 / -6.4%
tpcds_q76/datafusion:vortex-file-compressed 43509932 / 43971378 / -1.0% 62687266 / 63388144 / -1.1% 0.69 / 0.69 / +0.1%
tpcds_q77/datafusion:vortex-file-compressed 35187819 / 35741318 / -1.5% 58691886 / 62197587 / -5.6% 0.60 / 0.57 / +4.3%
tpcds_q78/datafusion:vortex-file-compressed 80261304 / 80359945 / -0.1% 107527260 / 108606563 / -1.0% 0.75 / 0.74 / +0.9%
tpcds_q79/datafusion:vortex-file-compressed 21234220 / 21574348 / -1.6% 41175540 / 42003956 / -2.0% 0.52 / 0.51 / +0.4%
tpcds_q80/datafusion:vortex-file-compressed 76107231 / 76924502 / -1.1% 108860244 / 112653029 / -3.4% 0.70 / 0.68 / +2.4%
tpcds_q81/datafusion:vortex-file-compressed 28092150 / 28140101 / -0.2% 45532982 / 45903086 / -0.8% 0.62 / 0.61 / +0.6%
tpcds_q82/datafusion:vortex-file-compressed 13488924 / 13495116 / -0.0% 36776258 / 34632554 / +6.2% 0.37 / 0.39 / -5.9%
tpcds_q83/datafusion:vortex-file-compressed 36463926 / 36065150 / +1.1% 56030919 / 58502756 / -4.2% 0.65 / 0.62 / +5.6%
tpcds_q84/datafusion:vortex-file-compressed 11863070 / 11976792 / -0.9% 27479880 / 29070537 / -5.5% 0.43 / 0.41 / +4.8%
tpcds_q85/datafusion:vortex-file-compressed 59739806 / 59334170 / +0.7% 84254856 / 85696527 / -1.7% 0.71 / 0.69 / +2.4%
tpcds_q86/datafusion:vortex-file-compressed 16384726 / 16348562 / +0.2% 32260044 / 33439477 / -3.5% 0.51 / 0.49 / +3.9%
tpcds_q87/datafusion:vortex-file-compressed 29601948 / 29803142 / -0.7% 51217962 / 51409902 / -0.4% 0.58 / 0.58 / -0.3%
tpcds_q88/datafusion:vortex-file-compressed 35082391 / 34554180 / +1.5% 63286066 / 61485432 / +2.9% 0.55 / 0.56 / -1.4%
tpcds_q89/datafusion:vortex-file-compressed 21801270 / 21125854 / +3.2% 40905842 / 41041172 / -0.3% 0.53 / 0.51 / +3.5%
tpcds_q90/datafusion:vortex-file-compressed 10333360 / 10385954 / -0.5% 27031102 / 27364095 / -1.2% 0.38 / 0.38 / +0.7%
tpcds_q91/datafusion:vortex-file-compressed 17048635 / 16847242 / +1.2% 35926791 / 37671534 / -4.6% 0.47 / 0.45 / +6.1%
tpcds_q92/datafusion:vortex-file-compressed 13790951 / 13782900 / +0.1% 32397418 / 32552739 / -0.5% 0.43 / 0.42 / +0.5%
tpcds_q93/datafusion:vortex-file-compressed 23835486 / 24322544 / -2.0% 46201688 / 46730122 / -1.1% 0.52 / 0.52 / -0.9%
tpcds_q94/datafusion:vortex-file-compressed 19821684 / 19958883 / -0.7% 39961376 / 42113118 / -5.1% 0.50 / 0.47 / +4.7%
tpcds_q95/datafusion:vortex-file-compressed 46526940 / 45991068 / +1.2% 68530137 / 67624281 / +1.3% 0.68 / 0.68 / -0.2%
tpcds_q96/datafusion:vortex-file-compressed 9473787 / 9312906 / +1.7% 26250841 / 27187965 / -3.4% 0.36 / 0.34 / +5.4%
tpcds_q97/datafusion:vortex-file-compressed 21273010 / 21183288 / +0.4% 43444245 / 45726866 / -5.0% 0.49 / 0.46 / +5.7%
tpcds_q98/datafusion:vortex-file-compressed 17281401 / 16842682 / +2.6% 36971130 / 36599480 / +1.0% 0.47 / 0.46 / +1.6%
tpcds_q99/datafusion:vortex-file-compressed 19420017 / 19458266 / -0.2% 38691255 / 38993987 / -0.8% 0.50 / 0.50 / +0.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30192459 / 30062198 / +0.4% 46336631 / 49831058 / -7.0% 0.65 / 0.60 / +8.0%
tpcds_q02/datafusion:parquet 46078832 / 45016867 / +2.4% 59340001 / 61454861 / -3.4% 0.78 / 0.73 / +6.0%
tpcds_q03/datafusion:parquet 18817620 / 18920669 / -0.5% 31456903 / 33386590 / -5.8% 0.60 / 0.57 / +5.6%
tpcds_q04/datafusion:parquet 192484058 / 194600820 / -1.1% 223335347 / 225310035 / -0.9% 0.86 / 0.86 / -0.2%
tpcds_q05/datafusion:parquet 72010059 / 71382220 / +0.9% 97557000 / 98813829 / -1.3% 0.74 / 0.72 / +2.2%
tpcds_q06/datafusion:parquet 34823510 / 34775912 / +0.1% 50917222 / 51251478 / -0.7% 0.68 / 0.68 / +0.8%
tpcds_q07/datafusion:parquet 45644748 / 46135303 / -1.1% 65993490 / 67532411 / -2.3% 0.69 / 0.68 / +1.2%
tpcds_q08/datafusion:parquet 39542382 / 39375014 / +0.4% 53243641 / 54659730 / -2.6% 0.74 / 0.72 / +3.1%
tpcds_q09/datafusion:parquet 30692197 / 30701824 / -0.0% 43471331 / 42890248 / +1.4% 0.71 / 0.72 / -1.4%
tpcds_q10/datafusion:parquet 51472664 / 51136871 / +0.7% 67427280 / 65633088 / +2.7% 0.76 / 0.78 / -2.0%
tpcds_q11/datafusion:parquet 92648142 / 95844155 / -3.3% 118618766 / 120923009 / -1.9% 0.78 / 0.79 / -1.5%
tpcds_q12/datafusion:parquet 24311221 / 24743280 / -1.7% 36544152 / 36752086 / -0.6% 0.67 / 0.67 / -1.2%
tpcds_q13/datafusion:parquet 45776798 / 44700036 / +2.4% 65826526 / 66895580 / -1.6% 0.70 / 0.67 / +4.1%
tpcds_q14/datafusion:parquet 140689614 / 140156019 / +0.4% 150088072 / 155761551 / -3.6% 0.94 / 0.90 / +4.2%
tpcds_q15/datafusion:parquet 31338042 / 30835644 / +1.6% 48282004 / 49743752 / -2.9% 0.65 / 0.62 / +4.7%
tpcds_q16/datafusion:parquet 36774122 / 38092580 / -3.5% 55312007 / 56497738 / -2.1% 0.66 / 0.67 / -1.4%
tpcds_q17/datafusion:parquet 74459504 / 73441380 / +1.4% 101336879 / 100472278 / +0.9% 0.73 / 0.73 / +0.5%
tpcds_q18/datafusion:parquet 59598206 / 60670620 / -1.8% 77096734 / 80316332 / -4.0% 0.77 / 0.76 / +2.3%
tpcds_q19/datafusion:parquet 32266536 / 32064820 / +0.6% 49284804 / 50759122 / -2.9% 0.65 / 0.63 / +3.6%
tpcds_q20/datafusion:parquet 25336827 / 25527740 / -0.7% 37597118 / 38186111 / -1.5% 0.67 / 0.67 / +0.8%
tpcds_q21/datafusion:parquet 20691772 / 20351322 / +1.7% 33626007 / 34110002 / -1.4% 0.62 / 0.60 / +3.1%
tpcds_q22/datafusion:parquet 77274838 / 77973004 / -0.9% 91993718 / 94868990 / -3.0% 0.84 / 0.82 / +2.2%
tpcds_q23/datafusion:parquet 114751961 / 118363890 / -3.1% 141550815 / 143667462 / -1.5% 0.81 / 0.82 / -1.6%
tpcds_q24/datafusion:parquet 89409018 / 89810130 / -0.4% 118684066 / 120731087 / -1.7% 0.75 / 0.74 / +1.3%
tpcds_q25/datafusion:parquet 75620808 / 74786102 / +1.1% 102828560 / 102343248 / +0.5% 0.74 / 0.73 / +0.6%
tpcds_q26/datafusion:parquet 41991959 / 42085026 / -0.2% 58239014 / 61823422 / -5.8% 0.72 / 0.68 / +5.9%
tpcds_q27/datafusion:parquet 77540802 / 76658520 / +1.2% 105789094 / 103133026 / +2.6% 0.73 / 0.74 / -1.4%
tpcds_q28/datafusion:parquet 26656840 / 28019366 / -4.9% 42114230 / 42768823 / -1.5% 0.63 / 0.66 / -3.4%
tpcds_q29/datafusion:parquet 77069357 / 75899113 / +1.5% 101965178 / 103229337 / -1.2% 0.76 / 0.74 / +2.8%
tpcds_q30/datafusion:parquet 45420356 / 44695710 / +1.6% 64581235 / 69420764 / -7.0% 0.70 / 0.64 / +9.2%
tpcds_q31/datafusion:parquet 90634406 / 90738140 / -0.1% 107302777 / 104988607 / +2.2% 0.84 / 0.86 / -2.3%
tpcds_q32/datafusion:parquet 25679438 / 25860522 / -0.7% 41790422 / 43007189 / -2.8% 0.61 / 0.60 / +2.2%
tpcds_q33/datafusion:parquet 39300775 / 39190389 / +0.3% 56977159 / 58693329 / -2.9% 0.69 / 0.67 / +3.3%
tpcds_q34/datafusion:parquet 23539043 / 23689580 / -0.6% 38220065 / 39468263 / -3.2% 0.62 / 0.60 / +2.6%
tpcds_q35/datafusion:parquet 53082415 / 53794318 / -1.3% 71951079 / 72653555 / -1.0% 0.74 / 0.74 / -0.4%
tpcds_q36/datafusion:parquet 51171825 / 50292870 / +1.7% 73554438 / 73874019 / -0.4% 0.70 / 0.68 / +2.2%
tpcds_q37/datafusion:parquet 25190222 / 25720264 / -2.1% 39001261 / 39870808 / -2.2% 0.65 / 0.65 / +0.1%
tpcds_q38/datafusion:parquet 43267730 / 44774258 / -3.4% 62539193 / 66599171 / -6.1% 0.69 / 0.67 / +2.9%
tpcds_q39/datafusion:parquet 71384226 / 72219204 / -1.2% 90596301 / 93695676 / -3.3% 0.79 / 0.77 / +2.2%
tpcds_q40/datafusion:parquet 29732259 / 29472098 / +0.9% 50755238 / 51453273 / -1.4% 0.59 / 0.57 / +2.3%
tpcds_q41/datafusion:parquet 20089422 / 19823526 / +1.3% 32884935 / 35494435 / -7.4% 0.61 / 0.56 / +9.4%
tpcds_q42/datafusion:parquet 18200600 / 18261986 / -0.3% 31486735 / 32190769 / -2.2% 0.58 / 0.57 / +1.9%
tpcds_q43/datafusion:parquet 19603596 / 19368988 / +1.2% 33532918 / 33611807 / -0.2% 0.58 / 0.58 / +1.4%
tpcds_q44/datafusion:parquet 33498411 / 34808793 / -3.8% 51379089 / 52905277 / -2.9% 0.65 / 0.66 / -0.9%
tpcds_q45/datafusion:parquet 38281536 / 39043766 / -2.0% 54760465 / 56999496 / -3.9% 0.70 / 0.68 / +2.1%
tpcds_q46/datafusion:parquet 29823380 / 29368984 / +1.5% 51581662 / 53551238 / -3.7% 0.58 / 0.55 / +5.4%
tpcds_q47/datafusion:parquet 99582842 / 99416911 / +0.2% 118811192 / 126249094 / -5.9% 0.84 / 0.79 / +6.4%
tpcds_q48/datafusion:parquet 41840098 / 41600378 / +0.6% 61636672 / 64542678 / -4.5% 0.68 / 0.64 / +5.3%
tpcds_q49/datafusion:parquet 75471794 / 76577116 / -1.4% 100474716 / 99659438 / +0.8% 0.75 / 0.77 / -2.2%
tpcds_q50/datafusion:parquet 47436896 / 48177886 / -1.5% 70391924 / 73155619 / -3.8% 0.67 / 0.66 / +2.3%
tpcds_q51/datafusion:parquet 71329928 / 71466433 / -0.2% 92765138 / 93666681 / -1.0% 0.77 / 0.76 / +0.8%
tpcds_q52/datafusion:parquet 18553803 / 18888608 / -1.8% 33202208 / 31906212 / +4.1% 0.56 / 0.59 / -5.6%
tpcds_q53/datafusion:parquet 23023206 / 22690602 / +1.5% 41464070 / 40721522 / +1.8% 0.56 / 0.56 / -0.4%
tpcds_q54/datafusion:parquet 54897190 / 54788424 / +0.2% 74664548 / 68594589 / +8.8% 0.74 / 0.80 / -7.9%
tpcds_q55/datafusion:parquet 17963852 / 18135092 / -0.9% 30542020 / 31668741 / -3.6% 0.59 / 0.57 / +2.7%
tpcds_q56/datafusion:parquet 45838559 / 45959838 / -0.3% 61792043 / 62040832 / -0.4% 0.74 / 0.74 / +0.1%
tpcds_q57/datafusion:parquet 100447556 / 101336019 / -0.9% 121837431 / 123671684 / -1.5% 0.82 / 0.82 / +0.6%
tpcds_q58/datafusion:parquet 64361540 / 64328912 / +0.1% 82703560 / 85116060 / -2.8% 0.78 / 0.76 / +3.0%
tpcds_q59/datafusion:parquet 46093364 / 46630518 / -1.2% 64956406 / 66331280 / -2.1% 0.71 / 0.70 / +0.9%
tpcds_q60/datafusion:parquet 44945368 / 45756330 / -1.8% 61562387 / 62641411 / -1.7% 0.73 / 0.73 / -0.1%
tpcds_q61/datafusion:parquet 37861204 / 39926925 / -5.2% 61009495 / 58306094 / +4.6% 0.62 / 0.68 / -9.4%
tpcds_q62/datafusion:parquet 25260891 / 25236282 / +0.1% 39683449 / 40027485 / -0.9% 0.64 / 0.63 / +1.0%
tpcds_q63/datafusion:parquet 22185616 / 22264648 / -0.4% 40558163 / 42664016 / -4.9% 0.55 / 0.52 / +4.8%
tpcds_q64/datafusion:parquet 207005610 / 207892780 / -0.4% 239419292 / 237873277 / +0.6% 0.86 / 0.87 / -1.1%
tpcds_q65/datafusion:parquet 37649388 / 36759290 / +2.4% 57824229 / 58673841 / -1.4% 0.65 / 0.63 / +3.9%
tpcds_q66/datafusion:parquet 62217006 / 62200356 / +0.0% 82040964 / 79212404 / +3.6% 0.76 / 0.79 / -3.4%
tpcds_q67/datafusion:parquet 69528052 / 70326757 / -1.1% 97152977 / 98660867 / -1.5% 0.72 / 0.71 / +0.4%
tpcds_q68/datafusion:parquet 29290324 / 29275181 / +0.1% 50803603 / 53185853 / -4.5% 0.58 / 0.55 / +4.7%
tpcds_q69/datafusion:parquet 49548046 / 49049070 / +1.0% 63711722 / 62616738 / +1.7% 0.78 / 0.78 / -0.7%
tpcds_q70/datafusion:parquet 36966364 / 36863418 / +0.3% 57779517 / 51853141 / +11.4% 🔴 0.64 / 0.71 / -10.0%
tpcds_q71/datafusion:parquet 28580974 / 28930465 / -1.2% 43914243 / 44602436 / -1.5% 0.65 / 0.65 / +0.3%
tpcds_q72/datafusion:parquet 550098935 / 549486546 / +0.1% 583256387 / 574966962 / +1.4% 0.94 / 0.96 / -1.3%
tpcds_q73/datafusion:parquet 23007928 / 23137152 / -0.6% 39208558 / 37995620 / +3.2% 0.59 / 0.61 / -3.6%
tpcds_q74/datafusion:parquet 69341650 / 68505526 / +1.2% 86509066 / 87321449 / -0.9% 0.80 / 0.78 / +2.2%
tpcds_q75/datafusion:parquet 147111890 / 144646848 / +1.7% 184443658 / 174812408 / +5.5% 0.80 / 0.83 / -3.6%
tpcds_q76/datafusion:parquet 53938787 / 53713398 / +0.4% 69756686 / 72896464 / -4.3% 0.77 / 0.74 / +4.9%
tpcds_q77/datafusion:parquet 56991934 / 56953912 / +0.1% 77721715 / 78283238 / -0.7% 0.73 / 0.73 / +0.8%
tpcds_q78/datafusion:parquet 91986932 / 91460437 / +0.6% 121762121 / 130551991 / -6.7% 0.76 / 0.70 / +7.8%
tpcds_q79/datafusion:parquet 26356142 / 25929354 / +1.6% 47053881 / 46643507 / +0.9% 0.56 / 0.56 / +0.8%
tpcds_q80/datafusion:parquet 79735558 / 80662100 / -1.1% 112870045 / 116892165 / -3.4% 0.71 / 0.69 / +2.4%
tpcds_q81/datafusion:parquet 42122398 / 42690130 / -1.3% 63732595 / 58067699 / +9.8% 0.66 / 0.74 / -10.1%
tpcds_q82/datafusion:parquet 26024452 / 26691289 / -2.5% 40658324 / 43005524 / -5.5% 0.64 / 0.62 / +3.1%
tpcds_q83/datafusion:parquet 57584760 / 59131534 / -2.6% 75783193 / 76494683 / -0.9% 0.76 / 0.77 / -1.7%
tpcds_q84/datafusion:parquet 30336535 / 31124682 / -2.5% 45212092 / 46625879 / -3.0% 0.67 / 0.67 / +0.5%
tpcds_q85/datafusion:parquet 82971884 / 84931503 / -2.3% 108719154 / 110293019 / -1.4% 0.76 / 0.77 / -0.9%
tpcds_q86/datafusion:parquet 20557522 / 20269275 / +1.4% 35497921 / 35633136 / -0.4% 0.58 / 0.57 / +1.8%
tpcds_q87/datafusion:parquet 47058468 / 44804628 / +5.0% 63295635 / 64214462 / -1.4% 0.74 / 0.70 / +6.6%
tpcds_q88/datafusion:parquet 46940174 / 48961740 / -4.1% 71619803 / 65700336 / +9.0% 0.66 / 0.75 / -12.1%
tpcds_q89/datafusion:parquet 25654825 / 25895460 / -0.9% 43659385 / 46003742 / -5.1% 0.59 / 0.56 / +4.4%
tpcds_q90/datafusion:parquet 19276804 / 19374612 / -0.5% 33823423 / 33743440 / +0.2% 0.57 / 0.57 / -0.7%
tpcds_q91/datafusion:parquet 36369216 / 36973164 / -1.6% 53133707 / 56714901 / -6.3% 0.68 / 0.65 / +5.0%
tpcds_q92/datafusion:parquet 26304982 / 26083588 / +0.8% 42224861 / 41400050 / +2.0% 0.62 / 0.63 / -1.1%
tpcds_q93/datafusion:parquet 26933448 / 27294046 / -1.3% 47365383 / 49517527 / -4.3% 0.57 / 0.55 / +3.2%
tpcds_q94/datafusion:parquet 34614983 / 34608264 / +0.0% 49701634 / 49900120 / -0.4% 0.70 / 0.69 / +0.4%
tpcds_q95/datafusion:parquet 64020034 / 64315113 / -0.5% 79218871 / 85578425 / -7.4% 0.81 / 0.75 / +7.5%
tpcds_q96/datafusion:parquet 16350507 / 16910192 / -3.3% 29558972 / 31000608 / -4.7% 0.55 / 0.55 / +1.4%
tpcds_q97/datafusion:parquet 35138214 / 35008334 / +0.4% 54407479 / 57220196 / -4.9% 0.65 / 0.61 / +5.6%
tpcds_q98/datafusion:parquet 25513548 / 25504364 / +0.0% 40392036 / 41454657 / -2.6% 0.63 / 0.62 / +2.7%
tpcds_q99/datafusion:parquet 29583806 / 29807734 / -0.8% 45108938 / 45883330 / -1.7% 0.66 / 0.65 / +1.0%
duckdb / vortex-file-compressed / ns (0.998x ➖, 4↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15202866 / 15118918 / +0.6% 24039831 / 23444500 / +2.5% 0.63 / 0.64 / -1.9%
tpcds_q02/duckdb:vortex-file-compressed 15105736 / 14710022 / +2.7% 19708822 / 22104465 / -10.8% 🟢 0.77 / 0.67 / +15.2%
tpcds_q03/duckdb:vortex-file-compressed 11359182 / 11574860 / -1.9% 23175104 / 21262361 / +9.0% 0.49 / 0.54 / -10.0%
tpcds_q04/duckdb:vortex-file-compressed 50548411 / 50926688 / -0.7% 62940241 / 63353450 / -0.7% 0.80 / 0.80 / -0.1%
tpcds_q05/duckdb:vortex-file-compressed 19358150 / 19017770 / +1.8% 26808903 / 27084443 / -1.0% 0.72 / 0.70 / +2.8%
tpcds_q06/duckdb:vortex-file-compressed 27079534 / 28865508 / -6.2% 40768993 / 42207265 / -3.4% 0.66 / 0.68 / -2.9%
tpcds_q07/duckdb:vortex-file-compressed 15929878 / 15465978 / +3.0% 30288162 / 30852428 / -1.8% 0.53 / 0.50 / +4.9%
tpcds_q08/duckdb:vortex-file-compressed 18837352 / 19212390 / -2.0% 28612855 / 31251779 / -8.4% 0.66 / 0.61 / +7.1%
tpcds_q09/duckdb:vortex-file-compressed 13643740 / 13598744 / +0.3% 22593137 / 23952500 / -5.7% 0.60 / 0.57 / +6.4%
tpcds_q10/duckdb:vortex-file-compressed 27250160 / 27573268 / -1.2% 40789987 / 44259420 / -7.8% 0.67 / 0.62 / +7.2%
tpcds_q11/duckdb:vortex-file-compressed 40123017 / 40352845 / -0.6% 53478043 / 51852520 / +3.1% 0.75 / 0.78 / -3.6%
tpcds_q12/duckdb:vortex-file-compressed 10439578 / 10423542 / +0.2% 17104630 / 17129628 / -0.1% 0.61 / 0.61 / +0.3%
tpcds_q13/duckdb:vortex-file-compressed 22125852 / 21755422 / +1.7% 33930353 / 36568937 / -7.2% 0.65 / 0.59 / +9.6%
tpcds_q14/duckdb:vortex-file-compressed 58427512 / 58198622 / +0.4% 70814620 / 72970238 / -3.0% 0.83 / 0.80 / +3.4%
tpcds_q15/duckdb:vortex-file-compressed 20762410 / 20708794 / +0.3% 25953995 / 26234294 / -1.1% 0.80 / 0.79 / +1.3%
tpcds_q16/duckdb:vortex-file-compressed 17576508 / 17457168 / +0.7% 26160131 / 28588627 / -8.5% 0.67 / 0.61 / +10.0%
tpcds_q17/duckdb:vortex-file-compressed 30094035 / 30069320 / +0.1% 44604154 / 44861538 / -0.6% 0.67 / 0.67 / +0.7%
tpcds_q18/duckdb:vortex-file-compressed 28548138 / 28079017 / +1.7% 36973015 / 39520430 / -6.4% 0.77 / 0.71 / +8.7%
tpcds_q19/duckdb:vortex-file-compressed 23490153 / 23534796 / -0.2% 38365229 / 37504458 / +2.3% 0.61 / 0.63 / -2.4%
tpcds_q20/duckdb:vortex-file-compressed 10568182 / 10616694 / -0.5% 18478297 / 16103017 / +14.8% 🔴 0.57 / 0.66 / -13.3%
tpcds_q21/duckdb:vortex-file-compressed 10982164 / 9807166 / +12.0% 🔴 21738610 / 20796186 / +4.5% 0.51 / 0.47 / +7.1%
tpcds_q22/duckdb:vortex-file-compressed 29353618 / 29449760 / -0.3% 39240301 / 40515189 / -3.1% 0.75 / 0.73 / +2.9%
tpcds_q23/duckdb:vortex-file-compressed 36285234 / 36669386 / -1.0% 48677891 / 47835563 / +1.8% 0.75 / 0.77 / -2.8%
tpcds_q24/duckdb:vortex-file-compressed 28276460 / 28496017 / -0.8% 39985094 / 39742417 / +0.6% 0.71 / 0.72 / -1.4%
tpcds_q25/duckdb:vortex-file-compressed 25740190 / 25269028 / +1.9% 41372648 / 44430894 / -6.9% 0.62 / 0.57 / +9.4%
tpcds_q26/duckdb:vortex-file-compressed 13719484 / 13396333 / +2.4% 21174454 / 21188475 / -0.1% 0.65 / 0.63 / +2.5%
tpcds_q27/duckdb:vortex-file-compressed 18655069 / 17349129 / +7.5% 30483051 / 32458960 / -6.1% 0.61 / 0.53 / +14.5%
tpcds_q28/duckdb:vortex-file-compressed 12880163 / 13138052 / -2.0% 24640015 / 22468232 / +9.7% 0.52 / 0.58 / -10.6%
tpcds_q29/duckdb:vortex-file-compressed 28638776 / 28536814 / +0.4% 43914862 / 44945092 / -2.3% 0.65 / 0.63 / +2.7%
tpcds_q30/duckdb:vortex-file-compressed 19266975 / 19092098 / +0.9% 27813181 / 31080387 / -10.5% 🟢 0.69 / 0.61 / +12.8%
tpcds_q31/duckdb:vortex-file-compressed 19152130 / 19214219 / -0.3% 25762061 / 28658799 / -10.1% 🟢 0.74 / 0.67 / +10.9%
tpcds_q32/duckdb:vortex-file-compressed 10720851 / 9991125 / +7.3% 18628533 / 20820814 / -10.5% 🟢 0.58 / 0.48 / +19.9%
tpcds_q33/duckdb:vortex-file-compressed 16778636 / 16428751 / +2.1% 28846926 / 28456952 / +1.4% 0.58 / 0.58 / +0.7%
tpcds_q34/duckdb:vortex-file-compressed 15648321 / 15791876 / -0.9% 21518181 / 22305620 / -3.5% 0.73 / 0.71 / +2.7%
tpcds_q35/duckdb:vortex-file-compressed 46068202 / 45868926 / +0.4% 61243389 / 64080846 / -4.4% 0.75 / 0.72 / +5.1%
tpcds_q36/duckdb:vortex-file-compressed 14805979 / 15314427 / -3.3% 28564984 / 29422386 / -2.9% 0.52 / 0.52 / -0.4%
tpcds_q37/duckdb:vortex-file-compressed 13666470 / 13859666 / -1.4% 25155415 / 23226791 / +8.3% 0.54 / 0.60 / -9.0%
tpcds_q38/duckdb:vortex-file-compressed 22382936 / 22586217 / -0.9% 28512021 / 29186123 / -2.3% 0.79 / 0.77 / +1.4%
tpcds_q39/duckdb:vortex-file-compressed 18566574 / 18377802 / +1.0% 29987197 / 28252337 / +6.1% 0.62 / 0.65 / -4.8%
tpcds_q40/duckdb:vortex-file-compressed 12982402 / 13138184 / -1.2% 21911351 / 19948211 / +9.8% 0.59 / 0.66 / -10.0%
tpcds_q41/duckdb:vortex-file-compressed 6603510 / 6645386 / -0.6% 10020184 / 9841974 / +1.8% 0.66 / 0.68 / -2.4%
tpcds_q42/duckdb:vortex-file-compressed 8074650 / 7994049 / +1.0% 17334668 / 22175710 / -21.8% 🟢 0.47 / 0.36 / +29.2%
tpcds_q43/duckdb:vortex-file-compressed 9825226 / 10141478 / -3.1% 18089331 / 18493113 / -2.2% 0.54 / 0.55 / -1.0%
tpcds_q44/duckdb:vortex-file-compressed 15409226 / 15302974 / +0.7% 25631277 / 24177256 / +6.0% 0.60 / 0.63 / -5.0%
tpcds_q45/duckdb:vortex-file-compressed 22279882 / 22425601 / -0.6% 29684287 / 29743391 / -0.2% 0.75 / 0.75 / -0.5%
tpcds_q46/duckdb:vortex-file-compressed 18189351 / 18427240 / -1.3% 34495599 / 30331482 / +13.7% 🔴 0.53 / 0.61 / -13.2%
tpcds_q47/duckdb:vortex-file-compressed 31589170 / 31434004 / +0.5% 40559581 / 43294688 / -6.3% 0.78 / 0.73 / +7.3%
tpcds_q48/duckdb:vortex-file-compressed 19516882 / 19977178 / -2.3% 31435766 / 32424701 / -3.0% 0.62 / 0.62 / +0.8%
tpcds_q49/duckdb:vortex-file-compressed 17052754 / 17072764 / -0.1% 30134143 / 32023760 / -5.9% 0.57 / 0.53 / +6.1%
tpcds_q50/duckdb:vortex-file-compressed 16797384 / 17184823 / -2.3% 27917142 / 28664061 / -2.6% 0.60 / 0.60 / +0.4%
tpcds_q51/duckdb:vortex-file-compressed 77463838 / 63866094 / +21.3% 🔴 63279339 / 91255244 / -30.7% 🟢 1.22 / 0.70 / +74.9%
tpcds_q52/duckdb:vortex-file-compressed 8360630 / 8672758 / -3.6% 20254309 / 21017030 / -3.6% 0.41 / 0.41 / +0.0%
tpcds_q53/duckdb:vortex-file-compressed 14812023 / 14551083 / +1.8% 25799631 / 25681648 / +0.5% 0.57 / 0.57 / +1.3%
tpcds_q54/duckdb:vortex-file-compressed 20504608 / 20157296 / +1.7% 28264503 / 30450983 / -7.2% 0.73 / 0.66 / +9.6%
tpcds_q55/duckdb:vortex-file-compressed 8165768 / 9855140 / -17.1% 🟢 16572544 / 17958671 / -7.7% 0.49 / 0.55 / -10.2%
tpcds_q56/duckdb:vortex-file-compressed 17401638 / 17286974 / +0.7% 29474949 / 31196700 / -5.5% 0.59 / 0.55 / +6.5%
tpcds_q57/duckdb:vortex-file-compressed 24649940 / 26949785 / -8.5% 32867941 / 31761359 / +3.5% 0.75 / 0.85 / -11.6%
tpcds_q58/duckdb:vortex-file-compressed 17852634 / 17885228 / -0.2% 27113247 / 28670513 / -5.4% 0.66 / 0.62 / +5.6%
tpcds_q59/duckdb:vortex-file-compressed 18808842 / 21505809 / -12.5% 🟢 25129385 / 25053272 / +0.3% 0.75 / 0.86 / -12.8%
tpcds_q60/duckdb:vortex-file-compressed 18143404 / 18233587 / -0.5% 30363443 / 31588104 / -3.9% 0.60 / 0.58 / +3.5%
tpcds_q61/duckdb:vortex-file-compressed 19607716 / 19243559 / +1.9% 32520344 / 32959639 / -1.3% 0.60 / 0.58 / +3.3%
tpcds_q62/duckdb:vortex-file-compressed 10372558 / 10169523 / +2.0% 16090895 / 18306354 / -12.1% 🟢 0.64 / 0.56 / +16.0%
tpcds_q63/duckdb:vortex-file-compressed 13499538 / 14702753 / -8.2% 22316076 / 23901017 / -6.6% 0.60 / 0.62 / -1.7%
tpcds_q64/duckdb:vortex-file-compressed 62268943 / 63578732 / -2.1% 76979382 / 80844661 / -4.8% 0.81 / 0.79 / +2.9%
tpcds_q65/duckdb:vortex-file-compressed 16106094 / 15598224 / +3.3% 24829366 / 25816271 / -3.8% 0.65 / 0.60 / +7.4%
tpcds_q66/duckdb:vortex-file-compressed 20734583 / 22033432 / -5.9% 28226030 / 35116952 / -19.6% 🟢 0.73 / 0.63 / +17.1%
tpcds_q67/duckdb:vortex-file-compressed 66707100 / 65137936 / +2.4% 82411606 / 82522607 / -0.1% 0.81 / 0.79 / +2.5%
tpcds_q68/duckdb:vortex-file-compressed 18507736 / 18312185 / +1.1% 29246897 / 27166712 / +7.7% 0.63 / 0.67 / -6.1%
tpcds_q69/duckdb:vortex-file-compressed 28911040 / 29291397 / -1.3% 43079970 / 43904858 / -1.9% 0.67 / 0.67 / +0.6%
tpcds_q70/duckdb:vortex-file-compressed 19103948 / 18596019 / +2.7% 29035211 / 34974873 / -17.0% 🟢 0.66 / 0.53 / +23.7%
tpcds_q71/duckdb:vortex-file-compressed 13189866 / 12887450 / +2.3% 21274388 / 25269234 / -15.8% 🟢 0.62 / 0.51 / +21.6%
tpcds_q72/duckdb:vortex-file-compressed 61427554 / 61489362 / -0.1% 77317520 / 77946399 / -0.8% 0.79 / 0.79 / +0.7%
tpcds_q73/duckdb:vortex-file-compressed 15216792 / 14868260 / +2.3% 19995318 / 20633436 / -3.1% 0.76 / 0.72 / +5.6%
tpcds_q74/duckdb:vortex-file-compressed 27111520 / 27413339 / -1.1% 38101990 / 36907391 / +3.2% 0.71 / 0.74 / -4.2%
tpcds_q75/duckdb:vortex-file-compressed 30030210 / 28556840 / +5.2% 43288499 / 49585047 / -12.7% 🟢 0.69 / 0.58 / +20.5%
tpcds_q76/duckdb:vortex-file-compressed 12376102 / 12245948 / +1.1% 22076093 / 25391713 / -13.1% 🟢 0.56 / 0.48 / +16.2%
tpcds_q77/duckdb:vortex-file-compressed 15695980 / 17143913 / -8.4% 23662251 / 25697461 / -7.9% 0.66 / 0.67 / -0.6%
tpcds_q78/duckdb:vortex-file-compressed 37803446 / 37166454 / +1.7% 51355833 / 46931936 / +9.4% 0.74 / 0.79 / -7.0%
tpcds_q79/duckdb:vortex-file-compressed 14646191 / 14804282 / -1.1% 24035967 / 27966210 / -14.1% 🟢 0.61 / 0.53 / +15.1%
tpcds_q80/duckdb:vortex-file-compressed 27999094 / 28531126 / -1.9% 39689365 / 45544614 / -12.9% 🟢 0.71 / 0.63 / +12.6%
tpcds_q81/duckdb:vortex-file-compressed 22515334 / 22321520 / +0.9% 30245382 / 30345580 / -0.3% 0.74 / 0.74 / +1.2%
tpcds_q82/duckdb:vortex-file-compressed 32261313 / 32300958 / -0.1% 41323865 / 40596794 / +1.8% 0.78 / 0.80 / -1.9%
tpcds_q83/duckdb:vortex-file-compressed 20342053 / 19906540 / +2.2% 25443837 / 25780172 / -1.3% 0.80 / 0.77 / +3.5%
tpcds_q84/duckdb:vortex-file-compressed 14426035 / 12707602 / +13.5% 🔴 17651315 / 24752526 / -28.7% 🟢 0.82 / 0.51 / +59.2%
tpcds_q85/duckdb:vortex-file-compressed 31615810 / 31255034 / +1.2% 41236930 / 41312334 / -0.2% 0.77 / 0.76 / +1.3%
tpcds_q86/duckdb:vortex-file-compressed 10873902 / 13483782 / -19.4% 🟢 17858595 / 19585385 / -8.8% 0.61 / 0.69 / -11.6%
tpcds_q87/duckdb:vortex-file-compressed 23935958 / 24058795 / -0.5% 31166897 / 30487617 / +2.2% 0.77 / 0.79 / -2.7%
tpcds_q88/duckdb:vortex-file-compressed 32340816 / 33142186 / -2.4% 44603059 / 48009431 / -7.1% 0.73 / 0.69 / +5.0%
tpcds_q89/duckdb:vortex-file-compressed 13871242 / 14479628 / -4.2% 23287201 / 24476912 / -4.9% 0.60 / 0.59 / +0.7%
tpcds_q90/duckdb:vortex-file-compressed 8224676 / 8017384 / +2.6% 14231574 / 12523681 / +13.6% 🔴 0.58 / 0.64 / -9.7%
tpcds_q91/duckdb:vortex-file-compressed 15341643 / 14955504 / +2.6% 21181272 / 22165806 / -4.4% 0.72 / 0.67 / +7.4%
tpcds_q92/duckdb:vortex-file-compressed 13064776 / 13110166 / -0.3% 22213690 / 20794165 / +6.8% 0.59 / 0.63 / -6.7%
tpcds_q93/duckdb:vortex-file-compressed 18286156 / 16510604 / +10.8% 🔴 25473197 / 24657281 / +3.3% 0.72 / 0.67 / +7.2%
tpcds_q94/duckdb:vortex-file-compressed 16653910 / 16049908 / +3.8% 26250415 / 26581257 / -1.2% 0.63 / 0.60 / +5.1%
tpcds_q95/duckdb:vortex-file-compressed 45459086 / 44838474 / +1.4% 53449044 / 55786957 / -4.2% 0.85 / 0.80 / +5.8%
tpcds_q96/duckdb:vortex-file-compressed 7409471 / 7412020 / -0.0% 14732858 / 15121684 / -2.6% 0.50 / 0.49 / +2.6%
tpcds_q97/duckdb:vortex-file-compressed 22155301 / 22450090 / -1.3% 29022187 / 31566659 / -8.1% 0.76 / 0.71 / +7.3%
tpcds_q98/duckdb:vortex-file-compressed 13501056 / 15353082 / -12.1% 🟢 22653868 / 24158213 / -6.2% 0.60 / 0.64 / -6.2%
tpcds_q99/duckdb:vortex-file-compressed 13216039 / 13293168 / -0.6% 19368882 / 22711737 / -14.7% 🟢 0.68 / 0.59 / +16.6%
duckdb / parquet / ns (1.006x ➖, 4↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 26274570 / 23593523 / +11.4% 🔴 31601036 / 32101938 / -1.6% 0.83 / 0.73 / +13.1%
tpcds_q02/duckdb:parquet 18213499 / 15401036 / +18.3% 🔴 20276697 / 20211375 / +0.3% 0.90 / 0.76 / +17.9%
tpcds_q03/duckdb:parquet 8851034 / 8789880 / +0.7% 15626222 / 15821348 / -1.2% 0.57 / 0.56 / +2.0%
tpcds_q04/duckdb:parquet 127412109 / 127865106 / -0.4% 133615296 / 132570222 / +0.8% 0.95 / 0.96 / -1.1%
tpcds_q05/duckdb:parquet 21437392 / 21335930 / +0.5% 25599346 / 31379130 / -18.4% 🟢 0.84 / 0.68 / +23.2%
tpcds_q06/duckdb:parquet 26892832 / 26224556 / +2.5% 38905883 / 37269814 / +4.4% 0.69 / 0.70 / -1.8%
tpcds_q07/duckdb:parquet 15236832 / 15170734 / +0.4% 22480185 / 26531395 / -15.3% 🟢 0.68 / 0.57 / +18.5%
tpcds_q08/duckdb:parquet 25612647 / 27491166 / -6.8% 35398378 / 33462561 / +5.8% 0.72 / 0.82 / -11.9%
tpcds_q09/duckdb:parquet 18662258 / 18807930 / -0.8% 23344902 / 24261607 / -3.8% 0.80 / 0.78 / +3.1%
tpcds_q10/duckdb:parquet 27826942 / 27652594 / +0.6% 38459455 / 37256908 / +3.2% 0.72 / 0.74 / -2.5%
tpcds_q11/duckdb:parquet 72174506 / 71411006 / +1.1% 78964531 / 78527578 / +0.6% 0.91 / 0.91 / +0.5%
tpcds_q12/duckdb:parquet 12742653 / 12410918 / +2.7% 17375577 / 17784810 / -2.3% 0.73 / 0.70 / +5.1%
tpcds_q13/duckdb:parquet 24055351 / 23893012 / +0.7% 31577812 / 31814883 / -0.7% 0.76 / 0.75 / +1.4%
tpcds_q14/duckdb:parquet 61090644 / 60369483 / +1.2% 67655822 / 70243386 / -3.7% 0.90 / 0.86 / +5.1%
tpcds_q15/duckdb:parquet 25005986 / 24732292 / +1.1% 31417052 / 30609124 / +2.6% 0.80 / 0.81 / -1.5%
tpcds_q16/duckdb:parquet 20067631 / 19887399 / +0.9% 29043899 / 28641898 / +1.4% 0.69 / 0.69 / -0.5%
tpcds_q17/duckdb:parquet 32442578 / 33713257 / -3.8% 41050095 / 40790699 / +0.6% 0.79 / 0.83 / -4.4%
tpcds_q18/duckdb:parquet 39706378 / 39479976 / +0.6% 56106170 / 49776007 / +12.7% 🔴 0.71 / 0.79 / -10.8%
tpcds_q19/duckdb:parquet 24479120 / 24277930 / +0.8% 32064548 / 33682842 / -4.8% 0.76 / 0.72 / +5.9%
tpcds_q20/duckdb:parquet 13772090 / 13617766 / +1.1% 18552776 / 17945029 / +3.4% 0.74 / 0.76 / -2.2%
tpcds_q21/duckdb:parquet 9497120 / 9414642 / +0.9% 13180043 / 13358579 / -1.3% 0.72 / 0.70 / +2.2%
tpcds_q22/duckdb:parquet 37507046 / 36279765 / +3.4% 39974028 / 39093248 / +2.3% 0.94 / 0.93 / +1.1%
tpcds_q23/duckdb:parquet 40876964 / 40586666 / +0.7% 48187755 / 47443002 / +1.6% 0.85 / 0.86 / -0.8%
tpcds_q24/duckdb:parquet 33643710 / 33221028 / +1.3% 44193797 / 44149478 / +0.1% 0.76 / 0.75 / +1.2%
tpcds_q25/duckdb:parquet 30080837 / 30098483 / -0.1% 43052850 / 40464029 / +6.4% 0.70 / 0.74 / -6.1%
tpcds_q26/duckdb:parquet 31230560 / 30940594 / +0.9% 38979412 / 38162823 / +2.1% 0.80 / 0.81 / -1.2%
tpcds_q27/duckdb:parquet 33293987 / 32098111 / +3.7% 40468844 / 41790103 / -3.2% 0.82 / 0.77 / +7.1%
tpcds_q28/duckdb:parquet 17746414 / 16962842 / +4.6% 25416996 / 25657444 / -0.9% 0.70 / 0.66 / +5.6%
tpcds_q29/duckdb:parquet 30843244 / 30674292 / +0.6% 39133443 / 39771948 / -1.6% 0.79 / 0.77 / +2.2%
tpcds_q30/duckdb:parquet 32694612 / 32628346 / +0.2% 40908975 / 43394609 / -5.7% 0.80 / 0.75 / +6.3%
tpcds_q31/duckdb:parquet 20399444 / 20253019 / +0.7% 25804650 / 25644571 / +0.6% 0.79 / 0.79 / +0.1%
tpcds_q32/duckdb:parquet 11285966 / 11197721 / +0.8% 17700542 / 17222588 / +2.8% 0.64 / 0.65 / -1.9%
tpcds_q33/duckdb:parquet 16528674 / 16959038 / -2.5% 23486720 / 23252504 / +1.0% 0.70 / 0.73 / -3.5%
tpcds_q34/duckdb:parquet 16210331 / 15909302 / +1.9% 21976701 / 22165554 / -0.9% 0.74 / 0.72 / +2.8%
tpcds_q35/duckdb:parquet 46898120 / 47021200 / -0.3% 57519109 / 56894075 / +1.1% 0.82 / 0.83 / -1.3%
tpcds_q36/duckdb:parquet 15117370 / 15015256 / +0.7% 23103390 / 26238930 / -11.9% 🟢 0.65 / 0.57 / +14.3%
tpcds_q37/duckdb:parquet 11499441 / 12472008 / -7.8% 17777372 / 19131520 / -7.1% 0.65 / 0.65 / -0.8%
tpcds_q38/duckdb:parquet 26596196 / 26243322 / +1.3% 30642762 / 30294457 / +1.1% 0.87 / 0.87 / +0.2%
tpcds_q39/duckdb:parquet 24566320 / 24565908 / +0.0% 28958035 / 28686626 / +0.9% 0.85 / 0.86 / -0.9%
tpcds_q40/duckdb:parquet 16089238 / 15951000 / +0.9% 21772151 / 21909129 / -0.6% 0.74 / 0.73 / +1.5%
tpcds_q41/duckdb:parquet 7920454 / 7606298 / +4.1% 13548233 / 12777631 / +6.0% 0.58 / 0.60 / -1.8%
tpcds_q42/duckdb:parquet 8438723 / 8399644 / +0.5% 15200869 / 15025568 / +1.2% 0.56 / 0.56 / -0.7%
tpcds_q43/duckdb:parquet 10761393 / 10587260 / +1.6% 16242017 / 15743478 / +3.2% 0.66 / 0.67 / -1.5%
tpcds_q44/duckdb:parquet 16200598 / 16219078 / -0.1% 23107754 / 25053846 / -7.8% 0.70 / 0.65 / +8.3%
tpcds_q45/duckdb:parquet 23366495 / 23035947 / +1.4% 29634039 / 29231008 / +1.4% 0.79 / 0.79 / +0.1%
tpcds_q46/duckdb:parquet 36579766 / 36086350 / +1.4% 45558663 / 45631563 / -0.2% 0.80 / 0.79 / +1.5%
tpcds_q47/duckdb:parquet 31378590 / 31116106 / +0.8% 37521997 / 38028856 / -1.3% 0.84 / 0.82 / +2.2%
tpcds_q48/duckdb:parquet 21300728 / 21077824 / +1.1% 29108147 / 28331195 / +2.7% 0.73 / 0.74 / -1.6%
tpcds_q49/duckdb:parquet 19220266 / 18881618 / +1.8% 27375692 / 28952178 / -5.4% 0.70 / 0.65 / +7.7%
tpcds_q50/duckdb:parquet 17737100 / 17977907 / -1.3% 25575437 / 24936856 / +2.6% 0.69 / 0.72 / -3.8%
tpcds_q51/duckdb:parquet 54559373 / 52993790 / +3.0% 59565534 / 63132677 / -5.7% 0.92 / 0.84 / +9.1%
tpcds_q52/duckdb:parquet 8637154 / 8598854 / +0.4% 15174034 / 15556821 / -2.5% 0.57 / 0.55 / +3.0%
tpcds_q53/duckdb:parquet 11707104 / 11452456 / +2.2% 20564130 / 17399396 / +18.2% 🔴 0.57 / 0.66 / -13.5%
tpcds_q54/duckdb:parquet 20678837 / 20420981 / +1.3% 29803093 / 30514096 / -2.3% 0.69 / 0.67 / +3.7%
tpcds_q55/duckdb:parquet 8651287 / 9865324 / -12.3% 🟢 15288762 / 18739951 / -18.4% 🟢 0.57 / 0.53 / +7.5%
tpcds_q56/duckdb:parquet 16589946 / 16501204 / +0.5% 23650308 / 23668646 / -0.1% 0.70 / 0.70 / +0.6%
tpcds_q57/duckdb:parquet 29153330 / 28655818 / +1.7% 38141305 / 36212640 / +5.3% 0.76 / 0.79 / -3.4%
tpcds_q58/duckdb:parquet 18378966 / 18087312 / +1.6% 24574688 / 26014617 / -5.5% 0.75 / 0.70 / +7.6%
tpcds_q59/duckdb:parquet 19940928 / 21216761 / -6.0% 26261664 / 32820942 / -20.0% 🟢 0.76 / 0.65 / +17.5%
tpcds_q60/duckdb:parquet 17228902 / 16734356 / +3.0% 26096369 / 24632340 / +5.9% 0.66 / 0.68 / -2.8%
tpcds_q61/duckdb:parquet 21687639 / 21560786 / +0.6% 29439311 / 29818285 / -1.3% 0.74 / 0.72 / +1.9%
tpcds_q62/duckdb:parquet 10860103 / 13304468 / -18.4% 🟢 15349188 / 14747168 / +4.1% 0.71 / 0.90 / -21.6%
tpcds_q63/duckdb:parquet 11055002 / 10903936 / +1.4% 16674453 / 17066617 / -2.3% 0.66 / 0.64 / +3.8%
tpcds_q64/duckdb:parquet 53035822 / 53287355 / -0.5% 65064994 / 73372365 / -11.3% 🟢 0.82 / 0.73 / +12.2%
tpcds_q65/duckdb:parquet 14584038 / 14252537 / +2.3% 23820782 / 21806975 / +9.2% 0.61 / 0.65 / -6.3%
tpcds_q66/duckdb:parquet 24601636 / 24549560 / +0.2% 32182768 / 31472761 / +2.3% 0.76 / 0.78 / -2.0%
tpcds_q67/duckdb:parquet 78169212 / 81985976 / -4.7% 87614993 / 84036055 / +4.3% 0.89 / 0.98 / -8.6%
tpcds_q68/duckdb:parquet 29407454 / 29028334 / +1.3% 40042459 / 42115744 / -4.9% 0.73 / 0.69 / +6.6%
tpcds_q69/duckdb:parquet 29071526 / 28637920 / +1.5% 39627447 / 38074046 / +4.1% 0.73 / 0.75 / -2.5%
tpcds_q70/duckdb:parquet 17412344 / 15999158 / +8.8% 25849494 / 23518758 / +9.9% 0.67 / 0.68 / -1.0%
tpcds_q71/duckdb:parquet 14786680 / 15011126 / -1.5% 24716629 / 20694448 / +19.4% 🔴 0.60 / 0.73 / -17.5%
tpcds_q72/duckdb:parquet 82083974 / 81772800 / +0.4% 86572066 / 90003592 / -3.8% 0.95 / 0.91 / +4.4%
tpcds_q73/duckdb:parquet 13444506 / 13411628 / +0.2% 19854631 / 19294509 / +2.9% 0.68 / 0.70 / -2.6%
tpcds_q74/duckdb:parquet 99918278 / 98464542 / +1.5% 106822973 / 111174378 / -3.9% 0.94 / 0.89 / +5.6%
tpcds_q75/duckdb:parquet 40533004 / 40121080 / +1.0% 50311948 / 54561803 / -7.8% 0.81 / 0.74 / +9.6%
tpcds_q76/duckdb:parquet 13765022 / 13568244 / +1.5% 20388563 / 21325393 / -4.4% 0.68 / 0.64 / +6.1%
tpcds_q77/duckdb:parquet 17595502 / 16915637 / +4.0% 24520018 / 24954652 / -1.7% 0.72 / 0.68 / +5.9%
tpcds_q78/duckdb:parquet 47965613 / 48134946 / -0.4% 57707702 / 54136634 / +6.6% 0.83 / 0.89 / -6.5%
tpcds_q79/duckdb:parquet 20576696 / 20457076 / +0.6% 32028705 / 29304803 / +9.3% 0.64 / 0.70 / -8.0%
tpcds_q80/duckdb:parquet 31553948 / 31106513 / +1.4% 42288447 / 40625963 / +4.1% 0.75 / 0.77 / -2.5%
tpcds_q81/duckdb:parquet 29899956 / 32653038 / -8.4% 39922334 / 41995641 / -4.9% 0.75 / 0.78 / -3.7%
tpcds_q82/duckdb:parquet 14263424 / 12931571 / +10.3% 🔴 18728353 / 19820011 / -5.5% 0.76 / 0.65 / +16.7%
tpcds_q83/duckdb:parquet 15912693 / 15584402 / +2.1% 21219791 / 21304723 / -0.4% 0.75 / 0.73 / +2.5%
tpcds_q84/duckdb:parquet 17472392 / 17415881 / +0.3% 23964175 / 23465634 / +2.1% 0.73 / 0.74 / -1.8%
tpcds_q85/duckdb:parquet 34957499 / 34957764 / -0.0% 45234477 / 48686243 / -7.1% 0.77 / 0.72 / +7.6%
tpcds_q86/duckdb:parquet 11065951 / 13216064 / -16.3% 🟢 15881893 / 17621046 / -9.9% 0.70 / 0.75 / -7.1%
tpcds_q87/duckdb:parquet 28541501 / 28253840 / +1.0% 33107868 / 32922947 / +0.6% 0.86 / 0.86 / +0.5%
tpcds_q88/duckdb:parquet 26946200 / 27039754 / -0.3% 31078734 / 35269222 / -11.9% 🟢 0.87 / 0.77 / +13.1%
tpcds_q89/duckdb:parquet 12767910 / 12610188 / +1.3% 18904801 / 19014771 / -0.6% 0.68 / 0.66 / +1.8%
tpcds_q90/duckdb:parquet 10012983 / 6937891 / +44.3% 🔴 12275411 / 10859996 / +13.0% 🔴 0.82 / 0.64 / +27.7%
tpcds_q91/duckdb:parquet 20869464 / 20764452 / +0.5% 30685618 / 28605194 / +7.3% 0.68 / 0.73 / -6.3%
tpcds_q92/duckdb:parquet 11576616 / 11355813 / +1.9% 18698774 / 18635965 / +0.3% 0.62 / 0.61 / +1.6%
tpcds_q93/duckdb:parquet 21172864 / 21193722 / -0.1% 29103446 / 28936012 / +0.6% 0.73 / 0.73 / -0.7%
tpcds_q94/duckdb:parquet 17333404 / 17395716 / -0.4% 28273437 / 25654333 / +10.2% 🔴 0.61 / 0.68 / -9.6%
tpcds_q95/duckdb:parquet 90527316 / 90581924 / -0.1% 97254127 / 101293413 / -4.0% 0.93 / 0.89 / +4.1%
tpcds_q96/duckdb:parquet 6942107 / 6824060 / +1.7% 10842111 / 10538266 / +2.9% 0.64 / 0.65 / -1.1%
tpcds_q97/duckdb:parquet 26106476 / 26023714 / +0.3% 35136811 / 32029452 / +9.7% 0.74 / 0.81 / -8.6%
tpcds_q98/duckdb:parquet 14947564 / 14889074 / +0.4% 21763073 / 21500357 / +1.2% 0.69 / 0.69 / -0.8%
tpcds_q99/duckdb:parquet 17453850 / 20577322 / -15.2% 🟢 21884953 / 20899099 / +4.7% 0.80 / 0.98 / -19.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 0.979x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93142451 / 99038694 / -6.0% 161385189 / 167551273 / -3.7% 0.58 / 0.59 / -2.4%
tpch_q02/datafusion:vortex-file-compressed 65222987 / 65403281 / -0.3% 89490956 / 95953929 / -6.7% 0.73 / 0.68 / +6.9%
tpch_q03/datafusion:vortex-file-compressed 64527819 / 64452070 / +0.1% 117038823 / 116746786 / +0.3% 0.55 / 0.55 / -0.1%
tpch_q04/datafusion:vortex-file-compressed 35536650 / 35551841 / -0.0% 76960673 / 81707054 / -5.8% 0.46 / 0.44 / +6.1%
tpch_q05/datafusion:vortex-file-compressed 118133211 / 118781117 / -0.5% 175950515 / 174454146 / +0.9% 0.67 / 0.68 / -1.4%
tpch_q06/datafusion:vortex-file-compressed 14740605 / 14932645 / -1.3% 70874202 / 69244945 / +2.4% 0.21 / 0.22 / -3.6%
tpch_q07/datafusion:vortex-file-compressed 137707513 / 142154188 / -3.1% 192027360 / 202283834 / -5.1% 0.72 / 0.70 / +2.0%
tpch_q08/datafusion:vortex-file-compressed 143088031 / 144448170 / -0.9% 239616412 / 208070715 / +15.2% 🔴 0.60 / 0.69 / -14.0%
tpch_q09/datafusion:vortex-file-compressed 184811904 / 186663280 / -1.0% 258562184 / 266941929 / -3.1% 0.71 / 0.70 / +2.2%
tpch_q10/datafusion:vortex-file-compressed 73038028 / 73815749 / -1.1% 135563392 / 142464754 / -4.8% 0.54 / 0.52 / +4.0%
tpch_q11/datafusion:vortex-file-compressed 42718964 / 43030659 / -0.7% 61765304 / 67478196 / -8.5% 0.69 / 0.64 / +8.5%
tpch_q12/datafusion:vortex-file-compressed 45831875 / 44896449 / +2.1% 91148931 / 91809344 / -0.7% 0.50 / 0.49 / +2.8%
tpch_q13/datafusion:vortex-file-compressed 46756531 / 46133686 / +1.4% 74352101 / 85364954 / -12.9% 🟢 0.63 / 0.54 / +16.4%
tpch_q14/datafusion:vortex-file-compressed 25201520 / 25340125 / -0.5% 98856565 / 102509142 / -3.6% 0.25 / 0.25 / +3.1%
tpch_q15/datafusion:vortex-file-compressed 36933767 / 37407464 / -1.3% 95549284 / 99834677 / -4.3% 0.39 / 0.37 / +3.2%
tpch_q16/datafusion:vortex-file-compressed 38054076 / 37318769 / +2.0% 62944642 / 70371246 / -10.6% 🟢 0.60 / 0.53 / +14.0%
tpch_q17/datafusion:vortex-file-compressed 175166531 / 177289906 / -1.2% 221540301 / 231306834 / -4.2% 0.79 / 0.77 / +3.2%
tpch_q18/datafusion:vortex-file-compressed 201265083 / 200148438 / +0.6% 262381617 / 275507814 / -4.8% 0.77 / 0.73 / +5.6%
tpch_q19/datafusion:vortex-file-compressed 35307764 / 34704850 / +1.7% 91755935 / 95545245 / -4.0% 0.38 / 0.36 / +5.9%
tpch_q20/datafusion:vortex-file-compressed 62670388 / 63828297 / -1.8% 120117127 / 127998180 / -6.2% 0.52 / 0.50 / +4.6%
tpch_q21/datafusion:vortex-file-compressed 183396212 / 182852689 / +0.3% 241636236 / 250522844 / -3.5% 0.76 / 0.73 / +4.0%
tpch_q22/datafusion:vortex-file-compressed 25553320 / 26003233 / -1.7% 50747662 / 54375560 / -6.7% 0.50 / 0.48 / +5.3%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83380310 / 83086443 / +0.4% 130768826 / 132057999 / -1.0% 0.64 / 0.63 / +1.3%
tpch_q02/datafusion:parquet 134639108 / 135512781 / -0.6% 161842358 / 168391291 / -3.9% 0.83 / 0.80 / +3.4%
tpch_q03/datafusion:parquet 126112748 / 124822240 / +1.0% 185047242 / 189735913 / -2.5% 0.68 / 0.66 / +3.6%
tpch_q04/datafusion:parquet 53763780 / 54283230 / -1.0% 91094800 / 102877787 / -11.5% 🟢 0.59 / 0.53 / +11.9%
tpch_q05/datafusion:parquet 164281980 / 165885842 / -1.0% 225429164 / 256341345 / -12.1% 🟢 0.73 / 0.65 / +12.6%
tpch_q06/datafusion:parquet 32542226 / 32628925 / -0.3% 75227837 / 85900145 / -12.4% 🟢 0.43 / 0.38 / +13.9%
tpch_q07/datafusion:parquet 217427848 / 218511574 / -0.5% 286169794 / 301067605 / -4.9% 0.76 / 0.73 / +4.7%
tpch_q08/datafusion:parquet 210790356 / 212651525 / -0.9% 286625449 / 289042285 / -0.8% 0.74 / 0.74 / -0.0%
tpch_q09/datafusion:parquet 283235211 / 285322982 / -0.7% 366382940 / 365850038 / +0.1% 0.77 / 0.78 / -0.9%
tpch_q10/datafusion:parquet 310376548 / 310775011 / -0.1% 369664424 / 372094046 / -0.7% 0.84 / 0.84 / +0.5%
tpch_q11/datafusion:parquet 96027013 / 96943572 / -0.9% 117113267 / 122050180 / -4.0% 0.82 / 0.79 / +3.2%
tpch_q12/datafusion:parquet 79406305 / 79497758 / -0.1% 124498355 / 131587467 / -5.4% 0.64 / 0.60 / +5.6%
tpch_q13/datafusion:parquet 195639731 / 195266197 / +0.2% 224106688 / 233515311 / -4.0% 0.87 / 0.84 / +4.4%
tpch_q14/datafusion:parquet 75658134 / 76816334 / -1.5% 194829489 / 186956092 / +4.2% 0.39 / 0.41 / -5.5%
tpch_q15/datafusion:parquet 79189732 / 78758044 / +0.5% 133953274 / 138865000 / -3.5% 0.59 / 0.57 / +4.2%
tpch_q16/datafusion:parquet 84973852 / 84217206 / +0.9% 109041451 / 109101672 / -0.1% 0.78 / 0.77 / +1.0%
tpch_q17/datafusion:parquet 206914685 / 208518971 / -0.8% 260144823 / 262403325 / -0.9% 0.80 / 0.79 / +0.1%
tpch_q18/datafusion:parquet 266721257 / 270313973 / -1.3% 312751904 / 321684783 / -2.8% 0.85 / 0.84 / +1.5%
tpch_q19/datafusion:parquet 97814559 / 98562903 / -0.8% 167678119 / 173991866 / -3.6% 0.58 / 0.57 / +3.0%
tpch_q20/datafusion:parquet 154856657 / 153343032 / +1.0% 215924961 / 216257367 / -0.2% 0.72 / 0.71 / +1.1%
tpch_q21/datafusion:parquet 231733706 / 236408358 / -2.0% 319754729 / 316964718 / +0.9% 0.72 / 0.75 / -2.8%
tpch_q22/datafusion:parquet 161973621 / 162238507 / -0.2% 179338261 / 183790930 / -2.4% 0.90 / 0.88 / +2.3%
duckdb / vortex-file-compressed / ns (0.983x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 53927638 / 56156782 / -4.0% 95219634 / 94381832 / +0.9% 0.57 / 0.59 / -4.8%
tpch_q02/duckdb:vortex-file-compressed 32449816 / 32878751 / -1.3% 47514547 / 49018305 / -3.1% 0.68 / 0.67 / +1.8%
tpch_q03/duckdb:vortex-file-compressed 56615650 / 58136466 / -2.6% 110001849 / 109363524 / +0.6% 0.51 / 0.53 / -3.2%
tpch_q04/duckdb:vortex-file-compressed 80488237 / 80459370 / +0.0% 115721393 / 117076443 / -1.2% 0.70 / 0.69 / +1.2%
tpch_q05/duckdb:vortex-file-compressed 65105513 / 64068078 / +1.6% 115118605 / 115982703 / -0.7% 0.57 / 0.55 / +2.4%
tpch_q06/duckdb:vortex-file-compressed 21165020 / 22131798 / -4.4% 58580270 / 57185613 / +2.4% 0.36 / 0.39 / -6.6%
tpch_q07/duckdb:vortex-file-compressed 59588806 / 60929493 / -2.2% 119283901 / 129040642 / -7.6% 0.50 / 0.47 / +5.8%
tpch_q08/duckdb:vortex-file-compressed 85838575 / 87345371 / -1.7% 142850245 / 147097424 / -2.9% 0.60 / 0.59 / +1.2%
tpch_q09/duckdb:vortex-file-compressed 165792781 / 172650402 / -4.0% 239547490 / 225035852 / +6.4% 0.69 / 0.77 / -9.8%
tpch_q10/duckdb:vortex-file-compressed 106939778 / 108575736 / -1.5% 166214678 / 164666000 / +0.9% 0.64 / 0.66 / -2.4%
tpch_q11/duckdb:vortex-file-compressed 17688849 / 17626243 / +0.4% 29562754 / 30234423 / -2.2% 0.60 / 0.58 / +2.6%
tpch_q12/duckdb:vortex-file-compressed 55456174 / 54627119 / +1.5% 109596920 / 101029514 / +8.5% 0.51 / 0.54 / -6.4%
tpch_q13/duckdb:vortex-file-compressed 91013919 / 90339153 / +0.7% 145422253 / 138826902 / +4.8% 0.63 / 0.65 / -3.8%
tpch_q14/duckdb:vortex-file-compressed 30833805 / 30532498 / +1.0% 71296211 / 72982573 / -2.3% 0.43 / 0.42 / +3.4%
tpch_q15/duckdb:vortex-file-compressed 37573167 / 39113323 / -3.9% 82422066 / 86601293 / -4.8% 0.46 / 0.45 / +0.9%
tpch_q16/duckdb:vortex-file-compressed 43070056 / 42528018 / +1.3% 55170940 / 54457063 / +1.3% 0.78 / 0.78 / -0.0%
tpch_q17/duckdb:vortex-file-compressed 54885374 / 58351482 / -5.9% 115936841 / 122054343 / -5.0% 0.47 / 0.48 / -1.0%
tpch_q18/duckdb:vortex-file-compressed 130699396 / 130715677 / -0.0% 157979158 / 150418863 / +5.0% 0.83 / 0.87 / -4.8%
tpch_q19/duckdb:vortex-file-compressed 41591278 / 42823613 / -2.9% 96651956 / 94391678 / +2.4% 0.43 / 0.45 / -5.1%
tpch_q20/duckdb:vortex-file-compressed 58617340 / 62604599 / -6.4% 112022934 / 127065722 / -11.8% 🟢 0.52 / 0.49 / +6.2%
tpch_q21/duckdb:vortex-file-compressed 240124413 / 239774048 / +0.1% 279291010 / 277558859 / +0.6% 0.86 / 0.86 / -0.5%
tpch_q22/duckdb:vortex-file-compressed 41254605 / 42026796 / -1.8% 62074640 / 61416063 / +1.1% 0.66 / 0.68 / -2.9%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70820498 / 70532511 / +0.4% 92342212 / 101405956 / -8.9% 0.77 / 0.70 / +10.3%
tpch_q02/duckdb:parquet 70833770 / 71537424 / -1.0% 81379872 / 82610537 / -1.5% 0.87 / 0.87 / +0.5%
tpch_q03/duckdb:parquet 113095766 / 116424354 / -2.9% 145079178 / 149243312 / -2.8% 0.78 / 0.78 / -0.1%
tpch_q04/duckdb:parquet 74878977 / 75121819 / -0.3% 95712439 / 98411448 / -2.7% 0.78 / 0.76 / +2.5%
tpch_q05/duckdb:parquet 125395843 / 126264186 / -0.7% 179800961 / 162509559 / +10.6% 🔴 0.70 / 0.78 / -10.2%
tpch_q06/duckdb:parquet 35017332 / 34914181 / +0.3% 49472243 / 49288542 / +0.4% 0.71 / 0.71 / -0.1%
tpch_q07/duckdb:parquet 90052183 / 90603845 / -0.6% 129524621 / 129030106 / +0.4% 0.70 / 0.70 / -1.0%
tpch_q08/duckdb:parquet 145079994 / 144653870 / +0.3% 187596515 / 187490629 / +0.1% 0.77 / 0.77 / +0.2%
tpch_q09/duckdb:parquet 222305453 / 225420135 / -1.4% 262664292 / 262492741 / +0.1% 0.85 / 0.86 / -1.4%
tpch_q10/duckdb:parquet 476353556 / 472770707 / +0.8% 508259112 / 520208123 / -2.3% 0.94 / 0.91 / +3.1%
tpch_q11/duckdb:parquet 30848227 / 30983737 / -0.4% 37703162 / 37450811 / +0.7% 0.82 / 0.83 / -1.1%
tpch_q12/duckdb:parquet 76161854 / 76108570 / +0.1% 92089023 / 93025437 / -1.0% 0.83 / 0.82 / +1.1%
tpch_q13/duckdb:parquet 317817759 / 317114505 / +0.2% 335038677 / 330570069 / +1.4% 0.95 / 0.96 / -1.1%
tpch_q14/duckdb:parquet 103192213 / 104700327 / -1.4% 135192588 / 134854764 / +0.3% 0.76 / 0.78 / -1.7%
tpch_q15/duckdb:parquet 43889166 / 44253836 / -0.8% 66366337 / 68209031 / -2.7% 0.66 / 0.65 / +1.9%
tpch_q16/duckdb:parquet 115144649 / 115498136 / -0.3% 125113117 / 126015441 / -0.7% 0.92 / 0.92 / +0.4%
tpch_q17/duckdb:parquet 75277745 / 73756974 / +2.1% 106730343 / 103821688 / +2.8% 0.71 / 0.71 / -0.7%
tpch_q18/duckdb:parquet 203617223 / 195916301 / +3.9% 187319368 / 166748350 / +12.3% 🔴 1.09 / 1.17 / -7.5%
tpch_q19/duckdb:parquet 167038603 / 165732117 / +0.8% 196655857 / 208697981 / -5.8% 0.85 / 0.79 / +7.0%
tpch_q20/duckdb:parquet 128164558 / 128529086 / -0.3% 161446462 / 163988231 / -1.5% 0.79 / 0.78 / +1.3%
tpch_q21/duckdb:parquet 274555509 / 270715768 / +1.4% 307721835 / 286958810 / +7.2% 0.89 / 0.94 / -5.4%
tpch_q22/duckdb:parquet 260208904 / 261614285 / -0.5% 281406887 / 272371011 / +3.3% 0.92 / 0.96 / -3.7%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.050x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9012620 / 9018583 / -0.1% 9514513 / 9422742 / +1.0% 0.95 / 0.96 / -1.0%
statpopgen_q01/duckdb:vortex-file-compressed 10304394 / 10329171 / -0.2% 15343376 / 13905716 / +10.3% 🔴 0.67 / 0.74 / -9.6%
statpopgen_q02/duckdb:vortex-file-compressed 306760222 / 303253890 / +1.2% 361557641 / 339408552 / +6.5% 0.85 / 0.89 / -5.0%
statpopgen_q03/duckdb:vortex-file-compressed 813973038 / 816429243 / -0.3% 819972469 / 823535505 / -0.4% 0.99 / 0.99 / +0.1%
statpopgen_q04/duckdb:vortex-file-compressed 817199955 / 810569455 / +0.8% 832179001 / 820612217 / +1.4% 0.98 / 0.99 / -0.6%
statpopgen_q05/duckdb:vortex-file-compressed 319605279 / 318526152 / +0.3% 359668179 / 343442509 / +4.7% 0.89 / 0.93 / -4.2%
statpopgen_q06/duckdb:vortex-file-compressed 1152898012 / 1138749405 / +1.2% 1166431746 / 1156235542 / +0.9% 0.99 / 0.98 / +0.4%
statpopgen_q07/duckdb:vortex-file-compressed 112983550 / 112582175 / +0.4% 169141723 / 126678019 / +33.5% 🔴 0.67 / 0.89 / -24.8%
statpopgen_q08/duckdb:vortex-file-compressed 124368531 / 124873302 / -0.4% 143182381 / 146307786 / -2.1% 0.87 / 0.85 / +1.8%
statpopgen_q09/duckdb:vortex-file-compressed 620620620 / 621883400 / -0.2% 638933528 / 619151785 / +3.2% 0.97 / 1.00 / -3.3%
statpopgen_q10/duckdb:vortex-file-compressed 1927636283 / 1921336038 / +0.3% 1895215167 / 1899284217 / -0.2% 1.02 / 1.01 / +0.5%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245481474 / 247898620 / -1.0% 247563655 / 247119458 / +0.2% 0.99 / 1.00 / -1.2%
statpopgen_q01/duckdb:parquet 303907750 / 305834637 / -0.6% 306539415 / 307167639 / -0.2% 0.99 / 1.00 / -0.4%
statpopgen_q02/duckdb:parquet 546331980 / 570936044 / -4.3% 563730895 / 582756934 / -3.3% 0.97 / 0.98 / -1.1%
statpopgen_q03/duckdb:parquet 855086443 / 889706651 / -3.9% 839962574 / 873723765 / -3.9% 1.02 / 1.02 / -0.0%
statpopgen_q04/duckdb:parquet 869481690 / 869546081 / -0.0% 876412339 / 867695923 / +1.0% 0.99 / 1.00 / -1.0%
statpopgen_q05/duckdb:parquet 572125330 / 595539376 / -3.9% 582099844 / 604546426 / -3.7% 0.98 / 0.99 / -0.2%
statpopgen_q06/duckdb:parquet 720729350 / 735269436 / -2.0% 728253534 / 757991668 / -3.9% 0.99 / 0.97 / +2.0%
statpopgen_q07/duckdb:parquet 614997768 / 608435664 / +1.1% 700301520 / 691456529 / +1.3% 0.88 / 0.88 / -0.2%
statpopgen_q08/duckdb:parquet 619914354 / 623744138 / -0.6% 719947389 / 676708823 / +6.4% 0.86 / 0.92 / -6.6%
statpopgen_q09/duckdb:parquet 803895914 / 790907808 / +1.6% 823646298 / 801798710 / +2.7% 0.98 / 0.99 / -1.1%
statpopgen_q10/duckdb:parquet 1537458404 / 1459571962 / +5.3% 1303005477 / 1262134553 / +3.2% 1.18 / 1.16 / +2.0%

No file size changes detected.

@github-actions

github-actions Bot commented Sep 7, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR c31dafbf vs base 138c2802
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -11.7%
Engines: DataFusion No clear signal (-18.9%, environment too noisy confidence) · DuckDB No clear signal (-4.0%, environment too noisy confidence)
Vortex (geomean): hot 0.822x ➖ · cold 0.809x ➖
Parquet (geomean): hot 0.931x ➖ · cold 0.892x ➖
Shifts: Parquet (control) -6.9% · Median polish -8.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.762x ➖, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 215610479 / 215262561 / +0.2% 691352299 / 842071057 / -17.9% 0.31 / 0.26 / +22.0%
tpch_q02/datafusion:vortex-file-compressed 304430491 / 294067939 / +3.5% 596645681 / 674431721 / -11.5% 0.51 / 0.44 / +17.0%
tpch_q03/datafusion:vortex-file-compressed 388021422 / 620274389 / -37.4% 🟢 950061502 / 1148644427 / -17.3% 0.41 / 0.54 / -24.4%
tpch_q04/datafusion:vortex-file-compressed 181772072 / 215905648 / -15.8% 392573229 / 504221192 / -22.1% 0.46 / 0.43 / +8.1%
tpch_q05/datafusion:vortex-file-compressed 376732573 / 565702715 / -33.4% 🟢 693516730 / 947974775 / -26.8% 0.54 / 0.60 / -9.0%
tpch_q06/datafusion:vortex-file-compressed 255416203 / 263073804 / -2.9% 387801006 / 384759388 / +0.8% 0.66 / 0.68 / -3.7%
tpch_q07/datafusion:vortex-file-compressed 317020926 / 768011467 / -58.7% 🟢 525017091 / 711618603 / -26.2% 0.60 / 1.08 / -44.1%
tpch_q08/datafusion:vortex-file-compressed 430585821 / 750299931 / -42.6% 🟢 557415858 / 765000920 / -27.1% 0.77 / 0.98 / -21.2%
tpch_q09/datafusion:vortex-file-compressed 438263640 / 349880448 / +25.3% 434829223 / 662642591 / -34.4% 🟢 1.01 / 0.53 / +90.9%
tpch_q10/datafusion:vortex-file-compressed 350312614 / 541380314 / -35.3% 🟢 521942482 / 1115395585 / -53.2% 🟢 0.67 / 0.49 / +38.3%
tpch_q11/datafusion:vortex-file-compressed 279264737 / 290422888 / -3.8% 414475546 / 506593798 / -18.2% 0.67 / 0.57 / +17.5%
tpch_q12/datafusion:vortex-file-compressed 297938386 / 527343952 / -43.5% 🟢 441990142 / 702063169 / -37.0% 🟢 0.67 / 0.75 / -10.3%
tpch_q13/datafusion:vortex-file-compressed 136917636 / 231647877 / -40.9% 🟢 337770609 / 537052826 / -37.1% 🟢 0.41 / 0.43 / -6.0%
tpch_q14/datafusion:vortex-file-compressed 183711428 / 196632546 / -6.6% 304772121 / 321527719 / -5.2% 0.60 / 0.61 / -1.4%
tpch_q15/datafusion:vortex-file-compressed 293759944 / 329891066 / -11.0% 654642698 / 507217157 / +29.1% 0.45 / 0.65 / -31.0%
tpch_q16/datafusion:vortex-file-compressed 160328119 / 176410769 / -9.1% 309108800 / 522839290 / -40.9% 🟢 0.52 / 0.34 / +53.7%
tpch_q17/datafusion:vortex-file-compressed 284295215 / 332236421 / -14.4% 450709354 / 491828913 / -8.4% 0.63 / 0.68 / -6.6%
tpch_q18/datafusion:vortex-file-compressed 267289157 / 403051984 / -33.7% 🟢 423433894 / 579588867 / -26.9% 0.63 / 0.70 / -9.2%
tpch_q19/datafusion:vortex-file-compressed 368324009 / 361266774 / +2.0% 440280745 / 486990011 / -9.6% 0.84 / 0.74 / +12.8%
tpch_q20/datafusion:vortex-file-compressed 257376222 / 286802353 / -10.3% 383441119 / 679971575 / -43.6% 🟢 0.67 / 0.42 / +59.1%
tpch_q21/datafusion:vortex-file-compressed 453469829 / 554955620 / -18.3% 717670546 / 815141263 / -12.0% 0.63 / 0.68 / -7.2%
tpch_q22/datafusion:vortex-file-compressed 162575401 / 444863492 / -63.5% 🟢 372068837 / 716246776 / -48.1% 🟢 0.44 / 0.62 / -29.6%
datafusion / parquet / ns (0.940x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 168071394 / 166760364 / +0.8% 499618687 / 435472899 / +14.7% 0.34 / 0.38 / -12.2%
tpch_q02/datafusion:parquet 295130213 / 309864880 / -4.8% 665418502 / 578871658 / +15.0% 0.44 / 0.54 / -17.1%
tpch_q03/datafusion:parquet 274164516 / 294565449 / -6.9% 689184463 / 1096557241 / -37.2% 🟢 0.40 / 0.27 / +48.1%
tpch_q04/datafusion:parquet 156723925 / 164925599 / -5.0% 351389585 / 397802236 / -11.7% 0.45 / 0.41 / +7.6%
tpch_q05/datafusion:parquet 360308755 / 356122267 / +1.2% 445191760 / 512016479 / -13.1% 0.81 / 0.70 / +16.4%
tpch_q06/datafusion:parquet 125540504 / 127438346 / -1.5% 215574230 / 231071840 / -6.7% 0.58 / 0.55 / +5.6%
tpch_q07/datafusion:parquet 380129068 / 373855113 / +1.7% 478496052 / 617911659 / -22.6% 0.79 / 0.61 / +31.3%
tpch_q08/datafusion:parquet 412133964 / 428062171 / -3.7% 554198662 / 654654088 / -15.3% 0.74 / 0.65 / +13.7%
tpch_q09/datafusion:parquet 433061714 / 438375357 / -1.2% 655134464 / 685826218 / -4.5% 0.66 / 0.64 / +3.4%
tpch_q10/datafusion:parquet 366296043 / 374896403 / -2.3% 515710227 / 495738482 / +4.0% 0.71 / 0.76 / -6.1%
tpch_q11/datafusion:parquet 273997935 / 260611054 / +5.1% 464800827 / 435010707 / +6.8% 0.59 / 0.60 / -1.6%
tpch_q12/datafusion:parquet 196356298 / 210636310 / -6.8% 404088389 / 568171300 / -28.9% 0.49 / 0.37 / +31.1%
tpch_q13/datafusion:parquet 399647191 / 424026143 / -5.7% 599755204 / 705201401 / -15.0% 0.67 / 0.60 / +10.8%
tpch_q14/datafusion:parquet 155000638 / 156997340 / -1.3% 261392504 / 295424298 / -11.5% 0.59 / 0.53 / +11.6%
tpch_q15/datafusion:parquet 255934780 / 289885279 / -11.7% 424772476 / 416864217 / +1.9% 0.60 / 0.70 / -13.4%
tpch_q16/datafusion:parquet 113889887 / 114077498 / -0.2% 244346778 / 264919086 / -7.8% 0.47 / 0.43 / +8.2%
tpch_q17/datafusion:parquet 301652786 / 304822938 / -1.0% 411806161 / 417531623 / -1.4% 0.73 / 0.73 / +0.3%
tpch_q18/datafusion:parquet 412523284 / 418955774 / -1.5% 502004274 / 579249834 / -13.3% 0.82 / 0.72 / +13.6%
tpch_q19/datafusion:parquet 161438897 / 175877125 / -8.2% 283462917 / 337313989 / -16.0% 0.57 / 0.52 / +9.2%
tpch_q20/datafusion:parquet 274793021 / 264101207 / +4.0% 454298760 / 437018750 / +4.0% 0.60 / 0.60 / +0.1%
tpch_q21/datafusion:parquet 310519771 / 589673128 / -47.3% 🟢 409482480 / 599930685 / -31.7% 🟢 0.76 / 0.98 / -22.8%
tpch_q22/datafusion:parquet 172276313 / 211802155 / -18.7% 347381668 / 335486198 / +3.5% 0.50 / 0.63 / -21.4%
duckdb / vortex-file-compressed / ns (0.886x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 191670962 / 196697497 / -2.6% 255672700 / 402491443 / -36.5% 🟢 0.75 / 0.49 / +53.4%
tpch_q02/duckdb:vortex-file-compressed 385515320 / 379554002 / +1.6% 401316473 / 365563023 / +9.8% 0.96 / 1.04 / -7.5%
tpch_q03/duckdb:vortex-file-compressed 413963135 / 551115785 / -24.9% 440739712 / 704114877 / -37.4% 🟢 0.94 / 0.78 / +20.0%
tpch_q04/duckdb:vortex-file-compressed 222955142 / 328854279 / -32.2% 🟢 285762100 / 327374541 / -12.7% 0.78 / 1.00 / -22.3%
tpch_q05/duckdb:vortex-file-compressed 405955827 / 547864516 / -25.9% 476814449 / 546949881 / -12.8% 0.85 / 1.00 / -15.0%
tpch_q06/duckdb:vortex-file-compressed 282816569 / 266008457 / +6.3% 340228510 / 347370595 / -2.1% 0.83 / 0.77 / +8.6%
tpch_q07/duckdb:vortex-file-compressed 430575200 / 554765142 / -22.4% 500857588 / 564582924 / -11.3% 0.86 / 0.98 / -12.5%
tpch_q08/duckdb:vortex-file-compressed 584152011 / 680679400 / -14.2% 574067329 / 677495687 / -15.3% 1.02 / 1.00 / +1.3%
tpch_q09/duckdb:vortex-file-compressed 429471656 / 453929449 / -5.4% 438071007 / 434807147 / +0.8% 0.98 / 1.04 / -6.1%
tpch_q10/duckdb:vortex-file-compressed 433515951 / 503455577 / -13.9% 459639597 / 588713711 / -21.9% 0.94 / 0.86 / +10.3%
tpch_q11/duckdb:vortex-file-compressed 188737256 / 185019508 / +2.0% 197527765 / 211570858 / -6.6% 0.96 / 0.87 / +9.3%
tpch_q12/duckdb:vortex-file-compressed 385637267 / 465735683 / -17.2% 427637245 / 542161611 / -21.1% 0.90 / 0.86 / +5.0%
tpch_q13/duckdb:vortex-file-compressed 364471203 / 461141785 / -21.0% 346893757 / 460833728 / -24.7% 1.05 / 1.00 / +5.0%
tpch_q14/duckdb:vortex-file-compressed 236552082 / 229422446 / +3.1% 276743885 / 328998005 / -15.9% 0.85 / 0.70 / +22.6%
tpch_q15/duckdb:vortex-file-compressed 156133449 / 149410129 / +4.5% 191753268 / 219042387 / -12.5% 0.81 / 0.68 / +19.4%
tpch_q16/duckdb:vortex-file-compressed 186321219 / 170420663 / +9.3% 217179088 / 207171533 / +4.8% 0.86 / 0.82 / +4.3%
tpch_q17/duckdb:vortex-file-compressed 402448089 / 500631309 / -19.6% 619653221 / 507113445 / +22.2% 0.65 / 0.99 / -34.2%
tpch_q18/duckdb:vortex-file-compressed 311312903 / 364936180 / -14.7% 370313605 / 384569045 / -3.7% 0.84 / 0.95 / -11.4%
tpch_q19/duckdb:vortex-file-compressed 312638837 / 333053764 / -6.1% 357829529 / 420447948 / -14.9% 0.87 / 0.79 / +10.3%
tpch_q20/duckdb:vortex-file-compressed 342118470 / 385920415 / -11.3% 375766087 / 458079149 / -18.0% 0.91 / 0.84 / +8.1%
tpch_q21/duckdb:vortex-file-compressed 514483690 / 579872065 / -11.3% 542632275 / 645932212 / -16.0% 0.95 / 0.90 / +5.6%
tpch_q22/duckdb:vortex-file-compressed 169195872 / 207894535 / -18.6% 190593409 / 249521247 / -23.6% 0.89 / 0.83 / +6.5%
duckdb / parquet / ns (0.923x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 275660924 / 287741210 / -4.2% 280645306 / 334928562 / -16.2% 0.98 / 0.86 / +14.3%
tpch_q02/duckdb:parquet 663385373 / 673331075 / -1.5% 627803449 / 751041262 / -16.4% 1.06 / 0.90 / +17.9%
tpch_q03/duckdb:parquet 696702673 / 816382625 / -14.7% 852195593 / 1072955791 / -20.6% 0.82 / 0.76 / +7.4%
tpch_q04/duckdb:parquet 426400010 / 466206522 / -8.5% 444309867 / 547710831 / -18.9% 0.96 / 0.85 / +12.7%
tpch_q05/duckdb:parquet 873712439 / 1029152715 / -15.1% 877091487 / 980409242 / -10.5% 1.00 / 1.05 / -5.1%
tpch_q06/duckdb:parquet 262913443 / 321995709 / -18.3% 295718564 / 388387424 / -23.9% 0.89 / 0.83 / +7.2%
tpch_q07/duckdb:parquet 800276610 / 843062972 / -5.1% 733905224 / 878806702 / -16.5% 1.09 / 0.96 / +13.7%
tpch_q08/duckdb:parquet 984035723 / 1056458951 / -6.9% 902803258 / 1076301957 / -16.1% 1.09 / 0.98 / +11.0%
tpch_q09/duckdb:parquet 1020708798 / 966521240 / +5.6% 903563270 / 999074135 / -9.6% 1.13 / 0.97 / +16.8%
tpch_q10/duckdb:parquet 904827391 / 1023682510 / -11.6% 897233061 / 985418128 / -8.9% 1.01 / 1.04 / -2.9%
tpch_q11/duckdb:parquet 421241763 / 462268361 / -8.9% 420724220 / 463902519 / -9.3% 1.00 / 1.00 / +0.5%
tpch_q12/duckdb:parquet 530759478 / 544973033 / -2.6% 556353721 / 607665604 / -8.4% 0.95 / 0.90 / +6.4%
tpch_q13/duckdb:parquet 755788427 / 782131628 / -3.4% 862053680 / 922418914 / -6.5% 0.88 / 0.85 / +3.4%
tpch_q14/duckdb:parquet 483740056 / 484081724 / -0.1% 466898920 / 464633355 / +0.5% 1.04 / 1.04 / -0.6%
tpch_q15/duckdb:parquet 344698124 / 381365246 / -9.6% 363661943 / 413441443 / -12.0% 0.95 / 0.92 / +2.8%
tpch_q16/duckdb:parquet 472640031 / 494605829 / -4.4% 463591495 / 516540343 / -10.3% 1.02 / 0.96 / +6.5%
tpch_q17/duckdb:parquet 445084235 / 467947668 / -4.9% 441465608 / 437922926 / +0.8% 1.01 / 1.07 / -5.6%
tpch_q18/duckdb:parquet 558717735 / 628937530 / -11.2% 627443217 / 626676674 / +0.1% 0.89 / 1.00 / -11.3%
tpch_q19/duckdb:parquet 519875429 / 609382009 / -14.7% 545778200 / 768079185 / -28.9% 0.95 / 0.79 / +20.1%
tpch_q20/duckdb:parquet 770140676 / 828666762 / -7.1% 724437659 / 896236125 / -19.2% 1.06 / 0.92 / +15.0%
tpch_q21/duckdb:parquet 626056352 / 668321680 / -6.3% 594179344 / 633593504 / -6.2% 1.05 / 1.05 / -0.1%
tpch_q22/duckdb:parquet 390707559 / 451117797 / -13.4% 439002547 / 426820079 / +2.9% 0.89 / 1.06 / -15.8%

@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch 4 times, most recently from 5a76dc2 to 2dd2e1a Compare September 8, 2026 15:52
Comment thread vortex-arrow/src/dtype.rs Resolved
@AdamGS AdamGS added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@AdamGS
AdamGS force-pushed the adamg/df-fix-bugs-conversion branch from 55e1679 to d37c4e1 Compare September 9, 2026 12:16
@AdamGS AdamGS added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@AdamGS AdamGS added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026
@github-actions
github-actions Bot temporarily deployed to docs-preview/pr-9785 September 27, 2026 05:42 Inactive
@github-actions
github-actions Bot temporarily deployed to docs-preview/pr-9785 September 27, 2026 06:19 Inactive
@robert3005
robert3005 marked this pull request as ready for review September 28, 2026 01:12
@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 28, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 28, 2026
@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 28, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 28, 2026
robert3005 pushed a commit that referenced this pull request Sep 29, 2026
## Problem

`can_scalar_fn_be_pushed_down` accepts every `GetFieldFunc` without
checking its source. `get_field(named_struct(...), 'value')` is valid in
DataFusion, but `named_struct` has no Vortex expression conversion.
Marking the whole expression pushable lets planning proceed into a
conversion error instead of leaving it above the scan.

## Change

Only mark `GetFieldFunc` pushable when its complete expression converts.
The regression builds the actual DataFusion `named_struct` and
`get_field` physical expressions and checks the pushdown decision. It
fails on current `develop` and passes with this change.

## Verification

- `cargo test -p vortex-datafusion
test_get_field_of_unsupported_struct_function_stays_in_datafusion --lib`
(with the repository-pinned `flatc` 25.12.19)
- `cargo +nightly fmt --package vortex-datafusion -- --check`

#9785 has a broader schema-aware expression-conversion redesign that
also addresses this class of error. This PR offers a focused fix and
regression for current `develop`; it can be superseded if #9785 lands
first.

Signed-off-by: Ivan Bobchenkov <me@bobchenkov.ru>
AdamGS and others added 4 commits October 12, 2026 00:57
Replace separate eligibility and conversion checks with a schema-aware
`try_convert`, preserve SQL null semantics for IN/NOT IN, and reject
pushdown where casts, short-circuit evaluation, or nullable struct access
could differ. Re-split filters after per-file schema adaptation so
unsupported conjuncts run as DataFusion residual filters before projection
and limit. Fix v2 filter pushdown after projection swapping, and rename
`ExpressionConvertor` to `ExpressionConverter`.

Squashed onto develop, porting the bind-before-optimize change from #10002.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: "Claude" <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013wUbDvL9BL68K3YceQiuZw
Signed-off-by: Robert Kruszewski <github@robertk.io>
Build the v2 `DefaultExpressionConverter` from the data source's session so
registered Arrow extension types resolve the same way as in the file source,
and fold the pushed filters into the existing filter with `and_collect`.

Signed-off-by: "Claude" <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013wUbDvL9BL68K3YceQiuZw
Signed-off-by: Robert Kruszewski <github@robertk.io>
The `CASE WHEN hd_vehicle_count > 0 THEN hd_dep_count / hd_vehicle_count END`
conjunct is no longer pushed into the Vortex scan: its THEN branch can fail,
and Vortex may evaluate it on rows the WHEN condition excludes. DataFusion now
evaluates that conjunct in a FilterExec while the remaining conjuncts stay
pushed down.

Signed-off-by: Claude <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013wUbDvL9BL68K3YceQiuZw
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
robert3005 force-pushed the adamg/df-fix-bugs-conversion branch from c31dafb to 7162b8d Compare October 12, 2026 00:15
@github-actions
github-actions Bot temporarily deployed to docs-preview/pr-9785 October 12, 2026 00:26 Inactive
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
@github-actions
github-actions Bot temporarily deployed to docs-preview/pr-9785 October 12, 2026 12:59 Inactive
One .profraw file per nextest test process fills the coverage runner disk.
Use a pool of 8 merged files per binary.

Signed-off-by: Robert Kruszewski <robert@spiraldb.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions
github-actions Bot temporarily deployed to docs-preview/pr-9785 October 12, 2026 14:05 Inactive
@robert3005
robert3005 merged commit c752371 into develop Oct 12, 2026
88 of 89 checks passed
@robert3005
robert3005 deleted the adamg/df-fix-bugs-conversion branch October 12, 2026 14:16
robert3005 pushed a commit that referenced this pull request Oct 20, 2026
## Summary

- Tracking Issue: #10634

For `ree_dict = 'x'` on a `RunEndEncoded<_, Dictionary<_, Utf8>>`
column, DataFusion's comparison coercion produces `CAST(ree_dict AS
Dictionary(UInt32, Utf8)) = 'x'`. Since #9785 the converter rejects that
cast, so the filter runs in DataFusion instead of the scan. Results stay
correct, but pushdown is lost. Both Arrow types map to Vortex `Utf8`, so
Vortex has nothing to cast.

## Changes

`supported_cast` becomes `classify_cast`, which either drops a cast,
keeps it as a Vortex `cast`, or leaves it in DataFusion:

- **Drop** (the converted child is returned unchanged) when the Arrow
cast cannot fail and the Vortex dtype is unchanged:
  - identity casts;
  - `REE<Int16 | Int32, Dict<K, V>>` → `Dict<K, V>`.

Arrow expands runs with `take` on `Int32` indices, and `take` on a
dictionary only gathers keys. A dropped cast no longer blocks pushdown
under `AND`/`OR` or in `IN` lists.
- **Keep** numeric widening, as before.
- **Leave in DataFusion** everything else, including:
  - `Int64` run ends (Arrow's indices may wrap);
- `REE<_, V>` → `V` when expanding values can fail (for example,
`Utf8`/`Binary` offset overflow);
  - `Dict<K, V>` → `V` (out of scope; see below);
  - dictionary key changes;
  - `V` → `Dict<K, V>`;
  - `LargeUtf8` → `Utf8`.

Tests:

- The issue's repro (coerce, simplify, plan) for `=`, `OR` and `IN`,
asserting no `cast` node remains.
- Accepted and rejected casts.
- Vortex vs. DataFusion evaluation on an REE batch with nulls and
unreferenced dictionary values.
- A `.vortex` scan vs. `MemTable` test that also asserts the filter is
accepted by the scan when pushdown is enabled.

## Follow-up scope

`Dict<K, V>` → `V` is deliberately out of scope for this PR. Arrow
decodes a dictionary by gathering one value per key. For offset-based
values such as `Utf8` or `Binary`, the decoded output can exceed the
offset limit and the cast can fail. A follow-up can allow specific value
types only after checking that the Arrow cast cannot fail, preserves
values and nulls, and leaves the expected Vortex dtype. For now, all
dictionary-to-value casts stay in DataFusion.

---------

Signed-off-by: Yiquan Zhou <yiquan.zhou@dash0.com>
mhk197 added a commit that referenced this pull request Nov 3, 2026
…taFusion (#11161)

## Summary

The DataFusion converter now pushes down integer and boolean casts to
`Float64`, plus list casts whose element cast is supported. These were
left out of the cast allowlist from #9785, but Arrow and Vortex convert
them the same way. `array_sum` needs this: DataFusion always plans it as
`array_sum(CAST(xs AS List<Float64>))`.

## Changes

- `Boolean` and every integer type → `Float64`: both engines use `as
f64` (round to nearest, never fails; booleans become 1.0/0.0).
- Lossless unsigned → wider signed casts, such as `UInt32 → Int64`.
- `List`/`LargeList` casts are classified by their element cast.
`FixedSizeList → List` and narrowing element nullability stay in
DataFusion.

---------

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

This branch was previously deployed

1 inactive deployment
docs-preview/pr-9785 — 7bb0bd5c Deployed Oct 12, 2026 by github-actions[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix ext/datafusion Relates to the DataFusion integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants