Skip to content

fix: ignore zero-byte benchmark file identities - #9197

Merged
connortsui20 merged 1 commit into
developfrom
ct/benchmark-zero-byte-reporting
Aug 5, 2026
Merged

connortsui20 merged 1 commit into
developfrom
ct/benchmark-zero-byte-reporting

Conversation

@connortsui20

Copy link
Copy Markdown
Member

Fixes file-size reporting when either the baseline or HEAD records an empty file. The report previously dropped the zero-byte row and then treated its missing counterpart as 0 B, which could report a false deletion or a newly created file.

File identities with a zero-byte record on either side are now excluded from both sides before totals and missing-file comparisons. The regression test covers both asymmetric cases.

Checks: uv run --no-project --with orjson --with pandas pytest scripts/tests/test_benchmark_reporting.py and ruff check scripts/compare-benchmark-jsons.py scripts/tests/test_benchmark_reporting.py.

@codspeed

codspeed Bot commented Aug 5, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 18.02%

⚡ 1 improved benchmark
✅ 1829 untouched benchmarks
⏩ 43 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation fsl_large 253.2 µs 214.6 µs +18.02%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/benchmark-zero-byte-reporting (6380aa5) with develop (3d0c124)2

Open in CodSpeed

Footnotes

  1. 43 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. No successful run was found on develop (69661e0) during the generation of this report, so 3d0c124 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

@connortsui20
connortsui20 force-pushed the ct/benchmark-zero-byte-reporting branch from ec1a6d0 to 3020476 Compare August 5, 2026 14:57
@connortsui20
connortsui20 marked this pull request as ready for review August 5, 2026 15:07
Base automatically changed from ct/benchmark-labels to develop August 5, 2026 16:13
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
connortsui20 force-pushed the ct/benchmark-zero-byte-reporting branch from 3020476 to 6380aa5 Compare August 5, 2026 16:13
@connortsui20 connortsui20 added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Aug 5, 2026
@github-actions github-actions Bot removed action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Aug 5, 2026
@github-actions

github-actions Bot commented Aug 5, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6380aa5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 6380aa5 tpch-s3 1 Explore Profiling Data
🟢 Done 6380aa5 statpopgen 1 Explore Profiling Data
🟢 Done 6380aa5 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 6380aa5 fineweb 1 Explore Profiling Data
🟢 Done 6380aa5 tpch-s3-10 1 Explore Profiling Data
🟢 Done 6380aa5 fineweb-s3 1 Explore Profiling Data
🟢 Done 6380aa5 tpcds-nvme 1 Explore Profiling Data
🟢 Done 6380aa5 appian-nvme 1 Explore Profiling Data
🟢 Done 6380aa5 clickbench-nvme 1 Explore Profiling Data
🟢 Done 6380aa5 polarsignals 1 Explore Profiling Data
🟢 Done 6380aa5 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.007x ➖


datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 120087391 111015000 1.08
polarsignals_q01/datafusion:vortex-file-compressed 160573950 162529312 0.99
polarsignals_q02/datafusion:vortex-file-compressed 21400127 21277196 1.01
polarsignals_q03/datafusion:vortex-file-compressed 163952360 165832303 0.99
polarsignals_q04/datafusion:vortex-file-compressed 12233425 11810747 1.04
polarsignals_q05/datafusion:vortex-file-compressed 14528840 14566605 1.00
polarsignals_q06/datafusion:vortex-file-compressed 21499040 21594242 1.00
polarsignals_q07/datafusion:vortex-file-compressed 13029218 13105198 0.99
polarsignals_q08/datafusion:vortex-file-compressed 280759312 276895350 1.01
polarsignals_q09/datafusion:vortex-file-compressed 11008236 11349681 0.97

No file size changes detected.

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (+2.8%, environment too noisy confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 47325162 47341724 1.00
tpch_q02/datafusion:vortex-file-compressed 21352703 21512362 0.99
tpch_q03/datafusion:vortex-file-compressed 31150224 31097958 1.00
tpch_q04/datafusion:vortex-file-compressed 19589027 19311581 1.01
tpch_q05/datafusion:vortex-file-compressed 51273351 50801042 1.01
tpch_q06/datafusion:vortex-file-compressed 10688894 10407404 1.03
tpch_q07/datafusion:vortex-file-compressed 58066745 57627668 1.01
tpch_q08/datafusion:vortex-file-compressed 48698391 47400266 1.03
tpch_q09/datafusion:vortex-file-compressed 54689173 54120323 1.01
tpch_q10/datafusion:vortex-file-compressed 32667362 31963999 1.02
tpch_q11/datafusion:vortex-file-compressed 16522738 16663264 0.99
tpch_q12/datafusion:vortex-file-compressed 29388977 29352324 1.00
tpch_q13/datafusion:vortex-file-compressed 25374958 25342191 1.00
tpch_q14/datafusion:vortex-file-compressed 18012755 18044090 1.00
tpch_q15/datafusion:vortex-file-compressed 25786700 25748113 1.00
tpch_q16/datafusion:vortex-file-compressed 22117602 22076696 1.00
tpch_q17/datafusion:vortex-file-compressed 60886288 60932323 1.00
tpch_q18/datafusion:vortex-file-compressed 72040503 70700133 1.02
tpch_q19/datafusion:vortex-file-compressed 20953139 21857438 0.96
tpch_q20/datafusion:vortex-file-compressed 31466813 31605741 1.00
tpch_q21/datafusion:vortex-file-compressed 70339563 68447534 1.03
tpch_q22/datafusion:vortex-file-compressed 12371900 12422856 1.00
datafusion / parquet / ns (0.977x ➖, 4↑ 1↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 110664049 123971295 0.89
tpch_q02/datafusion:parquet 69168711 68768716 1.01
tpch_q03/datafusion:parquet 94704306 95335035 0.99
tpch_q04/datafusion:parquet 52599476 49406306 1.06
tpch_q05/datafusion:parquet 🚨 132490201 117102670 1.13
tpch_q06/datafusion:parquet 🚀 39804593 44543027 0.89
tpch_q07/datafusion:parquet 133028849 136863178 0.97
tpch_q08/datafusion:parquet 124253761 124879422 0.99
tpch_q09/datafusion:parquet 161639710 160005655 1.01
tpch_q10/datafusion:parquet 🚀 117933097 133472917 0.88
tpch_q11/datafusion:parquet 50827155 51962182 0.98
tpch_q12/datafusion:parquet 100850678 104268687 0.97
tpch_q13/datafusion:parquet 224018621 231043994 0.97
tpch_q14/datafusion:parquet 50868915 51138888 0.99
tpch_q15/datafusion:parquet 71400548 66873998 1.07
tpch_q16/datafusion:parquet 50542740 51134217 0.99
tpch_q17/datafusion:parquet 160475516 168850269 0.95
tpch_q18/datafusion:parquet 185588605 180645451 1.03
tpch_q19/datafusion:parquet 🚀 78772555 91906547 0.86
tpch_q20/datafusion:parquet 88267600 92404081 0.96
tpch_q21/datafusion:parquet 169971479 173028484 0.98
tpch_q22/datafusion:parquet 55462313 57426479 0.97
duckdb / vortex-file-compressed / ns (0.999x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 23346227 26851711 0.87
tpch_q02/duckdb:vortex-file-compressed 35933820 35900129 1.00
tpch_q03/duckdb:vortex-file-compressed 40380105 41641410 0.97
tpch_q04/duckdb:vortex-file-compressed 32542198 32432299 1.00
tpch_q05/duckdb:vortex-file-compressed 43802712 45639229 0.96
tpch_q06/duckdb:vortex-file-compressed 14291810 14186278 1.01
tpch_q07/duckdb:vortex-file-compressed 45704486 46523118 0.98
tpch_q08/duckdb:vortex-file-compressed 54829186 57624316 0.95
tpch_q09/duckdb:vortex-file-compressed 63898447 63596430 1.00
tpch_q10/duckdb:vortex-file-compressed 54238908 54208524 1.00
tpch_q11/duckdb:vortex-file-compressed 20436838 19676435 1.04
tpch_q12/duckdb:vortex-file-compressed 31731021 32377039 0.98
tpch_q13/duckdb:vortex-file-compressed 44942236 45848128 0.98
tpch_q14/duckdb:vortex-file-compressed 23773521 22567409 1.05
tpch_q15/duckdb:vortex-file-compressed 22060500 21701515 1.02
tpch_q16/duckdb:vortex-file-compressed 35234290 33203809 1.06
tpch_q17/duckdb:vortex-file-compressed 34672543 32426632 1.07
tpch_q18/duckdb:vortex-file-compressed 53135389 52950994 1.00
tpch_q19/duckdb:vortex-file-compressed 38335189 38300770 1.00
tpch_q20/duckdb:vortex-file-compressed 40753513 39412082 1.03
tpch_q21/duckdb:vortex-file-compressed 128200772 129348543 0.99
tpch_q22/duckdb:vortex-file-compressed 23346071 22904268 1.02
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81469838 81499090 1.00
tpch_q02/duckdb:parquet 46239929 46548603 0.99
tpch_q03/duckdb:parquet 80784168 80338936 1.01
tpch_q04/duckdb:parquet 58039190 57761932 1.00
tpch_q05/duckdb:parquet 78145841 78493467 1.00
tpch_q06/duckdb:parquet 24909896 24799133 1.00
tpch_q07/duckdb:parquet 79968790 82000896 0.98
tpch_q08/duckdb:parquet 97201041 96231242 1.01
tpch_q09/duckdb:parquet 147930813 148260267 1.00
tpch_q10/duckdb:parquet 141402954 142425492 0.99
tpch_q11/duckdb:parquet 25346735 25716521 0.99
tpch_q12/duckdb:parquet 53309111 53414283 1.00
tpch_q13/duckdb:parquet 286799613 290710682 0.99
tpch_q14/duckdb:parquet 55993583 56148721 1.00
tpch_q15/duckdb:parquet 30610211 30789512 0.99
tpch_q16/duckdb:parquet 66493211 66621803 1.00
tpch_q17/duckdb:parquet 57978341 57830134 1.00
tpch_q18/duckdb:parquet 127507059 128246878 0.99
tpch_q19/duckdb:parquet 77349520 77267442 1.00
tpch_q20/duckdb:parquet 77730645 76886488 1.01
tpch_q21/duckdb:parquet 188217471 186544174 1.01
tpch_q22/duckdb:parquet 63912764 64004759 1.00

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 0 B 126.00 MB -100.0%
nation.vortex 1.0 vortex-compact 8.01 KB 0 B 8.01 KB -100.0%
orders.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 6.06 KB 0 B 6.06 KB -100.0%
supplier.vortex 1.0 vortex-compact 496.68 KB 0 B 496.68 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.85 MB → 242.85 MB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (+0.6%, environment too noisy confidence) · DuckDB No clear signal (-2.0%, low confidence)
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 51908271 50778970 1.02
tpch_q02/datafusion:vortex-compact 24132683 24054519 1.00
tpch_q03/datafusion:vortex-compact 31867656 31922308 1.00
tpch_q04/datafusion:vortex-compact 22207464 21953077 1.01
tpch_q05/datafusion:vortex-compact 51700047 51599778 1.00
tpch_q06/datafusion:vortex-compact 12227485 12059032 1.01
tpch_q07/datafusion:vortex-compact 58942572 58253997 1.01
tpch_q08/datafusion:vortex-compact 50145434 50823182 0.99
tpch_q09/datafusion:vortex-compact 57426550 57055489 1.01
tpch_q10/datafusion:vortex-compact 35634474 36182763 0.98
tpch_q11/datafusion:vortex-compact 17302916 17424670 0.99
tpch_q12/datafusion:vortex-compact 32952360 33936581 0.97
tpch_q13/datafusion:vortex-compact 28585197 28515653 1.00
tpch_q14/datafusion:vortex-compact 19440361 19381961 1.00
tpch_q15/datafusion:vortex-compact 30448055 29631612 1.03
tpch_q16/datafusion:vortex-compact 25935002 25954532 1.00
tpch_q17/datafusion:vortex-compact 61863933 61903258 1.00
tpch_q18/datafusion:vortex-compact 72673420 72600839 1.00
tpch_q19/datafusion:vortex-compact 37612282 37211589 1.01
tpch_q20/datafusion:vortex-compact 34657521 33806253 1.03
tpch_q21/datafusion:vortex-compact 73810949 74091813 1.00
tpch_q22/datafusion:vortex-compact 13599696 13972887 0.97
datafusion / parquet / ns (0.996x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 119435534 123971295 0.96
tpch_q02/datafusion:parquet 70980943 68768716 1.03
tpch_q03/datafusion:parquet 104403978 95335035 1.10
tpch_q04/datafusion:parquet 52453174 49406306 1.06
tpch_q05/datafusion:parquet 🚨 129927396 117102670 1.11
tpch_q06/datafusion:parquet 44002559 44543027 0.99
tpch_q07/datafusion:parquet 124670805 136863178 0.91
tpch_q08/datafusion:parquet 126688812 124879422 1.01
tpch_q09/datafusion:parquet 157384989 160005655 0.98
tpch_q10/datafusion:parquet 124632054 133472917 0.93
tpch_q11/datafusion:parquet 51580732 51962182 0.99
tpch_q12/datafusion:parquet 101199748 104268687 0.97
tpch_q13/datafusion:parquet 226793200 231043994 0.98
tpch_q14/datafusion:parquet 51026077 51138888 1.00
tpch_q15/datafusion:parquet 70261095 66873998 1.05
tpch_q16/datafusion:parquet 51060618 51134217 1.00
tpch_q17/datafusion:parquet 154549671 168850269 0.92
tpch_q18/datafusion:parquet 183894963 180645451 1.02
tpch_q19/datafusion:parquet 87352099 91906547 0.95
tpch_q20/datafusion:parquet 88651881 92404081 0.96
tpch_q21/datafusion:parquet 174898670 173028484 1.01
tpch_q22/datafusion:parquet 57290787 57426479 1.00
duckdb / vortex-compact / ns (0.978x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 30628370 28707453 1.07
tpch_q02/duckdb:vortex-compact 41289499 41898505 0.99
tpch_q03/duckdb:vortex-compact 40356721 42832545 0.94
tpch_q04/duckdb:vortex-compact 34216269 35293109 0.97
tpch_q05/duckdb:vortex-compact 44285382 46200406 0.96
tpch_q06/duckdb:vortex-compact 13737930 14221356 0.97
tpch_q07/duckdb:vortex-compact 🚀 45864549 51103902 0.90
tpch_q08/duckdb:vortex-compact 59161747 58391376 1.01
tpch_q09/duckdb:vortex-compact 63744065 69224493 0.92
tpch_q10/duckdb:vortex-compact 56288552 58015624 0.97
tpch_q11/duckdb:vortex-compact 20334183 20732517 0.98
tpch_q12/duckdb:vortex-compact 32008976 33641850 0.95
tpch_q13/duckdb:vortex-compact 44852873 45606375 0.98
tpch_q14/duckdb:vortex-compact 25863562 28600958 0.90
tpch_q15/duckdb:vortex-compact 22060084 23629369 0.93
tpch_q16/duckdb:vortex-compact 36081199 35742758 1.01
tpch_q17/duckdb:vortex-compact 38046377 38100886 1.00
tpch_q18/duckdb:vortex-compact 55375967 53374142 1.04
tpch_q19/duckdb:vortex-compact 41239264 41214007 1.00
tpch_q20/duckdb:vortex-compact 45211413 44378360 1.02
tpch_q21/duckdb:vortex-compact 124188406 128948884 0.96
tpch_q22/duckdb:vortex-compact 23362335 21933331 1.07
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81618506 81499090 1.00
tpch_q02/duckdb:parquet 46040563 46548603 0.99
tpch_q03/duckdb:parquet 81067780 80338936 1.01
tpch_q04/duckdb:parquet 57564236 57761932 1.00
tpch_q05/duckdb:parquet 78449463 78493467 1.00
tpch_q06/duckdb:parquet 24996849 24799133 1.01
tpch_q07/duckdb:parquet 80001386 82000896 0.98
tpch_q08/duckdb:parquet 96767876 96231242 1.01
tpch_q09/duckdb:parquet 147736293 148260267 1.00
tpch_q10/duckdb:parquet 141041863 142425492 0.99
tpch_q11/duckdb:parquet 25395822 25716521 0.99
tpch_q12/duckdb:parquet 53430894 53414283 1.00
tpch_q13/duckdb:parquet 289687508 290710682 1.00
tpch_q14/duckdb:parquet 55969015 56148721 1.00
tpch_q15/duckdb:parquet 30620129 30789512 0.99
tpch_q16/duckdb:parquet 66387052 66621803 1.00
tpch_q17/duckdb:parquet 57849021 57830134 1.00
tpch_q18/duckdb:parquet 127434581 128246878 0.99
tpch_q19/duckdb:parquet 77425235 77267442 1.00
tpch_q20/duckdb:parquet 77471484 76886488 1.01
tpch_q21/duckdb:parquet 187575732 186544174 1.01
tpch_q22/duckdb:parquet 63495795 64004759 0.99

File Size Changes (9 files changed, -56.1% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-file-compressed 8.78 MB 0 B 8.78 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-file-compressed 164.64 MB 0 B 164.64 MB -100.0%
nation.vortex 1.0 vortex-file-compressed 11.05 KB 0 B 11.05 KB -100.0%
orders.vortex 1.0 vortex-file-compressed 39.39 MB 0 B 39.39 MB -100.0%
part.vortex 1.0 vortex-file-compressed 5.33 MB 0 B 5.33 MB -100.0%
partsupp.vortex 1.0 vortex-file-compressed 23.83 MB 0 B 23.83 MB -100.0%
region.vortex 1.0 vortex-file-compressed 6.88 KB 0 B 6.88 KB -100.0%
supplier.vortex 1.0 vortex-file-compressed 611.33 KB 0 B 611.33 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 189.73 MB (0.0%)
  • vortex-file-compressed: 242.85 MB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): 0.984x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed / ns (0.984x ➖, 2↑ 1↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 14148851 14421889 0.98
statpopgen_q01/duckdb:vortex-file-compressed 13038790 13073613 1.00
statpopgen_q02/duckdb:vortex-file-compressed 625579139 571150816 1.10
statpopgen_q03/duckdb:vortex-file-compressed 🚀 1180572460 1762371752 0.67
statpopgen_q04/duckdb:vortex-file-compressed 🚨 1724270100 1182498676 1.46
statpopgen_q05/duckdb:vortex-file-compressed 610897053 657944254 0.93
statpopgen_q06/duckdb:vortex-file-compressed 1757250473 1811574254 0.97
statpopgen_q07/duckdb:vortex-file-compressed 276893775 268251696 1.03
statpopgen_q08/duckdb:vortex-file-compressed 278138131 278860057 1.00
statpopgen_q09/duckdb:vortex-file-compressed 🚀 1069075847 1232121386 0.87
statpopgen_q10/duckdb:vortex-file-compressed 2941111731 2964327701 0.99
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 375809882 376451538 1.00
statpopgen_q01/duckdb:parquet 467111930 467856103 1.00
statpopgen_q02/duckdb:parquet 773316747 775172380 1.00
statpopgen_q03/duckdb:parquet 1049929316 1053083392 1.00
statpopgen_q04/duckdb:parquet 1045950739 1049647164 1.00
statpopgen_q05/duckdb:parquet 768787630 764609731 1.01
statpopgen_q06/duckdb:parquet 1015047207 1020692399 0.99
statpopgen_q07/duckdb:parquet 959489890 955744216 1.00
statpopgen_q08/duckdb:parquet 967753782 963800102 1.00
statpopgen_q09/duckdb:parquet 996856499 997321289 1.00
statpopgen_q10/duckdb:parquet 1646813270 1664666193 0.99

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.993x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6908517 7079863 0.98
fineweb_q01/datafusion:vortex-compact 101268233 101039251 1.00
fineweb_q02/datafusion:vortex-compact 102913710 99431472 1.04
fineweb_q03/datafusion:vortex-compact 533488744 528825347 1.01
fineweb_q04/datafusion:vortex-compact 553286996 564114459 0.98
fineweb_q05/datafusion:vortex-compact 494447329 525093675 0.94
fineweb_q06/datafusion:vortex-compact 289593253 289240438 1.00
fineweb_q07/datafusion:vortex-compact 298595211 298026962 1.00
fineweb_q08/datafusion:vortex-compact 15723343 15865133 0.99
datafusion / parquet / ns (0.990x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 8740118 8943594 0.98
fineweb_q01/datafusion:parquet 197015792 201379096 0.98
fineweb_q02/datafusion:parquet 201117902 200213900 1.00
fineweb_q03/datafusion:parquet 190093043 196239984 0.97
fineweb_q04/datafusion:parquet 208187104 208359808 1.00
fineweb_q05/datafusion:parquet 205668739 206360263 1.00
fineweb_q06/datafusion:parquet 199583091 197917789 1.01
fineweb_q07/datafusion:parquet 196525450 195154525 1.01
fineweb_q08/datafusion:parquet 187236591 192703294 0.97
duckdb / vortex-compact / ns (1.003x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 6328469 6091908 1.04
fineweb_q01/duckdb:vortex-compact 107940471 100897330 1.07
fineweb_q02/duckdb:vortex-compact 112609574 105087371 1.07
fineweb_q03/duckdb:vortex-compact 351802402 349652311 1.01
fineweb_q04/duckdb:vortex-compact 392367851 391156058 1.00
fineweb_q05/duckdb:vortex-compact 348818914 344205361 1.01
fineweb_q06/duckdb:vortex-compact 232633634 236869464 0.98
fineweb_q07/duckdb:vortex-compact 232993322 237609883 0.98
fineweb_q08/duckdb:vortex-compact 🚀 25416316 29064311 0.87
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36481742 36979181 0.99
fineweb_q01/duckdb:parquet 77228146 77079196 1.00
fineweb_q02/duckdb:parquet 77645018 78120800 0.99
fineweb_q03/duckdb:parquet 207143638 206305132 1.00
fineweb_q04/duckdb:parquet 230046206 234335661 0.98
fineweb_q05/duckdb:parquet 201314945 200684243 1.00
fineweb_q06/duckdb:parquet 142020734 142801423 0.99
fineweb_q07/duckdb:parquet 143049516 143236805 1.00
fineweb_q08/duckdb:parquet 39261509 40774050 0.96

File Size Changes (2 files changed, -53.7% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-file-compressed 1.43 GB 0 B 1.43 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.2%, environment too noisy confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.004x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-compact 2040119 2206641 0.92
clickbench_q01/datafusion:vortex-compact 23189622 23643567 0.98
clickbench_q02/datafusion:vortex-compact 58796594 58581020 1.00
clickbench_q03/datafusion:vortex-compact 39796219 39283604 1.01
clickbench_q04/datafusion:vortex-compact 169699236 166811219 1.02
clickbench_q05/datafusion:vortex-compact 253840058 243392992 1.04
clickbench_q06/datafusion:vortex-compact 2165197 2002873 1.08
clickbench_q07/datafusion:vortex-compact 31615184 31675303 1.00
clickbench_q08/datafusion:vortex-compact 252135758 256598678 0.98
clickbench_q09/datafusion:vortex-compact 422901445 404196109 1.05
clickbench_q10/datafusion:vortex-compact 119959205 118588949 1.01
clickbench_q11/datafusion:vortex-compact 156023232 158109495 0.99
clickbench_q12/datafusion:vortex-compact 240903155 237307564 1.02
clickbench_q13/datafusion:vortex-compact 397545131 396052146 1.00
clickbench_q14/datafusion:vortex-compact 256442891 245391863 1.05
clickbench_q15/datafusion:vortex-compact 203223905 199964465 1.02
clickbench_q16/datafusion:vortex-compact 504811758 499877570 1.01
clickbench_q17/datafusion:vortex-compact 511751230 500562006 1.02
clickbench_q18/datafusion:vortex-compact 947916944 949848161 1.00
clickbench_q19/datafusion:vortex-compact 31280281 31387965 1.00
clickbench_q20/datafusion:vortex-compact 241309642 239098975 1.01
clickbench_q21/datafusion:vortex-compact 353612698 348120196 1.02
clickbench_q22/datafusion:vortex-compact 560036988 557604190 1.00
clickbench_q23/datafusion:vortex-compact 1652995966 1740961979 0.95
clickbench_q24/datafusion:vortex-compact 76113415 75169932 1.01
clickbench_q25/datafusion:vortex-compact 111517630 112496276 0.99
clickbench_q26/datafusion:vortex-compact 76662446 74513142 1.03
clickbench_q27/datafusion:vortex-compact 326022125 332734109 0.98
clickbench_q28/datafusion:vortex-compact 1558059810 1565256586 1.00
clickbench_q29/datafusion:vortex-compact 🚨 93693511 83285084 1.12
clickbench_q30/datafusion:vortex-compact 277397758 277839280 1.00
clickbench_q31/datafusion:vortex-compact 303907433 301367187 1.01
clickbench_q32/datafusion:vortex-compact 849743921 844458579 1.01
clickbench_q33/datafusion:vortex-compact 1030300036 1036040110 0.99
clickbench_q34/datafusion:vortex-compact 1020487850 1051948779 0.97
clickbench_q35/datafusion:vortex-compact 189332009 184921284 1.02
clickbench_q36/datafusion:vortex-compact 63443302 63593583 1.00
clickbench_q37/datafusion:vortex-compact 31600935 30501302 1.04
clickbench_q38/datafusion:vortex-compact 18551927 19120537 0.97
clickbench_q39/datafusion:vortex-compact 136310003 138767133 0.98
clickbench_q40/datafusion:vortex-compact 16638326 16581598 1.00
clickbench_q41/datafusion:vortex-compact 17960227 19611951 0.92
clickbench_q42/datafusion:vortex-compact 13965129 14462330 0.97
datafusion / parquet / ns (1.006x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1945574 1999795 0.97
clickbench_q01/datafusion:parquet 17293156 18617218 0.93
clickbench_q02/datafusion:parquet 30563516 32561273 0.94
clickbench_q03/datafusion:parquet 27095808 26455082 1.02
clickbench_q04/datafusion:parquet 174133200 173301460 1.00
clickbench_q05/datafusion:parquet 233839471 239422497 0.98
clickbench_q06/datafusion:parquet 1961048 1942384 1.01
clickbench_q07/datafusion:parquet 17951691 18321337 0.98
clickbench_q08/datafusion:parquet 232402281 230801359 1.01
clickbench_q09/datafusion:parquet 366022666 380449635 0.96
clickbench_q10/datafusion:parquet 72132826 72651242 0.99
clickbench_q11/datafusion:parquet 91456491 92795000 0.99
clickbench_q12/datafusion:parquet 241304770 239974730 1.01
clickbench_q13/datafusion:parquet 398503362 390193715 1.02
clickbench_q14/datafusion:parquet 254638549 249502892 1.02
clickbench_q15/datafusion:parquet 194358899 197331719 0.98
clickbench_q16/datafusion:parquet 490771829 477393005 1.03
clickbench_q17/datafusion:parquet 486713907 483874589 1.01
clickbench_q18/datafusion:parquet 902145784 919393219 0.98
clickbench_q19/datafusion:parquet 🚨 32607988 22726571 1.43
clickbench_q20/datafusion:parquet 457012224 459931913 0.99
clickbench_q21/datafusion:parquet 500786923 482832749 1.04
clickbench_q22/datafusion:parquet 663070236 659499726 1.01
clickbench_q23/datafusion:parquet 2937334962 2856872407 1.03
clickbench_q24/datafusion:parquet 53323807 51397011 1.04
clickbench_q25/datafusion:parquet 96346383 94821155 1.02
clickbench_q26/datafusion:parquet 48460121 50237445 0.96
clickbench_q27/datafusion:parquet 540144851 538503197 1.00
clickbench_q28/datafusion:parquet 1524539595 1534926979 0.99
clickbench_q29/datafusion:parquet 41474586 40967678 1.01
clickbench_q30/datafusion:parquet 236630385 238222715 0.99
clickbench_q31/datafusion:parquet 277814091 279472263 0.99
clickbench_q32/datafusion:parquet 840319106 843170294 1.00
clickbench_q33/datafusion:parquet 1084829227 1096351576 0.99
clickbench_q34/datafusion:parquet 1069620955 1083745100 0.99
clickbench_q35/datafusion:parquet 164414490 168366630 0.98
clickbench_q36/datafusion:parquet 117693729 119182565 0.99
clickbench_q37/datafusion:parquet 47795316 50450072 0.95
clickbench_q38/datafusion:parquet 70780930 70404845 1.01
clickbench_q39/datafusion:parquet 238722323 229849479 1.04
clickbench_q40/datafusion:parquet 27287790 26140340 1.04
clickbench_q41/datafusion:parquet 24983457 23520832 1.06
clickbench_q42/datafusion:parquet 25826437 26557932 0.97
duckdb / vortex-compact / ns (1.002x ➖, 3↑ 3↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-compact 🚀 10731865 12359147 0.87
clickbench_q01/duckdb:vortex-compact 20286870 20623927 0.98
clickbench_q02/duckdb:vortex-compact 32006180 31794780 1.01
clickbench_q03/duckdb:vortex-compact 25322471 26512716 0.96
clickbench_q04/duckdb:vortex-compact 136242958 137626253 0.99
clickbench_q05/duckdb:vortex-compact 174032079 172619474 1.01
clickbench_q06/duckdb:vortex-compact 🚀 14949915 17466912 0.86
clickbench_q07/duckdb:vortex-compact 23414374 24359975 0.96
clickbench_q08/duckdb:vortex-compact 179092002 181946768 0.98
clickbench_q09/duckdb:vortex-compact 258350392 261868757 0.99
clickbench_q10/duckdb:vortex-compact 75332036 76727261 0.98
clickbench_q11/duckdb:vortex-compact 96201382 98602444 0.98
clickbench_q12/duckdb:vortex-compact 204765980 198019033 1.03
clickbench_q13/duckdb:vortex-compact 363219956 365236940 0.99
clickbench_q14/duckdb:vortex-compact 216413726 226159374 0.96
clickbench_q15/duckdb:vortex-compact 190750045 184445414 1.03
clickbench_q16/duckdb:vortex-compact 406867799 418717875 0.97
clickbench_q17/duckdb:vortex-compact 387430160 392701986 0.99
clickbench_q18/duckdb:vortex-compact 724097467 735083263 0.99
clickbench_q19/duckdb:vortex-compact 26704594 27347361 0.98
clickbench_q20/duckdb:vortex-compact 206894871 202515537 1.02
clickbench_q21/duckdb:vortex-compact 311710799 299904767 1.04
clickbench_q22/duckdb:vortex-compact 483567940 478625806 1.01
clickbench_q23/duckdb:vortex-compact 299844183 309935517 0.97
clickbench_q24/duckdb:vortex-compact 🚀 67312179 74973373 0.90
clickbench_q25/duckdb:vortex-compact 91925076 92001833 1.00
clickbench_q26/duckdb:vortex-compact 82355744 85097104 0.97
clickbench_q27/duckdb:vortex-compact 388761379 373498607 1.04
clickbench_q28/duckdb:vortex-compact 🚨 1621871888 1277524234 1.27
clickbench_q29/duckdb:vortex-compact 38847964 39380904 0.99
clickbench_q30/duckdb:vortex-compact 197419762 200786950 0.98
clickbench_q31/duckdb:vortex-compact 371315821 371260468 1.00
clickbench_q32/duckdb:vortex-compact 934345130 948712613 0.98
clickbench_q33/duckdb:vortex-compact 1058059138 1028030543 1.03
clickbench_q34/duckdb:vortex-compact 1095860996 1101813082 0.99
clickbench_q35/duckdb:vortex-compact 219112011 222554149 0.98
clickbench_q36/duckdb:vortex-compact 🚨 43154853 37625181 1.15
clickbench_q37/duckdb:vortex-compact 29836449 31054516 0.96
clickbench_q38/duckdb:vortex-compact 🚨 34482846 31079817 1.11
clickbench_q39/duckdb:vortex-compact 58019517 53645030 1.08
clickbench_q40/duckdb:vortex-compact 29784810 28341367 1.05
clickbench_q41/duckdb:vortex-compact 30949327 29649480 1.04
clickbench_q42/duckdb:vortex-compact 27584586 25287943 1.09
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 16150675 16908946 0.96
clickbench_q01/duckdb:parquet 16772142 16539164 1.01
clickbench_q02/duckdb:parquet 23342626 24199036 0.96
clickbench_q03/duckdb:parquet 27689472 26533688 1.04
clickbench_q04/duckdb:parquet 128193085 131123502 0.98
clickbench_q05/duckdb:parquet 186489451 182836603 1.02
clickbench_q06/duckdb:parquet 24331352 23147513 1.05
clickbench_q07/duckdb:parquet 18702961 19399421 0.96
clickbench_q08/duckdb:parquet 165337001 163692237 1.01
clickbench_q09/duckdb:parquet 229067445 230839338 0.99
clickbench_q10/duckdb:parquet 58312276 57666285 1.01
clickbench_q11/duckdb:parquet 68394750 67190145 1.02
clickbench_q12/duckdb:parquet 172888604 171066063 1.01
clickbench_q13/duckdb:parquet 310307064 308054449 1.01
clickbench_q14/duckdb:parquet 189265137 185666379 1.02
clickbench_q15/duckdb:parquet 182820392 186686060 0.98
clickbench_q16/duckdb:parquet 357032819 358341252 1.00
clickbench_q17/duckdb:parquet 369564002 371925795 0.99
clickbench_q18/duckdb:parquet 687384741 692467823 0.99
clickbench_q19/duckdb:parquet 21128863 21777082 0.97
clickbench_q20/duckdb:parquet 261315178 261004306 1.00
clickbench_q21/duckdb:parquet 319833641 314842334 1.02
clickbench_q22/duckdb:parquet 493083958 457205601 1.08
clickbench_q23/duckdb:parquet 256547680 262014254 0.98
clickbench_q24/duckdb:parquet 70777079 72426909 0.98
clickbench_q25/duckdb:parquet 71506847 72180734 0.99
clickbench_q26/duckdb:parquet 48334762 49797187 0.97
clickbench_q27/duckdb:parquet 269241363 272929544 0.99
clickbench_q28/duckdb:parquet 1736177196 1756720947 0.99
clickbench_q29/duckdb:parquet 26387927 26393626 1.00
clickbench_q30/duckdb:parquet 176413676 178119640 0.99
clickbench_q31/duckdb:parquet 308148485 304991316 1.01
clickbench_q32/duckdb:parquet 910874716 918698308 0.99
clickbench_q33/duckdb:parquet 784342829 779112661 1.01
clickbench_q34/duckdb:parquet 791056319 799793574 0.99
clickbench_q35/duckdb:parquet 209536848 210940968 0.99
clickbench_q36/duckdb:parquet 50301480 50182815 1.00
clickbench_q37/duckdb:parquet 36609620 36319770 1.01
clickbench_q38/duckdb:parquet 37597501 38162211 0.99
clickbench_q39/duckdb:parquet 89304424 87052743 1.03
clickbench_q40/duckdb:parquet 21100790 19836365 1.06
clickbench_q41/duckdb:parquet 19674005 21335854 0.92
clickbench_q42/duckdb:parquet 24826250 23779528 1.04

File Size Changes (101 files changed, -60.8% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-file-compressed 89.98 MB 0 B 89.98 MB -100.0%
hits_1.vortex 1.0 vortex-file-compressed 138.88 MB 0 B 138.88 MB -100.0%
hits_10.vortex 1.0 vortex-file-compressed 69.58 MB 0 B 69.58 MB -100.0%
hits_11.vortex 1.0 vortex-file-compressed 80.00 MB 0 B 80.00 MB -100.0%
hits_12.vortex 1.0 vortex-file-compressed 101.33 MB 0 B 101.33 MB -100.0%
hits_13.vortex 1.0 vortex-file-compressed 99.65 MB 0 B 99.65 MB -100.0%
hits_14.vortex 1.0 vortex-file-compressed 111.63 MB 0 B 111.63 MB -100.0%
hits_15.vortex 1.0 vortex-file-compressed 89.27 MB 0 B 89.27 MB -100.0%
hits_16.vortex 1.0 vortex-file-compressed 79.46 MB 0 B 79.46 MB -100.0%
hits_17.vortex 1.0 vortex-file-compressed 87.59 MB 0 B 87.59 MB -100.0%
hits_18.vortex 1.0 vortex-file-compressed 104.87 MB 0 B 104.87 MB -100.0%
hits_19.vortex 1.0 vortex-file-compressed 73.36 MB 0 B 73.36 MB -100.0%
hits_2.vortex 1.0 vortex-file-compressed 187.07 MB 0 B 187.07 MB -100.0%
hits_20.vortex 1.0 vortex-file-compressed 62.65 MB 0 B 62.65 MB -100.0%
hits_21.vortex 1.0 vortex-file-compressed 93.14 MB 0 B 93.14 MB -100.0%
hits_22.vortex 1.0 vortex-file-compressed 77.08 MB 0 B 77.08 MB -100.0%
hits_23.vortex 1.0 vortex-file-compressed 76.50 MB 0 B 76.50 MB -100.0%
hits_24.vortex 1.0 vortex-file-compressed 76.01 MB 0 B 76.01 MB -100.0%
hits_25.vortex 1.0 vortex-file-compressed 113.80 MB 0 B 113.80 MB -100.0%
hits_26.vortex 1.0 vortex-file-compressed 109.79 MB 0 B 109.79 MB -100.0%
hits_27.vortex 1.0 vortex-file-compressed 123.30 MB 0 B 123.30 MB -100.0%
hits_28.vortex 1.0 vortex-file-compressed 120.53 MB 0 B 120.53 MB -100.0%
hits_29.vortex 1.0 vortex-file-compressed 59.54 MB 0 B 59.54 MB -100.0%
hits_3.vortex 1.0 vortex-file-compressed 142.57 MB 0 B 142.57 MB -100.0%
hits_30.vortex 1.0 vortex-file-compressed 87.19 MB 0 B 87.19 MB -100.0%
hits_31.vortex 1.0 vortex-file-compressed 90.32 MB 0 B 90.32 MB -100.0%
hits_32.vortex 1.0 vortex-file-compressed 66.83 MB 0 B 66.83 MB -100.0%
hits_33.vortex 1.0 vortex-file-compressed 57.18 MB 0 B 57.18 MB -100.0%
hits_34.vortex 1.0 vortex-file-compressed 97.86 MB 0 B 97.86 MB -100.0%
hits_35.vortex 1.0 vortex-file-compressed 115.52 MB 0 B 115.52 MB -100.0%
hits_36.vortex 1.0 vortex-file-compressed 68.60 MB 0 B 68.60 MB -100.0%
hits_37.vortex 1.0 vortex-file-compressed 85.67 MB 0 B 85.67 MB -100.0%
hits_38.vortex 1.0 vortex-file-compressed 99.37 MB 0 B 99.37 MB -100.0%
hits_39.vortex 1.0 vortex-file-compressed 80.39 MB 0 B 80.39 MB -100.0%
hits_4.vortex 1.0 vortex-file-compressed 109.09 MB 0 B 109.09 MB -100.0%
hits_40.vortex 1.0 vortex-file-compressed 118.09 MB 0 B 118.09 MB -100.0%
hits_41.vortex 1.0 vortex-file-compressed 224.38 MB 0 B 224.38 MB -100.0%
hits_42.vortex 1.0 vortex-file-compressed 223.25 MB 0 B 223.25 MB -100.0%
hits_43.vortex 1.0 vortex-file-compressed 227.72 MB 0 B 227.72 MB -100.0%
hits_44.vortex 1.0 vortex-file-compressed 186.89 MB 0 B 186.89 MB -100.0%
hits_45.vortex 1.0 vortex-file-compressed 122.43 MB 0 B 122.43 MB -100.0%
hits_46.vortex 1.0 vortex-file-compressed 69.35 MB 0 B 69.35 MB -100.0%
hits_47.vortex 1.0 vortex-file-compressed 41.25 MB 0 B 41.25 MB -100.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 0 B 28.03 MB -100.0%
hits_49.vortex 1.0 vortex-file-compressed 75.73 MB 0 B 75.73 MB -100.0%
hits_5.vortex 1.0 vortex-file-compressed 93.70 MB 0 B 93.70 MB -100.0%
hits_50.vortex 1.0 vortex-file-compressed 180.37 MB 0 B 180.37 MB -100.0%
hits_51.vortex 1.0 vortex-file-compressed 280.34 MB 0 B 280.34 MB -100.0%
hits_52.vortex 1.0 vortex-file-compressed 103.90 MB 0 B 103.90 MB -100.0%
hits_53.vortex 1.0 vortex-file-compressed 85.82 MB 0 B 85.82 MB -100.0%
hits_54.vortex 1.0 vortex-file-compressed 223.19 MB 0 B 223.19 MB -100.0%
hits_55.vortex 1.0 vortex-file-compressed 170.19 MB 0 B 170.19 MB -100.0%
hits_56.vortex 1.0 vortex-file-compressed 124.03 MB 0 B 124.03 MB -100.0%
hits_57.vortex 1.0 vortex-file-compressed 128.67 MB 0 B 128.67 MB -100.0%
hits_58.vortex 1.0 vortex-file-compressed 90.80 MB 0 B 90.80 MB -100.0%
hits_59.vortex 1.0 vortex-file-compressed 102.04 MB 0 B 102.04 MB -100.0%
hits_6.vortex 1.0 vortex-file-compressed 94.07 MB 0 B 94.07 MB -100.0%
hits_60.vortex 1.0 vortex-file-compressed 103.57 MB 0 B 103.57 MB -100.0%
hits_61.vortex 1.0 vortex-file-compressed 101.41 MB 0 B 101.41 MB -100.0%
hits_62.vortex 1.0 vortex-file-compressed 117.79 MB 0 B 117.79 MB -100.0%
hits_63.vortex 1.0 vortex-file-compressed 69.27 MB 0 B 69.27 MB -100.0%
hits_64.vortex 1.0 vortex-file-compressed 81.22 MB 0 B 81.22 MB -100.0%
hits_65.vortex 1.0 vortex-file-compressed 184.41 MB 0 B 184.41 MB -100.0%
hits_66.vortex 1.0 vortex-file-compressed 90.40 MB 0 B 90.40 MB -100.0%
hits_67.vortex 1.0 vortex-file-compressed 185.41 MB 0 B 185.41 MB -100.0%
hits_68.vortex 1.0 vortex-file-compressed 123.50 MB 0 B 123.50 MB -100.0%
hits_69.vortex 1.0 vortex-file-compressed 123.48 MB 0 B 123.48 MB -100.0%
hits_7.vortex 1.0 vortex-file-compressed 94.72 MB 0 B 94.72 MB -100.0%
hits_70.vortex 1.0 vortex-file-compressed 93.93 MB 0 B 93.93 MB -100.0%
hits_71.vortex 1.0 vortex-file-compressed 102.16 MB 0 B 102.16 MB -100.0%
hits_72.vortex 1.0 vortex-file-compressed 84.69 MB 0 B 84.69 MB -100.0%
hits_73.vortex 1.0 vortex-file-compressed 109.92 MB 0 B 109.92 MB -100.0%
hits_74.vortex 1.0 vortex-file-compressed 120.18 MB 0 B 120.18 MB -100.0%
hits_75.vortex 1.0 vortex-file-compressed 63.49 MB 0 B 63.49 MB -100.0%
hits_76.vortex 1.0 vortex-file-compressed 114.35 MB 0 B 114.35 MB -100.0%
hits_77.vortex 1.0 vortex-file-compressed 169.01 MB 0 B 169.01 MB -100.0%
hits_78.vortex 1.0 vortex-file-compressed 165.52 MB 0 B 165.52 MB -100.0%
hits_79.vortex 1.0 vortex-file-compressed 144.84 MB 0 B 144.84 MB -100.0%
hits_8.vortex 1.0 vortex-file-compressed 93.98 MB 0 B 93.98 MB -100.0%
hits_80.vortex 1.0 vortex-file-compressed 105.48 MB 0 B 105.48 MB -100.0%
hits_81.vortex 1.0 vortex-file-compressed 101.36 MB 0 B 101.36 MB -100.0%
hits_82.vortex 1.0 vortex-file-compressed 99.99 MB 0 B 99.99 MB -100.0%
hits_83.vortex 1.0 vortex-file-compressed 89.42 MB 0 B 89.42 MB -100.0%
hits_84.vortex 1.0 vortex-file-compressed 117.86 MB 0 B 117.86 MB -100.0%
hits_85.vortex 1.0 vortex-file-compressed 91.80 MB 0 B 91.80 MB -100.0%
hits_86.vortex 1.0 vortex-file-compressed 69.42 MB 0 B 69.42 MB -100.0%
hits_87.vortex 1.0 vortex-file-compressed 173.03 MB 0 B 173.03 MB -100.0%
hits_88.vortex 1.0 vortex-file-compressed 111.37 MB 0 B 111.37 MB -100.0%
hits_89.vortex 1.0 vortex-file-compressed 185.66 MB 0 B 185.66 MB -100.0%
hits_9.vortex 1.0 vortex-file-compressed 99.71 MB 0 B 99.71 MB -100.0%
hits_90.vortex 1.0 vortex-file-compressed 142.88 MB 0 B 142.88 MB -100.0%
hits_91.vortex 1.0 vortex-file-compressed 97.36 MB 0 B 97.36 MB -100.0%
hits_92.vortex 1.0 vortex-file-compressed 147.51 MB 0 B 147.51 MB -100.0%
hits_93.vortex 1.0 vortex-file-compressed 90.68 MB 0 B 90.68 MB -100.0%
hits_94.vortex 1.0 vortex-file-compressed 139.39 MB 0 B 139.39 MB -100.0%
hits_95.vortex 1.0 vortex-file-compressed 96.47 MB 0 B 96.47 MB -100.0%
hits_96.vortex 1.0 vortex-file-compressed 136.17 MB 0 B 136.17 MB -100.0%
hits_97.vortex 1.0 vortex-file-compressed 107.27 MB 0 B 107.27 MB -100.0%
hits_98.vortex 1.0 vortex-file-compressed 118.90 MB 0 B 118.90 MB -100.0%
hits_99.vortex 1.0 vortex-file-compressed 123.59 MB 0 B 123.59 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (0.0%)
  • vortex-file-compressed: 11.04 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (+1.3%, low confidence) · DuckDB No clear signal (-2.8%, low confidence)
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.010x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 383196747 384436145 1.00
tpch_q02/datafusion:vortex-compact 106125574 104655834 1.01
tpch_q03/datafusion:vortex-compact 181617541 184493694 0.98
tpch_q04/datafusion:vortex-compact 114933030 112945708 1.02
tpch_q05/datafusion:vortex-compact 304111931 295561185 1.03
tpch_q06/datafusion:vortex-compact 61788746 61703947 1.00
tpch_q07/datafusion:vortex-compact 395735276 397367434 1.00
tpch_q08/datafusion:vortex-compact 322284015 322910037 1.00
tpch_q09/datafusion:vortex-compact 516798537 530909491 0.97
tpch_q10/datafusion:vortex-compact 226933762 223503273 1.02
tpch_q11/datafusion:vortex-compact 82120245 75532361 1.09
tpch_q12/datafusion:vortex-compact 155081513 155855615 1.00
tpch_q13/datafusion:vortex-compact 155026515 156074609 0.99
tpch_q14/datafusion:vortex-compact 80800519 76596297 1.05
tpch_q15/datafusion:vortex-compact 154684484 157143758 0.98
tpch_q16/datafusion:vortex-compact 77274221 74939206 1.03
tpch_q17/datafusion:vortex-compact 477051998 474019012 1.01
tpch_q18/datafusion:vortex-compact 706185391 690988688 1.02
tpch_q19/datafusion:vortex-compact 180471247 182214371 0.99
tpch_q20/datafusion:vortex-compact 172152289 171991625 1.00
tpch_q21/datafusion:vortex-compact 581177057 574713779 1.01
tpch_q22/datafusion:vortex-compact 55167924 53618627 1.03
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 324632756 320200738 1.01
tpch_q02/datafusion:parquet 221668085 221491061 1.00
tpch_q03/datafusion:parquet 225890908 226505573 1.00
tpch_q04/datafusion:parquet 97932754 101323106 0.97
tpch_q05/datafusion:parquet 366068632 365725664 1.00
tpch_q06/datafusion:parquet 74784640 70634820 1.06
tpch_q07/datafusion:parquet 516161800 510995412 1.01
tpch_q08/datafusion:parquet 406000481 412247176 0.98
tpch_q09/datafusion:parquet 668156598 661820302 1.01
tpch_q10/datafusion:parquet 556087377 554650342 1.00
tpch_q11/datafusion:parquet 159163302 160885651 0.99
tpch_q12/datafusion:parquet 151767030 152369353 1.00
tpch_q13/datafusion:parquet 349595097 356809814 0.98
tpch_q14/datafusion:parquet 119839844 120889536 0.99
tpch_q15/datafusion:parquet 184314392 191903540 0.96
tpch_q16/datafusion:parquet 139165761 137948909 1.01
tpch_q17/datafusion:parquet 499710339 510585554 0.98
tpch_q18/datafusion:parquet 687706241 723902432 0.95
tpch_q19/datafusion:parquet 199752735 195210975 1.02
tpch_q20/datafusion:parquet 314894826 299675363 1.05
tpch_q21/datafusion:parquet 536949334 546040450 0.98
tpch_q22/datafusion:parquet 258830449 259762972 1.00
duckdb / vortex-compact / ns (0.991x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 110351370 112448333 0.98
tpch_q02/duckdb:vortex-compact 75830829 75377120 1.01
tpch_q03/duckdb:vortex-compact 125419028 126278125 0.99
tpch_q04/duckdb:vortex-compact 158083696 160476842 0.99
tpch_q05/duckdb:vortex-compact 155227164 147777992 1.05
tpch_q06/duckdb:vortex-compact 43830061 44206506 0.99
tpch_q07/duckdb:vortex-compact 136952427 138038264 0.99
tpch_q08/duckdb:vortex-compact 183537857 184556626 0.99
tpch_q09/duckdb:vortex-compact 310320929 298884557 1.04
tpch_q10/duckdb:vortex-compact 209836709 210905920 0.99
tpch_q11/duckdb:vortex-compact 43003119 45760949 0.94
tpch_q12/duckdb:vortex-compact 123193079 122221492 1.01
tpch_q13/duckdb:vortex-compact 174950737 172574408 1.01
tpch_q14/duckdb:vortex-compact 61654392 65318218 0.94
tpch_q15/duckdb:vortex-compact 93393436 94946094 0.98
tpch_q16/duckdb:vortex-compact 89161436 88826649 1.00
tpch_q17/duckdb:vortex-compact 104681835 110671099 0.95
tpch_q18/duckdb:vortex-compact 253900029 259110734 0.98
tpch_q19/duckdb:vortex-compact 86275041 89581674 0.96
tpch_q20/duckdb:vortex-compact 148678607 152009321 0.98
tpch_q21/duckdb:vortex-compact 478997597 467239427 1.03
tpch_q22/duckdb:vortex-compact 80544300 80732914 1.00
duckdb / parquet / ns (1.020x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 129213441 106759947 1.21
tpch_q02/duckdb:parquet 100628413 101472823 0.99
tpch_q03/duckdb:parquet 165476842 164762028 1.00
tpch_q04/duckdb:parquet 119281918 118818283 1.00
tpch_q05/duckdb:parquet 187078641 187993047 1.00
tpch_q06/duckdb:parquet 57635509 55050535 1.05
tpch_q07/duckdb:parquet 145457007 139338763 1.04
tpch_q08/duckdb:parquet 218621732 216271600 1.01
tpch_q09/duckdb:parquet 348940366 346894822 1.01
tpch_q10/duckdb:parquet 656359564 654132833 1.00
tpch_q11/duckdb:parquet 41574184 41131653 1.01
tpch_q12/duckdb:parquet 116590042 121003093 0.96
tpch_q13/duckdb:parquet 398750260 399298475 1.00
tpch_q14/duckdb:parquet 152605373 152720327 1.00
tpch_q15/duckdb:parquet 79949891 73337675 1.09
tpch_q16/duckdb:parquet 155720431 155094945 1.00
tpch_q17/duckdb:parquet 120472017 117015873 1.03
tpch_q18/duckdb:parquet 292396534 272086073 1.07
tpch_q19/duckdb:parquet 238276855 240220520 0.99
tpch_q20/duckdb:parquet 196142962 197007473 1.00
tpch_q21/duckdb:parquet 434862066 439124066 0.99
tpch_q22/duckdb:parquet 334892139 335696958 1.00

File Size Changes (9 files changed, -56.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-file-compressed 87.23 MB 0 B 87.23 MB -100.0%
duckdb.db 10.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-file-compressed 1.65 GB 0 B 1.65 GB -100.0%
nation.vortex 10.0 vortex-file-compressed 11.05 KB 0 B 11.05 KB -100.0%
orders.vortex 10.0 vortex-file-compressed 436.71 MB 0 B 436.71 MB -100.0%
part.vortex 10.0 vortex-file-compressed 53.62 MB 0 B 53.62 MB -100.0%
partsupp.vortex 10.0 vortex-file-compressed 240.78 MB 0 B 240.78 MB -100.0%
region.vortex 10.0 vortex-file-compressed 6.88 KB 0 B 6.88 KB -100.0%
supplier.vortex 10.0 vortex-file-compressed 5.69 MB 0 B 5.69 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 1.92 GB (0.0%)
  • vortex-file-compressed: 2.45 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.016x ➖, 0↑ 2↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1973850 2000414 0.99
clickbench_q01/datafusion:vortex-file-compressed 22577214 22807289 0.99
clickbench_q02/datafusion:vortex-file-compressed 30730342 31109631 0.99
clickbench_q03/datafusion:vortex-file-compressed 33729702 33420161 1.01
clickbench_q04/datafusion:vortex-file-compressed 168766497 165086997 1.02
clickbench_q05/datafusion:vortex-file-compressed 225913337 228185454 0.99
clickbench_q06/datafusion:vortex-file-compressed 2010354 1997504 1.01
clickbench_q07/datafusion:vortex-file-compressed 26532371 25923555 1.02
clickbench_q08/datafusion:vortex-file-compressed 226912900 228409801 0.99
clickbench_q09/datafusion:vortex-file-compressed 342699455 349509047 0.98
clickbench_q10/datafusion:vortex-file-compressed 58658267 59449079 0.99
clickbench_q11/datafusion:vortex-file-compressed 67125593 65426897 1.03
clickbench_q12/datafusion:vortex-file-compressed 199058921 203397634 0.98
clickbench_q13/datafusion:vortex-file-compressed 334475598 337574769 0.99
clickbench_q14/datafusion:vortex-file-compressed 206010751 204253865 1.01
clickbench_q15/datafusion:vortex-file-compressed 197160069 192391636 1.02
clickbench_q16/datafusion:vortex-file-compressed 491264361 470084639 1.05
clickbench_q17/datafusion:vortex-file-compressed 472574935 483662443 0.98
clickbench_q18/datafusion:vortex-file-compressed 917863906 949680404 0.97
clickbench_q19/datafusion:vortex-file-compressed 🚨 43174789 27104504 1.59
clickbench_q20/datafusion:vortex-file-compressed 207770327 206234973 1.01
clickbench_q21/datafusion:vortex-file-compressed 277557740 273038767 1.02
clickbench_q22/datafusion:vortex-file-compressed 336454962 338946368 0.99
clickbench_q23/datafusion:vortex-file-compressed 418296377 411056449 1.02
clickbench_q24/datafusion:vortex-file-compressed 37607289 38431013 0.98
clickbench_q25/datafusion:vortex-file-compressed 60839635 66028884 0.92
clickbench_q26/datafusion:vortex-file-compressed 37683802 39204828 0.96
clickbench_q27/datafusion:vortex-file-compressed 286619426 291038986 0.98
clickbench_q28/datafusion:vortex-file-compressed 1471594974 1475856128 1.00
clickbench_q29/datafusion:vortex-file-compressed 🚨 60801350 52004089 1.17
clickbench_q30/datafusion:vortex-file-compressed 184611386 174368585 1.06
clickbench_q31/datafusion:vortex-file-compressed 206096499 208315956 0.99
clickbench_q32/datafusion:vortex-file-compressed 832128875 838483498 0.99
clickbench_q33/datafusion:vortex-file-compressed 1007135804 987273420 1.02
clickbench_q34/datafusion:vortex-file-compressed 1007115105 996033685 1.01
clickbench_q35/datafusion:vortex-file-compressed 180292706 171366998 1.05
clickbench_q36/datafusion:vortex-file-compressed 59943218 58967312 1.02
clickbench_q37/datafusion:vortex-file-compressed 29567733 29042273 1.02
clickbench_q38/datafusion:vortex-file-compressed 16915510 17006240 0.99
clickbench_q39/datafusion:vortex-file-compressed 125445927 132651624 0.95
clickbench_q40/datafusion:vortex-file-compressed 14943874 14277643 1.05
clickbench_q41/datafusion:vortex-file-compressed 14678690 13965986 1.05
clickbench_q42/datafusion:vortex-file-compressed 14123702 14065014 1.00
datafusion / parquet / ns (1.004x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1938844 2027815 0.96
clickbench_q01/datafusion:parquet 17812996 17915870 0.99
clickbench_q02/datafusion:parquet 32268537 30431175 1.06
clickbench_q03/datafusion:parquet 25906313 27076013 0.96
clickbench_q04/datafusion:parquet 175321543 171864502 1.02
clickbench_q05/datafusion:parquet 237114376 237812595 1.00
clickbench_q06/datafusion:parquet 1960363 1959585 1.00
clickbench_q07/datafusion:parquet 18614614 18145586 1.03
clickbench_q08/datafusion:parquet 233614735 227866554 1.03
clickbench_q09/datafusion:parquet 374143504 380051845 0.98
clickbench_q10/datafusion:parquet 73263938 71549231 1.02
clickbench_q11/datafusion:parquet 93067169 92907574 1.00
clickbench_q12/datafusion:parquet 247309834 241739928 1.02
clickbench_q13/datafusion:parquet 392885744 402699770 0.98
clickbench_q14/datafusion:parquet 256573046 252709741 1.02
clickbench_q15/datafusion:parquet 194751116 196772203 0.99
clickbench_q16/datafusion:parquet 489763162 479222045 1.02
clickbench_q17/datafusion:parquet 477206367 488235515 0.98
clickbench_q18/datafusion:parquet 933547758 935203270 1.00
clickbench_q19/datafusion:parquet 🚨 26541515 23624874 1.12
clickbench_q20/datafusion:parquet 465237712 455742914 1.02
clickbench_q21/datafusion:parquet 494574141 498049535 0.99
clickbench_q22/datafusion:parquet 655352388 653310362 1.00
clickbench_q23/datafusion:parquet 2873976671 2883122169 1.00
clickbench_q24/datafusion:parquet 52083455 50845832 1.02
clickbench_q25/datafusion:parquet 95075672 98863567 0.96
clickbench_q26/datafusion:parquet 48092620 49608202 0.97
clickbench_q27/datafusion:parquet 547826124 543258394 1.01
clickbench_q28/datafusion:parquet 1516795912 1524312069 1.00
clickbench_q29/datafusion:parquet 42223855 42784360 0.99
clickbench_q30/datafusion:parquet 242359829 243951741 0.99
clickbench_q31/datafusion:parquet 275461477 274084489 1.01
clickbench_q32/datafusion:parquet 840149767 852136541 0.99
clickbench_q33/datafusion:parquet 1086547064 1081496480 1.00
clickbench_q34/datafusion:parquet 1077661371 1093329224 0.99
clickbench_q35/datafusion:parquet 170456205 182971766 0.93
clickbench_q36/datafusion:parquet 121041158 121417459 1.00
clickbench_q37/datafusion:parquet 50334846 48308058 1.04
clickbench_q38/datafusion:parquet 75182054 69295486 1.08
clickbench_q39/datafusion:parquet 232854616 229679166 1.01
clickbench_q40/datafusion:parquet 26262052 25518039 1.03
clickbench_q41/datafusion:parquet 24030271 24975862 0.96
clickbench_q42/datafusion:parquet 26991978 26623519 1.01
duckdb / vortex-file-compressed / ns (1.005x ➖, 1↑ 3↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 11372656 12461143 0.91
clickbench_q01/duckdb:vortex-file-compressed 20384683 20834733 0.98
clickbench_q02/duckdb:vortex-file-compressed 19032203 20166290 0.94
clickbench_q03/duckdb:vortex-file-compressed 33582546 33563685 1.00
clickbench_q04/duckdb:vortex-file-compressed 130646502 130642866 1.00
clickbench_q05/duckdb:vortex-file-compressed 165795658 159899576 1.04
clickbench_q06/duckdb:vortex-file-compressed 🚨 20120510 17886761 1.12
clickbench_q07/duckdb:vortex-file-compressed 23186459 23315030 0.99
clickbench_q08/duckdb:vortex-file-compressed 167400930 165230061 1.01
clickbench_q09/duckdb:vortex-file-compressed 204170113 207730276 0.98
clickbench_q10/duckdb:vortex-file-compressed 69072702 65559437 1.05
clickbench_q11/duckdb:vortex-file-compressed 69497108 66649408 1.04
clickbench_q12/duckdb:vortex-file-compressed 189873405 197769346 0.96
clickbench_q13/duckdb:vortex-file-compressed 331170171 341187057 0.97
clickbench_q14/duckdb:vortex-file-compressed 209651022 209797457 1.00
clickbench_q15/duckdb:vortex-file-compressed 185847722 184110843 1.01
clickbench_q16/duckdb:vortex-file-compressed 388645082 390924661 0.99
clickbench_q17/duckdb:vortex-file-compressed 373352088 380569467 0.98
clickbench_q18/duckdb:vortex-file-compressed 737508369 732550994 1.01
clickbench_q19/duckdb:vortex-file-compressed 26521824 28461258 0.93
clickbench_q20/duckdb:vortex-file-compressed 247880137 236613025 1.05
clickbench_q21/duckdb:vortex-file-compressed 334648119 349873771 0.96
clickbench_q22/duckdb:vortex-file-compressed 532485600 494972991 1.08
clickbench_q23/duckdb:vortex-file-compressed 215104929 219971800 0.98
clickbench_q24/duckdb:vortex-file-compressed 🚨 65851842 52224872 1.26
clickbench_q25/duckdb:vortex-file-compressed 81678423 74308203 1.10
clickbench_q26/duckdb:vortex-file-compressed 74478473 74201107 1.00
clickbench_q27/duckdb:vortex-file-compressed 194410618 190055277 1.02
clickbench_q28/duckdb:vortex-file-compressed 🚀 1269113129 1694641918 0.75
clickbench_q29/duckdb:vortex-file-compressed 27746872 30321432 0.92
clickbench_q30/duckdb:vortex-file-compressed 164556287 166886403 0.99
clickbench_q31/duckdb:vortex-file-compressed 309039994 299209690 1.03
clickbench_q32/duckdb:vortex-file-compressed 931593200 934442547 1.00
clickbench_q33/duckdb:vortex-file-compressed 1153087162 1128564188 1.02
clickbench_q34/duckdb:vortex-file-compressed 1131193485 1181305761 0.96
clickbench_q35/duckdb:vortex-file-compressed 210241512 207052321 1.02
clickbench_q36/duckdb:vortex-file-compressed 39681028 38795745 1.02
clickbench_q37/duckdb:vortex-file-compressed 30824240 29712577 1.04
clickbench_q38/duckdb:vortex-file-compressed 33760768 32290349 1.05
clickbench_q39/duckdb:vortex-file-compressed 🚨 56362439 49609631 1.14
clickbench_q40/duckdb:vortex-file-compressed 29891296 30162349 0.99
clickbench_q41/duckdb:vortex-file-compressed 29246019 29968152 0.98
clickbench_q42/duckdb:vortex-file-compressed 29664814 27891783 1.06
duckdb / parquet / ns (1.000x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 16759205 15037577 1.11
clickbench_q01/duckdb:parquet 15205290 16471643 0.92
clickbench_q02/duckdb:parquet 23727857 24735928 0.96
clickbench_q03/duckdb:parquet 26596035 26262399 1.01
clickbench_q04/duckdb:parquet 128874564 130556636 0.99
clickbench_q05/duckdb:parquet 198077812 184908613 1.07
clickbench_q06/duckdb:parquet 24567412 22495750 1.09
clickbench_q07/duckdb:parquet 19254477 19211832 1.00
clickbench_q08/duckdb:parquet 162778845 161781970 1.01
clickbench_q09/duckdb:parquet 230471350 229707632 1.00
clickbench_q10/duckdb:parquet 58178337 56634731 1.03
clickbench_q11/duckdb:parquet 68084040 66975849 1.02
clickbench_q12/duckdb:parquet 176447673 175620716 1.00
clickbench_q13/duckdb:parquet 311088642 306844042 1.01
clickbench_q14/duckdb:parquet 191152791 188475292 1.01
clickbench_q15/duckdb:parquet 186689326 183632855 1.02
clickbench_q16/duckdb:parquet 359737093 363097691 0.99
clickbench_q17/duckdb:parquet 357797853 357958311 1.00
clickbench_q18/duckdb:parquet 688447391 687857130 1.00
clickbench_q19/duckdb:parquet 20658337 21495168 0.96
clickbench_q20/duckdb:parquet 262704493 260501888 1.01
clickbench_q21/duckdb:parquet 317495335 318543556 1.00
clickbench_q22/duckdb:parquet 484118572 485858154 1.00
clickbench_q23/duckdb:parquet 240149443 248674081 0.97
clickbench_q24/duckdb:parquet 66849546 73646057 0.91
clickbench_q25/duckdb:parquet 72771488 73005595 1.00
clickbench_q26/duckdb:parquet 47237266 48586152 0.97
clickbench_q27/duckdb:parquet 270721503 270788760 1.00
clickbench_q28/duckdb:parquet 1730186385 1710597412 1.01
clickbench_q29/duckdb:parquet 25560566 26704542 0.96
clickbench_q30/duckdb:parquet 175976395 177263394 0.99
clickbench_q31/duckdb:parquet 310549548 310740898 1.00
clickbench_q32/duckdb:parquet 916819222 910720185 1.01
clickbench_q33/duckdb:parquet 778300538 777419025 1.00
clickbench_q34/duckdb:parquet 802844098 786484167 1.02
clickbench_q35/duckdb:parquet 209002301 206361818 1.01
clickbench_q36/duckdb:parquet 51519820 50424940 1.02
clickbench_q37/duckdb:parquet 36132668 39031254 0.93
clickbench_q38/duckdb:parquet 38043894 37425325 1.02
clickbench_q39/duckdb:parquet 86352188 88598231 0.97
clickbench_q40/duckdb:parquet 21669780 20962266 1.03
clickbench_q41/duckdb:parquet 20650198 20378518 1.01
clickbench_q42/duckdb:parquet 23416077 23570374 0.99

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.58 MB 0 B 58.58 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.59 MB 0 B 73.59 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.74 MB 0 B 91.74 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.9%
Engines: DataFusion No clear signal (-14.5%, environment too noisy confidence) · DuckDB No clear signal (-5.0%, low confidence)
Vortex (geomean): 1.037x ➖
Parquet (geomean): 1.150x ➖
Shifts: Parquet (control) +15.0% · Median polish +7.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.125x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36513190 32116773 1.14
fineweb_q01/datafusion:vortex-file-compressed 494313363 461305306 1.07
fineweb_q02/datafusion:vortex-file-compressed 515497213 446440542 1.15
fineweb_q03/datafusion:vortex-file-compressed 608132035 615998838 0.99
fineweb_q04/datafusion:vortex-file-compressed 505053278 510051574 0.99
fineweb_q05/datafusion:vortex-file-compressed 478171392 482685291 0.99
fineweb_q06/datafusion:vortex-file-compressed 917631724 715521072 1.28
fineweb_q07/datafusion:vortex-file-compressed 789193329 638848476 1.24
fineweb_q08/datafusion:vortex-file-compressed 🚨 340969233 254349609 1.34
datafusion / parquet / ns (1.316x ❌, 0↑ 1↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 696276604 555441398 1.25
fineweb_q01/datafusion:parquet 978764610 1037727315 0.94
fineweb_q02/datafusion:parquet 1215650275 1044851709 1.16
fineweb_q03/datafusion:parquet 1217134352 992678456 1.23
fineweb_q04/datafusion:parquet 970714847 959863431 1.01
fineweb_q05/datafusion:parquet 1049758771 1039496265 1.01
fineweb_q06/datafusion:parquet 1091616088 933195753 1.17
fineweb_q07/datafusion:parquet 1075172497 1058848898 1.02
fineweb_q08/datafusion:parquet 🚨 5178581718 893710020 5.79
duckdb / vortex-file-compressed / ns (0.955x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 56092325 52111802 1.08
fineweb_q01/duckdb:vortex-file-compressed 608529482 819194373 0.74
fineweb_q02/duckdb:vortex-file-compressed 520917918 539446933 0.97
fineweb_q03/duckdb:vortex-file-compressed 1512438592 1538507321 0.98
fineweb_q04/duckdb:vortex-file-compressed 1886320435 1900401579 0.99
fineweb_q05/duckdb:vortex-file-compressed 1769930628 1747389437 1.01
fineweb_q06/duckdb:vortex-file-compressed 1762733904 1824053500 0.97
fineweb_q07/duckdb:vortex-file-compressed 1545554734 1676169336 0.92
fineweb_q08/duckdb:vortex-file-compressed 698266021 715251144 0.98
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 5268498505 5265733378 1.00
fineweb_q01/duckdb:parquet 5351049854 5288563092 1.01
fineweb_q02/duckdb:parquet 5332114299 5309157733 1.00
fineweb_q03/duckdb:parquet 5408208058 5366860568 1.01
fineweb_q04/duckdb:parquet 5325632182 5302942817 1.00
fineweb_q05/duckdb:parquet 5355248150 5332416288 1.00
fineweb_q06/duckdb:parquet 5476205819 5405559348 1.01
fineweb_q07/duckdb:parquet 5380546670 5334358818 1.01
fineweb_q08/duckdb:parquet 5261404001 5289731016 0.99

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-1.6%, low confidence) · DuckDB No clear signal (+1.2%, environment too noisy confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.998x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 28034750 28880637 0.97
tpcds_q02/datafusion:vortex-compact 56281405 56090606 1.00
tpcds_q03/datafusion:vortex-compact 17898337 17412380 1.03
tpcds_q04/datafusion:vortex-compact 256229168 257268874 1.00
tpcds_q05/datafusion:vortex-compact 66896082 64843000 1.03
tpcds_q06/datafusion:vortex-compact 30726071 30300017 1.01
tpcds_q07/datafusion:vortex-compact 57228195 56619386 1.01
tpcds_q08/datafusion:vortex-compact 42731567 42539664 1.00
tpcds_q09/datafusion:vortex-compact 44874299 45279048 0.99
tpcds_q10/datafusion:vortex-compact 54319918 55395808 0.98
tpcds_q11/datafusion:vortex-compact 136778551 136220934 1.00
tpcds_q12/datafusion:vortex-compact 25709790 26870798 0.96
tpcds_q13/datafusion:vortex-compact 131760832 133870426 0.98
tpcds_q14/datafusion:vortex-compact 232116161 236870827 0.98
tpcds_q15/datafusion:vortex-compact 33916652 33452079 1.01
tpcds_q16/datafusion:vortex-compact 33509080 32837988 1.02
tpcds_q17/datafusion:vortex-compact 109765676 108525904 1.01
tpcds_q18/datafusion:vortex-compact 102074229 100163337 1.02
tpcds_q19/datafusion:vortex-compact 31357054 31585183 0.99
tpcds_q20/datafusion:vortex-compact 27670938 27304001 1.01
tpcds_q21/datafusion:vortex-compact 36955639 36843448 1.00
tpcds_q22/datafusion:vortex-compact 122465189 112453281 1.09
tpcds_q23/datafusion:vortex-compact 141908979 139859297 1.01
tpcds_q24/datafusion:vortex-compact 115567274 119996448 0.96
tpcds_q25/datafusion:vortex-compact 83371986 84605414 0.99
tpcds_q26/datafusion:vortex-compact 50899927 49747631 1.02
tpcds_q27/datafusion:vortex-compact 117999030 116545892 1.01
tpcds_q28/datafusion:vortex-compact 64392698 64777580 0.99
tpcds_q29/datafusion:vortex-compact 84267951 81935918 1.03
tpcds_q30/datafusion:vortex-compact 33432567 32948318 1.01
tpcds_q31/datafusion:vortex-compact 104039264 104651856 0.99
tpcds_q32/datafusion:vortex-compact 23848085 24312281 0.98
tpcds_q33/datafusion:vortex-compact 39998638 40880057 0.98
tpcds_q34/datafusion:vortex-compact 38678632 39396855 0.98
tpcds_q35/datafusion:vortex-compact 60245504 59944740 1.01
tpcds_q36/datafusion:vortex-compact 75192118 74418382 1.01
tpcds_q37/datafusion:vortex-compact 25462000 26098791 0.98
tpcds_q38/datafusion:vortex-compact 52201036 50857847 1.03
tpcds_q39/datafusion:vortex-compact 104810479 104331062 1.00
tpcds_q40/datafusion:vortex-compact 36366671 36226166 1.00
tpcds_q41/datafusion:vortex-compact 27970644 27786602 1.01
tpcds_q42/datafusion:vortex-compact 17778426 18199867 0.98
tpcds_q43/datafusion:vortex-compact 24202701 23875459 1.01
tpcds_q44/datafusion:vortex-compact 48841632 48830489 1.00
tpcds_q45/datafusion:vortex-compact 37316110 37983487 0.98
tpcds_q46/datafusion:vortex-compact 48072224 47946828 1.00
tpcds_q47/datafusion:vortex-compact 141377867 141768016 1.00
tpcds_q48/datafusion:vortex-compact 92207917 99064136 0.93
tpcds_q49/datafusion:vortex-compact 86856811 86270441 1.01
tpcds_q50/datafusion:vortex-compact 58517245 53834577 1.09
tpcds_q51/datafusion:vortex-compact 82410048 83078250 0.99
tpcds_q52/datafusion:vortex-compact 18995159 18596176 1.02
tpcds_q53/datafusion:vortex-compact 29961563 30227781 0.99
tpcds_q54/datafusion:vortex-compact 47179257 46674925 1.01
tpcds_q55/datafusion:vortex-compact 18288890 17943474 1.02
tpcds_q56/datafusion:vortex-compact 40162671 40121119 1.00
tpcds_q57/datafusion:vortex-compact 116130509 116919132 0.99
tpcds_q58/datafusion:vortex-compact 70028042 70174720 1.00
tpcds_q59/datafusion:vortex-compact 64311100 64983521 0.99
tpcds_q60/datafusion:vortex-compact 39992215 40153387 1.00
tpcds_q61/datafusion:vortex-compact 48340461 51007946 0.95
tpcds_q62/datafusion:vortex-compact 27240114 27310259 1.00
tpcds_q63/datafusion:vortex-compact 30527981 30176677 1.01
tpcds_q64/datafusion:vortex-compact 526304624 522819979 1.01
tpcds_q65/datafusion:vortex-compact 84999200 85594401 0.99
tpcds_q66/datafusion:vortex-compact 85306926 84086555 1.01
tpcds_q67/datafusion:vortex-compact 120646552 120104055 1.00
tpcds_q68/datafusion:vortex-compact 51012989 47990510 1.06
tpcds_q69/datafusion:vortex-compact 52739778 52317316 1.01
tpcds_q70/datafusion:vortex-compact 117801224 119977801 0.98
tpcds_q71/datafusion:vortex-compact 30783845 31272132 0.98
tpcds_q72/datafusion:vortex-compact 1496175684 1489003484 1.00
tpcds_q73/datafusion:vortex-compact 35879332 35016070 1.02
tpcds_q74/datafusion:vortex-compact 93027101 89935437 1.03
tpcds_q75/datafusion:vortex-compact 🚀 153532911 172594035 0.89
tpcds_q76/datafusion:vortex-compact 47913063 48196362 0.99
tpcds_q77/datafusion:vortex-compact 50295049 51469877 0.98
tpcds_q78/datafusion:vortex-compact 121356307 125108798 0.97
tpcds_q79/datafusion:vortex-compact 40656606 40382449 1.01
tpcds_q80/datafusion:vortex-compact 106661580 109735228 0.97
tpcds_q81/datafusion:vortex-compact 32212067 33587558 0.96
tpcds_q82/datafusion:vortex-compact 27547896 28047978 0.98
tpcds_q83/datafusion:vortex-compact 42992758 43185129 1.00
tpcds_q84/datafusion:vortex-compact 14856871 14447691 1.03
tpcds_q85/datafusion:vortex-compact 161880236 167593400 0.97
tpcds_q86/datafusion:vortex-compact 21560554 22125107 0.97
tpcds_q87/datafusion:vortex-compact 51942895 54034050 0.96
tpcds_q88/datafusion:vortex-compact 82485992 83397644 0.99
tpcds_q89/datafusion:vortex-compact 32788103 33429939 0.98
tpcds_q90/datafusion:vortex-compact 17155232 16926165 1.01
tpcds_q91/datafusion:vortex-compact 40671061 41501589 0.98
tpcds_q92/datafusion:vortex-compact 21410755 21100817 1.01
tpcds_q93/datafusion:vortex-compact 38609595 39078637 0.99
tpcds_q94/datafusion:vortex-compact 28709938 29670316 0.97
tpcds_q95/datafusion:vortex-compact 69343269 69402009 1.00
tpcds_q96/datafusion:vortex-compact 18872821 18202889 1.04
tpcds_q97/datafusion:vortex-compact 36864355 37004806 1.00
tpcds_q98/datafusion:vortex-compact 31140594 31926623 0.98
tpcds_q99/datafusion:vortex-compact 32465094 31719601 1.02
datafusion / parquet / ns (1.015x ➖, 0↑ 6↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 32246948 30790414 1.05
tpcds_q02/datafusion:parquet 52283252 53490797 0.98
tpcds_q03/datafusion:parquet 17564777 17555522 1.00
tpcds_q04/datafusion:parquet 365447395 337867899 1.08
tpcds_q05/datafusion:parquet 82349769 79386104 1.04
tpcds_q06/datafusion:parquet 31861887 30810958 1.03
tpcds_q07/datafusion:parquet 98673086 98369830 1.00
tpcds_q08/datafusion:parquet 38247191 39073984 0.98
tpcds_q09/datafusion:parquet 37654795 36148161 1.04
tpcds_q10/datafusion:parquet 90225334 89237158 1.01
tpcds_q11/datafusion:parquet 173576862 165315579 1.05
tpcds_q12/datafusion:parquet 23711671 25172739 0.94
tpcds_q13/datafusion:parquet 97484879 96759405 1.01
tpcds_q14/datafusion:parquet 280857278 286545554 0.98
tpcds_q15/datafusion:parquet 36982495 39207806 0.94
tpcds_q16/datafusion:parquet 49716874 47912236 1.04
tpcds_q17/datafusion:parquet 110468124 108373588 1.02
tpcds_q18/datafusion:parquet 131365355 135896070 0.97
tpcds_q19/datafusion:parquet 29539567 29177096 1.01
tpcds_q20/datafusion:parquet 23918939 24210207 0.99
tpcds_q21/datafusion:parquet 22035956 22477960 0.98
tpcds_q22/datafusion:parquet 🚨 141144470 124894168 1.13
tpcds_q23/datafusion:parquet 174560600 173587900 1.01
tpcds_q24/datafusion:parquet 140040460 135770820 1.03
tpcds_q25/datafusion:parquet 107033826 107250465 1.00
tpcds_q26/datafusion:parquet 91286373 83726880 1.09
tpcds_q27/datafusion:parquet 160582993 162341904 0.99
tpcds_q28/datafusion:parquet 41087178 41009276 1.00
tpcds_q29/datafusion:parquet 107992243 108409454 1.00
tpcds_q30/datafusion:parquet 44241186 43428380 1.02
tpcds_q31/datafusion:parquet 94527787 92576539 1.02
tpcds_q32/datafusion:parquet 24433673 24099050 1.01
tpcds_q33/datafusion:parquet 37006131 35269373 1.05
tpcds_q34/datafusion:parquet 29281481 29825406 0.98
tpcds_q35/datafusion:parquet 93115019 91645344 1.02
tpcds_q36/datafusion:parquet 70819075 67758296 1.05
tpcds_q37/datafusion:parquet 24593091 25014147 0.98
tpcds_q38/datafusion:parquet 58101917 57423058 1.01
tpcds_q39/datafusion:parquet 82758950 81035529 1.02
tpcds_q40/datafusion:parquet 34632291 34207800 1.01
tpcds_q41/datafusion:parquet 19241338 19041368 1.01
tpcds_q42/datafusion:parquet 16823810 16636290 1.01
tpcds_q43/datafusion:parquet 22733365 23093650 0.98
tpcds_q44/datafusion:parquet 41108396 41714750 0.99
tpcds_q45/datafusion:parquet 45504197 46610887 0.98
tpcds_q46/datafusion:parquet 42853343 41032623 1.04
tpcds_q47/datafusion:parquet 151355414 150096422 1.01
tpcds_q48/datafusion:parquet 87809555 87153104 1.01
tpcds_q49/datafusion:parquet 🚨 83850132 74697481 1.12
tpcds_q50/datafusion:parquet 71025135 71089251 1.00
tpcds_q51/datafusion:parquet 85052063 85587087 0.99
tpcds_q52/datafusion:parquet 16799451 16638711 1.01
tpcds_q53/datafusion:parquet 25431243 25018014 1.02
tpcds_q54/datafusion:parquet 45971332 45945008 1.00
tpcds_q55/datafusion:parquet 17007289 16635519 1.02
tpcds_q56/datafusion:parquet 36090818 37701611 0.96
tpcds_q57/datafusion:parquet 123443645 129970225 0.95
tpcds_q58/datafusion:parquet 79993118 84990855 0.94
tpcds_q59/datafusion:parquet 74709832 77097022 0.97
tpcds_q60/datafusion:parquet 36455112 36414349 1.00
tpcds_q61/datafusion:parquet 43904290 45317328 0.97
tpcds_q62/datafusion:parquet 🚨 33269377 28733450 1.16
tpcds_q63/datafusion:parquet 25106753 25032662 1.00
tpcds_q64/datafusion:parquet 376253775 369853011 1.02
tpcds_q65/datafusion:parquet 49156355 50812757 0.97
tpcds_q66/datafusion:parquet 81030997 88206398 0.92
tpcds_q67/datafusion:parquet 139422757 138211859 1.01
tpcds_q68/datafusion:parquet 40034385 39882843 1.00
tpcds_q69/datafusion:parquet 87261650 86620597 1.01
tpcds_q70/datafusion:parquet 43810877 45260969 0.97
tpcds_q71/datafusion:parquet 26898214 25971853 1.04
tpcds_q72/datafusion:parquet 450604748 448671931 1.00
tpcds_q73/datafusion:parquet 29659252 27873508 1.06
tpcds_q74/datafusion:parquet 102552796 97371194 1.05
tpcds_q75/datafusion:parquet 168463908 172156893 0.98
tpcds_q76/datafusion:parquet 62479561 60036302 1.04
tpcds_q77/datafusion:parquet 57447676 56354769 1.02
tpcds_q78/datafusion:parquet 128320179 123466455 1.04
tpcds_q79/datafusion:parquet 34284928 34638139 0.99
tpcds_q80/datafusion:parquet 95681379 94915573 1.01
tpcds_q81/datafusion:parquet 🚨 48334580 39336351 1.23
tpcds_q82/datafusion:parquet 23284999 23347709 1.00
tpcds_q83/datafusion:parquet 58435717 55674992 1.05
tpcds_q84/datafusion:parquet 47660081 48458085 0.98
tpcds_q85/datafusion:parquet 198801762 200105419 0.99
tpcds_q86/datafusion:parquet 🚨 23099593 20906007 1.10
tpcds_q87/datafusion:parquet 61792452 60673357 1.02
tpcds_q88/datafusion:parquet 58686997 59634551 0.98
tpcds_q89/datafusion:parquet 30120083 29850095 1.01
tpcds_q90/datafusion:parquet 20891900 19554690 1.07
tpcds_q91/datafusion:parquet 67346321 66111285 1.02
tpcds_q92/datafusion:parquet 25336497 25616637 0.99
tpcds_q93/datafusion:parquet 38664295 38380817 1.01
tpcds_q94/datafusion:parquet 30082755 30059030 1.00
tpcds_q95/datafusion:parquet 87120267 88074982 0.99
tpcds_q96/datafusion:parquet 16993100 16847817 1.01
tpcds_q97/datafusion:parquet 42058991 40593131 1.04
tpcds_q98/datafusion:parquet 27193352 26181510 1.04
tpcds_q99/datafusion:parquet 🚨 41680537 34503920 1.21
duckdb / vortex-compact / ns (1.013x ➖, 1↑ 3↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 29739922 28671334 1.04
tpcds_q02/duckdb:vortex-compact 32799468 31305572 1.05
tpcds_q03/duckdb:vortex-compact 44846004 44516865 1.01
tpcds_q04/duckdb:vortex-compact 102417743 97325938 1.05
tpcds_q05/duckdb:vortex-compact 49603392 47635181 1.04
tpcds_q06/duckdb:vortex-compact 61125122 63493471 0.96
tpcds_q07/duckdb:vortex-compact 53744755 50718567 1.06
tpcds_q08/duckdb:vortex-compact 95896676 97593197 0.98
tpcds_q09/duckdb:vortex-compact 23920348 24845968 0.96
tpcds_q10/duckdb:vortex-compact 88125778 91743334 0.96
tpcds_q11/duckdb:vortex-compact 80762404 80950094 1.00
tpcds_q12/duckdb:vortex-compact 24757305 23421360 1.06
tpcds_q13/duckdb:vortex-compact 75155629 73577996 1.02
tpcds_q14/duckdb:vortex-compact 133092490 131593152 1.01
tpcds_q15/duckdb:vortex-compact 41832268 41529097 1.01
tpcds_q16/duckdb:vortex-compact 45027898 41912539 1.07
tpcds_q17/duckdb:vortex-compact 89809000 86131671 1.04
tpcds_q18/duckdb:vortex-compact 65994097 67711404 0.97
tpcds_q19/duckdb:vortex-compact 64275371 62996776 1.02
tpcds_q20/duckdb:vortex-compact 22007648 22514924 0.98
tpcds_q21/duckdb:vortex-compact 25099711 23402440 1.07
tpcds_q22/duckdb:vortex-compact 68418046 64281284 1.06
tpcds_q23/duckdb:vortex-compact 92983105 88987093 1.04
tpcds_q24/duckdb:vortex-compact 72148290 74620097 0.97
tpcds_q25/duckdb:vortex-compact 76575209 79021955 0.97
tpcds_q26/duckdb:vortex-compact 41028110 40454640 1.01
tpcds_q27/duckdb:vortex-compact 64459262 60802579 1.06
tpcds_q28/duckdb:vortex-compact 23240508 21898438 1.06
tpcds_q29/duckdb:vortex-compact 84655048 81300281 1.04
tpcds_q30/duckdb:vortex-compact 44998106 41585759 1.08
tpcds_q31/duckdb:vortex-compact 46719047 45070909 1.04
tpcds_q32/duckdb:vortex-compact 24910459 25779651 0.97
tpcds_q33/duckdb:vortex-compact 47239151 47008780 1.00
tpcds_q34/duckdb:vortex-compact 48204766 48984675 0.98
tpcds_q35/duckdb:vortex-compact 112358367 114450140 0.98
tpcds_q36/duckdb:vortex-compact 43541564 44543664 0.98
tpcds_q37/duckdb:vortex-compact 28291569 27917545 1.01
tpcds_q38/duckdb:vortex-compact 52156010 53895969 0.97
tpcds_q39/duckdb:vortex-compact 🚨 39180330 34480146 1.14
tpcds_q40/duckdb:vortex-compact 27287692 29286559 0.93
tpcds_q41/duckdb:vortex-compact 22427692 22302762 1.01
tpcds_q42/duckdb:vortex-compact 24467022 26054972 0.94
tpcds_q43/duckdb:vortex-compact 37277918 35565934 1.05
tpcds_q44/duckdb:vortex-compact 32247328 33205955 0.97
tpcds_q45/duckdb:vortex-compact 47445943 47443404 1.00
tpcds_q46/duckdb:vortex-compact 66050994 62834157 1.05
tpcds_q47/duckdb:vortex-compact 72754286 69551058 1.05
tpcds_q48/duckdb:vortex-compact 71088447 69736048 1.02
tpcds_q49/duckdb:vortex-compact 54904447 53890405 1.02
tpcds_q50/duckdb:vortex-compact 56119080 61116323 0.92
tpcds_q51/duckdb:vortex-compact 🚀 114327010 133850196 0.85
tpcds_q52/duckdb:vortex-compact 25696214 24200946 1.06
tpcds_q53/duckdb:vortex-compact 44176871 45022947 0.98
tpcds_q54/duckdb:vortex-compact 57262580 56176120 1.02
tpcds_q55/duckdb:vortex-compact 25341494 26481572 0.96
tpcds_q56/duckdb:vortex-compact 47023103 44735532 1.05
tpcds_q57/duckdb:vortex-compact 51777697 49507205 1.05
tpcds_q58/duckdb:vortex-compact 48250336 49531821 0.97
tpcds_q59/duckdb:vortex-compact 49455417 49791338 0.99
tpcds_q60/duckdb:vortex-compact 46819021 47668821 0.98
tpcds_q61/duckdb:vortex-compact 62352943 64299385 0.97
tpcds_q62/duckdb:vortex-compact 24327886 23587179 1.03
tpcds_q63/duckdb:vortex-compact 42002644 41665053 1.01
tpcds_q64/duckdb:vortex-compact 165135609 163085924 1.01
tpcds_q65/duckdb:vortex-compact 38252322 37849563 1.01
tpcds_q66/duckdb:vortex-compact 50048712 49026479 1.02
tpcds_q67/duckdb:vortex-compact 147165411 142308332 1.03
tpcds_q68/duckdb:vortex-compact 63138885 63912440 0.99
tpcds_q69/duckdb:vortex-compact 91182749 93233676 0.98
tpcds_q70/duckdb:vortex-compact 66835988 65519542 1.02
tpcds_q71/duckdb:vortex-compact 38757273 39696389 0.98
tpcds_q72/duckdb:vortex-compact 174798074 168198162 1.04
tpcds_q73/duckdb:vortex-compact 45707646 47697377 0.96
tpcds_q74/duckdb:vortex-compact 59710460 58783749 1.02
tpcds_q75/duckdb:vortex-compact 70013168 69282241 1.01
tpcds_q76/duckdb:vortex-compact 🚨 34303981 29303161 1.17
tpcds_q77/duckdb:vortex-compact 46501681 44425326 1.05
tpcds_q78/duckdb:vortex-compact 91454205 91697690 1.00
tpcds_q79/duckdb:vortex-compact 79095946 79110852 1.00
tpcds_q80/duckdb:vortex-compact 74158778 70899210 1.05
tpcds_q81/duckdb:vortex-compact 43835682 44334085 0.99
tpcds_q82/duckdb:vortex-compact 59209009 57329477 1.03
tpcds_q83/duckdb:vortex-compact 49374641 50421360 0.98
tpcds_q84/duckdb:vortex-compact 🚨 35694851 31923714 1.12
tpcds_q85/duckdb:vortex-compact 83283919 78712333 1.06
tpcds_q86/duckdb:vortex-compact 21586430 22874462 0.94
tpcds_q87/duckdb:vortex-compact 55447164 57933186 0.96
tpcds_q88/duckdb:vortex-compact 118571544 113461607 1.05
tpcds_q89/duckdb:vortex-compact 41939562 43027324 0.97
tpcds_q90/duckdb:vortex-compact 20758895 22690945 0.91
tpcds_q91/duckdb:vortex-compact 72065179 68223976 1.06
tpcds_q92/duckdb:vortex-compact 44993731 43592134 1.03
tpcds_q93/duckdb:vortex-compact 37531938 36017306 1.04
tpcds_q94/duckdb:vortex-compact 42069772 42469128 0.99
tpcds_q95/duckdb:vortex-compact 161642413 160290577 1.01
tpcds_q96/duckdb:vortex-compact 37744183 36357685 1.04
tpcds_q97/duckdb:vortex-compact 50027395 46089470 1.09
tpcds_q98/duckdb:vortex-compact 34250937 31808767 1.08
tpcds_q99/duckdb:vortex-compact 34345790 31278395 1.10
duckdb / parquet / ns (1.001x ➖, 3↑ 3↓)
name PR 6380aa5 (ns) base 3d37216 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 32142485 31618840 1.02
tpcds_q02/duckdb:parquet 22135715 21873083 1.01
tpcds_q03/duckdb:parquet 12315943 12313451 1.00
tpcds_q04/duckdb:parquet 197103518 197048763 1.00
tpcds_q05/duckdb:parquet 32684767 34083665 0.96
tpcds_q06/duckdb:parquet 35100246 35102592 1.00
tpcds_q07/duckdb:parquet 22977913 22471002 1.02
tpcds_q08/duckdb:parquet 32673996 33682683 0.97
tpcds_q09/duckdb:parquet 29962074 30373786 0.99
tpcds_q10/duckdb:parquet 43074891 41615993 1.04
tpcds_q11/duckdb:parquet 103890159 102142648 1.02
tpcds_q12/duckdb:parquet 17820014 17616675 1.01
tpcds_q13/duckdb:parquet 🚀 34290757 39662012 0.86
tpcds_q14/duckdb:parquet 103415959 104666851 0.99
tpcds_q15/duckdb:parquet 35527958 35373764 1.00
tpcds_q16/duckdb:parquet 27311466 27419641 1.00
tpcds_q17/duckdb:parquet 44823192 44601378 1.00
tpcds_q18/duckdb:parquet 56437796 56851493 0.99
tpcds_q19/duckdb:parquet 33503996 34260438 0.98
tpcds_q20/duckdb:parquet 19382471 18909662 1.03
tpcds_q21/duckdb:parquet 14047607 14315672 0.98
tpcds_q22/duckdb:parquet 62763896 66690154 0.94
tpcds_q23/duckdb:parquet 67630082 68111465 0.99
tpcds_q24/duckdb:parquet 48409257 50825486 0.95
tpcds_q25/duckdb:parquet 41948872 41655851 1.01
tpcds_q26/duckdb:parquet 43291729 44653770 0.97
tpcds_q27/duckdb:parquet 55213379 53726195 1.03
tpcds_q28/duckdb:parquet 29454605 28747592 1.02
tpcds_q29/duckdb:parquet 42269942 42643346 0.99
tpcds_q30/duckdb:parquet 45864328 42777656 1.07
tpcds_q31/duckdb:parquet 29813346 29434028 1.01
tpcds_q32/duckdb:parquet 15465269 15305141 1.01
tpcds_q33/duckdb:parquet 23728902 23443524 1.01
tpcds_q34/duckdb:parquet 🚨 25142606 21648657 1.16
tpcds_q35/duckdb:parquet 68539325 69475985 0.99
tpcds_q36/duckdb:parquet 22702111 21567697 1.05
tpcds_q37/duckdb:parquet 17606000 17831876 0.99
tpcds_q38/duckdb:parquet 41001836 40464722 1.01
tpcds_q39/duckdb:parquet 38854794 37488692 1.04
tpcds_q40/duckdb:parquet 22802437 22378819 1.02
tpcds_q41/duckdb:parquet 10487365 10427748 1.01
tpcds_q42/duckdb:parquet 11547294 11521575 1.00
tpcds_q43/duckdb:parquet 14552083 14579505 1.00
tpcds_q44/duckdb:parquet 24321314 24269400 1.00
tpcds_q45/duckdb:parquet 33005632 32048533 1.03
tpcds_q46/duckdb:parquet 51416082 50427098 1.02
tpcds_q47/duckdb:parquet 49608148 49830591 1.00
tpcds_q48/duckdb:parquet 🚨 35362920 30250215 1.17
tpcds_q49/duckdb:parquet 27978490 28464667 0.98
tpcds_q50/duckdb:parquet 🚨 29895204 24232701 1.23
tpcds_q51/duckdb:parquet 97382949 99166176 0.98
tpcds_q52/duckdb:parquet 13670192 13129461 1.04
tpcds_q53/duckdb:parquet 15781914 15961515 0.99
tpcds_q54/duckdb:parquet 29927316 29277849 1.02
tpcds_q55/duckdb:parquet 11585471 11709686 0.99
tpcds_q56/duckdb:parquet 23844173 25927129 0.92
tpcds_q57/duckdb:parquet 42555457 44912073 0.95
tpcds_q58/duckdb:parquet 26953112 26683914 1.01
tpcds_q59/duckdb:parquet 29420689 29675068 0.99
tpcds_q60/duckdb:parquet 25894646 26335418 0.98
tpcds_q61/duckdb:parquet 33842978 31346814 1.08
tpcds_q62/duckdb:parquet 15091445 14742245 1.02
tpcds_q63/duckdb:parquet 15325386 15907407 0.96
tpcds_q64/duckdb:parquet 83903047 80247821 1.05
tpcds_q65/duckdb:parquet 22004001 21667745 1.02
tpcds_q66/duckdb:parquet 34119110 34820876 0.98
tpcds_q67/duckdb:parquet 123945108 126640076 0.98
tpcds_q68/duckdb:parquet 43500145 39759692 1.09
tpcds_q69/duckdb:parquet 42770363 42317207 1.01
tpcds_q70/duckdb:parquet 27956903 28630415 0.98
tpcds_q71/duckdb:parquet 21510237 21382813 1.01
tpcds_q72/duckdb:parquet 🚀 121953012 178886319 0.68
tpcds_q73/duckdb:parquet 18606894 18493489 1.01
tpcds_q74/duckdb:parquet 145677218 144972468 1.00
tpcds_q75/duckdb:parquet 60740296 61446212 0.99
tpcds_q76/duckdb:parquet 19170803 19618529 0.98
tpcds_q77/duckdb:parquet 26050106 25404411 1.03
tpcds_q78/duckdb:parquet 78034694 77447563 1.01
tpcds_q79/duckdb:parquet 🚀 27599933 33099915 0.83
tpcds_q80/duckdb:parquet 51783912 48149786 1.08
tpcds_q81/duckdb:parquet 41087460 40762792 1.01
tpcds_q82/duckdb:parquet 20328796 19067968 1.07
tpcds_q83/duckdb:parquet 22168898 21914061 1.01
tpcds_q84/duckdb:parquet 23907147 23705580 1.01
tpcds_q85/duckdb:parquet 47319495 47192958 1.00
tpcds_q86/duckdb:parquet 14833156 14895698 1.00
tpcds_q87/duckdb:parquet 43122124 44871813 0.96
tpcds_q88/duckdb:parquet 42404461 43924010 0.97
tpcds_q89/duckdb:parquet 19847906 20260923 0.98
tpcds_q90/duckdb:parquet 10165730 9705908 1.05
tpcds_q91/duckdb:parquet 27870396 27818063 1.00
tpcds_q92/duckdb:parquet 15352322 15345724 1.00
tpcds_q93/duckdb:parquet 31390737 31387254 1.00
tpcds_q94/duckdb:parquet 21792795 21674485 1.01
tpcds_q95/duckdb:parquet 138451591 138713392 1.00
tpcds_q96/duckdb:parquet 10191826 10342215 0.99
tpcds_q97/duckdb:parquet 39062897 38581579 1.01
tpcds_q98/duckdb:parquet 21478990 21211107 1.01
tpcds_q99/duckdb:parquet 23554562 23671194 1.00

File Size Changes (25 files changed, -56.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-file-compressed 53.96 KB 0 B 53.96 KB -100.0%
catalog_page.vortex 1.0 vortex-file-compressed 569.12 KB 0 B 569.12 KB -100.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.16 MB 0 B 7.16 MB -100.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.44 MB 0 B 70.44 MB -100.0%
customer.vortex 1.0 vortex-file-compressed 4.20 MB 0 B 4.20 MB -100.0%
customer_address.vortex 1.0 vortex-file-compressed 837.77 KB 0 B 837.77 KB -100.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 0 B 1.49 MB -100.0%
date_dim.vortex 1.0 vortex-file-compressed 1.02 MB 0 B 1.02 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-file-compressed 16.76 KB 0 B 16.76 KB -100.0%
income_band.vortex 1.0 vortex-file-compressed 5.98 KB 0 B 5.98 KB -100.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 0 B 36.64 MB -100.0%
item.vortex 1.0 vortex-file-compressed 1.64 MB 0 B 1.64 MB -100.0%
promotion.vortex 1.0 vortex-file-compressed 60.16 KB 0 B 60.16 KB -100.0%
reason.vortex 1.0 vortex-file-compressed 7.86 KB 0 B 7.86 KB -100.0%
ship_mode.vortex 1.0 vortex-file-compressed 13.52 KB 0 B 13.52 KB -100.0%
store.vortex 1.0 vortex-file-compressed 49.45 KB 0 B 49.45 KB -100.0%
store_returns.vortex 1.0 vortex-file-compressed 10.97 MB 0 B 10.97 MB -100.0%
store_sales.vortex 1.0 vortex-file-compressed 96.33 MB 0 B 96.33 MB -100.0%
time_dim.vortex 1.0 vortex-file-compressed 408.34 KB 0 B 408.34 KB -100.0%
warehouse.vortex 1.0 vortex-file-compressed 24.30 KB 0 B 24.30 KB -100.0%
web_page.vortex 1.0 vortex-file-compressed 30.74 KB 0 B 30.74 KB -100.0%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 0 B 3.55 MB -100.0%
web_sales.vortex 1.0 vortex-file-compressed 34.20 MB 0 B 34.20 MB -100.0%
web_site.vortex 1.0 vortex-file-compressed 54.93 KB 0 B 54.93 KB -100.0%

Totals:

  • vortex-compact: 207.95 MB → 207.95 MB (0.0%)
  • vortex-file-compressed: 269.98 MB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 0.997x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-compact 101466897 102977104 0.99
appian_q02/datafusion:vortex-compact 470383248 469046770 1.00
appian_q03/datafusion:vortex-compact 284086508 286228530 0.99
appian_q04/datafusion:vortex-compact 13553964165 13522706633 1.00
appian_q05/datafusion:vortex-compact 227419918 222643969 1.02
appian_q06/datafusion:vortex-compact 279935452 277961905 1.01
appian_q07/datafusion:vortex-compact 355271592 355732698 1.00
appian_q08/datafusion:vortex-compact 1406878434 1407104073 1.00
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 133063466 133842587 0.99
appian_q02/datafusion:parquet 588380523 590704795 1.00
appian_q03/datafusion:parquet 302618685 306258661 0.99
appian_q04/datafusion:parquet 13696550933 13619749247 1.01
appian_q05/datafusion:parquet 311219535 311463994 1.00
appian_q06/datafusion:parquet 302342737 307187978 0.98
appian_q07/datafusion:parquet 434336974 442568419 0.98
appian_q08/datafusion:parquet 1523194378 1529735264 1.00
duckdb / vortex-compact / ns (0.994x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-compact 149074707 149583633 1.00
appian_q02/duckdb:vortex-compact 402833299 399574987 1.01
appian_q03/duckdb:vortex-compact 267866721 271089470 0.99
appian_q04/duckdb:vortex-compact 1598837833 1593779331 1.00
appian_q05/duckdb:vortex-compact 244831980 250653465 0.98
appian_q06/duckdb:vortex-compact 1029550676 1033029569 1.00
appian_q07/duckdb:vortex-compact 288661761 299593524 0.96
appian_q08/duckdb:vortex-compact 923045765 907258016 1.02
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 156558231 156994795 1.00
appian_q02/duckdb:parquet 361346657 362514866 1.00
appian_q03/duckdb:parquet 220439282 221158551 1.00
appian_q04/duckdb:parquet 1479788937 1466803065 1.01
appian_q05/duckdb:parquet 244659024 242713152 1.01
appian_q06/duckdb:parquet 964919741 961938780 1.00
appian_q07/duckdb:parquet 267436761 264066384 1.01
appian_q08/duckdb:parquet 783365368 780631173 1.00

File Size Changes (10 files changed, -63.8% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
addressview.vortex 1.0 vortex-file-compressed 34.61 MB 0 B 34.61 MB -100.0%
categoryview.vortex 1.0 vortex-file-compressed 19.89 KB 0 B 19.89 KB -100.0%
creditcardview.vortex 1.0 vortex-file-compressed 59.15 MB 0 B 59.15 MB -100.0%
customerview.vortex 1.0 vortex-file-compressed 19.98 MB 0 B 19.98 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
orderitemnovelty_update.vortex 1.0 vortex-file-compressed 11.92 KB 0 B 11.92 KB -100.0%
orderitemview.vortex 1.0 vortex-file-compressed 265.21 MB 0 B 265.21 MB -100.0%
orderview.vortex 1.0 vortex-file-compressed 78.51 MB 0 B 78.51 MB -100.0%
productview.vortex 1.0 vortex-file-compressed 19.76 KB 0 B 19.76 KB -100.0%
taxrecordview.vortex 1.0 vortex-file-compressed 21.91 MB 0 B 21.91 MB -100.0%

Totals:

  • vortex-compact: 271.91 MB → 271.91 MB (0.0%)
  • vortex-file-compressed: 479.69 MB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+4.0%, environment too noisy confidence)
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 3↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28278693 28493960 0.99
tpcds_q02/datafusion:vortex-file-compressed 49345095 49522704 1.00
tpcds_q03/datafusion:vortex-file-compressed 14737285 14592125 1.01
tpcds_q04/datafusion:vortex-file-compressed 217192727 231201695 0.94
tpcds_q05/datafusion:vortex-file-compressed 64459311 66115606 0.97
tpcds_q06/datafusion:vortex-file-compressed 26580138 27086802 0.98
tpcds_q07/datafusion:vortex-file-compressed 42102040 42245271 1.00
tpcds_q08/datafusion:vortex-file-compressed 34025796 33907184 1.00
tpcds_q09/datafusion:vortex-file-compressed 30327651 29783167 1.02
tpcds_q10/datafusion:vortex-file-compressed 38232078 37686138 1.01
tpcds_q11/datafusion:vortex-file-compressed 118479416 118430518 1.00
tpcds_q12/datafusion:vortex-file-compressed 21136060 21141251 1.00
tpcds_q13/datafusion:vortex-file-compressed 48428150 47262718 1.02
tpcds_q14/datafusion:vortex-file-compressed 209319779 213704843 0.98
tpcds_q15/datafusion:vortex-file-compressed 29477695 29391511 1.00
tpcds_q16/datafusion:vortex-file-compressed 25492372 25822608 0.99
tpcds_q17/datafusion:vortex-file-compressed 73863257 73631963 1.00
tpcds_q18/datafusion:vortex-file-compressed 89184667 89281996 1.00
tpcds_q19/datafusion:vortex-file-compressed 22594207 22134578 1.02
tpcds_q20/datafusion:vortex-file-compressed 25676409 25584815 1.00
tpcds_q21/datafusion:vortex-file-compressed 34204140 36381686 0.94
tpcds_q22/datafusion:vortex-file-compressed 🚨 125860547 104896885 1.20
tpcds_q23/datafusion:vortex-file-compressed 133090761 133282347 1.00
tpcds_q24/datafusion:vortex-file-compressed 95387572 98125673 0.97
tpcds_q25/datafusion:vortex-file-compressed 72278045 75471402 0.96
tpcds_q26/datafusion:vortex-file-compressed 38355625 38410214 1.00
tpcds_q27/datafusion:vortex-file-compressed 96691372 96615318 1.00
tpcds_q28/datafusion:vortex-file-compressed 32984346 31810156 1.04
tpcds_q29/datafusion:vortex-file-compressed 71594395 69238529 1.03
tpcds_q30/datafusion:vortex-file-compressed 28948014 28823702 1.00
tpcds_q31/datafusion:vortex-file-compressed 81227486 80424305 1.01
tpcds_q32/datafusion:vortex-file-compressed 20003889 19611852 1.02
tpcds_q33/datafusion:vortex-file-compressed 33527046 33893499 0.99
tpcds_q34/datafusion:vortex-file-compressed 26336868 26144455 1.01
tpcds_q35/datafusion:vortex-file-compressed 46436588 48885264 0.95
tpcds_q36/datafusion:vortex-file-compressed 65052882 64862924 1.00
tpcds_q37/datafusion:vortex-file-compressed 🚨 21045311 18881275 1.11
tpcds_q38/datafusion:vortex-file-compressed 42110899 45079250 0.93
tpcds_q39/datafusion:vortex-file-compressed 104292371 101438289 1.03
tpcds_q40/datafusion:vortex-file-compressed 33875556 33631881 1.01
tpcds_q41/datafusion:vortex-file-compressed 24528502 24899293 0.99
tpcds_q42/datafusion:vortex-file-compressed 14388229 14550645 0.99
tpcds_q43/datafusion:vortex-file-compressed 18889740 19065352 0.99
tpcds_q44/datafusion:vortex-file-compressed 35004408 35509626 0.99
tpcds_q45/datafusion:vortex-file-compressed 34250074 33826028 1.01
tpcds_q46/datafusion:vortex-file-compressed 35799773 36742963 0.97
tpcds_q47/datafusion:vortex-file-compressed 128470961 129183783 0.99
tpcds_q48/datafusion:vortex-file-compressed 41119612 41133468 1.00
tpcds_q49/datafusion:vortex-file-compressed 72554591 75055321 0.97
tpcds_q50/datafusion:vortex-file-compressed 48053798 45536104 1.06
tpcds_q51/datafusion:vortex-file-compressed 78328088 76772397 1.02
tpcds_q52/datafusion:vortex-file-compressed 15161100 14804068 1.02
tpcds_q53/datafusion:vortex-file-compressed 25293903 24974284 1.01
tpcds_q54/datafusion:vortex-file-compressed 38987834 39427108 0.99
tpcds_q55/datafusion:vortex-file-compressed 14721461 14559839 1.01
tpcds_q56/datafusion:vortex-file-compressed 35376828 35551066 1.00
tpcds_q57/datafusion:vortex-file-compressed 104676312 102656261 1.02
tpcds_q58/datafusion:vortex-file-compressed 64335917 65210189 0.99
tpcds_q59/datafusion:vortex-file-compressed 53291299 53700550 0.99
tpcds_q60/datafusion:vortex-file-compressed 34340174 33618103 1.02
tpcds_q61/datafusion:vortex-file-compressed 37570867 37257169 1.01
tpcds_q62/datafusion:vortex-file-compressed 25191953 24777055 1.02
tpcds_q63/datafusion:vortex-file-compressed 25578002 25324257 1.01
tpcds_q64/datafusion:vortex-file-compressed 522548053 513256181 1.02
tpcds_q65/datafusion:vortex-file-compressed 72163783 73457105 0.98
tpcds_q66/datafusion:vortex-file-compressed 80176988 80567576 1.00
tpcds_q67/datafusion:vortex-file-compressed 122293922 119393465 1.02
tpcds_q68/datafusion:vortex-file-compressed 34688891 35319234 0.98
tpcds_q69/datafusion:vortex-file-compressed 35653263 35102664 1.02
tpcds_q70/datafusion:vortex-file-compressed 111275850 107894422 1.03
tpcds_q71/datafusion:vortex-file-compressed 23951383 24093412 0.99
tpcds_q72/datafusion:vortex-file-compressed 1464434853 1476698710 0.99
tpcds_q73/datafusion:vortex-file-compressed 25354643 24748202 1.02
tpcds_q74/datafusion:vortex-file-compressed 80546532 78732123 1.02
tpcds_q75/datafusion:vortex-file-compressed 🚨 160160614 142128041 1.13
tpcds_q76/datafusion:vortex-file-compressed 42708359 46533637 0.92
tpcds_q77/datafusion:vortex-file-compressed 45019658 44046782 1.02
tpcds_q78/datafusion:vortex-file-compressed 111521937 112088393 0.99
tpcds_q79/datafusion:vortex-file-compressed 29207017 29500274 0.99
tpcds_q80/datafusion:vortex-file-compressed 102312780 102528918 1.00
tpcds_q81/datafusion:vortex-file-compressed 30477156 30002335 1.02
tpcds_q82/datafusion:vortex-file-compressed 20718305 19965550 1.04
tpcds_q83/datafusion:vortex-file-compressed 44669407 44416753 1.01
tpcds_q84/datafusion:vortex-file-compressed 13267339 13322151 1.00
tpcds_q85/datafusion:vortex-file-compressed 111059008 112652896 0.99
tpcds_q86/datafusion:vortex-file-compressed 20162106 19883608 1.01
tpcds_q87/datafusion:vortex-file-compressed 42043726 45508534 0.92
tpcds_q88/datafusion:vortex-file-compressed 53932196 53865816 1.00
tpcds_q89/datafusion:vortex-file-compressed 28324219 28377893 1.00
tpcds_q90/datafusion:vortex-file-compressed 14421911 14860061 0.97
tpcds_q91/datafusion:vortex-file-compressed 20496703 20558835 1.00
tpcds_q92/datafusion:vortex-file-compressed 18015531 18435546 0.98
tpcds_q93/datafusion:vortex-file-compressed 31605880 31210642 1.01
tpcds_q94/datafusion:vortex-file-compressed 23603359 23919268 0.99
tpcds_q95/datafusion:vortex-file-compressed 63964782 63573247 1.01
tpcds_q96/datafusion:vortex-file-compressed 12824755 12304536 1.04
tpcds_q97/datafusion:vortex-file-compressed 30078325 32408830 0.93
tpcds_q98/datafusion:vortex-file-compressed 26485878 26519624 1.00
tpcds_q99/datafusion:vortex-file-compressed 29047126 28265842 1.03
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 31806466 32780604 0.97
tpcds_q02/datafusion:parquet 52927933 53201396 0.99
tpcds_q03/datafusion:parquet 17494630 17936557 0.98
tpcds_q04/datafusion:parquet 352270024 348757375 1.01
tpcds_q05/datafusion:parquet 80683005 80555780 1.00
tpcds_q06/datafusion:parquet 31011881 31273260 0.99
tpcds_q07/datafusion:parquet 98980764 97145883 1.02
tpcds_q08/datafusion:parquet 39043319 38531279 1.01
tpcds_q09/datafusion:parquet 35677264 36417060 0.98
tpcds_q10/datafusion:parquet 89020038 88839304 1.00
tpcds_q11/datafusion:parquet 164245078 163200258 1.01
tpcds_q12/datafusion:parquet 22106779 22451956 0.98
tpcds_q13/datafusion:parquet 98570169 101372998 0.97
tpcds_q14/datafusion:parquet 280512809 276461291 1.01
tpcds_q15/datafusion:parquet 36334674 37874060 0.96
tpcds_q16/datafusion:parquet 48724191 47911369 1.02
tpcds_q17/datafusion:parquet 110038225 112252385 0.98
tpcds_q18/datafusion:parquet 134493014 134285287 1.00
tpcds_q19/datafusion:parquet 28555362 28862900 0.99
tpcds_q20/datafusion:parquet 23153941 23227424 1.00
tpcds_q21/datafusion:parquet 22025867 23773369 0.93
tpcds_q22/datafusion:parquet 141954572 142495264 1.00
tpcds_q23/datafusion:parquet 174143438 175119027 0.99
tpcds_q24/datafusion:parquet 138437917 136394327 1.01
tpcds_q25/datafusion:parquet 108983860 109426480 1.00
tpcds_q26/datafusion:parquet 83748844 86479370 0.97
tpcds_q27/datafusion:parquet 169496835 156054981 1.09
tpcds_q28/datafusion:parquet 41793272 40288358 1.04
tpcds_q29/datafusion:parquet 112448280 109741371 1.02
tpcds_q30/datafusion:parquet 43187903 43070675 1.00
tpcds_q31/datafusion:parquet 92923719 94515199 0.98
tpcds_q32/datafusion:parquet 25266560 23219446 1.09
tpcds_q33/datafusion:parquet 37571512 37575174 1.00
tpcds_q34/datafusion:parquet 30299895 29910154 1.01
tpcds_q35/datafusion:parquet 94468105 89835247 1.05
tpcds_q36/datafusion:parquet 67366820 68307177 0.99
tpcds_q37/datafusion:parquet 23907465 24636485 0.97
tpcds_q38/datafusion:parquet 59463408 57568737 1.03
tpcds_q39/datafusion:parquet 84657044 84072791 1.01
tpcds_q40/datafusion:parquet 34077689 33804657 1.01
tpcds_q41/datafusion:parquet 19783776 19453849 1.02
tpcds_q42/datafusion:parquet 16642971 16647415 1.00
tpcds_q43/datafusion:parquet 23061355 22911810 1.01
tpcds_q44/datafusion:parquet 42166636 42671637 0.99
tpcds_q45/datafusion:parquet 45121883 47415161 0.95
tpcds_q46/datafusion:parquet 40723310 41520022 0.98
tpcds_q47/datafusion:parquet 156590193 154005421 1.02
tpcds_q48/datafusion:parquet 90019035 84912517 1.06
tpcds_q49/datafusion:parquet 82244570 76962463 1.07
tpcds_q50/datafusion:parquet 70736522 68792601 1.03
tpcds_q51/datafusion:parquet 84667443 81721724 1.04
tpcds_q52/datafusion:parquet 17073210 17000474 1.00
tpcds_q53/datafusion:parquet 25637999 25168978 1.02
tpcds_q54/datafusion:parquet 46235758 46635423 0.99
tpcds_q55/datafusion:parquet 16421359 15936929 1.03
tpcds_q56/datafusion:parquet 36448384 35919202 1.01
tpcds_q57/datafusion:parquet 133354302 125360877 1.06
tpcds_q58/datafusion:parquet 82695478 82053952 1.01
tpcds_q59/datafusion:parquet 76483240 75737610 1.01
tpcds_q60/datafusion:parquet 36427604 37250578 0.98
tpcds_q61/datafusion:parquet 46327700 45974864 1.01
tpcds_q62/datafusion:parquet 30149102 27675603 1.09
tpcds_q63/datafusion:parquet 25810758 27657201 0.93
tpcds_q64/datafusion:parquet 354102418 366221210 0.97
tpcds_q65/datafusion:parquet 50409190 50723941 0.99
tpcds_q66/datafusion:parquet 84499474 90169895 0.94
tpcds_q67/datafusion:parquet 143792336 142806219 1.01
tpcds_q68/datafusion:parquet 40679024 40837734 1.00
tpcds_q69/datafusion:parquet 83136200 86598061 0.96
tpcds_q70/datafusion:parquet 43239841 44427540 0.97
tpcds_q71/datafusion:parquet 26575626 26655821 1.00
tpcds_q72/datafusion:parquet 466983868 437723647 1.07
tpcds_q73/datafusion:parquet 29282018 27926852 1.05
tpcds_q74/datafusion:parquet 101280698 99951557 1.01
tpcds_q75/datafusion:parquet 174686078 180533207 0.97
tpcds_q76/datafusion:parquet 59657236 61688441 0.97
tpcds_q77/datafusion:parquet 55232072 59911272 0.92
tpcds_q78/datafusion:parquet 123855968 127365032 0.97
tpcds_q79/datafusion:parquet 35710686 35433962 1.01
tpcds_q80/datafusion:parquet 95989460 97382156 0.99
tpcds_q81/datafusion:parquet 38603560 39860973 0.97
tpcds_q82/datafusion:parquet 24304128 24197992 1.00
tpcds_q83/datafusion:parquet 56035224 57087012 0.98
tpcds_q84/datafusion:parquet 47504532 48175026 0.99
tpcds_q85/datafusion:parquet 197304652 198163195 1.00
tpcds_q86/datafusion:parquet 20897130 21073307 0.99
tpcds_q87/datafusion:parquet 61471608 61811855 0.99
tpcds_q88/datafusion:parquet 58336565 58105909 1.00
tpcds_q89/datafusion:parquet 30563446 30319824 1.01
tpcds_q90/datafusion:parquet 18694704 18646092 1.00
tpcds_q91/datafusion:parquet 65841983 67527431 0.98
tpcds_q92/datafusion:parquet 24935624 25452211 0.98
tpcds_q93/datafusion:parquet 36778523 37363721 0.98
tpcds_q94/datafusion:parquet 29696213 31547492 0.94
tpcds_q95/datafusion:parquet 90138118 89855303 1.00
tpcds_q96/datafusion:parquet 16462314 15886172 1.04
tpcds_q97/datafusion:parquet 39778918 39318335 1.01
tpcds_q98/datafusion:parquet 26601079 26807754 0.99
tpcds_q99/datafusion:parquet 35047611 34118543 1.03
duckdb / vortex-file-compressed / ns (1.048x ➖, 6↑ 22↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 31315910 29423597 1.06
tpcds_q02/duckdb:vortex-file-compressed 28521808 30303148 0.94
tpcds_q03/duckdb:vortex-file-compressed 🚀 23149818 26127189 0.89
tpcds_q04/duckdb:vortex-file-compressed 98539647 100032739 0.99
tpcds_q05/duckdb:vortex-file-compressed 🚨 45953375 40200372 1.14
tpcds_q06/duckdb:vortex-file-compressed 54951719 50165899 1.10
tpcds_q07/duckdb:vortex-file-compressed 33437971 31307312 1.07
tpcds_q08/duckdb:vortex-file-compressed 33481365 35851293 0.93
tpcds_q09/duckdb:vortex-file-compressed 20840156 19944155 1.04
tpcds_q10/duckdb:vortex-file-compressed 54160215 57146350 0.95
tpcds_q11/duckdb:vortex-file-compressed 79080438 74621812 1.06
tpcds_q12/duckdb:vortex-file-compressed 19144510 18758876 1.02
tpcds_q13/duckdb:vortex-file-compressed 43977395 40169288 1.09
tpcds_q14/duckdb:vortex-file-compressed 118820384 114348369 1.04
tpcds_q15/duckdb:vortex-file-compressed 34383124 36484142 0.94
tpcds_q16/duckdb:vortex-file-compressed 35424726 35869562 0.99
tpcds_q17/duckdb:vortex-file-compressed 58212905 57395298 1.01
tpcds_q18/duckdb:vortex-file-compressed 52758802 50945869 1.04
tpcds_q19/duckdb:vortex-file-compressed 🚨 47276983 40243352 1.17
tpcds_q20/duckdb:vortex-file-compressed 20297229 19701173 1.03
tpcds_q21/duckdb:vortex-file-compressed 21836337 21444379 1.02
tpcds_q22/duckdb:vortex-file-compressed 70220676 67351311 1.04
tpcds_q23/duckdb:vortex-file-compressed 81719277 76607791 1.07
tpcds_q24/duckdb:vortex-file-compressed 55141692 52079276 1.06
tpcds_q25/duckdb:vortex-file-compressed 47978849 49817300 0.96
tpcds_q26/duckdb:vortex-file-compressed 25337288 23748087 1.07
tpcds_q27/duckdb:vortex-file-compressed 🚨 39035910 35071629 1.11
tpcds_q28/duckdb:vortex-file-compressed 🚨 17620278 14849394 1.19
tpcds_q29/duckdb:vortex-file-compressed 56577781 55758150 1.01
tpcds_q30/duckdb:vortex-file-compressed 36065020 36975822 0.98
tpcds_q31/duckdb:vortex-file-compressed 🚨 40605908 35814152 1.13
tpcds_q32/duckdb:vortex-file-compressed 19480372 18991703 1.03
tpcds_q33/duckdb:vortex-file-compressed 34914495 33521923 1.04
tpcds_q34/duckdb:vortex-file-compressed 🚨 36925446 31970035 1.16
tpcds_q35/duckdb:vortex-file-compressed 84999641 89245274 0.95
tpcds_q36/duckdb:vortex-file-compressed 33571829 31838893 1.05
tpcds_q37/duckdb:vortex-file-compressed 27199029 28506738 0.95
tpcds_q38/duckdb:vortex-file-compressed 44974218 42368363 1.06
tpcds_q39/duckdb:vortex-file-compressed 35601774 35002762 1.02
tpcds_q40/duckdb:vortex-file-compressed 🚨 26134889 23413162 1.12
tpcds_q41/duckdb:vortex-file-compressed 20230895 19432555 1.04
tpcds_q42/duckdb:vortex-file-compressed 19495250 20176817 0.97
tpcds_q43/duckdb:vortex-file-compressed 21760757 20983627 1.04
tpcds_q44/duckdb:vortex-file-compressed 🚨 32302404 25324005 1.28
tpcds_q45/duckdb:vortex-file-compressed 37127316 39840461 0.93
tpcds_q46/duckdb:vortex-file-compressed 🚀 39937933 44435509 0.90
tpcds_q47/duckdb:vortex-file-compressed 62133390 59557031 1.04
tpcds_q48/duckdb:vortex-file-compressed 41592260 38250241 1.09
tpcds_q49/duckdb:vortex-file-compressed 43625348 42181660 1.03
tpcds_q50/duckdb:vortex-file-compressed 🚨 42877154 35456793 1.21
tpcds_q51/duckdb:vortex-file-compressed 🚨 143622646 110388682 1.30
tpcds_q52/duckdb:vortex-file-compressed 🚨 22136362 16891469 1.31
tpcds_q53/duckdb:vortex-file-compressed 32813362 30495276 1.08
tpcds_q54/duckdb:vortex-file-compressed 46146638 44409138 1.04
tpcds_q55/duckdb:vortex-file-compressed 🚨 24038176 16710785 1.44
tpcds_q56/duckdb:vortex-file-compressed 🚨 37477659 32723071 1.15
tpcds_q57/duckdb:vortex-file-compressed 46232423 45505863 1.02
tpcds_q58/duckdb:vortex-file-compressed 🚨 47691743 41946285 1.14
tpcds_q59/duckdb:vortex-file-compressed 40271437 40930215 0.98
tpcds_q60/duckdb:vortex-file-compressed 36092398 37195566 0.97
tpcds_q61/duckdb:vortex-file-compressed 🚨 44546609 39355164 1.13
tpcds_q62/duckdb:vortex-file-compressed 22266017 20292907 1.10
tpcds_q63/duckdb:vortex-file-compressed 30324058 27788143 1.09
tpcds_q64/duckdb:vortex-file-compressed 122575211 116278485 1.05
tpcds_q65/duckdb:vortex-file-compressed 🚀 28491689 31986058 0.89
tpcds_q66/duckdb:vortex-file-compressed 42892247 39848173 1.08
tpcds_q67/duckdb:vortex-file-compressed 140143446 128024713 1.09
tpcds_q68/duckdb:vortex-file-compressed 🚨 42750914 38495057 1.11
tpcds_q69/duckdb:vortex-file-compressed 60933835 59077955 1.03
tpcds_q70/duckdb:vortex-file-compressed 🚨 48641156 40490518 1.20
tpcds_q71/duckdb:vortex-file-compressed 🚨 27911126 24829507 1.12
tpcds_q72/duckdb:vortex-file-compressed 157528634 153622325 1.03
tpcds_q73/duckdb:vortex-file-compressed 🚀 29363450 33992783 0.86
tpcds_q74/duckdb:vortex-file-compressed 53727011 54290159 0.99
tpcds_q75/duckdb:vortex-file-compressed 57410409 62244190 0.92
tpcds_q76/duckdb:vortex-file-compressed 27264967 25122275 1.09
tpcds_q77/duckdb:vortex-file-compressed 🚨 35691340 32390735 1.10
tpcds_q78/duckdb:vortex-file-compressed 86482498 81737535 1.06
tpcds_q79/duckdb:vortex-file-compressed 🚨 35540637 31559391 1.13
tpcds_q80/duckdb:vortex-file-compressed 59458340 57398289 1.04
tpcds_q81/duckdb:vortex-file-compressed 43064212 40699563 1.06
tpcds_q82/duckdb:vortex-file-compressed 59225502 56183763 1.05
tpcds_q83/duckdb:vortex-file-compressed 43631543 41822804 1.04
tpcds_q84/duckdb:vortex-file-compressed 🚨 31846303 28880194 1.10
tpcds_q85/duckdb:vortex-file-compressed 60374065 56240586 1.07
tpcds_q86/duckdb:vortex-file-compressed 19431514 19277380 1.01
tpcds_q87/duckdb:vortex-file-compressed 47974099 48469609 0.99
tpcds_q88/duckdb:vortex-file-compressed 68146483 62841961 1.08
tpcds_q89/duckdb:vortex-file-compressed 30606370 28259476 1.08
tpcds_q90/duckdb:vortex-file-compressed 🚀 15292097 17930223 0.85
tpcds_q91/duckdb:vortex-file-compressed 33711216 34665749 0.97
tpcds_q92/duckdb:vortex-file-compressed 25802356 23973271 1.08
tpcds_q93/duckdb:vortex-file-compressed 31053488 29115534 1.07
tpcds_q94/duckdb:vortex-file-compressed 🚨 37432987 33430768 1.12
tpcds_q95/duckdb:vortex-file-compressed 153054806 145802436 1.05
tpcds_q96/duckdb:vortex-file-compressed 17498252 18063894 0.97
tpcds_q97/duckdb:vortex-file-compressed 48317886 44636093 1.08
tpcds_q98/duckdb:vortex-file-compressed 25527852 26094949 0.98
tpcds_q99/duckdb:vortex-file-compressed 🚀 24018618 27607251 0.87
duckdb / parquet / ns (1.008x ➖, 2↑ 5↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 34403717 32653141 1.05
tpcds_q02/duckdb:parquet 28474778 28555245 1.00
tpcds_q03/duckdb:parquet 14545902 14004741 1.04
tpcds_q04/duckdb:parquet 191542671 196927937 0.97
tpcds_q05/duckdb:parquet 32388269 34743442 0.93
tpcds_q06/duckdb:parquet 34837013 35478996 0.98
tpcds_q07/duckdb:parquet 23125285 23023336 1.00
tpcds_q08/duckdb:parquet 32841064 33251863 0.99
tpcds_q09/duckdb:parquet 30335771 30207960 1.00
tpcds_q10/duckdb:parquet 40094799 41043294 0.98
tpcds_q11/duckdb:parquet 107192093 108761848 0.99
tpcds_q12/duckdb:parquet 17594360 18594991 0.95
tpcds_q13/duckdb:parquet 🚨 39808301 34396546 1.16
tpcds_q14/duckdb:parquet 105563124 105935158 1.00
tpcds_q15/duckdb:parquet 36664043 35135215 1.04
tpcds_q16/duckdb:parquet 27446114 27323916 1.00
tpcds_q17/duckdb:parquet 45050589 44367547 1.02
tpcds_q18/duckdb:parquet 57464443 56149806 1.02
tpcds_q19/duckdb:parquet 33588009 34152596 0.98
tpcds_q20/duckdb:parquet 19186439 19351102 0.99
tpcds_q21/duckdb:parquet 13690734 13991104 0.98
tpcds_q22/duckdb:parquet 🚀 50494908 66034402 0.76
tpcds_q23/duckdb:parquet 68872518 70549836 0.98
tpcds_q24/duckdb:parquet 49365476 48942225 1.01
tpcds_q25/duckdb:parquet 41692075 41699327 1.00
tpcds_q26/duckdb:parquet 44285337 45128724 0.98
tpcds_q27/duckdb:parquet 58124267 55043750 1.06
tpcds_q28/duckdb:parquet 30353733 29216215 1.04
tpcds_q29/duckdb:parquet 43369516 43662075 0.99
tpcds_q30/duckdb:parquet 43296100 44112934 0.98
tpcds_q31/duckdb:parquet 29140665 30133745 0.97
tpcds_q32/duckdb:parquet 14749880 14875578 0.99
tpcds_q33/duckdb:parquet 23589269 23626529 1.00
tpcds_q34/duckdb:parquet 🚨 25385798 21443977 1.18
tpcds_q35/duckdb:parquet 67831402 68461212 0.99
tpcds_q36/duckdb:parquet 22455113 22426860 1.00
tpcds_q37/duckdb:parquet 18588412 18697489 0.99
tpcds_q38/duckdb:parquet 40366230 40903063 0.99
tpcds_q39/duckdb:parquet 36781872 37789107 0.97
tpcds_q40/duckdb:parquet 22376664 22542282 0.99
tpcds_q41/duckdb:parquet 10363864 10008615 1.04
tpcds_q42/duckdb:parquet 🚨 12945451 11492191 1.13
tpcds_q43/duckdb:parquet 🚨 19096664 14736205 1.30
tpcds_q44/duckdb:parquet 25048844 24635684 1.02
tpcds_q45/duckdb:parquet 32016473 32840429 0.97
tpcds_q46/duckdb:parquet 50629703 50964396 0.99
tpcds_q47/duckdb:parquet 52336062 48260466 1.08
tpcds_q48/duckdb:parquet 29994028 29654920 1.01
tpcds_q49/duckdb:parquet 28144974 27456126 1.03
tpcds_q50/duckdb:parquet 24786338 24610205 1.01
tpcds_q51/duckdb:parquet 99683966 98325235 1.01
tpcds_q52/duckdb:parquet 12098996 13214458 0.92
tpcds_q53/duckdb:parquet 15929469 15437809 1.03
tpcds_q54/duckdb:parquet 30316056 30344208 1.00
tpcds_q55/duckdb:parquet 11905840 13173250 0.90
tpcds_q56/duckdb:parquet 25680128 23938788 1.07
tpcds_q57/duckdb:parquet 43255618 42797113 1.01
tpcds_q58/duckdb:parquet 27524997 27463142 1.00
tpcds_q59/duckdb:parquet 29860263 29642551 1.01
tpcds_q60/duckdb:parquet 25699425 25379893 1.01
tpcds_q61/duckdb:parquet 31532232 33200308 0.95
tpcds_q62/duckdb:parquet 15078065 14623214 1.03
tpcds_q63/duckdb:parquet 17424544 16613422 1.05
tpcds_q64/duckdb:parquet 81452612 79814097 1.02
tpcds_q65/duckdb:parquet 21400795 21696121 0.99
tpcds_q66/duckdb:parquet 34440275 34501485 1.00
tpcds_q67/duckdb:parquet 130870314 123414279 1.06
tpcds_q68/duckdb:parquet 🚀 39194606 43638982 0.90
tpcds_q69/duckdb:parquet 41844643 41485681 1.01
tpcds_q70/duckdb:parquet 28499803 28072022 1.02
tpcds_q71/duckdb:parquet 21665534 21340989 1.02
tpcds_q72/duckdb:parquet 🚨 178107721 121346134 1.47
tpcds_q73/duckdb:parquet 18484366 18096540 1.02
tpcds_q74/duckdb:parquet 148173355 144632492 1.02
tpcds_q75/duckdb:parquet 59947542 60446027 0.99
tpcds_q76/duckdb:parquet 19398773 19816372 0.98
tpcds_q77/duckdb:parquet 24783835 25854081 0.96
tpcds_q78/duckdb:parquet 78066284 77559696 1.01
tpcds_q79/duckdb:parquet 27544333 27430220 1.00
tpcds_q80/duckdb:parquet 49603631 48238238 1.03
tpcds_q81/duckdb:parquet 40802378 41179265 0.99
tpcds_q82/duckdb:parquet 18937452 18578665 1.02
tpcds_q83/duckdb:parquet 21954763 22426277 0.98
tpcds_q84/duckdb:parquet 23927801 23563378 1.02
tpcds_q85/duckdb:parquet 47243015 47589566 0.99
tpcds_q86/duckdb:parquet 15112351 14816482 1.02
tpcds_q87/duckdb:parquet 43963216 43348489 1.01
tpcds_q88/duckdb:parquet 43169059 43062752 1.00
tpcds_q89/duckdb:parquet 18060307 19786177 0.91
tpcds_q90/duckdb:parquet 10255104 9681588 1.06
tpcds_q91/duckdb:parquet 27729216 27454434 1.01
tpcds_q92/duckdb:parquet 15570936 15783552 0.99
tpcds_q93/duckdb:parquet 31192980 31008066 1.01
tpcds_q94/duckdb:parquet 21485337 21809526 0.99
tpcds_q95/duckdb:parquet 137494487 138813770 0.99
tpcds_q96/duckdb:parquet 9947566 9944823 1.00
tpcds_q97/duckdb:parquet 39040773 39373942 0.99
tpcds_q98/duckdb:parquet 21471019 21023557 1.02
tpcds_q99/duckdb:parquet 23616918 23696920 1.00

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.66 KB 0 B 47.66 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.67 KB 0 B 362.67 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 639.05 KB 0 B 639.05 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.39 KB 0 B 424.39 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.49 KB 0 B 140.49 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.50 KB 0 B 10.50 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.77 KB 0 B 5.77 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.55 KB 0 B 1000.55 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.52 KB 0 B 50.52 KB -100.0%
reason.vortex 1.0 vortex-compact 6.17 KB 0 B 6.17 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.94 KB 0 B 10.94 KB -100.0%
store.vortex 1.0 vortex-compact 43.45 KB 0 B 43.45 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.80 KB 0 B 96.80 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.35 KB 0 B 22.35 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.22 KB 0 B 25.22 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.40 KB 0 B 42.40 KB -100.0%

Totals:

  • vortex-compact: 207.95 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +22.3%
Engines: DataFusion No clear signal (-3.8%, environment too noisy confidence) · DuckDB No clear signal (+55.5%, environment too noisy confidence)
Vortex (geomean): 0.999x ➖
Parquet (geomean): 0.817x ➖
Shifts: Parquet (control) -18.3% · Median polish +1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 53664954 57487574 0.93
fineweb_q01/datafusion:vortex-compact 445205488 440527551 1.01
fineweb_q02/datafusion:vortex-compact 589545966 550156464 1.07
fineweb_q03/datafusion:vortex-compact 760681390 785724471 0.97
fineweb_q04/datafusion:vortex-compact 740177881 744717142 0.99
fineweb_q05/datafusion:vortex-compact 656291110 662522047 0.99
fineweb_q06/datafusion:vortex-compact 725527562 722472166 1.00
fineweb_q07/datafusion:vortex-compact 583605662 561037232 1.04
fineweb_q08/datafusion:vortex-compact 176188767 190573984 0.92
datafusion / parquet / ns (1.031x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 730690324 555441398 1.32
fineweb_q01/datafusion:parquet 1024855904 1037727315 0.99
fineweb_q02/datafusion:parquet 1032641091 1044851709 0.99
fineweb_q03/datafusion:parquet 949119358 992678456 0.96
fineweb_q04/datafusion:parquet 1043443474 959863431 1.09
fineweb_q05/datafusion:parquet 1110965638 1039496265 1.07
fineweb_q06/datafusion:parquet 964991054 933195753 1.03
fineweb_q07/datafusion:parquet 893713906 1058848898 0.84
fineweb_q08/datafusion:parquet 942979516 893710020 1.06
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 63486431 74676041 0.85
fineweb_q01/duckdb:vortex-compact 579779820 549985307 1.05
fineweb_q02/duckdb:vortex-compact 611313314 567125922 1.08
fineweb_q03/duckdb:vortex-compact 1640977420 1610389514 1.02
fineweb_q04/duckdb:vortex-compact 1730388998 1737099908 1.00
fineweb_q05/duckdb:vortex-compact 1653464039 1637853852 1.01
fineweb_q06/duckdb:vortex-compact 1721147279 1671148427 1.03
fineweb_q07/duckdb:vortex-compact 1504828896 1517993206 0.99
fineweb_q08/duckdb:vortex-compact 648905129 619360423 1.05
duckdb / parquet / ns (0.647x ✅, 2↑ 0↓)
name PR 6380aa5 (ns) base c6629ac (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 695705568 5265733378 0.13
fineweb_q01/duckdb:parquet 5324706123 5288563092 1.01
fineweb_q02/duckdb:parquet 5319757542 5309157733 1.00
fineweb_q03/duckdb:parquet 5346794941 5366860568 1.00
fineweb_q04/duckdb:parquet 5303861678 5302942817 1.00
fineweb_q05/duckdb:parquet 🚀 804300135 5332416288 0.15
fineweb_q06/duckdb:parquet 5415437590 5405559348 1.00
fineweb_q07/duckdb:parquet 5316775794 5334358818 1.00
fineweb_q08/duckdb:parquet 5279448797 5289731016 1.00

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.6%
Engines: DataFusion No clear signal (-2.4%, low confidence) · DuckDB No clear signal (-10.5%, low confidence)
Vortex (geomean): 0.940x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.979x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6113594 6170611 0.99
fineweb_q01/datafusion:vortex-file-compressed 31745663 31976099 0.99
fineweb_q02/datafusion:vortex-file-compressed 35570298 36102661 0.99
fineweb_q03/datafusion:vortex-file-compressed 41756815 42838382 0.97
fineweb_q04/datafusion:vortex-file-compressed 205205812 205831765 1.00
fineweb_q05/datafusion:vortex-file-compressed 150585471 154603850 0.97
fineweb_q06/datafusion:vortex-file-compressed 39096314 40312828 0.97
fineweb_q07/datafusion:vortex-file-compressed 40663763 40260883 1.01
fineweb_q08/datafusion:vortex-file-compressed 15970318 17318022 0.92
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 9083485 8722381 1.04
fineweb_q01/datafusion:parquet 194511519 194395355 1.00
fineweb_q02/datafusion:parquet 200895039 198708259 1.01
fineweb_q03/datafusion:parquet 193596263 191222992 1.01
fineweb_q04/datafusion:parquet 208685652 207219424 1.01
fineweb_q05/datafusion:parquet 204796623 205082899 1.00
fineweb_q06/datafusion:parquet 198048732 198790965 1.00
fineweb_q07/datafusion:parquet 190171448 197611879 0.96
fineweb_q08/datafusion:parquet 189416482 188258664 1.01
duckdb / vortex-file-compressed / ns (0.902x ➖, 4↑ 0↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3873639 4181003 0.93
fineweb_q01/duckdb:vortex-file-compressed 44637760 48428222 0.92
fineweb_q02/duckdb:vortex-file-compressed 47060770 48708392 0.97
fineweb_q03/duckdb:vortex-file-compressed 🚀 67494244 78300385 0.86
fineweb_q04/duckdb:vortex-file-compressed 286029915 291838417 0.98
fineweb_q05/duckdb:vortex-file-compressed 226031692 221844545 1.02
fineweb_q06/duckdb:vortex-file-compressed 🚀 68398847 76487725 0.89
fineweb_q07/duckdb:vortex-file-compressed 🚀 70878619 85973428 0.82
fineweb_q08/duckdb:vortex-file-compressed 🚀 28468575 37732842 0.75
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37678372 40395614 0.93
fineweb_q01/duckdb:parquet 79420073 77249207 1.03
fineweb_q02/duckdb:parquet 77737115 76854256 1.01
fineweb_q03/duckdb:parquet 209028073 204097379 1.02
fineweb_q04/duckdb:parquet 236008729 226956056 1.04
fineweb_q05/duckdb:parquet 202997291 202137118 1.00
fineweb_q06/duckdb:parquet 145215720 141327695 1.03
fineweb_q07/duckdb:parquet 145298644 141407491 1.03
fineweb_q08/duckdb:parquet 38943499 39695847 0.98

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-3.4%, environment too noisy confidence) · DuckDB No clear signal (+2.5%, low confidence)
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.959x ➖, 2↑ 1↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚀 396456587 453996834 0.87
clickbench-sorted_q24/datafusion:vortex-file-compressed 🚨 27170902 23968038 1.13
clickbench-sorted_q26/datafusion:vortex-file-compressed 23719127 22510063 1.05
clickbench-sorted_q36/datafusion:vortex-file-compressed 48312926 49232819 0.98
clickbench-sorted_q37/datafusion:vortex-file-compressed 🚀 35349258 45095733 0.78
clickbench-sorted_q38/datafusion:vortex-file-compressed 36276801 39658614 0.91
clickbench-sorted_q39/datafusion:vortex-file-compressed 90128642 88776220 1.02
clickbench-sorted_q40/datafusion:vortex-file-compressed 19359657 19485055 0.99
clickbench-sorted_q41/datafusion:vortex-file-compressed 18709494 20568143 0.91
clickbench-sorted_q42/datafusion:vortex-file-compressed 15688241 16072303 0.98
datafusion / parquet / ns (0.993x ➖, 1↑ 2↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2933751908 2922433556 1.00
clickbench-sorted_q24/datafusion:parquet 🚨 39585064 35946252 1.10
clickbench-sorted_q26/datafusion:parquet 🚀 31884269 38017307 0.84
clickbench-sorted_q36/datafusion:parquet 171924463 189817390 0.91
clickbench-sorted_q37/datafusion:parquet 101426650 100387991 1.01
clickbench-sorted_q38/datafusion:parquet 157739251 164090667 0.96
clickbench-sorted_q39/datafusion:parquet 314264146 314765090 1.00
clickbench-sorted_q40/datafusion:parquet 66156693 71528470 0.92
clickbench-sorted_q41/datafusion:parquet 64686624 61876982 1.05
clickbench-sorted_q42/datafusion:parquet 🚨 40152932 33951870 1.18
duckdb / vortex-file-compressed / ns (1.016x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 241794494 242202431 1.00
clickbench-sorted_q24/duckdb:vortex-file-compressed 38280453 38361570 1.00
clickbench-sorted_q26/duckdb:vortex-file-compressed 68966794 67345388 1.02
clickbench-sorted_q36/duckdb:vortex-file-compressed 69330438 67615654 1.03
clickbench-sorted_q37/duckdb:vortex-file-compressed 55342552 56730844 0.98
clickbench-sorted_q38/duckdb:vortex-file-compressed 66647382 62934792 1.06
clickbench-sorted_q39/duckdb:vortex-file-compressed 121822399 118129033 1.03
clickbench-sorted_q40/duckdb:vortex-file-compressed 38383378 39300979 0.98
clickbench-sorted_q41/duckdb:vortex-file-compressed 39384339 37954187 1.04
clickbench-sorted_q42/duckdb:vortex-file-compressed 32212195 31123870 1.03
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 214299250 224299026 0.96
clickbench-sorted_q24/duckdb:parquet 30293969 30841158 0.98
clickbench-sorted_q26/duckdb:parquet 22824518 23301336 0.98
clickbench-sorted_q36/duckdb:parquet 71136541 71700392 0.99
clickbench-sorted_q37/duckdb:parquet 58812575 57209893 1.03
clickbench-sorted_q38/duckdb:parquet 60194691 62058996 0.97
clickbench-sorted_q39/duckdb:parquet 107303043 110731818 0.97
clickbench-sorted_q40/duckdb:parquet 29877796 30347155 0.98
clickbench-sorted_q41/duckdb:parquet 30611133 29367514 1.04
clickbench-sorted_q42/duckdb:parquet 20313217 20069416 1.01

File Size Changes (201 files changed, -42.8% overall, 42↑ 159↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 189.34 MB 193.51 MB +4.17 MB +2.2%
hits_087.vortex 1.0 vortex-file-compressed 159.69 MB 161.52 MB +1.82 MB +1.1%
hits_023.vortex 1.0 vortex-file-compressed 195.32 MB 197.32 MB +2.00 MB +1.0%
hits_064.vortex 1.0 vortex-file-compressed 191.28 MB 193.02 MB +1.74 MB +0.9%
hits_029.vortex 1.0 vortex-file-compressed 198.08 MB 199.71 MB +1.63 MB +0.8%
hits_038.vortex 1.0 vortex-file-compressed 190.37 MB 191.79 MB +1.42 MB +0.7%
hits_054.vortex 1.0 vortex-file-compressed 146.84 MB 147.84 MB +1.01 MB +0.7%
hits_055.vortex 1.0 vortex-file-compressed 198.69 MB 199.81 MB +1.12 MB +0.6%
hits_071.vortex 1.0 vortex-file-compressed 140.09 MB 140.81 MB +729.11 KB +0.5%
hits_051.vortex 1.0 vortex-file-compressed 172.31 MB 173.04 MB +746.30 KB +0.4%
hits_017.vortex 1.0 vortex-file-compressed 146.76 MB 147.25 MB +500.21 KB +0.3%
hits_089.vortex 1.0 vortex-file-compressed 131.48 MB 131.91 MB +432.76 KB +0.3%
hits_057.vortex 1.0 vortex-file-compressed 159.96 MB 160.43 MB +471.85 KB +0.3%
hits_061.vortex 1.0 vortex-file-compressed 160.50 MB 160.94 MB +455.84 KB +0.3%
hits_047.vortex 1.0 vortex-file-compressed 154.48 MB 154.88 MB +410.73 KB +0.3%
hits_030.vortex 1.0 vortex-file-compressed 131.72 MB 131.95 MB +236.88 KB +0.2%
hits_046.vortex 1.0 vortex-file-compressed 101.29 MB 101.46 MB +179.16 KB +0.2%
hits_070.vortex 1.0 vortex-file-compressed 199.69 MB 200.03 MB +345.19 KB +0.2%
hits_000.vortex 1.0 vortex-file-compressed 131.51 MB 131.72 MB +219.02 KB +0.2%
hits_009.vortex 1.0 vortex-file-compressed 101.25 MB 101.40 MB +148.87 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 199.20 MB 199.47 MB +270.98 KB +0.1%
hits_040.vortex 1.0 vortex-file-compressed 142.96 MB 143.14 MB +190.38 KB +0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.12 MB 171.34 MB +227.51 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.02 MB 172.23 MB +219.90 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.58 MB 167.77 MB +193.59 KB +0.1%
hits_027.vortex 1.0 vortex-file-compressed 189.81 MB 190.00 MB +198.97 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.89 MB 126.99 MB +101.95 KB +0.1%
hits_091.vortex 1.0 vortex-file-compressed 146.98 MB 147.07 MB +94.88 KB +0.1%
hits_036.vortex 1.0 vortex-file-compressed 171.37 MB 171.46 MB +98.13 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.11 MB 161.19 MB +85.46 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 192.82 MB 192.92 MB +101.05 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.69 MB 199.78 MB +89.01 KB +0.0%
hits_041.vortex 1.0 vortex-file-compressed 131.29 MB 131.34 MB +45.88 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 151.76 MB 151.80 MB +39.20 KB +0.0%
hits_020.vortex 1.0 vortex-file-compressed 160.28 MB 160.30 MB +24.87 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 154.45 MB 154.47 MB +23.13 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.50 MB 126.52 MB +12.49 KB +0.0%
hits_094.vortex 1.0 vortex-file-compressed 158.76 MB 158.78 MB +15.10 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 131.56 MB 131.57 MB +12.33 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 177.18 MB 177.19 MB +16.35 KB +0.0%
hits_010.vortex 1.0 vortex-file-compressed 169.08 MB 169.09 MB +10.54 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.04 MB 161.04 MB +1.61 KB +0.0%
hits_074.vortex 1.0 vortex-file-compressed 199.34 MB 199.34 MB 3.14 KB -0.0%
hits_063.vortex 1.0 vortex-file-compressed 131.84 MB 131.84 MB 4.77 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 131.07 MB 131.06 MB 7.41 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 131.79 MB 131.78 MB 11.91 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 160.52 MB 160.50 MB 18.45 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 154.37 MB 154.34 MB 30.79 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.60 MB 159.57 MB 32.30 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.39 MB 161.35 MB 43.77 KB -0.0%
hits_093.vortex 1.0 vortex-file-compressed 131.70 MB 131.66 MB 37.07 KB -0.0%
hits_033.vortex 1.0 vortex-file-compressed 200.12 MB 200.06 MB 62.25 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 140.21 MB 140.16 MB 51.25 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 190.08 MB 190.00 MB 79.48 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.61 MB 136.55 MB 59.83 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 180.30 MB 180.22 MB 80.00 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.68 MB 189.60 MB 88.44 KB -0.0%
hits_045.vortex 1.0 vortex-file-compressed 140.10 MB 140.03 MB 65.39 KB -0.0%
hits_060.vortex 1.0 vortex-file-compressed 193.28 MB 193.19 MB 92.12 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.42 MB 126.36 MB 63.02 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.72 MB 154.64 MB 80.30 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.14 MB 157.06 MB 85.24 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.18 MB 155.10 MB 91.67 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.81 MB 199.69 MB 122.59 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 131.01 MB 130.93 MB 80.92 KB -0.1%
hits_025.vortex 1.0 vortex-file-compressed 172.04 MB 171.93 MB 112.64 KB -0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.74 MB 172.63 MB 114.23 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.19 MB 161.08 MB 107.26 KB -0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.73 MB 135.64 MB 95.65 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 200.23 MB 200.09 MB 142.76 KB -0.1%
hits_012.vortex 1.0 vortex-file-compressed 191.16 MB 191.02 MB 144.54 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 199.63 MB 199.45 MB 177.36 KB -0.1%
hits_019.vortex 1.0 vortex-file-compressed 141.01 MB 140.89 MB 126.68 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 161.08 MB 160.94 MB 145.28 KB -0.1%
hits_086.vortex 1.0 vortex-file-compressed 192.51 MB 192.33 MB 180.75 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.77 MB 137.60 MB 168.78 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.75 MB 192.50 MB 252.10 KB -0.1%
hits_048.vortex 1.0 vortex-file-compressed 199.90 MB 199.63 MB 275.88 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.34 MB 142.14 MB 202.87 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.71 MB 191.44 MB 277.12 KB -0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.04 MB 201.75 MB 296.96 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 131.13 MB 130.93 MB 204.52 KB -0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.90 MB 102.74 MB 166.62 KB -0.2%
hits_021.vortex 1.0 vortex-file-compressed 154.71 MB 154.46 MB 264.30 KB -0.2%
hits_077.vortex 1.0 vortex-file-compressed 173.12 MB 172.71 MB 414.41 KB -0.2%
hits_072.vortex 1.0 vortex-file-compressed 102.85 MB 102.53 MB 324.58 KB -0.3%
hits_082.vortex 1.0 vortex-file-compressed 140.49 MB 140.04 MB 460.08 KB -0.3%
hits_066.vortex 1.0 vortex-file-compressed 163.68 MB 163.15 MB 539.02 KB -0.3%
hits_044.vortex 1.0 vortex-file-compressed 200.54 MB 199.90 MB 661.10 KB -0.3%
hits_022.vortex 1.0 vortex-file-compressed 199.60 MB 198.92 MB 692.88 KB -0.3%
hits_079.vortex 1.0 vortex-file-compressed 181.52 MB 180.89 MB 648.35 KB -0.3%
hits_026.vortex 1.0 vortex-file-compressed 131.81 MB 131.31 MB 520.05 KB -0.4%
hits_062.vortex 1.0 vortex-file-compressed 171.10 MB 170.42 MB 695.55 KB -0.4%
hits_013.vortex 1.0 vortex-file-compressed 161.92 MB 161.17 MB 768.30 KB -0.5%
hits_088.vortex 1.0 vortex-file-compressed 172.71 MB 171.91 MB 821.24 KB -0.5%
hits_096.vortex 1.0 vortex-file-compressed 199.72 MB 198.59 MB 1.14 MB -0.6%
hits_059.vortex 1.0 vortex-file-compressed 199.18 MB 198.00 MB 1.18 MB -0.6%
hits_076.vortex 1.0 vortex-file-compressed 161.05 MB 159.85 MB 1.20 MB -0.7%
hits_007.vortex 1.0 vortex-file-compressed 200.17 MB 198.67 MB 1.49 MB -0.7%
hits_034.vortex 1.0 vortex-file-compressed 183.91 MB 182.00 MB 1.92 MB -1.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 98.23 MB 0 B 98.23 MB -100.0%
hits_001.vortex 1.0 vortex-compact 137.70 MB 0 B 137.70 MB -100.0%
hits_002.vortex 1.0 vortex-compact 125.30 MB 0 B 125.30 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.54 MB 0 B 104.54 MB -100.0%
hits_004.vortex 1.0 vortex-compact 98.65 MB 0 B 98.65 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.93 MB 0 B 115.93 MB -100.0%
hits_006.vortex 1.0 vortex-compact 96.15 MB 0 B 96.15 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.76 MB 0 B 153.76 MB -100.0%
hits_008.vortex 1.0 vortex-compact 106.14 MB 0 B 106.14 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 0 B 75.24 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.50 MB 0 B 123.50 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.96 MB 0 B 152.96 MB -100.0%
hits_012.vortex 1.0 vortex-compact 140.07 MB 0 B 140.07 MB -100.0%
hits_013.vortex 1.0 vortex-compact 124.25 MB 0 B 124.25 MB -100.0%
hits_014.vortex 1.0 vortex-compact 134.05 MB 0 B 134.05 MB -100.0%
hits_015.vortex 1.0 vortex-compact 97.69 MB 0 B 97.69 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.62 MB 0 B 127.62 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.76 MB 0 B 111.76 MB -100.0%
hits_018.vortex 1.0 vortex-compact 152.90 MB 0 B 152.90 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.64 MB 0 B 106.64 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.67 MB 0 B 111.67 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.62 MB 0 B 110.62 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.21 MB 0 B 153.21 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.61 MB 0 B 142.61 MB -100.0%
hits_024.vortex 1.0 vortex-compact 123.94 MB 0 B 123.94 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.71 MB 0 B 133.71 MB -100.0%
hits_026.vortex 1.0 vortex-compact 98.10 MB 0 B 98.10 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.34 MB 0 B 139.34 MB -100.0%
hits_028.vortex 1.0 vortex-compact 116.03 MB 0 B 116.03 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.55 MB 0 B 153.55 MB -100.0%
hits_030.vortex 1.0 vortex-compact 99.02 MB 0 B 99.02 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.70 MB 0 B 111.70 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.61 MB 0 B 110.61 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.74 MB 0 B 153.74 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.34 MB 0 B 133.34 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.94 MB 0 B 75.94 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.23 MB 0 B 133.23 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.51 MB 0 B 132.51 MB -100.0%
hits_038.vortex 1.0 vortex-compact 139.60 MB 0 B 139.60 MB -100.0%
hits_039.vortex 1.0 vortex-compact 124.40 MB 0 B 124.40 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.03 MB 0 B 110.03 MB -100.0%
hits_041.vortex 1.0 vortex-compact 98.64 MB 0 B 98.64 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.24 MB 0 B 136.24 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.33 MB 0 B 94.33 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.60 MB 0 B 153.60 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.05 MB 0 B 106.05 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.93 MB 0 B 74.93 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.47 MB 0 B 110.47 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.36 MB 0 B 153.36 MB -100.0%
hits_049.vortex 1.0 vortex-compact 140.59 MB 0 B 140.59 MB -100.0%
hits_050.vortex 1.0 vortex-compact 125.99 MB 0 B 125.99 MB -100.0%
hits_051.vortex 1.0 vortex-compact 134.01 MB 0 B 134.01 MB -100.0%
hits_052.vortex 1.0 vortex-compact 98.02 MB 0 B 98.02 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.55 MB 0 B 138.55 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.12 MB 0 B 112.12 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.36 MB 0 B 153.36 MB -100.0%
hits_056.vortex 1.0 vortex-compact 101.33 MB 0 B 101.33 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.81 MB 0 B 111.81 MB -100.0%
hits_058.vortex 1.0 vortex-compact 110.98 MB 0 B 110.98 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.07 MB 0 B 152.07 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.18 MB 0 B 141.18 MB -100.0%
hits_061.vortex 1.0 vortex-compact 123.91 MB 0 B 123.91 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.77 MB 0 B 132.77 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.49 MB 0 B 98.49 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.17 MB 0 B 140.17 MB -100.0%
hits_065.vortex 1.0 vortex-compact 123.94 MB 0 B 123.94 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.44 MB 0 B 117.44 MB -100.0%
hits_067.vortex 1.0 vortex-compact 99.31 MB 0 B 99.31 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.50 MB 0 B 112.50 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.54 MB 0 B 99.54 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.83 MB 0 B 153.83 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.23 MB 0 B 106.23 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.66 MB 0 B 75.66 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.19 MB 0 B 134.19 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.00 MB 0 B 153.00 MB -100.0%
hits_075.vortex 1.0 vortex-compact 137.83 MB 0 B 137.83 MB -100.0%
hits_076.vortex 1.0 vortex-compact 126.03 MB 0 B 126.03 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.40 MB 0 B 134.40 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.93 MB 0 B 97.93 MB -100.0%
hits_079.vortex 1.0 vortex-compact 127.99 MB 0 B 127.99 MB -100.0%
hits_080.vortex 1.0 vortex-compact 96.81 MB 0 B 96.81 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.82 MB 0 B 153.82 MB -100.0%
hits_082.vortex 1.0 vortex-compact 106.34 MB 0 B 106.34 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.10 MB 0 B 110.10 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.67 MB 0 B 110.67 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.51 MB 0 B 153.51 MB -100.0%
hits_086.vortex 1.0 vortex-compact 139.69 MB 0 B 139.69 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.48 MB 0 B 125.48 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.12 MB 0 B 134.12 MB -100.0%
hits_089.vortex 1.0 vortex-compact 98.80 MB 0 B 98.80 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.25 MB 0 B 141.25 MB -100.0%
hits_091.vortex 1.0 vortex-compact 112.40 MB 0 B 112.40 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.15 MB 0 B 153.15 MB -100.0%
hits_093.vortex 1.0 vortex-compact 97.96 MB 0 B 97.96 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.80 MB 0 B 110.80 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.64 MB 0 B 110.64 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.21 MB 0 B 153.21 MB -100.0%
hits_097.vortex 1.0 vortex-compact 140.77 MB 0 B 140.77 MB -100.0%
hits_098.vortex 1.0 vortex-compact 102.91 MB 0 B 102.91 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.16 MB 0 B 133.16 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@connortsui20
connortsui20 merged commit 4030e01 into develop Aug 5, 2026
131 of 132 checks passed
@connortsui20
connortsui20 deleted the ct/benchmark-zero-byte-reporting branch August 5, 2026 17:56
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.8%
Engines: DataFusion No clear signal (+1.1%, environment too noisy confidence) · DuckDB No clear signal (+2.5%, environment too noisy confidence)
Vortex (geomean): 0.953x ➖
Parquet (geomean): 0.936x ➖
Shifts: Parquet (control) -6.4% · Median polish -3.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.946x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 582367915 612112244 0.95
tpch_q02/datafusion:vortex-compact 629560037 646292225 0.97
tpch_q03/datafusion:vortex-compact 613119602 756543998 0.81
tpch_q04/datafusion:vortex-compact 362044804 481812325 0.75
tpch_q05/datafusion:vortex-compact 702516675 890347168 0.79
tpch_q06/datafusion:vortex-compact 492963048 440905397 1.12
tpch_q07/datafusion:vortex-compact 717032701 984373576 0.73
tpch_q08/datafusion:vortex-compact 929327883 918284964 1.01
tpch_q09/datafusion:vortex-compact 849055596 883225466 0.96
tpch_q10/datafusion:vortex-compact 669287189 801221535 0.84
tpch_q11/datafusion:vortex-compact 364845904 404160397 0.90
tpch_q12/datafusion:vortex-compact 541736136 504564833 1.07
tpch_q13/datafusion:vortex-compact 267070276 282482109 0.95
tpch_q14/datafusion:vortex-compact 389660112 364476901 1.07
tpch_q15/datafusion:vortex-compact 621082566 632508642 0.98
tpch_q16/datafusion:vortex-compact 298154234 297577356 1.00
tpch_q17/datafusion:vortex-compact 786392350 805878359 0.98
tpch_q18/datafusion:vortex-compact 911667094 943765508 0.97
tpch_q19/datafusion:vortex-compact 573888342 643951321 0.89
tpch_q20/datafusion:vortex-compact 724887195 734309661 0.99
tpch_q21/datafusion:vortex-compact 1079650634 1082957932 1.00
tpch_q22/datafusion:vortex-compact 447956574 355952592 1.26
datafusion / parquet / ns (0.936x ➖, 2↑ 1↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 415024914 423049616 0.98
tpch_q02/datafusion:parquet 604403639 727623293 0.83
tpch_q03/datafusion:parquet 590232953 776853268 0.76
tpch_q04/datafusion:parquet 415956907 405340090 1.03
tpch_q05/datafusion:parquet 727997411 735924905 0.99
tpch_q06/datafusion:parquet 🚀 197392037 327720069 0.60
tpch_q07/datafusion:parquet 856930964 922227424 0.93
tpch_q08/datafusion:parquet 1129864096 941573900 1.20
tpch_q09/datafusion:parquet 🚨 1728640572 1287725909 1.34
tpch_q10/datafusion:parquet 1923199807 1973030290 0.97
tpch_q11/datafusion:parquet 🚀 467931506 752880441 0.62
tpch_q12/datafusion:parquet 476632409 678880675 0.70
tpch_q13/datafusion:parquet 608283905 746944155 0.81
tpch_q14/datafusion:parquet 520003864 433162837 1.20
tpch_q15/datafusion:parquet 703791065 738827493 0.95
tpch_q16/datafusion:parquet 310716193 320462277 0.97
tpch_q17/datafusion:parquet 832378416 835001615 1.00
tpch_q18/datafusion:parquet 1211791308 1250711109 0.97
tpch_q19/datafusion:parquet 497875940 494160981 1.01
tpch_q20/datafusion:parquet 1099534104 850427868 1.29
tpch_q21/datafusion:parquet 1224599511 1394727001 0.88
tpch_q22/datafusion:parquet 733183951 751729255 0.98
duckdb / vortex-compact / ns (0.960x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 627598484 598049508 1.05
tpch_q02/duckdb:vortex-compact 745037237 750039720 0.99
tpch_q03/duckdb:vortex-compact 734907801 827687558 0.89
tpch_q04/duckdb:vortex-compact 573090785 717619216 0.80
tpch_q05/duckdb:vortex-compact 918212328 1072263738 0.86
tpch_q06/duckdb:vortex-compact 632063787 615533611 1.03
tpch_q07/duckdb:vortex-compact 1039911232 1077843421 0.96
tpch_q08/duckdb:vortex-compact 1196994329 1305783542 0.92
tpch_q09/duckdb:vortex-compact 1331068157 1318674595 1.01
tpch_q10/duckdb:vortex-compact 1185321563 1097943492 1.08
tpch_q11/duckdb:vortex-compact 431192031 435907247 0.99
tpch_q12/duckdb:vortex-compact 1088304012 1124919677 0.97
tpch_q13/duckdb:vortex-compact 655034355 682687175 0.96
tpch_q14/duckdb:vortex-compact 609638350 605907575 1.01
tpch_q15/duckdb:vortex-compact 559909933 591096916 0.95
tpch_q16/duckdb:vortex-compact 303834998 302957620 1.00
tpch_q17/duckdb:vortex-compact 944348055 999471742 0.94
tpch_q18/duckdb:vortex-compact 685087171 683777977 1.00
tpch_q19/duckdb:vortex-compact 813418908 820316059 0.99
tpch_q20/duckdb:vortex-compact 1043596050 1139948017 0.92
tpch_q21/duckdb:vortex-compact 1999137208 1992066171 1.00
tpch_q22/duckdb:vortex-compact 313218955 364871489 0.86
duckdb / parquet / ns (0.936x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 9a482c0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 386594694 588944052 0.66
tpch_q02/duckdb:parquet 811111952 916593700 0.88
tpch_q03/duckdb:parquet 1006852866 1189126427 0.85
tpch_q04/duckdb:parquet 608883044 703298195 0.87
tpch_q05/duckdb:parquet 1211603603 1247443013 0.97
tpch_q06/duckdb:parquet 502111387 393318448 1.28
tpch_q07/duckdb:parquet 973912461 1201796750 0.81
tpch_q08/duckdb:parquet 1504370352 1511170797 1.00
tpch_q09/duckdb:parquet 1345035709 1465972572 0.92
tpch_q10/duckdb:parquet 2468786154 2536329929 0.97
tpch_q11/duckdb:parquet 514694299 556610680 0.92
tpch_q12/duckdb:parquet 657140961 744117050 0.88
tpch_q13/duckdb:parquet 1023792341 1008048938 1.02
tpch_q14/duckdb:parquet 689178981 739463665 0.93
tpch_q15/duckdb:parquet 564867883 451279102 1.25
tpch_q16/duckdb:parquet 659814601 768713021 0.86
tpch_q17/duckdb:parquet 643275277 680774589 0.94
tpch_q18/duckdb:parquet 928443290 930964008 1.00
tpch_q19/duckdb:parquet 889459979 868798399 1.02
tpch_q20/duckdb:parquet 1165547980 1235002479 0.94
tpch_q21/duckdb:parquet 1008949517 1132302833 0.89
tpch_q22/duckdb:parquet 879900666 959681276 0.92

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (-0.4%, environment too noisy confidence) · DuckDB No clear signal (+2.5%, environment too noisy confidence)
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.983x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 252706255 249634522 1.01
tpch_q02/datafusion:vortex-compact 427744293 489276263 0.87
tpch_q03/datafusion:vortex-compact 329524601 354454348 0.93
tpch_q04/datafusion:vortex-compact 169428892 197703622 0.86
tpch_q05/datafusion:vortex-compact 🚨 555289712 356453546 1.56
tpch_q06/datafusion:vortex-compact 316338749 307649443 1.03
tpch_q07/datafusion:vortex-compact 380708829 399022117 0.95
tpch_q08/datafusion:vortex-compact 508723861 551118212 0.92
tpch_q09/datafusion:vortex-compact 336498228 414915289 0.81
tpch_q10/datafusion:vortex-compact 412043741 383809473 1.07
tpch_q11/datafusion:vortex-compact 306906269 307464162 1.00
tpch_q12/datafusion:vortex-compact 286009991 328390414 0.87
tpch_q13/datafusion:vortex-compact 103771309 106945492 0.97
tpch_q14/datafusion:vortex-compact 178142713 184803334 0.96
tpch_q15/datafusion:vortex-compact 307378489 313114625 0.98
tpch_q16/datafusion:vortex-compact 188512546 186212327 1.01
tpch_q17/datafusion:vortex-compact 317551239 340161260 0.93
tpch_q18/datafusion:vortex-compact 267866967 264767027 1.01
tpch_q19/datafusion:vortex-compact 429940183 407904945 1.05
tpch_q20/datafusion:vortex-compact 330030193 336906133 0.98
tpch_q21/datafusion:vortex-compact 440557555 459754962 0.96
tpch_q22/datafusion:vortex-compact 141766296 135483725 1.05
datafusion / parquet / ns (0.987x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 211405119 225541634 0.94
tpch_q02/datafusion:parquet 309403122 282285334 1.10
tpch_q03/datafusion:parquet 410116451 346294465 1.18
tpch_q04/datafusion:parquet 176286033 166775514 1.06
tpch_q05/datafusion:parquet 381993116 369439043 1.03
tpch_q06/datafusion:parquet 136061451 138094153 0.99
tpch_q07/datafusion:parquet 373105294 384636833 0.97
tpch_q08/datafusion:parquet 440950484 464770930 0.95
tpch_q09/datafusion:parquet 486382141 468633263 1.04
tpch_q10/datafusion:parquet 437254694 412081074 1.06
tpch_q11/datafusion:parquet 284876851 292467623 0.97
tpch_q12/datafusion:parquet 209356482 216698496 0.97
tpch_q13/datafusion:parquet 456376269 451917580 1.01
tpch_q14/datafusion:parquet 182344058 179821199 1.01
tpch_q15/datafusion:parquet 279834437 289089026 0.97
tpch_q16/datafusion:parquet 124433108 124259854 1.00
tpch_q17/datafusion:parquet 314956853 353798714 0.89
tpch_q18/datafusion:parquet 446457322 497646916 0.90
tpch_q19/datafusion:parquet 198304337 217073596 0.91
tpch_q20/datafusion:parquet 267777727 330902405 0.81
tpch_q21/datafusion:parquet 429486979 440057427 0.98
tpch_q22/datafusion:parquet 182929778 175080526 1.04
duckdb / vortex-compact / ns (1.022x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 255026995 238582140 1.07
tpch_q02/duckdb:vortex-compact 616270751 575885695 1.07
tpch_q03/duckdb:vortex-compact 523638379 499192626 1.05
tpch_q04/duckdb:vortex-compact 305413271 264531103 1.15
tpch_q05/duckdb:vortex-compact 574207047 527717200 1.09
tpch_q06/duckdb:vortex-compact 297089920 275182580 1.08
tpch_q07/duckdb:vortex-compact 590825315 586617202 1.01
tpch_q08/duckdb:vortex-compact 741439305 709442362 1.05
tpch_q09/duckdb:vortex-compact 591941848 570375308 1.04
tpch_q10/duckdb:vortex-compact 505332140 475727540 1.06
tpch_q11/duckdb:vortex-compact 280309616 250938667 1.12
tpch_q12/duckdb:vortex-compact 473047779 479791569 0.99
tpch_q13/duckdb:vortex-compact 344976114 286232451 1.21
tpch_q14/duckdb:vortex-compact 267263191 258770438 1.03
tpch_q15/duckdb:vortex-compact 180648107 185801626 0.97
tpch_q16/duckdb:vortex-compact 222834899 256289453 0.87
tpch_q17/duckdb:vortex-compact 477226513 454040860 1.05
tpch_q18/duckdb:vortex-compact 342746501 416916206 0.82
tpch_q19/duckdb:vortex-compact 446930051 406402642 1.10
tpch_q20/duckdb:vortex-compact 498654485 524501406 0.95
tpch_q21/duckdb:vortex-compact 717529681 724459329 0.99
tpch_q22/duckdb:vortex-compact 151755721 185303794 0.82
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 695e068 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 331035578 333294292 0.99
tpch_q02/duckdb:parquet 661189442 708578251 0.93
tpch_q03/duckdb:parquet 787348072 792539670 0.99
tpch_q04/duckdb:parquet 486066583 512674343 0.95
tpch_q05/duckdb:parquet 953970794 962451778 0.99
tpch_q06/duckdb:parquet 313762606 366705790 0.86
tpch_q07/duckdb:parquet 853680348 877004728 0.97
tpch_q08/duckdb:parquet 1151754369 1122842969 1.03
tpch_q09/duckdb:parquet 1089025187 1108952793 0.98
tpch_q10/duckdb:parquet 1000232319 1040864619 0.96
tpch_q11/duckdb:parquet 422306926 469307234 0.90
tpch_q12/duckdb:parquet 555480809 545175510 1.02
tpch_q13/duckdb:parquet 858734728 865215110 0.99
tpch_q14/duckdb:parquet 535603262 561015722 0.95
tpch_q15/duckdb:parquet 477170755 385018430 1.24
tpch_q16/duckdb:parquet 540354565 518437966 1.04
tpch_q17/duckdb:parquet 514749620 508377468 1.01
tpch_q18/duckdb:parquet 697745286 689366063 1.01
tpch_q19/duckdb:parquet 602979243 587903503 1.03
tpch_q20/duckdb:parquet 949728241 915952357 1.04
tpch_q21/duckdb:parquet 779805756 741668029 1.05
tpch_q22/duckdb:parquet 445644365 430407400 1.04

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+1.0%, environment too noisy confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): 0.978x ➖
Parquet (geomean): 0.976x ➖
Shifts: Parquet (control) -2.4% · Median polish -1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.987x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-compact 199738420 221440725 0.90
clickbench-sorted_q24/datafusion:vortex-compact 57748849 55912284 1.03
clickbench-sorted_q26/datafusion:vortex-compact 52520624 52904739 0.99
clickbench-sorted_q36/datafusion:vortex-compact 57033370 58845178 0.97
clickbench-sorted_q37/datafusion:vortex-compact 50031175 49158840 1.02
clickbench-sorted_q38/datafusion:vortex-compact 46500544 45562783 1.02
clickbench-sorted_q39/datafusion:vortex-compact 105301672 105147535 1.00
clickbench-sorted_q40/datafusion:vortex-compact 26376240 27665106 0.95
clickbench-sorted_q41/datafusion:vortex-compact 23624164 24015247 0.98
clickbench-sorted_q42/datafusion:vortex-compact 17280566 17260526 1.00
datafusion / parquet / ns (0.977x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2912911966 2922433556 1.00
clickbench-sorted_q24/datafusion:parquet 🚀 30908906 35946252 0.86
clickbench-sorted_q26/datafusion:parquet 35543932 38017307 0.93
clickbench-sorted_q36/datafusion:parquet 175878863 189817390 0.93
clickbench-sorted_q37/datafusion:parquet 108424766 100387991 1.08
clickbench-sorted_q38/datafusion:parquet 167999007 164090667 1.02
clickbench-sorted_q39/datafusion:parquet 308858128 314765090 0.98
clickbench-sorted_q40/datafusion:parquet 71694804 71528470 1.00
clickbench-sorted_q41/datafusion:parquet 60328655 61876982 0.97
clickbench-sorted_q42/datafusion:parquet 34187927 33951870 1.01
duckdb / vortex-compact / ns (0.970x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-compact 251318511 253488671 0.99
clickbench-sorted_q24/duckdb:vortex-compact 55406237 57567077 0.96
clickbench-sorted_q26/duckdb:vortex-compact 91533965 97025466 0.94
clickbench-sorted_q36/duckdb:vortex-compact 70124722 72538817 0.97
clickbench-sorted_q37/duckdb:vortex-compact 60900079 58940450 1.03
clickbench-sorted_q38/duckdb:vortex-compact 61563814 62882981 0.98
clickbench-sorted_q39/duckdb:vortex-compact 115022550 112996772 1.02
clickbench-sorted_q40/duckdb:vortex-compact 40980310 41491815 0.99
clickbench-sorted_q41/duckdb:vortex-compact 40004767 42598673 0.94
clickbench-sorted_q42/duckdb:vortex-compact 🚀 29951525 33726444 0.89
duckdb / parquet / ns (0.974x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 69661e0 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 218700750 224299026 0.98
clickbench-sorted_q24/duckdb:parquet 29125177 30841158 0.94
clickbench-sorted_q26/duckdb:parquet 22685323 23301336 0.97
clickbench-sorted_q36/duckdb:parquet 67710416 71700392 0.94
clickbench-sorted_q37/duckdb:parquet 58540781 57209893 1.02
clickbench-sorted_q38/duckdb:parquet 61517713 62058996 0.99
clickbench-sorted_q39/duckdb:parquet 107947635 110731818 0.97
clickbench-sorted_q40/duckdb:parquet 29065892 30347155 0.96
clickbench-sorted_q41/duckdb:parquet 28103185 29367514 0.96
clickbench-sorted_q42/duckdb:parquet 20136449 20069416 1.00

File Size Changes (201 files changed, -57.2% overall, 48↑ 153↓)
File Scale Format Base HEAD Change %
hits_065.vortex 1.0 vortex-compact 123.94 MB 125.88 MB +1.93 MB +1.6%
hits_098.vortex 1.0 vortex-compact 102.91 MB 104.08 MB +1.17 MB +1.1%
hits_001.vortex 1.0 vortex-compact 137.70 MB 139.14 MB +1.43 MB +1.0%
hits_075.vortex 1.0 vortex-compact 137.83 MB 139.16 MB +1.33 MB +1.0%
hits_000.vortex 1.0 vortex-compact 98.23 MB 99.07 MB +860.31 KB +0.9%
hits_086.vortex 1.0 vortex-compact 139.69 MB 140.84 MB +1.15 MB +0.8%
hits_015.vortex 1.0 vortex-compact 97.69 MB 98.41 MB +740.48 KB +0.7%
hits_069.vortex 1.0 vortex-compact 99.54 MB 100.07 MB +542.75 KB +0.5%
hits_089.vortex 1.0 vortex-compact 98.80 MB 99.29 MB +506.10 KB +0.5%
hits_002.vortex 1.0 vortex-compact 125.30 MB 125.91 MB +630.74 KB +0.5%
hits_018.vortex 1.0 vortex-compact 152.90 MB 153.60 MB +711.55 KB +0.5%
hits_093.vortex 1.0 vortex-compact 97.96 MB 98.40 MB +455.25 KB +0.5%
hits_058.vortex 1.0 vortex-compact 110.98 MB 111.42 MB +451.01 KB +0.4%
hits_034.vortex 1.0 vortex-compact 133.34 MB 133.86 MB +535.11 KB +0.4%
hits_040.vortex 1.0 vortex-compact 110.03 MB 110.45 MB +436.12 KB +0.4%
hits_050.vortex 1.0 vortex-compact 125.99 MB 126.41 MB +437.88 KB +0.3%
hits_004.vortex 1.0 vortex-compact 98.65 MB 98.95 MB +309.66 KB +0.3%
hits_053.vortex 1.0 vortex-compact 138.55 MB 138.94 MB +401.11 KB +0.3%
hits_059.vortex 1.0 vortex-compact 152.07 MB 152.49 MB +429.41 KB +0.3%
hits_060.vortex 1.0 vortex-compact 141.18 MB 141.56 MB +390.60 KB +0.3%
hits_087.vortex 1.0 vortex-compact 125.48 MB 125.78 MB +307.32 KB +0.2%
hits_092.vortex 1.0 vortex-compact 153.15 MB 153.49 MB +346.91 KB +0.2%
hits_003.vortex 1.0 vortex-compact 104.54 MB 104.75 MB +212.55 KB +0.2%
hits_074.vortex 1.0 vortex-compact 153.00 MB 153.25 MB +254.55 KB +0.2%
hits_023.vortex 1.0 vortex-compact 142.61 MB 142.76 MB +149.59 KB +0.1%
hits_026.vortex 1.0 vortex-compact 98.10 MB 98.20 MB +100.23 KB +0.1%
hits_044.vortex 1.0 vortex-compact 153.60 MB 153.73 MB +137.85 KB +0.1%
hits_013.vortex 1.0 vortex-compact 124.25 MB 124.35 MB +101.20 KB +0.1%
hits_051.vortex 1.0 vortex-compact 134.01 MB 134.12 MB +105.21 KB +0.1%
hits_046.vortex 1.0 vortex-compact 74.93 MB 74.99 MB +58.72 KB +0.1%
hits_070.vortex 1.0 vortex-compact 153.83 MB 153.94 MB +107.93 KB +0.1%
hits_043.vortex 1.0 vortex-compact 94.33 MB 94.39 MB +60.65 KB +0.1%
hits_073.vortex 1.0 vortex-compact 134.19 MB 134.26 MB +74.16 KB +0.1%
hits_008.vortex 1.0 vortex-compact 106.14 MB 106.20 MB +53.80 KB +0.0%
hits_081.vortex 1.0 vortex-compact 153.82 MB 153.88 MB +59.13 KB +0.0%
hits_045.vortex 1.0 vortex-compact 106.05 MB 106.09 MB +34.06 KB +0.0%
hits_090.vortex 1.0 vortex-compact 141.25 MB 141.30 MB +43.80 KB +0.0%
hits_099.vortex 1.0 vortex-compact 133.16 MB 133.20 MB +38.88 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.94 MB 75.96 MB +16.44 KB +0.0%
hits_021.vortex 1.0 vortex-compact 110.62 MB 110.64 MB +22.12 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.24 MB 136.26 MB +19.77 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.67 MB 110.69 MB +15.80 KB +0.0%
hits_032.vortex 1.0 vortex-compact 110.61 MB 110.62 MB +12.17 KB +0.0%
hits_088.vortex 1.0 vortex-compact 134.12 MB 134.14 MB +14.59 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.81 MB 111.82 MB +11.50 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.47 MB 110.48 MB +4.91 KB +0.0%
hits_036.vortex 1.0 vortex-compact 133.23 MB 133.24 MB +5.84 KB +0.0%
hits_095.vortex 1.0 vortex-compact 110.64 MB 110.65 MB +2.19 KB +0.0%
hits_011.vortex 1.0 vortex-compact 152.96 MB 152.96 MB 1.40 KB -0.0%
hits_068.vortex 1.0 vortex-compact 112.50 MB 112.49 MB 6.04 KB -0.0%
hits_064.vortex 1.0 vortex-compact 140.17 MB 140.16 MB 10.04 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.64 MB 106.62 MB 14.73 KB -0.0%
hits_024.vortex 1.0 vortex-compact 123.94 MB 123.92 MB 17.48 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 75.23 MB 13.73 KB -0.0%
hits_094.vortex 1.0 vortex-compact 110.80 MB 110.77 MB 26.05 KB -0.0%
hits_078.vortex 1.0 vortex-compact 97.93 MB 97.91 MB 28.68 KB -0.0%
hits_006.vortex 1.0 vortex-compact 96.15 MB 96.10 MB 48.56 KB -0.0%
hits_054.vortex 1.0 vortex-compact 112.12 MB 112.07 MB 59.84 KB -0.1%
hits_048.vortex 1.0 vortex-compact 153.36 MB 153.27 MB 84.62 KB -0.1%
hits_005.vortex 1.0 vortex-compact 115.93 MB 115.87 MB 64.51 KB -0.1%
hits_020.vortex 1.0 vortex-compact 111.67 MB 111.60 MB 64.51 KB -0.1%
hits_072.vortex 1.0 vortex-compact 75.66 MB 75.62 MB 44.70 KB -0.1%
hits_007.vortex 1.0 vortex-compact 153.76 MB 153.67 MB 91.90 KB -0.1%
hits_029.vortex 1.0 vortex-compact 153.55 MB 153.45 MB 99.09 KB -0.1%
hits_096.vortex 1.0 vortex-compact 153.21 MB 153.11 MB 99.16 KB -0.1%
hits_027.vortex 1.0 vortex-compact 139.34 MB 139.24 MB 104.62 KB -0.1%
hits_049.vortex 1.0 vortex-compact 140.59 MB 140.48 MB 113.97 KB -0.1%
hits_016.vortex 1.0 vortex-compact 127.62 MB 127.52 MB 104.97 KB -0.1%
hits_055.vortex 1.0 vortex-compact 153.36 MB 153.24 MB 126.64 KB -0.1%
hits_079.vortex 1.0 vortex-compact 127.99 MB 127.89 MB 108.16 KB -0.1%
hits_083.vortex 1.0 vortex-compact 110.10 MB 110.01 MB 93.43 KB -0.1%
hits_012.vortex 1.0 vortex-compact 140.07 MB 139.95 MB 119.16 KB -0.1%
hits_031.vortex 1.0 vortex-compact 111.70 MB 111.60 MB 97.67 KB -0.1%
hits_091.vortex 1.0 vortex-compact 112.40 MB 112.30 MB 104.52 KB -0.1%
hits_014.vortex 1.0 vortex-compact 134.05 MB 133.90 MB 146.42 KB -0.1%
hits_067.vortex 1.0 vortex-compact 99.31 MB 99.20 MB 112.67 KB -0.1%
hits_038.vortex 1.0 vortex-compact 139.60 MB 139.44 MB 170.19 KB -0.1%
hits_017.vortex 1.0 vortex-compact 111.76 MB 111.62 MB 141.34 KB -0.1%
hits_062.vortex 1.0 vortex-compact 132.77 MB 132.58 MB 194.45 KB -0.1%
hits_010.vortex 1.0 vortex-compact 123.50 MB 123.30 MB 208.14 KB -0.2%
hits_037.vortex 1.0 vortex-compact 132.51 MB 132.26 MB 251.19 KB -0.2%
hits_085.vortex 1.0 vortex-compact 153.51 MB 153.22 MB 301.48 KB -0.2%
hits_033.vortex 1.0 vortex-compact 153.74 MB 153.43 MB 321.70 KB -0.2%
hits_077.vortex 1.0 vortex-compact 134.40 MB 134.12 MB 294.27 KB -0.2%
hits_028.vortex 1.0 vortex-compact 116.03 MB 115.75 MB 284.08 KB -0.2%
hits_025.vortex 1.0 vortex-compact 133.71 MB 133.37 MB 341.02 KB -0.2%
hits_061.vortex 1.0 vortex-compact 123.91 MB 123.44 MB 477.91 KB -0.4%
hits_071.vortex 1.0 vortex-compact 106.23 MB 105.76 MB 474.66 KB -0.4%
hits_066.vortex 1.0 vortex-compact 117.44 MB 116.92 MB 530.43 KB -0.4%
hits_056.vortex 1.0 vortex-compact 101.33 MB 100.88 MB 459.79 KB -0.4%
hits_097.vortex 1.0 vortex-compact 140.77 MB 140.14 MB 648.34 KB -0.4%
hits_076.vortex 1.0 vortex-compact 126.03 MB 125.43 MB 617.22 KB -0.5%
hits_039.vortex 1.0 vortex-compact 124.40 MB 123.79 MB 625.02 KB -0.5%
hits_082.vortex 1.0 vortex-compact 106.34 MB 105.80 MB 556.04 KB -0.5%
hits_041.vortex 1.0 vortex-compact 98.64 MB 98.11 MB 541.73 KB -0.5%
hits_022.vortex 1.0 vortex-compact 153.21 MB 152.32 MB 913.07 KB -0.6%
hits_052.vortex 1.0 vortex-compact 98.02 MB 97.43 MB 612.41 KB -0.6%
hits_063.vortex 1.0 vortex-compact 98.49 MB 97.88 MB 630.23 KB -0.6%
hits_030.vortex 1.0 vortex-compact 99.02 MB 98.08 MB 968.21 KB -1.0%
hits_080.vortex 1.0 vortex-compact 96.81 MB 94.77 MB 2.04 MB -2.1%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-file-compressed 131.51 MB 0 B 131.51 MB -100.0%
hits_001.vortex 1.0 vortex-file-compressed 189.34 MB 0 B 189.34 MB -100.0%
hits_002.vortex 1.0 vortex-file-compressed 161.19 MB 0 B 161.19 MB -100.0%
hits_003.vortex 1.0 vortex-file-compressed 136.61 MB 0 B 136.61 MB -100.0%
hits_004.vortex 1.0 vortex-file-compressed 131.56 MB 0 B 131.56 MB -100.0%
hits_005.vortex 1.0 vortex-file-compressed 167.58 MB 0 B 167.58 MB -100.0%
hits_006.vortex 1.0 vortex-file-compressed 126.42 MB 0 B 126.42 MB -100.0%
hits_007.vortex 1.0 vortex-file-compressed 200.17 MB 0 B 200.17 MB -100.0%
hits_008.vortex 1.0 vortex-file-compressed 140.21 MB 0 B 140.21 MB -100.0%
hits_009.vortex 1.0 vortex-file-compressed 101.25 MB 0 B 101.25 MB -100.0%
hits_010.vortex 1.0 vortex-file-compressed 169.08 MB 0 B 169.08 MB -100.0%
hits_011.vortex 1.0 vortex-file-compressed 199.20 MB 0 B 199.20 MB -100.0%
hits_012.vortex 1.0 vortex-file-compressed 191.16 MB 0 B 191.16 MB -100.0%
hits_013.vortex 1.0 vortex-file-compressed 161.92 MB 0 B 161.92 MB -100.0%
hits_014.vortex 1.0 vortex-file-compressed 172.02 MB 0 B 172.02 MB -100.0%
hits_015.vortex 1.0 vortex-file-compressed 131.07 MB 0 B 131.07 MB -100.0%
hits_016.vortex 1.0 vortex-file-compressed 180.30 MB 0 B 180.30 MB -100.0%
hits_017.vortex 1.0 vortex-file-compressed 146.76 MB 0 B 146.76 MB -100.0%
hits_018.vortex 1.0 vortex-file-compressed 199.81 MB 0 B 199.81 MB -100.0%
hits_019.vortex 1.0 vortex-file-compressed 141.01 MB 0 B 141.01 MB -100.0%
hits_020.vortex 1.0 vortex-file-compressed 160.28 MB 0 B 160.28 MB -100.0%
hits_021.vortex 1.0 vortex-file-compressed 154.71 MB 0 B 154.71 MB -100.0%
hits_022.vortex 1.0 vortex-file-compressed 199.60 MB 0 B 199.60 MB -100.0%
hits_023.vortex 1.0 vortex-file-compressed 195.32 MB 0 B 195.32 MB -100.0%
hits_024.vortex 1.0 vortex-file-compressed 160.52 MB 0 B 160.52 MB -100.0%
hits_025.vortex 1.0 vortex-file-compressed 172.04 MB 0 B 172.04 MB -100.0%
hits_026.vortex 1.0 vortex-file-compressed 131.81 MB 0 B 131.81 MB -100.0%
hits_027.vortex 1.0 vortex-file-compressed 189.81 MB 0 B 189.81 MB -100.0%
hits_028.vortex 1.0 vortex-file-compressed 151.76 MB 0 B 151.76 MB -100.0%
hits_029.vortex 1.0 vortex-file-compressed 198.08 MB 0 B 198.08 MB -100.0%
hits_030.vortex 1.0 vortex-file-compressed 131.72 MB 0 B 131.72 MB -100.0%
hits_031.vortex 1.0 vortex-file-compressed 159.60 MB 0 B 159.60 MB -100.0%
hits_032.vortex 1.0 vortex-file-compressed 154.72 MB 0 B 154.72 MB -100.0%
hits_033.vortex 1.0 vortex-file-compressed 200.12 MB 0 B 200.12 MB -100.0%
hits_034.vortex 1.0 vortex-file-compressed 183.91 MB 0 B 183.91 MB -100.0%
hits_035.vortex 1.0 vortex-file-compressed 102.90 MB 0 B 102.90 MB -100.0%
hits_036.vortex 1.0 vortex-file-compressed 171.37 MB 0 B 171.37 MB -100.0%
hits_037.vortex 1.0 vortex-file-compressed 177.18 MB 0 B 177.18 MB -100.0%
hits_038.vortex 1.0 vortex-file-compressed 190.37 MB 0 B 190.37 MB -100.0%
hits_039.vortex 1.0 vortex-file-compressed 161.11 MB 0 B 161.11 MB -100.0%
hits_040.vortex 1.0 vortex-file-compressed 142.96 MB 0 B 142.96 MB -100.0%
hits_041.vortex 1.0 vortex-file-compressed 131.29 MB 0 B 131.29 MB -100.0%
hits_042.vortex 1.0 vortex-file-compressed 202.04 MB 0 B 202.04 MB -100.0%
hits_043.vortex 1.0 vortex-file-compressed 126.50 MB 0 B 126.50 MB -100.0%
hits_044.vortex 1.0 vortex-file-compressed 200.54 MB 0 B 200.54 MB -100.0%
hits_045.vortex 1.0 vortex-file-compressed 140.10 MB 0 B 140.10 MB -100.0%
hits_046.vortex 1.0 vortex-file-compressed 101.29 MB 0 B 101.29 MB -100.0%
hits_047.vortex 1.0 vortex-file-compressed 154.48 MB 0 B 154.48 MB -100.0%
hits_048.vortex 1.0 vortex-file-compressed 199.90 MB 0 B 199.90 MB -100.0%
hits_049.vortex 1.0 vortex-file-compressed 191.71 MB 0 B 191.71 MB -100.0%
hits_050.vortex 1.0 vortex-file-compressed 161.04 MB 0 B 161.04 MB -100.0%
hits_051.vortex 1.0 vortex-file-compressed 172.31 MB 0 B 172.31 MB -100.0%
hits_052.vortex 1.0 vortex-file-compressed 131.01 MB 0 B 131.01 MB -100.0%
hits_053.vortex 1.0 vortex-file-compressed 190.08 MB 0 B 190.08 MB -100.0%
hits_054.vortex 1.0 vortex-file-compressed 146.84 MB 0 B 146.84 MB -100.0%
hits_055.vortex 1.0 vortex-file-compressed 198.69 MB 0 B 198.69 MB -100.0%
hits_056.vortex 1.0 vortex-file-compressed 135.73 MB 0 B 135.73 MB -100.0%
hits_057.vortex 1.0 vortex-file-compressed 159.96 MB 0 B 159.96 MB -100.0%
hits_058.vortex 1.0 vortex-file-compressed 155.18 MB 0 B 155.18 MB -100.0%
hits_059.vortex 1.0 vortex-file-compressed 199.18 MB 0 B 199.18 MB -100.0%
hits_060.vortex 1.0 vortex-file-compressed 193.28 MB 0 B 193.28 MB -100.0%
hits_061.vortex 1.0 vortex-file-compressed 160.50 MB 0 B 160.50 MB -100.0%
hits_062.vortex 1.0 vortex-file-compressed 171.10 MB 0 B 171.10 MB -100.0%
hits_063.vortex 1.0 vortex-file-compressed 131.84 MB 0 B 131.84 MB -100.0%
hits_064.vortex 1.0 vortex-file-compressed 191.28 MB 0 B 191.28 MB -100.0%
hits_065.vortex 1.0 vortex-file-compressed 161.39 MB 0 B 161.39 MB -100.0%
hits_066.vortex 1.0 vortex-file-compressed 163.68 MB 0 B 163.68 MB -100.0%
hits_067.vortex 1.0 vortex-file-compressed 131.79 MB 0 B 131.79 MB -100.0%
hits_068.vortex 1.0 vortex-file-compressed 161.08 MB 0 B 161.08 MB -100.0%
hits_069.vortex 1.0 vortex-file-compressed 142.34 MB 0 B 142.34 MB -100.0%
hits_070.vortex 1.0 vortex-file-compressed 199.69 MB 0 B 199.69 MB -100.0%
hits_071.vortex 1.0 vortex-file-compressed 140.09 MB 0 B 140.09 MB -100.0%
hits_072.vortex 1.0 vortex-file-compressed 102.85 MB 0 B 102.85 MB -100.0%
hits_073.vortex 1.0 vortex-file-compressed 172.74 MB 0 B 172.74 MB -100.0%
hits_074.vortex 1.0 vortex-file-compressed 199.34 MB 0 B 199.34 MB -100.0%
hits_075.vortex 1.0 vortex-file-compressed 189.68 MB 0 B 189.68 MB -100.0%
hits_076.vortex 1.0 vortex-file-compressed 161.05 MB 0 B 161.05 MB -100.0%
hits_077.vortex 1.0 vortex-file-compressed 173.12 MB 0 B 173.12 MB -100.0%
hits_078.vortex 1.0 vortex-file-compressed 131.13 MB 0 B 131.13 MB -100.0%
hits_079.vortex 1.0 vortex-file-compressed 181.52 MB 0 B 181.52 MB -100.0%
hits_080.vortex 1.0 vortex-file-compressed 126.89 MB 0 B 126.89 MB -100.0%
hits_081.vortex 1.0 vortex-file-compressed 200.23 MB 0 B 200.23 MB -100.0%
hits_082.vortex 1.0 vortex-file-compressed 140.49 MB 0 B 140.49 MB -100.0%
hits_083.vortex 1.0 vortex-file-compressed 157.14 MB 0 B 157.14 MB -100.0%
hits_084.vortex 1.0 vortex-file-compressed 154.45 MB 0 B 154.45 MB -100.0%
hits_085.vortex 1.0 vortex-file-compressed 199.69 MB 0 B 199.69 MB -100.0%
hits_086.vortex 1.0 vortex-file-compressed 192.51 MB 0 B 192.51 MB -100.0%
hits_087.vortex 1.0 vortex-file-compressed 159.69 MB 0 B 159.69 MB -100.0%
hits_088.vortex 1.0 vortex-file-compressed 172.71 MB 0 B 172.71 MB -100.0%
hits_089.vortex 1.0 vortex-file-compressed 131.48 MB 0 B 131.48 MB -100.0%
hits_090.vortex 1.0 vortex-file-compressed 192.75 MB 0 B 192.75 MB -100.0%
hits_091.vortex 1.0 vortex-file-compressed 146.98 MB 0 B 146.98 MB -100.0%
hits_092.vortex 1.0 vortex-file-compressed 199.63 MB 0 B 199.63 MB -100.0%
hits_093.vortex 1.0 vortex-file-compressed 131.70 MB 0 B 131.70 MB -100.0%
hits_094.vortex 1.0 vortex-file-compressed 158.76 MB 0 B 158.76 MB -100.0%
hits_095.vortex 1.0 vortex-file-compressed 154.37 MB 0 B 154.37 MB -100.0%
hits_096.vortex 1.0 vortex-file-compressed 199.72 MB 0 B 199.72 MB -100.0%
hits_097.vortex 1.0 vortex-file-compressed 192.82 MB 0 B 192.82 MB -100.0%
hits_098.vortex 1.0 vortex-file-compressed 137.77 MB 0 B 137.77 MB -100.0%
hits_099.vortex 1.0 vortex-file-compressed 171.12 MB 0 B 171.12 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (+0.0%)
  • vortex-file-compressed: 15.96 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-compact / ns (0.996x ➖, 1↑ 2↓)
name PR 6380aa5 (ns) base 7ad0d9d (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 13456547 14381977 0.94
statpopgen_q01/duckdb:vortex-compact 17665310 16308944 1.08
statpopgen_q02/duckdb:vortex-compact 🚨 733275850 635673634 1.15
statpopgen_q03/duckdb:vortex-compact 1863283118 1847256155 1.01
statpopgen_q04/duckdb:vortex-compact 1407335800 1387275169 1.01
statpopgen_q05/duckdb:vortex-compact 🚀 680723656 878183269 0.78
statpopgen_q06/duckdb:vortex-compact 2463275360 2637455073 0.93
statpopgen_q07/duckdb:vortex-compact 1100833526 1063322434 1.04
statpopgen_q08/duckdb:vortex-compact 1102596498 1134633155 0.97
statpopgen_q09/duckdb:vortex-compact 🚨 1294684438 1124490788 1.15
statpopgen_q10/duckdb:vortex-compact 2934959843 3078642413 0.95
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 7ad0d9d (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 376895795 375776483 1.00
statpopgen_q01/duckdb:parquet 466780169 466810968 1.00
statpopgen_q02/duckdb:parquet 782942817 785895897 1.00
statpopgen_q03/duckdb:parquet 1057913575 1067433235 0.99
statpopgen_q04/duckdb:parquet 1063959746 1069791041 0.99
statpopgen_q05/duckdb:parquet 770280451 774285551 0.99
statpopgen_q06/duckdb:parquet 1024564187 1028154174 1.00
statpopgen_q07/duckdb:parquet 954252913 954638517 1.00
statpopgen_q08/duckdb:parquet 968378801 960159897 1.01
statpopgen_q09/duckdb:parquet 1005160616 1018871841 0.99
statpopgen_q10/duckdb:parquet 1659654857 1663312824 1.00

File Size Changes (2 files changed, -67.7% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 0 B 1.96 GB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 960.92 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+6.1%, environment too noisy confidence) · DuckDB No clear signal (-3.9%, low confidence)
Vortex (geomean): 1.034x ➖
Parquet (geomean): 1.024x ➖
Shifts: Parquet (control) +2.4% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.091x ➖, 0↑ 3↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 253641447 251198949 1.01
tpch_q02/datafusion:vortex-file-compressed 436293246 447478870 0.98
tpch_q03/datafusion:vortex-file-compressed 343222674 354188515 0.97
tpch_q04/datafusion:vortex-file-compressed 176709850 208334278 0.85
tpch_q05/datafusion:vortex-file-compressed 353042456 384946004 0.92
tpch_q06/datafusion:vortex-file-compressed 305326706 269150668 1.13
tpch_q07/datafusion:vortex-file-compressed 422995117 437552225 0.97
tpch_q08/datafusion:vortex-file-compressed 595634387 527759969 1.13
tpch_q09/datafusion:vortex-file-compressed 366075228 389578937 0.94
tpch_q10/datafusion:vortex-file-compressed 416326346 378439058 1.10
tpch_q11/datafusion:vortex-file-compressed 346382050 300483911 1.15
tpch_q12/datafusion:vortex-file-compressed 🚨 535820601 344233197 1.56
tpch_q13/datafusion:vortex-file-compressed 157391674 125249772 1.26
tpch_q14/datafusion:vortex-file-compressed 🚨 268772337 195945862 1.37
tpch_q15/datafusion:vortex-file-compressed 364913816 305776713 1.19
tpch_q16/datafusion:vortex-file-compressed 216164147 209428504 1.03
tpch_q17/datafusion:vortex-file-compressed 411480440 330715300 1.24
tpch_q18/datafusion:vortex-file-compressed 291281691 310316686 0.94
tpch_q19/datafusion:vortex-file-compressed 411563868 365258774 1.13
tpch_q20/datafusion:vortex-file-compressed 🚨 520126951 393075848 1.32
tpch_q21/datafusion:vortex-file-compressed 477145737 515954682 0.92
tpch_q22/datafusion:vortex-file-compressed 167689764 144383450 1.16
datafusion / parquet / ns (1.028x ➖, 0↑ 1↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 278850855 285823629 0.98
tpch_q02/datafusion:parquet 297806020 283495991 1.05
tpch_q03/datafusion:parquet 314204652 336407668 0.93
tpch_q04/datafusion:parquet 176630074 157009212 1.12
tpch_q05/datafusion:parquet 393810312 388569986 1.01
tpch_q06/datafusion:parquet 161500944 207522357 0.78
tpch_q07/datafusion:parquet 440969718 392601820 1.12
tpch_q08/datafusion:parquet 461662178 444901272 1.04
tpch_q09/datafusion:parquet 492434865 485908520 1.01
tpch_q10/datafusion:parquet 422760706 436028711 0.97
tpch_q11/datafusion:parquet 297803265 324871261 0.92
tpch_q12/datafusion:parquet 215577394 227210743 0.95
tpch_q13/datafusion:parquet 456266191 456718372 1.00
tpch_q14/datafusion:parquet 179687650 185719026 0.97
tpch_q15/datafusion:parquet 297810836 295802062 1.01
tpch_q16/datafusion:parquet 124143850 125744212 0.99
tpch_q17/datafusion:parquet 327303794 326092020 1.00
tpch_q18/datafusion:parquet 451245234 461627420 0.98
tpch_q19/datafusion:parquet 210639039 202240134 1.04
tpch_q20/datafusion:parquet 🚨 453990050 293858024 1.54
tpch_q21/datafusion:parquet 574612920 483956643 1.19
tpch_q22/datafusion:parquet 212002304 176897969 1.20
duckdb / vortex-file-compressed / ns (0.981x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 298708756 262180934 1.14
tpch_q02/duckdb:vortex-file-compressed 599574576 642354433 0.93
tpch_q03/duckdb:vortex-file-compressed 589864537 484674971 1.22
tpch_q04/duckdb:vortex-file-compressed 303153602 337328960 0.90
tpch_q05/duckdb:vortex-file-compressed 525205232 598480656 0.88
tpch_q06/duckdb:vortex-file-compressed 275184213 275104099 1.00
tpch_q07/duckdb:vortex-file-compressed 622151521 582045410 1.07
tpch_q08/duckdb:vortex-file-compressed 764756410 743403533 1.03
tpch_q09/duckdb:vortex-file-compressed 578550303 637046129 0.91
tpch_q10/duckdb:vortex-file-compressed 479122692 566220578 0.85
tpch_q11/duckdb:vortex-file-compressed 276184751 332412652 0.83
tpch_q12/duckdb:vortex-file-compressed 497895649 598631585 0.83
tpch_q13/duckdb:vortex-file-compressed 315293077 336729036 0.94
tpch_q14/duckdb:vortex-file-compressed 273037719 278446271 0.98
tpch_q15/duckdb:vortex-file-compressed 179702141 213781294 0.84
tpch_q16/duckdb:vortex-file-compressed 242287127 237431488 1.02
tpch_q17/duckdb:vortex-file-compressed 469534356 489570668 0.96
tpch_q18/duckdb:vortex-file-compressed 412105461 378641845 1.09
tpch_q19/duckdb:vortex-file-compressed 353574666 359873732 0.98
tpch_q20/duckdb:vortex-file-compressed 526223873 512375866 1.03
tpch_q21/duckdb:vortex-file-compressed 856710016 733159687 1.17
tpch_q22/duckdb:vortex-file-compressed 174569870 154657420 1.13
duckdb / parquet / ns (1.021x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 359930894 347154661 1.04
tpch_q02/duckdb:parquet 740683307 707351081 1.05
tpch_q03/duckdb:parquet 836445892 835658422 1.00
tpch_q04/duckdb:parquet 515223871 561993906 0.92
tpch_q05/duckdb:parquet 1026817611 1053657433 0.97
tpch_q06/duckdb:parquet 338993619 303971156 1.12
tpch_q07/duckdb:parquet 989648600 887880990 1.11
tpch_q08/duckdb:parquet 1189449603 1161182916 1.02
tpch_q09/duckdb:parquet 1189081093 1190913701 1.00
tpch_q10/duckdb:parquet 1041737995 1052813294 0.99
tpch_q11/duckdb:parquet 453244107 466486732 0.97
tpch_q12/duckdb:parquet 594933419 584350640 1.02
tpch_q13/duckdb:parquet 856760471 852948392 1.00
tpch_q14/duckdb:parquet 520138841 521334087 1.00
tpch_q15/duckdb:parquet 420166143 398525607 1.05
tpch_q16/duckdb:parquet 553273379 553685458 1.00
tpch_q17/duckdb:parquet 547570518 537305520 1.02
tpch_q18/duckdb:parquet 713559454 693860410 1.03
tpch_q19/duckdb:parquet 645304238 597985651 1.08
tpch_q20/duckdb:parquet 896312514 917262419 0.98
tpch_q21/duckdb:parquet 821305911 784734278 1.05
tpch_q22/duckdb:parquet 507692813 473309284 1.07

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 365396696 363907183 1.00
tpch_q02/datafusion:vortex-file-compressed 109051963 105720778 1.03
tpch_q03/datafusion:vortex-file-compressed 184150137 188509657 0.98
tpch_q04/datafusion:vortex-file-compressed 99371957 98767844 1.01
tpch_q05/datafusion:vortex-file-compressed 320863972 296562067 1.08
tpch_q06/datafusion:vortex-file-compressed 51058655 50956484 1.00
tpch_q07/datafusion:vortex-file-compressed 396253376 394096868 1.01
tpch_q08/datafusion:vortex-file-compressed 317773315 331157591 0.96
tpch_q09/datafusion:vortex-file-compressed 502384272 511767067 0.98
tpch_q10/datafusion:vortex-file-compressed 214308612 218654287 0.98
tpch_q11/datafusion:vortex-file-compressed 77515453 75018032 1.03
tpch_q12/datafusion:vortex-file-compressed 122042686 118942331 1.03
tpch_q13/datafusion:vortex-file-compressed 126187521 123925782 1.02
tpch_q14/datafusion:vortex-file-compressed 64551803 65095251 0.99
tpch_q15/datafusion:vortex-file-compressed 123984241 119700763 1.04
tpch_q16/datafusion:vortex-file-compressed 76446292 72741310 1.05
tpch_q17/datafusion:vortex-file-compressed 471552176 489804865 0.96
tpch_q18/datafusion:vortex-file-compressed 695385873 675070470 1.03
tpch_q19/datafusion:vortex-file-compressed 95803085 104284661 0.92
tpch_q20/datafusion:vortex-file-compressed 160664583 161826659 0.99
tpch_q21/datafusion:vortex-file-compressed 542394176 551995787 0.98
tpch_q22/datafusion:vortex-file-compressed 50099851 49667942 1.01
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 322269398 323374830 1.00
tpch_q02/datafusion:parquet 221308282 214433185 1.03
tpch_q03/datafusion:parquet 226214236 228533225 0.99
tpch_q04/datafusion:parquet 99922103 98646610 1.01
tpch_q05/datafusion:parquet 361872075 368557327 0.98
tpch_q06/datafusion:parquet 73363604 71702490 1.02
tpch_q07/datafusion:parquet 520842215 529704933 0.98
tpch_q08/datafusion:parquet 415988543 408844597 1.02
tpch_q09/datafusion:parquet 662597377 685927621 0.97
tpch_q10/datafusion:parquet 532624211 556575099 0.96
tpch_q11/datafusion:parquet 154005842 158122069 0.97
tpch_q12/datafusion:parquet 148577918 149167567 1.00
tpch_q13/datafusion:parquet 347476997 353120362 0.98
tpch_q14/datafusion:parquet 117959281 119807748 0.98
tpch_q15/datafusion:parquet 192371920 186444808 1.03
tpch_q16/datafusion:parquet 136336099 139584975 0.98
tpch_q17/datafusion:parquet 510952438 504473703 1.01
tpch_q18/datafusion:parquet 706195166 697723594 1.01
tpch_q19/datafusion:parquet 202121001 206953010 0.98
tpch_q20/datafusion:parquet 308703725 306513208 1.01
tpch_q21/datafusion:parquet 537058798 549697890 0.98
tpch_q22/datafusion:parquet 258832560 260410769 0.99
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 90862701 88907676 1.02
tpch_q02/duckdb:vortex-file-compressed 70800694 74093098 0.96
tpch_q03/duckdb:vortex-file-compressed 136677716 140433959 0.97
tpch_q04/duckdb:vortex-file-compressed 165746224 166446116 1.00
tpch_q05/duckdb:vortex-file-compressed 153972921 152662278 1.01
tpch_q06/duckdb:vortex-file-compressed 40069299 40535170 0.99
tpch_q07/duckdb:vortex-file-compressed 140549198 140002394 1.00
tpch_q08/duckdb:vortex-file-compressed 183208528 182525593 1.00
tpch_q09/duckdb:vortex-file-compressed 293108914 303923237 0.96
tpch_q10/duckdb:vortex-file-compressed 222516651 224177931 0.99
tpch_q11/duckdb:vortex-file-compressed 42035085 41674362 1.01
tpch_q12/duckdb:vortex-file-compressed 120458665 116565408 1.03
tpch_q13/duckdb:vortex-file-compressed 172712028 170410610 1.01
tpch_q14/duckdb:vortex-file-compressed 60440001 61700760 0.98
tpch_q15/duckdb:vortex-file-compressed 93344200 92232282 1.01
tpch_q16/duckdb:vortex-file-compressed 83337525 86575358 0.96
tpch_q17/duckdb:vortex-file-compressed 107019072 107671609 0.99
tpch_q18/duckdb:vortex-file-compressed 260324549 260001660 1.00
tpch_q19/duckdb:vortex-file-compressed 85978660 83718389 1.03
tpch_q20/duckdb:vortex-file-compressed 152779898 150015512 1.02
tpch_q21/duckdb:vortex-file-compressed 500284885 487510503 1.03
tpch_q22/duckdb:vortex-file-compressed 79020964 76328854 1.04
duckdb / parquet / ns (1.003x ➖, 1↑ 0↓)
name PR 6380aa5 (ns) base 8f5d671 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 128072562 143463396 0.89
tpch_q02/duckdb:parquet 101175910 99124694 1.02
tpch_q03/duckdb:parquet 160785612 166087847 0.97
tpch_q04/duckdb:parquet 120838621 117977326 1.02
tpch_q05/duckdb:parquet 188209455 188269446 1.00
tpch_q06/duckdb:parquet 55522726 54882975 1.01
tpch_q07/duckdb:parquet 150199455 141811378 1.06
tpch_q08/duckdb:parquet 220312323 214629079 1.03
tpch_q09/duckdb:parquet 348773959 348545291 1.00
tpch_q10/duckdb:parquet 657366278 654986653 1.00
tpch_q11/duckdb:parquet 41629085 40740723 1.02
tpch_q12/duckdb:parquet 117232934 127658716 0.92
tpch_q13/duckdb:parquet 397081811 396674997 1.00
tpch_q14/duckdb:parquet 150825118 152793569 0.99
tpch_q15/duckdb:parquet 78205789 76398939 1.02
tpch_q16/duckdb:parquet 154875718 153543996 1.01
tpch_q17/duckdb:parquet 127666124 120144451 1.06
tpch_q18/duckdb:parquet 293515106 278576236 1.05
tpch_q19/duckdb:parquet 237385731 236058500 1.01
tpch_q20/duckdb:parquet 197464918 197384910 1.00
tpch_q21/duckdb:parquet 427190436 435109627 0.98
tpch_q22/duckdb:parquet 335400051 334733586 1.00

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 8.01 KB 0 B 8.01 KB -100.0%
orders.vortex 10.0 vortex-compact 344.31 MB 0 B 344.31 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 6.06 KB 0 B 6.06 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants