Skip to content

bench(statpopgen): run the suite on DataFusion as well as DuckDB - #10212

Merged
joseph-isaacs merged 8 commits into
developfrom
ji/statpopgen-datafusion
Oct 2, 2026
Merged

joseph-isaacs merged 8 commits into
developfrom
ji/statpopgen-datafusion

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 2, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Stacked on #10215 (Vortex projection-pushdown fix for lambdas); review that first. This PR only contains the statpopgen benchmark changes.

The statpopgen suite only ran on DuckDB because its queries use DuckDB list lambdas. DataFusion 55 already has every function the queries need (list_sum, list_transform with lambdas, array_length), so no DataFusion change is needed, only dialect and SQL fixes.

Changes

  • datafusion-bench now runs each benchmark's engine_init_sql(Engine::DataFusion) when it creates a session, as duckdb-bench already does for DuckDB.
  • StatPopGenBenchmark::engine_init_sql sets datafusion.sql_parser.dialect = 'duckdb' for DataFusion, so the lambda g: ... syntax parses (the default generic dialect rejects lambdas).
  • statpopgen.sql: quote "GT" everywhere (DataFusion lowercases unquoted identifiers), rename the lambda parameter from GT to g, and make query 10 filter a subquery instead of referring to a SELECT alias in WHERE (DuckDB-only behaviour). These are intended to leave DuckDB's plans unchanged; see below.
  • CI: the statpopgen catalog entry now uses the standard DataFusion + DuckDB coverage sets. The DuckDB-only sets it alone used are removed, and test_matrix.py asserts both engines are present.
  • statpopgen.md updated.

Results

DataFusion, SF 10 (10,000 variants), median of 5 runs on a 4-core / 15 GB container. All 11 queries pass their expected row counts.

Query Parquet (ms) Vortex (ms) Vortex / Parquet
0 count 6.5 6.1 0.94
1 array_length 10.7 11.1 1.03
2 read GT 462.0 99.2 0.21
3 ref allele freq 634.2 661.4 1.04
4 alt allele freq 689.8 619.8 0.90
5 n called 490.3 363.5 0.74
6 Hardy-Weinberg 1078.4 1501.7 1.39
7 point lookup 687.0 513.0 0.75
8 window 1212.6 728.6 0.60
9 group by pos 639.6 528.4 0.83
10 rare alleles 1462.1 1695.3 1.16

Not yet measured: DuckDB numbers, and DuckDB before/after the SQL edits. The DuckDB build could not fetch its sources in the environment used, so this PR's CI run is the first DuckDB check.

Checks run: cargo clippy -p datafusion-bench -p vortex-bench --all-targets --all-features -- -D warnings, nightly cargo fmt --check, bench-orchestrator pytest tests/test_matrix.py and ruff.

🤖 Generated with Claude Code

https://claude.ai/code/session_01SzyZPNAEc6NDXftguW3WNQ

@joseph-isaacs joseph-isaacs added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR changelog/feature A new feature labels Oct 2, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 2, 2026
DataFusion indexes lambda parameters past the end of the projection's
input columns, but split_projection reshapes the scan output (pushed
expressions, one column per unpushable projection) and
reassign_expr_columns only remaps Column indices. The lambda variable
then pointed at a duplicated list column, so statpopgen Q6 tried to
allocate ~137 GB at 1,000 rows, and a bare array_transform in the select
list failed to convert. Fall back to reading the referenced columns
unchanged when the projection contains a lambda.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SzyZPNAEc6NDXftguW3WNQ
Signed-off-by: Claude <noreply@anthropic.com>
@github-actions

github-actions Bot commented Oct 2, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 8504919 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 8504919 clickbench-nvme 1 Explore Profiling Data
🟢 Done 8504919 statpopgen 1 Explore Profiling Data
🟢 Done 8504919 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 8504919 fineweb 1 Explore Profiling Data
🟢 Done 8504919 tpcds-nvme 1 Explore Profiling Data
🟢 Done 8504919 fineweb-s3 1 Explore Profiling Data
🟢 Done 8504919 polarsignals 1 Explore Profiling Data
🟢 Done 8504919 tpch-nvme 1 Explore Profiling Data
🟢 Done 8504919 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

claude added 3 commits October 2, 2026 13:42
Run each benchmark's engine_init_sql in datafusion-bench, switch the
statpopgen DataFusion session to the DuckDB SQL dialect so the lambda
syntax parses, quote the GT column, and filter query 10 through a
subquery instead of a SELECT alias.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SzyZPNAEc6NDXftguW3WNQ
Signed-off-by: Claude <noreply@anthropic.com>
Give the statpopgen suite the same DataFusion + DuckDB target coverage
as the other SQL suites now that its queries run on DataFusion, drop the
DuckDB-only coverage sets it alone used, and update the suite docs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SzyZPNAEc6NDXftguW3WNQ
Signed-off-by: Claude <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SzyZPNAEc6NDXftguW3WNQ
Signed-off-by: Claude <noreply@anthropic.com>
@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 85049199 vs base 900c1f29
Vortex (geomean): hot 1.001x ➖ · cold 1.026x ➖


datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57543388 / 58043006 / -0.9% 104224895 / 100708880 / +3.5% 0.55 / 0.58 / -4.2%
polarsignals_q01/datafusion:vortex-file-compressed 63003701 / 62708292 / +0.5% 129322934 / 124281597 / +4.1% 0.49 / 0.50 / -3.4%
polarsignals_q02/datafusion:vortex-file-compressed 62583212 / 63122922 / -0.9% 102986662 / 105801364 / -2.7% 0.61 / 0.60 / +1.9%
polarsignals_q03/datafusion:vortex-file-compressed 79767624 / 79566961 / +0.3% 145110348 / 142101752 / +2.1% 0.55 / 0.56 / -1.8%
polarsignals_q04/datafusion:vortex-file-compressed 9566496 / 9577982 / -0.1% 49495878 / 48548980 / +2.0% 0.19 / 0.20 / -2.0%
polarsignals_q05/datafusion:vortex-file-compressed 24599378 / 23962372 / +2.7% 67546873 / 65926097 / +2.5% 0.36 / 0.36 / +0.2%
polarsignals_q06/datafusion:vortex-file-compressed 21395208 / 20878470 / +2.5% 64152954 / 60304744 / +6.4% 0.33 / 0.35 / -3.7%
polarsignals_q07/datafusion:vortex-file-compressed 39433094 / 39940516 / -1.3% 80284811 / 78310798 / +2.5% 0.49 / 0.51 / -3.7%
polarsignals_q08/datafusion:vortex-file-compressed 98172200 / 97801144 / +0.4% 163730221 / 159595489 / +2.6% 0.60 / 0.61 / -2.2%
polarsignals_q09/datafusion:vortex-file-compressed 10118480 / 10300786 / -1.8% 49109642 / 47320901 / +3.8% 0.21 / 0.22 / -5.3%

No file size changes detected.

@joseph-isaacs
joseph-isaacs force-pushed the ji/statpopgen-datafusion branch from 8504919 to fee08c0 Compare October 2, 2026 13:43
@joseph-isaacs joseph-isaacs changed the title Fix lambda expression handling in projection pushdown bench(statpopgen): run the suite on DataFusion as well as DuckDB Oct 2, 2026
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/datafusion-lambda-projection October 2, 2026 13:43
@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-2.3%, low confidence)
Vortex (geomean): hot 0.986x ➖ · cold 0.983x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16395185 / 16816797 / -2.5% 47540138 / 44296582 / +7.3% 0.34 / 0.38 / -9.2%
tpch_q02/datafusion:vortex-file-compressed 17291627 / 17554970 / -1.5% 38305622 / 37626245 / +1.8% 0.45 / 0.47 / -3.2%
tpch_q03/datafusion:vortex-file-compressed 19379756 / 18906675 / +2.5% 51073161 / 51187148 / -0.2% 0.38 / 0.37 / +2.7%
tpch_q04/datafusion:vortex-file-compressed 9962568 / 10080732 / -1.2% 36393304 / 36168976 / +0.6% 0.27 / 0.28 / -1.8%
tpch_q05/datafusion:vortex-file-compressed 37971654 / 37229677 / +2.0% 66653480 / 67502900 / -1.3% 0.57 / 0.55 / +3.3%
tpch_q06/datafusion:vortex-file-compressed 6276677 / 6093568 / +3.0% 31336164 / 32979653 / -5.0% 0.20 / 0.18 / +8.4%
tpch_q07/datafusion:vortex-file-compressed 51727528 / 52132966 / -0.8% 85114948 / 86013963 / -1.0% 0.61 / 0.61 / +0.3%
tpch_q08/datafusion:vortex-file-compressed 52677460 / 52340561 / +0.6% 85620550 / 87165571 / -1.8% 0.62 / 0.60 / +2.5%
tpch_q09/datafusion:vortex-file-compressed 49008785 / 49215555 / -0.4% 78353699 / 79574995 / -1.5% 0.63 / 0.62 / +1.1%
tpch_q10/datafusion:vortex-file-compressed 16955049 / 16615970 / +2.0% 53250060 / 54016272 / -1.4% 0.32 / 0.31 / +3.5%
tpch_q11/datafusion:vortex-file-compressed 15225340 / 15280847 / -0.4% 36338918 / 36172402 / +0.5% 0.42 / 0.42 / -0.8%
tpch_q12/datafusion:vortex-file-compressed 23022803 / 22626213 / +1.8% 49456268 / 51278521 / -3.6% 0.47 / 0.44 / +5.5%
tpch_q13/datafusion:vortex-file-compressed 19964655 / 20496778 / -2.6% 43019099 / 40439855 / +6.4% 0.46 / 0.51 / -8.4%
tpch_q14/datafusion:vortex-file-compressed 15035916 / 15262034 / -1.5% 42757686 / 44983199 / -4.9% 0.35 / 0.34 / +3.6%
tpch_q15/datafusion:vortex-file-compressed 18488175 / 18479201 / +0.0% 48873333 / 49150215 / -0.6% 0.38 / 0.38 / +0.6%
tpch_q16/datafusion:vortex-file-compressed 18839739 / 18783258 / +0.3% 39247202 / 39234612 / +0.0% 0.48 / 0.48 / +0.3%
tpch_q17/datafusion:vortex-file-compressed 28046857 / 28065881 / -0.1% 61606898 / 60867225 / +1.2% 0.46 / 0.46 / -1.3%
tpch_q18/datafusion:vortex-file-compressed 36820092 / 37032663 / -0.6% 60719212 / 60652283 / +0.1% 0.61 / 0.61 / -0.7%
tpch_q19/datafusion:vortex-file-compressed 13654553 / 13476672 / +1.3% 41124001 / 42465052 / -3.2% 0.33 / 0.32 / +4.6%
tpch_q20/datafusion:vortex-file-compressed 20768562 / 21233670 / -2.2% 48161442 / 45807734 / +5.1% 0.43 / 0.46 / -7.0%
tpch_q21/datafusion:vortex-file-compressed 38633301 / 39514450 / -2.2% 69667010 / 67443048 / +3.3% 0.55 / 0.59 / -5.4%
tpch_q22/datafusion:vortex-file-compressed 11110032 / 11404635 / -2.6% 34142544 / 32303830 / +5.7% 0.33 / 0.35 / -7.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72761576 / 72901975 / -0.2% 92589592 / 91514487 / +1.2% 0.79 / 0.80 / -1.4%
tpch_q02/datafusion:parquet 58026784 / 57274501 / +1.3% 79254295 / 80855289 / -2.0% 0.73 / 0.71 / +3.4%
tpch_q03/datafusion:parquet 84152629 / 84342784 / -0.2% 111688014 / 111279840 / +0.4% 0.75 / 0.76 / -0.6%
tpch_q04/datafusion:parquet 47185774 / 46919955 / +0.6% 68802634 / 68894597 / -0.1% 0.69 / 0.68 / +0.7%
tpch_q05/datafusion:parquet 100110331 / 99660112 / +0.5% 130831776 / 130440186 / +0.3% 0.77 / 0.76 / +0.2%
tpch_q06/datafusion:parquet 32219530 / 32210163 / +0.0% 52987247 / 53335175 / -0.7% 0.61 / 0.60 / +0.7%
tpch_q07/datafusion:parquet 105493141 / 105975521 / -0.5% 135978386 / 138054271 / -1.5% 0.78 / 0.77 / +1.1%
tpch_q08/datafusion:parquet 113375305 / 113656071 / -0.2% 145279709 / 145236027 / +0.0% 0.78 / 0.78 / -0.3%
tpch_q09/datafusion:parquet 130994266 / 131861988 / -0.7% 167458417 / 164029264 / +2.1% 0.78 / 0.80 / -2.7%
tpch_q10/datafusion:parquet 104702561 / 104544173 / +0.2% 133412235 / 137039848 / -2.6% 0.78 / 0.76 / +2.9%
tpch_q11/datafusion:parquet 41452191 / 42393132 / -2.2% 67294628 / 67481626 / -0.3% 0.62 / 0.63 / -1.9%
tpch_q12/datafusion:parquet 70573494 / 68863116 / +2.5% 98132184 / 98323126 / -0.2% 0.72 / 0.70 / +2.7%
tpch_q13/datafusion:parquet 185230243 / 185769738 / -0.3% 209078614 / 209433485 / -0.2% 0.89 / 0.89 / -0.1%
tpch_q14/datafusion:parquet 48858493 / 47689805 / +2.5% 77582567 / 81403363 / -4.7% 0.63 / 0.59 / +7.5%
tpch_q15/datafusion:parquet 54324433 / 54975226 / -1.2% 78005568 / 77692750 / +0.4% 0.70 / 0.71 / -1.6%
tpch_q16/datafusion:parquet 41221219 / 40932591 / +0.7% 61870802 / 62282504 / -0.7% 0.67 / 0.66 / +1.4%
tpch_q17/datafusion:parquet 129841096 / 128929811 / +0.7% 153582979 / 155365657 / -1.1% 0.85 / 0.83 / +1.9%
tpch_q18/datafusion:parquet 131234141 / 130495672 / +0.6% 152843914 / 154397863 / -1.0% 0.86 / 0.85 / +1.6%
tpch_q19/datafusion:parquet 59008646 / 59902204 / -1.5% 89456315 / 91896260 / -2.7% 0.66 / 0.65 / +1.2%
tpch_q20/datafusion:parquet 67349033 / 68215963 / -1.3% 95639857 / 95322294 / +0.3% 0.70 / 0.72 / -1.6%
tpch_q21/datafusion:parquet 108196594 / 108825802 / -0.6% 133325342 / 132332027 / +0.8% 0.81 / 0.82 / -1.3%
tpch_q22/datafusion:parquet 47618927 / 47786799 / -0.4% 67274711 / 71883215 / -6.4% 0.71 / 0.66 / +6.5%
duckdb / vortex-file-compressed / ns (0.975x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9584376 / 11937392 / -19.7% 🟢 19781572 / 21789448 / -9.2% 0.48 / 0.55 / -11.6%
tpch_q02/duckdb:vortex-file-compressed 17477992 / 17696317 / -1.2% 26737236 / 28645083 / -6.7% 0.65 / 0.62 / +5.8%
tpch_q03/duckdb:vortex-file-compressed 17979229 / 18017034 / -0.2% 40771131 / 35449314 / +15.0% 🔴 0.44 / 0.51 / -13.2%
tpch_q04/duckdb:vortex-file-compressed 17419265 / 18361855 / -5.1% 32459810 / 38876002 / -16.5% 🟢 0.54 / 0.47 / +13.6%
tpch_q05/duckdb:vortex-file-compressed 22064774 / 22091172 / -0.1% 36313972 / 37002264 / -1.9% 0.61 / 0.60 / +1.8%
tpch_q06/duckdb:vortex-file-compressed 5395608 / 5887711 / -8.4% 15157417 / 18025028 / -15.9% 🟢 0.36 / 0.33 / +9.0%
tpch_q07/duckdb:vortex-file-compressed 20603084 / 21033082 / -2.0% 37955979 / 43494669 / -12.7% 🟢 0.54 / 0.48 / +12.2%
tpch_q08/duckdb:vortex-file-compressed 22916206 / 23844034 / -3.9% 39341885 / 41925251 / -6.2% 0.58 / 0.57 / +2.4%
tpch_q09/duckdb:vortex-file-compressed 30253676 / 29831194 / +1.4% 53477026 / 47579654 / +12.4% 🔴 0.57 / 0.63 / -9.8%
tpch_q10/duckdb:vortex-file-compressed 27818318 / 27982364 / -0.6% 45828823 / 47543034 / -3.6% 0.61 / 0.59 / +3.1%
tpch_q11/duckdb:vortex-file-compressed 8694358 / 8852146 / -1.8% 15683240 / 15527306 / +1.0% 0.55 / 0.57 / -2.8%
tpch_q12/duckdb:vortex-file-compressed 16157159 / 17305569 / -6.6% 35935613 / 36889931 / -2.6% 0.45 / 0.47 / -4.2%
tpch_q13/duckdb:vortex-file-compressed 23876546 / 22451932 / +6.3% 40509917 / 42428805 / -4.5% 0.59 / 0.53 / +11.4%
tpch_q14/duckdb:vortex-file-compressed 13070694 / 12849501 / +1.7% 25137236 / 25834013 / -2.7% 0.52 / 0.50 / +4.5%
tpch_q15/duckdb:vortex-file-compressed 10010523 / 10852491 / -7.8% 20544956 / 19932058 / +3.1% 0.49 / 0.54 / -10.5%
tpch_q16/duckdb:vortex-file-compressed 18345009 / 18468005 / -0.7% 25283418 / 26459238 / -4.4% 0.73 / 0.70 / +4.0%
tpch_q17/duckdb:vortex-file-compressed 14283412 / 15379193 / -7.1% 30953798 / 36018869 / -14.1% 🟢 0.46 / 0.43 / +8.1%
tpch_q18/duckdb:vortex-file-compressed 24662363 / 24589627 / +0.3% 39518119 / 36663667 / +7.8% 0.62 / 0.67 / -6.9%
tpch_q19/duckdb:vortex-file-compressed 23078046 / 23885177 / -3.4% 37265234 / 39838733 / -6.5% 0.62 / 0.60 / +3.3%
tpch_q20/duckdb:vortex-file-compressed 18053955 / 16600237 / +8.8% 33668262 / 36177008 / -6.9% 0.54 / 0.46 / +16.9%
tpch_q21/duckdb:vortex-file-compressed 65735705 / 66810061 / -1.6% 84541126 / 84237320 / +0.4% 0.78 / 0.79 / -2.0%
tpch_q22/duckdb:vortex-file-compressed 12281399 / 12325488 / -0.4% 21315169 / 21068914 / +1.2% 0.58 / 0.59 / -1.5%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 63291762 / 63413716 / -0.2% 69516291 / 69980542 / -0.7% 0.91 / 0.91 / +0.5%
tpch_q02/duckdb:parquet 38132865 / 38063700 / +0.2% 45977579 / 45943695 / +0.1% 0.83 / 0.83 / +0.1%
tpch_q03/duckdb:parquet 68074983 / 68304956 / -0.3% 78913730 / 80006387 / -1.4% 0.86 / 0.85 / +1.0%
tpch_q04/duckdb:parquet 46995899 / 47161846 / -0.4% 56338966 / 56152226 / +0.3% 0.83 / 0.84 / -0.7%
tpch_q05/duckdb:parquet 65915840 / 66273651 / -0.5% 77766103 / 77577850 / +0.2% 0.85 / 0.85 / -0.8%
tpch_q06/duckdb:parquet 22099768 / 22153606 / -0.2% 26919113 / 27933309 / -3.6% 0.82 / 0.79 / +3.5%
tpch_q07/duckdb:parquet 65864531 / 65858293 / +0.0% 75463525 / 76215465 / -1.0% 0.87 / 0.86 / +1.0%
tpch_q08/duckdb:parquet 80680144 / 80650642 / +0.0% 93461603 / 93749788 / -0.3% 0.86 / 0.86 / +0.3%
tpch_q09/duckdb:parquet 120601078 / 120296044 / +0.3% 132836932 / 133755435 / -0.7% 0.91 / 0.90 / +0.9%
tpch_q10/duckdb:parquet 119125181 / 120128321 / -0.8% 130750378 / 131306742 / -0.4% 0.91 / 0.91 / -0.4%
tpch_q11/duckdb:parquet 21484843 / 21633985 / -0.7% 25488090 / 25073657 / +1.7% 0.84 / 0.86 / -2.3%
tpch_q12/duckdb:parquet 44867393 / 44575587 / +0.7% 51772110 / 51537859 / +0.5% 0.87 / 0.86 / +0.2%
tpch_q13/duckdb:parquet 243734866 / 244486446 / -0.3% 253292045 / 251831970 / +0.6% 0.96 / 0.97 / -0.9%
tpch_q14/duckdb:parquet 47502474 / 47552057 / -0.1% 56585516 / 56840059 / -0.4% 0.84 / 0.84 / +0.3%
tpch_q15/duckdb:parquet 26837392 / 26874528 / -0.1% 34237095 / 33693127 / +1.6% 0.78 / 0.80 / -1.7%
tpch_q16/duckdb:parquet 51908010 / 52480278 / -1.1% 57957848 / 60539957 / -4.3% 0.90 / 0.87 / +3.3%
tpch_q17/duckdb:parquet 49372010 / 49410374 / -0.1% 59276261 / 63066684 / -6.0% 0.83 / 0.78 / +6.3%
tpch_q18/duckdb:parquet 96059200 / 96757245 / -0.7% 102973911 / 106148056 / -3.0% 0.93 / 0.91 / +2.3%
tpch_q19/duckdb:parquet 65604253 / 65578747 / +0.0% 74496439 / 74854739 / -0.5% 0.88 / 0.88 / +0.5%
tpch_q20/duckdb:parquet 62085417 / 62406460 / -0.5% 73719287 / 74242069 / -0.7% 0.84 / 0.84 / +0.2%
tpch_q21/duckdb:parquet 142918735 / 142860587 / +0.0% 153632543 / 154208319 / -0.4% 0.93 / 0.93 / +0.4%
tpch_q22/duckdb:parquet 51909908 / 51732192 / +0.3% 59090723 / 59639108 / -0.9% 0.88 / 0.87 / +1.3%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.6%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-7.3%, medium confidence)
Vortex (geomean): hot 0.962x ➖ · cold 1.007x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.035x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7012264 / 6842364 / +2.5% 21116562 / 19274354 / +9.6% 0.33 / 0.35 / -6.5%
fineweb_q01/datafusion:vortex-file-compressed 11832017 / 12125084 / -2.4% 51332356 / 45582234 / +12.6% 🔴 0.23 / 0.27 / -13.3%
fineweb_q02/datafusion:vortex-file-compressed 12643121 / 12659428 / -0.1% 55215969 / 50317541 / +9.7% 0.23 / 0.25 / -9.0%
fineweb_q03/datafusion:vortex-file-compressed 19900206 / 20223418 / -1.6% 107722218 / 98236800 / +9.7% 0.18 / 0.21 / -10.3%
fineweb_q04/datafusion:vortex-file-compressed 78511530 / 77636308 / +1.1% 155963762 / 156035959 / -0.0% 0.50 / 0.50 / +1.2%
fineweb_q05/datafusion:vortex-file-compressed 60576306 / 60129888 / +0.7% 143223128 / 137538248 / +4.1% 0.42 / 0.44 / -3.3%
fineweb_q06/datafusion:vortex-file-compressed 19051644 / 19313026 / -1.4% 107193618 / 100482539 / +6.7% 0.18 / 0.19 / -7.5%
fineweb_q07/datafusion:vortex-file-compressed 18346806 / 18318191 / +0.2% 102370112 / 96448377 / +6.1% 0.18 / 0.19 / -5.6%
fineweb_q08/datafusion:vortex-file-compressed 11337806 / 10591290 / +7.0% 48564138 / 38062956 / +27.6% 🔴 0.23 / 0.28 / -16.1%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9363474 / 9675596 / -3.2% 35406633 / 33447685 / +5.9% 0.26 / 0.29 / -8.6%
fineweb_q01/datafusion:parquet 76172748 / 74300748 / +2.5% 158739647 / 140463773 / +13.0% 🔴 0.48 / 0.53 / -9.3%
fineweb_q02/datafusion:parquet 74096682 / 74250020 / -0.2% 151652719 / 143777500 / +5.5% 0.49 / 0.52 / -5.4%
fineweb_q03/datafusion:parquet 75654460 / 74934168 / +1.0% 151287631 / 145022016 / +4.3% 0.50 / 0.52 / -3.2%
fineweb_q04/datafusion:parquet 82508614 / 81708732 / +1.0% 149571513 / 139024251 / +7.6% 0.55 / 0.59 / -6.1%
fineweb_q05/datafusion:parquet 81295016 / 81395455 / -0.1% 154816458 / 143886743 / +7.6% 0.53 / 0.57 / -7.2%
fineweb_q06/datafusion:parquet 76410418 / 73563941 / +3.9% 155189628 / 144560136 / +7.4% 0.49 / 0.51 / -3.2%
fineweb_q07/datafusion:parquet 74421771 / 74582084 / -0.2% 149292329 / 144962144 / +3.0% 0.50 / 0.51 / -3.1%
fineweb_q08/datafusion:parquet 73361170 / 74560652 / -1.6% 148389305 / 145913570 / +1.7% 0.49 / 0.51 / -3.3%
duckdb / vortex-file-compressed / ns (0.919x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1919484 / 1897922 / +1.1% 4994242 / 4930835 / +1.3% 0.38 / 0.38 / -0.1%
fineweb_q01/duckdb:vortex-file-compressed 19423814 / 24593810 / -21.0% 🟢 63531682 / 65512444 / -3.0% 0.31 / 0.38 / -18.6%
fineweb_q02/duckdb:vortex-file-compressed 17210810 / 20582364 / -16.4% 🟢 57499903 / 49168976 / +16.9% 🔴 0.30 / 0.42 / -28.5%
fineweb_q03/duckdb:vortex-file-compressed 27299568 / 28297332 / -3.5% 101110945 / 123683061 / -18.2% 🟢 0.27 / 0.23 / +18.0%
fineweb_q04/duckdb:vortex-file-compressed 81007694 / 76552130 / +5.8% 129460640 / 114086307 / +13.5% 🔴 0.63 / 0.67 / -6.7%
fineweb_q05/duckdb:vortex-file-compressed 59476962 / 88618082 / -32.9% 🟢 110545795 / 193650890 / -42.9% 🟢 0.54 / 0.46 / +17.6%
fineweb_q06/duckdb:vortex-file-compressed 36857249 / 51726395 / -28.7% 🟢 138844951 / 152336054 / -8.9% 0.27 / 0.34 / -21.8%
fineweb_q07/duckdb:vortex-file-compressed 34971484 / 24580445 / +42.3% 🔴 108497725 / 97315395 / +11.5% 🔴 0.32 / 0.25 / +27.6%
fineweb_q08/duckdb:vortex-file-compressed 6588978 / 6562286 / +0.4% 16135424 / 19716881 / -18.2% 🟢 0.41 / 0.33 / +22.7%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21292606 / 23486313 / -9.3% 23001875 / 26653368 / -13.7% 🟢 0.93 / 0.88 / +5.1%
fineweb_q01/duckdb:parquet 44328812 / 44852952 / -1.2% 56987519 / 56822889 / +0.3% 0.78 / 0.79 / -1.5%
fineweb_q02/duckdb:parquet 43899530 / 43723293 / +0.4% 56899763 / 53377393 / +6.6% 0.77 / 0.82 / -5.8%
fineweb_q03/duckdb:parquet 94214664 / 95355901 / -1.2% 193733135 / 187144321 / +3.5% 0.49 / 0.51 / -4.6%
fineweb_q04/duckdb:parquet 154114646 / 150597571 / +2.3% 207145785 / 210735442 / -1.7% 0.74 / 0.71 / +4.1%
fineweb_q05/duckdb:parquet 143732602 / 145665733 / -1.3% 201288784 / 199031577 / +1.1% 0.71 / 0.73 / -2.4%
fineweb_q06/duckdb:parquet 71405444 / 70601065 / +1.1% 127684260 / 116290149 / +9.8% 0.56 / 0.61 / -7.9%
fineweb_q07/duckdb:parquet 72628466 / 72530903 / +0.1% 161225741 / 153911216 / +4.8% 0.45 / 0.47 / -4.4%
fineweb_q08/duckdb:parquet 22847137 / 22453110 / +1.8% 24394865 / 24745213 / -1.4% 0.94 / 0.91 / +3.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -12.3%
Engines: DataFusion No clear signal (-12.1%, environment too noisy confidence) · DuckDB No clear signal (-12.4%, environment too noisy confidence)
Vortex (geomean): hot 0.882x ➖ · cold 0.892x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.031x ➖
Shifts: Parquet (control) +0.6% · Median polish -2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.801x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 79504092 / 59198961 / +34.3% 🔴 135830191 / 104684705 / +29.8% 0.59 / 0.57 / +3.5%
fineweb_q01/datafusion:vortex-file-compressed 366802274 / 395245514 / -7.2% 638366985 / 705011826 / -9.5% 0.57 / 0.56 / +2.5%
fineweb_q02/datafusion:vortex-file-compressed 410001583 / 623292998 / -34.2% 🟢 878798160 / 686569335 / +28.0% 0.47 / 0.91 / -48.6%
fineweb_q03/datafusion:vortex-file-compressed 464375966 / 694230660 / -33.1% 🟢 687133971 / 779024674 / -11.8% 0.68 / 0.89 / -24.2%
fineweb_q04/datafusion:vortex-file-compressed 417256491 / 650887233 / -35.9% 🟢 488627611 / 831428166 / -41.2% 🟢 0.85 / 0.78 / +9.1%
fineweb_q05/datafusion:vortex-file-compressed 424918012 / 531871258 / -20.1% 440871975 / 568412279 / -22.4% 0.96 / 0.94 / +3.0%
fineweb_q06/datafusion:vortex-file-compressed 677214199 / 824225992 / -17.8% 762671788 / 827813599 / -7.9% 0.89 / 1.00 / -10.8%
fineweb_q07/datafusion:vortex-file-compressed 482364970 / 606721182 / -20.5% 443659952 / 513669747 / -13.6% 1.09 / 1.18 / -8.0%
fineweb_q08/datafusion:vortex-file-compressed 266350119 / 358614512 / -25.7% 230056508 / 413846581 / -44.4% 🟢 1.16 / 0.87 / +33.6%
datafusion / parquet / ns (0.912x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 604748630 / 493951070 / +22.4% 735099750 / 780559347 / -5.8% 0.82 / 0.63 / +30.0%
fineweb_q01/datafusion:parquet 653525220 / 887435345 / -26.4% 677495333 / 920779499 / -26.4% 0.96 / 0.96 / +0.1%
fineweb_q02/datafusion:parquet 735476055 / 781531218 / -5.9% 715959970 / 741463308 / -3.4% 1.03 / 1.05 / -2.5%
fineweb_q03/datafusion:parquet 794082690 / 858566635 / -7.5% 793956947 / 722921087 / +9.8% 1.00 / 1.19 / -15.8%
fineweb_q04/datafusion:parquet 674939731 / 754721012 / -10.6% 754170159 / 663225268 / +13.7% 0.89 / 1.14 / -21.4%
fineweb_q05/datafusion:parquet 753805494 / 753850366 / -0.0% 837481380 / 706328592 / +18.6% 0.90 / 1.07 / -15.7%
fineweb_q06/datafusion:parquet 748750103 / 923610656 / -18.9% 799437885 / 847147171 / -5.6% 0.94 / 1.09 / -14.1%
fineweb_q07/datafusion:parquet 696565144 / 911518844 / -23.6% 642904090 / 889136217 / -27.7% 1.08 / 1.03 / +5.7%
fineweb_q08/datafusion:parquet 774440612 / 770358659 / +0.5% 771395479 / 859141731 / -10.2% 1.00 / 0.90 / +12.0%
duckdb / vortex-file-compressed / ns (0.971x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 51873068 / 62262992 / -16.7% 51936998 / 65151462 / -20.3% 1.00 / 0.96 / +4.5%
fineweb_q01/duckdb:vortex-file-compressed 434186122 / 466344523 / -6.9% 471991105 / 505203277 / -6.6% 0.92 / 0.92 / -0.3%
fineweb_q02/duckdb:vortex-file-compressed 579230762 / 555334170 / +4.3% 627672013 / 624935414 / +0.4% 0.92 / 0.89 / +3.8%
fineweb_q03/duckdb:vortex-file-compressed 988757966 / 972245976 / +1.7% 1128260388 / 1099875655 / +2.6% 0.88 / 0.88 / -0.9%
fineweb_q04/duckdb:vortex-file-compressed 995593395 / 950932802 / +4.7% 1021096465 / 974212809 / +4.8% 0.98 / 0.98 / -0.1%
fineweb_q05/duckdb:vortex-file-compressed 920264474 / 938721689 / -2.0% 970089200 / 1092776303 / -11.2% 0.95 / 0.86 / +10.4%
fineweb_q06/duckdb:vortex-file-compressed 1246645226 / 1226746940 / +1.6% 1181895036 / 1383083701 / -14.5% 1.05 / 0.89 / +18.9%
fineweb_q07/duckdb:vortex-file-compressed 1015900095 / 996148194 / +2.0% 1030541863 / 1043407155 / -1.2% 0.99 / 0.95 / +3.3%
fineweb_q08/duckdb:vortex-file-compressed 407382176 / 463617054 / -12.1% 474746051 / 601019759 / -21.0% 0.86 / 0.77 / +11.2%
duckdb / parquet / ns (1.109x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 470509238 / 487600330 / -3.5% 732934930 / 539136219 / +35.9% 🔴 0.64 / 0.90 / -29.0%
fineweb_q01/duckdb:parquet 774672208 / 562939865 / +37.6% 🔴 717875201 / 585523909 / +22.6% 1.08 / 0.96 / +12.2%
fineweb_q02/duckdb:parquet 585847626 / 552087626 / +6.1% 786483098 / 570037106 / +38.0% 🔴 0.74 / 0.97 / -23.1%
fineweb_q03/duckdb:parquet 1369108908 / 1452708384 / -5.8% 1391065688 / 1407055536 / -1.1% 0.98 / 1.03 / -4.7%
fineweb_q04/duckdb:parquet 1127242586 / 853847477 / +32.0% 🔴 994251192 / 805104105 / +23.5% 1.13 / 1.06 / +6.9%
fineweb_q05/duckdb:parquet 1007884756 / 827556079 / +21.8% 1000662277 / 904733427 / +10.6% 1.01 / 0.91 / +10.1%
fineweb_q06/duckdb:parquet 1645339186 / 1556954255 / +5.7% 1515958668 / 1570548617 / -3.5% 1.09 / 0.99 / +9.5%
fineweb_q07/duckdb:parquet 1083435984 / 1025536376 / +5.6% 1098119209 / 1238738040 / -11.4% 0.99 / 0.83 / +19.2%
fineweb_q08/duckdb:parquet 492121914 / 463949702 / +6.1% 524478090 / 490513578 / +6.9% 0.94 / 0.95 / -0.8%

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 96172783 / 96742281 / -0.6% 176023571 / 161248592 / +9.2% 0.55 / 0.60 / -8.9%
tpch_q02/datafusion:vortex-file-compressed 65147902 / 64925795 / +0.3% 97001462 / 95434234 / +1.6% 0.67 / 0.68 / -1.3%
tpch_q03/datafusion:vortex-file-compressed 64456494 / 64923575 / -0.7% 123119907 / 116490997 / +5.7% 0.52 / 0.56 / -6.1%
tpch_q04/datafusion:vortex-file-compressed 34730876 / 35102298 / -1.1% 81574369 / 78393265 / +4.1% 0.43 / 0.45 / -4.9%
tpch_q05/datafusion:vortex-file-compressed 115678014 / 117562195 / -1.6% 194764733 / 174908512 / +11.4% 🔴 0.59 / 0.67 / -11.6%
tpch_q06/datafusion:vortex-file-compressed 15750772 / 14332990 / +9.9% 75047242 / 70304654 / +6.7% 0.21 / 0.20 / +2.9%
tpch_q07/datafusion:vortex-file-compressed 140810454 / 139099695 / +1.2% 186409149 / 198610832 / -6.1% 0.76 / 0.70 / +7.9%
tpch_q08/datafusion:vortex-file-compressed 146571967 / 142762531 / +2.7% 212531263 / 202606758 / +4.9% 0.69 / 0.70 / -2.1%
tpch_q09/datafusion:vortex-file-compressed 186909803 / 187207604 / -0.2% 267334016 / 252252267 / +6.0% 0.70 / 0.74 / -5.8%
tpch_q10/datafusion:vortex-file-compressed 73532159 / 73821414 / -0.4% 141791171 / 136014347 / +4.2% 0.52 / 0.54 / -4.5%
tpch_q11/datafusion:vortex-file-compressed 43214722 / 43510669 / -0.7% 69428150 / 65517710 / +6.0% 0.62 / 0.66 / -6.3%
tpch_q12/datafusion:vortex-file-compressed 43522008 / 43694397 / -0.4% 93411047 / 97336942 / -4.0% 0.47 / 0.45 / +3.8%
tpch_q13/datafusion:vortex-file-compressed 46273335 / 47121542 / -1.8% 79547113 / 72368368 / +9.9% 0.58 / 0.65 / -10.7%
tpch_q14/datafusion:vortex-file-compressed 25285795 / 25157016 / +0.5% 98658368 / 94730014 / +4.1% 0.26 / 0.27 / -3.5%
tpch_q15/datafusion:vortex-file-compressed 37171776 / 37280310 / -0.3% 104886129 / 99253893 / +5.7% 0.35 / 0.38 / -5.6%
tpch_q16/datafusion:vortex-file-compressed 37705371 / 37667701 / +0.1% 66823574 / 68150118 / -1.9% 0.56 / 0.55 / +2.1%
tpch_q17/datafusion:vortex-file-compressed 176777137 / 174518760 / +1.3% 222076798 / 220452992 / +0.7% 0.80 / 0.79 / +0.6%
tpch_q18/datafusion:vortex-file-compressed 199000493 / 200390008 / -0.7% 263803616 / 270524542 / -2.5% 0.75 / 0.74 / +1.8%
tpch_q19/datafusion:vortex-file-compressed 35280953 / 35383794 / -0.3% 94975620 / 91229259 / +4.1% 0.37 / 0.39 / -4.2%
tpch_q20/datafusion:vortex-file-compressed 62713358 / 63023688 / -0.5% 128920057 / 121874411 / +5.8% 0.49 / 0.52 / -5.9%
tpch_q21/datafusion:vortex-file-compressed 182559388 / 183218668 / -0.4% 243021385 / 243053178 / -0.0% 0.75 / 0.75 / -0.3%
tpch_q22/datafusion:vortex-file-compressed 25965841 / 25609291 / +1.4% 57106837 / 55795492 / +2.4% 0.45 / 0.46 / -0.9%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87366820 / 86979802 / +0.4% 130466280 / 129747338 / +0.6% 0.67 / 0.67 / -0.1%
tpch_q02/datafusion:parquet 158787350 / 158895621 / -0.1% 187961225 / 182036139 / +3.3% 0.84 / 0.87 / -3.2%
tpch_q03/datafusion:parquet 143455868 / 142852263 / +0.4% 190446204 / 188263556 / +1.2% 0.75 / 0.76 / -0.7%
tpch_q04/datafusion:parquet 59458400 / 59904302 / -0.7% 94711576 / 96514033 / -1.9% 0.63 / 0.62 / +1.1%
tpch_q05/datafusion:parquet 180243799 / 182066847 / -1.0% 233081960 / 242167016 / -3.8% 0.77 / 0.75 / +2.9%
tpch_q06/datafusion:parquet 35780629 / 35417381 / +1.0% 78632546 / 79946552 / -1.6% 0.46 / 0.44 / +2.7%
tpch_q07/datafusion:parquet 231142099 / 235168562 / -1.7% 294742301 / 285411358 / +3.3% 0.78 / 0.82 / -4.8%
tpch_q08/datafusion:parquet 234378191 / 235436385 / -0.4% 301439481 / 302952185 / -0.5% 0.78 / 0.78 / +0.1%
tpch_q09/datafusion:parquet 314359345 / 315410178 / -0.3% 380995497 / 375849616 / +1.4% 0.83 / 0.84 / -1.7%
tpch_q10/datafusion:parquet 403514114 / 406740852 / -0.8% 457677005 / 451206974 / +1.4% 0.88 / 0.90 / -2.2%
tpch_q11/datafusion:parquet 105874579 / 104174668 / +1.6% 129182703 / 126057831 / +2.5% 0.82 / 0.83 / -0.8%
tpch_q12/datafusion:parquet 85056178 / 85150597 / -0.1% 125590174 / 124871734 / +0.6% 0.68 / 0.68 / -0.7%
tpch_q13/datafusion:parquet 227112281 / 227676010 / -0.2% 253964100 / 254483808 / -0.2% 0.89 / 0.89 / -0.0%
tpch_q14/datafusion:parquet 88319575 / 88839592 / -0.6% 206445982 / 199556523 / +3.5% 0.43 / 0.45 / -3.9%
tpch_q15/datafusion:parquet 90984365 / 91583109 / -0.7% 142169675 / 139211396 / +2.1% 0.64 / 0.66 / -2.7%
tpch_q16/datafusion:parquet 95081411 / 95094172 / -0.0% 123594230 / 119971661 / +3.0% 0.77 / 0.79 / -2.9%
tpch_q17/datafusion:parquet 217444104 / 216261890 / +0.5% 272094016 / 265725954 / +2.4% 0.80 / 0.81 / -1.8%
tpch_q18/datafusion:parquet 291266233 / 291344834 / -0.0% 335901100 / 335232925 / +0.2% 0.87 / 0.87 / -0.2%
tpch_q19/datafusion:parquet 110636071 / 110690508 / -0.0% 179275611 / 174519519 / +2.7% 0.62 / 0.63 / -2.7%
tpch_q20/datafusion:parquet 183168330 / 183949132 / -0.4% 248347668 / 242134906 / +2.6% 0.74 / 0.76 / -2.9%
tpch_q21/datafusion:parquet 248808993 / 244656956 / +1.7% 322748662 / 317215114 / +1.7% 0.77 / 0.77 / -0.0%
tpch_q22/datafusion:parquet 199746305 / 199274252 / +0.2% 222512325 / 220544786 / +0.9% 0.90 / 0.90 / -0.6%
duckdb / vortex-file-compressed / ns (0.990x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 53490241 / 55410351 / -3.5% 87060071 / 110807390 / -21.4% 🟢 0.61 / 0.50 / +22.9%
tpch_q02/duckdb:vortex-file-compressed 32714254 / 32478646 / +0.7% 46266711 / 47957319 / -3.5% 0.71 / 0.68 / +4.4%
tpch_q03/duckdb:vortex-file-compressed 58421292 / 59318484 / -1.5% 101661131 / 104435630 / -2.7% 0.57 / 0.57 / +1.2%
tpch_q04/duckdb:vortex-file-compressed 79788353 / 81299669 / -1.9% 115049461 / 115576553 / -0.5% 0.69 / 0.70 / -1.4%
tpch_q05/duckdb:vortex-file-compressed 65429521 / 65686402 / -0.4% 121839821 / 122120038 / -0.2% 0.54 / 0.54 / -0.2%
tpch_q06/duckdb:vortex-file-compressed 21134892 / 20931246 / +1.0% 58278589 / 58325452 / -0.1% 0.36 / 0.36 / +1.1%
tpch_q07/duckdb:vortex-file-compressed 58462203 / 59170638 / -1.2% 118883029 / 122335994 / -2.8% 0.49 / 0.48 / +1.7%
tpch_q08/duckdb:vortex-file-compressed 86137022 / 87148661 / -1.2% 144364751 / 146607470 / -1.5% 0.60 / 0.59 / +0.4%
tpch_q09/duckdb:vortex-file-compressed 170920666 / 166398641 / +2.7% 242277246 / 238216417 / +1.7% 0.71 / 0.70 / +1.0%
tpch_q10/duckdb:vortex-file-compressed 108833765 / 109374271 / -0.5% 162389353 / 157932890 / +2.8% 0.67 / 0.69 / -3.2%
tpch_q11/duckdb:vortex-file-compressed 17747116 / 17284606 / +2.7% 30328227 / 33201864 / -8.7% 0.59 / 0.52 / +12.4%
tpch_q12/duckdb:vortex-file-compressed 54574712 / 56183553 / -2.9% 99389201 / 103159119 / -3.7% 0.55 / 0.54 / +0.8%
tpch_q13/duckdb:vortex-file-compressed 90577945 / 91811264 / -1.3% 132879743 / 141347466 / -6.0% 0.68 / 0.65 / +4.9%
tpch_q14/duckdb:vortex-file-compressed 30921035 / 32262966 / -4.2% 77086312 / 77416263 / -0.4% 0.40 / 0.42 / -3.7%
tpch_q15/duckdb:vortex-file-compressed 38447876 / 39419910 / -2.5% 85770994 / 82855834 / +3.5% 0.45 / 0.48 / -5.8%
tpch_q16/duckdb:vortex-file-compressed 42458647 / 42490804 / -0.1% 53560791 / 55328357 / -3.2% 0.79 / 0.77 / +3.2%
tpch_q17/duckdb:vortex-file-compressed 58023678 / 64904498 / -10.6% 🟢 113582499 / 127629425 / -11.0% 🟢 0.51 / 0.51 / +0.5%
tpch_q18/duckdb:vortex-file-compressed 133312886 / 136026196 / -2.0% 164984762 / 154856742 / +6.5% 0.81 / 0.88 / -8.0%
tpch_q19/duckdb:vortex-file-compressed 44355820 / 41729032 / +6.3% 97177416 / 92201646 / +5.4% 0.46 / 0.45 / +0.9%
tpch_q20/duckdb:vortex-file-compressed 59300320 / 59602709 / -0.5% 117276481 / 120007448 / -2.3% 0.51 / 0.50 / +1.8%
tpch_q21/duckdb:vortex-file-compressed 245109307 / 239208413 / +2.5% 279502097 / 284255124 / -1.7% 0.88 / 0.84 / +4.2%
tpch_q22/duckdb:vortex-file-compressed 43568427 / 44376167 / -1.8% 66604997 / 61306792 / +8.6% 0.65 / 0.72 / -9.6%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 73547507 / 72363334 / +1.6% 88779464 / 86214655 / +3.0% 0.83 / 0.84 / -1.3%
tpch_q02/duckdb:parquet 80287922 / 81159872 / -1.1% 91193677 / 91411770 / -0.2% 0.88 / 0.89 / -0.8%
tpch_q03/duckdb:parquet 121635843 / 119203592 / +2.0% 144449734 / 170973111 / -15.5% 🟢 0.84 / 0.70 / +20.8%
tpch_q04/duckdb:parquet 76064994 / 76046749 / +0.0% 95814346 / 94229560 / +1.7% 0.79 / 0.81 / -1.6%
tpch_q05/duckdb:parquet 129381908 / 130139169 / -0.6% 161173291 / 161805535 / -0.4% 0.80 / 0.80 / -0.2%
tpch_q06/duckdb:parquet 34280763 / 36763169 / -6.8% 46751538 / 45026940 / +3.8% 0.73 / 0.82 / -10.2%
tpch_q07/duckdb:parquet 93000741 / 93013419 / -0.0% 127787400 / 126434662 / +1.1% 0.73 / 0.74 / -1.1%
tpch_q08/duckdb:parquet 152076756 / 151228323 / +0.6% 202290270 / 204911430 / -1.3% 0.75 / 0.74 / +1.9%
tpch_q09/duckdb:parquet 227717040 / 229964253 / -1.0% 288347557 / 263602965 / +9.4% 0.79 / 0.87 / -9.5%
tpch_q10/duckdb:parquet 511515177 / 511679284 / -0.0% 544212398 / 544557173 / -0.1% 0.94 / 0.94 / +0.0%
tpch_q11/duckdb:parquet 33502928 / 33835422 / -1.0% 38728783 / 39372039 / -1.6% 0.87 / 0.86 / +0.7%
tpch_q12/duckdb:parquet 77144983 / 76652183 / +0.6% 93523340 / 89964156 / +4.0% 0.82 / 0.85 / -3.2%
tpch_q13/duckdb:parquet 322414354 / 322797633 / -0.1% 334604767 / 332802954 / +0.5% 0.96 / 0.97 / -0.7%
tpch_q14/duckdb:parquet 110335271 / 112591533 / -2.0% 157192361 / 134217598 / +17.1% 🔴 0.70 / 0.84 / -16.3%
tpch_q15/duckdb:parquet 43251329 / 43432313 / -0.4% 79196064 / 76365231 / +3.7% 0.55 / 0.57 / -4.0%
tpch_q16/duckdb:parquet 118312447 / 118341733 / -0.0% 127490549 / 129051597 / -1.2% 0.93 / 0.92 / +1.2%
tpch_q17/duckdb:parquet 80239801 / 83215957 / -3.6% 106092543 / 105720489 / +0.4% 0.76 / 0.79 / -3.9%
tpch_q18/duckdb:parquet 205234138 / 220691422 / -7.0% 167639543 / 192715875 / -13.0% 🟢 1.22 / 1.15 / +6.9%
tpch_q19/duckdb:parquet 166733777 / 165373716 / +0.8% 193010653 / 193944855 / -0.5% 0.86 / 0.85 / +1.3%
tpch_q20/duckdb:parquet 136716275 / 136457407 / +0.2% 168161854 / 174221480 / -3.5% 0.81 / 0.78 / +3.8%
tpch_q21/duckdb:parquet 270893312 / 272560802 / -0.6% 287031905 / 286220158 / +0.3% 0.94 / 0.95 / -0.9%
tpch_q22/duckdb:parquet 267907848 / 270534421 / -1.0% 277578421 / 282238425 / -1.7% 0.97 / 0.96 / +0.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.997x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24418336 / 24309184 / +0.4% 43386552 / 42420860 / +2.3% 0.56 / 0.57 / -1.8%
tpcds_q02/datafusion:vortex-file-compressed 45488614 / 44972405 / +1.1% 62242826 / 62753925 / -0.8% 0.73 / 0.72 / +2.0%
tpcds_q03/datafusion:vortex-file-compressed 11681672 / 11700172 / -0.2% 28672684 / 29480859 / -2.7% 0.41 / 0.40 / +2.7%
tpcds_q04/datafusion:vortex-file-compressed 112065648 / 113711632 / -1.4% 146590144 / 142026580 / +3.2% 0.76 / 0.80 / -4.5%
tpcds_q05/datafusion:vortex-file-compressed 59945310 / 59970442 / -0.0% 82176252 / 82658822 / -0.6% 0.73 / 0.73 / +0.5%
tpcds_q06/datafusion:vortex-file-compressed 23744127 / 23948694 / -0.9% 46303040 / 44430373 / +4.2% 0.51 / 0.54 / -4.9%
tpcds_q07/datafusion:vortex-file-compressed 32859524 / 32923748 / -0.2% 56084651 / 55992775 / +0.2% 0.59 / 0.59 / -0.4%
tpcds_q08/datafusion:vortex-file-compressed 25448603 / 25470788 / -0.1% 44667323 / 44474438 / +0.4% 0.57 / 0.57 / -0.5%
tpcds_q09/datafusion:vortex-file-compressed 16731916 / 16915770 / -1.1% 35253314 / 35944770 / -1.9% 0.47 / 0.47 / +0.9%
tpcds_q10/datafusion:vortex-file-compressed 29309238 / 28822946 / +1.7% 50357448 / 49923907 / +0.9% 0.58 / 0.58 / +0.8%
tpcds_q11/datafusion:vortex-file-compressed 63583948 / 63375044 / +0.3% 90494845 / 89098438 / +1.6% 0.70 / 0.71 / -1.2%
tpcds_q12/datafusion:vortex-file-compressed 16105313 / 16322031 / -1.3% 32931611 / 32027567 / +2.8% 0.49 / 0.51 / -4.0%
tpcds_q13/datafusion:vortex-file-compressed 34177948 / 33789342 / +1.2% 52615202 / 53123247 / -1.0% 0.65 / 0.64 / +2.1%
tpcds_q14/datafusion:vortex-file-compressed 90447064 / 92352502 / -2.1% 120732582 / 117805624 / +2.5% 0.75 / 0.78 / -4.4%
tpcds_q15/datafusion:vortex-file-compressed 24000168 / 23930524 / +0.3% 44484328 / 44530912 / -0.1% 0.54 / 0.54 / +0.4%
tpcds_q16/datafusion:vortex-file-compressed 20679489 / 20513162 / +0.8% 42216676 / 41704033 / +1.2% 0.49 / 0.49 / -0.4%
tpcds_q17/datafusion:vortex-file-compressed 61878528 / 54262272 / +14.0% 🔴 83537338 / 86414842 / -3.3% 0.74 / 0.63 / +18.0%
tpcds_q18/datafusion:vortex-file-compressed 68437507 / 68207929 / +0.3% 92931218 / 91624355 / +1.4% 0.74 / 0.74 / -1.1%
tpcds_q19/datafusion:vortex-file-compressed 18314203 / 18239348 / +0.4% 41259219 / 41720945 / -1.1% 0.44 / 0.44 / +1.5%
tpcds_q20/datafusion:vortex-file-compressed 17513859 / 17142310 / +2.2% 35686306 / 34021781 / +4.9% 0.49 / 0.50 / -2.6%
tpcds_q21/datafusion:vortex-file-compressed 16339034 / 17536338 / -6.8% 39314787 / 40546248 / -3.0% 0.42 / 0.43 / -3.9%
tpcds_q22/datafusion:vortex-file-compressed 49785286 / 49413259 / +0.8% 71208422 / 72940630 / -2.4% 0.70 / 0.68 / +3.2%
tpcds_q23/datafusion:vortex-file-compressed 72998972 / 73929216 / -1.3% 101838429 / 101651168 / +0.2% 0.72 / 0.73 / -1.4%
tpcds_q24/datafusion:vortex-file-compressed 70672961 / 70045855 / +0.9% 93975752 / 94230746 / -0.3% 0.75 / 0.74 / +1.2%
tpcds_q25/datafusion:vortex-file-compressed 54885906 / 56668872 / -3.1% 82623897 / 74211704 / +11.3% 🔴 0.66 / 0.76 / -13.0%
tpcds_q26/datafusion:vortex-file-compressed 30002232 / 30465700 / -1.5% 51477558 / 51575713 / -0.2% 0.58 / 0.59 / -1.3%
tpcds_q27/datafusion:vortex-file-compressed 61975032 / 67591662 / -8.3% 86833538 / 85884414 / +1.1% 0.71 / 0.79 / -9.3%
tpcds_q28/datafusion:vortex-file-compressed 18064934 / 18597021 / -2.9% 40034783 / 37755413 / +6.0% 0.45 / 0.49 / -8.4%
tpcds_q29/datafusion:vortex-file-compressed 61108548 / 56785086 / +7.6% 74587162 / 84043835 / -11.3% 🟢 0.82 / 0.68 / +21.3%
tpcds_q30/datafusion:vortex-file-compressed 28547110 / 27295555 / +4.6% 46556388 / 45759552 / +1.7% 0.61 / 0.60 / +2.8%
tpcds_q31/datafusion:vortex-file-compressed 64474684 / 64818545 / -0.5% 93218047 / 93377856 / -0.2% 0.69 / 0.69 / -0.4%
tpcds_q32/datafusion:vortex-file-compressed 13423538 / 13347290 / +0.6% 31543620 / 31264023 / +0.9% 0.43 / 0.43 / -0.3%
tpcds_q33/datafusion:vortex-file-compressed 27031248 / 26900292 / +0.5% 47692795 / 47981297 / -0.6% 0.57 / 0.56 / +1.1%
tpcds_q34/datafusion:vortex-file-compressed 18252316 / 18344315 / -0.5% 38368229 / 38600560 / -0.6% 0.48 / 0.48 / +0.1%
tpcds_q35/datafusion:vortex-file-compressed 35417929 / 36530109 / -3.0% 57582359 / 57490400 / +0.2% 0.62 / 0.64 / -3.2%
tpcds_q36/datafusion:vortex-file-compressed 49322612 / 47755498 / +3.3% 72857109 / 69808509 / +4.4% 0.68 / 0.68 / -1.0%
tpcds_q37/datafusion:vortex-file-compressed 13974764 / 12812932 / +9.1% 35899257 / 34037447 / +5.5% 0.39 / 0.38 / +3.4%
tpcds_q38/datafusion:vortex-file-compressed 30064676 / 29824407 / +0.8% 53641608 / 51744286 / +3.7% 0.56 / 0.58 / -2.8%
tpcds_q39/datafusion:vortex-file-compressed 65760839 / 65327518 / +0.7% 91595295 / 91061078 / +0.6% 0.72 / 0.72 / +0.1%
tpcds_q40/datafusion:vortex-file-compressed 25649212 / 25000092 / +2.6% 46602458 / 46314209 / +0.6% 0.55 / 0.54 / +2.0%
tpcds_q41/datafusion:vortex-file-compressed 16689833 / 16461460 / +1.4% 31677854 / 31329525 / +1.1% 0.53 / 0.53 / +0.3%
tpcds_q42/datafusion:vortex-file-compressed 11355965 / 11016084 / +3.1% 27675876 / 28543175 / -3.0% 0.41 / 0.39 / +6.3%
tpcds_q43/datafusion:vortex-file-compressed 13483672 / 13575120 / -0.7% 32233613 / 32664332 / -1.3% 0.42 / 0.42 / +0.7%
tpcds_q44/datafusion:vortex-file-compressed 26728416 / 26410738 / +1.2% 51319095 / 50021523 / +2.6% 0.52 / 0.53 / -1.4%
tpcds_q45/datafusion:vortex-file-compressed 27743348 / 27449045 / +1.1% 48682594 / 48576378 / +0.2% 0.57 / 0.57 / +0.9%
tpcds_q46/datafusion:vortex-file-compressed 24515098 / 24302593 / +0.9% 48955213 / 49657999 / -1.4% 0.50 / 0.49 / +2.3%
tpcds_q47/datafusion:vortex-file-compressed 78549678 / 78614744 / -0.1% 106889904 / 109680029 / -2.5% 0.73 / 0.72 / +2.5%
tpcds_q48/datafusion:vortex-file-compressed 31269038 / 31661904 / -1.2% 53435494 / 52451226 / +1.9% 0.59 / 0.60 / -3.1%
tpcds_q49/datafusion:vortex-file-compressed 59586932 / 59704805 / -0.2% 83241204 / 83030951 / +0.3% 0.72 / 0.72 / -0.4%
tpcds_q50/datafusion:vortex-file-compressed 34175040 / 34780076 / -1.7% 55406041 / 55628983 / -0.4% 0.62 / 0.63 / -1.3%
tpcds_q51/datafusion:vortex-file-compressed 60046890 / 60195929 / -0.2% 83910976 / 84074357 / -0.2% 0.72 / 0.72 / -0.1%
tpcds_q52/datafusion:vortex-file-compressed 11814627 / 11808090 / +0.1% 28118249 / 30497843 / -7.8% 0.42 / 0.39 / +8.5%
tpcds_q53/datafusion:vortex-file-compressed 18669128 / 18270292 / +2.2% 39181616 / 37347156 / +4.9% 0.48 / 0.49 / -2.6%
tpcds_q54/datafusion:vortex-file-compressed 33947778 / 34005328 / -0.2% 61071243 / 57780112 / +5.7% 0.56 / 0.59 / -5.5%
tpcds_q55/datafusion:vortex-file-compressed 11623682 / 11383448 / +2.1% 28361256 / 27808763 / +2.0% 0.41 / 0.41 / +0.1%
tpcds_q56/datafusion:vortex-file-compressed 26948126 / 26984908 / -0.1% 50137338 / 48468372 / +3.4% 0.54 / 0.56 / -3.5%
tpcds_q57/datafusion:vortex-file-compressed 73457296 / 72910589 / +0.7% 98428707 / 98944048 / -0.5% 0.75 / 0.74 / +1.3%
tpcds_q58/datafusion:vortex-file-compressed 40710150 / 40694738 / +0.0% 69647657 / 66458585 / +4.8% 0.58 / 0.61 / -4.5%
tpcds_q59/datafusion:vortex-file-compressed 32454807 / 32516062 / -0.2% 54172059 / 54122441 / +0.1% 0.60 / 0.60 / -0.3%
tpcds_q60/datafusion:vortex-file-compressed 27129220 / 26164640 / +3.7% 49620033 / 49223199 / +0.8% 0.55 / 0.53 / +2.9%
tpcds_q61/datafusion:vortex-file-compressed 25163834 / 24167548 / +4.1% 47742201 / 48046174 / -0.6% 0.53 / 0.50 / +4.8%
tpcds_q62/datafusion:vortex-file-compressed 17567570 / 17339949 / +1.3% 35817228 / 35973831 / -0.4% 0.49 / 0.48 / +1.8%
tpcds_q63/datafusion:vortex-file-compressed 18608504 / 18470431 / +0.7% 38385101 / 37969932 / +1.1% 0.48 / 0.49 / -0.3%
tpcds_q64/datafusion:vortex-file-compressed 319268785 / 321217448 / -0.6% 353200113 / 369071702 / -4.3% 0.90 / 0.87 / +3.9%
tpcds_q65/datafusion:vortex-file-compressed 76022908 / 77449350 / -1.8% 95062321 / 95453383 / -0.4% 0.80 / 0.81 / -1.4%
tpcds_q66/datafusion:vortex-file-compressed 53297471 / 52841336 / +0.9% 76396350 / 77512179 / -1.4% 0.70 / 0.68 / +2.3%
tpcds_q67/datafusion:vortex-file-compressed 55682938 / 55339462 / +0.6% 85277721 / 84901668 / +0.4% 0.65 / 0.65 / +0.2%
tpcds_q68/datafusion:vortex-file-compressed 23533754 / 23769770 / -1.0% 47700710 / 46254715 / +3.1% 0.49 / 0.51 / -4.0%
tpcds_q69/datafusion:vortex-file-compressed 29778940 / 28946876 / +2.9% 48260625 / 48866625 / -1.2% 0.62 / 0.59 / +4.2%
tpcds_q70/datafusion:vortex-file-compressed 71511770 / 71501474 / +0.0% 93168466 / 93331147 / -0.2% 0.77 / 0.77 / +0.2%
tpcds_q71/datafusion:vortex-file-compressed 19555980 / 19344512 / +1.1% 40296226 / 40664240 / -0.9% 0.49 / 0.48 / +2.0%
tpcds_q72/datafusion:vortex-file-compressed 460013874 / 455158327 / +1.1% 499622883 / 493445754 / +1.3% 0.92 / 0.92 / -0.2%
tpcds_q73/datafusion:vortex-file-compressed 17079456 / 17424344 / -2.0% 39403164 / 38425017 / +2.5% 0.43 / 0.45 / -4.4%
tpcds_q74/datafusion:vortex-file-compressed 45141141 / 45569468 / -0.9% 69843757 / 70899617 / -1.5% 0.65 / 0.64 / +0.6%
tpcds_q75/datafusion:vortex-file-compressed 133070476 / 130412102 / +2.0% 168065293 / 166136891 / +1.2% 0.79 / 0.78 / +0.9%
tpcds_q76/datafusion:vortex-file-compressed 44073094 / 42863954 / +2.8% 64570582 / 64948761 / -0.6% 0.68 / 0.66 / +3.4%
tpcds_q77/datafusion:vortex-file-compressed 35495959 / 34745384 / +2.2% 57369398 / 58824719 / -2.5% 0.62 / 0.59 / +4.8%
tpcds_q78/datafusion:vortex-file-compressed 80482678 / 80267494 / +0.3% 108692971 / 108249412 / +0.4% 0.74 / 0.74 / -0.1%
tpcds_q79/datafusion:vortex-file-compressed 20950296 / 21111920 / -0.8% 42900685 / 43116603 / -0.5% 0.49 / 0.49 / -0.3%
tpcds_q80/datafusion:vortex-file-compressed 77389302 / 76985548 / +0.5% 109369484 / 109452009 / -0.1% 0.71 / 0.70 / +0.6%
tpcds_q81/datafusion:vortex-file-compressed 27865793 / 28004702 / -0.5% 45496929 / 45256783 / +0.5% 0.61 / 0.62 / -1.0%
tpcds_q82/datafusion:vortex-file-compressed 13602369 / 13078946 / +4.0% 36086536 / 35256198 / +2.4% 0.38 / 0.37 / +1.6%
tpcds_q83/datafusion:vortex-file-compressed 36224162 / 35876788 / +1.0% 57876049 / 57897769 / -0.0% 0.63 / 0.62 / +1.0%
tpcds_q84/datafusion:vortex-file-compressed 11998848 / 12261106 / -2.1% 28768355 / 28325767 / +1.6% 0.42 / 0.43 / -3.6%
tpcds_q85/datafusion:vortex-file-compressed 60113156 / 59968952 / +0.2% 84291905 / 83756523 / +0.6% 0.71 / 0.72 / -0.4%
tpcds_q86/datafusion:vortex-file-compressed 16245630 / 16438016 / -1.2% 33374495 / 32788887 / +1.8% 0.49 / 0.50 / -2.9%
tpcds_q87/datafusion:vortex-file-compressed 29524318 / 29498180 / +0.1% 53946922 / 52154266 / +3.4% 0.55 / 0.57 / -3.2%
tpcds_q88/datafusion:vortex-file-compressed 34335161 / 34552917 / -0.6% 63580995 / 60607149 / +4.9% 0.54 / 0.57 / -5.3%
tpcds_q89/datafusion:vortex-file-compressed 21361152 / 21332386 / +0.1% 41564661 / 40765611 / +2.0% 0.51 / 0.52 / -1.8%
tpcds_q90/datafusion:vortex-file-compressed 10234288 / 10291278 / -0.6% 26301986 / 26305822 / -0.0% 0.39 / 0.39 / -0.5%
tpcds_q91/datafusion:vortex-file-compressed 17015740 / 16502722 / +3.1% 34659718 / 36428647 / -4.9% 0.49 / 0.45 / +8.4%
tpcds_q92/datafusion:vortex-file-compressed 13700366 / 13874164 / -1.3% 32341001 / 31471961 / +2.8% 0.42 / 0.44 / -3.9%
tpcds_q93/datafusion:vortex-file-compressed 23961778 / 23852352 / +0.5% 44785938 / 47250452 / -5.2% 0.54 / 0.50 / +6.0%
tpcds_q94/datafusion:vortex-file-compressed 19841616 / 19946300 / -0.5% 40308562 / 39232029 / +2.7% 0.49 / 0.51 / -3.2%
tpcds_q95/datafusion:vortex-file-compressed 46099846 / 46243064 / -0.3% 69219888 / 66683176 / +3.8% 0.67 / 0.69 / -4.0%
tpcds_q96/datafusion:vortex-file-compressed 9495898 / 9096142 / +4.4% 26054764 / 24789936 / +5.1% 0.36 / 0.37 / -0.7%
tpcds_q97/datafusion:vortex-file-compressed 21520129 / 21630422 / -0.5% 43689297 / 43912730 / -0.5% 0.49 / 0.49 / -0.0%
tpcds_q98/datafusion:vortex-file-compressed 17141347 / 17018891 / +0.7% 36519644 / 36911952 / -1.1% 0.47 / 0.46 / +1.8%
tpcds_q99/datafusion:vortex-file-compressed 19507545 / 19474668 / +0.2% 38528826 / 39117531 / -1.5% 0.51 / 0.50 / +1.7%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31379874 / 29525388 / +6.3% 50122933 / 49507473 / +1.2% 0.63 / 0.60 / +5.0%
tpcds_q02/datafusion:parquet 40019112 / 39820728 / +0.5% 59354071 / 58636814 / +1.2% 0.67 / 0.68 / -0.7%
tpcds_q03/datafusion:parquet 16431792 / 16421540 / +0.1% 31335882 / 31134856 / +0.6% 0.52 / 0.53 / -0.6%
tpcds_q04/datafusion:parquet 200530756 / 200052806 / +0.2% 229121239 / 227914662 / +0.5% 0.88 / 0.88 / -0.3%
tpcds_q05/datafusion:parquet 71870855 / 72522258 / -0.9% 96557746 / 95051661 / +1.6% 0.74 / 0.76 / -2.4%
tpcds_q06/datafusion:parquet 29091574 / 28789964 / +1.0% 49918548 / 50148846 / -0.5% 0.58 / 0.57 / +1.5%
tpcds_q07/datafusion:parquet 46754752 / 46796287 / -0.1% 68241792 / 68190291 / +0.1% 0.69 / 0.69 / -0.2%
tpcds_q08/datafusion:parquet 31566796 / 31553400 / +0.0% 48933971 / 48007180 / +1.9% 0.65 / 0.66 / -1.9%
tpcds_q09/datafusion:parquet 31260566 / 29682464 / +5.3% 45828733 / 46188290 / -0.8% 0.68 / 0.64 / +6.1%
tpcds_q10/datafusion:parquet 43067272 / 41229372 / +4.5% 62224349 / 63907852 / -2.6% 0.69 / 0.65 / +7.3%
tpcds_q11/datafusion:parquet 95657334 / 96238021 / -0.6% 119376673 / 120169688 / -0.7% 0.80 / 0.80 / +0.1%
tpcds_q12/datafusion:parquet 21389496 / 21627780 / -1.1% 36563635 / 35507038 / +3.0% 0.58 / 0.61 / -4.0%
tpcds_q13/datafusion:parquet 42199396 / 43728387 / -3.5% 69043761 / 68528607 / +0.8% 0.61 / 0.64 / -4.2%
tpcds_q14/datafusion:parquet 127875480 / 128343621 / -0.4% 153658071 / 151539863 / +1.4% 0.83 / 0.85 / -1.7%
tpcds_q15/datafusion:parquet 32871488 / 32902914 / -0.1% 51233766 / 51593548 / -0.7% 0.64 / 0.64 / +0.6%
tpcds_q16/datafusion:parquet 37979782 / 37090244 / +2.4% 57064540 / 55099037 / +3.6% 0.67 / 0.67 / -1.1%
tpcds_q17/datafusion:parquet 76544416 / 76922996 / -0.5% 105549187 / 104361525 / +1.1% 0.73 / 0.74 / -1.6%
tpcds_q18/datafusion:parquet 60065378 / 60795786 / -1.2% 82758318 / 84430531 / -2.0% 0.73 / 0.72 / +0.8%
tpcds_q19/datafusion:parquet 26540596 / 26342960 / +0.8% 45941935 / 45594195 / +0.8% 0.58 / 0.58 / -0.0%
tpcds_q20/datafusion:parquet 23429906 / 23185362 / +1.1% 37939686 / 37374838 / +1.5% 0.62 / 0.62 / -0.4%
tpcds_q21/datafusion:parquet 18718272 / 17904211 / +4.5% 34161376 / 33987613 / +0.5% 0.55 / 0.53 / +4.0%
tpcds_q22/datafusion:parquet 75590576 / 75084052 / +0.7% 90359233 / 89987705 / +0.4% 0.84 / 0.83 / +0.3%
tpcds_q23/datafusion:parquet 108780694 / 107441196 / +1.2% 139523971 / 135855747 / +2.7% 0.78 / 0.79 / -1.4%
tpcds_q24/datafusion:parquet 97367448 / 96039448 / +1.4% 122242924 / 122335882 / -0.1% 0.80 / 0.79 / +1.5%
tpcds_q25/datafusion:parquet 78558108 / 78307842 / +0.3% 107069458 / 105036356 / +1.9% 0.73 / 0.75 / -1.6%
tpcds_q26/datafusion:parquet 44023046 / 43260554 / +1.8% 63146648 / 61759550 / +2.2% 0.70 / 0.70 / -0.5%
tpcds_q27/datafusion:parquet 77244660 / 74444964 / +3.8% 98183914 / 95541275 / +2.8% 0.79 / 0.78 / +1.0%
tpcds_q28/datafusion:parquet 27601133 / 27524889 / +0.3% 44571312 / 44625529 / -0.1% 0.62 / 0.62 / +0.4%
tpcds_q29/datafusion:parquet 79293263 / 79039080 / +0.3% 104677366 / 99797106 / +4.9% 0.76 / 0.79 / -4.4%
tpcds_q30/datafusion:parquet 44891549 / 45648225 / -1.7% 63146357 / 63525836 / -0.6% 0.71 / 0.72 / -1.1%
tpcds_q31/datafusion:parquet 80889476 / 81006646 / -0.1% 104234876 / 103913587 / +0.3% 0.78 / 0.78 / -0.5%
tpcds_q32/datafusion:parquet 23248772 / 23692072 / -1.9% 41121911 / 39479957 / +4.2% 0.57 / 0.60 / -5.8%
tpcds_q33/datafusion:parquet 33532702 / 33214884 / +1.0% 52363122 / 51053283 / +2.6% 0.64 / 0.65 / -1.6%
tpcds_q34/datafusion:parquet 23714184 / 23148380 / +2.4% 37974470 / 38900905 / -2.4% 0.62 / 0.60 / +4.9%
tpcds_q35/datafusion:parquet 50285410 / 49784862 / +1.0% 70373219 / 69586443 / +1.1% 0.71 / 0.72 / -0.1%
tpcds_q36/datafusion:parquet 54634512 / 53218490 / +2.7% 78236187 / 76729957 / +2.0% 0.70 / 0.69 / +0.7%
tpcds_q37/datafusion:parquet 23631416 / 23150903 / +2.1% 38216328 / 37406492 / +2.2% 0.62 / 0.62 / -0.1%
tpcds_q38/datafusion:parquet 44150660 / 44275436 / -0.3% 65638332 / 65967488 / -0.5% 0.67 / 0.67 / +0.2%
tpcds_q39/datafusion:parquet 71736724 / 71426230 / +0.4% 91350538 / 89362074 / +2.2% 0.79 / 0.80 / -1.8%
tpcds_q40/datafusion:parquet 30530701 / 31146482 / -2.0% 50683412 / 51856179 / -2.3% 0.60 / 0.60 / +0.3%
tpcds_q41/datafusion:parquet 17229144 / 17385528 / -0.9% 29414257 / 28482182 / +3.3% 0.59 / 0.61 / -4.0%
tpcds_q42/datafusion:parquet 15357620 / 15572438 / -1.4% 30226685 / 28952870 / +4.4% 0.51 / 0.54 / -5.5%
tpcds_q43/datafusion:parquet 17739576 / 17465026 / +1.6% 32488471 / 32226814 / +0.8% 0.55 / 0.54 / +0.8%
tpcds_q44/datafusion:parquet 33401706 / 33184025 / +0.7% 52001925 / 50715496 / +2.5% 0.64 / 0.65 / -1.8%
tpcds_q45/datafusion:parquet 37698936 / 37085592 / +1.7% 56014412 / 56180087 / -0.3% 0.67 / 0.66 / +2.0%
tpcds_q46/datafusion:parquet 29725992 / 28540108 / +4.2% 49319895 / 49560402 / -0.5% 0.60 / 0.58 / +4.7%
tpcds_q47/datafusion:parquet 95981579 / 96301390 / -0.3% 123927500 / 125122146 / -1.0% 0.77 / 0.77 / +0.6%
tpcds_q48/datafusion:parquet 38276098 / 38967277 / -1.8% 60464364 / 60653428 / -0.3% 0.63 / 0.64 / -1.5%
tpcds_q49/datafusion:parquet 77859226 / 73858328 / +5.4% 99506900 / 99321785 / +0.2% 0.78 / 0.74 / +5.2%
tpcds_q50/datafusion:parquet 49795181 / 49316416 / +1.0% 70983064 / 70134200 / +1.2% 0.70 / 0.70 / -0.2%
tpcds_q51/datafusion:parquet 67186538 / 66566716 / +0.9% 90904106 / 90520931 / +0.4% 0.74 / 0.74 / +0.5%
tpcds_q52/datafusion:parquet 15877388 / 16051312 / -1.1% 30405217 / 29168921 / +4.2% 0.52 / 0.55 / -5.1%
tpcds_q53/datafusion:parquet 21940689 / 22024276 / -0.4% 39025385 / 39001645 / +0.1% 0.56 / 0.56 / -0.4%
tpcds_q54/datafusion:parquet 45626270 / 45513719 / +0.2% 65264564 / 65397057 / -0.2% 0.70 / 0.70 / +0.5%
tpcds_q55/datafusion:parquet 15485244 / 15480660 / +0.0% 29047116 / 29096577 / -0.2% 0.53 / 0.53 / +0.2%
tpcds_q56/datafusion:parquet 32828532 / 31302448 / +4.9% 54824570 / 52912314 / +3.6% 0.60 / 0.59 / +1.2%
tpcds_q57/datafusion:parquet 98856334 / 98791364 / +0.1% 123081335 / 122540205 / +0.4% 0.80 / 0.81 / -0.4%
tpcds_q58/datafusion:parquet 64855374 / 64869968 / -0.0% 87295098 / 86033435 / +1.5% 0.74 / 0.75 / -1.5%
tpcds_q59/datafusion:parquet 43139798 / 43054656 / +0.2% 63200732 / 63206831 / -0.0% 0.68 / 0.68 / +0.2%
tpcds_q60/datafusion:parquet 31345338 / 30826168 / +1.7% 52650293 / 52256527 / +0.8% 0.60 / 0.59 / +0.9%
tpcds_q61/datafusion:parquet 33472271 / 34804752 / -3.8% 56920330 / 57111876 / -0.3% 0.59 / 0.61 / -3.5%
tpcds_q62/datafusion:parquet 24463998 / 23942297 / +2.2% 38639625 / 37836779 / +2.1% 0.63 / 0.63 / +0.1%
tpcds_q63/datafusion:parquet 22279214 / 22042362 / +1.1% 38518793 / 39042434 / -1.3% 0.58 / 0.56 / +2.4%
tpcds_q64/datafusion:parquet 207626892 / 206649076 / +0.5% 241082834 / 239427838 / +0.7% 0.86 / 0.86 / -0.2%
tpcds_q65/datafusion:parquet 38849605 / 38495142 / +0.9% 59202586 / 58991151 / +0.4% 0.66 / 0.65 / +0.6%
tpcds_q66/datafusion:parquet 61521318 / 61689371 / -0.3% 80754950 / 79923996 / +1.0% 0.76 / 0.77 / -1.3%
tpcds_q67/datafusion:parquet 69912160 / 70145319 / -0.3% 97389896 / 94548260 / +3.0% 0.72 / 0.74 / -3.2%
tpcds_q68/datafusion:parquet 28550628 / 28564478 / -0.0% 50946798 / 49575687 / +2.8% 0.56 / 0.58 / -2.7%
tpcds_q69/datafusion:parquet 41869958 / 42343028 / -1.1% 60595647 / 61077302 / -0.8% 0.69 / 0.69 / -0.3%
tpcds_q70/datafusion:parquet 33114205 / 32570349 / +1.7% 55687576 / 54967059 / +1.3% 0.59 / 0.59 / +0.4%
tpcds_q71/datafusion:parquet 24413823 / 24372736 / +0.2% 38677029 / 38169937 / +1.3% 0.63 / 0.64 / -1.1%
tpcds_q72/datafusion:parquet 542767518 / 544701010 / -0.4% 573606552 / 572638059 / +0.2% 0.95 / 0.95 / -0.5%
tpcds_q73/datafusion:parquet 22296221 / 22583302 / -1.3% 39425653 / 38062523 / +3.6% 0.57 / 0.59 / -4.7%
tpcds_q74/datafusion:parquet 67465536 / 67052665 / +0.6% 88766261 / 87706917 / +1.2% 0.76 / 0.76 / -0.6%
tpcds_q75/datafusion:parquet 149809126 / 148724811 / +0.7% 172730993 / 182738078 / -5.5% 0.87 / 0.81 / +6.6%
tpcds_q76/datafusion:parquet 49733000 / 49914118 / -0.4% 64836049 / 61933775 / +4.7% 0.77 / 0.81 / -4.8%
tpcds_q77/datafusion:parquet 51378580 / 51933282 / -1.1% 73891163 / 78321606 / -5.7% 0.70 / 0.66 / +4.9%
tpcds_q78/datafusion:parquet 92342123 / 93980484 / -1.7% 120436548 / 125532688 / -4.1% 0.77 / 0.75 / +2.4%
tpcds_q79/datafusion:parquet 26131435 / 25976522 / +0.6% 44834063 / 44841543 / -0.0% 0.58 / 0.58 / +0.6%
tpcds_q80/datafusion:parquet 82168882 / 83480280 / -1.6% 109665397 / 112209537 / -2.3% 0.75 / 0.74 / +0.7%
tpcds_q81/datafusion:parquet 39893020 / 39246292 / +1.6% 59218258 / 58436874 / +1.3% 0.67 / 0.67 / +0.3%
tpcds_q82/datafusion:parquet 26047968 / 25767668 / +1.1% 41036596 / 40797051 / +0.6% 0.63 / 0.63 / +0.5%
tpcds_q83/datafusion:parquet 48704384 / 48563654 / +0.3% 67849397 / 67666565 / +0.3% 0.72 / 0.72 / +0.0%
tpcds_q84/datafusion:parquet 29797917 / 29094936 / +2.4% 46671847 / 43807519 / +6.5% 0.64 / 0.66 / -3.9%
tpcds_q85/datafusion:parquet 87214096 / 86374956 / +1.0% 109297290 / 108421279 / +0.8% 0.80 / 0.80 / +0.2%
tpcds_q86/datafusion:parquet 20886226 / 21201546 / -1.5% 34663250 / 34890186 / -0.7% 0.60 / 0.61 / -0.8%
tpcds_q87/datafusion:parquet 43104738 / 43322284 / -0.5% 60703655 / 60780933 / -0.1% 0.71 / 0.71 / -0.4%
tpcds_q88/datafusion:parquet 38629532 / 38201088 / +1.1% 60338160 / 64494702 / -6.4% 0.64 / 0.59 / +8.1%
tpcds_q89/datafusion:parquet 25654288 / 25238997 / +1.6% 43077922 / 42975014 / +0.2% 0.60 / 0.59 / +1.4%
tpcds_q90/datafusion:parquet 15911640 / 16269650 / -2.2% 31827391 / 31848098 / -0.1% 0.50 / 0.51 / -2.1%
tpcds_q91/datafusion:parquet 32019650 / 31722633 / +0.9% 50392627 / 49942230 / +0.9% 0.64 / 0.64 / +0.0%
tpcds_q92/datafusion:parquet 24398622 / 24068358 / +1.4% 42037214 / 39661516 / +6.0% 0.58 / 0.61 / -4.4%
tpcds_q93/datafusion:parquet 27388128 / 27597470 / -0.8% 47040081 / 49828366 / -5.6% 0.58 / 0.55 / +5.1%
tpcds_q94/datafusion:parquet 32067043 / 31959038 / +0.3% 49765615 / 49372062 / +0.8% 0.64 / 0.65 / -0.5%
tpcds_q95/datafusion:parquet 68016994 / 66172990 / +2.8% 80988479 / 81961989 / -1.2% 0.84 / 0.81 / +4.0%
tpcds_q96/datafusion:parquet 12975200 / 12977930 / -0.0% 28130233 / 27453073 / +2.5% 0.46 / 0.47 / -2.4%
tpcds_q97/datafusion:parquet 32196287 / 32323256 / -0.4% 53270259 / 52580594 / +1.3% 0.60 / 0.61 / -1.7%
tpcds_q98/datafusion:parquet 22882250 / 22536656 / +1.5% 39444591 / 38081397 / +3.6% 0.58 / 0.59 / -2.0%
tpcds_q99/datafusion:parquet 28709468 / 28535922 / +0.6% 43260320 / 41994072 / +3.0% 0.66 / 0.68 / -2.3%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15051352 / 14918889 / +0.9% 23406255 / 22471802 / +4.2% 0.64 / 0.66 / -3.1%
tpcds_q02/duckdb:vortex-file-compressed 15115228 / 15180908 / -0.4% 20018816 / 20334251 / -1.6% 0.76 / 0.75 / +1.1%
tpcds_q03/duckdb:vortex-file-compressed 14334685 / 13107531 / +9.4% 19405413 / 25125178 / -22.8% 🟢 0.74 / 0.52 / +41.6%
tpcds_q04/duckdb:vortex-file-compressed 50310038 / 49962058 / +0.7% 62369205 / 61521068 / +1.4% 0.81 / 0.81 / -0.7%
tpcds_q05/duckdb:vortex-file-compressed 18805154 / 18735088 / +0.4% 26896242 / 25468658 / +5.6% 0.70 / 0.74 / -5.0%
tpcds_q06/duckdb:vortex-file-compressed 26491001 / 26984416 / -1.8% 40245548 / 40925054 / -1.7% 0.66 / 0.66 / -0.2%
tpcds_q07/duckdb:vortex-file-compressed 15962288 / 15685120 / +1.8% 28152989 / 28969905 / -2.8% 0.57 / 0.54 / +4.7%
tpcds_q08/duckdb:vortex-file-compressed 19195667 / 19011929 / +1.0% 27452137 / 27244308 / +0.8% 0.70 / 0.70 / +0.2%
tpcds_q09/duckdb:vortex-file-compressed 13990906 / 13431490 / +4.2% 21790251 / 22125826 / -1.5% 0.64 / 0.61 / +5.8%
tpcds_q10/duckdb:vortex-file-compressed 27441433 / 27471218 / -0.1% 40425758 / 45830079 / -11.8% 🟢 0.68 / 0.60 / +13.2%
tpcds_q11/duckdb:vortex-file-compressed 40397738 / 39947858 / +1.1% 51770017 / 49790162 / +4.0% 0.78 / 0.80 / -2.7%
tpcds_q12/duckdb:vortex-file-compressed 10247360 / 10332476 / -0.8% 16008442 / 16094005 / -0.5% 0.64 / 0.64 / -0.3%
tpcds_q13/duckdb:vortex-file-compressed 22407894 / 21963392 / +2.0% 34647598 / 35478492 / -2.3% 0.65 / 0.62 / +4.5%
tpcds_q14/duckdb:vortex-file-compressed 57955695 / 57813278 / +0.2% 80468093 / 78774559 / +2.1% 0.72 / 0.73 / -1.9%
tpcds_q15/duckdb:vortex-file-compressed 20591672 / 20561472 / +0.1% 26753702 / 28829992 / -7.2% 0.77 / 0.71 / +7.9%
tpcds_q16/duckdb:vortex-file-compressed 17436283 / 17522219 / -0.5% 25987404 / 26610519 / -2.3% 0.67 / 0.66 / +1.9%
tpcds_q17/duckdb:vortex-file-compressed 30816840 / 29794277 / +3.4% 47584294 / 43649911 / +9.0% 0.65 / 0.68 / -5.1%
tpcds_q18/duckdb:vortex-file-compressed 28093480 / 28278048 / -0.7% 38629792 / 38748669 / -0.3% 0.73 / 0.73 / -0.3%
tpcds_q19/duckdb:vortex-file-compressed 23501851 / 23301586 / +0.9% 33257591 / 35734680 / -6.9% 0.71 / 0.65 / +8.4%
tpcds_q20/duckdb:vortex-file-compressed 10772798 / 10426340 / +3.3% 17184164 / 15604958 / +10.1% 🔴 0.63 / 0.67 / -6.2%
tpcds_q21/duckdb:vortex-file-compressed 11351126 / 9726836 / +16.7% 🔴 20697012 / 22802542 / -9.2% 0.55 / 0.43 / +28.6%
tpcds_q22/duckdb:vortex-file-compressed 28777288 / 29722024 / -3.2% 38589861 / 40917403 / -5.7% 0.75 / 0.73 / +2.7%
tpcds_q23/duckdb:vortex-file-compressed 35917375 / 36846889 / -2.5% 44687168 / 48614997 / -8.1% 0.80 / 0.76 / +6.0%
tpcds_q24/duckdb:vortex-file-compressed 28560764 / 27986492 / +2.1% 40044230 / 41699746 / -4.0% 0.71 / 0.67 / +6.3%
tpcds_q25/duckdb:vortex-file-compressed 25597276 / 25157364 / +1.7% 38960095 / 39019937 / -0.2% 0.66 / 0.64 / +1.9%
tpcds_q26/duckdb:vortex-file-compressed 13601610 / 13246468 / +2.7% 20312489 / 21395882 / -5.1% 0.67 / 0.62 / +8.2%
tpcds_q27/duckdb:vortex-file-compressed 17557246 / 17828057 / -1.5% 30288442 / 29896588 / +1.3% 0.58 / 0.60 / -2.8%
tpcds_q28/duckdb:vortex-file-compressed 12754520 / 13588062 / -6.1% 21321464 / 27126544 / -21.4% 🟢 0.60 / 0.50 / +19.4%
tpcds_q29/duckdb:vortex-file-compressed 28910788 / 28185930 / +2.6% 44067124 / 43181986 / +2.0% 0.66 / 0.65 / +0.5%
tpcds_q30/duckdb:vortex-file-compressed 19148739 / 19006386 / +0.7% 27093537 / 28091828 / -3.6% 0.71 / 0.68 / +4.5%
tpcds_q31/duckdb:vortex-file-compressed 19376504 / 19196170 / +0.9% 26689901 / 33728183 / -20.9% 🟢 0.73 / 0.57 / +27.6%
tpcds_q32/duckdb:vortex-file-compressed 9844456 / 10075557 / -2.3% 16989248 / 17935773 / -5.3% 0.58 / 0.56 / +3.1%
tpcds_q33/duckdb:vortex-file-compressed 16893133 / 16596362 / +1.8% 27887416 / 26985425 / +3.3% 0.61 / 0.62 / -1.5%
tpcds_q34/duckdb:vortex-file-compressed 15318039 / 15265786 / +0.3% 20950590 / 20485817 / +2.3% 0.73 / 0.75 / -1.9%
tpcds_q35/duckdb:vortex-file-compressed 45927964 / 45939222 / -0.0% 59558760 / 63402479 / -6.1% 0.77 / 0.72 / +6.4%
tpcds_q36/duckdb:vortex-file-compressed 15921058 / 14990999 / +6.2% 25712985 / 25155134 / +2.2% 0.62 / 0.60 / +3.9%
tpcds_q37/duckdb:vortex-file-compressed 13515211 / 13859566 / -2.5% 23977934 / 23330309 / +2.8% 0.56 / 0.59 / -5.1%
tpcds_q38/duckdb:vortex-file-compressed 22303098 / 22072964 / +1.0% 29197922 / 30960141 / -5.7% 0.76 / 0.71 / +7.1%
tpcds_q39/duckdb:vortex-file-compressed 18102203 / 18172540 / -0.4% 26291346 / 27081319 / -2.9% 0.69 / 0.67 / +2.6%
tpcds_q40/duckdb:vortex-file-compressed 13310922 / 13286458 / +0.2% 18977220 / 19348049 / -1.9% 0.70 / 0.69 / +2.1%
tpcds_q41/duckdb:vortex-file-compressed 6539942 / 6503894 / +0.6% 12548336 / 9705081 / +29.3% 🔴 0.52 / 0.67 / -22.2%
tpcds_q42/duckdb:vortex-file-compressed 8191226 / 8696162 / -5.8% 19102932 / 17637583 / +8.3% 0.43 / 0.49 / -13.0%
tpcds_q43/duckdb:vortex-file-compressed 10062916 / 10465943 / -3.9% 19891187 / 20764259 / -4.2% 0.51 / 0.50 / +0.4%
tpcds_q44/duckdb:vortex-file-compressed 15931179 / 15932254 / -0.0% 27548182 / 25290558 / +8.9% 0.58 / 0.63 / -8.2%
tpcds_q45/duckdb:vortex-file-compressed 22060560 / 22341730 / -1.3% 29216454 / 29386177 / -0.6% 0.76 / 0.76 / -0.7%
tpcds_q46/duckdb:vortex-file-compressed 18425503 / 18369312 / +0.3% 31456160 / 28776441 / +9.3% 0.59 / 0.64 / -8.2%
tpcds_q47/duckdb:vortex-file-compressed 30235060 / 30160610 / +0.2% 45782465 / 42363323 / +8.1% 0.66 / 0.71 / -7.2%
tpcds_q48/duckdb:vortex-file-compressed 19810130 / 19514105 / +1.5% 29964680 / 32072853 / -6.6% 0.66 / 0.61 / +8.7%
tpcds_q49/duckdb:vortex-file-compressed 16481896 / 16466266 / +0.1% 30383948 / 29579906 / +2.7% 0.54 / 0.56 / -2.6%
tpcds_q50/duckdb:vortex-file-compressed 16838234 / 16455132 / +2.3% 29479040 / 26825612 / +9.9% 0.57 / 0.61 / -6.9%
tpcds_q51/duckdb:vortex-file-compressed 76153370 / 64174662 / +18.7% 🔴 64086137 / 61314397 / +4.5% 1.19 / 1.05 / +13.5%
tpcds_q52/duckdb:vortex-file-compressed 8442750 / 8123064 / +3.9% 16445532 / 22992797 / -28.5% 🟢 0.51 / 0.35 / +45.3%
tpcds_q53/duckdb:vortex-file-compressed 14988100 / 14349448 / +4.5% 23545135 / 28250927 / -16.7% 🟢 0.64 / 0.51 / +25.3%
tpcds_q54/duckdb:vortex-file-compressed 20062375 / 20342954 / -1.4% 28689430 / 29340526 / -2.2% 0.70 / 0.69 / +0.9%
tpcds_q55/duckdb:vortex-file-compressed 9028809 / 8193077 / +10.2% 🔴 20070072 / 21660227 / -7.3% 0.45 / 0.38 / +18.9%
tpcds_q56/duckdb:vortex-file-compressed 17091706 / 17307537 / -1.2% 28093686 / 28706247 / -2.1% 0.61 / 0.60 / +0.9%
tpcds_q57/duckdb:vortex-file-compressed 24074558 / 23871832 / +0.8% 30891737 / 31417481 / -1.7% 0.78 / 0.76 / +2.6%
tpcds_q58/duckdb:vortex-file-compressed 17778988 / 17656072 / +0.7% 30213492 / 26804050 / +12.7% 🔴 0.59 / 0.66 / -10.7%
tpcds_q59/duckdb:vortex-file-compressed 18392158 / 18605089 / -1.1% 24021114 / 24312707 / -1.2% 0.77 / 0.77 / +0.1%
tpcds_q60/duckdb:vortex-file-compressed 18056933 / 18080916 / -0.1% 29990229 / 28081688 / +6.8% 0.60 / 0.64 / -6.5%
tpcds_q61/duckdb:vortex-file-compressed 19403278 / 19732216 / -1.7% 30915534 / 31260118 / -1.1% 0.63 / 0.63 / -0.6%
tpcds_q62/duckdb:vortex-file-compressed 10192222 / 10050972 / +1.4% 18799982 / 18810544 / -0.1% 0.54 / 0.53 / +1.5%
tpcds_q63/duckdb:vortex-file-compressed 13761142 / 13756854 / +0.0% 22124586 / 23002243 / -3.8% 0.62 / 0.60 / +4.0%
tpcds_q64/duckdb:vortex-file-compressed 63050537 / 62271952 / +1.3% 75495707 / 81421430 / -7.3% 0.84 / 0.76 / +9.2%
tpcds_q65/duckdb:vortex-file-compressed 15405164 / 15893368 / -3.1% 26638832 / 24984006 / +6.6% 0.58 / 0.64 / -9.1%
tpcds_q66/duckdb:vortex-file-compressed 20984869 / 21272800 / -1.4% 28204162 / 30833966 / -8.5% 0.74 / 0.69 / +7.8%
tpcds_q67/duckdb:vortex-file-compressed 65219988 / 65281415 / -0.1% 77644394 / 79316782 / -2.1% 0.84 / 0.82 / +2.1%
tpcds_q68/duckdb:vortex-file-compressed 18071301 / 18015545 / +0.3% 36016057 / 29257761 / +23.1% 🔴 0.50 / 0.62 / -18.5%
tpcds_q69/duckdb:vortex-file-compressed 28720378 / 29493796 / -2.6% 41653890 / 45918123 / -9.3% 0.69 / 0.64 / +7.3%
tpcds_q70/duckdb:vortex-file-compressed 18554828 / 18847530 / -1.6% 28504404 / 28017320 / +1.7% 0.65 / 0.67 / -3.2%
tpcds_q71/duckdb:vortex-file-compressed 12208952 / 12516728 / -2.5% 21766347 / 22298424 / -2.4% 0.56 / 0.56 / -0.1%
tpcds_q72/duckdb:vortex-file-compressed 61400844 / 61362250 / +0.1% 75397463 / 75323769 / +0.1% 0.81 / 0.81 / -0.0%
tpcds_q73/duckdb:vortex-file-compressed 14735517 / 15020610 / -1.9% 20591830 / 20118400 / +2.4% 0.72 / 0.75 / -4.2%
tpcds_q74/duckdb:vortex-file-compressed 27109869 / 27251586 / -0.5% 36114899 / 36751098 / -1.7% 0.75 / 0.74 / +1.2%
tpcds_q75/duckdb:vortex-file-compressed 28446009 / 28503384 / -0.2% 41940469 / 39686432 / +5.7% 0.68 / 0.72 / -5.6%
tpcds_q76/duckdb:vortex-file-compressed 12125508 / 12890374 / -5.9% 26471971 / 24264310 / +9.1% 0.46 / 0.53 / -13.8%
tpcds_q77/duckdb:vortex-file-compressed 15807145 / 15648138 / +1.0% 22858848 / 24494321 / -6.7% 0.69 / 0.64 / +8.2%
tpcds_q78/duckdb:vortex-file-compressed 37858560 / 36720739 / +3.1% 46775042 / 47760044 / -2.1% 0.81 / 0.77 / +5.3%
tpcds_q79/duckdb:vortex-file-compressed 14314968 / 14995285 / -4.5% 24114704 / 27014116 / -10.7% 🟢 0.59 / 0.56 / +6.9%
tpcds_q80/duckdb:vortex-file-compressed 27813588 / 28090704 / -1.0% 61429467 / 45273148 / +35.7% 🔴 0.45 / 0.62 / -27.0%
tpcds_q81/duckdb:vortex-file-compressed 22190766 / 21989996 / +0.9% 29105363 / 29840267 / -2.5% 0.76 / 0.74 / +3.5%
tpcds_q82/duckdb:vortex-file-compressed 31658328 / 32421332 / -2.4% 37844338 / 43499042 / -13.0% 🟢 0.84 / 0.75 / +12.2%
tpcds_q83/duckdb:vortex-file-compressed 20176388 / 19805270 / +1.9% 25300880 / 26051238 / -2.9% 0.80 / 0.76 / +4.9%
tpcds_q84/duckdb:vortex-file-compressed 12906006 / 12611572 / +2.3% 20955512 / 19388372 / +8.1% 0.62 / 0.65 / -5.3%
tpcds_q85/duckdb:vortex-file-compressed 30888434 / 31248856 / -1.2% 40243226 / 40709875 / -1.1% 0.77 / 0.77 / -0.0%
tpcds_q86/duckdb:vortex-file-compressed 10717418 / 10801582 / -0.8% 20297392 / 19252079 / +5.4% 0.53 / 0.56 / -5.9%
tpcds_q87/duckdb:vortex-file-compressed 23766988 / 23892054 / -0.5% 30577945 / 35238593 / -13.2% 🟢 0.78 / 0.68 / +14.6%
tpcds_q88/duckdb:vortex-file-compressed 32329771 / 32343070 / -0.0% 43037366 / 43608502 / -1.3% 0.75 / 0.74 / +1.3%
tpcds_q89/duckdb:vortex-file-compressed 13933832 / 13759814 / +1.3% 24092371 / 24733612 / -2.6% 0.58 / 0.56 / +4.0%
tpcds_q90/duckdb:vortex-file-compressed 8170486 / 8115524 / +0.7% 15552598 / 13523951 / +15.0% 🔴 0.53 / 0.60 / -12.5%
tpcds_q91/duckdb:vortex-file-compressed 15047981 / 15204520 / -1.0% 21006464 / 23236186 / -9.6% 0.72 / 0.65 / +9.5%
tpcds_q92/duckdb:vortex-file-compressed 12988064 / 13168046 / -1.4% 23112368 / 24712384 / -6.5% 0.56 / 0.53 / +5.5%
tpcds_q93/duckdb:vortex-file-compressed 16724578 / 17023968 / -1.8% 26610577 / 25214463 / +5.5% 0.63 / 0.68 / -6.9%
tpcds_q94/duckdb:vortex-file-compressed 16250310 / 16467658 / -1.3% 30641095 / 25719910 / +19.1% 🔴 0.53 / 0.64 / -17.2%
tpcds_q95/duckdb:vortex-file-compressed 44093850 / 42924996 / +2.7% 51366138 / 53393376 / -3.8% 0.86 / 0.80 / +6.8%
tpcds_q96/duckdb:vortex-file-compressed 9691912 / 7042504 / +37.6% 🔴 15143330 / 16787699 / -9.8% 0.64 / 0.42 / +52.6%
tpcds_q97/duckdb:vortex-file-compressed 22218368 / 22480862 / -1.2% 31100058 / 29455836 / +5.6% 0.71 / 0.76 / -6.4%
tpcds_q98/duckdb:vortex-file-compressed 13323290 / 13217590 / +0.8% 21315531 / 21860917 / -2.5% 0.63 / 0.60 / +3.4%
tpcds_q99/duckdb:vortex-file-compressed 13313360 / 13417768 / -0.8% 19259022 / 19263306 / -0.0% 0.69 / 0.70 / -0.8%
duckdb / parquet / ns (0.995x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24594743 / 26473638 / -7.1% 31865630 / 31535587 / +1.0% 0.77 / 0.84 / -8.1%
tpcds_q02/duckdb:parquet 15824336 / 15648402 / +1.1% 20819606 / 20278183 / +2.7% 0.76 / 0.77 / -1.5%
tpcds_q03/duckdb:parquet 9026041 / 9214230 / -2.0% 16217296 / 16262437 / -0.3% 0.56 / 0.57 / -1.8%
tpcds_q04/duckdb:parquet 129344227 / 129998755 / -0.5% 138014486 / 134796295 / +2.4% 0.94 / 0.96 / -2.8%
tpcds_q05/duckdb:parquet 22114168 / 22244472 / -0.6% 26422853 / 26116094 / +1.2% 0.84 / 0.85 / -1.7%
tpcds_q06/duckdb:parquet 26547600 / 26704146 / -0.6% 37717210 / 39264357 / -3.9% 0.70 / 0.68 / +3.5%
tpcds_q07/duckdb:parquet 15594094 / 15676323 / -0.5% 24333146 / 22245493 / +9.4% 0.64 / 0.70 / -9.1%
tpcds_q08/duckdb:parquet 25743086 / 25824948 / -0.3% 33532730 / 32869643 / +2.0% 0.77 / 0.79 / -2.3%
tpcds_q09/duckdb:parquet 19063086 / 18678622 / +2.1% 23881291 / 22139884 / +7.9% 0.80 / 0.84 / -5.4%
tpcds_q10/duckdb:parquet 27931572 / 28535020 / -2.1% 37883848 / 39384075 / -3.8% 0.74 / 0.72 / +1.8%
tpcds_q11/duckdb:parquet 73019246 / 73077000 / -0.1% 77955180 / 76966049 / +1.3% 0.94 / 0.95 / -1.3%
tpcds_q12/duckdb:parquet 12840628 / 12681624 / +1.3% 17513123 / 17283853 / +1.3% 0.73 / 0.73 / -0.1%
tpcds_q13/duckdb:parquet 24207732 / 24714888 / -2.1% 30800033 / 30457227 / +1.1% 0.79 / 0.81 / -3.1%
tpcds_q14/duckdb:parquet 63400262 / 61309167 / +3.4% 68021366 / 67806993 / +0.3% 0.93 / 0.90 / +3.1%
tpcds_q15/duckdb:parquet 25342942 / 28204026 / -10.1% 🟢 31323121 / 32913101 / -4.8% 0.81 / 0.86 / -5.6%
tpcds_q16/duckdb:parquet 20983150 / 21050268 / -0.3% 29385985 / 28790001 / +2.1% 0.71 / 0.73 / -2.3%
tpcds_q17/duckdb:parquet 32766236 / 32909174 / -0.4% 40382771 / 40678348 / -0.7% 0.81 / 0.81 / +0.3%
tpcds_q18/duckdb:parquet 39770636 / 40183815 / -1.0% 54585955 / 51632789 / +5.7% 0.73 / 0.78 / -6.4%
tpcds_q19/duckdb:parquet 25234759 / 25236858 / -0.0% 31970074 / 31923389 / +0.1% 0.79 / 0.79 / -0.2%
tpcds_q20/duckdb:parquet 16699196 / 14130836 / +18.2% 🔴 21771649 / 19003210 / +14.6% 🔴 0.77 / 0.74 / +3.1%
tpcds_q21/duckdb:parquet 9525326 / 9588219 / -0.7% 16161676 / 12386527 / +30.5% 🔴 0.59 / 0.77 / -23.9%
tpcds_q22/duckdb:parquet 35212584 / 36167060 / -2.6% 40350672 / 39612751 / +1.9% 0.87 / 0.91 / -4.4%
tpcds_q23/duckdb:parquet 41064153 / 41283198 / -0.5% 48460573 / 47241280 / +2.6% 0.85 / 0.87 / -3.0%
tpcds_q24/duckdb:parquet 33618680 / 33859239 / -0.7% 42278299 / 43644308 / -3.1% 0.80 / 0.78 / +2.5%
tpcds_q25/duckdb:parquet 31562350 / 31573650 / -0.0% 40667905 / 40427798 / +0.6% 0.78 / 0.78 / -0.6%
tpcds_q26/duckdb:parquet 31485536 / 31754962 / -0.8% 38603317 / 39110264 / -1.3% 0.82 / 0.81 / +0.5%
tpcds_q27/duckdb:parquet 32063703 / 32092168 / -0.1% 41765747 / 39343388 / +6.2% 0.77 / 0.82 / -5.9%
tpcds_q28/duckdb:parquet 17481930 / 17824532 / -1.9% 22102668 / 22066409 / +0.2% 0.79 / 0.81 / -2.1%
tpcds_q29/duckdb:parquet 30962562 / 31334904 / -1.2% 38510111 / 39285847 / -2.0% 0.80 / 0.80 / +0.8%
tpcds_q30/duckdb:parquet 34292388 / 33996238 / +0.9% 42703431 / 43061288 / -0.8% 0.80 / 0.79 / +1.7%
tpcds_q31/duckdb:parquet 20794118 / 20606464 / +0.9% 25262096 / 26862596 / -6.0% 0.82 / 0.77 / +7.3%
tpcds_q32/duckdb:parquet 12172106 / 12190574 / -0.2% 18893551 / 18828929 / +0.3% 0.64 / 0.65 / -0.5%
tpcds_q33/duckdb:parquet 16467906 / 16341966 / +0.8% 23173304 / 22935659 / +1.0% 0.71 / 0.71 / -0.3%
tpcds_q34/duckdb:parquet 16350510 / 16309586 / +0.3% 22273006 / 22100417 / +0.8% 0.73 / 0.74 / -0.5%
tpcds_q35/duckdb:parquet 46917839 / 47018351 / -0.2% 58318523 / 56828433 / +2.6% 0.80 / 0.83 / -2.8%
tpcds_q36/duckdb:parquet 15882725 / 15833210 / +0.3% 23318136 / 23372941 / -0.2% 0.68 / 0.68 / +0.5%
tpcds_q37/duckdb:parquet 11525987 / 12532740 / -8.0% 18707716 / 18674677 / +0.2% 0.62 / 0.67 / -8.2%
tpcds_q38/duckdb:parquet 26786298 / 26978295 / -0.7% 30549844 / 30893909 / -1.1% 0.88 / 0.87 / +0.4%
tpcds_q39/duckdb:parquet 24349780 / 24308728 / +0.2% 30207255 / 31004475 / -2.6% 0.81 / 0.78 / +2.8%
tpcds_q40/duckdb:parquet 16506078 / 16496842 / +0.1% 21078693 / 21183831 / -0.5% 0.78 / 0.78 / +0.6%
tpcds_q41/duckdb:parquet 7702878 / 7914134 / -2.7% 13157090 / 13408355 / -1.9% 0.59 / 0.59 / -0.8%
tpcds_q42/duckdb:parquet 8718448 / 8704488 / +0.2% 15524249 / 15236736 / +1.9% 0.56 / 0.57 / -1.7%
tpcds_q43/duckdb:parquet 10618945 / 10700276 / -0.8% 14939669 / 14978634 / -0.3% 0.71 / 0.71 / -0.5%
tpcds_q44/duckdb:parquet 15944139 / 15771100 / +1.1% 21694312 / 22944648 / -5.4% 0.73 / 0.69 / +6.9%
tpcds_q45/duckdb:parquet 23602968 / 23657974 / -0.2% 29273408 / 31606478 / -7.4% 0.81 / 0.75 / +7.7%
tpcds_q46/duckdb:parquet 36911258 / 37304662 / -1.1% 45007921 / 47535518 / -5.3% 0.82 / 0.78 / +4.5%
tpcds_q47/duckdb:parquet 31110687 / 34762737 / -10.5% 🟢 36336463 / 38359105 / -5.3% 0.86 / 0.91 / -5.5%
tpcds_q48/duckdb:parquet 21173278 / 22040206 / -3.9% 27118153 / 26811342 / +1.1% 0.78 / 0.82 / -5.0%
tpcds_q49/duckdb:parquet 20135854 / 20075568 / +0.3% 27510328 / 28018111 / -1.8% 0.73 / 0.72 / +2.2%
tpcds_q50/duckdb:parquet 17910274 / 19199799 / -6.7% 23480204 / 27178594 / -13.6% 🟢 0.76 / 0.71 / +8.0%
tpcds_q51/duckdb:parquet 53680084 / 53078606 / +1.1% 59216707 / 65251573 / -9.2% 0.91 / 0.81 / +11.4%
tpcds_q52/duckdb:parquet 8915644 / 11598756 / -23.1% 🟢 16825656 / 15945472 / +5.5% 0.53 / 0.73 / -27.2%
tpcds_q53/duckdb:parquet 11792180 / 11879498 / -0.7% 16622758 / 16447471 / +1.1% 0.71 / 0.72 / -1.8%
tpcds_q54/duckdb:parquet 20816630 / 20641763 / +0.8% 30295481 / 29739879 / +1.9% 0.69 / 0.69 / -1.0%
tpcds_q55/duckdb:parquet 8916012 / 10027805 / -11.1% 🟢 15576616 / 15834409 / -1.6% 0.57 / 0.63 / -9.6%
tpcds_q56/duckdb:parquet 19511744 / 16917334 / +15.3% 🔴 23420212 / 24147811 / -3.0% 0.83 / 0.70 / +18.9%
tpcds_q57/duckdb:parquet 28912162 / 29006845 / -0.3% 34294279 / 34861817 / -1.6% 0.84 / 0.83 / +1.3%
tpcds_q58/duckdb:parquet 18947590 / 18989701 / -0.2% 26515880 / 26571618 / -0.2% 0.71 / 0.71 / -0.0%
tpcds_q59/duckdb:parquet 21623316 / 19859891 / +8.9% 28537540 / 24888142 / +14.7% 🔴 0.76 / 0.80 / -5.0%
tpcds_q60/duckdb:parquet 17449778 / 17654368 / -1.2% 24480171 / 24232335 / +1.0% 0.71 / 0.73 / -2.2%
tpcds_q61/duckdb:parquet 22012868 / 22355985 / -1.5% 27674000 / 28514895 / -2.9% 0.80 / 0.78 / +1.5%
tpcds_q62/duckdb:parquet 10719357 / 10853638 / -1.2% 14483988 / 14508703 / -0.2% 0.74 / 0.75 / -1.1%
tpcds_q63/duckdb:parquet 11090150 / 11148877 / -0.5% 16247487 / 16062010 / +1.2% 0.68 / 0.69 / -1.7%
tpcds_q64/duckdb:parquet 54179448 / 52981870 / +2.3% 64361174 / 66510590 / -3.2% 0.84 / 0.80 / +5.7%
tpcds_q65/duckdb:parquet 14706751 / 14684628 / +0.2% 22095887 / 22503380 / -1.8% 0.67 / 0.65 / +2.0%
tpcds_q66/duckdb:parquet 24761832 / 24733433 / +0.1% 30724673 / 30709296 / +0.1% 0.81 / 0.81 / +0.1%
tpcds_q67/duckdb:parquet 76784313 / 76715374 / +0.1% 83674812 / 85997333 / -2.7% 0.92 / 0.89 / +2.9%
tpcds_q68/duckdb:parquet 31070391 / 30116958 / +3.2% 39671089 / 38804619 / +2.2% 0.78 / 0.78 / +0.9%
tpcds_q69/duckdb:parquet 29025952 / 29182171 / -0.5% 39144781 / 38951390 / +0.5% 0.74 / 0.75 / -1.0%
tpcds_q70/duckdb:parquet 16124662 / 16162476 / -0.2% 22878428 / 23263761 / -1.7% 0.70 / 0.69 / +1.4%
tpcds_q71/duckdb:parquet 15077210 / 15086863 / -0.1% 23613612 / 21185354 / +11.5% 🔴 0.64 / 0.71 / -10.3%
tpcds_q72/duckdb:parquet 84486791 / 81521346 / +3.6% 86413176 / 86132476 / +0.3% 0.98 / 0.95 / +3.3%
tpcds_q73/duckdb:parquet 13707574 / 13762293 / -0.4% 19574721 / 19142486 / +2.3% 0.70 / 0.72 / -2.6%
tpcds_q74/duckdb:parquet 100280026 / 101326346 / -1.0% 109786974 / 108091220 / +1.6% 0.91 / 0.94 / -2.6%
tpcds_q75/duckdb:parquet 40533345 / 41207773 / -1.6% 50347387 / 51297145 / -1.9% 0.81 / 0.80 / +0.2%
tpcds_q76/duckdb:parquet 13734846 / 13953236 / -1.6% 21094926 / 27829777 / -24.2% 🟢 0.65 / 0.50 / +29.9%
tpcds_q77/duckdb:parquet 17399226 / 17347954 / +0.3% 25485828 / 24541386 / +3.8% 0.68 / 0.71 / -3.4%
tpcds_q78/duckdb:parquet 48610568 / 48911129 / -0.6% 52277564 / 53581825 / -2.4% 0.93 / 0.91 / +1.9%
tpcds_q79/duckdb:parquet 21101397 / 21226626 / -0.6% 28549860 / 28514107 / +0.1% 0.74 / 0.74 / -0.7%
tpcds_q80/duckdb:parquet 32753947 / 32624931 / +0.4% 40122117 / 42625027 / -5.9% 0.82 / 0.77 / +6.7%
tpcds_q81/duckdb:parquet 31738196 / 31253712 / +1.6% 39831261 / 41436783 / -3.9% 0.80 / 0.75 / +5.6%
tpcds_q82/duckdb:parquet 12477896 / 12493498 / -0.1% 17208397 / 17640655 / -2.5% 0.73 / 0.71 / +2.4%
tpcds_q83/duckdb:parquet 18395022 / 16762258 / +9.7% 21059682 / 20729306 / +1.6% 0.87 / 0.81 / +8.0%
tpcds_q84/duckdb:parquet 18510047 / 18747114 / -1.3% 24666140 / 23964365 / +2.9% 0.75 / 0.78 / -4.1%
tpcds_q85/duckdb:parquet 35513902 / 35678694 / -0.5% 44697807 / 44522582 / +0.4% 0.79 / 0.80 / -0.9%
tpcds_q86/duckdb:parquet 12768272 / 13742577 / -7.1% 16578446 / 18984669 / -12.7% 🟢 0.77 / 0.72 / +6.4%
tpcds_q87/duckdb:parquet 28473754 / 28304876 / +0.6% 32885982 / 34788517 / -5.5% 0.87 / 0.81 / +6.4%
tpcds_q88/duckdb:parquet 27887995 / 26950720 / +3.5% 33149122 / 31378271 / +5.6% 0.84 / 0.86 / -2.1%
tpcds_q89/duckdb:parquet 12913368 / 12896540 / +0.1% 18596829 / 18483781 / +0.6% 0.69 / 0.70 / -0.5%
tpcds_q90/duckdb:parquet 6978677 / 6975438 / +0.0% 11439967 / 13268111 / -13.8% 🟢 0.61 / 0.53 / +16.0%
tpcds_q91/duckdb:parquet 21479710 / 21389339 / +0.4% 29452875 / 29223210 / +0.8% 0.73 / 0.73 / -0.4%
tpcds_q92/duckdb:parquet 12546076 / 12386228 / +1.3% 18878377 / 18767084 / +0.6% 0.66 / 0.66 / +0.7%
tpcds_q93/duckdb:parquet 21800092 / 21644461 / +0.7% 26766132 / 27006078 / -0.9% 0.81 / 0.80 / +1.6%
tpcds_q94/duckdb:parquet 16874916 / 16893324 / -0.1% 25491700 / 25084647 / +1.6% 0.66 / 0.67 / -1.7%
tpcds_q95/duckdb:parquet 90859560 / 92372344 / -1.6% 100118823 / 99363759 / +0.8% 0.91 / 0.93 / -2.4%
tpcds_q96/duckdb:parquet 7474379 / 6954312 / +7.5% 13598940 / 10871960 / +25.1% 🔴 0.55 / 0.64 / -14.1%
tpcds_q97/duckdb:parquet 26043521 / 25908214 / +0.5% 32801212 / 32817857 / -0.1% 0.79 / 0.79 / +0.6%
tpcds_q98/duckdb:parquet 15280250 / 15126672 / +1.0% 22383596 / 22746117 / -1.6% 0.68 / 0.67 / +2.7%
tpcds_q99/duckdb:parquet 17340440 / 18431412 / -5.9% 21222973 / 24979262 / -15.0% 🟢 0.82 / 0.74 / +10.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Engines: DuckDB No clear signal (+2.4%, low confidence)
Vortex (geomean): hot 1.011x ➖ · cold 1.027x ➖
Parquet (geomean): hot 0.987x ➖ · cold 0.981x ➖
Shifts: Parquet (control) -1.3% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1813948 / — / no baseline 5597553 / — / no baseline 0.32 / — / no baseline
statpopgen_q01/datafusion:vortex-file-compressed 6992334 / — / no baseline 15306345 / — / no baseline 0.46 / — / no baseline
statpopgen_q02/datafusion:vortex-file-compressed 110322046 / — / no baseline 140843137 / — / no baseline 0.78 / — / no baseline
statpopgen_q03/datafusion:vortex-file-compressed 348225858 / — / no baseline 393838967 / — / no baseline 0.88 / — / no baseline
statpopgen_q04/datafusion:vortex-file-compressed 348782588 / — / no baseline 383628375 / — / no baseline 0.91 / — / no baseline
statpopgen_q05/datafusion:vortex-file-compressed 208960548 / — / no baseline 261398050 / — / no baseline 0.80 / — / no baseline
statpopgen_q06/datafusion:vortex-file-compressed 765655747 / — / no baseline 784507041 / — / no baseline 0.98 / — / no baseline
statpopgen_q07/datafusion:vortex-file-compressed 287015942 / — / no baseline 301267590 / — / no baseline 0.95 / — / no baseline
statpopgen_q08/datafusion:vortex-file-compressed 300212190 / — / no baseline 318282989 / — / no baseline 0.94 / — / no baseline
statpopgen_q09/datafusion:vortex-file-compressed 251456532 / — / no baseline 286356446 / — / no baseline 0.88 / — / no baseline
statpopgen_q10/datafusion:vortex-file-compressed 750976408 / — / no baseline 790380705 / — / no baseline 0.95 / — / no baseline
datafusion / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1979874 / — / no baseline 90280879 / — / no baseline 0.02 / — / no baseline
statpopgen_q01/datafusion:parquet 162162272 / — / no baseline 173738837 / — / no baseline 0.93 / — / no baseline
statpopgen_q02/datafusion:parquet 288584330 / — / no baseline 423357408 / — / no baseline 0.68 / — / no baseline
statpopgen_q03/datafusion:parquet 413534952 / — / no baseline 493653919 / — / no baseline 0.84 / — / no baseline
statpopgen_q04/datafusion:parquet 405489072 / — / no baseline 529382442 / — / no baseline 0.77 / — / no baseline
statpopgen_q05/datafusion:parquet 316229626 / — / no baseline 458117246 / — / no baseline 0.69 / — / no baseline
statpopgen_q06/datafusion:parquet 518743142 / — / no baseline 635864086 / — / no baseline 0.82 / — / no baseline
statpopgen_q07/datafusion:parquet 439508043 / — / no baseline 546582633 / — / no baseline 0.80 / — / no baseline
statpopgen_q08/datafusion:parquet 437792038 / — / no baseline 577224631 / — / no baseline 0.76 / — / no baseline
statpopgen_q09/datafusion:parquet 359087372 / — / no baseline 484950192 / — / no baseline 0.74 / — / no baseline
statpopgen_q10/datafusion:parquet 575744327 / — / no baseline 693468624 / — / no baseline 0.83 / — / no baseline
duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9035197 / 8964423 / +0.8% 9384706 / 9355141 / +0.3% 0.96 / 0.96 / +0.5%
statpopgen_q01/duckdb:vortex-file-compressed 10359100 / 10402841 / -0.4% 13537293 / 13557337 / -0.1% 0.77 / 0.77 / -0.3%
statpopgen_q02/duckdb:vortex-file-compressed 304134172 / 306639138 / -0.8% 347711166 / 342344566 / +1.6% 0.87 / 0.90 / -2.3%
statpopgen_q03/duckdb:vortex-file-compressed 811112656 / 806874484 / +0.5% 813523503 / 825768841 / -1.5% 1.00 / 0.98 / +2.0%
statpopgen_q04/duckdb:vortex-file-compressed 811080311 / 803752348 / +0.9% 817672119 / 802864865 / +1.8% 0.99 / 1.00 / -0.9%
statpopgen_q05/duckdb:vortex-file-compressed 320887470 / 320927770 / -0.0% 367006084 / 362825846 / +1.2% 0.87 / 0.88 / -1.2%
statpopgen_q06/duckdb:vortex-file-compressed 1145375715 / 1139671986 / +0.5% 1157058523 / 1148208219 / +0.8% 0.99 / 0.99 / -0.3%
statpopgen_q07/duckdb:vortex-file-compressed 113725765 / 110975892 / +2.5% 131538336 / 124473742 / +5.7% 0.86 / 0.89 / -3.0%
statpopgen_q08/duckdb:vortex-file-compressed 132203400 / 127027037 / +4.1% 174619840 / 142867014 / +22.2% 🔴 0.76 / 0.89 / -14.8%
statpopgen_q09/duckdb:vortex-file-compressed 618455942 / 610500554 / +1.3% 633369833 / 635465045 / -0.3% 0.98 / 0.96 / +1.6%
statpopgen_q10/duckdb:vortex-file-compressed 1937535859 / 1891413148 / +2.4% 1903103083 / 1906437277 / -0.2% 1.02 / 0.99 / +2.6%
duckdb / parquet / ns (0.987x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 244235039 / 247938269 / -1.5% 244492102 / 246093744 / -0.7% 1.00 / 1.01 / -0.8%
statpopgen_q01/duckdb:parquet 301576110 / 302814608 / -0.4% 301495958 / 304073281 / -0.8% 1.00 / 1.00 / +0.4%
statpopgen_q02/duckdb:parquet 565071250 / 545338192 / +3.6% 581035861 / 549487489 / +5.7% 0.97 / 0.99 / -2.0%
statpopgen_q03/duckdb:parquet 838174770 / 909091142 / -7.8% 815796993 / 901802608 / -9.5% 1.03 / 1.01 / +1.9%
statpopgen_q04/duckdb:parquet 828594582 / 835201741 / -0.8% 852613418 / 846343553 / +0.7% 0.97 / 0.99 / -1.5%
statpopgen_q05/duckdb:parquet 578751384 / 588724980 / -1.7% 584611875 / 585976115 / -0.2% 0.99 / 1.00 / -1.5%
statpopgen_q06/duckdb:parquet 707644331 / 740309656 / -4.4% 717859475 / 760817546 / -5.6% 0.99 / 0.97 / +1.3%
statpopgen_q07/duckdb:parquet 610762474 / 616997523 / -1.0% 705803822 / 678244360 / +4.1% 0.87 / 0.91 / -4.9%
statpopgen_q08/duckdb:parquet 615113546 / 618569918 / -0.6% 682264257 / 733344502 / -7.0% 0.90 / 0.84 / +6.9%
statpopgen_q09/duckdb:parquet 807323545 / 846778102 / -4.7% 819250055 / 858434593 / -4.6% 0.99 / 0.99 / -0.1%
statpopgen_q10/duckdb:parquet 1421122656 / 1344363050 / +5.7% 1241669230 / 1260271179 / -1.5% 1.14 / 1.07 / +7.3%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.6%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (-6.1%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.075x ➖
Parquet (geomean): hot 1.028x ➖ · cold 1.090x ➖
Shifts: Parquet (control) +2.8% · Median polish +1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 179753396 / 170705958 / +5.3% 583332911 / 500318457 / +16.6% 🔴 0.31 / 0.34 / -9.7%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11066902 / 10698938 / +3.4% 52606048 / 46159368 / +14.0% 🔴 0.21 / 0.23 / -9.2%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11630258 / 11956526 / -2.7% 53177870 / 46246509 / +15.0% 🔴 0.22 / 0.26 / -15.4%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23635185 / 23744908 / -0.5% 74332581 / 65318765 / +13.8% 🔴 0.32 / 0.36 / -12.5%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18639520 / 17869719 / +4.3% 64763316 / 57924339 / +11.8% 🔴 0.29 / 0.31 / -6.7%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17818018 / 17199802 / +3.6% 64536451 / 58993621 / +9.4% 0.28 / 0.29 / -5.3%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40429112 / 41848090 / -3.4% 95736699 / 86852154 / +10.2% 🔴 0.42 / 0.48 / -12.4%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12066494 / 12152068 / -0.7% 48992952 / 42518511 / +15.2% 🔴 0.25 / 0.29 / -13.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12365914 / 11795880 / +4.8% 47488816 / 42587835 / +11.5% 🔴 0.26 / 0.28 / -6.0%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10233728 / 9988864 / +2.5% 37827643 / 34469470 / +9.7% 0.27 / 0.29 / -6.6%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 764373214 / 758448607 / +0.8% 974625041 / 962131766 / +1.3% 0.78 / 0.79 / -0.5%
clickbench-sorted_q24/datafusion:parquet 8957128 / 9228234 / -2.9% 74229776 / 69496640 / +6.8% 0.12 / 0.13 / -9.1%
clickbench-sorted_q26/datafusion:parquet 9929724 / 9393894 / +5.7% 74400766 / 68603626 / +8.5% 0.13 / 0.14 / -2.5%
clickbench-sorted_q36/datafusion:parquet 94499170 / 93713116 / +0.8% 173944709 / 164067324 / +6.0% 0.54 / 0.57 / -4.9%
clickbench-sorted_q37/datafusion:parquet 65007771 / 64620969 / +0.6% 134919896 / 130347702 / +3.5% 0.48 / 0.50 / -2.8%
clickbench-sorted_q38/datafusion:parquet 87799195 / 87604792 / +0.2% 169114132 / 157806831 / +7.2% 0.52 / 0.56 / -6.5%
clickbench-sorted_q39/datafusion:parquet 160132002 / 160211970 / -0.0% 242018275 / 230860257 / +4.8% 0.66 / 0.69 / -4.7%
clickbench-sorted_q40/datafusion:parquet 44993944 / 44374940 / +1.4% 118901774 / 110762122 / +7.3% 0.38 / 0.40 / -5.5%
clickbench-sorted_q41/datafusion:parquet 42646687 / 42635525 / +0.0% 115655933 / 107668126 / +7.4% 0.37 / 0.40 / -6.9%
clickbench-sorted_q42/datafusion:parquet 26162070 / 26225979 / -0.2% 88474052 / 86996281 / +1.7% 0.30 / 0.30 / -1.9%
duckdb / vortex-file-compressed / ns (0.987x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 56599309 / 54887532 / +3.1% 81499565 / 88691967 / -8.1% 0.69 / 0.62 / +12.2%
clickbench-sorted_q24/duckdb:vortex-file-compressed 20800194 / 22401503 / -7.1% 36072067 / 32463142 / +11.1% 🔴 0.58 / 0.69 / -16.4%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14930925 / 17131842 / -12.8% 🟢 27349737 / 32670312 / -16.3% 🟢 0.55 / 0.52 / +4.1%
clickbench-sorted_q36/duckdb:vortex-file-compressed 30667298 / 28810568 / +6.4% 63529387 / 61930510 / +2.6% 0.48 / 0.47 / +3.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23956856 / 22648752 / +5.8% 58714215 / 51627865 / +13.7% 🔴 0.41 / 0.44 / -7.0%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25484956 / 27064118 / -5.8% 62570899 / 58885471 / +6.3% 0.41 / 0.46 / -11.4%
clickbench-sorted_q39/duckdb:vortex-file-compressed 49562860 / 47931082 / +3.4% 102710473 / 95645455 / +7.4% 0.48 / 0.50 / -3.7%
clickbench-sorted_q40/duckdb:vortex-file-compressed 16401234 / 15451819 / +6.1% 40962003 / 38271458 / +7.0% 0.40 / 0.40 / -0.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15662214 / 16211449 / -3.4% 41093603 / 38291064 / +7.3% 0.38 / 0.42 / -10.0%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12827862 / 13692634 / -6.3% 30995336 / 31506147 / -1.6% 0.41 / 0.43 / -4.8%
duckdb / parquet / ns (1.051x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 127215248 / 123431866 / +3.1% 150000215 / 137982358 / +8.7% 0.85 / 0.89 / -5.2%
clickbench-sorted_q24/duckdb:parquet 18317270 / 17479294 / +4.8% 29039008 / 26764364 / +8.5% 0.63 / 0.65 / -3.4%
clickbench-sorted_q26/duckdb:parquet 13132956 / 12429690 / +5.7% 25298565 / 21124546 / +19.8% 🔴 0.52 / 0.59 / -11.8%
clickbench-sorted_q36/duckdb:parquet 50523664 / 42983643 / +17.5% 🔴 66638000 / 59438521 / +12.1% 🔴 0.76 / 0.72 / +4.8%
clickbench-sorted_q37/duckdb:parquet 31290156 / 30227288 / +3.5% 53299124 / 47431401 / +12.4% 🔴 0.59 / 0.64 / -7.9%
clickbench-sorted_q38/duckdb:parquet 38624479 / 38762726 / -0.4% 59802096 / 54752042 / +9.2% 0.65 / 0.71 / -8.8%
clickbench-sorted_q39/duckdb:parquet 75964882 / 70656012 / +7.5% 88208637 / 101617877 / -13.2% 🟢 0.86 / 0.70 / +23.9%
clickbench-sorted_q40/duckdb:parquet 18676282 / 17673619 / +5.7% 47418210 / 35559605 / +33.3% 🔴 0.39 / 0.50 / -20.8%
clickbench-sorted_q41/duckdb:parquet 16880981 / 17226312 / -2.0% 45616119 / 35139504 / +29.8% 🔴 0.37 / 0.49 / -24.5%
clickbench-sorted_q42/duckdb:parquet 11440140 / 10711364 / +6.8% 25999036 / 22904352 / +13.5% 🔴 0.44 / 0.47 / -5.9%

File Size Changes (100 files changed, -0.1% overall, 45↑ 55↓)
File Scale Format Base HEAD Change %
hits_074.vortex 1.0 vortex-file-compressed 199.16 MB 200.41 MB +1.25 MB +0.6%
hits_054.vortex 1.0 vortex-file-compressed 147.28 MB 148.18 MB +929.40 KB +0.6%
hits_040.vortex 1.0 vortex-file-compressed 144.10 MB 144.98 MB +891.91 KB +0.6%
hits_045.vortex 1.0 vortex-file-compressed 139.13 MB 139.92 MB +810.71 KB +0.6%
hits_081.vortex 1.0 vortex-file-compressed 200.02 MB 201.07 MB +1.05 MB +0.5%
hits_082.vortex 1.0 vortex-file-compressed 139.21 MB 139.92 MB +718.89 KB +0.5%
hits_073.vortex 1.0 vortex-file-compressed 172.95 MB 173.31 MB +367.52 KB +0.2%
hits_010.vortex 1.0 vortex-file-compressed 168.80 MB 169.12 MB +324.33 KB +0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.38 MB 190.73 MB +356.55 KB +0.2%
hits_057.vortex 1.0 vortex-file-compressed 159.78 MB 160.05 MB +282.27 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 179.65 MB 179.95 MB +306.45 KB +0.2%
hits_097.vortex 1.0 vortex-file-compressed 192.64 MB 192.90 MB +260.64 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.31 MB 130.48 MB +175.40 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.06 MB 152.24 MB +185.80 KB +0.1%
hits_071.vortex 1.0 vortex-file-compressed 139.59 MB 139.76 MB +167.81 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.19 MB 156.34 MB +154.48 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.63 MB 100.72 MB +91.73 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.55 MB 130.67 MB +117.41 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 200.60 MB 200.75 MB +154.72 KB +0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.43 MB 136.52 MB +94.23 KB +0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.73 MB 192.85 MB +130.91 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.99 MB 127.07 MB +84.85 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.77 MB 161.87 MB +105.81 KB +0.1%
hits_053.vortex 1.0 vortex-file-compressed 189.42 MB 189.54 MB +122.66 KB +0.1%
hits_062.vortex 1.0 vortex-file-compressed 171.35 MB 171.45 MB +104.36 KB +0.1%
hits_007.vortex 1.0 vortex-file-compressed 201.13 MB 201.25 MB +122.16 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.86 MB 172.95 MB +96.03 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.80 MB 142.88 MB +78.76 KB +0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.33 MB 160.41 MB +86.68 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 134.97 MB 135.03 MB +68.10 KB +0.0%
hits_020.vortex 1.0 vortex-file-compressed 159.93 MB 160.00 MB +76.15 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.61 MB 200.70 MB +94.18 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.14 MB 102.19 MB +46.57 KB +0.0%
hits_055.vortex 1.0 vortex-file-compressed 200.75 MB 200.84 MB +88.76 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.64 MB 161.71 MB +68.18 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.06 MB 101.10 MB +41.33 KB +0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.14 MB 167.20 MB +61.65 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.59 MB 126.63 MB +41.12 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.49 MB 161.54 MB +48.56 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.69 MB 126.72 MB +35.93 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.76 MB 171.80 MB +45.29 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.51 MB 189.53 MB +20.33 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 200.07 MB 200.08 MB +10.52 KB +0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.48 MB 172.48 MB +3.40 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.15 MB 189.15 MB +1.84 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.42 MB 154.41 MB 4.44 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.36 MB 130.35 MB 4.55 KB -0.0%
hits_059.vortex 1.0 vortex-file-compressed 200.12 MB 200.11 MB 10.37 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 172.01 MB 172.00 MB 10.63 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 140.01 MB 140.00 MB 9.48 KB -0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.50 MB 180.48 MB 12.84 KB -0.0%
hits_033.vortex 1.0 vortex-file-compressed 200.95 MB 200.93 MB 15.73 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.68 MB 181.66 MB 22.88 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.39 MB 161.37 MB 21.62 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.88 MB 161.84 MB 38.75 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.74 MB 153.70 MB 37.52 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.81 MB 130.77 MB 32.47 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.26 MB 202.21 MB 56.55 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.98 MB 172.93 MB 52.00 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.20 MB 130.16 MB 43.22 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.33 MB 130.28 MB 51.50 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.12 MB 191.04 MB 75.68 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.88 MB 101.84 MB 46.88 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.87 MB 194.76 MB 110.20 KB -0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.98 MB 172.88 MB 101.02 KB -0.1%
hits_048.vortex 1.0 vortex-file-compressed 200.58 MB 200.46 MB 119.66 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.41 MB 139.32 MB 93.72 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.78 MB 137.69 MB 93.31 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.72 MB 130.63 MB 89.38 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 200.51 MB 200.36 MB 144.48 KB -0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.74 MB 153.62 MB 117.86 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 153.86 MB 153.74 MB 121.20 KB -0.1%
hits_017.vortex 1.0 vortex-file-compressed 147.36 MB 147.23 MB 132.01 KB -0.1%
hits_037.vortex 1.0 vortex-file-compressed 178.13 MB 177.96 MB 172.84 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.18 MB 154.01 MB 172.88 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.10 MB 130.95 MB 150.99 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.24 MB 131.08 MB 159.32 KB -0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.84 MB 130.65 MB 197.66 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.27 MB 200.97 MB 312.16 KB -0.2%
hits_085.vortex 1.0 vortex-file-compressed 201.05 MB 200.70 MB 358.62 KB -0.2%
hits_000.vortex 1.0 vortex-file-compressed 130.96 MB 130.72 MB 242.98 KB -0.2%
hits_094.vortex 1.0 vortex-file-compressed 158.50 MB 158.21 MB 299.14 KB -0.2%
hits_093.vortex 1.0 vortex-file-compressed 130.97 MB 130.70 MB 278.17 KB -0.2%
hits_087.vortex 1.0 vortex-file-compressed 161.90 MB 161.52 MB 385.44 KB -0.2%
hits_031.vortex 1.0 vortex-file-compressed 159.55 MB 159.09 MB 465.70 KB -0.3%
hits_091.vortex 1.0 vortex-file-compressed 148.15 MB 147.51 MB 651.74 KB -0.4%
hits_025.vortex 1.0 vortex-file-compressed 173.00 MB 172.25 MB 772.27 KB -0.4%
hits_084.vortex 1.0 vortex-file-compressed 154.55 MB 153.85 MB 710.78 KB -0.4%
hits_011.vortex 1.0 vortex-file-compressed 200.09 MB 198.87 MB 1.22 MB -0.6%
hits_029.vortex 1.0 vortex-file-compressed 200.81 MB 199.59 MB 1.23 MB -0.6%
hits_038.vortex 1.0 vortex-file-compressed 191.17 MB 189.54 MB 1.63 MB -0.9%
hits_070.vortex 1.0 vortex-file-compressed 200.89 MB 199.09 MB 1.80 MB -0.9%
hits_066.vortex 1.0 vortex-file-compressed 164.76 MB 163.26 MB 1.50 MB -0.9%
hits_064.vortex 1.0 vortex-file-compressed 192.46 MB 190.59 MB 1.87 MB -1.0%
hits_076.vortex 1.0 vortex-file-compressed 161.69 MB 159.97 MB 1.72 MB -1.1%
hits_086.vortex 1.0 vortex-file-compressed 193.78 MB 191.70 MB 2.07 MB -1.1%
hits_090.vortex 1.0 vortex-file-compressed 194.46 MB 192.26 MB 2.20 MB -1.1%
hits_024.vortex 1.0 vortex-file-compressed 161.02 MB 159.17 MB 1.85 MB -1.2%
hits_050.vortex 1.0 vortex-file-compressed 161.57 MB 159.49 MB 2.08 MB -1.3%
hits_001.vortex 1.0 vortex-file-compressed 193.03 MB 188.70 MB 4.33 MB -2.2%

Totals:

  • vortex-file-compressed: 15.97 GB → 15.95 GB (-0.1%)

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.4%
Engines: DataFusion No clear signal (+13.6%, environment too noisy confidence) · DuckDB No clear signal (+3.5%, environment too noisy confidence)
Vortex (geomean): hot 0.975x ➖ · cold 0.924x ➖
Parquet (geomean): hot 0.899x ➖ · cold 0.900x ➖
Shifts: Parquet (control) -10.1% · Median polish -7.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.052x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 236218373 / 243999685 / -3.2% 702570165 / 1020571307 / -31.2% 🟢 0.34 / 0.24 / +40.6%
tpch_q02/datafusion:vortex-file-compressed 353014511 / 337712678 / +4.5% 701709172 / 706825529 / -0.7% 0.50 / 0.48 / +5.3%
tpch_q03/datafusion:vortex-file-compressed 354117801 / 356790864 / -0.7% 901865056 / 974945294 / -7.5% 0.39 / 0.37 / +7.3%
tpch_q04/datafusion:vortex-file-compressed 217301109 / 217975217 / -0.3% 440651963 / 409223871 / +7.7% 0.49 / 0.53 / -7.4%
tpch_q05/datafusion:vortex-file-compressed 404066293 / 438083634 / -7.8% 653339955 / 805509924 / -18.9% 0.62 / 0.54 / +13.7%
tpch_q06/datafusion:vortex-file-compressed 261745544 / 277784149 / -5.8% 370522204 / 494934854 / -25.1% 0.71 / 0.56 / +25.9%
tpch_q07/datafusion:vortex-file-compressed 392641484 / 385688525 / +1.8% 545882397 / 586445529 / -6.9% 0.72 / 0.66 / +9.4%
tpch_q08/datafusion:vortex-file-compressed 668255551 / 436605528 / +53.1% 🔴 648466229 / 604937662 / +7.2% 1.03 / 0.72 / +42.8%
tpch_q09/datafusion:vortex-file-compressed 502580037 / 420644977 / +19.5% 793870757 / 514220958 / +54.4% 🔴 0.63 / 0.82 / -22.6%
tpch_q10/datafusion:vortex-file-compressed 409744667 / 349043582 / +17.4% 665996807 / 586884533 / +13.5% 0.62 / 0.59 / +3.4%
tpch_q11/datafusion:vortex-file-compressed 285013862 / 274057924 / +4.0% 400256462 / 437488050 / -8.5% 0.71 / 0.63 / +13.7%
tpch_q12/datafusion:vortex-file-compressed 490616321 / 406745555 / +20.6% 725569628 / 785205317 / -7.6% 0.68 / 0.52 / +30.5%
tpch_q13/datafusion:vortex-file-compressed 153220078 / 144916244 / +5.7% 303005835 / 357539978 / -15.3% 0.51 / 0.41 / +24.8%
tpch_q14/datafusion:vortex-file-compressed 184374374 / 184183952 / +0.1% 297034722 / 393250355 / -24.5% 0.62 / 0.47 / +32.5%
tpch_q15/datafusion:vortex-file-compressed 346311949 / 313018028 / +10.6% 461777499 / 497011545 / -7.1% 0.75 / 0.63 / +19.1%
tpch_q16/datafusion:vortex-file-compressed 157491693 / 160592040 / -1.9% 290463231 / 290900197 / -0.2% 0.54 / 0.55 / -1.8%
tpch_q17/datafusion:vortex-file-compressed 303241003 / 341770833 / -11.3% 485029469 / 695315555 / -30.2% 🟢 0.63 / 0.49 / +27.2%
tpch_q18/datafusion:vortex-file-compressed 293622785 / 241056012 / +21.8% 446364948 / 429364863 / +4.0% 0.66 / 0.56 / +17.2%
tpch_q19/datafusion:vortex-file-compressed 356418793 / 371322084 / -4.0% 495502131 / 473582391 / +4.6% 0.72 / 0.78 / -8.3%
tpch_q20/datafusion:vortex-file-compressed 282358971 / 287412738 / -1.8% 429443265 / 424570232 / +1.1% 0.66 / 0.68 / -2.9%
tpch_q21/datafusion:vortex-file-compressed 564463317 / 489523116 / +15.3% 1113984611 / 654930258 / +70.1% 🔴 0.51 / 0.75 / -32.2%
tpch_q22/datafusion:vortex-file-compressed 178037238 / 189151691 / -5.9% 386567549 / 370852212 / +4.2% 0.46 / 0.51 / -9.7%
datafusion / parquet / ns (0.926x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 162472799 / 160936213 / +1.0% 542020060 / 469192114 / +15.5% 0.30 / 0.34 / -12.6%
tpch_q02/datafusion:parquet 251235187 / 282749684 / -11.1% 462057040 / 497253820 / -7.1% 0.54 / 0.57 / -4.4%
tpch_q03/datafusion:parquet 298260368 / 305201216 / -2.3% 713063049 / 803995139 / -11.3% 0.42 / 0.38 / +10.2%
tpch_q04/datafusion:parquet 148152256 / 181749731 / -18.5% 378925116 / 364978927 / +3.8% 0.39 / 0.50 / -21.5%
tpch_q05/datafusion:parquet 401425097 / 407368987 / -1.5% 438463523 / 582259747 / -24.7% 0.92 / 0.70 / +30.9%
tpch_q06/datafusion:parquet 151881641 / 121356964 / +25.2% 255334392 / 255224439 / +0.0% 0.59 / 0.48 / +25.1%
tpch_q07/datafusion:parquet 369361735 / 410115417 / -9.9% 927877831 / 745013789 / +24.5% 0.40 / 0.55 / -27.7%
tpch_q08/datafusion:parquet 425973030 / 508082115 / -16.2% 525979966 / 703992695 / -25.3% 0.81 / 0.72 / +12.2%
tpch_q09/datafusion:parquet 369045834 / 431858404 / -14.5% 542555911 / 568166616 / -4.5% 0.68 / 0.76 / -10.5%
tpch_q10/datafusion:parquet 308709314 / 391524896 / -21.2% 441083254 / 561016783 / -21.4% 0.70 / 0.70 / +0.3%
tpch_q11/datafusion:parquet 262259075 / 252539423 / +3.8% 398570929 / 451379621 / -11.7% 0.66 / 0.56 / +17.6%
tpch_q12/datafusion:parquet 202647333 / 212523153 / -4.6% 390519054 / 474820701 / -17.8% 0.52 / 0.45 / +15.9%
tpch_q13/datafusion:parquet 359900079 / 369825926 / -2.7% 462569823 / 617899317 / -25.1% 0.78 / 0.60 / +30.0%
tpch_q14/datafusion:parquet 160783889 / 180470318 / -10.9% 267567470 / 287850282 / -7.0% 0.60 / 0.63 / -4.2%
tpch_q15/datafusion:parquet 294383045 / 353919129 / -16.8% 479163766 / 496763171 / -3.5% 0.61 / 0.71 / -13.8%
tpch_q16/datafusion:parquet 111047902 / 120824503 / -8.1% 289352799 / 294235457 / -1.7% 0.38 / 0.41 / -6.5%
tpch_q17/datafusion:parquet 270359072 / 285743458 / -5.4% 438701298 / 399092643 / +9.9% 0.62 / 0.72 / -13.9%
tpch_q18/datafusion:parquet 420280224 / 558946014 / -24.8% 649502171 / 574263732 / +13.1% 0.65 / 0.97 / -33.5%
tpch_q19/datafusion:parquet 176094469 / 160685075 / +9.6% 297724124 / 303713377 / -2.0% 0.59 / 0.53 / +11.8%
tpch_q20/datafusion:parquet 231868330 / 250380316 / -7.4% 368828149 / 399735546 / -7.7% 0.63 / 0.63 / +0.4%
tpch_q21/datafusion:parquet 308809219 / 330991342 / -6.7% 424392972 / 422794531 / +0.4% 0.73 / 0.78 / -7.1%
tpch_q22/datafusion:parquet 157845785 / 171433850 / -7.9% 330285654 / 334174122 / -1.2% 0.48 / 0.51 / -6.8%
duckdb / vortex-file-compressed / ns (0.904x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 213111436 / 206167620 / +3.4% 245788261 / 422041588 / -41.8% 🟢 0.87 / 0.49 / +77.5%
tpch_q02/duckdb:vortex-file-compressed 381049917 / 460364668 / -17.2% 404357224 / 882880727 / -54.2% 🟢 0.94 / 0.52 / +80.7%
tpch_q03/duckdb:vortex-file-compressed 464605798 / 469319447 / -1.0% 530909824 / 522680403 / +1.6% 0.88 / 0.90 / -2.5%
tpch_q04/duckdb:vortex-file-compressed 275457254 / 315670666 / -12.7% 304375625 / 459648049 / -33.8% 🟢 0.90 / 0.69 / +31.8%
tpch_q05/duckdb:vortex-file-compressed 442330575 / 472418006 / -6.4% 563786637 / 491503929 / +14.7% 0.78 / 0.96 / -18.4%
tpch_q06/duckdb:vortex-file-compressed 261296914 / 349781479 / -25.3% 252214699 / 297114644 / -15.1% 1.04 / 1.18 / -12.0%
tpch_q07/duckdb:vortex-file-compressed 468695666 / 483009875 / -3.0% 526776319 / 512599671 / +2.8% 0.89 / 0.94 / -5.6%
tpch_q08/duckdb:vortex-file-compressed 696601675 / 756788819 / -8.0% 782087795 / 694990183 / +12.5% 0.89 / 1.09 / -18.2%
tpch_q09/duckdb:vortex-file-compressed 498708225 / 490492531 / +1.7% 591187061 / 572592917 / +3.2% 0.84 / 0.86 / -1.5%
tpch_q10/duckdb:vortex-file-compressed 515042412 / 507717005 / +1.4% 551729615 / 594173547 / -7.1% 0.93 / 0.85 / +9.2%
tpch_q11/duckdb:vortex-file-compressed 189953400 / 190642012 / -0.4% 230529189 / 234207477 / -1.6% 0.82 / 0.81 / +1.2%
tpch_q12/duckdb:vortex-file-compressed 525729058 / 612440610 / -14.2% 506511006 / 618227692 / -18.1% 1.04 / 0.99 / +4.8%
tpch_q13/duckdb:vortex-file-compressed 353375395 / 466185709 / -24.2% 503366943 / 309682555 / +62.5% 🔴 0.70 / 1.51 / -53.4%
tpch_q14/duckdb:vortex-file-compressed 232112352 / 284884754 / -18.5% 281543580 / 294447190 / -4.4% 0.82 / 0.97 / -14.8%
tpch_q15/duckdb:vortex-file-compressed 142997210 / 155387644 / -8.0% 213290202 / 270095818 / -21.0% 0.67 / 0.58 / +16.5%
tpch_q16/duckdb:vortex-file-compressed 166129614 / 174588463 / -4.8% 177683194 / 194667087 / -8.7% 0.93 / 0.90 / +4.3%
tpch_q17/duckdb:vortex-file-compressed 408059046 / 476023428 / -14.3% 413454760 / 489644016 / -15.6% 0.99 / 0.97 / +1.5%
tpch_q18/duckdb:vortex-file-compressed 321315450 / 379538363 / -15.3% 324986660 / 344651786 / -5.7% 0.99 / 1.10 / -10.2%
tpch_q19/duckdb:vortex-file-compressed 311822904 / 333729846 / -6.6% 377069249 / 434910107 / -13.3% 0.83 / 0.77 / +7.8%
tpch_q20/duckdb:vortex-file-compressed 359498225 / 426598815 / -15.7% 394394783 / 522734345 / -24.6% 0.91 / 0.82 / +11.7%
tpch_q21/duckdb:vortex-file-compressed 612646970 / 653937897 / -6.3% 649284601 / 824976190 / -21.3% 0.94 / 0.79 / +19.0%
tpch_q22/duckdb:vortex-file-compressed 180789127 / 198601545 / -9.0% 188741523 / 216055045 / -12.6% 0.96 / 0.92 / +4.2%
duckdb / parquet / ns (0.873x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 282856825 / 354745319 / -20.3% 282478179 / 391450096 / -27.8% 1.00 / 0.91 / +10.5%
tpch_q02/duckdb:parquet 647790589 / 627719201 / +3.2% 625915667 / 664721002 / -5.8% 1.03 / 0.94 / +9.6%
tpch_q03/duckdb:parquet 680897517 / 891299574 / -23.6% 686986415 / 1003745001 / -31.6% 🟢 0.99 / 0.89 / +11.6%
tpch_q04/duckdb:parquet 475632459 / 553548753 / -14.1% 526570641 / 559845132 / -5.9% 0.90 / 0.99 / -8.6%
tpch_q05/duckdb:parquet 943321214 / 1017781824 / -7.3% 1041785674 / 1039759673 / +0.2% 0.91 / 0.98 / -7.5%
tpch_q06/duckdb:parquet 281829593 / 313769019 / -10.2% 273320102 / 393053063 / -30.5% 🟢 1.03 / 0.80 / +29.2%
tpch_q07/duckdb:parquet 894942810 / 898972975 / -0.4% 905840702 / 914657943 / -1.0% 0.99 / 0.98 / +0.5%
tpch_q08/duckdb:parquet 997461664 / 1211708837 / -17.7% 1109228528 / 1166260138 / -4.9% 0.90 / 1.04 / -13.4%
tpch_q09/duckdb:parquet 917260723 / 1065160585 / -13.9% 1049560771 / 1040293304 / +0.9% 0.87 / 1.02 / -14.6%
tpch_q10/duckdb:parquet 860751859 / 1028604846 / -16.3% 760338957 / 1038405457 / -26.8% 1.13 / 0.99 / +14.3%
tpch_q11/duckdb:parquet 392124538 / 461099352 / -15.0% 346847367 / 493435216 / -29.7% 1.13 / 0.93 / +21.0%
tpch_q12/duckdb:parquet 520129623 / 566768608 / -8.2% 557106927 / 626538822 / -11.1% 0.93 / 0.90 / +3.2%
tpch_q13/duckdb:parquet 689280185 / 765118330 / -9.9% 704068803 / 1024699702 / -31.3% 🟢 0.98 / 0.75 / +31.1%
tpch_q14/duckdb:parquet 495933894 / 566808523 / -12.5% 436585724 / 715857647 / -39.0% 🟢 1.14 / 0.79 / +43.5%
tpch_q15/duckdb:parquet 402044838 / 441954177 / -9.0% 616242673 / 448492156 / +37.4% 🔴 0.65 / 0.99 / -33.8%
tpch_q16/duckdb:parquet 477556295 / 477784736 / -0.0% 466067074 / 487601417 / -4.4% 1.02 / 0.98 / +4.6%
tpch_q17/duckdb:parquet 450764867 / 534286960 / -15.6% 418129375 / 516648670 / -19.1% 1.08 / 1.03 / +4.2%
tpch_q18/duckdb:parquet 576861984 / 661018381 / -12.7% 632928905 / 644072628 / -1.7% 0.91 / 1.03 / -11.2%
tpch_q19/duckdb:parquet 557045585 / 606824578 / -8.2% 546651608 / 612656421 / -10.8% 1.02 / 0.99 / +2.9%
tpch_q20/duckdb:parquet 753216107 / 972365063 / -22.5% 968927041 / 873096314 / +11.0% 0.78 / 1.11 / -30.2%
tpch_q21/duckdb:parquet 656854990 / 873013232 / -24.8% 701676616 / 827451370 / -15.2% 0.94 / 1.06 / -11.3%
tpch_q22/duckdb:parquet 411206216 / 473724715 / -13.2% 368334140 / 506556922 / -27.3% 1.12 / 0.94 / +19.4%

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 85049199 vs base 900c1f29
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+2.4%, environment too noisy confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.990x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1254212 / 1244244 / +0.8% 20879568 / 19586918 / +6.6% 0.06 / 0.06 / -5.4%
clickbench_q01/datafusion:vortex-file-compressed 6098116 / 5968114 / +2.2% 33581231 / 34237009 / -1.9% 0.18 / 0.17 / +4.2%
clickbench_q02/datafusion:vortex-file-compressed 10708296 / 9960774 / +7.5% 38916047 / 39686093 / -1.9% 0.28 / 0.25 / +9.6%
clickbench_q03/datafusion:vortex-file-compressed 11349966 / 11835168 / -4.1% 51246924 / 50845254 / +0.8% 0.22 / 0.23 / -4.9%
clickbench_q04/datafusion:vortex-file-compressed 56137226 / 56509300 / -0.7% 91996534 / 93577923 / -1.7% 0.61 / 0.60 / +1.0%
clickbench_q05/datafusion:vortex-file-compressed 74357167 / 74042456 / +0.4% 116105809 / 116927823 / -0.7% 0.64 / 0.63 / +1.1%
clickbench_q06/datafusion:vortex-file-compressed 1247966 / 1262374 / -1.1% 20208784 / 20394303 / -0.9% 0.06 / 0.06 / -0.2%
clickbench_q07/datafusion:vortex-file-compressed 9783497 / 9655184 / +1.3% 32730173 / 35360162 / -7.4% 0.30 / 0.27 / +9.5%
clickbench_q08/datafusion:vortex-file-compressed 77928910 / 75539326 / +3.2% 113103841 / 116282392 / -2.7% 0.69 / 0.65 / +6.1%
clickbench_q09/datafusion:vortex-file-compressed 171163002 / 169955491 / +0.7% 205895681 / 209136433 / -1.5% 0.83 / 0.81 / +2.3%
clickbench_q10/datafusion:vortex-file-compressed 23945162 / 23690710 / +1.1% 63942784 / 67182807 / -4.8% 0.37 / 0.35 / +6.2%
clickbench_q11/datafusion:vortex-file-compressed 25939448 / 26663664 / -2.7% 65031563 / 70449395 / -7.7% 0.40 / 0.38 / +5.4%
clickbench_q12/datafusion:vortex-file-compressed 72715532 / 71448538 / +1.8% 115187567 / 112671321 / +2.2% 0.63 / 0.63 / -0.4%
clickbench_q13/datafusion:vortex-file-compressed 118540254 / 116553714 / +1.7% 177702232 / 179454859 / -1.0% 0.67 / 0.65 / +2.7%
clickbench_q14/datafusion:vortex-file-compressed 74208673 / 75067926 / -1.1% 119087827 / 116084771 / +2.6% 0.62 / 0.65 / -3.6%
clickbench_q15/datafusion:vortex-file-compressed 62110074 / 62036206 / +0.1% 94101477 / 91767218 / +2.5% 0.66 / 0.68 / -2.4%
clickbench_q16/datafusion:vortex-file-compressed 150434102 / 147836332 / +1.8% 200530307 / 205593671 / -2.5% 0.75 / 0.72 / +4.3%
clickbench_q17/datafusion:vortex-file-compressed 149961931 / 150590667 / -0.4% 210553100 / 215232850 / -2.2% 0.71 / 0.70 / +1.8%
clickbench_q18/datafusion:vortex-file-compressed 297277295 / 295892848 / +0.5% 362904151 / 366763592 / -1.1% 0.82 / 0.81 / +1.5%
clickbench_q19/datafusion:vortex-file-compressed 7799228 / 7530376 / +3.6% 46708512 / 45194021 / +3.4% 0.17 / 0.17 / +0.2%
clickbench_q20/datafusion:vortex-file-compressed 62813680 / 60934476 / +3.1% 225138460 / 224047467 / +0.5% 0.28 / 0.27 / +2.6%
clickbench_q21/datafusion:vortex-file-compressed 86503078 / 89630793 / -3.5% 273013606 / 266914529 / +2.3% 0.32 / 0.34 / -5.6%
clickbench_q22/datafusion:vortex-file-compressed 103590950 / 103083044 / +0.5% 344647583 / 344025842 / +0.2% 0.30 / 0.30 / +0.3%
clickbench_q23/datafusion:vortex-file-compressed 194348041 / 209765146 / -7.3% 512384654 / 516901554 / -0.9% 0.38 / 0.41 / -6.5%
clickbench_q24/datafusion:vortex-file-compressed 16020362 / 16022912 / -0.0% 60239900 / 66002344 / -8.7% 0.27 / 0.24 / +9.5%
clickbench_q25/datafusion:vortex-file-compressed 18405894 / 18434784 / -0.2% 56359837 / 55445809 / +1.6% 0.33 / 0.33 / -1.8%
clickbench_q26/datafusion:vortex-file-compressed 16222876 / 16465334 / -1.5% 65558336 / 66015366 / -0.7% 0.25 / 0.25 / -0.8%
clickbench_q27/datafusion:vortex-file-compressed 96389406 / 97717621 / -1.4% 243087987 / 243614320 / -0.2% 0.40 / 0.40 / -1.1%
clickbench_q28/datafusion:vortex-file-compressed 566964481 / 573047028 / -1.1% 634795339 / 621786141 / +2.1% 0.89 / 0.92 / -3.1%
clickbench_q29/datafusion:vortex-file-compressed 23294834 / 22934932 / +1.6% 49724637 / 49587626 / +0.3% 0.47 / 0.46 / +1.3%
clickbench_q30/datafusion:vortex-file-compressed 59101162 / 60799767 / -2.8% 103962632 / 104448476 / -0.5% 0.57 / 0.58 / -2.3%
clickbench_q31/datafusion:vortex-file-compressed 71328313 / 68968266 / +3.4% 151041038 / 147899323 / +2.1% 0.47 / 0.47 / +1.3%
clickbench_q32/datafusion:vortex-file-compressed 303762893 / 311379474 / -2.4% 385085610 / 384903799 / +0.0% 0.79 / 0.81 / -2.5%
clickbench_q33/datafusion:vortex-file-compressed 324436512 / 330194596 / -1.7% 425032344 / 428672211 / -0.8% 0.76 / 0.77 / -0.9%
clickbench_q34/datafusion:vortex-file-compressed 331649167 / 331309188 / +0.1% 425677121 / 435758753 / -2.3% 0.78 / 0.76 / +2.5%
clickbench_q35/datafusion:vortex-file-compressed 56353098 / 56104816 / +0.4% 85007798 / 89539895 / -5.1% 0.66 / 0.63 / +5.8%
clickbench_q36/datafusion:vortex-file-compressed 37247034 / 37520810 / -0.7% 64838383 / 64193745 / +1.0% 0.57 / 0.58 / -1.7%
clickbench_q37/datafusion:vortex-file-compressed 21714628 / 21686951 / +0.1% 47055879 / 47703197 / -1.4% 0.46 / 0.45 / +1.5%
clickbench_q38/datafusion:vortex-file-compressed 11759536 / 11683994 / +0.6% 37499926 / 38111707 / -1.6% 0.31 / 0.31 / +2.3%
clickbench_q39/datafusion:vortex-file-compressed 78379590 / 78437156 / -0.1% 109201875 / 108518723 / +0.6% 0.72 / 0.72 / -0.7%
clickbench_q40/datafusion:vortex-file-compressed 11193034 / 11615170 / -3.6% 36386037 / 35505705 / +2.5% 0.31 / 0.33 / -6.0%
clickbench_q41/datafusion:vortex-file-compressed 10519826 / 10666582 / -1.4% 34581249 / 35223855 / -1.8% 0.30 / 0.30 / +0.5%
clickbench_q42/datafusion:vortex-file-compressed 11106586 / 10963699 / +1.3% 35261625 / 34144635 / +3.3% 0.31 / 0.32 / -1.9%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1262495 / 1250306 / +1.0% 49665403 / 46458536 / +6.9% 0.03 / 0.03 / -5.5%
clickbench_q01/datafusion:parquet 16252895 / 15705420 / +3.5% 75521724 / 66007667 / +14.4% 🔴 0.22 / 0.24 / -9.6%
clickbench_q02/datafusion:parquet 19063456 / 19056963 / +0.0% 82864305 / 80219416 / +3.3% 0.23 / 0.24 / -3.2%
clickbench_q03/datafusion:parquet 17848707 / 18394683 / -3.0% 84643601 / 77456776 / +9.3% 0.21 / 0.24 / -11.2%
clickbench_q04/datafusion:parquet 63230159 / 64647709 / -2.2% 128835657 / 126140199 / +2.1% 0.49 / 0.51 / -4.2%
clickbench_q05/datafusion:parquet 89430984 / 88245019 / +1.3% 161988193 / 158196332 / +2.4% 0.55 / 0.56 / -1.0%
clickbench_q06/datafusion:parquet 1314322 / 1303496 / +0.8% 49830991 / 48218703 / +3.3% 0.03 / 0.03 / -2.4%
clickbench_q07/datafusion:parquet 16958988 / 16603589 / +2.1% 69317579 / 67181185 / +3.2% 0.24 / 0.25 / -1.0%
clickbench_q08/datafusion:parquet 87927124 / 85276444 / +3.1% 163099377 / 156493157 / +4.2% 0.54 / 0.54 / -1.1%
clickbench_q09/datafusion:parquet 191760210 / 185867821 / +3.2% 268487669 / 254613997 / +5.4% 0.71 / 0.73 / -2.2%
clickbench_q10/datafusion:parquet 36675244 / 36965765 / -0.8% 101239405 / 98124375 / +3.2% 0.36 / 0.38 / -3.8%
clickbench_q11/datafusion:parquet 42779331 / 43114610 / -0.8% 112030342 / 106793309 / +4.9% 0.38 / 0.40 / -5.4%
clickbench_q12/datafusion:parquet 95550290 / 95950344 / -0.4% 161398761 / 161142227 / +0.2% 0.59 / 0.60 / -0.6%
clickbench_q13/datafusion:parquet 146938864 / 149123190 / -1.5% 222860385 / 224615959 / -0.8% 0.66 / 0.66 / -0.7%
clickbench_q14/datafusion:parquet 101792156 / 101955630 / -0.2% 172702296 / 171572875 / +0.7% 0.59 / 0.59 / -0.8%
clickbench_q15/datafusion:parquet 73626866 / 70310184 / +4.7% 132062109 / 130039951 / +1.6% 0.56 / 0.54 / +3.1%
clickbench_q16/datafusion:parquet 158485201 / 156331242 / +1.4% 236011770 / 233087290 / +1.3% 0.67 / 0.67 / +0.1%
clickbench_q17/datafusion:parquet 157388084 / 155691702 / +1.1% 239985110 / 237045084 / +1.2% 0.66 / 0.66 / -0.1%
clickbench_q18/datafusion:parquet 314171540 / 317564542 / -1.1% 423696447 / 421549165 / +0.5% 0.74 / 0.75 / -1.6%
clickbench_q19/datafusion:parquet 18035877 / 19011367 / -5.1% 70953069 / 74200025 / -4.4% 0.25 / 0.26 / -0.8%
clickbench_q20/datafusion:parquet 178779834 / 179766816 / -0.5% 276975334 / 276311845 / +0.2% 0.65 / 0.65 / -0.8%
clickbench_q21/datafusion:parquet 173170870 / 176482142 / -1.9% 292063781 / 290626386 / +0.5% 0.59 / 0.61 / -2.4%
clickbench_q22/datafusion:parquet 262267528 / 262832626 / -0.2% 416216272 / 413026058 / +0.8% 0.63 / 0.64 / -1.0%
clickbench_q23/datafusion:parquet 1101930679 / 1108105476 / -0.6% 1236066973 / 1236843727 / -0.1% 0.89 / 0.90 / -0.5%
clickbench_q24/datafusion:parquet 30174284 / 29761096 / +1.4% 88121643 / 85885770 / +2.6% 0.34 / 0.35 / -1.2%
clickbench_q25/datafusion:parquet 36923426 / 36517006 / +1.1% 101098581 / 97448597 / +3.7% 0.37 / 0.37 / -2.5%
clickbench_q26/datafusion:parquet 31001097 / 30371925 / +2.1% 88863188 / 85814269 / +3.6% 0.35 / 0.35 / -1.4%
clickbench_q27/datafusion:parquet 193397703 / 193629726 / -0.1% 287996909 / 281569542 / +2.3% 0.67 / 0.69 / -2.3%
clickbench_q28/datafusion:parquet 623027975 / 626541776 / -0.6% 706362383 / 698597560 / +1.1% 0.88 / 0.90 / -1.7%
clickbench_q29/datafusion:parquet 29425142 / 29146232 / +1.0% 93778633 / 91693629 / +2.3% 0.31 / 0.32 / -1.3%
clickbench_q30/datafusion:parquet 89913273 / 91238537 / -1.5% 168504973 / 167987137 / +0.3% 0.53 / 0.54 / -1.8%
clickbench_q31/datafusion:parquet 105700776 / 103902468 / +1.7% 189219846 / 190144484 / -0.5% 0.56 / 0.55 / +2.2%
clickbench_q32/datafusion:parquet 331241012 / 320653361 / +3.3% 430540299 / 426506551 / +0.9% 0.77 / 0.75 / +2.3%
clickbench_q33/datafusion:parquet 381028329 / 382804718 / -0.5% 474531821 / 470970801 / +0.8% 0.80 / 0.81 / -1.2%
clickbench_q34/datafusion:parquet 384396008 / 384120984 / +0.1% 474606019 / 473863239 / +0.2% 0.81 / 0.81 / -0.1%
clickbench_q35/datafusion:parquet 64596482 / 63783980 / +1.3% 124277820 / 121551371 / +2.2% 0.52 / 0.52 / -0.9%
clickbench_q36/datafusion:parquet 73749820 / 73613871 / +0.2% 134985812 / 134934324 / +0.0% 0.55 / 0.55 / +0.1%
clickbench_q37/datafusion:parquet 35346419 / 35582706 / -0.7% 92403032 / 91699412 / +0.8% 0.38 / 0.39 / -1.4%
clickbench_q38/datafusion:parquet 47726406 / 47640956 / +0.2% 106530679 / 106337282 / +0.2% 0.45 / 0.45 / -0.0%
clickbench_q39/datafusion:parquet 143518298 / 143657986 / -0.1% 206542612 / 205688777 / +0.4% 0.69 / 0.70 / -0.5%
clickbench_q40/datafusion:parquet 20085776 / 19992911 / +0.5% 77799584 / 77544649 / +0.3% 0.26 / 0.26 / +0.1%
clickbench_q41/datafusion:parquet 18932783 / 18820666 / +0.6% 76604010 / 75376561 / +1.6% 0.25 / 0.25 / -1.0%
clickbench_q42/datafusion:parquet 19328156 / 19134958 / +1.0% 74693546 / 75374243 / -0.9% 0.26 / 0.25 / +1.9%
duckdb / vortex-file-compressed / ns (1.010x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1602614 / 1554848 / +3.1% 24739125 / 27998045 / -11.6% 🟢 0.06 / 0.06 / +16.6%
clickbench_q01/duckdb:vortex-file-compressed 12147274 / 13525279 / -10.2% 🟢 32053358 / 31515374 / +1.7% 0.38 / 0.43 / -11.7%
clickbench_q02/duckdb:vortex-file-compressed 12964452 / 12930064 / +0.3% 34204475 / 31679735 / +8.0% 0.38 / 0.41 / -7.1%
clickbench_q03/duckdb:vortex-file-compressed 17742438 / 17245332 / +2.9% 46600457 / 46375783 / +0.5% 0.38 / 0.37 / +2.4%
clickbench_q04/duckdb:vortex-file-compressed 67626173 / 70789556 / -4.5% 99720084 / 97710109 / +2.1% 0.68 / 0.72 / -6.4%
clickbench_q05/duckdb:vortex-file-compressed 65633882 / 67072507 / -2.1% 96559208 / 95932707 / +0.7% 0.68 / 0.70 / -2.8%
clickbench_q06/duckdb:vortex-file-compressed 1971347 / 1822226 / +8.2% 27294020 / 32915802 / -17.1% 🟢 0.07 / 0.06 / +30.5%
clickbench_q07/duckdb:vortex-file-compressed 13843885 / 13363690 / +3.6% 31345604 / 31908265 / -1.8% 0.44 / 0.42 / +5.5%
clickbench_q08/duckdb:vortex-file-compressed 83003649 / 82789266 / +0.3% 121381666 / 132385377 / -8.3% 0.68 / 0.63 / +9.3%
clickbench_q09/duckdb:vortex-file-compressed 109849087 / 105897908 / +3.7% 147938336 / 153844738 / -3.8% 0.74 / 0.69 / +7.9%
clickbench_q10/duckdb:vortex-file-compressed 34882632 / 34273954 / +1.8% 65861559 / 66052188 / -0.3% 0.53 / 0.52 / +2.1%
clickbench_q11/duckdb:vortex-file-compressed 34896558 / 35566702 / -1.9% 68044185 / 67776639 / +0.4% 0.51 / 0.52 / -2.3%
clickbench_q12/duckdb:vortex-file-compressed 72158052 / 73546836 / -1.9% 104294865 / 104977716 / -0.7% 0.69 / 0.70 / -1.2%
clickbench_q13/duckdb:vortex-file-compressed 141526515 / 136151138 / +3.9% 171806843 / 172764732 / -0.6% 0.82 / 0.79 / +4.5%
clickbench_q14/duckdb:vortex-file-compressed 76022892 / 77537560 / -2.0% 106112103 / 108297947 / -2.0% 0.72 / 0.72 / +0.1%
clickbench_q15/duckdb:vortex-file-compressed 92692948 / 91038200 / +1.8% 126493708 / 130141137 / -2.8% 0.73 / 0.70 / +4.8%
clickbench_q16/duckdb:vortex-file-compressed 159669464 / 158467194 / +0.8% 224827468 / 208461180 / +7.9% 0.71 / 0.76 / -6.6%
clickbench_q17/duckdb:vortex-file-compressed 164806659 / 163708820 / +0.7% 208852271 / 215135379 / -2.9% 0.79 / 0.76 / +3.7%
clickbench_q18/duckdb:vortex-file-compressed 317739637 / 333022534 / -4.6% 366932418 / 364428077 / +0.7% 0.87 / 0.91 / -5.2%
clickbench_q19/duckdb:vortex-file-compressed 17684181 / 16459952 / +7.4% 38867511 / 40665025 / -4.4% 0.45 / 0.40 / +12.4%
clickbench_q20/duckdb:vortex-file-compressed 115085984 / 110986351 / +3.7% 187476996 / 184804881 / +1.4% 0.61 / 0.60 / +2.2%
clickbench_q21/duckdb:vortex-file-compressed 164644644 / 161139120 / +2.2% 287960431 / 290288318 / -0.8% 0.57 / 0.56 / +3.0%
clickbench_q22/duckdb:vortex-file-compressed 242446782 / 238713238 / +1.6% 427157037 / 433903300 / -1.6% 0.57 / 0.55 / +3.2%
clickbench_q23/duckdb:vortex-file-compressed 57022152 / 57708000 / -1.2% 106712276 / 95954532 / +11.2% 🔴 0.53 / 0.60 / -11.1%
clickbench_q24/duckdb:vortex-file-compressed 25908086 / 25792741 / +0.4% 44324796 / 44991286 / -1.5% 0.58 / 0.57 / +2.0%
clickbench_q25/duckdb:vortex-file-compressed 32440386 / 32838544 / -1.2% 50893779 / 52780417 / -3.6% 0.64 / 0.62 / +2.4%
clickbench_q26/duckdb:vortex-file-compressed 20372422 / 21505847 / -5.3% 34528155 / 34928047 / -1.1% 0.59 / 0.62 / -4.2%
clickbench_q27/duckdb:vortex-file-compressed 147434723 / 145211002 / +1.5% 242799940 / 248356371 / -2.2% 0.61 / 0.58 / +3.9%
clickbench_q28/duckdb:vortex-file-compressed 578577310 / 573402728 / +0.9% 666091655 / 667114548 / -0.2% 0.87 / 0.86 / +1.1%
clickbench_q29/duckdb:vortex-file-compressed 18835748 / 19925334 / -5.5% 36299848 / 38084856 / -4.7% 0.52 / 0.52 / -0.8%
clickbench_q30/duckdb:vortex-file-compressed 66507045 / 67567001 / -1.6% 107102301 / 112784641 / -5.0% 0.62 / 0.60 / +3.7%
clickbench_q31/duckdb:vortex-file-compressed 126646666 / 123890536 / +2.2% 195493345 / 192927182 / +1.3% 0.65 / 0.64 / +0.9%
clickbench_q32/duckdb:vortex-file-compressed 466940324 / 441977100 / +5.6% 485936267 / 486490778 / -0.1% 0.96 / 0.91 / +5.8%
clickbench_q33/duckdb:vortex-file-compressed 390701580 / 397802295 / -1.8% 487909212 / 507309660 / -3.8% 0.80 / 0.78 / +2.1%
clickbench_q34/duckdb:vortex-file-compressed 405320328 / 411895965 / -1.6% 521530537 / 527980344 / -1.2% 0.78 / 0.78 / -0.4%
clickbench_q35/duckdb:vortex-file-compressed 102124978 / 101770606 / +0.3% 138067815 / 139004226 / -0.7% 0.74 / 0.73 / +1.0%
clickbench_q36/duckdb:vortex-file-compressed 15982564 / 15833741 / +0.9% 32798002 / 31741598 / +3.3% 0.49 / 0.50 / -2.3%
clickbench_q37/duckdb:vortex-file-compressed 12056446 / 11472312 / +5.1% 28190192 / 28546578 / -1.2% 0.43 / 0.40 / +6.4%
clickbench_q38/duckdb:vortex-file-compressed 13925604 / 12941248 / +7.6% 28887508 / 29110535 / -0.8% 0.48 / 0.44 / +8.4%
clickbench_q39/duckdb:vortex-file-compressed 23574320 / 22321396 / +5.6% 45499641 / 40999360 / +11.0% 🔴 0.52 / 0.54 / -4.8%
clickbench_q40/duckdb:vortex-file-compressed 11472356 / 10824564 / +6.0% 27508178 / 28225640 / -2.5% 0.42 / 0.38 / +8.7%
clickbench_q41/duckdb:vortex-file-compressed 11568226 / 10884060 / +6.3% 26939324 / 28785555 / -6.4% 0.43 / 0.38 / +13.6%
clickbench_q42/duckdb:vortex-file-compressed 11507715 / 11241266 / +2.4% 28295491 / 30803911 / -8.1% 0.41 / 0.36 / +11.4%
duckdb / parquet / ns (0.986x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 7714246 / 10413316 / -25.9% 🟢 18274202 / 21202573 / -13.8% 🟢 0.42 / 0.49 / -14.0%
clickbench_q01/duckdb:parquet 9869388 / 9595443 / +2.9% 18540433 / 21331976 / -13.1% 🟢 0.53 / 0.45 / +18.3%
clickbench_q02/duckdb:parquet 16637062 / 14668931 / +13.4% 🔴 32205544 / 32359456 / -0.5% 0.52 / 0.45 / +14.0%
clickbench_q03/duckdb:parquet 16308106 / 16260758 / +0.3% 51165825 / 52540832 / -2.6% 0.32 / 0.31 / +3.0%
clickbench_q04/duckdb:parquet 67631500 / 69882938 / -3.2% 88263353 / 97219014 / -9.2% 0.77 / 0.72 / +6.6%
clickbench_q05/duckdb:parquet 77629834 / 79984450 / -2.9% 112297203 / 122941797 / -8.7% 0.69 / 0.65 / +6.3%
clickbench_q06/duckdb:parquet 15219036 / 15468302 / -1.6% 22720601 / 23022578 / -1.3% 0.67 / 0.67 / -0.3%
clickbench_q07/duckdb:parquet 10718968 / 10879532 / -1.5% 25206752 / 23494070 / +7.3% 0.43 / 0.46 / -8.2%
clickbench_q08/duckdb:parquet 84165436 / 83079594 / +1.3% 121517219 / 129433128 / -6.1% 0.69 / 0.64 / +7.9%
clickbench_q09/duckdb:parquet 114338918 / 115076530 / -0.6% 159576902 / 160602610 / -0.6% 0.72 / 0.72 / -0.0%
clickbench_q10/duckdb:parquet 32686494 / 32951918 / -0.8% 67648081 / 68155750 / -0.7% 0.48 / 0.48 / -0.1%
clickbench_q11/duckdb:parquet 36154484 / 37559380 / -3.7% 74362675 / 73270206 / +1.5% 0.49 / 0.51 / -5.2%
clickbench_q12/duckdb:parquet 91877679 / 89772074 / +2.3% 129408313 / 128539745 / +0.7% 0.71 / 0.70 / +1.7%
clickbench_q13/duckdb:parquet 146237766 / 145882357 / +0.2% 206192786 / 211488381 / -2.5% 0.71 / 0.69 / +2.8%
clickbench_q14/duckdb:parquet 95497206 / 96151912 / -0.7% 134761719 / 141772294 / -4.9% 0.71 / 0.68 / +4.5%
clickbench_q15/duckdb:parquet 92218098 / 96656574 / -4.6% 121113883 / 116640292 / +3.8% 0.76 / 0.83 / -8.1%
clickbench_q16/duckdb:parquet 164880818 / 167227755 / -1.4% 245273155 / 222659041 / +10.2% 🔴 0.67 / 0.75 / -10.5%
clickbench_q17/duckdb:parquet 185314010 / 175325142 / +5.7% 226884332 / 228824529 / -0.8% 0.82 / 0.77 / +6.6%
clickbench_q18/duckdb:parquet 321110518 / 324166756 / -0.9% 402769548 / 425260833 / -5.3% 0.80 / 0.76 / +4.6%
clickbench_q19/duckdb:parquet 12466790 / 13975247 / -10.8% 🟢 39057166 / 40372688 / -3.3% 0.32 / 0.35 / -7.8%
clickbench_q20/duckdb:parquet 134648784 / 136663726 / -1.5% 242082023 / 245447869 / -1.4% 0.56 / 0.56 / -0.1%
clickbench_q21/duckdb:parquet 176651278 / 185656680 / -4.9% 317628148 / 327213453 / -2.9% 0.56 / 0.57 / -2.0%
clickbench_q22/duckdb:parquet 249435969 / 246458970 / +1.2% 397306416 / 403538333 / -1.5% 0.63 / 0.61 / +2.8%
clickbench_q23/duckdb:parquet 143997443 / 146407737 / -1.6% 172731581 / 163590499 / +5.6% 0.83 / 0.89 / -6.9%
clickbench_q24/duckdb:parquet 42475927 / 42106473 / +0.9% 64527802 / 60653699 / +6.4% 0.66 / 0.69 / -5.2%
clickbench_q25/duckdb:parquet 40645976 / 41495506 / -2.0% 92443306 / 86348464 / +7.1% 0.44 / 0.48 / -8.5%
clickbench_q26/duckdb:parquet 31229560 / 29569038 / +5.6% 48628262 / 46594967 / +4.4% 0.64 / 0.63 / +1.2%
clickbench_q27/duckdb:parquet 145014290 / 149563137 / -3.0% 253101034 / 255173867 / -0.8% 0.57 / 0.59 / -2.2%
clickbench_q28/duckdb:parquet 901321584 / 904904039 / -0.4% 982510622 / 1007201965 / -2.5% 0.92 / 0.90 / +2.1%
clickbench_q29/duckdb:parquet 16854710 / 17459313 / -3.5% 32511582 / 32383606 / +0.4% 0.52 / 0.54 / -3.8%
clickbench_q30/duckdb:parquet 93584650 / 93566753 / +0.0% 170752547 / 170954587 / -0.1% 0.55 / 0.55 / +0.1%
clickbench_q31/duckdb:parquet 142978272 / 143651854 / -0.5% 289631622 / 289776940 / -0.1% 0.49 / 0.50 / -0.4%
clickbench_q32/duckdb:parquet 459344084 / 465632048 / -1.4% 525694865 / 538569278 / -2.4% 0.87 / 0.86 / +1.1%
clickbench_q33/duckdb:parquet 435774028 / 468097350 / -6.9% 501132409 / 489447618 / +2.4% 0.87 / 0.96 / -9.1%
clickbench_q34/duckdb:parquet 440287820 / 449318855 / -2.0% 477688221 / 472618029 / +1.1% 0.92 / 0.95 / -3.1%
clickbench_q35/duckdb:parquet 101739438 / 100435418 / +1.3% 119245632 / 123299500 / -3.3% 0.85 / 0.81 / +4.7%
clickbench_q36/duckdb:parquet 30816412 / 30946368 / -0.4% 41123436 / 42007765 / -2.1% 0.75 / 0.74 / +1.7%
clickbench_q37/duckdb:parquet 22931239 / 22840462 / +0.4% 32405183 / 32335485 / +0.2% 0.71 / 0.71 / +0.2%
clickbench_q38/duckdb:parquet 23560680 / 24196878 / -2.6% 34526142 / 33547983 / +2.9% 0.68 / 0.72 / -5.4%
clickbench_q39/duckdb:parquet 55860165 / 56419522 / -1.0% 65905366 / 67523763 / -2.4% 0.85 / 0.84 / +1.4%
clickbench_q40/duckdb:parquet 12677456 / 12377972 / +2.4% 23187876 / 22942432 / +1.1% 0.55 / 0.54 / +1.3%
clickbench_q41/duckdb:parquet 12971336 / 12989522 / -0.1% 22251812 / 23112518 / -3.7% 0.58 / 0.56 / +3.7%
clickbench_q42/duckdb:parquet 14159387 / 14449966 / -2.0% 24375756 / 24602788 / -0.9% 0.58 / 0.59 / -1.1%

No file size changes detected.

claude added 2 commits October 2, 2026 15:29
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SzyZPNAEc6NDXftguW3WNQ
Signed-off-by: Claude <noreply@anthropic.com>
@codspeed

codspeed Bot commented Oct 2, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 28.73%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

❌ 7 regressed benchmarks
✅ 2090 untouched benchmarks
⏩ 509 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime decode_bitpacked_chunked_avx512[i64, 524288] 17.8 µs 31.6 µs -43.72%
❌ Simulation scalar_access[(1024, true, false)] 788.2 µs 1,314.1 µs -40.02%
❌ WallTime decode_bitpacked_chunked_avx2[i64, 524288] 20.5 µs 34 µs -39.92%
❌ WallTime decode_bitpacked_chunked_neon[i64, 524288] 27.3 µs 41.3 µs -33.78%
❌ Simulation scalar_access[(1024, false, false)] 728.4 µs 830.5 µs -12.29%
❌ Simulation decompress[alp_for_bp_f64] 77 µs 86.8 µs -11.36%
❌ Simulation decompress[datetime_for_bp] 146.7 µs 164 µs -10.53%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/statpopgen-datafusion (c5f6e7c) with ji/datafusion-lambda-projection (012ae44)2

Open in CodSpeed

Footnotes

  1. 509 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. No successful run was found on ji/datafusion-lambda-projection (5c4b574) during the generation of this report, so 964ad2c was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

claude added 2 commits October 2, 2026 15:37
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SzyZPNAEc6NDXftguW3WNQ
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs
joseph-isaacs marked this pull request as ready for review October 2, 2026 15:41
@joseph-isaacs
joseph-isaacs requested a review from myrrc October 2, 2026 15:41
Base automatically changed from ji/datafusion-lambda-projection to develop October 2, 2026 16:25
@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) October 2, 2026 16:25

@danking danking left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@joseph-isaacs
joseph-isaacs merged commit c07196e into develop Oct 2, 2026
92 of 94 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/statpopgen-datafusion branch October 2, 2026 16:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants