Skip to content

Store SQL benchmark file sizes in the benchmarks database - #11443

Merged
joseph-isaacs merged 2 commits into
developfrom
ji/friendly-noether-hk4glm
Nov 13, 2026
Merged

joseph-isaacs merged 2 commits into
developfrom
ji/friendly-noether-hk4glm

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Summary

The file-size section disappeared from SQL benchmark PR comments in #10987, which moved the baseline from S3 to the benchmarks Postgres. File sizes were never stored there, so compare-benchmark-jsons.py found no baseline rows and dropped the section without a message. This PR stores the sizes on develop runs and reads them back on PR runs.

PR benchmark comments lost their file-size section when the baseline moved
from S3 to the benchmarks Postgres, because file sizes were never ingested.

`capture-file-sizes.py` now also writes `file_size` ingest records, which the
SQL bench job appends to `results.ingest.jsonl`. Develop runs upsert them into
the new `file_sizes` table, and PR runs fetch them back as the baseline, one
lookup per (benchmark, scale factor, format) so files a PR stops writing still
show up. The size-change column now prints the minus sign on shrinking files.

Requires the `file_sizes` table (vortex.dev `db/migrations/014_file_sizes.sql`)
to be applied before this merges: the develop ingest is required and writes
each file in one transaction.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9quRiv5fCx8AhzH9s
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs joseph-isaacs added the changelog/chore A trivial change label Nov 13, 2026 — with Claude
- Choose the baseline commit from the measurements, not the file-size scopes.
  A scope has one row per file per commit, so paging back through it took
  seconds once a PR was a hundred commits behind develop.
- Skip a kind whose table the database does not have yet, so a missing
  `file_sizes` table costs the file sizes and not the whole baseline.
- Stop crashing when the baseline holds only file sizes: the empty benchmark
  frame now keeps the columns the comparison reads.
- Say "No baseline file sizes found" instead of silently dropping the section.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9quRiv5fCx8AhzH9s
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done abc04be fineweb 1 Explore Profiling Data
🟢 Done abc04be clickbench-nvme 1 Explore Profiling Data
🟢 Done abc04be polarsignals 1 Explore Profiling Data
🟢 Done abc04be tpcds-nvme-10 1 Explore Profiling Data
🟢 Done abc04be tpch-nvme-10 1 Explore Profiling Data
🟢 Done abc04be tpch-s3 1 Explore Profiling Data
🟢 Done abc04be tpch-nvme 1 Explore Profiling Data
🟢 Done abc04be tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR abc04be5 vs base 64808453
Vortex (geomean): hot 0.995x ➖ · cold 0.859x ✅


datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 80572784 / 80151198 / +0.5% 113229092 / 125682074 / -9.9% 0.71 / 0.64 / +11.6%
polarsignals_q01/datafusion:vortex-file-compressed 88682854 / 88634744 / +0.1% 137623561 / 147204217 / -6.5% 0.64 / 0.60 / +7.0%
polarsignals_q02/datafusion:vortex-file-compressed 11027328 / 13013602 / -15.3% 🟢 34540835 / 41811303 / -17.4% 🟢 0.32 / 0.31 / +2.6%
polarsignals_q03/datafusion:vortex-file-compressed 89770222 / 90449142 / -0.8% 141594061 / 206107738 / -31.3% 🟢 0.63 / 0.44 / +44.5%
polarsignals_q04/datafusion:vortex-file-compressed 9352040 / 9221628 / +1.4% 31317652 / 39509013 / -20.7% 🟢 0.30 / 0.23 / +27.9%
polarsignals_q05/datafusion:vortex-file-compressed 11583566 / 11528684 / +0.5% 39579754 / 43338177 / -8.7% 0.29 / 0.27 / +10.0%
polarsignals_q06/datafusion:vortex-file-compressed 22814296 / 22979293 / -0.7% 45318642 / 52031319 / -12.9% 🟢 0.50 / 0.44 / +14.0%
polarsignals_q07/datafusion:vortex-file-compressed 10851638 / 10312294 / +5.2% 34251582 / 39786521 / -13.9% 🟢 0.32 / 0.26 / +22.2%
polarsignals_q08/datafusion:vortex-file-compressed 133687174 / 134783892 / -0.8% 184051125 / 191743412 / -4.0% 0.73 / 0.70 / +3.3%
polarsignals_q09/datafusion:vortex-file-compressed 10108895 / 9929858 / +1.8% 31223712 / 38143161 / -18.1% 🟢 0.32 / 0.26 / +24.4%
polarsignals_q10/datafusion:vortex-file-compressed 13079658 / 13127331 / -0.4% 42028199 / 48815456 / -13.9% 🟢 0.31 / 0.27 / +15.7%
polarsignals_q11/datafusion:vortex-file-compressed 15976088 / 15903416 / +0.5% 41742851 / 46237224 / -9.7% 0.38 / 0.34 / +11.3%
polarsignals_q12/datafusion:vortex-file-compressed 16533736 / 16158840 / +2.3% 39483917 / 45009338 / -12.3% 🟢 0.42 / 0.36 / +16.6%

No baseline file sizes found for base commit.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR abc04be5 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Engines: DataFusion No clear signal (-1.6%, low confidence) · DuckDB No clear signal (-2.4%, low confidence)
Vortex (geomean): hot 0.985x ➖ · cold 1.038x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.062x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.979x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6086234 / 5985445 / +1.7% 21504937 / 19153616 / +12.3% 🔴 0.28 / 0.31 / -9.4%
fineweb_q01/datafusion:vortex-file-compressed 8941768 / 8498534 / +5.2% 36485302 / 41026113 / -11.1% 🟢 0.25 / 0.21 / +18.3%
fineweb_q02/datafusion:vortex-file-compressed 11626672 / 11571138 / +0.5% 45041505 / 40668793 / +10.8% 🔴 0.26 / 0.28 / -9.3%
fineweb_q03/datafusion:vortex-file-compressed 17523708 / 17409038 / +0.7% 122733136 / 106697049 / +15.0% 🔴 0.14 / 0.16 / -12.5%
fineweb_q04/datafusion:vortex-file-compressed 63614098 / 64512260 / -1.4% 152600985 / 136733638 / +11.6% 🔴 0.42 / 0.47 / -11.6%
fineweb_q05/datafusion:vortex-file-compressed 62603114 / 62841706 / -0.4% 140438779 / 138665906 / +1.3% 0.45 / 0.45 / -1.6%
fineweb_q06/datafusion:vortex-file-compressed 16420804 / 16536322 / -0.7% 106308694 / 97371676 / +9.2% 0.15 / 0.17 / -9.0%
fineweb_q07/datafusion:vortex-file-compressed 16218628 / 17570418 / -7.7% 116646258 / 97388552 / +19.8% 🔴 0.14 / 0.18 / -22.9%
fineweb_q08/datafusion:vortex-file-compressed 9084068 / 10713922 / -15.2% 🟢 27271405 / 27264730 / +0.0% 0.33 / 0.39 / -15.2%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9482132 / 9261317 / +2.4% 34293418 / 34396651 / -0.3% 0.28 / 0.27 / +2.7%
fineweb_q01/datafusion:parquet 74603282 / 75391012 / -1.0% 158429487 / 145192269 / +9.1% 0.47 / 0.52 / -9.3%
fineweb_q02/datafusion:parquet 75535648 / 74523088 / +1.4% 158402546 / 144233337 / +9.8% 0.48 / 0.52 / -7.7%
fineweb_q03/datafusion:parquet 74030552 / 73737818 / +0.4% 174266165 / 146570587 / +18.9% 🔴 0.42 / 0.50 / -15.6%
fineweb_q04/datafusion:parquet 81741148 / 82143270 / -0.5% 172199082 / 138634498 / +24.2% 🔴 0.47 / 0.59 / -19.9%
fineweb_q05/datafusion:parquet 80212912 / 82092049 / -2.3% 166390932 / 144905880 / +14.8% 🔴 0.48 / 0.57 / -14.9%
fineweb_q06/datafusion:parquet 75178037 / 77193364 / -2.6% 160783941 / 152039848 / +5.8% 0.47 / 0.51 / -7.9%
fineweb_q07/datafusion:parquet 74035469 / 74125138 / -0.1% 161366046 / 151378457 / +6.6% 0.46 / 0.49 / -6.3%
fineweb_q08/datafusion:parquet 73524332 / 75020578 / -2.0% 155752561 / 142565591 / +9.2% 0.47 / 0.53 / -10.3%
duckdb / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2043542 / 2095650 / -2.5% 7192880 / 8010165 / -10.2% 🟢 0.28 / 0.26 / +8.6%
fineweb_q01/duckdb:vortex-file-compressed 8645138 / 8104238 / +6.7% 25189427 / 25484255 / -1.2% 0.34 / 0.32 / +7.9%
fineweb_q02/duckdb:vortex-file-compressed 11018433 / 10479842 / +5.1% 28484137 / 30039717 / -5.2% 0.39 / 0.35 / +10.9%
fineweb_q03/duckdb:vortex-file-compressed 17298070 / 17637774 / -1.9% 92266792 / 87016938 / +6.0% 0.19 / 0.20 / -7.5%
fineweb_q04/duckdb:vortex-file-compressed 68372748 / 68892491 / -0.8% 113190522 / 109673916 / +3.2% 0.60 / 0.63 / -3.8%
fineweb_q05/duckdb:vortex-file-compressed 68043812 / 67854090 / +0.3% 112339357 / 108951583 / +3.1% 0.61 / 0.62 / -2.7%
fineweb_q06/duckdb:vortex-file-compressed 18361140 / 18585628 / -1.2% 91213371 / 87670646 / +4.0% 0.20 / 0.21 / -5.0%
fineweb_q07/duckdb:vortex-file-compressed 18981976 / 19379656 / -2.1% 91321814 / 86651286 / +5.4% 0.21 / 0.22 / -7.1%
fineweb_q08/duckdb:vortex-file-compressed 4359450 / 4890195 / -10.9% 🟢 11582071 / 11576056 / +0.1% 0.38 / 0.42 / -10.9%
duckdb / parquet / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23877674 / 23389677 / +2.1% 28067008 / 27777637 / +1.0% 0.85 / 0.84 / +1.0%
fineweb_q01/duckdb:parquet 54510504 / 52797178 / +3.2% 76860113 / 71516649 / +7.5% 0.71 / 0.74 / -3.9%
fineweb_q02/duckdb:parquet 57701675 / 56824412 / +1.5% 82425430 / 78926470 / +4.4% 0.70 / 0.72 / -2.8%
fineweb_q03/duckdb:parquet 119418910 / 116886785 / +2.2% 177316470 / 175902762 / +0.8% 0.67 / 0.66 / +1.4%
fineweb_q04/duckdb:parquet 162535669 / 161380272 / +0.7% 204226417 / 205973312 / -0.8% 0.80 / 0.78 / +1.6%
fineweb_q05/duckdb:parquet 158734364 / 161141572 / -1.5% 198383802 / 198003672 / +0.2% 0.80 / 0.81 / -1.7%
fineweb_q06/duckdb:parquet 88664746 / 87763020 / +1.0% 143305259 / 150316251 / -4.7% 0.62 / 0.58 / +6.0%
fineweb_q07/duckdb:parquet 90514285 / 90026940 / +0.5% 146334178 / 137368758 / +6.5% 0.62 / 0.66 / -5.6%
fineweb_q08/duckdb:parquet 29286366 / 28034633 / +4.5% 30169273 / 29583831 / +2.0% 0.97 / 0.95 / +2.4%

No baseline file sizes found for base commit.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR abc04be5 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.000x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16014817 / 15404548 / +4.0% 41372342 / 42652838 / -3.0% 0.39 / 0.36 / +7.2%
tpch_q02/datafusion:vortex-file-compressed 17353149 / 17392146 / -0.2% 37499457 / 38277508 / -2.0% 0.46 / 0.45 / +1.8%
tpch_q03/datafusion:vortex-file-compressed 19708029 / 19560854 / +0.8% 45186126 / 43147698 / +4.7% 0.44 / 0.45 / -3.8%
tpch_q04/datafusion:vortex-file-compressed 10359115 / 10634795 / -2.6% 34975804 / 34374175 / +1.8% 0.30 / 0.31 / -4.3%
tpch_q05/datafusion:vortex-file-compressed 37519373 / 37621821 / -0.3% 68225095 / 64803242 / +5.3% 0.55 / 0.58 / -5.3%
tpch_q06/datafusion:vortex-file-compressed 4480425 / 4510021 / -0.7% 26748768 / 25517329 / +4.8% 0.17 / 0.18 / -5.2%
tpch_q07/datafusion:vortex-file-compressed 52454047 / 52432755 / +0.0% 81038489 / 81940179 / -1.1% 0.65 / 0.64 / +1.2%
tpch_q08/datafusion:vortex-file-compressed 52708976 / 52057898 / +1.3% 84164242 / 86529179 / -2.7% 0.63 / 0.60 / +4.1%
tpch_q09/datafusion:vortex-file-compressed 47364160 / 47702454 / -0.7% 79172775 / 82625171 / -4.2% 0.60 / 0.58 / +3.6%
tpch_q10/datafusion:vortex-file-compressed 17409007 / 17515961 / -0.6% 54619241 / 50979714 / +7.1% 0.32 / 0.34 / -7.2%
tpch_q11/datafusion:vortex-file-compressed 14824849 / 14373184 / +3.1% 34123160 / 34698749 / -1.7% 0.43 / 0.41 / +4.9%
tpch_q12/datafusion:vortex-file-compressed 18308800 / 18649775 / -1.8% 43850242 / 43796328 / +0.1% 0.42 / 0.43 / -1.9%
tpch_q13/datafusion:vortex-file-compressed 19675000 / 19315075 / +1.9% 45109740 / 42370688 / +6.5% 0.44 / 0.46 / -4.3%
tpch_q14/datafusion:vortex-file-compressed 14452393 / 14306965 / +1.0% 39095481 / 37792718 / +3.4% 0.37 / 0.38 / -2.3%
tpch_q15/datafusion:vortex-file-compressed 18441213 / 18275394 / +0.9% 45348598 / 45895999 / -1.2% 0.41 / 0.40 / +2.1%
tpch_q16/datafusion:vortex-file-compressed 18295605 / 18548388 / -1.4% 39730231 / 39759952 / -0.1% 0.46 / 0.47 / -1.3%
tpch_q17/datafusion:vortex-file-compressed 29200696 / 29327393 / -0.4% 58911531 / 59179715 / -0.5% 0.50 / 0.50 / +0.0%
tpch_q18/datafusion:vortex-file-compressed 36215515 / 36390140 / -0.5% 61069288 / 61433170 / -0.6% 0.59 / 0.59 / +0.1%
tpch_q19/datafusion:vortex-file-compressed 10105710 / 9724836 / +3.9% 37881153 / 39043058 / -3.0% 0.27 / 0.25 / +7.1%
tpch_q20/datafusion:vortex-file-compressed 20633291 / 20571043 / +0.3% 48104191 / 46477273 / +3.5% 0.43 / 0.44 / -3.1%
tpch_q21/datafusion:vortex-file-compressed 34728983 / 35202578 / -1.3% 66707353 / 63776720 / +4.6% 0.52 / 0.55 / -5.7%
tpch_q22/datafusion:vortex-file-compressed 11043477 / 10741757 / +2.8% 31094510 / 31106485 / -0.0% 0.36 / 0.35 / +2.8%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71251699 / 71274566 / -0.0% 88368607 / 88235738 / +0.2% 0.81 / 0.81 / -0.2%
tpch_q02/datafusion:parquet 75414713 / 76391827 / -1.3% 93367700 / 92593653 / +0.8% 0.81 / 0.83 / -2.1%
tpch_q03/datafusion:parquet 81673626 / 81970359 / -0.4% 101148389 / 103434330 / -2.2% 0.81 / 0.79 / +1.9%
tpch_q04/datafusion:parquet 39284499 / 39468312 / -0.5% 58384174 / 59025188 / -1.1% 0.67 / 0.67 / +0.6%
tpch_q05/datafusion:parquet 109664397 / 110194580 / -0.5% 135650844 / 136668607 / -0.7% 0.81 / 0.81 / +0.3%
tpch_q06/datafusion:parquet 31239991 / 31204193 / +0.1% 48738687 / 48822016 / -0.2% 0.64 / 0.64 / +0.3%
tpch_q07/datafusion:parquet 112490681 / 112510419 / -0.0% 139381214 / 138500796 / +0.6% 0.81 / 0.81 / -0.6%
tpch_q08/datafusion:parquet 117495423 / 117162508 / +0.3% 143088114 / 145725055 / -1.8% 0.82 / 0.80 / +2.1%
tpch_q09/datafusion:parquet 137138013 / 137571085 / -0.3% 167227164 / 166582651 / +0.4% 0.82 / 0.83 / -0.7%
tpch_q10/datafusion:parquet 103038487 / 103866094 / -0.8% 126306536 / 127917330 / -1.3% 0.82 / 0.81 / +0.5%
tpch_q11/datafusion:parquet 61832753 / 62331716 / -0.8% 81194044 / 81917732 / -0.9% 0.76 / 0.76 / +0.1%
tpch_q12/datafusion:parquet 63489902 / 63261634 / +0.4% 85886844 / 85047967 / +1.0% 0.74 / 0.74 / -0.6%
tpch_q13/datafusion:parquet 143301532 / 143400849 / -0.1% 160539349 / 163383952 / -1.7% 0.89 / 0.88 / +1.7%
tpch_q14/datafusion:parquet 47761518 / 47796624 / -0.1% 70799238 / 70349236 / +0.6% 0.67 / 0.68 / -0.7%
tpch_q15/datafusion:parquet 74943020 / 73890766 / +1.4% 94517635 / 95143882 / -0.7% 0.79 / 0.78 / +2.1%
tpch_q16/datafusion:parquet 43757128 / 44069053 / -0.7% 62059151 / 60438215 / +2.7% 0.71 / 0.73 / -3.3%
tpch_q17/datafusion:parquet 123501385 / 122536560 / +0.8% 146243427 / 146959663 / -0.5% 0.84 / 0.83 / +1.3%
tpch_q18/datafusion:parquet 121062735 / 120748858 / +0.3% 142088609 / 142928481 / -0.6% 0.85 / 0.84 / +0.9%
tpch_q19/datafusion:parquet 56839737 / 56840748 / -0.0% 81445955 / 82237708 / -1.0% 0.70 / 0.69 / +1.0%
tpch_q20/datafusion:parquet 77843100 / 78489537 / -0.8% 102663851 / 99557442 / +3.1% 0.76 / 0.79 / -3.8%
tpch_q21/datafusion:parquet 113841840 / 113510212 / +0.3% 138661207 / 137518221 / +0.8% 0.82 / 0.83 / -0.5%
tpch_q22/datafusion:parquet 51562721 / 51604631 / -0.1% 68427166 / 66554724 / +2.8% 0.75 / 0.78 / -2.8%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9576661 / 9435939 / +1.5% 18690908 / 18809866 / -0.6% 0.51 / 0.50 / +2.1%
tpch_q02/duckdb:vortex-file-compressed 15118119 / 15067243 / +0.3% 24339867 / 25306408 / -3.8% 0.62 / 0.60 / +4.3%
tpch_q03/duckdb:vortex-file-compressed 18214044 / 18315312 / -0.6% 35374391 / 34750844 / +1.8% 0.51 / 0.53 / -2.3%
tpch_q04/duckdb:vortex-file-compressed 12186478 / 12097081 / +0.7% 26272508 / 26496052 / -0.8% 0.46 / 0.46 / +1.6%
tpch_q05/duckdb:vortex-file-compressed 20288424 / 19985413 / +1.5% 37878546 / 35904646 / +5.5% 0.54 / 0.56 / -3.8%
tpch_q06/duckdb:vortex-file-compressed 4586395 / 4397852 / +4.3% 13875132 / 13568609 / +2.3% 0.33 / 0.32 / +2.0%
tpch_q07/duckdb:vortex-file-compressed 24003714 / 23943998 / +0.2% 38183513 / 40184861 / -5.0% 0.63 / 0.60 / +5.5%
tpch_q08/duckdb:vortex-file-compressed 21095693 / 20943820 / +0.7% 36644205 / 37457996 / -2.2% 0.58 / 0.56 / +3.0%
tpch_q09/duckdb:vortex-file-compressed 22706451 / 22076214 / +2.9% 37739644 / 39099623 / -3.5% 0.60 / 0.56 / +6.6%
tpch_q10/duckdb:vortex-file-compressed 27757574 / 27737212 / +0.1% 44820946 / 45175825 / -0.8% 0.62 / 0.61 / +0.9%
tpch_q11/duckdb:vortex-file-compressed 8024172 / 8106750 / -1.0% 16758087 / 17176487 / -2.4% 0.48 / 0.47 / +1.5%
tpch_q12/duckdb:vortex-file-compressed 14619650 / 14630851 / -0.1% 27735774 / 28009952 / -1.0% 0.53 / 0.52 / +0.9%
tpch_q13/duckdb:vortex-file-compressed 19185490 / 19394384 / -1.1% 31569225 / 30559109 / +3.3% 0.61 / 0.63 / -4.2%
tpch_q14/duckdb:vortex-file-compressed 10955092 / 11277748 / -2.9% 24560942 / 23773446 / +3.3% 0.45 / 0.47 / -6.0%
tpch_q15/duckdb:vortex-file-compressed 8276832 / 8425298 / -1.8% 20079012 / 20537004 / -2.2% 0.41 / 0.41 / +0.5%
tpch_q16/duckdb:vortex-file-compressed 16404359 / 16332893 / +0.4% 22586686 / 22957328 / -1.6% 0.73 / 0.71 / +2.1%
tpch_q17/duckdb:vortex-file-compressed 12598243 / 12551348 / +0.4% 27503396 / 28659139 / -4.0% 0.46 / 0.44 / +4.6%
tpch_q18/duckdb:vortex-file-compressed 24328156 / 24276422 / +0.2% 34293974 / 35811784 / -4.2% 0.71 / 0.68 / +4.6%
tpch_q19/duckdb:vortex-file-compressed 11624337 / 11357985 / +2.3% 25908193 / 25649287 / +1.0% 0.45 / 0.44 / +1.3%
tpch_q20/duckdb:vortex-file-compressed 14225821 / 14219279 / +0.0% 30201135 / 31418587 / -3.9% 0.47 / 0.45 / +4.1%
tpch_q21/duckdb:vortex-file-compressed 48583417 / 48785315 / -0.4% 64164272 / 66252929 / -3.2% 0.76 / 0.74 / +2.8%
tpch_q22/duckdb:vortex-file-compressed 16425419 / 16600840 / -1.1% 27081417 / 26838510 / +0.9% 0.61 / 0.62 / -1.9%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47271023 / 47698261 / -0.9% 54245801 / 54621975 / -0.7% 0.87 / 0.87 / -0.2%
tpch_q02/duckdb:parquet 48159870 / 48333312 / -0.4% 54678594 / 55766447 / -2.0% 0.88 / 0.87 / +1.6%
tpch_q03/duckdb:parquet 60124129 / 60135310 / -0.0% 69237331 / 68829841 / +0.6% 0.87 / 0.87 / -0.6%
tpch_q04/duckdb:parquet 34639761 / 34719941 / -0.2% 42910803 / 43013386 / -0.2% 0.81 / 0.81 / +0.0%
tpch_q05/duckdb:parquet 66811537 / 67074826 / -0.4% 77707355 / 78118023 / -0.5% 0.86 / 0.86 / +0.1%
tpch_q06/duckdb:parquet 21941550 / 21690206 / +1.2% 27283597 / 27653446 / -1.3% 0.80 / 0.78 / +2.5%
tpch_q07/duckdb:parquet 63817613 / 63638572 / +0.3% 73479983 / 73454296 / +0.0% 0.87 / 0.87 / +0.2%
tpch_q08/duckdb:parquet 75423593 / 75769695 / -0.5% 86888828 / 86648157 / +0.3% 0.87 / 0.87 / -0.7%
tpch_q09/duckdb:parquet 107280634 / 107662028 / -0.4% 118502759 / 119936779 / -1.2% 0.91 / 0.90 / +0.9%
tpch_q10/duckdb:parquet 105446969 / 105839733 / -0.4% 117146288 / 118234336 / -0.9% 0.90 / 0.90 / +0.6%
tpch_q11/duckdb:parquet 29489032 / 29316205 / +0.6% 34624338 / 34936123 / -0.9% 0.85 / 0.84 / +1.5%
tpch_q12/duckdb:parquet 37048131 / 36862965 / +0.5% 43668423 / 44307485 / -1.4% 0.85 / 0.83 / +2.0%
tpch_q13/duckdb:parquet 173885933 / 174493519 / -0.3% 180863236 / 180829717 / +0.0% 0.96 / 0.96 / -0.4%
tpch_q14/duckdb:parquet 42331525 / 42192727 / +0.3% 50833445 / 50974934 / -0.3% 0.83 / 0.83 / +0.6%
tpch_q15/duckdb:parquet 32522239 / 32612862 / -0.3% 41206719 / 41120739 / +0.2% 0.79 / 0.79 / -0.5%
tpch_q16/duckdb:parquet 46957022 / 46888172 / +0.1% 52668436 / 52208490 / +0.9% 0.89 / 0.90 / -0.7%
tpch_q17/duckdb:parquet 47964296 / 47952875 / +0.0% 57760418 / 57149842 / +1.1% 0.83 / 0.84 / -1.0%
tpch_q18/duckdb:parquet 73796020 / 74228495 / -0.6% 80487074 / 80054973 / +0.5% 0.92 / 0.93 / -1.1%
tpch_q19/duckdb:parquet 48253953 / 49688691 / -2.9% 58810292 / 58868433 / -0.1% 0.82 / 0.84 / -2.8%
tpch_q20/duckdb:parquet 63287243 / 63481403 / -0.3% 73835682 / 74207766 / -0.5% 0.86 / 0.86 / +0.2%
tpch_q21/duckdb:parquet 105982158 / 106592474 / -0.6% 115224474 / 115519712 / -0.3% 0.92 / 0.92 / -0.3%
tpch_q22/duckdb:parquet 50328219 / 50416042 / -0.2% 58789135 / 58812862 / -0.0% 0.86 / 0.86 / -0.1%

No baseline file sizes found for base commit.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR abc04be5 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.025x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91016716 / 91842335 / -0.9% 148582961 / 153716425 / -3.3% 0.61 / 0.60 / +2.5%
tpch_q02/datafusion:vortex-file-compressed 64601179 / 65026629 / -0.7% 95614429 / 95487647 / +0.1% 0.68 / 0.68 / -0.8%
tpch_q03/datafusion:vortex-file-compressed 63359761 / 63153061 / +0.3% 121432646 / 124566444 / -2.5% 0.52 / 0.51 / +2.9%
tpch_q04/datafusion:vortex-file-compressed 34122539 / 33884066 / +0.7% 70147480 / 71863341 / -2.4% 0.49 / 0.47 / +3.2%
tpch_q05/datafusion:vortex-file-compressed 119617124 / 118972735 / +0.5% 183315681 / 177425002 / +3.3% 0.65 / 0.67 / -2.7%
tpch_q06/datafusion:vortex-file-compressed 10576085 / 9551072 / +10.7% 🔴 52837439 / 55201335 / -4.3% 0.20 / 0.17 / +15.7%
tpch_q07/datafusion:vortex-file-compressed 97082974 / 96638878 / +0.5% 160828705 / 164883110 / -2.5% 0.60 / 0.59 / +3.0%
tpch_q08/datafusion:vortex-file-compressed 142359066 / 144630521 / -1.6% 209160563 / 213228501 / -1.9% 0.68 / 0.68 / +0.3%
tpch_q09/datafusion:vortex-file-compressed 183030379 / 185911194 / -1.5% 268073095 / 266393828 / +0.6% 0.68 / 0.70 / -2.2%
tpch_q10/datafusion:vortex-file-compressed 70145808 / 70523772 / -0.5% 138673306 / 133955265 / +3.5% 0.51 / 0.53 / -3.9%
tpch_q11/datafusion:vortex-file-compressed 45706136 / 45504924 / +0.4% 70422972 / 70219947 / +0.3% 0.65 / 0.65 / +0.2%
tpch_q12/datafusion:vortex-file-compressed 35146142 / 36132483 / -2.7% 83346983 / 80853664 / +3.1% 0.42 / 0.45 / -5.6%
tpch_q13/datafusion:vortex-file-compressed 48358573 / 49677499 / -2.7% 85146189 / 81071536 / +5.0% 0.57 / 0.61 / -7.3%
tpch_q14/datafusion:vortex-file-compressed 20171266 / 20840427 / -3.2% 85179156 / 87484129 / -2.6% 0.24 / 0.24 / -0.6%
tpch_q15/datafusion:vortex-file-compressed 32539709 / 32990887 / -1.4% 91075153 / 91658221 / -0.6% 0.36 / 0.36 / -0.7%
tpch_q16/datafusion:vortex-file-compressed 37130682 / 36450417 / +1.9% 65730034 / 66994481 / -1.9% 0.56 / 0.54 / +3.8%
tpch_q17/datafusion:vortex-file-compressed 175931103 / 179168427 / -1.8% 226116303 / 231004897 / -2.1% 0.78 / 0.78 / +0.3%
tpch_q18/datafusion:vortex-file-compressed 200474429 / 208854688 / -4.0% 276288758 / 270434360 / +2.2% 0.73 / 0.77 / -6.0%
tpch_q19/datafusion:vortex-file-compressed 29206471 / 27436278 / +6.5% 82804239 / 80256543 / +3.2% 0.35 / 0.34 / +3.2%
tpch_q20/datafusion:vortex-file-compressed 60342163 / 60584636 / -0.4% 115566137 / 113779951 / +1.6% 0.52 / 0.53 / -1.9%
tpch_q21/datafusion:vortex-file-compressed 180908546 / 181544706 / -0.4% 227960643 / 238929947 / -4.6% 0.79 / 0.76 / +4.4%
tpch_q22/datafusion:vortex-file-compressed 25891016 / 25622876 / +1.0% 54387033 / 53594727 / +1.5% 0.48 / 0.48 / -0.4%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87100892 / 87405800 / -0.3% 130761357 / 124638672 / +4.9% 0.67 / 0.70 / -5.0%
tpch_q02/datafusion:parquet 173128060 / 172465451 / +0.4% 200171569 / 202597955 / -1.2% 0.86 / 0.85 / +1.6%
tpch_q03/datafusion:parquet 134969021 / 134728458 / +0.2% 182944392 / 183462869 / -0.3% 0.74 / 0.73 / +0.5%
tpch_q04/datafusion:parquet 56951382 / 56277229 / +1.2% 94842225 / 90214521 / +5.1% 0.60 / 0.62 / -3.7%
tpch_q05/datafusion:parquet 166198215 / 168325732 / -1.3% 226902392 / 222155755 / +2.1% 0.73 / 0.76 / -3.3%
tpch_q06/datafusion:parquet 36245785 / 36485825 / -0.7% 76950218 / 75060623 / +2.5% 0.47 / 0.49 / -3.1%
tpch_q07/datafusion:parquet 216373974 / 215241217 / +0.5% 273939951 / 271310582 / +1.0% 0.79 / 0.79 / -0.4%
tpch_q08/datafusion:parquet 217557694 / 217006507 / +0.3% 288430655 / 282649931 / +2.0% 0.75 / 0.77 / -1.8%
tpch_q09/datafusion:parquet 309932947 / 308912169 / +0.3% 384500866 / 376615714 / +2.1% 0.81 / 0.82 / -1.7%
tpch_q10/datafusion:parquet 311446777 / 312067282 / -0.2% 378952368 / 369477627 / +2.6% 0.82 / 0.84 / -2.7%
tpch_q11/datafusion:parquet 127785618 / 126847909 / +0.7% 153786711 / 150878780 / +1.9% 0.83 / 0.84 / -1.2%
tpch_q12/datafusion:parquet 81963769 / 82036773 / -0.1% 126062571 / 116979721 / +7.8% 0.65 / 0.70 / -7.3%
tpch_q13/datafusion:parquet 210884616 / 210681253 / +0.1% 243750485 / 240622916 / +1.3% 0.87 / 0.88 / -1.2%
tpch_q14/datafusion:parquet 85124354 / 85201736 / -0.1% 196396526 / 187735247 / +4.6% 0.43 / 0.45 / -4.5%
tpch_q15/datafusion:parquet 106014608 / 106750251 / -0.7% 156058690 / 155219431 / +0.5% 0.68 / 0.69 / -1.2%
tpch_q16/datafusion:parquet 96253485 / 96269388 / -0.0% 121978600 / 118688661 / +2.8% 0.79 / 0.81 / -2.7%
tpch_q17/datafusion:parquet 213634663 / 214480401 / -0.4% 275025888 / 259331757 / +6.1% 0.78 / 0.83 / -6.1%
tpch_q18/datafusion:parquet 268280421 / 268723017 / -0.2% 317218894 / 316946606 / +0.1% 0.85 / 0.85 / -0.3%
tpch_q19/datafusion:parquet 107838473 / 108265953 / -0.4% 171752803 / 165478424 / +3.8% 0.63 / 0.65 / -4.0%
tpch_q20/datafusion:parquet 185611561 / 185210052 / +0.2% 256311848 / 247277500 / +3.7% 0.72 / 0.75 / -3.3%
tpch_q21/datafusion:parquet 243401082 / 245201943 / -0.7% 307940952 / 307074278 / +0.3% 0.79 / 0.80 / -1.0%
tpch_q22/datafusion:parquet 150084119 / 150005944 / +0.1% 174086124 / 176443849 / -1.3% 0.86 / 0.85 / +1.4%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32203478 / 32251704 / -0.1% 72136770 / 69153970 / +4.3% 0.45 / 0.47 / -4.3%
tpch_q02/duckdb:vortex-file-compressed 28652242 / 28909312 / -0.9% 42800848 / 43582573 / -1.8% 0.67 / 0.66 / +0.9%
tpch_q03/duckdb:vortex-file-compressed 51415384 / 51402442 / +0.0% 103293923 / 103389371 / -0.1% 0.50 / 0.50 / +0.1%
tpch_q04/duckdb:vortex-file-compressed 51647979 / 51762710 / -0.2% 91010272 / 92577835 / -1.7% 0.57 / 0.56 / +1.5%
tpch_q05/duckdb:vortex-file-compressed 68382808 / 69457495 / -1.5% 109245828 / 109500482 / -0.2% 0.63 / 0.63 / -1.3%
tpch_q06/duckdb:vortex-file-compressed 14741866 / 14900939 / -1.1% 49580865 / 49682131 / -0.2% 0.30 / 0.30 / -0.9%
tpch_q07/duckdb:vortex-file-compressed 54225109 / 54544092 / -0.6% 106206218 / 106643884 / -0.4% 0.51 / 0.51 / -0.2%
tpch_q08/duckdb:vortex-file-compressed 84761323 / 84993514 / -0.3% 133734239 / 132299262 / +1.1% 0.63 / 0.64 / -1.3%
tpch_q09/duckdb:vortex-file-compressed 101424533 / 101205886 / +0.2% 166395590 / 158473857 / +5.0% 0.61 / 0.64 / -4.6%
tpch_q10/duckdb:vortex-file-compressed 96469836 / 95563305 / +0.9% 153343238 / 154004292 / -0.4% 0.63 / 0.62 / +1.4%
tpch_q11/duckdb:vortex-file-compressed 12760283 / 12842129 / -0.6% 28015371 / 28014330 / +0.0% 0.46 / 0.46 / -0.6%
tpch_q12/duckdb:vortex-file-compressed 44503599 / 45117080 / -1.4% 80751560 / 84523081 / -4.5% 0.55 / 0.53 / +3.2%
tpch_q13/duckdb:vortex-file-compressed 71769698 / 70672009 / +1.6% 98250626 / 98725240 / -0.5% 0.73 / 0.72 / +2.0%
tpch_q14/duckdb:vortex-file-compressed 27946921 / 27767452 / +0.6% 73677437 / 71915268 / +2.5% 0.38 / 0.39 / -1.8%
tpch_q15/duckdb:vortex-file-compressed 23665291 / 23725208 / -0.3% 60949585 / 63356327 / -3.8% 0.39 / 0.37 / +3.7%
tpch_q16/duckdb:vortex-file-compressed 48627162 / 49016468 / -0.8% 58956489 / 57914482 / +1.8% 0.82 / 0.85 / -2.5%
tpch_q17/duckdb:vortex-file-compressed 35148712 / 35547768 / -1.1% 67285048 / 66685687 / +0.9% 0.52 / 0.53 / -2.0%
tpch_q18/duckdb:vortex-file-compressed 110688347 / 105784888 / +4.6% 122875816 / 120405979 / +2.1% 0.90 / 0.88 / +2.5%
tpch_q19/duckdb:vortex-file-compressed 26788714 / 26875811 / -0.3% 75503276 / 72837846 / +3.7% 0.35 / 0.37 / -3.8%
tpch_q20/duckdb:vortex-file-compressed 41045197 / 41196046 / -0.4% 91470941 / 92113901 / -0.7% 0.45 / 0.45 / +0.3%
tpch_q21/duckdb:vortex-file-compressed 94689764 / 94262995 / +0.5% 148937360 / 151375901 / -1.6% 0.64 / 0.62 / +2.1%
tpch_q22/duckdb:vortex-file-compressed 32998500 / 32997604 / +0.0% 50891706 / 48698572 / +4.5% 0.65 / 0.68 / -4.3%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67984196 / 67623322 / +0.5% 89513671 / 87632213 / +2.1% 0.76 / 0.77 / -1.6%
tpch_q02/duckdb:parquet 86622235 / 87325629 / -0.8% 95895681 / 98085918 / -2.2% 0.90 / 0.89 / +1.5%
tpch_q03/duckdb:parquet 109756336 / 111044674 / -1.2% 144521842 / 142264345 / +1.6% 0.76 / 0.78 / -2.7%
tpch_q04/duckdb:parquet 76783746 / 76270893 / +0.7% 99877218 / 97986939 / +1.9% 0.77 / 0.78 / -1.2%
tpch_q05/duckdb:parquet 122860304 / 123102862 / -0.2% 160815496 / 158199755 / +1.7% 0.76 / 0.78 / -1.8%
tpch_q06/duckdb:parquet 35401567 / 34877337 / +1.5% 68017589 / 57062619 / +19.2% 🔴 0.52 / 0.61 / -14.8%
tpch_q07/duckdb:parquet 119597621 / 117542539 / +1.7% 158595267 / 154596729 / +2.6% 0.75 / 0.76 / -0.8%
tpch_q08/duckdb:parquet 147784200 / 147008544 / +0.5% 195881122 / 187395401 / +4.5% 0.75 / 0.78 / -3.8%
tpch_q09/duckdb:parquet 238386520 / 237232312 / +0.5% 281775777 / 277586494 / +1.5% 0.85 / 0.85 / -1.0%
tpch_q10/duckdb:parquet 314630959 / 313048354 / +0.5% 342145178 / 337998688 / +1.2% 0.92 / 0.93 / -0.7%
tpch_q11/duckdb:parquet 43641402 / 43555760 / +0.2% 51419404 / 51127462 / +0.6% 0.85 / 0.85 / -0.4%
tpch_q12/duckdb:parquet 70690064 / 70607081 / +0.1% 93959140 / 89431918 / +5.1% 0.75 / 0.79 / -4.7%
tpch_q13/duckdb:parquet 291710231 / 291764690 / -0.0% 309382043 / 309269508 / +0.0% 0.94 / 0.94 / -0.1%
tpch_q14/duckdb:parquet 101447277 / 100951247 / +0.5% 146599953 / 134059126 / +9.4% 0.69 / 0.75 / -8.1%
tpch_q15/duckdb:parquet 57390226 / 57944980 / -1.0% 85178044 / 87619779 / -2.8% 0.67 / 0.66 / +1.9%
tpch_q16/duckdb:parquet 100101196 / 99623104 / +0.5% 105952329 / 106717340 / -0.7% 0.94 / 0.93 / +1.2%
tpch_q17/duckdb:parquet 82098085 / 81527631 / +0.7% 123227849 / 116876479 / +5.4% 0.67 / 0.70 / -4.5%
tpch_q18/duckdb:parquet 159135036 / 156152046 / +1.9% 170364135 / 177975443 / -4.3% 0.93 / 0.88 / +6.5%
tpch_q19/duckdb:parquet 97894539 / 97339169 / +0.6% 136505494 / 127894637 / +6.7% 0.72 / 0.76 / -5.8%
tpch_q20/duckdb:parquet 146783100 / 146603561 / +0.1% 191128686 / 183747501 / +4.0% 0.77 / 0.80 / -3.7%
tpch_q21/duckdb:parquet 254940006 / 250423696 / +1.8% 282703678 / 277022922 / +2.1% 0.90 / 0.90 / -0.2%
tpch_q22/duckdb:parquet 168218179 / 168018688 / +0.1% 180480113 / 180618979 / -0.1% 0.93 / 0.93 / +0.2%

No baseline file sizes found for base commit.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR abc04be5 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.976x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.991x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21465447 / 21449004 / +0.1% 40830143 / 42498684 / -3.9% 0.53 / 0.50 / +4.2%
tpcds_q02/datafusion:vortex-file-compressed 43245515 / 42738788 / +1.2% 64292151 / 63955906 / +0.5% 0.67 / 0.67 / +0.7%
tpcds_q03/datafusion:vortex-file-compressed 11472262 / 11929812 / -3.8% 27921858 / 28666779 / -2.6% 0.41 / 0.42 / -1.3%
tpcds_q04/datafusion:vortex-file-compressed 82308124 / 80382178 / +2.4% 108823003 / 114582340 / -5.0% 0.76 / 0.70 / +7.8%
tpcds_q05/datafusion:vortex-file-compressed 56482642 / 57220050 / -1.3% 79303438 / 77864537 / +1.8% 0.71 / 0.73 / -3.1%
tpcds_q06/datafusion:vortex-file-compressed 21718035 / 21933751 / -1.0% 42731831 / 42085565 / +1.5% 0.51 / 0.52 / -2.5%
tpcds_q07/datafusion:vortex-file-compressed 26428036 / 26766862 / -1.3% 48534337 / 49927427 / -2.8% 0.54 / 0.54 / +1.6%
tpcds_q08/datafusion:vortex-file-compressed 25819725 / 25864988 / -0.2% 44133781 / 45745693 / -3.5% 0.59 / 0.57 / +3.5%
tpcds_q09/datafusion:vortex-file-compressed 20331667 / 19975436 / +1.8% 37818906 / 37448450 / +1.0% 0.54 / 0.53 / +0.8%
tpcds_q10/datafusion:vortex-file-compressed 30224250 / 29269160 / +3.3% 49709999 / 50954544 / -2.4% 0.61 / 0.57 / +5.8%
tpcds_q11/datafusion:vortex-file-compressed 49144866 / 49830590 / -1.4% 74469758 / 80030495 / -6.9% 0.66 / 0.62 / +6.0%
tpcds_q12/datafusion:vortex-file-compressed 15302470 / 15474688 / -1.1% 33608420 / 33407488 / +0.6% 0.46 / 0.46 / -1.7%
tpcds_q13/datafusion:vortex-file-compressed 30271738 / 32749398 / -7.6% 56569180 / 56392965 / +0.3% 0.54 / 0.58 / -7.9%
tpcds_q14/datafusion:vortex-file-compressed 489293892 / 490004930 / -0.1% 543785999 / 546335491 / -0.5% 0.90 / 0.90 / +0.3%
tpcds_q15/datafusion:vortex-file-compressed 12643426 / 12768877 / -1.0% 31729882 / 31438184 / +0.9% 0.40 / 0.41 / -1.9%
tpcds_q16/datafusion:vortex-file-compressed 18790876 / 18981875 / -1.0% 36794023 / 38519538 / -4.5% 0.51 / 0.49 / +3.6%
tpcds_q17/datafusion:vortex-file-compressed 53600969 / 52389490 / +2.3% 74776567 / 74438869 / +0.5% 0.72 / 0.70 / +1.9%
tpcds_q18/datafusion:vortex-file-compressed 63668013 / 54475018 / +16.9% 🔴 82202968 / 72615185 / +13.2% 🔴 0.77 / 0.75 / +3.2%
tpcds_q19/datafusion:vortex-file-compressed 16966066 / 17395646 / -2.5% 38956822 / 41778842 / -6.8% 0.44 / 0.42 / +4.6%
tpcds_q20/datafusion:vortex-file-compressed 16635998 / 16574804 / +0.4% 33101210 / 34835360 / -5.0% 0.50 / 0.48 / +5.6%
tpcds_q21/datafusion:vortex-file-compressed 15369890 / 14967152 / +2.7% 37290950 / 34090252 / +9.4% 0.41 / 0.44 / -6.1%
tpcds_q22/datafusion:vortex-file-compressed 50129634 / 49803606 / +0.7% 69322763 / 72395029 / -4.2% 0.72 / 0.69 / +5.1%
tpcds_q23/datafusion:vortex-file-compressed 70674507 / 72311890 / -2.3% 98977302 / 103071785 / -4.0% 0.71 / 0.70 / +1.8%
tpcds_q24/datafusion:vortex-file-compressed 64055931 / 64058281 / -0.0% 85716464 / 86930470 / -1.4% 0.75 / 0.74 / +1.4%
tpcds_q25/datafusion:vortex-file-compressed 45045632 / 44760488 / +0.6% 68417556 / 71283849 / -4.0% 0.66 / 0.63 / +4.9%
tpcds_q26/datafusion:vortex-file-compressed 26684166 / 26627942 / +0.2% 44353662 / 46348751 / -4.3% 0.60 / 0.57 / +4.7%
tpcds_q27/datafusion:vortex-file-compressed 52349754 / 56419937 / -7.2% 70981732 / 74135277 / -4.3% 0.74 / 0.76 / -3.1%
tpcds_q28/datafusion:vortex-file-compressed 19019314 / 18817866 / +1.1% 38662948 / 38735697 / -0.2% 0.49 / 0.49 / +1.3%
tpcds_q29/datafusion:vortex-file-compressed 51681840 / 48357027 / +6.9% 65816877 / 74173927 / -11.3% 🟢 0.79 / 0.65 / +20.4%
tpcds_q30/datafusion:vortex-file-compressed 27697216 / 27686742 / +0.0% 46168457 / 48468787 / -4.7% 0.60 / 0.57 / +5.0%
tpcds_q31/datafusion:vortex-file-compressed 62458950 / 62990009 / -0.8% 88343450 / 91175904 / -3.1% 0.71 / 0.69 / +2.3%
tpcds_q32/datafusion:vortex-file-compressed 12894138 / 12714930 / +1.4% 30962530 / 30232909 / +2.4% 0.42 / 0.42 / -1.0%
tpcds_q33/datafusion:vortex-file-compressed 28030012 / 28100685 / -0.3% 51925269 / 56000482 / -7.3% 0.54 / 0.50 / +7.6%
tpcds_q34/datafusion:vortex-file-compressed 17389328 / 17688358 / -1.7% 37582895 / 39087432 / -3.8% 0.46 / 0.45 / +2.2%
tpcds_q35/datafusion:vortex-file-compressed 30927838 / 31187080 / -0.8% 52628304 / 58451747 / -10.0% 0.59 / 0.53 / +10.1%
tpcds_q36/datafusion:vortex-file-compressed 46800686 / 46986574 / -0.4% 67458820 / 69673332 / -3.2% 0.69 / 0.67 / +2.9%
tpcds_q37/datafusion:vortex-file-compressed 12794780 / 12104225 / +5.7% 34780858 / 36334974 / -4.3% 0.37 / 0.33 / +10.4%
tpcds_q38/datafusion:vortex-file-compressed 26108885 / 26040116 / +0.3% 47440216 / 49435317 / -4.0% 0.55 / 0.53 / +4.5%
tpcds_q39/datafusion:vortex-file-compressed 64220275 / 63590843 / +1.0% 88790650 / 87528038 / +1.4% 0.72 / 0.73 / -0.4%
tpcds_q40/datafusion:vortex-file-compressed 22820662 / 23146031 / -1.4% 40455233 / 42456392 / -4.7% 0.56 / 0.55 / +3.5%
tpcds_q41/datafusion:vortex-file-compressed 19953334 / 19857088 / +0.5% 32770624 / 32585196 / +0.6% 0.61 / 0.61 / -0.1%
tpcds_q42/datafusion:vortex-file-compressed 11582678 / 11634661 / -0.4% 28011565 / 29260028 / -4.3% 0.41 / 0.40 / +4.0%
tpcds_q43/datafusion:vortex-file-compressed 13239280 / 13256147 / -0.1% 32648887 / 34503816 / -5.4% 0.41 / 0.38 / +5.5%
tpcds_q44/datafusion:vortex-file-compressed 27772226 / 27701670 / +0.3% 50345525 / 50164040 / +0.4% 0.55 / 0.55 / -0.1%
tpcds_q45/datafusion:vortex-file-compressed 16971278 / 17058599 / -0.5% 36077655 / 36753518 / -1.8% 0.47 / 0.46 / +1.4%
tpcds_q46/datafusion:vortex-file-compressed 23464509 / 23504132 / -0.2% 46616662 / 49629158 / -6.1% 0.50 / 0.47 / +6.3%
tpcds_q47/datafusion:vortex-file-compressed 75616027 / 74149150 / +2.0% 104311303 / 107162604 / -2.7% 0.72 / 0.69 / +4.8%
tpcds_q48/datafusion:vortex-file-compressed 28615736 / 28482035 / +0.5% 53651203 / 52245270 / +2.7% 0.53 / 0.55 / -2.2%
tpcds_q49/datafusion:vortex-file-compressed 58046957 / 55647761 / +4.3% 77793064 / 85460631 / -9.0% 0.75 / 0.65 / +14.6%
tpcds_q50/datafusion:vortex-file-compressed 31152493 / 32380240 / -3.8% 51443288 / 53066138 / -3.1% 0.61 / 0.61 / -0.8%
tpcds_q51/datafusion:vortex-file-compressed 66201032 / 66827490 / -0.9% 89587437 / 91545180 / -2.1% 0.74 / 0.73 / +1.2%
tpcds_q52/datafusion:vortex-file-compressed 11881645 / 11805344 / +0.6% 27311370 / 29482820 / -7.4% 0.44 / 0.40 / +8.6%
tpcds_q53/datafusion:vortex-file-compressed 18322654 / 18332840 / -0.1% 38598862 / 40855988 / -5.5% 0.47 / 0.45 / +5.8%
tpcds_q54/datafusion:vortex-file-compressed 32119044 / 31777460 / +1.1% 54999599 / 55566235 / -1.0% 0.58 / 0.57 / +2.1%
tpcds_q55/datafusion:vortex-file-compressed 11363218 / 11386898 / -0.2% 28309919 / 26708425 / +6.0% 0.40 / 0.43 / -5.9%
tpcds_q56/datafusion:vortex-file-compressed 26483086 / 26545850 / -0.2% 48523301 / 49268989 / -1.5% 0.55 / 0.54 / +1.3%
tpcds_q57/datafusion:vortex-file-compressed 62262283 / 62359600 / -0.2% 87436936 / 89946998 / -2.8% 0.71 / 0.69 / +2.7%
tpcds_q58/datafusion:vortex-file-compressed 40254869 / 40872440 / -1.5% 64784159 / 66900849 / -3.2% 0.62 / 0.61 / +1.7%
tpcds_q59/datafusion:vortex-file-compressed 27219448 / 27517764 / -1.1% 53377395 / 53978809 / -1.1% 0.51 / 0.51 / +0.0%
tpcds_q60/datafusion:vortex-file-compressed 27154140 / 26400983 / +2.9% 48339266 / 48792663 / -0.9% 0.56 / 0.54 / +3.8%
tpcds_q61/datafusion:vortex-file-compressed 20369353 / 20675778 / -1.5% 42202832 / 41297673 / +2.2% 0.48 / 0.50 / -3.6%
tpcds_q62/datafusion:vortex-file-compressed 16306245 / 16558694 / -1.5% 34546866 / 34571284 / -0.1% 0.47 / 0.48 / -1.5%
tpcds_q63/datafusion:vortex-file-compressed 18192754 / 18181666 / +0.1% 39133670 / 41196266 / -5.0% 0.46 / 0.44 / +5.3%
tpcds_q64/datafusion:vortex-file-compressed 189329122 / 191351242 / -1.1% 221416740 / 227870948 / -2.8% 0.86 / 0.84 / +1.8%
tpcds_q65/datafusion:vortex-file-compressed 72590728 / 72715048 / -0.2% 94720947 / 98443447 / -3.8% 0.77 / 0.74 / +3.8%
tpcds_q66/datafusion:vortex-file-compressed 49697404 / 49627487 / +0.1% 69087328 / 71294454 / -3.1% 0.72 / 0.70 / +3.3%
tpcds_q67/datafusion:vortex-file-compressed 50959072 / 50575306 / +0.8% 84833385 / 85291554 / -0.5% 0.60 / 0.59 / +1.3%
tpcds_q68/datafusion:vortex-file-compressed 22915342 / 22905012 / +0.0% 46697410 / 45973809 / +1.6% 0.49 / 0.50 / -1.5%
tpcds_q69/datafusion:vortex-file-compressed 26775955 / 26831008 / -0.2% 48037664 / 49375979 / -2.7% 0.56 / 0.54 / +2.6%
tpcds_q70/datafusion:vortex-file-compressed 73027458 / 73082920 / -0.1% 92830193 / 96067912 / -3.4% 0.79 / 0.76 / +3.4%
tpcds_q71/datafusion:vortex-file-compressed 19461145 / 18202877 / +6.9% 38354144 / 40816818 / -6.0% 0.51 / 0.45 / +13.8%
tpcds_q72/datafusion:vortex-file-compressed 274998628 / 270582635 / +1.6% 223775598 / 278041133 / -19.5% 🟢 1.23 / 0.97 / +26.3%
tpcds_q73/datafusion:vortex-file-compressed 16339450 / 16408834 / -0.4% 35599797 / 37227767 / -4.4% 0.46 / 0.44 / +4.1%
tpcds_q74/datafusion:vortex-file-compressed 40807302 / 40891589 / -0.2% 67365668 / 68950722 / -2.3% 0.61 / 0.59 / +2.1%
tpcds_q75/datafusion:vortex-file-compressed 137365234 / 136933056 / +0.3% 153772732 / 176672529 / -13.0% 🟢 0.89 / 0.78 / +15.3%
tpcds_q76/datafusion:vortex-file-compressed 29363606 / 29306602 / +0.2% 51193014 / 50817896 / +0.7% 0.57 / 0.58 / -0.5%
tpcds_q77/datafusion:vortex-file-compressed 45113773 / 45161332 / -0.1% 66885702 / 68031847 / -1.7% 0.67 / 0.66 / +1.6%
tpcds_q78/datafusion:vortex-file-compressed 61333838 / 61222074 / +0.2% 86665057 / 91279920 / -5.1% 0.71 / 0.67 / +5.5%
tpcds_q79/datafusion:vortex-file-compressed 20068751 / 20280174 / -1.0% 41133050 / 42197009 / -2.5% 0.49 / 0.48 / +1.5%
tpcds_q80/datafusion:vortex-file-compressed 68929898 / 68873983 / +0.1% 93592790 / 94109171 / -0.5% 0.74 / 0.73 / +0.6%
tpcds_q81/datafusion:vortex-file-compressed 27619736 / 28066564 / -1.6% 46440555 / 47284348 / -1.8% 0.59 / 0.59 / +0.2%
tpcds_q82/datafusion:vortex-file-compressed 13428578 / 12397074 / +8.3% 34149573 / 36379399 / -6.1% 0.39 / 0.34 / +15.4%
tpcds_q83/datafusion:vortex-file-compressed 34600106 / 34666817 / -0.2% 52514125 / 55140265 / -4.8% 0.66 / 0.63 / +4.8%
tpcds_q84/datafusion:vortex-file-compressed 10423122 / 10589235 / -1.6% 26836724 / 27651300 / -2.9% 0.39 / 0.38 / +1.4%
tpcds_q85/datafusion:vortex-file-compressed 52143416 / 52379096 / -0.4% 75798247 / 78218823 / -3.1% 0.69 / 0.67 / +2.7%
tpcds_q86/datafusion:vortex-file-compressed 16403531 / 16156348 / +1.5% 34223753 / 35681131 / -4.1% 0.48 / 0.45 / +5.9%
tpcds_q87/datafusion:vortex-file-compressed 25841966 / 26219597 / -1.4% 49395093 / 50423190 / -2.0% 0.52 / 0.52 / +0.6%
tpcds_q88/datafusion:vortex-file-compressed 31479806 / 31364419 / +0.4% 51289614 / 51472799 / -0.4% 0.61 / 0.61 / +0.7%
tpcds_q89/datafusion:vortex-file-compressed 21277288 / 21216648 / +0.3% 42788768 / 44141371 / -3.1% 0.50 / 0.48 / +3.5%
tpcds_q90/datafusion:vortex-file-compressed 10524584 / 10590750 / -0.6% 25466291 / 26186255 / -2.7% 0.41 / 0.40 / +2.2%
tpcds_q91/datafusion:vortex-file-compressed 16457817 / 15873791 / +3.7% 35571370 / 37530117 / -5.2% 0.46 / 0.42 / +9.4%
tpcds_q92/datafusion:vortex-file-compressed 13180162 / 13095928 / +0.6% 29230132 / 31897473 / -8.4% 0.45 / 0.41 / +9.8%
tpcds_q93/datafusion:vortex-file-compressed 20003889 / 20461675 / -2.2% 40018144 / 38338479 / +4.4% 0.50 / 0.53 / -6.3%
tpcds_q94/datafusion:vortex-file-compressed 18424656 / 18455948 / -0.2% 35939183 / 37333633 / -3.7% 0.51 / 0.49 / +3.7%
tpcds_q95/datafusion:vortex-file-compressed 41953536 / 42141119 / -0.4% 62430615 / 62101264 / +0.5% 0.67 / 0.68 / -1.0%
tpcds_q96/datafusion:vortex-file-compressed 7385968 / 7941012 / -7.0% 25402934 / 23393537 / +8.6% 0.29 / 0.34 / -14.3%
tpcds_q97/datafusion:vortex-file-compressed 17933822 / 17546132 / +2.2% 38762389 / 40760025 / -4.9% 0.46 / 0.43 / +7.5%
tpcds_q98/datafusion:vortex-file-compressed 15796048 / 15784005 / +0.1% 34583048 / 34322373 / +0.8% 0.46 / 0.46 / -0.7%
tpcds_q99/datafusion:vortex-file-compressed 16209817 / 16132910 / +0.5% 32521262 / 34094422 / -4.6% 0.50 / 0.47 / +5.3%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41346986 / 41934641 / -1.4% 60235572 / 62940275 / -4.3% 0.69 / 0.67 / +3.0%
tpcds_q02/datafusion:parquet 54388524 / 54199292 / +0.3% 70372001 / 71443108 / -1.5% 0.77 / 0.76 / +1.9%
tpcds_q03/datafusion:parquet 19150418 / 18829179 / +1.7% 31136562 / 31099736 / +0.1% 0.62 / 0.61 / +1.6%
tpcds_q04/datafusion:parquet 178587662 / 177862064 / +0.4% 204136340 / 203486177 / +0.3% 0.87 / 0.87 / +0.1%
tpcds_q05/datafusion:parquet 68526806 / 67740948 / +1.2% 87889255 / 90107180 / -2.5% 0.78 / 0.75 / +3.7%
tpcds_q06/datafusion:parquet 33783754 / 34361484 / -1.7% 46901692 / 51149315 / -8.3% 0.72 / 0.67 / +7.2%
tpcds_q07/datafusion:parquet 47195591 / 46846304 / +0.7% 63860463 / 67154149 / -4.9% 0.74 / 0.70 / +5.9%
tpcds_q08/datafusion:parquet 31234390 / 31423518 / -0.6% 47093877 / 47678301 / -1.2% 0.66 / 0.66 / +0.6%
tpcds_q09/datafusion:parquet 30161180 / 32478880 / -7.1% 37230649 / 44248215 / -15.9% 🟢 0.81 / 0.73 / +10.4%
tpcds_q10/datafusion:parquet 45173670 / 44548093 / +1.4% 60610280 / 57251390 / +5.9% 0.75 / 0.78 / -4.2%
tpcds_q11/datafusion:parquet 97978716 / 97946912 / +0.0% 117267254 / 121218036 / -3.3% 0.84 / 0.81 / +3.4%
tpcds_q12/datafusion:parquet 23588414 / 23550060 / +0.2% 36045910 / 36929462 / -2.4% 0.65 / 0.64 / +2.6%
tpcds_q13/datafusion:parquet 46065903 / 45294244 / +1.7% 65532502 / 67069448 / -2.3% 0.70 / 0.68 / +4.1%
tpcds_q14/datafusion:parquet 534500476 / 531374890 / +0.6% 581553417 / 585568185 / -0.7% 0.92 / 0.91 / +1.3%
tpcds_q15/datafusion:parquet 23293453 / 23402312 / -0.5% 38094556 / 40214599 / -5.3% 0.61 / 0.58 / +5.1%
tpcds_q16/datafusion:parquet 36806476 / 36637342 / +0.5% 52235812 / 51066956 / +2.3% 0.70 / 0.72 / -1.8%
tpcds_q17/datafusion:parquet 73876021 / 74474544 / -0.8% 98406894 / 98329954 / +0.1% 0.75 / 0.76 / -0.9%
tpcds_q18/datafusion:parquet 69087472 / 69610683 / -0.8% 90678400 / 88806689 / +2.1% 0.76 / 0.78 / -2.8%
tpcds_q19/datafusion:parquet 29214752 / 29277994 / -0.2% 42767747 / 44382161 / -3.6% 0.68 / 0.66 / +3.6%
tpcds_q20/datafusion:parquet 25263246 / 24893586 / +1.5% 35979696 / 37794574 / -4.8% 0.70 / 0.66 / +6.6%
tpcds_q21/datafusion:parquet 19961286 / 20169398 / -1.0% 32512110 / 35031277 / -7.2% 0.61 / 0.58 / +6.6%
tpcds_q22/datafusion:parquet 77670348 / 77429776 / +0.3% 88825496 / 91781240 / -3.2% 0.87 / 0.84 / +3.6%
tpcds_q23/datafusion:parquet 90970606 / 91259834 / -0.3% 114331693 / 119150612 / -4.0% 0.80 / 0.77 / +3.9%
tpcds_q24/datafusion:parquet 89474954 / 89902664 / -0.5% 110636372 / 115437521 / -4.2% 0.81 / 0.78 / +3.8%
tpcds_q25/datafusion:parquet 79702813 / 79214470 / +0.6% 100098034 / 98849383 / +1.3% 0.80 / 0.80 / -0.6%
tpcds_q26/datafusion:parquet 42396532 / 42902962 / -1.2% 58050553 / 62061401 / -6.5% 0.73 / 0.69 / +5.6%
tpcds_q27/datafusion:parquet 75560475 / 78739678 / -4.0% 98990349 / 97462203 / +1.6% 0.76 / 0.81 / -5.5%
tpcds_q28/datafusion:parquet 28189392 / 28557796 / -1.3% 44091446 / 45573823 / -3.3% 0.64 / 0.63 / +2.0%
tpcds_q29/datafusion:parquet 75029630 / 74400790 / +0.8% 95934181 / 99987626 / -4.1% 0.78 / 0.74 / +5.1%
tpcds_q30/datafusion:parquet 45319425 / 43679683 / +3.8% 56382612 / 62074216 / -9.2% 0.80 / 0.70 / +14.2%
tpcds_q31/datafusion:parquet 82230435 / 82633347 / -0.5% 96493135 / 101659070 / -5.1% 0.85 / 0.81 / +4.8%
tpcds_q32/datafusion:parquet 26591600 / 26231688 / +1.4% 39551871 / 41134481 / -3.8% 0.67 / 0.64 / +5.4%
tpcds_q33/datafusion:parquet 37231210 / 37063050 / +0.5% 51572611 / 54536844 / -5.4% 0.72 / 0.68 / +6.2%
tpcds_q34/datafusion:parquet 24143104 / 23939049 / +0.9% 35576936 / 37229360 / -4.4% 0.68 / 0.64 / +5.5%
tpcds_q35/datafusion:parquet 50956545 / 49786038 / +2.4% 65614293 / 63718958 / +3.0% 0.78 / 0.78 / -0.6%
tpcds_q36/datafusion:parquet 53119544 / 53258567 / -0.3% 74886975 / 71855645 / +4.2% 0.71 / 0.74 / -4.3%
tpcds_q37/datafusion:parquet 21506582 / 21580606 / -0.3% 33601154 / 36748733 / -8.6% 0.64 / 0.59 / +9.0%
tpcds_q38/datafusion:parquet 44091620 / 44649130 / -1.2% 60225000 / 64816610 / -7.1% 0.73 / 0.69 / +6.3%
tpcds_q39/datafusion:parquet 68338538 / 68131247 / +0.3% 84242861 / 86331106 / -2.4% 0.81 / 0.79 / +2.8%
tpcds_q40/datafusion:parquet 29738666 / 30335482 / -2.0% 50335818 / 51683983 / -2.6% 0.59 / 0.59 / +0.7%
tpcds_q41/datafusion:parquet 20111238 / 19602344 / +2.6% 33062639 / 32017842 / +3.3% 0.61 / 0.61 / -0.6%
tpcds_q42/datafusion:parquet 18489956 / 18278492 / +1.2% 28830961 / 30319528 / -4.9% 0.64 / 0.60 / +6.4%
tpcds_q43/datafusion:parquet 19315436 / 19504236 / -1.0% 32267282 / 33000985 / -2.2% 0.60 / 0.59 / +1.3%
tpcds_q44/datafusion:parquet 35501646 / 35785336 / -0.8% 49873272 / 51263405 / -2.7% 0.71 / 0.70 / +2.0%
tpcds_q45/datafusion:parquet 27542754 / 28084930 / -1.9% 39788865 / 41460552 / -4.0% 0.69 / 0.68 / +2.2%
tpcds_q46/datafusion:parquet 29026741 / 28929198 / +0.3% 44794716 / 45583700 / -1.7% 0.65 / 0.63 / +2.1%
tpcds_q47/datafusion:parquet 97252790 / 98276346 / -1.0% 118898543 / 120887976 / -1.6% 0.82 / 0.81 / +0.6%
tpcds_q48/datafusion:parquet 41641394 / 41522119 / +0.3% 57995326 / 59033188 / -1.8% 0.72 / 0.70 / +2.1%
tpcds_q49/datafusion:parquet 70450476 / 71826388 / -1.9% 92003703 / 94752933 / -2.9% 0.77 / 0.76 / +1.0%
tpcds_q50/datafusion:parquet 46807866 / 46382150 / +0.9% 66768474 / 69761702 / -4.3% 0.70 / 0.66 / +5.4%
tpcds_q51/datafusion:parquet 74939246 / 74983710 / -0.1% 93985316 / 94366271 / -0.4% 0.80 / 0.79 / +0.3%
tpcds_q52/datafusion:parquet 18578970 / 18475504 / +0.6% 29065609 / 30424943 / -4.5% 0.64 / 0.61 / +5.3%
tpcds_q53/datafusion:parquet 22495086 / 21993897 / +2.3% 38804385 / 39222491 / -1.1% 0.58 / 0.56 / +3.4%
tpcds_q54/datafusion:parquet 53135363 / 53067003 / +0.1% 67148752 / 68471352 / -1.9% 0.79 / 0.78 / +2.1%
tpcds_q55/datafusion:parquet 18138635 / 18264418 / -0.7% 29734720 / 30935383 / -3.9% 0.61 / 0.59 / +3.3%
tpcds_q56/datafusion:parquet 40660512 / 41223383 / -1.4% 56044980 / 53962201 / +3.9% 0.73 / 0.76 / -5.0%
tpcds_q57/datafusion:parquet 100289162 / 101425854 / -1.1% 120041155 / 117484513 / +2.2% 0.84 / 0.86 / -3.2%
tpcds_q58/datafusion:parquet 65970836 / 65431608 / +0.8% 82961753 / 82952017 / +0.0% 0.80 / 0.79 / +0.8%
tpcds_q59/datafusion:parquet 47202603 / 46711870 / +1.1% 61862014 / 62937696 / -1.7% 0.76 / 0.74 / +2.8%
tpcds_q60/datafusion:parquet 39181926 / 41167501 / -4.8% 55495279 / 53341109 / +4.0% 0.71 / 0.77 / -8.5%
tpcds_q61/datafusion:parquet 35271216 / 34981678 / +0.8% 51564763 / 50442547 / +2.2% 0.68 / 0.69 / -1.4%
tpcds_q62/datafusion:parquet 24940978 / 24903140 / +0.2% 38085927 / 38481086 / -1.0% 0.65 / 0.65 / +1.2%
tpcds_q63/datafusion:parquet 22240242 / 21782786 / +2.1% 38175146 / 39692051 / -3.8% 0.58 / 0.55 / +6.2%
tpcds_q64/datafusion:parquet 284786353 / 287308187 / -0.9% 321806721 / 324339106 / -0.8% 0.88 / 0.89 / -0.1%
tpcds_q65/datafusion:parquet 119689308 / 120536482 / -0.7% 136790772 / 141857851 / -3.6% 0.87 / 0.85 / +3.0%
tpcds_q66/datafusion:parquet 60777233 / 60186930 / +1.0% 77172846 / 75885526 / +1.7% 0.79 / 0.79 / -0.7%
tpcds_q67/datafusion:parquet 68257612 / 68585032 / -0.5% 92970862 / 95821566 / -3.0% 0.73 / 0.72 / +2.6%
tpcds_q68/datafusion:parquet 28609219 / 28771694 / -0.6% 47534604 / 48992140 / -3.0% 0.60 / 0.59 / +2.5%
tpcds_q69/datafusion:parquet 43957828 / 42987038 / +2.3% 59588922 / 59339488 / +0.4% 0.74 / 0.72 / +1.8%
tpcds_q70/datafusion:parquet 80547342 / 80702666 / -0.2% 98678293 / 98395868 / +0.3% 0.82 / 0.82 / -0.5%
tpcds_q71/datafusion:parquet 25346824 / 26357412 / -3.8% 39290301 / 40662998 / -3.4% 0.65 / 0.65 / -0.5%
tpcds_q72/datafusion:parquet 521535839 / 515469642 / +1.2% 555157770 / 548320267 / +1.2% 0.94 / 0.94 / -0.1%
tpcds_q73/datafusion:parquet 23728328 / 23911079 / -0.8% 36123901 / 37711874 / -4.2% 0.66 / 0.63 / +3.6%
tpcds_q74/datafusion:parquet 69324512 / 68736513 / +0.9% 89882594 / 87904932 / +2.2% 0.77 / 0.78 / -1.4%
tpcds_q75/datafusion:parquet 150423252 / 152432366 / -1.3% 179210239 / 181806746 / -1.4% 0.84 / 0.84 / +0.1%
tpcds_q76/datafusion:parquet 33200124 / 33103139 / +0.3% 47475539 / 47082402 / +0.8% 0.70 / 0.70 / -0.5%
tpcds_q77/datafusion:parquet 57048984 / 56932614 / +0.2% 73420559 / 77954260 / -5.8% 0.78 / 0.73 / +6.4%
tpcds_q78/datafusion:parquet 85768722 / 85631185 / +0.2% 116392119 / 118462226 / -1.7% 0.74 / 0.72 / +1.9%
tpcds_q79/datafusion:parquet 26689442 / 26535574 / +0.6% 41301986 / 44201567 / -6.6% 0.65 / 0.60 / +7.6%
tpcds_q80/datafusion:parquet 81194218 / 80415402 / +1.0% 107516584 / 110583053 / -2.8% 0.76 / 0.73 / +3.8%
tpcds_q81/datafusion:parquet 37708770 / 38944306 / -3.2% 50887199 / 50474181 / +0.8% 0.74 / 0.77 / -4.0%
tpcds_q82/datafusion:parquet 21960409 / 22418096 / -2.0% 36716096 / 36232964 / +1.3% 0.60 / 0.62 / -3.3%
tpcds_q83/datafusion:parquet 59925948 / 59108821 / +1.4% 76167644 / 75660356 / +0.7% 0.79 / 0.78 / +0.7%
tpcds_q84/datafusion:parquet 27106692 / 26684250 / +1.6% 39820964 / 41453347 / -3.9% 0.68 / 0.64 / +5.7%
tpcds_q85/datafusion:parquet 80006338 / 80162231 / -0.2% 103573724 / 103700921 / -0.1% 0.77 / 0.77 / -0.1%
tpcds_q86/datafusion:parquet 20884641 / 20695666 / +0.9% 32850120 / 33472984 / -1.9% 0.64 / 0.62 / +2.8%
tpcds_q87/datafusion:parquet 43379444 / 44677312 / -2.9% 62381896 / 58664162 / +6.3% 0.70 / 0.76 / -8.7%
tpcds_q88/datafusion:parquet 36655472 / 37097696 / -1.2% 50740624 / 49853056 / +1.8% 0.72 / 0.74 / -2.9%
tpcds_q89/datafusion:parquet 25948368 / 25910608 / +0.1% 41003078 / 42618747 / -3.8% 0.63 / 0.61 / +4.1%
tpcds_q90/datafusion:parquet 15223198 / 15769406 / -3.5% 29358693 / 29399972 / -0.1% 0.52 / 0.54 / -3.3%
tpcds_q91/datafusion:parquet 32621578 / 32633648 / -0.0% 46862497 / 48180870 / -2.7% 0.70 / 0.68 / +2.8%
tpcds_q92/datafusion:parquet 27133760 / 26515896 / +2.3% 41313867 / 41341709 / -0.1% 0.66 / 0.64 / +2.4%
tpcds_q93/datafusion:parquet 27466055 / 27531030 / -0.2% 43961532 / 47468285 / -7.4% 0.62 / 0.58 / +7.7%
tpcds_q94/datafusion:parquet 35053617 / 34980072 / +0.2% 48501886 / 50063009 / -3.1% 0.72 / 0.70 / +3.4%
tpcds_q95/datafusion:parquet 63308152 / 64070348 / -1.2% 77999482 / 79328390 / -1.7% 0.81 / 0.81 / +0.5%
tpcds_q96/datafusion:parquet 12862677 / 12819981 / +0.3% 24889518 / 24687730 / +0.8% 0.52 / 0.52 / -0.5%
tpcds_q97/datafusion:parquet 35367300 / 34563396 / +2.3% 51852458 / 51932431 / -0.2% 0.68 / 0.67 / +2.5%
tpcds_q98/datafusion:parquet 24458540 / 24491682 / -0.1% 39153107 / 39124259 / +0.1% 0.62 / 0.63 / -0.2%
tpcds_q99/datafusion:parquet 29611920 / 29767726 / -0.5% 43470220 / 42905800 / +1.3% 0.68 / 0.69 / -1.8%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16058939 / 16280605 / -1.4% 24571720 / 25355059 / -3.1% 0.65 / 0.64 / +1.8%
tpcds_q02/duckdb:vortex-file-compressed 17058244 / 17816070 / -4.3% 22765209 / 24783072 / -8.1% 0.75 / 0.72 / +4.2%
tpcds_q03/duckdb:vortex-file-compressed 7013740 / 7049213 / -0.5% 16332182 / 16660554 / -2.0% 0.43 / 0.42 / +1.5%
tpcds_q04/duckdb:vortex-file-compressed 58736018 / 58341647 / +0.7% 70883590 / 72505688 / -2.2% 0.83 / 0.80 / +3.0%
tpcds_q05/duckdb:vortex-file-compressed 23149537 / 23257678 / -0.5% 33050487 / 32782333 / +0.8% 0.70 / 0.71 / -1.3%
tpcds_q06/duckdb:vortex-file-compressed 24193820 / 24142587 / +0.2% 38247311 / 39379849 / -2.9% 0.63 / 0.61 / +3.2%
tpcds_q07/duckdb:vortex-file-compressed 22410750 / 22277980 / +0.6% 34106452 / 35748885 / -4.6% 0.66 / 0.62 / +5.4%
tpcds_q08/duckdb:vortex-file-compressed 17352988 / 17321541 / +0.2% 25998022 / 25589170 / +1.6% 0.67 / 0.68 / -1.4%
tpcds_q09/duckdb:vortex-file-compressed 19345966 / 19158518 / +1.0% 29430071 / 30063595 / -2.1% 0.66 / 0.64 / +3.2%
tpcds_q10/duckdb:vortex-file-compressed 28285257 / 27840512 / +1.6% 40468730 / 41908476 / -3.4% 0.70 / 0.66 / +5.2%
tpcds_q11/duckdb:vortex-file-compressed 36384346 / 35801609 / +1.6% 44857453 / 45566363 / -1.6% 0.81 / 0.79 / +3.2%
tpcds_q12/duckdb:vortex-file-compressed 10383266 / 10348776 / +0.3% 16379819 / 16979304 / -3.5% 0.63 / 0.61 / +4.0%
tpcds_q13/duckdb:vortex-file-compressed 19824172 / 19506848 / +1.6% 30655285 / 34253318 / -10.5% 🟢 0.65 / 0.57 / +13.6%
tpcds_q14/duckdb:vortex-file-compressed 55794714 / 54580905 / +2.2% 65620539 / 65827298 / -0.3% 0.85 / 0.83 / +2.5%
tpcds_q15/duckdb:vortex-file-compressed 11352178 / 11261424 / +0.8% 17638109 / 17913819 / -1.5% 0.64 / 0.63 / +2.4%
tpcds_q16/duckdb:vortex-file-compressed 24692752 / 24416186 / +1.1% 35300528 / 35773144 / -1.3% 0.70 / 0.68 / +2.5%
tpcds_q17/duckdb:vortex-file-compressed 20472290 / 20162202 / +1.5% 31841933 / 31675244 / +0.5% 0.64 / 0.64 / +1.0%
tpcds_q18/duckdb:vortex-file-compressed 32472064 / 32025276 / +1.4% 42642472 / 42413959 / +0.5% 0.76 / 0.76 / +0.9%
tpcds_q19/duckdb:vortex-file-compressed 20671775 / 20453884 / +1.1% 29338123 / 29003169 / +1.2% 0.70 / 0.71 / -0.1%
tpcds_q20/duckdb:vortex-file-compressed 11016530 / 10971338 / +0.4% 17436936 / 17766266 / -1.9% 0.63 / 0.62 / +2.3%
tpcds_q21/duckdb:vortex-file-compressed 10499440 / 10162788 / +3.3% 23497739 / 22733869 / +3.4% 0.45 / 0.45 / -0.0%
tpcds_q22/duckdb:vortex-file-compressed 18138151 / 18540464 / -2.2% 30930382 / 31006366 / -0.2% 0.59 / 0.60 / -1.9%
tpcds_q23/duckdb:vortex-file-compressed 38503095 / 37021247 / +4.0% 48962660 / 48880567 / +0.2% 0.79 / 0.76 / +3.8%
tpcds_q24/duckdb:vortex-file-compressed 27190982 / 26513250 / +2.6% 36323310 / 38813844 / -6.4% 0.75 / 0.68 / +9.6%
tpcds_q25/duckdb:vortex-file-compressed 19241420 / 19058916 / +1.0% 30564007 / 31360765 / -2.5% 0.63 / 0.61 / +3.6%
tpcds_q26/duckdb:vortex-file-compressed 21950044 / 22068404 / -0.5% 31070161 / 33068431 / -6.0% 0.71 / 0.67 / +5.9%
tpcds_q27/duckdb:vortex-file-compressed 25085501 / 24765314 / +1.3% 36445245 / 37788034 / -3.6% 0.69 / 0.66 / +5.0%
tpcds_q28/duckdb:vortex-file-compressed 15159415 / 15262860 / -0.7% 26668700 / 26294087 / +1.4% 0.57 / 0.58 / -2.1%
tpcds_q29/duckdb:vortex-file-compressed 18893963 / 18734154 / +0.9% 28893095 / 31534111 / -8.4% 0.65 / 0.59 / +10.1%
tpcds_q30/duckdb:vortex-file-compressed 18867024 / 18259288 / +3.3% 26206287 / 28484119 / -8.0% 0.72 / 0.64 / +12.3%
tpcds_q31/duckdb:vortex-file-compressed 18248722 / 17869242 / +2.1% 26080727 / 26018319 / +0.2% 0.70 / 0.69 / +1.9%
tpcds_q32/duckdb:vortex-file-compressed 10391926 / 10445140 / -0.5% 18464146 / 18389816 / +0.4% 0.56 / 0.57 / -0.9%
tpcds_q33/duckdb:vortex-file-compressed 18040304 / 17732877 / +1.7% 28113242 / 28363600 / -0.9% 0.64 / 0.63 / +2.6%
tpcds_q34/duckdb:vortex-file-compressed 13263975 / 12818871 / +3.5% 22031678 / 22421085 / -1.7% 0.60 / 0.57 / +5.3%
tpcds_q35/duckdb:vortex-file-compressed 30805861 / 31030149 / -0.7% 42993079 / 44094491 / -2.5% 0.72 / 0.70 / +1.8%
tpcds_q36/duckdb:vortex-file-compressed 14202230 / 14096882 / +0.7% 24361673 / 24229993 / +0.5% 0.58 / 0.58 / +0.2%
tpcds_q37/duckdb:vortex-file-compressed 9843579 / 9844538 / -0.0% 26725316 / 25401145 / +5.2% 0.37 / 0.39 / -5.0%
tpcds_q38/duckdb:vortex-file-compressed 24630462 / 24299488 / +1.4% 31592815 / 31853582 / -0.8% 0.78 / 0.76 / +2.2%
tpcds_q39/duckdb:vortex-file-compressed 19330765 / 19609497 / -1.4% 32959298 / 32479064 / +1.5% 0.59 / 0.60 / -2.9%
tpcds_q40/duckdb:vortex-file-compressed 11006422 / 11232802 / -2.0% 19873450 / 19691550 / +0.9% 0.55 / 0.57 / -2.9%
tpcds_q41/duckdb:vortex-file-compressed 17494890 / 17309274 / +1.1% 23851002 / 23931086 / -0.3% 0.73 / 0.72 / +1.4%
tpcds_q42/duckdb:vortex-file-compressed 6922954 / 6793297 / +1.9% 15583328 / 15555415 / +0.2% 0.44 / 0.44 / +1.7%
tpcds_q43/duckdb:vortex-file-compressed 9768010 / 9675598 / +1.0% 18940354 / 18839730 / +0.5% 0.52 / 0.51 / +0.4%
tpcds_q44/duckdb:vortex-file-compressed 12894998 / 12784414 / +0.9% 24742514 / 25134090 / -1.6% 0.52 / 0.51 / +2.5%
tpcds_q45/duckdb:vortex-file-compressed 23884766 / 23883250 / +0.0% 30557988 / 31026335 / -1.5% 0.78 / 0.77 / +1.5%
tpcds_q46/duckdb:vortex-file-compressed 31545857 / 31434921 / +0.4% 43821611 / 43487662 / +0.8% 0.72 / 0.72 / -0.4%
tpcds_q47/duckdb:vortex-file-compressed 30938912 / 30632259 / +1.0% 40599151 / 41501393 / -2.2% 0.76 / 0.74 / +3.2%
tpcds_q48/duckdb:vortex-file-compressed 22625590 / 22592041 / +0.1% 35439565 / 37222108 / -4.8% 0.64 / 0.61 / +5.2%
tpcds_q49/duckdb:vortex-file-compressed 18467552 / 18322068 / +0.8% 29306943 / 30928449 / -5.2% 0.63 / 0.59 / +6.4%
tpcds_q50/duckdb:vortex-file-compressed 14944003 / 14983409 / -0.3% 24257769 / 27340423 / -11.3% 🟢 0.62 / 0.55 / +12.4%
tpcds_q51/duckdb:vortex-file-compressed 49220712 / 49161851 / +0.1% 58335279 / 59729306 / -2.3% 0.84 / 0.82 / +2.5%
tpcds_q52/duckdb:vortex-file-compressed 7049450 / 6981268 / +1.0% 15768417 / 16278010 / -3.1% 0.45 / 0.43 / +4.2%
tpcds_q53/duckdb:vortex-file-compressed 11551192 / 11267339 / +2.5% 20193855 / 20062956 / +0.7% 0.57 / 0.56 / +1.9%
tpcds_q54/duckdb:vortex-file-compressed 19917356 / 19994896 / -0.4% 29763411 / 30179635 / -1.4% 0.67 / 0.66 / +1.0%
tpcds_q55/duckdb:vortex-file-compressed 6918955 / 6788880 / +1.9% 15151576 / 16101703 / -5.9% 0.46 / 0.42 / +8.3%
tpcds_q56/duckdb:vortex-file-compressed 17934408 / 18701545 / -4.1% 28050253 / 28711583 / -2.3% 0.64 / 0.65 / -1.8%
tpcds_q57/duckdb:vortex-file-compressed 25657240 / 25353327 / +1.2% 33865581 / 34687673 / -2.4% 0.76 / 0.73 / +3.7%
tpcds_q58/duckdb:vortex-file-compressed 20453437 / 20479752 / -0.1% 30925146 / 31186599 / -0.8% 0.66 / 0.66 / +0.7%
tpcds_q59/duckdb:vortex-file-compressed 19548909 / 19427672 / +0.6% 26976230 / 26843091 / +0.5% 0.72 / 0.72 / +0.1%
tpcds_q60/duckdb:vortex-file-compressed 18588074 / 18599638 / -0.1% 27830747 / 28582098 / -2.6% 0.67 / 0.65 / +2.6%
tpcds_q61/duckdb:vortex-file-compressed 20091920 / 19998388 / +0.5% 30684547 / 31444142 / -2.4% 0.65 / 0.64 / +3.0%
tpcds_q62/duckdb:vortex-file-compressed 11263192 / 11367574 / -0.9% 18460106 / 18982693 / -2.8% 0.61 / 0.60 / +1.9%
tpcds_q63/duckdb:vortex-file-compressed 10992374 / 10912253 / +0.7% 19829048 / 19057101 / +4.1% 0.55 / 0.57 / -3.2%
tpcds_q64/duckdb:vortex-file-compressed 52902547 / 51939750 / +1.9% 67578291 / 69493781 / -2.8% 0.78 / 0.75 / +4.7%
tpcds_q65/duckdb:vortex-file-compressed 13149072 / 12758646 / +3.1% 22698247 / 23117906 / -1.8% 0.58 / 0.55 / +5.0%
tpcds_q66/duckdb:vortex-file-compressed 31032600 / 32662078 / -5.0% 37629479 / 39475687 / -4.7% 0.82 / 0.83 / -0.3%
tpcds_q67/duckdb:vortex-file-compressed 55151249 / 55260231 / -0.2% 64398037 / 64955234 / -0.9% 0.86 / 0.85 / +0.7%
tpcds_q68/duckdb:vortex-file-compressed 23061830 / 22924902 / +0.6% 35050921 / 35192342 / -0.4% 0.66 / 0.65 / +1.0%
tpcds_q69/duckdb:vortex-file-compressed 22517678 / 22809916 / -1.3% 36708345 / 36355878 / +1.0% 0.61 / 0.63 / -2.2%
tpcds_q70/duckdb:vortex-file-compressed 14670500 / 14551981 / +0.8% 25310619 / 26014801 / -2.7% 0.58 / 0.56 / +3.6%
tpcds_q71/duckdb:vortex-file-compressed 14002218 / 14445859 / -3.1% 23008375 / 23531827 / -2.2% 0.61 / 0.61 / -0.9%
tpcds_q72/duckdb:vortex-file-compressed 43272426 / 43625218 / -0.8% 55968028 / 57180932 / -2.1% 0.77 / 0.76 / +1.3%
tpcds_q73/duckdb:vortex-file-compressed 11909262 / 12052644 / -1.2% 21428432 / 21109572 / +1.5% 0.56 / 0.57 / -2.7%
tpcds_q74/duckdb:vortex-file-compressed 31512798 / 31226532 / +0.9% 39340912 / 40885399 / -3.8% 0.80 / 0.76 / +4.9%
tpcds_q75/duckdb:vortex-file-compressed 36848346 / 37198383 / -0.9% 49127131 / 50976831 / -3.6% 0.75 / 0.73 / +2.8%
tpcds_q76/duckdb:vortex-file-compressed 12877126 / 12702059 / +1.4% 22084952 / 23488092 / -6.0% 0.58 / 0.54 / +7.8%
tpcds_q77/duckdb:vortex-file-compressed 20636589 / 20600114 / +0.2% 30956000 / 32203719 / -3.9% 0.67 / 0.64 / +4.2%
tpcds_q78/duckdb:vortex-file-compressed 43103936 / 43699523 / -1.4% 52065600 / 55583815 / -6.3% 0.83 / 0.79 / +5.3%
tpcds_q79/duckdb:vortex-file-compressed 17370658 / 17125770 / +1.4% 27452896 / 28074737 / -2.2% 0.63 / 0.61 / +3.7%
tpcds_q80/duckdb:vortex-file-compressed 30148464 / 29958771 / +0.6% 43131501 / 43980835 / -1.9% 0.70 / 0.68 / +2.6%
tpcds_q81/duckdb:vortex-file-compressed 21225802 / 21427182 / -0.9% 29800534 / 30407988 / -2.0% 0.71 / 0.70 / +1.1%
tpcds_q82/duckdb:vortex-file-compressed 10533960 / 10053465 / +4.8% 25645889 / 26668887 / -3.8% 0.41 / 0.38 / +9.0%
tpcds_q83/duckdb:vortex-file-compressed 17401946 / 17412324 / -0.1% 24481674 / 24259016 / +0.9% 0.71 / 0.72 / -1.0%
tpcds_q84/duckdb:vortex-file-compressed 15778039 / 15727843 / +0.3% 23226429 / 23338055 / -0.5% 0.68 / 0.67 / +0.8%
tpcds_q85/duckdb:vortex-file-compressed 25262094 / 25230302 / +0.1% 35734757 / 37087133 / -3.6% 0.71 / 0.68 / +3.9%
tpcds_q86/duckdb:vortex-file-compressed 10381362 / 10234004 / +1.4% 16983027 / 17849359 / -4.9% 0.61 / 0.57 / +6.6%
tpcds_q87/duckdb:vortex-file-compressed 26264755 / 25929686 / +1.3% 33257605 / 33661664 / -1.2% 0.79 / 0.77 / +2.5%
tpcds_q88/duckdb:vortex-file-compressed 30182879 / 30511148 / -1.1% 38003836 / 39720459 / -4.3% 0.79 / 0.77 / +3.4%
tpcds_q89/duckdb:vortex-file-compressed 12318632 / 11779673 / +4.6% 20710831 / 20919048 / -1.0% 0.59 / 0.56 / +5.6%
tpcds_q90/duckdb:vortex-file-compressed 7838631 / 7861846 / -0.3% 14988776 / 14704391 / +1.9% 0.52 / 0.53 / -2.2%
tpcds_q91/duckdb:vortex-file-compressed 14956177 / 14562214 / +2.7% 24064922 / 24569202 / -2.1% 0.62 / 0.59 / +4.9%
tpcds_q92/duckdb:vortex-file-compressed 10976210 / 10651178 / +3.1% 19149499 / 19962494 / -4.1% 0.57 / 0.53 / +7.4%
tpcds_q93/duckdb:vortex-file-compressed 10292684 / 10134612 / +1.6% 23163121 / 23834289 / -2.8% 0.44 / 0.43 / +4.5%
tpcds_q94/duckdb:vortex-file-compressed 22019485 / 22128457 / -0.5% 32098587 / 33222700 / -3.4% 0.69 / 0.67 / +3.0%
tpcds_q95/duckdb:vortex-file-compressed 60706102 / 60736772 / -0.1% 67848286 / 69948171 / -3.0% 0.89 / 0.87 / +3.0%
tpcds_q96/duckdb:vortex-file-compressed 6714996 / 6396328 / +5.0% 15018290 / 15985008 / -6.0% 0.45 / 0.40 / +11.7%
tpcds_q97/duckdb:vortex-file-compressed 23470342 / 23222665 / +1.1% 31268617 / 32515988 / -3.8% 0.75 / 0.71 / +5.1%
tpcds_q98/duckdb:vortex-file-compressed 11313870 / 11195368 / +1.1% 18545549 / 19219492 / -3.5% 0.61 / 0.58 / +4.7%
tpcds_q99/duckdb:vortex-file-compressed 14535900 / 14643890 / -0.7% 22435756 / 22992975 / -2.4% 0.65 / 0.64 / +1.7%
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23927938 / 23993272 / -0.3% 30938506 / 31017328 / -0.3% 0.77 / 0.77 / -0.0%
tpcds_q02/duckdb:parquet 18002710 / 17861354 / +0.8% 23774052 / 24242419 / -1.9% 0.76 / 0.74 / +2.8%
tpcds_q03/duckdb:parquet 9973030 / 9919218 / +0.5% 15805768 / 15696933 / +0.7% 0.63 / 0.63 / -0.1%
tpcds_q04/duckdb:parquet 118300892 / 117164704 / +1.0% 126326625 / 125870653 / +0.4% 0.94 / 0.93 / +0.6%
tpcds_q05/duckdb:parquet 28386806 / 28098910 / +1.0% 32749555 / 32770980 / -0.1% 0.87 / 0.86 / +1.1%
tpcds_q06/duckdb:parquet 26634336 / 26372178 / +1.0% 35737933 / 35350798 / +1.1% 0.75 / 0.75 / -0.1%
tpcds_q07/duckdb:parquet 30901263 / 32355026 / -4.5% 38354607 / 38463680 / -0.3% 0.81 / 0.84 / -4.2%
tpcds_q08/duckdb:parquet 20099000 / 19589864 / +2.6% 26490161 / 24838798 / +6.6% 0.76 / 0.79 / -3.8%
tpcds_q09/duckdb:parquet 26759970 / 26428399 / +1.3% 29590183 / 30897711 / -4.2% 0.90 / 0.86 / +5.7%
tpcds_q10/duckdb:parquet 33185366 / 32777236 / +1.2% 40072234 / 40044825 / +0.1% 0.83 / 0.82 / +1.2%
tpcds_q11/duckdb:parquet 68081304 / 68476230 / -0.6% 75691655 / 77053057 / -1.8% 0.90 / 0.89 / +1.2%
tpcds_q12/duckdb:parquet 14170211 / 13954478 / +1.5% 18887615 / 19186897 / -1.6% 0.75 / 0.73 / +3.2%
tpcds_q13/duckdb:parquet 32491200 / 30140124 / +7.8% 38854298 / 38873556 / -0.0% 0.84 / 0.78 / +7.9%
tpcds_q14/duckdb:parquet 66228897 / 64838960 / +2.1% 68564395 / 68125173 / +0.6% 0.97 / 0.95 / +1.5%
tpcds_q15/duckdb:parquet 16629008 / 16594544 / +0.2% 22368625 / 22749329 / -1.7% 0.74 / 0.73 / +1.9%
tpcds_q16/duckdb:parquet 30318155 / 30013369 / +1.0% 37525506 / 37217539 / +0.8% 0.81 / 0.81 / +0.2%
tpcds_q17/duckdb:parquet 34523632 / 34188894 / +1.0% 40515276 / 39765057 / +1.9% 0.85 / 0.86 / -0.9%
tpcds_q18/duckdb:parquet 47795880 / 46911602 / +1.9% 54770355 / 54812213 / -0.1% 0.87 / 0.86 / +2.0%
tpcds_q19/duckdb:parquet 18766006 / 18671098 / +0.5% 25810262 / 25495520 / +1.2% 0.73 / 0.73 / -0.7%
tpcds_q20/duckdb:parquet 15105597 / 14848960 / +1.7% 19548080 / 19579488 / -0.2% 0.77 / 0.76 / +1.9%
tpcds_q21/duckdb:parquet 10591982 / 10638532 / -0.4% 16444918 / 17128157 / -4.0% 0.64 / 0.62 / +3.7%
tpcds_q22/duckdb:parquet 21042493 / 20588084 / +2.2% 26582301 / 26745923 / -0.6% 0.79 / 0.77 / +2.8%
tpcds_q23/duckdb:parquet 42745508 / 43212620 / -1.1% 50389329 / 47185122 / +6.8% 0.85 / 0.92 / -7.4%
tpcds_q24/duckdb:parquet 32167558 / 30165460 / +6.6% 36754736 / 36866227 / -0.3% 0.88 / 0.82 / +7.0%
tpcds_q25/duckdb:parquet 30654282 / 30384990 / +0.9% 36680007 / 37377516 / -1.9% 0.84 / 0.81 / +2.8%
tpcds_q26/duckdb:parquet 29136796 / 28800104 / +1.2% 34872359 / 35437625 / -1.6% 0.84 / 0.81 / +2.8%
tpcds_q27/duckdb:parquet 34745611 / 35225814 / -1.4% 41918097 / 41479754 / +1.1% 0.83 / 0.85 / -2.4%
tpcds_q28/duckdb:parquet 26448288 / 25653510 / +3.1% 34289785 / 35318212 / -2.9% 0.77 / 0.73 / +6.2%
tpcds_q29/duckdb:parquet 32725460 / 31881220 / +2.6% 38861921 / 39329360 / -1.2% 0.84 / 0.81 / +3.9%
tpcds_q30/duckdb:parquet 35804701 / 35145400 / +1.9% 45219811 / 44275655 / +2.1% 0.79 / 0.79 / -0.3%
tpcds_q31/duckdb:parquet 35855510 / 35547370 / +0.9% 42965606 / 42788337 / +0.4% 0.83 / 0.83 / +0.5%
tpcds_q32/duckdb:parquet 14233132 / 14172346 / +0.4% 20627933 / 20737007 / -0.5% 0.69 / 0.68 / +1.0%
tpcds_q33/duckdb:parquet 24569178 / 24292464 / +1.1% 29071281 / 28817430 / +0.9% 0.85 / 0.84 / +0.3%
tpcds_q34/duckdb:parquet 17111439 / 17150278 / -0.2% 24415004 / 24314514 / +0.4% 0.70 / 0.71 / -0.6%
tpcds_q35/duckdb:parquet 35077360 / 34927944 / +0.4% 43985202 / 44136639 / -0.3% 0.80 / 0.79 / +0.8%
tpcds_q36/duckdb:parquet 41986008 / 40823224 / +2.8% 47104037 / 47345235 / -0.5% 0.89 / 0.86 / +3.4%
tpcds_q37/duckdb:parquet 12711892 / 12630832 / +0.6% 19227714 / 19701366 / -2.4% 0.66 / 0.64 / +3.1%
tpcds_q38/duckdb:parquet 30087394 / 29601931 / +1.6% 35187657 / 33705405 / +4.4% 0.86 / 0.88 / -2.6%
tpcds_q39/duckdb:parquet 23574756 / 23152192 / +1.8% 30263982 / 29376123 / +3.0% 0.78 / 0.79 / -1.2%
tpcds_q40/duckdb:parquet 15975427 / 15926147 / +0.3% 20990299 / 21791675 / -3.7% 0.76 / 0.73 / +4.1%
tpcds_q41/duckdb:parquet 12053988 / 11949064 / +0.9% 18320913 / 17501169 / +4.7% 0.66 / 0.68 / -3.6%
tpcds_q42/duckdb:parquet 9584872 / 9514996 / +0.7% 15550926 / 16233916 / -4.2% 0.62 / 0.59 / +5.2%
tpcds_q43/duckdb:parquet 12058944 / 11963960 / +0.8% 18084274 / 17776247 / +1.7% 0.67 / 0.67 / -0.9%
tpcds_q44/duckdb:parquet 21205235 / 22807810 / -7.0% 27462127 / 26645358 / +3.1% 0.77 / 0.86 / -9.8%
tpcds_q45/duckdb:parquet 21129012 / 20698650 / +2.1% 27441195 / 27592389 / -0.5% 0.77 / 0.75 / +2.6%
tpcds_q46/duckdb:parquet 36766408 / 35201466 / +4.4% 43660929 / 43536320 / +0.3% 0.84 / 0.81 / +4.1%
tpcds_q47/duckdb:parquet 35976800 / 34156556 / +5.3% 41503124 / 40893691 / +1.5% 0.87 / 0.84 / +3.8%
tpcds_q48/duckdb:parquet 29748743 / 29263563 / +1.7% 36592863 / 36405734 / +0.5% 0.81 / 0.80 / +1.1%
tpcds_q49/duckdb:parquet 30075424 / 29513960 / +1.9% 35553346 / 36055889 / -1.4% 0.85 / 0.82 / +3.3%
tpcds_q50/duckdb:parquet 19371243 / 19558272 / -1.0% 25540173 / 25398288 / +0.6% 0.76 / 0.77 / -1.5%
tpcds_q51/duckdb:parquet 52437304 / 52612432 / -0.3% 61188548 / 58747627 / +4.2% 0.86 / 0.90 / -4.3%
tpcds_q52/duckdb:parquet 9702251 / 9571456 / +1.4% 15712053 / 15601463 / +0.7% 0.62 / 0.61 / +0.7%
tpcds_q53/duckdb:parquet 15001014 / 13785832 / +8.8% 20755877 / 20933496 / -0.8% 0.72 / 0.66 / +9.7%
tpcds_q54/duckdb:parquet 24944395 / 24718568 / +0.9% 32025823 / 32061188 / -0.1% 0.78 / 0.77 / +1.0%
tpcds_q55/duckdb:parquet 9568134 / 9375315 / +2.1% 15561465 / 15249725 / +2.0% 0.61 / 0.61 / +0.0%
tpcds_q56/duckdb:parquet 25972224 / 26705728 / -2.7% 30026880 / 30756753 / -2.4% 0.86 / 0.87 / -0.4%
tpcds_q57/duckdb:parquet 30631860 / 30356678 / +0.9% 36183168 / 36154758 / +0.1% 0.85 / 0.84 / +0.8%
tpcds_q58/duckdb:parquet 25876656 / 24284922 / +6.6% 30220610 / 29284348 / +3.2% 0.86 / 0.83 / +3.3%
tpcds_q59/duckdb:parquet 22614322 / 22677524 / -0.3% 29065479 / 28585952 / +1.7% 0.78 / 0.79 / -1.9%
tpcds_q60/duckdb:parquet 26657788 / 27712731 / -3.8% 32442480 / 31835413 / +1.9% 0.82 / 0.87 / -5.6%
tpcds_q61/duckdb:parquet 24688181 / 25052707 / -1.5% 28873697 / 29145260 / -0.9% 0.86 / 0.86 / -0.5%
tpcds_q62/duckdb:parquet 12828226 / 12905044 / -0.6% 17631987 / 17919170 / -1.6% 0.73 / 0.72 / +1.0%
tpcds_q63/duckdb:parquet 13220248 / 13141136 / +0.6% 19808729 / 19852484 / -0.2% 0.67 / 0.66 / +0.8%
tpcds_q64/duckdb:parquet 72014953 / 70393644 / +2.3% 80002710 / 81582676 / -1.9% 0.90 / 0.86 / +4.3%
tpcds_q65/duckdb:parquet 20278153 / 19438016 / +4.3% 26367793 / 25679395 / +2.7% 0.77 / 0.76 / +1.6%
tpcds_q66/duckdb:parquet 33432690 / 33221336 / +0.6% 37948186 / 38205776 / -0.7% 0.88 / 0.87 / +1.3%
tpcds_q67/duckdb:parquet 60676986 / 60653521 / +0.0% 67128640 / 67471860 / -0.5% 0.90 / 0.90 / +0.6%
tpcds_q68/duckdb:parquet 29990770 / 28175192 / +6.4% 36128321 / 36063564 / +0.2% 0.83 / 0.78 / +6.3%
tpcds_q69/duckdb:parquet 26078768 / 25677424 / +1.6% 34404092 / 34599666 / -0.6% 0.76 / 0.74 / +2.1%
tpcds_q70/duckdb:parquet 19410886 / 19139774 / +1.4% 26785297 / 26912424 / -0.5% 0.72 / 0.71 / +1.9%
tpcds_q71/duckdb:parquet 16960492 / 18331078 / -7.5% 23976067 / 23937136 / +0.2% 0.71 / 0.77 / -7.6%
tpcds_q72/duckdb:parquet 52748672 / 52868966 / -0.2% 59178127 / 59733187 / -0.9% 0.89 / 0.89 / +0.7%
tpcds_q73/duckdb:parquet 16694783 / 16023036 / +4.2% 21416692 / 21564827 / -0.7% 0.78 / 0.74 / +4.9%
tpcds_q74/duckdb:parquet 84794042 / 84438536 / +0.4% 91491168 / 91285738 / +0.2% 0.93 / 0.92 / +0.2%
tpcds_q75/duckdb:parquet 45110556 / 44406848 / +1.6% 50118211 / 49680412 / +0.9% 0.90 / 0.89 / +0.7%
tpcds_q76/duckdb:parquet 19244920 / 19344888 / -0.5% 22962684 / 23464548 / -2.1% 0.84 / 0.82 / +1.7%
tpcds_q77/duckdb:parquet 24885276 / 25811932 / -3.6% 31124223 / 30967118 / +0.5% 0.80 / 0.83 / -4.1%
tpcds_q78/duckdb:parquet 78196590 / 78615622 / -0.5% 85871620 / 85001453 / +1.0% 0.91 / 0.92 / -1.5%
tpcds_q79/duckdb:parquet 24112339 / 22566732 / +6.8% 28929425 / 28603184 / +1.1% 0.83 / 0.79 / +5.6%
tpcds_q80/duckdb:parquet 37893792 / 37629026 / +0.7% 43680053 / 43268386 / +1.0% 0.87 / 0.87 / -0.2%
tpcds_q81/duckdb:parquet 36655387 / 36103182 / +1.5% 45127950 / 44988648 / +0.3% 0.81 / 0.80 / +1.2%
tpcds_q82/duckdb:parquet 13752146 / 13249048 / +3.8% 20327049 / 20359866 / -0.2% 0.68 / 0.65 / +4.0%
tpcds_q83/duckdb:parquet 20324354 / 20198756 / +0.6% 25379886 / 24684116 / +2.8% 0.80 / 0.82 / -2.1%
tpcds_q84/duckdb:parquet 22612022 / 22813764 / -0.9% 28554617 / 28477344 / +0.3% 0.79 / 0.80 / -1.2%
tpcds_q85/duckdb:parquet 32559540 / 32186971 / +1.2% 39032616 / 39252382 / -0.6% 0.83 / 0.82 / +1.7%
tpcds_q86/duckdb:parquet 11839516 / 11815521 / +0.2% 17074343 / 17190846 / -0.7% 0.69 / 0.69 / +0.9%
tpcds_q87/duckdb:parquet 31146046 / 31093874 / +0.2% 36057186 / 35194619 / +2.5% 0.86 / 0.88 / -2.2%
tpcds_q88/duckdb:parquet 38578841 / 39066738 / -1.2% 43770112 / 43127450 / +1.5% 0.88 / 0.91 / -2.7%
tpcds_q89/duckdb:parquet 14825256 / 15426974 / -3.9% 21927621 / 21303473 / +2.9% 0.68 / 0.72 / -6.6%
tpcds_q90/duckdb:parquet 10115073 / 9985410 / +1.3% 15509017 / 15219231 / +1.9% 0.65 / 0.66 / -0.6%
tpcds_q91/duckdb:parquet 21154081 / 20948609 / +1.0% 28229364 / 28241071 / -0.0% 0.75 / 0.74 / +1.0%
tpcds_q92/duckdb:parquet 15794408 / 15571232 / +1.4% 22391275 / 22227599 / +0.7% 0.71 / 0.70 / +0.7%
tpcds_q93/duckdb:parquet 14151845 / 14026861 / +0.9% 20473746 / 20371462 / +0.5% 0.69 / 0.69 / +0.4%
tpcds_q94/duckdb:parquet 25609800 / 25258316 / +1.4% 33050370 / 32663861 / +1.2% 0.77 / 0.77 / +0.2%
tpcds_q95/duckdb:parquet 43906633 / 43656083 / +0.6% 49735398 / 48981323 / +1.5% 0.88 / 0.89 / -1.0%
tpcds_q96/duckdb:parquet 8227616 / 8623489 / -4.6% 14058959 / 13692950 / +2.7% 0.59 / 0.63 / -7.1%
tpcds_q97/duckdb:parquet 27734738 / 27436296 / +1.1% 34041123 / 33943266 / +0.3% 0.81 / 0.81 / +0.8%
tpcds_q98/duckdb:parquet 16761632 / 16341622 / +2.6% 22575317 / 23050864 / -2.1% 0.74 / 0.71 / +4.7%
tpcds_q99/duckdb:parquet 18817025 / 18685366 / +0.7% 25210148 / 24749146 / +1.9% 0.75 / 0.75 / -1.1%

No baseline file sizes found for base commit.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR abc04be5 vs base 64808453
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.962x ➖
Parquet (geomean): hot 0.994x ➖ · cold 0.980x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1210794 / 1205442 / +0.4% 21827826 / 24033622 / -9.2% 0.06 / 0.05 / +10.6%
clickbench_q01/datafusion:vortex-file-compressed 5832108 / 5740966 / +1.6% 29161282 / 30794703 / -5.3% 0.20 / 0.19 / +7.3%
clickbench_q02/datafusion:vortex-file-compressed 10820032 / 10924060 / -1.0% 43768580 / 45684096 / -4.2% 0.25 / 0.24 / +3.4%
clickbench_q03/datafusion:vortex-file-compressed 12820558 / 13028278 / -1.6% 50248580 / 57904251 / -13.2% 🟢 0.26 / 0.22 / +13.4%
clickbench_q04/datafusion:vortex-file-compressed 56629957 / 60313872 / -6.1% 97666623 / 104937907 / -6.9% 0.58 / 0.57 / +0.9%
clickbench_q05/datafusion:vortex-file-compressed 80289736 / 80929260 / -0.8% 128181599 / 133758736 / -4.2% 0.63 / 0.61 / +3.5%
clickbench_q06/datafusion:vortex-file-compressed 1239590 / 1223508 / +1.3% 22577583 / 23965392 / -5.8% 0.05 / 0.05 / +7.5%
clickbench_q07/datafusion:vortex-file-compressed 9159435 / 9235059 / -0.8% 33894740 / 34406312 / -1.5% 0.27 / 0.27 / +0.7%
clickbench_q08/datafusion:vortex-file-compressed 80077748 / 77215909 / +3.7% 124621861 / 131567487 / -5.3% 0.64 / 0.59 / +9.5%
clickbench_q09/datafusion:vortex-file-compressed 174103168 / 167007727 / +4.2% 205815205 / 217156366 / -5.2% 0.85 / 0.77 / +10.0%
clickbench_q10/datafusion:vortex-file-compressed 22612408 / 22926567 / -1.4% 64638159 / 69812214 / -7.4% 0.35 / 0.33 / +6.5%
clickbench_q11/datafusion:vortex-file-compressed 23781636 / 24194012 / -1.7% 67188038 / 69444504 / -3.2% 0.35 / 0.35 / +1.6%
clickbench_q12/datafusion:vortex-file-compressed 74040834 / 75191520 / -1.5% 120859711 / 130558787 / -7.4% 0.61 / 0.58 / +6.4%
clickbench_q13/datafusion:vortex-file-compressed 115994546 / 115821656 / +0.1% 177243340 / 195540587 / -9.4% 0.65 / 0.59 / +10.5%
clickbench_q14/datafusion:vortex-file-compressed 77073736 / 77734208 / -0.8% 124834854 / 129058377 / -3.3% 0.62 / 0.60 / +2.5%
clickbench_q15/datafusion:vortex-file-compressed 64091304 / 64569630 / -0.7% 99428804 / 107153727 / -7.2% 0.64 / 0.60 / +7.0%
clickbench_q16/datafusion:vortex-file-compressed 152627137 / 155106756 / -1.6% 210386788 / 219191643 / -4.0% 0.73 / 0.71 / +2.5%
clickbench_q17/datafusion:vortex-file-compressed 156303306 / 155443082 / +0.6% 223207402 / 224189499 / -0.4% 0.70 / 0.69 / +1.0%
clickbench_q18/datafusion:vortex-file-compressed 294639340 / 290995542 / +1.3% 386756269 / 387405582 / -0.2% 0.76 / 0.75 / +1.4%
clickbench_q19/datafusion:vortex-file-compressed 7123918 / 7228089 / -1.4% 42859911 / 46390786 / -7.6% 0.17 / 0.16 / +6.7%
clickbench_q20/datafusion:vortex-file-compressed 69917989 / 69802694 / +0.2% 244288633 / 245434110 / -0.5% 0.29 / 0.28 / +0.6%
clickbench_q21/datafusion:vortex-file-compressed 75150883 / 79092060 / -5.0% 293973368 / 287742626 / +2.2% 0.26 / 0.27 / -7.0%
clickbench_q22/datafusion:vortex-file-compressed 90685386 / 89842660 / +0.9% 394859375 / 396389606 / -0.4% 0.23 / 0.23 / +1.3%
clickbench_q23/datafusion:vortex-file-compressed 87359541 / 93277478 / -6.3% 398817954 / 389793978 / +2.3% 0.22 / 0.24 / -8.5%
clickbench_q24/datafusion:vortex-file-compressed 8747320 / 8836552 / -1.0% 57403950 / 66571649 / -13.8% 🟢 0.15 / 0.13 / +14.8%
clickbench_q25/datafusion:vortex-file-compressed 17781120 / 18356787 / -3.1% 57156570 / 66043074 / -13.5% 🟢 0.31 / 0.28 / +11.9%
clickbench_q26/datafusion:vortex-file-compressed 14781500 / 13562380 / +9.0% 68286005 / 67661539 / +0.9% 0.22 / 0.20 / +8.0%
clickbench_q27/datafusion:vortex-file-compressed 96048461 / 98735396 / -2.7% 250273032 / 252590794 / -0.9% 0.38 / 0.39 / -1.8%
clickbench_q28/datafusion:vortex-file-compressed 547467084 / 553255376 / -1.0% 639015516 / 641859241 / -0.4% 0.86 / 0.86 / -0.6%
clickbench_q29/datafusion:vortex-file-compressed 24689166 / 24471186 / +0.9% 54037923 / 55410613 / -2.5% 0.46 / 0.44 / +3.5%
clickbench_q30/datafusion:vortex-file-compressed 54880604 / 55465638 / -1.1% 110466623 / 110909330 / -0.4% 0.50 / 0.50 / -0.7%
clickbench_q31/datafusion:vortex-file-compressed 65540374 / 65167067 / +0.6% 160321324 / 159193184 / +0.7% 0.41 / 0.41 / -0.1%
clickbench_q32/datafusion:vortex-file-compressed 287754149 / 296240456 / -2.9% 387603983 / 391716019 / -1.0% 0.74 / 0.76 / -1.8%
clickbench_q33/datafusion:vortex-file-compressed 320298243 / 320018382 / +0.1% 440865785 / 432789411 / +1.9% 0.73 / 0.74 / -1.7%
clickbench_q34/datafusion:vortex-file-compressed 320036404 / 323206142 / -1.0% 435747876 / 433809545 / +0.4% 0.73 / 0.75 / -1.4%
clickbench_q35/datafusion:vortex-file-compressed 57289912 / 58108322 / -1.4% 90532724 / 97786209 / -7.4% 0.63 / 0.59 / +6.5%
clickbench_q36/datafusion:vortex-file-compressed 37241256 / 37637351 / -1.1% 65806084 / 69699612 / -5.6% 0.57 / 0.54 / +4.8%
clickbench_q37/datafusion:vortex-file-compressed 20864485 / 20600294 / +1.3% 46311640 / 49573254 / -6.6% 0.45 / 0.42 / +8.4%
clickbench_q38/datafusion:vortex-file-compressed 12370235 / 12772438 / -3.1% 39798043 / 42951958 / -7.3% 0.31 / 0.30 / +4.5%
clickbench_q39/datafusion:vortex-file-compressed 78701380 / 78715417 / -0.0% 110086490 / 114533734 / -3.9% 0.71 / 0.69 / +4.0%
clickbench_q40/datafusion:vortex-file-compressed 9906425 / 10134752 / -2.3% 34933946 / 37757783 / -7.5% 0.28 / 0.27 / +5.6%
clickbench_q41/datafusion:vortex-file-compressed 9629142 / 9528984 / +1.1% 33980845 / 36674023 / -7.3% 0.28 / 0.26 / +9.1%
clickbench_q42/datafusion:vortex-file-compressed 9889876 / 9542299 / +3.6% 34320694 / 37506019 / -8.5% 0.29 / 0.25 / +13.3%
datafusion / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1238579 / 1246046 / -0.6% 49427165 / 50131230 / -1.4% 0.03 / 0.02 / +0.8%
clickbench_q01/datafusion:parquet 15860014 / 15767376 / +0.6% 65672890 / 68808395 / -4.6% 0.24 / 0.23 / +5.4%
clickbench_q02/datafusion:parquet 18599610 / 18739867 / -0.7% 80152265 / 83019430 / -3.5% 0.23 / 0.23 / +2.8%
clickbench_q03/datafusion:parquet 16801553 / 17357276 / -3.2% 78925863 / 80555139 / -2.0% 0.21 / 0.22 / -1.2%
clickbench_q04/datafusion:parquet 63520632 / 62656713 / +1.4% 124513152 / 126706752 / -1.7% 0.51 / 0.49 / +3.2%
clickbench_q05/datafusion:parquet 89034254 / 89497932 / -0.5% 152968828 / 157265209 / -2.7% 0.58 / 0.57 / +2.3%
clickbench_q06/datafusion:parquet 1210468 / 1244010 / -2.7% 48718738 / 52918851 / -7.9% 0.02 / 0.02 / +5.7%
clickbench_q07/datafusion:parquet 17045444 / 17085624 / -0.2% 67935496 / 68539860 / -0.9% 0.25 / 0.25 / +0.7%
clickbench_q08/datafusion:parquet 84485508 / 85350156 / -1.0% 155981132 / 161697929 / -3.5% 0.54 / 0.53 / +2.6%
clickbench_q09/datafusion:parquet 188098060 / 188404076 / -0.2% 260073150 / 274612439 / -5.3% 0.72 / 0.69 / +5.4%
clickbench_q10/datafusion:parquet 36112158 / 36543710 / -1.2% 96542443 / 103102926 / -6.4% 0.37 / 0.35 / +5.5%
clickbench_q11/datafusion:parquet 42396094 / 43537004 / -2.6% 108807231 / 112986511 / -3.7% 0.39 / 0.39 / +1.1%
clickbench_q12/datafusion:parquet 95690146 / 97077529 / -1.4% 159771461 / 165683892 / -3.6% 0.60 / 0.59 / +2.2%
clickbench_q13/datafusion:parquet 148500256 / 148119973 / +0.3% 223563479 / 233362615 / -4.2% 0.66 / 0.63 / +4.7%
clickbench_q14/datafusion:parquet 102685194 / 101442931 / +1.2% 170129144 / 176742262 / -3.7% 0.60 / 0.57 / +5.2%
clickbench_q15/datafusion:parquet 70450034 / 72117185 / -2.3% 130854627 / 131536454 / -0.5% 0.54 / 0.55 / -1.8%
clickbench_q16/datafusion:parquet 156771840 / 157730510 / -0.6% 235015727 / 241916871 / -2.9% 0.67 / 0.65 / +2.3%
clickbench_q17/datafusion:parquet 157443244 / 156840059 / +0.4% 235848977 / 236653137 / -0.3% 0.67 / 0.66 / +0.7%
clickbench_q18/datafusion:parquet 307415420 / 310236411 / -0.9% 417953512 / 430377164 / -2.9% 0.74 / 0.72 / +2.0%
clickbench_q19/datafusion:parquet 18582966 / 18807833 / -1.2% 69174574 / 78707141 / -12.1% 🟢 0.27 / 0.24 / +12.4%
clickbench_q20/datafusion:parquet 178092358 / 180601676 / -1.4% 273807076 / 298533503 / -8.3% 0.65 / 0.60 / +7.5%
clickbench_q21/datafusion:parquet 172449400 / 172253270 / +0.1% 289292660 / 317303212 / -8.8% 0.60 / 0.54 / +9.8%
clickbench_q22/datafusion:parquet 258135422 / 262444127 / -1.6% 414964771 / 454986639 / -8.8% 0.62 / 0.58 / +7.8%
clickbench_q23/datafusion:parquet 1009225350 / 1014661149 / -0.5% 1186121832 / 1225152723 / -3.2% 0.85 / 0.83 / +2.7%
clickbench_q24/datafusion:parquet 30293186 / 30254725 / +0.1% 87446920 / 91151860 / -4.1% 0.35 / 0.33 / +4.4%
clickbench_q25/datafusion:parquet 36142754 / 36966308 / -2.2% 98799767 / 105359861 / -6.2% 0.37 / 0.35 / +4.3%
clickbench_q26/datafusion:parquet 30118160 / 30948017 / -2.7% 87289149 / 94481297 / -7.6% 0.35 / 0.33 / +5.3%
clickbench_q27/datafusion:parquet 192644145 / 192646707 / -0.0% 281615666 / 299333952 / -5.9% 0.68 / 0.64 / +6.3%
clickbench_q28/datafusion:parquet 615597784 / 618927318 / -0.5% 696391780 / 717314384 / -2.9% 0.88 / 0.86 / +2.5%
clickbench_q29/datafusion:parquet 28420416 / 28925726 / -1.7% 89509201 / 91399903 / -2.1% 0.32 / 0.32 / +0.3%
clickbench_q30/datafusion:parquet 88621918 / 89819964 / -1.3% 169687111 / 179502744 / -5.5% 0.52 / 0.50 / +4.4%
clickbench_q31/datafusion:parquet 101596605 / 103561028 / -1.9% 189113682 / 200218899 / -5.5% 0.54 / 0.52 / +3.9%
clickbench_q32/datafusion:parquet 306966116 / 310066655 / -1.0% 421429066 / 431021282 / -2.2% 0.73 / 0.72 / +1.3%
clickbench_q33/datafusion:parquet 376430381 / 377996374 / -0.4% 466971016 / 477985171 / -2.3% 0.81 / 0.79 / +1.9%
clickbench_q34/datafusion:parquet 374813379 / 377686588 / -0.8% 470056087 / 476260952 / -1.3% 0.80 / 0.79 / +0.5%
clickbench_q35/datafusion:parquet 64290454 / 64690851 / -0.6% 124628908 / 124106845 / +0.4% 0.52 / 0.52 / -1.0%
clickbench_q36/datafusion:parquet 73339890 / 74441223 / -1.5% 135339168 / 138311114 / -2.1% 0.54 / 0.54 / +0.7%
clickbench_q37/datafusion:parquet 35561732 / 35465304 / +0.3% 93505511 / 93152754 / +0.4% 0.38 / 0.38 / -0.1%
clickbench_q38/datafusion:parquet 47490745 / 48095980 / -1.3% 106578133 / 110095318 / -3.2% 0.45 / 0.44 / +2.0%
clickbench_q39/datafusion:parquet 143198746 / 144183540 / -0.7% 206141860 / 213071035 / -3.3% 0.69 / 0.68 / +2.7%
clickbench_q40/datafusion:parquet 19629390 / 20014066 / -1.9% 76733707 / 79052120 / -2.9% 0.26 / 0.25 / +1.0%
clickbench_q41/datafusion:parquet 18530647 / 18973698 / -2.3% 75977172 / 77475719 / -1.9% 0.24 / 0.24 / -0.4%
clickbench_q42/datafusion:parquet 19042974 / 19114188 / -0.4% 74834754 / 76031986 / -1.6% 0.25 / 0.25 / +1.2%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2198822 / 2212350 / -0.6% 24557615 / 26393071 / -7.0% 0.09 / 0.08 / +6.8%
clickbench_q01/duckdb:vortex-file-compressed 7583984 / 6918460 / +9.6% 29252923 / 26239654 / +11.5% 🔴 0.26 / 0.26 / -1.7%
clickbench_q02/duckdb:vortex-file-compressed 8912107 / 9004158 / -1.0% 32796161 / 36309269 / -9.7% 0.27 / 0.25 / +9.6%
clickbench_q03/duckdb:vortex-file-compressed 13976349 / 14086318 / -0.8% 44034792 / 48189747 / -8.6% 0.32 / 0.29 / +8.6%
clickbench_q04/duckdb:vortex-file-compressed 56117858 / 55951486 / +0.3% 87485468 / 87283466 / +0.2% 0.64 / 0.64 / +0.1%
clickbench_q05/duckdb:vortex-file-compressed 63945702 / 63666944 / +0.4% 93714083 / 95414488 / -1.8% 0.68 / 0.67 / +2.3%
clickbench_q06/duckdb:vortex-file-compressed 2562438 / 2783147 / -7.9% 31849261 / 31521362 / +1.0% 0.08 / 0.09 / -8.9%
clickbench_q07/duckdb:vortex-file-compressed 9395590 / 8956197 / +4.9% 29864024 / 30564599 / -2.3% 0.31 / 0.29 / +7.4%
clickbench_q08/duckdb:vortex-file-compressed 70918924 / 68362946 / +3.7% 103314300 / 100838700 / +2.5% 0.69 / 0.68 / +1.3%
clickbench_q09/duckdb:vortex-file-compressed 92994650 / 91570648 / +1.6% 123180903 / 127268581 / -3.2% 0.75 / 0.72 / +4.9%
clickbench_q10/duckdb:vortex-file-compressed 26654956 / 27717154 / -3.8% 59126596 / 71498527 / -17.3% 🟢 0.45 / 0.39 / +16.3%
clickbench_q11/duckdb:vortex-file-compressed 29349580 / 29901358 / -1.8% 66837573 / 74304868 / -10.0% 🟢 0.44 / 0.40 / +9.1%
clickbench_q12/duckdb:vortex-file-compressed 68895200 / 69114800 / -0.3% 97411128 / 102111558 / -4.6% 0.71 / 0.68 / +4.5%
clickbench_q13/duckdb:vortex-file-compressed 117418199 / 116289753 / +1.0% 157364806 / 163591203 / -3.8% 0.75 / 0.71 / +5.0%
clickbench_q14/duckdb:vortex-file-compressed 73296404 / 73174946 / +0.2% 103093690 / 102708335 / +0.4% 0.71 / 0.71 / -0.2%
clickbench_q15/duckdb:vortex-file-compressed 76091018 / 76153072 / -0.1% 108186045 / 109697615 / -1.4% 0.70 / 0.69 / +1.3%
clickbench_q16/duckdb:vortex-file-compressed 133137020 / 133305134 / -0.1% 167288914 / 168727742 / -0.9% 0.80 / 0.79 / +0.7%
clickbench_q17/duckdb:vortex-file-compressed 139860440 / 138295928 / +1.1% 166038929 / 170612064 / -2.7% 0.84 / 0.81 / +3.9%
clickbench_q18/duckdb:vortex-file-compressed 259908296 / 257391645 / +1.0% 303894456 / 309145583 / -1.7% 0.86 / 0.83 / +2.7%
clickbench_q19/duckdb:vortex-file-compressed 8728612 / 8938558 / -2.3% 34752235 / 39486581 / -12.0% 🟢 0.25 / 0.23 / +11.0%
clickbench_q20/duckdb:vortex-file-compressed 67061109 / 66740800 / +0.5% 161452209 / 169679875 / -4.8% 0.42 / 0.39 / +5.6%
clickbench_q21/duckdb:vortex-file-compressed 72027692 / 72912849 / -1.2% 182051794 / 181442280 / +0.3% 0.40 / 0.40 / -1.5%
clickbench_q22/duckdb:vortex-file-compressed 107190552 / 109339446 / -2.0% 297692261 / 300739456 / -1.0% 0.36 / 0.36 / -1.0%
clickbench_q23/duckdb:vortex-file-compressed 64906643 / 62617782 / +3.7% 180649742 / 180009444 / +0.4% 0.36 / 0.35 / +3.3%
clickbench_q24/duckdb:vortex-file-compressed 16851266 / 17182999 / -1.9% 45441491 / 46151811 / -1.5% 0.37 / 0.37 / -0.4%
clickbench_q25/duckdb:vortex-file-compressed 18493242 / 18205744 / +1.6% 49661428 / 54002551 / -8.0% 0.37 / 0.34 / +10.5%
clickbench_q26/duckdb:vortex-file-compressed 13900132 / 13451064 / +3.3% 45094033 / 41678053 / +8.2% 0.31 / 0.32 / -4.5%
clickbench_q27/duckdb:vortex-file-compressed 49274396 / 49662274 / -0.8% 168798346 / 175559857 / -3.9% 0.29 / 0.28 / +3.2%
clickbench_q28/duckdb:vortex-file-compressed 513112796 / 513511095 / -0.1% 554321270 / 564175941 / -1.7% 0.93 / 0.91 / +1.7%
clickbench_q29/duckdb:vortex-file-compressed 17003514 / 17118262 / -0.7% 42551597 / 44120063 / -3.6% 0.40 / 0.39 / +3.0%
clickbench_q30/duckdb:vortex-file-compressed 58397492 / 59068172 / -1.1% 100342281 / 109122885 / -8.0% 0.58 / 0.54 / +7.5%
clickbench_q31/duckdb:vortex-file-compressed 107843004 / 109230581 / -1.3% 183679305 / 200959107 / -8.6% 0.59 / 0.54 / +8.0%
clickbench_q32/duckdb:vortex-file-compressed 354022919 / 360460050 / -1.8% 397576793 / 396777993 / +0.2% 0.89 / 0.91 / -2.0%
clickbench_q33/duckdb:vortex-file-compressed 342837402 / 348787022 / -1.7% 401432578 / 405778028 / -1.1% 0.85 / 0.86 / -0.6%
clickbench_q34/duckdb:vortex-file-compressed 352902622 / 355305662 / -0.7% 412996050 / 406879093 / +1.5% 0.85 / 0.87 / -2.1%
clickbench_q35/duckdb:vortex-file-compressed 58011484 / 56719274 / +2.3% 86983812 / 88857347 / -2.1% 0.67 / 0.64 / +4.5%
clickbench_q36/duckdb:vortex-file-compressed 10903322 / 10985779 / -0.8% 31690405 / 35843290 / -11.6% 🟢 0.34 / 0.31 / +12.3%
clickbench_q37/duckdb:vortex-file-compressed 7709078 / 7566981 / +1.9% 28392884 / 28269206 / +0.4% 0.27 / 0.27 / +1.4%
clickbench_q38/duckdb:vortex-file-compressed 8034602 / 7947630 / +1.1% 28660037 / 28750032 / -0.3% 0.28 / 0.28 / +1.4%
clickbench_q39/duckdb:vortex-file-compressed 17446754 / 17981140 / -3.0% 42600544 / 42826923 / -0.5% 0.41 / 0.42 / -2.5%
clickbench_q40/duckdb:vortex-file-compressed 6840717 / 6890977 / -0.7% 29549879 / 29225575 / +1.1% 0.23 / 0.24 / -1.8%
clickbench_q41/duckdb:vortex-file-compressed 7764491 / 7790208 / -0.3% 29900396 / 30478113 / -1.9% 0.26 / 0.26 / +1.6%
clickbench_q42/duckdb:vortex-file-compressed 7071900 / 6995600 / +1.1% 27398953 / 30237471 / -9.4% 0.26 / 0.23 / +11.6%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9582882 / 9857317 / -2.8% 14081627 / 14205151 / -0.9% 0.68 / 0.69 / -1.9%
clickbench_q01/duckdb:parquet 14931090 / 15650171 / -4.6% 22174603 / 20819349 / +6.5% 0.67 / 0.75 / -10.4%
clickbench_q02/duckdb:parquet 22250766 / 22032852 / +1.0% 33157182 / 31793623 / +4.3% 0.67 / 0.69 / -3.2%
clickbench_q03/duckdb:parquet 22802454 / 22927784 / -0.5% 36025787 / 33551819 / +7.4% 0.63 / 0.68 / -7.4%
clickbench_q04/duckdb:parquet 61771780 / 61636388 / +0.2% 72115062 / 70878232 / +1.7% 0.86 / 0.87 / -1.5%
clickbench_q05/duckdb:parquet 82553351 / 82139203 / +0.5% 96554949 / 95838628 / +0.7% 0.85 / 0.86 / -0.2%
clickbench_q06/duckdb:parquet 20811780 / 20436438 / +1.8% 29267111 / 28145562 / +4.0% 0.71 / 0.73 / -2.1%
clickbench_q07/duckdb:parquet 17186028 / 17320495 / -0.8% 22894620 / 24886394 / -8.0% 0.75 / 0.70 / +7.9%
clickbench_q08/duckdb:parquet 74774953 / 75314716 / -0.7% 88767637 / 89903694 / -1.3% 0.84 / 0.84 / +0.6%
clickbench_q09/duckdb:parquet 102042024 / 102220371 / -0.2% 117657172 / 119484306 / -1.5% 0.87 / 0.86 / +1.4%
clickbench_q10/duckdb:parquet 41050896 / 41195936 / -0.4% 52312885 / 61280512 / -14.6% 🟢 0.78 / 0.67 / +16.7%
clickbench_q11/duckdb:parquet 46531364 / 46529677 / +0.0% 64913301 / 58998376 / +10.0% 🔴 0.72 / 0.79 / -9.1%
clickbench_q12/duckdb:parquet 93576007 / 92844469 / +0.8% 109430346 / 104846844 / +4.4% 0.86 / 0.89 / -3.4%
clickbench_q13/duckdb:parquet 152703958 / 149283603 / +2.3% 170751079 / 164805034 / +3.6% 0.89 / 0.91 / -1.3%
clickbench_q14/duckdb:parquet 102075868 / 100719424 / +1.3% 117795355 / 117219177 / +0.5% 0.87 / 0.86 / +0.9%
clickbench_q15/duckdb:parquet 86683508 / 86305514 / +0.4% 100212050 / 98759774 / +1.5% 0.87 / 0.87 / -1.0%
clickbench_q16/duckdb:parquet 164680350 / 160014286 / +2.9% 177550322 / 178484364 / -0.5% 0.93 / 0.90 / +3.5%
clickbench_q17/duckdb:parquet 162762290 / 163673269 / -0.6% 177722424 / 177502784 / +0.1% 0.92 / 0.92 / -0.7%
clickbench_q18/duckdb:parquet 297762868 / 294403882 / +1.1% 315369484 / 315383921 / -0.0% 0.94 / 0.93 / +1.1%
clickbench_q19/duckdb:parquet 19693082 / 19936563 / -1.2% 26368872 / 25548039 / +3.2% 0.75 / 0.78 / -4.3%
clickbench_q20/duckdb:parquet 194631721 / 181878499 / +7.0% 233388898 / 229691149 / +1.6% 0.83 / 0.79 / +5.3%
clickbench_q21/duckdb:parquet 219979559 / 221884634 / -0.9% 271615344 / 269901992 / +0.6% 0.81 / 0.82 / -1.5%
clickbench_q22/duckdb:parquet 310142000 / 306819235 / +1.1% 365066932 / 356415829 / +2.4% 0.85 / 0.86 / -1.3%
clickbench_q23/duckdb:parquet 173909134 / 174333042 / -0.2% 239855320 / 225395310 / +6.4% 0.73 / 0.77 / -6.3%
clickbench_q24/duckdb:parquet 30437193 / 30141928 / +1.0% 42828263 / 49470561 / -13.4% 🟢 0.71 / 0.61 / +16.6%
clickbench_q25/duckdb:parquet 42131683 / 41807831 / +0.8% 61105088 / 58393577 / +4.6% 0.69 / 0.72 / -3.7%
clickbench_q26/duckdb:parquet 29746449 / 30812815 / -3.5% 44376236 / 46182806 / -3.9% 0.67 / 0.67 / +0.5%
clickbench_q27/duckdb:parquet 195674122 / 192827278 / +1.5% 230765430 / 226556492 / +1.9% 0.85 / 0.85 / -0.4%
clickbench_q28/duckdb:parquet 968045482 / 960256302 / +0.8% 941118091 / 943922858 / -0.3% 1.03 / 1.02 / +1.1%
clickbench_q29/duckdb:parquet 23456463 / 24440537 / -4.0% 31916374 / 29834400 / +7.0% 0.73 / 0.82 / -10.3%
clickbench_q30/duckdb:parquet 105175644 / 106314368 / -1.1% 124724980 / 128049532 / -2.6% 0.84 / 0.83 / +1.6%
clickbench_q31/duckdb:parquet 144393372 / 136442760 / +5.8% 173806581 / 175202352 / -0.8% 0.83 / 0.78 / +6.7%
clickbench_q32/duckdb:parquet 390320058 / 385766438 / +1.2% 422237691 / 409693420 / +3.1% 0.92 / 0.94 / -1.8%
clickbench_q33/duckdb:parquet 474751788 / 488028422 / -2.7% 464201759 / 460471666 / +0.8% 1.02 / 1.06 / -3.5%
clickbench_q34/duckdb:parquet 467999094 / 478714945 / -2.2% 461357874 / 470091089 / -1.9% 1.01 / 1.02 / -0.4%
clickbench_q35/duckdb:parquet 61410644 / 61521912 / -0.2% 73723158 / 74193854 / -0.6% 0.83 / 0.83 / +0.5%
clickbench_q36/duckdb:parquet 29854203 / 30217710 / -1.2% 35407395 / 36445267 / -2.8% 0.84 / 0.83 / +1.7%
clickbench_q37/duckdb:parquet 23296778 / 23187430 / +0.5% 28914316 / 32526256 / -11.1% 🟢 0.81 / 0.71 / +13.0%
clickbench_q38/duckdb:parquet 23749304 / 23323322 / +1.8% 29075271 / 31240002 / -6.9% 0.82 / 0.75 / +9.4%
clickbench_q39/duckdb:parquet 52270511 / 52945178 / -1.3% 59455369 / 60405421 / -1.6% 0.88 / 0.88 / +0.3%
clickbench_q40/duckdb:parquet 14286100 / 14810682 / -3.5% 20101064 / 20069534 / +0.2% 0.71 / 0.74 / -3.7%
clickbench_q41/duckdb:parquet 15075044 / 16133318 / -6.6% 20921131 / 21226535 / -1.4% 0.72 / 0.76 / -5.2%
clickbench_q42/duckdb:parquet 14009676 / 14186854 / -1.2% 20304273 / 21296298 / -4.7% 0.69 / 0.67 / +3.6%

No baseline file sizes found for base commit.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR abc04be5 vs base 64808453
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.8%
Engines: DataFusion No clear signal (+11.5%, environment too noisy confidence) · DuckDB No clear signal (+6.1%, environment too noisy confidence)
Vortex (geomean): hot 1.069x ➖ · cold 1.056x ➖
Parquet (geomean): hot 0.983x ➖ · cold 1.062x ➖
Shifts: Parquet (control) -1.7% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.107x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 202364172 / 227886930 / -11.2% 684107785 / 738528554 / -7.4% 0.30 / 0.31 / -4.1%
tpch_q02/datafusion:vortex-file-compressed 327038734 / 326160569 / +0.3% 682278824 / 610470982 / +11.8% 0.48 / 0.53 / -10.3%
tpch_q03/datafusion:vortex-file-compressed 313481221 / 338971452 / -7.5% 927768514 / 840149789 / +10.4% 0.34 / 0.40 / -16.3%
tpch_q04/datafusion:vortex-file-compressed 171945247 / 207332329 / -17.1% 415550314 / 418543479 / -0.7% 0.41 / 0.50 / -16.5%
tpch_q05/datafusion:vortex-file-compressed 392270776 / 356242789 / +10.1% 543944450 / 557042154 / -2.4% 0.72 / 0.64 / +12.8%
tpch_q06/datafusion:vortex-file-compressed 129573752 / 130088496 / -0.4% 379601407 / 296818218 / +27.9% 0.34 / 0.44 / -22.1%
tpch_q07/datafusion:vortex-file-compressed 404002992 / 428773948 / -5.8% 624483743 / 706284430 / -11.6% 0.65 / 0.61 / +6.6%
tpch_q08/datafusion:vortex-file-compressed 629074364 / 433061689 / +45.3% 🔴 796939654 / 589435939 / +35.2% 🔴 0.79 / 0.73 / +7.4%
tpch_q09/datafusion:vortex-file-compressed 382872634 / 321388366 / +19.1% 653535987 / 784562651 / -16.7% 0.59 / 0.41 / +43.0%
tpch_q10/datafusion:vortex-file-compressed 378612228 / 435538504 / -13.1% 741667878 / 496113175 / +49.5% 🔴 0.51 / 0.88 / -41.9%
tpch_q11/datafusion:vortex-file-compressed 281371540 / 322521718 / -12.8% 423924177 / 469932247 / -9.8% 0.66 / 0.69 / -3.3%
tpch_q12/datafusion:vortex-file-compressed 228615627 / 212258638 / +7.7% 388145593 / 456167189 / -14.9% 0.59 / 0.47 / +26.6%
tpch_q13/datafusion:vortex-file-compressed 108226232 / 106627628 / +1.5% 346364547 / 313370942 / +10.5% 0.31 / 0.34 / -8.2%
tpch_q14/datafusion:vortex-file-compressed 203349234 / 185915963 / +9.4% 371053298 / 326856054 / +13.5% 0.55 / 0.57 / -3.7%
tpch_q15/datafusion:vortex-file-compressed 883890129 / 296496443 / +198.1% 🔴 542109124 / 514541025 / +5.4% 1.63 / 0.58 / +183.0%
tpch_q16/datafusion:vortex-file-compressed 140648702 / 133336808 / +5.5% 397289177 / 300081536 / +32.4% 🔴 0.35 / 0.44 / -20.3%
tpch_q17/datafusion:vortex-file-compressed 248573013 / 250546621 / -0.8% 444361263 / 429136323 / +3.5% 0.56 / 0.58 / -4.2%
tpch_q18/datafusion:vortex-file-compressed 501174847 / 240195189 / +108.7% 🔴 624125510 / 466717813 / +33.7% 🔴 0.80 / 0.51 / +56.0%
tpch_q19/datafusion:vortex-file-compressed 236336188 / 223332398 / +5.8% 361284304 / 401054585 / -9.9% 0.65 / 0.56 / +17.5%
tpch_q20/datafusion:vortex-file-compressed 257271731 / 253455178 / +1.5% 486561091 / 420951180 / +15.6% 0.53 / 0.60 / -12.2%
tpch_q21/datafusion:vortex-file-compressed 554431419 / 438838999 / +26.3% 808946061 / 732828785 / +10.4% 0.69 / 0.60 / +14.5%
tpch_q22/datafusion:vortex-file-compressed 151692367 / 157796575 / -3.9% 545921952 / 378470521 / +44.2% 🔴 0.28 / 0.42 / -33.4%
datafusion / parquet / ns (0.993x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 145448117 / 160893639 / -9.6% 501737934 / 477656305 / +5.0% 0.29 / 0.34 / -13.9%
tpch_q02/datafusion:parquet 289252038 / 283224545 / +2.1% 586529763 / 518342864 / +13.2% 0.49 / 0.55 / -9.7%
tpch_q03/datafusion:parquet 246772420 / 240972716 / +2.4% 758637660 / 642874880 / +18.0% 0.33 / 0.37 / -13.2%
tpch_q04/datafusion:parquet 140041792 / 290591746 / -51.8% 🟢 373163745 / 390782032 / -4.5% 0.38 / 0.74 / -49.5%
tpch_q05/datafusion:parquet 349347655 / 331069979 / +5.5% 485314422 / 498026437 / -2.6% 0.72 / 0.66 / +8.3%
tpch_q06/datafusion:parquet 108477231 / 108799011 / -0.3% 210389699 / 245916825 / -14.4% 0.52 / 0.44 / +16.5%
tpch_q07/datafusion:parquet 321411382 / 326678397 / -1.6% 433483746 / 449002978 / -3.5% 0.74 / 0.73 / +1.9%
tpch_q08/datafusion:parquet 398150411 / 398421423 / -0.1% 583035037 / 498590910 / +16.9% 0.68 / 0.80 / -14.5%
tpch_q09/datafusion:parquet 390252460 / 372817746 / +4.7% 533588581 / 519672148 / +2.7% 0.73 / 0.72 / +1.9%
tpch_q10/datafusion:parquet 303467896 / 290771087 / +4.4% 560076981 / 438077597 / +27.8% 0.54 / 0.66 / -18.4%
tpch_q11/datafusion:parquet 262555190 / 248573335 / +5.6% 486878615 / 386545032 / +26.0% 0.54 / 0.64 / -16.1%
tpch_q12/datafusion:parquet 151250841 / 158312075 / -4.5% 294822963 / 283576009 / +4.0% 0.51 / 0.56 / -8.1%
tpch_q13/datafusion:parquet 269482313 / 271934092 / -0.9% 432831286 / 454802346 / -4.8% 0.62 / 0.60 / +4.1%
tpch_q14/datafusion:parquet 144443058 / 156701057 / -7.8% 280467635 / 242600586 / +15.6% 0.52 / 0.65 / -20.3%
tpch_q15/datafusion:parquet 298638597 / 321289289 / -7.0% 492091225 / 463365168 / +6.2% 0.61 / 0.69 / -12.5%
tpch_q16/datafusion:parquet 100768027 / 102064398 / -1.3% 206554636 / 214176376 / -3.6% 0.49 / 0.48 / +2.4%
tpch_q17/datafusion:parquet 269361854 / 269963531 / -0.2% 455993962 / 384737839 / +18.5% 0.59 / 0.70 / -15.8%
tpch_q18/datafusion:parquet 319171292 / 315368072 / +1.2% 430020845 / 438983449 / -2.0% 0.74 / 0.72 / +3.3%
tpch_q19/datafusion:parquet 160346243 / 165415410 / -3.1% 285387941 / 305066336 / -6.5% 0.56 / 0.54 / +3.6%
tpch_q20/datafusion:parquet 504588485 / 269297459 / +87.4% 🔴 728066690 / 410205409 / +77.5% 🔴 0.69 / 0.66 / +5.6%
tpch_q21/datafusion:parquet 300248227 / 284891803 / +5.4% 452448263 / 448342791 / +0.9% 0.66 / 0.64 / +4.4%
tpch_q22/datafusion:parquet 159534365 / 156165651 / +2.2% 383504735 / 306092476 / +25.3% 0.42 / 0.51 / -18.5%
duckdb / vortex-file-compressed / ns (1.032x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 249844171 / 242576933 / +3.0% 255252133 / 248191398 / +2.8% 0.98 / 0.98 / +0.1%
tpch_q02/duckdb:vortex-file-compressed 412357962 / 399746901 / +3.2% 517911910 / 432574115 / +19.7% 0.80 / 0.92 / -13.8%
tpch_q03/duckdb:vortex-file-compressed 406924227 / 408139921 / -0.3% 436473858 / 445279875 / -2.0% 0.93 / 0.92 / +1.7%
tpch_q04/duckdb:vortex-file-compressed 253663662 / 300287133 / -15.5% 287864666 / 265471776 / +8.4% 0.88 / 1.13 / -22.1%
tpch_q05/duckdb:vortex-file-compressed 588826211 / 498871469 / +18.0% 520459442 / 598179582 / -13.0% 1.13 / 0.83 / +35.7%
tpch_q06/duckdb:vortex-file-compressed 180429876 / 147640908 / +22.2% 194879291 / 185412460 / +5.1% 0.93 / 0.80 / +16.3%
tpch_q07/duckdb:vortex-file-compressed 429503526 / 464160734 / -7.5% 451580651 / 499509474 / -9.6% 0.95 / 0.93 / +2.4%
tpch_q08/duckdb:vortex-file-compressed 587716072 / 603655169 / -2.6% 620935372 / 654992607 / -5.2% 0.95 / 0.92 / +2.7%
tpch_q09/duckdb:vortex-file-compressed 383749955 / 429862616 / -10.7% 458061708 / 463513032 / -1.2% 0.84 / 0.93 / -9.7%
tpch_q10/duckdb:vortex-file-compressed 558266079 / 556081010 / +0.4% 581153269 / 588793346 / -1.3% 0.96 / 0.94 / +1.7%
tpch_q11/duckdb:vortex-file-compressed 288980572 / 316860152 / -8.8% 290443540 / 309339752 / -6.1% 0.99 / 1.02 / -2.9%
tpch_q12/duckdb:vortex-file-compressed 1263627289 / 260103561 / +385.8% 🔴 383279677 / 370870281 / +3.3% 3.30 / 0.70 / +370.1%
tpch_q13/duckdb:vortex-file-compressed 251268046 / 258887318 / -2.9% 319744528 / 205261457 / +55.8% 🔴 0.79 / 1.26 / -37.7%
tpch_q14/duckdb:vortex-file-compressed 227398756 / 220303505 / +3.2% 298417685 / 272140647 / +9.7% 0.76 / 0.81 / -5.9%
tpch_q15/duckdb:vortex-file-compressed 229697848 / 242509441 / -5.3% 269815329 / 280983375 / -4.0% 0.85 / 0.86 / -1.4%
tpch_q16/duckdb:vortex-file-compressed 197629052 / 212419567 / -7.0% 265770677 / 274668578 / -3.2% 0.74 / 0.77 / -3.8%
tpch_q17/duckdb:vortex-file-compressed 292287974 / 268487617 / +8.9% 540075584 / 320891586 / +68.3% 🔴 0.54 / 0.84 / -35.3%
tpch_q18/duckdb:vortex-file-compressed 384611574 / 336988542 / +14.1% 421240214 / 397837732 / +5.9% 0.91 / 0.85 / +7.8%
tpch_q19/duckdb:vortex-file-compressed 316766643 / 610735610 / -48.1% 🟢 364581041 / 339255633 / +7.5% 0.87 / 1.80 / -51.7%
tpch_q20/duckdb:vortex-file-compressed 373118899 / 429572715 / -13.1% 364263514 / 431952232 / -15.7% 1.02 / 0.99 / +3.0%
tpch_q21/duckdb:vortex-file-compressed 555788159 / 578033785 / -3.8% 616560170 / 970857916 / -36.5% 🟢 0.90 / 0.60 / +51.4%
tpch_q22/duckdb:vortex-file-compressed 220873506 / 242071604 / -8.8% 320423690 / 305429431 / +4.9% 0.69 / 0.79 / -13.0%
duckdb / parquet / ns (0.973x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 153065427 / 190713046 / -19.7% 217139982 / 197906009 / +9.7% 0.70 / 0.96 / -26.8%
tpch_q02/duckdb:parquet 564905272 / 446758763 / +26.4% 673762433 / 459769284 / +46.5% 🔴 0.84 / 0.97 / -13.7%
tpch_q03/duckdb:parquet 367484960 / 354133080 / +3.8% 426815975 / 375826133 / +13.6% 0.86 / 0.94 / -8.6%
tpch_q04/duckdb:parquet 282906839 / 249123959 / +13.6% 296003134 / 293716436 / +0.8% 0.96 / 0.85 / +12.7%
tpch_q05/duckdb:parquet 505425925 / 532981089 / -5.2% 630352470 / 643402723 / -2.0% 0.80 / 0.83 / -3.2%
tpch_q06/duckdb:parquet 169130764 / 349026244 / -51.5% 🟢 278533659 / 315233105 / -11.6% 0.61 / 1.11 / -45.2%
tpch_q07/duckdb:parquet 400098686 / 423386232 / -5.5% 455273843 / 461722193 / -1.4% 0.88 / 0.92 / -4.2%
tpch_q08/duckdb:parquet 537179011 / 554469756 / -3.1% 627055172 / 643357467 / -2.5% 0.86 / 0.86 / -0.6%
tpch_q09/duckdb:parquet 528110152 / 543951388 / -2.9% 609214781 / 596356255 / +2.2% 0.87 / 0.91 / -5.0%
tpch_q10/duckdb:parquet 540569883 / 544369504 / -0.7% 605441633 / 585943370 / +3.3% 0.89 / 0.93 / -3.9%
tpch_q11/duckdb:parquet 294056875 / 305296856 / -3.7% 292077764 / 289924264 / +0.7% 1.01 / 1.05 / -4.4%
tpch_q12/duckdb:parquet 284771681 / 228638503 / +24.6% 336582388 / 269427709 / +24.9% 0.85 / 0.85 / -0.3%
tpch_q13/duckdb:parquet 364153007 / 355878945 / +2.3% 489076107 / 502732834 / -2.7% 0.74 / 0.71 / +5.2%
tpch_q14/duckdb:parquet 260683274 / 253263272 / +2.9% 332815402 / 348389252 / -4.5% 0.78 / 0.73 / +7.7%
tpch_q15/duckdb:parquet 209672452 / 204745510 / +2.4% 247807140 / 269302806 / -8.0% 0.85 / 0.76 / +11.3%
tpch_q16/duckdb:parquet 264553181 / 266729619 / -0.8% 289002724 / 275134499 / +5.0% 0.92 / 0.97 / -5.6%
tpch_q17/duckdb:parquet 248269138 / 256545030 / -3.2% 292124138 / 294925434 / -0.9% 0.85 / 0.87 / -2.3%
tpch_q18/duckdb:parquet 323613857 / 331587754 / -2.4% 369837524 / 320878845 / +15.3% 0.88 / 1.03 / -15.3%
tpch_q19/duckdb:parquet 228507067 / 243894413 / -6.3% 235154906 / 347315464 / -32.3% 🟢 0.97 / 0.70 / +38.4%
tpch_q20/duckdb:parquet 475296811 / 452122499 / +5.1% 770659410 / 496751656 / +55.1% 🔴 0.62 / 0.91 / -32.2%
tpch_q21/duckdb:parquet 414048172 / 443206537 / -6.6% 557430871 / 452624014 / +23.2% 0.74 / 0.98 / -24.1%
tpch_q22/duckdb:parquet 293711335 / 291858097 / +0.6% 293406554 / 333194595 / -11.9% 1.00 / 0.88 / +14.3%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR abc04be5 vs base d81bd4ce
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.018x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.008x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35461554 / 35687064 / -0.6% 60704633 / 59727902 / +1.6% 0.58 / 0.60 / -2.2%
tpcds_q02/datafusion:vortex-file-compressed 49396744 / 51071520 / -3.3% 73368976 / 73866370 / -0.7% 0.67 / 0.69 / -2.6%
tpcds_q03/datafusion:vortex-file-compressed 19961464 / 20122918 / -0.8% 43530410 / 45522240 / -4.4% 0.46 / 0.44 / +3.7%
tpcds_q04/datafusion:vortex-file-compressed 295578467 / 294488276 / +0.4% 354069095 / 348826657 / +1.5% 0.83 / 0.84 / -1.1%
tpcds_q05/datafusion:vortex-file-compressed 70883952 / 72186978 / -1.8% 104534545 / 98074801 / +6.6% 0.68 / 0.74 / -7.9%
tpcds_q06/datafusion:vortex-file-compressed 42122213 / 42034562 / +0.2% 69261677 / 71314146 / -2.9% 0.61 / 0.59 / +3.2%
tpcds_q07/datafusion:vortex-file-compressed 42431526 / 41936610 / +1.2% 83992393 / 81598206 / +2.9% 0.51 / 0.51 / -1.7%
tpcds_q08/datafusion:vortex-file-compressed 28666345 / 29293898 / -2.1% 57659946 / 54786660 / +5.2% 0.50 / 0.53 / -7.0%
tpcds_q09/datafusion:vortex-file-compressed 44181210 / 43492521 / +1.6% 78820212 / 75585378 / +4.3% 0.56 / 0.58 / -2.6%
tpcds_q10/datafusion:vortex-file-compressed 37135367 / 37575747 / -1.2% 63022630 / 65187408 / -3.3% 0.59 / 0.58 / +2.2%
tpcds_q11/datafusion:vortex-file-compressed 174130876 / 174078024 / +0.0% 214798214 / 212796053 / +0.9% 0.81 / 0.82 / -0.9%
tpcds_q12/datafusion:vortex-file-compressed 17867296 / 17602241 / +1.5% 37872680 / 36804611 / +2.9% 0.47 / 0.48 / -1.4%
tpcds_q13/datafusion:vortex-file-compressed 37854772 / 37777492 / +0.2% 81017201 / 82427050 / -1.7% 0.47 / 0.46 / +1.9%
tpcds_q14/datafusion:vortex-file-compressed 230823583 / 234215656 / -1.4% 268231605 / 269416137 / -0.4% 0.86 / 0.87 / -1.0%
tpcds_q15/datafusion:vortex-file-compressed 41066790 / 40700370 / +0.9% 60667719 / 59132696 / +2.6% 0.68 / 0.69 / -1.7%
tpcds_q16/datafusion:vortex-file-compressed 23871741 / 24140928 / -1.1% 42096739 / 41799402 / +0.7% 0.57 / 0.58 / -1.8%
tpcds_q17/datafusion:vortex-file-compressed 63888156 / 64613948 / -1.1% 97700423 / 96825489 / +0.9% 0.65 / 0.67 / -2.0%
tpcds_q18/datafusion:vortex-file-compressed 68371168 / 68135038 / +0.3% 99063107 / 96678626 / +2.5% 0.69 / 0.70 / -2.1%
tpcds_q19/datafusion:vortex-file-compressed 22487302 / 23065796 / -2.5% 53703415 / 53499164 / +0.4% 0.42 / 0.43 / -2.9%
tpcds_q20/datafusion:vortex-file-compressed 23284020 / 23434874 / -0.6% 40815363 / 39490521 / +3.4% 0.57 / 0.59 / -3.9%
tpcds_q21/datafusion:vortex-file-compressed 46591718 / 46991756 / -0.9% 76638744 / 77561336 / -1.2% 0.61 / 0.61 / +0.3%
tpcds_q22/datafusion:vortex-file-compressed 434442264 / 436213066 / -0.4% 456816661 / 456238601 / +0.1% 0.95 / 0.96 / -0.5%
tpcds_q23/datafusion:vortex-file-compressed 293506732 / 295445526 / -0.7% 351640221 / 350238393 / +0.4% 0.83 / 0.84 / -1.1%
tpcds_q24/datafusion:vortex-file-compressed 118319130 / 118209681 / +0.1% 162095039 / 163532003 / -0.9% 0.73 / 0.72 / +1.0%
tpcds_q25/datafusion:vortex-file-compressed 60885245 / 58404091 / +4.2% 94092380 / 100148037 / -6.0% 0.65 / 0.58 / +11.0%
tpcds_q26/datafusion:vortex-file-compressed 37690647 / 37624965 / +0.2% 59672271 / 59590326 / +0.1% 0.63 / 0.63 / +0.0%
tpcds_q27/datafusion:vortex-file-compressed 69900264 / 71638275 / -2.4% 108025707 / 105343615 / +2.5% 0.65 / 0.68 / -4.8%
tpcds_q28/datafusion:vortex-file-compressed 42938656 / 42371952 / +1.3% 90339092 / 87727130 / +3.0% 0.48 / 0.48 / -1.6%
tpcds_q29/datafusion:vortex-file-compressed 62613887 / 66811756 / -6.3% 99313122 / 102564955 / -3.2% 0.63 / 0.65 / -3.2%
tpcds_q30/datafusion:vortex-file-compressed 51013254 / 51119143 / -0.2% 79142990 / 75743723 / +4.5% 0.64 / 0.67 / -4.5%
tpcds_q31/datafusion:vortex-file-compressed 200786666 / 200218175 / +0.3% 233143614 / 233152597 / -0.0% 0.86 / 0.86 / +0.3%
tpcds_q32/datafusion:vortex-file-compressed 15082738 / 15152590 / -0.5% 31153137 / 31036644 / +0.4% 0.48 / 0.49 / -0.8%
tpcds_q33/datafusion:vortex-file-compressed 33314296 / 33166894 / +0.4% 67152945 / 66312007 / +1.3% 0.50 / 0.50 / -0.8%
tpcds_q34/datafusion:vortex-file-compressed 40417228 / 40800963 / -0.9% 66879281 / 69572930 / -3.9% 0.60 / 0.59 / +3.0%
tpcds_q35/datafusion:vortex-file-compressed 91824142 / 92953752 / -1.2% 121061563 / 118717623 / +2.0% 0.76 / 0.78 / -3.1%
tpcds_q36/datafusion:vortex-file-compressed 66884788 / 66188984 / +1.1% 99595535 / 100548488 / -0.9% 0.67 / 0.66 / +2.0%
tpcds_q37/datafusion:vortex-file-compressed 23595514 / 28659362 / -17.7% 🟢 40589552 / 39142184 / +3.7% 0.58 / 0.73 / -20.6%
tpcds_q38/datafusion:vortex-file-compressed 79070304 / 79029305 / +0.1% 108742126 / 106760595 / +1.9% 0.73 / 0.74 / -1.8%
tpcds_q39/datafusion:vortex-file-compressed 889766733 / 884718834 / +0.6% 906491893 / 908976999 / -0.3% 0.98 / 0.97 / +0.8%
tpcds_q40/datafusion:vortex-file-compressed 29118197 / 28530688 / +2.1% 49591416 / 48600430 / +2.0% 0.59 / 0.59 / +0.0%
tpcds_q41/datafusion:vortex-file-compressed 19351357 / 19016106 / +1.8% 32563051 / 31973918 / +1.8% 0.59 / 0.59 / -0.1%
tpcds_q42/datafusion:vortex-file-compressed 13444734 / 14446512 / -6.9% 38676145 / 37086223 / +4.3% 0.35 / 0.39 / -10.8%
tpcds_q43/datafusion:vortex-file-compressed 16835194 / 17062690 / -1.3% 42830113 / 37710185 / +13.6% 🔴 0.39 / 0.45 / -13.1%
tpcds_q44/datafusion:vortex-file-compressed 42820849 / 43352470 / -1.2% 71848009 / 72038897 / -0.3% 0.60 / 0.60 / -1.0%
tpcds_q45/datafusion:vortex-file-compressed 42762046 / 44364085 / -3.6% 67155811 / 59556323 / +12.8% 🔴 0.64 / 0.74 / -14.5%
tpcds_q46/datafusion:vortex-file-compressed 72079331 / 70145033 / +2.8% 105382404 / 104029608 / +1.3% 0.68 / 0.67 / +1.4%
tpcds_q47/datafusion:vortex-file-compressed 174391990 / 173539465 / +0.5% 221500674 / 216035492 / +2.5% 0.79 / 0.80 / -2.0%
tpcds_q48/datafusion:vortex-file-compressed 35826522 / 35623834 / +0.6% 71242141 / 70644306 / +0.8% 0.50 / 0.50 / -0.3%
tpcds_q49/datafusion:vortex-file-compressed 77975060 / 77255316 / +0.9% 119820960 / 116737222 / +2.6% 0.65 / 0.66 / -1.7%
tpcds_q50/datafusion:vortex-file-compressed 55993533 / 55980736 / +0.0% 86439273 / 86230008 / +0.2% 0.65 / 0.65 / -0.2%
tpcds_q51/datafusion:vortex-file-compressed 243055585 / 247038673 / -1.6% 281416214 / 280421401 / +0.4% 0.86 / 0.88 / -2.0%
tpcds_q52/datafusion:vortex-file-compressed 14386098 / 14714848 / -2.2% 40403936 / 38389598 / +5.2% 0.36 / 0.38 / -7.1%
tpcds_q53/datafusion:vortex-file-compressed 23025338 / 22346742 / +3.0% 49667344 / 49846122 / -0.4% 0.46 / 0.45 / +3.4%
tpcds_q54/datafusion:vortex-file-compressed 60027324 / 57426460 / +4.5% 90133265 / 92580497 / -2.6% 0.67 / 0.62 / +7.4%
tpcds_q55/datafusion:vortex-file-compressed 13726476 / 13973340 / -1.8% 41008052 / 38808883 / +5.7% 0.33 / 0.36 / -7.0%
tpcds_q56/datafusion:vortex-file-compressed 32842490 / 33761524 / -2.7% 65227711 / 63265036 / +3.1% 0.50 / 0.53 / -5.6%
tpcds_q57/datafusion:vortex-file-compressed 132208246 / 131113802 / +0.8% 161423685 / 161410678 / +0.0% 0.82 / 0.81 / +0.8%
tpcds_q58/datafusion:vortex-file-compressed 48555597 / 48391922 / +0.3% 83893698 / 84580372 / -0.8% 0.58 / 0.57 / +1.2%
tpcds_q59/datafusion:vortex-file-compressed 53889176 / 55056536 / -2.1% 82018406 / 81170032 / +1.0% 0.66 / 0.68 / -3.1%
tpcds_q60/datafusion:vortex-file-compressed 33493028 / 34937748 / -4.1% 62145937 / 63120098 / -1.5% 0.54 / 0.55 / -2.6%
tpcds_q61/datafusion:vortex-file-compressed 44521236 / 45353798 / -1.8% 72338380 / 72493548 / -0.2% 0.62 / 0.63 / -1.6%
tpcds_q62/datafusion:vortex-file-compressed 19173582 / 18948984 / +1.2% 40963957 / 40635590 / +0.8% 0.47 / 0.47 / +0.4%
tpcds_q63/datafusion:vortex-file-compressed 22022948 / 22886570 / -3.8% 51101981 / 51245739 / -0.3% 0.43 / 0.45 / -3.5%
tpcds_q64/datafusion:vortex-file-compressed 334777634 / 331770842 / +0.9% 401878564 / 405661127 / -0.9% 0.83 / 0.82 / +1.9%
tpcds_q65/datafusion:vortex-file-compressed 75860139 / 74188341 / +2.3% 110220703 / 106874319 / +3.1% 0.69 / 0.69 / -0.9%
tpcds_q66/datafusion:vortex-file-compressed 51826884 / 51726748 / +0.2% 76900677 / 75217399 / +2.2% 0.67 / 0.69 / -2.0%
tpcds_q67/datafusion:vortex-file-compressed 419356776 / 425404384 / -1.4% 520124439 / 518487417 / +0.3% 0.81 / 0.82 / -1.7%
tpcds_q68/datafusion:vortex-file-compressed 65457356 / 67065476 / -2.4% 93238785 / 99957636 / -6.7% 0.70 / 0.67 / +4.6%
tpcds_q69/datafusion:vortex-file-compressed 37267342 / 36411572 / +2.4% 62572051 / 61245093 / +2.2% 0.60 / 0.59 / +0.2%
tpcds_q70/datafusion:vortex-file-compressed 194967462 / 195234258 / -0.1% 227315131 / 223353634 / +1.8% 0.86 / 0.87 / -1.9%
tpcds_q71/datafusion:vortex-file-compressed 26241780 / 24846620 / +5.6% 59686707 / 57873035 / +3.1% 0.44 / 0.43 / +2.4%
tpcds_q72/datafusion:vortex-file-compressed 1659935795 / 1613070819 / +2.9% 1643192365 / 1672817704 / -1.8% 1.01 / 0.96 / +4.8%
tpcds_q73/datafusion:vortex-file-compressed 38228993 / 37798150 / +1.1% 64515771 / 63097488 / +2.2% 0.59 / 0.60 / -1.1%
tpcds_q74/datafusion:vortex-file-compressed 134996367 / 134609600 / +0.3% 169588654 / 169107950 / +0.3% 0.80 / 0.80 / +0.0%
tpcds_q75/datafusion:vortex-file-compressed 158087702 / 157283038 / +0.5% 200301226 / 199539779 / +0.4% 0.79 / 0.79 / +0.1%
tpcds_q76/datafusion:vortex-file-compressed 34868159 / 34141944 / +2.1% 73767459 / 76790189 / -3.9% 0.47 / 0.44 / +6.3%
tpcds_q77/datafusion:vortex-file-compressed 54683930 / 54578544 / +0.2% 87914222 / 87907886 / +0.0% 0.62 / 0.62 / +0.2%
tpcds_q78/datafusion:vortex-file-compressed 140591310 / 139945221 / +0.5% 193095041 / 191111158 / +1.0% 0.73 / 0.73 / -0.6%
tpcds_q79/datafusion:vortex-file-compressed 53152614 / 54551104 / -2.6% 82971127 / 83695427 / -0.9% 0.64 / 0.65 / -1.7%
tpcds_q80/datafusion:vortex-file-compressed 82372924 / 81251883 / +1.4% 130145322 / 126092347 / +3.2% 0.63 / 0.64 / -1.8%
tpcds_q81/datafusion:vortex-file-compressed 55863058 / 57217203 / -2.4% 83976477 / 83290839 / +0.8% 0.67 / 0.69 / -3.2%
tpcds_q82/datafusion:vortex-file-compressed 30286392 / 29527786 / +2.6% 48186745 / 46344112 / +4.0% 0.63 / 0.64 / -1.4%
tpcds_q83/datafusion:vortex-file-compressed 42071358 / 42234106 / -0.4% 67364626 / 65316165 / +3.1% 0.62 / 0.65 / -3.4%
tpcds_q84/datafusion:vortex-file-compressed 12956352 / 12318387 / +5.2% 31625165 / 31461444 / +0.5% 0.41 / 0.39 / +4.6%
tpcds_q85/datafusion:vortex-file-compressed 60845330 / 60351388 / +0.8% 88708276 / 89165946 / -0.5% 0.69 / 0.68 / +1.3%
tpcds_q86/datafusion:vortex-file-compressed 18717438 / 18635084 / +0.4% 39227840 / 40794939 / -3.8% 0.48 / 0.46 / +4.5%
tpcds_q87/datafusion:vortex-file-compressed 79513804 / 77726270 / +2.3% 105814933 / 106793331 / -0.9% 0.75 / 0.73 / +3.2%
tpcds_q88/datafusion:vortex-file-compressed 53247047 / 54134854 / -1.6% 91176625 / 91920123 / -0.8% 0.58 / 0.59 / -0.8%
tpcds_q89/datafusion:vortex-file-compressed 26906986 / 27705445 / -2.9% 55908910 / 52989044 / +5.5% 0.48 / 0.52 / -8.0%
tpcds_q90/datafusion:vortex-file-compressed 13081455 / 12876262 / +1.6% 32579325 / 31193191 / +4.4% 0.40 / 0.41 / -2.7%
tpcds_q91/datafusion:vortex-file-compressed 19020476 / 19841934 / -4.1% 40611175 / 40517298 / +0.2% 0.47 / 0.49 / -4.4%
tpcds_q92/datafusion:vortex-file-compressed 15465840 / 15586140 / -0.8% 36531422 / 35022452 / +4.3% 0.42 / 0.45 / -4.9%
tpcds_q93/datafusion:vortex-file-compressed 56380308 / 54479092 / +3.5% 88031751 / 91110634 / -3.4% 0.64 / 0.60 / +7.1%
tpcds_q94/datafusion:vortex-file-compressed 21138658 / 21721248 / -2.7% 44923257 / 43008447 / +4.5% 0.47 / 0.51 / -6.8%
tpcds_q95/datafusion:vortex-file-compressed 95720700 / 96025348 / -0.3% 118234203 / 125556657 / -5.8% 0.81 / 0.76 / +5.9%
tpcds_q96/datafusion:vortex-file-compressed 11721541 / 11669502 / +0.4% 30554686 / 29013229 / +5.3% 0.38 / 0.40 / -4.6%
tpcds_q97/datafusion:vortex-file-compressed 39491850 / 39740562 / -0.6% 64468120 / 64433312 / +0.1% 0.61 / 0.62 / -0.7%
tpcds_q98/datafusion:vortex-file-compressed 20368556 / 20279683 / +0.4% 46032099 / 49580667 / -7.2% 0.44 / 0.41 / +8.2%
tpcds_q99/datafusion:vortex-file-compressed 29222131 / 28990486 / +0.8% 48306087 / 46237709 / +4.5% 0.60 / 0.63 / -3.5%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59565266 / 59467470 / +0.2% 82050946 / 78629990 / +4.4% 0.73 / 0.76 / -4.0%
tpcds_q02/datafusion:parquet 69254494 / 68841136 / +0.6% 90312847 / 92247774 / -2.1% 0.77 / 0.75 / +2.8%
tpcds_q03/datafusion:parquet 27919492 / 28412717 / -1.7% 50158869 / 51484914 / -2.6% 0.56 / 0.55 / +0.9%
tpcds_q04/datafusion:parquet 646623868 / 642280600 / +0.7% 707839217 / 713442164 / -0.8% 0.91 / 0.90 / +1.5%
tpcds_q05/datafusion:parquet 82130436 / 80587203 / +1.9% 117154218 / 114099796 / +2.7% 0.70 / 0.71 / -0.7%
tpcds_q06/datafusion:parquet 91208198 / 91299202 / -0.1% 111922932 / 111123421 / +0.7% 0.81 / 0.82 / -0.8%
tpcds_q07/datafusion:parquet 103025676 / 100516129 / +2.5% 134566851 / 140439595 / -4.2% 0.77 / 0.72 / +7.0%
tpcds_q08/datafusion:parquet 47370734 / 47906314 / -1.1% 76163855 / 77683939 / -2.0% 0.62 / 0.62 / +0.9%
tpcds_q09/datafusion:parquet 76043476 / 75858005 / +0.2% 102395476 / 103150303 / -0.7% 0.74 / 0.74 / +1.0%
tpcds_q10/datafusion:parquet 60287434 / 59911058 / +0.6% 80701610 / 85891230 / -6.0% 0.75 / 0.70 / +7.1%
tpcds_q11/datafusion:parquet 411242836 / 410249982 / +0.2% 456927404 / 453298906 / +0.8% 0.90 / 0.91 / -0.6%
tpcds_q12/datafusion:parquet 39715452 / 40180548 / -1.2% 59092808 / 57554919 / +2.7% 0.67 / 0.70 / -3.7%
tpcds_q13/datafusion:parquet 86756339 / 84877392 / +2.2% 129382441 / 129583250 / -0.2% 0.67 / 0.66 / +2.4%
tpcds_q14/datafusion:parquet 378659710 / 390641226 / -3.1% 419497737 / 422522225 / -0.7% 0.90 / 0.92 / -2.4%
tpcds_q15/datafusion:parquet 50455204 / 51004075 / -1.1% 71990392 / 70096169 / +2.7% 0.70 / 0.73 / -3.7%
tpcds_q16/datafusion:parquet 44984737 / 45319756 / -0.7% 63840226 / 62344760 / +2.4% 0.70 / 0.73 / -3.1%
tpcds_q17/datafusion:parquet 134816468 / 140124091 / -3.8% 168189923 / 173293414 / -2.9% 0.80 / 0.81 / -0.9%
tpcds_q18/datafusion:parquet 107926566 / 110049167 / -1.9% 141738644 / 141644863 / +0.1% 0.76 / 0.78 / -2.0%
tpcds_q19/datafusion:parquet 46969400 / 47382432 / -0.9% 78420468 / 74454407 / +5.3% 0.60 / 0.64 / -5.9%
tpcds_q20/datafusion:parquet 41276688 / 41140804 / +0.3% 54998351 / 53422774 / +2.9% 0.75 / 0.77 / -2.5%
tpcds_q21/datafusion:parquet 61321094 / 60585280 / +1.2% 74497829 / 72359261 / +3.0% 0.82 / 0.84 / -1.7%
tpcds_q22/datafusion:parquet 462953586 / 464956066 / -0.4% 480664229 / 480116418 / +0.1% 0.96 / 0.97 / -0.5%
tpcds_q23/datafusion:parquet 368510020 / 362030230 / +1.8% 421685512 / 423236940 / -0.4% 0.87 / 0.86 / +2.2%
tpcds_q24/datafusion:parquet 243499191 / 238522424 / +2.1% 280394148 / 280988941 / -0.2% 0.87 / 0.85 / +2.3%
tpcds_q25/datafusion:parquet 148325786 / 145856299 / +1.7% 187711371 / 180939258 / +3.7% 0.79 / 0.81 / -2.0%
tpcds_q26/datafusion:parquet 54830629 / 54371764 / +0.8% 77050266 / 78855738 / -2.3% 0.71 / 0.69 / +3.2%
tpcds_q27/datafusion:parquet 205007332 / 208670172 / -1.8% 244493077 / 244008894 / +0.2% 0.84 / 0.86 / -1.9%
tpcds_q28/datafusion:parquet 85443576 / 88438947 / -3.4% 121725483 / 115489704 / +5.4% 0.70 / 0.77 / -8.3%
tpcds_q29/datafusion:parquet 141603326 / 143202262 / -1.1% 181252430 / 175795941 / +3.1% 0.78 / 0.81 / -4.1%
tpcds_q30/datafusion:parquet 99073808 / 99031156 / +0.0% 121093432 / 119707182 / +1.2% 0.82 / 0.83 / -1.1%
tpcds_q31/datafusion:parquet 317018196 / 318865238 / -0.6% 343255146 / 342248409 / +0.3% 0.92 / 0.93 / -0.9%
tpcds_q32/datafusion:parquet 29480222 / 29268206 / +0.7% 41078543 / 43049951 / -4.6% 0.72 / 0.68 / +5.6%
tpcds_q33/datafusion:parquet 52659652 / 54279188 / -3.0% 79116776 / 73291711 / +7.9% 0.67 / 0.74 / -10.1%
tpcds_q34/datafusion:parquet 62958607 / 62880984 / +0.1% 87880730 / 85677254 / +2.6% 0.72 / 0.73 / -2.4%
tpcds_q35/datafusion:parquet 124602589 / 124024507 / +0.5% 148387029 / 152510309 / -2.7% 0.84 / 0.81 / +3.3%
tpcds_q36/datafusion:parquet 98276730 / 96065436 / +2.3% 129920275 / 130472892 / -0.4% 0.76 / 0.74 / +2.7%
tpcds_q37/datafusion:parquet 50024568 / 50326967 / -0.6% 64898043 / 62106792 / +4.5% 0.77 / 0.81 / -4.9%
tpcds_q38/datafusion:parquet 120118749 / 121809162 / -1.4% 148074795 / 148143097 / -0.0% 0.81 / 0.82 / -1.3%
tpcds_q39/datafusion:parquet 853581351 / 850365260 / +0.4% 858591946 / 858244795 / +0.0% 0.99 / 0.99 / +0.3%
tpcds_q40/datafusion:parquet 34281106 / 34460206 / -0.5% 55114851 / 55082629 / +0.1% 0.62 / 0.63 / -0.6%
tpcds_q41/datafusion:parquet 31482558 / 32074791 / -1.8% 44388974 / 42604832 / +4.2% 0.71 / 0.75 / -5.8%
tpcds_q42/datafusion:parquet 26203992 / 26668796 / -1.7% 45120527 / 44471155 / +1.5% 0.58 / 0.60 / -3.2%
tpcds_q43/datafusion:parquet 26998430 / 27798290 / -2.9% 48842345 / 48667153 / +0.4% 0.55 / 0.57 / -3.2%
tpcds_q44/datafusion:parquet 65893006 / 66005414 / -0.2% 92106659 / 85489645 / +7.7% 0.72 / 0.77 / -7.3%
tpcds_q45/datafusion:parquet 66450161 / 66367192 / +0.1% 85772451 / 87700095 / -2.2% 0.77 / 0.76 / +2.4%
tpcds_q46/datafusion:parquet 105466842 / 108262468 / -2.6% 151103216 / 147281576 / +2.6% 0.70 / 0.74 / -5.0%
tpcds_q47/datafusion:parquet 236182774 / 235616338 / +0.2% 276274847 / 274771942 / +0.5% 0.85 / 0.86 / -0.3%
tpcds_q48/datafusion:parquet 78697348 / 79003310 / -0.4% 106895692 / 104369134 / +2.4% 0.74 / 0.76 / -2.7%
tpcds_q49/datafusion:parquet 118112172 / 117557337 / +0.5% 171895161 / 168445239 / +2.0% 0.69 / 0.70 / -1.5%
tpcds_q50/datafusion:parquet 92453790 / 91455979 / +1.1% 125742086 / 121449330 / +3.5% 0.74 / 0.75 / -2.4%
tpcds_q51/datafusion:parquet 253780590 / 257462208 / -1.4% 288284673 / 275612309 / +4.6% 0.88 / 0.93 / -5.8%
tpcds_q52/datafusion:parquet 26631142 / 26582131 / +0.2% 45420199 / 46713825 / -2.8% 0.59 / 0.57 / +3.0%
tpcds_q53/datafusion:parquet 37452351 / 35857856 / +4.4% 59105540 / 60285453 / -2.0% 0.63 / 0.59 / +6.5%
tpcds_q54/datafusion:parquet 85557716 / 84979193 / +0.7% 108175023 / 106622915 / +1.5% 0.79 / 0.80 / -0.8%
tpcds_q55/datafusion:parquet 25720936 / 25716791 / +0.0% 48130325 / 47255907 / +1.9% 0.53 / 0.54 / -1.8%
tpcds_q56/datafusion:parquet 53512356 / 52634930 / +1.7% 77169171 / 72550483 / +6.4% 0.69 / 0.73 / -4.4%
tpcds_q57/datafusion:parquet 172395238 / 171481192 / +0.5% 196818822 / 193556759 / +1.7% 0.88 / 0.89 / -1.1%
tpcds_q58/datafusion:parquet 97075804 / 97417717 / -0.4% 123601394 / 116545953 / +6.1% 0.79 / 0.84 / -6.0%
tpcds_q59/datafusion:parquet 104994789 / 105187850 / -0.2% 132560600 / 128553486 / +3.1% 0.79 / 0.82 / -3.2%
tpcds_q60/datafusion:parquet 52799351 / 53716710 / -1.7% 75824250 / 72468178 / +4.6% 0.70 / 0.74 / -6.1%
tpcds_q61/datafusion:parquet 74568462 / 74726424 / -0.2% 97623944 / 100897235 / -3.2% 0.76 / 0.74 / +3.1%
tpcds_q62/datafusion:parquet 27433820 / 27394960 / +0.1% 45735077 / 44704350 / +2.3% 0.60 / 0.61 / -2.1%
tpcds_q63/datafusion:parquet 36208906 / 36109236 / +0.3% 58805875 / 58190337 / +1.1% 0.62 / 0.62 / -0.8%
tpcds_q64/datafusion:parquet 662097686 / 658028547 / +0.6% 737571799 / 727112413 / +1.4% 0.90 / 0.90 / -0.8%
tpcds_q65/datafusion:parquet 101500589 / 100883629 / +0.6% 135358404 / 133391313 / +1.5% 0.75 / 0.76 / -0.9%
tpcds_q66/datafusion:parquet 76526712 / 77524761 / -1.3% 102453512 / 104064088 / -1.5% 0.75 / 0.74 / +0.3%
tpcds_q67/datafusion:parquet 433390958 / 432898548 / +0.1% 502726645 / 500774321 / +0.4% 0.86 / 0.86 / -0.3%
tpcds_q68/datafusion:parquet 109091178 / 107972369 / +1.0% 156413216 / 153393827 / +2.0% 0.70 / 0.70 / -0.9%
tpcds_q69/datafusion:parquet 60971494 / 59031088 / +3.3% 83404377 / 81368763 / +2.5% 0.73 / 0.73 / +0.8%
tpcds_q70/datafusion:parquet 213682336 / 211356872 / +1.1% 243583884 / 243628971 / -0.0% 0.88 / 0.87 / +1.1%
tpcds_q71/datafusion:parquet 37672139 / 39988372 / -5.8% 62863626 / 63580905 / -1.1% 0.60 / 0.63 / -4.7%
tpcds_q72/datafusion:parquet 1748256513 / 1766291258 / -1.0% 1835726192 / 1717685799 / +6.9% 0.95 / 1.03 / -7.4%
tpcds_q73/datafusion:parquet 62975666 / 62604856 / +0.6% 86023819 / 85382876 / +0.8% 0.73 / 0.73 / -0.2%
tpcds_q74/datafusion:parquet 296466434 / 293543952 / +1.0% 332773561 / 333014708 / -0.1% 0.89 / 0.88 / +1.1%
tpcds_q75/datafusion:parquet 194394678 / 195570109 / -0.6% 234592395 / 227532670 / +3.1% 0.83 / 0.86 / -3.6%
tpcds_q76/datafusion:parquet 50043764 / 50790492 / -1.5% 81131139 / 80279383 / +1.1% 0.62 / 0.63 / -2.5%
tpcds_q77/datafusion:parquet 71707207 / 71696114 / +0.0% 103739966 / 102466534 / +1.2% 0.69 / 0.70 / -1.2%
tpcds_q78/datafusion:parquet 210482667 / 210078458 / +0.2% 271616538 / 262635746 / +3.4% 0.77 / 0.80 / -3.1%
tpcds_q79/datafusion:parquet 78814670 / 78772706 / +0.1% 113020065 / 113848428 / -0.7% 0.70 / 0.69 / +0.8%
tpcds_q80/datafusion:parquet 143513701 / 143215239 / +0.2% 193986906 / 198385628 / -2.2% 0.74 / 0.72 / +2.5%
tpcds_q81/datafusion:parquet 108714590 / 108666647 / +0.0% 131603649 / 126675306 / +3.9% 0.83 / 0.86 / -3.7%
tpcds_q82/datafusion:parquet 55001825 / 54589676 / +0.8% 74445868 / 72577165 / +2.6% 0.74 / 0.75 / -1.8%
tpcds_q83/datafusion:parquet 66546740 / 66004765 / +0.8% 85597955 / 80766410 / +6.0% 0.78 / 0.82 / -4.9%
tpcds_q84/datafusion:parquet 34851921 / 35067368 / -0.6% 50780549 / 49217980 / +3.2% 0.69 / 0.71 / -3.7%
tpcds_q85/datafusion:parquet 107091338 / 106118258 / +0.9% 131856712 / 126965208 / +3.9% 0.81 / 0.84 / -2.8%
tpcds_q86/datafusion:parquet 22303624 / 21856744 / +2.0% 40679709 / 38801034 / +4.8% 0.55 / 0.56 / -2.7%
tpcds_q87/datafusion:parquet 122288242 / 121427887 / +0.7% 144658365 / 146352765 / -1.2% 0.85 / 0.83 / +1.9%
tpcds_q88/datafusion:parquet 87309232 / 85112720 / +2.6% 109306533 / 111247316 / -1.7% 0.80 / 0.77 / +4.4%
tpcds_q89/datafusion:parquet 39734192 / 38253917 / +3.9% 63257369 / 64696968 / -2.2% 0.63 / 0.59 / +6.2%
tpcds_q90/datafusion:parquet 17279760 / 17095194 / +1.1% 30590740 / 32500458 / -5.9% 0.56 / 0.53 / +7.4%
tpcds_q91/datafusion:parquet 42460577 / 41649029 / +1.9% 59179124 / 57973405 / +2.1% 0.72 / 0.72 / -0.1%
tpcds_q92/datafusion:parquet 28493424 / 28701521 / -0.7% 47100358 / 45914012 / +2.6% 0.60 / 0.63 / -3.2%
tpcds_q93/datafusion:parquet 60550882 / 61105564 / -0.9% 90390360 / 86368626 / +4.7% 0.67 / 0.71 / -5.3%
tpcds_q94/datafusion:parquet 38475131 / 38133748 / +0.9% 59097585 / 57944474 / +2.0% 0.65 / 0.66 / -1.1%
tpcds_q95/datafusion:parquet 126144694 / 129222804 / -2.4% 156888326 / 153739120 / +2.0% 0.80 / 0.84 / -4.3%
tpcds_q96/datafusion:parquet 20924230 / 21737938 / -3.7% 37129567 / 38315607 / -3.1% 0.56 / 0.57 / -0.7%
tpcds_q97/datafusion:parquet 55044508 / 54900939 / +0.3% 82630942 / 80044710 / +3.2% 0.67 / 0.69 / -2.9%
tpcds_q98/datafusion:parquet 60947988 / 62068014 / -1.8% 86768561 / 84935164 / +2.2% 0.70 / 0.73 / -3.9%
tpcds_q99/datafusion:parquet 42651460 / 42547334 / +0.2% 57207663 / 57947364 / -1.3% 0.75 / 0.73 / +1.5%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32682594 / 32666622 / +0.0% 44706565 / 44442032 / +0.6% 0.73 / 0.74 / -0.5%
tpcds_q02/duckdb:vortex-file-compressed 31671808 / 31019078 / +2.1% 44727012 / 42210494 / +6.0% 0.71 / 0.73 / -3.6%
tpcds_q03/duckdb:vortex-file-compressed 13465996 / 13791742 / -2.4% 31404753 / 29378226 / +6.9% 0.43 / 0.47 / -8.7%
tpcds_q04/duckdb:vortex-file-compressed 129378171 / 129471634 / -0.1% 157131352 / 151903616 / +3.4% 0.82 / 0.85 / -3.4%
tpcds_q05/duckdb:vortex-file-compressed 55274025 / 54650877 / +1.1% 77272026 / 73147246 / +5.6% 0.72 / 0.75 / -4.3%
tpcds_q06/duckdb:vortex-file-compressed 58741578 / 58713689 / +0.0% 78990309 / 75959131 / +4.0% 0.74 / 0.77 / -3.8%
tpcds_q07/duckdb:vortex-file-compressed 29745937 / 30579528 / -2.7% 51599401 / 52049505 / -0.9% 0.58 / 0.59 / -1.9%
tpcds_q08/duckdb:vortex-file-compressed 31433504 / 30914874 / +1.7% 41295071 / 40665146 / +1.5% 0.76 / 0.76 / +0.1%
tpcds_q09/duckdb:vortex-file-compressed 56165382 / 56913068 / -1.3% 79598109 / 74998255 / +6.1% 0.71 / 0.76 / -7.0%
tpcds_q10/duckdb:vortex-file-compressed 39713952 / 39635552 / +0.2% 57916410 / 57816076 / +0.2% 0.69 / 0.69 / +0.0%
tpcds_q11/duckdb:vortex-file-compressed 96021099 / 95253860 / +0.8% 112146285 / 113706380 / -1.4% 0.86 / 0.84 / +2.2%
tpcds_q12/duckdb:vortex-file-compressed 17714604 / 17712503 / +0.0% 30133941 / 29984002 / +0.5% 0.59 / 0.59 / -0.5%
tpcds_q13/duckdb:vortex-file-compressed 39133171 / 37991460 / +3.0% 70781635 / 69301429 / +2.1% 0.55 / 0.55 / +0.9%
tpcds_q14/duckdb:vortex-file-compressed 121411028 / 121384720 / +0.0% 136342487 / 134734274 / +1.2% 0.89 / 0.90 / -1.2%
tpcds_q15/duckdb:vortex-file-compressed 59205099 / 61299576 / -3.4% 68843935 / 72388428 / -4.9% 0.86 / 0.85 / +1.6%
tpcds_q16/duckdb:vortex-file-compressed 35032758 / 34690472 / +1.0% 52660238 / 52266117 / +0.8% 0.67 / 0.66 / +0.2%
tpcds_q17/duckdb:vortex-file-compressed 58135738 / 57332318 / +1.4% 82504142 / 79066911 / +4.3% 0.70 / 0.73 / -2.8%
tpcds_q18/duckdb:vortex-file-compressed 82509049 / 82923020 / -0.5% 101929862 / 101023706 / +0.9% 0.81 / 0.82 / -1.4%
tpcds_q19/duckdb:vortex-file-compressed 46276106 / 43597316 / +6.1% 63393957 / 62263780 / +1.8% 0.73 / 0.70 / +4.3%
tpcds_q20/duckdb:vortex-file-compressed 22061192 / 22262395 / -0.9% 37243844 / 35610939 / +4.6% 0.59 / 0.63 / -5.2%
tpcds_q21/duckdb:vortex-file-compressed 35984494 / 34748561 / +3.6% 68447343 / 61670816 / +11.0% 🔴 0.53 / 0.56 / -6.7%
tpcds_q22/duckdb:vortex-file-compressed 157755358 / 161348692 / -2.2% 174309674 / 172593381 / +1.0% 0.91 / 0.93 / -3.2%
tpcds_q23/duckdb:vortex-file-compressed 183065690 / 183560942 / -0.3% 198867979 / 197879336 / +0.5% 0.92 / 0.93 / -0.8%
tpcds_q24/duckdb:vortex-file-compressed 51470248 / 52262054 / -1.5% 77721652 / 70571615 / +10.1% 🔴 0.66 / 0.74 / -10.6%
tpcds_q25/duckdb:vortex-file-compressed 53410274 / 52927888 / +0.9% 76153798 / 72882457 / +4.5% 0.70 / 0.73 / -3.4%
tpcds_q26/duckdb:vortex-file-compressed 26343554 / 26933009 / -2.2% 41276438 / 40955560 / +0.8% 0.64 / 0.66 / -2.9%
tpcds_q27/duckdb:vortex-file-compressed 31729610 / 32187006 / -1.4% 53371510 / 51949183 / +2.7% 0.59 / 0.62 / -4.0%
tpcds_q28/duckdb:vortex-file-compressed 42550918 / 42552663 / -0.0% 65743545 / 61657569 / +6.6% 0.65 / 0.69 / -6.2%
tpcds_q29/duckdb:vortex-file-compressed 52408216 / 52233606 / +0.3% 73997389 / 71810623 / +3.0% 0.71 / 0.73 / -2.6%
tpcds_q30/duckdb:vortex-file-compressed 38795526 / 38885226 / -0.2% 51641660 / 50464856 / +2.3% 0.75 / 0.77 / -2.5%
tpcds_q31/duckdb:vortex-file-compressed 38870742 / 38098196 / +2.0% 51545013 / 53564287 / -3.8% 0.75 / 0.71 / +6.0%
tpcds_q32/duckdb:vortex-file-compressed 13896678 / 13744550 / +1.1% 28648318 / 29352103 / -2.4% 0.49 / 0.47 / +3.6%
tpcds_q33/duckdb:vortex-file-compressed 34424042 / 34677902 / -0.7% 57912265 / 56234127 / +3.0% 0.59 / 0.62 / -3.6%
tpcds_q34/duckdb:vortex-file-compressed 22943394 / 22969670 / -0.1% 39032327 / 38109259 / +2.4% 0.59 / 0.60 / -2.5%
tpcds_q35/duckdb:vortex-file-compressed 67162904 / 67973400 / -1.2% 89108796 / 87774818 / +1.5% 0.75 / 0.77 / -2.7%
tpcds_q36/duckdb:vortex-file-compressed 28928481 / 29798050 / -2.9% 48219987 / 50744981 / -5.0% 0.60 / 0.59 / +2.2%
tpcds_q37/duckdb:vortex-file-compressed 27631412 / 27056984 / +2.1% 75289981 / 63501341 / +18.6% 🔴 0.37 / 0.43 / -13.9%
tpcds_q38/duckdb:vortex-file-compressed 61146586 / 65418466 / -6.5% 74300031 / 79214533 / -6.2% 0.82 / 0.83 / -0.3%
tpcds_q39/duckdb:vortex-file-compressed 58177528 / 59507598 / -2.2% 87366422 / 85059050 / +2.7% 0.67 / 0.70 / -4.8%
tpcds_q40/duckdb:vortex-file-compressed 19191733 / 18871024 / +1.7% 35468795 / 33673544 / +5.3% 0.54 / 0.56 / -3.4%
tpcds_q41/duckdb:vortex-file-compressed 19539864 / 19805286 / -1.3% 26331477 / 29362971 / -10.3% 🟢 0.74 / 0.67 / +10.0%
tpcds_q42/duckdb:vortex-file-compressed 14478460 / 13899774 / +4.2% 30783268 / 29210586 / +5.4% 0.47 / 0.48 / -1.2%
tpcds_q43/duckdb:vortex-file-compressed 20036941 / 19246490 / +4.1% 34725266 / 32560191 / +6.6% 0.58 / 0.59 / -2.4%
tpcds_q44/duckdb:vortex-file-compressed 28274626 / 28025286 / +0.9% 47998143 / 48655091 / -1.4% 0.59 / 0.58 / +2.3%
tpcds_q45/duckdb:vortex-file-compressed 47093386 / 47072534 / +0.0% 59844546 / 59554822 / +0.5% 0.79 / 0.79 / -0.4%
tpcds_q46/duckdb:vortex-file-compressed 51790376 / 50438530 / +2.7% 75844299 / 74694605 / +1.5% 0.68 / 0.68 / +1.1%
tpcds_q47/duckdb:vortex-file-compressed 80465133 / 80023928 / +0.6% 92935920 / 94571206 / -1.7% 0.87 / 0.85 / +2.3%
tpcds_q48/duckdb:vortex-file-compressed 53969608 / 54686811 / -1.3% 80827957 / 74230374 / +8.9% 0.67 / 0.74 / -9.4%
tpcds_q49/duckdb:vortex-file-compressed 38179355 / 37594846 / +1.6% 80440486 / 74467492 / +8.0% 0.47 / 0.50 / -6.0%
tpcds_q50/duckdb:vortex-file-compressed 31200209 / 32781100 / -4.8% 55256506 / 53162237 / +3.9% 0.56 / 0.62 / -8.4%
tpcds_q51/duckdb:vortex-file-compressed 204861664 / 203964206 / +0.4% 222294427 / 219753980 / +1.2% 0.92 / 0.93 / -0.7%
tpcds_q52/duckdb:vortex-file-compressed 14904647 / 14677496 / +1.5% 31399006 / 31526862 / -0.4% 0.47 / 0.47 / +2.0%
tpcds_q53/duckdb:vortex-file-compressed 22763900 / 22186665 / +2.6% 39453412 / 37074470 / +6.4% 0.58 / 0.60 / -3.6%
tpcds_q54/duckdb:vortex-file-compressed 45133760 / 44656646 / +1.1% 65388063 / 64461201 / +1.4% 0.69 / 0.69 / -0.4%
tpcds_q55/duckdb:vortex-file-compressed 14860548 / 14576306 / +2.0% 31219274 / 29207984 / +6.9% 0.48 / 0.50 / -4.6%
tpcds_q56/duckdb:vortex-file-compressed 34159400 / 33782552 / +1.1% 56033731 / 55297615 / +1.3% 0.61 / 0.61 / -0.2%
tpcds_q57/duckdb:vortex-file-compressed 72815278 / 65424170 / +11.3% 🔴 77903650 / 78631941 / -0.9% 0.93 / 0.83 / +12.3%
tpcds_q58/duckdb:vortex-file-compressed 38243604 / 38898298 / -1.7% 60040365 / 55844701 / +7.5% 0.64 / 0.70 / -8.6%
tpcds_q59/duckdb:vortex-file-compressed 53841478 / 53884934 / -0.1% 63053989 / 64106634 / -1.6% 0.85 / 0.84 / +1.6%
tpcds_q60/duckdb:vortex-file-compressed 35918543 / 35946234 / -0.1% 60267322 / 56917888 / +5.9% 0.60 / 0.63 / -5.6%
tpcds_q61/duckdb:vortex-file-compressed 34862978 / 35361596 / -1.4% 56656613 / 54931615 / +3.1% 0.62 / 0.64 / -4.4%
tpcds_q62/duckdb:vortex-file-compressed 15359487 / 15642241 / -1.8% 27123542 / 26437775 / +2.6% 0.57 / 0.59 / -4.3%
tpcds_q63/duckdb:vortex-file-compressed 21930116 / 21535454 / +1.8% 37759902 / 37891582 / -0.3% 0.58 / 0.57 / +2.2%
tpcds_q64/duckdb:vortex-file-compressed 119089834 / 118554184 / +0.5% 162704278 / 155152310 / +4.9% 0.73 / 0.76 / -4.2%
tpcds_q65/duckdb:vortex-file-compressed 51503744 / 51795274 / -0.6% 62477411 / 58381044 / +7.0% 0.82 / 0.89 / -7.1%
tpcds_q66/duckdb:vortex-file-compressed 41944424 / 43175862 / -2.9% 59132838 / 58144026 / +1.7% 0.71 / 0.74 / -4.5%
tpcds_q67/duckdb:vortex-file-compressed 271698403 / 279697525 / -2.9% 283716360 / 286952006 / -1.1% 0.96 / 0.97 / -1.8%
tpcds_q68/duckdb:vortex-file-compressed 43995716 / 43855412 / +0.3% 71503108 / 70889380 / +0.9% 0.62 / 0.62 / -0.5%
tpcds_q69/duckdb:vortex-file-compressed 38827042 / 38928932 / -0.3% 61155593 / 58818393 / +4.0% 0.63 / 0.66 / -4.1%
tpcds_q70/duckdb:vortex-file-compressed 24950160 / 25463294 / -2.0% 42543208 / 40384021 / +5.3% 0.59 / 0.63 / -7.0%
tpcds_q71/duckdb:vortex-file-compressed 27757483 / 28420039 / -2.3% 52786195 / 50106346 / +5.3% 0.53 / 0.57 / -7.3%
tpcds_q72/duckdb:vortex-file-compressed 139462969 / 139979520 / -0.4% 162624153 / 158903169 / +2.3% 0.86 / 0.88 / -2.6%
tpcds_q73/duckdb:vortex-file-compressed 20272388 / 20585262 / -1.5% 35547475 / 34351793 / +3.5% 0.57 / 0.60 / -4.8%
tpcds_q74/duckdb:vortex-file-compressed 82891175 / 82954312 / -0.1% 99156099 / 96750254 / +2.5% 0.84 / 0.86 / -2.5%
tpcds_q75/duckdb:vortex-file-compressed 110878866 / 111812181 / -0.8% 141124034 / 134642468 / +4.8% 0.79 / 0.83 / -5.4%
tpcds_q76/duckdb:vortex-file-compressed 28030650 / 28565848 / -1.9% 57756721 / 50818005 / +13.7% 🔴 0.49 / 0.56 / -13.7%
tpcds_q77/duckdb:vortex-file-compressed 37110788 / 37119674 / -0.0% 62458290 / 58001525 / +7.7% 0.59 / 0.64 / -7.2%
tpcds_q78/duckdb:vortex-file-compressed 135054988 / 134376332 / +0.5% 161075863 / 156253992 / +3.1% 0.84 / 0.86 / -2.5%
tpcds_q79/duckdb:vortex-file-compressed 37816656 / 37226774 / +1.6% 62485043 / 64984627 / -3.8% 0.61 / 0.57 / +5.6%
tpcds_q80/duckdb:vortex-file-compressed 59767167 / 60631832 / -1.4% 92625676 / 87730396 / +5.6% 0.65 / 0.69 / -6.6%
tpcds_q81/duckdb:vortex-file-compressed 57610446 / 56945055 / +1.2% 69672363 / 69412304 / +0.4% 0.83 / 0.82 / +0.8%
tpcds_q82/duckdb:vortex-file-compressed 29080942 / 29310453 / -0.8% 77646663 / 66476381 / +16.8% 🔴 0.37 / 0.44 / -15.1%
tpcds_q83/duckdb:vortex-file-compressed 21677881 / 22220825 / -2.4% 31031644 / 31287098 / -0.8% 0.70 / 0.71 / -1.6%
tpcds_q84/duckdb:vortex-file-compressed 13556556 / 13235808 / +2.4% 24339032 / 23242568 / +4.7% 0.56 / 0.57 / -2.2%
tpcds_q85/duckdb:vortex-file-compressed 36700117 / 36925374 / -0.6% 56514175 / 51546008 / +9.6% 0.65 / 0.72 / -9.3%
tpcds_q86/duckdb:vortex-file-compressed 18425251 / 17513178 / +5.2% 28438094 / 27253205 / +4.3% 0.65 / 0.64 / +0.8%
tpcds_q87/duckdb:vortex-file-compressed 74541214 / 77864842 / -4.3% 85377882 / 89463261 / -4.6% 0.87 / 0.87 / +0.3%
tpcds_q88/duckdb:vortex-file-compressed 38108166 / 38263800 / -0.4% 48146541 / 48154818 / -0.0% 0.79 / 0.79 / -0.4%
tpcds_q89/duckdb:vortex-file-compressed 24728448 / 24642745 / +0.3% 39728872 / 39097340 / +1.6% 0.62 / 0.63 / -1.2%
tpcds_q90/duckdb:vortex-file-compressed 10059672 / 9989277 / +0.7% 19897546 / 19596667 / +1.5% 0.51 / 0.51 / -0.8%
tpcds_q91/duckdb:vortex-file-compressed 19419062 / 19631830 / -1.1% 28718230 / 28502784 / +0.8% 0.68 / 0.69 / -1.8%
tpcds_q92/duckdb:vortex-file-compressed 13705498 / 13669336 / +0.3% 28297565 / 27546971 / +2.7% 0.48 / 0.50 / -2.4%
tpcds_q93/duckdb:vortex-file-compressed 25659190 / 25614763 / +0.2% 53145146 / 48903940 / +8.7% 0.48 / 0.52 / -7.8%
tpcds_q94/duckdb:vortex-file-compressed 32834278 / 32556908 / +0.9% 46394753 / 46308520 / +0.2% 0.71 / 0.70 / +0.7%
tpcds_q95/duckdb:vortex-file-compressed 97486930 / 94847437 / +2.8% 108642732 / 106019934 / +2.5% 0.90 / 0.89 / +0.3%
tpcds_q96/duckdb:vortex-file-compressed 12281448 / 11913750 / +3.1% 24793219 / 24940175 / -0.6% 0.50 / 0.48 / +3.7%
tpcds_q97/duckdb:vortex-file-compressed 60543004 / 61212860 / -1.1% 80214311 / 78071460 / +2.7% 0.75 / 0.78 / -3.7%
tpcds_q98/duckdb:vortex-file-compressed 26972360 / 27621885 / -2.4% 45384710 / 43376439 / +4.6% 0.59 / 0.64 / -6.7%
tpcds_q99/duckdb:vortex-file-compressed 22183720 / 22726621 / -2.4% 35218763 / 35480133 / -0.7% 0.63 / 0.64 / -1.7%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41411488 / 41754509 / -0.8% 50722548 / 49716420 / +2.0% 0.82 / 0.84 / -2.8%
tpcds_q02/duckdb:parquet 37898510 / 39320498 / -3.6% 45590425 / 48014421 / -5.0% 0.83 / 0.82 / +1.5%
tpcds_q03/duckdb:parquet 25493540 / 25927457 / -1.7% 38073559 / 36544174 / +4.2% 0.67 / 0.71 / -5.6%
tpcds_q04/duckdb:parquet 204501866 / 204404258 / +0.0% 229213718 / 225527266 / +1.6% 0.89 / 0.91 / -1.6%
tpcds_q05/duckdb:parquet 69427514 / 69257976 / +0.2% 85736673 / 85239338 / +0.6% 0.81 / 0.81 / -0.3%
tpcds_q06/duckdb:parquet 74624022 / 75009952 / -0.5% 88036835 / 86459760 / +1.8% 0.85 / 0.87 / -2.3%
tpcds_q07/duckdb:parquet 60860959 / 61347346 / -0.8% 78769475 / 78900270 / -0.2% 0.77 / 0.78 / -0.6%
tpcds_q08/duckdb:parquet 38518771 / 39528259 / -2.6% 45302476 / 47045239 / -3.7% 0.85 / 0.84 / +1.2%
tpcds_q09/duckdb:parquet 86256338 / 85242190 / +1.2% 96225737 / 99107059 / -2.9% 0.90 / 0.86 / +4.2%
tpcds_q10/duckdb:parquet 53099887 / 51215596 / +3.7% 65095929 / 60545042 / +7.5% 0.82 / 0.85 / -3.6%
tpcds_q11/duckdb:parquet 158195484 / 157115754 / +0.7% 168214797 / 167096251 / +0.7% 0.94 / 0.94 / +0.0%
tpcds_q12/duckdb:parquet 40001022 / 40352013 / -0.9% 46606474 / 47141692 / -1.1% 0.86 / 0.86 / +0.3%
tpcds_q13/duckdb:parquet 72327348 / 70020372 / +3.3% 93317466 / 85638270 / +9.0% 0.78 / 0.82 / -5.2%
tpcds_q14/duckdb:parquet 189038549 / 184880045 / +2.2% 201173251 / 198443193 / +1.4% 0.94 / 0.93 / +0.9%
tpcds_q15/duckdb:parquet 60553278 / 60771048 / -0.4% 67699175 / 67619690 / +0.1% 0.89 / 0.90 / -0.5%
tpcds_q16/duckdb:parquet 38100948 / 37994630 / +0.3% 46458023 / 45727616 / +1.6% 0.82 / 0.83 / -1.3%
tpcds_q17/duckdb:parquet 83225300 / 83160258 / +0.1% 90773771 / 89114981 / +1.9% 0.92 / 0.93 / -1.8%
tpcds_q18/duckdb:parquet 87851912 / 87879957 / -0.0% 97294576 / 95836133 / +1.5% 0.90 / 0.92 / -1.5%
tpcds_q19/duckdb:parquet 48435649 / 47515380 / +1.9% 63709511 / 61000663 / +4.4% 0.76 / 0.78 / -2.4%
tpcds_q20/duckdb:parquet 43255139 / 43268675 / -0.0% 49039223 / 53319914 / -8.0% 0.88 / 0.81 / +8.7%
tpcds_q21/duckdb:parquet 23739321 / 23792717 / -0.2% 28293984 / 30200345 / -6.3% 0.84 / 0.79 / +6.5%
tpcds_q22/duckdb:parquet 164610126 / 166859429 / -1.3% 164075757 / 164973195 / -0.5% 1.00 / 1.01 / -0.8%
tpcds_q23/duckdb:parquet 183804232 / 185062354 / -0.7% 192421528 / 194317115 / -1.0% 0.96 / 0.95 / +0.3%
tpcds_q24/duckdb:parquet 71419074 / 73795194 / -3.2% 82429408 / 81539892 / +1.1% 0.87 / 0.91 / -4.3%
tpcds_q25/duckdb:parquet 50949016 / 50609986 / +0.7% 60363467 / 59253909 / +1.9% 0.84 / 0.85 / -1.2%
tpcds_q26/duckdb:parquet 43018149 / 42341269 / +1.6% 52135298 / 50367988 / +3.5% 0.83 / 0.84 / -1.8%
tpcds_q27/duckdb:parquet 58318412 / 59273806 / -1.6% 73356913 / 74915572 / -2.1% 0.79 / 0.79 / +0.5%
tpcds_q28/duckdb:parquet 95155436 / 92538077 / +2.8% 107025703 / 108311955 / -1.2% 0.89 / 0.85 / +4.1%
tpcds_q29/duckdb:parquet 80597231 / 85143526 / -5.3% 98929003 / 97322888 / +1.7% 0.81 / 0.87 / -6.9%
tpcds_q30/duckdb:parquet 72681822 / 71883182 / +1.1% 81163417 / 79235601 / +2.4% 0.90 / 0.91 / -1.3%
tpcds_q31/duckdb:parquet 99569255 / 98352300 / +1.2% 110522222 / 110050281 / +0.4% 0.90 / 0.89 / +0.8%
tpcds_q32/duckdb:parquet 18290580 / 18136707 / +0.8% 25240620 / 25667997 / -1.7% 0.72 / 0.71 / +2.6%
tpcds_q33/duckdb:parquet 62273174 / 63106814 / -1.3% 75367609 / 75700594 / -0.4% 0.83 / 0.83 / -0.9%
tpcds_q34/duckdb:parquet 32213106 / 33253224 / -3.1% 41917325 / 39802094 / +5.3% 0.77 / 0.84 / -8.0%
tpcds_q35/duckdb:parquet 77399666 / 75987730 / +1.9% 87175833 / 90314190 / -3.5% 0.89 / 0.84 / +5.5%
tpcds_q36/duckdb:parquet 98447162 / 96353316 / +2.2% 115448830 / 111385494 / +3.6% 0.85 / 0.87 / -1.4%
tpcds_q37/duckdb:parquet 41331048 / 42209048 / -2.1% 47228679 / 47786871 / -1.2% 0.88 / 0.88 / -0.9%
tpcds_q38/duckdb:parquet 73945798 / 77958424 / -5.1% 84572625 / 85349165 / -0.9% 0.87 / 0.91 / -4.3%
tpcds_q39/duckdb:parquet 61329098 / 61486491 / -0.3% 67781618 / 68395844 / -0.9% 0.90 / 0.90 / +0.6%
tpcds_q40/duckdb:parquet 28139901 / 28074760 / +0.2% 36100815 / 35471051 / +1.8% 0.78 / 0.79 / -1.5%
tpcds_q41/duckdb:parquet 20114268 / 20300412 / -0.9% 27651180 / 27039573 / +2.3% 0.73 / 0.75 / -3.1%
tpcds_q42/duckdb:parquet 26070425 / 25832600 / +0.9% 36794055 / 37396731 / -1.6% 0.71 / 0.69 / +2.6%
tpcds_q43/duckdb:parquet 26359060 / 27833256 / -5.3% 35152328 / 37569548 / -6.4% 0.75 / 0.74 / +1.2%
tpcds_q44/duckdb:parquet 60860052 / 61917711 / -1.7% 73866112 / 76056446 / -2.9% 0.82 / 0.81 / +1.2%
tpcds_q45/duckdb:parquet 61797666 / 60935476 / +1.4% 69587529 / 66445419 / +4.7% 0.89 / 0.92 / -3.2%
tpcds_q46/duckdb:parquet 70617040 / 74233802 / -4.9% 83876694 / 85326401 / -1.7% 0.84 / 0.87 / -3.2%
tpcds_q47/duckdb:parquet 90699316 / 91376278 / -0.7% 101986737 / 100561337 / +1.4% 0.89 / 0.91 / -2.1%
tpcds_q48/duckdb:parquet 65213918 / 65415782 / -0.3% 77260455 / 77089178 / +0.2% 0.84 / 0.85 / -0.5%
tpcds_q49/duckdb:parquet 68439299 / 68736560 / -0.4% 85792609 / 88271949 / -2.8% 0.80 / 0.78 / +2.4%
tpcds_q50/duckdb:parquet 45048000 / 44405659 / +1.4% 54920346 / 50047873 / +9.7% 0.82 / 0.89 / -7.6%
tpcds_q51/duckdb:parquet 218215885 / 215203352 / +1.4% 227530549 / 225668772 / +0.8% 0.96 / 0.95 / +0.6%
tpcds_q52/duckdb:parquet 27521696 / 26929999 / +2.2% 37310424 / 37851845 / -1.4% 0.74 / 0.71 / +3.7%
tpcds_q53/duckdb:parquet 34105638 / 35085957 / -2.8% 45497378 / 45697835 / -0.4% 0.75 / 0.77 / -2.4%
tpcds_q54/duckdb:parquet 55313813 / 55066050 / +0.4% 65500091 / 62823873 / +4.3% 0.84 / 0.88 / -3.7%
tpcds_q55/duckdb:parquet 27438200 / 27167385 / +1.0% 38188645 / 36846878 / +3.6% 0.72 / 0.74 / -2.6%
tpcds_q56/duckdb:parquet 70151978 / 69810094 / +0.5% 83785890 / 78191395 / +7.2% 0.84 / 0.89 / -6.2%
tpcds_q57/duckdb:parquet 68590491 / 67924052 / +1.0% 75345360 / 75378836 / -0.0% 0.91 / 0.90 / +1.0%
tpcds_q58/duckdb:parquet 56007334 / 55636208 / +0.7% 65981770 / 67771566 / -2.6% 0.85 / 0.82 / +3.4%
tpcds_q59/duckdb:parquet 61422110 / 60888385 / +0.9% 68569135 / 69281606 / -1.0% 0.90 / 0.88 / +1.9%
tpcds_q60/duckdb:parquet 80779756 / 82995592 / -2.7% 94198306 / 93609037 / +0.6% 0.86 / 0.89 / -3.3%
tpcds_q61/duckdb:parquet 78789288 / 79843582 / -1.3% 94742809 / 96209480 / -1.5% 0.83 / 0.83 / +0.2%
tpcds_q62/duckdb:parquet 20524730 / 22427732 / -8.5% 28345100 / 26553261 / +6.7% 0.72 / 0.84 / -14.3%
tpcds_q63/duckdb:parquet 33869945 / 32945599 / +2.8% 43162834 / 44810985 / -3.7% 0.78 / 0.74 / +6.7%
tpcds_q64/duckdb:parquet 135381346 / 137730810 / -1.7% 155640604 / 162467301 / -4.2% 0.87 / 0.85 / +2.6%
tpcds_q65/duckdb:parquet 93113425 / 90841106 / +2.5% 104980313 / 98758923 / +6.3% 0.89 / 0.92 / -3.6%
tpcds_q66/duckdb:parquet 45147164 / 46229679 / -2.3% 54288906 / 52011770 / +4.4% 0.83 / 0.89 / -6.4%
tpcds_q67/duckdb:parquet 293062262 / 296484754 / -1.2% 313367884 / 300794460 / +4.2% 0.94 / 0.99 / -5.1%
tpcds_q68/duckdb:parquet 63476950 / 62271290 / +1.9% 74277586 / 79884988 / -7.0% 0.85 / 0.78 / +9.6%
tpcds_q69/duckdb:parquet 65476531 / 66823133 / -2.0% 76134017 / 75751375 / +0.5% 0.86 / 0.88 / -2.5%
tpcds_q70/duckdb:parquet 44229654 / 43502914 / +1.7% 53311203 / 51876494 / +2.8% 0.83 / 0.84 / -1.1%
tpcds_q71/duckdb:parquet 40897846 / 40235578 / +1.6% 52700653 / 53331431 / -1.2% 0.78 / 0.75 / +2.9%
tpcds_q72/duckdb:parquet 172983070 / 171234634 / +1.0% 186614084 / 185887233 / +0.4% 0.93 / 0.92 / +0.6%
tpcds_q73/duckdb:parquet 28024470 / 28539550 / -1.8% 34920459 / 38525179 / -9.4% 0.80 / 0.74 / +8.3%
tpcds_q74/duckdb:parquet 215741292 / 214701141 / +0.5% 224166759 / 226612264 / -1.1% 0.96 / 0.95 / +1.6%
tpcds_q75/duckdb:parquet 132582254 / 136513298 / -2.9% 149324939 / 144305040 / +3.5% 0.89 / 0.95 / -6.1%
tpcds_q76/duckdb:parquet 52020290 / 52107498 / -0.2% 64448391 / 66393995 / -2.9% 0.81 / 0.78 / +2.8%
tpcds_q77/duckdb:parquet 55008386 / 53680122 / +2.5% 74372472 / 68802211 / +8.1% 0.74 / 0.78 / -5.2%
tpcds_q78/duckdb:parquet 150203378 / 146481247 / +2.5% 168241752 / 173928138 / -3.3% 0.89 / 0.84 / +6.0%
tpcds_q79/duckdb:parquet 53949648 / 52912912 / +2.0% 65194726 / 69766888 / -6.6% 0.83 / 0.76 / +9.1%
tpcds_q80/duckdb:parquet 82795182 / 84091399 / -1.5% 101477778 / 101467325 / +0.0% 0.82 / 0.83 / -1.6%
tpcds_q81/duckdb:parquet 97904116 / 96942804 / +1.0% 106513236 / 105070620 / +1.4% 0.92 / 0.92 / -0.4%
tpcds_q82/duckdb:parquet 46933251 / 46487240 / +1.0% 53911741 / 53044060 / +1.6% 0.87 / 0.88 / -0.7%
tpcds_q83/duckdb:parquet 28202352 / 28126860 / +0.3% 33147289 / 33556853 / -1.2% 0.85 / 0.84 / +1.5%
tpcds_q84/duckdb:parquet 22765119 / 22718850 / +0.2% 29387545 / 28854283 / +1.8% 0.77 / 0.79 / -1.6%
tpcds_q85/duckdb:parquet 51594270 / 51569898 / +0.0% 66350611 / 60972055 / +8.8% 0.78 / 0.85 / -8.1%
tpcds_q86/duckdb:parquet 24515236 / 25653376 / -4.4% 32981130 / 32290498 / +2.1% 0.74 / 0.79 / -6.4%
tpcds_q87/duckdb:parquet 88820326 / 86041585 / +3.2% 95136321 / 96073615 / -1.0% 0.93 / 0.90 / +4.2%
tpcds_q88/duckdb:parquet 104981436 / 104156077 / +0.8% 111851135 / 113708809 / -1.6% 0.94 / 0.92 / +2.5%
tpcds_q89/duckdb:parquet 37301306 / 37221714 / +0.2% 48282456 / 52543843 / -8.1% 0.77 / 0.71 / +9.1%
tpcds_q90/duckdb:parquet 14904518 / 15320644 / -2.7% 20364082 / 19638004 / +3.7% 0.73 / 0.78 / -6.2%
tpcds_q91/duckdb:parquet 25801682 / 25533825 / +1.0% 32801244 / 32629028 / +0.5% 0.79 / 0.78 / +0.5%
tpcds_q92/duckdb:parquet 22113162 / 22457040 / -1.5% 29516559 / 29600706 / -0.3% 0.75 / 0.76 / -1.3%
tpcds_q93/duckdb:parquet 34660434 / 36522483 / -5.1% 49484404 / 49556338 / -0.1% 0.70 / 0.74 / -5.0%
tpcds_q94/duckdb:parquet 39694443 / 38221661 / +3.9% 47571879 / 47915670 / -0.7% 0.83 / 0.80 / +4.6%
tpcds_q95/duckdb:parquet 82836822 / 80753512 / +2.6% 99675288 / 88826826 / +12.2% 🔴 0.83 / 0.91 / -8.6%
tpcds_q96/duckdb:parquet 17592992 / 17701885 / -0.6% 22686470 / 22852748 / -0.7% 0.78 / 0.77 / +0.1%
tpcds_q97/duckdb:parquet 72045327 / 72195042 / -0.2% 86266854 / 85867593 / +0.5% 0.84 / 0.84 / -0.7%
tpcds_q98/duckdb:parquet 54839254 / 54526654 / +0.6% 67137911 / 67784295 / -1.0% 0.82 / 0.80 / +1.5%
tpcds_q99/duckdb:parquet 24409940 / 25590772 / -4.6% 31705105 / 32382010 / -2.1% 0.77 / 0.79 / -2.6%

No baseline file sizes found for base commit.

@joseph-isaacs
joseph-isaacs merged commit eacb353 into develop Nov 13, 2026
114 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/friendly-noether-hk4glm branch November 13, 2026 14:16
joseph-isaacs added a commit that referenced this pull request Nov 13, 2026
develop (#11443, #11444) made "Capture file sizes" append file-size records to
results.ingest.jsonl, which "Fetch baseline" reads, and added the sampled file
tree dump and upload. The benchmark job now runs the capture alongside the
dump, then the tree upload alongside the baseline fetch, so the fetch still
sees the file-size records.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
joseph-isaacs added a commit that referenced this pull request Nov 13, 2026
## Summary

#11443 started storing SQL benchmark file sizes in the benchmarks
database, but only for `vortex-file-compressed` and `vortex-compact`.
This PR stores every on-disk format, so bench can chart Parquet, DuckDB,
Lance and the rest beside Vortex (vortex-data/vortex.dev#222). PR
comments still compare only the Vortex formats.

## Changes

- `scripts/capture-file-sizes.py` records every format directory that
`Format::name()` in `vortex-bench/src/lib.rs` names: `arrow-ipc`, `csv`,
`duckdb`, `lance`, `litdata`, `parquet`, `vortex-compact`,
`vortex-file-compressed` and `vortex-spatial-native`. Each develop
commit adds roughly one row per Parquet file; ClickBench has about 100.
- **DuckDB catalogs:** DuckDB keeps a catalog of views (`duckdb.db`, and
`duckdb.db.wal` while open) in every format directory it queries
(`duckdb-bench/src/lib.rs`). That isn't the format's data, so it's now
skipped everywhere except the `duckdb` directory, where the database is
the data. This also takes the catalog out of the Vortex totals. Rows
recorded today include it, so PR comments based on today's develop
commits list `duckdb.db` as a removed file, once.
- `scripts/compare-benchmark-jsons.py`: the "File Size Changes" section
compares only formats starting with `vortex`. The other formats' files
come from the data generators and don't change with a Vortex PR.

New tests check that capture records every format, skips the DuckDB
catalogs outside `duckdb`, and ignores unknown directories. Another
checks that the report leaves out non-Vortex formats.

### Checks

- `uv run --no-project --with pytest --with pandas --with numpy --with
orjson --with tabulate --with xxhash pytest
scripts/tests/test_measurement_id.py
scripts/tests/test_benchmark_reporting.py
scripts/tests/test_post_ingest.py`: 49 passed.
- `uvx ruff format --check` and `uvx ruff check` on the changed files
pass, as does `git diff --check`.
- Not run: a CI benchmark run. `action/bench-sql` on this PR would
exercise capture and the comment. The new formats only reach the
database from develop runs.

---
_Generated by [Claude
Code](https://claude.ai/code/session_01UeniB9quRiv5fCx8AhzH9s)_

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants