Skip to content

Run independent benchmark setup steps in parallel - #11445

Merged
joseph-isaacs merged 5 commits into
developfrom
ji/confident-allen-2ohb41
Nov 13, 2026
Merged

joseph-isaacs merged 5 commits into
developfrom
ji/confident-allen-2ohb41

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Summary

The benchmark jobs run every setup step one after another, even though most of the steps don't depend on each other. This change groups the independent steps into parallel: blocks, the same way ci.yml already does, to shorten the time a benchmark machine spends before the timed run. It also moves the Polar Signals debuginfo upload out of the build jobs, so the bench jobs no longer wait for it.

joseph-isaacs and others added 3 commits November 13, 2026 13:45
The SQL, PR and develop benchmark jobs ran every setup step one after another.
Group the steps that do not depend on each other into `parallel:` blocks:

- runs-on/action alongside checkout, and assert-cpu alongside setup-prebuild.
- setup-prebuild, uv, DuckDB, system info, binary download, AWS credentials,
  the Polar Signals agent and the data cache key all at once before data
  generation, then chmod, LitData and the cache restore.
- debuginfo and binary uploads together after the build.
- the S3 data upload alongside the cache save or Polar Signals setup.
  setup-benchmark.sh still runs after them, since it pins every running
  process to the housekeeping CPUs.
- file size capture alongside the baseline fetch.

Also fix the SQL build's debuginfo upload: `polarsignals-cloud-token` and
`project-id` were indented into the `paths` block, so the action never got them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
… jobs

Extend the parallel setup to the remaining benchmark workflows:

- codspeed.yml: runs-on/action alongside checkout (or shard selection),
  setup-prebuild alongside system-info, the artifact download alongside the
  toolchain setup, and the cargo-codspeed install alongside unpacking.
- pr-bench-gpu-compress.yml: the Rust, DuckDB and uv installs, system info and
  nvidia-smi together, then the cuDF install alongside the benchmark build.
- s3-measurements.yml: only the setup before the timed schedule.

The CodSpeed install still waits for setup-prebuild or setup-rust, since it
needs the toolchain they install.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
develop (#11443, #11444) made "Capture file sizes" append file-size records to
results.ingest.jsonl, which "Fetch baseline" reads, and added the sampled file
tree dump and upload. The benchmark job now runs the capture alongside the
dump, then the tree upload alongside the baseline fetch, so the fetch still
sees the file-size records.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/ci action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026
@codspeed

codspeed Bot commented Nov 13, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 11.75%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 2 improved benchmarks
✅ 1981 untouched benchmarks
⏩ 3 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ CPU Simulation test_repeated_scan_scalar_at[int_float] 317.2 µs 283.6 µs +11.84%
⚡ Walltime scalar_subtract_neon 12.9 µs 11.6 µs +11.66%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/confident-allen-2ohb41 (31d2f1e) with develop (eacb353)

Open in CodSpeed

Footnotes

  1. 3 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 31d2f1e clickbench-nvme 1 Explore Profiling Data
🟢 Done 31d2f1e tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 31d2f1e string-bench 1 Explore Profiling Data
🟢 Done 31d2f1e polarsignals 1 Explore Profiling Data
🟢 Done 31d2f1e tpch-nvme-10 1 Explore Profiling Data
🟢 Done 31d2f1e fineweb 1 Explore Profiling Data
🟢 Done 31d2f1e tpch-s3 1 Explore Profiling Data
🟢 Done 31d2f1e tpch-nvme 1 Explore Profiling Data
🟢 Done 31d2f1e tpcds-nvme 1 Explore Profiling Data
Previous Runs (8)
Status Commit Job Attempt Link
🟢 Done eda2753 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done eda2753 clickbench-nvme 1 Explore Profiling Data
🟢 Done eda2753 fineweb 1 Explore Profiling Data
🟢 Done eda2753 tpcds-nvme 1 Explore Profiling Data
🟢 Done eda2753 polarsignals 1 Explore Profiling Data
🟢 Done eda2753 tpch-nvme-10 1 Explore Profiling Data
🟢 Done eda2753 tpch-nvme 1 Explore Profiling Data
🟢 Done eda2753 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 31d2f1e8 vs base eacb3538
Vortex (geomean): hot 1.030x ➖ · cold 0.861x ✅


datafusion / vortex-file-compressed / ns (1.030x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 80689593 / 80957022 / -0.3% 115814719 / 121284142 / -4.5% 0.70 / 0.67 / +4.4%
polarsignals_q01/datafusion:vortex-file-compressed 88517724 / 88543000 / -0.0% 138570846 / 149934900 / -7.6% 0.64 / 0.59 / +8.2%
polarsignals_q02/datafusion:vortex-file-compressed 13023666 / 11370408 / +14.5% 🔴 38914974 / 45418293 / -14.3% 🟢 0.33 / 0.25 / +33.7%
polarsignals_q03/datafusion:vortex-file-compressed 90919877 / 90483360 / +0.5% 146206291 / 155744400 / -6.1% 0.62 / 0.58 / +7.0%
polarsignals_q04/datafusion:vortex-file-compressed 9204724 / 9373486 / -1.8% 33955924 / 41999728 / -19.2% 🟢 0.27 / 0.22 / +21.5%
polarsignals_q05/datafusion:vortex-file-compressed 11613785 / 11518021 / +0.8% 37170285 / 45021970 / -17.4% 🟢 0.31 / 0.26 / +22.1%
polarsignals_q06/datafusion:vortex-file-compressed 23036780 / 22582504 / +2.0% 46925481 / 56318049 / -16.7% 🟢 0.49 / 0.40 / +22.4%
polarsignals_q07/datafusion:vortex-file-compressed 10622740 / 10682087 / -0.6% 35552660 / 44098606 / -19.4% 🟢 0.30 / 0.24 / +23.3%
polarsignals_q08/datafusion:vortex-file-compressed 167980598 / 133710364 / +25.6% 🔴 185173893 / 194277985 / -4.7% 0.91 / 0.69 / +31.8%
polarsignals_q09/datafusion:vortex-file-compressed 10022745 / 9782482 / +2.5% 32312845 / 40254790 / -19.7% 🟢 0.31 / 0.24 / +27.6%
polarsignals_q10/datafusion:vortex-file-compressed 12873438 / 12906686 / -0.3% 43905193 / 52238277 / -16.0% 🟢 0.29 / 0.25 / +18.7%
polarsignals_q11/datafusion:vortex-file-compressed 16090012 / 16004176 / +0.5% 42225841 / 50108366 / -15.7% 🟢 0.38 / 0.32 / +19.3%
polarsignals_q12/datafusion:vortex-file-compressed 16633158 / 16816219 / -1.1% 40825409 / 49322691 / -17.2% 🟢 0.41 / 0.34 / +19.5%

No file size changes detected.

Once its inputs were fixed, the Polar Signals debuginfo upload took 5m37s in
the build job. That took the build job from 4m50s to 8m32s, and every bench job
waits for it. The upload now runs in its own job on an arm64-medium runner.
It downloads the build artifact and uploads alongside the bench jobs.
Polar Signals matches debuginfo to profiles by build ID, so the later upload
still symbolizes them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 31d2f1e8 vs base eacb3538
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.991x ➖
Parquet (geomean): hot 1.008x ➖ · cold 0.977x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6025222 / 6125492 / -1.6% 19350763 / 20012977 / -3.3% 0.31 / 0.31 / +1.7%
fineweb_q01/datafusion:vortex-file-compressed 8590892 / 9004160 / -4.6% 38995765 / 40075665 / -2.7% 0.22 / 0.22 / -1.9%
fineweb_q02/datafusion:vortex-file-compressed 10931366 / 10930490 / +0.0% 41644715 / 42555848 / -2.1% 0.26 / 0.26 / +2.2%
fineweb_q03/datafusion:vortex-file-compressed 17812214 / 17342202 / +2.7% 105492505 / 101913072 / +3.5% 0.17 / 0.17 / -0.8%
fineweb_q04/datafusion:vortex-file-compressed 64187242 / 65297917 / -1.7% 140848929 / 141770760 / -0.7% 0.46 / 0.46 / -1.1%
fineweb_q05/datafusion:vortex-file-compressed 62167109 / 64687594 / -3.9% 140941074 / 134691639 / +4.6% 0.44 / 0.48 / -8.2%
fineweb_q06/datafusion:vortex-file-compressed 16533355 / 16616140 / -0.5% 101493977 / 98633518 / +2.9% 0.16 / 0.17 / -3.3%
fineweb_q07/datafusion:vortex-file-compressed 18601041 / 17418066 / +6.8% 103197462 / 99958329 / +3.2% 0.18 / 0.17 / +3.4%
fineweb_q08/datafusion:vortex-file-compressed 10059390 / 9866852 / +2.0% 29012943 / 25883631 / +12.1% 🔴 0.35 / 0.38 / -9.0%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9863888 / 9672847 / +2.0% 33511569 / 33419709 / +0.3% 0.29 / 0.29 / +1.7%
fineweb_q01/datafusion:parquet 74994296 / 76004037 / -1.3% 145173675 / 152898770 / -5.1% 0.52 / 0.50 / +3.9%
fineweb_q02/datafusion:parquet 74161446 / 74723460 / -0.8% 154425727 / 156785469 / -1.5% 0.48 / 0.48 / +0.8%
fineweb_q03/datafusion:parquet 73030830 / 73563502 / -0.7% 145314658 / 153313223 / -5.2% 0.50 / 0.48 / +4.7%
fineweb_q04/datafusion:parquet 81552822 / 82237518 / -0.8% 148579512 / 158405443 / -6.2% 0.55 / 0.52 / +5.7%
fineweb_q05/datafusion:parquet 80795449 / 80237534 / +0.7% 150413610 / 157797896 / -4.7% 0.54 / 0.51 / +5.6%
fineweb_q06/datafusion:parquet 75200745 / 75067380 / +0.2% 147163466 / 161402525 / -8.8% 0.51 / 0.47 / +9.9%
fineweb_q07/datafusion:parquet 74443312 / 76462997 / -2.6% 150192676 / 159735612 / -6.0% 0.50 / 0.48 / +3.5%
fineweb_q08/datafusion:parquet 73886054 / 73541896 / +0.5% 145815322 / 152247580 / -4.2% 0.51 / 0.48 / +4.9%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2180806 / 2060610 / +5.8% 7364098 / 8182790 / -10.0% 🟢 0.30 / 0.25 / +17.6%
fineweb_q01/duckdb:vortex-file-compressed 8930750 / 8616094 / +3.7% 25424458 / 27927037 / -9.0% 0.35 / 0.31 / +13.9%
fineweb_q02/duckdb:vortex-file-compressed 10398586 / 10409144 / -0.1% 27899420 / 30191625 / -7.6% 0.37 / 0.34 / +8.1%
fineweb_q03/duckdb:vortex-file-compressed 17316770 / 17887106 / -3.2% 89303021 / 88270577 / +1.2% 0.19 / 0.20 / -4.3%
fineweb_q04/duckdb:vortex-file-compressed 69113467 / 69154610 / -0.1% 109173994 / 108957824 / +0.2% 0.63 / 0.63 / -0.3%
fineweb_q05/duckdb:vortex-file-compressed 68180358 / 68056241 / +0.2% 109263822 / 110316079 / -1.0% 0.62 / 0.62 / +1.1%
fineweb_q06/duckdb:vortex-file-compressed 17894927 / 18490017 / -3.2% 87042908 / 86682827 / +0.4% 0.21 / 0.21 / -3.6%
fineweb_q07/duckdb:vortex-file-compressed 19471488 / 19181942 / +1.5% 88710913 / 89286952 / -0.6% 0.22 / 0.21 / +2.2%
fineweb_q08/duckdb:vortex-file-compressed 4568272 / 4590397 / -0.5% 11742451 / 12341600 / -4.9% 0.39 / 0.37 / +4.6%
duckdb / parquet / ns (1.018x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23738628 / 23083432 / +2.8% 28053208 / 27922010 / +0.5% 0.85 / 0.83 / +2.4%
fineweb_q01/duckdb:parquet 54560518 / 53145157 / +2.7% 72125528 / 70044899 / +3.0% 0.76 / 0.76 / -0.3%
fineweb_q02/duckdb:parquet 58095820 / 56102362 / +3.6% 74081461 / 77200382 / -4.0% 0.78 / 0.73 / +7.9%
fineweb_q03/duckdb:parquet 120114130 / 119370746 / +0.6% 180949620 / 176130982 / +2.7% 0.66 / 0.68 / -2.1%
fineweb_q04/duckdb:parquet 162128237 / 161290326 / +0.5% 205048087 / 210260144 / -2.5% 0.79 / 0.77 / +3.1%
fineweb_q05/duckdb:parquet 158412917 / 157675808 / +0.5% 197579687 / 203748175 / -3.0% 0.80 / 0.77 / +3.6%
fineweb_q06/duckdb:parquet 88318694 / 88175056 / +0.2% 148292971 / 146692773 / +1.1% 0.60 / 0.60 / -0.9%
fineweb_q07/duckdb:parquet 90898868 / 89862386 / +1.2% 145861262 / 143280898 / +1.8% 0.62 / 0.63 / -0.6%
fineweb_q08/duckdb:parquet 29368192 / 28030750 / +4.8% 30518462 / 29888032 / +2.1% 0.96 / 0.94 / +2.6%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 31d2f1e8 vs base eacb3538
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 1.016x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15916398 / 15530438 / +2.5% 44101854 / 42547436 / +3.7% 0.36 / 0.37 / -1.1%
tpch_q02/datafusion:vortex-file-compressed 17248436 / 17185123 / +0.4% 38214448 / 39540741 / -3.4% 0.45 / 0.43 / +3.9%
tpch_q03/datafusion:vortex-file-compressed 19543552 / 19507512 / +0.2% 49447430 / 46808732 / +5.6% 0.40 / 0.42 / -5.2%
tpch_q04/datafusion:vortex-file-compressed 10531771 / 10635839 / -1.0% 36162649 / 33873626 / +6.8% 0.29 / 0.31 / -7.2%
tpch_q05/datafusion:vortex-file-compressed 37009038 / 37642244 / -1.7% 70092193 / 66424762 / +5.5% 0.53 / 0.57 / -6.8%
tpch_q06/datafusion:vortex-file-compressed 4300046 / 4301190 / -0.0% 30278291 / 27453316 / +10.3% 🔴 0.14 / 0.16 / -9.4%
tpch_q07/datafusion:vortex-file-compressed 52553514 / 52639117 / -0.2% 83672105 / 78880702 / +6.1% 0.63 / 0.67 / -5.9%
tpch_q08/datafusion:vortex-file-compressed 52995695 / 52281284 / +1.4% 79341575 / 86811193 / -8.6% 0.67 / 0.60 / +10.9%
tpch_q09/datafusion:vortex-file-compressed 48114299 / 48800602 / -1.4% 82083400 / 81557155 / +0.6% 0.59 / 0.60 / -2.0%
tpch_q10/datafusion:vortex-file-compressed 17494541 / 17886047 / -2.2% 50022133 / 49694745 / +0.7% 0.35 / 0.36 / -2.8%
tpch_q11/datafusion:vortex-file-compressed 14614136 / 14453083 / +1.1% 35154818 / 34743458 / +1.2% 0.42 / 0.42 / -0.1%
tpch_q12/datafusion:vortex-file-compressed 18354816 / 18447428 / -0.5% 48207661 / 42590124 / +13.2% 🔴 0.38 / 0.43 / -12.1%
tpch_q13/datafusion:vortex-file-compressed 20252870 / 19588185 / +3.4% 43813477 / 43202919 / +1.4% 0.46 / 0.45 / +2.0%
tpch_q14/datafusion:vortex-file-compressed 14343906 / 13913986 / +3.1% 38619121 / 40281737 / -4.1% 0.37 / 0.35 / +7.5%
tpch_q15/datafusion:vortex-file-compressed 18328189 / 18315305 / +0.1% 45725090 / 45955532 / -0.5% 0.40 / 0.40 / +0.6%
tpch_q16/datafusion:vortex-file-compressed 18432657 / 18171059 / +1.4% 39460775 / 40301361 / -2.1% 0.47 / 0.45 / +3.6%
tpch_q17/datafusion:vortex-file-compressed 29564635 / 29001691 / +1.9% 60097835 / 59630915 / +0.8% 0.49 / 0.49 / +1.1%
tpch_q18/datafusion:vortex-file-compressed 36376231 / 36628725 / -0.7% 60709337 / 58151239 / +4.4% 0.60 / 0.63 / -4.9%
tpch_q19/datafusion:vortex-file-compressed 10303333 / 9415047 / +9.4% 38627617 / 37324024 / +3.5% 0.27 / 0.25 / +5.7%
tpch_q20/datafusion:vortex-file-compressed 20905432 / 21093714 / -0.9% 49652139 / 52210436 / -4.9% 0.42 / 0.40 / +4.2%
tpch_q21/datafusion:vortex-file-compressed 36425297 / 35952730 / +1.3% 65546203 / 68612744 / -4.5% 0.56 / 0.52 / +6.1%
tpch_q22/datafusion:vortex-file-compressed 10951300 / 10906857 / +0.4% 32509175 / 32062185 / +1.4% 0.34 / 0.34 / -1.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71400939 / 71205705 / +0.3% 90011963 / 92886572 / -3.1% 0.79 / 0.77 / +3.5%
tpch_q02/datafusion:parquet 76143529 / 75859133 / +0.4% 92661932 / 92261538 / +0.4% 0.82 / 0.82 / -0.1%
tpch_q03/datafusion:parquet 81993209 / 81565683 / +0.5% 105280029 / 105185019 / +0.1% 0.78 / 0.78 / +0.4%
tpch_q04/datafusion:parquet 39613465 / 39136515 / +1.2% 58345393 / 58250324 / +0.2% 0.68 / 0.67 / +1.1%
tpch_q05/datafusion:parquet 109185915 / 110435615 / -1.1% 136762293 / 137365331 / -0.4% 0.80 / 0.80 / -0.7%
tpch_q06/datafusion:parquet 31535403 / 31332541 / +0.6% 49297960 / 48272388 / +2.1% 0.64 / 0.65 / -1.4%
tpch_q07/datafusion:parquet 112834188 / 112794343 / +0.0% 137902018 / 141286691 / -2.4% 0.82 / 0.80 / +2.5%
tpch_q08/datafusion:parquet 116911722 / 117181790 / -0.2% 144798327 / 144235378 / +0.4% 0.81 / 0.81 / -0.6%
tpch_q09/datafusion:parquet 137379514 / 137754042 / -0.3% 165605858 / 166611850 / -0.6% 0.83 / 0.83 / +0.3%
tpch_q10/datafusion:parquet 102892445 / 103753394 / -0.8% 128138685 / 129632122 / -1.2% 0.80 / 0.80 / +0.3%
tpch_q11/datafusion:parquet 61506478 / 62525185 / -1.6% 81780290 / 80981607 / +1.0% 0.75 / 0.77 / -2.6%
tpch_q12/datafusion:parquet 63282689 / 63280930 / +0.0% 85879158 / 83379692 / +3.0% 0.74 / 0.76 / -2.9%
tpch_q13/datafusion:parquet 143844147 / 143397268 / +0.3% 162122224 / 163555965 / -0.9% 0.89 / 0.88 / +1.2%
tpch_q14/datafusion:parquet 47091053 / 47690124 / -1.3% 69966555 / 71627175 / -2.3% 0.67 / 0.67 / +1.1%
tpch_q15/datafusion:parquet 73755934 / 73719208 / +0.0% 93326655 / 94594538 / -1.3% 0.79 / 0.78 / +1.4%
tpch_q16/datafusion:parquet 43697954 / 43701201 / -0.0% 61276058 / 61583751 / -0.5% 0.71 / 0.71 / +0.5%
tpch_q17/datafusion:parquet 123306798 / 122885136 / +0.3% 146060485 / 147834912 / -1.2% 0.84 / 0.83 / +1.6%
tpch_q18/datafusion:parquet 120672857 / 120039268 / +0.5% 143512660 / 141716142 / +1.3% 0.84 / 0.85 / -0.7%
tpch_q19/datafusion:parquet 56595320 / 56491507 / +0.2% 83734650 / 82268877 / +1.8% 0.68 / 0.69 / -1.6%
tpch_q20/datafusion:parquet 78260143 / 77258949 / +1.3% 102258543 / 103412159 / -1.1% 0.77 / 0.75 / +2.4%
tpch_q21/datafusion:parquet 113399109 / 113367542 / +0.0% 138429395 / 139854152 / -1.0% 0.82 / 0.81 / +1.1%
tpch_q22/datafusion:parquet 52130685 / 51763803 / +0.7% 69325032 / 67423075 / +2.8% 0.75 / 0.77 / -2.1%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9235755 / 8443671 / +9.4% 18568916 / 19716745 / -5.8% 0.50 / 0.43 / +16.1%
tpch_q02/duckdb:vortex-file-compressed 15074439 / 14936138 / +0.9% 25329434 / 24917754 / +1.7% 0.60 / 0.60 / -0.7%
tpch_q03/duckdb:vortex-file-compressed 18676508 / 18449986 / +1.2% 35224354 / 34178902 / +3.1% 0.53 / 0.54 / -1.8%
tpch_q04/duckdb:vortex-file-compressed 12170000 / 12063315 / +0.9% 27487475 / 25777283 / +6.6% 0.44 / 0.47 / -5.4%
tpch_q05/duckdb:vortex-file-compressed 19896218 / 19355227 / +2.8% 36279457 / 35891013 / +1.1% 0.55 / 0.54 / +1.7%
tpch_q06/duckdb:vortex-file-compressed 4571436 / 4463808 / +2.4% 14423095 / 14192445 / +1.6% 0.32 / 0.31 / +0.8%
tpch_q07/duckdb:vortex-file-compressed 23750254 / 24040951 / -1.2% 41574630 / 41522055 / +0.1% 0.57 / 0.58 / -1.3%
tpch_q08/duckdb:vortex-file-compressed 20495767 / 20685318 / -0.9% 37494671 / 36270438 / +3.4% 0.55 / 0.57 / -4.2%
tpch_q09/duckdb:vortex-file-compressed 21982116 / 21727228 / +1.2% 41228087 / 38523711 / +7.0% 0.53 / 0.56 / -5.5%
tpch_q10/duckdb:vortex-file-compressed 27531060 / 27373022 / +0.6% 45057118 / 44065315 / +2.3% 0.61 / 0.62 / -1.6%
tpch_q11/duckdb:vortex-file-compressed 8057488 / 7891472 / +2.1% 17170044 / 16862763 / +1.8% 0.47 / 0.47 / +0.3%
tpch_q12/duckdb:vortex-file-compressed 14649834 / 14572697 / +0.5% 26484363 / 26461612 / +0.1% 0.55 / 0.55 / +0.4%
tpch_q13/duckdb:vortex-file-compressed 19445821 / 19327015 / +0.6% 31968358 / 30709834 / +4.1% 0.61 / 0.63 / -3.3%
tpch_q14/duckdb:vortex-file-compressed 11228918 / 11212898 / +0.1% 23655867 / 23517051 / +0.6% 0.47 / 0.48 / -0.4%
tpch_q15/duckdb:vortex-file-compressed 8419954 / 8234690 / +2.2% 20219946 / 20522644 / -1.5% 0.42 / 0.40 / +3.8%
tpch_q16/duckdb:vortex-file-compressed 16559084 / 16597727 / -0.2% 23137651 / 23028355 / +0.5% 0.72 / 0.72 / -0.7%
tpch_q17/duckdb:vortex-file-compressed 12524464 / 12523965 / +0.0% 29217659 / 27334116 / +6.9% 0.43 / 0.46 / -6.4%
tpch_q18/duckdb:vortex-file-compressed 23934583 / 24396771 / -1.9% 35562312 / 33932580 / +4.8% 0.67 / 0.72 / -6.4%
tpch_q19/duckdb:vortex-file-compressed 11320683 / 11340518 / -0.2% 25733948 / 25197203 / +2.1% 0.44 / 0.45 / -2.3%
tpch_q20/duckdb:vortex-file-compressed 14202381 / 14706669 / -3.4% 30081206 / 30346498 / -0.9% 0.47 / 0.48 / -2.6%
tpch_q21/duckdb:vortex-file-compressed 48486445 / 48807382 / -0.7% 64742333 / 63243884 / +2.4% 0.75 / 0.77 / -3.0%
tpch_q22/duckdb:vortex-file-compressed 16776567 / 16554230 / +1.3% 26749740 / 27943552 / -4.3% 0.63 / 0.59 / +5.9%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47383605 / 47638902 / -0.5% 54053207 / 54458850 / -0.7% 0.88 / 0.87 / +0.2%
tpch_q02/duckdb:parquet 48408375 / 48333244 / +0.2% 55637506 / 55186616 / +0.8% 0.87 / 0.88 / -0.7%
tpch_q03/duckdb:parquet 60324727 / 60137246 / +0.3% 68315668 / 68654628 / -0.5% 0.88 / 0.88 / +0.8%
tpch_q04/duckdb:parquet 34747586 / 34735804 / +0.0% 43916660 / 42906181 / +2.4% 0.79 / 0.81 / -2.3%
tpch_q05/duckdb:parquet 67286823 / 67035967 / +0.4% 77457049 / 77289255 / +0.2% 0.87 / 0.87 / +0.2%
tpch_q06/duckdb:parquet 21627417 / 21706399 / -0.4% 27734123 / 28291014 / -2.0% 0.78 / 0.77 / +1.6%
tpch_q07/duckdb:parquet 64164323 / 64118232 / +0.1% 73771807 / 72486467 / +1.8% 0.87 / 0.88 / -1.7%
tpch_q08/duckdb:parquet 75785933 / 75762917 / +0.0% 86836976 / 86069109 / +0.9% 0.87 / 0.88 / -0.9%
tpch_q09/duckdb:parquet 107667440 / 108097636 / -0.4% 119341044 / 119220894 / +0.1% 0.90 / 0.91 / -0.5%
tpch_q10/duckdb:parquet 105893342 / 105914990 / -0.0% 117869961 / 118086192 / -0.2% 0.90 / 0.90 / +0.2%
tpch_q11/duckdb:parquet 29658443 / 29478441 / +0.6% 34998186 / 34801577 / +0.6% 0.85 / 0.85 / +0.0%
tpch_q12/duckdb:parquet 37110838 / 37208520 / -0.3% 44009551 / 44046962 / -0.1% 0.84 / 0.84 / -0.2%
tpch_q13/duckdb:parquet 175129100 / 175171617 / -0.0% 184228348 / 185356900 / -0.6% 0.95 / 0.95 / +0.6%
tpch_q14/duckdb:parquet 42306710 / 42378978 / -0.2% 51283812 / 50322376 / +1.9% 0.82 / 0.84 / -2.0%
tpch_q15/duckdb:parquet 32788247 / 32543137 / +0.8% 40709004 / 41271906 / -1.4% 0.81 / 0.79 / +2.1%
tpch_q16/duckdb:parquet 47618377 / 46938027 / +1.4% 52744330 / 52758300 / -0.0% 0.90 / 0.89 / +1.5%
tpch_q17/duckdb:parquet 48013223 / 47772533 / +0.5% 57626413 / 56950762 / +1.2% 0.83 / 0.84 / -0.7%
tpch_q18/duckdb:parquet 74139291 / 74067913 / +0.1% 81476566 / 81287277 / +0.2% 0.91 / 0.91 / -0.1%
tpch_q19/duckdb:parquet 48720927 / 47654057 / +2.2% 56525847 / 54796719 / +3.2% 0.86 / 0.87 / -0.9%
tpch_q20/duckdb:parquet 63619867 / 63397755 / +0.4% 74909546 / 73763671 / +1.6% 0.85 / 0.86 / -1.2%
tpch_q21/duckdb:parquet 106892849 / 107088090 / -0.2% 116249818 / 115595026 / +0.6% 0.92 / 0.93 / -0.7%
tpch_q22/duckdb:parquet 50559054 / 50530874 / +0.1% 59442336 / 58883378 / +0.9% 0.85 / 0.86 / -0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 31d2f1e8 vs base eacb3538
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.958x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.963x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91327845 / 91831851 / -0.5% 141200905 / 153405298 / -8.0% 0.65 / 0.60 / +8.0%
tpch_q02/datafusion:vortex-file-compressed 65059568 / 64458884 / +0.9% 94417998 / 94884545 / -0.5% 0.69 / 0.68 / +1.4%
tpch_q03/datafusion:vortex-file-compressed 63031001 / 63452366 / -0.7% 123850244 / 125061875 / -1.0% 0.51 / 0.51 / +0.3%
tpch_q04/datafusion:vortex-file-compressed 34018071 / 34177949 / -0.5% 67455913 / 71921735 / -6.2% 0.50 / 0.48 / +6.1%
tpch_q05/datafusion:vortex-file-compressed 119565184 / 120043202 / -0.4% 193487012 / 199704529 / -3.1% 0.62 / 0.60 / +2.8%
tpch_q06/datafusion:vortex-file-compressed 9656784 / 9916621 / -2.6% 51978965 / 57780755 / -10.0% 🟢 0.19 / 0.17 / +8.2%
tpch_q07/datafusion:vortex-file-compressed 97006949 / 97815732 / -0.8% 154442891 / 164994316 / -6.4% 0.63 / 0.59 / +5.9%
tpch_q08/datafusion:vortex-file-compressed 143835633 / 140671135 / +2.2% 229935406 / 218762515 / +5.1% 0.63 / 0.64 / -2.7%
tpch_q09/datafusion:vortex-file-compressed 186050275 / 186396877 / -0.2% 260583616 / 268438569 / -2.9% 0.71 / 0.69 / +2.8%
tpch_q10/datafusion:vortex-file-compressed 70073665 / 70661274 / -0.8% 134970723 / 135832728 / -0.6% 0.52 / 0.52 / -0.2%
tpch_q11/datafusion:vortex-file-compressed 45994976 / 45885837 / +0.2% 69007253 / 72589961 / -4.9% 0.67 / 0.63 / +5.4%
tpch_q12/datafusion:vortex-file-compressed 34758809 / 36081634 / -3.7% 73957315 / 81799575 / -9.6% 0.47 / 0.44 / +6.5%
tpch_q13/datafusion:vortex-file-compressed 48511114 / 49858730 / -2.7% 83423355 / 82054051 / +1.7% 0.58 / 0.61 / -4.3%
tpch_q14/datafusion:vortex-file-compressed 20329236 / 21175056 / -4.0% 89333513 / 89769058 / -0.5% 0.23 / 0.24 / -3.5%
tpch_q15/datafusion:vortex-file-compressed 32348504 / 33667388 / -3.9% 91779614 / 90246587 / +1.7% 0.35 / 0.37 / -5.5%
tpch_q16/datafusion:vortex-file-compressed 36848229 / 37358266 / -1.4% 65642445 / 69082821 / -5.0% 0.56 / 0.54 / +3.8%
tpch_q17/datafusion:vortex-file-compressed 178251578 / 181466366 / -1.8% 225795634 / 229375344 / -1.6% 0.79 / 0.79 / -0.2%
tpch_q18/datafusion:vortex-file-compressed 206517249 / 205333998 / +0.6% 267888534 / 274842045 / -2.5% 0.77 / 0.75 / +3.2%
tpch_q19/datafusion:vortex-file-compressed 28352862 / 28910786 / -1.9% 82627744 / 83927525 / -1.5% 0.34 / 0.34 / -0.4%
tpch_q20/datafusion:vortex-file-compressed 60035509 / 60625058 / -1.0% 109482826 / 113929731 / -3.9% 0.55 / 0.53 / +3.0%
tpch_q21/datafusion:vortex-file-compressed 180714465 / 180797569 / -0.0% 230083137 / 238873870 / -3.7% 0.79 / 0.76 / +3.8%
tpch_q22/datafusion:vortex-file-compressed 25609860 / 25363498 / +1.0% 54368704 / 54363898 / +0.0% 0.47 / 0.47 / +1.0%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87338250 / 87562066 / -0.3% 122788526 / 128952252 / -4.8% 0.71 / 0.68 / +4.8%
tpch_q02/datafusion:parquet 173256323 / 174185337 / -0.5% 198348034 / 196172565 / +1.1% 0.87 / 0.89 / -1.6%
tpch_q03/datafusion:parquet 136356140 / 134741602 / +1.2% 175575541 / 180517947 / -2.7% 0.78 / 0.75 / +4.0%
tpch_q04/datafusion:parquet 56575294 / 56761984 / -0.3% 84745283 / 92934758 / -8.8% 0.67 / 0.61 / +9.3%
tpch_q05/datafusion:parquet 167095391 / 166243955 / +0.5% 222960423 / 230562093 / -3.3% 0.75 / 0.72 / +3.9%
tpch_q06/datafusion:parquet 36247053 / 36346994 / -0.3% 74607642 / 79943496 / -6.7% 0.49 / 0.45 / +6.9%
tpch_q07/datafusion:parquet 215098631 / 218237235 / -1.4% 269032570 / 282576550 / -4.8% 0.80 / 0.77 / +3.5%
tpch_q08/datafusion:parquet 217736590 / 217865351 / -0.1% 283380056 / 282257863 / +0.4% 0.77 / 0.77 / -0.5%
tpch_q09/datafusion:parquet 309587864 / 307917441 / +0.5% 371677000 / 371481374 / +0.1% 0.83 / 0.83 / +0.5%
tpch_q10/datafusion:parquet 311739728 / 311417207 / +0.1% 363809854 / 377397415 / -3.6% 0.86 / 0.83 / +3.8%
tpch_q11/datafusion:parquet 127588355 / 127842800 / -0.2% 149167376 / 149296902 / -0.1% 0.86 / 0.86 / -0.1%
tpch_q12/datafusion:parquet 81963785 / 82475423 / -0.6% 115969487 / 122537981 / -5.4% 0.71 / 0.67 / +5.0%
tpch_q13/datafusion:parquet 210254214 / 211059705 / -0.4% 238920731 / 243318150 / -1.8% 0.88 / 0.87 / +1.5%
tpch_q14/datafusion:parquet 86802710 / 85798716 / +1.2% 184190416 / 203054685 / -9.3% 0.47 / 0.42 / +11.5%
tpch_q15/datafusion:parquet 104979989 / 105761677 / -0.7% 154243571 / 162970850 / -5.4% 0.68 / 0.65 / +4.9%
tpch_q16/datafusion:parquet 96541264 / 94628671 / +2.0% 119320560 / 125670806 / -5.1% 0.81 / 0.75 / +7.5%
tpch_q17/datafusion:parquet 214027201 / 214637610 / -0.3% 260348730 / 268219141 / -2.9% 0.82 / 0.80 / +2.7%
tpch_q18/datafusion:parquet 268025765 / 267731437 / +0.1% 311959373 / 319573505 / -2.4% 0.86 / 0.84 / +2.6%
tpch_q19/datafusion:parquet 108063828 / 108768569 / -0.6% 164290718 / 172801676 / -4.9% 0.66 / 0.63 / +4.5%
tpch_q20/datafusion:parquet 184812065 / 186604000 / -1.0% 235076462 / 246606423 / -4.7% 0.79 / 0.76 / +3.9%
tpch_q21/datafusion:parquet 242284853 / 244663136 / -1.0% 304774740 / 315026213 / -3.3% 0.79 / 0.78 / +2.4%
tpch_q22/datafusion:parquet 149898769 / 150084055 / -0.1% 171178558 / 175969206 / -2.7% 0.88 / 0.85 / +2.7%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32180513 / 32000399 / +0.6% 62725604 / 69589901 / -9.9% 0.51 / 0.46 / +11.6%
tpch_q02/duckdb:vortex-file-compressed 28325054 / 28296681 / +0.1% 43332336 / 43415497 / -0.2% 0.65 / 0.65 / +0.3%
tpch_q03/duckdb:vortex-file-compressed 51242671 / 52052783 / -1.6% 95260732 / 103968946 / -8.4% 0.54 / 0.50 / +7.4%
tpch_q04/duckdb:vortex-file-compressed 51411671 / 52313691 / -1.7% 83622401 / 92228876 / -9.3% 0.61 / 0.57 / +8.4%
tpch_q05/duckdb:vortex-file-compressed 67109625 / 68598050 / -2.2% 105817349 / 110109411 / -3.9% 0.63 / 0.62 / +1.8%
tpch_q06/duckdb:vortex-file-compressed 15427646 / 15452642 / -0.2% 46069382 / 52145731 / -11.7% 🟢 0.33 / 0.30 / +13.0%
tpch_q07/duckdb:vortex-file-compressed 54836531 / 55084379 / -0.4% 104560580 / 110175280 / -5.1% 0.52 / 0.50 / +4.9%
tpch_q08/duckdb:vortex-file-compressed 85367293 / 85069101 / +0.4% 125908830 / 133680633 / -5.8% 0.68 / 0.64 / +6.5%
tpch_q09/duckdb:vortex-file-compressed 102325972 / 102304349 / +0.0% 152970707 / 161888112 / -5.5% 0.67 / 0.63 / +5.9%
tpch_q10/duckdb:vortex-file-compressed 96011396 / 96672452 / -0.7% 143704568 / 149267038 / -3.7% 0.67 / 0.65 / +3.2%
tpch_q11/duckdb:vortex-file-compressed 13183030 / 13272074 / -0.7% 29023425 / 27221911 / +6.6% 0.45 / 0.49 / -6.8%
tpch_q12/duckdb:vortex-file-compressed 44758882 / 45082633 / -0.7% 75057011 / 83565232 / -10.2% 🟢 0.60 / 0.54 / +10.5%
tpch_q13/duckdb:vortex-file-compressed 71457532 / 72226835 / -1.1% 97769241 / 99528635 / -1.8% 0.73 / 0.73 / +0.7%
tpch_q14/duckdb:vortex-file-compressed 27402779 / 27663971 / -0.9% 69466210 / 73719656 / -5.8% 0.39 / 0.38 / +5.1%
tpch_q15/duckdb:vortex-file-compressed 23841765 / 23915159 / -0.3% 58982064 / 62727321 / -6.0% 0.40 / 0.38 / +6.0%
tpch_q16/duckdb:vortex-file-compressed 49111366 / 49354969 / -0.5% 57754296 / 57154852 / +1.0% 0.85 / 0.86 / -1.5%
tpch_q17/duckdb:vortex-file-compressed 36346280 / 35076974 / +3.6% 63011067 / 68328171 / -7.8% 0.58 / 0.51 / +12.4%
tpch_q18/duckdb:vortex-file-compressed 105818179 / 104063899 / +1.7% 118373508 / 121753516 / -2.8% 0.89 / 0.85 / +4.6%
tpch_q19/duckdb:vortex-file-compressed 27108450 / 26916973 / +0.7% 70195421 / 77554006 / -9.5% 0.39 / 0.35 / +11.3%
tpch_q20/duckdb:vortex-file-compressed 41569550 / 41223797 / +0.8% 88838951 / 98436658 / -9.8% 0.47 / 0.42 / +11.7%
tpch_q21/duckdb:vortex-file-compressed 94014582 / 94303023 / -0.3% 140851153 / 150958629 / -6.7% 0.67 / 0.62 / +6.8%
tpch_q22/duckdb:vortex-file-compressed 33008848 / 33444142 / -1.3% 47388771 / 48352611 / -2.0% 0.70 / 0.69 / +0.7%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67799043 / 68220663 / -0.6% 89027978 / 89823966 / -0.9% 0.76 / 0.76 / +0.3%
tpch_q02/duckdb:parquet 86588508 / 87470568 / -1.0% 96633152 / 98256052 / -1.7% 0.90 / 0.89 / +0.7%
tpch_q03/duckdb:parquet 109474596 / 110201684 / -0.7% 139659541 / 147796097 / -5.5% 0.78 / 0.75 / +5.1%
tpch_q04/duckdb:parquet 76244214 / 76543090 / -0.4% 96683502 / 101906243 / -5.1% 0.79 / 0.75 / +5.0%
tpch_q05/duckdb:parquet 122250214 / 123634503 / -1.1% 155741467 / 159276316 / -2.2% 0.78 / 0.78 / +1.1%
tpch_q06/duckdb:parquet 35492241 / 35706012 / -0.6% 57541523 / 64056254 / -10.2% 🟢 0.62 / 0.56 / +10.7%
tpch_q07/duckdb:parquet 116935346 / 117527976 / -0.5% 153555160 / 156177516 / -1.7% 0.76 / 0.75 / +1.2%
tpch_q08/duckdb:parquet 147206467 / 149359141 / -1.4% 187738070 / 198023249 / -5.2% 0.78 / 0.75 / +4.0%
tpch_q09/duckdb:parquet 235538791 / 238566747 / -1.3% 274790752 / 287736794 / -4.5% 0.86 / 0.83 / +3.4%
tpch_q10/duckdb:parquet 311130404 / 313110238 / -0.6% 333441348 / 343484431 / -2.9% 0.93 / 0.91 / +2.4%
tpch_q11/duckdb:parquet 43492651 / 43557204 / -0.1% 50584859 / 50608583 / -0.0% 0.86 / 0.86 / -0.1%
tpch_q12/duckdb:parquet 70599383 / 70464943 / +0.2% 88889707 / 95189852 / -6.6% 0.79 / 0.74 / +7.3%
tpch_q13/duckdb:parquet 291877696 / 293120630 / -0.4% 307056461 / 310808785 / -1.2% 0.95 / 0.94 / +0.8%
tpch_q14/duckdb:parquet 99737724 / 102461786 / -2.7% 134805898 / 141392532 / -4.7% 0.74 / 0.72 / +2.1%
tpch_q15/duckdb:parquet 57345207 / 57371637 / -0.0% 87288043 / 87971323 / -0.8% 0.66 / 0.65 / +0.7%
tpch_q16/duckdb:parquet 99697778 / 101349196 / -1.6% 107027804 / 108560138 / -1.4% 0.93 / 0.93 / -0.2%
tpch_q17/duckdb:parquet 82273219 / 81824748 / +0.5% 109689023 / 116873395 / -6.1% 0.75 / 0.70 / +7.1%
tpch_q18/duckdb:parquet 155513670 / 158246944 / -1.7% 172538517 / 172780163 / -0.1% 0.90 / 0.92 / -1.6%
tpch_q19/duckdb:parquet 97948633 / 100231335 / -2.3% 124260877 / 141330444 / -12.1% 🟢 0.79 / 0.71 / +11.1%
tpch_q20/duckdb:parquet 147130416 / 147347341 / -0.1% 182729620 / 190090998 / -3.9% 0.81 / 0.78 / +3.9%
tpch_q21/duckdb:parquet 253416465 / 255378403 / -0.8% 273649293 / 278761611 / -1.8% 0.93 / 0.92 / +1.1%
tpch_q22/duckdb:parquet 168169339 / 168728985 / -0.3% 178957877 / 180745808 / -1.0% 0.94 / 0.93 / +0.7%

No file size changes detected.

As in the SQL benchmarks, pr-bench-runner.yml and develop-bench.yml upload
Polar Signals debuginfo in the build job, so the bench job waits for it. Each
now uploads from its own job on an arm64-medium runner. That job downloads
the build artifact and runs alongside the bench job.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-string Run only the string encoding benchmark on this PR label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-string Run only the string encoding benchmark on this PR label Nov 13, 2026
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 31d2f1e8 vs base eacb3538
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.982x ➖
Parquet (geomean): hot 0.991x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.990x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1240820 / 1249035 / -0.7% 22574233 / 23785182 / -5.1% 0.05 / 0.05 / +4.7%
clickbench_q01/datafusion:vortex-file-compressed 5827982 / 5661473 / +2.9% 30031794 / 30338472 / -1.0% 0.19 / 0.19 / +4.0%
clickbench_q02/datafusion:vortex-file-compressed 10703096 / 11097038 / -3.5% 41442493 / 37394451 / +10.8% 🔴 0.26 / 0.30 / -13.0%
clickbench_q03/datafusion:vortex-file-compressed 12708402 / 13038988 / -2.5% 50020554 / 53253305 / -6.1% 0.25 / 0.24 / +3.8%
clickbench_q04/datafusion:vortex-file-compressed 58410011 / 57689948 / +1.2% 100985950 / 106687478 / -5.3% 0.58 / 0.54 / +7.0%
clickbench_q05/datafusion:vortex-file-compressed 77389112 / 77094719 / +0.4% 132549419 / 132060060 / +0.4% 0.58 / 0.58 / +0.0%
clickbench_q06/datafusion:vortex-file-compressed 1242534 / 1212646 / +2.5% 23225974 / 22600206 / +2.8% 0.05 / 0.05 / -0.3%
clickbench_q07/datafusion:vortex-file-compressed 8881042 / 9536844 / -6.9% 33617200 / 34692849 / -3.1% 0.26 / 0.27 / -3.9%
clickbench_q08/datafusion:vortex-file-compressed 77557507 / 78868142 / -1.7% 137309047 / 126722589 / +8.4% 0.56 / 0.62 / -9.2%
clickbench_q09/datafusion:vortex-file-compressed 174192112 / 167060993 / +4.3% 213892109 / 211413552 / +1.2% 0.81 / 0.79 / +3.1%
clickbench_q10/datafusion:vortex-file-compressed 22540344 / 22686663 / -0.6% 65234057 / 69539189 / -6.2% 0.35 / 0.33 / +5.9%
clickbench_q11/datafusion:vortex-file-compressed 23490154 / 23817480 / -1.4% 66924590 / 72768579 / -8.0% 0.35 / 0.33 / +7.2%
clickbench_q12/datafusion:vortex-file-compressed 73816054 / 74812272 / -1.3% 126879824 / 130353784 / -2.7% 0.58 / 0.57 / +1.4%
clickbench_q13/datafusion:vortex-file-compressed 116891500 / 117688590 / -0.7% 185258564 / 180909668 / +2.4% 0.63 / 0.65 / -3.0%
clickbench_q14/datafusion:vortex-file-compressed 75623658 / 77799410 / -2.8% 127968202 / 132334872 / -3.3% 0.59 / 0.59 / +0.5%
clickbench_q15/datafusion:vortex-file-compressed 65700894 / 64569590 / +1.8% 98013400 / 105055770 / -6.7% 0.67 / 0.61 / +9.1%
clickbench_q16/datafusion:vortex-file-compressed 156067934 / 154218586 / +1.2% 213327992 / 228419949 / -6.6% 0.73 / 0.68 / +8.4%
clickbench_q17/datafusion:vortex-file-compressed 152632458 / 153031510 / -0.3% 221280872 / 224809295 / -1.6% 0.69 / 0.68 / +1.3%
clickbench_q18/datafusion:vortex-file-compressed 298611267 / 300750750 / -0.7% 367589879 / 378812660 / -3.0% 0.81 / 0.79 / +2.3%
clickbench_q19/datafusion:vortex-file-compressed 7329795 / 7362659 / -0.4% 41775885 / 44674079 / -6.5% 0.18 / 0.16 / +6.5%
clickbench_q20/datafusion:vortex-file-compressed 69040963 / 69113996 / -0.1% 248806747 / 242752009 / +2.5% 0.28 / 0.28 / -2.5%
clickbench_q21/datafusion:vortex-file-compressed 75020623 / 78796840 / -4.8% 293513524 / 289712967 / +1.3% 0.26 / 0.27 / -6.0%
clickbench_q22/datafusion:vortex-file-compressed 91583975 / 94361496 / -2.9% 399278958 / 400176709 / -0.2% 0.23 / 0.24 / -2.7%
clickbench_q23/datafusion:vortex-file-compressed 80768184 / 93732783 / -13.8% 🟢 395956839 / 389528222 / +1.7% 0.20 / 0.24 / -15.2%
clickbench_q24/datafusion:vortex-file-compressed 8159866 / 7997862 / +2.0% 61448251 / 68678358 / -10.5% 🟢 0.13 / 0.12 / +14.0%
clickbench_q25/datafusion:vortex-file-compressed 17821456 / 19044120 / -6.4% 63169479 / 65239244 / -3.2% 0.28 / 0.29 / -3.4%
clickbench_q26/datafusion:vortex-file-compressed 13544514 / 15099346 / -10.3% 🟢 68486993 / 66604763 / +2.8% 0.20 / 0.23 / -12.8%
clickbench_q27/datafusion:vortex-file-compressed 95183532 / 97848252 / -2.7% 252450596 / 252099238 / +0.1% 0.38 / 0.39 / -2.9%
clickbench_q28/datafusion:vortex-file-compressed 556397539 / 563994444 / -1.3% 635817285 / 639575689 / -0.6% 0.88 / 0.88 / -0.8%
clickbench_q29/datafusion:vortex-file-compressed 25037790 / 24310182 / +3.0% 53860271 / 56180828 / -4.1% 0.46 / 0.43 / +7.4%
clickbench_q30/datafusion:vortex-file-compressed 56241142 / 55894280 / +0.6% 107465522 / 111755150 / -3.8% 0.52 / 0.50 / +4.6%
clickbench_q31/datafusion:vortex-file-compressed 64383068 / 66569174 / -3.3% 159287928 / 158248865 / +0.7% 0.40 / 0.42 / -3.9%
clickbench_q32/datafusion:vortex-file-compressed 297215887 / 283958087 / +4.7% 380735552 / 389517142 / -2.3% 0.78 / 0.73 / +7.1%
clickbench_q33/datafusion:vortex-file-compressed 319866264 / 318852486 / +0.3% 441800957 / 434875060 / +1.6% 0.72 / 0.73 / -1.3%
clickbench_q34/datafusion:vortex-file-compressed 317467668 / 315631920 / +0.6% 426930004 / 448436148 / -4.8% 0.74 / 0.70 / +5.6%
clickbench_q35/datafusion:vortex-file-compressed 57418806 / 57685532 / -0.5% 95391686 / 93982813 / +1.5% 0.60 / 0.61 / -1.9%
clickbench_q36/datafusion:vortex-file-compressed 36797306 / 37548440 / -2.0% 67024669 / 71036617 / -5.6% 0.55 / 0.53 / +3.9%
clickbench_q37/datafusion:vortex-file-compressed 20832708 / 20679874 / +0.7% 48126584 / 50428815 / -4.6% 0.43 / 0.41 / +5.6%
clickbench_q38/datafusion:vortex-file-compressed 12755426 / 12780594 / -0.2% 40521002 / 42850525 / -5.4% 0.31 / 0.30 / +5.5%
clickbench_q39/datafusion:vortex-file-compressed 77987963 / 77262534 / +0.9% 111114251 / 113403272 / -2.0% 0.70 / 0.68 / +3.0%
clickbench_q40/datafusion:vortex-file-compressed 10152641 / 9916032 / +2.4% 36047136 / 37496181 / -3.9% 0.28 / 0.26 / +6.5%
clickbench_q41/datafusion:vortex-file-compressed 9747960 / 9493411 / +2.7% 34443032 / 35608665 / -3.3% 0.28 / 0.27 / +6.2%
clickbench_q42/datafusion:vortex-file-compressed 9748411 / 9818576 / -0.7% 35336012 / 36882440 / -4.2% 0.28 / 0.27 / +3.6%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1249777 / 1263260 / -1.1% 50108464 / 50388494 / -0.6% 0.02 / 0.03 / -0.5%
clickbench_q01/datafusion:parquet 16012850 / 16052822 / -0.2% 66019560 / 71966547 / -8.3% 0.24 / 0.22 / +8.7%
clickbench_q02/datafusion:parquet 18606895 / 18886302 / -1.5% 80801128 / 78830970 / +2.5% 0.23 / 0.24 / -3.9%
clickbench_q03/datafusion:parquet 17309168 / 17431925 / -0.7% 78023938 / 79091679 / -1.4% 0.22 / 0.22 / +0.7%
clickbench_q04/datafusion:parquet 64475644 / 64595764 / -0.2% 127263057 / 126420752 / +0.7% 0.51 / 0.51 / -0.8%
clickbench_q05/datafusion:parquet 88192492 / 88831058 / -0.7% 153051907 / 156752800 / -2.4% 0.58 / 0.57 / +1.7%
clickbench_q06/datafusion:parquet 1284748 / 1254526 / +2.4% 50219758 / 49449126 / +1.6% 0.03 / 0.03 / +0.8%
clickbench_q07/datafusion:parquet 17035769 / 16933904 / +0.6% 67772214 / 67959144 / -0.3% 0.25 / 0.25 / +0.9%
clickbench_q08/datafusion:parquet 86493749 / 83916342 / +3.1% 161721067 / 156411120 / +3.4% 0.53 / 0.54 / -0.3%
clickbench_q09/datafusion:parquet 192566761 / 187652752 / +2.6% 265556329 / 264955190 / +0.2% 0.73 / 0.71 / +2.4%
clickbench_q10/datafusion:parquet 35629691 / 37047712 / -3.8% 100546695 / 100172772 / +0.4% 0.35 / 0.37 / -4.2%
clickbench_q11/datafusion:parquet 42485867 / 42708588 / -0.5% 109921085 / 110504486 / -0.5% 0.39 / 0.39 / +0.0%
clickbench_q12/datafusion:parquet 95689438 / 95627342 / +0.1% 161982467 / 162510203 / -0.3% 0.59 / 0.59 / +0.4%
clickbench_q13/datafusion:parquet 147412311 / 148647466 / -0.8% 228635323 / 227793259 / +0.4% 0.64 / 0.65 / -1.2%
clickbench_q14/datafusion:parquet 101804702 / 102036464 / -0.2% 170956895 / 177209325 / -3.5% 0.60 / 0.58 / +3.4%
clickbench_q15/datafusion:parquet 70706586 / 75473350 / -6.3% 132621377 / 131074896 / +1.2% 0.53 / 0.58 / -7.4%
clickbench_q16/datafusion:parquet 157245312 / 157146300 / +0.1% 229869082 / 234484473 / -2.0% 0.68 / 0.67 / +2.1%
clickbench_q17/datafusion:parquet 158195410 / 156541058 / +1.1% 235294171 / 237435376 / -0.9% 0.67 / 0.66 / +2.0%
clickbench_q18/datafusion:parquet 310645209 / 309857342 / +0.3% 420755298 / 421242676 / -0.1% 0.74 / 0.74 / +0.4%
clickbench_q19/datafusion:parquet 19001686 / 19448535 / -2.3% 75355256 / 78125637 / -3.5% 0.25 / 0.25 / +1.3%
clickbench_q20/datafusion:parquet 177191337 / 178928530 / -1.0% 274142046 / 286128892 / -4.2% 0.65 / 0.63 / +3.4%
clickbench_q21/datafusion:parquet 172940208 / 173779555 / -0.5% 292312661 / 299436794 / -2.4% 0.59 / 0.58 / +1.9%
clickbench_q22/datafusion:parquet 258994471 / 261983232 / -1.1% 417386011 / 429204127 / -2.8% 0.62 / 0.61 / +1.7%
clickbench_q23/datafusion:parquet 1010267289 / 1010512274 / -0.0% 1173661539 / 1186971921 / -1.1% 0.86 / 0.85 / +1.1%
clickbench_q24/datafusion:parquet 29664364 / 30077628 / -1.4% 87454453 / 89889500 / -2.7% 0.34 / 0.33 / +1.4%
clickbench_q25/datafusion:parquet 36287611 / 36588597 / -0.8% 98338849 / 102457196 / -4.0% 0.37 / 0.36 / +3.3%
clickbench_q26/datafusion:parquet 31095274 / 30745556 / +1.1% 87979241 / 90998680 / -3.3% 0.35 / 0.34 / +4.6%
clickbench_q27/datafusion:parquet 193569089 / 194448983 / -0.5% 282294974 / 294162139 / -4.0% 0.69 / 0.66 / +3.7%
clickbench_q28/datafusion:parquet 617207366 / 620379708 / -0.5% 700024015 / 708819932 / -1.2% 0.88 / 0.88 / +0.7%
clickbench_q29/datafusion:parquet 29484054 / 28660418 / +2.9% 90476227 / 90690334 / -0.2% 0.33 / 0.32 / +3.1%
clickbench_q30/datafusion:parquet 88520372 / 91482114 / -3.2% 167727968 / 176470744 / -5.0% 0.53 / 0.52 / +1.8%
clickbench_q31/datafusion:parquet 102131634 / 102760570 / -0.6% 187816221 / 200844828 / -6.5% 0.54 / 0.51 / +6.3%
clickbench_q32/datafusion:parquet 305871472 / 310822994 / -1.6% 421726206 / 432373978 / -2.5% 0.73 / 0.72 / +0.9%
clickbench_q33/datafusion:parquet 378785234 / 378498141 / +0.1% 471888556 / 474640722 / -0.6% 0.80 / 0.80 / +0.7%
clickbench_q34/datafusion:parquet 376793160 / 378981446 / -0.6% 473579510 / 479195854 / -1.2% 0.80 / 0.79 / +0.6%
clickbench_q35/datafusion:parquet 66729975 / 64436474 / +3.6% 125051313 / 124679344 / +0.3% 0.53 / 0.52 / +3.3%
clickbench_q36/datafusion:parquet 73527736 / 73980046 / -0.6% 136085642 / 136317688 / -0.2% 0.54 / 0.54 / -0.4%
clickbench_q37/datafusion:parquet 35552780 / 36076114 / -1.5% 93053187 / 91651975 / +1.5% 0.38 / 0.39 / -2.9%
clickbench_q38/datafusion:parquet 47937092 / 48003576 / -0.1% 107157807 / 109806416 / -2.4% 0.45 / 0.44 / +2.3%
clickbench_q39/datafusion:parquet 143197794 / 144270642 / -0.7% 207647595 / 213058726 / -2.5% 0.69 / 0.68 / +1.8%
clickbench_q40/datafusion:parquet 19947824 / 20101636 / -0.8% 77920390 / 78020109 / -0.1% 0.26 / 0.26 / -0.6%
clickbench_q41/datafusion:parquet 18636090 / 18909304 / -1.4% 77251928 / 75375489 / +2.5% 0.24 / 0.25 / -3.8%
clickbench_q42/datafusion:parquet 18816710 / 19330469 / -2.7% 75997164 / 75876718 / +0.2% 0.25 / 0.25 / -2.8%
duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2189782 / 2213340 / -1.1% 24890760 / 24492334 / +1.6% 0.09 / 0.09 / -2.6%
clickbench_q01/duckdb:vortex-file-compressed 7688430 / 7744752 / -0.7% 29492590 / 28626067 / +3.0% 0.26 / 0.27 / -3.6%
clickbench_q02/duckdb:vortex-file-compressed 9052064 / 9084919 / -0.4% 33754804 / 35000126 / -3.6% 0.27 / 0.26 / +3.3%
clickbench_q03/duckdb:vortex-file-compressed 14088224 / 14068072 / +0.1% 45502956 / 48717857 / -6.6% 0.31 / 0.29 / +7.2%
clickbench_q04/duckdb:vortex-file-compressed 55331752 / 57152015 / -3.2% 84201344 / 88668444 / -5.0% 0.66 / 0.64 / +2.0%
clickbench_q05/duckdb:vortex-file-compressed 63856576 / 63449323 / +0.6% 94075255 / 93876904 / +0.2% 0.68 / 0.68 / +0.4%
clickbench_q06/duckdb:vortex-file-compressed 2632280 / 2629688 / +0.1% 32438741 / 30662170 / +5.8% 0.08 / 0.09 / -5.4%
clickbench_q07/duckdb:vortex-file-compressed 8908722 / 9297717 / -4.2% 31711888 / 27918258 / +13.6% 🔴 0.28 / 0.33 / -15.6%
clickbench_q08/duckdb:vortex-file-compressed 67815214 / 68958420 / -1.7% 99164597 / 102720048 / -3.5% 0.68 / 0.67 / +1.9%
clickbench_q09/duckdb:vortex-file-compressed 93068290 / 93187623 / -0.1% 127250476 / 125762199 / +1.2% 0.73 / 0.74 / -1.3%
clickbench_q10/duckdb:vortex-file-compressed 26723866 / 27114311 / -1.4% 62094550 / 69907554 / -11.2% 🟢 0.43 / 0.39 / +11.0%
clickbench_q11/duckdb:vortex-file-compressed 29100544 / 29333869 / -0.8% 65063992 / 72298218 / -10.0% 🟢 0.45 / 0.41 / +10.2%
clickbench_q12/duckdb:vortex-file-compressed 66691204 / 69606394 / -4.2% 94387951 / 98891407 / -4.6% 0.71 / 0.70 / +0.4%
clickbench_q13/duckdb:vortex-file-compressed 117012532 / 118999177 / -1.7% 157641310 / 167105875 / -5.7% 0.74 / 0.71 / +4.2%
clickbench_q14/duckdb:vortex-file-compressed 72357920 / 74961097 / -3.5% 102123322 / 102004337 / +0.1% 0.71 / 0.73 / -3.6%
clickbench_q15/duckdb:vortex-file-compressed 76346960 / 75958696 / +0.5% 107424831 / 108573519 / -1.1% 0.71 / 0.70 / +1.6%
clickbench_q16/duckdb:vortex-file-compressed 134300686 / 133469786 / +0.6% 170552548 / 170697354 / -0.1% 0.79 / 0.78 / +0.7%
clickbench_q17/duckdb:vortex-file-compressed 139167176 / 139485432 / -0.2% 171167075 / 169172479 / +1.2% 0.81 / 0.82 / -1.4%
clickbench_q18/duckdb:vortex-file-compressed 258830263 / 256715048 / +0.8% 303055373 / 304016486 / -0.3% 0.85 / 0.84 / +1.1%
clickbench_q19/duckdb:vortex-file-compressed 8584230 / 8917848 / -3.7% 34213567 / 37001701 / -7.5% 0.25 / 0.24 / +4.1%
clickbench_q20/duckdb:vortex-file-compressed 67659206 / 66892859 / +1.1% 161320986 / 172031961 / -6.2% 0.42 / 0.39 / +7.9%
clickbench_q21/duckdb:vortex-file-compressed 74231792 / 72170525 / +2.9% 184372605 / 184152069 / +0.1% 0.40 / 0.39 / +2.7%
clickbench_q22/duckdb:vortex-file-compressed 106699488 / 107874136 / -1.1% 305303512 / 308299499 / -1.0% 0.35 / 0.35 / -0.1%
clickbench_q23/duckdb:vortex-file-compressed 65029416 / 66041664 / -1.5% 181364238 / 171702369 / +5.6% 0.36 / 0.38 / -6.8%
clickbench_q24/duckdb:vortex-file-compressed 16968132 / 17272183 / -1.8% 41655801 / 51729339 / -19.5% 🟢 0.41 / 0.33 / +22.0%
clickbench_q25/duckdb:vortex-file-compressed 18105108 / 18067738 / +0.2% 51356518 / 53772554 / -4.5% 0.35 / 0.34 / +4.9%
clickbench_q26/duckdb:vortex-file-compressed 13587573 / 13925328 / -2.4% 47635572 / 42487432 / +12.1% 🔴 0.29 / 0.33 / -13.0%
clickbench_q27/duckdb:vortex-file-compressed 49252116 / 50142335 / -1.8% 172807609 / 175719135 / -1.7% 0.29 / 0.29 / -0.1%
clickbench_q28/duckdb:vortex-file-compressed 510648546 / 508515342 / +0.4% 548418477 / 561367561 / -2.3% 0.93 / 0.91 / +2.8%
clickbench_q29/duckdb:vortex-file-compressed 17249760 / 16886156 / +2.2% 43897517 / 47421716 / -7.4% 0.39 / 0.36 / +10.4%
clickbench_q30/duckdb:vortex-file-compressed 58729610 / 59077722 / -0.6% 101932191 / 108694153 / -6.2% 0.58 / 0.54 / +6.0%
clickbench_q31/duckdb:vortex-file-compressed 109223916 / 108131633 / +1.0% 185935130 / 196929780 / -5.6% 0.59 / 0.55 / +7.0%
clickbench_q32/duckdb:vortex-file-compressed 356676637 / 376392723 / -5.2% 391568180 / 408507600 / -4.1% 0.91 / 0.92 / -1.1%
clickbench_q33/duckdb:vortex-file-compressed 347490878 / 342601184 / +1.4% 407683585 / 401991732 / +1.4% 0.85 / 0.85 / +0.0%
clickbench_q34/duckdb:vortex-file-compressed 350697306 / 354392914 / -1.0% 411363299 / 404858007 / +1.6% 0.85 / 0.88 / -2.6%
clickbench_q35/duckdb:vortex-file-compressed 57631678 / 58020292 / -0.7% 89247142 / 88924451 / +0.4% 0.65 / 0.65 / -1.0%
clickbench_q36/duckdb:vortex-file-compressed 10912834 / 11310201 / -3.5% 31896432 / 32352209 / -1.4% 0.34 / 0.35 / -2.1%
clickbench_q37/duckdb:vortex-file-compressed 7600538 / 7515417 / +1.1% 29448670 / 29003197 / +1.5% 0.26 / 0.26 / -0.4%
clickbench_q38/duckdb:vortex-file-compressed 8186769 / 8150196 / +0.4% 30116256 / 28877841 / +4.3% 0.27 / 0.28 / -3.7%
clickbench_q39/duckdb:vortex-file-compressed 17424276 / 17731293 / -1.7% 42899221 / 42343658 / +1.3% 0.41 / 0.42 / -3.0%
clickbench_q40/duckdb:vortex-file-compressed 6863222 / 6888788 / -0.4% 27545558 / 28484281 / -3.3% 0.25 / 0.24 / +3.0%
clickbench_q41/duckdb:vortex-file-compressed 7772158 / 7781590 / -0.1% 30291126 / 29398682 / +3.0% 0.26 / 0.26 / -3.1%
clickbench_q42/duckdb:vortex-file-compressed 6966698 / 6936294 / +0.4% 28638616 / 26523524 / +8.0% 0.24 / 0.26 / -7.0%
duckdb / parquet / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9739130 / 9652494 / +0.9% 13874132 / 14782841 / -6.1% 0.70 / 0.65 / +7.5%
clickbench_q01/duckdb:parquet 14734135 / 15111698 / -2.5% 20548742 / 20190283 / +1.8% 0.72 / 0.75 / -4.2%
clickbench_q02/duckdb:parquet 21885676 / 22704432 / -3.6% 32403830 / 33252628 / -2.6% 0.68 / 0.68 / -1.1%
clickbench_q03/duckdb:parquet 22793096 / 23514338 / -3.1% 35801362 / 36330165 / -1.5% 0.64 / 0.65 / -1.6%
clickbench_q04/duckdb:parquet 60236164 / 61956260 / -2.8% 72112997 / 71943415 / +0.2% 0.84 / 0.86 / -3.0%
clickbench_q05/duckdb:parquet 81076816 / 85171406 / -4.8% 94359912 / 96692187 / -2.4% 0.86 / 0.88 / -2.5%
clickbench_q06/duckdb:parquet 20841290 / 20987226 / -0.7% 29288725 / 26999076 / +8.5% 0.71 / 0.78 / -8.5%
clickbench_q07/duckdb:parquet 16512864 / 17373725 / -5.0% 25121022 / 23157617 / +8.5% 0.66 / 0.75 / -12.4%
clickbench_q08/duckdb:parquet 73859725 / 74975444 / -1.5% 85233906 / 87489743 / -2.6% 0.87 / 0.86 / +1.1%
clickbench_q09/duckdb:parquet 101713868 / 103079878 / -1.3% 121461181 / 122074773 / -0.5% 0.84 / 0.84 / -0.8%
clickbench_q10/duckdb:parquet 41281230 / 41005951 / +0.7% 60297687 / 51774260 / +16.5% 🔴 0.68 / 0.79 / -13.6%
clickbench_q11/duckdb:parquet 46358462 / 46874918 / -1.1% 62659817 / 61990888 / +1.1% 0.74 / 0.76 / -2.2%
clickbench_q12/duckdb:parquet 91565030 / 92813654 / -1.3% 106365447 / 106393405 / -0.0% 0.86 / 0.87 / -1.3%
clickbench_q13/duckdb:parquet 149420519 / 150519466 / -0.7% 166207336 / 165415445 / +0.5% 0.90 / 0.91 / -1.2%
clickbench_q14/duckdb:parquet 99770302 / 103324114 / -3.4% 115536943 / 116577384 / -0.9% 0.86 / 0.89 / -2.6%
clickbench_q15/duckdb:parquet 85527848 / 87274672 / -2.0% 99724062 / 99034144 / +0.7% 0.86 / 0.88 / -2.7%
clickbench_q16/duckdb:parquet 167860126 / 161769701 / +3.8% 175234529 / 178277688 / -1.7% 0.96 / 0.91 / +5.6%
clickbench_q17/duckdb:parquet 163094498 / 169276898 / -3.7% 175989457 / 179056956 / -1.7% 0.93 / 0.95 / -2.0%
clickbench_q18/duckdb:parquet 296082064 / 290993564 / +1.7% 314423446 / 318770789 / -1.4% 0.94 / 0.91 / +3.2%
clickbench_q19/duckdb:parquet 19736488 / 20084464 / -1.7% 27367502 / 26294085 / +4.1% 0.72 / 0.76 / -5.6%
clickbench_q20/duckdb:parquet 193335398 / 183326304 / +5.5% 232578528 / 232280867 / +0.1% 0.83 / 0.79 / +5.3%
clickbench_q21/duckdb:parquet 224334128 / 229206894 / -2.1% 266585097 / 266311254 / +0.1% 0.84 / 0.86 / -2.2%
clickbench_q22/duckdb:parquet 317985434 / 331580222 / -4.1% 372351674 / 363070202 / +2.6% 0.85 / 0.91 / -6.5%
clickbench_q23/duckdb:parquet 169388212 / 175298262 / -3.4% 244115572 / 239037393 / +2.1% 0.69 / 0.73 / -5.4%
clickbench_q24/duckdb:parquet 30311438 / 30510304 / -0.7% 42721876 / 43681050 / -2.2% 0.71 / 0.70 / +1.6%
clickbench_q25/duckdb:parquet 41777990 / 43082480 / -3.0% 58424194 / 54606234 / +7.0% 0.72 / 0.79 / -9.4%
clickbench_q26/duckdb:parquet 31969718 / 31143715 / +2.7% 45731369 / 44247519 / +3.4% 0.70 / 0.70 / -0.7%
clickbench_q27/duckdb:parquet 187989738 / 193039020 / -2.6% 232286082 / 233436652 / -0.5% 0.81 / 0.83 / -2.1%
clickbench_q28/duckdb:parquet 950096462 / 957291200 / -0.8% 944332674 / 956294259 / -1.3% 1.01 / 1.00 / +0.5%
clickbench_q29/duckdb:parquet 23567208 / 24229538 / -2.7% 30804901 / 31650718 / -2.7% 0.77 / 0.77 / -0.1%
clickbench_q30/duckdb:parquet 105133354 / 106030834 / -0.8% 126595803 / 126566795 / +0.0% 0.83 / 0.84 / -0.9%
clickbench_q31/duckdb:parquet 144626816 / 158000340 / -8.5% 174357640 / 173071702 / +0.7% 0.83 / 0.91 / -9.1%
clickbench_q32/duckdb:parquet 393933801 / 394241937 / -0.1% 410428192 / 420482104 / -2.4% 0.96 / 0.94 / +2.4%
clickbench_q33/duckdb:parquet 466516692 / 493776388 / -5.5% 452164393 / 461618606 / -2.0% 1.03 / 1.07 / -3.5%
clickbench_q34/duckdb:parquet 459034396 / 477016534 / -3.8% 448604274 / 459307263 / -2.3% 1.02 / 1.04 / -1.5%
clickbench_q35/duckdb:parquet 61399857 / 60750196 / +1.1% 73042319 / 73679028 / -0.9% 0.84 / 0.82 / +2.0%
clickbench_q36/duckdb:parquet 30109335 / 29954988 / +0.5% 35490594 / 35757471 / -0.7% 0.85 / 0.84 / +1.3%
clickbench_q37/duckdb:parquet 23025163 / 23313370 / -1.2% 29118566 / 29223588 / -0.4% 0.79 / 0.80 / -0.9%
clickbench_q38/duckdb:parquet 23335730 / 23595572 / -1.1% 28981413 / 29796204 / -2.7% 0.81 / 0.79 / +1.7%
clickbench_q39/duckdb:parquet 52827074 / 52335796 / +0.9% 58947567 / 61139309 / -3.6% 0.90 / 0.86 / +4.7%
clickbench_q40/duckdb:parquet 14819874 / 14537858 / +1.9% 20559648 / 19969707 / +3.0% 0.72 / 0.73 / -1.0%
clickbench_q41/duckdb:parquet 15508041 / 15502810 / +0.0% 20768131 / 20754245 / +0.1% 0.75 / 0.75 / -0.0%
clickbench_q42/duckdb:parquet 14354600 / 14142064 / +1.5% 20857260 / 20059811 / +4.0% 0.69 / 0.70 / -2.4%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 31d2f1e8 vs base eacb3538
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 22114472 / 21199144 / +4.3% 40873824 / 41538009 / -1.6% 0.54 / 0.51 / +6.0%
tpcds_q02/datafusion:vortex-file-compressed 42680098 / 43285096 / -1.4% 63942183 / 64915965 / -1.5% 0.67 / 0.67 / +0.1%
tpcds_q03/datafusion:vortex-file-compressed 11661950 / 11435564 / +2.0% 29881442 / 29775894 / +0.4% 0.39 / 0.38 / +1.6%
tpcds_q04/datafusion:vortex-file-compressed 80824508 / 78561462 / +2.9% 112045093 / 110669116 / +1.2% 0.72 / 0.71 / +1.6%
tpcds_q05/datafusion:vortex-file-compressed 57394128 / 56689039 / +1.2% 79339965 / 77108886 / +2.9% 0.72 / 0.74 / -1.6%
tpcds_q06/datafusion:vortex-file-compressed 21998258 / 21434534 / +2.6% 42176027 / 41095704 / +2.6% 0.52 / 0.52 / +0.0%
tpcds_q07/datafusion:vortex-file-compressed 26436364 / 26294080 / +0.5% 49019640 / 48924989 / +0.2% 0.54 / 0.54 / +0.3%
tpcds_q08/datafusion:vortex-file-compressed 25726350 / 25592455 / +0.5% 46297913 / 46008286 / +0.6% 0.56 / 0.56 / -0.1%
tpcds_q09/datafusion:vortex-file-compressed 20657221 / 20041526 / +3.1% 40168478 / 38136206 / +5.3% 0.51 / 0.53 / -2.1%
tpcds_q10/datafusion:vortex-file-compressed 29436956 / 30085012 / -2.2% 50657687 / 52137693 / -2.8% 0.58 / 0.58 / +0.7%
tpcds_q11/datafusion:vortex-file-compressed 49330134 / 48611620 / +1.5% 77080154 / 76537700 / +0.7% 0.64 / 0.64 / +0.8%
tpcds_q12/datafusion:vortex-file-compressed 15348744 / 15823516 / -3.0% 33943272 / 34545294 / -1.7% 0.45 / 0.46 / -1.3%
tpcds_q13/datafusion:vortex-file-compressed 30878949 / 30969520 / -0.3% 56213504 / 56794531 / -1.0% 0.55 / 0.55 / +0.7%
tpcds_q14/datafusion:vortex-file-compressed 487519536 / 488718557 / -0.2% 538644492 / 545204627 / -1.2% 0.91 / 0.90 / +1.0%
tpcds_q15/datafusion:vortex-file-compressed 12743404 / 12586246 / +1.2% 31666847 / 34236879 / -7.5% 0.40 / 0.37 / +9.5%
tpcds_q16/datafusion:vortex-file-compressed 18594396 / 18777760 / -1.0% 37970275 / 37487992 / +1.3% 0.49 / 0.50 / -2.2%
tpcds_q17/datafusion:vortex-file-compressed 51515514 / 53728307 / -4.1% 78179500 / 74259393 / +5.3% 0.66 / 0.72 / -8.9%
tpcds_q18/datafusion:vortex-file-compressed 54406385 / 56079304 / -3.0% 74426246 / 74409649 / +0.0% 0.73 / 0.75 / -3.0%
tpcds_q19/datafusion:vortex-file-compressed 17026568 / 16752122 / +1.6% 41274534 / 39217489 / +5.2% 0.41 / 0.43 / -3.4%
tpcds_q20/datafusion:vortex-file-compressed 16783221 / 16332867 / +2.8% 35161962 / 35114851 / +0.1% 0.48 / 0.47 / +2.6%
tpcds_q21/datafusion:vortex-file-compressed 15260318 / 15800620 / -3.4% 37576774 / 34343060 / +9.4% 0.41 / 0.46 / -11.7%
tpcds_q22/datafusion:vortex-file-compressed 49668762 / 50022502 / -0.7% 72814175 / 72190995 / +0.9% 0.68 / 0.69 / -1.6%
tpcds_q23/datafusion:vortex-file-compressed 71210125 / 71383412 / -0.2% 99302297 / 98836207 / +0.5% 0.72 / 0.72 / -0.7%
tpcds_q24/datafusion:vortex-file-compressed 63722432 / 63532012 / +0.3% 87050309 / 88065709 / -1.2% 0.73 / 0.72 / +1.5%
tpcds_q25/datafusion:vortex-file-compressed 45804713 / 45717448 / +0.2% 69833218 / 75322928 / -7.3% 0.66 / 0.61 / +8.1%
tpcds_q26/datafusion:vortex-file-compressed 26738633 / 25904746 / +3.2% 47517835 / 46848926 / +1.4% 0.56 / 0.55 / +1.8%
tpcds_q27/datafusion:vortex-file-compressed 51061690 / 53875108 / -5.2% 76989318 / 78392165 / -1.8% 0.66 / 0.69 / -3.5%
tpcds_q28/datafusion:vortex-file-compressed 18675819 / 18593076 / +0.4% 34661453 / 39388017 / -12.0% 🟢 0.54 / 0.47 / +14.1%
tpcds_q29/datafusion:vortex-file-compressed 47476498 / 50669238 / -6.3% 75296453 / 74492222 / +1.1% 0.63 / 0.68 / -7.3%
tpcds_q30/datafusion:vortex-file-compressed 27686652 / 27855018 / -0.6% 46471388 / 46301850 / +0.4% 0.60 / 0.60 / -1.0%
tpcds_q31/datafusion:vortex-file-compressed 63233619 / 62800076 / +0.7% 92080959 / 90358003 / +1.9% 0.69 / 0.70 / -1.2%
tpcds_q32/datafusion:vortex-file-compressed 12831797 / 12705820 / +1.0% 30736263 / 29725424 / +3.4% 0.42 / 0.43 / -2.3%
tpcds_q33/datafusion:vortex-file-compressed 27739275 / 27807681 / -0.2% 52089801 / 51954022 / +0.3% 0.53 / 0.54 / -0.5%
tpcds_q34/datafusion:vortex-file-compressed 17479000 / 17567206 / -0.5% 37577979 / 38050626 / -1.2% 0.47 / 0.46 / +0.7%
tpcds_q35/datafusion:vortex-file-compressed 30268310 / 30895764 / -2.0% 54800084 / 56669367 / -3.3% 0.55 / 0.55 / +1.3%
tpcds_q36/datafusion:vortex-file-compressed 46640984 / 46828800 / -0.4% 68466986 / 69293720 / -1.2% 0.68 / 0.68 / +0.8%
tpcds_q37/datafusion:vortex-file-compressed 13238148 / 12609494 / +5.0% 34493533 / 35876260 / -3.9% 0.38 / 0.35 / +9.2%
tpcds_q38/datafusion:vortex-file-compressed 26488331 / 26272796 / +0.8% 47905224 / 48618694 / -1.5% 0.55 / 0.54 / +2.3%
tpcds_q39/datafusion:vortex-file-compressed 64905786 / 64396852 / +0.8% 86504419 / 89389578 / -3.2% 0.75 / 0.72 / +4.2%
tpcds_q40/datafusion:vortex-file-compressed 23097720 / 22598054 / +2.2% 41587306 / 41725260 / -0.3% 0.56 / 0.54 / +2.6%
tpcds_q41/datafusion:vortex-file-compressed 19603308 / 19689584 / -0.4% 34787171 / 33002068 / +5.4% 0.56 / 0.60 / -5.5%
tpcds_q42/datafusion:vortex-file-compressed 11651406 / 11496814 / +1.3% 28583218 / 27387696 / +4.4% 0.41 / 0.42 / -2.9%
tpcds_q43/datafusion:vortex-file-compressed 13248758 / 13096368 / +1.2% 32390067 / 32995837 / -1.8% 0.41 / 0.40 / +3.1%
tpcds_q44/datafusion:vortex-file-compressed 27081696 / 27593222 / -1.9% 51604488 / 51432401 / +0.3% 0.52 / 0.54 / -2.2%
tpcds_q45/datafusion:vortex-file-compressed 16802192 / 17345528 / -3.1% 36147918 / 36241981 / -0.3% 0.46 / 0.48 / -2.9%
tpcds_q46/datafusion:vortex-file-compressed 23633343 / 23880296 / -1.0% 48143344 / 48412100 / -0.6% 0.49 / 0.49 / -0.5%
tpcds_q47/datafusion:vortex-file-compressed 75155546 / 74902031 / +0.3% 105134434 / 106649543 / -1.4% 0.71 / 0.70 / +1.8%
tpcds_q48/datafusion:vortex-file-compressed 28340246 / 28485492 / -0.5% 53343758 / 51209907 / +4.2% 0.53 / 0.56 / -4.5%
tpcds_q49/datafusion:vortex-file-compressed 55263994 / 58695509 / -5.8% 80784452 / 76606472 / +5.5% 0.68 / 0.77 / -10.7%
tpcds_q50/datafusion:vortex-file-compressed 30750388 / 30585356 / +0.5% 52057442 / 50853625 / +2.4% 0.59 / 0.60 / -1.8%
tpcds_q51/datafusion:vortex-file-compressed 66656522 / 66838349 / -0.3% 89856042 / 90679099 / -0.9% 0.74 / 0.74 / +0.6%
tpcds_q52/datafusion:vortex-file-compressed 11894792 / 11833430 / +0.5% 28502873 / 28987860 / -1.7% 0.42 / 0.41 / +2.2%
tpcds_q53/datafusion:vortex-file-compressed 18375897 / 18080796 / +1.6% 42356027 / 40801367 / +3.8% 0.43 / 0.44 / -2.1%
tpcds_q54/datafusion:vortex-file-compressed 31798192 / 32238074 / -1.4% 54973157 / 54329472 / +1.2% 0.58 / 0.59 / -2.5%
tpcds_q55/datafusion:vortex-file-compressed 11668737 / 11637509 / +0.3% 27560634 / 28662902 / -3.8% 0.42 / 0.41 / +4.3%
tpcds_q56/datafusion:vortex-file-compressed 26464707 / 26487509 / -0.1% 49037467 / 49157512 / -0.2% 0.54 / 0.54 / +0.2%
tpcds_q57/datafusion:vortex-file-compressed 62269177 / 62561647 / -0.5% 88751585 / 89114224 / -0.4% 0.70 / 0.70 / -0.1%
tpcds_q58/datafusion:vortex-file-compressed 40181593 / 40299633 / -0.3% 66159133 / 68340530 / -3.2% 0.61 / 0.59 / +3.0%
tpcds_q59/datafusion:vortex-file-compressed 27636968 / 27562263 / +0.3% 52769079 / 54720783 / -3.6% 0.52 / 0.50 / +4.0%
tpcds_q60/datafusion:vortex-file-compressed 26145201 / 26825272 / -2.5% 48538580 / 49148292 / -1.2% 0.54 / 0.55 / -1.3%
tpcds_q61/datafusion:vortex-file-compressed 20447060 / 20257310 / +0.9% 42843721 / 43155132 / -0.7% 0.48 / 0.47 / +1.7%
tpcds_q62/datafusion:vortex-file-compressed 16430692 / 16672509 / -1.5% 35489689 / 34745748 / +2.1% 0.46 / 0.48 / -3.5%
tpcds_q63/datafusion:vortex-file-compressed 17971022 / 18309886 / -1.9% 39296328 / 41624963 / -5.6% 0.46 / 0.44 / +4.0%
tpcds_q64/datafusion:vortex-file-compressed 190605896 / 191570520 / -0.5% 219714465 / 227038579 / -3.2% 0.87 / 0.84 / +2.8%
tpcds_q65/datafusion:vortex-file-compressed 73043596 / 75002974 / -2.6% 98239635 / 95770247 / +2.6% 0.74 / 0.78 / -5.1%
tpcds_q66/datafusion:vortex-file-compressed 49507191 / 49991196 / -1.0% 70764239 / 70818778 / -0.1% 0.70 / 0.71 / -0.9%
tpcds_q67/datafusion:vortex-file-compressed 50964840 / 51812209 / -1.6% 85780095 / 83990975 / +2.1% 0.59 / 0.62 / -3.7%
tpcds_q68/datafusion:vortex-file-compressed 22664530 / 23075120 / -1.8% 45618740 / 48943339 / -6.8% 0.50 / 0.47 / +5.4%
tpcds_q69/datafusion:vortex-file-compressed 26953772 / 26593542 / +1.4% 49895991 / 50433926 / -1.1% 0.54 / 0.53 / +2.4%
tpcds_q70/datafusion:vortex-file-compressed 72979901 / 73042057 / -0.1% 100796022 / 94237137 / +7.0% 0.72 / 0.78 / -6.6%
tpcds_q71/datafusion:vortex-file-compressed 19042907 / 18050385 / +5.5% 40979718 / 39748131 / +3.1% 0.46 / 0.45 / +2.3%
tpcds_q72/datafusion:vortex-file-compressed 277199908 / 264069742 / +5.0% 290956714 / 279412497 / +4.1% 0.95 / 0.95 / +0.8%
tpcds_q73/datafusion:vortex-file-compressed 16490976 / 16540644 / -0.3% 37695091 / 36678510 / +2.8% 0.44 / 0.45 / -3.0%
tpcds_q74/datafusion:vortex-file-compressed 40741923 / 40665012 / +0.2% 68966527 / 69167580 / -0.3% 0.59 / 0.59 / +0.5%
tpcds_q75/datafusion:vortex-file-compressed 137538956 / 134278815 / +2.4% 161846651 / 162528797 / -0.4% 0.85 / 0.83 / +2.9%
tpcds_q76/datafusion:vortex-file-compressed 29799710 / 29624977 / +0.6% 50578937 / 50538109 / +0.1% 0.59 / 0.59 / +0.5%
tpcds_q77/datafusion:vortex-file-compressed 44870742 / 45831518 / -2.1% 68302351 / 66474565 / +2.7% 0.66 / 0.69 / -4.7%
tpcds_q78/datafusion:vortex-file-compressed 60546460 / 61231952 / -1.1% 90248318 / 89388960 / +1.0% 0.67 / 0.69 / -2.1%
tpcds_q79/datafusion:vortex-file-compressed 19985638 / 20288050 / -1.5% 43203368 / 42129203 / +2.5% 0.46 / 0.48 / -3.9%
tpcds_q80/datafusion:vortex-file-compressed 68471954 / 68878902 / -0.6% 93328424 / 95297869 / -2.1% 0.73 / 0.72 / +1.5%
tpcds_q81/datafusion:vortex-file-compressed 27938555 / 27734650 / +0.7% 47298137 / 46012481 / +2.8% 0.59 / 0.60 / -2.0%
tpcds_q82/datafusion:vortex-file-compressed 12306697 / 12737110 / -3.4% 36838846 / 35350220 / +4.2% 0.33 / 0.36 / -7.3%
tpcds_q83/datafusion:vortex-file-compressed 34980941 / 34783423 / +0.6% 54567860 / 55819941 / -2.2% 0.64 / 0.62 / +2.9%
tpcds_q84/datafusion:vortex-file-compressed 10508786 / 10317042 / +1.9% 26532066 / 27898547 / -4.9% 0.40 / 0.37 / +7.1%
tpcds_q85/datafusion:vortex-file-compressed 51904550 / 52041198 / -0.3% 79576713 / 79848069 / -0.3% 0.65 / 0.65 / +0.1%
tpcds_q86/datafusion:vortex-file-compressed 16240394 / 16215968 / +0.2% 34847109 / 35812203 / -2.7% 0.47 / 0.45 / +2.9%
tpcds_q87/datafusion:vortex-file-compressed 26232846 / 26654630 / -1.6% 49446905 / 48977396 / +1.0% 0.53 / 0.54 / -2.5%
tpcds_q88/datafusion:vortex-file-compressed 31406202 / 31582316 / -0.6% 50126331 / 53211921 / -5.8% 0.63 / 0.59 / +5.6%
tpcds_q89/datafusion:vortex-file-compressed 21621324 / 21361534 / +1.2% 44285848 / 44195960 / +0.2% 0.49 / 0.48 / +1.0%
tpcds_q90/datafusion:vortex-file-compressed 10542002 / 10504006 / +0.4% 26389575 / 25691948 / +2.7% 0.40 / 0.41 / -2.3%
tpcds_q91/datafusion:vortex-file-compressed 16158500 / 15918642 / +1.5% 37543607 / 36991450 / +1.5% 0.43 / 0.43 / +0.0%
tpcds_q92/datafusion:vortex-file-compressed 13395864 / 13235183 / +1.2% 30110885 / 31431188 / -4.2% 0.44 / 0.42 / +5.7%
tpcds_q93/datafusion:vortex-file-compressed 20077066 / 20297074 / -1.1% 40317704 / 40745604 / -1.1% 0.50 / 0.50 / -0.0%
tpcds_q94/datafusion:vortex-file-compressed 18501982 / 19047842 / -2.9% 38720644 / 37043604 / +4.5% 0.48 / 0.51 / -7.1%
tpcds_q95/datafusion:vortex-file-compressed 42155796 / 42205006 / -0.1% 61379914 / 62308957 / -1.5% 0.69 / 0.68 / +1.4%
tpcds_q96/datafusion:vortex-file-compressed 7792658 / 7694872 / +1.3% 24387560 / 25898610 / -5.8% 0.32 / 0.30 / +7.5%
tpcds_q97/datafusion:vortex-file-compressed 17477060 / 17138557 / +2.0% 39467582 / 38573188 / +2.3% 0.44 / 0.44 / -0.3%
tpcds_q98/datafusion:vortex-file-compressed 16230140 / 15901438 / +2.1% 37236789 / 35136326 / +6.0% 0.44 / 0.45 / -3.7%
tpcds_q99/datafusion:vortex-file-compressed 16270466 / 16056798 / +1.3% 33809957 / 33875370 / -0.2% 0.48 / 0.47 / +1.5%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43627740 / 42124441 / +3.6% 61866122 / 61335072 / +0.9% 0.71 / 0.69 / +2.7%
tpcds_q02/datafusion:parquet 55306600 / 54382945 / +1.7% 71476641 / 70407849 / +1.5% 0.77 / 0.77 / +0.2%
tpcds_q03/datafusion:parquet 18665602 / 18937887 / -1.4% 34028311 / 31559972 / +7.8% 0.55 / 0.60 / -8.6%
tpcds_q04/datafusion:parquet 176217277 / 178331180 / -1.2% 208770401 / 207606000 / +0.6% 0.84 / 0.86 / -1.7%
tpcds_q05/datafusion:parquet 66672132 / 67543579 / -1.3% 89840775 / 90495399 / -0.7% 0.74 / 0.75 / -0.6%
tpcds_q06/datafusion:parquet 33940948 / 33794529 / +0.4% 48416983 / 48884441 / -1.0% 0.70 / 0.69 / +1.4%
tpcds_q07/datafusion:parquet 47213565 / 47020748 / +0.4% 67335624 / 63995634 / +5.2% 0.70 / 0.73 / -4.6%
tpcds_q08/datafusion:parquet 30829195 / 31266224 / -1.4% 48170537 / 47003843 / +2.5% 0.64 / 0.67 / -3.8%
tpcds_q09/datafusion:parquet 33528042 / 33121424 / +1.2% 44069980 / 37738239 / +16.8% 🔴 0.76 / 0.88 / -13.3%
tpcds_q10/datafusion:parquet 43268768 / 43807856 / -1.2% 58888282 / 60234929 / -2.2% 0.73 / 0.73 / +1.0%
tpcds_q11/datafusion:parquet 96302147 / 97324814 / -1.1% 119367298 / 120312815 / -0.8% 0.81 / 0.81 / -0.3%
tpcds_q12/datafusion:parquet 23654892 / 23393886 / +1.1% 37064916 / 37173910 / -0.3% 0.64 / 0.63 / +1.4%
tpcds_q13/datafusion:parquet 45463260 / 46080351 / -1.3% 68132948 / 68534318 / -0.6% 0.67 / 0.67 / -0.8%
tpcds_q14/datafusion:parquet 532194551 / 535182781 / -0.6% 581519225 / 582897591 / -0.2% 0.92 / 0.92 / -0.3%
tpcds_q15/datafusion:parquet 23667637 / 23915794 / -1.0% 40095278 / 38277700 / +4.7% 0.59 / 0.62 / -5.5%
tpcds_q16/datafusion:parquet 36929308 / 36826879 / +0.3% 51447062 / 50770849 / +1.3% 0.72 / 0.73 / -1.0%
tpcds_q17/datafusion:parquet 74030041 / 72601440 / +2.0% 98134634 / 96601773 / +1.6% 0.75 / 0.75 / +0.4%
tpcds_q18/datafusion:parquet 68494661 / 68457950 / +0.1% 88617218 / 92677806 / -4.4% 0.77 / 0.74 / +4.6%
tpcds_q19/datafusion:parquet 29501066 / 29684787 / -0.6% 42705457 / 41950311 / +1.8% 0.69 / 0.71 / -2.4%
tpcds_q20/datafusion:parquet 25116646 / 24852470 / +1.1% 37409982 / 39241052 / -4.7% 0.67 / 0.63 / +6.0%
tpcds_q21/datafusion:parquet 20239633 / 19916227 / +1.6% 34314690 / 32271372 / +6.3% 0.59 / 0.62 / -4.4%
tpcds_q22/datafusion:parquet 78099304 / 77742574 / +0.5% 89440561 / 89605937 / -0.2% 0.87 / 0.87 / +0.6%
tpcds_q23/datafusion:parquet 93013915 / 93850537 / -0.9% 111091543 / 114862357 / -3.3% 0.84 / 0.82 / +2.5%
tpcds_q24/datafusion:parquet 89948584 / 89760014 / +0.2% 112352372 / 114872714 / -2.2% 0.80 / 0.78 / +2.5%
tpcds_q25/datafusion:parquet 75520656 / 80896832 / -6.6% 95203436 / 100089630 / -4.9% 0.79 / 0.81 / -1.9%
tpcds_q26/datafusion:parquet 43533468 / 43126936 / +0.9% 60911178 / 61811092 / -1.5% 0.71 / 0.70 / +2.4%
tpcds_q27/datafusion:parquet 78772829 / 75300787 / +4.6% 95840902 / 99277540 / -3.5% 0.82 / 0.76 / +8.4%
tpcds_q28/datafusion:parquet 28436416 / 28458368 / -0.1% 43306865 / 43490351 / -0.4% 0.66 / 0.65 / +0.3%
tpcds_q29/datafusion:parquet 74165548 / 75841623 / -2.2% 95526326 / 100497442 / -4.9% 0.78 / 0.75 / +2.9%
tpcds_q30/datafusion:parquet 45044494 / 45779788 / -1.6% 58169676 / 61046509 / -4.7% 0.77 / 0.75 / +3.3%
tpcds_q31/datafusion:parquet 77577400 / 79483353 / -2.4% 99627681 / 97777369 / +1.9% 0.78 / 0.81 / -4.2%
tpcds_q32/datafusion:parquet 26618364 / 27137775 / -1.9% 41024312 / 40243298 / +1.9% 0.65 / 0.67 / -3.8%
tpcds_q33/datafusion:parquet 37394710 / 37623841 / -0.6% 54781785 / 54091839 / +1.3% 0.68 / 0.70 / -1.9%
tpcds_q34/datafusion:parquet 24297972 / 23954961 / +1.4% 36347745 / 36050106 / +0.8% 0.67 / 0.66 / +0.6%
tpcds_q35/datafusion:parquet 50161751 / 49812126 / +0.7% 62163861 / 63306137 / -1.8% 0.81 / 0.79 / +2.6%
tpcds_q36/datafusion:parquet 52695724 / 51243602 / +2.8% 74306280 / 72556831 / +2.4% 0.71 / 0.71 / +0.4%
tpcds_q37/datafusion:parquet 21026704 / 21230620 / -1.0% 34561251 / 35090103 / -1.5% 0.61 / 0.61 / +0.6%
tpcds_q38/datafusion:parquet 45256769 / 44412062 / +1.9% 63832656 / 63761810 / +0.1% 0.71 / 0.70 / +1.8%
tpcds_q39/datafusion:parquet 68149692 / 67861920 / +0.4% 86356226 / 84634149 / +2.0% 0.79 / 0.80 / -1.6%
tpcds_q40/datafusion:parquet 29588134 / 30226196 / -2.1% 49676413 / 50653335 / -1.9% 0.60 / 0.60 / -0.2%
tpcds_q41/datafusion:parquet 19993748 / 19926826 / +0.3% 33348252 / 32515448 / +2.6% 0.60 / 0.61 / -2.2%
tpcds_q42/datafusion:parquet 18176116 / 18382166 / -1.1% 32545206 / 31258050 / +4.1% 0.56 / 0.59 / -5.0%
tpcds_q43/datafusion:parquet 19506482 / 19423290 / +0.4% 32303422 / 32296052 / +0.0% 0.60 / 0.60 / +0.4%
tpcds_q44/datafusion:parquet 34419885 / 35660086 / -3.5% 49622361 / 52217642 / -5.0% 0.69 / 0.68 / +1.6%
tpcds_q45/datafusion:parquet 27940232 / 27782476 / +0.6% 41255440 / 41068441 / +0.5% 0.68 / 0.68 / +0.1%
tpcds_q46/datafusion:parquet 28574316 / 28901943 / -1.1% 46224612 / 46308050 / -0.2% 0.62 / 0.62 / -1.0%
tpcds_q47/datafusion:parquet 97136086 / 98304456 / -1.2% 121326703 / 120588068 / +0.6% 0.80 / 0.82 / -1.8%
tpcds_q48/datafusion:parquet 41744006 / 41664722 / +0.2% 59916445 / 59650993 / +0.4% 0.70 / 0.70 / -0.3%
tpcds_q49/datafusion:parquet 76772403 / 70085290 / +9.5% 96814322 / 94473592 / +2.5% 0.79 / 0.74 / +6.9%
tpcds_q50/datafusion:parquet 47983684 / 45949709 / +4.4% 66268008 / 65846211 / +0.6% 0.72 / 0.70 / +3.8%
tpcds_q51/datafusion:parquet 75280464 / 75004643 / +0.4% 94073420 / 95093949 / -1.1% 0.80 / 0.79 / +1.5%
tpcds_q52/datafusion:parquet 18582493 / 18434712 / +0.8% 30498398 / 30996539 / -1.6% 0.61 / 0.59 / +2.4%
tpcds_q53/datafusion:parquet 22432597 / 23334352 / -3.9% 38779009 / 38928810 / -0.4% 0.58 / 0.60 / -3.5%
tpcds_q54/datafusion:parquet 53334832 / 52787031 / +1.0% 68365594 / 68710489 / -0.5% 0.78 / 0.77 / +1.5%
tpcds_q55/datafusion:parquet 18012326 / 18031698 / -0.1% 31540707 / 31397840 / +0.5% 0.57 / 0.57 / -0.6%
tpcds_q56/datafusion:parquet 41894676 / 41928440 / -0.1% 56460362 / 55838355 / +1.1% 0.74 / 0.75 / -1.2%
tpcds_q57/datafusion:parquet 101954363 / 101157820 / +0.8% 116236529 / 120515392 / -3.6% 0.88 / 0.84 / +4.5%
tpcds_q58/datafusion:parquet 65470109 / 64712466 / +1.2% 85041359 / 84003063 / +1.2% 0.77 / 0.77 / -0.1%
tpcds_q59/datafusion:parquet 47322000 / 48418482 / -2.3% 66702895 / 67173043 / -0.7% 0.71 / 0.72 / -1.6%
tpcds_q60/datafusion:parquet 41035878 / 41432007 / -1.0% 54156585 / 56804542 / -4.7% 0.76 / 0.73 / +3.9%
tpcds_q61/datafusion:parquet 36061884 / 34935940 / +3.2% 51403797 / 54249427 / -5.2% 0.70 / 0.64 / +8.9%
tpcds_q62/datafusion:parquet 25022824 / 24972797 / +0.2% 37596293 / 38476298 / -2.3% 0.67 / 0.65 / +2.5%
tpcds_q63/datafusion:parquet 21913142 / 22364184 / -2.0% 39296146 / 40123393 / -2.1% 0.56 / 0.56 / +0.0%
tpcds_q64/datafusion:parquet 285725936 / 287139524 / -0.5% 323865783 / 325359144 / -0.5% 0.88 / 0.88 / -0.0%
tpcds_q65/datafusion:parquet 121001896 / 120580158 / +0.3% 132822784 / 138612892 / -4.2% 0.91 / 0.87 / +4.7%
tpcds_q66/datafusion:parquet 59557628 / 61051164 / -2.4% 76617765 / 77879706 / -1.6% 0.78 / 0.78 / -0.8%
tpcds_q67/datafusion:parquet 68342300 / 68623384 / -0.4% 94216529 / 93625675 / +0.6% 0.73 / 0.73 / -1.0%
tpcds_q68/datafusion:parquet 28768254 / 29006914 / -0.8% 48646333 / 50112635 / -2.9% 0.59 / 0.58 / +2.2%
tpcds_q69/datafusion:parquet 42924888 / 42838314 / +0.2% 58258714 / 59276689 / -1.7% 0.74 / 0.72 / +2.0%
tpcds_q70/datafusion:parquet 80244606 / 79762482 / +0.6% 100062911 / 97708114 / +2.4% 0.80 / 0.82 / -1.8%
tpcds_q71/datafusion:parquet 26200648 / 26514088 / -1.2% 39051458 / 38960028 / +0.2% 0.67 / 0.68 / -1.4%
tpcds_q72/datafusion:parquet 519384992 / 520779186 / -0.3% 543252365 / 562553984 / -3.4% 0.96 / 0.93 / +3.3%
tpcds_q73/datafusion:parquet 23874412 / 23784070 / +0.4% 37698718 / 36310216 / +3.8% 0.63 / 0.66 / -3.3%
tpcds_q74/datafusion:parquet 69023914 / 70366873 / -1.9% 90054194 / 89879555 / +0.2% 0.77 / 0.78 / -2.1%
tpcds_q75/datafusion:parquet 153245329 / 151463481 / +1.2% 176743197 / 182107896 / -2.9% 0.87 / 0.83 / +4.2%
tpcds_q76/datafusion:parquet 33069699 / 33559856 / -1.5% 46564695 / 46297173 / +0.6% 0.71 / 0.72 / -2.0%
tpcds_q77/datafusion:parquet 57103032 / 57565968 / -0.8% 79174772 / 75562638 / +4.8% 0.72 / 0.76 / -5.3%
tpcds_q78/datafusion:parquet 85364853 / 86427014 / -1.2% 117532141 / 118681521 / -1.0% 0.73 / 0.73 / -0.3%
tpcds_q79/datafusion:parquet 26553377 / 26638546 / -0.3% 42109335 / 42848740 / -1.7% 0.63 / 0.62 / +1.4%
tpcds_q80/datafusion:parquet 80760413 / 79006926 / +2.2% 110578822 / 111035914 / -0.4% 0.73 / 0.71 / +2.6%
tpcds_q81/datafusion:parquet 38151312 / 36576835 / +4.3% 50293279 / 52981826 / -5.1% 0.76 / 0.69 / +9.9%
tpcds_q82/datafusion:parquet 22221745 / 22172608 / +0.2% 35807428 / 36926043 / -3.0% 0.62 / 0.60 / +3.4%
tpcds_q83/datafusion:parquet 58891480 / 59068687 / -0.3% 76681382 / 76076124 / +0.8% 0.77 / 0.78 / -1.1%
tpcds_q84/datafusion:parquet 26195822 / 26328924 / -0.5% 40822029 / 39176757 / +4.2% 0.64 / 0.67 / -4.5%
tpcds_q85/datafusion:parquet 79572220 / 79611710 / -0.0% 106571866 / 104252478 / +2.2% 0.75 / 0.76 / -2.2%
tpcds_q86/datafusion:parquet 20655500 / 20799439 / -0.7% 33630425 / 33744920 / -0.3% 0.61 / 0.62 / -0.4%
tpcds_q87/datafusion:parquet 44784590 / 44552918 / +0.5% 58145437 / 59845300 / -2.8% 0.77 / 0.74 / +3.5%
tpcds_q88/datafusion:parquet 37207789 / 36511954 / +1.9% 51692337 / 50375290 / +2.6% 0.72 / 0.72 / -0.7%
tpcds_q89/datafusion:parquet 25681034 / 25523938 / +0.6% 42103821 / 41889362 / +0.5% 0.61 / 0.61 / +0.1%
tpcds_q90/datafusion:parquet 15047637 / 15623538 / -3.7% 27040898 / 27100307 / -0.2% 0.56 / 0.58 / -3.5%
tpcds_q91/datafusion:parquet 32326674 / 32807702 / -1.5% 50723430 / 47313578 / +7.2% 0.64 / 0.69 / -8.1%
tpcds_q92/datafusion:parquet 26630386 / 26751832 / -0.5% 36670720 / 40567704 / -9.6% 0.73 / 0.66 / +10.1%
tpcds_q93/datafusion:parquet 26425879 / 26359654 / +0.3% 46996879 / 47188079 / -0.4% 0.56 / 0.56 / +0.7%
tpcds_q94/datafusion:parquet 34784820 / 35016474 / -0.7% 49164544 / 50086946 / -1.8% 0.71 / 0.70 / +1.2%
tpcds_q95/datafusion:parquet 64468649 / 65583250 / -1.7% 77107532 / 78928675 / -2.3% 0.84 / 0.83 / +0.6%
tpcds_q96/datafusion:parquet 13295380 / 12962555 / +2.6% 24966997 / 24291890 / +2.8% 0.53 / 0.53 / -0.2%
tpcds_q97/datafusion:parquet 35809522 / 35309756 / +1.4% 53673950 / 52887848 / +1.5% 0.67 / 0.67 / -0.1%
tpcds_q98/datafusion:parquet 24764558 / 24763240 / +0.0% 40781013 / 38901359 / +4.8% 0.61 / 0.64 / -4.6%
tpcds_q99/datafusion:parquet 29784877 / 29865346 / -0.3% 43252531 / 42603337 / +1.5% 0.69 / 0.70 / -1.8%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15971222 / 16220942 / -1.5% 24416172 / 25113829 / -2.8% 0.65 / 0.65 / +1.3%
tpcds_q02/duckdb:vortex-file-compressed 15845260 / 15888044 / -0.3% 22484220 / 23404542 / -3.9% 0.70 / 0.68 / +3.8%
tpcds_q03/duckdb:vortex-file-compressed 7193564 / 7035414 / +2.2% 16137735 / 15869386 / +1.7% 0.45 / 0.44 / +0.5%
tpcds_q04/duckdb:vortex-file-compressed 58970056 / 58464260 / +0.9% 71692232 / 71846807 / -0.2% 0.82 / 0.81 / +1.1%
tpcds_q05/duckdb:vortex-file-compressed 22858662 / 22924154 / -0.3% 32768188 / 33132639 / -1.1% 0.70 / 0.69 / +0.8%
tpcds_q06/duckdb:vortex-file-compressed 24209859 / 24002724 / +0.9% 37735052 / 37895927 / -0.4% 0.64 / 0.63 / +1.3%
tpcds_q07/duckdb:vortex-file-compressed 22513850 / 22245362 / +1.2% 34087882 / 34655256 / -1.6% 0.66 / 0.64 / +2.9%
tpcds_q08/duckdb:vortex-file-compressed 17353906 / 17390104 / -0.2% 25636532 / 25799842 / -0.6% 0.68 / 0.67 / +0.4%
tpcds_q09/duckdb:vortex-file-compressed 18924572 / 19243684 / -1.7% 29684033 / 28578211 / +3.9% 0.64 / 0.67 / -5.3%
tpcds_q10/duckdb:vortex-file-compressed 27619733 / 27926112 / -1.1% 42271217 / 41100938 / +2.8% 0.65 / 0.68 / -3.8%
tpcds_q11/duckdb:vortex-file-compressed 36173980 / 36364902 / -0.5% 45142771 / 45640093 / -1.1% 0.80 / 0.80 / +0.6%
tpcds_q12/duckdb:vortex-file-compressed 10237770 / 10332720 / -0.9% 16823911 / 17351121 / -3.0% 0.61 / 0.60 / +2.2%
tpcds_q13/duckdb:vortex-file-compressed 20141809 / 19818257 / +1.6% 33626029 / 33922768 / -0.9% 0.60 / 0.58 / +2.5%
tpcds_q14/duckdb:vortex-file-compressed 54781635 / 55994314 / -2.2% 65399556 / 65535415 / -0.2% 0.84 / 0.85 / -2.0%
tpcds_q15/duckdb:vortex-file-compressed 11053416 / 11165736 / -1.0% 17530457 / 18147881 / -3.4% 0.63 / 0.62 / +2.5%
tpcds_q16/duckdb:vortex-file-compressed 24546984 / 24507233 / +0.2% 35781074 / 35255777 / +1.5% 0.69 / 0.70 / -1.3%
tpcds_q17/duckdb:vortex-file-compressed 19884110 / 20095406 / -1.1% 32227579 / 32905423 / -2.1% 0.62 / 0.61 / +1.0%
tpcds_q18/duckdb:vortex-file-compressed 32218124 / 32401436 / -0.6% 41909723 / 42580340 / -1.6% 0.77 / 0.76 / +1.0%
tpcds_q19/duckdb:vortex-file-compressed 20717784 / 20403936 / +1.5% 29420548 / 29273664 / +0.5% 0.70 / 0.70 / +1.0%
tpcds_q20/duckdb:vortex-file-compressed 10819510 / 10925662 / -1.0% 17824208 / 17394227 / +2.5% 0.61 / 0.63 / -3.4%
tpcds_q21/duckdb:vortex-file-compressed 9881726 / 9953665 / -0.7% 24027370 / 22893584 / +5.0% 0.41 / 0.43 / -5.4%
tpcds_q22/duckdb:vortex-file-compressed 17945014 / 18127208 / -1.0% 30658575 / 30089942 / +1.9% 0.59 / 0.60 / -2.8%
tpcds_q23/duckdb:vortex-file-compressed 37854969 / 38197666 / -0.9% 49048478 / 49114083 / -0.1% 0.77 / 0.78 / -0.8%
tpcds_q24/duckdb:vortex-file-compressed 26881302 / 26301371 / +2.2% 36327639 / 37890032 / -4.1% 0.74 / 0.69 / +6.6%
tpcds_q25/duckdb:vortex-file-compressed 18996010 / 18956766 / +0.2% 31310428 / 32008502 / -2.2% 0.61 / 0.59 / +2.4%
tpcds_q26/duckdb:vortex-file-compressed 21937494 / 21750768 / +0.9% 31915729 / 32619195 / -2.2% 0.69 / 0.67 / +3.1%
tpcds_q27/duckdb:vortex-file-compressed 25121276 / 25033074 / +0.4% 37616338 / 36552079 / +2.9% 0.67 / 0.68 / -2.5%
tpcds_q28/duckdb:vortex-file-compressed 14608952 / 14993554 / -2.6% 26794274 / 25988854 / +3.1% 0.55 / 0.58 / -5.5%
tpcds_q29/duckdb:vortex-file-compressed 18488454 / 18568754 / -0.4% 31172842 / 30950964 / +0.7% 0.59 / 0.60 / -1.1%
tpcds_q30/duckdb:vortex-file-compressed 18395514 / 18426515 / -0.2% 27078564 / 28233796 / -4.1% 0.68 / 0.65 / +4.1%
tpcds_q31/duckdb:vortex-file-compressed 17830572 / 18154092 / -1.8% 26718381 / 26794008 / -0.3% 0.67 / 0.68 / -1.5%
tpcds_q32/duckdb:vortex-file-compressed 10422478 / 10646808 / -2.1% 18917468 / 18770172 / +0.8% 0.55 / 0.57 / -2.9%
tpcds_q33/duckdb:vortex-file-compressed 18047139 / 18115721 / -0.4% 28368849 / 27583037 / +2.8% 0.64 / 0.66 / -3.1%
tpcds_q34/duckdb:vortex-file-compressed 12942791 / 12752492 / +1.5% 22426009 / 21949213 / +2.2% 0.58 / 0.58 / -0.7%
tpcds_q35/duckdb:vortex-file-compressed 30801740 / 31020177 / -0.7% 45178764 / 43544798 / +3.8% 0.68 / 0.71 / -4.3%
tpcds_q36/duckdb:vortex-file-compressed 14044991 / 14035336 / +0.1% 24299163 / 24437567 / -0.6% 0.58 / 0.57 / +0.6%
tpcds_q37/duckdb:vortex-file-compressed 9878192 / 9722334 / +1.6% 24884964 / 25065412 / -0.7% 0.40 / 0.39 / +2.3%
tpcds_q38/duckdb:vortex-file-compressed 24295053 / 24457628 / -0.7% 32204646 / 31659147 / +1.7% 0.75 / 0.77 / -2.3%
tpcds_q39/duckdb:vortex-file-compressed 19217278 / 18840972 / +2.0% 32645205 / 33789734 / -3.4% 0.59 / 0.56 / +5.6%
tpcds_q40/duckdb:vortex-file-compressed 11377489 / 11287111 / +0.8% 20644314 / 19660907 / +5.0% 0.55 / 0.57 / -4.0%
tpcds_q41/duckdb:vortex-file-compressed 17173548 / 17260604 / -0.5% 23555236 / 23681243 / -0.5% 0.73 / 0.73 / +0.0%
tpcds_q42/duckdb:vortex-file-compressed 6883970 / 6921604 / -0.5% 15565812 / 15990187 / -2.7% 0.44 / 0.43 / +2.2%
tpcds_q43/duckdb:vortex-file-compressed 9679066 / 9582982 / +1.0% 18594680 / 19413718 / -4.2% 0.52 / 0.49 / +5.5%
tpcds_q44/duckdb:vortex-file-compressed 12685031 / 12752308 / -0.5% 25467759 / 25589790 / -0.5% 0.50 / 0.50 / -0.1%
tpcds_q45/duckdb:vortex-file-compressed 23189480 / 23792688 / -2.5% 31262088 / 31028137 / +0.8% 0.74 / 0.77 / -3.3%
tpcds_q46/duckdb:vortex-file-compressed 31628153 / 31579144 / +0.2% 44058202 / 43386624 / +1.5% 0.72 / 0.73 / -1.4%
tpcds_q47/duckdb:vortex-file-compressed 30972826 / 30976223 / -0.0% 40532553 / 40688020 / -0.4% 0.76 / 0.76 / +0.4%
tpcds_q48/duckdb:vortex-file-compressed 22527213 / 22490982 / +0.2% 36047127 / 36928454 / -2.4% 0.62 / 0.61 / +2.6%
tpcds_q49/duckdb:vortex-file-compressed 18891247 / 18682632 / +1.1% 31129654 / 31339189 / -0.7% 0.61 / 0.60 / +1.8%
tpcds_q50/duckdb:vortex-file-compressed 14929554 / 14787050 / +1.0% 26266021 / 24990523 / +5.1% 0.57 / 0.59 / -3.9%
tpcds_q51/duckdb:vortex-file-compressed 49412002 / 48677605 / +1.5% 77527052 / 78227513 / -0.9% 0.64 / 0.62 / +2.4%
tpcds_q52/duckdb:vortex-file-compressed 7156524 / 7049750 / +1.5% 16154421 / 17214654 / -6.2% 0.44 / 0.41 / +8.2%
tpcds_q53/duckdb:vortex-file-compressed 11347190 / 11279240 / +0.6% 21648253 / 20698374 / +4.6% 0.52 / 0.54 / -3.8%
tpcds_q54/duckdb:vortex-file-compressed 19680570 / 19544350 / +0.7% 31266174 / 30657772 / +2.0% 0.63 / 0.64 / -1.3%
tpcds_q55/duckdb:vortex-file-compressed 6896798 / 6797016 / +1.5% 16333740 / 15942075 / +2.5% 0.42 / 0.43 / -1.0%
tpcds_q56/duckdb:vortex-file-compressed 18203391 / 17935658 / +1.5% 27739398 / 27491703 / +0.9% 0.66 / 0.65 / +0.6%
tpcds_q57/duckdb:vortex-file-compressed 25373684 / 25603476 / -0.9% 34546002 / 34951211 / -1.2% 0.73 / 0.73 / +0.3%
tpcds_q58/duckdb:vortex-file-compressed 20364754 / 20930948 / -2.7% 30958924 / 31582094 / -2.0% 0.66 / 0.66 / -0.7%
tpcds_q59/duckdb:vortex-file-compressed 19499024 / 19444122 / +0.3% 27812923 / 26756231 / +3.9% 0.70 / 0.73 / -3.5%
tpcds_q60/duckdb:vortex-file-compressed 18338985 / 18870170 / -2.8% 29037702 / 29048833 / -0.0% 0.63 / 0.65 / -2.8%
tpcds_q61/duckdb:vortex-file-compressed 20137534 / 19863296 / +1.4% 31724214 / 31365178 / +1.1% 0.63 / 0.63 / +0.2%
tpcds_q62/duckdb:vortex-file-compressed 11430770 / 11266738 / +1.5% 18612761 / 18296536 / +1.7% 0.61 / 0.62 / -0.3%
tpcds_q63/duckdb:vortex-file-compressed 10894130 / 10894244 / -0.0% 19527765 / 19179602 / +1.8% 0.56 / 0.57 / -1.8%
tpcds_q64/duckdb:vortex-file-compressed 52309870 / 52264642 / +0.1% 69238874 / 68843655 / +0.6% 0.76 / 0.76 / -0.5%
tpcds_q65/duckdb:vortex-file-compressed 12896936 / 12835008 / +0.5% 23315783 / 24035916 / -3.0% 0.55 / 0.53 / +3.6%
tpcds_q66/duckdb:vortex-file-compressed 31654554 / 31602101 / +0.2% 38476363 / 39168591 / -1.8% 0.82 / 0.81 / +2.0%
tpcds_q67/duckdb:vortex-file-compressed 55031760 / 55841469 / -1.5% 64881771 / 67325567 / -3.6% 0.85 / 0.83 / +2.3%
tpcds_q68/duckdb:vortex-file-compressed 22623684 / 22828038 / -0.9% 35819900 / 36370794 / -1.5% 0.63 / 0.63 / +0.6%
tpcds_q69/duckdb:vortex-file-compressed 22746002 / 22837176 / -0.4% 37676911 / 37503338 / +0.5% 0.60 / 0.61 / -0.9%
tpcds_q70/duckdb:vortex-file-compressed 14706752 / 14853254 / -1.0% 25075043 / 25454317 / -1.5% 0.59 / 0.58 / +0.5%
tpcds_q71/duckdb:vortex-file-compressed 13467328 / 13625909 / -1.2% 23497992 / 23870488 / -1.6% 0.57 / 0.57 / +0.4%
tpcds_q72/duckdb:vortex-file-compressed 43205534 / 43273417 / -0.2% 57442552 / 56906413 / +0.9% 0.75 / 0.76 / -1.1%
tpcds_q73/duckdb:vortex-file-compressed 11959942 / 11851831 / +0.9% 20884145 / 21015397 / -0.6% 0.57 / 0.56 / +1.5%
tpcds_q74/duckdb:vortex-file-compressed 31387298 / 31386286 / +0.0% 40725533 / 41330420 / -1.5% 0.77 / 0.76 / +1.5%
tpcds_q75/duckdb:vortex-file-compressed 37497325 / 37853060 / -0.9% 48977776 / 51212202 / -4.4% 0.77 / 0.74 / +3.6%
tpcds_q76/duckdb:vortex-file-compressed 12792773 / 12618273 / +1.4% 23303692 / 22401510 / +4.0% 0.55 / 0.56 / -2.5%
tpcds_q77/duckdb:vortex-file-compressed 20952684 / 20829368 / +0.6% 31918708 / 31980676 / -0.2% 0.66 / 0.65 / +0.8%
tpcds_q78/duckdb:vortex-file-compressed 42827097 / 42652940 / +0.4% 53862555 / 52787645 / +2.0% 0.80 / 0.81 / -1.6%
tpcds_q79/duckdb:vortex-file-compressed 17064604 / 17129268 / -0.4% 28352600 / 28716488 / -1.3% 0.60 / 0.60 / +0.9%
tpcds_q80/duckdb:vortex-file-compressed 29668920 / 29739214 / -0.2% 44369923 / 44462974 / -0.2% 0.67 / 0.67 / -0.0%
tpcds_q81/duckdb:vortex-file-compressed 21219382 / 21255846 / -0.2% 30198400 / 31265636 / -3.4% 0.70 / 0.68 / +3.4%
tpcds_q82/duckdb:vortex-file-compressed 9919683 / 10065670 / -1.5% 26235389 / 24626727 / +6.5% 0.38 / 0.41 / -7.5%
tpcds_q83/duckdb:vortex-file-compressed 17408176 / 17417399 / -0.1% 24787640 / 24412387 / +1.5% 0.70 / 0.71 / -1.6%
tpcds_q84/duckdb:vortex-file-compressed 16041190 / 15641221 / +2.6% 23731625 / 23672634 / +0.2% 0.68 / 0.66 / +2.3%
tpcds_q85/duckdb:vortex-file-compressed 25001142 / 25013147 / -0.0% 37107366 / 36859138 / +0.7% 0.67 / 0.68 / -0.7%
tpcds_q86/duckdb:vortex-file-compressed 10238824 / 10209790 / +0.3% 18122468 / 17636751 / +2.8% 0.56 / 0.58 / -2.4%
tpcds_q87/duckdb:vortex-file-compressed 25944338 / 25994247 / -0.2% 33238719 / 33962191 / -2.1% 0.78 / 0.77 / +2.0%
tpcds_q88/duckdb:vortex-file-compressed 30284984 / 30086780 / +0.7% 41013294 / 39894422 / +2.8% 0.74 / 0.75 / -2.1%
tpcds_q89/duckdb:vortex-file-compressed 11923605 / 11781135 / +1.2% 21082898 / 21269977 / -0.9% 0.57 / 0.55 / +2.1%
tpcds_q90/duckdb:vortex-file-compressed 7926816 / 7789668 / +1.8% 15190589 / 14728819 / +3.1% 0.52 / 0.53 / -1.3%
tpcds_q91/duckdb:vortex-file-compressed 14851105 / 14872301 / -0.1% 24671898 / 24663889 / +0.0% 0.60 / 0.60 / -0.2%
tpcds_q92/duckdb:vortex-file-compressed 11009099 / 10812160 / +1.8% 19658653 / 20240748 / -2.9% 0.56 / 0.53 / +4.8%
tpcds_q93/duckdb:vortex-file-compressed 10191562 / 10283276 / -0.9% 24086020 / 23544588 / +2.3% 0.42 / 0.44 / -3.1%
tpcds_q94/duckdb:vortex-file-compressed 22075710 / 22246659 / -0.8% 32250031 / 31980327 / +0.8% 0.68 / 0.70 / -1.6%
tpcds_q95/duckdb:vortex-file-compressed 60731701 / 61002415 / -0.4% 68872974 / 67936924 / +1.4% 0.88 / 0.90 / -1.8%
tpcds_q96/duckdb:vortex-file-compressed 6506934 / 6525155 / -0.3% 15601241 / 16760811 / -6.9% 0.42 / 0.39 / +7.1%
tpcds_q97/duckdb:vortex-file-compressed 23358017 / 22825693 / +2.3% 32572497 / 32074469 / +1.6% 0.72 / 0.71 / +0.8%
tpcds_q98/duckdb:vortex-file-compressed 11286605 / 11200454 / +0.8% 20272662 / 19026183 / +6.6% 0.56 / 0.59 / -5.4%
tpcds_q99/duckdb:vortex-file-compressed 14642236 / 14543208 / +0.7% 22727064 / 23022643 / -1.3% 0.64 / 0.63 / +2.0%
duckdb / parquet / ns (1.002x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23922497 / 24013994 / -0.4% 31181440 / 30990762 / +0.6% 0.77 / 0.77 / -1.0%
tpcds_q02/duckdb:parquet 18032088 / 17829352 / +1.1% 23852617 / 24038963 / -0.8% 0.76 / 0.74 / +1.9%
tpcds_q03/duckdb:parquet 9672728 / 9863690 / -1.9% 15656323 / 15685042 / -0.2% 0.62 / 0.63 / -1.8%
tpcds_q04/duckdb:parquet 118309550 / 118471752 / -0.1% 126898185 / 126423571 / +0.4% 0.93 / 0.94 / -0.5%
tpcds_q05/duckdb:parquet 28186142 / 28421952 / -0.8% 33205902 / 32680524 / +1.6% 0.85 / 0.87 / -2.4%
tpcds_q06/duckdb:parquet 26392953 / 26412650 / -0.1% 35833865 / 35809468 / +0.1% 0.74 / 0.74 / -0.1%
tpcds_q07/duckdb:parquet 30717768 / 31867454 / -3.6% 39301645 / 38885157 / +1.1% 0.78 / 0.82 / -4.6%
tpcds_q08/duckdb:parquet 19664058 / 19640686 / +0.1% 25049069 / 24903772 / +0.6% 0.79 / 0.79 / -0.5%
tpcds_q09/duckdb:parquet 26218855 / 26860515 / -2.4% 30132325 / 30550245 / -1.4% 0.87 / 0.88 / -1.0%
tpcds_q10/duckdb:parquet 32817862 / 32536320 / +0.9% 40284376 / 40058867 / +0.6% 0.81 / 0.81 / +0.3%
tpcds_q11/duckdb:parquet 68829325 / 67763508 / +1.6% 75518849 / 74475102 / +1.4% 0.91 / 0.91 / +0.2%
tpcds_q12/duckdb:parquet 14140943 / 13868026 / +2.0% 19148810 / 18957838 / +1.0% 0.74 / 0.73 / +1.0%
tpcds_q13/duckdb:parquet 31256350 / 31320687 / -0.2% 39243020 / 39581396 / -0.9% 0.80 / 0.79 / +0.7%
tpcds_q14/duckdb:parquet 63778506 / 65728241 / -3.0% 67615304 / 67766462 / -0.2% 0.94 / 0.97 / -2.7%
tpcds_q15/duckdb:parquet 16526795 / 16555660 / -0.2% 22665641 / 22622654 / +0.2% 0.73 / 0.73 / -0.4%
tpcds_q16/duckdb:parquet 30193082 / 30174997 / +0.1% 36997315 / 37073188 / -0.2% 0.82 / 0.81 / +0.3%
tpcds_q17/duckdb:parquet 34791653 / 34371860 / +1.2% 40172869 / 40027762 / +0.4% 0.87 / 0.86 / +0.9%
tpcds_q18/duckdb:parquet 47151216 / 47170658 / -0.0% 54575798 / 54810311 / -0.4% 0.86 / 0.86 / +0.4%
tpcds_q19/duckdb:parquet 18908050 / 18682912 / +1.2% 26244749 / 25835895 / +1.6% 0.72 / 0.72 / -0.4%
tpcds_q20/duckdb:parquet 14912478 / 14733882 / +1.2% 19469740 / 19372511 / +0.5% 0.77 / 0.76 / +0.7%
tpcds_q21/duckdb:parquet 10566328 / 10488052 / +0.7% 16925952 / 17025771 / -0.6% 0.62 / 0.62 / +1.3%
tpcds_q22/duckdb:parquet 20611134 / 20820235 / -1.0% 26431015 / 26449791 / -0.1% 0.78 / 0.79 / -0.9%
tpcds_q23/duckdb:parquet 41575528 / 42080340 / -1.2% 47129869 / 46711580 / +0.9% 0.88 / 0.90 / -2.1%
tpcds_q24/duckdb:parquet 30467055 / 30283369 / +0.6% 36300666 / 36589771 / -0.8% 0.84 / 0.83 / +1.4%
tpcds_q25/duckdb:parquet 30618325 / 30248721 / +1.2% 37486847 / 37678730 / -0.5% 0.82 / 0.80 / +1.7%
tpcds_q26/duckdb:parquet 28713089 / 28795051 / -0.3% 35691075 / 34946309 / +2.1% 0.80 / 0.82 / -2.4%
tpcds_q27/duckdb:parquet 35121078 / 33056830 / +6.2% 41600540 / 41601919 / -0.0% 0.84 / 0.79 / +6.2%
tpcds_q28/duckdb:parquet 26389276 / 26590945 / -0.8% 35117399 / 32656630 / +7.5% 0.75 / 0.81 / -7.7%
tpcds_q29/duckdb:parquet 32857704 / 31861206 / +3.1% 41922061 / 39162691 / +7.0% 0.78 / 0.81 / -3.7%
tpcds_q30/duckdb:parquet 35482167 / 35442328 / +0.1% 44534567 / 43972966 / +1.3% 0.80 / 0.81 / -1.2%
tpcds_q31/duckdb:parquet 35643696 / 36133444 / -1.4% 42710577 / 43957496 / -2.8% 0.83 / 0.82 / +1.5%
tpcds_q32/duckdb:parquet 14138094 / 14142034 / -0.0% 20770944 / 20953886 / -0.9% 0.68 / 0.67 / +0.9%
tpcds_q33/duckdb:parquet 23972130 / 24159178 / -0.8% 28802114 / 30420229 / -5.3% 0.83 / 0.79 / +4.8%
tpcds_q34/duckdb:parquet 17086941 / 19586632 / -12.8% 🟢 24539442 / 24255979 / +1.2% 0.70 / 0.81 / -13.8%
tpcds_q35/duckdb:parquet 36702419 / 35345106 / +3.8% 43799003 / 44059264 / -0.6% 0.84 / 0.80 / +4.5%
tpcds_q36/duckdb:parquet 39495302 / 40211767 / -1.8% 47200965 / 47973633 / -1.6% 0.84 / 0.84 / -0.2%
tpcds_q37/duckdb:parquet 12850422 / 12712384 / +1.1% 19728218 / 19925178 / -1.0% 0.65 / 0.64 / +2.1%
tpcds_q38/duckdb:parquet 29719641 / 29797054 / -0.3% 33762181 / 34614817 / -2.5% 0.88 / 0.86 / +2.3%
tpcds_q39/duckdb:parquet 23137775 / 23188270 / -0.2% 29591553 / 29487407 / +0.4% 0.78 / 0.79 / -0.6%
tpcds_q40/duckdb:parquet 15961940 / 15857881 / +0.7% 21372072 / 21386477 / -0.1% 0.75 / 0.74 / +0.7%
tpcds_q41/duckdb:parquet 11929976 / 11975306 / -0.4% 17854769 / 18000212 / -0.8% 0.67 / 0.67 / +0.4%
tpcds_q42/duckdb:parquet 9565354 / 9577392 / -0.1% 15452040 / 15303361 / +1.0% 0.62 / 0.63 / -1.1%
tpcds_q43/duckdb:parquet 12030805 / 11953778 / +0.6% 18037315 / 17910160 / +0.7% 0.67 / 0.67 / -0.1%
tpcds_q44/duckdb:parquet 21209886 / 20622374 / +2.8% 27129526 / 27245505 / -0.4% 0.78 / 0.76 / +3.3%
tpcds_q45/duckdb:parquet 20839786 / 20983045 / -0.7% 27889856 / 27486874 / +1.5% 0.75 / 0.76 / -2.1%
tpcds_q46/duckdb:parquet 36285620 / 35492990 / +2.2% 43238533 / 43378594 / -0.3% 0.84 / 0.82 / +2.6%
tpcds_q47/duckdb:parquet 35872785 / 34793072 / +3.1% 40802127 / 40730777 / +0.2% 0.88 / 0.85 / +2.9%
tpcds_q48/duckdb:parquet 28846552 / 29768996 / -3.1% 36533114 / 36497930 / +0.1% 0.79 / 0.82 / -3.2%
tpcds_q49/duckdb:parquet 31237292 / 28876224 / +8.2% 36002743 / 35968523 / +0.1% 0.87 / 0.80 / +8.1%
tpcds_q50/duckdb:parquet 19236818 / 19176756 / +0.3% 25787603 / 25552854 / +0.9% 0.75 / 0.75 / -0.6%
tpcds_q51/duckdb:parquet 52210676 / 51440282 / +1.5% 76740832 / 60317460 / +27.2% 🔴 0.68 / 0.85 / -20.2%
tpcds_q52/duckdb:parquet 9594328 / 9622652 / -0.3% 15563140 / 15644769 / -0.5% 0.62 / 0.62 / +0.2%
tpcds_q53/duckdb:parquet 13813743 / 13663494 / +1.1% 20914316 / 21700166 / -3.6% 0.66 / 0.63 / +4.9%
tpcds_q54/duckdb:parquet 24798084 / 25228249 / -1.7% 31948472 / 32482635 / -1.6% 0.78 / 0.78 / -0.1%
tpcds_q55/duckdb:parquet 9391106 / 9415163 / -0.3% 15162701 / 15297172 / -0.9% 0.62 / 0.62 / +0.6%
tpcds_q56/duckdb:parquet 26762280 / 24889820 / +7.5% 31429006 / 30778995 / +2.1% 0.85 / 0.81 / +5.3%
tpcds_q57/duckdb:parquet 30583973 / 30417974 / +0.5% 35917250 / 36327271 / -1.1% 0.85 / 0.84 / +1.7%
tpcds_q58/duckdb:parquet 24018258 / 23692338 / +1.4% 29780429 / 30788578 / -3.3% 0.81 / 0.77 / +4.8%
tpcds_q59/duckdb:parquet 22653296 / 22697402 / -0.2% 28854006 / 28813099 / +0.1% 0.79 / 0.79 / -0.3%
tpcds_q60/duckdb:parquet 26600371 / 27698929 / -4.0% 32499946 / 31861642 / +2.0% 0.82 / 0.87 / -5.9%
tpcds_q61/duckdb:parquet 24074713 / 23378133 / +3.0% 29330262 / 29363914 / -0.1% 0.82 / 0.80 / +3.1%
tpcds_q62/duckdb:parquet 12721982 / 12780992 / -0.5% 17948105 / 17677751 / +1.5% 0.71 / 0.72 / -2.0%
tpcds_q63/duckdb:parquet 13397200 / 13322274 / +0.6% 20151768 / 20146993 / +0.0% 0.66 / 0.66 / +0.5%
tpcds_q64/duckdb:parquet 70308600 / 71887096 / -2.2% 80657666 / 80076340 / +0.7% 0.87 / 0.90 / -2.9%
tpcds_q65/duckdb:parquet 19984155 / 18360582 / +8.8% 25522652 / 26403567 / -3.3% 0.78 / 0.70 / +12.6%
tpcds_q66/duckdb:parquet 33243768 / 33774879 / -1.6% 37846875 / 38361723 / -1.3% 0.88 / 0.88 / -0.2%
tpcds_q67/duckdb:parquet 60587518 / 60386662 / +0.3% 69276228 / 68313724 / +1.4% 0.87 / 0.88 / -1.1%
tpcds_q68/duckdb:parquet 30217637 / 28071626 / +7.6% 36393801 / 35744494 / +1.8% 0.83 / 0.79 / +5.7%
tpcds_q69/duckdb:parquet 25652347 / 25708158 / -0.2% 34269302 / 34501462 / -0.7% 0.75 / 0.75 / +0.5%
tpcds_q70/duckdb:parquet 19239352 / 19136756 / +0.5% 27079460 / 27016969 / +0.2% 0.71 / 0.71 / +0.3%
tpcds_q71/duckdb:parquet 16919416 / 17155762 / -1.4% 24142578 / 24056214 / +0.4% 0.70 / 0.71 / -1.7%
tpcds_q72/duckdb:parquet 53041154 / 52857357 / +0.3% 59881609 / 60228852 / -0.6% 0.89 / 0.88 / +0.9%
tpcds_q73/duckdb:parquet 14768380 / 14683825 / +0.6% 21570176 / 21486021 / +0.4% 0.68 / 0.68 / +0.2%
tpcds_q74/duckdb:parquet 83692034 / 83049806 / +0.8% 91011413 / 91203970 / -0.2% 0.92 / 0.91 / +1.0%
tpcds_q75/duckdb:parquet 42903942 / 45041018 / -4.7% 50077417 / 50183731 / -0.2% 0.86 / 0.90 / -4.5%
tpcds_q76/duckdb:parquet 17842656 / 18956046 / -5.9% 23254259 / 23577467 / -1.4% 0.77 / 0.80 / -4.6%
tpcds_q77/duckdb:parquet 25903251 / 26339358 / -1.7% 31860704 / 31583672 / +0.9% 0.81 / 0.83 / -2.5%
tpcds_q78/duckdb:parquet 78789760 / 78339850 / +0.6% 84439818 / 85174846 / -0.9% 0.93 / 0.92 / +1.4%
tpcds_q79/duckdb:parquet 22680512 / 22816789 / -0.6% 28885644 / 28720892 / +0.6% 0.79 / 0.79 / -1.2%
tpcds_q80/duckdb:parquet 36785628 / 37267866 / -1.3% 44694013 / 44619102 / +0.2% 0.82 / 0.84 / -1.5%
tpcds_q81/duckdb:parquet 36293146 / 36292522 / +0.0% 44792262 / 44900872 / -0.2% 0.81 / 0.81 / +0.2%
tpcds_q82/duckdb:parquet 13434796 / 13670254 / -1.7% 20653960 / 20341369 / +1.5% 0.65 / 0.67 / -3.2%
tpcds_q83/duckdb:parquet 20226702 / 20247926 / -0.1% 24952968 / 25193907 / -1.0% 0.81 / 0.80 / +0.9%
tpcds_q84/duckdb:parquet 22943462 / 22937625 / +0.0% 29076320 / 28838806 / +0.8% 0.79 / 0.80 / -0.8%
tpcds_q85/duckdb:parquet 32308840 / 32486924 / -0.5% 39223258 / 40084033 / -2.1% 0.82 / 0.81 / +1.6%
tpcds_q86/duckdb:parquet 11771296 / 11706093 / +0.6% 17089202 / 16792874 / +1.8% 0.69 / 0.70 / -1.2%
tpcds_q87/duckdb:parquet 31189836 / 31097007 / +0.3% 35606070 / 35181536 / +1.2% 0.88 / 0.88 / -0.9%
tpcds_q88/duckdb:parquet 39040051 / 39250322 / -0.5% 42274266 / 42670903 / -0.9% 0.92 / 0.92 / +0.4%
tpcds_q89/duckdb:parquet 16155031 / 14339204 / +12.7% 🔴 21368315 / 21417942 / -0.2% 0.76 / 0.67 / +12.9%
tpcds_q90/duckdb:parquet 10166323 / 10168719 / -0.0% 15175110 / 15429206 / -1.6% 0.67 / 0.66 / +1.7%
tpcds_q91/duckdb:parquet 21030984 / 20959085 / +0.3% 28637469 / 28067224 / +2.0% 0.73 / 0.75 / -1.7%
tpcds_q92/duckdb:parquet 15454920 / 15543170 / -0.6% 21772480 / 22173816 / -1.8% 0.71 / 0.70 / +1.3%
tpcds_q93/duckdb:parquet 14125648 / 14026666 / +0.7% 21083475 / 20130913 / +4.7% 0.67 / 0.70 / -3.8%
tpcds_q94/duckdb:parquet 25465468 / 25308935 / +0.6% 32578704 / 32908835 / -1.0% 0.78 / 0.77 / +1.6%
tpcds_q95/duckdb:parquet 43821936 / 43863208 / -0.1% 49288230 / 49441964 / -0.3% 0.89 / 0.89 / +0.2%
tpcds_q96/duckdb:parquet 8178007 / 8122943 / +0.7% 13768686 / 13610093 / +1.2% 0.59 / 0.60 / -0.5%
tpcds_q97/duckdb:parquet 27448144 / 27375118 / +0.3% 33791598 / 34427899 / -1.8% 0.81 / 0.80 / +2.2%
tpcds_q98/duckdb:parquet 16259748 / 16228456 / +0.2% 23019967 / 23287233 / -1.1% 0.71 / 0.70 / +1.4%
tpcds_q99/duckdb:parquet 18708695 / 18657166 / +0.3% 24649049 / 24792622 / -0.6% 0.76 / 0.75 / +0.9%

No file size changes detected.

Copy link
Copy Markdown
Contributor Author

The red "CodSpeed Performance Analysis" check on 598050b comes from a single walltime benchmark: decode_chunked_neon[i64, 524288], 14.2 µs → 15.7 µs (-10%). I don't think this PR caused it:

  • This PR changes only .github/ workflow files. git diff origin/develop --stat -- ':!.github' is empty, so the benchmark binaries are built from the same code as the base.
  • In the walltime CodSpeed jobs, the PR only runs the setup steps (checkout, toolchain setup, artifact download, cargo-codspeed install, unpacking) in parallel. All of that finishes before setup-benchmark.sh and the timed "Run benchmarks" step, which are unchanged and still run in the same order.
  • The same run shows an equal-sized walltime improvement on an unrelated benchmark: deferred_bool_avx512[i64, PerRowPerRow] +10.5%. CodSpeed also warns that "Walltime results may be unreliable" outside its Macro Runners.
  • The earlier CodSpeed run on eda2753 used the same codspeed.yml and didn't flag this benchmark.

So this looks like walltime noise. Whether to acknowledge it in CodSpeed is the maintainers' call.


Generated by Claude Code

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 31d2f1e8 vs base eacb3538
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.3%
Engines: DataFusion No clear signal (-0.4%, environment too noisy confidence) · DuckDB No clear signal (-8.1%, environment too noisy confidence)
Vortex (geomean): hot 0.952x ➖ · cold 0.972x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.960x ➖
Shifts: Parquet (control) -0.5% · Median polish -1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.963x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 203982983 / 204735671 / -0.4% 599382609 / 589922484 / +1.6% 0.34 / 0.35 / -1.9%
tpch_q02/datafusion:vortex-file-compressed 334669016 / 318815096 / +5.0% 623505996 / 687277704 / -9.3% 0.54 / 0.46 / +15.7%
tpch_q03/datafusion:vortex-file-compressed 321653261 / 320265586 / +0.4% 820061767 / 853906119 / -4.0% 0.39 / 0.38 / +4.6%
tpch_q04/datafusion:vortex-file-compressed 173022438 / 273017503 / -36.6% 🟢 399396480 / 468453951 / -14.7% 0.43 / 0.58 / -25.7%
tpch_q05/datafusion:vortex-file-compressed 351048218 / 377403128 / -7.0% 553840968 / 582521884 / -4.9% 0.63 / 0.65 / -2.2%
tpch_q06/datafusion:vortex-file-compressed 124888690 / 131050601 / -4.7% 323912292 / 253668646 / +27.7% 0.39 / 0.52 / -25.4%
tpch_q07/datafusion:vortex-file-compressed 429562913 / 421873140 / +1.8% 604338531 / 578653674 / +4.4% 0.71 / 0.73 / -2.5%
tpch_q08/datafusion:vortex-file-compressed 409116699 / 411145168 / -0.5% 730615722 / 681200945 / +7.3% 0.56 / 0.60 / -7.2%
tpch_q09/datafusion:vortex-file-compressed 305028631 / 404569134 / -24.6% 507476856 / 541595822 / -6.3% 0.60 / 0.75 / -19.5%
tpch_q10/datafusion:vortex-file-compressed 391228289 / 376214248 / +4.0% 638272111 / 555199942 / +15.0% 0.61 / 0.68 / -9.5%
tpch_q11/datafusion:vortex-file-compressed 278748371 / 281401381 / -0.9% 480509586 / 463265034 / +3.7% 0.58 / 0.61 / -4.5%
tpch_q12/datafusion:vortex-file-compressed 200658284 / 213407238 / -6.0% 367355986 / 369794210 / -0.7% 0.55 / 0.58 / -5.3%
tpch_q13/datafusion:vortex-file-compressed 102907819 / 109864320 / -6.3% 381966858 / 431974699 / -11.6% 0.27 / 0.25 / +5.9%
tpch_q14/datafusion:vortex-file-compressed 189292722 / 179385382 / +5.5% 387215231 / 344226201 / +12.5% 0.49 / 0.52 / -6.2%
tpch_q15/datafusion:vortex-file-compressed 291178966 / 290876331 / +0.1% 516631226 / 496163128 / +4.1% 0.56 / 0.59 / -3.9%
tpch_q16/datafusion:vortex-file-compressed 139839094 / 135446806 / +3.2% 294466287 / 254796991 / +15.6% 0.47 / 0.53 / -10.7%
tpch_q17/datafusion:vortex-file-compressed 258037309 / 260872400 / -1.1% 628545636 / 508049971 / +23.7% 0.41 / 0.51 / -20.0%
tpch_q18/datafusion:vortex-file-compressed 418276710 / 247932361 / +68.7% 🔴 412386714 / 475931570 / -13.4% 1.01 / 0.52 / +94.7%
tpch_q19/datafusion:vortex-file-compressed 228641863 / 355826296 / -35.7% 🟢 413555795 / 448979281 / -7.9% 0.55 / 0.79 / -30.2%
tpch_q20/datafusion:vortex-file-compressed 258431485 / 380591968 / -32.1% 🟢 417477141 / 480760628 / -13.2% 0.62 / 0.79 / -21.8%
tpch_q21/datafusion:vortex-file-compressed 557899458 / 449742488 / +24.0% 855062852 / 686079180 / +24.6% 0.65 / 0.66 / -0.5%
tpch_q22/datafusion:vortex-file-compressed 155382325 / 143547809 / +8.2% 428502815 / 423172597 / +1.3% 0.36 / 0.34 / +6.9%
datafusion / parquet / ns (0.966x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 150997355 / 164236462 / -8.1% 507820389 / 444694535 / +14.2% 0.30 / 0.37 / -19.5%
tpch_q02/datafusion:parquet 277479692 / 336463392 / -17.5% 520409831 / 999936645 / -48.0% 🟢 0.53 / 0.34 / +58.5%
tpch_q03/datafusion:parquet 217048445 / 234869574 / -7.6% 745426522 / 652888772 / +14.2% 0.29 / 0.36 / -19.1%
tpch_q04/datafusion:parquet 132844571 / 145402768 / -8.6% 364149536 / 262921590 / +38.5% 🔴 0.36 / 0.55 / -34.0%
tpch_q05/datafusion:parquet 341798146 / 372972749 / -8.4% 451950454 / 588986708 / -23.3% 0.76 / 0.63 / +19.4%
tpch_q06/datafusion:parquet 105851469 / 108244360 / -2.2% 220731232 / 197008252 / +12.0% 0.48 / 0.55 / -12.7%
tpch_q07/datafusion:parquet 328886660 / 343615052 / -4.3% 440370929 / 510713610 / -13.8% 0.75 / 0.67 / +11.0%
tpch_q08/datafusion:parquet 383470224 / 409531292 / -6.4% 512007942 / 519906919 / -1.5% 0.75 / 0.79 / -4.9%
tpch_q09/datafusion:parquet 381944264 / 374780568 / +1.9% 534253533 / 661952638 / -19.3% 0.71 / 0.57 / +26.3%
tpch_q10/datafusion:parquet 287060728 / 287459606 / -0.1% 451433634 / 457184940 / -1.3% 0.64 / 0.63 / +1.1%
tpch_q11/datafusion:parquet 253791197 / 251965330 / +0.7% 351878846 / 379556784 / -7.3% 0.72 / 0.66 / +8.6%
tpch_q12/datafusion:parquet 165047363 / 168196602 / -1.9% 295369845 / 357516206 / -17.4% 0.56 / 0.47 / +18.8%
tpch_q13/datafusion:parquet 269194291 / 271102070 / -0.7% 410759849 / 448123143 / -8.3% 0.66 / 0.60 / +8.3%
tpch_q14/datafusion:parquet 144006367 / 147263534 / -2.2% 371562936 / 304368991 / +22.1% 0.39 / 0.48 / -19.9%
tpch_q15/datafusion:parquet 295693482 / 296061611 / -0.1% 452719108 / 479261409 / -5.5% 0.65 / 0.62 / +5.7%
tpch_q16/datafusion:parquet 98727278 / 104767154 / -5.8% 218655224 / 191917572 / +13.9% 0.45 / 0.55 / -17.3%
tpch_q17/datafusion:parquet 262344589 / 293809244 / -10.7% 398463684 / 476625509 / -16.4% 0.66 / 0.62 / +6.8%
tpch_q18/datafusion:parquet 315806084 / 294757031 / +7.1% 531904420 / 452587526 / +17.5% 0.59 / 0.65 / -8.8%
tpch_q19/datafusion:parquet 155902731 / 156171127 / -0.2% 289402729 / 286798377 / +0.9% 0.54 / 0.54 / -1.1%
tpch_q20/datafusion:parquet 231445080 / 231370389 / +0.0% 351999562 / 375025219 / -6.1% 0.66 / 0.62 / +6.6%
tpch_q21/datafusion:parquet 318500905 / 300095604 / +6.1% 450821799 / 478733873 / -5.8% 0.71 / 0.63 / +12.7%
tpch_q22/datafusion:parquet 152595675 / 155190385 / -1.7% 335366298 / 297361077 / +12.8% 0.46 / 0.52 / -12.8%
duckdb / vortex-file-compressed / ns (0.941x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 241630392 / 238127230 / +1.5% 298729469 / 257671011 / +15.9% 0.81 / 0.92 / -12.5%
tpch_q02/duckdb:vortex-file-compressed 389393209 / 396411803 / -1.8% 420330309 / 456537753 / -7.9% 0.93 / 0.87 / +6.7%
tpch_q03/duckdb:vortex-file-compressed 400247606 / 405145983 / -1.2% 465704057 / 419330461 / +11.1% 0.86 / 0.97 / -11.0%
tpch_q04/duckdb:vortex-file-compressed 309832401 / 273364053 / +13.3% 301003305 / 341238219 / -11.8% 1.03 / 0.80 / +28.5%
tpch_q05/duckdb:vortex-file-compressed 519610747 / 670335637 / -22.5% 597339717 / 761101936 / -21.5% 0.87 / 0.88 / -1.2%
tpch_q06/duckdb:vortex-file-compressed 159582005 / 180652924 / -11.7% 230063988 / 212199832 / +8.4% 0.69 / 0.85 / -18.5%
tpch_q07/duckdb:vortex-file-compressed 395610007 / 407848394 / -3.0% 486116482 / 465315809 / +4.5% 0.81 / 0.88 / -7.2%
tpch_q08/duckdb:vortex-file-compressed 678174771 / 555840219 / +22.0% 765029637 / 617850687 / +23.8% 0.89 / 0.90 / -1.5%
tpch_q09/duckdb:vortex-file-compressed 397539905 / 551330237 / -27.9% 520335850 / 810432780 / -35.8% 🟢 0.76 / 0.68 / +12.3%
tpch_q10/duckdb:vortex-file-compressed 512245060 / 535353932 / -4.3% 587236252 / 832996991 / -29.5% 0.87 / 0.64 / +35.7%
tpch_q11/duckdb:vortex-file-compressed 262985430 / 292174390 / -10.0% 309396367 / 343027878 / -9.8% 0.85 / 0.85 / -0.2%
tpch_q12/duckdb:vortex-file-compressed 251503008 / 231803928 / +8.5% 296492456 / 294598374 / +0.6% 0.85 / 0.79 / +7.8%
tpch_q13/duckdb:vortex-file-compressed 198188961 / 264794978 / -25.2% 251891107 / 260775350 / -3.4% 0.79 / 1.02 / -22.5%
tpch_q14/duckdb:vortex-file-compressed 222631242 / 227142207 / -2.0% 340577628 / 273659698 / +24.5% 0.65 / 0.83 / -21.2%
tpch_q15/duckdb:vortex-file-compressed 230366401 / 303979620 / -24.2% 247941047 / 387072559 / -35.9% 🟢 0.93 / 0.79 / +18.3%
tpch_q16/duckdb:vortex-file-compressed 207822743 / 200881926 / +3.5% 247200502 / 290140434 / -14.8% 0.84 / 0.69 / +21.4%
tpch_q17/duckdb:vortex-file-compressed 298547141 / 285047406 / +4.7% 336191556 / 304626788 / +10.4% 0.89 / 0.94 / -5.1%
tpch_q18/duckdb:vortex-file-compressed 362597605 / 387588656 / -6.4% 434002601 / 725431533 / -40.2% 🟢 0.84 / 0.53 / +56.4%
tpch_q19/duckdb:vortex-file-compressed 301560441 / 388905138 / -22.5% 321045925 / 338432825 / -5.1% 0.94 / 1.15 / -18.3%
tpch_q20/duckdb:vortex-file-compressed 324297272 / 342536820 / -5.3% 411070582 / 455345608 / -9.7% 0.79 / 0.75 / +4.9%
tpch_q21/duckdb:vortex-file-compressed 553269216 / 551439749 / +0.3% 630768802 / 696334057 / -9.4% 0.88 / 0.79 / +10.8%
tpch_q22/duckdb:vortex-file-compressed 231064953 / 221088801 / +4.5% 293301237 / 241865898 / +21.3% 0.79 / 0.91 / -13.8%
duckdb / parquet / ns (1.024x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 176107148 / 170214499 / +3.5% 236468533 / 218452778 / +8.2% 0.74 / 0.78 / -4.4%
tpch_q02/duckdb:parquet 455281519 / 454357479 / +0.2% 483572406 / 457475343 / +5.7% 0.94 / 0.99 / -5.2%
tpch_q03/duckdb:parquet 358737337 / 329299370 / +8.9% 405609041 / 398029124 / +1.9% 0.88 / 0.83 / +6.9%
tpch_q04/duckdb:parquet 261857647 / 273881027 / -4.4% 317727417 / 902431172 / -64.8% 🟢 0.82 / 0.30 / +171.6%
tpch_q05/duckdb:parquet 581125650 / 506887465 / +14.6% 584004283 / 500056729 / +16.8% 1.00 / 1.01 / -1.8%
tpch_q06/duckdb:parquet 169299047 / 144913600 / +16.8% 219300958 / 166030013 / +32.1% 🔴 0.77 / 0.87 / -11.6%
tpch_q07/duckdb:parquet 421019074 / 388497242 / +8.4% 441671332 / 486651752 / -9.2% 0.95 / 0.80 / +19.4%
tpch_q08/duckdb:parquet 580932536 / 614305388 / -5.4% 580277665 / 630695881 / -8.0% 1.00 / 0.97 / +2.8%
tpch_q09/duckdb:parquet 554321969 / 555771017 / -0.3% 594179832 / 658733593 / -9.8% 0.93 / 0.84 / +10.6%
tpch_q10/duckdb:parquet 529481653 / 512115381 / +3.4% 616066012 / 557850859 / +10.4% 0.86 / 0.92 / -6.4%
tpch_q11/duckdb:parquet 271548506 / 254263276 / +6.8% 273622667 / 296318821 / -7.7% 0.99 / 0.86 / +15.7%
tpch_q12/duckdb:parquet 209928590 / 273626176 / -23.3% 239196147 / 360685654 / -33.7% 🟢 0.88 / 0.76 / +15.7%
tpch_q13/duckdb:parquet 405522213 / 375993028 / +7.9% 465124047 / 513270534 / -9.4% 0.87 / 0.73 / +19.0%
tpch_q14/duckdb:parquet 258092122 / 239466302 / +7.8% 276382836 / 297853419 / -7.2% 0.93 / 0.80 / +16.2%
tpch_q15/duckdb:parquet 211040641 / 189753450 / +11.2% 258707778 / 217738235 / +18.8% 0.82 / 0.87 / -6.4%
tpch_q16/duckdb:parquet 240235418 / 262908092 / -8.6% 267304492 / 270841735 / -1.3% 0.90 / 0.97 / -7.4%
tpch_q17/duckdb:parquet 272824510 / 258347198 / +5.6% 316711279 / 330618457 / -4.2% 0.86 / 0.78 / +10.2%
tpch_q18/duckdb:parquet 302739805 / 334305486 / -9.4% 359820136 / 347516848 / +3.5% 0.84 / 0.96 / -12.5%
tpch_q19/duckdb:parquet 260676353 / 256693663 / +1.6% 316803609 / 315297605 / +0.5% 0.82 / 0.81 / +1.1%
tpch_q20/duckdb:parquet 423011424 / 415364070 / +1.8% 434116254 / 524966626 / -17.3% 0.97 / 0.79 / +23.2%
tpch_q21/duckdb:parquet 462636486 / 455148646 / +1.6% 506473510 / 476152047 / +6.4% 0.91 / 0.96 / -4.4%
tpch_q22/duckdb:parquet 308722744 / 269895600 / +14.4% 333988934 / 285124282 / +17.1% 0.92 / 0.95 / -2.3%

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 31d2f1e8 vs base d81bd4ce
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.022x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35481862 / 35687064 / -0.6% 60763884 / 59727902 / +1.7% 0.58 / 0.60 / -2.3%
tpcds_q02/datafusion:vortex-file-compressed 50114649 / 51071520 / -1.9% 74204320 / 73866370 / +0.5% 0.68 / 0.69 / -2.3%
tpcds_q03/datafusion:vortex-file-compressed 20008058 / 20122918 / -0.6% 45615838 / 45522240 / +0.2% 0.44 / 0.44 / -0.8%
tpcds_q04/datafusion:vortex-file-compressed 295475072 / 294488276 / +0.3% 358312924 / 348826657 / +2.7% 0.82 / 0.84 / -2.3%
tpcds_q05/datafusion:vortex-file-compressed 70924204 / 72186978 / -1.7% 102060905 / 98074801 / +4.1% 0.69 / 0.74 / -5.6%
tpcds_q06/datafusion:vortex-file-compressed 41649984 / 42034562 / -0.9% 67700415 / 71314146 / -5.1% 0.62 / 0.59 / +4.4%
tpcds_q07/datafusion:vortex-file-compressed 41723730 / 41936610 / -0.5% 79426634 / 81598206 / -2.7% 0.53 / 0.51 / +2.2%
tpcds_q08/datafusion:vortex-file-compressed 28620531 / 29293898 / -2.3% 56247330 / 54786660 / +2.7% 0.51 / 0.53 / -4.8%
tpcds_q09/datafusion:vortex-file-compressed 43172778 / 43492521 / -0.7% 78280485 / 75585378 / +3.6% 0.55 / 0.58 / -4.2%
tpcds_q10/datafusion:vortex-file-compressed 36870250 / 37575747 / -1.9% 65303281 / 65187408 / +0.2% 0.56 / 0.58 / -2.1%
tpcds_q11/datafusion:vortex-file-compressed 174706026 / 174078024 / +0.4% 216773008 / 212796053 / +1.9% 0.81 / 0.82 / -1.5%
tpcds_q12/datafusion:vortex-file-compressed 18346910 / 17602241 / +4.2% 38443634 / 36804611 / +4.5% 0.48 / 0.48 / -0.2%
tpcds_q13/datafusion:vortex-file-compressed 38203842 / 37777492 / +1.1% 81645878 / 82427050 / -0.9% 0.47 / 0.46 / +2.1%
tpcds_q14/datafusion:vortex-file-compressed 228260098 / 234215656 / -2.5% 270387511 / 269416137 / +0.4% 0.84 / 0.87 / -2.9%
tpcds_q15/datafusion:vortex-file-compressed 39332670 / 40700370 / -3.4% 56725602 / 59132696 / -4.1% 0.69 / 0.69 / +0.7%
tpcds_q16/datafusion:vortex-file-compressed 23142592 / 24140928 / -4.1% 42051388 / 41799402 / +0.6% 0.55 / 0.58 / -4.7%
tpcds_q17/datafusion:vortex-file-compressed 63903306 / 64613948 / -1.1% 88327099 / 96825489 / -8.8% 0.72 / 0.67 / +8.4%
tpcds_q18/datafusion:vortex-file-compressed 67180579 / 68135038 / -1.4% 96945663 / 96678626 / +0.3% 0.69 / 0.70 / -1.7%
tpcds_q19/datafusion:vortex-file-compressed 23110594 / 23065796 / +0.2% 53702989 / 53499164 / +0.4% 0.43 / 0.43 / -0.2%
tpcds_q20/datafusion:vortex-file-compressed 23073484 / 23434874 / -1.5% 40728327 / 39490521 / +3.1% 0.57 / 0.59 / -4.5%
tpcds_q21/datafusion:vortex-file-compressed 47043764 / 46991756 / +0.1% 79624758 / 77561336 / +2.7% 0.59 / 0.61 / -2.5%
tpcds_q22/datafusion:vortex-file-compressed 432786540 / 436213066 / -0.8% 467594053 / 456238601 / +2.5% 0.93 / 0.96 / -3.2%
tpcds_q23/datafusion:vortex-file-compressed 295486272 / 295445526 / +0.0% 362790257 / 350238393 / +3.6% 0.81 / 0.84 / -3.4%
tpcds_q24/datafusion:vortex-file-compressed 116659958 / 118209681 / -1.3% 158723213 / 163532003 / -2.9% 0.73 / 0.72 / +1.7%
tpcds_q25/datafusion:vortex-file-compressed 59031491 / 58404091 / +1.1% 102795523 / 100148037 / +2.6% 0.57 / 0.58 / -1.5%
tpcds_q26/datafusion:vortex-file-compressed 37645508 / 37624965 / +0.1% 59762441 / 59590326 / +0.3% 0.63 / 0.63 / -0.2%
tpcds_q27/datafusion:vortex-file-compressed 72783110 / 71638275 / +1.6% 106297695 / 105343615 / +0.9% 0.68 / 0.68 / +0.7%
tpcds_q28/datafusion:vortex-file-compressed 41853094 / 42371952 / -1.2% 91025747 / 87727130 / +3.8% 0.46 / 0.48 / -4.8%
tpcds_q29/datafusion:vortex-file-compressed 62729965 / 66811756 / -6.1% 95447690 / 102564955 / -6.9% 0.66 / 0.65 / +0.9%
tpcds_q30/datafusion:vortex-file-compressed 51031414 / 51119143 / -0.2% 77937539 / 75743723 / +2.9% 0.65 / 0.67 / -3.0%
tpcds_q31/datafusion:vortex-file-compressed 200627394 / 200218175 / +0.2% 232265780 / 233152597 / -0.4% 0.86 / 0.86 / +0.6%
tpcds_q32/datafusion:vortex-file-compressed 15163593 / 15152590 / +0.1% 31419139 / 31036644 / +1.2% 0.48 / 0.49 / -1.1%
tpcds_q33/datafusion:vortex-file-compressed 33985988 / 33166894 / +2.5% 67431255 / 66312007 / +1.7% 0.50 / 0.50 / +0.8%
tpcds_q34/datafusion:vortex-file-compressed 41563532 / 40800963 / +1.9% 68938563 / 69572930 / -0.9% 0.60 / 0.59 / +2.8%
tpcds_q35/datafusion:vortex-file-compressed 93174356 / 92953752 / +0.2% 123479964 / 118717623 / +4.0% 0.75 / 0.78 / -3.6%
tpcds_q36/datafusion:vortex-file-compressed 64611852 / 66188984 / -2.4% 98613960 / 100548488 / -1.9% 0.66 / 0.66 / -0.5%
tpcds_q37/datafusion:vortex-file-compressed 22704556 / 28659362 / -20.8% 🟢 53860428 / 39142184 / +37.6% 🔴 0.42 / 0.73 / -42.4%
tpcds_q38/datafusion:vortex-file-compressed 79573846 / 79029305 / +0.7% 107209935 / 106760595 / +0.4% 0.74 / 0.74 / +0.3%
tpcds_q39/datafusion:vortex-file-compressed 886182045 / 884718834 / +0.2% 912862940 / 908976999 / +0.4% 0.97 / 0.97 / -0.3%
tpcds_q40/datafusion:vortex-file-compressed 29154570 / 28530688 / +2.2% 49699288 / 48600430 / +2.3% 0.59 / 0.59 / -0.1%
tpcds_q41/datafusion:vortex-file-compressed 20256789 / 19016106 / +6.5% 31575151 / 31973918 / -1.2% 0.64 / 0.59 / +7.9%
tpcds_q42/datafusion:vortex-file-compressed 14214412 / 14446512 / -1.6% 40150968 / 37086223 / +8.3% 0.35 / 0.39 / -9.1%
tpcds_q43/datafusion:vortex-file-compressed 17346999 / 17062690 / +1.7% 40118460 / 37710185 / +6.4% 0.43 / 0.45 / -4.4%
tpcds_q44/datafusion:vortex-file-compressed 42737804 / 43352470 / -1.4% 71570217 / 72038897 / -0.7% 0.60 / 0.60 / -0.8%
tpcds_q45/datafusion:vortex-file-compressed 42910435 / 44364085 / -3.3% 64719743 / 59556323 / +8.7% 0.66 / 0.74 / -11.0%
tpcds_q46/datafusion:vortex-file-compressed 72966292 / 70145033 / +4.0% 101627146 / 104029608 / -2.3% 0.72 / 0.67 / +6.5%
tpcds_q47/datafusion:vortex-file-compressed 174685028 / 173539465 / +0.7% 219417730 / 216035492 / +1.6% 0.80 / 0.80 / -0.9%
tpcds_q48/datafusion:vortex-file-compressed 36434272 / 35623834 / +2.3% 71451639 / 70644306 / +1.1% 0.51 / 0.50 / +1.1%
tpcds_q49/datafusion:vortex-file-compressed 78493245 / 77255316 / +1.6% 121311825 / 116737222 / +3.9% 0.65 / 0.66 / -2.2%
tpcds_q50/datafusion:vortex-file-compressed 56136228 / 55980736 / +0.3% 86012353 / 86230008 / -0.3% 0.65 / 0.65 / +0.5%
tpcds_q51/datafusion:vortex-file-compressed 246160221 / 247038673 / -0.4% 269308247 / 280421401 / -4.0% 0.91 / 0.88 / +3.8%
tpcds_q52/datafusion:vortex-file-compressed 14378948 / 14714848 / -2.3% 40065813 / 38389598 / +4.4% 0.36 / 0.38 / -6.4%
tpcds_q53/datafusion:vortex-file-compressed 22733217 / 22346742 / +1.7% 51376670 / 49846122 / +3.1% 0.44 / 0.45 / -1.3%
tpcds_q54/datafusion:vortex-file-compressed 58597240 / 57426460 / +2.0% 91218058 / 92580497 / -1.5% 0.64 / 0.62 / +3.6%
tpcds_q55/datafusion:vortex-file-compressed 13619649 / 13973340 / -2.5% 38341446 / 38808883 / -1.2% 0.36 / 0.36 / -1.3%
tpcds_q56/datafusion:vortex-file-compressed 32555687 / 33761524 / -3.6% 64203007 / 63265036 / +1.5% 0.51 / 0.53 / -5.0%
tpcds_q57/datafusion:vortex-file-compressed 130979350 / 131113802 / -0.1% 161325160 / 161410678 / -0.1% 0.81 / 0.81 / -0.0%
tpcds_q58/datafusion:vortex-file-compressed 48591431 / 48391922 / +0.4% 85829154 / 84580372 / +1.5% 0.57 / 0.57 / -1.0%
tpcds_q59/datafusion:vortex-file-compressed 53820837 / 55056536 / -2.2% 81803489 / 81170032 / +0.8% 0.66 / 0.68 / -3.0%
tpcds_q60/datafusion:vortex-file-compressed 33982583 / 34937748 / -2.7% 65925402 / 63120098 / +4.4% 0.52 / 0.55 / -6.9%
tpcds_q61/datafusion:vortex-file-compressed 46503687 / 45353798 / +2.5% 73988192 / 72493548 / +2.1% 0.63 / 0.63 / +0.5%
tpcds_q62/datafusion:vortex-file-compressed 18988162 / 18948984 / +0.2% 42085181 / 40635590 / +3.6% 0.45 / 0.47 / -3.2%
tpcds_q63/datafusion:vortex-file-compressed 22985006 / 22886570 / +0.4% 52110669 / 51245739 / +1.7% 0.44 / 0.45 / -1.2%
tpcds_q64/datafusion:vortex-file-compressed 333418540 / 331770842 / +0.5% 408894136 / 405661127 / +0.8% 0.82 / 0.82 / -0.3%
tpcds_q65/datafusion:vortex-file-compressed 73418743 / 74188341 / -1.0% 112700331 / 106874319 / +5.5% 0.65 / 0.69 / -6.2%
tpcds_q66/datafusion:vortex-file-compressed 53374706 / 51726748 / +3.2% 76772359 / 75217399 / +2.1% 0.70 / 0.69 / +1.1%
tpcds_q67/datafusion:vortex-file-compressed 418426850 / 425404384 / -1.6% 522284039 / 518487417 / +0.7% 0.80 / 0.82 / -2.4%
tpcds_q68/datafusion:vortex-file-compressed 66564012 / 67065476 / -0.7% 106601160 / 99957636 / +6.6% 0.62 / 0.67 / -6.9%
tpcds_q69/datafusion:vortex-file-compressed 36699552 / 36411572 / +0.8% 63542940 / 61245093 / +3.8% 0.58 / 0.59 / -2.9%
tpcds_q70/datafusion:vortex-file-compressed 193480115 / 195234258 / -0.9% 227357737 / 223353634 / +1.8% 0.85 / 0.87 / -2.6%
tpcds_q71/datafusion:vortex-file-compressed 25791162 / 24846620 / +3.8% 57362607 / 57873035 / -0.9% 0.45 / 0.43 / +4.7%
tpcds_q72/datafusion:vortex-file-compressed 1661561785 / 1613070819 / +3.0% 1664589825 / 1672817704 / -0.5% 1.00 / 0.96 / +3.5%
tpcds_q73/datafusion:vortex-file-compressed 38711044 / 37798150 / +2.4% 63510906 / 63097488 / +0.7% 0.61 / 0.60 / +1.7%
tpcds_q74/datafusion:vortex-file-compressed 135280313 / 134609600 / +0.5% 171477178 / 169107950 / +1.4% 0.79 / 0.80 / -0.9%
tpcds_q75/datafusion:vortex-file-compressed 156704942 / 157283038 / -0.4% 197483609 / 199539779 / -1.0% 0.79 / 0.79 / +0.7%
tpcds_q76/datafusion:vortex-file-compressed 34042659 / 34141944 / -0.3% 73928424 / 76790189 / -3.7% 0.46 / 0.44 / +3.6%
tpcds_q77/datafusion:vortex-file-compressed 53614472 / 54578544 / -1.8% 86635939 / 87907886 / -1.4% 0.62 / 0.62 / -0.3%
tpcds_q78/datafusion:vortex-file-compressed 141489478 / 139945221 / +1.1% 191411769 / 191111158 / +0.2% 0.74 / 0.73 / +0.9%
tpcds_q79/datafusion:vortex-file-compressed 54068373 / 54551104 / -0.9% 84341560 / 83695427 / +0.8% 0.64 / 0.65 / -1.6%
tpcds_q80/datafusion:vortex-file-compressed 80732020 / 81251883 / -0.6% 126786941 / 126092347 / +0.6% 0.64 / 0.64 / -1.2%
tpcds_q81/datafusion:vortex-file-compressed 55672566 / 57217203 / -2.7% 83500289 / 83290839 / +0.3% 0.67 / 0.69 / -2.9%
tpcds_q82/datafusion:vortex-file-compressed 30327755 / 29527786 / +2.7% 48057329 / 46344112 / +3.7% 0.63 / 0.64 / -1.0%
tpcds_q83/datafusion:vortex-file-compressed 42209910 / 42234106 / -0.1% 68178148 / 65316165 / +4.4% 0.62 / 0.65 / -4.3%
tpcds_q84/datafusion:vortex-file-compressed 12072726 / 12318387 / -2.0% 31845774 / 31461444 / +1.2% 0.38 / 0.39 / -3.2%
tpcds_q85/datafusion:vortex-file-compressed 59612620 / 60351388 / -1.2% 90089598 / 89165946 / +1.0% 0.66 / 0.68 / -2.2%
tpcds_q86/datafusion:vortex-file-compressed 18529382 / 18635084 / -0.6% 37835712 / 40794939 / -7.3% 0.49 / 0.46 / +7.2%
tpcds_q87/datafusion:vortex-file-compressed 79046342 / 77726270 / +1.7% 107842297 / 106793331 / +1.0% 0.73 / 0.73 / +0.7%
tpcds_q88/datafusion:vortex-file-compressed 52847292 / 54134854 / -2.4% 90207947 / 91920123 / -1.9% 0.59 / 0.59 / -0.5%
tpcds_q89/datafusion:vortex-file-compressed 26581686 / 27705445 / -4.1% 55109415 / 52989044 / +4.0% 0.48 / 0.52 / -7.7%
tpcds_q90/datafusion:vortex-file-compressed 12716771 / 12876262 / -1.2% 30222286 / 31193191 / -3.1% 0.42 / 0.41 / +1.9%
tpcds_q91/datafusion:vortex-file-compressed 19046324 / 19841934 / -4.0% 42851256 / 40517298 / +5.8% 0.44 / 0.49 / -9.2%
tpcds_q92/datafusion:vortex-file-compressed 15478590 / 15586140 / -0.7% 36823690 / 35022452 / +5.1% 0.42 / 0.45 / -5.5%
tpcds_q93/datafusion:vortex-file-compressed 55000792 / 54479092 / +1.0% 90275706 / 91110634 / -0.9% 0.61 / 0.60 / +1.9%
tpcds_q94/datafusion:vortex-file-compressed 21650874 / 21721248 / -0.3% 44897218 / 43008447 / +4.4% 0.48 / 0.51 / -4.5%
tpcds_q95/datafusion:vortex-file-compressed 95748246 / 96025348 / -0.3% 124131052 / 125556657 / -1.1% 0.77 / 0.76 / +0.9%
tpcds_q96/datafusion:vortex-file-compressed 11471298 / 11669502 / -1.7% 31214302 / 29013229 / +7.6% 0.37 / 0.40 / -8.6%
tpcds_q97/datafusion:vortex-file-compressed 39232980 / 39740562 / -1.3% 66833627 / 64433312 / +3.7% 0.59 / 0.62 / -4.8%
tpcds_q98/datafusion:vortex-file-compressed 20520197 / 20279683 / +1.2% 48694141 / 49580667 / -1.8% 0.42 / 0.41 / +3.0%
tpcds_q99/datafusion:vortex-file-compressed 29292066 / 28990486 / +1.0% 48214404 / 46237709 / +4.3% 0.61 / 0.63 / -3.1%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 58777842 / 59467470 / -1.2% 77148669 / 78629990 / -1.9% 0.76 / 0.76 / +0.7%
tpcds_q02/datafusion:parquet 69465016 / 68841136 / +0.9% 89685888 / 92247774 / -2.8% 0.77 / 0.75 / +3.8%
tpcds_q03/datafusion:parquet 28531938 / 28412717 / +0.4% 50113329 / 51484914 / -2.7% 0.57 / 0.55 / +3.2%
tpcds_q04/datafusion:parquet 640267026 / 642280600 / -0.3% 705959514 / 713442164 / -1.0% 0.91 / 0.90 / +0.7%
tpcds_q05/datafusion:parquet 80605849 / 80587203 / +0.0% 114161914 / 114099796 / +0.1% 0.71 / 0.71 / -0.0%
tpcds_q06/datafusion:parquet 91392272 / 91299202 / +0.1% 112833824 / 111123421 / +1.5% 0.81 / 0.82 / -1.4%
tpcds_q07/datafusion:parquet 101401554 / 100516129 / +0.9% 141234144 / 140439595 / +0.6% 0.72 / 0.72 / +0.3%
tpcds_q08/datafusion:parquet 47802686 / 47906314 / -0.2% 76702670 / 77683939 / -1.3% 0.62 / 0.62 / +1.1%
tpcds_q09/datafusion:parquet 76245518 / 75858005 / +0.5% 104656108 / 103150303 / +1.5% 0.73 / 0.74 / -0.9%
tpcds_q10/datafusion:parquet 62718212 / 59911058 / +4.7% 84456973 / 85891230 / -1.7% 0.74 / 0.70 / +6.5%
tpcds_q11/datafusion:parquet 411872374 / 410249982 / +0.4% 452559755 / 453298906 / -0.2% 0.91 / 0.91 / +0.6%
tpcds_q12/datafusion:parquet 39803895 / 40180548 / -0.9% 56777565 / 57554919 / -1.4% 0.70 / 0.70 / +0.4%
tpcds_q13/datafusion:parquet 86664920 / 84877392 / +2.1% 132611607 / 129583250 / +2.3% 0.65 / 0.66 / -0.2%
tpcds_q14/datafusion:parquet 380692790 / 390641226 / -2.5% 419675498 / 422522225 / -0.7% 0.91 / 0.92 / -1.9%
tpcds_q15/datafusion:parquet 50515692 / 51004075 / -1.0% 71690040 / 70096169 / +2.3% 0.70 / 0.73 / -3.2%
tpcds_q16/datafusion:parquet 45181674 / 45319756 / -0.3% 62591716 / 62344760 / +0.4% 0.72 / 0.73 / -0.7%
tpcds_q17/datafusion:parquet 137518232 / 140124091 / -1.9% 174270199 / 173293414 / +0.6% 0.79 / 0.81 / -2.4%
tpcds_q18/datafusion:parquet 108745138 / 110049167 / -1.2% 144534609 / 141644863 / +2.0% 0.75 / 0.78 / -3.2%
tpcds_q19/datafusion:parquet 48137493 / 47382432 / +1.6% 75101349 / 74454407 / +0.9% 0.64 / 0.64 / +0.7%
tpcds_q20/datafusion:parquet 42072455 / 41140804 / +2.3% 54569969 / 53422774 / +2.1% 0.77 / 0.77 / +0.1%
tpcds_q21/datafusion:parquet 61257530 / 60585280 / +1.1% 74142023 / 72359261 / +2.5% 0.83 / 0.84 / -1.3%
tpcds_q22/datafusion:parquet 463411338 / 464956066 / -0.3% 491624542 / 480116418 / +2.4% 0.94 / 0.97 / -2.7%
tpcds_q23/datafusion:parquet 360738784 / 362030230 / -0.4% 428176083 / 423236940 / +1.2% 0.84 / 0.86 / -1.5%
tpcds_q24/datafusion:parquet 242091709 / 238522424 / +1.5% 273592005 / 280988941 / -2.6% 0.88 / 0.85 / +4.2%
tpcds_q25/datafusion:parquet 143490484 / 145856299 / -1.6% 192871808 / 180939258 / +6.6% 0.74 / 0.81 / -7.7%
tpcds_q26/datafusion:parquet 54969709 / 54371764 / +1.1% 80632360 / 78855738 / +2.3% 0.68 / 0.69 / -1.1%
tpcds_q27/datafusion:parquet 207967754 / 208670172 / -0.3% 242611836 / 244008894 / -0.6% 0.86 / 0.86 / +0.2%
tpcds_q28/datafusion:parquet 86510792 / 88438947 / -2.2% 117557924 / 115489704 / +1.8% 0.74 / 0.77 / -3.9%
tpcds_q29/datafusion:parquet 142534367 / 143202262 / -0.5% 179163329 / 175795941 / +1.9% 0.80 / 0.81 / -2.3%
tpcds_q30/datafusion:parquet 96930596 / 99031156 / -2.1% 117590935 / 119707182 / -1.8% 0.82 / 0.83 / -0.4%
tpcds_q31/datafusion:parquet 318360273 / 318865238 / -0.2% 346395388 / 342248409 / +1.2% 0.92 / 0.93 / -1.4%
tpcds_q32/datafusion:parquet 28503405 / 29268206 / -2.6% 46323207 / 43049951 / +7.6% 0.62 / 0.68 / -9.5%
tpcds_q33/datafusion:parquet 52817205 / 54279188 / -2.7% 80190062 / 73291711 / +9.4% 0.66 / 0.74 / -11.1%
tpcds_q34/datafusion:parquet 63527262 / 62880984 / +1.0% 85918079 / 85677254 / +0.3% 0.74 / 0.73 / +0.7%
tpcds_q35/datafusion:parquet 123471118 / 124024507 / -0.4% 153871567 / 152510309 / +0.9% 0.80 / 0.81 / -1.3%
tpcds_q36/datafusion:parquet 98413632 / 96065436 / +2.4% 126618331 / 130472892 / -3.0% 0.78 / 0.74 / +5.6%
tpcds_q37/datafusion:parquet 50089954 / 50326967 / -0.5% 63942354 / 62106792 / +3.0% 0.78 / 0.81 / -3.3%
tpcds_q38/datafusion:parquet 123561140 / 121809162 / +1.4% 145850224 / 148143097 / -1.5% 0.85 / 0.82 / +3.0%
tpcds_q39/datafusion:parquet 850405413 / 850365260 / +0.0% 871033378 / 858244795 / +1.5% 0.98 / 0.99 / -1.5%
tpcds_q40/datafusion:parquet 35231695 / 34460206 / +2.2% 55232047 / 55082629 / +0.3% 0.64 / 0.63 / +2.0%
tpcds_q41/datafusion:parquet 31279257 / 32074791 / -2.5% 43058980 / 42604832 / +1.1% 0.73 / 0.75 / -3.5%
tpcds_q42/datafusion:parquet 25122601 / 26668796 / -5.8% 45933019 / 44471155 / +3.3% 0.55 / 0.60 / -8.8%
tpcds_q43/datafusion:parquet 27473870 / 27798290 / -1.2% 50084483 / 48667153 / +2.9% 0.55 / 0.57 / -4.0%
tpcds_q44/datafusion:parquet 64653200 / 66005414 / -2.0% 88603475 / 85489645 / +3.6% 0.73 / 0.77 / -5.5%
tpcds_q45/datafusion:parquet 65883898 / 66367192 / -0.7% 87553859 / 87700095 / -0.2% 0.75 / 0.76 / -0.6%
tpcds_q46/datafusion:parquet 107130115 / 108262468 / -1.0% 142631736 / 147281576 / -3.2% 0.75 / 0.74 / +2.2%
tpcds_q47/datafusion:parquet 235405844 / 235616338 / -0.1% 277135751 / 274771942 / +0.9% 0.85 / 0.86 / -0.9%
tpcds_q48/datafusion:parquet 77229460 / 79003310 / -2.2% 104123740 / 104369134 / -0.2% 0.74 / 0.76 / -2.0%
tpcds_q49/datafusion:parquet 116803300 / 117557337 / -0.6% 163398977 / 168445239 / -3.0% 0.71 / 0.70 / +2.4%
tpcds_q50/datafusion:parquet 90816122 / 91455979 / -0.7% 125725129 / 121449330 / +3.5% 0.72 / 0.75 / -4.1%
tpcds_q51/datafusion:parquet 255415285 / 257462208 / -0.8% 279377371 / 275612309 / +1.4% 0.91 / 0.93 / -2.1%
tpcds_q52/datafusion:parquet 27386546 / 26582131 / +3.0% 45899075 / 46713825 / -1.7% 0.60 / 0.57 / +4.9%
tpcds_q53/datafusion:parquet 36300826 / 35857856 / +1.2% 60288286 / 60285453 / +0.0% 0.60 / 0.59 / +1.2%
tpcds_q54/datafusion:parquet 84831217 / 84979193 / -0.2% 109098272 / 106622915 / +2.3% 0.78 / 0.80 / -2.4%
tpcds_q55/datafusion:parquet 25730751 / 25716791 / +0.1% 45719505 / 47255907 / -3.3% 0.56 / 0.54 / +3.4%
tpcds_q56/datafusion:parquet 51400494 / 52634930 / -2.3% 74895826 / 72550483 / +3.2% 0.69 / 0.73 / -5.4%
tpcds_q57/datafusion:parquet 171448040 / 171481192 / -0.0% 199152985 / 193556759 / +2.9% 0.86 / 0.89 / -2.8%
tpcds_q58/datafusion:parquet 92845114 / 97417717 / -4.7% 122941120 / 116545953 / +5.5% 0.76 / 0.84 / -9.7%
tpcds_q59/datafusion:parquet 103924140 / 105187850 / -1.2% 129807931 / 128553486 / +1.0% 0.80 / 0.82 / -2.2%
tpcds_q60/datafusion:parquet 54928716 / 53716710 / +2.3% 77960231 / 72468178 / +7.6% 0.70 / 0.74 / -4.9%
tpcds_q61/datafusion:parquet 75922101 / 74726424 / +1.6% 97035035 / 100897235 / -3.8% 0.78 / 0.74 / +5.6%
tpcds_q62/datafusion:parquet 27602870 / 27394960 / +0.8% 45351012 / 44704350 / +1.4% 0.61 / 0.61 / -0.7%
tpcds_q63/datafusion:parquet 36066877 / 36109236 / -0.1% 58254421 / 58190337 / +0.1% 0.62 / 0.62 / -0.2%
tpcds_q64/datafusion:parquet 661417452 / 658028547 / +0.5% 743710866 / 727112413 / +2.3% 0.89 / 0.90 / -1.7%
tpcds_q65/datafusion:parquet 102630496 / 100883629 / +1.7% 139423002 / 133391313 / +4.5% 0.74 / 0.76 / -2.7%
tpcds_q66/datafusion:parquet 75313248 / 77524761 / -2.9% 101145895 / 104064088 / -2.8% 0.74 / 0.74 / -0.0%
tpcds_q67/datafusion:parquet 434540000 / 432898548 / +0.4% 502216596 / 500774321 / +0.3% 0.87 / 0.86 / +0.1%
tpcds_q68/datafusion:parquet 110118814 / 107972369 / +2.0% 160028436 / 153393827 / +4.3% 0.69 / 0.70 / -2.2%
tpcds_q69/datafusion:parquet 60211935 / 59031088 / +2.0% 79023658 / 81368763 / -2.9% 0.76 / 0.73 / +5.0%
tpcds_q70/datafusion:parquet 212313480 / 211356872 / +0.5% 244340438 / 243628971 / +0.3% 0.87 / 0.87 / +0.2%
tpcds_q71/datafusion:parquet 37635930 / 39988372 / -5.9% 64158432 / 63580905 / +0.9% 0.59 / 0.63 / -6.7%
tpcds_q72/datafusion:parquet 1774426211 / 1766291258 / +0.5% 1804872993 / 1717685799 / +5.1% 0.98 / 1.03 / -4.4%
tpcds_q73/datafusion:parquet 62568426 / 62604856 / -0.1% 86934560 / 85382876 / +1.8% 0.72 / 0.73 / -1.8%
tpcds_q74/datafusion:parquet 295044104 / 293543952 / +0.5% 326576225 / 333014708 / -1.9% 0.90 / 0.88 / +2.5%
tpcds_q75/datafusion:parquet 194261314 / 195570109 / -0.7% 236605370 / 227532670 / +4.0% 0.82 / 0.86 / -4.5%
tpcds_q76/datafusion:parquet 49185044 / 50790492 / -3.2% 79746836 / 80279383 / -0.7% 0.62 / 0.63 / -2.5%
tpcds_q77/datafusion:parquet 74191144 / 71696114 / +3.5% 101831034 / 102466534 / -0.6% 0.73 / 0.70 / +4.1%
tpcds_q78/datafusion:parquet 210226596 / 210078458 / +0.1% 271007178 / 262635746 / +3.2% 0.78 / 0.80 / -3.0%
tpcds_q79/datafusion:parquet 77252514 / 78772706 / -1.9% 114361270 / 113848428 / +0.5% 0.68 / 0.69 / -2.4%
tpcds_q80/datafusion:parquet 144867332 / 143215239 / +1.2% 194242941 / 198385628 / -2.1% 0.75 / 0.72 / +3.3%
tpcds_q81/datafusion:parquet 107475902 / 108666647 / -1.1% 132876712 / 126675306 / +4.9% 0.81 / 0.86 / -5.7%
tpcds_q82/datafusion:parquet 55130139 / 54589676 / +1.0% 72009956 / 72577165 / -0.8% 0.77 / 0.75 / +1.8%
tpcds_q83/datafusion:parquet 65751955 / 66004765 / -0.4% 84567727 / 80766410 / +4.7% 0.78 / 0.82 / -4.9%
tpcds_q84/datafusion:parquet 35445572 / 35067368 / +1.1% 50951450 / 49217980 / +3.5% 0.70 / 0.71 / -2.4%
tpcds_q85/datafusion:parquet 105651408 / 106118258 / -0.4% 132462410 / 126965208 / +4.3% 0.80 / 0.84 / -4.6%
tpcds_q86/datafusion:parquet 22434887 / 21856744 / +2.6% 39417136 / 38801034 / +1.6% 0.57 / 0.56 / +1.0%
tpcds_q87/datafusion:parquet 124315736 / 121427887 / +2.4% 141593917 / 146352765 / -3.3% 0.88 / 0.83 / +5.8%
tpcds_q88/datafusion:parquet 85997640 / 85112720 / +1.0% 105242010 / 111247316 / -5.4% 0.82 / 0.77 / +6.8%
tpcds_q89/datafusion:parquet 39177992 / 38253917 / +2.4% 64564798 / 64696968 / -0.2% 0.61 / 0.59 / +2.6%
tpcds_q90/datafusion:parquet 17051693 / 17095194 / -0.3% 32132075 / 32500458 / -1.1% 0.53 / 0.53 / +0.9%
tpcds_q91/datafusion:parquet 42313634 / 41649029 / +1.6% 59720139 / 57973405 / +3.0% 0.71 / 0.72 / -1.4%
tpcds_q92/datafusion:parquet 28521120 / 28701521 / -0.6% 46887290 / 45914012 / +2.1% 0.61 / 0.63 / -2.7%
tpcds_q93/datafusion:parquet 62267814 / 61105564 / +1.9% 94882342 / 86368626 / +9.9% 0.66 / 0.71 / -7.2%
tpcds_q94/datafusion:parquet 37863385 / 38133748 / -0.7% 57686242 / 57944474 / -0.4% 0.66 / 0.66 / -0.3%
tpcds_q95/datafusion:parquet 128362132 / 129222804 / -0.7% 157763295 / 153739120 / +2.6% 0.81 / 0.84 / -3.2%
tpcds_q96/datafusion:parquet 20965290 / 21737938 / -3.6% 36032053 / 38315607 / -6.0% 0.58 / 0.57 / +2.6%
tpcds_q97/datafusion:parquet 54628799 / 54900939 / -0.5% 81258589 / 80044710 / +1.5% 0.67 / 0.69 / -2.0%
tpcds_q98/datafusion:parquet 60695580 / 62068014 / -2.2% 88920693 / 84935164 / +4.7% 0.68 / 0.73 / -6.6%
tpcds_q99/datafusion:parquet 42031252 / 42547334 / -1.2% 58392192 / 57947364 / +0.8% 0.72 / 0.73 / -2.0%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32706876 / 32666622 / +0.1% 47110067 / 44442032 / +6.0% 0.69 / 0.74 / -5.5%
tpcds_q02/duckdb:vortex-file-compressed 30116716 / 31019078 / -2.9% 43098520 / 42210494 / +2.1% 0.70 / 0.73 / -4.9%
tpcds_q03/duckdb:vortex-file-compressed 13625508 / 13791742 / -1.2% 29334748 / 29378226 / -0.1% 0.46 / 0.47 / -1.1%
tpcds_q04/duckdb:vortex-file-compressed 128769018 / 129471634 / -0.5% 154571033 / 151903616 / +1.8% 0.83 / 0.85 / -2.3%
tpcds_q05/duckdb:vortex-file-compressed 54419508 / 54650877 / -0.4% 79134235 / 73147246 / +8.2% 0.69 / 0.75 / -8.0%
tpcds_q06/duckdb:vortex-file-compressed 59089357 / 58713689 / +0.6% 79041561 / 75959131 / +4.1% 0.75 / 0.77 / -3.3%
tpcds_q07/duckdb:vortex-file-compressed 30471544 / 30579528 / -0.4% 51126606 / 52049505 / -1.8% 0.60 / 0.59 / +1.4%
tpcds_q08/duckdb:vortex-file-compressed 31079266 / 30914874 / +0.5% 43331707 / 40665146 / +6.6% 0.72 / 0.76 / -5.7%
tpcds_q09/duckdb:vortex-file-compressed 55537458 / 56913068 / -2.4% 77072195 / 74998255 / +2.8% 0.72 / 0.76 / -5.0%
tpcds_q10/duckdb:vortex-file-compressed 39379350 / 39635552 / -0.6% 58574205 / 57816076 / +1.3% 0.67 / 0.69 / -1.9%
tpcds_q11/duckdb:vortex-file-compressed 94955470 / 95253860 / -0.3% 116334607 / 113706380 / +2.3% 0.82 / 0.84 / -2.6%
tpcds_q12/duckdb:vortex-file-compressed 17956846 / 17712503 / +1.4% 31059245 / 29984002 / +3.6% 0.58 / 0.59 / -2.1%
tpcds_q13/duckdb:vortex-file-compressed 38016990 / 37991460 / +0.1% 69728168 / 69301429 / +0.6% 0.55 / 0.55 / -0.5%
tpcds_q14/duckdb:vortex-file-compressed 119375008 / 121384720 / -1.7% 141954127 / 134734274 / +5.4% 0.84 / 0.90 / -6.7%
tpcds_q15/duckdb:vortex-file-compressed 60360709 / 61299576 / -1.5% 75179778 / 72388428 / +3.9% 0.80 / 0.85 / -5.2%
tpcds_q16/duckdb:vortex-file-compressed 34394654 / 34690472 / -0.9% 52941391 / 52266117 / +1.3% 0.65 / 0.66 / -2.1%
tpcds_q17/duckdb:vortex-file-compressed 57040484 / 57332318 / -0.5% 79647144 / 79066911 / +0.7% 0.72 / 0.73 / -1.2%
tpcds_q18/duckdb:vortex-file-compressed 82716111 / 82923020 / -0.2% 103060904 / 101023706 / +2.0% 0.80 / 0.82 / -2.2%
tpcds_q19/duckdb:vortex-file-compressed 45029291 / 43597316 / +3.3% 61107720 / 62263780 / -1.9% 0.74 / 0.70 / +5.2%
tpcds_q20/duckdb:vortex-file-compressed 22105698 / 22262395 / -0.7% 36494216 / 35610939 / +2.5% 0.61 / 0.63 / -3.1%
tpcds_q21/duckdb:vortex-file-compressed 35127728 / 34748561 / +1.1% 65169445 / 61670816 / +5.7% 0.54 / 0.56 / -4.3%
tpcds_q22/duckdb:vortex-file-compressed 154925217 / 161348692 / -4.0% 174744853 / 172593381 / +1.2% 0.89 / 0.93 / -5.2%
tpcds_q23/duckdb:vortex-file-compressed 181609450 / 183560942 / -1.1% 202086933 / 197879336 / +2.1% 0.90 / 0.93 / -3.1%
tpcds_q24/duckdb:vortex-file-compressed 51700755 / 52262054 / -1.1% 76901892 / 70571615 / +9.0% 0.67 / 0.74 / -9.2%
tpcds_q25/duckdb:vortex-file-compressed 53155580 / 52927888 / +0.4% 75432269 / 72882457 / +3.5% 0.70 / 0.73 / -3.0%
tpcds_q26/duckdb:vortex-file-compressed 26514266 / 26933009 / -1.6% 45710283 / 40955560 / +11.6% 🔴 0.58 / 0.66 / -11.8%
tpcds_q27/duckdb:vortex-file-compressed 31652565 / 32187006 / -1.7% 52613284 / 51949183 / +1.3% 0.60 / 0.62 / -2.9%
tpcds_q28/duckdb:vortex-file-compressed 42160673 / 42552663 / -0.9% 64347998 / 61657569 / +4.4% 0.66 / 0.69 / -5.1%
tpcds_q29/duckdb:vortex-file-compressed 52291682 / 52233606 / +0.1% 73931121 / 71810623 / +3.0% 0.71 / 0.73 / -2.8%
tpcds_q30/duckdb:vortex-file-compressed 38148908 / 38885226 / -1.9% 51112307 / 50464856 / +1.3% 0.75 / 0.77 / -3.1%
tpcds_q31/duckdb:vortex-file-compressed 38033394 / 38098196 / -0.2% 54152003 / 53564287 / +1.1% 0.70 / 0.71 / -1.3%
tpcds_q32/duckdb:vortex-file-compressed 13997434 / 13744550 / +1.8% 29197980 / 29352103 / -0.5% 0.48 / 0.47 / +2.4%
tpcds_q33/duckdb:vortex-file-compressed 35209415 / 34677902 / +1.5% 59581973 / 56234127 / +6.0% 0.59 / 0.62 / -4.2%
tpcds_q34/duckdb:vortex-file-compressed 22408353 / 22969670 / -2.4% 39212219 / 38109259 / +2.9% 0.57 / 0.60 / -5.2%
tpcds_q35/duckdb:vortex-file-compressed 66225184 / 67973400 / -2.6% 88025458 / 87774818 / +0.3% 0.75 / 0.77 / -2.8%
tpcds_q36/duckdb:vortex-file-compressed 28611071 / 29798050 / -4.0% 48894265 / 50744981 / -3.6% 0.59 / 0.59 / -0.3%
tpcds_q37/duckdb:vortex-file-compressed 27330052 / 27056984 / +1.0% 77331903 / 63501341 / +21.8% 🔴 0.35 / 0.43 / -17.1%
tpcds_q38/duckdb:vortex-file-compressed 62270584 / 65418466 / -4.8% 74026513 / 79214533 / -6.5% 0.84 / 0.83 / +1.9%
tpcds_q39/duckdb:vortex-file-compressed 59321582 / 59507598 / -0.3% 87824141 / 85059050 / +3.3% 0.68 / 0.70 / -3.5%
tpcds_q40/duckdb:vortex-file-compressed 19120614 / 18871024 / +1.3% 35451458 / 33673544 / +5.3% 0.54 / 0.56 / -3.8%
tpcds_q41/duckdb:vortex-file-compressed 19595609 / 19805286 / -1.1% 26834253 / 29362971 / -8.6% 0.73 / 0.67 / +8.3%
tpcds_q42/duckdb:vortex-file-compressed 14445588 / 13899774 / +3.9% 30648709 / 29210586 / +4.9% 0.47 / 0.48 / -0.9%
tpcds_q43/duckdb:vortex-file-compressed 19515951 / 19246490 / +1.4% 32292265 / 32560191 / -0.8% 0.60 / 0.59 / +2.2%
tpcds_q44/duckdb:vortex-file-compressed 28162917 / 28025286 / +0.5% 47259588 / 48655091 / -2.9% 0.60 / 0.58 / +3.5%
tpcds_q45/duckdb:vortex-file-compressed 46119798 / 47072534 / -2.0% 60111102 / 59554822 / +0.9% 0.77 / 0.79 / -2.9%
tpcds_q46/duckdb:vortex-file-compressed 50955244 / 50438530 / +1.0% 75710763 / 74694605 / +1.4% 0.67 / 0.68 / -0.3%
tpcds_q47/duckdb:vortex-file-compressed 81593012 / 80023928 / +2.0% 97359078 / 94571206 / +2.9% 0.84 / 0.85 / -1.0%
tpcds_q48/duckdb:vortex-file-compressed 52929724 / 54686811 / -3.2% 79515010 / 74230374 / +7.1% 0.67 / 0.74 / -9.6%
tpcds_q49/duckdb:vortex-file-compressed 37924782 / 37594846 / +0.9% 77718529 / 74467492 / +4.4% 0.49 / 0.50 / -3.3%
tpcds_q50/duckdb:vortex-file-compressed 31655366 / 32781100 / -3.4% 55768906 / 53162237 / +4.9% 0.57 / 0.62 / -7.9%
tpcds_q51/duckdb:vortex-file-compressed 204585144 / 203964206 / +0.3% 223448827 / 219753980 / +1.7% 0.92 / 0.93 / -1.4%
tpcds_q52/duckdb:vortex-file-compressed 14760702 / 14677496 / +0.6% 32823560 / 31526862 / +4.1% 0.45 / 0.47 / -3.4%
tpcds_q53/duckdb:vortex-file-compressed 21955375 / 22186665 / -1.0% 38083739 / 37074470 / +2.7% 0.58 / 0.60 / -3.7%
tpcds_q54/duckdb:vortex-file-compressed 44430480 / 44656646 / -0.5% 65917910 / 64461201 / +2.3% 0.67 / 0.69 / -2.7%
tpcds_q55/duckdb:vortex-file-compressed 15015394 / 14576306 / +3.0% 29971251 / 29207984 / +2.6% 0.50 / 0.50 / +0.4%
tpcds_q56/duckdb:vortex-file-compressed 33655668 / 33782552 / -0.4% 57754246 / 55297615 / +4.4% 0.58 / 0.61 / -4.6%
tpcds_q57/duckdb:vortex-file-compressed 65768514 / 65424170 / +0.5% 77072511 / 78631941 / -2.0% 0.85 / 0.83 / +2.6%
tpcds_q58/duckdb:vortex-file-compressed 38209130 / 38898298 / -1.8% 59128088 / 55844701 / +5.9% 0.65 / 0.70 / -7.2%
tpcds_q59/duckdb:vortex-file-compressed 52346538 / 53884934 / -2.9% 65275318 / 64106634 / +1.8% 0.80 / 0.84 / -4.6%
tpcds_q60/duckdb:vortex-file-compressed 35566001 / 35946234 / -1.1% 58114069 / 56917888 / +2.1% 0.61 / 0.63 / -3.1%
tpcds_q61/duckdb:vortex-file-compressed 34922538 / 35361596 / -1.2% 55882941 / 54931615 / +1.7% 0.62 / 0.64 / -2.9%
tpcds_q62/duckdb:vortex-file-compressed 15945065 / 15642241 / +1.9% 26371509 / 26437775 / -0.3% 0.60 / 0.59 / +2.2%
tpcds_q63/duckdb:vortex-file-compressed 21402921 / 21535454 / -0.6% 38012890 / 37891582 / +0.3% 0.56 / 0.57 / -0.9%
tpcds_q64/duckdb:vortex-file-compressed 119075496 / 118554184 / +0.4% 152808824 / 155152310 / -1.5% 0.78 / 0.76 / +2.0%
tpcds_q65/duckdb:vortex-file-compressed 49795863 / 51795274 / -3.9% 59068283 / 58381044 / +1.2% 0.84 / 0.89 / -5.0%
tpcds_q66/duckdb:vortex-file-compressed 41161432 / 43175862 / -4.7% 59228811 / 58144026 / +1.9% 0.69 / 0.74 / -6.4%
tpcds_q67/duckdb:vortex-file-compressed 274337520 / 279697525 / -1.9% 294201364 / 286952006 / +2.5% 0.93 / 0.97 / -4.3%
tpcds_q68/duckdb:vortex-file-compressed 44095168 / 43855412 / +0.5% 73766955 / 70889380 / +4.1% 0.60 / 0.62 / -3.4%
tpcds_q69/duckdb:vortex-file-compressed 38834917 / 38928932 / -0.2% 59506397 / 58818393 / +1.2% 0.65 / 0.66 / -1.4%
tpcds_q70/duckdb:vortex-file-compressed 25383978 / 25463294 / -0.3% 42505058 / 40384021 / +5.3% 0.60 / 0.63 / -5.3%
tpcds_q71/duckdb:vortex-file-compressed 27815804 / 28420039 / -2.1% 50199390 / 50106346 / +0.2% 0.55 / 0.57 / -2.3%
tpcds_q72/duckdb:vortex-file-compressed 138655862 / 139979520 / -0.9% 161864110 / 158903169 / +1.9% 0.86 / 0.88 / -2.8%
tpcds_q73/duckdb:vortex-file-compressed 20016839 / 20585262 / -2.8% 38012380 / 34351793 / +10.7% 🔴 0.53 / 0.60 / -12.1%
tpcds_q74/duckdb:vortex-file-compressed 85001034 / 82954312 / +2.5% 96118379 / 96750254 / -0.7% 0.88 / 0.86 / +3.1%
tpcds_q75/duckdb:vortex-file-compressed 111132277 / 111812181 / -0.6% 140767835 / 134642468 / +4.5% 0.79 / 0.83 / -4.9%
tpcds_q76/duckdb:vortex-file-compressed 28192538 / 28565848 / -1.3% 56557091 / 50818005 / +11.3% 🔴 0.50 / 0.56 / -11.3%
tpcds_q77/duckdb:vortex-file-compressed 37373166 / 37119674 / +0.7% 62215974 / 58001525 / +7.3% 0.60 / 0.64 / -6.1%
tpcds_q78/duckdb:vortex-file-compressed 136027932 / 134376332 / +1.2% 160569809 / 156253992 / +2.8% 0.85 / 0.86 / -1.5%
tpcds_q79/duckdb:vortex-file-compressed 37830158 / 37226774 / +1.6% 63200168 / 64984627 / -2.7% 0.60 / 0.57 / +4.5%
tpcds_q80/duckdb:vortex-file-compressed 60054913 / 60631832 / -1.0% 96185849 / 87730396 / +9.6% 0.62 / 0.69 / -9.7%
tpcds_q81/duckdb:vortex-file-compressed 57407154 / 56945055 / +0.8% 71203455 / 69412304 / +2.6% 0.81 / 0.82 / -1.7%
tpcds_q82/duckdb:vortex-file-compressed 28541696 / 29310453 / -2.6% 78828290 / 66476381 / +18.6% 🔴 0.36 / 0.44 / -17.9%
tpcds_q83/duckdb:vortex-file-compressed 21832554 / 22220825 / -1.7% 32058574 / 31287098 / +2.5% 0.68 / 0.71 / -4.1%
tpcds_q84/duckdb:vortex-file-compressed 13825246 / 13235808 / +4.5% 23972387 / 23242568 / +3.1% 0.58 / 0.57 / +1.3%
tpcds_q85/duckdb:vortex-file-compressed 37166986 / 36925374 / +0.7% 57254591 / 51546008 / +11.1% 🔴 0.65 / 0.72 / -9.4%
tpcds_q86/duckdb:vortex-file-compressed 17104062 / 17513178 / -2.3% 27675499 / 27253205 / +1.5% 0.62 / 0.64 / -3.8%
tpcds_q87/duckdb:vortex-file-compressed 78079769 / 77864842 / +0.3% 88300768 / 89463261 / -1.3% 0.88 / 0.87 / +1.6%
tpcds_q88/duckdb:vortex-file-compressed 38177176 / 38263800 / -0.2% 50486367 / 48154818 / +4.8% 0.76 / 0.79 / -4.8%
tpcds_q89/duckdb:vortex-file-compressed 24669770 / 24642745 / +0.1% 40618894 / 39097340 / +3.9% 0.61 / 0.63 / -3.6%
tpcds_q90/duckdb:vortex-file-compressed 9909190 / 9989277 / -0.8% 21670366 / 19596667 / +10.6% 🔴 0.46 / 0.51 / -10.3%
tpcds_q91/duckdb:vortex-file-compressed 19473284 / 19631830 / -0.8% 29940416 / 28502784 / +5.0% 0.65 / 0.69 / -5.6%
tpcds_q92/duckdb:vortex-file-compressed 14199650 / 13669336 / +3.9% 27252443 / 27546971 / -1.1% 0.52 / 0.50 / +5.0%
tpcds_q93/duckdb:vortex-file-compressed 25447873 / 25614763 / -0.7% 51611960 / 48903940 / +5.5% 0.49 / 0.52 / -5.9%
tpcds_q94/duckdb:vortex-file-compressed 32771750 / 32556908 / +0.7% 48624870 / 46308520 / +5.0% 0.67 / 0.70 / -4.1%
tpcds_q95/duckdb:vortex-file-compressed 94075870 / 94847437 / -0.8% 108152360 / 106019934 / +2.0% 0.87 / 0.89 / -2.8%
tpcds_q96/duckdb:vortex-file-compressed 12007990 / 11913750 / +0.8% 24569727 / 24940175 / -1.5% 0.49 / 0.48 / +2.3%
tpcds_q97/duckdb:vortex-file-compressed 60150944 / 61212860 / -1.7% 81264328 / 78071460 / +4.1% 0.74 / 0.78 / -5.6%
tpcds_q98/duckdb:vortex-file-compressed 27452570 / 27621885 / -0.6% 44736094 / 43376439 / +3.1% 0.61 / 0.64 / -3.6%
tpcds_q99/duckdb:vortex-file-compressed 22163695 / 22726621 / -2.5% 36020476 / 35480133 / +1.5% 0.62 / 0.64 / -3.9%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 42829008 / 41754509 / +2.6% 50219232 / 49716420 / +1.0% 0.85 / 0.84 / +1.5%
tpcds_q02/duckdb:parquet 39286074 / 39320498 / -0.1% 51233571 / 48014421 / +6.7% 0.77 / 0.82 / -6.4%
tpcds_q03/duckdb:parquet 25451248 / 25927457 / -1.8% 36402628 / 36544174 / -0.4% 0.70 / 0.71 / -1.5%
tpcds_q04/duckdb:parquet 203800752 / 204404258 / -0.3% 227582628 / 225527266 / +0.9% 0.90 / 0.91 / -1.2%
tpcds_q05/duckdb:parquet 68589556 / 69257976 / -1.0% 83110801 / 85239338 / -2.5% 0.83 / 0.81 / +1.6%
tpcds_q06/duckdb:parquet 74481042 / 75009952 / -0.7% 91098391 / 86459760 / +5.4% 0.82 / 0.87 / -5.8%
tpcds_q07/duckdb:parquet 60153853 / 61347346 / -1.9% 78456900 / 78900270 / -0.6% 0.77 / 0.78 / -1.4%
tpcds_q08/duckdb:parquet 37984975 / 39528259 / -3.9% 42624686 / 47045239 / -9.4% 0.89 / 0.84 / +6.1%
tpcds_q09/duckdb:parquet 86038230 / 85242190 / +0.9% 94763649 / 99107059 / -4.4% 0.91 / 0.86 / +5.6%
tpcds_q10/duckdb:parquet 52134574 / 51215596 / +1.8% 63175730 / 60545042 / +4.3% 0.83 / 0.85 / -2.4%
tpcds_q11/duckdb:parquet 156884796 / 157115754 / -0.1% 169197425 / 167096251 / +1.3% 0.93 / 0.94 / -1.4%
tpcds_q12/duckdb:parquet 40234364 / 40352013 / -0.3% 47839587 / 47141692 / +1.5% 0.84 / 0.86 / -1.7%
tpcds_q13/duckdb:parquet 70045531 / 70020372 / +0.0% 89327067 / 85638270 / +4.3% 0.78 / 0.82 / -4.1%
tpcds_q14/duckdb:parquet 187451265 / 184880045 / +1.4% 207294049 / 198443193 / +4.5% 0.90 / 0.93 / -2.9%
tpcds_q15/duckdb:parquet 60957660 / 60771048 / +0.3% 70242115 / 67619690 / +3.9% 0.87 / 0.90 / -3.4%
tpcds_q16/duckdb:parquet 38081300 / 37994630 / +0.2% 46823080 / 45727616 / +2.4% 0.81 / 0.83 / -2.1%
tpcds_q17/duckdb:parquet 83416328 / 83160258 / +0.3% 90441476 / 89114981 / +1.5% 0.92 / 0.93 / -1.2%
tpcds_q18/duckdb:parquet 87997126 / 87879957 / +0.1% 98044978 / 95836133 / +2.3% 0.90 / 0.92 / -2.1%
tpcds_q19/duckdb:parquet 48790698 / 47515380 / +2.7% 59447896 / 61000663 / -2.5% 0.82 / 0.78 / +5.4%
tpcds_q20/duckdb:parquet 42237687 / 43268675 / -2.4% 50704031 / 53319914 / -4.9% 0.83 / 0.81 / +2.7%
tpcds_q21/duckdb:parquet 23773758 / 23792717 / -0.1% 28404524 / 30200345 / -5.9% 0.84 / 0.79 / +6.2%
tpcds_q22/duckdb:parquet 163545260 / 166859429 / -2.0% 168220553 / 164973195 / +2.0% 0.97 / 1.01 / -3.9%
tpcds_q23/duckdb:parquet 186519748 / 185062354 / +0.8% 193274395 / 194317115 / -0.5% 0.97 / 0.95 / +1.3%
tpcds_q24/duckdb:parquet 72555414 / 73795194 / -1.7% 84114828 / 81539892 / +3.2% 0.86 / 0.91 / -4.7%
tpcds_q25/duckdb:parquet 50716398 / 50609986 / +0.2% 60797382 / 59253909 / +2.6% 0.83 / 0.85 / -2.3%
tpcds_q26/duckdb:parquet 42458876 / 42341269 / +0.3% 52299699 / 50367988 / +3.8% 0.81 / 0.84 / -3.4%
tpcds_q27/duckdb:parquet 56743766 / 59273806 / -4.3% 74047842 / 74915572 / -1.2% 0.77 / 0.79 / -3.1%
tpcds_q28/duckdb:parquet 92875015 / 92538077 / +0.4% 110734640 / 108311955 / +2.2% 0.84 / 0.85 / -1.8%
tpcds_q29/duckdb:parquet 83354358 / 85143526 / -2.1% 98023908 / 97322888 / +0.7% 0.85 / 0.87 / -2.8%
tpcds_q30/duckdb:parquet 72603505 / 71883182 / +1.0% 80165393 / 79235601 / +1.2% 0.91 / 0.91 / -0.2%
tpcds_q31/duckdb:parquet 98708039 / 98352300 / +0.4% 111123086 / 110050281 / +1.0% 0.89 / 0.89 / -0.6%
tpcds_q32/duckdb:parquet 18344908 / 18136707 / +1.1% 26232309 / 25667997 / +2.2% 0.70 / 0.71 / -1.0%
tpcds_q33/duckdb:parquet 62238462 / 63106814 / -1.4% 73546203 / 75700594 / -2.8% 0.85 / 0.83 / +1.5%
tpcds_q34/duckdb:parquet 32943547 / 33253224 / -0.9% 42251882 / 39802094 / +6.2% 0.78 / 0.84 / -6.7%
tpcds_q35/duckdb:parquet 77913484 / 75987730 / +2.5% 91384708 / 90314190 / +1.2% 0.85 / 0.84 / +1.3%
tpcds_q36/duckdb:parquet 98184780 / 96353316 / +1.9% 116374714 / 111385494 / +4.5% 0.84 / 0.87 / -2.5%
tpcds_q37/duckdb:parquet 41658101 / 42209048 / -1.3% 46676292 / 47786871 / -2.3% 0.89 / 0.88 / +1.0%
tpcds_q38/duckdb:parquet 76693619 / 77958424 / -1.6% 84069007 / 85349165 / -1.5% 0.91 / 0.91 / -0.1%
tpcds_q39/duckdb:parquet 60969566 / 61486491 / -0.8% 66695752 / 68395844 / -2.5% 0.91 / 0.90 / +1.7%
tpcds_q40/duckdb:parquet 28188548 / 28074760 / +0.4% 35424750 / 35471051 / -0.1% 0.80 / 0.79 / +0.5%
tpcds_q41/duckdb:parquet 19739630 / 20300412 / -2.8% 25926907 / 27039573 / -4.1% 0.76 / 0.75 / +1.4%
tpcds_q42/duckdb:parquet 25417998 / 25832600 / -1.6% 37003579 / 37396731 / -1.1% 0.69 / 0.69 / -0.6%
tpcds_q43/duckdb:parquet 26579274 / 27833256 / -4.5% 35362235 / 37569548 / -5.9% 0.75 / 0.74 / +1.5%
tpcds_q44/duckdb:parquet 60956670 / 61917711 / -1.6% 74190744 / 76056446 / -2.5% 0.82 / 0.81 / +0.9%
tpcds_q45/duckdb:parquet 61718849 / 60935476 / +1.3% 67213202 / 66445419 / +1.2% 0.92 / 0.92 / +0.1%
tpcds_q46/duckdb:parquet 70542514 / 74233802 / -5.0% 88178954 / 85326401 / +3.3% 0.80 / 0.87 / -8.0%
tpcds_q47/duckdb:parquet 90699385 / 91376278 / -0.7% 102219715 / 100561337 / +1.6% 0.89 / 0.91 / -2.4%
tpcds_q48/duckdb:parquet 67515962 / 65415782 / +3.2% 78000414 / 77089178 / +1.2% 0.87 / 0.85 / +2.0%
tpcds_q49/duckdb:parquet 70488252 / 68736560 / +2.5% 87862178 / 88271949 / -0.5% 0.80 / 0.78 / +3.0%
tpcds_q50/duckdb:parquet 41489568 / 44405659 / -6.6% 52141319 / 50047873 / +4.2% 0.80 / 0.89 / -10.3%
tpcds_q51/duckdb:parquet 217342173 / 215203352 / +1.0% 222730029 / 225668772 / -1.3% 0.98 / 0.95 / +2.3%
tpcds_q52/duckdb:parquet 27671159 / 26929999 / +2.8% 38756028 / 37851845 / +2.4% 0.71 / 0.71 / +0.4%
tpcds_q53/duckdb:parquet 34051138 / 35085957 / -2.9% 45680262 / 45697835 / -0.0% 0.75 / 0.77 / -2.9%
tpcds_q54/duckdb:parquet 55392062 / 55066050 / +0.6% 63229309 / 62823873 / +0.6% 0.88 / 0.88 / -0.1%
tpcds_q55/duckdb:parquet 26050299 / 27167385 / -4.1% 37776852 / 36846878 / +2.5% 0.69 / 0.74 / -6.5%
tpcds_q56/duckdb:parquet 68258134 / 69810094 / -2.2% 83300307 / 78191395 / +6.5% 0.82 / 0.89 / -8.2%
tpcds_q57/duckdb:parquet 68600702 / 67924052 / +1.0% 74783469 / 75378836 / -0.8% 0.92 / 0.90 / +1.8%
tpcds_q58/duckdb:parquet 55618233 / 55636208 / -0.0% 66228414 / 67771566 / -2.3% 0.84 / 0.82 / +2.3%
tpcds_q59/duckdb:parquet 60803900 / 60888385 / -0.1% 68662732 / 69281606 / -0.9% 0.89 / 0.88 / +0.8%
tpcds_q60/duckdb:parquet 81474170 / 82995592 / -1.8% 91490769 / 93609037 / -2.3% 0.89 / 0.89 / +0.4%
tpcds_q61/duckdb:parquet 79079568 / 79843582 / -1.0% 94712307 / 96209480 / -1.6% 0.83 / 0.83 / +0.6%
tpcds_q62/duckdb:parquet 20418154 / 22427732 / -9.0% 26550971 / 26553261 / -0.0% 0.77 / 0.84 / -9.0%
tpcds_q63/duckdb:parquet 33108692 / 32945599 / +0.5% 42727353 / 44810985 / -4.6% 0.77 / 0.74 / +5.4%
tpcds_q64/duckdb:parquet 136324223 / 137730810 / -1.0% 151128870 / 162467301 / -7.0% 0.90 / 0.85 / +6.4%
tpcds_q65/duckdb:parquet 92976915 / 90841106 / +2.4% 107258216 / 98758923 / +8.6% 0.87 / 0.92 / -5.8%
tpcds_q66/duckdb:parquet 45274840 / 46229679 / -2.1% 54780886 / 52011770 / +5.3% 0.83 / 0.89 / -7.0%
tpcds_q67/duckdb:parquet 295745444 / 296484754 / -0.2% 299611279 / 300794460 / -0.4% 0.99 / 0.99 / +0.1%
tpcds_q68/duckdb:parquet 62837098 / 62271290 / +0.9% 76106501 / 79884988 / -4.7% 0.83 / 0.78 / +5.9%
tpcds_q69/duckdb:parquet 66685914 / 66823133 / -0.2% 76472698 / 75751375 / +1.0% 0.87 / 0.88 / -1.1%
tpcds_q70/duckdb:parquet 42647973 / 43502914 / -2.0% 54654606 / 51876494 / +5.4% 0.78 / 0.84 / -6.9%
tpcds_q71/duckdb:parquet 41153846 / 40235578 / +2.3% 53250054 / 53331431 / -0.2% 0.77 / 0.75 / +2.4%
tpcds_q72/duckdb:parquet 172501396 / 171234634 / +0.7% 184098792 / 185887233 / -1.0% 0.94 / 0.92 / +1.7%
tpcds_q73/duckdb:parquet 28221042 / 28539550 / -1.1% 35793964 / 38525179 / -7.1% 0.79 / 0.74 / +6.4%
tpcds_q74/duckdb:parquet 214068690 / 214701141 / -0.3% 221842084 / 226612264 / -2.1% 0.96 / 0.95 / +1.8%
tpcds_q75/duckdb:parquet 131349323 / 136513298 / -3.8% 151919484 / 144305040 / +5.3% 0.86 / 0.95 / -8.6%
tpcds_q76/duckdb:parquet 51241580 / 52107498 / -1.7% 67525573 / 66393995 / +1.7% 0.76 / 0.78 / -3.3%
tpcds_q77/duckdb:parquet 54681005 / 53680122 / +1.9% 71103866 / 68802211 / +3.3% 0.77 / 0.78 / -1.4%
tpcds_q78/duckdb:parquet 148005300 / 146481247 / +1.0% 158551439 / 173928138 / -8.8% 0.93 / 0.84 / +10.8%
tpcds_q79/duckdb:parquet 50448897 / 52912912 / -4.7% 64801564 / 69766888 / -7.1% 0.78 / 0.76 / +2.6%
tpcds_q80/duckdb:parquet 82589412 / 84091399 / -1.8% 104131830 / 101467325 / +2.6% 0.79 / 0.83 / -4.3%
tpcds_q81/duckdb:parquet 97088902 / 96942804 / +0.2% 105902769 / 105070620 / +0.8% 0.92 / 0.92 / -0.6%
tpcds_q82/duckdb:parquet 45731210 / 46487240 / -1.6% 54720754 / 53044060 / +3.2% 0.84 / 0.88 / -4.6%
tpcds_q83/duckdb:parquet 28317408 / 28126860 / +0.7% 33736242 / 33556853 / +0.5% 0.84 / 0.84 / +0.1%
tpcds_q84/duckdb:parquet 22686168 / 22718850 / -0.1% 29448694 / 28854283 / +2.1% 0.77 / 0.79 / -2.2%
tpcds_q85/duckdb:parquet 51240681 / 51569898 / -0.6% 61136974 / 60972055 / +0.3% 0.84 / 0.85 / -0.9%
tpcds_q86/duckdb:parquet 25594742 / 25653376 / -0.2% 31768618 / 32290498 / -1.6% 0.81 / 0.79 / +1.4%
tpcds_q87/duckdb:parquet 86734656 / 86041585 / +0.8% 99295386 / 96073615 / +3.4% 0.87 / 0.90 / -2.5%
tpcds_q88/duckdb:parquet 105092550 / 104156077 / +0.9% 111955114 / 113708809 / -1.5% 0.94 / 0.92 / +2.5%
tpcds_q89/duckdb:parquet 37808480 / 37221714 / +1.6% 48740740 / 52543843 / -7.2% 0.78 / 0.71 / +9.5%
tpcds_q90/duckdb:parquet 15398552 / 15320644 / +0.5% 20018450 / 19638004 / +1.9% 0.77 / 0.78 / -1.4%
tpcds_q91/duckdb:parquet 25557920 / 25533825 / +0.1% 33441496 / 32629028 / +2.5% 0.76 / 0.78 / -2.3%
tpcds_q92/duckdb:parquet 21903701 / 22457040 / -2.5% 29294859 / 29600706 / -1.0% 0.75 / 0.76 / -1.4%
tpcds_q93/duckdb:parquet 37257972 / 36522483 / +2.0% 49205708 / 49556338 / -0.7% 0.76 / 0.74 / +2.7%
tpcds_q94/duckdb:parquet 38523362 / 38221661 / +0.8% 46288280 / 47915670 / -3.4% 0.83 / 0.80 / +4.3%
tpcds_q95/duckdb:parquet 82152490 / 80753512 / +1.7% 87546540 / 88826826 / -1.4% 0.94 / 0.91 / +3.2%
tpcds_q96/duckdb:parquet 17343088 / 17701885 / -2.0% 24454974 / 22852748 / +7.0% 0.71 / 0.77 / -8.4%
tpcds_q97/duckdb:parquet 70503542 / 72195042 / -2.3% 80711736 / 85867593 / -6.0% 0.87 / 0.84 / +3.9%
tpcds_q98/duckdb:parquet 54365124 / 54526654 / -0.3% 69911148 / 67784295 / +3.1% 0.78 / 0.80 / -3.3%
tpcds_q99/duckdb:parquet 24403970 / 25590772 / -4.6% 31883922 / 32382010 / -1.5% 0.77 / 0.79 / -3.1%

No baseline file sizes found for base commit.

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 31d2f1e8 vs base 7f07d78f


vortex / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/strings/amazon/book_reviews/fsst 552736791 / 553320797 / -0.1% 552466210 / 553661653 / -0.2% 1.00 / 1.00 / +0.1%
compress time/strings/amazon/book_reviews/onpair-12 967107983 / 966646851 / +0.0% 966755579 / 966080746 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_reviews/onpair-16 984872034 / 981457484 / +0.3% 984323013 / 981897627 / +0.2% 1.00 / 1.00 / +0.1%
compress time/strings/amazon/book_titles/fsst 57580896 / 57766901 / -0.3% 57678503 / 57926884 / -0.4% 1.00 / 1.00 / +0.1%
compress time/strings/amazon/book_titles/onpair-12 87745457 / 87930289 / -0.2% 87672849 / 87816202 / -0.2% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_titles/onpair-16 90691192 / 90800242 / -0.1% 90773177 / 90789209 / -0.0% 1.00 / 1.00 / -0.1%
compress time/strings/clickbench/url/shard-0/fsst 427330387 / 427973351 / -0.2% 427046826 / 428256738 / -0.3% 1.00 / 1.00 / +0.1%
compress time/strings/clickbench/url/shard-0/onpair-12 600629815 / 602083263 / -0.2% 600686171 / 602421363 / -0.3% 1.00 / 1.00 / +0.0%
compress time/strings/clickbench/url/shard-0/onpair-16 608244089 / 609633909 / -0.2% 608564427 / 609752527 / -0.2% 1.00 / 1.00 / -0.0%
compress time/strings/fineweb/text/fsst 213099804 / 213104369 / -0.0% 213016462 / 213062519 / -0.0% 1.00 / 1.00 / +0.0%
compress time/strings/fineweb/text/onpair-12 503570248 / 502762017 / +0.2% 503771546 / 502593973 / +0.2% 1.00 / 1.00 / -0.1%
compress time/strings/fineweb/text/onpair-16 517994781 / 520249912 / -0.4% 517677157 / 519596993 / -0.4% 1.00 / 1.00 / -0.1%
compress time/strings/news/headlines/fsst 331617425 / 332989182 / -0.4% 331613612 / 333098204 / -0.4% 1.00 / 1.00 / +0.0%
compress time/strings/news/headlines/onpair-12 461933258 / 461898394 / +0.0% 461999566 / 462116713 / -0.0% 1.00 / 1.00 / +0.0%
compress time/strings/news/headlines/onpair-16 474787332 / 474383088 / +0.1% 474963460 / 474354590 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/tinystories/text/fsst 131569827 / 131692923 / -0.1% 131590426 / 131688816 / -0.1% 1.00 / 1.00 / -0.0%
compress time/strings/tinystories/text/onpair-12 217273995 / 217085685 / +0.1% 217199760 / 216961081 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/tinystories/text/onpair-16 220822068 / 220688512 / +0.1% 220937915 / 221087602 / -0.1% 1.00 / 1.00 / +0.1%
compress time/strings/tpch/l_comment/fsst 1053068623 / 1056428415 / -0.3% 1053028086 / 1056954426 / -0.4% 1.00 / 1.00 / +0.1%
compress time/strings/tpch/l_comment/onpair-12 1019116235 / 1021328690 / -0.2% 1019371573 / 1021945252 / -0.3% 1.00 / 1.00 / +0.0%
compress time/strings/tpch/l_comment/onpair-16 1031759275 / 1034003348 / -0.2% 1031432496 / 1034020319 / -0.3% 1.00 / 1.00 / +0.0%
compress time/strings/twitter/sentiment140/fsst 553314108 / 555309373 / -0.4% 553457010 / 555056571 / -0.3% 1.00 / 1.00 / -0.1%
compress time/strings/twitter/sentiment140/onpair-12 941263606 / 939964881 / +0.1% 941225356 / 939889733 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/twitter/sentiment140/onpair-16 1032330829 / 1031480180 / +0.1% 1032197117 / 1031461557 / +0.1% 1.00 / 1.00 / +0.0%
decompress time/strings/amazon/book_reviews/fsst 41445021 / 41497298 / -0.1% 41442196 / 41462437 / -0.0% 1.00 / 1.00 / -0.1%
decompress time/strings/amazon/book_reviews/onpair-12 30518295 / 30450369 / +0.2% 30483670 / 30503550 / -0.1% 1.00 / 1.00 / +0.3%
decompress time/strings/amazon/book_reviews/onpair-16 34013670 / 34106672 / -0.3% 33997855 / 34124923 / -0.4% 1.00 / 1.00 / +0.1%
decompress time/strings/amazon/book_titles/fsst 3426748 / 3440435 / -0.4% 3435324 / 3432673 / +0.1% 1.00 / 1.00 / -0.5%
decompress time/strings/amazon/book_titles/onpair-12 3130253 / 3135074 / -0.2% 3160630 / 3141648 / +0.6% 0.99 / 1.00 / -0.8%
decompress time/strings/amazon/book_titles/onpair-16 3023898 / 3017171 / +0.2% 3030216 / 3015810 / +0.5% 1.00 / 1.00 / -0.3%
decompress time/strings/clickbench/url/shard-0/fsst 31907212 / 31906075 / +0.0% 31897807 / 32041422 / -0.4% 1.00 / 1.00 / +0.5%
decompress time/strings/clickbench/url/shard-0/onpair-12 18970166 / 18918564 / +0.3% 18990198 / 18900907 / +0.5% 1.00 / 1.00 / -0.2%
decompress time/strings/clickbench/url/shard-0/onpair-16 18438508 / 18381949 / +0.3% 18153233 / 18413352 / -1.4% 1.02 / 1.00 / +1.7%
decompress time/strings/fineweb/text/fsst 10360214 / 10346997 / +0.1% 10352515 / 10351626 / +0.0% 1.00 / 1.00 / +0.1%
decompress time/strings/fineweb/text/onpair-12 9528098 / 9571676 / -0.5% 9569161 / 9571867 / -0.0% 1.00 / 1.00 / -0.4%
decompress time/strings/fineweb/text/onpair-16 8477615 / 8509232 / -0.4% 8479714 / 8497903 / -0.2% 1.00 / 1.00 / -0.2%
decompress time/strings/news/headlines/fsst 17753550 / 17826630 / -0.4% 17751578 / 17861510 / -0.6% 1.00 / 1.00 / +0.2%
decompress time/strings/news/headlines/onpair-12 17115342 / 17097989 / +0.1% 17099439 / 17063694 / +0.2% 1.00 / 1.00 / -0.1%
decompress time/strings/news/headlines/onpair-16 16157057 / 16146773 / +0.1% 16160941 / 16110592 / +0.3% 1.00 / 1.00 / -0.2%
decompress time/strings/tinystories/text/fsst 8944147 / 8937701 / +0.1% 8932247 / 9042330 / -1.2% 1.00 / 0.99 / +1.3%
decompress time/strings/tinystories/text/onpair-12 5922349 / 5919360 / +0.1% 6036738 / 5945742 / +1.5% 0.98 / 1.00 / -1.5%
decompress time/strings/tinystories/text/onpair-16 6632096 / 6611588 / +0.3% 6634828 / 6549583 / +1.3% 1.00 / 1.01 / -1.0%
decompress time/strings/tpch/l_comment/fsst 50792184 / 50829247 / -0.1% 50627811 / 51084162 / -0.9% 1.00 / 1.00 / +0.8%
decompress time/strings/tpch/l_comment/onpair-12 42763776 / 42668851 / +0.2% 42653013 / 42752912 / -0.2% 1.00 / 1.00 / +0.5%
decompress time/strings/tpch/l_comment/onpair-16 42514090 / 42541431 / -0.1% 42474352 / 42441906 / +0.1% 1.00 / 1.00 / -0.1%
decompress time/strings/twitter/sentiment140/fsst 36870530 / 36948413 / -0.2% 36866940 / 36940074 / -0.2% 1.00 / 1.00 / -0.0%
decompress time/strings/twitter/sentiment140/onpair-12 33803614 / 33778363 / +0.1% 33872677 / 33832023 / +0.1% 1.00 / 1.00 / -0.0%
decompress time/strings/twitter/sentiment140/onpair-16 34271667 / 34229681 / +0.1% 34258598 / 34301921 / -0.1% 1.00 / 1.00 / +0.2%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/strings/amazon/book_reviews/fsst 66249788 / 66249788 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-12 48618844 / 48618844 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-16 48243532 / 48243532 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/fsst 5434916 / 5434916 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-12 4765620 / 4765620 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-16 4892932 / 4892932 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/fsst 49404124 / 49404124 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-12 29634068 / 29634068 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-16 30002076 / 30002076 / +0.0%
vortex-file-compressed size/strings/fineweb/text/fsst 17098836 / 17098836 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-12 13554932 / 13554932 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-16 12265644 / 12265644 / +0.0%
vortex-file-compressed size/strings/news/headlines/fsst 30677948 / 30677948 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-12 26430660 / 26430660 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-16 26907604 / 26907604 / +0.0%
vortex-file-compressed size/strings/tinystories/text/fsst 14908372 / 14908372 / +0.0%
vortex-file-compressed size/strings/tinystories/text/onpair-12 9300532 / 9300532 / +0.0%
vortex-file-compressed size/strings/tinystories/text/onpair-16 9201148 / 9201148 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/fsst 75050292 / 75050292 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-12 57417388 / 57417388 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-16 57453556 / 57453556 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/fsst 63507044 / 63507044 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-12 54111996 / 54111996 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-16 56471812 / 56471812 / +0.0%

@joseph-isaacs
joseph-isaacs merged commit 815e344 into develop Nov 13, 2026
152 of 153 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/confident-allen-2ohb41 branch November 13, 2026 15:34
joseph-isaacs added a commit that referenced this pull request Nov 13, 2026
## Summary

A follow-up to #11445. Step timings from recent runs showed CI jobs
outside the benchmarks still doing independent setup and checks one step
at a time. This groups those steps into `parallel:` blocks, splits the
Java job into a matrix, and speeds up the SQL benchmark binary handoff.
It also fixes the SQL benchmarks' DuckDB runs, which have been failing
since the Rust 1.100 upgrade.

## Changes

**SQL benchmarks (`sql-bench-matrix.yml`)**
- The build job packs the bench binaries into one tar with
multi-threaded zstd and uploads it with `compression-level: 0`, instead
of letting upload-artifact zip them with single-threaded zlib. Packing
and uploading took 12s, down from 64–90s. Each bench job then spends
about 4s unpacking, and every bench job starts 50–75s sooner. The tar
also keeps the executable bits, so the `chmod` step is gone.
- **Fix:** every DuckDB benchmark failed with `libduckdb.so: cannot open
shared object file`, on other branches too. Rust 1.100's cargo moved
build-script output from `build/<pkg>-<hash>/out` to
`build/<pkg>/<hash>/out`. `vortex-duckdb/build.rs` keeps its DuckDB
cache two levels above `OUT_DIR`, so the library moved to
`build/vortex-duckdb/vortex-duckdb-cache/`, and the hard-coded upload
path matched nothing. upload-artifact skipped the missing file silently.
The build now searches `target/release_debug/build` for the library and
fails if it is missing, because `duckdb-bench` cannot run without it. It
loads the library through an absolute rpath, so the archive keeps its
relative path.

**Pre-merge CI (`ci.yml`)**
- Java: a matrix of four jobs. One leg runs `javadoc check` without the
Spark compat suites, and one leg runs each Spark compat suite (4.1, 4.2,
4.3). Gradle `--parallel` only splits work across projects, and all
three compat suites live in `:vortex-spark-4.0_2.13`, so they ran one
after another. A "Java" gate job keeps the required check name. It runs
with `always()` and fails if any leg failed or was cancelled, because a
skipped required check counts as passed.
- License check: `cargo deny check advisories` and `check bans licenses
sources` run at the same time. The advisory warning still runs after
them, and now has `!cancelled()` so it isn't skipped when both checks
fail.
- Python (test): after the main suite has built the extension and synced
the environment, the datasets-floor, Polars-floor and docs checks run at
the same time.
- Lightweight checks: the uv setup runs alongside the apt install.

**Other PR-path workflows**
- `docs-build.yml`:
  - Rust, JDK and uv install at the same time.
  - Javadoc (3m41s) builds alongside the Sphinx build (7m15s).
- The Javadoc is copied into `docs/_build/html/_static` after the Sphinx
build. The docs link to it with raw HTML, and Sphinx only copies
`_static` into the output, so the built site is the same.
- `publish-dry-runs.yml`, wheel build: setup-prebuild, Zig and uv
install at the same time. The Rust cache still waits for setup-prebuild,
because its key includes the rustc version.
- `web.yml`, `web-build.yml`: Rust, wasm-pack, Bun and Node install at
the same time.

**Fuzz, package and release workflows**
- `run-fuzzer.yml`, `minimize_fuzz_corpus_workflow.yml`:
`runs-on/action` and checkout run together, then building or downloading
the fuzzer runs alongside the corpus restore.
- `fuzz-coverage.yml`: the corpus download (python3 only) runs alongside
setup-prebuild.
- `close-fixed-fuzzer-issues.yml`: the LLVM setup runs with the
cargo-fuzz install. `setup-fuzz-linker` stays on its own, because both
it and the LLVM setup may run `apt-get`.
- `wasm-fuzz.yml`: the wasm32 build runs with the wabt install.
`setup-fuzz-linker` still comes after, because it sets mold `RUSTFLAGS`.
- `build-fuzzers.yml`, `package.yml`, `release-binaries.yml`,
`publish.yml`, `compat-gen-upload.yml`: `runs-on/action` and checkout
run together, and the JDK, Rust, Zig, AWS-credential and
artifact-download steps that don't depend on each other run at the same
time.

**Not changed**
- Windows: splitting the wheel build into its own job was tried and
reverted. The runner pool keeps one Windows instance warm and a cold one
takes 85–105s to boot, which costs more than the 67s it took off the
critical path.
- Rust tests (cpu-features): "Check CPU features" and the test step
compile into the same cargo target directory, so cargo would make them
wait for each other.
- The CUDA, sanitizer, musl and Rust/Clippy jobs: their time is almost
all compiling and running tests.
- No matrix caps `max-parallel`, so all matrix legs already run at once.

## Measured

| | Before | After |
|---|---|---|
| SQL bench: package + upload binaries | 64–90s | 12s |
| SQL bench: download + unpack, per bench job | 16–20s | 17–31s |
| Java, warm Gradle cache | 100s | 81s longest leg + 2s gate |
| Java, cold Gradle cache | 546–588s | the compat suites (about 1.5–2
min each) no longer run in series |
| License check | 92–110s | 67–84s |
| Docs build | 11m33s | 8m39s–10m36s |

The `ci.yml` wall time is still set by Windows (about 8.5–10.5 min), so
these changes shorten individual jobs, not the whole run. The SQL
benchmark changes shorten the bench run directly. On the latest commit
the SQL benchmarks all finished, each with a "No clear signal" verdict,
as expected for a CI-only change.

## Checks
- `yamllint --strict -c .yamllint.yaml .github/` passes.
- For every job in every workflow, I parsed the old and new YAML,
flattened the `parallel:` groups and compared the steps. They are
identical apart from the rewritten Javadoc copy step, the `!cancelled()`
on the advisory warning, the Java matrix, and the SQL bench packaging.
- I ran Cargo 1.100 locally to confirm the new `OUT_DIR` layout, and
checked that the `libduckdb.so` search matches it.
- A separate review pass checked each group for shared files,
environments, outputs, `PATH`/`GITHUB_ENV` needs and apt-lock conflicts.
- CI on the latest commit is green, including all four Java legs, the
Java gate, and the integration smoke tests. An earlier smoke-test
failure, where the RustFS bucket creation returned an HTTP error after
the health check passed, did not recur.

---
🤖 Generated with [Claude Code](https://claude.com/claude-code)

https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N

---------

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Claude <noreply@anthropic.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants