Skip to content

Speed up V2 scans and default datafusion-bench to V2 for TPC-DS and ClickBench - #10799

Merged
joseph-isaacs merged 6 commits into
developfrom
ji/scan-v2-clickbench-tpcds
Oct 29, 2026
Merged

joseph-isaacs merged 6 commits into
developfrom
ji/scan-v2-clickbench-tpcds

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

V2 ClickBench scans can do less CPU work than V1 yet take longer because 1M-row filtered chunks leave most workers idle behind a few expensive chunks. Use 128K-row chunks for filtered string and wider scans. Keep 1M-row chunks when the filter and projection together read only one primitive or boolean field, where smaller chunks mainly add setup overhead.

This PR also reuses structurally equivalent scan plans, retains recently read segments, joins short edge chunks, and preserves encoded values for sparse string/binary dictionary takes. It enables V2 by default in datafusion-bench for ClickBench and TPC-DS.

The filter/slice rewrite is already in develop through #10959, so it is no longer part of this diff.

DataFusion performance

Matched local ARM64 measurements compare V2 before and after the chunk-sizing change, with the filter/slice rewrite present in both binaries. CPU affinity was 2–31; Tokio workers and DataFusion partitions were both 30. Each query ran nine iterations, discarding the first and reporting the median of the remaining eight. No competing benchmark or build overlap was detected.

Query Before After Latency change
Q20 149.2 ms 125.1 ms -16.1%
Q21 161.6 ms 143.9 ms -11.0%
Q23 287.4 ms 200.4 ms -30.3%
Q24 21.6 ms 17.3 ms -19.9%
Q26 22.8 ms 17.7 ms -22.3%
Q38 13.6 ms 8.7 ms -35.6%

@joseph-isaacs
joseph-isaacs changed the base branch from ji/jolly-shannon-f0erx1 to develop October 26, 2026 14:06
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 26, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026
@codspeed

codspeed Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 10.41%

3 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

ℹ️ This run is excluded from the branch history

This commit was force-pushed, so this run no longer appears in the branch's performance history.

⚡ 3 improved benchmarks
❌ 6 regressed benchmarks
✅ 2295 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation filter_powerlaw_by_random[10000] 813.5 ns 1,357.7 ns -40.09%
❌ CPU Simulation missing_stats[16] 67.9 µs 85.2 µs -20.28%
❌ CPU Simulation random_i8[0.01] 99.1 µs 122.8 µs -19.3%
❌ CPU Simulation test_scan_scalar_at[int] 581.8 µs 679.5 µs -14.38%
❌ Walltime starts_with_avx2[64, VarBin] 54.2 µs 63.2 µs -14.28%
❌ CPU Simulation compare[13] 76.3 µs 85.6 µs -10.83%
⚡ CPU Simulation encode_primitives[u8, (2000, 4)] 164.2 µs 136.5 µs +20.33%
⚡ CPU Simulation take_filter_primitive_small_uncached_random_mask_random_indices[4096, 10] 23.3 µs 21 µs +11.01%
⚡ Walltime threshold_avx512[80] 2.8 µs 2.5 µs +10.35%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/scan-v2-clickbench-tpcds (e503266) with develop (f04a28c)1

Open in CodSpeed

Footnotes

  1. No successful run was found on develop (322a04a) during the generation of this report, so f04a28c was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f0752c6 tpch-nvme 2 Explore Profiling Data
🟢 Done f0752c6 fineweb 2 Explore Profiling Data
🟢 Done f0752c6 clickbench-nvme 2 Explore Profiling Data
🟢 Done f0752c6 tpch-nvme-10 2 Explore Profiling Data
🟢 Done f0752c6 polarsignals 2 Explore Profiling Data
🟢 Done f0752c6 tpch-s3 2 Explore Profiling Data
🟢 Done f0752c6 tpcds-nvme 2 Explore Profiling Data
Previous Runs (70)
Status Commit Job Attempt Link
🟢 Done 75af0e4 clickbench-nvme 1 Explore Profiling Data
🟢 Done 75af0e4 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 75af0e4 polarsignals 1 Explore Profiling Data
🟢 Done 75af0e4 fineweb 1 Explore Profiling Data
🟢 Done 75af0e4 tpch-s3 1 Explore Profiling Data
🟢 Done 75af0e4 tpch-nvme 1 Explore Profiling Data
🟢 Done 75af0e4 tpcds-nvme 1 Explore Profiling Data
🟢 Done 65bf7e9 clickbench-nvme 1 Explore Profiling Data
🟢 Done 65bf7e9 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 65bf7e9 polarsignals 1 Explore Profiling Data
🟢 Done 65bf7e9 fineweb 1 Explore Profiling Data
🟢 Done 65bf7e9 tpch-s3 1 Explore Profiling Data
🟢 Done 65bf7e9 tpch-nvme 1 Explore Profiling Data
🟢 Done 65bf7e9 tpcds-nvme 1 Explore Profiling Data
🟢 Done 9847c99 clickbench-nvme 1 Explore Profiling Data
🟢 Done 9847c99 polarsignals 1 Explore Profiling Data
🟢 Done 9847c99 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 9847c99 fineweb 1 Explore Profiling Data
🟢 Done 9847c99 tpch-nvme 1 Explore Profiling Data
🟢 Done 9847c99 tpch-s3 1 Explore Profiling Data
🟢 Done 9847c99 tpcds-nvme 1 Explore Profiling Data
🟢 Done eb87fcd clickbench-nvme 1 Explore Profiling Data
🟢 Done eb87fcd polarsignals 1 Explore Profiling Data
🟢 Done eb87fcd tpch-nvme-10 1 Explore Profiling Data
🟢 Done eb87fcd tpch-s3 1 Explore Profiling Data
🟢 Done eb87fcd fineweb 1 Explore Profiling Data
🟢 Done eb87fcd tpcds-nvme 1 Explore Profiling Data
🟢 Done eb87fcd tpch-nvme 1 Explore Profiling Data
🟢 Done eedd5bf clickbench-nvme 1 Explore Profiling Data
🟢 Done eedd5bf polarsignals 1 Explore Profiling Data
🟢 Done eedd5bf tpch-nvme-10 1 Explore Profiling Data
🟢 Done eedd5bf fineweb 1 Explore Profiling Data
🟢 Done eedd5bf tpch-nvme 1 Explore Profiling Data
🟢 Done eedd5bf tpch-s3 1 Explore Profiling Data
🟢 Done eedd5bf tpcds-nvme 1 Explore Profiling Data
🟢 Done bef7c23 fineweb 1 Explore Profiling Data
🟢 Done bef7c23 clickbench-nvme 1 Explore Profiling Data
🟢 Done bef7c23 polarsignals 1 Explore Profiling Data
🟢 Done bef7c23 tpch-nvme-10 1 Explore Profiling Data
🟢 Done bef7c23 tpcds-nvme 1 Explore Profiling Data
🟢 Done bef7c23 tpch-s3 1 Explore Profiling Data
🟢 Done bef7c23 tpch-nvme 1 Explore Profiling Data
🟢 Done 06c0701 clickbench-nvme 1 Explore Profiling Data
🟢 Done 06c0701 fineweb 1 Explore Profiling Data
🟢 Done 06c0701 tpch-s3 1 Explore Profiling Data
🟢 Done 06c0701 polarsignals 1 Explore Profiling Data
🟢 Done 06c0701 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 06c0701 tpcds-nvme 1 Explore Profiling Data
🟢 Done 06c0701 tpch-nvme 1 Explore Profiling Data
🟢 Done ba0fb42 clickbench-nvme 1 Explore Profiling Data
🟢 Done ba0fb42 polarsignals 1 Explore Profiling Data
🟢 Done ba0fb42 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ba0fb42 fineweb 1 Explore Profiling Data
🟢 Done ba0fb42 tpch-s3 1 Explore Profiling Data
🟢 Done ba0fb42 tpch-nvme 1 Explore Profiling Data
🟢 Done ba0fb42 tpcds-nvme 1 Explore Profiling Data
🟢 Done 02d9b08 clickbench-nvme 1 Explore Profiling Data
🟢 Done 02d9b08 polarsignals 1 Explore Profiling Data
🟢 Done 02d9b08 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 02d9b08 tpcds-nvme 1 Explore Profiling Data
🟢 Done 02d9b08 fineweb 1 Explore Profiling Data
🟢 Done 02d9b08 tpch-s3 1 Explore Profiling Data
🟢 Done 02d9b08 tpch-nvme 1 Explore Profiling Data
🟢 Done b971253 clickbench-nvme 1 Explore Profiling Data
🟢 Done b971253 polarsignals 1 Explore Profiling Data
🟢 Done b971253 tpch-nvme-10 1 Explore Profiling Data
🟢 Done b971253 tpch-s3 1 Explore Profiling Data
🟢 Done b971253 fineweb 1 Explore Profiling Data
🟢 Done b971253 tpch-nvme 1 Explore Profiling Data
🟢 Done b971253 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress b971253 fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR f0752c6b vs base 322a04a6
Vortex (geomean): hot 0.997x ➖ · cold 0.910x ➖


datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44830084 / 44512828 / +0.7% 86669620 / 92608266 / -6.4% 0.52 / 0.48 / +7.6%
polarsignals_q01/datafusion:vortex-file-compressed 50687636 / 50652905 / +0.1% 112405953 / 116999241 / -3.9% 0.45 / 0.43 / +4.2%
polarsignals_q02/datafusion:vortex-file-compressed 43680314 / 43932552 / -0.6% 80664090 / 86739086 / -7.0% 0.54 / 0.51 / +6.9%
polarsignals_q03/datafusion:vortex-file-compressed 53539224 / 53559262 / -0.0% 112118576 / 116030303 / -3.4% 0.48 / 0.46 / +3.5%
polarsignals_q04/datafusion:vortex-file-compressed 9147378 / 9407826 / -2.8% 43162272 / 48985496 / -11.9% 🟢 0.21 / 0.19 / +10.3%
polarsignals_q05/datafusion:vortex-file-compressed 11645928 / 11923030 / -2.3% 48436658 / 52811355 / -8.3% 0.24 / 0.23 / +6.5%
polarsignals_q06/datafusion:vortex-file-compressed 23346484 / 23487048 / -0.6% 56106816 / 62722068 / -10.5% 🟢 0.42 / 0.37 / +11.1%
polarsignals_q07/datafusion:vortex-file-compressed 11165532 / 10882604 / +2.6% 43273631 / 52352544 / -17.3% 🟢 0.26 / 0.21 / +24.1%
polarsignals_q08/datafusion:vortex-file-compressed 97456966 / 97457228 / -0.0% 155347375 / 164394267 / -5.5% 0.63 / 0.59 / +5.8%
polarsignals_q09/datafusion:vortex-file-compressed 10185130 / 10233696 / -0.5% 41176270 / 48489740 / -15.1% 🟢 0.25 / 0.21 / +17.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR f0752c6b vs base 322a04a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.013x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.959x ➖
Shifts: Parquet (control) -0.7% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6806684 / 6869672 / -0.9% 16369834 / 15612164 / +4.9% 0.42 / 0.44 / -5.5%
fineweb_q01/datafusion:vortex-file-compressed 9169886 / 9119447 / +0.6% 45719847 / 45367598 / +0.8% 0.20 / 0.20 / -0.2%
fineweb_q02/datafusion:vortex-file-compressed 10820711 / 9675036 / +11.8% 🔴 48809249 / 51486667 / -5.2% 0.22 / 0.19 / +18.0%
fineweb_q03/datafusion:vortex-file-compressed 21034833 / 20388922 / +3.2% 104392593 / 111389825 / -6.3% 0.20 / 0.18 / +10.1%
fineweb_q04/datafusion:vortex-file-compressed 66734244 / 66894560 / -0.2% 148197000 / 155626262 / -4.8% 0.45 / 0.43 / +4.8%
fineweb_q05/datafusion:vortex-file-compressed 68326784 / 67287887 / +1.5% 151254345 / 152079055 / -0.5% 0.45 / 0.44 / +2.1%
fineweb_q06/datafusion:vortex-file-compressed 19877116 / 19847264 / +0.2% 109698121 / 116490151 / -5.8% 0.18 / 0.17 / +6.4%
fineweb_q07/datafusion:vortex-file-compressed 17538986 / 19299052 / -9.1% 106252192 / 113666514 / -6.5% 0.17 / 0.17 / -2.8%
fineweb_q08/datafusion:vortex-file-compressed 9022207 / 9744776 / -7.4% 56108857 / 43752112 / +28.2% 🔴 0.16 / 0.22 / -27.8%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9230188 / 9292595 / -0.7% 34078169 / 33057787 / +3.1% 0.27 / 0.28 / -3.6%
fineweb_q01/datafusion:parquet 74786717 / 75533878 / -1.0% 162122018 / 162482136 / -0.2% 0.46 / 0.46 / -0.8%
fineweb_q02/datafusion:parquet 75310532 / 74510024 / +1.1% 147519650 / 158066733 / -6.7% 0.51 / 0.47 / +8.3%
fineweb_q03/datafusion:parquet 73878299 / 73238131 / +0.9% 145757528 / 163125379 / -10.6% 🟢 0.51 / 0.45 / +12.9%
fineweb_q04/datafusion:parquet 82792342 / 83379542 / -0.7% 149960107 / 168016250 / -10.7% 🟢 0.55 / 0.50 / +11.3%
fineweb_q05/datafusion:parquet 80255043 / 81423669 / -1.4% 151116586 / 161041711 / -6.2% 0.53 / 0.51 / +5.0%
fineweb_q06/datafusion:parquet 74612228 / 75519136 / -1.2% 157505873 / 161258281 / -2.3% 0.47 / 0.47 / +1.2%
fineweb_q07/datafusion:parquet 74293290 / 74365024 / -0.1% 155972421 / 166511037 / -6.3% 0.48 / 0.45 / +6.7%
fineweb_q08/datafusion:parquet 73005034 / 73101090 / -0.1% 147950917 / 166123275 / -10.9% 🟢 0.49 / 0.44 / +12.1%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1915078 / 2034918 / -5.9% 7516355 / 7774295 / -3.3% 0.25 / 0.26 / -2.7%
fineweb_q01/duckdb:vortex-file-compressed 9423394 / 9596636 / -1.8% 34977618 / 33942847 / +3.0% 0.27 / 0.28 / -4.7%
fineweb_q02/duckdb:vortex-file-compressed 10656970 / 10458682 / +1.9% 37153554 / 34163576 / +8.8% 0.29 / 0.31 / -6.3%
fineweb_q03/duckdb:vortex-file-compressed 19675034 / 19336385 / +1.8% 100338876 / 98944860 / +1.4% 0.20 / 0.20 / +0.3%
fineweb_q04/duckdb:vortex-file-compressed 68297420 / 67619570 / +1.0% 113242710 / 113012025 / +0.2% 0.60 / 0.60 / +0.8%
fineweb_q05/duckdb:vortex-file-compressed 65976632 / 66309577 / -0.5% 113030740 / 111269255 / +1.6% 0.58 / 0.60 / -2.1%
fineweb_q06/duckdb:vortex-file-compressed 19676306 / 18854534 / +4.4% 103208107 / 102534555 / +0.7% 0.19 / 0.18 / +3.7%
fineweb_q07/duckdb:vortex-file-compressed 19589093 / 18778977 / +4.3% 96386301 / 97548888 / -1.2% 0.20 / 0.19 / +5.6%
fineweb_q08/duckdb:vortex-file-compressed 5408943 / 5577597 / -3.0% 16326131 / 14519515 / +12.4% 🔴 0.33 / 0.38 / -13.8%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23163759 / 23824726 / -2.8% 27357473 / 28268239 / -3.2% 0.85 / 0.84 / +0.5%
fineweb_q01/duckdb:parquet 55053160 / 55686528 / -1.1% 81317435 / 79313801 / +2.5% 0.68 / 0.70 / -3.6%
fineweb_q02/duckdb:parquet 59079042 / 57951383 / +1.9% 80400756 / 86762354 / -7.3% 0.73 / 0.67 / +10.0%
fineweb_q03/duckdb:parquet 118281209 / 120227194 / -1.6% 181486039 / 187503899 / -3.2% 0.65 / 0.64 / +1.6%
fineweb_q04/duckdb:parquet 160587816 / 162168258 / -1.0% 217817278 / 217017263 / +0.4% 0.74 / 0.75 / -1.3%
fineweb_q05/duckdb:parquet 161201564 / 157271213 / +2.5% 213614137 / 210453098 / +1.5% 0.75 / 0.75 / +1.0%
fineweb_q06/duckdb:parquet 87062494 / 88326036 / -1.4% 149754881 / 150925538 / -0.8% 0.58 / 0.59 / -0.7%
fineweb_q07/duckdb:parquet 91178315 / 93341186 / -2.3% 144010537 / 157620991 / -8.6% 0.63 / 0.59 / +6.9%
fineweb_q08/duckdb:parquet 28741005 / 29570148 / -2.8% 30646430 / 31368235 / -2.3% 0.94 / 0.94 / -0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR f0752c6b vs base 322a04a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.5%
Engines: DataFusion Likely improvement (-11.4%, medium confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 0.943x ➖ · cold 0.993x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.885x ✅, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15671090 / 17420084 / -10.0% 🟢 42996824 / 45450818 / -5.4% 0.36 / 0.38 / -4.9%
tpch_q02/datafusion:vortex-file-compressed 16870154 / 18130969 / -7.0% 35675170 / 37520093 / -4.9% 0.47 / 0.48 / -2.1%
tpch_q03/datafusion:vortex-file-compressed 19734595 / 22087070 / -10.7% 🟢 53258914 / 51518317 / +3.4% 0.37 / 0.43 / -13.6%
tpch_q04/datafusion:vortex-file-compressed 10592802 / 12808841 / -17.3% 🟢 35624759 / 36827248 / -3.3% 0.30 / 0.35 / -14.5%
tpch_q05/datafusion:vortex-file-compressed 37020511 / 39602342 / -6.5% 68168601 / 70838035 / -3.8% 0.54 / 0.56 / -2.9%
tpch_q06/datafusion:vortex-file-compressed 6079620 / 9036318 / -32.7% 🟢 30812086 / 29632967 / +4.0% 0.20 / 0.30 / -35.3%
tpch_q07/datafusion:vortex-file-compressed 52157716 / 54774528 / -4.8% 83193107 / 80189847 / +3.7% 0.63 / 0.68 / -8.2%
tpch_q08/datafusion:vortex-file-compressed 52006733 / 53886005 / -3.5% 81622100 / 85725644 / -4.8% 0.64 / 0.63 / +1.4%
tpch_q09/datafusion:vortex-file-compressed 47080748 / 48743479 / -3.4% 80110869 / 80696960 / -0.7% 0.59 / 0.60 / -2.7%
tpch_q10/datafusion:vortex-file-compressed 17510829 / 20438403 / -14.3% 🟢 52917367 / 54409529 / -2.7% 0.33 / 0.38 / -11.9%
tpch_q11/datafusion:vortex-file-compressed 13983410 / 15583995 / -10.3% 🟢 34433447 / 35663919 / -3.5% 0.41 / 0.44 / -7.1%
tpch_q12/datafusion:vortex-file-compressed 18347272 / 24873947 / -26.2% 🟢 41796444 / 46786700 / -10.7% 🟢 0.44 / 0.53 / -17.4%
tpch_q13/datafusion:vortex-file-compressed 19917872 / 20801812 / -4.2% 39708219 / 42503231 / -6.6% 0.50 / 0.49 / +2.5%
tpch_q14/datafusion:vortex-file-compressed 14223346 / 15227497 / -6.6% 38708078 / 39678266 / -2.4% 0.37 / 0.38 / -4.3%
tpch_q15/datafusion:vortex-file-compressed 18392319 / 21005167 / -12.4% 🟢 47386001 / 47497058 / -0.2% 0.39 / 0.44 / -12.2%
tpch_q16/datafusion:vortex-file-compressed 18903815 / 18492943 / +2.2% 42566489 / 42834708 / -0.6% 0.44 / 0.43 / +2.9%
tpch_q17/datafusion:vortex-file-compressed 28216993 / 29876607 / -5.6% 58257782 / 58622011 / -0.6% 0.48 / 0.51 / -5.0%
tpch_q18/datafusion:vortex-file-compressed 36139965 / 37689903 / -4.1% 60022407 / 61695910 / -2.7% 0.60 / 0.61 / -1.4%
tpch_q19/datafusion:vortex-file-compressed 11366343 / 18573618 / -38.8% 🟢 40668310 / 42862693 / -5.1% 0.28 / 0.43 / -35.5%
tpch_q20/datafusion:vortex-file-compressed 20143167 / 22924178 / -12.1% 🟢 47516290 / 46488666 / +2.2% 0.42 / 0.49 / -14.0%
tpch_q21/datafusion:vortex-file-compressed 40316774 / 44183448 / -8.8% 70521707 / 74574178 / -5.4% 0.57 / 0.59 / -3.5%
tpch_q22/datafusion:vortex-file-compressed 10772764 / 11152015 / -3.4% 30003794 / 30255005 / -0.8% 0.36 / 0.37 / -2.6%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72081291 / 72085514 / -0.0% 91136256 / 90166953 / +1.1% 0.79 / 0.80 / -1.1%
tpch_q02/datafusion:parquet 75658394 / 76065243 / -0.5% 93787806 / 94554099 / -0.8% 0.81 / 0.80 / +0.3%
tpch_q03/datafusion:parquet 83631529 / 83991025 / -0.4% 108190868 / 106761640 / +1.3% 0.77 / 0.79 / -1.7%
tpch_q04/datafusion:parquet 40782012 / 40700578 / +0.2% 60521224 / 59647236 / +1.5% 0.67 / 0.68 / -1.2%
tpch_q05/datafusion:parquet 112936182 / 113045867 / -0.1% 142066997 / 140160382 / +1.4% 0.79 / 0.81 / -1.4%
tpch_q06/datafusion:parquet 32106937 / 32238601 / -0.4% 50473220 / 49459306 / +2.0% 0.64 / 0.65 / -2.4%
tpch_q07/datafusion:parquet 115736361 / 115023072 / +0.6% 144410997 / 141996667 / +1.7% 0.80 / 0.81 / -1.1%
tpch_q08/datafusion:parquet 119807594 / 119568905 / +0.2% 148169230 / 148288443 / -0.1% 0.81 / 0.81 / +0.3%
tpch_q09/datafusion:parquet 140090153 / 140812072 / -0.5% 167083886 / 169309287 / -1.3% 0.84 / 0.83 / +0.8%
tpch_q10/datafusion:parquet 106330309 / 106446950 / -0.1% 132161041 / 132480622 / -0.2% 0.80 / 0.80 / +0.1%
tpch_q11/datafusion:parquet 60427981 / 60345762 / +0.1% 82045109 / 79377705 / +3.4% 0.74 / 0.76 / -3.1%
tpch_q12/datafusion:parquet 65336247 / 65148780 / +0.3% 89520046 / 88590847 / +1.0% 0.73 / 0.74 / -0.8%
tpch_q13/datafusion:parquet 147918113 / 147400277 / +0.4% 168229278 / 169320711 / -0.6% 0.88 / 0.87 / +1.0%
tpch_q14/datafusion:parquet 47815237 / 47912662 / -0.2% 73172178 / 73603754 / -0.6% 0.65 / 0.65 / +0.4%
tpch_q15/datafusion:parquet 75221454 / 75089218 / +0.2% 99477659 / 98693465 / +0.8% 0.76 / 0.76 / -0.6%
tpch_q16/datafusion:parquet 44047000 / 43761331 / +0.7% 65365943 / 62897027 / +3.9% 0.67 / 0.70 / -3.1%
tpch_q17/datafusion:parquet 123983031 / 125055535 / -0.9% 149202813 / 149434460 / -0.2% 0.83 / 0.84 / -0.7%
tpch_q18/datafusion:parquet 123843928 / 124689865 / -0.7% 144546676 / 146801584 / -1.5% 0.86 / 0.85 / +0.9%
tpch_q19/datafusion:parquet 58435115 / 58648628 / -0.4% 83119423 / 86108383 / -3.5% 0.70 / 0.68 / +3.2%
tpch_q20/datafusion:parquet 79491923 / 79685131 / -0.2% 101701334 / 107344628 / -5.3% 0.78 / 0.74 / +5.3%
tpch_q21/datafusion:parquet 116698637 / 116333316 / +0.3% 141003906 / 142143675 / -0.8% 0.83 / 0.82 / +1.1%
tpch_q22/datafusion:parquet 51434849 / 52850056 / -2.7% 70176155 / 70090158 / +0.1% 0.73 / 0.75 / -2.8%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9601432 / 9097227 / +5.5% 21154823 / 18752522 / +12.8% 🔴 0.45 / 0.49 / -6.4%
tpch_q02/duckdb:vortex-file-compressed 15567018 / 15468704 / +0.6% 26146009 / 25808639 / +1.3% 0.60 / 0.60 / -0.7%
tpch_q03/duckdb:vortex-file-compressed 18228952 / 18165653 / +0.3% 33791182 / 33981111 / -0.6% 0.54 / 0.53 / +0.9%
tpch_q04/duckdb:vortex-file-compressed 12193868 / 12258033 / -0.5% 25112501 / 24737264 / +1.5% 0.49 / 0.50 / -2.0%
tpch_q05/duckdb:vortex-file-compressed 20418533 / 20411697 / +0.0% 33107763 / 32606445 / +1.5% 0.62 / 0.63 / -1.5%
tpch_q06/duckdb:vortex-file-compressed 4861309 / 4715679 / +3.1% 14689787 / 13949620 / +5.3% 0.33 / 0.34 / -2.1%
tpch_q07/duckdb:vortex-file-compressed 24000893 / 23828242 / +0.7% 37291109 / 38443062 / -3.0% 0.64 / 0.62 / +3.8%
tpch_q08/duckdb:vortex-file-compressed 21603383 / 21322745 / +1.3% 37002324 / 36311388 / +1.9% 0.58 / 0.59 / -0.6%
tpch_q09/duckdb:vortex-file-compressed 21314861 / 21217799 / +0.5% 37149866 / 36897763 / +0.7% 0.57 / 0.58 / -0.2%
tpch_q10/duckdb:vortex-file-compressed 27329168 / 27186156 / +0.5% 41742149 / 42153324 / -1.0% 0.65 / 0.64 / +1.5%
tpch_q11/duckdb:vortex-file-compressed 8322688 / 8379623 / -0.7% 17303747 / 17037829 / +1.6% 0.48 / 0.49 / -2.2%
tpch_q12/duckdb:vortex-file-compressed 14276471 / 14143590 / +0.9% 26445450 / 27899321 / -5.2% 0.54 / 0.51 / +6.5%
tpch_q13/duckdb:vortex-file-compressed 23420006 / 23441458 / -0.1% 31875641 / 32544139 / -2.1% 0.73 / 0.72 / +2.0%
tpch_q14/duckdb:vortex-file-compressed 11539143 / 11610107 / -0.6% 24167056 / 22715012 / +6.4% 0.48 / 0.51 / -6.6%
tpch_q15/duckdb:vortex-file-compressed 8628672 / 8572051 / +0.7% 19856577 / 19755064 / +0.5% 0.43 / 0.43 / +0.1%
tpch_q16/duckdb:vortex-file-compressed 16542021 / 16685948 / -0.9% 23858358 / 23639226 / +0.9% 0.69 / 0.71 / -1.8%
tpch_q17/duckdb:vortex-file-compressed 12272158 / 12212732 / +0.5% 24983396 / 27157352 / -8.0% 0.49 / 0.45 / +9.2%
tpch_q18/duckdb:vortex-file-compressed 24683193 / 23418417 / +5.4% 34475297 / 34012456 / +1.4% 0.72 / 0.69 / +4.0%
tpch_q19/duckdb:vortex-file-compressed 10819803 / 10947649 / -1.2% 23537192 / 22330958 / +5.4% 0.46 / 0.49 / -6.2%
tpch_q20/duckdb:vortex-file-compressed 14024753 / 13877249 / +1.1% 28710645 / 29055733 / -1.2% 0.49 / 0.48 / +2.3%
tpch_q21/duckdb:vortex-file-compressed 36123749 / 37324009 / -3.2% 54952796 / 54692716 / +0.5% 0.66 / 0.68 / -3.7%
tpch_q22/duckdb:vortex-file-compressed 18996981 / 19268693 / -1.4% 29265340 / 28428260 / +2.9% 0.65 / 0.68 / -4.2%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48394132 / 48310518 / +0.2% 55207921 / 55094115 / +0.2% 0.88 / 0.88 / -0.0%
tpch_q02/duckdb:parquet 48814891 / 49062231 / -0.5% 55801781 / 56216160 / -0.7% 0.87 / 0.87 / +0.2%
tpch_q03/duckdb:parquet 60443333 / 60620988 / -0.3% 69443051 / 68544787 / +1.3% 0.87 / 0.88 / -1.6%
tpch_q04/duckdb:parquet 35331123 / 35325944 / +0.0% 44457708 / 44398114 / +0.1% 0.79 / 0.80 / -0.1%
tpch_q05/duckdb:parquet 67709595 / 67967508 / -0.4% 77472237 / 78287694 / -1.0% 0.87 / 0.87 / +0.7%
tpch_q06/duckdb:parquet 21927448 / 22113561 / -0.8% 27609145 / 27948792 / -1.2% 0.79 / 0.79 / +0.4%
tpch_q07/duckdb:parquet 64485178 / 64547616 / -0.1% 74810504 / 74406095 / +0.5% 0.86 / 0.87 / -0.6%
tpch_q08/duckdb:parquet 76320193 / 76330455 / -0.0% 87274388 / 88192143 / -1.0% 0.87 / 0.87 / +1.0%
tpch_q09/duckdb:parquet 108368898 / 108340225 / +0.0% 120419442 / 120799734 / -0.3% 0.90 / 0.90 / +0.3%
tpch_q10/duckdb:parquet 106529985 / 106737234 / -0.2% 119595862 / 118157966 / +1.2% 0.89 / 0.90 / -1.4%
tpch_q11/duckdb:parquet 29932341 / 29718084 / +0.7% 35375889 / 35277468 / +0.3% 0.85 / 0.84 / +0.4%
tpch_q12/duckdb:parquet 37906072 / 38115377 / -0.5% 45132545 / 44844853 / +0.6% 0.84 / 0.85 / -1.2%
tpch_q13/duckdb:parquet 176382484 / 175704522 / +0.4% 182374161 / 183871410 / -0.8% 0.97 / 0.96 / +1.2%
tpch_q14/duckdb:parquet 42923730 / 43019170 / -0.2% 52653526 / 51988822 / +1.3% 0.82 / 0.83 / -1.5%
tpch_q15/duckdb:parquet 33073301 / 32984742 / +0.3% 41056123 / 42416737 / -3.2% 0.81 / 0.78 / +3.6%
tpch_q16/duckdb:parquet 47966815 / 47753616 / +0.4% 53200305 / 54239052 / -1.9% 0.90 / 0.88 / +2.4%
tpch_q17/duckdb:parquet 48367196 / 48247702 / +0.2% 58578464 / 58395997 / +0.3% 0.83 / 0.83 / -0.1%
tpch_q18/duckdb:parquet 74812385 / 74973657 / -0.2% 81843669 / 82312541 / -0.6% 0.91 / 0.91 / +0.4%
tpch_q19/duckdb:parquet 48469289 / 49440283 / -2.0% 59889375 / 56177745 / +6.6% 0.81 / 0.88 / -8.0%
tpch_q20/duckdb:parquet 63828553 / 63754486 / +0.1% 75377014 / 74636701 / +1.0% 0.85 / 0.85 / -0.9%
tpch_q21/duckdb:parquet 107111242 / 107274404 / -0.2% 118550325 / 117844579 / +0.6% 0.90 / 0.91 / -0.7%
tpch_q22/duckdb:parquet 50984611 / 51007045 / -0.0% 59465409 / 59390897 / +0.1% 0.86 / 0.86 / -0.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR f0752c6b vs base 891c01ab
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Engines: DataFusion No clear signal (-4.1%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.981x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.960x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 89850419 / 90421711 / -0.6% 152959592 / 141995850 / +7.7% 0.59 / 0.64 / -7.8%
tpch_q02/datafusion:vortex-file-compressed 64103321 / 67565558 / -5.1% 95661023 / 102115137 / -6.3% 0.67 / 0.66 / +1.3%
tpch_q03/datafusion:vortex-file-compressed 64140054 / 68440097 / -6.3% 119629770 / 122271488 / -2.2% 0.54 / 0.56 / -4.2%
tpch_q04/datafusion:vortex-file-compressed 34440204 / 35524846 / -3.1% 73065459 / 75006092 / -2.6% 0.47 / 0.47 / -0.5%
tpch_q05/datafusion:vortex-file-compressed 118818809 / 120274798 / -1.2% 198944554 / 176831698 / +12.5% 🔴 0.60 / 0.68 / -12.2%
tpch_q06/datafusion:vortex-file-compressed 10276242 / 11322639 / -9.2% 59717272 / 57602409 / +3.7% 0.17 / 0.20 / -12.5%
tpch_q07/datafusion:vortex-file-compressed 134391138 / 136487832 / -1.5% 204202797 / 191931606 / +6.4% 0.66 / 0.71 / -7.5%
tpch_q08/datafusion:vortex-file-compressed 143681103 / 145502958 / -1.3% 215694687 / 219290037 / -1.6% 0.67 / 0.66 / +0.4%
tpch_q09/datafusion:vortex-file-compressed 183333245 / 186216686 / -1.5% 259302845 / 260707454 / -0.5% 0.71 / 0.71 / -1.0%
tpch_q10/datafusion:vortex-file-compressed 70151334 / 74153528 / -5.4% 133195250 / 139115438 / -4.3% 0.53 / 0.53 / -1.2%
tpch_q11/datafusion:vortex-file-compressed 43547135 / 44983051 / -3.2% 68439261 / 69832693 / -2.0% 0.64 / 0.64 / -1.2%
tpch_q12/datafusion:vortex-file-compressed 34874502 / 37810196 / -7.8% 78293769 / 81617122 / -4.1% 0.45 / 0.46 / -3.8%
tpch_q13/datafusion:vortex-file-compressed 46742807 / 42599591 / +9.7% 80258480 / 82235682 / -2.4% 0.58 / 0.52 / +12.4%
tpch_q14/datafusion:vortex-file-compressed 21858807 / 23002058 / -5.0% 85702943 / 83526574 / +2.6% 0.26 / 0.28 / -7.4%
tpch_q15/datafusion:vortex-file-compressed 33377991 / 35046351 / -4.8% 90929557 / 90699552 / +0.3% 0.37 / 0.39 / -5.0%
tpch_q16/datafusion:vortex-file-compressed 37298160 / 39765561 / -6.2% 66971172 / 68874204 / -2.8% 0.56 / 0.58 / -3.5%
tpch_q17/datafusion:vortex-file-compressed 177597984 / 177083395 / +0.3% 217404967 / 226068532 / -3.8% 0.82 / 0.78 / +4.3%
tpch_q18/datafusion:vortex-file-compressed 207784309 / 207611854 / +0.1% 266461170 / 270342947 / -1.4% 0.78 / 0.77 / +1.5%
tpch_q19/datafusion:vortex-file-compressed 29774901 / 34957046 / -14.8% 🟢 84528194 / 87904686 / -3.8% 0.35 / 0.40 / -11.4%
tpch_q20/datafusion:vortex-file-compressed 60305521 / 64278020 / -6.2% 120869158 / 118379344 / +2.1% 0.50 / 0.54 / -8.1%
tpch_q21/datafusion:vortex-file-compressed 179939049 / 183023961 / -1.7% 243241877 / 242448463 / +0.3% 0.74 / 0.75 / -2.0%
tpch_q22/datafusion:vortex-file-compressed 25004317 / 27883932 / -10.3% 🟢 54050662 / 53536698 / +1.0% 0.46 / 0.52 / -11.2%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 88037238 / 88494633 / -0.5% 130934289 / 126967843 / +3.1% 0.67 / 0.70 / -3.5%
tpch_q02/datafusion:parquet 175826777 / 174703212 / +0.6% 199944857 / 199572701 / +0.2% 0.88 / 0.88 / +0.5%
tpch_q03/datafusion:parquet 137495621 / 138491651 / -0.7% 188167992 / 182443295 / +3.1% 0.73 / 0.76 / -3.7%
tpch_q04/datafusion:parquet 58824754 / 58638802 / +0.3% 95419799 / 92257905 / +3.4% 0.62 / 0.64 / -3.0%
tpch_q05/datafusion:parquet 170251180 / 169716343 / +0.3% 236078722 / 226128944 / +4.4% 0.72 / 0.75 / -3.9%
tpch_q06/datafusion:parquet 37085598 / 37146953 / -0.2% 79135852 / 74767826 / +5.8% 0.47 / 0.50 / -5.7%
tpch_q07/datafusion:parquet 219863030 / 218589370 / +0.6% 282907161 / 276920926 / +2.2% 0.78 / 0.79 / -1.5%
tpch_q08/datafusion:parquet 220889054 / 221103631 / -0.1% 296171959 / 285288401 / +3.8% 0.75 / 0.78 / -3.8%
tpch_q09/datafusion:parquet 315694009 / 314360848 / +0.4% 383403796 / 386255662 / -0.7% 0.82 / 0.81 / +1.2%
tpch_q10/datafusion:parquet 321574779 / 320847174 / +0.2% 388214788 / 387546024 / +0.2% 0.83 / 0.83 / +0.1%
tpch_q11/datafusion:parquet 126485253 / 125545638 / +0.7% 149455660 / 149739191 / -0.2% 0.85 / 0.84 / +0.9%
tpch_q12/datafusion:parquet 84236192 / 84391724 / -0.2% 120125959 / 122337849 / -1.8% 0.70 / 0.69 / +1.7%
tpch_q13/datafusion:parquet 216766382 / 216471698 / +0.1% 247754627 / 247590876 / +0.1% 0.87 / 0.87 / +0.1%
tpch_q14/datafusion:parquet 89027904 / 89038718 / -0.0% 191050200 / 181579037 / +5.2% 0.47 / 0.49 / -5.0%
tpch_q15/datafusion:parquet 106276476 / 105596593 / +0.6% 154680620 / 154616969 / +0.0% 0.69 / 0.68 / +0.6%
tpch_q16/datafusion:parquet 97273159 / 96843178 / +0.4% 124641289 / 122207496 / +2.0% 0.78 / 0.79 / -1.5%
tpch_q17/datafusion:parquet 213439259 / 213166447 / +0.1% 259056863 / 261077577 / -0.8% 0.82 / 0.82 / +0.9%
tpch_q18/datafusion:parquet 271433178 / 271036032 / +0.1% 316837510 / 323402297 / -2.0% 0.86 / 0.84 / +2.2%
tpch_q19/datafusion:parquet 108516727 / 108642656 / -0.1% 164760245 / 169584977 / -2.8% 0.66 / 0.64 / +2.8%
tpch_q20/datafusion:parquet 189045106 / 189279979 / -0.1% 253453487 / 248412590 / +2.0% 0.75 / 0.76 / -2.1%
tpch_q21/datafusion:parquet 247637646 / 247710338 / -0.0% 309670309 / 315286021 / -1.8% 0.80 / 0.79 / +1.8%
tpch_q22/datafusion:parquet 154152395 / 154424737 / -0.2% 175362488 / 179636660 / -2.4% 0.88 / 0.86 / +2.3%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32622762 / 33349857 / -2.2% 73180720 / 69341547 / +5.5% 0.45 / 0.48 / -7.3%
tpch_q02/duckdb:vortex-file-compressed 32241774 / 31869777 / +1.2% 46255321 / 45941299 / +0.7% 0.70 / 0.69 / +0.5%
tpch_q03/duckdb:vortex-file-compressed 52018246 / 52434187 / -0.8% 99277623 / 100430404 / -1.1% 0.52 / 0.52 / +0.4%
tpch_q04/duckdb:vortex-file-compressed 51552821 / 50674538 / +1.7% 88729918 / 88112285 / +0.7% 0.58 / 0.58 / +1.0%
tpch_q05/duckdb:vortex-file-compressed 69209958 / 68608520 / +0.9% 107108295 / 109044750 / -1.8% 0.65 / 0.63 / +2.7%
tpch_q06/duckdb:vortex-file-compressed 14483138 / 14693436 / -1.4% 51970790 / 51561054 / +0.8% 0.28 / 0.28 / -2.2%
tpch_q07/duckdb:vortex-file-compressed 54331317 / 53921645 / +0.8% 111098222 / 111571063 / -0.4% 0.49 / 0.48 / +1.2%
tpch_q08/duckdb:vortex-file-compressed 87299478 / 87340367 / -0.0% 130513052 / 133928383 / -2.6% 0.67 / 0.65 / +2.6%
tpch_q09/duckdb:vortex-file-compressed 97984907 / 97251243 / +0.8% 154726815 / 158394360 / -2.3% 0.63 / 0.61 / +3.1%
tpch_q10/duckdb:vortex-file-compressed 87795017 / 87844198 / -0.1% 139137558 / 139959942 / -0.6% 0.63 / 0.63 / +0.5%
tpch_q11/duckdb:vortex-file-compressed 13107263 / 13021081 / +0.7% 26119143 / 26600501 / -1.8% 0.50 / 0.49 / +2.5%
tpch_q12/duckdb:vortex-file-compressed 44303916 / 43433008 / +2.0% 83411486 / 83774672 / -0.4% 0.53 / 0.52 / +2.4%
tpch_q13/duckdb:vortex-file-compressed 67659001 / 67518710 / +0.2% 87057456 / 87769468 / -0.8% 0.78 / 0.77 / +1.0%
tpch_q14/duckdb:vortex-file-compressed 28250699 / 28238602 / +0.0% 72820060 / 72995541 / -0.2% 0.39 / 0.39 / +0.3%
tpch_q15/duckdb:vortex-file-compressed 24696658 / 24504700 / +0.8% 66078019 / 65021988 / +1.6% 0.37 / 0.38 / -0.8%
tpch_q16/duckdb:vortex-file-compressed 50062552 / 49228946 / +1.7% 59107354 / 58244066 / +1.5% 0.85 / 0.85 / +0.2%
tpch_q17/duckdb:vortex-file-compressed 34753008 / 34434502 / +0.9% 65567026 / 64234766 / +2.1% 0.53 / 0.54 / -1.1%
tpch_q18/duckdb:vortex-file-compressed 98034799 / 99599129 / -1.6% 122883857 / 119418694 / +2.9% 0.80 / 0.83 / -4.3%
tpch_q19/duckdb:vortex-file-compressed 25095500 / 25391922 / -1.2% 74680514 / 71989316 / +3.7% 0.34 / 0.35 / -4.7%
tpch_q20/duckdb:vortex-file-compressed 39100446 / 39069466 / +0.1% 90948751 / 88580862 / +2.7% 0.43 / 0.44 / -2.5%
tpch_q21/duckdb:vortex-file-compressed 95840298 / 94943370 / +0.9% 147656672 / 146034384 / +1.1% 0.65 / 0.65 / -0.2%
tpch_q22/duckdb:vortex-file-compressed 35244386 / 35603270 / -1.0% 52716501 / 52346151 / +0.7% 0.67 / 0.68 / -1.7%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68866605 / 68529089 / +0.5% 94387928 / 91721872 / +2.9% 0.73 / 0.75 / -2.3%
tpch_q02/duckdb:parquet 87722048 / 87980890 / -0.3% 99725997 / 100126172 / -0.4% 0.88 / 0.88 / +0.1%
tpch_q03/duckdb:parquet 110644487 / 111392580 / -0.7% 144122379 / 145840878 / -1.2% 0.77 / 0.76 / +0.5%
tpch_q04/duckdb:parquet 76777145 / 76780616 / -0.0% 98352865 / 102028744 / -3.6% 0.78 / 0.75 / +3.7%
tpch_q05/duckdb:parquet 123699372 / 124594550 / -0.7% 158655323 / 159040491 / -0.2% 0.78 / 0.78 / -0.5%
tpch_q06/duckdb:parquet 35960268 / 36525834 / -1.5% 63605965 / 63078816 / +0.8% 0.57 / 0.58 / -2.4%
tpch_q07/duckdb:parquet 117409944 / 118598815 / -1.0% 156063666 / 155755842 / +0.2% 0.75 / 0.76 / -1.2%
tpch_q08/duckdb:parquet 149980092 / 147958180 / +1.4% 189559120 / 190748168 / -0.6% 0.79 / 0.78 / +2.0%
tpch_q09/duckdb:parquet 238744820 / 237683966 / +0.4% 284523304 / 281635671 / +1.0% 0.84 / 0.84 / -0.6%
tpch_q10/duckdb:parquet 315513177 / 316828815 / -0.4% 341209856 / 342561582 / -0.4% 0.92 / 0.92 / -0.0%
tpch_q11/duckdb:parquet 43969144 / 43893063 / +0.2% 52245573 / 52189936 / +0.1% 0.84 / 0.84 / +0.1%
tpch_q12/duckdb:parquet 72684627 / 72208829 / +0.7% 94237128 / 93875174 / +0.4% 0.77 / 0.77 / +0.3%
tpch_q13/duckdb:parquet 293233974 / 295219035 / -0.7% 311302635 / 307736255 / +1.2% 0.94 / 0.96 / -1.8%
tpch_q14/duckdb:parquet 103347031 / 101585729 / +1.7% 139176437 / 142851362 / -2.6% 0.74 / 0.71 / +4.4%
tpch_q15/duckdb:parquet 59382335 / 57919937 / +2.5% 91082585 / 87162905 / +4.5% 0.65 / 0.66 / -1.9%
tpch_q16/duckdb:parquet 101698377 / 102552148 / -0.8% 108938234 / 109107827 / -0.2% 0.93 / 0.94 / -0.7%
tpch_q17/duckdb:parquet 82301571 / 83029054 / -0.9% 120007087 / 120991902 / -0.8% 0.69 / 0.69 / -0.1%
tpch_q18/duckdb:parquet 160753345 / 156594219 / +2.7% 174028558 / 176632529 / -1.5% 0.92 / 0.89 / +4.2%
tpch_q19/duckdb:parquet 101193039 / 98663556 / +2.6% 134816703 / 135244224 / -0.3% 0.75 / 0.73 / +2.9%
tpch_q20/duckdb:parquet 147698427 / 148052589 / -0.2% 186442978 / 187620677 / -0.6% 0.79 / 0.79 / +0.4%
tpch_q21/duckdb:parquet 259634573 / 251050714 / +3.4% 272267321 / 279389394 / -2.5% 0.95 / 0.90 / +6.1%
tpch_q22/duckdb:parquet 169182639 / 168588942 / +0.4% 184999433 / 185737392 / -0.4% 0.91 / 0.91 / +0.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR f0752c6b vs base f04a28c8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.9%
Engines: DataFusion No clear signal (-5.0%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.974x ➖ · cold 1.024x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.949x ➖, 23↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20878442 / 24501350 / -14.8% 🟢 38825936 / 42602850 / -8.9% 0.54 / 0.58 / -6.5%
tpcds_q02/datafusion:vortex-file-compressed 44703148 / 47761568 / -6.4% 63700531 / 63371649 / +0.5% 0.70 / 0.75 / -6.9%
tpcds_q03/datafusion:vortex-file-compressed 11097081 / 11838734 / -6.3% 27938768 / 26809585 / +4.2% 0.40 / 0.44 / -10.1%
tpcds_q04/datafusion:vortex-file-compressed 87941263 / 123272686 / -28.7% 🟢 119168172 / 158867336 / -25.0% 🟢 0.74 / 0.78 / -4.9%
tpcds_q05/datafusion:vortex-file-compressed 56744007 / 58864387 / -3.6% 77532273 / 80020222 / -3.1% 0.73 / 0.74 / -0.5%
tpcds_q06/datafusion:vortex-file-compressed 22341937 / 22695570 / -1.6% 42824633 / 41176092 / +4.0% 0.52 / 0.55 / -5.3%
tpcds_q07/datafusion:vortex-file-compressed 28428362 / 30632476 / -7.2% 53744855 / 53091940 / +1.2% 0.53 / 0.58 / -8.3%
tpcds_q08/datafusion:vortex-file-compressed 24359806 / 24564190 / -0.8% 44317134 / 41394978 / +7.1% 0.55 / 0.59 / -7.4%
tpcds_q09/datafusion:vortex-file-compressed 18575435 / 17403328 / +6.7% 36474807 / 32104848 / +13.6% 🔴 0.51 / 0.54 / -6.1%
tpcds_q10/datafusion:vortex-file-compressed 26659729 / 27275658 / -2.3% 48940413 / 46257296 / +5.8% 0.54 / 0.59 / -7.6%
tpcds_q11/datafusion:vortex-file-compressed 52774703 / 64237301 / -17.8% 🟢 86302464 / 91547069 / -5.7% 0.61 / 0.70 / -12.9%
tpcds_q12/datafusion:vortex-file-compressed 14941746 / 16666263 / -10.3% 🟢 34974089 / 32921544 / +6.2% 0.43 / 0.51 / -15.6%
tpcds_q13/datafusion:vortex-file-compressed 30793828 / 32640088 / -5.7% 56541044 / 54880752 / +3.0% 0.54 / 0.59 / -8.4%
tpcds_q14/datafusion:vortex-file-compressed 488982616 / 496716390 / -1.6% 543539826 / 549199113 / -1.0% 0.90 / 0.90 / -0.5%
tpcds_q15/datafusion:vortex-file-compressed 12096944 / 15608418 / -22.5% 🟢 35040848 / 34389203 / +1.9% 0.35 / 0.45 / -23.9%
tpcds_q16/datafusion:vortex-file-compressed 18554534 / 19737104 / -6.0% 37225689 / 37155401 / +0.2% 0.50 / 0.53 / -6.2%
tpcds_q17/datafusion:vortex-file-compressed 55053441 / 58910702 / -6.5% 81994108 / 82878526 / -1.1% 0.67 / 0.71 / -5.5%
tpcds_q18/datafusion:vortex-file-compressed 63544560 / 68344634 / -7.0% 87756258 / 91672040 / -4.3% 0.72 / 0.75 / -2.9%
tpcds_q19/datafusion:vortex-file-compressed 17231935 / 17024424 / +1.2% 39090177 / 37491480 / +4.3% 0.44 / 0.45 / -2.9%
tpcds_q20/datafusion:vortex-file-compressed 16399138 / 17987758 / -8.8% 38155755 / 35594009 / +7.2% 0.43 / 0.51 / -15.0%
tpcds_q21/datafusion:vortex-file-compressed 15778478 / 16413266 / -3.9% 39818253 / 37909666 / +5.0% 0.40 / 0.43 / -8.5%
tpcds_q22/datafusion:vortex-file-compressed 49701410 / 57099952 / -13.0% 🟢 73863193 / 79200135 / -6.7% 0.67 / 0.72 / -6.7%
tpcds_q23/datafusion:vortex-file-compressed 71284802 / 71028847 / +0.4% 97802739 / 95792384 / +2.1% 0.73 / 0.74 / -1.7%
tpcds_q24/datafusion:vortex-file-compressed 65144194 / 68263959 / -4.6% 87538785 / 87446586 / +0.1% 0.74 / 0.78 / -4.7%
tpcds_q25/datafusion:vortex-file-compressed 48282827 / 50246102 / -3.9% 70374449 / 71067864 / -1.0% 0.69 / 0.71 / -3.0%
tpcds_q26/datafusion:vortex-file-compressed 25811687 / 29832526 / -13.5% 🟢 48520376 / 51007324 / -4.9% 0.53 / 0.58 / -9.0%
tpcds_q27/datafusion:vortex-file-compressed 55843083 / 61072522 / -8.6% 85313214 / 80997207 / +5.3% 0.65 / 0.75 / -13.2%
tpcds_q28/datafusion:vortex-file-compressed 25256305 / 19032271 / +32.7% 🔴 40435036 / 34669323 / +16.6% 🔴 0.62 / 0.55 / +13.8%
tpcds_q29/datafusion:vortex-file-compressed 45960410 / 59062112 / -22.2% 🟢 76671423 / 79949736 / -4.1% 0.60 / 0.74 / -18.9%
tpcds_q30/datafusion:vortex-file-compressed 26002932 / 26881251 / -3.3% 44669164 / 43936745 / +1.7% 0.58 / 0.61 / -4.9%
tpcds_q31/datafusion:vortex-file-compressed 57756339 / 58896074 / -1.9% 84312108 / 82543059 / +2.1% 0.69 / 0.71 / -4.0%
tpcds_q32/datafusion:vortex-file-compressed 12516630 / 13933882 / -10.2% 🟢 30242348 / 29583685 / +2.2% 0.41 / 0.47 / -12.1%
tpcds_q33/datafusion:vortex-file-compressed 27474596 / 27168522 / +1.1% 49994079 / 47447371 / +5.4% 0.55 / 0.57 / -4.0%
tpcds_q34/datafusion:vortex-file-compressed 17466202 / 17311541 / +0.9% 38365792 / 34258870 / +12.0% 🔴 0.46 / 0.51 / -9.9%
tpcds_q35/datafusion:vortex-file-compressed 30250814 / 34696750 / -12.8% 🟢 55587166 / 56369878 / -1.4% 0.54 / 0.62 / -11.6%
tpcds_q36/datafusion:vortex-file-compressed 47942094 / 46832354 / +2.4% 70658020 / 70204167 / +0.6% 0.68 / 0.67 / +1.7%
tpcds_q37/datafusion:vortex-file-compressed 11670698 / 13469552 / -13.4% 🟢 34291748 / 33970937 / +0.9% 0.34 / 0.40 / -14.2%
tpcds_q38/datafusion:vortex-file-compressed 25991940 / 29743390 / -12.6% 🟢 47634672 / 49143904 / -3.1% 0.55 / 0.61 / -9.8%
tpcds_q39/datafusion:vortex-file-compressed 64460932 / 61133982 / +5.4% 91599938 / 85922228 / +6.6% 0.70 / 0.71 / -1.1%
tpcds_q40/datafusion:vortex-file-compressed 23617934 / 24267302 / -2.7% 45419653 / 43551474 / +4.3% 0.52 / 0.56 / -6.7%
tpcds_q41/datafusion:vortex-file-compressed 20548582 / 20097675 / +2.2% 34754202 / 33935690 / +2.4% 0.59 / 0.59 / -0.2%
tpcds_q42/datafusion:vortex-file-compressed 10716366 / 11110042 / -3.5% 26703937 / 26159743 / +2.1% 0.40 / 0.42 / -5.5%
tpcds_q43/datafusion:vortex-file-compressed 12700792 / 12680616 / +0.2% 31891510 / 28448241 / +12.1% 🔴 0.40 / 0.45 / -10.7%
tpcds_q44/datafusion:vortex-file-compressed 29035486 / 25720180 / +12.9% 🔴 52856133 / 45820876 / +15.4% 🔴 0.55 / 0.56 / -2.1%
tpcds_q45/datafusion:vortex-file-compressed 15940836 / 18128532 / -12.1% 🟢 37670486 / 35798008 / +5.2% 0.42 / 0.51 / -16.4%
tpcds_q46/datafusion:vortex-file-compressed 23470312 / 22890114 / +2.5% 50384989 / 45837042 / +9.9% 0.47 / 0.50 / -6.7%
tpcds_q47/datafusion:vortex-file-compressed 75427504 / 78962849 / -4.5% 104839048 / 103683347 / +1.1% 0.72 / 0.76 / -5.5%
tpcds_q48/datafusion:vortex-file-compressed 28866454 / 31059264 / -7.1% 51898021 / 49759287 / +4.3% 0.56 / 0.62 / -10.9%
tpcds_q49/datafusion:vortex-file-compressed 59113470 / 56789549 / +4.1% 83007976 / 79671716 / +4.2% 0.71 / 0.71 / -0.1%
tpcds_q50/datafusion:vortex-file-compressed 30470312 / 32625994 / -6.6% 52870455 / 52096427 / +1.5% 0.58 / 0.63 / -8.0%
tpcds_q51/datafusion:vortex-file-compressed 66739792 / 66874912 / -0.2% 87739372 / 89083198 / -1.5% 0.76 / 0.75 / +1.3%
tpcds_q52/datafusion:vortex-file-compressed 11247344 / 11741288 / -4.2% 28975668 / 26924330 / +7.6% 0.39 / 0.44 / -11.0%
tpcds_q53/datafusion:vortex-file-compressed 17949580 / 17578090 / +2.1% 38155524 / 37284901 / +2.3% 0.47 / 0.47 / -0.2%
tpcds_q54/datafusion:vortex-file-compressed 30933980 / 32793493 / -5.7% 54424566 / 53746805 / +1.3% 0.57 / 0.61 / -6.8%
tpcds_q55/datafusion:vortex-file-compressed 10870628 / 11339902 / -4.1% 26998631 / 26234871 / +2.9% 0.40 / 0.43 / -6.9%
tpcds_q56/datafusion:vortex-file-compressed 26382336 / 26576710 / -0.7% 50791970 / 48153327 / +5.5% 0.52 / 0.55 / -5.9%
tpcds_q57/datafusion:vortex-file-compressed 62543662 / 78693360 / -20.5% 🟢 89700832 / 101568787 / -11.7% 🟢 0.70 / 0.77 / -10.0%
tpcds_q58/datafusion:vortex-file-compressed 38007967 / 40549088 / -6.3% 62225487 / 63993424 / -2.8% 0.61 / 0.63 / -3.6%
tpcds_q59/datafusion:vortex-file-compressed 29705306 / 30862199 / -3.7% 54758417 / 51529824 / +6.3% 0.54 / 0.60 / -9.4%
tpcds_q60/datafusion:vortex-file-compressed 26288958 / 26441172 / -0.6% 47551005 / 46438421 / +2.4% 0.55 / 0.57 / -2.9%
tpcds_q61/datafusion:vortex-file-compressed 21315298 / 22742517 / -6.3% 44332985 / 44644312 / -0.7% 0.48 / 0.51 / -5.6%
tpcds_q62/datafusion:vortex-file-compressed 16203159 / 18071968 / -10.3% 🟢 34501995 / 33885305 / +1.8% 0.47 / 0.53 / -11.9%
tpcds_q63/datafusion:vortex-file-compressed 17513579 / 17830714 / -1.8% 39438581 / 36081084 / +9.3% 0.44 / 0.49 / -10.1%
tpcds_q64/datafusion:vortex-file-compressed 211707869 / 224132483 / -5.5% 250614529 / 257814432 / -2.8% 0.84 / 0.87 / -2.8%
tpcds_q65/datafusion:vortex-file-compressed 73200517 / 75086035 / -2.5% 95845262 / 94501428 / +1.4% 0.76 / 0.79 / -3.9%
tpcds_q66/datafusion:vortex-file-compressed 50986991 / 52553018 / -3.0% 73227606 / 72212949 / +1.4% 0.70 / 0.73 / -4.3%
tpcds_q67/datafusion:vortex-file-compressed 51810614 / 58626837 / -11.6% 🟢 83466606 / 86820979 / -3.9% 0.62 / 0.68 / -8.1%
tpcds_q68/datafusion:vortex-file-compressed 23302634 / 23209446 / +0.4% 48064801 / 44782467 / +7.3% 0.48 / 0.52 / -6.5%
tpcds_q69/datafusion:vortex-file-compressed 25038204 / 27928652 / -10.3% 🟢 48235482 / 46696624 / +3.3% 0.52 / 0.60 / -13.2%
tpcds_q70/datafusion:vortex-file-compressed 71869320 / 70295474 / +2.2% 92610658 / 87632212 / +5.7% 0.78 / 0.80 / -3.3%
tpcds_q71/datafusion:vortex-file-compressed 18494710 / 17902779 / +3.3% 38737205 / 36459817 / +6.2% 0.48 / 0.49 / -2.8%
tpcds_q72/datafusion:vortex-file-compressed 370041710 / 355829341 / +4.0% 380335599 / 385011040 / -1.2% 0.97 / 0.92 / +5.3%
tpcds_q73/datafusion:vortex-file-compressed 16084640 / 16393330 / -1.9% 37550297 / 35206115 / +6.7% 0.43 / 0.47 / -8.0%
tpcds_q74/datafusion:vortex-file-compressed 40042288 / 45268125 / -11.5% 🟢 68311355 / 72067127 / -5.2% 0.59 / 0.63 / -6.7%
tpcds_q75/datafusion:vortex-file-compressed 135801863 / 138627042 / -2.0% 155248840 / 163781998 / -5.2% 0.87 / 0.85 / +3.3%
tpcds_q76/datafusion:vortex-file-compressed 30003104 / 26685874 / +12.4% 🔴 52216850 / 43605585 / +19.7% 🔴 0.57 / 0.61 / -6.1%
tpcds_q77/datafusion:vortex-file-compressed 44752360 / 45173579 / -0.9% 67342367 / 66878449 / +0.7% 0.66 / 0.68 / -1.6%
tpcds_q78/datafusion:vortex-file-compressed 64129350 / 68957569 / -7.0% 91384835 / 96844551 / -5.6% 0.70 / 0.71 / -1.4%
tpcds_q79/datafusion:vortex-file-compressed 19943484 / 19547150 / +2.0% 43967361 / 41657290 / +5.5% 0.45 / 0.47 / -3.3%
tpcds_q80/datafusion:vortex-file-compressed 73312123 / 74183590 / -1.2% 104187396 / 103470391 / +0.7% 0.70 / 0.72 / -1.9%
tpcds_q81/datafusion:vortex-file-compressed 26348784 / 26946390 / -2.2% 45578193 / 43467494 / +4.9% 0.58 / 0.62 / -6.7%
tpcds_q82/datafusion:vortex-file-compressed 12333486 / 12067322 / +2.2% 32991651 / 33347197 / -1.1% 0.37 / 0.36 / +3.3%
tpcds_q83/datafusion:vortex-file-compressed 32756026 / 35471316 / -7.7% 50766317 / 52892624 / -4.0% 0.65 / 0.67 / -3.8%
tpcds_q84/datafusion:vortex-file-compressed 9917180 / 11913716 / -16.8% 🟢 26681169 / 26398589 / +1.1% 0.37 / 0.45 / -17.6%
tpcds_q85/datafusion:vortex-file-compressed 53139338 / 58493567 / -9.2% 81226336 / 84224297 / -3.6% 0.65 / 0.69 / -5.8%
tpcds_q86/datafusion:vortex-file-compressed 15754758 / 16393360 / -3.9% 34399056 / 32713829 / +5.2% 0.46 / 0.50 / -8.6%
tpcds_q87/datafusion:vortex-file-compressed 25523463 / 29568035 / -13.7% 🟢 48629763 / 48923298 / -0.6% 0.52 / 0.60 / -13.2%
tpcds_q88/datafusion:vortex-file-compressed 31359180 / 31828894 / -1.5% 51803474 / 60386875 / -14.2% 🟢 0.61 / 0.53 / +14.8%
tpcds_q89/datafusion:vortex-file-compressed 20876043 / 20547964 / +1.6% 43035454 / 39315902 / +9.5% 0.49 / 0.52 / -7.2%
tpcds_q90/datafusion:vortex-file-compressed 10037585 / 10471528 / -4.1% 25962734 / 25230867 / +2.9% 0.39 / 0.42 / -6.8%
tpcds_q91/datafusion:vortex-file-compressed 17010454 / 16338107 / +4.1% 36090244 / 34206610 / +5.5% 0.47 / 0.48 / -1.3%
tpcds_q92/datafusion:vortex-file-compressed 12815371 / 13568701 / -5.6% 29057771 / 29048169 / +0.0% 0.44 / 0.47 / -5.6%
tpcds_q93/datafusion:vortex-file-compressed 20502652 / 21920392 / -6.5% 40797051 / 40764313 / +0.1% 0.50 / 0.54 / -6.5%
tpcds_q94/datafusion:vortex-file-compressed 18389117 / 18959579 / -3.0% 36467844 / 35312793 / +3.3% 0.50 / 0.54 / -6.1%
tpcds_q95/datafusion:vortex-file-compressed 42133610 / 44569196 / -5.5% 62437916 / 62760386 / -0.5% 0.67 / 0.71 / -5.0%
tpcds_q96/datafusion:vortex-file-compressed 7374361 / 8298650 / -11.1% 🟢 24927566 / 23216046 / +7.4% 0.30 / 0.36 / -17.2%
tpcds_q97/datafusion:vortex-file-compressed 17482202 / 21117579 / -17.2% 🟢 36782346 / 40244682 / -8.6% 0.48 / 0.52 / -9.4%
tpcds_q98/datafusion:vortex-file-compressed 16297132 / 16934314 / -3.8% 38174492 / 37229434 / +2.5% 0.43 / 0.45 / -6.1%
tpcds_q99/datafusion:vortex-file-compressed 15932969 / 20948781 / -23.9% 🟢 34565411 / 36554502 / -5.4% 0.46 / 0.57 / -19.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43651461 / 43487942 / +0.4% 60901473 / 59123860 / +3.0% 0.72 / 0.74 / -2.6%
tpcds_q02/datafusion:parquet 55637417 / 55412791 / +0.4% 71349748 / 70816357 / +0.8% 0.78 / 0.78 / -0.3%
tpcds_q03/datafusion:parquet 18901020 / 19149515 / -1.3% 32144626 / 32302687 / -0.5% 0.59 / 0.59 / -0.8%
tpcds_q04/datafusion:parquet 181115922 / 181155620 / -0.0% 207923913 / 208050079 / -0.1% 0.87 / 0.87 / +0.0%
tpcds_q05/datafusion:parquet 68796050 / 68352212 / +0.6% 89520796 / 89134491 / +0.4% 0.77 / 0.77 / +0.2%
tpcds_q06/datafusion:parquet 33387597 / 33644028 / -0.8% 46754958 / 45099148 / +3.7% 0.71 / 0.75 / -4.3%
tpcds_q07/datafusion:parquet 47295426 / 46641076 / +1.4% 66467203 / 65180563 / +2.0% 0.71 / 0.72 / -0.6%
tpcds_q08/datafusion:parquet 31157359 / 31517254 / -1.1% 45480982 / 49344212 / -7.8% 0.69 / 0.64 / +7.3%
tpcds_q09/datafusion:parquet 33061502 / 33439881 / -1.1% 43616933 / 35879132 / +21.6% 🔴 0.76 / 0.93 / -18.7%
tpcds_q10/datafusion:parquet 44441216 / 45110282 / -1.5% 56570255 / 60468947 / -6.4% 0.79 / 0.75 / +5.3%
tpcds_q11/datafusion:parquet 97228388 / 98449261 / -1.2% 121663438 / 118403923 / +2.8% 0.80 / 0.83 / -3.9%
tpcds_q12/datafusion:parquet 23551144 / 24088814 / -2.2% 35805212 / 37330651 / -4.1% 0.66 / 0.65 / +1.9%
tpcds_q13/datafusion:parquet 47078048 / 46787060 / +0.6% 69126900 / 66936428 / +3.3% 0.68 / 0.70 / -2.6%
tpcds_q14/datafusion:parquet 537329706 / 538007598 / -0.1% 590090262 / 588995480 / +0.2% 0.91 / 0.91 / -0.3%
tpcds_q15/datafusion:parquet 23619889 / 23641746 / -0.1% 38965510 / 37923506 / +2.7% 0.61 / 0.62 / -2.8%
tpcds_q16/datafusion:parquet 37302922 / 37385306 / -0.2% 52046707 / 50285047 / +3.5% 0.72 / 0.74 / -3.6%
tpcds_q17/datafusion:parquet 73034114 / 76755658 / -4.8% 98029535 / 96269706 / +1.8% 0.75 / 0.80 / -6.6%
tpcds_q18/datafusion:parquet 68576335 / 65011064 / +5.5% 94111108 / 90823900 / +3.6% 0.73 / 0.72 / +1.8%
tpcds_q19/datafusion:parquet 29681060 / 29583560 / +0.3% 44639770 / 42587171 / +4.8% 0.66 / 0.69 / -4.3%
tpcds_q20/datafusion:parquet 25725025 / 25582244 / +0.6% 38243693 / 37572989 / +1.8% 0.67 / 0.68 / -1.2%
tpcds_q21/datafusion:parquet 20141460 / 20175820 / -0.2% 32869876 / 31882717 / +3.1% 0.61 / 0.63 / -3.2%
tpcds_q22/datafusion:parquet 77099194 / 77210375 / -0.1% 89046930 / 88932427 / +0.1% 0.87 / 0.87 / -0.3%
tpcds_q23/datafusion:parquet 92827084 / 93503042 / -0.7% 116805040 / 114014382 / +2.4% 0.79 / 0.82 / -3.1%
tpcds_q24/datafusion:parquet 91762157 / 92735444 / -1.0% 116874527 / 115089541 / +1.6% 0.79 / 0.81 / -2.6%
tpcds_q25/datafusion:parquet 79491602 / 79632148 / -0.2% 103628606 / 103259436 / +0.4% 0.77 / 0.77 / -0.5%
tpcds_q26/datafusion:parquet 43708492 / 42766329 / +2.2% 60849898 / 61283769 / -0.7% 0.72 / 0.70 / +2.9%
tpcds_q27/datafusion:parquet 74610690 / 77894436 / -4.2% 100673250 / 98030236 / +2.7% 0.74 / 0.79 / -6.7%
tpcds_q28/datafusion:parquet 28878092 / 29042218 / -0.6% 42747325 / 43224918 / -1.1% 0.68 / 0.67 / +0.5%
tpcds_q29/datafusion:parquet 77402738 / 76591974 / +1.1% 99274141 / 96377635 / +3.0% 0.78 / 0.79 / -1.9%
tpcds_q30/datafusion:parquet 43916770 / 45939784 / -4.4% 62712975 / 58773025 / +6.7% 0.70 / 0.78 / -10.4%
tpcds_q31/datafusion:parquet 79981799 / 81494052 / -1.9% 101788978 / 98368620 / +3.5% 0.79 / 0.83 / -5.2%
tpcds_q32/datafusion:parquet 26618538 / 26694684 / -0.3% 40804756 / 40087332 / +1.8% 0.65 / 0.67 / -2.0%
tpcds_q33/datafusion:parquet 36749973 / 38755488 / -5.2% 55359710 / 55991458 / -1.1% 0.66 / 0.69 / -4.1%
tpcds_q34/datafusion:parquet 24817955 / 25078757 / -1.0% 36871612 / 36556192 / +0.9% 0.67 / 0.69 / -1.9%
tpcds_q35/datafusion:parquet 50188902 / 50697138 / -1.0% 65793901 / 62939472 / +4.5% 0.76 / 0.81 / -5.3%
tpcds_q36/datafusion:parquet 51616594 / 51430110 / +0.4% 71786548 / 72297039 / -0.7% 0.72 / 0.71 / +1.1%
tpcds_q37/datafusion:parquet 21150203 / 21427465 / -1.3% 35361016 / 34087238 / +3.7% 0.60 / 0.63 / -4.8%
tpcds_q38/datafusion:parquet 45255938 / 44659992 / +1.3% 60843187 / 61249426 / -0.7% 0.74 / 0.73 / +2.0%
tpcds_q39/datafusion:parquet 68096066 / 68150364 / -0.1% 86675012 / 85889928 / +0.9% 0.79 / 0.79 / -1.0%
tpcds_q40/datafusion:parquet 31770668 / 31947377 / -0.6% 51011909 / 51105271 / -0.2% 0.62 / 0.63 / -0.4%
tpcds_q41/datafusion:parquet 19609152 / 19685674 / -0.4% 31990631 / 32535659 / -1.7% 0.61 / 0.61 / +1.3%
tpcds_q42/datafusion:parquet 18324676 / 18265964 / +0.3% 31239355 / 29448123 / +6.1% 0.59 / 0.62 / -5.4%
tpcds_q43/datafusion:parquet 19263310 / 19628400 / -1.9% 32166344 / 31969918 / +0.6% 0.60 / 0.61 / -2.5%
tpcds_q44/datafusion:parquet 34376120 / 34090011 / +0.8% 49563547 / 49120455 / +0.9% 0.69 / 0.69 / -0.1%
tpcds_q45/datafusion:parquet 27349712 / 27780710 / -1.6% 42233108 / 40563216 / +4.1% 0.65 / 0.68 / -5.4%
tpcds_q46/datafusion:parquet 29495740 / 29335306 / +0.5% 46260911 / 45914982 / +0.8% 0.64 / 0.64 / -0.2%
tpcds_q47/datafusion:parquet 98787150 / 98397610 / +0.4% 117489061 / 120654855 / -2.6% 0.84 / 0.82 / +3.1%
tpcds_q48/datafusion:parquet 42320682 / 41306060 / +2.5% 59527609 / 56308427 / +5.7% 0.71 / 0.73 / -3.1%
tpcds_q49/datafusion:parquet 70640981 / 70129166 / +0.7% 94279218 / 90964956 / +3.6% 0.75 / 0.77 / -2.8%
tpcds_q50/datafusion:parquet 48293219 / 48193346 / +0.2% 67428293 / 69991764 / -3.7% 0.72 / 0.69 / +4.0%
tpcds_q51/datafusion:parquet 75640426 / 75858512 / -0.3% 95715189 / 94296712 / +1.5% 0.79 / 0.80 / -1.8%
tpcds_q52/datafusion:parquet 18733230 / 18469272 / +1.4% 34196404 / 32946590 / +3.8% 0.55 / 0.56 / -2.3%
tpcds_q53/datafusion:parquet 22446537 / 23120657 / -2.9% 40413757 / 38899157 / +3.9% 0.56 / 0.59 / -6.6%
tpcds_q54/datafusion:parquet 52413708 / 52528361 / -0.2% 68362565 / 67210235 / +1.7% 0.77 / 0.78 / -1.9%
tpcds_q55/datafusion:parquet 18234456 / 18262902 / -0.2% 29812308 / 29228379 / +2.0% 0.61 / 0.62 / -2.1%
tpcds_q56/datafusion:parquet 40763800 / 39692957 / +2.7% 55573929 / 55826426 / -0.5% 0.73 / 0.71 / +3.2%
tpcds_q57/datafusion:parquet 102189489 / 102960637 / -0.7% 123517937 / 119224275 / +3.6% 0.83 / 0.86 / -4.2%
tpcds_q58/datafusion:parquet 66132736 / 65772064 / +0.5% 83228978 / 82035303 / +1.5% 0.79 / 0.80 / -0.9%
tpcds_q59/datafusion:parquet 48299508 / 47661142 / +1.3% 63621028 / 65957735 / -3.5% 0.76 / 0.72 / +5.1%
tpcds_q60/datafusion:parquet 40825820 / 40066302 / +1.9% 55798906 / 52364105 / +6.6% 0.73 / 0.77 / -4.4%
tpcds_q61/datafusion:parquet 37805492 / 36857068 / +2.6% 53061392 / 51267659 / +3.5% 0.71 / 0.72 / -0.9%
tpcds_q62/datafusion:parquet 24980696 / 25455594 / -1.9% 38132503 / 38132116 / +0.0% 0.66 / 0.67 / -1.9%
tpcds_q63/datafusion:parquet 22341831 / 22217393 / +0.6% 39020083 / 38845896 / +0.4% 0.57 / 0.57 / +0.1%
tpcds_q64/datafusion:parquet 289056984 / 288544575 / +0.2% 328791692 / 326012473 / +0.9% 0.88 / 0.89 / -0.7%
tpcds_q65/datafusion:parquet 123376640 / 120283541 / +2.6% 137301185 / 139942160 / -1.9% 0.90 / 0.86 / +4.5%
tpcds_q66/datafusion:parquet 61029714 / 61323768 / -0.5% 79169084 / 74153011 / +6.8% 0.77 / 0.83 / -6.8%
tpcds_q67/datafusion:parquet 68554584 / 68600049 / -0.1% 92747819 / 91141180 / +1.8% 0.74 / 0.75 / -1.8%
tpcds_q68/datafusion:parquet 29700304 / 29776515 / -0.3% 49102521 / 48873014 / +0.5% 0.60 / 0.61 / -0.7%
tpcds_q69/datafusion:parquet 44193978 / 43041267 / +2.7% 59225641 / 58911545 / +0.5% 0.75 / 0.73 / +2.1%
tpcds_q70/datafusion:parquet 81031472 / 80439724 / +0.7% 97663003 / 99383421 / -1.7% 0.83 / 0.81 / +2.5%
tpcds_q71/datafusion:parquet 25977562 / 25720200 / +1.0% 41337231 / 37536866 / +10.1% 🔴 0.63 / 0.69 / -8.3%
tpcds_q72/datafusion:parquet 519155455 / 523311768 / -0.8% 545951210 / 553746172 / -1.4% 0.95 / 0.95 / +0.6%
tpcds_q73/datafusion:parquet 24387079 / 24053488 / +1.4% 36741662 / 35764837 / +2.7% 0.66 / 0.67 / -1.3%
tpcds_q74/datafusion:parquet 71044170 / 70618414 / +0.6% 90251030 / 88497613 / +2.0% 0.79 / 0.80 / -1.4%
tpcds_q75/datafusion:parquet 151851381 / 153307483 / -0.9% 180081873 / 179856897 / +0.1% 0.84 / 0.85 / -1.1%
tpcds_q76/datafusion:parquet 33448937 / 33274905 / +0.5% 47146273 / 46992304 / +0.3% 0.71 / 0.71 / +0.2%
tpcds_q77/datafusion:parquet 57331324 / 57433339 / -0.2% 76171705 / 79281419 / -3.9% 0.75 / 0.72 / +3.9%
tpcds_q78/datafusion:parquet 84971102 / 87637518 / -3.0% 121263892 / 118033537 / +2.7% 0.70 / 0.74 / -5.6%
tpcds_q79/datafusion:parquet 27476349 / 27649268 / -0.6% 43758302 / 41767192 / +4.8% 0.63 / 0.66 / -5.1%
tpcds_q80/datafusion:parquet 82020349 / 80552549 / +1.8% 112075521 / 112013615 / +0.1% 0.73 / 0.72 / +1.8%
tpcds_q81/datafusion:parquet 39672950 / 38943070 / +1.9% 54662297 / 51915840 / +5.3% 0.73 / 0.75 / -3.2%
tpcds_q82/datafusion:parquet 22290822 / 22594954 / -1.3% 35851241 / 35780847 / +0.2% 0.62 / 0.63 / -1.5%
tpcds_q83/datafusion:parquet 58648276 / 58888684 / -0.4% 75516283 / 72409363 / +4.3% 0.78 / 0.81 / -4.5%
tpcds_q84/datafusion:parquet 26467464 / 26166645 / +1.1% 42369034 / 41437452 / +2.2% 0.62 / 0.63 / -1.1%
tpcds_q85/datafusion:parquet 81175413 / 81013904 / +0.2% 104893894 / 105699304 / -0.8% 0.77 / 0.77 / +1.0%
tpcds_q86/datafusion:parquet 20986518 / 20595086 / +1.9% 33338318 / 33272069 / +0.2% 0.63 / 0.62 / +1.7%
tpcds_q87/datafusion:parquet 44595492 / 46165638 / -3.4% 63157385 / 59762604 / +5.7% 0.71 / 0.77 / -8.6%
tpcds_q88/datafusion:parquet 37088579 / 37393812 / -0.8% 51184722 / 52576902 / -2.6% 0.72 / 0.71 / +1.9%
tpcds_q89/datafusion:parquet 25683682 / 25785624 / -0.4% 42050358 / 41578614 / +1.1% 0.61 / 0.62 / -1.5%
tpcds_q90/datafusion:parquet 14779852 / 15251788 / -3.1% 26370748 / 27949267 / -5.6% 0.56 / 0.55 / +2.7%
tpcds_q91/datafusion:parquet 32568146 / 31807367 / +2.4% 48541228 / 46331576 / +4.8% 0.67 / 0.69 / -2.3%
tpcds_q92/datafusion:parquet 26997640 / 27050445 / -0.2% 43115189 / 40975991 / +5.2% 0.63 / 0.66 / -5.1%
tpcds_q93/datafusion:parquet 27835451 / 27273018 / +2.1% 47306569 / 46807664 / +1.1% 0.59 / 0.58 / +1.0%
tpcds_q94/datafusion:parquet 35751715 / 35251646 / +1.4% 48926155 / 49399777 / -1.0% 0.73 / 0.71 / +2.4%
tpcds_q95/datafusion:parquet 65599510 / 64541164 / +1.6% 77222668 / 78731688 / -1.9% 0.85 / 0.82 / +3.6%
tpcds_q96/datafusion:parquet 12598097 / 12346841 / +2.0% 23782406 / 23962214 / -0.8% 0.53 / 0.52 / +2.8%
tpcds_q97/datafusion:parquet 35860240 / 35922825 / -0.2% 50994727 / 51300230 / -0.6% 0.70 / 0.70 / +0.4%
tpcds_q98/datafusion:parquet 25175252 / 24875887 / +1.2% 39502743 / 37754626 / +4.6% 0.64 / 0.66 / -3.3%
tpcds_q99/datafusion:parquet 29855823 / 29827236 / +0.1% 43330173 / 42823931 / +1.2% 0.69 / 0.70 / -1.1%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15598972 / 15600044 / -0.0% 24534451 / 23806835 / +3.1% 0.64 / 0.66 / -3.0%
tpcds_q02/duckdb:vortex-file-compressed 15410307 / 15671566 / -1.7% 23507462 / 22424054 / +4.8% 0.66 / 0.70 / -6.2%
tpcds_q03/duckdb:vortex-file-compressed 6993051 / 7183056 / -2.6% 16131718 / 15641362 / +3.1% 0.43 / 0.46 / -5.6%
tpcds_q04/duckdb:vortex-file-compressed 45717812 / 45492669 / +0.5% 56262206 / 54810037 / +2.6% 0.81 / 0.83 / -2.1%
tpcds_q05/duckdb:vortex-file-compressed 23320793 / 23110810 / +0.9% 31417267 / 30080527 / +4.4% 0.74 / 0.77 / -3.4%
tpcds_q06/duckdb:vortex-file-compressed 23791782 / 23882775 / -0.4% 37476889 / 36693687 / +2.1% 0.63 / 0.65 / -2.5%
tpcds_q07/duckdb:vortex-file-compressed 13432361 / 13538712 / -0.8% 24169314 / 23549055 / +2.6% 0.56 / 0.57 / -3.3%
tpcds_q08/duckdb:vortex-file-compressed 17548422 / 17253680 / +1.7% 25663523 / 24479969 / +4.8% 0.68 / 0.70 / -3.0%
tpcds_q09/duckdb:vortex-file-compressed 18385616 / 18878368 / -2.6% 28124292 / 26995077 / +4.2% 0.65 / 0.70 / -6.5%
tpcds_q10/duckdb:vortex-file-compressed 26800615 / 26764116 / +0.1% 40600478 / 40198310 / +1.0% 0.66 / 0.67 / -0.9%
tpcds_q11/duckdb:vortex-file-compressed 36537319 / 36396022 / +0.4% 44815190 / 44391672 / +1.0% 0.82 / 0.82 / -0.6%
tpcds_q12/duckdb:vortex-file-compressed 10028853 / 10048138 / -0.2% 17695710 / 16680987 / +6.1% 0.57 / 0.60 / -5.9%
tpcds_q13/duckdb:vortex-file-compressed 20557008 / 20647696 / -0.4% 34876331 / 32065974 / +8.8% 0.59 / 0.64 / -8.5%
tpcds_q14/duckdb:vortex-file-compressed 55876234 / 55423977 / +0.8% 66671051 / 65469495 / +1.8% 0.84 / 0.85 / -1.0%
tpcds_q15/duckdb:vortex-file-compressed 10959828 / 10906448 / +0.5% 18211089 / 17156503 / +6.1% 0.60 / 0.64 / -5.3%
tpcds_q16/duckdb:vortex-file-compressed 24223808 / 23979476 / +1.0% 35187827 / 35074882 / +0.3% 0.69 / 0.68 / +0.7%
tpcds_q17/duckdb:vortex-file-compressed 25306254 / 25726228 / -1.6% 40923580 / 37110977 / +10.3% 🔴 0.62 / 0.69 / -10.8%
tpcds_q18/duckdb:vortex-file-compressed 31258133 / 31059262 / +0.6% 43003307 / 40726473 / +5.6% 0.73 / 0.76 / -4.7%
tpcds_q19/duckdb:vortex-file-compressed 77602060 / 78852115 / -1.6% 89760812 / 88292524 / +1.7% 0.86 / 0.89 / -3.2%
tpcds_q20/duckdb:vortex-file-compressed 10738984 / 10682342 / +0.5% 18935246 / 18056786 / +4.9% 0.57 / 0.59 / -4.1%
tpcds_q21/duckdb:vortex-file-compressed 10344130 / 10308538 / +0.3% 22831043 / 22154351 / +3.1% 0.45 / 0.47 / -2.6%
tpcds_q22/duckdb:vortex-file-compressed 18015231 / 18641072 / -3.4% 29547531 / 28930771 / +2.1% 0.61 / 0.64 / -5.4%
tpcds_q23/duckdb:vortex-file-compressed 37336670 / 37471604 / -0.4% 49920570 / 47948727 / +4.1% 0.75 / 0.78 / -4.3%
tpcds_q24/duckdb:vortex-file-compressed 26782202 / 27204366 / -1.6% 38730615 / 37709841 / +2.7% 0.69 / 0.72 / -4.1%
tpcds_q25/duckdb:vortex-file-compressed 23469878 / 23749403 / -1.2% 38626156 / 35564648 / +8.6% 0.61 / 0.67 / -9.0%
tpcds_q26/duckdb:vortex-file-compressed 12765158 / 12842035 / -0.6% 21353404 / 20874428 / +2.3% 0.60 / 0.62 / -2.8%
tpcds_q27/duckdb:vortex-file-compressed 15855256 / 16206321 / -2.2% 27454421 / 26346419 / +4.2% 0.58 / 0.62 / -6.1%
tpcds_q28/duckdb:vortex-file-compressed 15849050 / 15419468 / +2.8% 24964098 / 24550184 / +1.7% 0.63 / 0.63 / +1.1%
tpcds_q29/duckdb:vortex-file-compressed 24055056 / 23619137 / +1.8% 38316415 / 35766515 / +7.1% 0.63 / 0.66 / -4.9%
tpcds_q30/duckdb:vortex-file-compressed 16075296 / 15988044 / +0.5% 24882059 / 24214572 / +2.8% 0.65 / 0.66 / -2.2%
tpcds_q31/duckdb:vortex-file-compressed 18109249 / 18068072 / +0.2% 26194150 / 26138672 / +0.2% 0.69 / 0.69 / +0.0%
tpcds_q32/duckdb:vortex-file-compressed 11399230 / 11395982 / +0.0% 21893858 / 20921108 / +4.6% 0.52 / 0.54 / -4.4%
tpcds_q33/duckdb:vortex-file-compressed 18610496 / 18429971 / +1.0% 28372861 / 28740601 / -1.3% 0.66 / 0.64 / +2.3%
tpcds_q34/duckdb:vortex-file-compressed 12446171 / 12256724 / +1.5% 22276381 / 23290557 / -4.4% 0.56 / 0.53 / +6.2%
tpcds_q35/duckdb:vortex-file-compressed 28275077 / 28072970 / +0.7% 39727700 / 38597007 / +2.9% 0.71 / 0.73 / -2.1%
tpcds_q36/duckdb:vortex-file-compressed 14252729 / 14828297 / -3.9% 25568410 / 23864855 / +7.1% 0.56 / 0.62 / -10.3%
tpcds_q37/duckdb:vortex-file-compressed 9403080 / 9420520 / -0.2% 22757717 / 22455212 / +1.3% 0.41 / 0.42 / -1.5%
tpcds_q38/duckdb:vortex-file-compressed 23997332 / 24050966 / -0.2% 31432658 / 30144343 / +4.3% 0.76 / 0.80 / -4.3%
tpcds_q39/duckdb:vortex-file-compressed 20109164 / 19494299 / +3.2% 31963050 / 31270477 / +2.2% 0.63 / 0.62 / +0.9%
tpcds_q40/duckdb:vortex-file-compressed 14410234 / 14280950 / +0.9% 21774284 / 21299845 / +2.2% 0.66 / 0.67 / -1.3%
tpcds_q41/duckdb:vortex-file-compressed 16998162 / 16887436 / +0.7% 24670801 / 24042176 / +2.6% 0.69 / 0.70 / -1.9%
tpcds_q42/duckdb:vortex-file-compressed 6831208 / 6969466 / -2.0% 15691624 / 15301514 / +2.5% 0.44 / 0.46 / -4.4%
tpcds_q43/duckdb:vortex-file-compressed 10114196 / 10290804 / -1.7% 18629475 / 18263805 / +2.0% 0.54 / 0.56 / -3.6%
tpcds_q44/duckdb:vortex-file-compressed 12827642 / 13002488 / -1.3% 24213092 / 23032567 / +5.1% 0.53 / 0.56 / -6.2%
tpcds_q45/duckdb:vortex-file-compressed 23331731 / 23087950 / +1.1% 31850923 / 30535701 / +4.3% 0.73 / 0.76 / -3.1%
tpcds_q46/duckdb:vortex-file-compressed 19355254 / 19263864 / +0.5% 27701909 / 27431545 / +1.0% 0.70 / 0.70 / -0.5%
tpcds_q47/duckdb:vortex-file-compressed 33905436 / 34144894 / -0.7% 44920563 / 43533076 / +3.2% 0.75 / 0.78 / -3.8%
tpcds_q48/duckdb:vortex-file-compressed 23499808 / 23172004 / +1.4% 38087217 / 35181817 / +8.3% 0.62 / 0.66 / -6.3%
tpcds_q49/duckdb:vortex-file-compressed 19375379 / 19212522 / +0.8% 33645481 / 31526343 / +6.7% 0.58 / 0.61 / -5.5%
tpcds_q50/duckdb:vortex-file-compressed 17130204 / 17161919 / -0.2% 30087261 / 28910068 / +4.1% 0.57 / 0.59 / -4.1%
tpcds_q51/duckdb:vortex-file-compressed 48091266 / 48723270 / -1.3% 58113699 / 75642069 / -23.2% 🟢 0.83 / 0.64 / +28.5%
tpcds_q52/duckdb:vortex-file-compressed 7003802 / 7207645 / -2.8% 16635664 / 15477404 / +7.5% 0.42 / 0.47 / -9.6%
tpcds_q53/duckdb:vortex-file-compressed 11468004 / 11312132 / +1.4% 22365843 / 19090771 / +17.2% 🔴 0.51 / 0.59 / -13.5%
tpcds_q54/duckdb:vortex-file-compressed 20163806 / 19977004 / +0.9% 30446084 / 29098276 / +4.6% 0.66 / 0.69 / -3.5%
tpcds_q55/duckdb:vortex-file-compressed 6830334 / 6959280 / -1.9% 15252117 / 16066851 / -5.1% 0.45 / 0.43 / +3.4%
tpcds_q56/duckdb:vortex-file-compressed 18279820 / 18064101 / +1.2% 27443505 / 27504212 / -0.2% 0.67 / 0.66 / +1.4%
tpcds_q57/duckdb:vortex-file-compressed 25772524 / 25323574 / +1.8% 33871755 / 33772836 / +0.3% 0.76 / 0.75 / +1.5%
tpcds_q58/duckdb:vortex-file-compressed 20352976 / 20406710 / -0.3% 30223128 / 29131235 / +3.7% 0.67 / 0.70 / -3.9%
tpcds_q59/duckdb:vortex-file-compressed 19623891 / 19582062 / +0.2% 28635287 / 27374419 / +4.6% 0.69 / 0.72 / -4.2%
tpcds_q60/duckdb:vortex-file-compressed 18431124 / 18323942 / +0.6% 28654745 / 27493489 / +4.2% 0.64 / 0.67 / -3.5%
tpcds_q61/duckdb:vortex-file-compressed 23602146 / 24995251 / -5.6% 34279227 / 33701546 / +1.7% 0.69 / 0.74 / -7.2%
tpcds_q62/duckdb:vortex-file-compressed 11867660 / 11758102 / +0.9% 18978369 / 18810769 / +0.9% 0.63 / 0.63 / +0.0%
tpcds_q63/duckdb:vortex-file-compressed 11090219 / 10867746 / +2.0% 20798278 / 18763701 / +10.8% 🔴 0.53 / 0.58 / -7.9%
tpcds_q64/duckdb:vortex-file-compressed 49466088 / 49651312 / -0.4% 69473771 / 66507250 / +4.5% 0.71 / 0.75 / -4.6%
tpcds_q65/duckdb:vortex-file-compressed 13300782 / 12697344 / +4.8% 22548169 / 20800171 / +8.4% 0.59 / 0.61 / -3.4%
tpcds_q66/duckdb:vortex-file-compressed 28894468 / 29071646 / -0.6% 39051183 / 37689530 / +3.6% 0.74 / 0.77 / -4.1%
tpcds_q67/duckdb:vortex-file-compressed 58116836 / 57658283 / +0.8% 68506310 / 65613523 / +4.4% 0.85 / 0.88 / -3.5%
tpcds_q68/duckdb:vortex-file-compressed 18921892 / 18794468 / +0.7% 27263692 / 26745583 / +1.9% 0.69 / 0.70 / -1.2%
tpcds_q69/duckdb:vortex-file-compressed 22218022 / 22018490 / +0.9% 38061622 / 36260397 / +5.0% 0.58 / 0.61 / -3.9%
tpcds_q70/duckdb:vortex-file-compressed 15460468 / 15370884 / +0.6% 25808894 / 25585211 / +0.9% 0.60 / 0.60 / -0.3%
tpcds_q71/duckdb:vortex-file-compressed 13123305 / 12565774 / +4.4% 22647180 / 22168974 / +2.2% 0.58 / 0.57 / +2.2%
tpcds_q72/duckdb:vortex-file-compressed 55170478 / 54636238 / +1.0% 70460815 / 68881082 / +2.3% 0.78 / 0.79 / -1.3%
tpcds_q73/duckdb:vortex-file-compressed 11182204 / 11187374 / -0.0% 21315733 / 20503107 / +4.0% 0.52 / 0.55 / -3.9%
tpcds_q74/duckdb:vortex-file-compressed 26102442 / 25876048 / +0.9% 33468061 / 33103529 / +1.1% 0.78 / 0.78 / -0.2%
tpcds_q75/duckdb:vortex-file-compressed 28845172 / 28796016 / +0.2% 39727301 / 38269880 / +3.8% 0.73 / 0.75 / -3.5%
tpcds_q76/duckdb:vortex-file-compressed 13203145 / 12779757 / +3.3% 24381320 / 22030297 / +10.7% 🔴 0.54 / 0.58 / -6.6%
tpcds_q77/duckdb:vortex-file-compressed 20531658 / 20924870 / -1.9% 29961757 / 29827626 / +0.4% 0.69 / 0.70 / -2.3%
tpcds_q78/duckdb:vortex-file-compressed 42957590 / 43173124 / -0.5% 52804105 / 51882765 / +1.8% 0.81 / 0.83 / -2.2%
tpcds_q79/duckdb:vortex-file-compressed 12971780 / 13093850 / -0.9% 22384578 / 21087998 / +6.1% 0.58 / 0.62 / -6.7%
tpcds_q80/duckdb:vortex-file-compressed 36951774 / 36620438 / +0.9% 51297377 / 49877831 / +2.8% 0.72 / 0.73 / -1.9%
tpcds_q81/duckdb:vortex-file-compressed 21027846 / 21144568 / -0.6% 28816662 / 28702132 / +0.4% 0.73 / 0.74 / -0.9%
tpcds_q82/duckdb:vortex-file-compressed 9647148 / 9782354 / -1.4% 23505114 / 22426718 / +4.8% 0.41 / 0.44 / -5.9%
tpcds_q83/duckdb:vortex-file-compressed 17448564 / 17256164 / +1.1% 25617652 / 24708341 / +3.7% 0.68 / 0.70 / -2.5%
tpcds_q84/duckdb:vortex-file-compressed 15785014 / 15671896 / +0.7% 23583566 / 22792964 / +3.5% 0.67 / 0.69 / -2.7%
tpcds_q85/duckdb:vortex-file-compressed 24480402 / 24207774 / +1.1% 38356975 / 36725083 / +4.4% 0.64 / 0.66 / -3.2%
tpcds_q86/duckdb:vortex-file-compressed 9492775 / 9780747 / -2.9% 16573536 / 16629849 / -0.3% 0.57 / 0.59 / -2.6%
tpcds_q87/duckdb:vortex-file-compressed 25807476 / 25606717 / +0.8% 31991489 / 31713834 / +0.9% 0.81 / 0.81 / -0.1%
tpcds_q88/duckdb:vortex-file-compressed 30913574 / 31286994 / -1.2% 39667000 / 39724856 / -0.1% 0.78 / 0.79 / -1.0%
tpcds_q89/duckdb:vortex-file-compressed 12113658 / 12226279 / -0.9% 22103739 / 20506250 / +7.8% 0.55 / 0.60 / -8.1%
tpcds_q90/duckdb:vortex-file-compressed 8199184 / 8205116 / -0.1% 15724801 / 15484822 / +1.5% 0.52 / 0.53 / -1.6%
tpcds_q91/duckdb:vortex-file-compressed 14261262 / 14111847 / +1.1% 23018866 / 20974884 / +9.7% 0.62 / 0.67 / -7.9%
tpcds_q92/duckdb:vortex-file-compressed 11892600 / 11744049 / +1.3% 20498618 / 20641333 / -0.7% 0.58 / 0.57 / +2.0%
tpcds_q93/duckdb:vortex-file-compressed 10507784 / 10665562 / -1.5% 25630301 / 23032519 / +11.3% 🔴 0.41 / 0.46 / -11.5%
tpcds_q94/duckdb:vortex-file-compressed 22066552 / 21877851 / +0.9% 31515519 / 30990737 / +1.7% 0.70 / 0.71 / -0.8%
tpcds_q95/duckdb:vortex-file-compressed 62132440 / 62520004 / -0.6% 72563892 / 70970112 / +2.2% 0.86 / 0.88 / -2.8%
tpcds_q96/duckdb:vortex-file-compressed 6599410 / 6751151 / -2.2% 15885338 / 15318151 / +3.7% 0.42 / 0.44 / -5.7%
tpcds_q97/duckdb:vortex-file-compressed 23249194 / 23454252 / -0.9% 32345800 / 30772255 / +5.1% 0.72 / 0.76 / -5.7%
tpcds_q98/duckdb:vortex-file-compressed 11237942 / 11298200 / -0.5% 20647990 / 19361097 / +6.6% 0.54 / 0.58 / -6.7%
tpcds_q99/duckdb:vortex-file-compressed 14816767 / 14754798 / +0.4% 22356464 / 21940836 / +1.9% 0.66 / 0.67 / -1.4%
duckdb / parquet / ns (1.008x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24272619 / 24155774 / +0.5% 30872345 / 30964395 / -0.3% 0.79 / 0.78 / +0.8%
tpcds_q02/duckdb:parquet 18362600 / 18439694 / -0.4% 24914596 / 24742209 / +0.7% 0.74 / 0.75 / -1.1%
tpcds_q03/duckdb:parquet 9916578 / 9790092 / +1.3% 15596331 / 15517648 / +0.5% 0.64 / 0.63 / +0.8%
tpcds_q04/duckdb:parquet 118228044 / 118718923 / -0.4% 123893943 / 126030920 / -1.7% 0.95 / 0.94 / +1.3%
tpcds_q05/duckdb:parquet 28791768 / 28924080 / -0.5% 33144420 / 32817507 / +1.0% 0.87 / 0.88 / -1.4%
tpcds_q06/duckdb:parquet 26704266 / 26459952 / +0.9% 36241359 / 35982806 / +0.7% 0.74 / 0.74 / +0.2%
tpcds_q07/duckdb:parquet 33147466 / 30785729 / +7.7% 39228991 / 39090732 / +0.4% 0.84 / 0.79 / +7.3%
tpcds_q08/duckdb:parquet 20288253 / 20106878 / +0.9% 25112838 / 25899642 / -3.0% 0.81 / 0.78 / +4.1%
tpcds_q09/duckdb:parquet 27460136 / 27528532 / -0.2% 34239236 / 31278103 / +9.5% 0.80 / 0.88 / -8.9%
tpcds_q10/duckdb:parquet 33066894 / 32857808 / +0.6% 41132465 / 40216439 / +2.3% 0.80 / 0.82 / -1.6%
tpcds_q11/duckdb:parquet 68850308 / 68353367 / +0.7% 74900104 / 76601806 / -2.2% 0.92 / 0.89 / +3.0%
tpcds_q12/duckdb:parquet 14233171 / 14033765 / +1.4% 19165922 / 19083723 / +0.4% 0.74 / 0.74 / +1.0%
tpcds_q13/duckdb:parquet 31066590 / 30708574 / +1.2% 39862876 / 40418871 / -1.4% 0.78 / 0.76 / +2.6%
tpcds_q14/duckdb:parquet 64538296 / 63675456 / +1.4% 70242694 / 69326486 / +1.3% 0.92 / 0.92 / +0.0%
tpcds_q15/duckdb:parquet 16952912 / 16784528 / +1.0% 22738262 / 23101983 / -1.6% 0.75 / 0.73 / +2.6%
tpcds_q16/duckdb:parquet 30640947 / 30524416 / +0.4% 37650142 / 37230319 / +1.1% 0.81 / 0.82 / -0.7%
tpcds_q17/duckdb:parquet 35332444 / 35387898 / -0.2% 41485014 / 40665319 / +2.0% 0.85 / 0.87 / -2.1%
tpcds_q18/duckdb:parquet 48035690 / 47949280 / +0.2% 55601142 / 55476100 / +0.2% 0.86 / 0.86 / -0.0%
tpcds_q19/duckdb:parquet 18850252 / 18873968 / -0.1% 25780156 / 25473309 / +1.2% 0.73 / 0.74 / -1.3%
tpcds_q20/duckdb:parquet 15194548 / 15238704 / -0.3% 19914686 / 20263361 / -1.7% 0.76 / 0.75 / +1.5%
tpcds_q21/duckdb:parquet 10802540 / 11064422 / -2.4% 17672452 / 17118666 / +3.2% 0.61 / 0.65 / -5.4%
tpcds_q22/duckdb:parquet 20692460 / 20701504 / -0.0% 26770823 / 27107915 / -1.2% 0.77 / 0.76 / +1.2%
tpcds_q23/duckdb:parquet 42671264 / 43108766 / -1.0% 50529710 / 47629484 / +6.1% 0.84 / 0.91 / -6.7%
tpcds_q24/duckdb:parquet 30784774 / 30872540 / -0.3% 38042368 / 36580226 / +4.0% 0.81 / 0.84 / -4.1%
tpcds_q25/duckdb:parquet 31001414 / 30958210 / +0.1% 37350893 / 36916939 / +1.2% 0.83 / 0.84 / -1.0%
tpcds_q26/duckdb:parquet 29101010 / 29484030 / -1.3% 35485288 / 35240817 / +0.7% 0.82 / 0.84 / -2.0%
tpcds_q27/duckdb:parquet 33685738 / 34547371 / -2.5% 42600321 / 44391662 / -4.0% 0.79 / 0.78 / +1.6%
tpcds_q28/duckdb:parquet 26928936 / 25504921 / +5.6% 33793019 / 33384746 / +1.2% 0.80 / 0.76 / +4.3%
tpcds_q29/duckdb:parquet 32409076 / 32695144 / -0.9% 40152295 / 39184527 / +2.5% 0.81 / 0.83 / -3.3%
tpcds_q30/duckdb:parquet 36331342 / 36245873 / +0.2% 45544964 / 44885884 / +1.5% 0.80 / 0.81 / -1.2%
tpcds_q31/duckdb:parquet 36821021 / 35666950 / +3.2% 43247083 / 43117463 / +0.3% 0.85 / 0.83 / +2.9%
tpcds_q32/duckdb:parquet 14507474 / 14554540 / -0.3% 21198533 / 21092803 / +0.5% 0.68 / 0.69 / -0.8%
tpcds_q33/duckdb:parquet 23743926 / 23685087 / +0.2% 29278628 / 29198836 / +0.3% 0.81 / 0.81 / -0.0%
tpcds_q34/duckdb:parquet 20670779 / 17244228 / +19.9% 🔴 24453315 / 24435606 / +0.1% 0.85 / 0.71 / +19.8%
tpcds_q35/duckdb:parquet 35737666 / 35365510 / +1.1% 44955002 / 43818172 / +2.6% 0.79 / 0.81 / -1.5%
tpcds_q36/duckdb:parquet 41651614 / 40075460 / +3.9% 49169506 / 47976717 / +2.5% 0.85 / 0.84 / +1.4%
tpcds_q37/duckdb:parquet 12844292 / 12952144 / -0.8% 19531683 / 19791096 / -1.3% 0.66 / 0.65 / +0.5%
tpcds_q38/duckdb:parquet 29908608 / 29642626 / +0.9% 34060482 / 33806481 / +0.8% 0.88 / 0.88 / +0.1%
tpcds_q39/duckdb:parquet 23564140 / 23515344 / +0.2% 30032722 / 30225805 / -0.6% 0.78 / 0.78 / +0.9%
tpcds_q40/duckdb:parquet 16244441 / 16292993 / -0.3% 21574858 / 21922840 / -1.6% 0.75 / 0.74 / +1.3%
tpcds_q41/duckdb:parquet 12472480 / 12126886 / +2.8% 18371065 / 18490734 / -0.6% 0.68 / 0.66 / +3.5%
tpcds_q42/duckdb:parquet 9625352 / 9549062 / +0.8% 15538709 / 15627516 / -0.6% 0.62 / 0.61 / +1.4%
tpcds_q43/duckdb:parquet 12464061 / 12536583 / -0.6% 18499763 / 18530711 / -0.2% 0.67 / 0.68 / -0.4%
tpcds_q44/duckdb:parquet 21420430 / 20662598 / +3.7% 27176669 / 26268369 / +3.5% 0.79 / 0.79 / +0.2%
tpcds_q45/duckdb:parquet 21336756 / 21123426 / +1.0% 28202802 / 27832435 / +1.3% 0.76 / 0.76 / -0.3%
tpcds_q46/duckdb:parquet 36362832 / 37898499 / -4.1% 44336589 / 42853657 / +3.5% 0.82 / 0.88 / -7.3%
tpcds_q47/duckdb:parquet 34519288 / 34197234 / +0.9% 41476102 / 41692345 / -0.5% 0.83 / 0.82 / +1.5%
tpcds_q48/duckdb:parquet 29769494 / 29080484 / +2.4% 37135041 / 37216819 / -0.2% 0.80 / 0.78 / +2.6%
tpcds_q49/duckdb:parquet 31379762 / 30443550 / +3.1% 39390218 / 36555429 / +7.8% 0.80 / 0.83 / -4.3%
tpcds_q50/duckdb:parquet 19698928 / 19781562 / -0.4% 25798470 / 26142118 / -1.3% 0.76 / 0.76 / +0.9%
tpcds_q51/duckdb:parquet 52299182 / 52376294 / -0.1% 75739412 / 60472154 / +25.2% 🔴 0.69 / 0.87 / -20.3%
tpcds_q52/duckdb:parquet 9752458 / 9708260 / +0.5% 15669613 / 16160012 / -3.0% 0.62 / 0.60 / +3.6%
tpcds_q53/duckdb:parquet 14004266 / 14094226 / -0.6% 20957367 / 21161085 / -1.0% 0.67 / 0.67 / +0.3%
tpcds_q54/duckdb:parquet 25203758 / 24885952 / +1.3% 32872356 / 32078039 / +2.5% 0.77 / 0.78 / -1.2%
tpcds_q55/duckdb:parquet 9669514 / 9542448 / +1.3% 15245382 / 15448294 / -1.3% 0.63 / 0.62 / +2.7%
tpcds_q56/duckdb:parquet 27546662 / 25190620 / +9.4% 30948550 / 30422632 / +1.7% 0.89 / 0.83 / +7.5%
tpcds_q57/duckdb:parquet 30896232 / 30762238 / +0.4% 36847376 / 36252949 / +1.6% 0.84 / 0.85 / -1.2%
tpcds_q58/duckdb:parquet 24458080 / 24537851 / -0.3% 30322307 / 30204725 / +0.4% 0.81 / 0.81 / -0.7%
tpcds_q59/duckdb:parquet 23385018 / 23181583 / +0.9% 30090279 / 29199809 / +3.0% 0.78 / 0.79 / -2.1%
tpcds_q60/duckdb:parquet 27530698 / 27701096 / -0.6% 32488395 / 33249781 / -2.3% 0.85 / 0.83 / +1.7%
tpcds_q61/duckdb:parquet 26059051 / 26245988 / -0.7% 29765739 / 29778140 / -0.0% 0.88 / 0.88 / -0.7%
tpcds_q62/duckdb:parquet 13310050 / 13187358 / +0.9% 18472246 / 18260911 / +1.2% 0.72 / 0.72 / -0.2%
tpcds_q63/duckdb:parquet 13668176 / 13608340 / +0.4% 20448355 / 20770761 / -1.6% 0.67 / 0.66 / +2.0%
tpcds_q64/duckdb:parquet 73171152 / 71126663 / +2.9% 82333329 / 81858239 / +0.6% 0.89 / 0.87 / +2.3%
tpcds_q65/duckdb:parquet 21608049 / 21922848 / -1.4% 25516259 / 24365541 / +4.7% 0.85 / 0.90 / -5.9%
tpcds_q66/duckdb:parquet 35566980 / 34827730 / +2.1% 42476143 / 41867441 / +1.5% 0.84 / 0.83 / +0.7%
tpcds_q67/duckdb:parquet 61312247 / 60664984 / +1.1% 67374279 / 67551608 / -0.3% 0.91 / 0.90 / +1.3%
tpcds_q68/duckdb:parquet 29622054 / 28730490 / +3.1% 39334402 / 36107406 / +8.9% 0.75 / 0.80 / -5.4%
tpcds_q69/duckdb:parquet 26107623 / 26045694 / +0.2% 35051056 / 34325094 / +2.1% 0.74 / 0.76 / -1.8%
tpcds_q70/duckdb:parquet 19352468 / 19528067 / -0.9% 26468846 / 26833875 / -1.4% 0.73 / 0.73 / +0.5%
tpcds_q71/duckdb:parquet 17290072 / 17175779 / +0.7% 24766779 / 23831032 / +3.9% 0.70 / 0.72 / -3.1%
tpcds_q72/duckdb:parquet 54624094 / 54501147 / +0.2% 63170138 / 62527642 / +1.0% 0.86 / 0.87 / -0.8%
tpcds_q73/duckdb:parquet 14872002 / 15041249 / -1.1% 21703444 / 22009597 / -1.4% 0.69 / 0.68 / +0.3%
tpcds_q74/duckdb:parquet 84595266 / 83510815 / +1.3% 91602954 / 92102266 / -0.5% 0.92 / 0.91 / +1.9%
tpcds_q75/duckdb:parquet 46537006 / 46067988 / +1.0% 51785288 / 51262922 / +1.0% 0.90 / 0.90 / -0.0%
tpcds_q76/duckdb:parquet 19859647 / 18646243 / +6.5% 23702001 / 23026236 / +2.9% 0.84 / 0.81 / +3.5%
tpcds_q77/duckdb:parquet 24867716 / 24924687 / -0.2% 32149924 / 31996691 / +0.5% 0.77 / 0.78 / -0.7%
tpcds_q78/duckdb:parquet 78840330 / 79434690 / -0.7% 86358022 / 84870185 / +1.8% 0.91 / 0.94 / -2.5%
tpcds_q79/duckdb:parquet 23261688 / 21919254 / +6.1% 29909490 / 29229223 / +2.3% 0.78 / 0.75 / +3.7%
tpcds_q80/duckdb:parquet 37710293 / 38936993 / -3.2% 44732825 / 43916127 / +1.9% 0.84 / 0.89 / -4.9%
tpcds_q81/duckdb:parquet 36862194 / 36527306 / +0.9% 45365517 / 45085177 / +0.6% 0.81 / 0.81 / +0.3%
tpcds_q82/duckdb:parquet 13619550 / 13666704 / -0.3% 21030934 / 20680312 / +1.7% 0.65 / 0.66 / -2.0%
tpcds_q83/duckdb:parquet 20870908 / 20752658 / +0.6% 25520038 / 25701435 / -0.7% 0.82 / 0.81 / +1.3%
tpcds_q84/duckdb:parquet 23199052 / 23271748 / -0.3% 28982169 / 28489820 / +1.7% 0.80 / 0.82 / -2.0%
tpcds_q85/duckdb:parquet 32792516 / 32761447 / +0.1% 40356624 / 39791056 / +1.4% 0.81 / 0.82 / -1.3%
tpcds_q86/duckdb:parquet 11987426 / 11973638 / +0.1% 17181119 / 16856153 / +1.9% 0.70 / 0.71 / -1.8%
tpcds_q87/duckdb:parquet 31492532 / 31344363 / +0.5% 35801135 / 36552396 / -2.1% 0.88 / 0.86 / +2.6%
tpcds_q88/duckdb:parquet 39750446 / 39341130 / +1.0% 45521781 / 45564708 / -0.1% 0.87 / 0.86 / +1.1%
tpcds_q89/duckdb:parquet 14513828 / 14530630 / -0.1% 21315865 / 21283431 / +0.2% 0.68 / 0.68 / -0.3%
tpcds_q90/duckdb:parquet 10218214 / 10185412 / +0.3% 15433230 / 15532645 / -0.6% 0.66 / 0.66 / +1.0%
tpcds_q91/duckdb:parquet 21478789 / 21252416 / +1.1% 29125211 / 28369636 / +2.7% 0.74 / 0.75 / -1.6%
tpcds_q92/duckdb:parquet 15866222 / 15896182 / -0.2% 22571726 / 22828604 / -1.1% 0.70 / 0.70 / +0.9%
tpcds_q93/duckdb:parquet 14260844 / 14297474 / -0.3% 20780421 / 20531032 / +1.2% 0.69 / 0.70 / -1.5%
tpcds_q94/duckdb:parquet 25699231 / 25549534 / +0.6% 33011882 / 33586248 / -1.7% 0.78 / 0.76 / +2.3%
tpcds_q95/duckdb:parquet 43820800 / 43920504 / -0.2% 49736951 / 49306952 / +0.9% 0.88 / 0.89 / -1.1%
tpcds_q96/duckdb:parquet 8395581 / 8427374 / -0.4% 14317187 / 14226975 / +0.6% 0.59 / 0.59 / -1.0%
tpcds_q97/duckdb:parquet 27640208 / 27609772 / +0.1% 34486236 / 34613565 / -0.4% 0.80 / 0.80 / +0.5%
tpcds_q98/duckdb:parquet 16590518 / 16780385 / -1.1% 23409003 / 23543321 / -0.6% 0.71 / 0.71 / -0.6%
tpcds_q99/duckdb:parquet 19235378 / 19141604 / +0.5% 24328281 / 24237355 / +0.4% 0.79 / 0.79 / +0.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR f0752c6b vs base 891c01ab
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+1.7%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.047x ➖
Parquet (geomean): hot 0.993x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.013x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1208614 / 1277246 / -5.4% 22998404 / 22024462 / +4.4% 0.05 / 0.06 / -9.4%
clickbench_q01/datafusion:vortex-file-compressed 5892292 / 5876934 / +0.3% 30936045 / 33936943 / -8.8% 0.19 / 0.17 / +10.0%
clickbench_q02/datafusion:vortex-file-compressed 10844300 / 9474910 / +14.5% 🔴 44852147 / 37555396 / +19.4% 🔴 0.24 / 0.25 / -4.2%
clickbench_q03/datafusion:vortex-file-compressed 12725996 / 11523814 / +10.4% 🔴 54054305 / 49449355 / +9.3% 0.24 / 0.23 / +1.0%
clickbench_q04/datafusion:vortex-file-compressed 57424472 / 56500204 / +1.6% 101601220 / 89176898 / +13.9% 🔴 0.57 / 0.63 / -10.8%
clickbench_q05/datafusion:vortex-file-compressed 78324942 / 76807437 / +2.0% 132945840 / 117171431 / +13.5% 🔴 0.59 / 0.66 / -10.1%
clickbench_q06/datafusion:vortex-file-compressed 1243400 / 1259262 / -1.3% 23093147 / 22323207 / +3.4% 0.05 / 0.06 / -4.6%
clickbench_q07/datafusion:vortex-file-compressed 9205120 / 9035675 / +1.9% 34686433 / 32392578 / +7.1% 0.27 / 0.28 / -4.9%
clickbench_q08/datafusion:vortex-file-compressed 78821079 / 76412092 / +3.2% 126044767 / 112846507 / +11.7% 🔴 0.63 / 0.68 / -7.6%
clickbench_q09/datafusion:vortex-file-compressed 172351092 / 170865214 / +0.9% 219431997 / 205095340 / +7.0% 0.79 / 0.83 / -5.7%
clickbench_q10/datafusion:vortex-file-compressed 23765536 / 22929527 / +3.6% 70052916 / 63727073 / +9.9% 0.34 / 0.36 / -5.7%
clickbench_q11/datafusion:vortex-file-compressed 25299702 / 26507294 / -4.6% 72192980 / 63689153 / +13.4% 🔴 0.35 / 0.42 / -15.8%
clickbench_q12/datafusion:vortex-file-compressed 74018530 / 71578650 / +3.4% 127335746 / 115491837 / +10.3% 🔴 0.58 / 0.62 / -6.2%
clickbench_q13/datafusion:vortex-file-compressed 116625932 / 114979905 / +1.4% 178700181 / 177443642 / +0.7% 0.65 / 0.65 / +0.7%
clickbench_q14/datafusion:vortex-file-compressed 75879714 / 73818192 / +2.8% 125306228 / 118039651 / +6.2% 0.61 / 0.63 / -3.2%
clickbench_q15/datafusion:vortex-file-compressed 64364396 / 63448128 / +1.4% 100828393 / 94487196 / +6.7% 0.64 / 0.67 / -4.9%
clickbench_q16/datafusion:vortex-file-compressed 155943832 / 148282060 / +5.2% 220468346 / 206234166 / +6.9% 0.71 / 0.72 / -1.6%
clickbench_q17/datafusion:vortex-file-compressed 151296566 / 150341064 / +0.6% 220159746 / 207187208 / +6.3% 0.69 / 0.73 / -5.3%
clickbench_q18/datafusion:vortex-file-compressed 292940492 / 297405950 / -1.5% 379586235 / 366852406 / +3.5% 0.77 / 0.81 / -4.8%
clickbench_q19/datafusion:vortex-file-compressed 7753744 / 7524886 / +3.0% 47819051 / 47139353 / +1.4% 0.16 / 0.16 / +1.6%
clickbench_q20/datafusion:vortex-file-compressed 68362822 / 59462452 / +15.0% 🔴 239079790 / 224113915 / +6.7% 0.29 / 0.27 / +7.8%
clickbench_q21/datafusion:vortex-file-compressed 77629516 / 88061722 / -11.8% 🟢 284926152 / 266482171 / +6.9% 0.27 / 0.33 / -17.6%
clickbench_q22/datafusion:vortex-file-compressed 93728937 / 100012086 / -6.3% 385650858 / 342464018 / +12.6% 🔴 0.24 / 0.29 / -16.8%
clickbench_q23/datafusion:vortex-file-compressed 186628754 / 193762304 / -3.7% 566919665 / 504225292 / +12.4% 🔴 0.33 / 0.38 / -14.3%
clickbench_q24/datafusion:vortex-file-compressed 15734768 / 15268066 / +3.1% 69316717 / 60214351 / +15.1% 🔴 0.23 / 0.25 / -10.5%
clickbench_q25/datafusion:vortex-file-compressed 18916865 / 18374098 / +3.0% 61469187 / 60620345 / +1.4% 0.31 / 0.30 / +1.5%
clickbench_q26/datafusion:vortex-file-compressed 16306731 / 15172439 / +7.5% 68389097 / 63889816 / +7.0% 0.24 / 0.24 / +0.4%
clickbench_q27/datafusion:vortex-file-compressed 101658552 / 94925984 / +7.1% 253495923 / 240361559 / +5.5% 0.40 / 0.39 / +1.5%
clickbench_q28/datafusion:vortex-file-compressed 555156654 / 557142159 / -0.4% 627737835 / 617447933 / +1.7% 0.88 / 0.90 / -2.0%
clickbench_q29/datafusion:vortex-file-compressed 24276674 / 23032658 / +5.4% 56818495 / 50912041 / +11.6% 🔴 0.43 / 0.45 / -5.6%
clickbench_q30/datafusion:vortex-file-compressed 55605686 / 56472133 / -1.5% 107167557 / 102382911 / +4.7% 0.52 / 0.55 / -5.9%
clickbench_q31/datafusion:vortex-file-compressed 65760283 / 69583918 / -5.5% 155008720 / 150524379 / +3.0% 0.42 / 0.46 / -8.2%
clickbench_q32/datafusion:vortex-file-compressed 284688141 / 280170926 / +1.6% 389932366 / 381630807 / +2.2% 0.73 / 0.73 / -0.6%
clickbench_q33/datafusion:vortex-file-compressed 316073676 / 321163488 / -1.6% 433617512 / 421584912 / +2.9% 0.73 / 0.76 / -4.3%
clickbench_q34/datafusion:vortex-file-compressed 320458617 / 319349609 / +0.3% 436862914 / 423295980 / +3.2% 0.73 / 0.75 / -2.8%
clickbench_q35/datafusion:vortex-file-compressed 58220519 / 54982400 / +5.9% 93020727 / 89308371 / +4.2% 0.63 / 0.62 / +1.7%
clickbench_q36/datafusion:vortex-file-compressed 38263270 / 37343460 / +2.5% 68174127 / 63536855 / +7.3% 0.56 / 0.59 / -4.5%
clickbench_q37/datafusion:vortex-file-compressed 20910130 / 21570580 / -3.1% 47289045 / 46842463 / +1.0% 0.44 / 0.46 / -4.0%
clickbench_q38/datafusion:vortex-file-compressed 13062362 / 11469421 / +13.9% 🔴 41633298 / 37179506 / +12.0% 🔴 0.31 / 0.31 / +1.7%
clickbench_q39/datafusion:vortex-file-compressed 78703669 / 77679328 / +1.3% 113835960 / 108313339 / +5.1% 0.69 / 0.72 / -3.6%
clickbench_q40/datafusion:vortex-file-compressed 10713602 / 10996484 / -2.6% 37206743 / 35512586 / +4.8% 0.29 / 0.31 / -7.0%
clickbench_q41/datafusion:vortex-file-compressed 10115250 / 10875140 / -7.0% 35173718 / 35342592 / -0.5% 0.29 / 0.31 / -6.5%
clickbench_q42/datafusion:vortex-file-compressed 10233844 / 10855630 / -5.7% 38219753 / 35258298 / +8.4% 0.27 / 0.31 / -13.0%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1240032 / 1266400 / -2.1% 51235783 / 47747068 / +7.3% 0.02 / 0.03 / -8.7%
clickbench_q01/datafusion:parquet 16023678 / 15780286 / +1.5% 74599900 / 64593783 / +15.5% 🔴 0.21 / 0.24 / -12.1%
clickbench_q02/datafusion:parquet 18542760 / 18715074 / -0.9% 84279375 / 79758201 / +5.7% 0.22 / 0.23 / -6.2%
clickbench_q03/datafusion:parquet 17336854 / 17370278 / -0.2% 85033840 / 76707363 / +10.9% 🔴 0.20 / 0.23 / -10.0%
clickbench_q04/datafusion:parquet 63838667 / 62170066 / +2.7% 129516433 / 121226742 / +6.8% 0.49 / 0.51 / -3.9%
clickbench_q05/datafusion:parquet 87537930 / 87565230 / -0.0% 157407633 / 152252487 / +3.4% 0.56 / 0.58 / -3.3%
clickbench_q06/datafusion:parquet 1269556 / 1273618 / -0.3% 52440514 / 48301175 / +8.6% 0.02 / 0.03 / -8.2%
clickbench_q07/datafusion:parquet 16733446 / 16900322 / -1.0% 70531329 / 66960390 / +5.3% 0.24 / 0.25 / -6.0%
clickbench_q08/datafusion:parquet 85025474 / 83921770 / +1.3% 160762310 / 154007075 / +4.4% 0.53 / 0.54 / -2.9%
clickbench_q09/datafusion:parquet 187428082 / 187761152 / -0.2% 265599304 / 259247911 / +2.4% 0.71 / 0.72 / -2.6%
clickbench_q10/datafusion:parquet 36150822 / 36260880 / -0.3% 103789874 / 97694544 / +6.2% 0.35 / 0.37 / -6.2%
clickbench_q11/datafusion:parquet 42984516 / 42635150 / +0.8% 113302090 / 105625016 / +7.3% 0.38 / 0.40 / -6.0%
clickbench_q12/datafusion:parquet 95197284 / 95819098 / -0.6% 162253163 / 156842602 / +3.4% 0.59 / 0.61 / -4.0%
clickbench_q13/datafusion:parquet 147675284 / 149906859 / -1.5% 231140328 / 221161507 / +4.5% 0.64 / 0.68 / -5.7%
clickbench_q14/datafusion:parquet 102318334 / 101447247 / +0.9% 174552161 / 166807396 / +4.6% 0.59 / 0.61 / -3.6%
clickbench_q15/datafusion:parquet 71530834 / 74533161 / -4.0% 132946542 / 129330886 / +2.8% 0.54 / 0.58 / -6.6%
clickbench_q16/datafusion:parquet 156292272 / 156070149 / +0.1% 234396429 / 236268332 / -0.8% 0.67 / 0.66 / +0.9%
clickbench_q17/datafusion:parquet 156048976 / 156626648 / -0.4% 238182930 / 232696353 / +2.4% 0.66 / 0.67 / -2.7%
clickbench_q18/datafusion:parquet 306137350 / 309189786 / -1.0% 416640271 / 417493557 / -0.2% 0.73 / 0.74 / -0.8%
clickbench_q19/datafusion:parquet 19150906 / 18779314 / +2.0% 78712562 / 73612107 / +6.9% 0.24 / 0.26 / -4.6%
clickbench_q20/datafusion:parquet 178252794 / 178726488 / -0.3% 295780053 / 277254841 / +6.7% 0.60 / 0.64 / -6.5%
clickbench_q21/datafusion:parquet 172295167 / 175606469 / -1.9% 316188118 / 288693124 / +9.5% 0.54 / 0.61 / -10.4%
clickbench_q22/datafusion:parquet 256902483 / 261298302 / -1.7% 455122947 / 413036735 / +10.2% 🔴 0.56 / 0.63 / -10.8%
clickbench_q23/datafusion:parquet 1007186837 / 1017993872 / -1.1% 1210490525 / 1181192815 / +2.5% 0.83 / 0.86 / -3.5%
clickbench_q24/datafusion:parquet 29765182 / 30115323 / -1.2% 92476438 / 86246562 / +7.2% 0.32 / 0.35 / -7.8%
clickbench_q25/datafusion:parquet 37280485 / 36979650 / +0.8% 103265743 / 99325122 / +4.0% 0.36 / 0.37 / -3.0%
clickbench_q26/datafusion:parquet 30128858 / 30397842 / -0.9% 91674723 / 85757827 / +6.9% 0.33 / 0.35 / -7.3%
clickbench_q27/datafusion:parquet 193185340 / 191814399 / +0.7% 308516059 / 280174617 / +10.1% 🔴 0.63 / 0.68 / -8.5%
clickbench_q28/datafusion:parquet 613497247 / 616539991 / -0.5% 704397666 / 699758819 / +0.7% 0.87 / 0.88 / -1.1%
clickbench_q29/datafusion:parquet 29004508 / 29196843 / -0.7% 92504322 / 88570870 / +4.4% 0.31 / 0.33 / -4.9%
clickbench_q30/datafusion:parquet 89267572 / 90660008 / -1.5% 178334022 / 166307785 / +7.2% 0.50 / 0.55 / -8.2%
clickbench_q31/datafusion:parquet 102499670 / 103186246 / -0.7% 200962477 / 190287706 / +5.6% 0.51 / 0.54 / -5.9%
clickbench_q32/datafusion:parquet 307547586 / 308961130 / -0.5% 428501982 / 436452065 / -1.8% 0.72 / 0.71 / +1.4%
clickbench_q33/datafusion:parquet 374567898 / 376538974 / -0.5% 474249517 / 474593745 / -0.1% 0.79 / 0.79 / -0.5%
clickbench_q34/datafusion:parquet 374633742 / 376477550 / -0.5% 476619859 / 477560599 / -0.2% 0.79 / 0.79 / -0.3%
clickbench_q35/datafusion:parquet 65461954 / 66023334 / -0.9% 121914067 / 121949591 / -0.0% 0.54 / 0.54 / -0.8%
clickbench_q36/datafusion:parquet 73537500 / 73645336 / -0.1% 134531572 / 133777759 / +0.6% 0.55 / 0.55 / -0.7%
clickbench_q37/datafusion:parquet 35308994 / 35352336 / -0.1% 90839019 / 91148462 / -0.3% 0.39 / 0.39 / +0.2%
clickbench_q38/datafusion:parquet 47698410 / 47516447 / +0.4% 110035312 / 105604940 / +4.2% 0.43 / 0.45 / -3.7%
clickbench_q39/datafusion:parquet 143334300 / 143594268 / -0.2% 209670989 / 204643195 / +2.5% 0.68 / 0.70 / -2.6%
clickbench_q40/datafusion:parquet 19886090 / 20414244 / -2.6% 76488047 / 77132444 / -0.8% 0.26 / 0.26 / -1.8%
clickbench_q41/datafusion:parquet 18861379 / 18925828 / -0.3% 74499332 / 75642329 / -1.5% 0.25 / 0.25 / +1.2%
clickbench_q42/datafusion:parquet 19114688 / 19249036 / -0.7% 74294332 / 74233923 / +0.1% 0.26 / 0.26 / -0.8%
duckdb / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2203008 / 2185384 / +0.8% 25470754 / 24803243 / +2.7% 0.09 / 0.09 / -1.8%
clickbench_q01/duckdb:vortex-file-compressed 7186062 / 7161398 / +0.3% 26073245 / 28089620 / -7.2% 0.28 / 0.25 / +8.1%
clickbench_q02/duckdb:vortex-file-compressed 8198250 / 8280574 / -1.0% 36112628 / 34205443 / +5.6% 0.23 / 0.24 / -6.2%
clickbench_q03/duckdb:vortex-file-compressed 14273052 / 14456872 / -1.3% 57549451 / 50244667 / +14.5% 🔴 0.25 / 0.29 / -13.8%
clickbench_q04/duckdb:vortex-file-compressed 55406466 / 56485081 / -1.9% 96847725 / 93760717 / +3.3% 0.57 / 0.60 / -5.0%
clickbench_q05/duckdb:vortex-file-compressed 63216102 / 64964185 / -2.7% 94932663 / 92919248 / +2.2% 0.67 / 0.70 / -4.8%
clickbench_q06/duckdb:vortex-file-compressed 2743377 / 2684998 / +2.2% 28318749 / 32371697 / -12.5% 🟢 0.10 / 0.08 / +16.8%
clickbench_q07/duckdb:vortex-file-compressed 8524838 / 8293078 / +2.8% 28359156 / 30198537 / -6.1% 0.30 / 0.27 / +9.5%
clickbench_q08/duckdb:vortex-file-compressed 67347676 / 68288933 / -1.4% 112557027 / 102890097 / +9.4% 0.60 / 0.66 / -9.8%
clickbench_q09/duckdb:vortex-file-compressed 88546940 / 89179366 / -0.7% 132744766 / 126156693 / +5.2% 0.67 / 0.71 / -5.6%
clickbench_q10/duckdb:vortex-file-compressed 26483102 / 26911918 / -1.6% 71287968 / 63933488 / +11.5% 🔴 0.37 / 0.42 / -11.7%
clickbench_q11/duckdb:vortex-file-compressed 28615242 / 28662850 / -0.2% 72235954 / 65830388 / +9.7% 0.40 / 0.44 / -9.0%
clickbench_q12/duckdb:vortex-file-compressed 70299394 / 70643473 / -0.5% 101850294 / 100792409 / +1.0% 0.69 / 0.70 / -1.5%
clickbench_q13/duckdb:vortex-file-compressed 124150443 / 126431593 / -1.8% 166029610 / 160389016 / +3.5% 0.75 / 0.79 / -5.1%
clickbench_q14/duckdb:vortex-file-compressed 72951532 / 74205783 / -1.7% 104514439 / 108268715 / -3.5% 0.70 / 0.69 / +1.8%
clickbench_q15/duckdb:vortex-file-compressed 74732051 / 75776702 / -1.4% 118523630 / 111665847 / +6.1% 0.63 / 0.68 / -7.1%
clickbench_q16/duckdb:vortex-file-compressed 136713746 / 145297051 / -5.9% 180530630 / 224063687 / -19.4% 🟢 0.76 / 0.65 / +16.8%
clickbench_q17/duckdb:vortex-file-compressed 137314160 / 142695395 / -3.8% 174529827 / 176372184 / -1.0% 0.79 / 0.81 / -2.8%
clickbench_q18/duckdb:vortex-file-compressed 254096038 / 260870388 / -2.6% 311288488 / 316628462 / -1.7% 0.82 / 0.82 / -0.9%
clickbench_q19/duckdb:vortex-file-compressed 9266631 / 9514586 / -2.6% 42157406 / 41395872 / +1.8% 0.22 / 0.23 / -4.4%
clickbench_q20/duckdb:vortex-file-compressed 65128104 / 64232854 / +1.4% 168214985 / 163903131 / +2.6% 0.39 / 0.39 / -1.2%
clickbench_q21/duckdb:vortex-file-compressed 94972419 / 96168886 / -1.2% 270077964 / 255574860 / +5.7% 0.35 / 0.38 / -6.5%
clickbench_q22/duckdb:vortex-file-compressed 171050213 / 171807171 / -0.4% 429220330 / 376463424 / +14.0% 🔴 0.40 / 0.46 / -12.7%
clickbench_q23/duckdb:vortex-file-compressed 33860910 / 34160306 / -0.9% 86031480 / 82042361 / +4.9% 0.39 / 0.42 / -5.5%
clickbench_q24/duckdb:vortex-file-compressed 13872373 / 13842003 / +0.2% 36499201 / 34875214 / +4.7% 0.38 / 0.40 / -4.2%
clickbench_q25/duckdb:vortex-file-compressed 18388262 / 18726360 / -1.8% 48428387 / 46002532 / +5.3% 0.38 / 0.41 / -6.7%
clickbench_q26/duckdb:vortex-file-compressed 11087188 / 11438484 / -3.1% 34859982 / 33714003 / +3.4% 0.32 / 0.34 / -6.3%
clickbench_q27/duckdb:vortex-file-compressed 52512184 / 53235400 / -1.4% 225201041 / 211893858 / +6.3% 0.23 / 0.25 / -7.2%
clickbench_q28/duckdb:vortex-file-compressed 510168375 / 512380540 / -0.4% 581665386 / 571544424 / +1.8% 0.88 / 0.90 / -2.2%
clickbench_q29/duckdb:vortex-file-compressed 17236484 / 17122516 / +0.7% 44941005 / 43378564 / +3.6% 0.38 / 0.39 / -2.8%
clickbench_q30/duckdb:vortex-file-compressed 59336012 / 59760769 / -0.7% 114225932 / 103360527 / +10.5% 🔴 0.52 / 0.58 / -10.2%
clickbench_q31/duckdb:vortex-file-compressed 110066152 / 109889283 / +0.2% 197300243 / 161956832 / +21.8% 🔴 0.56 / 0.68 / -17.8%
clickbench_q32/duckdb:vortex-file-compressed 365042675 / 388319538 / -6.0% 398814787 / 406197670 / -1.8% 0.92 / 0.96 / -4.3%
clickbench_q33/duckdb:vortex-file-compressed 339091118 / 343897273 / -1.4% 448838067 / 427170802 / +5.1% 0.76 / 0.81 / -6.2%
clickbench_q34/duckdb:vortex-file-compressed 360356737 / 366544268 / -1.7% 461609919 / 456670831 / +1.1% 0.78 / 0.80 / -2.7%
clickbench_q35/duckdb:vortex-file-compressed 56356760 / 57567756 / -2.1% 93299209 / 89254569 / +4.5% 0.60 / 0.64 / -6.3%
clickbench_q36/duckdb:vortex-file-compressed 11414720 / 11096531 / +2.9% 31927857 / 30258195 / +5.5% 0.36 / 0.37 / -2.5%
clickbench_q37/duckdb:vortex-file-compressed 7547544 / 7812192 / -3.4% 28189024 / 31495778 / -10.5% 🟢 0.27 / 0.25 / +7.9%
clickbench_q38/duckdb:vortex-file-compressed 8273932 / 8454372 / -2.1% 29371092 / 28049638 / +4.7% 0.28 / 0.30 / -6.5%
clickbench_q39/duckdb:vortex-file-compressed 19679660 / 19337154 / +1.8% 40851303 / 37998753 / +7.5% 0.48 / 0.51 / -5.3%
clickbench_q40/duckdb:vortex-file-compressed 6735832 / 6840441 / -1.5% 28148265 / 27832752 / +1.1% 0.24 / 0.25 / -2.6%
clickbench_q41/duckdb:vortex-file-compressed 7758022 / 7761936 / -0.1% 29021131 / 28624700 / +1.4% 0.27 / 0.27 / -1.4%
clickbench_q42/duckdb:vortex-file-compressed 7017751 / 7091379 / -1.0% 30288381 / 29011308 / +4.4% 0.23 / 0.24 / -5.2%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 11625908 / 11446490 / +1.6% 17894201 / 18181935 / -1.6% 0.65 / 0.63 / +3.2%
clickbench_q01/duckdb:parquet 17383769 / 16999100 / +2.3% 24012408 / 24649536 / -2.6% 0.72 / 0.69 / +5.0%
clickbench_q02/duckdb:parquet 23620014 / 24690012 / -4.3% 37398768 / 37097994 / +0.8% 0.63 / 0.67 / -5.1%
clickbench_q03/duckdb:parquet 24915308 / 24973711 / -0.2% 38051945 / 38322172 / -0.7% 0.65 / 0.65 / +0.5%
clickbench_q04/duckdb:parquet 63446342 / 63943681 / -0.8% 79352949 / 79284436 / +0.1% 0.80 / 0.81 / -0.9%
clickbench_q05/duckdb:parquet 84390072 / 87769402 / -3.9% 101304984 / 101281469 / +0.0% 0.83 / 0.87 / -3.9%
clickbench_q06/duckdb:parquet 22366412 / 22674612 / -1.4% 33570787 / 33325024 / +0.7% 0.67 / 0.68 / -2.1%
clickbench_q07/duckdb:parquet 18905348 / 18699320 / +1.1% 25891116 / 26245246 / -1.3% 0.73 / 0.71 / +2.5%
clickbench_q08/duckdb:parquet 76374476 / 78170826 / -2.3% 91471120 / 93546564 / -2.2% 0.83 / 0.84 / -0.1%
clickbench_q09/duckdb:parquet 104962598 / 104335634 / +0.6% 122655845 / 123422054 / -0.6% 0.86 / 0.85 / +1.2%
clickbench_q10/duckdb:parquet 42180672 / 43553135 / -3.2% 59338749 / 60318314 / -1.6% 0.71 / 0.72 / -1.6%
clickbench_q11/duckdb:parquet 47266230 / 47708106 / -0.9% 62908386 / 68807005 / -8.6% 0.75 / 0.69 / +8.4%
clickbench_q12/duckdb:parquet 95002184 / 95070530 / -0.1% 114610410 / 116873490 / -1.9% 0.83 / 0.81 / +1.9%
clickbench_q13/duckdb:parquet 151621798 / 154408776 / -1.8% 177865942 / 177080389 / +0.4% 0.85 / 0.87 / -2.2%
clickbench_q14/duckdb:parquet 102550366 / 104719660 / -2.1% 126055961 / 127524854 / -1.2% 0.81 / 0.82 / -0.9%
clickbench_q15/duckdb:parquet 88891384 / 90307218 / -1.6% 105705338 / 106140314 / -0.4% 0.84 / 0.85 / -1.2%
clickbench_q16/duckdb:parquet 177999618 / 176890878 / +0.6% 189605811 / 189745234 / -0.1% 0.94 / 0.93 / +0.7%
clickbench_q17/duckdb:parquet 173486380 / 177548459 / -2.3% 194335363 / 192755245 / +0.8% 0.89 / 0.92 / -3.1%
clickbench_q18/duckdb:parquet 305647038 / 319446030 / -4.3% 334184468 / 336546928 / -0.7% 0.91 / 0.95 / -3.6%
clickbench_q19/duckdb:parquet 22109118 / 22114940 / -0.0% 30068292 / 30908078 / -2.7% 0.74 / 0.72 / +2.8%
clickbench_q20/duckdb:parquet 185382148 / 193156502 / -4.0% 234455965 / 235893013 / -0.6% 0.79 / 0.82 / -3.4%
clickbench_q21/duckdb:parquet 230650902 / 217315846 / +6.1% 268415359 / 270382143 / -0.7% 0.86 / 0.80 / +6.9%
clickbench_q22/duckdb:parquet 325345916 / 322350706 / +0.9% 358024726 / 368468845 / -2.8% 0.91 / 0.87 / +3.9%
clickbench_q23/duckdb:parquet 168172974 / 170797312 / -1.5% 234542721 / 264409707 / -11.3% 🟢 0.72 / 0.65 / +11.0%
clickbench_q24/duckdb:parquet 31660822 / 32370188 / -2.2% 40960278 / 46481840 / -11.9% 🟢 0.77 / 0.70 / +11.0%
clickbench_q25/duckdb:parquet 43787535 / 44072520 / -0.6% 61924839 / 60759768 / +1.9% 0.71 / 0.73 / -2.5%
clickbench_q26/duckdb:parquet 32442690 / 32722441 / -0.9% 51779644 / 53971736 / -4.1% 0.63 / 0.61 / +3.3%
clickbench_q27/duckdb:parquet 189515577 / 192449606 / -1.5% 231307698 / 230927315 / +0.2% 0.82 / 0.83 / -1.7%
clickbench_q28/duckdb:parquet 979446718 / 988829818 / -0.9% 976739754 / 989346691 / -1.3% 1.00 / 1.00 / +0.3%
clickbench_q29/duckdb:parquet 26142624 / 26301932 / -0.6% 35040311 / 34432593 / +1.8% 0.75 / 0.76 / -2.3%
clickbench_q30/duckdb:parquet 109370430 / 107112883 / +2.1% 135562956 / 135739431 / -0.1% 0.81 / 0.79 / +2.2%
clickbench_q31/duckdb:parquet 150226476 / 160198344 / -6.2% 183298660 / 205712944 / -10.9% 🟢 0.82 / 0.78 / +5.2%
clickbench_q32/duckdb:parquet 393283316 / 394035286 / -0.2% 416897423 / 420713496 / -0.9% 0.94 / 0.94 / +0.7%
clickbench_q33/duckdb:parquet 483183206 / 493957058 / -2.2% 477497672 / 465351597 / +2.6% 1.01 / 1.06 / -4.7%
clickbench_q34/duckdb:parquet 474555914 / 487689708 / -2.7% 466715339 / 483442060 / -3.5% 1.02 / 1.01 / +0.8%
clickbench_q35/duckdb:parquet 63651563 / 63950934 / -0.5% 78915958 / 78487512 / +0.5% 0.81 / 0.81 / -1.0%
clickbench_q36/duckdb:parquet 32408878 / 31936322 / +1.5% 39807582 / 41033228 / -3.0% 0.81 / 0.78 / +4.6%
clickbench_q37/duckdb:parquet 24546682 / 25242250 / -2.8% 34328630 / 33906029 / +1.2% 0.72 / 0.74 / -4.0%
clickbench_q38/duckdb:parquet 24750486 / 26079954 / -5.1% 35090053 / 34432085 / +1.9% 0.71 / 0.76 / -6.9%
clickbench_q39/duckdb:parquet 55356567 / 54560667 / +1.5% 63139816 / 63892240 / -1.2% 0.88 / 0.85 / +2.7%
clickbench_q40/duckdb:parquet 16179606 / 16210026 / -0.2% 25234932 / 24979238 / +1.0% 0.64 / 0.65 / -1.2%
clickbench_q41/duckdb:parquet 16680282 / 16487228 / +1.2% 24382219 / 25543724 / -4.5% 0.68 / 0.65 / +6.0%
clickbench_q42/duckdb:parquet 15647825 / 16052710 / -2.5% 25167203 / 24745673 / +1.7% 0.62 / 0.65 / -4.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR f0752c6b vs base 891c01ab
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (-1.8%, environment too noisy confidence) · DuckDB No clear signal (+4.8%, environment too noisy confidence)
Vortex (geomean): hot 0.976x ➖ · cold 1.000x ➖
Parquet (geomean): hot 0.962x ➖ · cold 0.961x ➖
Shifts: Parquet (control) -3.8% · Median polish -4.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.936x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 239307498 / 260739919 / -8.2% 740003789 / 1045240414 / -29.2% 0.32 / 0.25 / +29.6%
tpch_q02/datafusion:vortex-file-compressed 327202691 / 333333245 / -1.8% 711276367 / 712448519 / -0.2% 0.46 / 0.47 / -1.7%
tpch_q03/datafusion:vortex-file-compressed 392853766 / 383531435 / +2.4% 996355348 / 955423135 / +4.3% 0.39 / 0.40 / -1.8%
tpch_q04/datafusion:vortex-file-compressed 189632370 / 310419130 / -38.9% 🟢 430765262 / 403334928 / +6.8% 0.44 / 0.77 / -42.8%
tpch_q05/datafusion:vortex-file-compressed 381026435 / 398464394 / -4.4% 785953189 / 598486209 / +31.3% 🔴 0.48 / 0.67 / -27.2%
tpch_q06/datafusion:vortex-file-compressed 133148103 / 151113156 / -11.9% 306169453 / 302634044 / +1.2% 0.43 / 0.50 / -12.9%
tpch_q07/datafusion:vortex-file-compressed 404625984 / 406238709 / -0.4% 565593631 / 622000099 / -9.1% 0.72 / 0.65 / +9.5%
tpch_q08/datafusion:vortex-file-compressed 779565667 / 425174121 / +83.4% 🔴 664793690 / 606342707 / +9.6% 1.17 / 0.70 / +67.2%
tpch_q09/datafusion:vortex-file-compressed 370528572 / 359753987 / +3.0% 556067202 / 871734982 / -36.2% 🟢 0.67 / 0.41 / +61.5%
tpch_q10/datafusion:vortex-file-compressed 340111811 / 344712003 / -1.3% 507739403 / 540785906 / -6.1% 0.67 / 0.64 / +5.1%
tpch_q11/datafusion:vortex-file-compressed 259351993 / 250509342 / +3.5% 656791091 / 391965589 / +67.6% 🔴 0.39 / 0.64 / -38.2%
tpch_q12/datafusion:vortex-file-compressed 197417640 / 273914859 / -27.9% 323414432 / 486262401 / -33.5% 🟢 0.61 / 0.56 / +8.4%
tpch_q13/datafusion:vortex-file-compressed 137926081 / 307745424 / -55.2% 🟢 317652194 / 330993647 / -4.0% 0.43 / 0.93 / -53.3%
tpch_q14/datafusion:vortex-file-compressed 200136810 / 179075550 / +11.8% 345259655 / 397872165 / -13.2% 0.58 / 0.45 / +28.8%
tpch_q15/datafusion:vortex-file-compressed 347270018 / 290829033 / +19.4% 770957194 / 503657670 / +53.1% 🔴 0.45 / 0.58 / -22.0%
tpch_q16/datafusion:vortex-file-compressed 125376440 / 144949507 / -13.5% 303546250 / 279664085 / +8.5% 0.41 / 0.52 / -20.3%
tpch_q17/datafusion:vortex-file-compressed 414087271 / 447215647 / -7.4% 657283302 / 605061992 / +8.6% 0.63 / 0.74 / -14.8%
tpch_q18/datafusion:vortex-file-compressed 231654117 / 264902161 / -12.6% 413389770 / 1033628850 / -60.0% 🟢 0.56 / 0.26 / +118.7%
tpch_q19/datafusion:vortex-file-compressed 221631069 / 270664389 / -18.1% 397521027 / 361833728 / +9.9% 0.56 / 0.75 / -25.5%
tpch_q20/datafusion:vortex-file-compressed 262124465 / 280873590 / -6.7% 390989176 / 456430707 / -14.3% 0.67 / 0.62 / +8.9%
tpch_q21/datafusion:vortex-file-compressed 443959120 / 454896302 / -2.4% 649034907 / 679684215 / -4.5% 0.68 / 0.67 / +2.2%
tpch_q22/datafusion:vortex-file-compressed 192079877 / 170775528 / +12.5% 390856740 / 477314972 / -18.1% 0.49 / 0.36 / +37.4%
datafusion / parquet / ns (0.952x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 149682193 / 167415846 / -10.6% 500765435 / 503697585 / -0.6% 0.30 / 0.33 / -10.1%
tpch_q02/datafusion:parquet 328702870 / 324008613 / +1.4% 664490588 / 597398268 / +11.2% 0.49 / 0.54 / -8.8%
tpch_q03/datafusion:parquet 254144099 / 405053242 / -37.3% 🟢 744190040 / 673796158 / +10.4% 0.34 / 0.60 / -43.2%
tpch_q04/datafusion:parquet 149283707 / 143139452 / +4.3% 280495922 / 369662336 / -24.1% 0.53 / 0.39 / +37.4%
tpch_q05/datafusion:parquet 348790781 / 368248173 / -5.3% 488407639 / 484928022 / +0.7% 0.71 / 0.76 / -6.0%
tpch_q06/datafusion:parquet 121873773 / 115851222 / +5.2% 299734742 / 272143174 / +10.1% 0.41 / 0.43 / -4.5%
tpch_q07/datafusion:parquet 343751341 / 340458322 / +1.0% 469537592 / 464042325 / +1.2% 0.73 / 0.73 / -0.2%
tpch_q08/datafusion:parquet 409990611 / 465668927 / -12.0% 515670638 / 618218742 / -16.6% 0.80 / 0.75 / +5.6%
tpch_q09/datafusion:parquet 432878913 / 392473476 / +10.3% 617041238 / 560325035 / +10.1% 0.70 / 0.70 / +0.2%
tpch_q10/datafusion:parquet 295174305 / 332432232 / -11.2% 454321853 / 541199686 / -16.1% 0.65 / 0.61 / +5.8%
tpch_q11/datafusion:parquet 312111117 / 278087225 / +12.2% 457720061 / 380484858 / +20.3% 0.68 / 0.73 / -6.7%
tpch_q12/datafusion:parquet 157346426 / 165997461 / -5.2% 281056227 / 316161542 / -11.1% 0.56 / 0.53 / +6.6%
tpch_q13/datafusion:parquet 278606333 / 279471624 / -0.3% 383978242 / 474101863 / -19.0% 0.73 / 0.59 / +23.1%
tpch_q14/datafusion:parquet 169000141 / 187879913 / -10.0% 316585594 / 287864976 / +10.0% 0.53 / 0.65 / -18.2%
tpch_q15/datafusion:parquet 302438329 / 323097110 / -6.4% 456209958 / 465887599 / -2.1% 0.66 / 0.69 / -4.4%
tpch_q16/datafusion:parquet 107551589 / 109814445 / -2.1% 245266898 / 220085632 / +11.4% 0.44 / 0.50 / -12.1%
tpch_q17/datafusion:parquet 277653656 / 292567108 / -5.1% 403330420 / 385533714 / +4.6% 0.69 / 0.76 / -9.3%
tpch_q18/datafusion:parquet 314906044 / 309412298 / +1.8% 465717643 / 513005245 / -9.2% 0.68 / 0.60 / +12.1%
tpch_q19/datafusion:parquet 164562589 / 188318873 / -12.6% 332907923 / 349647045 / -4.8% 0.49 / 0.54 / -8.2%
tpch_q20/datafusion:parquet 245467925 / 255185025 / -3.8% 390663283 / 418180316 / -6.6% 0.63 / 0.61 / +3.0%
tpch_q21/datafusion:parquet 314041418 / 326915108 / -3.9% 830411271 / 446330776 / +86.1% 🔴 0.38 / 0.73 / -48.4%
tpch_q22/datafusion:parquet 158130162 / 162023086 / -2.4% 326659747 / 327659885 / -0.3% 0.48 / 0.49 / -2.1%
duckdb / vortex-file-compressed / ns (1.018x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 247554656 / 245897276 / +0.7% 254589204 / 258322247 / -1.4% 0.97 / 0.95 / +2.2%
tpch_q02/duckdb:vortex-file-compressed 389694993 / 442412058 / -11.9% 453180526 / 474787124 / -4.6% 0.86 / 0.93 / -7.7%
tpch_q03/duckdb:vortex-file-compressed 427434354 / 389367838 / +9.8% 464815283 / 491253313 / -5.4% 0.92 / 0.79 / +16.0%
tpch_q04/duckdb:vortex-file-compressed 225256627 / 260481861 / -13.5% 260045250 / 288691782 / -9.9% 0.87 / 0.90 / -4.0%
tpch_q05/duckdb:vortex-file-compressed 527878525 / 521588305 / +1.2% 536610700 / 667138476 / -19.6% 0.98 / 0.78 / +25.8%
tpch_q06/duckdb:vortex-file-compressed 181752512 / 214016600 / -15.1% 210168934 / 195999473 / +7.2% 0.86 / 1.09 / -20.8%
tpch_q07/duckdb:vortex-file-compressed 401479209 / 424592303 / -5.4% 503583291 / 535445839 / -6.0% 0.80 / 0.79 / +0.5%
tpch_q08/duckdb:vortex-file-compressed 573498525 / 727743250 / -21.2% 632929379 / 648030041 / -2.3% 0.91 / 1.12 / -19.3%
tpch_q09/duckdb:vortex-file-compressed 520583674 / 383286656 / +35.8% 🔴 616026692 / 449702130 / +37.0% 🔴 0.85 / 0.85 / -0.9%
tpch_q10/duckdb:vortex-file-compressed 504453863 / 510643170 / -1.2% 513455267 / 562587416 / -8.7% 0.98 / 0.91 / +8.2%
tpch_q11/duckdb:vortex-file-compressed 302370684 / 273774795 / +10.4% 317608889 / 277687015 / +14.4% 0.95 / 0.99 / -3.4%
tpch_q12/duckdb:vortex-file-compressed 269994869 / 229779422 / +17.5% 361179462 / 263051965 / +37.3% 🔴 0.75 / 0.87 / -14.4%
tpch_q13/duckdb:vortex-file-compressed 299588051 / 279915480 / +7.0% 271575369 / 213771812 / +27.0% 1.10 / 1.31 / -15.8%
tpch_q14/duckdb:vortex-file-compressed 221560472 / 217888167 / +1.7% 332703062 / 281124814 / +18.3% 0.67 / 0.78 / -14.1%
tpch_q15/duckdb:vortex-file-compressed 236783875 / 239005466 / -0.9% 303875516 / 262597736 / +15.7% 0.78 / 0.91 / -14.4%
tpch_q16/duckdb:vortex-file-compressed 259092139 / 220948520 / +17.3% 277977051 / 239843552 / +15.9% 0.93 / 0.92 / +1.2%
tpch_q17/duckdb:vortex-file-compressed 313054556 / 502850874 / -37.7% 🟢 408879668 / 404967111 / +1.0% 0.77 / 1.24 / -38.3%
tpch_q18/duckdb:vortex-file-compressed 362724841 / 316093571 / +14.8% 595574663 / 315713240 / +88.6% 🔴 0.61 / 1.00 / -39.2%
tpch_q19/duckdb:vortex-file-compressed 279737800 / 296517320 / -5.7% 310973536 / 372645475 / -16.5% 0.90 / 0.80 / +13.1%
tpch_q20/duckdb:vortex-file-compressed 682837698 / 434448811 / +57.2% 🔴 576920560 / 679849007 / -15.1% 1.18 / 0.64 / +85.2%
tpch_q21/duckdb:vortex-file-compressed 668647531 / 616671392 / +8.4% 674447113 / 633842813 / +6.4% 0.99 / 0.97 / +1.9%
tpch_q22/duckdb:vortex-file-compressed 265519124 / 244278004 / +8.7% 294574654 / 327062676 / -9.9% 0.90 / 0.75 / +20.7%
duckdb / parquet / ns (0.972x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 175751229 / 163138582 / +7.7% 253407633 / 199820808 / +26.8% 0.69 / 0.82 / -15.1%
tpch_q02/duckdb:parquet 438265668 / 481274333 / -8.9% 402023486 / 548580722 / -26.7% 1.09 / 0.88 / +24.3%
tpch_q03/duckdb:parquet 391505037 / 416157799 / -5.9% 413431551 / 481553153 / -14.1% 0.95 / 0.86 / +9.6%
tpch_q04/duckdb:parquet 271719783 / 334023601 / -18.7% 325003932 / 380043612 / -14.5% 0.84 / 0.88 / -4.9%
tpch_q05/duckdb:parquet 504535175 / 473475494 / +6.6% 552482409 / 559230746 / -1.2% 0.91 / 0.85 / +7.9%
tpch_q06/duckdb:parquet 153858463 / 189252116 / -18.7% 189237119 / 229629198 / -17.6% 0.81 / 0.82 / -1.3%
tpch_q07/duckdb:parquet 403185894 / 460004495 / -12.4% 383323445 / 578423183 / -33.7% 🟢 1.05 / 0.80 / +32.3%
tpch_q08/duckdb:parquet 662630578 / 663709067 / -0.2% 620734437 / 587447056 / +5.7% 1.07 / 1.13 / -5.5%
tpch_q09/duckdb:parquet 573576734 / 543506644 / +5.5% 592722488 / 2456037320 / -75.9% 🟢 0.97 / 0.22 / +337.3%
tpch_q10/duckdb:parquet 569717325 / 559602258 / +1.8% 614313075 / 517171436 / +18.8% 0.93 / 1.08 / -14.3%
tpch_q11/duckdb:parquet 315948333 / 308794271 / +2.3% 382038396 / 353286591 / +8.1% 0.83 / 0.87 / -5.4%
tpch_q12/duckdb:parquet 263302022 / 269096406 / -2.2% 277815956 / 288791261 / -3.8% 0.95 / 0.93 / +1.7%
tpch_q13/duckdb:parquet 390418686 / 355205012 / +9.9% 430844954 / 422882673 / +1.9% 0.91 / 0.84 / +7.9%
tpch_q14/duckdb:parquet 272273315 / 309557325 / -12.0% 319709270 / 281657120 / +13.5% 0.85 / 1.10 / -22.5%
tpch_q15/duckdb:parquet 225855575 / 187661774 / +20.4% 261640800 / 240681775 / +8.7% 0.86 / 0.78 / +10.7%
tpch_q16/duckdb:parquet 274000992 / 292080096 / -6.2% 307022873 / 301444774 / +1.9% 0.89 / 0.97 / -7.9%
tpch_q17/duckdb:parquet 283236355 / 298033823 / -5.0% 319975532 / 351915656 / -9.1% 0.89 / 0.85 / +4.5%
tpch_q18/duckdb:parquet 322776538 / 341621973 / -5.5% 415046460 / 407999890 / +1.7% 0.78 / 0.84 / -7.1%
tpch_q19/duckdb:parquet 250820314 / 269437732 / -6.9% 360068208 / 326747527 / +10.2% 0.70 / 0.82 / -15.5%
tpch_q20/duckdb:parquet 422040467 / 462508396 / -8.7% 433874385 / 506466728 / -14.3% 0.97 / 0.91 / +6.5%
tpch_q21/duckdb:parquet 517017612 / 490065775 / +5.5% 496841863 / 451371123 / +10.1% 1.04 / 1.09 / -4.2%
tpch_q22/duckdb:parquet 299833522 / 303373189 / -1.2% 319941594 / 343873696 / -7.0% 0.94 / 0.88 / +6.2%

@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 4960855 to 02d9b08 Compare October 26, 2026 14:46
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 02d9b08 to ba0fb42 Compare October 26, 2026 16:30
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from ba0fb42 to 78afd60 Compare October 26, 2026 17:28
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 78afd60 to 06c0701 Compare October 26, 2026 21:51
@joseph-isaacs joseph-isaacs added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR and removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 26, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 06c0701 to bef7c23 Compare October 26, 2026 22:59
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 26, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 4e32a01 to 75af0e4 Compare October 29, 2026 11:44
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs changed the title Speed up V2 scans and default datafusion-bench to V2 for TPC-DS and ClickBench Improve V2 scan feedback and sparse TopK payload retrieval Oct 29, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from 8f49581 to e503266 Compare October 29, 2026 14:34
@joseph-isaacs joseph-isaacs changed the title Improve V2 scan feedback and sparse TopK payload retrieval Speed up V2 scans and default datafusion-bench to V2 for TPC-DS and ClickBench Oct 29, 2026
joseph-isaacs and others added 6 commits October 29, 2026 14:44
A V2 scan reads each chunk through a session of its own, and the file's
segment source shares a read only while it is in flight. A stored segment
that spans a chunk boundary was therefore read again by every chunk that
started after its neighbour had finished, and by every partition and every
concurrent scan of the file. TPC-DS q28 on SF1 read 188 MB where V1 reads
114 MB, every segment V1 reads up to two and a half times as often.

The file's ScanCache now retains up to 64 MiB of recently read host
segments in least-recently-used order, and every scan of the file reads
through it. ScanCache::with_retained_bytes sets the budget; zero disables
it. q28 now reads 125 MB.

TPC-DS SF1 on DataFusion, V2 vs V1 geomean: 1.052 -> 1.002.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Codex <codex@openai.com>
TPC-H already defaults to the planner-driven V2 scan. Extend the default to
TPC-DS and ClickBench so the SQL benchmarks measure V2 on them too.
`--scan-v2 false` or `VORTEX_SCAN_V2=0` still selects V1.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Codex <codex@openai.com>
The V2 scan cache keyed filter and projection plans by `ExactBoundExpr`,
which compares children by pointer. DataFusion opens each partition of a
file separately and binds its predicate and projection anew, so no
partition ever found the plans another had built: every partition lowered
its own filter plans, optimized its own projection and re-evaluated the
zone maps. The cost scales with the partition count, so TPC-DS q09 and
q28 ran twice as long as V1 on the 32-core benchmark runners.

Key the cache by structure instead. Hashing walks the scalar functions
and skips dtypes, so a lookup does not walk a wide schema; equality still
compares dtypes. Both walk the tree iteratively.

Locally (4 cores, 32 partitions), q09/q13/q28/q44/q48 go from a 1.41x
geomean of V1 to 1.15x, and q28 from 1.57x to 1.15x.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Codex <codex@openai.com>
A V2 scan cuts its rows on a fixed grid in the file's row domain, but
DataFusion's partition edges fall off that grid. Every partition of a
filtered scan then planned a sliver at its edge: TPC-DS q28 at 32
partitions cut each 90,112-row partition into chunks of 81,920 and 8,192
rows. The sliver costs a whole chunk's pipeline compile and conjunct
setup, which dominates a selective filter over few rows.

The chunk planner now joins an edge chunk under half a chunk to its
neighbour; interior boundaries stay on the grid. Locally at 32
partitions, q28's V2 CPU time falls from 1.32x V1 to 1.10x and its wall
time matches V1.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LYor8ydYMRcjUSh622VTEC
Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Codex <codex@openai.com>
Expose encoded values for large string dictionaries when a batch selects fewer than one sixteenth of their entries. Encoding-specific take kernels can then gather the selected values without canonicalizing the whole dictionary. Keep shared decoding for small and denser takes, and reuse any already-cached canonical values.

Cover nullable UTF-8 and binary values, nullable codes, and dictionary cache reuse in the pipeline tests.

Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Codex <codex@openai.com>

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from e503266 to f0752c6 Compare October 29, 2026 14:44
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs
joseph-isaacs marked this pull request as ready for review October 29, 2026 15:05
@joseph-isaacs
joseph-isaacs merged commit 705911c into develop Oct 29, 2026
144 of 145 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/scan-v2-clickbench-tpcds branch October 29, 2026 15:21
joseph-isaacs added a commit that referenced this pull request Oct 29, 2026
Rebased onto develop as one commit. Conflicts with #10799 resolved:
- The scan cache keeps develop's structural ExprKey and retained
  segments, with this branch's build-once OnceCell entries.
- A filtered chunk is sized by concurrency up to develop's per-shape cap
  (128Ki rows, or 1Mi for one fixed-width field), never below 64Ki.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBEEc3okQ7JZh6AZDur
joseph-isaacs added a commit that referenced this pull request Oct 29, 2026
Reconcile with merged #10799 and leave overlapping scheduling and read
ownership policies to #10789, #10857, and #10969. Preserve current develop's
structural cache, sparse dictionary threshold, chunk sizing, short-edge
merging, retained segments, and benchmark defaults.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
joseph-isaacs added a commit that referenced this pull request Oct 30, 2026
Rebased onto develop as one commit. Conflicts with #10799 resolved:
- The scan cache keeps develop's structural ExprKey and retained
  segments, with this branch's build-once OnceCell entries.
- A filtered chunk is sized by concurrency up to develop's per-shape cap
  (128Ki rows, or 1Mi for one fixed-width field), never below 64Ki.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBEEc3okQ7JZh6AZDur
@joseph-isaacs joseph-isaacs mentioned this pull request Nov 9, 2026
16 of 46 tasks
joseph-isaacs added a commit that referenced this pull request Nov 16, 2026
Rebased onto develop as one commit. Conflicts with #10799 resolved:
- The scan cache keeps develop's structural ExprKey and retained
  segments, with this branch's build-once OnceCell entries.
- A filtered chunk is sized by concurrency up to develop's per-shape cap
  (128Ki rows, or 1Mi for one fixed-width field), never below 64Ki.

Rebased again onto develop. Conflicts resolved:
- The filter planner keeps develop's dynamic-conjunct skipping, with
  the conjunct's version held beside its MaskScan.
- Filter plans built once per filter still honour develop's
  skip_unselective_dynamic: a scan whose setting differs from the cached
  plans plans its own.
- Roots lower through Layout::new_plan, and is_identity_expression keeps
  develop's bool return.
- v2_inline_chunks_read_through_their_own_sessions now sets
  scan_concurrency 1: 0 means unset here, and 1 is what runs inline.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBEEc3okQ7JZh6AZDur
Claude-Session: https://claude.ai/code/session_01UeniB9i8ce2ie4BaCQkHSc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants