Skip to content

Dispatch structural kernels by physical width - #10841

Merged
connortsui20 merged 4 commits into
developfrom
ct/physical-width-dispatch
Oct 27, 2026
Merged

connortsui20 merged 4 commits into
developfrom
ct/physical-width-dispatch

Conversation

@connortsui20

@connortsui20 connortsui20 commented Oct 26, 2026 •

Copy link
Copy Markdown
Member

Summary

Follow-up to #10740. Kernels that only copy or compare stored bits can share code across signed, unsigned, and floating-point types of the same width.

Changes

  • Add typed width adapters that forward to a shared power-of-two byte-width dispatcher.
  • Use byte records in primitive patch, zip, fill-null, interleave, and is-constant kernels, plus shared fixed-width take/filter and filtered take.
  • Add tests for dispatch contracts, floating-point bit patterns, buffer ownership, and decimal alignment.

API Changes

match_each_ptype_width!, match_each_decimal_type_width!, and match_each_power_of_two_width! bind a const W: usize, with an explicit fallback for unsupported widths and an optional specialization list.

Validation: pinned nightly formatting, scoped Clippy with all targets and features and -D warnings, 100 focused tests, and seven width doctests pass.

Code size comparison

Compared base a59294e35e with 77a96de1c0 using separate checkouts and target directories. Both use rustc 1.99.1, LLVM 23.1.1, aarch64-apple-darwin, the release profile (opt-level 3, one codegen unit, LTO off), package default features, and the repository's frame-pointer flag.

Machine-code bytes from Mach-O __text sections:

Artifact Base PR Change
vortex-buffer library 34,448 34,448 0
vortex-array library 11,646,740 11,508,116 -138,624 (-1.19%)
vortex-fastlanes library 2,719,444 2,719,444 0
Linked vx binary 74,396,028 74,357,628 -38,400 (-0.052%)

The linked vx file also shrinks from 120,844,528 to 120,779,936 bytes (-64,592). Library totals exclude Rust metadata. Small archive increases in vortex-buffer and vortex-fastlanes come from metadata, while their machine sections are unchanged.

Commands run in each checkout:

cargo build --release --locked -p vortex-buffer -p vortex-array -p vortex-fastlanes --message-format=json-render-diagnostics
cargo build --release --locked -p vortex-tui --bin vx --message-format=json-render-diagnostics
llvm-size --format=sysv --radix=10 <artifact>

These measurements cover this target and profile. Runtime benchmarks were not run locally.

@connortsui20
connortsui20 marked this pull request as draft October 26, 2026 20:43
@connortsui20 connortsui20 added the changelog/performance A performance improvement label Oct 26, 2026 — with ChatGPT Codex Connector
@codspeed

codspeed Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Merging this PR will regress 3 benchmarks

4 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ Unable to measure the execution of 3 benchmarks

These benchmarks measured no execution time, so their results are not comparable and count as unchanged. This usually happens when the compiler removes the code under test.

Prevent compiler optimizations

See affected benchmarks

⚠️ 24 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

ℹ️ 40 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

⚡ 15 improved benchmarks
❌ 3 regressed benchmarks
✅ 2421 untouched benchmarks
⏩ 116 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation chunked_dict_primitive_canonical_into[f64, (1000, 1000, 10)] 141 µs 202.1 µs -30.23%
❌ CPU Simulation missing_stats[16] 70.4 µs 89.5 µs -21.33%
❌ CPU Simulation test_scan_scalar_at[int_str_float] 1.1 ms 1.3 ms -10.96%
⚡ CPU Simulation bench_compare_varbin[(10000, 128)] 99.8 µs 65.6 µs +52.23%
⚡ CPU Simulation bench_compare_varbin[(50000, 8)] 165.3 µs 135.4 µs +22.08%
⚡ CPU Simulation bench_compare_varbin[(50000, 4)] 164.2 µs 134.5 µs +22.08%
⚡ CPU Simulation bench_compare_varbin[(50000, 32)] 165.5 µs 135.7 µs +21.94%
⚡ CPU Simulation bench_compare_varbin[(50000, 128)] 167.5 µs 137.6 µs +21.69%
⚡ CPU Simulation take_filter_primitive_small_uncached_random_mask_random_indices[4096, 10] 23.4 µs 19.5 µs +20.05%
⚡ CPU Simulation bench_compare_sliced_dict_varbinview[(7500, 10000)] 230.2 µs 194.1 µs +18.62%
⚡ CPU Simulation bench_compare_varbin[(50000, 512)] 216.9 µs 187 µs +15.97%
⚡ CPU Simulation bench_compare_sliced_dict_varbinview[(10000, 10000)] 236.5 µs 208.2 µs +13.57%
⚡ CPU Simulation bench_compare_sliced_dict_varbinview[(1000, 10000)] 92.4 µs 81.5 µs +13.43%
⚡ CPU Simulation random_i8[0.01] 114.8 µs 101.8 µs +12.75%
⚡ CPU Simulation fsl_i32[16, 0.01] 17.6 µs 15.7 µs +11.92%
⚡ CPU Simulation primitive_mixed_constants[round_robin/n2/null] 344.1 µs 311.2 µs +10.58%
⚡ CPU Simulation bench_compare_sliced_dict_primitive[(2000, 10000)] 75.3 µs 68.2 µs +10.41%
⚡ CPU Simulation primitive_mixed_constants[round_robin/n2/nonnull] 362.8 µs 329.6 µs +10.1%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/physical-width-dispatch (f0517af) with develop (fb4a037)

Open in CodSpeed

Footnotes

  1. 116 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@connortsui20
connortsui20 marked this pull request as ready for review October 26, 2026 21:45
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026
@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 77a96de clickbench-nvme 1 Explore Profiling Data
🟢 Done 77a96de polarsignals 1 Explore Profiling Data
🟢 Done 77a96de tpch-nvme-10 1 Explore Profiling Data
🟢 Done 77a96de fineweb 1 Explore Profiling Data
🟢 Done 77a96de tpch-nvme 1 Explore Profiling Data
🟢 Done 77a96de tpch-s3 1 Explore Profiling Data
🟢 Done 77a96de tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 77a96de1 vs base a59294e3
Vortex (geomean): hot 1.000x ➖ · cold 1.097x ➖


datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44717868 / 45011382 / -0.7% 95711854 / 88007719 / +8.8% 0.47 / 0.51 / -8.6%
polarsignals_q01/datafusion:vortex-file-compressed 50377171 / 50433898 / -0.1% 116726249 / 108330595 / +7.8% 0.43 / 0.47 / -7.3%
polarsignals_q02/datafusion:vortex-file-compressed 43541038 / 43567031 / -0.1% 87175900 / 84151315 / +3.6% 0.50 / 0.52 / -3.5%
polarsignals_q03/datafusion:vortex-file-compressed 52818576 / 54488600 / -3.1% 118808496 / 109979388 / +8.0% 0.44 / 0.50 / -10.3%
polarsignals_q04/datafusion:vortex-file-compressed 9156304 / 9238203 / -0.9% 52463063 / 41520899 / +26.4% 🔴 0.17 / 0.22 / -21.6%
polarsignals_q05/datafusion:vortex-file-compressed 12009914 / 11885060 / +1.1% 53296068 / 44900381 / +18.7% 🔴 0.23 / 0.26 / -14.9%
polarsignals_q06/datafusion:vortex-file-compressed 23182954 / 23257970 / -0.3% 66092252 / 56113443 / +17.8% 🔴 0.35 / 0.41 / -15.4%
polarsignals_q07/datafusion:vortex-file-compressed 10978214 / 11152574 / -1.6% 52034210 / 50312612 / +3.4% 0.21 / 0.22 / -4.8%
polarsignals_q08/datafusion:vortex-file-compressed 97441900 / 97486556 / -0.0% 162842800 / 161295449 / +1.0% 0.60 / 0.60 / -1.0%
polarsignals_q09/datafusion:vortex-file-compressed 10220282 / 9675708 / +5.6% 51706665 / 49625506 / +4.2% 0.20 / 0.19 / +1.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 77a96de1 vs base a59294e3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-2.1%, low confidence) · DuckDB No clear signal (+2.0%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.992x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.011x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.973x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7041648 / 6904037 / +2.0% 13568117 / 17293393 / -21.5% 🟢 0.52 / 0.40 / +30.0%
fineweb_q01/datafusion:vortex-file-compressed 7650426 / 8055758 / -5.0% 38655575 / 45881798 / -15.7% 🟢 0.20 / 0.18 / +12.7%
fineweb_q02/datafusion:vortex-file-compressed 9185118 / 9256510 / -0.8% 40444552 / 49871020 / -18.9% 🟢 0.23 / 0.19 / +22.4%
fineweb_q03/datafusion:vortex-file-compressed 20175876 / 20307072 / -0.6% 108948924 / 114517256 / -4.9% 0.19 / 0.18 / +4.4%
fineweb_q04/datafusion:vortex-file-compressed 66581226 / 67140125 / -0.8% 151204982 / 153437230 / -1.5% 0.44 / 0.44 / +0.6%
fineweb_q05/datafusion:vortex-file-compressed 67906580 / 67748338 / +0.2% 151502580 / 151452004 / +0.0% 0.45 / 0.45 / +0.2%
fineweb_q06/datafusion:vortex-file-compressed 19247952 / 19558984 / -1.6% 112601781 / 113185998 / -0.5% 0.17 / 0.17 / -1.1%
fineweb_q07/datafusion:vortex-file-compressed 18507988 / 18002360 / +2.8% 110809544 / 108104254 / +2.5% 0.17 / 0.17 / +0.3%
fineweb_q08/datafusion:vortex-file-compressed 8559664 / 10483864 / -18.4% 🟢 36006435 / 41646475 / -13.5% 🟢 0.24 / 0.25 / -5.6%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9306869 / 9227758 / +0.9% 29585202 / 32498359 / -9.0% 0.31 / 0.28 / +10.8%
fineweb_q01/datafusion:parquet 74239258 / 73634542 / +0.8% 163241625 / 161111286 / +1.3% 0.45 / 0.46 / -0.5%
fineweb_q02/datafusion:parquet 74349950 / 74609638 / -0.3% 157325415 / 165242869 / -4.8% 0.47 / 0.45 / +4.7%
fineweb_q03/datafusion:parquet 74517599 / 75024748 / -0.7% 162986759 / 154449706 / +5.5% 0.46 / 0.49 / -5.9%
fineweb_q04/datafusion:parquet 80992816 / 82266572 / -1.5% 163689060 / 157989736 / +3.6% 0.49 / 0.52 / -5.0%
fineweb_q05/datafusion:parquet 80983924 / 81095445 / -0.1% 159585572 / 160313193 / -0.5% 0.51 / 0.51 / +0.3%
fineweb_q06/datafusion:parquet 75385978 / 76521018 / -1.5% 169339895 / 164018193 / +3.2% 0.45 / 0.47 / -4.6%
fineweb_q07/datafusion:parquet 73276756 / 74077756 / -1.1% 159272267 / 154114778 / +3.3% 0.46 / 0.48 / -4.3%
fineweb_q08/datafusion:parquet 73348021 / 74306141 / -1.3% 158550181 / 161521729 / -1.8% 0.46 / 0.46 / +0.6%
duckdb / vortex-file-compressed / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2034490 / 2090224 / -2.7% 7239217 / 7045611 / +2.7% 0.28 / 0.30 / -5.3%
fineweb_q01/duckdb:vortex-file-compressed 9314694 / 9090878 / +2.5% 32019806 / 31710357 / +1.0% 0.29 / 0.29 / +1.5%
fineweb_q02/duckdb:vortex-file-compressed 10661117 / 10615704 / +0.4% 35084351 / 32955117 / +6.5% 0.30 / 0.32 / -5.7%
fineweb_q03/duckdb:vortex-file-compressed 19128054 / 19230332 / -0.5% 102058687 / 86906208 / +17.4% 🔴 0.19 / 0.22 / -15.3%
fineweb_q04/duckdb:vortex-file-compressed 68394688 / 66169736 / +3.4% 116838276 / 104174712 / +12.2% 🔴 0.59 / 0.64 / -7.8%
fineweb_q05/duckdb:vortex-file-compressed 67066202 / 65690638 / +2.1% 114287265 / 103368719 / +10.6% 🔴 0.59 / 0.64 / -7.7%
fineweb_q06/duckdb:vortex-file-compressed 18769404 / 19034616 / -1.4% 102648425 / 92464232 / +11.0% 🔴 0.18 / 0.21 / -11.2%
fineweb_q07/duckdb:vortex-file-compressed 18457900 / 18128907 / +1.8% 96796124 / 85530471 / +13.2% 🔴 0.19 / 0.21 / -10.0%
fineweb_q08/duckdb:vortex-file-compressed 5545629 / 5063812 / +9.5% 13685358 / 14046856 / -2.6% 0.41 / 0.36 / +12.4%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24027490 / 23684770 / +1.4% 29289936 / 27767369 / +5.5% 0.82 / 0.85 / -3.8%
fineweb_q01/duckdb:parquet 54222610 / 54028828 / +0.4% 82085042 / 77850675 / +5.4% 0.66 / 0.69 / -4.8%
fineweb_q02/duckdb:parquet 60267234 / 60183341 / +0.1% 83505661 / 85107415 / -1.9% 0.72 / 0.71 / +2.1%
fineweb_q03/duckdb:parquet 119365740 / 119768847 / -0.3% 195068460 / 192807099 / +1.2% 0.61 / 0.62 / -1.5%
fineweb_q04/duckdb:parquet 159398170 / 160417964 / -0.6% 217553955 / 211682473 / +2.8% 0.73 / 0.76 / -3.3%
fineweb_q05/duckdb:parquet 158521898 / 163563388 / -3.1% 210768936 / 208122949 / +1.3% 0.75 / 0.79 / -4.3%
fineweb_q06/duckdb:parquet 88650516 / 89951770 / -1.4% 158078867 / 155073730 / +1.9% 0.56 / 0.58 / -3.3%
fineweb_q07/duckdb:parquet 91785039 / 93666274 / -2.0% 152785482 / 148144856 / +3.1% 0.60 / 0.63 / -5.0%
fineweb_q08/duckdb:parquet 30194868 / 29427784 / +2.6% 31489180 / 31237710 / +0.8% 0.96 / 0.94 / +1.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 77a96de1 vs base a59294e3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.030x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 17753797 / 17239670 / +3.0% 44970151 / 45059292 / -0.2% 0.39 / 0.38 / +3.2%
tpch_q02/datafusion:vortex-file-compressed 17904440 / 18037313 / -0.7% 35586035 / 36095803 / -1.4% 0.50 / 0.50 / +0.7%
tpch_q03/datafusion:vortex-file-compressed 21761895 / 22544089 / -3.5% 51389852 / 47910427 / +7.3% 0.42 / 0.47 / -10.0%
tpch_q04/datafusion:vortex-file-compressed 13254838 / 13473966 / -1.6% 37314000 / 34128448 / +9.3% 0.36 / 0.39 / -10.0%
tpch_q05/datafusion:vortex-file-compressed 39640737 / 39414624 / +0.6% 70082697 / 68809902 / +1.8% 0.57 / 0.57 / -1.3%
tpch_q06/datafusion:vortex-file-compressed 8593573 / 8741713 / -1.7% 30271964 / 28308414 / +6.9% 0.28 / 0.31 / -8.1%
tpch_q07/datafusion:vortex-file-compressed 54489998 / 55336136 / -1.5% 81179213 / 77554064 / +4.7% 0.67 / 0.71 / -5.9%
tpch_q08/datafusion:vortex-file-compressed 54875328 / 54128283 / +1.4% 83036070 / 80969765 / +2.6% 0.66 / 0.67 / -1.1%
tpch_q09/datafusion:vortex-file-compressed 48554800 / 49446155 / -1.8% 81759367 / 85021416 / -3.8% 0.59 / 0.58 / +2.1%
tpch_q10/datafusion:vortex-file-compressed 20849882 / 20311979 / +2.6% 52096040 / 50836534 / +2.5% 0.40 / 0.40 / +0.2%
tpch_q11/datafusion:vortex-file-compressed 15556071 / 15609040 / -0.3% 34460046 / 33548930 / +2.7% 0.45 / 0.47 / -3.0%
tpch_q12/datafusion:vortex-file-compressed 25243061 / 25182379 / +0.2% 45103530 / 47890662 / -5.8% 0.56 / 0.53 / +6.4%
tpch_q13/datafusion:vortex-file-compressed 20558900 / 20365151 / +1.0% 41955291 / 40087673 / +4.7% 0.49 / 0.51 / -3.5%
tpch_q14/datafusion:vortex-file-compressed 15287343 / 15365403 / -0.5% 38894069 / 38079981 / +2.1% 0.39 / 0.40 / -2.6%
tpch_q15/datafusion:vortex-file-compressed 21256165 / 20817548 / +2.1% 46780879 / 47580259 / -1.7% 0.45 / 0.44 / +3.9%
tpch_q16/datafusion:vortex-file-compressed 18659890 / 18434712 / +1.2% 41117430 / 41119929 / -0.0% 0.45 / 0.45 / +1.2%
tpch_q17/datafusion:vortex-file-compressed 30304690 / 29615727 / +2.3% 60300466 / 58832361 / +2.5% 0.50 / 0.50 / -0.2%
tpch_q18/datafusion:vortex-file-compressed 37503542 / 37631104 / -0.3% 59818717 / 58168557 / +2.8% 0.63 / 0.65 / -3.1%
tpch_q19/datafusion:vortex-file-compressed 18911615 / 18701397 / +1.1% 44183257 / 40410581 / +9.3% 0.43 / 0.46 / -7.5%
tpch_q20/datafusion:vortex-file-compressed 22965588 / 22938405 / +0.1% 48427063 / 46702673 / +3.7% 0.47 / 0.49 / -3.4%
tpch_q21/datafusion:vortex-file-compressed 44074175 / 43192190 / +2.0% 75949894 / 74955652 / +1.3% 0.58 / 0.58 / +0.7%
tpch_q22/datafusion:vortex-file-compressed 10861080 / 11185959 / -2.9% 32533497 / 30048555 / +8.3% 0.33 / 0.37 / -10.3%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72188639 / 71950523 / +0.3% 91430586 / 90887633 / +0.6% 0.79 / 0.79 / -0.3%
tpch_q02/datafusion:parquet 75889742 / 75918085 / -0.0% 95106742 / 92178163 / +3.2% 0.80 / 0.82 / -3.1%
tpch_q03/datafusion:parquet 83560518 / 84282890 / -0.9% 108294529 / 105895773 / +2.3% 0.77 / 0.80 / -3.1%
tpch_q04/datafusion:parquet 40297146 / 40528730 / -0.6% 61747595 / 58201706 / +6.1% 0.65 / 0.70 / -6.3%
tpch_q05/datafusion:parquet 112701051 / 112712319 / -0.0% 142016122 / 138727521 / +2.4% 0.79 / 0.81 / -2.3%
tpch_q06/datafusion:parquet 32190388 / 31995988 / +0.6% 50679002 / 49869582 / +1.6% 0.64 / 0.64 / -1.0%
tpch_q07/datafusion:parquet 115159345 / 115168669 / -0.0% 138292074 / 141942337 / -2.6% 0.83 / 0.81 / +2.6%
tpch_q08/datafusion:parquet 119620547 / 119953115 / -0.3% 148469999 / 146839207 / +1.1% 0.81 / 0.82 / -1.4%
tpch_q09/datafusion:parquet 140226709 / 141605759 / -1.0% 170375995 / 168125142 / +1.3% 0.82 / 0.84 / -2.3%
tpch_q10/datafusion:parquet 106499528 / 106348206 / +0.1% 133666323 / 131421247 / +1.7% 0.80 / 0.81 / -1.5%
tpch_q11/datafusion:parquet 61682910 / 61561183 / +0.2% 80877056 / 81266688 / -0.5% 0.76 / 0.76 / +0.7%
tpch_q12/datafusion:parquet 65663517 / 65370161 / +0.4% 88565961 / 82652763 / +7.2% 0.74 / 0.79 / -6.3%
tpch_q13/datafusion:parquet 147744294 / 147103482 / +0.4% 168198652 / 167390221 / +0.5% 0.88 / 0.88 / -0.0%
tpch_q14/datafusion:parquet 47499775 / 47782441 / -0.6% 71592521 / 71674810 / -0.1% 0.66 / 0.67 / -0.5%
tpch_q15/datafusion:parquet 75229593 / 75278308 / -0.1% 97093405 / 95006286 / +2.2% 0.77 / 0.79 / -2.2%
tpch_q16/datafusion:parquet 43452983 / 44158917 / -1.6% 61999604 / 60856181 / +1.9% 0.70 / 0.73 / -3.4%
tpch_q17/datafusion:parquet 123611604 / 123815188 / -0.2% 149851874 / 148002549 / +1.2% 0.82 / 0.84 / -1.4%
tpch_q18/datafusion:parquet 123543298 / 123897428 / -0.3% 145951163 / 145742173 / +0.1% 0.85 / 0.85 / -0.4%
tpch_q19/datafusion:parquet 57793693 / 58478981 / -1.2% 82810740 / 84343331 / -1.8% 0.70 / 0.69 / +0.7%
tpch_q20/datafusion:parquet 79635781 / 79914682 / -0.3% 102919792 / 102207993 / +0.7% 0.77 / 0.78 / -1.0%
tpch_q21/datafusion:parquet 116470575 / 116301828 / +0.1% 144786649 / 141991219 / +2.0% 0.80 / 0.82 / -1.8%
tpch_q22/datafusion:parquet 52550110 / 51881357 / +1.3% 70164857 / 67245251 / +4.3% 0.75 / 0.77 / -2.9%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9137751 / 9288627 / -1.6% 20761264 / 18525566 / +12.1% 🔴 0.44 / 0.50 / -12.2%
tpch_q02/duckdb:vortex-file-compressed 14962001 / 15060375 / -0.7% 23932975 / 23266289 / +2.9% 0.63 / 0.65 / -3.4%
tpch_q03/duckdb:vortex-file-compressed 17914781 / 18036145 / -0.7% 33913514 / 32826437 / +3.3% 0.53 / 0.55 / -3.9%
tpch_q04/duckdb:vortex-file-compressed 12250668 / 12024552 / +1.9% 25617958 / 24822028 / +3.2% 0.48 / 0.48 / -1.3%
tpch_q05/duckdb:vortex-file-compressed 19889891 / 20278379 / -1.9% 33513351 / 31349460 / +6.9% 0.59 / 0.65 / -8.2%
tpch_q06/duckdb:vortex-file-compressed 4564973 / 4665711 / -2.2% 14522419 / 13259287 / +9.5% 0.31 / 0.35 / -10.7%
tpch_q07/duckdb:vortex-file-compressed 23654027 / 23567502 / +0.4% 38586282 / 38379680 / +0.5% 0.61 / 0.61 / -0.2%
tpch_q08/duckdb:vortex-file-compressed 21731320 / 20899596 / +4.0% 36701376 / 35424741 / +3.6% 0.59 / 0.59 / +0.4%
tpch_q09/duckdb:vortex-file-compressed 21165151 / 21016262 / +0.7% 37229637 / 35312089 / +5.4% 0.57 / 0.60 / -4.5%
tpch_q10/duckdb:vortex-file-compressed 26981641 / 27356938 / -1.4% 41842148 / 40767440 / +2.6% 0.64 / 0.67 / -3.9%
tpch_q11/duckdb:vortex-file-compressed 7605558 / 7941835 / -4.2% 15583255 / 14407621 / +8.2% 0.49 / 0.55 / -11.5%
tpch_q12/duckdb:vortex-file-compressed 13717152 / 13846784 / -0.9% 25637124 / 24999388 / +2.6% 0.54 / 0.55 / -3.4%
tpch_q13/duckdb:vortex-file-compressed 23141843 / 23282642 / -0.6% 33285632 / 32289369 / +3.1% 0.70 / 0.72 / -3.6%
tpch_q14/duckdb:vortex-file-compressed 11225501 / 11632485 / -3.5% 23341804 / 22803078 / +2.4% 0.48 / 0.51 / -5.7%
tpch_q15/duckdb:vortex-file-compressed 8527079 / 8323853 / +2.4% 20435618 / 20059281 / +1.9% 0.42 / 0.41 / +0.6%
tpch_q16/duckdb:vortex-file-compressed 16545150 / 16528401 / +0.1% 22894347 / 23777428 / -3.7% 0.72 / 0.70 / +4.0%
tpch_q17/duckdb:vortex-file-compressed 11807627 / 11786634 / +0.2% 24987142 / 25464267 / -1.9% 0.47 / 0.46 / +2.1%
tpch_q18/duckdb:vortex-file-compressed 24292311 / 23965867 / +1.4% 33658600 / 33579943 / +0.2% 0.72 / 0.71 / +1.1%
tpch_q19/duckdb:vortex-file-compressed 10139750 / 10289408 / -1.5% 21417633 / 21063085 / +1.7% 0.47 / 0.49 / -3.1%
tpch_q20/duckdb:vortex-file-compressed 13844860 / 13719473 / +0.9% 28881853 / 27647948 / +4.5% 0.48 / 0.50 / -3.4%
tpch_q21/duckdb:vortex-file-compressed 36269048 / 36819296 / -1.5% 55004827 / 54144274 / +1.6% 0.66 / 0.68 / -3.0%
tpch_q22/duckdb:vortex-file-compressed 19130243 / 19077361 / +0.3% 28742606 / 27866293 / +3.1% 0.67 / 0.68 / -2.8%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48298374 / 48137470 / +0.3% 55792162 / 54739333 / +1.9% 0.87 / 0.88 / -1.6%
tpch_q02/duckdb:parquet 49004934 / 48995389 / +0.0% 56313793 / 55747395 / +1.0% 0.87 / 0.88 / -1.0%
tpch_q03/duckdb:parquet 60628027 / 60714197 / -0.1% 70081789 / 69094883 / +1.4% 0.87 / 0.88 / -1.5%
tpch_q04/duckdb:parquet 35055869 / 35145467 / -0.3% 44703687 / 45431191 / -1.6% 0.78 / 0.77 / +1.4%
tpch_q05/duckdb:parquet 67688124 / 67695743 / -0.0% 78699277 / 77753470 / +1.2% 0.86 / 0.87 / -1.2%
tpch_q06/duckdb:parquet 22152201 / 21995349 / +0.7% 28187335 / 27330155 / +3.1% 0.79 / 0.80 / -2.3%
tpch_q07/duckdb:parquet 64471456 / 64583247 / -0.2% 75715668 / 74223822 / +2.0% 0.85 / 0.87 / -2.1%
tpch_q08/duckdb:parquet 76233461 / 76374749 / -0.2% 88577059 / 86969226 / +1.8% 0.86 / 0.88 / -2.0%
tpch_q09/duckdb:parquet 108626527 / 108488747 / +0.1% 120232061 / 120209293 / +0.0% 0.90 / 0.90 / +0.1%
tpch_q10/duckdb:parquet 106536433 / 106747742 / -0.2% 118777955 / 118095944 / +0.6% 0.90 / 0.90 / -0.8%
tpch_q11/duckdb:parquet 30008491 / 29819836 / +0.6% 35283526 / 36212325 / -2.6% 0.85 / 0.82 / +3.3%
tpch_q12/duckdb:parquet 38108330 / 38032666 / +0.2% 46020020 / 44699831 / +3.0% 0.83 / 0.85 / -2.7%
tpch_q13/duckdb:parquet 175923045 / 175074624 / +0.5% 183188421 / 183059597 / +0.1% 0.96 / 0.96 / +0.4%
tpch_q14/duckdb:parquet 43044805 / 42809105 / +0.6% 52720484 / 51425075 / +2.5% 0.82 / 0.83 / -1.9%
tpch_q15/duckdb:parquet 33120828 / 33050488 / +0.2% 42077625 / 41410663 / +1.6% 0.79 / 0.80 / -1.4%
tpch_q16/duckdb:parquet 48046992 / 48141779 / -0.2% 53523703 / 53624496 / -0.2% 0.90 / 0.90 / -0.0%
tpch_q17/duckdb:parquet 48265048 / 48331948 / -0.1% 58505752 / 57681067 / +1.4% 0.82 / 0.84 / -1.5%
tpch_q18/duckdb:parquet 74795742 / 74944199 / -0.2% 81434826 / 81256471 / +0.2% 0.92 / 0.92 / -0.4%
tpch_q19/duckdb:parquet 48189064 / 47712928 / +1.0% 61669200 / 56921653 / +8.3% 0.78 / 0.84 / -6.8%
tpch_q20/duckdb:parquet 63694712 / 63888799 / -0.3% 74678528 / 73955104 / +1.0% 0.85 / 0.86 / -1.3%
tpch_q21/duckdb:parquet 107723696 / 107475083 / +0.2% 118360626 / 117129368 / +1.1% 0.91 / 0.92 / -0.8%
tpch_q22/duckdb:parquet 51216097 / 50916974 / +0.6% 60124630 / 59065604 / +1.8% 0.85 / 0.86 / -1.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 77a96de1 vs base a59294e3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.997x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90206785 / 91554008 / -1.5% 144269026 / 143333641 / +0.7% 0.63 / 0.64 / -2.1%
tpch_q02/datafusion:vortex-file-compressed 68008497 / 66863715 / +1.7% 100756871 / 103790004 / -2.9% 0.67 / 0.64 / +4.8%
tpch_q03/datafusion:vortex-file-compressed 66692968 / 66962785 / -0.4% 114061573 / 116377458 / -2.0% 0.58 / 0.58 / +1.6%
tpch_q04/datafusion:vortex-file-compressed 35717205 / 35610710 / +0.3% 70221715 / 72992887 / -3.8% 0.51 / 0.49 / +4.3%
tpch_q05/datafusion:vortex-file-compressed 120277881 / 120996931 / -0.6% 171588333 / 170863121 / +0.4% 0.70 / 0.71 / -1.0%
tpch_q06/datafusion:vortex-file-compressed 11239007 / 11770387 / -4.5% 57693181 / 56578665 / +2.0% 0.19 / 0.21 / -6.4%
tpch_q07/datafusion:vortex-file-compressed 134651083 / 137218777 / -1.9% 178774146 / 196598076 / -9.1% 0.75 / 0.70 / +7.9%
tpch_q08/datafusion:vortex-file-compressed 144269006 / 147884202 / -2.4% 209766875 / 210572589 / -0.4% 0.69 / 0.70 / -2.1%
tpch_q09/datafusion:vortex-file-compressed 186502608 / 186383331 / +0.1% 263629594 / 253411488 / +4.0% 0.71 / 0.74 / -3.8%
tpch_q10/datafusion:vortex-file-compressed 73743926 / 74199216 / -0.6% 134218218 / 137940013 / -2.7% 0.55 / 0.54 / +2.1%
tpch_q11/datafusion:vortex-file-compressed 44675168 / 45386912 / -1.6% 70694474 / 73364997 / -3.6% 0.63 / 0.62 / +2.2%
tpch_q12/datafusion:vortex-file-compressed 37695751 / 38500650 / -2.1% 81089139 / 81972778 / -1.1% 0.46 / 0.47 / -1.0%
tpch_q13/datafusion:vortex-file-compressed 42305507 / 43154299 / -2.0% 82358111 / 82729721 / -0.4% 0.51 / 0.52 / -1.5%
tpch_q14/datafusion:vortex-file-compressed 23168182 / 22778842 / +1.7% 85849995 / 89771289 / -4.4% 0.27 / 0.25 / +6.4%
tpch_q15/datafusion:vortex-file-compressed 35616580 / 35933488 / -0.9% 92092050 / 93559736 / -1.6% 0.39 / 0.38 / +0.7%
tpch_q16/datafusion:vortex-file-compressed 40125528 / 39947905 / +0.4% 69409650 / 69304049 / +0.2% 0.58 / 0.58 / +0.3%
tpch_q17/datafusion:vortex-file-compressed 178542832 / 178210920 / +0.2% 227118702 / 215744008 / +5.3% 0.79 / 0.83 / -4.8%
tpch_q18/datafusion:vortex-file-compressed 209184644 / 205808056 / +1.6% 270943009 / 273434832 / -0.9% 0.77 / 0.75 / +2.6%
tpch_q19/datafusion:vortex-file-compressed 36067431 / 35391419 / +1.9% 91229417 / 90040944 / +1.3% 0.40 / 0.39 / +0.6%
tpch_q20/datafusion:vortex-file-compressed 63100511 / 64232067 / -1.8% 124073155 / 118079102 / +5.1% 0.51 / 0.54 / -6.5%
tpch_q21/datafusion:vortex-file-compressed 182810057 / 184956196 / -1.2% 243730340 / 238696746 / +2.1% 0.75 / 0.77 / -3.2%
tpch_q22/datafusion:vortex-file-compressed 27547781 / 27657723 / -0.4% 53321894 / 53601430 / -0.5% 0.52 / 0.52 / +0.1%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87922395 / 88204353 / -0.3% 135096738 / 130088911 / +3.8% 0.65 / 0.68 / -4.0%
tpch_q02/datafusion:parquet 174634016 / 174726336 / -0.1% 207026752 / 204625784 / +1.2% 0.84 / 0.85 / -1.2%
tpch_q03/datafusion:parquet 137612649 / 136926488 / +0.5% 186157842 / 186492437 / -0.2% 0.74 / 0.73 / +0.7%
tpch_q04/datafusion:parquet 59143383 / 59059610 / +0.1% 100209869 / 90627947 / +10.6% 🔴 0.59 / 0.65 / -9.4%
tpch_q05/datafusion:parquet 169756786 / 170828936 / -0.6% 233008342 / 233350655 / -0.1% 0.73 / 0.73 / -0.5%
tpch_q06/datafusion:parquet 37074526 / 37023580 / +0.1% 82921974 / 79182885 / +4.7% 0.45 / 0.47 / -4.4%
tpch_q07/datafusion:parquet 220674702 / 218646397 / +0.9% 277606992 / 273468464 / +1.5% 0.79 / 0.80 / -0.6%
tpch_q08/datafusion:parquet 220783367 / 221064822 / -0.1% 303033393 / 289056660 / +4.8% 0.73 / 0.76 / -4.7%
tpch_q09/datafusion:parquet 314939879 / 314906664 / +0.0% 389710409 / 382686958 / +1.8% 0.81 / 0.82 / -1.8%
tpch_q10/datafusion:parquet 321454961 / 321799257 / -0.1% 387532113 / 387060543 / +0.1% 0.83 / 0.83 / -0.2%
tpch_q11/datafusion:parquet 126041554 / 126953939 / -0.7% 153248534 / 150534751 / +1.8% 0.82 / 0.84 / -2.5%
tpch_q12/datafusion:parquet 84657065 / 84500730 / +0.2% 124309930 / 124392326 / -0.1% 0.68 / 0.68 / +0.3%
tpch_q13/datafusion:parquet 216683252 / 216952945 / -0.1% 248669926 / 248474997 / +0.1% 0.87 / 0.87 / -0.2%
tpch_q14/datafusion:parquet 87207743 / 86851349 / +0.4% 199884096 / 196086278 / +1.9% 0.44 / 0.44 / -1.5%
tpch_q15/datafusion:parquet 106498347 / 106984016 / -0.5% 164532789 / 156205326 / +5.3% 0.65 / 0.68 / -5.5%
tpch_q16/datafusion:parquet 96199783 / 97797080 / -1.6% 122061884 / 122211019 / -0.1% 0.79 / 0.80 / -1.5%
tpch_q17/datafusion:parquet 211959297 / 212288946 / -0.2% 263668709 / 263160651 / +0.2% 0.80 / 0.81 / -0.3%
tpch_q18/datafusion:parquet 269566838 / 272868516 / -1.2% 311656715 / 309985509 / +0.5% 0.86 / 0.88 / -1.7%
tpch_q19/datafusion:parquet 108606464 / 108496774 / +0.1% 169831399 / 170805911 / -0.6% 0.64 / 0.64 / +0.7%
tpch_q20/datafusion:parquet 189722554 / 189120972 / +0.3% 247998111 / 262204361 / -5.4% 0.77 / 0.72 / +6.1%
tpch_q21/datafusion:parquet 248312654 / 248691727 / -0.2% 318698751 / 314157219 / +1.4% 0.78 / 0.79 / -1.6%
tpch_q22/datafusion:parquet 153862450 / 153846074 / +0.0% 181708732 / 180111894 / +0.9% 0.85 / 0.85 / -0.9%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33432538 / 33031566 / +1.2% 66765200 / 74102925 / -9.9% 0.50 / 0.45 / +12.3%
tpch_q02/duckdb:vortex-file-compressed 31372997 / 31080180 / +0.9% 44783814 / 44510767 / +0.6% 0.70 / 0.70 / +0.3%
tpch_q03/duckdb:vortex-file-compressed 52201414 / 52893273 / -1.3% 104928775 / 103094425 / +1.8% 0.50 / 0.51 / -3.0%
tpch_q04/duckdb:vortex-file-compressed 52166039 / 51610126 / +1.1% 89649138 / 89607068 / +0.0% 0.58 / 0.58 / +1.0%
tpch_q05/duckdb:vortex-file-compressed 68715714 / 67646100 / +1.6% 106857349 / 109224196 / -2.2% 0.64 / 0.62 / +3.8%
tpch_q06/duckdb:vortex-file-compressed 14396158 / 14391316 / +0.0% 52628263 / 53596583 / -1.8% 0.27 / 0.27 / +1.9%
tpch_q07/duckdb:vortex-file-compressed 54657071 / 54217905 / +0.8% 110152436 / 109846383 / +0.3% 0.50 / 0.49 / +0.5%
tpch_q08/duckdb:vortex-file-compressed 87100627 / 86981848 / +0.1% 131309316 / 132222649 / -0.7% 0.66 / 0.66 / +0.8%
tpch_q09/duckdb:vortex-file-compressed 96814498 / 96740613 / +0.1% 163603763 / 152875231 / +7.0% 0.59 / 0.63 / -6.5%
tpch_q10/duckdb:vortex-file-compressed 88974682 / 87725847 / +1.4% 142087413 / 140730500 / +1.0% 0.63 / 0.62 / +0.5%
tpch_q11/duckdb:vortex-file-compressed 14698832 / 13970042 / +5.2% 25122971 / 25247604 / -0.5% 0.59 / 0.55 / +5.7%
tpch_q12/duckdb:vortex-file-compressed 43598676 / 42817374 / +1.8% 85080055 / 83399590 / +2.0% 0.51 / 0.51 / -0.2%
tpch_q13/duckdb:vortex-file-compressed 67483876 / 67167074 / +0.5% 88804290 / 86520857 / +2.6% 0.76 / 0.78 / -2.1%
tpch_q14/duckdb:vortex-file-compressed 27792645 / 28247358 / -1.6% 70435930 / 72779837 / -3.2% 0.39 / 0.39 / +1.7%
tpch_q15/duckdb:vortex-file-compressed 24183269 / 24438956 / -1.0% 64763052 / 64063675 / +1.1% 0.37 / 0.38 / -2.1%
tpch_q16/duckdb:vortex-file-compressed 49708122 / 50309249 / -1.2% 57181450 / 58370993 / -2.0% 0.87 / 0.86 / +0.9%
tpch_q17/duckdb:vortex-file-compressed 34023505 / 33839919 / +0.5% 66168119 / 65524114 / +1.0% 0.51 / 0.52 / -0.4%
tpch_q18/duckdb:vortex-file-compressed 98311757 / 97366631 / +1.0% 122182564 / 120413006 / +1.5% 0.80 / 0.81 / -0.5%
tpch_q19/duckdb:vortex-file-compressed 24916942 / 24663760 / +1.0% 72777416 / 72791988 / -0.0% 0.34 / 0.34 / +1.0%
tpch_q20/duckdb:vortex-file-compressed 38865768 / 38852329 / +0.0% 92010031 / 91462815 / +0.6% 0.42 / 0.42 / -0.6%
tpch_q21/duckdb:vortex-file-compressed 92595365 / 95649542 / -3.2% 144882978 / 143886887 / +0.7% 0.64 / 0.66 / -3.9%
tpch_q22/duckdb:vortex-file-compressed 35149902 / 34886756 / +0.8% 52801824 / 51482041 / +2.6% 0.67 / 0.68 / -1.8%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68667035 / 67925061 / +1.1% 95724349 / 90570817 / +5.7% 0.72 / 0.75 / -4.4%
tpch_q02/duckdb:parquet 87645477 / 87743811 / -0.1% 99019242 / 100504820 / -1.5% 0.89 / 0.87 / +1.4%
tpch_q03/duckdb:parquet 112445721 / 110940424 / +1.4% 152137814 / 148404661 / +2.5% 0.74 / 0.75 / -1.1%
tpch_q04/duckdb:parquet 77183049 / 77001363 / +0.2% 101319654 / 99864577 / +1.5% 0.76 / 0.77 / -1.2%
tpch_q05/duckdb:parquet 124180455 / 125025010 / -0.7% 161043160 / 160089903 / +0.6% 0.77 / 0.78 / -1.3%
tpch_q06/duckdb:parquet 36081548 / 35651214 / +1.2% 65121778 / 64451853 / +1.0% 0.55 / 0.55 / +0.2%
tpch_q07/duckdb:parquet 119740103 / 117921650 / +1.5% 157327781 / 157683609 / -0.2% 0.76 / 0.75 / +1.8%
tpch_q08/duckdb:parquet 149581516 / 149738329 / -0.1% 190078255 / 197052531 / -3.5% 0.79 / 0.76 / +3.6%
tpch_q09/duckdb:parquet 238098846 / 237374867 / +0.3% 285142886 / 281479592 / +1.3% 0.84 / 0.84 / -1.0%
tpch_q10/duckdb:parquet 316300201 / 318219759 / -0.6% 344704146 / 347022820 / -0.7% 0.92 / 0.92 / +0.1%
tpch_q11/duckdb:parquet 44107515 / 43892770 / +0.5% 52346645 / 51563259 / +1.5% 0.84 / 0.85 / -1.0%
tpch_q12/duckdb:parquet 71736520 / 72475242 / -1.0% 95876964 / 93025838 / +3.1% 0.75 / 0.78 / -4.0%
tpch_q13/duckdb:parquet 295782565 / 294289313 / +0.5% 308993364 / 309495459 / -0.2% 0.96 / 0.95 / +0.7%
tpch_q14/duckdb:parquet 101720990 / 103609582 / -1.8% 144172571 / 145226052 / -0.7% 0.71 / 0.71 / -1.1%
tpch_q15/duckdb:parquet 58845602 / 57362861 / +2.6% 91078411 / 88728426 / +2.6% 0.65 / 0.65 / -0.1%
tpch_q16/duckdb:parquet 102342728 / 101230938 / +1.1% 109504387 / 109731633 / -0.2% 0.93 / 0.92 / +1.3%
tpch_q17/duckdb:parquet 82381622 / 82873725 / -0.6% 128659311 / 120151745 / +7.1% 0.64 / 0.69 / -7.2%
tpch_q18/duckdb:parquet 158476108 / 158751085 / -0.2% 171969890 / 176303412 / -2.5% 0.92 / 0.90 / +2.3%
tpch_q19/duckdb:parquet 100606126 / 98304267 / +2.3% 143197880 / 144086616 / -0.6% 0.70 / 0.68 / +3.0%
tpch_q20/duckdb:parquet 148743390 / 147407915 / +0.9% 196022761 / 191342693 / +2.4% 0.76 / 0.77 / -1.5%
tpch_q21/duckdb:parquet 263310245 / 254804407 / +3.3% 284502745 / 281731874 / +1.0% 0.93 / 0.90 / +2.3%
tpch_q22/duckdb:parquet 169679328 / 169194420 / +0.3% 185356574 / 183949064 / +0.8% 0.92 / 0.92 / -0.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 77a96de1 vs base 967e2f59
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.004x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24404202 / 24765286 / -1.5% 40976533 / 40825124 / +0.4% 0.60 / 0.61 / -1.8%
tpcds_q02/datafusion:vortex-file-compressed 48238929 / 47632115 / +1.3% 64246158 / 62778191 / +2.3% 0.75 / 0.76 / -1.0%
tpcds_q03/datafusion:vortex-file-compressed 11477716 / 12040078 / -4.7% 27250201 / 25655358 / +6.2% 0.42 / 0.47 / -10.2%
tpcds_q04/datafusion:vortex-file-compressed 124265000 / 124763541 / -0.4% 152489940 / 151389179 / +0.7% 0.81 / 0.82 / -1.1%
tpcds_q05/datafusion:vortex-file-compressed 59779602 / 58959356 / +1.4% 80372693 / 80702462 / -0.4% 0.74 / 0.73 / +1.8%
tpcds_q06/datafusion:vortex-file-compressed 22905350 / 22827728 / +0.3% 42529425 / 41748679 / +1.9% 0.54 / 0.55 / -1.5%
tpcds_q07/datafusion:vortex-file-compressed 31175342 / 31535618 / -1.1% 54071845 / 51314414 / +5.4% 0.58 / 0.61 / -6.2%
tpcds_q08/datafusion:vortex-file-compressed 24910576 / 24730550 / +0.7% 40016347 / 39753423 / +0.7% 0.62 / 0.62 / +0.1%
tpcds_q09/datafusion:vortex-file-compressed 17225962 / 17694412 / -2.6% 32034260 / 30991096 / +3.4% 0.54 / 0.57 / -5.8%
tpcds_q10/datafusion:vortex-file-compressed 26840408 / 27292028 / -1.7% 47296473 / 46210844 / +2.3% 0.57 / 0.59 / -3.9%
tpcds_q11/datafusion:vortex-file-compressed 65338986 / 63601232 / +2.7% 92126853 / 90270202 / +2.1% 0.71 / 0.70 / +0.7%
tpcds_q12/datafusion:vortex-file-compressed 16678465 / 16529726 / +0.9% 32612772 / 32736591 / -0.4% 0.51 / 0.50 / +1.3%
tpcds_q13/datafusion:vortex-file-compressed 31547161 / 32366914 / -2.5% 50046271 / 50771302 / -1.4% 0.63 / 0.64 / -1.1%
tpcds_q14/datafusion:vortex-file-compressed 497071514 / 494914244 / +0.4% 552835995 / 546290108 / +1.2% 0.90 / 0.91 / -0.8%
tpcds_q15/datafusion:vortex-file-compressed 15297886 / 15427440 / -0.8% 33465446 / 31744777 / +5.4% 0.46 / 0.49 / -5.9%
tpcds_q16/datafusion:vortex-file-compressed 19810494 / 19895420 / -0.4% 37152467 / 35095586 / +5.9% 0.53 / 0.57 / -5.9%
tpcds_q17/datafusion:vortex-file-compressed 58987622 / 59599600 / -1.0% 89200204 / 80805734 / +10.4% 🔴 0.66 / 0.74 / -10.3%
tpcds_q18/datafusion:vortex-file-compressed 68912784 / 68296202 / +0.9% 91228184 / 88833715 / +2.7% 0.76 / 0.77 / -1.7%
tpcds_q19/datafusion:vortex-file-compressed 17634429 / 17059943 / +3.4% 35287518 / 35096402 / +0.5% 0.50 / 0.49 / +2.8%
tpcds_q20/datafusion:vortex-file-compressed 17803671 / 18137578 / -1.8% 34372975 / 33941674 / +1.3% 0.52 / 0.53 / -3.1%
tpcds_q21/datafusion:vortex-file-compressed 15859061 / 16390645 / -3.2% 36167198 / 36577279 / -1.1% 0.44 / 0.45 / -2.1%
tpcds_q22/datafusion:vortex-file-compressed 57804457 / 58321778 / -0.9% 80899480 / 80348051 / +0.7% 0.71 / 0.73 / -1.6%
tpcds_q23/datafusion:vortex-file-compressed 70921300 / 70968229 / -0.1% 102299557 / 96219723 / +6.3% 0.69 / 0.74 / -6.0%
tpcds_q24/datafusion:vortex-file-compressed 67173274 / 68077838 / -1.3% 87341243 / 91112978 / -4.1% 0.77 / 0.75 / +2.9%
tpcds_q25/datafusion:vortex-file-compressed 54251379 / 53155032 / +2.1% 78293770 / 67488520 / +16.0% 🔴 0.69 / 0.79 / -12.0%
tpcds_q26/datafusion:vortex-file-compressed 30032292 / 30745753 / -2.3% 49687983 / 48987605 / +1.4% 0.60 / 0.63 / -3.7%
tpcds_q27/datafusion:vortex-file-compressed 61222862 / 63101618 / -3.0% 87693975 / 84533326 / +3.7% 0.70 / 0.75 / -6.5%
tpcds_q28/datafusion:vortex-file-compressed 17627984 / 17864450 / -1.3% 35062256 / 33425488 / +4.9% 0.50 / 0.53 / -5.9%
tpcds_q29/datafusion:vortex-file-compressed 58696767 / 58927133 / -0.4% 72795716 / 81770669 / -11.0% 🟢 0.81 / 0.72 / +11.9%
tpcds_q30/datafusion:vortex-file-compressed 26905203 / 27389422 / -1.8% 43301958 / 42670860 / +1.5% 0.62 / 0.64 / -3.2%
tpcds_q31/datafusion:vortex-file-compressed 58435456 / 58614714 / -0.3% 81995420 / 80843671 / +1.4% 0.71 / 0.73 / -1.7%
tpcds_q32/datafusion:vortex-file-compressed 13720682 / 13670157 / +0.4% 30148526 / 28270284 / +6.6% 0.46 / 0.48 / -5.9%
tpcds_q33/datafusion:vortex-file-compressed 26998352 / 27192720 / -0.7% 50653721 / 46596888 / +8.7% 0.53 / 0.58 / -8.7%
tpcds_q34/datafusion:vortex-file-compressed 17989772 / 17348670 / +3.7% 35327436 / 34848845 / +1.4% 0.51 / 0.50 / +2.3%
tpcds_q35/datafusion:vortex-file-compressed 34283168 / 34062130 / +0.6% 54027253 / 54414996 / -0.7% 0.63 / 0.63 / +1.4%
tpcds_q36/datafusion:vortex-file-compressed 47202311 / 47827877 / -1.3% 68051167 / 68446358 / -0.6% 0.69 / 0.70 / -0.7%
tpcds_q37/datafusion:vortex-file-compressed 13249932 / 13024588 / +1.7% 28581654 / 30777837 / -7.1% 0.46 / 0.42 / +9.5%
tpcds_q38/datafusion:vortex-file-compressed 30290206 / 29912662 / +1.3% 48131312 / 48286117 / -0.3% 0.63 / 0.62 / +1.6%
tpcds_q39/datafusion:vortex-file-compressed 61435937 / 62095772 / -1.1% 85476852 / 86203810 / -0.8% 0.72 / 0.72 / -0.2%
tpcds_q40/datafusion:vortex-file-compressed 24307737 / 24096222 / +0.9% 42833796 / 42104615 / +1.7% 0.57 / 0.57 / -0.8%
tpcds_q41/datafusion:vortex-file-compressed 17423364 / 17669398 / -1.4% 31001183 / 30987750 / +0.0% 0.56 / 0.57 / -1.4%
tpcds_q42/datafusion:vortex-file-compressed 11093338 / 11286578 / -1.7% 26754522 / 25025573 / +6.9% 0.41 / 0.45 / -8.1%
tpcds_q43/datafusion:vortex-file-compressed 13066918 / 12800876 / +2.1% 28163844 / 27602665 / +2.0% 0.46 / 0.46 / +0.0%
tpcds_q44/datafusion:vortex-file-compressed 25889023 / 25934996 / -0.2% 43979159 / 46062387 / -4.5% 0.59 / 0.56 / +4.6%
tpcds_q45/datafusion:vortex-file-compressed 18262917 / 18161600 / +0.6% 36933298 / 36344061 / +1.6% 0.49 / 0.50 / -1.0%
tpcds_q46/datafusion:vortex-file-compressed 23034061 / 22746856 / +1.3% 45160059 / 44906032 / +0.6% 0.51 / 0.51 / +0.7%
tpcds_q47/datafusion:vortex-file-compressed 78235884 / 78535050 / -0.4% 106102551 / 104083181 / +1.9% 0.74 / 0.75 / -2.3%
tpcds_q48/datafusion:vortex-file-compressed 29748640 / 29606816 / +0.5% 46927525 / 45891016 / +2.3% 0.63 / 0.65 / -1.7%
tpcds_q49/datafusion:vortex-file-compressed 57452184 / 56842230 / +1.1% 78347717 / 78102635 / +0.3% 0.73 / 0.73 / +0.8%
tpcds_q50/datafusion:vortex-file-compressed 32194562 / 32173058 / +0.1% 50522834 / 51184664 / -1.3% 0.64 / 0.63 / +1.4%
tpcds_q51/datafusion:vortex-file-compressed 68139904 / 67305988 / +1.2% 88200144 / 86778009 / +1.6% 0.77 / 0.78 / -0.4%
tpcds_q52/datafusion:vortex-file-compressed 11786176 / 11792805 / -0.1% 26538124 / 26832332 / -1.1% 0.44 / 0.44 / +1.1%
tpcds_q53/datafusion:vortex-file-compressed 17896920 / 17537298 / +2.1% 37403154 / 36541216 / +2.4% 0.48 / 0.48 / -0.3%
tpcds_q54/datafusion:vortex-file-compressed 32778240 / 33194521 / -1.3% 54804537 / 53668210 / +2.1% 0.60 / 0.62 / -3.3%
tpcds_q55/datafusion:vortex-file-compressed 11254106 / 11325256 / -0.6% 26924385 / 25321428 / +6.3% 0.42 / 0.45 / -6.5%
tpcds_q56/datafusion:vortex-file-compressed 26681365 / 26466136 / +0.8% 47060637 / 46246220 / +1.8% 0.57 / 0.57 / -0.9%
tpcds_q57/datafusion:vortex-file-compressed 76858430 / 77349734 / -0.6% 101542005 / 102207780 / -0.7% 0.76 / 0.76 / +0.0%
tpcds_q58/datafusion:vortex-file-compressed 40759728 / 40476795 / +0.7% 64436502 / 64465267 / -0.0% 0.63 / 0.63 / +0.7%
tpcds_q59/datafusion:vortex-file-compressed 31091278 / 31258431 / -0.5% 50458081 / 50631776 / -0.3% 0.62 / 0.62 / -0.2%
tpcds_q60/datafusion:vortex-file-compressed 26293798 / 26680270 / -1.4% 45051731 / 45827969 / -1.7% 0.58 / 0.58 / +0.2%
tpcds_q61/datafusion:vortex-file-compressed 23280788 / 22952304 / +1.4% 42561179 / 42973962 / -1.0% 0.55 / 0.53 / +2.4%
tpcds_q62/datafusion:vortex-file-compressed 18212958 / 18255630 / -0.2% 32513490 / 32478773 / +0.1% 0.56 / 0.56 / -0.3%
tpcds_q63/datafusion:vortex-file-compressed 17642468 / 17731795 / -0.5% 38672485 / 37129981 / +4.2% 0.46 / 0.48 / -4.5%
tpcds_q64/datafusion:vortex-file-compressed 226147779 / 223628596 / +1.1% 262097704 / 261821758 / +0.1% 0.86 / 0.85 / +1.0%
tpcds_q65/datafusion:vortex-file-compressed 74606682 / 75324954 / -1.0% 95380126 / 93701579 / +1.8% 0.78 / 0.80 / -2.7%
tpcds_q66/datafusion:vortex-file-compressed 52700582 / 52401064 / +0.6% 69910332 / 70379700 / -0.7% 0.75 / 0.74 / +1.2%
tpcds_q67/datafusion:vortex-file-compressed 58782374 / 58063664 / +1.2% 87246843 / 85134055 / +2.5% 0.67 / 0.68 / -1.2%
tpcds_q68/datafusion:vortex-file-compressed 22046499 / 22085051 / -0.2% 44548440 / 45764202 / -2.7% 0.49 / 0.48 / +2.5%
tpcds_q69/datafusion:vortex-file-compressed 27448891 / 28201996 / -2.7% 45431667 / 46312790 / -1.9% 0.60 / 0.61 / -0.8%
tpcds_q70/datafusion:vortex-file-compressed 70249226 / 70557484 / -0.4% 88246287 / 88663508 / -0.5% 0.80 / 0.80 / +0.0%
tpcds_q71/datafusion:vortex-file-compressed 19796906 / 18844756 / +5.1% 38057240 / 35940268 / +5.9% 0.52 / 0.52 / -0.8%
tpcds_q72/datafusion:vortex-file-compressed 347254955 / 352630149 / -1.5% 404409949 / 402964821 / +0.4% 0.86 / 0.88 / -1.9%
tpcds_q73/datafusion:vortex-file-compressed 16051678 / 16736020 / -4.1% 35019214 / 34868673 / +0.4% 0.46 / 0.48 / -4.5%
tpcds_q74/datafusion:vortex-file-compressed 46411030 / 45967482 / +1.0% 70459272 / 70192707 / +0.4% 0.66 / 0.65 / +0.6%
tpcds_q75/datafusion:vortex-file-compressed 136417042 / 136327010 / +0.1% 166858361 / 163186206 / +2.3% 0.82 / 0.84 / -2.1%
tpcds_q76/datafusion:vortex-file-compressed 27106512 / 26324230 / +3.0% 43442965 / 43777449 / -0.8% 0.62 / 0.60 / +3.8%
tpcds_q77/datafusion:vortex-file-compressed 45622282 / 45565959 / +0.1% 66069037 / 65616056 / +0.7% 0.69 / 0.69 / -0.6%
tpcds_q78/datafusion:vortex-file-compressed 68544986 / 69577331 / -1.5% 96590739 / 94866066 / +1.8% 0.71 / 0.73 / -3.2%
tpcds_q79/datafusion:vortex-file-compressed 19816775 / 19611042 / +1.0% 40099383 / 38993699 / +2.8% 0.49 / 0.50 / -1.7%
tpcds_q80/datafusion:vortex-file-compressed 75623266 / 74999212 / +0.8% 103437737 / 102384363 / +1.0% 0.73 / 0.73 / -0.2%
tpcds_q81/datafusion:vortex-file-compressed 27642287 / 27640939 / +0.0% 44553018 / 44011481 / +1.2% 0.62 / 0.63 / -1.2%
tpcds_q82/datafusion:vortex-file-compressed 13327550 / 13453336 / -0.9% 30485415 / 29227442 / +4.3% 0.44 / 0.46 / -5.0%
tpcds_q83/datafusion:vortex-file-compressed 35595136 / 35834170 / -0.7% 52300833 / 54347155 / -3.8% 0.68 / 0.66 / +3.2%
tpcds_q84/datafusion:vortex-file-compressed 12308968 / 12267092 / +0.3% 24389098 / 25221336 / -3.3% 0.50 / 0.49 / +3.8%
tpcds_q85/datafusion:vortex-file-compressed 57460774 / 58318192 / -1.5% 81731022 / 79877776 / +2.3% 0.70 / 0.73 / -3.7%
tpcds_q86/datafusion:vortex-file-compressed 16747966 / 16637786 / +0.7% 33067389 / 31665993 / +4.4% 0.51 / 0.53 / -3.6%
tpcds_q87/datafusion:vortex-file-compressed 29716446 / 29888216 / -0.6% 47374324 / 48189285 / -1.7% 0.63 / 0.62 / +1.1%
tpcds_q88/datafusion:vortex-file-compressed 32417628 / 31577401 / +2.7% 62355897 / 59348594 / +5.1% 0.52 / 0.53 / -2.3%
tpcds_q89/datafusion:vortex-file-compressed 20653538 / 20511202 / +0.7% 39117659 / 38207389 / +2.4% 0.53 / 0.54 / -1.6%
tpcds_q90/datafusion:vortex-file-compressed 10589284 / 10504856 / +0.8% 24442853 / 23682825 / +3.2% 0.43 / 0.44 / -2.3%
tpcds_q91/datafusion:vortex-file-compressed 16352275 / 15706330 / +4.1% 33212114 / 32699695 / +1.6% 0.49 / 0.48 / +2.5%
tpcds_q92/datafusion:vortex-file-compressed 14372037 / 13684255 / +5.0% 28361987 / 27238562 / +4.1% 0.51 / 0.50 / +0.9%
tpcds_q93/datafusion:vortex-file-compressed 22686804 / 21999783 / +3.1% 40453641 / 39719161 / +1.8% 0.56 / 0.55 / +1.3%
tpcds_q94/datafusion:vortex-file-compressed 19624519 / 19580596 / +0.2% 35661126 / 33899366 / +5.2% 0.55 / 0.58 / -4.7%
tpcds_q95/datafusion:vortex-file-compressed 44982876 / 45080774 / -0.2% 62609428 / 62573696 / +0.1% 0.72 / 0.72 / -0.3%
tpcds_q96/datafusion:vortex-file-compressed 8297595 / 8333268 / -0.4% 20960945 / 21443442 / -2.3% 0.40 / 0.39 / +1.9%
tpcds_q97/datafusion:vortex-file-compressed 21273772 / 21061622 / +1.0% 39414972 / 40025965 / -1.5% 0.54 / 0.53 / +2.6%
tpcds_q98/datafusion:vortex-file-compressed 17099754 / 16844690 / +1.5% 35782753 / 35523598 / +0.7% 0.48 / 0.47 / +0.8%
tpcds_q99/datafusion:vortex-file-compressed 20952424 / 20762023 / +0.9% 35499182 / 34364218 / +3.3% 0.59 / 0.60 / -2.3%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43565482 / 41237674 / +5.6% 58500916 / 61047508 / -4.2% 0.74 / 0.68 / +10.2%
tpcds_q02/datafusion:parquet 55834304 / 54683742 / +2.1% 72035470 / 71253627 / +1.1% 0.78 / 0.77 / +1.0%
tpcds_q03/datafusion:parquet 18859294 / 19232764 / -1.9% 32378808 / 29635415 / +9.3% 0.58 / 0.65 / -10.3%
tpcds_q04/datafusion:parquet 181326728 / 181216574 / +0.1% 208643466 / 205630668 / +1.5% 0.87 / 0.88 / -1.4%
tpcds_q05/datafusion:parquet 67515158 / 68804129 / -1.9% 89558637 / 91037707 / -1.6% 0.75 / 0.76 / -0.3%
tpcds_q06/datafusion:parquet 33669342 / 33028204 / +1.9% 47848371 / 46815413 / +2.2% 0.70 / 0.71 / -0.3%
tpcds_q07/datafusion:parquet 47050822 / 46974674 / +0.2% 63186446 / 66911046 / -5.6% 0.74 / 0.70 / +6.1%
tpcds_q08/datafusion:parquet 30819950 / 31174152 / -1.1% 44498419 / 45410028 / -2.0% 0.69 / 0.69 / +0.9%
tpcds_q09/datafusion:parquet 32851592 / 34168634 / -3.9% 40911481 / 44484745 / -8.0% 0.80 / 0.77 / +4.5%
tpcds_q10/datafusion:parquet 43338700 / 45112421 / -3.9% 59519502 / 57177631 / +4.1% 0.73 / 0.79 / -7.7%
tpcds_q11/datafusion:parquet 98919286 / 98752582 / +0.2% 120553255 / 120786339 / -0.2% 0.82 / 0.82 / +0.4%
tpcds_q12/datafusion:parquet 24103656 / 23985924 / +0.5% 36031417 / 35397978 / +1.8% 0.67 / 0.68 / -1.3%
tpcds_q13/datafusion:parquet 46199192 / 46839674 / -1.4% 65770040 / 66485215 / -1.1% 0.70 / 0.70 / -0.3%
tpcds_q14/datafusion:parquet 537790078 / 536512640 / +0.2% 592842363 / 587702283 / +0.9% 0.91 / 0.91 / -0.6%
tpcds_q15/datafusion:parquet 23791938 / 23594156 / +0.8% 38468950 / 38620929 / -0.4% 0.62 / 0.61 / +1.2%
tpcds_q16/datafusion:parquet 36575032 / 37035918 / -1.2% 53539159 / 52241859 / +2.5% 0.68 / 0.71 / -3.6%
tpcds_q17/datafusion:parquet 73894894 / 73740780 / +0.2% 98714910 / 95528016 / +3.3% 0.75 / 0.77 / -3.0%
tpcds_q18/datafusion:parquet 67661257 / 68419783 / -1.1% 92252506 / 84698704 / +8.9% 0.73 / 0.81 / -9.2%
tpcds_q19/datafusion:parquet 29724788 / 29567482 / +0.5% 43582136 / 43278686 / +0.7% 0.68 / 0.68 / -0.2%
tpcds_q20/datafusion:parquet 25246456 / 25945232 / -2.7% 38234817 / 39146651 / -2.3% 0.66 / 0.66 / -0.4%
tpcds_q21/datafusion:parquet 20362998 / 20584002 / -1.1% 33883487 / 32047115 / +5.7% 0.60 / 0.64 / -6.4%
tpcds_q22/datafusion:parquet 77136884 / 77279992 / -0.2% 89125250 / 88963446 / +0.2% 0.87 / 0.87 / -0.4%
tpcds_q23/datafusion:parquet 92730148 / 93307484 / -0.6% 114363952 / 116037018 / -1.4% 0.81 / 0.80 / +0.8%
tpcds_q24/datafusion:parquet 92153537 / 91648664 / +0.6% 115987158 / 116895366 / -0.8% 0.79 / 0.78 / +1.3%
tpcds_q25/datafusion:parquet 80587166 / 81363052 / -1.0% 105326941 / 98740077 / +6.7% 0.77 / 0.82 / -7.1%
tpcds_q26/datafusion:parquet 44012288 / 43157762 / +2.0% 60479414 / 57088043 / +5.9% 0.73 / 0.76 / -3.7%
tpcds_q27/datafusion:parquet 78697512 / 78277096 / +0.5% 97679070 / 97566435 / +0.1% 0.81 / 0.80 / +0.4%
tpcds_q28/datafusion:parquet 29058318 / 28642444 / +1.5% 44337461 / 41665779 / +6.4% 0.66 / 0.69 / -4.7%
tpcds_q29/datafusion:parquet 75790210 / 75772818 / +0.0% 99892886 / 96034981 / +4.0% 0.76 / 0.79 / -3.8%
tpcds_q30/datafusion:parquet 46260597 / 46667241 / -0.9% 60753319 / 57576198 / +5.5% 0.76 / 0.81 / -6.1%
tpcds_q31/datafusion:parquet 80866588 / 82776198 / -2.3% 101324766 / 99391007 / +1.9% 0.80 / 0.83 / -4.2%
tpcds_q32/datafusion:parquet 26389314 / 26711960 / -1.2% 42109620 / 40945733 / +2.8% 0.63 / 0.65 / -3.9%
tpcds_q33/datafusion:parquet 36842504 / 37390050 / -1.5% 53152233 / 53737761 / -1.1% 0.69 / 0.70 / -0.4%
tpcds_q34/datafusion:parquet 24457142 / 24165604 / +1.2% 36970863 / 36730319 / +0.7% 0.66 / 0.66 / +0.5%
tpcds_q35/datafusion:parquet 51388686 / 51476142 / -0.2% 63051075 / 61838723 / +2.0% 0.82 / 0.83 / -2.1%
tpcds_q36/datafusion:parquet 51377780 / 52379374 / -1.9% 74594599 / 70307770 / +6.1% 0.69 / 0.75 / -7.5%
tpcds_q37/datafusion:parquet 21129146 / 21267638 / -0.7% 34452952 / 32835003 / +4.9% 0.61 / 0.65 / -5.3%
tpcds_q38/datafusion:parquet 43749192 / 45012703 / -2.8% 62954083 / 61377978 / +2.6% 0.69 / 0.73 / -5.2%
tpcds_q39/datafusion:parquet 68920268 / 68519072 / +0.6% 86189892 / 82894307 / +4.0% 0.80 / 0.83 / -3.3%
tpcds_q40/datafusion:parquet 29630864 / 31142360 / -4.9% 51181309 / 48776440 / +4.9% 0.58 / 0.64 / -9.3%
tpcds_q41/datafusion:parquet 19500598 / 19877606 / -1.9% 33333238 / 31809658 / +4.8% 0.59 / 0.62 / -6.4%
tpcds_q42/datafusion:parquet 18037996 / 18375912 / -1.8% 29974660 / 30144584 / -0.6% 0.60 / 0.61 / -1.3%
tpcds_q43/datafusion:parquet 19541592 / 19689218 / -0.7% 31866033 / 32421935 / -1.7% 0.61 / 0.61 / +1.0%
tpcds_q44/datafusion:parquet 35020899 / 36352672 / -3.7% 51614465 / 51584336 / +0.1% 0.68 / 0.70 / -3.7%
tpcds_q45/datafusion:parquet 27780766 / 27914660 / -0.5% 41109362 / 41842907 / -1.8% 0.68 / 0.67 / +1.3%
tpcds_q46/datafusion:parquet 29572266 / 30118244 / -1.8% 45896178 / 45540435 / +0.8% 0.64 / 0.66 / -2.6%
tpcds_q47/datafusion:parquet 98263055 / 97984259 / +0.3% 121324377 / 120914670 / +0.3% 0.81 / 0.81 / -0.1%
tpcds_q48/datafusion:parquet 41845551 / 41389094 / +1.1% 58230095 / 59160672 / -1.6% 0.72 / 0.70 / +2.7%
tpcds_q49/datafusion:parquet 71905554 / 71845015 / +0.1% 96154912 / 95553020 / +0.6% 0.75 / 0.75 / -0.5%
tpcds_q50/datafusion:parquet 48210271 / 48801714 / -1.2% 71317610 / 67248170 / +6.1% 0.68 / 0.73 / -6.8%
tpcds_q51/datafusion:parquet 76035420 / 76400302 / -0.5% 94550282 / 95095329 / -0.6% 0.80 / 0.80 / +0.1%
tpcds_q52/datafusion:parquet 18629076 / 18905687 / -1.5% 32690289 / 30401187 / +7.5% 0.57 / 0.62 / -8.4%
tpcds_q53/datafusion:parquet 23774100 / 22784340 / +4.3% 38701309 / 37423006 / +3.4% 0.61 / 0.61 / +0.9%
tpcds_q54/datafusion:parquet 52501254 / 52214500 / +0.5% 72026060 / 63785965 / +12.9% 🔴 0.73 / 0.82 / -11.0%
tpcds_q55/datafusion:parquet 18423174 / 18506343 / -0.4% 32234436 / 28901473 / +11.5% 🔴 0.57 / 0.64 / -10.7%
tpcds_q56/datafusion:parquet 42047826 / 40666124 / +3.4% 57681727 / 54307184 / +6.2% 0.73 / 0.75 / -2.7%
tpcds_q57/datafusion:parquet 102205510 / 101983490 / +0.2% 116318931 / 113851886 / +2.2% 0.88 / 0.90 / -1.9%
tpcds_q58/datafusion:parquet 66249408 / 64951072 / +2.0% 85321132 / 83772691 / +1.8% 0.78 / 0.78 / +0.1%
tpcds_q59/datafusion:parquet 47824050 / 48725940 / -1.9% 67293462 / 65551177 / +2.7% 0.71 / 0.74 / -4.4%
tpcds_q60/datafusion:parquet 39811197 / 40824857 / -2.5% 56229931 / 54848493 / +2.5% 0.71 / 0.74 / -4.9%
tpcds_q61/datafusion:parquet 37141790 / 35875874 / +3.5% 50773189 / 50097483 / +1.3% 0.73 / 0.72 / +2.2%
tpcds_q62/datafusion:parquet 25352281 / 25386920 / -0.1% 39027130 / 37582608 / +3.8% 0.65 / 0.68 / -3.8%
tpcds_q63/datafusion:parquet 22510684 / 22474233 / +0.2% 39095581 / 38530180 / +1.5% 0.58 / 0.58 / -1.3%
tpcds_q64/datafusion:parquet 289697990 / 291474830 / -0.6% 327785561 / 329359841 / -0.5% 0.88 / 0.88 / -0.1%
tpcds_q65/datafusion:parquet 122432255 / 121202213 / +1.0% 142781060 / 139234236 / +2.5% 0.86 / 0.87 / -1.5%
tpcds_q66/datafusion:parquet 60994032 / 61059063 / -0.1% 76206294 / 77138722 / -1.2% 0.80 / 0.79 / +1.1%
tpcds_q67/datafusion:parquet 69105672 / 69429791 / -0.5% 90916453 / 91483174 / -0.6% 0.76 / 0.76 / +0.2%
tpcds_q68/datafusion:parquet 29648088 / 29894340 / -0.8% 48785129 / 47541370 / +2.6% 0.61 / 0.63 / -3.4%
tpcds_q69/datafusion:parquet 44265812 / 44100656 / +0.4% 59640654 / 58153803 / +2.6% 0.74 / 0.76 / -2.1%
tpcds_q70/datafusion:parquet 80491672 / 80699214 / -0.3% 99287270 / 101686923 / -2.4% 0.81 / 0.79 / +2.2%
tpcds_q71/datafusion:parquet 25473464 / 27053920 / -5.8% 37299857 / 38867178 / -4.0% 0.68 / 0.70 / -1.9%
tpcds_q72/datafusion:parquet 519875680 / 527548112 / -1.5% 580589678 / 545581897 / +6.4% 0.90 / 0.97 / -7.4%
tpcds_q73/datafusion:parquet 23970286 / 23916453 / +0.2% 36740824 / 36439971 / +0.8% 0.65 / 0.66 / -0.6%
tpcds_q74/datafusion:parquet 71000444 / 71771388 / -1.1% 90657238 / 90240806 / +0.5% 0.78 / 0.80 / -1.5%
tpcds_q75/datafusion:parquet 154523258 / 153086779 / +0.9% 179019737 / 179446999 / -0.2% 0.86 / 0.85 / +1.2%
tpcds_q76/datafusion:parquet 33775308 / 34782831 / -2.9% 47219435 / 46500554 / +1.5% 0.72 / 0.75 / -4.4%
tpcds_q77/datafusion:parquet 56823328 / 56987314 / -0.3% 77994792 / 77774384 / +0.3% 0.73 / 0.73 / -0.6%
tpcds_q78/datafusion:parquet 85562102 / 85150991 / +0.5% 118381473 / 117023342 / +1.2% 0.72 / 0.73 / -0.7%
tpcds_q79/datafusion:parquet 27190416 / 27413666 / -0.8% 42173543 / 41326635 / +2.0% 0.64 / 0.66 / -2.8%
tpcds_q80/datafusion:parquet 81020880 / 81861987 / -1.0% 109881890 / 109146990 / +0.7% 0.74 / 0.75 / -1.7%
tpcds_q81/datafusion:parquet 39718720 / 36445585 / +9.0% 50860309 / 53162669 / -4.3% 0.78 / 0.69 / +13.9%
tpcds_q82/datafusion:parquet 22479248 / 22631142 / -0.7% 35398583 / 35871289 / -1.3% 0.64 / 0.63 / +0.7%
tpcds_q83/datafusion:parquet 58907124 / 57647332 / +2.2% 74323777 / 74119934 / +0.3% 0.79 / 0.78 / +1.9%
tpcds_q84/datafusion:parquet 27129340 / 26036656 / +4.2% 40943203 / 42409010 / -3.5% 0.66 / 0.61 / +7.9%
tpcds_q85/datafusion:parquet 81470957 / 81239623 / +0.3% 103018553 / 102867523 / +0.1% 0.79 / 0.79 / +0.1%
tpcds_q86/datafusion:parquet 21004288 / 20845431 / +0.8% 33792119 / 33489705 / +0.9% 0.62 / 0.62 / -0.1%
tpcds_q87/datafusion:parquet 45493966 / 45013615 / +1.1% 62702257 / 61399131 / +2.1% 0.73 / 0.73 / -1.0%
tpcds_q88/datafusion:parquet 38418082 / 37664881 / +2.0% 52716974 / 51312700 / +2.7% 0.73 / 0.73 / -0.7%
tpcds_q89/datafusion:parquet 26105395 / 25994244 / +0.4% 41293634 / 41193575 / +0.2% 0.63 / 0.63 / +0.2%
tpcds_q90/datafusion:parquet 15374985 / 14579625 / +5.5% 26875506 / 25762001 / +4.3% 0.57 / 0.57 / +1.1%
tpcds_q91/datafusion:parquet 32186982 / 32208153 / -0.1% 46356394 / 49264834 / -5.9% 0.69 / 0.65 / +6.2%
tpcds_q92/datafusion:parquet 27133684 / 26677306 / +1.7% 42634006 / 41181581 / +3.5% 0.64 / 0.65 / -1.8%
tpcds_q93/datafusion:parquet 27563070 / 28552268 / -3.5% 46676229 / 46191950 / +1.0% 0.59 / 0.62 / -4.5%
tpcds_q94/datafusion:parquet 35502574 / 36193699 / -1.9% 48881142 / 47724743 / +2.4% 0.73 / 0.76 / -4.2%
tpcds_q95/datafusion:parquet 63475121 / 64984978 / -2.3% 79117378 / 76599000 / +3.3% 0.80 / 0.85 / -5.4%
tpcds_q96/datafusion:parquet 12625921 / 12539142 / +0.7% 24595094 / 23611996 / +4.2% 0.51 / 0.53 / -3.3%
tpcds_q97/datafusion:parquet 35698872 / 35897484 / -0.6% 49049837 / 51016025 / -3.9% 0.73 / 0.70 / +3.4%
tpcds_q98/datafusion:parquet 24931044 / 25398902 / -1.8% 39435925 / 39263662 / +0.4% 0.63 / 0.65 / -2.3%
tpcds_q99/datafusion:parquet 29395545 / 29766702 / -1.2% 43716802 / 42694391 / +2.4% 0.67 / 0.70 / -3.6%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15689505 / 15802422 / -0.7% 24225339 / 24298052 / -0.3% 0.65 / 0.65 / -0.4%
tpcds_q02/duckdb:vortex-file-compressed 15231920 / 15305089 / -0.5% 22493170 / 22451786 / +0.2% 0.68 / 0.68 / -0.7%
tpcds_q03/duckdb:vortex-file-compressed 6948310 / 6801088 / +2.2% 15410610 / 14682399 / +5.0% 0.45 / 0.46 / -2.7%
tpcds_q04/duckdb:vortex-file-compressed 44660195 / 44949311 / -0.6% 53921182 / 54021477 / -0.2% 0.83 / 0.83 / -0.5%
tpcds_q05/duckdb:vortex-file-compressed 22723850 / 22631856 / +0.4% 29839741 / 30025929 / -0.6% 0.76 / 0.75 / +1.0%
tpcds_q06/duckdb:vortex-file-compressed 23394645 / 23763109 / -1.6% 36564021 / 36753487 / -0.5% 0.64 / 0.65 / -1.0%
tpcds_q07/duckdb:vortex-file-compressed 13465424 / 13699557 / -1.7% 23082751 / 24304154 / -5.0% 0.58 / 0.56 / +3.5%
tpcds_q08/duckdb:vortex-file-compressed 16964995 / 17085020 / -0.7% 23786006 / 25109459 / -5.3% 0.71 / 0.68 / +4.8%
tpcds_q09/duckdb:vortex-file-compressed 18191652 / 18220904 / -0.2% 26834331 / 27169800 / -1.2% 0.68 / 0.67 / +1.1%
tpcds_q10/duckdb:vortex-file-compressed 26903584 / 26801511 / +0.4% 38617075 / 39147460 / -1.4% 0.70 / 0.68 / +1.8%
tpcds_q11/duckdb:vortex-file-compressed 35648749 / 36281728 / -1.7% 43784130 / 44344059 / -1.3% 0.81 / 0.82 / -0.5%
tpcds_q12/duckdb:vortex-file-compressed 9688176 / 9981268 / -2.9% 16036096 / 16095986 / -0.4% 0.60 / 0.62 / -2.6%
tpcds_q13/duckdb:vortex-file-compressed 20779098 / 20824883 / -0.2% 31605841 / 32294824 / -2.1% 0.66 / 0.64 / +2.0%
tpcds_q14/duckdb:vortex-file-compressed 55325828 / 54953832 / +0.7% 64892070 / 64388389 / +0.8% 0.85 / 0.85 / -0.1%
tpcds_q15/duckdb:vortex-file-compressed 10901538 / 10796783 / +1.0% 18099577 / 17642644 / +2.6% 0.60 / 0.61 / -1.6%
tpcds_q16/duckdb:vortex-file-compressed 23752836 / 23952759 / -0.8% 34456418 / 34360553 / +0.3% 0.69 / 0.70 / -1.1%
tpcds_q17/duckdb:vortex-file-compressed 24888344 / 25491742 / -2.4% 38065336 / 37997711 / +0.2% 0.65 / 0.67 / -2.5%
tpcds_q18/duckdb:vortex-file-compressed 30568904 / 30985417 / -1.3% 40251095 / 39804911 / +1.1% 0.76 / 0.78 / -2.4%
tpcds_q19/duckdb:vortex-file-compressed 79171878 / 77678128 / +1.9% 89081844 / 88630918 / +0.5% 0.89 / 0.88 / +1.4%
tpcds_q20/duckdb:vortex-file-compressed 10667362 / 10469396 / +1.9% 16904012 / 17162569 / -1.5% 0.63 / 0.61 / +3.4%
tpcds_q21/duckdb:vortex-file-compressed 10204689 / 10469072 / -2.5% 24460114 / 22060763 / +10.9% 🔴 0.42 / 0.47 / -12.1%
tpcds_q22/duckdb:vortex-file-compressed 19293782 / 18247900 / +5.7% 27698670 / 28626706 / -3.2% 0.70 / 0.64 / +9.3%
tpcds_q23/duckdb:vortex-file-compressed 36894681 / 37388230 / -1.3% 46698525 / 47844431 / -2.4% 0.79 / 0.78 / +1.1%
tpcds_q24/duckdb:vortex-file-compressed 27006180 / 26953025 / +0.2% 35892359 / 37623069 / -4.6% 0.75 / 0.72 / +5.0%
tpcds_q25/duckdb:vortex-file-compressed 23619604 / 23263917 / +1.5% 35457919 / 35055325 / +1.1% 0.67 / 0.66 / +0.4%
tpcds_q26/duckdb:vortex-file-compressed 12834289 / 12846210 / -0.1% 21051267 / 20251460 / +3.9% 0.61 / 0.63 / -3.9%
tpcds_q27/duckdb:vortex-file-compressed 16207723 / 16295213 / -0.5% 26356832 / 26729320 / -1.4% 0.61 / 0.61 / +0.9%
tpcds_q28/duckdb:vortex-file-compressed 14838948 / 14988394 / -1.0% 23335339 / 23071968 / +1.1% 0.64 / 0.65 / -2.1%
tpcds_q29/duckdb:vortex-file-compressed 22835652 / 23087950 / -1.1% 35593165 / 35891438 / -0.8% 0.64 / 0.64 / -0.3%
tpcds_q30/duckdb:vortex-file-compressed 15605868 / 15688242 / -0.5% 22558457 / 22423346 / +0.6% 0.69 / 0.70 / -1.1%
tpcds_q31/duckdb:vortex-file-compressed 17846457 / 17762258 / +0.5% 24894182 / 25452879 / -2.2% 0.72 / 0.70 / +2.7%
tpcds_q32/duckdb:vortex-file-compressed 11373902 / 11546310 / -1.5% 20752413 / 20670282 / +0.4% 0.55 / 0.56 / -1.9%
tpcds_q33/duckdb:vortex-file-compressed 17521926 / 17384540 / +0.8% 25300274 / 26093960 / -3.0% 0.69 / 0.67 / +4.0%
tpcds_q34/duckdb:vortex-file-compressed 12267831 / 12152618 / +0.9% 21528462 / 21373333 / +0.7% 0.57 / 0.57 / +0.2%
tpcds_q35/duckdb:vortex-file-compressed 27958324 / 27448528 / +1.9% 38662220 / 37542216 / +3.0% 0.72 / 0.73 / -1.1%
tpcds_q36/duckdb:vortex-file-compressed 14174384 / 14396148 / -1.5% 23280407 / 23910207 / -2.6% 0.61 / 0.60 / +1.1%
tpcds_q37/duckdb:vortex-file-compressed 9130849 / 9017662 / +1.3% 21267472 / 22629144 / -6.0% 0.43 / 0.40 / +7.7%
tpcds_q38/duckdb:vortex-file-compressed 23506422 / 23877327 / -1.6% 29952681 / 29721070 / +0.8% 0.78 / 0.80 / -2.3%
tpcds_q39/duckdb:vortex-file-compressed 19419234 / 21390934 / -9.2% 31000758 / 31389335 / -1.2% 0.63 / 0.68 / -8.1%
tpcds_q40/duckdb:vortex-file-compressed 14063130 / 14037827 / +0.2% 20320518 / 20961932 / -3.1% 0.69 / 0.67 / +3.3%
tpcds_q41/duckdb:vortex-file-compressed 14525942 / 14290316 / +1.6% 21011775 / 21326306 / -1.5% 0.69 / 0.67 / +3.2%
tpcds_q42/duckdb:vortex-file-compressed 7037830 / 6978028 / +0.9% 15230171 / 15574302 / -2.2% 0.46 / 0.45 / +3.1%
tpcds_q43/duckdb:vortex-file-compressed 9978102 / 9842237 / +1.4% 17900659 / 17912536 / -0.1% 0.56 / 0.55 / +1.4%
tpcds_q44/duckdb:vortex-file-compressed 15096688 / 14844436 / +1.7% 24436438 / 24862647 / -1.7% 0.62 / 0.60 / +3.5%
tpcds_q45/duckdb:vortex-file-compressed 22857274 / 23503170 / -2.7% 30267210 / 29707812 / +1.9% 0.76 / 0.79 / -4.5%
tpcds_q46/duckdb:vortex-file-compressed 19159958 / 19151718 / +0.0% 25702152 / 26733870 / -3.9% 0.75 / 0.72 / +4.1%
tpcds_q47/duckdb:vortex-file-compressed 33628845 / 33851195 / -0.7% 42890941 / 43625037 / -1.7% 0.78 / 0.78 / +1.0%
tpcds_q48/duckdb:vortex-file-compressed 23235066 / 23636324 / -1.7% 34557101 / 34494794 / +0.2% 0.67 / 0.69 / -1.9%
tpcds_q49/duckdb:vortex-file-compressed 19945982 / 19740604 / +1.0% 32017857 / 31377618 / +2.0% 0.62 / 0.63 / -1.0%
tpcds_q50/duckdb:vortex-file-compressed 17237864 / 17314214 / -0.4% 29117823 / 28271029 / +3.0% 0.59 / 0.61 / -3.3%
tpcds_q51/duckdb:vortex-file-compressed 48176883 / 49103020 / -1.9% 57769040 / 59394524 / -2.7% 0.83 / 0.83 / +0.9%
tpcds_q52/duckdb:vortex-file-compressed 7087419 / 6913364 / +2.5% 14848038 / 15638787 / -5.1% 0.48 / 0.44 / +8.0%
tpcds_q53/duckdb:vortex-file-compressed 11702052 / 11369348 / +2.9% 18996887 / 18414644 / +3.2% 0.62 / 0.62 / -0.2%
tpcds_q54/duckdb:vortex-file-compressed 19628241 / 19674900 / -0.2% 28384008 / 29413634 / -3.5% 0.69 / 0.67 / +3.4%
tpcds_q55/duckdb:vortex-file-compressed 6977173 / 6869972 / +1.6% 14457604 / 14799017 / -2.3% 0.48 / 0.46 / +4.0%
tpcds_q56/duckdb:vortex-file-compressed 17824014 / 17652373 / +1.0% 25853107 / 26148002 / -1.1% 0.69 / 0.68 / +2.1%
tpcds_q57/duckdb:vortex-file-compressed 25239144 / 25294642 / -0.2% 32709761 / 33190036 / -1.4% 0.77 / 0.76 / +1.2%
tpcds_q58/duckdb:vortex-file-compressed 20317371 / 19545132 / +4.0% 28560470 / 28190594 / +1.3% 0.71 / 0.69 / +2.6%
tpcds_q59/duckdb:vortex-file-compressed 19368122 / 19578103 / -1.1% 26121918 / 26487631 / -1.4% 0.74 / 0.74 / +0.3%
tpcds_q60/duckdb:vortex-file-compressed 18410001 / 18509235 / -0.5% 26595637 / 27189873 / -2.2% 0.69 / 0.68 / +1.7%
tpcds_q61/duckdb:vortex-file-compressed 23799627 / 23351216 / +1.9% 32804608 / 33471701 / -2.0% 0.73 / 0.70 / +4.0%
tpcds_q62/duckdb:vortex-file-compressed 11760870 / 11678724 / +0.7% 18312501 / 18595309 / -1.5% 0.64 / 0.63 / +2.3%
tpcds_q63/duckdb:vortex-file-compressed 11230340 / 11019285 / +1.9% 18289865 / 18570153 / -1.5% 0.61 / 0.59 / +3.5%
tpcds_q64/duckdb:vortex-file-compressed 49267892 / 49515487 / -0.5% 66013758 / 67517919 / -2.2% 0.75 / 0.73 / +1.8%
tpcds_q65/duckdb:vortex-file-compressed 14724718 / 14970884 / -1.6% 22781745 / 23677969 / -3.8% 0.65 / 0.63 / +2.2%
tpcds_q66/duckdb:vortex-file-compressed 28472965 / 29835191 / -4.6% 37882875 / 38121024 / -0.6% 0.75 / 0.78 / -4.0%
tpcds_q67/duckdb:vortex-file-compressed 57526358 / 57911190 / -0.7% 67271996 / 65672432 / +2.4% 0.86 / 0.88 / -3.0%
tpcds_q68/duckdb:vortex-file-compressed 18593260 / 18853756 / -1.4% 25875469 / 26686844 / -3.0% 0.72 / 0.71 / +1.7%
tpcds_q69/duckdb:vortex-file-compressed 22090516 / 21737318 / +1.6% 36080034 / 35312712 / +2.2% 0.61 / 0.62 / -0.5%
tpcds_q70/duckdb:vortex-file-compressed 15447544 / 15214089 / +1.5% 24804597 / 25116282 / -1.2% 0.62 / 0.61 / +2.8%
tpcds_q71/duckdb:vortex-file-compressed 12894168 / 13176744 / -2.1% 20953371 / 21513426 / -2.6% 0.62 / 0.61 / +0.5%
tpcds_q72/duckdb:vortex-file-compressed 54488950 / 54918522 / -0.8% 67230348 / 68135509 / -1.3% 0.81 / 0.81 / +0.6%
tpcds_q73/duckdb:vortex-file-compressed 11348819 / 11306659 / +0.4% 19463314 / 19397154 / +0.3% 0.58 / 0.58 / +0.0%
tpcds_q74/duckdb:vortex-file-compressed 25557868 / 25697200 / -0.5% 32516509 / 32411223 / +0.3% 0.79 / 0.79 / -0.9%
tpcds_q75/duckdb:vortex-file-compressed 28559233 / 28192782 / +1.3% 37978664 / 37472123 / +1.4% 0.75 / 0.75 / -0.1%
tpcds_q76/duckdb:vortex-file-compressed 12697646 / 12874996 / -1.4% 22427222 / 21825489 / +2.8% 0.57 / 0.59 / -4.0%
tpcds_q77/duckdb:vortex-file-compressed 20457505 / 20149040 / +1.5% 30458373 / 29987292 / +1.6% 0.67 / 0.67 / -0.0%
tpcds_q78/duckdb:vortex-file-compressed 42738344 / 43560559 / -1.9% 52283111 / 52259904 / +0.0% 0.82 / 0.83 / -1.9%
tpcds_q79/duckdb:vortex-file-compressed 12949191 / 13198426 / -1.9% 20967176 / 20609413 / +1.7% 0.62 / 0.64 / -3.6%
tpcds_q80/duckdb:vortex-file-compressed 36787138 / 36833196 / -0.1% 48259538 / 48045158 / +0.4% 0.76 / 0.77 / -0.6%
tpcds_q81/duckdb:vortex-file-compressed 20385264 / 20992067 / -2.9% 27363372 / 27998591 / -2.3% 0.74 / 0.75 / -0.6%
tpcds_q82/duckdb:vortex-file-compressed 9752226 / 9552157 / +2.1% 22059956 / 22618428 / -2.5% 0.44 / 0.42 / +4.7%
tpcds_q83/duckdb:vortex-file-compressed 17261235 / 17112580 / +0.9% 23052464 / 22890466 / +0.7% 0.75 / 0.75 / +0.2%
tpcds_q84/duckdb:vortex-file-compressed 15301789 / 15741230 / -2.8% 23188800 / 21887681 / +5.9% 0.66 / 0.72 / -8.2%
tpcds_q85/duckdb:vortex-file-compressed 23923103 / 23880588 / +0.2% 36200266 / 35118704 / +3.1% 0.66 / 0.68 / -2.8%
tpcds_q86/duckdb:vortex-file-compressed 9449916 / 9501361 / -0.5% 16560217 / 16229321 / +2.0% 0.57 / 0.59 / -2.5%
tpcds_q87/duckdb:vortex-file-compressed 25461626 / 25750809 / -1.1% 31351138 / 31702468 / -1.1% 0.81 / 0.81 / -0.0%
tpcds_q88/duckdb:vortex-file-compressed 36892051 / 36913662 / -0.1% 45825791 / 46321419 / -1.1% 0.81 / 0.80 / +1.0%
tpcds_q89/duckdb:vortex-file-compressed 11923465 / 11919950 / +0.0% 19826635 / 19774979 / +0.3% 0.60 / 0.60 / -0.2%
tpcds_q90/duckdb:vortex-file-compressed 8662559 / 8760096 / -1.1% 13477677 / 14284295 / -5.6% 0.64 / 0.61 / +4.8%
tpcds_q91/duckdb:vortex-file-compressed 13764720 / 13962402 / -1.4% 20183553 / 20399433 / -1.1% 0.68 / 0.68 / -0.4%
tpcds_q92/duckdb:vortex-file-compressed 11669036 / 11802658 / -1.1% 20257534 / 19180502 / +5.6% 0.58 / 0.62 / -6.4%
tpcds_q93/duckdb:vortex-file-compressed 10275639 / 10275175 / +0.0% 22804738 / 23380715 / -2.5% 0.45 / 0.44 / +2.5%
tpcds_q94/duckdb:vortex-file-compressed 21824918 / 22109685 / -1.3% 30399214 / 30683629 / -0.9% 0.72 / 0.72 / -0.4%
tpcds_q95/duckdb:vortex-file-compressed 40596292 / 40478661 / +0.3% 49965227 / 51298092 / -2.6% 0.81 / 0.79 / +3.0%
tpcds_q96/duckdb:vortex-file-compressed 6662170 / 6663725 / -0.0% 15401248 / 14948764 / +3.0% 0.43 / 0.45 / -3.0%
tpcds_q97/duckdb:vortex-file-compressed 23002626 / 23136591 / -0.6% 31207085 / 31223092 / -0.1% 0.74 / 0.74 / -0.5%
tpcds_q98/duckdb:vortex-file-compressed 11153002 / 10991567 / +1.5% 18314951 / 18386188 / -0.4% 0.61 / 0.60 / +1.9%
tpcds_q99/duckdb:vortex-file-compressed 14606326 / 14867658 / -1.8% 21580073 / 22290310 / -3.2% 0.68 / 0.67 / +1.5%
duckdb / parquet / ns (1.002x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24437800 / 24382868 / +0.2% 30949474 / 30838129 / +0.4% 0.79 / 0.79 / -0.1%
tpcds_q02/duckdb:parquet 18318031 / 18342060 / -0.1% 24207322 / 24561276 / -1.4% 0.76 / 0.75 / +1.3%
tpcds_q03/duckdb:parquet 9816367 / 9849220 / -0.3% 15526708 / 15695983 / -1.1% 0.63 / 0.63 / +0.8%
tpcds_q04/duckdb:parquet 118099680 / 117815716 / +0.2% 126364604 / 125317614 / +0.8% 0.93 / 0.94 / -0.6%
tpcds_q05/duckdb:parquet 28859398 / 28869834 / -0.0% 33210464 / 33769732 / -1.7% 0.87 / 0.85 / +1.6%
tpcds_q06/duckdb:parquet 26792610 / 26703844 / +0.3% 35465146 / 35621173 / -0.4% 0.76 / 0.75 / +0.8%
tpcds_q07/duckdb:parquet 32021026 / 31832000 / +0.6% 39026933 / 38609895 / +1.1% 0.82 / 0.82 / -0.5%
tpcds_q08/duckdb:parquet 20073037 / 20231890 / -0.8% 25427153 / 26414683 / -3.7% 0.79 / 0.77 / +3.1%
tpcds_q09/duckdb:parquet 27093760 / 26976666 / +0.4% 29838742 / 30018042 / -0.6% 0.91 / 0.90 / +1.0%
tpcds_q10/duckdb:parquet 32986742 / 32992112 / -0.0% 40493478 / 40252062 / +0.6% 0.81 / 0.82 / -0.6%
tpcds_q11/duckdb:parquet 68578254 / 69132114 / -0.8% 76087576 / 75428611 / +0.9% 0.90 / 0.92 / -1.7%
tpcds_q12/duckdb:parquet 14230847 / 14270732 / -0.3% 19650662 / 19328071 / +1.7% 0.72 / 0.74 / -1.9%
tpcds_q13/duckdb:parquet 31270280 / 30678936 / +1.9% 39862510 / 40893576 / -2.5% 0.78 / 0.75 / +4.6%
tpcds_q14/duckdb:parquet 64654440 / 65694288 / -1.6% 70272054 / 70650661 / -0.5% 0.92 / 0.93 / -1.1%
tpcds_q15/duckdb:parquet 16615463 / 16690486 / -0.4% 22802760 / 22797292 / +0.0% 0.73 / 0.73 / -0.5%
tpcds_q16/duckdb:parquet 30754647 / 30682150 / +0.2% 37284988 / 37263109 / +0.1% 0.82 / 0.82 / +0.2%
tpcds_q17/duckdb:parquet 35064002 / 35150436 / -0.2% 40077230 / 40880571 / -2.0% 0.87 / 0.86 / +1.8%
tpcds_q18/duckdb:parquet 47620091 / 47690564 / -0.1% 54970246 / 56376389 / -2.5% 0.87 / 0.85 / +2.4%
tpcds_q19/duckdb:parquet 19117033 / 18840906 / +1.5% 26054315 / 25786093 / +1.0% 0.73 / 0.73 / +0.4%
tpcds_q20/duckdb:parquet 15231190 / 15011050 / +1.5% 19484171 / 19611998 / -0.7% 0.78 / 0.77 / +2.1%
tpcds_q21/duckdb:parquet 11090367 / 10692296 / +3.7% 16489852 / 17136997 / -3.8% 0.67 / 0.62 / +7.8%
tpcds_q22/duckdb:parquet 20883021 / 20844910 / +0.2% 26373625 / 26510262 / -0.5% 0.79 / 0.79 / +0.7%
tpcds_q23/duckdb:parquet 44687871 / 42278441 / +5.7% 49023557 / 53977816 / -9.2% 0.91 / 0.78 / +16.4%
tpcds_q24/duckdb:parquet 30672510 / 30779787 / -0.3% 36937685 / 37849701 / -2.4% 0.83 / 0.81 / +2.1%
tpcds_q25/duckdb:parquet 31107259 / 30801432 / +1.0% 37417622 / 37271181 / +0.4% 0.83 / 0.83 / +0.6%
tpcds_q26/duckdb:parquet 29166588 / 29419484 / -0.9% 35133915 / 35641186 / -1.4% 0.83 / 0.83 / +0.6%
tpcds_q27/duckdb:parquet 35191488 / 34425970 / +2.2% 44436382 / 41622422 / +6.8% 0.79 / 0.83 / -4.2%
tpcds_q28/duckdb:parquet 26897240 / 26682818 / +0.8% 32881236 / 33309630 / -1.3% 0.82 / 0.80 / +2.1%
tpcds_q29/duckdb:parquet 32498364 / 32558876 / -0.2% 39415191 / 39882524 / -1.2% 0.82 / 0.82 / +1.0%
tpcds_q30/duckdb:parquet 36156092 / 36208556 / -0.1% 44380250 / 44832238 / -1.0% 0.81 / 0.81 / +0.9%
tpcds_q31/duckdb:parquet 36269644 / 36111508 / +0.4% 42656705 / 43989898 / -3.0% 0.85 / 0.82 / +3.6%
tpcds_q32/duckdb:parquet 14446566 / 14626952 / -1.2% 20945329 / 21253053 / -1.4% 0.69 / 0.69 / +0.2%
tpcds_q33/duckdb:parquet 23590448 / 24405932 / -3.3% 29207928 / 29415980 / -0.7% 0.81 / 0.83 / -2.7%
tpcds_q34/duckdb:parquet 18316816 / 17122779 / +7.0% 24367153 / 24664505 / -1.2% 0.75 / 0.69 / +8.3%
tpcds_q35/duckdb:parquet 35803204 / 35440778 / +1.0% 43897529 / 44390137 / -1.1% 0.82 / 0.80 / +2.2%
tpcds_q36/duckdb:parquet 39713250 / 40058580 / -0.9% 47776582 / 48102330 / -0.7% 0.83 / 0.83 / -0.2%
tpcds_q37/duckdb:parquet 13064402 / 12905798 / +1.2% 19165472 / 19188113 / -0.1% 0.68 / 0.67 / +1.3%
tpcds_q38/duckdb:parquet 29857992 / 29946381 / -0.3% 34118916 / 34241138 / -0.4% 0.88 / 0.87 / +0.1%
tpcds_q39/duckdb:parquet 23546450 / 23443880 / +0.4% 29575198 / 29952193 / -1.3% 0.80 / 0.78 / +1.7%
tpcds_q40/duckdb:parquet 16218968 / 16469818 / -1.5% 21609627 / 21952767 / -1.6% 0.75 / 0.75 / +0.0%
tpcds_q41/duckdb:parquet 12277924 / 12152346 / +1.0% 18865871 / 19184561 / -1.7% 0.65 / 0.63 / +2.7%
tpcds_q42/duckdb:parquet 9885336 / 9519476 / +3.8% 15423579 / 15530547 / -0.7% 0.64 / 0.61 / +4.6%
tpcds_q43/duckdb:parquet 12654144 / 12581723 / +0.6% 18104715 / 18782455 / -3.6% 0.70 / 0.67 / +4.3%
tpcds_q44/duckdb:parquet 20845190 / 20887080 / -0.2% 25912792 / 28480036 / -9.0% 0.80 / 0.73 / +9.7%
tpcds_q45/duckdb:parquet 21158751 / 21233797 / -0.4% 27553910 / 27877433 / -1.2% 0.77 / 0.76 / +0.8%
tpcds_q46/duckdb:parquet 38673046 / 35833144 / +7.9% 43699386 / 43603981 / +0.2% 0.88 / 0.82 / +7.7%
tpcds_q47/duckdb:parquet 34530952 / 34501142 / +0.1% 41133688 / 41263136 / -0.3% 0.84 / 0.84 / +0.4%
tpcds_q48/duckdb:parquet 29198068 / 33173738 / -12.0% 🟢 37135341 / 37616903 / -1.3% 0.79 / 0.88 / -10.8%
tpcds_q49/duckdb:parquet 31669658 / 30020206 / +5.5% 35999469 / 35836898 / +0.5% 0.88 / 0.84 / +5.0%
tpcds_q50/duckdb:parquet 20020798 / 19829589 / +1.0% 25793227 / 25717448 / +0.3% 0.78 / 0.77 / +0.7%
tpcds_q51/duckdb:parquet 52303082 / 52208108 / +0.2% 58941866 / 60532829 / -2.6% 0.89 / 0.86 / +2.9%
tpcds_q52/duckdb:parquet 9843964 / 9752686 / +0.9% 15345531 / 16091844 / -4.6% 0.64 / 0.61 / +5.8%
tpcds_q53/duckdb:parquet 14174389 / 14322545 / -1.0% 20647175 / 20389339 / +1.3% 0.69 / 0.70 / -2.3%
tpcds_q54/duckdb:parquet 25199032 / 25180639 / +0.1% 32016123 / 32261066 / -0.8% 0.79 / 0.78 / +0.8%
tpcds_q55/duckdb:parquet 9547093 / 9632032 / -0.9% 15144487 / 15396276 / -1.6% 0.63 / 0.63 / +0.8%
tpcds_q56/duckdb:parquet 25085454 / 26522552 / -5.4% 30960291 / 30643740 / +1.0% 0.81 / 0.87 / -6.4%
tpcds_q57/duckdb:parquet 30728938 / 30758159 / -0.1% 36112694 / 36338559 / -0.6% 0.85 / 0.85 / +0.5%
tpcds_q58/duckdb:parquet 25026348 / 24228208 / +3.3% 29904737 / 31006220 / -3.6% 0.84 / 0.78 / +7.1%
tpcds_q59/duckdb:parquet 23303664 / 23377982 / -0.3% 29235077 / 29948469 / -2.4% 0.80 / 0.78 / +2.1%
tpcds_q60/duckdb:parquet 26917280 / 28156890 / -4.4% 32291215 / 32209507 / +0.3% 0.83 / 0.87 / -4.6%
tpcds_q61/duckdb:parquet 25594385 / 24941672 / +2.6% 29633989 / 29462197 / +0.6% 0.86 / 0.85 / +2.0%
tpcds_q62/duckdb:parquet 13366820 / 13304912 / +0.5% 18166728 / 18091888 / +0.4% 0.74 / 0.74 / +0.1%
tpcds_q63/duckdb:parquet 14817818 / 13370952 / +10.8% 🔴 20083627 / 19919427 / +0.8% 0.74 / 0.67 / +9.9%
tpcds_q64/duckdb:parquet 71836546 / 71791072 / +0.1% 80681894 / 81245168 / -0.7% 0.89 / 0.88 / +0.8%
tpcds_q65/duckdb:parquet 19619635 / 21070074 / -6.9% 24923063 / 28600423 / -12.9% 🟢 0.79 / 0.74 / +6.9%
tpcds_q66/duckdb:parquet 35869917 / 35825405 / +0.1% 42133147 / 42236658 / -0.2% 0.85 / 0.85 / +0.4%
tpcds_q67/duckdb:parquet 60490869 / 60637446 / -0.2% 67919904 / 67392751 / +0.8% 0.89 / 0.90 / -1.0%
tpcds_q68/duckdb:parquet 30083615 / 30060714 / +0.1% 36163288 / 38079366 / -5.0% 0.83 / 0.79 / +5.4%
tpcds_q69/duckdb:parquet 26214620 / 26218258 / -0.0% 33965475 / 34118833 / -0.4% 0.77 / 0.77 / +0.4%
tpcds_q70/duckdb:parquet 19872452 / 19492306 / +2.0% 26443509 / 26495081 / -0.2% 0.75 / 0.74 / +2.1%
tpcds_q71/duckdb:parquet 16930012 / 17158290 / -1.3% 23535892 / 23895400 / -1.5% 0.72 / 0.72 / +0.2%
tpcds_q72/duckdb:parquet 54617483 / 54727246 / -0.2% 62196406 / 61649773 / +0.9% 0.88 / 0.89 / -1.1%
tpcds_q73/duckdb:parquet 15532915 / 15839989 / -1.9% 21883678 / 21834051 / +0.2% 0.71 / 0.73 / -2.2%
tpcds_q74/duckdb:parquet 83629084 / 84638644 / -1.2% 90880538 / 91214184 / -0.4% 0.92 / 0.93 / -0.8%
tpcds_q75/duckdb:parquet 44734446 / 45776344 / -2.3% 50768459 / 50048090 / +1.4% 0.88 / 0.91 / -3.7%
tpcds_q76/duckdb:parquet 20093210 / 19026916 / +5.6% 23283975 / 23182989 / +0.4% 0.86 / 0.82 / +5.1%
tpcds_q77/duckdb:parquet 25403658 / 25079386 / +1.3% 31319204 / 31171183 / +0.5% 0.81 / 0.80 / +0.8%
tpcds_q78/duckdb:parquet 78555326 / 78651332 / -0.1% 88162356 / 87043467 / +1.3% 0.89 / 0.90 / -1.4%
tpcds_q79/duckdb:parquet 23063652 / 23406992 / -1.5% 29095862 / 29686460 / -2.0% 0.79 / 0.79 / +0.5%
tpcds_q80/duckdb:parquet 37473776 / 38908716 / -3.7% 44766481 / 43904238 / +2.0% 0.84 / 0.89 / -5.5%
tpcds_q81/duckdb:parquet 36803990 / 37113473 / -0.8% 45163536 / 45115709 / +0.1% 0.81 / 0.82 / -0.9%
tpcds_q82/duckdb:parquet 13868532 / 13701602 / +1.2% 20382072 / 20533043 / -0.7% 0.68 / 0.67 / +2.0%
tpcds_q83/duckdb:parquet 20646508 / 20434172 / +1.0% 25638007 / 25737394 / -0.4% 0.81 / 0.79 / +1.4%
tpcds_q84/duckdb:parquet 22967404 / 23226782 / -1.1% 28731142 / 28734674 / -0.0% 0.80 / 0.81 / -1.1%
tpcds_q85/duckdb:parquet 32803062 / 32799365 / +0.0% 39856628 / 40381388 / -1.3% 0.82 / 0.81 / +1.3%
tpcds_q86/duckdb:parquet 12081922 / 12119846 / -0.3% 16640722 / 16977967 / -2.0% 0.73 / 0.71 / +1.7%
tpcds_q87/duckdb:parquet 31560382 / 31613342 / -0.2% 35677861 / 36795025 / -3.0% 0.88 / 0.86 / +3.0%
tpcds_q88/duckdb:parquet 39672984 / 39281004 / +1.0% 44786739 / 44494477 / +0.7% 0.89 / 0.88 / +0.3%
tpcds_q89/duckdb:parquet 14298778 / 14448024 / -1.0% 21342689 / 21217601 / +0.6% 0.67 / 0.68 / -1.6%
tpcds_q90/duckdb:parquet 10351192 / 10395494 / -0.4% 15374045 / 15667447 / -1.9% 0.67 / 0.66 / +1.5%
tpcds_q91/duckdb:parquet 21419781 / 21328056 / +0.4% 28687767 / 28486172 / +0.7% 0.75 / 0.75 / -0.3%
tpcds_q92/duckdb:parquet 15980874 / 15777923 / +1.3% 21964903 / 22635717 / -3.0% 0.73 / 0.70 / +4.4%
tpcds_q93/duckdb:parquet 14196844 / 14266178 / -0.5% 20280922 / 20670385 / -1.9% 0.70 / 0.69 / +1.4%
tpcds_q94/duckdb:parquet 25935688 / 25868284 / +0.3% 32521307 / 32950959 / -1.3% 0.80 / 0.79 / +1.6%
tpcds_q95/duckdb:parquet 44162148 / 43916591 / +0.6% 49921243 / 50139884 / -0.4% 0.88 / 0.88 / +1.0%
tpcds_q96/duckdb:parquet 8420702 / 8359194 / +0.7% 13974058 / 14073082 / -0.7% 0.60 / 0.59 / +1.4%
tpcds_q97/duckdb:parquet 27818575 / 27537742 / +1.0% 33479249 / 32705200 / +2.4% 0.83 / 0.84 / -1.3%
tpcds_q98/duckdb:parquet 16610279 / 16842283 / -1.4% 22994388 / 23243812 / -1.1% 0.72 / 0.72 / -0.3%
tpcds_q99/duckdb:parquet 19316638 / 19153042 / +0.9% 24690843 / 24480635 / +0.9% 0.78 / 0.78 / -0.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 77a96de1 vs base a59294e3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.031x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1243052 / 1281075 / -3.0% 23307610 / 22114745 / +5.4% 0.05 / 0.06 / -7.9%
clickbench_q01/datafusion:vortex-file-compressed 5947335 / 5552493 / +7.1% 35155473 / 33364044 / +5.4% 0.17 / 0.17 / +1.7%
clickbench_q02/datafusion:vortex-file-compressed 9689569 / 9595292 / +1.0% 39531681 / 39192640 / +0.9% 0.25 / 0.24 / +0.1%
clickbench_q03/datafusion:vortex-file-compressed 10802626 / 12254576 / -11.8% 🟢 54553191 / 52102933 / +4.7% 0.20 / 0.24 / -15.8%
clickbench_q04/datafusion:vortex-file-compressed 56232666 / 55709435 / +0.9% 94115339 / 88872914 / +5.9% 0.60 / 0.63 / -4.7%
clickbench_q05/datafusion:vortex-file-compressed 72352756 / 76987760 / -6.0% 116579189 / 118897443 / -1.9% 0.62 / 0.65 / -4.2%
clickbench_q06/datafusion:vortex-file-compressed 1252098 / 1261820 / -0.8% 22966273 / 21927988 / +4.7% 0.05 / 0.06 / -5.3%
clickbench_q07/datafusion:vortex-file-compressed 9153188 / 9017869 / +1.5% 36917101 / 31621677 / +16.7% 🔴 0.25 / 0.29 / -13.1%
clickbench_q08/datafusion:vortex-file-compressed 73403136 / 74945576 / -2.1% 113665629 / 111755086 / +1.7% 0.65 / 0.67 / -3.7%
clickbench_q09/datafusion:vortex-file-compressed 165470506 / 166438758 / -0.6% 208086645 / 207218528 / +0.4% 0.80 / 0.80 / -1.0%
clickbench_q10/datafusion:vortex-file-compressed 23367287 / 22663542 / +3.1% 67572125 / 63042672 / +7.2% 0.35 / 0.36 / -3.8%
clickbench_q11/datafusion:vortex-file-compressed 25176016 / 24088220 / +4.5% 68977577 / 64811691 / +6.4% 0.36 / 0.37 / -1.8%
clickbench_q12/datafusion:vortex-file-compressed 71667733 / 72509834 / -1.2% 119092812 / 114643576 / +3.9% 0.60 / 0.63 / -4.9%
clickbench_q13/datafusion:vortex-file-compressed 116401722 / 120361205 / -3.3% 177784173 / 187281395 / -5.1% 0.65 / 0.64 / +1.9%
clickbench_q14/datafusion:vortex-file-compressed 74696706 / 74641554 / +0.1% 126722347 / 117510244 / +7.8% 0.59 / 0.64 / -7.2%
clickbench_q15/datafusion:vortex-file-compressed 60704210 / 59593045 / +1.9% 99077566 / 99788668 / -0.7% 0.61 / 0.60 / +2.6%
clickbench_q16/datafusion:vortex-file-compressed 149293039 / 147387973 / +1.3% 207242589 / 206971490 / +0.1% 0.72 / 0.71 / +1.2%
clickbench_q17/datafusion:vortex-file-compressed 146951578 / 147795668 / -0.6% 210790046 / 211843533 / -0.5% 0.70 / 0.70 / -0.1%
clickbench_q18/datafusion:vortex-file-compressed 291483693 / 287091988 / +1.5% 375564986 / 365907947 / +2.6% 0.78 / 0.78 / -1.1%
clickbench_q19/datafusion:vortex-file-compressed 7672918 / 7576981 / +1.3% 48048641 / 46794999 / +2.7% 0.16 / 0.16 / -1.4%
clickbench_q20/datafusion:vortex-file-compressed 59904924 / 62224132 / -3.7% 221227272 / 225118106 / -1.7% 0.27 / 0.28 / -2.0%
clickbench_q21/datafusion:vortex-file-compressed 88157268 / 88438306 / -0.3% 271786542 / 267382227 / +1.6% 0.32 / 0.33 / -1.9%
clickbench_q22/datafusion:vortex-file-compressed 97853116 / 97822461 / +0.0% 340697389 / 341945197 / -0.4% 0.29 / 0.29 / +0.4%
clickbench_q23/datafusion:vortex-file-compressed 186436544 / 194181530 / -4.0% 387579567 / 440027607 / -11.9% 🟢 0.48 / 0.44 / +9.0%
clickbench_q24/datafusion:vortex-file-compressed 15169316 / 15419234 / -1.6% 66297972 / 63156567 / +5.0% 0.23 / 0.24 / -6.3%
clickbench_q25/datafusion:vortex-file-compressed 17967954 / 17465037 / +2.9% 58550307 / 55481408 / +5.5% 0.31 / 0.31 / -2.5%
clickbench_q26/datafusion:vortex-file-compressed 15200032 / 16031158 / -5.2% 64285818 / 64799218 / -0.8% 0.24 / 0.25 / -4.4%
clickbench_q27/datafusion:vortex-file-compressed 96812732 / 93177063 / +3.9% 244495725 / 246117722 / -0.7% 0.40 / 0.38 / +4.6%
clickbench_q28/datafusion:vortex-file-compressed 554778496 / 551157494 / +0.7% 621741936 / 612219530 / +1.6% 0.89 / 0.90 / -0.9%
clickbench_q29/datafusion:vortex-file-compressed 22527506 / 23833740 / -5.5% 51646704 / 48065891 / +7.4% 0.44 / 0.50 / -12.0%
clickbench_q30/datafusion:vortex-file-compressed 57380107 / 56388595 / +1.8% 107195031 / 107249345 / -0.1% 0.54 / 0.53 / +1.8%
clickbench_q31/datafusion:vortex-file-compressed 66505509 / 66142682 / +0.5% 153473977 / 149955708 / +2.3% 0.43 / 0.44 / -1.8%
clickbench_q32/datafusion:vortex-file-compressed 288461706 / 284155610 / +1.5% 385018278 / 383688501 / +0.3% 0.75 / 0.74 / +1.2%
clickbench_q33/datafusion:vortex-file-compressed 318759267 / 316611081 / +0.7% 414499807 / 422332363 / -1.9% 0.77 / 0.75 / +2.6%
clickbench_q34/datafusion:vortex-file-compressed 319919697 / 316040135 / +1.2% 443775815 / 431613190 / +2.8% 0.72 / 0.73 / -1.5%
clickbench_q35/datafusion:vortex-file-compressed 55679860 / 55141879 / +1.0% 86661327 / 85228385 / +1.7% 0.64 / 0.65 / -0.7%
clickbench_q36/datafusion:vortex-file-compressed 37230786 / 37319171 / -0.2% 65710956 / 65500861 / +0.3% 0.57 / 0.57 / -0.6%
clickbench_q37/datafusion:vortex-file-compressed 21741136 / 21776770 / -0.2% 48428199 / 47554259 / +1.8% 0.45 / 0.46 / -2.0%
clickbench_q38/datafusion:vortex-file-compressed 11498122 / 11956484 / -3.8% 41002338 / 37638279 / +8.9% 0.28 / 0.32 / -11.7%
clickbench_q39/datafusion:vortex-file-compressed 77268926 / 77565918 / -0.4% 112122619 / 107967691 / +3.8% 0.69 / 0.72 / -4.1%
clickbench_q40/datafusion:vortex-file-compressed 11456194 / 11187904 / +2.4% 38952294 / 36134586 / +7.8% 0.29 / 0.31 / -5.0%
clickbench_q41/datafusion:vortex-file-compressed 10604750 / 10650550 / -0.4% 38232744 / 35577346 / +7.5% 0.28 / 0.30 / -7.3%
clickbench_q42/datafusion:vortex-file-compressed 10765016 / 11060506 / -2.7% 37950988 / 36654575 / +3.5% 0.28 / 0.30 / -6.0%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1264892 / 1289504 / -1.9% 50257814 / 48408904 / +3.8% 0.03 / 0.03 / -5.5%
clickbench_q01/datafusion:parquet 15921882 / 15893654 / +0.2% 67828169 / 69496803 / -2.4% 0.23 / 0.23 / +2.6%
clickbench_q02/datafusion:parquet 18957108 / 18910922 / +0.2% 79752703 / 81992864 / -2.7% 0.24 / 0.23 / +3.1%
clickbench_q03/datafusion:parquet 17236874 / 17462512 / -1.3% 81375093 / 78062058 / +4.2% 0.21 / 0.22 / -5.3%
clickbench_q04/datafusion:parquet 61668733 / 63350254 / -2.7% 123188625 / 129197979 / -4.7% 0.50 / 0.49 / +2.1%
clickbench_q05/datafusion:parquet 89356612 / 88770802 / +0.7% 159662454 / 154127098 / +3.6% 0.56 / 0.58 / -2.8%
clickbench_q06/datafusion:parquet 1280830 / 1282830 / -0.2% 50140037 / 48484685 / +3.4% 0.03 / 0.03 / -3.5%
clickbench_q07/datafusion:parquet 16707064 / 16782372 / -0.4% 69002990 / 66362797 / +4.0% 0.24 / 0.25 / -4.3%
clickbench_q08/datafusion:parquet 87071743 / 88798216 / -1.9% 164603463 / 156289443 / +5.3% 0.53 / 0.57 / -6.9%
clickbench_q09/datafusion:parquet 186017162 / 185360202 / +0.4% 263734399 / 271418986 / -2.8% 0.71 / 0.68 / +3.3%
clickbench_q10/datafusion:parquet 36320687 / 36513794 / -0.5% 101955182 / 98869779 / +3.1% 0.36 / 0.37 / -3.5%
clickbench_q11/datafusion:parquet 42825779 / 42431898 / +0.9% 110786493 / 108042175 / +2.5% 0.39 / 0.39 / -1.6%
clickbench_q12/datafusion:parquet 95056714 / 96316629 / -1.3% 161925084 / 160189352 / +1.1% 0.59 / 0.60 / -2.4%
clickbench_q13/datafusion:parquet 148644178 / 147594245 / +0.7% 228883427 / 222936512 / +2.7% 0.65 / 0.66 / -1.9%
clickbench_q14/datafusion:parquet 101782247 / 102102064 / -0.3% 175190356 / 170337926 / +2.8% 0.58 / 0.60 / -3.1%
clickbench_q15/datafusion:parquet 71279774 / 70340250 / +1.3% 131292893 / 133081819 / -1.3% 0.54 / 0.53 / +2.7%
clickbench_q16/datafusion:parquet 155407512 / 157118644 / -1.1% 236889476 / 233853996 / +1.3% 0.66 / 0.67 / -2.4%
clickbench_q17/datafusion:parquet 154623178 / 157737014 / -2.0% 237318245 / 235826758 / +0.6% 0.65 / 0.67 / -2.6%
clickbench_q18/datafusion:parquet 307644835 / 307951725 / -0.1% 417928314 / 414555516 / +0.8% 0.74 / 0.74 / -0.9%
clickbench_q19/datafusion:parquet 19068523 / 19109764 / -0.2% 76886528 / 75983818 / +1.2% 0.25 / 0.25 / -1.4%
clickbench_q20/datafusion:parquet 177218284 / 180626259 / -1.9% 303010529 / 274131972 / +10.5% 🔴 0.58 / 0.66 / -11.2%
clickbench_q21/datafusion:parquet 172205214 / 172664215 / -0.3% 324632233 / 289476933 / +12.1% 🔴 0.53 / 0.60 / -11.1%
clickbench_q22/datafusion:parquet 256932904 / 259707815 / -1.1% 463092140 / 413408923 / +12.0% 🔴 0.55 / 0.63 / -11.7%
clickbench_q23/datafusion:parquet 1005495913 / 1022429167 / -1.7% 1184984304 / 1176058988 / +0.8% 0.85 / 0.87 / -2.4%
clickbench_q24/datafusion:parquet 30226396 / 30044666 / +0.6% 87953824 / 87383672 / +0.7% 0.34 / 0.34 / -0.0%
clickbench_q25/datafusion:parquet 37243330 / 37670514 / -1.1% 102183204 / 99219716 / +3.0% 0.36 / 0.38 / -4.0%
clickbench_q26/datafusion:parquet 30465940 / 31088665 / -2.0% 89862524 / 86098486 / +4.4% 0.34 / 0.36 / -6.1%
clickbench_q27/datafusion:parquet 192720442 / 193200886 / -0.2% 289880369 / 279785561 / +3.6% 0.66 / 0.69 / -3.7%
clickbench_q28/datafusion:parquet 620199434 / 614968633 / +0.9% 706485163 / 700467033 / +0.9% 0.88 / 0.88 / -0.0%
clickbench_q29/datafusion:parquet 29193864 / 28818777 / +1.3% 91148559 / 87900196 / +3.7% 0.32 / 0.33 / -2.3%
clickbench_q30/datafusion:parquet 90344171 / 90503284 / -0.2% 172132359 / 169106410 / +1.8% 0.52 / 0.54 / -1.9%
clickbench_q31/datafusion:parquet 102476540 / 103838082 / -1.3% 200912650 / 192088375 / +4.6% 0.51 / 0.54 / -5.6%
clickbench_q32/datafusion:parquet 306206416 / 304728959 / +0.5% 427496407 / 424969489 / +0.6% 0.72 / 0.72 / -0.1%
clickbench_q33/datafusion:parquet 378144295 / 376499000 / +0.4% 473894659 / 470006513 / +0.8% 0.80 / 0.80 / -0.4%
clickbench_q34/datafusion:parquet 378189014 / 378380562 / -0.1% 474452582 / 480520839 / -1.3% 0.80 / 0.79 / +1.2%
clickbench_q35/datafusion:parquet 65524594 / 65269300 / +0.4% 124815592 / 122129623 / +2.2% 0.52 / 0.53 / -1.8%
clickbench_q36/datafusion:parquet 73040996 / 73523429 / -0.7% 136718767 / 133158322 / +2.7% 0.53 / 0.55 / -3.2%
clickbench_q37/datafusion:parquet 35108343 / 35349286 / -0.7% 91288112 / 90691783 / +0.7% 0.38 / 0.39 / -1.3%
clickbench_q38/datafusion:parquet 47346400 / 47805046 / -1.0% 108331353 / 107887003 / +0.4% 0.44 / 0.44 / -1.4%
clickbench_q39/datafusion:parquet 142971614 / 143912859 / -0.7% 209485415 / 205819476 / +1.8% 0.68 / 0.70 / -2.4%
clickbench_q40/datafusion:parquet 20110362 / 20038738 / +0.4% 78225556 / 75034534 / +4.3% 0.26 / 0.27 / -3.7%
clickbench_q41/datafusion:parquet 18781874 / 18855535 / -0.4% 76055983 / 76008653 / +0.1% 0.25 / 0.25 / -0.5%
clickbench_q42/datafusion:parquet 19118262 / 19307819 / -1.0% 75144971 / 73797494 / +1.8% 0.25 / 0.26 / -2.8%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2146300 / 2154750 / -0.4% 25036293 / 25114082 / -0.3% 0.09 / 0.09 / -0.1%
clickbench_q01/duckdb:vortex-file-compressed 7078512 / 7189330 / -1.5% 26657366 / 27468341 / -3.0% 0.27 / 0.26 / +1.5%
clickbench_q02/duckdb:vortex-file-compressed 8132599 / 8076634 / +0.7% 33699639 / 34104425 / -1.2% 0.24 / 0.24 / +1.9%
clickbench_q03/duckdb:vortex-file-compressed 13962830 / 14264485 / -2.1% 58501311 / 50963177 / +14.8% 🔴 0.24 / 0.28 / -14.7%
clickbench_q04/duckdb:vortex-file-compressed 56996285 / 55308602 / +3.1% 97317555 / 90429314 / +7.6% 0.59 / 0.61 / -4.2%
clickbench_q05/duckdb:vortex-file-compressed 65273864 / 63562222 / +2.7% 97342070 / 93638488 / +4.0% 0.67 / 0.68 / -1.2%
clickbench_q06/duckdb:vortex-file-compressed 2656886 / 2611214 / +1.7% 29210441 / 29415786 / -0.7% 0.09 / 0.09 / +2.5%
clickbench_q07/duckdb:vortex-file-compressed 8497834 / 8585906 / -1.0% 31210293 / 31763865 / -1.7% 0.27 / 0.27 / +0.7%
clickbench_q08/duckdb:vortex-file-compressed 68142591 / 67166464 / +1.5% 113926662 / 101166593 / +12.6% 🔴 0.60 / 0.66 / -9.9%
clickbench_q09/duckdb:vortex-file-compressed 89163654 / 89784717 / -0.7% 129145972 / 127007998 / +1.7% 0.69 / 0.71 / -2.3%
clickbench_q10/duckdb:vortex-file-compressed 26172028 / 26126168 / +0.2% 67445267 / 63180978 / +6.7% 0.39 / 0.41 / -6.2%
clickbench_q11/duckdb:vortex-file-compressed 28934652 / 28504876 / +1.5% 75774053 / 64414636 / +17.6% 🔴 0.38 / 0.44 / -13.7%
clickbench_q12/duckdb:vortex-file-compressed 70468440 / 70131346 / +0.5% 99945231 / 99654194 / +0.3% 0.71 / 0.70 / +0.2%
clickbench_q13/duckdb:vortex-file-compressed 127463600 / 122125994 / +4.4% 168494344 / 161161730 / +4.5% 0.76 / 0.76 / -0.2%
clickbench_q14/duckdb:vortex-file-compressed 74613535 / 74150508 / +0.6% 103365852 / 100901836 / +2.4% 0.72 / 0.73 / -1.8%
clickbench_q15/duckdb:vortex-file-compressed 75726649 / 74988022 / +1.0% 114991425 / 109341598 / +5.2% 0.66 / 0.69 / -4.0%
clickbench_q16/duckdb:vortex-file-compressed 136844896 / 136582434 / +0.2% 182667211 / 175992086 / +3.8% 0.75 / 0.78 / -3.5%
clickbench_q17/duckdb:vortex-file-compressed 140783292 / 143084438 / -1.6% 177352216 / 175139221 / +1.3% 0.79 / 0.82 / -2.8%
clickbench_q18/duckdb:vortex-file-compressed 263041352 / 257382554 / +2.2% 320398082 / 312574424 / +2.5% 0.82 / 0.82 / -0.3%
clickbench_q19/duckdb:vortex-file-compressed 9030220 / 9302108 / -2.9% 43935321 / 41866615 / +4.9% 0.21 / 0.22 / -7.5%
clickbench_q20/duckdb:vortex-file-compressed 67132234 / 64586118 / +3.9% 169699642 / 161560861 / +5.0% 0.40 / 0.40 / -1.0%
clickbench_q21/duckdb:vortex-file-compressed 97093963 / 96141861 / +1.0% 283563140 / 268381801 / +5.7% 0.34 / 0.36 / -4.4%
clickbench_q22/duckdb:vortex-file-compressed 174040639 / 173081060 / +0.6% 431313908 / 390391792 / +10.5% 🔴 0.40 / 0.44 / -9.0%
clickbench_q23/duckdb:vortex-file-compressed 33888686 / 33026536 / +2.6% 88063111 / 82768330 / +6.4% 0.38 / 0.40 / -3.6%
clickbench_q24/duckdb:vortex-file-compressed 14376488 / 13739446 / +4.6% 37670953 / 35380072 / +6.5% 0.38 / 0.39 / -1.7%
clickbench_q25/duckdb:vortex-file-compressed 18517240 / 18725836 / -1.1% 52695334 / 47423544 / +11.1% 🔴 0.35 / 0.39 / -11.0%
clickbench_q26/duckdb:vortex-file-compressed 11415710 / 11339533 / +0.7% 34532858 / 33858819 / +2.0% 0.33 / 0.33 / -1.3%
clickbench_q27/duckdb:vortex-file-compressed 53041712 / 53616611 / -1.1% 218995324 / 216508123 / +1.1% 0.24 / 0.25 / -2.2%
clickbench_q28/duckdb:vortex-file-compressed 511636524 / 512872780 / -0.2% 574362750 / 570191562 / +0.7% 0.89 / 0.90 / -1.0%
clickbench_q29/duckdb:vortex-file-compressed 16419001 / 17394166 / -5.6% 43678248 / 44168329 / -1.1% 0.38 / 0.39 / -4.5%
clickbench_q30/duckdb:vortex-file-compressed 59071754 / 58673847 / +0.7% 113733279 / 101662286 / +11.9% 🔴 0.52 / 0.58 / -10.0%
clickbench_q31/duckdb:vortex-file-compressed 110424564 / 109527666 / +0.8% 198848804 / 185226017 / +7.4% 0.56 / 0.59 / -6.1%
clickbench_q32/duckdb:vortex-file-compressed 370582150 / 366260390 / +1.2% 402200797 / 398194859 / +1.0% 0.92 / 0.92 / +0.2%
clickbench_q33/duckdb:vortex-file-compressed 349334546 / 346687527 / +0.8% 442112838 / 436107499 / +1.4% 0.79 / 0.79 / -0.6%
clickbench_q34/duckdb:vortex-file-compressed 357647962 / 358519890 / -0.2% 460354962 / 444861064 / +3.5% 0.78 / 0.81 / -3.6%
clickbench_q35/duckdb:vortex-file-compressed 57114853 / 57080322 / +0.1% 93523056 / 88696267 / +5.4% 0.61 / 0.64 / -5.1%
clickbench_q36/duckdb:vortex-file-compressed 11525337 / 11697876 / -1.5% 32276267 / 31805342 / +1.5% 0.36 / 0.37 / -2.9%
clickbench_q37/duckdb:vortex-file-compressed 7889372 / 7993682 / -1.3% 30062938 / 29303430 / +2.6% 0.26 / 0.27 / -3.8%
clickbench_q38/duckdb:vortex-file-compressed 8931150 / 8419136 / +6.1% 29271443 / 28897797 / +1.3% 0.31 / 0.29 / +4.7%
clickbench_q39/duckdb:vortex-file-compressed 19423332 / 19145964 / +1.4% 39847264 / 37951232 / +5.0% 0.49 / 0.50 / -3.4%
clickbench_q40/duckdb:vortex-file-compressed 6985700 / 6986888 / -0.0% 30201402 / 29026401 / +4.0% 0.23 / 0.24 / -3.9%
clickbench_q41/duckdb:vortex-file-compressed 7833294 / 7730446 / +1.3% 28744891 / 31678625 / -9.3% 0.27 / 0.24 / +11.7%
clickbench_q42/duckdb:vortex-file-compressed 7179019 / 6980544 / +2.8% 29143414 / 29663638 / -1.8% 0.25 / 0.24 / +4.7%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 11512832 / 12497801 / -7.9% 18153715 / 18848103 / -3.7% 0.63 / 0.66 / -4.4%
clickbench_q01/duckdb:parquet 17061622 / 17543072 / -2.7% 25868513 / 24102809 / +7.3% 0.66 / 0.73 / -9.4%
clickbench_q02/duckdb:parquet 23787987 / 24180710 / -1.6% 37472946 / 37925377 / -1.2% 0.63 / 0.64 / -0.4%
clickbench_q03/duckdb:parquet 24745768 / 24432032 / +1.3% 36733252 / 41781586 / -12.1% 🟢 0.67 / 0.58 / +15.2%
clickbench_q04/duckdb:parquet 63375424 / 63469839 / -0.1% 77715115 / 77945855 / -0.3% 0.82 / 0.81 / +0.1%
clickbench_q05/duckdb:parquet 83952714 / 85609014 / -1.9% 99791488 / 100533367 / -0.7% 0.84 / 0.85 / -1.2%
clickbench_q06/duckdb:parquet 22795804 / 23056248 / -1.1% 30456383 / 29621066 / +2.8% 0.75 / 0.78 / -3.8%
clickbench_q07/duckdb:parquet 19755296 / 19181326 / +3.0% 27346012 / 25927766 / +5.5% 0.72 / 0.74 / -2.3%
clickbench_q08/duckdb:parquet 77508144 / 76660025 / +1.1% 93092981 / 93614026 / -0.6% 0.83 / 0.82 / +1.7%
clickbench_q09/duckdb:parquet 104571788 / 104516198 / +0.1% 123172303 / 123907878 / -0.6% 0.85 / 0.84 / +0.7%
clickbench_q10/duckdb:parquet 41763982 / 41846635 / -0.2% 58297375 / 59712387 / -2.4% 0.72 / 0.70 / +2.2%
clickbench_q11/duckdb:parquet 48174990 / 47068208 / +2.4% 67543465 / 66254136 / +1.9% 0.71 / 0.71 / +0.4%
clickbench_q12/duckdb:parquet 92933470 / 93473280 / -0.6% 114083637 / 114049544 / +0.0% 0.81 / 0.82 / -0.6%
clickbench_q13/duckdb:parquet 153634638 / 150607594 / +2.0% 179183612 / 172439603 / +3.9% 0.86 / 0.87 / -1.8%
clickbench_q14/duckdb:parquet 102783854 / 101712006 / +1.1% 127037256 / 126289095 / +0.6% 0.81 / 0.81 / +0.5%
clickbench_q15/duckdb:parquet 88532476 / 89936848 / -1.6% 105598216 / 107400073 / -1.7% 0.84 / 0.84 / +0.1%
clickbench_q16/duckdb:parquet 180613315 / 177732160 / +1.6% 188584380 / 190926032 / -1.2% 0.96 / 0.93 / +2.9%
clickbench_q17/duckdb:parquet 178759009 / 176224270 / +1.4% 189648262 / 185768026 / +2.1% 0.94 / 0.95 / -0.6%
clickbench_q18/duckdb:parquet 308403712 / 307985556 / +0.1% 335256879 / 333285419 / +0.6% 0.92 / 0.92 / -0.5%
clickbench_q19/duckdb:parquet 22613897 / 21788596 / +3.8% 29840997 / 30005780 / -0.5% 0.76 / 0.73 / +4.4%
clickbench_q20/duckdb:parquet 182375871 / 190048924 / -4.0% 229982723 / 227595744 / +1.0% 0.79 / 0.84 / -5.0%
clickbench_q21/duckdb:parquet 234148704 / 240772242 / -2.8% 277222407 / 273221489 / +1.5% 0.84 / 0.88 / -4.2%
clickbench_q22/duckdb:parquet 313348136 / 320652239 / -2.3% 375330795 / 371081105 / +1.1% 0.83 / 0.86 / -3.4%
clickbench_q23/duckdb:parquet 174670524 / 162995277 / +7.2% 243967205 / 239226423 / +2.0% 0.72 / 0.68 / +5.1%
clickbench_q24/duckdb:parquet 31824853 / 32848403 / -3.1% 47619215 / 47093759 / +1.1% 0.67 / 0.70 / -4.2%
clickbench_q25/duckdb:parquet 44574154 / 43218714 / +3.1% 59739676 / 59478742 / +0.4% 0.75 / 0.73 / +2.7%
clickbench_q26/duckdb:parquet 33533438 / 32849491 / +2.1% 51255137 / 45968849 / +11.5% 🔴 0.65 / 0.71 / -8.4%
clickbench_q27/duckdb:parquet 190813389 / 194174718 / -1.7% 230776364 / 235256831 / -1.9% 0.83 / 0.83 / +0.2%
clickbench_q28/duckdb:parquet 988866170 / 996387860 / -0.8% 1011219947 / 974436974 / +3.8% 0.98 / 1.02 / -4.4%
clickbench_q29/duckdb:parquet 26071593 / 26148384 / -0.3% 36963461 / 35713024 / +3.5% 0.71 / 0.73 / -3.7%
clickbench_q30/duckdb:parquet 107687270 / 107273371 / +0.4% 133064338 / 135115257 / -1.5% 0.81 / 0.79 / +1.9%
clickbench_q31/duckdb:parquet 150228700 / 161577744 / -7.0% 187394283 / 208206451 / -10.0% 0.80 / 0.78 / +3.3%
clickbench_q32/duckdb:parquet 403683778 / 401031746 / +0.7% 418626445 / 421200634 / -0.6% 0.96 / 0.95 / +1.3%
clickbench_q33/duckdb:parquet 479820290 / 480740512 / -0.2% 457465979 / 453540611 / +0.9% 1.05 / 1.06 / -1.0%
clickbench_q34/duckdb:parquet 484181530 / 464853802 / +4.2% 472054628 / 461690390 / +2.2% 1.03 / 1.01 / +1.9%
clickbench_q35/duckdb:parquet 63766324 / 63112869 / +1.0% 77782747 / 81330898 / -4.4% 0.82 / 0.78 / +5.6%
clickbench_q36/duckdb:parquet 31449378 / 32564355 / -3.4% 41190566 / 40199025 / +2.5% 0.76 / 0.81 / -5.7%
clickbench_q37/duckdb:parquet 25532012 / 24946204 / +2.3% 35197448 / 33791866 / +4.2% 0.73 / 0.74 / -1.7%
clickbench_q38/duckdb:parquet 25757479 / 25540612 / +0.8% 35472451 / 34993525 / +1.4% 0.73 / 0.73 / -0.5%
clickbench_q39/duckdb:parquet 55426951 / 55037536 / +0.7% 63562716 / 63409578 / +0.2% 0.87 / 0.87 / +0.5%
clickbench_q40/duckdb:parquet 16289574 / 15559138 / +4.7% 24668945 / 24156523 / +2.1% 0.66 / 0.64 / +2.5%
clickbench_q41/duckdb:parquet 16727072 / 17003451 / -1.6% 24951599 / 24653505 / +1.2% 0.67 / 0.69 / -2.8%
clickbench_q42/duckdb:parquet 16765496 / 15435730 / +8.6% 24705928 / 24673534 / +0.1% 0.68 / 0.63 / +8.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 77a96de1 vs base a59294e3
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (+2.1%, environment too noisy confidence) · DuckDB No clear signal (-4.7%, environment too noisy confidence)
Vortex (geomean): hot 0.971x ➖ · cold 1.009x ➖
Parquet (geomean): hot 0.984x ➖ · cold 0.952x ➖
Shifts: Parquet (control) -1.6% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 203701148 / 247358094 / -17.6% 575979993 / 738868352 / -22.0% 0.35 / 0.33 / +5.6%
tpch_q02/datafusion:vortex-file-compressed 325611369 / 330871678 / -1.6% 605879606 / 728806429 / -16.9% 0.54 / 0.45 / +18.4%
tpch_q03/datafusion:vortex-file-compressed 350916626 / 385729639 / -9.0% 1016549045 / 1627757578 / -37.5% 🟢 0.35 / 0.24 / +45.7%
tpch_q04/datafusion:vortex-file-compressed 207572103 / 207236107 / +0.2% 533021309 / 415145968 / +28.4% 0.39 / 0.50 / -22.0%
tpch_q05/datafusion:vortex-file-compressed 397054430 / 396405219 / +0.2% 595303828 / 627729660 / -5.2% 0.67 / 0.63 / +5.6%
tpch_q06/datafusion:vortex-file-compressed 157797422 / 140079154 / +12.6% 354138347 / 284789953 / +24.4% 0.45 / 0.49 / -9.4%
tpch_q07/datafusion:vortex-file-compressed 451696840 / 398571958 / +13.3% 760429033 / 623580284 / +21.9% 0.59 / 0.64 / -7.1%
tpch_q08/datafusion:vortex-file-compressed 430555765 / 479188752 / -10.1% 624785998 / 592878190 / +5.4% 0.69 / 0.81 / -14.7%
tpch_q09/datafusion:vortex-file-compressed 286707415 / 299413330 / -4.2% 460623684 / 478898510 / -3.8% 0.62 / 0.63 / -0.4%
tpch_q10/datafusion:vortex-file-compressed 471375384 / 420015221 / +12.2% 617472933 / 577599821 / +6.9% 0.76 / 0.73 / +5.0%
tpch_q11/datafusion:vortex-file-compressed 297859136 / 260115453 / +14.5% 462822981 / 432372514 / +7.0% 0.64 / 0.60 / +7.0%
tpch_q12/datafusion:vortex-file-compressed 199534571 / 259385245 / -23.1% 425649688 / 388771647 / +9.5% 0.47 / 0.67 / -29.7%
tpch_q13/datafusion:vortex-file-compressed 145057994 / 135290597 / +7.2% 309108441 / 308555393 / +0.2% 0.47 / 0.44 / +7.0%
tpch_q14/datafusion:vortex-file-compressed 176649850 / 178970213 / -1.3% 342589888 / 350854358 / -2.4% 0.52 / 0.51 / +1.1%
tpch_q15/datafusion:vortex-file-compressed 334288423 / 322081392 / +3.8% 521187374 / 510712295 / +2.1% 0.64 / 0.63 / +1.7%
tpch_q16/datafusion:vortex-file-compressed 137121466 / 126501014 / +8.4% 290836861 / 272473140 / +6.7% 0.47 / 0.46 / +1.6%
tpch_q17/datafusion:vortex-file-compressed 242723237 / 256065252 / -5.2% 490699309 / 465092987 / +5.5% 0.49 / 0.55 / -10.2%
tpch_q18/datafusion:vortex-file-compressed 280134454 / 290355928 / -3.5% 439690096 / 463238728 / -5.1% 0.64 / 0.63 / +1.6%
tpch_q19/datafusion:vortex-file-compressed 256933150 / 363374282 / -29.3% 476484683 / 390901590 / +21.9% 0.54 / 0.93 / -42.0%
tpch_q20/datafusion:vortex-file-compressed 290109372 / 320994507 / -9.6% 512986456 / 473423850 / +8.4% 0.57 / 0.68 / -16.6%
tpch_q21/datafusion:vortex-file-compressed 615304487 / 543096778 / +13.3% 1953239919 / 741583315 / +163.4% 🔴 0.32 / 0.73 / -57.0%
tpch_q22/datafusion:vortex-file-compressed 172905577 / 156825815 / +10.3% 399933182 / 487653353 / -18.0% 0.43 / 0.32 / +34.4%
datafusion / parquet / ns (0.963x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 162993208 / 150342294 / +8.4% 573533796 / 646421025 / -11.3% 0.28 / 0.23 / +22.2%
tpch_q02/datafusion:parquet 282984095 / 318145674 / -11.1% 556570688 / 528810111 / +5.2% 0.51 / 0.60 / -15.5%
tpch_q03/datafusion:parquet 245784855 / 266705687 / -7.8% 676467303 / 774689657 / -12.7% 0.36 / 0.34 / +5.5%
tpch_q04/datafusion:parquet 144837258 / 140052038 / +3.4% 264915797 / 350721027 / -24.5% 0.55 / 0.40 / +36.9%
tpch_q05/datafusion:parquet 383581034 / 375881936 / +2.0% 511012368 / 537365012 / -4.9% 0.75 / 0.70 / +7.3%
tpch_q06/datafusion:parquet 115781841 / 127689750 / -9.3% 245040754 / 264155280 / -7.2% 0.47 / 0.48 / -2.3%
tpch_q07/datafusion:parquet 337097763 / 357948555 / -5.8% 464790278 / 506363719 / -8.2% 0.73 / 0.71 / +2.6%
tpch_q08/datafusion:parquet 430814015 / 521246472 / -17.3% 523835709 / 638399108 / -17.9% 0.82 / 0.82 / +0.7%
tpch_q09/datafusion:parquet 399535678 / 399567776 / -0.0% 493024902 / 527347451 / -6.5% 0.81 / 0.76 / +7.0%
tpch_q10/datafusion:parquet 314766003 / 348602481 / -9.7% 612094081 / 461858523 / +32.5% 🔴 0.51 / 0.75 / -31.9%
tpch_q11/datafusion:parquet 257125566 / 267636402 / -3.9% 403179889 / 346313588 / +16.4% 0.64 / 0.77 / -17.5%
tpch_q12/datafusion:parquet 179701794 / 159129987 / +12.9% 529941146 / 347081161 / +52.7% 🔴 0.34 / 0.46 / -26.0%
tpch_q13/datafusion:parquet 276208680 / 276171368 / +0.0% 444360932 / 434549436 / +2.3% 0.62 / 0.64 / -2.2%
tpch_q14/datafusion:parquet 150361462 / 149523154 / +0.6% 262740337 / 258218950 / +1.8% 0.57 / 0.58 / -1.2%
tpch_q15/datafusion:parquet 296375413 / 302171840 / -1.9% 511510834 / 446225897 / +14.6% 0.58 / 0.68 / -14.4%
tpch_q16/datafusion:parquet 96535871 / 96091424 / +0.5% 212172001 / 391639268 / -45.8% 🟢 0.45 / 0.25 / +85.4%
tpch_q17/datafusion:parquet 314214037 / 287853076 / +9.2% 443872647 / 447489249 / -0.8% 0.71 / 0.64 / +10.0%
tpch_q18/datafusion:parquet 320574754 / 320843864 / -0.1% 493116490 / 506876018 / -2.7% 0.65 / 0.63 / +2.7%
tpch_q19/datafusion:parquet 157672120 / 156387904 / +0.8% 305928274 / 324442414 / -5.7% 0.52 / 0.48 / +6.9%
tpch_q20/datafusion:parquet 226017438 / 246557927 / -8.3% 445863058 / 355411653 / +25.4% 0.51 / 0.69 / -26.9%
tpch_q21/datafusion:parquet 326996437 / 432302473 / -24.4% 454311131 / 597012831 / -23.9% 0.72 / 0.72 / -0.6%
tpch_q22/datafusion:parquet 144291088 / 160313673 / -10.0% 319112737 / 324489963 / -1.7% 0.45 / 0.49 / -8.5%
duckdb / vortex-file-compressed / ns (0.958x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 247534886 / 249597078 / -0.8% 273930858 / 298875807 / -8.3% 0.90 / 0.84 / +8.2%
tpch_q02/duckdb:vortex-file-compressed 427543747 / 407595128 / +4.9% 502916967 / 508219919 / -1.0% 0.85 / 0.80 / +6.0%
tpch_q03/duckdb:vortex-file-compressed 418298348 / 412986649 / +1.3% 658516202 / 500554235 / +31.6% 🔴 0.64 / 0.83 / -23.0%
tpch_q04/duckdb:vortex-file-compressed 235661162 / 243739722 / -3.3% 283795248 / 282914589 / +0.3% 0.83 / 0.86 / -3.6%
tpch_q05/duckdb:vortex-file-compressed 798156813 / 697900940 / +14.4% 796038800 / 794970127 / +0.1% 1.00 / 0.88 / +14.2%
tpch_q06/duckdb:vortex-file-compressed 177270037 / 141618340 / +25.2% 190627468 / 193603466 / -1.5% 0.93 / 0.73 / +27.1%
tpch_q07/duckdb:vortex-file-compressed 412790890 / 379944758 / +8.6% 457343691 / 517052800 / -11.5% 0.90 / 0.73 / +22.8%
tpch_q08/duckdb:vortex-file-compressed 577129021 / 562852607 / +2.5% 628451656 / 671255688 / -6.4% 0.92 / 0.84 / +9.5%
tpch_q09/duckdb:vortex-file-compressed 396003970 / 380690575 / +4.0% 477123982 / 403319411 / +18.3% 0.83 / 0.94 / -12.1%
tpch_q10/duckdb:vortex-file-compressed 505708438 / 534562426 / -5.4% 504573561 / 530988355 / -5.0% 1.00 / 1.01 / -0.4%
tpch_q11/duckdb:vortex-file-compressed 299702750 / 354415648 / -15.4% 362821527 / 370481431 / -2.1% 0.83 / 0.96 / -13.7%
tpch_q12/duckdb:vortex-file-compressed 272908615 / 259431028 / +5.2% 311586740 / 331654821 / -6.1% 0.88 / 0.78 / +12.0%
tpch_q13/duckdb:vortex-file-compressed 272378535 / 263741725 / +3.3% 222607088 / 218743465 / +1.8% 1.22 / 1.21 / +1.5%
tpch_q14/duckdb:vortex-file-compressed 216153982 / 211934175 / +2.0% 361796965 / 261396399 / +38.4% 🔴 0.60 / 0.81 / -26.3%
tpch_q15/duckdb:vortex-file-compressed 243789196 / 266824668 / -8.6% 259904813 / 287091118 / -9.5% 0.94 / 0.93 / +0.9%
tpch_q16/duckdb:vortex-file-compressed 207836978 / 231111457 / -10.1% 257379445 / 269193615 / -4.4% 0.81 / 0.86 / -5.9%
tpch_q17/duckdb:vortex-file-compressed 315265813 / 392257562 / -19.6% 306202579 / 440068338 / -30.4% 🟢 1.03 / 0.89 / +15.5%
tpch_q18/duckdb:vortex-file-compressed 342090155 / 464225551 / -26.3% 393608394 / 408985968 / -3.8% 0.87 / 1.14 / -23.4%
tpch_q19/duckdb:vortex-file-compressed 277514830 / 313715711 / -11.5% 289879422 / 306058070 / -5.3% 0.96 / 1.03 / -6.6%
tpch_q20/duckdb:vortex-file-compressed 360856999 / 417698583 / -13.6% 434399435 / 420348861 / +3.3% 0.83 / 0.99 / -16.4%
tpch_q21/duckdb:vortex-file-compressed 587719659 / 808105269 / -27.3% 637100169 / 925274359 / -31.1% 🟢 0.92 / 0.87 / +5.6%
tpch_q22/duckdb:vortex-file-compressed 243549956 / 254112149 / -4.2% 273706333 / 291904033 / -6.2% 0.89 / 0.87 / +2.2%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 197146663 / 155769346 / +26.6% 235989125 / 245281191 / -3.8% 0.84 / 0.64 / +31.5%
tpch_q02/duckdb:parquet 480160753 / 450870470 / +6.5% 521140210 / 518844598 / +0.4% 0.92 / 0.87 / +6.0%
tpch_q03/duckdb:parquet 437402809 / 435397247 / +0.5% 517286972 / 619722832 / -16.5% 0.85 / 0.70 / +20.4%
tpch_q04/duckdb:parquet 268538911 / 261483672 / +2.7% 339707511 / 297370408 / +14.2% 0.79 / 0.88 / -10.1%
tpch_q05/duckdb:parquet 508451664 / 547473896 / -7.1% 679448585 / 560648713 / +21.2% 0.75 / 0.98 / -23.4%
tpch_q06/duckdb:parquet 155514409 / 165852535 / -6.2% 192249751 / 171106172 / +12.4% 0.81 / 0.97 / -16.5%
tpch_q07/duckdb:parquet 430688351 / 450528044 / -4.4% 456262700 / 483335528 / -5.6% 0.94 / 0.93 / +1.3%
tpch_q08/duckdb:parquet 605708528 / 616162684 / -1.7% 653571885 / 853513101 / -23.4% 0.93 / 0.72 / +28.4%
tpch_q09/duckdb:parquet 549895713 / 587897421 / -6.5% 552441219 / 983222702 / -43.8% 🟢 1.00 / 0.60 / +66.5%
tpch_q10/duckdb:parquet 559729078 / 612122344 / -8.6% 611123942 / 1076964806 / -43.3% 🟢 0.92 / 0.57 / +61.1%
tpch_q11/duckdb:parquet 283550737 / 271284896 / +4.5% 291761602 / 309469624 / -5.7% 0.97 / 0.88 / +10.9%
tpch_q12/duckdb:parquet 263619017 / 284581482 / -7.4% 383530681 / 392791683 / -2.4% 0.69 / 0.72 / -5.1%
tpch_q13/duckdb:parquet 369099873 / 346773236 / +6.4% 407298173 / 587932376 / -30.7% 🟢 0.91 / 0.59 / +53.6%
tpch_q14/duckdb:parquet 255858058 / 235587342 / +8.6% 333960569 / 298727797 / +11.8% 0.77 / 0.79 / -2.9%
tpch_q15/duckdb:parquet 204568160 / 191597413 / +6.8% 238209573 / 217100593 / +9.7% 0.86 / 0.88 / -2.7%
tpch_q16/duckdb:parquet 298786617 / 270027796 / +10.7% 377425094 / 296145732 / +27.4% 0.79 / 0.91 / -13.2%
tpch_q17/duckdb:parquet 285799405 / 313678834 / -8.9% 356596077 / 325672736 / +9.5% 0.80 / 0.96 / -16.8%
tpch_q18/duckdb:parquet 368148385 / 343324586 / +7.2% 391908365 / 369120013 / +6.2% 0.94 / 0.93 / +1.0%
tpch_q19/duckdb:parquet 246467626 / 228920278 / +7.7% 312009286 / 295217714 / +5.7% 0.79 / 0.78 / +1.9%
tpch_q20/duckdb:parquet 462610224 / 520969487 / -11.2% 485947824 / 703938676 / -31.0% 🟢 0.95 / 0.74 / +28.6%
tpch_q21/duckdb:parquet 408553856 / 466019234 / -12.3% 578894490 / 630524878 / -8.2% 0.71 / 0.74 / -4.5%
tpch_q22/duckdb:parquet 323531852 / 306782848 / +5.5% 333699257 / 324135047 / +3.0% 0.97 / 0.95 / +2.4%

@connortsui20

Copy link
Copy Markdown
Member Author

Whoops the regressions are real, making a fix

connortsui20 and others added 4 commits October 27, 2026 08:52
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
The width dispatch change made the primitive interleave gather yield
`Result<[u8; W], VortexError>` per row. `[u8; W]` has alignment 1, so the
`Ok` payload sits at offset 1 and LLVM splits each 8-byte copy into
4 + 2 + 1 + 1 byte moves. This roughly doubled the time of the
`interleave` primitive benchmarks.

Write rows through the buffer's spare capacity slice instead. This keeps
each copy a single move and lets LLVM hold the loop state in registers.
The benchmarks now match or beat the code before the width dispatch
change.

Claude-Session: https://claude.ai/code/session_019amF7o3i2tJvRGbgL3c3GA
Signed-off-by: Claude <noreply@anthropic.com>
@connortsui20
connortsui20 force-pushed the ct/physical-width-dispatch branch from 2ea4cfd to f0517af Compare October 27, 2026 12:52
@connortsui20

Copy link
Copy Markdown
Member Author

Oh claude already made the fix, the microbenchmarks aren't up to date

@connortsui20

Copy link
Copy Markdown
Member Author

Somehow some things are faster, not sure I believe that

@connortsui20
connortsui20 merged commit d610673 into develop Oct 27, 2026
80 of 81 checks passed
@connortsui20
connortsui20 deleted the ct/physical-width-dispatch branch October 27, 2026 13:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants