Skip to content

Use the shared scan driver in the DataFusion file opener - #11611

Merged
gatesn merged 2 commits into
developfrom
ngates/datafusion-shared-scan-driver
Nov 19, 2026
Merged

gatesn merged 2 commits into
developfrom
ngates/datafusion-shared-scan-driver

Conversation

@gatesn

@gatesn gatesn commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Use the shared driver for the DataFusion V2 file opener and remove its duplicate scheduler. The opener still waits for scan preparation so failures are reported as file-open errors, and Arrow conversion still runs on the task that produces each batch.

When several chunks run on the same scheduler, such as with scan_concurrency=0, each chunk needs its own queue for pending reads. The shared driver used to give these chunks the same I/O session, so when one chunk finished and cleared the session, it could discard another chunk’s pending reads. Give each planner root its own session over the same file source, preserving the isolation DataFusion already had for inline chunks.

Stacked on #11610.
Part of #9062.

This change was prepared with assistance from OpenAI Codex.

@gatesn gatesn added the changelog/chore A trivial change label Nov 18, 2026
@gatesn
gatesn added this pull request to stack #11612 November 18, 2026 19:50
@gatesn
gatesn force-pushed the ngates/datafusion-shared-scan-driver branch from b55e7c9 to 2e569f7 Compare November 18, 2026 20:15
@gatesn
gatesn requested a review from joseph-isaacs November 18, 2026 20:18
@gatesn
gatesn marked this pull request as ready for review November 18, 2026 20:18
@gatesn
gatesn enabled stacked auto-merge (squash) November 18, 2026 20:18
@connortsui20 connortsui20 added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Nov 18, 2026
@github-actions github-actions Bot removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Nov 18, 2026
@codspeed

codspeed Bot commented Nov 18, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 12.77%

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚡ 1 improved benchmark
❌ 6 regressed benchmarks
✅ 1968 untouched benchmarks
⏩ 53 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime compare_u8_neon 1.7 µs 2.3 µs -26.7%
❌ Walltime compare_f32_neon 4.2 µs 5 µs -16.76%
❌ Walltime compare_u64_neon 4 µs 4.8 µs -15.94%
❌ Walltime compare_int_constant_neon 3.3 µs 3.8 µs -14.42%
❌ Walltime compare_int_eq_neon 3.9 µs 4.4 µs -11.15%
❌ Walltime compare_int_nullable_neon 4.4 µs 4.9 µs -10.6%
⚡ Walltime decode_avx512[DeltaU8] 11.1 µs 10.1 µs +10.24%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ngates/datafusion-shared-scan-driver (28218cf) with develop (452f24a)

Open in CodSpeed

Footnotes

  1. 53 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

github-actions Bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2e569f7 tpcds-nvme 1 Explore Profiling Data
🟢 Done 2e569f7 appian-nvme 1 Explore Profiling Data
🟢 Done 2e569f7 clickbench-nvme 1 Explore Profiling Data
🟢 Done 2e569f7 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 2e569f7 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 2e569f7 fineweb 1 Explore Profiling Data
🟢 Done 2e569f7 statpopgen 1 Explore Profiling Data
🟢 Done 2e569f7 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 2e569f7 polarsignals 1 Explore Profiling Data
🟢 Done 2e569f7 tpch-s3-10 1 Explore Profiling Data
🟢 Done 2e569f7 fineweb-s3 1 Explore Profiling Data
🟢 Done 2e569f7 tpch-s3 1 Explore Profiling Data
🟢 Done 2e569f7 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 2e569f7e vs base d5373802
Vortex (geomean): hot 0.999x ➖ · cold 0.952x ➖


datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 80888994 / 81094905 / -0.3% 118014146 / 121970217 / -3.2% 0.69 / 0.66 / +3.1%
polarsignals_q01/datafusion:vortex-file-compressed 90219746 / 88866520 / +1.5% 144991798 / 145451746 / -0.3% 0.62 / 0.61 / +1.8%
polarsignals_q02/datafusion:vortex-file-compressed 14337459 / 14561970 / -1.5% 46061840 / 47507811 / -3.0% 0.31 / 0.31 / +1.5%
polarsignals_q03/datafusion:vortex-file-compressed 91079552 / 92281098 / -1.3% 147490644 / 148753769 / -0.8% 0.62 / 0.62 / -0.5%
polarsignals_q04/datafusion:vortex-file-compressed 8974618 / 9236430 / -2.8% 37796247 / 40157829 / -5.9% 0.24 / 0.23 / +3.2%
polarsignals_q05/datafusion:vortex-file-compressed 11439956 / 11739224 / -2.5% 41201840 / 43529907 / -5.3% 0.28 / 0.27 / +3.0%
polarsignals_q06/datafusion:vortex-file-compressed 22904514 / 22898603 / +0.0% 51159437 / 54730905 / -6.5% 0.45 / 0.42 / +7.0%
polarsignals_q07/datafusion:vortex-file-compressed 10640738 / 10763124 / -1.1% 40168699 / 41859865 / -4.0% 0.26 / 0.26 / +3.0%
polarsignals_q08/datafusion:vortex-file-compressed 134554487 / 134422682 / +0.1% 191747882 / 193579848 / -0.9% 0.70 / 0.69 / +1.1%
polarsignals_q09/datafusion:vortex-file-compressed 9866526 / 9843114 / +0.2% 37566694 / 40357241 / -6.9% 0.26 / 0.24 / +7.7%
polarsignals_q10/datafusion:vortex-file-compressed 17540978 / 17535359 / +0.0% 48909463 / 53419690 / -8.4% 0.36 / 0.33 / +9.3%
polarsignals_q11/datafusion:vortex-file-compressed 16280428 / 16020822 / +1.6% 47584993 / 51636328 / -7.8% 0.34 / 0.31 / +10.3%
polarsignals_q12/datafusion:vortex-file-compressed 16770398 / 16010094 / +4.7% 44461893 / 48681826 / -8.7% 0.38 / 0.33 / +14.7%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-1.4%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.967x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5998616 / 6117482 / -1.9% 20471756 / 19828503 / +3.2% 0.29 / 0.31 / -5.0%
fineweb_q01/datafusion:vortex-file-compressed 9294813 / 8651656 / +7.4% 35352716 / 39745422 / -11.1% 🟢 0.26 / 0.22 / +20.8%
fineweb_q02/datafusion:vortex-file-compressed 10678956 / 11158508 / -4.3% 39683829 / 41712116 / -4.9% 0.27 / 0.27 / +0.6%
fineweb_q03/datafusion:vortex-file-compressed 17101736 / 18091623 / -5.5% 101897393 / 99037515 / +2.9% 0.17 / 0.18 / -8.1%
fineweb_q04/datafusion:vortex-file-compressed 39402584 / 38974358 / +1.1% 113700710 / 112401663 / +1.2% 0.35 / 0.35 / -0.1%
fineweb_q05/datafusion:vortex-file-compressed 35857641 / 36885796 / -2.8% 107618059 / 116893853 / -7.9% 0.33 / 0.32 / +5.6%
fineweb_q06/datafusion:vortex-file-compressed 16507178 / 17696691 / -6.7% 96156586 / 94301630 / +2.0% 0.17 / 0.19 / -8.5%
fineweb_q07/datafusion:vortex-file-compressed 16638699 / 16778134 / -0.8% 99546892 / 103488368 / -3.8% 0.17 / 0.16 / +3.1%
fineweb_q08/datafusion:vortex-file-compressed 8943540 / 8076346 / +10.7% 🔴 23721243 / 27701553 / -14.4% 🟢 0.38 / 0.29 / +29.3%
datafusion / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9621520 / 9514346 / +1.1% 31267637 / 33871288 / -7.7% 0.31 / 0.28 / +9.5%
fineweb_q01/datafusion:parquet 75026886 / 74867081 / +0.2% 149402499 / 141580032 / +5.5% 0.50 / 0.53 / -5.0%
fineweb_q02/datafusion:parquet 76278564 / 75005212 / +1.7% 145566054 / 150282733 / -3.1% 0.52 / 0.50 / +5.0%
fineweb_q03/datafusion:parquet 75367884 / 73243494 / +2.9% 143224529 / 148015722 / -3.2% 0.53 / 0.49 / +6.3%
fineweb_q04/datafusion:parquet 83668428 / 81989372 / +2.0% 148301713 / 146437338 / +1.3% 0.56 / 0.56 / +0.8%
fineweb_q05/datafusion:parquet 80744364 / 81243009 / -0.6% 146393400 / 146126206 / +0.2% 0.55 / 0.56 / -0.8%
fineweb_q06/datafusion:parquet 74631829 / 74783707 / -0.2% 147393107 / 151861835 / -2.9% 0.51 / 0.49 / +2.8%
fineweb_q07/datafusion:parquet 73951396 / 73068760 / +1.2% 151293796 / 141230352 / +7.1% 0.49 / 0.52 / -5.5%
fineweb_q08/datafusion:parquet 74511038 / 74621766 / -0.1% 144086461 / 144194909 / -0.1% 0.52 / 0.52 / -0.1%
duckdb / vortex-file-compressed / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2198259 / 2113032 / +4.0% 7172178 / 8070817 / -11.1% 🟢 0.31 / 0.26 / +17.1%
fineweb_q01/duckdb:vortex-file-compressed 9773642 / 9032599 / +8.2% 26546333 / 26834943 / -1.1% 0.37 / 0.34 / +9.4%
fineweb_q02/duckdb:vortex-file-compressed 10506104 / 10349122 / +1.5% 26764555 / 28386754 / -5.7% 0.39 / 0.36 / +7.7%
fineweb_q03/duckdb:vortex-file-compressed 18810346 / 18465424 / +1.9% 87189195 / 90127359 / -3.3% 0.22 / 0.20 / +5.3%
fineweb_q04/duckdb:vortex-file-compressed 39129238 / 39855132 / -1.8% 97353870 / 94218509 / +3.3% 0.40 / 0.42 / -5.0%
fineweb_q05/duckdb:vortex-file-compressed 39116945 / 39810278 / -1.7% 93796895 / 93982658 / -0.2% 0.42 / 0.42 / -1.5%
fineweb_q06/duckdb:vortex-file-compressed 18345711 / 18143524 / +1.1% 87208269 / 91553922 / -4.7% 0.21 / 0.20 / +6.2%
fineweb_q07/duckdb:vortex-file-compressed 17860107 / 17426154 / +2.5% 86740104 / 87587502 / -1.0% 0.21 / 0.20 / +3.5%
fineweb_q08/duckdb:vortex-file-compressed 4112447 / 4325539 / -4.9% 11801651 / 11923197 / -1.0% 0.35 / 0.36 / -3.9%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23458351 / 23439010 / +0.1% 27783861 / 27927516 / -0.5% 0.84 / 0.84 / +0.6%
fineweb_q01/duckdb:parquet 54905002 / 54742006 / +0.3% 75531846 / 72968834 / +3.5% 0.73 / 0.75 / -3.1%
fineweb_q02/duckdb:parquet 58673327 / 58220480 / +0.8% 74852056 / 79260651 / -5.6% 0.78 / 0.73 / +6.7%
fineweb_q03/duckdb:parquet 118464144 / 119453929 / -0.8% 185341139 / 170939331 / +8.4% 0.64 / 0.70 / -8.5%
fineweb_q04/duckdb:parquet 159367814 / 160738288 / -0.9% 202929113 / 206864523 / -1.9% 0.79 / 0.78 / +1.1%
fineweb_q05/duckdb:parquet 158176247 / 157412190 / +0.5% 200519905 / 200457495 / +0.0% 0.79 / 0.79 / +0.5%
fineweb_q06/duckdb:parquet 86392076 / 89917390 / -3.9% 147243670 / 143491245 / +2.6% 0.59 / 0.63 / -6.4%
fineweb_q07/duckdb:parquet 89241454 / 90684114 / -1.6% 148423396 / 139207627 / +6.6% 0.60 / 0.65 / -7.7%
fineweb_q08/duckdb:parquet 28453132 / 28811704 / -1.2% 30576167 / 30292794 / +0.9% 0.93 / 0.95 / -2.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.012x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16867377 / 16364953 / +3.1% 45362649 / 44360589 / +2.3% 0.37 / 0.37 / +0.8%
tpch_q02/datafusion:vortex-compact 19261824 / 19449832 / -1.0% 39846375 / 38910358 / +2.4% 0.48 / 0.50 / -3.3%
tpch_q03/datafusion:vortex-compact 19892319 / 20029237 / -0.7% 45654829 / 46480321 / -1.8% 0.44 / 0.43 / +1.1%
tpch_q04/datafusion:vortex-compact 10958438 / 11150808 / -1.7% 34770906 / 35485464 / -2.0% 0.32 / 0.31 / +0.3%
tpch_q05/datafusion:vortex-compact 38052419 / 38323560 / -0.7% 67611946 / 64666687 / +4.6% 0.56 / 0.59 / -5.0%
tpch_q06/datafusion:vortex-compact 5590759 / 5486668 / +1.9% 27627456 / 28170388 / -1.9% 0.20 / 0.19 / +3.9%
tpch_q07/datafusion:vortex-compact 54357697 / 53923800 / +0.8% 79694274 / 78244950 / +1.9% 0.68 / 0.69 / -1.0%
tpch_q08/datafusion:vortex-compact 53005579 / 52708154 / +0.6% 82641744 / 82557031 / +0.1% 0.64 / 0.64 / +0.5%
tpch_q09/datafusion:vortex-compact 51038849 / 49378490 / +3.4% 78447731 / 79013463 / -0.7% 0.65 / 0.62 / +4.1%
tpch_q10/datafusion:vortex-compact 19587119 / 19133994 / +2.4% 49258991 / 50408786 / -2.3% 0.40 / 0.38 / +4.8%
tpch_q11/datafusion:vortex-compact 15164664 / 15112082 / +0.3% 35840496 / 36447135 / -1.7% 0.42 / 0.41 / +2.0%
tpch_q12/datafusion:vortex-compact 20241122 / 19775207 / +2.4% 42453847 / 41951186 / +1.2% 0.48 / 0.47 / +1.1%
tpch_q13/datafusion:vortex-compact 19654922 / 21121950 / -6.9% 40801628 / 39043585 / +4.5% 0.48 / 0.54 / -11.0%
tpch_q14/datafusion:vortex-compact 14979134 / 15353450 / -2.4% 40207498 / 38247602 / +5.1% 0.37 / 0.40 / -7.2%
tpch_q15/datafusion:vortex-compact 20157115 / 20094202 / +0.3% 47872071 / 47804282 / +0.1% 0.42 / 0.42 / +0.2%
tpch_q16/datafusion:vortex-compact 18399624 / 18387963 / +0.1% 38915443 / 38274572 / +1.7% 0.47 / 0.48 / -1.6%
tpch_q17/datafusion:vortex-compact 30308979 / 30435764 / -0.4% 61337968 / 60772735 / +0.9% 0.49 / 0.50 / -1.3%
tpch_q18/datafusion:vortex-compact 36826690 / 36753720 / +0.2% 60350150 / 58247381 / +3.6% 0.61 / 0.63 / -3.3%
tpch_q19/datafusion:vortex-compact 11698587 / 11188955 / +4.6% 40704262 / 38333191 / +6.2% 0.29 / 0.29 / -1.5%
tpch_q20/datafusion:vortex-compact 21739815 / 21978994 / -1.1% 44680084 / 49634956 / -10.0% 0.49 / 0.44 / +9.9%
tpch_q21/datafusion:vortex-compact 37729252 / 37759530 / -0.1% 71182337 / 68546463 / +3.8% 0.53 / 0.55 / -3.8%
tpch_q22/datafusion:vortex-compact 11536469 / 11260596 / +2.4% 32299606 / 31683905 / +1.9% 0.36 / 0.36 / +0.5%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71014049 / 71077014 / -0.1% 89927761 / 87975506 / +2.2% 0.79 / 0.81 / -2.3%
tpch_q02/datafusion:parquet 76052327 / 76008608 / +0.1% 93066558 / 92682003 / +0.4% 0.82 / 0.82 / -0.4%
tpch_q03/datafusion:parquet 81844802 / 81348581 / +0.6% 104782707 / 104724145 / +0.1% 0.78 / 0.78 / +0.6%
tpch_q04/datafusion:parquet 39253613 / 39712008 / -1.2% 60023530 / 57335547 / +4.7% 0.65 / 0.69 / -5.6%
tpch_q05/datafusion:parquet 110377453 / 110696353 / -0.3% 137218163 / 136051287 / +0.9% 0.80 / 0.81 / -1.1%
tpch_q06/datafusion:parquet 31579683 / 31656344 / -0.2% 49093794 / 47545401 / +3.3% 0.64 / 0.67 / -3.4%
tpch_q07/datafusion:parquet 113144489 / 112914935 / +0.2% 140128288 / 138871059 / +0.9% 0.81 / 0.81 / -0.7%
tpch_q08/datafusion:parquet 117314107 / 117675832 / -0.3% 144812187 / 143226916 / +1.1% 0.81 / 0.82 / -1.4%
tpch_q09/datafusion:parquet 137374740 / 136765911 / +0.4% 167970002 / 167591581 / +0.2% 0.82 / 0.82 / +0.2%
tpch_q10/datafusion:parquet 104146851 / 103431301 / +0.7% 130667110 / 127681884 / +2.3% 0.80 / 0.81 / -1.6%
tpch_q11/datafusion:parquet 61947791 / 61624863 / +0.5% 81209087 / 81111830 / +0.1% 0.76 / 0.76 / +0.4%
tpch_q12/datafusion:parquet 63490444 / 64237360 / -1.2% 85432407 / 85280892 / +0.2% 0.74 / 0.75 / -1.3%
tpch_q13/datafusion:parquet 143548596 / 143435465 / +0.1% 163941003 / 164817007 / -0.5% 0.88 / 0.87 / +0.6%
tpch_q14/datafusion:parquet 47886570 / 47741697 / +0.3% 70299007 / 70085205 / +0.3% 0.68 / 0.68 / -0.0%
tpch_q15/datafusion:parquet 73993557 / 74312815 / -0.4% 94413348 / 93204490 / +1.3% 0.78 / 0.80 / -1.7%
tpch_q16/datafusion:parquet 43712761 / 43916764 / -0.5% 64030630 / 59010361 / +8.5% 0.68 / 0.74 / -8.3%
tpch_q17/datafusion:parquet 124335748 / 123985812 / +0.3% 148249459 / 147601828 / +0.4% 0.84 / 0.84 / -0.2%
tpch_q18/datafusion:parquet 120747416 / 120609718 / +0.1% 144464832 / 139016633 / +3.9% 0.84 / 0.87 / -3.7%
tpch_q19/datafusion:parquet 57550344 / 56555687 / +1.8% 83001136 / 81286571 / +2.1% 0.69 / 0.70 / -0.3%
tpch_q20/datafusion:parquet 78170531 / 78222203 / -0.1% 101952141 / 98558583 / +3.4% 0.77 / 0.79 / -3.4%
tpch_q21/datafusion:parquet 112887358 / 113368192 / -0.4% 141181391 / 136961895 / +3.1% 0.80 / 0.83 / -3.4%
tpch_q22/datafusion:parquet 52378003 / 51778458 / +1.2% 68634873 / 67616590 / +1.5% 0.76 / 0.77 / -0.3%
duckdb / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 10312021 / 11253063 / -8.4% 22280515 / 22357510 / -0.3% 0.46 / 0.50 / -8.0%
tpch_q02/duckdb:vortex-compact 17397368 / 17380027 / +0.1% 27120347 / 27746731 / -2.3% 0.64 / 0.63 / +2.4%
tpch_q03/duckdb:vortex-compact 19853363 / 19991315 / -0.7% 35774376 / 35683679 / +0.3% 0.55 / 0.56 / -0.9%
tpch_q04/duckdb:vortex-compact 13325795 / 13091984 / +1.8% 27650102 / 26752585 / +3.4% 0.48 / 0.49 / -1.5%
tpch_q05/duckdb:vortex-compact 21149340 / 20982969 / +0.8% 36723730 / 36151276 / +1.6% 0.58 / 0.58 / -0.8%
tpch_q06/duckdb:vortex-compact 5289176 / 5204022 / +1.6% 16359050 / 15360127 / +6.5% 0.32 / 0.34 / -4.6%
tpch_q07/duckdb:vortex-compact 25582395 / 25819377 / -0.9% 42026143 / 42804145 / -1.8% 0.61 / 0.60 / +0.9%
tpch_q08/duckdb:vortex-compact 21635119 / 21974315 / -1.5% 38374792 / 38862603 / -1.3% 0.56 / 0.57 / -0.3%
tpch_q09/duckdb:vortex-compact 24224649 / 23858305 / +1.5% 40618518 / 39654148 / +2.4% 0.60 / 0.60 / -0.9%
tpch_q10/duckdb:vortex-compact 31726354 / 31163086 / +1.8% 47663031 / 47412468 / +0.5% 0.67 / 0.66 / +1.3%
tpch_q11/duckdb:vortex-compact 8495892 / 8453440 / +0.5% 19093774 / 17316310 / +10.3% 🔴 0.44 / 0.49 / -8.9%
tpch_q12/duckdb:vortex-compact 17375916 / 17331780 / +0.3% 27821127 / 28362988 / -1.9% 0.62 / 0.61 / +2.2%
tpch_q13/duckdb:vortex-compact 19949963 / 20115239 / -0.8% 31812955 / 33161610 / -4.1% 0.63 / 0.61 / +3.4%
tpch_q14/duckdb:vortex-compact 12474041 / 12190238 / +2.3% 28022351 / 26110952 / +7.3% 0.45 / 0.47 / -4.7%
tpch_q15/duckdb:vortex-compact 9775749 / 9307952 / +5.0% 22790459 / 23003693 / -0.9% 0.43 / 0.40 / +6.0%
tpch_q16/duckdb:vortex-compact 17264176 / 17246852 / +0.1% 24245710 / 23821532 / +1.8% 0.71 / 0.72 / -1.7%
tpch_q17/duckdb:vortex-compact 13604182 / 13477122 / +0.9% 30362150 / 28847296 / +5.3% 0.45 / 0.47 / -4.1%
tpch_q18/duckdb:vortex-compact 25563670 / 25052359 / +2.0% 34940356 / 33549740 / +4.1% 0.73 / 0.75 / -2.0%
tpch_q19/duckdb:vortex-compact 14353308 / 14893949 / -3.6% 30954007 / 29730438 / +4.1% 0.46 / 0.50 / -7.4%
tpch_q20/duckdb:vortex-compact 16798981 / 17682528 / -5.0% 33562173 / 33818281 / -0.8% 0.50 / 0.52 / -4.3%
tpch_q21/duckdb:vortex-compact 49445670 / 49139476 / +0.6% 65529056 / 65817399 / -0.4% 0.75 / 0.75 / +1.1%
tpch_q22/duckdb:vortex-compact 19692863 / 19451239 / +1.2% 28948392 / 28830269 / +0.4% 0.68 / 0.67 / +0.8%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47568377 / 47453094 / +0.2% 54480056 / 53979925 / +0.9% 0.87 / 0.88 / -0.7%
tpch_q02/duckdb:parquet 48215389 / 48287343 / -0.1% 55401792 / 55797700 / -0.7% 0.87 / 0.87 / +0.6%
tpch_q03/duckdb:parquet 60272419 / 60257002 / +0.0% 68314908 / 68876443 / -0.8% 0.88 / 0.87 / +0.8%
tpch_q04/duckdb:parquet 34759807 / 34636740 / +0.4% 43791482 / 43820310 / -0.1% 0.79 / 0.79 / +0.4%
tpch_q05/duckdb:parquet 67122866 / 67153308 / -0.0% 77074853 / 78121188 / -1.3% 0.87 / 0.86 / +1.3%
tpch_q06/duckdb:parquet 21555982 / 21801872 / -1.1% 26880935 / 27227481 / -1.3% 0.80 / 0.80 / +0.1%
tpch_q07/duckdb:parquet 63985980 / 63851892 / +0.2% 73753221 / 74134773 / -0.5% 0.87 / 0.86 / +0.7%
tpch_q08/duckdb:parquet 75784167 / 75696357 / +0.1% 87120494 / 87136135 / -0.0% 0.87 / 0.87 / +0.1%
tpch_q09/duckdb:parquet 107812869 / 107704781 / +0.1% 119876917 / 119571464 / +0.3% 0.90 / 0.90 / -0.2%
tpch_q10/duckdb:parquet 106046743 / 105374207 / +0.6% 117916662 / 116909323 / +0.9% 0.90 / 0.90 / -0.2%
tpch_q11/duckdb:parquet 29544631 / 29413604 / +0.4% 34394753 / 35003983 / -1.7% 0.86 / 0.84 / +2.2%
tpch_q12/duckdb:parquet 37182182 / 37119571 / +0.2% 44543318 / 44704318 / -0.4% 0.83 / 0.83 / +0.5%
tpch_q13/duckdb:parquet 174337786 / 175168600 / -0.5% 182919899 / 181214693 / +0.9% 0.95 / 0.97 / -1.4%
tpch_q14/duckdb:parquet 42189249 / 42288104 / -0.2% 50781328 / 50659686 / +0.2% 0.83 / 0.83 / -0.5%
tpch_q15/duckdb:parquet 32585467 / 32753134 / -0.5% 40940467 / 41599543 / -1.6% 0.80 / 0.79 / +1.1%
tpch_q16/duckdb:parquet 47333590 / 47099828 / +0.5% 52765436 / 52514372 / +0.5% 0.90 / 0.90 / +0.0%
tpch_q17/duckdb:parquet 48115470 / 48072044 / +0.1% 57715506 / 57523837 / +0.3% 0.83 / 0.84 / -0.2%
tpch_q18/duckdb:parquet 74389767 / 74354543 / +0.0% 80392568 / 81385806 / -1.2% 0.93 / 0.91 / +1.3%
tpch_q19/duckdb:parquet 50762478 / 48882092 / +3.8% 59001644 / 62508160 / -5.6% 0.86 / 0.78 / +10.0%
tpch_q20/duckdb:parquet 63330826 / 63487788 / -0.2% 74032405 / 74097096 / -0.1% 0.86 / 0.86 / -0.2%
tpch_q21/duckdb:parquet 107015697 / 106495564 / +0.5% 116577007 / 115270394 / +1.1% 0.92 / 0.92 / -0.6%
tpch_q22/duckdb:parquet 50430463 / 50378790 / +0.1% 58610407 / 58782141 / -0.3% 0.86 / 0.86 / +0.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.995x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15569737 / 15943132 / -2.3% 45953910 / 41514514 / +10.7% 🔴 0.34 / 0.38 / -11.8%
tpch_q02/datafusion:vortex-file-compressed 17492213 / 17582121 / -0.5% 39357275 / 38026949 / +3.5% 0.44 / 0.46 / -3.9%
tpch_q03/datafusion:vortex-file-compressed 18814316 / 19277277 / -2.4% 45359823 / 47567624 / -4.6% 0.41 / 0.41 / +2.3%
tpch_q04/datafusion:vortex-file-compressed 10497003 / 10281649 / +2.1% 34312898 / 34367669 / -0.2% 0.31 / 0.30 / +2.3%
tpch_q05/datafusion:vortex-file-compressed 37376709 / 37399482 / -0.1% 66020288 / 66841467 / -1.2% 0.57 / 0.56 / +1.2%
tpch_q06/datafusion:vortex-file-compressed 4348139 / 4540852 / -4.2% 25935360 / 24758173 / +4.8% 0.17 / 0.18 / -8.6%
tpch_q07/datafusion:vortex-file-compressed 52699559 / 52662934 / +0.1% 80613132 / 76829622 / +4.9% 0.65 / 0.69 / -4.6%
tpch_q08/datafusion:vortex-file-compressed 52140221 / 51810322 / +0.6% 85452085 / 86009442 / -0.6% 0.61 / 0.60 / +1.3%
tpch_q09/datafusion:vortex-file-compressed 47493737 / 50666538 / -6.3% 77399157 / 78417007 / -1.3% 0.61 / 0.65 / -5.0%
tpch_q10/datafusion:vortex-file-compressed 17720283 / 17737668 / -0.1% 47824395 / 49790052 / -3.9% 0.37 / 0.36 / +4.0%
tpch_q11/datafusion:vortex-file-compressed 14788827 / 14842738 / -0.4% 35250325 / 33848089 / +4.1% 0.42 / 0.44 / -4.3%
tpch_q12/datafusion:vortex-file-compressed 18604867 / 18819513 / -1.1% 43098875 / 41749058 / +3.2% 0.43 / 0.45 / -4.2%
tpch_q13/datafusion:vortex-file-compressed 20168742 / 19678684 / +2.5% 41044648 / 39499136 / +3.9% 0.49 / 0.50 / -1.4%
tpch_q14/datafusion:vortex-file-compressed 14045481 / 14274828 / -1.6% 37278832 / 40552682 / -8.1% 0.38 / 0.35 / +7.0%
tpch_q15/datafusion:vortex-file-compressed 18720509 / 18770187 / -0.3% 48078910 / 46843095 / +2.6% 0.39 / 0.40 / -2.8%
tpch_q16/datafusion:vortex-file-compressed 17825451 / 18500938 / -3.7% 40199122 / 38838224 / +3.5% 0.44 / 0.48 / -6.9%
tpch_q17/datafusion:vortex-file-compressed 29516804 / 29256554 / +0.9% 58625417 / 58317464 / +0.5% 0.50 / 0.50 / +0.4%
tpch_q18/datafusion:vortex-file-compressed 36696545 / 36273744 / +1.2% 60224994 / 60378998 / -0.3% 0.61 / 0.60 / +1.4%
tpch_q19/datafusion:vortex-file-compressed 10072024 / 10009175 / +0.6% 36288667 / 35225034 / +3.0% 0.28 / 0.28 / -2.3%
tpch_q20/datafusion:vortex-file-compressed 20621893 / 20640310 / -0.1% 45010749 / 46627602 / -3.5% 0.46 / 0.44 / +3.5%
tpch_q21/datafusion:vortex-file-compressed 34748350 / 35069176 / -0.9% 65740396 / 63949873 / +2.8% 0.53 / 0.55 / -3.6%
tpch_q22/datafusion:vortex-file-compressed 10889021 / 10929943 / -0.4% 32323199 / 30253325 / +6.8% 0.34 / 0.36 / -6.8%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71372175 / 71077014 / +0.4% 89383218 / 87975506 / +1.6% 0.80 / 0.81 / -1.2%
tpch_q02/datafusion:parquet 76744781 / 76008608 / +1.0% 93477896 / 92682003 / +0.9% 0.82 / 0.82 / +0.1%
tpch_q03/datafusion:parquet 82371718 / 81348581 / +1.3% 101878815 / 104724145 / -2.7% 0.81 / 0.78 / +4.1%
tpch_q04/datafusion:parquet 39703463 / 39712008 / -0.0% 58435261 / 57335547 / +1.9% 0.68 / 0.69 / -1.9%
tpch_q05/datafusion:parquet 110130775 / 110696353 / -0.5% 135017102 / 136051287 / -0.8% 0.82 / 0.81 / +0.3%
tpch_q06/datafusion:parquet 31463544 / 31656344 / -0.6% 48557390 / 47545401 / +2.1% 0.65 / 0.67 / -2.7%
tpch_q07/datafusion:parquet 113600575 / 112914935 / +0.6% 139119501 / 138871059 / +0.2% 0.82 / 0.81 / +0.4%
tpch_q08/datafusion:parquet 117053522 / 117675832 / -0.5% 144108135 / 143226916 / +0.6% 0.81 / 0.82 / -1.1%
tpch_q09/datafusion:parquet 138765268 / 136765911 / +1.5% 164765286 / 167591581 / -1.7% 0.84 / 0.82 / +3.2%
tpch_q10/datafusion:parquet 103446593 / 103431301 / +0.0% 126825251 / 127681884 / -0.7% 0.82 / 0.81 / +0.7%
tpch_q11/datafusion:parquet 61398466 / 61624863 / -0.4% 82986805 / 81111830 / +2.3% 0.74 / 0.76 / -2.6%
tpch_q12/datafusion:parquet 64413813 / 64237360 / +0.3% 83670613 / 85280892 / -1.9% 0.77 / 0.75 / +2.2%
tpch_q13/datafusion:parquet 143365221 / 143435465 / -0.0% 161082227 / 164817007 / -2.3% 0.89 / 0.87 / +2.3%
tpch_q14/datafusion:parquet 47633069 / 47741697 / -0.2% 70688094 / 70085205 / +0.9% 0.67 / 0.68 / -1.1%
tpch_q15/datafusion:parquet 74431424 / 74312815 / +0.2% 94287737 / 93204490 / +1.2% 0.79 / 0.80 / -1.0%
tpch_q16/datafusion:parquet 43725424 / 43916764 / -0.4% 61324884 / 59010361 / +3.9% 0.71 / 0.74 / -4.2%
tpch_q17/datafusion:parquet 123713971 / 123985812 / -0.2% 145864080 / 147601828 / -1.2% 0.85 / 0.84 / +1.0%
tpch_q18/datafusion:parquet 121150264 / 120609718 / +0.4% 143214015 / 139016633 / +3.0% 0.85 / 0.87 / -2.5%
tpch_q19/datafusion:parquet 56775272 / 56555687 / +0.4% 80568445 / 81286571 / -0.9% 0.70 / 0.70 / +1.3%
tpch_q20/datafusion:parquet 78209683 / 78222203 / -0.0% 100395476 / 98558583 / +1.9% 0.78 / 0.79 / -1.8%
tpch_q21/datafusion:parquet 113485521 / 113368192 / +0.1% 139686685 / 136961895 / +2.0% 0.81 / 0.83 / -1.8%
tpch_q22/datafusion:parquet 50490126 / 51778458 / -2.5% 68850215 / 67616590 / +1.8% 0.73 / 0.77 / -4.2%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9579992 / 8840609 / +8.4% 21406193 / 20713381 / +3.3% 0.45 / 0.43 / +4.9%
tpch_q02/duckdb:vortex-file-compressed 15409547 / 15202128 / +1.4% 25468252 / 25575450 / -0.4% 0.61 / 0.59 / +1.8%
tpch_q03/duckdb:vortex-file-compressed 18449469 / 18861812 / -2.2% 35755301 / 35737343 / +0.1% 0.52 / 0.53 / -2.2%
tpch_q04/duckdb:vortex-file-compressed 12280726 / 12246302 / +0.3% 24774518 / 24905847 / -0.5% 0.50 / 0.49 / +0.8%
tpch_q05/duckdb:vortex-file-compressed 20385054 / 20063090 / +1.6% 37277953 / 39028412 / -4.5% 0.55 / 0.51 / +6.4%
tpch_q06/duckdb:vortex-file-compressed 4694016 / 4621607 / +1.6% 14136295 / 14507062 / -2.6% 0.33 / 0.32 / +4.2%
tpch_q07/duckdb:vortex-file-compressed 23759632 / 24025522 / -1.1% 40590828 / 41805287 / -2.9% 0.59 / 0.57 / +1.9%
tpch_q08/duckdb:vortex-file-compressed 21214486 / 21248795 / -0.2% 38677638 / 37771443 / +2.4% 0.55 / 0.56 / -2.5%
tpch_q09/duckdb:vortex-file-compressed 22153751 / 22328530 / -0.8% 38787181 / 38929829 / -0.4% 0.57 / 0.57 / -0.4%
tpch_q10/duckdb:vortex-file-compressed 27215821 / 27963961 / -2.7% 44384893 / 45609567 / -2.7% 0.61 / 0.61 / +0.0%
tpch_q11/duckdb:vortex-file-compressed 8129495 / 7945147 / +2.3% 16693603 / 17587933 / -5.1% 0.49 / 0.45 / +7.8%
tpch_q12/duckdb:vortex-file-compressed 14451095 / 14585168 / -0.9% 25756777 / 26492274 / -2.8% 0.56 / 0.55 / +1.9%
tpch_q13/duckdb:vortex-file-compressed 19671379 / 19072304 / +3.1% 32726224 / 32555680 / +0.5% 0.60 / 0.59 / +2.6%
tpch_q14/duckdb:vortex-file-compressed 11220775 / 11175500 / +0.4% 25004654 / 25586242 / -2.3% 0.45 / 0.44 / +2.7%
tpch_q15/duckdb:vortex-file-compressed 8345126 / 8368701 / -0.3% 20250949 / 21474233 / -5.7% 0.41 / 0.39 / +5.7%
tpch_q16/duckdb:vortex-file-compressed 16593514 / 16587601 / +0.0% 23766686 / 24075134 / -1.3% 0.70 / 0.69 / +1.3%
tpch_q17/duckdb:vortex-file-compressed 13051925 / 12909718 / +1.1% 27965879 / 27950583 / +0.1% 0.47 / 0.46 / +1.0%
tpch_q18/duckdb:vortex-file-compressed 24419644 / 24410941 / +0.0% 34330579 / 35321738 / -2.8% 0.71 / 0.69 / +2.9%
tpch_q19/duckdb:vortex-file-compressed 11301213 / 11708596 / -3.5% 28774413 / 27430885 / +4.9% 0.39 / 0.43 / -8.0%
tpch_q20/duckdb:vortex-file-compressed 14479445 / 14677797 / -1.4% 29075681 / 30239594 / -3.8% 0.50 / 0.49 / +2.6%
tpch_q21/duckdb:vortex-file-compressed 47894673 / 48052957 / -0.3% 63410882 / 63632599 / -0.3% 0.76 / 0.76 / +0.0%
tpch_q22/duckdb:vortex-file-compressed 16765467 / 16867263 / -0.6% 27386272 / 26756779 / +2.4% 0.61 / 0.63 / -2.9%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47400555 / 47453094 / -0.1% 53770647 / 53979925 / -0.4% 0.88 / 0.88 / +0.3%
tpch_q02/duckdb:parquet 48468702 / 48287343 / +0.4% 54906060 / 55797700 / -1.6% 0.88 / 0.87 / +2.0%
tpch_q03/duckdb:parquet 60222583 / 60257002 / -0.1% 67652624 / 68876443 / -1.8% 0.89 / 0.87 / +1.8%
tpch_q04/duckdb:parquet 34663311 / 34636740 / +0.1% 42541599 / 43820310 / -2.9% 0.81 / 0.79 / +3.1%
tpch_q05/duckdb:parquet 67202377 / 67153308 / +0.1% 76379201 / 78121188 / -2.2% 0.88 / 0.86 / +2.4%
tpch_q06/duckdb:parquet 21651121 / 21801872 / -0.7% 26840041 / 27227481 / -1.4% 0.81 / 0.80 / +0.7%
tpch_q07/duckdb:parquet 64133710 / 63851892 / +0.4% 72967606 / 74134773 / -1.6% 0.88 / 0.86 / +2.0%
tpch_q08/duckdb:parquet 75750730 / 75696357 / +0.1% 85941464 / 87136135 / -1.4% 0.88 / 0.87 / +1.5%
tpch_q09/duckdb:parquet 107778394 / 107704781 / +0.1% 118873387 / 119571464 / -0.6% 0.91 / 0.90 / +0.7%
tpch_q10/duckdb:parquet 105898220 / 105374207 / +0.5% 116112366 / 116909323 / -0.7% 0.91 / 0.90 / +1.2%
tpch_q11/duckdb:parquet 29437033 / 29413604 / +0.1% 34465315 / 35003983 / -1.5% 0.85 / 0.84 / +1.6%
tpch_q12/duckdb:parquet 37195470 / 37119571 / +0.2% 43409978 / 44704318 / -2.9% 0.86 / 0.83 / +3.2%
tpch_q13/duckdb:parquet 174057526 / 175168600 / -0.6% 180372445 / 181214693 / -0.5% 0.96 / 0.97 / -0.2%
tpch_q14/duckdb:parquet 42318656 / 42288104 / +0.1% 50521582 / 50659686 / -0.3% 0.84 / 0.83 / +0.3%
tpch_q15/duckdb:parquet 32690630 / 32753134 / -0.2% 40999143 / 41599543 / -1.4% 0.80 / 0.79 / +1.3%
tpch_q16/duckdb:parquet 47092722 / 47099828 / -0.0% 52519516 / 52514372 / +0.0% 0.90 / 0.90 / -0.0%
tpch_q17/duckdb:parquet 47963150 / 48072044 / -0.2% 57046721 / 57523837 / -0.8% 0.84 / 0.84 / +0.6%
tpch_q18/duckdb:parquet 74381739 / 74354543 / +0.0% 80105136 / 81385806 / -1.6% 0.93 / 0.91 / +1.6%
tpch_q19/duckdb:parquet 49521816 / 48882092 / +1.3% 57234964 / 62508160 / -8.4% 0.87 / 0.78 / +10.6%
tpch_q20/duckdb:parquet 63569224 / 63487788 / +0.1% 73002937 / 74097096 / -1.5% 0.87 / 0.86 / +1.6%
tpch_q21/duckdb:parquet 106354494 / 106495564 / -0.1% 115909262 / 115270394 / +0.6% 0.92 / 0.92 / -0.7%
tpch_q22/duckdb:parquet 50487095 / 50378790 / +0.2% 58425469 / 58782141 / -0.6% 0.86 / 0.86 / +0.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 1.008x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.009x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93713959 / 92706700 / +1.1% 156509411 / 149540829 / +4.7% 0.60 / 0.62 / -3.4%
tpch_q02/datafusion:vortex-file-compressed 64918999 / 64802212 / +0.2% 99626629 / 96290347 / +3.5% 0.65 / 0.67 / -3.2%
tpch_q03/datafusion:vortex-file-compressed 62380341 / 62401421 / -0.0% 106878508 / 116007672 / -7.9% 0.58 / 0.54 / +8.5%
tpch_q04/datafusion:vortex-file-compressed 33964199 / 34560403 / -1.7% 65307844 / 62536686 / +4.4% 0.52 / 0.55 / -5.9%
tpch_q05/datafusion:vortex-file-compressed 117192251 / 119195872 / -1.7% 173562706 / 175253344 / -1.0% 0.68 / 0.68 / -0.7%
tpch_q06/datafusion:vortex-file-compressed 9698040 / 10196711 / -4.9% 54962610 / 55716212 / -1.4% 0.18 / 0.18 / -3.6%
tpch_q07/datafusion:vortex-file-compressed 95182431 / 97116982 / -2.0% 165425985 / 149830619 / +10.4% 🔴 0.58 / 0.65 / -11.2%
tpch_q08/datafusion:vortex-file-compressed 143088292 / 142177221 / +0.6% 202468702 / 207342179 / -2.4% 0.71 / 0.69 / +3.1%
tpch_q09/datafusion:vortex-file-compressed 185757731 / 185056584 / +0.4% 260606484 / 259925336 / +0.3% 0.71 / 0.71 / +0.1%
tpch_q10/datafusion:vortex-file-compressed 69539721 / 70746529 / -1.7% 125020286 / 126005122 / -0.8% 0.56 / 0.56 / -0.9%
tpch_q11/datafusion:vortex-file-compressed 45352550 / 46492744 / -2.5% 70658846 / 72591583 / -2.7% 0.64 / 0.64 / +0.2%
tpch_q12/datafusion:vortex-file-compressed 34600879 / 36129343 / -4.2% 73788928 / 70608812 / +4.5% 0.47 / 0.51 / -8.4%
tpch_q13/datafusion:vortex-file-compressed 48520524 / 49118778 / -1.2% 84003831 / 77106381 / +8.9% 0.58 / 0.64 / -9.3%
tpch_q14/datafusion:vortex-file-compressed 20478589 / 20252907 / +1.1% 83753404 / 86575118 / -3.3% 0.24 / 0.23 / +4.5%
tpch_q15/datafusion:vortex-file-compressed 32189791 / 33280481 / -3.3% 91701580 / 89397742 / +2.6% 0.35 / 0.37 / -5.7%
tpch_q16/datafusion:vortex-file-compressed 36864471 / 36884935 / -0.1% 66225129 / 67529156 / -1.9% 0.56 / 0.55 / +1.9%
tpch_q17/datafusion:vortex-file-compressed 178316826 / 181353369 / -1.7% 229760949 / 225731501 / +1.8% 0.78 / 0.80 / -3.4%
tpch_q18/datafusion:vortex-file-compressed 205948514 / 206131621 / -0.1% 261122612 / 269436842 / -3.1% 0.79 / 0.77 / +3.1%
tpch_q19/datafusion:vortex-file-compressed 29506784 / 27988515 / +5.4% 80831623 / 82265691 / -1.7% 0.37 / 0.34 / +7.3%
tpch_q20/datafusion:vortex-file-compressed 60132348 / 61444253 / -2.1% 112745638 / 119428872 / -5.6% 0.53 / 0.51 / +3.7%
tpch_q21/datafusion:vortex-file-compressed 179078995 / 178134968 / +0.5% 224904952 / 226845257 / -0.9% 0.80 / 0.79 / +1.4%
tpch_q22/datafusion:vortex-file-compressed 26563610 / 25619947 / +3.7% 54146231 / 54825694 / -1.2% 0.49 / 0.47 / +5.0%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87083353 / 87286291 / -0.2% 128613605 / 126242563 / +1.9% 0.68 / 0.69 / -2.1%
tpch_q02/datafusion:parquet 174639185 / 173611677 / +0.6% 204626490 / 203492440 / +0.6% 0.85 / 0.85 / +0.0%
tpch_q03/datafusion:parquet 134439672 / 136096582 / -1.2% 182830864 / 183581650 / -0.4% 0.74 / 0.74 / -0.8%
tpch_q04/datafusion:parquet 56972737 / 57399641 / -0.7% 91865888 / 88377141 / +3.9% 0.62 / 0.65 / -4.5%
tpch_q05/datafusion:parquet 168121925 / 168690615 / -0.3% 221844340 / 220751921 / +0.5% 0.76 / 0.76 / -0.8%
tpch_q06/datafusion:parquet 36637353 / 36645027 / -0.0% 77022439 / 73373517 / +5.0% 0.48 / 0.50 / -4.8%
tpch_q07/datafusion:parquet 216495644 / 214016265 / +1.2% 266183337 / 264623175 / +0.6% 0.81 / 0.81 / +0.6%
tpch_q08/datafusion:parquet 217365674 / 218163189 / -0.4% 280427597 / 286518815 / -2.1% 0.78 / 0.76 / +1.8%
tpch_q09/datafusion:parquet 307931109 / 309852176 / -0.6% 381349950 / 371877830 / +2.5% 0.81 / 0.83 / -3.1%
tpch_q10/datafusion:parquet 310816938 / 311852571 / -0.3% 371136390 / 369356014 / +0.5% 0.84 / 0.84 / -0.8%
tpch_q11/datafusion:parquet 127647617 / 128293317 / -0.5% 151385639 / 150514082 / +0.6% 0.84 / 0.85 / -1.1%
tpch_q12/datafusion:parquet 82757403 / 82599131 / +0.2% 118714298 / 116757410 / +1.7% 0.70 / 0.71 / -1.5%
tpch_q13/datafusion:parquet 210424849 / 210786898 / -0.2% 241985810 / 239725596 / +0.9% 0.87 / 0.88 / -1.1%
tpch_q14/datafusion:parquet 87322850 / 88239915 / -1.0% 192512507 / 188275933 / +2.3% 0.45 / 0.47 / -3.2%
tpch_q15/datafusion:parquet 106455567 / 106561658 / -0.1% 155671692 / 151442282 / +2.8% 0.68 / 0.70 / -2.8%
tpch_q16/datafusion:parquet 95665132 / 97241953 / -1.6% 120677608 / 121045018 / -0.3% 0.79 / 0.80 / -1.3%
tpch_q17/datafusion:parquet 212631610 / 216243106 / -1.7% 263437347 / 262686085 / +0.3% 0.81 / 0.82 / -2.0%
tpch_q18/datafusion:parquet 268894099 / 268699122 / +0.1% 311221267 / 317519737 / -2.0% 0.86 / 0.85 / +2.1%
tpch_q19/datafusion:parquet 108643047 / 108940968 / -0.3% 165385599 / 164811331 / +0.3% 0.66 / 0.66 / -0.6%
tpch_q20/datafusion:parquet 185162267 / 186121494 / -0.5% 240071341 / 243860778 / -1.6% 0.77 / 0.76 / +1.1%
tpch_q21/datafusion:parquet 242293731 / 245630597 / -1.4% 313601026 / 311414845 / +0.7% 0.77 / 0.79 / -2.0%
tpch_q22/datafusion:parquet 149904132 / 149541220 / +0.2% 172822394 / 169398997 / +2.0% 0.87 / 0.88 / -1.7%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 36129113 / 35972532 / +0.4% 79257014 / 77392172 / +2.4% 0.46 / 0.46 / -1.9%
tpch_q02/duckdb:vortex-file-compressed 28697870 / 28737270 / -0.1% 44587910 / 43941714 / +1.5% 0.64 / 0.65 / -1.6%
tpch_q03/duckdb:vortex-file-compressed 52445349 / 52806004 / -0.7% 96594211 / 95500903 / +1.1% 0.54 / 0.55 / -1.8%
tpch_q04/duckdb:vortex-file-compressed 49521081 / 49440353 / +0.2% 80461985 / 81364540 / -1.1% 0.62 / 0.61 / +1.3%
tpch_q05/duckdb:vortex-file-compressed 69783173 / 71663589 / -2.6% 105077323 / 105950650 / -0.8% 0.66 / 0.68 / -1.8%
tpch_q06/duckdb:vortex-file-compressed 15157687 / 15070255 / +0.6% 48814955 / 49750325 / -1.9% 0.31 / 0.30 / +2.5%
tpch_q07/duckdb:vortex-file-compressed 53585170 / 55260199 / -3.0% 103112027 / 101640057 / +1.4% 0.52 / 0.54 / -4.4%
tpch_q08/duckdb:vortex-file-compressed 87227676 / 87277416 / -0.1% 127723971 / 122333401 / +4.4% 0.68 / 0.71 / -4.3%
tpch_q09/duckdb:vortex-file-compressed 106425552 / 106984022 / -0.5% 156239507 / 148512158 / +5.2% 0.68 / 0.72 / -5.4%
tpch_q10/duckdb:vortex-file-compressed 96286136 / 95865824 / +0.4% 142294922 / 141962575 / +0.2% 0.68 / 0.68 / +0.2%
tpch_q11/duckdb:vortex-file-compressed 13356689 / 13663835 / -2.2% 29995857 / 28024616 / +7.0% 0.45 / 0.49 / -8.7%
tpch_q12/duckdb:vortex-file-compressed 45327088 / 46583708 / -2.7% 86535475 / 85481618 / +1.2% 0.52 / 0.54 / -3.9%
tpch_q13/duckdb:vortex-file-compressed 70664105 / 70204383 / +0.7% 97274728 / 96581290 / +0.7% 0.73 / 0.73 / -0.1%
tpch_q14/duckdb:vortex-file-compressed 27893980 / 27353202 / +2.0% 74788459 / 72332233 / +3.4% 0.37 / 0.38 / -1.4%
tpch_q15/duckdb:vortex-file-compressed 24067768 / 23759565 / +1.3% 64503096 / 62478295 / +3.2% 0.37 / 0.38 / -1.9%
tpch_q16/duckdb:vortex-file-compressed 47974361 / 48692958 / -1.5% 59270194 / 58381192 / +1.5% 0.81 / 0.83 / -3.0%
tpch_q17/duckdb:vortex-file-compressed 38165144 / 38936321 / -2.0% 68136220 / 66711882 / +2.1% 0.56 / 0.58 / -4.0%
tpch_q18/duckdb:vortex-file-compressed 103084103 / 104412553 / -1.3% 117980028 / 118493579 / -0.4% 0.87 / 0.88 / -0.8%
tpch_q19/duckdb:vortex-file-compressed 27152127 / 26729525 / +1.6% 75617382 / 76621235 / -1.3% 0.36 / 0.35 / +2.9%
tpch_q20/duckdb:vortex-file-compressed 41493128 / 41019547 / +1.2% 91812151 / 89997465 / +2.0% 0.45 / 0.46 / -0.8%
tpch_q21/duckdb:vortex-file-compressed 92555088 / 94245653 / -1.8% 140298701 / 138668293 / +1.2% 0.66 / 0.68 / -2.9%
tpch_q22/duckdb:vortex-file-compressed 33121244 / 33214024 / -0.3% 49124308 / 49485467 / -0.7% 0.67 / 0.67 / +0.5%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67701683 / 68320233 / -0.9% 88301701 / 86381136 / +2.2% 0.77 / 0.79 / -3.1%
tpch_q02/duckdb:parquet 86755328 / 87325960 / -0.7% 97471859 / 98456354 / -1.0% 0.89 / 0.89 / +0.3%
tpch_q03/duckdb:parquet 110043503 / 110315762 / -0.2% 142670366 / 141728671 / +0.7% 0.77 / 0.78 / -0.9%
tpch_q04/duckdb:parquet 76341214 / 76485802 / -0.2% 99567212 / 96120302 / +3.6% 0.77 / 0.80 / -3.6%
tpch_q05/duckdb:parquet 122067164 / 122811513 / -0.6% 156735328 / 158598746 / -1.2% 0.78 / 0.77 / +0.6%
tpch_q06/duckdb:parquet 35363128 / 35453737 / -0.3% 59144745 / 57513243 / +2.8% 0.60 / 0.62 / -3.0%
tpch_q07/duckdb:parquet 116139014 / 116904984 / -0.7% 153620978 / 156079987 / -1.6% 0.76 / 0.75 / +0.9%
tpch_q08/duckdb:parquet 148160162 / 148215769 / -0.0% 190339950 / 191252134 / -0.5% 0.78 / 0.77 / +0.4%
tpch_q09/duckdb:parquet 236392303 / 236613331 / -0.1% 279022361 / 279081351 / -0.0% 0.85 / 0.85 / -0.1%
tpch_q10/duckdb:parquet 311588134 / 312351995 / -0.2% 338348404 / 341195332 / -0.8% 0.92 / 0.92 / +0.6%
tpch_q11/duckdb:parquet 43382854 / 43602127 / -0.5% 51108139 / 51254655 / -0.3% 0.85 / 0.85 / -0.2%
tpch_q12/duckdb:parquet 71066364 / 70040593 / +1.5% 91161267 / 88990927 / +2.4% 0.78 / 0.79 / -1.0%
tpch_q13/duckdb:parquet 290315339 / 292469858 / -0.7% 304646723 / 307598393 / -1.0% 0.95 / 0.95 / +0.2%
tpch_q14/duckdb:parquet 99980766 / 101475650 / -1.5% 137932250 / 133769018 / +3.1% 0.72 / 0.76 / -4.4%
tpch_q15/duckdb:parquet 58049832 / 58336292 / -0.5% 84448680 / 84715216 / -0.3% 0.69 / 0.69 / -0.2%
tpch_q16/duckdb:parquet 99587021 / 100269733 / -0.7% 106587194 / 107184809 / -0.6% 0.93 / 0.94 / -0.1%
tpch_q17/duckdb:parquet 82528158 / 81858584 / +0.8% 117046024 / 110763150 / +5.7% 0.71 / 0.74 / -4.6%
tpch_q18/duckdb:parquet 157175103 / 158661641 / -0.9% 173798370 / 171984119 / +1.1% 0.90 / 0.92 / -2.0%
tpch_q19/duckdb:parquet 98051073 / 98698945 / -0.7% 131003894 / 125888154 / +4.1% 0.75 / 0.78 / -4.5%
tpch_q20/duckdb:parquet 146726628 / 146973464 / -0.2% 185820945 / 182567909 / +1.8% 0.79 / 0.81 / -1.9%
tpch_q21/duckdb:parquet 252086101 / 252830188 / -0.3% 276139890 / 278956906 / -1.0% 0.91 / 0.91 / +0.7%
tpch_q22/duckdb:parquet 168249916 / 168547555 / -0.2% 180085395 / 180157195 / -0.0% 0.93 / 0.94 / -0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.9%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, environment too noisy confidence)
Vortex (geomean): hot 0.928x ➖ · cold 0.909x ➖
Parquet (geomean): hot 0.927x ➖ · cold 0.743x ➖
Shifts: Parquet (control) -7.3% · Median polish -3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.868x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 38939731 / 42507230 / -8.4% 131220875 / 158921479 / -17.4% 0.30 / 0.27 / +10.9%
fineweb_q01/datafusion:vortex-compact 479487006 / 373901201 / +28.2% 500538579 / 669618224 / -25.3% 0.96 / 0.56 / +71.6%
fineweb_q02/datafusion:vortex-compact 349853816 / 427399767 / -18.1% 687690207 / 496685954 / +38.5% 🔴 0.51 / 0.86 / -40.9%
fineweb_q03/datafusion:vortex-compact 487252248 / 1139737016 / -57.2% 🟢 564512636 / 1731218235 / -67.4% 🟢 0.86 / 0.66 / +31.1%
fineweb_q04/datafusion:vortex-compact 487623304 / 502746550 / -3.0% 529161934 / 529389702 / -0.0% 0.92 / 0.95 / -3.0%
fineweb_q05/datafusion:vortex-compact 493381144 / 527626558 / -6.5% 585284113 / 547916705 / +6.8% 0.84 / 0.96 / -12.5%
fineweb_q06/datafusion:vortex-compact 513169206 / 551362738 / -6.9% 502069191 / 637402338 / -21.2% 1.02 / 0.87 / +18.2%
fineweb_q07/datafusion:vortex-compact 526114738 / 516987462 / +1.8% 498875085 / 502972593 / -0.8% 1.05 / 1.03 / +2.6%
fineweb_q08/datafusion:vortex-compact 151240065 / 190924406 / -20.8% 155483490 / 226147170 / -31.2% 🟢 0.97 / 0.84 / +15.2%
datafusion / parquet / ns (0.860x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 348376594 / 2499728434 / -86.1% 🟢 763580794 / 3046378207 / -74.9% 🟢 0.46 / 0.82 / -44.4%
fineweb_q01/datafusion:parquet 720845705 / 846183702 / -14.8% 653801742 / 1072770761 / -39.1% 🟢 1.10 / 0.79 / +39.8%
fineweb_q02/datafusion:parquet 742571017 / 743107484 / -0.1% 648954964 / 723240385 / -10.3% 1.14 / 1.03 / +11.4%
fineweb_q03/datafusion:parquet 1216633324 / 943309808 / +29.0% 1289671583 / 1154137141 / +11.7% 0.94 / 0.82 / +15.4%
fineweb_q04/datafusion:parquet 731210499 / 765320805 / -4.5% 626847354 / 796550916 / -21.3% 1.17 / 0.96 / +21.4%
fineweb_q05/datafusion:parquet 1048246974 / 799461810 / +31.1% 🔴 836370160 / 792244016 / +5.6% 1.25 / 1.01 / +24.2%
fineweb_q06/datafusion:parquet 1039186996 / 719398760 / +44.5% 🔴 979868005 / 758689765 / +29.2% 1.06 / 0.95 / +11.8%
fineweb_q07/datafusion:parquet 862579089 / 972214794 / -11.3% 770347654 / 59660339665 / -98.7% 🟢 1.12 / 0.02 / +6771.2%
fineweb_q08/datafusion:parquet 763042396 / 727808338 / +4.8% 767762100 / 732449570 / +4.8% 0.99 / 0.99 / +0.0%
duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 73058601 / 73846965 / -1.1% 97382760 / 72410152 / +34.5% 🔴 0.75 / 1.02 / -26.4%
fineweb_q01/duckdb:vortex-compact 405489227 / 378684717 / +7.1% 398810665 / 366032355 / +9.0% 1.02 / 1.03 / -1.7%
fineweb_q02/duckdb:vortex-compact 377259553 / 508775618 / -25.8% 373256602 / 398986083 / -6.4% 1.01 / 1.28 / -20.7%
fineweb_q03/duckdb:vortex-compact 888495923 / 889979563 / -0.2% 1016960921 / 1033369593 / -1.6% 0.87 / 0.86 / +1.4%
fineweb_q04/duckdb:vortex-compact 953949306 / 900973684 / +5.9% 989641749 / 1031430408 / -4.1% 0.96 / 0.87 / +10.4%
fineweb_q05/duckdb:vortex-compact 888536435 / 871596894 / +1.9% 1002177633 / 964749116 / +3.9% 0.89 / 0.90 / -1.9%
fineweb_q06/duckdb:vortex-compact 897899222 / 932024395 / -3.7% 1208806907 / 1560853495 / -22.6% 0.74 / 0.60 / +24.4%
fineweb_q07/duckdb:vortex-compact 976868046 / 786035402 / +24.3% 989205590 / 895158424 / +10.5% 0.99 / 0.88 / +12.5%
fineweb_q08/duckdb:vortex-compact 205831262 / 224260485 / -8.2% 221888258 / 229181588 / -3.2% 0.93 / 0.98 / -5.2%
duckdb / parquet / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 392921444 / 345225361 / +13.8% 494409799 / 388292509 / +27.3% 0.79 / 0.89 / -10.6%
fineweb_q01/duckdb:parquet 500439675 / 538642382 / -7.1% 558007257 / 604328748 / -7.7% 0.90 / 0.89 / +0.6%
fineweb_q02/duckdb:parquet 517323252 / 568953274 / -9.1% 649534150 / 595419474 / +9.1% 0.80 / 0.96 / -16.6%
fineweb_q03/duckdb:parquet 664982334 / 743332366 / -10.5% 755423347 / 806029980 / -6.3% 0.88 / 0.92 / -4.5%
fineweb_q04/duckdb:parquet 733877536 / 738749894 / -0.7% 766210311 / 787858189 / -2.7% 0.96 / 0.94 / +2.1%
fineweb_q05/duckdb:parquet 804845874 / 869448152 / -7.4% 942033675 / 945108202 / -0.3% 0.85 / 0.92 / -7.1%
fineweb_q06/duckdb:parquet 729584028 / 935478342 / -22.0% 775425489 / 948467615 / -18.2% 0.94 / 0.99 / -4.6%
fineweb_q07/duckdb:parquet 915350459 / 808936778 / +13.2% 1294993332 / 737989150 / +75.5% 🔴 0.71 / 1.10 / -35.5%
fineweb_q08/duckdb:parquet 433384278 / 303144111 / +43.0% 🔴 500692657 / 386519379 / +29.5% 0.87 / 0.78 / +10.4%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6122094 / 6274916 / -2.4% 18995301 / 20307697 / -6.5% 0.32 / 0.31 / +4.3%
fineweb_q01/datafusion:vortex-compact 102103524 / 101485054 / +0.6% 129527234 / 127185677 / +1.8% 0.79 / 0.80 / -1.2%
fineweb_q02/datafusion:vortex-compact 102631274 / 103174529 / -0.5% 131525963 / 129290539 / +1.7% 0.78 / 0.80 / -2.2%
fineweb_q03/datafusion:vortex-compact 179115598 / 188994254 / -5.2% 261690339 / 251846242 / +3.9% 0.68 / 0.75 / -8.8%
fineweb_q04/datafusion:vortex-compact 209034584 / 194180053 / +7.6% 261690986 / 258284553 / +1.3% 0.80 / 0.75 / +6.2%
fineweb_q05/datafusion:vortex-compact 180562803 / 180503855 / +0.0% 255182627 / 255173029 / +0.0% 0.71 / 0.71 / +0.0%
fineweb_q06/datafusion:vortex-compact 122620926 / 117789242 / +4.1% 191800883 / 191120905 / +0.4% 0.64 / 0.62 / +3.7%
fineweb_q07/datafusion:vortex-compact 136787760 / 126712063 / +8.0% 187681494 / 187553815 / +0.1% 0.73 / 0.68 / +7.9%
fineweb_q08/datafusion:vortex-compact 9171434 / 9967320 / -8.0% 26378654 / 23698931 / +11.3% 🔴 0.35 / 0.42 / -17.3%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9584216 / 9514346 / +0.7% 34242865 / 33871288 / +1.1% 0.28 / 0.28 / -0.4%
fineweb_q01/datafusion:parquet 74514832 / 74867081 / -0.5% 146079939 / 141580032 / +3.2% 0.51 / 0.53 / -3.5%
fineweb_q02/datafusion:parquet 74217565 / 75005212 / -1.1% 139958218 / 150282733 / -6.9% 0.53 / 0.50 / +6.2%
fineweb_q03/datafusion:parquet 73524000 / 73243494 / +0.4% 149566157 / 148015722 / +1.0% 0.49 / 0.49 / -0.7%
fineweb_q04/datafusion:parquet 81872406 / 81989372 / -0.1% 137889891 / 146437338 / -5.8% 0.59 / 0.56 / +6.0%
fineweb_q05/datafusion:parquet 80030940 / 81243009 / -1.5% 148072799 / 146126206 / +1.3% 0.54 / 0.56 / -2.8%
fineweb_q06/datafusion:parquet 76545282 / 74783707 / +2.4% 142799559 / 151861835 / -6.0% 0.54 / 0.49 / +8.9%
fineweb_q07/datafusion:parquet 74655444 / 73068760 / +2.2% 143633816 / 141230352 / +1.7% 0.52 / 0.52 / +0.5%
fineweb_q08/datafusion:parquet 72378247 / 74621766 / -3.0% 148161267 / 144194909 / +2.8% 0.49 / 0.52 / -5.6%
duckdb / vortex-compact / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2416129 / 2267041 / +6.6% 7201286 / 8399166 / -14.3% 🟢 0.34 / 0.27 / +24.3%
fineweb_q01/duckdb:vortex-compact 70592022 / 70428204 / +0.2% 90187345 / 89726713 / +0.5% 0.78 / 0.78 / -0.3%
fineweb_q02/duckdb:vortex-compact 72142880 / 73144890 / -1.4% 88213886 / 92191520 / -4.3% 0.82 / 0.79 / +3.1%
fineweb_q03/duckdb:vortex-compact 186211788 / 185002945 / +0.7% 222659504 / 221889455 / +0.3% 0.84 / 0.83 / +0.3%
fineweb_q04/duckdb:vortex-compact 195911927 / 194888614 / +0.5% 231925210 / 233631821 / -0.7% 0.84 / 0.83 / +1.3%
fineweb_q05/duckdb:vortex-compact 189840095 / 187900312 / +1.0% 224134126 / 224211511 / -0.0% 0.85 / 0.84 / +1.1%
fineweb_q06/duckdb:vortex-compact 113518270 / 113271592 / +0.2% 150549540 / 149648767 / +0.6% 0.75 / 0.76 / -0.4%
fineweb_q07/duckdb:vortex-compact 115270858 / 115350908 / -0.1% 153346004 / 154587033 / -0.8% 0.75 / 0.75 / +0.7%
fineweb_q08/duckdb:vortex-compact 4578048 / 4477070 / +2.3% 11063024 / 11390812 / -2.9% 0.41 / 0.39 / +5.3%
duckdb / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24920784 / 23439010 / +6.3% 28808880 / 27927516 / +3.2% 0.87 / 0.84 / +3.1%
fineweb_q01/duckdb:parquet 54799566 / 54742006 / +0.1% 74136581 / 72968834 / +1.6% 0.74 / 0.75 / -1.5%
fineweb_q02/duckdb:parquet 58495700 / 58220480 / +0.5% 77748820 / 79260651 / -1.9% 0.75 / 0.73 / +2.4%
fineweb_q03/duckdb:parquet 119316212 / 119453929 / -0.1% 179726732 / 170939331 / +5.1% 0.66 / 0.70 / -5.0%
fineweb_q04/duckdb:parquet 163184282 / 160738288 / +1.5% 202732095 / 206864523 / -2.0% 0.80 / 0.78 / +3.6%
fineweb_q05/duckdb:parquet 155957614 / 157412190 / -0.9% 194613418 / 200457495 / -2.9% 0.80 / 0.79 / +2.1%
fineweb_q06/duckdb:parquet 88572490 / 89917390 / -1.5% 143432443 / 143491245 / -0.0% 0.62 / 0.63 / -1.5%
fineweb_q07/duckdb:parquet 90779572 / 90684114 / +0.1% 145544482 / 139207627 / +4.6% 0.62 / 0.65 / -4.3%
fineweb_q08/duckdb:parquet 28868939 / 28811704 / +0.2% 30790072 / 30292794 / +1.6% 0.94 / 0.95 / -1.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+2.5%, low confidence) · DuckDB No clear signal (-1.9%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 1.007x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.017x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 283314072 / 274959210 / +3.0% 503787775 / 537863771 / -6.3% 0.56 / 0.51 / +10.0%
clickbench-sorted_q24/datafusion:vortex-compact 14441334 / 13492532 / +7.0% 53487950 / 50968211 / +4.9% 0.27 / 0.26 / +2.0%
clickbench-sorted_q26/datafusion:vortex-compact 17536828 / 17098586 / +2.6% 57959832 / 59466355 / -2.5% 0.30 / 0.29 / +5.2%
clickbench-sorted_q36/datafusion:vortex-compact 34219474 / 32628800 / +4.9% 76810803 / 77206087 / -0.5% 0.45 / 0.42 / +5.4%
clickbench-sorted_q37/datafusion:vortex-compact 29821997 / 30414100 / -1.9% 74541346 / 74110477 / +0.6% 0.40 / 0.41 / -2.5%
clickbench-sorted_q38/datafusion:vortex-compact 22634565 / 24352050 / -7.1% 68969561 / 64358786 / +7.2% 0.33 / 0.38 / -13.3%
clickbench-sorted_q39/datafusion:vortex-compact 44073902 / 45345706 / -2.8% 99791178 / 103740615 / -3.8% 0.44 / 0.44 / +1.0%
clickbench-sorted_q40/datafusion:vortex-compact 13487734 / 12628530 / +6.8% 42225810 / 42757169 / -1.2% 0.32 / 0.30 / +8.1%
clickbench-sorted_q41/datafusion:vortex-compact 13353446 / 11983929 / +11.4% 🔴 46921931 / 44050107 / +6.5% 0.28 / 0.27 / +4.6%
clickbench-sorted_q42/datafusion:vortex-compact 9786699 / 10311572 / -5.1% 36231572 / 35956977 / +0.8% 0.27 / 0.29 / -5.8%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 744562152 / 751302200 / -0.9% 947463384 / 953981888 / -0.7% 0.79 / 0.79 / -0.2%
clickbench-sorted_q24/datafusion:parquet 8809461 / 9000151 / -2.1% 72254609 / 71671387 / +0.8% 0.12 / 0.13 / -2.9%
clickbench-sorted_q26/datafusion:parquet 9173901 / 9470902 / -3.1% 71319346 / 72075276 / -1.0% 0.13 / 0.13 / -2.1%
clickbench-sorted_q36/datafusion:parquet 90256924 / 89870324 / +0.4% 162630045 / 161324062 / +0.8% 0.55 / 0.56 / -0.4%
clickbench-sorted_q37/datafusion:parquet 61355480 / 61217200 / +0.2% 127376519 / 126366271 / +0.8% 0.48 / 0.48 / -0.6%
clickbench-sorted_q38/datafusion:parquet 83370588 / 82991287 / +0.5% 154353062 / 153638822 / +0.5% 0.54 / 0.54 / -0.0%
clickbench-sorted_q39/datafusion:parquet 152663069 / 153119780 / -0.3% 225694365 / 224080055 / +0.7% 0.68 / 0.68 / -1.0%
clickbench-sorted_q40/datafusion:parquet 41803016 / 42048870 / -0.6% 109025825 / 107554893 / +1.4% 0.38 / 0.39 / -1.9%
clickbench-sorted_q41/datafusion:parquet 39350478 / 39579811 / -0.6% 107016001 / 107042337 / -0.0% 0.37 / 0.37 / -0.6%
clickbench-sorted_q42/datafusion:parquet 24818904 / 25047468 / -0.9% 87589479 / 85904036 / +2.0% 0.28 / 0.29 / -2.8%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 78364050 / 78544375 / -0.2% 286796615 / 290757489 / -1.4% 0.27 / 0.27 / +1.1%
clickbench-sorted_q24/duckdb:vortex-compact 15724320 / 15856282 / -0.8% 34654365 / 33294015 / +4.1% 0.45 / 0.48 / -4.7%
clickbench-sorted_q26/duckdb:vortex-compact 16740664 / 17375532 / -3.7% 38345386 / 38176745 / +0.4% 0.44 / 0.46 / -4.1%
clickbench-sorted_q36/duckdb:vortex-compact 31670763 / 29156764 / +8.6% 55075245 / 55072021 / +0.0% 0.58 / 0.53 / +8.6%
clickbench-sorted_q37/duckdb:vortex-compact 25046512 / 25222800 / -0.7% 47341497 / 50178659 / -5.7% 0.53 / 0.50 / +5.3%
clickbench-sorted_q38/duckdb:vortex-compact 20456181 / 20585800 / -0.6% 49375895 / 50869426 / -2.9% 0.41 / 0.40 / +2.4%
clickbench-sorted_q39/duckdb:vortex-compact 43166674 / 43306962 / -0.3% 72950704 / 72737654 / +0.3% 0.59 / 0.60 / -0.6%
clickbench-sorted_q40/duckdb:vortex-compact 11500552 / 11597022 / -0.8% 34493629 / 32714162 / +5.4% 0.33 / 0.35 / -5.9%
clickbench-sorted_q41/duckdb:vortex-compact 12829999 / 12379032 / +3.6% 36940575 / 36810148 / +0.4% 0.35 / 0.34 / +3.3%
clickbench-sorted_q42/duckdb:vortex-compact 9085781 / 9587853 / -5.2% 31337117 / 28810209 / +8.8% 0.29 / 0.33 / -12.9%
duckdb / parquet / ns (1.019x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 141857482 / 141549707 / +0.2% 173376126 / 171203657 / +1.3% 0.82 / 0.83 / -1.0%
clickbench-sorted_q24/duckdb:parquet 15496322 / 15149618 / +2.3% 18767810 / 19761645 / -5.0% 0.83 / 0.77 / +7.7%
clickbench-sorted_q26/duckdb:parquet 16066888 / 15101890 / +6.4% 20164131 / 21274282 / -5.2% 0.80 / 0.71 / +12.2%
clickbench-sorted_q36/duckdb:parquet 47480928 / 46037178 / +3.1% 63863551 / 54759018 / +16.6% 🔴 0.74 / 0.84 / -11.6%
clickbench-sorted_q37/duckdb:parquet 36364447 / 35086452 / +3.6% 48628191 / 41278756 / +17.8% 🔴 0.75 / 0.85 / -12.0%
clickbench-sorted_q38/duckdb:parquet 41833896 / 42229336 / -0.9% 53324645 / 52638265 / +1.3% 0.78 / 0.80 / -2.2%
clickbench-sorted_q39/duckdb:parquet 77519651 / 75571262 / +2.6% 82647699 / 86373219 / -4.3% 0.94 / 0.87 / +7.2%
clickbench-sorted_q40/duckdb:parquet 21367269 / 22025750 / -3.0% 27953822 / 28703868 / -2.6% 0.76 / 0.77 / -0.4%
clickbench-sorted_q41/duckdb:parquet 21797308 / 22111088 / -1.4% 28267686 / 28301722 / -0.1% 0.77 / 0.78 / -1.3%
clickbench-sorted_q42/duckdb:parquet 17441658 / 16374505 / +6.5% 23410390 / 23987454 / -2.4% 0.75 / 0.68 / +9.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21953742 / 21890296 / +0.3% 41763635 / 39832981 / +4.8% 0.53 / 0.55 / -4.3%
tpcds_q02/datafusion:vortex-file-compressed 43069592 / 43262334 / -0.4% 64676311 / 64232184 / +0.7% 0.67 / 0.67 / -1.1%
tpcds_q03/datafusion:vortex-file-compressed 11651534 / 11683484 / -0.3% 29187031 / 29223900 / -0.1% 0.40 / 0.40 / -0.1%
tpcds_q04/datafusion:vortex-file-compressed 80389578 / 80119532 / +0.3% 111379714 / 116344080 / -4.3% 0.72 / 0.69 / +4.8%
tpcds_q05/datafusion:vortex-file-compressed 56750432 / 55984378 / +1.4% 80278299 / 78852639 / +1.8% 0.71 / 0.71 / -0.4%
tpcds_q06/datafusion:vortex-file-compressed 21561712 / 21693702 / -0.6% 43872846 / 41829645 / +4.9% 0.49 / 0.52 / -5.2%
tpcds_q07/datafusion:vortex-file-compressed 26206905 / 26152688 / +0.2% 50997380 / 48379720 / +5.4% 0.51 / 0.54 / -4.9%
tpcds_q08/datafusion:vortex-file-compressed 26114655 / 25720072 / +1.5% 46154193 / 43942881 / +5.0% 0.57 / 0.59 / -3.3%
tpcds_q09/datafusion:vortex-file-compressed 20402072 / 21067456 / -3.2% 38312311 / 36152990 / +6.0% 0.53 / 0.58 / -8.6%
tpcds_q10/datafusion:vortex-file-compressed 30898452 / 31157453 / -0.8% 54373767 / 54783318 / -0.7% 0.57 / 0.57 / -0.1%
tpcds_q11/datafusion:vortex-file-compressed 48200878 / 49162578 / -2.0% 77185264 / 76379660 / +1.1% 0.62 / 0.64 / -3.0%
tpcds_q12/datafusion:vortex-file-compressed 15366884 / 15046337 / +2.1% 35134713 / 33299185 / +5.5% 0.44 / 0.45 / -3.2%
tpcds_q13/datafusion:vortex-file-compressed 31468048 / 30830178 / +2.1% 56508148 / 59626951 / -5.2% 0.56 / 0.52 / +7.7%
tpcds_q14/datafusion:vortex-file-compressed 490065421 / 489351064 / +0.1% 541807195 / 543558743 / -0.3% 0.90 / 0.90 / +0.5%
tpcds_q15/datafusion:vortex-file-compressed 12743858 / 12517718 / +1.8% 33354021 / 32067271 / +4.0% 0.38 / 0.39 / -2.1%
tpcds_q16/datafusion:vortex-file-compressed 18834180 / 19018950 / -1.0% 39837745 / 37898529 / +5.1% 0.47 / 0.50 / -5.8%
tpcds_q17/datafusion:vortex-file-compressed 53103024 / 53437402 / -0.6% 78881123 / 74228295 / +6.3% 0.67 / 0.72 / -6.5%
tpcds_q18/datafusion:vortex-file-compressed 63500272 / 54547527 / +16.4% 🔴 73490016 / 72271475 / +1.7% 0.86 / 0.75 / +14.5%
tpcds_q19/datafusion:vortex-file-compressed 17160031 / 17119682 / +0.2% 39472879 / 40280685 / -2.0% 0.43 / 0.43 / +2.3%
tpcds_q20/datafusion:vortex-file-compressed 17540128 / 16906211 / +3.7% 34825872 / 34394592 / +1.3% 0.50 / 0.49 / +2.5%
tpcds_q21/datafusion:vortex-file-compressed 15308204 / 15132910 / +1.2% 37701826 / 34321342 / +9.8% 0.41 / 0.44 / -7.9%
tpcds_q22/datafusion:vortex-file-compressed 49742076 / 49853218 / -0.2% 71898619 / 71404587 / +0.7% 0.69 / 0.70 / -0.9%
tpcds_q23/datafusion:vortex-file-compressed 70887484 / 71694276 / -1.1% 98427531 / 99882118 / -1.5% 0.72 / 0.72 / +0.3%
tpcds_q24/datafusion:vortex-file-compressed 63038386 / 63588409 / -0.9% 87413712 / 89064354 / -1.9% 0.72 / 0.71 / +1.0%
tpcds_q25/datafusion:vortex-file-compressed 45201425 / 45411116 / -0.5% 66749492 / 66597351 / +0.2% 0.68 / 0.68 / -0.7%
tpcds_q26/datafusion:vortex-file-compressed 26471523 / 26872243 / -1.5% 48023430 / 44386318 / +8.2% 0.55 / 0.61 / -9.0%
tpcds_q27/datafusion:vortex-file-compressed 55606713 / 56183700 / -1.0% 74804580 / 71930165 / +4.0% 0.74 / 0.78 / -4.8%
tpcds_q28/datafusion:vortex-file-compressed 19464989 / 19947222 / -2.4% 39886859 / 39922760 / -0.1% 0.49 / 0.50 / -2.3%
tpcds_q29/datafusion:vortex-file-compressed 52080112 / 51862495 / +0.4% 75748159 / 75750918 / -0.0% 0.69 / 0.68 / +0.4%
tpcds_q30/datafusion:vortex-file-compressed 27525285 / 27383558 / +0.5% 47874331 / 48135145 / -0.5% 0.57 / 0.57 / +1.1%
tpcds_q31/datafusion:vortex-file-compressed 64560871 / 65140462 / -0.9% 91978033 / 89533461 / +2.7% 0.70 / 0.73 / -3.5%
tpcds_q32/datafusion:vortex-file-compressed 12906113 / 13053783 / -1.1% 30965593 / 31787533 / -2.6% 0.42 / 0.41 / +1.5%
tpcds_q33/datafusion:vortex-file-compressed 29140726 / 28285436 / +3.0% 51604070 / 51454761 / +0.3% 0.56 / 0.55 / +2.7%
tpcds_q34/datafusion:vortex-file-compressed 17816206 / 17975082 / -0.9% 38323905 / 38837179 / -1.3% 0.46 / 0.46 / +0.4%
tpcds_q35/datafusion:vortex-file-compressed 30864711 / 31707258 / -2.7% 54892387 / 57092398 / -3.9% 0.56 / 0.56 / +1.2%
tpcds_q36/datafusion:vortex-file-compressed 46897636 / 48204010 / -2.7% 69968878 / 71646708 / -2.3% 0.67 / 0.67 / -0.4%
tpcds_q37/datafusion:vortex-file-compressed 12804440 / 12859500 / -0.4% 36184441 / 34834855 / +3.9% 0.35 / 0.37 / -4.1%
tpcds_q38/datafusion:vortex-file-compressed 26410498 / 25871652 / +2.1% 48430516 / 48799539 / -0.8% 0.55 / 0.53 / +2.9%
tpcds_q39/datafusion:vortex-file-compressed 65943972 / 64138940 / +2.8% 89669253 / 84196873 / +6.5% 0.74 / 0.76 / -3.5%
tpcds_q40/datafusion:vortex-file-compressed 22697206 / 23099822 / -1.7% 42292224 / 40826570 / +3.6% 0.54 / 0.57 / -5.1%
tpcds_q41/datafusion:vortex-file-compressed 20232578 / 20313999 / -0.4% 35987715 / 33601939 / +7.1% 0.56 / 0.60 / -7.0%
tpcds_q42/datafusion:vortex-file-compressed 11644858 / 11573266 / +0.6% 29438812 / 28707023 / +2.5% 0.40 / 0.40 / -1.9%
tpcds_q43/datafusion:vortex-file-compressed 13260583 / 13257601 / +0.0% 34506639 / 34317881 / +0.6% 0.38 / 0.39 / -0.5%
tpcds_q44/datafusion:vortex-file-compressed 27155852 / 27566980 / -1.5% 51739716 / 50073879 / +3.3% 0.52 / 0.55 / -4.7%
tpcds_q45/datafusion:vortex-file-compressed 16859892 / 17156192 / -1.7% 36648072 / 35825937 / +2.3% 0.46 / 0.48 / -3.9%
tpcds_q46/datafusion:vortex-file-compressed 23500403 / 23724990 / -0.9% 48126999 / 47332751 / +1.7% 0.49 / 0.50 / -2.6%
tpcds_q47/datafusion:vortex-file-compressed 76247243 / 76495896 / -0.3% 105390491 / 104667758 / +0.7% 0.72 / 0.73 / -1.0%
tpcds_q48/datafusion:vortex-file-compressed 28758386 / 28809968 / -0.2% 53467025 / 52106139 / +2.6% 0.54 / 0.55 / -2.7%
tpcds_q49/datafusion:vortex-file-compressed 60277494 / 56989200 / +5.8% 80714964 / 77552140 / +4.1% 0.75 / 0.73 / +1.6%
tpcds_q50/datafusion:vortex-file-compressed 30760436 / 31259463 / -1.6% 53161970 / 54552899 / -2.5% 0.58 / 0.57 / +1.0%
tpcds_q51/datafusion:vortex-file-compressed 67515328 / 67069247 / +0.7% 89770333 / 89960108 / -0.2% 0.75 / 0.75 / +0.9%
tpcds_q52/datafusion:vortex-file-compressed 11953106 / 12089902 / -1.1% 29358528 / 28647560 / +2.5% 0.41 / 0.42 / -3.5%
tpcds_q53/datafusion:vortex-file-compressed 18785879 / 18550316 / +1.3% 39692158 / 40404602 / -1.8% 0.47 / 0.46 / +3.1%
tpcds_q54/datafusion:vortex-file-compressed 32038118 / 32138062 / -0.3% 55821060 / 57117772 / -2.3% 0.57 / 0.56 / +2.0%
tpcds_q55/datafusion:vortex-file-compressed 11561486 / 11895288 / -2.8% 29336294 / 28020452 / +4.7% 0.39 / 0.42 / -7.2%
tpcds_q56/datafusion:vortex-file-compressed 27040368 / 27065868 / -0.1% 49815591 / 49357213 / +0.9% 0.54 / 0.55 / -1.0%
tpcds_q57/datafusion:vortex-file-compressed 61869148 / 63358198 / -2.4% 90201349 / 91105324 / -1.0% 0.69 / 0.70 / -1.4%
tpcds_q58/datafusion:vortex-file-compressed 41115243 / 40581704 / +1.3% 69051755 / 68018578 / +1.5% 0.60 / 0.60 / -0.2%
tpcds_q59/datafusion:vortex-file-compressed 27944441 / 27824138 / +0.4% 55954943 / 53525892 / +4.5% 0.50 / 0.52 / -3.9%
tpcds_q60/datafusion:vortex-file-compressed 27511102 / 27689472 / -0.6% 48671154 / 49736215 / -2.1% 0.57 / 0.56 / +1.5%
tpcds_q61/datafusion:vortex-file-compressed 21094766 / 21369380 / -1.3% 42184482 / 41632787 / +1.3% 0.50 / 0.51 / -2.6%
tpcds_q62/datafusion:vortex-file-compressed 16764072 / 16571048 / +1.2% 34871594 / 34775326 / +0.3% 0.48 / 0.48 / +0.9%
tpcds_q63/datafusion:vortex-file-compressed 18592555 / 18669124 / -0.4% 39876022 / 38956952 / +2.4% 0.47 / 0.48 / -2.7%
tpcds_q64/datafusion:vortex-file-compressed 187644918 / 189357435 / -0.9% 220730138 / 224993260 / -1.9% 0.85 / 0.84 / +1.0%
tpcds_q65/datafusion:vortex-file-compressed 74181847 / 73958021 / +0.3% 95837787 / 95001141 / +0.9% 0.77 / 0.78 / -0.6%
tpcds_q66/datafusion:vortex-file-compressed 50114669 / 50474817 / -0.7% 71411714 / 71536691 / -0.2% 0.70 / 0.71 / -0.5%
tpcds_q67/datafusion:vortex-file-compressed 51896398 / 50621378 / +2.5% 84599618 / 82996109 / +1.9% 0.61 / 0.61 / +0.6%
tpcds_q68/datafusion:vortex-file-compressed 23277378 / 23248194 / +0.1% 47487553 / 47824842 / -0.7% 0.49 / 0.49 / +0.8%
tpcds_q69/datafusion:vortex-file-compressed 27338911 / 28023170 / -2.4% 49907969 / 50236462 / -0.7% 0.55 / 0.56 / -1.8%
tpcds_q70/datafusion:vortex-file-compressed 73200926 / 73309885 / -0.1% 95096946 / 94271727 / +0.9% 0.77 / 0.78 / -1.0%
tpcds_q71/datafusion:vortex-file-compressed 19797508 / 19145562 / +3.4% 40746331 / 39489035 / +3.2% 0.49 / 0.48 / +0.2%
tpcds_q72/datafusion:vortex-file-compressed 227827418 / 259231169 / -12.1% 🟢 288295875 / 195627659 / +47.4% 🔴 0.79 / 1.33 / -40.4%
tpcds_q73/datafusion:vortex-file-compressed 16492887 / 16754338 / -1.6% 38580090 / 39462733 / -2.2% 0.43 / 0.42 / +0.7%
tpcds_q74/datafusion:vortex-file-compressed 40685050 / 40684996 / +0.0% 66274564 / 67025462 / -1.1% 0.61 / 0.61 / +1.1%
tpcds_q75/datafusion:vortex-file-compressed 140089217 / 134232744 / +4.4% 159733758 / 159913855 / -0.1% 0.88 / 0.84 / +4.5%
tpcds_q76/datafusion:vortex-file-compressed 29804048 / 30213172 / -1.4% 50446276 / 52500225 / -3.9% 0.59 / 0.58 / +2.7%
tpcds_q77/datafusion:vortex-file-compressed 45056694 / 45602928 / -1.2% 69235922 / 67382553 / +2.8% 0.65 / 0.68 / -3.8%
tpcds_q78/datafusion:vortex-file-compressed 60907733 / 60833842 / +0.1% 89434467 / 88724920 / +0.8% 0.68 / 0.69 / -0.7%
tpcds_q79/datafusion:vortex-file-compressed 19747158 / 19985701 / -1.2% 40935079 / 41624416 / -1.7% 0.48 / 0.48 / +0.5%
tpcds_q80/datafusion:vortex-file-compressed 69512142 / 69396138 / +0.2% 98072357 / 94039026 / +4.3% 0.71 / 0.74 / -4.0%
tpcds_q81/datafusion:vortex-file-compressed 28296226 / 27595739 / +2.5% 47994986 / 47579010 / +0.9% 0.59 / 0.58 / +1.6%
tpcds_q82/datafusion:vortex-file-compressed 12540992 / 12771559 / -1.8% 36025392 / 34407892 / +4.7% 0.35 / 0.37 / -6.2%
tpcds_q83/datafusion:vortex-file-compressed 34902264 / 34908527 / -0.0% 57046855 / 55384861 / +3.0% 0.61 / 0.63 / -2.9%
tpcds_q84/datafusion:vortex-file-compressed 10957028 / 10722866 / +2.2% 28058452 / 27152708 / +3.3% 0.39 / 0.39 / -1.1%
tpcds_q85/datafusion:vortex-file-compressed 52257548 / 52336471 / -0.2% 77665247 / 78887292 / -1.5% 0.67 / 0.66 / +1.4%
tpcds_q86/datafusion:vortex-file-compressed 16329120 / 16572537 / -1.5% 36388674 / 36334887 / +0.1% 0.45 / 0.46 / -1.6%
tpcds_q87/datafusion:vortex-file-compressed 26288023 / 26677014 / -1.5% 50412762 / 49827521 / +1.2% 0.52 / 0.54 / -2.6%
tpcds_q88/datafusion:vortex-file-compressed 33007608 / 32869826 / +0.4% 59581171 / 52707803 / +13.0% 🔴 0.55 / 0.62 / -11.2%
tpcds_q89/datafusion:vortex-file-compressed 21948116 / 21796038 / +0.7% 42921918 / 43994836 / -2.4% 0.51 / 0.50 / +3.2%
tpcds_q90/datafusion:vortex-file-compressed 11471740 / 11241666 / +2.0% 27099065 / 27019834 / +0.3% 0.42 / 0.42 / +1.7%
tpcds_q91/datafusion:vortex-file-compressed 16202743 / 16268288 / -0.4% 37800225 / 37513295 / +0.8% 0.43 / 0.43 / -1.2%
tpcds_q92/datafusion:vortex-file-compressed 13519888 / 13439210 / +0.6% 33323535 / 31985520 / +4.2% 0.41 / 0.42 / -3.4%
tpcds_q93/datafusion:vortex-file-compressed 20625524 / 20336282 / +1.4% 41993491 / 42092690 / -0.2% 0.49 / 0.48 / +1.7%
tpcds_q94/datafusion:vortex-file-compressed 18960729 / 19086337 / -0.7% 37739068 / 38361999 / -1.6% 0.50 / 0.50 / +1.0%
tpcds_q95/datafusion:vortex-file-compressed 41643168 / 41609895 / +0.1% 65309915 / 60770917 / +7.5% 0.64 / 0.68 / -6.9%
tpcds_q96/datafusion:vortex-file-compressed 7956800 / 7643411 / +4.1% 26078065 / 23979023 / +8.8% 0.31 / 0.32 / -4.3%
tpcds_q97/datafusion:vortex-file-compressed 17664640 / 18076009 / -2.3% 39528772 / 40475927 / -2.3% 0.45 / 0.45 / +0.1%
tpcds_q98/datafusion:vortex-file-compressed 16203492 / 16186638 / +0.1% 35439500 / 34574834 / +2.5% 0.46 / 0.47 / -2.3%
tpcds_q99/datafusion:vortex-file-compressed 16568077 / 16876998 / -1.8% 34837178 / 33606268 / +3.7% 0.48 / 0.50 / -5.3%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41581348 / 41376042 / +0.5% 60312957 / 61219563 / -1.5% 0.69 / 0.68 / +2.0%
tpcds_q02/datafusion:parquet 54469498 / 55732362 / -2.3% 71738027 / 69894210 / +2.6% 0.76 / 0.80 / -4.8%
tpcds_q03/datafusion:parquet 18782908 / 18737738 / +0.2% 30589717 / 31694728 / -3.5% 0.61 / 0.59 / +3.9%
tpcds_q04/datafusion:parquet 178297410 / 179523139 / -0.7% 204335367 / 205607654 / -0.6% 0.87 / 0.87 / -0.1%
tpcds_q05/datafusion:parquet 67291288 / 67174177 / +0.2% 91337388 / 88313263 / +3.4% 0.74 / 0.76 / -3.1%
tpcds_q06/datafusion:parquet 33961530 / 33950600 / +0.0% 50190252 / 48964223 / +2.5% 0.68 / 0.69 / -2.4%
tpcds_q07/datafusion:parquet 46818445 / 46470560 / +0.7% 64259757 / 66709214 / -3.7% 0.73 / 0.70 / +4.6%
tpcds_q08/datafusion:parquet 31317678 / 30605192 / +2.3% 45376972 / 47185942 / -3.8% 0.69 / 0.65 / +6.4%
tpcds_q09/datafusion:parquet 33829138 / 31848258 / +6.2% 38123174 / 42365274 / -10.0% 🟢 0.89 / 0.75 / +18.0%
tpcds_q10/datafusion:parquet 43718938 / 44008693 / -0.7% 57888070 / 59276877 / -2.3% 0.76 / 0.74 / +1.7%
tpcds_q11/datafusion:parquet 97159446 / 97387583 / -0.2% 121180479 / 121162439 / +0.0% 0.80 / 0.80 / -0.2%
tpcds_q12/datafusion:parquet 23841634 / 23757968 / +0.4% 37208564 / 36166281 / +2.9% 0.64 / 0.66 / -2.5%
tpcds_q13/datafusion:parquet 47098416 / 46582172 / +1.1% 67761337 / 66579247 / +1.8% 0.70 / 0.70 / -0.7%
tpcds_q14/datafusion:parquet 536201276 / 534336185 / +0.3% 578252882 / 578660836 / -0.1% 0.93 / 0.92 / +0.4%
tpcds_q15/datafusion:parquet 23373762 / 23392806 / -0.1% 40120288 / 37937293 / +5.8% 0.58 / 0.62 / -5.5%
tpcds_q16/datafusion:parquet 37056402 / 36413108 / +1.8% 51596709 / 49676739 / +3.9% 0.72 / 0.73 / -2.0%
tpcds_q17/datafusion:parquet 73421512 / 72825562 / +0.8% 98016541 / 96065604 / +2.0% 0.75 / 0.76 / -1.2%
tpcds_q18/datafusion:parquet 67111048 / 69986060 / -4.1% 94702212 / 89559714 / +5.7% 0.71 / 0.78 / -9.3%
tpcds_q19/datafusion:parquet 29433106 / 29692210 / -0.9% 43081883 / 42317870 / +1.8% 0.68 / 0.70 / -2.6%
tpcds_q20/datafusion:parquet 25017034 / 24998773 / +0.1% 38674926 / 39649312 / -2.5% 0.65 / 0.63 / +2.6%
tpcds_q21/datafusion:parquet 20245898 / 20293156 / -0.2% 35671897 / 31891395 / +11.9% 🔴 0.57 / 0.64 / -10.8%
tpcds_q22/datafusion:parquet 76234209 / 76673806 / -0.6% 89613019 / 88245600 / +1.5% 0.85 / 0.87 / -2.1%
tpcds_q23/datafusion:parquet 91791418 / 92994178 / -1.3% 114022887 / 116346255 / -2.0% 0.81 / 0.80 / +0.7%
tpcds_q24/datafusion:parquet 89699322 / 90352230 / -0.7% 113903348 / 114052483 / -0.1% 0.79 / 0.79 / -0.6%
tpcds_q25/datafusion:parquet 81311178 / 83103540 / -2.2% 110359173 / 106991814 / +3.1% 0.74 / 0.78 / -5.1%
tpcds_q26/datafusion:parquet 42941394 / 43230669 / -0.7% 60169152 / 59614170 / +0.9% 0.71 / 0.73 / -1.6%
tpcds_q27/datafusion:parquet 73972828 / 78436083 / -5.7% 95928969 / 96734171 / -0.8% 0.77 / 0.81 / -4.9%
tpcds_q28/datafusion:parquet 27912584 / 28439834 / -1.9% 43896286 / 42919609 / +2.3% 0.64 / 0.66 / -4.0%
tpcds_q29/datafusion:parquet 75287201 / 74674603 / +0.8% 96031882 / 94927127 / +1.2% 0.78 / 0.79 / -0.3%
tpcds_q30/datafusion:parquet 46012349 / 44134348 / +4.3% 60122084 / 56208527 / +7.0% 0.77 / 0.79 / -2.5%
tpcds_q31/datafusion:parquet 80941875 / 80867606 / +0.1% 98020501 / 97410449 / +0.6% 0.83 / 0.83 / -0.5%
tpcds_q32/datafusion:parquet 26773291 / 26483018 / +1.1% 41933302 / 40256380 / +4.2% 0.64 / 0.66 / -2.9%
tpcds_q33/datafusion:parquet 39759065 / 36833372 / +7.9% 53461822 / 53260196 / +0.4% 0.74 / 0.69 / +7.5%
tpcds_q34/datafusion:parquet 24364380 / 24317154 / +0.2% 37141716 / 36441604 / +1.9% 0.66 / 0.67 / -1.7%
tpcds_q35/datafusion:parquet 50140238 / 50190934 / -0.1% 62645312 / 62947670 / -0.5% 0.80 / 0.80 / +0.4%
tpcds_q36/datafusion:parquet 50197540 / 52860474 / -5.0% 71556113 / 68624394 / +4.3% 0.70 / 0.77 / -8.9%
tpcds_q37/datafusion:parquet 21534532 / 21151724 / +1.8% 33956123 / 33918247 / +0.1% 0.63 / 0.62 / +1.7%
tpcds_q38/datafusion:parquet 43478388 / 44859544 / -3.1% 63350451 / 63473075 / -0.2% 0.69 / 0.71 / -2.9%
tpcds_q39/datafusion:parquet 68989202 / 67112504 / +2.8% 86563872 / 85331642 / +1.4% 0.80 / 0.79 / +1.3%
tpcds_q40/datafusion:parquet 30609808 / 30532482 / +0.3% 50730328 / 49143732 / +3.2% 0.60 / 0.62 / -2.9%
tpcds_q41/datafusion:parquet 19943685 / 19787577 / +0.8% 32727163 / 31851776 / +2.7% 0.61 / 0.62 / -1.9%
tpcds_q42/datafusion:parquet 18185610 / 18178046 / +0.0% 30613270 / 29288979 / +4.5% 0.59 / 0.62 / -4.3%
tpcds_q43/datafusion:parquet 19041296 / 19083207 / -0.2% 33761778 / 31783720 / +6.2% 0.56 / 0.60 / -6.1%
tpcds_q44/datafusion:parquet 36281437 / 35750512 / +1.5% 50918756 / 50601371 / +0.6% 0.71 / 0.71 / +0.9%
tpcds_q45/datafusion:parquet 28010028 / 28178494 / -0.6% 40667643 / 41490483 / -2.0% 0.69 / 0.68 / +1.4%
tpcds_q46/datafusion:parquet 28678082 / 28972956 / -1.0% 46073459 / 45414322 / +1.5% 0.62 / 0.64 / -2.4%
tpcds_q47/datafusion:parquet 97439566 / 97934518 / -0.5% 120648822 / 118309705 / +2.0% 0.81 / 0.83 / -2.4%
tpcds_q48/datafusion:parquet 41955207 / 41701310 / +0.6% 59254997 / 57953501 / +2.2% 0.71 / 0.72 / -1.6%
tpcds_q49/datafusion:parquet 71179053 / 71784336 / -0.8% 93758036 / 94510003 / -0.8% 0.76 / 0.76 / -0.0%
tpcds_q50/datafusion:parquet 46968108 / 48609835 / -3.4% 65370109 / 67338815 / -2.9% 0.72 / 0.72 / -0.5%
tpcds_q51/datafusion:parquet 75242992 / 75209341 / +0.0% 94471599 / 95256576 / -0.8% 0.80 / 0.79 / +0.9%
tpcds_q52/datafusion:parquet 18562384 / 18917972 / -1.9% 30525331 / 31163039 / -2.0% 0.61 / 0.61 / +0.2%
tpcds_q53/datafusion:parquet 22560515 / 22211532 / +1.6% 38319859 / 38349233 / -0.1% 0.59 / 0.58 / +1.6%
tpcds_q54/datafusion:parquet 52334456 / 53454868 / -2.1% 71964912 / 67971128 / +5.9% 0.73 / 0.79 / -7.5%
tpcds_q55/datafusion:parquet 18175218 / 18235946 / -0.3% 30116953 / 30316506 / -0.7% 0.60 / 0.60 / +0.3%
tpcds_q56/datafusion:parquet 42040148 / 41246233 / +1.9% 55952337 / 55602370 / +0.6% 0.75 / 0.74 / +1.3%
tpcds_q57/datafusion:parquet 100516022 / 100767090 / -0.2% 121567908 / 120128876 / +1.2% 0.83 / 0.84 / -1.4%
tpcds_q58/datafusion:parquet 65571699 / 65248474 / +0.5% 83683086 / 84687088 / -1.2% 0.78 / 0.77 / +1.7%
tpcds_q59/datafusion:parquet 48123656 / 47775176 / +0.7% 64066179 / 63656695 / +0.6% 0.75 / 0.75 / +0.1%
tpcds_q60/datafusion:parquet 42103729 / 39445761 / +6.7% 54543580 / 56847584 / -4.1% 0.77 / 0.69 / +11.2%
tpcds_q61/datafusion:parquet 35270924 / 36813269 / -4.2% 54160710 / 50895221 / +6.4% 0.65 / 0.72 / -10.0%
tpcds_q62/datafusion:parquet 25123458 / 25338640 / -0.8% 38575840 / 38285058 / +0.8% 0.65 / 0.66 / -1.6%
tpcds_q63/datafusion:parquet 22378642 / 21930100 / +2.0% 38494310 / 38582650 / -0.2% 0.58 / 0.57 / +2.3%
tpcds_q64/datafusion:parquet 285765984 / 286831498 / -0.4% 323640907 / 326238857 / -0.8% 0.88 / 0.88 / +0.4%
tpcds_q65/datafusion:parquet 123604474 / 121801285 / +1.5% 143166742 / 134186273 / +6.7% 0.86 / 0.91 / -4.9%
tpcds_q66/datafusion:parquet 60883412 / 60839942 / +0.1% 77943240 / 79575451 / -2.1% 0.78 / 0.76 / +2.2%
tpcds_q67/datafusion:parquet 68768396 / 68273845 / +0.7% 91883700 / 93375373 / -1.6% 0.75 / 0.73 / +2.4%
tpcds_q68/datafusion:parquet 29028407 / 28987636 / +0.1% 48971669 / 47721454 / +2.6% 0.59 / 0.61 / -2.4%
tpcds_q69/datafusion:parquet 44329306 / 44011666 / +0.7% 58109831 / 59312736 / -2.0% 0.76 / 0.74 / +2.8%
tpcds_q70/datafusion:parquet 80325344 / 79739070 / +0.7% 97471467 / 96557167 / +0.9% 0.82 / 0.83 / -0.2%
tpcds_q71/datafusion:parquet 25547386 / 26511336 / -3.6% 40177026 / 40530827 / -0.9% 0.64 / 0.65 / -2.8%
tpcds_q72/datafusion:parquet 524156794 / 540761378 / -3.1% 565688061 / 551950149 / +2.5% 0.93 / 0.98 / -5.4%
tpcds_q73/datafusion:parquet 23934226 / 23924097 / +0.0% 36575009 / 36151951 / +1.2% 0.65 / 0.66 / -1.1%
tpcds_q74/datafusion:parquet 70033670 / 70601638 / -0.8% 85724064 / 90643728 / -5.4% 0.82 / 0.78 / +4.9%
tpcds_q75/datafusion:parquet 151550884 / 150295181 / +0.8% 177585707 / 180193164 / -1.4% 0.85 / 0.83 / +2.3%
tpcds_q76/datafusion:parquet 33413250 / 33534629 / -0.4% 47782556 / 47350461 / +0.9% 0.70 / 0.71 / -1.3%
tpcds_q77/datafusion:parquet 55617252 / 56484353 / -1.5% 77266856 / 74409264 / +3.8% 0.72 / 0.76 / -5.2%
tpcds_q78/datafusion:parquet 86184844 / 85590208 / +0.7% 120850327 / 118425953 / +2.0% 0.71 / 0.72 / -1.3%
tpcds_q79/datafusion:parquet 26686360 / 26762858 / -0.3% 42788987 / 42045849 / +1.8% 0.62 / 0.64 / -2.0%
tpcds_q80/datafusion:parquet 80996656 / 80712046 / +0.4% 110095911 / 108409957 / +1.6% 0.74 / 0.74 / -1.2%
tpcds_q81/datafusion:parquet 38506362 / 38586344 / -0.2% 51824488 / 51809010 / +0.0% 0.74 / 0.74 / -0.2%
tpcds_q82/datafusion:parquet 22095964 / 22524582 / -1.9% 35940081 / 37133596 / -3.2% 0.61 / 0.61 / +1.4%
tpcds_q83/datafusion:parquet 59753678 / 59569809 / +0.3% 77419429 / 72022758 / +7.5% 0.77 / 0.83 / -6.7%
tpcds_q84/datafusion:parquet 26749984 / 26371932 / +1.4% 40136462 / 39708160 / +1.1% 0.67 / 0.66 / +0.4%
tpcds_q85/datafusion:parquet 79824871 / 79952822 / -0.2% 101984325 / 106512050 / -4.3% 0.78 / 0.75 / +4.3%
tpcds_q86/datafusion:parquet 20787703 / 20734859 / +0.3% 34034655 / 33497201 / +1.6% 0.61 / 0.62 / -1.3%
tpcds_q87/datafusion:parquet 45254740 / 44299628 / +2.2% 63328114 / 63642189 / -0.5% 0.71 / 0.70 / +2.7%
tpcds_q88/datafusion:parquet 37585727 / 37159283 / +1.1% 53060350 / 51724259 / +2.6% 0.71 / 0.72 / -1.4%
tpcds_q89/datafusion:parquet 25420531 / 26138636 / -2.7% 43188829 / 41281572 / +4.6% 0.59 / 0.63 / -7.0%
tpcds_q90/datafusion:parquet 15253658 / 16136780 / -5.5% 28480642 / 27195766 / +4.7% 0.54 / 0.59 / -9.7%
tpcds_q91/datafusion:parquet 31996878 / 32373534 / -1.2% 48066172 / 47212357 / +1.8% 0.67 / 0.69 / -2.9%
tpcds_q92/datafusion:parquet 26630740 / 27216506 / -2.2% 41742368 / 40386922 / +3.4% 0.64 / 0.67 / -5.3%
tpcds_q93/datafusion:parquet 26723684 / 26683946 / +0.1% 48250454 / 45552147 / +5.9% 0.55 / 0.59 / -5.5%
tpcds_q94/datafusion:parquet 35025898 / 34886300 / +0.4% 49773547 / 48312778 / +3.0% 0.70 / 0.72 / -2.5%
tpcds_q95/datafusion:parquet 64570073 / 64259654 / +0.5% 82092172 / 80348221 / +2.2% 0.79 / 0.80 / -1.7%
tpcds_q96/datafusion:parquet 12742144 / 12953416 / -1.6% 25059364 / 24275479 / +3.2% 0.51 / 0.53 / -4.7%
tpcds_q97/datafusion:parquet 35400879 / 35162045 / +0.7% 52215196 / 50122030 / +4.2% 0.68 / 0.70 / -3.4%
tpcds_q98/datafusion:parquet 24581142 / 25039502 / -1.8% 38209192 / 38557743 / -0.9% 0.64 / 0.65 / -0.9%
tpcds_q99/datafusion:parquet 29996519 / 29466395 / +1.8% 43041025 / 42157730 / +2.1% 0.70 / 0.70 / -0.3%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16167730 / 15950180 / +1.4% 24731885 / 25263427 / -2.1% 0.65 / 0.63 / +3.5%
tpcds_q02/duckdb:vortex-file-compressed 17733864 / 18801004 / -5.7% 23633147 / 23883580 / -1.0% 0.75 / 0.79 / -4.7%
tpcds_q03/duckdb:vortex-file-compressed 7479482 / 7320582 / +2.2% 15638054 / 16654105 / -6.1% 0.48 / 0.44 / +8.8%
tpcds_q04/duckdb:vortex-file-compressed 59047476 / 59203912 / -0.3% 71334573 / 71541396 / -0.3% 0.83 / 0.83 / +0.0%
tpcds_q05/duckdb:vortex-file-compressed 23223674 / 23035500 / +0.8% 33029625 / 33388993 / -1.1% 0.70 / 0.69 / +1.9%
tpcds_q06/duckdb:vortex-file-compressed 24561334 / 24528946 / +0.1% 38034861 / 38642241 / -1.6% 0.65 / 0.63 / +1.7%
tpcds_q07/duckdb:vortex-file-compressed 22283510 / 22308278 / -0.1% 33646832 / 35253198 / -4.6% 0.66 / 0.63 / +4.7%
tpcds_q08/duckdb:vortex-file-compressed 17671110 / 17645794 / +0.1% 26059900 / 25505272 / +2.2% 0.68 / 0.69 / -2.0%
tpcds_q09/duckdb:vortex-file-compressed 19200890 / 19366975 / -0.9% 29145725 / 30843387 / -5.5% 0.66 / 0.63 / +4.9%
tpcds_q10/duckdb:vortex-file-compressed 28189323 / 27862250 / +1.2% 42080161 / 43082554 / -2.3% 0.67 / 0.65 / +3.6%
tpcds_q11/duckdb:vortex-file-compressed 36591254 / 36169896 / +1.2% 44913513 / 45305479 / -0.9% 0.81 / 0.80 / +2.0%
tpcds_q12/duckdb:vortex-file-compressed 10578115 / 10246959 / +3.2% 17794759 / 17946512 / -0.8% 0.59 / 0.57 / +4.1%
tpcds_q13/duckdb:vortex-file-compressed 20360762 / 20616028 / -1.2% 33218586 / 34013966 / -2.3% 0.61 / 0.61 / +1.1%
tpcds_q14/duckdb:vortex-file-compressed 56098856 / 57230122 / -2.0% 65722272 / 66337307 / -0.9% 0.85 / 0.86 / -1.1%
tpcds_q15/duckdb:vortex-file-compressed 11193014 / 11170355 / +0.2% 17808257 / 18430743 / -3.4% 0.63 / 0.61 / +3.7%
tpcds_q16/duckdb:vortex-file-compressed 24755401 / 24490082 / +1.1% 34610752 / 34363914 / +0.7% 0.72 / 0.71 / +0.4%
tpcds_q17/duckdb:vortex-file-compressed 19858801 / 19836557 / +0.1% 31406778 / 33452272 / -6.1% 0.63 / 0.59 / +6.6%
tpcds_q18/duckdb:vortex-file-compressed 32399527 / 32332526 / +0.2% 44034023 / 42770299 / +3.0% 0.74 / 0.76 / -2.7%
tpcds_q19/duckdb:vortex-file-compressed 21003488 / 20733066 / +1.3% 29573730 / 29043896 / +1.8% 0.71 / 0.71 / -0.5%
tpcds_q20/duckdb:vortex-file-compressed 11044336 / 10896007 / +1.4% 18599245 / 19362443 / -3.9% 0.59 / 0.56 / +5.5%
tpcds_q21/duckdb:vortex-file-compressed 10393530 / 10357654 / +0.3% 22489489 / 23056050 / -2.5% 0.46 / 0.45 / +2.9%
tpcds_q22/duckdb:vortex-file-compressed 18686756 / 18446908 / +1.3% 30922751 / 31043892 / -0.4% 0.60 / 0.59 / +1.7%
tpcds_q23/duckdb:vortex-file-compressed 38122635 / 36930008 / +3.2% 48737607 / 50973194 / -4.4% 0.78 / 0.72 / +8.0%
tpcds_q24/duckdb:vortex-file-compressed 26766875 / 26535469 / +0.9% 36381398 / 36711742 / -0.9% 0.74 / 0.72 / +1.8%
tpcds_q25/duckdb:vortex-file-compressed 19334509 / 19161888 / +0.9% 31096424 / 31706360 / -1.9% 0.62 / 0.60 / +2.9%
tpcds_q26/duckdb:vortex-file-compressed 21733636 / 21473940 / +1.2% 31235740 / 31940513 / -2.2% 0.70 / 0.67 / +3.5%
tpcds_q27/duckdb:vortex-file-compressed 24980161 / 24627853 / +1.4% 37257851 / 37062490 / +0.5% 0.67 / 0.66 / +0.9%
tpcds_q28/duckdb:vortex-file-compressed 15542302 / 14909132 / +4.2% 25153816 / 25855408 / -2.7% 0.62 / 0.58 / +7.2%
tpcds_q29/duckdb:vortex-file-compressed 18483207 / 18382644 / +0.5% 30334915 / 30526185 / -0.6% 0.61 / 0.60 / +1.2%
tpcds_q30/duckdb:vortex-file-compressed 18603356 / 18307739 / +1.6% 27289117 / 27489761 / -0.7% 0.68 / 0.67 / +2.4%
tpcds_q31/duckdb:vortex-file-compressed 18385930 / 18103724 / +1.6% 26860192 / 27164329 / -1.1% 0.68 / 0.67 / +2.7%
tpcds_q32/duckdb:vortex-file-compressed 10279968 / 10378996 / -1.0% 18546194 / 18293540 / +1.4% 0.55 / 0.57 / -2.3%
tpcds_q33/duckdb:vortex-file-compressed 18379108 / 18037569 / +1.9% 27600084 / 28781562 / -4.1% 0.67 / 0.63 / +6.3%
tpcds_q34/duckdb:vortex-file-compressed 12996388 / 12801462 / +1.5% 22937474 / 22659012 / +1.2% 0.57 / 0.56 / +0.3%
tpcds_q35/duckdb:vortex-file-compressed 31517468 / 30873694 / +2.1% 43549453 / 44562166 / -2.3% 0.72 / 0.69 / +4.5%
tpcds_q36/duckdb:vortex-file-compressed 14538862 / 14397374 / +1.0% 24484406 / 25399079 / -3.6% 0.59 / 0.57 / +4.8%
tpcds_q37/duckdb:vortex-file-compressed 9780746 / 9725238 / +0.6% 23990671 / 25619843 / -6.4% 0.41 / 0.38 / +7.4%
tpcds_q38/duckdb:vortex-file-compressed 24621771 / 24409856 / +0.9% 32383385 / 32724251 / -1.0% 0.76 / 0.75 / +1.9%
tpcds_q39/duckdb:vortex-file-compressed 19372465 / 18636791 / +3.9% 32900278 / 32162326 / +2.3% 0.59 / 0.58 / +1.6%
tpcds_q40/duckdb:vortex-file-compressed 11365901 / 11184190 / +1.6% 19293471 / 19148368 / +0.8% 0.59 / 0.58 / +0.9%
tpcds_q41/duckdb:vortex-file-compressed 17474208 / 17342186 / +0.8% 24196651 / 24029694 / +0.7% 0.72 / 0.72 / +0.1%
tpcds_q42/duckdb:vortex-file-compressed 7202634 / 7099606 / +1.5% 15680087 / 15724098 / -0.3% 0.46 / 0.45 / +1.7%
tpcds_q43/duckdb:vortex-file-compressed 10010799 / 9986872 / +0.2% 18856164 / 19731742 / -4.4% 0.53 / 0.51 / +4.9%
tpcds_q44/duckdb:vortex-file-compressed 12802416 / 13000492 / -1.5% 24113366 / 25367464 / -4.9% 0.53 / 0.51 / +3.6%
tpcds_q45/duckdb:vortex-file-compressed 24101052 / 23949190 / +0.6% 31049700 / 31323076 / -0.9% 0.78 / 0.76 / +1.5%
tpcds_q46/duckdb:vortex-file-compressed 31541257 / 31147955 / +1.3% 43515903 / 43517007 / -0.0% 0.72 / 0.72 / +1.3%
tpcds_q47/duckdb:vortex-file-compressed 31449386 / 31649572 / -0.6% 41847116 / 41544193 / +0.7% 0.75 / 0.76 / -1.4%
tpcds_q48/duckdb:vortex-file-compressed 22625926 / 22756620 / -0.6% 35798978 / 35932579 / -0.4% 0.63 / 0.63 / -0.2%
tpcds_q49/duckdb:vortex-file-compressed 19012896 / 18629694 / +2.1% 30370336 / 31146202 / -2.5% 0.63 / 0.60 / +4.7%
tpcds_q50/duckdb:vortex-file-compressed 14825381 / 14941534 / -0.8% 25523139 / 26785755 / -4.7% 0.58 / 0.56 / +4.1%
tpcds_q51/duckdb:vortex-file-compressed 49515519 / 48607867 / +1.9% 58880167 / 58443826 / +0.7% 0.84 / 0.83 / +1.1%
tpcds_q52/duckdb:vortex-file-compressed 7486194 / 7509994 / -0.3% 16053677 / 15590999 / +3.0% 0.47 / 0.48 / -3.2%
tpcds_q53/duckdb:vortex-file-compressed 11691302 / 11878563 / -1.6% 20947657 / 20971241 / -0.1% 0.56 / 0.57 / -1.5%
tpcds_q54/duckdb:vortex-file-compressed 19594708 / 19747336 / -0.8% 29983753 / 30843853 / -2.8% 0.65 / 0.64 / +2.1%
tpcds_q55/duckdb:vortex-file-compressed 7190572 / 7110922 / +1.1% 15457643 / 15841679 / -2.4% 0.47 / 0.45 / +3.6%
tpcds_q56/duckdb:vortex-file-compressed 18920686 / 18749636 / +0.9% 28337373 / 29716288 / -4.6% 0.67 / 0.63 / +5.8%
tpcds_q57/duckdb:vortex-file-compressed 25586082 / 25370060 / +0.9% 34204380 / 34220539 / -0.0% 0.75 / 0.74 / +0.9%
tpcds_q58/duckdb:vortex-file-compressed 20284583 / 20744970 / -2.2% 32194435 / 31382790 / +2.6% 0.63 / 0.66 / -4.7%
tpcds_q59/duckdb:vortex-file-compressed 19681350 / 19960692 / -1.4% 27681622 / 27021662 / +2.4% 0.71 / 0.74 / -3.8%
tpcds_q60/duckdb:vortex-file-compressed 19004069 / 19017145 / -0.1% 28592457 / 29070982 / -1.6% 0.66 / 0.65 / +1.6%
tpcds_q61/duckdb:vortex-file-compressed 20081094 / 19802826 / +1.4% 30039778 / 31082899 / -3.4% 0.67 / 0.64 / +4.9%
tpcds_q62/duckdb:vortex-file-compressed 11842100 / 11166698 / +6.0% 17687528 / 17746265 / -0.3% 0.67 / 0.63 / +6.4%
tpcds_q63/duckdb:vortex-file-compressed 11337752 / 11243846 / +0.8% 19743853 / 19992881 / -1.2% 0.57 / 0.56 / +2.1%
tpcds_q64/duckdb:vortex-file-compressed 52517850 / 53121820 / -1.1% 67608481 / 69626046 / -2.9% 0.78 / 0.76 / +1.8%
tpcds_q65/duckdb:vortex-file-compressed 13210988 / 13349834 / -1.0% 23687406 / 23074259 / +2.7% 0.56 / 0.58 / -3.6%
tpcds_q66/duckdb:vortex-file-compressed 32366912 / 31214542 / +3.7% 38996693 / 39115457 / -0.3% 0.83 / 0.80 / +4.0%
tpcds_q67/duckdb:vortex-file-compressed 56224288 / 55938640 / +0.5% 64957494 / 65591713 / -1.0% 0.87 / 0.85 / +1.5%
tpcds_q68/duckdb:vortex-file-compressed 22166661 / 22209406 / -0.2% 34826251 / 35713394 / -2.5% 0.64 / 0.62 / +2.3%
tpcds_q69/duckdb:vortex-file-compressed 22925882 / 23070750 / -0.6% 38200294 / 37625924 / +1.5% 0.60 / 0.61 / -2.1%
tpcds_q70/duckdb:vortex-file-compressed 15005586 / 15001290 / +0.0% 26340827 / 25143834 / +4.8% 0.57 / 0.60 / -4.5%
tpcds_q71/duckdb:vortex-file-compressed 13893634 / 13210582 / +5.2% 23936191 / 23954603 / -0.1% 0.58 / 0.55 / +5.3%
tpcds_q72/duckdb:vortex-file-compressed 43575611 / 42876446 / +1.6% 57557919 / 57206061 / +0.6% 0.76 / 0.75 / +1.0%
tpcds_q73/duckdb:vortex-file-compressed 11755205 / 11640646 / +1.0% 21069772 / 21558663 / -2.3% 0.56 / 0.54 / +3.3%
tpcds_q74/duckdb:vortex-file-compressed 31703237 / 31388265 / +1.0% 40650986 / 41220258 / -1.4% 0.78 / 0.76 / +2.4%
tpcds_q75/duckdb:vortex-file-compressed 37691488 / 37672066 / +0.1% 50684780 / 50735919 / -0.1% 0.74 / 0.74 / +0.2%
tpcds_q76/duckdb:vortex-file-compressed 12993748 / 13118286 / -0.9% 23131324 / 22629245 / +2.2% 0.56 / 0.58 / -3.1%
tpcds_q77/duckdb:vortex-file-compressed 21438280 / 21197152 / +1.1% 32163037 / 32738076 / -1.8% 0.67 / 0.65 / +2.9%
tpcds_q78/duckdb:vortex-file-compressed 43566996 / 42913782 / +1.5% 52351311 / 55178265 / -5.1% 0.83 / 0.78 / +7.0%
tpcds_q79/duckdb:vortex-file-compressed 16338880 / 16335712 / +0.0% 26746047 / 26631686 / +0.4% 0.61 / 0.61 / -0.4%
tpcds_q80/duckdb:vortex-file-compressed 30795865 / 29825932 / +3.3% 44464586 / 44588835 / -0.3% 0.69 / 0.67 / +3.5%
tpcds_q81/duckdb:vortex-file-compressed 21542104 / 21146468 / +1.9% 30419800 / 30026230 / +1.3% 0.71 / 0.70 / +0.6%
tpcds_q82/duckdb:vortex-file-compressed 10344584 / 10016326 / +3.3% 25807803 / 25845834 / -0.1% 0.40 / 0.39 / +3.4%
tpcds_q83/duckdb:vortex-file-compressed 17705272 / 17438640 / +1.5% 24740783 / 25427703 / -2.7% 0.72 / 0.69 / +4.3%
tpcds_q84/duckdb:vortex-file-compressed 16431879 / 15744426 / +4.4% 23300567 / 22990705 / +1.3% 0.71 / 0.68 / +3.0%
tpcds_q85/duckdb:vortex-file-compressed 25093484 / 25055424 / +0.2% 36818531 / 37432950 / -1.6% 0.68 / 0.67 / +1.8%
tpcds_q86/duckdb:vortex-file-compressed 10348510 / 10169914 / +1.8% 17000264 / 17363315 / -2.1% 0.61 / 0.59 / +3.9%
tpcds_q87/duckdb:vortex-file-compressed 26066867 / 25953241 / +0.4% 33570670 / 33600139 / -0.1% 0.78 / 0.77 / +0.5%
tpcds_q88/duckdb:vortex-file-compressed 30345132 / 30572310 / -0.7% 38157342 / 38655563 / -1.3% 0.80 / 0.79 / +0.6%
tpcds_q89/duckdb:vortex-file-compressed 13138769 / 12301116 / +6.8% 21284844 / 22248419 / -4.3% 0.62 / 0.55 / +11.6%
tpcds_q90/duckdb:vortex-file-compressed 7839427 / 7888657 / -0.6% 15197562 / 14890704 / +2.1% 0.52 / 0.53 / -2.6%
tpcds_q91/duckdb:vortex-file-compressed 15037148 / 14930783 / +0.7% 24230947 / 24613558 / -1.6% 0.62 / 0.61 / +2.3%
tpcds_q92/duckdb:vortex-file-compressed 10915483 / 10721310 / +1.8% 18864529 / 18908862 / -0.2% 0.58 / 0.57 / +2.1%
tpcds_q93/duckdb:vortex-file-compressed 9845566 / 9555436 / +3.0% 22623331 / 22832258 / -0.9% 0.44 / 0.42 / +4.0%
tpcds_q94/duckdb:vortex-file-compressed 22081370 / 21954807 / +0.6% 31471941 / 31189614 / +0.9% 0.70 / 0.70 / -0.3%
tpcds_q95/duckdb:vortex-file-compressed 59551553 / 59946633 / -0.7% 67412532 / 67982595 / -0.8% 0.88 / 0.88 / +0.2%
tpcds_q96/duckdb:vortex-file-compressed 6857703 / 6944434 / -1.2% 15713946 / 15312325 / +2.6% 0.44 / 0.45 / -3.8%
tpcds_q97/duckdb:vortex-file-compressed 23174410 / 23430530 / -1.1% 31276884 / 32067215 / -2.5% 0.74 / 0.73 / +1.4%
tpcds_q98/duckdb:vortex-file-compressed 11670812 / 11703098 / -0.3% 20494895 / 20998927 / -2.4% 0.57 / 0.56 / +2.2%
tpcds_q99/duckdb:vortex-file-compressed 14657310 / 14509094 / +1.0% 22228180 / 22659994 / -1.9% 0.66 / 0.64 / +3.0%
duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24130577 / 24073216 / +0.2% 30867879 / 30710979 / +0.5% 0.78 / 0.78 / -0.3%
tpcds_q02/duckdb:parquet 18027322 / 17849130 / +1.0% 23771867 / 23732681 / +0.2% 0.76 / 0.75 / +0.8%
tpcds_q03/duckdb:parquet 9824618 / 9794384 / +0.3% 15409005 / 15550470 / -0.9% 0.64 / 0.63 / +1.2%
tpcds_q04/duckdb:parquet 118357344 / 118506223 / -0.1% 125812306 / 125613891 / +0.2% 0.94 / 0.94 / -0.3%
tpcds_q05/duckdb:parquet 28640512 / 28354389 / +1.0% 32801234 / 32802471 / -0.0% 0.87 / 0.86 / +1.0%
tpcds_q06/duckdb:parquet 26730416 / 26331690 / +1.5% 35692885 / 35351923 / +1.0% 0.75 / 0.74 / +0.5%
tpcds_q07/duckdb:parquet 33388837 / 31741252 / +5.2% 38495628 / 38570529 / -0.2% 0.87 / 0.82 / +5.4%
tpcds_q08/duckdb:parquet 19803870 / 19794708 / +0.0% 26310051 / 25846234 / +1.8% 0.75 / 0.77 / -1.7%
tpcds_q09/duckdb:parquet 26685042 / 26144806 / +2.1% 29354725 / 29675920 / -1.1% 0.91 / 0.88 / +3.2%
tpcds_q10/duckdb:parquet 33221844 / 32633190 / +1.8% 39975024 / 40250101 / -0.7% 0.83 / 0.81 / +2.5%
tpcds_q11/duckdb:parquet 68813548 / 68986190 / -0.3% 75612824 / 77362985 / -2.3% 0.91 / 0.89 / +2.1%
tpcds_q12/duckdb:parquet 14000824 / 13916064 / +0.6% 18784826 / 19053363 / -1.4% 0.75 / 0.73 / +2.0%
tpcds_q13/duckdb:parquet 32446076 / 30738367 / +5.6% 39225625 / 39428486 / -0.5% 0.83 / 0.78 / +6.1%
tpcds_q14/duckdb:parquet 64101559 / 66035072 / -2.9% 69036369 / 68022810 / +1.5% 0.93 / 0.97 / -4.4%
tpcds_q15/duckdb:parquet 16583636 / 16583388 / +0.0% 22717413 / 22387179 / +1.5% 0.73 / 0.74 / -1.5%
tpcds_q16/duckdb:parquet 30230200 / 30164618 / +0.2% 37069431 / 36980747 / +0.2% 0.82 / 0.82 / -0.0%
tpcds_q17/duckdb:parquet 34642332 / 34663156 / -0.1% 40013740 / 40562264 / -1.4% 0.87 / 0.85 / +1.3%
tpcds_q18/duckdb:parquet 47723840 / 46888790 / +1.8% 55222525 / 55063500 / +0.3% 0.86 / 0.85 / +1.5%
tpcds_q19/duckdb:parquet 19629962 / 18692639 / +5.0% 25674143 / 25568198 / +0.4% 0.76 / 0.73 / +4.6%
tpcds_q20/duckdb:parquet 15025628 / 14865047 / +1.1% 19707601 / 19303239 / +2.1% 0.76 / 0.77 / -1.0%
tpcds_q21/duckdb:parquet 10853576 / 10488846 / +3.5% 16880120 / 16597396 / +1.7% 0.64 / 0.63 / +1.7%
tpcds_q22/duckdb:parquet 20482732 / 20616512 / -0.6% 26617020 / 26545329 / +0.3% 0.77 / 0.78 / -0.9%
tpcds_q23/duckdb:parquet 42385984 / 44282988 / -4.3% 47175377 / 46544724 / +1.4% 0.90 / 0.95 / -5.6%
tpcds_q24/duckdb:parquet 31405066 / 30378958 / +3.4% 36598163 / 36884461 / -0.8% 0.86 / 0.82 / +4.2%
tpcds_q25/duckdb:parquet 30602147 / 30451766 / +0.5% 36673295 / 37193241 / -1.4% 0.83 / 0.82 / +1.9%
tpcds_q26/duckdb:parquet 29397036 / 28814890 / +2.0% 35238922 / 35083031 / +0.4% 0.83 / 0.82 / +1.6%
tpcds_q27/duckdb:parquet 33524087 / 33096841 / +1.3% 41603767 / 41974933 / -0.9% 0.81 / 0.79 / +2.2%
tpcds_q28/duckdb:parquet 26331079 / 25716484 / +2.4% 33935283 / 33667182 / +0.8% 0.78 / 0.76 / +1.6%
tpcds_q29/duckdb:parquet 32362990 / 31904670 / +1.4% 39160811 / 38986555 / +0.4% 0.83 / 0.82 / +1.0%
tpcds_q30/duckdb:parquet 35786740 / 35558110 / +0.6% 44161788 / 44024286 / +0.3% 0.81 / 0.81 / +0.3%
tpcds_q31/duckdb:parquet 35460203 / 35613797 / -0.4% 43298944 / 42646288 / +1.5% 0.82 / 0.84 / -1.9%
tpcds_q32/duckdb:parquet 14201143 / 14151454 / +0.4% 21083663 / 20680411 / +1.9% 0.67 / 0.68 / -1.6%
tpcds_q33/duckdb:parquet 23819525 / 23503816 / +1.3% 28852954 / 28830085 / +0.1% 0.83 / 0.82 / +1.3%
tpcds_q34/duckdb:parquet 17287376 / 18387020 / -6.0% 24224959 / 24043400 / +0.8% 0.71 / 0.76 / -6.7%
tpcds_q35/duckdb:parquet 35084684 / 35613044 / -1.5% 43963619 / 44361838 / -0.9% 0.80 / 0.80 / -0.6%
tpcds_q36/duckdb:parquet 39529283 / 42335787 / -6.6% 47633901 / 47785750 / -0.3% 0.83 / 0.89 / -6.3%
tpcds_q37/duckdb:parquet 12666584 / 12611308 / +0.4% 19339661 / 19314828 / +0.1% 0.65 / 0.65 / +0.3%
tpcds_q38/duckdb:parquet 29904834 / 29538285 / +1.2% 34184003 / 33729568 / +1.3% 0.87 / 0.88 / -0.1%
tpcds_q39/duckdb:parquet 23559131 / 23310860 / +1.1% 30463928 / 30054415 / +1.4% 0.77 / 0.78 / -0.3%
tpcds_q40/duckdb:parquet 15972754 / 15917991 / +0.3% 21489377 / 21477832 / +0.1% 0.74 / 0.74 / +0.3%
tpcds_q41/duckdb:parquet 12096238 / 11846480 / +2.1% 18373853 / 18072072 / +1.7% 0.66 / 0.66 / +0.4%
tpcds_q42/duckdb:parquet 9680782 / 9500457 / +1.9% 15632147 / 15193403 / +2.9% 0.62 / 0.63 / -1.0%
tpcds_q43/duckdb:parquet 12077986 / 11997976 / +0.7% 18340603 / 17817734 / +2.9% 0.66 / 0.67 / -2.2%
tpcds_q44/duckdb:parquet 21188652 / 21270910 / -0.4% 27217555 / 27803955 / -2.1% 0.78 / 0.77 / +1.8%
tpcds_q45/duckdb:parquet 21009696 / 20817216 / +0.9% 27465126 / 27895502 / -1.5% 0.76 / 0.75 / +2.5%
tpcds_q46/duckdb:parquet 37134602 / 37847588 / -1.9% 43468203 / 43436230 / +0.1% 0.85 / 0.87 / -2.0%
tpcds_q47/duckdb:parquet 34807081 / 34499506 / +0.9% 40849872 / 41131374 / -0.7% 0.85 / 0.84 / +1.6%
tpcds_q48/duckdb:parquet 29825739 / 28551023 / +4.5% 36454336 / 36618472 / -0.4% 0.82 / 0.78 / +4.9%
tpcds_q49/duckdb:parquet 30361531 / 28982140 / +4.8% 36459640 / 36899025 / -1.2% 0.83 / 0.79 / +6.0%
tpcds_q50/duckdb:parquet 19391490 / 19448953 / -0.3% 25744600 / 25425978 / +1.3% 0.75 / 0.76 / -1.5%
tpcds_q51/duckdb:parquet 52814126 / 51720222 / +2.1% 60344958 / 60791328 / -0.7% 0.88 / 0.85 / +2.9%
tpcds_q52/duckdb:parquet 9796034 / 9604584 / +2.0% 15614023 / 15688928 / -0.5% 0.63 / 0.61 / +2.5%
tpcds_q53/duckdb:parquet 15062210 / 13777479 / +9.3% 20911721 / 20645585 / +1.3% 0.72 / 0.67 / +7.9%
tpcds_q54/duckdb:parquet 24991652 / 24704058 / +1.2% 32026186 / 31968681 / +0.2% 0.78 / 0.77 / +1.0%
tpcds_q55/duckdb:parquet 9499605 / 9576810 / -0.8% 15480968 / 15146323 / +2.2% 0.61 / 0.63 / -3.0%
tpcds_q56/duckdb:parquet 25637758 / 26199279 / -2.1% 30893692 / 31230388 / -1.1% 0.83 / 0.84 / -1.1%
tpcds_q57/duckdb:parquet 30836733 / 30692586 / +0.5% 36563913 / 35733697 / +2.3% 0.84 / 0.86 / -1.8%
tpcds_q58/duckdb:parquet 24017310 / 24061200 / -0.2% 29743515 / 29937411 / -0.6% 0.81 / 0.80 / +0.5%
tpcds_q59/duckdb:parquet 22675304 / 22653866 / +0.1% 28875781 / 28741875 / +0.5% 0.79 / 0.79 / -0.4%
tpcds_q60/duckdb:parquet 28508469 / 28606143 / -0.3% 32265647 / 32511408 / -0.8% 0.88 / 0.88 / +0.4%
tpcds_q61/duckdb:parquet 24374778 / 24783622 / -1.6% 29553501 / 29286064 / +0.9% 0.82 / 0.85 / -2.5%
tpcds_q62/duckdb:parquet 12809472 / 12756632 / +0.4% 17851224 / 18016813 / -0.9% 0.72 / 0.71 / +1.3%
tpcds_q63/duckdb:parquet 13187748 / 13167075 / +0.2% 20030629 / 19627896 / +2.1% 0.66 / 0.67 / -1.9%
tpcds_q64/duckdb:parquet 70937092 / 70332196 / +0.9% 79862837 / 79898672 / -0.0% 0.89 / 0.88 / +0.9%
tpcds_q65/duckdb:parquet 19943374 / 19712448 / +1.2% 26064923 / 25557808 / +2.0% 0.77 / 0.77 / -0.8%
tpcds_q66/duckdb:parquet 33365469 / 33168506 / +0.6% 37890401 / 38268266 / -1.0% 0.88 / 0.87 / +1.6%
tpcds_q67/duckdb:parquet 61437832 / 60583596 / +1.4% 69641348 / 67118365 / +3.8% 0.88 / 0.90 / -2.3%
tpcds_q68/duckdb:parquet 28285982 / 28384108 / -0.3% 36178127 / 36234251 / -0.2% 0.78 / 0.78 / -0.2%
tpcds_q69/duckdb:parquet 26008962 / 25916971 / +0.4% 33960052 / 34186488 / -0.7% 0.77 / 0.76 / +1.0%
tpcds_q70/duckdb:parquet 19083026 / 19298662 / -1.1% 27132708 / 26964121 / +0.6% 0.70 / 0.72 / -1.7%
tpcds_q71/duckdb:parquet 17373008 / 16838646 / +3.2% 23859003 / 23898437 / -0.2% 0.73 / 0.70 / +3.3%
tpcds_q72/duckdb:parquet 53298730 / 52670348 / +1.2% 59042793 / 59222434 / -0.3% 0.90 / 0.89 / +1.5%
tpcds_q73/duckdb:parquet 14917215 / 15277827 / -2.4% 21833695 / 21330322 / +2.4% 0.68 / 0.72 / -4.6%
tpcds_q74/duckdb:parquet 84457216 / 84403742 / +0.1% 91357603 / 90793062 / +0.6% 0.92 / 0.93 / -0.6%
tpcds_q75/duckdb:parquet 43746248 / 45758096 / -4.4% 49893688 / 51227579 / -2.6% 0.88 / 0.89 / -1.8%
tpcds_q76/duckdb:parquet 18787582 / 19111945 / -1.7% 23366289 / 23651489 / -1.2% 0.80 / 0.81 / -0.5%
tpcds_q77/duckdb:parquet 26000058 / 25114661 / +3.5% 31548316 / 31183903 / +1.2% 0.82 / 0.81 / +2.3%
tpcds_q78/duckdb:parquet 77447158 / 78213693 / -1.0% 85379025 / 84710850 / +0.8% 0.91 / 0.92 / -1.8%
tpcds_q79/duckdb:parquet 24278608 / 22818478 / +6.4% 28536138 / 28675865 / -0.5% 0.85 / 0.80 / +6.9%
tpcds_q80/duckdb:parquet 38142390 / 38084688 / +0.2% 44283633 / 43905754 / +0.9% 0.86 / 0.87 / -0.7%
tpcds_q81/duckdb:parquet 36335597 / 36114452 / +0.6% 45159209 / 44674149 / +1.1% 0.80 / 0.81 / -0.5%
tpcds_q82/duckdb:parquet 13522504 / 13431422 / +0.7% 20188727 / 20484421 / -1.4% 0.67 / 0.66 / +2.2%
tpcds_q83/duckdb:parquet 20250090 / 20016020 / +1.2% 25144937 / 24837421 / +1.2% 0.81 / 0.81 / -0.1%
tpcds_q84/duckdb:parquet 22752780 / 22806443 / -0.2% 28814667 / 28776016 / +0.1% 0.79 / 0.79 / -0.4%
tpcds_q85/duckdb:parquet 32738453 / 32077430 / +2.1% 39536528 / 39504632 / +0.1% 0.83 / 0.81 / +2.0%
tpcds_q86/duckdb:parquet 11842019 / 11722304 / +1.0% 16744857 / 16860872 / -0.7% 0.71 / 0.70 / +1.7%
tpcds_q87/duckdb:parquet 31387698 / 31414421 / -0.1% 35546679 / 35159347 / +1.1% 0.88 / 0.89 / -1.2%
tpcds_q88/duckdb:parquet 37951488 / 38187692 / -0.6% 41738204 / 42610984 / -2.0% 0.91 / 0.90 / +1.5%
tpcds_q89/duckdb:parquet 14203030 / 15328942 / -7.3% 21201103 / 21620872 / -1.9% 0.67 / 0.71 / -5.5%
tpcds_q90/duckdb:parquet 10223610 / 9998867 / +2.2% 15556302 / 15240061 / +2.1% 0.66 / 0.66 / +0.2%
tpcds_q91/duckdb:parquet 21157026 / 21066494 / +0.4% 28182971 / 28347679 / -0.6% 0.75 / 0.74 / +1.0%
tpcds_q92/duckdb:parquet 15714280 / 15765522 / -0.3% 22407719 / 22031310 / +1.7% 0.70 / 0.72 / -2.0%
tpcds_q93/duckdb:parquet 14251366 / 14174594 / +0.5% 20053581 / 20222555 / -0.8% 0.71 / 0.70 / +1.4%
tpcds_q94/duckdb:parquet 25553872 / 25239802 / +1.2% 32682015 / 32756921 / -0.2% 0.78 / 0.77 / +1.5%
tpcds_q95/duckdb:parquet 43805424 / 44035276 / -0.5% 49582128 / 50061727 / -1.0% 0.88 / 0.88 / +0.4%
tpcds_q96/duckdb:parquet 8187221 / 8200122 / -0.2% 13862523 / 13736674 / +0.9% 0.59 / 0.60 / -1.1%
tpcds_q97/duckdb:parquet 27449140 / 27582790 / -0.5% 34043202 / 33982058 / +0.2% 0.81 / 0.81 / -0.7%
tpcds_q98/duckdb:parquet 16609988 / 16429147 / +1.1% 23067571 / 22724400 / +1.5% 0.72 / 0.72 / -0.4%
tpcds_q99/duckdb:parquet 18729736 / 18805868 / -0.4% 24663817 / 24735012 / -0.3% 0.76 / 0.76 / -0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.978x ➖
Parquet (geomean): hot 0.988x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1217384 / 1267153 / -3.9% 23116393 / 24036027 / -3.8% 0.05 / 0.05 / -0.1%
clickbench_q01/datafusion:vortex-file-compressed 9120396 / 8970344 / +1.7% 37868056 / 31943033 / +18.5% 🔴 0.24 / 0.28 / -14.2%
clickbench_q02/datafusion:vortex-file-compressed 13542224 / 13362432 / +1.3% 48235689 / 48781441 / -1.1% 0.28 / 0.27 / +2.5%
clickbench_q03/datafusion:vortex-file-compressed 13845195 / 13839250 / +0.0% 51050206 / 53494831 / -4.6% 0.27 / 0.26 / +4.8%
clickbench_q04/datafusion:vortex-file-compressed 60034304 / 58390786 / +2.8% 100028692 / 103899706 / -3.7% 0.60 / 0.56 / +6.8%
clickbench_q05/datafusion:vortex-file-compressed 79611713 / 81274972 / -2.0% 127344122 / 131730579 / -3.3% 0.63 / 0.62 / +1.3%
clickbench_q06/datafusion:vortex-file-compressed 1227325 / 1255366 / -2.2% 22871975 / 24504800 / -6.7% 0.05 / 0.05 / +4.7%
clickbench_q07/datafusion:vortex-file-compressed 12233698 / 12458902 / -1.8% 38248000 / 37105333 / +3.1% 0.32 / 0.34 / -4.7%
clickbench_q08/datafusion:vortex-file-compressed 82860304 / 83173606 / -0.4% 128884220 / 136880503 / -5.8% 0.64 / 0.61 / +5.8%
clickbench_q09/datafusion:vortex-file-compressed 176927636 / 177148416 / -0.1% 216668663 / 223706447 / -3.1% 0.82 / 0.79 / +3.1%
clickbench_q10/datafusion:vortex-file-compressed 24837888 / 24162881 / +2.8% 66733741 / 66462248 / +0.4% 0.37 / 0.36 / +2.4%
clickbench_q11/datafusion:vortex-file-compressed 26530794 / 27280956 / -2.7% 68006072 / 69070567 / -1.5% 0.39 / 0.39 / -1.2%
clickbench_q12/datafusion:vortex-file-compressed 77087326 / 75840524 / +1.6% 123430775 / 126051785 / -2.1% 0.62 / 0.60 / +3.8%
clickbench_q13/datafusion:vortex-file-compressed 117257940 / 121241805 / -3.3% 182231002 / 196753665 / -7.4% 0.64 / 0.62 / +4.4%
clickbench_q14/datafusion:vortex-file-compressed 77851742 / 77661064 / +0.2% 128626254 / 130753700 / -1.6% 0.61 / 0.59 / +1.9%
clickbench_q15/datafusion:vortex-file-compressed 65951893 / 66233480 / -0.4% 106554124 / 111267910 / -4.2% 0.62 / 0.60 / +4.0%
clickbench_q16/datafusion:vortex-file-compressed 156191605 / 158215728 / -1.3% 218639281 / 216986636 / +0.8% 0.71 / 0.73 / -2.0%
clickbench_q17/datafusion:vortex-file-compressed 157914118 / 160083673 / -1.4% 218828091 / 228855691 / -4.4% 0.72 / 0.70 / +3.2%
clickbench_q18/datafusion:vortex-file-compressed 301082343 / 303694352 / -0.9% 378787906 / 392832690 / -3.6% 0.79 / 0.77 / +2.8%
clickbench_q19/datafusion:vortex-file-compressed 9783766 / 10198920 / -4.1% 44778006 / 49233225 / -9.0% 0.22 / 0.21 / +5.5%
clickbench_q20/datafusion:vortex-file-compressed 47384968 / 47268364 / +0.2% 235274165 / 234218782 / +0.5% 0.20 / 0.20 / -0.2%
clickbench_q21/datafusion:vortex-file-compressed 56818340 / 58128786 / -2.3% 274902068 / 278098286 / -1.1% 0.21 / 0.21 / -1.1%
clickbench_q22/datafusion:vortex-file-compressed 76368598 / 77905718 / -2.0% 383232033 / 379717849 / +0.9% 0.20 / 0.21 / -2.9%
clickbench_q23/datafusion:vortex-file-compressed 104283868 / 91749216 / +13.7% 🔴 362499551 / 356953233 / +1.6% 0.29 / 0.26 / +11.9%
clickbench_q24/datafusion:vortex-file-compressed 8697654 / 8772579 / -0.9% 53709514 / 56275625 / -4.6% 0.16 / 0.16 / +3.9%
clickbench_q25/datafusion:vortex-file-compressed 20664990 / 20427477 / +1.2% 65368703 / 65502134 / -0.2% 0.32 / 0.31 / +1.4%
clickbench_q26/datafusion:vortex-file-compressed 14918629 / 14637094 / +1.9% 71573454 / 66990640 / +6.8% 0.21 / 0.22 / -4.6%
clickbench_q27/datafusion:vortex-file-compressed 104047456 / 102957136 / +1.1% 256969378 / 257493906 / -0.2% 0.40 / 0.40 / +1.3%
clickbench_q28/datafusion:vortex-file-compressed 555166112 / 560670097 / -1.0% 638992470 / 637826151 / +0.2% 0.87 / 0.88 / -1.2%
clickbench_q29/datafusion:vortex-file-compressed 26314304 / 26383149 / -0.3% 57527485 / 60799425 / -5.4% 0.46 / 0.43 / +5.4%
clickbench_q30/datafusion:vortex-file-compressed 60407578 / 60343391 / +0.1% 117780200 / 114296970 / +3.0% 0.51 / 0.53 / -2.9%
clickbench_q31/datafusion:vortex-file-compressed 69056258 / 68180661 / +1.3% 157345289 / 157215310 / +0.1% 0.44 / 0.43 / +1.2%
clickbench_q32/datafusion:vortex-file-compressed 299251496 / 292088070 / +2.5% 385973340 / 388708321 / -0.7% 0.78 / 0.75 / +3.2%
clickbench_q33/datafusion:vortex-file-compressed 324749360 / 323328270 / +0.4% 428622225 / 442657571 / -3.2% 0.76 / 0.73 / +3.7%
clickbench_q34/datafusion:vortex-file-compressed 323084636 / 326020272 / -0.9% 427181582 / 439432746 / -2.8% 0.76 / 0.74 / +1.9%
clickbench_q35/datafusion:vortex-file-compressed 62806192 / 62665812 / +0.2% 96599721 / 95756160 / +0.9% 0.65 / 0.65 / -0.7%
clickbench_q36/datafusion:vortex-file-compressed 37682782 / 37597980 / +0.2% 69692288 / 68626703 / +1.6% 0.54 / 0.55 / -1.3%
clickbench_q37/datafusion:vortex-file-compressed 20343431 / 20589600 / -1.2% 47969149 / 48776139 / -1.7% 0.42 / 0.42 / +0.5%
clickbench_q38/datafusion:vortex-file-compressed 12805793 / 12949682 / -1.1% 40596302 / 42250658 / -3.9% 0.32 / 0.31 / +2.9%
clickbench_q39/datafusion:vortex-file-compressed 79094310 / 79597738 / -0.6% 114634279 / 114362702 / +0.2% 0.69 / 0.70 / -0.9%
clickbench_q40/datafusion:vortex-file-compressed 10180440 / 10435612 / -2.4% 37182924 / 37311987 / -0.3% 0.27 / 0.28 / -2.1%
clickbench_q41/datafusion:vortex-file-compressed 9577580 / 9494610 / +0.9% 36392096 / 34957701 / +4.1% 0.26 / 0.27 / -3.1%
clickbench_q42/datafusion:vortex-file-compressed 9905680 / 9962244 / -0.6% 37131464 / 35540497 / +4.5% 0.27 / 0.28 / -4.8%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1247702 / 1241134 / +0.5% 49608055 / 49839332 / -0.5% 0.03 / 0.02 / +1.0%
clickbench_q01/datafusion:parquet 16039842 / 16181457 / -0.9% 67751071 / 74263654 / -8.8% 0.24 / 0.22 / +8.7%
clickbench_q02/datafusion:parquet 18871057 / 19370602 / -2.6% 81171131 / 80540945 / +0.8% 0.23 / 0.24 / -3.3%
clickbench_q03/datafusion:parquet 16782802 / 17538883 / -4.3% 76482302 / 81150959 / -5.8% 0.22 / 0.22 / +1.5%
clickbench_q04/datafusion:parquet 64412092 / 62570188 / +2.9% 127605793 / 123402943 / +3.4% 0.50 / 0.51 / -0.4%
clickbench_q05/datafusion:parquet 87650483 / 88486426 / -0.9% 151623511 / 155102865 / -2.2% 0.58 / 0.57 / +1.3%
clickbench_q06/datafusion:parquet 1262507 / 1238631 / +1.9% 49535434 / 49977331 / -0.9% 0.03 / 0.02 / +2.8%
clickbench_q07/datafusion:parquet 16717288 / 16723302 / -0.0% 68524363 / 66923822 / +2.4% 0.24 / 0.25 / -2.4%
clickbench_q08/datafusion:parquet 85970516 / 84318256 / +2.0% 156396499 / 157686567 / -0.8% 0.55 / 0.53 / +2.8%
clickbench_q09/datafusion:parquet 187530272 / 190556540 / -1.6% 269382834 / 265113573 / +1.6% 0.70 / 0.72 / -3.1%
clickbench_q10/datafusion:parquet 36064040 / 36166815 / -0.3% 101766593 / 100991387 / +0.8% 0.35 / 0.36 / -1.0%
clickbench_q11/datafusion:parquet 42741452 / 42536372 / +0.5% 109404562 / 110725170 / -1.2% 0.39 / 0.38 / +1.7%
clickbench_q12/datafusion:parquet 95734552 / 95207434 / +0.6% 163448805 / 162573788 / +0.5% 0.59 / 0.59 / +0.0%
clickbench_q13/datafusion:parquet 148556090 / 148458750 / +0.1% 225254437 / 229350661 / -1.8% 0.66 / 0.65 / +1.9%
clickbench_q14/datafusion:parquet 99675412 / 102421268 / -2.7% 169405606 / 176560215 / -4.1% 0.59 / 0.58 / +1.4%
clickbench_q15/datafusion:parquet 70266062 / 71016342 / -1.1% 131001402 / 132395676 / -1.1% 0.54 / 0.54 / -0.0%
clickbench_q16/datafusion:parquet 155322093 / 155796120 / -0.3% 239590351 / 235894989 / +1.6% 0.65 / 0.66 / -1.8%
clickbench_q17/datafusion:parquet 155287178 / 157498196 / -1.4% 234147675 / 237082548 / -1.2% 0.66 / 0.66 / -0.2%
clickbench_q18/datafusion:parquet 309395704 / 313662826 / -1.4% 419071408 / 424237465 / -1.2% 0.74 / 0.74 / -0.1%
clickbench_q19/datafusion:parquet 19057382 / 19107441 / -0.3% 77677816 / 77171331 / +0.7% 0.25 / 0.25 / -0.9%
clickbench_q20/datafusion:parquet 178181498 / 179926882 / -1.0% 277298874 / 284640986 / -2.6% 0.64 / 0.63 / +1.7%
clickbench_q21/datafusion:parquet 173596374 / 174665781 / -0.6% 291514905 / 299976599 / -2.8% 0.60 / 0.58 / +2.3%
clickbench_q22/datafusion:parquet 262062851 / 258904787 / +1.2% 414275916 / 430462629 / -3.8% 0.63 / 0.60 / +5.2%
clickbench_q23/datafusion:parquet 1008643780 / 1006954526 / +0.2% 1185926460 / 1185879000 / +0.0% 0.85 / 0.85 / +0.2%
clickbench_q24/datafusion:parquet 29595948 / 30150070 / -1.8% 86757677 / 90269263 / -3.9% 0.34 / 0.33 / +2.1%
clickbench_q25/datafusion:parquet 36557540 / 37128882 / -1.5% 101741543 / 102925612 / -1.2% 0.36 / 0.36 / -0.4%
clickbench_q26/datafusion:parquet 30340408 / 30603660 / -0.9% 87470561 / 90233629 / -3.1% 0.35 / 0.34 / +2.3%
clickbench_q27/datafusion:parquet 192781690 / 194373944 / -0.8% 286999495 / 285630725 / +0.5% 0.67 / 0.68 / -1.3%
clickbench_q28/datafusion:parquet 619033930 / 615353231 / +0.6% 697965425 / 709094109 / -1.6% 0.89 / 0.87 / +2.2%
clickbench_q29/datafusion:parquet 28549970 / 28654558 / -0.4% 91227621 / 92031093 / -0.9% 0.31 / 0.31 / +0.5%
clickbench_q30/datafusion:parquet 89999098 / 91880723 / -2.0% 179616072 / 174388901 / +3.0% 0.50 / 0.53 / -4.9%
clickbench_q31/datafusion:parquet 101743262 / 103544378 / -1.7% 190940281 / 198195188 / -3.7% 0.53 / 0.52 / +2.0%
clickbench_q32/datafusion:parquet 304876097 / 308174972 / -1.1% 426711129 / 424797501 / +0.5% 0.71 / 0.73 / -1.5%
clickbench_q33/datafusion:parquet 377060338 / 378104617 / -0.3% 471261238 / 479346205 / -1.7% 0.80 / 0.79 / +1.4%
clickbench_q34/datafusion:parquet 374518898 / 378660916 / -1.1% 474619471 / 478690635 / -0.9% 0.79 / 0.79 / -0.2%
clickbench_q35/datafusion:parquet 64605082 / 64065576 / +0.8% 121887363 / 128300748 / -5.0% 0.53 / 0.50 / +6.1%
clickbench_q36/datafusion:parquet 73738504 / 74221746 / -0.7% 136439908 / 134685358 / +1.3% 0.54 / 0.55 / -1.9%
clickbench_q37/datafusion:parquet 35787568 / 35938828 / -0.4% 92660611 / 90703364 / +2.2% 0.39 / 0.40 / -2.5%
clickbench_q38/datafusion:parquet 47551573 / 48109404 / -1.2% 107335469 / 109165912 / -1.7% 0.44 / 0.44 / +0.5%
clickbench_q39/datafusion:parquet 143814412 / 144640912 / -0.6% 209970373 / 214162127 / -2.0% 0.68 / 0.68 / +1.4%
clickbench_q40/datafusion:parquet 20212963 / 20267500 / -0.3% 77734711 / 77542458 / +0.2% 0.26 / 0.26 / -0.5%
clickbench_q41/datafusion:parquet 18701583 / 19126163 / -2.2% 76203027 / 75851192 / +0.5% 0.25 / 0.25 / -2.7%
clickbench_q42/datafusion:parquet 19125530 / 19226486 / -0.5% 76286229 / 75461928 / +1.1% 0.25 / 0.25 / -1.6%
duckdb / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2203334 / 2205072 / -0.1% 26066768 / 25392913 / +2.7% 0.08 / 0.09 / -2.7%
clickbench_q01/duckdb:vortex-file-compressed 7128648 / 7020426 / +1.5% 27108691 / 26902018 / +0.8% 0.26 / 0.26 / +0.8%
clickbench_q02/duckdb:vortex-file-compressed 9171234 / 9265933 / -1.0% 32837803 / 37755094 / -13.0% 🟢 0.28 / 0.25 / +13.8%
clickbench_q03/duckdb:vortex-file-compressed 13922490 / 14112633 / -1.3% 45246503 / 45923886 / -1.5% 0.31 / 0.31 / +0.1%
clickbench_q04/duckdb:vortex-file-compressed 54688340 / 56210718 / -2.7% 84641295 / 88450789 / -4.3% 0.65 / 0.64 / +1.7%
clickbench_q05/duckdb:vortex-file-compressed 63457940 / 65679400 / -3.4% 92497549 / 92395032 / +0.1% 0.69 / 0.71 / -3.5%
clickbench_q06/duckdb:vortex-file-compressed 2612616 / 2679487 / -2.5% 31448032 / 31340331 / +0.3% 0.08 / 0.09 / -2.8%
clickbench_q07/duckdb:vortex-file-compressed 9751844 / 9631018 / +1.3% 30177956 / 32291861 / -6.5% 0.32 / 0.30 / +8.3%
clickbench_q08/duckdb:vortex-file-compressed 68395110 / 70568556 / -3.1% 100537549 / 104263839 / -3.6% 0.68 / 0.68 / +0.5%
clickbench_q09/duckdb:vortex-file-compressed 88762020 / 95288196 / -6.8% 116501043 / 127127530 / -8.4% 0.76 / 0.75 / +1.6%
clickbench_q10/duckdb:vortex-file-compressed 27218985 / 27641215 / -1.5% 59604392 / 69316661 / -14.0% 🟢 0.46 / 0.40 / +14.5%
clickbench_q11/duckdb:vortex-file-compressed 30080285 / 31090082 / -3.2% 65884772 / 71466605 / -7.8% 0.46 / 0.44 / +4.9%
clickbench_q12/duckdb:vortex-file-compressed 68171184 / 71714680 / -4.9% 98255625 / 100909240 / -2.6% 0.69 / 0.71 / -2.4%
clickbench_q13/duckdb:vortex-file-compressed 118502923 / 119764578 / -1.1% 155919783 / 164618470 / -5.3% 0.76 / 0.73 / +4.5%
clickbench_q14/duckdb:vortex-file-compressed 73510725 / 73434424 / +0.1% 99466070 / 101441353 / -1.9% 0.74 / 0.72 / +2.1%
clickbench_q15/duckdb:vortex-file-compressed 75728294 / 76194339 / -0.6% 102970321 / 108733483 / -5.3% 0.74 / 0.70 / +5.0%
clickbench_q16/duckdb:vortex-file-compressed 138093536 / 136842268 / +0.9% 166516820 / 169124802 / -1.5% 0.83 / 0.81 / +2.5%
clickbench_q17/duckdb:vortex-file-compressed 139378619 / 141872532 / -1.8% 167669660 / 167654300 / +0.0% 0.83 / 0.85 / -1.8%
clickbench_q18/duckdb:vortex-file-compressed 256191328 / 260000492 / -1.5% 296827663 / 305840288 / -2.9% 0.86 / 0.85 / +1.5%
clickbench_q19/duckdb:vortex-file-compressed 9351478 / 8810469 / +6.1% 35565038 / 36020161 / -1.3% 0.26 / 0.24 / +7.5%
clickbench_q20/duckdb:vortex-file-compressed 50697826 / 51534784 / -1.6% 153379508 / 160397962 / -4.4% 0.33 / 0.32 / +2.9%
clickbench_q21/duckdb:vortex-file-compressed 56682746 / 57695962 / -1.8% 174459637 / 179563401 / -2.8% 0.32 / 0.32 / +1.1%
clickbench_q22/duckdb:vortex-file-compressed 88113350 / 89827668 / -1.9% 289662243 / 290845478 / -0.4% 0.30 / 0.31 / -1.5%
clickbench_q23/duckdb:vortex-file-compressed 62764792 / 70826048 / -11.4% 🟢 156356094 / 150764164 / +3.7% 0.40 / 0.47 / -14.6%
clickbench_q24/duckdb:vortex-file-compressed 16864408 / 17306496 / -2.6% 41355674 / 41279781 / +0.2% 0.41 / 0.42 / -2.7%
clickbench_q25/duckdb:vortex-file-compressed 18623007 / 19466330 / -4.3% 50868643 / 53969172 / -5.7% 0.37 / 0.36 / +1.5%
clickbench_q26/duckdb:vortex-file-compressed 13446610 / 14298159 / -6.0% 41782608 / 46980314 / -11.1% 🟢 0.32 / 0.30 / +5.7%
clickbench_q27/duckdb:vortex-file-compressed 50294552 / 51719395 / -2.8% 169939696 / 174007789 / -2.3% 0.30 / 0.30 / -0.4%
clickbench_q28/duckdb:vortex-file-compressed 512219530 / 520615130 / -1.6% 545991858 / 553911015 / -1.4% 0.94 / 0.94 / -0.2%
clickbench_q29/duckdb:vortex-file-compressed 17302306 / 17403831 / -0.6% 43195749 / 45526305 / -5.1% 0.40 / 0.38 / +4.8%
clickbench_q30/duckdb:vortex-file-compressed 59562968 / 60778994 / -2.0% 100182867 / 111272218 / -10.0% 0.59 / 0.55 / +8.8%
clickbench_q31/duckdb:vortex-file-compressed 110182074 / 110374704 / -0.2% 161964836 / 174380127 / -7.1% 0.68 / 0.63 / +7.5%
clickbench_q32/duckdb:vortex-file-compressed 362815333 / 373001534 / -2.7% 396854252 / 405349871 / -2.1% 0.91 / 0.92 / -0.6%
clickbench_q33/duckdb:vortex-file-compressed 339826575 / 355724650 / -4.5% 398429195 / 413358008 / -3.6% 0.85 / 0.86 / -0.9%
clickbench_q34/duckdb:vortex-file-compressed 357329378 / 353685646 / +1.0% 418781888 / 411106677 / +1.9% 0.85 / 0.86 / -0.8%
clickbench_q35/duckdb:vortex-file-compressed 58779954 / 58438667 / +0.6% 85667352 / 87188613 / -1.7% 0.69 / 0.67 / +2.4%
clickbench_q36/duckdb:vortex-file-compressed 11190602 / 11197437 / -0.1% 34209055 / 35690441 / -4.2% 0.33 / 0.31 / +4.3%
clickbench_q37/duckdb:vortex-file-compressed 7741550 / 7548016 / +2.6% 29695379 / 28986524 / +2.4% 0.26 / 0.26 / +0.1%
clickbench_q38/duckdb:vortex-file-compressed 8031694 / 8130786 / -1.2% 28959230 / 31183514 / -7.1% 0.28 / 0.26 / +6.4%
clickbench_q39/duckdb:vortex-file-compressed 17828670 / 17829612 / -0.0% 41482751 / 43265099 / -4.1% 0.43 / 0.41 / +4.3%
clickbench_q40/duckdb:vortex-file-compressed 6746550 / 6914176 / -2.4% 28425854 / 29559596 / -3.8% 0.24 / 0.23 / +1.5%
clickbench_q41/duckdb:vortex-file-compressed 7874414 / 7813494 / +0.8% 28595959 / 29291129 / -2.4% 0.28 / 0.27 / +3.2%
clickbench_q42/duckdb:vortex-file-compressed 6973730 / 7027268 / -0.8% 28452038 / 26746733 / +6.4% 0.25 / 0.26 / -6.7%
duckdb / parquet / ns (0.981x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9195744 / 9514360 / -3.3% 14638457 / 14613052 / +0.2% 0.63 / 0.65 / -3.5%
clickbench_q01/duckdb:parquet 14701586 / 15075554 / -2.5% 19948672 / 21017608 / -5.1% 0.74 / 0.72 / +2.7%
clickbench_q02/duckdb:parquet 22163314 / 22687573 / -2.3% 30989391 / 29867341 / +3.8% 0.72 / 0.76 / -5.8%
clickbench_q03/duckdb:parquet 22563488 / 23499195 / -4.0% 32246873 / 33131413 / -2.7% 0.70 / 0.71 / -1.3%
clickbench_q04/duckdb:parquet 59816382 / 61529590 / -2.8% 73753355 / 73746304 / +0.0% 0.81 / 0.83 / -2.8%
clickbench_q05/duckdb:parquet 81303385 / 83393120 / -2.5% 92083338 / 96674644 / -4.7% 0.88 / 0.86 / +2.4%
clickbench_q06/duckdb:parquet 21047979 / 20687098 / +1.7% 29099716 / 26656595 / +9.2% 0.72 / 0.78 / -6.8%
clickbench_q07/duckdb:parquet 16749804 / 17530655 / -4.5% 24151843 / 25883177 / -6.7% 0.69 / 0.68 / +2.4%
clickbench_q08/duckdb:parquet 73341649 / 75896575 / -3.4% 86270977 / 89123144 / -3.2% 0.85 / 0.85 / -0.2%
clickbench_q09/duckdb:parquet 102659154 / 102615510 / +0.0% 119168346 / 118716617 / +0.4% 0.86 / 0.86 / -0.3%
clickbench_q10/duckdb:parquet 40869386 / 41681130 / -1.9% 55387902 / 53661579 / +3.2% 0.74 / 0.78 / -5.0%
clickbench_q11/duckdb:parquet 46265089 / 46842001 / -1.2% 61306528 / 63045194 / -2.8% 0.75 / 0.74 / +1.6%
clickbench_q12/duckdb:parquet 90676213 / 94078794 / -3.6% 103890851 / 109289709 / -4.9% 0.87 / 0.86 / +1.4%
clickbench_q13/duckdb:parquet 149274766 / 150113635 / -0.6% 168431167 / 166274607 / +1.3% 0.89 / 0.90 / -1.8%
clickbench_q14/duckdb:parquet 101364889 / 101069434 / +0.3% 115799217 / 120914938 / -4.2% 0.88 / 0.84 / +4.7%
clickbench_q15/duckdb:parquet 86771442 / 86777807 / -0.0% 99418820 / 104833088 / -5.2% 0.87 / 0.83 / +5.4%
clickbench_q16/duckdb:parquet 161047084 / 163672108 / -1.6% 174838593 / 181026510 / -3.4% 0.92 / 0.90 / +1.9%
clickbench_q17/duckdb:parquet 161573388 / 165378248 / -2.3% 177650168 / 203039288 / -12.5% 🟢 0.91 / 0.81 / +11.7%
clickbench_q18/duckdb:parquet 292392174 / 295276836 / -1.0% 317352734 / 320137919 / -0.9% 0.92 / 0.92 / -0.1%
clickbench_q19/duckdb:parquet 19745728 / 20004563 / -1.3% 25750926 / 27091245 / -4.9% 0.77 / 0.74 / +3.8%
clickbench_q20/duckdb:parquet 180583774 / 185990814 / -2.9% 227604488 / 224312081 / +1.5% 0.79 / 0.83 / -4.3%
clickbench_q21/duckdb:parquet 224986912 / 230716244 / -2.5% 265624930 / 260909155 / +1.8% 0.85 / 0.88 / -4.2%
clickbench_q22/duckdb:parquet 309918862 / 313064184 / -1.0% 370434744 / 358033037 / +3.5% 0.84 / 0.87 / -4.3%
clickbench_q23/duckdb:parquet 173660454 / 170319132 / +2.0% 255466164 / 234598921 / +8.9% 0.68 / 0.73 / -6.4%
clickbench_q24/duckdb:parquet 28906014 / 30023448 / -3.7% 41191847 / 43491100 / -5.3% 0.70 / 0.69 / +1.7%
clickbench_q25/duckdb:parquet 40820114 / 42424526 / -3.8% 58585332 / 63259000 / -7.4% 0.70 / 0.67 / +3.9%
clickbench_q26/duckdb:parquet 30028440 / 31092795 / -3.4% 45187690 / 44528812 / +1.5% 0.66 / 0.70 / -4.8%
clickbench_q27/duckdb:parquet 192797410 / 191426239 / +0.7% 225063007 / 228278131 / -1.4% 0.86 / 0.84 / +2.2%
clickbench_q28/duckdb:parquet 941443698 / 970414806 / -3.0% 938718184 / 943803215 / -0.5% 1.00 / 1.03 / -2.5%
clickbench_q29/duckdb:parquet 23408629 / 24833638 / -5.7% 30364004 / 31724807 / -4.3% 0.77 / 0.78 / -1.5%
clickbench_q30/duckdb:parquet 104909160 / 107710020 / -2.6% 125568389 / 126913914 / -1.1% 0.84 / 0.85 / -1.6%
clickbench_q31/duckdb:parquet 145766236 / 156886834 / -7.1% 169284525 / 175002698 / -3.3% 0.86 / 0.90 / -3.9%
clickbench_q32/duckdb:parquet 385682886 / 390581060 / -1.3% 416322704 / 409899294 / +1.6% 0.93 / 0.95 / -2.8%
clickbench_q33/duckdb:parquet 473096242 / 488827754 / -3.2% 443366323 / 448618569 / -1.2% 1.07 / 1.09 / -2.1%
clickbench_q34/duckdb:parquet 470680975 / 477613692 / -1.5% 470640519 / 469742152 / +0.2% 1.00 / 1.02 / -1.6%
clickbench_q35/duckdb:parquet 60335466 / 60872367 / -0.9% 73428335 / 74897013 / -2.0% 0.82 / 0.81 / +1.1%
clickbench_q36/duckdb:parquet 30127092 / 30728875 / -2.0% 35445627 / 35963023 / -1.4% 0.85 / 0.85 / -0.5%
clickbench_q37/duckdb:parquet 23305455 / 23024320 / +1.2% 29133537 / 29917780 / -2.6% 0.80 / 0.77 / +3.9%
clickbench_q38/duckdb:parquet 23460670 / 23403182 / +0.2% 28528260 / 29933599 / -4.7% 0.82 / 0.78 / +5.2%
clickbench_q39/duckdb:parquet 52679904 / 53912046 / -2.3% 60967112 / 60858419 / +0.2% 0.86 / 0.89 / -2.5%
clickbench_q40/duckdb:parquet 14352756 / 14469288 / -0.8% 20431681 / 19946378 / +2.4% 0.70 / 0.73 / -3.2%
clickbench_q41/duckdb:parquet 15373524 / 15136037 / +1.6% 21333694 / 20936258 / +1.9% 0.72 / 0.72 / -0.3%
clickbench_q42/duckdb:parquet 13999828 / 14178397 / -1.3% 21057684 / 20462121 / +2.9% 0.66 / 0.69 / -4.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.012x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 99313384 / 100133964 / -0.8% 143306828 / 153722004 / -6.8% 0.69 / 0.65 / +6.4%
tpch_q02/datafusion:vortex-compact 66373868 / 65774467 / +0.9% 97256631 / 93177386 / +4.4% 0.68 / 0.71 / -3.3%
tpch_q03/datafusion:vortex-compact 68307976 / 68236082 / +0.1% 120912989 / 115081601 / +5.1% 0.56 / 0.59 / -4.7%
tpch_q04/datafusion:vortex-compact 38433821 / 38484297 / -0.1% 66915060 / 66632849 / +0.4% 0.57 / 0.58 / -0.6%
tpch_q05/datafusion:vortex-compact 119987345 / 121658063 / -1.4% 171832801 / 181037340 / -5.1% 0.70 / 0.67 / +3.9%
tpch_q06/datafusion:vortex-compact 15788890 / 16228079 / -2.7% 50186766 / 53748496 / -6.6% 0.31 / 0.30 / +4.2%
tpch_q07/datafusion:vortex-compact 102630368 / 104700239 / -2.0% 154157489 / 155468836 / -0.8% 0.67 / 0.67 / -1.1%
tpch_q08/datafusion:vortex-compact 144601807 / 148450311 / -2.6% 251945920 / 212626535 / +18.5% 🔴 0.57 / 0.70 / -17.8%
tpch_q09/datafusion:vortex-compact 189941584 / 187558905 / +1.3% 249696723 / 262748116 / -5.0% 0.76 / 0.71 / +6.6%
tpch_q10/datafusion:vortex-compact 76970412 / 77282831 / -0.4% 135034281 / 127249583 / +6.1% 0.57 / 0.61 / -6.1%
tpch_q11/datafusion:vortex-compact 45729971 / 45972856 / -0.5% 73026167 / 69766641 / +4.7% 0.63 / 0.66 / -5.0%
tpch_q12/datafusion:vortex-compact 48184790 / 48993505 / -1.7% 82879507 / 85619020 / -3.2% 0.58 / 0.57 / +1.6%
tpch_q13/datafusion:vortex-compact 57094089 / 57189220 / -0.2% 94090048 / 81761594 / +15.1% 🔴 0.61 / 0.70 / -13.2%
tpch_q14/datafusion:vortex-compact 24349416 / 25478551 / -4.4% 95993270 / 87909509 / +9.2% 0.25 / 0.29 / -12.5%
tpch_q15/datafusion:vortex-compact 47043878 / 48904784 / -3.8% 101089103 / 101428614 / -0.3% 0.47 / 0.48 / -3.5%
tpch_q16/datafusion:vortex-compact 38034028 / 38066981 / -0.1% 68331139 / 65129996 / +4.9% 0.56 / 0.58 / -4.8%
tpch_q17/datafusion:vortex-compact 178709733 / 181948821 / -1.8% 217218161 / 224409080 / -3.2% 0.82 / 0.81 / +1.5%
tpch_q18/datafusion:vortex-compact 208866512 / 206149611 / +1.3% 269729342 / 259726168 / +3.9% 0.77 / 0.79 / -2.4%
tpch_q19/datafusion:vortex-compact 32666408 / 33363273 / -2.1% 81593770 / 81985391 / -0.5% 0.40 / 0.41 / -1.6%
tpch_q20/datafusion:vortex-compact 66854180 / 66758869 / +0.1% 112004921 / 115954763 / -3.4% 0.60 / 0.58 / +3.7%
tpch_q21/datafusion:vortex-compact 185919796 / 188584188 / -1.4% 234744949 / 231927100 / +1.2% 0.79 / 0.81 / -2.6%
tpch_q22/datafusion:vortex-compact 27364008 / 26970377 / +1.5% 54946751 / 53940175 / +1.9% 0.50 / 0.50 / -0.4%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87555552 / 87286291 / +0.3% 124907488 / 126242563 / -1.1% 0.70 / 0.69 / +1.4%
tpch_q02/datafusion:parquet 174575097 / 173611677 / +0.6% 201968539 / 203492440 / -0.7% 0.86 / 0.85 / +1.3%
tpch_q03/datafusion:parquet 135500466 / 136096582 / -0.4% 186225227 / 183581650 / +1.4% 0.73 / 0.74 / -1.9%
tpch_q04/datafusion:parquet 57213417 / 57399641 / -0.3% 93318619 / 88377141 / +5.6% 0.61 / 0.65 / -5.6%
tpch_q05/datafusion:parquet 169164518 / 168690615 / +0.3% 226668600 / 220751921 / +2.7% 0.75 / 0.76 / -2.3%
tpch_q06/datafusion:parquet 36319146 / 36645027 / -0.9% 76415638 / 73373517 / +4.1% 0.48 / 0.50 / -4.8%
tpch_q07/datafusion:parquet 216974581 / 214016265 / +1.4% 267736310 / 264623175 / +1.2% 0.81 / 0.81 / +0.2%
tpch_q08/datafusion:parquet 219621195 / 218163189 / +0.7% 288775058 / 286518815 / +0.8% 0.76 / 0.76 / -0.1%
tpch_q09/datafusion:parquet 308100325 / 309852176 / -0.6% 373417646 / 371877830 / +0.4% 0.83 / 0.83 / -1.0%
tpch_q10/datafusion:parquet 311324824 / 311852571 / -0.2% 375409255 / 369356014 / +1.6% 0.83 / 0.84 / -1.8%
tpch_q11/datafusion:parquet 127364194 / 128293317 / -0.7% 150783556 / 150514082 / +0.2% 0.84 / 0.85 / -0.9%
tpch_q12/datafusion:parquet 82925604 / 82599131 / +0.4% 120015185 / 116757410 / +2.8% 0.69 / 0.71 / -2.3%
tpch_q13/datafusion:parquet 210269869 / 210786898 / -0.2% 241642962 / 239725596 / +0.8% 0.87 / 0.88 / -1.0%
tpch_q14/datafusion:parquet 86535239 / 88239915 / -1.9% 189561873 / 188275933 / +0.7% 0.46 / 0.47 / -2.6%
tpch_q15/datafusion:parquet 106002318 / 106561658 / -0.5% 154185503 / 151442282 / +1.8% 0.69 / 0.70 / -2.3%
tpch_q16/datafusion:parquet 95821419 / 97241953 / -1.5% 122018938 / 121045018 / +0.8% 0.79 / 0.80 / -2.2%
tpch_q17/datafusion:parquet 215569988 / 216243106 / -0.3% 266163842 / 262686085 / +1.3% 0.81 / 0.82 / -1.6%
tpch_q18/datafusion:parquet 271116806 / 268699122 / +0.9% 313422455 / 317519737 / -1.3% 0.87 / 0.85 / +2.2%
tpch_q19/datafusion:parquet 108165772 / 108940968 / -0.7% 166889390 / 164811331 / +1.3% 0.65 / 0.66 / -1.9%
tpch_q20/datafusion:parquet 185799061 / 186121494 / -0.2% 243093669 / 243860778 / -0.3% 0.76 / 0.76 / +0.1%
tpch_q21/datafusion:parquet 242135641 / 245630597 / -1.4% 314231376 / 311414845 / +0.9% 0.77 / 0.79 / -2.3%
tpch_q22/datafusion:parquet 150038859 / 149541220 / +0.3% 172283504 / 169398997 / +1.7% 0.87 / 0.88 / -1.3%
duckdb / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 44890236 / 45038647 / -0.3% 77932266 / 79665867 / -2.2% 0.58 / 0.57 / +1.9%
tpch_q02/duckdb:vortex-compact 31463789 / 31748437 / -0.9% 45781067 / 47580105 / -3.8% 0.69 / 0.67 / +3.0%
tpch_q03/duckdb:vortex-compact 58630496 / 58485730 / +0.2% 96762988 / 97493614 / -0.7% 0.61 / 0.60 / +1.0%
tpch_q04/duckdb:vortex-compact 53482865 / 54186909 / -1.3% 81385330 / 81526632 / -0.2% 0.66 / 0.66 / -1.1%
tpch_q05/duckdb:vortex-compact 73481178 / 73197214 / +0.4% 111096594 / 112200835 / -1.0% 0.66 / 0.65 / +1.4%
tpch_q06/duckdb:vortex-compact 20246295 / 19966350 / +1.4% 51750751 / 50884355 / +1.7% 0.39 / 0.39 / -0.3%
tpch_q07/duckdb:vortex-compact 64603480 / 63559472 / +1.6% 105944203 / 107089133 / -1.1% 0.61 / 0.59 / +2.7%
tpch_q08/duckdb:vortex-compact 90363842 / 89878878 / +0.5% 126581922 / 126662313 / -0.1% 0.71 / 0.71 / +0.6%
tpch_q09/duckdb:vortex-compact 114477612 / 111041132 / +3.1% 155048037 / 155165971 / -0.1% 0.74 / 0.72 / +3.2%
tpch_q10/duckdb:vortex-compact 102879377 / 103631936 / -0.7% 141730558 / 148850414 / -4.8% 0.73 / 0.70 / +4.3%
tpch_q11/duckdb:vortex-compact 14047578 / 14229794 / -1.3% 30097613 / 30951300 / -2.8% 0.47 / 0.46 / +1.5%
tpch_q12/duckdb:vortex-compact 59021542 / 59482270 / -0.8% 84355097 / 81810755 / +3.1% 0.70 / 0.73 / -3.8%
tpch_q13/duckdb:vortex-compact 77705064 / 76782456 / +1.2% 101064648 / 100979161 / +0.1% 0.77 / 0.76 / +1.1%
tpch_q14/duckdb:vortex-compact 32961955 / 32923100 / +0.1% 71782041 / 71648782 / +0.2% 0.46 / 0.46 / -0.1%
tpch_q15/duckdb:vortex-compact 31362791 / 30891476 / +1.5% 66171164 / 71165437 / -7.0% 0.47 / 0.43 / +9.2%
tpch_q16/duckdb:vortex-compact 50831246 / 50545650 / +0.6% 59646365 / 60395958 / -1.2% 0.85 / 0.84 / +1.8%
tpch_q17/duckdb:vortex-compact 40936210 / 39841734 / +2.7% 69374855 / 69787490 / -0.6% 0.59 / 0.57 / +3.4%
tpch_q18/duckdb:vortex-compact 107228766 / 110096597 / -2.6% 116987762 / 122641439 / -4.6% 0.92 / 0.90 / +2.1%
tpch_q19/duckdb:vortex-compact 33517061 / 33404116 / +0.3% 80811226 / 75253034 / +7.4% 0.41 / 0.44 / -6.6%
tpch_q20/duckdb:vortex-compact 51872139 / 51673702 / +0.4% 95546898 / 94801909 / +0.8% 0.54 / 0.55 / -0.4%
tpch_q21/duckdb:vortex-compact 104947986 / 104163911 / +0.8% 148739712 / 146584338 / +1.5% 0.71 / 0.71 / -0.7%
tpch_q22/duckdb:vortex-compact 35559159 / 36109852 / -1.5% 50949970 / 51691211 / -1.4% 0.70 / 0.70 / -0.1%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67967431 / 68320233 / -0.5% 85687155 / 86381136 / -0.8% 0.79 / 0.79 / +0.3%
tpch_q02/duckdb:parquet 86500174 / 87325960 / -0.9% 97479503 / 98456354 / -1.0% 0.89 / 0.89 / +0.0%
tpch_q03/duckdb:parquet 109469158 / 110315762 / -0.8% 145552990 / 141728671 / +2.7% 0.75 / 0.78 / -3.4%
tpch_q04/duckdb:parquet 76731479 / 76485802 / +0.3% 99789204 / 96120302 / +3.8% 0.77 / 0.80 / -3.4%
tpch_q05/duckdb:parquet 122018695 / 122811513 / -0.6% 156203133 / 158598746 / -1.5% 0.78 / 0.77 / +0.9%
tpch_q06/duckdb:parquet 35217154 / 35453737 / -0.7% 61793497 / 57513243 / +7.4% 0.57 / 0.62 / -7.5%
tpch_q07/duckdb:parquet 118934221 / 116904984 / +1.7% 155879300 / 156079987 / -0.1% 0.76 / 0.75 / +1.9%
tpch_q08/duckdb:parquet 146407441 / 148215769 / -1.2% 186778403 / 191252134 / -2.3% 0.78 / 0.77 / +1.1%
tpch_q09/duckdb:parquet 236147656 / 236613331 / -0.2% 277825671 / 279081351 / -0.4% 0.85 / 0.85 / +0.3%
tpch_q10/duckdb:parquet 313395285 / 312351995 / +0.3% 337928303 / 341195332 / -1.0% 0.93 / 0.92 / +1.3%
tpch_q11/duckdb:parquet 43437226 / 43602127 / -0.4% 50753837 / 51254655 / -1.0% 0.86 / 0.85 / +0.6%
tpch_q12/duckdb:parquet 70136277 / 70040593 / +0.1% 91970147 / 88990927 / +3.3% 0.76 / 0.79 / -3.1%
tpch_q13/duckdb:parquet 293992152 / 292469858 / +0.5% 306103429 / 307598393 / -0.5% 0.96 / 0.95 / +1.0%
tpch_q14/duckdb:parquet 101294159 / 101475650 / -0.2% 140910648 / 133769018 / +5.3% 0.72 / 0.76 / -5.2%
tpch_q15/duckdb:parquet 57509972 / 58336292 / -1.4% 86808422 / 84715216 / +2.5% 0.66 / 0.69 / -3.8%
tpch_q16/duckdb:parquet 100518425 / 100269733 / +0.2% 107755724 / 107184809 / +0.5% 0.93 / 0.94 / -0.3%
tpch_q17/duckdb:parquet 82899081 / 81858584 / +1.3% 115783106 / 110763150 / +4.5% 0.72 / 0.74 / -3.1%
tpch_q18/duckdb:parquet 158029911 / 158661641 / -0.4% 173308296 / 171984119 / +0.8% 0.91 / 0.92 / -1.2%
tpch_q19/duckdb:parquet 97627676 / 98698945 / -1.1% 128362764 / 125888154 / +2.0% 0.76 / 0.78 / -3.0%
tpch_q20/duckdb:parquet 147035343 / 146973464 / +0.0% 189625037 / 182567909 / +3.9% 0.78 / 0.81 / -3.7%
tpch_q21/duckdb:parquet 253746817 / 252830188 / +0.4% 275285052 / 278956906 / -1.3% 0.92 / 0.91 / +1.7%
tpch_q22/duckdb:parquet 168207170 / 168547555 / -0.2% 180406232 / 180157195 / +0.1% 0.93 / 0.94 / -0.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-1.8%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.994x ➖
Parquet (geomean): hot 1.009x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1777534 / 1775310 / +0.1% 6384039 / 6551069 / -2.5% 0.28 / 0.27 / +2.7%
statpopgen_q01/datafusion:vortex-compact 4460158 / 5005053 / -10.9% 🟢 13713701 / 13008622 / +5.4% 0.33 / 0.38 / -15.5%
statpopgen_q02/datafusion:vortex-compact 46978176 / 46016967 / +2.1% 66974949 / 64483336 / +3.9% 0.70 / 0.71 / -1.7%
statpopgen_q03/datafusion:vortex-compact 334801908 / 339876902 / -1.5% 358671524 / 365512921 / -1.9% 0.93 / 0.93 / +0.4%
statpopgen_q04/datafusion:vortex-compact 331933160 / 341179831 / -2.7% 362955905 / 365106696 / -0.6% 0.91 / 0.93 / -2.1%
statpopgen_q05/datafusion:vortex-compact 146746840 / 147382994 / -0.4% 156426264 / 168392548 / -7.1% 0.94 / 0.88 / +7.2%
statpopgen_q06/datafusion:vortex-compact 660973750 / 656180626 / +0.7% 695943670 / 686390689 / +1.4% 0.95 / 0.96 / -0.7%
statpopgen_q07/datafusion:vortex-compact 354167254 / 353320642 / +0.2% 387095522 / 395662944 / -2.2% 0.91 / 0.89 / +2.5%
statpopgen_q08/datafusion:vortex-compact 365805064 / 365279724 / +0.1% 398474113 / 392399046 / +1.5% 0.92 / 0.93 / -1.4%
statpopgen_q09/datafusion:vortex-compact 491624800 / 490418931 / +0.2% 548082190 / 551203168 / -0.6% 0.90 / 0.89 / +0.8%
statpopgen_q10/datafusion:vortex-compact 1076827474 / 1080115814 / -0.3% 1127808116 / 1156093951 / -2.4% 0.95 / 0.93 / +2.2%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1958166 / 1913732 / +2.3% 90916086 / 89991685 / +1.0% 0.02 / 0.02 / +1.3%
statpopgen_q01/datafusion:parquet 164215899 / 163263650 / +0.6% 174987539 / 175122084 / -0.1% 0.94 / 0.93 / +0.7%
statpopgen_q02/datafusion:parquet 292163960 / 284007286 / +2.9% 431650548 / 433651062 / -0.5% 0.68 / 0.65 / +3.3%
statpopgen_q03/datafusion:parquet 396966860 / 393184038 / +1.0% 524618035 / 524345822 / +0.1% 0.76 / 0.75 / +0.9%
statpopgen_q04/datafusion:parquet 399326609 / 393174910 / +1.6% 536751470 / 518620529 / +3.5% 0.74 / 0.76 / -1.9%
statpopgen_q05/datafusion:parquet 329975784 / 326753852 / +1.0% 425274506 / 449633099 / -5.4% 0.78 / 0.73 / +6.8%
statpopgen_q06/datafusion:parquet 473177644 / 489754670 / -3.4% 617009604 / 604365454 / +2.1% 0.77 / 0.81 / -5.4%
statpopgen_q07/datafusion:parquet 554994064 / 555188082 / -0.0% 672246071 / 672722743 / -0.1% 0.83 / 0.83 / +0.0%
statpopgen_q08/datafusion:parquet 558948400 / 556395896 / +0.5% 674584059 / 679307154 / -0.7% 0.83 / 0.82 / +1.2%
statpopgen_q09/datafusion:parquet 364703716 / 352643398 / +3.4% 498676009 / 488608931 / +2.1% 0.73 / 0.72 / +1.3%
statpopgen_q10/datafusion:parquet 524224189 / 538737734 / -2.7% 700566575 / 708194498 / -1.1% 0.75 / 0.76 / -1.6%
duckdb / vortex-compact / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 12967719 / 13004760 / -0.3% 14895594 / 14880057 / +0.1% 0.87 / 0.87 / -0.4%
statpopgen_q01/duckdb:vortex-compact 13687163 / 13873593 / -1.3% 16776407 / 16696450 / +0.5% 0.82 / 0.83 / -1.8%
statpopgen_q02/duckdb:vortex-compact 162534062 / 149222012 / +8.9% 193034934 / 201601768 / -4.2% 0.84 / 0.74 / +13.8%
statpopgen_q03/duckdb:vortex-compact 1251913469 / 1256910774 / -0.4% 1296697567 / 1323396280 / -2.0% 0.97 / 0.95 / +1.7%
statpopgen_q04/duckdb:vortex-compact 1265899820 / 1269915012 / -0.3% 1352096801 / 1347632209 / +0.3% 0.94 / 0.94 / -0.6%
statpopgen_q05/duckdb:vortex-compact 646793702 / 640784582 / +0.9% 689756417 / 695866660 / -0.9% 0.94 / 0.92 / +1.8%
statpopgen_q06/duckdb:vortex-compact 1554566069 / 1554578612 / -0.0% 1591012203 / 1618473802 / -1.7% 0.98 / 0.96 / +1.7%
statpopgen_q07/duckdb:vortex-compact 194912686 / 194294325 / +0.3% 217042253 / 217690657 / -0.3% 0.90 / 0.89 / +0.6%
statpopgen_q08/duckdb:vortex-compact 217467222 / 216091730 / +0.6% 241935641 / 241038830 / +0.4% 0.90 / 0.90 / +0.3%
statpopgen_q09/duckdb:vortex-compact 956175212 / 940123470 / +1.7% 1023464844 / 1017303638 / +0.6% 0.93 / 0.92 / +1.1%
statpopgen_q10/duckdb:vortex-compact 2553914992 / 2508995958 / +1.8% 2521461695 / 2535682737 / -0.6% 1.01 / 0.99 / +2.4%
duckdb / parquet / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 252739414 / 245522402 / +2.9% 250876779 / 244898098 / +2.4% 1.01 / 1.00 / +0.5%
statpopgen_q01/duckdb:parquet 311869720 / 304753888 / +2.3% 312145745 / 305851350 / +2.1% 1.00 / 1.00 / +0.3%
statpopgen_q02/duckdb:parquet 561433416 / 572695806 / -2.0% 561426632 / 567824202 / -1.1% 1.00 / 1.01 / -0.8%
statpopgen_q03/duckdb:parquet 773139776 / 754802038 / +2.4% 817198514 / 809168826 / +1.0% 0.95 / 0.93 / +1.4%
statpopgen_q04/duckdb:parquet 805194854 / 752852510 / +7.0% 818246536 / 817002743 / +0.2% 0.98 / 0.92 / +6.8%
statpopgen_q05/duckdb:parquet 557501781 / 541878296 / +2.9% 602336597 / 599515931 / +0.5% 0.93 / 0.90 / +2.4%
statpopgen_q06/duckdb:parquet 640187991 / 643500484 / -0.5% 663101608 / 683174605 / -2.9% 0.97 / 0.94 / +2.5%
statpopgen_q07/duckdb:parquet 896390192 / 906654833 / -1.1% 883406221 / 887505123 / -0.5% 1.01 / 1.02 / -0.7%
statpopgen_q08/duckdb:parquet 918740164 / 913062122 / +0.6% 902492653 / 898343536 / +0.5% 1.02 / 1.02 / +0.2%
statpopgen_q09/duckdb:parquet 744473045 / 745239324 / -0.1% 795724690 / 754812090 / +5.4% 0.94 / 0.99 / -5.2%
statpopgen_q10/duckdb:parquet 989251896 / 997540757 / -0.8% 1127213712 / 1084435614 / +3.9% 0.88 / 0.92 / -4.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.2%
Engines: DataFusion No clear signal (+12.6%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, environment too noisy confidence)
Vortex (geomean): hot 1.010x ➖ · cold 0.967x ➖
Parquet (geomean): hot 0.960x ➖ · cold 0.915x ➖
Shifts: Parquet (control) -4.0% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.021x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 207407933 / 219714059 / -5.6% 719079208 / 687234582 / +4.6% 0.29 / 0.32 / -9.8%
tpch_q02/datafusion:vortex-file-compressed 328960295 / 323950427 / +1.5% 694209928 / 684449059 / +1.4% 0.47 / 0.47 / +0.1%
tpch_q03/datafusion:vortex-file-compressed 300869799 / 304777509 / -1.3% 800580090 / 758503684 / +5.5% 0.38 / 0.40 / -6.5%
tpch_q04/datafusion:vortex-file-compressed 173041921 / 160548586 / +7.8% 398549636 / 397272172 / +0.3% 0.43 / 0.40 / +7.4%
tpch_q05/datafusion:vortex-file-compressed 348581837 / 359480485 / -3.0% 531464473 / 529030638 / +0.5% 0.66 / 0.68 / -3.5%
tpch_q06/datafusion:vortex-file-compressed 131776095 / 135026660 / -2.4% 286238652 / 265597682 / +7.8% 0.46 / 0.51 / -9.4%
tpch_q07/datafusion:vortex-file-compressed 407692941 / 430586271 / -5.3% 568951397 / 668321085 / -14.9% 0.72 / 0.64 / +11.2%
tpch_q08/datafusion:vortex-file-compressed 406999208 / 415372352 / -2.0% 591637610 / 555747354 / +6.5% 0.69 / 0.75 / -8.0%
tpch_q09/datafusion:vortex-file-compressed 347252404 / 368977638 / -5.9% 494419752 / 699481993 / -29.3% 0.70 / 0.53 / +33.1%
tpch_q10/datafusion:vortex-file-compressed 364383102 / 378932379 / -3.8% 525883326 / 513595624 / +2.4% 0.69 / 0.74 / -6.1%
tpch_q11/datafusion:vortex-file-compressed 289076261 / 297463372 / -2.8% 464403122 / 414092231 / +12.1% 0.62 / 0.72 / -13.3%
tpch_q12/datafusion:vortex-file-compressed 215729330 / 221246688 / -2.5% 359392003 / 431622920 / -16.7% 0.60 / 0.51 / +17.1%
tpch_q13/datafusion:vortex-file-compressed 124726923 / 114892490 / +8.6% 288804426 / 315645268 / -8.5% 0.43 / 0.36 / +18.6%
tpch_q14/datafusion:vortex-file-compressed 185816035 / 197345398 / -5.8% 311997078 / 428273238 / -27.1% 0.60 / 0.46 / +29.2%
tpch_q15/datafusion:vortex-file-compressed 294120881 / 292891394 / +0.4% 523889148 / 564436741 / -7.2% 0.56 / 0.52 / +8.2%
tpch_q16/datafusion:vortex-file-compressed 133011491 / 135109916 / -1.6% 274986083 / 368204015 / -25.3% 0.48 / 0.37 / +31.8%
tpch_q17/datafusion:vortex-file-compressed 262129213 / 268473505 / -2.4% 407803171 / 469099037 / -13.1% 0.64 / 0.57 / +12.3%
tpch_q18/datafusion:vortex-file-compressed 386826611 / 306142852 / +26.4% 417027453 / 506238510 / -17.6% 0.93 / 0.60 / +53.4%
tpch_q19/datafusion:vortex-file-compressed 272078182 / 220747309 / +23.3% 501281934 / 467931559 / +7.1% 0.54 / 0.47 / +15.1%
tpch_q20/datafusion:vortex-file-compressed 332396661 / 261671592 / +27.0% 470086298 / 447187161 / +5.1% 0.71 / 0.59 / +20.8%
tpch_q21/datafusion:vortex-file-compressed 494399066 / 434221083 / +13.9% 665439254 / 642903130 / +3.5% 0.74 / 0.68 / +10.0%
tpch_q22/datafusion:vortex-file-compressed 156573873 / 170071516 / -7.9% 448093922 / 394592078 / +13.6% 0.35 / 0.43 / -18.9%
datafusion / parquet / ns (0.907x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 143200196 / 347221807 / -58.8% 🟢 422399862 / 528510834 / -20.1% 0.34 / 0.66 / -48.4%
tpch_q02/datafusion:parquet 282686148 / 289234150 / -2.3% 593435228 / 547156599 / +8.5% 0.48 / 0.53 / -9.9%
tpch_q03/datafusion:parquet 241594707 / 232464738 / +3.9% 684407917 / 703962114 / -2.8% 0.35 / 0.33 / +6.9%
tpch_q04/datafusion:parquet 140801882 / 139278607 / +1.1% 278651232 / 313195375 / -11.0% 0.51 / 0.44 / +13.6%
tpch_q05/datafusion:parquet 345273217 / 349643068 / -1.2% 481312715 / 455719534 / +5.6% 0.72 / 0.77 / -6.5%
tpch_q06/datafusion:parquet 109416556 / 109072065 / +0.3% 263213434 / 236079601 / +11.5% 0.42 / 0.46 / -10.0%
tpch_q07/datafusion:parquet 323177444 / 787966686 / -59.0% 🟢 455864617 / 1219103981 / -62.6% 🟢 0.71 / 0.65 / +9.7%
tpch_q08/datafusion:parquet 411660861 / 401068083 / +2.6% 494358574 / 557875783 / -11.4% 0.83 / 0.72 / +15.8%
tpch_q09/datafusion:parquet 447400166 / 381058130 / +17.4% 623807738 / 527485907 / +18.3% 0.72 / 0.72 / -0.7%
tpch_q10/datafusion:parquet 309408838 / 305670279 / +1.2% 437814042 / 483633454 / -9.5% 0.71 / 0.63 / +11.8%
tpch_q11/datafusion:parquet 248426162 / 255496848 / -2.8% 363071129 / 355083571 / +2.2% 0.68 / 0.72 / -4.9%
tpch_q12/datafusion:parquet 163680980 / 190930094 / -14.3% 287499992 / 484627563 / -40.7% 🟢 0.57 / 0.39 / +44.5%
tpch_q13/datafusion:parquet 267775473 / 272625909 / -1.8% 424194602 / 421121939 / +0.7% 0.63 / 0.65 / -2.5%
tpch_q14/datafusion:parquet 151395009 / 161742998 / -6.4% 293732777 / 519975971 / -43.5% 🟢 0.52 / 0.31 / +65.7%
tpch_q15/datafusion:parquet 322611277 / 488093141 / -33.9% 🟢 504753838 / 817925699 / -38.3% 🟢 0.64 / 0.60 / +7.1%
tpch_q16/datafusion:parquet 108932043 / 97496598 / +11.7% 249877272 / 194835975 / +28.3% 0.44 / 0.50 / -12.9%
tpch_q17/datafusion:parquet 269979378 / 284752436 / -5.2% 420035543 / 430185910 / -2.4% 0.64 / 0.66 / -2.9%
tpch_q18/datafusion:parquet 299753256 / 314133239 / -4.6% 576712632 / 471019242 / +22.4% 0.52 / 0.67 / -22.1%
tpch_q19/datafusion:parquet 178638266 / 160704914 / +11.2% 377702205 / 344164837 / +9.7% 0.47 / 0.47 / +1.3%
tpch_q20/datafusion:parquet 228184398 / 237452578 / -3.9% 355837567 / 370271426 / -3.9% 0.64 / 0.64 / -0.0%
tpch_q21/datafusion:parquet 314325225 / 315597522 / -0.4% 643270942 / 463878145 / +38.7% 🔴 0.49 / 0.68 / -28.2%
tpch_q22/datafusion:parquet 155146831 / 152724583 / +1.6% 336964639 / 301756335 / +11.7% 0.46 / 0.51 / -9.0%
duckdb / vortex-file-compressed / ns (1.000x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 240820835 / 249901127 / -3.6% 290977150 / 277612343 / +4.8% 0.83 / 0.90 / -8.1%
tpch_q02/duckdb:vortex-file-compressed 453543495 / 438583899 / +3.4% 461244236 / 595836172 / -22.6% 0.98 / 0.74 / +33.6%
tpch_q03/duckdb:vortex-file-compressed 535813089 / 380853901 / +40.7% 🔴 379265017 / 422908631 / -10.3% 1.41 / 0.90 / +56.9%
tpch_q04/duckdb:vortex-file-compressed 225297912 / 438153119 / -48.6% 🟢 229817813 / 326076599 / -29.5% 0.98 / 1.34 / -27.0%
tpch_q05/duckdb:vortex-file-compressed 659064683 / 561869450 / +17.3% 696782309 / 674997982 / +3.2% 0.95 / 0.83 / +13.6%
tpch_q06/duckdb:vortex-file-compressed 173998426 / 171262596 / +1.6% 183509295 / 222789942 / -17.6% 0.95 / 0.77 / +23.3%
tpch_q07/duckdb:vortex-file-compressed 414862918 / 414710285 / +0.0% 431648165 / 455504671 / -5.2% 0.96 / 0.91 / +5.6%
tpch_q08/duckdb:vortex-file-compressed 536477083 / 708600985 / -24.3% 632833594 / 589403639 / +7.4% 0.85 / 1.20 / -29.5%
tpch_q09/duckdb:vortex-file-compressed 382647002 / 403814974 / -5.2% 459037766 / 496779378 / -7.6% 0.83 / 0.81 / +2.5%
tpch_q10/duckdb:vortex-file-compressed 487474374 / 471509161 / +3.4% 567576354 / 576544639 / -1.6% 0.86 / 0.82 / +5.0%
tpch_q11/duckdb:vortex-file-compressed 1034303351 / 304345259 / +239.8% 🔴 467956442 / 361192801 / +29.6% 2.21 / 0.84 / +162.3%
tpch_q12/duckdb:vortex-file-compressed 245745646 / 511023071 / -51.9% 🟢 298693587 / 326104613 / -8.4% 0.82 / 1.57 / -47.5%
tpch_q13/duckdb:vortex-file-compressed 190852532 / 222661188 / -14.3% 277481086 / 285589731 / -2.8% 0.69 / 0.78 / -11.8%
tpch_q14/duckdb:vortex-file-compressed 222596790 / 250790769 / -11.2% 273225848 / 324260653 / -15.7% 0.81 / 0.77 / +5.3%
tpch_q15/duckdb:vortex-file-compressed 235489805 / 232896806 / +1.1% 258352748 / 250855189 / +3.0% 0.91 / 0.93 / -1.8%
tpch_q16/duckdb:vortex-file-compressed 214683164 / 205357170 / +4.5% 246520178 / 232717578 / +5.9% 0.87 / 0.88 / -1.3%
tpch_q17/duckdb:vortex-file-compressed 323976097 / 308511979 / +5.0% 490517406 / 394856524 / +24.2% 0.66 / 0.78 / -15.5%
tpch_q18/duckdb:vortex-file-compressed 315837106 / 294027423 / +7.4% 346623847 / 353095400 / -1.8% 0.91 / 0.83 / +9.4%
tpch_q19/duckdb:vortex-file-compressed 301782106 / 331124493 / -8.9% 336939545 / 376680234 / -10.6% 0.90 / 0.88 / +1.9%
tpch_q20/duckdb:vortex-file-compressed 350699697 / 347306144 / +1.0% 561079036 / 385491204 / +45.5% 🔴 0.63 / 0.90 / -30.6%
tpch_q21/duckdb:vortex-file-compressed 629638245 / 550704027 / +14.3% 641774091 / 629510066 / +1.9% 0.98 / 0.87 / +12.1%
tpch_q22/duckdb:vortex-file-compressed 246756200 / 245571498 / +0.5% 325871208 / 321740507 / +1.3% 0.76 / 0.76 / -0.8%
duckdb / parquet / ns (1.017x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 180952845 / 152207141 / +18.9% 221090296 / 221729144 / -0.3% 0.82 / 0.69 / +19.2%
tpch_q02/duckdb:parquet 448571317 / 430712356 / +4.1% 454912093 / 501012707 / -9.2% 0.99 / 0.86 / +14.7%
tpch_q03/duckdb:parquet 420491105 / 514316078 / -18.2% 703380516 / 597173393 / +17.8% 0.60 / 0.86 / -30.6%
tpch_q04/duckdb:parquet 271569639 / 287694995 / -5.6% 282817650 / 365439014 / -22.6% 0.96 / 0.79 / +22.0%
tpch_q05/duckdb:parquet 554108882 / 530403873 / +4.5% 609012034 / 1478276999 / -58.8% 🟢 0.91 / 0.36 / +153.6%
tpch_q06/duckdb:parquet 160753140 / 158342584 / +1.5% 193049427 / 217390947 / -11.2% 0.83 / 0.73 / +14.3%
tpch_q07/duckdb:parquet 429141043 / 394380632 / +8.8% 490608291 / 430710140 / +13.9% 0.87 / 0.92 / -4.5%
tpch_q08/duckdb:parquet 587125986 / 563650838 / +4.2% 745755598 / 623822816 / +19.5% 0.79 / 0.90 / -12.9%
tpch_q09/duckdb:parquet 546477919 / 558084641 / -2.1% 573625809 / 570293573 / +0.6% 0.95 / 0.98 / -2.6%
tpch_q10/duckdb:parquet 581348888 / 637402834 / -8.8% 637156045 / 884100572 / -27.9% 0.91 / 0.72 / +26.6%
tpch_q11/duckdb:parquet 296271257 / 300609896 / -1.4% 336085063 / 301827943 / +11.3% 0.88 / 1.00 / -11.5%
tpch_q12/duckdb:parquet 228465260 / 469993158 / -51.4% 🟢 283119088 / 814756722 / -65.3% 🟢 0.81 / 0.58 / +39.9%
tpch_q13/duckdb:parquet 386973453 / 365995457 / +5.7% 470643444 / 441001246 / +6.7% 0.82 / 0.83 / -0.9%
tpch_q14/duckdb:parquet 252168387 / 244752424 / +3.0% 301317233 / 323669008 / -6.9% 0.84 / 0.76 / +10.7%
tpch_q15/duckdb:parquet 246076377 / 190329360 / +29.3% 260423552 / 217864439 / +19.5% 0.94 / 0.87 / +8.2%
tpch_q16/duckdb:parquet 275901507 / 287439787 / -4.0% 290470249 / 322563344 / -9.9% 0.95 / 0.89 / +6.6%
tpch_q17/duckdb:parquet 329108579 / 292286320 / +12.6% 342822739 / 273641796 / +25.3% 0.96 / 1.07 / -10.1%
tpch_q18/duckdb:parquet 369064353 / 337170029 / +9.5% 394680493 / 354639340 / +11.3% 0.94 / 0.95 / -1.6%
tpch_q19/duckdb:parquet 295694915 / 242043440 / +22.2% 358322019 / 373054524 / -3.9% 0.83 / 0.65 / +27.2%
tpch_q20/duckdb:parquet 508793624 / 425462587 / +19.6% 516425168 / 498888781 / +3.5% 0.99 / 0.85 / +15.5%
tpch_q21/duckdb:parquet 471718615 / 412538204 / +14.3% 530583169 / 443365956 / +19.7% 0.89 / 0.93 / -4.5%
tpch_q22/duckdb:parquet 296511885 / 282000965 / +5.1% 265855057 / 442389148 / -39.9% 🟢 1.12 / 0.64 / +75.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +14.4%
Engines: DataFusion No clear signal (+8.5%, environment too noisy confidence) · DuckDB No clear signal (+20.6%, environment too noisy confidence)
Vortex (geomean): hot 1.105x ➖ · cold 1.058x ➖
Parquet (geomean): hot 0.966x ➖ · cold 0.921x ➖
Shifts: Parquet (control) -3.4% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.032x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 226310702 / 230456077 / -1.8% 701927487 / 650334522 / +7.9% 0.32 / 0.35 / -9.0%
tpch_q02/datafusion:vortex-compact 330664873 / 321560735 / +2.8% 628253900 / 625105827 / +0.5% 0.53 / 0.51 / +2.3%
tpch_q03/datafusion:vortex-compact 291118110 / 299425548 / -2.8% 775865981 / 586329526 / +32.3% 🔴 0.38 / 0.51 / -26.5%
tpch_q04/datafusion:vortex-compact 169181610 / 157158998 / +7.6% 425046823 / 313305420 / +35.7% 🔴 0.40 / 0.50 / -20.7%
tpch_q05/datafusion:vortex-compact 343481338 / 350942778 / -2.1% 533456735 / 595554407 / -10.4% 0.64 / 0.59 / +9.3%
tpch_q06/datafusion:vortex-compact 167527797 / 148959423 / +12.5% 266135440 / 295495403 / -9.9% 0.63 / 0.50 / +24.9%
tpch_q07/datafusion:vortex-compact 411494750 / 425222274 / -3.2% 584219062 / 528872817 / +10.5% 0.70 / 0.80 / -12.4%
tpch_q08/datafusion:vortex-compact 400648937 / 465577797 / -13.9% 587124840 / 790629189 / -25.7% 0.68 / 0.59 / +15.9%
tpch_q09/datafusion:vortex-compact 688883795 / 390528406 / +76.4% 🔴 908143749 / 529024021 / +71.7% 🔴 0.76 / 0.74 / +2.8%
tpch_q10/datafusion:vortex-compact 327279812 / 330688292 / -1.0% 474085929 / 484950204 / -2.2% 0.69 / 0.68 / +1.2%
tpch_q11/datafusion:vortex-compact 273061549 / 282443762 / -3.3% 446179743 / 436746749 / +2.2% 0.61 / 0.65 / -5.4%
tpch_q12/datafusion:vortex-compact 186573981 / 164789706 / +13.2% 358881806 / 322858559 / +11.2% 0.52 / 0.51 / +1.9%
tpch_q13/datafusion:vortex-compact 198256285 / 125996292 / +57.4% 🔴 344547085 / 282687330 / +21.9% 0.58 / 0.45 / +29.1%
tpch_q14/datafusion:vortex-compact 175354428 / 180930108 / -3.1% 366474206 / 343454230 / +6.7% 0.48 / 0.53 / -9.2%
tpch_q15/datafusion:vortex-compact 290228607 / 298702406 / -2.8% 450162682 / 596496205 / -24.5% 0.64 / 0.50 / +28.7%
tpch_q16/datafusion:vortex-compact 120552223 / 120332136 / +0.2% 322288366 / 278800445 / +15.6% 0.37 / 0.43 / -13.3%
tpch_q17/datafusion:vortex-compact 284868847 / 284782585 / +0.0% 432880236 / 552662498 / -21.7% 0.66 / 0.52 / +27.7%
tpch_q18/datafusion:vortex-compact 264945345 / 299020698 / -11.4% 440139080 / 430612617 / +2.2% 0.60 / 0.69 / -13.3%
tpch_q19/datafusion:vortex-compact 267162767 / 239966910 / +11.3% 549040095 / 389018508 / +41.1% 🔴 0.49 / 0.62 / -21.1%
tpch_q20/datafusion:vortex-compact 266714264 / 273669912 / -2.5% 447654317 / 392185277 / +14.1% 0.60 / 0.70 / -14.6%
tpch_q21/datafusion:vortex-compact 412136629 / 509813402 / -19.2% 602874207 / 826543606 / -27.1% 0.68 / 0.62 / +10.8%
tpch_q22/datafusion:vortex-compact 160410522 / 173208821 / -7.4% 339032324 / 413518523 / -18.0% 0.47 / 0.42 / +13.0%
datafusion / parquet / ns (0.951x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 173304503 / 347221807 / -50.1% 🟢 561904755 / 528510834 / +6.3% 0.31 / 0.66 / -53.1%
tpch_q02/datafusion:parquet 275607055 / 289234150 / -4.7% 492504193 / 547156599 / -10.0% 0.56 / 0.53 / +5.9%
tpch_q03/datafusion:parquet 234255453 / 232464738 / +0.8% 552990223 / 703962114 / -21.4% 0.42 / 0.33 / +28.3%
tpch_q04/datafusion:parquet 146939791 / 139278607 / +5.5% 256150603 / 313195375 / -18.2% 0.57 / 0.44 / +29.0%
tpch_q05/datafusion:parquet 330588707 / 349643068 / -5.4% 446600956 / 455719534 / -2.0% 0.74 / 0.77 / -3.5%
tpch_q06/datafusion:parquet 116533155 / 109072065 / +6.8% 227604280 / 236079601 / -3.6% 0.51 / 0.46 / +10.8%
tpch_q07/datafusion:parquet 335526531 / 787966686 / -57.4% 🟢 468740952 / 1219103981 / -61.6% 🟢 0.72 / 0.65 / +10.7%
tpch_q08/datafusion:parquet 443641509 / 401068083 / +10.6% 586677288 / 557875783 / +5.2% 0.76 / 0.72 / +5.2%
tpch_q09/datafusion:parquet 395902140 / 381058130 / +3.9% 557495589 / 527485907 / +5.7% 0.71 / 0.72 / -1.7%
tpch_q10/datafusion:parquet 297351009 / 305670279 / -2.7% 445366072 / 483633454 / -7.9% 0.67 / 0.63 / +5.6%
tpch_q11/datafusion:parquet 245285909 / 255496848 / -4.0% 354343474 / 355083571 / -0.2% 0.69 / 0.72 / -3.8%
tpch_q12/datafusion:parquet 168984604 / 190930094 / -11.5% 292184938 / 484627563 / -39.7% 🟢 0.58 / 0.39 / +46.8%
tpch_q13/datafusion:parquet 271290984 / 272625909 / -0.5% 407832453 / 421121939 / -3.2% 0.67 / 0.65 / +2.8%
tpch_q14/datafusion:parquet 145836029 / 161742998 / -9.8% 284194999 / 519975971 / -45.3% 🟢 0.51 / 0.31 / +65.0%
tpch_q15/datafusion:parquet 351547281 / 488093141 / -28.0% 759475071 / 817925699 / -7.1% 0.46 / 0.60 / -22.4%
tpch_q16/datafusion:parquet 104494484 / 97496598 / +7.2% 233658436 / 194835975 / +19.9% 0.45 / 0.50 / -10.6%
tpch_q17/datafusion:parquet 269110354 / 284752436 / -5.5% 419947234 / 430185910 / -2.4% 0.64 / 0.66 / -3.2%
tpch_q18/datafusion:parquet 380714009 / 314133239 / +21.2% 448151934 / 471019242 / -4.9% 0.85 / 0.67 / +27.4%
tpch_q19/datafusion:parquet 183388588 / 160704914 / +14.1% 417559120 / 344164837 / +21.3% 0.44 / 0.47 / -5.9%
tpch_q20/datafusion:parquet 367691744 / 237452578 / +54.8% 🔴 514751678 / 370271426 / +39.0% 🔴 0.71 / 0.64 / +11.4%
tpch_q21/datafusion:parquet 317155923 / 315597522 / +0.5% 528180135 / 463878145 / +13.9% 0.60 / 0.68 / -11.7%
tpch_q22/datafusion:parquet 171758911 / 152724583 / +12.5% 334441238 / 301756335 / +10.8% 0.51 / 0.51 / +1.5%
duckdb / vortex-compact / ns (1.184x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 254705633 / 247816044 / +2.8% 272696254 / 260871889 / +4.5% 0.93 / 0.95 / -1.7%
tpch_q02/duckdb:vortex-compact 380107949 / 388621463 / -2.2% 460899419 / 465498737 / -1.0% 0.82 / 0.83 / -1.2%
tpch_q03/duckdb:vortex-compact 422626438 / 384581069 / +9.9% 522556868 / 399384730 / +30.8% 🔴 0.81 / 0.96 / -16.0%
tpch_q04/duckdb:vortex-compact 257060450 / 253703950 / +1.3% 282022389 / 241662870 / +16.7% 0.91 / 1.05 / -13.2%
tpch_q05/duckdb:vortex-compact 711011647 / 512474280 / +38.7% 🔴 647627449 / 621650756 / +4.2% 1.10 / 0.82 / +33.2%
tpch_q06/duckdb:vortex-compact 173227747 / 160914850 / +7.7% 274846445 / 272195795 / +1.0% 0.63 / 0.59 / +6.6%
tpch_q07/duckdb:vortex-compact 409240574 / 394583970 / +3.7% 425518051 / 399476149 / +6.5% 0.96 / 0.99 / -2.6%
tpch_q08/duckdb:vortex-compact 545568087 / 564170117 / -3.3% 637857731 / 737132990 / -13.5% 0.86 / 0.77 / +11.8%
tpch_q09/duckdb:vortex-compact 409167019 / 401331084 / +2.0% 443216644 / 470824330 / -5.9% 0.92 / 0.85 / +8.3%
tpch_q10/duckdb:vortex-compact 473436523 / 463917672 / +2.1% 475384943 / 574056998 / -17.2% 1.00 / 0.81 / +23.2%
tpch_q11/duckdb:vortex-compact 289515210 / 305315513 / -5.2% 307930149 / 326616559 / -5.7% 0.94 / 0.93 / +0.6%
tpch_q12/duckdb:vortex-compact 227330770 / 231729087 / -1.9% 277991244 / 283046372 / -1.8% 0.82 / 0.82 / -0.1%
tpch_q13/duckdb:vortex-compact 216445888 / 221653210 / -2.3% 269208213 / 233462363 / +15.3% 0.80 / 0.95 / -15.3%
tpch_q14/duckdb:vortex-compact 234888331 / 233339295 / +0.7% 254190717 / 257969644 / -1.5% 0.92 / 0.90 / +2.2%
tpch_q15/duckdb:vortex-compact 233083933 / 240251759 / -3.0% 279898413 / 279017822 / +0.3% 0.83 / 0.86 / -3.3%
tpch_q16/duckdb:vortex-compact 615031091 / 203352193 / +202.4% 🔴 666856404 / 282574187 / +136.0% 🔴 0.92 / 0.72 / +28.2%
tpch_q17/duckdb:vortex-compact 396445936 / 319652634 / +24.0% 383525496 / 370822170 / +3.4% 1.03 / 0.86 / +19.9%
tpch_q18/duckdb:vortex-compact 650164056 / 317528306 / +104.8% 🔴 547396627 / 339157764 / +61.4% 🔴 1.19 / 0.94 / +26.9%
tpch_q19/duckdb:vortex-compact 275104170 / 301510623 / -8.8% 330036240 / 373919905 / -11.7% 0.83 / 0.81 / +3.4%
tpch_q20/duckdb:vortex-compact 323914693 / 330662650 / -2.0% 343273873 / 505943528 / -32.2% 🟢 0.94 / 0.65 / +44.4%
tpch_q21/duckdb:vortex-compact 515876199 / 503919103 / +2.4% 625129935 / 517399932 / +20.8% 0.83 / 0.97 / -15.3%
tpch_q22/duckdb:vortex-compact 936109593 / 248112412 / +277.3% 🔴 428088458 / 278057649 / +54.0% 🔴 2.19 / 0.89 / +145.1%
duckdb / parquet / ns (0.981x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 188162827 / 152207141 / +23.6% 239135942 / 221729144 / +7.9% 0.79 / 0.69 / +14.6%
tpch_q02/duckdb:parquet 433433916 / 430712356 / +0.6% 410916387 / 501012707 / -18.0% 1.05 / 0.86 / +22.7%
tpch_q03/duckdb:parquet 406296339 / 514316078 / -21.0% 425444085 / 597173393 / -28.8% 0.95 / 0.86 / +10.9%
tpch_q04/duckdb:parquet 317011154 / 287694995 / +10.2% 398616130 / 365439014 / +9.1% 0.80 / 0.79 / +1.0%
tpch_q05/duckdb:parquet 516797506 / 530403873 / -2.6% 594436728 / 1478276999 / -59.8% 🟢 0.87 / 0.36 / +142.3%
tpch_q06/duckdb:parquet 193122319 / 158342584 / +22.0% 496180182 / 217390947 / +128.2% 🔴 0.39 / 0.73 / -46.6%
tpch_q07/duckdb:parquet 445898767 / 394380632 / +13.1% 530706641 / 430710140 / +23.2% 0.84 / 0.92 / -8.2%
tpch_q08/duckdb:parquet 546684823 / 563650838 / -3.0% 648471915 / 623822816 / +4.0% 0.84 / 0.90 / -6.7%
tpch_q09/duckdb:parquet 560276878 / 558084641 / +0.4% 606681372 / 570293573 / +6.4% 0.92 / 0.98 / -5.6%
tpch_q10/duckdb:parquet 531958722 / 637402834 / -16.5% 679177194 / 884100572 / -23.2% 0.78 / 0.72 / +8.6%
tpch_q11/duckdb:parquet 273623680 / 300609896 / -9.0% 304695950 / 301827943 / +1.0% 0.90 / 1.00 / -9.8%
tpch_q12/duckdb:parquet 236654425 / 469993158 / -49.6% 🟢 299544019 / 814756722 / -63.2% 🟢 0.79 / 0.58 / +37.0%
tpch_q13/duckdb:parquet 356228815 / 365995457 / -2.7% 429166412 / 441001246 / -2.7% 0.83 / 0.83 / +0.0%
tpch_q14/duckdb:parquet 218765179 / 244752424 / -10.6% 279161382 / 323669008 / -13.8% 0.78 / 0.76 / +3.6%
tpch_q15/duckdb:parquet 189344218 / 190329360 / -0.5% 197159445 / 217864439 / -9.5% 0.96 / 0.87 / +9.9%
tpch_q16/duckdb:parquet 268262535 / 287439787 / -6.7% 272937028 / 322563344 / -15.4% 0.98 / 0.89 / +10.3%
tpch_q17/duckdb:parquet 245701997 / 292286320 / -15.9% 279854236 / 273641796 / +2.3% 0.88 / 1.07 / -17.8%
tpch_q18/duckdb:parquet 348095187 / 337170029 / +3.2% 460050743 / 354639340 / +29.7% 0.76 / 0.95 / -20.4%
tpch_q19/duckdb:parquet 260927975 / 242043440 / +7.8% 313644575 / 373054524 / -15.9% 0.83 / 0.65 / +28.2%
tpch_q20/duckdb:parquet 448735268 / 425462587 / +5.5% 456961597 / 498888781 / -8.4% 0.98 / 0.85 / +15.1%
tpch_q21/duckdb:parquet 489123930 / 412538204 / +18.6% 533323314 / 443365956 / +20.3% 0.92 / 0.93 / -1.4%
tpch_q22/duckdb:parquet 363688158 / 282000965 / +29.0% 379040873 / 442389148 / -14.3% 0.96 / 0.64 / +50.5%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1244884 / 1226456 / +1.5% 21783068 / 22637013 / -3.8% 0.06 / 0.05 / +5.5%
clickbench_q01/datafusion:vortex-compact 7129572 / 7236555 / -1.5% 30646811 / 29919075 / +2.4% 0.23 / 0.24 / -3.8%
clickbench_q02/datafusion:vortex-compact 13548756 / 12405274 / +9.2% 44821011 / 43544870 / +2.9% 0.30 / 0.28 / +6.1%
clickbench_q03/datafusion:vortex-compact 13038492 / 13218569 / -1.4% 46955521 / 48513570 / -3.2% 0.28 / 0.27 / +1.9%
clickbench_q04/datafusion:vortex-compact 58493738 / 59016532 / -0.9% 100582315 / 98857663 / +1.7% 0.58 / 0.60 / -2.6%
clickbench_q05/datafusion:vortex-compact 84763510 / 84353798 / +0.5% 135543364 / 138867477 / -2.4% 0.63 / 0.61 / +3.0%
clickbench_q06/datafusion:vortex-compact 1245296 / 1249451 / -0.3% 22635899 / 22072037 / +2.6% 0.06 / 0.06 / -2.8%
clickbench_q07/datafusion:vortex-compact 11591044 / 11827613 / -2.0% 36146609 / 36022974 / +0.3% 0.32 / 0.33 / -2.3%
clickbench_q08/datafusion:vortex-compact 78971680 / 80806126 / -2.3% 132306998 / 127036371 / +4.1% 0.60 / 0.64 / -6.2%
clickbench_q09/datafusion:vortex-compact 175192758 / 173003064 / +1.3% 206735522 / 208651015 / -0.9% 0.85 / 0.83 / +2.2%
clickbench_q10/datafusion:vortex-compact 25703685 / 25978342 / -1.1% 64009607 / 66119369 / -3.2% 0.40 / 0.39 / +2.2%
clickbench_q11/datafusion:vortex-compact 28380748 / 28229591 / +0.5% 64565171 / 61535721 / +4.9% 0.44 / 0.46 / -4.2%
clickbench_q12/datafusion:vortex-compact 87121552 / 87825729 / -0.8% 142520736 / 132884024 / +7.3% 0.61 / 0.66 / -7.5%
clickbench_q13/datafusion:vortex-compact 132257601 / 131680188 / +0.4% 190132627 / 188555592 / +0.8% 0.70 / 0.70 / -0.4%
clickbench_q14/datafusion:vortex-compact 95712901 / 93703678 / +2.1% 138169666 / 149564018 / -7.6% 0.69 / 0.63 / +10.6%
clickbench_q15/datafusion:vortex-compact 64586920 / 64120396 / +0.7% 96023058 / 101508963 / -5.4% 0.67 / 0.63 / +6.5%
clickbench_q16/datafusion:vortex-compact 157920748 / 161936792 / -2.5% 218135776 / 215427517 / +1.3% 0.72 / 0.75 / -3.7%
clickbench_q17/datafusion:vortex-compact 160432407 / 165962083 / -3.3% 225227669 / 231180235 / -2.6% 0.71 / 0.72 / -0.8%
clickbench_q18/datafusion:vortex-compact 292894332 / 297637410 / -1.6% 377526374 / 372037126 / +1.5% 0.78 / 0.80 / -3.0%
clickbench_q19/datafusion:vortex-compact 9828958 / 9821266 / +0.1% 42071593 / 40242928 / +4.5% 0.23 / 0.24 / -4.3%
clickbench_q20/datafusion:vortex-compact 91340830 / 87757333 / +4.1% 224465460 / 220946677 / +1.6% 0.41 / 0.40 / +2.5%
clickbench_q21/datafusion:vortex-compact 111543649 / 113103840 / -1.4% 250228366 / 253800196 / -1.4% 0.45 / 0.45 / +0.0%
clickbench_q22/datafusion:vortex-compact 215334007 / 233186350 / -7.7% 377378450 / 371773276 / +1.5% 0.57 / 0.63 / -9.0%
clickbench_q23/datafusion:vortex-compact 183397400 / 177163468 / +3.5% 296952795 / 287416641 / +3.3% 0.62 / 0.62 / +0.2%
clickbench_q24/datafusion:vortex-compact 19604704 / 19777384 / -0.9% 59490209 / 63972845 / -7.0% 0.33 / 0.31 / +6.6%
clickbench_q25/datafusion:vortex-compact 37004814 / 35772382 / +3.4% 77523920 / 79608302 / -2.6% 0.48 / 0.45 / +6.2%
clickbench_q26/datafusion:vortex-compact 34656053 / 33325505 / +4.0% 81473848 / 75054211 / +8.6% 0.43 / 0.44 / -4.2%
clickbench_q27/datafusion:vortex-compact 166992487 / 163902889 / +1.9% 268809328 / 271372235 / -0.9% 0.62 / 0.60 / +2.9%
clickbench_q28/datafusion:vortex-compact 616437250 / 605936384 / +1.7% 678887438 / 664776756 / +2.1% 0.91 / 0.91 / -0.4%
clickbench_q29/datafusion:vortex-compact 25608338 / 25520248 / +0.3% 57030568 / 54523369 / +4.6% 0.45 / 0.47 / -4.1%
clickbench_q30/datafusion:vortex-compact 68926881 / 67798985 / +1.7% 110216689 / 113760308 / -3.1% 0.63 / 0.60 / +4.9%
clickbench_q31/datafusion:vortex-compact 77763367 / 74793468 / +4.0% 156719938 / 147731185 / +6.1% 0.50 / 0.51 / -2.0%
clickbench_q32/datafusion:vortex-compact 288588938 / 290351244 / -0.6% 381595037 / 387645369 / -1.6% 0.76 / 0.75 / +1.0%
clickbench_q33/datafusion:vortex-compact 329740932 / 332241656 / -0.8% 427732039 / 443870545 / -3.6% 0.77 / 0.75 / +3.0%
clickbench_q34/datafusion:vortex-compact 333102603 / 329887066 / +1.0% 429636139 / 444031352 / -3.2% 0.78 / 0.74 / +4.4%
clickbench_q35/datafusion:vortex-compact 62280205 / 59906830 / +4.0% 93753320 / 91469797 / +2.5% 0.66 / 0.65 / +1.4%
clickbench_q36/datafusion:vortex-compact 43386489 / 43121974 / +0.6% 72829185 / 72809683 / +0.0% 0.60 / 0.59 / +0.6%
clickbench_q37/datafusion:vortex-compact 22395400 / 22320936 / +0.3% 49462303 / 47757327 / +3.6% 0.45 / 0.47 / -3.1%
clickbench_q38/datafusion:vortex-compact 18223263 / 18770552 / -2.9% 47853441 / 46441305 / +3.0% 0.38 / 0.40 / -5.8%
clickbench_q39/datafusion:vortex-compact 83773713 / 83462151 / +0.4% 116483157 / 115117890 / +1.2% 0.72 / 0.73 / -0.8%
clickbench_q40/datafusion:vortex-compact 11908843 / 11903711 / +0.0% 38088570 / 36476931 / +4.4% 0.31 / 0.33 / -4.2%
clickbench_q41/datafusion:vortex-compact 10617321 / 10833497 / -2.0% 35424776 / 35264242 / +0.5% 0.30 / 0.31 / -2.4%
clickbench_q42/datafusion:vortex-compact 10188386 / 10305536 / -1.1% 35735946 / 35131065 / +1.7% 0.29 / 0.29 / -2.8%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1270270 / 1241134 / +2.3% 50835485 / 49839332 / +2.0% 0.02 / 0.02 / +0.3%
clickbench_q01/datafusion:parquet 16056996 / 16181457 / -0.8% 67413300 / 74263654 / -9.2% 0.24 / 0.22 / +9.3%
clickbench_q02/datafusion:parquet 19144186 / 19370602 / -1.2% 81976248 / 80540945 / +1.8% 0.23 / 0.24 / -2.9%
clickbench_q03/datafusion:parquet 17285280 / 17538883 / -1.4% 78745409 / 81150959 / -3.0% 0.22 / 0.22 / +1.6%
clickbench_q04/datafusion:parquet 61855770 / 62570188 / -1.1% 128080465 / 123402943 / +3.8% 0.48 / 0.51 / -4.8%
clickbench_q05/datafusion:parquet 88386942 / 88486426 / -0.1% 156449129 / 155102865 / +0.9% 0.56 / 0.57 / -1.0%
clickbench_q06/datafusion:parquet 1280977 / 1238631 / +3.4% 50565379 / 49977331 / +1.2% 0.03 / 0.02 / +2.2%
clickbench_q07/datafusion:parquet 16860554 / 16723302 / +0.8% 67990723 / 66923822 / +1.6% 0.25 / 0.25 / -0.8%
clickbench_q08/datafusion:parquet 85722659 / 84318256 / +1.7% 163859766 / 157686567 / +3.9% 0.52 / 0.53 / -2.2%
clickbench_q09/datafusion:parquet 187207096 / 190556540 / -1.8% 263649354 / 265113573 / -0.6% 0.71 / 0.72 / -1.2%
clickbench_q10/datafusion:parquet 36127674 / 36166815 / -0.1% 101941646 / 100991387 / +0.9% 0.35 / 0.36 / -1.0%
clickbench_q11/datafusion:parquet 43394612 / 42536372 / +2.0% 111868801 / 110725170 / +1.0% 0.39 / 0.38 / +1.0%
clickbench_q12/datafusion:parquet 96285650 / 95207434 / +1.1% 162964257 / 162573788 / +0.2% 0.59 / 0.59 / +0.9%
clickbench_q13/datafusion:parquet 146232586 / 148458750 / -1.5% 229241529 / 229350661 / -0.0% 0.64 / 0.65 / -1.5%
clickbench_q14/datafusion:parquet 100337122 / 102421268 / -2.0% 172499725 / 176560215 / -2.3% 0.58 / 0.58 / +0.3%
clickbench_q15/datafusion:parquet 72283560 / 71016342 / +1.8% 130721169 / 132395676 / -1.3% 0.55 / 0.54 / +3.1%
clickbench_q16/datafusion:parquet 155330354 / 155796120 / -0.3% 237049578 / 235894989 / +0.5% 0.66 / 0.66 / -0.8%
clickbench_q17/datafusion:parquet 154859602 / 157498196 / -1.7% 235006119 / 237082548 / -0.9% 0.66 / 0.66 / -0.8%
clickbench_q18/datafusion:parquet 309186836 / 313662826 / -1.4% 418866285 / 424237465 / -1.3% 0.74 / 0.74 / -0.2%
clickbench_q19/datafusion:parquet 19103198 / 19107441 / -0.0% 78285911 / 77171331 / +1.4% 0.24 / 0.25 / -1.4%
clickbench_q20/datafusion:parquet 178362724 / 179926882 / -0.9% 282985929 / 284640986 / -0.6% 0.63 / 0.63 / -0.3%
clickbench_q21/datafusion:parquet 171986782 / 174665781 / -1.5% 299442545 / 299976599 / -0.2% 0.57 / 0.58 / -1.4%
clickbench_q22/datafusion:parquet 262252232 / 258904787 / +1.3% 430826161 / 430462629 / +0.1% 0.61 / 0.60 / +1.2%
clickbench_q23/datafusion:parquet 1006263423 / 1006954526 / -0.1% 1191589684 / 1185879000 / +0.5% 0.84 / 0.85 / -0.5%
clickbench_q24/datafusion:parquet 30045118 / 30150070 / -0.3% 90031717 / 90269263 / -0.3% 0.33 / 0.33 / -0.1%
clickbench_q25/datafusion:parquet 37455805 / 37128882 / +0.9% 103454781 / 102925612 / +0.5% 0.36 / 0.36 / +0.4%
clickbench_q26/datafusion:parquet 30166898 / 30603660 / -1.4% 90655221 / 90233629 / +0.5% 0.33 / 0.34 / -1.9%
clickbench_q27/datafusion:parquet 193216332 / 194373944 / -0.6% 291611743 / 285630725 / +2.1% 0.66 / 0.68 / -2.6%
clickbench_q28/datafusion:parquet 620820393 / 615353231 / +0.9% 700688051 / 709094109 / -1.2% 0.89 / 0.87 / +2.1%
clickbench_q29/datafusion:parquet 28963344 / 28654558 / +1.1% 92513458 / 92031093 / +0.5% 0.31 / 0.31 / +0.6%
clickbench_q30/datafusion:parquet 90186806 / 91880723 / -1.8% 174186398 / 174388901 / -0.1% 0.52 / 0.53 / -1.7%
clickbench_q31/datafusion:parquet 102745590 / 103544378 / -0.8% 199522312 / 198195188 / +0.7% 0.51 / 0.52 / -1.4%
clickbench_q32/datafusion:parquet 311202310 / 308174972 / +1.0% 429733780 / 424797501 / +1.2% 0.72 / 0.73 / -0.2%
clickbench_q33/datafusion:parquet 379829261 / 378104617 / +0.5% 478900372 / 479346205 / -0.1% 0.79 / 0.79 / +0.5%
clickbench_q34/datafusion:parquet 376873208 / 378660916 / -0.5% 479281158 / 478690635 / +0.1% 0.79 / 0.79 / -0.6%
clickbench_q35/datafusion:parquet 64932148 / 64065576 / +1.4% 125726456 / 128300748 / -2.0% 0.52 / 0.50 / +3.4%
clickbench_q36/datafusion:parquet 73613273 / 74221746 / -0.8% 138449161 / 134685358 / +2.8% 0.53 / 0.55 / -3.5%
clickbench_q37/datafusion:parquet 35921522 / 35938828 / -0.0% 92258524 / 90703364 / +1.7% 0.39 / 0.40 / -1.7%
clickbench_q38/datafusion:parquet 47917888 / 48109404 / -0.4% 111202888 / 109165912 / +1.9% 0.43 / 0.44 / -2.2%
clickbench_q39/datafusion:parquet 143462507 / 144640912 / -0.8% 214388513 / 214162127 / +0.1% 0.67 / 0.68 / -0.9%
clickbench_q40/datafusion:parquet 19456257 / 20267500 / -4.0% 78195036 / 77542458 / +0.8% 0.25 / 0.26 / -4.8%
clickbench_q41/datafusion:parquet 18730646 / 19126163 / -2.1% 77464444 / 75851192 / +2.1% 0.24 / 0.25 / -4.1%
clickbench_q42/datafusion:parquet 19061898 / 19226486 / -0.9% 76840980 / 75461928 / +1.8% 0.25 / 0.25 / -2.6%
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 2269074 / 2185576 / +3.8% 28165036 / 25971962 / +8.4% 0.08 / 0.08 / -4.3%
clickbench_q01/duckdb:vortex-compact 7485038 / 7412276 / +1.0% 28332416 / 30174372 / -6.1% 0.26 / 0.25 / +7.5%
clickbench_q02/duckdb:vortex-compact 12366420 / 12445575 / -0.6% 38193888 / 38390472 / -0.5% 0.32 / 0.32 / -0.1%
clickbench_q03/duckdb:vortex-compact 14718324 / 15003132 / -1.9% 45169368 / 45845153 / -1.5% 0.33 / 0.33 / -0.4%
clickbench_q04/duckdb:vortex-compact 60477027 / 60489991 / -0.0% 91799319 / 90883330 / +1.0% 0.66 / 0.67 / -1.0%
clickbench_q05/duckdb:vortex-compact 68500936 / 68629964 / -0.2% 99689940 / 97844964 / +1.9% 0.69 / 0.70 / -2.0%
clickbench_q06/duckdb:vortex-compact 2664086 / 2600202 / +2.5% 32316759 / 30832310 / +4.8% 0.08 / 0.08 / -2.2%
clickbench_q07/duckdb:vortex-compact 9245708 / 9712912 / -4.8% 30639046 / 32946640 / -7.0% 0.30 / 0.29 / +2.4%
clickbench_q08/duckdb:vortex-compact 72616960 / 72545678 / +0.1% 107184396 / 108465189 / -1.2% 0.68 / 0.67 / +1.3%
clickbench_q09/duckdb:vortex-compact 101038815 / 101265100 / -0.2% 136400336 / 138282115 / -1.4% 0.74 / 0.73 / +1.2%
clickbench_q10/duckdb:vortex-compact 31957976 / 32206818 / -0.8% 69491027 / 70441894 / -1.3% 0.46 / 0.46 / +0.6%
clickbench_q11/duckdb:vortex-compact 35397187 / 35223518 / +0.5% 75424581 / 70524492 / +6.9% 0.47 / 0.50 / -6.0%
clickbench_q12/duckdb:vortex-compact 82375943 / 82805222 / -0.5% 110477383 / 112139399 / -1.5% 0.75 / 0.74 / +1.0%
clickbench_q13/duckdb:vortex-compact 144303102 / 147187304 / -2.0% 184970936 / 185211738 / -0.1% 0.78 / 0.79 / -1.8%
clickbench_q14/duckdb:vortex-compact 89087472 / 89368168 / -0.3% 114952856 / 118685445 / -3.1% 0.77 / 0.75 / +2.9%
clickbench_q15/duckdb:vortex-compact 77122622 / 78993620 / -2.4% 109037988 / 108104763 / +0.9% 0.71 / 0.73 / -3.2%
clickbench_q16/duckdb:vortex-compact 146583298 / 147177770 / -0.4% 177672775 / 176878777 / +0.4% 0.83 / 0.83 / -0.8%
clickbench_q17/duckdb:vortex-compact 151943266 / 147943525 / +2.7% 167041155 / 169263386 / -1.3% 0.91 / 0.87 / +4.1%
clickbench_q18/duckdb:vortex-compact 263066082 / 262861103 / +0.1% 298501341 / 313234130 / -4.7% 0.88 / 0.84 / +5.0%
clickbench_q19/duckdb:vortex-compact 9706490 / 9903928 / -2.0% 35630791 / 33906055 / +5.1% 0.27 / 0.29 / -6.7%
clickbench_q20/duckdb:vortex-compact 78950121 / 78806461 / +0.2% 147906412 / 148643162 / -0.5% 0.53 / 0.53 / +0.7%
clickbench_q21/duckdb:vortex-compact 105894950 / 107168548 / -1.2% 173966042 / 175756725 / -1.0% 0.61 / 0.61 / -0.2%
clickbench_q22/duckdb:vortex-compact 236663736 / 237119516 / -0.2% 341121039 / 327415668 / +4.2% 0.69 / 0.72 / -4.2%
clickbench_q23/duckdb:vortex-compact 72357162 / 72758922 / -0.6% 147791800 / 148923261 / -0.8% 0.49 / 0.49 / +0.2%
clickbench_q24/duckdb:vortex-compact 22728318 / 22172156 / +2.5% 54438215 / 51048761 / +6.6% 0.42 / 0.43 / -3.9%
clickbench_q25/duckdb:vortex-compact 41422022 / 41537093 / -0.3% 75388262 / 72376902 / +4.2% 0.55 / 0.57 / -4.3%
clickbench_q26/duckdb:vortex-compact 22800529 / 22277244 / +2.3% 53674861 / 52501470 / +2.2% 0.42 / 0.42 / +0.1%
clickbench_q27/duckdb:vortex-compact 130754442 / 129605471 / +0.9% 190681940 / 190374351 / +0.2% 0.69 / 0.68 / +0.7%
clickbench_q28/duckdb:vortex-compact 575323942 / 568048088 / +1.3% 600410498 / 605375137 / -0.8% 0.96 / 0.94 / +2.1%
clickbench_q29/duckdb:vortex-compact 19262128 / 19196674 / +0.3% 49314101 / 43099437 / +14.4% 🔴 0.39 / 0.45 / -12.3%
clickbench_q30/duckdb:vortex-compact 77804471 / 78067146 / -0.3% 117998923 / 117776763 / +0.2% 0.66 / 0.66 / -0.5%
clickbench_q31/duckdb:vortex-compact 126552516 / 117781220 / +7.4% 199858013 / 199636041 / +0.1% 0.63 / 0.59 / +7.3%
clickbench_q32/duckdb:vortex-compact 368827464 / 360307796 / +2.4% 397646493 / 404941464 / -1.8% 0.93 / 0.89 / +4.2%
clickbench_q33/duckdb:vortex-compact 346950015 / 347016354 / -0.0% 388188966 / 399207993 / -2.8% 0.89 / 0.87 / +2.8%
clickbench_q34/duckdb:vortex-compact 356058404 / 359363678 / -0.9% 408044574 / 402981013 / +1.3% 0.87 / 0.89 / -2.1%
clickbench_q35/duckdb:vortex-compact 62570980 / 63523381 / -1.5% 89280866 / 92266391 / -3.2% 0.70 / 0.69 / +1.8%
clickbench_q36/duckdb:vortex-compact 12526131 / 12981721 / -3.5% 33757185 / 34336931 / -1.7% 0.37 / 0.38 / -1.9%
clickbench_q37/duckdb:vortex-compact 9482989 / 9298320 / +2.0% 30222397 / 30386781 / -0.5% 0.31 / 0.31 / +2.5%
clickbench_q38/duckdb:vortex-compact 8919792 / 8682688 / +2.7% 30464694 / 30976808 / -1.7% 0.29 / 0.28 / +4.5%
clickbench_q39/duckdb:vortex-compact 19031977 / 19003613 / +0.1% 43657829 / 44958834 / -2.9% 0.44 / 0.42 / +3.1%
clickbench_q40/duckdb:vortex-compact 7561700 / 7652273 / -1.2% 29582017 / 28518573 / +3.7% 0.26 / 0.27 / -4.7%
clickbench_q41/duckdb:vortex-compact 8215052 / 8165604 / +0.6% 28795511 / 28718158 / +0.3% 0.29 / 0.28 / +0.3%
clickbench_q42/duckdb:vortex-compact 7110605 / 7232156 / -1.7% 29388899 / 27071386 / +8.6% 0.24 / 0.27 / -9.4%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9382950 / 9514360 / -1.4% 14583028 / 14613052 / -0.2% 0.64 / 0.65 / -1.2%
clickbench_q01/duckdb:parquet 15499642 / 15075554 / +2.8% 21386784 / 21017608 / +1.8% 0.72 / 0.72 / +1.0%
clickbench_q02/duckdb:parquet 22290764 / 22687573 / -1.7% 30042015 / 29867341 / +0.6% 0.74 / 0.76 / -2.3%
clickbench_q03/duckdb:parquet 22505694 / 23499195 / -4.2% 33263260 / 33131413 / +0.4% 0.68 / 0.71 / -4.6%
clickbench_q04/duckdb:parquet 61678122 / 61529590 / +0.2% 72599998 / 73746304 / -1.6% 0.85 / 0.83 / +1.8%
clickbench_q05/duckdb:parquet 83611854 / 83393120 / +0.3% 96207503 / 96674644 / -0.5% 0.87 / 0.86 / +0.7%
clickbench_q06/duckdb:parquet 21447154 / 20687098 / +3.7% 30019816 / 26656595 / +12.6% 🔴 0.71 / 0.78 / -7.9%
clickbench_q07/duckdb:parquet 17167678 / 17530655 / -2.1% 25680363 / 25883177 / -0.8% 0.67 / 0.68 / -1.3%
clickbench_q08/duckdb:parquet 74790095 / 75896575 / -1.5% 86536490 / 89123144 / -2.9% 0.86 / 0.85 / +1.5%
clickbench_q09/duckdb:parquet 102350080 / 102615510 / -0.3% 123292142 / 118716617 / +3.9% 0.83 / 0.86 / -4.0%
clickbench_q10/duckdb:parquet 41552980 / 41681130 / -0.3% 54815328 / 53661579 / +2.2% 0.76 / 0.78 / -2.4%
clickbench_q11/duckdb:parquet 46887918 / 46842001 / +0.1% 63675289 / 63045194 / +1.0% 0.74 / 0.74 / -0.9%
clickbench_q12/duckdb:parquet 93410524 / 94078794 / -0.7% 110959328 / 109289709 / +1.5% 0.84 / 0.86 / -2.2%
clickbench_q13/duckdb:parquet 151282586 / 150113635 / +0.8% 167676607 / 166274607 / +0.8% 0.90 / 0.90 / -0.1%
clickbench_q14/duckdb:parquet 101816899 / 101069434 / +0.7% 114417697 / 120914938 / -5.4% 0.89 / 0.84 / +6.5%
clickbench_q15/duckdb:parquet 87023084 / 86777807 / +0.3% 102016272 / 104833088 / -2.7% 0.85 / 0.83 / +3.1%
clickbench_q16/duckdb:parquet 164394908 / 163672108 / +0.4% 205288219 / 181026510 / +13.4% 🔴 0.80 / 0.90 / -11.4%
clickbench_q17/duckdb:parquet 168256268 / 165378248 / +1.7% 179574856 / 203039288 / -11.6% 🟢 0.94 / 0.81 / +15.0%
clickbench_q18/duckdb:parquet 297674799 / 295276836 / +0.8% 318351541 / 320137919 / -0.6% 0.94 / 0.92 / +1.4%
clickbench_q19/duckdb:parquet 19662933 / 20004563 / -1.7% 26698245 / 27091245 / -1.5% 0.74 / 0.74 / -0.3%
clickbench_q20/duckdb:parquet 188693546 / 185990814 / +1.5% 236016208 / 224312081 / +5.2% 0.80 / 0.83 / -3.6%
clickbench_q21/duckdb:parquet 213229860 / 230716244 / -7.6% 268759612 / 260909155 / +3.0% 0.79 / 0.88 / -10.3%
clickbench_q22/duckdb:parquet 315589106 / 313064184 / +0.8% 355621089 / 358033037 / -0.7% 0.89 / 0.87 / +1.5%
clickbench_q23/duckdb:parquet 174463256 / 170319132 / +2.4% 239540083 / 234598921 / +2.1% 0.73 / 0.73 / +0.3%
clickbench_q24/duckdb:parquet 29629476 / 30023448 / -1.3% 44247357 / 43491100 / +1.7% 0.67 / 0.69 / -3.0%
clickbench_q25/duckdb:parquet 42582936 / 42424526 / +0.4% 56942386 / 63259000 / -10.0% 0.75 / 0.67 / +11.5%
clickbench_q26/duckdb:parquet 30371373 / 31092795 / -2.3% 41470776 / 44528812 / -6.9% 0.73 / 0.70 / +4.9%
clickbench_q27/duckdb:parquet 192910544 / 191426239 / +0.8% 227302960 / 228278131 / -0.4% 0.85 / 0.84 / +1.2%
clickbench_q28/duckdb:parquet 960730494 / 970414806 / -1.0% 978508806 / 943803215 / +3.7% 0.98 / 1.03 / -4.5%
clickbench_q29/duckdb:parquet 23950990 / 24833638 / -3.6% 30317692 / 31724807 / -4.4% 0.79 / 0.78 / +0.9%
clickbench_q30/duckdb:parquet 106412118 / 107710020 / -1.2% 126558933 / 126913914 / -0.3% 0.84 / 0.85 / -0.9%
clickbench_q31/duckdb:parquet 158867894 / 156886834 / +1.3% 200553105 / 175002698 / +14.6% 🔴 0.79 / 0.90 / -11.6%
clickbench_q32/duckdb:parquet 388133803 / 390581060 / -0.6% 410195778 / 409899294 / +0.1% 0.95 / 0.95 / -0.7%
clickbench_q33/duckdb:parquet 473851064 / 488827754 / -3.1% 462212916 / 448618569 / +3.0% 1.03 / 1.09 / -5.9%
clickbench_q34/duckdb:parquet 465715530 / 477613692 / -2.5% 459416646 / 469742152 / -2.2% 1.01 / 1.02 / -0.3%
clickbench_q35/duckdb:parquet 61849208 / 60872367 / +1.6% 71752041 / 74897013 / -4.2% 0.86 / 0.81 / +6.1%
clickbench_q36/duckdb:parquet 29745650 / 30728875 / -3.2% 36143425 / 35963023 / +0.5% 0.82 / 0.85 / -3.7%
clickbench_q37/duckdb:parquet 23137564 / 23024320 / +0.5% 30074289 / 29917780 / +0.5% 0.77 / 0.77 / -0.0%
clickbench_q38/duckdb:parquet 23407276 / 23403182 / +0.0% 30886266 / 29933599 / +3.2% 0.76 / 0.78 / -3.1%
clickbench_q39/duckdb:parquet 53157776 / 53912046 / -1.4% 60731585 / 60858419 / -0.2% 0.88 / 0.89 / -1.2%
clickbench_q40/duckdb:parquet 14837341 / 14469288 / +2.5% 19353905 / 19946378 / -3.0% 0.77 / 0.73 / +5.7%
clickbench_q41/duckdb:parquet 15342458 / 15136037 / +1.4% 20602756 / 20936258 / -1.6% 0.74 / 0.72 / +3.0%
clickbench_q42/duckdb:parquet 14241640 / 14178397 / +0.4% 20315251 / 20462121 / -0.7% 0.70 / 0.69 / +1.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 2e569f7e vs base 3ebf68d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Engines: DataFusion No clear signal (+3.7%, low confidence) · DuckDB No clear signal (+2.6%, low confidence)
Vortex (geomean): hot 1.030x ➖ · cold 1.009x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.037x ➖, 0↑ 10↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35653908 / 35799330 / -0.4% 60177444 / 61689647 / -2.5% 0.59 / 0.58 / +2.1%
tpcds_q02/datafusion:vortex-file-compressed 49632058 / 50217766 / -1.2% 75467961 / 74796770 / +0.9% 0.66 / 0.67 / -2.0%
tpcds_q03/datafusion:vortex-file-compressed 21713300 / 20224232 / +7.4% 48020580 / 46941860 / +2.3% 0.45 / 0.43 / +5.0%
tpcds_q04/datafusion:vortex-file-compressed 296298926 / 292336274 / +1.4% 357968782 / 356690373 / +0.4% 0.83 / 0.82 / +1.0%
tpcds_q05/datafusion:vortex-file-compressed 74597678 / 72154590 / +3.4% 114809959 / 106421049 / +7.9% 0.65 / 0.68 / -4.2%
tpcds_q06/datafusion:vortex-file-compressed 44820383 / 42396424 / +5.7% 74244942 / 72159487 / +2.9% 0.60 / 0.59 / +2.7%
tpcds_q07/datafusion:vortex-file-compressed 43224942 / 41719296 / +3.6% 78049958 / 81246397 / -3.9% 0.55 / 0.51 / +7.9%
tpcds_q08/datafusion:vortex-file-compressed 31166472 / 28563638 / +9.1% 56484738 / 59316330 / -4.8% 0.55 / 0.48 / +14.6%
tpcds_q09/datafusion:vortex-file-compressed 43097728 / 42986616 / +0.3% 77246596 / 75308255 / +2.6% 0.56 / 0.57 / -2.3%
tpcds_q10/datafusion:vortex-file-compressed 40930150 / 35555214 / +15.1% 🔴 69089645 / 62409839 / +10.7% 🔴 0.59 / 0.57 / +4.0%
tpcds_q11/datafusion:vortex-file-compressed 179628992 / 173523389 / +3.5% 217535008 / 214505223 / +1.4% 0.83 / 0.81 / +2.1%
tpcds_q12/datafusion:vortex-file-compressed 17661602 / 18096524 / -2.4% 39133371 / 37539813 / +4.2% 0.45 / 0.48 / -6.4%
tpcds_q13/datafusion:vortex-file-compressed 39322352 / 39343336 / -0.1% 81712007 / 80829716 / +1.1% 0.48 / 0.49 / -1.1%
tpcds_q14/datafusion:vortex-file-compressed 238294267 / 231458230 / +3.0% 286438922 / 264267827 / +8.4% 0.83 / 0.88 / -5.0%
tpcds_q15/datafusion:vortex-file-compressed 40063606 / 40614309 / -1.4% 60069813 / 59820528 / +0.4% 0.67 / 0.68 / -1.8%
tpcds_q16/datafusion:vortex-file-compressed 23698946 / 23790210 / -0.4% 42796096 / 43584865 / -1.8% 0.55 / 0.55 / +1.5%
tpcds_q17/datafusion:vortex-file-compressed 66235599 / 63353118 / +4.5% 102930306 / 100415400 / +2.5% 0.64 / 0.63 / +2.0%
tpcds_q18/datafusion:vortex-file-compressed 68776428 / 69340120 / -0.8% 98654321 / 100703912 / -2.0% 0.70 / 0.69 / +1.2%
tpcds_q19/datafusion:vortex-file-compressed 25992358 / 23657792 / +9.9% 56436962 / 55337589 / +2.0% 0.46 / 0.43 / +7.7%
tpcds_q20/datafusion:vortex-file-compressed 23090922 / 23192622 / -0.4% 41830740 / 40917810 / +2.2% 0.55 / 0.57 / -2.6%
tpcds_q21/datafusion:vortex-file-compressed 47095196 / 49083830 / -4.1% 61800670 / 63605296 / -2.8% 0.76 / 0.77 / -1.2%
tpcds_q22/datafusion:vortex-file-compressed 445359063 / 435913498 / +2.2% 472279883 / 460351477 / +2.6% 0.94 / 0.95 / -0.4%
tpcds_q23/datafusion:vortex-file-compressed 298086543 / 291622768 / +2.2% 349349124 / 344158199 / +1.5% 0.85 / 0.85 / +0.7%
tpcds_q24/datafusion:vortex-file-compressed 120881442 / 119206182 / +1.4% 158034096 / 153567345 / +2.9% 0.76 / 0.78 / -1.5%
tpcds_q25/datafusion:vortex-file-compressed 66444840 / 61720714 / +7.7% 99669537 / 103559242 / -3.8% 0.67 / 0.60 / +11.9%
tpcds_q26/datafusion:vortex-file-compressed 36876526 / 37796614 / -2.4% 59945807 / 62490791 / -4.1% 0.62 / 0.60 / +1.7%
tpcds_q27/datafusion:vortex-file-compressed 81418629 / 70465941 / +15.5% 🔴 113086899 / 109943349 / +2.9% 0.72 / 0.64 / +12.3%
tpcds_q28/datafusion:vortex-file-compressed 43747936 / 43192704 / +1.3% 86248905 / 95070891 / -9.3% 0.51 / 0.45 / +11.6%
tpcds_q29/datafusion:vortex-file-compressed 68765275 / 66717374 / +3.1% 95200453 / 106319116 / -10.5% 🟢 0.72 / 0.63 / +15.1%
tpcds_q30/datafusion:vortex-file-compressed 51264371 / 51123024 / +0.3% 79713227 / 80350694 / -0.8% 0.64 / 0.64 / +1.1%
tpcds_q31/datafusion:vortex-file-compressed 208736046 / 199166430 / +4.8% 239212097 / 233432469 / +2.5% 0.87 / 0.85 / +2.3%
tpcds_q32/datafusion:vortex-file-compressed 15496080 / 15147104 / +2.3% 33142216 / 32651674 / +1.5% 0.47 / 0.46 / +0.8%
tpcds_q33/datafusion:vortex-file-compressed 36100024 / 34093110 / +5.9% 67299447 / 66617940 / +1.0% 0.54 / 0.51 / +4.8%
tpcds_q34/datafusion:vortex-file-compressed 45357543 / 41354822 / +9.7% 73186421 / 68686412 / +6.6% 0.62 / 0.60 / +2.9%
tpcds_q35/datafusion:vortex-file-compressed 94639130 / 94157360 / +0.5% 122318246 / 119710400 / +2.2% 0.77 / 0.79 / -1.6%
tpcds_q36/datafusion:vortex-file-compressed 72579575 / 66419194 / +9.3% 101906794 / 100027215 / +1.9% 0.71 / 0.66 / +7.3%
tpcds_q37/datafusion:vortex-file-compressed 25285708 / 22658156 / +11.6% 🔴 46068239 / 43625965 / +5.6% 0.55 / 0.52 / +5.7%
tpcds_q38/datafusion:vortex-file-compressed 79456379 / 79018751 / +0.6% 109134618 / 108452631 / +0.6% 0.73 / 0.73 / -0.1%
tpcds_q39/datafusion:vortex-file-compressed 834658230 / 880253560 / -5.2% 845699034 / 897963334 / -5.8% 0.99 / 0.98 / +0.7%
tpcds_q40/datafusion:vortex-file-compressed 28744866 / 28783082 / -0.1% 49880415 / 49944444 / -0.1% 0.58 / 0.58 / -0.0%
tpcds_q41/datafusion:vortex-file-compressed 20164701 / 19291940 / +4.5% 33058093 / 32570164 / +1.5% 0.61 / 0.59 / +3.0%
tpcds_q42/datafusion:vortex-file-compressed 16847315 / 14252318 / +18.2% 🔴 40578550 / 41262604 / -1.7% 0.42 / 0.35 / +20.2%
tpcds_q43/datafusion:vortex-file-compressed 18989828 / 17342318 / +9.5% 42324374 / 39909857 / +6.0% 0.45 / 0.43 / +3.3%
tpcds_q44/datafusion:vortex-file-compressed 43201506 / 43350694 / -0.3% 73796193 / 71321638 / +3.5% 0.59 / 0.61 / -3.7%
tpcds_q45/datafusion:vortex-file-compressed 42137380 / 43698224 / -3.6% 61561447 / 67569903 / -8.9% 0.68 / 0.65 / +5.8%
tpcds_q46/datafusion:vortex-file-compressed 73670848 / 70618048 / +4.3% 103711760 / 103474657 / +0.2% 0.71 / 0.68 / +4.1%
tpcds_q47/datafusion:vortex-file-compressed 182617668 / 174845276 / +4.4% 227122705 / 219762954 / +3.3% 0.80 / 0.80 / +1.1%
tpcds_q48/datafusion:vortex-file-compressed 37943362 / 36170206 / +4.9% 69380259 / 69559533 / -0.3% 0.55 / 0.52 / +5.2%
tpcds_q49/datafusion:vortex-file-compressed 83298550 / 78266317 / +6.4% 120177590 / 116082973 / +3.5% 0.69 / 0.67 / +2.8%
tpcds_q50/datafusion:vortex-file-compressed 56627290 / 56320236 / +0.5% 85206706 / 88068227 / -3.2% 0.66 / 0.64 / +3.9%
tpcds_q51/datafusion:vortex-file-compressed 247761756 / 247118668 / +0.3% 281042550 / 283597624 / -0.9% 0.88 / 0.87 / +1.2%
tpcds_q52/datafusion:vortex-file-compressed 16683647 / 14477826 / +15.2% 🔴 40872862 / 38956165 / +4.9% 0.41 / 0.37 / +9.8%
tpcds_q53/datafusion:vortex-file-compressed 24750310 / 22839771 / +8.4% 52393682 / 51832859 / +1.1% 0.47 / 0.44 / +7.2%
tpcds_q54/datafusion:vortex-file-compressed 59750960 / 59198948 / +0.9% 89556347 / 92821866 / -3.5% 0.67 / 0.64 / +4.6%
tpcds_q55/datafusion:vortex-file-compressed 17210974 / 13832294 / +24.4% 🔴 42563961 / 39646732 / +7.4% 0.40 / 0.35 / +15.9%
tpcds_q56/datafusion:vortex-file-compressed 36218578 / 32915890 / +10.0% 🔴 66586102 / 64732799 / +2.9% 0.54 / 0.51 / +7.0%
tpcds_q57/datafusion:vortex-file-compressed 130674193 / 131291841 / -0.5% 162094050 / 159683536 / +1.5% 0.81 / 0.82 / -2.0%
tpcds_q58/datafusion:vortex-file-compressed 50457418 / 48235048 / +4.6% 86774379 / 85084326 / +2.0% 0.58 / 0.57 / +2.6%
tpcds_q59/datafusion:vortex-file-compressed 57120302 / 55018210 / +3.8% 84455436 / 81116335 / +4.1% 0.68 / 0.68 / -0.3%
tpcds_q60/datafusion:vortex-file-compressed 35803734 / 33664539 / +6.4% 66046958 / 64315479 / +2.7% 0.54 / 0.52 / +3.6%
tpcds_q61/datafusion:vortex-file-compressed 50532366 / 46561578 / +8.5% 78036485 / 68519379 / +13.9% 🔴 0.65 / 0.68 / -4.7%
tpcds_q62/datafusion:vortex-file-compressed 19495730 / 18846026 / +3.4% 41052357 / 41053124 / -0.0% 0.47 / 0.46 / +3.4%
tpcds_q63/datafusion:vortex-file-compressed 24741335 / 23227046 / +6.5% 52356342 / 50026121 / +4.7% 0.47 / 0.46 / +1.8%
tpcds_q64/datafusion:vortex-file-compressed 333494261 / 332547258 / +0.3% 401466217 / 406783737 / -1.3% 0.83 / 0.82 / +1.6%
tpcds_q65/datafusion:vortex-file-compressed 78829454 / 75042737 / +5.0% 111104668 / 112842974 / -1.5% 0.71 / 0.67 / +6.7%
tpcds_q66/datafusion:vortex-file-compressed 52812119 / 52947696 / -0.3% 75752279 / 79220576 / -4.4% 0.70 / 0.67 / +4.3%
tpcds_q67/datafusion:vortex-file-compressed 426831924 / 419283290 / +1.8% 530048628 / 518521163 / +2.2% 0.81 / 0.81 / -0.4%
tpcds_q68/datafusion:vortex-file-compressed 71539187 / 66944006 / +6.9% 100041351 / 99959672 / +0.1% 0.72 / 0.67 / +6.8%
tpcds_q69/datafusion:vortex-file-compressed 40424208 / 36274700 / +11.4% 🔴 65105405 / 63391124 / +2.7% 0.62 / 0.57 / +8.5%
tpcds_q70/datafusion:vortex-file-compressed 194691766 / 194472950 / +0.1% 230239133 / 224768879 / +2.4% 0.85 / 0.87 / -2.3%
tpcds_q71/datafusion:vortex-file-compressed 28292782 / 26015456 / +8.8% 61626643 / 59191541 / +4.1% 0.46 / 0.44 / +4.5%
tpcds_q72/datafusion:vortex-file-compressed 1600129351 / 1608447118 / -0.5% 1635590012 / 1638909544 / -0.2% 0.98 / 0.98 / -0.3%
tpcds_q73/datafusion:vortex-file-compressed 40885646 / 38218072 / +7.0% 66086876 / 64992904 / +1.7% 0.62 / 0.59 / +5.2%
tpcds_q74/datafusion:vortex-file-compressed 136877673 / 134956708 / +1.4% 169701557 / 171039504 / -0.8% 0.81 / 0.79 / +2.2%
tpcds_q75/datafusion:vortex-file-compressed 161158315 / 157160290 / +2.5% 203226519 / 196671080 / +3.3% 0.79 / 0.80 / -0.8%
tpcds_q76/datafusion:vortex-file-compressed 35428744 / 34000306 / +4.2% 73534117 / 75356110 / -2.4% 0.48 / 0.45 / +6.8%
tpcds_q77/datafusion:vortex-file-compressed 57316252 / 54647870 / +4.9% 93324775 / 92619406 / +0.8% 0.61 / 0.59 / +4.1%
tpcds_q78/datafusion:vortex-file-compressed 142303935 / 142130394 / +0.1% 190516438 / 191360441 / -0.4% 0.75 / 0.74 / +0.6%
tpcds_q79/datafusion:vortex-file-compressed 57494744 / 54644203 / +5.2% 83566488 / 87010643 / -4.0% 0.69 / 0.63 / +9.6%
tpcds_q80/datafusion:vortex-file-compressed 82655766 / 80866081 / +2.2% 131014963 / 125350029 / +4.5% 0.63 / 0.65 / -2.2%
tpcds_q81/datafusion:vortex-file-compressed 56042854 / 56606214 / -1.0% 83733341 / 86101513 / -2.8% 0.67 / 0.66 / +1.8%
tpcds_q82/datafusion:vortex-file-compressed 29937050 / 29439518 / +1.7% 50351262 / 51584874 / -2.4% 0.59 / 0.57 / +4.2%
tpcds_q83/datafusion:vortex-file-compressed 42601212 / 42567916 / +0.1% 66934128 / 67487254 / -0.8% 0.64 / 0.63 / +0.9%
tpcds_q84/datafusion:vortex-file-compressed 12954230 / 12690625 / +2.1% 32681704 / 31877676 / +2.5% 0.40 / 0.40 / -0.4%
tpcds_q85/datafusion:vortex-file-compressed 59317761 / 59480827 / -0.3% 90774265 / 89138690 / +1.8% 0.65 / 0.67 / -2.1%
tpcds_q86/datafusion:vortex-file-compressed 18748028 / 18954698 / -1.1% 39532227 / 40690674 / -2.8% 0.47 / 0.47 / +1.8%
tpcds_q87/datafusion:vortex-file-compressed 80432151 / 78334370 / +2.7% 109634250 / 106732259 / +2.7% 0.73 / 0.73 / -0.0%
tpcds_q88/datafusion:vortex-file-compressed 65080973 / 53772266 / +21.0% 🔴 101909005 / 91092623 / +11.9% 🔴 0.64 / 0.59 / +8.2%
tpcds_q89/datafusion:vortex-file-compressed 28442684 / 26969496 / +5.5% 53774059 / 53916307 / -0.3% 0.53 / 0.50 / +5.7%
tpcds_q90/datafusion:vortex-file-compressed 13639544 / 13180212 / +3.5% 33829785 / 29415112 / +15.0% 🔴 0.40 / 0.45 / -10.0%
tpcds_q91/datafusion:vortex-file-compressed 19026462 / 19032312 / -0.0% 42929197 / 43088752 / -0.4% 0.44 / 0.44 / +0.3%
tpcds_q92/datafusion:vortex-file-compressed 15209737 / 15122420 / +0.6% 38374361 / 36672616 / +4.6% 0.40 / 0.41 / -3.9%
tpcds_q93/datafusion:vortex-file-compressed 55585356 / 56530026 / -1.7% 94245837 / 91739367 / +2.7% 0.59 / 0.62 / -4.3%
tpcds_q94/datafusion:vortex-file-compressed 21749095 / 21633426 / +0.5% 46319034 / 45996500 / +0.7% 0.47 / 0.47 / -0.2%
tpcds_q95/datafusion:vortex-file-compressed 96432522 / 96449408 / -0.0% 126796988 / 124620559 / +1.7% 0.76 / 0.77 / -1.7%
tpcds_q96/datafusion:vortex-file-compressed 13258056 / 11795181 / +12.4% 🔴 33755088 / 29572759 / +14.1% 🔴 0.39 / 0.40 / -1.5%
tpcds_q97/datafusion:vortex-file-compressed 40055086 / 39685942 / +0.9% 67385508 / 67443028 / -0.1% 0.59 / 0.59 / +1.0%
tpcds_q98/datafusion:vortex-file-compressed 22669280 / 21544350 / +5.2% 52086063 / 46960548 / +10.9% 🔴 0.44 / 0.46 / -5.1%
tpcds_q99/datafusion:vortex-file-compressed 29776289 / 29827380 / -0.2% 49222004 / 47642455 / +3.3% 0.60 / 0.63 / -3.4%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59304350 / 59383308 / -0.1% 79588021 / 79321074 / +0.3% 0.75 / 0.75 / -0.5%
tpcds_q02/datafusion:parquet 68663338 / 69012498 / -0.5% 92874286 / 90601532 / +2.5% 0.74 / 0.76 / -2.9%
tpcds_q03/datafusion:parquet 28752577 / 28066414 / +2.4% 49188513 / 51128242 / -3.8% 0.58 / 0.55 / +6.5%
tpcds_q04/datafusion:parquet 642211410 / 639113319 / +0.5% 703538726 / 703564880 / -0.0% 0.91 / 0.91 / +0.5%
tpcds_q05/datafusion:parquet 80996896 / 79208110 / +2.3% 114752581 / 115093319 / -0.3% 0.71 / 0.69 / +2.6%
tpcds_q06/datafusion:parquet 90620414 / 90739672 / -0.1% 114843623 / 114029689 / +0.7% 0.79 / 0.80 / -0.8%
tpcds_q07/datafusion:parquet 101995771 / 100721879 / +1.3% 140581642 / 136043972 / +3.3% 0.73 / 0.74 / -2.0%
tpcds_q08/datafusion:parquet 47827702 / 48247211 / -0.9% 70588780 / 70465899 / +0.2% 0.68 / 0.68 / -1.0%
tpcds_q09/datafusion:parquet 74815285 / 76916054 / -2.7% 105007441 / 101458384 / +3.5% 0.71 / 0.76 / -6.0%
tpcds_q10/datafusion:parquet 60728720 / 61160342 / -0.7% 77614876 / 81401449 / -4.7% 0.78 / 0.75 / +4.1%
tpcds_q11/datafusion:parquet 415078667 / 408890309 / +1.5% 455310971 / 451990461 / +0.7% 0.91 / 0.90 / +0.8%
tpcds_q12/datafusion:parquet 39845288 / 39964309 / -0.3% 58174335 / 59640283 / -2.5% 0.68 / 0.67 / +2.2%
tpcds_q13/datafusion:parquet 85680360 / 87143940 / -1.7% 129330821 / 130151161 / -0.6% 0.66 / 0.67 / -1.1%
tpcds_q14/datafusion:parquet 375630930 / 382952264 / -1.9% 409269894 / 411485553 / -0.5% 0.92 / 0.93 / -1.4%
tpcds_q15/datafusion:parquet 51163117 / 50521591 / +1.3% 72044073 / 70444220 / +2.3% 0.71 / 0.72 / -1.0%
tpcds_q16/datafusion:parquet 45713610 / 45086446 / +1.4% 64218320 / 62230222 / +3.2% 0.71 / 0.72 / -1.7%
tpcds_q17/datafusion:parquet 136649332 / 135698628 / +0.7% 168966161 / 170384509 / -0.8% 0.81 / 0.80 / +1.5%
tpcds_q18/datafusion:parquet 107585204 / 109092285 / -1.4% 141470859 / 142610870 / -0.8% 0.76 / 0.76 / -0.6%
tpcds_q19/datafusion:parquet 46927298 / 47980244 / -2.2% 76763367 / 77606400 / -1.1% 0.61 / 0.62 / -1.1%
tpcds_q20/datafusion:parquet 41272702 / 41198191 / +0.2% 55018489 / 53928727 / +2.0% 0.75 / 0.76 / -1.8%
tpcds_q21/datafusion:parquet 60932738 / 60803662 / +0.2% 73516657 / 72923216 / +0.8% 0.83 / 0.83 / -0.6%
tpcds_q22/datafusion:parquet 461328303 / 463230661 / -0.4% 478659917 / 475748881 / +0.6% 0.96 / 0.97 / -1.0%
tpcds_q23/datafusion:parquet 361555452 / 365434508 / -1.1% 410957591 / 413496775 / -0.6% 0.88 / 0.88 / -0.5%
tpcds_q24/datafusion:parquet 240219702 / 241911688 / -0.7% 277039028 / 275438266 / +0.6% 0.87 / 0.88 / -1.3%
tpcds_q25/datafusion:parquet 153374237 / 145452838 / +5.4% 186282514 / 180174485 / +3.4% 0.82 / 0.81 / +2.0%
tpcds_q26/datafusion:parquet 54599490 / 55051276 / -0.8% 78691943 / 77214647 / +1.9% 0.69 / 0.71 / -2.7%
tpcds_q27/datafusion:parquet 213849146 / 203937031 / +4.9% 234653238 / 242346532 / -3.2% 0.91 / 0.84 / +8.3%
tpcds_q28/datafusion:parquet 86448307 / 86939420 / -0.6% 117764862 / 119806268 / -1.7% 0.73 / 0.73 / +1.2%
tpcds_q29/datafusion:parquet 143096267 / 144008465 / -0.6% 178998678 / 183150830 / -2.3% 0.80 / 0.79 / +1.7%
tpcds_q30/datafusion:parquet 95854710 / 96613486 / -0.8% 123677004 / 118215521 / +4.6% 0.78 / 0.82 / -5.2%
tpcds_q31/datafusion:parquet 317941714 / 317607596 / +0.1% 343263244 / 340976798 / +0.7% 0.93 / 0.93 / -0.6%
tpcds_q32/datafusion:parquet 29176699 / 29523430 / -1.2% 41561863 / 44137594 / -5.8% 0.70 / 0.67 / +5.0%
tpcds_q33/datafusion:parquet 51996218 / 53239216 / -2.3% 78746390 / 75708963 / +4.0% 0.66 / 0.70 / -6.1%
tpcds_q34/datafusion:parquet 62358572 / 62880336 / -0.8% 84926639 / 85364080 / -0.5% 0.73 / 0.74 / -0.3%
tpcds_q35/datafusion:parquet 124427664 / 127605550 / -2.5% 146147124 / 152201143 / -4.0% 0.85 / 0.84 / +1.5%
tpcds_q36/datafusion:parquet 98663478 / 98095649 / +0.6% 127849998 / 130790506 / -2.2% 0.77 / 0.75 / +2.9%
tpcds_q37/datafusion:parquet 49294516 / 50229009 / -1.9% 63970083 / 65073574 / -1.7% 0.77 / 0.77 / -0.2%
tpcds_q38/datafusion:parquet 122664293 / 121959293 / +0.6% 146648969 / 146180510 / +0.3% 0.84 / 0.83 / +0.3%
tpcds_q39/datafusion:parquet 848509947 / 849450426 / -0.1% 868532374 / 862489103 / +0.7% 0.98 / 0.98 / -0.8%
tpcds_q40/datafusion:parquet 35139770 / 35170482 / -0.1% 56806067 / 55096718 / +3.1% 0.62 / 0.64 / -3.1%
tpcds_q41/datafusion:parquet 31965272 / 32228387 / -0.8% 43400699 / 42863855 / +1.3% 0.74 / 0.75 / -2.0%
tpcds_q42/datafusion:parquet 26320216 / 26476248 / -0.6% 45313377 / 45223534 / +0.2% 0.58 / 0.59 / -0.8%
tpcds_q43/datafusion:parquet 27813552 / 27565354 / +0.9% 49674270 / 48431408 / +2.6% 0.56 / 0.57 / -1.6%
tpcds_q44/datafusion:parquet 64960574 / 63555414 / +2.2% 87003978 / 88787032 / -2.0% 0.75 / 0.72 / +4.3%
tpcds_q45/datafusion:parquet 65489633 / 65627960 / -0.2% 88355830 / 89738622 / -1.5% 0.74 / 0.73 / +1.4%
tpcds_q46/datafusion:parquet 106422233 / 108099908 / -1.6% 153964740 / 146726889 / +4.9% 0.69 / 0.74 / -6.2%
tpcds_q47/datafusion:parquet 234995538 / 235085845 / -0.0% 274310160 / 278386923 / -1.5% 0.86 / 0.84 / +1.4%
tpcds_q48/datafusion:parquet 77865641 / 76733536 / +1.5% 105983800 / 103897387 / +2.0% 0.73 / 0.74 / -0.5%
tpcds_q49/datafusion:parquet 115010360 / 122526892 / -6.1% 169697673 / 154529800 / +9.8% 0.68 / 0.79 / -14.5%
tpcds_q50/datafusion:parquet 91112755 / 90258718 / +0.9% 122228596 / 121595722 / +0.5% 0.75 / 0.74 / +0.4%
tpcds_q51/datafusion:parquet 252708570 / 255516616 / -1.1% 290093420 / 280555832 / +3.4% 0.87 / 0.91 / -4.4%
tpcds_q52/datafusion:parquet 27452774 / 27142567 / +1.1% 47214347 / 46947835 / +0.6% 0.58 / 0.58 / +0.6%
tpcds_q53/datafusion:parquet 36211932 / 36456268 / -0.7% 59623078 / 61016006 / -2.3% 0.61 / 0.60 / +1.7%
tpcds_q54/datafusion:parquet 86457889 / 86083798 / +0.4% 115372256 / 108820449 / +6.0% 0.75 / 0.79 / -5.3%
tpcds_q55/datafusion:parquet 26464894 / 26856084 / -1.5% 46017354 / 46723004 / -1.5% 0.58 / 0.57 / +0.1%
tpcds_q56/datafusion:parquet 51744446 / 52749376 / -1.9% 76984887 / 78823198 / -2.3% 0.67 / 0.67 / +0.4%
tpcds_q57/datafusion:parquet 170830520 / 171711916 / -0.5% 193023239 / 196473676 / -1.8% 0.89 / 0.87 / +1.3%
tpcds_q58/datafusion:parquet 97832974 / 95037270 / +2.9% 126473782 / 126678892 / -0.2% 0.77 / 0.75 / +3.1%
tpcds_q59/datafusion:parquet 104551244 / 105825523 / -1.2% 130253748 / 130706690 / -0.3% 0.80 / 0.81 / -0.9%
tpcds_q60/datafusion:parquet 53552897 / 55166164 / -2.9% 71385463 / 78619002 / -9.2% 0.75 / 0.70 / +6.9%
tpcds_q61/datafusion:parquet 75741699 / 72363571 / +4.7% 96215276 / 104232599 / -7.7% 0.79 / 0.69 / +13.4%
tpcds_q62/datafusion:parquet 27131576 / 27555552 / -1.5% 44015293 / 46510486 / -5.4% 0.62 / 0.59 / +4.0%
tpcds_q63/datafusion:parquet 36118068 / 35533783 / +1.6% 59640121 / 57538816 / +3.7% 0.61 / 0.62 / -1.9%
tpcds_q64/datafusion:parquet 659857054 / 655213154 / +0.7% 754210253 / 741333148 / +1.7% 0.87 / 0.88 / -1.0%
tpcds_q65/datafusion:parquet 101607412 / 101338440 / +0.3% 135432735 / 134992677 / +0.3% 0.75 / 0.75 / -0.1%
tpcds_q66/datafusion:parquet 75602326 / 76653364 / -1.4% 103072791 / 104847845 / -1.7% 0.73 / 0.73 / +0.3%
tpcds_q67/datafusion:parquet 435125522 / 432303073 / +0.7% 499143207 / 498324003 / +0.2% 0.87 / 0.87 / +0.5%
tpcds_q68/datafusion:parquet 108628822 / 112354246 / -3.3% 156605633 / 153536513 / +2.0% 0.69 / 0.73 / -5.2%
tpcds_q69/datafusion:parquet 61270866 / 59136420 / +3.6% 85231211 / 77471499 / +10.0% 🔴 0.72 / 0.76 / -5.8%
tpcds_q70/datafusion:parquet 210223977 / 211019934 / -0.4% 239986876 / 242265455 / -0.9% 0.88 / 0.87 / +0.6%
tpcds_q71/datafusion:parquet 37289832 / 38409654 / -2.9% 63913865 / 64906215 / -1.5% 0.58 / 0.59 / -1.4%
tpcds_q72/datafusion:parquet 1821149796 / 1786309728 / +2.0% 1788306910 / 1836458733 / -2.6% 1.02 / 0.97 / +4.7%
tpcds_q73/datafusion:parquet 62322226 / 62927414 / -1.0% 87497043 / 88770308 / -1.4% 0.71 / 0.71 / +0.5%
tpcds_q74/datafusion:parquet 291055971 / 294290586 / -1.1% 326737028 / 328040916 / -0.4% 0.89 / 0.90 / -0.7%
tpcds_q75/datafusion:parquet 196688098 / 193186731 / +1.8% 242197951 / 229337369 / +5.6% 0.81 / 0.84 / -3.6%
tpcds_q76/datafusion:parquet 51527411 / 49730774 / +3.6% 81937061 / 79976918 / +2.5% 0.63 / 0.62 / +1.1%
tpcds_q77/datafusion:parquet 71638888 / 70294255 / +1.9% 100425855 / 105555329 / -4.9% 0.71 / 0.67 / +7.1%
tpcds_q78/datafusion:parquet 210770987 / 213320434 / -1.2% 266312877 / 271330753 / -1.8% 0.79 / 0.79 / +0.7%
tpcds_q79/datafusion:parquet 77864115 / 78983879 / -1.4% 113203658 / 119491915 / -5.3% 0.69 / 0.66 / +4.1%
tpcds_q80/datafusion:parquet 143846073 / 141300236 / +1.8% 191786478 / 191033060 / +0.4% 0.75 / 0.74 / +1.4%
tpcds_q81/datafusion:parquet 107825686 / 108022631 / -0.2% 131233905 / 132723856 / -1.1% 0.82 / 0.81 / +1.0%
tpcds_q82/datafusion:parquet 54472744 / 54404076 / +0.1% 73331882 / 73095311 / +0.3% 0.74 / 0.74 / -0.2%
tpcds_q83/datafusion:parquet 66636328 / 66645796 / -0.0% 85290977 / 81355005 / +4.8% 0.78 / 0.82 / -4.6%
tpcds_q84/datafusion:parquet 35683964 / 35839882 / -0.4% 50636760 / 49177945 / +3.0% 0.70 / 0.73 / -3.3%
tpcds_q85/datafusion:parquet 103656471 / 106087967 / -2.3% 131457039 / 133428434 / -1.5% 0.79 / 0.80 / -0.8%
tpcds_q86/datafusion:parquet 21956141 / 21720236 / +1.1% 38830054 / 38760404 / +0.2% 0.57 / 0.56 / +0.9%
tpcds_q87/datafusion:parquet 120456876 / 120696352 / -0.2% 148244495 / 141614860 / +4.7% 0.81 / 0.85 / -4.7%
tpcds_q88/datafusion:parquet 87153290 / 85266947 / +2.2% 107871109 / 107860161 / +0.0% 0.81 / 0.79 / +2.2%
tpcds_q89/datafusion:parquet 38638816 / 38936334 / -0.8% 62650207 / 63840358 / -1.9% 0.62 / 0.61 / +1.1%
tpcds_q90/datafusion:parquet 17445634 / 17059700 / +2.3% 35348340 / 31016043 / +14.0% 🔴 0.49 / 0.55 / -10.3%
tpcds_q91/datafusion:parquet 42707778 / 42576364 / +0.3% 60936460 / 61131549 / -0.3% 0.70 / 0.70 / +0.6%
tpcds_q92/datafusion:parquet 29008170 / 28488856 / +1.8% 49022803 / 47829742 / +2.5% 0.59 / 0.60 / -0.7%
tpcds_q93/datafusion:parquet 62311679 / 61354750 / +1.6% 89883355 / 92366205 / -2.7% 0.69 / 0.66 / +4.4%
tpcds_q94/datafusion:parquet 38164918 / 38502430 / -0.9% 57750040 / 58018764 / -0.5% 0.66 / 0.66 / -0.4%
tpcds_q95/datafusion:parquet 127549380 / 128293749 / -0.6% 146388507 / 151772769 / -3.5% 0.87 / 0.85 / +3.1%
tpcds_q96/datafusion:parquet 21538516 / 20505201 / +5.0% 37702284 / 37124240 / +1.6% 0.57 / 0.55 / +3.4%
tpcds_q97/datafusion:parquet 55018485 / 55194439 / -0.3% 79566732 / 80951012 / -1.7% 0.69 / 0.68 / +1.4%
tpcds_q98/datafusion:parquet 61332169 / 60536292 / +1.3% 87209361 / 88354493 / -1.3% 0.70 / 0.69 / +2.6%
tpcds_q99/datafusion:parquet 42732488 / 43018030 / -0.7% 58331707 / 57774828 / +1.0% 0.73 / 0.74 / -1.6%
duckdb / vortex-file-compressed / ns (1.023x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32040770 / 33145218 / -3.3% 45078340 / 44778655 / +0.7% 0.71 / 0.74 / -4.0%
tpcds_q02/duckdb:vortex-file-compressed 31286283 / 30744634 / +1.8% 44120947 / 44168614 / -0.1% 0.71 / 0.70 / +1.9%
tpcds_q03/duckdb:vortex-file-compressed 14934136 / 13744228 / +8.7% 32337338 / 30784398 / +5.0% 0.46 / 0.45 / +3.4%
tpcds_q04/duckdb:vortex-file-compressed 131117394 / 126156865 / +3.9% 153118228 / 151513686 / +1.1% 0.86 / 0.83 / +2.8%
tpcds_q05/duckdb:vortex-file-compressed 55363348 / 55535056 / -0.3% 84066391 / 71471450 / +17.6% 🔴 0.66 / 0.78 / -15.2%
tpcds_q06/duckdb:vortex-file-compressed 59685516 / 58773186 / +1.6% 81560920 / 77093227 / +5.8% 0.73 / 0.76 / -4.0%
tpcds_q07/duckdb:vortex-file-compressed 32967248 / 31134998 / +5.9% 53887311 / 56151516 / -4.0% 0.61 / 0.55 / +10.3%
tpcds_q08/duckdb:vortex-file-compressed 32356417 / 30957614 / +4.5% 43931227 / 47133857 / -6.8% 0.74 / 0.66 / +12.1%
tpcds_q09/duckdb:vortex-file-compressed 56046484 / 55953960 / +0.2% 79368793 / 79241359 / +0.2% 0.71 / 0.71 / +0.0%
tpcds_q10/duckdb:vortex-file-compressed 40086102 / 39037222 / +2.7% 59189501 / 58494504 / +1.2% 0.68 / 0.67 / +1.5%
tpcds_q11/duckdb:vortex-file-compressed 95764398 / 95680417 / +0.1% 114290573 / 112543066 / +1.6% 0.84 / 0.85 / -1.4%
tpcds_q12/duckdb:vortex-file-compressed 17821420 / 17644904 / +1.0% 30971721 / 31360193 / -1.2% 0.58 / 0.56 / +2.3%
tpcds_q13/duckdb:vortex-file-compressed 40544264 / 38585764 / +5.1% 70662265 / 69581832 / +1.6% 0.57 / 0.55 / +3.5%
tpcds_q14/duckdb:vortex-file-compressed 125902504 / 120775830 / +4.2% 150169743 / 139827098 / +7.4% 0.84 / 0.86 / -2.9%
tpcds_q15/duckdb:vortex-file-compressed 59680988 / 61229657 / -2.5% 73886328 / 68853368 / +7.3% 0.81 / 0.89 / -9.2%
tpcds_q16/duckdb:vortex-file-compressed 34248250 / 34609586 / -1.0% 51457752 / 52911062 / -2.7% 0.67 / 0.65 / +1.8%
tpcds_q17/duckdb:vortex-file-compressed 56228958 / 57811390 / -2.7% 80927603 / 81662227 / -0.9% 0.69 / 0.71 / -1.9%
tpcds_q18/duckdb:vortex-file-compressed 83270336 / 83616693 / -0.4% 103659041 / 102960767 / +0.7% 0.80 / 0.81 / -1.1%
tpcds_q19/duckdb:vortex-file-compressed 45522442 / 45343302 / +0.4% 62629804 / 63761444 / -1.8% 0.73 / 0.71 / +2.2%
tpcds_q20/duckdb:vortex-file-compressed 22111149 / 22323878 / -1.0% 37316446 / 37773398 / -1.2% 0.59 / 0.59 / +0.3%
tpcds_q21/duckdb:vortex-file-compressed 35690568 / 35295284 / +1.1% 55763350 / 67927368 / -17.9% 🟢 0.64 / 0.52 / +23.2%
tpcds_q22/duckdb:vortex-file-compressed 158771316 / 158487355 / +0.2% 172942533 / 176929138 / -2.3% 0.92 / 0.90 / +2.5%
tpcds_q23/duckdb:vortex-file-compressed 185914040 / 185267775 / +0.3% 198875246 / 208914242 / -4.8% 0.93 / 0.89 / +5.4%
tpcds_q24/duckdb:vortex-file-compressed 52097982 / 52243512 / -0.3% 75039360 / 75444119 / -0.5% 0.69 / 0.69 / +0.3%
tpcds_q25/duckdb:vortex-file-compressed 52541280 / 53497720 / -1.8% 76037116 / 80618448 / -5.7% 0.69 / 0.66 / +4.1%
tpcds_q26/duckdb:vortex-file-compressed 25749168 / 26558116 / -3.0% 42652275 / 44529292 / -4.2% 0.60 / 0.60 / +1.2%
tpcds_q27/duckdb:vortex-file-compressed 33034286 / 31928027 / +3.5% 54657499 / 56437869 / -3.2% 0.60 / 0.57 / +6.8%
tpcds_q28/duckdb:vortex-file-compressed 42835102 / 43217884 / -0.9% 63435738 / 61480065 / +3.2% 0.68 / 0.70 / -3.9%
tpcds_q29/duckdb:vortex-file-compressed 50611676 / 51106784 / -1.0% 73695571 / 75046889 / -1.8% 0.69 / 0.68 / +0.8%
tpcds_q30/duckdb:vortex-file-compressed 37894469 / 37976684 / -0.2% 51467605 / 49831887 / +3.3% 0.74 / 0.76 / -3.4%
tpcds_q31/duckdb:vortex-file-compressed 39195577 / 38286651 / +2.4% 53965594 / 54339686 / -0.7% 0.73 / 0.70 / +3.1%
tpcds_q32/duckdb:vortex-file-compressed 13968132 / 14394473 / -3.0% 29237494 / 29455377 / -0.7% 0.48 / 0.49 / -2.2%
tpcds_q33/duckdb:vortex-file-compressed 35266248 / 34700222 / +1.6% 59254772 / 59240517 / +0.0% 0.60 / 0.59 / +1.6%
tpcds_q34/duckdb:vortex-file-compressed 25034369 / 22790526 / +9.8% 40957812 / 39503572 / +3.7% 0.61 / 0.58 / +5.9%
tpcds_q35/duckdb:vortex-file-compressed 69240909 / 67782824 / +2.2% 89431986 / 88529308 / +1.0% 0.77 / 0.77 / +1.1%
tpcds_q36/duckdb:vortex-file-compressed 31867463 / 29130798 / +9.4% 50676725 / 50492957 / +0.4% 0.63 / 0.58 / +9.0%
tpcds_q37/duckdb:vortex-file-compressed 26836180 / 27253876 / -1.5% 67601912 / 73576260 / -8.1% 0.40 / 0.37 / +7.2%
tpcds_q38/duckdb:vortex-file-compressed 61218060 / 59925660 / +2.2% 76265038 / 74764868 / +2.0% 0.80 / 0.80 / +0.1%
tpcds_q39/duckdb:vortex-file-compressed 57300614 / 57100517 / +0.4% 80419284 / 88068577 / -8.7% 0.71 / 0.65 / +9.9%
tpcds_q40/duckdb:vortex-file-compressed 19153664 / 19348808 / -1.0% 35254106 / 35361635 / -0.3% 0.54 / 0.55 / -0.7%
tpcds_q41/duckdb:vortex-file-compressed 19665118 / 19647300 / +0.1% 26193515 / 26567090 / -1.4% 0.75 / 0.74 / +1.5%
tpcds_q42/duckdb:vortex-file-compressed 15939810 / 14510201 / +9.9% 33936726 / 30474549 / +11.4% 🔴 0.47 / 0.48 / -1.4%
tpcds_q43/duckdb:vortex-file-compressed 21263634 / 20427220 / +4.1% 35641234 / 34461434 / +3.4% 0.60 / 0.59 / +0.6%
tpcds_q44/duckdb:vortex-file-compressed 27505215 / 28175370 / -2.4% 48533687 / 48535134 / -0.0% 0.57 / 0.58 / -2.4%
tpcds_q45/duckdb:vortex-file-compressed 46811402 / 47115118 / -0.6% 61102295 / 60617293 / +0.8% 0.77 / 0.78 / -1.4%
tpcds_q46/duckdb:vortex-file-compressed 52958758 / 51525064 / +2.8% 75550000 / 75390398 / +0.2% 0.70 / 0.68 / +2.6%
tpcds_q47/duckdb:vortex-file-compressed 83254375 / 81844244 / +1.7% 99912839 / 97648316 / +2.3% 0.83 / 0.84 / -0.6%
tpcds_q48/duckdb:vortex-file-compressed 55642063 / 53473376 / +4.1% 80018639 / 80968947 / -1.2% 0.70 / 0.66 / +5.3%
tpcds_q49/duckdb:vortex-file-compressed 39192902 / 37648214 / +4.1% 77501279 / 78573783 / -1.4% 0.51 / 0.48 / +5.5%
tpcds_q50/duckdb:vortex-file-compressed 34153270 / 32830688 / +4.0% 56446001 / 56211082 / +0.4% 0.61 / 0.58 / +3.6%
tpcds_q51/duckdb:vortex-file-compressed 208497962 / 205508376 / +1.5% 220880331 / 220366312 / +0.2% 0.94 / 0.93 / +1.2%
tpcds_q52/duckdb:vortex-file-compressed 17150660 / 14663330 / +17.0% 🔴 31853242 / 31081360 / +2.5% 0.54 / 0.47 / +14.1%
tpcds_q53/duckdb:vortex-file-compressed 24571820 / 22525805 / +9.1% 42837786 / 38260250 / +12.0% 🔴 0.57 / 0.59 / -2.6%
tpcds_q54/duckdb:vortex-file-compressed 45236710 / 44409558 / +1.9% 65563928 / 64372173 / +1.9% 0.69 / 0.69 / +0.0%
tpcds_q55/duckdb:vortex-file-compressed 16207670 / 14749303 / +9.9% 31600842 / 31744509 / -0.5% 0.51 / 0.46 / +10.4%
tpcds_q56/duckdb:vortex-file-compressed 34311630 / 33187872 / +3.4% 56709886 / 57188463 / -0.8% 0.61 / 0.58 / +4.3%
tpcds_q57/duckdb:vortex-file-compressed 64463599 / 64843531 / -0.6% 79538326 / 78043199 / +1.9% 0.81 / 0.83 / -2.5%
tpcds_q58/duckdb:vortex-file-compressed 39027574 / 37140895 / +5.1% 58219458 / 62700640 / -7.1% 0.67 / 0.59 / +13.2%
tpcds_q59/duckdb:vortex-file-compressed 57288898 / 53419163 / +7.2% 69159852 / 64912073 / +6.5% 0.83 / 0.82 / +0.7%
tpcds_q60/duckdb:vortex-file-compressed 36913736 / 35139361 / +5.0% 57402905 / 59023388 / -2.7% 0.64 / 0.60 / +8.0%
tpcds_q61/duckdb:vortex-file-compressed 35760958 / 35838040 / -0.2% 59193428 / 55135357 / +7.4% 0.60 / 0.65 / -7.1%
tpcds_q62/duckdb:vortex-file-compressed 15362370 / 18297085 / -16.0% 🟢 27935866 / 26280730 / +6.3% 0.55 / 0.70 / -21.0%
tpcds_q63/duckdb:vortex-file-compressed 23753866 / 21622339 / +9.9% 39915806 / 38522602 / +3.6% 0.60 / 0.56 / +6.0%
tpcds_q64/duckdb:vortex-file-compressed 118663617 / 118683998 / -0.0% 147321404 / 154509886 / -4.7% 0.81 / 0.77 / +4.9%
tpcds_q65/duckdb:vortex-file-compressed 54149179 / 53471124 / +1.3% 63617157 / 61064937 / +4.2% 0.85 / 0.88 / -2.8%
tpcds_q66/duckdb:vortex-file-compressed 42424120 / 43262786 / -1.9% 57823726 / 57897358 / -0.1% 0.73 / 0.75 / -1.8%
tpcds_q67/duckdb:vortex-file-compressed 274104480 / 278318512 / -1.5% 284193341 / 288037934 / -1.3% 0.96 / 0.97 / -0.2%
tpcds_q68/duckdb:vortex-file-compressed 45684962 / 44910465 / +1.7% 70017213 / 72534263 / -3.5% 0.65 / 0.62 / +5.4%
tpcds_q69/duckdb:vortex-file-compressed 40211854 / 38651880 / +4.0% 63288246 / 60604469 / +4.4% 0.64 / 0.64 / -0.4%
tpcds_q70/duckdb:vortex-file-compressed 28238494 / 25046006 / +12.7% 🔴 42431429 / 41966082 / +1.1% 0.67 / 0.60 / +11.5%
tpcds_q71/duckdb:vortex-file-compressed 29235312 / 27909166 / +4.8% 51442076 / 50156995 / +2.6% 0.57 / 0.56 / +2.1%
tpcds_q72/duckdb:vortex-file-compressed 138205406 / 139287054 / -0.8% 159033979 / 159676473 / -0.4% 0.87 / 0.87 / -0.4%
tpcds_q73/duckdb:vortex-file-compressed 22767046 / 19874364 / +14.6% 🔴 40116653 / 36330832 / +10.4% 🔴 0.57 / 0.55 / +3.7%
tpcds_q74/duckdb:vortex-file-compressed 84578536 / 85048735 / -0.6% 99824191 / 99211325 / +0.6% 0.85 / 0.86 / -1.2%
tpcds_q75/duckdb:vortex-file-compressed 114981582 / 112082818 / +2.6% 138651934 / 139888211 / -0.9% 0.83 / 0.80 / +3.5%
tpcds_q76/duckdb:vortex-file-compressed 28776376 / 27579541 / +4.3% 56158113 / 56451097 / -0.5% 0.51 / 0.49 / +4.9%
tpcds_q77/duckdb:vortex-file-compressed 38429975 / 36732643 / +4.6% 62161176 / 60252744 / +3.2% 0.62 / 0.61 / +1.4%
tpcds_q78/duckdb:vortex-file-compressed 138546580 / 138141032 / +0.3% 161141196 / 162180015 / -0.6% 0.86 / 0.85 / +0.9%
tpcds_q79/duckdb:vortex-file-compressed 37680990 / 37691475 / -0.0% 60334838 / 63147035 / -4.5% 0.62 / 0.60 / +4.6%
tpcds_q80/duckdb:vortex-file-compressed 59514505 / 61400592 / -3.1% 93644784 / 98021719 / -4.5% 0.64 / 0.63 / +1.5%
tpcds_q81/duckdb:vortex-file-compressed 56504466 / 57257572 / -1.3% 70520986 / 69763241 / +1.1% 0.80 / 0.82 / -2.4%
tpcds_q82/duckdb:vortex-file-compressed 28780244 / 28925109 / -0.5% 68396161 / 78702241 / -13.1% 🟢 0.42 / 0.37 / +14.5%
tpcds_q83/duckdb:vortex-file-compressed 21697458 / 21571937 / +0.6% 31974581 / 32329430 / -1.1% 0.68 / 0.67 / +1.7%
tpcds_q84/duckdb:vortex-file-compressed 14027237 / 13793324 / +1.7% 24231709 / 23878415 / +1.5% 0.58 / 0.58 / +0.2%
tpcds_q85/duckdb:vortex-file-compressed 36726417 / 36935050 / -0.6% 54502907 / 55748237 / -2.2% 0.67 / 0.66 / +1.7%
tpcds_q86/duckdb:vortex-file-compressed 16911539 / 16972827 / -0.4% 28593115 / 29566004 / -3.3% 0.59 / 0.57 / +3.0%
tpcds_q87/duckdb:vortex-file-compressed 78432941 / 77902528 / +0.7% 90844293 / 93420215 / -2.8% 0.86 / 0.83 / +3.5%
tpcds_q88/duckdb:vortex-file-compressed 39846752 / 38196280 / +4.3% 50810458 / 49021762 / +3.6% 0.78 / 0.78 / +0.6%
tpcds_q89/duckdb:vortex-file-compressed 26719825 / 24443410 / +9.3% 42531429 / 40903432 / +4.0% 0.63 / 0.60 / +5.1%
tpcds_q90/duckdb:vortex-file-compressed 9882384 / 10013898 / -1.3% 21070339 / 20711047 / +1.7% 0.47 / 0.48 / -3.0%
tpcds_q91/duckdb:vortex-file-compressed 19749138 / 19634476 / +0.6% 28396795 / 27311714 / +4.0% 0.70 / 0.72 / -3.3%
tpcds_q92/duckdb:vortex-file-compressed 13854818 / 13548709 / +2.3% 27063356 / 28278278 / -4.3% 0.51 / 0.48 / +6.8%
tpcds_q93/duckdb:vortex-file-compressed 25844646 / 25407901 / +1.7% 54009016 / 51991573 / +3.9% 0.48 / 0.49 / -2.1%
tpcds_q94/duckdb:vortex-file-compressed 32485890 / 32421666 / +0.2% 46701938 / 48367412 / -3.4% 0.70 / 0.67 / +3.8%
tpcds_q95/duckdb:vortex-file-compressed 97102444 / 93462994 / +3.9% 122026539 / 105079673 / +16.1% 🔴 0.80 / 0.89 / -10.5%
tpcds_q96/duckdb:vortex-file-compressed 14190939 / 11852274 / +19.7% 🔴 27740586 / 25577562 / +8.5% 0.51 / 0.46 / +10.4%
tpcds_q97/duckdb:vortex-file-compressed 61243384 / 61109452 / +0.2% 84740390 / 83004624 / +2.1% 0.72 / 0.74 / -1.8%
tpcds_q98/duckdb:vortex-file-compressed 28951464 / 27085630 / +6.9% 45044569 / 45016718 / +0.1% 0.64 / 0.60 / +6.8%
tpcds_q99/duckdb:vortex-file-compressed 25562368 / 20807356 / +22.9% 🔴 37210162 / 36583289 / +1.7% 0.69 / 0.57 / +20.8%
duckdb / parquet / ns (0.998x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 42102337 / 41411833 / +1.7% 50582108 / 50330845 / +0.5% 0.83 / 0.82 / +1.2%
tpcds_q02/duckdb:parquet 38222814 / 40151418 / -4.8% 43891434 / 48109762 / -8.8% 0.87 / 0.83 / +4.3%
tpcds_q03/duckdb:parquet 25192716 / 24639136 / +2.2% 35816453 / 38230840 / -6.3% 0.70 / 0.64 / +9.1%
tpcds_q04/duckdb:parquet 204720174 / 202387014 / +1.2% 224308426 / 224999819 / -0.3% 0.91 / 0.90 / +1.5%
tpcds_q05/duckdb:parquet 68755937 / 69747180 / -1.4% 83195279 / 85614145 / -2.8% 0.83 / 0.81 / +1.4%
tpcds_q06/duckdb:parquet 74380356 / 74792468 / -0.6% 87378227 / 87156942 / +0.3% 0.85 / 0.86 / -0.8%
tpcds_q07/duckdb:parquet 59240016 / 62315450 / -4.9% 79555046 / 75375742 / +5.5% 0.74 / 0.83 / -9.9%
tpcds_q08/duckdb:parquet 40583568 / 38536233 / +5.3% 46756632 / 46956728 / -0.4% 0.87 / 0.82 / +5.8%
tpcds_q09/duckdb:parquet 87163652 / 86754632 / +0.5% 101824011 / 91623337 / +11.1% 🔴 0.86 / 0.95 / -9.6%
tpcds_q10/duckdb:parquet 51982882 / 52127956 / -0.3% 63341011 / 62197454 / +1.8% 0.82 / 0.84 / -2.1%
tpcds_q11/duckdb:parquet 156787068 / 158010400 / -0.8% 165444947 / 164097798 / +0.8% 0.95 / 0.96 / -1.6%
tpcds_q12/duckdb:parquet 39918200 / 40201510 / -0.7% 46214978 / 48714777 / -5.1% 0.86 / 0.83 / +4.7%
tpcds_q13/duckdb:parquet 69647300 / 71340386 / -2.4% 84202752 / 86527176 / -2.7% 0.83 / 0.82 / +0.3%
tpcds_q14/duckdb:parquet 185081188 / 187490772 / -1.3% 192401428 / 202477522 / -5.0% 0.96 / 0.93 / +3.9%
tpcds_q15/duckdb:parquet 60824026 / 60653064 / +0.3% 68690874 / 68767023 / -0.1% 0.89 / 0.88 / +0.4%
tpcds_q16/duckdb:parquet 37872272 / 37782536 / +0.2% 46450461 / 46105209 / +0.7% 0.82 / 0.82 / -0.5%
tpcds_q17/duckdb:parquet 83787910 / 82847564 / +1.1% 89576122 / 88761359 / +0.9% 0.94 / 0.93 / +0.2%
tpcds_q18/duckdb:parquet 87747276 / 87476864 / +0.3% 97514474 / 96901439 / +0.6% 0.90 / 0.90 / -0.3%
tpcds_q19/duckdb:parquet 47950272 / 47853123 / +0.2% 63100957 / 62067396 / +1.7% 0.76 / 0.77 / -1.4%
tpcds_q20/duckdb:parquet 42893425 / 43249852 / -0.8% 49248526 / 50719745 / -2.9% 0.87 / 0.85 / +2.1%
tpcds_q21/duckdb:parquet 23861254 / 23988143 / -0.5% 28331241 / 28513407 / -0.6% 0.84 / 0.84 / +0.1%
tpcds_q22/duckdb:parquet 162918866 / 164709200 / -1.1% 165739880 / 168322845 / -1.5% 0.98 / 0.98 / +0.5%
tpcds_q23/duckdb:parquet 182671448 / 188569684 / -3.1% 193204267 / 196046445 / -1.4% 0.95 / 0.96 / -1.7%
tpcds_q24/duckdb:parquet 71077578 / 72144454 / -1.5% 84072351 / 86039623 / -2.3% 0.85 / 0.84 / +0.8%
tpcds_q25/duckdb:parquet 51406232 / 50259293 / +2.3% 60562187 / 60687516 / -0.2% 0.85 / 0.83 / +2.5%
tpcds_q26/duckdb:parquet 42419644 / 42537823 / -0.3% 51613215 / 51296561 / +0.6% 0.82 / 0.83 / -0.9%
tpcds_q27/duckdb:parquet 59461952 / 58634844 / +1.4% 72124873 / 74042519 / -2.6% 0.82 / 0.79 / +4.1%
tpcds_q28/duckdb:parquet 92452106 / 92966380 / -0.6% 107621469 / 107295070 / +0.3% 0.86 / 0.87 / -0.9%
tpcds_q29/duckdb:parquet 81973198 / 84166501 / -2.6% 97192325 / 98154221 / -1.0% 0.84 / 0.86 / -1.6%
tpcds_q30/duckdb:parquet 72007151 / 71784536 / +0.3% 80610000 / 80690972 / -0.1% 0.89 / 0.89 / +0.4%
tpcds_q31/duckdb:parquet 98871517 / 98811001 / +0.1% 109301068 / 110982113 / -1.5% 0.90 / 0.89 / +1.6%
tpcds_q32/duckdb:parquet 18322000 / 18151863 / +0.9% 26089944 / 26520557 / -1.6% 0.70 / 0.68 / +2.6%
tpcds_q33/duckdb:parquet 62920660 / 63760030 / -1.3% 73753139 / 74898471 / -1.5% 0.85 / 0.85 / +0.2%
tpcds_q34/duckdb:parquet 32783176 / 31608494 / +3.7% 39361119 / 42160796 / -6.6% 0.83 / 0.75 / +11.1%
tpcds_q35/duckdb:parquet 77068812 / 76946453 / +0.2% 86956123 / 85928651 / +1.2% 0.89 / 0.90 / -1.0%
tpcds_q36/duckdb:parquet 99398362 / 97676660 / +1.8% 113556631 / 111727834 / +1.6% 0.88 / 0.87 / +0.1%
tpcds_q37/duckdb:parquet 41294974 / 40638086 / +1.6% 46033545 / 45871930 / +0.4% 0.90 / 0.89 / +1.3%
tpcds_q38/duckdb:parquet 75552428 / 77147604 / -2.1% 80509955 / 83066340 / -3.1% 0.94 / 0.93 / +1.0%
tpcds_q39/duckdb:parquet 61320436 / 61708064 / -0.6% 67056876 / 68741173 / -2.5% 0.91 / 0.90 / +1.9%
tpcds_q40/duckdb:parquet 28017764 / 27935482 / +0.3% 35461242 / 36104052 / -1.8% 0.79 / 0.77 / +2.1%
tpcds_q41/duckdb:parquet 19755598 / 20421025 / -3.3% 26179131 / 26675395 / -1.9% 0.75 / 0.77 / -1.4%
tpcds_q42/duckdb:parquet 25667068 / 25538393 / +0.5% 37402294 / 35928456 / +4.1% 0.69 / 0.71 / -3.5%
tpcds_q43/duckdb:parquet 27734396 / 27426727 / +1.1% 33083611 / 39066396 / -15.3% 🟢 0.84 / 0.70 / +19.4%
tpcds_q44/duckdb:parquet 61468378 / 60417942 / +1.7% 75124767 / 76049590 / -1.2% 0.82 / 0.79 / +3.0%
tpcds_q45/duckdb:parquet 62619324 / 60966350 / +2.7% 67407221 / 69569943 / -3.1% 0.93 / 0.88 / +6.0%
tpcds_q46/duckdb:parquet 73214586 / 72858778 / +0.5% 89675375 / 87476624 / +2.5% 0.82 / 0.83 / -2.0%
tpcds_q47/duckdb:parquet 90217753 / 91108504 / -1.0% 101323500 / 101938455 / -0.6% 0.89 / 0.89 / -0.4%
tpcds_q48/duckdb:parquet 66223619 / 68493255 / -3.3% 80452859 / 77961604 / +3.2% 0.82 / 0.88 / -6.3%
tpcds_q49/duckdb:parquet 67213000 / 68745034 / -2.2% 89665941 / 89316606 / +0.4% 0.75 / 0.77 / -2.6%
tpcds_q50/duckdb:parquet 44788622 / 44677016 / +0.2% 53085455 / 54280014 / -2.2% 0.84 / 0.82 / +2.5%
tpcds_q51/duckdb:parquet 218547725 / 217333293 / +0.6% 225940050 / 218624612 / +3.3% 0.97 / 0.99 / -2.7%
tpcds_q52/duckdb:parquet 25562780 / 26456753 / -3.4% 38373823 / 39025051 / -1.7% 0.67 / 0.68 / -1.7%
tpcds_q53/duckdb:parquet 35380736 / 34065543 / +3.9% 41936495 / 47344981 / -11.4% 🟢 0.84 / 0.72 / +17.3%
tpcds_q54/duckdb:parquet 54486652 / 56419478 / -3.4% 66220222 / 66989268 / -1.1% 0.82 / 0.84 / -2.3%
tpcds_q55/duckdb:parquet 26056484 / 26280216 / -0.9% 39700642 / 38075005 / +4.3% 0.66 / 0.69 / -4.9%
tpcds_q56/duckdb:parquet 68061938 / 69801366 / -2.5% 83883045 / 80332383 / +4.4% 0.81 / 0.87 / -6.6%
tpcds_q57/duckdb:parquet 67827350 / 68304389 / -0.7% 75342698 / 74989417 / +0.5% 0.90 / 0.91 / -1.2%
tpcds_q58/duckdb:parquet 55374254 / 56063354 / -1.2% 64736012 / 68493005 / -5.5% 0.86 / 0.82 / +4.5%
tpcds_q59/duckdb:parquet 61420666 / 61324346 / +0.2% 66354723 / 67577162 / -1.8% 0.93 / 0.91 / +2.0%
tpcds_q60/duckdb:parquet 81241623 / 82507134 / -1.5% 94429844 / 98756932 / -4.4% 0.86 / 0.84 / +3.0%
tpcds_q61/duckdb:parquet 78753695 / 79267990 / -0.6% 95512644 / 94326994 / +1.3% 0.82 / 0.84 / -1.9%
tpcds_q62/duckdb:parquet 21123902 / 19074495 / +10.7% 🔴 26187639 / 26064756 / +0.5% 0.81 / 0.73 / +10.2%
tpcds_q63/duckdb:parquet 33086506 / 34002222 / -2.7% 44493339 / 46476947 / -4.3% 0.74 / 0.73 / +1.6%
tpcds_q64/duckdb:parquet 136265520 / 134475540 / +1.3% 150087581 / 151168563 / -0.7% 0.91 / 0.89 / +2.1%
tpcds_q65/duckdb:parquet 91126728 / 89330937 / +2.0% 105582358 / 94616735 / +11.6% 🔴 0.86 / 0.94 / -8.6%
tpcds_q66/duckdb:parquet 45725730 / 46881216 / -2.5% 53099009 / 53729413 / -1.2% 0.86 / 0.87 / -1.3%
tpcds_q67/duckdb:parquet 293141444 / 291866356 / +0.4% 307717648 / 307284269 / +0.1% 0.95 / 0.95 / +0.3%
tpcds_q68/duckdb:parquet 60304760 / 62770597 / -3.9% 82620400 / 75672834 / +9.2% 0.73 / 0.83 / -12.0%
tpcds_q69/duckdb:parquet 65256264 / 65894120 / -1.0% 78046252 / 77193869 / +1.1% 0.84 / 0.85 / -2.0%
tpcds_q70/duckdb:parquet 43989676 / 42353503 / +3.9% 56420880 / 55783597 / +1.1% 0.78 / 0.76 / +2.7%
tpcds_q71/duckdb:parquet 40999126 / 40821024 / +0.4% 56886984 / 57262044 / -0.7% 0.72 / 0.71 / +1.1%
tpcds_q72/duckdb:parquet 171948158 / 173956853 / -1.2% 184582584 / 183832900 / +0.4% 0.93 / 0.95 / -1.6%
tpcds_q73/duckdb:parquet 27370914 / 29100228 / -5.9% 35998789 / 38113116 / -5.5% 0.76 / 0.76 / -0.4%
tpcds_q74/duckdb:parquet 212811640 / 213731775 / -0.4% 226197780 / 222880901 / +1.5% 0.94 / 0.96 / -1.9%
tpcds_q75/duckdb:parquet 135100631 / 133516234 / +1.2% 150664937 / 149749659 / +0.6% 0.90 / 0.89 / +0.6%
tpcds_q76/duckdb:parquet 50790754 / 52111897 / -2.5% 67959406 / 66511627 / +2.2% 0.75 / 0.78 / -4.6%
tpcds_q77/duckdb:parquet 55847316 / 55091250 / +1.4% 73569863 / 70384621 / +4.5% 0.76 / 0.78 / -3.0%
tpcds_q78/duckdb:parquet 145775810 / 155445746 / -6.2% 155488346 / 177584613 / -12.4% 🟢 0.94 / 0.88 / +7.1%
tpcds_q79/duckdb:parquet 52396878 / 50483421 / +3.8% 73275092 / 71000203 / +3.2% 0.72 / 0.71 / +0.6%
tpcds_q80/duckdb:parquet 82788246 / 81998815 / +1.0% 105908240 / 101411967 / +4.4% 0.78 / 0.81 / -3.3%
tpcds_q81/duckdb:parquet 98367338 / 97870895 / +0.5% 107601333 / 104747993 / +2.7% 0.91 / 0.93 / -2.2%
tpcds_q82/duckdb:parquet 45756132 / 46244812 / -1.1% 52531536 / 54626811 / -3.8% 0.87 / 0.85 / +2.9%
tpcds_q83/duckdb:parquet 28138280 / 28125027 / +0.0% 33288393 / 33164607 / +0.4% 0.85 / 0.85 / -0.3%
tpcds_q84/duckdb:parquet 22654302 / 22618490 / +0.2% 29586832 / 29190640 / +1.4% 0.77 / 0.77 / -1.2%
tpcds_q85/duckdb:parquet 51870848 / 51585785 / +0.6% 62574250 / 60477752 / +3.5% 0.83 / 0.85 / -2.8%
tpcds_q86/duckdb:parquet 25484380 / 27074516 / -5.9% 30722489 / 30641267 / +0.3% 0.83 / 0.88 / -6.1%
tpcds_q87/duckdb:parquet 88106236 / 86846626 / +1.5% 94910432 / 95206482 / -0.3% 0.93 / 0.91 / +1.8%
tpcds_q88/duckdb:parquet 102786457 / 105479012 / -2.6% 108909274 / 112907524 / -3.5% 0.94 / 0.93 / +1.0%
tpcds_q89/duckdb:parquet 37110787 / 37214810 / -0.3% 48660870 / 49270655 / -1.2% 0.76 / 0.76 / +1.0%
tpcds_q90/duckdb:parquet 15710400 / 15168123 / +3.6% 19592214 / 20710570 / -5.4% 0.80 / 0.73 / +9.5%
tpcds_q91/duckdb:parquet 25440692 / 25505233 / -0.3% 33874371 / 32837411 / +3.2% 0.75 / 0.78 / -3.3%
tpcds_q92/duckdb:parquet 21379620 / 21822424 / -2.0% 28518008 / 29251737 / -2.5% 0.75 / 0.75 / +0.5%
tpcds_q93/duckdb:parquet 35706156 / 36521322 / -2.2% 49656765 / 47601222 / +4.3% 0.72 / 0.77 / -6.3%
tpcds_q94/duckdb:parquet 38768326 / 39023368 / -0.7% 47737616 / 44936044 / +6.2% 0.81 / 0.87 / -6.5%
tpcds_q95/duckdb:parquet 81487810 / 80915454 / +0.7% 87790474 / 87073511 / +0.8% 0.93 / 0.93 / -0.1%
tpcds_q96/duckdb:parquet 17510406 / 16735182 / +4.6% 24023704 / 23617355 / +1.7% 0.73 / 0.71 / +2.9%
tpcds_q97/duckdb:parquet 71260068 / 72982410 / -2.4% 83273068 / 84589553 / -1.6% 0.86 / 0.86 / -0.8%
tpcds_q98/duckdb:parquet 54831676 / 55657062 / -1.5% 65583713 / 65158691 / +0.7% 0.84 / 0.85 / -2.1%
tpcds_q99/duckdb:parquet 25556896 / 24058509 / +6.2% 32338530 / 32826965 / -1.5% 0.79 / 0.73 / +7.8%

File Size Changes (33 files changed, -10.2% overall, 7↑ 26↓)
File Scale Format Base HEAD Change %
income_band_0001.vortex 10.0 vortex-file-compressed 5.08 KB 5.11 KB +32 B +0.6%
reason_0001.vortex 10.0 vortex-file-compressed 8.26 KB 8.29 KB +32 B +0.4%
ship_mode_0001.vortex 10.0 vortex-file-compressed 13.56 KB 13.60 KB +40 B +0.3%
household_demographics_0001.vortex 10.0 vortex-file-compressed 16.31 KB 16.35 KB +40 B +0.2%
warehouse_0001.vortex 10.0 vortex-file-compressed 27.68 KB 27.72 KB +40 B +0.1%
web_site_0001.vortex 10.0 vortex-file-compressed 59.07 KB 59.11 KB +40 B +0.1%
call_center_0001.vortex 10.0 vortex-file-compressed 63.29 KB 63.32 KB +40 B +0.1%
web_page_0001.vortex 10.0 vortex-file-compressed 34.55 KB 34.31 KB -248 B -0.7%
catalog_sales_0002.vortex 10.0 vortex-file-compressed 167.78 MB 165.95 MB -1.83 MB -1.1%
catalog_sales_0004.vortex 10.0 vortex-file-compressed 168.15 MB 166.26 MB -1.89 MB -1.1%
catalog_sales_0003.vortex 10.0 vortex-file-compressed 167.70 MB 165.74 MB -1.96 MB -1.2%
catalog_sales_0001.vortex 10.0 vortex-file-compressed 168.18 MB 165.88 MB -2.30 MB -1.4%
store_0001.vortex 10.0 vortex-file-compressed 76.36 KB 74.73 KB -1.62 KB -2.1%
web_sales_0001.vortex 10.0 vortex-file-compressed 164.92 MB 161.02 MB -3.90 MB -2.4%
web_sales_0002.vortex 10.0 vortex-file-compressed 164.82 MB 160.71 MB -4.11 MB -2.5%
promotion_0001.vortex 10.0 vortex-file-compressed 62.91 KB 60.99 KB -1.91 KB -3.0%
web_returns_0001.vortex 10.0 vortex-file-compressed 35.77 MB 34.61 MB -1.16 MB -3.3%
store_sales_0002.vortex 10.0 vortex-file-compressed 204.05 MB 196.74 MB -7.31 MB -3.6%
store_sales_0005.vortex 10.0 vortex-file-compressed 204.05 MB 196.68 MB -7.37 MB -3.6%
store_sales_0003.vortex 10.0 vortex-file-compressed 204.04 MB 196.62 MB -7.42 MB -3.6%
store_sales_0001.vortex 10.0 vortex-file-compressed 204.03 MB 196.54 MB -7.49 MB -3.7%
store_returns_0001.vortex 10.0 vortex-file-compressed 113.84 MB 109.16 MB -4.68 MB -4.1%
catalog_returns_0001.vortex 10.0 vortex-file-compressed 72.42 MB 69.25 MB -3.17 MB -4.4%
store_sales_0004.vortex 10.0 vortex-file-compressed 204.07 MB 195.03 MB -9.04 MB -4.4%
customer_0001.vortex 10.0 vortex-file-compressed 21.63 MB 19.94 MB -1.68 MB -7.8%
catalog_page_0001.vortex 10.0 vortex-file-compressed 596.69 KB 546.83 KB -49.86 KB -8.4%
item_0001.vortex 10.0 vortex-file-compressed 7.70 MB 6.99 MB -724.64 KB -9.2%
customer_address_0001.vortex 10.0 vortex-file-compressed 3.76 MB 3.33 MB -434.29 KB -11.3%
customer_demographics_0001.vortex 10.0 vortex-file-compressed 1.48 MB 1.18 MB -309.34 KB -20.4%
time_dim_0001.vortex 10.0 vortex-file-compressed 441.56 KB 318.51 KB -123.05 KB -27.9%
date_dim_0001.vortex 10.0 vortex-file-compressed 1013.55 KB 580.59 KB -432.96 KB -42.7%
inventory_0001.vortex 10.0 vortex-file-compressed 223.32 MB 122.63 MB -100.69 MB -45.1%
inventory_0002.vortex 10.0 vortex-file-compressed 223.32 MB 114.10 MB -109.22 MB -48.9%

Totals:

  • vortex-file-compressed: 2.66 GB → 2.39 GB (-10.2%)

@gatesn
gatesn disabled stacked auto-merge November 18, 2026 20:38
Base automatically changed from ngates/shared-scan-api to develop November 18, 2026 20:38
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn
gatesn force-pushed the ngates/datafusion-shared-scan-driver branch from 2e569f7 to 28218cf Compare November 18, 2026 20:39
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.005x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 21978824 / 21580563 / +1.8% 43162344 / 40491065 / +6.6% 0.51 / 0.53 / -4.5%
tpcds_q02/datafusion:vortex-compact 42941098 / 43606036 / -1.5% 65183222 / 64413583 / +1.2% 0.66 / 0.68 / -2.7%
tpcds_q03/datafusion:vortex-compact 11916300 / 12436379 / -4.2% 33194923 / 33585343 / -1.2% 0.36 / 0.37 / -3.1%
tpcds_q04/datafusion:vortex-compact 88651059 / 89317840 / -0.7% 123492561 / 120270074 / +2.7% 0.72 / 0.74 / -3.3%
tpcds_q05/datafusion:vortex-compact 58398678 / 58364808 / +0.1% 82333140 / 82555227 / -0.3% 0.71 / 0.71 / +0.3%
tpcds_q06/datafusion:vortex-compact 24382808 / 24290510 / +0.4% 47433909 / 46531199 / +1.9% 0.51 / 0.52 / -1.5%
tpcds_q07/datafusion:vortex-compact 28579999 / 29104944 / -1.8% 50663960 / 50334403 / +0.7% 0.56 / 0.58 / -2.4%
tpcds_q08/datafusion:vortex-compact 27009556 / 27001554 / +0.0% 50550284 / 49353424 / +2.4% 0.53 / 0.55 / -2.3%
tpcds_q09/datafusion:vortex-compact 21660320 / 21614045 / +0.2% 41817623 / 39847486 / +4.9% 0.52 / 0.54 / -4.5%
tpcds_q10/datafusion:vortex-compact 34449638 / 35323389 / -2.5% 60782155 / 57354684 / +6.0% 0.57 / 0.62 / -8.0%
tpcds_q11/datafusion:vortex-compact 53193078 / 52631436 / +1.1% 82390046 / 84070084 / -2.0% 0.65 / 0.63 / +3.1%
tpcds_q12/datafusion:vortex-compact 19330336 / 19584026 / -1.3% 40281922 / 39381692 / +2.3% 0.48 / 0.50 / -3.5%
tpcds_q13/datafusion:vortex-compact 45585308 / 45734844 / -0.3% 68008470 / 68902887 / -1.3% 0.67 / 0.66 / +1.0%
tpcds_q14/datafusion:vortex-compact 650398478 / 649741734 / +0.1% 706560695 / 708369216 / -0.3% 0.92 / 0.92 / +0.4%
tpcds_q15/datafusion:vortex-compact 13396964 / 13457474 / -0.4% 34586206 / 33369668 / +3.6% 0.39 / 0.40 / -4.0%
tpcds_q16/datafusion:vortex-compact 20145978 / 20066328 / +0.4% 40085494 / 40362379 / -0.7% 0.50 / 0.50 / +1.1%
tpcds_q17/datafusion:vortex-compact 56831106 / 57312214 / -0.8% 83652730 / 79993684 / +4.6% 0.68 / 0.72 / -5.2%
tpcds_q18/datafusion:vortex-compact 63033810 / 62455041 / +0.9% 77558112 / 74562688 / +4.0% 0.81 / 0.84 / -3.0%
tpcds_q19/datafusion:vortex-compact 20553356 / 20037206 / +2.6% 41658786 / 42087142 / -1.0% 0.49 / 0.48 / +3.6%
tpcds_q20/datafusion:vortex-compact 20744262 / 20939252 / -0.9% 43499150 / 41199496 / +5.6% 0.48 / 0.51 / -6.2%
tpcds_q21/datafusion:vortex-compact 17820368 / 17677564 / +0.8% 38610871 / 37549496 / +2.8% 0.46 / 0.47 / -2.0%
tpcds_q22/datafusion:vortex-compact 51535372 / 50877368 / +1.3% 73180588 / 72981072 / +0.3% 0.70 / 0.70 / +1.0%
tpcds_q23/datafusion:vortex-compact 73291937 / 74302408 / -1.4% 101867623 / 102015859 / -0.1% 0.72 / 0.73 / -1.2%
tpcds_q24/datafusion:vortex-compact 69966246 / 70150540 / -0.3% 95104134 / 95840764 / -0.8% 0.74 / 0.73 / +0.5%
tpcds_q25/datafusion:vortex-compact 50128343 / 48964962 / +2.4% 80832185 / 68592847 / +17.8% 🔴 0.62 / 0.71 / -13.1%
tpcds_q26/datafusion:vortex-compact 28756013 / 29250020 / -1.7% 47345395 / 48655418 / -2.7% 0.61 / 0.60 / +1.0%
tpcds_q27/datafusion:vortex-compact 52067447 / 53010096 / -1.8% 82417760 / 81355098 / +1.3% 0.63 / 0.65 / -3.0%
tpcds_q28/datafusion:vortex-compact 22356744 / 23511532 / -4.9% 44478719 / 43560346 / +2.1% 0.50 / 0.54 / -6.9%
tpcds_q29/datafusion:vortex-compact 53018313 / 56337130 / -5.9% 71712204 / 76560273 / -6.3% 0.74 / 0.74 / +0.5%
tpcds_q30/datafusion:vortex-compact 29562720 / 29393888 / +0.6% 49216750 / 49387711 / -0.3% 0.60 / 0.60 / +0.9%
tpcds_q31/datafusion:vortex-compact 67394236 / 68323034 / -1.4% 96204737 / 94669762 / +1.6% 0.70 / 0.72 / -2.9%
tpcds_q32/datafusion:vortex-compact 14113538 / 13821853 / +2.1% 34586794 / 33646689 / +2.8% 0.41 / 0.41 / -0.7%
tpcds_q33/datafusion:vortex-compact 29077705 / 29390014 / -1.1% 54236401 / 53630077 / +1.1% 0.54 / 0.55 / -2.2%
tpcds_q34/datafusion:vortex-compact 20593844 / 19881163 / +3.6% 42164788 / 40486417 / +4.1% 0.49 / 0.49 / -0.5%
tpcds_q35/datafusion:vortex-compact 36894446 / 37654824 / -2.0% 63489665 / 63954543 / -0.7% 0.58 / 0.59 / -1.3%
tpcds_q36/datafusion:vortex-compact 51597482 / 51602954 / -0.0% 75575026 / 74028424 / +2.1% 0.68 / 0.70 / -2.1%
tpcds_q37/datafusion:vortex-compact 14987366 / 14635389 / +2.4% 37467966 / 38322537 / -2.2% 0.40 / 0.38 / +4.7%
tpcds_q38/datafusion:vortex-compact 28071514 / 28229912 / -0.6% 49265637 / 49443843 / -0.4% 0.57 / 0.57 / -0.2%
tpcds_q39/datafusion:vortex-compact 67731800 / 66953734 / +1.2% 89437203 / 88573118 / +1.0% 0.76 / 0.76 / +0.2%
tpcds_q40/datafusion:vortex-compact 23673622 / 23958072 / -1.2% 46196752 / 44714761 / +3.3% 0.51 / 0.54 / -4.4%
tpcds_q41/datafusion:vortex-compact 20615978 / 20808258 / -0.9% 36055090 / 35548338 / +1.4% 0.57 / 0.59 / -2.3%
tpcds_q42/datafusion:vortex-compact 12227782 / 11998175 / +1.9% 34400280 / 32596333 / +5.5% 0.36 / 0.37 / -3.4%
tpcds_q43/datafusion:vortex-compact 14124126 / 14250206 / -0.9% 35688127 / 34493352 / +3.5% 0.40 / 0.41 / -4.2%
tpcds_q44/datafusion:vortex-compact 27050164 / 27204122 / -0.6% 50711822 / 49936710 / +1.6% 0.53 / 0.54 / -2.1%
tpcds_q45/datafusion:vortex-compact 17610891 / 18211926 / -3.3% 38664141 / 38303526 / +0.9% 0.46 / 0.48 / -4.2%
tpcds_q46/datafusion:vortex-compact 26564166 / 26551628 / +0.0% 48782035 / 46944233 / +3.9% 0.54 / 0.57 / -3.7%
tpcds_q47/datafusion:vortex-compact 80678858 / 79765694 / +1.1% 112715804 / 112322281 / +0.4% 0.72 / 0.71 / +0.8%
tpcds_q48/datafusion:vortex-compact 42563308 / 42131573 / +1.0% 63508728 / 70595703 / -10.0% 🟢 0.67 / 0.60 / +12.3%
tpcds_q49/datafusion:vortex-compact 58833191 / 58316121 / +0.9% 81775848 / 78618261 / +4.0% 0.72 / 0.74 / -3.0%
tpcds_q50/datafusion:vortex-compact 32308646 / 33586632 / -3.8% 52595803 / 57004071 / -7.7% 0.61 / 0.59 / +4.3%
tpcds_q51/datafusion:vortex-compact 67467463 / 67779434 / -0.5% 89128185 / 89996238 / -1.0% 0.76 / 0.75 / +0.5%
tpcds_q52/datafusion:vortex-compact 12401264 / 12341530 / +0.5% 32798144 / 33610069 / -2.4% 0.38 / 0.37 / +3.0%
tpcds_q53/datafusion:vortex-compact 22189730 / 22179534 / +0.0% 45212081 / 45500950 / -0.6% 0.49 / 0.49 / +0.7%
tpcds_q54/datafusion:vortex-compact 34367379 / 34116126 / +0.7% 61515995 / 59488701 / +3.4% 0.56 / 0.57 / -2.6%
tpcds_q55/datafusion:vortex-compact 11726840 / 11952067 / -1.9% 33926757 / 32593584 / +4.1% 0.35 / 0.37 / -5.7%
tpcds_q56/datafusion:vortex-compact 28325569 / 28448452 / -0.4% 53017025 / 51225179 / +3.5% 0.53 / 0.56 / -3.8%
tpcds_q57/datafusion:vortex-compact 67521178 / 67443142 / +0.1% 96107608 / 96808513 / -0.7% 0.70 / 0.70 / +0.8%
tpcds_q58/datafusion:vortex-compact 45335396 / 45487320 / -0.3% 73802275 / 75406137 / -2.1% 0.61 / 0.60 / +1.8%
tpcds_q59/datafusion:vortex-compact 29501787 / 30152862 / -2.2% 55333369 / 55563566 / -0.4% 0.53 / 0.54 / -1.8%
tpcds_q60/datafusion:vortex-compact 28145868 / 27949036 / +0.7% 52736564 / 50600039 / +4.2% 0.53 / 0.55 / -3.4%
tpcds_q61/datafusion:vortex-compact 25190952 / 24959987 / +0.9% 46110522 / 44384441 / +3.9% 0.55 / 0.56 / -2.9%
tpcds_q62/datafusion:vortex-compact 16922415 / 16828268 / +0.6% 34804192 / 34879755 / -0.2% 0.49 / 0.48 / +0.8%
tpcds_q63/datafusion:vortex-compact 22233460 / 21770965 / +2.1% 45268700 / 46335863 / -2.3% 0.49 / 0.47 / +4.5%
tpcds_q64/datafusion:vortex-compact 280710882 / 283224116 / -0.9% 313520996 / 313038089 / +0.2% 0.90 / 0.90 / -1.0%
tpcds_q65/datafusion:vortex-compact 77996086 / 77373738 / +0.8% 101637054 / 102789665 / -1.1% 0.77 / 0.75 / +1.9%
tpcds_q66/datafusion:vortex-compact 50864386 / 51030680 / -0.3% 74751344 / 73096826 / +2.3% 0.68 / 0.70 / -2.5%
tpcds_q67/datafusion:vortex-compact 52746903 / 54019842 / -2.4% 87024153 / 85981933 / +1.2% 0.61 / 0.63 / -3.5%
tpcds_q68/datafusion:vortex-compact 27317084 / 26597902 / +2.7% 49487901 / 48578773 / +1.9% 0.55 / 0.55 / +0.8%
tpcds_q69/datafusion:vortex-compact 33311204 / 33849586 / -1.6% 58366286 / 60103921 / -2.9% 0.57 / 0.56 / +1.3%
tpcds_q70/datafusion:vortex-compact 75163825 / 74715588 / +0.6% 98011279 / 96272773 / +1.8% 0.77 / 0.78 / -1.2%
tpcds_q71/datafusion:vortex-compact 19644338 / 19669445 / -0.1% 41512097 / 42863832 / -3.2% 0.47 / 0.46 / +3.1%
tpcds_q72/datafusion:vortex-compact 274256141 / 268468836 / +2.2% 317391408 / 191525056 / +65.7% 🔴 0.86 / 1.40 / -38.4%
tpcds_q73/datafusion:vortex-compact 21644982 / 20040453 / +8.0% 42954734 / 41331206 / +3.9% 0.50 / 0.48 / +3.9%
tpcds_q74/datafusion:vortex-compact 42467161 / 43256730 / -1.8% 72396243 / 70277030 / +3.0% 0.59 / 0.62 / -4.7%
tpcds_q75/datafusion:vortex-compact 140416585 / 139744186 / +0.5% 166121095 / 166487060 / -0.2% 0.85 / 0.84 / +0.7%
tpcds_q76/datafusion:vortex-compact 29212658 / 29851902 / -2.1% 50518671 / 51004760 / -1.0% 0.58 / 0.59 / -1.2%
tpcds_q77/datafusion:vortex-compact 46721438 / 46872810 / -0.3% 71960872 / 69853132 / +3.0% 0.65 / 0.67 / -3.2%
tpcds_q78/datafusion:vortex-compact 65091882 / 64857579 / +0.4% 92382562 / 90773451 / +1.8% 0.70 / 0.71 / -1.4%
tpcds_q79/datafusion:vortex-compact 23044070 / 22717913 / +1.4% 44754990 / 42604516 / +5.0% 0.51 / 0.53 / -3.4%
tpcds_q80/datafusion:vortex-compact 70770830 / 71178391 / -0.6% 100510893 / 99310584 / +1.2% 0.70 / 0.72 / -1.8%
tpcds_q81/datafusion:vortex-compact 29134249 / 29585950 / -1.5% 49480523 / 48158504 / +2.7% 0.59 / 0.61 / -4.2%
tpcds_q82/datafusion:vortex-compact 14974380 / 14779627 / +1.3% 39627422 / 38791534 / +2.2% 0.38 / 0.38 / -0.8%
tpcds_q83/datafusion:vortex-compact 36743194 / 36410744 / +0.9% 60596293 / 59891976 / +1.2% 0.61 / 0.61 / -0.3%
tpcds_q84/datafusion:vortex-compact 12691342 / 12986884 / -2.3% 29029058 / 29403223 / -1.3% 0.44 / 0.44 / -1.0%
tpcds_q85/datafusion:vortex-compact 95467692 / 95737091 / -0.3% 120049277 / 123880296 / -3.1% 0.80 / 0.77 / +2.9%
tpcds_q86/datafusion:vortex-compact 16068117 / 16569019 / -3.0% 36536850 / 35595673 / +2.6% 0.44 / 0.47 / -5.5%
tpcds_q87/datafusion:vortex-compact 28335668 / 28106944 / +0.8% 52230673 / 50555551 / +3.3% 0.54 / 0.56 / -2.4%
tpcds_q88/datafusion:vortex-compact 46118827 / 45152435 / +2.1% 68916522 / 63992228 / +7.7% 0.67 / 0.71 / -5.2%
tpcds_q89/datafusion:vortex-compact 23679551 / 24260054 / -2.4% 47654594 / 45622755 / +4.5% 0.50 / 0.53 / -6.6%
tpcds_q90/datafusion:vortex-compact 12118670 / 11817656 / +2.5% 28652622 / 28596930 / +0.2% 0.42 / 0.41 / +2.3%
tpcds_q91/datafusion:vortex-compact 25363642 / 25177752 / +0.7% 46233375 / 47050273 / -1.7% 0.55 / 0.54 / +2.5%
tpcds_q92/datafusion:vortex-compact 14070918 / 14441027 / -2.6% 33306280 / 33091041 / +0.7% 0.42 / 0.44 / -3.2%
tpcds_q93/datafusion:vortex-compact 20294964 / 20447650 / -0.7% 41607109 / 41605463 / +0.0% 0.49 / 0.49 / -0.8%
tpcds_q94/datafusion:vortex-compact 19820198 / 20609706 / -3.8% 41926987 / 40401112 / +3.8% 0.47 / 0.51 / -7.3%
tpcds_q95/datafusion:vortex-compact 43809244 / 43320312 / +1.1% 63348384 / 63489439 / -0.2% 0.69 / 0.68 / +1.4%
tpcds_q96/datafusion:vortex-compact 10629558 / 11133295 / -4.5% 28629647 / 27129743 / +5.5% 0.37 / 0.41 / -9.5%
tpcds_q97/datafusion:vortex-compact 18528320 / 18273992 / +1.4% 40319604 / 39770730 / +1.4% 0.46 / 0.46 / +0.0%
tpcds_q98/datafusion:vortex-compact 20435533 / 20641074 / -1.0% 41952121 / 41046089 / +2.2% 0.49 / 0.50 / -3.1%
tpcds_q99/datafusion:vortex-compact 17538448 / 17822372 / -1.6% 36797468 / 36850806 / -0.1% 0.48 / 0.48 / -1.5%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41101952 / 41376042 / -0.7% 58074046 / 61219563 / -5.1% 0.71 / 0.68 / +4.7%
tpcds_q02/datafusion:parquet 54511920 / 55732362 / -2.2% 70264705 / 69894210 / +0.5% 0.78 / 0.80 / -2.7%
tpcds_q03/datafusion:parquet 18915708 / 18737738 / +0.9% 31431272 / 31694728 / -0.8% 0.60 / 0.59 / +1.8%
tpcds_q04/datafusion:parquet 178335713 / 179523139 / -0.7% 206491910 / 205607654 / +0.4% 0.86 / 0.87 / -1.1%
tpcds_q05/datafusion:parquet 66367070 / 67174177 / -1.2% 89533273 / 88313263 / +1.4% 0.74 / 0.76 / -2.5%
tpcds_q06/datafusion:parquet 33839960 / 33950600 / -0.3% 45727525 / 48964223 / -6.6% 0.74 / 0.69 / +6.7%
tpcds_q07/datafusion:parquet 47054671 / 46470560 / +1.3% 65761886 / 66709214 / -1.4% 0.72 / 0.70 / +2.7%
tpcds_q08/datafusion:parquet 31067046 / 30605192 / +1.5% 47412868 / 47185942 / +0.5% 0.66 / 0.65 / +1.0%
tpcds_q09/datafusion:parquet 32458734 / 31848258 / +1.9% 43774007 / 42365274 / +3.3% 0.74 / 0.75 / -1.4%
tpcds_q10/datafusion:parquet 44626340 / 44008693 / +1.4% 60637798 / 59276877 / +2.3% 0.74 / 0.74 / -0.9%
tpcds_q11/datafusion:parquet 96684371 / 97387583 / -0.7% 119974078 / 121162439 / -1.0% 0.81 / 0.80 / +0.3%
tpcds_q12/datafusion:parquet 23599232 / 23757968 / -0.7% 37223058 / 36166281 / +2.9% 0.63 / 0.66 / -3.5%
tpcds_q13/datafusion:parquet 46410340 / 46582172 / -0.4% 68339195 / 66579247 / +2.6% 0.68 / 0.70 / -2.9%
tpcds_q14/datafusion:parquet 534458536 / 534336185 / +0.0% 577670645 / 578660836 / -0.2% 0.93 / 0.92 / +0.2%
tpcds_q15/datafusion:parquet 23354796 / 23392806 / -0.2% 38480149 / 37937293 / +1.4% 0.61 / 0.62 / -1.6%
tpcds_q16/datafusion:parquet 37440888 / 36413108 / +2.8% 51125358 / 49676739 / +2.9% 0.73 / 0.73 / -0.1%
tpcds_q17/datafusion:parquet 74860920 / 72825562 / +2.8% 99589169 / 96065604 / +3.7% 0.75 / 0.76 / -0.8%
tpcds_q18/datafusion:parquet 67476997 / 69986060 / -3.6% 94823053 / 89559714 / +5.9% 0.71 / 0.78 / -8.9%
tpcds_q19/datafusion:parquet 29299616 / 29692210 / -1.3% 44772539 / 42317870 / +5.8% 0.65 / 0.70 / -6.7%
tpcds_q20/datafusion:parquet 24657700 / 24998773 / -1.4% 36887313 / 39649312 / -7.0% 0.67 / 0.63 / +6.0%
tpcds_q21/datafusion:parquet 20290704 / 20293156 / -0.0% 32180782 / 31891395 / +0.9% 0.63 / 0.64 / -0.9%
tpcds_q22/datafusion:parquet 76793512 / 76673806 / +0.2% 89406385 / 88245600 / +1.3% 0.86 / 0.87 / -1.1%
tpcds_q23/datafusion:parquet 93037388 / 92994178 / +0.0% 115697411 / 116346255 / -0.6% 0.80 / 0.80 / +0.6%
tpcds_q24/datafusion:parquet 89837288 / 90352230 / -0.6% 113381931 / 114052483 / -0.6% 0.79 / 0.79 / +0.0%
tpcds_q25/datafusion:parquet 80646138 / 83103540 / -3.0% 103696215 / 106991814 / -3.1% 0.78 / 0.78 / +0.1%
tpcds_q26/datafusion:parquet 43661312 / 43230669 / +1.0% 61558494 / 59614170 / +3.3% 0.71 / 0.73 / -2.2%
tpcds_q27/datafusion:parquet 75260115 / 78436083 / -4.0% 97211691 / 96734171 / +0.5% 0.77 / 0.81 / -4.5%
tpcds_q28/datafusion:parquet 28227444 / 28439834 / -0.7% 44010770 / 42919609 / +2.5% 0.64 / 0.66 / -3.2%
tpcds_q29/datafusion:parquet 75394859 / 74674603 / +1.0% 96187803 / 94927127 / +1.3% 0.78 / 0.79 / -0.4%
tpcds_q30/datafusion:parquet 44419057 / 44134348 / +0.6% 58166411 / 56208527 / +3.5% 0.76 / 0.79 / -2.7%
tpcds_q31/datafusion:parquet 80640828 / 80867606 / -0.3% 98063451 / 97410449 / +0.7% 0.82 / 0.83 / -0.9%
tpcds_q32/datafusion:parquet 26551171 / 26483018 / +0.3% 42184367 / 40256380 / +4.8% 0.63 / 0.66 / -4.3%
tpcds_q33/datafusion:parquet 38415772 / 36833372 / +4.3% 55283552 / 53260196 / +3.8% 0.69 / 0.69 / +0.5%
tpcds_q34/datafusion:parquet 24459750 / 24317154 / +0.6% 36447999 / 36441604 / +0.0% 0.67 / 0.67 / +0.6%
tpcds_q35/datafusion:parquet 51765988 / 50190934 / +3.1% 64755865 / 62947670 / +2.9% 0.80 / 0.80 / +0.3%
tpcds_q36/datafusion:parquet 53203106 / 52860474 / +0.6% 71338941 / 68624394 / +4.0% 0.75 / 0.77 / -3.2%
tpcds_q37/datafusion:parquet 21769222 / 21151724 / +2.9% 34078783 / 33918247 / +0.5% 0.64 / 0.62 / +2.4%
tpcds_q38/datafusion:parquet 44815265 / 44859544 / -0.1% 60430801 / 63473075 / -4.8% 0.74 / 0.71 / +4.9%
tpcds_q39/datafusion:parquet 68842262 / 67112504 / +2.6% 85997677 / 85331642 / +0.8% 0.80 / 0.79 / +1.8%
tpcds_q40/datafusion:parquet 30757754 / 30532482 / +0.7% 50457363 / 49143732 / +2.7% 0.61 / 0.62 / -1.9%
tpcds_q41/datafusion:parquet 19887486 / 19787577 / +0.5% 33326007 / 31851776 / +4.6% 0.60 / 0.62 / -3.9%
tpcds_q42/datafusion:parquet 18137526 / 18178046 / -0.2% 30629148 / 29288979 / +4.6% 0.59 / 0.62 / -4.6%
tpcds_q43/datafusion:parquet 19479600 / 19083207 / +2.1% 32352962 / 31783720 / +1.8% 0.60 / 0.60 / +0.3%
tpcds_q44/datafusion:parquet 34872764 / 35750512 / -2.5% 51907469 / 50601371 / +2.6% 0.67 / 0.71 / -4.9%
tpcds_q45/datafusion:parquet 27847542 / 28178494 / -1.2% 40383409 / 41490483 / -2.7% 0.69 / 0.68 / +1.5%
tpcds_q46/datafusion:parquet 28919186 / 28972956 / -0.2% 45925141 / 45414322 / +1.1% 0.63 / 0.64 / -1.3%
tpcds_q47/datafusion:parquet 97676513 / 97934518 / -0.3% 120147322 / 118309705 / +1.6% 0.81 / 0.83 / -1.8%
tpcds_q48/datafusion:parquet 42632979 / 41701310 / +2.2% 60424172 / 57953501 / +4.3% 0.71 / 0.72 / -1.9%
tpcds_q49/datafusion:parquet 74161304 / 71784336 / +3.3% 93903535 / 94510003 / -0.6% 0.79 / 0.76 / +4.0%
tpcds_q50/datafusion:parquet 46785532 / 48609835 / -3.8% 65832953 / 67338815 / -2.2% 0.71 / 0.72 / -1.6%
tpcds_q51/datafusion:parquet 74894888 / 75209341 / -0.4% 94684929 / 95256576 / -0.6% 0.79 / 0.79 / +0.2%
tpcds_q52/datafusion:parquet 18818718 / 18917972 / -0.5% 30293373 / 31163039 / -2.8% 0.62 / 0.61 / +2.3%
tpcds_q53/datafusion:parquet 22688946 / 22211532 / +2.1% 39748368 / 38349233 / +3.6% 0.57 / 0.58 / -1.4%
tpcds_q54/datafusion:parquet 52636809 / 53454868 / -1.5% 69137196 / 67971128 / +1.7% 0.76 / 0.79 / -3.2%
tpcds_q55/datafusion:parquet 18045714 / 18235946 / -1.0% 29317834 / 30316506 / -3.3% 0.62 / 0.60 / +2.3%
tpcds_q56/datafusion:parquet 41256253 / 41246233 / +0.0% 56252252 / 55602370 / +1.2% 0.73 / 0.74 / -1.1%
tpcds_q57/datafusion:parquet 101194968 / 100767090 / +0.4% 118819802 / 120128876 / -1.1% 0.85 / 0.84 / +1.5%
tpcds_q58/datafusion:parquet 65218428 / 65248474 / -0.0% 83011796 / 84687088 / -2.0% 0.79 / 0.77 / +2.0%
tpcds_q59/datafusion:parquet 48475195 / 47775176 / +1.5% 64289261 / 63656695 / +1.0% 0.75 / 0.75 / +0.5%
tpcds_q60/datafusion:parquet 38536738 / 39445761 / -2.3% 51603512 / 56847584 / -9.2% 0.75 / 0.69 / +7.6%
tpcds_q61/datafusion:parquet 36563182 / 36813269 / -0.7% 51228114 / 50895221 / +0.7% 0.71 / 0.72 / -1.3%
tpcds_q62/datafusion:parquet 25328368 / 25338640 / -0.0% 38932323 / 38285058 / +1.7% 0.65 / 0.66 / -1.7%
tpcds_q63/datafusion:parquet 21979486 / 21930100 / +0.2% 39454347 / 38582650 / +2.3% 0.56 / 0.57 / -2.0%
tpcds_q64/datafusion:parquet 285843324 / 286831498 / -0.3% 323935382 / 326238857 / -0.7% 0.88 / 0.88 / +0.4%
tpcds_q65/datafusion:parquet 121360528 / 121801285 / -0.4% 142011245 / 134186273 / +5.8% 0.85 / 0.91 / -5.9%
tpcds_q66/datafusion:parquet 60438024 / 60839942 / -0.7% 75535218 / 79575451 / -5.1% 0.80 / 0.76 / +4.7%
tpcds_q67/datafusion:parquet 68417957 / 68273845 / +0.2% 93069135 / 93375373 / -0.3% 0.74 / 0.73 / +0.5%
tpcds_q68/datafusion:parquet 28862539 / 28987636 / -0.4% 49086107 / 47721454 / +2.9% 0.59 / 0.61 / -3.2%
tpcds_q69/datafusion:parquet 44958296 / 44011666 / +2.2% 57948162 / 59312736 / -2.3% 0.78 / 0.74 / +4.6%
tpcds_q70/datafusion:parquet 79831804 / 79739070 / +0.1% 98063340 / 96557167 / +1.6% 0.81 / 0.83 / -1.4%
tpcds_q71/datafusion:parquet 25926134 / 26511336 / -2.2% 39241684 / 40530827 / -3.2% 0.66 / 0.65 / +1.0%
tpcds_q72/datafusion:parquet 525089077 / 540761378 / -2.9% 553850640 / 551950149 / +0.3% 0.95 / 0.98 / -3.2%
tpcds_q73/datafusion:parquet 23809328 / 23924097 / -0.5% 36379372 / 36151951 / +0.6% 0.65 / 0.66 / -1.1%
tpcds_q74/datafusion:parquet 69561688 / 70601638 / -1.5% 90218425 / 90643728 / -0.5% 0.77 / 0.78 / -1.0%
tpcds_q75/datafusion:parquet 150902952 / 150295181 / +0.4% 181434153 / 180193164 / +0.7% 0.83 / 0.83 / -0.3%
tpcds_q76/datafusion:parquet 33720648 / 33534629 / +0.6% 47740115 / 47350461 / +0.8% 0.71 / 0.71 / -0.3%
tpcds_q77/datafusion:parquet 57769116 / 56484353 / +2.3% 77505767 / 74409264 / +4.2% 0.75 / 0.76 / -1.8%
tpcds_q78/datafusion:parquet 85234451 / 85590208 / -0.4% 120172606 / 118425953 / +1.5% 0.71 / 0.72 / -1.9%
tpcds_q79/datafusion:parquet 26796180 / 26762858 / +0.1% 42704801 / 42045849 / +1.6% 0.63 / 0.64 / -1.4%
tpcds_q80/datafusion:parquet 81446273 / 80712046 / +0.9% 109522288 / 108409957 / +1.0% 0.74 / 0.74 / -0.1%
tpcds_q81/datafusion:parquet 38660902 / 38586344 / +0.2% 51862556 / 51809010 / +0.1% 0.75 / 0.74 / +0.1%
tpcds_q82/datafusion:parquet 22635834 / 22524582 / +0.5% 35983222 / 37133596 / -3.1% 0.63 / 0.61 / +3.7%
tpcds_q83/datafusion:parquet 59341192 / 59569809 / -0.4% 74489681 / 72022758 / +3.4% 0.80 / 0.83 / -3.7%
tpcds_q84/datafusion:parquet 26351204 / 26371932 / -0.1% 40502322 / 39708160 / +2.0% 0.65 / 0.66 / -2.0%
tpcds_q85/datafusion:parquet 80068158 / 79952822 / +0.1% 106721872 / 106512050 / +0.2% 0.75 / 0.75 / -0.1%
tpcds_q86/datafusion:parquet 20996798 / 20734859 / +1.3% 33827236 / 33497201 / +1.0% 0.62 / 0.62 / +0.3%
tpcds_q87/datafusion:parquet 44083736 / 44299628 / -0.5% 60777659 / 63642189 / -4.5% 0.73 / 0.70 / +4.2%
tpcds_q88/datafusion:parquet 37415978 / 37159283 / +0.7% 49923319 / 51724259 / -3.5% 0.75 / 0.72 / +4.3%
tpcds_q89/datafusion:parquet 25611605 / 26138636 / -2.0% 42724634 / 41281572 / +3.5% 0.60 / 0.63 / -5.3%
tpcds_q90/datafusion:parquet 15683209 / 16136780 / -2.8% 26525907 / 27195766 / -2.5% 0.59 / 0.59 / -0.4%
tpcds_q91/datafusion:parquet 32728295 / 32373534 / +1.1% 44617814 / 47212357 / -5.5% 0.73 / 0.69 / +7.0%
tpcds_q92/datafusion:parquet 26700286 / 27216506 / -1.9% 42277045 / 40386922 / +4.7% 0.63 / 0.67 / -6.3%
tpcds_q93/datafusion:parquet 27197618 / 26683946 / +1.9% 45078142 / 45552147 / -1.0% 0.60 / 0.59 / +3.0%
tpcds_q94/datafusion:parquet 35241428 / 34886300 / +1.0% 48350957 / 48312778 / +0.1% 0.73 / 0.72 / +0.9%
tpcds_q95/datafusion:parquet 63727964 / 64259654 / -0.8% 81901441 / 80348221 / +1.9% 0.78 / 0.80 / -2.7%
tpcds_q96/datafusion:parquet 13048474 / 12953416 / +0.7% 24295300 / 24275479 / +0.1% 0.54 / 0.53 / +0.7%
tpcds_q97/datafusion:parquet 35631782 / 35162045 / +1.3% 53071190 / 50122030 / +5.9% 0.67 / 0.70 / -4.3%
tpcds_q98/datafusion:parquet 25153758 / 25039502 / +0.5% 41045194 / 38557743 / +6.5% 0.61 / 0.65 / -5.6%
tpcds_q99/datafusion:parquet 29867890 / 29466395 / +1.4% 42767780 / 42157730 / +1.4% 0.70 / 0.70 / -0.1%
duckdb / vortex-compact / ns (0.995x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17391690 / 17457464 / -0.4% 26158021 / 26599379 / -1.7% 0.66 / 0.66 / +1.3%
tpcds_q02/duckdb:vortex-compact 16480956 / 18593008 / -11.4% 🟢 24607953 / 24143094 / +1.9% 0.67 / 0.77 / -13.0%
tpcds_q03/duckdb:vortex-compact 8325740 / 8295034 / +0.4% 17108089 / 17954017 / -4.7% 0.49 / 0.46 / +5.3%
tpcds_q04/duckdb:vortex-compact 62388068 / 62955034 / -0.9% 76767909 / 76496167 / +0.4% 0.81 / 0.82 / -1.3%
tpcds_q05/duckdb:vortex-compact 24569689 / 24943881 / -1.5% 34651099 / 35725191 / -3.0% 0.71 / 0.70 / +1.6%
tpcds_q06/duckdb:vortex-compact 25592701 / 25455498 / +0.5% 38746687 / 39756220 / -2.5% 0.66 / 0.64 / +3.2%
tpcds_q07/duckdb:vortex-compact 26431949 / 26535772 / -0.4% 38752532 / 38494009 / +0.7% 0.68 / 0.69 / -1.1%
tpcds_q08/duckdb:vortex-compact 18146542 / 18341949 / -1.1% 26235421 / 26234736 / +0.0% 0.69 / 0.70 / -1.1%
tpcds_q09/duckdb:vortex-compact 20468221 / 20406216 / +0.3% 30779817 / 30934423 / -0.5% 0.66 / 0.66 / +0.8%
tpcds_q10/duckdb:vortex-compact 31459059 / 31753644 / -0.9% 45317818 / 46230210 / -2.0% 0.69 / 0.69 / +1.1%
tpcds_q11/duckdb:vortex-compact 38182188 / 38417931 / -0.6% 47974257 / 48904283 / -1.9% 0.80 / 0.79 / +1.3%
tpcds_q12/duckdb:vortex-compact 13274432 / 13231236 / +0.3% 21903575 / 21875735 / +0.1% 0.61 / 0.60 / +0.2%
tpcds_q13/duckdb:vortex-compact 33828004 / 33840283 / -0.0% 45175943 / 45711259 / -1.2% 0.75 / 0.74 / +1.1%
tpcds_q14/duckdb:vortex-compact 59143254 / 58001477 / +2.0% 68657769 / 69254841 / -0.9% 0.86 / 0.84 / +2.9%
tpcds_q15/duckdb:vortex-compact 12679930 / 12782468 / -0.8% 20195290 / 19240314 / +5.0% 0.63 / 0.66 / -5.5%
tpcds_q16/duckdb:vortex-compact 26552954 / 26633898 / -0.3% 36617692 / 37204539 / -1.6% 0.73 / 0.72 / +1.3%
tpcds_q17/duckdb:vortex-compact 23640478 / 23808136 / -0.7% 35027065 / 36362084 / -3.7% 0.67 / 0.65 / +3.1%
tpcds_q18/duckdb:vortex-compact 38125075 / 38155590 / -0.1% 50208530 / 50848141 / -1.3% 0.76 / 0.75 / +1.2%
tpcds_q19/duckdb:vortex-compact 25405248 / 24800598 / +2.4% 31645518 / 31681476 / -0.1% 0.80 / 0.78 / +2.6%
tpcds_q20/duckdb:vortex-compact 13596319 / 14041251 / -3.2% 23483194 / 22032575 / +6.6% 0.58 / 0.64 / -9.2%
tpcds_q21/duckdb:vortex-compact 11212496 / 13114134 / -14.5% 🟢 26027428 / 25018052 / +4.0% 0.43 / 0.52 / -17.8%
tpcds_q22/duckdb:vortex-compact 23351692 / 19613948 / +19.1% 🔴 33071656 / 38397427 / -13.9% 🟢 0.71 / 0.51 / +38.2%
tpcds_q23/duckdb:vortex-compact 41594162 / 41228428 / +0.9% 54300179 / 53635231 / +1.2% 0.77 / 0.77 / -0.3%
tpcds_q24/duckdb:vortex-compact 28062640 / 28341857 / -1.0% 37538728 / 38610475 / -2.8% 0.75 / 0.73 / +1.8%
tpcds_q25/duckdb:vortex-compact 22259374 / 21976445 / +1.3% 34423362 / 35256714 / -2.4% 0.65 / 0.62 / +3.7%
tpcds_q26/duckdb:vortex-compact 26906417 / 27244053 / -1.2% 37901638 / 37759302 / +0.4% 0.71 / 0.72 / -1.6%
tpcds_q27/duckdb:vortex-compact 28691912 / 29087184 / -1.4% 41233446 / 40236538 / +2.5% 0.70 / 0.72 / -3.7%
tpcds_q28/duckdb:vortex-compact 20495791 / 20346468 / +0.7% 29999696 / 30515958 / -1.7% 0.68 / 0.67 / +2.5%
tpcds_q29/duckdb:vortex-compact 21965498 / 21709746 / +1.2% 33738658 / 33512517 / +0.7% 0.65 / 0.65 / +0.5%
tpcds_q30/duckdb:vortex-compact 21375190 / 21727674 / -1.6% 31812775 / 31664703 / +0.5% 0.67 / 0.69 / -2.1%
tpcds_q31/duckdb:vortex-compact 22146923 / 19264744 / +15.0% 🔴 28013830 / 28745238 / -2.5% 0.79 / 0.67 / +18.0%
tpcds_q32/duckdb:vortex-compact 11324718 / 11223513 / +0.9% 19669676 / 19242795 / +2.2% 0.58 / 0.58 / -1.3%
tpcds_q33/duckdb:vortex-compact 19571656 / 19932324 / -1.8% 29754685 / 30877575 / -3.6% 0.66 / 0.65 / +1.9%
tpcds_q34/duckdb:vortex-compact 14166956 / 14145269 / +0.2% 24914835 / 24605919 / +1.3% 0.57 / 0.57 / -1.1%
tpcds_q35/duckdb:vortex-compact 33628060 / 33525758 / +0.3% 47714717 / 46563922 / +2.5% 0.70 / 0.72 / -2.1%
tpcds_q36/duckdb:vortex-compact 15746994 / 15533244 / +1.4% 25752082 / 25004848 / +3.0% 0.61 / 0.62 / -1.6%
tpcds_q37/duckdb:vortex-compact 13117192 / 12654073 / +3.7% 29642286 / 28745298 / +3.1% 0.44 / 0.44 / +0.5%
tpcds_q38/duckdb:vortex-compact 25223104 / 25173608 / +0.2% 33533863 / 34292771 / -2.2% 0.75 / 0.73 / +2.5%
tpcds_q39/duckdb:vortex-compact 19557371 / 20316606 / -3.7% 34454036 / 35321570 / -2.5% 0.57 / 0.58 / -1.3%
tpcds_q40/duckdb:vortex-compact 12765220 / 12759680 / +0.0% 21472802 / 21452500 / +0.1% 0.59 / 0.59 / -0.1%
tpcds_q41/duckdb:vortex-compact 19380636 / 19344988 / +0.2% 26459667 / 26909671 / -1.7% 0.73 / 0.72 / +1.9%
tpcds_q42/duckdb:vortex-compact 8089144 / 8186487 / -1.2% 17391077 / 18297553 / -5.0% 0.47 / 0.45 / +4.0%
tpcds_q43/duckdb:vortex-compact 10859134 / 11910636 / -8.8% 19863390 / 19559253 / +1.6% 0.55 / 0.61 / -10.2%
tpcds_q44/duckdb:vortex-compact 14619380 / 14475397 / +1.0% 26165842 / 26551598 / -1.5% 0.56 / 0.55 / +2.5%
tpcds_q45/duckdb:vortex-compact 25022596 / 25196747 / -0.7% 33733224 / 33529373 / +0.6% 0.74 / 0.75 / -1.3%
tpcds_q46/duckdb:vortex-compact 33199923 / 32906225 / +0.9% 44752474 / 44336009 / +0.9% 0.74 / 0.74 / -0.0%
tpcds_q47/duckdb:vortex-compact 32414396 / 32380912 / +0.1% 42758101 / 43167020 / -0.9% 0.76 / 0.75 / +1.1%
tpcds_q48/duckdb:vortex-compact 35649925 / 35942838 / -0.8% 47026818 / 47726147 / -1.5% 0.76 / 0.75 / +0.7%
tpcds_q49/duckdb:vortex-compact 22360776 / 23170434 / -3.5% 32706043 / 33194425 / -1.5% 0.68 / 0.70 / -2.1%
tpcds_q50/duckdb:vortex-compact 16386560 / 16364484 / +0.1% 25350318 / 26475199 / -4.2% 0.65 / 0.62 / +4.6%
tpcds_q51/duckdb:vortex-compact 49789460 / 50459976 / -1.3% 60632183 / 79877563 / -24.1% 🟢 0.82 / 0.63 / +30.0%
tpcds_q52/duckdb:vortex-compact 8262246 / 8490255 / -2.7% 17518397 / 16675233 / +5.1% 0.47 / 0.51 / -7.4%
tpcds_q53/duckdb:vortex-compact 13469039 / 13421662 / +0.4% 23093136 / 23197750 / -0.5% 0.58 / 0.58 / +0.8%
tpcds_q54/duckdb:vortex-compact 21123280 / 21032879 / +0.4% 31307705 / 31788940 / -1.5% 0.67 / 0.66 / +2.0%
tpcds_q55/duckdb:vortex-compact 7940826 / 7962026 / -0.3% 16562350 / 16327131 / +1.4% 0.48 / 0.49 / -1.7%
tpcds_q56/duckdb:vortex-compact 19293156 / 21103496 / -8.6% 29614508 / 31024025 / -4.5% 0.65 / 0.68 / -4.2%
tpcds_q57/duckdb:vortex-compact 27169647 / 26921743 / +0.9% 35512887 / 35149634 / +1.0% 0.77 / 0.77 / -0.1%
tpcds_q58/duckdb:vortex-compact 21910066 / 21467704 / +2.1% 32817511 / 32159590 / +2.0% 0.67 / 0.67 / +0.0%
tpcds_q59/duckdb:vortex-compact 20523220 / 24764578 / -17.1% 🟢 28827616 / 28284746 / +1.9% 0.71 / 0.88 / -18.7%
tpcds_q60/duckdb:vortex-compact 20479897 / 21707223 / -5.7% 31455509 / 30962451 / +1.6% 0.65 / 0.70 / -7.1%
tpcds_q61/duckdb:vortex-compact 21761001 / 22104848 / -1.6% 33023499 / 32517384 / +1.6% 0.66 / 0.68 / -3.1%
tpcds_q62/duckdb:vortex-compact 12972089 / 12991746 / -0.2% 19558924 / 19606180 / -0.2% 0.66 / 0.66 / +0.1%
tpcds_q63/duckdb:vortex-compact 12780262 / 12824662 / -0.3% 22738215 / 23157668 / -1.8% 0.56 / 0.55 / +1.5%
tpcds_q64/duckdb:vortex-compact 59358462 / 59722248 / -0.6% 74143342 / 74852558 / -0.9% 0.80 / 0.80 / +0.3%
tpcds_q65/duckdb:vortex-compact 14265426 / 13991050 / +2.0% 24811838 / 24384947 / +1.8% 0.57 / 0.57 / +0.2%
tpcds_q66/duckdb:vortex-compact 35509423 / 35117358 / +1.1% 42017605 / 41227523 / +1.9% 0.85 / 0.85 / -0.8%
tpcds_q67/duckdb:vortex-compact 57221882 / 62592992 / -8.6% 66846253 / 67642509 / -1.2% 0.86 / 0.93 / -7.5%
tpcds_q68/duckdb:vortex-compact 24783753 / 24114964 / +2.8% 36627530 / 36187926 / +1.2% 0.68 / 0.67 / +1.5%
tpcds_q69/duckdb:vortex-compact 26857896 / 26982630 / -0.5% 41519499 / 41742787 / -0.5% 0.65 / 0.65 / +0.1%
tpcds_q70/duckdb:vortex-compact 15586125 / 15631234 / -0.3% 26215957 / 27333128 / -4.1% 0.59 / 0.57 / +4.0%
tpcds_q71/duckdb:vortex-compact 14120504 / 14141962 / -0.2% 24801993 / 25207256 / -1.6% 0.57 / 0.56 / +1.5%
tpcds_q72/duckdb:vortex-compact 48818642 / 48914342 / -0.2% 61992763 / 61318505 / +1.1% 0.79 / 0.80 / -1.3%
tpcds_q73/duckdb:vortex-compact 12924015 / 12915748 / +0.1% 23483867 / 23116346 / +1.6% 0.55 / 0.56 / -1.5%
tpcds_q74/duckdb:vortex-compact 33040870 / 33036696 / +0.0% 42320833 / 43568507 / -2.9% 0.78 / 0.76 / +3.0%
tpcds_q75/duckdb:vortex-compact 39829708 / 39404394 / +1.1% 51621835 / 51745465 / -0.2% 0.77 / 0.76 / +1.3%
tpcds_q76/duckdb:vortex-compact 13850188 / 13552802 / +2.2% 23430498 / 23790709 / -1.5% 0.59 / 0.57 / +3.8%
tpcds_q77/duckdb:vortex-compact 23577936 / 23131646 / +1.9% 33533825 / 33533979 / -0.0% 0.70 / 0.69 / +1.9%
tpcds_q78/duckdb:vortex-compact 45961577 / 45387660 / +1.3% 56808847 / 56000561 / +1.4% 0.81 / 0.81 / -0.2%
tpcds_q79/duckdb:vortex-compact 17769285 / 17785374 / -0.1% 28837134 / 28627260 / +0.7% 0.62 / 0.62 / -0.8%
tpcds_q80/duckdb:vortex-compact 32788196 / 32502304 / +0.9% 45039769 / 46240604 / -2.6% 0.73 / 0.70 / +3.6%
tpcds_q81/duckdb:vortex-compact 23661244 / 23676042 / -0.1% 31823382 / 32267747 / -1.4% 0.74 / 0.73 / +1.3%
tpcds_q82/duckdb:vortex-compact 13677606 / 13763652 / -0.6% 30469500 / 29530649 / +3.2% 0.45 / 0.47 / -3.7%
tpcds_q83/duckdb:vortex-compact 18335046 / 18531906 / -1.1% 25709848 / 25581141 / +0.5% 0.71 / 0.72 / -1.6%
tpcds_q84/duckdb:vortex-compact 17795936 / 17967215 / -1.0% 24237443 / 24335381 / -0.4% 0.73 / 0.74 / -0.6%
tpcds_q85/duckdb:vortex-compact 38977702 / 39058994 / -0.2% 51121951 / 50960481 / +0.3% 0.76 / 0.77 / -0.5%
tpcds_q86/duckdb:vortex-compact 11108366 / 11101567 / +0.1% 17164576 / 17967202 / -4.5% 0.65 / 0.62 / +4.7%
tpcds_q87/duckdb:vortex-compact 26904366 / 26881280 / +0.1% 35968821 / 35098100 / +2.5% 0.75 / 0.77 / -2.3%
tpcds_q88/duckdb:vortex-compact 31408823 / 31044585 / +1.2% 37660686 / 38720718 / -2.7% 0.83 / 0.80 / +4.0%
tpcds_q89/duckdb:vortex-compact 13690212 / 13687168 / +0.0% 24062741 / 23623108 / +1.9% 0.57 / 0.58 / -1.8%
tpcds_q90/duckdb:vortex-compact 8383102 / 8195776 / +2.3% 14915209 / 14929497 / -0.1% 0.56 / 0.55 / +2.4%
tpcds_q91/duckdb:vortex-compact 23742860 / 23746924 / -0.0% 32704186 / 32709661 / -0.0% 0.73 / 0.73 / -0.0%
tpcds_q92/duckdb:vortex-compact 11660298 / 11697420 / -0.3% 19441228 / 19252899 / +1.0% 0.60 / 0.61 / -1.3%
tpcds_q93/duckdb:vortex-compact 11687802 / 11754854 / -0.6% 26178748 / 25095066 / +4.3% 0.45 / 0.47 / -4.7%
tpcds_q94/duckdb:vortex-compact 24282468 / 24419148 / -0.6% 33366978 / 33375120 / -0.0% 0.73 / 0.73 / -0.5%
tpcds_q95/duckdb:vortex-compact 61944500 / 62240083 / -0.5% 70350215 / 70144808 / +0.3% 0.88 / 0.89 / -0.8%
tpcds_q96/duckdb:vortex-compact 7600050 / 7604393 / -0.1% 15267458 / 15507335 / -1.5% 0.50 / 0.49 / +1.5%
tpcds_q97/duckdb:vortex-compact 23522474 / 23499981 / +0.1% 32711014 / 33238889 / -1.6% 0.72 / 0.71 / +1.7%
tpcds_q98/duckdb:vortex-compact 14272108 / 14296128 / -0.2% 24465075 / 24994689 / -2.1% 0.58 / 0.57 / +2.0%
tpcds_q99/duckdb:vortex-compact 16449204 / 16538044 / -0.5% 24985569 / 25121065 / -0.5% 0.66 / 0.66 / +0.0%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23962620 / 24073216 / -0.5% 30936159 / 30710979 / +0.7% 0.77 / 0.78 / -1.2%
tpcds_q02/duckdb:parquet 17733695 / 17849130 / -0.6% 24191730 / 23732681 / +1.9% 0.73 / 0.75 / -2.5%
tpcds_q03/duckdb:parquet 9846156 / 9794384 / +0.5% 15062774 / 15550470 / -3.1% 0.65 / 0.63 / +3.8%
tpcds_q04/duckdb:parquet 117877322 / 118506223 / -0.5% 125544305 / 125613891 / -0.1% 0.94 / 0.94 / -0.5%
tpcds_q05/duckdb:parquet 28348302 / 28354389 / -0.0% 33003974 / 32802471 / +0.6% 0.86 / 0.86 / -0.6%
tpcds_q06/duckdb:parquet 26268220 / 26331690 / -0.2% 35735009 / 35351923 / +1.1% 0.74 / 0.74 / -1.3%
tpcds_q07/duckdb:parquet 30764128 / 31741252 / -3.1% 38504327 / 38570529 / -0.2% 0.80 / 0.82 / -2.9%
tpcds_q08/duckdb:parquet 19796870 / 19794708 / +0.0% 25002454 / 25846234 / -3.3% 0.79 / 0.77 / +3.4%
tpcds_q09/duckdb:parquet 27021618 / 26144806 / +3.4% 28891392 / 29675920 / -2.6% 0.94 / 0.88 / +6.2%
tpcds_q10/duckdb:parquet 32347900 / 32633190 / -0.9% 40246463 / 40250101 / -0.0% 0.80 / 0.81 / -0.9%
tpcds_q11/duckdb:parquet 68594066 / 68986190 / -0.6% 75197462 / 77362985 / -2.8% 0.91 / 0.89 / +2.3%
tpcds_q12/duckdb:parquet 13913470 / 13916064 / -0.0% 19200385 / 19053363 / +0.8% 0.72 / 0.73 / -0.8%
tpcds_q13/duckdb:parquet 30628155 / 30738367 / -0.4% 39371719 / 39428486 / -0.1% 0.78 / 0.78 / -0.2%
tpcds_q14/duckdb:parquet 65510475 / 66035072 / -0.8% 70598791 / 68022810 / +3.8% 0.93 / 0.97 / -4.4%
tpcds_q15/duckdb:parquet 16364490 / 16583388 / -1.3% 22456183 / 22387179 / +0.3% 0.73 / 0.74 / -1.6%
tpcds_q16/duckdb:parquet 30180012 / 30164618 / +0.1% 37353797 / 36980747 / +1.0% 0.81 / 0.82 / -0.9%
tpcds_q17/duckdb:parquet 34583567 / 34663156 / -0.2% 40341202 / 40562264 / -0.5% 0.86 / 0.85 / +0.3%
tpcds_q18/duckdb:parquet 47238328 / 46888790 / +0.7% 55257788 / 55063500 / +0.4% 0.85 / 0.85 / +0.4%
tpcds_q19/duckdb:parquet 18808360 / 18692639 / +0.6% 26399876 / 25568198 / +3.3% 0.71 / 0.73 / -2.6%
tpcds_q20/duckdb:parquet 14853976 / 14865047 / -0.1% 19516601 / 19303239 / +1.1% 0.76 / 0.77 / -1.2%
tpcds_q21/duckdb:parquet 10418670 / 10488846 / -0.7% 16535857 / 16597396 / -0.4% 0.63 / 0.63 / -0.3%
tpcds_q22/duckdb:parquet 20554752 / 20616512 / -0.3% 26441926 / 26545329 / -0.4% 0.78 / 0.78 / +0.1%
tpcds_q23/duckdb:parquet 43910200 / 44282988 / -0.8% 46808702 / 46544724 / +0.6% 0.94 / 0.95 / -1.4%
tpcds_q24/duckdb:parquet 30377630 / 30378958 / -0.0% 36474656 / 36884461 / -1.1% 0.83 / 0.82 / +1.1%
tpcds_q25/duckdb:parquet 30458886 / 30451766 / +0.0% 37614920 / 37193241 / +1.1% 0.81 / 0.82 / -1.1%
tpcds_q26/duckdb:parquet 28834106 / 28814890 / +0.1% 35208571 / 35083031 / +0.4% 0.82 / 0.82 / -0.3%
tpcds_q27/duckdb:parquet 35730127 / 33096841 / +8.0% 41983412 / 41974933 / +0.0% 0.85 / 0.79 / +7.9%
tpcds_q28/duckdb:parquet 26172126 / 25716484 / +1.8% 33817409 / 33667182 / +0.4% 0.77 / 0.76 / +1.3%
tpcds_q29/duckdb:parquet 32013066 / 31904670 / +0.3% 39096000 / 38986555 / +0.3% 0.82 / 0.82 / +0.1%
tpcds_q30/duckdb:parquet 35521564 / 35558110 / -0.1% 44279573 / 44024286 / +0.6% 0.80 / 0.81 / -0.7%
tpcds_q31/duckdb:parquet 35621677 / 35613797 / +0.0% 42911814 / 42646288 / +0.6% 0.83 / 0.84 / -0.6%
tpcds_q32/duckdb:parquet 14194588 / 14151454 / +0.3% 20675216 / 20680411 / -0.0% 0.69 / 0.68 / +0.3%
tpcds_q33/duckdb:parquet 24163878 / 23503816 / +2.8% 28738337 / 28830085 / -0.3% 0.84 / 0.82 / +3.1%
tpcds_q34/duckdb:parquet 17112846 / 18387020 / -6.9% 24233996 / 24043400 / +0.8% 0.71 / 0.76 / -7.7%
tpcds_q35/duckdb:parquet 35217255 / 35613044 / -1.1% 43753457 / 44361838 / -1.4% 0.80 / 0.80 / +0.3%
tpcds_q36/duckdb:parquet 41417670 / 42335787 / -2.2% 47376917 / 47785750 / -0.9% 0.87 / 0.89 / -1.3%
tpcds_q37/duckdb:parquet 12937818 / 12611308 / +2.6% 19512197 / 19314828 / +1.0% 0.66 / 0.65 / +1.6%
tpcds_q38/duckdb:parquet 29713347 / 29538285 / +0.6% 33584367 / 33729568 / -0.4% 0.88 / 0.88 / +1.0%
tpcds_q39/duckdb:parquet 23400668 / 23310860 / +0.4% 30009641 / 30054415 / -0.1% 0.78 / 0.78 / +0.5%
tpcds_q40/duckdb:parquet 15777620 / 15917991 / -0.9% 21311050 / 21477832 / -0.8% 0.74 / 0.74 / -0.1%
tpcds_q41/duckdb:parquet 11810524 / 11846480 / -0.3% 17715283 / 18072072 / -2.0% 0.67 / 0.66 / +1.7%
tpcds_q42/duckdb:parquet 9469805 / 9500457 / -0.3% 15388621 / 15193403 / +1.3% 0.62 / 0.63 / -1.6%
tpcds_q43/duckdb:parquet 12240381 / 11997976 / +2.0% 17907844 / 17817734 / +0.5% 0.68 / 0.67 / +1.5%
tpcds_q44/duckdb:parquet 21701046 / 21270910 / +2.0% 26773909 / 27803955 / -3.7% 0.81 / 0.77 / +5.9%
tpcds_q45/duckdb:parquet 20838422 / 20817216 / +0.1% 28123856 / 27895502 / +0.8% 0.74 / 0.75 / -0.7%
tpcds_q46/duckdb:parquet 38207078 / 37847588 / +0.9% 43247042 / 43436230 / -0.4% 0.88 / 0.87 / +1.4%
tpcds_q47/duckdb:parquet 34679240 / 34499506 / +0.5% 40843328 / 41131374 / -0.7% 0.85 / 0.84 / +1.2%
tpcds_q48/duckdb:parquet 28800173 / 28551023 / +0.9% 37345461 / 36618472 / +2.0% 0.77 / 0.78 / -1.1%
tpcds_q49/duckdb:parquet 30290717 / 28982140 / +4.5% 36471385 / 36899025 / -1.2% 0.83 / 0.79 / +5.7%
tpcds_q50/duckdb:parquet 19316485 / 19448953 / -0.7% 25790406 / 25425978 / +1.4% 0.75 / 0.76 / -2.1%
tpcds_q51/duckdb:parquet 51974652 / 51720222 / +0.5% 75337561 / 60791328 / +23.9% 🔴 0.69 / 0.85 / -18.9%
tpcds_q52/duckdb:parquet 9645110 / 9604584 / +0.4% 15693897 / 15688928 / +0.0% 0.61 / 0.61 / +0.4%
tpcds_q53/duckdb:parquet 14868940 / 13777479 / +7.9% 20675019 / 20645585 / +0.1% 0.72 / 0.67 / +7.8%
tpcds_q54/duckdb:parquet 24903684 / 24704058 / +0.8% 32304298 / 31968681 / +1.0% 0.77 / 0.77 / -0.2%
tpcds_q55/duckdb:parquet 9540013 / 9576810 / -0.4% 15561300 / 15146323 / +2.7% 0.61 / 0.63 / -3.0%
tpcds_q56/duckdb:parquet 25793964 / 26199279 / -1.5% 30445918 / 31230388 / -2.5% 0.85 / 0.84 / +1.0%
tpcds_q57/duckdb:parquet 30438262 / 30692586 / -0.8% 35911121 / 35733697 / +0.5% 0.85 / 0.86 / -1.3%
tpcds_q58/duckdb:parquet 24549553 / 24061200 / +2.0% 29716574 / 29937411 / -0.7% 0.83 / 0.80 / +2.8%
tpcds_q59/duckdb:parquet 22520678 / 22653866 / -0.6% 28824214 / 28741875 / +0.3% 0.78 / 0.79 / -0.9%
tpcds_q60/duckdb:parquet 27338698 / 28606143 / -4.4% 31979991 / 32511408 / -1.6% 0.85 / 0.88 / -2.8%
tpcds_q61/duckdb:parquet 24553754 / 24783622 / -0.9% 29124663 / 29286064 / -0.6% 0.84 / 0.85 / -0.4%
tpcds_q62/duckdb:parquet 12686654 / 12756632 / -0.5% 17699113 / 18016813 / -1.8% 0.72 / 0.71 / +1.2%
tpcds_q63/duckdb:parquet 13431212 / 13167075 / +2.0% 20085045 / 19627896 / +2.3% 0.67 / 0.67 / -0.3%
tpcds_q64/duckdb:parquet 71085095 / 70332196 / +1.1% 80410286 / 79898672 / +0.6% 0.88 / 0.88 / +0.4%
tpcds_q65/duckdb:parquet 19861058 / 19712448 / +0.8% 25995518 / 25557808 / +1.7% 0.76 / 0.77 / -0.9%
tpcds_q66/duckdb:parquet 33115260 / 33168506 / -0.2% 37917942 / 38268266 / -0.9% 0.87 / 0.87 / +0.8%
tpcds_q67/duckdb:parquet 60689023 / 60583596 / +0.2% 67610982 / 67118365 / +0.7% 0.90 / 0.90 / -0.6%
tpcds_q68/duckdb:parquet 29277828 / 28384108 / +3.1% 36245431 / 36234251 / +0.0% 0.81 / 0.78 / +3.1%
tpcds_q69/duckdb:parquet 25743548 / 25916971 / -0.7% 34201291 / 34186488 / +0.0% 0.75 / 0.76 / -0.7%
tpcds_q70/duckdb:parquet 18961066 / 19298662 / -1.7% 26692648 / 26964121 / -1.0% 0.71 / 0.72 / -0.8%
tpcds_q71/duckdb:parquet 17053548 / 16838646 / +1.3% 23887346 / 23898437 / -0.0% 0.71 / 0.70 / +1.3%
tpcds_q72/duckdb:parquet 53252228 / 52670348 / +1.1% 59375817 / 59222434 / +0.3% 0.90 / 0.89 / +0.8%
tpcds_q73/duckdb:parquet 15909447 / 15277827 / +4.1% 21648573 / 21330322 / +1.5% 0.73 / 0.72 / +2.6%
tpcds_q74/duckdb:parquet 83517726 / 84403742 / -1.0% 91304998 / 90793062 / +0.6% 0.91 / 0.93 / -1.6%
tpcds_q75/duckdb:parquet 45612830 / 45758096 / -0.3% 49970893 / 51227579 / -2.5% 0.91 / 0.89 / +2.2%
tpcds_q76/duckdb:parquet 18623460 / 19111945 / -2.6% 23354736 / 23651489 / -1.3% 0.80 / 0.81 / -1.3%
tpcds_q77/duckdb:parquet 25324201 / 25114661 / +0.8% 31774822 / 31183903 / +1.9% 0.80 / 0.81 / -1.0%
tpcds_q78/duckdb:parquet 77996176 / 78213693 / -0.3% 85400860 / 84710850 / +0.8% 0.91 / 0.92 / -1.1%
tpcds_q79/duckdb:parquet 21283536 / 22818478 / -6.7% 28810386 / 28675865 / +0.5% 0.74 / 0.80 / -7.2%
tpcds_q80/duckdb:parquet 37288703 / 38084688 / -2.1% 43626871 / 43905754 / -0.6% 0.85 / 0.87 / -1.5%
tpcds_q81/duckdb:parquet 36113942 / 36114452 / -0.0% 45240256 / 44674149 / +1.3% 0.80 / 0.81 / -1.3%
tpcds_q82/duckdb:parquet 13350604 / 13431422 / -0.6% 20461001 / 20484421 / -0.1% 0.65 / 0.66 / -0.5%
tpcds_q83/duckdb:parquet 20370496 / 20016020 / +1.8% 25309394 / 24837421 / +1.9% 0.80 / 0.81 / -0.1%
tpcds_q84/duckdb:parquet 22932941 / 22806443 / +0.6% 29099669 / 28776016 / +1.1% 0.79 / 0.79 / -0.6%
tpcds_q85/duckdb:parquet 32281491 / 32077430 / +0.6% 40008609 / 39504632 / +1.3% 0.81 / 0.81 / -0.6%
tpcds_q86/duckdb:parquet 11821780 / 11722304 / +0.8% 17243674 / 16860872 / +2.3% 0.69 / 0.70 / -1.4%
tpcds_q87/duckdb:parquet 31329934 / 31414421 / -0.3% 34849021 / 35159347 / -0.9% 0.90 / 0.89 / +0.6%
tpcds_q88/duckdb:parquet 37874010 / 38187692 / -0.8% 44474846 / 42610984 / +4.4% 0.85 / 0.90 / -5.0%
tpcds_q89/duckdb:parquet 14052598 / 15328942 / -8.3% 21046637 / 21620872 / -2.7% 0.67 / 0.71 / -5.8%
tpcds_q90/duckdb:parquet 9979542 / 9998867 / -0.2% 15382594 / 15240061 / +0.9% 0.65 / 0.66 / -1.1%
tpcds_q91/duckdb:parquet 21053350 / 21066494 / -0.1% 28217110 / 28347679 / -0.5% 0.75 / 0.74 / +0.4%
tpcds_q92/duckdb:parquet 15689608 / 15765522 / -0.5% 22296980 / 22031310 / +1.2% 0.70 / 0.72 / -1.7%
tpcds_q93/duckdb:parquet 14006258 / 14174594 / -1.2% 20206836 / 20222555 / -0.1% 0.69 / 0.70 / -1.1%
tpcds_q94/duckdb:parquet 25295107 / 25239802 / +0.2% 32581018 / 32756921 / -0.5% 0.78 / 0.77 / +0.8%
tpcds_q95/duckdb:parquet 43785547 / 44035276 / -0.6% 49585016 / 50061727 / -1.0% 0.88 / 0.88 / +0.4%
tpcds_q96/duckdb:parquet 8169003 / 8200122 / -0.4% 13936346 / 13736674 / +1.5% 0.59 / 0.60 / -1.8%
tpcds_q97/duckdb:parquet 27292388 / 27582790 / -1.1% 34065321 / 33982058 / +0.2% 0.80 / 0.81 / -1.3%
tpcds_q98/duckdb:parquet 16429767 / 16429147 / +0.0% 22998391 / 22724400 / +1.2% 0.71 / 0.72 / -1.2%
tpcds_q99/duckdb:parquet 18656196 / 18805868 / -0.8% 24930295 / 24735012 / +0.8% 0.75 / 0.76 / -1.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52344260 / 52493881 / -0.3% 74521623 / 75329468 / -1.1% 0.70 / 0.70 / +0.8%
appian_q02/datafusion:vortex-compact 227521557 / 229258468 / -0.8% 271330269 / 272011833 / -0.3% 0.84 / 0.84 / -0.5%
appian_q03/datafusion:vortex-compact 131052280 / 131299420 / -0.2% 174106309 / 172575602 / +0.9% 0.75 / 0.76 / -1.1%
appian_q04/datafusion:vortex-compact 9652517671 / 9657805835 / -0.1% 9752244381 / 9776174685 / -0.2% 0.99 / 0.99 / +0.2%
appian_q05/datafusion:vortex-compact 132904575 / 133880316 / -0.7% 168884948 / 164997854 / +2.4% 0.79 / 0.81 / -3.0%
appian_q06/datafusion:vortex-compact 148836833 / 147652674 / +0.8% 173656433 / 179811604 / -3.4% 0.86 / 0.82 / +4.4%
appian_q07/datafusion:vortex-compact 159335034 / 158748410 / +0.4% 201638343 / 199331245 / +1.2% 0.79 / 0.80 / -0.8%
appian_q08/datafusion:vortex-compact 528860381 / 529826101 / -0.2% 604989409 / 605169193 / -0.0% 0.87 / 0.88 / -0.2%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 71665286 / 72048910 / -0.5% 92078953 / 93807989 / -1.8% 0.78 / 0.77 / +1.3%
appian_q02/datafusion:parquet 292465195 / 292200385 / +0.1% 329281871 / 329078287 / +0.1% 0.89 / 0.89 / +0.0%
appian_q03/datafusion:parquet 184215575 / 184190668 / +0.0% 235201225 / 226837635 / +3.7% 0.78 / 0.81 / -3.5%
appian_q04/datafusion:parquet 9663665422 / 9681337691 / -0.2% 9738260022 / 9715161284 / +0.2% 0.99 / 1.00 / -0.4%
appian_q05/datafusion:parquet 192026971 / 192097881 / -0.0% 222623372 / 222316526 / +0.1% 0.86 / 0.86 / -0.2%
appian_q06/datafusion:parquet 165972933 / 165965799 / +0.0% 193980002 / 193464412 / +0.3% 0.86 / 0.86 / -0.3%
appian_q07/datafusion:parquet 204484824 / 204295082 / +0.1% 241101882 / 236700460 / +1.9% 0.85 / 0.86 / -1.7%
appian_q08/datafusion:parquet 625741356 / 624634137 / +0.2% 683332878 / 690826351 / -1.1% 0.92 / 0.90 / +1.3%
duckdb / vortex-compact / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 85770722 / 84273691 / +1.8% 97538372 / 99010478 / -1.5% 0.88 / 0.85 / +3.3%
appian_q02/duckdb:vortex-compact 233399005 / 231445684 / +0.8% 242512991 / 259000706 / -6.4% 0.96 / 0.89 / +7.7%
appian_q03/duckdb:vortex-compact 115375010 / 116120340 / -0.6% 132533169 / 131853875 / +0.5% 0.87 / 0.88 / -1.2%
appian_q04/duckdb:vortex-compact 618585640 / 619787999 / -0.2% 623995154 / 626436424 / -0.4% 0.99 / 0.99 / +0.2%
appian_q05/duckdb:vortex-compact 119202931 / 117752190 / +1.2% 136686018 / 131780061 / +3.7% 0.87 / 0.89 / -2.4%
appian_q06/duckdb:vortex-compact 201388410 / 199735346 / +0.8% 207656030 / 202635462 / +2.5% 0.97 / 0.99 / -1.6%
appian_q07/duckdb:vortex-compact 117510225 / 118486233 / -0.8% 133059968 / 133616719 / -0.4% 0.88 / 0.89 / -0.4%
appian_q08/duckdb:vortex-compact 346347046 / 342564148 / +1.1% 358044271 / 347929896 / +2.9% 0.97 / 0.98 / -1.8%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 92967719 / 95037869 / -2.2% 99821652 / 102767180 / -2.9% 0.93 / 0.92 / +0.7%
appian_q02/duckdb:parquet 245986359 / 239316810 / +2.8% 245760174 / 252289110 / -2.6% 1.00 / 0.95 / +5.5%
appian_q03/duckdb:parquet 130948603 / 131103408 / -0.1% 136809151 / 139299066 / -1.8% 0.96 / 0.94 / +1.7%
appian_q04/duckdb:parquet 486385550 / 486343973 / +0.0% 508239179 / 499433098 / +1.8% 0.96 / 0.97 / -1.7%
appian_q05/duckdb:parquet 131012808 / 131709465 / -0.5% 135356967 / 138021856 / -1.9% 0.97 / 0.95 / +1.4%
appian_q06/duckdb:parquet 114276505 / 114065664 / +0.2% 120619393 / 118742451 / +1.6% 0.95 / 0.96 / -1.4%
appian_q07/duckdb:parquet 108243220 / 108410255 / -0.2% 125093835 / 122975741 / +1.7% 0.87 / 0.88 / -1.8%
appian_q08/duckdb:parquet 363471781 / 359118016 / +1.2% 364902492 / 350017013 / +4.3% 1.00 / 1.03 / -2.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 2e569f7e vs base d5373802
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -10.8%
Engines: DataFusion No clear signal (-12.8%, environment too noisy confidence) · DuckDB No clear signal (-8.7%, environment too noisy confidence)
Vortex (geomean): hot 0.981x ➖ · cold 1.030x ➖
Parquet (geomean): hot 1.100x ➖ · cold 1.098x ➖
Shifts: Parquet (control) +10.0% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.012x ➖, 2↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 315582038 / 303531180 / +4.0% 1056812658 / 804966045 / +31.3% 🔴 0.30 / 0.38 / -20.8%
tpch_q02/datafusion:vortex-compact 522898169 / 526701204 / -0.7% 1162944635 / 1011271081 / +15.0% 0.45 / 0.52 / -13.7%
tpch_q03/datafusion:vortex-compact 478256238 / 579443668 / -17.5% 1175258633 / 1367799457 / -14.1% 0.41 / 0.42 / -3.9%
tpch_q04/datafusion:vortex-compact 453047532 / 295355695 / +53.4% 🔴 559045264 / 626542393 / -10.8% 0.81 / 0.47 / +71.9%
tpch_q05/datafusion:vortex-compact 583334848 / 654663481 / -10.9% 830844206 / 1382683720 / -39.9% 🟢 0.70 / 0.47 / +48.3%
tpch_q06/datafusion:vortex-compact 393166397 / 256986933 / +53.0% 🔴 846865975 / 442733035 / +91.3% 🔴 0.46 / 0.58 / -20.0%
tpch_q07/datafusion:vortex-compact 677143086 / 640030460 / +5.8% 827748658 / 877491119 / -5.7% 0.82 / 0.73 / +12.2%
tpch_q08/datafusion:vortex-compact 1056387585 / 761801563 / +38.7% 🔴 1398798268 / 920182832 / +52.0% 🔴 0.76 / 0.83 / -8.8%
tpch_q09/datafusion:vortex-compact 775875124 / 697621067 / +11.2% 1316939526 / 958729538 / +37.4% 🔴 0.59 / 0.73 / -19.0%
tpch_q10/datafusion:vortex-compact 745782490 / 3088432822 / -75.9% 🟢 1388027701 / 1179082984 / +17.7% 0.54 / 2.62 / -79.5%
tpch_q11/datafusion:vortex-compact 853317805 / 406429264 / +110.0% 🔴 911302787 / 744929117 / +22.3% 0.94 / 0.55 / +71.6%
tpch_q12/datafusion:vortex-compact 483618086 / 719829002 / -32.8% 🟢 807010732 / 728098297 / +10.8% 0.60 / 0.99 / -39.4%
tpch_q13/datafusion:vortex-compact 445710999 / 302447922 / +47.4% 🔴 1033934105 / 751985520 / +37.5% 🔴 0.43 / 0.40 / +7.2%
tpch_q14/datafusion:vortex-compact 310416387 / 351302192 / -11.6% 623679822 / 492930703 / +26.5% 0.50 / 0.71 / -30.2%
tpch_q15/datafusion:vortex-compact 576928828 / 548031402 / +5.3% 790108922 / 1283872236 / -38.5% 🟢 0.73 / 0.43 / +71.1%
tpch_q16/datafusion:vortex-compact 240005353 / 226859384 / +5.8% 449040894 / 545170176 / -17.6% 0.53 / 0.42 / +28.4%
tpch_q17/datafusion:vortex-compact 640578646 / 838885344 / -23.6% 647711749 / 1304666202 / -50.4% 🟢 0.99 / 0.64 / +53.8%
tpch_q18/datafusion:vortex-compact 674147065 / 617368125 / +9.2% 717401134 / 682076591 / +5.2% 0.94 / 0.91 / +3.8%
tpch_q19/datafusion:vortex-compact 471147842 / 457834521 / +2.9% 724692558 / 659714620 / +9.8% 0.65 / 0.69 / -6.3%
tpch_q20/datafusion:vortex-compact 660236024 / 658480062 / +0.3% 1144045594 / 834528151 / +37.1% 🔴 0.58 / 0.79 / -26.9%
tpch_q21/datafusion:vortex-compact 889671699 / 861537136 / +3.3% 942952590 / 1043610479 / -9.6% 0.94 / 0.83 / +14.3%
tpch_q22/datafusion:vortex-compact 286504778 / 283575124 / +1.0% 740003115 / 708641508 / +4.4% 0.39 / 0.40 / -3.2%
datafusion / parquet / ns (1.161x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 228126122 / 479380984 / -52.4% 🟢 513704291 / 597725857 / -14.1% 0.44 / 0.80 / -44.6%
tpch_q02/datafusion:parquet 452698576 / 483348321 / -6.3% 879478806 / 995294307 / -11.6% 0.51 / 0.49 / +6.0%
tpch_q03/datafusion:parquet 480429440 / 620142731 / -22.5% 854297683 / 1144431266 / -25.4% 0.56 / 0.54 / +3.8%
tpch_q04/datafusion:parquet 371751571 / 373449721 / -0.5% 743730255 / 521877549 / +42.5% 🔴 0.50 / 0.72 / -30.1%
tpch_q05/datafusion:parquet 709935136 / 609713509 / +16.4% 1015674647 / 914984716 / +11.0% 0.70 / 0.67 / +4.9%
tpch_q06/datafusion:parquet 663358516 / 296698920 / +123.6% 🔴 616783910 / 334837063 / +84.2% 🔴 1.08 / 0.89 / +21.4%
tpch_q07/datafusion:parquet 615599424 / 575183043 / +7.0% 1026401415 / 765659805 / +34.1% 🔴 0.60 / 0.75 / -20.2%
tpch_q08/datafusion:parquet 682796704 / 718972142 / -5.0% 1058206414 / 959912626 / +10.2% 0.65 / 0.75 / -13.9%
tpch_q09/datafusion:parquet 826485637 / 793929448 / +4.1% 1088694696 / 956114861 / +13.9% 0.76 / 0.83 / -8.6%
tpch_q10/datafusion:parquet 4677293393 / 1084560356 / +331.3% 🔴 2919421052 / 1353136475 / +115.8% 🔴 1.60 / 0.80 / +99.9%
tpch_q11/datafusion:parquet 361065122 / 431314241 / -16.3% 550257638 / 780537218 / -29.5% 0.66 / 0.55 / +18.7%
tpch_q12/datafusion:parquet 385896370 / 471166098 / -18.1% 545763451 / 1087591969 / -49.8% 🟢 0.71 / 0.43 / +63.2%
tpch_q13/datafusion:parquet 401831764 / 432310521 / -7.1% 673700891 / 744689810 / -9.5% 0.60 / 0.58 / +2.7%
tpch_q14/datafusion:parquet 492214345 / 431775707 / +14.0% 796731058 / 643276228 / +23.9% 0.62 / 0.67 / -8.0%
tpch_q15/datafusion:parquet 1851280518 / 534677130 / +246.2% 🔴 2146785137 / 674818956 / +218.1% 🔴 0.86 / 0.79 / +8.8%
tpch_q16/datafusion:parquet 224301134 / 260774787 / -14.0% 490207091 / 434410881 / +12.8% 0.46 / 0.60 / -23.8%
tpch_q17/datafusion:parquet 1383729863 / 711343804 / +94.5% 🔴 1075247621 / 749999200 / +43.4% 🔴 1.29 / 0.95 / +35.7%
tpch_q18/datafusion:parquet 735902229 / 509335151 / +44.5% 🔴 976056923 / 743147175 / +31.3% 🔴 0.75 / 0.69 / +10.0%
tpch_q19/datafusion:parquet 426620989 / 468885980 / -9.0% 564166131 / 630485610 / -10.5% 0.76 / 0.74 / +1.7%
tpch_q20/datafusion:parquet 710323692 / 690097179 / +2.9% 818379647 / 783198875 / +4.5% 0.87 / 0.88 / -1.5%
tpch_q21/datafusion:parquet 1229540787 / 1060877920 / +15.9% 1360999091 / 960193472 / +41.7% 🔴 0.90 / 1.10 / -18.2%
tpch_q22/datafusion:parquet 393022228 / 400621034 / -1.9% 715885510 / 644698822 / +11.0% 0.55 / 0.62 / -11.7%
duckdb / vortex-compact / ns (0.951x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 940969665 / 1041542523 / -9.7% 1077422390 / 1462341582 / -26.3% 0.87 / 0.71 / +22.6%
tpch_q02/duckdb:vortex-compact 493135681 / 553256805 / -10.9% 669880288 / 709034069 / -5.5% 0.74 / 0.78 / -5.7%
tpch_q03/duckdb:vortex-compact 1188612702 / 1188201102 / +0.0% 1598067059 / 1910436811 / -16.4% 0.74 / 0.62 / +19.6%
tpch_q04/duckdb:vortex-compact 869365583 / 1170947283 / -25.8% 1219238160 / 1471113920 / -17.1% 0.71 / 0.80 / -10.4%
tpch_q05/duckdb:vortex-compact 956850380 / 1051039156 / -9.0% 1235819102 / 1520075676 / -18.7% 0.77 / 0.69 / +12.0%
tpch_q06/duckdb:vortex-compact 733318079 / 740952899 / -1.0% 950298322 / 854092280 / +11.3% 0.77 / 0.87 / -11.0%
tpch_q07/duckdb:vortex-compact 1217662465 / 1120663918 / +8.7% 1664889643 / 1357741079 / +22.6% 0.73 / 0.83 / -11.4%
tpch_q08/duckdb:vortex-compact 1086220493 / 1082466936 / +0.3% 1390128125 / 1331889805 / +4.4% 0.78 / 0.81 / -3.9%
tpch_q09/duckdb:vortex-compact 1377337072 / 1346419726 / +2.3% 1480916209 / 1507186853 / -1.7% 0.93 / 0.89 / +4.1%
tpch_q10/duckdb:vortex-compact 1396147497 / 1376001006 / +1.5% 1613837449 / 1883516303 / -14.3% 0.87 / 0.73 / +18.4%
tpch_q11/duckdb:vortex-compact 319936445 / 381431703 / -16.1% 441678542 / 431009073 / +2.5% 0.72 / 0.88 / -18.1%
tpch_q12/duckdb:vortex-compact 822122593 / 835284948 / -1.6% 1035233589 / 965670223 / +7.2% 0.79 / 0.86 / -8.2%
tpch_q13/duckdb:vortex-compact 807350800 / 819681796 / -1.5% 1203182385 / 1125336359 / +6.9% 0.67 / 0.73 / -7.9%
tpch_q14/duckdb:vortex-compact 936595901 / 910463228 / +2.9% 1134702553 / 1071138993 / +5.9% 0.83 / 0.85 / -2.9%
tpch_q15/duckdb:vortex-compact 879539034 / 914547667 / -3.8% 1235684431 / 970346128 / +27.3% 0.71 / 0.94 / -24.5%
tpch_q16/duckdb:vortex-compact 311430359 / 278452528 / +11.8% 338333461 / 443981654 / -23.8% 0.92 / 0.63 / +46.8%
tpch_q17/duckdb:vortex-compact 909008769 / 1276197542 / -28.8% 1150931763 / 1052952037 / +9.3% 0.79 / 1.21 / -34.8%
tpch_q18/duckdb:vortex-compact 1297086599 / 1203189918 / +7.8% 1954664819 / 1182559446 / +65.3% 🔴 0.66 / 1.02 / -34.8%
tpch_q19/duckdb:vortex-compact 1002226635 / 1038276492 / -3.5% 1158089174 / 1225104023 / -5.5% 0.87 / 0.85 / +2.1%
tpch_q20/duckdb:vortex-compact 1003421819 / 998875057 / +0.5% 1231195923 / 1177396709 / +4.6% 0.81 / 0.85 / -3.9%
tpch_q21/duckdb:vortex-compact 2542194514 / 2284298743 / +11.3% 3225770464 / 2447459733 / +31.8% 🔴 0.79 / 0.93 / -15.6%
tpch_q22/duckdb:vortex-compact 401922418 / 546185220 / -26.4% 633052567 / 623519068 / +1.5% 0.63 / 0.88 / -27.5%
duckdb / parquet / ns (1.042x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 371728832 / 435950176 / -14.7% 378594787 / 360659103 / +5.0% 0.98 / 1.21 / -18.8%
tpch_q02/duckdb:parquet 593390041 / 534807186 / +11.0% 690882306 / 716851177 / -3.6% 0.86 / 0.75 / +15.1%
tpch_q03/duckdb:parquet 604069910 / 533701163 / +13.2% 918724076 / 808930400 / +13.6% 0.66 / 0.66 / -0.3%
tpch_q04/duckdb:parquet 394296533 / 397374837 / -0.8% 579360219 / 610077739 / -5.0% 0.68 / 0.65 / +4.5%
tpch_q05/duckdb:parquet 725284250 / 761411765 / -4.7% 1138188347 / 900200949 / +26.4% 0.64 / 0.85 / -24.7%
tpch_q06/duckdb:parquet 242082879 / 242477073 / -0.2% 227775806 / 272695555 / -16.5% 1.06 / 0.89 / +19.5%
tpch_q07/duckdb:parquet 880285460 / 812210622 / +8.4% 903112345 / 892209160 / +1.2% 0.97 / 0.91 / +7.1%
tpch_q08/duckdb:parquet 951402895 / 987120126 / -3.6% 1398986421 / 1031930840 / +35.6% 🔴 0.68 / 0.96 / -28.9%
tpch_q09/duckdb:parquet 1014686992 / 1017557531 / -0.3% 1175293908 / 1155391967 / +1.7% 0.86 / 0.88 / -2.0%
tpch_q10/duckdb:parquet 797970188 / 808549606 / -1.3% 922556173 / 897332215 / +2.8% 0.86 / 0.90 / -4.0%
tpch_q11/duckdb:parquet 438873667 / 365589226 / +20.0% 491101812 / 375485709 / +30.8% 🔴 0.89 / 0.97 / -8.2%
tpch_q12/duckdb:parquet 409912961 / 471462052 / -13.1% 532462305 / 780890004 / -31.8% 🟢 0.77 / 0.60 / +27.5%
tpch_q13/duckdb:parquet 555702123 / 546091398 / +1.8% 773499225 / 706013220 / +9.6% 0.72 / 0.77 / -7.1%
tpch_q14/duckdb:parquet 606223562 / 578205514 / +4.8% 734181243 / 693052667 / +5.9% 0.83 / 0.83 / -1.0%
tpch_q15/duckdb:parquet 505575603 / 324885389 / +55.6% 🔴 457866538 / 360950162 / +26.9% 1.10 / 0.90 / +22.7%
tpch_q16/duckdb:parquet 370536849 / 351344998 / +5.5% 418264595 / 400153061 / +4.5% 0.89 / 0.88 / +0.9%
tpch_q17/duckdb:parquet 398884024 / 424861532 / -6.1% 642017096 / 594868651 / +7.9% 0.62 / 0.71 / -13.0%
tpch_q18/duckdb:parquet 500221303 / 485736240 / +3.0% 728186951 / 1226833895 / -40.6% 🟢 0.69 / 0.40 / +73.5%
tpch_q19/duckdb:parquet 618694233 / 591667493 / +4.6% 596558720 / 626368279 / -4.8% 1.04 / 0.94 / +9.8%
tpch_q20/duckdb:parquet 827371480 / 827545922 / -0.0% 746985767 / 712994555 / +4.8% 1.11 / 1.16 / -4.6%
tpch_q21/duckdb:parquet 794859305 / 688939054 / +15.4% 1182431806 / 694564004 / +70.2% 🔴 0.67 / 0.99 / -32.2%
tpch_q22/duckdb:parquet 524173708 / 469921061 / +11.5% 580449831 / 556950016 / +4.2% 0.90 / 0.84 / +7.0%

@gatesn
gatesn merged commit 32730c9 into develop Nov 19, 2026
102 of 104 checks passed
@gatesn
gatesn deleted the ngates/datafusion-shared-scan-driver branch November 19, 2026 00:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants