Skip to content

Skip unused fields of nullable structs in V2 scans - #11638

Merged
connortsui20 merged 1 commit into
developfrom
ct/nullable-struct-projection
Nov 19, 2026
Merged

connortsui20 merged 1 commit into
developfrom
ct/nullable-struct-projection

Conversation

@connortsui20

@connortsui20 connortsui20 commented Nov 19, 2026 •

Copy link
Copy Markdown
Member

On develop, a V2 scan that reads one field from a nullable struct can still plan every child. The scan fails if a sibling uses a layout that V2 cannot execute. This PR plans only the requested fields and the validity needed to preserve their nulls.

For address.zip, the scan can skip address.city and an unused sibling list. A null address still produces a null zip.

Related to #10952, which handles deep projections in the classic reader.

This change was implemented and reviewed with OpenAI Codex.

@connortsui20 connortsui20 self-assigned this Nov 19, 2026
@connortsui20 connortsui20 changed the title Read projected fields of nullable structs in the V2 scan Skip unused fields of nullable structs in V2 scans Nov 19, 2026
@connortsui20
connortsui20 marked this pull request as ready for review November 19, 2026 18:54
@codspeed

codspeed Bot commented Nov 19, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 14.23%

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚡ 1 improved benchmark
✅ 1981 untouched benchmarks
⏩ 57 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Walltime random_rotating_avx2[(0.9, 0.9, "self_90pct_mask_90pct")] 9.5 µs 8.3 µs +14.23%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/nullable-struct-projection (fa6cf9b) with develop (d368834)

Open in CodSpeed

Footnotes

  1. 57 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

An unused sibling could force the planner to read every field or fail when it could not compile the sibling layout. Preserve ancestor validity in the field projection so the planner can skip unreferenced fields.

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
connortsui20 force-pushed the ct/nullable-struct-projection branch from 59234fd to fa6cf9b Compare November 19, 2026 19:20
@connortsui20 connortsui20 added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 19, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Nov 19, 2026
@github-actions

github-actions Bot commented Nov 19, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done fa6cf9b vortex-queries 1 Explore Profiling Data
🟢 Done fa6cf9b clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done fa6cf9b clickbench-nvme 1 Explore Profiling Data
🟢 Done fa6cf9b job-nvme 1 Explore Profiling Data
🟢 Done fa6cf9b tpch-nvme-10 1 Explore Profiling Data
🟢 Done fa6cf9b tpch-s3-10 1 Explore Profiling Data
🟢 Done fa6cf9b appian-nvme 1 Explore Profiling Data
🟢 Done fa6cf9b tpcds-nvme-10 1 Explore Profiling Data
🟢 Done fa6cf9b polarsignals 1 Explore Profiling Data
🟢 Done fa6cf9b tpch-s3 1 Explore Profiling Data
🟢 Done fa6cf9b statpopgen 1 Explore Profiling Data
🟢 Done fa6cf9b tpch-nested-nvme 1 Explore Profiling Data
🟢 Done fa6cf9b tpch-nvme 1 Explore Profiling Data
🟢 Done fa6cf9b tpcds-nvme 1 Explore Profiling Data
🟢 Done fa6cf9b fineweb 1 Explore Profiling Data
🟢 Done fa6cf9b fineweb-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR fa6cf9b2 vs base d3688347
Vortex (geomean): hot 1.002x ➖ · cold 1.008x ➖


datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 81759506 / 81841380 / -0.1% 120629270 / 122754795 / -1.7% 0.68 / 0.67 / +1.7%
polarsignals_q01/datafusion:vortex-file-compressed 89791046 / 89925882 / -0.1% 146279646 / 144127060 / +1.5% 0.61 / 0.62 / -1.6%
polarsignals_q02/datafusion:vortex-file-compressed 14455035 / 14355581 / +0.7% 45496742 / 44629233 / +1.9% 0.32 / 0.32 / -1.2%
polarsignals_q03/datafusion:vortex-file-compressed 91159364 / 91792999 / -0.7% 148171873 / 146151962 / +1.4% 0.62 / 0.63 / -2.0%
polarsignals_q04/datafusion:vortex-file-compressed 9247065 / 9338496 / -1.0% 38134058 / 38574622 / -1.1% 0.24 / 0.24 / +0.2%
polarsignals_q05/datafusion:vortex-file-compressed 11251648 / 11493772 / -2.1% 41729335 / 42453411 / -1.7% 0.27 / 0.27 / -0.4%
polarsignals_q06/datafusion:vortex-file-compressed 23086152 / 22855249 / +1.0% 53572919 / 52571152 / +1.9% 0.43 / 0.43 / -0.9%
polarsignals_q07/datafusion:vortex-file-compressed 10766122 / 10665186 / +0.9% 41797239 / 40031799 / +4.4% 0.26 / 0.27 / -3.3%
polarsignals_q08/datafusion:vortex-file-compressed 133934973 / 133278859 / +0.5% 191789086 / 191385719 / +0.2% 0.70 / 0.70 / +0.3%
polarsignals_q09/datafusion:vortex-file-compressed 9921182 / 9846660 / +0.8% 36818157 / 37079760 / -0.7% 0.27 / 0.27 / +1.5%
polarsignals_q10/datafusion:vortex-file-compressed 17603754 / 17204970 / +2.3% 50388559 / 50101341 / +0.6% 0.35 / 0.34 / +1.7%
polarsignals_q11/datafusion:vortex-file-compressed 16194310 / 16046012 / +0.9% 49261293 / 48066051 / +2.5% 0.33 / 0.33 / -1.5%
polarsignals_q12/datafusion:vortex-file-compressed 16482542 / 16565703 / -0.5% 46264039 / 45838582 / +0.9% 0.36 / 0.36 / -1.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.5%
Engines: DataFusion No clear signal (+2.4%, low confidence) · DuckDB No clear signal (+2.6%, low confidence)
Vortex (geomean): hot 1.024x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.035x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6092920 / 6041654 / +0.8% 19722764 / 19299274 / +2.2% 0.31 / 0.31 / -1.3%
fineweb_q01/datafusion:vortex-file-compressed 8874230 / 8939338 / -0.7% 34212207 / 33054762 / +3.5% 0.26 / 0.27 / -4.1%
fineweb_q02/datafusion:vortex-file-compressed 11272730 / 10159232 / +11.0% 🔴 39069767 / 38500968 / +1.5% 0.29 / 0.26 / +9.3%
fineweb_q03/datafusion:vortex-file-compressed 18205879 / 17423194 / +4.5% 102040985 / 106919545 / -4.6% 0.18 / 0.16 / +9.5%
fineweb_q04/datafusion:vortex-file-compressed 38569889 / 39387709 / -2.1% 119383286 / 114658727 / +4.1% 0.32 / 0.34 / -6.0%
fineweb_q05/datafusion:vortex-file-compressed 36802883 / 36339422 / +1.3% 110540881 / 115010974 / -3.9% 0.33 / 0.32 / +5.4%
fineweb_q06/datafusion:vortex-file-compressed 16455560 / 17032821 / -3.4% 97744879 / 103149156 / -5.2% 0.17 / 0.17 / +2.0%
fineweb_q07/datafusion:vortex-file-compressed 17418034 / 16260294 / +7.1% 101171796 / 103996038 / -2.7% 0.17 / 0.16 / +10.1%
fineweb_q08/datafusion:vortex-file-compressed 9959480 / 8692398 / +14.6% 🔴 27614962 / 26365571 / +4.7% 0.36 / 0.33 / +9.4%
datafusion / vortex-compact / ns (1.032x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6132447 / 6165120 / -0.5% 20117557 / 19134612 / +5.1% 0.30 / 0.32 / -5.4%
fineweb_q01/datafusion:vortex-compact 102533882 / 101656694 / +0.9% 132853642 / 131927890 / +0.7% 0.77 / 0.77 / +0.2%
fineweb_q02/datafusion:vortex-compact 102868730 / 103107670 / -0.2% 131293674 / 130824471 / +0.4% 0.78 / 0.79 / -0.6%
fineweb_q03/datafusion:vortex-compact 178487914 / 191881033 / -7.0% 254276985 / 254277439 / -0.0% 0.70 / 0.75 / -7.0%
fineweb_q04/datafusion:vortex-compact 194962358 / 200386483 / -2.7% 276880033 / 269722329 / +2.7% 0.70 / 0.74 / -5.2%
fineweb_q05/datafusion:vortex-compact 179590214 / 189318750 / -5.1% 263757886 / 259469099 / +1.7% 0.68 / 0.73 / -6.7%
fineweb_q06/datafusion:vortex-compact 124504736 / 121965334 / +2.1% 191936075 / 195975050 / -2.1% 0.65 / 0.62 / +4.2%
fineweb_q07/datafusion:vortex-compact 124848020 / 115913618 / +7.7% 191238075 / 195671609 / -2.3% 0.65 / 0.59 / +10.2%
fineweb_q08/datafusion:vortex-compact 8168091 / 5811842 / +40.5% 🔴 30335929 / 23755285 / +27.7% 🔴 0.27 / 0.24 / +10.1%
datafusion / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9375856 / 9318735 / +0.6% 32844297 / 32939329 / -0.3% 0.29 / 0.28 / +0.9%
fineweb_q01/datafusion:parquet 76008204 / 74343658 / +2.2% 151481918 / 148656822 / +1.9% 0.50 / 0.50 / +0.3%
fineweb_q02/datafusion:parquet 75309206 / 73729708 / +2.1% 146113386 / 148841639 / -1.8% 0.52 / 0.50 / +4.0%
fineweb_q03/datafusion:parquet 74689238 / 73717756 / +1.3% 144049138 / 149289026 / -3.5% 0.52 / 0.49 / +5.0%
fineweb_q04/datafusion:parquet 84722806 / 81127071 / +4.4% 154316576 / 145851394 / +5.8% 0.55 / 0.56 / -1.3%
fineweb_q05/datafusion:parquet 81240563 / 82201981 / -1.2% 142863847 / 151542318 / -5.7% 0.57 / 0.54 / +4.8%
fineweb_q06/datafusion:parquet 74419662 / 76034427 / -2.1% 146869718 / 148348265 / -1.0% 0.51 / 0.51 / -1.1%
fineweb_q07/datafusion:parquet 74321175 / 73452348 / +1.2% 143298518 / 146471653 / -2.2% 0.52 / 0.50 / +3.4%
fineweb_q08/datafusion:parquet 73315030 / 73263654 / +0.1% 146055575 / 147646891 / -1.1% 0.50 / 0.50 / +1.2%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2277924 / 2099988 / +8.5% 7122920 / 8183311 / -13.0% 🟢 0.32 / 0.26 / +24.6%
fineweb_q01/duckdb:vortex-file-compressed 9075752 / 8972763 / +1.1% 26526432 / 27001740 / -1.8% 0.34 / 0.33 / +3.0%
fineweb_q02/duckdb:vortex-file-compressed 10189124 / 11003276 / -7.4% 29271970 / 30712390 / -4.7% 0.35 / 0.36 / -2.8%
fineweb_q03/duckdb:vortex-file-compressed 18155421 / 17890652 / +1.5% 86150037 / 93767039 / -8.1% 0.21 / 0.19 / +10.5%
fineweb_q04/duckdb:vortex-file-compressed 39232762 / 39453839 / -0.6% 97140119 / 100325577 / -3.2% 0.40 / 0.39 / +2.7%
fineweb_q05/duckdb:vortex-file-compressed 39439922 / 39620134 / -0.5% 95255234 / 96281595 / -1.1% 0.41 / 0.41 / +0.6%
fineweb_q06/duckdb:vortex-file-compressed 18244551 / 18659912 / -2.2% 86426597 / 90693353 / -4.7% 0.21 / 0.21 / +2.6%
fineweb_q07/duckdb:vortex-file-compressed 17984916 / 17918571 / +0.4% 87053276 / 91700843 / -5.1% 0.21 / 0.20 / +5.7%
fineweb_q08/duckdb:vortex-file-compressed 4288936 / 4074069 / +5.3% 11267264 / 11015496 / +2.3% 0.38 / 0.37 / +2.9%
duckdb / vortex-compact / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2519298 / 2229256 / +13.0% 🔴 7996331 / 8248572 / -3.1% 0.32 / 0.27 / +16.6%
fineweb_q01/duckdb:vortex-compact 71411904 / 70833482 / +0.8% 88624750 / 90155154 / -1.7% 0.81 / 0.79 / +2.6%
fineweb_q02/duckdb:vortex-compact 72106117 / 72648477 / -0.7% 92380108 / 90652989 / +1.9% 0.78 / 0.80 / -2.6%
fineweb_q03/duckdb:vortex-compact 185267308 / 185343482 / -0.0% 222968544 / 223133661 / -0.1% 0.83 / 0.83 / +0.0%
fineweb_q04/duckdb:vortex-compact 194907762 / 195170878 / -0.1% 232030309 / 236460969 / -1.9% 0.84 / 0.83 / +1.8%
fineweb_q05/duckdb:vortex-compact 189798300 / 189277513 / +0.3% 224702816 / 224676217 / +0.0% 0.84 / 0.84 / +0.3%
fineweb_q06/duckdb:vortex-compact 116533374 / 113610822 / +2.6% 151957378 / 150682560 / +0.8% 0.77 / 0.75 / +1.7%
fineweb_q07/duckdb:vortex-compact 115193303 / 115522196 / -0.3% 154835725 / 154930369 / -0.1% 0.74 / 0.75 / -0.2%
fineweb_q08/duckdb:vortex-compact 4641902 / 4351026 / +6.7% 11340483 / 10633477 / +6.6% 0.41 / 0.41 / +0.0%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23658360 / 23233505 / +1.8% 27730882 / 28037386 / -1.1% 0.85 / 0.83 / +3.0%
fineweb_q01/duckdb:parquet 53910424 / 54996508 / -2.0% 73881649 / 71656085 / +3.1% 0.73 / 0.77 / -4.9%
fineweb_q02/duckdb:parquet 57542267 / 57394350 / +0.3% 76070300 / 76501269 / -0.6% 0.76 / 0.75 / +0.8%
fineweb_q03/duckdb:parquet 118116451 / 119091520 / -0.8% 181018314 / 177837688 / +1.8% 0.65 / 0.67 / -2.6%
fineweb_q04/duckdb:parquet 161830726 / 165134232 / -2.0% 203020588 / 206611863 / -1.7% 0.80 / 0.80 / -0.3%
fineweb_q05/duckdb:parquet 156110983 / 158293162 / -1.4% 203047516 / 197222008 / +3.0% 0.77 / 0.80 / -4.2%
fineweb_q06/duckdb:parquet 87612613 / 89994383 / -2.6% 147268172 / 150383639 / -2.1% 0.59 / 0.60 / -0.6%
fineweb_q07/duckdb:parquet 88435754 / 89488813 / -1.2% 142873354 / 140890355 / +1.4% 0.62 / 0.64 / -2.5%
fineweb_q08/duckdb:parquet 28456238 / 28933041 / -1.6% 31026528 / 29995376 / +3.4% 0.92 / 0.96 / -4.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.977x ➖ · cold 0.989x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.973x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 110704817 / 102487877 / +8.0% 494911129 / 518139989 / -4.5% 0.22 / 0.20 / +13.1%
clickbench-sorted_q24/datafusion:vortex-file-compressed 8104428 / 8570378 / -5.4% 54557686 / 53829529 / +1.4% 0.15 / 0.16 / -6.7%
clickbench-sorted_q26/datafusion:vortex-file-compressed 9706072 / 10225029 / -5.1% 54734973 / 54211620 / +1.0% 0.18 / 0.19 / -6.0%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22940978 / 24370424 / -5.9% 61734482 / 68345712 / -9.7% 0.37 / 0.36 / +4.2%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18377682 / 20306526 / -9.5% 57035692 / 59234431 / -3.7% 0.32 / 0.34 / -6.0%
clickbench-sorted_q38/datafusion:vortex-file-compressed 13577962 / 13157423 / +3.2% 60641964 / 62829445 / -3.5% 0.22 / 0.21 / +6.9%
clickbench-sorted_q39/datafusion:vortex-file-compressed 37851512 / 37911386 / -0.2% 97109902 / 96361510 / +0.8% 0.39 / 0.39 / -0.9%
clickbench-sorted_q40/datafusion:vortex-file-compressed 11346212 / 10990400 / +3.2% 43589502 / 43757871 / -0.4% 0.26 / 0.25 / +3.6%
clickbench-sorted_q41/datafusion:vortex-file-compressed 10618824 / 10738228 / -1.1% 44036771 / 45278914 / -2.7% 0.24 / 0.24 / +1.7%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9260822 / 9443241 / -1.9% 38925652 / 38590251 / +0.9% 0.24 / 0.24 / -2.8%
datafusion / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 748982177 / 744373994 / +0.6% 951921078 / 959537167 / -0.8% 0.79 / 0.78 / +1.4%
clickbench-sorted_q24/datafusion:parquet 8821114 / 8935952 / -1.3% 73939172 / 73899432 / +0.1% 0.12 / 0.12 / -1.3%
clickbench-sorted_q26/datafusion:parquet 8898088 / 9144548 / -2.7% 73090504 / 73571687 / -0.7% 0.12 / 0.12 / -2.1%
clickbench-sorted_q36/datafusion:parquet 89855623 / 90147186 / -0.3% 164267052 / 165994200 / -1.0% 0.55 / 0.54 / +0.7%
clickbench-sorted_q37/datafusion:parquet 61214139 / 61375475 / -0.3% 127126659 / 127700834 / -0.4% 0.48 / 0.48 / +0.2%
clickbench-sorted_q38/datafusion:parquet 83181636 / 83597676 / -0.5% 158692156 / 160048022 / -0.8% 0.52 / 0.52 / +0.4%
clickbench-sorted_q39/datafusion:parquet 152158746 / 153416754 / -0.8% 228780417 / 228970898 / -0.1% 0.67 / 0.67 / -0.7%
clickbench-sorted_q40/datafusion:parquet 41459016 / 42010596 / -1.3% 113142102 / 114587883 / -1.3% 0.37 / 0.37 / -0.1%
clickbench-sorted_q41/datafusion:parquet 39674696 / 39828071 / -0.4% 107326297 / 107897330 / -0.5% 0.37 / 0.37 / +0.1%
clickbench-sorted_q42/datafusion:parquet 24865126 / 25281970 / -1.6% 85000815 / 86074798 / -1.2% 0.29 / 0.29 / -0.4%
duckdb / vortex-file-compressed / ns (0.970x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 58080442 / 63069756 / -7.9% 264243485 / 266081614 / -0.7% 0.22 / 0.24 / -7.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed 11594730 / 11841604 / -2.1% 31016438 / 29550251 / +5.0% 0.37 / 0.40 / -6.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 10879774 / 12112372 / -10.2% 🟢 31928190 / 33972926 / -6.0% 0.34 / 0.36 / -4.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed 20325582 / 20602112 / -1.3% 50669002 / 48023716 / +5.5% 0.40 / 0.43 / -6.5%
clickbench-sorted_q37/duckdb:vortex-file-compressed 16716130 / 16362316 / +2.2% 44469979 / 43831750 / +1.5% 0.38 / 0.37 / +0.7%
clickbench-sorted_q38/duckdb:vortex-file-compressed 13588322 / 14864930 / -8.6% 45656620 / 44921698 / +1.6% 0.30 / 0.33 / -10.1%
clickbench-sorted_q39/duckdb:vortex-file-compressed 33764279 / 33752846 / +0.0% 77849638 / 78692223 / -1.1% 0.43 / 0.43 / +1.1%
clickbench-sorted_q40/duckdb:vortex-file-compressed 9884586 / 10266902 / -3.7% 33771019 / 35267710 / -4.2% 0.29 / 0.29 / +0.5%
clickbench-sorted_q41/duckdb:vortex-file-compressed 11388302 / 11290484 / +0.9% 36165747 / 36807448 / -1.7% 0.31 / 0.31 / +2.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed 8786386 / 8603988 / +2.1% 30365265 / 30347327 / +0.1% 0.29 / 0.28 / +2.1%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 139573763 / 142546168 / -2.1% 173522851 / 181508472 / -4.4% 0.80 / 0.79 / +2.4%
clickbench-sorted_q24/duckdb:parquet 16010648 / 15370608 / +4.2% 20257346 / 23978201 / -15.5% 🟢 0.79 / 0.64 / +23.3%
clickbench-sorted_q26/duckdb:parquet 14877866 / 15464360 / -3.8% 21829461 / 21359523 / +2.2% 0.68 / 0.72 / -5.9%
clickbench-sorted_q36/duckdb:parquet 46626878 / 47132348 / -1.1% 58164459 / 66896092 / -13.1% 🟢 0.80 / 0.70 / +13.8%
clickbench-sorted_q37/duckdb:parquet 36442396 / 36396853 / +0.1% 42453965 / 44994804 / -5.6% 0.86 / 0.81 / +6.1%
clickbench-sorted_q38/duckdb:parquet 43179093 / 42673205 / +1.2% 57084705 / 59910782 / -4.7% 0.76 / 0.71 / +6.2%
clickbench-sorted_q39/duckdb:parquet 75962767 / 75816606 / +0.2% 86372957 / 87664810 / -1.5% 0.88 / 0.86 / +1.7%
clickbench-sorted_q40/duckdb:parquet 22853296 / 22177114 / +3.0% 27709707 / 29938375 / -7.4% 0.82 / 0.74 / +11.3%
clickbench-sorted_q41/duckdb:parquet 22432180 / 22070588 / +1.6% 28587769 / 28708157 / -0.4% 0.78 / 0.77 / +2.1%
clickbench-sorted_q42/duckdb:parquet 16905613 / 16910432 / -0.0% 24667275 / 23117539 / +6.7% 0.69 / 0.73 / -6.3%
duckdb / duckdb / ns (1.022x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 68940309 / 68564922 / +0.5% 119767551 / 120687297 / -0.8% 0.58 / 0.57 / +1.3%
clickbench-sorted_q24/duckdb:duckdb 22739126 / 22556004 / +0.8% 29354255 / 29043451 / +1.1% 0.77 / 0.78 / -0.3%
clickbench-sorted_q26/duckdb:duckdb 23234574 / 22838294 / +1.7% 31804058 / 31618823 / +0.6% 0.73 / 0.72 / +1.1%
clickbench-sorted_q36/duckdb:duckdb 44412630 / 38118910 / +16.5% 🔴 68479960 / 75972457 / -9.9% 0.65 / 0.50 / +29.3%
clickbench-sorted_q37/duckdb:duckdb 36806193 / 36473612 / +0.9% 72948770 / 72295236 / +0.9% 0.50 / 0.50 / +0.0%
clickbench-sorted_q38/duckdb:duckdb 30438932 / 29870929 / +1.9% 67212383 / 66434951 / +1.2% 0.45 / 0.45 / +0.7%
clickbench-sorted_q39/duckdb:duckdb 54350793 / 55458976 / -2.0% 109273954 / 108888080 / +0.4% 0.50 / 0.51 / -2.3%
clickbench-sorted_q40/duckdb:duckdb 22170226 / 21857022 / +1.4% 46128336 / 46162072 / -0.1% 0.48 / 0.47 / +1.5%
clickbench-sorted_q41/duckdb:duckdb 21021068 / 20860010 / +0.8% 38788497 / 38617058 / +0.4% 0.54 / 0.54 / +0.3%
clickbench-sorted_q42/duckdb:duckdb 17079304 / 16960511 / +0.7% 28583450 / 28564101 / +0.1% 0.60 / 0.59 / +0.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15705935 / 15625333 / +0.5% 43947282 / 42035392 / +4.5% 0.36 / 0.37 / -3.9%
tpch_q02/datafusion:vortex-file-compressed 17724379 / 17706589 / +0.1% 37896265 / 37943740 / -0.1% 0.47 / 0.47 / +0.2%
tpch_q03/datafusion:vortex-file-compressed 19108579 / 19285445 / -0.9% 47222517 / 48627169 / -2.9% 0.40 / 0.40 / +2.0%
tpch_q04/datafusion:vortex-file-compressed 10804781 / 10655209 / +1.4% 34130696 / 32173277 / +6.1% 0.32 / 0.33 / -4.4%
tpch_q05/datafusion:vortex-file-compressed 37276614 / 37773498 / -1.3% 64744370 / 67771326 / -4.5% 0.58 / 0.56 / +3.3%
tpch_q06/datafusion:vortex-file-compressed 4688779 / 4713971 / -0.5% 26076484 / 26561962 / -1.8% 0.18 / 0.18 / +1.3%
tpch_q07/datafusion:vortex-file-compressed 52200938 / 51865906 / +0.6% 78528884 / 79235389 / -0.9% 0.66 / 0.65 / +1.6%
tpch_q08/datafusion:vortex-file-compressed 52217024 / 52151452 / +0.1% 84276126 / 83838813 / +0.5% 0.62 / 0.62 / -0.4%
tpch_q09/datafusion:vortex-file-compressed 47339666 / 47717528 / -0.8% 82252441 / 83096804 / -1.0% 0.58 / 0.57 / +0.2%
tpch_q10/datafusion:vortex-file-compressed 17347441 / 17680950 / -1.9% 50451835 / 49365343 / +2.2% 0.34 / 0.36 / -4.0%
tpch_q11/datafusion:vortex-file-compressed 14727140 / 14524291 / +1.4% 33672103 / 34829580 / -3.3% 0.44 / 0.42 / +4.9%
tpch_q12/datafusion:vortex-file-compressed 18668403 / 18585359 / +0.4% 43204569 / 46553419 / -7.2% 0.43 / 0.40 / +8.2%
tpch_q13/datafusion:vortex-file-compressed 19771601 / 19365435 / +2.1% 40627364 / 39043920 / +4.1% 0.49 / 0.50 / -1.9%
tpch_q14/datafusion:vortex-file-compressed 13953474 / 14511854 / -3.8% 39540630 / 38343633 / +3.1% 0.35 / 0.38 / -6.8%
tpch_q15/datafusion:vortex-file-compressed 18828829 / 18717987 / +0.6% 45984974 / 45363636 / +1.4% 0.41 / 0.41 / -0.8%
tpch_q16/datafusion:vortex-file-compressed 18383698 / 18359971 / +0.1% 40222079 / 39928261 / +0.7% 0.46 / 0.46 / -0.6%
tpch_q17/datafusion:vortex-file-compressed 29209518 / 29405767 / -0.7% 59537813 / 59478178 / +0.1% 0.49 / 0.49 / -0.8%
tpch_q18/datafusion:vortex-file-compressed 36497457 / 36226844 / +0.7% 62314722 / 59368278 / +5.0% 0.59 / 0.61 / -4.0%
tpch_q19/datafusion:vortex-file-compressed 9580861 / 9661454 / -0.8% 35471925 / 37078370 / -4.3% 0.27 / 0.26 / +3.7%
tpch_q20/datafusion:vortex-file-compressed 20622205 / 20658978 / -0.2% 47182692 / 46259766 / +2.0% 0.44 / 0.45 / -2.1%
tpch_q21/datafusion:vortex-file-compressed 34780398 / 35148859 / -1.0% 65113916 / 64686324 / +0.7% 0.53 / 0.54 / -1.7%
tpch_q22/datafusion:vortex-file-compressed 10902827 / 10886558 / +0.1% 32054318 / 31320034 / +2.3% 0.34 / 0.35 / -2.1%
datafusion / vortex-compact / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16413072 / 16547314 / -0.8% 45687999 / 45217999 / +1.0% 0.36 / 0.37 / -1.8%
tpch_q02/datafusion:vortex-compact 19468885 / 19686434 / -1.1% 38766473 / 39780200 / -2.5% 0.50 / 0.49 / +1.5%
tpch_q03/datafusion:vortex-compact 20106565 / 19939460 / +0.8% 46403752 / 46074343 / +0.7% 0.43 / 0.43 / +0.1%
tpch_q04/datafusion:vortex-compact 11004000 / 11328177 / -2.9% 36204338 / 32689567 / +10.8% 🔴 0.30 / 0.35 / -12.3%
tpch_q05/datafusion:vortex-compact 37931516 / 38381713 / -1.2% 67639981 / 69409168 / -2.5% 0.56 / 0.55 / +1.4%
tpch_q06/datafusion:vortex-compact 5345019 / 5449250 / -1.9% 28041692 / 27490873 / +2.0% 0.19 / 0.20 / -3.8%
tpch_q07/datafusion:vortex-compact 53864200 / 54299035 / -0.8% 78882339 / 81397902 / -3.1% 0.68 / 0.67 / +2.4%
tpch_q08/datafusion:vortex-compact 52945547 / 53766908 / -1.5% 83734133 / 82667658 / +1.3% 0.63 / 0.65 / -2.8%
tpch_q09/datafusion:vortex-compact 49840917 / 48657218 / +2.4% 76558740 / 82969282 / -7.7% 0.65 / 0.59 / +11.0%
tpch_q10/datafusion:vortex-compact 19373567 / 19620106 / -1.3% 49844092 / 47693568 / +4.5% 0.39 / 0.41 / -5.5%
tpch_q11/datafusion:vortex-compact 15225765 / 15480770 / -1.6% 35728365 / 34689167 / +3.0% 0.43 / 0.45 / -4.5%
tpch_q12/datafusion:vortex-compact 20195338 / 20071705 / +0.6% 44363509 / 41427603 / +7.1% 0.46 / 0.48 / -6.0%
tpch_q13/datafusion:vortex-compact 20546999 / 20581576 / -0.2% 39345725 / 37154687 / +5.9% 0.52 / 0.55 / -5.7%
tpch_q14/datafusion:vortex-compact 15296603 / 15397451 / -0.7% 39042084 / 38967122 / +0.2% 0.39 / 0.40 / -0.8%
tpch_q15/datafusion:vortex-compact 19851875 / 19918432 / -0.3% 47385244 / 48700706 / -2.7% 0.42 / 0.41 / +2.4%
tpch_q16/datafusion:vortex-compact 18689971 / 18146615 / +3.0% 38976103 / 39565835 / -1.5% 0.48 / 0.46 / +4.6%
tpch_q17/datafusion:vortex-compact 30440895 / 30619291 / -0.6% 62607213 / 60582816 / +3.3% 0.49 / 0.51 / -3.8%
tpch_q18/datafusion:vortex-compact 36943997 / 36816026 / +0.3% 60127970 / 59670992 / +0.8% 0.61 / 0.62 / -0.4%
tpch_q19/datafusion:vortex-compact 11293813 / 11451242 / -1.4% 38122152 / 39256280 / -2.9% 0.30 / 0.29 / +1.6%
tpch_q20/datafusion:vortex-compact 21795449 / 22084834 / -1.3% 48136849 / 49444873 / -2.6% 0.45 / 0.45 / +1.4%
tpch_q21/datafusion:vortex-compact 37192722 / 37877813 / -1.8% 65595331 / 66855837 / -1.9% 0.57 / 0.57 / +0.1%
tpch_q22/datafusion:vortex-compact 10936419 / 11119349 / -1.6% 30676235 / 32044040 / -4.3% 0.36 / 0.35 / +2.7%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71284886 / 71318813 / -0.0% 88561217 / 89010609 / -0.5% 0.80 / 0.80 / +0.5%
tpch_q02/datafusion:parquet 75784066 / 76690312 / -1.2% 94320239 / 92005275 / +2.5% 0.80 / 0.83 / -3.6%
tpch_q03/datafusion:parquet 82204113 / 82460180 / -0.3% 105045373 / 103187382 / +1.8% 0.78 / 0.80 / -2.1%
tpch_q04/datafusion:parquet 39600723 / 39286324 / +0.8% 59431767 / 59444283 / -0.0% 0.67 / 0.66 / +0.8%
tpch_q05/datafusion:parquet 110485807 / 110570384 / -0.1% 139325960 / 136735775 / +1.9% 0.79 / 0.81 / -1.9%
tpch_q06/datafusion:parquet 31685988 / 31663533 / +0.1% 48585497 / 47796057 / +1.7% 0.65 / 0.66 / -1.6%
tpch_q07/datafusion:parquet 112887101 / 113515937 / -0.6% 139984548 / 140744687 / -0.5% 0.81 / 0.81 / -0.0%
tpch_q08/datafusion:parquet 117633225 / 117086047 / +0.5% 143947502 / 144477693 / -0.4% 0.82 / 0.81 / +0.8%
tpch_q09/datafusion:parquet 137458579 / 137528464 / -0.1% 167723771 / 167891311 / -0.1% 0.82 / 0.82 / +0.0%
tpch_q10/datafusion:parquet 103282754 / 104227330 / -0.9% 129423824 / 126802710 / +2.1% 0.80 / 0.82 / -2.9%
tpch_q11/datafusion:parquet 62636681 / 61589682 / +1.7% 81630373 / 81887212 / -0.3% 0.77 / 0.75 / +2.0%
tpch_q12/datafusion:parquet 64732569 / 64192579 / +0.8% 85365843 / 84610568 / +0.9% 0.76 / 0.76 / -0.1%
tpch_q13/datafusion:parquet 142596827 / 143479607 / -0.6% 162988805 / 162727878 / +0.2% 0.87 / 0.88 / -0.8%
tpch_q14/datafusion:parquet 47654565 / 47746662 / -0.2% 71882409 / 70891120 / +1.4% 0.66 / 0.67 / -1.6%
tpch_q15/datafusion:parquet 73537224 / 74039844 / -0.7% 95994499 / 94842820 / +1.2% 0.77 / 0.78 / -1.9%
tpch_q16/datafusion:parquet 43547138 / 43560778 / -0.0% 67499122 / 61461065 / +9.8% 0.65 / 0.71 / -9.0%
tpch_q17/datafusion:parquet 123185366 / 123226866 / -0.0% 148442851 / 148490678 / -0.0% 0.83 / 0.83 / -0.0%
tpch_q18/datafusion:parquet 120016597 / 120896707 / -0.7% 143226812 / 144105926 / -0.6% 0.84 / 0.84 / -0.1%
tpch_q19/datafusion:parquet 56761971 / 57022082 / -0.5% 82409437 / 82872323 / -0.6% 0.69 / 0.69 / +0.1%
tpch_q20/datafusion:parquet 78289336 / 77621089 / +0.9% 102238005 / 103874187 / -1.6% 0.77 / 0.75 / +2.5%
tpch_q21/datafusion:parquet 113547200 / 113240065 / +0.3% 140170315 / 138772330 / +1.0% 0.81 / 0.82 / -0.7%
tpch_q22/datafusion:parquet 51758592 / 52565556 / -1.5% 69035720 / 67555664 / +2.2% 0.75 / 0.78 / -3.6%
duckdb / vortex-file-compressed / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8727846 / 9812636 / -11.1% 🟢 20013519 / 20890918 / -4.2% 0.44 / 0.47 / -7.2%
tpch_q02/duckdb:vortex-file-compressed 15155425 / 15016077 / +0.9% 24871962 / 25193517 / -1.3% 0.61 / 0.60 / +2.2%
tpch_q03/duckdb:vortex-file-compressed 18327928 / 18653458 / -1.7% 35442044 / 37206541 / -4.7% 0.52 / 0.50 / +3.1%
tpch_q04/duckdb:vortex-file-compressed 12094235 / 12231462 / -1.1% 25855484 / 26522034 / -2.5% 0.47 / 0.46 / +1.4%
tpch_q05/duckdb:vortex-file-compressed 20255103 / 20718257 / -2.2% 36001413 / 36541293 / -1.5% 0.56 / 0.57 / -0.8%
tpch_q06/duckdb:vortex-file-compressed 4904659 / 4693867 / +4.5% 14845619 / 14068902 / +5.5% 0.33 / 0.33 / -1.0%
tpch_q07/duckdb:vortex-file-compressed 24110079 / 24274877 / -0.7% 43325473 / 39185484 / +10.6% 🔴 0.56 / 0.62 / -10.2%
tpch_q08/duckdb:vortex-file-compressed 21473185 / 21259323 / +1.0% 37376639 / 37590184 / -0.6% 0.57 / 0.57 / +1.6%
tpch_q09/duckdb:vortex-file-compressed 22821790 / 23164729 / -1.5% 37930925 / 39813362 / -4.7% 0.60 / 0.58 / +3.4%
tpch_q10/duckdb:vortex-file-compressed 27451652 / 27490443 / -0.1% 44287512 / 43196462 / +2.5% 0.62 / 0.64 / -2.6%
tpch_q11/duckdb:vortex-file-compressed 8048865 / 8090294 / -0.5% 16751582 / 17223910 / -2.7% 0.48 / 0.47 / +2.3%
tpch_q12/duckdb:vortex-file-compressed 14246168 / 14523553 / -1.9% 25114654 / 25128357 / -0.1% 0.57 / 0.58 / -1.9%
tpch_q13/duckdb:vortex-file-compressed 19272470 / 19658949 / -2.0% 32593751 / 31587965 / +3.2% 0.59 / 0.62 / -5.0%
tpch_q14/duckdb:vortex-file-compressed 11279921 / 11130218 / +1.3% 24683351 / 24515531 / +0.7% 0.46 / 0.45 / +0.7%
tpch_q15/duckdb:vortex-file-compressed 8516246 / 8308494 / +2.5% 19999200 / 20377460 / -1.9% 0.43 / 0.41 / +4.4%
tpch_q16/duckdb:vortex-file-compressed 16489331 / 16454690 / +0.2% 23393225 / 23773746 / -1.6% 0.70 / 0.69 / +1.8%
tpch_q17/duckdb:vortex-file-compressed 12762373 / 12830570 / -0.5% 28866805 / 27339442 / +5.6% 0.44 / 0.47 / -5.8%
tpch_q18/duckdb:vortex-file-compressed 24323635 / 24704692 / -1.5% 33839983 / 33733223 / +0.3% 0.72 / 0.73 / -1.9%
tpch_q19/duckdb:vortex-file-compressed 11480037 / 11405904 / +0.6% 24857573 / 24534095 / +1.3% 0.46 / 0.46 / -0.7%
tpch_q20/duckdb:vortex-file-compressed 14313399 / 14289622 / +0.2% 29796666 / 30159044 / -1.2% 0.48 / 0.47 / +1.4%
tpch_q21/duckdb:vortex-file-compressed 48059670 / 47967100 / +0.2% 63614988 / 64187475 / -0.9% 0.76 / 0.75 / +1.1%
tpch_q22/duckdb:vortex-file-compressed 16925678 / 16872038 / +0.3% 26641884 / 26781955 / -0.5% 0.64 / 0.63 / +0.8%
duckdb / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 10691404 / 11143630 / -4.1% 20920911 / 22891592 / -8.6% 0.51 / 0.49 / +5.0%
tpch_q02/duckdb:vortex-compact 17731869 / 17533728 / +1.1% 27357985 / 27302556 / +0.2% 0.65 / 0.64 / +0.9%
tpch_q03/duckdb:vortex-compact 20125899 / 20091620 / +0.2% 33863361 / 35384250 / -4.3% 0.59 / 0.57 / +4.7%
tpch_q04/duckdb:vortex-compact 13118466 / 12860093 / +2.0% 26770750 / 25746458 / +4.0% 0.49 / 0.50 / -1.9%
tpch_q05/duckdb:vortex-compact 21009965 / 20899094 / +0.5% 36558342 / 36989120 / -1.2% 0.57 / 0.57 / +1.7%
tpch_q06/duckdb:vortex-compact 5187639 / 5259496 / -1.4% 15509307 / 15937809 / -2.7% 0.33 / 0.33 / +1.4%
tpch_q07/duckdb:vortex-compact 25743089 / 25543683 / +0.8% 39790667 / 41956010 / -5.2% 0.65 / 0.61 / +6.3%
tpch_q08/duckdb:vortex-compact 21977858 / 21609177 / +1.7% 38123607 / 38354070 / -0.6% 0.58 / 0.56 / +2.3%
tpch_q09/duckdb:vortex-compact 24020813 / 24710672 / -2.8% 41103129 / 40508288 / +1.5% 0.58 / 0.61 / -4.2%
tpch_q10/duckdb:vortex-compact 31111579 / 30913600 / +0.6% 46503633 / 47086531 / -1.2% 0.67 / 0.66 / +1.9%
tpch_q11/duckdb:vortex-compact 8542975 / 8614170 / -0.8% 17218801 / 17496288 / -1.6% 0.50 / 0.49 / +0.8%
tpch_q12/duckdb:vortex-compact 17314394 / 17299124 / +0.1% 27699940 / 27834451 / -0.5% 0.63 / 0.62 / +0.6%
tpch_q13/duckdb:vortex-compact 19775335 / 20460870 / -3.4% 32249085 / 32485340 / -0.7% 0.61 / 0.63 / -2.6%
tpch_q14/duckdb:vortex-compact 12368152 / 12342068 / +0.2% 27247315 / 26012492 / +4.7% 0.45 / 0.47 / -4.3%
tpch_q15/duckdb:vortex-compact 9729406 / 9553541 / +1.8% 23506896 / 23696694 / -0.8% 0.41 / 0.40 / +2.7%
tpch_q16/duckdb:vortex-compact 17038068 / 17176354 / -0.8% 23588889 / 24392481 / -3.3% 0.72 / 0.70 / +2.6%
tpch_q17/duckdb:vortex-compact 13372461 / 13096925 / +2.1% 30269971 / 28070101 / +7.8% 0.44 / 0.47 / -5.3%
tpch_q18/duckdb:vortex-compact 25064847 / 25091111 / -0.1% 33823287 / 34700131 / -2.5% 0.74 / 0.72 / +2.5%
tpch_q19/duckdb:vortex-compact 14607896 / 14884325 / -1.9% 30905551 / 30495903 / +1.3% 0.47 / 0.49 / -3.2%
tpch_q20/duckdb:vortex-compact 17045104 / 17806522 / -4.3% 33799283 / 33354294 / +1.3% 0.50 / 0.53 / -5.5%
tpch_q21/duckdb:vortex-compact 48962982 / 49337668 / -0.8% 64701442 / 65780997 / -1.6% 0.76 / 0.75 / +0.9%
tpch_q22/duckdb:vortex-compact 19506593 / 19369234 / +0.7% 29176682 / 29643776 / -1.6% 0.67 / 0.65 / +2.3%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47402037 / 47590618 / -0.4% 53757689 / 54233731 / -0.9% 0.88 / 0.88 / +0.5%
tpch_q02/duckdb:parquet 48165171 / 48469561 / -0.6% 55263206 / 55710596 / -0.8% 0.87 / 0.87 / +0.2%
tpch_q03/duckdb:parquet 60299216 / 60179183 / +0.2% 68555595 / 68746781 / -0.3% 0.88 / 0.88 / +0.5%
tpch_q04/duckdb:parquet 34588057 / 34742421 / -0.4% 43292134 / 43114255 / +0.4% 0.80 / 0.81 / -0.9%
tpch_q05/duckdb:parquet 67033992 / 67403236 / -0.5% 76715074 / 77601820 / -1.1% 0.87 / 0.87 / +0.6%
tpch_q06/duckdb:parquet 21786056 / 21508442 / +1.3% 27458852 / 28166407 / -2.5% 0.79 / 0.76 / +3.9%
tpch_q07/duckdb:parquet 63511779 / 63936924 / -0.7% 73478781 / 73394105 / +0.1% 0.86 / 0.87 / -0.8%
tpch_q08/duckdb:parquet 75515106 / 75784194 / -0.4% 87276780 / 87049690 / +0.3% 0.87 / 0.87 / -0.6%
tpch_q09/duckdb:parquet 107448739 / 107802243 / -0.3% 118928344 / 119806744 / -0.7% 0.90 / 0.90 / +0.4%
tpch_q10/duckdb:parquet 105394218 / 105839396 / -0.4% 117163099 / 117436535 / -0.2% 0.90 / 0.90 / -0.2%
tpch_q11/duckdb:parquet 29345470 / 29342994 / +0.0% 34709868 / 34742947 / -0.1% 0.85 / 0.84 / +0.1%
tpch_q12/duckdb:parquet 37113028 / 37171584 / -0.2% 44083615 / 44736646 / -1.5% 0.84 / 0.83 / +1.3%
tpch_q13/duckdb:parquet 174176333 / 174984437 / -0.5% 181074150 / 182764046 / -0.9% 0.96 / 0.96 / +0.5%
tpch_q14/duckdb:parquet 42131821 / 42295888 / -0.4% 51207787 / 50853959 / +0.7% 0.82 / 0.83 / -1.1%
tpch_q15/duckdb:parquet 32504121 / 32630186 / -0.4% 41285340 / 41303517 / -0.0% 0.79 / 0.79 / -0.3%
tpch_q16/duckdb:parquet 46957856 / 46829342 / +0.3% 52214125 / 52249951 / -0.1% 0.90 / 0.90 / +0.3%
tpch_q17/duckdb:parquet 47825477 / 47962074 / -0.3% 57575583 / 57695600 / -0.2% 0.83 / 0.83 / -0.1%
tpch_q18/duckdb:parquet 73859679 / 74191557 / -0.4% 80174591 / 81299100 / -1.4% 0.92 / 0.91 / +0.9%
tpch_q19/duckdb:parquet 50189341 / 47474045 / +5.7% 58360460 / 57661999 / +1.2% 0.86 / 0.82 / +4.5%
tpch_q20/duckdb:parquet 63446167 / 63446176 / -0.0% 75060984 / 74450254 / +0.8% 0.85 / 0.85 / -0.8%
tpch_q21/duckdb:parquet 105785486 / 106949857 / -1.1% 115253406 / 116754153 / -1.3% 0.92 / 0.92 / +0.2%
tpch_q22/duckdb:parquet 50364644 / 50517069 / -0.3% 58661621 / 58996763 / -0.6% 0.86 / 0.86 / +0.3%
duckdb / duckdb / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 6267688 / 6254009 / +0.2% 14874059 / 15241743 / -2.4% 0.42 / 0.41 / +2.7%
tpch_q02/duckdb:duckdb 8586037 / 8720536 / -1.5% 17116071 / 16555867 / +3.4% 0.50 / 0.53 / -4.8%
tpch_q03/duckdb:duckdb 15440824 / 15595720 / -1.0% 25728162 / 24993715 / +2.9% 0.60 / 0.62 / -3.8%
tpch_q04/duckdb:duckdb 11347720 / 11319755 / +0.2% 21232064 / 22307927 / -4.8% 0.53 / 0.51 / +5.3%
tpch_q05/duckdb:duckdb 15545705 / 15480342 / +0.4% 27471230 / 27478086 / -0.0% 0.57 / 0.56 / +0.4%
tpch_q06/duckdb:duckdb 3225832 / 3182272 / +1.4% 9879096 / 9786046 / +1.0% 0.33 / 0.33 / +0.4%
tpch_q07/duckdb:duckdb 18347206 / 18417013 / -0.4% 29607054 / 27956356 / +5.9% 0.62 / 0.66 / -5.9%
tpch_q08/duckdb:duckdb 17186908 / 17371062 / -1.1% 30298119 / 29110254 / +4.1% 0.57 / 0.60 / -4.9%
tpch_q09/duckdb:duckdb 23828075 / 23950117 / -0.5% 37516754 / 37055958 / +1.2% 0.64 / 0.65 / -1.7%
tpch_q10/duckdb:duckdb 28855408 / 29593521 / -2.5% 42508484 / 42643171 / -0.3% 0.68 / 0.69 / -2.2%
tpch_q11/duckdb:duckdb 5730667 / 5785850 / -1.0% 12020479 / 12026634 / -0.1% 0.48 / 0.48 / -0.9%
tpch_q12/duckdb:duckdb 10672829 / 10620017 / +0.5% 20379679 / 20335972 / +0.2% 0.52 / 0.52 / +0.3%
tpch_q13/duckdb:duckdb 32014363 / 32066141 / -0.2% 40233804 / 40196453 / +0.1% 0.80 / 0.80 / -0.3%
tpch_q14/duckdb:duckdb 12347427 / 12383371 / -0.3% 20620341 / 21527304 / -4.2% 0.60 / 0.58 / +4.1%
tpch_q15/duckdb:duckdb 6846442 / 6974622 / -1.8% 16516129 / 16741704 / -1.3% 0.41 / 0.42 / -0.5%
tpch_q16/duckdb:duckdb 18964490 / 18827041 / +0.7% 24818360 / 24696180 / +0.5% 0.76 / 0.76 / +0.2%
tpch_q17/duckdb:duckdb 8510267 / 8383874 / +1.5% 17476621 / 17018824 / +2.7% 0.49 / 0.49 / -1.2%
tpch_q18/duckdb:duckdb 18189871 / 18311245 / -0.7% 25435417 / 26292073 / -3.3% 0.72 / 0.70 / +2.7%
tpch_q19/duckdb:duckdb 12843015 / 12655255 / +1.5% 22117547 / 21063039 / +5.0% 0.58 / 0.60 / -3.4%
tpch_q20/duckdb:duckdb 14332949 / 14382447 / -0.3% 27090772 / 26858821 / +0.9% 0.53 / 0.54 / -1.2%
tpch_q21/duckdb:duckdb 21898061 / 21826856 / +0.3% 32829603 / 32937820 / -0.3% 0.67 / 0.66 / +0.7%
tpch_q22/duckdb:duckdb 23122746 / 23226047 / -0.4% 31952266 / 32113107 / -0.5% 0.72 / 0.72 / +0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.3%
Engines: DataFusion No clear signal (+12.0%, environment too noisy confidence) · DuckDB No clear signal (+4.7%, environment too noisy confidence)
Vortex (geomean): hot 1.060x ➖ · cold 0.976x ➖
Parquet (geomean): hot 0.979x ➖ · cold 1.040x ➖
Shifts: Parquet (control) -2.1% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.053x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 31925779 / 38455998 / -17.0% 97110203 / 152706684 / -36.4% 🟢 0.33 / 0.25 / +30.5%
fineweb_q01/datafusion:vortex-file-compressed 513437709 / 362220340 / +41.7% 🔴 449819466 / 546729952 / -17.7% 1.14 / 0.66 / +72.3%
fineweb_q02/datafusion:vortex-file-compressed 311530259 / 250410363 / +24.4% 390949104 / 379224616 / +3.1% 0.80 / 0.66 / +20.7%
fineweb_q03/datafusion:vortex-file-compressed 383065874 / 398188544 / -3.8% 484514265 / 449539205 / +7.8% 0.79 / 0.89 / -10.7%
fineweb_q04/datafusion:vortex-file-compressed 466229670 / 408328738 / +14.2% 488876356 / 451149463 / +8.4% 0.95 / 0.91 / +5.4%
fineweb_q05/datafusion:vortex-file-compressed 402195460 / 415729504 / -3.3% 409648027 / 446847016 / -8.3% 0.98 / 0.93 / +5.5%
fineweb_q06/datafusion:vortex-file-compressed 520033850 / 511352330 / +1.7% 475362971 / 656882047 / -27.6% 1.09 / 0.78 / +40.5%
fineweb_q07/datafusion:vortex-file-compressed 483491736 / 459831322 / +5.1% 472236893 / 472007622 / +0.0% 1.02 / 0.97 / +5.1%
fineweb_q08/datafusion:vortex-file-compressed 162302484 / 169434070 / -4.2% 185470893 / 254254682 / -27.1% 0.88 / 0.67 / +31.3%
datafusion / vortex-compact / ns (1.176x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 39378756 / 36250384 / +8.6% 89496642 / 165608250 / -46.0% 🟢 0.44 / 0.22 / +101.0%
fineweb_q01/datafusion:vortex-compact 646111612 / 330879308 / +95.3% 🔴 743624171 / 817370225 / -9.0% 0.87 / 0.40 / +114.6%
fineweb_q02/datafusion:vortex-compact 489786328 / 335868074 / +45.8% 🔴 738371478 / 416788276 / +77.2% 🔴 0.66 / 0.81 / -17.7%
fineweb_q03/datafusion:vortex-compact 476179626 / 517391925 / -8.0% 603041998 / 631612718 / -4.5% 0.79 / 0.82 / -3.6%
fineweb_q04/datafusion:vortex-compact 499715176 / 717457762 / -30.3% 🟢 550721835 / 682502196 / -19.3% 0.91 / 1.05 / -13.7%
fineweb_q05/datafusion:vortex-compact 798141706 / 507227730 / +57.4% 🔴 1081149163 / 632697793 / +70.9% 🔴 0.74 / 0.80 / -7.9%
fineweb_q06/datafusion:vortex-compact 739445158 / 547510678 / +35.1% 🔴 867859068 / 625892089 / +38.7% 🔴 0.85 / 0.87 / -2.6%
fineweb_q07/datafusion:vortex-compact 497370202 / 514411669 / -3.3% 518409981 / 513338205 / +1.0% 0.96 / 1.00 / -4.3%
fineweb_q08/datafusion:vortex-compact 170840860 / 161531523 / +5.8% 198273978 / 151463374 / +30.9% 🔴 0.86 / 1.07 / -19.2%
datafusion / parquet / ns (0.994x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 366733892 / 386011080 / -5.0% 749728577 / 822631037 / -8.9% 0.49 / 0.47 / +4.2%
fineweb_q01/datafusion:parquet 1483935176 / 1127835081 / +31.6% 🔴 1959939463 / 896965464 / +118.5% 🔴 0.76 / 1.26 / -39.8%
fineweb_q02/datafusion:parquet 870812242 / 728645132 / +19.5% 1011597376 / 687279258 / +47.2% 🔴 0.86 / 1.06 / -18.8%
fineweb_q03/datafusion:parquet 821196988 / 679207992 / +20.9% 2299284855 / 663810962 / +246.4% 🔴 0.36 / 1.02 / -65.1%
fineweb_q04/datafusion:parquet 705790332 / 714722921 / -1.2% 734738748 / 769059035 / -4.5% 0.96 / 0.93 / +3.4%
fineweb_q05/datafusion:parquet 796104502 / 1159502741 / -31.3% 🟢 715798417 / 1394466774 / -48.7% 🟢 1.11 / 0.83 / +33.8%
fineweb_q06/datafusion:parquet 694643033 / 717075926 / -3.1% 806953081 / 707846857 / +14.0% 0.86 / 1.01 / -15.0%
fineweb_q07/datafusion:parquet 727288287 / 883693098 / -17.7% 676578575 / 792633258 / -14.6% 1.07 / 1.11 / -3.6%
fineweb_q08/datafusion:parquet 712062256 / 733243996 / -2.9% 652244275 / 653128120 / -0.1% 1.09 / 1.12 / -2.8%
duckdb / vortex-file-compressed / ns (0.884x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 66320746 / 80714797 / -17.8% 95880364 / 134103612 / -28.5% 0.69 / 0.60 / +14.9%
fineweb_q01/duckdb:vortex-file-compressed 274468367 / 379727650 / -27.7% 310281113 / 347218059 / -10.6% 0.88 / 1.09 / -19.1%
fineweb_q02/duckdb:vortex-file-compressed 310076777 / 446474676 / -30.5% 🟢 335846978 / 501794784 / -33.1% 🟢 0.92 / 0.89 / +3.8%
fineweb_q03/duckdb:vortex-file-compressed 964934582 / 1070365900 / -9.9% 989881007 / 1339322753 / -26.1% 0.97 / 0.80 / +22.0%
fineweb_q04/duckdb:vortex-file-compressed 863435005 / 924119218 / -6.6% 912013719 / 1036564371 / -12.0% 0.95 / 0.89 / +6.2%
fineweb_q05/duckdb:vortex-file-compressed 907633492 / 884841654 / +2.6% 990905478 / 1009290339 / -1.8% 0.92 / 0.88 / +4.5%
fineweb_q06/duckdb:vortex-file-compressed 916768045 / 936799686 / -2.1% 942824238 / 988081017 / -4.6% 0.97 / 0.95 / +2.6%
fineweb_q07/duckdb:vortex-file-compressed 891879984 / 875591810 / +1.9% 1000426452 / 1021631077 / -2.1% 0.89 / 0.86 / +4.0%
fineweb_q08/duckdb:vortex-file-compressed 199820740 / 215517440 / -7.3% 219318089 / 188536635 / +16.3% 0.91 / 1.14 / -20.3%
duckdb / vortex-compact / ns (1.153x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 69755358 / 82762098 / -15.7% 76165966 / 82945852 / -8.2% 0.92 / 1.00 / -8.2%
fineweb_q01/duckdb:vortex-compact 322102326 / 321141964 / +0.3% 341681614 / 408899915 / -16.4% 0.94 / 0.79 / +20.0%
fineweb_q02/duckdb:vortex-compact 540733671 / 346628098 / +56.0% 🔴 433725914 / 407675203 / +6.4% 1.25 / 0.85 / +46.6%
fineweb_q03/duckdb:vortex-compact 943230316 / 854190415 / +10.4% 1046383886 / 1071739042 / -2.4% 0.90 / 0.80 / +13.1%
fineweb_q04/duckdb:vortex-compact 2053237664 / 899175818 / +128.3% 🔴 2236326089 / 1004449537 / +122.6% 🔴 0.92 / 0.90 / +2.6%
fineweb_q05/duckdb:vortex-compact 927004756 / 899415232 / +3.1% 1112073165 / 984806616 / +12.9% 0.83 / 0.91 / -8.7%
fineweb_q06/duckdb:vortex-compact 1209760583 / 1008290911 / +20.0% 1056945627 / 979063963 / +8.0% 1.14 / 1.03 / +11.1%
fineweb_q07/duckdb:vortex-compact 939842501 / 1095545596 / -14.2% 909048230 / 892083486 / +1.9% 1.03 / 1.23 / -15.8%
fineweb_q08/duckdb:vortex-compact 217201379 / 212422500 / +2.2% 230009486 / 232191143 / -0.9% 0.94 / 0.91 / +3.2%
duckdb / parquet / ns (0.964x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 316245546 / 313717058 / +0.8% 473465175 / 338375224 / +39.9% 🔴 0.67 / 0.93 / -28.0%
fineweb_q01/duckdb:parquet 542363942 / 512334297 / +5.9% 557122627 / 588107462 / -5.3% 0.97 / 0.87 / +11.7%
fineweb_q02/duckdb:parquet 546870886 / 585510678 / -6.6% 566338772 / 577623593 / -2.0% 0.97 / 1.01 / -4.7%
fineweb_q03/duckdb:parquet 665660978 / 792824024 / -16.0% 728038148 / 913651870 / -20.3% 0.91 / 0.87 / +5.4%
fineweb_q04/duckdb:parquet 743970420 / 801216338 / -7.1% 678194498 / 826442218 / -17.9% 1.10 / 0.97 / +13.2%
fineweb_q05/duckdb:parquet 778427366 / 808018190 / -3.7% 854596000 / 932181673 / -8.3% 0.91 / 0.87 / +5.1%
fineweb_q06/duckdb:parquet 746813874 / 831378123 / -10.2% 757958836 / 1156567126 / -34.5% 🟢 0.99 / 0.72 / +37.1%
fineweb_q07/duckdb:parquet 762104827 / 750545278 / +1.5% 859623059 / 801131638 / +7.3% 0.89 / 0.94 / -5.4%
fineweb_q08/duckdb:parquet 305529858 / 289721289 / +5.5% 357520964 / 467918846 / -23.6% 0.85 / 0.62 / +38.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+1.6%, environment too noisy confidence)
Vortex (geomean): hot 1.012x ➖ · cold 1.012x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.020x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1766528 / 1773544 / -0.4% 6363639 / 6276079 / +1.4% 0.28 / 0.28 / -1.8%
statpopgen_q01/datafusion:vortex-file-compressed 5483222 / 4356928 / +25.9% 🔴 12798641 / 12594192 / +1.6% 0.43 / 0.35 / +23.8%
statpopgen_q02/datafusion:vortex-file-compressed 40447094 / 39876947 / +1.4% 74806493 / 65194703 / +14.7% 🔴 0.54 / 0.61 / -11.6%
statpopgen_q03/datafusion:vortex-file-compressed 277291086 / 273716528 / +1.3% 304450170 / 301211666 / +1.1% 0.91 / 0.91 / +0.2%
statpopgen_q04/datafusion:vortex-file-compressed 271830451 / 267829960 / +1.5% 309028066 / 305729115 / +1.1% 0.88 / 0.88 / +0.4%
statpopgen_q05/datafusion:vortex-file-compressed 115647867 / 122902052 / -5.9% 147117190 / 141165932 / +4.2% 0.79 / 0.87 / -9.7%
statpopgen_q06/datafusion:vortex-file-compressed 524062112 / 527781820 / -0.7% 557949903 / 561302655 / -0.6% 0.94 / 0.94 / -0.1%
statpopgen_q07/datafusion:vortex-file-compressed 307676592 / 305600500 / +0.7% 338137216 / 321582287 / +5.1% 0.91 / 0.95 / -4.2%
statpopgen_q08/datafusion:vortex-file-compressed 313618236 / 312639892 / +0.3% 344911655 / 342350169 / +0.7% 0.91 / 0.91 / -0.4%
statpopgen_q09/datafusion:vortex-file-compressed 456806227 / 454706464 / +0.5% 495593030 / 502665972 / -1.4% 0.92 / 0.90 / +1.9%
statpopgen_q10/datafusion:vortex-file-compressed 1006783401 / 999175668 / +0.8% 1076578907 / 1064912813 / +1.1% 0.94 / 0.94 / -0.3%
datafusion / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1769656 / 1796460 / -1.5% 6315351 / 6239818 / +1.2% 0.28 / 0.29 / -2.7%
statpopgen_q01/datafusion:vortex-compact 4525796 / 4252952 / +6.4% 11904923 / 13670316 / -12.9% 🟢 0.38 / 0.31 / +22.2%
statpopgen_q02/datafusion:vortex-compact 46605480 / 45620834 / +2.2% 65400615 / 65090815 / +0.5% 0.71 / 0.70 / +1.7%
statpopgen_q03/datafusion:vortex-compact 340074509 / 330312712 / +3.0% 390935073 / 363262195 / +7.6% 0.87 / 0.91 / -4.3%
statpopgen_q04/datafusion:vortex-compact 341060105 / 332009984 / +2.7% 366666923 / 383179055 / -4.3% 0.93 / 0.87 / +7.4%
statpopgen_q05/datafusion:vortex-compact 137111036 / 148000058 / -7.4% 164695481 / 157663512 / +4.5% 0.83 / 0.94 / -11.3%
statpopgen_q06/datafusion:vortex-compact 658354729 / 658044684 / +0.0% 688461699 / 705402882 / -2.4% 0.96 / 0.93 / +2.5%
statpopgen_q07/datafusion:vortex-compact 354422933 / 354298596 / +0.0% 375621184 / 381378054 / -1.5% 0.94 / 0.93 / +1.6%
statpopgen_q08/datafusion:vortex-compact 367182762 / 362847804 / +1.2% 396692488 / 390611155 / +1.6% 0.93 / 0.93 / -0.4%
statpopgen_q09/datafusion:vortex-compact 495348451 / 498385178 / -0.6% 539265236 / 532328482 / +1.3% 0.92 / 0.94 / -1.9%
statpopgen_q10/datafusion:vortex-compact 1080315570 / 1074067744 / +0.6% 1162479784 / 1142756225 / +1.7% 0.93 / 0.94 / -1.1%
datafusion / parquet / ns (1.015x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1953854 / 1907424 / +2.4% 89640456 / 89414350 / +0.3% 0.02 / 0.02 / +2.2%
statpopgen_q01/datafusion:parquet 164675454 / 163008920 / +1.0% 171079021 / 173192482 / -1.2% 0.96 / 0.94 / +2.3%
statpopgen_q02/datafusion:parquet 293451772 / 298426986 / -1.7% 417953284 / 409489378 / +2.1% 0.70 / 0.73 / -3.7%
statpopgen_q03/datafusion:parquet 405619103 / 392368373 / +3.4% 518627182 / 535922865 / -3.2% 0.78 / 0.73 / +6.8%
statpopgen_q04/datafusion:parquet 398664203 / 394907518 / +1.0% 530749191 / 516317606 / +2.8% 0.75 / 0.76 / -1.8%
statpopgen_q05/datafusion:parquet 326347136 / 325777294 / +0.2% 457460186 / 463437405 / -1.3% 0.71 / 0.70 / +1.5%
statpopgen_q06/datafusion:parquet 496897198 / 483420880 / +2.8% 667996541 / 609551460 / +9.6% 0.74 / 0.79 / -6.2%
statpopgen_q07/datafusion:parquet 618288553 / 554788622 / +11.4% 🔴 686562584 / 693463106 / -1.0% 0.90 / 0.80 / +12.6%
statpopgen_q08/datafusion:parquet 556473060 / 556212684 / +0.0% 679045052 / 688226883 / -1.3% 0.82 / 0.81 / +1.4%
statpopgen_q09/datafusion:parquet 356180480 / 360002024 / -1.1% 474193855 / 489219610 / -3.1% 0.75 / 0.74 / +2.1%
statpopgen_q10/datafusion:parquet 533937579 / 544153222 / -1.9% 703365640 / 704534380 / -0.2% 0.76 / 0.77 / -1.7%
duckdb / vortex-file-compressed / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 13083610 / 13098738 / -0.1% 14920865 / 14914659 / +0.0% 0.88 / 0.88 / -0.2%
statpopgen_q01/duckdb:vortex-file-compressed 13923927 / 13974198 / -0.4% 16891867 / 16773780 / +0.7% 0.82 / 0.83 / -1.1%
statpopgen_q02/duckdb:vortex-file-compressed 157591224 / 142679972 / +10.5% 🔴 190330906 / 173454894 / +9.7% 0.83 / 0.82 / +0.7%
statpopgen_q03/duckdb:vortex-file-compressed 1173535002 / 1164981042 / +0.7% 1232311794 / 1235342693 / -0.2% 0.95 / 0.94 / +1.0%
statpopgen_q04/duckdb:vortex-file-compressed 1187978964 / 1187423564 / +0.0% 1245618713 / 1258958297 / -1.1% 0.95 / 0.94 / +1.1%
statpopgen_q05/duckdb:vortex-file-compressed 561046146 / 557398692 / +0.7% 620119280 / 616781050 / +0.5% 0.90 / 0.90 / +0.1%
statpopgen_q06/duckdb:vortex-file-compressed 1471241634 / 1469265057 / +0.1% 1512379795 / 1510491457 / +0.1% 0.97 / 0.97 / +0.0%
statpopgen_q07/duckdb:vortex-file-compressed 141899482 / 141314238 / +0.4% 168826310 / 154290333 / +9.4% 0.84 / 0.92 / -8.2%
statpopgen_q08/duckdb:vortex-file-compressed 162327815 / 159613884 / +1.7% 186921393 / 185633500 / +0.7% 0.87 / 0.86 / +1.0%
statpopgen_q09/duckdb:vortex-file-compressed 871333363 / 866691351 / +0.5% 933741897 / 918960174 / +1.6% 0.93 / 0.94 / -1.1%
statpopgen_q10/duckdb:vortex-file-compressed 2449160416 / 2417319781 / +1.3% 2445182479 / 2435710360 / +0.4% 1.00 / 0.99 / +0.9%
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 13193478 / 13104295 / +0.7% 14997989 / 14877676 / +0.8% 0.88 / 0.88 / -0.1%
statpopgen_q01/duckdb:vortex-compact 13800225 / 14054514 / -1.8% 17013699 / 16848390 / +1.0% 0.81 / 0.83 / -2.8%
statpopgen_q02/duckdb:vortex-compact 173025083 / 164139700 / +5.4% 206281269 / 196145221 / +5.2% 0.84 / 0.84 / +0.2%
statpopgen_q03/duckdb:vortex-compact 1253185476 / 1249168424 / +0.3% 1315942396 / 1303089295 / +1.0% 0.95 / 0.96 / -0.7%
statpopgen_q04/duckdb:vortex-compact 1271953234 / 1266095818 / +0.5% 1320338545 / 1339605947 / -1.4% 0.96 / 0.95 / +1.9%
statpopgen_q05/duckdb:vortex-compact 642273716 / 642549038 / -0.0% 691891547 / 696618682 / -0.7% 0.93 / 0.92 / +0.6%
statpopgen_q06/duckdb:vortex-compact 1556007637 / 1556811794 / -0.1% 1591762355 / 1591947731 / -0.0% 0.98 / 0.98 / -0.0%
statpopgen_q07/duckdb:vortex-compact 194446882 / 192671758 / +0.9% 208619269 / 208260758 / +0.2% 0.93 / 0.93 / +0.7%
statpopgen_q08/duckdb:vortex-compact 219406966 / 220019578 / -0.3% 241242220 / 236946157 / +1.8% 0.91 / 0.93 / -2.1%
statpopgen_q09/duckdb:vortex-compact 963963104 / 945330706 / +2.0% 1003192509 / 1010867384 / -0.8% 0.96 / 0.94 / +2.8%
statpopgen_q10/duckdb:vortex-compact 2501184244 / 2508508743 / -0.3% 2544047579 / 2511778145 / +1.3% 0.98 / 1.00 / -1.6%
duckdb / parquet / ns (0.994x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 246141740 / 247259632 / -0.5% 247352963 / 245010121 / +1.0% 1.00 / 1.01 / -1.4%
statpopgen_q01/duckdb:parquet 304596210 / 304940321 / -0.1% 307523693 / 306172065 / +0.4% 0.99 / 1.00 / -0.6%
statpopgen_q02/duckdb:parquet 573494658 / 586594857 / -2.2% 562347738 / 579237743 / -2.9% 1.02 / 1.01 / +0.7%
statpopgen_q03/duckdb:parquet 733966524 / 740055774 / -0.8% 796256739 / 787472395 / +1.1% 0.92 / 0.94 / -1.9%
statpopgen_q04/duckdb:parquet 726885554 / 834572205 / -12.9% 🟢 783709463 / 813039279 / -3.6% 0.93 / 1.03 / -9.6%
statpopgen_q05/duckdb:parquet 536463608 / 536631764 / -0.0% 576436957 / 573114518 / +0.6% 0.93 / 0.94 / -0.6%
statpopgen_q06/duckdb:parquet 627820148 / 633622412 / -0.9% 659191640 / 689893053 / -4.5% 0.95 / 0.92 / +3.7%
statpopgen_q07/duckdb:parquet 900637848 / 899699274 / +0.1% 898846685 / 895004182 / +0.4% 1.00 / 1.01 / -0.3%
statpopgen_q08/duckdb:parquet 911757807 / 910487224 / +0.1% 888594450 / 904196497 / -1.7% 1.03 / 1.01 / +1.9%
statpopgen_q09/duckdb:parquet 708656161 / 721755364 / -1.8% 794532688 / 795432012 / -0.1% 0.89 / 0.91 / -1.7%
statpopgen_q10/duckdb:parquet 1180458200 / 1028810676 / +14.7% 🔴 1187644446 / 1099820473 / +8.0% 0.99 / 0.94 / +6.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.973x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95249550 / 94867562 / +0.4% 154274553 / 151569603 / +1.8% 0.62 / 0.63 / -1.4%
tpch_q02/datafusion:vortex-file-compressed 64954163 / 65484722 / -0.8% 97421648 / 94577713 / +3.0% 0.67 / 0.69 / -3.7%
tpch_q03/datafusion:vortex-file-compressed 63113757 / 63574342 / -0.7% 121320656 / 112924943 / +7.4% 0.52 / 0.56 / -7.6%
tpch_q04/datafusion:vortex-file-compressed 34674918 / 33873285 / +2.4% 63477266 / 65303414 / -2.8% 0.55 / 0.52 / +5.3%
tpch_q05/datafusion:vortex-file-compressed 117680105 / 118006337 / -0.3% 176886219 / 178411424 / -0.9% 0.67 / 0.66 / +0.6%
tpch_q06/datafusion:vortex-file-compressed 9810359 / 9579737 / +2.4% 50830103 / 52040734 / -2.3% 0.19 / 0.18 / +4.8%
tpch_q07/datafusion:vortex-file-compressed 96143277 / 97079450 / -1.0% 154132759 / 160350806 / -3.9% 0.62 / 0.61 / +3.0%
tpch_q08/datafusion:vortex-file-compressed 143652385 / 144444055 / -0.5% 200316006 / 203673347 / -1.6% 0.72 / 0.71 / +1.1%
tpch_q09/datafusion:vortex-file-compressed 187049031 / 186136287 / +0.5% 270050895 / 271560352 / -0.6% 0.69 / 0.69 / +1.1%
tpch_q10/datafusion:vortex-file-compressed 71290546 / 71096329 / +0.3% 123533987 / 123759894 / -0.2% 0.58 / 0.57 / +0.5%
tpch_q11/datafusion:vortex-file-compressed 45807586 / 46176934 / -0.8% 70777618 / 72406073 / -2.2% 0.65 / 0.64 / +1.5%
tpch_q12/datafusion:vortex-file-compressed 35585592 / 36332473 / -2.1% 77972525 / 72708303 / +7.2% 0.46 / 0.50 / -8.7%
tpch_q13/datafusion:vortex-file-compressed 49070209 / 48584506 / +1.0% 77761809 / 81086918 / -4.1% 0.63 / 0.60 / +5.3%
tpch_q14/datafusion:vortex-file-compressed 20421875 / 21040461 / -2.9% 85910297 / 81595071 / +5.3% 0.24 / 0.26 / -7.8%
tpch_q15/datafusion:vortex-file-compressed 33463660 / 33348221 / +0.3% 91877917 / 88557219 / +3.7% 0.36 / 0.38 / -3.3%
tpch_q16/datafusion:vortex-file-compressed 36877302 / 36840349 / +0.1% 66550674 / 67276056 / -1.1% 0.55 / 0.55 / +1.2%
tpch_q17/datafusion:vortex-file-compressed 180435059 / 182331019 / -1.0% 237565614 / 224970510 / +5.6% 0.76 / 0.81 / -6.3%
tpch_q18/datafusion:vortex-file-compressed 204450219 / 204566214 / -0.1% 257905015 / 272168988 / -5.2% 0.79 / 0.75 / +5.5%
tpch_q19/datafusion:vortex-file-compressed 28832344 / 29640047 / -2.7% 83039099 / 82378571 / +0.8% 0.35 / 0.36 / -3.5%
tpch_q20/datafusion:vortex-file-compressed 60251016 / 60538971 / -0.5% 107718825 / 108526316 / -0.7% 0.56 / 0.56 / +0.3%
tpch_q21/datafusion:vortex-file-compressed 180950905 / 178058718 / +1.6% 227908156 / 228443760 / -0.2% 0.79 / 0.78 / +1.9%
tpch_q22/datafusion:vortex-file-compressed 25710371 / 26069444 / -1.4% 53102065 / 52564992 / +1.0% 0.48 / 0.50 / -2.4%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 98906037 / 100302866 / -1.4% 151440347 / 151911542 / -0.3% 0.65 / 0.66 / -1.1%
tpch_q02/datafusion:vortex-compact 65908030 / 65589708 / +0.5% 95942796 / 99026011 / -3.1% 0.69 / 0.66 / +3.7%
tpch_q03/datafusion:vortex-compact 68634806 / 69344075 / -1.0% 118853131 / 119320761 / -0.4% 0.58 / 0.58 / -0.6%
tpch_q04/datafusion:vortex-compact 38633835 / 38493765 / +0.4% 65312947 / 69983692 / -6.7% 0.59 / 0.55 / +7.5%
tpch_q05/datafusion:vortex-compact 120942788 / 120766640 / +0.1% 173210689 / 184269349 / -6.0% 0.70 / 0.66 / +6.5%
tpch_q06/datafusion:vortex-compact 16019599 / 15523111 / +3.2% 50745869 / 52029552 / -2.5% 0.32 / 0.30 / +5.8%
tpch_q07/datafusion:vortex-compact 103240396 / 103882791 / -0.6% 159420096 / 154566587 / +3.1% 0.65 / 0.67 / -3.6%
tpch_q08/datafusion:vortex-compact 147228401 / 146493888 / +0.5% 207240262 / 221791710 / -6.6% 0.71 / 0.66 / +7.6%
tpch_q09/datafusion:vortex-compact 188550541 / 188042311 / +0.3% 257882185 / 274066559 / -5.9% 0.73 / 0.69 / +6.6%
tpch_q10/datafusion:vortex-compact 77096233 / 77108018 / -0.0% 127302271 / 133776648 / -4.8% 0.61 / 0.58 / +5.1%
tpch_q11/datafusion:vortex-compact 45759299 / 46033416 / -0.6% 71212051 / 71791862 / -0.8% 0.64 / 0.64 / +0.2%
tpch_q12/datafusion:vortex-compact 47769107 / 49547441 / -3.6% 81604452 / 82318035 / -0.9% 0.59 / 0.60 / -2.7%
tpch_q13/datafusion:vortex-compact 57241326 / 57290248 / -0.1% 91818836 / 93310163 / -1.6% 0.62 / 0.61 / +1.5%
tpch_q14/datafusion:vortex-compact 25536365 / 24953305 / +2.3% 88332540 / 95899264 / -7.9% 0.29 / 0.26 / +11.1%
tpch_q15/datafusion:vortex-compact 48203389 / 47109003 / +2.3% 100539555 / 100747610 / -0.2% 0.48 / 0.47 / +2.5%
tpch_q16/datafusion:vortex-compact 38131672 / 38605555 / -1.2% 64277077 / 65075130 / -1.2% 0.59 / 0.59 / -0.0%
tpch_q17/datafusion:vortex-compact 185220966 / 181124595 / +2.3% 219578371 / 223486066 / -1.7% 0.84 / 0.81 / +4.1%
tpch_q18/datafusion:vortex-compact 205895939 / 207191412 / -0.6% 272587923 / 265533925 / +2.7% 0.76 / 0.78 / -3.2%
tpch_q19/datafusion:vortex-compact 33883981 / 35233272 / -3.8% 80311229 / 80283816 / +0.0% 0.42 / 0.44 / -3.9%
tpch_q20/datafusion:vortex-compact 66969515 / 67736437 / -1.1% 114824538 / 116780246 / -1.7% 0.58 / 0.58 / +0.6%
tpch_q21/datafusion:vortex-compact 187489984 / 189843599 / -1.2% 238630324 / 237478247 / +0.5% 0.79 / 0.80 / -1.7%
tpch_q22/datafusion:vortex-compact 27031156 / 27556193 / -1.9% 52333800 / 53852822 / -2.8% 0.52 / 0.51 / +0.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87195522 / 86504859 / +0.8% 124085241 / 129475756 / -4.2% 0.70 / 0.67 / +5.2%
tpch_q02/datafusion:parquet 174885450 / 173755731 / +0.7% 202311278 / 198104574 / +2.1% 0.86 / 0.88 / -1.4%
tpch_q03/datafusion:parquet 135082835 / 134516100 / +0.4% 181723884 / 179209515 / +1.4% 0.74 / 0.75 / -1.0%
tpch_q04/datafusion:parquet 57153715 / 57721586 / -1.0% 86225019 / 91820431 / -6.1% 0.66 / 0.63 / +5.4%
tpch_q05/datafusion:parquet 167736515 / 168038054 / -0.2% 222931886 / 225450231 / -1.1% 0.75 / 0.75 / +0.9%
tpch_q06/datafusion:parquet 36451780 / 36840400 / -1.1% 74538889 / 74714868 / -0.2% 0.49 / 0.49 / -0.8%
tpch_q07/datafusion:parquet 216028042 / 218998969 / -1.4% 266890295 / 274066667 / -2.6% 0.81 / 0.80 / +1.3%
tpch_q08/datafusion:parquet 217697000 / 218264194 / -0.3% 283060366 / 281696555 / +0.5% 0.77 / 0.77 / -0.7%
tpch_q09/datafusion:parquet 308897663 / 308895889 / +0.0% 371319734 / 371538210 / -0.1% 0.83 / 0.83 / +0.1%
tpch_q10/datafusion:parquet 312879705 / 312045281 / +0.3% 356034673 / 374936909 / -5.0% 0.88 / 0.83 / +5.6%
tpch_q11/datafusion:parquet 127250697 / 127462846 / -0.2% 149374672 / 150903834 / -1.0% 0.85 / 0.84 / +0.9%
tpch_q12/datafusion:parquet 82666495 / 83123465 / -0.5% 120001749 / 119039631 / +0.8% 0.69 / 0.70 / -1.3%
tpch_q13/datafusion:parquet 210697933 / 210097786 / +0.3% 238682492 / 240781319 / -0.9% 0.88 / 0.87 / +1.2%
tpch_q14/datafusion:parquet 85444210 / 85858533 / -0.5% 197104759 / 182755960 / +7.9% 0.43 / 0.47 / -7.7%
tpch_q15/datafusion:parquet 106177382 / 106813082 / -0.6% 155461888 / 153901141 / +1.0% 0.68 / 0.69 / -1.6%
tpch_q16/datafusion:parquet 97205362 / 97772589 / -0.6% 121129825 / 124157418 / -2.4% 0.80 / 0.79 / +1.9%
tpch_q17/datafusion:parquet 214957361 / 216802043 / -0.9% 260768508 / 263720666 / -1.1% 0.82 / 0.82 / +0.3%
tpch_q18/datafusion:parquet 267824049 / 268798741 / -0.4% 315217709 / 319657158 / -1.4% 0.85 / 0.84 / +1.0%
tpch_q19/datafusion:parquet 108970667 / 109135096 / -0.2% 169031558 / 163235400 / +3.6% 0.64 / 0.67 / -3.6%
tpch_q20/datafusion:parquet 185756407 / 186406495 / -0.3% 240075367 / 240719649 / -0.3% 0.77 / 0.77 / -0.1%
tpch_q21/datafusion:parquet 243496690 / 246575108 / -1.2% 308530477 / 310525912 / -0.6% 0.79 / 0.79 / -0.6%
tpch_q22/datafusion:parquet 150258841 / 150127739 / +0.1% 171923404 / 173128405 / -0.7% 0.87 / 0.87 / +0.8%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 35915847 / 35978563 / -0.2% 67541603 / 76627615 / -11.9% 🟢 0.53 / 0.47 / +13.3%
tpch_q02/duckdb:vortex-file-compressed 28604534 / 28810245 / -0.7% 43155148 / 43415232 / -0.6% 0.66 / 0.66 / -0.1%
tpch_q03/duckdb:vortex-file-compressed 53268689 / 53349976 / -0.2% 89302177 / 96922502 / -7.9% 0.60 / 0.55 / +8.4%
tpch_q04/duckdb:vortex-file-compressed 49424339 / 49456791 / -0.1% 78370393 / 81218256 / -3.5% 0.63 / 0.61 / +3.6%
tpch_q05/duckdb:vortex-file-compressed 70212980 / 69401609 / +1.2% 103908194 / 106586910 / -2.5% 0.68 / 0.65 / +3.8%
tpch_q06/duckdb:vortex-file-compressed 15064357 / 14999971 / +0.4% 47449297 / 50567119 / -6.2% 0.32 / 0.30 / +7.0%
tpch_q07/duckdb:vortex-file-compressed 54841429 / 55538381 / -1.3% 97113365 / 102732052 / -5.5% 0.56 / 0.54 / +4.5%
tpch_q08/duckdb:vortex-file-compressed 86440888 / 87978305 / -1.7% 118635496 / 128038653 / -7.3% 0.73 / 0.69 / +6.0%
tpch_q09/duckdb:vortex-file-compressed 106278442 / 107371510 / -1.0% 146466752 / 159564734 / -8.2% 0.73 / 0.67 / +7.8%
tpch_q10/duckdb:vortex-file-compressed 95613021 / 96296493 / -0.7% 130009277 / 140819725 / -7.7% 0.74 / 0.68 / +7.5%
tpch_q11/duckdb:vortex-file-compressed 13538147 / 13663215 / -0.9% 30223398 / 30710621 / -1.6% 0.45 / 0.44 / +0.7%
tpch_q12/duckdb:vortex-file-compressed 45774878 / 45873581 / -0.2% 76195424 / 79662920 / -4.4% 0.60 / 0.58 / +4.3%
tpch_q13/duckdb:vortex-file-compressed 71068377 / 70353168 / +1.0% 94407425 / 95713606 / -1.4% 0.75 / 0.74 / +2.4%
tpch_q14/duckdb:vortex-file-compressed 27852148 / 27848019 / +0.0% 68602177 / 71916157 / -4.6% 0.41 / 0.39 / +4.8%
tpch_q15/duckdb:vortex-file-compressed 23852709 / 24116934 / -1.1% 58524910 / 64685981 / -9.5% 0.41 / 0.37 / +9.3%
tpch_q16/duckdb:vortex-file-compressed 49327355 / 49026315 / +0.6% 57797705 / 58667106 / -1.5% 0.85 / 0.84 / +2.1%
tpch_q17/duckdb:vortex-file-compressed 38745166 / 38626552 / +0.3% 65119769 / 70263821 / -7.3% 0.59 / 0.55 / +8.2%
tpch_q18/duckdb:vortex-file-compressed 108254957 / 105491064 / +2.6% 117715241 / 119344487 / -1.4% 0.92 / 0.88 / +4.0%
tpch_q19/duckdb:vortex-file-compressed 26809569 / 27171157 / -1.3% 70818537 / 72276290 / -2.0% 0.38 / 0.38 / +0.7%
tpch_q20/duckdb:vortex-file-compressed 41506547 / 41428135 / +0.2% 88881293 / 90000040 / -1.2% 0.47 / 0.46 / +1.5%
tpch_q21/duckdb:vortex-file-compressed 92525511 / 92206098 / +0.3% 137152657 / 144321933 / -5.0% 0.67 / 0.64 / +5.6%
tpch_q22/duckdb:vortex-file-compressed 32943744 / 33200213 / -0.8% 48792761 / 49490006 / -1.4% 0.68 / 0.67 / +0.6%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 46553396 / 45101022 / +3.2% 74598808 / 80265934 / -7.1% 0.62 / 0.56 / +11.1%
tpch_q02/duckdb:vortex-compact 32383909 / 32227796 / +0.5% 46876114 / 48648592 / -3.6% 0.69 / 0.66 / +4.3%
tpch_q03/duckdb:vortex-compact 58740789 / 58977208 / -0.4% 92470337 / 96530373 / -4.2% 0.64 / 0.61 / +4.0%
tpch_q04/duckdb:vortex-compact 53872191 / 54178704 / -0.6% 81698270 / 84353449 / -3.1% 0.66 / 0.64 / +2.7%
tpch_q05/duckdb:vortex-compact 72801202 / 72569878 / +0.3% 104390379 / 109445036 / -4.6% 0.70 / 0.66 / +5.2%
tpch_q06/duckdb:vortex-compact 19689905 / 20291861 / -3.0% 46397529 / 53870803 / -13.9% 🟢 0.42 / 0.38 / +12.7%
tpch_q07/duckdb:vortex-compact 63856983 / 64338537 / -0.7% 102378784 / 107276102 / -4.6% 0.62 / 0.60 / +4.0%
tpch_q08/duckdb:vortex-compact 90914974 / 89415938 / +1.7% 123497043 / 127854201 / -3.4% 0.74 / 0.70 / +5.3%
tpch_q09/duckdb:vortex-compact 114242451 / 111940480 / +2.1% 151811294 / 152168574 / -0.2% 0.75 / 0.74 / +2.3%
tpch_q10/duckdb:vortex-compact 103439257 / 103648960 / -0.2% 143341276 / 140915435 / +1.7% 0.72 / 0.74 / -1.9%
tpch_q11/duckdb:vortex-compact 14503168 / 15011507 / -3.4% 30448408 / 32388020 / -6.0% 0.48 / 0.46 / +2.8%
tpch_q12/duckdb:vortex-compact 59518002 / 59737108 / -0.4% 79483538 / 84787193 / -6.3% 0.75 / 0.70 / +6.3%
tpch_q13/duckdb:vortex-compact 77279862 / 76868056 / +0.5% 99735550 / 103565101 / -3.7% 0.77 / 0.74 / +4.4%
tpch_q14/duckdb:vortex-compact 32853677 / 33065328 / -0.6% 68929250 / 71494524 / -3.6% 0.48 / 0.46 / +3.1%
tpch_q15/duckdb:vortex-compact 31107905 / 31031567 / +0.2% 63077458 / 67651196 / -6.8% 0.49 / 0.46 / +7.5%
tpch_q16/duckdb:vortex-compact 50731397 / 50466977 / +0.5% 60710434 / 61195769 / -0.8% 0.84 / 0.82 / +1.3%
tpch_q17/duckdb:vortex-compact 40134285 / 40681138 / -1.3% 67766024 / 67549315 / +0.3% 0.59 / 0.60 / -1.7%
tpch_q18/duckdb:vortex-compact 107154894 / 108634997 / -1.4% 118999545 / 121627870 / -2.2% 0.90 / 0.89 / +0.8%
tpch_q19/duckdb:vortex-compact 34051840 / 34646553 / -1.7% 69367170 / 75346280 / -7.9% 0.49 / 0.46 / +6.8%
tpch_q20/duckdb:vortex-compact 52394163 / 51665413 / +1.4% 91288296 / 96684425 / -5.6% 0.57 / 0.53 / +7.4%
tpch_q21/duckdb:vortex-compact 103282102 / 104080417 / -0.8% 143494076 / 147266447 / -2.6% 0.72 / 0.71 / +1.8%
tpch_q22/duckdb:vortex-compact 36123835 / 35157965 / +2.7% 49957723 / 51141520 / -2.3% 0.72 / 0.69 / +5.2%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67577406 / 67691563 / -0.2% 88830589 / 85355739 / +4.1% 0.76 / 0.79 / -4.1%
tpch_q02/duckdb:parquet 87294778 / 87574510 / -0.3% 98265480 / 98725270 / -0.5% 0.89 / 0.89 / +0.1%
tpch_q03/duckdb:parquet 110134715 / 111108311 / -0.9% 142292572 / 141540672 / +0.5% 0.77 / 0.78 / -1.4%
tpch_q04/duckdb:parquet 76278963 / 77078930 / -1.0% 98081397 / 95823921 / +2.4% 0.78 / 0.80 / -3.3%
tpch_q05/duckdb:parquet 128889344 / 123592442 / +4.3% 156412278 / 160913819 / -2.8% 0.82 / 0.77 / +7.3%
tpch_q06/duckdb:parquet 35539187 / 35426747 / +0.3% 57488021 / 57588571 / -0.2% 0.62 / 0.62 / +0.5%
tpch_q07/duckdb:parquet 116913802 / 117478798 / -0.5% 154883182 / 152386362 / +1.6% 0.75 / 0.77 / -2.1%
tpch_q08/duckdb:parquet 147841074 / 148578627 / -0.5% 188082317 / 190567360 / -1.3% 0.79 / 0.78 / +0.8%
tpch_q09/duckdb:parquet 237962377 / 236351364 / +0.7% 276727760 / 281392039 / -1.7% 0.86 / 0.84 / +2.4%
tpch_q10/duckdb:parquet 313855543 / 312409979 / +0.5% 336322242 / 340347688 / -1.2% 0.93 / 0.92 / +1.7%
tpch_q11/duckdb:parquet 43745373 / 43557711 / +0.4% 51383242 / 51005705 / +0.7% 0.85 / 0.85 / -0.3%
tpch_q12/duckdb:parquet 70552595 / 70990606 / -0.6% 90953323 / 89177015 / +2.0% 0.78 / 0.80 / -2.6%
tpch_q13/duckdb:parquet 292016677 / 292346723 / -0.1% 310440943 / 310278143 / +0.1% 0.94 / 0.94 / -0.2%
tpch_q14/duckdb:parquet 100872808 / 102486560 / -1.6% 137002417 / 136304284 / +0.5% 0.74 / 0.75 / -2.1%
tpch_q15/duckdb:parquet 57092996 / 58393501 / -2.2% 88661886 / 86213092 / +2.8% 0.64 / 0.68 / -4.9%
tpch_q16/duckdb:parquet 100578308 / 100668623 / -0.1% 106070324 / 107298419 / -1.1% 0.95 / 0.94 / +1.1%
tpch_q17/duckdb:parquet 81300296 / 82299992 / -1.2% 114023737 / 114545898 / -0.5% 0.71 / 0.72 / -0.8%
tpch_q18/duckdb:parquet 154837450 / 154706870 / +0.1% 177322302 / 173144258 / +2.4% 0.87 / 0.89 / -2.3%
tpch_q19/duckdb:parquet 98707653 / 99182678 / -0.5% 133535732 / 135194480 / -1.2% 0.74 / 0.73 / +0.8%
tpch_q20/duckdb:parquet 146939527 / 147455820 / -0.4% 182937611 / 187212999 / -2.3% 0.80 / 0.79 / +2.0%
tpch_q21/duckdb:parquet 253288438 / 249349105 / +1.6% 272524120 / 276777006 / -1.5% 0.93 / 0.90 / +3.2%
tpch_q22/duckdb:parquet 168360059 / 168410742 / -0.0% 180106001 / 180928295 / -0.5% 0.93 / 0.93 / +0.4%
duckdb / duckdb / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 23554832 / 23403851 / +0.6% 51337464 / 54786631 / -6.3% 0.46 / 0.43 / +7.4%
tpch_q02/duckdb:duckdb 20354344 / 20414432 / -0.3% 31480074 / 34220054 / -8.0% 0.65 / 0.60 / +8.4%
tpch_q03/duckdb:duckdb 44624138 / 45251592 / -1.4% 74734610 / 78582449 / -4.9% 0.60 / 0.58 / +3.7%
tpch_q04/duckdb:duckdb 55291347 / 55827910 / -1.0% 79280111 / 79526089 / -0.3% 0.70 / 0.70 / -0.7%
tpch_q05/duckdb:duckdb 60022977 / 60218397 / -0.3% 93597953 / 92583516 / +1.1% 0.64 / 0.65 / -1.4%
tpch_q06/duckdb:duckdb 14378346 / 14455725 / -0.5% 44844236 / 42241074 / +6.2% 0.32 / 0.34 / -6.3%
tpch_q07/duckdb:duckdb 43225637 / 43506392 / -0.6% 78630714 / 80156088 / -1.9% 0.55 / 0.54 / +1.3%
tpch_q08/duckdb:duckdb 66486134 / 66667864 / -0.3% 102874271 / 108435166 / -5.1% 0.65 / 0.61 / +5.1%
tpch_q09/duckdb:duckdb 77746779 / 77780019 / -0.0% 111980197 / 113549609 / -1.4% 0.69 / 0.68 / +1.4%
tpch_q10/duckdb:duckdb 92398838 / 91553178 / +0.9% 117647259 / 127626949 / -7.8% 0.79 / 0.72 / +9.5%
tpch_q11/duckdb:duckdb 9857315 / 9862893 / -0.1% 17195449 / 17860101 / -3.7% 0.57 / 0.55 / +3.8%
tpch_q12/duckdb:duckdb 39878834 / 39523119 / +0.9% 66975385 / 71306144 / -6.1% 0.60 / 0.55 / +7.4%
tpch_q13/duckdb:duckdb 100747564 / 99837633 / +0.9% 112304951 / 113156735 / -0.8% 0.90 / 0.88 / +1.7%
tpch_q14/duckdb:duckdb 32323816 / 32455181 / -0.4% 64233944 / 70446758 / -8.8% 0.50 / 0.46 / +9.2%
tpch_q15/duckdb:duckdb 24984824 / 25045899 / -0.2% 53291665 / 56550192 / -5.8% 0.47 / 0.44 / +5.9%
tpch_q16/duckdb:duckdb 45244888 / 44929218 / +0.7% 52132481 / 51772230 / +0.7% 0.87 / 0.87 / +0.0%
tpch_q17/duckdb:duckdb 25924524 / 26117872 / -0.7% 57116151 / 60072829 / -4.9% 0.45 / 0.43 / +4.4%
tpch_q18/duckdb:duckdb 71818846 / 71417446 / +0.6% 91800044 / 93947920 / -2.3% 0.78 / 0.76 / +2.9%
tpch_q19/duckdb:duckdb 29192200 / 29321163 / -0.4% 64364230 / 65564763 / -1.8% 0.45 / 0.45 / +1.4%
tpch_q20/duckdb:duckdb 37668615 / 37938792 / -0.7% 79477519 / 82744896 / -3.9% 0.47 / 0.46 / +3.4%
tpch_q21/duckdb:duckdb 63365534 / 63637071 / -0.4% 92202290 / 93323912 / -1.2% 0.69 / 0.68 / +0.8%
tpch_q22/duckdb:duckdb 35755994 / 35914231 / -0.4% 44789030 / 46565649 / -3.8% 0.80 / 0.77 / +3.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Nested TPC-H SF=1 on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/datafusion:vortex-file-compressed 27201317 / 27368377 / -0.6% 60066880 / 61171682 / -1.8% 0.45 / 0.45 / +1.2%
tpch-nested_q02/datafusion:vortex-file-compressed 74355772 / 75481167 / -1.5% 101817809 / 100017785 / +1.8% 0.73 / 0.75 / -3.2%
tpch-nested_q03/datafusion:vortex-file-compressed 31313447 / 31095359 / +0.7% 70839892 / 63551813 / +11.5% 🔴 0.44 / 0.49 / -9.7%
tpch-nested_q04/datafusion:vortex-file-compressed 32622950 / 33095763 / -1.4% 69123726 / 67031995 / +3.1% 0.47 / 0.49 / -4.4%
tpch-nested_q05/datafusion:vortex-file-compressed 60242028 / 60569748 / -0.5% 98146745 / 96169582 / +2.1% 0.61 / 0.63 / -2.5%
tpch-nested_q06/datafusion:vortex-file-compressed 10678742 / 10535790 / +1.4% 38663303 / 40193914 / -3.8% 0.28 / 0.26 / +5.4%
tpch-nested_q07/datafusion:vortex-file-compressed 67357040 / 67899426 / -0.8% 101975169 / 99155108 / +2.8% 0.66 / 0.68 / -3.5%
tpch-nested_q08/datafusion:vortex-file-compressed 88050779 / 87690911 / +0.4% 132574155 / 125466110 / +5.7% 0.66 / 0.70 / -5.0%
tpch-nested_q09/datafusion:vortex-file-compressed 69471570 / 71117064 / -2.3% 106646957 / 112091875 / -4.9% 0.65 / 0.63 / +2.7%
tpch-nested_q10/datafusion:vortex-file-compressed 43483522 / 43428590 / +0.1% 82646832 / 76018536 / +8.7% 0.53 / 0.57 / -7.9%
tpch-nested_q11/datafusion:vortex-file-compressed 33886114 / 34536423 / -1.9% 59677413 / 59251966 / +0.7% 0.57 / 0.58 / -2.6%
tpch-nested_q12/datafusion:vortex-file-compressed 35492899 / 36331867 / -2.3% 71110027 / 67271079 / +5.7% 0.50 / 0.54 / -7.6%
tpch-nested_q13/datafusion:vortex-file-compressed 21279137 / 21832587 / -2.5% 45602225 / 44478496 / +2.5% 0.47 / 0.49 / -4.9%
tpch-nested_q14/datafusion:vortex-file-compressed 19986502 / 20314012 / -1.6% 47369609 / 52023127 / -8.9% 0.42 / 0.39 / +8.1%
tpch-nested_q15/datafusion:vortex-file-compressed 32534451 / 32401341 / +0.4% 61910859 / 61341686 / +0.9% 0.53 / 0.53 / -0.5%
tpch-nested_q16/datafusion:vortex-file-compressed 34682300 / 34675228 / +0.0% 60180127 / 57557207 / +4.6% 0.58 / 0.60 / -4.3%
tpch-nested_q17/datafusion:vortex-file-compressed 58015557 / 57919967 / +0.2% 96759330 / 96755210 / +0.0% 0.60 / 0.60 / +0.2%
tpch-nested_q18/datafusion:vortex-file-compressed 73860860 / 73162495 / +1.0% 117712348 / 121204228 / -2.9% 0.63 / 0.60 / +3.9%
tpch-nested_q19/datafusion:vortex-file-compressed 31244194 / 30883632 / +1.2% 66634714 / 64188891 / +3.8% 0.47 / 0.48 / -2.5%
tpch-nested_q20/datafusion:vortex-file-compressed 54009735 / 54024356 / -0.0% 93751095 / 86237303 / +8.7% 0.58 / 0.63 / -8.0%
tpch-nested_q21/datafusion:vortex-file-compressed 96991914 / 96454669 / +0.6% 139931265 / 141072313 / -0.8% 0.69 / 0.68 / +1.4%
tpch-nested_q22/datafusion:vortex-file-compressed 25279056 / 24518276 / +3.1% 42999989 / 43823638 / -1.9% 0.59 / 0.56 / +5.1%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/datafusion:vortex-compact 30223001 / 30119536 / +0.3% 60886907 / 59490342 / +2.3% 0.50 / 0.51 / -2.0%
tpch-nested_q02/datafusion:vortex-compact 79578109 / 80294810 / -0.9% 103616812 / 105273901 / -1.6% 0.77 / 0.76 / +0.7%
tpch-nested_q03/datafusion:vortex-compact 37729465 / 38165315 / -1.1% 70466891 / 72344529 / -2.6% 0.54 / 0.53 / +1.5%
tpch-nested_q04/datafusion:vortex-compact 37665293 / 38772830 / -2.9% 74578601 / 74632888 / -0.1% 0.51 / 0.52 / -2.8%
tpch-nested_q05/datafusion:vortex-compact 63792290 / 63733918 / +0.1% 100127627 / 95810643 / +4.5% 0.64 / 0.67 / -4.2%
tpch-nested_q06/datafusion:vortex-compact 17529174 / 16635391 / +5.4% 50685431 / 44467308 / +14.0% 🔴 0.35 / 0.37 / -7.6%
tpch-nested_q07/datafusion:vortex-compact 73643393 / 72768372 / +1.2% 105294864 / 106515928 / -1.1% 0.70 / 0.68 / +2.4%
tpch-nested_q08/datafusion:vortex-compact 94746651 / 92853727 / +2.0% 124905395 / 134363964 / -7.0% 0.76 / 0.69 / +9.8%
tpch-nested_q09/datafusion:vortex-compact 76058520 / 76432475 / -0.5% 116596111 / 115479302 / +1.0% 0.65 / 0.66 / -1.4%
tpch-nested_q10/datafusion:vortex-compact 49220984 / 49286561 / -0.1% 82016731 / 82557689 / -0.7% 0.60 / 0.60 / +0.5%
tpch-nested_q11/datafusion:vortex-compact 36209249 / 36433961 / -0.6% 62954961 / 58899193 / +6.9% 0.58 / 0.62 / -7.0%
tpch-nested_q12/datafusion:vortex-compact 40348560 / 39783321 / +1.4% 78593266 / 79279954 / -0.9% 0.51 / 0.50 / +2.3%
tpch-nested_q13/datafusion:vortex-compact 23059672 / 22731185 / +1.4% 47458001 / 47159814 / +0.6% 0.49 / 0.48 / +0.8%
tpch-nested_q14/datafusion:vortex-compact 28268846 / 27675088 / +2.1% 61090223 / 54932791 / +11.2% 🔴 0.46 / 0.50 / -8.2%
tpch-nested_q15/datafusion:vortex-compact 44320212 / 45121865 / -1.8% 77681028 / 76918070 / +1.0% 0.57 / 0.59 / -2.7%
tpch-nested_q16/datafusion:vortex-compact 37850677 / 37995965 / -0.4% 62327670 / 60823527 / +2.5% 0.61 / 0.62 / -2.8%
tpch-nested_q17/datafusion:vortex-compact 67458302 / 66112502 / +2.0% 107543631 / 109060150 / -1.4% 0.63 / 0.61 / +3.5%
tpch-nested_q18/datafusion:vortex-compact 82853474 / 82394759 / +0.6% 131083759 / 131628441 / -0.4% 0.63 / 0.63 / +1.0%
tpch-nested_q19/datafusion:vortex-compact 35899440 / 36034723 / -0.4% 68741690 / 68469927 / +0.4% 0.52 / 0.53 / -0.8%
tpch-nested_q20/datafusion:vortex-compact 64199449 / 64825705 / -1.0% 101732361 / 102291005 / -0.5% 0.63 / 0.63 / -0.4%
tpch-nested_q21/datafusion:vortex-compact 105877299 / 105458987 / +0.4% 146818559 / 146788726 / +0.0% 0.72 / 0.72 / +0.4%
tpch-nested_q22/datafusion:vortex-compact 30852023 / 31388004 / -1.7% 49905144 / 49888491 / +0.0% 0.62 / 0.63 / -1.7%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/datafusion:parquet 247033333 / 247454330 / -0.2% 266672413 / 266159974 / +0.2% 0.93 / 0.93 / -0.4%
tpch-nested_q02/datafusion:parquet 435477307 / 436361568 / -0.2% 465638037 / 466718865 / -0.2% 0.94 / 0.93 / +0.0%
tpch-nested_q03/datafusion:parquet 378949298 / 379272733 / -0.1% 405099658 / 406911365 / -0.4% 0.94 / 0.93 / +0.4%
tpch-nested_q04/datafusion:parquet 327549667 / 327098675 / +0.1% 358854697 / 353361206 / +1.6% 0.91 / 0.93 / -1.4%
tpch-nested_q05/datafusion:parquet 287923044 / 288733177 / -0.3% 321099689 / 318235501 / +0.9% 0.90 / 0.91 / -1.2%
tpch-nested_q06/datafusion:parquet 186464424 / 186020457 / +0.2% 208240347 / 207506050 / +0.4% 0.90 / 0.90 / -0.1%
tpch-nested_q07/datafusion:parquet 304185084 / 305201621 / -0.3% 333546774 / 331932102 / +0.5% 0.91 / 0.92 / -0.8%
tpch-nested_q08/datafusion:parquet 360924586 / 361169240 / -0.1% 393134111 / 395776481 / -0.7% 0.92 / 0.91 / +0.6%
tpch-nested_q09/datafusion:parquet 505608091 / 504346505 / +0.3% 543176889 / 540090994 / +0.6% 0.93 / 0.93 / -0.3%
tpch-nested_q10/datafusion:parquet 282273413 / 282078840 / +0.1% 311666376 / 312948796 / -0.4% 0.91 / 0.90 / +0.5%
tpch-nested_q11/datafusion:parquet 356593723 / 354817185 / +0.5% 381778349 / 380334568 / +0.4% 0.93 / 0.93 / +0.1%
tpch-nested_q12/datafusion:parquet 353422046 / 353493389 / -0.0% 381654653 / 380936544 / +0.2% 0.93 / 0.93 / -0.2%
tpch-nested_q13/datafusion:parquet 210245466 / 210910917 / -0.3% 236196499 / 235496550 / +0.3% 0.89 / 0.90 / -0.6%
tpch-nested_q14/datafusion:parquet 232218017 / 232571532 / -0.2% 257490603 / 258133789 / -0.2% 0.90 / 0.90 / +0.1%
tpch-nested_q15/datafusion:parquet 393428325 / 393785666 / -0.1% 417106223 / 416268127 / +0.2% 0.94 / 0.95 / -0.3%
tpch-nested_q16/datafusion:parquet 89008493 / 90180232 / -1.3% 117728298 / 117620702 / +0.1% 0.76 / 0.77 / -1.4%
tpch-nested_q17/datafusion:parquet 517214402 / 516206981 / +0.2% 542044090 / 543332515 / -0.2% 0.95 / 0.95 / +0.4%
tpch-nested_q18/datafusion:parquet 632686130 / 632790472 / -0.0% 673141015 / 676884481 / -0.6% 0.94 / 0.93 / +0.5%
tpch-nested_q19/datafusion:parquet 264944258 / 264998270 / -0.0% 288917585 / 288644095 / +0.1% 0.92 / 0.92 / -0.1%
tpch-nested_q20/datafusion:parquet 454666290 / 453863946 / +0.2% 485497647 / 489351866 / -0.8% 0.94 / 0.93 / +1.0%
tpch-nested_q21/datafusion:parquet 644650114 / 646012683 / -0.2% 676805162 / 680845847 / -0.6% 0.95 / 0.95 / +0.4%
tpch-nested_q22/datafusion:parquet 123052349 / 123059265 / -0.0% 142072145 / 141837230 / +0.2% 0.87 / 0.87 / -0.2%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:vortex-file-compressed 24332808 / 22708152 / +7.2% 39163136 / 38846980 / +0.8% 0.62 / 0.58 / +6.3%
tpch-nested_q02/duckdb:vortex-file-compressed 25024542 / 25069646 / -0.2% 40270654 / 40411342 / -0.3% 0.62 / 0.62 / +0.2%
tpch-nested_q03/duckdb:vortex-file-compressed 35927651 / 37272762 / -3.6% 61189783 / 63486031 / -3.6% 0.59 / 0.59 / +0.0%
tpch-nested_q04/duckdb:vortex-file-compressed 28759114 / 30048425 / -4.3% 49660158 / 49286972 / +0.8% 0.58 / 0.61 / -5.0%
tpch-nested_q05/duckdb:vortex-file-compressed 35064240 / 35097977 / -0.1% 61125754 / 61550433 / -0.7% 0.57 / 0.57 / +0.6%
tpch-nested_q06/duckdb:vortex-file-compressed 14833427 / 14542939 / +2.0% 28490427 / 31130863 / -8.5% 0.52 / 0.47 / +11.5%
tpch-nested_q07/duckdb:vortex-file-compressed 35321436 / 35403199 / -0.2% 54897506 / 59512404 / -7.8% 0.64 / 0.59 / +8.2%
tpch-nested_q08/duckdb:vortex-file-compressed 37505220 / 36373501 / +3.1% 59181497 / 57131666 / +3.6% 0.63 / 0.64 / -0.5%
tpch-nested_q09/duckdb:vortex-file-compressed 43530595 / 42793908 / +1.7% 65381037 / 67432518 / -3.0% 0.67 / 0.63 / +4.9%
tpch-nested_q10/duckdb:vortex-file-compressed 45279295 / 45070901 / +0.5% 64544117 / 67650596 / -4.6% 0.70 / 0.67 / +5.3%
tpch-nested_q11/duckdb:vortex-file-compressed 14254755 / 14667524 / -2.8% 33909243 / 34475106 / -1.6% 0.42 / 0.43 / -1.2%
tpch-nested_q12/duckdb:vortex-file-compressed 35659630 / 35194866 / +1.3% 55310261 / 55546090 / -0.4% 0.64 / 0.63 / +1.8%
tpch-nested_q13/duckdb:vortex-file-compressed 22688162 / 22741136 / -0.2% 39370004 / 39193716 / +0.4% 0.58 / 0.58 / -0.7%
tpch-nested_q14/duckdb:vortex-file-compressed 21795923 / 21946744 / -0.7% 38700273 / 39586625 / -2.2% 0.56 / 0.55 / +1.6%
tpch-nested_q15/duckdb:vortex-file-compressed 15886243 / 15972136 / -0.5% 28731521 / 30189829 / -4.8% 0.55 / 0.53 / +4.5%
tpch-nested_q16/duckdb:vortex-file-compressed 19628248 / 19705206 / -0.4% 26839064 / 28296189 / -5.1% 0.73 / 0.70 / +5.0%
tpch-nested_q17/duckdb:vortex-file-compressed 39871613 / 41283020 / -3.4% 62577598 / 61988036 / +1.0% 0.64 / 0.67 / -4.3%
tpch-nested_q18/duckdb:vortex-file-compressed 55436876 / 55563288 / -0.2% 74146083 / 74100555 / +0.1% 0.75 / 0.75 / -0.3%
tpch-nested_q19/duckdb:vortex-file-compressed 30811651 / 30190042 / +2.1% 47310887 / 50594452 / -6.5% 0.65 / 0.60 / +9.1%
tpch-nested_q20/duckdb:vortex-file-compressed 30126151 / 30468704 / -1.1% 52928191 / 57628061 / -8.2% 0.57 / 0.53 / +7.7%
tpch-nested_q21/duckdb:vortex-file-compressed 79481156 / 78718830 / +1.0% 103981943 / 105008067 / -1.0% 0.76 / 0.75 / +2.0%
tpch-nested_q22/duckdb:vortex-file-compressed 20748207 / 20763882 / -0.1% 31184503 / 30896953 / +0.9% 0.67 / 0.67 / -1.0%
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:vortex-compact 27515307 / 27438739 / +0.3% 43664193 / 42416476 / +2.9% 0.63 / 0.65 / -2.6%
tpch-nested_q02/duckdb:vortex-compact 32568022 / 32343449 / +0.7% 44805281 / 44608450 / +0.4% 0.73 / 0.73 / +0.3%
tpch-nested_q03/duckdb:vortex-compact 44434031 / 44791244 / -0.8% 67494992 / 69164050 / -2.4% 0.66 / 0.65 / +1.7%
tpch-nested_q04/duckdb:vortex-compact 39189962 / 37606816 / +4.2% 56054936 / 60366174 / -7.1% 0.70 / 0.62 / +12.2%
tpch-nested_q05/duckdb:vortex-compact 43626022 / 43800174 / -0.4% 64332764 / 67340346 / -4.5% 0.68 / 0.65 / +4.3%
tpch-nested_q06/duckdb:vortex-compact 20101931 / 20670830 / -2.8% 34766267 / 36104939 / -3.7% 0.58 / 0.57 / +1.0%
tpch-nested_q07/duckdb:vortex-compact 41350759 / 42150518 / -1.9% 67631042 / 65888773 / +2.6% 0.61 / 0.64 / -4.4%
tpch-nested_q08/duckdb:vortex-compact 45372713 / 46169195 / -1.7% 69588800 / 67901760 / +2.5% 0.65 / 0.68 / -4.1%
tpch-nested_q09/duckdb:vortex-compact 52567251 / 53667937 / -2.1% 72903201 / 75286176 / -3.2% 0.72 / 0.71 / +1.2%
tpch-nested_q10/duckdb:vortex-compact 58303019 / 58299601 / +0.0% 75572003 / 78479654 / -3.7% 0.77 / 0.74 / +3.9%
tpch-nested_q11/duckdb:vortex-compact 17533219 / 17552988 / -0.1% 36369947 / 37918708 / -4.1% 0.48 / 0.46 / +4.1%
tpch-nested_q12/duckdb:vortex-compact 45324599 / 45135118 / +0.4% 64240076 / 64780508 / -0.8% 0.71 / 0.70 / +1.3%
tpch-nested_q13/duckdb:vortex-compact 25209178 / 25142922 / +0.3% 39072259 / 40167232 / -2.7% 0.65 / 0.63 / +3.1%
tpch-nested_q14/duckdb:vortex-compact 33038340 / 32912814 / +0.4% 49105187 / 50146604 / -2.1% 0.67 / 0.66 / +2.5%
tpch-nested_q15/duckdb:vortex-compact 22714303 / 21145009 / +7.4% 38783247 / 36955345 / +4.9% 0.59 / 0.57 / +2.4%
tpch-nested_q16/duckdb:vortex-compact 22049278 / 22129480 / -0.4% 29789910 / 30245041 / -1.5% 0.74 / 0.73 / +1.2%
tpch-nested_q17/duckdb:vortex-compact 55842423 / 56126778 / -0.5% 77210739 / 74939293 / +3.0% 0.72 / 0.75 / -3.4%
tpch-nested_q18/duckdb:vortex-compact 72016140 / 71333010 / +1.0% 87546482 / 88797815 / -1.4% 0.82 / 0.80 / +2.4%
tpch-nested_q19/duckdb:vortex-compact 39623116 / 40851741 / -3.0% 57433995 / 59169421 / -2.9% 0.69 / 0.69 / -0.1%
tpch-nested_q20/duckdb:vortex-compact 42621375 / 42483950 / +0.3% 65201729 / 64815127 / +0.6% 0.65 / 0.66 / -0.3%
tpch-nested_q21/duckdb:vortex-compact 100101782 / 99103823 / +1.0% 116636498 / 121904898 / -4.3% 0.86 / 0.81 / +5.6%
tpch-nested_q22/duckdb:vortex-compact 33001553 / 33149354 / -0.4% 43654416 / 43752633 / -0.2% 0.76 / 0.76 / -0.2%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:parquet 189767580 / 189535419 / +0.1% 198384086 / 200047982 / -0.8% 0.96 / 0.95 / +1.0%
tpch-nested_q02/duckdb:parquet 319717901 / 320380947 / -0.2% 328557422 / 330323964 / -0.5% 0.97 / 0.97 / +0.3%
tpch-nested_q03/duckdb:parquet 284199370 / 284337884 / -0.0% 297382775 / 299056220 / -0.6% 0.96 / 0.95 / +0.5%
tpch-nested_q04/duckdb:parquet 283581748 / 283865929 / -0.1% 298959212 / 302162353 / -1.1% 0.95 / 0.94 / +1.0%
tpch-nested_q05/duckdb:parquet 195288461 / 195460846 / -0.1% 208486813 / 212117379 / -1.7% 0.94 / 0.92 / +1.7%
tpch-nested_q06/duckdb:parquet 152319337 / 152689153 / -0.2% 162308086 / 165057705 / -1.7% 0.94 / 0.93 / +1.4%
tpch-nested_q07/duckdb:parquet 195961999 / 196111462 / -0.1% 208053803 / 209341822 / -0.6% 0.94 / 0.94 / +0.5%
tpch-nested_q08/duckdb:parquet 194741287 / 194581127 / +0.1% 206706912 / 210766458 / -1.9% 0.94 / 0.92 / +2.0%
tpch-nested_q09/duckdb:parquet 398829491 / 398774618 / +0.0% 414054031 / 419072555 / -1.2% 0.96 / 0.95 / +1.2%
tpch-nested_q10/duckdb:parquet 259496083 / 259376930 / +0.0% 276124384 / 278153751 / -0.7% 0.94 / 0.93 / +0.8%
tpch-nested_q11/duckdb:parquet 157832461 / 158270736 / -0.3% 165099497 / 164364612 / +0.4% 0.96 / 0.96 / -0.7%
tpch-nested_q12/duckdb:parquet 321130073 / 321856678 / -0.2% 336668789 / 339384832 / -0.8% 0.95 / 0.95 / +0.6%
tpch-nested_q13/duckdb:parquet 243972745 / 244244426 / -0.1% 251507566 / 254741792 / -1.3% 0.97 / 0.96 / +1.2%
tpch-nested_q14/duckdb:parquet 204715970 / 204717091 / -0.0% 218819377 / 219445980 / -0.3% 0.94 / 0.93 / +0.3%
tpch-nested_q15/duckdb:parquet 163944500 / 163749501 / +0.1% 175411791 / 178210109 / -1.6% 0.93 / 0.92 / +1.7%
tpch-nested_q16/duckdb:parquet 87579861 / 87674940 / -0.1% 95303134 / 95394272 / -0.1% 0.92 / 0.92 / -0.0%
tpch-nested_q17/duckdb:parquet 337022882 / 337383653 / -0.1% 354243970 / 356618942 / -0.7% 0.95 / 0.95 / +0.6%
tpch-nested_q18/duckdb:parquet 375043709 / 375396853 / -0.1% 388721758 / 390857170 / -0.5% 0.96 / 0.96 / +0.5%
tpch-nested_q19/duckdb:parquet 208966339 / 209339638 / -0.2% 223484264 / 224129022 / -0.3% 0.94 / 0.93 / +0.1%
tpch-nested_q20/duckdb:parquet 364089275 / 363674815 / +0.1% 378843881 / 381235564 / -0.6% 0.96 / 0.95 / +0.7%
tpch-nested_q21/duckdb:parquet 503634834 / 504338300 / -0.1% 518358649 / 520912336 / -0.5% 0.97 / 0.97 / +0.4%
tpch-nested_q22/duckdb:parquet 128797777 / 129324129 / -0.4% 137290682 / 138577154 / -0.9% 0.94 / 0.93 / +0.5%
duckdb / duckdb / ns (1.013x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:duckdb 22442987 / 22070047 / +1.7% 29997622 / 30815990 / -2.7% 0.75 / 0.72 / +4.5%
tpch-nested_q02/duckdb:duckdb 32269282 / 32200376 / +0.2% 42467664 / 44050786 / -3.6% 0.76 / 0.73 / +3.9%
tpch-nested_q03/duckdb:duckdb 33475879 / 33184417 / +0.9% 46531637 / 49232850 / -5.5% 0.72 / 0.67 / +6.7%
tpch-nested_q04/duckdb:duckdb 30932219 / 30698740 / +0.8% 44568244 / 47195909 / -5.6% 0.69 / 0.65 / +6.7%
tpch-nested_q05/duckdb:duckdb 27388960 / 27073917 / +1.2% 40000659 / 40948786 / -2.3% 0.68 / 0.66 / +3.6%
tpch-nested_q06/duckdb:duckdb 15591273 / 15433845 / +1.0% 24135619 / 25304181 / -4.6% 0.65 / 0.61 / +5.9%
tpch-nested_q07/duckdb:duckdb 31390235 / 31232948 / +0.5% 42919148 / 44766003 / -4.1% 0.73 / 0.70 / +4.8%
tpch-nested_q08/duckdb:duckdb 30156792 / 30211831 / -0.2% 43080053 / 45024230 / -4.3% 0.70 / 0.67 / +4.3%
tpch-nested_q09/duckdb:duckdb 52573192 / 52561408 / +0.0% 67477457 / 70287058 / -4.0% 0.78 / 0.75 / +4.2%
tpch-nested_q10/duckdb:duckdb 66390885 / 63711731 / +4.2% 77450307 / 78033059 / -0.7% 0.86 / 0.82 / +5.0%
tpch-nested_q11/duckdb:duckdb 14300581 / 14306362 / -0.0% 21342596 / 21668209 / -1.5% 0.67 / 0.66 / +1.5%
tpch-nested_q12/duckdb:duckdb 37811047 / 37654566 / +0.4% 49786811 / 53411109 / -6.8% 0.76 / 0.70 / +7.7%
tpch-nested_q13/duckdb:duckdb 38799722 / 39277670 / -1.2% 45742368 / 48803143 / -6.3% 0.85 / 0.80 / +5.4%
tpch-nested_q14/duckdb:duckdb 34716709 / 34429615 / +0.8% 46434382 / 47077876 / -1.4% 0.75 / 0.73 / +2.2%
tpch-nested_q15/duckdb:duckdb 19292764 / 19067949 / +1.2% 30267351 / 31459606 / -3.8% 0.64 / 0.61 / +5.2%
tpch-nested_q16/duckdb:duckdb 30142922 / 29959221 / +0.6% 38005340 / 38600397 / -1.5% 0.79 / 0.78 / +2.2%
tpch-nested_q17/duckdb:duckdb 37862366 / 37612651 / +0.7% 51378570 / 51578542 / -0.4% 0.74 / 0.73 / +1.1%
tpch-nested_q18/duckdb:duckdb 36540628 / 36158445 / +1.1% 46933042 / 50282222 / -6.7% 0.78 / 0.72 / +8.3%
tpch-nested_q19/duckdb:duckdb 37043116 / 36862602 / +0.5% 48612851 / 49015565 / -0.8% 0.76 / 0.75 / +1.3%
tpch-nested_q20/duckdb:duckdb 43930171 / 43988654 / -0.1% 61223869 / 64485099 / -5.1% 0.72 / 0.68 / +5.2%
tpch-nested_q21/duckdb:duckdb 65203010 / 64920830 / +0.4% 78223235 / 80739851 / -3.1% 0.83 / 0.80 / +3.7%
tpch-nested_q22/duckdb:duckdb 51619809 / 44552695 / +15.9% 🔴 61242340 / 55910012 / +9.5% 0.84 / 0.80 / +5.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.007x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed 51517857 / 51044022 / +0.9% 78789360 / 77742431 / +1.3% 0.65 / 0.66 / -0.4%
appian_q02/datafusion:vortex-file-compressed 228851803 / 227755103 / +0.5% 266836085 / 271987686 / -1.9% 0.86 / 0.84 / +2.4%
appian_q03/datafusion:vortex-file-compressed 129563193 / 128301304 / +1.0% 170837201 / 171601723 / -0.4% 0.76 / 0.75 / +1.4%
appian_q04/datafusion:vortex-file-compressed 9636980652 / 9637449272 / -0.0% 9755942797 / 9671675688 / +0.9% 0.99 / 1.00 / -0.9%
appian_q05/datafusion:vortex-file-compressed 133582169 / 134427571 / -0.6% 168486941 / 166510359 / +1.2% 0.79 / 0.81 / -1.8%
appian_q06/datafusion:vortex-file-compressed 147750618 / 144693433 / +2.1% 176218088 / 178945681 / -1.5% 0.84 / 0.81 / +3.7%
appian_q07/datafusion:vortex-file-compressed 154591430 / 154830046 / -0.2% 194779215 / 191864313 / +1.5% 0.79 / 0.81 / -1.6%
appian_q08/datafusion:vortex-file-compressed 524454127 / 525702923 / -0.2% 598773548 / 596577018 / +0.4% 0.88 / 0.88 / -0.6%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 71950356 / 71419099 / +0.7% 96454928 / 92514510 / +4.3% 0.75 / 0.77 / -3.4%
appian_q02/datafusion:parquet 291420754 / 287659861 / +1.3% 329934935 / 331663840 / -0.5% 0.88 / 0.87 / +1.8%
appian_q03/datafusion:parquet 185052185 / 184280500 / +0.4% 231106634 / 227718351 / +1.5% 0.80 / 0.81 / -1.1%
appian_q04/datafusion:parquet 9640906349 / 9675732629 / -0.4% 9804149495 / 9737996549 / +0.7% 0.98 / 0.99 / -1.0%
appian_q05/datafusion:parquet 192938061 / 193533655 / -0.3% 225488406 / 221324106 / +1.9% 0.86 / 0.87 / -2.1%
appian_q06/datafusion:parquet 166065400 / 165965064 / +0.1% 192411390 / 189741194 / +1.4% 0.86 / 0.87 / -1.3%
appian_q07/datafusion:parquet 204398153 / 203573361 / +0.4% 239666528 / 233483824 / +2.6% 0.85 / 0.87 / -2.2%
appian_q08/datafusion:parquet 628740112 / 627837916 / +0.1% 688538793 / 683861905 / +0.7% 0.91 / 0.92 / -0.5%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed 83663649 / 84434403 / -0.9% 98407505 / 96966735 / +1.5% 0.85 / 0.87 / -2.4%
appian_q02/duckdb:vortex-file-compressed 235411873 / 238301675 / -1.2% 256616592 / 255994385 / +0.2% 0.92 / 0.93 / -1.5%
appian_q03/duckdb:vortex-file-compressed 116371591 / 115711999 / +0.6% 134326345 / 130062690 / +3.3% 0.87 / 0.89 / -2.6%
appian_q04/duckdb:vortex-file-compressed 614569458 / 614202462 / +0.1% 658743330 / 662050201 / -0.5% 0.93 / 0.93 / +0.6%
appian_q05/duckdb:vortex-file-compressed 117303183 / 118571821 / -1.1% 133140942 / 134500270 / -1.0% 0.88 / 0.88 / -0.1%
appian_q06/duckdb:vortex-file-compressed 199645959 / 197887680 / +0.9% 202114448 / 205373564 / -1.6% 0.99 / 0.96 / +2.5%
appian_q07/duckdb:vortex-file-compressed 117745555 / 118035808 / -0.2% 132997432 / 136483135 / -2.6% 0.89 / 0.86 / +2.4%
appian_q08/duckdb:vortex-file-compressed 341248738 / 340593100 / +0.2% 351112294 / 356395863 / -1.5% 0.97 / 0.96 / +1.7%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 91335428 / 94666437 / -3.5% 101215157 / 99713657 / +1.5% 0.90 / 0.95 / -4.9%
appian_q02/duckdb:parquet 234748847 / 241299960 / -2.7% 260520880 / 253449954 / +2.8% 0.90 / 0.95 / -5.4%
appian_q03/duckdb:parquet 129513927 / 130527058 / -0.8% 137562548 / 135216516 / +1.7% 0.94 / 0.97 / -2.5%
appian_q04/duckdb:parquet 486682304 / 489082275 / -0.5% 489367611 / 491593396 / -0.5% 0.99 / 0.99 / -0.0%
appian_q05/duckdb:parquet 129732739 / 130745283 / -0.8% 141832758 / 138244562 / +2.6% 0.91 / 0.95 / -3.3%
appian_q06/duckdb:parquet 113306962 / 114878075 / -1.4% 117638468 / 121526389 / -3.2% 0.96 / 0.95 / +1.9%
appian_q07/duckdb:parquet 107282135 / 108886084 / -1.5% 121746915 / 123339456 / -1.3% 0.88 / 0.88 / -0.2%
appian_q08/duckdb:parquet 354799310 / 349838658 / +1.4% 345340288 / 360777779 / -4.3% 1.03 / 0.97 / +6.0%
duckdb / duckdb / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb 78814585 / 78653458 / +0.2% 90181479 / 91454894 / -1.4% 0.87 / 0.86 / +1.6%
appian_q02/duckdb:duckdb 214856555 / 213641165 / +0.6% 231508510 / 210871966 / +9.8% 0.93 / 1.01 / -8.4%
appian_q03/duckdb:duckdb 83848090 / 84527090 / -0.8% 91004771 / 91873313 / -0.9% 0.92 / 0.92 / +0.1%
appian_q04/duckdb:duckdb 540363751 / 545299638 / -0.9% 555128241 / 559151627 / -0.7% 0.97 / 0.98 / -0.2%
appian_q05/duckdb:duckdb 106621758 / 106903985 / -0.3% 118865335 / 120645821 / -1.5% 0.90 / 0.89 / +1.2%
appian_q06/duckdb:duckdb 186607756 / 187051481 / -0.2% 207395823 / 198984064 / +4.2% 0.90 / 0.94 / -4.3%
appian_q07/duckdb:duckdb 87667040 / 88020133 / -0.4% 101277750 / 101557458 / -0.3% 0.87 / 0.87 / -0.1%
appian_q08/duckdb:duckdb 320214298 / 312652221 / +2.4% 311214539 / 324407216 / -4.1% 1.03 / 0.96 / +6.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1232670 / 1233530 / -0.1% 22412860 / 23154525 / -3.2% 0.05 / 0.05 / +3.2%
clickbench_q01/datafusion:vortex-file-compressed 8837956 / 8981246 / -1.6% 32154215 / 34800055 / -7.6% 0.27 / 0.26 / +6.5%
clickbench_q02/datafusion:vortex-file-compressed 13150564 / 13255645 / -0.8% 49495315 / 52458534 / -5.6% 0.27 / 0.25 / +5.1%
clickbench_q03/datafusion:vortex-file-compressed 14482880 / 14199606 / +2.0% 50223498 / 50096325 / +0.3% 0.29 / 0.28 / +1.7%
clickbench_q04/datafusion:vortex-file-compressed 60367860 / 60532771 / -0.3% 103585348 / 107346050 / -3.5% 0.58 / 0.56 / +3.3%
clickbench_q05/datafusion:vortex-file-compressed 80610582 / 82631474 / -2.4% 128468136 / 128465413 / +0.0% 0.63 / 0.64 / -2.4%
clickbench_q06/datafusion:vortex-file-compressed 1233553 / 1236886 / -0.3% 23760730 / 24858688 / -4.4% 0.05 / 0.05 / +4.3%
clickbench_q07/datafusion:vortex-file-compressed 12446470 / 12383729 / +0.5% 36124911 / 36832471 / -1.9% 0.34 / 0.34 / +2.5%
clickbench_q08/datafusion:vortex-file-compressed 82501132 / 82127814 / +0.5% 127305243 / 129344238 / -1.6% 0.65 / 0.63 / +2.1%
clickbench_q09/datafusion:vortex-file-compressed 175892050 / 177757442 / -1.0% 211256498 / 211625569 / -0.2% 0.83 / 0.84 / -0.9%
clickbench_q10/datafusion:vortex-file-compressed 24916136 / 25251665 / -1.3% 65663474 / 66187856 / -0.8% 0.38 / 0.38 / -0.5%
clickbench_q11/datafusion:vortex-file-compressed 26287564 / 27393119 / -4.0% 65532808 / 66483533 / -1.4% 0.40 / 0.41 / -2.6%
clickbench_q12/datafusion:vortex-file-compressed 74977154 / 75654048 / -0.9% 122190803 / 128906187 / -5.2% 0.61 / 0.59 / +4.6%
clickbench_q13/datafusion:vortex-file-compressed 118764186 / 119110992 / -0.3% 188898855 / 183089480 / +3.2% 0.63 / 0.65 / -3.4%
clickbench_q14/datafusion:vortex-file-compressed 78936418 / 78950892 / -0.0% 126885373 / 128943627 / -1.6% 0.62 / 0.61 / +1.6%
clickbench_q15/datafusion:vortex-file-compressed 66076633 / 68206406 / -3.1% 106610026 / 104858608 / +1.7% 0.62 / 0.65 / -4.7%
clickbench_q16/datafusion:vortex-file-compressed 162757563 / 158820820 / +2.5% 214364439 / 223769639 / -4.2% 0.76 / 0.71 / +7.0%
clickbench_q17/datafusion:vortex-file-compressed 157095686 / 159120782 / -1.3% 223307367 / 228771712 / -2.4% 0.70 / 0.70 / +1.1%
clickbench_q18/datafusion:vortex-file-compressed 301972168 / 301337348 / +0.2% 384227169 / 392135551 / -2.0% 0.79 / 0.77 / +2.3%
clickbench_q19/datafusion:vortex-file-compressed 10170818 / 9833854 / +3.4% 45019568 / 45036706 / -0.0% 0.23 / 0.22 / +3.5%
clickbench_q20/datafusion:vortex-file-compressed 46931314 / 47961235 / -2.1% 231358644 / 238558990 / -3.0% 0.20 / 0.20 / +0.9%
clickbench_q21/datafusion:vortex-file-compressed 58207012 / 58398514 / -0.3% 273706975 / 278136796 / -1.6% 0.21 / 0.21 / +1.3%
clickbench_q22/datafusion:vortex-file-compressed 75540220 / 79056973 / -4.4% 379456818 / 379121353 / +0.1% 0.20 / 0.21 / -4.5%
clickbench_q23/datafusion:vortex-file-compressed 90962291 / 76537384 / +18.8% 🔴 362806374 / 361018222 / +0.5% 0.25 / 0.21 / +18.3%
clickbench_q24/datafusion:vortex-file-compressed 9061465 / 9054770 / +0.1% 57013283 / 56397368 / +1.1% 0.16 / 0.16 / -1.0%
clickbench_q25/datafusion:vortex-file-compressed 20676988 / 19920522 / +3.8% 65034623 / 63358256 / +2.6% 0.32 / 0.31 / +1.1%
clickbench_q26/datafusion:vortex-file-compressed 14905994 / 14457100 / +3.1% 59026807 / 68862550 / -14.3% 🟢 0.25 / 0.21 / +20.3%
clickbench_q27/datafusion:vortex-file-compressed 105477670 / 102662951 / +2.7% 252044900 / 255032726 / -1.2% 0.42 / 0.40 / +4.0%
clickbench_q28/datafusion:vortex-file-compressed 560831347 / 565808580 / -0.9% 631265174 / 640500114 / -1.4% 0.89 / 0.88 / +0.6%
clickbench_q29/datafusion:vortex-file-compressed 26542294 / 26318438 / +0.9% 61189828 / 54456575 / +12.4% 🔴 0.43 / 0.48 / -10.2%
clickbench_q30/datafusion:vortex-file-compressed 61744096 / 60309770 / +2.4% 111001423 / 111769466 / -0.7% 0.56 / 0.54 / +3.1%
clickbench_q31/datafusion:vortex-file-compressed 67350251 / 70643655 / -4.7% 153853621 / 156214385 / -1.5% 0.44 / 0.45 / -3.2%
clickbench_q32/datafusion:vortex-file-compressed 291675169 / 297211380 / -1.9% 392984130 / 390520648 / +0.6% 0.74 / 0.76 / -2.5%
clickbench_q33/datafusion:vortex-file-compressed 326652110 / 327087737 / -0.1% 435767272 / 438660234 / -0.7% 0.75 / 0.75 / +0.5%
clickbench_q34/datafusion:vortex-file-compressed 332046206 / 324973784 / +2.2% 444062784 / 432086385 / +2.8% 0.75 / 0.75 / -0.6%
clickbench_q35/datafusion:vortex-file-compressed 61462454 / 60692548 / +1.3% 97220919 / 98366374 / -1.2% 0.63 / 0.62 / +2.5%
clickbench_q36/datafusion:vortex-file-compressed 37451404 / 37106494 / +0.9% 66374885 / 68114343 / -2.6% 0.56 / 0.54 / +3.6%
clickbench_q37/datafusion:vortex-file-compressed 20970582 / 20825900 / +0.7% 47122896 / 46494526 / +1.4% 0.45 / 0.45 / -0.6%
clickbench_q38/datafusion:vortex-file-compressed 13184293 / 13127681 / +0.4% 39963443 / 39912906 / +0.1% 0.33 / 0.33 / +0.3%
clickbench_q39/datafusion:vortex-file-compressed 78976454 / 78644246 / +0.4% 110218955 / 112967787 / -2.4% 0.72 / 0.70 / +2.9%
clickbench_q40/datafusion:vortex-file-compressed 10319624 / 9964508 / +3.6% 35709514 / 36203755 / -1.4% 0.29 / 0.28 / +5.0%
clickbench_q41/datafusion:vortex-file-compressed 9592417 / 9753473 / -1.7% 33979425 / 35778994 / -5.0% 0.28 / 0.27 / +3.6%
clickbench_q42/datafusion:vortex-file-compressed 9994970 / 10044980 / -0.5% 36725846 / 36195009 / +1.5% 0.27 / 0.28 / -1.9%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1251786 / 1233828 / +1.5% 49321133 / 49353520 / -0.1% 0.03 / 0.02 / +1.5%
clickbench_q01/datafusion:parquet 16580412 / 15919990 / +4.1% 72041689 / 66414601 / +8.5% 0.23 / 0.24 / -4.0%
clickbench_q02/datafusion:parquet 19133152 / 18428088 / +3.8% 80716580 / 80661939 / +0.1% 0.24 / 0.23 / +3.8%
clickbench_q03/datafusion:parquet 17434969 / 17426782 / +0.0% 76857967 / 79540204 / -3.4% 0.23 / 0.22 / +3.5%
clickbench_q04/datafusion:parquet 63142635 / 64738730 / -2.5% 125058975 / 131464368 / -4.9% 0.50 / 0.49 / +2.5%
clickbench_q05/datafusion:parquet 88067080 / 88535198 / -0.5% 153650979 / 155762477 / -1.4% 0.57 / 0.57 / +0.8%
clickbench_q06/datafusion:parquet 1257276 / 1245741 / +0.9% 49307947 / 49801832 / -1.0% 0.03 / 0.03 / +1.9%
clickbench_q07/datafusion:parquet 16851046 / 16786384 / +0.4% 67176244 / 68193814 / -1.5% 0.25 / 0.25 / +1.9%
clickbench_q08/datafusion:parquet 84209202 / 88122188 / -4.4% 161764830 / 156305746 / +3.5% 0.52 / 0.56 / -7.7%
clickbench_q09/datafusion:parquet 189700977 / 184000010 / +3.1% 265100050 / 257618736 / +2.9% 0.72 / 0.71 / +0.2%
clickbench_q10/datafusion:parquet 36166216 / 36553032 / -1.1% 101513584 / 102341190 / -0.8% 0.36 / 0.36 / -0.3%
clickbench_q11/datafusion:parquet 43263971 / 41877446 / +3.3% 110829711 / 107230630 / +3.4% 0.39 / 0.39 / -0.0%
clickbench_q12/datafusion:parquet 95147846 / 95301070 / -0.2% 163069932 / 160684492 / +1.5% 0.58 / 0.59 / -1.6%
clickbench_q13/datafusion:parquet 148801050 / 147606602 / +0.8% 226672916 / 227777405 / -0.5% 0.66 / 0.65 / +1.3%
clickbench_q14/datafusion:parquet 103346196 / 100719496 / +2.6% 171856984 / 169763947 / +1.2% 0.60 / 0.59 / +1.4%
clickbench_q15/datafusion:parquet 69746092 / 73809394 / -5.5% 134049980 / 131669308 / +1.8% 0.52 / 0.56 / -7.2%
clickbench_q16/datafusion:parquet 156201676 / 156545470 / -0.2% 237569645 / 236277721 / +0.5% 0.66 / 0.66 / -0.8%
clickbench_q17/datafusion:parquet 157355482 / 157211782 / +0.1% 236313322 / 236399920 / -0.0% 0.67 / 0.67 / +0.1%
clickbench_q18/datafusion:parquet 312652584 / 312138754 / +0.2% 422305314 / 426683990 / -1.0% 0.74 / 0.73 / +1.2%
clickbench_q19/datafusion:parquet 18871190 / 19156759 / -1.5% 77876271 / 77160733 / +0.9% 0.24 / 0.25 / -2.4%
clickbench_q20/datafusion:parquet 178720144 / 179435800 / -0.4% 275841657 / 275178318 / +0.2% 0.65 / 0.65 / -0.6%
clickbench_q21/datafusion:parquet 174265122 / 175007071 / -0.4% 292668664 / 291609955 / +0.4% 0.60 / 0.60 / -0.8%
clickbench_q22/datafusion:parquet 262560639 / 263006584 / -0.2% 415917433 / 413810046 / +0.5% 0.63 / 0.64 / -0.7%
clickbench_q23/datafusion:parquet 1011972309 / 1005608476 / +0.6% 1191720948 / 1191066481 / +0.1% 0.85 / 0.84 / +0.6%
clickbench_q24/datafusion:parquet 30055571 / 29776465 / +0.9% 87023046 / 89012500 / -2.2% 0.35 / 0.33 / +3.2%
clickbench_q25/datafusion:parquet 38752610 / 36661936 / +5.7% 100331779 / 100260301 / +0.1% 0.39 / 0.37 / +5.6%
clickbench_q26/datafusion:parquet 30600574 / 30955552 / -1.1% 88316719 / 89351602 / -1.2% 0.35 / 0.35 / +0.0%
clickbench_q27/datafusion:parquet 192602844 / 192361072 / +0.1% 286310444 / 285313673 / +0.3% 0.67 / 0.67 / -0.2%
clickbench_q28/datafusion:parquet 617643588 / 624499114 / -1.1% 701215682 / 706198966 / -0.7% 0.88 / 0.88 / -0.4%
clickbench_q29/datafusion:parquet 28953032 / 29077978 / -0.4% 91307905 / 91479512 / -0.2% 0.32 / 0.32 / -0.2%
clickbench_q30/datafusion:parquet 90448498 / 89934666 / +0.6% 168835729 / 167164809 / +1.0% 0.54 / 0.54 / -0.4%
clickbench_q31/datafusion:parquet 102747836 / 102348395 / +0.4% 192485645 / 192324661 / +0.1% 0.53 / 0.53 / +0.3%
clickbench_q32/datafusion:parquet 306860976 / 306216334 / +0.2% 426483759 / 421140104 / +1.3% 0.72 / 0.73 / -1.0%
clickbench_q33/datafusion:parquet 377174852 / 378540218 / -0.4% 472943504 / 476413534 / -0.7% 0.80 / 0.79 / +0.4%
clickbench_q34/datafusion:parquet 376395466 / 378485001 / -0.6% 475614706 / 474166354 / +0.3% 0.79 / 0.80 / -0.9%
clickbench_q35/datafusion:parquet 64847013 / 63554991 / +2.0% 124372640 / 124654844 / -0.2% 0.52 / 0.51 / +2.3%
clickbench_q36/datafusion:parquet 73445111 / 74166688 / -1.0% 134861818 / 134420931 / +0.3% 0.54 / 0.55 / -1.3%
clickbench_q37/datafusion:parquet 35857732 / 35592254 / +0.7% 92805285 / 93390453 / -0.6% 0.39 / 0.38 / +1.4%
clickbench_q38/datafusion:parquet 48027764 / 47733958 / +0.6% 107351782 / 106693237 / +0.6% 0.45 / 0.45 / -0.0%
clickbench_q39/datafusion:parquet 142965452 / 143914100 / -0.7% 209522875 / 209726137 / -0.1% 0.68 / 0.69 / -0.6%
clickbench_q40/datafusion:parquet 20010152 / 19818434 / +1.0% 77270793 / 77263943 / +0.0% 0.26 / 0.26 / +1.0%
clickbench_q41/datafusion:parquet 18705136 / 18849430 / -0.8% 77051924 / 76597549 / +0.6% 0.24 / 0.25 / -1.4%
clickbench_q42/datafusion:parquet 19266584 / 19340757 / -0.4% 76522057 / 74974441 / +2.1% 0.25 / 0.26 / -2.4%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2217262 / 2158922 / +2.7% 25756028 / 25511090 / +1.0% 0.09 / 0.08 / +1.7%
clickbench_q01/duckdb:vortex-file-compressed 7461643 / 7152192 / +4.3% 31043420 / 28153425 / +10.3% 🔴 0.24 / 0.25 / -5.4%
clickbench_q02/duckdb:vortex-file-compressed 9505330 / 9327806 / +1.9% 34724930 / 33690398 / +3.1% 0.27 / 0.28 / -1.1%
clickbench_q03/duckdb:vortex-file-compressed 14090528 / 14054486 / +0.3% 43421552 / 43625516 / -0.5% 0.32 / 0.32 / +0.7%
clickbench_q04/duckdb:vortex-file-compressed 56207104 / 55836744 / +0.7% 89107320 / 86577530 / +2.9% 0.63 / 0.64 / -2.2%
clickbench_q05/duckdb:vortex-file-compressed 64293090 / 63958818 / +0.5% 92591033 / 93255703 / -0.7% 0.69 / 0.69 / +1.2%
clickbench_q06/duckdb:vortex-file-compressed 2597480 / 2622572 / -1.0% 32725031 / 30754151 / +6.4% 0.08 / 0.09 / -6.9%
clickbench_q07/duckdb:vortex-file-compressed 8758909 / 9064985 / -3.4% 29974066 / 30008804 / -0.1% 0.29 / 0.30 / -3.3%
clickbench_q08/duckdb:vortex-file-compressed 71042964 / 68780979 / +3.3% 99671869 / 100181474 / -0.5% 0.71 / 0.69 / +3.8%
clickbench_q09/duckdb:vortex-file-compressed 90956947 / 96597011 / -5.8% 117615531 / 126869756 / -7.3% 0.77 / 0.76 / +1.6%
clickbench_q10/duckdb:vortex-file-compressed 27932812 / 27607357 / +1.2% 60816069 / 61931335 / -1.8% 0.46 / 0.45 / +3.0%
clickbench_q11/duckdb:vortex-file-compressed 31032059 / 30707059 / +1.1% 65426996 / 65498664 / -0.1% 0.47 / 0.47 / +1.2%
clickbench_q12/duckdb:vortex-file-compressed 68418244 / 69664995 / -1.8% 98126903 / 97337435 / +0.8% 0.70 / 0.72 / -2.6%
clickbench_q13/duckdb:vortex-file-compressed 119735100 / 117315394 / +2.1% 158046657 / 158335876 / -0.2% 0.76 / 0.74 / +2.2%
clickbench_q14/duckdb:vortex-file-compressed 73088482 / 74101750 / -1.4% 105914890 / 100792186 / +5.1% 0.69 / 0.74 / -6.1%
clickbench_q15/duckdb:vortex-file-compressed 75869700 / 75879168 / -0.0% 105727706 / 105119425 / +0.6% 0.72 / 0.72 / -0.6%
clickbench_q16/duckdb:vortex-file-compressed 136225037 / 135274764 / +0.7% 167674756 / 167832065 / -0.1% 0.81 / 0.81 / +0.8%
clickbench_q17/duckdb:vortex-file-compressed 138076008 / 139806817 / -1.2% 169014943 / 163836903 / +3.2% 0.82 / 0.85 / -4.3%
clickbench_q18/duckdb:vortex-file-compressed 261763682 / 260996244 / +0.3% 306743293 / 302510041 / +1.4% 0.85 / 0.86 / -1.1%
clickbench_q19/duckdb:vortex-file-compressed 9215716 / 8865175 / +4.0% 33124077 / 31337492 / +5.7% 0.28 / 0.28 / -1.7%
clickbench_q20/duckdb:vortex-file-compressed 51791230 / 50531741 / +2.5% 153758985 / 153080056 / +0.4% 0.34 / 0.33 / +2.0%
clickbench_q21/duckdb:vortex-file-compressed 57158958 / 57401462 / -0.4% 175442704 / 176716019 / -0.7% 0.33 / 0.32 / +0.3%
clickbench_q22/duckdb:vortex-file-compressed 88569016 / 88035935 / +0.6% 293118330 / 291515952 / +0.5% 0.30 / 0.30 / +0.1%
clickbench_q23/duckdb:vortex-file-compressed 61113614 / 64116929 / -4.7% 175099393 / 159236637 / +10.0% 0.35 / 0.40 / -13.3%
clickbench_q24/duckdb:vortex-file-compressed 17396663 / 17383428 / +0.1% 40211326 / 50740856 / -20.8% 🟢 0.43 / 0.34 / +26.3%
clickbench_q25/duckdb:vortex-file-compressed 19441278 / 18748304 / +3.7% 51452782 / 49252374 / +4.5% 0.38 / 0.38 / -0.7%
clickbench_q26/duckdb:vortex-file-compressed 14823420 / 14079026 / +5.3% 45757451 / 49909712 / -8.3% 0.32 / 0.28 / +14.8%
clickbench_q27/duckdb:vortex-file-compressed 52280466 / 52541479 / -0.5% 173490140 / 173743083 / -0.1% 0.30 / 0.30 / -0.4%
clickbench_q28/duckdb:vortex-file-compressed 512052886 / 510248128 / +0.4% 550273202 / 551767901 / -0.3% 0.93 / 0.92 / +0.6%
clickbench_q29/duckdb:vortex-file-compressed 17377270 / 17267000 / +0.6% 46506508 / 43556250 / +6.8% 0.37 / 0.40 / -5.7%
clickbench_q30/duckdb:vortex-file-compressed 60405506 / 59407334 / +1.7% 102000651 / 100289781 / +1.7% 0.59 / 0.59 / -0.0%
clickbench_q31/duckdb:vortex-file-compressed 111161813 / 110824567 / +0.3% 160505514 / 161689175 / -0.7% 0.69 / 0.69 / +1.0%
clickbench_q32/duckdb:vortex-file-compressed 376797079 / 360248396 / +4.6% 401880225 / 388836885 / +3.4% 0.94 / 0.93 / +1.2%
clickbench_q33/duckdb:vortex-file-compressed 345381518 / 347083490 / -0.5% 394947402 / 397619998 / -0.7% 0.87 / 0.87 / +0.2%
clickbench_q34/duckdb:vortex-file-compressed 353038708 / 353787975 / -0.2% 403850865 / 418291198 / -3.5% 0.87 / 0.85 / +3.4%
clickbench_q35/duckdb:vortex-file-compressed 59547988 / 57801338 / +3.0% 88044881 / 83462916 / +5.5% 0.68 / 0.69 / -2.3%
clickbench_q36/duckdb:vortex-file-compressed 11222434 / 11324424 / -0.9% 33517293 / 31678173 / +5.8% 0.33 / 0.36 / -6.3%
clickbench_q37/duckdb:vortex-file-compressed 7832674 / 7671676 / +2.1% 27536828 / 29182772 / -5.6% 0.28 / 0.26 / +8.2%
clickbench_q38/duckdb:vortex-file-compressed 8077664 / 8394656 / -3.8% 29705986 / 30412350 / -2.3% 0.27 / 0.28 / -1.5%
clickbench_q39/duckdb:vortex-file-compressed 17742470 / 17849796 / -0.6% 41457347 / 42407268 / -2.2% 0.43 / 0.42 / +1.7%
clickbench_q40/duckdb:vortex-file-compressed 6792704 / 6936501 / -2.1% 29080183 / 28982069 / +0.3% 0.23 / 0.24 / -2.4%
clickbench_q41/duckdb:vortex-file-compressed 7737002 / 7828174 / -1.2% 28817168 / 29876438 / -3.5% 0.27 / 0.26 / +2.5%
clickbench_q42/duckdb:vortex-file-compressed 6961189 / 6988234 / -0.4% 26618225 / 25943709 / +2.6% 0.26 / 0.27 / -2.9%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9513184 / 9734210 / -2.3% 14149143 / 14669725 / -3.5% 0.67 / 0.66 / +1.3%
clickbench_q01/duckdb:parquet 15793614 / 15501700 / +1.9% 20484234 / 22008704 / -6.9% 0.77 / 0.70 / +9.5%
clickbench_q02/duckdb:parquet 22618348 / 22670756 / -0.2% 31204169 / 31431384 / -0.7% 0.72 / 0.72 / +0.5%
clickbench_q03/duckdb:parquet 22096812 / 23000459 / -3.9% 34714716 / 34271804 / +1.3% 0.64 / 0.67 / -5.2%
clickbench_q04/duckdb:parquet 61925382 / 61080284 / +1.4% 72950146 / 74596505 / -2.2% 0.85 / 0.82 / +3.7%
clickbench_q05/duckdb:parquet 81848798 / 84633272 / -3.3% 96483415 / 96526220 / -0.0% 0.85 / 0.88 / -3.2%
clickbench_q06/duckdb:parquet 21247554 / 20910898 / +1.6% 29387824 / 28797942 / +2.0% 0.72 / 0.73 / -0.4%
clickbench_q07/duckdb:parquet 16852372 / 16891999 / -0.2% 22198819 / 22681734 / -2.1% 0.76 / 0.74 / +1.9%
clickbench_q08/duckdb:parquet 75056185 / 74191555 / +1.2% 87052259 / 83524917 / +4.2% 0.86 / 0.89 / -2.9%
clickbench_q09/duckdb:parquet 102892495 / 103469686 / -0.6% 118109616 / 120991960 / -2.4% 0.87 / 0.86 / +1.9%
clickbench_q10/duckdb:parquet 41361188 / 41777654 / -1.0% 54501728 / 54823492 / -0.6% 0.76 / 0.76 / -0.4%
clickbench_q11/duckdb:parquet 46428307 / 46949388 / -1.1% 63887892 / 60849993 / +5.0% 0.73 / 0.77 / -5.8%
clickbench_q12/duckdb:parquet 91854744 / 93110330 / -1.3% 107826100 / 106473452 / +1.3% 0.85 / 0.87 / -2.6%
clickbench_q13/duckdb:parquet 151026250 / 152416918 / -0.9% 168719224 / 166285859 / +1.5% 0.90 / 0.92 / -2.3%
clickbench_q14/duckdb:parquet 100397580 / 101463972 / -1.1% 117484636 / 115962465 / +1.3% 0.85 / 0.87 / -2.3%
clickbench_q15/duckdb:parquet 86327311 / 86461047 / -0.2% 101082730 / 98246764 / +2.9% 0.85 / 0.88 / -3.0%
clickbench_q16/duckdb:parquet 158907182 / 161985009 / -1.9% 179371351 / 177369336 / +1.1% 0.89 / 0.91 / -3.0%
clickbench_q17/duckdb:parquet 162472918 / 163861136 / -0.8% 177789696 / 200689249 / -11.4% 🟢 0.91 / 0.82 / +11.9%
clickbench_q18/duckdb:parquet 296548379 / 290488262 / +2.1% 316519020 / 321551778 / -1.6% 0.94 / 0.90 / +3.7%
clickbench_q19/duckdb:parquet 19935582 / 19485081 / +2.3% 25749953 / 26746022 / -3.7% 0.77 / 0.73 / +6.3%
clickbench_q20/duckdb:parquet 184586644 / 185435154 / -0.5% 223833367 / 224175827 / -0.2% 0.82 / 0.83 / -0.3%
clickbench_q21/duckdb:parquet 222893992 / 219618836 / +1.5% 269971993 / 271690917 / -0.6% 0.83 / 0.81 / +2.1%
clickbench_q22/duckdb:parquet 312798760 / 318580908 / -1.8% 361704675 / 361051580 / +0.2% 0.86 / 0.88 / -2.0%
clickbench_q23/duckdb:parquet 172465740 / 172487708 / -0.0% 254543219 / 249473980 / +2.0% 0.68 / 0.69 / -2.0%
clickbench_q24/duckdb:parquet 29736048 / 29718382 / +0.1% 46378185 / 44464092 / +4.3% 0.64 / 0.67 / -4.1%
clickbench_q25/duckdb:parquet 41535397 / 41341509 / +0.5% 57296758 / 57974024 / -1.2% 0.72 / 0.71 / +1.7%
clickbench_q26/duckdb:parquet 30885958 / 29852864 / +3.5% 48768267 / 44575710 / +9.4% 0.63 / 0.67 / -5.4%
clickbench_q27/duckdb:parquet 195935138 / 188546128 / +3.9% 223210784 / 228175009 / -2.2% 0.88 / 0.83 / +6.2%
clickbench_q28/duckdb:parquet 965994530 / 950107852 / +1.7% 941546305 / 943903720 / -0.2% 1.03 / 1.01 / +1.9%
clickbench_q29/duckdb:parquet 24218433 / 24365200 / -0.6% 30324587 / 31555514 / -3.9% 0.80 / 0.77 / +3.4%
clickbench_q30/duckdb:parquet 106198740 / 106051019 / +0.1% 129656584 / 125132754 / +3.6% 0.82 / 0.85 / -3.4%
clickbench_q31/duckdb:parquet 145948920 / 156576240 / -6.8% 176320112 / 174184392 / +1.2% 0.83 / 0.90 / -7.9%
clickbench_q32/duckdb:parquet 381452934 / 389229202 / -2.0% 407304673 / 417620107 / -2.5% 0.94 / 0.93 / +0.5%
clickbench_q33/duckdb:parquet 501697906 / 472413586 / +6.2% 460521976 / 448476095 / +2.7% 1.09 / 1.05 / +3.4%
clickbench_q34/duckdb:parquet 465481009 / 474841678 / -2.0% 478028053 / 463486376 / +3.1% 0.97 / 1.02 / -5.0%
clickbench_q35/duckdb:parquet 61459561 / 61081874 / +0.6% 73566931 / 73512523 / +0.1% 0.84 / 0.83 / +0.5%
clickbench_q36/duckdb:parquet 29839073 / 29993840 / -0.5% 36161489 / 35624078 / +1.5% 0.83 / 0.84 / -2.0%
clickbench_q37/duckdb:parquet 23324363 / 22984995 / +1.5% 29465828 / 29513311 / -0.2% 0.79 / 0.78 / +1.6%
clickbench_q38/duckdb:parquet 23810947 / 23501892 / +1.3% 29925685 / 29384320 / +1.8% 0.80 / 0.80 / -0.5%
clickbench_q39/duckdb:parquet 53158136 / 53390251 / -0.4% 60645011 / 58948474 / +2.9% 0.88 / 0.91 / -3.2%
clickbench_q40/duckdb:parquet 14513956 / 14807084 / -2.0% 19828561 / 19826127 / +0.0% 0.73 / 0.75 / -2.0%
clickbench_q41/duckdb:parquet 15229714 / 15467964 / -1.5% 21721151 / 20294642 / +7.0% 0.70 / 0.76 / -8.0%
clickbench_q42/duckdb:parquet 14192414 / 13798928 / +2.9% 20483297 / 20769522 / -1.4% 0.69 / 0.66 / +4.3%
duckdb / duckdb / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb 11292722 / 11205625 / +0.8% 13787721 / 14008787 / -1.6% 0.82 / 0.80 / +2.4%
clickbench_q01/duckdb:duckdb 25808495 / 26498171 / -2.6% 43623534 / 43333139 / +0.7% 0.59 / 0.61 / -3.3%
clickbench_q02/duckdb:duckdb 22531430 / 22010268 / +2.4% 47952240 / 47538546 / +0.9% 0.47 / 0.46 / +1.5%
clickbench_q03/duckdb:duckdb 21301725 / 21037776 / +1.3% 43249077 / 43325409 / -0.2% 0.49 / 0.49 / +1.4%
clickbench_q04/duckdb:duckdb 74469724 / 74179509 / +0.4% 97641069 / 96020722 / +1.7% 0.76 / 0.77 / -1.3%
clickbench_q05/duckdb:duckdb 79305898 / 79288345 / +0.0% 103647781 / 100052214 / +3.6% 0.77 / 0.79 / -3.4%
clickbench_q06/duckdb:duckdb 21506197 / 21428811 / +0.4% 29204031 / 27976473 / +4.4% 0.74 / 0.77 / -3.9%
clickbench_q07/duckdb:duckdb 17620954 / 17430771 / +1.1% 35270204 / 33152080 / +6.4% 0.50 / 0.53 / -5.0%
clickbench_q08/duckdb:duckdb 87570669 / 87636815 / -0.1% 116078319 / 114911836 / +1.0% 0.75 / 0.76 / -1.1%
clickbench_q09/duckdb:duckdb 98147842 / 96288077 / +1.9% 133128322 / 130479533 / +2.0% 0.74 / 0.74 / -0.1%
clickbench_q10/duckdb:duckdb 52578584 / 52549399 / +0.1% 89680600 / 86755997 / +3.4% 0.59 / 0.61 / -3.2%
clickbench_q11/duckdb:duckdb 55558608 / 55242448 / +0.6% 97103865 / 94862972 / +2.4% 0.57 / 0.58 / -1.7%
clickbench_q12/duckdb:duckdb 82117760 / 82556298 / -0.5% 104756446 / 108376585 / -3.3% 0.78 / 0.76 / +2.9%
clickbench_q13/duckdb:duckdb 145424527 / 142626661 / +2.0% 177277971 / 174791243 / +1.4% 0.82 / 0.82 / +0.5%
clickbench_q14/duckdb:duckdb 92687779 / 91801450 / +1.0% 115504079 / 111600539 / +3.5% 0.80 / 0.82 / -2.4%
clickbench_q15/duckdb:duckdb 81874447 / 82403718 / -0.6% 102483080 / 103084496 / -0.6% 0.80 / 0.80 / -0.1%
clickbench_q16/duckdb:duckdb 167316113 / 164223098 / +1.9% 189129137 / 188549094 / +0.3% 0.88 / 0.87 / +1.6%
clickbench_q17/duckdb:duckdb 151647490 / 152266359 / -0.4% 188596543 / 181473039 / +3.9% 0.80 / 0.84 / -4.2%
clickbench_q18/duckdb:duckdb 302812771 / 298136174 / +1.6% 349849765 / 345775095 / +1.2% 0.87 / 0.86 / +0.4%
clickbench_q19/duckdb:duckdb 17887364 / 17467932 / +2.4% 32934425 / 29453235 / +11.8% 🔴 0.54 / 0.59 / -8.4%
clickbench_q20/duckdb:duckdb 184692682 / 184671016 / +0.0% 441421497 / 417855814 / +5.6% 0.42 / 0.44 / -5.3%
clickbench_q21/duckdb:duckdb 170551512 / 168062792 / +1.5% 457579659 / 425760537 / +7.5% 0.37 / 0.39 / -5.6%
clickbench_q22/duckdb:duckdb 187326438 / 200040412 / -6.4% 458161266 / 439479190 / +4.3% 0.41 / 0.46 / -10.2%
clickbench_q23/duckdb:duckdb 68527360 / 68272752 / +0.4% 134875048 / 134553981 / +0.2% 0.51 / 0.51 / +0.1%
clickbench_q24/duckdb:duckdb 30200797 / 29928633 / +0.9% 45043074 / 44329335 / +1.6% 0.67 / 0.68 / -0.7%
clickbench_q25/duckdb:duckdb 40829958 / 40524326 / +0.8% 74181184 / 74031611 / +0.2% 0.55 / 0.55 / +0.6%
clickbench_q26/duckdb:duckdb 30254082 / 30875384 / -2.0% 46077202 / 44290941 / +4.0% 0.66 / 0.70 / -5.8%
clickbench_q27/duckdb:duckdb 154295048 / 151791906 / +1.6% 397199413 / 401373300 / -1.0% 0.39 / 0.38 / +2.7%
clickbench_q28/duckdb:duckdb 823143689 / 817695939 / +0.7% 870905474 / 866348171 / +0.5% 0.95 / 0.94 / +0.1%
clickbench_q29/duckdb:duckdb 27115638 / 27056248 / +0.2% 45104085 / 42202975 / +6.9% 0.60 / 0.64 / -6.2%
clickbench_q30/duckdb:duckdb 100875432 / 100095516 / +0.8% 167027090 / 161400818 / +3.5% 0.60 / 0.62 / -2.6%
clickbench_q31/duckdb:duckdb 161010323 / 170860678 / -5.8% 264243490 / 264472185 / -0.1% 0.61 / 0.65 / -5.7%
clickbench_q32/duckdb:duckdb 447401010 / 482145498 / -7.2% 481476983 / 478493568 / +0.6% 0.93 / 1.01 / -7.8%
clickbench_q33/duckdb:duckdb 443683704 / 463154136 / -4.2% 576705058 / 571094241 / +1.0% 0.77 / 0.81 / -5.1%
clickbench_q34/duckdb:duckdb 443515214 / 447443352 / -0.9% 583275321 / 583218601 / +0.0% 0.76 / 0.77 / -0.9%
clickbench_q35/duckdb:duckdb 75391774 / 75113512 / +0.4% 93921816 / 92128082 / +1.9% 0.80 / 0.82 / -1.5%
clickbench_q36/duckdb:duckdb 32199292 / 31766861 / +1.4% 45062509 / 43341496 / +4.0% 0.71 / 0.73 / -2.5%
clickbench_q37/duckdb:duckdb 16556658 / 16621827 / -0.4% 25652244 / 23825292 / +7.7% 0.65 / 0.70 / -7.5%
clickbench_q38/duckdb:duckdb 19460141 / 18483618 / +5.3% 33966404 / 28909670 / +17.5% 🔴 0.57 / 0.64 / -10.4%
clickbench_q39/duckdb:duckdb 55383190 / 53921718 / +2.7% 76360193 / 72334222 / +5.6% 0.73 / 0.75 / -2.7%
clickbench_q40/duckdb:duckdb 16209840 / 16156598 / +0.3% 28524013 / 25506549 / +11.8% 🔴 0.57 / 0.63 / -10.3%
clickbench_q41/duckdb:duckdb 15911314 / 15976503 / -0.4% 25534217 / 24853418 / +2.7% 0.62 / 0.64 / -3.1%
clickbench_q42/duckdb:duckdb 15875195 / 15937760 / -0.4% 25660521 / 23228286 / +10.5% 🔴 0.62 / 0.69 / -9.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: JOB on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.040x ➖
Parquet (geomean): hot 0.992x ➖ · cold 1.011x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:vortex-file-compressed 14710178 / 14931628 / -1.5% 31043712 / 28493770 / +8.9% 0.47 / 0.52 / -9.6%
job_q02/duckdb:vortex-file-compressed 25053838 / 25227142 / -0.7% 38769316 / 37100967 / +4.5% 0.65 / 0.68 / -5.0%
job_q03/duckdb:vortex-file-compressed 16006838 / 15872880 / +0.8% 29279812 / 29026258 / +0.9% 0.55 / 0.55 / -0.0%
job_q04/duckdb:vortex-file-compressed 27089015 / 26931698 / +0.6% 42387839 / 40119107 / +5.7% 0.64 / 0.67 / -4.8%
job_q05/duckdb:vortex-file-compressed 19304259 / 19761821 / -2.3% 36843166 / 34964478 / +5.4% 0.52 / 0.57 / -7.3%
job_q06/duckdb:vortex-file-compressed 16377948 / 16314490 / +0.4% 33524465 / 31060427 / +7.9% 0.49 / 0.53 / -7.0%
job_q07/duckdb:vortex-file-compressed 9386460 / 9431680 / -0.5% 25988048 / 23745892 / +9.4% 0.36 / 0.40 / -9.1%
job_q08/duckdb:vortex-file-compressed 21617574 / 21813813 / -0.9% 37379150 / 35536234 / +5.2% 0.58 / 0.61 / -5.8%
job_q09/duckdb:vortex-file-compressed 68245652 / 69134764 / -1.3% 99581010 / 95938288 / +3.8% 0.69 / 0.72 / -4.9%
job_q10/duckdb:vortex-file-compressed 44735322 / 46035086 / -2.8% 74688332 / 73651960 / +1.4% 0.60 / 0.63 / -4.2%
job_q100/duckdb:vortex-file-compressed 40895213 / 39487286 / +3.6% 73800481 / 72651926 / +1.6% 0.55 / 0.54 / +2.0%
job_q101/duckdb:vortex-file-compressed 38491984 / 38286363 / +0.5% 71139952 / 68877659 / +3.3% 0.54 / 0.56 / -2.7%
job_q102/duckdb:vortex-file-compressed 73073518 / 73172896 / -0.1% 111793536 / 109775421 / +1.8% 0.65 / 0.67 / -1.9%
job_q103/duckdb:vortex-file-compressed 49136894 / 49471338 / -0.7% 83307376 / 79076499 / +5.4% 0.59 / 0.63 / -5.7%
job_q104/duckdb:vortex-file-compressed 38020854 / 38136561 / -0.3% 71954542 / 69290514 / +3.8% 0.53 / 0.55 / -4.0%
job_q105/duckdb:vortex-file-compressed 69781105 / 68528399 / +1.8% 101969265 / 101987156 / -0.0% 0.68 / 0.67 / +1.8%
job_q106/duckdb:vortex-file-compressed 63593909 / 63314110 / +0.4% 96804329 / 92839639 / +4.3% 0.66 / 0.68 / -3.7%
job_q107/duckdb:vortex-file-compressed 43839831 / 42643710 / +2.8% 81424033 / 73821579 / +10.3% 🔴 0.54 / 0.58 / -6.8%
job_q108/duckdb:vortex-file-compressed 64197926 / 64846834 / -1.0% 99395323 / 95598446 / +4.0% 0.65 / 0.68 / -4.8%
job_q109/duckdb:vortex-file-compressed 10950722 / 11172992 / -2.0% 23781135 / 23857995 / -0.3% 0.46 / 0.47 / -1.7%
job_q11/duckdb:vortex-file-compressed 39479978 / 40009836 / -1.3% 69420392 / 67155607 / +3.4% 0.57 / 0.60 / -4.5%
job_q110/duckdb:vortex-file-compressed 17006955 / 17366850 / -2.1% 31323739 / 31718401 / -1.2% 0.54 / 0.55 / -0.8%
job_q111/duckdb:vortex-file-compressed 27962290 / 27885048 / +0.3% 43965001 / 44147899 / -0.4% 0.64 / 0.63 / +0.7%
job_q112/duckdb:vortex-file-compressed 27378986 / 27420340 / -0.2% 46324552 / 42769600 / +8.3% 0.59 / 0.64 / -7.8%
job_q113/duckdb:vortex-file-compressed 31151678 / 31244102 / -0.3% 49700598 / 49234899 / +0.9% 0.63 / 0.63 / -1.2%
job_q12/duckdb:vortex-file-compressed 38161798 / 37998908 / +0.4% 55146581 / 56430495 / -2.3% 0.69 / 0.67 / +2.8%
job_q13/duckdb:vortex-file-compressed 12830544 / 13022005 / -1.5% 30471425 / 29337139 / +3.9% 0.42 / 0.44 / -5.1%
job_q14/duckdb:vortex-file-compressed 47400988 / 47762700 / -0.8% 67110127 / 61534085 / +9.1% 0.71 / 0.78 / -9.0%
job_q15/duckdb:vortex-file-compressed 26853096 / 27182302 / -1.2% 56882691 / 53960116 / +5.4% 0.47 / 0.50 / -6.3%
job_q16/duckdb:vortex-file-compressed 25535396 / 25357968 / +0.7% 56005235 / 55793063 / +0.4% 0.46 / 0.45 / +0.3%
job_q17/duckdb:vortex-file-compressed 36300330 / 36482137 / -0.5% 66961907 / 64933071 / +3.1% 0.54 / 0.56 / -3.5%
job_q18/duckdb:vortex-file-compressed 27212624 / 33245112 / -18.1% 🟢 67548118 / 63399952 / +6.5% 0.40 / 0.52 / -23.2%
job_q19/duckdb:vortex-file-compressed 19010286 / 19199772 / -1.0% 42915358 / 38304070 / +12.0% 🔴 0.44 / 0.50 / -11.6%
job_q20/duckdb:vortex-file-compressed 17926245 / 17199556 / +4.2% 45006321 / 39256814 / +14.6% 🔴 0.40 / 0.44 / -9.1%
job_q21/duckdb:vortex-file-compressed 38745542 / 37467494 / +3.4% 62055007 / 59800588 / +3.8% 0.62 / 0.63 / -0.3%
job_q22/duckdb:vortex-file-compressed 27916336 / 28868300 / -3.3% 57063912 / 51901771 / +9.9% 0.49 / 0.56 / -12.0%
job_q23/duckdb:vortex-file-compressed 67636051 / 67831530 / -0.3% 96956814 / 90102246 / +7.6% 0.70 / 0.75 / -7.3%
job_q24/duckdb:vortex-file-compressed 41172774 / 40834551 / +0.8% 70874038 / 66452226 / +6.7% 0.58 / 0.61 / -5.5%
job_q25/duckdb:vortex-file-compressed 34642582 / 34749320 / -0.3% 66231830 / 60780578 / +9.0% 0.52 / 0.57 / -8.5%
job_q26/duckdb:vortex-file-compressed 87456920 / 87677996 / -0.3% 124463212 / 116943315 / +6.4% 0.70 / 0.75 / -6.3%
job_q27/duckdb:vortex-file-compressed 28700470 / 28393353 / +1.1% 52291909 / 52091269 / +0.4% 0.55 / 0.55 / +0.7%
job_q28/duckdb:vortex-file-compressed 23717718 / 23834530 / -0.5% 49366773 / 46571057 / +6.0% 0.48 / 0.51 / -6.1%
job_q29/duckdb:vortex-file-compressed 85017536 / 84962256 / +0.1% 102037264 / 101120417 / +0.9% 0.83 / 0.84 / -0.8%
job_q30/duckdb:vortex-file-compressed 66864665 / 67513568 / -1.0% 84744947 / 83538805 / +1.4% 0.79 / 0.81 / -2.4%
job_q31/duckdb:vortex-file-compressed 59773664 / 59923448 / -0.2% 94413060 / 88629789 / +6.5% 0.63 / 0.68 / -6.4%
job_q32/duckdb:vortex-file-compressed 47129966 / 47212136 / -0.2% 78533654 / 75071212 / +4.6% 0.60 / 0.63 / -4.6%
job_q33/duckdb:vortex-file-compressed 61139904 / 61373478 / -0.4% 88402501 / 85362234 / +3.6% 0.69 / 0.72 / -3.8%
job_q34/duckdb:vortex-file-compressed 125903398 / 126398444 / -0.4% 156540430 / 150301026 / +4.2% 0.80 / 0.84 / -4.4%
job_q35/duckdb:vortex-file-compressed 26581703 / 26558010 / +0.1% 52383897 / 49919256 / +4.9% 0.51 / 0.53 / -4.6%
job_q36/duckdb:vortex-file-compressed 21315878 / 21296332 / +0.1% 48390289 / 45674460 / +5.9% 0.44 / 0.47 / -5.5%
job_q37/duckdb:vortex-file-compressed 50217800 / 50530068 / -0.6% 83352137 / 79227269 / +5.2% 0.60 / 0.64 / -5.5%
job_q38/duckdb:vortex-file-compressed 18771176 / 18360556 / +2.2% 34864377 / 34016982 / +2.5% 0.54 / 0.54 / -0.2%
job_q39/duckdb:vortex-file-compressed 16042340 / 16315168 / -1.7% 31592191 / 31235923 / +1.1% 0.51 / 0.52 / -2.8%
job_q40/duckdb:vortex-file-compressed 94291272 / 94580392 / -0.3% 114088277 / 111972163 / +1.9% 0.83 / 0.84 / -2.2%
job_q41/duckdb:vortex-file-compressed 258300188 / 257357577 / +0.4% 279510969 / 274162189 / +2.0% 0.92 / 0.94 / -1.6%
job_q42/duckdb:vortex-file-compressed 29464468 / 29309724 / +0.5% 49650196 / 48273326 / +2.9% 0.59 / 0.61 / -2.3%
job_q43/duckdb:vortex-file-compressed 16908925 / 17173702 / -1.5% 35919186 / 34080150 / +5.4% 0.47 / 0.50 / -6.6%
job_q44/duckdb:vortex-file-compressed 45591459 / 45705976 / -0.3% 66933680 / 65235995 / +2.6% 0.68 / 0.70 / -2.8%
job_q45/duckdb:vortex-file-compressed 66462552 / 66497738 / -0.1% 86212751 / 84333627 / +2.2% 0.77 / 0.79 / -2.2%
job_q46/duckdb:vortex-file-compressed 21485329 / 21478658 / +0.0% 39429428 / 38163245 / +3.3% 0.54 / 0.56 / -3.2%
job_q47/duckdb:vortex-file-compressed 17792759 / 17779151 / +0.1% 36422215 / 33009097 / +10.3% 🔴 0.49 / 0.54 / -9.3%
job_q48/duckdb:vortex-file-compressed 71538780 / 70994594 / +0.8% 87094492 / 86687984 / +0.5% 0.82 / 0.82 / +0.3%
job_q49/duckdb:vortex-file-compressed 49720201 / 50582328 / -1.7% 70325011 / 62924695 / +11.8% 🔴 0.71 / 0.80 / -12.0%
job_q50/duckdb:vortex-file-compressed 36947298 / 37130742 / -0.5% 55224846 / 54099352 / +2.1% 0.67 / 0.69 / -2.5%
job_q51/duckdb:vortex-file-compressed 56442070 / 56671230 / -0.4% 76599683 / 75986258 / +0.8% 0.74 / 0.75 / -1.2%
job_q52/duckdb:vortex-file-compressed 45673356 / 46371554 / -1.5% 70018397 / 68787777 / +1.8% 0.65 / 0.67 / -3.2%
job_q53/duckdb:vortex-file-compressed 43750085 / 43385475 / +0.8% 67425548 / 66526703 / +1.4% 0.65 / 0.65 / -0.5%
job_q54/duckdb:vortex-file-compressed 56028332 / 56484830 / -0.8% 80326560 / 78071342 / +2.9% 0.70 / 0.72 / -3.6%
job_q55/duckdb:vortex-file-compressed 56857152 / 56043685 / +1.5% 76113879 / 77260680 / -1.5% 0.75 / 0.73 / +3.0%
job_q56/duckdb:vortex-file-compressed 36432848 / 36534284 / -0.3% 66224851 / 62474639 / +6.0% 0.55 / 0.58 / -5.9%
job_q57/duckdb:vortex-file-compressed 82199686 / 83314984 / -1.3% 105292959 / 102852237 / +2.4% 0.78 / 0.81 / -3.6%
job_q58/duckdb:vortex-file-compressed 65929846 / 65926014 / +0.0% 94922835 / 91671108 / +3.5% 0.69 / 0.72 / -3.4%
job_q59/duckdb:vortex-file-compressed 61074726 / 61425855 / -0.6% 90013678 / 87715437 / +2.6% 0.68 / 0.70 / -3.1%
job_q60/duckdb:vortex-file-compressed 41783130 / 41554422 / +0.6% 66209105 / 63779679 / +3.8% 0.63 / 0.65 / -3.1%
job_q61/duckdb:vortex-file-compressed 32639000 / 32381144 / +0.8% 60730953 / 56503075 / +7.5% 0.54 / 0.57 / -6.2%
job_q62/duckdb:vortex-file-compressed 31512102 / 31238331 / +0.9% 59659322 / 55730883 / +7.0% 0.53 / 0.56 / -5.8%
job_q63/duckdb:vortex-file-compressed 34530237 / 34428260 / +0.3% 59975532 / 59963096 / +0.0% 0.58 / 0.57 / +0.3%
job_q64/duckdb:vortex-file-compressed 56043046 / 57498851 / -2.5% 83430700 / 77409656 / +7.8% 0.67 / 0.74 / -9.6%
job_q65/duckdb:vortex-file-compressed 48913476 / 49220746 / -0.6% 77709123 / 73444866 / +5.8% 0.63 / 0.67 / -6.1%
job_q66/duckdb:vortex-file-compressed 48793959 / 48822732 / -0.1% 80160392 / 79277714 / +1.1% 0.61 / 0.62 / -1.2%
job_q67/duckdb:vortex-file-compressed 33941310 / 33848104 / +0.3% 64751281 / 63451864 / +2.0% 0.52 / 0.53 / -1.7%
job_q68/duckdb:vortex-file-compressed 54027953 / 55353971 / -2.4% 85520344 / 83869330 / +2.0% 0.63 / 0.66 / -4.3%
job_q69/duckdb:vortex-file-compressed 74735468 / 75930113 / -1.6% 108251374 / 105583692 / +2.5% 0.69 / 0.72 / -4.0%
job_q70/duckdb:vortex-file-compressed 43338695 / 43312844 / +0.1% 75570795 / 71047437 / +6.4% 0.57 / 0.61 / -5.9%
job_q71/duckdb:vortex-file-compressed 66961311 / 67304122 / -0.5% 98571180 / 97433857 / +1.2% 0.68 / 0.69 / -1.7%
job_q72/duckdb:vortex-file-compressed 138122252 / 140608279 / -1.8% 167371051 / 167142198 / +0.1% 0.83 / 0.84 / -1.9%
job_q73/duckdb:vortex-file-compressed 82641414 / 81908068 / +0.9% 118157575 / 112376263 / +5.1% 0.70 / 0.73 / -4.0%
job_q74/duckdb:vortex-file-compressed 66557964 / 67485102 / -1.4% 103897039 / 99111562 / +4.8% 0.64 / 0.68 / -5.9%
job_q75/duckdb:vortex-file-compressed 64142350 / 64999194 / -1.3% 103117969 / 99545394 / +3.6% 0.62 / 0.65 / -4.7%
job_q76/duckdb:vortex-file-compressed 27435532 / 26877656 / +2.1% 51992597 / 50893117 / +2.2% 0.53 / 0.53 / -0.1%
job_q77/duckdb:vortex-file-compressed 25918995 / 26143046 / -0.9% 51901365 / 49641626 / +4.6% 0.50 / 0.53 / -5.2%
job_q78/duckdb:vortex-file-compressed 27952352 / 28412899 / -1.6% 52778066 / 52178354 / +1.1% 0.53 / 0.54 / -2.7%
job_q79/duckdb:vortex-file-compressed 60189820 / 59220514 / +1.6% 82955890 / 80627377 / +2.9% 0.73 / 0.73 / -1.2%
job_q80/duckdb:vortex-file-compressed 46864890 / 46256730 / +1.3% 71534461 / 67042322 / +6.7% 0.66 / 0.69 / -5.0%
job_q81/duckdb:vortex-file-compressed 87748962 / 90066142 / -2.6% 112374274 / 109694805 / +2.4% 0.78 / 0.82 / -4.9%
job_q82/duckdb:vortex-file-compressed 135452624 / 136884830 / -1.0% 154450577 / 155734592 / -0.8% 0.88 / 0.88 / -0.2%
job_q83/duckdb:vortex-file-compressed 39852478 / 40524995 / -1.7% 64123173 / 60423181 / +6.1% 0.62 / 0.67 / -7.3%
job_q84/duckdb:vortex-file-compressed 38836694 / 38170632 / +1.7% 60559464 / 59135335 / +2.4% 0.64 / 0.65 / -0.6%
job_q85/duckdb:vortex-file-compressed 45717208 / 45934611 / -0.5% 68841328 / 66404820 / +3.7% 0.66 / 0.69 / -4.0%
job_q86/duckdb:vortex-file-compressed 64225960 / 64980930 / -1.2% 102695299 / 97413015 / +5.4% 0.63 / 0.67 / -6.2%
job_q87/duckdb:vortex-file-compressed 60815442 / 60321652 / +0.8% 95638186 / 93532141 / +2.3% 0.64 / 0.64 / -1.4%
job_q88/duckdb:vortex-file-compressed 58741602 / 59113076 / -0.6% 96113054 / 89219216 / +7.7% 0.61 / 0.66 / -7.8%
job_q89/duckdb:vortex-file-compressed 47371861 / 47233394 / +0.3% 84585829 / 77519631 / +9.1% 0.56 / 0.61 / -8.1%
job_q90/duckdb:vortex-file-compressed 69752242 / 68997010 / +1.1% 101767733 / 99384959 / +2.4% 0.69 / 0.69 / -1.3%
job_q91/duckdb:vortex-file-compressed 60008556 / 59671308 / +0.6% 99894957 / 95833625 / +4.2% 0.60 / 0.62 / -3.5%
job_q92/duckdb:vortex-file-compressed 42436862 / 42134940 / +0.7% 78841485 / 73024908 / +8.0% 0.54 / 0.58 / -6.7%
job_q93/duckdb:vortex-file-compressed 68179490 / 68293666 / -0.2% 107170020 / 101684171 / +5.4% 0.64 / 0.67 / -5.3%
job_q94/duckdb:vortex-file-compressed 27550168 / 27750616 / -0.7% 49738179 / 50953057 / -2.4% 0.55 / 0.54 / +1.7%
job_q95/duckdb:vortex-file-compressed 26824348 / 26563188 / +1.0% 48202729 / 46222450 / +4.3% 0.56 / 0.57 / -3.2%
job_q96/duckdb:vortex-file-compressed 29021977 / 28872736 / +0.5% 52539744 / 50396495 / +4.3% 0.55 / 0.57 / -3.6%
job_q97/duckdb:vortex-file-compressed 84389742 / 83922940 / +0.6% 121146641 / 117096677 / +3.5% 0.70 / 0.72 / -2.8%
job_q98/duckdb:vortex-file-compressed 56274135 / 56753322 / -0.8% 93312704 / 89016992 / +4.8% 0.60 / 0.64 / -5.4%
job_q99/duckdb:vortex-file-compressed 79852674 / 80315507 / -0.6% 114824608 / 113804239 / +0.9% 0.70 / 0.71 / -1.5%
duckdb / parquet / ns (0.992x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:parquet 60630298 / 60603994 / +0.0% 68106808 / 67360930 / +1.1% 0.89 / 0.90 / -1.1%
job_q02/duckdb:parquet 147598400 / 147612029 / -0.0% 164558856 / 161939334 / +1.6% 0.90 / 0.91 / -1.6%
job_q03/duckdb:parquet 89882143 / 89975413 / -0.1% 99295232 / 98320183 / +1.0% 0.91 / 0.92 / -1.1%
job_q04/duckdb:parquet 168561620 / 168842234 / -0.2% 177533505 / 178194534 / -0.4% 0.95 / 0.95 / +0.2%
job_q05/duckdb:parquet 76499327 / 77306705 / -1.0% 88198685 / 86792583 / +1.6% 0.87 / 0.89 / -2.6%
job_q06/duckdb:parquet 73298218 / 73532452 / -0.3% 84051755 / 81945162 / +2.6% 0.87 / 0.90 / -2.8%
job_q07/duckdb:parquet 31378962 / 31198824 / +0.6% 41694301 / 40194790 / +3.7% 0.75 / 0.78 / -3.0%
job_q08/duckdb:parquet 93468670 / 93481118 / -0.0% 104048746 / 102733947 / +1.3% 0.90 / 0.91 / -1.3%
job_q09/duckdb:parquet 290270397 / 294881934 / -1.6% 328238655 / 309690061 / +6.0% 0.88 / 0.95 / -7.1%
job_q10/duckdb:parquet 242860006 / 238310350 / +1.9% 285620896 / 251159506 / +13.7% 🔴 0.85 / 0.95 / -10.4%
job_q100/duckdb:parquet 223353428 / 232792334 / -4.1% 273199793 / 263903197 / +3.5% 0.82 / 0.88 / -7.3%
job_q101/duckdb:parquet 217903277 / 228473003 / -4.6% 252297152 / 261857057 / -3.7% 0.86 / 0.87 / -1.0%
job_q102/duckdb:parquet 259212972 / 260047676 / -0.3% 302232397 / 293654204 / +2.9% 0.86 / 0.89 / -3.2%
job_q103/duckdb:parquet 197304198 / 203309836 / -3.0% 229382280 / 237697252 / -3.5% 0.86 / 0.86 / +0.6%
job_q104/duckdb:parquet 152892745 / 165840474 / -7.8% 193477427 / 204599134 / -5.4% 0.79 / 0.81 / -2.5%
job_q105/duckdb:parquet 202480468 / 219746564 / -7.9% 233114116 / 235619867 / -1.1% 0.87 / 0.93 / -6.9%
job_q106/duckdb:parquet 220167488 / 213609864 / +3.1% 242697441 / 243039565 / -0.1% 0.91 / 0.88 / +3.2%
job_q107/duckdb:parquet 198371729 / 206480678 / -3.9% 241083750 / 225599552 / +6.9% 0.82 / 0.92 / -10.1%
job_q108/duckdb:parquet 223700780 / 232767774 / -3.9% 250374901 / 251192955 / -0.3% 0.89 / 0.93 / -3.6%
job_q109/duckdb:parquet 29896018 / 29542694 / +1.2% 36396650 / 36133019 / +0.7% 0.82 / 0.82 / +0.5%
job_q11/duckdb:parquet 329924632 / 323974646 / +1.8% 341680889 / 346406298 / -1.4% 0.97 / 0.94 / +3.2%
job_q110/duckdb:parquet 77835742 / 78167830 / -0.4% 86523882 / 86058009 / +0.5% 0.90 / 0.91 / -1.0%
job_q111/duckdb:parquet 109069322 / 109631667 / -0.5% 119141895 / 118654519 / +0.4% 0.92 / 0.92 / -0.9%
job_q112/duckdb:parquet 105781852 / 106740762 / -0.9% 116745580 / 115076608 / +1.5% 0.91 / 0.93 / -2.3%
job_q113/duckdb:parquet 117465392 / 118424737 / -0.8% 128374488 / 127950142 / +0.3% 0.92 / 0.93 / -1.1%
job_q12/duckdb:parquet 106986646 / 108400441 / -1.3% 118007174 / 116086127 / +1.7% 0.91 / 0.93 / -2.9%
job_q13/duckdb:parquet 59887911 / 60327955 / -0.7% 69039306 / 68169150 / +1.3% 0.87 / 0.88 / -2.0%
job_q14/duckdb:parquet 124184893 / 124482832 / -0.2% 134515488 / 132802708 / +1.3% 0.92 / 0.94 / -1.5%
job_q15/duckdb:parquet 361246052 / 363263561 / -0.6% 383877119 / 379030560 / +1.3% 0.94 / 0.96 / -1.8%
job_q16/duckdb:parquet 254556940 / 254231726 / +0.1% 334141963 / 330689646 / +1.0% 0.76 / 0.77 / -0.9%
job_q17/duckdb:parquet 309855186 / 336269572 / -7.9% 385165181 / 373676878 / +3.1% 0.80 / 0.90 / -10.6%
job_q18/duckdb:parquet 84924614 / 85362238 / -0.5% 98868336 / 99237296 / -0.4% 0.86 / 0.86 / -0.1%
job_q19/duckdb:parquet 72558292 / 72820626 / -0.4% 84099017 / 83695822 / +0.5% 0.86 / 0.87 / -0.8%
job_q20/duckdb:parquet 72373954 / 72396000 / -0.0% 85223272 / 85850593 / -0.7% 0.85 / 0.84 / +0.7%
job_q21/duckdb:parquet 115234286 / 115658776 / -0.4% 131460916 / 130810728 / +0.5% 0.88 / 0.88 / -0.9%
job_q22/duckdb:parquet 110419180 / 110460242 / -0.0% 126094234 / 126666786 / -0.5% 0.88 / 0.87 / +0.4%
job_q23/duckdb:parquet 197896398 / 197762810 / +0.1% 219195636 / 220109103 / -0.4% 0.90 / 0.90 / +0.5%
job_q24/duckdb:parquet 165018220 / 165442264 / -0.3% 183300347 / 184530568 / -0.7% 0.90 / 0.90 / +0.4%
job_q25/duckdb:parquet 132989451 / 132142854 / +0.6% 152305113 / 150115170 / +1.5% 0.87 / 0.88 / -0.8%
job_q26/duckdb:parquet 321631789 / 320924944 / +0.2% 343948176 / 343203941 / +0.2% 0.94 / 0.94 / +0.0%
job_q27/duckdb:parquet 131622022 / 132824419 / -0.9% 149618579 / 147573778 / +1.4% 0.88 / 0.90 / -2.3%
job_q28/duckdb:parquet 145923902 / 145257566 / +0.5% 162651864 / 162040547 / +0.4% 0.90 / 0.90 / +0.1%
job_q29/duckdb:parquet 389317139 / 388263530 / +0.3% 405322369 / 400644548 / +1.2% 0.96 / 0.97 / -0.9%
job_q30/duckdb:parquet 204895274 / 204672680 / +0.1% 217414546 / 215437668 / +0.9% 0.94 / 0.95 / -0.8%
job_q31/duckdb:parquet 311845048 / 312472690 / -0.2% 335674553 / 329307247 / +1.9% 0.93 / 0.95 / -2.1%
job_q32/duckdb:parquet 269850769 / 270144836 / -0.1% 290304133 / 286580547 / +1.3% 0.93 / 0.94 / -1.4%
job_q33/duckdb:parquet 262293149 / 263009240 / -0.3% 283864075 / 279302449 / +1.6% 0.92 / 0.94 / -1.9%
job_q34/duckdb:parquet 411372358 / 416552268 / -1.2% 432240673 / 434208817 / -0.5% 0.95 / 0.96 / -0.8%
job_q35/duckdb:parquet 141826567 / 143047801 / -0.9% 158086249 / 158739463 / -0.4% 0.90 / 0.90 / -0.4%
job_q36/duckdb:parquet 85340236 / 85381020 / -0.0% 102552650 / 100691245 / +1.8% 0.83 / 0.85 / -1.9%
job_q37/duckdb:parquet 246725760 / 246277415 / +0.2% 266758157 / 268337469 / -0.6% 0.92 / 0.92 / +0.8%
job_q38/duckdb:parquet 67161296 / 67499264 / -0.5% 80620862 / 74153364 / +8.7% 0.83 / 0.91 / -8.5%
job_q39/duckdb:parquet 61231492 / 60957597 / +0.4% 69732379 / 69671298 / +0.1% 0.88 / 0.87 / +0.4%
job_q40/duckdb:parquet 81556842 / 81602408 / -0.1% 91170818 / 89708672 / +1.6% 0.89 / 0.91 / -1.7%
job_q41/duckdb:parquet 91964654 / 92479857 / -0.6% 102873736 / 101504109 / +1.3% 0.89 / 0.91 / -1.9%
job_q42/duckdb:parquet 158837897 / 139989936 / +13.5% 🔴 197410337 / 161135954 / +22.5% 🔴 0.80 / 0.87 / -7.4%
job_q43/duckdb:parquet 55445869 / 55744712 / -0.5% 69594802 / 65470325 / +6.3% 0.80 / 0.85 / -6.4%
job_q44/duckdb:parquet 167252384 / 182210710 / -8.2% 190827358 / 315243214 / -39.5% 🟢 0.88 / 0.58 / +51.6%
job_q45/duckdb:parquet 175835189 / 177872440 / -1.1% 190618462 / 190151226 / +0.2% 0.92 / 0.94 / -1.4%
job_q46/duckdb:parquet 112943920 / 113221464 / -0.2% 129439245 / 123623935 / +4.7% 0.87 / 0.92 / -4.7%
job_q47/duckdb:parquet 91854064 / 92148554 / -0.3% 103125255 / 104131864 / -1.0% 0.89 / 0.88 / +0.7%
job_q48/duckdb:parquet 171326372 / 171537444 / -0.1% 185600552 / 181600911 / +2.2% 0.92 / 0.94 / -2.3%
job_q49/duckdb:parquet 164741388 / 169709530 / -2.9% 186712414 / 174204366 / +7.2% 0.88 / 0.97 / -9.4%
job_q50/duckdb:parquet 140398942 / 135005415 / +4.0% 156134677 / 150283681 / +3.9% 0.90 / 0.90 / +0.1%
job_q51/duckdb:parquet 181837838 / 196019944 / -7.2% 205817944 / 214534974 / -4.1% 0.88 / 0.91 / -3.3%
job_q52/duckdb:parquet 181607946 / 178879448 / +1.5% 198779808 / 195234453 / +1.8% 0.91 / 0.92 / -0.3%
job_q53/duckdb:parquet 171269430 / 175046638 / -2.2% 193345688 / 206360711 / -6.3% 0.89 / 0.85 / +4.4%
job_q54/duckdb:parquet 170097028 / 186054894 / -8.6% 192505331 / 220482233 / -12.7% 🟢 0.88 / 0.84 / +4.7%
job_q55/duckdb:parquet 173981657 / 172831098 / +0.7% 189257724 / 185534328 / +2.0% 0.92 / 0.93 / -1.3%
job_q56/duckdb:parquet 155260084 / 155470548 / -0.1% 180786007 / 177639432 / +1.8% 0.86 / 0.88 / -1.9%
job_q57/duckdb:parquet 204164536 / 206556394 / -1.2% 229876554 / 227541415 / +1.0% 0.89 / 0.91 / -2.2%
job_q58/duckdb:parquet 240043412 / 239293170 / +0.3% 264234907 / 259743374 / +1.7% 0.91 / 0.92 / -1.4%
job_q59/duckdb:parquet 224985842 / 225429244 / -0.2% 254335901 / 249448647 / +2.0% 0.88 / 0.90 / -2.1%
job_q60/duckdb:parquet 94079054 / 93091918 / +1.1% 112348711 / 108550662 / +3.5% 0.84 / 0.86 / -2.4%
job_q61/duckdb:parquet 76645742 / 76617058 / +0.0% 92778320 / 91494112 / +1.4% 0.83 / 0.84 / -1.3%
job_q62/duckdb:parquet 73075341 / 73395160 / -0.4% 88868053 / 90842320 / -2.2% 0.82 / 0.81 / +1.8%
job_q63/duckdb:parquet 90136522 / 90391954 / -0.3% 106295219 / 108331558 / -1.9% 0.85 / 0.83 / +1.6%
job_q64/duckdb:parquet 157203400 / 159560990 / -1.5% 185188471 / 181744247 / +1.9% 0.85 / 0.88 / -3.3%
job_q65/duckdb:parquet 111210828 / 111175928 / +0.0% 128181820 / 128110682 / +0.1% 0.87 / 0.87 / -0.0%
job_q66/duckdb:parquet 186921788 / 188124854 / -0.6% 210616295 / 211573084 / -0.5% 0.89 / 0.89 / -0.2%
job_q67/duckdb:parquet 176786440 / 154285230 / +14.6% 🔴 185202991 / 177816466 / +4.2% 0.95 / 0.87 / +10.0%
job_q68/duckdb:parquet 179783229 / 196018835 / -8.3% 210458185 / 211617446 / -0.5% 0.85 / 0.93 / -7.8%
job_q69/duckdb:parquet 310368845 / 305228118 / +1.7% 326187220 / 327827201 / -0.5% 0.95 / 0.93 / +2.2%
job_q70/duckdb:parquet 233442982 / 242679988 / -3.8% 268622256 / 264276331 / +1.6% 0.87 / 0.92 / -5.4%
job_q71/duckdb:parquet 201663836 / 199704177 / +1.0% 230715023 / 222379926 / +3.7% 0.87 / 0.90 / -2.7%
job_q72/duckdb:parquet 287863845 / 287514736 / +0.1% 304257968 / 304410677 / -0.1% 0.95 / 0.94 / +0.2%
job_q73/duckdb:parquet 195904720 / 196244184 / -0.2% 223665088 / 219303440 / +2.0% 0.88 / 0.89 / -2.1%
job_q74/duckdb:parquet 196174160 / 195317648 / +0.4% 220540613 / 220306766 / +0.1% 0.89 / 0.89 / +0.3%
job_q75/duckdb:parquet 224901684 / 227126140 / -1.0% 251818955 / 252744072 / -0.4% 0.89 / 0.90 / -0.6%
job_q76/duckdb:parquet 136301246 / 130983914 / +4.1% 156842301 / 155761228 / +0.7% 0.87 / 0.84 / +3.3%
job_q77/duckdb:parquet 126224986 / 130618930 / -3.4% 140763093 / 141451435 / -0.5% 0.90 / 0.92 / -2.9%
job_q78/duckdb:parquet 127614858 / 134528635 / -5.1% 146077030 / 156312342 / -6.5% 0.87 / 0.86 / +1.5%
job_q79/duckdb:parquet 259560184 / 269807797 / -3.8% 314017551 / 268310992 / +17.0% 🔴 0.83 / 1.01 / -17.8%
job_q80/duckdb:parquet 239336250 / 238020782 / +0.6% 272630428 / 264064609 / +3.2% 0.88 / 0.90 / -2.6%
job_q81/duckdb:parquet 364542507 / 361367470 / +0.9% 415563259 / 385150508 / +7.9% 0.88 / 0.94 / -6.5%
job_q82/duckdb:parquet 280103217 / 280814333 / -0.3% 299021569 / 301578859 / -0.8% 0.94 / 0.93 / +0.6%
job_q83/duckdb:parquet 125445140 / 118941739 / +5.5% 151479378 / 133380560 / +13.6% 🔴 0.83 / 0.89 / -7.1%
job_q84/duckdb:parquet 119845498 / 120280566 / -0.4% 154927444 / 136273213 / +13.7% 🔴 0.77 / 0.88 / -12.4%
job_q85/duckdb:parquet 142411643 / 152530647 / -6.6% 162160923 / 136483730 / +18.8% 🔴 0.88 / 1.12 / -21.4%
job_q86/duckdb:parquet 225984748 / 230737214 / -2.1% 276045939 / 245414339 / +12.5% 🔴 0.82 / 0.94 / -12.9%
job_q87/duckdb:parquet 209193000 / 204238382 / +2.4% 232628922 / 235429245 / -1.2% 0.90 / 0.87 / +3.7%
job_q88/duckdb:parquet 197685864 / 197057355 / +0.3% 234137214 / 220565683 / +6.2% 0.84 / 0.89 / -5.5%
job_q89/duckdb:parquet 173503840 / 165025394 / +5.1% 201686502 / 189146367 / +6.6% 0.86 / 0.87 / -1.4%
job_q90/duckdb:parquet 223265912 / 296836502 / -24.8% 🟢 254334540 / 257252539 / -1.1% 0.88 / 1.15 / -23.9%
job_q91/duckdb:parquet 257041722 / 257467984 / -0.2% 284279631 / 283662503 / +0.2% 0.90 / 0.91 / -0.4%
job_q92/duckdb:parquet 198758842 / 199320878 / -0.3% 227420332 / 225734970 / +0.7% 0.87 / 0.88 / -1.0%
job_q93/duckdb:parquet 240152782 / 241153459 / -0.4% 271239261 / 269106057 / +0.8% 0.89 / 0.90 / -1.2%
job_q94/duckdb:parquet 141223476 / 135066519 / +4.6% 163707527 / 150499209 / +8.8% 0.86 / 0.90 / -3.9%
job_q95/duckdb:parquet 124452364 / 125171950 / -0.6% 165291300 / 142889552 / +15.7% 🔴 0.75 / 0.88 / -14.0%
job_q96/duckdb:parquet 140648066 / 149669284 / -6.0% 160617020 / 163187924 / -1.6% 0.88 / 0.92 / -4.5%
job_q97/duckdb:parquet 260098823 / 257862948 / +0.9% 299329212 / 289944187 / +3.2% 0.87 / 0.89 / -2.3%
job_q98/duckdb:parquet 207334892 / 193108226 / +7.4% 221511231 / 300361745 / -26.3% 🟢 0.94 / 0.64 / +45.6%
job_q99/duckdb:parquet 243432134 / 235189824 / +3.5% 274384893 / 284187641 / -3.4% 0.89 / 0.83 / +7.2%
duckdb / duckdb / ns (1.002x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:duckdb 7617152 / 7681493 / -0.8% 17008437 / 15691179 / +8.4% 0.45 / 0.49 / -8.5%
job_q02/duckdb:duckdb 5904855 / 5611530 / +5.2% 13487858 / 12827930 / +5.1% 0.44 / 0.44 / +0.1%
job_q03/duckdb:duckdb 6251054 / 6245350 / +0.1% 14161539 / 13573823 / +4.3% 0.44 / 0.46 / -4.1%
job_q04/duckdb:duckdb 5681980 / 5714498 / -0.6% 13403246 / 12471597 / +7.5% 0.42 / 0.46 / -7.5%
job_q05/duckdb:duckdb 14408170 / 14423296 / -0.1% 24942143 / 23737205 / +5.1% 0.58 / 0.61 / -4.9%
job_q06/duckdb:duckdb 14070798 / 14205068 / -0.9% 24829333 / 23546020 / +5.5% 0.57 / 0.60 / -6.1%
job_q07/duckdb:duckdb 11100563 / 11024832 / +0.7% 20162766 / 19542901 / +3.2% 0.55 / 0.56 / -2.4%
job_q08/duckdb:duckdb 16478867 / 16466420 / +0.1% 27268861 / 26238242 / +3.9% 0.60 / 0.63 / -3.7%
job_q09/duckdb:duckdb 62940391 / 63366150 / -0.7% 91990127 / 86633191 / +6.2% 0.68 / 0.73 / -6.5%
job_q10/duckdb:duckdb 40054188 / 40091538 / -0.1% 71901234 / 68321828 / +5.2% 0.56 / 0.59 / -5.1%
job_q100/duckdb:duckdb 26254312 / 23550248 / +11.5% 🔴 43037817 / 39938410 / +7.8% 0.61 / 0.59 / +3.5%
job_q101/duckdb:duckdb 25244710 / 25062970 / +0.7% 48095706 / 49106581 / -2.1% 0.52 / 0.51 / +2.8%
job_q102/duckdb:duckdb 45141134 / 44519419 / +1.4% 71378748 / 66842503 / +6.8% 0.63 / 0.67 / -5.0%
job_q103/duckdb:duckdb 54194322 / 53562216 / +1.2% 83694626 / 80068213 / +4.5% 0.65 / 0.67 / -3.2%
job_q104/duckdb:duckdb 46016006 / 45700684 / +0.7% 70832182 / 67168967 / +5.5% 0.65 / 0.68 / -4.5%
job_q105/duckdb:duckdb 72975344 / 73734729 / -1.0% 103548577 / 98513282 / +5.1% 0.70 / 0.75 / -5.8%
job_q106/duckdb:duckdb 64114310 / 65016056 / -1.4% 97066673 / 91415788 / +6.2% 0.66 / 0.71 / -7.1%
job_q107/duckdb:duckdb 59166828 / 59411402 / -0.4% 86724583 / 84033724 / +3.2% 0.68 / 0.71 / -3.5%
job_q108/duckdb:duckdb 74397870 / 75281028 / -1.2% 106287534 / 104842578 / +1.4% 0.70 / 0.72 / -2.5%
job_q109/duckdb:duckdb 7075390 / 7125605 / -0.7% 15682370 / 15036214 / +4.3% 0.45 / 0.47 / -4.8%
job_q11/duckdb:duckdb 47036226 / 46951267 / +0.2% 84987628 / 82664715 / +2.8% 0.55 / 0.57 / -2.6%
job_q110/duckdb:duckdb 13733323 / 13816666 / -0.6% 23302359 / 22167675 / +5.1% 0.59 / 0.62 / -5.4%
job_q111/duckdb:duckdb 16004577 / 16097608 / -0.6% 27606357 / 26829414 / +2.9% 0.58 / 0.60 / -3.4%
job_q112/duckdb:duckdb 22015556 / 22096095 / -0.4% 34529724 / 31753237 / +8.7% 0.64 / 0.70 / -8.4%
job_q113/duckdb:duckdb 18279432 / 18356398 / -0.4% 30715184 / 28936959 / +6.1% 0.60 / 0.63 / -6.2%
job_q12/duckdb:duckdb 27322850 / 27546862 / -0.8% 37501241 / 35510194 / +5.6% 0.73 / 0.78 / -6.1%
job_q13/duckdb:duckdb 10077644 / 10002904 / +0.7% 19180757 / 17396529 / +10.3% 🔴 0.53 / 0.57 / -8.6%
job_q14/duckdb:duckdb 35757607 / 35654704 / +0.3% 46344775 / 44177289 / +4.9% 0.77 / 0.81 / -4.4%
job_q15/duckdb:duckdb 55603263 / 56091716 / -0.9% 87386672 / 85384828 / +2.3% 0.64 / 0.66 / -3.1%
job_q16/duckdb:duckdb 45614664 / 45774512 / -0.3% 76809070 / 71545160 / +7.4% 0.59 / 0.64 / -7.2%
job_q17/duckdb:duckdb 54664380 / 54838019 / -0.3% 81183000 / 78358012 / +3.6% 0.67 / 0.70 / -3.8%
job_q18/duckdb:duckdb 21242662 / 21362048 / -0.6% 43437866 / 40344028 / +7.7% 0.49 / 0.53 / -7.6%
job_q19/duckdb:duckdb 12155764 / 12070608 / +0.7% 20673186 / 21763462 / -5.0% 0.59 / 0.55 / +6.0%
job_q20/duckdb:duckdb 15213391 / 15459479 / -1.6% 32027975 / 32183741 / -0.5% 0.48 / 0.48 / -1.1%
job_q21/duckdb:duckdb 22383604 / 22231342 / +0.7% 33391520 / 31417364 / +6.3% 0.67 / 0.71 / -5.3%
job_q22/duckdb:duckdb 21465970 / 21586320 / -0.6% 42898750 / 41744795 / +2.8% 0.50 / 0.52 / -3.2%
job_q23/duckdb:duckdb 39924754 / 39927257 / -0.0% 56237733 / 54415544 / +3.3% 0.71 / 0.73 / -3.2%
job_q24/duckdb:duckdb 17410052 / 16718292 / +4.1% 33043223 / 30614244 / +7.9% 0.53 / 0.55 / -3.5%
job_q25/duckdb:duckdb 15710998 / 15327190 / +2.5% 29358174 / 27024436 / +8.6% 0.54 / 0.57 / -5.6%
job_q26/duckdb:duckdb 78420249 / 75873222 / +3.4% 130244000 / 115410782 / +12.9% 🔴 0.60 / 0.66 / -8.4%
job_q27/duckdb:duckdb 25956902 / 26434970 / -1.8% 43433669 / 40560136 / +7.1% 0.60 / 0.65 / -8.3%
job_q28/duckdb:duckdb 25663785 / 25007119 / +2.6% 42553542 / 38881988 / +9.4% 0.60 / 0.64 / -6.2%
job_q29/duckdb:duckdb 85076622 / 84640455 / +0.5% 97778646 / 96509782 / +1.3% 0.87 / 0.88 / -0.8%
job_q30/duckdb:duckdb 56347695 / 55876854 / +0.8% 70725676 / 67123158 / +5.4% 0.80 / 0.83 / -4.3%
job_q31/duckdb:duckdb 67499726 / 64795959 / +4.2% 91057941 / 84426570 / +7.9% 0.74 / 0.77 / -3.4%
job_q32/duckdb:duckdb 46947939 / 47007440 / -0.1% 70973822 / 65929998 / +7.7% 0.66 / 0.71 / -7.2%
job_q33/duckdb:duckdb 56066477 / 58241536 / -3.7% 77492224 / 74763187 / +3.7% 0.72 / 0.78 / -7.1%
job_q34/duckdb:duckdb 92268346 / 91672340 / +0.7% 113326113 / 111141938 / +2.0% 0.81 / 0.82 / -1.3%
job_q35/duckdb:duckdb 21653335 / 21585120 / +0.3% 39450389 / 37089089 / +6.4% 0.55 / 0.58 / -5.7%
job_q36/duckdb:duckdb 15272960 / 15641948 / -2.4% 32197109 / 28669746 / +12.3% 🔴 0.47 / 0.55 / -13.1%
job_q37/duckdb:duckdb 50372480 / 50172328 / +0.4% 73675158 / 70211919 / +4.9% 0.68 / 0.71 / -4.3%
job_q38/duckdb:duckdb 19070851 / 18358852 / +3.9% 33172951 / 31799349 / +4.3% 0.57 / 0.58 / -0.4%
job_q39/duckdb:duckdb 14444234 / 13941628 / +3.6% 26715820 / 25537616 / +4.6% 0.54 / 0.55 / -1.0%
job_q40/duckdb:duckdb 25502793 / 25326918 / +0.7% 36387303 / 35760771 / +1.8% 0.70 / 0.71 / -1.0%
job_q41/duckdb:duckdb 40187402 / 39633480 / +1.4% 50880682 / 50903896 / -0.0% 0.79 / 0.78 / +1.4%
job_q42/duckdb:duckdb 20256409 / 20238437 / +0.1% 31411286 / 29211511 / +7.5% 0.64 / 0.69 / -6.9%
job_q43/duckdb:duckdb 23740214 / 23760354 / -0.1% 35963757 / 34819893 / +3.3% 0.66 / 0.68 / -3.3%
job_q44/duckdb:duckdb 29294403 / 28562802 / +2.6% 41689283 / 37886374 / +10.0% 🔴 0.70 / 0.75 / -6.8%
job_q45/duckdb:duckdb 21910290 / 21935218 / -0.1% 34839376 / 32236663 / +8.1% 0.63 / 0.68 / -7.6%
job_q46/duckdb:duckdb 34507035 / 34229942 / +0.8% 47586318 / 44799137 / +6.2% 0.73 / 0.76 / -5.1%
job_q47/duckdb:duckdb 32162580 / 32006464 / +0.5% 45409457 / 43307647 / +4.9% 0.71 / 0.74 / -4.2%
job_q48/duckdb:duckdb 58119790 / 58524811 / -0.7% 71071480 / 69070846 / +2.9% 0.82 / 0.85 / -3.5%
job_q49/duckdb:duckdb 53244718 / 52639501 / +1.1% 68096172 / 64556683 / +5.5% 0.78 / 0.82 / -4.1%
job_q50/duckdb:duckdb 26913728 / 27117544 / -0.8% 40264151 / 36209592 / +11.2% 🔴 0.67 / 0.75 / -10.7%
job_q51/duckdb:duckdb 38879764 / 39312346 / -1.1% 51589772 / 48781842 / +5.8% 0.75 / 0.81 / -6.5%
job_q52/duckdb:duckdb 34793636 / 34661835 / +0.4% 49838307 / 46258054 / +7.7% 0.70 / 0.75 / -6.8%
job_q53/duckdb:duckdb 21924057 / 21770146 / +0.7% 39022503 / 35083627 / +11.2% 🔴 0.56 / 0.62 / -9.5%
job_q54/duckdb:duckdb 58703324 / 58415440 / +0.5% 74685808 / 72350497 / +3.2% 0.79 / 0.81 / -2.6%
job_q55/duckdb:duckdb 65099676 / 66562202 / -2.2% 82474948 / 79827674 / +3.3% 0.79 / 0.83 / -5.3%
job_q56/duckdb:duckdb 24993441 / 24800658 / +0.8% 46787155 / 43741286 / +7.0% 0.53 / 0.57 / -5.8%
job_q57/duckdb:duckdb 111593632 / 111744736 / -0.1% 132410859 / 130119689 / +1.8% 0.84 / 0.86 / -1.9%
job_q58/duckdb:duckdb 44719328 / 45124707 / -0.9% 66979996 / 64441889 / +3.9% 0.67 / 0.70 / -4.7%
job_q59/duckdb:duckdb 42512758 / 41960612 / +1.3% 64448154 / 63642514 / +1.3% 0.66 / 0.66 / +0.0%
job_q60/duckdb:duckdb 47148517 / 48284748 / -2.4% 66478396 / 64212778 / +3.5% 0.71 / 0.75 / -5.7%
job_q61/duckdb:duckdb 54489904 / 53684842 / +1.5% 72459894 / 69603122 / +4.1% 0.75 / 0.77 / -2.5%
job_q62/duckdb:duckdb 52388336 / 52319268 / +0.1% 69900036 / 68075133 / +2.7% 0.75 / 0.77 / -2.5%
job_q63/duckdb:duckdb 58348919 / 58335176 / +0.0% 76073148 / 74444497 / +2.2% 0.77 / 0.78 / -2.1%
job_q64/duckdb:duckdb 46891882 / 46904630 / -0.0% 65153332 / 64158129 / +1.6% 0.72 / 0.73 / -1.6%
job_q65/duckdb:duckdb 74545387 / 74218444 / +0.4% 91189150 / 89212222 / +2.2% 0.82 / 0.83 / -1.7%
job_q66/duckdb:duckdb 53397278 / 53614345 / -0.4% 82647396 / 76675286 / +7.8% 0.65 / 0.70 / -7.6%
job_q67/duckdb:duckdb 24081254 / 24221894 / -0.6% 46855132 / 46409629 / +1.0% 0.51 / 0.52 / -1.5%
job_q68/duckdb:duckdb 52144576 / 53745734 / -3.0% 76378847 / 73970538 / +3.3% 0.68 / 0.73 / -6.0%
job_q69/duckdb:duckdb 76850534 / 74276902 / +3.5% 97095500 / 90967349 / +6.7% 0.79 / 0.82 / -3.1%
job_q70/duckdb:duckdb 47404084 / 46257324 / +2.5% 68355850 / 61682147 / +10.8% 🔴 0.69 / 0.75 / -7.5%
job_q71/duckdb:duckdb 79842376 / 79728048 / +0.1% 100365925 / 99406823 / +1.0% 0.80 / 0.80 / -0.8%
job_q72/duckdb:duckdb 108672544 / 109633590 / -0.9% 127519902 / 125153085 / +1.9% 0.85 / 0.88 / -2.7%
job_q73/duckdb:duckdb 64220019 / 63102523 / +1.8% 86054791 / 84512297 / +1.8% 0.75 / 0.75 / -0.1%
job_q74/duckdb:duckdb 61530283 / 62092166 / -0.9% 86542683 / 82012839 / +5.5% 0.71 / 0.76 / -6.1%
job_q75/duckdb:duckdb 54380445 / 54369072 / +0.0% 76403740 / 73742477 / +3.6% 0.71 / 0.74 / -3.5%
job_q76/duckdb:duckdb 24181778 / 24836801 / -2.6% 41009353 / 39750129 / +3.2% 0.59 / 0.62 / -5.6%
job_q77/duckdb:duckdb 22101650 / 22199125 / -0.4% 37392367 / 36303491 / +3.0% 0.59 / 0.61 / -3.3%
job_q78/duckdb:duckdb 24582392 / 24226987 / +1.5% 44367876 / 40090301 / +10.7% 🔴 0.55 / 0.60 / -8.3%
job_q79/duckdb:duckdb 63579776 / 62567032 / +1.6% 79757400 / 76222324 / +4.6% 0.80 / 0.82 / -2.9%
job_q80/duckdb:duckdb 46672344 / 46921764 / -0.5% 64311747 / 59483402 / +8.1% 0.73 / 0.79 / -8.0%
job_q81/duckdb:duckdb 102393520 / 101355100 / +1.0% 121680112 / 116430951 / +4.5% 0.84 / 0.87 / -3.3%
job_q82/duckdb:duckdb 142790008 / 143043526 / -0.2% 158876970 / 158231556 / +0.4% 0.90 / 0.90 / -0.6%
job_q83/duckdb:duckdb 47799562 / 47403952 / +0.8% 63406219 / 59975795 / +5.7% 0.75 / 0.79 / -4.6%
job_q84/duckdb:duckdb 26558608 / 27800762 / -4.5% 41876872 / 39104319 / +7.1% 0.63 / 0.71 / -10.8%
job_q85/duckdb:duckdb 49266438 / 48854436 / +0.8% 65097539 / 62310007 / +4.5% 0.76 / 0.78 / -3.5%
job_q86/duckdb:duckdb 55183582 / 54874612 / +0.6% 78391975 / 73621390 / +6.5% 0.70 / 0.75 / -5.6%
job_q87/duckdb:duckdb 30655616 / 33113907 / -7.4% 56545518 / 48243863 / +17.2% 🔴 0.54 / 0.69 / -21.0%
job_q88/duckdb:duckdb 47953216 / 48652387 / -1.4% 76354552 / 72820568 / +4.9% 0.63 / 0.67 / -6.0%
job_q89/duckdb:duckdb 25616392 / 25762962 / -0.6% 49124985 / 46012400 / +6.8% 0.52 / 0.56 / -6.9%
job_q90/duckdb:duckdb 58328326 / 58957228 / -1.1% 84042958 / 82890635 / +1.4% 0.69 / 0.71 / -2.4%
job_q91/duckdb:duckdb 54084775 / 54765079 / -1.2% 86661098 / 80667547 / +7.4% 0.62 / 0.68 / -8.1%
job_q92/duckdb:duckdb 34290438 / 34287720 / +0.0% 60407793 / 57794509 / +4.5% 0.57 / 0.59 / -4.3%
job_q93/duckdb:duckdb 78484110 / 79034349 / -0.7% 108614119 / 104971182 / +3.5% 0.72 / 0.75 / -4.0%
job_q94/duckdb:duckdb 22504620 / 22558980 / -0.2% 39205237 / 36504287 / +7.4% 0.57 / 0.62 / -7.1%
job_q95/duckdb:duckdb 21514608 / 20533786 / +4.8% 36872325 / 34690539 / +6.3% 0.58 / 0.59 / -1.4%
job_q96/duckdb:duckdb 23272500 / 22684840 / +2.6% 39105527 / 36412456 / +7.4% 0.60 / 0.62 / -4.5%
job_q97/duckdb:duckdb 86912760 / 85754479 / +1.4% 104798499 / 100172000 / +4.6% 0.83 / 0.86 / -3.1%
job_q98/duckdb:duckdb 45399236 / 45857057 / -1.0% 62776449 / 60635618 / +3.5% 0.72 / 0.76 / -4.4%
job_q99/duckdb:duckdb 77566712 / 78225648 / -0.8% 94893995 / 92077168 / +3.1% 0.82 / 0.85 / -3.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR fa6cf9b2 vs base 32730c9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.026x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 34959798 / 35521635 / -1.6% 60331936 / 59684971 / +1.1% 0.58 / 0.60 / -2.6%
tpcds_q02/datafusion:vortex-file-compressed 49562740 / 50387084 / -1.6% 74351394 / 72851913 / +2.1% 0.67 / 0.69 / -3.6%
tpcds_q03/datafusion:vortex-file-compressed 22085146 / 22065906 / +0.1% 47548711 / 45923324 / +3.5% 0.46 / 0.48 / -3.3%
tpcds_q04/datafusion:vortex-file-compressed 297151818 / 296112666 / +0.4% 353112441 / 350653669 / +0.7% 0.84 / 0.84 / -0.3%
tpcds_q05/datafusion:vortex-file-compressed 72928854 / 72032750 / +1.2% 101680038 / 109426209 / -7.1% 0.72 / 0.66 / +9.0%
tpcds_q06/datafusion:vortex-file-compressed 45256970 / 44636538 / +1.4% 73857505 / 69349377 / +6.5% 0.61 / 0.64 / -4.8%
tpcds_q07/datafusion:vortex-file-compressed 44548752 / 41790226 / +6.6% 78860174 / 76805516 / +2.7% 0.56 / 0.54 / +3.8%
tpcds_q08/datafusion:vortex-file-compressed 30938476 / 31156392 / -0.7% 54246449 / 54759876 / -0.9% 0.57 / 0.57 / +0.2%
tpcds_q09/datafusion:vortex-file-compressed 43348564 / 45188218 / -4.1% 75703159 / 73454372 / +3.1% 0.57 / 0.62 / -6.9%
tpcds_q10/datafusion:vortex-file-compressed 40819179 / 39439662 / +3.5% 68021050 / 64181619 / +6.0% 0.60 / 0.61 / -2.3%
tpcds_q11/datafusion:vortex-file-compressed 176594656 / 176831292 / -0.1% 219110124 / 218138529 / +0.4% 0.81 / 0.81 / -0.6%
tpcds_q12/datafusion:vortex-file-compressed 17836922 / 17729052 / +0.6% 38948863 / 37327085 / +4.3% 0.46 / 0.47 / -3.6%
tpcds_q13/datafusion:vortex-file-compressed 39853278 / 40015009 / -0.4% 85032540 / 83550753 / +1.8% 0.47 / 0.48 / -2.1%
tpcds_q14/datafusion:vortex-file-compressed 238680074 / 239531691 / -0.4% 289699263 / 279125836 / +3.8% 0.82 / 0.86 / -4.0%
tpcds_q15/datafusion:vortex-file-compressed 41165654 / 38288980 / +7.5% 61334043 / 60441909 / +1.5% 0.67 / 0.63 / +5.9%
tpcds_q16/datafusion:vortex-file-compressed 23711884 / 23657399 / +0.2% 41928970 / 41049803 / +2.1% 0.57 / 0.58 / -1.9%
tpcds_q17/datafusion:vortex-file-compressed 67428972 / 66702003 / +1.1% 92268416 / 92561184 / -0.3% 0.73 / 0.72 / +1.4%
tpcds_q18/datafusion:vortex-file-compressed 68604782 / 68381753 / +0.3% 95607943 / 95965372 / -0.4% 0.72 / 0.71 / +0.7%
tpcds_q19/datafusion:vortex-file-compressed 25729579 / 25394296 / +1.3% 55767704 / 51341127 / +8.6% 0.46 / 0.49 / -6.7%
tpcds_q20/datafusion:vortex-file-compressed 23124534 / 23186022 / -0.3% 41840193 / 39680629 / +5.4% 0.55 / 0.58 / -5.4%
tpcds_q21/datafusion:vortex-file-compressed 45700577 / 46605586 / -1.9% 76375375 / 64052678 / +19.2% 🔴 0.60 / 0.73 / -17.8%
tpcds_q22/datafusion:vortex-file-compressed 443690924 / 446452262 / -0.6% 466364079 / 467529852 / -0.2% 0.95 / 0.95 / -0.4%
tpcds_q23/datafusion:vortex-file-compressed 296079626 / 297951152 / -0.6% 349826089 / 342723576 / +2.1% 0.85 / 0.87 / -2.6%
tpcds_q24/datafusion:vortex-file-compressed 121967733 / 119534939 / +2.0% 160036437 / 159451201 / +0.4% 0.76 / 0.75 / +1.7%
tpcds_q25/datafusion:vortex-file-compressed 65294474 / 65401108 / -0.2% 102670877 / 95089238 / +8.0% 0.64 / 0.69 / -7.5%
tpcds_q26/datafusion:vortex-file-compressed 37416350 / 37146477 / +0.7% 61242485 / 58878192 / +4.0% 0.61 / 0.63 / -3.2%
tpcds_q27/datafusion:vortex-file-compressed 75598438 / 77735921 / -2.7% 114440153 / 110466560 / +3.6% 0.66 / 0.70 / -6.1%
tpcds_q28/datafusion:vortex-file-compressed 43599889 / 42139954 / +3.5% 90750087 / 84587901 / +7.3% 0.48 / 0.50 / -3.6%
tpcds_q29/datafusion:vortex-file-compressed 68087246 / 68651474 / -0.8% 104378849 / 102385530 / +1.9% 0.65 / 0.67 / -2.7%
tpcds_q30/datafusion:vortex-file-compressed 51550492 / 51656554 / -0.2% 79501969 / 79921164 / -0.5% 0.65 / 0.65 / +0.3%
tpcds_q31/datafusion:vortex-file-compressed 207820556 / 208852640 / -0.5% 237240301 / 238661080 / -0.6% 0.88 / 0.88 / +0.1%
tpcds_q32/datafusion:vortex-file-compressed 15289791 / 15283665 / +0.0% 32964337 / 31657180 / +4.1% 0.46 / 0.48 / -3.9%
tpcds_q33/datafusion:vortex-file-compressed 35619175 / 36158330 / -1.5% 66782682 / 68525270 / -2.5% 0.53 / 0.53 / +1.1%
tpcds_q34/datafusion:vortex-file-compressed 44881322 / 44855052 / +0.1% 72754097 / 71232663 / +2.1% 0.62 / 0.63 / -2.0%
tpcds_q35/datafusion:vortex-file-compressed 94534466 / 94972847 / -0.5% 120011414 / 122635548 / -2.1% 0.79 / 0.77 / +1.7%
tpcds_q36/datafusion:vortex-file-compressed 72209822 / 71308994 / +1.3% 106159159 / 100490592 / +5.6% 0.68 / 0.71 / -4.1%
tpcds_q37/datafusion:vortex-file-compressed 24974204 / 25650577 / -2.6% 57571898 / 40188455 / +43.3% 🔴 0.43 / 0.64 / -32.0%
tpcds_q38/datafusion:vortex-file-compressed 80822591 / 80641340 / +0.2% 109253593 / 110677881 / -1.3% 0.74 / 0.73 / +1.5%
tpcds_q39/datafusion:vortex-file-compressed 826793610 / 834584340 / -0.9% 852999434 / 854784873 / -0.2% 0.97 / 0.98 / -0.7%
tpcds_q40/datafusion:vortex-file-compressed 28511223 / 28736350 / -0.8% 48796006 / 49201724 / -0.8% 0.58 / 0.58 / +0.0%
tpcds_q41/datafusion:vortex-file-compressed 20093072 / 20002064 / +0.5% 32609005 / 31696830 / +2.9% 0.62 / 0.63 / -2.4%
tpcds_q42/datafusion:vortex-file-compressed 16754533 / 16839938 / -0.5% 39001809 / 38567944 / +1.1% 0.43 / 0.44 / -1.6%
tpcds_q43/datafusion:vortex-file-compressed 19209487 / 19570556 / -1.8% 40514590 / 40028447 / +1.2% 0.47 / 0.49 / -3.0%
tpcds_q44/datafusion:vortex-file-compressed 43689051 / 42651706 / +2.4% 74163822 / 72358013 / +2.5% 0.59 / 0.59 / -0.1%
tpcds_q45/datafusion:vortex-file-compressed 43546146 / 43015801 / +1.2% 65615886 / 60579942 / +8.3% 0.66 / 0.71 / -6.5%
tpcds_q46/datafusion:vortex-file-compressed 75278159 / 76868674 / -2.1% 103256272 / 110330762 / -6.4% 0.73 / 0.70 / +4.6%
tpcds_q47/datafusion:vortex-file-compressed 181616999 / 180674888 / +0.5% 226077519 / 223293379 / +1.2% 0.80 / 0.81 / -0.7%
tpcds_q48/datafusion:vortex-file-compressed 37793528 / 37805882 / -0.0% 71878651 / 69689161 / +3.1% 0.53 / 0.54 / -3.1%
tpcds_q49/datafusion:vortex-file-compressed 80905614 / 81936059 / -1.3% 120117605 / 115323954 / +4.2% 0.67 / 0.71 / -5.2%
tpcds_q50/datafusion:vortex-file-compressed 57750465 / 56677298 / +1.9% 84490572 / 83871847 / +0.7% 0.68 / 0.68 / +1.1%
tpcds_q51/datafusion:vortex-file-compressed 248335272 / 249384338 / -0.4% 278271483 / 283052893 / -1.7% 0.89 / 0.88 / +1.3%
tpcds_q52/datafusion:vortex-file-compressed 17152503 / 16937946 / +1.3% 43275706 / 39914455 / +8.4% 0.40 / 0.42 / -6.6%
tpcds_q53/datafusion:vortex-file-compressed 24869612 / 25749014 / -3.4% 50448234 / 50721315 / -0.5% 0.49 / 0.51 / -2.9%
tpcds_q54/datafusion:vortex-file-compressed 60475502 / 60381968 / +0.2% 91329250 / 87779169 / +4.0% 0.66 / 0.69 / -3.7%
tpcds_q55/datafusion:vortex-file-compressed 16997076 / 17126860 / -0.8% 39028922 / 37593891 / +3.8% 0.44 / 0.46 / -4.4%
tpcds_q56/datafusion:vortex-file-compressed 34965514 / 34459594 / +1.5% 65550207 / 64698264 / +1.3% 0.53 / 0.53 / +0.1%
tpcds_q57/datafusion:vortex-file-compressed 130815794 / 131971333 / -0.9% 161937901 / 159751853 / +1.4% 0.81 / 0.83 / -2.2%
tpcds_q58/datafusion:vortex-file-compressed 50341328 / 50991188 / -1.3% 84583353 / 84401361 / +0.2% 0.60 / 0.60 / -1.5%
tpcds_q59/datafusion:vortex-file-compressed 56862709 / 56095160 / +1.4% 84548492 / 83035539 / +1.8% 0.67 / 0.68 / -0.4%
tpcds_q60/datafusion:vortex-file-compressed 35555868 / 37002646 / -3.9% 68992833 / 65719595 / +5.0% 0.52 / 0.56 / -8.5%
tpcds_q61/datafusion:vortex-file-compressed 49414276 / 50205772 / -1.6% 71059628 / 76195561 / -6.7% 0.70 / 0.66 / +5.5%
tpcds_q62/datafusion:vortex-file-compressed 20264500 / 19218269 / +5.4% 42105283 / 40068705 / +5.1% 0.48 / 0.48 / +0.3%
tpcds_q63/datafusion:vortex-file-compressed 24242805 / 24873638 / -2.5% 50724943 / 49812114 / +1.8% 0.48 / 0.50 / -4.3%
tpcds_q64/datafusion:vortex-file-compressed 335901527 / 337913970 / -0.6% 393802745 / 414361592 / -5.0% 0.85 / 0.82 / +4.6%
tpcds_q65/datafusion:vortex-file-compressed 75877446 / 76297924 / -0.6% 115827330 / 112080721 / +3.3% 0.66 / 0.68 / -3.8%
tpcds_q66/datafusion:vortex-file-compressed 52235575 / 52532332 / -0.6% 79691062 / 73819260 / +8.0% 0.66 / 0.71 / -7.9%
tpcds_q67/datafusion:vortex-file-compressed 426234024 / 423455544 / +0.7% 515643640 / 520666488 / -1.0% 0.83 / 0.81 / +1.6%
tpcds_q68/datafusion:vortex-file-compressed 69412966 / 69488770 / -0.1% 95457481 / 98389968 / -3.0% 0.73 / 0.71 / +3.0%
tpcds_q69/datafusion:vortex-file-compressed 38498646 / 38050714 / +1.2% 64984011 / 62182387 / +4.5% 0.59 / 0.61 / -3.2%
tpcds_q70/datafusion:vortex-file-compressed 196622400 / 196911744 / -0.1% 226781714 / 225545613 / +0.5% 0.87 / 0.87 / -0.7%
tpcds_q71/datafusion:vortex-file-compressed 28645273 / 27559023 / +3.9% 59541948 / 56263398 / +5.8% 0.48 / 0.49 / -1.8%
tpcds_q72/datafusion:vortex-file-compressed 1610527414 / 1563438738 / +3.0% 1636830619 / 1628297002 / +0.5% 0.98 / 0.96 / +2.5%
tpcds_q73/datafusion:vortex-file-compressed 40638613 / 41133626 / -1.2% 67593846 / 65515603 / +3.2% 0.60 / 0.63 / -4.2%
tpcds_q74/datafusion:vortex-file-compressed 137392164 / 137341692 / +0.0% 171102479 / 169066117 / +1.2% 0.80 / 0.81 / -1.2%
tpcds_q75/datafusion:vortex-file-compressed 161826014 / 157042286 / +3.0% 199416681 / 194170633 / +2.7% 0.81 / 0.81 / +0.3%
tpcds_q76/datafusion:vortex-file-compressed 35115728 / 36120736 / -2.8% 70952072 / 71480006 / -0.7% 0.49 / 0.51 / -2.1%
tpcds_q77/datafusion:vortex-file-compressed 58470048 / 56788880 / +3.0% 89929286 / 87233792 / +3.1% 0.65 / 0.65 / -0.1%
tpcds_q78/datafusion:vortex-file-compressed 142949122 / 142898356 / +0.0% 195009199 / 188636134 / +3.4% 0.73 / 0.76 / -3.2%
tpcds_q79/datafusion:vortex-file-compressed 56636368 / 56187678 / +0.8% 84475462 / 84413440 / +0.1% 0.67 / 0.67 / +0.7%
tpcds_q80/datafusion:vortex-file-compressed 83688733 / 83869578 / -0.2% 128198559 / 125516337 / +2.1% 0.65 / 0.67 / -2.3%
tpcds_q81/datafusion:vortex-file-compressed 56013435 / 55281264 / +1.3% 83630439 / 82452700 / +1.4% 0.67 / 0.67 / -0.1%
tpcds_q82/datafusion:vortex-file-compressed 32896325 / 32390003 / +1.6% 50516541 / 45363132 / +11.4% 🔴 0.65 / 0.71 / -8.8%
tpcds_q83/datafusion:vortex-file-compressed 42092380 / 42939380 / -2.0% 66767233 / 65786574 / +1.5% 0.63 / 0.65 / -3.4%
tpcds_q84/datafusion:vortex-file-compressed 12725514 / 12914254 / -1.5% 31399688 / 30326922 / +3.5% 0.41 / 0.43 / -4.8%
tpcds_q85/datafusion:vortex-file-compressed 59769050 / 59113857 / +1.1% 89350540 / 87407002 / +2.2% 0.67 / 0.68 / -1.1%
tpcds_q86/datafusion:vortex-file-compressed 18761374 / 18650792 / +0.6% 39723965 / 37528261 / +5.9% 0.47 / 0.50 / -5.0%
tpcds_q87/datafusion:vortex-file-compressed 80688841 / 80498189 / +0.2% 108554273 / 107544520 / +0.9% 0.74 / 0.75 / -0.7%
tpcds_q88/datafusion:vortex-file-compressed 64379786 / 65661388 / -2.0% 101562758 / 101046953 / +0.5% 0.63 / 0.65 / -2.4%
tpcds_q89/datafusion:vortex-file-compressed 28589996 / 28515915 / +0.3% 53409571 / 54211780 / -1.5% 0.54 / 0.53 / +1.8%
tpcds_q90/datafusion:vortex-file-compressed 13755778 / 13400814 / +2.6% 33388389 / 32513842 / +2.7% 0.41 / 0.41 / -0.0%
tpcds_q91/datafusion:vortex-file-compressed 19624200 / 19116420 / +2.7% 43016293 / 40797696 / +5.4% 0.46 / 0.47 / -2.6%
tpcds_q92/datafusion:vortex-file-compressed 15080284 / 15504128 / -2.7% 36621020 / 35450891 / +3.3% 0.41 / 0.44 / -5.8%
tpcds_q93/datafusion:vortex-file-compressed 54611907 / 60035770 / -9.0% 91370161 / 93796029 / -2.6% 0.60 / 0.64 / -6.6%
tpcds_q94/datafusion:vortex-file-compressed 21227160 / 21365032 / -0.6% 45254827 / 43208504 / +4.7% 0.47 / 0.49 / -5.1%
tpcds_q95/datafusion:vortex-file-compressed 98902898 / 95940082 / +3.1% 128378585 / 123134015 / +4.3% 0.77 / 0.78 / -1.1%
tpcds_q96/datafusion:vortex-file-compressed 13336144 / 13015662 / +2.5% 31539160 / 33014480 / -4.5% 0.42 / 0.39 / +7.3%
tpcds_q97/datafusion:vortex-file-compressed 40128976 / 41173610 / -2.5% 66388690 / 68311315 / -2.8% 0.60 / 0.60 / +0.3%
tpcds_q98/datafusion:vortex-file-compressed 23112210 / 22790756 / +1.4% 49671984 / 48260068 / +2.9% 0.47 / 0.47 / -1.5%
tpcds_q99/datafusion:vortex-file-compressed 30006326 / 29695441 / +1.0% 48049818 / 47010663 / +2.2% 0.62 / 0.63 / -1.1%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59554666 / 59526398 / +0.0% 80902465 / 79538725 / +1.7% 0.74 / 0.75 / -1.6%
tpcds_q02/datafusion:parquet 69129956 / 68199126 / +1.4% 89871005 / 92698460 / -3.1% 0.77 / 0.74 / +4.6%
tpcds_q03/datafusion:parquet 28752009 / 28024787 / +2.6% 50487064 / 51307662 / -1.6% 0.57 / 0.55 / +4.3%
tpcds_q04/datafusion:parquet 646864492 / 642588548 / +0.7% 705601723 / 704105116 / +0.2% 0.92 / 0.91 / +0.5%
tpcds_q05/datafusion:parquet 82668000 / 81843776 / +1.0% 110937892 / 113102032 / -1.9% 0.75 / 0.72 / +3.0%
tpcds_q06/datafusion:parquet 91710431 / 91190610 / +0.6% 114932401 / 113689962 / +1.1% 0.80 / 0.80 / -0.5%
tpcds_q07/datafusion:parquet 101761529 / 100394794 / +1.4% 140497578 / 129347483 / +8.6% 0.72 / 0.78 / -6.7%
tpcds_q08/datafusion:parquet 48086558 / 48573220 / -1.0% 76536492 / 76947097 / -0.5% 0.63 / 0.63 / -0.5%
tpcds_q09/datafusion:parquet 75073193 / 76740452 / -2.2% 103143679 / 99542680 / +3.6% 0.73 / 0.77 / -5.6%
tpcds_q10/datafusion:parquet 61831470 / 63221852 / -2.2% 85477548 / 90749319 / -5.8% 0.72 / 0.70 / +3.8%
tpcds_q11/datafusion:parquet 410901768 / 406868302 / +1.0% 454280723 / 451447848 / +0.6% 0.90 / 0.90 / +0.4%
tpcds_q12/datafusion:parquet 39753697 / 39671192 / +0.2% 58140142 / 57073627 / +1.9% 0.68 / 0.70 / -1.6%
tpcds_q13/datafusion:parquet 85755812 / 87848614 / -2.4% 130801212 / 132161929 / -1.0% 0.66 / 0.66 / -1.4%
tpcds_q14/datafusion:parquet 387038580 / 378950914 / +2.1% 403110720 / 424459446 / -5.0% 0.96 / 0.89 / +7.5%
tpcds_q15/datafusion:parquet 50556876 / 50674312 / -0.2% 72789344 / 71390243 / +2.0% 0.69 / 0.71 / -2.1%
tpcds_q16/datafusion:parquet 45259286 / 44812125 / +1.0% 62738445 / 62501639 / +0.4% 0.72 / 0.72 / +0.6%
tpcds_q17/datafusion:parquet 138183795 / 135460590 / +2.0% 175364782 / 173777242 / +0.9% 0.79 / 0.78 / +1.1%
tpcds_q18/datafusion:parquet 108726384 / 108512032 / +0.2% 143250303 / 138371286 / +3.5% 0.76 / 0.78 / -3.2%
tpcds_q19/datafusion:parquet 48208529 / 49149885 / -1.9% 76420207 / 73011227 / +4.7% 0.63 / 0.67 / -6.3%
tpcds_q20/datafusion:parquet 41312590 / 41666718 / -0.8% 55100718 / 55113648 / -0.0% 0.75 / 0.76 / -0.8%
tpcds_q21/datafusion:parquet 61356314 / 61706876 / -0.6% 73689446 / 73012416 / +0.9% 0.83 / 0.85 / -1.5%
tpcds_q22/datafusion:parquet 463483041 / 462847012 / +0.1% 478686114 / 479351488 / -0.1% 0.97 / 0.97 / +0.3%
tpcds_q23/datafusion:parquet 360846179 / 366901299 / -1.7% 422446415 / 419785146 / +0.6% 0.85 / 0.87 / -2.3%
tpcds_q24/datafusion:parquet 241312878 / 243712396 / -1.0% 280476774 / 279201354 / +0.5% 0.86 / 0.87 / -1.4%
tpcds_q25/datafusion:parquet 143501088 / 145199201 / -1.2% 188203775 / 185912070 / +1.2% 0.76 / 0.78 / -2.4%
tpcds_q26/datafusion:parquet 54777766 / 55745687 / -1.7% 78836450 / 78674432 / +0.2% 0.69 / 0.71 / -1.9%
tpcds_q27/datafusion:parquet 209759138 / 204571720 / +2.5% 232801272 / 229799624 / +1.3% 0.90 / 0.89 / +1.2%
tpcds_q28/datafusion:parquet 88623358 / 87197050 / +1.6% 118470593 / 111586376 / +6.2% 0.75 / 0.78 / -4.3%
tpcds_q29/datafusion:parquet 145636642 / 144619728 / +0.7% 178325929 / 179627956 / -0.7% 0.82 / 0.81 / +1.4%
tpcds_q30/datafusion:parquet 99102153 / 97969877 / +1.2% 120540312 / 120847845 / -0.3% 0.82 / 0.81 / +1.4%
tpcds_q31/datafusion:parquet 319535350 / 316614563 / +0.9% 347994504 / 345458638 / +0.7% 0.92 / 0.92 / +0.2%
tpcds_q32/datafusion:parquet 29522628 / 29161988 / +1.2% 44002711 / 44609948 / -1.4% 0.67 / 0.65 / +2.6%
tpcds_q33/datafusion:parquet 54549518 / 52220324 / +4.5% 78866184 / 76629619 / +2.9% 0.69 / 0.68 / +1.5%
tpcds_q34/datafusion:parquet 63301755 / 62990655 / +0.5% 86700051 / 90614969 / -4.3% 0.73 / 0.70 / +5.0%
tpcds_q35/datafusion:parquet 126314582 / 125096514 / +1.0% 149773775 / 145575643 / +2.9% 0.84 / 0.86 / -1.9%
tpcds_q36/datafusion:parquet 99494122 / 97149540 / +2.4% 128430072 / 123037866 / +4.4% 0.77 / 0.79 / -1.9%
tpcds_q37/datafusion:parquet 49266339 / 50626862 / -2.7% 64636100 / 68148664 / -5.2% 0.76 / 0.74 / +2.6%
tpcds_q38/datafusion:parquet 122281199 / 123545886 / -1.0% 142685393 / 144911922 / -1.5% 0.86 / 0.85 / +0.5%
tpcds_q39/datafusion:parquet 847019546 / 846271242 / +0.1% 862866679 / 871817320 / -1.0% 0.98 / 0.97 / +1.1%
tpcds_q40/datafusion:parquet 34819299 / 35027534 / -0.6% 56122115 / 56581246 / -0.8% 0.62 / 0.62 / +0.2%
tpcds_q41/datafusion:parquet 31442579 / 32717370 / -3.9% 43062042 / 43793502 / -1.7% 0.73 / 0.75 / -2.3%
tpcds_q42/datafusion:parquet 25625412 / 26580264 / -3.6% 48536323 / 45691092 / +6.2% 0.53 / 0.58 / -9.2%
tpcds_q43/datafusion:parquet 26865774 / 27267492 / -1.5% 48811849 / 48865859 / -0.1% 0.55 / 0.56 / -1.4%
tpcds_q44/datafusion:parquet 66093216 / 65290830 / +1.2% 90902805 / 85437033 / +6.4% 0.73 / 0.76 / -4.9%
tpcds_q45/datafusion:parquet 65598540 / 65963415 / -0.6% 90395006 / 86385724 / +4.6% 0.73 / 0.76 / -5.0%
tpcds_q46/datafusion:parquet 107459730 / 107016059 / +0.4% 144093772 / 142682171 / +1.0% 0.75 / 0.75 / -0.6%
tpcds_q47/datafusion:parquet 237036178 / 235415582 / +0.7% 276339628 / 275893007 / +0.2% 0.86 / 0.85 / +0.5%
tpcds_q48/datafusion:parquet 78350482 / 78287644 / +0.1% 108948357 / 105822851 / +3.0% 0.72 / 0.74 / -2.8%
tpcds_q49/datafusion:parquet 113808652 / 114741914 / -0.8% 149582448 / 157758674 / -5.2% 0.76 / 0.73 / +4.6%
tpcds_q50/datafusion:parquet 90494523 / 92207674 / -1.9% 127104434 / 123302705 / +3.1% 0.71 / 0.75 / -4.8%
tpcds_q51/datafusion:parquet 255165757 / 255805316 / -0.3% 278944882 / 282193170 / -1.2% 0.91 / 0.91 / +0.9%
tpcds_q52/datafusion:parquet 27247436 / 26232364 / +3.9% 46474939 / 48172254 / -3.5% 0.59 / 0.54 / +7.7%
tpcds_q53/datafusion:parquet 36103758 / 36306796 / -0.6% 60026295 / 57108481 / +5.1% 0.60 / 0.64 / -5.4%
tpcds_q54/datafusion:parquet 86971726 / 86826034 / +0.2% 108993096 / 109005484 / -0.0% 0.80 / 0.80 / +0.2%
tpcds_q55/datafusion:parquet 26434984 / 25548756 / +3.5% 45801853 / 46424165 / -1.3% 0.58 / 0.55 / +4.9%
tpcds_q56/datafusion:parquet 51373618 / 51837646 / -0.9% 75670512 / 73156110 / +3.4% 0.68 / 0.71 / -4.2%
tpcds_q57/datafusion:parquet 172922509 / 172020622 / +0.5% 194711993 / 193283758 / +0.7% 0.89 / 0.89 / -0.2%
tpcds_q58/datafusion:parquet 93748928 / 97921952 / -4.3% 129330982 / 123718135 / +4.5% 0.72 / 0.79 / -8.4%
tpcds_q59/datafusion:parquet 104950554 / 104036630 / +0.9% 133030380 / 130625814 / +1.8% 0.79 / 0.80 / -0.9%
tpcds_q60/datafusion:parquet 56419884 / 57080342 / -1.2% 79567776 / 81317011 / -2.2% 0.71 / 0.70 / +1.0%
tpcds_q61/datafusion:parquet 75896982 / 78798902 / -3.7% 98408671 / 94126255 / +4.5% 0.77 / 0.84 / -7.9%
tpcds_q62/datafusion:parquet 27383519 / 27875326 / -1.8% 45273624 / 44369262 / +2.0% 0.60 / 0.63 / -3.7%
tpcds_q63/datafusion:parquet 36267112 / 35793406 / +1.3% 60006255 / 61630016 / -2.6% 0.60 / 0.58 / +4.1%
tpcds_q64/datafusion:parquet 659715529 / 659067069 / +0.1% 750106032 / 724366071 / +3.6% 0.88 / 0.91 / -3.3%
tpcds_q65/datafusion:parquet 100941772 / 102534596 / -1.6% 135332148 / 135345567 / -0.0% 0.75 / 0.76 / -1.5%
tpcds_q66/datafusion:parquet 78001080 / 77655984 / +0.4% 103714866 / 103535766 / +0.2% 0.75 / 0.75 / +0.3%
tpcds_q67/datafusion:parquet 431427355 / 429968348 / +0.3% 508990999 / 499690752 / +1.9% 0.85 / 0.86 / -1.5%
tpcds_q68/datafusion:parquet 110630176 / 107524281 / +2.9% 154552754 / 154180018 / +0.2% 0.72 / 0.70 / +2.6%
tpcds_q69/datafusion:parquet 60374644 / 61729861 / -2.2% 89497099 / 85295685 / +4.9% 0.67 / 0.72 / -6.8%
tpcds_q70/datafusion:parquet 211579442 / 213697192 / -1.0% 241292439 / 243803444 / -1.0% 0.88 / 0.88 / +0.0%
tpcds_q71/datafusion:parquet 38018580 / 38129609 / -0.3% 63936143 / 65940257 / -3.0% 0.59 / 0.58 / +2.8%
tpcds_q72/datafusion:parquet 1857730224 / 1830761288 / +1.5% 1838361945 / 1833307199 / +0.3% 1.01 / 1.00 / +1.2%
tpcds_q73/datafusion:parquet 63001840 / 63364149 / -0.6% 86345254 / 84516542 / +2.2% 0.73 / 0.75 / -2.7%
tpcds_q74/datafusion:parquet 294465826 / 293384512 / +0.4% 325071893 / 322296504 / +0.9% 0.91 / 0.91 / -0.5%
tpcds_q75/datafusion:parquet 194262484 / 193230118 / +0.5% 238082459 / 233224339 / +2.1% 0.82 / 0.83 / -1.5%
tpcds_q76/datafusion:parquet 50218250 / 49325066 / +1.8% 79154561 / 80656297 / -1.9% 0.63 / 0.61 / +3.7%
tpcds_q77/datafusion:parquet 72105196 / 74120778 / -2.7% 98783072 / 102690628 / -3.8% 0.73 / 0.72 / +1.1%
tpcds_q78/datafusion:parquet 212867582 / 210466504 / +1.1% 274165427 / 266664346 / +2.8% 0.78 / 0.79 / -1.6%
tpcds_q79/datafusion:parquet 77532174 / 78227685 / -0.9% 119863405 / 111507984 / +7.5% 0.65 / 0.70 / -7.8%
tpcds_q80/datafusion:parquet 145478954 / 141270109 / +3.0% 196011345 / 193337299 / +1.4% 0.74 / 0.73 / +1.6%
tpcds_q81/datafusion:parquet 109654300 / 108402239 / +1.2% 130396102 / 126985827 / +2.7% 0.84 / 0.85 / -1.5%
tpcds_q82/datafusion:parquet 55054404 / 54281142 / +1.4% 72181666 / 73038790 / -1.2% 0.76 / 0.74 / +2.6%
tpcds_q83/datafusion:parquet 65857369 / 66993156 / -1.7% 83525336 / 81793328 / +2.1% 0.79 / 0.82 / -3.7%
tpcds_q84/datafusion:parquet 35679772 / 34794385 / +2.5% 50752591 / 49822486 / +1.9% 0.70 / 0.70 / +0.7%
tpcds_q85/datafusion:parquet 105244505 / 104898327 / +0.3% 133350637 / 129260238 / +3.2% 0.79 / 0.81 / -2.7%
tpcds_q86/datafusion:parquet 22009586 / 22098753 / -0.4% 39996239 / 40182384 / -0.5% 0.55 / 0.55 / +0.1%
tpcds_q87/datafusion:parquet 119954751 / 120977975 / -0.8% 146505584 / 141905649 / +3.2% 0.82 / 0.85 / -4.0%
tpcds_q88/datafusion:parquet 86768918 / 85342608 / +1.7% 114477573 / 109299292 / +4.7% 0.76 / 0.78 / -2.9%
tpcds_q89/datafusion:parquet 38769916 / 38725332 / +0.1% 63321783 / 65216084 / -2.9% 0.61 / 0.59 / +3.1%
tpcds_q90/datafusion:parquet 17006906 / 17532818 / -3.0% 34473140 / 34640801 / -0.5% 0.49 / 0.51 / -2.5%
tpcds_q91/datafusion:parquet 42476298 / 43360747 / -2.0% 60496329 / 57097504 / +6.0% 0.70 / 0.76 / -7.5%
tpcds_q92/datafusion:parquet 28079489 / 28786806 / -2.5% 46812257 / 46680902 / +0.3% 0.60 / 0.62 / -2.7%
tpcds_q93/datafusion:parquet 62918654 / 61763644 / +1.9% 88580256 / 88062114 / +0.6% 0.71 / 0.70 / +1.3%
tpcds_q94/datafusion:parquet 37954362 / 38494936 / -1.4% 58558693 / 57342050 / +2.1% 0.65 / 0.67 / -3.5%
tpcds_q95/datafusion:parquet 128318176 / 122918913 / +4.4% 153865195 / 147436867 / +4.4% 0.83 / 0.83 / +0.0%
tpcds_q96/datafusion:parquet 20794609 / 21628460 / -3.9% 36866953 / 37878146 / -2.7% 0.56 / 0.57 / -1.2%
tpcds_q97/datafusion:parquet 55285876 / 54382089 / +1.7% 81876042 / 82113018 / -0.3% 0.68 / 0.66 / +2.0%
tpcds_q98/datafusion:parquet 60715992 / 61206122 / -0.8% 88601684 / 87884458 / +0.8% 0.69 / 0.70 / -1.6%
tpcds_q99/datafusion:parquet 42916168 / 42816106 / +0.2% 59179505 / 58104206 / +1.9% 0.73 / 0.74 / -1.6%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 31908180 / 32074466 / -0.5% 44402543 / 43087251 / +3.1% 0.72 / 0.74 / -3.5%
tpcds_q02/duckdb:vortex-file-compressed 30439060 / 30829348 / -1.3% 43248421 / 42785766 / +1.1% 0.70 / 0.72 / -2.3%
tpcds_q03/duckdb:vortex-file-compressed 15467332 / 14851960 / +4.1% 32467120 / 29908589 / +8.6% 0.48 / 0.50 / -4.1%
tpcds_q04/duckdb:vortex-file-compressed 129616187 / 131214727 / -1.2% 152422370 / 147252035 / +3.5% 0.85 / 0.89 / -4.6%
tpcds_q05/duckdb:vortex-file-compressed 56030622 / 56004028 / +0.0% 76962210 / 71189933 / +8.1% 0.73 / 0.79 / -7.5%
tpcds_q06/duckdb:vortex-file-compressed 58995715 / 59148138 / -0.3% 79890205 / 78318873 / +2.0% 0.74 / 0.76 / -2.2%
tpcds_q07/duckdb:vortex-file-compressed 31845706 / 32540690 / -2.1% 55292260 / 51794225 / +6.8% 0.58 / 0.63 / -8.3%
tpcds_q08/duckdb:vortex-file-compressed 32254747 / 32250774 / +0.0% 43203861 / 41909620 / +3.1% 0.75 / 0.77 / -3.0%
tpcds_q09/duckdb:vortex-file-compressed 55967743 / 55853974 / +0.2% 80595304 / 74673300 / +7.9% 0.69 / 0.75 / -7.2%
tpcds_q10/duckdb:vortex-file-compressed 40644777 / 40314582 / +0.8% 58938260 / 57780543 / +2.0% 0.69 / 0.70 / -1.2%
tpcds_q11/duckdb:vortex-file-compressed 98197717 / 95952542 / +2.3% 114553334 / 111140669 / +3.1% 0.86 / 0.86 / -0.7%
tpcds_q12/duckdb:vortex-file-compressed 17824812 / 17804408 / +0.1% 31086176 / 31269124 / -0.6% 0.57 / 0.57 / +0.7%
tpcds_q13/duckdb:vortex-file-compressed 40602641 / 40616754 / -0.0% 74123836 / 67667049 / +9.5% 0.55 / 0.60 / -8.7%
tpcds_q14/duckdb:vortex-file-compressed 127582276 / 128563176 / -0.8% 141330436 / 145472445 / -2.8% 0.90 / 0.88 / +2.1%
tpcds_q15/duckdb:vortex-file-compressed 60021212 / 60488272 / -0.8% 75997892 / 72700843 / +4.5% 0.79 / 0.83 / -5.1%
tpcds_q16/duckdb:vortex-file-compressed 33491498 / 33900286 / -1.2% 51240523 / 50757755 / +1.0% 0.65 / 0.67 / -2.1%
tpcds_q17/duckdb:vortex-file-compressed 56937995 / 57036614 / -0.2% 82160941 / 78556081 / +4.6% 0.69 / 0.73 / -4.6%
tpcds_q18/duckdb:vortex-file-compressed 83485730 / 83367221 / +0.1% 104516079 / 101800693 / +2.7% 0.80 / 0.82 / -2.5%
tpcds_q19/duckdb:vortex-file-compressed 46099348 / 46947670 / -1.8% 62768041 / 61824478 / +1.5% 0.73 / 0.76 / -3.3%
tpcds_q20/duckdb:vortex-file-compressed 22151010 / 22289932 / -0.6% 38039769 / 36137831 / +5.3% 0.58 / 0.62 / -5.6%
tpcds_q21/duckdb:vortex-file-compressed 36606097 / 35838440 / +2.1% 56205695 / 53567215 / +4.9% 0.65 / 0.67 / -2.7%
tpcds_q22/duckdb:vortex-file-compressed 159977887 / 157904098 / +1.3% 167051007 / 166346922 / +0.4% 0.96 / 0.95 / +0.9%
tpcds_q23/duckdb:vortex-file-compressed 188271233 / 183183891 / +2.8% 205506873 / 196691388 / +4.5% 0.92 / 0.93 / -1.6%
tpcds_q24/duckdb:vortex-file-compressed 52078575 / 51931930 / +0.3% 73673217 / 69935534 / +5.3% 0.71 / 0.74 / -4.8%
tpcds_q25/duckdb:vortex-file-compressed 52882497 / 52103638 / +1.5% 74893454 / 72762181 / +2.9% 0.71 / 0.72 / -1.4%
tpcds_q26/duckdb:vortex-file-compressed 26088298 / 26714674 / -2.3% 40448211 / 39615466 / +2.1% 0.64 / 0.67 / -4.4%
tpcds_q27/duckdb:vortex-file-compressed 33385384 / 33289783 / +0.3% 54746659 / 53457342 / +2.4% 0.61 / 0.62 / -2.1%
tpcds_q28/duckdb:vortex-file-compressed 42971464 / 42082689 / +2.1% 63429134 / 60823109 / +4.3% 0.68 / 0.69 / -2.1%
tpcds_q29/duckdb:vortex-file-compressed 50838257 / 50800150 / +0.1% 73238868 / 68975759 / +6.2% 0.69 / 0.74 / -5.8%
tpcds_q30/duckdb:vortex-file-compressed 38091306 / 38450483 / -0.9% 50438881 / 50454100 / -0.0% 0.76 / 0.76 / -0.9%
tpcds_q31/duckdb:vortex-file-compressed 39327955 / 39635800 / -0.8% 54700680 / 53728242 / +1.8% 0.72 / 0.74 / -2.5%
tpcds_q32/duckdb:vortex-file-compressed 14503116 / 13587206 / +6.7% 29668140 / 28792435 / +3.0% 0.49 / 0.47 / +3.6%
tpcds_q33/duckdb:vortex-file-compressed 34691627 / 35483356 / -2.2% 58757394 / 55471455 / +5.9% 0.59 / 0.64 / -7.7%
tpcds_q34/duckdb:vortex-file-compressed 25476202 / 24917233 / +2.2% 42455062 / 38737039 / +9.6% 0.60 / 0.64 / -6.7%
tpcds_q35/duckdb:vortex-file-compressed 67833572 / 68612825 / -1.1% 89803230 / 82931792 / +8.3% 0.76 / 0.83 / -8.7%
tpcds_q36/duckdb:vortex-file-compressed 30810393 / 31624996 / -2.6% 51192733 / 49996256 / +2.4% 0.60 / 0.63 / -4.9%
tpcds_q37/duckdb:vortex-file-compressed 27146482 / 27204703 / -0.2% 65725818 / 62152195 / +5.7% 0.41 / 0.44 / -5.6%
tpcds_q38/duckdb:vortex-file-compressed 61215697 / 63754012 / -4.0% 75304191 / 77392661 / -2.7% 0.81 / 0.82 / -1.3%
tpcds_q39/duckdb:vortex-file-compressed 57145022 / 57539714 / -0.7% 79522938 / 77398285 / +2.7% 0.72 / 0.74 / -3.3%
tpcds_q40/duckdb:vortex-file-compressed 19101169 / 18863966 / +1.3% 34721203 / 34913100 / -0.5% 0.55 / 0.54 / +1.8%
tpcds_q41/duckdb:vortex-file-compressed 19472086 / 19381854 / +0.5% 25966515 / 26451019 / -1.8% 0.75 / 0.73 / +2.3%
tpcds_q42/duckdb:vortex-file-compressed 15711518 / 16234000 / -3.2% 32331963 / 31631785 / +2.2% 0.49 / 0.51 / -5.3%
tpcds_q43/duckdb:vortex-file-compressed 21285764 / 21200074 / +0.4% 37106326 / 35716007 / +3.9% 0.57 / 0.59 / -3.4%
tpcds_q44/duckdb:vortex-file-compressed 27642034 / 27613092 / +0.1% 51321266 / 48114653 / +6.7% 0.54 / 0.57 / -6.1%
tpcds_q45/duckdb:vortex-file-compressed 47320606 / 47220816 / +0.2% 59874933 / 59686157 / +0.3% 0.79 / 0.79 / -0.1%
tpcds_q46/duckdb:vortex-file-compressed 52685345 / 52944502 / -0.5% 73598721 / 71791080 / +2.5% 0.72 / 0.74 / -2.9%
tpcds_q47/duckdb:vortex-file-compressed 81699824 / 82153602 / -0.6% 98936984 / 97523240 / +1.4% 0.83 / 0.84 / -2.0%
tpcds_q48/duckdb:vortex-file-compressed 55934732 / 55827684 / +0.2% 82867674 / 75871534 / +9.2% 0.67 / 0.74 / -8.3%
tpcds_q49/duckdb:vortex-file-compressed 38316532 / 39743982 / -3.6% 77133669 / 72490192 / +6.4% 0.50 / 0.55 / -9.4%
tpcds_q50/duckdb:vortex-file-compressed 34392072 / 34258560 / +0.4% 55803278 / 54010365 / +3.3% 0.62 / 0.63 / -2.8%
tpcds_q51/duckdb:vortex-file-compressed 207496157 / 206757399 / +0.4% 217729201 / 220082223 / -1.1% 0.95 / 0.94 / +1.4%
tpcds_q52/duckdb:vortex-file-compressed 16422332 / 15988201 / +2.7% 32131472 / 31271447 / +2.8% 0.51 / 0.51 / -0.0%
tpcds_q53/duckdb:vortex-file-compressed 25404792 / 24890289 / +2.1% 42824209 / 41175691 / +4.0% 0.59 / 0.60 / -1.9%
tpcds_q54/duckdb:vortex-file-compressed 45303990 / 46194941 / -1.9% 65844639 / 64800636 / +1.6% 0.69 / 0.71 / -3.5%
tpcds_q55/duckdb:vortex-file-compressed 16773053 / 16135154 / +4.0% 31698337 / 31546529 / +0.5% 0.53 / 0.51 / +3.5%
tpcds_q56/duckdb:vortex-file-compressed 34456549 / 34121965 / +1.0% 55995436 / 53809377 / +4.1% 0.62 / 0.63 / -3.0%
tpcds_q57/duckdb:vortex-file-compressed 64669684 / 69126536 / -6.4% 77039430 / 76691308 / +0.5% 0.84 / 0.90 / -6.9%
tpcds_q58/duckdb:vortex-file-compressed 37665886 / 38082686 / -1.1% 58118308 / 58906998 / -1.3% 0.65 / 0.65 / +0.2%
tpcds_q59/duckdb:vortex-file-compressed 56048422 / 58084507 / -3.5% 69870781 / 67567254 / +3.4% 0.80 / 0.86 / -6.7%
tpcds_q60/duckdb:vortex-file-compressed 36162803 / 36171118 / -0.0% 59381809 / 57145599 / +3.9% 0.61 / 0.63 / -3.8%
tpcds_q61/duckdb:vortex-file-compressed 35698316 / 36429354 / -2.0% 55518553 / 53804131 / +3.2% 0.64 / 0.68 / -5.0%
tpcds_q62/duckdb:vortex-file-compressed 15563583 / 15620401 / -0.4% 26700993 / 26058474 / +2.5% 0.58 / 0.60 / -2.8%
tpcds_q63/duckdb:vortex-file-compressed 23345646 / 22732749 / +2.7% 39714518 / 39304997 / +1.0% 0.59 / 0.58 / +1.6%
tpcds_q64/duckdb:vortex-file-compressed 120408905 / 119935238 / +0.4% 145487084 / 150980760 / -3.6% 0.83 / 0.79 / +4.2%
tpcds_q65/duckdb:vortex-file-compressed 53429078 / 51470067 / +3.8% 71308821 / 60892922 / +17.1% 🔴 0.75 / 0.85 / -11.4%
tpcds_q66/duckdb:vortex-file-compressed 43054864 / 43137992 / -0.2% 58193411 / 56875234 / +2.3% 0.74 / 0.76 / -2.5%
tpcds_q67/duckdb:vortex-file-compressed 277423484 / 272764464 / +1.7% 282918602 / 290067013 / -2.5% 0.98 / 0.94 / +4.3%
tpcds_q68/duckdb:vortex-file-compressed 45627581 / 45989396 / -0.8% 68729726 / 69364430 / -0.9% 0.66 / 0.66 / +0.1%
tpcds_q69/duckdb:vortex-file-compressed 39583238 / 39457880 / +0.3% 60804709 / 59338783 / +2.5% 0.65 / 0.66 / -2.1%
tpcds_q70/duckdb:vortex-file-compressed 26667536 / 27142552 / -1.8% 44195203 / 42905196 / +3.0% 0.60 / 0.63 / -4.6%
tpcds_q71/duckdb:vortex-file-compressed 29297216 / 29549009 / -0.9% 53043041 / 50154052 / +5.8% 0.55 / 0.59 / -6.3%
tpcds_q72/duckdb:vortex-file-compressed 139307116 / 138423312 / +0.6% 156609265 / 157156216 / -0.3% 0.89 / 0.88 / +1.0%
tpcds_q73/duckdb:vortex-file-compressed 22495320 / 21989176 / +2.3% 39028804 / 36834392 / +6.0% 0.58 / 0.60 / -3.5%
tpcds_q74/duckdb:vortex-file-compressed 82521166 / 82847284 / -0.4% 97108131 / 101664745 / -4.5% 0.85 / 0.81 / +4.3%
tpcds_q75/duckdb:vortex-file-compressed 114353050 / 112816166 / +1.4% 137905116 / 134325941 / +2.7% 0.83 / 0.84 / -1.3%
tpcds_q76/duckdb:vortex-file-compressed 29143858 / 28230000 / +3.2% 59760493 / 53936348 / +10.8% 🔴 0.49 / 0.52 / -6.8%
tpcds_q77/duckdb:vortex-file-compressed 37799832 / 39307035 / -3.8% 63824771 / 60693336 / +5.2% 0.59 / 0.65 / -8.6%
tpcds_q78/duckdb:vortex-file-compressed 138429497 / 137467414 / +0.7% 160894458 / 158010829 / +1.8% 0.86 / 0.87 / -1.1%
tpcds_q79/duckdb:vortex-file-compressed 37475845 / 38964922 / -3.8% 57114281 / 56130393 / +1.8% 0.66 / 0.69 / -5.5%
tpcds_q80/duckdb:vortex-file-compressed 59909577 / 58699392 / +2.1% 89534523 / 94835508 / -5.6% 0.67 / 0.62 / +8.1%
tpcds_q81/duckdb:vortex-file-compressed 57675158 / 57085290 / +1.0% 69340195 / 68923775 / +0.6% 0.83 / 0.83 / +0.4%
tpcds_q82/duckdb:vortex-file-compressed 28602730 / 27834488 / +2.8% 72950690 / 62461285 / +16.8% 🔴 0.39 / 0.45 / -12.0%
tpcds_q83/duckdb:vortex-file-compressed 21745825 / 21654038 / +0.4% 33354004 / 31914749 / +4.5% 0.65 / 0.68 / -3.9%
tpcds_q84/duckdb:vortex-file-compressed 13858706 / 13611140 / +1.8% 25003359 / 24173932 / +3.4% 0.55 / 0.56 / -1.6%
tpcds_q85/duckdb:vortex-file-compressed 36520558 / 36953414 / -1.2% 54935645 / 53040674 / +3.6% 0.66 / 0.70 / -4.6%
tpcds_q86/duckdb:vortex-file-compressed 17025316 / 18104564 / -6.0% 29466951 / 27518181 / +7.1% 0.58 / 0.66 / -12.2%
tpcds_q87/duckdb:vortex-file-compressed 74960854 / 78256297 / -4.2% 87563410 / 90839595 / -3.6% 0.86 / 0.86 / -0.6%
tpcds_q88/duckdb:vortex-file-compressed 39939426 / 40237504 / -0.7% 50439087 / 49968327 / +0.9% 0.79 / 0.81 / -1.7%
tpcds_q89/duckdb:vortex-file-compressed 26371258 / 26670602 / -1.1% 42431470 / 43771575 / -3.1% 0.62 / 0.61 / +2.0%
tpcds_q90/duckdb:vortex-file-compressed 10238103 / 10260670 / -0.2% 20532817 / 21602509 / -5.0% 0.50 / 0.47 / +5.0%
tpcds_q91/duckdb:vortex-file-compressed 19478186 / 19723819 / -1.2% 30914523 / 29157641 / +6.0% 0.63 / 0.68 / -6.9%
tpcds_q92/duckdb:vortex-file-compressed 13907652 / 13636884 / +2.0% 26573583 / 27086299 / -1.9% 0.52 / 0.50 / +4.0%
tpcds_q93/duckdb:vortex-file-compressed 24903516 / 24651691 / +1.0% 52821053 / 47526229 / +11.1% 🔴 0.47 / 0.52 / -9.1%
tpcds_q94/duckdb:vortex-file-compressed 32122458 / 32022553 / +0.3% 45886208 / 45669118 / +0.5% 0.70 / 0.70 / -0.2%
tpcds_q95/duckdb:vortex-file-compressed 94764288 / 95182362 / -0.4% 107352397 / 105284134 / +2.0% 0.88 / 0.90 / -2.4%
tpcds_q96/duckdb:vortex-file-compressed 13818868 / 14189766 / -2.6% 26866175 / 27949100 / -3.9% 0.51 / 0.51 / +1.3%
tpcds_q97/duckdb:vortex-file-compressed 63300696 / 61786652 / +2.5% 82373548 / 82349242 / +0.0% 0.77 / 0.75 / +2.4%
tpcds_q98/duckdb:vortex-file-compressed 28362882 / 28151018 / +0.8% 45737479 / 46503721 / -1.6% 0.62 / 0.61 / +2.4%
tpcds_q99/duckdb:vortex-file-compressed 28482280 / 22837791 / +24.7% 🔴 36931493 / 36678206 / +0.7% 0.77 / 0.62 / +23.9%
duckdb / parquet / ns (1.004x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41535611 / 41118112 / +1.0% 50610298 / 49475587 / +2.3% 0.82 / 0.83 / -1.2%
tpcds_q02/duckdb:parquet 40288889 / 38236058 / +5.4% 50664913 / 49223865 / +2.9% 0.80 / 0.78 / +2.4%
tpcds_q03/duckdb:parquet 25745924 / 25228902 / +2.0% 36381618 / 35535274 / +2.4% 0.71 / 0.71 / -0.3%
tpcds_q04/duckdb:parquet 204179542 / 204908708 / -0.4% 220108814 / 227544234 / -3.3% 0.93 / 0.90 / +3.0%
tpcds_q05/duckdb:parquet 69683752 / 69276986 / +0.6% 87068867 / 87142504 / -0.1% 0.80 / 0.79 / +0.7%
tpcds_q06/duckdb:parquet 74267766 / 74957897 / -0.9% 87023894 / 85827197 / +1.4% 0.85 / 0.87 / -2.3%
tpcds_q07/duckdb:parquet 58741418 / 60028340 / -2.1% 75690732 / 76795973 / -1.4% 0.78 / 0.78 / -0.7%
tpcds_q08/duckdb:parquet 37270820 / 37582549 / -0.8% 45486297 / 44486798 / +2.2% 0.82 / 0.84 / -3.0%
tpcds_q09/duckdb:parquet 84337978 / 85739545 / -1.6% 101844249 / 97102552 / +4.9% 0.83 / 0.88 / -6.2%
tpcds_q10/duckdb:parquet 53416387 / 52574512 / +1.6% 62745631 / 61294800 / +2.4% 0.85 / 0.86 / -0.7%
tpcds_q11/duckdb:parquet 159975365 / 156800224 / +2.0% 170539560 / 167603072 / +1.8% 0.94 / 0.94 / +0.3%
tpcds_q12/duckdb:parquet 40218510 / 40851316 / -1.5% 46301006 / 45649658 / +1.4% 0.87 / 0.89 / -2.9%
tpcds_q13/duckdb:parquet 71718970 / 70979766 / +1.0% 87986962 / 90722303 / -3.0% 0.82 / 0.78 / +4.2%
tpcds_q14/duckdb:parquet 185110162 / 188110376 / -1.6% 194998920 / 197172312 / -1.1% 0.95 / 0.95 / -0.5%
tpcds_q15/duckdb:parquet 60460565 / 60564028 / -0.2% 68672635 / 67513105 / +1.7% 0.88 / 0.90 / -1.9%
tpcds_q16/duckdb:parquet 38403424 / 37865913 / +1.4% 46520083 / 46228743 / +0.6% 0.83 / 0.82 / +0.8%
tpcds_q17/duckdb:parquet 83452231 / 82947278 / +0.6% 91026329 / 88669640 / +2.7% 0.92 / 0.94 / -2.0%
tpcds_q18/duckdb:parquet 87297904 / 86747862 / +0.6% 96539093 / 96050563 / +0.5% 0.90 / 0.90 / +0.1%
tpcds_q19/duckdb:parquet 47009036 / 48570114 / -3.2% 59404238 / 59316748 / +0.1% 0.79 / 0.82 / -3.4%
tpcds_q20/duckdb:parquet 43106021 / 43068760 / +0.1% 50452311 / 47700756 / +5.8% 0.85 / 0.90 / -5.4%
tpcds_q21/duckdb:parquet 23791830 / 23653833 / +0.6% 28138311 / 28045056 / +0.3% 0.85 / 0.84 / +0.3%
tpcds_q22/duckdb:parquet 162291080 / 162847498 / -0.3% 168236232 / 166213888 / +1.2% 0.96 / 0.98 / -1.5%
tpcds_q23/duckdb:parquet 183035572 / 184416876 / -0.7% 196969686 / 192699886 / +2.2% 0.93 / 0.96 / -2.9%
tpcds_q24/duckdb:parquet 73336886 / 72212310 / +1.6% 83079874 / 79978667 / +3.9% 0.88 / 0.90 / -2.2%
tpcds_q25/duckdb:parquet 50491449 / 50565040 / -0.1% 60850673 / 58933220 / +3.3% 0.83 / 0.86 / -3.3%
tpcds_q26/duckdb:parquet 42501332 / 42275876 / +0.5% 51566204 / 50607418 / +1.9% 0.82 / 0.84 / -1.3%
tpcds_q27/duckdb:parquet 58667172 / 58379759 / +0.5% 74300450 / 73183034 / +1.5% 0.79 / 0.80 / -1.0%
tpcds_q28/duckdb:parquet 94219870 / 92080313 / +2.3% 110130070 / 108867751 / +1.2% 0.86 / 0.85 / +1.2%
tpcds_q29/duckdb:parquet 83623994 / 85528870 / -2.2% 98271093 / 94724959 / +3.7% 0.85 / 0.90 / -5.8%
tpcds_q30/duckdb:parquet 71438584 / 70987496 / +0.6% 79848254 / 79274681 / +0.7% 0.89 / 0.90 / -0.1%
tpcds_q31/duckdb:parquet 98947362 / 99354608 / -0.4% 109194547 / 108838499 / +0.3% 0.91 / 0.91 / -0.7%
tpcds_q32/duckdb:parquet 18282676 / 18102407 / +1.0% 26209499 / 25519482 / +2.7% 0.70 / 0.71 / -1.7%
tpcds_q33/duckdb:parquet 64294238 / 62495279 / +2.9% 75722336 / 74898793 / +1.1% 0.85 / 0.83 / +1.8%
tpcds_q34/duckdb:parquet 33191777 / 32877334 / +1.0% 40416697 / 42525537 / -5.0% 0.82 / 0.77 / +6.2%
tpcds_q35/duckdb:parquet 79551960 / 77108846 / +3.2% 86376744 / 86858772 / -0.6% 0.92 / 0.89 / +3.7%
tpcds_q36/duckdb:parquet 97865334 / 96897026 / +1.0% 111371043 / 113002501 / -1.4% 0.88 / 0.86 / +2.5%
tpcds_q37/duckdb:parquet 41551235 / 40975370 / +1.4% 48743091 / 45385342 / +7.4% 0.85 / 0.90 / -5.6%
tpcds_q38/duckdb:parquet 74736132 / 76239698 / -2.0% 81092888 / 83573090 / -3.0% 0.92 / 0.91 / +1.0%
tpcds_q39/duckdb:parquet 61269690 / 60922842 / +0.6% 66420345 / 67494377 / -1.6% 0.92 / 0.90 / +2.2%
tpcds_q40/duckdb:parquet 27926372 / 27874594 / +0.2% 35289031 / 34077680 / +3.6% 0.79 / 0.82 / -3.3%
tpcds_q41/duckdb:parquet 20047732 / 20074721 / -0.1% 26500646 / 25867635 / +2.4% 0.76 / 0.78 / -2.5%
tpcds_q42/duckdb:parquet 26016913 / 25779932 / +0.9% 38033743 / 36779463 / +3.4% 0.68 / 0.70 / -2.4%
tpcds_q43/duckdb:parquet 25700362 / 26842550 / -4.3% 35758956 / 34973656 / +2.2% 0.72 / 0.77 / -6.4%
tpcds_q44/duckdb:parquet 61381460 / 60442950 / +1.6% 77016987 / 72595761 / +6.1% 0.80 / 0.83 / -4.3%
tpcds_q45/duckdb:parquet 60174371 / 60070354 / +0.2% 68147968 / 68573695 / -0.6% 0.88 / 0.88 / +0.8%
tpcds_q46/duckdb:parquet 72622484 / 73230946 / -0.8% 88581029 / 89532773 / -1.1% 0.82 / 0.82 / +0.2%
tpcds_q47/duckdb:parquet 92722444 / 90189678 / +2.8% 99496899 / 101541051 / -2.0% 0.93 / 0.89 / +4.9%
tpcds_q48/duckdb:parquet 64158852 / 67487324 / -4.9% 81108769 / 80286744 / +1.0% 0.79 / 0.84 / -5.9%
tpcds_q49/duckdb:parquet 69472597 / 68257294 / +1.8% 94389591 / 92748182 / +1.8% 0.74 / 0.74 / +0.0%
tpcds_q50/duckdb:parquet 45319446 / 41574388 / +9.0% 56094314 / 56748344 / -1.2% 0.81 / 0.73 / +10.3%
tpcds_q51/duckdb:parquet 216443700 / 215287820 / +0.5% 226225479 / 227077157 / -0.4% 0.96 / 0.95 / +0.9%
tpcds_q52/duckdb:parquet 26459280 / 27422122 / -3.5% 37842272 / 38431878 / -1.5% 0.70 / 0.71 / -2.0%
tpcds_q53/duckdb:parquet 35735328 / 35135808 / +1.7% 47395563 / 46845148 / +1.2% 0.75 / 0.75 / +0.5%
tpcds_q54/duckdb:parquet 56144442 / 55994680 / +0.3% 62056255 / 64704690 / -4.1% 0.90 / 0.87 / +4.5%
tpcds_q55/duckdb:parquet 26822134 / 27653174 / -3.0% 38692837 / 36713055 / +5.4% 0.69 / 0.75 / -8.0%
tpcds_q56/duckdb:parquet 69829271 / 69930716 / -0.1% 81472869 / 83176589 / -2.0% 0.86 / 0.84 / +1.9%
tpcds_q57/duckdb:parquet 67539652 / 67974478 / -0.6% 74315611 / 73729497 / +0.8% 0.91 / 0.92 / -1.4%
tpcds_q58/duckdb:parquet 54687624 / 55080441 / -0.7% 67485900 / 64096021 / +5.3% 0.81 / 0.86 / -5.7%
tpcds_q59/duckdb:parquet 59972887 / 60669470 / -1.1% 67181897 / 66942796 / +0.4% 0.89 / 0.91 / -1.5%
tpcds_q60/duckdb:parquet 83437934 / 82010658 / +1.7% 92194315 / 91942191 / +0.3% 0.91 / 0.89 / +1.5%
tpcds_q61/duckdb:parquet 79766991 / 79559015 / +0.3% 94156734 / 91178144 / +3.3% 0.85 / 0.87 / -2.9%
tpcds_q62/duckdb:parquet 21923883 / 19535025 / +12.2% 🔴 24609296 / 26068340 / -5.6% 0.89 / 0.75 / +18.9%
tpcds_q63/duckdb:parquet 34702100 / 34370313 / +1.0% 42061380 / 44599142 / -5.7% 0.83 / 0.77 / +7.1%
tpcds_q64/duckdb:parquet 135584300 / 134519590 / +0.8% 150132293 / 148809721 / +0.9% 0.90 / 0.90 / -0.1%
tpcds_q65/duckdb:parquet 92543999 / 92755317 / -0.2% 107070510 / 107648848 / -0.5% 0.86 / 0.86 / +0.3%
tpcds_q66/duckdb:parquet 47482256 / 45937752 / +3.4% 55970205 / 52121299 / +7.4% 0.85 / 0.88 / -3.7%
tpcds_q67/duckdb:parquet 293260735 / 288664051 / +1.6% 291885333 / 298791899 / -2.3% 1.00 / 0.97 / +4.0%
tpcds_q68/duckdb:parquet 62672204 / 61145474 / +2.5% 77090883 / 74350495 / +3.7% 0.81 / 0.82 / -1.1%
tpcds_q69/duckdb:parquet 64604366 / 65509756 / -1.4% 76612814 / 77265111 / -0.8% 0.84 / 0.85 / -0.5%
tpcds_q70/duckdb:parquet 42281806 / 43343072 / -2.4% 53701040 / 54715651 / -1.9% 0.79 / 0.79 / -0.6%
tpcds_q71/duckdb:parquet 41475484 / 40538224 / +2.3% 54376911 / 56162507 / -3.2% 0.76 / 0.72 / +5.7%
tpcds_q72/duckdb:parquet 172749560 / 170926189 / +1.1% 185622661 / 182559524 / +1.7% 0.93 / 0.94 / -0.6%
tpcds_q73/duckdb:parquet 28306508 / 27828315 / +1.7% 35172506 / 37438223 / -6.1% 0.80 / 0.74 / +8.3%
tpcds_q74/duckdb:parquet 213940888 / 214146768 / -0.1% 219606592 / 222219985 / -1.2% 0.97 / 0.96 / +1.1%
tpcds_q75/duckdb:parquet 133438477 / 130777142 / +2.0% 145452712 / 145592845 / -0.1% 0.92 / 0.90 / +2.1%
tpcds_q76/duckdb:parquet 50864534 / 51436768 / -1.1% 68134799 / 63887396 / +6.6% 0.75 / 0.81 / -7.3%
tpcds_q77/duckdb:parquet 55679369 / 56030840 / -0.6% 69710820 / 72498040 / -3.8% 0.80 / 0.77 / +3.3%
tpcds_q78/duckdb:parquet 150939039 / 154312451 / -2.2% 160972381 / 166424296 / -3.3% 0.94 / 0.93 / +1.1%
tpcds_q79/duckdb:parquet 51126362 / 51421591 / -0.6% 65028188 / 66006182 / -1.5% 0.79 / 0.78 / +0.9%
tpcds_q80/duckdb:parquet 82745241 / 83547092 / -1.0% 103070243 / 102109064 / +0.9% 0.80 / 0.82 / -1.9%
tpcds_q81/duckdb:parquet 98692022 / 98580078 / +0.1% 105962637 / 104919861 / +1.0% 0.93 / 0.94 / -0.9%
tpcds_q82/duckdb:parquet 46469832 / 46090114 / +0.8% 54877572 / 54859313 / +0.0% 0.85 / 0.84 / +0.8%
tpcds_q83/duckdb:parquet 27952675 / 27921592 / +0.1% 32858136 / 32430628 / +1.3% 0.85 / 0.86 / -1.2%
tpcds_q84/duckdb:parquet 22602300 / 22538256 / +0.3% 29784391 / 28843871 / +3.3% 0.76 / 0.78 / -2.9%
tpcds_q85/duckdb:parquet 51831139 / 51333096 / +1.0% 62329508 / 60642325 / +2.8% 0.83 / 0.85 / -1.8%
tpcds_q86/duckdb:parquet 24722538 / 25655944 / -3.6% 30405874 / 30824829 / -1.4% 0.81 / 0.83 / -2.3%
tpcds_q87/duckdb:parquet 88239684 / 88166010 / +0.1% 95391462 / 94926124 / +0.5% 0.93 / 0.93 / -0.4%
tpcds_q88/duckdb:parquet 104606625 / 103094848 / +1.5% 109996307 / 110765653 / -0.7% 0.95 / 0.93 / +2.2%
tpcds_q89/duckdb:parquet 37847161 / 36828192 / +2.8% 46802799 / 47048115 / -0.5% 0.81 / 0.78 / +3.3%
tpcds_q90/duckdb:parquet 15218620 / 15880382 / -4.2% 20059005 / 20030325 / +0.1% 0.76 / 0.79 / -4.3%
tpcds_q91/duckdb:parquet 25721998 / 25632920 / +0.3% 33308869 / 31803221 / +4.7% 0.77 / 0.81 / -4.2%
tpcds_q92/duckdb:parquet 22912638 / 21984686 / +4.2% 31204176 / 29391991 / +6.2% 0.73 / 0.75 / -1.8%
tpcds_q93/duckdb:parquet 35884399 / 36135860 / -0.7% 48920133 / 48461818 / +0.9% 0.73 / 0.75 / -1.6%
tpcds_q94/duckdb:parquet 38117332 / 37848001 / +0.7% 45729075 / 46839430 / -2.4% 0.83 / 0.81 / +3.2%
tpcds_q95/duckdb:parquet 82072220 / 82486173 / -0.5% 87181526 / 86824907 / +0.4% 0.94 / 0.95 / -0.9%
tpcds_q96/duckdb:parquet 17635623 / 17217136 / +2.4% 22182174 / 23908994 / -7.2% 0.80 / 0.72 / +10.4%
tpcds_q97/duckdb:parquet 72450481 / 73140431 / -0.9% 83951510 / 83098766 / +1.0% 0.86 / 0.88 / -1.9%
tpcds_q98/duckdb:parquet 54088159 / 54899273 / -1.5% 67980997 / 65210886 / +4.2% 0.80 / 0.84 / -5.5%
tpcds_q99/duckdb:parquet 24389718 / 24105616 / +1.2% 32944773 / 31888483 / +3.3% 0.74 / 0.76 / -2.1%

File Size Changes (33 files changed, +0.0% overall, 33↑ 0↓)
File Scale Format Base HEAD Change %
income_band_0001.vortex 10.0 vortex-file-compressed 5.11 KB 5.19 KB +80 B +1.5%
reason_0001.vortex 10.0 vortex-file-compressed 8.29 KB 8.37 KB +80 B +0.9%
ship_mode_0001.vortex 10.0 vortex-file-compressed 13.60 KB 13.68 KB +80 B +0.6%
household_demographics_0001.vortex 10.0 vortex-file-compressed 16.35 KB 16.43 KB +80 B +0.5%
warehouse_0001.vortex 10.0 vortex-file-compressed 27.72 KB 27.80 KB +80 B +0.3%
web_page_0001.vortex 10.0 vortex-file-compressed 34.31 KB 34.39 KB +80 B +0.2%
web_site_0001.vortex 10.0 vortex-file-compressed 59.11 KB 59.18 KB +80 B +0.1%
promotion_0001.vortex 10.0 vortex-file-compressed 60.99 KB 61.07 KB +80 B +0.1%
call_center_0001.vortex 10.0 vortex-file-compressed 63.32 KB 63.40 KB +80 B +0.1%
store_0001.vortex 10.0 vortex-file-compressed 74.73 KB 74.81 KB +80 B +0.1%
time_dim_0001.vortex 10.0 vortex-file-compressed 318.51 KB 318.59 KB +80 B +0.0%
catalog_page_0001.vortex 10.0 vortex-file-compressed 546.83 KB 546.91 KB +80 B +0.0%
date_dim_0001.vortex 10.0 vortex-file-compressed 580.59 KB 580.67 KB +80 B +0.0%
customer_demographics_0001.vortex 10.0 vortex-file-compressed 1.18 MB 1.18 MB +80 B +0.0%
customer_address_0001.vortex 10.0 vortex-file-compressed 3.33 MB 3.33 MB +80 B +0.0%
item_0001.vortex 10.0 vortex-file-compressed 6.99 MB 6.99 MB +80 B +0.0%
customer_0001.vortex 10.0 vortex-file-compressed 19.94 MB 19.94 MB +80 B +0.0%
web_returns_0001.vortex 10.0 vortex-file-compressed 34.61 MB 34.61 MB +80 B +0.0%
catalog_returns_0001.vortex 10.0 vortex-file-compressed 69.25 MB 69.25 MB +80 B +0.0%
store_returns_0001.vortex 10.0 vortex-file-compressed 109.16 MB 109.16 MB +80 B +0.0%
inventory_0002.vortex 10.0 vortex-file-compressed 114.10 MB 114.10 MB +80 B +0.0%
inventory_0001.vortex 10.0 vortex-file-compressed 122.63 MB 122.63 MB +80 B +0.0%
web_sales_0002.vortex 10.0 vortex-file-compressed 160.71 MB 160.71 MB +80 B +0.0%
web_sales_0001.vortex 10.0 vortex-file-compressed 161.02 MB 161.02 MB +80 B +0.0%
catalog_sales_0003.vortex 10.0 vortex-file-compressed 165.74 MB 165.74 MB +80 B +0.0%
catalog_sales_0001.vortex 10.0 vortex-file-compressed 165.88 MB 165.88 MB +80 B +0.0%
catalog_sales_0002.vortex 10.0 vortex-file-compressed 165.95 MB 165.95 MB +80 B +0.0%
catalog_sales_0004.vortex 10.0 vortex-file-compressed 166.26 MB 166.26 MB +80 B +0.0%
store_sales_0004.vortex 10.0 vortex-file-compressed 195.03 MB 195.03 MB +80 B +0.0%
store_sales_0001.vortex 10.0 vortex-file-compressed 196.54 MB 196.54 MB +80 B +0.0%
store_sales_0003.vortex 10.0 vortex-file-compressed 196.62 MB 196.62 MB +80 B +0.0%
store_sales_0005.vortex 10.0 vortex-file-compressed 196.68 MB 196.68 MB +80 B +0.0%
store_sales_0002.vortex 10.0 vortex-file-compressed 196.74 MB 196.74 MB +80 B +0.0%

Totals:

  • vortex-file-compressed: 2.39 GB → 2.39 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21909784 / 21237177 / +3.2% 41185972 / 41101215 / +0.2% 0.53 / 0.52 / +3.0%
tpcds_q02/datafusion:vortex-file-compressed 42840600 / 42901042 / -0.1% 66196804 / 63938372 / +3.5% 0.65 / 0.67 / -3.5%
tpcds_q03/datafusion:vortex-file-compressed 11636424 / 11727656 / -0.8% 28526141 / 29494716 / -3.3% 0.41 / 0.40 / +2.6%
tpcds_q04/datafusion:vortex-file-compressed 80433454 / 80769188 / -0.4% 109710261 / 110006506 / -0.3% 0.73 / 0.73 / -0.1%
tpcds_q05/datafusion:vortex-file-compressed 57113240 / 56169876 / +1.7% 79135571 / 79966803 / -1.0% 0.72 / 0.70 / +2.7%
tpcds_q06/datafusion:vortex-file-compressed 21811048 / 22056258 / -1.1% 41616601 / 41748326 / -0.3% 0.52 / 0.53 / -0.8%
tpcds_q07/datafusion:vortex-file-compressed 26542106 / 26342970 / +0.8% 51559206 / 50694141 / +1.7% 0.51 / 0.52 / -0.9%
tpcds_q08/datafusion:vortex-file-compressed 26049312 / 25792884 / +1.0% 46593736 / 46812172 / -0.5% 0.56 / 0.55 / +1.5%
tpcds_q09/datafusion:vortex-file-compressed 19976164 / 20496964 / -2.5% 37188808 / 37615814 / -1.1% 0.54 / 0.54 / -1.4%
tpcds_q10/datafusion:vortex-file-compressed 30307414 / 30059652 / +0.8% 52219442 / 51819621 / +0.8% 0.58 / 0.58 / +0.1%
tpcds_q11/datafusion:vortex-file-compressed 49040806 / 48819790 / +0.5% 79452796 / 75612761 / +5.1% 0.62 / 0.65 / -4.4%
tpcds_q12/datafusion:vortex-file-compressed 15863488 / 15996434 / -0.8% 32722718 / 34818741 / -6.0% 0.48 / 0.46 / +5.5%
tpcds_q13/datafusion:vortex-file-compressed 31177630 / 31325734 / -0.5% 55554780 / 55162106 / +0.7% 0.56 / 0.57 / -1.2%
tpcds_q14/datafusion:vortex-file-compressed 490974428 / 489725025 / +0.3% 540825613 / 542579740 / -0.3% 0.91 / 0.90 / +0.6%
tpcds_q15/datafusion:vortex-file-compressed 12751458 / 12639795 / +0.9% 31966727 / 32957465 / -3.0% 0.40 / 0.38 / +4.0%
tpcds_q16/datafusion:vortex-file-compressed 18392653 / 18766476 / -2.0% 40332187 / 37511676 / +7.5% 0.46 / 0.50 / -8.8%
tpcds_q17/datafusion:vortex-file-compressed 52734030 / 51569060 / +2.3% 78249930 / 76120768 / +2.8% 0.67 / 0.68 / -0.5%
tpcds_q18/datafusion:vortex-file-compressed 63238968 / 63264772 / -0.0% 72740736 / 73161486 / -0.6% 0.87 / 0.86 / +0.5%
tpcds_q19/datafusion:vortex-file-compressed 17045682 / 17350284 / -1.8% 40097468 / 41565312 / -3.5% 0.43 / 0.42 / +1.8%
tpcds_q20/datafusion:vortex-file-compressed 16802986 / 16763912 / +0.2% 35064841 / 35728404 / -1.9% 0.48 / 0.47 / +2.1%
tpcds_q21/datafusion:vortex-file-compressed 15120592 / 15624810 / -3.2% 36413794 / 33632718 / +8.3% 0.42 / 0.46 / -10.6%
tpcds_q22/datafusion:vortex-file-compressed 50255558 / 49516638 / +1.5% 71584854 / 71172228 / +0.6% 0.70 / 0.70 / +0.9%
tpcds_q23/datafusion:vortex-file-compressed 71979776 / 71304302 / +0.9% 97280358 / 97980000 / -0.7% 0.74 / 0.73 / +1.7%
tpcds_q24/datafusion:vortex-file-compressed 63576598 / 63141270 / +0.7% 87746972 / 85963738 / +2.1% 0.72 / 0.73 / -1.4%
tpcds_q25/datafusion:vortex-file-compressed 45141520 / 45622760 / -1.1% 69283767 / 62971971 / +10.0% 🔴 0.65 / 0.72 / -10.1%
tpcds_q26/datafusion:vortex-file-compressed 27507378 / 26520866 / +3.7% 47195924 / 47654717 / -1.0% 0.58 / 0.56 / +4.7%
tpcds_q27/datafusion:vortex-file-compressed 52253681 / 51206899 / +2.0% 74043802 / 72593767 / +2.0% 0.71 / 0.71 / +0.0%
tpcds_q28/datafusion:vortex-file-compressed 19907951 / 19336810 / +3.0% 39658110 / 38117848 / +4.0% 0.50 / 0.51 / -1.0%
tpcds_q29/datafusion:vortex-file-compressed 52904194 / 51274976 / +3.2% 74830021 / 76240888 / -1.9% 0.71 / 0.67 / +5.1%
tpcds_q30/datafusion:vortex-file-compressed 27506454 / 27491942 / +0.1% 47266811 / 45853610 / +3.1% 0.58 / 0.60 / -2.9%
tpcds_q31/datafusion:vortex-file-compressed 64362123 / 64589481 / -0.4% 92416879 / 90133342 / +2.5% 0.70 / 0.72 / -2.8%
tpcds_q32/datafusion:vortex-file-compressed 13108509 / 12931906 / +1.4% 31033792 / 30373753 / +2.2% 0.42 / 0.43 / -0.8%
tpcds_q33/datafusion:vortex-file-compressed 28548683 / 28384206 / +0.6% 52348131 / 50398735 / +3.9% 0.55 / 0.56 / -3.2%
tpcds_q34/datafusion:vortex-file-compressed 17775110 / 17520708 / +1.5% 37604717 / 37014959 / +1.6% 0.47 / 0.47 / -0.1%
tpcds_q35/datafusion:vortex-file-compressed 31483981 / 31769318 / -0.9% 55147479 / 54113744 / +1.9% 0.57 / 0.59 / -2.8%
tpcds_q36/datafusion:vortex-file-compressed 47555597 / 47716595 / -0.3% 70382876 / 68773145 / +2.3% 0.68 / 0.69 / -2.6%
tpcds_q37/datafusion:vortex-file-compressed 12506759 / 12844061 / -2.6% 35324130 / 35356603 / -0.1% 0.35 / 0.36 / -2.5%
tpcds_q38/datafusion:vortex-file-compressed 26447941 / 26483066 / -0.1% 49051977 / 47783980 / +2.7% 0.54 / 0.55 / -2.7%
tpcds_q39/datafusion:vortex-file-compressed 63587377 / 64445812 / -1.3% 88658200 / 86663819 / +2.3% 0.72 / 0.74 / -3.6%
tpcds_q40/datafusion:vortex-file-compressed 23264371 / 23224878 / +0.2% 41532870 / 42059935 / -1.3% 0.56 / 0.55 / +1.4%
tpcds_q41/datafusion:vortex-file-compressed 20166986 / 20330407 / -0.8% 34163789 / 33352134 / +2.4% 0.59 / 0.61 / -3.2%
tpcds_q42/datafusion:vortex-file-compressed 11707808 / 11740064 / -0.3% 30962013 / 31600448 / -2.0% 0.38 / 0.37 / +1.8%
tpcds_q43/datafusion:vortex-file-compressed 13213203 / 13449912 / -1.8% 32819371 / 31814484 / +3.2% 0.40 / 0.42 / -4.8%
tpcds_q44/datafusion:vortex-file-compressed 27100684 / 27548430 / -1.6% 52593065 / 50740431 / +3.7% 0.52 / 0.54 / -5.1%
tpcds_q45/datafusion:vortex-file-compressed 17059599 / 17195040 / -0.8% 37980930 / 36797083 / +3.2% 0.45 / 0.47 / -3.9%
tpcds_q46/datafusion:vortex-file-compressed 24019446 / 23785493 / +1.0% 47126056 / 47094143 / +0.1% 0.51 / 0.51 / +0.9%
tpcds_q47/datafusion:vortex-file-compressed 75639791 / 76091086 / -0.6% 106134188 / 106004418 / +0.1% 0.71 / 0.72 / -0.7%
tpcds_q48/datafusion:vortex-file-compressed 28916328 / 28474080 / +1.6% 52885484 / 54456325 / -2.9% 0.55 / 0.52 / +4.6%
tpcds_q49/datafusion:vortex-file-compressed 57525330 / 58515857 / -1.7% 79279260 / 76409828 / +3.8% 0.73 / 0.77 / -5.3%
tpcds_q50/datafusion:vortex-file-compressed 30718924 / 31890967 / -3.7% 55248355 / 51383527 / +7.5% 0.56 / 0.62 / -10.4%
tpcds_q51/datafusion:vortex-file-compressed 67419872 / 67434820 / -0.0% 91065157 / 90841941 / +0.2% 0.74 / 0.74 / -0.3%
tpcds_q52/datafusion:vortex-file-compressed 12084426 / 11993827 / +0.8% 30673175 / 28929918 / +6.0% 0.39 / 0.41 / -5.0%
tpcds_q53/datafusion:vortex-file-compressed 18570036 / 18619456 / -0.3% 40714207 / 38248281 / +6.4% 0.46 / 0.49 / -6.3%
tpcds_q54/datafusion:vortex-file-compressed 32135216 / 31449879 / +2.2% 55953267 / 54716319 / +2.3% 0.57 / 0.57 / -0.1%
tpcds_q55/datafusion:vortex-file-compressed 11712730 / 11392758 / +2.8% 29363458 / 29918834 / -1.9% 0.40 / 0.38 / +4.8%
tpcds_q56/datafusion:vortex-file-compressed 26863230 / 26542604 / +1.2% 48876022 / 48361813 / +1.1% 0.55 / 0.55 / +0.1%
tpcds_q57/datafusion:vortex-file-compressed 62916886 / 62535718 / +0.6% 89361680 / 90062048 / -0.8% 0.70 / 0.69 / +1.4%
tpcds_q58/datafusion:vortex-file-compressed 40824542 / 41058312 / -0.6% 70963761 / 66894407 / +6.1% 0.58 / 0.61 / -6.3%
tpcds_q59/datafusion:vortex-file-compressed 27202932 / 27682006 / -1.7% 53586179 / 53241014 / +0.6% 0.51 / 0.52 / -2.4%
tpcds_q60/datafusion:vortex-file-compressed 27063626 / 27698822 / -2.3% 48705546 / 47904057 / +1.7% 0.56 / 0.58 / -3.9%
tpcds_q61/datafusion:vortex-file-compressed 21098137 / 21827974 / -3.3% 42707861 / 42221954 / +1.2% 0.49 / 0.52 / -4.4%
tpcds_q62/datafusion:vortex-file-compressed 16568384 / 16346910 / +1.4% 35161175 / 33368213 / +5.4% 0.47 / 0.49 / -3.8%
tpcds_q63/datafusion:vortex-file-compressed 18151891 / 18513864 / -2.0% 39599678 / 38721639 / +2.3% 0.46 / 0.48 / -4.1%
tpcds_q64/datafusion:vortex-file-compressed 188380674 / 189356710 / -0.5% 219971310 / 220791444 / -0.4% 0.86 / 0.86 / -0.1%
tpcds_q65/datafusion:vortex-file-compressed 74035388 / 73176118 / +1.2% 94643215 / 95250307 / -0.6% 0.78 / 0.77 / +1.8%
tpcds_q66/datafusion:vortex-file-compressed 49527838 / 49397672 / +0.3% 70425346 / 70770555 / -0.5% 0.70 / 0.70 / +0.8%
tpcds_q67/datafusion:vortex-file-compressed 51174795 / 51718615 / -1.1% 82254543 / 82994266 / -0.9% 0.62 / 0.62 / -0.2%
tpcds_q68/datafusion:vortex-file-compressed 22844284 / 23106009 / -1.1% 48037727 / 46984068 / +2.2% 0.48 / 0.49 / -3.3%
tpcds_q69/datafusion:vortex-file-compressed 27765610 / 27756974 / +0.0% 50064806 / 51840605 / -3.4% 0.55 / 0.54 / +3.6%
tpcds_q70/datafusion:vortex-file-compressed 73215528 / 73511502 / -0.4% 98008207 / 93355281 / +5.0% 0.75 / 0.79 / -5.1%
tpcds_q71/datafusion:vortex-file-compressed 19416039 / 20189894 / -3.8% 40233934 / 40220431 / +0.0% 0.48 / 0.50 / -3.9%
tpcds_q72/datafusion:vortex-file-compressed 249465054 / 263523230 / -5.3% 282425341 / 283566169 / -0.4% 0.88 / 0.93 / -5.0%
tpcds_q73/datafusion:vortex-file-compressed 16387078 / 16759658 / -2.2% 36322950 / 40334304 / -9.9% 0.45 / 0.42 / +8.6%
tpcds_q74/datafusion:vortex-file-compressed 40770168 / 41297670 / -1.3% 67136301 / 66363447 / +1.2% 0.61 / 0.62 / -2.4%
tpcds_q75/datafusion:vortex-file-compressed 133419575 / 134385593 / -0.7% 168656503 / 157447437 / +7.1% 0.79 / 0.85 / -7.3%
tpcds_q76/datafusion:vortex-file-compressed 29770144 / 29452846 / +1.1% 51333122 / 50443050 / +1.8% 0.58 / 0.58 / -0.7%
tpcds_q77/datafusion:vortex-file-compressed 45252998 / 44951976 / +0.7% 68956211 / 68165841 / +1.2% 0.66 / 0.66 / -0.5%
tpcds_q78/datafusion:vortex-file-compressed 61126496 / 61279398 / -0.2% 89973717 / 88509124 / +1.7% 0.68 / 0.69 / -1.9%
tpcds_q79/datafusion:vortex-file-compressed 20049375 / 20165178 / -0.6% 43205297 / 41024960 / +5.3% 0.46 / 0.49 / -5.6%
tpcds_q80/datafusion:vortex-file-compressed 68818166 / 68550936 / +0.4% 95960720 / 96419215 / -0.5% 0.72 / 0.71 / +0.9%
tpcds_q81/datafusion:vortex-file-compressed 28046958 / 28078232 / -0.1% 49008873 / 48383288 / +1.3% 0.57 / 0.58 / -1.4%
tpcds_q82/datafusion:vortex-file-compressed 12419348 / 12801766 / -3.0% 34319317 / 35865237 / -4.3% 0.36 / 0.36 / +1.4%
tpcds_q83/datafusion:vortex-file-compressed 35089398 / 35032074 / +0.2% 57184803 / 53887625 / +6.1% 0.61 / 0.65 / -5.6%
tpcds_q84/datafusion:vortex-file-compressed 10717928 / 10756595 / -0.4% 27373007 / 27782541 / -1.5% 0.39 / 0.39 / +1.1%
tpcds_q85/datafusion:vortex-file-compressed 53907800 / 52303138 / +3.1% 78535306 / 79455393 / -1.2% 0.69 / 0.66 / +4.3%
tpcds_q86/datafusion:vortex-file-compressed 16627088 / 16287572 / +2.1% 36341696 / 35216862 / +3.2% 0.46 / 0.46 / -1.1%
tpcds_q87/datafusion:vortex-file-compressed 26021334 / 26410185 / -1.5% 49657644 / 48761572 / +1.8% 0.52 / 0.54 / -3.3%
tpcds_q88/datafusion:vortex-file-compressed 32993310 / 33880505 / -2.6% 55816280 / 57223533 / -2.5% 0.59 / 0.59 / -0.2%
tpcds_q89/datafusion:vortex-file-compressed 22120115 / 21858842 / +1.2% 45044568 / 42578582 / +5.8% 0.49 / 0.51 / -4.3%
tpcds_q90/datafusion:vortex-file-compressed 11342364 / 11049958 / +2.6% 28154167 / 26272437 / +7.2% 0.40 / 0.42 / -4.2%
tpcds_q91/datafusion:vortex-file-compressed 16217392 / 16082788 / +0.8% 38170748 / 35516223 / +7.5% 0.42 / 0.45 / -6.2%
tpcds_q92/datafusion:vortex-file-compressed 13616364 / 13231007 / +2.9% 32387116 / 31787880 / +1.9% 0.42 / 0.42 / +1.0%
tpcds_q93/datafusion:vortex-file-compressed 19933362 / 20590870 / -3.2% 42711360 / 40390250 / +5.7% 0.47 / 0.51 / -8.5%
tpcds_q94/datafusion:vortex-file-compressed 18820179 / 18957142 / -0.7% 38659653 / 37486525 / +3.1% 0.49 / 0.51 / -3.7%
tpcds_q95/datafusion:vortex-file-compressed 42402266 / 41719594 / +1.6% 62250090 / 61941960 / +0.5% 0.68 / 0.67 / +1.1%
tpcds_q96/datafusion:vortex-file-compressed 7912210 / 7854926 / +0.7% 25736949 / 25068433 / +2.7% 0.31 / 0.31 / -1.9%
tpcds_q97/datafusion:vortex-file-compressed 17730719 / 17823196 / -0.5% 39978883 / 39323107 / +1.7% 0.44 / 0.45 / -2.2%
tpcds_q98/datafusion:vortex-file-compressed 16342680 / 16305044 / +0.2% 36238796 / 35075489 / +3.3% 0.45 / 0.46 / -3.0%
tpcds_q99/datafusion:vortex-file-compressed 16528264 / 16704089 / -1.1% 34546285 / 34115262 / +1.3% 0.48 / 0.49 / -2.3%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 21984143 / 21753367 / +1.1% 42077575 / 41935886 / +0.3% 0.52 / 0.52 / +0.7%
tpcds_q02/datafusion:vortex-compact 43107718 / 43320863 / -0.5% 65806816 / 64256944 / +2.4% 0.66 / 0.67 / -2.8%
tpcds_q03/datafusion:vortex-compact 12082577 / 12583138 / -4.0% 34056258 / 31620811 / +7.7% 0.35 / 0.40 / -10.8%
tpcds_q04/datafusion:vortex-compact 90073702 / 88488449 / +1.8% 119412469 / 121270975 / -1.5% 0.75 / 0.73 / +3.4%
tpcds_q05/datafusion:vortex-compact 57268500 / 57350208 / -0.1% 82514786 / 82822053 / -0.4% 0.69 / 0.69 / +0.2%
tpcds_q06/datafusion:vortex-compact 23922804 / 24368094 / -1.8% 45985306 / 46914208 / -2.0% 0.52 / 0.52 / +0.2%
tpcds_q07/datafusion:vortex-compact 28459038 / 29106081 / -2.2% 51777778 / 50970180 / +1.6% 0.55 / 0.57 / -3.7%
tpcds_q08/datafusion:vortex-compact 27569216 / 27148384 / +1.6% 48524245 / 48422840 / +0.2% 0.57 / 0.56 / +1.3%
tpcds_q09/datafusion:vortex-compact 21165072 / 22258434 / -4.9% 40629115 / 40624482 / +0.0% 0.52 / 0.55 / -4.9%
tpcds_q10/datafusion:vortex-compact 35093564 / 34538565 / +1.6% 58835103 / 57196900 / +2.9% 0.60 / 0.60 / -1.2%
tpcds_q11/datafusion:vortex-compact 51979064 / 51990141 / -0.0% 79603394 / 78592601 / +1.3% 0.65 / 0.66 / -1.3%
tpcds_q12/datafusion:vortex-compact 19482066 / 19212378 / +1.4% 38828478 / 38707408 / +0.3% 0.50 / 0.50 / +1.1%
tpcds_q13/datafusion:vortex-compact 45811243 / 45812746 / -0.0% 67384493 / 66148599 / +1.9% 0.68 / 0.69 / -1.8%
tpcds_q14/datafusion:vortex-compact 651519536 / 652944056 / -0.2% 713160723 / 705730844 / +1.1% 0.91 / 0.93 / -1.3%
tpcds_q15/datafusion:vortex-compact 13472211 / 13380064 / +0.7% 33472623 / 34360417 / -2.6% 0.40 / 0.39 / +3.4%
tpcds_q16/datafusion:vortex-compact 20509136 / 20129700 / +1.9% 40319743 / 39520277 / +2.0% 0.51 / 0.51 / -0.1%
tpcds_q17/datafusion:vortex-compact 57754628 / 57184046 / +1.0% 81032976 / 83943045 / -3.5% 0.71 / 0.68 / +4.6%
tpcds_q18/datafusion:vortex-compact 63334356 / 63156323 / +0.3% 74653083 / 75384223 / -1.0% 0.85 / 0.84 / +1.3%
tpcds_q19/datafusion:vortex-compact 19967245 / 20485081 / -2.5% 44215134 / 42098353 / +5.0% 0.45 / 0.49 / -7.2%
tpcds_q20/datafusion:vortex-compact 21080598 / 20981314 / +0.5% 39652681 / 40497633 / -2.1% 0.53 / 0.52 / +2.6%
tpcds_q21/datafusion:vortex-compact 17825593 / 17565988 / +1.5% 39111222 / 37339737 / +4.7% 0.46 / 0.47 / -3.1%
tpcds_q22/datafusion:vortex-compact 50395876 / 50067312 / +0.7% 73044181 / 71729750 / +1.8% 0.69 / 0.70 / -1.2%
tpcds_q23/datafusion:vortex-compact 75015325 / 74265836 / +1.0% 101296307 / 100430511 / +0.9% 0.74 / 0.74 / +0.1%
tpcds_q24/datafusion:vortex-compact 70258458 / 69291428 / +1.4% 93375045 / 98005535 / -4.7% 0.75 / 0.71 / +6.4%
tpcds_q25/datafusion:vortex-compact 49655267 / 50078974 / -0.8% 75756758 / 74159554 / +2.2% 0.66 / 0.68 / -2.9%
tpcds_q26/datafusion:vortex-compact 28781672 / 28377515 / +1.4% 46882833 / 47765258 / -1.8% 0.61 / 0.59 / +3.3%
tpcds_q27/datafusion:vortex-compact 53200456 / 53119775 / +0.2% 79014218 / 74700048 / +5.8% 0.67 / 0.71 / -5.3%
tpcds_q28/datafusion:vortex-compact 23583514 / 22810152 / +3.4% 44244249 / 41339166 / +7.0% 0.53 / 0.55 / -3.4%
tpcds_q29/datafusion:vortex-compact 56827981 / 55423722 / +2.5% 71866270 / 77150958 / -6.8% 0.79 / 0.72 / +10.1%
tpcds_q30/datafusion:vortex-compact 29479629 / 29553200 / -0.2% 48041014 / 48401692 / -0.7% 0.61 / 0.61 / +0.5%
tpcds_q31/datafusion:vortex-compact 67881703 / 67783439 / +0.1% 94943585 / 94464770 / +0.5% 0.71 / 0.72 / -0.4%
tpcds_q32/datafusion:vortex-compact 13937720 / 13957262 / -0.1% 34887881 / 33950302 / +2.8% 0.40 / 0.41 / -2.8%
tpcds_q33/datafusion:vortex-compact 29650077 / 29515252 / +0.5% 59366314 / 52642899 / +12.8% 🔴 0.50 / 0.56 / -10.9%
tpcds_q34/datafusion:vortex-compact 19988644 / 20279570 / -1.4% 41904601 / 39810806 / +5.3% 0.48 / 0.51 / -6.4%
tpcds_q35/datafusion:vortex-compact 38932140 / 37231655 / +4.6% 62017874 / 66248532 / -6.4% 0.63 / 0.56 / +11.7%
tpcds_q36/datafusion:vortex-compact 52069725 / 51658782 / +0.8% 73041835 / 77337648 / -5.6% 0.71 / 0.67 / +6.7%
tpcds_q37/datafusion:vortex-compact 14123314 / 13968004 / +1.1% 36711470 / 35074004 / +4.7% 0.38 / 0.40 / -3.4%
tpcds_q38/datafusion:vortex-compact 28025184 / 28060330 / -0.1% 49450476 / 49758355 / -0.6% 0.57 / 0.56 / +0.5%
tpcds_q39/datafusion:vortex-compact 67051381 / 65919746 / +1.7% 90258909 / 88252282 / +2.3% 0.74 / 0.75 / -0.5%
tpcds_q40/datafusion:vortex-compact 23860442 / 23634910 / +1.0% 44727873 / 45489841 / -1.7% 0.53 / 0.52 / +2.7%
tpcds_q41/datafusion:vortex-compact 20478600 / 20544253 / -0.3% 36115160 / 34906677 / +3.5% 0.57 / 0.59 / -3.7%
tpcds_q42/datafusion:vortex-compact 11777644 / 11893269 / -1.0% 31919012 / 31947108 / -0.1% 0.37 / 0.37 / -0.9%
tpcds_q43/datafusion:vortex-compact 14374198 / 14097848 / +2.0% 34008675 / 33237104 / +2.3% 0.42 / 0.42 / -0.4%
tpcds_q44/datafusion:vortex-compact 27217380 / 26791665 / +1.6% 51529516 / 48757277 / +5.7% 0.53 / 0.55 / -3.9%
tpcds_q45/datafusion:vortex-compact 17852503 / 17924797 / -0.4% 38472991 / 37288154 / +3.2% 0.46 / 0.48 / -3.5%
tpcds_q46/datafusion:vortex-compact 26190993 / 26321825 / -0.5% 48287711 / 47689159 / +1.3% 0.54 / 0.55 / -1.7%
tpcds_q47/datafusion:vortex-compact 80322715 / 79768324 / +0.7% 114141794 / 113519642 / +0.5% 0.70 / 0.70 / +0.1%
tpcds_q48/datafusion:vortex-compact 42091950 / 43066736 / -2.3% 71602866 / 65116911 / +10.0% 0.59 / 0.66 / -11.1%
tpcds_q49/datafusion:vortex-compact 57956584 / 57422458 / +0.9% 86051003 / 82758375 / +4.0% 0.67 / 0.69 / -2.9%
tpcds_q50/datafusion:vortex-compact 32691625 / 33215733 / -1.6% 59262606 / 58236106 / +1.8% 0.55 / 0.57 / -3.3%
tpcds_q51/datafusion:vortex-compact 67591678 / 68182886 / -0.9% 90305400 / 89729932 / +0.6% 0.75 / 0.76 / -1.5%
tpcds_q52/datafusion:vortex-compact 12325394 / 12577372 / -2.0% 35049599 / 33135055 / +5.8% 0.35 / 0.38 / -7.4%
tpcds_q53/datafusion:vortex-compact 22065112 / 22018350 / +0.2% 44420397 / 43628267 / +1.8% 0.50 / 0.50 / -1.6%
tpcds_q54/datafusion:vortex-compact 34393963 / 34390940 / +0.0% 60174718 / 58627087 / +2.6% 0.57 / 0.59 / -2.6%
tpcds_q55/datafusion:vortex-compact 11984535 / 12055019 / -0.6% 33019747 / 32118760 / +2.8% 0.36 / 0.38 / -3.3%
tpcds_q56/datafusion:vortex-compact 27787592 / 27969024 / -0.6% 51574393 / 51313393 / +0.5% 0.54 / 0.55 / -1.2%
tpcds_q57/datafusion:vortex-compact 67230102 / 67488304 / -0.4% 96679128 / 96029012 / +0.7% 0.70 / 0.70 / -1.1%
tpcds_q58/datafusion:vortex-compact 44763482 / 44940110 / -0.4% 78914244 / 72800530 / +8.4% 0.57 / 0.62 / -8.1%
tpcds_q59/datafusion:vortex-compact 29389867 / 29618037 / -0.8% 55901449 / 55127224 / +1.4% 0.53 / 0.54 / -2.1%
tpcds_q60/datafusion:vortex-compact 28162470 / 27797446 / +1.3% 52502569 / 50787756 / +3.4% 0.54 / 0.55 / -2.0%
tpcds_q61/datafusion:vortex-compact 24427198 / 23763284 / +2.8% 44471016 / 44208258 / +0.6% 0.55 / 0.54 / +2.2%
tpcds_q62/datafusion:vortex-compact 16970570 / 16982116 / -0.1% 34990077 / 34122576 / +2.5% 0.49 / 0.50 / -2.5%
tpcds_q63/datafusion:vortex-compact 21921424 / 21939844 / -0.1% 43014350 / 43613268 / -1.4% 0.51 / 0.50 / +1.3%
tpcds_q64/datafusion:vortex-compact 281240462 / 284477366 / -1.1% 314460699 / 313263194 / +0.4% 0.89 / 0.91 / -1.5%
tpcds_q65/datafusion:vortex-compact 76537178 / 77268300 / -0.9% 102082571 / 100678765 / +1.4% 0.75 / 0.77 / -2.3%
tpcds_q66/datafusion:vortex-compact 51393993 / 51210314 / +0.4% 73304142 / 74095330 / -1.1% 0.70 / 0.69 / +1.4%
tpcds_q67/datafusion:vortex-compact 52656428 / 53285684 / -1.2% 86032385 / 87782807 / -2.0% 0.61 / 0.61 / +0.8%
tpcds_q68/datafusion:vortex-compact 27182414 / 26507819 / +2.5% 49277387 / 49927003 / -1.3% 0.55 / 0.53 / +3.9%
tpcds_q69/datafusion:vortex-compact 33978028 / 33400588 / +1.7% 57030351 / 56042275 / +1.8% 0.60 / 0.60 / -0.0%
tpcds_q70/datafusion:vortex-compact 73496858 / 73662865 / -0.2% 100448422 / 96629858 / +4.0% 0.73 / 0.76 / -4.0%
tpcds_q71/datafusion:vortex-compact 19148010 / 19296443 / -0.8% 40161662 / 40749597 / -1.4% 0.48 / 0.47 / +0.7%
tpcds_q72/datafusion:vortex-compact 273383422 / 256338474 / +6.6% 276065411 / 289931064 / -4.8% 0.99 / 0.88 / +12.0%
tpcds_q73/datafusion:vortex-compact 20626971 / 20189596 / +2.2% 40196544 / 41489392 / -3.1% 0.51 / 0.49 / +5.5%
tpcds_q74/datafusion:vortex-compact 43572548 / 43281342 / +0.7% 71447024 / 70396892 / +1.5% 0.61 / 0.61 / -0.8%
tpcds_q75/datafusion:vortex-compact 138469212 / 137283545 / +0.9% 171310995 / 168050878 / +1.9% 0.81 / 0.82 / -1.1%
tpcds_q76/datafusion:vortex-compact 29441444 / 30492437 / -3.4% 51971222 / 51815516 / +0.3% 0.57 / 0.59 / -3.7%
tpcds_q77/datafusion:vortex-compact 46316848 / 47052384 / -1.6% 70214862 / 71457543 / -1.7% 0.66 / 0.66 / +0.2%
tpcds_q78/datafusion:vortex-compact 63181986 / 63919680 / -1.2% 91586291 / 90594951 / +1.1% 0.69 / 0.71 / -2.2%
tpcds_q79/datafusion:vortex-compact 23014870 / 22615920 / +1.8% 44318791 / 43860614 / +1.0% 0.52 / 0.52 / +0.7%
tpcds_q80/datafusion:vortex-compact 70847104 / 70709628 / +0.2% 99893001 / 99864648 / +0.0% 0.71 / 0.71 / +0.2%
tpcds_q81/datafusion:vortex-compact 29316560 / 29607514 / -1.0% 48791930 / 48333671 / +0.9% 0.60 / 0.61 / -1.9%
tpcds_q82/datafusion:vortex-compact 15446758 / 15179060 / +1.8% 39090423 / 38853271 / +0.6% 0.40 / 0.39 / +1.1%
tpcds_q83/datafusion:vortex-compact 36268886 / 36055407 / +0.6% 57016986 / 60777179 / -6.2% 0.64 / 0.59 / +7.2%
tpcds_q84/datafusion:vortex-compact 12409708 / 12137046 / +2.2% 28429264 / 28795062 / -1.3% 0.44 / 0.42 / +3.6%
tpcds_q85/datafusion:vortex-compact 95814272 / 95277862 / +0.6% 121746026 / 118219540 / +3.0% 0.79 / 0.81 / -2.3%
tpcds_q86/datafusion:vortex-compact 15810090 / 16257978 / -2.8% 35104798 / 35334586 / -0.7% 0.45 / 0.46 / -2.1%
tpcds_q87/datafusion:vortex-compact 27562315 / 27796740 / -0.8% 50015734 / 49526257 / +1.0% 0.55 / 0.56 / -1.8%
tpcds_q88/datafusion:vortex-compact 45489834 / 45914946 / -0.9% 66961508 / 67918578 / -1.4% 0.68 / 0.68 / +0.5%
tpcds_q89/datafusion:vortex-compact 23589985 / 23802381 / -0.9% 48114287 / 45906072 / +4.8% 0.49 / 0.52 / -5.4%
tpcds_q90/datafusion:vortex-compact 12278098 / 12084430 / +1.6% 29721350 / 28625071 / +3.8% 0.41 / 0.42 / -2.1%
tpcds_q91/datafusion:vortex-compact 25814003 / 26363418 / -2.1% 46516211 / 44469677 / +4.6% 0.55 / 0.59 / -6.4%
tpcds_q92/datafusion:vortex-compact 14267401 / 14254548 / +0.1% 33253225 / 33182460 / +0.2% 0.43 / 0.43 / -0.1%
tpcds_q93/datafusion:vortex-compact 20369410 / 20610701 / -1.2% 40286231 / 39645360 / +1.6% 0.51 / 0.52 / -2.7%
tpcds_q94/datafusion:vortex-compact 20445197 / 20080337 / +1.8% 40386073 / 40350072 / +0.1% 0.51 / 0.50 / +1.7%
tpcds_q95/datafusion:vortex-compact 42764604 / 43105360 / -0.8% 63014793 / 62193906 / +1.3% 0.68 / 0.69 / -2.1%
tpcds_q96/datafusion:vortex-compact 10749308 / 10352646 / +3.8% 27685947 / 29205620 / -5.2% 0.39 / 0.35 / +9.5%
tpcds_q97/datafusion:vortex-compact 18029409 / 18015504 / +0.1% 39645736 / 40054938 / -1.0% 0.45 / 0.45 / +1.1%
tpcds_q98/datafusion:vortex-compact 20609722 / 20581648 / +0.1% 42861242 / 40710045 / +5.3% 0.48 / 0.51 / -4.9%
tpcds_q99/datafusion:vortex-compact 17688572 / 17486656 / +1.2% 36593619 / 37205825 / -1.6% 0.48 / 0.47 / +2.8%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43722854 / 42948976 / +1.8% 59570638 / 60432562 / -1.4% 0.73 / 0.71 / +3.3%
tpcds_q02/datafusion:parquet 55242519 / 54696270 / +1.0% 69755407 / 68884339 / +1.3% 0.79 / 0.79 / -0.3%
tpcds_q03/datafusion:parquet 19278732 / 19402294 / -0.6% 30557756 / 31836087 / -4.0% 0.63 / 0.61 / +3.5%
tpcds_q04/datafusion:parquet 180111168 / 182111569 / -1.1% 204087073 / 202212042 / +0.9% 0.88 / 0.90 / -2.0%
tpcds_q05/datafusion:parquet 66573206 / 67109028 / -0.8% 89258578 / 85155663 / +4.8% 0.75 / 0.79 / -5.4%
tpcds_q06/datafusion:parquet 32828846 / 33982628 / -3.4% 47425183 / 48221092 / -1.7% 0.69 / 0.70 / -1.8%
tpcds_q07/datafusion:parquet 47045578 / 46482916 / +1.2% 66516575 / 66883902 / -0.5% 0.71 / 0.69 / +1.8%
tpcds_q08/datafusion:parquet 31290984 / 31364598 / -0.2% 45008000 / 48859389 / -7.9% 0.70 / 0.64 / +8.3%
tpcds_q09/datafusion:parquet 32298114 / 31920589 / +1.2% 46704190 / 42518908 / +9.8% 0.69 / 0.75 / -7.9%
tpcds_q10/datafusion:parquet 44089414 / 44041668 / +0.1% 59947558 / 58873436 / +1.8% 0.74 / 0.75 / -1.7%
tpcds_q11/datafusion:parquet 97734668 / 97794246 / -0.1% 119870143 / 121104489 / -1.0% 0.82 / 0.81 / +1.0%
tpcds_q12/datafusion:parquet 23583884 / 23981544 / -1.7% 37733063 / 35472336 / +6.4% 0.63 / 0.68 / -7.6%
tpcds_q13/datafusion:parquet 46294666 / 46021537 / +0.6% 70367060 / 67847167 / +3.7% 0.66 / 0.68 / -3.0%
tpcds_q14/datafusion:parquet 534375620 / 534748584 / -0.1% 580983069 / 591217548 / -1.7% 0.92 / 0.90 / +1.7%
tpcds_q15/datafusion:parquet 23895356 / 23310382 / +2.5% 38808373 / 38891497 / -0.2% 0.62 / 0.60 / +2.7%
tpcds_q16/datafusion:parquet 36834058 / 37197247 / -1.0% 51711898 / 48848306 / +5.9% 0.71 / 0.76 / -6.5%
tpcds_q17/datafusion:parquet 72911994 / 73182720 / -0.4% 99884309 / 97517298 / +2.4% 0.73 / 0.75 / -2.7%
tpcds_q18/datafusion:parquet 69002163 / 65204676 / +5.8% 88718819 / 88273676 / +0.5% 0.78 / 0.74 / +5.3%
tpcds_q19/datafusion:parquet 29484316 / 29783196 / -1.0% 44148668 / 44746935 / -1.3% 0.67 / 0.67 / +0.3%
tpcds_q20/datafusion:parquet 25660256 / 24966064 / +2.8% 37564798 / 37340395 / +0.6% 0.68 / 0.67 / +2.2%
tpcds_q21/datafusion:parquet 20655509 / 19945126 / +3.6% 32115078 / 31677352 / +1.4% 0.64 / 0.63 / +2.2%
tpcds_q22/datafusion:parquet 77514858 / 76917926 / +0.8% 89051713 / 88814833 / +0.3% 0.87 / 0.87 / +0.5%
tpcds_q23/datafusion:parquet 91828904 / 93128384 / -1.4% 113788365 / 118192465 / -3.7% 0.81 / 0.79 / +2.4%
tpcds_q24/datafusion:parquet 89830624 / 92124831 / -2.5% 113828400 / 115649391 / -1.6% 0.79 / 0.80 / -0.9%
tpcds_q25/datafusion:parquet 81189020 / 82150242 / -1.2% 108478084 / 101220506 / +7.2% 0.75 / 0.81 / -7.8%
tpcds_q26/datafusion:parquet 43815358 / 42481988 / +3.1% 59812150 / 59579262 / +0.4% 0.73 / 0.71 / +2.7%
tpcds_q27/datafusion:parquet 77843654 / 75345379 / +3.3% 99456017 / 95046009 / +4.6% 0.78 / 0.79 / -1.3%
tpcds_q28/datafusion:parquet 28613383 / 28427124 / +0.7% 42505974 / 44417670 / -4.3% 0.67 / 0.64 / +5.2%
tpcds_q29/datafusion:parquet 74625909 / 75845983 / -1.6% 100647378 / 98575571 / +2.1% 0.74 / 0.77 / -3.6%
tpcds_q30/datafusion:parquet 45797742 / 44441779 / +3.1% 60772282 / 59582469 / +2.0% 0.75 / 0.75 / +1.0%
tpcds_q31/datafusion:parquet 81032882 / 80531342 / +0.6% 102544841 / 96589944 / +6.2% 0.79 / 0.83 / -5.2%
tpcds_q32/datafusion:parquet 26532712 / 26922818 / -1.4% 40919132 / 39299175 / +4.1% 0.65 / 0.69 / -5.4%
tpcds_q33/datafusion:parquet 37560412 / 37323255 / +0.6% 51557353 / 51564828 / -0.0% 0.73 / 0.72 / +0.7%
tpcds_q34/datafusion:parquet 23971320 / 24345573 / -1.5% 35772043 / 35811463 / -0.1% 0.67 / 0.68 / -1.4%
tpcds_q35/datafusion:parquet 50368131 / 50783080 / -0.8% 64597809 / 65565910 / -1.5% 0.78 / 0.77 / +0.7%
tpcds_q36/datafusion:parquet 53149944 / 52941560 / +0.4% 72518100 / 71285891 / +1.7% 0.73 / 0.74 / -1.3%
tpcds_q37/datafusion:parquet 21206864 / 21829843 / -2.9% 34177595 / 32826756 / +4.1% 0.62 / 0.67 / -6.7%
tpcds_q38/datafusion:parquet 44998762 / 44791318 / +0.5% 60277160 / 59978989 / +0.5% 0.75 / 0.75 / -0.0%
tpcds_q39/datafusion:parquet 67741808 / 68070316 / -0.5% 85058176 / 86561125 / -1.7% 0.80 / 0.79 / +1.3%
tpcds_q40/datafusion:parquet 30780206 / 31248471 / -1.5% 51510382 / 49597722 / +3.9% 0.60 / 0.63 / -5.2%
tpcds_q41/datafusion:parquet 20620270 / 20168762 / +2.2% 33039912 / 32251160 / +2.4% 0.62 / 0.63 / -0.2%
tpcds_q42/datafusion:parquet 18141242 / 18342886 / -1.1% 33173001 / 29717635 / +11.6% 🔴 0.55 / 0.62 / -11.4%
tpcds_q43/datafusion:parquet 19366520 / 19297119 / +0.4% 31635328 / 32607146 / -3.0% 0.61 / 0.59 / +3.4%
tpcds_q44/datafusion:parquet 35540746 / 36582594 / -2.8% 50545891 / 50385187 / +0.3% 0.70 / 0.73 / -3.2%
tpcds_q45/datafusion:parquet 27777803 / 27984607 / -0.7% 41259982 / 41010680 / +0.6% 0.67 / 0.68 / -1.3%
tpcds_q46/datafusion:parquet 28843684 / 28922038 / -0.3% 46246972 / 46637226 / -0.8% 0.62 / 0.62 / +0.6%
tpcds_q47/datafusion:parquet 96159932 / 97068339 / -0.9% 119436875 / 120015113 / -0.5% 0.81 / 0.81 / -0.5%
tpcds_q48/datafusion:parquet 41752091 / 42031122 / -0.7% 59044754 / 58522723 / +0.9% 0.71 / 0.72 / -1.5%
tpcds_q49/datafusion:parquet 71968725 / 70882439 / +1.5% 95213891 / 94886211 / +0.3% 0.76 / 0.75 / +1.2%
tpcds_q50/datafusion:parquet 47024156 / 47629344 / -1.3% 68597891 / 67745684 / +1.3% 0.69 / 0.70 / -2.5%
tpcds_q51/datafusion:parquet 75156161 / 75578680 / -0.6% 94771101 / 96061472 / -1.3% 0.79 / 0.79 / +0.8%
tpcds_q52/datafusion:parquet 18763908 / 19039650 / -1.4% 30851493 / 30438317 / +1.4% 0.61 / 0.63 / -2.8%
tpcds_q53/datafusion:parquet 21963006 / 22358888 / -1.8% 38217778 / 39162676 / -2.4% 0.57 / 0.57 / +0.7%
tpcds_q54/datafusion:parquet 53366629 / 53451285 / -0.2% 68693775 / 67299913 / +2.1% 0.78 / 0.79 / -2.2%
tpcds_q55/datafusion:parquet 17956341 / 17955854 / +0.0% 30060139 / 31549462 / -4.7% 0.60 / 0.57 / +5.0%
tpcds_q56/datafusion:parquet 41609708 / 41332030 / +0.7% 54942020 / 54195461 / +1.4% 0.76 / 0.76 / -0.7%
tpcds_q57/datafusion:parquet 98927044 / 100212452 / -1.3% 117312316 / 119522698 / -1.8% 0.84 / 0.84 / +0.6%
tpcds_q58/datafusion:parquet 65645970 / 65582447 / +0.1% 84416227 / 83878557 / +0.6% 0.78 / 0.78 / -0.5%
tpcds_q59/datafusion:parquet 47902142 / 47805840 / +0.2% 65689535 / 65181041 / +0.8% 0.73 / 0.73 / -0.6%
tpcds_q60/datafusion:parquet 40284996 / 40456728 / -0.4% 54403145 / 54815053 / -0.8% 0.74 / 0.74 / +0.3%
tpcds_q61/datafusion:parquet 35960938 / 35489225 / +1.3% 52396418 / 51753639 / +1.2% 0.69 / 0.69 / +0.1%
tpcds_q62/datafusion:parquet 24907858 / 25463334 / -2.2% 38798846 / 38883831 / -0.2% 0.64 / 0.65 / -2.0%
tpcds_q63/datafusion:parquet 22116494 / 22280790 / -0.7% 37921492 / 38258058 / -0.9% 0.58 / 0.58 / +0.1%
tpcds_q64/datafusion:parquet 285875145 / 291335354 / -1.9% 328927247 / 326043321 / +0.9% 0.87 / 0.89 / -2.7%
tpcds_q65/datafusion:parquet 120105532 / 121639532 / -1.3% 144525785 / 141766986 / +1.9% 0.83 / 0.86 / -3.1%
tpcds_q66/datafusion:parquet 59907928 / 60237110 / -0.5% 76294744 / 74574142 / +2.3% 0.79 / 0.81 / -2.8%
tpcds_q67/datafusion:parquet 68698910 / 68291857 / +0.6% 93741768 / 92824201 / +1.0% 0.73 / 0.74 / -0.4%
tpcds_q68/datafusion:parquet 28797426 / 28880581 / -0.3% 48798142 / 48666870 / +0.3% 0.59 / 0.59 / -0.6%
tpcds_q69/datafusion:parquet 43720260 / 43583140 / +0.3% 56465578 / 58908192 / -4.1% 0.77 / 0.74 / +4.7%
tpcds_q70/datafusion:parquet 79454427 / 79966660 / -0.6% 98120386 / 97945745 / +0.2% 0.81 / 0.82 / -0.8%
tpcds_q71/datafusion:parquet 24846843 / 25169308 / -1.3% 39328040 / 38344253 / +2.6% 0.63 / 0.66 / -3.8%
tpcds_q72/datafusion:parquet 520077864 / 525096405 / -1.0% 563486694 / 554517239 / +1.6% 0.92 / 0.95 / -2.5%
tpcds_q73/datafusion:parquet 23650076 / 23548167 / +0.4% 36785383 / 36726978 / +0.2% 0.64 / 0.64 / +0.3%
tpcds_q74/datafusion:parquet 70788562 / 68357734 / +3.6% 91194309 / 89106371 / +2.3% 0.78 / 0.77 / +1.2%
tpcds_q75/datafusion:parquet 154662304 / 153471530 / +0.8% 181122834 / 180886022 / +0.1% 0.85 / 0.85 / +0.6%
tpcds_q76/datafusion:parquet 33227595 / 33385612 / -0.5% 49135629 / 47630683 / +3.2% 0.68 / 0.70 / -3.5%
tpcds_q77/datafusion:parquet 55706688 / 56797690 / -1.9% 76022108 / 76354603 / -0.4% 0.73 / 0.74 / -1.5%
tpcds_q78/datafusion:parquet 85009628 / 86609977 / -1.8% 119713847 / 119394244 / +0.3% 0.71 / 0.73 / -2.1%
tpcds_q79/datafusion:parquet 26408922 / 26804936 / -1.5% 42834830 / 42677620 / +0.4% 0.62 / 0.63 / -1.8%
tpcds_q80/datafusion:parquet 79812624 / 82130406 / -2.8% 110053741 / 110384615 / -0.3% 0.73 / 0.74 / -2.5%
tpcds_q81/datafusion:parquet 39241180 / 38837560 / +1.0% 52679984 / 51122765 / +3.0% 0.74 / 0.76 / -1.9%
tpcds_q82/datafusion:parquet 22429792 / 22726874 / -1.3% 37495112 / 35220664 / +6.5% 0.60 / 0.65 / -7.3%
tpcds_q83/datafusion:parquet 58472990 / 58036882 / +0.8% 75094446 / 74910869 / +0.2% 0.78 / 0.77 / +0.5%
tpcds_q84/datafusion:parquet 25836516 / 26380096 / -2.1% 40563663 / 40520414 / +0.1% 0.64 / 0.65 / -2.2%
tpcds_q85/datafusion:parquet 80681096 / 80106902 / +0.7% 105595866 / 102140635 / +3.4% 0.76 / 0.78 / -2.6%
tpcds_q86/datafusion:parquet 20671410 / 20698887 / -0.1% 33482712 / 33910327 / -1.3% 0.62 / 0.61 / +1.1%
tpcds_q87/datafusion:parquet 44096128 / 45243625 / -2.5% 60072607 / 61571984 / -2.4% 0.73 / 0.73 / -0.1%
tpcds_q88/datafusion:parquet 37884916 / 36668996 / +3.3% 52813054 / 51072605 / +3.4% 0.72 / 0.72 / -0.1%
tpcds_q89/datafusion:parquet 25714398 / 25880651 / -0.6% 42035020 / 41911320 / +0.3% 0.61 / 0.62 / -0.9%
tpcds_q90/datafusion:parquet 15586866 / 15950444 / -2.3% 27082695 / 26092143 / +3.8% 0.58 / 0.61 / -5.9%
tpcds_q91/datafusion:parquet 32464500 / 33401602 / -2.8% 47486894 / 45420101 / +4.6% 0.68 / 0.74 / -7.0%
tpcds_q92/datafusion:parquet 27152076 / 26865048 / +1.1% 41245696 / 40692745 / +1.4% 0.66 / 0.66 / -0.3%
tpcds_q93/datafusion:parquet 27169776 / 26126751 / +4.0% 47141432 / 46694564 / +1.0% 0.58 / 0.56 / +3.0%
tpcds_q94/datafusion:parquet 35311309 / 35397726 / -0.2% 50041241 / 49438350 / +1.2% 0.71 / 0.72 / -1.4%
tpcds_q95/datafusion:parquet 65691980 / 64737714 / +1.5% 78951405 / 76050619 / +3.8% 0.83 / 0.85 / -2.3%
tpcds_q96/datafusion:parquet 12712274 / 13026752 / -2.4% 24440384 / 24026930 / +1.7% 0.52 / 0.54 / -4.1%
tpcds_q97/datafusion:parquet 35270922 / 35119516 / +0.4% 51984243 / 50965356 / +2.0% 0.68 / 0.69 / -1.5%
tpcds_q98/datafusion:parquet 24769030 / 24546488 / +0.9% 40641996 / 39018632 / +4.2% 0.61 / 0.63 / -3.1%
tpcds_q99/datafusion:parquet 29809562 / 30165717 / -1.2% 43699012 / 43550417 / +0.3% 0.68 / 0.69 / -1.5%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16059752 / 16250098 / -1.2% 24309761 / 25099807 / -3.1% 0.66 / 0.65 / +2.0%
tpcds_q02/duckdb:vortex-file-compressed 15761260 / 17278894 / -8.8% 23290064 / 23043087 / +1.1% 0.68 / 0.75 / -9.8%
tpcds_q03/duckdb:vortex-file-compressed 7385020 / 7437204 / -0.7% 16182090 / 16062561 / +0.7% 0.46 / 0.46 / -1.4%
tpcds_q04/duckdb:vortex-file-compressed 59241462 / 59587556 / -0.6% 70928673 / 71456607 / -0.7% 0.84 / 0.83 / +0.2%
tpcds_q05/duckdb:vortex-file-compressed 23259716 / 23234050 / +0.1% 32072467 / 32542589 / -1.4% 0.73 / 0.71 / +1.6%
tpcds_q06/duckdb:vortex-file-compressed 24082123 / 24632049 / -2.2% 37413427 / 38460096 / -2.7% 0.64 / 0.64 / +0.5%
tpcds_q07/duckdb:vortex-file-compressed 22146742 / 22561137 / -1.8% 33988705 / 33886401 / +0.3% 0.65 / 0.67 / -2.1%
tpcds_q08/duckdb:vortex-file-compressed 17527297 / 17630972 / -0.6% 25264545 / 25498283 / -0.9% 0.69 / 0.69 / +0.3%
tpcds_q09/duckdb:vortex-file-compressed 19181522 / 19856948 / -3.4% 29429361 / 30703361 / -4.1% 0.65 / 0.65 / +0.8%
tpcds_q10/duckdb:vortex-file-compressed 27903752 / 28099268 / -0.7% 42474939 / 43318770 / -1.9% 0.66 / 0.65 / +1.3%
tpcds_q11/duckdb:vortex-file-compressed 36225280 / 36195554 / +0.1% 45154328 / 46759331 / -3.4% 0.80 / 0.77 / +3.6%
tpcds_q12/duckdb:vortex-file-compressed 10408970 / 10294676 / +1.1% 17148865 / 17582997 / -2.5% 0.61 / 0.59 / +3.7%
tpcds_q13/duckdb:vortex-file-compressed 20630700 / 20806577 / -0.8% 31954708 / 33212473 / -3.8% 0.65 / 0.63 / +3.1%
tpcds_q14/duckdb:vortex-file-compressed 55821174 / 57390305 / -2.7% 66547414 / 67443681 / -1.3% 0.84 / 0.85 / -1.4%
tpcds_q15/duckdb:vortex-file-compressed 11350541 / 11137911 / +1.9% 18640433 / 18116037 / +2.9% 0.61 / 0.61 / -1.0%
tpcds_q16/duckdb:vortex-file-compressed 24358792 / 24330160 / +0.1% 34519982 / 35071565 / -1.6% 0.71 / 0.69 / +1.7%
tpcds_q17/duckdb:vortex-file-compressed 20089751 / 20119198 / -0.1% 32954665 / 32184554 / +2.4% 0.61 / 0.63 / -2.5%
tpcds_q18/duckdb:vortex-file-compressed 32237554 / 32122300 / +0.4% 42659819 / 44341239 / -3.8% 0.76 / 0.72 / +4.3%
tpcds_q19/duckdb:vortex-file-compressed 20568833 / 21068336 / -2.4% 29530842 / 30327236 / -2.6% 0.70 / 0.69 / +0.3%
tpcds_q20/duckdb:vortex-file-compressed 11060452 / 11340172 / -2.5% 18705170 / 18699401 / +0.0% 0.59 / 0.61 / -2.5%
tpcds_q21/duckdb:vortex-file-compressed 10343110 / 10077514 / +2.6% 23080067 / 23423349 / -1.5% 0.45 / 0.43 / +4.2%
tpcds_q22/duckdb:vortex-file-compressed 18124578 / 18808860 / -3.6% 30543320 / 30727780 / -0.6% 0.59 / 0.61 / -3.1%
tpcds_q23/duckdb:vortex-file-compressed 37157710 / 37921296 / -2.0% 48998503 / 50351921 / -2.7% 0.76 / 0.75 / +0.7%
tpcds_q24/duckdb:vortex-file-compressed 26543364 / 26266124 / +1.1% 37331388 / 35690161 / +4.6% 0.71 / 0.74 / -3.4%
tpcds_q25/duckdb:vortex-file-compressed 18922050 / 19089964 / -0.9% 32350170 / 32065048 / +0.9% 0.58 / 0.60 / -1.8%
tpcds_q26/duckdb:vortex-file-compressed 21764554 / 21502554 / +1.2% 32020640 / 31840958 / +0.6% 0.68 / 0.68 / +0.7%
tpcds_q27/duckdb:vortex-file-compressed 24961465 / 25038554 / -0.3% 36814680 / 37017944 / -0.5% 0.68 / 0.68 / +0.2%
tpcds_q28/duckdb:vortex-file-compressed 15117556 / 15108214 / +0.1% 25768059 / 25533567 / +0.9% 0.59 / 0.59 / -0.8%
tpcds_q29/duckdb:vortex-file-compressed 18201061 / 18339060 / -0.8% 29834180 / 30409341 / -1.9% 0.61 / 0.60 / +1.2%
tpcds_q30/duckdb:vortex-file-compressed 18354825 / 18581736 / -1.2% 26813576 / 27361734 / -2.0% 0.68 / 0.68 / +0.8%
tpcds_q31/duckdb:vortex-file-compressed 18078726 / 18243522 / -0.9% 26954923 / 27214792 / -1.0% 0.67 / 0.67 / +0.1%
tpcds_q32/duckdb:vortex-file-compressed 10222612 / 10399264 / -1.7% 18733254 / 18493173 / +1.3% 0.55 / 0.56 / -3.0%
tpcds_q33/duckdb:vortex-file-compressed 18609621 / 18564528 / +0.2% 28270904 / 29549839 / -4.3% 0.66 / 0.63 / +4.8%
tpcds_q34/duckdb:vortex-file-compressed 12771782 / 12877292 / -0.8% 22936792 / 22387071 / +2.5% 0.56 / 0.58 / -3.2%
tpcds_q35/duckdb:vortex-file-compressed 31139176 / 30970548 / +0.5% 43691187 / 43777615 / -0.2% 0.71 / 0.71 / +0.7%
tpcds_q36/duckdb:vortex-file-compressed 14406196 / 14393074 / +0.1% 24725078 / 24268423 / +1.9% 0.58 / 0.59 / -1.8%
tpcds_q37/duckdb:vortex-file-compressed 9711574 / 10019183 / -3.1% 25135169 / 25220749 / -0.3% 0.39 / 0.40 / -2.7%
tpcds_q38/duckdb:vortex-file-compressed 24473972 / 24646964 / -0.7% 31657932 / 32931434 / -3.9% 0.77 / 0.75 / +3.3%
tpcds_q39/duckdb:vortex-file-compressed 19054078 / 18923791 / +0.7% 31848723 / 31952074 / -0.3% 0.60 / 0.59 / +1.0%
tpcds_q40/duckdb:vortex-file-compressed 11178758 / 11169597 / +0.1% 19320881 / 22546362 / -14.3% 🟢 0.58 / 0.50 / +16.8%
tpcds_q41/duckdb:vortex-file-compressed 17325832 / 17231207 / +0.5% 24110607 / 23933802 / +0.7% 0.72 / 0.72 / -0.2%
tpcds_q42/duckdb:vortex-file-compressed 7190154 / 7183621 / +0.1% 16239097 / 16169026 / +0.4% 0.44 / 0.44 / -0.3%
tpcds_q43/duckdb:vortex-file-compressed 10103636 / 10203030 / -1.0% 20046893 / 19174945 / +4.5% 0.50 / 0.53 / -5.3%
tpcds_q44/duckdb:vortex-file-compressed 12868019 / 13136822 / -2.0% 25696174 / 25121319 / +2.3% 0.50 / 0.52 / -4.2%
tpcds_q45/duckdb:vortex-file-compressed 23833044 / 24111002 / -1.2% 30449188 / 30760968 / -1.0% 0.78 / 0.78 / -0.1%
tpcds_q46/duckdb:vortex-file-compressed 31310052 / 31373780 / -0.2% 43378806 / 43693309 / -0.7% 0.72 / 0.72 / +0.5%
tpcds_q47/duckdb:vortex-file-compressed 31123534 / 31734104 / -1.9% 41715405 / 41851371 / -0.3% 0.75 / 0.76 / -1.6%
tpcds_q48/duckdb:vortex-file-compressed 23005468 / 22877604 / +0.6% 35195535 / 35241906 / -0.1% 0.65 / 0.65 / +0.7%
tpcds_q49/duckdb:vortex-file-compressed 18897320 / 19381704 / -2.5% 31701974 / 32078695 / -1.2% 0.60 / 0.60 / -1.3%
tpcds_q50/duckdb:vortex-file-compressed 14698606 / 15004814 / -2.0% 26332202 / 25457967 / +3.4% 0.56 / 0.59 / -5.3%
tpcds_q51/duckdb:vortex-file-compressed 49207266 / 49052069 / +0.3% 76251952 / 77903216 / -2.1% 0.65 / 0.63 / +2.5%
tpcds_q52/duckdb:vortex-file-compressed 7383426 / 7548967 / -2.2% 16548647 / 16228276 / +2.0% 0.45 / 0.47 / -4.1%
tpcds_q53/duckdb:vortex-file-compressed 11778620 / 11727082 / +0.4% 20501728 / 20700865 / -1.0% 0.57 / 0.57 / +1.4%
tpcds_q54/duckdb:vortex-file-compressed 19721931 / 20133189 / -2.0% 31545154 / 30917244 / +2.0% 0.63 / 0.65 / -4.0%
tpcds_q55/duckdb:vortex-file-compressed 7159978 / 7198320 / -0.5% 15972812 / 15825527 / +0.9% 0.45 / 0.45 / -1.4%
tpcds_q56/duckdb:vortex-file-compressed 18064892 / 18772263 / -3.8% 28772020 / 29469660 / -2.4% 0.63 / 0.64 / -1.4%
tpcds_q57/duckdb:vortex-file-compressed 25497416 / 25668054 / -0.7% 34333819 / 33650870 / +2.0% 0.74 / 0.76 / -2.6%
tpcds_q58/duckdb:vortex-file-compressed 20619552 / 20782554 / -0.8% 30462531 / 31757314 / -4.1% 0.68 / 0.65 / +3.4%
tpcds_q59/duckdb:vortex-file-compressed 19970117 / 20029180 / -0.3% 27040218 / 26689042 / +1.3% 0.74 / 0.75 / -1.6%
tpcds_q60/duckdb:vortex-file-compressed 18991666 / 19300668 / -1.6% 29415227 / 28970825 / +1.5% 0.65 / 0.67 / -3.1%
tpcds_q61/duckdb:vortex-file-compressed 19772543 / 20171274 / -2.0% 30778086 / 31128785 / -1.1% 0.64 / 0.65 / -0.9%
tpcds_q62/duckdb:vortex-file-compressed 11113504 / 11411038 / -2.6% 17751091 / 17670626 / +0.5% 0.63 / 0.65 / -3.0%
tpcds_q63/duckdb:vortex-file-compressed 11192534 / 11325182 / -1.2% 19876750 / 19710174 / +0.8% 0.56 / 0.57 / -2.0%
tpcds_q64/duckdb:vortex-file-compressed 52675462 / 52959080 / -0.5% 69209778 / 70180449 / -1.4% 0.76 / 0.75 / +0.9%
tpcds_q65/duckdb:vortex-file-compressed 13174426 / 13415832 / -1.8% 23364640 / 24396752 / -4.2% 0.56 / 0.55 / +2.5%
tpcds_q66/duckdb:vortex-file-compressed 31984482 / 31436579 / +1.7% 39420588 / 38980940 / +1.1% 0.81 / 0.81 / +0.6%
tpcds_q67/duckdb:vortex-file-compressed 55673205 / 55433592 / +0.4% 65699613 / 64468380 / +1.9% 0.85 / 0.86 / -1.4%
tpcds_q68/duckdb:vortex-file-compressed 22460455 / 22636864 / -0.8% 35114198 / 36394719 / -3.5% 0.64 / 0.62 / +2.8%
tpcds_q69/duckdb:vortex-file-compressed 22816591 / 22989176 / -0.8% 38080377 / 38051063 / +0.1% 0.60 / 0.60 / -0.8%
tpcds_q70/duckdb:vortex-file-compressed 15016011 / 14895883 / +0.8% 26114644 / 26790560 / -2.5% 0.58 / 0.56 / +3.4%
tpcds_q71/duckdb:vortex-file-compressed 13966016 / 14175623 / -1.5% 24270737 / 24399757 / -0.5% 0.58 / 0.58 / -1.0%
tpcds_q72/duckdb:vortex-file-compressed 43073758 / 43806326 / -1.7% 57062927 / 56806186 / +0.5% 0.75 / 0.77 / -2.1%
tpcds_q73/duckdb:vortex-file-compressed 11787843 / 11771057 / +0.1% 22323898 / 20990532 / +6.4% 0.53 / 0.56 / -5.8%
tpcds_q74/duckdb:vortex-file-compressed 31597559 / 31864177 / -0.8% 39844191 / 40922701 / -2.6% 0.79 / 0.78 / +1.8%
tpcds_q75/duckdb:vortex-file-compressed 37326000 / 37651410 / -0.9% 50333479 / 49584185 / +1.5% 0.74 / 0.76 / -2.3%
tpcds_q76/duckdb:vortex-file-compressed 13149903 / 13210344 / -0.5% 22343425 / 23512243 / -5.0% 0.59 / 0.56 / +4.7%
tpcds_q77/duckdb:vortex-file-compressed 20851948 / 21255998 / -1.9% 33779371 / 32844169 / +2.8% 0.62 / 0.65 / -4.6%
tpcds_q78/duckdb:vortex-file-compressed 43449896 / 43733182 / -0.6% 53454284 / 55247793 / -3.2% 0.81 / 0.79 / +2.7%
tpcds_q79/duckdb:vortex-file-compressed 16365670 / 16512568 / -0.9% 27382964 / 27046479 / +1.2% 0.60 / 0.61 / -2.1%
tpcds_q80/duckdb:vortex-file-compressed 30344666 / 30371416 / -0.1% 44551343 / 44664913 / -0.3% 0.68 / 0.68 / +0.2%
tpcds_q81/duckdb:vortex-file-compressed 21222362 / 21417750 / -0.9% 30658731 / 30848541 / -0.6% 0.69 / 0.69 / -0.3%
tpcds_q82/duckdb:vortex-file-compressed 10028808 / 9982004 / +0.5% 26379593 / 26820630 / -1.6% 0.38 / 0.37 / +2.1%
tpcds_q83/duckdb:vortex-file-compressed 17756666 / 17872918 / -0.7% 25547013 / 25656533 / -0.4% 0.70 / 0.70 / -0.2%
tpcds_q84/duckdb:vortex-file-compressed 15601818 / 15972707 / -2.3% 23606128 / 24105193 / -2.1% 0.66 / 0.66 / -0.3%
tpcds_q85/duckdb:vortex-file-compressed 25547837 / 25503396 / +0.2% 37899691 / 37441570 / +1.2% 0.67 / 0.68 / -1.0%
tpcds_q86/duckdb:vortex-file-compressed 10200678 / 10349925 / -1.4% 16621332 / 16954064 / -2.0% 0.61 / 0.61 / +0.5%
tpcds_q87/duckdb:vortex-file-compressed 25933939 / 26226628 / -1.1% 33237220 / 34083368 / -2.5% 0.78 / 0.77 / +1.4%
tpcds_q88/duckdb:vortex-file-compressed 30451037 / 31106918 / -2.1% 38431737 / 39028917 / -1.5% 0.79 / 0.80 / -0.6%
tpcds_q89/duckdb:vortex-file-compressed 12209920 / 12327209 / -1.0% 21530903 / 21903084 / -1.7% 0.57 / 0.56 / +0.8%
tpcds_q90/duckdb:vortex-file-compressed 7780193 / 8089860 / -3.8% 14550214 / 14706440 / -1.1% 0.53 / 0.55 / -2.8%
tpcds_q91/duckdb:vortex-file-compressed 14898428 / 15074703 / -1.2% 23739997 / 24156660 / -1.7% 0.63 / 0.62 / +0.6%
tpcds_q92/duckdb:vortex-file-compressed 10899376 / 10719787 / +1.7% 18566701 / 18440782 / +0.7% 0.59 / 0.58 / +1.0%
tpcds_q93/duckdb:vortex-file-compressed 9609321 / 9677784 / -0.7% 21857604 / 22333487 / -2.1% 0.44 / 0.43 / +1.5%
tpcds_q94/duckdb:vortex-file-compressed 21822242 / 22089106 / -1.2% 31716302 / 31657387 / +0.2% 0.69 / 0.70 / -1.4%
tpcds_q95/duckdb:vortex-file-compressed 59875572 / 59767405 / +0.2% 66980283 / 68264608 / -1.9% 0.89 / 0.88 / +2.1%
tpcds_q96/duckdb:vortex-file-compressed 6960172 / 6968500 / -0.1% 15326865 / 15500897 / -1.1% 0.45 / 0.45 / +1.0%
tpcds_q97/duckdb:vortex-file-compressed 23265348 / 23532142 / -1.1% 33448501 / 32221696 / +3.8% 0.70 / 0.73 / -4.8%
tpcds_q98/duckdb:vortex-file-compressed 11575974 / 11655704 / -0.7% 21345442 / 20411982 / +4.6% 0.54 / 0.57 / -5.0%
tpcds_q99/duckdb:vortex-file-compressed 14677735 / 14761818 / -0.6% 23113681 / 22910609 / +0.9% 0.64 / 0.64 / -1.4%
duckdb / vortex-compact / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17687242 / 17490356 / +1.1% 25913561 / 26448628 / -2.0% 0.68 / 0.66 / +3.2%
tpcds_q02/duckdb:vortex-compact 20640546 / 19732389 / +4.6% 24612673 / 24340053 / +1.1% 0.84 / 0.81 / +3.4%
tpcds_q03/duckdb:vortex-compact 8304485 / 8491580 / -2.2% 16307829 / 16954644 / -3.8% 0.51 / 0.50 / +1.7%
tpcds_q04/duckdb:vortex-compact 62908201 / 62664350 / +0.4% 76462040 / 75034873 / +1.9% 0.82 / 0.84 / -1.5%
tpcds_q05/duckdb:vortex-compact 24724536 / 25169732 / -1.8% 34342563 / 34335938 / +0.0% 0.72 / 0.73 / -1.8%
tpcds_q06/duckdb:vortex-compact 25557275 / 25938163 / -1.5% 38982286 / 39603814 / -1.6% 0.66 / 0.65 / +0.1%
tpcds_q07/duckdb:vortex-compact 26133722 / 26616454 / -1.8% 37769175 / 37977231 / -0.5% 0.69 / 0.70 / -1.3%
tpcds_q08/duckdb:vortex-compact 18005792 / 18208100 / -1.1% 26049943 / 26020750 / +0.1% 0.69 / 0.70 / -1.2%
tpcds_q09/duckdb:vortex-compact 20297998 / 20920412 / -3.0% 30696168 / 31608926 / -2.9% 0.66 / 0.66 / -0.1%
tpcds_q10/duckdb:vortex-compact 31459450 / 31632896 / -0.5% 46484249 / 45158331 / +2.9% 0.68 / 0.70 / -3.4%
tpcds_q11/duckdb:vortex-compact 38066355 / 38229404 / -0.4% 48160417 / 48836794 / -1.4% 0.79 / 0.78 / +1.0%
tpcds_q12/duckdb:vortex-compact 13086598 / 13333360 / -1.9% 21311549 / 21692388 / -1.8% 0.61 / 0.61 / -0.1%
tpcds_q13/duckdb:vortex-compact 33770462 / 34055064 / -0.8% 45775716 / 44542021 / +2.8% 0.74 / 0.76 / -3.5%
tpcds_q14/duckdb:vortex-compact 59498712 / 59215996 / +0.5% 68882157 / 68462219 / +0.6% 0.86 / 0.86 / -0.1%
tpcds_q15/duckdb:vortex-compact 12698414 / 12747444 / -0.4% 19809810 / 20011250 / -1.0% 0.64 / 0.64 / +0.6%
tpcds_q16/duckdb:vortex-compact 28863630 / 26914158 / +7.2% 37712972 / 36832657 / +2.4% 0.77 / 0.73 / +4.7%
tpcds_q17/duckdb:vortex-compact 23794282 / 23435184 / +1.5% 36103915 / 35579543 / +1.5% 0.66 / 0.66 / +0.1%
tpcds_q18/duckdb:vortex-compact 39680869 / 39477876 / +0.5% 49655491 / 50409032 / -1.5% 0.80 / 0.78 / +2.0%
tpcds_q19/duckdb:vortex-compact 23982088 / 23124256 / +3.7% 31548335 / 31631950 / -0.3% 0.76 / 0.73 / +4.0%
tpcds_q20/duckdb:vortex-compact 13827740 / 13790924 / +0.3% 22115875 / 22012051 / +0.5% 0.63 / 0.63 / -0.2%
tpcds_q21/duckdb:vortex-compact 12347506 / 12807276 / -3.6% 24966712 / 24532977 / +1.8% 0.49 / 0.52 / -5.3%
tpcds_q22/duckdb:vortex-compact 20127290 / 22610066 / -11.0% 🟢 32733523 / 32116472 / +1.9% 0.61 / 0.70 / -12.7%
tpcds_q23/duckdb:vortex-compact 42837960 / 43114273 / -0.6% 52454113 / 53781512 / -2.5% 0.82 / 0.80 / +1.9%
tpcds_q24/duckdb:vortex-compact 28277890 / 28145345 / +0.5% 38343202 / 38465986 / -0.3% 0.74 / 0.73 / +0.8%
tpcds_q25/duckdb:vortex-compact 22213412 / 22085572 / +0.6% 35648227 / 34626028 / +3.0% 0.62 / 0.64 / -2.3%
tpcds_q26/duckdb:vortex-compact 26895396 / 27036015 / -0.5% 37260976 / 37209068 / +0.1% 0.72 / 0.73 / -0.7%
tpcds_q27/duckdb:vortex-compact 28746518 / 29178519 / -1.5% 40562242 / 41001370 / -1.1% 0.71 / 0.71 / -0.4%
tpcds_q28/duckdb:vortex-compact 20794572 / 21211753 / -2.0% 30861594 / 30174231 / +2.3% 0.67 / 0.70 / -4.2%
tpcds_q29/duckdb:vortex-compact 21824814 / 21735043 / +0.4% 32948291 / 33578072 / -1.9% 0.66 / 0.65 / +2.3%
tpcds_q30/duckdb:vortex-compact 21644962 / 21784383 / -0.6% 30828587 / 31449037 / -2.0% 0.70 / 0.69 / +1.4%
tpcds_q31/duckdb:vortex-compact 19872400 / 19296413 / +3.0% 27856176 / 28464469 / -2.1% 0.71 / 0.68 / +5.2%
tpcds_q32/duckdb:vortex-compact 11202436 / 11069018 / +1.2% 20361424 / 19911989 / +2.3% 0.55 / 0.56 / -1.0%
tpcds_q33/duckdb:vortex-compact 19511552 / 20747545 / -6.0% 30531747 / 30428677 / +0.3% 0.64 / 0.68 / -6.3%
tpcds_q34/duckdb:vortex-compact 14256726 / 14593404 / -2.3% 23966921 / 23588351 / +1.6% 0.59 / 0.62 / -3.9%
tpcds_q35/duckdb:vortex-compact 33702294 / 33806128 / -0.3% 47140517 / 46874160 / +0.6% 0.71 / 0.72 / -0.9%
tpcds_q36/duckdb:vortex-compact 15524126 / 15743648 / -1.4% 25024992 / 25605526 / -2.3% 0.62 / 0.61 / +0.9%
tpcds_q37/duckdb:vortex-compact 12992703 / 13231830 / -1.8% 26546339 / 27515109 / -3.5% 0.49 / 0.48 / +1.8%
tpcds_q38/duckdb:vortex-compact 25004076 / 25442215 / -1.7% 33810916 / 33758980 / +0.2% 0.74 / 0.75 / -1.9%
tpcds_q39/duckdb:vortex-compact 20315172 / 20217686 / +0.5% 33484922 / 33517210 / -0.1% 0.61 / 0.60 / +0.6%
tpcds_q40/duckdb:vortex-compact 12876644 / 12673718 / +1.6% 21350716 / 21715625 / -1.7% 0.60 / 0.58 / +3.3%
tpcds_q41/duckdb:vortex-compact 19443710 / 19394030 / +0.3% 26027021 / 25950803 / +0.3% 0.75 / 0.75 / -0.0%
tpcds_q42/duckdb:vortex-compact 8534784 / 8089650 / +5.5% 17104322 / 16541365 / +3.4% 0.50 / 0.49 / +2.0%
tpcds_q43/duckdb:vortex-compact 10688200 / 10839572 / -1.4% 20767148 / 19778465 / +5.0% 0.51 / 0.55 / -6.1%
tpcds_q44/duckdb:vortex-compact 14494442 / 14805592 / -2.1% 26472187 / 26605963 / -0.5% 0.55 / 0.56 / -1.6%
tpcds_q45/duckdb:vortex-compact 24931316 / 25153772 / -0.9% 32473506 / 33453273 / -2.9% 0.77 / 0.75 / +2.1%
tpcds_q46/duckdb:vortex-compact 32992868 / 33166923 / -0.5% 45022566 / 45420094 / -0.9% 0.73 / 0.73 / +0.4%
tpcds_q47/duckdb:vortex-compact 34694876 / 32868420 / +5.6% 41876522 / 42598717 / -1.7% 0.83 / 0.77 / +7.4%
tpcds_q48/duckdb:vortex-compact 35528336 / 35583959 / -0.2% 47543180 / 47344036 / +0.4% 0.75 / 0.75 / -0.6%
tpcds_q49/duckdb:vortex-compact 22240388 / 22683636 / -2.0% 33883126 / 33434267 / +1.3% 0.66 / 0.68 / -3.3%
tpcds_q50/duckdb:vortex-compact 16293435 / 16598804 / -1.8% 24948593 / 26112548 / -4.5% 0.65 / 0.64 / +2.7%
tpcds_q51/duckdb:vortex-compact 50012898 / 49803742 / +0.4% 78883289 / 77905925 / +1.3% 0.63 / 0.64 / -0.8%
tpcds_q52/duckdb:vortex-compact 8446680 / 8416422 / +0.4% 16807776 / 16576875 / +1.4% 0.50 / 0.51 / -1.0%
tpcds_q53/duckdb:vortex-compact 13556503 / 13381490 / +1.3% 23042774 / 23107035 / -0.3% 0.59 / 0.58 / +1.6%
tpcds_q54/duckdb:vortex-compact 21186631 / 21067857 / +0.6% 31398151 / 30775083 / +2.0% 0.67 / 0.68 / -1.4%
tpcds_q55/duckdb:vortex-compact 8060112 / 7963406 / +1.2% 17354036 / 17040494 / +1.8% 0.46 / 0.47 / -0.6%
tpcds_q56/duckdb:vortex-compact 20199792 / 20841188 / -3.1% 30703630 / 31151371 / -1.4% 0.66 / 0.67 / -1.7%
tpcds_q57/duckdb:vortex-compact 26988136 / 27151033 / -0.6% 35476482 / 35079914 / +1.1% 0.76 / 0.77 / -1.7%
tpcds_q58/duckdb:vortex-compact 21934989 / 22191100 / -1.2% 31836568 / 33052958 / -3.7% 0.69 / 0.67 / +2.6%
tpcds_q59/duckdb:vortex-compact 20729447 / 20888747 / -0.8% 27482016 / 28413240 / -3.3% 0.75 / 0.74 / +2.6%
tpcds_q60/duckdb:vortex-compact 21399642 / 22210154 / -3.6% 30659318 / 31558114 / -2.8% 0.70 / 0.70 / -0.8%
tpcds_q61/duckdb:vortex-compact 21659088 / 22320663 / -3.0% 32209508 / 32041444 / +0.5% 0.67 / 0.70 / -3.5%
tpcds_q62/duckdb:vortex-compact 12933236 / 13084293 / -1.2% 19712606 / 19724636 / -0.1% 0.66 / 0.66 / -1.1%
tpcds_q63/duckdb:vortex-compact 12746162 / 12992907 / -1.9% 22551622 / 22623449 / -0.3% 0.57 / 0.57 / -1.6%
tpcds_q64/duckdb:vortex-compact 59357317 / 59966296 / -1.0% 74164780 / 75073276 / -1.2% 0.80 / 0.80 / +0.2%
tpcds_q65/duckdb:vortex-compact 14161710 / 14366766 / -1.4% 25150898 / 24723575 / +1.7% 0.56 / 0.58 / -3.1%
tpcds_q66/duckdb:vortex-compact 35863068 / 37350050 / -4.0% 41898846 / 42023020 / -0.3% 0.86 / 0.89 / -3.7%
tpcds_q67/duckdb:vortex-compact 58567781 / 60433897 / -3.1% 68094514 / 67296027 / +1.2% 0.86 / 0.90 / -4.2%
tpcds_q68/duckdb:vortex-compact 24213266 / 24508588 / -1.2% 36621032 / 36201372 / +1.2% 0.66 / 0.68 / -2.3%
tpcds_q69/duckdb:vortex-compact 26854090 / 27121544 / -1.0% 41910797 / 42408532 / -1.2% 0.64 / 0.64 / +0.2%
tpcds_q70/duckdb:vortex-compact 15662927 / 15899515 / -1.5% 25712808 / 26441333 / -2.8% 0.61 / 0.60 / +1.3%
tpcds_q71/duckdb:vortex-compact 14977706 / 14258832 / +5.0% 24815255 / 25621109 / -3.1% 0.60 / 0.56 / +8.5%
tpcds_q72/duckdb:vortex-compact 49038428 / 48966050 / +0.1% 62324879 / 61412939 / +1.5% 0.79 / 0.80 / -1.3%
tpcds_q73/duckdb:vortex-compact 13005831 / 13373999 / -2.8% 23411201 / 23236368 / +0.8% 0.56 / 0.58 / -3.5%
tpcds_q74/duckdb:vortex-compact 33226346 / 33607304 / -1.1% 41944205 / 42436155 / -1.2% 0.79 / 0.79 / +0.0%
tpcds_q75/duckdb:vortex-compact 40066477 / 39597059 / +1.2% 52468438 / 52141223 / +0.6% 0.76 / 0.76 / +0.6%
tpcds_q76/duckdb:vortex-compact 13533952 / 13752007 / -1.6% 22833859 / 23097993 / -1.1% 0.59 / 0.60 / -0.4%
tpcds_q77/duckdb:vortex-compact 23043723 / 23177824 / -0.6% 32414033 / 32968067 / -1.7% 0.71 / 0.70 / +1.1%
tpcds_q78/duckdb:vortex-compact 44877306 / 47334264 / -5.2% 55713383 / 55686455 / +0.0% 0.81 / 0.85 / -5.2%
tpcds_q79/duckdb:vortex-compact 17918081 / 17769670 / +0.8% 28599068 / 27946018 / +2.3% 0.63 / 0.64 / -1.5%
tpcds_q80/duckdb:vortex-compact 32210504 / 34022118 / -5.3% 45364429 / 45224171 / +0.3% 0.71 / 0.75 / -5.6%
tpcds_q81/duckdb:vortex-compact 23700696 / 23843702 / -0.6% 32175637 / 32321446 / -0.5% 0.74 / 0.74 / -0.1%
tpcds_q82/duckdb:vortex-compact 13678292 / 14096312 / -3.0% 29212954 / 29051691 / +0.6% 0.47 / 0.49 / -3.5%
tpcds_q83/duckdb:vortex-compact 18342502 / 18761020 / -2.2% 25734097 / 26819875 / -4.0% 0.71 / 0.70 / +1.9%
tpcds_q84/duckdb:vortex-compact 18250183 / 18278264 / -0.2% 24203248 / 24274116 / -0.3% 0.75 / 0.75 / +0.1%
tpcds_q85/duckdb:vortex-compact 39472658 / 39428220 / +0.1% 51378197 / 51924854 / -1.1% 0.77 / 0.76 / +1.2%
tpcds_q86/duckdb:vortex-compact 11172946 / 11185234 / -0.1% 18176888 / 18321238 / -0.8% 0.61 / 0.61 / +0.7%
tpcds_q87/duckdb:vortex-compact 26994598 / 27046924 / -0.2% 35473415 / 35396107 / +0.2% 0.76 / 0.76 / -0.4%
tpcds_q88/duckdb:vortex-compact 31163106 / 32025028 / -2.7% 38318768 / 38650277 / -0.9% 0.81 / 0.83 / -1.8%
tpcds_q89/duckdb:vortex-compact 13690037 / 14037290 / -2.5% 23257373 / 23343041 / -0.4% 0.59 / 0.60 / -2.1%
tpcds_q90/duckdb:vortex-compact 8398592 / 8451444 / -0.6% 14902743 / 15283456 / -2.5% 0.56 / 0.55 / +1.9%
tpcds_q91/duckdb:vortex-compact 23894232 / 23979449 / -0.4% 32950169 / 32992134 / -0.1% 0.73 / 0.73 / -0.2%
tpcds_q92/duckdb:vortex-compact 11520447 / 11800740 / -2.4% 18824136 / 19666184 / -4.3% 0.61 / 0.60 / +2.0%
tpcds_q93/duckdb:vortex-compact 11731309 / 11637960 / +0.8% 25144990 / 25244255 / -0.4% 0.47 / 0.46 / +1.2%
tpcds_q94/duckdb:vortex-compact 24016682 / 24384392 / -1.5% 34000214 / 33108927 / +2.7% 0.71 / 0.74 / -4.1%
tpcds_q95/duckdb:vortex-compact 61628516 / 62475926 / -1.4% 70268748 / 70858818 / -0.8% 0.88 / 0.88 / -0.5%
tpcds_q96/duckdb:vortex-compact 7389511 / 7636885 / -3.2% 14870514 / 15820267 / -6.0% 0.50 / 0.48 / +2.9%
tpcds_q97/duckdb:vortex-compact 23656279 / 23843600 / -0.8% 34166148 / 33386715 / +2.3% 0.69 / 0.71 / -3.0%
tpcds_q98/duckdb:vortex-compact 14199364 / 14395118 / -1.4% 24091471 / 24088337 / +0.0% 0.59 / 0.60 / -1.4%
tpcds_q99/duckdb:vortex-compact 16329304 / 16383748 / -0.3% 24268134 / 24278238 / -0.0% 0.67 / 0.67 / -0.3%
duckdb / parquet / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24078970 / 24183948 / -0.4% 30922482 / 30998809 / -0.2% 0.78 / 0.78 / -0.2%
tpcds_q02/duckdb:parquet 18045093 / 17911772 / +0.7% 24128918 / 24176810 / -0.2% 0.75 / 0.74 / +0.9%
tpcds_q03/duckdb:parquet 9866530 / 9803284 / +0.6% 15963454 / 15467033 / +3.2% 0.62 / 0.63 / -2.5%
tpcds_q04/duckdb:parquet 118234187 / 118248790 / -0.0% 127768308 / 126967025 / +0.6% 0.93 / 0.93 / -0.6%
tpcds_q05/duckdb:parquet 28267046 / 28519392 / -0.9% 32788028 / 32888344 / -0.3% 0.86 / 0.87 / -0.6%
tpcds_q06/duckdb:parquet 26246496 / 26325008 / -0.3% 36004360 / 35852805 / +0.4% 0.73 / 0.73 / -0.7%
tpcds_q07/duckdb:parquet 31338059 / 30675450 / +2.2% 38948936 / 38896569 / +0.1% 0.80 / 0.79 / +2.0%
tpcds_q08/duckdb:parquet 19584518 / 19894329 / -1.6% 25922851 / 26335801 / -1.6% 0.76 / 0.76 / +0.0%
tpcds_q09/duckdb:parquet 27193628 / 27749008 / -2.0% 29841781 / 30775943 / -3.0% 0.91 / 0.90 / +1.1%
tpcds_q10/duckdb:parquet 32620320 / 32804224 / -0.6% 40067002 / 41420643 / -3.3% 0.81 / 0.79 / +2.8%
tpcds_q11/duckdb:parquet 68770301 / 68485508 / +0.4% 74433610 / 76414411 / -2.6% 0.92 / 0.90 / +3.1%
tpcds_q12/duckdb:parquet 13968160 / 13990760 / -0.2% 19086349 / 19200254 / -0.6% 0.73 / 0.73 / +0.4%
tpcds_q13/duckdb:parquet 31556306 / 31525562 / +0.1% 38975128 / 39972625 / -2.5% 0.81 / 0.79 / +2.7%
tpcds_q14/duckdb:parquet 65488659 / 65879764 / -0.6% 68576826 / 68465478 / +0.2% 0.95 / 0.96 / -0.8%
tpcds_q15/duckdb:parquet 16625619 / 16609212 / +0.1% 22788056 / 22621459 / +0.7% 0.73 / 0.73 / -0.6%
tpcds_q16/duckdb:parquet 30270525 / 30145101 / +0.4% 37847783 / 37123810 / +2.0% 0.80 / 0.81 / -1.5%
tpcds_q17/duckdb:parquet 34277909 / 34488830 / -0.6% 40021668 / 39877275 / +0.4% 0.86 / 0.86 / -1.0%
tpcds_q18/duckdb:parquet 47197262 / 47490360 / -0.6% 54842034 / 54639326 / +0.4% 0.86 / 0.87 / -1.0%
tpcds_q19/duckdb:parquet 18771662 / 18932100 / -0.8% 25880762 / 26262688 / -1.5% 0.73 / 0.72 / +0.6%
tpcds_q20/duckdb:parquet 14823300 / 14927743 / -0.7% 19659998 / 19516088 / +0.7% 0.75 / 0.76 / -1.4%
tpcds_q21/duckdb:parquet 10450278 / 10600184 / -1.4% 17106250 / 16805537 / +1.8% 0.61 / 0.63 / -3.1%
tpcds_q22/duckdb:parquet 20566001 / 20628402 / -0.3% 26422871 / 26519116 / -0.4% 0.78 / 0.78 / +0.1%
tpcds_q23/duckdb:parquet 44581918 / 44713253 / -0.3% 49536894 / 50700885 / -2.3% 0.90 / 0.88 / +2.0%
tpcds_q24/duckdb:parquet 32421481 / 30158114 / +7.5% 36462663 / 36933118 / -1.3% 0.89 / 0.82 / +8.9%
tpcds_q25/duckdb:parquet 30182570 / 30353747 / -0.6% 37390922 / 37217364 / +0.5% 0.81 / 0.82 / -1.0%
tpcds_q26/duckdb:parquet 29062684 / 28880037 / +0.6% 36055221 / 35989188 / +0.2% 0.81 / 0.80 / +0.4%
tpcds_q27/duckdb:parquet 33255352 / 34792632 / -4.4% 41997702 / 41595531 / +1.0% 0.79 / 0.84 / -5.3%
tpcds_q28/duckdb:parquet 26409790 / 26285727 / +0.5% 33839185 / 32651138 / +3.6% 0.78 / 0.81 / -3.1%
tpcds_q29/duckdb:parquet 32316874 / 32287950 / +0.1% 39037401 / 40005666 / -2.4% 0.83 / 0.81 / +2.6%
tpcds_q30/duckdb:parquet 35331668 / 35694652 / -1.0% 44834859 / 44177979 / +1.5% 0.79 / 0.81 / -2.5%
tpcds_q31/duckdb:parquet 36387492 / 36197061 / +0.5% 43504245 / 42971717 / +1.2% 0.84 / 0.84 / -0.7%
tpcds_q32/duckdb:parquet 14115885 / 14264735 / -1.0% 20774167 / 20847000 / -0.3% 0.68 / 0.68 / -0.7%
tpcds_q33/duckdb:parquet 25592620 / 25468784 / +0.5% 28823699 / 29914950 / -3.6% 0.89 / 0.85 / +4.3%
tpcds_q34/duckdb:parquet 16883679 / 17371618 / -2.8% 24446441 / 24010123 / +1.8% 0.69 / 0.72 / -4.5%
tpcds_q35/duckdb:parquet 36286120 / 35045534 / +3.5% 44457984 / 43418333 / +2.4% 0.82 / 0.81 / +1.1%
tpcds_q36/duckdb:parquet 39174937 / 39587144 / -1.0% 47328614 / 47539537 / -0.4% 0.83 / 0.83 / -0.6%
tpcds_q37/duckdb:parquet 12920704 / 12713264 / +1.6% 19431280 / 19211654 / +1.1% 0.66 / 0.66 / +0.5%
tpcds_q38/duckdb:parquet 29824508 / 29809052 / +0.1% 34075335 / 34128948 / -0.2% 0.88 / 0.87 / +0.2%
tpcds_q39/duckdb:parquet 23436170 / 23769142 / -1.4% 30076332 / 29751887 / +1.1% 0.78 / 0.80 / -2.5%
tpcds_q40/duckdb:parquet 15906778 / 15960934 / -0.3% 21357877 / 21619475 / -1.2% 0.74 / 0.74 / +0.9%
tpcds_q41/duckdb:parquet 11860267 / 12053108 / -1.6% 17855451 / 17776293 / +0.4% 0.66 / 0.68 / -2.0%
tpcds_q42/duckdb:parquet 9481016 / 9571672 / -0.9% 15739667 / 15461737 / +1.8% 0.60 / 0.62 / -2.7%
tpcds_q43/duckdb:parquet 12065848 / 12272854 / -1.7% 18306249 / 17969502 / +1.9% 0.66 / 0.68 / -3.5%
tpcds_q44/duckdb:parquet 21824721 / 21310186 / +2.4% 26782796 / 27334098 / -2.0% 0.81 / 0.78 / +4.5%
tpcds_q45/duckdb:parquet 20930004 / 21148696 / -1.0% 27993019 / 28025043 / -0.1% 0.75 / 0.75 / -0.9%
tpcds_q46/duckdb:parquet 35511000 / 37814240 / -6.1% 43745227 / 43627648 / +0.3% 0.81 / 0.87 / -6.3%
tpcds_q47/duckdb:parquet 34548896 / 34262098 / +0.8% 41050199 / 41284663 / -0.6% 0.84 / 0.83 / +1.4%
tpcds_q48/duckdb:parquet 28711328 / 31356193 / -8.4% 36740751 / 37052139 / -0.8% 0.78 / 0.85 / -7.7%
tpcds_q49/duckdb:parquet 30608562 / 31519738 / -2.9% 36919675 / 36411043 / +1.4% 0.83 / 0.87 / -4.2%
tpcds_q50/duckdb:parquet 19312050 / 19372612 / -0.3% 25831796 / 25463911 / +1.4% 0.75 / 0.76 / -1.7%
tpcds_q51/duckdb:parquet 51649884 / 52063449 / -0.8% 60307756 / 77245115 / -21.9% 🟢 0.86 / 0.67 / +27.1%
tpcds_q52/duckdb:parquet 9635671 / 9757559 / -1.2% 15470295 / 15476158 / -0.0% 0.62 / 0.63 / -1.2%
tpcds_q53/duckdb:parquet 13822638 / 13993950 / -1.2% 20867670 / 21348523 / -2.3% 0.66 / 0.66 / +1.1%
tpcds_q54/duckdb:parquet 25703024 / 25124807 / +2.3% 32461064 / 32215937 / +0.8% 0.79 / 0.78 / +1.5%
tpcds_q55/duckdb:parquet 9364392 / 9502432 / -1.5% 15399522 / 15260962 / +0.9% 0.61 / 0.62 / -2.3%
tpcds_q56/duckdb:parquet 25929766 / 25207576 / +2.9% 30870396 / 32114321 / -3.9% 0.84 / 0.78 / +7.0%
tpcds_q57/duckdb:parquet 30636572 / 31063395 / -1.4% 36403089 / 36150842 / +0.7% 0.84 / 0.86 / -2.1%
tpcds_q58/duckdb:parquet 24612890 / 24757408 / -0.6% 29637116 / 30472066 / -2.7% 0.83 / 0.81 / +2.2%
tpcds_q59/duckdb:parquet 22940730 / 22798828 / +0.6% 29231553 / 28906771 / +1.1% 0.78 / 0.79 / -0.5%
tpcds_q60/duckdb:parquet 26762854 / 26956960 / -0.7% 32846506 / 32532636 / +1.0% 0.81 / 0.83 / -1.7%
tpcds_q61/duckdb:parquet 24587815 / 24809051 / -0.9% 28444935 / 29764030 / -4.4% 0.86 / 0.83 / +3.7%
tpcds_q62/duckdb:parquet 12687616 / 12722583 / -0.3% 17954412 / 17873299 / +0.5% 0.71 / 0.71 / -0.7%
tpcds_q63/duckdb:parquet 13358078 / 14462026 / -7.6% 20164413 / 20083520 / +0.4% 0.66 / 0.72 / -8.0%
tpcds_q64/duckdb:parquet 70670560 / 70980147 / -0.4% 80138184 / 80825045 / -0.8% 0.88 / 0.88 / +0.4%
tpcds_q65/duckdb:parquet 19291500 / 20420645 / -5.5% 25714466 / 25865496 / -0.6% 0.75 / 0.79 / -5.0%
tpcds_q66/duckdb:parquet 33190754 / 33477482 / -0.9% 38269222 / 38236144 / +0.1% 0.87 / 0.88 / -0.9%
tpcds_q67/duckdb:parquet 60407218 / 60911977 / -0.8% 66219859 / 66980967 / -1.1% 0.91 / 0.91 / +0.3%
tpcds_q68/duckdb:parquet 29499348 / 29623572 / -0.4% 35931759 / 36535992 / -1.7% 0.82 / 0.81 / +1.3%
tpcds_q69/duckdb:parquet 25797952 / 26011454 / -0.8% 34291729 / 34756621 / -1.3% 0.75 / 0.75 / +0.5%
tpcds_q70/duckdb:parquet 19184600 / 19213818 / -0.2% 27019449 / 26826123 / +0.7% 0.71 / 0.72 / -0.9%
tpcds_q71/duckdb:parquet 16782730 / 17086219 / -1.8% 23907640 / 24170562 / -1.1% 0.70 / 0.71 / -0.7%
tpcds_q72/duckdb:parquet 52838308 / 53404216 / -1.1% 60112073 / 60225117 / -0.2% 0.88 / 0.89 / -0.9%
tpcds_q73/duckdb:parquet 16240484 / 15313092 / +6.1% 21965631 / 21769502 / +0.9% 0.74 / 0.70 / +5.1%
tpcds_q74/duckdb:parquet 84743339 / 84502408 / +0.3% 91255729 / 91322699 / -0.1% 0.93 / 0.93 / +0.4%
tpcds_q75/duckdb:parquet 44850923 / 45226784 / -0.8% 50197981 / 49747952 / +0.9% 0.89 / 0.91 / -1.7%
tpcds_q76/duckdb:parquet 18419778 / 18828505 / -2.2% 23547648 / 23668487 / -0.5% 0.78 / 0.80 / -1.7%
tpcds_q77/duckdb:parquet 24751782 / 26232048 / -5.6% 31126196 / 32222487 / -3.4% 0.80 / 0.81 / -2.3%
tpcds_q78/duckdb:parquet 78548436 / 78620910 / -0.1% 85524872 / 86113098 / -0.7% 0.92 / 0.91 / +0.6%
tpcds_q79/duckdb:parquet 21280002 / 24128185 / -11.8% 🟢 28808149 / 29026344 / -0.8% 0.74 / 0.83 / -11.1%
tpcds_q80/duckdb:parquet 37079674 / 38953046 / -4.8% 43499440 / 44097261 / -1.4% 0.85 / 0.88 / -3.5%
tpcds_q81/duckdb:parquet 36280715 / 36396218 / -0.3% 44515727 / 45358052 / -1.9% 0.82 / 0.80 / +1.6%
tpcds_q82/duckdb:parquet 13530826 / 13533042 / -0.0% 20366967 / 20977204 / -2.9% 0.66 / 0.65 / +3.0%
tpcds_q83/duckdb:parquet 19995420 / 20423822 / -2.1% 25272046 / 25471648 / -0.8% 0.79 / 0.80 / -1.3%
tpcds_q84/duckdb:parquet 22972061 / 22991686 / -0.1% 28918030 / 29107703 / -0.7% 0.79 / 0.79 / +0.6%
tpcds_q85/duckdb:parquet 32294027 / 32455769 / -0.5% 39356786 / 39338042 / +0.0% 0.82 / 0.83 / -0.5%
tpcds_q86/duckdb:parquet 11797502 / 11990518 / -1.6% 17090411 / 17453589 / -2.1% 0.69 / 0.69 / +0.5%
tpcds_q87/duckdb:parquet 31361522 / 31551726 / -0.6% 36326378 / 35344570 / +2.8% 0.86 / 0.89 / -3.3%
tpcds_q88/duckdb:parquet 38517194 / 38833678 / -0.8% 41995592 / 43506157 / -3.5% 0.92 / 0.89 / +2.8%
tpcds_q89/duckdb:parquet 14103430 / 14394804 / -2.0% 21424848 / 21795793 / -1.7% 0.66 / 0.66 / -0.3%
tpcds_q90/duckdb:parquet 9986683 / 10140472 / -1.5% 15142116 / 15336926 / -1.3% 0.66 / 0.66 / -0.2%
tpcds_q91/duckdb:parquet 20890681 / 21229464 / -1.6% 28648635 / 28283429 / +1.3% 0.73 / 0.75 / -2.9%
tpcds_q92/duckdb:parquet 15587185 / 15786893 / -1.3% 22316549 / 22798904 / -2.1% 0.70 / 0.69 / +0.9%
tpcds_q93/duckdb:parquet 14167972 / 14190028 / -0.2% 20373308 / 20402346 / -0.1% 0.70 / 0.70 / -0.0%
tpcds_q94/duckdb:parquet 25517604 / 25501554 / +0.1% 32953509 / 33128962 / -0.5% 0.77 / 0.77 / +0.6%
tpcds_q95/duckdb:parquet 43555052 / 43820005 / -0.6% 49252027 / 49406377 / -0.3% 0.88 / 0.89 / -0.3%
tpcds_q96/duckdb:parquet 8180907 / 8323404 / -1.7% 13910501 / 13906181 / +0.0% 0.59 / 0.60 / -1.7%
tpcds_q97/duckdb:parquet 27520884 / 27570472 / -0.2% 34070605 / 34175901 / -0.3% 0.81 / 0.81 / +0.1%
tpcds_q98/duckdb:parquet 16501268 / 16498868 / +0.0% 23087207 / 23324013 / -1.0% 0.71 / 0.71 / +1.0%
tpcds_q99/duckdb:parquet 18708012 / 18858972 / -0.8% 24978952 / 24978215 / +0.0% 0.75 / 0.76 / -0.8%
duckdb / duckdb / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb 15194664 / 15694803 / -3.2% 24570414 / 25287160 / -2.8% 0.62 / 0.62 / -0.4%
tpcds_q02/duckdb:duckdb 12381522 / 12315474 / +0.5% 19464405 / 19188299 / +1.4% 0.64 / 0.64 / -0.9%
tpcds_q03/duckdb:duckdb 4954913 / 5045765 / -1.8% 11872213 / 12569503 / -5.5% 0.42 / 0.40 / +4.0%
tpcds_q04/duckdb:duckdb 48972298 / 48776548 / +0.4% 57333158 / 56135866 / +2.1% 0.85 / 0.87 / -1.7%
tpcds_q05/duckdb:duckdb 15126076 / 15364666 / -1.6% 22102549 / 21349597 / +3.5% 0.68 / 0.72 / -4.9%
tpcds_q06/duckdb:duckdb 17619955 / 17796972 / -1.0% 28845333 / 29898147 / -3.5% 0.61 / 0.60 / +2.6%
tpcds_q07/duckdb:duckdb 21121342 / 21063078 / +0.3% 32223937 / 32465617 / -0.7% 0.66 / 0.65 / +1.0%
tpcds_q08/duckdb:duckdb 18384364 / 18413148 / -0.2% 28720112 / 28402520 / +1.1% 0.64 / 0.65 / -1.3%
tpcds_q09/duckdb:duckdb 8739792 / 8625791 / +1.3% 14046158 / 13642490 / +3.0% 0.62 / 0.63 / -1.6%
tpcds_q10/duckdb:duckdb 17897718 / 17936288 / -0.2% 28520280 / 28126497 / +1.4% 0.63 / 0.64 / -1.6%
tpcds_q11/duckdb:duckdb 41949436 / 42121430 / -0.4% 51067509 / 50052106 / +2.0% 0.82 / 0.84 / -2.4%
tpcds_q12/duckdb:duckdb 9012828 / 9185422 / -1.9% 16766698 / 17372757 / -3.5% 0.54 / 0.53 / +1.7%
tpcds_q13/duckdb:duckdb 20122024 / 20178718 / -0.3% 31832100 / 33603038 / -5.3% 0.63 / 0.60 / +5.3%
tpcds_q14/duckdb:duckdb 39979018 / 40132446 / -0.4% 46672442 / 44952439 / +3.8% 0.86 / 0.89 / -4.1%
tpcds_q15/duckdb:duckdb 7971495 / 7962435 / +0.1% 14043764 / 14018393 / +0.2% 0.57 / 0.57 / -0.1%
tpcds_q16/duckdb:duckdb 12129726 / 12203218 / -0.6% 21606985 / 21820468 / -1.0% 0.56 / 0.56 / +0.4%
tpcds_q17/duckdb:duckdb 17410954 / 17674424 / -1.5% 29810346 / 29496914 / +1.1% 0.58 / 0.60 / -2.5%
tpcds_q18/duckdb:duckdb 32212255 / 32449558 / -0.7% 46788092 / 45956229 / +1.8% 0.69 / 0.71 / -2.5%
tpcds_q19/duckdb:duckdb 10500146 / 10524368 / -0.2% 20157527 / 20409653 / -1.2% 0.52 / 0.52 / +1.0%
tpcds_q20/duckdb:duckdb 9510539 / 9733187 / -2.3% 16866626 / 16665587 / +1.2% 0.56 / 0.58 / -3.5%
tpcds_q21/duckdb:duckdb 6070323 / 6089545 / -0.3% 11307812 / 11225630 / +0.7% 0.54 / 0.54 / -1.0%
tpcds_q22/duckdb:duckdb 17288886 / 17579050 / -1.7% 23128263 / 22897560 / +1.0% 0.75 / 0.77 / -2.6%
tpcds_q23/duckdb:duckdb 26636684 / 26924192 / -1.1% 34870266 / 35235018 / -1.0% 0.76 / 0.76 / -0.0%
tpcds_q24/duckdb:duckdb 15213060 / 15526926 / -2.0% 30656781 / 30230343 / +1.4% 0.50 / 0.51 / -3.4%
tpcds_q25/duckdb:duckdb 13596018 / 13785908 / -1.4% 26866694 / 27334459 / -1.7% 0.51 / 0.50 / +0.3%
tpcds_q26/duckdb:duckdb 18059065 / 18364765 / -1.7% 27481077 / 27975873 / -1.8% 0.66 / 0.66 / +0.1%
tpcds_q27/duckdb:duckdb 23229626 / 23314266 / -0.4% 34131593 / 35406085 / -3.6% 0.68 / 0.66 / +3.4%
tpcds_q28/duckdb:duckdb 12026588 / 12045688 / -0.2% 18772904 / 17242038 / +8.9% 0.64 / 0.70 / -8.3%
tpcds_q29/duckdb:duckdb 13921000 / 13989618 / -0.5% 27619290 / 28501698 / -3.1% 0.50 / 0.49 / +2.7%
tpcds_q30/duckdb:duckdb 17315789 / 17664355 / -2.0% 30092734 / 30481312 / -1.3% 0.58 / 0.58 / -0.7%
tpcds_q31/duckdb:duckdb 30239346 / 30149758 / +0.3% 39055523 / 38351599 / +1.8% 0.77 / 0.79 / -1.5%
tpcds_q32/duckdb:duckdb 5215012 / 5348982 / -2.5% 12710893 / 12787652 / -0.6% 0.41 / 0.42 / -1.9%
tpcds_q33/duckdb:duckdb 8616500 / 8984922 / -4.1% 16042978 / 16335109 / -1.8% 0.54 / 0.55 / -2.4%
tpcds_q34/duckdb:duckdb 10434686 / 10422222 / +0.1% 20003066 / 19889268 / +0.6% 0.52 / 0.52 / -0.4%
tpcds_q35/duckdb:duckdb 24187718 / 24280806 / -0.4% 34117271 / 34564226 / -1.3% 0.71 / 0.70 / +0.9%
tpcds_q36/duckdb:duckdb 12707454 / 12814356 / -0.8% 23174069 / 22730333 / +2.0% 0.55 / 0.56 / -2.7%
tpcds_q37/duckdb:duckdb 5238120 / 5254303 / -0.3% 13596364 / 13668074 / -0.5% 0.39 / 0.38 / +0.2%
tpcds_q38/duckdb:duckdb 22631338 / 22566622 / +0.3% 29539774 / 29114533 / +1.5% 0.77 / 0.78 / -1.2%
tpcds_q39/duckdb:duckdb 19180969 / 19269020 / -0.5% 24228763 / 24892370 / -2.7% 0.79 / 0.77 / +2.3%
tpcds_q40/duckdb:duckdb 8404851 / 8330481 / +0.9% 16342461 / 16304951 / +0.2% 0.51 / 0.51 / +0.7%
tpcds_q41/duckdb:duckdb 10022984 / 9982094 / +0.4% 16976642 / 16521749 / +2.8% 0.59 / 0.60 / -2.3%
tpcds_q42/duckdb:duckdb 4723450 / 4902266 / -3.6% 11290365 / 12332512 / -8.5% 0.42 / 0.40 / +5.2%
tpcds_q43/duckdb:duckdb 7449191 / 7562568 / -1.5% 15699890 / 15744433 / -0.3% 0.47 / 0.48 / -1.2%
tpcds_q44/duckdb:duckdb 9229148 / 9128706 / +1.1% 18805473 / 18042293 / +4.2% 0.49 / 0.51 / -3.0%
tpcds_q45/duckdb:duckdb 13494106 / 13441177 / +0.4% 22334066 / 22499557 / -0.7% 0.60 / 0.60 / +1.1%
tpcds_q46/duckdb:duckdb 24967836 / 25217268 / -1.0% 35801065 / 36742703 / -2.6% 0.70 / 0.69 / +1.6%
tpcds_q47/duckdb:duckdb 33326476 / 33103399 / +0.7% 42090527 / 41345334 / +1.8% 0.79 / 0.80 / -1.1%
tpcds_q48/duckdb:duckdb 26971782 / 26996740 / -0.1% 37207306 / 37549391 / -0.9% 0.72 / 0.72 / +0.8%
tpcds_q49/duckdb:duckdb 14385064 / 14813796 / -2.9% 24325046 / 25157426 / -3.3% 0.59 / 0.59 / +0.4%
tpcds_q50/duckdb:duckdb 9932428 / 9939780 / -0.1% 18767082 / 18410203 / +1.9% 0.53 / 0.54 / -2.0%
tpcds_q51/duckdb:duckdb 46246717 / 46067560 / +0.4% 55615012 / 53792064 / +3.4% 0.83 / 0.86 / -2.9%
tpcds_q52/duckdb:duckdb 4994249 / 5110977 / -2.3% 11096799 / 12365080 / -10.3% 🟢 0.45 / 0.41 / +8.9%
tpcds_q53/duckdb:duckdb 9321272 / 9357311 / -0.4% 17779783 / 18634552 / -4.6% 0.52 / 0.50 / +4.4%
tpcds_q54/duckdb:duckdb 11726960 / 11761127 / -0.3% 21652043 / 22006107 / -1.6% 0.54 / 0.53 / +1.3%
tpcds_q55/duckdb:duckdb 4693020 / 4855021 / -3.3% 11124894 / 12222545 / -9.0% 0.42 / 0.40 / +6.2%
tpcds_q56/duckdb:duckdb 10077947 / 10132330 / -0.5% 17719072 / 17551701 / +1.0% 0.57 / 0.58 / -1.5%
tpcds_q57/duckdb:duckdb 27946646 / 27670036 / +1.0% 35070286 / 35355511 / -0.8% 0.80 / 0.78 / +1.8%
tpcds_q58/duckdb:duckdb 10666915 / 10936606 / -2.5% 17899282 / 18267428 / -2.0% 0.60 / 0.60 / -0.5%
tpcds_q59/duckdb:duckdb 16750656 / 16909098 / -0.9% 24307840 / 26207879 / -7.2% 0.69 / 0.65 / +6.8%
tpcds_q60/duckdb:duckdb 10623508 / 11031524 / -3.7% 17448665 / 18028053 / -3.2% 0.61 / 0.61 / -0.5%
tpcds_q61/duckdb:duckdb 9963974 / 9944322 / +0.2% 18887454 / 19252571 / -1.9% 0.53 / 0.52 / +2.1%
tpcds_q62/duckdb:duckdb 8223768 / 8180316 / +0.5% 15212918 / 15170102 / +0.3% 0.54 / 0.54 / +0.2%
tpcds_q63/duckdb:duckdb 8886550 / 8958547 / -0.8% 17402552 / 16736256 / +4.0% 0.51 / 0.54 / -4.6%
tpcds_q64/duckdb:duckdb 38176742 / 38357992 / -0.5% 55558132 / 58521727 / -5.1% 0.69 / 0.66 / +4.8%
tpcds_q65/duckdb:duckdb 9586702 / 9731857 / -1.5% 18718003 / 19101332 / -2.0% 0.51 / 0.51 / +0.5%
tpcds_q66/duckdb:duckdb 24387840 / 24496860 / -0.4% 32009406 / 32566478 / -1.7% 0.76 / 0.75 / +1.3%
tpcds_q67/duckdb:duckdb 56380500 / 56809942 / -0.8% 64228317 / 66185277 / -3.0% 0.88 / 0.86 / +2.3%
tpcds_q68/duckdb:duckdb 15912431 / 15889516 / +0.1% 27784408 / 27570665 / +0.8% 0.57 / 0.58 / -0.6%
tpcds_q69/duckdb:duckdb 15037586 / 15206819 / -1.1% 24195257 / 24944064 / -3.0% 0.62 / 0.61 / +1.9%
tpcds_q70/duckdb:duckdb 10002706 / 10202252 / -2.0% 20436615 / 21147747 / -3.4% 0.49 / 0.48 / +1.5%
tpcds_q71/duckdb:duckdb 7888886 / 7945574 / -0.7% 15404681 / 15636437 / -1.5% 0.51 / 0.51 / +0.8%
tpcds_q72/duckdb:duckdb 35638407 / 36382736 / -2.0% 46402982 / 47728820 / -2.8% 0.77 / 0.76 / +0.8%
tpcds_q73/duckdb:duckdb 7942356 / 7931894 / +0.1% 17138377 / 17474038 / -1.9% 0.46 / 0.45 / +2.1%
tpcds_q74/duckdb:duckdb 35973331 / 36555004 / -1.6% 43883452 / 45197240 / -2.9% 0.82 / 0.81 / +1.4%
tpcds_q75/duckdb:duckdb 29761438 / 30031052 / -0.9% 41225086 / 40764936 / +1.1% 0.72 / 0.74 / -2.0%
tpcds_q76/duckdb:duckdb 8042440 / 8192389 / -1.8% 16723330 / 17031197 / -1.8% 0.48 / 0.48 / -0.0%
tpcds_q77/duckdb:duckdb 10494952 / 10459063 / +0.3% 20625959 / 21231511 / -2.9% 0.51 / 0.49 / +3.3%
tpcds_q78/duckdb:duckdb 65087262 / 64778415 / +0.5% 75036394 / 75299362 / -0.3% 0.87 / 0.86 / +0.8%
tpcds_q79/duckdb:duckdb 11884349 / 12185692 / -2.5% 21828943 / 22759192 / -4.1% 0.54 / 0.54 / +1.7%
tpcds_q80/duckdb:duckdb 16794117 / 16820376 / -0.2% 29783780 / 30070044 / -1.0% 0.56 / 0.56 / +0.8%
tpcds_q81/duckdb:duckdb 25132472 / 25365582 / -0.9% 37049734 / 38087010 / -2.7% 0.68 / 0.67 / +1.9%
tpcds_q82/duckdb:duckdb 5778985 / 5796821 / -0.3% 14309580 / 14365305 / -0.4% 0.40 / 0.40 / +0.1%
tpcds_q83/duckdb:duckdb 8856428 / 9158860 / -3.3% 15160435 / 15603815 / -2.8% 0.58 / 0.59 / -0.5%
tpcds_q84/duckdb:duckdb 9176036 / 9393062 / -2.3% 18386311 / 18438908 / -0.3% 0.50 / 0.51 / -2.0%
tpcds_q85/duckdb:duckdb 21048126 / 21142667 / -0.4% 35647649 / 36454333 / -2.2% 0.59 / 0.58 / +1.8%
tpcds_q86/duckdb:duckdb 8457986 / 8565557 / -1.3% 15166463 / 15785293 / -3.9% 0.56 / 0.54 / +2.8%
tpcds_q87/duckdb:duckdb 24866384 / 24861922 / +0.0% 31336129 / 32537451 / -3.7% 0.79 / 0.76 / +3.9%
tpcds_q88/duckdb:duckdb 18942940 / 18981930 / -0.2% 24248941 / 24557812 / -1.3% 0.78 / 0.77 / +1.1%
tpcds_q89/duckdb:duckdb 10367426 / 10328094 / +0.4% 19275706 / 18384837 / +4.8% 0.54 / 0.56 / -4.3%
tpcds_q90/duckdb:duckdb 4927143 / 4901652 / +0.5% 11137800 / 10490221 / +6.2% 0.44 / 0.47 / -5.3%
tpcds_q91/duckdb:duckdb 8475864 / 8825866 / -4.0% 17427051 / 18900331 / -7.8% 0.49 / 0.47 / +4.2%
tpcds_q92/duckdb:duckdb 6745796 / 6677524 / +1.0% 14605835 / 14547972 / +0.4% 0.46 / 0.46 / +0.6%
tpcds_q93/duckdb:duckdb 6851238 / 6976320 / -1.8% 14768554 / 15048231 / -1.9% 0.46 / 0.46 / +0.1%
tpcds_q94/duckdb:duckdb 11654028 / 11828336 / -1.5% 22491545 / 23027005 / -2.3% 0.52 / 0.51 / +0.9%
tpcds_q95/duckdb:duckdb 35463300 / 35608778 / -0.4% 44803980 / 44345092 / +1.0% 0.79 / 0.80 / -1.4%
tpcds_q96/duckdb:duckdb 3786996 / 3858994 / -1.9% 9406211 / 9589555 / -1.9% 0.40 / 0.40 / +0.0%
tpcds_q97/duckdb:duckdb 21660313 / 21732752 / -0.3% 27635943 / 27824359 / -0.7% 0.78 / 0.78 / +0.3%
tpcds_q98/duckdb:duckdb 10606206 / 10745558 / -1.3% 19307294 / 19174921 / +0.7% 0.55 / 0.56 / -2.0%
tpcds_q99/duckdb:duckdb 13014648 / 12930068 / +0.7% 19971508 / 20249466 / -1.4% 0.65 / 0.64 / +2.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.8%
Engines: DataFusion No clear signal (+0.5%, environment too noisy confidence) · DuckDB No clear signal (-9.7%, environment too noisy confidence)
Vortex (geomean): hot 0.978x ➖ · cold 1.034x ➖
Parquet (geomean): hot 1.027x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +2.7% · Median polish -1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.121x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 210995695 / 204320900 / +3.3% 768711605 / 751964457 / +2.2% 0.27 / 0.27 / +1.0%
tpch_q02/datafusion:vortex-file-compressed 350812605 / 330169166 / +6.3% 639765001 / 686218841 / -6.8% 0.55 / 0.48 / +14.0%
tpch_q03/datafusion:vortex-file-compressed 408184009 / 457296475 / -10.7% 834685473 / 1062855649 / -21.5% 0.49 / 0.43 / +13.7%
tpch_q04/datafusion:vortex-file-compressed 154443722 / 203198463 / -24.0% 448152370 / 405280470 / +10.6% 0.34 / 0.50 / -31.3%
tpch_q05/datafusion:vortex-file-compressed 356446566 / 356107742 / +0.1% 545880374 / 466610578 / +17.0% 0.65 / 0.76 / -14.4%
tpch_q06/datafusion:vortex-file-compressed 180566653 / 146927472 / +22.9% 315780937 / 298794813 / +5.7% 0.57 / 0.49 / +16.3%
tpch_q07/datafusion:vortex-file-compressed 402405252 / 441332081 / -8.8% 558283515 / 609064178 / -8.3% 0.72 / 0.72 / -0.5%
tpch_q08/datafusion:vortex-file-compressed 521762712 / 411722548 / +26.7% 567177682 / 618101524 / -8.2% 0.92 / 0.67 / +38.1%
tpch_q09/datafusion:vortex-file-compressed 345530434 / 360563300 / -4.2% 520166584 / 646404109 / -19.5% 0.66 / 0.56 / +19.1%
tpch_q10/datafusion:vortex-file-compressed 358216877 / 362483740 / -1.2% 533487963 / 480783010 / +11.0% 0.67 / 0.75 / -10.9%
tpch_q11/datafusion:vortex-file-compressed 304881460 / 420294389 / -27.5% 522428609 / 473677649 / +10.3% 0.58 / 0.89 / -34.2%
tpch_q12/datafusion:vortex-file-compressed 197868556 / 222349952 / -11.0% 415538531 / 368991793 / +12.6% 0.48 / 0.60 / -21.0%
tpch_q13/datafusion:vortex-file-compressed 278329564 / 136888138 / +103.3% 🔴 409984322 / 368124148 / +11.4% 0.68 / 0.37 / +82.6%
tpch_q14/datafusion:vortex-file-compressed 202112366 / 192676487 / +4.9% 391161152 / 405259064 / -3.5% 0.52 / 0.48 / +8.7%
tpch_q15/datafusion:vortex-file-compressed 355986281 / 303602552 / +17.3% 506385350 / 563520062 / -10.1% 0.70 / 0.54 / +30.5%
tpch_q16/datafusion:vortex-file-compressed 147352163 / 150152640 / -1.9% 346303841 / 296783414 / +16.7% 0.43 / 0.51 / -15.9%
tpch_q17/datafusion:vortex-file-compressed 314545399 / 288128065 / +9.2% 491427745 / 443849493 / +10.7% 0.64 / 0.65 / -1.4%
tpch_q18/datafusion:vortex-file-compressed 316253470 / 274721906 / +15.1% 838251346 / 534719302 / +56.8% 🔴 0.38 / 0.51 / -26.6%
tpch_q19/datafusion:vortex-file-compressed 709448083 / 227828516 / +211.4% 🔴 710536090 / 386691971 / +83.7% 🔴 1.00 / 0.59 / +69.5%
tpch_q20/datafusion:vortex-file-compressed 295099647 / 285119980 / +3.5% 668865689 / 522505305 / +28.0% 0.44 / 0.55 / -19.1%
tpch_q21/datafusion:vortex-file-compressed 1249140371 / 653907996 / +91.0% 🔴 981457861 / 691712929 / +41.9% 🔴 1.27 / 0.95 / +34.6%
tpch_q22/datafusion:vortex-file-compressed 174296382 / 172800177 / +0.9% 419191643 / 381774104 / +9.8% 0.42 / 0.45 / -8.1%
datafusion / vortex-compact / ns (1.031x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 230593395 / 236741347 / -2.6% 738377250 / 621044471 / +18.9% 0.31 / 0.38 / -18.1%
tpch_q02/datafusion:vortex-compact 321910188 / 327514616 / -1.7% 674812864 / 803155683 / -16.0% 0.48 / 0.41 / +17.0%
tpch_q03/datafusion:vortex-compact 320654601 / 295864692 / +8.4% 1025286068 / 675458403 / +51.8% 🔴 0.31 / 0.44 / -28.6%
tpch_q04/datafusion:vortex-compact 164401332 / 169134118 / -2.8% 332669268 / 404832017 / -17.8% 0.49 / 0.42 / +18.3%
tpch_q05/datafusion:vortex-compact 352686842 / 349317132 / +1.0% 508711394 / 499086476 / +1.9% 0.69 / 0.70 / -0.9%
tpch_q06/datafusion:vortex-compact 128263537 / 155195596 / -17.4% 291005574 / 338605700 / -14.1% 0.44 / 0.46 / -3.8%
tpch_q07/datafusion:vortex-compact 398247701 / 473792936 / -15.9% 549480342 / 597986660 / -8.1% 0.72 / 0.79 / -8.5%
tpch_q08/datafusion:vortex-compact 588936926 / 431266448 / +36.6% 🔴 573614142 / 606406329 / -5.4% 1.03 / 0.71 / +44.4%
tpch_q09/datafusion:vortex-compact 339894817 / 389896751 / -12.8% 742449642 / 516608685 / +43.7% 🔴 0.46 / 0.75 / -39.3%
tpch_q10/datafusion:vortex-compact 357346003 / 345079493 / +3.6% 553567537 / 439053971 / +26.1% 0.65 / 0.79 / -17.9%
tpch_q11/datafusion:vortex-compact 290949633 / 298429344 / -2.5% 501699790 / 478897865 / +4.8% 0.58 / 0.62 / -6.9%
tpch_q12/datafusion:vortex-compact 191724484 / 182232111 / +5.2% 327397733 / 345572239 / -5.3% 0.59 / 0.53 / +11.0%
tpch_q13/datafusion:vortex-compact 137436926 / 110900798 / +23.9% 357450948 / 290520099 / +23.0% 0.38 / 0.38 / +0.7%
tpch_q14/datafusion:vortex-compact 189769398 / 356815263 / -46.8% 🟢 334109478 / 468953314 / -28.8% 0.57 / 0.76 / -25.4%
tpch_q15/datafusion:vortex-compact 331747678 / 300994410 / +10.2% 637925750 / 455319587 / +40.1% 🔴 0.52 / 0.66 / -21.3%
tpch_q16/datafusion:vortex-compact 120842249 / 119665223 / +1.0% 312137781 / 288353197 / +8.2% 0.39 / 0.41 / -6.7%
tpch_q17/datafusion:vortex-compact 292947189 / 291102659 / +0.6% 457215413 / 467275611 / -2.2% 0.64 / 0.62 / +2.8%
tpch_q18/datafusion:vortex-compact 491197420 / 260222714 / +88.8% 🔴 622839986 / 473017686 / +31.7% 🔴 0.79 / 0.55 / +43.4%
tpch_q19/datafusion:vortex-compact 253758304 / 254091633 / -0.1% 436742582 / 335773054 / +30.1% 🔴 0.58 / 0.76 / -23.2%
tpch_q20/datafusion:vortex-compact 259898385 / 329187742 / -21.0% 439040453 / 503935273 / -12.9% 0.59 / 0.65 / -9.4%
tpch_q21/datafusion:vortex-compact 761388691 / 433126800 / +75.8% 🔴 819262161 / 633684023 / +29.3% 0.93 / 0.68 / +36.0%
tpch_q22/datafusion:vortex-compact 180841321 / 158798737 / +13.9% 351896835 / 354274678 / -0.7% 0.51 / 0.45 / +14.7%
datafusion / parquet / ns (1.070x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 210139252 / 152171410 / +38.1% 🔴 567635490 / 578950536 / -2.0% 0.37 / 0.26 / +40.8%
tpch_q02/datafusion:parquet 283180925 / 274023647 / +3.3% 493531246 / 493602762 / -0.0% 0.57 / 0.56 / +3.4%
tpch_q03/datafusion:parquet 250009995 / 302628478 / -17.4% 646168534 / 826475265 / -21.8% 0.39 / 0.37 / +5.7%
tpch_q04/datafusion:parquet 144750822 / 147711203 / -2.0% 315048645 / 314737982 / +0.1% 0.46 / 0.47 / -2.1%
tpch_q05/datafusion:parquet 341184413 / 359365874 / -5.1% 516651543 / 483377574 / +6.9% 0.66 / 0.74 / -11.2%
tpch_q06/datafusion:parquet 108898898 / 117426724 / -7.3% 225023526 / 256331187 / -12.2% 0.48 / 0.46 / +5.6%
tpch_q07/datafusion:parquet 329854832 / 338481615 / -2.5% 509306967 / 498675071 / +2.1% 0.65 / 0.68 / -4.6%
tpch_q08/datafusion:parquet 421235001 / 476053148 / -11.5% 561593700 / 539500048 / +4.1% 0.75 / 0.88 / -15.0%
tpch_q09/datafusion:parquet 382530027 / 387252263 / -1.2% 531577519 / 543461973 / -2.2% 0.72 / 0.71 / +1.0%
tpch_q10/datafusion:parquet 314407438 / 322672206 / -2.6% 443049364 / 601426401 / -26.3% 0.71 / 0.54 / +32.3%
tpch_q11/datafusion:parquet 336619537 / 260911509 / +29.0% 586718079 / 357604004 / +64.1% 🔴 0.57 / 0.73 / -21.4%
tpch_q12/datafusion:parquet 154145551 / 186603813 / -17.4% 388466578 / 383410719 / +1.3% 0.40 / 0.49 / -18.5%
tpch_q13/datafusion:parquet 268349321 / 274655278 / -2.3% 418375320 / 492583721 / -15.1% 0.64 / 0.56 / +15.0%
tpch_q14/datafusion:parquet 147753721 / 159973601 / -7.6% 274333012 / 315115134 / -12.9% 0.54 / 0.51 / +6.1%
tpch_q15/datafusion:parquet 503141939 / 296872170 / +69.5% 🔴 501991654 / 541143185 / -7.2% 1.00 / 0.55 / +82.7%
tpch_q16/datafusion:parquet 106038630 / 106227868 / -0.2% 259762496 / 200497317 / +29.6% 0.41 / 0.53 / -23.0%
tpch_q17/datafusion:parquet 355023982 / 271199986 / +30.9% 🔴 501169201 / 430761888 / +16.3% 0.71 / 0.63 / +12.5%
tpch_q18/datafusion:parquet 303812198 / 311757367 / -2.5% 458353534 / 479431763 / -4.4% 0.66 / 0.65 / +1.9%
tpch_q19/datafusion:parquet 467903237 / 177682711 / +163.3% 🔴 1418286855 / 295787362 / +379.5% 🔴 0.33 / 0.60 / -45.1%
tpch_q20/datafusion:parquet 254850123 / 266337549 / -4.3% 474180142 / 377294076 / +25.7% 0.54 / 0.71 / -23.9%
tpch_q21/datafusion:parquet 308319703 / 317731036 / -3.0% 512787092 / 684053044 / -25.0% 0.60 / 0.46 / +29.4%
tpch_q22/datafusion:parquet 173623831 / 167537140 / +3.6% 355621876 / 400542583 / -11.2% 0.49 / 0.42 / +16.7%
duckdb / vortex-file-compressed / ns (0.885x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 247877619 / 266266572 / -6.9% 263755943 / 320267427 / -17.6% 0.94 / 0.83 / +13.0%
tpch_q02/duckdb:vortex-file-compressed 411207407 / 444675876 / -7.5% 505019255 / 819453630 / -38.4% 🟢 0.81 / 0.54 / +50.0%
tpch_q03/duckdb:vortex-file-compressed 388079764 / 406794105 / -4.6% 459340126 / 476762780 / -3.7% 0.84 / 0.85 / -1.0%
tpch_q04/duckdb:vortex-file-compressed 254773663 / 247422221 / +3.0% 289343988 / 319885936 / -9.5% 0.88 / 0.77 / +13.8%
tpch_q05/duckdb:vortex-file-compressed 504344677 / 1289864843 / -60.9% 🟢 597640706 / 701611921 / -14.8% 0.84 / 1.84 / -54.1%
tpch_q06/duckdb:vortex-file-compressed 186540596 / 168660315 / +10.6% 246964389 / 218009829 / +13.3% 0.76 / 0.77 / -2.4%
tpch_q07/duckdb:vortex-file-compressed 383859344 / 391300915 / -1.9% 437818291 / 412480658 / +6.1% 0.88 / 0.95 / -7.6%
tpch_q08/duckdb:vortex-file-compressed 748117098 / 898190596 / -16.7% 1026461758 / 731463706 / +40.3% 🔴 0.73 / 1.23 / -40.6%
tpch_q09/duckdb:vortex-file-compressed 397829162 / 529321096 / -24.8% 470897528 / 490105144 / -3.9% 0.84 / 1.08 / -21.8%
tpch_q10/duckdb:vortex-file-compressed 492710534 / 510206277 / -3.4% 585535964 / 538940274 / +8.6% 0.84 / 0.95 / -11.1%
tpch_q11/duckdb:vortex-file-compressed 323681909 / 312569915 / +3.6% 331947109 / 313436339 / +5.9% 0.98 / 1.00 / -2.2%
tpch_q12/duckdb:vortex-file-compressed 221465320 / 238687398 / -7.2% 258090998 / 222302248 / +16.1% 0.86 / 1.07 / -20.1%
tpch_q13/duckdb:vortex-file-compressed 206286953 / 231834344 / -11.0% 301090044 / 243623508 / +23.6% 0.69 / 0.95 / -28.0%
tpch_q14/duckdb:vortex-file-compressed 231091806 / 227850104 / +1.4% 299100578 / 284991708 / +5.0% 0.77 / 0.80 / -3.4%
tpch_q15/duckdb:vortex-file-compressed 233783611 / 236552125 / -1.2% 295697216 / 274512434 / +7.7% 0.79 / 0.86 / -8.3%
tpch_q16/duckdb:vortex-file-compressed 228015713 / 218063127 / +4.6% 211338303 / 238248602 / -11.3% 1.08 / 0.92 / +17.9%
tpch_q17/duckdb:vortex-file-compressed 323060858 / 371985242 / -13.2% 340030034 / 381809454 / -10.9% 0.95 / 0.97 / -2.5%
tpch_q18/duckdb:vortex-file-compressed 403129814 / 357414044 / +12.8% 334953471 / 333149894 / +0.5% 1.20 / 1.07 / +12.2%
tpch_q19/duckdb:vortex-file-compressed 288635962 / 330782811 / -12.7% 326341611 / 304892645 / +7.0% 0.88 / 1.08 / -18.5%
tpch_q20/duckdb:vortex-file-compressed 335196850 / 610583117 / -45.1% 🟢 396459157 / 854110114 / -53.6% 🟢 0.85 / 0.71 / +18.3%
tpch_q21/duckdb:vortex-file-compressed 563909186 / 761738000 / -26.0% 580239929 / 809794068 / -28.3% 0.97 / 0.94 / +3.3%
tpch_q22/duckdb:vortex-file-compressed 253350047 / 249029353 / +1.7% 269861408 / 290483146 / -7.1% 0.94 / 0.86 / +9.5%
duckdb / vortex-compact / ns (0.894x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 263200443 / 275687237 / -4.5% 244871773 / 279178411 / -12.3% 1.07 / 0.99 / +8.8%
tpch_q02/duckdb:vortex-compact 406110475 / 412324166 / -1.5% 519723665 / 456112670 / +13.9% 0.78 / 0.90 / -13.6%
tpch_q03/duckdb:vortex-compact 365558027 / 364800105 / +0.2% 442961989 / 410884186 / +7.8% 0.83 / 0.89 / -7.0%
tpch_q04/duckdb:vortex-compact 228233038 / 233544843 / -2.3% 254813164 / 322909822 / -21.1% 0.90 / 0.72 / +23.8%
tpch_q05/duckdb:vortex-compact 546126635 / 555466776 / -1.7% 585891896 / 553024002 / +5.9% 0.93 / 1.00 / -7.2%
tpch_q06/duckdb:vortex-compact 149837950 / 197440860 / -24.1% 202944332 / 207379603 / -2.1% 0.74 / 0.95 / -22.5%
tpch_q07/duckdb:vortex-compact 438803981 / 400219060 / +9.6% 474273810 / 591570285 / -19.8% 0.93 / 0.68 / +36.8%
tpch_q08/duckdb:vortex-compact 522403108 / 1091962350 / -52.2% 🟢 679023868 / 876389516 / -22.5% 0.77 / 1.25 / -38.3%
tpch_q09/duckdb:vortex-compact 493644868 / 435678592 / +13.3% 500003885 / 488263976 / +2.4% 0.99 / 0.89 / +10.6%
tpch_q10/duckdb:vortex-compact 510830094 / 1543935628 / -66.9% 🟢 585954124 / 538692049 / +8.8% 0.87 / 2.87 / -69.6%
tpch_q11/duckdb:vortex-compact 301658967 / 295471981 / +2.1% 317216232 / 283905226 / +11.7% 0.95 / 1.04 / -8.6%
tpch_q12/duckdb:vortex-compact 242059874 / 307819925 / -21.4% 248104431 / 277702100 / -10.7% 0.98 / 1.11 / -12.0%
tpch_q13/duckdb:vortex-compact 206123481 / 216780891 / -4.9% 417821130 / 185899002 / +124.8% 🔴 0.49 / 1.17 / -57.7%
tpch_q14/duckdb:vortex-compact 256281899 / 238270148 / +7.6% 277177332 / 295796254 / -6.3% 0.92 / 0.81 / +14.8%
tpch_q15/duckdb:vortex-compact 256489659 / 271490779 / -5.5% 637159342 / 316783449 / +101.1% 🔴 0.40 / 0.86 / -53.0%
tpch_q16/duckdb:vortex-compact 198656268 / 227699376 / -12.8% 231473280 / 272641844 / -15.1% 0.86 / 0.84 / +2.8%
tpch_q17/duckdb:vortex-compact 316234318 / 330854431 / -4.4% 337131156 / 308413261 / +9.3% 0.94 / 1.07 / -12.6%
tpch_q18/duckdb:vortex-compact 386556388 / 302486617 / +27.8% 356915074 / 292514665 / +22.0% 1.08 / 1.03 / +4.7%
tpch_q19/duckdb:vortex-compact 351161361 / 294019999 / +19.4% 385359491 / 375709944 / +2.6% 0.91 / 0.78 / +16.4%
tpch_q20/duckdb:vortex-compact 337522068 / 325793676 / +3.6% 457821344 / 406840482 / +12.5% 0.74 / 0.80 / -7.9%
tpch_q21/duckdb:vortex-compact 515177391 / 820582428 / -37.2% 🟢 590582640 / 780096813 / -24.3% 0.87 / 1.05 / -17.1%
tpch_q22/duckdb:vortex-compact 239185655 / 242990202 / -1.6% 244976832 / 277910243 / -11.9% 0.98 / 0.87 / +11.7%
duckdb / parquet / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 193930721 / 171448703 / +13.1% 201338388 / 243827533 / -17.4% 0.96 / 0.70 / +37.0%
tpch_q02/duckdb:parquet 455214858 / 470815408 / -3.3% 437352353 / 502228829 / -12.9% 1.04 / 0.94 / +11.0%
tpch_q03/duckdb:parquet 323534341 / 412227563 / -21.5% 412905670 / 450167769 / -8.3% 0.78 / 0.92 / -14.4%
tpch_q04/duckdb:parquet 274723858 / 287444423 / -4.4% 337587319 / 305581770 / +10.5% 0.81 / 0.94 / -13.5%
tpch_q05/duckdb:parquet 507673279 / 487097360 / +4.2% 562940230 / 577212339 / -2.5% 0.90 / 0.84 / +6.9%
tpch_q06/duckdb:parquet 148539818 / 163139074 / -8.9% 195402681 / 230556637 / -15.2% 0.76 / 0.71 / +7.4%
tpch_q07/duckdb:parquet 439821644 / 439121535 / +0.2% 428251451 / 447913225 / -4.4% 1.03 / 0.98 / +4.8%
tpch_q08/duckdb:parquet 584869042 / 637601625 / -8.3% 680090416 / 657264305 / +3.5% 0.86 / 0.97 / -11.3%
tpch_q09/duckdb:parquet 537156442 / 545118736 / -1.5% 578098988 / 568286757 / +1.7% 0.93 / 0.96 / -3.1%
tpch_q10/duckdb:parquet 648435706 / 502602591 / +29.0% 1080129134 / 522601341 / +106.7% 🔴 0.60 / 0.96 / -37.6%
tpch_q11/duckdb:parquet 370389090 / 441929944 / -16.2% 356797390 / 494232977 / -27.8% 1.04 / 0.89 / +16.1%
tpch_q12/duckdb:parquet 262091767 / 234392301 / +11.8% 321399092 / 509997690 / -37.0% 🟢 0.82 / 0.46 / +77.4%
tpch_q13/duckdb:parquet 330497573 / 360722973 / -8.4% 466108752 / 465312331 / +0.2% 0.71 / 0.78 / -8.5%
tpch_q14/duckdb:parquet 244872900 / 243461546 / +0.6% 306893293 / 290764054 / +5.5% 0.80 / 0.84 / -4.7%
tpch_q15/duckdb:parquet 221715358 / 228751233 / -3.1% 253731866 / 260947561 / -2.8% 0.87 / 0.88 / -0.3%
tpch_q16/duckdb:parquet 279821973 / 283453924 / -1.3% 285099446 / 327818481 / -13.0% 0.98 / 0.86 / +13.5%
tpch_q17/duckdb:parquet 295310214 / 282675124 / +4.5% 349269391 / 364373252 / -4.1% 0.85 / 0.78 / +9.0%
tpch_q18/duckdb:parquet 346598628 / 347525933 / -0.3% 353797437 / 380587144 / -7.0% 0.98 / 0.91 / +7.3%
tpch_q19/duckdb:parquet 228828836 / 236100868 / -3.1% 298960337 / 304667376 / -1.9% 0.77 / 0.77 / -1.2%
tpch_q20/duckdb:parquet 506923313 / 468080286 / +8.3% 581662172 / 514818907 / +13.0% 0.87 / 0.91 / -4.1%
tpch_q21/duckdb:parquet 471137181 / 470928682 / +0.0% 526619459 / 508573204 / +3.5% 0.89 / 0.93 / -3.4%
tpch_q22/duckdb:parquet 272184805 / 308468418 / -11.8% 293475036 / 358121812 / -18.1% 0.93 / 0.86 / +7.7%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+1.7%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.969x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed 199169658 / 198913510 / +0.1% 508560439 / 513506537 / -1.0% 0.39 / 0.39 / +1.1%
vortex_q01/datafusion:vortex-file-compressed 129800340 / 128247635 / +1.2% 276624839 / 286626686 / -3.5% 0.47 / 0.45 / +4.9%
vortex_q02/datafusion:vortex-file-compressed 393416287 / 388294499 / +1.3% 299692763 / 299153368 / +0.2% 1.31 / 1.30 / +1.1%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet 138236696 / 137140485 / +0.8% 1175984696 / 1146914109 / +2.5% 0.12 / 0.12 / -1.7%
vortex_q01/datafusion:parquet 67248322 / 69323868 / -3.0% 116958253 / 113192974 / +3.3% 0.57 / 0.61 / -6.1%
vortex_q02/datafusion:parquet 289424344 / 290268292 / -0.3% 678196076 / 671710315 / +1.0% 0.43 / 0.43 / -1.2%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed 193575064 / 194047072 / -0.2% 896033460 / 959791372 / -6.6% 0.22 / 0.20 / +6.9%
vortex_q01/duckdb:vortex-file-compressed 92266562 / 92240340 / +0.0% 330957832 / 331332807 / -0.1% 0.28 / 0.28 / +0.1%
vortex_q02/duckdb:vortex-file-compressed 190022988 / 190587602 / -0.3% 478623315 / 517299162 / -7.5% 0.40 / 0.37 / +7.8%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet 275723700 / 276288830 / -0.2% 759067823 / 830784554 / -8.6% 0.36 / 0.33 / +9.2%
vortex_q01/duckdb:parquet 159448634 / 158925521 / +0.3% 168469322 / 168864695 / -0.2% 0.95 / 0.94 / +0.6%
vortex_q02/duckdb:parquet 340884542 / 340353214 / +0.2% 613211964 / 624263343 / -1.8% 0.56 / 0.55 / +2.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR fa6cf9b2 vs base d3688347
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (-3.4%, environment too noisy confidence) · DuckDB No clear signal (+6.4%, environment too noisy confidence)
Vortex (geomean): hot 0.932x ➖ · cold 0.943x ➖
Parquet (geomean): hot 0.919x ➖ · cold 0.949x ➖
Shifts: Parquet (control) -8.1% · Median polish -3.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.917x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 333826899 / 390373647 / -14.5% 981477647 / 1188055232 / -17.4% 0.34 / 0.33 / +3.5%
tpch_q02/datafusion:vortex-file-compressed 580381428 / 554935438 / +4.6% 1256993252 / 1265463090 / -0.7% 0.46 / 0.44 / +5.3%
tpch_q03/datafusion:vortex-file-compressed 411267545 / 440793140 / -6.7% 1194179041 / 1141366040 / +4.6% 0.34 / 0.39 / -10.8%
tpch_q04/datafusion:vortex-file-compressed 401622317 / 376885377 / +6.6% 617897970 / 652291082 / -5.3% 0.65 / 0.58 / +12.5%
tpch_q05/datafusion:vortex-file-compressed 656905383 / 536583423 / +22.4% 1008810173 / 1165450108 / -13.4% 0.65 / 0.46 / +41.4%
tpch_q06/datafusion:vortex-file-compressed 231532015 / 230398373 / +0.5% 469215140 / 355775813 / +31.9% 🔴 0.49 / 0.65 / -23.8%
tpch_q07/datafusion:vortex-file-compressed 658280563 / 728301291 / -9.6% 916488496 / 1068647257 / -14.2% 0.72 / 0.68 / +5.4%
tpch_q08/datafusion:vortex-file-compressed 1034027868 / 1136886690 / -9.0% 1063229455 / 1841022314 / -42.2% 🟢 0.97 / 0.62 / +57.5%
tpch_q09/datafusion:vortex-file-compressed 698539441 / 708209998 / -1.4% 1393563904 / 1086396407 / +28.3% 0.50 / 0.65 / -23.1%
tpch_q10/datafusion:vortex-file-compressed 592171532 / 582725183 / +1.6% 909468430 / 996998528 / -8.8% 0.65 / 0.58 / +11.4%
tpch_q11/datafusion:vortex-file-compressed 406133421 / 832870436 / -51.2% 🟢 723855496 / 856785349 / -15.5% 0.56 / 0.97 / -42.3%
tpch_q12/datafusion:vortex-file-compressed 391240383 / 624632410 / -37.4% 🟢 553142069 / 841411860 / -34.3% 🟢 0.71 / 0.74 / -4.7%
tpch_q13/datafusion:vortex-file-compressed 262006851 / 384569811 / -31.9% 🟢 574915200 / 681696062 / -15.7% 0.46 / 0.56 / -19.2%
tpch_q14/datafusion:vortex-file-compressed 422249626 / 461219860 / -8.4% 632242922 / 541454513 / +16.8% 0.67 / 0.85 / -21.6%
tpch_q15/datafusion:vortex-file-compressed 570272990 / 611416374 / -6.7% 755791833 / 888914453 / -15.0% 0.75 / 0.69 / +9.7%
tpch_q16/datafusion:vortex-file-compressed 303568533 / 270747481 / +12.1% 677202473 / 520035465 / +30.2% 🔴 0.45 / 0.52 / -13.9%
tpch_q17/datafusion:vortex-file-compressed 661875366 / 856678568 / -22.7% 881876206 / 1066088538 / -17.3% 0.75 / 0.80 / -6.6%
tpch_q18/datafusion:vortex-file-compressed 646844663 / 682197628 / -5.2% 724460220 / 894368771 / -19.0% 0.89 / 0.76 / +17.1%
tpch_q19/datafusion:vortex-file-compressed 446078920 / 469771566 / -5.0% 549626588 / 665768518 / -17.4% 0.81 / 0.71 / +15.0%
tpch_q20/datafusion:vortex-file-compressed 812356194 / 771049742 / +5.4% 863231686 / 742211749 / +16.3% 0.94 / 1.04 / -9.4%
tpch_q21/datafusion:vortex-file-compressed 994264849 / 827353967 / +20.2% 1277159447 / 1031605783 / +23.8% 0.78 / 0.80 / -2.9%
tpch_q22/datafusion:vortex-file-compressed 269596344 / 289897358 / -7.0% 682487783 / 660035236 / +3.4% 0.40 / 0.44 / -10.1%
datafusion / vortex-compact / ns (0.827x ➖, 5↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 295152085 / 684803461 / -56.9% 🟢 928494272 / 735074923 / +26.3% 0.32 / 0.93 / -65.9%
tpch_q02/datafusion:vortex-compact 530441187 / 519282010 / +2.1% 1149738307 / 1260715355 / -8.8% 0.46 / 0.41 / +12.0%
tpch_q03/datafusion:vortex-compact 446159151 / 1736642325 / -74.3% 🟢 1103596674 / 1302320181 / -15.3% 0.40 / 1.33 / -69.7%
tpch_q04/datafusion:vortex-compact 272922748 / 283581242 / -3.8% 625786904 / 611547929 / +2.3% 0.44 / 0.46 / -5.9%
tpch_q05/datafusion:vortex-compact 652906330 / 659825741 / -1.0% 933922960 / 1007621439 / -7.3% 0.70 / 0.65 / +6.8%
tpch_q06/datafusion:vortex-compact 223447418 / 273329182 / -18.2% 462573640 / 517730895 / -10.7% 0.48 / 0.53 / -8.5%
tpch_q07/datafusion:vortex-compact 682131375 / 765362079 / -10.9% 876489279 / 999140383 / -12.3% 0.78 / 0.77 / +1.6%
tpch_q08/datafusion:vortex-compact 743678642 / 1314913443 / -43.4% 🟢 980048960 / 1616242185 / -39.4% 🟢 0.76 / 0.81 / -6.7%
tpch_q09/datafusion:vortex-compact 889168061 / 707016066 / +25.8% 1091737227 / 1016732998 / +7.4% 0.81 / 0.70 / +17.1%
tpch_q10/datafusion:vortex-compact 712110204 / 754779480 / -5.7% 960145587 / 1087807791 / -11.7% 0.74 / 0.69 / +6.9%
tpch_q11/datafusion:vortex-compact 407011918 / 400277336 / +1.7% 786715706 / 658150553 / +19.5% 0.52 / 0.61 / -14.9%
tpch_q12/datafusion:vortex-compact 486626665 / 2094516240 / -76.8% 🟢 777321699 / 1939656134 / -59.9% 🟢 0.63 / 1.08 / -42.0%
tpch_q13/datafusion:vortex-compact 337992852 / 307801459 / +9.8% 606076400 / 537587246 / +12.7% 0.56 / 0.57 / -2.6%
tpch_q14/datafusion:vortex-compact 379944561 / 304534902 / +24.8% 552368391 / 492377367 / +12.2% 0.69 / 0.62 / +11.2%
tpch_q15/datafusion:vortex-compact 567709953 / 700678745 / -19.0% 738398397 / 977320851 / -24.4% 0.77 / 0.72 / +7.2%
tpch_q16/datafusion:vortex-compact 237189205 / 299947655 / -20.9% 354621303 / 573711649 / -38.2% 🟢 0.67 / 0.52 / +27.9%
tpch_q17/datafusion:vortex-compact 763377784 / 727993900 / +4.9% 805356404 / 1001578817 / -19.6% 0.95 / 0.73 / +30.4%
tpch_q18/datafusion:vortex-compact 604617815 / 884866156 / -31.7% 🟢 731573597 / 1081420114 / -32.4% 🟢 0.83 / 0.82 / +1.0%
tpch_q19/datafusion:vortex-compact 549033829 / 440143235 / +24.7% 544456497 / 514455675 / +5.8% 1.01 / 0.86 / +17.9%
tpch_q20/datafusion:vortex-compact 825518111 / 573778591 / +43.9% 🔴 830489468 / 882911136 / -5.9% 0.99 / 0.65 / +53.0%
tpch_q21/datafusion:vortex-compact 856895546 / 864188780 / -0.8% 977384645 / 1043732110 / -6.4% 0.88 / 0.83 / +5.9%
tpch_q22/datafusion:vortex-compact 320492339 / 288996328 / +10.9% 729271588 / 690053087 / +5.7% 0.44 / 0.42 / +4.9%
datafusion / parquet / ns (0.901x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 255242208 / 221827381 / +15.1% 812834344 / 638438605 / +27.3% 0.31 / 0.35 / -9.6%
tpch_q02/datafusion:parquet 461825531 / 445806197 / +3.6% 925139962 / 1048946123 / -11.8% 0.50 / 0.43 / +17.5%
tpch_q03/datafusion:parquet 466259522 / 524128546 / -11.0% 943596371 / 1109021890 / -14.9% 0.49 / 0.47 / +4.6%
tpch_q04/datafusion:parquet 353691992 / 367069195 / -3.6% 480916170 / 510055323 / -5.7% 0.74 / 0.72 / +2.2%
tpch_q05/datafusion:parquet 609204536 / 672595831 / -9.4% 793369174 / 1053839872 / -24.7% 0.77 / 0.64 / +20.3%
tpch_q06/datafusion:parquet 375800195 / 249447938 / +50.7% 🔴 477887518 / 407983535 / +17.1% 0.79 / 0.61 / +28.6%
tpch_q07/datafusion:parquet 565010283 / 597368865 / -5.4% 712398839 / 841505236 / -15.3% 0.79 / 0.71 / +11.7%
tpch_q08/datafusion:parquet 1106727400 / 1233109019 / -10.2% 1059515640 / 1138525956 / -6.9% 1.04 / 1.08 / -3.6%
tpch_q09/datafusion:parquet 835662576 / 2838883680 / -70.6% 🟢 1124060359 / 2401440011 / -53.2% 🟢 0.74 / 1.18 / -37.1%
tpch_q10/datafusion:parquet 1041455247 / 966910200 / +7.7% 1330797330 / 1335798505 / -0.4% 0.78 / 0.72 / +8.1%
tpch_q11/datafusion:parquet 368956260 / 417199610 / -11.6% 581535494 / 679690808 / -14.4% 0.63 / 0.61 / +3.4%
tpch_q12/datafusion:parquet 424509559 / 479319445 / -11.4% 501247429 / 791918801 / -36.7% 🟢 0.85 / 0.61 / +39.9%
tpch_q13/datafusion:parquet 412714380 / 443809898 / -7.0% 683109300 / 668221830 / +2.2% 0.60 / 0.66 / -9.0%
tpch_q14/datafusion:parquet 409492845 / 433141071 / -5.5% 715216624 / 589245251 / +21.4% 0.57 / 0.74 / -22.1%
tpch_q15/datafusion:parquet 573132405 / 614705495 / -6.8% 761551113 / 753462171 / +1.1% 0.75 / 0.82 / -7.8%
tpch_q16/datafusion:parquet 210256449 / 216185170 / -2.7% 482224819 / 436538052 / +10.5% 0.44 / 0.50 / -12.0%
tpch_q17/datafusion:parquet 734102015 / 709957968 / +3.4% 843473711 / 827775699 / +1.9% 0.87 / 0.86 / +1.5%
tpch_q18/datafusion:parquet 541389136 / 892458372 / -39.3% 🟢 728858057 / 1330767846 / -45.2% 🟢 0.74 / 0.67 / +10.8%
tpch_q19/datafusion:parquet 449016197 / 447156012 / +0.4% 565279563 / 543356592 / +4.0% 0.79 / 0.82 / -3.5%
tpch_q20/datafusion:parquet 731489279 / 1037978655 / -29.5% 1116110107 / 1037446816 / +7.6% 0.66 / 1.00 / -34.5%
tpch_q21/datafusion:parquet 1714545796 / 1746437147 / -1.8% 2542469982 / 1946932524 / +30.6% 🔴 0.67 / 0.90 / -24.8%
tpch_q22/datafusion:parquet 400993657 / 403326733 / -0.6% 676717584 / 998523603 / -32.2% 🟢 0.59 / 0.40 / +46.7%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 1058265616 / 978166061 / +8.2% 1180911683 / 1169295040 / +1.0% 0.90 / 0.84 / +7.1%
tpch_q02/duckdb:vortex-file-compressed 536387858 / 519999915 / +3.2% 657073510 / 631955065 / +4.0% 0.82 / 0.82 / -0.8%
tpch_q03/duckdb:vortex-file-compressed 1126481517 / 1225890998 / -8.1% 1364317755 / 1497565517 / -8.9% 0.83 / 0.82 / +0.9%
tpch_q04/duckdb:vortex-file-compressed 939520471 / 902046408 / +4.2% 1134307737 / 1178033739 / -3.7% 0.83 / 0.77 / +8.2%
tpch_q05/duckdb:vortex-file-compressed 1059345490 / 965730026 / +9.7% 1358106416 / 1333088811 / +1.9% 0.78 / 0.72 / +7.7%
tpch_q06/duckdb:vortex-file-compressed 789822769 / 736867683 / +7.2% 923556195 / 869278533 / +6.2% 0.86 / 0.85 / +0.9%
tpch_q07/duckdb:vortex-file-compressed 1150105884 / 1320589581 / -12.9% 1396963383 / 1494648855 / -6.5% 0.82 / 0.88 / -6.8%
tpch_q08/duckdb:vortex-file-compressed 1201128538 / 1195076366 / +0.5% 1603354585 / 1630286909 / -1.7% 0.75 / 0.73 / +2.2%
tpch_q09/duckdb:vortex-file-compressed 1352893809 / 1376619581 / -1.7% 1682505688 / 1583406000 / +6.3% 0.80 / 0.87 / -7.5%
tpch_q10/duckdb:vortex-file-compressed 1683777877 / 1280044276 / +31.5% 🔴 1775831482 / 1900219560 / -6.5% 0.95 / 0.67 / +40.8%
tpch_q11/duckdb:vortex-file-compressed 382137488 / 352269489 / +8.5% 453624835 / 446744644 / +1.5% 0.84 / 0.79 / +6.8%
tpch_q12/duckdb:vortex-file-compressed 849050950 / 1169786382 / -27.4% 1163155195 / 1228430969 / -5.3% 0.73 / 0.95 / -23.3%
tpch_q13/duckdb:vortex-file-compressed 731388587 / 722630221 / +1.2% 1047447598 / 1049467150 / -0.2% 0.70 / 0.69 / +1.4%
tpch_q14/duckdb:vortex-file-compressed 999081156 / 885146332 / +12.9% 1217928913 / 1056251501 / +15.3% 0.82 / 0.84 / -2.1%
tpch_q15/duckdb:vortex-file-compressed 879613725 / 949753919 / -7.4% 1022533245 / 1059295082 / -3.5% 0.86 / 0.90 / -4.1%
tpch_q16/duckdb:vortex-file-compressed 319036723 / 316285170 / +0.9% 381111149 / 440093540 / -13.4% 0.84 / 0.72 / +16.5%
tpch_q17/duckdb:vortex-file-compressed 1079748693 / 1131881552 / -4.6% 1125254241 / 1163052956 / -3.2% 0.96 / 0.97 / -1.4%
tpch_q18/duckdb:vortex-file-compressed 1253569487 / 1448475896 / -13.5% 1282202946 / 1565815272 / -18.1% 0.98 / 0.93 / +5.7%
tpch_q19/duckdb:vortex-file-compressed 993834394 / 1034005023 / -3.9% 1171137317 / 1221928979 / -4.2% 0.85 / 0.85 / +0.3%
tpch_q20/duckdb:vortex-file-compressed 1554575010 / 1271750248 / +22.2% 1622001959 / 1331247578 / +21.8% 0.96 / 0.96 / +0.3%
tpch_q21/duckdb:vortex-file-compressed 2353236760 / 2147410911 / +9.6% 2639101139 / 2317800430 / +13.9% 0.89 / 0.93 / -3.8%
tpch_q22/duckdb:vortex-file-compressed 391795629 / 464514556 / -15.7% 632848917 / 530524720 / +19.3% 0.62 / 0.88 / -29.3%
duckdb / vortex-compact / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1006140223 / 937854847 / +7.3% 1243362072 / 1385099246 / -10.2% 0.81 / 0.68 / +19.5%
tpch_q02/duckdb:vortex-compact 549210375 / 543337422 / +1.1% 675416140 / 642709011 / +5.1% 0.81 / 0.85 / -3.8%
tpch_q03/duckdb:vortex-compact 1109431463 / 1193580857 / -7.1% 1447619066 / 1572973555 / -8.0% 0.77 / 0.76 / +1.0%
tpch_q04/duckdb:vortex-compact 904072600 / 845682584 / +6.9% 1092521604 / 1214480587 / -10.0% 0.83 / 0.70 / +18.8%
tpch_q05/duckdb:vortex-compact 944842985 / 969520523 / -2.5% 1487682111 / 1483995706 / +0.2% 0.64 / 0.65 / -2.8%
tpch_q06/duckdb:vortex-compact 827359910 / 731853555 / +13.0% 1338527370 / 850341890 / +57.4% 🔴 0.62 / 0.86 / -28.2%
tpch_q07/duckdb:vortex-compact 1079978072 / 1078385671 / +0.1% 1289649802 / 1368664155 / -5.8% 0.84 / 0.79 / +6.3%
tpch_q08/duckdb:vortex-compact 1140342671 / 1267666024 / -10.0% 1458509960 / 1359083247 / +7.3% 0.78 / 0.93 / -16.2%
tpch_q09/duckdb:vortex-compact 1335934385 / 1417150631 / -5.7% 1519465252 / 1629267065 / -6.7% 0.88 / 0.87 / +1.1%
tpch_q10/duckdb:vortex-compact 1542207413 / 1875687803 / -17.8% 1625375709 / 1990615319 / -18.3% 0.95 / 0.94 / +0.7%
tpch_q11/duckdb:vortex-compact 350921097 / 337896396 / +3.9% 477981505 / 473232348 / +1.0% 0.73 / 0.71 / +2.8%
tpch_q12/duckdb:vortex-compact 833312474 / 977278839 / -14.7% 1002532010 / 1526186078 / -34.3% 🟢 0.83 / 0.64 / +29.8%
tpch_q13/duckdb:vortex-compact 700463936 / 762470249 / -8.1% 1069981269 / 1090915479 / -1.9% 0.65 / 0.70 / -6.3%
tpch_q14/duckdb:vortex-compact 871406902 / 871057821 / +0.0% 961229953 / 1004036749 / -4.3% 0.91 / 0.87 / +4.5%
tpch_q15/duckdb:vortex-compact 843175093 / 795796100 / +6.0% 976455325 / 991285710 / -1.5% 0.86 / 0.80 / +7.6%
tpch_q16/duckdb:vortex-compact 323764182 / 290013825 / +11.6% 343344476 / 389672499 / -11.9% 0.94 / 0.74 / +26.7%
tpch_q17/duckdb:vortex-compact 1074539013 / 915077339 / +17.4% 1053979398 / 1140680086 / -7.6% 1.02 / 0.80 / +27.1%
tpch_q18/duckdb:vortex-compact 1187757606 / 1037719638 / +14.5% 1427019640 / 1205680961 / +18.4% 0.83 / 0.86 / -3.3%
tpch_q19/duckdb:vortex-compact 1037557433 / 1057596712 / -1.9% 1248309403 / 1427171848 / -12.5% 0.83 / 0.74 / +12.2%
tpch_q20/duckdb:vortex-compact 1043129491 / 1032599203 / +1.0% 1226270412 / 1353282404 / -9.4% 0.85 / 0.76 / +11.5%
tpch_q21/duckdb:vortex-compact 2279261125 / 2293203413 / -0.6% 2426892435 / 2353819491 / +3.1% 0.94 / 0.97 / -3.6%
tpch_q22/duckdb:vortex-compact 447128722 / 582087950 / -23.2% 584457990 / 880089437 / -33.6% 🟢 0.77 / 0.66 / +15.7%
duckdb / parquet / ns (0.937x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 296219383 / 409951370 / -27.7% 348972629 / 356577090 / -2.1% 0.85 / 1.15 / -26.2%
tpch_q02/duckdb:parquet 581498175 / 559573762 / +3.9% 738230886 / 780479861 / -5.4% 0.79 / 0.72 / +9.9%
tpch_q03/duckdb:parquet 505965079 / 653364970 / -22.6% 739966931 / 960228163 / -22.9% 0.68 / 0.68 / +0.5%
tpch_q04/duckdb:parquet 400431866 / 368862333 / +8.6% 732199989 / 491106015 / +49.1% 🔴 0.55 / 0.75 / -27.2%
tpch_q05/duckdb:parquet 684303780 / 724920806 / -5.6% 898868700 / 920189943 / -2.3% 0.76 / 0.79 / -3.4%
tpch_q06/duckdb:parquet 237485931 / 237184264 / +0.1% 279354830 / 304219517 / -8.2% 0.85 / 0.78 / +9.0%
tpch_q07/duckdb:parquet 839433966 / 956139909 / -12.2% 942932711 / 1145354835 / -17.7% 0.89 / 0.83 / +6.6%
tpch_q08/duckdb:parquet 984694232 / 968262325 / +1.7% 966512252 / 1159293668 / -16.6% 1.02 / 0.84 / +22.0%
tpch_q09/duckdb:parquet 1030067693 / 993895504 / +3.6% 1038595475 / 1123219227 / -7.5% 0.99 / 0.88 / +12.1%
tpch_q10/duckdb:parquet 833724244 / 814350706 / +2.4% 934176191 / 1015826859 / -8.0% 0.89 / 0.80 / +11.3%
tpch_q11/duckdb:parquet 309805499 / 322715033 / -4.0% 369501456 / 370531975 / -0.3% 0.84 / 0.87 / -3.7%
tpch_q12/duckdb:parquet 409872624 / 402315187 / +1.9% 588266835 / 508768922 / +15.6% 0.70 / 0.79 / -11.9%
tpch_q13/duckdb:parquet 542240531 / 615856680 / -12.0% 679815418 / 726050602 / -6.4% 0.80 / 0.85 / -6.0%
tpch_q14/duckdb:parquet 479519682 / 592908051 / -19.1% 800823351 / 573088386 / +39.7% 🔴 0.60 / 1.03 / -42.1%
tpch_q15/duckdb:parquet 393543844 / 470241373 / -16.3% 424475839 / 545235448 / -22.1% 0.93 / 0.86 / +7.5%
tpch_q16/duckdb:parquet 371568167 / 517930871 / -28.3% 373926946 / 420532319 / -11.1% 0.99 / 1.23 / -19.3%
tpch_q17/duckdb:parquet 399704910 / 462212184 / -13.5% 451056648 / 508335611 / -11.3% 0.89 / 0.91 / -2.5%
tpch_q18/duckdb:parquet 547481966 / 554555778 / -1.3% 735413789 / 731698933 / +0.5% 0.74 / 0.76 / -1.8%
tpch_q19/duckdb:parquet 612370324 / 605445639 / +1.1% 662931937 / 608146456 / +9.0% 0.92 / 1.00 / -7.2%
tpch_q20/duckdb:parquet 931782823 / 762296625 / +22.2% 998659769 / 747057237 / +33.7% 🔴 0.93 / 1.02 / -8.6%
tpch_q21/duckdb:parquet 780690126 / 744223692 / +4.9% 705717494 / 793197841 / -11.0% 1.11 / 0.94 / +17.9%
tpch_q22/duckdb:parquet 489305416 / 540390275 / -9.5% 1036383870 / 863198960 / +20.1% 0.47 / 0.63 / -24.6%

@robert3005 robert3005 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this one is correct after @myrrc changes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants