Skip to content

Remove unused unbound expression analysis and traversal helpers - #9993

Merged
gatesn merged 2 commits into
developfrom
mk/remove-unused-unbound-expressions
Sep 25, 2026
Merged

gatesn merged 2 commits into
developfrom
mk/remove-unused-unbound-expressions

Conversation

@mhk197

@mhk197 mhk197 commented Sep 22, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Expression analysis and partitioning now use bound expressions in layout planning, leaving the old unbound implementations with no production callers in this repository. Remove those implementations and their supporting APIs,.

Changes

  • Delete analysis/strict.rs, analysis/infallible.rs, transform/partition.rs, and traversal/references.rs, including tests specific to the removed APIs.
  • Remove unbound annotations and labeling, the free-field annotator, VortexExprExt, ExactExpr, split_conjunction, and replace_root_fields.
  • Remove unused context-free folding and upward/combined traversal convenience APIs; simplify the remaining closure adapters.
  • Adapt existing labeling tests to bound expressions and fold/rewrite tests to the surviving traversal APIs. Construct the expanded root directly in the bound partitioning test.

API Changes

This removes public Rust APIs with no production callers in the repository: unbound partitioning/analysis helpers and associated types, ReferenceCollector, VortexExprExt, ExactExpr, split_conjunction, replace_root_fields, NodeFolder, FoldDown, NodeExt::fold, NodeExt::transform, NodeExt::transform_up, and pre_order_visit_up. AnnotationFn now defaults its node type to BoundExpression.

@mhk197 mhk197 added the changelog/break A breaking API change label Sep 22, 2026
@codspeed

codspeed Bot commented Sep 22, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 21.56%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ 3 benchmarks measured no execution time

Nothing ran under measurement, usually because the compiler removed the code under test. These results are not comparable, so they count as unchanged.

Preventing compiler optimizations

⚡ 5 improved benchmarks
✅ 2081 untouched benchmarks
⏩ 479 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ WallTime mul_u64_nonnull_neon 40 µs 28.5 µs +40.15%
⚡ WallTime mul_i64_nonnull_neon 38.7 µs 32.5 µs +18.96%
⚡ WallTime multiply_shapes_neon[(32768, PerRowPerRow)] 38.7 µs 32.6 µs +18.91%
⚡ Simulation sum_v2_i64 224.6 µs 193.9 µs +15.87%
⚡ Simulation sum_i64 223.7 µs 193.6 µs +15.56%
⚠️ Simulation fixed_16_advancing_ptr_safe[100] < 1 ns < 1 ns N/A
⚠️ Simulation preverify_advancing_ptr_unchecked[1000] < 1 ns < 1 ns N/A
⚠️ Simulation preverify_advancing_ptr_unchecked[10000] < 1 ns < 1 ns N/A

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing mk/remove-unused-unbound-expressions (33b0e9f) with develop (bc9a579)

Open in CodSpeed

Footnotes

  1. 479 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@mhk197
mhk197 added this pull request to stack #10003 September 23, 2026 14:25
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 23, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 23, 2026
@github-actions

github-actions Bot commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 62f2845 statpopgen 1 Explore Profiling Data
🟢 Done 62f2845 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 62f2845 fineweb-s3 1 Explore Profiling Data
🟢 Done 62f2845 fineweb 1 Explore Profiling Data
🟢 Done 62f2845 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 62f2845 clickbench-nvme 1 Explore Profiling Data
🟢 Done 62f2845 tpcds-nvme 1 Explore Profiling Data
🟢 Done 62f2845 polarsignals 1 Explore Profiling Data
🟢 Done 62f2845 tpch-s3 1 Explore Profiling Data
🟢 Done 62f2845 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 62f28454 vs base 133aacdb
Vortex (geomean): hot 0.991x ➖ · cold 1.080x ➖


datafusion / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44674123 / 44996020 / -0.7% 94177173 / 88585674 / +6.3% 0.47 / 0.51 / -6.6%
polarsignals_q01/datafusion:vortex-file-compressed 50744374 / 50906696 / -0.3% 117259477 / 114040005 / +2.8% 0.43 / 0.45 / -3.1%
polarsignals_q02/datafusion:vortex-file-compressed 34773738 / 37202882 / -6.5% 84786327 / 80798573 / +4.9% 0.41 / 0.46 / -10.9%
polarsignals_q03/datafusion:vortex-file-compressed 53769226 / 54038176 / -0.5% 122050584 / 117997845 / +3.4% 0.44 / 0.46 / -3.8%
polarsignals_q04/datafusion:vortex-file-compressed 9701376 / 9689563 / +0.1% 53336395 / 46290639 / +15.2% 🔴 0.18 / 0.21 / -13.1%
polarsignals_q05/datafusion:vortex-file-compressed 11860749 / 11147877 / +6.4% 57959278 / 51815964 / +11.9% 🔴 0.20 / 0.22 / -4.9%
polarsignals_q06/datafusion:vortex-file-compressed 21748152 / 21883354 / -0.6% 65969582 / 59856048 / +10.2% 🔴 0.33 / 0.37 / -9.8%
polarsignals_q07/datafusion:vortex-file-compressed 11053275 / 11522380 / -4.1% 56876500 / 52441629 / +8.5% 0.19 / 0.22 / -11.6%
polarsignals_q08/datafusion:vortex-file-compressed 97690041 / 98277480 / -0.6% 168301345 / 162732883 / +3.4% 0.58 / 0.60 / -3.9%
polarsignals_q09/datafusion:vortex-file-compressed 10008758 / 10227333 / -2.1% 54314486 / 47413844 / +14.6% 🔴 0.18 / 0.22 / -14.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.983x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16468386 / 16478658 / -0.1% 47290654 / 47273241 / +0.0% 0.35 / 0.35 / -0.1%
tpch_q02/datafusion:vortex-file-compressed 17483207 / 17359438 / +0.7% 37540439 / 37249996 / +0.8% 0.47 / 0.47 / -0.1%
tpch_q03/datafusion:vortex-file-compressed 19180642 / 19332023 / -0.8% 49076569 / 50964874 / -3.7% 0.39 / 0.38 / +3.0%
tpch_q04/datafusion:vortex-file-compressed 10557181 / 10007673 / +5.5% 32717964 / 32496107 / +0.7% 0.32 / 0.31 / +4.8%
tpch_q05/datafusion:vortex-file-compressed 37227800 / 36747767 / +1.3% 65731530 / 66481792 / -1.1% 0.57 / 0.55 / +2.5%
tpch_q06/datafusion:vortex-file-compressed 6260850 / 6088048 / +2.8% 29365207 / 31154738 / -5.7% 0.21 / 0.20 / +9.1%
tpch_q07/datafusion:vortex-file-compressed 51342005 / 51751963 / -0.8% 82670361 / 83007438 / -0.4% 0.62 / 0.62 / -0.4%
tpch_q08/datafusion:vortex-file-compressed 52115127 / 53414680 / -2.4% 82871655 / 79581836 / +4.1% 0.63 / 0.67 / -6.3%
tpch_q09/datafusion:vortex-file-compressed 50430716 / 49707799 / +1.5% 78641953 / 77961340 / +0.9% 0.64 / 0.64 / +0.6%
tpch_q10/datafusion:vortex-file-compressed 17107094 / 16897819 / +1.2% 49987756 / 50375295 / -0.8% 0.34 / 0.34 / +2.0%
tpch_q11/datafusion:vortex-file-compressed 15333931 / 15305366 / +0.2% 34344402 / 35293548 / -2.7% 0.45 / 0.43 / +3.0%
tpch_q12/datafusion:vortex-file-compressed 22401218 / 22556725 / -0.7% 46473248 / 48474766 / -4.1% 0.48 / 0.47 / +3.6%
tpch_q13/datafusion:vortex-file-compressed 20070194 / 20435468 / -1.8% 43020861 / 39789205 / +8.1% 0.47 / 0.51 / -9.2%
tpch_q14/datafusion:vortex-file-compressed 15194321 / 14892600 / +2.0% 41290066 / 42125201 / -2.0% 0.37 / 0.35 / +4.1%
tpch_q15/datafusion:vortex-file-compressed 18548595 / 18317646 / +1.3% 45889094 / 46033955 / -0.3% 0.40 / 0.40 / +1.6%
tpch_q16/datafusion:vortex-file-compressed 18556191 / 18622275 / -0.4% 39570554 / 38313538 / +3.3% 0.47 / 0.49 / -3.5%
tpch_q17/datafusion:vortex-file-compressed 28189643 / 28524336 / -1.2% 60402874 / 59816425 / +1.0% 0.47 / 0.48 / -2.1%
tpch_q18/datafusion:vortex-file-compressed 36702343 / 37007669 / -0.8% 56913590 / 58961911 / -3.5% 0.64 / 0.63 / +2.7%
tpch_q19/datafusion:vortex-file-compressed 13668536 / 13819646 / -1.1% 39808246 / 39848321 / -0.1% 0.34 / 0.35 / -1.0%
tpch_q20/datafusion:vortex-file-compressed 20830096 / 21018980 / -0.9% 44367827 / 46314876 / -4.2% 0.47 / 0.45 / +3.5%
tpch_q21/datafusion:vortex-file-compressed 39226587 / 39044782 / +0.5% 68755454 / 68140388 / +0.9% 0.57 / 0.57 / -0.4%
tpch_q22/datafusion:vortex-file-compressed 10900306 / 11153784 / -2.3% 32417156 / 31619786 / +2.5% 0.34 / 0.35 / -4.7%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67112512 / 67590864 / -0.7% 84901556 / 89231552 / -4.9% 0.79 / 0.76 / +4.4%
tpch_q02/datafusion:parquet 52285366 / 52788778 / -1.0% 71246364 / 72037756 / -1.1% 0.73 / 0.73 / +0.1%
tpch_q03/datafusion:parquet 72527305 / 73029895 / -0.7% 98255209 / 99086021 / -0.8% 0.74 / 0.74 / +0.2%
tpch_q04/datafusion:parquet 39901019 / 40405779 / -1.2% 60828939 / 62506431 / -2.7% 0.66 / 0.65 / +1.5%
tpch_q05/datafusion:parquet 87989706 / 88635906 / -0.7% 117681586 / 120252759 / -2.1% 0.75 / 0.74 / +1.4%
tpch_q06/datafusion:parquet 28054294 / 28375640 / -1.1% 47698624 / 48054486 / -0.7% 0.59 / 0.59 / -0.4%
tpch_q07/datafusion:parquet 93512447 / 94568786 / -1.1% 124180240 / 124433034 / -0.2% 0.75 / 0.76 / -0.9%
tpch_q08/datafusion:parquet 95049479 / 95753783 / -0.7% 127431558 / 128314649 / -0.7% 0.75 / 0.75 / -0.0%
tpch_q09/datafusion:parquet 114198538 / 114092624 / +0.1% 146246086 / 149036887 / -1.9% 0.78 / 0.77 / +2.0%
tpch_q10/datafusion:parquet 80136123 / 80426091 / -0.4% 109969442 / 114007030 / -3.5% 0.73 / 0.71 / +3.3%
tpch_q11/datafusion:parquet 39430769 / 39140557 / +0.7% 60355121 / 62731617 / -3.8% 0.65 / 0.62 / +4.7%
tpch_q12/datafusion:parquet 61803918 / 61981806 / -0.3% 84917062 / 90391596 / -6.1% 0.73 / 0.69 / +6.1%
tpch_q13/datafusion:parquet 160770423 / 159512261 / +0.8% 182682301 / 183681803 / -0.5% 0.88 / 0.87 / +1.3%
tpch_q14/datafusion:parquet 39841396 / 39801606 / +0.1% 65202218 / 66500924 / -2.0% 0.61 / 0.60 / +2.1%
tpch_q15/datafusion:parquet 46404561 / 46356853 / +0.1% 68005167 / 69111788 / -1.6% 0.68 / 0.67 / +1.7%
tpch_q16/datafusion:parquet 39229632 / 38349366 / +2.3% 59308310 / 57674505 / +2.8% 0.66 / 0.66 / -0.5%
tpch_q17/datafusion:parquet 117146392 / 115818617 / +1.1% 141835185 / 144648583 / -1.9% 0.83 / 0.80 / +3.2%
tpch_q18/datafusion:parquet 114954006 / 115403037 / -0.4% 138210939 / 142262715 / -2.8% 0.83 / 0.81 / +2.5%
tpch_q19/datafusion:parquet 50432601 / 50670579 / -0.5% 77624923 / 81231516 / -4.4% 0.65 / 0.62 / +4.2%
tpch_q20/datafusion:parquet 58038203 / 58386210 / -0.6% 83717595 / 85007591 / -1.5% 0.69 / 0.69 / +0.9%
tpch_q21/datafusion:parquet 99416134 / 99186250 / +0.2% 123611107 / 124738235 / -0.9% 0.80 / 0.80 / +1.1%
tpch_q22/datafusion:parquet 41724416 / 42369812 / -1.5% 61273118 / 61925595 / -1.1% 0.68 / 0.68 / -0.5%
duckdb / vortex-file-compressed / ns (0.993x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11466908 / 10949268 / +4.7% 22093185 / 21419557 / +3.1% 0.52 / 0.51 / +1.5%
tpch_q02/duckdb:vortex-file-compressed 17451872 / 17721981 / -1.5% 25514447 / 27747137 / -8.0% 0.68 / 0.64 / +7.1%
tpch_q03/duckdb:vortex-file-compressed 17908961 / 18429767 / -2.8% 37407077 / 34169147 / +9.5% 0.48 / 0.54 / -11.2%
tpch_q04/duckdb:vortex-file-compressed 17447280 / 17777991 / -1.9% 29772278 / 31339957 / -5.0% 0.59 / 0.57 / +3.3%
tpch_q05/duckdb:vortex-file-compressed 21437340 / 22392223 / -4.3% 41447411 / 37349505 / +11.0% 🔴 0.52 / 0.60 / -13.7%
tpch_q06/duckdb:vortex-file-compressed 6166220 / 5587701 / +10.4% 🔴 15481703 / 14037478 / +10.3% 🔴 0.40 / 0.40 / +0.1%
tpch_q07/duckdb:vortex-file-compressed 21120185 / 20704058 / +2.0% 37780291 / 40826304 / -7.5% 0.56 / 0.51 / +10.2%
tpch_q08/duckdb:vortex-file-compressed 23386985 / 23065571 / +1.4% 39708266 / 41678032 / -4.7% 0.59 / 0.55 / +6.4%
tpch_q09/duckdb:vortex-file-compressed 29699849 / 30596254 / -2.9% 45878010 / 50979659 / -10.0% 🟢 0.65 / 0.60 / +7.9%
tpch_q10/duckdb:vortex-file-compressed 28223698 / 27783060 / +1.6% 42718370 / 50946680 / -16.2% 🟢 0.66 / 0.55 / +21.2%
tpch_q11/duckdb:vortex-file-compressed 8825453 / 8709718 / +1.3% 14461135 / 15076877 / -4.1% 0.61 / 0.58 / +5.6%
tpch_q12/duckdb:vortex-file-compressed 16070885 / 15668829 / +2.6% 32044591 / 29126350 / +10.0% 🔴 0.50 / 0.54 / -6.8%
tpch_q13/duckdb:vortex-file-compressed 22940601 / 21686064 / +5.8% 48404082 / 43037008 / +12.5% 🔴 0.47 / 0.50 / -5.9%
tpch_q14/duckdb:vortex-file-compressed 12870641 / 12956925 / -0.7% 24431104 / 25348033 / -3.6% 0.53 / 0.51 / +3.1%
tpch_q15/duckdb:vortex-file-compressed 9153413 / 9361317 / -2.2% 19932761 / 19948410 / -0.1% 0.46 / 0.47 / -2.1%
tpch_q16/duckdb:vortex-file-compressed 18200123 / 18388942 / -1.0% 24306986 / 24518901 / -0.9% 0.75 / 0.75 / -0.2%
tpch_q17/duckdb:vortex-file-compressed 15091273 / 18852912 / -20.0% 🟢 31590139 / 34836879 / -9.3% 0.48 / 0.54 / -11.7%
tpch_q18/duckdb:vortex-file-compressed 24477546 / 24870102 / -1.6% 35159124 / 40377403 / -12.9% 🟢 0.70 / 0.62 / +13.0%
tpch_q19/duckdb:vortex-file-compressed 23536718 / 24267052 / -3.0% 34289594 / 38578012 / -11.1% 🟢 0.69 / 0.63 / +9.1%
tpch_q20/duckdb:vortex-file-compressed 17290556 / 17231274 / +0.3% 32415715 / 36383047 / -10.9% 🟢 0.53 / 0.47 / +12.6%
tpch_q21/duckdb:vortex-file-compressed 65453163 / 66808642 / -2.0% 81888371 / 85949089 / -4.7% 0.80 / 0.78 / +2.8%
tpch_q22/duckdb:vortex-file-compressed 12104324 / 11992465 / +0.9% 19931792 / 21588979 / -7.7% 0.61 / 0.56 / +9.3%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60075695 / 60236542 / -0.3% 66794951 / 67031817 / -0.4% 0.90 / 0.90 / +0.1%
tpch_q02/duckdb:parquet 34702247 / 34788142 / -0.2% 43222024 / 42899730 / +0.8% 0.80 / 0.81 / -1.0%
tpch_q03/duckdb:parquet 62289864 / 62379524 / -0.1% 73570960 / 74217925 / -0.9% 0.85 / 0.84 / +0.7%
tpch_q04/duckdb:parquet 45515291 / 45607122 / -0.2% 55506310 / 55630811 / -0.2% 0.82 / 0.82 / +0.0%
tpch_q05/duckdb:parquet 60614432 / 60768837 / -0.3% 71750267 / 73613766 / -2.5% 0.84 / 0.83 / +2.3%
tpch_q06/duckdb:parquet 20246474 / 20157920 / +0.4% 24760557 / 24271547 / +2.0% 0.82 / 0.83 / -1.5%
tpch_q07/duckdb:parquet 60726528 / 61067239 / -0.6% 71561125 / 72565781 / -1.4% 0.85 / 0.84 / +0.8%
tpch_q08/duckdb:parquet 73123863 / 72755945 / +0.5% 85500426 / 86775680 / -1.5% 0.86 / 0.84 / +2.0%
tpch_q09/duckdb:parquet 113903159 / 114250588 / -0.3% 126696465 / 130895715 / -3.2% 0.90 / 0.87 / +3.0%
tpch_q10/duckdb:parquet 107719238 / 108779302 / -1.0% 121122886 / 122811457 / -1.4% 0.89 / 0.89 / +0.4%
tpch_q11/duckdb:parquet 19914608 / 20117833 / -1.0% 23859279 / 23924237 / -0.3% 0.83 / 0.84 / -0.7%
tpch_q12/duckdb:parquet 41222462 / 41488041 / -0.6% 49427119 / 49309092 / +0.2% 0.83 / 0.84 / -0.9%
tpch_q13/duckdb:parquet 238783415 / 239446399 / -0.3% 247403047 / 248683310 / -0.5% 0.97 / 0.96 / +0.2%
tpch_q14/duckdb:parquet 43278550 / 43424024 / -0.3% 51240640 / 53215712 / -3.7% 0.84 / 0.82 / +3.5%
tpch_q15/duckdb:parquet 24770386 / 24881458 / -0.4% 30673443 / 31559782 / -2.8% 0.81 / 0.79 / +2.4%
tpch_q16/duckdb:parquet 50820653 / 49944805 / +1.8% 57921108 / 59293718 / -2.3% 0.88 / 0.84 / +4.2%
tpch_q17/duckdb:parquet 44352203 / 44404992 / -0.1% 54014902 / 54568450 / -1.0% 0.82 / 0.81 / +0.9%
tpch_q18/duckdb:parquet 89992222 / 90242605 / -0.3% 97334971 / 101585498 / -4.2% 0.92 / 0.89 / +4.1%
tpch_q19/duckdb:parquet 61164040 / 61089332 / +0.1% 70871227 / 71357620 / -0.7% 0.86 / 0.86 / +0.8%
tpch_q20/duckdb:parquet 58642080 / 58601324 / +0.1% 70856453 / 70425954 / +0.6% 0.83 / 0.83 / -0.5%
tpch_q21/duckdb:parquet 136279936 / 136364073 / -0.1% 146772833 / 148286235 / -1.0% 0.93 / 0.92 / +1.0%
tpch_q22/duckdb:parquet 50359614 / 50301252 / +0.1% 58062391 / 57421133 / +1.1% 0.87 / 0.88 / -1.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+6.3%, low confidence)
Vortex (geomean): hot 1.027x ➖ · cold 0.994x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.013x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.990x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6913510 / 6865668 / +0.7% 19650714 / 20737116 / -5.2% 0.35 / 0.33 / +6.3%
fineweb_q01/datafusion:vortex-file-compressed 11997047 / 11491396 / +4.4% 48465212 / 51648072 / -6.2% 0.25 / 0.22 / +11.3%
fineweb_q02/datafusion:vortex-file-compressed 12618510 / 14266568 / -11.6% 🟢 51115455 / 55491010 / -7.9% 0.25 / 0.26 / -4.0%
fineweb_q03/datafusion:vortex-file-compressed 20351426 / 20003104 / +1.7% 116812656 / 106193719 / +10.0% 0.17 / 0.19 / -7.5%
fineweb_q04/datafusion:vortex-file-compressed 76313480 / 76581448 / -0.3% 163481721 / 162630834 / +0.5% 0.47 / 0.47 / -0.9%
fineweb_q05/datafusion:vortex-file-compressed 61449034 / 60708712 / +1.2% 146512704 / 139870782 / +4.7% 0.42 / 0.43 / -3.4%
fineweb_q06/datafusion:vortex-file-compressed 19179529 / 20005883 / -4.1% 118486506 / 109351276 / +8.4% 0.16 / 0.18 / -11.5%
fineweb_q07/datafusion:vortex-file-compressed 16835072 / 17392833 / -3.2% 112914604 / 103378964 / +9.2% 0.15 / 0.17 / -11.4%
fineweb_q08/datafusion:vortex-file-compressed 10452201 / 10135009 / +3.1% 56206481 / 49089770 / +14.5% 🔴 0.19 / 0.21 / -9.9%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9298618 / 9519542 / -2.3% 37737884 / 33504757 / +12.6% 🔴 0.25 / 0.28 / -13.3%
fineweb_q01/datafusion:parquet 75442372 / 74340830 / +1.5% 155766053 / 151880052 / +2.6% 0.48 / 0.49 / -1.0%
fineweb_q02/datafusion:parquet 74547897 / 74039476 / +0.7% 154498010 / 155566272 / -0.7% 0.48 / 0.48 / +1.4%
fineweb_q03/datafusion:parquet 73709040 / 74039710 / -0.4% 155648643 / 150903027 / +3.1% 0.47 / 0.49 / -3.5%
fineweb_q04/datafusion:parquet 82628025 / 82587285 / +0.0% 165614792 / 150832112 / +9.8% 0.50 / 0.55 / -8.9%
fineweb_q05/datafusion:parquet 81683453 / 79863990 / +2.3% 154197065 / 155752609 / -1.0% 0.53 / 0.51 / +3.3%
fineweb_q06/datafusion:parquet 74667039 / 75877495 / -1.6% 165101080 / 160748564 / +2.7% 0.45 / 0.47 / -4.2%
fineweb_q07/datafusion:parquet 74865107 / 75269979 / -0.5% 157207867 / 151625921 / +3.7% 0.48 / 0.50 / -4.1%
fineweb_q08/datafusion:parquet 73495728 / 73558662 / -0.1% 155233055 / 146813950 / +5.7% 0.47 / 0.50 / -5.5%
duckdb / vortex-file-compressed / ns (1.064x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 3674131 / 1908762 / +92.5% 🔴 7693310 / 6085806 / +26.4% 🔴 0.48 / 0.31 / +52.3%
fineweb_q01/duckdb:vortex-file-compressed 18885600 / 19765777 / -4.5% 57650988 / 60906323 / -5.3% 0.33 / 0.32 / +0.9%
fineweb_q02/duckdb:vortex-file-compressed 19502994 / 20295954 / -3.9% 52003874 / 52824492 / -1.6% 0.38 / 0.38 / -2.4%
fineweb_q03/duckdb:vortex-file-compressed 27253005 / 26131680 / +4.3% 90708682 / 101647811 / -10.8% 🟢 0.30 / 0.26 / +16.9%
fineweb_q04/duckdb:vortex-file-compressed 75530642 / 76586855 / -1.4% 114850054 / 140934958 / -18.5% 🟢 0.66 / 0.54 / +21.0%
fineweb_q05/duckdb:vortex-file-compressed 59535179 / 59335900 / +0.3% 102776910 / 105689563 / -2.8% 0.58 / 0.56 / +3.2%
fineweb_q06/duckdb:vortex-file-compressed 36888022 / 36998453 / -0.3% 118677540 / 118337113 / +0.3% 0.31 / 0.31 / -0.6%
fineweb_q07/duckdb:vortex-file-compressed 27253690 / 29075583 / -6.3% 108611630 / 113541986 / -4.3% 0.25 / 0.26 / -2.0%
fineweb_q08/duckdb:vortex-file-compressed 6328684 / 6149257 / +2.9% 14562658 / 16755360 / -13.1% 🟢 0.43 / 0.37 / +18.4%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24129169 / 23688636 / +1.9% 23384535 / 22929968 / +2.0% 1.03 / 1.03 / -0.1%
fineweb_q01/duckdb:parquet 44066746 / 44884231 / -1.8% 55465056 / 57281847 / -3.2% 0.79 / 0.78 / +1.4%
fineweb_q02/duckdb:parquet 43584482 / 43847862 / -0.6% 56586663 / 53324643 / +6.1% 0.77 / 0.82 / -6.3%
fineweb_q03/duckdb:parquet 94403640 / 94670463 / -0.3% 177502610 / 184384565 / -3.7% 0.53 / 0.51 / +3.6%
fineweb_q04/duckdb:parquet 153515476 / 151598390 / +1.3% 197497461 / 224019223 / -11.8% 🟢 0.78 / 0.68 / +14.9%
fineweb_q05/duckdb:parquet 144540595 / 143715127 / +0.6% 194103372 / 199586032 / -2.7% 0.74 / 0.72 / +3.4%
fineweb_q06/duckdb:parquet 71601180 / 71770700 / -0.2% 125552213 / 131441587 / -4.5% 0.57 / 0.55 / +4.4%
fineweb_q07/duckdb:parquet 72319537 / 72182728 / +0.2% 156052055 / 143340591 / +8.9% 0.46 / 0.50 / -8.0%
fineweb_q08/duckdb:parquet 24070616 / 23904844 / +0.7% 23711146 / 24555905 / -3.4% 1.02 / 0.97 / +4.3%

No file size changes detected.

@mhk197
mhk197 removed this pull request from stack #10003 September 23, 2026 15:50
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+3.4%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 1.023x ➖ · cold 1.083x ➖
Parquet (geomean): hot 1.014x ➖ · cold 1.100x ➖
Shifts: Parquet (control) +1.4% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.038x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 208462174 / 169677039 / +22.9% 🔴 572047092 / 495580740 / +15.4% 🔴 0.36 / 0.34 / +6.4%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10766449 / 10565602 / +1.9% 51213093 / 46281107 / +10.7% 🔴 0.21 / 0.23 / -7.9%
clickbench-sorted_q26/datafusion:vortex-file-compressed 12003608 / 12413810 / -3.3% 50568637 / 47062075 / +7.5% 0.24 / 0.26 / -10.0%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23059716 / 22604848 / +2.0% 75785298 / 62896188 / +20.5% 🔴 0.30 / 0.36 / -15.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18424898 / 18116288 / +1.7% 60257040 / 55046206 / +9.5% 0.31 / 0.33 / -7.1%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17770218 / 17334964 / +2.5% 64987562 / 58691156 / +10.7% 🔴 0.27 / 0.30 / -7.4%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41233008 / 40851726 / +0.9% 94984706 / 87818305 / +8.2% 0.43 / 0.47 / -6.7%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12256696 / 11753988 / +4.3% 48994886 / 39907633 / +22.8% 🔴 0.25 / 0.29 / -15.1%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12199062 / 11621022 / +5.0% 46845297 / 39586073 / +18.3% 🔴 0.26 / 0.29 / -11.3%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10135670 / 9947480 / +1.9% 39110336 / 33731378 / +15.9% 🔴 0.26 / 0.29 / -12.1%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 768130822 / 758954862 / +1.2% 989970071 / 966620132 / +2.4% 0.78 / 0.79 / -1.2%
clickbench-sorted_q24/datafusion:parquet 8715762 / 8709598 / +0.1% 72954371 / 69496409 / +5.0% 0.12 / 0.13 / -4.7%
clickbench-sorted_q26/datafusion:parquet 8877206 / 9187352 / -3.4% 74151794 / 70126841 / +5.7% 0.12 / 0.13 / -8.6%
clickbench-sorted_q36/datafusion:parquet 94579026 / 94399293 / +0.2% 174281649 / 164669456 / +5.8% 0.54 / 0.57 / -5.3%
clickbench-sorted_q37/datafusion:parquet 64764492 / 64150050 / +1.0% 133498211 / 129635283 / +3.0% 0.49 / 0.49 / -2.0%
clickbench-sorted_q38/datafusion:parquet 88111422 / 87080078 / +1.2% 165326517 / 156366095 / +5.7% 0.53 / 0.56 / -4.3%
clickbench-sorted_q39/datafusion:parquet 161317761 / 160354076 / +0.6% 240670276 / 230129750 / +4.6% 0.67 / 0.70 / -3.8%
clickbench-sorted_q40/datafusion:parquet 45002272 / 43998456 / +2.3% 117875183 / 109177410 / +8.0% 0.38 / 0.40 / -5.3%
clickbench-sorted_q41/datafusion:parquet 42428724 / 41996604 / +1.0% 113152311 / 106686986 / +6.1% 0.37 / 0.39 / -4.7%
clickbench-sorted_q42/datafusion:parquet 26019818 / 26060896 / -0.2% 87192247 / 86307467 / +1.0% 0.30 / 0.30 / -1.2%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 55919568 / 55595612 / +0.6% 76214868 / 98211544 / -22.4% 🟢 0.73 / 0.57 / +29.6%
clickbench-sorted_q24/duckdb:vortex-file-compressed 17919094 / 19688954 / -9.0% 37148548 / 32121289 / +15.7% 🔴 0.48 / 0.61 / -21.3%
clickbench-sorted_q26/duckdb:vortex-file-compressed 17769494 / 14530607 / +22.3% 🔴 27082102 / 30658306 / -11.7% 🟢 0.66 / 0.47 / +38.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed 30029442 / 29471770 / +1.9% 63707170 / 61158910 / +4.2% 0.47 / 0.48 / -2.2%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23340328 / 24590983 / -5.1% 52264080 / 51944759 / +0.6% 0.45 / 0.47 / -5.7%
clickbench-sorted_q38/duckdb:vortex-file-compressed 26320551 / 25822844 / +1.9% 61028919 / 54733599 / +11.5% 🔴 0.43 / 0.47 / -8.6%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48166818 / 47609590 / +1.2% 105546636 / 92137724 / +14.6% 🔴 0.46 / 0.52 / -11.7%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15925402 / 15998015 / -0.5% 41216011 / 35019250 / +17.7% 🔴 0.39 / 0.46 / -15.4%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15372242 / 15462336 / -0.6% 40000016 / 35324013 / +13.2% 🔴 0.38 / 0.44 / -12.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed 11881830 / 12063503 / -1.5% 29443704 / 31079481 / -5.3% 0.40 / 0.39 / +4.0%
duckdb / parquet / ns (1.024x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 128388084 / 125122411 / +2.6% 147555698 / 141465765 / +4.3% 0.87 / 0.88 / -1.6%
clickbench-sorted_q24/duckdb:parquet 17919396 / 17622182 / +1.7% 27764957 / 29574575 / -6.1% 0.65 / 0.60 / +8.3%
clickbench-sorted_q26/duckdb:parquet 12929064 / 13461512 / -4.0% 28497624 / 25400584 / +12.2% 🔴 0.45 / 0.53 / -14.4%
clickbench-sorted_q36/duckdb:parquet 44947800 / 42545567 / +5.6% 69225825 / 59587869 / +16.2% 🔴 0.65 / 0.71 / -9.1%
clickbench-sorted_q37/duckdb:parquet 30707524 / 31211295 / -1.6% 54386309 / 45587739 / +19.3% 🔴 0.56 / 0.68 / -17.5%
clickbench-sorted_q38/duckdb:parquet 40693766 / 37828072 / +7.6% 64342466 / 56067961 / +14.8% 🔴 0.63 / 0.67 / -6.3%
clickbench-sorted_q39/duckdb:parquet 78430556 / 71601597 / +9.5% 91653280 / 88542189 / +3.5% 0.86 / 0.81 / +5.8%
clickbench-sorted_q40/duckdb:parquet 17148746 / 16929866 / +1.3% 49063603 / 34611080 / +41.8% 🔴 0.35 / 0.49 / -28.5%
clickbench-sorted_q41/duckdb:parquet 17258136 / 16681118 / +3.5% 46119998 / 35345295 / +30.5% 🔴 0.37 / 0.47 / -20.7%
clickbench-sorted_q42/duckdb:parquet 10599530 / 10799896 / -1.9% 29057187 / 22923450 / +26.8% 🔴 0.36 / 0.47 / -22.6%

File Size Changes (100 files changed, +0.0% overall, 53↑ 47↓)
File Scale Format Base HEAD Change %
hits_097.vortex 1.0 vortex-file-compressed 192.66 MB 196.12 MB +3.46 MB +1.8%
hits_032.vortex 1.0 vortex-file-compressed 152.54 MB 154.22 MB +1.69 MB +1.1%
hits_096.vortex 1.0 vortex-file-compressed 199.19 MB 200.68 MB +1.49 MB +0.7%
hits_045.vortex 1.0 vortex-file-compressed 139.17 MB 139.95 MB +802.16 KB +0.6%
hits_036.vortex 1.0 vortex-file-compressed 171.90 MB 172.76 MB +884.26 KB +0.5%
hits_066.vortex 1.0 vortex-file-compressed 162.99 MB 163.80 MB +829.89 KB +0.5%
hits_071.vortex 1.0 vortex-file-compressed 139.33 MB 139.99 MB +669.04 KB +0.5%
hits_006.vortex 1.0 vortex-file-compressed 126.59 MB 127.03 MB +455.59 KB +0.4%
hits_062.vortex 1.0 vortex-file-compressed 171.34 MB 171.81 MB +479.41 KB +0.3%
hits_067.vortex 1.0 vortex-file-compressed 130.77 MB 131.07 MB +305.51 KB +0.2%
hits_025.vortex 1.0 vortex-file-compressed 172.31 MB 172.69 MB +393.36 KB +0.2%
hits_092.vortex 1.0 vortex-file-compressed 200.61 MB 201.04 MB +443.24 KB +0.2%
hits_057.vortex 1.0 vortex-file-compressed 159.79 MB 160.09 MB +312.75 KB +0.2%
hits_079.vortex 1.0 vortex-file-compressed 180.55 MB 180.89 MB +343.38 KB +0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.39 MB 190.74 MB +357.10 KB +0.2%
hits_069.vortex 1.0 vortex-file-compressed 142.84 MB 143.08 MB +242.87 KB +0.2%
hits_088.vortex 1.0 vortex-file-compressed 172.88 MB 173.16 MB +288.18 KB +0.2%
hits_046.vortex 1.0 vortex-file-compressed 100.71 MB 100.87 MB +160.95 KB +0.2%
hits_000.vortex 1.0 vortex-file-compressed 130.57 MB 130.76 MB +190.71 KB +0.1%
hits_055.vortex 1.0 vortex-file-compressed 200.69 MB 200.96 MB +275.87 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.03 MB 152.21 MB +193.25 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 161.64 MB 161.82 MB +187.27 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.44 MB 190.62 MB +183.73 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 200.16 MB 200.34 MB +190.18 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 200.76 MB 200.92 MB +166.95 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.61 MB 130.71 MB +103.84 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.91 MB 169.03 MB +121.34 KB +0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.54 MB 161.65 MB +111.65 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.05 MB 167.16 MB +106.23 KB +0.1%
hits_027.vortex 1.0 vortex-file-compressed 189.48 MB 189.60 MB +120.20 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 194.80 MB 194.91 MB +106.91 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.08 MB 161.17 MB +85.56 KB +0.1%
hits_022.vortex 1.0 vortex-file-compressed 198.80 MB 198.90 MB +100.52 KB +0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.25 MB 130.31 MB +60.85 KB +0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.31 MB 160.38 MB +71.98 KB +0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.54 MB 189.61 MB +77.84 KB +0.0%
hits_007.vortex 1.0 vortex-file-compressed 201.12 MB 201.19 MB +74.93 KB +0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.40 MB 139.44 MB +50.62 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.13 MB 178.19 MB +62.99 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.70 MB 181.76 MB +59.43 KB +0.0%
hits_074.vortex 1.0 vortex-file-compressed 200.14 MB 200.21 MB +62.74 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.55 MB 161.60 MB +48.62 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.75 MB 192.80 MB +52.91 KB +0.0%
hits_051.vortex 1.0 vortex-file-compressed 172.82 MB 172.87 MB +44.55 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.00 MB 127.02 MB +29.52 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.75 MB 171.79 MB +39.27 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.20 MB 156.23 MB +30.73 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.40 MB 154.42 MB +23.66 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.12 MB 131.14 MB +17.39 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.70 MB 126.72 MB +13.37 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.71 MB 172.73 MB +15.11 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.20 MB 147.21 MB +10.41 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.77 MB 130.78 MB +6.13 KB +0.0%
hits_048.vortex 1.0 vortex-file-compressed 200.68 MB 200.67 MB 3.06 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.49 MB 136.49 MB 2.28 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.76 MB 191.76 MB 8.22 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.95 MB 161.93 MB 12.58 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.78 MB 153.77 MB 13.59 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.58 MB 130.57 MB 13.44 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.66 MB 161.64 MB 19.94 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.21 MB 202.19 MB 25.91 KB -0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.05 MB 201.02 MB 30.91 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.87 MB 172.84 MB 32.95 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.13 MB 159.09 MB 41.52 KB -0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.92 MB 130.89 MB 35.52 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.08 MB 189.03 MB 53.50 KB -0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.36 MB 192.30 MB 65.77 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.29 MB 147.24 MB 50.91 KB -0.0%
hits_041.vortex 1.0 vortex-file-compressed 130.26 MB 130.21 MB 45.76 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.18 MB 102.14 MB 39.75 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.80 MB 153.72 MB 76.84 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 173.07 MB 172.97 MB 94.73 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.18 MB 130.11 MB 72.04 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.19 MB 191.09 MB 108.52 KB -0.1%
hits_053.vortex 1.0 vortex-file-compressed 189.55 MB 189.44 MB 115.20 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.74 MB 130.65 MB 87.55 KB -0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.75 MB 153.65 MB 103.29 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.74 MB 137.65 MB 93.45 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 201.00 MB 200.86 MB 144.57 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 179.91 MB 179.78 MB 129.71 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 144.08 MB 143.98 MB 104.53 KB -0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.01 MB 139.90 MB 112.38 KB -0.1%
hits_033.vortex 1.0 vortex-file-compressed 201.09 MB 200.91 MB 188.93 KB -0.1%
hits_091.vortex 1.0 vortex-file-compressed 147.55 MB 147.37 MB 182.45 KB -0.1%
hits_050.vortex 1.0 vortex-file-compressed 161.81 MB 161.61 MB 204.39 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 161.54 MB 161.33 MB 213.05 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.98 MB 101.84 MB 139.56 KB -0.1%
hits_070.vortex 1.0 vortex-file-compressed 201.16 MB 200.89 MB 281.24 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 162.03 MB 161.81 MB 231.34 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.33 MB 130.15 MB 187.87 KB -0.1%
hits_001.vortex 1.0 vortex-file-compressed 189.09 MB 188.77 MB 329.62 KB -0.2%
hits_084.vortex 1.0 vortex-file-compressed 154.21 MB 153.94 MB 276.88 KB -0.2%
hits_020.vortex 1.0 vortex-file-compressed 160.04 MB 159.76 MB 295.94 KB -0.2%
hits_009.vortex 1.0 vortex-file-compressed 101.25 MB 101.04 MB 212.05 KB -0.2%
hits_094.vortex 1.0 vortex-file-compressed 158.59 MB 158.20 MB 396.38 KB -0.2%
hits_056.vortex 1.0 vortex-file-compressed 135.52 MB 135.00 MB 529.60 KB -0.4%
hits_082.vortex 1.0 vortex-file-compressed 140.01 MB 139.25 MB 778.41 KB -0.5%
hits_059.vortex 1.0 vortex-file-compressed 200.21 MB 198.94 MB 1.27 MB -0.6%
hits_085.vortex 1.0 vortex-file-compressed 200.81 MB 199.46 MB 1.35 MB -0.7%
hits_044.vortex 1.0 vortex-file-compressed 201.51 MB 199.46 MB 2.05 MB -1.0%

Totals:

  • vortex-file-compressed: 15.96 GB → 15.96 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.941x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 96804676 / 96837014 / -0.0% 168700616 / 172832219 / -2.4% 0.57 / 0.56 / +2.4%
tpch_q02/datafusion:vortex-file-compressed 64507472 / 64729358 / -0.3% 93918928 / 98343385 / -4.5% 0.69 / 0.66 / +4.4%
tpch_q03/datafusion:vortex-file-compressed 64049419 / 64791387 / -1.1% 114888778 / 120361289 / -4.5% 0.56 / 0.54 / +3.6%
tpch_q04/datafusion:vortex-file-compressed 34986069 / 35223101 / -0.7% 81693556 / 82153036 / -0.6% 0.43 / 0.43 / -0.1%
tpch_q05/datafusion:vortex-file-compressed 117559050 / 117695706 / -0.1% 195134021 / 181384210 / +7.6% 0.60 / 0.65 / -7.2%
tpch_q06/datafusion:vortex-file-compressed 14650694 / 15157800 / -3.3% 65671117 / 72626276 / -9.6% 0.22 / 0.21 / +6.9%
tpch_q07/datafusion:vortex-file-compressed 140598253 / 140940248 / -0.2% 189262266 / 198996739 / -4.9% 0.74 / 0.71 / +4.9%
tpch_q08/datafusion:vortex-file-compressed 142846361 / 144413621 / -1.1% 205103624 / 205301030 / -0.1% 0.70 / 0.70 / -1.0%
tpch_q09/datafusion:vortex-file-compressed 188573527 / 182172681 / +3.5% 259008575 / 259733149 / -0.3% 0.73 / 0.70 / +3.8%
tpch_q10/datafusion:vortex-file-compressed 73490175 / 73406718 / +0.1% 137218732 / 140735619 / -2.5% 0.54 / 0.52 / +2.7%
tpch_q11/datafusion:vortex-file-compressed 43076942 / 43117204 / -0.1% 66989806 / 70196062 / -4.6% 0.64 / 0.61 / +4.7%
tpch_q12/datafusion:vortex-file-compressed 45036123 / 45900327 / -1.9% 89408567 / 96770582 / -7.6% 0.50 / 0.47 / +6.2%
tpch_q13/datafusion:vortex-file-compressed 46354549 / 45827114 / +1.2% 72796448 / 78154662 / -6.9% 0.64 / 0.59 / +8.6%
tpch_q14/datafusion:vortex-file-compressed 25196003 / 25071648 / +0.5% 91924918 / 98466273 / -6.6% 0.27 / 0.25 / +7.6%
tpch_q15/datafusion:vortex-file-compressed 36914478 / 37011380 / -0.3% 98131249 / 103206355 / -4.9% 0.38 / 0.36 / +4.9%
tpch_q16/datafusion:vortex-file-compressed 37039407 / 37331587 / -0.8% 63120235 / 68030166 / -7.2% 0.59 / 0.55 / +6.9%
tpch_q17/datafusion:vortex-file-compressed 173432175 / 172724811 / +0.4% 221390331 / 228777808 / -3.2% 0.78 / 0.75 / +3.8%
tpch_q18/datafusion:vortex-file-compressed 200810571 / 200026755 / +0.4% 269206117 / 269758705 / -0.2% 0.75 / 0.74 / +0.6%
tpch_q19/datafusion:vortex-file-compressed 34136228 / 34823193 / -2.0% 93301945 / 94646887 / -1.4% 0.37 / 0.37 / -0.6%
tpch_q20/datafusion:vortex-file-compressed 63265922 / 63090231 / +0.3% 123436846 / 128404811 / -3.9% 0.51 / 0.49 / +4.3%
tpch_q21/datafusion:vortex-file-compressed 183650629 / 185528897 / -1.0% 239364697 / 241080631 / -0.7% 0.77 / 0.77 / -0.3%
tpch_q22/datafusion:vortex-file-compressed 25540163 / 25213687 / +1.3% 53626096 / 58997969 / -9.1% 0.48 / 0.43 / +11.4%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 82658319 / 83593448 / -1.1% 130659646 / 133867744 / -2.4% 0.63 / 0.62 / +1.3%
tpch_q02/datafusion:parquet 136046332 / 134381651 / +1.2% 163080734 / 167308126 / -2.5% 0.83 / 0.80 / +3.9%
tpch_q03/datafusion:parquet 126237765 / 124856096 / +1.1% 186338785 / 199711953 / -6.7% 0.68 / 0.63 / +8.4%
tpch_q04/datafusion:parquet 54250158 / 53998632 / +0.5% 99965006 / 106259153 / -5.9% 0.54 / 0.51 / +6.8%
tpch_q05/datafusion:parquet 164392797 / 166536696 / -1.3% 239796627 / 247100769 / -3.0% 0.69 / 0.67 / +1.7%
tpch_q06/datafusion:parquet 32436651 / 32656803 / -0.7% 78361030 / 82643484 / -5.2% 0.41 / 0.40 / +4.8%
tpch_q07/datafusion:parquet 216959113 / 216602659 / +0.2% 285686964 / 283096409 / +0.9% 0.76 / 0.77 / -0.7%
tpch_q08/datafusion:parquet 214620548 / 211196270 / +1.6% 292366067 / 303253792 / -3.6% 0.73 / 0.70 / +5.4%
tpch_q09/datafusion:parquet 283077340 / 280636179 / +0.9% 360478017 / 381551637 / -5.5% 0.79 / 0.74 / +6.8%
tpch_q10/datafusion:parquet 305472726 / 304647361 / +0.3% 375340351 / 388444608 / -3.4% 0.81 / 0.78 / +3.8%
tpch_q11/datafusion:parquet 97368741 / 96948775 / +0.4% 120057756 / 126827832 / -5.3% 0.81 / 0.76 / +6.1%
tpch_q12/datafusion:parquet 78761349 / 79574512 / -1.0% 130339525 / 138279375 / -5.7% 0.60 / 0.58 / +5.0%
tpch_q13/datafusion:parquet 195330112 / 195544445 / -0.1% 227283078 / 230850399 / -1.5% 0.86 / 0.85 / +1.5%
tpch_q14/datafusion:parquet 75398537 / 75759877 / -0.5% 195312374 / 196167088 / -0.4% 0.39 / 0.39 / -0.0%
tpch_q15/datafusion:parquet 78422410 / 79808833 / -1.7% 139811367 / 141662067 / -1.3% 0.56 / 0.56 / -0.4%
tpch_q16/datafusion:parquet 85244859 / 83338035 / +2.3% 111173386 / 113592029 / -2.1% 0.77 / 0.73 / +4.5%
tpch_q17/datafusion:parquet 206782281 / 207460102 / -0.3% 266390252 / 271424019 / -1.9% 0.78 / 0.76 / +1.6%
tpch_q18/datafusion:parquet 265357882 / 264964825 / +0.1% 318106798 / 317624220 / +0.2% 0.83 / 0.83 / -0.0%
tpch_q19/datafusion:parquet 98585942 / 98096000 / +0.5% 172859344 / 170306468 / +1.5% 0.57 / 0.58 / -1.0%
tpch_q20/datafusion:parquet 153703872 / 154061590 / -0.2% 218934458 / 220898216 / -0.9% 0.70 / 0.70 / +0.7%
tpch_q21/datafusion:parquet 232972452 / 232702639 / +0.1% 320759046 / 318977307 / +0.6% 0.73 / 0.73 / -0.4%
tpch_q22/datafusion:parquet 162382977 / 161763004 / +0.4% 185900577 / 189132291 / -1.7% 0.87 / 0.86 / +2.1%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54813904 / 51008551 / +7.5% 91045215 / 95401170 / -4.6% 0.60 / 0.53 / +12.6%
tpch_q02/duckdb:vortex-file-compressed 31465388 / 32566950 / -3.4% 48829967 / 50175353 / -2.7% 0.64 / 0.65 / -0.7%
tpch_q03/duckdb:vortex-file-compressed 57586379 / 58889558 / -2.2% 108233933 / 123467692 / -12.3% 🟢 0.53 / 0.48 / +11.6%
tpch_q04/duckdb:vortex-file-compressed 79891696 / 82240370 / -2.9% 115193322 / 126528300 / -9.0% 0.69 / 0.65 / +6.7%
tpch_q05/duckdb:vortex-file-compressed 67745103 / 66198483 / +2.3% 126667048 / 129012960 / -1.8% 0.53 / 0.51 / +4.2%
tpch_q06/duckdb:vortex-file-compressed 20878428 / 21656515 / -3.6% 58663334 / 70206690 / -16.4% 🟢 0.36 / 0.31 / +15.4%
tpch_q07/duckdb:vortex-file-compressed 61582620 / 59612355 / +3.3% 125807591 / 131660262 / -4.4% 0.49 / 0.45 / +8.1%
tpch_q08/duckdb:vortex-file-compressed 85766668 / 88480999 / -3.1% 151244021 / 159084559 / -4.9% 0.57 / 0.56 / +2.0%
tpch_q09/duckdb:vortex-file-compressed 166979938 / 168191450 / -0.7% 228146921 / 258235598 / -11.7% 🟢 0.73 / 0.65 / +12.4%
tpch_q10/duckdb:vortex-file-compressed 108385387 / 109616646 / -1.1% 156252728 / 178910604 / -12.7% 🟢 0.69 / 0.61 / +13.2%
tpch_q11/duckdb:vortex-file-compressed 17589520 / 17598311 / -0.0% 28227474 / 32780725 / -13.9% 🟢 0.62 / 0.54 / +16.1%
tpch_q12/duckdb:vortex-file-compressed 57456123 / 57800935 / -0.6% 109850655 / 116060189 / -5.4% 0.52 / 0.50 / +5.0%
tpch_q13/duckdb:vortex-file-compressed 90095313 / 90830142 / -0.8% 132039051 / 148586371 / -11.1% 🟢 0.68 / 0.61 / +11.6%
tpch_q14/duckdb:vortex-file-compressed 31461608 / 30438771 / +3.4% 74350162 / 79059927 / -6.0% 0.42 / 0.39 / +9.9%
tpch_q15/duckdb:vortex-file-compressed 38876738 / 39568276 / -1.7% 82168034 / 97630719 / -15.8% 🟢 0.47 / 0.41 / +16.7%
tpch_q16/duckdb:vortex-file-compressed 42535583 / 42697467 / -0.4% 53782092 / 56279091 / -4.4% 0.79 / 0.76 / +4.2%
tpch_q17/duckdb:vortex-file-compressed 65224602 / 63250484 / +3.1% 128693881 / 144046922 / -10.7% 🟢 0.51 / 0.44 / +15.4%
tpch_q18/duckdb:vortex-file-compressed 131562181 / 135429430 / -2.9% 168422074 / 169277310 / -0.5% 0.78 / 0.80 / -2.4%
tpch_q19/duckdb:vortex-file-compressed 42969516 / 41006516 / +4.8% 92808629 / 98569600 / -5.8% 0.46 / 0.42 / +11.3%
tpch_q20/duckdb:vortex-file-compressed 58940097 / 60638119 / -2.8% 112744786 / 132084959 / -14.6% 🟢 0.52 / 0.46 / +13.9%
tpch_q21/duckdb:vortex-file-compressed 241222086 / 237996034 / +1.4% 278103155 / 288385274 / -3.6% 0.87 / 0.83 / +5.1%
tpch_q22/duckdb:vortex-file-compressed 41579279 / 41951091 / -0.9% 59368408 / 62462938 / -5.0% 0.70 / 0.67 / +4.3%
duckdb / parquet / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70493268 / 70724894 / -0.3% 88465155 / 92912701 / -4.8% 0.80 / 0.76 / +4.7%
tpch_q02/duckdb:parquet 71217096 / 71910989 / -1.0% 81438344 / 85891457 / -5.2% 0.87 / 0.84 / +4.5%
tpch_q03/duckdb:parquet 115405510 / 114707985 / +0.6% 151112076 / 149421541 / +1.1% 0.76 / 0.77 / -0.5%
tpch_q04/duckdb:parquet 74704899 / 75989177 / -1.7% 100427439 / 97018779 / +3.5% 0.74 / 0.78 / -5.0%
tpch_q05/duckdb:parquet 127276503 / 125888470 / +1.1% 174304207 / 163875482 / +6.4% 0.73 / 0.77 / -4.9%
tpch_q06/duckdb:parquet 33693769 / 40686398 / -17.2% 🟢 55453229 / 48946961 / +13.3% 🔴 0.61 / 0.83 / -26.9%
tpch_q07/duckdb:parquet 89721790 / 90777602 / -1.2% 130028379 / 133107274 / -2.3% 0.69 / 0.68 / +1.2%
tpch_q08/duckdb:parquet 142924684 / 143433778 / -0.4% 203634133 / 199080504 / +2.3% 0.70 / 0.72 / -2.6%
tpch_q09/duckdb:parquet 222433171 / 223251797 / -0.4% 267442266 / 266940131 / +0.2% 0.83 / 0.84 / -0.6%
tpch_q10/duckdb:parquet 471683542 / 472434183 / -0.2% 531244161 / 510610726 / +4.0% 0.89 / 0.93 / -4.0%
tpch_q11/duckdb:parquet 30922093 / 30941232 / -0.1% 40788100 / 39469376 / +3.3% 0.76 / 0.78 / -3.3%
tpch_q12/duckdb:parquet 75419636 / 76461944 / -1.4% 95164220 / 91393735 / +4.1% 0.79 / 0.84 / -5.3%
tpch_q13/duckdb:parquet 318671965 / 318931574 / -0.1% 328610433 / 331658330 / -0.9% 0.97 / 0.96 / +0.8%
tpch_q14/duckdb:parquet 107244201 / 106018100 / +1.2% 138041625 / 133582540 / +3.3% 0.78 / 0.79 / -2.1%
tpch_q15/duckdb:parquet 44532502 / 48915653 / -9.0% 70349667 / 75251914 / -6.5% 0.63 / 0.65 / -2.6%
tpch_q16/duckdb:parquet 114751464 / 115243278 / -0.4% 124129801 / 126848071 / -2.1% 0.92 / 0.91 / +1.8%
tpch_q17/duckdb:parquet 76144845 / 74159570 / +2.7% 102811946 / 100744197 / +2.1% 0.74 / 0.74 / +0.6%
tpch_q18/duckdb:parquet 204102343 / 192488565 / +6.0% 168000060 / 172745370 / -2.7% 1.21 / 1.11 / +9.0%
tpch_q19/duckdb:parquet 175697452 / 162803565 / +7.9% 210978477 / 194782639 / +8.3% 0.83 / 0.84 / -0.4%
tpch_q20/duckdb:parquet 130571533 / 129040012 / +1.2% 169546347 / 172663877 / -1.8% 0.77 / 0.75 / +3.0%
tpch_q21/duckdb:parquet 259692747 / 267985206 / -3.1% 285917404 / 292258709 / -2.2% 0.91 / 0.92 / -0.9%
tpch_q22/duckdb:parquet 262942340 / 261515391 / +0.5% 271882855 / 272960806 / -0.4% 0.97 / 0.96 / +0.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1252948 / 1259412 / -0.5% 21063280 / 20902963 / +0.8% 0.06 / 0.06 / -1.3%
clickbench_q01/datafusion:vortex-file-compressed 5916024 / 5796599 / +2.1% 34581238 / 33601099 / +2.9% 0.17 / 0.17 / -0.8%
clickbench_q02/datafusion:vortex-file-compressed 10994057 / 10186847 / +7.9% 38091861 / 39971592 / -4.7% 0.29 / 0.25 / +13.2%
clickbench_q03/datafusion:vortex-file-compressed 11954386 / 11972396 / -0.2% 55018133 / 54271999 / +1.4% 0.22 / 0.22 / -1.5%
clickbench_q04/datafusion:vortex-file-compressed 58262733 / 57735154 / +0.9% 92862664 / 91949476 / +1.0% 0.63 / 0.63 / -0.1%
clickbench_q05/datafusion:vortex-file-compressed 74141709 / 73445050 / +0.9% 119935563 / 117021840 / +2.5% 0.62 / 0.63 / -1.5%
clickbench_q06/datafusion:vortex-file-compressed 1217721 / 1227607 / -0.8% 20677475 / 20904245 / -1.1% 0.06 / 0.06 / +0.3%
clickbench_q07/datafusion:vortex-file-compressed 10155092 / 9812696 / +3.5% 34004182 / 35768511 / -4.9% 0.30 / 0.27 / +8.9%
clickbench_q08/datafusion:vortex-file-compressed 78796212 / 77538060 / +1.6% 119864456 / 118118920 / +1.5% 0.66 / 0.66 / +0.1%
clickbench_q09/datafusion:vortex-file-compressed 170561304 / 170521830 / +0.0% 205675805 / 205782996 / -0.1% 0.83 / 0.83 / +0.1%
clickbench_q10/datafusion:vortex-file-compressed 24500398 / 23974368 / +2.2% 70195034 / 68586534 / +2.3% 0.35 / 0.35 / -0.1%
clickbench_q11/datafusion:vortex-file-compressed 26507586 / 25790332 / +2.8% 71754373 / 71320210 / +0.6% 0.37 / 0.36 / +2.2%
clickbench_q12/datafusion:vortex-file-compressed 71287489 / 72310000 / -1.4% 115190784 / 116391877 / -1.0% 0.62 / 0.62 / -0.4%
clickbench_q13/datafusion:vortex-file-compressed 116529418 / 120267546 / -3.1% 181364330 / 179327175 / +1.1% 0.64 / 0.67 / -4.2%
clickbench_q14/datafusion:vortex-file-compressed 73935932 / 75292916 / -1.8% 119948016 / 119433346 / +0.4% 0.62 / 0.63 / -2.2%
clickbench_q15/datafusion:vortex-file-compressed 61685213 / 60905420 / +1.3% 96167538 / 96921319 / -0.8% 0.64 / 0.63 / +2.1%
clickbench_q16/datafusion:vortex-file-compressed 150436519 / 149935848 / +0.3% 205583542 / 205082447 / +0.2% 0.73 / 0.73 / +0.1%
clickbench_q17/datafusion:vortex-file-compressed 149242296 / 149501204 / -0.2% 210130002 / 212989891 / -1.3% 0.71 / 0.70 / +1.2%
clickbench_q18/datafusion:vortex-file-compressed 297585534 / 300333779 / -0.9% 380600931 / 378289418 / +0.6% 0.78 / 0.79 / -1.5%
clickbench_q19/datafusion:vortex-file-compressed 7724430 / 7696490 / +0.4% 48146950 / 48781301 / -1.3% 0.16 / 0.16 / +1.7%
clickbench_q20/datafusion:vortex-file-compressed 60275339 / 62359200 / -3.3% 234031490 / 232689716 / +0.6% 0.26 / 0.27 / -3.9%
clickbench_q21/datafusion:vortex-file-compressed 88857410 / 90330759 / -1.6% 270164121 / 271484896 / -0.5% 0.33 / 0.33 / -1.2%
clickbench_q22/datafusion:vortex-file-compressed 102241396 / 103052834 / -0.8% 346471682 / 351013741 / -1.3% 0.30 / 0.29 / +0.5%
clickbench_q23/datafusion:vortex-file-compressed 200639426 / 212067716 / -5.4% 530169744 / 517582071 / +2.4% 0.38 / 0.41 / -7.6%
clickbench_q24/datafusion:vortex-file-compressed 16447635 / 15903980 / +3.4% 64487668 / 64200297 / +0.4% 0.26 / 0.25 / +3.0%
clickbench_q25/datafusion:vortex-file-compressed 17710631 / 17727313 / -0.1% 56743171 / 69023459 / -17.8% 🟢 0.31 / 0.26 / +21.5%
clickbench_q26/datafusion:vortex-file-compressed 16720546 / 17124152 / -2.4% 67264274 / 70225543 / -4.2% 0.25 / 0.24 / +1.9%
clickbench_q27/datafusion:vortex-file-compressed 97492719 / 98191410 / -0.7% 241718793 / 241862124 / -0.1% 0.40 / 0.41 / -0.7%
clickbench_q28/datafusion:vortex-file-compressed 559332028 / 568143071 / -1.6% 624048120 / 614847948 / +1.5% 0.90 / 0.92 / -3.0%
clickbench_q29/datafusion:vortex-file-compressed 23011007 / 23442246 / -1.8% 50641509 / 51975193 / -2.6% 0.45 / 0.45 / +0.7%
clickbench_q30/datafusion:vortex-file-compressed 60511291 / 60629960 / -0.2% 108549450 / 110018866 / -1.3% 0.56 / 0.55 / +1.2%
clickbench_q31/datafusion:vortex-file-compressed 70493195 / 71093866 / -0.8% 154597590 / 156448612 / -1.2% 0.46 / 0.45 / +0.3%
clickbench_q32/datafusion:vortex-file-compressed 312357379 / 303711526 / +2.8% 380754079 / 385852974 / -1.3% 0.82 / 0.79 / +4.2%
clickbench_q33/datafusion:vortex-file-compressed 325485150 / 332081184 / -2.0% 421315515 / 436872592 / -3.6% 0.77 / 0.76 / +1.6%
clickbench_q34/datafusion:vortex-file-compressed 333467882 / 329659451 / +1.2% 422163513 / 435226003 / -3.0% 0.79 / 0.76 / +4.3%
clickbench_q35/datafusion:vortex-file-compressed 56916204 / 54946870 / +3.6% 91118790 / 87698656 / +3.9% 0.62 / 0.63 / -0.3%
clickbench_q36/datafusion:vortex-file-compressed 37059700 / 37484181 / -1.1% 65300730 / 66056666 / -1.1% 0.57 / 0.57 / +0.0%
clickbench_q37/datafusion:vortex-file-compressed 21696192 / 21702716 / -0.0% 48897786 / 48630030 / +0.6% 0.44 / 0.45 / -0.6%
clickbench_q38/datafusion:vortex-file-compressed 11596579 / 11476194 / +1.0% 40361247 / 40213816 / +0.4% 0.29 / 0.29 / +0.7%
clickbench_q39/datafusion:vortex-file-compressed 77899965 / 78050636 / -0.2% 111836598 / 110624268 / +1.1% 0.70 / 0.71 / -1.3%
clickbench_q40/datafusion:vortex-file-compressed 11236448 / 11517324 / -2.4% 37529883 / 38472774 / -2.5% 0.30 / 0.30 / +0.0%
clickbench_q41/datafusion:vortex-file-compressed 10924410 / 10584548 / +3.2% 36065428 / 36702151 / -1.7% 0.30 / 0.29 / +5.0%
clickbench_q42/datafusion:vortex-file-compressed 11162690 / 11068714 / +0.8% 36234387 / 36929641 / -1.9% 0.31 / 0.30 / +2.8%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1265036 / 1245210 / +1.6% 49767827 / 49589636 / +0.4% 0.03 / 0.03 / +1.2%
clickbench_q01/datafusion:parquet 16201224 / 15865004 / +2.1% 74351407 / 66811376 / +11.3% 🔴 0.22 / 0.24 / -8.2%
clickbench_q02/datafusion:parquet 19075258 / 18982826 / +0.5% 82713769 / 83087524 / -0.4% 0.23 / 0.23 / +0.9%
clickbench_q03/datafusion:parquet 18140859 / 17497046 / +3.7% 82713843 / 82178944 / +0.7% 0.22 / 0.21 / +3.0%
clickbench_q04/datafusion:parquet 64547642 / 63822020 / +1.1% 130263483 / 126639487 / +2.9% 0.50 / 0.50 / -1.7%
clickbench_q05/datafusion:parquet 89764324 / 89288098 / +0.5% 162470675 / 156199969 / +4.0% 0.55 / 0.57 / -3.3%
clickbench_q06/datafusion:parquet 1284058 / 1260456 / +1.9% 49660436 / 48902808 / +1.5% 0.03 / 0.03 / +0.3%
clickbench_q07/datafusion:parquet 16932554 / 16746474 / +1.1% 69924209 / 68204506 / +2.5% 0.24 / 0.25 / -1.4%
clickbench_q08/datafusion:parquet 85242532 / 87161701 / -2.2% 165300991 / 161841358 / +2.1% 0.52 / 0.54 / -4.2%
clickbench_q09/datafusion:parquet 195236206 / 186950513 / +4.4% 278928877 / 268833958 / +3.8% 0.70 / 0.70 / +0.7%
clickbench_q10/datafusion:parquet 36311937 / 35855639 / +1.3% 103433048 / 102050375 / +1.4% 0.35 / 0.35 / -0.1%
clickbench_q11/datafusion:parquet 42576886 / 43166601 / -1.4% 112179726 / 111602582 / +0.5% 0.38 / 0.39 / -1.9%
clickbench_q12/datafusion:parquet 95731178 / 94405561 / +1.4% 165383038 / 160873924 / +2.8% 0.58 / 0.59 / -1.4%
clickbench_q13/datafusion:parquet 149325292 / 149501538 / -0.1% 233573774 / 230085697 / +1.5% 0.64 / 0.65 / -1.6%
clickbench_q14/datafusion:parquet 102343262 / 102786675 / -0.4% 176782746 / 175224456 / +0.9% 0.58 / 0.59 / -1.3%
clickbench_q15/datafusion:parquet 69522766 / 71049026 / -2.1% 136153385 / 131878932 / +3.2% 0.51 / 0.54 / -5.2%
clickbench_q16/datafusion:parquet 157531586 / 157031320 / +0.3% 239085157 / 235690391 / +1.4% 0.66 / 0.67 / -1.1%
clickbench_q17/datafusion:parquet 155573486 / 156487397 / -0.6% 240367026 / 240726356 / -0.1% 0.65 / 0.65 / -0.4%
clickbench_q18/datafusion:parquet 325832888 / 318239530 / +2.4% 426300315 / 420492970 / +1.4% 0.76 / 0.76 / +1.0%
clickbench_q19/datafusion:parquet 19136658 / 18919904 / +1.1% 77605131 / 77671436 / -0.1% 0.25 / 0.24 / +1.2%
clickbench_q20/datafusion:parquet 180181826 / 177880786 / +1.3% 301302837 / 284615535 / +5.9% 0.60 / 0.62 / -4.3%
clickbench_q21/datafusion:parquet 175444104 / 176868948 / -0.8% 318860108 / 304422095 / +4.7% 0.55 / 0.58 / -5.3%
clickbench_q22/datafusion:parquet 261040500 / 262449315 / -0.5% 456586823 / 428523960 / +6.5% 0.57 / 0.61 / -6.7%
clickbench_q23/datafusion:parquet 1156991368 / 1155832794 / +0.1% 1231518513 / 1246756004 / -1.2% 0.94 / 0.93 / +1.3%
clickbench_q24/datafusion:parquet 30439755 / 30125885 / +1.0% 91310289 / 89239830 / +2.3% 0.33 / 0.34 / -1.2%
clickbench_q25/datafusion:parquet 36803797 / 37219798 / -1.1% 105167804 / 100873168 / +4.3% 0.35 / 0.37 / -5.2%
clickbench_q26/datafusion:parquet 30644306 / 31030532 / -1.2% 92923780 / 91844519 / +1.2% 0.33 / 0.34 / -2.4%
clickbench_q27/datafusion:parquet 193760004 / 196925526 / -1.6% 303679479 / 294102955 / +3.3% 0.64 / 0.67 / -4.7%
clickbench_q28/datafusion:parquet 628427336 / 623038816 / +0.9% 710407525 / 704893237 / +0.8% 0.88 / 0.88 / +0.1%
clickbench_q29/datafusion:parquet 30261908 / 29054292 / +4.2% 94337704 / 91332736 / +3.3% 0.32 / 0.32 / +0.8%
clickbench_q30/datafusion:parquet 91313554 / 90920200 / +0.4% 179759281 / 173200306 / +3.8% 0.51 / 0.52 / -3.2%
clickbench_q31/datafusion:parquet 104730847 / 104130686 / +0.6% 208134409 / 200448601 / +3.8% 0.50 / 0.52 / -3.1%
clickbench_q32/datafusion:parquet 323786049 / 328615886 / -1.5% 430235766 / 426385511 / +0.9% 0.75 / 0.77 / -2.4%
clickbench_q33/datafusion:parquet 385047652 / 382869292 / +0.6% 486844787 / 475659778 / +2.4% 0.79 / 0.80 / -1.7%
clickbench_q34/datafusion:parquet 384906728 / 383238618 / +0.4% 479007070 / 481040180 / -0.4% 0.80 / 0.80 / +0.9%
clickbench_q35/datafusion:parquet 66049532 / 65015737 / +1.6% 125918084 / 126875467 / -0.8% 0.52 / 0.51 / +2.4%
clickbench_q36/datafusion:parquet 73359606 / 73763908 / -0.5% 138724188 / 135639895 / +2.3% 0.53 / 0.54 / -2.8%
clickbench_q37/datafusion:parquet 35267698 / 35607451 / -1.0% 90972818 / 92839422 / -2.0% 0.39 / 0.38 / +1.1%
clickbench_q38/datafusion:parquet 47434143 / 47845106 / -0.9% 108438500 / 110053303 / -1.5% 0.44 / 0.43 / +0.6%
clickbench_q39/datafusion:parquet 143482026 / 143431000 / +0.0% 211384971 / 212176263 / -0.4% 0.68 / 0.68 / +0.4%
clickbench_q40/datafusion:parquet 20055904 / 19999317 / +0.3% 78057958 / 77704155 / +0.5% 0.26 / 0.26 / -0.2%
clickbench_q41/datafusion:parquet 18732104 / 18722480 / +0.1% 75793849 / 76216913 / -0.6% 0.25 / 0.25 / +0.6%
clickbench_q42/datafusion:parquet 19194052 / 18789574 / +2.2% 74863916 / 76300219 / -1.9% 0.26 / 0.25 / +4.1%
duckdb / vortex-file-compressed / ns (0.992x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1598066 / 1577550 / +1.3% 24452402 / 27551500 / -11.2% 🟢 0.07 / 0.06 / +14.1%
clickbench_q01/duckdb:vortex-file-compressed 11462328 / 13304288 / -13.8% 🟢 27553222 / 31984630 / -13.9% 🟢 0.42 / 0.42 / +0.0%
clickbench_q02/duckdb:vortex-file-compressed 14511905 / 15856572 / -8.5% 35547311 / 35134401 / +1.2% 0.41 / 0.45 / -9.5%
clickbench_q03/duckdb:vortex-file-compressed 18406787 / 17132146 / +7.4% 53440111 / 51098288 / +4.6% 0.34 / 0.34 / +2.7%
clickbench_q04/duckdb:vortex-file-compressed 71097122 / 72959522 / -2.6% 106408650 / 107734859 / -1.2% 0.67 / 0.68 / -1.3%
clickbench_q05/duckdb:vortex-file-compressed 67924016 / 68785386 / -1.3% 96207604 / 97348089 / -1.2% 0.71 / 0.71 / -0.1%
clickbench_q06/duckdb:vortex-file-compressed 1780980 / 1850146 / -3.7% 30816936 / 32813684 / -6.1% 0.06 / 0.06 / +2.5%
clickbench_q07/duckdb:vortex-file-compressed 13735866 / 13866520 / -0.9% 35467882 / 30472861 / +16.4% 🔴 0.39 / 0.46 / -14.9%
clickbench_q08/duckdb:vortex-file-compressed 84224816 / 82756809 / +1.8% 133110953 / 128305444 / +3.7% 0.63 / 0.64 / -1.9%
clickbench_q09/duckdb:vortex-file-compressed 107259104 / 108378800 / -1.0% 151272794 / 157681323 / -4.1% 0.71 / 0.69 / +3.2%
clickbench_q10/duckdb:vortex-file-compressed 34610919 / 32238254 / +7.4% 72113393 / 71251056 / +1.2% 0.48 / 0.45 / +6.1%
clickbench_q11/duckdb:vortex-file-compressed 35701712 / 35786522 / -0.2% 75938207 / 75270334 / +0.9% 0.47 / 0.48 / -1.1%
clickbench_q12/duckdb:vortex-file-compressed 73750906 / 73967439 / -0.3% 105838950 / 104977507 / +0.8% 0.70 / 0.70 / -1.1%
clickbench_q13/duckdb:vortex-file-compressed 137423308 / 138502590 / -0.8% 184195355 / 179803595 / +2.4% 0.75 / 0.77 / -3.1%
clickbench_q14/duckdb:vortex-file-compressed 77124217 / 80266613 / -3.9% 107686999 / 117008745 / -8.0% 0.72 / 0.69 / +4.4%
clickbench_q15/duckdb:vortex-file-compressed 91393394 / 96970030 / -5.8% 137442147 / 136493228 / +0.7% 0.66 / 0.71 / -6.4%
clickbench_q16/duckdb:vortex-file-compressed 159738205 / 159119636 / +0.4% 222843624 / 218235332 / +2.1% 0.72 / 0.73 / -1.7%
clickbench_q17/duckdb:vortex-file-compressed 163945783 / 165800316 / -1.1% 230339663 / 215744431 / +6.8% 0.71 / 0.77 / -7.4%
clickbench_q18/duckdb:vortex-file-compressed 321933334 / 313628982 / +2.6% 378123726 / 375511102 / +0.7% 0.85 / 0.84 / +1.9%
clickbench_q19/duckdb:vortex-file-compressed 15967254 / 17210966 / -7.2% 42872488 / 41143400 / +4.2% 0.37 / 0.42 / -11.0%
clickbench_q20/duckdb:vortex-file-compressed 110899252 / 111999070 / -1.0% 200311394 / 212558974 / -5.8% 0.55 / 0.53 / +5.1%
clickbench_q21/duckdb:vortex-file-compressed 157468856 / 158456086 / -0.6% 305495134 / 309758582 / -1.4% 0.52 / 0.51 / +0.8%
clickbench_q22/duckdb:vortex-file-compressed 237024744 / 237092974 / -0.0% 473872954 / 466160972 / +1.7% 0.50 / 0.51 / -1.7%
clickbench_q23/duckdb:vortex-file-compressed 57589028 / 59014144 / -2.4% 116926501 / 100809067 / +16.0% 🔴 0.49 / 0.59 / -15.9%
clickbench_q24/duckdb:vortex-file-compressed 26409490 / 26212608 / +0.8% 44665298 / 42720942 / +4.6% 0.59 / 0.61 / -3.6%
clickbench_q25/duckdb:vortex-file-compressed 30960454 / 33400204 / -7.3% 58411410 / 55134158 / +5.9% 0.53 / 0.61 / -12.5%
clickbench_q26/duckdb:vortex-file-compressed 18796896 / 20056507 / -6.3% 40066362 / 36048253 / +11.1% 🔴 0.47 / 0.56 / -15.7%
clickbench_q27/duckdb:vortex-file-compressed 144285328 / 148909132 / -3.1% 256515465 / 262118173 / -2.1% 0.56 / 0.57 / -1.0%
clickbench_q28/duckdb:vortex-file-compressed 811651998 / 592853492 / +36.9% 🔴 683157156 / 693085940 / -1.4% 1.19 / 0.86 / +38.9%
clickbench_q29/duckdb:vortex-file-compressed 16653826 / 17156830 / -2.9% 41941534 / 38524814 / +8.9% 0.40 / 0.45 / -10.8%
clickbench_q30/duckdb:vortex-file-compressed 68127123 / 65652206 / +3.8% 114405497 / 115431307 / -0.9% 0.60 / 0.57 / +4.7%
clickbench_q31/duckdb:vortex-file-compressed 123928210 / 125733350 / -1.4% 207518601 / 216750670 / -4.3% 0.60 / 0.58 / +2.9%
clickbench_q32/duckdb:vortex-file-compressed 442363222 / 456145708 / -3.0% 472292723 / 550446670 / -14.2% 🟢 0.94 / 0.83 / +13.0%
clickbench_q33/duckdb:vortex-file-compressed 393473926 / 386334684 / +1.8% 499028310 / 505482267 / -1.3% 0.79 / 0.76 / +3.2%
clickbench_q34/duckdb:vortex-file-compressed 407891632 / 402241422 / +1.4% 553995686 / 531008512 / +4.3% 0.74 / 0.76 / -2.8%
clickbench_q35/duckdb:vortex-file-compressed 102537028 / 101709234 / +0.8% 139536483 / 138989485 / +0.4% 0.73 / 0.73 / +0.4%
clickbench_q36/duckdb:vortex-file-compressed 16150524 / 16110108 / +0.3% 31664381 / 33110663 / -4.4% 0.51 / 0.49 / +4.8%
clickbench_q37/duckdb:vortex-file-compressed 12168081 / 11992340 / +1.5% 30704487 / 26026325 / +18.0% 🔴 0.40 / 0.46 / -14.0%
clickbench_q38/duckdb:vortex-file-compressed 12844961 / 13306110 / -3.5% 31881575 / 29686830 / +7.4% 0.40 / 0.45 / -10.1%
clickbench_q39/duckdb:vortex-file-compressed 23368190 / 22389516 / +4.4% 39450135 / 40846051 / -3.4% 0.59 / 0.55 / +8.1%
clickbench_q40/duckdb:vortex-file-compressed 11452464 / 11432802 / +0.2% 27323116 / 28368319 / -3.7% 0.42 / 0.40 / +4.0%
clickbench_q41/duckdb:vortex-file-compressed 10922318 / 11668004 / -6.4% 27508731 / 27562711 / -0.2% 0.40 / 0.42 / -6.2%
clickbench_q42/duckdb:vortex-file-compressed 10937606 / 11827196 / -7.5% 29135704 / 26805489 / +8.7% 0.38 / 0.44 / -14.9%
duckdb / parquet / ns (1.001x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9166184 / 7589722 / +20.8% 🔴 18402769 / 21341861 / -13.8% 🟢 0.50 / 0.36 / +40.1%
clickbench_q01/duckdb:parquet 10463997 / 10801650 / -3.1% 19860117 / 20758142 / -4.3% 0.53 / 0.52 / +1.3%
clickbench_q02/duckdb:parquet 15970682 / 15613778 / +2.3% 34631327 / 31995924 / +8.2% 0.46 / 0.49 / -5.5%
clickbench_q03/duckdb:parquet 16129213 / 15814087 / +2.0% 52145194 / 55537578 / -6.1% 0.31 / 0.28 / +8.6%
clickbench_q04/duckdb:parquet 70863440 / 73044332 / -3.0% 99371700 / 93233523 / +6.6% 0.71 / 0.78 / -9.0%
clickbench_q05/duckdb:parquet 80516031 / 81466271 / -1.2% 119745815 / 121479419 / -1.4% 0.67 / 0.67 / +0.3%
clickbench_q06/duckdb:parquet 15277256 / 14287713 / +6.9% 25802239 / 22389061 / +15.2% 🔴 0.59 / 0.64 / -7.2%
clickbench_q07/duckdb:parquet 12882878 / 10611222 / +21.4% 🔴 22248967 / 21313624 / +4.4% 0.58 / 0.50 / +16.3%
clickbench_q08/duckdb:parquet 86796942 / 92933601 / -6.6% 125777853 / 127412681 / -1.3% 0.69 / 0.73 / -5.4%
clickbench_q09/duckdb:parquet 115535874 / 114605702 / +0.8% 161923077 / 160163389 / +1.1% 0.71 / 0.72 / -0.3%
clickbench_q10/duckdb:parquet 33162410 / 33321890 / -0.5% 73793908 / 69994456 / +5.4% 0.45 / 0.48 / -5.6%
clickbench_q11/duckdb:parquet 36066938 / 35580862 / +1.4% 76467920 / 77589047 / -1.4% 0.47 / 0.46 / +2.9%
clickbench_q12/duckdb:parquet 90081343 / 91491566 / -1.5% 127772404 / 134434827 / -5.0% 0.71 / 0.68 / +3.6%
clickbench_q13/duckdb:parquet 145889105 / 147619237 / -1.2% 223184205 / 217458094 / +2.6% 0.65 / 0.68 / -3.7%
clickbench_q14/duckdb:parquet 95589250 / 104458143 / -8.5% 156436679 / 140673921 / +11.2% 🔴 0.61 / 0.74 / -17.7%
clickbench_q15/duckdb:parquet 94046119 / 92947950 / +1.2% 124206824 / 130061894 / -4.5% 0.76 / 0.71 / +6.0%
clickbench_q16/duckdb:parquet 172001902 / 174479954 / -1.4% 256520609 / 248895118 / +3.1% 0.67 / 0.70 / -4.4%
clickbench_q17/duckdb:parquet 176695161 / 175638098 / +0.6% 232795661 / 234362333 / -0.7% 0.76 / 0.75 / +1.3%
clickbench_q18/duckdb:parquet 328259556 / 320674026 / +2.4% 407611513 / 409728975 / -0.5% 0.81 / 0.78 / +2.9%
clickbench_q19/duckdb:parquet 13096899 / 13354285 / -1.9% 40964506 / 41870580 / -2.2% 0.32 / 0.32 / +0.2%
clickbench_q20/duckdb:parquet 133448638 / 152105272 / -12.3% 🟢 241570337 / 245491184 / -1.6% 0.55 / 0.62 / -10.8%
clickbench_q21/duckdb:parquet 180200751 / 182767014 / -1.4% 321985894 / 321934889 / +0.0% 0.56 / 0.57 / -1.4%
clickbench_q22/duckdb:parquet 238331070 / 238255803 / +0.0% 413617334 / 419046119 / -1.3% 0.58 / 0.57 / +1.3%
clickbench_q23/duckdb:parquet 147076910 / 144110686 / +2.1% 167826191 / 171305746 / -2.0% 0.88 / 0.84 / +4.2%
clickbench_q24/duckdb:parquet 42979528 / 42864200 / +0.3% 62492469 / 62536195 / -0.1% 0.69 / 0.69 / +0.3%
clickbench_q25/duckdb:parquet 39612498 / 41362607 / -4.2% 91079514 / 94755093 / -3.9% 0.43 / 0.44 / -0.4%
clickbench_q26/duckdb:parquet 28902904 / 31012598 / -6.8% 46178776 / 46451172 / -0.6% 0.63 / 0.67 / -6.3%
clickbench_q27/duckdb:parquet 143734638 / 146998492 / -2.2% 262827119 / 255981082 / +2.7% 0.55 / 0.57 / -4.8%
clickbench_q28/duckdb:parquet 904617610 / 898786408 / +0.6% 1012154497 / 1016416752 / -0.4% 0.89 / 0.88 / +1.1%
clickbench_q29/duckdb:parquet 17409864 / 16867184 / +3.2% 33506259 / 30704707 / +9.1% 0.52 / 0.55 / -5.4%
clickbench_q30/duckdb:parquet 91058626 / 90379465 / +0.8% 177778609 / 171706529 / +3.5% 0.51 / 0.53 / -2.7%
clickbench_q31/duckdb:parquet 143263602 / 144265108 / -0.7% 266023720 / 292043975 / -8.9% 0.54 / 0.49 / +9.0%
clickbench_q32/duckdb:parquet 460004824 / 452733449 / +1.6% 507154450 / 501912685 / +1.0% 0.91 / 0.90 / +0.6%
clickbench_q33/duckdb:parquet 453964064 / 444266680 / +2.2% 487573959 / 474344959 / +2.8% 0.93 / 0.94 / -0.6%
clickbench_q34/duckdb:parquet 461034216 / 456982927 / +0.9% 558262577 / 506288553 / +10.3% 🔴 0.83 / 0.90 / -8.5%
clickbench_q35/duckdb:parquet 105228371 / 99167984 / +6.1% 125693860 / 128379859 / -2.1% 0.84 / 0.77 / +8.4%
clickbench_q36/duckdb:parquet 31056228 / 31066900 / -0.0% 40565878 / 42055347 / -3.5% 0.77 / 0.74 / +3.6%
clickbench_q37/duckdb:parquet 22706438 / 23100533 / -1.7% 32717723 / 31452930 / +4.0% 0.69 / 0.73 / -5.5%
clickbench_q38/duckdb:parquet 23796514 / 23866771 / -0.3% 32617620 / 34167063 / -4.5% 0.73 / 0.70 / +4.4%
clickbench_q39/duckdb:parquet 56964310 / 56842065 / +0.2% 65375580 / 67304762 / -2.9% 0.87 / 0.84 / +3.2%
clickbench_q40/duckdb:parquet 12389996 / 12729432 / -2.7% 23077131 / 22867313 / +0.9% 0.54 / 0.56 / -3.6%
clickbench_q41/duckdb:parquet 11700320 / 12843368 / -8.9% 22257149 / 22299015 / -0.2% 0.53 / 0.58 / -8.7%
clickbench_q42/duckdb:parquet 15081468 / 14375474 / +4.9% 23588637 / 24815036 / -4.9% 0.64 / 0.58 / +10.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.8%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.948x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.983x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24220626 / 23892296 / +1.4% 40687489 / 45423709 / -10.4% 🟢 0.60 / 0.53 / +13.2%
tpcds_q02/datafusion:vortex-file-compressed 45235174 / 45402844 / -0.4% 61507161 / 63195094 / -2.7% 0.74 / 0.72 / +2.4%
tpcds_q03/datafusion:vortex-file-compressed 11843757 / 11732577 / +0.9% 26879062 / 28612944 / -6.1% 0.44 / 0.41 / +7.5%
tpcds_q04/datafusion:vortex-file-compressed 111171046 / 112493390 / -1.2% 143252040 / 144843311 / -1.1% 0.78 / 0.78 / -0.1%
tpcds_q05/datafusion:vortex-file-compressed 60291644 / 59941380 / +0.6% 80910855 / 83606513 / -3.2% 0.75 / 0.72 / +3.9%
tpcds_q06/datafusion:vortex-file-compressed 23739710 / 23931955 / -0.8% 44446947 / 46882563 / -5.2% 0.53 / 0.51 / +4.6%
tpcds_q07/datafusion:vortex-file-compressed 32584436 / 32808576 / -0.7% 55290437 / 57766026 / -4.3% 0.59 / 0.57 / +3.8%
tpcds_q08/datafusion:vortex-file-compressed 25428293 / 25378666 / +0.2% 42057854 / 44446958 / -5.4% 0.60 / 0.57 / +5.9%
tpcds_q09/datafusion:vortex-file-compressed 17051258 / 17110981 / -0.3% 33480207 / 35576077 / -5.9% 0.51 / 0.48 / +5.9%
tpcds_q10/datafusion:vortex-file-compressed 29118405 / 28873230 / +0.8% 47758004 / 50581001 / -5.6% 0.61 / 0.57 / +6.8%
tpcds_q11/datafusion:vortex-file-compressed 62498370 / 63160118 / -1.0% 87011792 / 90248836 / -3.6% 0.72 / 0.70 / +2.6%
tpcds_q12/datafusion:vortex-file-compressed 16444174 / 16340422 / +0.6% 31499019 / 34229517 / -8.0% 0.52 / 0.48 / +9.4%
tpcds_q13/datafusion:vortex-file-compressed 33719216 / 34577278 / -2.5% 52325335 / 56088741 / -6.7% 0.64 / 0.62 / +4.5%
tpcds_q14/datafusion:vortex-file-compressed 91210862 / 91497914 / -0.3% 118441547 / 122808578 / -3.6% 0.77 / 0.75 / +3.4%
tpcds_q15/datafusion:vortex-file-compressed 23815783 / 23949392 / -0.6% 42225244 / 43963259 / -4.0% 0.56 / 0.54 / +3.5%
tpcds_q16/datafusion:vortex-file-compressed 20204902 / 20670874 / -2.3% 39634459 / 42407225 / -6.5% 0.51 / 0.49 / +4.6%
tpcds_q17/datafusion:vortex-file-compressed 57616731 / 58880654 / -2.1% 83114205 / 86448982 / -3.9% 0.69 / 0.68 / +1.8%
tpcds_q18/datafusion:vortex-file-compressed 68698600 / 68607364 / +0.1% 90423736 / 94138138 / -3.9% 0.76 / 0.73 / +4.2%
tpcds_q19/datafusion:vortex-file-compressed 18324930 / 18521228 / -1.1% 39406076 / 41461032 / -5.0% 0.47 / 0.45 / +4.1%
tpcds_q20/datafusion:vortex-file-compressed 17681955 / 18043166 / -2.0% 34552564 / 36865562 / -6.3% 0.51 / 0.49 / +4.6%
tpcds_q21/datafusion:vortex-file-compressed 16798420 / 16912856 / -0.7% 37036441 / 41644153 / -11.1% 🟢 0.45 / 0.41 / +11.7%
tpcds_q22/datafusion:vortex-file-compressed 49726316 / 49688404 / +0.1% 67945321 / 72646155 / -6.5% 0.73 / 0.68 / +7.0%
tpcds_q23/datafusion:vortex-file-compressed 73376472 / 73886368 / -0.7% 101903959 / 103579991 / -1.6% 0.72 / 0.71 / +0.9%
tpcds_q24/datafusion:vortex-file-compressed 70104882 / 70544491 / -0.6% 94658630 / 96919640 / -2.3% 0.74 / 0.73 / +1.8%
tpcds_q25/datafusion:vortex-file-compressed 55644851 / 52755074 / +5.5% 84136766 / 85529224 / -1.6% 0.66 / 0.62 / +7.2%
tpcds_q26/datafusion:vortex-file-compressed 30477980 / 30096072 / +1.3% 49475770 / 54242212 / -8.8% 0.62 / 0.55 / +11.0%
tpcds_q27/datafusion:vortex-file-compressed 63510266 / 61226474 / +3.7% 89073660 / 96740547 / -7.9% 0.71 / 0.63 / +12.7%
tpcds_q28/datafusion:vortex-file-compressed 17974196 / 17900982 / +0.4% 36802289 / 39396126 / -6.6% 0.49 / 0.45 / +7.5%
tpcds_q29/datafusion:vortex-file-compressed 60768791 / 62188692 / -2.3% 84745127 / 83887060 / +1.0% 0.72 / 0.74 / -3.3%
tpcds_q30/datafusion:vortex-file-compressed 27925921 / 27721957 / +0.7% 43392206 / 44456897 / -2.4% 0.64 / 0.62 / +3.2%
tpcds_q31/datafusion:vortex-file-compressed 64372908 / 64689091 / -0.5% 88687246 / 93643926 / -5.3% 0.73 / 0.69 / +5.1%
tpcds_q32/datafusion:vortex-file-compressed 13925732 / 13530142 / +2.9% 30677836 / 31145479 / -1.5% 0.45 / 0.43 / +4.5%
tpcds_q33/datafusion:vortex-file-compressed 27248083 / 26940202 / +1.1% 46951602 / 49975437 / -6.1% 0.58 / 0.54 / +7.7%
tpcds_q34/datafusion:vortex-file-compressed 18416323 / 18321452 / +0.5% 35224843 / 38520294 / -8.6% 0.52 / 0.48 / +9.9%
tpcds_q35/datafusion:vortex-file-compressed 35662355 / 36557186 / -2.4% 54099536 / 60127212 / -10.0% 🟢 0.66 / 0.61 / +8.4%
tpcds_q36/datafusion:vortex-file-compressed 50018284 / 48436770 / +3.3% 71962655 / 73264529 / -1.8% 0.70 / 0.66 / +5.1%
tpcds_q37/datafusion:vortex-file-compressed 13161951 / 13695902 / -3.9% 32775616 / 35290255 / -7.1% 0.40 / 0.39 / +3.5%
tpcds_q38/datafusion:vortex-file-compressed 29469966 / 29448094 / +0.1% 52008297 / 53995678 / -3.7% 0.57 / 0.55 / +3.9%
tpcds_q39/datafusion:vortex-file-compressed 66120330 / 64340166 / +2.8% 90337656 / 89682673 / +0.7% 0.73 / 0.72 / +2.0%
tpcds_q40/datafusion:vortex-file-compressed 24956636 / 25104059 / -0.6% 44246298 / 46583148 / -5.0% 0.56 / 0.54 / +4.7%
tpcds_q41/datafusion:vortex-file-compressed 16638136 / 16488682 / +0.9% 30343371 / 31135385 / -2.5% 0.55 / 0.53 / +3.5%
tpcds_q42/datafusion:vortex-file-compressed 11108662 / 11251518 / -1.3% 27284430 / 27646345 / -1.3% 0.41 / 0.41 / +0.0%
tpcds_q43/datafusion:vortex-file-compressed 13245975 / 13106395 / +1.1% 30809896 / 32470739 / -5.1% 0.43 / 0.40 / +6.5%
tpcds_q44/datafusion:vortex-file-compressed 26289700 / 25917452 / +1.4% 48927294 / 51681695 / -5.3% 0.54 / 0.50 / +7.1%
tpcds_q45/datafusion:vortex-file-compressed 27748897 / 27518500 / +0.8% 46792516 / 47886303 / -2.3% 0.59 / 0.57 / +3.2%
tpcds_q46/datafusion:vortex-file-compressed 24312320 / 24502624 / -0.8% 44797829 / 48454052 / -7.5% 0.54 / 0.51 / +7.3%
tpcds_q47/datafusion:vortex-file-compressed 78087664 / 77541464 / +0.7% 104374813 / 107539437 / -2.9% 0.75 / 0.72 / +3.8%
tpcds_q48/datafusion:vortex-file-compressed 31141931 / 31105792 / +0.1% 49899628 / 50911118 / -2.0% 0.62 / 0.61 / +2.1%
tpcds_q49/datafusion:vortex-file-compressed 59883354 / 60400492 / -0.9% 81219741 / 92094029 / -11.8% 🟢 0.74 / 0.66 / +12.4%
tpcds_q50/datafusion:vortex-file-compressed 35495015 / 34918366 / +1.7% 51862777 / 56865890 / -8.8% 0.68 / 0.61 / +11.5%
tpcds_q51/datafusion:vortex-file-compressed 60827643 / 61313526 / -0.8% 82319821 / 84248840 / -2.3% 0.74 / 0.73 / +1.5%
tpcds_q52/datafusion:vortex-file-compressed 11629373 / 11655322 / -0.2% 26988571 / 30220613 / -10.7% 🟢 0.43 / 0.39 / +11.7%
tpcds_q53/datafusion:vortex-file-compressed 18313347 / 18294400 / +0.1% 37188015 / 39018207 / -4.7% 0.49 / 0.47 / +5.0%
tpcds_q54/datafusion:vortex-file-compressed 34194629 / 33754888 / +1.3% 55928061 / 62396032 / -10.4% 🟢 0.61 / 0.54 / +13.0%
tpcds_q55/datafusion:vortex-file-compressed 11216166 / 11215516 / +0.0% 25610418 / 29255255 / -12.5% 🟢 0.44 / 0.38 / +14.2%
tpcds_q56/datafusion:vortex-file-compressed 26615320 / 27049404 / -1.6% 46278546 / 49273022 / -6.1% 0.58 / 0.55 / +4.8%
tpcds_q57/datafusion:vortex-file-compressed 73075588 / 73626796 / -0.7% 96871306 / 97394356 / -0.5% 0.75 / 0.76 / -0.2%
tpcds_q58/datafusion:vortex-file-compressed 40493705 / 40781018 / -0.7% 64415102 / 68567149 / -6.1% 0.63 / 0.59 / +5.7%
tpcds_q59/datafusion:vortex-file-compressed 32084500 / 31946548 / +0.4% 51535126 / 53705234 / -4.0% 0.62 / 0.59 / +4.7%
tpcds_q60/datafusion:vortex-file-compressed 26565442 / 27318949 / -2.8% 46558452 / 49585766 / -6.1% 0.57 / 0.55 / +3.6%
tpcds_q61/datafusion:vortex-file-compressed 24336765 / 24113983 / +0.9% 47069355 / 47708362 / -1.3% 0.52 / 0.51 / +2.3%
tpcds_q62/datafusion:vortex-file-compressed 17341799 / 17131666 / +1.2% 33927429 / 36463578 / -7.0% 0.51 / 0.47 / +8.8%
tpcds_q63/datafusion:vortex-file-compressed 18572252 / 18462694 / +0.6% 36142921 / 39102991 / -7.6% 0.51 / 0.47 / +8.8%
tpcds_q64/datafusion:vortex-file-compressed 319387283 / 323668236 / -1.3% 358724492 / 367765543 / -2.5% 0.89 / 0.88 / +1.2%
tpcds_q65/datafusion:vortex-file-compressed 75527795 / 76249782 / -0.9% 93927104 / 96464205 / -2.6% 0.80 / 0.79 / +1.7%
tpcds_q66/datafusion:vortex-file-compressed 53122135 / 53219172 / -0.2% 73923305 / 76328855 / -3.2% 0.72 / 0.70 / +3.1%
tpcds_q67/datafusion:vortex-file-compressed 55436314 / 56053984 / -1.1% 81809504 / 85792534 / -4.6% 0.68 / 0.65 / +3.7%
tpcds_q68/datafusion:vortex-file-compressed 24600196 / 23797902 / +3.4% 46267223 / 48564344 / -4.7% 0.53 / 0.49 / +8.5%
tpcds_q69/datafusion:vortex-file-compressed 28435301 / 27837504 / +2.1% 46890481 / 49568272 / -5.4% 0.61 / 0.56 / +8.0%
tpcds_q70/datafusion:vortex-file-compressed 70768002 / 71473267 / -1.0% 90210790 / 94682422 / -4.7% 0.78 / 0.75 / +3.9%
tpcds_q71/datafusion:vortex-file-compressed 18583934 / 19067419 / -2.5% 37882459 / 40513144 / -6.5% 0.49 / 0.47 / +4.2%
tpcds_q72/datafusion:vortex-file-compressed 475251608 / 466715965 / +1.8% 505602765 / 491414300 / +2.9% 0.94 / 0.95 / -1.0%
tpcds_q73/datafusion:vortex-file-compressed 16735850 / 17367276 / -3.6% 36272605 / 38982603 / -7.0% 0.46 / 0.45 / +3.6%
tpcds_q74/datafusion:vortex-file-compressed 44546232 / 45543596 / -2.2% 71570866 / 71537235 / +0.0% 0.62 / 0.64 / -2.2%
tpcds_q75/datafusion:vortex-file-compressed 137970316 / 133430652 / +3.4% 159461492 / 163167913 / -2.3% 0.87 / 0.82 / +5.8%
tpcds_q76/datafusion:vortex-file-compressed 42910062 / 43777644 / -2.0% 65689174 / 66068452 / -0.6% 0.65 / 0.66 / -1.4%
tpcds_q77/datafusion:vortex-file-compressed 35036538 / 35319766 / -0.8% 58691860 / 63004189 / -6.8% 0.60 / 0.56 / +6.5%
tpcds_q78/datafusion:vortex-file-compressed 80781066 / 80713658 / +0.1% 106125629 / 108179868 / -1.9% 0.76 / 0.75 / +2.0%
tpcds_q79/datafusion:vortex-file-compressed 21167736 / 20687721 / +2.3% 40636579 / 42075705 / -3.4% 0.52 / 0.49 / +5.9%
tpcds_q80/datafusion:vortex-file-compressed 76226274 / 76950218 / -0.9% 107199372 / 110766959 / -3.2% 0.71 / 0.69 / +2.4%
tpcds_q81/datafusion:vortex-file-compressed 28333100 / 28162387 / +0.6% 45205749 / 47194001 / -4.2% 0.63 / 0.60 / +5.0%
tpcds_q82/datafusion:vortex-file-compressed 13234615 / 13472692 / -1.8% 33064887 / 37815816 / -12.6% 🟢 0.40 / 0.36 / +12.3%
tpcds_q83/datafusion:vortex-file-compressed 36366616 / 37203245 / -2.2% 54310085 / 60821830 / -10.7% 🟢 0.67 / 0.61 / +9.5%
tpcds_q84/datafusion:vortex-file-compressed 11957852 / 12058158 / -0.8% 25591186 / 28180595 / -9.2% 0.47 / 0.43 / +9.2%
tpcds_q85/datafusion:vortex-file-compressed 59399042 / 59790492 / -0.7% 82660172 / 86388923 / -4.3% 0.72 / 0.69 / +3.8%
tpcds_q86/datafusion:vortex-file-compressed 16522190 / 16443036 / +0.5% 31641165 / 33848578 / -6.5% 0.52 / 0.49 / +7.5%
tpcds_q87/datafusion:vortex-file-compressed 29788372 / 29338680 / +1.5% 50412947 / 52669010 / -4.3% 0.59 / 0.56 / +6.1%
tpcds_q88/datafusion:vortex-file-compressed 33890490 / 34087568 / -0.6% 56990145 / 62613837 / -9.0% 0.59 / 0.54 / +9.2%
tpcds_q89/datafusion:vortex-file-compressed 21137432 / 21034174 / +0.5% 38214420 / 41657082 / -8.3% 0.55 / 0.50 / +9.5%
tpcds_q90/datafusion:vortex-file-compressed 10033284 / 10026344 / +0.1% 25251505 / 26580023 / -5.0% 0.40 / 0.38 / +5.3%
tpcds_q91/datafusion:vortex-file-compressed 16553924 / 16525708 / +0.2% 33799820 / 35846664 / -5.7% 0.49 / 0.46 / +6.2%
tpcds_q92/datafusion:vortex-file-compressed 13744434 / 13263155 / +3.6% 30757222 / 31280180 / -1.7% 0.45 / 0.42 / +5.4%
tpcds_q93/datafusion:vortex-file-compressed 23316312 / 23695572 / -1.6% 42808001 / 48102412 / -11.0% 🟢 0.54 / 0.49 / +10.6%
tpcds_q94/datafusion:vortex-file-compressed 19910957 / 19425293 / +2.5% 36553432 / 40071547 / -8.8% 0.54 / 0.48 / +12.4%
tpcds_q95/datafusion:vortex-file-compressed 45552532 / 46079950 / -1.1% 66465887 / 69304506 / -4.1% 0.69 / 0.66 / +3.1%
tpcds_q96/datafusion:vortex-file-compressed 9594884 / 9123544 / +5.2% 24024284 / 24596988 / -2.3% 0.40 / 0.37 / +7.7%
tpcds_q97/datafusion:vortex-file-compressed 21667936 / 21192621 / +2.2% 42187690 / 43461244 / -2.9% 0.51 / 0.49 / +5.3%
tpcds_q98/datafusion:vortex-file-compressed 16823716 / 16707820 / +0.7% 35360382 / 37815927 / -6.5% 0.48 / 0.44 / +7.7%
tpcds_q99/datafusion:vortex-file-compressed 19497854 / 19184940 / +1.6% 36184706 / 39300132 / -7.9% 0.54 / 0.49 / +10.4%
datafusion / parquet / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30960494 / 29556782 / +4.7% 48374855 / 49041438 / -1.4% 0.64 / 0.60 / +6.2%
tpcds_q02/datafusion:parquet 45389208 / 45336318 / +0.1% 58427357 / 60721216 / -3.8% 0.78 / 0.75 / +4.0%
tpcds_q03/datafusion:parquet 19059963 / 18998518 / +0.3% 31483116 / 31999953 / -1.6% 0.61 / 0.59 / +2.0%
tpcds_q04/datafusion:parquet 194574984 / 196594446 / -1.0% 221814713 / 217394226 / +2.0% 0.88 / 0.90 / -3.0%
tpcds_q05/datafusion:parquet 72122916 / 73653998 / -2.1% 92343513 / 93521198 / -1.3% 0.78 / 0.79 / -0.8%
tpcds_q06/datafusion:parquet 35836370 / 34990289 / +2.4% 50928043 / 51175948 / -0.5% 0.70 / 0.68 / +2.9%
tpcds_q07/datafusion:parquet 46138174 / 47297078 / -2.5% 66167440 / 69408881 / -4.7% 0.70 / 0.68 / +2.3%
tpcds_q08/datafusion:parquet 40100865 / 39792856 / +0.8% 56417526 / 55208740 / +2.2% 0.71 / 0.72 / -1.4%
tpcds_q09/datafusion:parquet 31639802 / 30628732 / +3.3% 46352074 / 45608842 / +1.6% 0.68 / 0.67 / +1.6%
tpcds_q10/datafusion:parquet 51149988 / 49734734 / +2.8% 64020172 / 64895210 / -1.3% 0.80 / 0.77 / +4.3%
tpcds_q11/datafusion:parquet 95151958 / 94822718 / +0.3% 119905255 / 120016332 / -0.1% 0.79 / 0.79 / +0.4%
tpcds_q12/datafusion:parquet 24406730 / 24349067 / +0.2% 37395426 / 36697684 / +1.9% 0.65 / 0.66 / -1.6%
tpcds_q13/datafusion:parquet 44629880 / 45054040 / -0.9% 64041313 / 69461485 / -7.8% 0.70 / 0.65 / +7.4%
tpcds_q14/datafusion:parquet 139646208 / 140554621 / -0.6% 154861391 / 155410232 / -0.4% 0.90 / 0.90 / -0.3%
tpcds_q15/datafusion:parquet 31187360 / 30366975 / +2.7% 49400767 / 48138915 / +2.6% 0.63 / 0.63 / +0.1%
tpcds_q16/datafusion:parquet 38157990 / 36974362 / +3.2% 56753177 / 55208664 / +2.8% 0.67 / 0.67 / +0.4%
tpcds_q17/datafusion:parquet 74245974 / 75013221 / -1.0% 101918688 / 102045539 / -0.1% 0.73 / 0.74 / -0.9%
tpcds_q18/datafusion:parquet 56759686 / 57656014 / -1.6% 80141502 / 77116125 / +3.9% 0.71 / 0.75 / -5.3%
tpcds_q19/datafusion:parquet 32499822 / 32297656 / +0.6% 48088562 / 49280629 / -2.4% 0.68 / 0.66 / +3.1%
tpcds_q20/datafusion:parquet 25826274 / 26080224 / -1.0% 39056108 / 40342105 / -3.2% 0.66 / 0.65 / +2.3%
tpcds_q21/datafusion:parquet 20557503 / 20519470 / +0.2% 33352032 / 33908883 / -1.6% 0.62 / 0.61 / +1.9%
tpcds_q22/datafusion:parquet 76777034 / 77567192 / -1.0% 91634564 / 93705698 / -2.2% 0.84 / 0.83 / +1.2%
tpcds_q23/datafusion:parquet 115329590 / 114421692 / +0.8% 137517318 / 141135048 / -2.6% 0.84 / 0.81 / +3.4%
tpcds_q24/datafusion:parquet 90696502 / 90842074 / -0.2% 117202692 / 120573976 / -2.8% 0.77 / 0.75 / +2.7%
tpcds_q25/datafusion:parquet 75021206 / 74560836 / +0.6% 99258190 / 103238730 / -3.9% 0.76 / 0.72 / +4.7%
tpcds_q26/datafusion:parquet 42719626 / 42294840 / +1.0% 59160764 / 62265755 / -5.0% 0.72 / 0.68 / +6.3%
tpcds_q27/datafusion:parquet 78412674 / 78990050 / -0.7% 101952869 / 110221637 / -7.5% 0.77 / 0.72 / +7.3%
tpcds_q28/datafusion:parquet 26789613 / 27484800 / -2.5% 43293103 / 43724149 / -1.0% 0.62 / 0.63 / -1.6%
tpcds_q29/datafusion:parquet 76370350 / 75920355 / +0.6% 101609262 / 104509729 / -2.8% 0.75 / 0.73 / +3.5%
tpcds_q30/datafusion:parquet 44332510 / 46315112 / -4.3% 62618696 / 67011466 / -6.6% 0.71 / 0.69 / +2.4%
tpcds_q31/datafusion:parquet 89206466 / 89454798 / -0.3% 103214309 / 111977815 / -7.8% 0.86 / 0.80 / +8.2%
tpcds_q32/datafusion:parquet 25500280 / 25866550 / -1.4% 40326199 / 43850725 / -8.0% 0.63 / 0.59 / +7.2%
tpcds_q33/datafusion:parquet 40550122 / 40230316 / +0.8% 54500438 / 56350208 / -3.3% 0.74 / 0.71 / +4.2%
tpcds_q34/datafusion:parquet 23946995 / 24151644 / -0.8% 37734218 / 39298187 / -4.0% 0.63 / 0.61 / +3.3%
tpcds_q35/datafusion:parquet 55296310 / 54278454 / +1.9% 70279501 / 71959415 / -2.3% 0.79 / 0.75 / +4.3%
tpcds_q36/datafusion:parquet 50855636 / 52298276 / -2.8% 71755942 / 75280308 / -4.7% 0.71 / 0.69 / +2.0%
tpcds_q37/datafusion:parquet 25971576 / 25644560 / +1.3% 39083477 / 39754073 / -1.7% 0.66 / 0.65 / +3.0%
tpcds_q38/datafusion:parquet 43964937 / 44459160 / -1.1% 62305352 / 63830068 / -2.4% 0.71 / 0.70 / +1.3%
tpcds_q39/datafusion:parquet 70840208 / 72170424 / -1.8% 89861637 / 91333432 / -1.6% 0.79 / 0.79 / -0.2%
tpcds_q40/datafusion:parquet 28898206 / 29399133 / -1.7% 49439482 / 49792663 / -0.7% 0.58 / 0.59 / -1.0%
tpcds_q41/datafusion:parquet 19631102 / 19854046 / -1.1% 31041247 / 33861716 / -8.3% 0.63 / 0.59 / +7.9%
tpcds_q42/datafusion:parquet 17991583 / 18142146 / -0.8% 30486679 / 32523009 / -6.3% 0.59 / 0.56 / +5.8%
tpcds_q43/datafusion:parquet 19691707 / 19253203 / +2.3% 31877832 / 33573596 / -5.1% 0.62 / 0.57 / +7.7%
tpcds_q44/datafusion:parquet 33520052 / 33941892 / -1.2% 49847186 / 51322574 / -2.9% 0.67 / 0.66 / +1.7%
tpcds_q45/datafusion:parquet 38405862 / 38114824 / +0.8% 52566809 / 55475573 / -5.2% 0.73 / 0.69 / +6.3%
tpcds_q46/datafusion:parquet 29749782 / 29000626 / +2.6% 48953879 / 51808960 / -5.5% 0.61 / 0.56 / +8.6%
tpcds_q47/datafusion:parquet 98189440 / 99783422 / -1.6% 123994669 / 121998179 / +1.6% 0.79 / 0.82 / -3.2%
tpcds_q48/datafusion:parquet 40806482 / 40640938 / +0.4% 61660834 / 59891330 / +3.0% 0.66 / 0.68 / -2.5%
tpcds_q49/datafusion:parquet 73221918 / 73423737 / -0.3% 100085772 / 96824316 / +3.4% 0.73 / 0.76 / -3.5%
tpcds_q50/datafusion:parquet 48004319 / 47577948 / +0.9% 68095995 / 70351811 / -3.2% 0.70 / 0.68 / +4.2%
tpcds_q51/datafusion:parquet 70612000 / 71842598 / -1.7% 93040036 / 93261013 / -0.2% 0.76 / 0.77 / -1.5%
tpcds_q52/datafusion:parquet 18736494 / 18718374 / +0.1% 29278883 / 31443972 / -6.9% 0.64 / 0.60 / +7.5%
tpcds_q53/datafusion:parquet 23204589 / 23370024 / -0.7% 38093916 / 39491424 / -3.5% 0.61 / 0.59 / +2.9%
tpcds_q54/datafusion:parquet 54273575 / 54824326 / -1.0% 73607820 / 75066962 / -1.9% 0.74 / 0.73 / +1.0%
tpcds_q55/datafusion:parquet 18450274 / 18245570 / +1.1% 32004321 / 33798869 / -5.3% 0.58 / 0.54 / +6.8%
tpcds_q56/datafusion:parquet 46745318 / 44949932 / +4.0% 61908890 / 61729282 / +0.3% 0.76 / 0.73 / +3.7%
tpcds_q57/datafusion:parquet 101344310 / 101520246 / -0.2% 117644638 / 119626703 / -1.7% 0.86 / 0.85 / +1.5%
tpcds_q58/datafusion:parquet 64952688 / 65141191 / -0.3% 83196771 / 84050031 / -1.0% 0.78 / 0.78 / +0.7%
tpcds_q59/datafusion:parquet 47506374 / 46748479 / +1.6% 64822419 / 67819083 / -4.4% 0.73 / 0.69 / +6.3%
tpcds_q60/datafusion:parquet 46225082 / 44876382 / +3.0% 61413748 / 61064934 / +0.6% 0.75 / 0.73 / +2.4%
tpcds_q61/datafusion:parquet 36862934 / 37779704 / -2.4% 55226885 / 60680427 / -9.0% 0.67 / 0.62 / +7.2%
tpcds_q62/datafusion:parquet 24750442 / 25070230 / -1.3% 39311642 / 40610776 / -3.2% 0.63 / 0.62 / +2.0%
tpcds_q63/datafusion:parquet 22500794 / 22018860 / +2.2% 38355221 / 40748194 / -5.9% 0.59 / 0.54 / +8.6%
tpcds_q64/datafusion:parquet 204131490 / 207804692 / -1.8% 233682626 / 243520305 / -4.0% 0.87 / 0.85 / +2.4%
tpcds_q65/datafusion:parquet 38499524 / 37064193 / +3.9% 57760262 / 58679273 / -1.6% 0.67 / 0.63 / +5.5%
tpcds_q66/datafusion:parquet 62384920 / 62886772 / -0.8% 79463577 / 83155957 / -4.4% 0.79 / 0.76 / +3.8%
tpcds_q67/datafusion:parquet 69881202 / 70799346 / -1.3% 95789616 / 97990514 / -2.2% 0.73 / 0.72 / +1.0%
tpcds_q68/datafusion:parquet 29399148 / 29747202 / -1.2% 48781432 / 51462032 / -5.2% 0.60 / 0.58 / +4.3%
tpcds_q69/datafusion:parquet 50676460 / 45982070 / +10.2% 🔴 62530355 / 65982348 / -5.2% 0.81 / 0.70 / +16.3%
tpcds_q70/datafusion:parquet 36793058 / 37502844 / -1.9% 55760364 / 57968964 / -3.8% 0.66 / 0.65 / +2.0%
tpcds_q71/datafusion:parquet 28070561 / 28826997 / -2.6% 40933290 / 44415936 / -7.8% 0.69 / 0.65 / +5.7%
tpcds_q72/datafusion:parquet 561178266 / 548519064 / +2.3% 574099418 / 586456819 / -2.1% 0.98 / 0.94 / +4.5%
tpcds_q73/datafusion:parquet 23238744 / 23128420 / +0.5% 37606312 / 39823273 / -5.6% 0.62 / 0.58 / +6.4%
tpcds_q74/datafusion:parquet 67070906 / 67777730 / -1.0% 88968877 / 90149492 / -1.3% 0.75 / 0.75 / +0.3%
tpcds_q75/datafusion:parquet 146273570 / 146930188 / -0.4% 181954019 / 178877325 / +1.7% 0.80 / 0.82 / -2.1%
tpcds_q76/datafusion:parquet 54577434 / 55678498 / -2.0% 71438196 / 73254595 / -2.5% 0.76 / 0.76 / +0.5%
tpcds_q77/datafusion:parquet 54736618 / 54944742 / -0.4% 74437219 / 78112245 / -4.7% 0.74 / 0.70 / +4.5%
tpcds_q78/datafusion:parquet 90914532 / 90785181 / +0.1% 125305607 / 125442306 / -0.1% 0.73 / 0.72 / +0.3%
tpcds_q79/datafusion:parquet 26148218 / 26200576 / -0.2% 43011146 / 46955377 / -8.4% 0.61 / 0.56 / +9.0%
tpcds_q80/datafusion:parquet 79749602 / 81286672 / -1.9% 110717613 / 114633716 / -3.4% 0.72 / 0.71 / +1.6%
tpcds_q81/datafusion:parquet 42176488 / 40553496 / +4.0% 60880539 / 62122246 / -2.0% 0.69 / 0.65 / +6.1%
tpcds_q82/datafusion:parquet 26372782 / 27308711 / -3.4% 39873896 / 40400115 / -1.3% 0.66 / 0.68 / -2.2%
tpcds_q83/datafusion:parquet 57435604 / 59325175 / -3.2% 73929270 / 76131675 / -2.9% 0.78 / 0.78 / -0.3%
tpcds_q84/datafusion:parquet 30801344 / 30298270 / +1.7% 44415242 / 45368665 / -2.1% 0.69 / 0.67 / +3.8%
tpcds_q85/datafusion:parquet 83444941 / 84100266 / -0.8% 107062113 / 110361884 / -3.0% 0.78 / 0.76 / +2.3%
tpcds_q86/datafusion:parquet 20243686 / 20508638 / -1.3% 33341437 / 35633206 / -6.4% 0.61 / 0.58 / +5.5%
tpcds_q87/datafusion:parquet 46547834 / 45865112 / +1.5% 58508888 / 63168051 / -7.4% 0.80 / 0.73 / +9.6%
tpcds_q88/datafusion:parquet 48942466 / 46290634 / +5.7% 70608729 / 66799589 / +5.7% 0.69 / 0.69 / +0.0%
tpcds_q89/datafusion:parquet 25542010 / 25853911 / -1.2% 42758507 / 44644121 / -4.2% 0.60 / 0.58 / +3.2%
tpcds_q90/datafusion:parquet 20143099 / 19204341 / +4.9% 31747351 / 32948787 / -3.6% 0.63 / 0.58 / +8.9%
tpcds_q91/datafusion:parquet 37432164 / 36951150 / +1.3% 53524832 / 53360478 / +0.3% 0.70 / 0.69 / +1.0%
tpcds_q92/datafusion:parquet 25958463 / 26434196 / -1.8% 41014917 / 42718872 / -4.0% 0.63 / 0.62 / +2.3%
tpcds_q93/datafusion:parquet 27047840 / 26953854 / +0.3% 46203202 / 49632462 / -6.9% 0.59 / 0.54 / +7.8%
tpcds_q94/datafusion:parquet 34348052 / 34554374 / -0.6% 49005757 / 50445219 / -2.9% 0.70 / 0.68 / +2.3%
tpcds_q95/datafusion:parquet 64356974 / 63793301 / +0.9% 78286082 / 79893571 / -2.0% 0.82 / 0.80 / +3.0%
tpcds_q96/datafusion:parquet 16907237 / 16526785 / +2.3% 28576048 / 28644040 / -0.2% 0.59 / 0.58 / +2.5%
tpcds_q97/datafusion:parquet 35153978 / 35444556 / -0.8% 53571912 / 55376111 / -3.3% 0.66 / 0.64 / +2.5%
tpcds_q98/datafusion:parquet 25343018 / 25211682 / +0.5% 38905040 / 41119574 / -5.4% 0.65 / 0.61 / +6.2%
tpcds_q99/datafusion:parquet 29384955 / 29781138 / -1.3% 43436833 / 44208998 / -1.7% 0.68 / 0.67 / +0.4%
duckdb / vortex-file-compressed / ns (1.004x ➖, 1↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15050702 / 15183936 / -0.9% 22389636 / 23302176 / -3.9% 0.67 / 0.65 / +3.2%
tpcds_q02/duckdb:vortex-file-compressed 15022670 / 14889034 / +0.9% 19543323 / 21447408 / -8.9% 0.77 / 0.69 / +10.7%
tpcds_q03/duckdb:vortex-file-compressed 11954851 / 11936942 / +0.2% 23075841 / 21020285 / +9.8% 0.52 / 0.57 / -8.8%
tpcds_q04/duckdb:vortex-file-compressed 50067548 / 50049620 / +0.0% 57790439 / 63792626 / -9.4% 0.87 / 0.78 / +10.4%
tpcds_q05/duckdb:vortex-file-compressed 18655373 / 18886020 / -1.2% 26811175 / 25045178 / +7.1% 0.70 / 0.75 / -7.7%
tpcds_q06/duckdb:vortex-file-compressed 26600309 / 26635376 / -0.1% 38710632 / 39775813 / -2.7% 0.69 / 0.67 / +2.6%
tpcds_q07/duckdb:vortex-file-compressed 15893764 / 16086764 / -1.2% 27669722 / 31511739 / -12.2% 🟢 0.57 / 0.51 / +12.5%
tpcds_q08/duckdb:vortex-file-compressed 19016252 / 19167064 / -0.8% 29126293 / 32011563 / -9.0% 0.65 / 0.60 / +9.0%
tpcds_q09/duckdb:vortex-file-compressed 13556204 / 13954124 / -2.9% 20090102 / 23054381 / -12.9% 🟢 0.67 / 0.61 / +11.5%
tpcds_q10/duckdb:vortex-file-compressed 27198688 / 27720562 / -1.9% 40812616 / 40633139 / +0.4% 0.67 / 0.68 / -2.3%
tpcds_q11/duckdb:vortex-file-compressed 39736052 / 40143688 / -1.0% 50428846 / 50431654 / -0.0% 0.79 / 0.80 / -1.0%
tpcds_q12/duckdb:vortex-file-compressed 10322580 / 10516470 / -1.8% 15562336 / 17306875 / -10.1% 🟢 0.66 / 0.61 / +9.2%
tpcds_q13/duckdb:vortex-file-compressed 21008171 / 21525245 / -2.4% 34518175 / 40709319 / -15.2% 🟢 0.61 / 0.53 / +15.1%
tpcds_q14/duckdb:vortex-file-compressed 58391154 / 58675571 / -0.5% 70371279 / 70935480 / -0.8% 0.83 / 0.83 / +0.3%
tpcds_q15/duckdb:vortex-file-compressed 20474216 / 20880880 / -1.9% 26000076 / 28945594 / -10.2% 🟢 0.79 / 0.72 / +9.2%
tpcds_q16/duckdb:vortex-file-compressed 17476390 / 17526732 / -0.3% 25815174 / 27927570 / -7.6% 0.68 / 0.63 / +7.9%
tpcds_q17/duckdb:vortex-file-compressed 29853860 / 29997696 / -0.5% 44504089 / 45301829 / -1.8% 0.67 / 0.66 / +1.3%
tpcds_q18/duckdb:vortex-file-compressed 28210102 / 28254949 / -0.2% 36815713 / 38655065 / -4.8% 0.77 / 0.73 / +4.8%
tpcds_q19/duckdb:vortex-file-compressed 23449460 / 24008140 / -2.3% 33103244 / 35946807 / -7.9% 0.71 / 0.67 / +6.1%
tpcds_q20/duckdb:vortex-file-compressed 11894832 / 10772696 / +10.4% 🔴 17134520 / 15904122 / +7.7% 0.69 / 0.68 / +2.5%
tpcds_q21/duckdb:vortex-file-compressed 13054642 / 9697317 / +34.6% 🔴 19934403 / 19132283 / +4.2% 0.65 / 0.51 / +29.2%
tpcds_q22/duckdb:vortex-file-compressed 29547078 / 29062462 / +1.7% 39571789 / 40700425 / -2.8% 0.75 / 0.71 / +4.6%
tpcds_q23/duckdb:vortex-file-compressed 37477720 / 38745758 / -3.3% 46544023 / 47901072 / -2.8% 0.81 / 0.81 / -0.5%
tpcds_q24/duckdb:vortex-file-compressed 28084373 / 28132677 / -0.2% 40066530 / 39706114 / +0.9% 0.70 / 0.71 / -1.1%
tpcds_q25/duckdb:vortex-file-compressed 25456350 / 25436746 / +0.1% 40499742 / 40553762 / -0.1% 0.63 / 0.63 / +0.2%
tpcds_q26/duckdb:vortex-file-compressed 15025362 / 13586090 / +10.6% 🔴 20803451 / 22038289 / -5.6% 0.72 / 0.62 / +17.2%
tpcds_q27/duckdb:vortex-file-compressed 17283588 / 17292649 / -0.1% 29599825 / 32240586 / -8.2% 0.58 / 0.54 / +8.9%
tpcds_q28/duckdb:vortex-file-compressed 12728178 / 12811947 / -0.7% 20995996 / 22903047 / -8.3% 0.61 / 0.56 / +8.4%
tpcds_q29/duckdb:vortex-file-compressed 29116174 / 28617321 / +1.7% 46593812 / 45434888 / +2.6% 0.62 / 0.63 / -0.8%
tpcds_q30/duckdb:vortex-file-compressed 19281069 / 19186294 / +0.5% 26711893 / 30327486 / -11.9% 🟢 0.72 / 0.63 / +14.1%
tpcds_q31/duckdb:vortex-file-compressed 19164998 / 19476379 / -1.6% 25627932 / 32168871 / -20.3% 🟢 0.75 / 0.61 / +23.5%
tpcds_q32/duckdb:vortex-file-compressed 10894412 / 9746318 / +11.8% 🔴 16520443 / 17874284 / -7.6% 0.66 / 0.55 / +20.9%
tpcds_q33/duckdb:vortex-file-compressed 16358606 / 16797333 / -2.6% 28465089 / 28395670 / +0.2% 0.57 / 0.59 / -2.8%
tpcds_q34/duckdb:vortex-file-compressed 15458450 / 15531186 / -0.5% 21443886 / 22786596 / -5.9% 0.72 / 0.68 / +5.8%
tpcds_q35/duckdb:vortex-file-compressed 45926414 / 46419645 / -1.1% 61014125 / 61934574 / -1.5% 0.75 / 0.75 / +0.4%
tpcds_q36/duckdb:vortex-file-compressed 14823122 / 15488974 / -4.3% 25444847 / 27203406 / -6.5% 0.58 / 0.57 / +2.3%
tpcds_q37/duckdb:vortex-file-compressed 14383801 / 14021538 / +2.6% 22668207 / 23773172 / -4.6% 0.63 / 0.59 / +7.6%
tpcds_q38/duckdb:vortex-file-compressed 22348200 / 22175694 / +0.8% 28318030 / 29349882 / -3.5% 0.79 / 0.76 / +4.5%
tpcds_q39/duckdb:vortex-file-compressed 21160053 / 18464756 / +14.6% 🔴 31131450 / 27444020 / +13.4% 🔴 0.68 / 0.67 / +1.0%
tpcds_q40/duckdb:vortex-file-compressed 13078527 / 14241694 / -8.2% 18288772 / 21260607 / -14.0% 🟢 0.72 / 0.67 / +6.8%
tpcds_q41/duckdb:vortex-file-compressed 6553940 / 6631016 / -1.2% 9761636 / 9324979 / +4.7% 0.67 / 0.71 / -5.6%
tpcds_q42/duckdb:vortex-file-compressed 8316108 / 8383786 / -0.8% 18014747 / 18092679 / -0.4% 0.46 / 0.46 / -0.4%
tpcds_q43/duckdb:vortex-file-compressed 10343642 / 10024083 / +3.2% 18269849 / 18207656 / +0.3% 0.57 / 0.55 / +2.8%
tpcds_q44/duckdb:vortex-file-compressed 15532062 / 15361808 / +1.1% 23534652 / 25622250 / -8.1% 0.66 / 0.60 / +10.1%
tpcds_q45/duckdb:vortex-file-compressed 22191889 / 22253699 / -0.3% 28267026 / 29845679 / -5.3% 0.79 / 0.75 / +5.3%
tpcds_q46/duckdb:vortex-file-compressed 18683088 / 18756672 / -0.4% 26834229 / 29310086 / -8.4% 0.70 / 0.64 / +8.8%
tpcds_q47/duckdb:vortex-file-compressed 30330460 / 30836676 / -1.6% 40346939 / 45924762 / -12.1% 🟢 0.75 / 0.67 / +12.0%
tpcds_q48/duckdb:vortex-file-compressed 20032627 / 22191686 / -9.7% 30250427 / 32508700 / -6.9% 0.66 / 0.68 / -3.0%
tpcds_q49/duckdb:vortex-file-compressed 16519209 / 17106136 / -3.4% 28341620 / 29099187 / -2.6% 0.58 / 0.59 / -0.8%
tpcds_q50/duckdb:vortex-file-compressed 16684358 / 16697328 / -0.1% 28320301 / 30062019 / -5.8% 0.59 / 0.56 / +6.1%
tpcds_q51/duckdb:vortex-file-compressed 76145100 / 77153150 / -1.3% 60027498 / 89514811 / -32.9% 🟢 1.27 / 0.86 / +47.2%
tpcds_q52/duckdb:vortex-file-compressed 8871083 / 11189007 / -20.7% 🟢 16564820 / 19115180 / -13.3% 🟢 0.54 / 0.59 / -8.5%
tpcds_q53/duckdb:vortex-file-compressed 14707750 / 14367174 / +2.4% 23530521 / 25813910 / -8.8% 0.63 / 0.56 / +12.3%
tpcds_q54/duckdb:vortex-file-compressed 20448850 / 20586752 / -0.7% 31166994 / 29379602 / +6.1% 0.66 / 0.70 / -6.4%
tpcds_q55/duckdb:vortex-file-compressed 11318748 / 8681502 / +30.4% 🔴 16807330 / 18476943 / -9.0% 0.67 / 0.47 / +43.3%
tpcds_q56/duckdb:vortex-file-compressed 17466561 / 17081338 / +2.3% 29360655 / 29146489 / +0.7% 0.59 / 0.59 / +1.5%
tpcds_q57/duckdb:vortex-file-compressed 24301754 / 24338488 / -0.2% 31194387 / 31647280 / -1.4% 0.78 / 0.77 / +1.3%
tpcds_q58/duckdb:vortex-file-compressed 17487917 / 17606916 / -0.7% 26338520 / 27881996 / -5.5% 0.66 / 0.63 / +5.1%
tpcds_q59/duckdb:vortex-file-compressed 18474834 / 19073222 / -3.1% 24707805 / 25478092 / -3.0% 0.75 / 0.75 / -0.1%
tpcds_q60/duckdb:vortex-file-compressed 18134922 / 17970510 / +0.9% 31332791 / 30337950 / +3.3% 0.58 / 0.59 / -2.3%
tpcds_q61/duckdb:vortex-file-compressed 19594402 / 19425018 / +0.9% 30321537 / 35705121 / -15.1% 🟢 0.65 / 0.54 / +18.8%
tpcds_q62/duckdb:vortex-file-compressed 10437692 / 10252818 / +1.8% 18185133 / 19066729 / -4.6% 0.57 / 0.54 / +6.7%
tpcds_q63/duckdb:vortex-file-compressed 13122910 / 13852905 / -5.3% 22111641 / 24563978 / -10.0% 0.59 / 0.56 / +5.2%
tpcds_q64/duckdb:vortex-file-compressed 62216906 / 63254488 / -1.6% 79431706 / 78478433 / +1.2% 0.78 / 0.81 / -2.8%
tpcds_q65/duckdb:vortex-file-compressed 15953405 / 15771310 / +1.2% 24762120 / 30768331 / -19.5% 🟢 0.64 / 0.51 / +25.7%
tpcds_q66/duckdb:vortex-file-compressed 21067632 / 20623838 / +2.2% 30473419 / 33077604 / -7.9% 0.69 / 0.62 / +10.9%
tpcds_q67/duckdb:vortex-file-compressed 65068553 / 66086571 / -1.5% 78950021 / 83270512 / -5.2% 0.82 / 0.79 / +3.8%
tpcds_q68/duckdb:vortex-file-compressed 18169973 / 18434148 / -1.4% 28801071 / 31119960 / -7.5% 0.63 / 0.59 / +6.5%
tpcds_q69/duckdb:vortex-file-compressed 28778296 / 29229354 / -1.5% 45245129 / 42788944 / +5.7% 0.64 / 0.68 / -6.9%
tpcds_q70/duckdb:vortex-file-compressed 18546574 / 18085495 / +2.5% 28149669 / 35748398 / -21.3% 🟢 0.66 / 0.51 / +30.2%
tpcds_q71/duckdb:vortex-file-compressed 12573649 / 12651667 / -0.6% 20548615 / 22707155 / -9.5% 0.61 / 0.56 / +9.8%
tpcds_q72/duckdb:vortex-file-compressed 61294706 / 61733786 / -0.7% 75008903 / 81366114 / -7.8% 0.82 / 0.76 / +7.7%
tpcds_q73/duckdb:vortex-file-compressed 14527040 / 15147130 / -4.1% 23006136 / 20982016 / +9.6% 0.63 / 0.72 / -12.5%
tpcds_q74/duckdb:vortex-file-compressed 27379840 / 27195048 / +0.7% 35685325 / 37562833 / -5.0% 0.77 / 0.72 / +6.0%
tpcds_q75/duckdb:vortex-file-compressed 28968532 / 28616800 / +1.2% 39460102 / 47926696 / -17.7% 🟢 0.73 / 0.60 / +22.9%
tpcds_q76/duckdb:vortex-file-compressed 12857332 / 12302514 / +4.5% 26451059 / 24605747 / +7.5% 0.49 / 0.50 / -2.8%
tpcds_q77/duckdb:vortex-file-compressed 16232198 / 16436094 / -1.2% 25074569 / 28138585 / -10.9% 🟢 0.65 / 0.58 / +10.8%
tpcds_q78/duckdb:vortex-file-compressed 37075612 / 37206400 / -0.4% 45829724 / 47421448 / -3.4% 0.81 / 0.78 / +3.1%
tpcds_q79/duckdb:vortex-file-compressed 14517926 / 14497792 / +0.1% 25233135 / 27656101 / -8.8% 0.58 / 0.52 / +9.8%
tpcds_q80/duckdb:vortex-file-compressed 27778422 / 28267848 / -1.7% 44431548 / 44599531 / -0.4% 0.63 / 0.63 / -1.4%
tpcds_q81/duckdb:vortex-file-compressed 22295096 / 22352260 / -0.3% 31037299 / 30098574 / +3.1% 0.72 / 0.74 / -3.3%
tpcds_q82/duckdb:vortex-file-compressed 32541038 / 32148096 / +1.2% 41089378 / 40197769 / +2.2% 0.79 / 0.80 / -1.0%
tpcds_q83/duckdb:vortex-file-compressed 20019126 / 20099851 / -0.4% 24855762 / 25657152 / -3.1% 0.81 / 0.78 / +2.8%
tpcds_q84/duckdb:vortex-file-compressed 17085468 / 12678916 / +34.8% 🔴 21609959 / 21175674 / +2.1% 0.79 / 0.60 / +32.0%
tpcds_q85/duckdb:vortex-file-compressed 31417478 / 30851656 / +1.8% 39946853 / 41670720 / -4.1% 0.79 / 0.74 / +6.2%
tpcds_q86/duckdb:vortex-file-compressed 10676572 / 10839980 / -1.5% 16875321 / 17702027 / -4.7% 0.63 / 0.61 / +3.3%
tpcds_q87/duckdb:vortex-file-compressed 23501680 / 24114696 / -2.5% 30043559 / 30889788 / -2.7% 0.78 / 0.78 / +0.2%
tpcds_q88/duckdb:vortex-file-compressed 32215874 / 32421427 / -0.6% 44370828 / 46132210 / -3.8% 0.73 / 0.70 / +3.3%
tpcds_q89/duckdb:vortex-file-compressed 13701807 / 13829776 / -0.9% 22987625 / 24206632 / -5.0% 0.60 / 0.57 / +4.3%
tpcds_q90/duckdb:vortex-file-compressed 8004738 / 8428934 / -5.0% 12160331 / 12258538 / -0.8% 0.66 / 0.69 / -4.3%
tpcds_q91/duckdb:vortex-file-compressed 14987116 / 15388049 / -2.6% 21443888 / 22452273 / -4.5% 0.70 / 0.69 / +2.0%
tpcds_q92/duckdb:vortex-file-compressed 13074355 / 13095850 / -0.2% 20533100 / 25296944 / -18.8% 🟢 0.64 / 0.52 / +23.0%
tpcds_q93/duckdb:vortex-file-compressed 16870621 / 16814770 / +0.3% 23631785 / 23232044 / +1.7% 0.71 / 0.72 / -1.4%
tpcds_q94/duckdb:vortex-file-compressed 16046722 / 16556159 / -3.1% 25086709 / 27368529 / -8.3% 0.64 / 0.60 / +5.7%
tpcds_q95/duckdb:vortex-file-compressed 44023462 / 45125019 / -2.4% 51785414 / 57367996 / -9.7% 0.85 / 0.79 / +8.1%
tpcds_q96/duckdb:vortex-file-compressed 7360878 / 7616049 / -3.4% 14719828 / 15607712 / -5.7% 0.50 / 0.49 / +2.5%
tpcds_q97/duckdb:vortex-file-compressed 22331278 / 22188711 / +0.6% 27552715 / 28782482 / -4.3% 0.81 / 0.77 / +5.1%
tpcds_q98/duckdb:vortex-file-compressed 14340882 / 13508380 / +6.2% 23794074 / 23119631 / +2.9% 0.60 / 0.58 / +3.2%
tpcds_q99/duckdb:vortex-file-compressed 13219186 / 13405126 / -1.4% 19180763 / 21660838 / -11.4% 🟢 0.69 / 0.62 / +11.4%
duckdb / parquet / ns (0.996x ➖, 3↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24655097 / 23754438 / +3.8% 33580201 / 32267241 / +4.1% 0.73 / 0.74 / -0.3%
tpcds_q02/duckdb:parquet 15443146 / 15515303 / -0.5% 20136076 / 19986173 / +0.8% 0.77 / 0.78 / -1.2%
tpcds_q03/duckdb:parquet 8730718 / 8904015 / -1.9% 15354713 / 15472978 / -0.8% 0.57 / 0.58 / -1.2%
tpcds_q04/duckdb:parquet 126953590 / 128456472 / -1.2% 130982240 / 133513610 / -1.9% 0.97 / 0.96 / +0.7%
tpcds_q05/duckdb:parquet 21918592 / 21626620 / +1.4% 31775695 / 25398043 / +25.1% 🔴 0.69 / 0.85 / -19.0%
tpcds_q06/duckdb:parquet 29397752 / 26212014 / +12.2% 🔴 37658548 / 37000317 / +1.8% 0.78 / 0.71 / +10.2%
tpcds_q07/duckdb:parquet 15138412 / 15386112 / -1.6% 23035671 / 23677951 / -2.7% 0.66 / 0.65 / +1.1%
tpcds_q08/duckdb:parquet 25426802 / 26086728 / -2.5% 33365714 / 34000601 / -1.9% 0.76 / 0.77 / -0.7%
tpcds_q09/duckdb:parquet 18975016 / 18922093 / +0.3% 22821466 / 22337537 / +2.2% 0.83 / 0.85 / -1.8%
tpcds_q10/duckdb:parquet 27539826 / 27720976 / -0.7% 39663253 / 38806828 / +2.2% 0.69 / 0.71 / -2.8%
tpcds_q11/duckdb:parquet 70984742 / 72765529 / -2.4% 75816774 / 77157440 / -1.7% 0.94 / 0.94 / -0.7%
tpcds_q12/duckdb:parquet 12519340 / 14496522 / -13.6% 🟢 17335319 / 17926835 / -3.3% 0.72 / 0.81 / -10.7%
tpcds_q13/duckdb:parquet 23986105 / 24015783 / -0.1% 41324372 / 32409123 / +27.5% 🔴 0.58 / 0.74 / -21.7%
tpcds_q14/duckdb:parquet 61314514 / 61852170 / -0.9% 67564481 / 68225889 / -1.0% 0.91 / 0.91 / +0.1%
tpcds_q15/duckdb:parquet 24855838 / 25189521 / -1.3% 30789550 / 30865654 / -0.2% 0.81 / 0.82 / -1.1%
tpcds_q16/duckdb:parquet 19824867 / 20092852 / -1.3% 28808789 / 28934693 / -0.4% 0.69 / 0.69 / -0.9%
tpcds_q17/duckdb:parquet 32192280 / 32744939 / -1.7% 40398745 / 41353009 / -2.3% 0.80 / 0.79 / +0.6%
tpcds_q18/duckdb:parquet 38866102 / 39222650 / -0.9% 49546512 / 52307150 / -5.3% 0.78 / 0.75 / +4.6%
tpcds_q19/duckdb:parquet 24267550 / 24594828 / -1.3% 31702819 / 32329932 / -1.9% 0.77 / 0.76 / +0.6%
tpcds_q20/duckdb:parquet 16193218 / 13605368 / +19.0% 🔴 18371186 / 17499692 / +5.0% 0.88 / 0.78 / +13.4%
tpcds_q21/duckdb:parquet 9366656 / 9506610 / -1.5% 15308171 / 12370292 / +23.7% 🔴 0.61 / 0.77 / -20.4%
tpcds_q22/duckdb:parquet 36561018 / 35001009 / +4.5% 41874500 / 42041647 / -0.4% 0.87 / 0.83 / +4.9%
tpcds_q23/duckdb:parquet 40494586 / 40992220 / -1.2% 46642683 / 48026842 / -2.9% 0.87 / 0.85 / +1.7%
tpcds_q24/duckdb:parquet 33131103 / 33543952 / -1.2% 47606330 / 43956000 / +8.3% 0.70 / 0.76 / -8.8%
tpcds_q25/duckdb:parquet 29715241 / 30378764 / -2.2% 45290505 / 40600806 / +11.6% 🔴 0.66 / 0.75 / -12.3%
tpcds_q26/duckdb:parquet 31286044 / 31104554 / +0.6% 39022810 / 38415291 / +1.6% 0.80 / 0.81 / -1.0%
tpcds_q27/duckdb:parquet 31787976 / 32037839 / -0.8% 41100145 / 43862148 / -6.3% 0.77 / 0.73 / +5.9%
tpcds_q28/duckdb:parquet 17191934 / 17130741 / +0.4% 19625641 / 22825609 / -14.0% 🟢 0.88 / 0.75 / +16.7%
tpcds_q29/duckdb:parquet 30606051 / 30728322 / -0.4% 39547187 / 40127469 / -1.4% 0.77 / 0.77 / +1.1%
tpcds_q30/duckdb:parquet 32092470 / 32604856 / -1.6% 41521089 / 41921678 / -1.0% 0.77 / 0.78 / -0.6%
tpcds_q31/duckdb:parquet 21163598 / 20513347 / +3.2% 24715899 / 27449842 / -10.0% 0.86 / 0.75 / +14.6%
tpcds_q32/duckdb:parquet 11260036 / 11402296 / -1.2% 17109020 / 17696824 / -3.3% 0.66 / 0.64 / +2.1%
tpcds_q33/duckdb:parquet 17189692 / 17151678 / +0.2% 25645043 / 27334953 / -6.2% 0.67 / 0.63 / +6.8%
tpcds_q34/duckdb:parquet 16010462 / 16145835 / -0.8% 24213378 / 22462739 / +7.8% 0.66 / 0.72 / -8.0%
tpcds_q35/duckdb:parquet 46389628 / 47046582 / -1.4% 60443167 / 58032037 / +4.2% 0.77 / 0.81 / -5.3%
tpcds_q36/duckdb:parquet 15152198 / 15094690 / +0.4% 22693806 / 23262146 / -2.4% 0.67 / 0.65 / +2.9%
tpcds_q37/duckdb:parquet 12306223 / 11778486 / +4.5% 16592352 / 16691047 / -0.6% 0.74 / 0.71 / +5.1%
tpcds_q38/duckdb:parquet 26322156 / 26540732 / -0.8% 33730313 / 30740636 / +9.7% 0.78 / 0.86 / -9.6%
tpcds_q39/duckdb:parquet 24671482 / 24595112 / +0.3% 28292010 / 29520158 / -4.2% 0.87 / 0.83 / +4.7%
tpcds_q40/duckdb:parquet 15844305 / 15692439 / +1.0% 20662602 / 21058507 / -1.9% 0.77 / 0.75 / +2.9%
tpcds_q41/duckdb:parquet 7682276 / 9349318 / -17.8% 🟢 13516460 / 13310043 / +1.6% 0.57 / 0.70 / -19.1%
tpcds_q42/duckdb:parquet 8329972 / 8365312 / -0.4% 14950840 / 15232426 / -1.8% 0.56 / 0.55 / +1.5%
tpcds_q43/duckdb:parquet 10562872 / 10659335 / -0.9% 15779188 / 15546142 / +1.5% 0.67 / 0.69 / -2.4%
tpcds_q44/duckdb:parquet 16064975 / 16428199 / -2.2% 22592779 / 22115810 / +2.2% 0.71 / 0.74 / -4.3%
tpcds_q45/duckdb:parquet 23044062 / 23420886 / -1.6% 28962972 / 29568794 / -2.0% 0.80 / 0.79 / +0.4%
tpcds_q46/duckdb:parquet 35921766 / 36475585 / -1.5% 44668484 / 45233440 / -1.2% 0.80 / 0.81 / -0.3%
tpcds_q47/duckdb:parquet 30960812 / 31313746 / -1.1% 36642220 / 37263912 / -1.7% 0.84 / 0.84 / +0.6%
tpcds_q48/duckdb:parquet 20969236 / 21348864 / -1.8% 28501818 / 32402929 / -12.0% 🟢 0.74 / 0.66 / +11.7%
tpcds_q49/duckdb:parquet 18964335 / 19095486 / -0.7% 26679962 / 28800434 / -7.4% 0.71 / 0.66 / +7.2%
tpcds_q50/duckdb:parquet 17496091 / 17761245 / -1.5% 25156113 / 25895159 / -2.9% 0.70 / 0.69 / +1.4%
tpcds_q51/duckdb:parquet 53236168 / 54137192 / -1.7% 59060400 / 69300325 / -14.8% 🟢 0.90 / 0.78 / +15.4%
tpcds_q52/duckdb:parquet 8554220 / 8751473 / -2.3% 18801641 / 14972764 / +25.6% 🔴 0.45 / 0.58 / -22.2%
tpcds_q53/duckdb:parquet 11554846 / 11572381 / -0.2% 17139866 / 17136045 / +0.0% 0.67 / 0.68 / -0.2%
tpcds_q54/duckdb:parquet 20213316 / 20572644 / -1.7% 30019261 / 28904454 / +3.9% 0.67 / 0.71 / -5.4%
tpcds_q55/duckdb:parquet 8541790 / 8560682 / -0.2% 15069624 / 14943756 / +0.8% 0.57 / 0.57 / -1.1%
tpcds_q56/duckdb:parquet 16311456 / 16475063 / -1.0% 22823143 / 23787855 / -4.1% 0.71 / 0.69 / +3.2%
tpcds_q57/duckdb:parquet 28937003 / 29130088 / -0.7% 34218250 / 34590454 / -1.1% 0.85 / 0.84 / +0.4%
tpcds_q58/duckdb:parquet 17889418 / 19077340 / -6.2% 28258227 / 26350537 / +7.2% 0.63 / 0.72 / -12.6%
tpcds_q59/duckdb:parquet 20102130 / 22647864 / -11.2% 🟢 24892983 / 25528761 / -2.5% 0.81 / 0.89 / -9.0%
tpcds_q60/duckdb:parquet 16725814 / 17025878 / -1.8% 24291461 / 24540932 / -1.0% 0.69 / 0.69 / -0.8%
tpcds_q61/duckdb:parquet 21506448 / 21606854 / -0.5% 31957551 / 29345531 / +8.9% 0.67 / 0.74 / -8.6%
tpcds_q62/duckdb:parquet 13677416 / 10854129 / +26.0% 🔴 17624651 / 14450440 / +22.0% 🔴 0.78 / 0.75 / +3.3%
tpcds_q63/duckdb:parquet 10854680 / 10860974 / -0.1% 16563960 / 16690204 / -0.8% 0.66 / 0.65 / +0.7%
tpcds_q64/duckdb:parquet 52074496 / 54712296 / -4.8% 65364807 / 71328155 / -8.4% 0.80 / 0.77 / +3.9%
tpcds_q65/duckdb:parquet 14437125 / 14633802 / -1.3% 20458983 / 21138710 / -3.2% 0.71 / 0.69 / +1.9%
tpcds_q66/duckdb:parquet 24492096 / 24638794 / -0.6% 30710681 / 34943545 / -12.1% 🟢 0.80 / 0.71 / +13.1%
tpcds_q67/duckdb:parquet 76365707 / 77677850 / -1.7% 84434979 / 84299008 / +0.2% 0.90 / 0.92 / -1.8%
tpcds_q68/duckdb:parquet 29187689 / 29137726 / +0.2% 40168655 / 41443275 / -3.1% 0.73 / 0.70 / +3.4%
tpcds_q69/duckdb:parquet 30357420 / 28692096 / +5.8% 39122567 / 38715566 / +1.1% 0.78 / 0.74 / +4.7%
tpcds_q70/duckdb:parquet 16137754 / 16670018 / -3.2% 25075245 / 23437498 / +7.0% 0.64 / 0.71 / -9.5%
tpcds_q71/duckdb:parquet 14637476 / 14704038 / -0.5% 19929558 / 21030240 / -5.2% 0.73 / 0.70 / +5.0%
tpcds_q72/duckdb:parquet 81680342 / 81686392 / -0.0% 85890934 / 87243966 / -1.6% 0.95 / 0.94 / +1.6%
tpcds_q73/duckdb:parquet 13397936 / 14129028 / -5.2% 19271397 / 19740562 / -2.4% 0.70 / 0.72 / -2.9%
tpcds_q74/duckdb:parquet 97942089 / 98355589 / -0.4% 103069771 / 107289144 / -3.9% 0.95 / 0.92 / +3.7%
tpcds_q75/duckdb:parquet 39770373 / 40463638 / -1.7% 50091047 / 51586314 / -2.9% 0.79 / 0.78 / +1.2%
tpcds_q76/duckdb:parquet 13726271 / 13622006 / +0.8% 19818847 / 20926341 / -5.3% 0.69 / 0.65 / +6.4%
tpcds_q77/duckdb:parquet 16736306 / 16957676 / -1.3% 24699186 / 25715460 / -4.0% 0.68 / 0.66 / +2.8%
tpcds_q78/duckdb:parquet 48028685 / 48387968 / -0.7% 52501034 / 56453157 / -7.0% 0.91 / 0.86 / +6.7%
tpcds_q79/duckdb:parquet 20400776 / 20699832 / -1.4% 28501256 / 29095160 / -2.0% 0.72 / 0.71 / +0.6%
tpcds_q80/duckdb:parquet 31535340 / 31281479 / +0.8% 39582892 / 41498471 / -4.6% 0.80 / 0.75 / +5.7%
tpcds_q81/duckdb:parquet 29645955 / 32638552 / -9.2% 39166591 / 41879922 / -6.5% 0.76 / 0.78 / -2.9%
tpcds_q82/duckdb:parquet 13488963 / 12695620 / +6.2% 19386382 / 19497599 / -0.6% 0.70 / 0.65 / +6.9%
tpcds_q83/duckdb:parquet 15675684 / 15832392 / -1.0% 21112898 / 24098081 / -12.4% 🟢 0.74 / 0.66 / +13.0%
tpcds_q84/duckdb:parquet 17472813 / 17717862 / -1.4% 23502178 / 23368985 / +0.6% 0.74 / 0.76 / -1.9%
tpcds_q85/duckdb:parquet 34559234 / 34697022 / -0.4% 45055635 / 46403260 / -2.9% 0.77 / 0.75 / +2.6%
tpcds_q86/duckdb:parquet 10882115 / 11189046 / -2.7% 15599635 / 15693063 / -0.6% 0.70 / 0.71 / -2.2%
tpcds_q87/duckdb:parquet 28263163 / 28242314 / +0.1% 32386524 / 32270725 / +0.4% 0.87 / 0.88 / -0.3%
tpcds_q88/duckdb:parquet 27204086 / 28998502 / -6.2% 35355947 / 37228099 / -5.0% 0.77 / 0.78 / -1.2%
tpcds_q89/duckdb:parquet 12554862 / 12934968 / -2.9% 18432785 / 18870917 / -2.3% 0.68 / 0.69 / -0.6%
tpcds_q90/duckdb:parquet 9645265 / 6901044 / +39.8% 🔴 11023451 / 11357626 / -2.9% 0.87 / 0.61 / +44.0%
tpcds_q91/duckdb:parquet 20771064 / 21125577 / -1.7% 29723435 / 29212329 / +1.7% 0.70 / 0.72 / -3.4%
tpcds_q92/duckdb:parquet 11306300 / 11638500 / -2.9% 18024603 / 19249050 / -6.4% 0.63 / 0.60 / +3.7%
tpcds_q93/duckdb:parquet 21244330 / 21497720 / -1.2% 28537743 / 29063193 / -1.8% 0.74 / 0.74 / +0.6%
tpcds_q94/duckdb:parquet 15779898 / 15951954 / -1.1% 24203636 / 25130072 / -3.7% 0.65 / 0.63 / +2.7%
tpcds_q95/duckdb:parquet 90015040 / 90274468 / -0.3% 95648439 / 98618013 / -3.0% 0.94 / 0.92 / +2.8%
tpcds_q96/duckdb:parquet 6914058 / 6967485 / -0.8% 10885479 / 11146382 / -2.3% 0.64 / 0.63 / +1.6%
tpcds_q97/duckdb:parquet 26826611 / 26095680 / +2.8% 32131047 / 32149936 / -0.1% 0.83 / 0.81 / +2.9%
tpcds_q98/duckdb:parquet 14743157 / 15132730 / -2.6% 21481844 / 21956848 / -2.2% 0.69 / 0.69 / -0.4%
tpcds_q99/duckdb:parquet 17207099 / 17379173 / -1.0% 21153688 / 21278251 / -0.6% 0.81 / 0.82 / -0.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.971x ➖
Parquet (geomean): hot 0.990x ➖ · cold 0.984x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9026444 / 9038804 / -0.1% 9511595 / 9335600 / +1.9% 0.95 / 0.97 / -2.0%
statpopgen_q01/duckdb:vortex-file-compressed 10089238 / 10326478 / -2.3% 13440661 / 13949602 / -3.6% 0.75 / 0.74 / +1.4%
statpopgen_q02/duckdb:vortex-file-compressed 304094218 / 305036452 / -0.3% 348123390 / 341720344 / +1.9% 0.87 / 0.89 / -2.1%
statpopgen_q03/duckdb:vortex-file-compressed 817469487 / 819316778 / -0.2% 819154695 / 821545611 / -0.3% 1.00 / 1.00 / +0.1%
statpopgen_q04/duckdb:vortex-file-compressed 818184007 / 816876060 / +0.2% 835546981 / 823517158 / +1.5% 0.98 / 0.99 / -1.3%
statpopgen_q05/duckdb:vortex-file-compressed 319684366 / 323276002 / -1.1% 343188800 / 363785622 / -5.7% 0.93 / 0.89 / +4.8%
statpopgen_q06/duckdb:vortex-file-compressed 1147702186 / 1144825629 / +0.3% 1166422776 / 1143505901 / +2.0% 0.98 / 1.00 / -1.7%
statpopgen_q07/duckdb:vortex-file-compressed 114459026 / 111113347 / +3.0% 128320674 / 167566873 / -23.4% 🟢 0.89 / 0.66 / +34.5%
statpopgen_q08/duckdb:vortex-file-compressed 124547754 / 122583185 / +1.6% 135036402 / 140253631 / -3.7% 0.92 / 0.87 / +5.5%
statpopgen_q09/duckdb:vortex-file-compressed 608864952 / 606142460 / +0.4% 628947816 / 622018756 / +1.1% 0.97 / 0.97 / -0.7%
statpopgen_q10/duckdb:vortex-file-compressed 1940144680 / 1908944206 / +1.6% 1884362680 / 1897653013 / -0.7% 1.03 / 1.01 / +2.4%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245883294 / 247842562 / -0.8% 244993401 / 244968793 / +0.0% 1.00 / 1.01 / -0.8%
statpopgen_q01/duckdb:parquet 302407131 / 304973634 / -0.8% 304949758 / 308824198 / -1.3% 0.99 / 0.99 / +0.4%
statpopgen_q02/duckdb:parquet 558312082 / 564037864 / -1.0% 562210700 / 569651158 / -1.3% 0.99 / 0.99 / +0.3%
statpopgen_q03/duckdb:parquet 863226006 / 855970539 / +0.8% 863779936 / 821135850 / +5.2% 1.00 / 1.04 / -4.1%
statpopgen_q04/duckdb:parquet 828337987 / 823490654 / +0.6% 838907574 / 826066084 / +1.6% 0.99 / 1.00 / -1.0%
statpopgen_q05/duckdb:parquet 556036876 / 569360059 / -2.3% 561020866 / 587492003 / -4.5% 0.99 / 0.97 / +2.3%
statpopgen_q06/duckdb:parquet 700540549 / 742281826 / -5.6% 691996270 / 739833697 / -6.5% 1.01 / 1.00 / +0.9%
statpopgen_q07/duckdb:parquet 607786182 / 606096376 / +0.3% 680650061 / 720660437 / -5.6% 0.89 / 0.84 / +6.2%
statpopgen_q08/duckdb:parquet 619999454 / 616557440 / +0.6% 685450406 / 714475238 / -4.1% 0.90 / 0.86 / +4.8%
statpopgen_q09/duckdb:parquet 806576538 / 823812556 / -2.1% 824906312 / 812463878 / +1.5% 0.98 / 1.01 / -3.6%
statpopgen_q10/duckdb:parquet 1438363560 / 1449575129 / -0.8% 1235651535 / 1267976027 / -2.5% 1.16 / 1.14 / +1.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +16.7%
Engines: DataFusion No clear signal (+26.3%, environment too noisy confidence) · DuckDB No clear signal (+7.7%, environment too noisy confidence)
Vortex (geomean): hot 0.853x ➖ · cold 0.797x ➖
Parquet (geomean): hot 0.731x ➖ · cold 0.727x ➖
Shifts: Parquet (control) -26.9% · Median polish -17.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.849x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 37405465 / 58733012 / -36.3% 🟢 109141137 / 189277414 / -42.3% 🟢 0.34 / 0.31 / +10.4%
fineweb_q01/datafusion:vortex-file-compressed 422710049 / 478461094 / -11.7% 822921947 / 849111286 / -3.1% 0.51 / 0.56 / -8.8%
fineweb_q02/datafusion:vortex-file-compressed 431997886 / 614315594 / -29.7% 608767830 / 1032258037 / -41.0% 🟢 0.71 / 0.60 / +19.2%
fineweb_q03/datafusion:vortex-file-compressed 603444851 / 719079159 / -16.1% 856718656 / 1251781142 / -31.6% 🟢 0.70 / 0.57 / +22.6%
fineweb_q04/datafusion:vortex-file-compressed 472602950 / 596201641 / -20.7% 423049154 / 627566732 / -32.6% 🟢 1.12 / 0.95 / +17.6%
fineweb_q05/datafusion:vortex-file-compressed 471043221 / 504675300 / -6.7% 463870214 / 650475709 / -28.7% 1.02 / 0.78 / +30.9%
fineweb_q06/datafusion:vortex-file-compressed 1050232810 / 1151396020 / -8.8% 914493493 / 1035194860 / -11.7% 1.15 / 1.11 / +3.3%
fineweb_q07/datafusion:vortex-file-compressed 774780812 / 704806220 / +9.9% 575832289 / 698288514 / -17.5% 1.35 / 1.01 / +33.3%
fineweb_q08/datafusion:vortex-file-compressed 305001244 / 328389980 / -7.1% 356577979 / 319102615 / +11.7% 0.86 / 1.03 / -16.9%
datafusion / parquet / ns (0.672x ✅, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 508530541 / 1263853478 / -59.8% 🟢 955291265 / 1682390182 / -43.2% 🟢 0.53 / 0.75 / -29.1%
fineweb_q01/datafusion:parquet 1201908778 / 1831010188 / -34.4% 🟢 779414931 / 1082114263 / -28.0% 1.54 / 1.69 / -8.9%
fineweb_q02/datafusion:parquet 1071093043 / 1621176212 / -33.9% 🟢 1029162801 / 1608935868 / -36.0% 🟢 1.04 / 1.01 / +3.3%
fineweb_q03/datafusion:parquet 1241505332 / 1701149368 / -27.0% 1096501142 / 1721070495 / -36.3% 🟢 1.13 / 0.99 / +14.6%
fineweb_q04/datafusion:parquet 973571976 / 1549590593 / -37.2% 🟢 1418186097 / 1376642043 / +3.0% 0.69 / 1.13 / -39.0%
fineweb_q05/datafusion:parquet 1485323522 / 1726719246 / -14.0% 1166241317 / 1831537410 / -36.3% 🟢 1.27 / 0.94 / +35.1%
fineweb_q06/datafusion:parquet 1132542870 / 1433584158 / -21.0% 1119266815 / 1878907043 / -40.4% 🟢 1.01 / 0.76 / +32.6%
fineweb_q07/datafusion:parquet 1320570144 / 1620155244 / -18.5% 1462572248 / 1617595400 / -9.6% 0.90 / 1.00 / -9.9%
fineweb_q08/datafusion:parquet 1137044608 / 1805104420 / -37.0% 🟢 1083820425 / 1376937864 / -21.3% 1.05 / 1.31 / -20.0%
duckdb / vortex-file-compressed / ns (0.857x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 56580106 / 71309570 / -20.7% 58463580 / 66786825 / -12.5% 0.97 / 1.07 / -9.4%
fineweb_q01/duckdb:vortex-file-compressed 400494180 / 597358852 / -33.0% 🟢 485655839 / 832205651 / -41.6% 🟢 0.82 / 0.72 / +14.9%
fineweb_q02/duckdb:vortex-file-compressed 648283837 / 813077977 / -20.3% 615805195 / 1106731648 / -44.4% 🟢 1.05 / 0.73 / +43.3%
fineweb_q03/duckdb:vortex-file-compressed 1155679248 / 985970052 / +17.2% 1369634097 / 1657822080 / -17.4% 0.84 / 0.59 / +41.9%
fineweb_q04/duckdb:vortex-file-compressed 1062598158 / 1112932140 / -4.5% 1228810123 / 1109527693 / +10.8% 0.86 / 1.00 / -13.8%
fineweb_q05/duckdb:vortex-file-compressed 970969608 / 1060569506 / -8.4% 975610413 / 1105818390 / -11.8% 1.00 / 0.96 / +3.8%
fineweb_q06/duckdb:vortex-file-compressed 1226001000 / 1397051708 / -12.2% 1213535736 / 1277928454 / -5.0% 1.01 / 1.09 / -7.6%
fineweb_q07/duckdb:vortex-file-compressed 1016363411 / 1081142374 / -6.0% 1000182231 / 1098094269 / -8.9% 1.02 / 0.98 / +3.2%
fineweb_q08/duckdb:vortex-file-compressed 441686014 / 634293340 / -30.4% 🟢 566632739 / 585238146 / -3.2% 0.78 / 1.08 / -28.1%
duckdb / parquet / ns (0.796x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 501241490 / 641741132 / -21.9% 578376549 / 836717230 / -30.9% 🟢 0.87 / 0.77 / +13.0%
fineweb_q01/duckdb:parquet 711049120 / 835912111 / -14.9% 686282387 / 891848333 / -23.0% 1.04 / 0.94 / +10.5%
fineweb_q02/duckdb:parquet 768996476 / 806792396 / -4.7% 618299066 / 723279162 / -14.5% 1.24 / 1.12 / +11.5%
fineweb_q03/duckdb:parquet 1614000364 / 2011392162 / -19.8% 1575069544 / 2074208163 / -24.1% 1.02 / 0.97 / +5.7%
fineweb_q04/duckdb:parquet 838356689 / 1091880596 / -23.2% 958001747 / 1018356867 / -5.9% 0.88 / 1.07 / -18.4%
fineweb_q05/duckdb:parquet 1058288074 / 1260605077 / -16.0% 1274218626 / 1580701920 / -19.4% 0.83 / 0.80 / +4.1%
fineweb_q06/duckdb:parquet 1775808586 / 2632051222 / -32.5% 🟢 1684354182 / 2320077264 / -27.4% 1.05 / 1.13 / -7.1%
fineweb_q07/duckdb:parquet 1187668333 / 1624538168 / -26.9% 1141601555 / 2117419927 / -46.1% 🟢 1.04 / 0.77 / +35.6%
fineweb_q08/duckdb:parquet 565490954 / 714472206 / -20.9% 638533953 / 952431464 / -33.0% 🟢 0.89 / 0.75 / +18.1%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 62f28454 vs base 133aacdb
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +16.8%
Engines: DataFusion No clear signal (+18.6%, environment too noisy confidence) · DuckDB No clear signal (+15.1%, environment too noisy confidence)
Vortex (geomean): hot 0.965x ➖ · cold 0.952x ➖
Parquet (geomean): hot 0.826x ➖ · cold 0.844x ➖
Shifts: Parquet (control) -17.4% · Median polish -11.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.974x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 214596999 / 279963696 / -23.3% 824196177 / 934079194 / -11.8% 0.26 / 0.30 / -13.1%
tpch_q02/datafusion:vortex-file-compressed 471223423 / 331363758 / +42.2% 🔴 879441048 / 730973144 / +20.3% 0.54 / 0.45 / +18.2%
tpch_q03/datafusion:vortex-file-compressed 413276806 / 467859705 / -11.7% 1351420350 / 1552188927 / -12.9% 0.31 / 0.30 / +1.5%
tpch_q04/datafusion:vortex-file-compressed 216746215 / 199659596 / +8.6% 385297196 / 432223544 / -10.9% 0.56 / 0.46 / +21.8%
tpch_q05/datafusion:vortex-file-compressed 476960856 / 470685662 / +1.3% 677281265 / 902914000 / -25.0% 0.70 / 0.52 / +35.1%
tpch_q06/datafusion:vortex-file-compressed 281391267 / 362403572 / -22.4% 444827880 / 554840819 / -19.8% 0.63 / 0.65 / -3.2%
tpch_q07/datafusion:vortex-file-compressed 428891267 / 480323460 / -10.7% 545634344 / 791251105 / -31.0% 🟢 0.79 / 0.61 / +29.5%
tpch_q08/datafusion:vortex-file-compressed 445629090 / 606407498 / -26.5% 711644591 / 688958586 / +3.3% 0.63 / 0.88 / -28.9%
tpch_q09/datafusion:vortex-file-compressed 454055816 / 414640749 / +9.5% 585202385 / 522653880 / +12.0% 0.78 / 0.79 / -2.2%
tpch_q10/datafusion:vortex-file-compressed 408907480 / 441800179 / -7.4% 559888787 / 497233586 / +12.6% 0.73 / 0.89 / -17.8%
tpch_q11/datafusion:vortex-file-compressed 302246344 / 304878686 / -0.9% 476275326 / 414373575 / +14.9% 0.63 / 0.74 / -13.7%
tpch_q12/datafusion:vortex-file-compressed 442302671 / 458789112 / -3.6% 781935652 / 606151028 / +29.0% 0.57 / 0.76 / -25.3%
tpch_q13/datafusion:vortex-file-compressed 136737276 / 155947082 / -12.3% 459416910 / 361238939 / +27.2% 0.30 / 0.43 / -31.1%
tpch_q14/datafusion:vortex-file-compressed 203214366 / 273770723 / -25.8% 383542487 / 386522485 / -0.8% 0.53 / 0.71 / -25.2%
tpch_q15/datafusion:vortex-file-compressed 299721374 / 500749130 / -40.1% 🟢 594480520 / 800001352 / -25.7% 0.50 / 0.63 / -19.5%
tpch_q16/datafusion:vortex-file-compressed 232937898 / 153248913 / +52.0% 🔴 397644603 / 305784104 / +30.0% 🔴 0.59 / 0.50 / +16.9%
tpch_q17/datafusion:vortex-file-compressed 551394480 / 426757622 / +29.2% 787281313 / 932743400 / -15.6% 0.70 / 0.46 / +53.1%
tpch_q18/datafusion:vortex-file-compressed 440164814 / 366808168 / +20.0% 449448637 / 528078777 / -14.9% 0.98 / 0.69 / +41.0%
tpch_q19/datafusion:vortex-file-compressed 428837042 / 510536253 / -16.0% 620889879 / 544259293 / +14.1% 0.69 / 0.94 / -26.4%
tpch_q20/datafusion:vortex-file-compressed 378314055 / 308303262 / +22.7% 602816960 / 517097825 / +16.6% 0.63 / 0.60 / +5.3%
tpch_q21/datafusion:vortex-file-compressed 735017620 / 538121571 / +36.6% 🔴 913759240 / 672540350 / +35.9% 🔴 0.80 / 0.80 / +0.5%
tpch_q22/datafusion:vortex-file-compressed 167247177 / 201408560 / -17.0% 383533302 / 406561806 / -5.7% 0.44 / 0.50 / -12.0%
datafusion / parquet / ns (0.821x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 205137314 / 223321610 / -8.1% 527055085 / 524476894 / +0.5% 0.39 / 0.43 / -8.6%
tpch_q02/datafusion:parquet 288153677 / 344511914 / -16.4% 622249224 / 853669949 / -27.1% 0.46 / 0.40 / +14.7%
tpch_q03/datafusion:parquet 289733422 / 395625299 / -26.8% 732198273 / 964298965 / -24.1% 0.40 / 0.41 / -3.6%
tpch_q04/datafusion:parquet 173888786 / 348039812 / -50.0% 🟢 403711700 / 492008111 / -17.9% 0.43 / 0.71 / -39.1%
tpch_q05/datafusion:parquet 365503799 / 485217188 / -24.7% 472095319 / 706177807 / -33.1% 🟢 0.77 / 0.69 / +12.7%
tpch_q06/datafusion:parquet 129564106 / 181028460 / -28.4% 299811664 / 408329994 / -26.6% 0.43 / 0.44 / -2.5%
tpch_q07/datafusion:parquet 363350930 / 441368976 / -17.7% 505373723 / 687898050 / -26.5% 0.72 / 0.64 / +12.1%
tpch_q08/datafusion:parquet 445693638 / 491543273 / -9.3% 577734761 / 563844364 / +2.5% 0.77 / 0.87 / -11.5%
tpch_q09/datafusion:parquet 456883495 / 625203674 / -26.9% 699677074 / 970870595 / -27.9% 0.65 / 0.64 / +1.4%
tpch_q10/datafusion:parquet 625764630 / 569532175 / +9.9% 635435033 / 708620576 / -10.3% 0.98 / 0.80 / +22.5%
tpch_q11/datafusion:parquet 269471723 / 272332654 / -1.1% 482589318 / 482728001 / -0.0% 0.56 / 0.56 / -1.0%
tpch_q12/datafusion:parquet 224056807 / 321496770 / -30.3% 🟢 428428818 / 749751739 / -42.9% 🟢 0.52 / 0.43 / +22.0%
tpch_q13/datafusion:parquet 394482647 / 396295877 / -0.5% 593804367 / 698616392 / -15.0% 0.66 / 0.57 / +17.1%
tpch_q14/datafusion:parquet 192240840 / 202626067 / -5.1% 303026122 / 309645766 / -2.1% 0.63 / 0.65 / -3.1%
tpch_q15/datafusion:parquet 406884519 / 486145895 / -16.3% 625218404 / 689823522 / -9.4% 0.65 / 0.70 / -7.7%
tpch_q16/datafusion:parquet 110405714 / 126275170 / -12.6% 324659952 / 276191387 / +17.5% 0.34 / 0.46 / -25.6%
tpch_q17/datafusion:parquet 307703248 / 381647186 / -19.4% 454810089 / 500761645 / -9.2% 0.68 / 0.76 / -11.2%
tpch_q18/datafusion:parquet 400636585 / 540149607 / -25.8% 569981065 / 600196796 / -5.0% 0.70 / 0.90 / -21.9%
tpch_q19/datafusion:parquet 202547009 / 228873692 / -11.5% 411315710 / 381080908 / +7.9% 0.49 / 0.60 / -18.0%
tpch_q20/datafusion:parquet 278775618 / 324465890 / -14.1% 408762089 / 514526955 / -20.6% 0.68 / 0.63 / +8.1%
tpch_q21/datafusion:parquet 349450499 / 468682922 / -25.4% 441052601 / 632484457 / -30.3% 🟢 0.79 / 0.74 / +6.9%
tpch_q22/datafusion:parquet 171183463 / 190084226 / -9.9% 354769351 / 355126607 / -0.1% 0.48 / 0.54 / -9.9%
duckdb / vortex-file-compressed / ns (0.955x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 208162503 / 223934063 / -7.0% 271891087 / 309759523 / -12.2% 0.77 / 0.72 / +5.9%
tpch_q02/duckdb:vortex-file-compressed 401856707 / 409873038 / -2.0% 504861275 / 468115697 / +7.8% 0.80 / 0.88 / -9.1%
tpch_q03/duckdb:vortex-file-compressed 493942823 / 520902845 / -5.2% 511032028 / 1113609471 / -54.1% 🟢 0.97 / 0.47 / +106.6%
tpch_q04/duckdb:vortex-file-compressed 321447780 / 270871861 / +18.7% 273418254 / 289822655 / -5.7% 1.18 / 0.93 / +25.8%
tpch_q05/duckdb:vortex-file-compressed 417827144 / 468950848 / -10.9% 534188354 / 546864417 / -2.3% 0.78 / 0.86 / -8.8%
tpch_q06/duckdb:vortex-file-compressed 326922700 / 374791541 / -12.8% 413818488 / 286496223 / +44.4% 🔴 0.79 / 1.31 / -39.6%
tpch_q07/duckdb:vortex-file-compressed 483887195 / 543350024 / -10.9% 554566743 / 568956837 / -2.5% 0.87 / 0.95 / -8.6%
tpch_q08/duckdb:vortex-file-compressed 651491873 / 720289001 / -9.6% 665998009 / 717408087 / -7.2% 0.98 / 1.00 / -2.6%
tpch_q09/duckdb:vortex-file-compressed 542470013 / 581290032 / -6.7% 590520218 / 508009724 / +16.2% 0.92 / 1.14 / -19.7%
tpch_q10/duckdb:vortex-file-compressed 498522215 / 535740995 / -6.9% 564268744 / 639339055 / -11.7% 0.88 / 0.84 / +5.4%
tpch_q11/duckdb:vortex-file-compressed 192665828 / 185766776 / +3.7% 215544884 / 206120942 / +4.6% 0.89 / 0.90 / -0.8%
tpch_q12/duckdb:vortex-file-compressed 406137897 / 630233912 / -35.6% 🟢 526881800 / 828174018 / -36.4% 🟢 0.77 / 0.76 / +1.3%
tpch_q13/duckdb:vortex-file-compressed 352880384 / 375680936 / -6.1% 298512422 / 391445061 / -23.7% 1.18 / 0.96 / +23.2%
tpch_q14/duckdb:vortex-file-compressed 248034833 / 286757917 / -13.5% 293058181 / 332312154 / -11.8% 0.85 / 0.86 / -1.9%
tpch_q15/duckdb:vortex-file-compressed 170327560 / 192204201 / -11.4% 177431252 / 241763545 / -26.6% 0.96 / 0.80 / +20.7%
tpch_q16/duckdb:vortex-file-compressed 247195431 / 176009360 / +40.4% 🔴 305668610 / 218119556 / +40.1% 🔴 0.81 / 0.81 / +0.2%
tpch_q17/duckdb:vortex-file-compressed 466423327 / 475386836 / -1.9% 569313758 / 512895585 / +11.0% 0.82 / 0.93 / -11.6%
tpch_q18/duckdb:vortex-file-compressed 387898463 / 368944562 / +5.1% 382651217 / 387329332 / -1.2% 1.01 / 0.95 / +6.4%
tpch_q19/duckdb:vortex-file-compressed 364713128 / 375888106 / -3.0% 445473192 / 426711240 / +4.4% 0.82 / 0.88 / -7.1%
tpch_q20/duckdb:vortex-file-compressed 403525836 / 426770230 / -5.4% 439490525 / 796860554 / -44.8% 🟢 0.92 / 0.54 / +71.4%
tpch_q21/duckdb:vortex-file-compressed 719679121 / 753257595 / -4.5% 719599077 / 958291817 / -24.9% 1.00 / 0.79 / +27.2%
tpch_q22/duckdb:vortex-file-compressed 210953818 / 197242308 / +7.0% 214327256 / 220033679 / -2.6% 0.98 / 0.90 / +9.8%
duckdb / parquet / ns (0.830x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 314688087 / 405837834 / -22.5% 333614871 / 460969606 / -27.6% 0.94 / 0.88 / +7.1%
tpch_q02/duckdb:parquet 698997390 / 694765234 / +0.6% 705138017 / 914367364 / -22.9% 0.99 / 0.76 / +30.5%
tpch_q03/duckdb:parquet 803225284 / 1048439960 / -23.4% 828899364 / 1266147482 / -34.5% 🟢 0.97 / 0.83 / +17.0%
tpch_q04/duckdb:parquet 481247474 / 801936497 / -40.0% 🟢 622641855 / 1189866678 / -47.7% 🟢 0.77 / 0.67 / +14.7%
tpch_q05/duckdb:parquet 998476982 / 1351048011 / -26.1% 1032810411 / 1669031622 / -38.1% 🟢 0.97 / 0.81 / +19.4%
tpch_q06/duckdb:parquet 323746145 / 540424974 / -40.1% 🟢 353336484 / 441726363 / -20.0% 0.92 / 1.22 / -25.1%
tpch_q07/duckdb:parquet 949398903 / 1235263253 / -23.1% 1122122102 / 1318510091 / -14.9% 0.85 / 0.94 / -9.7%
tpch_q08/duckdb:parquet 1156564910 / 1371994221 / -15.7% 1272655173 / 1605030035 / -20.7% 0.91 / 0.85 / +6.3%
tpch_q09/duckdb:parquet 1081240170 / 1219172600 / -11.3% 1205743463 / 1032916732 / +16.7% 0.90 / 1.18 / -24.0%
tpch_q10/duckdb:parquet 1037482409 / 1116403271 / -7.1% 1031375172 / 1290349637 / -20.1% 1.01 / 0.87 / +16.3%
tpch_q11/duckdb:parquet 454519089 / 468501530 / -3.0% 450709928 / 464791464 / -3.0% 1.01 / 1.01 / +0.0%
tpch_q12/duckdb:parquet 542844354 / 742690083 / -26.9% 784228241 / 720275976 / +8.9% 0.69 / 1.03 / -32.9%
tpch_q13/duckdb:parquet 791244714 / 855763551 / -7.5% 976671708 / 1315697675 / -25.8% 0.81 / 0.65 / +24.6%
tpch_q14/duckdb:parquet 512727646 / 719365752 / -28.7% 674788835 / 690449036 / -2.3% 0.76 / 1.04 / -27.1%
tpch_q15/duckdb:parquet 416577451 / 522946693 / -20.3% 418848371 / 656302321 / -36.2% 🟢 0.99 / 0.80 / +24.8%
tpch_q16/duckdb:parquet 519742747 / 515005960 / +0.9% 475536155 / 504941134 / -5.8% 1.09 / 1.02 / +7.2%
tpch_q17/duckdb:parquet 498165167 / 598625533 / -16.8% 659189008 / 651061782 / +1.2% 0.76 / 0.92 / -17.8%
tpch_q18/duckdb:parquet 662158318 / 918286630 / -27.9% 1076131551 / 818051552 / +31.5% 🔴 0.62 / 1.12 / -45.2%
tpch_q19/duckdb:parquet 605052521 / 579381374 / +4.4% 730221090 / 790497874 / -7.6% 0.83 / 0.73 / +13.1%
tpch_q20/duckdb:parquet 885700995 / 880099015 / +0.6% 840780247 / 836686610 / +0.5% 1.05 / 1.05 / +0.1%
tpch_q21/duckdb:parquet 696456791 / 897565400 / -22.4% 673531439 / 1167385198 / -42.3% 🟢 1.03 / 0.77 / +34.5%
tpch_q22/duckdb:parquet 428213063 / 405278143 / +5.7% 398682030 / 395771616 / +0.7% 1.07 / 1.02 / +4.9%

@mhk197
mhk197 marked this pull request as ready for review September 25, 2026 14:01
gatesn pushed a commit that referenced this pull request Sep 25, 2026
Supersedes #9514.

Optimization now runs only on `BoundExpression`s: callers bind first,
then optimize. This removes the optimizer-owned dtype cache, rules can
read dtypes straight off the tree, and it unblocks lambdas/variables,
which must be typed before optimization.

## Changes

- `BoundExpression::optimize` and `optimize_recursive` replace the
`Expression` versions. Traversal and the fixpoint loop are unchanged.
- `ScalarFnVTable::simplify` now takes a `&BoundExpression`, and
`simplify_untyped` is merged into it. `SimplifyCtx` and `SimplifyCache`
are removed.
- `ExpressionReduceNode` keeps its name and `reduce_expression`
dispatch, but now borrows a bound tree.
- Rules ported: binary, case_when, cast, fill_null, mask, select, zip,
and `find_between`. `GetItem::simplify_untyped` is removed because it
duplicated `GetItem::reduce`. If the rebuilt `Between` fails to
type-check, `find_between` now skips the rewrite instead of producing a
tree that fails to bind.
- Callers change from `expr.optimize_recursive(dtype)?.bind(dtype)` to
`expr.bind(dtype)?.optimize_recursive()`.
- The unbound `expr::transform::partition` is deleted. It was the last
user of the unbound optimizer and has no callers; layouts use
`bound_partition`. #9993 deletes it too, so whichever PR lands second
will have a trivial conflict.

## API changes

- `Expression::optimize(scope)` / `optimize_recursive(scope)` become
`BoundExpression::optimize()` / `optimize_recursive()`.
- `ScalarFnVTable::simplify(options, &BoundExpression)` replaces
`simplify(options, &Expression, &dyn SimplifyCtx)` and
`simplify_untyped`.
- `ExpressionReduceNode::new(&BoundExpression)` drops the scope
argument.
- `partition`, `partition_annotations` and `PartitionedExpr` are
removed.

## Behavior

I checked this with a differential corpus of 30,018 generated
expressions targeting every rule, comparing develop's `optimize + bind`
against the new `bind + optimize` and evaluating before/after on data:

- 28,878 produce identical output.
- 131 panicked on develop (`Mask` simplify called `vortex_expect` on a
null mask literal) and now fail cleanly at bind time.
- 941 have ill-typed inputs that develop accepted only because a rule
removed the ill-typed subtree before binding. They now error.
- 68 differ because of a develop bug. `SimplifyCache` keys dtypes by
`Expression`, and `Scalar` equality ignores nullability, so develop
reused the wrong cached dtype and dropped `fill_null`s it should have
kept.

No well-typed expression regressed.

Existing bugs found, not addressed here:
- The `CASE WHEN`→`fill_null` rewrite is unexecutable for utf8.
- `select([], nullable_struct)` drops the struct's validity.
- `CaseWhen` execution can return a result that is non-nullable when its
dtype is nullable.
- `and`/`or`/`zip` literal rules can change the result's nullability.

## Performance

The optimizer benchmarks bind outside the timed loop and measure only
`optimize_recursive`, the same work develop's benchmarks time. Local
medians:

| case | develop | this PR |
|---|---|---|
| `or_chain` 200 | 17.5 µs | 18.6 µs |
| `balanced_or` 64–256 ids | 6.2–23.0 µs | 6.1–23.5 µs |
| `balanced_or` 1 id | 0.79 µs | 0.94 µs |
| `in_list` | ~0.77 µs | ~0.95 µs |

Small predicates pay a constant ~0.15–0.2 µs in the optimizer, almost
all of it in `find_between`, which now type-checks the `and`/`Between`
nodes it rebuilds (0.56 µs vs 0.34 µs). Across the full `bind +
optimize` pipeline that callers run, the gap is ~0.3–0.45 µs, because
binding also types the comparisons `find_between` later replaces.
Closing it would need an unchecked `BoundExpression` constructor. Open
question.

## Testing

- `cargo nextest run -p vortex-array -p vortex-layout -p vortex-file -p
vortex -p vortex-datafusion -p vortex-duckdb`
- `cargo test --doc -p vortex -p vortex-array`
- `cargo clippy --all-targets --all-features -- -D warnings` on all
changed crates and `fuzz/file_io`
- `cargo check --workspace --all-targets`

Not run: Python tests. `vortex-cuda-ffi` was not type-checked because it
is compiled out on macOS.

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Delete obsolete unbound partitioning, labeling, and field-reference
collection, and remove their unused supporting APIs. Keep the active
bound analysis and shared traversal paths, adapting existing tests to
the surviving APIs.

Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@mhk197
mhk197 force-pushed the mk/remove-unused-unbound-expressions branch from 4fbac1f to 33b0e9f Compare September 25, 2026 18:16
@mhk197
mhk197 requested a review from gatesn September 25, 2026 18:16
@gatesn
gatesn enabled auto-merge (squash) September 25, 2026 18:17
@gatesn
gatesn merged commit d8e45e0 into develop Sep 25, 2026
90 checks passed
@gatesn
gatesn deleted the mk/remove-unused-unbound-expressions branch September 25, 2026 18:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/break A breaking API change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants