Skip to content

Speed up RunEnd filter with a rank directory and POPCNT dispatch - #10575

Merged
connortsui20 merged 8 commits into
developfrom
claude/exciting-heisenberg-qvdbm8
Nov 4, 2026
Merged

connortsui20 merged 8 commits into
developfrom
claude/exciting-heisenberg-qvdbm8

Conversation

@robert3005

@robert3005 robert3005 commented Oct 17, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Speeds up the run-preserving path of the RunEnd filter kernel, most for short runs. The old loop counted the selected rows in each run with a separate BitBuffer::count_range call, and for short runs that call's setup cost more than the counting.

Changes

  • Rank lookup instead of range counts. A filtered run end is the number of selected rows before the source run end. A small table of 64-bit mask words with running popcounts answers that with one load and one popcount per run.
  • One pass. The loop writes each new end at the current output position and moves forward only when the run has selected rows, so the ends come out compacted with no second pass.
  • POPCNT through fearless_simd. The x86-64 baseline has no popcnt, so the loop is dispatched with dispatch!(Level::new(), …). Each level gets its own copy, which also lets BitBuffer::collect_bool inline.

@codspeed

codspeed Bot commented Oct 17, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 30.02%

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚡ 16 improved benchmarks
✅ 1751 untouched benchmarks
⏩ 105 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ CPU Simulation filter_run_end[len=65536_run=4_density=0.5] 900.7 µs 465.2 µs +93.62%
⚡ CPU Simulation filter_run_end[len=16384_run=16_density=0.9] 87.1 µs 47.3 µs +84.05%
⚡ CPU Simulation filter_run_end[len=16384_run=16_density=0.5] 87.1 µs 47.4 µs +83.95%
⚡ CPU Simulation filter_run_end[len=16384_run=16_density=0.1] 89.1 µs 62 µs +43.71%
⚡ CPU Simulation filter_run_end[len=4096_run=16_density=0.9] 31.3 µs 24.5 µs +27.98%
⚡ CPU Simulation filter_run_end[len=4096_run=16_density=0.1] 30.2 µs 24.1 µs +25.21%
⚡ CPU Simulation filter_run_end[len=4096_run=16_density=0.5] 30.6 µs 24.5 µs +25.07%
⚡ CPU Simulation random_i8[0.01] 129.4 µs 105.7 µs +22.42%
⚡ CPU Simulation filter_run_end[len=65536_run=256_density=0.5] 45.7 µs 37.3 µs +22.35%
⚡ CPU Simulation bench_compare_varbin[(50000, 2)] 173.8 µs 144.8 µs +20.07%
⚡ CPU Simulation bench_compare_sliced_dict_varbinview[(9999, 10000)] 245.5 µs 217.7 µs +12.73%
⚡ CPU Simulation bench_compare_sliced_dict_varbinview[(1000, 10000)] 105.2 µs 93.4 µs +12.59%
⚡ Walltime add_constant_shapes_neon[(32768, PerRowConstant)] 16.6 µs 14.8 µs +12.47%
⚡ Walltime add_constant_shapes_neon[(32768, ConstantPerRow)] 16.7 µs 14.9 µs +12.06%
⚡ Walltime add_constant_shapes_neon[(32768, PerRowNullableConstant)] 17.3 µs 15.6 µs +11.06%
⚡ Walltime deferred_bool_avx512[16384, (Columns, NullOnlyFailure)] 297.4 µs 268.8 µs +10.62%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/exciting-heisenberg-qvdbm8 (be4460e) with develop (8d9e027)

Open in CodSpeed

Footnotes

  1. 105 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@robert3005 robert3005 added the changelog/performance A performance improvement label Oct 19, 2026
@robert3005
robert3005 force-pushed the claude/exciting-heisenberg-qvdbm8 branch 2 times, most recently from 2bf84fe to 052c8d9 Compare October 29, 2026 15:49
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs

Copy link
Copy Markdown
Contributor

want to stack this on the benchmarks?

@robert3005
robert3005 force-pushed the claude/exciting-heisenberg-qvdbm8 branch from 052c8d9 to 65b4908 Compare October 29, 2026 16:32
@robert3005
robert3005 changed the base branch from develop to rk/runend-filter-bench October 29, 2026 16:32
@robert3005
robert3005 added this pull request to stack #10981 October 29, 2026 16:32
@robert3005

Copy link
Copy Markdown
Contributor Author

here #10978

Base automatically changed from rk/runend-filter-bench to develop October 29, 2026 16:45
@robert3005
robert3005 force-pushed the claude/exciting-heisenberg-qvdbm8 branch 2 times, most recently from 010d588 to 100957c Compare October 29, 2026 17:01
@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 24638a2f vs base f32cb549
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.8%
Engines: DataFusion No clear signal (+3.4%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.986x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -1.4% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.016x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15762047 / 15063267 / +4.6% 44966331 / 43947350 / +2.3% 0.35 / 0.34 / +2.3%
tpch_q02/datafusion:vortex-file-compressed 16796520 / 16872255 / -0.4% 36289013 / 35728411 / +1.6% 0.46 / 0.47 / -2.0%
tpch_q03/datafusion:vortex-file-compressed 19567134 / 19858823 / -1.5% 50534842 / 50199021 / +0.7% 0.39 / 0.40 / -2.1%
tpch_q04/datafusion:vortex-file-compressed 10286964 / 11176326 / -8.0% 35865451 / 34130806 / +5.1% 0.29 / 0.33 / -12.4%
tpch_q05/datafusion:vortex-file-compressed 37143444 / 37260442 / -0.3% 69453323 / 67860115 / +2.3% 0.53 / 0.55 / -2.6%
tpch_q06/datafusion:vortex-file-compressed 5929153 / 4134934 / +43.4% 🔴 30634631 / 28418734 / +7.8% 0.19 / 0.15 / +33.0%
tpch_q07/datafusion:vortex-file-compressed 52181982 / 51561012 / +1.2% 78213912 / 76882929 / +1.7% 0.67 / 0.67 / -0.5%
tpch_q08/datafusion:vortex-file-compressed 51716387 / 51663604 / +0.1% 84639432 / 82331906 / +2.8% 0.61 / 0.63 / -2.6%
tpch_q09/datafusion:vortex-file-compressed 47782307 / 47386907 / +0.8% 81401767 / 79544582 / +2.3% 0.59 / 0.60 / -1.5%
tpch_q10/datafusion:vortex-file-compressed 17111277 / 17273119 / -0.9% 50189928 / 50451184 / -0.5% 0.34 / 0.34 / -0.4%
tpch_q11/datafusion:vortex-file-compressed 14298692 / 13955198 / +2.5% 35029084 / 34947538 / +0.2% 0.41 / 0.40 / +2.2%
tpch_q12/datafusion:vortex-file-compressed 18406629 / 18485330 / -0.4% 42868419 / 44102270 / -2.8% 0.43 / 0.42 / +2.4%
tpch_q13/datafusion:vortex-file-compressed 19200876 / 19719038 / -2.6% 40316215 / 38404657 / +5.0% 0.48 / 0.51 / -7.2%
tpch_q14/datafusion:vortex-file-compressed 14598486 / 14711351 / -0.8% 40473287 / 38132006 / +6.1% 0.36 / 0.39 / -6.5%
tpch_q15/datafusion:vortex-file-compressed 18795637 / 18587848 / +1.1% 44942051 / 44435794 / +1.1% 0.42 / 0.42 / -0.0%
tpch_q16/datafusion:vortex-file-compressed 18139040 / 18093139 / +0.3% 42636915 / 38638176 / +10.3% 🔴 0.43 / 0.47 / -9.1%
tpch_q17/datafusion:vortex-file-compressed 28495689 / 27988166 / +1.8% 61055373 / 60277497 / +1.3% 0.47 / 0.46 / +0.5%
tpch_q18/datafusion:vortex-file-compressed 35502961 / 35728601 / -0.6% 59623472 / 60166851 / -0.9% 0.60 / 0.59 / +0.3%
tpch_q19/datafusion:vortex-file-compressed 12066297 / 11727739 / +2.9% 39429613 / 38901937 / +1.4% 0.31 / 0.30 / +1.5%
tpch_q20/datafusion:vortex-file-compressed 20374530 / 20102425 / +1.4% 46646366 / 45972423 / +1.5% 0.44 / 0.44 / -0.1%
tpch_q21/datafusion:vortex-file-compressed 39347523 / 39522937 / -0.4% 72620961 / 74459374 / -2.5% 0.54 / 0.53 / +2.1%
tpch_q22/datafusion:vortex-file-compressed 10710703 / 10891968 / -1.7% 31705026 / 30439545 / +4.2% 0.34 / 0.36 / -5.6%
datafusion / parquet / ns (0.983x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71516368 / 72226853 / -1.0% 89777364 / 89771657 / +0.0% 0.80 / 0.80 / -1.0%
tpch_q02/datafusion:parquet 75665827 / 75918259 / -0.3% 95324749 / 93721597 / +1.7% 0.79 / 0.81 / -2.0%
tpch_q03/datafusion:parquet 82160520 / 83501840 / -1.6% 106237057 / 103655273 / +2.5% 0.77 / 0.81 / -4.0%
tpch_q04/datafusion:parquet 39431477 / 40358472 / -2.3% 59530420 / 58061168 / +2.5% 0.66 / 0.70 / -4.7%
tpch_q05/datafusion:parquet 109981744 / 112280839 / -2.0% 139868108 / 138604348 / +0.9% 0.79 / 0.81 / -2.9%
tpch_q06/datafusion:parquet 31181573 / 32148079 / -3.0% 49415521 / 49051178 / +0.7% 0.63 / 0.66 / -3.7%
tpch_q07/datafusion:parquet 112246757 / 115671611 / -3.0% 140345132 / 140445218 / -0.1% 0.80 / 0.82 / -2.9%
tpch_q08/datafusion:parquet 117274793 / 119011671 / -1.5% 144467294 / 145109105 / -0.4% 0.81 / 0.82 / -1.0%
tpch_q09/datafusion:parquet 137542960 / 139972679 / -1.7% 167082453 / 168461344 / -0.8% 0.82 / 0.83 / -0.9%
tpch_q10/datafusion:parquet 103295950 / 106304343 / -2.8% 127734907 / 133399483 / -4.2% 0.81 / 0.80 / +1.5%
tpch_q11/datafusion:parquet 62670551 / 61232267 / +2.3% 83536303 / 81875539 / +2.0% 0.75 / 0.75 / +0.3%
tpch_q12/datafusion:parquet 63272153 / 65320455 / -3.1% 87279502 / 86644993 / +0.7% 0.72 / 0.75 / -3.8%
tpch_q13/datafusion:parquet 143636109 / 147177527 / -2.4% 161783025 / 168316439 / -3.9% 0.89 / 0.87 / +1.5%
tpch_q14/datafusion:parquet 46989665 / 47714447 / -1.5% 73159884 / 71099188 / +2.9% 0.64 / 0.67 / -4.3%
tpch_q15/datafusion:parquet 74375682 / 76022736 / -2.2% 93080235 / 97496073 / -4.5% 0.80 / 0.78 / +2.5%
tpch_q16/datafusion:parquet 43585472 / 43463722 / +0.3% 60984002 / 63759778 / -4.4% 0.71 / 0.68 / +4.8%
tpch_q17/datafusion:parquet 122314181 / 124458658 / -1.7% 147803144 / 148394932 / -0.4% 0.83 / 0.84 / -1.3%
tpch_q18/datafusion:parquet 120831293 / 123135395 / -1.9% 142741865 / 145847089 / -2.1% 0.85 / 0.84 / +0.3%
tpch_q19/datafusion:parquet 57283205 / 57716128 / -0.8% 83086284 / 83144542 / -0.1% 0.69 / 0.69 / -0.7%
tpch_q20/datafusion:parquet 78397810 / 80248748 / -2.3% 104408017 / 103853935 / +0.5% 0.75 / 0.77 / -2.8%
tpch_q21/datafusion:parquet 113549300 / 116664144 / -2.7% 138594323 / 142840531 / -3.0% 0.82 / 0.82 / +0.3%
tpch_q22/datafusion:parquet 50760747 / 52106189 / -2.6% 69743062 / 67341292 / +3.6% 0.73 / 0.77 / -5.9%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9330780 / 9358604 / -0.3% 20382396 / 20565969 / -0.9% 0.46 / 0.46 / +0.6%
tpch_q02/duckdb:vortex-file-compressed 15142378 / 15158291 / -0.1% 24566101 / 25533796 / -3.8% 0.62 / 0.59 / +3.8%
tpch_q03/duckdb:vortex-file-compressed 18580677 / 18952631 / -2.0% 33527266 / 34317238 / -2.3% 0.55 / 0.55 / +0.3%
tpch_q04/duckdb:vortex-file-compressed 12244843 / 12711532 / -3.7% 25736921 / 26078148 / -1.3% 0.48 / 0.49 / -2.4%
tpch_q05/duckdb:vortex-file-compressed 20442628 / 20683070 / -1.2% 36902111 / 37231629 / -0.9% 0.55 / 0.56 / -0.3%
tpch_q06/duckdb:vortex-file-compressed 4867742 / 4688059 / +3.8% 14824715 / 14728379 / +0.7% 0.33 / 0.32 / +3.2%
tpch_q07/duckdb:vortex-file-compressed 23867807 / 24093161 / -0.9% 41339107 / 38621339 / +7.0% 0.58 / 0.62 / -7.4%
tpch_q08/duckdb:vortex-file-compressed 20887631 / 21676878 / -3.6% 38533264 / 37817090 / +1.9% 0.54 / 0.57 / -5.4%
tpch_q09/duckdb:vortex-file-compressed 23119485 / 22054363 / +4.8% 38915249 / 40048961 / -2.8% 0.59 / 0.55 / +7.9%
tpch_q10/duckdb:vortex-file-compressed 22744738 / 22907764 / -0.7% 38875662 / 40292129 / -3.5% 0.59 / 0.57 / +2.9%
tpch_q11/duckdb:vortex-file-compressed 7997972 / 8196160 / -2.4% 17404182 / 19436818 / -10.5% 🟢 0.46 / 0.42 / +9.0%
tpch_q12/duckdb:vortex-file-compressed 14645883 / 14638543 / +0.1% 26836517 / 26832843 / +0.0% 0.55 / 0.55 / +0.0%
tpch_q13/duckdb:vortex-file-compressed 19535767 / 19782473 / -1.2% 32942732 / 31855468 / +3.4% 0.59 / 0.62 / -4.5%
tpch_q14/duckdb:vortex-file-compressed 11314135 / 11577536 / -2.3% 24390572 / 24812688 / -1.7% 0.46 / 0.47 / -0.6%
tpch_q15/duckdb:vortex-file-compressed 8551110 / 8780841 / -2.6% 21004936 / 22302571 / -5.8% 0.41 / 0.39 / +3.4%
tpch_q16/duckdb:vortex-file-compressed 16547103 / 16678356 / -0.8% 23950732 / 22919152 / +4.5% 0.69 / 0.73 / -5.1%
tpch_q17/duckdb:vortex-file-compressed 12408317 / 12450577 / -0.3% 27389363 / 28068095 / -2.4% 0.45 / 0.44 / +2.1%
tpch_q18/duckdb:vortex-file-compressed 24307860 / 23765061 / +2.3% 34380460 / 35385911 / -2.8% 0.71 / 0.67 / +5.3%
tpch_q19/duckdb:vortex-file-compressed 11935707 / 12117164 / -1.5% 26837499 / 26928859 / -0.3% 0.44 / 0.45 / -1.2%
tpch_q20/duckdb:vortex-file-compressed 14103640 / 14166298 / -0.4% 29907580 / 32182646 / -7.1% 0.47 / 0.44 / +7.1%
tpch_q21/duckdb:vortex-file-compressed 36926104 / 37162639 / -0.6% 58231331 / 56195989 / +3.6% 0.63 / 0.66 / -4.1%
tpch_q22/duckdb:vortex-file-compressed 16730399 / 17058605 / -1.9% 26575439 / 25965875 / +2.3% 0.63 / 0.66 / -4.2%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47625197 / 48317262 / -1.4% 53773304 / 54797145 / -1.9% 0.89 / 0.88 / +0.4%
tpch_q02/duckdb:parquet 48353499 / 48806479 / -0.9% 55044429 / 55211668 / -0.3% 0.88 / 0.88 / -0.6%
tpch_q03/duckdb:parquet 60003567 / 60802085 / -1.3% 68949897 / 70252078 / -1.9% 0.87 / 0.87 / +0.6%
tpch_q04/duckdb:parquet 34629968 / 35134525 / -1.4% 43244147 / 43657074 / -0.9% 0.80 / 0.80 / -0.5%
tpch_q05/duckdb:parquet 66886670 / 67468939 / -0.9% 77286481 / 78238036 / -1.2% 0.87 / 0.86 / +0.4%
tpch_q06/duckdb:parquet 21441258 / 21981487 / -2.5% 27232977 / 28543811 / -4.6% 0.79 / 0.77 / +2.2%
tpch_q07/duckdb:parquet 63783527 / 64434034 / -1.0% 72490341 / 74837492 / -3.1% 0.88 / 0.86 / +2.2%
tpch_q08/duckdb:parquet 75688641 / 76285363 / -0.8% 86378122 / 87520668 / -1.3% 0.88 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 108110890 / 107925971 / +0.2% 120132699 / 120323111 / -0.2% 0.90 / 0.90 / +0.3%
tpch_q10/duckdb:parquet 105686803 / 106411933 / -0.7% 118043922 / 118994019 / -0.8% 0.90 / 0.89 / +0.1%
tpch_q11/duckdb:parquet 29355183 / 29808458 / -1.5% 34911289 / 35328484 / -1.2% 0.84 / 0.84 / -0.3%
tpch_q12/duckdb:parquet 37164743 / 37847801 / -1.8% 44007012 / 45193625 / -2.6% 0.84 / 0.84 / +0.8%
tpch_q13/duckdb:parquet 175305844 / 175783286 / -0.3% 181992208 / 184117399 / -1.2% 0.96 / 0.95 / +0.9%
tpch_q14/duckdb:parquet 42365492 / 42962386 / -1.4% 51644600 / 51148702 / +1.0% 0.82 / 0.84 / -2.3%
tpch_q15/duckdb:parquet 32535463 / 32887884 / -1.1% 41090529 / 41322922 / -0.6% 0.79 / 0.80 / -0.5%
tpch_q16/duckdb:parquet 47203770 / 48003648 / -1.7% 52758665 / 53827342 / -2.0% 0.89 / 0.89 / +0.3%
tpch_q17/duckdb:parquet 47849247 / 48527815 / -1.4% 57305918 / 58128909 / -1.4% 0.83 / 0.83 / +0.0%
tpch_q18/duckdb:parquet 73714892 / 74648175 / -1.3% 78941918 / 82608398 / -4.4% 0.93 / 0.90 / +3.3%
tpch_q19/duckdb:parquet 48979911 / 48778792 / +0.4% 60513128 / 57276887 / +5.7% 0.81 / 0.85 / -5.0%
tpch_q20/duckdb:parquet 63177002 / 63764359 / -0.9% 74319517 / 74394672 / -0.1% 0.85 / 0.86 / -0.8%
tpch_q21/duckdb:parquet 106385766 / 107303435 / -0.9% 115417580 / 116748479 / -1.1% 0.92 / 0.92 / +0.3%
tpch_q22/duckdb:parquet 50466423 / 51117480 / -1.3% 58754290 / 59382704 / -1.1% 0.86 / 0.86 / -0.2%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 24638a2f vs base f32cb549
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.036x ➖
Parquet (geomean): hot 0.987x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -1.3% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93411146 / 89356257 / +4.5% 161707015 / 152601529 / +6.0% 0.58 / 0.59 / -1.3%
tpch_q02/datafusion:vortex-file-compressed 65981374 / 64981351 / +1.5% 99161373 / 94511503 / +4.9% 0.67 / 0.69 / -3.2%
tpch_q03/datafusion:vortex-file-compressed 62489904 / 64954026 / -3.8% 115793418 / 113823364 / +1.7% 0.54 / 0.57 / -5.4%
tpch_q04/datafusion:vortex-file-compressed 33601426 / 34589325 / -2.9% 76396222 / 68656997 / +11.3% 🔴 0.44 / 0.50 / -12.7%
tpch_q05/datafusion:vortex-file-compressed 117200407 / 116780008 / +0.4% 174975790 / 180798394 / -3.2% 0.67 / 0.65 / +3.7%
tpch_q06/datafusion:vortex-file-compressed 9921994 / 10580181 / -6.2% 57564691 / 56542993 / +1.8% 0.17 / 0.19 / -7.9%
tpch_q07/datafusion:vortex-file-compressed 132755267 / 134705420 / -1.4% 203179074 / 187743499 / +8.2% 0.65 / 0.72 / -8.9%
tpch_q08/datafusion:vortex-file-compressed 142044102 / 141511693 / +0.4% 217655239 / 215091926 / +1.2% 0.65 / 0.66 / -0.8%
tpch_q09/datafusion:vortex-file-compressed 183170852 / 186482073 / -1.8% 266968015 / 271404073 / -1.6% 0.69 / 0.69 / -0.1%
tpch_q10/datafusion:vortex-file-compressed 69402728 / 70962925 / -2.2% 137220081 / 134172785 / +2.3% 0.51 / 0.53 / -4.4%
tpch_q11/datafusion:vortex-file-compressed 42963423 / 42821696 / +0.3% 70046337 / 65411631 / +7.1% 0.61 / 0.65 / -6.3%
tpch_q12/datafusion:vortex-file-compressed 34910371 / 35297339 / -1.1% 79980318 / 79702921 / +0.3% 0.44 / 0.44 / -1.4%
tpch_q13/datafusion:vortex-file-compressed 46147195 / 48154321 / -4.2% 85643147 / 74745654 / +14.6% 🔴 0.54 / 0.64 / -16.4%
tpch_q14/datafusion:vortex-file-compressed 20680368 / 21241808 / -2.6% 83397799 / 85148667 / -2.1% 0.25 / 0.25 / -0.6%
tpch_q15/datafusion:vortex-file-compressed 33764642 / 33776175 / -0.0% 89797946 / 89846477 / -0.1% 0.38 / 0.38 / +0.0%
tpch_q16/datafusion:vortex-file-compressed 37097430 / 37524289 / -1.1% 65841821 / 65537255 / +0.5% 0.56 / 0.57 / -1.6%
tpch_q17/datafusion:vortex-file-compressed 177101045 / 174002451 / +1.8% 232495712 / 218467646 / +6.4% 0.76 / 0.80 / -4.4%
tpch_q18/datafusion:vortex-file-compressed 206505652 / 203557286 / +1.4% 270861549 / 273328491 / -0.9% 0.76 / 0.74 / +2.4%
tpch_q19/datafusion:vortex-file-compressed 30295111 / 30852921 / -1.8% 89069765 / 91824478 / -3.0% 0.34 / 0.34 / +1.2%
tpch_q20/datafusion:vortex-file-compressed 61192798 / 60602536 / +1.0% 118269098 / 117663391 / +0.5% 0.52 / 0.52 / +0.5%
tpch_q21/datafusion:vortex-file-compressed 177971719 / 177699051 / +0.2% 247529744 / 236936982 / +4.5% 0.72 / 0.75 / -4.1%
tpch_q22/datafusion:vortex-file-compressed 24857542 / 24958112 / -0.4% 53428535 / 51928573 / +2.9% 0.47 / 0.48 / -3.2%
datafusion / parquet / ns (0.984x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87271769 / 87468532 / -0.2% 128000359 / 125866104 / +1.7% 0.68 / 0.69 / -1.9%
tpch_q02/datafusion:parquet 175014736 / 174539027 / +0.3% 198156707 / 199943272 / -0.9% 0.88 / 0.87 / +1.2%
tpch_q03/datafusion:parquet 133730792 / 138079064 / -3.1% 177997321 / 180115900 / -1.2% 0.75 / 0.77 / -2.0%
tpch_q04/datafusion:parquet 57053692 / 59137736 / -3.5% 90636403 / 88473310 / +2.4% 0.63 / 0.67 / -5.8%
tpch_q05/datafusion:parquet 166289720 / 170288337 / -2.3% 218377003 / 221803678 / -1.5% 0.76 / 0.77 / -0.8%
tpch_q06/datafusion:parquet 36292081 / 37341875 / -2.8% 75053695 / 75096302 / -0.1% 0.48 / 0.50 / -2.8%
tpch_q07/datafusion:parquet 215295068 / 216928860 / -0.8% 273497771 / 269125250 / +1.6% 0.79 / 0.81 / -2.3%
tpch_q08/datafusion:parquet 217266704 / 221223192 / -1.8% 283004361 / 284037994 / -0.4% 0.77 / 0.78 / -1.4%
tpch_q09/datafusion:parquet 308065761 / 313915401 / -1.9% 376043580 / 371922201 / +1.1% 0.82 / 0.84 / -2.9%
tpch_q10/datafusion:parquet 312047114 / 320246603 / -2.6% 373392294 / 376673432 / -0.9% 0.84 / 0.85 / -1.7%
tpch_q11/datafusion:parquet 127573810 / 126938220 / +0.5% 153276354 / 148438552 / +3.3% 0.83 / 0.86 / -2.7%
tpch_q12/datafusion:parquet 82448078 / 84009706 / -1.9% 119898527 / 120893362 / -0.8% 0.69 / 0.69 / -1.0%
tpch_q13/datafusion:parquet 209703973 / 216405236 / -3.1% 241893508 / 245871967 / -1.6% 0.87 / 0.88 / -1.5%
tpch_q14/datafusion:parquet 86796031 / 88811840 / -2.3% 186862339 / 191709642 / -2.5% 0.46 / 0.46 / +0.3%
tpch_q15/datafusion:parquet 105801595 / 107060917 / -1.2% 154494196 / 152395718 / +1.4% 0.68 / 0.70 / -2.5%
tpch_q16/datafusion:parquet 96148451 / 96893642 / -0.8% 119133092 / 121695884 / -2.1% 0.81 / 0.80 / +1.4%
tpch_q17/datafusion:parquet 216682654 / 213148688 / +1.7% 260534335 / 255818355 / +1.8% 0.83 / 0.83 / -0.2%
tpch_q18/datafusion:parquet 267189936 / 268103859 / -0.3% 313900675 / 308917086 / +1.6% 0.85 / 0.87 / -1.9%
tpch_q19/datafusion:parquet 106482898 / 109230055 / -2.5% 164806048 / 164807384 / -0.0% 0.65 / 0.66 / -2.5%
tpch_q20/datafusion:parquet 185409096 / 189208421 / -2.0% 243221010 / 244100743 / -0.4% 0.76 / 0.78 / -1.7%
tpch_q21/datafusion:parquet 241252270 / 248303408 / -2.8% 305250921 / 308507311 / -1.1% 0.79 / 0.80 / -1.8%
tpch_q22/datafusion:parquet 149868082 / 153585255 / -2.4% 174158912 / 175914415 / -1.0% 0.86 / 0.87 / -1.4%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33492816 / 33363947 / +0.4% 68668891 / 62750032 / +9.4% 0.49 / 0.53 / -8.3%
tpch_q02/duckdb:vortex-file-compressed 28404208 / 27923325 / +1.7% 43474435 / 42892090 / +1.4% 0.65 / 0.65 / +0.4%
tpch_q03/duckdb:vortex-file-compressed 52975949 / 53175080 / -0.4% 105670042 / 96875588 / +9.1% 0.50 / 0.55 / -8.7%
tpch_q04/duckdb:vortex-file-compressed 52015259 / 51411163 / +1.2% 91194184 / 82729552 / +10.2% 🔴 0.57 / 0.62 / -8.2%
tpch_q05/duckdb:vortex-file-compressed 68953378 / 69599212 / -0.9% 109642171 / 106230812 / +3.2% 0.63 / 0.66 / -4.0%
tpch_q06/duckdb:vortex-file-compressed 15357002 / 15236980 / +0.8% 51691186 / 49944922 / +3.5% 0.30 / 0.31 / -2.6%
tpch_q07/duckdb:vortex-file-compressed 56299841 / 55161440 / +2.1% 109525238 / 103736664 / +5.6% 0.51 / 0.53 / -3.3%
tpch_q08/duckdb:vortex-file-compressed 87663448 / 88211178 / -0.6% 134757505 / 123942261 / +8.7% 0.65 / 0.71 / -8.6%
tpch_q09/duckdb:vortex-file-compressed 102901414 / 101053618 / +1.8% 157366957 / 151219334 / +4.1% 0.65 / 0.67 / -2.1%
tpch_q10/duckdb:vortex-file-compressed 95490224 / 93830561 / +1.8% 148372556 / 138412062 / +7.2% 0.64 / 0.68 / -5.1%
tpch_q11/duckdb:vortex-file-compressed 13286169 / 13852263 / -4.1% 28815636 / 29699318 / -3.0% 0.46 / 0.47 / -1.1%
tpch_q12/duckdb:vortex-file-compressed 45148326 / 45043895 / +0.2% 84600020 / 80034502 / +5.7% 0.53 / 0.56 / -5.2%
tpch_q13/duckdb:vortex-file-compressed 71673290 / 71905317 / -0.3% 100359340 / 98450704 / +1.9% 0.71 / 0.73 / -2.2%
tpch_q14/duckdb:vortex-file-compressed 28420704 / 28487587 / -0.2% 72421901 / 71877468 / +0.8% 0.39 / 0.40 / -1.0%
tpch_q15/duckdb:vortex-file-compressed 24820023 / 25268819 / -1.8% 64840417 / 59962544 / +8.1% 0.38 / 0.42 / -9.2%
tpch_q16/duckdb:vortex-file-compressed 49451503 / 48232026 / +2.5% 58235703 / 57378608 / +1.5% 0.85 / 0.84 / +1.0%
tpch_q17/duckdb:vortex-file-compressed 35012471 / 34032382 / +2.9% 68168602 / 63279347 / +7.7% 0.51 / 0.54 / -4.5%
tpch_q18/duckdb:vortex-file-compressed 105526124 / 109571782 / -3.7% 124363173 / 121902797 / +2.0% 0.85 / 0.90 / -5.6%
tpch_q19/duckdb:vortex-file-compressed 27264019 / 27804574 / -1.9% 77466944 / 73810316 / +5.0% 0.35 / 0.38 / -6.6%
tpch_q20/duckdb:vortex-file-compressed 42157429 / 41657299 / +1.2% 92502868 / 89867493 / +2.9% 0.46 / 0.46 / -1.7%
tpch_q21/duckdb:vortex-file-compressed 94132485 / 95997940 / -1.9% 150274221 / 145400895 / +3.4% 0.63 / 0.66 / -5.1%
tpch_q22/duckdb:vortex-file-compressed 32647804 / 32929886 / -0.9% 48478231 / 49364803 / -1.8% 0.67 / 0.67 / +1.0%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67556016 / 68421018 / -1.3% 88101855 / 88809257 / -0.8% 0.77 / 0.77 / -0.5%
tpch_q02/duckdb:parquet 86683710 / 87682176 / -1.1% 97698402 / 97613510 / +0.1% 0.89 / 0.90 / -1.2%
tpch_q03/duckdb:parquet 110168919 / 111342728 / -1.1% 140492853 / 140694059 / -0.1% 0.78 / 0.79 / -0.9%
tpch_q04/duckdb:parquet 75940874 / 76923747 / -1.3% 98506858 / 97281529 / +1.3% 0.77 / 0.79 / -2.5%
tpch_q05/duckdb:parquet 122788729 / 123413194 / -0.5% 156855703 / 156818304 / +0.0% 0.78 / 0.79 / -0.5%
tpch_q06/duckdb:parquet 34782250 / 35553177 / -2.2% 58155359 / 57203644 / +1.7% 0.60 / 0.62 / -3.8%
tpch_q07/duckdb:parquet 117043756 / 119164415 / -1.8% 154672235 / 153796175 / +0.6% 0.76 / 0.77 / -2.3%
tpch_q08/duckdb:parquet 147579876 / 149679781 / -1.4% 190772274 / 187635711 / +1.7% 0.77 / 0.80 / -3.0%
tpch_q09/duckdb:parquet 237487827 / 237078356 / +0.2% 283303793 / 278736349 / +1.6% 0.84 / 0.85 / -1.4%
tpch_q10/duckdb:parquet 312950446 / 316711823 / -1.2% 340487555 / 340339285 / +0.0% 0.92 / 0.93 / -1.2%
tpch_q11/duckdb:parquet 43608044 / 44030796 / -1.0% 50731598 / 51873102 / -2.2% 0.86 / 0.85 / +1.3%
tpch_q12/duckdb:parquet 69887378 / 73062309 / -4.3% 91639583 / 91232293 / +0.4% 0.76 / 0.80 / -4.8%
tpch_q13/duckdb:parquet 293871221 / 293805219 / +0.0% 307292082 / 309330090 / -0.7% 0.96 / 0.95 / +0.7%
tpch_q14/duckdb:parquet 100676335 / 102107170 / -1.4% 134783221 / 136714646 / -1.4% 0.75 / 0.75 / +0.0%
tpch_q15/duckdb:parquet 58641033 / 57837108 / +1.4% 86945704 / 87032157 / -0.1% 0.67 / 0.66 / +1.5%
tpch_q16/duckdb:parquet 100620090 / 101180385 / -0.6% 108322089 / 107613618 / +0.7% 0.93 / 0.94 / -1.2%
tpch_q17/duckdb:parquet 82901341 / 82504008 / +0.5% 114204083 / 110400493 / +3.4% 0.73 / 0.75 / -2.9%
tpch_q18/duckdb:parquet 152298728 / 157331102 / -3.2% 179555221 / 170385019 / +5.4% 0.85 / 0.92 / -8.1%
tpch_q19/duckdb:parquet 98921369 / 100105976 / -1.2% 131837162 / 129556574 / +1.8% 0.75 / 0.77 / -2.9%
tpch_q20/duckdb:parquet 147398328 / 147461459 / -0.0% 184677061 / 181854627 / +1.6% 0.80 / 0.81 / -1.6%
tpch_q21/duckdb:parquet 253008169 / 255020142 / -0.8% 275916157 / 285348213 / -3.3% 0.92 / 0.89 / +2.6%
tpch_q22/duckdb:parquet 168304642 / 169229412 / -0.5% 180088864 / 184041864 / -2.1% 0.93 / 0.92 / +1.6%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 24638a2f vs base f32cb549
Vortex (geomean): hot 0.970x ➖ · cold 0.869x ✅


datafusion / vortex-file-compressed / ns (0.970x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44376456 / 44108612 / +0.6% 87612009 / 93370522 / -6.2% 0.51 / 0.47 / +7.2%
polarsignals_q01/datafusion:vortex-file-compressed 52580830 / 52998570 / -0.8% 108512223 / 118223505 / -8.2% 0.48 / 0.45 / +8.1%
polarsignals_q02/datafusion:vortex-file-compressed 16425442 / 14184558 / +15.8% 🔴 44593200 / 51771641 / -13.9% 🟢 0.37 / 0.27 / +34.4%
polarsignals_q03/datafusion:vortex-file-compressed 54542928 / 84121488 / -35.2% 🟢 113357591 / 147817484 / -23.3% 🟢 0.48 / 0.57 / -15.5%
polarsignals_q04/datafusion:vortex-file-compressed 9221717 / 9310016 / -0.9% 39997866 / 48990586 / -18.4% 🟢 0.23 / 0.19 / +21.3%
polarsignals_q05/datafusion:vortex-file-compressed 11747616 / 11832147 / -0.7% 43641415 / 51503711 / -15.3% 🟢 0.27 / 0.23 / +17.2%
polarsignals_q06/datafusion:vortex-file-compressed 23101672 / 23284365 / -0.8% 53427161 / 60709148 / -12.0% 🟢 0.43 / 0.38 / +12.7%
polarsignals_q07/datafusion:vortex-file-compressed 10665386 / 10545501 / +1.1% 42104583 / 50219697 / -16.2% 🟢 0.25 / 0.21 / +20.6%
polarsignals_q08/datafusion:vortex-file-compressed 97558436 / 97677815 / -0.1% 160916564 / 163732641 / -1.7% 0.61 / 0.60 / +1.6%
polarsignals_q09/datafusion:vortex-file-compressed 10017064 / 10058461 / -0.4% 39755530 / 46208357 / -14.0% 🟢 0.25 / 0.22 / +15.8%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 24638a2f vs base f32cb549
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+1.1%, environment too noisy confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): hot 1.147x ➖ · cold 1.059x ➖
Parquet (geomean): hot 1.137x ➖ · cold 1.156x ➖
Shifts: Parquet (control) +13.7% · Median polish +11.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.159x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 259983574 / 239071801 / +8.7% 758058487 / 816332568 / -7.1% 0.34 / 0.29 / +17.1%
tpch_q02/datafusion:vortex-file-compressed 297231189 / 348772901 / -14.8% 671856276 / 993283945 / -32.4% 🟢 0.44 / 0.35 / +26.0%
tpch_q03/datafusion:vortex-file-compressed 557765571 / 438244819 / +27.3% 1179340629 / 1033105451 / +14.2% 0.47 / 0.42 / +11.5%
tpch_q04/datafusion:vortex-file-compressed 238947637 / 197370178 / +21.1% 503128373 / 515865455 / -2.5% 0.47 / 0.38 / +24.1%
tpch_q05/datafusion:vortex-file-compressed 431642059 / 408390534 / +5.7% 731994722 / 621802624 / +17.7% 0.59 / 0.66 / -10.2%
tpch_q06/datafusion:vortex-file-compressed 153697472 / 161194449 / -4.7% 333722102 / 283421998 / +17.7% 0.46 / 0.57 / -19.0%
tpch_q07/datafusion:vortex-file-compressed 577159349 / 426730625 / +35.3% 🔴 685990060 / 704159139 / -2.6% 0.84 / 0.61 / +38.8%
tpch_q08/datafusion:vortex-file-compressed 452716821 / 496688803 / -8.9% 829536656 / 600394925 / +38.2% 🔴 0.55 / 0.83 / -34.0%
tpch_q09/datafusion:vortex-file-compressed 463243969 / 474296765 / -2.3% 839251121 / 608651766 / +37.9% 🔴 0.55 / 0.78 / -29.2%
tpch_q10/datafusion:vortex-file-compressed 399424114 / 352049460 / +13.5% 562629077 / 572903409 / -1.8% 0.71 / 0.61 / +15.5%
tpch_q11/datafusion:vortex-file-compressed 364006632 / 263207767 / +38.3% 🔴 465080925 / 497881706 / -6.6% 0.78 / 0.53 / +48.0%
tpch_q12/datafusion:vortex-file-compressed 289789761 / 216844394 / +33.6% 🔴 388074609 / 447958294 / -13.4% 0.75 / 0.48 / +54.3%
tpch_q13/datafusion:vortex-file-compressed 148709324 / 131205426 / +13.3% 428266370 / 337748164 / +26.8% 0.35 / 0.39 / -10.6%
tpch_q14/datafusion:vortex-file-compressed 185841555 / 184357224 / +0.8% 422937552 / 319807077 / +32.2% 🔴 0.44 / 0.58 / -23.8%
tpch_q15/datafusion:vortex-file-compressed 331417675 / 316723452 / +4.6% 595769143 / 546672064 / +9.0% 0.56 / 0.58 / -4.0%
tpch_q16/datafusion:vortex-file-compressed 160560452 / 131666881 / +21.9% 341476237 / 297754268 / +14.7% 0.47 / 0.44 / +6.3%
tpch_q17/datafusion:vortex-file-compressed 325488955 / 295526033 / +10.1% 449957467 / 434694279 / +3.5% 0.72 / 0.68 / +6.4%
tpch_q18/datafusion:vortex-file-compressed 521149070 / 254592270 / +104.7% 🔴 707194878 / 477186586 / +48.2% 🔴 0.74 / 0.53 / +38.1%
tpch_q19/datafusion:vortex-file-compressed 525728360 / 279237312 / +88.3% 🔴 465690862 / 347360144 / +34.1% 🔴 1.13 / 0.80 / +40.4%
tpch_q20/datafusion:vortex-file-compressed 310836696 / 333118597 / -6.7% 491565943 / 567784989 / -13.4% 0.63 / 0.59 / +7.8%
tpch_q21/datafusion:vortex-file-compressed 618121367 / 600893633 / +2.9% 790013181 / 731685412 / +8.0% 0.78 / 0.82 / -4.7%
tpch_q22/datafusion:vortex-file-compressed 178571939 / 151150305 / +18.1% 436969855 / 365513206 / +19.5% 0.41 / 0.41 / -1.2%
datafusion / parquet / ns (1.146x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 201174352 / 157951161 / +27.4% 626491871 / 453558436 / +38.1% 🔴 0.32 / 0.35 / -7.8%
tpch_q02/datafusion:parquet 322339941 / 365723869 / -11.9% 643323795 / 606471386 / +6.1% 0.50 / 0.60 / -16.9%
tpch_q03/datafusion:parquet 423648168 / 285032544 / +48.6% 🔴 1088546013 / 731343215 / +48.8% 🔴 0.39 / 0.39 / -0.1%
tpch_q04/datafusion:parquet 189286977 / 184870109 / +2.4% 371158001 / 363542536 / +2.1% 0.51 / 0.51 / +0.3%
tpch_q05/datafusion:parquet 437348302 / 370207301 / +18.1% 819075704 / 548762883 / +49.3% 🔴 0.53 / 0.67 / -20.9%
tpch_q06/datafusion:parquet 179726168 / 114419684 / +57.1% 🔴 353762342 / 242023881 / +46.2% 🔴 0.51 / 0.47 / +7.5%
tpch_q07/datafusion:parquet 390031732 / 364792306 / +6.9% 762735630 / 457698581 / +66.6% 🔴 0.51 / 0.80 / -35.8%
tpch_q08/datafusion:parquet 588367853 / 467011525 / +26.0% 1132971635 / 610597651 / +85.6% 🔴 0.52 / 0.76 / -32.1%
tpch_q09/datafusion:parquet 500318962 / 408815807 / +22.4% 854696048 / 568552924 / +50.3% 🔴 0.59 / 0.72 / -18.6%
tpch_q10/datafusion:parquet 382222640 / 326835670 / +16.9% 518956330 / 516526786 / +0.5% 0.74 / 0.63 / +16.4%
tpch_q11/datafusion:parquet 252653547 / 285936995 / -11.6% 400849457 / 449142573 / -10.8% 0.63 / 0.64 / -1.0%
tpch_q12/datafusion:parquet 207259986 / 190211798 / +9.0% 346633500 / 351477362 / -1.4% 0.60 / 0.54 / +10.5%
tpch_q13/datafusion:parquet 273373498 / 278422356 / -1.8% 497550779 / 467022953 / +6.5% 0.55 / 0.60 / -7.8%
tpch_q14/datafusion:parquet 191701954 / 191618522 / +0.0% 296611088 / 413440415 / -28.3% 0.65 / 0.46 / +39.4%
tpch_q15/datafusion:parquet 366461690 / 345383456 / +6.1% 602006838 / 557002845 / +8.1% 0.61 / 0.62 / -1.8%
tpch_q16/datafusion:parquet 106167658 / 110124380 / -3.6% 243512761 / 343581208 / -29.1% 0.44 / 0.32 / +36.0%
tpch_q17/datafusion:parquet 370320522 / 290765795 / +27.4% 522403605 / 437805688 / +19.3% 0.71 / 0.66 / +6.7%
tpch_q18/datafusion:parquet 431035967 / 334494514 / +28.9% 859677068 / 647519662 / +32.8% 🔴 0.50 / 0.52 / -2.9%
tpch_q19/datafusion:parquet 203148941 / 167940221 / +21.0% 313195749 / 305914212 / +2.4% 0.65 / 0.55 / +18.2%
tpch_q20/datafusion:parquet 314291350 / 257109578 / +22.2% 477769916 / 465139074 / +2.7% 0.66 / 0.55 / +19.0%
tpch_q21/datafusion:parquet 530946994 / 357269624 / +48.6% 🔴 731944593 / 507724753 / +44.2% 🔴 0.73 / 0.70 / +3.1%
tpch_q22/datafusion:parquet 153343154 / 162620286 / -5.7% 357580459 / 331199091 / +8.0% 0.43 / 0.49 / -12.7%
duckdb / vortex-file-compressed / ns (1.135x ➖, 1↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 352757933 / 251387892 / +40.3% 🔴 491610971 / 271038799 / +81.4% 🔴 0.72 / 0.93 / -22.6%
tpch_q02/duckdb:vortex-file-compressed 567887396 / 431216688 / +31.7% 🔴 574710016 / 560213800 / +2.6% 0.99 / 0.77 / +28.4%
tpch_q03/duckdb:vortex-file-compressed 553890606 / 397268062 / +39.4% 🔴 580989917 / 515589107 / +12.7% 0.95 / 0.77 / +23.7%
tpch_q04/duckdb:vortex-file-compressed 268151933 / 379398996 / -29.3% 345698161 / 526806482 / -34.4% 🟢 0.78 / 0.72 / +7.7%
tpch_q05/duckdb:vortex-file-compressed 596581128 / 1051345977 / -43.3% 🟢 760625744 / 914578982 / -16.8% 0.78 / 1.15 / -31.8%
tpch_q06/duckdb:vortex-file-compressed 196072244 / 163219007 / +20.1% 270787449 / 283396423 / -4.4% 0.72 / 0.58 / +25.7%
tpch_q07/duckdb:vortex-file-compressed 465115900 / 533169903 / -12.8% 596127350 / 609624410 / -2.2% 0.78 / 0.87 / -10.8%
tpch_q08/duckdb:vortex-file-compressed 910438705 / 578043614 / +57.5% 🔴 741882642 / 829906565 / -10.6% 1.23 / 0.70 / +76.2%
tpch_q09/duckdb:vortex-file-compressed 535801793 / 428102998 / +25.2% 596994752 / 459403516 / +29.9% 0.90 / 0.93 / -3.7%
tpch_q10/duckdb:vortex-file-compressed 659096416 / 555478191 / +18.7% 684122279 / 548931605 / +24.6% 0.96 / 1.01 / -4.8%
tpch_q11/duckdb:vortex-file-compressed 329870111 / 309136559 / +6.7% 299064013 / 334913953 / -10.7% 1.10 / 0.92 / +19.5%
tpch_q12/duckdb:vortex-file-compressed 349790493 / 244179216 / +43.3% 🔴 269307711 / 325257747 / -17.2% 1.30 / 0.75 / +73.0%
tpch_q13/duckdb:vortex-file-compressed 271165809 / 234288058 / +15.7% 298501885 / 244831157 / +21.9% 0.91 / 0.96 / -5.1%
tpch_q14/duckdb:vortex-file-compressed 235324256 / 248146844 / -5.2% 332490412 / 335647638 / -0.9% 0.71 / 0.74 / -4.3%
tpch_q15/duckdb:vortex-file-compressed 248253412 / 244780971 / +1.4% 390794707 / 265780705 / +47.0% 🔴 0.64 / 0.92 / -31.0%
tpch_q16/duckdb:vortex-file-compressed 249468624 / 218890032 / +14.0% 237182393 / 275641784 / -14.0% 1.05 / 0.79 / +32.5%
tpch_q17/duckdb:vortex-file-compressed 460417620 / 354131581 / +30.0% 🔴 553380030 / 514110041 / +7.6% 0.83 / 0.69 / +20.8%
tpch_q18/duckdb:vortex-file-compressed 400468760 / 361053609 / +10.9% 416617305 / 431247462 / -3.4% 0.96 / 0.84 / +14.8%
tpch_q19/duckdb:vortex-file-compressed 430548149 / 281858212 / +52.8% 🔴 385801288 / 420131118 / -8.2% 1.12 / 0.67 / +66.3%
tpch_q20/duckdb:vortex-file-compressed 429191038 / 353300838 / +21.5% 531065760 / 500243373 / +6.2% 0.81 / 0.71 / +14.4%
tpch_q21/duckdb:vortex-file-compressed 888018512 / 819389067 / +8.4% 969205670 / 891678040 / +8.7% 0.92 / 0.92 / -0.3%
tpch_q22/duckdb:vortex-file-compressed 264884223 / 231770948 / +14.3% 301339593 / 318854498 / -5.5% 0.88 / 0.73 / +20.9%
duckdb / parquet / ns (1.127x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 231378251 / 176877106 / +30.8% 🔴 280792622 / 292590368 / -4.0% 0.82 / 0.60 / +36.3%
tpch_q02/duckdb:parquet 463133986 / 486244859 / -4.8% 457427894 / 591007154 / -22.6% 1.01 / 0.82 / +23.1%
tpch_q03/duckdb:parquet 476893517 / 362158032 / +31.7% 🔴 522709162 / 427950231 / +22.1% 0.91 / 0.85 / +7.8%
tpch_q04/duckdb:parquet 306128173 / 278914867 / +9.8% 365276158 / 298368969 / +22.4% 0.84 / 0.93 / -10.3%
tpch_q05/duckdb:parquet 666571761 / 577992187 / +15.3% 706444879 / 645262260 / +9.5% 0.94 / 0.90 / +5.3%
tpch_q06/duckdb:parquet 204490918 / 352184214 / -41.9% 🟢 361268717 / 323884324 / +11.5% 0.57 / 1.09 / -47.9%
tpch_q07/duckdb:parquet 513796948 / 424913825 / +20.9% 598389720 / 483589503 / +23.7% 0.86 / 0.88 / -2.3%
tpch_q08/duckdb:parquet 663472963 / 670309166 / -1.0% 737571939 / 700052684 / +5.4% 0.90 / 0.96 / -6.1%
tpch_q09/duckdb:parquet 602189559 / 580714015 / +3.7% 690665824 / 695483944 / -0.7% 0.87 / 0.83 / +4.4%
tpch_q10/duckdb:parquet 688674143 / 660504743 / +4.3% 727657070 / 769994737 / -5.5% 0.95 / 0.86 / +10.3%
tpch_q11/duckdb:parquet 291787764 / 284530523 / +2.6% 314977053 / 304474607 / +3.4% 0.93 / 0.93 / -0.9%
tpch_q12/duckdb:parquet 309082594 / 277058349 / +11.6% 716715279 / 335346278 / +113.7% 🔴 0.43 / 0.83 / -47.8%
tpch_q13/duckdb:parquet 407252639 / 401194687 / +1.5% 456827841 / 516051736 / -11.5% 0.89 / 0.78 / +14.7%
tpch_q14/duckdb:parquet 297708323 / 248422696 / +19.8% 366426384 / 296705936 / +23.5% 0.81 / 0.84 / -3.0%
tpch_q15/duckdb:parquet 462418287 / 192099068 / +140.7% 🔴 562368197 / 184399658 / +205.0% 🔴 0.82 / 1.04 / -21.1%
tpch_q16/duckdb:parquet 276965409 / 326932711 / -15.3% 290586864 / 302809910 / -4.0% 0.95 / 1.08 / -11.7%
tpch_q17/duckdb:parquet 348474496 / 293291748 / +18.8% 353503148 / 377353350 / -6.3% 0.99 / 0.78 / +26.8%
tpch_q18/duckdb:parquet 457131292 / 400816850 / +14.0% 497971046 / 425073353 / +17.1% 0.92 / 0.94 / -2.6%
tpch_q19/duckdb:parquet 407790686 / 282609652 / +44.3% 🔴 378309266 / 356515745 / +6.1% 1.08 / 0.79 / +36.0%
tpch_q20/duckdb:parquet 597709338 / 517742585 / +15.4% 641453954 / 526007552 / +21.9% 0.93 / 0.98 / -5.3%
tpch_q21/duckdb:parquet 622278175 / 435775714 / +42.8% 🔴 584835981 / 505460905 / +15.7% 1.06 / 0.86 / +23.4%
tpch_q22/duckdb:parquet 306113379 / 312600336 / -2.1% 322662955 / 316052561 / +2.1% 0.95 / 0.99 / -4.1%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 24638a2f vs base 37d9e8e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (-1.4%, low confidence) · DuckDB No clear signal (+4.5%, low confidence)
Vortex (geomean): hot 0.986x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.971x ➖ · cold 0.956x ➖
Shifts: Parquet (control) -2.9% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1223615 / 1245040 / -1.7% 23346843 / 23986609 / -2.7% 0.05 / 0.05 / +1.0%
clickbench_q01/datafusion:vortex-file-compressed 6140795 / 6326478 / -2.9% 29799323 / 34413745 / -13.4% 🟢 0.21 / 0.18 / +12.1%
clickbench_q02/datafusion:vortex-file-compressed 10285531 / 10579180 / -2.8% 44488318 / 44092718 / +0.9% 0.23 / 0.24 / -3.6%
clickbench_q03/datafusion:vortex-file-compressed 12349434 / 12614856 / -2.1% 52702293 / 56365947 / -6.5% 0.23 / 0.22 / +4.7%
clickbench_q04/datafusion:vortex-file-compressed 57362586 / 58289640 / -1.6% 104624658 / 98179218 / +6.6% 0.55 / 0.59 / -7.7%
clickbench_q05/datafusion:vortex-file-compressed 75630755 / 76501332 / -1.1% 128158076 / 122598043 / +4.5% 0.59 / 0.62 / -5.4%
clickbench_q06/datafusion:vortex-file-compressed 1226844 / 1251212 / -1.9% 23549227 / 23807786 / -1.1% 0.05 / 0.05 / -0.9%
clickbench_q07/datafusion:vortex-file-compressed 9212650 / 9842942 / -6.4% 34850451 / 34708100 / +0.4% 0.26 / 0.28 / -6.8%
clickbench_q08/datafusion:vortex-file-compressed 78017173 / 78549334 / -0.7% 122551777 / 121878629 / +0.6% 0.64 / 0.64 / -1.2%
clickbench_q09/datafusion:vortex-file-compressed 171207444 / 168426946 / +1.7% 214123841 / 217297680 / -1.5% 0.80 / 0.78 / +3.2%
clickbench_q10/datafusion:vortex-file-compressed 23083340 / 23929752 / -3.5% 71046628 / 68980965 / +3.0% 0.32 / 0.35 / -6.3%
clickbench_q11/datafusion:vortex-file-compressed 25111554 / 25449952 / -1.3% 72354693 / 72253299 / +0.1% 0.35 / 0.35 / -1.5%
clickbench_q12/datafusion:vortex-file-compressed 70684116 / 75476358 / -6.3% 124840595 / 123112816 / +1.4% 0.57 / 0.61 / -7.6%
clickbench_q13/datafusion:vortex-file-compressed 117746882 / 118639956 / -0.8% 188526526 / 177011607 / +6.5% 0.62 / 0.67 / -6.8%
clickbench_q14/datafusion:vortex-file-compressed 74313320 / 74929752 / -0.8% 130747936 / 126260599 / +3.6% 0.57 / 0.59 / -4.2%
clickbench_q15/datafusion:vortex-file-compressed 62774248 / 64105074 / -2.1% 98794731 / 99236111 / -0.4% 0.64 / 0.65 / -1.6%
clickbench_q16/datafusion:vortex-file-compressed 155108493 / 152403291 / +1.8% 216003284 / 212111105 / +1.8% 0.72 / 0.72 / -0.1%
clickbench_q17/datafusion:vortex-file-compressed 151514148 / 153357096 / -1.2% 226722109 / 233592164 / -2.9% 0.67 / 0.66 / +1.8%
clickbench_q18/datafusion:vortex-file-compressed 290979160 / 291925773 / -0.3% 380556896 / 387075138 / -1.7% 0.76 / 0.75 / +1.4%
clickbench_q19/datafusion:vortex-file-compressed 8145243 / 8465698 / -3.8% 51771703 / 52077705 / -0.6% 0.16 / 0.16 / -3.2%
clickbench_q20/datafusion:vortex-file-compressed 67745236 / 68359870 / -0.9% 251166844 / 242000644 / +3.8% 0.27 / 0.28 / -4.5%
clickbench_q21/datafusion:vortex-file-compressed 76833281 / 80700184 / -4.8% 292817953 / 285308540 / +2.6% 0.26 / 0.28 / -7.2%
clickbench_q22/datafusion:vortex-file-compressed 91560167 / 93264781 / -1.8% 392988346 / 396223678 / -0.8% 0.23 / 0.24 / -1.0%
clickbench_q23/datafusion:vortex-file-compressed 184634849 / 186481055 / -1.0% 559782540 / 561057140 / -0.2% 0.33 / 0.33 / -0.8%
clickbench_q24/datafusion:vortex-file-compressed 15331726 / 16119660 / -4.9% 72864003 / 67390678 / +8.1% 0.21 / 0.24 / -12.0%
clickbench_q25/datafusion:vortex-file-compressed 18450530 / 19496616 / -5.4% 64333370 / 60582350 / +6.2% 0.29 / 0.32 / -10.9%
clickbench_q26/datafusion:vortex-file-compressed 15632516 / 17028696 / -8.2% 72505107 / 70426382 / +3.0% 0.22 / 0.24 / -10.8%
clickbench_q27/datafusion:vortex-file-compressed 101495340 / 103494852 / -1.9% 258989248 / 250066147 / +3.6% 0.39 / 0.41 / -5.3%
clickbench_q28/datafusion:vortex-file-compressed 555684442 / 550610252 / +0.9% 639242569 / 631003820 / +1.3% 0.87 / 0.87 / -0.4%
clickbench_q29/datafusion:vortex-file-compressed 23968784 / 24262950 / -1.2% 57975952 / 54575431 / +6.2% 0.41 / 0.44 / -7.0%
clickbench_q30/datafusion:vortex-file-compressed 57830624 / 58418686 / -1.0% 111861771 / 109330719 / +2.3% 0.52 / 0.53 / -3.2%
clickbench_q31/datafusion:vortex-file-compressed 65621512 / 66291005 / -1.0% 159914810 / 154707432 / +3.4% 0.41 / 0.43 / -4.2%
clickbench_q32/datafusion:vortex-file-compressed 284456796 / 289146444 / -1.6% 387091693 / 387319648 / -0.1% 0.73 / 0.75 / -1.6%
clickbench_q33/datafusion:vortex-file-compressed 318355814 / 323119123 / -1.5% 432773790 / 440304179 / -1.7% 0.74 / 0.73 / +0.2%
clickbench_q34/datafusion:vortex-file-compressed 326371983 / 323845486 / +0.8% 438830913 / 445021833 / -1.4% 0.74 / 0.73 / +2.2%
clickbench_q35/datafusion:vortex-file-compressed 58048946 / 59062332 / -1.7% 95421692 / 90136930 / +5.9% 0.61 / 0.66 / -7.2%
clickbench_q36/datafusion:vortex-file-compressed 37414910 / 37724722 / -0.8% 71052045 / 68463188 / +3.8% 0.53 / 0.55 / -4.4%
clickbench_q37/datafusion:vortex-file-compressed 21324630 / 21353306 / -0.1% 48155350 / 48186267 / -0.1% 0.44 / 0.44 / -0.1%
clickbench_q38/datafusion:vortex-file-compressed 13199988 / 13189640 / +0.1% 43195991 / 42827312 / +0.9% 0.31 / 0.31 / -0.8%
clickbench_q39/datafusion:vortex-file-compressed 78748130 / 79455709 / -0.9% 113330901 / 112250201 / +1.0% 0.69 / 0.71 / -1.8%
clickbench_q40/datafusion:vortex-file-compressed 10747711 / 10460976 / +2.7% 36936349 / 37580573 / -1.7% 0.29 / 0.28 / +4.5%
clickbench_q41/datafusion:vortex-file-compressed 9929766 / 10338816 / -4.0% 36959431 / 36707276 / +0.7% 0.27 / 0.28 / -4.6%
clickbench_q42/datafusion:vortex-file-compressed 10310038 / 10538775 / -2.2% 36689216 / 36600918 / +0.2% 0.28 / 0.29 / -2.4%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1276080 / 1272980 / +0.2% 49653503 / 50213855 / -1.1% 0.03 / 0.03 / +1.4%
clickbench_q01/datafusion:parquet 15898722 / 16081917 / -1.1% 74632051 / 66334999 / +12.5% 🔴 0.21 / 0.24 / -12.1%
clickbench_q02/datafusion:parquet 18542693 / 19374062 / -4.3% 79696506 / 80384559 / -0.9% 0.23 / 0.24 / -3.5%
clickbench_q03/datafusion:parquet 16736689 / 16873865 / -0.8% 78351069 / 79975284 / -2.0% 0.21 / 0.21 / +1.2%
clickbench_q04/datafusion:parquet 62321355 / 61811794 / +0.8% 127384177 / 123914709 / +2.8% 0.49 / 0.50 / -1.9%
clickbench_q05/datafusion:parquet 88203624 / 87601634 / +0.7% 156149444 / 155654227 / +0.3% 0.56 / 0.56 / +0.4%
clickbench_q06/datafusion:parquet 1272264 / 1266265 / +0.5% 49786718 / 49456015 / +0.7% 0.03 / 0.03 / -0.2%
clickbench_q07/datafusion:parquet 16846283 / 16765629 / +0.5% 67651060 / 68757289 / -1.6% 0.25 / 0.24 / +2.1%
clickbench_q08/datafusion:parquet 85364941 / 86001291 / -0.7% 159565634 / 160173949 / -0.4% 0.53 / 0.54 / -0.4%
clickbench_q09/datafusion:parquet 187404152 / 188960692 / -0.8% 267344550 / 271042055 / -1.4% 0.70 / 0.70 / +0.5%
clickbench_q10/datafusion:parquet 36255374 / 36247988 / +0.0% 100537389 / 102645523 / -2.1% 0.36 / 0.35 / +2.1%
clickbench_q11/datafusion:parquet 42797628 / 42901071 / -0.2% 109968465 / 110187173 / -0.2% 0.39 / 0.39 / -0.0%
clickbench_q12/datafusion:parquet 96429014 / 95687680 / +0.8% 161690517 / 162247824 / -0.3% 0.60 / 0.59 / +1.1%
clickbench_q13/datafusion:parquet 146304274 / 147144536 / -0.6% 227052816 / 226254114 / +0.4% 0.64 / 0.65 / -0.9%
clickbench_q14/datafusion:parquet 101239787 / 102348568 / -1.1% 174471171 / 172405669 / +1.2% 0.58 / 0.59 / -2.3%
clickbench_q15/datafusion:parquet 70702790 / 70211354 / +0.7% 129137289 / 131183699 / -1.6% 0.55 / 0.54 / +2.3%
clickbench_q16/datafusion:parquet 154953598 / 154392040 / +0.4% 237588726 / 237144531 / +0.2% 0.65 / 0.65 / +0.2%
clickbench_q17/datafusion:parquet 155376638 / 154659340 / +0.5% 238531358 / 237635154 / +0.4% 0.65 / 0.65 / +0.1%
clickbench_q18/datafusion:parquet 310442976 / 309118935 / +0.4% 418805698 / 417724622 / +0.3% 0.74 / 0.74 / +0.2%
clickbench_q19/datafusion:parquet 19101831 / 18917550 / +1.0% 77227913 / 78210096 / -1.3% 0.25 / 0.24 / +2.3%
clickbench_q20/datafusion:parquet 177810064 / 177987746 / -0.1% 283014834 / 282521597 / +0.2% 0.63 / 0.63 / -0.3%
clickbench_q21/datafusion:parquet 173590576 / 173759999 / -0.1% 301440981 / 302138487 / -0.2% 0.58 / 0.58 / +0.1%
clickbench_q22/datafusion:parquet 258797469 / 259963625 / -0.4% 428452376 / 424312647 / +1.0% 0.60 / 0.61 / -1.4%
clickbench_q23/datafusion:parquet 1010620976 / 1016948573 / -0.6% 1200659678 / 1209983711 / -0.8% 0.84 / 0.84 / +0.1%
clickbench_q24/datafusion:parquet 29465148 / 30199362 / -2.4% 88345656 / 90734320 / -2.6% 0.33 / 0.33 / +0.2%
clickbench_q25/datafusion:parquet 36577006 / 37089527 / -1.4% 103537994 / 103091105 / +0.4% 0.35 / 0.36 / -1.8%
clickbench_q26/datafusion:parquet 30352506 / 30610402 / -0.8% 90264891 / 88364006 / +2.2% 0.34 / 0.35 / -2.9%
clickbench_q27/datafusion:parquet 192564780 / 192393474 / +0.1% 293614524 / 295032150 / -0.5% 0.66 / 0.65 / +0.6%
clickbench_q28/datafusion:parquet 619990532 / 617364204 / +0.4% 711929892 / 700354920 / +1.7% 0.87 / 0.88 / -1.2%
clickbench_q29/datafusion:parquet 29682904 / 29045190 / +2.2% 90085646 / 91832973 / -1.9% 0.33 / 0.32 / +4.2%
clickbench_q30/datafusion:parquet 90273222 / 90426770 / -0.2% 170161484 / 173518562 / -1.9% 0.53 / 0.52 / +1.8%
clickbench_q31/datafusion:parquet 101769596 / 104787628 / -2.9% 198786482 / 197020266 / +0.9% 0.51 / 0.53 / -3.7%
clickbench_q32/datafusion:parquet 302996450 / 313147694 / -3.2% 429516857 / 431338985 / -0.4% 0.71 / 0.73 / -2.8%
clickbench_q33/datafusion:parquet 376753945 / 380020864 / -0.9% 477740287 / 477064560 / +0.1% 0.79 / 0.80 / -1.0%
clickbench_q34/datafusion:parquet 375546193 / 379365318 / -1.0% 473832875 / 475624112 / -0.4% 0.79 / 0.80 / -0.6%
clickbench_q35/datafusion:parquet 65469645 / 64397906 / +1.7% 121475257 / 122776064 / -1.1% 0.54 / 0.52 / +2.8%
clickbench_q36/datafusion:parquet 72897776 / 73817559 / -1.2% 136419957 / 135976399 / +0.3% 0.53 / 0.54 / -1.6%
clickbench_q37/datafusion:parquet 35273478 / 35555152 / -0.8% 91716421 / 92363039 / -0.7% 0.38 / 0.38 / -0.1%
clickbench_q38/datafusion:parquet 47507794 / 47630425 / -0.3% 108839993 / 107660821 / +1.1% 0.44 / 0.44 / -1.3%
clickbench_q39/datafusion:parquet 143221932 / 143769660 / -0.4% 211912638 / 209686851 / +1.1% 0.68 / 0.69 / -1.4%
clickbench_q40/datafusion:parquet 19862212 / 20107890 / -1.2% 77542508 / 78245425 / -0.9% 0.26 / 0.26 / -0.3%
clickbench_q41/datafusion:parquet 18571732 / 18903612 / -1.8% 76323649 / 75818675 / +0.7% 0.24 / 0.25 / -2.4%
clickbench_q42/datafusion:parquet 19034526 / 19367482 / -1.7% 74810414 / 74656688 / +0.2% 0.25 / 0.26 / -1.9%
duckdb / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2229278 / 2143780 / +4.0% 25667529 / 23818595 / +7.8% 0.09 / 0.09 / -3.5%
clickbench_q01/duckdb:vortex-file-compressed 7432144 / 7852624 / -5.4% 28851607 / 28772740 / +0.3% 0.26 / 0.27 / -5.6%
clickbench_q02/duckdb:vortex-file-compressed 9136868 / 9181658 / -0.5% 36158202 / 35896274 / +0.7% 0.25 / 0.26 / -1.2%
clickbench_q03/duckdb:vortex-file-compressed 13813658 / 14105842 / -2.1% 51474540 / 50963384 / +1.0% 0.27 / 0.28 / -3.0%
clickbench_q04/duckdb:vortex-file-compressed 55558820 / 56801920 / -2.2% 87175563 / 91682844 / -4.9% 0.64 / 0.62 / +2.9%
clickbench_q05/duckdb:vortex-file-compressed 63242898 / 64057626 / -1.3% 95475080 / 97659135 / -2.2% 0.66 / 0.66 / +1.0%
clickbench_q06/duckdb:vortex-file-compressed 2662134 / 2674482 / -0.5% 30999614 / 28176186 / +10.0% 🔴 0.09 / 0.09 / -9.5%
clickbench_q07/duckdb:vortex-file-compressed 9895716 / 9599796 / +3.1% 28825773 / 31477659 / -8.4% 0.34 / 0.30 / +12.6%
clickbench_q08/duckdb:vortex-file-compressed 68741812 / 69068642 / -0.5% 101331996 / 105564734 / -4.0% 0.68 / 0.65 / +3.7%
clickbench_q09/duckdb:vortex-file-compressed 95034478 / 91586090 / +3.8% 126230086 / 130540650 / -3.3% 0.75 / 0.70 / +7.3%
clickbench_q10/duckdb:vortex-file-compressed 27010294 / 27678194 / -2.4% 69410641 / 73278202 / -5.3% 0.39 / 0.38 / +3.0%
clickbench_q11/duckdb:vortex-file-compressed 29926381 / 30413384 / -1.6% 76171320 / 78057571 / -2.4% 0.39 / 0.39 / +0.8%
clickbench_q12/duckdb:vortex-file-compressed 70050057 / 70308574 / -0.4% 97594558 / 101458488 / -3.8% 0.72 / 0.69 / +3.6%
clickbench_q13/duckdb:vortex-file-compressed 124500795 / 127924814 / -2.7% 168425802 / 169059388 / -0.4% 0.74 / 0.76 / -2.3%
clickbench_q14/duckdb:vortex-file-compressed 74310146 / 75004462 / -0.9% 105005177 / 106242966 / -1.2% 0.71 / 0.71 / +0.2%
clickbench_q15/duckdb:vortex-file-compressed 76634828 / 77304912 / -0.9% 111918185 / 108274792 / +3.4% 0.68 / 0.71 / -4.1%
clickbench_q16/duckdb:vortex-file-compressed 133358738 / 138922250 / -4.0% 171813744 / 173854756 / -1.2% 0.78 / 0.80 / -2.9%
clickbench_q17/duckdb:vortex-file-compressed 135554222 / 139121298 / -2.6% 170196217 / 173263131 / -1.8% 0.80 / 0.80 / -0.8%
clickbench_q18/duckdb:vortex-file-compressed 255096054 / 258215973 / -1.2% 306222122 / 313147563 / -2.2% 0.83 / 0.82 / +1.0%
clickbench_q19/duckdb:vortex-file-compressed 9279851 / 9684275 / -4.2% 37024936 / 38878867 / -4.8% 0.25 / 0.25 / +0.6%
clickbench_q20/duckdb:vortex-file-compressed 68647306 / 66608154 / +3.1% 166788370 / 167849599 / -0.6% 0.41 / 0.40 / +3.7%
clickbench_q21/duckdb:vortex-file-compressed 85553029 / 84659114 / +1.1% 195195342 / 199631069 / -2.2% 0.44 / 0.42 / +3.4%
clickbench_q22/duckdb:vortex-file-compressed 173535264 / 172583109 / +0.6% 355082128 / 361948416 / -1.9% 0.49 / 0.48 / +2.5%
clickbench_q23/duckdb:vortex-file-compressed 40209840 / 40296761 / -0.2% 87789563 / 84691610 / +3.7% 0.46 / 0.48 / -3.7%
clickbench_q24/duckdb:vortex-file-compressed 14184188 / 14501304 / -2.2% 38914154 / 35198330 / +10.6% 🔴 0.36 / 0.41 / -11.5%
clickbench_q25/duckdb:vortex-file-compressed 19451845 / 19705080 / -1.3% 56174714 / 52664473 / +6.7% 0.35 / 0.37 / -7.5%
clickbench_q26/duckdb:vortex-file-compressed 11344898 / 11446584 / -0.9% 35154052 / 35302901 / -0.4% 0.32 / 0.32 / -0.5%
clickbench_q27/duckdb:vortex-file-compressed 54250908 / 54294714 / -0.1% 181752248 / 174508379 / +4.2% 0.30 / 0.31 / -4.1%
clickbench_q28/duckdb:vortex-file-compressed 507734969 / 522526906 / -2.8% 565234680 / 580449103 / -2.6% 0.90 / 0.90 / -0.2%
clickbench_q29/duckdb:vortex-file-compressed 17005570 / 18024513 / -5.7% 48090044 / 48894598 / -1.6% 0.35 / 0.37 / -4.1%
clickbench_q30/duckdb:vortex-file-compressed 58715424 / 60779676 / -3.4% 109304228 / 110613249 / -1.2% 0.54 / 0.55 / -2.2%
clickbench_q31/duckdb:vortex-file-compressed 109919837 / 110902204 / -0.9% 174793793 / 198809399 / -12.1% 🟢 0.63 / 0.56 / +12.7%
clickbench_q32/duckdb:vortex-file-compressed 353945173 / 365242416 / -3.1% 399479676 / 401603681 / -0.5% 0.89 / 0.91 / -2.6%
clickbench_q33/duckdb:vortex-file-compressed 338392218 / 352230351 / -3.9% 402982598 / 415576515 / -3.0% 0.84 / 0.85 / -0.9%
clickbench_q34/duckdb:vortex-file-compressed 352266665 / 355918903 / -1.0% 409086264 / 413619886 / -1.1% 0.86 / 0.86 / +0.1%
clickbench_q35/duckdb:vortex-file-compressed 57541238 / 57365465 / +0.3% 86657287 / 86709918 / -0.1% 0.66 / 0.66 / +0.4%
clickbench_q36/duckdb:vortex-file-compressed 12199922 / 11723447 / +4.1% 33634820 / 33562054 / +0.2% 0.36 / 0.35 / +3.8%
clickbench_q37/duckdb:vortex-file-compressed 8308708 / 8361176 / -0.6% 27853558 / 26996743 / +3.2% 0.30 / 0.31 / -3.7%
clickbench_q38/duckdb:vortex-file-compressed 8962757 / 8909803 / +0.6% 30043808 / 30843644 / -2.6% 0.30 / 0.29 / +3.3%
clickbench_q39/duckdb:vortex-file-compressed 19055752 / 18999946 / +0.3% 39050334 / 37613113 / +3.8% 0.49 / 0.51 / -3.4%
clickbench_q40/duckdb:vortex-file-compressed 7534998 / 7370124 / +2.2% 27824457 / 26529843 / +4.9% 0.27 / 0.28 / -2.5%
clickbench_q41/duckdb:vortex-file-compressed 8389050 / 8598724 / -2.4% 30751777 / 28272367 / +8.8% 0.27 / 0.30 / -10.3%
clickbench_q42/duckdb:vortex-file-compressed 7404738 / 7495830 / -1.2% 28013912 / 28901927 / -3.1% 0.26 / 0.26 / +1.9%
duckdb / parquet / ns (0.947x ➖, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9380197 / 10797724 / -13.1% 🟢 14213042 / 18605113 / -23.6% 🟢 0.66 / 0.58 / +13.7%
clickbench_q01/duckdb:parquet 14820045 / 16717316 / -11.3% 🟢 19909429 / 23819590 / -16.4% 🟢 0.74 / 0.70 / +6.1%
clickbench_q02/duckdb:parquet 22626960 / 23769554 / -4.8% 31229634 / 37322865 / -16.3% 🟢 0.72 / 0.64 / +13.8%
clickbench_q03/duckdb:parquet 22352561 / 24759099 / -9.7% 33048477 / 39970087 / -17.3% 🟢 0.68 / 0.62 / +9.2%
clickbench_q04/duckdb:parquet 60708012 / 63366229 / -4.2% 72610111 / 76889876 / -5.6% 0.84 / 0.82 / +1.5%
clickbench_q05/duckdb:parquet 81621272 / 83962501 / -2.8% 96416264 / 100774289 / -4.3% 0.85 / 0.83 / +1.6%
clickbench_q06/duckdb:parquet 19893508 / 22418756 / -11.3% 🟢 27989834 / 33357510 / -16.1% 🟢 0.71 / 0.67 / +5.8%
clickbench_q07/duckdb:parquet 17081000 / 19441221 / -12.1% 🟢 22997959 / 27339644 / -15.9% 🟢 0.74 / 0.71 / +4.4%
clickbench_q08/duckdb:parquet 73726410 / 77156283 / -4.4% 89515887 / 92783242 / -3.5% 0.82 / 0.83 / -1.0%
clickbench_q09/duckdb:parquet 102732287 / 104759343 / -1.9% 116945849 / 124194740 / -5.8% 0.88 / 0.84 / +4.1%
clickbench_q10/duckdb:parquet 40970734 / 42038702 / -2.5% 59125795 / 58186266 / +1.6% 0.69 / 0.72 / -4.1%
clickbench_q11/duckdb:parquet 46732164 / 47073260 / -0.7% 59119469 / 70393975 / -16.0% 🟢 0.79 / 0.67 / +18.2%
clickbench_q12/duckdb:parquet 91142354 / 93795314 / -2.8% 105771855 / 113610331 / -6.9% 0.86 / 0.83 / +4.4%
clickbench_q13/duckdb:parquet 148618233 / 152834822 / -2.8% 166764300 / 173877821 / -4.1% 0.89 / 0.88 / +1.4%
clickbench_q14/duckdb:parquet 101511949 / 103057376 / -1.5% 117555783 / 122553118 / -4.1% 0.86 / 0.84 / +2.7%
clickbench_q15/duckdb:parquet 86318656 / 88870914 / -2.9% 101593498 / 105625067 / -3.8% 0.85 / 0.84 / +1.0%
clickbench_q16/duckdb:parquet 164293435 / 177202420 / -7.3% 173862147 / 188864327 / -7.9% 0.94 / 0.94 / +0.7%
clickbench_q17/duckdb:parquet 161822181 / 174046472 / -7.0% 178909759 / 190162332 / -5.9% 0.90 / 0.92 / -1.2%
clickbench_q18/duckdb:parquet 287550810 / 307151655 / -6.4% 315495363 / 335507678 / -6.0% 0.91 / 0.92 / -0.4%
clickbench_q19/duckdb:parquet 19743708 / 21558736 / -8.4% 26710089 / 30803864 / -13.3% 🟢 0.74 / 0.70 / +5.6%
clickbench_q20/duckdb:parquet 185730090 / 192273642 / -3.4% 227484037 / 227699689 / -0.1% 0.82 / 0.84 / -3.3%
clickbench_q21/duckdb:parquet 215345203 / 225117161 / -4.3% 266437870 / 263787242 / +1.0% 0.81 / 0.85 / -5.3%
clickbench_q22/duckdb:parquet 305115248 / 329106270 / -7.3% 357110894 / 354347355 / +0.8% 0.85 / 0.93 / -8.0%
clickbench_q23/duckdb:parquet 170067332 / 174140927 / -2.3% 242528181 / 250175105 / -3.1% 0.70 / 0.70 / +0.7%
clickbench_q24/duckdb:parquet 29726436 / 31603258 / -5.9% 43308563 / 45782240 / -5.4% 0.69 / 0.69 / -0.6%
clickbench_q25/duckdb:parquet 43425321 / 43467346 / -0.1% 57914340 / 59763300 / -3.1% 0.75 / 0.73 / +3.1%
clickbench_q26/duckdb:parquet 30460684 / 31955710 / -4.7% 46809725 / 52975433 / -11.6% 🟢 0.65 / 0.60 / +7.9%
clickbench_q27/duckdb:parquet 187342320 / 195223485 / -4.0% 224778722 / 225929887 / -0.5% 0.83 / 0.86 / -3.5%
clickbench_q28/duckdb:parquet 951012894 / 1002703132 / -5.2% 942138467 / 1009715557 / -6.7% 1.01 / 0.99 / +1.6%
clickbench_q29/duckdb:parquet 24475914 / 26260078 / -6.8% 30447769 / 34520294 / -11.8% 🟢 0.80 / 0.76 / +5.7%
clickbench_q30/duckdb:parquet 105025299 / 107227912 / -2.1% 128475667 / 136145641 / -5.6% 0.82 / 0.79 / +3.8%
clickbench_q31/duckdb:parquet 156637800 / 160289052 / -2.3% 172161192 / 184520003 / -6.7% 0.91 / 0.87 / +4.7%
clickbench_q32/duckdb:parquet 376438639 / 400085102 / -5.9% 409282903 / 415533802 / -1.5% 0.92 / 0.96 / -4.5%
clickbench_q33/duckdb:parquet 471759577 / 481559874 / -2.0% 450391764 / 457928610 / -1.6% 1.05 / 1.05 / -0.4%
clickbench_q34/duckdb:parquet 459708074 / 476689923 / -3.6% 446868115 / 467186964 / -4.3% 1.03 / 1.02 / +0.8%
clickbench_q35/duckdb:parquet 60257208 / 62980015 / -4.3% 72681745 / 76701933 / -5.2% 0.83 / 0.82 / +1.0%
clickbench_q36/duckdb:parquet 30725666 / 32132982 / -4.4% 35338972 / 40825636 / -13.4% 🟢 0.87 / 0.79 / +10.5%
clickbench_q37/duckdb:parquet 23479252 / 24864196 / -5.6% 29179027 / 34312964 / -15.0% 🟢 0.80 / 0.72 / +11.0%
clickbench_q38/duckdb:parquet 23704174 / 25392768 / -6.6% 30058406 / 34956941 / -14.0% 🟢 0.79 / 0.73 / +8.6%
clickbench_q39/duckdb:parquet 53048779 / 54791296 / -3.2% 58886579 / 64067035 / -8.1% 0.90 / 0.86 / +5.3%
clickbench_q40/duckdb:parquet 14437894 / 16298834 / -11.4% 🟢 21007809 / 24453006 / -14.1% 🟢 0.69 / 0.67 / +3.1%
clickbench_q41/duckdb:parquet 15940201 / 15897696 / +0.3% 20732898 / 24739848 / -16.2% 🟢 0.77 / 0.64 / +19.6%
clickbench_q42/duckdb:parquet 14099980 / 15659650 / -10.0% 20061774 / 25965032 / -22.7% 🟢 0.70 / 0.60 / +16.5%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 24638a2f vs base f32cb549
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Engines: DataFusion No clear signal (-4.6%, low confidence) · DuckDB No clear signal (+2.3%, low confidence)
Vortex (geomean): hot 0.972x ➖ · cold 1.033x ➖
Parquet (geomean): hot 0.984x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -1.6% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.954x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6947087 / 6989227 / -0.6% 16454378 / 16231113 / +1.4% 0.42 / 0.43 / -2.0%
fineweb_q01/datafusion:vortex-file-compressed 8308452 / 10749358 / -22.7% 🟢 41711942 / 38402098 / +8.6% 0.20 / 0.28 / -28.8%
fineweb_q02/datafusion:vortex-file-compressed 10907348 / 10201088 / +6.9% 44760468 / 45431757 / -1.5% 0.24 / 0.22 / +8.5%
fineweb_q03/datafusion:vortex-file-compressed 20218268 / 20475004 / -1.3% 104992965 / 98796262 / +6.3% 0.19 / 0.21 / -7.1%
fineweb_q04/datafusion:vortex-file-compressed 66742539 / 67398456 / -1.0% 149599991 / 149775618 / -0.1% 0.45 / 0.45 / -0.9%
fineweb_q05/datafusion:vortex-file-compressed 66785594 / 66834142 / -0.1% 140268718 / 140104951 / +0.1% 0.48 / 0.48 / -0.2%
fineweb_q06/datafusion:vortex-file-compressed 19956719 / 19625709 / +1.7% 105893020 / 100225012 / +5.7% 0.19 / 0.20 / -3.8%
fineweb_q07/datafusion:vortex-file-compressed 19101664 / 18402439 / +3.8% 103210391 / 95986957 / +7.5% 0.19 / 0.19 / -3.5%
fineweb_q08/datafusion:vortex-file-compressed 9040180 / 11685402 / -22.6% 🟢 44592387 / 32868615 / +35.7% 🔴 0.20 / 0.36 / -43.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9394391 / 9192946 / +2.2% 33845886 / 33465712 / +1.1% 0.28 / 0.27 / +1.0%
fineweb_q01/datafusion:parquet 76502430 / 75844274 / +0.9% 158975801 / 142119002 / +11.9% 🔴 0.48 / 0.53 / -9.8%
fineweb_q02/datafusion:parquet 74330354 / 75845454 / -2.0% 155892716 / 147979370 / +5.3% 0.48 / 0.51 / -7.0%
fineweb_q03/datafusion:parquet 73990670 / 75760090 / -2.3% 161889908 / 143555793 / +12.8% 🔴 0.46 / 0.53 / -13.4%
fineweb_q04/datafusion:parquet 81323974 / 82165068 / -1.0% 159086292 / 149335074 / +6.5% 0.51 / 0.55 / -7.1%
fineweb_q05/datafusion:parquet 80989318 / 81163962 / -0.2% 158976769 / 148197490 / +7.3% 0.51 / 0.55 / -7.0%
fineweb_q06/datafusion:parquet 75633130 / 75954318 / -0.4% 160791788 / 152763831 / +5.3% 0.47 / 0.50 / -5.4%
fineweb_q07/datafusion:parquet 75258224 / 73475559 / +2.4% 158252557 / 148409935 / +6.6% 0.48 / 0.50 / -3.9%
fineweb_q08/datafusion:parquet 74283184 / 73599765 / +0.9% 163501140 / 140651351 / +16.2% 🔴 0.45 / 0.52 / -13.2%
duckdb / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2022622 / 2357274 / -14.2% 🟢 7234633 / 7439983 / -2.8% 0.28 / 0.32 / -11.8%
fineweb_q01/duckdb:vortex-file-compressed 9470891 / 9506584 / -0.4% 31665028 / 31697264 / -0.1% 0.30 / 0.30 / -0.3%
fineweb_q02/duckdb:vortex-file-compressed 10996864 / 10717018 / +2.6% 34808948 / 32984444 / +5.5% 0.32 / 0.32 / -2.8%
fineweb_q03/duckdb:vortex-file-compressed 19517532 / 19494676 / +0.1% 90198866 / 90453103 / -0.3% 0.22 / 0.22 / +0.4%
fineweb_q04/duckdb:vortex-file-compressed 67799634 / 66799391 / +1.5% 107269255 / 105020980 / +2.1% 0.63 / 0.64 / -0.6%
fineweb_q05/duckdb:vortex-file-compressed 66531252 / 66885343 / -0.5% 106031239 / 104186141 / +1.8% 0.63 / 0.64 / -2.3%
fineweb_q06/duckdb:vortex-file-compressed 19151520 / 18918092 / +1.2% 92791638 / 91246444 / +1.7% 0.21 / 0.21 / -0.5%
fineweb_q07/duckdb:vortex-file-compressed 18392254 / 18764019 / -2.0% 88547784 / 86704468 / +2.1% 0.21 / 0.22 / -4.0%
fineweb_q08/duckdb:vortex-file-compressed 5769650 / 5525384 / +4.4% 13378391 / 14591042 / -8.3% 0.43 / 0.38 / +13.9%
duckdb / parquet / ns (0.968x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23096199 / 24119152 / -4.2% 27650443 / 29720881 / -7.0% 0.84 / 0.81 / +2.9%
fineweb_q01/duckdb:parquet 53156314 / 56317104 / -5.6% 71563433 / 76181270 / -6.1% 0.74 / 0.74 / +0.5%
fineweb_q02/duckdb:parquet 58149702 / 60212677 / -3.4% 72849975 / 81618011 / -10.7% 🟢 0.80 / 0.74 / +8.2%
fineweb_q03/duckdb:parquet 117770732 / 119768046 / -1.7% 174481240 / 182281801 / -4.3% 0.67 / 0.66 / +2.7%
fineweb_q04/duckdb:parquet 163318906 / 163806008 / -0.3% 202591428 / 224431558 / -9.7% 0.81 / 0.73 / +10.5%
fineweb_q05/duckdb:parquet 154369761 / 157829483 / -2.2% 191331425 / 204535845 / -6.5% 0.81 / 0.77 / +4.6%
fineweb_q06/duckdb:parquet 86569178 / 89585241 / -3.4% 150640459 / 155414070 / -3.1% 0.57 / 0.58 / -0.3%
fineweb_q07/duckdb:parquet 89705869 / 92608614 / -3.1% 141018156 / 154308715 / -8.6% 0.64 / 0.60 / +6.0%
fineweb_q08/duckdb:parquet 28241338 / 29637233 / -4.7% 30242949 / 31568267 / -4.2% 0.93 / 0.94 / -0.5%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 24638a2f vs base f32cb549
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 0.969x ➖
Parquet (geomean): hot 0.986x ➖ · cold 0.970x ➖
Shifts: Parquet (control) -1.4% · Median polish -1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20689598 / 20549879 / +0.7% 37469817 / 38741307 / -3.3% 0.55 / 0.53 / +4.1%
tpcds_q02/datafusion:vortex-file-compressed 44597974 / 44614870 / -0.0% 64387834 / 66365876 / -3.0% 0.69 / 0.67 / +3.0%
tpcds_q03/datafusion:vortex-file-compressed 11168590 / 11072366 / +0.9% 26771509 / 28226108 / -5.2% 0.42 / 0.39 / +6.3%
tpcds_q04/datafusion:vortex-file-compressed 86970691 / 88716300 / -2.0% 116538846 / 116914268 / -0.3% 0.75 / 0.76 / -1.7%
tpcds_q05/datafusion:vortex-file-compressed 57277222 / 56862810 / +0.7% 74381185 / 85709740 / -13.2% 🟢 0.77 / 0.66 / +16.1%
tpcds_q06/datafusion:vortex-file-compressed 22779080 / 22278248 / +2.2% 42188173 / 42269449 / -0.2% 0.54 / 0.53 / +2.4%
tpcds_q07/datafusion:vortex-file-compressed 29423820 / 28884332 / +1.9% 49868944 / 51891538 / -3.9% 0.59 / 0.56 / +6.0%
tpcds_q08/datafusion:vortex-file-compressed 24503755 / 24224192 / +1.2% 43454871 / 44820892 / -3.0% 0.56 / 0.54 / +4.3%
tpcds_q09/datafusion:vortex-file-compressed 22489906 / 20924187 / +7.5% 36763509 / 37792155 / -2.7% 0.61 / 0.55 / +10.5%
tpcds_q10/datafusion:vortex-file-compressed 26664898 / 26899546 / -0.9% 48240490 / 48617267 / -0.8% 0.55 / 0.55 / -0.1%
tpcds_q11/datafusion:vortex-file-compressed 53453784 / 52058084 / +2.7% 81489326 / 82996156 / -1.8% 0.66 / 0.63 / +4.6%
tpcds_q12/datafusion:vortex-file-compressed 14757500 / 14902174 / -1.0% 30944022 / 32645409 / -5.2% 0.48 / 0.46 / +4.5%
tpcds_q13/datafusion:vortex-file-compressed 31084739 / 30622438 / +1.5% 56557079 / 57655754 / -1.9% 0.55 / 0.53 / +3.5%
tpcds_q14/datafusion:vortex-file-compressed 487024335 / 489426114 / -0.5% 543658473 / 546552947 / -0.5% 0.90 / 0.90 / +0.0%
tpcds_q15/datafusion:vortex-file-compressed 12457897 / 12249532 / +1.7% 32542830 / 32887886 / -1.0% 0.38 / 0.37 / +2.8%
tpcds_q16/datafusion:vortex-file-compressed 18295128 / 18118158 / +1.0% 38059205 / 39085392 / -2.6% 0.48 / 0.46 / +3.7%
tpcds_q17/datafusion:vortex-file-compressed 52975250 / 53937796 / -1.8% 69393695 / 66546484 / +4.3% 0.76 / 0.81 / -5.8%
tpcds_q18/datafusion:vortex-file-compressed 62966850 / 63521772 / -0.9% 85507506 / 86774393 / -1.5% 0.74 / 0.73 / +0.6%
tpcds_q19/datafusion:vortex-file-compressed 16366081 / 16685162 / -1.9% 37496932 / 38619487 / -2.9% 0.44 / 0.43 / +1.0%
tpcds_q20/datafusion:vortex-file-compressed 16248034 / 16253544 / -0.0% 33712116 / 36280849 / -7.1% 0.48 / 0.45 / +7.6%
tpcds_q21/datafusion:vortex-file-compressed 16455898 / 16141142 / +2.0% 39434491 / 36607996 / +7.7% 0.42 / 0.44 / -5.4%
tpcds_q22/datafusion:vortex-file-compressed 49315886 / 49166960 / +0.3% 70148691 / 73279057 / -4.3% 0.70 / 0.67 / +4.8%
tpcds_q23/datafusion:vortex-file-compressed 70459785 / 70787934 / -0.5% 95835992 / 96087111 / -0.3% 0.74 / 0.74 / -0.2%
tpcds_q24/datafusion:vortex-file-compressed 64077273 / 64936830 / -1.3% 85452604 / 86961124 / -1.7% 0.75 / 0.75 / +0.4%
tpcds_q25/datafusion:vortex-file-compressed 48391186 / 47896318 / +1.0% 73269051 / 66883720 / +9.5% 0.66 / 0.72 / -7.8%
tpcds_q26/datafusion:vortex-file-compressed 25327846 / 25641802 / -1.2% 46759077 / 46155650 / +1.3% 0.54 / 0.56 / -2.5%
tpcds_q27/datafusion:vortex-file-compressed 57542267 / 56734753 / +1.4% 78835126 / 87581671 / -10.0% 0.73 / 0.65 / +12.7%
tpcds_q28/datafusion:vortex-file-compressed 27057234 / 25502230 / +6.1% 43172752 / 41275997 / +4.6% 0.63 / 0.62 / +1.4%
tpcds_q29/datafusion:vortex-file-compressed 45950816 / 53554875 / -14.2% 🟢 75377233 / 69004975 / +9.2% 0.61 / 0.78 / -21.5%
tpcds_q30/datafusion:vortex-file-compressed 25482380 / 26153657 / -2.6% 43359794 / 45989793 / -5.7% 0.59 / 0.57 / +3.3%
tpcds_q31/datafusion:vortex-file-compressed 58012831 / 58172296 / -0.3% 82611804 / 84571833 / -2.3% 0.70 / 0.69 / +2.1%
tpcds_q32/datafusion:vortex-file-compressed 12366906 / 12561718 / -1.6% 29459680 / 29294285 / +0.6% 0.42 / 0.43 / -2.1%
tpcds_q33/datafusion:vortex-file-compressed 26758896 / 27626796 / -3.1% 47958572 / 51148460 / -6.2% 0.56 / 0.54 / +3.3%
tpcds_q34/datafusion:vortex-file-compressed 17230546 / 17430255 / -1.1% 34730689 / 36653967 / -5.2% 0.50 / 0.48 / +4.3%
tpcds_q35/datafusion:vortex-file-compressed 30297337 / 30241994 / +0.2% 52750515 / 54420629 / -3.1% 0.57 / 0.56 / +3.4%
tpcds_q36/datafusion:vortex-file-compressed 46839218 / 47604114 / -1.6% 67204224 / 71476876 / -6.0% 0.70 / 0.67 / +4.6%
tpcds_q37/datafusion:vortex-file-compressed 11861710 / 11722030 / +1.2% 33582784 / 35231707 / -4.7% 0.35 / 0.33 / +6.2%
tpcds_q38/datafusion:vortex-file-compressed 25893076 / 25519956 / +1.5% 46192532 / 49184278 / -6.1% 0.56 / 0.52 / +8.0%
tpcds_q39/datafusion:vortex-file-compressed 64056402 / 63950288 / +0.2% 89201320 / 89828939 / -0.7% 0.72 / 0.71 / +0.9%
tpcds_q40/datafusion:vortex-file-compressed 23034797 / 23352806 / -1.4% 41255282 / 43670048 / -5.5% 0.56 / 0.53 / +4.4%
tpcds_q41/datafusion:vortex-file-compressed 20213216 / 20129306 / +0.4% 33001847 / 33619493 / -1.8% 0.61 / 0.60 / +2.3%
tpcds_q42/datafusion:vortex-file-compressed 10952866 / 11014502 / -0.6% 25422333 / 26411642 / -3.7% 0.43 / 0.42 / +3.3%
tpcds_q43/datafusion:vortex-file-compressed 12413648 / 12644298 / -1.8% 32636980 / 32563930 / +0.2% 0.38 / 0.39 / -2.0%
tpcds_q44/datafusion:vortex-file-compressed 28630489 / 28797792 / -0.6% 52272844 / 53212889 / -1.8% 0.55 / 0.54 / +1.2%
tpcds_q45/datafusion:vortex-file-compressed 16156720 / 15921694 / +1.5% 33814962 / 35667235 / -5.2% 0.48 / 0.45 / +7.0%
tpcds_q46/datafusion:vortex-file-compressed 22823882 / 23064916 / -1.0% 47130528 / 47409673 / -0.6% 0.48 / 0.49 / -0.5%
tpcds_q47/datafusion:vortex-file-compressed 74844872 / 75390664 / -0.7% 103456401 / 105388892 / -1.8% 0.72 / 0.72 / +1.1%
tpcds_q48/datafusion:vortex-file-compressed 28954819 / 28873245 / +0.3% 50786110 / 51591639 / -1.6% 0.57 / 0.56 / +1.9%
tpcds_q49/datafusion:vortex-file-compressed 58289910 / 57603690 / +1.2% 80332229 / 81751390 / -1.7% 0.73 / 0.70 / +3.0%
tpcds_q50/datafusion:vortex-file-compressed 30754631 / 30834626 / -0.3% 53522390 / 51731425 / +3.5% 0.57 / 0.60 / -3.6%
tpcds_q51/datafusion:vortex-file-compressed 66107088 / 66669710 / -0.8% 86055477 / 89467861 / -3.8% 0.77 / 0.75 / +3.1%
tpcds_q52/datafusion:vortex-file-compressed 11244946 / 11290956 / -0.4% 27425915 / 28086230 / -2.4% 0.41 / 0.40 / +2.0%
tpcds_q53/datafusion:vortex-file-compressed 17614995 / 17607232 / +0.0% 36900330 / 37939559 / -2.7% 0.48 / 0.46 / +2.9%
tpcds_q54/datafusion:vortex-file-compressed 31070621 / 31221556 / -0.5% 54228959 / 54370203 / -0.3% 0.57 / 0.57 / -0.2%
tpcds_q55/datafusion:vortex-file-compressed 10812812 / 10810759 / +0.0% 25282700 / 26389991 / -4.2% 0.43 / 0.41 / +4.4%
tpcds_q56/datafusion:vortex-file-compressed 26377826 / 26433648 / -0.2% 45832983 / 47057830 / -2.6% 0.58 / 0.56 / +2.5%
tpcds_q57/datafusion:vortex-file-compressed 61786974 / 61475790 / +0.5% 85504585 / 88167627 / -3.0% 0.72 / 0.70 / +3.6%
tpcds_q58/datafusion:vortex-file-compressed 37962118 / 38214578 / -0.7% 62399265 / 62648100 / -0.4% 0.61 / 0.61 / -0.3%
tpcds_q59/datafusion:vortex-file-compressed 29578382 / 29643946 / -0.2% 54330584 / 55179113 / -1.5% 0.54 / 0.54 / +1.3%
tpcds_q60/datafusion:vortex-file-compressed 25821200 / 25903412 / -0.3% 45799216 / 48427975 / -5.4% 0.56 / 0.53 / +5.4%
tpcds_q61/datafusion:vortex-file-compressed 21474091 / 21426738 / +0.2% 42653923 / 44086174 / -3.2% 0.50 / 0.49 / +3.6%
tpcds_q62/datafusion:vortex-file-compressed 16210410 / 16328016 / -0.7% 34280916 / 35397817 / -3.2% 0.47 / 0.46 / +2.5%
tpcds_q63/datafusion:vortex-file-compressed 17540505 / 17447194 / +0.5% 38411427 / 38736535 / -0.8% 0.46 / 0.45 / +1.4%
tpcds_q64/datafusion:vortex-file-compressed 211427230 / 213402485 / -0.9% 247504007 / 246331113 / +0.5% 0.85 / 0.87 / -1.4%
tpcds_q65/datafusion:vortex-file-compressed 72908408 / 73589510 / -0.9% 90045039 / 95456499 / -5.7% 0.81 / 0.77 / +5.0%
tpcds_q66/datafusion:vortex-file-compressed 50321988 / 50660266 / -0.7% 71850672 / 73038063 / -1.6% 0.70 / 0.69 / +1.0%
tpcds_q67/datafusion:vortex-file-compressed 50175568 / 50898526 / -1.4% 81268432 / 82320808 / -1.3% 0.62 / 0.62 / -0.1%
tpcds_q68/datafusion:vortex-file-compressed 22790198 / 22904476 / -0.5% 46073085 / 46999796 / -2.0% 0.49 / 0.49 / +1.5%
tpcds_q69/datafusion:vortex-file-compressed 25036744 / 25944613 / -3.5% 44968164 / 49283788 / -8.8% 0.56 / 0.53 / +5.8%
tpcds_q70/datafusion:vortex-file-compressed 71368026 / 70751094 / +0.9% 90632890 / 92025537 / -1.5% 0.79 / 0.77 / +2.4%
tpcds_q71/datafusion:vortex-file-compressed 19218500 / 18753060 / +2.5% 38978034 / 40970612 / -4.9% 0.49 / 0.46 / +7.7%
tpcds_q72/datafusion:vortex-file-compressed 343390070 / 360753650 / -4.8% 394031757 / 389969672 / +1.0% 0.87 / 0.93 / -5.8%
tpcds_q73/datafusion:vortex-file-compressed 15802578 / 16136334 / -2.1% 35876527 / 37127483 / -3.4% 0.44 / 0.43 / +1.3%
tpcds_q74/datafusion:vortex-file-compressed 39521673 / 39738646 / -0.5% 66065084 / 65940979 / +0.2% 0.60 / 0.60 / -0.7%
tpcds_q75/datafusion:vortex-file-compressed 135434502 / 137350814 / -1.4% 156716228 / 163632179 / -4.2% 0.86 / 0.84 / +3.0%
tpcds_q76/datafusion:vortex-file-compressed 29278124 / 29844596 / -1.9% 46551643 / 46540576 / +0.0% 0.63 / 0.64 / -1.9%
tpcds_q77/datafusion:vortex-file-compressed 44414889 / 44467107 / -0.1% 66190810 / 66278718 / -0.1% 0.67 / 0.67 / +0.0%
tpcds_q78/datafusion:vortex-file-compressed 63775548 / 63168882 / +1.0% 87679170 / 92605539 / -5.3% 0.73 / 0.68 / +6.6%
tpcds_q79/datafusion:vortex-file-compressed 19350852 / 19526052 / -0.9% 41415476 / 42465186 / -2.5% 0.47 / 0.46 / +1.6%
tpcds_q80/datafusion:vortex-file-compressed 71738281 / 72957626 / -1.7% 102016543 / 103770404 / -1.7% 0.70 / 0.70 / +0.0%
tpcds_q81/datafusion:vortex-file-compressed 26467264 / 26242004 / +0.9% 43794519 / 44881007 / -2.4% 0.60 / 0.58 / +3.4%
tpcds_q82/datafusion:vortex-file-compressed 11882350 / 11925021 / -0.4% 32561012 / 34564092 / -5.8% 0.36 / 0.35 / +5.8%
tpcds_q83/datafusion:vortex-file-compressed 32588141 / 32268947 / +1.0% 49916901 / 51185234 / -2.5% 0.65 / 0.63 / +3.6%
tpcds_q84/datafusion:vortex-file-compressed 9961962 / 10131528 / -1.7% 25472492 / 25663454 / -0.7% 0.39 / 0.39 / -0.9%
tpcds_q85/datafusion:vortex-file-compressed 53336368 / 53035180 / +0.6% 79439580 / 80126684 / -0.9% 0.67 / 0.66 / +1.4%
tpcds_q86/datafusion:vortex-file-compressed 15860712 / 16084248 / -1.4% 33041242 / 34190687 / -3.4% 0.48 / 0.47 / +2.0%
tpcds_q87/datafusion:vortex-file-compressed 25647897 / 25194401 / +1.8% 46880192 / 49465245 / -5.2% 0.55 / 0.51 / +7.4%
tpcds_q88/datafusion:vortex-file-compressed 31244646 / 31693384 / -1.4% 51133578 / 51738845 / -1.2% 0.61 / 0.61 / -0.2%
tpcds_q89/datafusion:vortex-file-compressed 20822541 / 21195640 / -1.8% 43063966 / 44345813 / -2.9% 0.48 / 0.48 / +1.2%
tpcds_q90/datafusion:vortex-file-compressed 9951070 / 9813798 / +1.4% 23831617 / 25770337 / -7.5% 0.42 / 0.38 / +9.6%
tpcds_q91/datafusion:vortex-file-compressed 16792724 / 17068203 / -1.6% 36696318 / 37815135 / -3.0% 0.46 / 0.45 / +1.4%
tpcds_q92/datafusion:vortex-file-compressed 12742462 / 12754499 / -0.1% 28437004 / 28784995 / -1.2% 0.45 / 0.44 / +1.1%
tpcds_q93/datafusion:vortex-file-compressed 20325998 / 20010852 / +1.6% 40985844 / 41699841 / -1.7% 0.50 / 0.48 / +3.3%
tpcds_q94/datafusion:vortex-file-compressed 17760979 / 18200259 / -2.4% 36114191 / 37914930 / -4.7% 0.49 / 0.48 / +2.5%
tpcds_q95/datafusion:vortex-file-compressed 41849235 / 41815758 / +0.1% 62852029 / 64604179 / -2.7% 0.67 / 0.65 / +2.9%
tpcds_q96/datafusion:vortex-file-compressed 7517967 / 7414539 / +1.4% 25082208 / 25536514 / -1.8% 0.30 / 0.29 / +3.2%
tpcds_q97/datafusion:vortex-file-compressed 17065344 / 16706230 / +2.1% 36610653 / 40642546 / -9.9% 0.47 / 0.41 / +13.4%
tpcds_q98/datafusion:vortex-file-compressed 16159354 / 16458228 / -1.8% 36629307 / 36437473 / +0.5% 0.44 / 0.45 / -2.3%
tpcds_q99/datafusion:vortex-file-compressed 15783882 / 15927414 / -0.9% 33970577 / 35728286 / -4.9% 0.46 / 0.45 / +4.2%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42026588 / 42352366 / -0.8% 58751174 / 61185169 / -4.0% 0.72 / 0.69 / +3.3%
tpcds_q02/datafusion:parquet 54038932 / 56136877 / -3.7% 68185380 / 70436730 / -3.2% 0.79 / 0.80 / -0.6%
tpcds_q03/datafusion:parquet 18886367 / 19171230 / -1.5% 32672898 / 31889286 / +2.5% 0.58 / 0.60 / -3.8%
tpcds_q04/datafusion:parquet 178601312 / 180679291 / -1.2% 205461405 / 201046072 / +2.2% 0.87 / 0.90 / -3.3%
tpcds_q05/datafusion:parquet 67841692 / 68801566 / -1.4% 88038882 / 90612148 / -2.8% 0.77 / 0.76 / +1.5%
tpcds_q06/datafusion:parquet 33537638 / 33214879 / +1.0% 47230641 / 49093963 / -3.8% 0.71 / 0.68 / +5.0%
tpcds_q07/datafusion:parquet 47002319 / 46610918 / +0.8% 63162248 / 69657045 / -9.3% 0.74 / 0.67 / +11.2%
tpcds_q08/datafusion:parquet 30763974 / 31628366 / -2.7% 46811566 / 49080386 / -4.6% 0.66 / 0.64 / +2.0%
tpcds_q09/datafusion:parquet 32389174 / 31082336 / +4.2% 35702226 / 42952471 / -16.9% 🟢 0.91 / 0.72 / +25.4%
tpcds_q10/datafusion:parquet 44296836 / 44510829 / -0.5% 59232719 / 58458035 / +1.3% 0.75 / 0.76 / -1.8%
tpcds_q11/datafusion:parquet 96585751 / 98179642 / -1.6% 117450939 / 121222373 / -3.1% 0.82 / 0.81 / +1.5%
tpcds_q12/datafusion:parquet 23543963 / 23943584 / -1.7% 36825042 / 35887127 / +2.6% 0.64 / 0.67 / -4.2%
tpcds_q13/datafusion:parquet 45858017 / 46291397 / -0.9% 66281865 / 65994687 / +0.4% 0.69 / 0.70 / -1.4%
tpcds_q14/datafusion:parquet 534143888 / 539076244 / -0.9% 578031357 / 582218065 / -0.7% 0.92 / 0.93 / -0.2%
tpcds_q15/datafusion:parquet 23715271 / 23576772 / +0.6% 37708955 / 37517259 / +0.5% 0.63 / 0.63 / +0.1%
tpcds_q16/datafusion:parquet 35835203 / 37626809 / -4.8% 49817753 / 51433458 / -3.1% 0.72 / 0.73 / -1.7%
tpcds_q17/datafusion:parquet 73581992 / 73737643 / -0.2% 95243048 / 96107359 / -0.9% 0.77 / 0.77 / +0.7%
tpcds_q18/datafusion:parquet 64998516 / 67429882 / -3.6% 87972932 / 88126444 / -0.2% 0.74 / 0.77 / -3.4%
tpcds_q19/datafusion:parquet 29896324 / 29886140 / +0.0% 40968526 / 42329355 / -3.2% 0.73 / 0.71 / +3.4%
tpcds_q20/datafusion:parquet 25127980 / 25320150 / -0.8% 37048124 / 38117231 / -2.8% 0.68 / 0.66 / +2.1%
tpcds_q21/datafusion:parquet 19998195 / 20249864 / -1.2% 34043398 / 32910624 / +3.4% 0.59 / 0.62 / -4.5%
tpcds_q22/datafusion:parquet 76633502 / 77918234 / -1.6% 88466520 / 89718492 / -1.4% 0.87 / 0.87 / -0.3%
tpcds_q23/datafusion:parquet 92801475 / 90455186 / +2.6% 111454926 / 118036230 / -5.6% 0.83 / 0.77 / +8.7%
tpcds_q24/datafusion:parquet 90599982 / 91212994 / -0.7% 113422498 / 116673547 / -2.8% 0.80 / 0.78 / +2.2%
tpcds_q25/datafusion:parquet 82316674 / 78004550 / +5.5% 94898389 / 104009961 / -8.8% 0.87 / 0.75 / +15.7%
tpcds_q26/datafusion:parquet 43199945 / 42233064 / +2.3% 59994787 / 61304319 / -2.1% 0.72 / 0.69 / +4.5%
tpcds_q27/datafusion:parquet 75156914 / 76533054 / -1.8% 97866173 / 101333140 / -3.4% 0.77 / 0.76 / +1.7%
tpcds_q28/datafusion:parquet 28235198 / 29056008 / -2.8% 41987581 / 44675182 / -6.0% 0.67 / 0.65 / +3.4%
tpcds_q29/datafusion:parquet 75902266 / 74628442 / +1.7% 93580085 / 98764157 / -5.2% 0.81 / 0.76 / +7.3%
tpcds_q30/datafusion:parquet 44012693 / 45779622 / -3.9% 55573734 / 61618022 / -9.8% 0.79 / 0.74 / +6.6%
tpcds_q31/datafusion:parquet 79428850 / 79653369 / -0.3% 97551256 / 100325198 / -2.8% 0.81 / 0.79 / +2.6%
tpcds_q32/datafusion:parquet 25800602 / 27051918 / -4.6% 38894767 / 41399203 / -6.0% 0.66 / 0.65 / +1.5%
tpcds_q33/datafusion:parquet 38331126 / 36837436 / +4.1% 53868324 / 49666743 / +8.5% 0.71 / 0.74 / -4.1%
tpcds_q34/datafusion:parquet 24298480 / 24637724 / -1.4% 35784502 / 36800616 / -2.8% 0.68 / 0.67 / +1.4%
tpcds_q35/datafusion:parquet 49635736 / 50763456 / -2.2% 65996468 / 66107813 / -0.2% 0.75 / 0.77 / -2.1%
tpcds_q36/datafusion:parquet 51769970 / 52689336 / -1.7% 72503774 / 72976898 / -0.6% 0.71 / 0.72 / -1.1%
tpcds_q37/datafusion:parquet 21172226 / 21088529 / +0.4% 33437732 / 35148441 / -4.9% 0.63 / 0.60 / +5.5%
tpcds_q38/datafusion:parquet 44315406 / 45550080 / -2.7% 59967064 / 63069906 / -4.9% 0.74 / 0.72 / +2.3%
tpcds_q39/datafusion:parquet 67570545 / 67733310 / -0.2% 84604442 / 86188187 / -1.8% 0.80 / 0.79 / +1.6%
tpcds_q40/datafusion:parquet 31072585 / 31059358 / +0.0% 49051067 / 50169068 / -2.2% 0.63 / 0.62 / +2.3%
tpcds_q41/datafusion:parquet 19707053 / 19435113 / +1.4% 31954757 / 32597654 / -2.0% 0.62 / 0.60 / +3.4%
tpcds_q42/datafusion:parquet 18023730 / 18312226 / -1.6% 29832883 / 30818828 / -3.2% 0.60 / 0.59 / +1.7%
tpcds_q43/datafusion:parquet 19178854 / 19169418 / +0.0% 32144635 / 33253819 / -3.3% 0.60 / 0.58 / +3.5%
tpcds_q44/datafusion:parquet 35077847 / 35593682 / -1.4% 49471710 / 52554185 / -5.9% 0.71 / 0.68 / +4.7%
tpcds_q45/datafusion:parquet 27709036 / 25790112 / +7.4% 40644432 / 41518840 / -2.1% 0.68 / 0.62 / +9.8%
tpcds_q46/datafusion:parquet 28608166 / 30129448 / -5.0% 45121785 / 46625473 / -3.2% 0.63 / 0.65 / -1.9%
tpcds_q47/datafusion:parquet 97928756 / 98745420 / -0.8% 117694569 / 122671705 / -4.1% 0.83 / 0.80 / +3.4%
tpcds_q48/datafusion:parquet 41727310 / 41734256 / -0.0% 59102286 / 59346278 / -0.4% 0.71 / 0.70 / +0.4%
tpcds_q49/datafusion:parquet 72353195 / 73556530 / -1.6% 90182859 / 96668503 / -6.7% 0.80 / 0.76 / +5.4%
tpcds_q50/datafusion:parquet 47236454 / 48057268 / -1.7% 68696557 / 67943173 / +1.1% 0.69 / 0.71 / -2.8%
tpcds_q51/datafusion:parquet 75427690 / 76465480 / -1.4% 93612842 / 96460972 / -3.0% 0.81 / 0.79 / +1.6%
tpcds_q52/datafusion:parquet 18516447 / 18786536 / -1.4% 30307519 / 30715337 / -1.3% 0.61 / 0.61 / -0.1%
tpcds_q53/datafusion:parquet 22815288 / 23276998 / -2.0% 37913319 / 39921957 / -5.0% 0.60 / 0.58 / +3.2%
tpcds_q54/datafusion:parquet 54229530 / 52748653 / +2.8% 67884428 / 68890152 / -1.5% 0.80 / 0.77 / +4.3%
tpcds_q55/datafusion:parquet 18207754 / 18545792 / -1.8% 31633881 / 31081410 / +1.8% 0.58 / 0.60 / -3.5%
tpcds_q56/datafusion:parquet 38885108 / 41413638 / -6.1% 53705688 / 58577155 / -8.3% 0.72 / 0.71 / +2.4%
tpcds_q57/datafusion:parquet 99502434 / 102349730 / -2.8% 114269618 / 114650804 / -0.3% 0.87 / 0.89 / -2.5%
tpcds_q58/datafusion:parquet 65288474 / 65680446 / -0.6% 80185498 / 84077023 / -4.6% 0.81 / 0.78 / +4.2%
tpcds_q59/datafusion:parquet 47857972 / 48480860 / -1.3% 63003150 / 66901182 / -5.8% 0.76 / 0.72 / +4.8%
tpcds_q60/datafusion:parquet 40902034 / 39814664 / +2.7% 54977158 / 57070053 / -3.7% 0.74 / 0.70 / +6.6%
tpcds_q61/datafusion:parquet 36579576 / 36261650 / +0.9% 49095433 / 52078629 / -5.7% 0.75 / 0.70 / +7.0%
tpcds_q62/datafusion:parquet 25085608 / 24844404 / +1.0% 38310564 / 38771579 / -1.2% 0.65 / 0.64 / +2.2%
tpcds_q63/datafusion:parquet 22194166 / 22156886 / +0.2% 37908039 / 39361093 / -3.7% 0.59 / 0.56 / +4.0%
tpcds_q64/datafusion:parquet 287225009 / 290151963 / -1.0% 322333356 / 326798201 / -1.4% 0.89 / 0.89 / +0.4%
tpcds_q65/datafusion:parquet 123561099 / 124880454 / -1.1% 139909846 / 136097037 / +2.8% 0.88 / 0.92 / -3.8%
tpcds_q66/datafusion:parquet 58928090 / 59632613 / -1.2% 79637855 / 75854926 / +5.0% 0.74 / 0.79 / -5.9%
tpcds_q67/datafusion:parquet 68459737 / 69015732 / -0.8% 92521477 / 93150255 / -0.7% 0.74 / 0.74 / -0.1%
tpcds_q68/datafusion:parquet 28678664 / 29748963 / -3.6% 48687832 / 50308494 / -3.2% 0.59 / 0.59 / -0.4%
tpcds_q69/datafusion:parquet 43616160 / 43934117 / -0.7% 54038959 / 56338732 / -4.1% 0.81 / 0.78 / +3.5%
tpcds_q70/datafusion:parquet 80756433 / 80527606 / +0.3% 97202736 / 99699229 / -2.5% 0.83 / 0.81 / +2.9%
tpcds_q71/datafusion:parquet 24995919 / 25770670 / -3.0% 37543804 / 37574943 / -0.1% 0.67 / 0.69 / -2.9%
tpcds_q72/datafusion:parquet 523508470 / 522863043 / +0.1% 548249043 / 550788829 / -0.5% 0.95 / 0.95 / +0.6%
tpcds_q73/datafusion:parquet 23660252 / 23958508 / -1.2% 35817633 / 37968404 / -5.7% 0.66 / 0.63 / +4.7%
tpcds_q74/datafusion:parquet 69653474 / 70836786 / -1.7% 91877475 / 92025630 / -0.2% 0.76 / 0.77 / -1.5%
tpcds_q75/datafusion:parquet 152100790 / 152157535 / -0.0% 184620368 / 177930818 / +3.8% 0.82 / 0.86 / -3.7%
tpcds_q76/datafusion:parquet 34001224 / 33908222 / +0.3% 46949625 / 47437402 / -1.0% 0.72 / 0.71 / +1.3%
tpcds_q77/datafusion:parquet 56433638 / 55904908 / +0.9% 70112935 / 76481574 / -8.3% 0.80 / 0.73 / +10.1%
tpcds_q78/datafusion:parquet 85209370 / 85826355 / -0.7% 118151919 / 119765402 / -1.3% 0.72 / 0.72 / +0.6%
tpcds_q79/datafusion:parquet 26541412 / 27344368 / -2.9% 41011969 / 42836709 / -4.3% 0.65 / 0.64 / +1.4%
tpcds_q80/datafusion:parquet 80696839 / 80548298 / +0.2% 108638223 / 111812437 / -2.8% 0.74 / 0.72 / +3.1%
tpcds_q81/datafusion:parquet 39394876 / 38305735 / +2.8% 50285430 / 50827110 / -1.1% 0.78 / 0.75 / +4.0%
tpcds_q82/datafusion:parquet 22423160 / 22196710 / +1.0% 35178213 / 37780986 / -6.9% 0.64 / 0.59 / +8.5%
tpcds_q83/datafusion:parquet 58116064 / 59833134 / -2.9% 70870186 / 75288497 / -5.9% 0.82 / 0.79 / +3.2%
tpcds_q84/datafusion:parquet 26308608 / 26454348 / -0.6% 40086119 / 41245465 / -2.8% 0.66 / 0.64 / +2.3%
tpcds_q85/datafusion:parquet 80273390 / 80929950 / -0.8% 101697739 / 104818336 / -3.0% 0.79 / 0.77 / +2.2%
tpcds_q86/datafusion:parquet 20551708 / 20922359 / -1.8% 33242869 / 34047448 / -2.4% 0.62 / 0.61 / +0.6%
tpcds_q87/datafusion:parquet 45412220 / 45158465 / +0.6% 62183875 / 60066186 / +3.5% 0.73 / 0.75 / -2.9%
tpcds_q88/datafusion:parquet 36579366 / 37023632 / -1.2% 49531226 / 50881537 / -2.7% 0.74 / 0.73 / +1.5%
tpcds_q89/datafusion:parquet 25368718 / 25679367 / -1.2% 41291985 / 42512782 / -2.9% 0.61 / 0.60 / +1.7%
tpcds_q90/datafusion:parquet 15053292 / 14563930 / +3.4% 27565102 / 27334431 / +0.8% 0.55 / 0.53 / +2.5%
tpcds_q91/datafusion:parquet 32257980 / 31631853 / +2.0% 46881651 / 46735033 / +0.3% 0.69 / 0.68 / +1.7%
tpcds_q92/datafusion:parquet 26860726 / 27221358 / -1.3% 39982369 / 41387657 / -3.4% 0.67 / 0.66 / +2.1%
tpcds_q93/datafusion:parquet 27190866 / 26714684 / +1.8% 45667688 / 47749504 / -4.4% 0.60 / 0.56 / +6.4%
tpcds_q94/datafusion:parquet 35301224 / 35460300 / -0.4% 48959270 / 49112763 / -0.3% 0.72 / 0.72 / -0.1%
tpcds_q95/datafusion:parquet 63910272 / 63942448 / -0.1% 78337259 / 77594324 / +1.0% 0.82 / 0.82 / -1.0%
tpcds_q96/datafusion:parquet 13016117 / 12773660 / +1.9% 24020175 / 24614311 / -2.4% 0.54 / 0.52 / +4.4%
tpcds_q97/datafusion:parquet 35159502 / 35743544 / -1.6% 51593100 / 52186327 / -1.1% 0.68 / 0.68 / -0.5%
tpcds_q98/datafusion:parquet 24489596 / 24921468 / -1.7% 37282388 / 40262932 / -7.4% 0.66 / 0.62 / +6.1%
tpcds_q99/datafusion:parquet 29793338 / 29822610 / -0.1% 42718435 / 42396609 / +0.8% 0.70 / 0.70 / -0.9%
duckdb / vortex-file-compressed / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16136254 / 16302669 / -1.0% 24591144 / 25464128 / -3.4% 0.66 / 0.64 / +2.5%
tpcds_q02/duckdb:vortex-file-compressed 15560378 / 16219345 / -4.1% 22983287 / 23584289 / -2.5% 0.68 / 0.69 / -1.6%
tpcds_q03/duckdb:vortex-file-compressed 7120488 / 7166510 / -0.6% 15562027 / 16412012 / -5.2% 0.46 / 0.44 / +4.8%
tpcds_q04/duckdb:vortex-file-compressed 45677993 / 46436842 / -1.6% 55817136 / 57197871 / -2.4% 0.82 / 0.81 / +0.8%
tpcds_q05/duckdb:vortex-file-compressed 22865163 / 23664064 / -3.4% 32730058 / 34840048 / -6.1% 0.70 / 0.68 / +2.9%
tpcds_q06/duckdb:vortex-file-compressed 24224308 / 24801048 / -2.3% 37861336 / 38882440 / -2.6% 0.64 / 0.64 / +0.3%
tpcds_q07/duckdb:vortex-file-compressed 13253752 / 13799439 / -4.0% 24016649 / 24774294 / -3.1% 0.55 / 0.56 / -0.9%
tpcds_q08/duckdb:vortex-file-compressed 17260016 / 17918551 / -3.7% 25314508 / 25890394 / -2.2% 0.68 / 0.69 / -1.5%
tpcds_q09/duckdb:vortex-file-compressed 19265632 / 19497705 / -1.2% 30695906 / 29275572 / +4.9% 0.63 / 0.67 / -5.8%
tpcds_q10/duckdb:vortex-file-compressed 27556023 / 28341988 / -2.8% 39706938 / 42341953 / -6.2% 0.69 / 0.67 / +3.7%
tpcds_q11/duckdb:vortex-file-compressed 36885506 / 36722674 / +0.4% 45661356 / 45680929 / -0.0% 0.81 / 0.80 / +0.5%
tpcds_q12/duckdb:vortex-file-compressed 10381360 / 10479346 / -0.9% 16543409 / 17583396 / -5.9% 0.63 / 0.60 / +5.3%
tpcds_q13/duckdb:vortex-file-compressed 20493696 / 21403491 / -4.3% 31694733 / 34048277 / -6.9% 0.65 / 0.63 / +2.9%
tpcds_q14/duckdb:vortex-file-compressed 55596734 / 57675859 / -3.6% 66109839 / 68847256 / -4.0% 0.84 / 0.84 / +0.4%
tpcds_q15/duckdb:vortex-file-compressed 11220014 / 11434258 / -1.9% 18528940 / 17843876 / +3.8% 0.61 / 0.64 / -5.5%
tpcds_q16/duckdb:vortex-file-compressed 24356684 / 24422870 / -0.3% 34477582 / 35255889 / -2.2% 0.71 / 0.69 / +2.0%
tpcds_q17/duckdb:vortex-file-compressed 24256662 / 25101342 / -3.4% 35307918 / 37129267 / -4.9% 0.69 / 0.68 / +1.6%
tpcds_q18/duckdb:vortex-file-compressed 31683520 / 31820490 / -0.4% 41291218 / 43338047 / -4.7% 0.77 / 0.73 / +4.5%
tpcds_q19/duckdb:vortex-file-compressed 77860278 / 78036552 / -0.2% 87512695 / 89508998 / -2.2% 0.89 / 0.87 / +2.1%
tpcds_q20/duckdb:vortex-file-compressed 10941322 / 11142881 / -1.8% 17938839 / 18847915 / -4.8% 0.61 / 0.59 / +3.2%
tpcds_q21/duckdb:vortex-file-compressed 9595212 / 9641825 / -0.5% 21792649 / 23045613 / -5.4% 0.44 / 0.42 / +5.2%
tpcds_q22/duckdb:vortex-file-compressed 17706090 / 17941810 / -1.3% 30839768 / 29191484 / +5.6% 0.57 / 0.61 / -6.6%
tpcds_q23/duckdb:vortex-file-compressed 38351490 / 38836348 / -1.2% 47972275 / 49788600 / -3.6% 0.80 / 0.78 / +2.5%
tpcds_q24/duckdb:vortex-file-compressed 26439996 / 26647442 / -0.8% 36401219 / 39318621 / -7.4% 0.73 / 0.68 / +7.2%
tpcds_q25/duckdb:vortex-file-compressed 23090822 / 23656519 / -2.4% 33465456 / 36110717 / -7.3% 0.69 / 0.66 / +5.3%
tpcds_q26/duckdb:vortex-file-compressed 12847898 / 13452554 / -4.5% 20837457 / 21489823 / -3.0% 0.62 / 0.63 / -1.5%
tpcds_q27/duckdb:vortex-file-compressed 15884945 / 16131790 / -1.5% 25606976 / 28082111 / -8.8% 0.62 / 0.57 / +8.0%
tpcds_q28/duckdb:vortex-file-compressed 15151556 / 15339190 / -1.2% 25980622 / 25990689 / -0.0% 0.58 / 0.59 / -1.2%
tpcds_q29/duckdb:vortex-file-compressed 22402744 / 23524112 / -4.8% 33367349 / 35799723 / -6.8% 0.67 / 0.66 / +2.2%
tpcds_q30/duckdb:vortex-file-compressed 16304924 / 16371048 / -0.4% 24165887 / 25582759 / -5.5% 0.67 / 0.64 / +5.4%
tpcds_q31/duckdb:vortex-file-compressed 17954786 / 18392612 / -2.4% 26591414 / 27379713 / -2.9% 0.68 / 0.67 / +0.5%
tpcds_q32/duckdb:vortex-file-compressed 12075026 / 12281980 / -1.7% 20843545 / 21533889 / -3.2% 0.58 / 0.57 / +1.6%
tpcds_q33/duckdb:vortex-file-compressed 18936606 / 18729074 / +1.1% 28721331 / 28163580 / +2.0% 0.66 / 0.67 / -0.9%
tpcds_q34/duckdb:vortex-file-compressed 12911310 / 13461786 / -4.1% 21890786 / 23075986 / -5.1% 0.59 / 0.58 / +1.1%
tpcds_q35/duckdb:vortex-file-compressed 27535168 / 28721788 / -4.1% 37898372 / 41273001 / -8.2% 0.73 / 0.70 / +4.4%
tpcds_q36/duckdb:vortex-file-compressed 14004250 / 14830046 / -5.6% 23698403 / 25703405 / -7.8% 0.59 / 0.58 / +2.4%
tpcds_q37/duckdb:vortex-file-compressed 9471757 / 9613262 / -1.5% 24334435 / 24674457 / -1.4% 0.39 / 0.39 / -0.1%
tpcds_q38/duckdb:vortex-file-compressed 24359392 / 24799848 / -1.8% 31994284 / 32713392 / -2.2% 0.76 / 0.76 / +0.4%
tpcds_q39/duckdb:vortex-file-compressed 18995922 / 19004107 / -0.0% 31709360 / 29852822 / +6.2% 0.60 / 0.64 / -5.9%
tpcds_q40/duckdb:vortex-file-compressed 14284260 / 14152412 / +0.9% 20230816 / 21742628 / -7.0% 0.71 / 0.65 / +8.5%
tpcds_q41/duckdb:vortex-file-compressed 18810526 / 19124610 / -1.6% 25506303 / 26152006 / -2.5% 0.74 / 0.73 / +0.8%
tpcds_q42/duckdb:vortex-file-compressed 6968824 / 7052436 / -1.2% 16144204 / 16360599 / -1.3% 0.43 / 0.43 / +0.1%
tpcds_q43/duckdb:vortex-file-compressed 9776297 / 10034098 / -2.6% 18914630 / 19347173 / -2.2% 0.52 / 0.52 / -0.3%
tpcds_q44/duckdb:vortex-file-compressed 12423490 / 12649132 / -1.8% 23551584 / 24377822 / -3.4% 0.53 / 0.52 / +1.7%
tpcds_q45/duckdb:vortex-file-compressed 23780673 / 24381477 / -2.5% 30322640 / 32315946 / -6.2% 0.78 / 0.75 / +3.9%
tpcds_q46/duckdb:vortex-file-compressed 19003192 / 20126906 / -5.6% 28091597 / 28559114 / -1.6% 0.68 / 0.70 / -4.0%
tpcds_q47/duckdb:vortex-file-compressed 35138348 / 34454213 / +2.0% 43518483 / 44769119 / -2.8% 0.81 / 0.77 / +4.9%
tpcds_q48/duckdb:vortex-file-compressed 23264362 / 23111814 / +0.7% 34015253 / 37155290 / -8.5% 0.68 / 0.62 / +10.0%
tpcds_q49/duckdb:vortex-file-compressed 18651986 / 19166280 / -2.7% 30071887 / 31758871 / -5.3% 0.62 / 0.60 / +2.8%
tpcds_q50/duckdb:vortex-file-compressed 16325132 / 17795412 / -8.3% 27410977 / 28631543 / -4.3% 0.60 / 0.62 / -4.2%
tpcds_q51/duckdb:vortex-file-compressed 49378385 / 49392112 / -0.0% 78046945 / 60449542 / +29.1% 🔴 0.63 / 0.82 / -22.6%
tpcds_q52/duckdb:vortex-file-compressed 7145176 / 7228938 / -1.2% 15514877 / 16630026 / -6.7% 0.46 / 0.43 / +5.9%
tpcds_q53/duckdb:vortex-file-compressed 11566162 / 11850370 / -2.4% 20818626 / 21464072 / -3.0% 0.56 / 0.55 / +0.6%
tpcds_q54/duckdb:vortex-file-compressed 20474691 / 20896674 / -2.0% 30323383 / 30443333 / -0.4% 0.68 / 0.69 / -1.6%
tpcds_q55/duckdb:vortex-file-compressed 7065218 / 7143260 / -1.1% 15708195 / 16233358 / -3.2% 0.45 / 0.44 / +2.2%
tpcds_q56/duckdb:vortex-file-compressed 17935870 / 18577632 / -3.5% 27823261 / 29582864 / -5.9% 0.64 / 0.63 / +2.7%
tpcds_q57/duckdb:vortex-file-compressed 26158440 / 26246972 / -0.3% 33690540 / 34842579 / -3.3% 0.78 / 0.75 / +3.1%
tpcds_q58/duckdb:vortex-file-compressed 20512927 / 21028704 / -2.5% 30045186 / 30757104 / -2.3% 0.68 / 0.68 / -0.1%
tpcds_q59/duckdb:vortex-file-compressed 19564745 / 19863457 / -1.5% 26653474 / 28767490 / -7.3% 0.73 / 0.69 / +6.3%
tpcds_q60/duckdb:vortex-file-compressed 18890977 / 19059973 / -0.9% 28788597 / 29200567 / -1.4% 0.66 / 0.65 / +0.5%
tpcds_q61/duckdb:vortex-file-compressed 25512447 / 25551646 / -0.2% 35139912 / 34802234 / +1.0% 0.73 / 0.73 / -1.1%
tpcds_q62/duckdb:vortex-file-compressed 11574084 / 12018830 / -3.7% 18022181 / 18869234 / -4.5% 0.64 / 0.64 / +0.8%
tpcds_q63/duckdb:vortex-file-compressed 11063628 / 11308482 / -2.2% 19640487 / 21101528 / -6.9% 0.56 / 0.54 / +5.1%
tpcds_q64/duckdb:vortex-file-compressed 49686176 / 50622490 / -1.8% 64063854 / 66208905 / -3.2% 0.78 / 0.76 / +1.4%
tpcds_q65/duckdb:vortex-file-compressed 13055901 / 13378476 / -2.4% 22821048 / 24689484 / -7.6% 0.57 / 0.54 / +5.6%
tpcds_q66/duckdb:vortex-file-compressed 30580428 / 30028144 / +1.8% 35065946 / 42311063 / -17.1% 🟢 0.87 / 0.71 / +22.9%
tpcds_q67/duckdb:vortex-file-compressed 58489801 / 58384050 / +0.2% 66691038 / 66927168 / -0.4% 0.88 / 0.87 / +0.5%
tpcds_q68/duckdb:vortex-file-compressed 19381560 / 19831084 / -2.3% 27968327 / 28021465 / -0.2% 0.69 / 0.71 / -2.1%
tpcds_q69/duckdb:vortex-file-compressed 22289774 / 23297030 / -4.3% 35623728 / 39239656 / -9.2% 0.63 / 0.59 / +5.4%
tpcds_q70/duckdb:vortex-file-compressed 16027906 / 16278697 / -1.5% 27208476 / 28628195 / -5.0% 0.59 / 0.57 / +3.6%
tpcds_q71/duckdb:vortex-file-compressed 12847488 / 13375014 / -3.9% 23737298 / 24583843 / -3.4% 0.54 / 0.54 / -0.5%
tpcds_q72/duckdb:vortex-file-compressed 51699217 / 53976603 / -4.2% 61751724 / 66495971 / -7.1% 0.84 / 0.81 / +3.1%
tpcds_q73/duckdb:vortex-file-compressed 11988154 / 11985579 / +0.0% 20855528 / 21827397 / -4.5% 0.57 / 0.55 / +4.7%
tpcds_q74/duckdb:vortex-file-compressed 26157152 / 26257884 / -0.4% 34344764 / 33907006 / +1.3% 0.76 / 0.77 / -1.7%
tpcds_q75/duckdb:vortex-file-compressed 27888814 / 28526634 / -2.2% 37858989 / 40443309 / -6.4% 0.74 / 0.71 / +4.4%
tpcds_q76/duckdb:vortex-file-compressed 12724589 / 13698618 / -7.1% 21760237 / 25948533 / -16.1% 🟢 0.58 / 0.53 / +10.8%
tpcds_q77/duckdb:vortex-file-compressed 21156328 / 21173408 / -0.1% 30838661 / 33630290 / -8.3% 0.69 / 0.63 / +9.0%
tpcds_q78/duckdb:vortex-file-compressed 42589590 / 44128875 / -3.5% 52946424 / 54268520 / -2.4% 0.80 / 0.81 / -1.1%
tpcds_q79/duckdb:vortex-file-compressed 13026905 / 13597855 / -4.2% 22159690 / 23074647 / -4.0% 0.59 / 0.59 / -0.2%
tpcds_q80/duckdb:vortex-file-compressed 36850494 / 38377874 / -4.0% 50229327 / 51967738 / -3.3% 0.73 / 0.74 / -0.7%
tpcds_q81/duckdb:vortex-file-compressed 21549684 / 21830323 / -1.3% 29449435 / 30769475 / -4.3% 0.73 / 0.71 / +3.1%
tpcds_q82/duckdb:vortex-file-compressed 9584402 / 9818386 / -2.4% 23441681 / 25553845 / -8.3% 0.41 / 0.38 / +6.4%
tpcds_q83/duckdb:vortex-file-compressed 17544454 / 18001625 / -2.5% 24665557 / 25760188 / -4.2% 0.71 / 0.70 / +1.8%
tpcds_q84/duckdb:vortex-file-compressed 15614024 / 15651368 / -0.2% 22788141 / 23614289 / -3.5% 0.69 / 0.66 / +3.4%
tpcds_q85/duckdb:vortex-file-compressed 24316037 / 24754574 / -1.8% 35934255 / 37136693 / -3.2% 0.68 / 0.67 / +1.5%
tpcds_q86/duckdb:vortex-file-compressed 9781410 / 10031428 / -2.5% 16239812 / 17183151 / -5.5% 0.60 / 0.58 / +3.2%
tpcds_q87/duckdb:vortex-file-compressed 26115579 / 26466829 / -1.3% 34598562 / 34271022 / +1.0% 0.75 / 0.77 / -2.3%
tpcds_q88/duckdb:vortex-file-compressed 29821304 / 31756526 / -6.1% 37492638 / 40756674 / -8.0% 0.80 / 0.78 / +2.1%
tpcds_q89/duckdb:vortex-file-compressed 12150874 / 12440840 / -2.3% 21063895 / 22177022 / -5.0% 0.58 / 0.56 / +2.8%
tpcds_q90/duckdb:vortex-file-compressed 7988800 / 8477870 / -5.8% 14960268 / 16269240 / -8.0% 0.53 / 0.52 / +2.5%
tpcds_q91/duckdb:vortex-file-compressed 14761364 / 14922348 / -1.1% 21955052 / 23928006 / -8.2% 0.67 / 0.62 / +7.8%
tpcds_q92/duckdb:vortex-file-compressed 12294010 / 12344877 / -0.4% 20782743 / 20781806 / +0.0% 0.59 / 0.59 / -0.4%
tpcds_q93/duckdb:vortex-file-compressed 10157170 / 10729464 / -5.3% 21835373 / 24429741 / -10.6% 🟢 0.47 / 0.44 / +5.9%
tpcds_q94/duckdb:vortex-file-compressed 22316594 / 22426428 / -0.5% 31801552 / 33026936 / -3.7% 0.70 / 0.68 / +3.3%
tpcds_q95/duckdb:vortex-file-compressed 62489274 / 62913132 / -0.7% 71307001 / 71426917 / -0.2% 0.88 / 0.88 / -0.5%
tpcds_q96/duckdb:vortex-file-compressed 6406758 / 7285878 / -12.1% 🟢 15217013 / 15727385 / -3.2% 0.42 / 0.46 / -9.1%
tpcds_q97/duckdb:vortex-file-compressed 23286138 / 23256281 / +0.1% 31807943 / 32105590 / -0.9% 0.73 / 0.72 / +1.1%
tpcds_q98/duckdb:vortex-file-compressed 11423238 / 11561181 / -1.2% 19951415 / 19865234 / +0.4% 0.57 / 0.58 / -1.6%
tpcds_q99/duckdb:vortex-file-compressed 14424860 / 15088850 / -4.4% 22264618 / 23402942 / -4.9% 0.65 / 0.64 / +0.5%
duckdb / parquet / ns (0.978x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24084142 / 24564356 / -2.0% 30714180 / 31568305 / -2.7% 0.78 / 0.78 / +0.8%
tpcds_q02/duckdb:parquet 17765538 / 18602112 / -4.5% 23544737 / 25210565 / -6.6% 0.75 / 0.74 / +2.3%
tpcds_q03/duckdb:parquet 9862632 / 10070970 / -2.1% 15472041 / 16294136 / -5.0% 0.64 / 0.62 / +3.1%
tpcds_q04/duckdb:parquet 117420310 / 118695624 / -1.1% 123734409 / 127821628 / -3.2% 0.95 / 0.93 / +2.2%
tpcds_q05/duckdb:parquet 28219508 / 29366876 / -3.9% 32699745 / 34740383 / -5.9% 0.86 / 0.85 / +2.1%
tpcds_q06/duckdb:parquet 26376618 / 27039728 / -2.5% 35722877 / 36671224 / -2.6% 0.74 / 0.74 / +0.1%
tpcds_q07/duckdb:parquet 32440588 / 31352136 / +3.5% 39094935 / 39093391 / +0.0% 0.83 / 0.80 / +3.5%
tpcds_q08/duckdb:parquet 19625518 / 20433701 / -4.0% 24821521 / 27297626 / -9.1% 0.79 / 0.75 / +5.6%
tpcds_q09/duckdb:parquet 26584834 / 27328034 / -2.7% 30765133 / 30781012 / -0.1% 0.86 / 0.89 / -2.7%
tpcds_q10/duckdb:parquet 32302789 / 33356326 / -3.2% 39576041 / 41457589 / -4.5% 0.82 / 0.80 / +1.4%
tpcds_q11/duckdb:parquet 68529694 / 68983704 / -0.7% 75344765 / 74703863 / +0.9% 0.91 / 0.92 / -1.5%
tpcds_q12/duckdb:parquet 13881162 / 14359933 / -3.3% 19094880 / 19565553 / -2.4% 0.73 / 0.73 / -1.0%
tpcds_q13/duckdb:parquet 32384688 / 31887564 / +1.6% 39720526 / 40003648 / -0.7% 0.82 / 0.80 / +2.3%
tpcds_q14/duckdb:parquet 64215024 / 64575436 / -0.6% 67435428 / 70965716 / -5.0% 0.95 / 0.91 / +4.6%
tpcds_q15/duckdb:parquet 16622284 / 17042732 / -2.5% 22126830 / 23407340 / -5.5% 0.75 / 0.73 / +3.2%
tpcds_q16/duckdb:parquet 29979727 / 30776319 / -2.6% 36829601 / 37376124 / -1.5% 0.81 / 0.82 / -1.1%
tpcds_q17/duckdb:parquet 34242439 / 35606828 / -3.8% 39872281 / 41161840 / -3.1% 0.86 / 0.87 / -0.7%
tpcds_q18/duckdb:parquet 47067662 / 48181962 / -2.3% 54345888 / 57123485 / -4.9% 0.87 / 0.84 / +2.7%
tpcds_q19/duckdb:parquet 18542300 / 19165567 / -3.3% 25249867 / 27200212 / -7.2% 0.73 / 0.70 / +4.2%
tpcds_q20/duckdb:parquet 14907776 / 15268165 / -2.4% 19523974 / 20465216 / -4.6% 0.76 / 0.75 / +2.3%
tpcds_q21/duckdb:parquet 10460239 / 10683068 / -2.1% 16655472 / 17445217 / -4.5% 0.63 / 0.61 / +2.6%
tpcds_q22/duckdb:parquet 20660732 / 20799956 / -0.7% 26637548 / 26850054 / -0.8% 0.78 / 0.77 / +0.1%
tpcds_q23/duckdb:parquet 41843547 / 44254574 / -5.4% 47049498 / 48234852 / -2.5% 0.89 / 0.92 / -3.1%
tpcds_q24/duckdb:parquet 30020752 / 30902642 / -2.9% 35508751 / 38083884 / -6.8% 0.85 / 0.81 / +4.2%
tpcds_q25/duckdb:parquet 30307418 / 31182363 / -2.8% 36961287 / 37702192 / -2.0% 0.82 / 0.83 / -0.9%
tpcds_q26/duckdb:parquet 29237027 / 29965671 / -2.4% 35069501 / 36249461 / -3.3% 0.83 / 0.83 / +0.9%
tpcds_q27/duckdb:parquet 34673274 / 35620490 / -2.7% 40870635 / 43464712 / -6.0% 0.85 / 0.82 / +3.5%
tpcds_q28/duckdb:parquet 25888092 / 26515854 / -2.4% 33785673 / 32594509 / +3.7% 0.77 / 0.81 / -5.8%
tpcds_q29/duckdb:parquet 32732091 / 32599333 / +0.4% 38503454 / 40476107 / -4.9% 0.85 / 0.81 / +5.6%
tpcds_q30/duckdb:parquet 35408185 / 36361158 / -2.6% 43556888 / 45345740 / -3.9% 0.81 / 0.80 / +1.4%
tpcds_q31/duckdb:parquet 35932640 / 36518081 / -1.6% 42754615 / 44067907 / -3.0% 0.84 / 0.83 / +1.4%
tpcds_q32/duckdb:parquet 14144400 / 14567298 / -2.9% 20345442 / 21303242 / -4.5% 0.70 / 0.68 / +1.7%
tpcds_q33/duckdb:parquet 23543607 / 23666554 / -0.5% 29155302 / 29050722 / +0.4% 0.81 / 0.81 / -0.9%
tpcds_q34/duckdb:parquet 19071558 / 17729118 / +7.6% 24376632 / 24799995 / -1.7% 0.78 / 0.71 / +9.4%
tpcds_q35/duckdb:parquet 35067758 / 35946162 / -2.4% 43288972 / 44991992 / -3.8% 0.81 / 0.80 / +1.4%
tpcds_q36/duckdb:parquet 40293866 / 41905560 / -3.8% 46741820 / 49048505 / -4.7% 0.86 / 0.85 / +0.9%
tpcds_q37/duckdb:parquet 12543010 / 13215004 / -5.1% 19149796 / 20011915 / -4.3% 0.65 / 0.66 / -0.8%
tpcds_q38/duckdb:parquet 29754485 / 30038536 / -0.9% 34930193 / 34798021 / +0.4% 0.85 / 0.86 / -1.3%
tpcds_q39/duckdb:parquet 23264716 / 23536158 / -1.2% 29133079 / 29708131 / -1.9% 0.80 / 0.79 / +0.8%
tpcds_q40/duckdb:parquet 15821310 / 16480280 / -4.0% 20999146 / 21903012 / -4.1% 0.75 / 0.75 / +0.1%
tpcds_q41/duckdb:parquet 11974892 / 12345572 / -3.0% 18266819 / 18676765 / -2.2% 0.66 / 0.66 / -0.8%
tpcds_q42/duckdb:parquet 9412254 / 9782059 / -3.8% 15016069 / 15568494 / -3.5% 0.63 / 0.63 / -0.2%
tpcds_q43/duckdb:parquet 11896720 / 12552966 / -5.2% 18287627 / 18694293 / -2.2% 0.65 / 0.67 / -3.1%
tpcds_q44/duckdb:parquet 20769876 / 21497984 / -3.4% 26773223 / 27387046 / -2.2% 0.78 / 0.78 / -1.2%
tpcds_q45/duckdb:parquet 20828615 / 21438510 / -2.8% 27604225 / 28815960 / -4.2% 0.75 / 0.74 / +1.4%
tpcds_q46/duckdb:parquet 34991816 / 36092032 / -3.0% 43414009 / 44184026 / -1.7% 0.81 / 0.82 / -1.3%
tpcds_q47/duckdb:parquet 34374538 / 34530466 / -0.5% 41000762 / 41497519 / -1.2% 0.84 / 0.83 / +0.8%
tpcds_q48/duckdb:parquet 29510252 / 30287770 / -2.6% 36779707 / 38134395 / -3.6% 0.80 / 0.79 / +1.0%
tpcds_q49/duckdb:parquet 29813184 / 29282227 / +1.8% 36118198 / 39131545 / -7.7% 0.83 / 0.75 / +10.3%
tpcds_q50/duckdb:parquet 19337732 / 20575838 / -6.0% 25090336 / 26184367 / -4.2% 0.77 / 0.79 / -1.9%
tpcds_q51/duckdb:parquet 51641662 / 53298506 / -3.1% 59443887 / 62413821 / -4.8% 0.87 / 0.85 / +1.7%
tpcds_q52/duckdb:parquet 9592932 / 9847938 / -2.6% 15615840 / 15988022 / -2.3% 0.61 / 0.62 / -0.3%
tpcds_q53/duckdb:parquet 13752821 / 14151964 / -2.8% 20824551 / 21314665 / -2.3% 0.66 / 0.66 / -0.5%
tpcds_q54/duckdb:parquet 24764293 / 25603347 / -3.3% 31617503 / 32698250 / -3.3% 0.78 / 0.78 / +0.0%
tpcds_q55/duckdb:parquet 9331719 / 9648272 / -3.3% 15362563 / 15876364 / -3.2% 0.61 / 0.61 / -0.0%
tpcds_q56/duckdb:parquet 26898738 / 25934494 / +3.7% 30488719 / 30925010 / -1.4% 0.88 / 0.84 / +5.2%
tpcds_q57/duckdb:parquet 30277170 / 31476294 / -3.8% 35704162 / 36926704 / -3.3% 0.85 / 0.85 / -0.5%
tpcds_q58/duckdb:parquet 25364312 / 25654508 / -1.1% 29673124 / 30096596 / -1.4% 0.85 / 0.85 / +0.3%
tpcds_q59/duckdb:parquet 22579766 / 23325797 / -3.2% 28531444 / 29855073 / -4.4% 0.79 / 0.78 / +1.3%
tpcds_q60/duckdb:parquet 28442178 / 27846810 / +2.1% 31498145 / 33302884 / -5.4% 0.90 / 0.84 / +8.0%
tpcds_q61/duckdb:parquet 24596322 / 23513767 / +4.6% 29470853 / 29860537 / -1.3% 0.83 / 0.79 / +6.0%
tpcds_q62/duckdb:parquet 12723992 / 13475949 / -5.6% 17789652 / 18676463 / -4.7% 0.72 / 0.72 / -0.9%
tpcds_q63/duckdb:parquet 13099198 / 14859350 / -11.8% 🟢 20101234 / 20094306 / +0.0% 0.65 / 0.74 / -11.9%
tpcds_q64/duckdb:parquet 71192349 / 72140854 / -1.3% 78333097 / 83522310 / -6.2% 0.91 / 0.86 / +5.2%
tpcds_q65/duckdb:parquet 20895000 / 18749426 / +11.4% 🔴 25831341 / 26696622 / -3.2% 0.81 / 0.70 / +15.2%
tpcds_q66/duckdb:parquet 33068896 / 35773066 / -7.6% 37968494 / 42168901 / -10.0% 0.87 / 0.85 / +2.7%
tpcds_q67/duckdb:parquet 61540558 / 62743192 / -1.9% 66663489 / 68419908 / -2.6% 0.92 / 0.92 / +0.7%
tpcds_q68/duckdb:parquet 30106822 / 32705302 / -7.9% 35697981 / 37967995 / -6.0% 0.84 / 0.86 / -2.1%
tpcds_q69/duckdb:parquet 25838974 / 26882742 / -3.9% 33843367 / 35940756 / -5.8% 0.76 / 0.75 / +2.1%
tpcds_q70/duckdb:parquet 19252696 / 19841025 / -3.0% 26491613 / 27732637 / -4.5% 0.73 / 0.72 / +1.6%
tpcds_q71/duckdb:parquet 18127442 / 17265704 / +5.0% 23609911 / 24182468 / -2.4% 0.77 / 0.71 / +7.5%
tpcds_q72/duckdb:parquet 52934612 / 55030523 / -3.8% 59289183 / 63399913 / -6.5% 0.89 / 0.87 / +2.9%
tpcds_q73/duckdb:parquet 16598746 / 14955008 / +11.0% 🔴 21340391 / 21772349 / -2.0% 0.78 / 0.69 / +13.2%
tpcds_q74/duckdb:parquet 83481956 / 84401264 / -1.1% 90665136 / 92833201 / -2.3% 0.92 / 0.91 / +1.3%
tpcds_q75/duckdb:parquet 43224177 / 44774374 / -3.5% 49484738 / 51229266 / -3.4% 0.87 / 0.87 / -0.1%
tpcds_q76/duckdb:parquet 17986260 / 17429408 / +3.2% 23349105 / 24268365 / -3.8% 0.77 / 0.72 / +7.3%
tpcds_q77/duckdb:parquet 26275654 / 25069059 / +4.8% 31415778 / 32796935 / -4.2% 0.84 / 0.76 / +9.4%
tpcds_q78/duckdb:parquet 77978018 / 79618890 / -2.1% 83653576 / 86776631 / -3.6% 0.93 / 0.92 / +1.6%
tpcds_q79/duckdb:parquet 24136146 / 24993274 / -3.4% 28733712 / 29490688 / -2.6% 0.84 / 0.85 / -0.9%
tpcds_q80/duckdb:parquet 38477230 / 38767110 / -0.7% 43323177 / 45115068 / -4.0% 0.89 / 0.86 / +3.4%
tpcds_q81/duckdb:parquet 36084084 / 37349680 / -3.4% 44355787 / 46015511 / -3.6% 0.81 / 0.81 / +0.2%
tpcds_q82/duckdb:parquet 13317834 / 13853092 / -3.9% 20103146 / 20887492 / -3.8% 0.66 / 0.66 / -0.1%
tpcds_q83/duckdb:parquet 19996832 / 20514791 / -2.5% 24711375 / 25865738 / -4.5% 0.81 / 0.79 / +2.0%
tpcds_q84/duckdb:parquet 22966321 / 23610580 / -2.7% 28935607 / 28976365 / -0.1% 0.79 / 0.81 / -2.6%
tpcds_q85/duckdb:parquet 32157710 / 32898616 / -2.3% 39406959 / 41248088 / -4.5% 0.82 / 0.80 / +2.3%
tpcds_q86/duckdb:parquet 11780306 / 12286024 / -4.1% 16780763 / 17811544 / -5.8% 0.70 / 0.69 / +1.8%
tpcds_q87/duckdb:parquet 31125934 / 31495931 / -1.2% 34727201 / 36124170 / -3.9% 0.90 / 0.87 / +2.8%
tpcds_q88/duckdb:parquet 37830982 / 39746630 / -4.8% 42867872 / 44640240 / -4.0% 0.88 / 0.89 / -0.9%
tpcds_q89/duckdb:parquet 14005094 / 15687755 / -10.7% 🟢 21315858 / 21862316 / -2.5% 0.66 / 0.72 / -8.4%
tpcds_q90/duckdb:parquet 9849613 / 10514167 / -6.3% 15286044 / 15398456 / -0.7% 0.64 / 0.68 / -5.6%
tpcds_q91/duckdb:parquet 20925428 / 21502680 / -2.7% 28102202 / 29531422 / -4.8% 0.74 / 0.73 / +2.3%
tpcds_q92/duckdb:parquet 15390896 / 15956368 / -3.5% 22359316 / 22653340 / -1.3% 0.69 / 0.70 / -2.3%
tpcds_q93/duckdb:parquet 14103339 / 14177085 / -0.5% 20064984 / 20738126 / -3.2% 0.70 / 0.68 / +2.8%
tpcds_q94/duckdb:parquet 25391750 / 25921776 / -2.0% 32478051 / 33842249 / -4.0% 0.78 / 0.77 / +2.1%
tpcds_q95/duckdb:parquet 43714652 / 44263461 / -1.2% 48842684 / 50491225 / -3.3% 0.90 / 0.88 / +2.1%
tpcds_q96/duckdb:parquet 8162862 / 8445614 / -3.3% 13844402 / 14363459 / -3.6% 0.59 / 0.59 / +0.3%
tpcds_q97/duckdb:parquet 27621405 / 28134037 / -1.8% 32816010 / 35014829 / -6.3% 0.84 / 0.80 / +4.8%
tpcds_q98/duckdb:parquet 16371838 / 16693691 / -1.9% 23232069 / 23679663 / -1.9% 0.70 / 0.70 / -0.0%
tpcds_q99/duckdb:parquet 18520320 / 19322457 / -4.2% 24442271 / 25330556 / -3.5% 0.76 / 0.76 / -0.7%

@robert3005
robert3005 force-pushed the claude/exciting-heisenberg-qvdbm8 branch from 100957c to 11dd5ab Compare October 29, 2026 17:56
@robert3005
robert3005 enabled stacked auto-merge (squash) October 29, 2026 21:39
@robert3005
robert3005 force-pushed the claude/exciting-heisenberg-qvdbm8 branch from 11dd5ab to 24638a2 Compare November 2, 2026 09:49
@connortsui20 connortsui20 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 4, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 24638a2 clickbench-nvme 1 Explore Profiling Data
🟢 Done 24638a2 fineweb 1 Explore Profiling Data
🟢 Done 24638a2 polarsignals 1 Explore Profiling Data
🟢 Done 24638a2 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 24638a2 tpch-s3 1 Explore Profiling Data
🟢 Done 24638a2 tpch-nvme 1 Explore Profiling Data
🟢 Done 24638a2 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@robert3005

Copy link
Copy Markdown
Contributor Author

fwiw this matters tpc-ds the most

@connortsui20 connortsui20 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is pretty cool. Though it took a while for me to grok it (and I needed the help of an LLM to understand)

@robert3005
robert3005 force-pushed the claude/exciting-heisenberg-qvdbm8 branch from 24638a2 to 885dd0a Compare November 4, 2026 16:23
stacked auto-merge was automatically disabled November 4, 2026 16:35

Pull Request is not mergeable

robert3005 and others added 6 commits November 4, 2026 16:42
Replace the per-run `BitBuffer::count_range` in `filter_run_end_primitive`
with a word-level rank directory: each filtered run end is the mask rank at
the source run end, which costs one load and one popcount per run. Ranks are
written for every run and the retained ends are compacted by the primitive
filter with the same mask that selects the run values.

The x86-64 baseline lacks POPCNT, so the loop is compiled under
`#[target_feature(enable = "popcnt")]` behind runtime detection. The retain
bitmap is packed by hand because `collect_bool` does not inline into that
caller.

Add a regression test against a per-row reference with offsets and an
unaligned mask.

Signed-off-by: Robert Kruszewski <github@robertk.io>
Give the POPCNT and portable rank loops distinct instantiations through a
const parameter. With one caller per closure type LLVM inlines
BitBuffer::collect_bool, so the hand-packed retain bitmap is no longer
needed, and the inlined fill and SSE2 pack are about 10% faster on the
run_end_filter benchmark.

Signed-off-by: Robert Kruszewski <github@robertk.io>
Replace the hand-rolled POPCNT detection and #[target_feature] wrapper with
fearless_simd's dispatch! and a #[simd] body, matching count_ones and select
in vortex-buffer. Levels from SSE4.2 up enable POPCNT, and each level gets
its own instantiation, so BitBuffer::collect_bool still inlines without the
const-parameter workaround. The AVX2 level also enables BMI, which brings
another 10-15% on the run_end_filter benchmark.

Signed-off-by: Robert Kruszewski <github@robertk.io>
Write each rank at the current retained count and advance the count only
for a retained run. This removes the second pass that filtered the ranks
through PrimitiveArray, and its extra allocation. Also remove the three
bounds checks from the hot loop, write into spare capacity instead of a
zeroed buffer, and allocate the ends through the session allocator.

run_end_filter on an Apple M4 Max is 26-41% faster than before. Of this,
the unchecked indexing gives 10-16%.

Signed-off-by: Robert Kruszewski <github@robertk.io>
Add BitRankDirectory and BitBuffer::rank_directory to vortex-buffer so
other code can make constant-time rank queries over a bitmap. The RunEnd
filter now uses this type. Expand the module documentation of the RunEnd
filter with a worked example, as the review suggested.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Robert Kruszewski <github@robertk.io>
The `u64: AsPrimitive<R>` bound hides the `usize` implementation during
method lookup, so call the `usize` conversion by its full path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
robert3005 force-pushed the claude/exciting-heisenberg-qvdbm8 branch from e55315b to 2596b29 Compare November 4, 2026 16:43
@connortsui20
connortsui20 enabled stacked auto-merge (squash) November 4, 2026 17:04
Run ends never decrease, so one walk over the mask words answers every rank
query. The directory allocated and filled a 16-byte entry for every mask word
before the first query, which made long runs slower than develop. The walk
builds no index and still inlines into the POPCNT dispatch body.

This removes BitRankDirectory from vortex-buffer, which has no other users.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@vercel

vercel Bot commented Nov 4, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
vortex-docs Ready Ready Preview Nov 4, 2026 5:24pm UTC
vortex-explorer Ready Ready Preview Nov 4, 2026 5:24pm UTC

Request Review

Both tests compared the filtered ends with a per-run count. One test now covers masks that start inside a byte, run ends before and after the slice, and runs that span several mask words.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@connortsui20
connortsui20 merged commit 3be54de into develop Nov 4, 2026
72 of 73 checks passed
@connortsui20
connortsui20 deleted the claude/exciting-heisenberg-qvdbm8 branch November 4, 2026 17:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants