Skip to content

Push slices through filtered arrays - #10959

Merged
robert3005 merged 1 commit into
developfrom
ji/codex/filter-slice-pushdown
Oct 29, 2026
Merged

robert3005 merged 1 commit into
developfrom
ji/codex/filter-slice-pushdown

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Slicing a filtered array can execute the entire filtered child before applying the slice. Separate slices can therefore repeat filtering and decoding.

Add a SliceReduce rule for Filter that translates output ranks through the existing mask, slices the child and mask to the corresponding input range, and then filters that smaller range. The output ranks are remapped; the slice bounds cannot simply be reused against the unfiltered child.

Includes ten regression cases covering bounded child spans, nullable values, cached and uncached mask indices, empty/full slices, and single-row slices. Updates the affected execution-trace snapshots with unchanged expected values.

This is the standalone array change from #10799, based on develop 891c01ab40. It changes only four files in vortex-array.

Validation:

The earlier V2 ClickBench improvements measured within #10799 are separate from these standalone results.

Translate filtered output ranks to a bounded child range before slicing,
so independent slices do not each execute the entire filtered array.

Signed-off-by: Codex <codex@openai.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done c63d98d tpcds-nvme 2 Explore Profiling Data
🟢 Done c63d98d clickbench-nvme 1 Explore Profiling Data
🟢 Done c63d98d tpch-nvme-10 1 Explore Profiling Data
🟢 Done c63d98d polarsignals 1 Explore Profiling Data
🟢 Done c63d98d fineweb 1 Explore Profiling Data
🟢 Done c63d98d tpch-s3 1 Explore Profiling Data
🟢 Done c63d98d tpch-nvme 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done c63d98d tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR c63d98dd vs base 891c01ab
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.997x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24641818 / 24929819 / -1.2% 40787635 / 39886261 / +2.3% 0.60 / 0.63 / -3.3%
tpcds_q02/datafusion:vortex-file-compressed 47080327 / 47304938 / -0.5% 62887634 / 63291753 / -0.6% 0.75 / 0.75 / +0.2%
tpcds_q03/datafusion:vortex-file-compressed 11616446 / 12072108 / -3.8% 26488081 / 26645962 / -0.6% 0.44 / 0.45 / -3.2%
tpcds_q04/datafusion:vortex-file-compressed 120913645 / 122255524 / -1.1% 154371587 / 153865025 / +0.3% 0.78 / 0.79 / -1.4%
tpcds_q05/datafusion:vortex-file-compressed 59400221 / 59282304 / +0.2% 78669888 / 77583288 / +1.4% 0.76 / 0.76 / -1.2%
tpcds_q06/datafusion:vortex-file-compressed 23067615 / 22524268 / +2.4% 40767812 / 42840616 / -4.8% 0.57 / 0.53 / +7.6%
tpcds_q07/datafusion:vortex-file-compressed 31467390 / 30906300 / +1.8% 51840907 / 51677789 / +0.3% 0.61 / 0.60 / +1.5%
tpcds_q08/datafusion:vortex-file-compressed 24532915 / 24906952 / -1.5% 40396925 / 40509425 / -0.3% 0.61 / 0.61 / -1.2%
tpcds_q09/datafusion:vortex-file-compressed 16912116 / 17545872 / -3.6% 30443847 / 30276524 / +0.6% 0.56 / 0.58 / -4.1%
tpcds_q10/datafusion:vortex-file-compressed 26936420 / 27485852 / -2.0% 46318281 / 46465672 / -0.3% 0.58 / 0.59 / -1.7%
tpcds_q11/datafusion:vortex-file-compressed 64534362 / 64354210 / +0.3% 90823221 / 93597519 / -3.0% 0.71 / 0.69 / +3.3%
tpcds_q12/datafusion:vortex-file-compressed 16584216 / 16522596 / +0.4% 32071398 / 31975875 / +0.3% 0.52 / 0.52 / +0.1%
tpcds_q13/datafusion:vortex-file-compressed 32867430 / 32328255 / +1.7% 51740450 / 52270915 / -1.0% 0.64 / 0.62 / +2.7%
tpcds_q14/datafusion:vortex-file-compressed 498789342 / 496419742 / +0.5% 546672238 / 547826039 / -0.2% 0.91 / 0.91 / +0.7%
tpcds_q15/datafusion:vortex-file-compressed 15504518 / 15734018 / -1.5% 32749157 / 32630451 / +0.4% 0.47 / 0.48 / -1.8%
tpcds_q16/datafusion:vortex-file-compressed 19579241 / 20111558 / -2.6% 36520613 / 35731013 / +2.2% 0.54 / 0.56 / -4.8%
tpcds_q17/datafusion:vortex-file-compressed 55516500 / 58750735 / -5.5% 74653989 / 75227935 / -0.8% 0.74 / 0.78 / -4.8%
tpcds_q18/datafusion:vortex-file-compressed 68316394 / 69628645 / -1.9% 89430584 / 90512486 / -1.2% 0.76 / 0.77 / -0.7%
tpcds_q19/datafusion:vortex-file-compressed 17209964 / 17158199 / +0.3% 37265072 / 35809080 / +4.1% 0.46 / 0.48 / -3.6%
tpcds_q20/datafusion:vortex-file-compressed 17783288 / 17601121 / +1.0% 34725077 / 33773856 / +2.8% 0.51 / 0.52 / -1.7%
tpcds_q21/datafusion:vortex-file-compressed 16291529 / 16353072 / -0.4% 35847491 / 35735796 / +0.3% 0.45 / 0.46 / -0.7%
tpcds_q22/datafusion:vortex-file-compressed 56922360 / 57723757 / -1.4% 79008917 / 77077432 / +2.5% 0.72 / 0.75 / -3.8%
tpcds_q23/datafusion:vortex-file-compressed 70090514 / 70451034 / -0.5% 97963790 / 97962967 / +0.0% 0.72 / 0.72 / -0.5%
tpcds_q24/datafusion:vortex-file-compressed 67428309 / 68175486 / -1.1% 87695189 / 87061950 / +0.7% 0.77 / 0.78 / -1.8%
tpcds_q25/datafusion:vortex-file-compressed 46425933 / 46347564 / +0.2% 77260245 / 77367351 / -0.1% 0.60 / 0.60 / +0.3%
tpcds_q26/datafusion:vortex-file-compressed 30713840 / 29707798 / +3.4% 49107199 / 48439232 / +1.4% 0.63 / 0.61 / +2.0%
tpcds_q27/datafusion:vortex-file-compressed 59958998 / 60228859 / -0.4% 87852483 / 89657895 / -2.0% 0.68 / 0.67 / +1.6%
tpcds_q28/datafusion:vortex-file-compressed 19283270 / 19347996 / -0.3% 33560947 / 34327358 / -2.2% 0.57 / 0.56 / +1.9%
tpcds_q29/datafusion:vortex-file-compressed 58633670 / 57999057 / +1.1% 72792714 / 78927427 / -7.8% 0.81 / 0.73 / +9.6%
tpcds_q30/datafusion:vortex-file-compressed 26598987 / 27023478 / -1.6% 43728336 / 42521209 / +2.8% 0.61 / 0.64 / -4.3%
tpcds_q31/datafusion:vortex-file-compressed 58381962 / 59282335 / -1.5% 80093383 / 80394556 / -0.4% 0.73 / 0.74 / -1.1%
tpcds_q32/datafusion:vortex-file-compressed 13344215 / 13371567 / -0.2% 28463757 / 28286974 / +0.6% 0.47 / 0.47 / -0.8%
tpcds_q33/datafusion:vortex-file-compressed 27970297 / 27078020 / +3.3% 48178961 / 47123699 / +2.2% 0.58 / 0.57 / +1.0%
tpcds_q34/datafusion:vortex-file-compressed 17412676 / 17440091 / -0.2% 34152148 / 34256331 / -0.3% 0.51 / 0.51 / +0.1%
tpcds_q35/datafusion:vortex-file-compressed 34589354 / 34086638 / +1.5% 56275087 / 55557154 / +1.3% 0.61 / 0.61 / +0.2%
tpcds_q36/datafusion:vortex-file-compressed 46628632 / 47077841 / -1.0% 71145377 / 68920367 / +3.2% 0.66 / 0.68 / -4.1%
tpcds_q37/datafusion:vortex-file-compressed 12676565 / 13173312 / -3.8% 31234170 / 32364436 / -3.5% 0.41 / 0.41 / -0.3%
tpcds_q38/datafusion:vortex-file-compressed 29477932 / 29152504 / +1.1% 48545953 / 48526498 / +0.0% 0.61 / 0.60 / +1.1%
tpcds_q39/datafusion:vortex-file-compressed 61101213 / 61974498 / -1.4% 84437353 / 84929033 / -0.6% 0.72 / 0.73 / -0.8%
tpcds_q40/datafusion:vortex-file-compressed 24439836 / 24289292 / +0.6% 42914472 / 43593051 / -1.6% 0.57 / 0.56 / +2.2%
tpcds_q41/datafusion:vortex-file-compressed 19869428 / 19658760 / +1.1% 33288758 / 33067594 / +0.7% 0.60 / 0.59 / +0.4%
tpcds_q42/datafusion:vortex-file-compressed 11369677 / 11354744 / +0.1% 24553792 / 25101140 / -2.2% 0.46 / 0.45 / +2.4%
tpcds_q43/datafusion:vortex-file-compressed 12706976 / 12665410 / +0.3% 27094643 / 28320584 / -4.3% 0.47 / 0.45 / +4.9%
tpcds_q44/datafusion:vortex-file-compressed 25180200 / 25797986 / -2.4% 45889516 / 46816657 / -2.0% 0.55 / 0.55 / -0.4%
tpcds_q45/datafusion:vortex-file-compressed 18278220 / 18522236 / -1.3% 35559700 / 35484936 / +0.2% 0.51 / 0.52 / -1.5%
tpcds_q46/datafusion:vortex-file-compressed 23418562 / 23441740 / -0.1% 46984284 / 44351483 / +5.9% 0.50 / 0.53 / -5.7%
tpcds_q47/datafusion:vortex-file-compressed 77917316 / 78175341 / -0.3% 102834540 / 104298236 / -1.4% 0.76 / 0.75 / +1.1%
tpcds_q48/datafusion:vortex-file-compressed 30455375 / 30573884 / -0.4% 47311506 / 48183905 / -1.8% 0.64 / 0.63 / +1.4%
tpcds_q49/datafusion:vortex-file-compressed 56474943 / 57519238 / -1.8% 81036075 / 80513180 / +0.6% 0.70 / 0.71 / -2.4%
tpcds_q50/datafusion:vortex-file-compressed 32623482 / 32814812 / -0.6% 50142498 / 50942731 / -1.6% 0.65 / 0.64 / +1.0%
tpcds_q51/datafusion:vortex-file-compressed 67852979 / 66570310 / +1.9% 86790262 / 86881593 / -0.1% 0.78 / 0.77 / +2.0%
tpcds_q52/datafusion:vortex-file-compressed 11415999 / 11842362 / -3.6% 26540595 / 25289355 / +4.9% 0.43 / 0.47 / -8.1%
tpcds_q53/datafusion:vortex-file-compressed 17763032 / 17682904 / +0.5% 36597731 / 37057939 / -1.2% 0.49 / 0.48 / +1.7%
tpcds_q54/datafusion:vortex-file-compressed 32805561 / 33339566 / -1.6% 55038803 / 55318782 / -0.5% 0.60 / 0.60 / -1.1%
tpcds_q55/datafusion:vortex-file-compressed 11167996 / 11391153 / -2.0% 23755413 / 25900761 / -8.3% 0.47 / 0.44 / +6.9%
tpcds_q56/datafusion:vortex-file-compressed 26681990 / 26517412 / +0.6% 46519923 / 47356836 / -1.8% 0.57 / 0.56 / +2.4%
tpcds_q57/datafusion:vortex-file-compressed 77997762 / 78464089 / -0.6% 102788157 / 101178726 / +1.6% 0.76 / 0.78 / -2.2%
tpcds_q58/datafusion:vortex-file-compressed 40420582 / 40724865 / -0.7% 64255846 / 63216193 / +1.6% 0.63 / 0.64 / -2.4%
tpcds_q59/datafusion:vortex-file-compressed 31100532 / 31017555 / +0.3% 50500506 / 51176096 / -1.3% 0.62 / 0.61 / +1.6%
tpcds_q60/datafusion:vortex-file-compressed 26506835 / 26170922 / +1.3% 45827220 / 45459005 / +0.8% 0.58 / 0.58 / +0.5%
tpcds_q61/datafusion:vortex-file-compressed 22994810 / 22739156 / +1.1% 41575884 / 42417457 / -2.0% 0.55 / 0.54 / +3.2%
tpcds_q62/datafusion:vortex-file-compressed 18167412 / 18099875 / +0.4% 31930626 / 32363575 / -1.3% 0.57 / 0.56 / +1.7%
tpcds_q63/datafusion:vortex-file-compressed 17686452 / 17721711 / -0.2% 36819604 / 37561081 / -2.0% 0.48 / 0.47 / +1.8%
tpcds_q64/datafusion:vortex-file-compressed 222241534 / 227626810 / -2.4% 259024027 / 257569313 / +0.6% 0.86 / 0.88 / -2.9%
tpcds_q65/datafusion:vortex-file-compressed 74559737 / 75477058 / -1.2% 95102412 / 95490306 / -0.4% 0.78 / 0.79 / -0.8%
tpcds_q66/datafusion:vortex-file-compressed 52159202 / 52795754 / -1.2% 69345576 / 68788304 / +0.8% 0.75 / 0.77 / -2.0%
tpcds_q67/datafusion:vortex-file-compressed 58369194 / 58535102 / -0.3% 85719895 / 85795812 / -0.1% 0.68 / 0.68 / -0.2%
tpcds_q68/datafusion:vortex-file-compressed 22636182 / 23044784 / -1.8% 45179604 / 45119209 / +0.1% 0.50 / 0.51 / -1.9%
tpcds_q69/datafusion:vortex-file-compressed 28240839 / 27559587 / +2.5% 46622002 / 46733751 / -0.2% 0.61 / 0.59 / +2.7%
tpcds_q70/datafusion:vortex-file-compressed 71521376 / 70694951 / +1.2% 89136306 / 90532225 / -1.5% 0.80 / 0.78 / +2.8%
tpcds_q71/datafusion:vortex-file-compressed 19037322 / 18105540 / +5.1% 35445586 / 34195029 / +3.7% 0.54 / 0.53 / +1.4%
tpcds_q72/datafusion:vortex-file-compressed 350829292 / 347124932 / +1.1% 381608815 / 387572832 / -1.5% 0.92 / 0.90 / +2.6%
tpcds_q73/datafusion:vortex-file-compressed 16363320 / 16164038 / +1.2% 33576713 / 34465922 / -2.6% 0.49 / 0.47 / +3.9%
tpcds_q74/datafusion:vortex-file-compressed 45292866 / 45454528 / -0.4% 69625286 / 70201271 / -0.8% 0.65 / 0.65 / +0.5%
tpcds_q75/datafusion:vortex-file-compressed 135397724 / 135862236 / -0.3% 158011797 / 156660075 / +0.9% 0.86 / 0.87 / -1.2%
tpcds_q76/datafusion:vortex-file-compressed 26658427 / 26210162 / +1.7% 43044083 / 43234603 / -0.4% 0.62 / 0.61 / +2.2%
tpcds_q77/datafusion:vortex-file-compressed 44554224 / 46190492 / -3.5% 65284447 / 64916586 / +0.6% 0.68 / 0.71 / -4.1%
tpcds_q78/datafusion:vortex-file-compressed 68191224 / 68523157 / -0.5% 95424617 / 96309622 / -0.9% 0.71 / 0.71 / +0.4%
tpcds_q79/datafusion:vortex-file-compressed 19584956 / 19638677 / -0.3% 41049849 / 40270552 / +1.9% 0.48 / 0.49 / -2.2%
tpcds_q80/datafusion:vortex-file-compressed 74211557 / 73392946 / +1.1% 103207745 / 103605302 / -0.4% 0.72 / 0.71 / +1.5%
tpcds_q81/datafusion:vortex-file-compressed 26905582 / 27385088 / -1.8% 42814372 / 43565573 / -1.7% 0.63 / 0.63 / -0.0%
tpcds_q82/datafusion:vortex-file-compressed 12742066 / 12453780 / +2.3% 31021429 / 31115694 / -0.3% 0.41 / 0.40 / +2.6%
tpcds_q83/datafusion:vortex-file-compressed 34924496 / 35109150 / -0.5% 53207726 / 50791070 / +4.8% 0.66 / 0.69 / -5.0%
tpcds_q84/datafusion:vortex-file-compressed 11838062 / 11947430 / -0.9% 24984424 / 24752705 / +0.9% 0.47 / 0.48 / -1.8%
tpcds_q85/datafusion:vortex-file-compressed 58818018 / 58992930 / -0.3% 79340086 / 82003598 / -3.2% 0.74 / 0.72 / +3.1%
tpcds_q86/datafusion:vortex-file-compressed 16399130 / 16556220 / -0.9% 31727431 / 31758994 / -0.1% 0.52 / 0.52 / -0.9%
tpcds_q87/datafusion:vortex-file-compressed 29772751 / 30203084 / -1.4% 47240013 / 48787181 / -3.2% 0.63 / 0.62 / +1.8%
tpcds_q88/datafusion:vortex-file-compressed 32233492 / 31877943 / +1.1% 55356075 / 57880872 / -4.4% 0.58 / 0.55 / +5.7%
tpcds_q89/datafusion:vortex-file-compressed 20865088 / 20571754 / +1.4% 39115685 / 39632800 / -1.3% 0.53 / 0.52 / +2.8%
tpcds_q90/datafusion:vortex-file-compressed 10389665 / 10432724 / -0.4% 23760249 / 21960882 / +8.2% 0.44 / 0.48 / -8.0%
tpcds_q91/datafusion:vortex-file-compressed 17188263 / 16364309 / +5.0% 34692304 / 34115638 / +1.7% 0.50 / 0.48 / +3.3%
tpcds_q92/datafusion:vortex-file-compressed 13549966 / 13552326 / -0.0% 28336205 / 28449037 / -0.4% 0.48 / 0.48 / +0.4%
tpcds_q93/datafusion:vortex-file-compressed 22219320 / 22284025 / -0.3% 39594414 / 39241971 / +0.9% 0.56 / 0.57 / -1.2%
tpcds_q94/datafusion:vortex-file-compressed 19152994 / 18832746 / +1.7% 34543931 / 34067741 / +1.4% 0.55 / 0.55 / +0.3%
tpcds_q95/datafusion:vortex-file-compressed 44580978 / 45089755 / -1.1% 62317531 / 61072387 / +2.0% 0.72 / 0.74 / -3.1%
tpcds_q96/datafusion:vortex-file-compressed 8541120 / 8046399 / +6.1% 20781635 / 21439149 / -3.1% 0.41 / 0.38 / +9.5%
tpcds_q97/datafusion:vortex-file-compressed 21016749 / 21313542 / -1.4% 39168057 / 38152738 / +2.7% 0.54 / 0.56 / -3.9%
tpcds_q98/datafusion:vortex-file-compressed 17049392 / 16923307 / +0.7% 34411544 / 35927725 / -4.2% 0.50 / 0.47 / +5.2%
tpcds_q99/datafusion:vortex-file-compressed 20805922 / 20859080 / -0.3% 35610364 / 36091739 / -1.3% 0.58 / 0.58 / +1.1%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 40701095 / 40985603 / -0.7% 60514255 / 60694467 / -0.3% 0.67 / 0.68 / -0.4%
tpcds_q02/datafusion:parquet 55811485 / 55353100 / +0.8% 70677643 / 71209304 / -0.7% 0.79 / 0.78 / +1.6%
tpcds_q03/datafusion:parquet 18941804 / 19156526 / -1.1% 31457026 / 32824523 / -4.2% 0.60 / 0.58 / +3.2%
tpcds_q04/datafusion:parquet 180864158 / 180637846 / +0.1% 203122595 / 207278932 / -2.0% 0.89 / 0.87 / +2.2%
tpcds_q05/datafusion:parquet 68769678 / 69636118 / -1.2% 89005740 / 88032665 / +1.1% 0.77 / 0.79 / -2.3%
tpcds_q06/datafusion:parquet 34329934 / 33502852 / +2.5% 47263010 / 45744693 / +3.3% 0.73 / 0.73 / -0.8%
tpcds_q07/datafusion:parquet 47987620 / 46896197 / +2.3% 65409314 / 64931450 / +0.7% 0.73 / 0.72 / +1.6%
tpcds_q08/datafusion:parquet 31496931 / 31024270 / +1.5% 47001014 / 45500004 / +3.3% 0.67 / 0.68 / -1.7%
tpcds_q09/datafusion:parquet 32886248 / 32561640 / +1.0% 37636925 / 48176217 / -21.9% 🟢 0.87 / 0.68 / +29.3%
tpcds_q10/datafusion:parquet 44326826 / 44980068 / -1.5% 59511695 / 59153408 / +0.6% 0.74 / 0.76 / -2.0%
tpcds_q11/datafusion:parquet 98085810 / 97719808 / +0.4% 122558697 / 119468174 / +2.6% 0.80 / 0.82 / -2.2%
tpcds_q12/datafusion:parquet 23926738 / 24085433 / -0.7% 36341167 / 36314876 / +0.1% 0.66 / 0.66 / -0.7%
tpcds_q13/datafusion:parquet 46720654 / 47335952 / -1.3% 66277228 / 67141160 / -1.3% 0.70 / 0.71 / -0.0%
tpcds_q14/datafusion:parquet 534061968 / 537365690 / -0.6% 588194107 / 588897681 / -0.1% 0.91 / 0.91 / -0.5%
tpcds_q15/datafusion:parquet 23148368 / 24077034 / -3.9% 36369746 / 37175654 / -2.2% 0.64 / 0.65 / -1.7%
tpcds_q16/datafusion:parquet 37090649 / 37566612 / -1.3% 49805504 / 51316817 / -2.9% 0.74 / 0.73 / +1.7%
tpcds_q17/datafusion:parquet 73713630 / 74238780 / -0.7% 96131779 / 95606780 / +0.5% 0.77 / 0.78 / -1.2%
tpcds_q18/datafusion:parquet 64839219 / 67151070 / -3.4% 87752587 / 86876634 / +1.0% 0.74 / 0.77 / -4.4%
tpcds_q19/datafusion:parquet 29406533 / 29264341 / +0.5% 42146326 / 43375230 / -2.8% 0.70 / 0.67 / +3.4%
tpcds_q20/datafusion:parquet 25543106 / 25372052 / +0.7% 38185276 / 36121885 / +5.7% 0.67 / 0.70 / -4.8%
tpcds_q21/datafusion:parquet 20366007 / 20305194 / +0.3% 31135480 / 30708070 / +1.4% 0.65 / 0.66 / -1.1%
tpcds_q22/datafusion:parquet 77913892 / 77598321 / +0.4% 86977144 / 88355795 / -1.6% 0.90 / 0.88 / +2.0%
tpcds_q23/datafusion:parquet 94629632 / 91998962 / +2.9% 113998884 / 115254515 / -1.1% 0.83 / 0.80 / +4.0%
tpcds_q24/datafusion:parquet 91877490 / 92044217 / -0.2% 115257454 / 114568818 / +0.6% 0.80 / 0.80 / -0.8%
tpcds_q25/datafusion:parquet 81641043 / 80273267 / +1.7% 101211685 / 101767184 / -0.5% 0.81 / 0.79 / +2.3%
tpcds_q26/datafusion:parquet 43920824 / 43793540 / +0.3% 59850612 / 57119263 / +4.8% 0.73 / 0.77 / -4.3%
tpcds_q27/datafusion:parquet 76190822 / 75147561 / +1.4% 97287650 / 95130409 / +2.3% 0.78 / 0.79 / -0.9%
tpcds_q28/datafusion:parquet 28672704 / 28546271 / +0.4% 44757047 / 42094328 / +6.3% 0.64 / 0.68 / -5.5%
tpcds_q29/datafusion:parquet 76610702 / 74988624 / +2.2% 95537087 / 94713920 / +0.9% 0.80 / 0.79 / +1.3%
tpcds_q30/datafusion:parquet 45893438 / 45721574 / +0.4% 59844550 / 59875680 / -0.1% 0.77 / 0.76 / +0.4%
tpcds_q31/datafusion:parquet 82628933 / 81216075 / +1.7% 97579396 / 99665273 / -2.1% 0.85 / 0.81 / +3.9%
tpcds_q32/datafusion:parquet 26290228 / 27013892 / -2.7% 38852674 / 39684322 / -2.1% 0.68 / 0.68 / -0.6%
tpcds_q33/datafusion:parquet 38192930 / 37053680 / +3.1% 52439051 / 52556481 / -0.2% 0.73 / 0.71 / +3.3%
tpcds_q34/datafusion:parquet 24839609 / 24286158 / +2.3% 35684644 / 35458284 / +0.6% 0.70 / 0.68 / +1.6%
tpcds_q35/datafusion:parquet 51497427 / 50717366 / +1.5% 64535926 / 62895878 / +2.6% 0.80 / 0.81 / -1.0%
tpcds_q36/datafusion:parquet 53035778 / 51383708 / +3.2% 69939374 / 69758665 / +0.3% 0.76 / 0.74 / +2.9%
tpcds_q37/datafusion:parquet 21215136 / 21664475 / -2.1% 33713958 / 32829680 / +2.7% 0.63 / 0.66 / -4.6%
tpcds_q38/datafusion:parquet 43855714 / 44625452 / -1.7% 61190945 / 60481899 / +1.2% 0.72 / 0.74 / -2.9%
tpcds_q39/datafusion:parquet 68270297 / 68842220 / -0.8% 85495841 / 84502259 / +1.2% 0.80 / 0.81 / -2.0%
tpcds_q40/datafusion:parquet 32402669 / 30380335 / +6.7% 48585385 / 50741717 / -4.2% 0.67 / 0.60 / +11.4%
tpcds_q41/datafusion:parquet 19568420 / 20039468 / -2.4% 30938156 / 31610104 / -2.1% 0.63 / 0.63 / -0.2%
tpcds_q42/datafusion:parquet 18397724 / 18216913 / +1.0% 29979727 / 28896171 / +3.7% 0.61 / 0.63 / -2.7%
tpcds_q43/datafusion:parquet 19214812 / 19424360 / -1.1% 31980006 / 30472220 / +4.9% 0.60 / 0.64 / -5.7%
tpcds_q44/datafusion:parquet 35791972 / 34950446 / +2.4% 50194718 / 48663569 / +3.1% 0.71 / 0.72 / -0.7%
tpcds_q45/datafusion:parquet 27543884 / 27651006 / -0.4% 39234950 / 39558082 / -0.8% 0.70 / 0.70 / +0.4%
tpcds_q46/datafusion:parquet 29509942 / 29223898 / +1.0% 44460631 / 45200529 / -1.6% 0.66 / 0.65 / +2.7%
tpcds_q47/datafusion:parquet 98432383 / 97527767 / +0.9% 117750900 / 119488998 / -1.5% 0.84 / 0.82 / +2.4%
tpcds_q48/datafusion:parquet 41766975 / 42674158 / -2.1% 58019064 / 58156525 / -0.2% 0.72 / 0.73 / -1.9%
tpcds_q49/datafusion:parquet 72773617 / 73627594 / -1.2% 92053785 / 94606778 / -2.7% 0.79 / 0.78 / +1.6%
tpcds_q50/datafusion:parquet 48306340 / 47904681 / +0.8% 69483709 / 66315794 / +4.8% 0.70 / 0.72 / -3.8%
tpcds_q51/datafusion:parquet 75746117 / 75408311 / +0.4% 94597434 / 93858395 / +0.8% 0.80 / 0.80 / -0.3%
tpcds_q52/datafusion:parquet 18986570 / 18684246 / +1.6% 28845879 / 29262567 / -1.4% 0.66 / 0.64 / +3.1%
tpcds_q53/datafusion:parquet 22679043 / 22710524 / -0.1% 37104292 / 36826415 / +0.8% 0.61 / 0.62 / -0.9%
tpcds_q54/datafusion:parquet 52736741 / 52040648 / +1.3% 67549820 / 67354087 / +0.3% 0.78 / 0.77 / +1.0%
tpcds_q55/datafusion:parquet 18640382 / 18295995 / +1.9% 29782907 / 29299613 / +1.6% 0.63 / 0.62 / +0.2%
tpcds_q56/datafusion:parquet 39200070 / 40490852 / -3.2% 55933356 / 53097063 / +5.3% 0.70 / 0.76 / -8.1%
tpcds_q57/datafusion:parquet 102144475 / 101434478 / +0.7% 113194179 / 113691936 / -0.4% 0.90 / 0.89 / +1.1%
tpcds_q58/datafusion:parquet 66214552 / 65599456 / +0.9% 81578490 / 81115192 / +0.6% 0.81 / 0.81 / +0.4%
tpcds_q59/datafusion:parquet 47076380 / 47015278 / +0.1% 61917976 / 63094916 / -1.9% 0.76 / 0.75 / +2.0%
tpcds_q60/datafusion:parquet 39722551 / 40073941 / -0.9% 52442291 / 53338131 / -1.7% 0.76 / 0.75 / +0.8%
tpcds_q61/datafusion:parquet 36031083 / 35867218 / +0.5% 50273036 / 49047157 / +2.5% 0.72 / 0.73 / -2.0%
tpcds_q62/datafusion:parquet 25416830 / 25393642 / +0.1% 38440044 / 37438462 / +2.7% 0.66 / 0.68 / -2.5%
tpcds_q63/datafusion:parquet 22557858 / 22451426 / +0.5% 36396123 / 37654948 / -3.3% 0.62 / 0.60 / +3.9%
tpcds_q64/datafusion:parquet 288395328 / 288456472 / -0.0% 330929890 / 327182991 / +1.1% 0.87 / 0.88 / -1.2%
tpcds_q65/datafusion:parquet 120772184 / 121626482 / -0.7% 135044981 / 135659466 / -0.5% 0.89 / 0.90 / -0.3%
tpcds_q66/datafusion:parquet 60956058 / 61855666 / -1.5% 74720060 / 77294689 / -3.3% 0.82 / 0.80 / +1.9%
tpcds_q67/datafusion:parquet 69152177 / 70864119 / -2.4% 90797878 / 91049938 / -0.3% 0.76 / 0.78 / -2.1%
tpcds_q68/datafusion:parquet 29603373 / 29587375 / +0.1% 47390460 / 47511054 / -0.3% 0.62 / 0.62 / +0.3%
tpcds_q69/datafusion:parquet 43871591 / 43918094 / -0.1% 53994725 / 57328233 / -5.8% 0.81 / 0.77 / +6.1%
tpcds_q70/datafusion:parquet 81714939 / 80169965 / +1.9% 95593330 / 96581863 / -1.0% 0.85 / 0.83 / +3.0%
tpcds_q71/datafusion:parquet 25794121 / 25261114 / +2.1% 39756305 / 37453527 / +6.1% 0.65 / 0.67 / -3.8%
tpcds_q72/datafusion:parquet 518839594 / 527503912 / -1.6% 559037225 / 557651770 / +0.2% 0.93 / 0.95 / -1.9%
tpcds_q73/datafusion:parquet 24168494 / 23633078 / +2.3% 34421842 / 34761298 / -1.0% 0.70 / 0.68 / +3.3%
tpcds_q74/datafusion:parquet 70541014 / 69896448 / +0.9% 88635903 / 86542970 / +2.4% 0.80 / 0.81 / -1.5%
tpcds_q75/datafusion:parquet 157514378 / 154237469 / +2.1% 180891923 / 179000550 / +1.1% 0.87 / 0.86 / +1.1%
tpcds_q76/datafusion:parquet 33641292 / 33827546 / -0.6% 47767763 / 45956011 / +3.9% 0.70 / 0.74 / -4.3%
tpcds_q77/datafusion:parquet 56230390 / 57914142 / -2.9% 76346538 / 73617351 / +3.7% 0.74 / 0.79 / -6.4%
tpcds_q78/datafusion:parquet 86287782 / 85438340 / +1.0% 114107416 / 115256480 / -1.0% 0.76 / 0.74 / +2.0%
tpcds_q79/datafusion:parquet 27335810 / 27116374 / +0.8% 41612965 / 41088944 / +1.3% 0.66 / 0.66 / -0.5%
tpcds_q80/datafusion:parquet 80488412 / 80527048 / -0.0% 106067442 / 109182220 / -2.9% 0.76 / 0.74 / +2.9%
tpcds_q81/datafusion:parquet 39742260 / 39719340 / +0.1% 53297299 / 52276433 / +2.0% 0.75 / 0.76 / -1.9%
tpcds_q82/datafusion:parquet 22496694 / 22549368 / -0.2% 34957781 / 36033076 / -3.0% 0.64 / 0.63 / +2.8%
tpcds_q83/datafusion:parquet 58762888 / 58140102 / +1.1% 73081559 / 74629424 / -2.1% 0.80 / 0.78 / +3.2%
tpcds_q84/datafusion:parquet 26827344 / 26885746 / -0.2% 36968025 / 39334331 / -6.0% 0.73 / 0.68 / +6.2%
tpcds_q85/datafusion:parquet 81327796 / 81351008 / -0.0% 102350608 / 102346258 / +0.0% 0.79 / 0.79 / -0.0%
tpcds_q86/datafusion:parquet 21429027 / 20706562 / +3.5% 32129103 / 31883082 / +0.8% 0.67 / 0.65 / +2.7%
tpcds_q87/datafusion:parquet 45323222 / 45413958 / -0.2% 60958945 / 58532042 / +4.1% 0.74 / 0.78 / -4.2%
tpcds_q88/datafusion:parquet 36476258 / 40161576 / -9.2% 51960792 / 49601538 / +4.8% 0.70 / 0.81 / -13.3%
tpcds_q89/datafusion:parquet 25736560 / 25890766 / -0.6% 40622517 / 39899480 / +1.8% 0.63 / 0.65 / -2.4%
tpcds_q90/datafusion:parquet 15995894 / 15158547 / +5.5% 26928838 / 25784428 / +4.4% 0.59 / 0.59 / +1.0%
tpcds_q91/datafusion:parquet 32441448 / 32144891 / +0.9% 46279144 / 45400045 / +1.9% 0.70 / 0.71 / -1.0%
tpcds_q92/datafusion:parquet 26860460 / 27154124 / -1.1% 39253892 / 39233535 / +0.1% 0.68 / 0.69 / -1.1%
tpcds_q93/datafusion:parquet 27484252 / 27661192 / -0.6% 46078320 / 46130123 / -0.1% 0.60 / 0.60 / -0.5%
tpcds_q94/datafusion:parquet 35270374 / 35778050 / -1.4% 48174563 / 47543034 / +1.3% 0.73 / 0.75 / -2.7%
tpcds_q95/datafusion:parquet 65313010 / 64759588 / +0.9% 76384322 / 77544255 / -1.5% 0.86 / 0.84 / +2.4%
tpcds_q96/datafusion:parquet 12585850 / 12422340 / +1.3% 22971755 / 23577868 / -2.6% 0.55 / 0.53 / +4.0%
tpcds_q97/datafusion:parquet 36051382 / 35416982 / +1.8% 47991958 / 50105785 / -4.2% 0.75 / 0.71 / +6.3%
tpcds_q98/datafusion:parquet 24820894 / 24899514 / -0.3% 36856237 / 36814564 / +0.1% 0.67 / 0.68 / -0.4%
tpcds_q99/datafusion:parquet 30055974 / 30181854 / -0.4% 42040486 / 42338005 / -0.7% 0.71 / 0.71 / +0.3%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15995362 / 15919011 / +0.5% 23668063 / 23528913 / +0.6% 0.68 / 0.68 / -0.1%
tpcds_q02/duckdb:vortex-file-compressed 15745598 / 15520145 / +1.5% 21664936 / 22891237 / -5.4% 0.73 / 0.68 / +7.2%
tpcds_q03/duckdb:vortex-file-compressed 7025603 / 7094498 / -1.0% 15538326 / 14957772 / +3.9% 0.45 / 0.47 / -4.7%
tpcds_q04/duckdb:vortex-file-compressed 45560636 / 45250316 / +0.7% 54341447 / 55459667 / -2.0% 0.84 / 0.82 / +2.8%
tpcds_q05/duckdb:vortex-file-compressed 23113585 / 23028408 / +0.4% 30236205 / 30233844 / +0.0% 0.76 / 0.76 / +0.4%
tpcds_q06/duckdb:vortex-file-compressed 23712722 / 23723990 / -0.0% 36621428 / 36545239 / +0.2% 0.65 / 0.65 / -0.3%
tpcds_q07/duckdb:vortex-file-compressed 13560614 / 13350553 / +1.6% 24297206 / 24171246 / +0.5% 0.56 / 0.55 / +1.0%
tpcds_q08/duckdb:vortex-file-compressed 17404651 / 17468970 / -0.4% 24205723 / 24299057 / -0.4% 0.72 / 0.72 / +0.0%
tpcds_q09/duckdb:vortex-file-compressed 18292952 / 18474592 / -1.0% 27423717 / 27811781 / -1.4% 0.67 / 0.66 / +0.4%
tpcds_q10/duckdb:vortex-file-compressed 26972862 / 26892040 / +0.3% 39158250 / 39686610 / -1.3% 0.69 / 0.68 / +1.7%
tpcds_q11/duckdb:vortex-file-compressed 36426871 / 36845186 / -1.1% 43966916 / 44879612 / -2.0% 0.83 / 0.82 / +0.9%
tpcds_q12/duckdb:vortex-file-compressed 10150398 / 10051307 / +1.0% 15763364 / 16505044 / -4.5% 0.64 / 0.61 / +5.7%
tpcds_q13/duckdb:vortex-file-compressed 20834494 / 20815663 / +0.1% 31370172 / 31444389 / -0.2% 0.66 / 0.66 / +0.3%
tpcds_q14/duckdb:vortex-file-compressed 55165580 / 55445002 / -0.5% 64751996 / 64471042 / +0.4% 0.85 / 0.86 / -0.9%
tpcds_q15/duckdb:vortex-file-compressed 10780236 / 11198524 / -3.7% 17882300 / 17482690 / +2.3% 0.60 / 0.64 / -5.9%
tpcds_q16/duckdb:vortex-file-compressed 23998130 / 24220555 / -0.9% 34510400 / 34063650 / +1.3% 0.70 / 0.71 / -2.2%
tpcds_q17/duckdb:vortex-file-compressed 25570378 / 25539186 / +0.1% 38059878 / 38197160 / -0.4% 0.67 / 0.67 / +0.5%
tpcds_q18/duckdb:vortex-file-compressed 30967468 / 31153088 / -0.6% 40531188 / 40228052 / +0.8% 0.76 / 0.77 / -1.3%
tpcds_q19/duckdb:vortex-file-compressed 77680958 / 77414668 / +0.3% 87371226 / 88530236 / -1.3% 0.89 / 0.87 / +1.7%
tpcds_q20/duckdb:vortex-file-compressed 10598493 / 10724292 / -1.2% 17633976 / 17745451 / -0.6% 0.60 / 0.60 / -0.5%
tpcds_q21/duckdb:vortex-file-compressed 10603008 / 10470166 / +1.3% 22655697 / 21448402 / +5.6% 0.47 / 0.49 / -4.1%
tpcds_q22/duckdb:vortex-file-compressed 18199393 / 17972182 / +1.3% 28099081 / 27996394 / +0.4% 0.65 / 0.64 / +0.9%
tpcds_q23/duckdb:vortex-file-compressed 37805115 / 37832930 / -0.1% 47617072 / 48024045 / -0.8% 0.79 / 0.79 / +0.8%
tpcds_q24/duckdb:vortex-file-compressed 27401027 / 27280710 / +0.4% 37492913 / 37602178 / -0.3% 0.73 / 0.73 / +0.7%
tpcds_q25/duckdb:vortex-file-compressed 23637856 / 23343046 / +1.3% 35685532 / 35279402 / +1.2% 0.66 / 0.66 / +0.1%
tpcds_q26/duckdb:vortex-file-compressed 12800270 / 12761648 / +0.3% 20693379 / 20620135 / +0.4% 0.62 / 0.62 / -0.1%
tpcds_q27/duckdb:vortex-file-compressed 16013832 / 16130970 / -0.7% 25733380 / 26516913 / -3.0% 0.62 / 0.61 / +2.3%
tpcds_q28/duckdb:vortex-file-compressed 15673030 / 15442270 / +1.5% 23971557 / 24460493 / -2.0% 0.65 / 0.63 / +3.6%
tpcds_q29/duckdb:vortex-file-compressed 23419106 / 23663650 / -1.0% 35617385 / 35183201 / +1.2% 0.66 / 0.67 / -2.2%
tpcds_q30/duckdb:vortex-file-compressed 15734121 / 16216396 / -3.0% 24472589 / 23254274 / +5.2% 0.64 / 0.70 / -7.8%
tpcds_q31/duckdb:vortex-file-compressed 17830873 / 17861928 / -0.2% 25460604 / 25941540 / -1.9% 0.70 / 0.69 / +1.7%
tpcds_q32/duckdb:vortex-file-compressed 11589544 / 11528346 / +0.5% 20889431 / 21283362 / -1.9% 0.55 / 0.54 / +2.4%
tpcds_q33/duckdb:vortex-file-compressed 18834965 / 19776336 / -4.8% 27698441 / 27466749 / +0.8% 0.68 / 0.72 / -5.6%
tpcds_q34/duckdb:vortex-file-compressed 12309602 / 12101374 / +1.7% 21346841 / 21467259 / -0.6% 0.58 / 0.56 / +2.3%
tpcds_q35/duckdb:vortex-file-compressed 28106264 / 28112076 / -0.0% 38048045 / 38240870 / -0.5% 0.74 / 0.74 / +0.5%
tpcds_q36/duckdb:vortex-file-compressed 14397530 / 14391147 / +0.0% 24088377 / 24681497 / -2.4% 0.60 / 0.58 / +2.5%
tpcds_q37/duckdb:vortex-file-compressed 9328936 / 9212808 / +1.3% 23253907 / 22022838 / +5.6% 0.40 / 0.42 / -4.1%
tpcds_q38/duckdb:vortex-file-compressed 24584292 / 24416000 / +0.7% 30988972 / 30426772 / +1.8% 0.79 / 0.80 / -1.1%
tpcds_q39/duckdb:vortex-file-compressed 20205504 / 20470003 / -1.3% 30619612 / 31488441 / -2.8% 0.66 / 0.65 / +1.5%
tpcds_q40/duckdb:vortex-file-compressed 14766702 / 14233836 / +3.7% 21156320 / 20810280 / +1.7% 0.70 / 0.68 / +2.0%
tpcds_q41/duckdb:vortex-file-compressed 16743562 / 16806528 / -0.4% 23526968 / 23581235 / -0.2% 0.71 / 0.71 / -0.1%
tpcds_q42/duckdb:vortex-file-compressed 6959226 / 6947040 / +0.2% 15156121 / 15177225 / -0.1% 0.46 / 0.46 / +0.3%
tpcds_q43/duckdb:vortex-file-compressed 10166358 / 9867166 / +3.0% 18203466 / 18078432 / +0.7% 0.56 / 0.55 / +2.3%
tpcds_q44/duckdb:vortex-file-compressed 12920214 / 12767183 / +1.2% 22351650 / 22925926 / -2.5% 0.58 / 0.56 / +3.8%
tpcds_q45/duckdb:vortex-file-compressed 23127950 / 23413399 / -1.2% 30424944 / 30578368 / -0.5% 0.76 / 0.77 / -0.7%
tpcds_q46/duckdb:vortex-file-compressed 19186402 / 19165658 / +0.1% 26648865 / 26734370 / -0.3% 0.72 / 0.72 / +0.4%
tpcds_q47/duckdb:vortex-file-compressed 34137757 / 34123432 / +0.0% 43988286 / 43850006 / +0.3% 0.78 / 0.78 / -0.3%
tpcds_q48/duckdb:vortex-file-compressed 23233686 / 23336362 / -0.4% 34987269 / 34724109 / +0.8% 0.66 / 0.67 / -1.2%
tpcds_q49/duckdb:vortex-file-compressed 19612622 / 19440484 / +0.9% 31258980 / 31441920 / -0.6% 0.63 / 0.62 / +1.5%
tpcds_q50/duckdb:vortex-file-compressed 17296780 / 17148543 / +0.9% 28046992 / 27763663 / +1.0% 0.62 / 0.62 / -0.2%
tpcds_q51/duckdb:vortex-file-compressed 48826066 / 48681482 / +0.3% 57626505 / 75590083 / -23.8% 🟢 0.85 / 0.64 / +31.6%
tpcds_q52/duckdb:vortex-file-compressed 7211922 / 6973824 / +3.4% 15217408 / 15196691 / +0.1% 0.47 / 0.46 / +3.3%
tpcds_q53/duckdb:vortex-file-compressed 11155784 / 11581516 / -3.7% 19147167 / 19335148 / -1.0% 0.58 / 0.60 / -2.7%
tpcds_q54/duckdb:vortex-file-compressed 20050302 / 20076112 / -0.1% 29207282 / 28790774 / +1.4% 0.69 / 0.70 / -1.6%
tpcds_q55/duckdb:vortex-file-compressed 6863770 / 6834079 / +0.4% 14830396 / 15778742 / -6.0% 0.46 / 0.43 / +6.9%
tpcds_q56/duckdb:vortex-file-compressed 18018840 / 17982910 / +0.2% 26874443 / 27747877 / -3.1% 0.67 / 0.65 / +3.5%
tpcds_q57/duckdb:vortex-file-compressed 25452277 / 25647497 / -0.8% 33731288 / 33968442 / -0.7% 0.75 / 0.76 / -0.1%
tpcds_q58/duckdb:vortex-file-compressed 20240588 / 20433238 / -0.9% 28679224 / 29209635 / -1.8% 0.71 / 0.70 / +0.9%
tpcds_q59/duckdb:vortex-file-compressed 19562103 / 19693700 / -0.7% 26697416 / 26903259 / -0.8% 0.73 / 0.73 / +0.1%
tpcds_q60/duckdb:vortex-file-compressed 18469102 / 18446892 / +0.1% 26957706 / 28113355 / -4.1% 0.69 / 0.66 / +4.4%
tpcds_q61/duckdb:vortex-file-compressed 24691324 / 24726354 / -0.1% 33212662 / 33421299 / -0.6% 0.74 / 0.74 / +0.5%
tpcds_q62/duckdb:vortex-file-compressed 11661574 / 12095010 / -3.6% 18917900 / 18924555 / -0.0% 0.62 / 0.64 / -3.5%
tpcds_q63/duckdb:vortex-file-compressed 10796454 / 10774297 / +0.2% 18861382 / 19322019 / -2.4% 0.57 / 0.56 / +2.7%
tpcds_q64/duckdb:vortex-file-compressed 50220394 / 49540366 / +1.4% 67131670 / 67488091 / -0.5% 0.75 / 0.73 / +1.9%
tpcds_q65/duckdb:vortex-file-compressed 13009728 / 12971960 / +0.3% 20364642 / 21100028 / -3.5% 0.64 / 0.61 / +3.9%
tpcds_q66/duckdb:vortex-file-compressed 29856474 / 29382676 / +1.6% 36687373 / 36986856 / -0.8% 0.81 / 0.79 / +2.4%
tpcds_q67/duckdb:vortex-file-compressed 57779260 / 58080422 / -0.5% 66110925 / 66137896 / -0.0% 0.87 / 0.88 / -0.5%
tpcds_q68/duckdb:vortex-file-compressed 18824476 / 18858980 / -0.2% 26768052 / 26388857 / +1.4% 0.70 / 0.71 / -1.6%
tpcds_q69/duckdb:vortex-file-compressed 22266900 / 22345762 / -0.4% 36226126 / 36591202 / -1.0% 0.61 / 0.61 / +0.7%
tpcds_q70/duckdb:vortex-file-compressed 15391794 / 15623656 / -1.5% 25262973 / 25201006 / +0.2% 0.61 / 0.62 / -1.7%
tpcds_q71/duckdb:vortex-file-compressed 13073444 / 12893999 / +1.4% 21323800 / 22289610 / -4.3% 0.61 / 0.58 / +6.0%
tpcds_q72/duckdb:vortex-file-compressed 55269618 / 54730828 / +1.0% 68744261 / 67715943 / +1.5% 0.80 / 0.81 / -0.5%
tpcds_q73/duckdb:vortex-file-compressed 11215170 / 11171449 / +0.4% 19860373 / 20187284 / -1.6% 0.56 / 0.55 / +2.0%
tpcds_q74/duckdb:vortex-file-compressed 25953072 / 26045986 / -0.4% 32696297 / 33093862 / -1.2% 0.79 / 0.79 / +0.9%
tpcds_q75/duckdb:vortex-file-compressed 28593760 / 28960507 / -1.3% 38162607 / 37985478 / +0.5% 0.75 / 0.76 / -1.7%
tpcds_q76/duckdb:vortex-file-compressed 12735997 / 12866162 / -1.0% 21344254 / 22570029 / -5.4% 0.60 / 0.57 / +4.7%
tpcds_q77/duckdb:vortex-file-compressed 20692460 / 20953319 / -1.2% 29800097 / 28843595 / +3.3% 0.69 / 0.73 / -4.4%
tpcds_q78/duckdb:vortex-file-compressed 43748361 / 43523280 / +0.5% 53079913 / 53061533 / +0.0% 0.82 / 0.82 / +0.5%
tpcds_q79/duckdb:vortex-file-compressed 13303902 / 13133414 / +1.3% 20808310 / 20449951 / +1.8% 0.64 / 0.64 / -0.4%
tpcds_q80/duckdb:vortex-file-compressed 37139396 / 38112692 / -2.6% 48958486 / 48955141 / +0.0% 0.76 / 0.78 / -2.6%
tpcds_q81/duckdb:vortex-file-compressed 20808062 / 21130844 / -1.5% 28428890 / 28921823 / -1.7% 0.73 / 0.73 / +0.2%
tpcds_q82/duckdb:vortex-file-compressed 9420612 / 9577543 / -1.6% 20839812 / 21709041 / -4.0% 0.45 / 0.44 / +2.5%
tpcds_q83/duckdb:vortex-file-compressed 17315269 / 17245764 / +0.4% 24357828 / 24694507 / -1.4% 0.71 / 0.70 / +1.8%
tpcds_q84/duckdb:vortex-file-compressed 15422243 / 15545053 / -0.8% 22244843 / 23072386 / -3.6% 0.69 / 0.67 / +2.9%
tpcds_q85/duckdb:vortex-file-compressed 24293004 / 24219552 / +0.3% 36624663 / 36067352 / +1.5% 0.66 / 0.67 / -1.2%
tpcds_q86/duckdb:vortex-file-compressed 9546484 / 9678996 / -1.4% 16263127 / 16889096 / -3.7% 0.59 / 0.57 / +2.4%
tpcds_q87/duckdb:vortex-file-compressed 25583544 / 25753060 / -0.7% 32531312 / 31515224 / +3.2% 0.79 / 0.82 / -3.8%
tpcds_q88/duckdb:vortex-file-compressed 31216920 / 31288280 / -0.2% 39289456 / 39101846 / +0.5% 0.79 / 0.80 / -0.7%
tpcds_q89/duckdb:vortex-file-compressed 11986290 / 11830948 / +1.3% 19988135 / 20540047 / -2.7% 0.60 / 0.58 / +4.1%
tpcds_q90/duckdb:vortex-file-compressed 8204527 / 8174146 / +0.4% 15173900 / 15393280 / -1.4% 0.54 / 0.53 / +1.8%
tpcds_q91/duckdb:vortex-file-compressed 14434273 / 14175986 / +1.8% 20159433 / 21025859 / -4.1% 0.72 / 0.67 / +6.2%
tpcds_q92/duckdb:vortex-file-compressed 11849642 / 11799417 / +0.4% 20623342 / 20696315 / -0.4% 0.57 / 0.57 / +0.8%
tpcds_q93/duckdb:vortex-file-compressed 10408434 / 10530452 / -1.2% 24171951 / 23099422 / +4.6% 0.43 / 0.46 / -5.5%
tpcds_q94/duckdb:vortex-file-compressed 22114446 / 21814858 / +1.4% 31024115 / 31535899 / -1.6% 0.71 / 0.69 / +3.0%
tpcds_q95/duckdb:vortex-file-compressed 62047924 / 62048885 / -0.0% 70733341 / 70528768 / +0.3% 0.88 / 0.88 / -0.3%
tpcds_q96/duckdb:vortex-file-compressed 6752362 / 6813175 / -0.9% 14849385 / 14920586 / -0.5% 0.45 / 0.46 / -0.4%
tpcds_q97/duckdb:vortex-file-compressed 23550910 / 23607630 / -0.2% 32336920 / 31903735 / +1.4% 0.73 / 0.74 / -1.6%
tpcds_q98/duckdb:vortex-file-compressed 11371891 / 11219368 / +1.4% 18137702 / 19198510 / -5.5% 0.63 / 0.58 / +7.3%
tpcds_q99/duckdb:vortex-file-compressed 14741481 / 14793370 / -0.4% 21460768 / 21840748 / -1.7% 0.69 / 0.68 / +1.4%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24213684 / 24569616 / -1.4% 31240940 / 31253594 / -0.0% 0.78 / 0.79 / -1.4%
tpcds_q02/duckdb:parquet 18276684 / 18371663 / -0.5% 23962963 / 24806917 / -3.4% 0.76 / 0.74 / +3.0%
tpcds_q03/duckdb:parquet 9840056 / 9795552 / +0.5% 15354061 / 15777796 / -2.7% 0.64 / 0.62 / +3.2%
tpcds_q04/duckdb:parquet 117670457 / 118593504 / -0.8% 126451780 / 126787777 / -0.3% 0.93 / 0.94 / -0.5%
tpcds_q05/duckdb:parquet 28878566 / 29033720 / -0.5% 32928459 / 32758234 / +0.5% 0.88 / 0.89 / -1.0%
tpcds_q06/duckdb:parquet 26946538 / 26555287 / +1.5% 36092683 / 36423739 / -0.9% 0.75 / 0.73 / +2.4%
tpcds_q07/duckdb:parquet 33658398 / 32411608 / +3.8% 41250554 / 39096426 / +5.5% 0.82 / 0.83 / -1.6%
tpcds_q08/duckdb:parquet 20080202 / 20124923 / -0.2% 24040998 / 24726566 / -2.8% 0.84 / 0.81 / +2.6%
tpcds_q09/duckdb:parquet 26584411 / 27345430 / -2.8% 31017344 / 30334027 / +2.3% 0.86 / 0.90 / -4.9%
tpcds_q10/duckdb:parquet 32846040 / 33258784 / -1.2% 40699270 / 40660668 / +0.1% 0.81 / 0.82 / -1.3%
tpcds_q11/duckdb:parquet 68569508 / 71040858 / -3.5% 75152612 / 75267275 / -0.2% 0.91 / 0.94 / -3.3%
tpcds_q12/duckdb:parquet 14197928 / 14438665 / -1.7% 18967654 / 19403868 / -2.2% 0.75 / 0.74 / +0.6%
tpcds_q13/duckdb:parquet 30809502 / 31329574 / -1.7% 39613042 / 40058635 / -1.1% 0.78 / 0.78 / -0.6%
tpcds_q14/duckdb:parquet 64453258 / 65385466 / -1.4% 68750842 / 72006332 / -4.5% 0.94 / 0.91 / +3.2%
tpcds_q15/duckdb:parquet 16883123 / 17007052 / -0.7% 22833973 / 22941753 / -0.5% 0.74 / 0.74 / -0.3%
tpcds_q16/duckdb:parquet 30464494 / 30751528 / -0.9% 37426970 / 37628273 / -0.5% 0.81 / 0.82 / -0.4%
tpcds_q17/duckdb:parquet 35074602 / 35094408 / -0.1% 40383821 / 41344683 / -2.3% 0.87 / 0.85 / +2.3%
tpcds_q18/duckdb:parquet 47711622 / 47719892 / -0.0% 54689422 / 55141913 / -0.8% 0.87 / 0.87 / +0.8%
tpcds_q19/duckdb:parquet 19072644 / 19097338 / -0.1% 25264586 / 25659347 / -1.5% 0.75 / 0.74 / +1.4%
tpcds_q20/duckdb:parquet 15087277 / 15281040 / -1.3% 19592758 / 19441382 / +0.8% 0.77 / 0.79 / -2.0%
tpcds_q21/duckdb:parquet 10983324 / 10953417 / +0.3% 17236500 / 17292345 / -0.3% 0.64 / 0.63 / +0.6%
tpcds_q22/duckdb:parquet 20660561 / 20765965 / -0.5% 26933446 / 26682350 / +0.9% 0.77 / 0.78 / -1.4%
tpcds_q23/duckdb:parquet 42598730 / 44395944 / -4.0% 46825693 / 49904432 / -6.2% 0.91 / 0.89 / +2.3%
tpcds_q24/duckdb:parquet 30609154 / 30675967 / -0.2% 36884546 / 36507785 / +1.0% 0.83 / 0.84 / -1.2%
tpcds_q25/duckdb:parquet 30765756 / 30997888 / -0.7% 36717264 / 37346883 / -1.7% 0.84 / 0.83 / +1.0%
tpcds_q26/duckdb:parquet 29438391 / 29436936 / +0.0% 34999025 / 35146956 / -0.4% 0.84 / 0.84 / +0.4%
tpcds_q27/duckdb:parquet 35468158 / 33786320 / +5.0% 41903390 / 42747870 / -2.0% 0.85 / 0.79 / +7.1%
tpcds_q28/duckdb:parquet 26883975 / 26555733 / +1.2% 32445750 / 32187486 / +0.8% 0.83 / 0.83 / +0.4%
tpcds_q29/duckdb:parquet 32242214 / 32878404 / -1.9% 39701727 / 39678945 / +0.1% 0.81 / 0.83 / -2.0%
tpcds_q30/duckdb:parquet 36061417 / 35830018 / +0.6% 44821502 / 44436689 / +0.9% 0.80 / 0.81 / -0.2%
tpcds_q31/duckdb:parquet 35833366 / 36273738 / -1.2% 43019563 / 43688524 / -1.5% 0.83 / 0.83 / +0.3%
tpcds_q32/duckdb:parquet 14443078 / 14606349 / -1.1% 20913648 / 21416396 / -2.3% 0.69 / 0.68 / +1.3%
tpcds_q33/duckdb:parquet 25090596 / 24790998 / +1.2% 28947286 / 29133086 / -0.6% 0.87 / 0.85 / +1.9%
tpcds_q34/duckdb:parquet 18847796 / 17406672 / +8.3% 24179845 / 24432499 / -1.0% 0.78 / 0.71 / +9.4%
tpcds_q35/duckdb:parquet 35368473 / 35554373 / -0.5% 44354581 / 44683821 / -0.7% 0.80 / 0.80 / +0.2%
tpcds_q36/duckdb:parquet 41180173 / 40194698 / +2.5% 48024038 / 48054996 / -0.1% 0.86 / 0.84 / +2.5%
tpcds_q37/duckdb:parquet 12711603 / 12793674 / -0.6% 19258175 / 19592667 / -1.7% 0.66 / 0.65 / +1.1%
tpcds_q38/duckdb:parquet 29869124 / 30047228 / -0.6% 33694549 / 33923984 / -0.7% 0.89 / 0.89 / +0.1%
tpcds_q39/duckdb:parquet 23380362 / 23622195 / -1.0% 30924152 / 29400291 / +5.2% 0.76 / 0.80 / -5.9%
tpcds_q40/duckdb:parquet 16131688 / 16336790 / -1.3% 21297443 / 21902162 / -2.8% 0.76 / 0.75 / +1.5%
tpcds_q41/duckdb:parquet 12449316 / 12290571 / +1.3% 18430109 / 18920259 / -2.6% 0.68 / 0.65 / +4.0%
tpcds_q42/duckdb:parquet 9584592 / 9595271 / -0.1% 15173123 / 15499496 / -2.1% 0.63 / 0.62 / +2.0%
tpcds_q43/duckdb:parquet 12540890 / 12533833 / +0.1% 18456222 / 18565693 / -0.6% 0.68 / 0.68 / +0.6%
tpcds_q44/duckdb:parquet 20618162 / 21271132 / -3.1% 28355396 / 26485690 / +7.1% 0.73 / 0.80 / -9.5%
tpcds_q45/duckdb:parquet 21305804 / 21290920 / +0.1% 27843609 / 28358611 / -1.8% 0.77 / 0.75 / +1.9%
tpcds_q46/duckdb:parquet 37168528 / 35736778 / +4.0% 44592228 / 43998833 / +1.3% 0.83 / 0.81 / +2.6%
tpcds_q47/duckdb:parquet 34666442 / 34502155 / +0.5% 41079074 / 40772337 / +0.8% 0.84 / 0.85 / -0.3%
tpcds_q48/duckdb:parquet 31426852 / 29055172 / +8.2% 37005673 / 37886753 / -2.3% 0.85 / 0.77 / +10.7%
tpcds_q49/duckdb:parquet 31444396 / 30282125 / +3.8% 36727684 / 36366515 / +1.0% 0.86 / 0.83 / +2.8%
tpcds_q50/duckdb:parquet 19821988 / 20997519 / -5.6% 25796470 / 26254238 / -1.7% 0.77 / 0.80 / -3.9%
tpcds_q51/duckdb:parquet 52413820 / 52527224 / -0.2% 59109051 / 61404859 / -3.7% 0.89 / 0.86 / +3.7%
tpcds_q52/duckdb:parquet 9638964 / 9696622 / -0.6% 15526884 / 15920941 / -2.5% 0.62 / 0.61 / +1.9%
tpcds_q53/duckdb:parquet 14147128 / 14282824 / -1.0% 20568392 / 21089102 / -2.5% 0.69 / 0.68 / +1.6%
tpcds_q54/duckdb:parquet 25450418 / 25080784 / +1.5% 32286916 / 32572146 / -0.9% 0.79 / 0.77 / +2.4%
tpcds_q55/duckdb:parquet 9550401 / 9532594 / +0.2% 15039955 / 15332896 / -1.9% 0.64 / 0.62 / +2.1%
tpcds_q56/duckdb:parquet 24919308 / 24868516 / +0.2% 30114641 / 30880093 / -2.5% 0.83 / 0.81 / +2.8%
tpcds_q57/duckdb:parquet 31033514 / 30876466 / +0.5% 36314908 / 36156172 / +0.4% 0.85 / 0.85 / +0.1%
tpcds_q58/duckdb:parquet 24420225 / 24167384 / +1.0% 29885438 / 30311720 / -1.4% 0.82 / 0.80 / +2.5%
tpcds_q59/duckdb:parquet 23456911 / 24670552 / -4.9% 29400336 / 29792613 / -1.3% 0.80 / 0.83 / -3.7%
tpcds_q60/duckdb:parquet 27426316 / 27578222 / -0.6% 31900792 / 32411678 / -1.6% 0.86 / 0.85 / +1.0%
tpcds_q61/duckdb:parquet 24674638 / 23294327 / +5.9% 29780934 / 29827535 / -0.2% 0.83 / 0.78 / +6.1%
tpcds_q62/duckdb:parquet 13207678 / 13291998 / -0.6% 18050204 / 18180801 / -0.7% 0.73 / 0.73 / +0.1%
tpcds_q63/duckdb:parquet 13529441 / 13454667 / +0.6% 19924286 / 20222695 / -1.5% 0.68 / 0.67 / +2.1%
tpcds_q64/duckdb:parquet 72960064 / 71190792 / +2.5% 81478130 / 80878722 / +0.7% 0.90 / 0.88 / +1.7%
tpcds_q65/duckdb:parquet 18709070 / 19012964 / -1.6% 25567253 / 24710752 / +3.5% 0.73 / 0.77 / -4.9%
tpcds_q66/duckdb:parquet 35815931 / 35679902 / +0.4% 41398773 / 42244865 / -2.0% 0.87 / 0.84 / +2.4%
tpcds_q67/duckdb:parquet 60634878 / 60260071 / +0.6% 67092142 / 67298170 / -0.3% 0.90 / 0.90 / +0.9%
tpcds_q68/duckdb:parquet 30804932 / 29391762 / +4.8% 36773783 / 36283629 / +1.4% 0.84 / 0.81 / +3.4%
tpcds_q69/duckdb:parquet 26002614 / 26236904 / -0.9% 34854618 / 34437238 / +1.2% 0.75 / 0.76 / -2.1%
tpcds_q70/duckdb:parquet 19404349 / 19562002 / -0.8% 26235093 / 26226230 / +0.0% 0.74 / 0.75 / -0.8%
tpcds_q71/duckdb:parquet 17001114 / 17069140 / -0.4% 23460990 / 24234697 / -3.2% 0.72 / 0.70 / +2.9%
tpcds_q72/duckdb:parquet 54242764 / 54853729 / -1.1% 61574240 / 62481223 / -1.5% 0.88 / 0.88 / +0.3%
tpcds_q73/duckdb:parquet 15062898 / 15005266 / +0.4% 21926209 / 22234708 / -1.4% 0.69 / 0.67 / +1.8%
tpcds_q74/duckdb:parquet 84190404 / 84442506 / -0.3% 91161810 / 91205126 / -0.0% 0.92 / 0.93 / -0.3%
tpcds_q75/duckdb:parquet 44358498 / 44465652 / -0.2% 50688886 / 51364121 / -1.3% 0.88 / 0.87 / +1.1%
tpcds_q76/duckdb:parquet 18840151 / 18799808 / +0.2% 23762545 / 23604752 / +0.7% 0.79 / 0.80 / -0.5%
tpcds_q77/duckdb:parquet 26632448 / 24874006 / +7.1% 31055330 / 31227481 / -0.6% 0.86 / 0.80 / +7.7%
tpcds_q78/duckdb:parquet 80694298 / 79179520 / +1.9% 85337607 / 86073931 / -0.9% 0.95 / 0.92 / +2.8%
tpcds_q79/duckdb:parquet 21883369 / 22199598 / -1.4% 29171357 / 29350712 / -0.6% 0.75 / 0.76 / -0.8%
tpcds_q80/duckdb:parquet 38558572 / 38590975 / -0.1% 44761389 / 43437976 / +3.0% 0.86 / 0.89 / -3.0%
tpcds_q81/duckdb:parquet 36829884 / 36718284 / +0.3% 45125402 / 45799489 / -1.5% 0.82 / 0.80 / +1.8%
tpcds_q82/duckdb:parquet 13508354 / 13687152 / -1.3% 20007739 / 20720313 / -3.4% 0.68 / 0.66 / +2.2%
tpcds_q83/duckdb:parquet 20753146 / 20426367 / +1.6% 25552391 / 25451174 / +0.4% 0.81 / 0.80 / +1.2%
tpcds_q84/duckdb:parquet 23346142 / 23423950 / -0.3% 28159356 / 28637937 / -1.7% 0.83 / 0.82 / +1.4%
tpcds_q85/duckdb:parquet 32806289 / 32347878 / +1.4% 39421622 / 39639719 / -0.6% 0.83 / 0.82 / +2.0%
tpcds_q86/duckdb:parquet 12048182 / 11849395 / +1.7% 16812712 / 16749817 / +0.4% 0.72 / 0.71 / +1.3%
tpcds_q87/duckdb:parquet 31521926 / 31719120 / -0.6% 35591956 / 36907909 / -3.6% 0.89 / 0.86 / +3.1%
tpcds_q88/duckdb:parquet 39486726 / 39763190 / -0.7% 43949051 / 45339151 / -3.1% 0.90 / 0.88 / +2.4%
tpcds_q89/duckdb:parquet 14433001 / 14522494 / -0.6% 21152506 / 21644578 / -2.3% 0.68 / 0.67 / +1.7%
tpcds_q90/duckdb:parquet 10263838 / 10379900 / -1.1% 15161355 / 15593648 / -2.8% 0.68 / 0.67 / +1.7%
tpcds_q91/duckdb:parquet 21282118 / 21429460 / -0.7% 28985624 / 29111785 / -0.4% 0.73 / 0.74 / -0.3%
tpcds_q92/duckdb:parquet 15942798 / 15773804 / +1.1% 22974324 / 22328867 / +2.9% 0.69 / 0.71 / -1.8%
tpcds_q93/duckdb:parquet 14337361 / 14296588 / +0.3% 20299104 / 20437873 / -0.7% 0.71 / 0.70 / +1.0%
tpcds_q94/duckdb:parquet 25848505 / 25530786 / +1.2% 33937696 / 33038037 / +2.7% 0.76 / 0.77 / -1.4%
tpcds_q95/duckdb:parquet 44106194 / 44153322 / -0.1% 49625766 / 50172171 / -1.1% 0.89 / 0.88 / +1.0%
tpcds_q96/duckdb:parquet 8336368 / 8355095 / -0.2% 13682638 / 14382025 / -4.9% 0.61 / 0.58 / +4.9%
tpcds_q97/duckdb:parquet 27734078 / 27623366 / +0.4% 34251361 / 34132101 / +0.3% 0.81 / 0.81 / +0.1%
tpcds_q98/duckdb:parquet 16546658 / 16549373 / -0.0% 23270532 / 23251779 / +0.1% 0.71 / 0.71 / -0.1%
tpcds_q99/duckdb:parquet 19147348 / 19388500 / -1.2% 24465210 / 24335243 / +0.5% 0.78 / 0.80 / -1.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR c63d98dd vs base 891c01ab
Vortex (geomean): hot 0.998x ➖ · cold 0.976x ➖


datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44673573 / 45115443 / -1.0% 92035497 / 93846898 / -1.9% 0.49 / 0.48 / +1.0%
polarsignals_q01/datafusion:vortex-file-compressed 50678678 / 50678700 / -0.0% 115055506 / 117957529 / -2.5% 0.44 / 0.43 / +2.5%
polarsignals_q02/datafusion:vortex-file-compressed 43799917 / 45466658 / -3.7% 91572785 / 86493948 / +5.9% 0.48 / 0.53 / -9.0%
polarsignals_q03/datafusion:vortex-file-compressed 53932826 / 53373156 / +1.0% 115900889 / 121270107 / -4.4% 0.47 / 0.44 / +5.7%
polarsignals_q04/datafusion:vortex-file-compressed 9193225 / 9092400 / +1.1% 50020680 / 53077162 / -5.8% 0.18 / 0.17 / +7.3%
polarsignals_q05/datafusion:vortex-file-compressed 11654052 / 11900222 / -2.1% 53743732 / 54576797 / -1.5% 0.22 / 0.22 / -0.6%
polarsignals_q06/datafusion:vortex-file-compressed 23285550 / 23233577 / +0.2% 64404794 / 65904373 / -2.3% 0.36 / 0.35 / +2.6%
polarsignals_q07/datafusion:vortex-file-compressed 11276576 / 11260816 / +0.1% 51315461 / 54624049 / -6.1% 0.22 / 0.21 / +6.6%
polarsignals_q08/datafusion:vortex-file-compressed 98363690 / 98053406 / +0.3% 162442762 / 170161727 / -4.5% 0.61 / 0.58 / +5.1%
polarsignals_q09/datafusion:vortex-file-compressed 10224958 / 9995404 / +2.3% 49630227 / 49603840 / +0.1% 0.21 / 0.20 / +2.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR c63d98dd vs base 891c01ab
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.054x ➖
Parquet (geomean): hot 1.011x ➖ · cold 1.049x ➖
Shifts: Parquet (control) +1.1% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7004068 / 6967318 / +0.5% 16480989 / 16049965 / +2.7% 0.42 / 0.43 / -2.1%
fineweb_q01/datafusion:vortex-file-compressed 8939825 / 9435792 / -5.3% 46980516 / 44731501 / +5.0% 0.19 / 0.21 / -9.8%
fineweb_q02/datafusion:vortex-file-compressed 11091881 / 10095934 / +9.9% 51933586 / 49629607 / +4.6% 0.21 / 0.20 / +5.0%
fineweb_q03/datafusion:vortex-file-compressed 19662637 / 20965292 / -6.2% 110908782 / 108695983 / +2.0% 0.18 / 0.19 / -8.1%
fineweb_q04/datafusion:vortex-file-compressed 66209514 / 66942157 / -1.1% 157573645 / 150154371 / +4.9% 0.42 / 0.45 / -5.8%
fineweb_q05/datafusion:vortex-file-compressed 66721116 / 67340242 / -0.9% 153222808 / 147100608 / +4.2% 0.44 / 0.46 / -4.9%
fineweb_q06/datafusion:vortex-file-compressed 19134748 / 19390104 / -1.3% 123624157 / 113140870 / +9.3% 0.15 / 0.17 / -9.7%
fineweb_q07/datafusion:vortex-file-compressed 18212678 / 18480318 / -1.4% 111648077 / 109286066 / +2.2% 0.16 / 0.17 / -3.5%
fineweb_q08/datafusion:vortex-file-compressed 11673325 / 11139960 / +4.8% 43437349 / 44863983 / -3.2% 0.27 / 0.25 / +8.2%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9287839 / 9176294 / +1.2% 33588780 / 31962985 / +5.1% 0.28 / 0.29 / -3.7%
fineweb_q01/datafusion:parquet 75588789 / 75277029 / +0.4% 165704773 / 157405746 / +5.3% 0.46 / 0.48 / -4.6%
fineweb_q02/datafusion:parquet 75505674 / 74482994 / +1.4% 165565365 / 150889874 / +9.7% 0.46 / 0.49 / -7.6%
fineweb_q03/datafusion:parquet 74840094 / 73029516 / +2.5% 168298410 / 154526562 / +8.9% 0.44 / 0.47 / -5.9%
fineweb_q04/datafusion:parquet 83425952 / 82710362 / +0.9% 167482945 / 153270537 / +9.3% 0.50 / 0.54 / -7.7%
fineweb_q05/datafusion:parquet 82793275 / 81635758 / +1.4% 167036849 / 149852685 / +11.5% 🔴 0.50 / 0.54 / -9.0%
fineweb_q06/datafusion:parquet 75477698 / 77888344 / -3.1% 170623764 / 153969666 / +10.8% 🔴 0.44 / 0.51 / -12.6%
fineweb_q07/datafusion:parquet 74226774 / 74337435 / -0.1% 158639935 / 150290974 / +5.6% 0.47 / 0.49 / -5.4%
fineweb_q08/datafusion:parquet 73872141 / 74038366 / -0.2% 155971517 / 151322026 / +3.1% 0.47 / 0.49 / -3.2%
duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2027056 / 1982043 / +2.3% 8693854 / 7212863 / +20.5% 🔴 0.23 / 0.27 / -15.2%
fineweb_q01/duckdb:vortex-file-compressed 9601556 / 9388336 / +2.3% 34606624 / 32625632 / +6.1% 0.28 / 0.29 / -3.6%
fineweb_q02/duckdb:vortex-file-compressed 10889134 / 10609639 / +2.6% 34267574 / 33112729 / +3.5% 0.32 / 0.32 / -0.8%
fineweb_q03/duckdb:vortex-file-compressed 19530645 / 19831758 / -1.5% 97481603 / 88522732 / +10.1% 🔴 0.20 / 0.22 / -10.6%
fineweb_q04/duckdb:vortex-file-compressed 67505128 / 68009227 / -0.7% 114854122 / 104788873 / +9.6% 0.59 / 0.65 / -9.4%
fineweb_q05/duckdb:vortex-file-compressed 67757732 / 66121595 / +2.5% 112971901 / 104323414 / +8.3% 0.60 / 0.63 / -5.4%
fineweb_q06/duckdb:vortex-file-compressed 19149268 / 19631661 / -2.5% 102360984 / 92354102 / +10.8% 🔴 0.19 / 0.21 / -12.0%
fineweb_q07/duckdb:vortex-file-compressed 18865770 / 18330431 / +2.9% 95958554 / 85849968 / +11.8% 🔴 0.20 / 0.21 / -7.9%
fineweb_q08/duckdb:vortex-file-compressed 5653616 / 5447516 / +3.8% 13372124 / 15125771 / -11.6% 🟢 0.42 / 0.36 / +17.4%
duckdb / parquet / ns (1.017x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24483861 / 23445030 / +4.4% 29019370 / 27892861 / +4.0% 0.84 / 0.84 / +0.4%
fineweb_q01/duckdb:parquet 57063086 / 56264058 / +1.4% 82525879 / 76333224 / +8.1% 0.69 / 0.74 / -6.2%
fineweb_q02/duckdb:parquet 61014445 / 58792404 / +3.8% 88908600 / 83840356 / +6.0% 0.69 / 0.70 / -2.1%
fineweb_q03/duckdb:parquet 120068057 / 119208047 / +0.7% 192303034 / 183651427 / +4.7% 0.62 / 0.65 / -3.8%
fineweb_q04/duckdb:parquet 163233466 / 165904157 / -1.6% 212293616 / 213997817 / -0.8% 0.77 / 0.78 / -0.8%
fineweb_q05/duckdb:parquet 159640883 / 157636433 / +1.3% 206685372 / 215240287 / -4.0% 0.77 / 0.73 / +5.5%
fineweb_q06/duckdb:parquet 89536717 / 88246212 / +1.5% 158995169 / 158365872 / +0.4% 0.56 / 0.56 / +1.1%
fineweb_q07/duckdb:parquet 92417701 / 90578990 / +2.0% 153568315 / 156378525 / -1.8% 0.60 / 0.58 / +3.9%
fineweb_q08/duckdb:parquet 29814570 / 29382608 / +1.5% 31729292 / 30348672 / +4.5% 0.94 / 0.97 / -2.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR c63d98dd vs base 891c01ab
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.038x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.020x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 17289893 / 17384191 / -0.5% 44942164 / 41320135 / +8.8% 0.38 / 0.42 / -8.6%
tpch_q02/datafusion:vortex-file-compressed 17466289 / 18108910 / -3.5% 34991618 / 35296794 / -0.9% 0.50 / 0.51 / -2.7%
tpch_q03/datafusion:vortex-file-compressed 22283489 / 22011605 / +1.2% 52064864 / 47329582 / +10.0% 🔴 0.43 / 0.47 / -8.0%
tpch_q04/datafusion:vortex-file-compressed 12958475 / 12985272 / -0.2% 38246758 / 34375288 / +11.3% 🔴 0.34 / 0.38 / -10.3%
tpch_q05/datafusion:vortex-file-compressed 39672519 / 39366026 / +0.8% 71584557 / 72738976 / -1.6% 0.55 / 0.54 / +2.4%
tpch_q06/datafusion:vortex-file-compressed 8598484 / 8622478 / -0.3% 34475202 / 24631328 / +40.0% 🔴 0.25 / 0.35 / -28.8%
tpch_q07/datafusion:vortex-file-compressed 54477090 / 55837501 / -2.4% 86441157 / 79804722 / +8.3% 0.63 / 0.70 / -9.9%
tpch_q08/datafusion:vortex-file-compressed 54749277 / 54796886 / -0.1% 86955104 / 83603129 / +4.0% 0.63 / 0.66 / -3.9%
tpch_q09/datafusion:vortex-file-compressed 49759664 / 49612248 / +0.3% 79332753 / 81128665 / -2.2% 0.63 / 0.61 / +2.6%
tpch_q10/datafusion:vortex-file-compressed 20579688 / 20486472 / +0.5% 56914243 / 49226188 / +15.6% 🔴 0.36 / 0.42 / -13.1%
tpch_q11/datafusion:vortex-file-compressed 15593024 / 15527100 / +0.4% 34793139 / 32817996 / +6.0% 0.45 / 0.47 / -5.3%
tpch_q12/datafusion:vortex-file-compressed 25201705 / 24989921 / +0.8% 45158954 / 42543080 / +6.1% 0.56 / 0.59 / -5.0%
tpch_q13/datafusion:vortex-file-compressed 20785975 / 20263530 / +2.6% 40662790 / 40004002 / +1.6% 0.51 / 0.51 / +0.9%
tpch_q14/datafusion:vortex-file-compressed 15205785 / 15411592 / -1.3% 40502874 / 37321980 / +8.5% 0.38 / 0.41 / -9.1%
tpch_q15/datafusion:vortex-file-compressed 20897096 / 20746202 / +0.7% 48186907 / 46594252 / +3.4% 0.43 / 0.45 / -2.6%
tpch_q16/datafusion:vortex-file-compressed 18443235 / 18216789 / +1.2% 40818100 / 41541814 / -1.7% 0.45 / 0.44 / +3.0%
tpch_q17/datafusion:vortex-file-compressed 29900491 / 29842182 / +0.2% 59952189 / 57697493 / +3.9% 0.50 / 0.52 / -3.6%
tpch_q18/datafusion:vortex-file-compressed 37961234 / 37703770 / +0.7% 60879149 / 59679217 / +2.0% 0.62 / 0.63 / -1.3%
tpch_q19/datafusion:vortex-file-compressed 18740380 / 18745025 / -0.0% 41123884 / 38791307 / +6.0% 0.46 / 0.48 / -5.7%
tpch_q20/datafusion:vortex-file-compressed 23539946 / 23334521 / +0.9% 47895045 / 45011563 / +6.4% 0.49 / 0.52 / -5.2%
tpch_q21/datafusion:vortex-file-compressed 44278855 / 43623532 / +1.5% 73713625 / 73741183 / -0.0% 0.60 / 0.59 / +1.5%
tpch_q22/datafusion:vortex-file-compressed 11313285 / 11247979 / +0.6% 31436023 / 30234457 / +4.0% 0.36 / 0.37 / -3.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72208047 / 72142750 / +0.1% 91087399 / 89062096 / +2.3% 0.79 / 0.81 / -2.1%
tpch_q02/datafusion:parquet 75903297 / 76098300 / -0.3% 94347619 / 92809458 / +1.7% 0.80 / 0.82 / -1.9%
tpch_q03/datafusion:parquet 83992062 / 83471963 / +0.6% 106937109 / 105305244 / +1.5% 0.79 / 0.79 / -0.9%
tpch_q04/datafusion:parquet 40825087 / 40757507 / +0.2% 61032424 / 58121610 / +5.0% 0.67 / 0.70 / -4.6%
tpch_q05/datafusion:parquet 112764013 / 111960635 / +0.7% 141180380 / 138441875 / +2.0% 0.80 / 0.81 / -1.2%
tpch_q06/datafusion:parquet 32096076 / 32004203 / +0.3% 51647953 / 49329132 / +4.7% 0.62 / 0.65 / -4.2%
tpch_q07/datafusion:parquet 115984823 / 115579072 / +0.4% 144706427 / 140493846 / +3.0% 0.80 / 0.82 / -2.6%
tpch_q08/datafusion:parquet 120167037 / 119412665 / +0.6% 150224778 / 145416929 / +3.3% 0.80 / 0.82 / -2.6%
tpch_q09/datafusion:parquet 140140229 / 139917445 / +0.2% 171944802 / 167025140 / +2.9% 0.82 / 0.84 / -2.7%
tpch_q10/datafusion:parquet 106364303 / 106540246 / -0.2% 133277866 / 131516884 / +1.3% 0.80 / 0.81 / -1.5%
tpch_q11/datafusion:parquet 61311537 / 61323999 / -0.0% 82839854 / 80253956 / +3.2% 0.74 / 0.76 / -3.1%
tpch_q12/datafusion:parquet 65642159 / 65066982 / +0.9% 88551531 / 85567792 / +3.5% 0.74 / 0.76 / -2.5%
tpch_q13/datafusion:parquet 146507331 / 146733377 / -0.2% 169591671 / 165893920 / +2.2% 0.86 / 0.88 / -2.3%
tpch_q14/datafusion:parquet 47783125 / 47804741 / -0.0% 73063914 / 68279475 / +7.0% 0.65 / 0.70 / -6.6%
tpch_q15/datafusion:parquet 74270387 / 75804155 / -2.0% 97861487 / 96010013 / +1.9% 0.76 / 0.79 / -3.9%
tpch_q16/datafusion:parquet 44042595 / 43687693 / +0.8% 64525481 / 61726959 / +4.5% 0.68 / 0.71 / -3.6%
tpch_q17/datafusion:parquet 124971262 / 124600341 / +0.3% 151584485 / 146923680 / +3.2% 0.82 / 0.85 / -2.8%
tpch_q18/datafusion:parquet 124369715 / 124176256 / +0.2% 144756899 / 144729522 / +0.0% 0.86 / 0.86 / +0.1%
tpch_q19/datafusion:parquet 57714921 / 58451856 / -1.3% 87512735 / 82281718 / +6.4% 0.66 / 0.71 / -7.2%
tpch_q20/datafusion:parquet 79562087 / 79813946 / -0.3% 104764347 / 103634081 / +1.1% 0.76 / 0.77 / -1.4%
tpch_q21/datafusion:parquet 117102258 / 117477335 / -0.3% 142912832 / 143471036 / -0.4% 0.82 / 0.82 / +0.1%
tpch_q22/datafusion:parquet 51489123 / 51820826 / -0.6% 68060570 / 67541500 / +0.8% 0.76 / 0.77 / -1.4%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9307254 / 9364457 / -0.6% 19855575 / 20059148 / -1.0% 0.47 / 0.47 / +0.4%
tpch_q02/duckdb:vortex-file-compressed 15741768 / 15553021 / +1.2% 25093627 / 25519582 / -1.7% 0.63 / 0.61 / +2.9%
tpch_q03/duckdb:vortex-file-compressed 18118004 / 18447596 / -1.8% 33070524 / 33492566 / -1.3% 0.55 / 0.55 / -0.5%
tpch_q04/duckdb:vortex-file-compressed 12232901 / 12231666 / +0.0% 24752256 / 23638210 / +4.7% 0.49 / 0.52 / -4.5%
tpch_q05/duckdb:vortex-file-compressed 20191405 / 20369078 / -0.9% 32630178 / 34300176 / -4.9% 0.62 / 0.59 / +4.2%
tpch_q06/duckdb:vortex-file-compressed 4619556 / 4726939 / -2.3% 14785003 / 14112551 / +4.8% 0.31 / 0.33 / -6.7%
tpch_q07/duckdb:vortex-file-compressed 24079835 / 23935188 / +0.6% 39092259 / 36293543 / +7.7% 0.62 / 0.66 / -6.6%
tpch_q08/duckdb:vortex-file-compressed 21383518 / 21072211 / +1.5% 36581901 / 37296563 / -1.9% 0.58 / 0.56 / +3.5%
tpch_q09/duckdb:vortex-file-compressed 21352684 / 21869360 / -2.4% 37657159 / 36390883 / +3.5% 0.57 / 0.60 / -5.6%
tpch_q10/duckdb:vortex-file-compressed 26907702 / 27031495 / -0.5% 41696990 / 41090952 / +1.5% 0.65 / 0.66 / -1.9%
tpch_q11/duckdb:vortex-file-compressed 8488981 / 8276946 / +2.6% 16917684 / 16453617 / +2.8% 0.50 / 0.50 / -0.3%
tpch_q12/duckdb:vortex-file-compressed 13997989 / 14308653 / -2.2% 26920164 / 24987212 / +7.7% 0.52 / 0.57 / -9.2%
tpch_q13/duckdb:vortex-file-compressed 23194342 / 23220459 / -0.1% 32633530 / 32373657 / +0.8% 0.71 / 0.72 / -0.9%
tpch_q14/duckdb:vortex-file-compressed 11515153 / 11479354 / +0.3% 23323964 / 21850432 / +6.7% 0.49 / 0.53 / -6.0%
tpch_q15/duckdb:vortex-file-compressed 8683404 / 8505233 / +2.1% 19686840 / 19385175 / +1.6% 0.44 / 0.44 / +0.5%
tpch_q16/duckdb:vortex-file-compressed 16492883 / 16596086 / -0.6% 23151320 / 23599585 / -1.9% 0.71 / 0.70 / +1.3%
tpch_q17/duckdb:vortex-file-compressed 12230858 / 12103817 / +1.0% 23981231 / 25656785 / -6.5% 0.51 / 0.47 / +8.1%
tpch_q18/duckdb:vortex-file-compressed 23589557 / 23763978 / -0.7% 34375064 / 32307654 / +6.4% 0.69 / 0.74 / -6.7%
tpch_q19/duckdb:vortex-file-compressed 10890674 / 10960808 / -0.6% 22576570 / 22242267 / +1.5% 0.48 / 0.49 / -2.1%
tpch_q20/duckdb:vortex-file-compressed 14150085 / 14055431 / +0.7% 28517185 / 27575843 / +3.4% 0.50 / 0.51 / -2.6%
tpch_q21/duckdb:vortex-file-compressed 37194834 / 37067749 / +0.3% 54582058 / 53365845 / +2.3% 0.68 / 0.69 / -1.9%
tpch_q22/duckdb:vortex-file-compressed 18959541 / 19450003 / -2.5% 29652971 / 28860773 / +2.7% 0.64 / 0.67 / -5.1%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48314954 / 48410035 / -0.2% 55745949 / 55071749 / +1.2% 0.87 / 0.88 / -1.4%
tpch_q02/duckdb:parquet 48857388 / 48781979 / +0.2% 56425473 / 56043234 / +0.7% 0.87 / 0.87 / -0.5%
tpch_q03/duckdb:parquet 60592189 / 60662781 / -0.1% 70629800 / 69186536 / +2.1% 0.86 / 0.88 / -2.2%
tpch_q04/duckdb:parquet 35225308 / 35239214 / -0.0% 44320652 / 43406257 / +2.1% 0.79 / 0.81 / -2.1%
tpch_q05/duckdb:parquet 68041871 / 67700624 / +0.5% 77542141 / 77804512 / -0.3% 0.88 / 0.87 / +0.8%
tpch_q06/duckdb:parquet 22182267 / 22011727 / +0.8% 29148748 / 27603798 / +5.6% 0.76 / 0.80 / -4.6%
tpch_q07/duckdb:parquet 64313509 / 64701658 / -0.6% 74713520 / 74217264 / +0.7% 0.86 / 0.87 / -1.3%
tpch_q08/duckdb:parquet 76185520 / 76216540 / -0.0% 88349919 / 88074917 / +0.3% 0.86 / 0.87 / -0.4%
tpch_q09/duckdb:parquet 108115539 / 108283566 / -0.2% 121239253 / 119510800 / +1.4% 0.89 / 0.91 / -1.6%
tpch_q10/duckdb:parquet 106841000 / 106372475 / +0.4% 118745047 / 117762180 / +0.8% 0.90 / 0.90 / -0.4%
tpch_q11/duckdb:parquet 29867986 / 29907303 / -0.1% 35008346 / 35880865 / -2.4% 0.85 / 0.83 / +2.4%
tpch_q12/duckdb:parquet 38116122 / 38101489 / +0.0% 45453873 / 44510954 / +2.1% 0.84 / 0.86 / -2.0%
tpch_q13/duckdb:parquet 175593031 / 175329715 / +0.2% 182569449 / 184310429 / -0.9% 0.96 / 0.95 / +1.1%
tpch_q14/duckdb:parquet 43221956 / 42994604 / +0.5% 51552040 / 52269794 / -1.4% 0.84 / 0.82 / +1.9%
tpch_q15/duckdb:parquet 33022980 / 32902709 / +0.4% 42175905 / 42035646 / +0.3% 0.78 / 0.78 / +0.0%
tpch_q16/duckdb:parquet 47884217 / 47729273 / +0.3% 53618341 / 53845688 / -0.4% 0.89 / 0.89 / +0.8%
tpch_q17/duckdb:parquet 48429370 / 48190566 / +0.5% 58445069 / 57719092 / +1.3% 0.83 / 0.83 / -0.8%
tpch_q18/duckdb:parquet 74927583 / 74960831 / -0.0% 81287666 / 81207555 / +0.1% 0.92 / 0.92 / -0.1%
tpch_q19/duckdb:parquet 49284346 / 49850007 / -1.1% 64281378 / 57878632 / +11.1% 🔴 0.77 / 0.86 / -11.0%
tpch_q20/duckdb:parquet 63796798 / 63815176 / -0.0% 75112453 / 73777575 / +1.8% 0.85 / 0.86 / -1.8%
tpch_q21/duckdb:parquet 107675801 / 107087917 / +0.5% 116960796 / 117445960 / -0.4% 0.92 / 0.91 / +1.0%
tpch_q22/duckdb:parquet 51135338 / 51234071 / -0.2% 59619192 / 59339225 / +0.5% 0.86 / 0.86 / -0.7%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR c63d98dd vs base 891c01ab
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90159883 / 90421711 / -0.3% 143693196 / 141995850 / +1.2% 0.63 / 0.64 / -1.5%
tpch_q02/datafusion:vortex-file-compressed 67260068 / 67565558 / -0.5% 97829729 / 102115137 / -4.2% 0.69 / 0.66 / +3.9%
tpch_q03/datafusion:vortex-file-compressed 66448549 / 68440097 / -2.9% 114299971 / 122271488 / -6.5% 0.58 / 0.56 / +3.9%
tpch_q04/datafusion:vortex-file-compressed 34847953 / 35524846 / -1.9% 70204025 / 75006092 / -6.4% 0.50 / 0.47 / +4.8%
tpch_q05/datafusion:vortex-file-compressed 119275840 / 120274798 / -0.8% 174006111 / 176831698 / -1.6% 0.69 / 0.68 / +0.8%
tpch_q06/datafusion:vortex-file-compressed 11253912 / 11322639 / -0.6% 59976475 / 57602409 / +4.1% 0.19 / 0.20 / -4.5%
tpch_q07/datafusion:vortex-file-compressed 135780232 / 136487832 / -0.5% 189379047 / 191931606 / -1.3% 0.72 / 0.71 / +0.8%
tpch_q08/datafusion:vortex-file-compressed 145476797 / 145502958 / -0.0% 210606341 / 219290037 / -4.0% 0.69 / 0.66 / +4.1%
tpch_q09/datafusion:vortex-file-compressed 185562197 / 186216686 / -0.4% 246408790 / 260707454 / -5.5% 0.75 / 0.71 / +5.4%
tpch_q10/datafusion:vortex-file-compressed 73686583 / 74153528 / -0.6% 137105857 / 139115438 / -1.4% 0.54 / 0.53 / +0.8%
tpch_q11/datafusion:vortex-file-compressed 44574375 / 44983051 / -0.9% 70882936 / 69832693 / +1.5% 0.63 / 0.64 / -2.4%
tpch_q12/datafusion:vortex-file-compressed 37088422 / 37810196 / -1.9% 80155912 / 81617122 / -1.8% 0.46 / 0.46 / -0.1%
tpch_q13/datafusion:vortex-file-compressed 42247545 / 42599591 / -0.8% 83487715 / 82235682 / +1.5% 0.51 / 0.52 / -2.3%
tpch_q14/datafusion:vortex-file-compressed 22560622 / 23002058 / -1.9% 85373851 / 83526574 / +2.2% 0.26 / 0.28 / -4.0%
tpch_q15/datafusion:vortex-file-compressed 35138049 / 35046351 / +0.3% 90485552 / 90699552 / -0.2% 0.39 / 0.39 / +0.5%
tpch_q16/datafusion:vortex-file-compressed 39952661 / 39765561 / +0.5% 68544389 / 68874204 / -0.5% 0.58 / 0.58 / +1.0%
tpch_q17/datafusion:vortex-file-compressed 185956152 / 177083395 / +5.0% 222092252 / 226068532 / -1.8% 0.84 / 0.78 / +6.9%
tpch_q18/datafusion:vortex-file-compressed 209115519 / 207611854 / +0.7% 272364800 / 270342947 / +0.7% 0.77 / 0.77 / -0.0%
tpch_q19/datafusion:vortex-file-compressed 35569545 / 34957046 / +1.8% 89646360 / 87904686 / +2.0% 0.40 / 0.40 / -0.2%
tpch_q20/datafusion:vortex-file-compressed 63217099 / 64278020 / -1.7% 122884276 / 118379344 / +3.8% 0.51 / 0.54 / -5.3%
tpch_q21/datafusion:vortex-file-compressed 183502444 / 183023961 / +0.3% 241190429 / 242448463 / -0.5% 0.76 / 0.75 / +0.8%
tpch_q22/datafusion:vortex-file-compressed 27785634 / 27883932 / -0.4% 53743651 / 53536698 / +0.4% 0.52 / 0.52 / -0.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87730299 / 88494633 / -0.9% 132105570 / 126967843 / +4.0% 0.66 / 0.70 / -4.7%
tpch_q02/datafusion:parquet 174955143 / 174703212 / +0.1% 204479204 / 199572701 / +2.5% 0.86 / 0.88 / -2.3%
tpch_q03/datafusion:parquet 138318345 / 138491651 / -0.1% 190152773 / 182443295 / +4.2% 0.73 / 0.76 / -4.2%
tpch_q04/datafusion:parquet 58864090 / 58638802 / +0.4% 97051754 / 92257905 / +5.2% 0.61 / 0.64 / -4.6%
tpch_q05/datafusion:parquet 170623972 / 169716343 / +0.5% 234176086 / 226128944 / +3.6% 0.73 / 0.75 / -2.9%
tpch_q06/datafusion:parquet 37474917 / 37146953 / +0.9% 79042947 / 74767826 / +5.7% 0.47 / 0.50 / -4.6%
tpch_q07/datafusion:parquet 217457420 / 218589370 / -0.5% 282960874 / 276920926 / +2.2% 0.77 / 0.79 / -2.6%
tpch_q08/datafusion:parquet 222229322 / 221103631 / +0.5% 303994963 / 285288401 / +6.6% 0.73 / 0.78 / -5.7%
tpch_q09/datafusion:parquet 314027648 / 314360848 / -0.1% 384696015 / 386255662 / -0.4% 0.82 / 0.81 / +0.3%
tpch_q10/datafusion:parquet 321953749 / 320847174 / +0.3% 386143238 / 387546024 / -0.4% 0.83 / 0.83 / +0.7%
tpch_q11/datafusion:parquet 126790302 / 125545638 / +1.0% 151673922 / 149739191 / +1.3% 0.84 / 0.84 / -0.3%
tpch_q12/datafusion:parquet 84232256 / 84391724 / -0.2% 122156982 / 122337849 / -0.1% 0.69 / 0.69 / -0.0%
tpch_q13/datafusion:parquet 216202045 / 216471698 / -0.1% 249572498 / 247590876 / +0.8% 0.87 / 0.87 / -0.9%
tpch_q14/datafusion:parquet 88141323 / 89038718 / -1.0% 200354395 / 181579037 / +10.3% 🔴 0.44 / 0.49 / -10.3%
tpch_q15/datafusion:parquet 106511869 / 105596593 / +0.9% 159303164 / 154616969 / +3.0% 0.67 / 0.68 / -2.1%
tpch_q16/datafusion:parquet 96692682 / 96843178 / -0.2% 120199494 / 122207496 / -1.6% 0.80 / 0.79 / +1.5%
tpch_q17/datafusion:parquet 214500918 / 213166447 / +0.6% 265297930 / 261077577 / +1.6% 0.81 / 0.82 / -1.0%
tpch_q18/datafusion:parquet 270504703 / 271036032 / -0.2% 315652034 / 323402297 / -2.4% 0.86 / 0.84 / +2.3%
tpch_q19/datafusion:parquet 108236711 / 108642656 / -0.4% 169338443 / 169584977 / -0.1% 0.64 / 0.64 / -0.2%
tpch_q20/datafusion:parquet 188919568 / 189279979 / -0.2% 251698380 / 248412590 / +1.3% 0.75 / 0.76 / -1.5%
tpch_q21/datafusion:parquet 247865262 / 247710338 / +0.1% 310035489 / 315286021 / -1.7% 0.80 / 0.79 / +1.8%
tpch_q22/datafusion:parquet 153739812 / 154424737 / -0.4% 179537779 / 179636660 / -0.1% 0.86 / 0.86 / -0.4%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32906038 / 33349857 / -1.3% 70905345 / 69341547 / +2.3% 0.46 / 0.48 / -3.5%
tpch_q02/duckdb:vortex-file-compressed 31283317 / 31869777 / -1.8% 47750893 / 45941299 / +3.9% 0.66 / 0.69 / -5.6%
tpch_q03/duckdb:vortex-file-compressed 52627368 / 52434187 / +0.4% 100710176 / 100430404 / +0.3% 0.52 / 0.52 / +0.1%
tpch_q04/duckdb:vortex-file-compressed 51044670 / 50674538 / +0.7% 86300178 / 88112285 / -2.1% 0.59 / 0.58 / +2.8%
tpch_q05/duckdb:vortex-file-compressed 68802091 / 68608520 / +0.3% 106593811 / 109044750 / -2.2% 0.65 / 0.63 / +2.6%
tpch_q06/duckdb:vortex-file-compressed 14306436 / 14693436 / -2.6% 53316286 / 51561054 / +3.4% 0.27 / 0.28 / -5.8%
tpch_q07/duckdb:vortex-file-compressed 54562814 / 53921645 / +1.2% 109140993 / 111571063 / -2.2% 0.50 / 0.48 / +3.4%
tpch_q08/duckdb:vortex-file-compressed 87339357 / 87340367 / -0.0% 132941593 / 133928383 / -0.7% 0.66 / 0.65 / +0.7%
tpch_q09/duckdb:vortex-file-compressed 97980000 / 97251243 / +0.7% 156521952 / 158394360 / -1.2% 0.63 / 0.61 / +2.0%
tpch_q10/duckdb:vortex-file-compressed 87777063 / 87844198 / -0.1% 140585574 / 139959942 / +0.4% 0.62 / 0.63 / -0.5%
tpch_q11/duckdb:vortex-file-compressed 13131989 / 13021081 / +0.9% 26137265 / 26600501 / -1.7% 0.50 / 0.49 / +2.6%
tpch_q12/duckdb:vortex-file-compressed 43079616 / 43433008 / -0.8% 82541508 / 83774672 / -1.5% 0.52 / 0.52 / +0.7%
tpch_q13/duckdb:vortex-file-compressed 66898553 / 67518710 / -0.9% 87311297 / 87769468 / -0.5% 0.77 / 0.77 / -0.4%
tpch_q14/duckdb:vortex-file-compressed 28044092 / 28238602 / -0.7% 71316759 / 72995541 / -2.3% 0.39 / 0.39 / +1.6%
tpch_q15/duckdb:vortex-file-compressed 24482447 / 24504700 / -0.1% 64258431 / 65021988 / -1.2% 0.38 / 0.38 / +1.1%
tpch_q16/duckdb:vortex-file-compressed 49756510 / 49228946 / +1.1% 57762980 / 58244066 / -0.8% 0.86 / 0.85 / +1.9%
tpch_q17/duckdb:vortex-file-compressed 34216079 / 34434502 / -0.6% 65011430 / 64234766 / +1.2% 0.53 / 0.54 / -1.8%
tpch_q18/duckdb:vortex-file-compressed 95628794 / 99599129 / -4.0% 118570261 / 119418694 / -0.7% 0.81 / 0.83 / -3.3%
tpch_q19/duckdb:vortex-file-compressed 25443182 / 25391922 / +0.2% 75094384 / 71989316 / +4.3% 0.34 / 0.35 / -3.9%
tpch_q20/duckdb:vortex-file-compressed 38911736 / 39069466 / -0.4% 90081356 / 88580862 / +1.7% 0.43 / 0.44 / -2.1%
tpch_q21/duckdb:vortex-file-compressed 94061011 / 94943370 / -0.9% 144610584 / 146034384 / -1.0% 0.65 / 0.65 / +0.0%
tpch_q22/duckdb:vortex-file-compressed 35293072 / 35603270 / -0.9% 51340119 / 52346151 / -1.9% 0.69 / 0.68 / +1.1%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68288028 / 68529089 / -0.4% 90659098 / 91721872 / -1.2% 0.75 / 0.75 / +0.8%
tpch_q02/duckdb:parquet 87539336 / 87980890 / -0.5% 99064432 / 100126172 / -1.1% 0.88 / 0.88 / +0.6%
tpch_q03/duckdb:parquet 111390767 / 111392580 / -0.0% 141375013 / 145840878 / -3.1% 0.79 / 0.76 / +3.2%
tpch_q04/duckdb:parquet 76452771 / 76780616 / -0.4% 97225165 / 102028744 / -4.7% 0.79 / 0.75 / +4.5%
tpch_q05/duckdb:parquet 126078534 / 124594550 / +1.2% 156096292 / 159040491 / -1.9% 0.81 / 0.78 / +3.1%
tpch_q06/duckdb:parquet 36089920 / 36525834 / -1.2% 61398432 / 63078816 / -2.7% 0.59 / 0.58 / +1.5%
tpch_q07/duckdb:parquet 118233162 / 118598815 / -0.3% 155701949 / 155755842 / -0.0% 0.76 / 0.76 / -0.3%
tpch_q08/duckdb:parquet 149351795 / 147958180 / +0.9% 197646413 / 190748168 / +3.6% 0.76 / 0.78 / -2.6%
tpch_q09/duckdb:parquet 239270716 / 237683966 / +0.7% 280941758 / 281635671 / -0.2% 0.85 / 0.84 / +0.9%
tpch_q10/duckdb:parquet 317978794 / 316828815 / +0.4% 339621062 / 342561582 / -0.9% 0.94 / 0.92 / +1.2%
tpch_q11/duckdb:parquet 43789659 / 43893063 / -0.2% 51815044 / 52189936 / -0.7% 0.85 / 0.84 / +0.5%
tpch_q12/duckdb:parquet 72648680 / 72208829 / +0.6% 93870440 / 93875174 / -0.0% 0.77 / 0.77 / +0.6%
tpch_q13/duckdb:parquet 292424674 / 295219035 / -0.9% 307225526 / 307736255 / -0.2% 0.95 / 0.96 / -0.8%
tpch_q14/duckdb:parquet 102798860 / 101585729 / +1.2% 144930630 / 142851362 / +1.5% 0.71 / 0.71 / -0.3%
tpch_q15/duckdb:parquet 57902284 / 57919937 / -0.0% 87199750 / 87162905 / +0.0% 0.66 / 0.66 / -0.1%
tpch_q16/duckdb:parquet 101141098 / 102552148 / -1.4% 109600793 / 109107827 / +0.5% 0.92 / 0.94 / -1.8%
tpch_q17/duckdb:parquet 82834513 / 83029054 / -0.2% 117771062 / 120991902 / -2.7% 0.70 / 0.69 / +2.5%
tpch_q18/duckdb:parquet 155954292 / 156594219 / -0.4% 171692201 / 176632529 / -2.8% 0.91 / 0.89 / +2.5%
tpch_q19/duckdb:parquet 100062979 / 98663556 / +1.4% 135734354 / 135244224 / +0.4% 0.74 / 0.73 / +1.1%
tpch_q20/duckdb:parquet 147579391 / 148052589 / -0.3% 184352077 / 187620677 / -1.7% 0.80 / 0.79 / +1.4%
tpch_q21/duckdb:parquet 257880384 / 251050714 / +2.7% 278163611 / 279389394 / -0.4% 0.93 / 0.90 / +3.2%
tpch_q22/duckdb:parquet 169151049 / 168588942 / +0.3% 183666984 / 185737392 / -1.1% 0.92 / 0.91 / +1.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR c63d98dd vs base 1a09eb47
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.973x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.983x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1230828 / 1228664 / +0.2% 22426024 / 23731277 / -5.5% 0.05 / 0.05 / +6.0%
clickbench_q01/datafusion:vortex-file-compressed 6244720 / 6016398 / +3.8% 33361899 / 34483199 / -3.3% 0.19 / 0.17 / +7.3%
clickbench_q02/datafusion:vortex-file-compressed 9223279 / 9316014 / -1.0% 38920351 / 39991923 / -2.7% 0.24 / 0.23 / +1.7%
clickbench_q03/datafusion:vortex-file-compressed 10783772 / 10815896 / -0.3% 51568997 / 54809223 / -5.9% 0.21 / 0.20 / +6.0%
clickbench_q04/datafusion:vortex-file-compressed 55522654 / 55608200 / -0.2% 91196755 / 92853745 / -1.8% 0.61 / 0.60 / +1.7%
clickbench_q05/datafusion:vortex-file-compressed 75462997 / 74309416 / +1.6% 114801349 / 123935220 / -7.4% 0.66 / 0.60 / +9.6%
clickbench_q06/datafusion:vortex-file-compressed 1236488 / 1223920 / +1.0% 22012680 / 22501544 / -2.2% 0.06 / 0.05 / +3.3%
clickbench_q07/datafusion:vortex-file-compressed 9260176 / 9057444 / +2.2% 34421779 / 33108001 / +4.0% 0.27 / 0.27 / -1.7%
clickbench_q08/datafusion:vortex-file-compressed 73552647 / 74666107 / -1.5% 119663241 / 118027686 / +1.4% 0.61 / 0.63 / -2.8%
clickbench_q09/datafusion:vortex-file-compressed 169153338 / 169668172 / -0.3% 201216339 / 203539821 / -1.1% 0.84 / 0.83 / +0.8%
clickbench_q10/datafusion:vortex-file-compressed 22628228 / 22615369 / +0.1% 66400144 / 66697414 / -0.4% 0.34 / 0.34 / +0.5%
clickbench_q11/datafusion:vortex-file-compressed 23641752 / 25814752 / -8.4% 63979675 / 71413963 / -10.4% 🟢 0.37 / 0.36 / +2.2%
clickbench_q12/datafusion:vortex-file-compressed 72163224 / 71205264 / +1.3% 116204295 / 120616664 / -3.7% 0.62 / 0.59 / +5.2%
clickbench_q13/datafusion:vortex-file-compressed 116963994 / 115991059 / +0.8% 173248898 / 183879391 / -5.8% 0.68 / 0.63 / +7.0%
clickbench_q14/datafusion:vortex-file-compressed 73807222 / 72829676 / +1.3% 121336958 / 118277860 / +2.6% 0.61 / 0.62 / -1.2%
clickbench_q15/datafusion:vortex-file-compressed 60434840 / 61715887 / -2.1% 97476685 / 94784023 / +2.8% 0.62 / 0.65 / -4.8%
clickbench_q16/datafusion:vortex-file-compressed 149322180 / 151860078 / -1.7% 202988984 / 204069693 / -0.5% 0.74 / 0.74 / -1.1%
clickbench_q17/datafusion:vortex-file-compressed 149061710 / 148936248 / +0.1% 210420121 / 210991513 / -0.3% 0.71 / 0.71 / +0.4%
clickbench_q18/datafusion:vortex-file-compressed 286281376 / 297923920 / -3.9% 374681163 / 363682079 / +3.0% 0.76 / 0.82 / -6.7%
clickbench_q19/datafusion:vortex-file-compressed 7629831 / 7613093 / +0.2% 48139851 / 51915177 / -7.3% 0.16 / 0.15 / +8.1%
clickbench_q20/datafusion:vortex-file-compressed 60047684 / 62076536 / -3.3% 224662919 / 229793699 / -2.2% 0.27 / 0.27 / -1.1%
clickbench_q21/datafusion:vortex-file-compressed 88783134 / 88506848 / +0.3% 267636153 / 270673099 / -1.1% 0.33 / 0.33 / +1.5%
clickbench_q22/datafusion:vortex-file-compressed 98955682 / 98329696 / +0.6% 341568370 / 340168513 / +0.4% 0.29 / 0.29 / +0.2%
clickbench_q23/datafusion:vortex-file-compressed 206768898 / 192389294 / +7.5% 467233392 / 446514194 / +4.6% 0.44 / 0.43 / +2.7%
clickbench_q24/datafusion:vortex-file-compressed 15320458 / 15376266 / -0.4% 62688022 / 66704258 / -6.0% 0.24 / 0.23 / +6.0%
clickbench_q25/datafusion:vortex-file-compressed 16910732 / 17721111 / -4.6% 55812173 / 60550851 / -7.8% 0.30 / 0.29 / +3.5%
clickbench_q26/datafusion:vortex-file-compressed 15568684 / 15803189 / -1.5% 64770089 / 64623875 / +0.2% 0.24 / 0.24 / -1.7%
clickbench_q27/datafusion:vortex-file-compressed 95392103 / 94502678 / +0.9% 241465494 / 240680511 / +0.3% 0.40 / 0.39 / +0.6%
clickbench_q28/datafusion:vortex-file-compressed 561277501 / 555588316 / +1.0% 601143374 / 624026839 / -3.7% 0.93 / 0.89 / +4.9%
clickbench_q29/datafusion:vortex-file-compressed 22770676 / 22796956 / -0.1% 48708238 / 51660322 / -5.7% 0.47 / 0.44 / +5.9%
clickbench_q30/datafusion:vortex-file-compressed 56960089 / 56885478 / +0.1% 101455330 / 106336821 / -4.6% 0.56 / 0.53 / +4.9%
clickbench_q31/datafusion:vortex-file-compressed 66199318 / 68522462 / -3.4% 149462276 / 153646968 / -2.7% 0.44 / 0.45 / -0.7%
clickbench_q32/datafusion:vortex-file-compressed 284034932 / 287062428 / -1.1% 377149125 / 393996204 / -4.3% 0.75 / 0.73 / +3.4%
clickbench_q33/datafusion:vortex-file-compressed 316390274 / 315990598 / +0.1% 412593144 / 426204986 / -3.2% 0.77 / 0.74 / +3.4%
clickbench_q34/datafusion:vortex-file-compressed 316139408 / 319502770 / -1.1% 418172645 / 434934201 / -3.9% 0.76 / 0.73 / +2.9%
clickbench_q35/datafusion:vortex-file-compressed 55504008 / 55067984 / +0.8% 91975307 / 89955494 / +2.2% 0.60 / 0.61 / -1.4%
clickbench_q36/datafusion:vortex-file-compressed 37436700 / 37109710 / +0.9% 67175391 / 66105271 / +1.6% 0.56 / 0.56 / -0.7%
clickbench_q37/datafusion:vortex-file-compressed 21467282 / 21734336 / -1.2% 49298128 / 48101649 / +2.5% 0.44 / 0.45 / -3.6%
clickbench_q38/datafusion:vortex-file-compressed 11288174 / 11842406 / -4.7% 38383834 / 40434372 / -5.1% 0.29 / 0.29 / +0.4%
clickbench_q39/datafusion:vortex-file-compressed 77519375 / 78492932 / -1.2% 109148342 / 110249620 / -1.0% 0.71 / 0.71 / -0.2%
clickbench_q40/datafusion:vortex-file-compressed 11151206 / 11269014 / -1.0% 37522392 / 37678898 / -0.4% 0.30 / 0.30 / -0.6%
clickbench_q41/datafusion:vortex-file-compressed 10447232 / 10714150 / -2.5% 35707220 / 37788079 / -5.5% 0.29 / 0.28 / +3.2%
clickbench_q42/datafusion:vortex-file-compressed 11161642 / 10885243 / +2.5% 36681770 / 38008923 / -3.5% 0.30 / 0.29 / +6.2%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1270176 / 1249202 / +1.7% 49754858 / 50456145 / -1.4% 0.03 / 0.02 / +3.1%
clickbench_q01/datafusion:parquet 15962328 / 16195310 / -1.4% 72743108 / 73718256 / -1.3% 0.22 / 0.22 / -0.1%
clickbench_q02/datafusion:parquet 18503370 / 18427166 / +0.4% 79640712 / 82979537 / -4.0% 0.23 / 0.22 / +4.6%
clickbench_q03/datafusion:parquet 16608300 / 16867754 / -1.5% 78628787 / 83530195 / -5.9% 0.21 / 0.20 / +4.6%
clickbench_q04/datafusion:parquet 63038120 / 63702133 / -1.0% 125314931 / 129486076 / -3.2% 0.50 / 0.49 / +2.3%
clickbench_q05/datafusion:parquet 89008138 / 87643623 / +1.6% 153826324 / 159867119 / -3.8% 0.58 / 0.55 / +5.5%
clickbench_q06/datafusion:parquet 1293232 / 1248620 / +3.6% 48327451 / 51057927 / -5.3% 0.03 / 0.02 / +9.4%
clickbench_q07/datafusion:parquet 16785975 / 16747051 / +0.2% 67404332 / 68079911 / -1.0% 0.25 / 0.25 / +1.2%
clickbench_q08/datafusion:parquet 86749608 / 87148892 / -0.5% 157437297 / 162824579 / -3.3% 0.55 / 0.54 / +2.9%
clickbench_q09/datafusion:parquet 188144908 / 193801861 / -2.9% 270942272 / 270149797 / +0.3% 0.69 / 0.72 / -3.2%
clickbench_q10/datafusion:parquet 36801510 / 35798764 / +2.8% 98722495 / 103252759 / -4.4% 0.37 / 0.35 / +7.5%
clickbench_q11/datafusion:parquet 42304888 / 43382002 / -2.5% 109992663 / 112812480 / -2.5% 0.38 / 0.38 / +0.0%
clickbench_q12/datafusion:parquet 95080040 / 96318191 / -1.3% 159980632 / 164770450 / -2.9% 0.59 / 0.58 / +1.7%
clickbench_q13/datafusion:parquet 146836079 / 146523478 / +0.2% 226129012 / 229686776 / -1.5% 0.65 / 0.64 / +1.8%
clickbench_q14/datafusion:parquet 100914454 / 101766128 / -0.8% 169035374 / 174383649 / -3.1% 0.60 / 0.58 / +2.3%
clickbench_q15/datafusion:parquet 72294273 / 70696354 / +2.3% 130155237 / 132180817 / -1.5% 0.56 / 0.53 / +3.9%
clickbench_q16/datafusion:parquet 156277738 / 156839602 / -0.4% 232644932 / 235164573 / -1.1% 0.67 / 0.67 / +0.7%
clickbench_q17/datafusion:parquet 155315028 / 156222023 / -0.6% 234060498 / 240467417 / -2.7% 0.66 / 0.65 / +2.1%
clickbench_q18/datafusion:parquet 310631792 / 311391208 / -0.2% 416356081 / 425277568 / -2.1% 0.75 / 0.73 / +1.9%
clickbench_q19/datafusion:parquet 19121638 / 18934701 / +1.0% 75860269 / 79969906 / -5.1% 0.25 / 0.24 / +6.5%
clickbench_q20/datafusion:parquet 177473098 / 179696156 / -1.2% 278066894 / 294316193 / -5.5% 0.64 / 0.61 / +4.5%
clickbench_q21/datafusion:parquet 172912846 / 172755354 / +0.1% 288653829 / 316138352 / -8.7% 0.60 / 0.55 / +9.6%
clickbench_q22/datafusion:parquet 257655672 / 259841256 / -0.8% 410228384 / 452237684 / -9.3% 0.63 / 0.57 / +9.3%
clickbench_q23/datafusion:parquet 1008512457 / 1018066184 / -0.9% 1182958146 / 1200937875 / -1.5% 0.85 / 0.85 / +0.6%
clickbench_q24/datafusion:parquet 29730154 / 30595338 / -2.8% 85385766 / 92080083 / -7.3% 0.35 / 0.33 / +4.8%
clickbench_q25/datafusion:parquet 36472027 / 37147926 / -1.8% 99272844 / 105391983 / -5.8% 0.37 / 0.35 / +4.2%
clickbench_q26/datafusion:parquet 30529916 / 31191532 / -2.1% 85737235 / 91289950 / -6.1% 0.36 / 0.34 / +4.2%
clickbench_q27/datafusion:parquet 192199915 / 192665152 / -0.2% 280089440 / 309418158 / -9.5% 0.69 / 0.62 / +10.2%
clickbench_q28/datafusion:parquet 617270574 / 618162741 / -0.1% 697491553 / 712505644 / -2.1% 0.88 / 0.87 / +2.0%
clickbench_q29/datafusion:parquet 29221105 / 29850318 / -2.1% 89467858 / 91298591 / -2.0% 0.33 / 0.33 / -0.1%
clickbench_q30/datafusion:parquet 89560472 / 90009854 / -0.5% 164126637 / 175438630 / -6.4% 0.55 / 0.51 / +6.4%
clickbench_q31/datafusion:parquet 102096273 / 103174295 / -1.0% 188497849 / 198229842 / -4.9% 0.54 / 0.52 / +4.1%
clickbench_q32/datafusion:parquet 308536748 / 308297550 / +0.1% 433452809 / 432084786 / +0.3% 0.71 / 0.71 / -0.2%
clickbench_q33/datafusion:parquet 377554324 / 378721808 / -0.3% 469241146 / 475656908 / -1.3% 0.80 / 0.80 / +1.1%
clickbench_q34/datafusion:parquet 375783388 / 381166178 / -1.4% 470856326 / 481139721 / -2.1% 0.80 / 0.79 / +0.7%
clickbench_q35/datafusion:parquet 64773768 / 64272653 / +0.8% 121717593 / 121585924 / +0.1% 0.53 / 0.53 / +0.7%
clickbench_q36/datafusion:parquet 73460588 / 73406078 / +0.1% 134001982 / 135645015 / -1.2% 0.55 / 0.54 / +1.3%
clickbench_q37/datafusion:parquet 35357645 / 35133739 / +0.6% 91255211 / 92466028 / -1.3% 0.39 / 0.38 / +2.0%
clickbench_q38/datafusion:parquet 47578072 / 47743090 / -0.3% 105695528 / 108405172 / -2.5% 0.45 / 0.44 / +2.2%
clickbench_q39/datafusion:parquet 143175966 / 143440383 / -0.2% 206013051 / 212175169 / -2.9% 0.69 / 0.68 / +2.8%
clickbench_q40/datafusion:parquet 19985855 / 20136116 / -0.7% 77054252 / 77811673 / -1.0% 0.26 / 0.26 / +0.2%
clickbench_q41/datafusion:parquet 18862901 / 18853009 / +0.1% 76054382 / 75162817 / +1.2% 0.25 / 0.25 / -1.1%
clickbench_q42/datafusion:parquet 19117356 / 19393592 / -1.4% 74921895 / 74923896 / -0.0% 0.26 / 0.26 / -1.4%
duckdb / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2163709 / 2285622 / -5.3% 24152634 / 25260207 / -4.4% 0.09 / 0.09 / -1.0%
clickbench_q01/duckdb:vortex-file-compressed 7283239 / 7018185 / +3.8% 26630118 / 23729549 / +12.2% 🔴 0.27 / 0.30 / -7.5%
clickbench_q02/duckdb:vortex-file-compressed 8188030 / 8173411 / +0.2% 32423623 / 33651886 / -3.6% 0.25 / 0.24 / +4.0%
clickbench_q03/duckdb:vortex-file-compressed 14156172 / 14459762 / -2.1% 51845982 / 57659469 / -10.1% 🟢 0.27 / 0.25 / +8.9%
clickbench_q04/duckdb:vortex-file-compressed 55687623 / 55714137 / -0.0% 89139105 / 97497788 / -8.6% 0.62 / 0.57 / +9.3%
clickbench_q05/duckdb:vortex-file-compressed 61840368 / 64064264 / -3.5% 93330740 / 98691070 / -5.4% 0.66 / 0.65 / +2.1%
clickbench_q06/duckdb:vortex-file-compressed 2755090 / 2615036 / +5.4% 29836418 / 29122247 / +2.5% 0.09 / 0.09 / +2.8%
clickbench_q07/duckdb:vortex-file-compressed 8459324 / 8340587 / +1.4% 28891167 / 28059203 / +3.0% 0.29 / 0.30 / -1.5%
clickbench_q08/duckdb:vortex-file-compressed 66975466 / 68296110 / -1.9% 103679565 / 109581431 / -5.4% 0.65 / 0.62 / +3.6%
clickbench_q09/duckdb:vortex-file-compressed 87903912 / 89155191 / -1.4% 124870579 / 130583987 / -4.4% 0.70 / 0.68 / +3.1%
clickbench_q10/duckdb:vortex-file-compressed 26183522 / 26379933 / -0.7% 63600292 / 70515237 / -9.8% 0.41 / 0.37 / +10.0%
clickbench_q11/duckdb:vortex-file-compressed 28390088 / 28829497 / -1.5% 66550383 / 73690820 / -9.7% 0.43 / 0.39 / +9.0%
clickbench_q12/duckdb:vortex-file-compressed 68555180 / 70223096 / -2.4% 98914427 / 100795428 / -1.9% 0.69 / 0.70 / -0.5%
clickbench_q13/duckdb:vortex-file-compressed 120853159 / 126062005 / -4.1% 156789361 / 167428823 / -6.4% 0.77 / 0.75 / +2.4%
clickbench_q14/duckdb:vortex-file-compressed 73185202 / 74558932 / -1.8% 101642771 / 105410080 / -3.6% 0.72 / 0.71 / +1.8%
clickbench_q15/duckdb:vortex-file-compressed 75070060 / 75154938 / -0.1% 112925918 / 116124504 / -2.8% 0.66 / 0.65 / +2.7%
clickbench_q16/duckdb:vortex-file-compressed 135579334 / 137120562 / -1.1% 176388221 / 185619926 / -5.0% 0.77 / 0.74 / +4.1%
clickbench_q17/duckdb:vortex-file-compressed 137080540 / 140043072 / -2.1% 170670687 / 177821106 / -4.0% 0.80 / 0.79 / +2.0%
clickbench_q18/duckdb:vortex-file-compressed 258527610 / 255751345 / +1.1% 312538576 / 321282957 / -2.7% 0.83 / 0.80 / +3.9%
clickbench_q19/duckdb:vortex-file-compressed 9362176 / 9465895 / -1.1% 40557933 / 43185843 / -6.1% 0.23 / 0.22 / +5.3%
clickbench_q20/duckdb:vortex-file-compressed 65681450 / 65402050 / +0.4% 163645522 / 166778381 / -1.9% 0.40 / 0.39 / +2.3%
clickbench_q21/duckdb:vortex-file-compressed 95031329 / 97684753 / -2.7% 257841437 / 264249930 / -2.4% 0.37 / 0.37 / -0.3%
clickbench_q22/duckdb:vortex-file-compressed 170693434 / 171088330 / -0.2% 374343051 / 423299779 / -11.6% 🟢 0.46 / 0.40 / +12.8%
clickbench_q23/duckdb:vortex-file-compressed 34016146 / 34964009 / -2.7% 83113941 / 83776922 / -0.8% 0.41 / 0.42 / -1.9%
clickbench_q24/duckdb:vortex-file-compressed 14011370 / 13965362 / +0.3% 34726674 / 33410134 / +3.9% 0.40 / 0.42 / -3.5%
clickbench_q25/duckdb:vortex-file-compressed 18569659 / 18669545 / -0.5% 45468870 / 51725408 / -12.1% 🟢 0.41 / 0.36 / +13.2%
clickbench_q26/duckdb:vortex-file-compressed 11139242 / 11437942 / -2.6% 33263698 / 35041663 / -5.1% 0.33 / 0.33 / +2.6%
clickbench_q27/duckdb:vortex-file-compressed 52987868 / 53004105 / -0.0% 214837634 / 217821108 / -1.4% 0.25 / 0.24 / +1.4%
clickbench_q28/duckdb:vortex-file-compressed 508245762 / 510881792 / -0.5% 571015677 / 582763353 / -2.0% 0.89 / 0.88 / +1.5%
clickbench_q29/duckdb:vortex-file-compressed 16485299 / 16878068 / -2.3% 44172232 / 45453431 / -2.8% 0.37 / 0.37 / +0.5%
clickbench_q30/duckdb:vortex-file-compressed 58979782 / 60872623 / -3.1% 101990956 / 112519916 / -9.4% 0.58 / 0.54 / +6.9%
clickbench_q31/duckdb:vortex-file-compressed 108212144 / 109035806 / -0.8% 182519416 / 174080813 / +4.8% 0.59 / 0.63 / -5.3%
clickbench_q32/duckdb:vortex-file-compressed 373621446 / 376281378 / -0.7% 407537881 / 410848680 / -0.8% 0.92 / 0.92 / +0.1%
clickbench_q33/duckdb:vortex-file-compressed 343262043 / 348363634 / -1.5% 428451843 / 446182624 / -4.0% 0.80 / 0.78 / +2.6%
clickbench_q34/duckdb:vortex-file-compressed 357847932 / 355181630 / +0.8% 445259865 / 457974068 / -2.8% 0.80 / 0.78 / +3.6%
clickbench_q35/duckdb:vortex-file-compressed 55652858 / 56433150 / -1.4% 87960244 / 89762210 / -2.0% 0.63 / 0.63 / +0.6%
clickbench_q36/duckdb:vortex-file-compressed 11143679 / 11126610 / +0.2% 31161853 / 30253525 / +3.0% 0.36 / 0.37 / -2.8%
clickbench_q37/duckdb:vortex-file-compressed 7555130 / 7556512 / -0.0% 29125828 / 28281503 / +3.0% 0.26 / 0.27 / -2.9%
clickbench_q38/duckdb:vortex-file-compressed 8298378 / 8802320 / -5.7% 27310949 / 29113944 / -6.2% 0.30 / 0.30 / +0.5%
clickbench_q39/duckdb:vortex-file-compressed 19175990 / 18826240 / +1.9% 36811344 / 38026199 / -3.2% 0.52 / 0.50 / +5.2%
clickbench_q40/duckdb:vortex-file-compressed 6761374 / 6707240 / +0.8% 28899445 / 28795435 / +0.4% 0.23 / 0.23 / +0.4%
clickbench_q41/duckdb:vortex-file-compressed 7583016 / 7723084 / -1.8% 29310347 / 29042176 / +0.9% 0.26 / 0.27 / -2.7%
clickbench_q42/duckdb:vortex-file-compressed 6939818 / 7030410 / -1.3% 28905422 / 29080862 / -0.6% 0.24 / 0.24 / -0.7%
duckdb / parquet / ns (0.994x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 10584256 / 11190461 / -5.4% 18617784 / 18350891 / +1.5% 0.57 / 0.61 / -6.8%
clickbench_q01/duckdb:parquet 17256944 / 17119682 / +0.8% 24320632 / 24257710 / +0.3% 0.71 / 0.71 / +0.5%
clickbench_q02/duckdb:parquet 24353115 / 23831872 / +2.2% 34596186 / 35553977 / -2.7% 0.70 / 0.67 / +5.0%
clickbench_q03/duckdb:parquet 24395734 / 24393363 / +0.0% 41602740 / 38781511 / +7.3% 0.59 / 0.63 / -6.8%
clickbench_q04/duckdb:parquet 61149394 / 63309198 / -3.4% 77176334 / 76340155 / +1.1% 0.79 / 0.83 / -4.5%
clickbench_q05/duckdb:parquet 83287670 / 85985638 / -3.1% 99038278 / 102182883 / -3.1% 0.84 / 0.84 / -0.1%
clickbench_q06/duckdb:parquet 21690270 / 22084972 / -1.8% 31590156 / 32908601 / -4.0% 0.69 / 0.67 / +2.3%
clickbench_q07/duckdb:parquet 19055074 / 19778312 / -3.7% 26742044 / 26602235 / +0.5% 0.71 / 0.74 / -4.2%
clickbench_q08/duckdb:parquet 76415089 / 78360708 / -2.5% 90424348 / 91898047 / -1.6% 0.85 / 0.85 / -0.9%
clickbench_q09/duckdb:parquet 103276850 / 104776970 / -1.4% 127348597 / 123495533 / +3.1% 0.81 / 0.85 / -4.4%
clickbench_q10/duckdb:parquet 42318280 / 42553512 / -0.6% 57607764 / 59802514 / -3.7% 0.73 / 0.71 / +3.2%
clickbench_q11/duckdb:parquet 46399168 / 46698225 / -0.6% 63521570 / 68804404 / -7.7% 0.73 / 0.68 / +7.6%
clickbench_q12/duckdb:parquet 92950767 / 93031656 / -0.1% 111811554 / 113078145 / -1.1% 0.83 / 0.82 / +1.0%
clickbench_q13/duckdb:parquet 151182635 / 154009948 / -1.8% 175485256 / 175940692 / -0.3% 0.86 / 0.88 / -1.6%
clickbench_q14/duckdb:parquet 101391394 / 103116775 / -1.7% 127791602 / 124049732 / +3.0% 0.79 / 0.83 / -4.6%
clickbench_q15/duckdb:parquet 86992720 / 89271184 / -2.6% 103998506 / 105185256 / -1.1% 0.84 / 0.85 / -1.4%
clickbench_q16/duckdb:parquet 178620446 / 179191667 / -0.3% 186061069 / 184501568 / +0.8% 0.96 / 0.97 / -1.2%
clickbench_q17/duckdb:parquet 173929248 / 177238850 / -1.9% 189736103 / 189673087 / +0.0% 0.92 / 0.93 / -1.9%
clickbench_q18/duckdb:parquet 307469516 / 310237449 / -0.9% 331223085 / 337581803 / -1.9% 0.93 / 0.92 / +1.0%
clickbench_q19/duckdb:parquet 21568082 / 21631884 / -0.3% 30746685 / 31019213 / -0.9% 0.70 / 0.70 / +0.6%
clickbench_q20/duckdb:parquet 180582140 / 185005536 / -2.4% 228558632 / 219582869 / +4.1% 0.79 / 0.84 / -6.2%
clickbench_q21/duckdb:parquet 217927342 / 231495012 / -5.9% 270229303 / 274101274 / -1.4% 0.81 / 0.84 / -4.5%
clickbench_q22/duckdb:parquet 320652096 / 316874234 / +1.2% 369790800 / 368456119 / +0.4% 0.87 / 0.86 / +0.8%
clickbench_q23/duckdb:parquet 167434974 / 167519099 / -0.1% 240953723 / 226748081 / +6.3% 0.69 / 0.74 / -5.9%
clickbench_q24/duckdb:parquet 32990372 / 32909088 / +0.2% 44052628 / 36186204 / +21.7% 🔴 0.75 / 0.91 / -17.7%
clickbench_q25/duckdb:parquet 43500732 / 44299739 / -1.8% 61571765 / 61360089 / +0.3% 0.71 / 0.72 / -2.1%
clickbench_q26/duckdb:parquet 31508690 / 32709602 / -3.7% 49224721 / 52848002 / -6.9% 0.64 / 0.62 / +3.4%
clickbench_q27/duckdb:parquet 217006760 / 192350206 / +12.8% 🔴 234268346 / 227077568 / +3.2% 0.93 / 0.85 / +9.4%
clickbench_q28/duckdb:parquet 1005280131 / 972564021 / +3.4% 970035106 / 1008241398 / -3.8% 1.04 / 0.96 / +7.4%
clickbench_q29/duckdb:parquet 26597232 / 25852824 / +2.9% 35672633 / 36366794 / -1.9% 0.75 / 0.71 / +4.9%
clickbench_q30/duckdb:parquet 106676662 / 108132974 / -1.3% 135298869 / 135784038 / -0.4% 0.79 / 0.80 / -1.0%
clickbench_q31/duckdb:parquet 147553989 / 137342226 / +7.4% 183139850 / 181212359 / +1.1% 0.81 / 0.76 / +6.3%
clickbench_q32/duckdb:parquet 387456368 / 393849758 / -1.6% 421530175 / 422076880 / -0.1% 0.92 / 0.93 / -1.5%
clickbench_q33/duckdb:parquet 481167572 / 467158113 / +3.0% 466643781 / 467118982 / -0.1% 1.03 / 1.00 / +3.1%
clickbench_q34/duckdb:parquet 474223006 / 488649766 / -3.0% 455181754 / 496967508 / -8.4% 1.04 / 0.98 / +6.0%
clickbench_q35/duckdb:parquet 63242934 / 64132626 / -1.4% 77091373 / 79756595 / -3.3% 0.82 / 0.80 / +2.0%
clickbench_q36/duckdb:parquet 32466130 / 32480106 / -0.0% 41014313 / 41153056 / -0.3% 0.79 / 0.79 / +0.3%
clickbench_q37/duckdb:parquet 24883615 / 25722894 / -3.3% 33996609 / 33944196 / +0.2% 0.73 / 0.76 / -3.4%
clickbench_q38/duckdb:parquet 26264731 / 25353535 / +3.6% 35463587 / 35510943 / -0.1% 0.74 / 0.71 / +3.7%
clickbench_q39/duckdb:parquet 54030097 / 54952096 / -1.7% 63836464 / 63722395 / +0.2% 0.85 / 0.86 / -1.9%
clickbench_q40/duckdb:parquet 15720617 / 16284270 / -3.5% 24477897 / 25147667 / -2.7% 0.64 / 0.65 / -0.8%
clickbench_q41/duckdb:parquet 17004704 / 16850950 / +0.9% 23918565 / 24022566 / -0.4% 0.71 / 0.70 / +1.4%
clickbench_q42/duckdb:parquet 15415040 / 15793172 / -2.4% 25244894 / 25044786 / +0.8% 0.61 / 0.63 / -3.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR c63d98dd vs base 891c01ab
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.1%, environment too noisy confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): hot 0.988x ➖ · cold 1.032x ➖
Parquet (geomean): hot 0.983x ➖ · cold 1.031x ➖
Shifts: Parquet (control) -1.7% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.927x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 211943954 / 260739919 / -18.7% 644773444 / 1045240414 / -38.3% 🟢 0.33 / 0.25 / +31.8%
tpch_q02/datafusion:vortex-file-compressed 302076043 / 333333245 / -9.4% 630989344 / 712448519 / -11.4% 0.48 / 0.47 / +2.3%
tpch_q03/datafusion:vortex-file-compressed 352919905 / 383531435 / -8.0% 1057322953 / 955423135 / +10.7% 0.33 / 0.40 / -16.8%
tpch_q04/datafusion:vortex-file-compressed 194691124 / 310419130 / -37.3% 🟢 410586371 / 403334928 / +1.8% 0.47 / 0.77 / -38.4%
tpch_q05/datafusion:vortex-file-compressed 384218312 / 398464394 / -3.6% 694710420 / 598486209 / +16.1% 0.55 / 0.67 / -16.9%
tpch_q06/datafusion:vortex-file-compressed 141191669 / 151113156 / -6.6% 291273567 / 302634044 / -3.8% 0.48 / 0.50 / -2.9%
tpch_q07/datafusion:vortex-file-compressed 420815382 / 406238709 / +3.6% 599521790 / 622000099 / -3.6% 0.70 / 0.65 / +7.5%
tpch_q08/datafusion:vortex-file-compressed 432182819 / 425174121 / +1.6% 597822107 / 606342707 / -1.4% 0.72 / 0.70 / +3.1%
tpch_q09/datafusion:vortex-file-compressed 286353808 / 359753987 / -20.4% 750789313 / 871734982 / -13.9% 0.38 / 0.41 / -7.6%
tpch_q10/datafusion:vortex-file-compressed 359067616 / 344712003 / +4.2% 495198560 / 540785906 / -8.4% 0.73 / 0.64 / +13.8%
tpch_q11/datafusion:vortex-file-compressed 258434633 / 250509342 / +3.2% 422826790 / 391965589 / +7.9% 0.61 / 0.64 / -4.4%
tpch_q12/datafusion:vortex-file-compressed 224092488 / 273914859 / -18.2% 494809691 / 486262401 / +1.8% 0.45 / 0.56 / -19.6%
tpch_q13/datafusion:vortex-file-compressed 155583347 / 307745424 / -49.4% 🟢 372382522 / 330993647 / +12.5% 0.42 / 0.93 / -55.1%
tpch_q14/datafusion:vortex-file-compressed 174145147 / 179075550 / -2.8% 365079945 / 397872165 / -8.2% 0.48 / 0.45 / +6.0%
tpch_q15/datafusion:vortex-file-compressed 313813783 / 290829033 / +7.9% 580022404 / 503657670 / +15.2% 0.54 / 0.58 / -6.3%
tpch_q16/datafusion:vortex-file-compressed 134965479 / 144949507 / -6.9% 288350818 / 279664085 / +3.1% 0.47 / 0.52 / -9.7%
tpch_q17/datafusion:vortex-file-compressed 250434115 / 447215647 / -44.0% 🟢 442280907 / 605061992 / -26.9% 0.57 / 0.74 / -23.4%
tpch_q18/datafusion:vortex-file-compressed 538018651 / 264902161 / +103.1% 🔴 488514901 / 1033628850 / -52.7% 🟢 1.10 / 0.26 / +329.7%
tpch_q19/datafusion:vortex-file-compressed 246411984 / 270664389 / -9.0% 387132104 / 361833728 / +7.0% 0.64 / 0.75 / -14.9%
tpch_q20/datafusion:vortex-file-compressed 305367769 / 280873590 / +8.7% 617424294 / 456430707 / +35.3% 🔴 0.49 / 0.62 / -19.6%
tpch_q21/datafusion:vortex-file-compressed 491276700 / 454896302 / +8.0% 645361996 / 679684215 / -5.0% 0.76 / 0.67 / +13.7%
tpch_q22/datafusion:vortex-file-compressed 191296103 / 170775528 / +12.0% 412582891 / 477314972 / -13.6% 0.46 / 0.36 / +29.6%
datafusion / parquet / ns (0.926x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 147365740 / 167415846 / -12.0% 467822710 / 503697585 / -7.1% 0.32 / 0.33 / -5.2%
tpch_q02/datafusion:parquet 281867245 / 324008613 / -13.0% 477726407 / 597398268 / -20.0% 0.59 / 0.54 / +8.8%
tpch_q03/datafusion:parquet 231825105 / 405053242 / -42.8% 🟢 643798378 / 673796158 / -4.5% 0.36 / 0.60 / -40.1%
tpch_q04/datafusion:parquet 139910435 / 143139452 / -2.3% 310533983 / 369662336 / -16.0% 0.45 / 0.39 / +16.4%
tpch_q05/datafusion:parquet 347516365 / 368248173 / -5.6% 477765979 / 484928022 / -1.5% 0.73 / 0.76 / -4.2%
tpch_q06/datafusion:parquet 109942342 / 115851222 / -5.1% 225076533 / 272143174 / -17.3% 0.49 / 0.43 / +14.7%
tpch_q07/datafusion:parquet 326499734 / 340458322 / -4.1% 424710704 / 464042325 / -8.5% 0.77 / 0.73 / +4.8%
tpch_q08/datafusion:parquet 426615157 / 465668927 / -8.4% 536650278 / 618218742 / -13.2% 0.79 / 0.75 / +5.5%
tpch_q09/datafusion:parquet 408464595 / 392473476 / +4.1% 559659836 / 560325035 / -0.1% 0.73 / 0.70 / +4.2%
tpch_q10/datafusion:parquet 315216111 / 332432232 / -5.2% 495814800 / 541199686 / -8.4% 0.64 / 0.61 / +3.5%
tpch_q11/datafusion:parquet 258532713 / 278087225 / -7.0% 362004885 / 380484858 / -4.9% 0.71 / 0.73 / -2.3%
tpch_q12/datafusion:parquet 164498166 / 165997461 / -0.9% 286560887 / 316161542 / -9.4% 0.57 / 0.53 / +9.3%
tpch_q13/datafusion:parquet 282519609 / 279471624 / +1.1% 487409595 / 474101863 / +2.8% 0.58 / 0.59 / -1.7%
tpch_q14/datafusion:parquet 154071205 / 187879913 / -18.0% 266768306 / 287864976 / -7.3% 0.58 / 0.65 / -11.5%
tpch_q15/datafusion:parquet 309589568 / 323097110 / -4.2% 447217860 / 465887599 / -4.0% 0.69 / 0.69 / -0.2%
tpch_q16/datafusion:parquet 110033680 / 109814445 / +0.2% 241990642 / 220085632 / +10.0% 0.45 / 0.50 / -8.9%
tpch_q17/datafusion:parquet 278118859 / 292567108 / -4.9% 408409530 / 385533714 / +5.9% 0.68 / 0.76 / -10.3%
tpch_q18/datafusion:parquet 318260996 / 309412298 / +2.9% 458508161 / 513005245 / -10.6% 0.69 / 0.60 / +15.1%
tpch_q19/datafusion:parquet 158957548 / 188318873 / -15.6% 270213371 / 349647045 / -22.7% 0.59 / 0.54 / +9.2%
tpch_q20/datafusion:parquet 226696651 / 255185025 / -11.2% 350289740 / 418180316 / -16.2% 0.65 / 0.61 / +6.1%
tpch_q21/datafusion:parquet 313180792 / 326915108 / -4.2% 445709805 / 446330776 / -0.1% 0.70 / 0.73 / -4.1%
tpch_q22/datafusion:parquet 174740983 / 162023086 / +7.8% 394515315 / 327659885 / +20.4% 0.44 / 0.49 / -10.4%
duckdb / vortex-file-compressed / ns (1.052x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 254310512 / 245897276 / +3.4% 262476776 / 258322247 / +1.6% 0.97 / 0.95 / +1.8%
tpch_q02/duckdb:vortex-file-compressed 456210096 / 442412058 / +3.1% 567145699 / 474787124 / +19.5% 0.80 / 0.93 / -13.7%
tpch_q03/duckdb:vortex-file-compressed 421376698 / 389367838 / +8.2% 613281160 / 491253313 / +24.8% 0.69 / 0.79 / -13.3%
tpch_q04/duckdb:vortex-file-compressed 256146129 / 260481861 / -1.7% 350233776 / 288691782 / +21.3% 0.73 / 0.90 / -18.9%
tpch_q05/duckdb:vortex-file-compressed 609697296 / 521588305 / +16.9% 630267932 / 667138476 / -5.5% 0.97 / 0.78 / +23.7%
tpch_q06/duckdb:vortex-file-compressed 203036915 / 214016600 / -5.1% 260925629 / 195999473 / +33.1% 🔴 0.78 / 1.09 / -28.7%
tpch_q07/duckdb:vortex-file-compressed 463111784 / 424592303 / +9.1% 639105910 / 535445839 / +19.4% 0.72 / 0.79 / -8.6%
tpch_q08/duckdb:vortex-file-compressed 623929330 / 727743250 / -14.3% 728166899 / 648030041 / +12.4% 0.86 / 1.12 / -23.7%
tpch_q09/duckdb:vortex-file-compressed 454261819 / 383286656 / +18.5% 688498731 / 449702130 / +53.1% 🔴 0.66 / 0.85 / -22.6%
tpch_q10/duckdb:vortex-file-compressed 538174623 / 510643170 / +5.4% 531857954 / 562587416 / -5.5% 1.01 / 0.91 / +11.5%
tpch_q11/duckdb:vortex-file-compressed 336469887 / 273774795 / +22.9% 419292618 / 277687015 / +51.0% 🔴 0.80 / 0.99 / -18.6%
tpch_q12/duckdb:vortex-file-compressed 266858810 / 229779422 / +16.1% 271543498 / 263051965 / +3.2% 0.98 / 0.87 / +12.5%
tpch_q13/duckdb:vortex-file-compressed 270974134 / 279915480 / -3.2% 229298563 / 213771812 / +7.3% 1.18 / 1.31 / -9.7%
tpch_q14/duckdb:vortex-file-compressed 248385154 / 217888167 / +14.0% 402249556 / 281124814 / +43.1% 🔴 0.62 / 0.78 / -20.3%
tpch_q15/duckdb:vortex-file-compressed 297918153 / 239005466 / +24.6% 311907059 / 262597736 / +18.8% 0.96 / 0.91 / +4.9%
tpch_q16/duckdb:vortex-file-compressed 205858304 / 220948520 / -6.8% 297844790 / 239843552 / +24.2% 0.69 / 0.92 / -25.0%
tpch_q17/duckdb:vortex-file-compressed 300325177 / 502850874 / -40.3% 🟢 331874596 / 404967111 / -18.0% 0.90 / 1.24 / -27.1%
tpch_q18/duckdb:vortex-file-compressed 361516022 / 316093571 / +14.4% 402445676 / 315713240 / +27.5% 0.90 / 1.00 / -10.3%
tpch_q19/duckdb:vortex-file-compressed 400127256 / 296517320 / +34.9% 🔴 389573963 / 372645475 / +4.5% 1.03 / 0.80 / +29.1%
tpch_q20/duckdb:vortex-file-compressed 457462109 / 434448811 / +5.3% 501771097 / 679849007 / -26.2% 0.91 / 0.64 / +42.7%
tpch_q21/duckdb:vortex-file-compressed 676023221 / 616671392 / +9.6% 692685795 / 633842813 / +9.3% 0.98 / 0.97 / +0.3%
tpch_q22/duckdb:vortex-file-compressed 259496286 / 244278004 / +6.2% 333371793 / 327062676 / +1.9% 0.78 / 0.75 / +4.2%
duckdb / parquet / ns (1.044x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 199559102 / 163138582 / +22.3% 402916383 / 199820808 / +101.6% 🔴 0.50 / 0.82 / -39.3%
tpch_q02/duckdb:parquet 441273891 / 481274333 / -8.3% 473155252 / 548580722 / -13.7% 0.93 / 0.88 / +6.3%
tpch_q03/duckdb:parquet 411895817 / 416157799 / -1.0% 477779008 / 481553153 / -0.8% 0.86 / 0.86 / -0.2%
tpch_q04/duckdb:parquet 252499732 / 334023601 / -24.4% 341250887 / 380043612 / -10.2% 0.74 / 0.88 / -15.8%
tpch_q05/duckdb:parquet 545819006 / 473475494 / +15.3% 626290025 / 559230746 / +12.0% 0.87 / 0.85 / +2.9%
tpch_q06/duckdb:parquet 195616470 / 189252116 / +3.4% 275235229 / 229629198 / +19.9% 0.71 / 0.82 / -13.8%
tpch_q07/duckdb:parquet 483709605 / 460004495 / +5.2% 513400144 / 578423183 / -11.2% 0.94 / 0.80 / +18.5%
tpch_q08/duckdb:parquet 730762913 / 663709067 / +10.1% 746334954 / 587447056 / +27.0% 0.98 / 1.13 / -13.3%
tpch_q09/duckdb:parquet 567595847 / 543506644 / +4.4% 629808951 / 2456037320 / -74.4% 🟢 0.90 / 0.22 / +307.2%
tpch_q10/duckdb:parquet 583184395 / 559602258 / +4.2% 639198718 / 517171436 / +23.6% 0.91 / 1.08 / -15.7%
tpch_q11/duckdb:parquet 306786583 / 308794271 / -0.7% 377261160 / 353286591 / +6.8% 0.81 / 0.87 / -7.0%
tpch_q12/duckdb:parquet 237404187 / 269096406 / -11.8% 310485603 / 288791261 / +7.5% 0.76 / 0.93 / -17.9%
tpch_q13/duckdb:parquet 385671579 / 355205012 / +8.6% 647893828 / 422882673 / +53.2% 🔴 0.60 / 0.84 / -29.1%
tpch_q14/duckdb:parquet 275906929 / 309557325 / -10.9% 449483498 / 281657120 / +59.6% 🔴 0.61 / 1.10 / -44.1%
tpch_q15/duckdb:parquet 289807070 / 187661774 / +54.4% 🔴 285300146 / 240681775 / +18.5% 1.02 / 0.78 / +30.3%
tpch_q16/duckdb:parquet 260682062 / 292080096 / -10.7% 290902565 / 301444774 / -3.5% 0.90 / 0.97 / -7.5%
tpch_q17/duckdb:parquet 334259605 / 298033823 / +12.2% 388239346 / 351915656 / +10.3% 0.86 / 0.85 / +1.7%
tpch_q18/duckdb:parquet 430648448 / 341621973 / +26.1% 586226576 / 407999890 / +43.7% 🔴 0.73 / 0.84 / -12.3%
tpch_q19/duckdb:parquet 314900320 / 269437732 / +16.9% 1294898986 / 326747527 / +296.3% 🔴 0.24 / 0.82 / -70.5%
tpch_q20/duckdb:parquet 464051465 / 462508396 / +0.3% 479811266 / 506466728 / -5.3% 0.97 / 0.91 / +5.9%
tpch_q21/duckdb:parquet 472217544 / 490065775 / -3.6% 512088309 / 451371123 / +13.5% 0.92 / 1.09 / -15.1%
tpch_q22/duckdb:parquet 335327515 / 303373189 / +10.5% 355388113 / 343873696 / +3.3% 0.94 / 0.88 / +7.0%

@codspeed

codspeed Bot commented Oct 29, 2026

Copy link
Copy Markdown

Merging this PR will regress 5 benchmarks

3 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 2 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

⚡ 5 improved benchmarks
❌ 5 regressed benchmarks
✅ 2294 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation bench_compare_varbin[(50000, 2)] 133.8 µs 163.7 µs -18.23%
❌ CPU Simulation bench_compare_varbin[(50000, 64)] 135.6 µs 165.6 µs -18.13%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(7500, 10000)] 200.8 µs 229.3 µs -12.42%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(1000, 10000)] 79.9 µs 91.1 µs -12.28%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(10000, 10000)] 207 µs 235.4 µs -12.06%
⚡ CPU Simulation filter_powerlaw_by_random[10000] 670 ns 418.6 ns +60.06%
⚡ Walltime threshold_neon[64] 3.9 µs 2.6 µs +50.42%
⚡ Walltime threshold_neon[80] 4.9 µs 3.4 µs +41.5%
⚡ CPU Simulation encode_primitives[u8, (2000, 4)] 164.7 µs 135.2 µs +21.79%
⚡ Walltime threshold_avx512[80] 2.8 µs 2.5 µs +12.4%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/codex/filter-slice-pushdown (c63d98d) with develop (1a09eb4)1

Open in CodSpeed

Footnotes

  1. No successful run was found on develop (891c01a) during the generation of this report, so 1a09eb4 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

@robert3005
robert3005 merged commit 322a04a into develop Oct 29, 2026
203 of 208 checks passed
@robert3005
robert3005 deleted the ji/codex/filter-slice-pushdown branch October 29, 2026 14:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants