Skip to content

perf(scan): keep dictionary values only while live work claims their rows - #11355

Draft
joseph-isaacs wants to merge 16 commits into
developfrom
ji/liveness-dict-values
Draft

joseph-isaacs wants to merge 16 commits into
developfrom
ji/liveness-dict-values

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Stacked on #11201 (driver-owned liveness). It targets develop so the SQL benchmarks run. Review the commits after the merge of #11201: 0ff47fa3, 63656cf0 and 2ff72324. The two commits marked experiment: were benchmark-only and are reverted by 96d17fc5, so the tree is identical to 2ff72324.

This uses liveness for one thing: limiting how long the V2 ValueCache keeps dictionary values. Today every decoded dictionary stays for the whole life of the ScanCache. With this change, each one is pinned to the file rows its dictionary covers and dropped once no live work claims any of those rows. The goal is lower memory at the same speed.

Changes

  • ValueCache (pipeline/values.rs): with_liveness(liveness) pins each recorded value to its file rows. Dropping the pin evicts the value. A generation check stops an old pin from evicting a value recorded again later. A value recorded while no work claims its rows is kept as long as the cache, as before, so scans driven without liveness don't re-decode dictionaries for every chunk.
  • Compiler: tracks the file row where each plan's row zero sits. compile_at adds a chunk's offset inside a concatenation, and compile_detached is used for dictionary values and zone tables, whose rows aren't file rows. Take and Share pin to file_rows(plan.row_count()), or for the whole file when the rows aren't known.
  • ScanCache: owns the file's Liveness, builds its ValueCache from it, and exposes liveness(). PreparedScan::liveness() passes it to the engines.
  • Driver/engines: Progress::Spawn carries the child's RowClaim, and Run::admit_spawned admits it with that claim. DataFusion, DuckDB and vortex-file admit with the cache's liveness, so a dictionary stays while any chunk over its rows is planned or running. ChunkPlanner::remaining_rows narrows the root's claim as it hands chunks out.
  • Claims off the lock (63656cf0, 2ff72324):
    • A child within its parent's claim shares it through an Arc instead of locking the liveness to claim and release its own rows.
    • A spawned chunk at the front of a claim only its parent holds takes those rows over with RowClaim::split_front, which never touches the liveness.
    • A scan of a 40M-row file now takes about two liveness locks per chunk, and scans with and without liveness take the same time.
  • Tests:
    • New dictionary_values_live_while_their_rows_are_claimed covers two dictionaries: one evicted after its claim drops, and the keep-for-the-cache's-life fallback.
    • New a_split_claim_keeps_its_rows_until_each_part_is_dropped.
    • Three existing tests expected values to survive between separate scans with nothing claimed in between. They now hold a claim to keep values across scans, plus a released case showing values are read again once nothing claims them.

Benchmarks

Measured at 2ff72324 against develop. Most suites come out the same or slightly faster after subtracting the Parquet drift: ClickBench −0.5%, FineWeb −2.1%, TPC-H SF1 +0.4% and SF10 −0.7%, TPC-DS SF1 +0.4%. TPC-H on S3 is marked too noisy. PolarSignals has no Parquet control.

TPC-DS SF10 inventory queries are slower against the base 4598f857: DuckDB q21 +26%, q37 +10%, q82 +11%. This doesn't appear to come from this PR:

So they most likely come from a develop commit after that base, probably #11331, which changes how integer columns get compressed. That's my best guess and isn't confirmed.

API Changes

ScanCache and PreparedScan gain liveness(). Progress::Spawn gains a third field, Option<RowClaim>; Run::admit_spawned and RowClaim::split_front are added. Dictionary values are no longer kept between scans of a shared ScanCache unless a caller holds a claim on their rows.

🤖 Generated with Claude Code

https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW

joseph-isaacs and others added 6 commits November 4, 2026 11:25
Extract the row-claim read lifetime from the closed #10857 on its own,
without its layout, DuckDB, or DataFusion changes.

`FileReads` shares pending and completed reads across all workers of one
file execution. Work owns a `RowClaim` over the file-local rows it may
still read, and moves, splits (`split_to`), narrows (`restrict_to`), or
shares that claim as it is handed between planners. A read whose
`ReadLifetime` bounds its consumers to a row range is evicted once no
live claim covers that range; reads with unknown lifetimes live until the
last claim drops.

Nothing constructs these types yet; wiring them into the V2 scan planners
is left to a follow-up.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Row claims are a timing system for when in-memory scan state can be
dropped, not an IO concern, so they now live in the planner driver.

A `Liveness` tracks which root rows of one file live work may still
touch. `Run::admit_with_liveness` gives every planner and morsel
descended from a root a `RowClaim` over its scope's rows: taken when the
work is spawned, narrowed after each compute to the work's new optional
`remaining_rows()`, and released when the work retires or is cancelled.
Children claim their rows before their parent narrows, so handed-off
rows are never uncovered in between. Planners no longer pass claims
around themselves.

Any value decoded for those rows (arrays, dictionary values, buffers)
can be pinned to a `Lifetime` with `Liveness::pin` and is dropped once
no claim covers its rows. Caches that want to find it again keep a weak
reference.

This removes the IO-layer `FileReads` coordinator and its read
lifetimes. `Planner` and `Morsel` gain `remaining_rows()`, which
defaults to keeping the whole scope, so existing implementations are
unchanged.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
…rows

The V2 scan's ValueCache kept every dictionary's decoded values for the
whole life of the ScanCache. Pin each value in the file's Liveness to the
file rows its dictionary covers instead, so it is dropped once no live work
claims any of those rows. Values recorded while no work claims their rows,
as in a scan driven without liveness, are kept as long as the cache, as
before.

The compiler now tracks the file row of each plan's row zero through
concatenations, and detaches it for dictionary values and zone tables,
whose rows are not file rows. Engines admit their scans with the cache's
liveness and pass claims with spawned chunks, so a dictionary stays while
any chunk over it is planned or running.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with Claude
@joseph-isaacs joseph-isaacs mentioned this pull request Nov 9, 2026
16 of 46 tasks
…alues

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-layout/src/plan/physical/plans/share.rs
@joseph-isaacs joseph-isaacs added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR and removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 9, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0fbea33 random-access-bench 1 Explore Profiling Data
🟢 Done 0fbea33 fineweb 1 Explore Profiling Data
🟢 Done 0fbea33 clickbench-nvme 1 Explore Profiling Data
🟢 Done 0fbea33 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 0fbea33 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0fbea33 polarsignals 1 Explore Profiling Data
🟢 Done 0fbea33 tpch-s3 1 Explore Profiling Data
🟢 Done 0fbea33 tpch-nvme 1 Explore Profiling Data
🟢 Done 0fbea33 tpcds-nvme 1 Explore Profiling Data
Previous Runs (49)
Status Commit Job Attempt Link
🟢 Done e7241f6 random-access-bench 1 Explore Profiling Data
🟢 Done e7241f6 fineweb 1 Explore Profiling Data
🟢 Done e7241f6 clickbench-nvme 1 Explore Profiling Data
🟢 Done e7241f6 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done e7241f6 tpch-nvme-10 1 Explore Profiling Data
🟢 Done e7241f6 polarsignals 1 Explore Profiling Data
🟢 Done e7241f6 tpch-s3 1 Explore Profiling Data
🟢 Done e7241f6 tpch-nvme 1 Explore Profiling Data
🟢 Done e7241f6 tpcds-nvme 1 Explore Profiling Data
🟢 Done 261823a fineweb 1 Explore Profiling Data
🟢 Done 261823a tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 261823a tpch-nvme-10 1 Explore Profiling Data
🟢 Done 261823a clickbench-nvme 1 Explore Profiling Data
🟢 Done 261823a polarsignals 1 Explore Profiling Data
🟢 Done 261823a tpch-nvme 1 Explore Profiling Data
🟢 Done 261823a tpch-s3 1 Explore Profiling Data
🟢 Done 261823a tpcds-nvme 1 Explore Profiling Data
🟢 Done af51447 fineweb 1 Explore Profiling Data
🟢 Done af51447 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done af51447 clickbench-nvme 1 Explore Profiling Data
🟢 Done af51447 polarsignals 1 Explore Profiling Data
🟢 Done af51447 tpch-nvme-10 1 Explore Profiling Data
🟢 Done af51447 tpch-nvme 1 Explore Profiling Data
🟢 Done af51447 tpcds-nvme 1 Explore Profiling Data
🟢 Done af51447 tpch-s3 1 Explore Profiling Data
🟢 Done 2ff7232 fineweb 1 Explore Profiling Data
🟢 Done 2ff7232 clickbench-nvme 1 Explore Profiling Data
🟢 Done 2ff7232 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 2ff7232 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 2ff7232 polarsignals 1 Explore Profiling Data
🟢 Done 2ff7232 tpch-s3 1 Explore Profiling Data
🟢 Done 2ff7232 tpcds-nvme 1 Explore Profiling Data
🟢 Done 2ff7232 tpch-nvme 1 Explore Profiling Data
🟢 Done 63656cf tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 63656cf polarsignals 1 Explore Profiling Data
🟢 Done 63656cf clickbench-nvme 1 Explore Profiling Data
🟢 Done 63656cf tpch-s3 1 Explore Profiling Data
🟢 Done 63656cf tpch-nvme 1 Explore Profiling Data
🟢 Done 63656cf tpch-nvme-10 1 Explore Profiling Data
🟢 Done 63656cf fineweb 1 Explore Profiling Data
🟢 Done 63656cf tpcds-nvme 1 Explore Profiling Data
🟢 Done d8017c0 clickbench-nvme 2 Explore Profiling Data
🟢 Done d8017c0 tpcds-nvme-10 2 Explore Profiling Data
🟢 Done d8017c0 tpch-nvme-10 2 Explore Profiling Data
🟢 Done d8017c0 polarsignals 2 Explore Profiling Data
🟢 Done d8017c0 tpch-s3 2 Explore Profiling Data
🟢 Done d8017c0 fineweb 2 Explore Profiling Data
🟢 Done d8017c0 tpch-nvme 2 Explore Profiling Data
🟢 Done d8017c0 tpcds-nvme 2 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 0fbea339 vs base ce2b6d02
Vortex (geomean): hot 0.967x ➖ · cold 0.921x ➖


datafusion / vortex-file-compressed / ns (0.967x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44233098 / 44158582 / +0.2% 85718188 / 89668296 / -4.4% 0.52 / 0.49 / +4.8%
polarsignals_q01/datafusion:vortex-file-compressed 53670448 / 67166500 / -20.1% 🟢 106616771 / 136884449 / -22.1% 🟢 0.50 / 0.49 / +2.6%
polarsignals_q02/datafusion:vortex-file-compressed 11812238 / 11716340 / +0.8% 48999347 / 47732284 / +2.7% 0.24 / 0.25 / -1.8%
polarsignals_q03/datafusion:vortex-file-compressed 54377414 / 58218058 / -6.6% 110011254 / 144595545 / -23.9% 🟢 0.49 / 0.40 / +22.8%
polarsignals_q04/datafusion:vortex-file-compressed 9017654 / 9416916 / -4.2% 40803491 / 43765066 / -6.8% 0.22 / 0.22 / +2.7%
polarsignals_q05/datafusion:vortex-file-compressed 11479734 / 11643464 / -1.4% 45491739 / 47478438 / -4.2% 0.25 / 0.25 / +2.9%
polarsignals_q06/datafusion:vortex-file-compressed 22883638 / 22895308 / -0.1% 54954688 / 55992197 / -1.9% 0.42 / 0.41 / +1.8%
polarsignals_q07/datafusion:vortex-file-compressed 10563386 / 10694890 / -1.2% 42417121 / 44048846 / -3.7% 0.25 / 0.24 / +2.6%
polarsignals_q08/datafusion:vortex-file-compressed 98244572 / 96570370 / +1.7% 155648776 / 156514643 / -0.6% 0.63 / 0.62 / +2.3%
polarsignals_q09/datafusion:vortex-file-compressed 9970674 / 10362002 / -3.8% 39543578 / 42053717 / -6.0% 0.25 / 0.25 / +2.3%
polarsignals_q10/datafusion:vortex-file-compressed 12268924 / 12220171 / +0.4% 44382152 / 50320488 / -11.8% 🟢 0.28 / 0.24 / +13.8%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 0fbea339 vs base a1fbac67
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (-3.9%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.978x ➖
Parquet (geomean): hot 1.007x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5981186 / 6042610 / -1.0% 20030316 / 18996191 / +5.4% 0.30 / 0.32 / -6.1%
fineweb_q01/datafusion:vortex-file-compressed 9066058 / 9096412 / -0.3% 37696334 / 40467004 / -6.8% 0.24 / 0.22 / +7.0%
fineweb_q02/datafusion:vortex-file-compressed 11152751 / 10846827 / +2.8% 36923127 / 42552685 / -13.2% 🟢 0.30 / 0.25 / +18.5%
fineweb_q03/datafusion:vortex-file-compressed 17035252 / 17066620 / -0.2% 100259418 / 102616932 / -2.3% 0.17 / 0.17 / +2.2%
fineweb_q04/datafusion:vortex-file-compressed 67900885 / 63983856 / +6.1% 142984730 / 144544331 / -1.1% 0.47 / 0.44 / +7.3%
fineweb_q05/datafusion:vortex-file-compressed 61596214 / 61581218 / +0.0% 128692968 / 133933033 / -3.9% 0.48 / 0.46 / +4.1%
fineweb_q06/datafusion:vortex-file-compressed 16128364 / 16804046 / -4.0% 100451801 / 99979338 / +0.5% 0.16 / 0.17 / -4.5%
fineweb_q07/datafusion:vortex-file-compressed 18185070 / 16632172 / +9.3% 103223125 / 102520874 / +0.7% 0.18 / 0.16 / +8.6%
fineweb_q08/datafusion:vortex-file-compressed 8740832 / 8869335 / -1.4% 32448998 / 28174986 / +15.2% 🔴 0.27 / 0.31 / -14.4%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9657376 / 9501142 / +1.6% 33182936 / 32277577 / +2.8% 0.29 / 0.29 / -1.1%
fineweb_q01/datafusion:parquet 73966956 / 74814340 / -1.1% 147068799 / 157446048 / -6.6% 0.50 / 0.48 / +5.8%
fineweb_q02/datafusion:parquet 74575006 / 73772434 / +1.1% 149296267 / 147690010 / +1.1% 0.50 / 0.50 / +0.0%
fineweb_q03/datafusion:parquet 73051616 / 73061924 / -0.0% 146339740 / 139852195 / +4.6% 0.50 / 0.52 / -4.4%
fineweb_q04/datafusion:parquet 82632298 / 81363628 / +1.6% 149288620 / 148003631 / +0.9% 0.55 / 0.55 / +0.7%
fineweb_q05/datafusion:parquet 80028120 / 81226126 / -1.5% 144098222 / 142644429 / +1.0% 0.56 / 0.57 / -2.5%
fineweb_q06/datafusion:parquet 78699828 / 76849485 / +2.4% 148949774 / 146595236 / +1.6% 0.53 / 0.52 / +0.8%
fineweb_q07/datafusion:parquet 73434124 / 74383736 / -1.3% 150510948 / 145258212 / +3.6% 0.49 / 0.51 / -4.7%
fineweb_q08/datafusion:parquet 74441370 / 73128559 / +1.8% 140939097 / 142510463 / -1.1% 0.53 / 0.51 / +2.9%
duckdb / vortex-file-compressed / ns (0.970x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2106460 / 2096480 / +0.5% 7062713 / 8456060 / -16.5% 🟢 0.30 / 0.25 / +20.3%
fineweb_q01/duckdb:vortex-file-compressed 7111989 / 7619354 / -6.7% 24979674 / 24778073 / +0.8% 0.28 / 0.31 / -7.4%
fineweb_q02/duckdb:vortex-file-compressed 8868418 / 9556805 / -7.2% 28281305 / 28294203 / -0.0% 0.31 / 0.34 / -7.2%
fineweb_q03/duckdb:vortex-file-compressed 18612302 / 18186195 / +2.3% 85980692 / 88043302 / -2.3% 0.22 / 0.21 / +4.8%
fineweb_q04/duckdb:vortex-file-compressed 65575007 / 65477170 / +0.1% 101472248 / 104223620 / -2.6% 0.65 / 0.63 / +2.9%
fineweb_q05/duckdb:vortex-file-compressed 65545588 / 65060140 / +0.7% 99514487 / 101897219 / -2.3% 0.66 / 0.64 / +3.2%
fineweb_q06/duckdb:vortex-file-compressed 17151982 / 17490793 / -1.9% 87179489 / 87772759 / -0.7% 0.20 / 0.20 / -1.3%
fineweb_q07/duckdb:vortex-file-compressed 16116488 / 18186870 / -11.4% 🟢 86565048 / 87665832 / -1.3% 0.19 / 0.21 / -10.3%
fineweb_q08/duckdb:vortex-file-compressed 4495278 / 4628180 / -2.9% 12272012 / 13036477 / -5.9% 0.37 / 0.36 / +3.2%
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23871293 / 23935763 / -0.3% 28636844 / 27747834 / +3.2% 0.83 / 0.86 / -3.4%
fineweb_q01/duckdb:parquet 54025014 / 53132187 / +1.7% 70506554 / 75701303 / -6.9% 0.77 / 0.70 / +9.2%
fineweb_q02/duckdb:parquet 58210192 / 57929455 / +0.5% 75598933 / 76047532 / -0.6% 0.77 / 0.76 / +1.1%
fineweb_q03/duckdb:parquet 118730213 / 118930200 / -0.2% 181405436 / 177687072 / +2.1% 0.65 / 0.67 / -2.2%
fineweb_q04/duckdb:parquet 160958798 / 160499528 / +0.3% 203904006 / 204470141 / -0.3% 0.79 / 0.78 / +0.6%
fineweb_q05/duckdb:parquet 160500038 / 157414534 / +2.0% 203055168 / 203414018 / -0.2% 0.79 / 0.77 / +2.1%
fineweb_q06/duckdb:parquet 87828456 / 87118241 / +0.8% 139959179 / 145027372 / -3.5% 0.63 / 0.60 / +4.5%
fineweb_q07/duckdb:parquet 91104796 / 89259270 / +2.1% 142200723 / 139355320 / +2.0% 0.64 / 0.64 / +0.0%
fineweb_q08/duckdb:parquet 28994520 / 28599318 / +1.4% 30822489 / 30472535 / +1.1% 0.94 / 0.94 / +0.2%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 0fbea339 vs base a1fbac67
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.985x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.996x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15539468 / 15284211 / +1.7% 42127423 / 43160006 / -2.4% 0.37 / 0.35 / +4.2%
tpch_q02/datafusion:vortex-file-compressed 17424350 / 17399755 / +0.1% 39772564 / 39783506 / -0.0% 0.44 / 0.44 / +0.2%
tpch_q03/datafusion:vortex-file-compressed 19263085 / 19262959 / +0.0% 44580143 / 47495583 / -6.1% 0.43 / 0.41 / +6.5%
tpch_q04/datafusion:vortex-file-compressed 11235467 / 10437858 / +7.6% 35419696 / 36388474 / -2.7% 0.32 / 0.29 / +10.6%
tpch_q05/datafusion:vortex-file-compressed 37909598 / 37774917 / +0.4% 70440301 / 70460320 / -0.0% 0.54 / 0.54 / +0.4%
tpch_q06/datafusion:vortex-file-compressed 4469153 / 4379080 / +2.1% 25058045 / 32214776 / -22.2% 🟢 0.18 / 0.14 / +31.2%
tpch_q07/datafusion:vortex-file-compressed 53243112 / 53100520 / +0.3% 79761731 / 83915775 / -5.0% 0.67 / 0.63 / +5.5%
tpch_q08/datafusion:vortex-file-compressed 51877052 / 53160413 / -2.4% 84043391 / 86410171 / -2.7% 0.62 / 0.62 / +0.3%
tpch_q09/datafusion:vortex-file-compressed 48303922 / 48937537 / -1.3% 77530037 / 84880245 / -8.7% 0.62 / 0.58 / +8.1%
tpch_q10/datafusion:vortex-file-compressed 17357715 / 18036025 / -3.8% 50590531 / 53366141 / -5.2% 0.34 / 0.34 / +1.5%
tpch_q11/datafusion:vortex-file-compressed 14490393 / 14464809 / +0.2% 34897166 / 35348313 / -1.3% 0.42 / 0.41 / +1.5%
tpch_q12/datafusion:vortex-file-compressed 18632533 / 18540856 / +0.5% 43279419 / 52291513 / -17.2% 🟢 0.43 / 0.35 / +21.4%
tpch_q13/datafusion:vortex-file-compressed 19795991 / 18968813 / +4.4% 41821876 / 43190156 / -3.2% 0.47 / 0.44 / +7.8%
tpch_q14/datafusion:vortex-file-compressed 13901416 / 14314703 / -2.9% 39290109 / 38990759 / +0.8% 0.35 / 0.37 / -3.6%
tpch_q15/datafusion:vortex-file-compressed 18365447 / 18392101 / -0.1% 46739316 / 45580596 / +2.5% 0.39 / 0.40 / -2.6%
tpch_q16/datafusion:vortex-file-compressed 18138816 / 17888107 / +1.4% 39552119 / 41102627 / -3.8% 0.46 / 0.44 / +5.4%
tpch_q17/datafusion:vortex-file-compressed 28961325 / 29256562 / -1.0% 60583151 / 60278730 / +0.5% 0.48 / 0.49 / -1.5%
tpch_q18/datafusion:vortex-file-compressed 36462389 / 36100585 / +1.0% 60245331 / 58793940 / +2.5% 0.61 / 0.61 / -1.4%
tpch_q19/datafusion:vortex-file-compressed 9569603 / 9750905 / -1.9% 36778580 / 36293196 / +1.3% 0.26 / 0.27 / -3.2%
tpch_q20/datafusion:vortex-file-compressed 20720943 / 20736482 / -0.1% 48315413 / 50023017 / -3.4% 0.43 / 0.41 / +3.5%
tpch_q21/datafusion:vortex-file-compressed 34557466 / 34896321 / -1.0% 67833992 / 68031724 / -0.3% 0.51 / 0.51 / -0.7%
tpch_q22/datafusion:vortex-file-compressed 11023949 / 10713447 / +2.9% 31734854 / 31065675 / +2.2% 0.35 / 0.34 / +0.7%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71383870 / 71289020 / +0.1% 88854686 / 89625542 / -0.9% 0.80 / 0.80 / +1.0%
tpch_q02/datafusion:parquet 75849201 / 75414203 / +0.6% 93165226 / 94271302 / -1.2% 0.81 / 0.80 / +1.8%
tpch_q03/datafusion:parquet 81915943 / 81791351 / +0.2% 104902422 / 103147386 / +1.7% 0.78 / 0.79 / -1.5%
tpch_q04/datafusion:parquet 39382086 / 39212094 / +0.4% 58721915 / 60364771 / -2.7% 0.67 / 0.65 / +3.2%
tpch_q05/datafusion:parquet 109725552 / 109870193 / -0.1% 137384681 / 139325167 / -1.4% 0.80 / 0.79 / +1.3%
tpch_q06/datafusion:parquet 31416893 / 31174888 / +0.8% 48831706 / 49189394 / -0.7% 0.64 / 0.63 / +1.5%
tpch_q07/datafusion:parquet 113691800 / 112821414 / +0.8% 138066968 / 140217281 / -1.5% 0.82 / 0.80 / +2.3%
tpch_q08/datafusion:parquet 117340086 / 116917375 / +0.4% 143646428 / 145923835 / -1.6% 0.82 / 0.80 / +2.0%
tpch_q09/datafusion:parquet 137389030 / 137638482 / -0.2% 164918670 / 168094166 / -1.9% 0.83 / 0.82 / +1.7%
tpch_q10/datafusion:parquet 103193896 / 103509900 / -0.3% 127116141 / 128757881 / -1.3% 0.81 / 0.80 / +1.0%
tpch_q11/datafusion:parquet 62123883 / 62168289 / -0.1% 82249330 / 82478353 / -0.3% 0.76 / 0.75 / +0.2%
tpch_q12/datafusion:parquet 63469039 / 62540796 / +1.5% 84777280 / 85717006 / -1.1% 0.75 / 0.73 / +2.6%
tpch_q13/datafusion:parquet 143307014 / 143690832 / -0.3% 163019496 / 162445800 / +0.4% 0.88 / 0.88 / -0.6%
tpch_q14/datafusion:parquet 47664283 / 47996099 / -0.7% 72993248 / 70372915 / +3.7% 0.65 / 0.68 / -4.3%
tpch_q15/datafusion:parquet 74658004 / 74613111 / +0.1% 95746957 / 93375745 / +2.5% 0.78 / 0.80 / -2.4%
tpch_q16/datafusion:parquet 43947550 / 42902044 / +2.4% 61980302 / 61411236 / +0.9% 0.71 / 0.70 / +1.5%
tpch_q17/datafusion:parquet 124198466 / 124087816 / +0.1% 146610347 / 151286647 / -3.1% 0.85 / 0.82 / +3.3%
tpch_q18/datafusion:parquet 120268660 / 120683667 / -0.3% 141305701 / 142572945 / -0.9% 0.85 / 0.85 / +0.5%
tpch_q19/datafusion:parquet 57131321 / 56940508 / +0.3% 82240020 / 84854079 / -3.1% 0.69 / 0.67 / +3.5%
tpch_q20/datafusion:parquet 79196551 / 78140439 / +1.4% 97957809 / 103496106 / -5.4% 0.81 / 0.76 / +7.1%
tpch_q21/datafusion:parquet 113793880 / 113579600 / +0.2% 137928301 / 139326731 / -1.0% 0.83 / 0.82 / +1.2%
tpch_q22/datafusion:parquet 51274211 / 52305168 / -2.0% 69942545 / 70624416 / -1.0% 0.73 / 0.74 / -1.0%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8667434 / 9606200 / -9.8% 17982933 / 18461690 / -2.6% 0.48 / 0.52 / -7.4%
tpch_q02/duckdb:vortex-file-compressed 15132632 / 15016122 / +0.8% 25609766 / 25864742 / -1.0% 0.59 / 0.58 / +1.8%
tpch_q03/duckdb:vortex-file-compressed 18271534 / 18281253 / -0.1% 34977073 / 33662003 / +3.9% 0.52 / 0.54 / -3.8%
tpch_q04/duckdb:vortex-file-compressed 12032766 / 12220664 / -1.5% 26190480 / 25824293 / +1.4% 0.46 / 0.47 / -2.9%
tpch_q05/duckdb:vortex-file-compressed 19747687 / 19905922 / -0.8% 36851529 / 35425173 / +4.0% 0.54 / 0.56 / -4.6%
tpch_q06/duckdb:vortex-file-compressed 4578017 / 4628873 / -1.1% 14327028 / 14372037 / -0.3% 0.32 / 0.32 / -0.8%
tpch_q07/duckdb:vortex-file-compressed 24139412 / 24043680 / +0.4% 41027098 / 41944672 / -2.2% 0.59 / 0.57 / +2.6%
tpch_q08/duckdb:vortex-file-compressed 20851616 / 20871334 / -0.1% 36182341 / 37204275 / -2.7% 0.58 / 0.56 / +2.7%
tpch_q09/duckdb:vortex-file-compressed 22390265 / 22171126 / +1.0% 41259431 / 37187932 / +10.9% 🔴 0.54 / 0.60 / -9.0%
tpch_q10/duckdb:vortex-file-compressed 26945612 / 26773208 / +0.6% 44772641 / 43596621 / +2.7% 0.60 / 0.61 / -2.0%
tpch_q11/duckdb:vortex-file-compressed 7950532 / 7866172 / +1.1% 17692528 / 17339608 / +2.0% 0.45 / 0.45 / -0.9%
tpch_q12/duckdb:vortex-file-compressed 14490299 / 14567462 / -0.5% 27139244 / 25764128 / +5.3% 0.53 / 0.57 / -5.6%
tpch_q13/duckdb:vortex-file-compressed 19742075 / 20019137 / -1.4% 32433131 / 31307327 / +3.6% 0.61 / 0.64 / -4.8%
tpch_q14/duckdb:vortex-file-compressed 11242649 / 11150794 / +0.8% 24933729 / 24346536 / +2.4% 0.45 / 0.46 / -1.6%
tpch_q15/duckdb:vortex-file-compressed 8346827 / 8216019 / +1.6% 19815476 / 19940462 / -0.6% 0.42 / 0.41 / +2.2%
tpch_q16/duckdb:vortex-file-compressed 16439406 / 16653416 / -1.3% 23143384 / 22634910 / +2.2% 0.71 / 0.74 / -3.5%
tpch_q17/duckdb:vortex-file-compressed 12555906 / 12676080 / -0.9% 27704595 / 29241180 / -5.3% 0.45 / 0.43 / +4.5%
tpch_q18/duckdb:vortex-file-compressed 24125729 / 24155535 / -0.1% 34873888 / 35689524 / -2.3% 0.69 / 0.68 / +2.2%
tpch_q19/duckdb:vortex-file-compressed 11181023 / 11514185 / -2.9% 26106865 / 27221407 / -4.1% 0.43 / 0.42 / +1.3%
tpch_q20/duckdb:vortex-file-compressed 14252719 / 14168524 / +0.6% 31070067 / 30361625 / +2.3% 0.46 / 0.47 / -1.7%
tpch_q21/duckdb:vortex-file-compressed 48440533 / 48848291 / -0.8% 65123249 / 65366193 / -0.4% 0.74 / 0.75 / -0.5%
tpch_q22/duckdb:vortex-file-compressed 16758906 / 16766180 / -0.0% 26260403 / 27101311 / -3.1% 0.64 / 0.62 / +3.2%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47453824 / 47584176 / -0.3% 54178563 / 53982090 / +0.4% 0.88 / 0.88 / -0.6%
tpch_q02/duckdb:parquet 48086466 / 48225492 / -0.3% 55229814 / 55395574 / -0.3% 0.87 / 0.87 / +0.0%
tpch_q03/duckdb:parquet 60090343 / 60132629 / -0.1% 68433195 / 67767642 / +1.0% 0.88 / 0.89 / -1.0%
tpch_q04/duckdb:parquet 34631668 / 34577125 / +0.2% 43474824 / 43277965 / +0.5% 0.80 / 0.80 / -0.3%
tpch_q05/duckdb:parquet 66940585 / 67047917 / -0.2% 77448489 / 77664085 / -0.3% 0.86 / 0.86 / +0.1%
tpch_q06/duckdb:parquet 21505703 / 21740112 / -1.1% 27717371 / 27685819 / +0.1% 0.78 / 0.79 / -1.2%
tpch_q07/duckdb:parquet 63873911 / 63769787 / +0.2% 73398303 / 72015594 / +1.9% 0.87 / 0.89 / -1.7%
tpch_q08/duckdb:parquet 75749176 / 75586813 / +0.2% 86736229 / 86587467 / +0.2% 0.87 / 0.87 / +0.0%
tpch_q09/duckdb:parquet 107669233 / 107251736 / +0.4% 119505767 / 118921601 / +0.5% 0.90 / 0.90 / -0.1%
tpch_q10/duckdb:parquet 105311374 / 105654449 / -0.3% 117361983 / 117358160 / +0.0% 0.90 / 0.90 / -0.3%
tpch_q11/duckdb:parquet 29209690 / 29414266 / -0.7% 34589564 / 35059347 / -1.3% 0.84 / 0.84 / +0.7%
tpch_q12/duckdb:parquet 37119101 / 37160654 / -0.1% 44168612 / 43751453 / +1.0% 0.84 / 0.85 / -1.1%
tpch_q13/duckdb:parquet 174814334 / 174082700 / +0.4% 180511969 / 182981854 / -1.3% 0.97 / 0.95 / +1.8%
tpch_q14/duckdb:parquet 42212551 / 42293043 / -0.2% 51026614 / 50628863 / +0.8% 0.83 / 0.84 / -1.0%
tpch_q15/duckdb:parquet 32588454 / 32491240 / +0.3% 40795416 / 41256233 / -1.1% 0.80 / 0.79 / +1.4%
tpch_q16/duckdb:parquet 47083379 / 47038362 / +0.1% 51952638 / 52272489 / -0.6% 0.91 / 0.90 / +0.7%
tpch_q17/duckdb:parquet 47833049 / 47792529 / +0.1% 57708872 / 57267515 / +0.8% 0.83 / 0.83 / -0.7%
tpch_q18/duckdb:parquet 73417836 / 73904873 / -0.7% 81032497 / 81029857 / +0.0% 0.91 / 0.91 / -0.7%
tpch_q19/duckdb:parquet 46947933 / 47466828 / -1.1% 59173327 / 60101850 / -1.5% 0.79 / 0.79 / +0.5%
tpch_q20/duckdb:parquet 63521611 / 63536099 / -0.0% 76427793 / 73605513 / +3.8% 0.83 / 0.86 / -3.7%
tpch_q21/duckdb:parquet 106656880 / 106320170 / +0.3% 116460340 / 116917987 / -0.4% 0.92 / 0.91 / +0.7%
tpch_q22/duckdb:parquet 50360297 / 50416101 / -0.1% 59277617 / 59564871 / -0.5% 0.85 / 0.85 / +0.4%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 0fbea339 vs base a1fbac67
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.021x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91873966 / 91461777 / +0.5% 155171830 / 152040173 / +2.1% 0.59 / 0.60 / -1.6%
tpch_q02/datafusion:vortex-file-compressed 65026895 / 65150600 / -0.2% 98341084 / 93349194 / +5.3% 0.66 / 0.70 / -5.3%
tpch_q03/datafusion:vortex-file-compressed 62324850 / 63604376 / -2.0% 124705805 / 118130203 / +5.6% 0.50 / 0.54 / -7.2%
tpch_q04/datafusion:vortex-file-compressed 34384080 / 34295407 / +0.3% 73428416 / 70536553 / +4.1% 0.47 / 0.49 / -3.7%
tpch_q05/datafusion:vortex-file-compressed 116945422 / 119364564 / -2.0% 195024174 / 182551149 / +6.8% 0.60 / 0.65 / -8.3%
tpch_q06/datafusion:vortex-file-compressed 9480195 / 9546368 / -0.7% 54123822 / 54436731 / -0.6% 0.18 / 0.18 / -0.1%
tpch_q07/datafusion:vortex-file-compressed 96969712 / 97262979 / -0.3% 160049838 / 161626600 / -1.0% 0.61 / 0.60 / +0.7%
tpch_q08/datafusion:vortex-file-compressed 142651738 / 142376708 / +0.2% 232512435 / 233260555 / -0.3% 0.61 / 0.61 / +0.5%
tpch_q09/datafusion:vortex-file-compressed 183645487 / 186248295 / -1.4% 263424799 / 269629050 / -2.3% 0.70 / 0.69 / +0.9%
tpch_q10/datafusion:vortex-file-compressed 70132944 / 71067964 / -1.3% 133141518 / 142466465 / -6.5% 0.53 / 0.50 / +5.6%
tpch_q11/datafusion:vortex-file-compressed 45987388 / 45560051 / +0.9% 72358332 / 73590875 / -1.7% 0.64 / 0.62 / +2.7%
tpch_q12/datafusion:vortex-file-compressed 35174730 / 35258096 / -0.2% 78025123 / 80954296 / -3.6% 0.45 / 0.44 / +3.5%
tpch_q13/datafusion:vortex-file-compressed 49962176 / 48642946 / +2.7% 83057211 / 80064407 / +3.7% 0.60 / 0.61 / -1.0%
tpch_q14/datafusion:vortex-file-compressed 20124619 / 20698377 / -2.8% 85365542 / 89002534 / -4.1% 0.24 / 0.23 / +1.4%
tpch_q15/datafusion:vortex-file-compressed 32618800 / 33697823 / -3.2% 91405950 / 93226341 / -2.0% 0.36 / 0.36 / -1.3%
tpch_q16/datafusion:vortex-file-compressed 36838993 / 36312583 / +1.4% 64657053 / 67846377 / -4.7% 0.57 / 0.54 / +6.5%
tpch_q17/datafusion:vortex-file-compressed 175904714 / 175352881 / +0.3% 224896396 / 238401885 / -5.7% 0.78 / 0.74 / +6.3%
tpch_q18/datafusion:vortex-file-compressed 203641459 / 204065535 / -0.2% 266130195 / 281285025 / -5.4% 0.77 / 0.73 / +5.5%
tpch_q19/datafusion:vortex-file-compressed 28441625 / 28642159 / -0.7% 85857748 / 81185246 / +5.8% 0.33 / 0.35 / -6.1%
tpch_q20/datafusion:vortex-file-compressed 60296368 / 61357991 / -1.7% 117270306 / 111640867 / +5.0% 0.51 / 0.55 / -6.4%
tpch_q21/datafusion:vortex-file-compressed 180960556 / 181322405 / -0.2% 235783786 / 234201105 / +0.7% 0.77 / 0.77 / -0.9%
tpch_q22/datafusion:vortex-file-compressed 25714417 / 25819872 / -0.4% 52403525 / 53907739 / -2.8% 0.49 / 0.48 / +2.5%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87483869 / 87414040 / +0.1% 129635894 / 129546947 / +0.1% 0.67 / 0.67 / +0.0%
tpch_q02/datafusion:parquet 173344769 / 172773330 / +0.3% 198507478 / 196404126 / +1.1% 0.87 / 0.88 / -0.7%
tpch_q03/datafusion:parquet 135719999 / 135360553 / +0.3% 186079373 / 182414690 / +2.0% 0.73 / 0.74 / -1.7%
tpch_q04/datafusion:parquet 57024261 / 56989447 / +0.1% 90732253 / 90229133 / +0.6% 0.63 / 0.63 / -0.5%
tpch_q05/datafusion:parquet 167044548 / 167192678 / -0.1% 222542871 / 224096978 / -0.7% 0.75 / 0.75 / +0.6%
tpch_q06/datafusion:parquet 36288104 / 36387327 / -0.3% 79969503 / 78666242 / +1.7% 0.45 / 0.46 / -1.9%
tpch_q07/datafusion:parquet 214912426 / 215591386 / -0.3% 281809065 / 272313472 / +3.5% 0.76 / 0.79 / -3.7%
tpch_q08/datafusion:parquet 216370089 / 217512386 / -0.5% 287225254 / 285689398 / +0.5% 0.75 / 0.76 / -1.1%
tpch_q09/datafusion:parquet 308173040 / 308833726 / -0.2% 383484728 / 380711309 / +0.7% 0.80 / 0.81 / -0.9%
tpch_q10/datafusion:parquet 311461798 / 311324882 / +0.0% 375231693 / 372320687 / +0.8% 0.83 / 0.84 / -0.7%
tpch_q11/datafusion:parquet 126860126 / 128939736 / -1.6% 149698192 / 149976767 / -0.2% 0.85 / 0.86 / -1.4%
tpch_q12/datafusion:parquet 82122279 / 82729779 / -0.7% 120877944 / 120038996 / +0.7% 0.68 / 0.69 / -1.4%
tpch_q13/datafusion:parquet 210322142 / 209991148 / +0.2% 241661268 / 239441721 / +0.9% 0.87 / 0.88 / -0.8%
tpch_q14/datafusion:parquet 86970363 / 86171921 / +0.9% 203286498 / 200700805 / +1.3% 0.43 / 0.43 / -0.4%
tpch_q15/datafusion:parquet 105920313 / 105275207 / +0.6% 161922012 / 154815947 / +4.6% 0.65 / 0.68 / -3.8%
tpch_q16/datafusion:parquet 95450321 / 96448282 / -1.0% 118403236 / 122285536 / -3.2% 0.81 / 0.79 / +2.2%
tpch_q17/datafusion:parquet 214077527 / 214261393 / -0.1% 266043400 / 265413583 / +0.2% 0.80 / 0.81 / -0.3%
tpch_q18/datafusion:parquet 269671782 / 266285159 / +1.3% 314206237 / 309860730 / +1.4% 0.86 / 0.86 / -0.1%
tpch_q19/datafusion:parquet 107772342 / 108236185 / -0.4% 176899703 / 169788852 / +4.2% 0.61 / 0.64 / -4.4%
tpch_q20/datafusion:parquet 185840338 / 185745898 / +0.1% 259232800 / 249469329 / +3.9% 0.72 / 0.74 / -3.7%
tpch_q21/datafusion:parquet 242283332 / 245324385 / -1.2% 305967011 / 313914343 / -2.5% 0.79 / 0.78 / +1.3%
tpch_q22/datafusion:parquet 149752725 / 150095416 / -0.2% 174246886 / 171119224 / +1.8% 0.86 / 0.88 / -2.0%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33085420 / 32325099 / +2.4% 67086268 / 72402987 / -7.3% 0.49 / 0.45 / +10.5%
tpch_q02/duckdb:vortex-file-compressed 28103682 / 28222681 / -0.4% 43931065 / 42834009 / +2.6% 0.64 / 0.66 / -2.9%
tpch_q03/duckdb:vortex-file-compressed 52047621 / 51575411 / +0.9% 104453712 / 105007113 / -0.5% 0.50 / 0.49 / +1.5%
tpch_q04/duckdb:vortex-file-compressed 50667432 / 51649041 / -1.9% 89593311 / 89123029 / +0.5% 0.57 / 0.58 / -2.4%
tpch_q05/duckdb:vortex-file-compressed 68299411 / 68616413 / -0.5% 109484245 / 109473236 / +0.0% 0.62 / 0.63 / -0.5%
tpch_q06/duckdb:vortex-file-compressed 14669590 / 14707751 / -0.3% 49370615 / 49904418 / -1.1% 0.30 / 0.29 / +0.8%
tpch_q07/duckdb:vortex-file-compressed 53543048 / 54348597 / -1.5% 107893713 / 108127641 / -0.2% 0.50 / 0.50 / -1.3%
tpch_q08/duckdb:vortex-file-compressed 85632466 / 84104770 / +1.8% 128473833 / 130975152 / -1.9% 0.67 / 0.64 / +3.8%
tpch_q09/duckdb:vortex-file-compressed 101681952 / 102378068 / -0.7% 165004573 / 154455544 / +6.8% 0.62 / 0.66 / -7.0%
tpch_q10/duckdb:vortex-file-compressed 95584291 / 97301636 / -1.8% 151999037 / 154148776 / -1.4% 0.63 / 0.63 / -0.4%
tpch_q11/duckdb:vortex-file-compressed 13472592 / 13064905 / +3.1% 27015957 / 28384395 / -4.8% 0.50 / 0.46 / +8.3%
tpch_q12/duckdb:vortex-file-compressed 45055404 / 44490160 / +1.3% 81847599 / 84041462 / -2.6% 0.55 / 0.53 / +4.0%
tpch_q13/duckdb:vortex-file-compressed 71346080 / 71289560 / +0.1% 99848440 / 100479650 / -0.6% 0.71 / 0.71 / +0.7%
tpch_q14/duckdb:vortex-file-compressed 27419395 / 27717049 / -1.1% 73347627 / 74538284 / -1.6% 0.37 / 0.37 / +0.5%
tpch_q15/duckdb:vortex-file-compressed 23664068 / 23959499 / -1.2% 64561812 / 65090822 / -0.8% 0.37 / 0.37 / -0.4%
tpch_q16/duckdb:vortex-file-compressed 48745917 / 48469377 / +0.6% 59007869 / 58756128 / +0.4% 0.83 / 0.82 / +0.1%
tpch_q17/duckdb:vortex-file-compressed 34510185 / 34666050 / -0.4% 63493581 / 65490818 / -3.0% 0.54 / 0.53 / +2.7%
tpch_q18/duckdb:vortex-file-compressed 105586049 / 104983522 / +0.6% 121625264 / 123498749 / -1.5% 0.87 / 0.85 / +2.1%
tpch_q19/duckdb:vortex-file-compressed 26138918 / 27557954 / -5.1% 73968644 / 73826153 / +0.2% 0.35 / 0.37 / -5.3%
tpch_q20/duckdb:vortex-file-compressed 40592018 / 41363264 / -1.9% 94420723 / 95092076 / -0.7% 0.43 / 0.43 / -1.2%
tpch_q21/duckdb:vortex-file-compressed 92720846 / 94528498 / -1.9% 146121415 / 148616412 / -1.7% 0.63 / 0.64 / -0.2%
tpch_q22/duckdb:vortex-file-compressed 32967948 / 32904651 / +0.2% 50489202 / 49012299 / +3.0% 0.65 / 0.67 / -2.7%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67742234 / 67947029 / -0.3% 96814320 / 91822789 / +5.4% 0.70 / 0.74 / -5.4%
tpch_q02/duckdb:parquet 86497703 / 86989369 / -0.6% 97665120 / 98244758 / -0.6% 0.89 / 0.89 / +0.0%
tpch_q03/duckdb:parquet 109828970 / 110185436 / -0.3% 154900845 / 149262603 / +3.8% 0.71 / 0.74 / -4.0%
tpch_q04/duckdb:parquet 75980025 / 76511890 / -0.7% 105095126 / 99993055 / +5.1% 0.72 / 0.77 / -5.5%
tpch_q05/duckdb:parquet 123467011 / 123561736 / -0.1% 164627322 / 157814354 / +4.3% 0.75 / 0.78 / -4.2%
tpch_q06/duckdb:parquet 35750021 / 35131677 / +1.8% 78468919 / 61656118 / +27.3% 🔴 0.46 / 0.57 / -20.0%
tpch_q07/duckdb:parquet 117162116 / 116987617 / +0.1% 158667835 / 156949610 / +1.1% 0.74 / 0.75 / -0.9%
tpch_q08/duckdb:parquet 148069541 / 147149868 / +0.6% 201463212 / 196980622 / +2.3% 0.73 / 0.75 / -1.6%
tpch_q09/duckdb:parquet 236517380 / 236026211 / +0.2% 288364962 / 282251691 / +2.2% 0.82 / 0.84 / -1.9%
tpch_q10/duckdb:parquet 315770856 / 312838050 / +0.9% 343003936 / 340171595 / +0.8% 0.92 / 0.92 / +0.1%
tpch_q11/duckdb:parquet 43434338 / 43452075 / -0.0% 50764826 / 50682588 / +0.2% 0.86 / 0.86 / -0.2%
tpch_q12/duckdb:parquet 71242320 / 70814666 / +0.6% 96514578 / 93902944 / +2.8% 0.74 / 0.75 / -2.1%
tpch_q13/duckdb:parquet 292273536 / 290323332 / +0.7% 306166609 / 307095813 / -0.3% 0.95 / 0.95 / +1.0%
tpch_q14/duckdb:parquet 102136997 / 100343677 / +1.8% 153713626 / 146303875 / +5.1% 0.66 / 0.69 / -3.1%
tpch_q15/duckdb:parquet 57245993 / 58168506 / -1.6% 91150871 / 86545506 / +5.3% 0.63 / 0.67 / -6.6%
tpch_q16/duckdb:parquet 100358874 / 99630311 / +0.7% 107215362 / 106701950 / +0.5% 0.94 / 0.93 / +0.2%
tpch_q17/duckdb:parquet 81343284 / 81679246 / -0.4% 124117055 / 116985216 / +6.1% 0.66 / 0.70 / -6.1%
tpch_q18/duckdb:parquet 156316800 / 155654918 / +0.4% 159184205 / 173475131 / -8.2% 0.98 / 0.90 / +9.4%
tpch_q19/duckdb:parquet 97741268 / 97628046 / +0.1% 135625030 / 136182506 / -0.4% 0.72 / 0.72 / +0.5%
tpch_q20/duckdb:parquet 147439488 / 146630543 / +0.6% 204508897 / 187669429 / +9.0% 0.72 / 0.78 / -7.7%
tpch_q21/duckdb:parquet 253868324 / 255660512 / -0.7% 284625713 / 275767145 / +3.2% 0.89 / 0.93 / -3.8%
tpch_q22/duckdb:parquet 168439386 / 167970193 / +0.3% 180073292 / 180252325 / -0.1% 0.94 / 0.93 / +0.4%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 0fbea339 vs base a1fbac67
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21910400 / 21904800 / +0.0% 40681095 / 41431503 / -1.8% 0.54 / 0.53 / +1.9%
tpcds_q02/datafusion:vortex-file-compressed 42903734 / 42554688 / +0.8% 65540437 / 64169393 / +2.1% 0.65 / 0.66 / -1.3%
tpcds_q03/datafusion:vortex-file-compressed 11712236 / 11470734 / +2.1% 28133132 / 28754889 / -2.2% 0.42 / 0.40 / +4.4%
tpcds_q04/datafusion:vortex-file-compressed 80866400 / 81602406 / -0.9% 110385692 / 111310572 / -0.8% 0.73 / 0.73 / -0.1%
tpcds_q05/datafusion:vortex-file-compressed 56650642 / 59287945 / -4.4% 79621438 / 78830185 / +1.0% 0.71 / 0.75 / -5.4%
tpcds_q06/datafusion:vortex-file-compressed 21269562 / 21867222 / -2.7% 42263362 / 42387921 / -0.3% 0.50 / 0.52 / -2.4%
tpcds_q07/datafusion:vortex-file-compressed 26514099 / 26602154 / -0.3% 50895150 / 50329718 / +1.1% 0.52 / 0.53 / -1.4%
tpcds_q08/datafusion:vortex-file-compressed 25069404 / 25910354 / -3.2% 46556871 / 45890880 / +1.5% 0.54 / 0.56 / -4.6%
tpcds_q09/datafusion:vortex-file-compressed 19763088 / 20003748 / -1.2% 36557313 / 37458089 / -2.4% 0.54 / 0.53 / +1.2%
tpcds_q10/datafusion:vortex-file-compressed 29313149 / 30191318 / -2.9% 52836602 / 52373171 / +0.9% 0.55 / 0.58 / -3.8%
tpcds_q11/datafusion:vortex-file-compressed 48621944 / 49085926 / -0.9% 76126111 / 76401580 / -0.4% 0.64 / 0.64 / -0.6%
tpcds_q12/datafusion:vortex-file-compressed 15140510 / 15378738 / -1.5% 33131282 / 32245228 / +2.7% 0.46 / 0.48 / -4.2%
tpcds_q13/datafusion:vortex-file-compressed 30397133 / 31905504 / -4.7% 56712363 / 56649829 / +0.1% 0.54 / 0.56 / -4.8%
tpcds_q14/datafusion:vortex-file-compressed 486774518 / 490516104 / -0.8% 549713240 / 544769656 / +0.9% 0.89 / 0.90 / -1.7%
tpcds_q15/datafusion:vortex-file-compressed 12582342 / 12373631 / +1.7% 33262267 / 32389583 / +2.7% 0.38 / 0.38 / -1.0%
tpcds_q16/datafusion:vortex-file-compressed 18889757 / 18744374 / +0.8% 39033182 / 39916699 / -2.2% 0.48 / 0.47 / +3.1%
tpcds_q17/datafusion:vortex-file-compressed 53402803 / 53598500 / -0.4% 74135849 / 76874378 / -3.6% 0.72 / 0.70 / +3.3%
tpcds_q18/datafusion:vortex-file-compressed 62710364 / 63579358 / -1.4% 92666319 / 92269128 / +0.4% 0.68 / 0.69 / -1.8%
tpcds_q19/datafusion:vortex-file-compressed 17176098 / 17553042 / -2.1% 39976626 / 41513087 / -3.7% 0.43 / 0.42 / +1.6%
tpcds_q20/datafusion:vortex-file-compressed 16625938 / 16381258 / +1.5% 34115316 / 35049919 / -2.7% 0.49 / 0.47 / +4.3%
tpcds_q21/datafusion:vortex-file-compressed 15396483 / 16444412 / -6.4% 32008242 / 33805593 / -5.3% 0.48 / 0.49 / -1.1%
tpcds_q22/datafusion:vortex-file-compressed 49156496 / 49824685 / -1.3% 70592742 / 70927107 / -0.5% 0.70 / 0.70 / -0.9%
tpcds_q23/datafusion:vortex-file-compressed 72111796 / 71177708 / +1.3% 95602658 / 97569152 / -2.0% 0.75 / 0.73 / +3.4%
tpcds_q24/datafusion:vortex-file-compressed 63612862 / 63915018 / -0.5% 89504557 / 86844067 / +3.1% 0.71 / 0.74 / -3.4%
tpcds_q25/datafusion:vortex-file-compressed 45378072 / 45966268 / -1.3% 70101522 / 68605944 / +2.2% 0.65 / 0.67 / -3.4%
tpcds_q26/datafusion:vortex-file-compressed 26407024 / 26827442 / -1.6% 45367021 / 45402017 / -0.1% 0.58 / 0.59 / -1.5%
tpcds_q27/datafusion:vortex-file-compressed 52732136 / 53290865 / -1.0% 74556320 / 74008255 / +0.7% 0.71 / 0.72 / -1.8%
tpcds_q28/datafusion:vortex-file-compressed 18733840 / 19240791 / -2.6% 38517829 / 40225849 / -4.2% 0.49 / 0.48 / +1.7%
tpcds_q29/datafusion:vortex-file-compressed 52108698 / 51555765 / +1.1% 66266226 / 68516736 / -3.3% 0.79 / 0.75 / +4.5%
tpcds_q30/datafusion:vortex-file-compressed 27254062 / 27675000 / -1.5% 47695482 / 48154307 / -1.0% 0.57 / 0.57 / -0.6%
tpcds_q31/datafusion:vortex-file-compressed 62867422 / 62746342 / +0.2% 90739265 / 90127965 / +0.7% 0.69 / 0.70 / -0.5%
tpcds_q32/datafusion:vortex-file-compressed 12968294 / 13034590 / -0.5% 31045003 / 31312466 / -0.9% 0.42 / 0.42 / +0.3%
tpcds_q33/datafusion:vortex-file-compressed 27911410 / 27786993 / +0.4% 52599522 / 50060902 / +5.1% 0.53 / 0.56 / -4.4%
tpcds_q34/datafusion:vortex-file-compressed 17414386 / 17666615 / -1.4% 37106512 / 35973092 / +3.2% 0.47 / 0.49 / -4.4%
tpcds_q35/datafusion:vortex-file-compressed 30950458 / 30642022 / +1.0% 55036254 / 55442805 / -0.7% 0.56 / 0.55 / +1.8%
tpcds_q36/datafusion:vortex-file-compressed 46990770 / 47490320 / -1.1% 68099470 / 67004549 / +1.6% 0.69 / 0.71 / -2.6%
tpcds_q37/datafusion:vortex-file-compressed 13061997 / 12314070 / +6.1% 35640448 / 35641325 / -0.0% 0.37 / 0.35 / +6.1%
tpcds_q38/datafusion:vortex-file-compressed 26343086 / 26404932 / -0.2% 48190161 / 48826459 / -1.3% 0.55 / 0.54 / +1.1%
tpcds_q39/datafusion:vortex-file-compressed 65546874 / 64438124 / +1.7% 89319045 / 89353796 / -0.0% 0.73 / 0.72 / +1.8%
tpcds_q40/datafusion:vortex-file-compressed 22652129 / 23385256 / -3.1% 40942388 / 41018372 / -0.2% 0.55 / 0.57 / -3.0%
tpcds_q41/datafusion:vortex-file-compressed 20200146 / 19934694 / +1.3% 32348079 / 32400272 / -0.2% 0.62 / 0.62 / +1.5%
tpcds_q42/datafusion:vortex-file-compressed 11552507 / 11564425 / -0.1% 27351327 / 28881907 / -5.3% 0.42 / 0.40 / +5.5%
tpcds_q43/datafusion:vortex-file-compressed 13592378 / 13354664 / +1.8% 34200483 / 34482910 / -0.8% 0.40 / 0.39 / +2.6%
tpcds_q44/datafusion:vortex-file-compressed 27484944 / 27760103 / -1.0% 52436540 / 52399411 / +0.1% 0.52 / 0.53 / -1.1%
tpcds_q45/datafusion:vortex-file-compressed 17657609 / 17177647 / +2.8% 36847436 / 34966512 / +5.4% 0.48 / 0.49 / -2.5%
tpcds_q46/datafusion:vortex-file-compressed 23427298 / 23641350 / -0.9% 47098779 / 47268851 / -0.4% 0.50 / 0.50 / -0.5%
tpcds_q47/datafusion:vortex-file-compressed 74891411 / 74911510 / -0.0% 105813334 / 108196139 / -2.2% 0.71 / 0.69 / +2.2%
tpcds_q48/datafusion:vortex-file-compressed 28485274 / 28298567 / +0.7% 52981176 / 53547151 / -1.1% 0.54 / 0.53 / +1.7%
tpcds_q49/datafusion:vortex-file-compressed 59752545 / 57603198 / +3.7% 77217629 / 80645803 / -4.3% 0.77 / 0.71 / +8.3%
tpcds_q50/datafusion:vortex-file-compressed 30112594 / 31202134 / -3.5% 51797056 / 52991413 / -2.3% 0.58 / 0.59 / -1.3%
tpcds_q51/datafusion:vortex-file-compressed 67149222 / 66860742 / +0.4% 89768812 / 91703431 / -2.1% 0.75 / 0.73 / +2.6%
tpcds_q52/datafusion:vortex-file-compressed 11995860 / 12316191 / -2.6% 29454950 / 30131969 / -2.2% 0.41 / 0.41 / -0.4%
tpcds_q53/datafusion:vortex-file-compressed 18201565 / 18515549 / -1.7% 41250523 / 39243545 / +5.1% 0.44 / 0.47 / -6.5%
tpcds_q54/datafusion:vortex-file-compressed 31729976 / 32172078 / -1.4% 55364699 / 54207655 / +2.1% 0.57 / 0.59 / -3.4%
tpcds_q55/datafusion:vortex-file-compressed 11438149 / 11582911 / -1.2% 27886638 / 28196674 / -1.1% 0.41 / 0.41 / -0.2%
tpcds_q56/datafusion:vortex-file-compressed 26970673 / 27102338 / -0.5% 47573153 / 48875491 / -2.7% 0.57 / 0.55 / +2.2%
tpcds_q57/datafusion:vortex-file-compressed 61663555 / 61855076 / -0.3% 86971089 / 88945063 / -2.2% 0.71 / 0.70 / +2.0%
tpcds_q58/datafusion:vortex-file-compressed 40336390 / 40456852 / -0.3% 69150677 / 67462177 / +2.5% 0.58 / 0.60 / -2.7%
tpcds_q59/datafusion:vortex-file-compressed 27692116 / 27901158 / -0.7% 54027916 / 54059604 / -0.1% 0.51 / 0.52 / -0.7%
tpcds_q60/datafusion:vortex-file-compressed 26347092 / 26811740 / -1.7% 48265277 / 47553306 / +1.5% 0.55 / 0.56 / -3.2%
tpcds_q61/datafusion:vortex-file-compressed 20262059 / 20527437 / -1.3% 42934721 / 42934235 / +0.0% 0.47 / 0.48 / -1.3%
tpcds_q62/datafusion:vortex-file-compressed 16722152 / 16509221 / +1.3% 35843618 / 35797617 / +0.1% 0.47 / 0.46 / +1.2%
tpcds_q63/datafusion:vortex-file-compressed 18144558 / 18063288 / +0.4% 39924369 / 37935138 / +5.2% 0.45 / 0.48 / -4.6%
tpcds_q64/datafusion:vortex-file-compressed 188124705 / 189170317 / -0.6% 220144849 / 222152094 / -0.9% 0.85 / 0.85 / +0.4%
tpcds_q65/datafusion:vortex-file-compressed 72829633 / 73781476 / -1.3% 96877996 / 97016607 / -0.1% 0.75 / 0.76 / -1.1%
tpcds_q66/datafusion:vortex-file-compressed 49954888 / 50175974 / -0.4% 71588982 / 70422685 / +1.7% 0.70 / 0.71 / -2.1%
tpcds_q67/datafusion:vortex-file-compressed 51222670 / 51168200 / +0.1% 85860618 / 85198994 / +0.8% 0.60 / 0.60 / -0.7%
tpcds_q68/datafusion:vortex-file-compressed 22779492 / 22962913 / -0.8% 46305467 / 47439632 / -2.4% 0.49 / 0.48 / +1.6%
tpcds_q69/datafusion:vortex-file-compressed 27763028 / 27357096 / +1.5% 49067666 / 51626623 / -5.0% 0.57 / 0.53 / +6.8%
tpcds_q70/datafusion:vortex-file-compressed 73355117 / 73670679 / -0.4% 99184762 / 95960288 / +3.4% 0.74 / 0.77 / -3.7%
tpcds_q71/datafusion:vortex-file-compressed 19067608 / 19364228 / -1.5% 39889572 / 41347646 / -3.5% 0.48 / 0.47 / +2.1%
tpcds_q72/datafusion:vortex-file-compressed 255816456 / 282942756 / -9.6% 318239982 / 282733491 / +12.6% 🔴 0.80 / 1.00 / -19.7%
tpcds_q73/datafusion:vortex-file-compressed 16199228 / 16541782 / -2.1% 37762907 / 38145219 / -1.0% 0.43 / 0.43 / -1.1%
tpcds_q74/datafusion:vortex-file-compressed 40665266 / 40784266 / -0.3% 67391243 / 67049365 / +0.5% 0.60 / 0.61 / -0.8%
tpcds_q75/datafusion:vortex-file-compressed 134166256 / 138469764 / -3.1% 163984909 / 157100118 / +4.4% 0.82 / 0.88 / -7.2%
tpcds_q76/datafusion:vortex-file-compressed 29360939 / 29480684 / -0.4% 49678109 / 48698255 / +2.0% 0.59 / 0.61 / -2.4%
tpcds_q77/datafusion:vortex-file-compressed 44747590 / 44913822 / -0.4% 68715915 / 69000116 / -0.4% 0.65 / 0.65 / +0.0%
tpcds_q78/datafusion:vortex-file-compressed 61089846 / 60813381 / +0.5% 89806640 / 90833093 / -1.1% 0.68 / 0.67 / +1.6%
tpcds_q79/datafusion:vortex-file-compressed 20055626 / 19982420 / +0.4% 41890947 / 43538981 / -3.8% 0.48 / 0.46 / +4.3%
tpcds_q80/datafusion:vortex-file-compressed 69059002 / 69460408 / -0.6% 96750313 / 93989196 / +2.9% 0.71 / 0.74 / -3.4%
tpcds_q81/datafusion:vortex-file-compressed 27699956 / 28045359 / -1.2% 46180413 / 46423478 / -0.5% 0.60 / 0.60 / -0.7%
tpcds_q82/datafusion:vortex-file-compressed 12413559 / 12630028 / -1.7% 35386514 / 36470350 / -3.0% 0.35 / 0.35 / +1.3%
tpcds_q83/datafusion:vortex-file-compressed 35385598 / 35314962 / +0.2% 56282524 / 54016924 / +4.2% 0.63 / 0.65 / -3.8%
tpcds_q84/datafusion:vortex-file-compressed 10859922 / 10330708 / +5.1% 27419440 / 28061582 / -2.3% 0.40 / 0.37 / +7.6%
tpcds_q85/datafusion:vortex-file-compressed 51858752 / 52098922 / -0.5% 78204290 / 78332845 / -0.2% 0.66 / 0.67 / -0.3%
tpcds_q86/datafusion:vortex-file-compressed 16039094 / 16413742 / -2.3% 35998792 / 34977342 / +2.9% 0.45 / 0.47 / -5.1%
tpcds_q87/datafusion:vortex-file-compressed 26554428 / 26374569 / +0.7% 49021932 / 49744079 / -1.5% 0.54 / 0.53 / +2.2%
tpcds_q88/datafusion:vortex-file-compressed 31849810 / 31944483 / -0.3% 52126672 / 49602465 / +5.1% 0.61 / 0.64 / -5.1%
tpcds_q89/datafusion:vortex-file-compressed 21408262 / 21456602 / -0.2% 43185500 / 43063840 / +0.3% 0.50 / 0.50 / -0.5%
tpcds_q90/datafusion:vortex-file-compressed 10334140 / 10681326 / -3.3% 26076160 / 26508354 / -1.6% 0.40 / 0.40 / -1.6%
tpcds_q91/datafusion:vortex-file-compressed 15846986 / 15770873 / +0.5% 37203590 / 37993267 / -2.1% 0.43 / 0.42 / +2.6%
tpcds_q92/datafusion:vortex-file-compressed 13402665 / 13365811 / +0.3% 33309488 / 31177789 / +6.8% 0.40 / 0.43 / -6.1%
tpcds_q93/datafusion:vortex-file-compressed 20009002 / 19991404 / +0.1% 41325069 / 42322308 / -2.4% 0.48 / 0.47 / +2.5%
tpcds_q94/datafusion:vortex-file-compressed 18549022 / 18559548 / -0.1% 38917467 / 40537382 / -4.0% 0.48 / 0.46 / +4.1%
tpcds_q95/datafusion:vortex-file-compressed 41643557 / 41532646 / +0.3% 62300324 / 62668588 / -0.6% 0.67 / 0.66 / +0.9%
tpcds_q96/datafusion:vortex-file-compressed 7727336 / 7605406 / +1.6% 26129353 / 26033294 / +0.4% 0.30 / 0.29 / +1.2%
tpcds_q97/datafusion:vortex-file-compressed 17250804 / 17518920 / -1.5% 39914565 / 40234482 / -0.8% 0.43 / 0.44 / -0.7%
tpcds_q98/datafusion:vortex-file-compressed 16171372 / 16436132 / -1.6% 35704845 / 36197376 / -1.4% 0.45 / 0.45 / -0.3%
tpcds_q99/datafusion:vortex-file-compressed 16066280 / 16406349 / -2.1% 34403842 / 35127573 / -2.1% 0.47 / 0.47 / -0.0%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41172477 / 42934234 / -4.1% 60897156 / 61494106 / -1.0% 0.68 / 0.70 / -3.2%
tpcds_q02/datafusion:parquet 54886390 / 55520197 / -1.1% 70901270 / 72574197 / -2.3% 0.77 / 0.77 / +1.2%
tpcds_q03/datafusion:parquet 18828961 / 18974839 / -0.8% 32799110 / 32165358 / +2.0% 0.57 / 0.59 / -2.7%
tpcds_q04/datafusion:parquet 177050772 / 178849752 / -1.0% 203263776 / 204682079 / -0.7% 0.87 / 0.87 / -0.3%
tpcds_q05/datafusion:parquet 68553826 / 68186313 / +0.5% 88657139 / 91065225 / -2.6% 0.77 / 0.75 / +3.3%
tpcds_q06/datafusion:parquet 33230048 / 33465509 / -0.7% 49423918 / 48781400 / +1.3% 0.67 / 0.69 / -2.0%
tpcds_q07/datafusion:parquet 46235368 / 47200548 / -2.0% 64756689 / 63374990 / +2.2% 0.71 / 0.74 / -4.1%
tpcds_q08/datafusion:parquet 31350400 / 31459043 / -0.3% 48414638 / 46740755 / +3.6% 0.65 / 0.67 / -3.8%
tpcds_q09/datafusion:parquet 32759220 / 32926696 / -0.5% 39502429 / 44827213 / -11.9% 🟢 0.83 / 0.73 / +12.9%
tpcds_q10/datafusion:parquet 43732882 / 44315386 / -1.3% 59855343 / 59359639 / +0.8% 0.73 / 0.75 / -2.1%
tpcds_q11/datafusion:parquet 96039565 / 96336563 / -0.3% 121280873 / 120325215 / +0.8% 0.79 / 0.80 / -1.1%
tpcds_q12/datafusion:parquet 23424684 / 23701000 / -1.2% 37357796 / 36242853 / +3.1% 0.63 / 0.65 / -4.1%
tpcds_q13/datafusion:parquet 46357868 / 46792320 / -0.9% 70020332 / 68546957 / +2.1% 0.66 / 0.68 / -3.0%
tpcds_q14/datafusion:parquet 534395333 / 540522645 / -1.1% 587785641 / 582197608 / +1.0% 0.91 / 0.93 / -2.1%
tpcds_q15/datafusion:parquet 23716862 / 23663158 / +0.2% 39105770 / 38544526 / +1.5% 0.61 / 0.61 / -1.2%
tpcds_q16/datafusion:parquet 37079184 / 36872738 / +0.6% 51386003 / 51209866 / +0.3% 0.72 / 0.72 / +0.2%
tpcds_q17/datafusion:parquet 72422880 / 72564482 / -0.2% 103111078 / 95881659 / +7.5% 0.70 / 0.76 / -7.2%
tpcds_q18/datafusion:parquet 65797207 / 68122830 / -3.4% 88978525 / 88836017 / +0.2% 0.74 / 0.77 / -3.6%
tpcds_q19/datafusion:parquet 29400699 / 29662360 / -0.9% 45417305 / 44127439 / +2.9% 0.65 / 0.67 / -3.7%
tpcds_q20/datafusion:parquet 25532248 / 24961735 / +2.3% 39068431 / 38575611 / +1.3% 0.65 / 0.65 / +1.0%
tpcds_q21/datafusion:parquet 20019088 / 20114379 / -0.5% 32223238 / 35471144 / -9.2% 0.62 / 0.57 / +9.6%
tpcds_q22/datafusion:parquet 77266857 / 77355861 / -0.1% 90047004 / 89515134 / +0.6% 0.86 / 0.86 / -0.7%
tpcds_q23/datafusion:parquet 93622524 / 91431288 / +2.4% 111341598 / 113499685 / -1.9% 0.84 / 0.81 / +4.4%
tpcds_q24/datafusion:parquet 90069180 / 91040348 / -1.1% 114588260 / 115099780 / -0.4% 0.79 / 0.79 / -0.6%
tpcds_q25/datafusion:parquet 80367270 / 81093493 / -0.9% 100923379 / 97539690 / +3.5% 0.80 / 0.83 / -4.2%
tpcds_q26/datafusion:parquet 43157655 / 43696248 / -1.2% 61398988 / 60943533 / +0.7% 0.70 / 0.72 / -2.0%
tpcds_q27/datafusion:parquet 79495893 / 75233912 / +5.7% 97429095 / 93429919 / +4.3% 0.82 / 0.81 / +1.3%
tpcds_q28/datafusion:parquet 28407440 / 28659182 / -0.9% 43456671 / 43461748 / -0.0% 0.65 / 0.66 / -0.9%
tpcds_q29/datafusion:parquet 75601424 / 75977194 / -0.5% 100751759 / 98235281 / +2.6% 0.75 / 0.77 / -3.0%
tpcds_q30/datafusion:parquet 42578584 / 45870200 / -7.2% 60452930 / 61819653 / -2.2% 0.70 / 0.74 / -5.1%
tpcds_q31/datafusion:parquet 79957131 / 79071612 / +1.1% 98103664 / 100807659 / -2.7% 0.82 / 0.78 / +3.9%
tpcds_q32/datafusion:parquet 26450138 / 26282745 / +0.6% 41827933 / 41185784 / +1.6% 0.63 / 0.64 / -0.9%
tpcds_q33/datafusion:parquet 38572827 / 38415689 / +0.4% 54681642 / 52996018 / +3.2% 0.71 / 0.72 / -2.7%
tpcds_q34/datafusion:parquet 24414106 / 24191854 / +0.9% 37073446 / 35789781 / +3.6% 0.66 / 0.68 / -2.6%
tpcds_q35/datafusion:parquet 50518130 / 51975162 / -2.8% 64508346 / 64664118 / -0.2% 0.78 / 0.80 / -2.6%
tpcds_q36/datafusion:parquet 52455978 / 52116968 / +0.7% 70631618 / 75118995 / -6.0% 0.74 / 0.69 / +7.0%
tpcds_q37/datafusion:parquet 21290138 / 21597429 / -1.4% 35639344 / 33925430 / +5.1% 0.60 / 0.64 / -6.2%
tpcds_q38/datafusion:parquet 44962114 / 44390870 / +1.3% 63439534 / 62886834 / +0.9% 0.71 / 0.71 / +0.4%
tpcds_q39/datafusion:parquet 68715769 / 68971004 / -0.4% 87499859 / 82903826 / +5.5% 0.79 / 0.83 / -5.6%
tpcds_q40/datafusion:parquet 28937367 / 30483250 / -5.1% 51755437 / 50399848 / +2.7% 0.56 / 0.60 / -7.6%
tpcds_q41/datafusion:parquet 19827318 / 19917396 / -0.5% 33107329 / 32206019 / +2.8% 0.60 / 0.62 / -3.2%
tpcds_q42/datafusion:parquet 18197220 / 18227916 / -0.2% 29736002 / 30867544 / -3.7% 0.61 / 0.59 / +3.6%
tpcds_q43/datafusion:parquet 19254542 / 19523289 / -1.4% 33241920 / 32938774 / +0.9% 0.58 / 0.59 / -2.3%
tpcds_q44/datafusion:parquet 35656539 / 35488766 / +0.5% 50336448 / 50862873 / -1.0% 0.71 / 0.70 / +1.5%
tpcds_q45/datafusion:parquet 28080314 / 28079029 / +0.0% 40960613 / 40185226 / +1.9% 0.69 / 0.70 / -1.9%
tpcds_q46/datafusion:parquet 28729212 / 28634012 / +0.3% 45519241 / 46816222 / -2.8% 0.63 / 0.61 / +3.2%
tpcds_q47/datafusion:parquet 97413624 / 97639136 / -0.2% 118232215 / 120283519 / -1.7% 0.82 / 0.81 / +1.5%
tpcds_q48/datafusion:parquet 42256886 / 42102848 / +0.4% 60450401 / 58497097 / +3.3% 0.70 / 0.72 / -2.9%
tpcds_q49/datafusion:parquet 71135470 / 71125603 / +0.0% 91436498 / 99638391 / -8.2% 0.78 / 0.71 / +9.0%
tpcds_q50/datafusion:parquet 46542903 / 47157688 / -1.3% 66738316 / 66779886 / -0.1% 0.70 / 0.71 / -1.2%
tpcds_q51/datafusion:parquet 75456608 / 75746528 / -0.4% 95433402 / 94645170 / +0.8% 0.79 / 0.80 / -1.2%
tpcds_q52/datafusion:parquet 18610950 / 18555163 / +0.3% 30697621 / 32528256 / -5.6% 0.61 / 0.57 / +6.3%
tpcds_q53/datafusion:parquet 22260603 / 22534791 / -1.2% 38185155 / 37608164 / +1.5% 0.58 / 0.60 / -2.7%
tpcds_q54/datafusion:parquet 52956920 / 53341828 / -0.7% 67148265 / 68563735 / -2.1% 0.79 / 0.78 / +1.4%
tpcds_q55/datafusion:parquet 18195195 / 18200760 / -0.0% 33389715 / 33511820 / -0.4% 0.54 / 0.54 / +0.3%
tpcds_q56/datafusion:parquet 42306867 / 41184408 / +2.7% 56500541 / 55405567 / +2.0% 0.75 / 0.74 / +0.7%
tpcds_q57/datafusion:parquet 101010071 / 101671995 / -0.7% 118867792 / 117775276 / +0.9% 0.85 / 0.86 / -1.6%
tpcds_q58/datafusion:parquet 64859504 / 65379172 / -0.8% 84646003 / 83445167 / +1.4% 0.77 / 0.78 / -2.2%
tpcds_q59/datafusion:parquet 47352318 / 47166733 / +0.4% 66311213 / 63758070 / +4.0% 0.71 / 0.74 / -3.5%
tpcds_q60/datafusion:parquet 40641278 / 40496120 / +0.4% 54013199 / 54970069 / -1.7% 0.75 / 0.74 / +2.1%
tpcds_q61/datafusion:parquet 36432242 / 36276349 / +0.4% 52894365 / 51677762 / +2.4% 0.69 / 0.70 / -1.9%
tpcds_q62/datafusion:parquet 25237648 / 25133856 / +0.4% 38507484 / 39080337 / -1.5% 0.66 / 0.64 / +1.9%
tpcds_q63/datafusion:parquet 22015451 / 22336690 / -1.4% 38687610 / 38535745 / +0.4% 0.57 / 0.58 / -1.8%
tpcds_q64/datafusion:parquet 285672084 / 289384498 / -1.3% 327380645 / 325537168 / +0.6% 0.87 / 0.89 / -1.8%
tpcds_q65/datafusion:parquet 122620600 / 122342684 / +0.2% 139632983 / 136500132 / +2.3% 0.88 / 0.90 / -2.0%
tpcds_q66/datafusion:parquet 60091597 / 60698380 / -1.0% 78471549 / 78646193 / -0.2% 0.77 / 0.77 / -0.8%
tpcds_q67/datafusion:parquet 68062473 / 68241426 / -0.3% 92603554 / 93760428 / -1.2% 0.73 / 0.73 / +1.0%
tpcds_q68/datafusion:parquet 28768830 / 28686418 / +0.3% 48055963 / 48389450 / -0.7% 0.60 / 0.59 / +1.0%
tpcds_q69/datafusion:parquet 44532180 / 44002805 / +1.2% 54732196 / 60154191 / -9.0% 0.81 / 0.73 / +11.2%
tpcds_q70/datafusion:parquet 81041814 / 81134460 / -0.1% 97229111 / 98779977 / -1.6% 0.83 / 0.82 / +1.5%
tpcds_q71/datafusion:parquet 26015906 / 24419574 / +6.5% 38356291 / 40431077 / -5.1% 0.68 / 0.60 / +12.3%
tpcds_q72/datafusion:parquet 530915384 / 524507354 / +1.2% 544402735 / 563010718 / -3.3% 0.98 / 0.93 / +4.7%
tpcds_q73/datafusion:parquet 23617661 / 23621957 / -0.0% 34939291 / 36478334 / -4.2% 0.68 / 0.65 / +4.4%
tpcds_q74/datafusion:parquet 69825800 / 70260886 / -0.6% 92884610 / 87264780 / +6.4% 0.75 / 0.81 / -6.6%
tpcds_q75/datafusion:parquet 152682242 / 154572858 / -1.2% 181158983 / 174609929 / +3.8% 0.84 / 0.89 / -4.8%
tpcds_q76/datafusion:parquet 33346928 / 34704096 / -3.9% 48670818 / 47374933 / +2.7% 0.69 / 0.73 / -6.5%
tpcds_q77/datafusion:parquet 57480228 / 57141103 / +0.6% 78534215 / 77607992 / +1.2% 0.73 / 0.74 / -0.6%
tpcds_q78/datafusion:parquet 86577844 / 84868968 / +2.0% 118589342 / 118188875 / +0.3% 0.73 / 0.72 / +1.7%
tpcds_q79/datafusion:parquet 26604274 / 26879678 / -1.0% 42564382 / 42307853 / +0.6% 0.63 / 0.64 / -1.6%
tpcds_q80/datafusion:parquet 81603401 / 81227851 / +0.5% 110537315 / 108643479 / +1.7% 0.74 / 0.75 / -1.3%
tpcds_q81/datafusion:parquet 38000589 / 38555362 / -1.4% 52025957 / 52531305 / -1.0% 0.73 / 0.73 / -0.5%
tpcds_q82/datafusion:parquet 22044510 / 23029840 / -4.3% 35310448 / 34990532 / +0.9% 0.62 / 0.66 / -5.1%
tpcds_q83/datafusion:parquet 58350502 / 58617186 / -0.5% 74983019 / 71885651 / +4.3% 0.78 / 0.82 / -4.6%
tpcds_q84/datafusion:parquet 27539912 / 25939382 / +6.2% 40799287 / 40828137 / -0.1% 0.68 / 0.64 / +6.2%
tpcds_q85/datafusion:parquet 80489880 / 80269182 / +0.3% 105106288 / 103609773 / +1.4% 0.77 / 0.77 / -1.2%
tpcds_q86/datafusion:parquet 20934501 / 20931520 / +0.0% 33250116 / 33148769 / +0.3% 0.63 / 0.63 / -0.3%
tpcds_q87/datafusion:parquet 44748892 / 44933464 / -0.4% 61525102 / 61039847 / +0.8% 0.73 / 0.74 / -1.2%
tpcds_q88/datafusion:parquet 36685810 / 37742125 / -2.8% 50575528 / 49614830 / +1.9% 0.73 / 0.76 / -4.6%
tpcds_q89/datafusion:parquet 25773166 / 25800445 / -0.1% 42621658 / 42806674 / -0.4% 0.60 / 0.60 / +0.3%
tpcds_q90/datafusion:parquet 15458706 / 15319838 / +0.9% 27699332 / 25941386 / +6.8% 0.56 / 0.59 / -5.5%
tpcds_q91/datafusion:parquet 32087955 / 32643981 / -1.7% 47624039 / 49753534 / -4.3% 0.67 / 0.66 / +2.7%
tpcds_q92/datafusion:parquet 26886035 / 26912362 / -0.1% 40011725 / 41642746 / -3.9% 0.67 / 0.65 / +4.0%
tpcds_q93/datafusion:parquet 27469254 / 26843600 / +2.3% 47226285 / 45233860 / +4.4% 0.58 / 0.59 / -2.0%
tpcds_q94/datafusion:parquet 35371187 / 35516594 / -0.4% 48606637 / 49506893 / -1.8% 0.73 / 0.72 / +1.4%
tpcds_q95/datafusion:parquet 65415119 / 64278658 / +1.8% 79992540 / 79439557 / +0.7% 0.82 / 0.81 / +1.1%
tpcds_q96/datafusion:parquet 13162851 / 12832798 / +2.6% 24401239 / 24186217 / +0.9% 0.54 / 0.53 / +1.7%
tpcds_q97/datafusion:parquet 35225500 / 35388267 / -0.5% 51836892 / 50661771 / +2.3% 0.68 / 0.70 / -2.7%
tpcds_q98/datafusion:parquet 24903408 / 24758076 / +0.6% 38809440 / 40681711 / -4.6% 0.64 / 0.61 / +5.4%
tpcds_q99/datafusion:parquet 30043110 / 29696472 / +1.2% 42374176 / 41832821 / +1.3% 0.71 / 0.71 / -0.1%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15927690 / 15889388 / +0.2% 24955522 / 24380243 / +2.4% 0.64 / 0.65 / -2.1%
tpcds_q02/duckdb:vortex-file-compressed 17353133 / 18123560 / -4.3% 23290273 / 22262636 / +4.6% 0.75 / 0.81 / -8.5%
tpcds_q03/duckdb:vortex-file-compressed 7439801 / 6861999 / +8.4% 15720763 / 15650209 / +0.5% 0.47 / 0.44 / +7.9%
tpcds_q04/duckdb:vortex-file-compressed 58853096 / 59044408 / -0.3% 71546810 / 71597694 / -0.1% 0.82 / 0.82 / -0.3%
tpcds_q05/duckdb:vortex-file-compressed 22751474 / 22948318 / -0.9% 31928860 / 32022722 / -0.3% 0.71 / 0.72 / -0.6%
tpcds_q06/duckdb:vortex-file-compressed 23972420 / 23762384 / +0.9% 38733135 / 38240614 / +1.3% 0.62 / 0.62 / -0.4%
tpcds_q07/duckdb:vortex-file-compressed 22031106 / 22214106 / -0.8% 34920655 / 34547053 / +1.1% 0.63 / 0.64 / -1.9%
tpcds_q08/duckdb:vortex-file-compressed 17113348 / 17242177 / -0.7% 25407945 / 25692186 / -1.1% 0.67 / 0.67 / +0.4%
tpcds_q09/duckdb:vortex-file-compressed 18929790 / 19217442 / -1.5% 30239547 / 29895752 / +1.1% 0.63 / 0.64 / -2.6%
tpcds_q10/duckdb:vortex-file-compressed 27817638 / 27714402 / +0.4% 42166958 / 41605423 / +1.3% 0.66 / 0.67 / -1.0%
tpcds_q11/duckdb:vortex-file-compressed 36485375 / 36069634 / +1.2% 45271210 / 45033737 / +0.5% 0.81 / 0.80 / +0.6%
tpcds_q12/duckdb:vortex-file-compressed 9800596 / 9866541 / -0.7% 17362420 / 17190410 / +1.0% 0.56 / 0.57 / -1.7%
tpcds_q13/duckdb:vortex-file-compressed 19644896 / 19644716 / +0.0% 34000475 / 34405068 / -1.2% 0.58 / 0.57 / +1.2%
tpcds_q14/duckdb:vortex-file-compressed 55308584 / 55954929 / -1.2% 67079525 / 64613474 / +3.8% 0.82 / 0.87 / -4.8%
tpcds_q15/duckdb:vortex-file-compressed 11078524 / 11403850 / -2.9% 18578121 / 18154910 / +2.3% 0.60 / 0.63 / -5.1%
tpcds_q16/duckdb:vortex-file-compressed 24602678 / 24528186 / +0.3% 36203373 / 35441746 / +2.1% 0.68 / 0.69 / -1.8%
tpcds_q17/duckdb:vortex-file-compressed 20244165 / 20412877 / -0.8% 32095173 / 32967619 / -2.6% 0.63 / 0.62 / +1.9%
tpcds_q18/duckdb:vortex-file-compressed 32086384 / 32030078 / +0.2% 42858961 / 42862753 / -0.0% 0.75 / 0.75 / +0.2%
tpcds_q19/duckdb:vortex-file-compressed 20685111 / 20353216 / +1.6% 29489275 / 29315762 / +0.6% 0.70 / 0.69 / +1.0%
tpcds_q20/duckdb:vortex-file-compressed 10467037 / 10355170 / +1.1% 18318036 / 17460761 / +4.9% 0.57 / 0.59 / -3.7%
tpcds_q21/duckdb:vortex-file-compressed 10849598 / 10100788 / +7.4% 21923107 / 23852975 / -8.1% 0.49 / 0.42 / +16.9%
tpcds_q22/duckdb:vortex-file-compressed 17785362 / 18819244 / -5.5% 29972964 / 31521389 / -4.9% 0.59 / 0.60 / -0.6%
tpcds_q23/duckdb:vortex-file-compressed 37165791 / 37666135 / -1.3% 48937787 / 49928387 / -2.0% 0.76 / 0.75 / +0.7%
tpcds_q24/duckdb:vortex-file-compressed 26359978 / 26610326 / -0.9% 37385707 / 37959984 / -1.5% 0.71 / 0.70 / +0.6%
tpcds_q25/duckdb:vortex-file-compressed 19184670 / 19567828 / -2.0% 31984028 / 32113008 / -0.4% 0.60 / 0.61 / -1.6%
tpcds_q26/duckdb:vortex-file-compressed 21768152 / 21401693 / +1.7% 32283660 / 31878958 / +1.3% 0.67 / 0.67 / +0.4%
tpcds_q27/duckdb:vortex-file-compressed 24733340 / 24961884 / -0.9% 37129821 / 36586658 / +1.5% 0.67 / 0.68 / -2.4%
tpcds_q28/duckdb:vortex-file-compressed 15073116 / 14659706 / +2.8% 25756776 / 26213887 / -1.7% 0.59 / 0.56 / +4.6%
tpcds_q29/duckdb:vortex-file-compressed 18451389 / 18550518 / -0.5% 30113059 / 29970312 / +0.5% 0.61 / 0.62 / -1.0%
tpcds_q30/duckdb:vortex-file-compressed 18430630 / 18133633 / +1.6% 27458263 / 27227612 / +0.8% 0.67 / 0.67 / +0.8%
tpcds_q31/duckdb:vortex-file-compressed 18388574 / 17691560 / +3.9% 25942055 / 26528375 / -2.2% 0.71 / 0.67 / +6.3%
tpcds_q32/duckdb:vortex-file-compressed 10429998 / 10079890 / +3.5% 18951566 / 18584909 / +2.0% 0.55 / 0.54 / +1.5%
tpcds_q33/duckdb:vortex-file-compressed 18046442 / 17622018 / +2.4% 27702373 / 27909093 / -0.7% 0.65 / 0.63 / +3.2%
tpcds_q34/duckdb:vortex-file-compressed 13023530 / 12969760 / +0.4% 23225711 / 23346513 / -0.5% 0.56 / 0.56 / +0.9%
tpcds_q35/duckdb:vortex-file-compressed 31229299 / 30958612 / +0.9% 44180996 / 45199274 / -2.3% 0.71 / 0.68 / +3.2%
tpcds_q36/duckdb:vortex-file-compressed 14265708 / 14104008 / +1.1% 25106368 / 24308127 / +3.3% 0.57 / 0.58 / -2.1%
tpcds_q37/duckdb:vortex-file-compressed 9650090 / 9735812 / -0.9% 25649756 / 25786355 / -0.5% 0.38 / 0.38 / -0.4%
tpcds_q38/duckdb:vortex-file-compressed 24390159 / 24303181 / +0.4% 32025979 / 31962701 / +0.2% 0.76 / 0.76 / +0.2%
tpcds_q39/duckdb:vortex-file-compressed 18747659 / 19065812 / -1.7% 32021379 / 32437893 / -1.3% 0.59 / 0.59 / -0.4%
tpcds_q40/duckdb:vortex-file-compressed 11122043 / 11074548 / +0.4% 19641440 / 20214584 / -2.8% 0.57 / 0.55 / +3.4%
tpcds_q41/duckdb:vortex-file-compressed 17337791 / 17226562 / +0.6% 23740258 / 23618815 / +0.5% 0.73 / 0.73 / +0.1%
tpcds_q42/duckdb:vortex-file-compressed 6785438 / 6822432 / -0.5% 16119819 / 15693623 / +2.7% 0.42 / 0.43 / -3.2%
tpcds_q43/duckdb:vortex-file-compressed 9441656 / 9627498 / -1.9% 18929445 / 19239929 / -1.6% 0.50 / 0.50 / -0.3%
tpcds_q44/duckdb:vortex-file-compressed 12380142 / 12534332 / -1.2% 24781133 / 24992220 / -0.8% 0.50 / 0.50 / -0.4%
tpcds_q45/duckdb:vortex-file-compressed 23734890 / 23418439 / +1.4% 31314123 / 31256919 / +0.2% 0.76 / 0.75 / +1.2%
tpcds_q46/duckdb:vortex-file-compressed 31665482 / 31152402 / +1.6% 44144637 / 43683456 / +1.1% 0.72 / 0.71 / +0.6%
tpcds_q47/duckdb:vortex-file-compressed 31319856 / 31157306 / +0.5% 41434248 / 41136784 / +0.7% 0.76 / 0.76 / -0.2%
tpcds_q48/duckdb:vortex-file-compressed 22550544 / 22768204 / -1.0% 35728164 / 36023036 / -0.8% 0.63 / 0.63 / -0.1%
tpcds_q49/duckdb:vortex-file-compressed 19079707 / 18697994 / +2.0% 31109810 / 31509645 / -1.3% 0.61 / 0.59 / +3.4%
tpcds_q50/duckdb:vortex-file-compressed 14749812 / 14904727 / -1.0% 26135528 / 25525366 / +2.4% 0.56 / 0.58 / -3.3%
tpcds_q51/duckdb:vortex-file-compressed 49528071 / 49039694 / +1.0% 76870616 / 77038194 / -0.2% 0.64 / 0.64 / +1.2%
tpcds_q52/duckdb:vortex-file-compressed 6996972 / 6899302 / +1.4% 16561773 / 15969178 / +3.7% 0.42 / 0.43 / -2.2%
tpcds_q53/duckdb:vortex-file-compressed 11412082 / 11279512 / +1.2% 21039353 / 21433800 / -1.8% 0.54 / 0.53 / +3.1%
tpcds_q54/duckdb:vortex-file-compressed 19711635 / 19706016 / +0.0% 30744227 / 31146768 / -1.3% 0.64 / 0.63 / +1.3%
tpcds_q55/duckdb:vortex-file-compressed 6880278 / 6818604 / +0.9% 15671313 / 15713149 / -0.3% 0.44 / 0.43 / +1.2%
tpcds_q56/duckdb:vortex-file-compressed 17655055 / 18297214 / -3.5% 27951375 / 28245259 / -1.0% 0.63 / 0.65 / -2.5%
tpcds_q57/duckdb:vortex-file-compressed 25442736 / 25426470 / +0.1% 33050736 / 33841429 / -2.3% 0.77 / 0.75 / +2.5%
tpcds_q58/duckdb:vortex-file-compressed 20569732 / 20104139 / +2.3% 29265225 / 29543094 / -0.9% 0.70 / 0.68 / +3.3%
tpcds_q59/duckdb:vortex-file-compressed 19280251 / 19719871 / -2.2% 27086155 / 27067289 / +0.1% 0.71 / 0.73 / -2.3%
tpcds_q60/duckdb:vortex-file-compressed 19081448 / 18309502 / +4.2% 28076056 / 28186094 / -0.4% 0.68 / 0.65 / +4.6%
tpcds_q61/duckdb:vortex-file-compressed 20097998 / 20014846 / +0.4% 31347350 / 31422989 / -0.2% 0.64 / 0.64 / +0.7%
tpcds_q62/duckdb:vortex-file-compressed 11326240 / 11254547 / +0.6% 18448152 / 18383950 / +0.3% 0.61 / 0.61 / +0.3%
tpcds_q63/duckdb:vortex-file-compressed 10874501 / 10762198 / +1.0% 18860823 / 19700318 / -4.3% 0.58 / 0.55 / +5.5%
tpcds_q64/duckdb:vortex-file-compressed 51419943 / 52481352 / -2.0% 67438789 / 68547232 / -1.6% 0.76 / 0.77 / -0.4%
tpcds_q65/duckdb:vortex-file-compressed 13028624 / 13087080 / -0.4% 23276259 / 22416985 / +3.8% 0.56 / 0.58 / -4.1%
tpcds_q66/duckdb:vortex-file-compressed 31363263 / 32052406 / -2.2% 39355931 / 39056692 / +0.8% 0.80 / 0.82 / -2.9%
tpcds_q67/duckdb:vortex-file-compressed 55160132 / 55172908 / -0.0% 65210707 / 64619974 / +0.9% 0.85 / 0.85 / -0.9%
tpcds_q68/duckdb:vortex-file-compressed 22725190 / 22696897 / +0.1% 36853287 / 35645438 / +3.4% 0.62 / 0.64 / -3.2%
tpcds_q69/duckdb:vortex-file-compressed 22613101 / 22575385 / +0.2% 37928335 / 37661518 / +0.7% 0.60 / 0.60 / -0.5%
tpcds_q70/duckdb:vortex-file-compressed 14241932 / 14770048 / -3.6% 26484268 / 25899196 / +2.3% 0.54 / 0.57 / -5.7%
tpcds_q71/duckdb:vortex-file-compressed 14057990 / 12968388 / +8.4% 24130498 / 23014353 / +4.8% 0.58 / 0.56 / +3.4%
tpcds_q72/duckdb:vortex-file-compressed 42836626 / 43233744 / -0.9% 56134348 / 56863538 / -1.3% 0.76 / 0.76 / +0.4%
tpcds_q73/duckdb:vortex-file-compressed 11902266 / 11803436 / +0.8% 22099034 / 21333798 / +3.6% 0.54 / 0.55 / -2.7%
tpcds_q74/duckdb:vortex-file-compressed 30807918 / 30953246 / -0.5% 39506732 / 40090481 / -1.5% 0.78 / 0.77 / +1.0%
tpcds_q75/duckdb:vortex-file-compressed 37407860 / 37256242 / +0.4% 49168253 / 50988638 / -3.6% 0.76 / 0.73 / +4.1%
tpcds_q76/duckdb:vortex-file-compressed 12764416 / 12741817 / +0.2% 22319171 / 22859296 / -2.4% 0.57 / 0.56 / +2.6%
tpcds_q77/duckdb:vortex-file-compressed 20827992 / 20705926 / +0.6% 31323297 / 31459131 / -0.4% 0.66 / 0.66 / +1.0%
tpcds_q78/duckdb:vortex-file-compressed 43264456 / 43541955 / -0.6% 53188941 / 54046455 / -1.6% 0.81 / 0.81 / +1.0%
tpcds_q79/duckdb:vortex-file-compressed 16895814 / 16938364 / -0.3% 28303645 / 30014196 / -5.7% 0.60 / 0.56 / +5.8%
tpcds_q80/duckdb:vortex-file-compressed 30006764 / 30710299 / -2.3% 43559404 / 44475318 / -2.1% 0.69 / 0.69 / -0.2%
tpcds_q81/duckdb:vortex-file-compressed 21109048 / 20748506 / +1.7% 29314792 / 29767552 / -1.5% 0.72 / 0.70 / +3.3%
tpcds_q82/duckdb:vortex-file-compressed 9882706 / 10000948 / -1.2% 26002806 / 25784830 / +0.8% 0.38 / 0.39 / -2.0%
tpcds_q83/duckdb:vortex-file-compressed 17328186 / 17406950 / -0.5% 24394418 / 24343765 / +0.2% 0.71 / 0.72 / -0.7%
tpcds_q84/duckdb:vortex-file-compressed 15547534 / 15329286 / +1.4% 23046782 / 23294703 / -1.1% 0.67 / 0.66 / +2.5%
tpcds_q85/duckdb:vortex-file-compressed 25238683 / 25300057 / -0.2% 37212439 / 36627590 / +1.6% 0.68 / 0.69 / -1.8%
tpcds_q86/duckdb:vortex-file-compressed 9842606 / 10001794 / -1.6% 17395302 / 17319109 / +0.4% 0.57 / 0.58 / -2.0%
tpcds_q87/duckdb:vortex-file-compressed 25791110 / 25857771 / -0.3% 32309508 / 32975606 / -2.0% 0.80 / 0.78 / +1.8%
tpcds_q88/duckdb:vortex-file-compressed 30399978 / 30335862 / +0.2% 40405951 / 39133646 / +3.3% 0.75 / 0.78 / -2.9%
tpcds_q89/duckdb:vortex-file-compressed 11850934 / 11712056 / +1.2% 21398965 / 21603193 / -0.9% 0.55 / 0.54 / +2.2%
tpcds_q90/duckdb:vortex-file-compressed 7861788 / 7865370 / -0.0% 14937938 / 14769777 / +1.1% 0.53 / 0.53 / -1.2%
tpcds_q91/duckdb:vortex-file-compressed 14650262 / 14607442 / +0.3% 24253123 / 24487438 / -1.0% 0.60 / 0.60 / +1.3%
tpcds_q92/duckdb:vortex-file-compressed 10638520 / 10687286 / -0.5% 20315509 / 19317036 / +5.2% 0.52 / 0.55 / -5.3%
tpcds_q93/duckdb:vortex-file-compressed 10070920 / 10232368 / -1.6% 24256586 / 23068919 / +5.1% 0.42 / 0.44 / -6.4%
tpcds_q94/duckdb:vortex-file-compressed 22245002 / 22420168 / -0.8% 32396014 / 31984034 / +1.3% 0.69 / 0.70 / -2.0%
tpcds_q95/duckdb:vortex-file-compressed 60929318 / 60831408 / +0.2% 68990594 / 68740664 / +0.4% 0.88 / 0.88 / -0.2%
tpcds_q96/duckdb:vortex-file-compressed 6613030 / 6586064 / +0.4% 15814820 / 16244274 / -2.6% 0.42 / 0.41 / +3.1%
tpcds_q97/duckdb:vortex-file-compressed 23075792 / 22948690 / +0.6% 30856338 / 32014186 / -3.6% 0.75 / 0.72 / +4.3%
tpcds_q98/duckdb:vortex-file-compressed 11011988 / 10801780 / +1.9% 19402542 / 20265218 / -4.3% 0.57 / 0.53 / +6.5%
tpcds_q99/duckdb:vortex-file-compressed 14657988 / 14788340 / -0.9% 22662631 / 22876518 / -0.9% 0.65 / 0.65 / +0.1%
duckdb / parquet / ns (0.994x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23911858 / 24072184 / -0.7% 31087966 / 31240349 / -0.5% 0.77 / 0.77 / -0.2%
tpcds_q02/duckdb:parquet 17880148 / 17775462 / +0.6% 23917466 / 23692787 / +0.9% 0.75 / 0.75 / -0.4%
tpcds_q03/duckdb:parquet 9748300 / 9747790 / +0.0% 15635345 / 15939644 / -1.9% 0.62 / 0.61 / +2.0%
tpcds_q04/duckdb:parquet 117773349 / 118039014 / -0.2% 125792842 / 126024097 / -0.2% 0.94 / 0.94 / -0.0%
tpcds_q05/duckdb:parquet 28221263 / 28283721 / -0.2% 32735439 / 32934527 / -0.6% 0.86 / 0.86 / +0.4%
tpcds_q06/duckdb:parquet 26323512 / 26168861 / +0.6% 36107623 / 35849279 / +0.7% 0.73 / 0.73 / -0.1%
tpcds_q07/duckdb:parquet 33469821 / 30866898 / +8.4% 38555673 / 38441449 / +0.3% 0.87 / 0.80 / +8.1%
tpcds_q08/duckdb:parquet 20100264 / 19926624 / +0.9% 26200215 / 26365758 / -0.6% 0.77 / 0.76 / +1.5%
tpcds_q09/duckdb:parquet 26987333 / 27313906 / -1.2% 29390103 / 30173176 / -2.6% 0.92 / 0.91 / +1.4%
tpcds_q10/duckdb:parquet 32500894 / 32571246 / -0.2% 40896553 / 40482458 / +1.0% 0.79 / 0.80 / -1.2%
tpcds_q11/duckdb:parquet 68814606 / 68433648 / +0.6% 74157683 / 76262649 / -2.8% 0.93 / 0.90 / +3.4%
tpcds_q12/duckdb:parquet 14062524 / 13923635 / +1.0% 19147055 / 19111353 / +0.2% 0.73 / 0.73 / +0.8%
tpcds_q13/duckdb:parquet 32036443 / 31188582 / +2.7% 39271713 / 47181471 / -16.8% 🟢 0.82 / 0.66 / +23.4%
tpcds_q14/duckdb:parquet 63230549 / 64240883 / -1.6% 68035992 / 67656718 / +0.6% 0.93 / 0.95 / -2.1%
tpcds_q15/duckdb:parquet 16573180 / 16507907 / +0.4% 22444119 / 22723580 / -1.2% 0.74 / 0.73 / +1.6%
tpcds_q16/duckdb:parquet 30211360 / 30323378 / -0.4% 36971100 / 37184566 / -0.6% 0.82 / 0.82 / +0.2%
tpcds_q17/duckdb:parquet 34050059 / 34153247 / -0.3% 40047300 / 40366833 / -0.8% 0.85 / 0.85 / +0.5%
tpcds_q18/duckdb:parquet 47207802 / 47044052 / +0.3% 55049872 / 54184677 / +1.6% 0.86 / 0.87 / -1.2%
tpcds_q19/duckdb:parquet 18824202 / 20189092 / -6.8% 25746263 / 25480395 / +1.0% 0.73 / 0.79 / -7.7%
tpcds_q20/duckdb:parquet 15036454 / 14829157 / +1.4% 19942902 / 19390101 / +2.9% 0.75 / 0.76 / -1.4%
tpcds_q21/duckdb:parquet 10348807 / 10497864 / -1.4% 17188633 / 16989434 / +1.2% 0.60 / 0.62 / -2.6%
tpcds_q22/duckdb:parquet 20691288 / 20566126 / +0.6% 26726326 / 26423212 / +1.1% 0.77 / 0.78 / -0.5%
tpcds_q23/duckdb:parquet 42938310 / 45406259 / -5.4% 47139786 / 46778077 / +0.8% 0.91 / 0.97 / -6.2%
tpcds_q24/duckdb:parquet 30226978 / 30134771 / +0.3% 36498801 / 36303460 / +0.5% 0.83 / 0.83 / -0.2%
tpcds_q25/duckdb:parquet 30296574 / 30176674 / +0.4% 37055124 / 37149956 / -0.3% 0.82 / 0.81 / +0.7%
tpcds_q26/duckdb:parquet 29024226 / 28671950 / +1.2% 35683747 / 35017847 / +1.9% 0.81 / 0.82 / -0.7%
tpcds_q27/duckdb:parquet 33120704 / 35554186 / -6.8% 41908145 / 42501091 / -1.4% 0.79 / 0.84 / -5.5%
tpcds_q28/duckdb:parquet 25652738 / 25927437 / -1.1% 33878625 / 33482506 / +1.2% 0.76 / 0.77 / -2.2%
tpcds_q29/duckdb:parquet 32263559 / 31991424 / +0.9% 39163109 / 39826297 / -1.7% 0.82 / 0.80 / +2.6%
tpcds_q30/duckdb:parquet 35164613 / 35327633 / -0.5% 44752063 / 44333052 / +0.9% 0.79 / 0.80 / -1.4%
tpcds_q31/duckdb:parquet 35858516 / 35414842 / +1.3% 42981962 / 42515102 / +1.1% 0.83 / 0.83 / +0.2%
tpcds_q32/duckdb:parquet 14088316 / 14069404 / +0.1% 20897850 / 20942886 / -0.2% 0.67 / 0.67 / +0.4%
tpcds_q33/duckdb:parquet 23023862 / 23777956 / -3.2% 29073320 / 28866649 / +0.7% 0.79 / 0.82 / -3.9%
tpcds_q34/duckdb:parquet 18656220 / 16857926 / +10.7% 🔴 23847083 / 24066251 / -0.9% 0.78 / 0.70 / +11.7%
tpcds_q35/duckdb:parquet 34792584 / 34818640 / -0.1% 44591685 / 43741082 / +1.9% 0.78 / 0.80 / -2.0%
tpcds_q36/duckdb:parquet 39288868 / 39448347 / -0.4% 48285904 / 47945816 / +0.7% 0.81 / 0.82 / -1.1%
tpcds_q37/duckdb:parquet 12665208 / 12706896 / -0.3% 19499749 / 20123611 / -3.1% 0.65 / 0.63 / +2.9%
tpcds_q38/duckdb:parquet 29665578 / 29473792 / +0.7% 33499182 / 33568857 / -0.2% 0.89 / 0.88 / +0.9%
tpcds_q39/duckdb:parquet 23203182 / 23356946 / -0.7% 29856395 / 29610603 / +0.8% 0.78 / 0.79 / -1.5%
tpcds_q40/duckdb:parquet 15872076 / 15920430 / -0.3% 21406241 / 21743526 / -1.6% 0.74 / 0.73 / +1.3%
tpcds_q41/duckdb:parquet 11862956 / 11854486 / +0.1% 17940590 / 17751613 / +1.1% 0.66 / 0.67 / -1.0%
tpcds_q42/duckdb:parquet 9528993 / 9458392 / +0.7% 15377045 / 15552241 / -1.1% 0.62 / 0.61 / +1.9%
tpcds_q43/duckdb:parquet 11959160 / 11993336 / -0.3% 18280943 / 18225720 / +0.3% 0.65 / 0.66 / -0.6%
tpcds_q44/duckdb:parquet 20638423 / 21705388 / -4.9% 26919860 / 26861294 / +0.2% 0.77 / 0.81 / -5.1%
tpcds_q45/duckdb:parquet 20913103 / 20722366 / +0.9% 27687849 / 28142073 / -1.6% 0.76 / 0.74 / +2.6%
tpcds_q46/duckdb:parquet 35974328 / 34954487 / +2.9% 43551632 / 43973131 / -1.0% 0.83 / 0.79 / +3.9%
tpcds_q47/duckdb:parquet 34615640 / 34375682 / +0.7% 41139683 / 41030814 / +0.3% 0.84 / 0.84 / +0.4%
tpcds_q48/duckdb:parquet 30350014 / 31278404 / -3.0% 36895319 / 37281696 / -1.0% 0.82 / 0.84 / -2.0%
tpcds_q49/duckdb:parquet 28749342 / 31182655 / -7.8% 36377361 / 35864941 / +1.4% 0.79 / 0.87 / -9.1%
tpcds_q50/duckdb:parquet 19221488 / 19519794 / -1.5% 25816087 / 25806900 / +0.0% 0.74 / 0.76 / -1.6%
tpcds_q51/duckdb:parquet 52063312 / 51888102 / +0.3% 76616342 / 59246696 / +29.3% 🔴 0.68 / 0.88 / -22.4%
tpcds_q52/duckdb:parquet 9648660 / 9575348 / +0.8% 15439165 / 15705505 / -1.7% 0.62 / 0.61 / +2.5%
tpcds_q53/duckdb:parquet 13745170 / 13703041 / +0.3% 21092555 / 21142753 / -0.2% 0.65 / 0.65 / +0.5%
tpcds_q54/duckdb:parquet 25098858 / 24916951 / +0.7% 31967906 / 31774473 / +0.6% 0.79 / 0.78 / +0.1%
tpcds_q55/duckdb:parquet 9404198 / 9483776 / -0.8% 15546431 / 15421523 / +0.8% 0.60 / 0.61 / -1.6%
tpcds_q56/duckdb:parquet 25112646 / 26293296 / -4.5% 30848366 / 30511894 / +1.1% 0.81 / 0.86 / -5.5%
tpcds_q57/duckdb:parquet 30284137 / 30419960 / -0.4% 36206583 / 36231858 / -0.1% 0.84 / 0.84 / -0.4%
tpcds_q58/duckdb:parquet 25692926 / 23841548 / +7.8% 29741030 / 29370042 / +1.3% 0.86 / 0.81 / +6.4%
tpcds_q59/duckdb:parquet 22598780 / 22599169 / -0.0% 28969105 / 28528874 / +1.5% 0.78 / 0.79 / -1.5%
tpcds_q60/duckdb:parquet 27127882 / 28189502 / -3.8% 32471491 / 32084132 / +1.2% 0.84 / 0.88 / -4.9%
tpcds_q61/duckdb:parquet 24857795 / 25621873 / -3.0% 29620848 / 29432819 / +0.6% 0.84 / 0.87 / -3.6%
tpcds_q62/duckdb:parquet 12680869 / 12556926 / +1.0% 18032541 / 17923279 / +0.6% 0.70 / 0.70 / +0.4%
tpcds_q63/duckdb:parquet 13291780 / 13307592 / -0.1% 19817532 / 19878213 / -0.3% 0.67 / 0.67 / +0.2%
tpcds_q64/duckdb:parquet 70697524 / 71753204 / -1.5% 79795276 / 80110705 / -0.4% 0.89 / 0.90 / -1.1%
tpcds_q65/duckdb:parquet 19454734 / 20363500 / -4.5% 25586428 / 25424914 / +0.6% 0.76 / 0.80 / -5.1%
tpcds_q66/duckdb:parquet 33244278 / 33388863 / -0.4% 38142538 / 37767804 / +1.0% 0.87 / 0.88 / -1.4%
tpcds_q67/duckdb:parquet 61318536 / 64690887 / -5.2% 69730179 / 67067413 / +4.0% 0.88 / 0.96 / -8.8%
tpcds_q68/duckdb:parquet 29338746 / 28354948 / +3.5% 35620233 / 36534250 / -2.5% 0.82 / 0.78 / +6.1%
tpcds_q69/duckdb:parquet 25815294 / 25737348 / +0.3% 34477552 / 34816820 / -1.0% 0.75 / 0.74 / +1.3%
tpcds_q70/duckdb:parquet 19206410 / 19091077 / +0.6% 27228170 / 26800747 / +1.6% 0.71 / 0.71 / -1.0%
tpcds_q71/duckdb:parquet 16660534 / 16844147 / -1.1% 24222267 / 24031264 / +0.8% 0.69 / 0.70 / -1.9%
tpcds_q72/duckdb:parquet 53097589 / 52662375 / +0.8% 59525211 / 59372308 / +0.3% 0.89 / 0.89 / +0.6%
tpcds_q73/duckdb:parquet 14696501 / 15949547 / -7.9% 21696996 / 21801868 / -0.5% 0.68 / 0.73 / -7.4%
tpcds_q74/duckdb:parquet 84396111 / 84336306 / +0.1% 91626235 / 92058790 / -0.5% 0.92 / 0.92 / +0.5%
tpcds_q75/duckdb:parquet 43472407 / 45125673 / -3.7% 50568753 / 49635205 / +1.9% 0.86 / 0.91 / -5.4%
tpcds_q76/duckdb:parquet 19150163 / 18594352 / +3.0% 24026566 / 24099108 / -0.3% 0.80 / 0.77 / +3.3%
tpcds_q77/duckdb:parquet 24892826 / 26880450 / -7.4% 31303875 / 31047303 / +0.8% 0.80 / 0.87 / -8.2%
tpcds_q78/duckdb:parquet 78635876 / 78979260 / -0.4% 86334659 / 84801623 / +1.8% 0.91 / 0.93 / -2.2%
tpcds_q79/duckdb:parquet 21471708 / 26090176 / -17.7% 🟢 29252760 / 28328966 / +3.3% 0.73 / 0.92 / -20.3%
tpcds_q80/duckdb:parquet 36988337 / 35690262 / +3.6% 44458780 / 43955772 / +1.1% 0.83 / 0.81 / +2.5%
tpcds_q81/duckdb:parquet 36233906 / 36174620 / +0.2% 45101147 / 44655081 / +1.0% 0.80 / 0.81 / -0.8%
tpcds_q82/duckdb:parquet 13307094 / 13591468 / -2.1% 20768309 / 20539025 / +1.1% 0.64 / 0.66 / -3.2%
tpcds_q83/duckdb:parquet 20047307 / 20121716 / -0.4% 25282126 / 24794738 / +2.0% 0.79 / 0.81 / -2.3%
tpcds_q84/duckdb:parquet 22669025 / 22949365 / -1.2% 28540754 / 28658856 / -0.4% 0.79 / 0.80 / -0.8%
tpcds_q85/duckdb:parquet 32280830 / 32262782 / +0.1% 39367495 / 39085799 / +0.7% 0.82 / 0.83 / -0.7%
tpcds_q86/duckdb:parquet 11736030 / 11711794 / +0.2% 17314679 / 16648950 / +4.0% 0.68 / 0.70 / -3.6%
tpcds_q87/duckdb:parquet 31246252 / 31223778 / +0.1% 35136936 / 35274119 / -0.4% 0.89 / 0.89 / +0.5%
tpcds_q88/duckdb:parquet 38150753 / 38376732 / -0.6% 43016449 / 42004897 / +2.4% 0.89 / 0.91 / -2.9%
tpcds_q89/duckdb:parquet 14124922 / 14052286 / +0.5% 21811111 / 21577511 / +1.1% 0.65 / 0.65 / -0.6%
tpcds_q90/duckdb:parquet 9955092 / 10021088 / -0.7% 15283410 / 15202252 / +0.5% 0.65 / 0.66 / -1.2%
tpcds_q91/duckdb:parquet 21094046 / 20980927 / +0.5% 28422864 / 28676379 / -0.9% 0.74 / 0.73 / +1.4%
tpcds_q92/duckdb:parquet 15585792 / 15439088 / +1.0% 22371709 / 22149784 / +1.0% 0.70 / 0.70 / -0.1%
tpcds_q93/duckdb:parquet 14196250 / 14072244 / +0.9% 20406377 / 20451202 / -0.2% 0.70 / 0.69 / +1.1%
tpcds_q94/duckdb:parquet 25371844 / 25535740 / -0.6% 33392136 / 32602497 / +2.4% 0.76 / 0.78 / -3.0%
tpcds_q95/duckdb:parquet 44025510 / 44220100 / -0.4% 49801186 / 49403691 / +0.8% 0.88 / 0.90 / -1.2%
tpcds_q96/duckdb:parquet 8288115 / 8681424 / -4.5% 13941532 / 13687646 / +1.9% 0.59 / 0.63 / -6.3%
tpcds_q97/duckdb:parquet 27442094 / 27436546 / +0.0% 34222352 / 33705160 / +1.5% 0.80 / 0.81 / -1.5%
tpcds_q98/duckdb:parquet 16408384 / 16415756 / -0.0% 23425917 / 23321830 / +0.4% 0.70 / 0.70 / -0.5%
tpcds_q99/duckdb:parquet 18703640 / 18749469 / -0.2% 24388842 / 24823370 / -1.8% 0.77 / 0.76 / +1.5%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 0fbea339 vs base ce2b6d02
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.042x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.018x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1259574 / 1243948 / +1.3% 22985254 / 20074979 / +14.5% 🔴 0.05 / 0.06 / -11.6%
clickbench_q01/datafusion:vortex-file-compressed 5791292 / 5602966 / +3.4% 34827412 / 27905355 / +24.8% 🔴 0.17 / 0.20 / -17.2%
clickbench_q02/datafusion:vortex-file-compressed 10879192 / 11406074 / -4.6% 40981276 / 42255722 / -3.0% 0.27 / 0.27 / -1.7%
clickbench_q03/datafusion:vortex-file-compressed 13523054 / 12437038 / +8.7% 52149502 / 49560101 / +5.2% 0.26 / 0.25 / +3.3%
clickbench_q04/datafusion:vortex-file-compressed 58178908 / 58429052 / -0.4% 103893790 / 98214241 / +5.8% 0.56 / 0.59 / -5.9%
clickbench_q05/datafusion:vortex-file-compressed 76559349 / 76866337 / -0.4% 123880375 / 124533627 / -0.5% 0.62 / 0.62 / +0.1%
clickbench_q06/datafusion:vortex-file-compressed 1302016 / 1273723 / +2.2% 22940815 / 20773754 / +10.4% 🔴 0.06 / 0.06 / -7.4%
clickbench_q07/datafusion:vortex-file-compressed 9288708 / 9404942 / -1.2% 34125827 / 31733396 / +7.5% 0.27 / 0.30 / -8.2%
clickbench_q08/datafusion:vortex-file-compressed 82026134 / 77550660 / +5.8% 131708808 / 125868843 / +4.6% 0.62 / 0.62 / +1.1%
clickbench_q09/datafusion:vortex-file-compressed 169500068 / 169279766 / +0.1% 217747831 / 218966251 / -0.6% 0.78 / 0.77 / +0.7%
clickbench_q10/datafusion:vortex-file-compressed 22702794 / 22329500 / +1.7% 69967108 / 64199514 / +9.0% 0.32 / 0.35 / -6.7%
clickbench_q11/datafusion:vortex-file-compressed 24061738 / 24789854 / -2.9% 67467822 / 64719869 / +4.2% 0.36 / 0.38 / -6.9%
clickbench_q12/datafusion:vortex-file-compressed 73360074 / 74575531 / -1.6% 125306894 / 120072447 / +4.4% 0.59 / 0.62 / -5.7%
clickbench_q13/datafusion:vortex-file-compressed 115191402 / 118624434 / -2.9% 180298837 / 181057369 / -0.4% 0.64 / 0.66 / -2.5%
clickbench_q14/datafusion:vortex-file-compressed 77350746 / 76137302 / +1.6% 134241962 / 125694742 / +6.8% 0.58 / 0.61 / -4.9%
clickbench_q15/datafusion:vortex-file-compressed 64408244 / 66194298 / -2.7% 100090428 / 98636083 / +1.5% 0.64 / 0.67 / -4.1%
clickbench_q16/datafusion:vortex-file-compressed 152862860 / 154118333 / -0.8% 219437565 / 219162089 / +0.1% 0.70 / 0.70 / -0.9%
clickbench_q17/datafusion:vortex-file-compressed 153276640 / 152538028 / +0.5% 218051951 / 220610921 / -1.2% 0.70 / 0.69 / +1.7%
clickbench_q18/datafusion:vortex-file-compressed 295179942 / 294961644 / +0.1% 388041854 / 386150594 / +0.5% 0.76 / 0.76 / -0.4%
clickbench_q19/datafusion:vortex-file-compressed 7262552 / 7415522 / -2.1% 49852859 / 40546969 / +23.0% 🔴 0.15 / 0.18 / -20.3%
clickbench_q20/datafusion:vortex-file-compressed 65766626 / 67464544 / -2.5% 246082418 / 244715953 / +0.6% 0.27 / 0.28 / -3.1%
clickbench_q21/datafusion:vortex-file-compressed 76542517 / 78393774 / -2.4% 287642676 / 282082156 / +2.0% 0.27 / 0.28 / -4.2%
clickbench_q22/datafusion:vortex-file-compressed 93930614 / 93221784 / +0.8% 390279330 / 388314193 / +0.5% 0.24 / 0.24 / +0.3%
clickbench_q23/datafusion:vortex-file-compressed 80248825 / 93127922 / -13.8% 🟢 413856084 / 375359221 / +10.3% 🔴 0.19 / 0.25 / -21.8%
clickbench_q24/datafusion:vortex-file-compressed 8423664 / 8714422 / -3.3% 61318726 / 56768742 / +8.0% 0.14 / 0.15 / -10.5%
clickbench_q25/datafusion:vortex-file-compressed 18148890 / 18329417 / -1.0% 61734517 / 58296734 / +5.9% 0.29 / 0.31 / -6.5%
clickbench_q26/datafusion:vortex-file-compressed 14401459 / 14591794 / -1.3% 62697636 / 65846867 / -4.8% 0.23 / 0.22 / +3.7%
clickbench_q27/datafusion:vortex-file-compressed 97477966 / 95927780 / +1.6% 249250181 / 253259562 / -1.6% 0.39 / 0.38 / +3.3%
clickbench_q28/datafusion:vortex-file-compressed 551492398 / 564521634 / -2.3% 630819741 / 643090274 / -1.9% 0.87 / 0.88 / -0.4%
clickbench_q29/datafusion:vortex-file-compressed 24341004 / 24204414 / +0.6% 58983627 / 57175216 / +3.2% 0.41 / 0.42 / -2.5%
clickbench_q30/datafusion:vortex-file-compressed 56793902 / 57466224 / -1.2% 112494303 / 105105082 / +7.0% 0.50 / 0.55 / -7.7%
clickbench_q31/datafusion:vortex-file-compressed 65093580 / 66752164 / -2.5% 156327621 / 152265888 / +2.7% 0.42 / 0.44 / -5.0%
clickbench_q32/datafusion:vortex-file-compressed 287437009 / 289714158 / -0.8% 391764801 / 383140895 / +2.3% 0.73 / 0.76 / -3.0%
clickbench_q33/datafusion:vortex-file-compressed 320093707 / 322137368 / -0.6% 416661115 / 435395503 / -4.3% 0.77 / 0.74 / +3.8%
clickbench_q34/datafusion:vortex-file-compressed 320021600 / 319034054 / +0.3% 424047718 / 431734762 / -1.8% 0.75 / 0.74 / +2.1%
clickbench_q35/datafusion:vortex-file-compressed 56834218 / 56645229 / +0.3% 90997295 / 87614983 / +3.9% 0.62 / 0.65 / -3.4%
clickbench_q36/datafusion:vortex-file-compressed 36844196 / 37218380 / -1.0% 68268084 / 65627991 / +4.0% 0.54 / 0.57 / -4.8%
clickbench_q37/datafusion:vortex-file-compressed 20700656 / 21164260 / -2.2% 48873948 / 45732668 / +6.9% 0.42 / 0.46 / -8.5%
clickbench_q38/datafusion:vortex-file-compressed 12281238 / 12632768 / -2.8% 41999899 / 38294284 / +9.7% 0.29 / 0.33 / -11.4%
clickbench_q39/datafusion:vortex-file-compressed 78363446 / 78656200 / -0.4% 113531001 / 110048857 / +3.2% 0.69 / 0.71 / -3.4%
clickbench_q40/datafusion:vortex-file-compressed 10489344 / 10251528 / +2.3% 37519305 / 34049431 / +10.2% 🔴 0.28 / 0.30 / -7.1%
clickbench_q41/datafusion:vortex-file-compressed 9987922 / 9815758 / +1.8% 37030466 / 32592656 / +13.6% 🔴 0.27 / 0.30 / -10.4%
clickbench_q42/datafusion:vortex-file-compressed 9908775 / 9786756 / +1.2% 36801718 / 32810424 / +12.2% 🔴 0.27 / 0.30 / -9.7%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1267687 / 1251427 / +1.3% 50170799 / 47338707 / +6.0% 0.03 / 0.03 / -4.4%
clickbench_q01/datafusion:parquet 16215352 / 16094866 / +0.7% 69398188 / 70811295 / -2.0% 0.23 / 0.23 / +2.8%
clickbench_q02/datafusion:parquet 18596786 / 19298364 / -3.6% 82293064 / 81503704 / +1.0% 0.23 / 0.24 / -4.6%
clickbench_q03/datafusion:parquet 17606640 / 17201029 / +2.4% 80573929 / 77525624 / +3.9% 0.22 / 0.22 / -1.5%
clickbench_q04/datafusion:parquet 63036415 / 62261869 / +1.2% 127520090 / 124376172 / +2.5% 0.49 / 0.50 / -1.3%
clickbench_q05/datafusion:parquet 88733072 / 89273653 / -0.6% 156617920 / 154661764 / +1.3% 0.57 / 0.58 / -1.8%
clickbench_q06/datafusion:parquet 1258892 / 1246035 / +1.0% 50656509 / 48015631 / +5.5% 0.02 / 0.03 / -4.2%
clickbench_q07/datafusion:parquet 16641134 / 16782477 / -0.8% 68309618 / 66868644 / +2.2% 0.24 / 0.25 / -2.9%
clickbench_q08/datafusion:parquet 85365816 / 86170240 / -0.9% 161643509 / 157472902 / +2.6% 0.53 / 0.55 / -3.5%
clickbench_q09/datafusion:parquet 187065702 / 185002786 / +1.1% 269747217 / 269875249 / -0.0% 0.69 / 0.69 / +1.2%
clickbench_q10/datafusion:parquet 36619924 / 37023180 / -1.1% 101379047 / 99483424 / +1.9% 0.36 / 0.37 / -2.9%
clickbench_q11/datafusion:parquet 42004733 / 43085013 / -2.5% 111193043 / 108972765 / +2.0% 0.38 / 0.40 / -4.5%
clickbench_q12/datafusion:parquet 95028158 / 96126374 / -1.1% 165415286 / 159256985 / +3.9% 0.57 / 0.60 / -4.8%
clickbench_q13/datafusion:parquet 148023386 / 148896274 / -0.6% 232862406 / 223390861 / +4.2% 0.64 / 0.67 / -4.6%
clickbench_q14/datafusion:parquet 102531810 / 101533862 / +1.0% 175790656 / 171095019 / +2.7% 0.58 / 0.59 / -1.7%
clickbench_q15/datafusion:parquet 70916932 / 71385336 / -0.7% 134692824 / 130197850 / +3.5% 0.53 / 0.55 / -4.0%
clickbench_q16/datafusion:parquet 154748510 / 156521500 / -1.1% 234349838 / 231541784 / +1.2% 0.66 / 0.68 / -2.3%
clickbench_q17/datafusion:parquet 154854314 / 156691337 / -1.2% 236755191 / 235073032 / +0.7% 0.65 / 0.67 / -1.9%
clickbench_q18/datafusion:parquet 311884375 / 310499588 / +0.4% 424740763 / 413442675 / +2.7% 0.73 / 0.75 / -2.2%
clickbench_q19/datafusion:parquet 19151828 / 19140822 / +0.1% 81210347 / 75184416 / +8.0% 0.24 / 0.25 / -7.4%
clickbench_q20/datafusion:parquet 178682070 / 178435465 / +0.1% 300236270 / 274002263 / +9.6% 0.60 / 0.65 / -8.6%
clickbench_q21/datafusion:parquet 173438798 / 174644394 / -0.7% 316260247 / 288634322 / +9.6% 0.55 / 0.61 / -9.4%
clickbench_q22/datafusion:parquet 261283750 / 263150886 / -0.7% 456663505 / 411129694 / +11.1% 🔴 0.57 / 0.64 / -10.6%
clickbench_q23/datafusion:parquet 1010073586 / 1009422786 / +0.1% 1192338544 / 1164432392 / +2.4% 0.85 / 0.87 / -2.3%
clickbench_q24/datafusion:parquet 30145313 / 30127838 / +0.1% 90763137 / 84963961 / +6.8% 0.33 / 0.35 / -6.3%
clickbench_q25/datafusion:parquet 36492044 / 36991131 / -1.3% 106065526 / 97037672 / +9.3% 0.34 / 0.38 / -9.7%
clickbench_q26/datafusion:parquet 30841278 / 30446253 / +1.3% 95624907 / 85341978 / +12.0% 🔴 0.32 / 0.36 / -9.6%
clickbench_q27/datafusion:parquet 190477572 / 193438081 / -1.5% 309428373 / 280513803 / +10.3% 🔴 0.62 / 0.69 / -10.7%
clickbench_q28/datafusion:parquet 619023515 / 620411100 / -0.2% 708209418 / 701759309 / +0.9% 0.87 / 0.88 / -1.1%
clickbench_q29/datafusion:parquet 29658637 / 28878419 / +2.7% 92963181 / 87859915 / +5.8% 0.32 / 0.33 / -2.9%
clickbench_q30/datafusion:parquet 90569734 / 91112722 / -0.6% 179080891 / 164952779 / +8.6% 0.51 / 0.55 / -8.4%
clickbench_q31/datafusion:parquet 101918224 / 102393314 / -0.5% 206023658 / 188795404 / +9.1% 0.49 / 0.54 / -8.8%
clickbench_q32/datafusion:parquet 305016430 / 306850998 / -0.6% 432464906 / 422144165 / +2.4% 0.71 / 0.73 / -3.0%
clickbench_q33/datafusion:parquet 374640502 / 379219060 / -1.2% 477465542 / 464231005 / +2.9% 0.78 / 0.82 / -3.9%
clickbench_q34/datafusion:parquet 376439537 / 379567914 / -0.8% 476361694 / 469556487 / +1.4% 0.79 / 0.81 / -2.2%
clickbench_q35/datafusion:parquet 63777686 / 65439958 / -2.5% 126367287 / 120113120 / +5.2% 0.50 / 0.54 / -7.4%
clickbench_q36/datafusion:parquet 73734957 / 73589438 / +0.2% 136339725 / 133078979 / +2.5% 0.54 / 0.55 / -2.2%
clickbench_q37/datafusion:parquet 35650258 / 35627338 / +0.1% 92963695 / 88762248 / +4.7% 0.38 / 0.40 / -4.5%
clickbench_q38/datafusion:parquet 47640781 / 47976322 / -0.7% 109045638 / 105295792 / +3.6% 0.44 / 0.46 / -4.1%
clickbench_q39/datafusion:parquet 143321463 / 144869072 / -1.1% 211490802 / 204817233 / +3.3% 0.68 / 0.71 / -4.2%
clickbench_q40/datafusion:parquet 19824982 / 20301300 / -2.3% 78128217 / 74218408 / +5.3% 0.25 / 0.27 / -7.2%
clickbench_q41/datafusion:parquet 18622706 / 18813406 / -1.0% 76978424 / 73273460 / +5.1% 0.24 / 0.26 / -5.8%
clickbench_q42/datafusion:parquet 19224862 / 19346648 / -0.6% 74778430 / 73339660 / +2.0% 0.26 / 0.26 / -2.5%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2214356 / 2163700 / +2.3% 25061150 / 25250904 / -0.8% 0.09 / 0.09 / +3.1%
clickbench_q01/duckdb:vortex-file-compressed 7034362 / 7725858 / -9.0% 27475494 / 28778460 / -4.5% 0.26 / 0.27 / -4.6%
clickbench_q02/duckdb:vortex-file-compressed 9244483 / 9085444 / +1.8% 36518282 / 34825538 / +4.9% 0.25 / 0.26 / -3.0%
clickbench_q03/duckdb:vortex-file-compressed 14515904 / 13973398 / +3.9% 47837190 / 45313604 / +5.6% 0.30 / 0.31 / -1.6%
clickbench_q04/duckdb:vortex-file-compressed 56797061 / 56291414 / +0.9% 88276646 / 88211533 / +0.1% 0.64 / 0.64 / +0.8%
clickbench_q05/duckdb:vortex-file-compressed 63651152 / 64644272 / -1.5% 95229709 / 95370169 / -0.1% 0.67 / 0.68 / -1.4%
clickbench_q06/duckdb:vortex-file-compressed 2737973 / 2686996 / +1.9% 32271944 / 32023593 / +0.8% 0.08 / 0.08 / +1.1%
clickbench_q07/duckdb:vortex-file-compressed 9669052 / 8960315 / +7.9% 29459933 / 28943376 / +1.8% 0.33 / 0.31 / +6.0%
clickbench_q08/duckdb:vortex-file-compressed 69983216 / 69364688 / +0.9% 105260821 / 101166069 / +4.0% 0.66 / 0.69 / -3.0%
clickbench_q09/duckdb:vortex-file-compressed 93259688 / 93827830 / -0.6% 129994624 / 127524308 / +1.9% 0.72 / 0.74 / -2.5%
clickbench_q10/duckdb:vortex-file-compressed 27320385 / 27093668 / +0.8% 69741847 / 64537471 / +8.1% 0.39 / 0.42 / -6.7%
clickbench_q11/duckdb:vortex-file-compressed 30242278 / 29699608 / +1.8% 72763803 / 65353232 / +11.3% 🔴 0.42 / 0.45 / -8.5%
clickbench_q12/duckdb:vortex-file-compressed 68818137 / 69885074 / -1.5% 100412351 / 101476526 / -1.0% 0.69 / 0.69 / -0.5%
clickbench_q13/duckdb:vortex-file-compressed 118459639 / 120024786 / -1.3% 166449085 / 157173766 / +5.9% 0.71 / 0.76 / -6.8%
clickbench_q14/duckdb:vortex-file-compressed 72669511 / 72815816 / -0.2% 102443222 / 99477257 / +3.0% 0.71 / 0.73 / -3.1%
clickbench_q15/duckdb:vortex-file-compressed 78439328 / 75826807 / +3.4% 111182183 / 106318686 / +4.6% 0.71 / 0.71 / -1.1%
clickbench_q16/duckdb:vortex-file-compressed 135240224 / 136209116 / -0.7% 169216142 / 168007654 / +0.7% 0.80 / 0.81 / -1.4%
clickbench_q17/duckdb:vortex-file-compressed 138152347 / 140782358 / -1.9% 171337805 / 168909305 / +1.4% 0.81 / 0.83 / -3.3%
clickbench_q18/duckdb:vortex-file-compressed 258746140 / 256659876 / +0.8% 305643795 / 301568081 / +1.4% 0.85 / 0.85 / -0.5%
clickbench_q19/duckdb:vortex-file-compressed 9024026 / 8967074 / +0.6% 37912347 / 34947684 / +8.5% 0.24 / 0.26 / -7.2%
clickbench_q20/duckdb:vortex-file-compressed 67286888 / 68020421 / -1.1% 171072196 / 161918172 / +5.7% 0.39 / 0.42 / -6.4%
clickbench_q21/duckdb:vortex-file-compressed 78073874 / 77119758 / +1.2% 191410493 / 184241318 / +3.9% 0.41 / 0.42 / -2.6%
clickbench_q22/duckdb:vortex-file-compressed 129519162 / 130503559 / -0.8% 324117754 / 306109023 / +5.9% 0.40 / 0.43 / -6.3%
clickbench_q23/duckdb:vortex-file-compressed 64172170 / 60142910 / +6.7% 180182743 / 180493683 / -0.2% 0.36 / 0.33 / +6.9%
clickbench_q24/duckdb:vortex-file-compressed 17123792 / 16960741 / +1.0% 48456414 / 41719215 / +16.1% 🔴 0.35 / 0.41 / -13.1%
clickbench_q25/duckdb:vortex-file-compressed 17785192 / 18143080 / -2.0% 53022903 / 49864753 / +6.3% 0.34 / 0.36 / -7.8%
clickbench_q26/duckdb:vortex-file-compressed 13574217 / 14077588 / -3.6% 46047978 / 45131652 / +2.0% 0.29 / 0.31 / -5.5%
clickbench_q27/duckdb:vortex-file-compressed 51840314 / 51972312 / -0.3% 178433445 / 172525401 / +3.4% 0.29 / 0.30 / -3.6%
clickbench_q28/duckdb:vortex-file-compressed 513155742 / 514614381 / -0.3% 559257043 / 553818925 / +1.0% 0.92 / 0.93 / -1.3%
clickbench_q29/duckdb:vortex-file-compressed 17486776 / 16854381 / +3.8% 46888488 / 38854932 / +20.7% 🔴 0.37 / 0.43 / -14.0%
clickbench_q30/duckdb:vortex-file-compressed 59832265 / 59564397 / +0.4% 108949286 / 103929202 / +4.8% 0.55 / 0.57 / -4.2%
clickbench_q31/duckdb:vortex-file-compressed 109519880 / 109700525 / -0.2% 178859708 / 164062261 / +9.0% 0.61 / 0.67 / -8.4%
clickbench_q32/duckdb:vortex-file-compressed 380473949 / 365385784 / +4.1% 396173177 / 404386667 / -2.0% 0.96 / 0.90 / +6.3%
clickbench_q33/duckdb:vortex-file-compressed 343385829 / 346688428 / -1.0% 406128395 / 400414557 / +1.4% 0.85 / 0.87 / -2.3%
clickbench_q34/duckdb:vortex-file-compressed 353646812 / 355434224 / -0.5% 412490418 / 411037829 / +0.4% 0.86 / 0.86 / -0.9%
clickbench_q35/duckdb:vortex-file-compressed 59966100 / 57812444 / +3.7% 90168607 / 85459891 / +5.5% 0.67 / 0.68 / -1.7%
clickbench_q36/duckdb:vortex-file-compressed 11220509 / 11000406 / +2.0% 31988498 / 33898052 / -5.6% 0.35 / 0.32 / +8.1%
clickbench_q37/duckdb:vortex-file-compressed 7664900 / 7526524 / +1.8% 29868494 / 27976724 / +6.8% 0.26 / 0.27 / -4.6%
clickbench_q38/duckdb:vortex-file-compressed 8021758 / 8277929 / -3.1% 28511855 / 27815312 / +2.5% 0.28 / 0.30 / -5.5%
clickbench_q39/duckdb:vortex-file-compressed 18642155 / 18249022 / +2.2% 40685927 / 38728043 / +5.1% 0.46 / 0.47 / -2.8%
clickbench_q40/duckdb:vortex-file-compressed 6933912 / 6877520 / +0.8% 30182456 / 28043702 / +7.6% 0.23 / 0.25 / -6.3%
clickbench_q41/duckdb:vortex-file-compressed 7927928 / 7856708 / +0.9% 29485406 / 27411574 / +7.6% 0.27 / 0.29 / -6.2%
clickbench_q42/duckdb:vortex-file-compressed 7138406 / 7088280 / +0.7% 27850862 / 27407780 / +1.6% 0.26 / 0.26 / -0.9%
duckdb / parquet / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9598100 / 9624200 / -0.3% 14832230 / 13726171 / +8.1% 0.65 / 0.70 / -7.7%
clickbench_q01/duckdb:parquet 14862250 / 15603995 / -4.8% 20585262 / 21366397 / -3.7% 0.72 / 0.73 / -1.1%
clickbench_q02/duckdb:parquet 22125456 / 22024260 / +0.5% 29916216 / 31594054 / -5.3% 0.74 / 0.70 / +6.1%
clickbench_q03/duckdb:parquet 22902984 / 23114718 / -0.9% 33734244 / 36182809 / -6.8% 0.68 / 0.64 / +6.3%
clickbench_q04/duckdb:parquet 61993914 / 61524598 / +0.8% 73756529 / 74197280 / -0.6% 0.84 / 0.83 / +1.4%
clickbench_q05/duckdb:parquet 82749262 / 82957263 / -0.3% 95807130 / 94913278 / +0.9% 0.86 / 0.87 / -1.2%
clickbench_q06/duckdb:parquet 20574021 / 20151859 / +2.1% 28873872 / 29646732 / -2.6% 0.71 / 0.68 / +4.8%
clickbench_q07/duckdb:parquet 17592191 / 16772958 / +4.9% 25442158 / 22667245 / +12.2% 🔴 0.69 / 0.74 / -6.6%
clickbench_q08/duckdb:parquet 74869718 / 73823596 / +1.4% 88905441 / 91589599 / -2.9% 0.84 / 0.81 / +4.5%
clickbench_q09/duckdb:parquet 101139826 / 102800255 / -1.6% 120769660 / 116235491 / +3.9% 0.84 / 0.88 / -5.3%
clickbench_q10/duckdb:parquet 41227555 / 41073835 / +0.4% 54794591 / 56050447 / -2.2% 0.75 / 0.73 / +2.7%
clickbench_q11/duckdb:parquet 46457154 / 47187216 / -1.5% 62152906 / 61978625 / +0.3% 0.75 / 0.76 / -1.8%
clickbench_q12/duckdb:parquet 92645626 / 91151242 / +1.6% 106462298 / 108785397 / -2.1% 0.87 / 0.84 / +3.9%
clickbench_q13/duckdb:parquet 150564521 / 150483028 / +0.1% 168002056 / 166152116 / +1.1% 0.90 / 0.91 / -1.0%
clickbench_q14/duckdb:parquet 100869304 / 102132483 / -1.2% 119212556 / 115549679 / +3.2% 0.85 / 0.88 / -4.3%
clickbench_q15/duckdb:parquet 86839242 / 86135994 / +0.8% 105416956 / 102393172 / +3.0% 0.82 / 0.84 / -2.1%
clickbench_q16/duckdb:parquet 169012142 / 165234460 / +2.3% 175363423 / 176904367 / -0.9% 0.96 / 0.93 / +3.2%
clickbench_q17/duckdb:parquet 163318318 / 162489984 / +0.5% 180631603 / 178691671 / +1.1% 0.90 / 0.91 / -0.6%
clickbench_q18/duckdb:parquet 291636452 / 292460092 / -0.3% 316455794 / 316949139 / -0.2% 0.92 / 0.92 / -0.1%
clickbench_q19/duckdb:parquet 19626518 / 19465951 / +0.8% 25376417 / 27495715 / -7.7% 0.77 / 0.71 / +9.2%
clickbench_q20/duckdb:parquet 175874764 / 180766146 / -2.7% 227122681 / 233034220 / -2.5% 0.77 / 0.78 / -0.2%
clickbench_q21/duckdb:parquet 215426640 / 213575454 / +0.9% 269659527 / 254375561 / +6.0% 0.80 / 0.84 / -4.9%
clickbench_q22/duckdb:parquet 306564536 / 312359604 / -1.9% 360533135 / 359231600 / +0.4% 0.85 / 0.87 / -2.2%
clickbench_q23/duckdb:parquet 173607194 / 173395286 / +0.1% 225482727 / 243845147 / -7.5% 0.77 / 0.71 / +8.3%
clickbench_q24/duckdb:parquet 30068148 / 30618639 / -1.8% 32557677 / 46088263 / -29.4% 🟢 0.92 / 0.66 / +39.0%
clickbench_q25/duckdb:parquet 41863804 / 42882559 / -2.4% 55931756 / 57201532 / -2.2% 0.75 / 0.75 / -0.2%
clickbench_q26/duckdb:parquet 31514545 / 30258512 / +4.2% 45054246 / 43013125 / +4.7% 0.70 / 0.70 / -0.6%
clickbench_q27/duckdb:parquet 189225660 / 187858154 / +0.7% 225863234 / 226671161 / -0.4% 0.84 / 0.83 / +1.1%
clickbench_q28/duckdb:parquet 975169570 / 946139367 / +3.1% 973564416 / 939968235 / +3.6% 1.00 / 1.01 / -0.5%
clickbench_q29/duckdb:parquet 24046913 / 23913753 / +0.6% 32446261 / 31250684 / +3.8% 0.74 / 0.77 / -3.1%
clickbench_q30/duckdb:parquet 105381270 / 105896126 / -0.5% 124793601 / 126651278 / -1.5% 0.84 / 0.84 / +1.0%
clickbench_q31/duckdb:parquet 133855340 / 157886378 / -15.2% 🟢 173488891 / 172852237 / +0.4% 0.77 / 0.91 / -15.5%
clickbench_q32/duckdb:parquet 381763646 / 389393022 / -2.0% 408586928 / 410824000 / -0.5% 0.93 / 0.95 / -1.4%
clickbench_q33/duckdb:parquet 464042326 / 478062996 / -2.9% 445172275 / 443591749 / +0.4% 1.04 / 1.08 / -3.3%
clickbench_q34/duckdb:parquet 460192390 / 478891495 / -3.9% 449804371 / 454808091 / -1.1% 1.02 / 1.05 / -2.8%
clickbench_q35/duckdb:parquet 61556326 / 60733335 / +1.4% 74814484 / 74446075 / +0.5% 0.82 / 0.82 / +0.9%
clickbench_q36/duckdb:parquet 30278376 / 29898844 / +1.3% 35969782 / 35257182 / +2.0% 0.84 / 0.85 / -0.7%
clickbench_q37/duckdb:parquet 23409946 / 22942346 / +2.0% 29344636 / 29142035 / +0.7% 0.80 / 0.79 / +1.3%
clickbench_q38/duckdb:parquet 23291648 / 24025472 / -3.1% 30230698 / 28702401 / +5.3% 0.77 / 0.84 / -8.0%
clickbench_q39/duckdb:parquet 52746816 / 53076837 / -0.6% 59779834 / 59510601 / +0.5% 0.88 / 0.89 / -1.1%
clickbench_q40/duckdb:parquet 14696276 / 14327934 / +2.6% 19925845 / 20267982 / -1.7% 0.74 / 0.71 / +4.3%
clickbench_q41/duckdb:parquet 15829637 / 15770624 / +0.4% 20441283 / 20784041 / -1.6% 0.77 / 0.76 / +2.1%
clickbench_q42/duckdb:parquet 13913872 / 14181922 / -1.9% 21090594 / 20599127 / +2.4% 0.66 / 0.69 / -4.2%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 0fbea339 vs base a1fbac67
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.9%, environment too noisy confidence) · DuckDB No clear signal (+0.5%, environment too noisy confidence)
Vortex (geomean): hot 0.932x ➖ · cold 0.945x ➖
Parquet (geomean): hot 0.934x ➖ · cold 0.921x ➖
Shifts: Parquet (control) -6.6% · Median polish -8.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.891x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 222510052 / 223458269 / -0.4% 596336429 / 816164338 / -26.9% 0.37 / 0.27 / +36.3%
tpch_q02/datafusion:vortex-file-compressed 359808481 / 351067010 / +2.5% 629829014 / 765204459 / -17.7% 0.57 / 0.46 / +24.5%
tpch_q03/datafusion:vortex-file-compressed 327210649 / 341903991 / -4.3% 818092936 / 1285385295 / -36.4% 🟢 0.40 / 0.27 / +50.4%
tpch_q04/datafusion:vortex-file-compressed 177648558 / 246325129 / -27.9% 394027778 / 663518167 / -40.6% 🟢 0.45 / 0.37 / +21.4%
tpch_q05/datafusion:vortex-file-compressed 360417959 / 607461228 / -40.7% 🟢 562873248 / 780032475 / -27.8% 0.64 / 0.78 / -17.8%
tpch_q06/datafusion:vortex-file-compressed 184209547 / 150853964 / +22.1% 435201170 / 367094635 / +18.6% 0.42 / 0.41 / +3.0%
tpch_q07/datafusion:vortex-file-compressed 432765423 / 584124955 / -25.9% 674110874 / 696859817 / -3.3% 0.64 / 0.84 / -23.4%
tpch_q08/datafusion:vortex-file-compressed 537950398 / 611609339 / -12.0% 765187974 / 608363076 / +25.8% 0.70 / 1.01 / -30.1%
tpch_q09/datafusion:vortex-file-compressed 310236718 / 316068880 / -1.8% 478493612 / 529622798 / -9.7% 0.65 / 0.60 / +8.6%
tpch_q10/datafusion:vortex-file-compressed 396304342 / 461917774 / -14.2% 590473264 / 655505088 / -9.9% 0.67 / 0.70 / -4.8%
tpch_q11/datafusion:vortex-file-compressed 293087105 / 316549801 / -7.4% 492598216 / 474238244 / +3.9% 0.59 / 0.67 / -10.9%
tpch_q12/datafusion:vortex-file-compressed 237665043 / 230982246 / +2.9% 545787299 / 451624552 / +20.8% 0.44 / 0.51 / -14.9%
tpch_q13/datafusion:vortex-file-compressed 108354825 / 123507937 / -12.3% 375080060 / 298425357 / +25.7% 0.29 / 0.41 / -30.2%
tpch_q14/datafusion:vortex-file-compressed 183961427 / 190310432 / -3.3% 334649027 / 386347820 / -13.4% 0.55 / 0.49 / +11.6%
tpch_q15/datafusion:vortex-file-compressed 295826997 / 320171947 / -7.6% 644424392 / 626450141 / +2.9% 0.46 / 0.51 / -10.2%
tpch_q16/datafusion:vortex-file-compressed 143435671 / 136624230 / +5.0% 308332642 / 334564913 / -7.8% 0.47 / 0.41 / +13.9%
tpch_q17/datafusion:vortex-file-compressed 261339402 / 287183601 / -9.0% 584813427 / 484402516 / +20.7% 0.45 / 0.59 / -24.6%
tpch_q18/datafusion:vortex-file-compressed 228338058 / 441388706 / -48.3% 🟢 449857532 / 699779205 / -35.7% 🟢 0.51 / 0.63 / -19.5%
tpch_q19/datafusion:vortex-file-compressed 243409647 / 236689467 / +2.8% 609980348 / 387364130 / +57.5% 🔴 0.40 / 0.61 / -34.7%
tpch_q20/datafusion:vortex-file-compressed 330600459 / 302040813 / +9.5% 460681697 / 510679474 / -9.8% 0.72 / 0.59 / +21.3%
tpch_q21/datafusion:vortex-file-compressed 461695728 / 610134440 / -24.3% 787881745 / 1437075412 / -45.2% 🟢 0.59 / 0.42 / +38.0%
tpch_q22/datafusion:vortex-file-compressed 154920362 / 173007818 / -10.5% 365011762 / 396224244 / -7.9% 0.42 / 0.44 / -2.8%
datafusion / parquet / ns (0.899x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 151445699 / 169425231 / -10.6% 514714709 / 504871448 / +1.9% 0.29 / 0.34 / -12.3%
tpch_q02/datafusion:parquet 270279747 / 286293270 / -5.6% 474206120 / 556480028 / -14.8% 0.57 / 0.51 / +10.8%
tpch_q03/datafusion:parquet 217894917 / 290515310 / -25.0% 709470561 / 799957591 / -11.3% 0.31 / 0.36 / -15.4%
tpch_q04/datafusion:parquet 124488807 / 156982158 / -20.7% 287378236 / 423342890 / -32.1% 🟢 0.43 / 0.37 / +16.8%
tpch_q05/datafusion:parquet 343159958 / 421510596 / -18.6% 499113959 / 525127471 / -5.0% 0.69 / 0.80 / -14.3%
tpch_q06/datafusion:parquet 110042470 / 111746947 / -1.5% 236831132 / 236212733 / +0.3% 0.46 / 0.47 / -1.8%
tpch_q07/datafusion:parquet 343402908 / 423167097 / -18.8% 447703217 / 582280192 / -23.1% 0.77 / 0.73 / +5.5%
tpch_q08/datafusion:parquet 396313677 / 473421661 / -16.3% 529901391 / 583659082 / -9.2% 0.75 / 0.81 / -7.8%
tpch_q09/datafusion:parquet 370155078 / 381870801 / -3.1% 539876446 / 553319649 / -2.4% 0.69 / 0.69 / -0.7%
tpch_q10/datafusion:parquet 298217074 / 352143306 / -15.3% 444498574 / 672080737 / -33.9% 🟢 0.67 / 0.52 / +28.0%
tpch_q11/datafusion:parquet 260679588 / 266414450 / -2.2% 376167264 / 365827052 / +2.8% 0.69 / 0.73 / -4.8%
tpch_q12/datafusion:parquet 169046306 / 185091682 / -8.7% 302956716 / 361342440 / -16.2% 0.56 / 0.51 / +8.9%
tpch_q13/datafusion:parquet 272337991 / 282117929 / -3.5% 422381447 / 565888994 / -25.4% 0.64 / 0.50 / +29.3%
tpch_q14/datafusion:parquet 161285062 / 158849302 / +1.5% 314563535 / 315384077 / -0.3% 0.51 / 0.50 / +1.8%
tpch_q15/datafusion:parquet 303382086 / 310511105 / -2.3% 656379217 / 480719873 / +36.5% 🔴 0.46 / 0.65 / -28.4%
tpch_q16/datafusion:parquet 100746086 / 107780204 / -6.5% 233624925 / 268737858 / -13.1% 0.43 / 0.40 / +7.5%
tpch_q17/datafusion:parquet 295366036 / 291726645 / +1.2% 648269310 / 505866073 / +28.2% 0.46 / 0.58 / -21.0%
tpch_q18/datafusion:parquet 334397880 / 327095707 / +2.2% 574362130 / 582522649 / -1.4% 0.58 / 0.56 / +3.7%
tpch_q19/datafusion:parquet 165406791 / 204045071 / -18.9% 397849605 / 311304702 / +27.8% 0.42 / 0.66 / -36.6%
tpch_q20/datafusion:parquet 251150583 / 296232555 / -15.2% 377321464 / 496730348 / -24.0% 0.67 / 0.60 / +11.6%
tpch_q21/datafusion:parquet 350364491 / 367920218 / -4.8% 491147738 / 521886968 / -5.9% 0.71 / 0.70 / +1.2%
tpch_q22/datafusion:parquet 144980216 / 184691744 / -21.5% 379692710 / 392883782 / -3.4% 0.38 / 0.47 / -18.8%
duckdb / vortex-file-compressed / ns (0.974x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 234880713 / 244107098 / -3.8% 258364877 / 314889647 / -18.0% 0.91 / 0.78 / +17.3%
tpch_q02/duckdb:vortex-file-compressed 433389827 / 424017244 / +2.2% 496105155 / 550926616 / -10.0% 0.87 / 0.77 / +13.5%
tpch_q03/duckdb:vortex-file-compressed 423418955 / 435838862 / -2.8% 472811797 / 498014858 / -5.1% 0.90 / 0.88 / +2.3%
tpch_q04/duckdb:vortex-file-compressed 242297781 / 287961973 / -15.9% 382660687 / 357301445 / +7.1% 0.63 / 0.81 / -21.4%
tpch_q05/duckdb:vortex-file-compressed 750688551 / 753437203 / -0.4% 736889315 / 617563333 / +19.3% 1.02 / 1.22 / -16.5%
tpch_q06/duckdb:vortex-file-compressed 171405580 / 216695042 / -20.9% 213740030 / 232969030 / -8.3% 0.80 / 0.93 / -13.8%
tpch_q07/duckdb:vortex-file-compressed 556346516 / 434059656 / +28.2% 788789922 / 894338511 / -11.8% 0.71 / 0.49 / +45.3%
tpch_q08/duckdb:vortex-file-compressed 598084652 / 595944997 / +0.4% 674633691 / 678434723 / -0.6% 0.89 / 0.88 / +0.9%
tpch_q09/duckdb:vortex-file-compressed 381478293 / 382843813 / -0.4% 437616347 / 599391638 / -27.0% 0.87 / 0.64 / +36.5%
tpch_q10/duckdb:vortex-file-compressed 542545179 / 568511228 / -4.6% 611635572 / 645795688 / -5.3% 0.89 / 0.88 / +0.8%
tpch_q11/duckdb:vortex-file-compressed 275407297 / 298103844 / -7.6% 313835467 / 301205533 / +4.2% 0.88 / 0.99 / -11.3%
tpch_q12/duckdb:vortex-file-compressed 225115108 / 263471079 / -14.6% 283909101 / 310868887 / -8.7% 0.79 / 0.85 / -6.4%
tpch_q13/duckdb:vortex-file-compressed 192432475 / 233548687 / -17.6% 262985366 / 246940944 / +6.5% 0.73 / 0.95 / -22.6%
tpch_q14/duckdb:vortex-file-compressed 219275573 / 249430763 / -12.1% 316636944 / 286405707 / +10.6% 0.69 / 0.87 / -20.5%
tpch_q15/duckdb:vortex-file-compressed 250442083 / 261718779 / -4.3% 279567987 / 282954292 / -1.2% 0.90 / 0.92 / -3.1%
tpch_q16/duckdb:vortex-file-compressed 193113011 / 209225095 / -7.7% 265047691 / 253527757 / +4.5% 0.73 / 0.83 / -11.7%
tpch_q17/duckdb:vortex-file-compressed 581231605 / 288424217 / +101.5% 🔴 737176918 / 333182632 / +121.3% 🔴 0.79 / 0.87 / -8.9%
tpch_q18/duckdb:vortex-file-compressed 327775313 / 356674706 / -8.1% 351403067 / 411589033 / -14.6% 0.93 / 0.87 / +7.6%
tpch_q19/duckdb:vortex-file-compressed 276311717 / 299153763 / -7.6% 385660174 / 418688214 / -7.9% 0.72 / 0.71 / +0.3%
tpch_q20/duckdb:vortex-file-compressed 379286039 / 348878313 / +8.7% 459701422 / 556508025 / -17.4% 0.83 / 0.63 / +31.6%
tpch_q21/duckdb:vortex-file-compressed 519698060 / 642778203 / -19.1% 681221821 / 840162507 / -18.9% 0.76 / 0.77 / -0.3%
tpch_q22/duckdb:vortex-file-compressed 222664389 / 231904309 / -4.0% 276090525 / 306438123 / -9.9% 0.81 / 0.76 / +6.6%
duckdb / parquet / ns (0.970x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 162490431 / 165763230 / -2.0% 235992365 / 179005304 / +31.8% 🔴 0.69 / 0.93 / -25.6%
tpch_q02/duckdb:parquet 469001207 / 454450305 / +3.2% 434998833 / 485604708 / -10.4% 1.08 / 0.94 / +15.2%
tpch_q03/duckdb:parquet 395713639 / 470100333 / -15.8% 433345592 / 682756834 / -36.5% 🟢 0.91 / 0.69 / +32.6%
tpch_q04/duckdb:parquet 260216846 / 261566944 / -0.5% 296567609 / 317168830 / -6.5% 0.88 / 0.82 / +6.4%
tpch_q05/duckdb:parquet 473006384 / 540547468 / -12.5% 574225625 / 577647697 / -0.6% 0.82 / 0.94 / -12.0%
tpch_q06/duckdb:parquet 126397816 / 187589701 / -32.6% 🟢 168873991 / 170482454 / -0.9% 0.75 / 1.10 / -32.0%
tpch_q07/duckdb:parquet 462381409 / 543669665 / -15.0% 455029217 / 572402598 / -20.5% 1.02 / 0.95 / +7.0%
tpch_q08/duckdb:parquet 587587143 / 638811789 / -8.0% 601508535 / 699255808 / -14.0% 0.98 / 0.91 / +6.9%
tpch_q09/duckdb:parquet 586859030 / 552862803 / +6.1% 589578413 / 641595172 / -8.1% 1.00 / 0.86 / +15.5%
tpch_q10/duckdb:parquet 576880509 / 569110736 / +1.4% 633289574 / 654452222 / -3.2% 0.91 / 0.87 / +4.8%
tpch_q11/duckdb:parquet 311735820 / 307876079 / +1.3% 335411520 / 401319333 / -16.4% 0.93 / 0.77 / +21.1%
tpch_q12/duckdb:parquet 253751445 / 221915138 / +14.3% 305235452 / 338257266 / -9.8% 0.83 / 0.66 / +26.7%
tpch_q13/duckdb:parquet 348733418 / 394973350 / -11.7% 434030406 / 428675690 / +1.2% 0.80 / 0.92 / -12.8%
tpch_q14/duckdb:parquet 220877166 / 270304721 / -18.3% 237411437 / 345052860 / -31.2% 🟢 0.93 / 0.78 / +18.8%
tpch_q15/duckdb:parquet 408026229 / 194674385 / +109.6% 🔴 459926982 / 276806949 / +66.2% 🔴 0.89 / 0.70 / +26.1%
tpch_q16/duckdb:parquet 241917388 / 275649108 / -12.2% 251328062 / 264647071 / -5.0% 0.96 / 1.04 / -7.6%
tpch_q17/duckdb:parquet 262723023 / 283976251 / -7.5% 252082087 / 316927253 / -20.5% 1.04 / 0.90 / +16.3%
tpch_q18/duckdb:parquet 355779640 / 354608309 / +0.3% 391202422 / 399377905 / -2.0% 0.91 / 0.89 / +2.4%
tpch_q19/duckdb:parquet 256924108 / 290194556 / -11.5% 319052975 / 348811161 / -8.5% 0.81 / 0.83 / -3.2%
tpch_q20/duckdb:parquet 458371060 / 495553093 / -7.5% 510635200 / 516870169 / -1.2% 0.90 / 0.96 / -6.4%
tpch_q21/duckdb:parquet 486296332 / 406167985 / +19.7% 474765652 / 475621321 / -0.2% 1.02 / 0.85 / +19.9%
tpch_q22/duckdb:parquet 284860646 / 329108422 / -13.4% 346654206 / 617083316 / -43.8% 🟢 0.82 / 0.53 / +54.1%

@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 0fbea339 vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35713868 / 35836658 / -0.3% 59743664 / 59839649 / -0.2% 0.60 / 0.60 / -0.2%
tpcds_q02/datafusion:vortex-file-compressed 49590564 / 51540980 / -3.8% 74629063 / 75356430 / -1.0% 0.66 / 0.68 / -2.8%
tpcds_q03/datafusion:vortex-file-compressed 20638913 / 20246396 / +1.9% 46162948 / 46166223 / -0.0% 0.45 / 0.44 / +1.9%
tpcds_q04/datafusion:vortex-file-compressed 292221444 / 293432920 / -0.4% 353557714 / 354050198 / -0.1% 0.83 / 0.83 / -0.3%
tpcds_q05/datafusion:vortex-file-compressed 74574128 / 71656747 / +4.1% 102568059 / 107692212 / -4.8% 0.73 / 0.67 / +9.3%
tpcds_q06/datafusion:vortex-file-compressed 42488206 / 42258217 / +0.5% 70393919 / 70535607 / -0.2% 0.60 / 0.60 / +0.7%
tpcds_q07/datafusion:vortex-file-compressed 41803196 / 42156216 / -0.8% 79935662 / 80613054 / -0.8% 0.52 / 0.52 / +0.0%
tpcds_q08/datafusion:vortex-file-compressed 28197728 / 28614063 / -1.5% 54186192 / 57730721 / -6.1% 0.52 / 0.50 / +5.0%
tpcds_q09/datafusion:vortex-file-compressed 41858596 / 44012164 / -4.9% 79008152 / 77101674 / +2.5% 0.53 / 0.57 / -7.2%
tpcds_q10/datafusion:vortex-file-compressed 37463950 / 37189576 / +0.7% 62810578 / 63021635 / -0.3% 0.60 / 0.59 / +1.1%
tpcds_q11/datafusion:vortex-file-compressed 176773805 / 174495550 / +1.3% 222000591 / 221987691 / +0.0% 0.80 / 0.79 / +1.3%
tpcds_q12/datafusion:vortex-file-compressed 17728803 / 17549844 / +1.0% 36299441 / 38571171 / -5.9% 0.49 / 0.45 / +7.3%
tpcds_q13/datafusion:vortex-file-compressed 38975550 / 38899632 / +0.2% 83124602 / 85520203 / -2.8% 0.47 / 0.45 / +3.1%
tpcds_q14/datafusion:vortex-file-compressed 239037466 / 231725092 / +3.2% 269213364 / 271215982 / -0.7% 0.89 / 0.85 / +3.9%
tpcds_q15/datafusion:vortex-file-compressed 40455752 / 40095029 / +0.9% 60790992 / 54164984 / +12.2% 🔴 0.67 / 0.74 / -10.1%
tpcds_q16/datafusion:vortex-file-compressed 23228272 / 22869641 / +1.6% 43013626 / 42034772 / +2.3% 0.54 / 0.54 / -0.7%
tpcds_q17/datafusion:vortex-file-compressed 64696556 / 64808376 / -0.2% 99937429 / 89558176 / +11.6% 🔴 0.65 / 0.72 / -10.5%
tpcds_q18/datafusion:vortex-file-compressed 68429950 / 69097730 / -1.0% 95085977 / 94787906 / +0.3% 0.72 / 0.73 / -1.3%
tpcds_q19/datafusion:vortex-file-compressed 23159520 / 22408799 / +3.4% 53238106 / 55496169 / -4.1% 0.44 / 0.40 / +7.7%
tpcds_q20/datafusion:vortex-file-compressed 22981750 / 23702741 / -3.0% 39571638 / 40220803 / -1.6% 0.58 / 0.59 / -1.5%
tpcds_q21/datafusion:vortex-file-compressed 47313084 / 47542674 / -0.5% 75521766 / 64058585 / +17.9% 🔴 0.63 / 0.74 / -15.6%
tpcds_q22/datafusion:vortex-file-compressed 438118197 / 431366016 / +1.6% 457145515 / 465284097 / -1.7% 0.96 / 0.93 / +3.4%
tpcds_q23/datafusion:vortex-file-compressed 297785324 / 299587271 / -0.6% 345477084 / 351318540 / -1.7% 0.86 / 0.85 / +1.1%
tpcds_q24/datafusion:vortex-file-compressed 116959095 / 120023524 / -2.6% 153211259 / 159982078 / -4.2% 0.76 / 0.75 / +1.8%
tpcds_q25/datafusion:vortex-file-compressed 63109834 / 63311010 / -0.3% 100364894 / 102454935 / -2.0% 0.63 / 0.62 / +1.8%
tpcds_q26/datafusion:vortex-file-compressed 36876242 / 37429288 / -1.5% 59357220 / 59331611 / +0.0% 0.62 / 0.63 / -1.5%
tpcds_q27/datafusion:vortex-file-compressed 72056450 / 72377160 / -0.4% 104242732 / 104225546 / +0.0% 0.69 / 0.69 / -0.5%
tpcds_q28/datafusion:vortex-file-compressed 43157867 / 42296916 / +2.0% 79107748 / 82755038 / -4.4% 0.55 / 0.51 / +6.7%
tpcds_q29/datafusion:vortex-file-compressed 65457024 / 61922299 / +5.7% 96866284 / 97201813 / -0.3% 0.68 / 0.64 / +6.1%
tpcds_q30/datafusion:vortex-file-compressed 50917912 / 51311054 / -0.8% 81192992 / 79114003 / +2.6% 0.63 / 0.65 / -3.3%
tpcds_q31/datafusion:vortex-file-compressed 199585010 / 196557266 / +1.5% 228385860 / 235875877 / -3.2% 0.87 / 0.83 / +4.9%
tpcds_q32/datafusion:vortex-file-compressed 15350283 / 15236954 / +0.7% 30878120 / 31554300 / -2.1% 0.50 / 0.48 / +2.9%
tpcds_q33/datafusion:vortex-file-compressed 33168653 / 33321710 / -0.5% 68024496 / 67027574 / +1.5% 0.49 / 0.50 / -1.9%
tpcds_q34/datafusion:vortex-file-compressed 40287461 / 41148345 / -2.1% 70685062 / 68234625 / +3.6% 0.57 / 0.60 / -5.5%
tpcds_q35/datafusion:vortex-file-compressed 92343183 / 92443260 / -0.1% 120091578 / 120652799 / -0.5% 0.77 / 0.77 / +0.4%
tpcds_q36/datafusion:vortex-file-compressed 66821636 / 65946206 / +1.3% 101022527 / 100250170 / +0.8% 0.66 / 0.66 / +0.6%
tpcds_q37/datafusion:vortex-file-compressed 26506531 / 23553139 / +12.5% 🔴 47181010 / 43598667 / +8.2% 0.56 / 0.54 / +4.0%
tpcds_q38/datafusion:vortex-file-compressed 79561396 / 76507711 / +4.0% 107650900 / 106221269 / +1.3% 0.74 / 0.72 / +2.6%
tpcds_q39/datafusion:vortex-file-compressed 881139998 / 887680404 / -0.7% 907107779 / 906829393 / +0.0% 0.97 / 0.98 / -0.8%
tpcds_q40/datafusion:vortex-file-compressed 28593521 / 28735451 / -0.5% 48522204 / 47789817 / +1.5% 0.59 / 0.60 / -2.0%
tpcds_q41/datafusion:vortex-file-compressed 19912586 / 19056672 / +4.5% 32124742 / 30560191 / +5.1% 0.62 / 0.62 / -0.6%
tpcds_q42/datafusion:vortex-file-compressed 14061821 / 14306364 / -1.7% 39171530 / 39330916 / -0.4% 0.36 / 0.36 / -1.3%
tpcds_q43/datafusion:vortex-file-compressed 18088306 / 17123520 / +5.6% 39360587 / 40887604 / -3.7% 0.46 / 0.42 / +9.7%
tpcds_q44/datafusion:vortex-file-compressed 42660625 / 42841783 / -0.4% 71441990 / 73034215 / -2.2% 0.60 / 0.59 / +1.8%
tpcds_q45/datafusion:vortex-file-compressed 42885172 / 42716522 / +0.4% 60850210 / 64325351 / -5.4% 0.70 / 0.66 / +6.1%
tpcds_q46/datafusion:vortex-file-compressed 74402922 / 70770951 / +5.1% 105149739 / 103002911 / +2.1% 0.71 / 0.69 / +3.0%
tpcds_q47/datafusion:vortex-file-compressed 173379145 / 176930862 / -2.0% 220144576 / 217533458 / +1.2% 0.79 / 0.81 / -3.2%
tpcds_q48/datafusion:vortex-file-compressed 35597659 / 35477019 / +0.3% 69333242 / 70167195 / -1.2% 0.51 / 0.51 / +1.5%
tpcds_q49/datafusion:vortex-file-compressed 81925434 / 79901468 / +2.5% 117607689 / 120233831 / -2.2% 0.70 / 0.66 / +4.8%
tpcds_q50/datafusion:vortex-file-compressed 55198798 / 56310110 / -2.0% 90282496 / 89046429 / +1.4% 0.61 / 0.63 / -3.3%
tpcds_q51/datafusion:vortex-file-compressed 243877437 / 241461239 / +1.0% 277835229 / 280306123 / -0.9% 0.88 / 0.86 / +1.9%
tpcds_q52/datafusion:vortex-file-compressed 14162621 / 14942948 / -5.2% 40068792 / 41146983 / -2.6% 0.35 / 0.36 / -2.7%
tpcds_q53/datafusion:vortex-file-compressed 22364958 / 23025893 / -2.9% 49238461 / 52394142 / -6.0% 0.45 / 0.44 / +3.4%
tpcds_q54/datafusion:vortex-file-compressed 58985326 / 59630808 / -1.1% 91700581 / 92798502 / -1.2% 0.64 / 0.64 / +0.1%
tpcds_q55/datafusion:vortex-file-compressed 14211138 / 15209610 / -6.6% 39964640 / 39200802 / +1.9% 0.36 / 0.39 / -8.4%
tpcds_q56/datafusion:vortex-file-compressed 32942666 / 34211642 / -3.7% 64272009 / 63579406 / +1.1% 0.51 / 0.54 / -4.7%
tpcds_q57/datafusion:vortex-file-compressed 131324297 / 130827096 / +0.4% 159139953 / 162474233 / -2.1% 0.83 / 0.81 / +2.5%
tpcds_q58/datafusion:vortex-file-compressed 48671046 / 49071762 / -0.8% 84372815 / 84738612 / -0.4% 0.58 / 0.58 / -0.4%
tpcds_q59/datafusion:vortex-file-compressed 53862235 / 54936949 / -2.0% 82401832 / 85696270 / -3.8% 0.65 / 0.64 / +2.0%
tpcds_q60/datafusion:vortex-file-compressed 34342676 / 34485962 / -0.4% 62753071 / 66114270 / -5.1% 0.55 / 0.52 / +4.9%
tpcds_q61/datafusion:vortex-file-compressed 44232204 / 45202724 / -2.1% 70713339 / 70916447 / -0.3% 0.63 / 0.64 / -1.9%
tpcds_q62/datafusion:vortex-file-compressed 19001712 / 19841460 / -4.2% 41447601 / 43084349 / -3.8% 0.46 / 0.46 / -0.5%
tpcds_q63/datafusion:vortex-file-compressed 23056127 / 22619521 / +1.9% 49309941 / 49716174 / -0.8% 0.47 / 0.45 / +2.8%
tpcds_q64/datafusion:vortex-file-compressed 329404818 / 332776120 / -1.0% 400691953 / 399340320 / +0.3% 0.82 / 0.83 / -1.3%
tpcds_q65/datafusion:vortex-file-compressed 74067925 / 73751860 / +0.4% 109663155 / 110569158 / -0.8% 0.68 / 0.67 / +1.3%
tpcds_q66/datafusion:vortex-file-compressed 52035610 / 52486634 / -0.9% 76188154 / 77837826 / -2.1% 0.68 / 0.67 / +1.3%
tpcds_q67/datafusion:vortex-file-compressed 423278002 / 420503111 / +0.7% 513824566 / 528828691 / -2.8% 0.82 / 0.80 / +3.6%
tpcds_q68/datafusion:vortex-file-compressed 65640098 / 66831493 / -1.8% 98982667 / 99391180 / -0.4% 0.66 / 0.67 / -1.4%
tpcds_q69/datafusion:vortex-file-compressed 35582194 / 36278824 / -1.9% 61767816 / 63625322 / -2.9% 0.58 / 0.57 / +1.0%
tpcds_q70/datafusion:vortex-file-compressed 194295436 / 194497137 / -0.1% 231445474 / 232217411 / -0.3% 0.84 / 0.84 / +0.2%
tpcds_q71/datafusion:vortex-file-compressed 26137884 / 25424784 / +2.8% 57515968 / 61267492 / -6.1% 0.45 / 0.41 / +9.5%
tpcds_q72/datafusion:vortex-file-compressed 1601873531 / 1575229677 / +1.7% 1650188466 / 1696144047 / -2.7% 0.97 / 0.93 / +4.5%
tpcds_q73/datafusion:vortex-file-compressed 37960028 / 38589712 / -1.6% 66621302 / 62969996 / +5.8% 0.57 / 0.61 / -7.0%
tpcds_q74/datafusion:vortex-file-compressed 134647598 / 134601274 / +0.0% 170239703 / 173765353 / -2.0% 0.79 / 0.77 / +2.1%
tpcds_q75/datafusion:vortex-file-compressed 156377580 / 155633299 / +0.5% 209425313 / 198511793 / +5.5% 0.75 / 0.78 / -4.8%
tpcds_q76/datafusion:vortex-file-compressed 34387394 / 34722660 / -1.0% 72616546 / 73189101 / -0.8% 0.47 / 0.47 / -0.2%
tpcds_q77/datafusion:vortex-file-compressed 55635390 / 54175824 / +2.7% 89721003 / 87493805 / +2.5% 0.62 / 0.62 / +0.1%
tpcds_q78/datafusion:vortex-file-compressed 140059784 / 140889933 / -0.6% 193098536 / 191779256 / +0.7% 0.73 / 0.73 / -1.3%
tpcds_q79/datafusion:vortex-file-compressed 53386274 / 53408896 / -0.0% 84205742 / 83137730 / +1.3% 0.63 / 0.64 / -1.3%
tpcds_q80/datafusion:vortex-file-compressed 80820166 / 80795658 / +0.0% 126046265 / 127799771 / -1.4% 0.64 / 0.63 / +1.4%
tpcds_q81/datafusion:vortex-file-compressed 55270910 / 55975548 / -1.3% 82434165 / 83846761 / -1.7% 0.67 / 0.67 / +0.4%
tpcds_q82/datafusion:vortex-file-compressed 31625992 / 30549740 / +3.5% 46175620 / 48106493 / -4.0% 0.68 / 0.64 / +7.9%
tpcds_q83/datafusion:vortex-file-compressed 41938144 / 42358020 / -1.0% 64708753 / 65597866 / -1.4% 0.65 / 0.65 / +0.4%
tpcds_q84/datafusion:vortex-file-compressed 12694777 / 12799204 / -0.8% 31537624 / 30970538 / +1.8% 0.40 / 0.41 / -2.6%
tpcds_q85/datafusion:vortex-file-compressed 59574438 / 60660052 / -1.8% 89599922 / 90654953 / -1.2% 0.66 / 0.67 / -0.6%
tpcds_q86/datafusion:vortex-file-compressed 18963940 / 18272155 / +3.8% 39778390 / 40425570 / -1.6% 0.48 / 0.45 / +5.5%
tpcds_q87/datafusion:vortex-file-compressed 78234878 / 79615489 / -1.7% 107589460 / 107689679 / -0.1% 0.73 / 0.74 / -1.6%
tpcds_q88/datafusion:vortex-file-compressed 53776365 / 56206700 / -4.3% 88557652 / 93094539 / -4.9% 0.61 / 0.60 / +0.6%
tpcds_q89/datafusion:vortex-file-compressed 26954823 / 26931306 / +0.1% 53833963 / 56072635 / -4.0% 0.50 / 0.48 / +4.2%
tpcds_q90/datafusion:vortex-file-compressed 12621656 / 12758200 / -1.1% 34081528 / 34107490 / -0.1% 0.37 / 0.37 / -1.0%
tpcds_q91/datafusion:vortex-file-compressed 18894033 / 19519254 / -3.2% 42471624 / 42141655 / +0.8% 0.44 / 0.46 / -4.0%
tpcds_q92/datafusion:vortex-file-compressed 15371558 / 15245025 / +0.8% 35729833 / 33922326 / +5.3% 0.43 / 0.45 / -4.3%
tpcds_q93/datafusion:vortex-file-compressed 63224844 / 54842766 / +15.3% 🔴 92041781 / 88696680 / +3.8% 0.69 / 0.62 / +11.1%
tpcds_q94/datafusion:vortex-file-compressed 21373361 / 21620928 / -1.1% 45465592 / 46231785 / -1.7% 0.47 / 0.47 / +0.5%
tpcds_q95/datafusion:vortex-file-compressed 95215560 / 95000299 / +0.2% 128080187 / 123858370 / +3.4% 0.74 / 0.77 / -3.1%
tpcds_q96/datafusion:vortex-file-compressed 12549804 / 11533278 / +8.8% 32517786 / 31102793 / +4.5% 0.39 / 0.37 / +4.1%
tpcds_q97/datafusion:vortex-file-compressed 39672772 / 39467840 / +0.5% 66060882 / 66425488 / -0.5% 0.60 / 0.59 / +1.1%
tpcds_q98/datafusion:vortex-file-compressed 21034540 / 20665282 / +1.8% 46538492 / 48509099 / -4.1% 0.45 / 0.43 / +6.1%
tpcds_q99/datafusion:vortex-file-compressed 29863628 / 29545800 / +1.1% 48847061 / 48862458 / -0.0% 0.61 / 0.60 / +1.1%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59122964 / 59408052 / -0.5% 78836849 / 82373568 / -4.3% 0.75 / 0.72 / +4.0%
tpcds_q02/datafusion:parquet 67511400 / 69761366 / -3.2% 91461855 / 90812813 / +0.7% 0.74 / 0.77 / -3.9%
tpcds_q03/datafusion:parquet 27795300 / 28478768 / -2.4% 50441180 / 49334251 / +2.2% 0.55 / 0.58 / -4.5%
tpcds_q04/datafusion:parquet 639627319 / 642610250 / -0.5% 712402918 / 708231753 / +0.6% 0.90 / 0.91 / -1.0%
tpcds_q05/datafusion:parquet 80761444 / 81388832 / -0.8% 117932023 / 113800720 / +3.6% 0.68 / 0.72 / -4.2%
tpcds_q06/datafusion:parquet 91191698 / 90852955 / +0.4% 113892150 / 115952402 / -1.8% 0.80 / 0.78 / +2.2%
tpcds_q07/datafusion:parquet 100849104 / 101418282 / -0.6% 132073177 / 133695330 / -1.2% 0.76 / 0.76 / +0.7%
tpcds_q08/datafusion:parquet 47696420 / 48684130 / -2.0% 78020616 / 74133519 / +5.2% 0.61 / 0.66 / -6.9%
tpcds_q09/datafusion:parquet 75662603 / 75160834 / +0.7% 100677600 / 102849415 / -2.1% 0.75 / 0.73 / +2.8%
tpcds_q10/datafusion:parquet 57552642 / 60416750 / -4.7% 86596323 / 84947233 / +1.9% 0.66 / 0.71 / -6.6%
tpcds_q11/datafusion:parquet 410322364 / 412444870 / -0.5% 459897219 / 461294550 / -0.3% 0.89 / 0.89 / -0.2%
tpcds_q12/datafusion:parquet 39528416 / 39871562 / -0.9% 57577056 / 57128529 / +0.8% 0.69 / 0.70 / -1.6%
tpcds_q13/datafusion:parquet 86050142 / 84637846 / +1.7% 138645876 / 130466094 / +6.3% 0.62 / 0.65 / -4.3%
tpcds_q14/datafusion:parquet 385561164 / 378360104 / +1.9% 419840114 / 433388374 / -3.1% 0.92 / 0.87 / +5.2%
tpcds_q15/datafusion:parquet 50716833 / 51502606 / -1.5% 71827341 / 72303263 / -0.7% 0.71 / 0.71 / -0.9%
tpcds_q16/datafusion:parquet 45675714 / 45710882 / -0.1% 62776692 / 63650471 / -1.4% 0.73 / 0.72 / +1.3%
tpcds_q17/datafusion:parquet 136809698 / 138067928 / -0.9% 174759044 / 172187136 / +1.5% 0.78 / 0.80 / -2.4%
tpcds_q18/datafusion:parquet 108950960 / 110369917 / -1.3% 143005132 / 144952536 / -1.3% 0.76 / 0.76 / +0.1%
tpcds_q19/datafusion:parquet 47136701 / 48384048 / -2.6% 79610077 / 75539146 / +5.4% 0.59 / 0.64 / -7.6%
tpcds_q20/datafusion:parquet 41572066 / 41512735 / +0.1% 55506823 / 55090816 / +0.8% 0.75 / 0.75 / -0.6%
tpcds_q21/datafusion:parquet 61284087 / 61141701 / +0.2% 73147793 / 73095747 / +0.1% 0.84 / 0.84 / +0.2%
tpcds_q22/datafusion:parquet 464091254 / 464195324 / -0.0% 480801302 / 478139930 / +0.6% 0.97 / 0.97 / -0.6%
tpcds_q23/datafusion:parquet 354951650 / 357626356 / -0.7% 412277434 / 417833459 / -1.3% 0.86 / 0.86 / +0.6%
tpcds_q24/datafusion:parquet 242670980 / 241331307 / +0.6% 275184640 / 278266611 / -1.1% 0.88 / 0.87 / +1.7%
tpcds_q25/datafusion:parquet 142324024 / 146902811 / -3.1% 187087174 / 196039200 / -4.6% 0.76 / 0.75 / +1.5%
tpcds_q26/datafusion:parquet 54045058 / 53821080 / +0.4% 80195620 / 80565923 / -0.5% 0.67 / 0.67 / +0.9%
tpcds_q27/datafusion:parquet 209911885 / 210089836 / -0.1% 239192131 / 235911774 / +1.4% 0.88 / 0.89 / -1.5%
tpcds_q28/datafusion:parquet 91430268 / 86784142 / +5.4% 119234382 / 119280232 / -0.0% 0.77 / 0.73 / +5.4%
tpcds_q29/datafusion:parquet 141237584 / 145820741 / -3.1% 183504941 / 175411233 / +4.6% 0.77 / 0.83 / -7.4%
tpcds_q30/datafusion:parquet 96783530 / 99608501 / -2.8% 117898880 / 120071149 / -1.8% 0.82 / 0.83 / -1.0%
tpcds_q31/datafusion:parquet 318398215 / 319058792 / -0.2% 343470539 / 344041143 / -0.2% 0.93 / 0.93 / -0.0%
tpcds_q32/datafusion:parquet 29163069 / 29399552 / -0.8% 44361076 / 43643939 / +1.6% 0.66 / 0.67 / -2.4%
tpcds_q33/datafusion:parquet 51374517 / 51971680 / -1.1% 74668693 / 76538194 / -2.4% 0.69 / 0.68 / +1.3%
tpcds_q34/datafusion:parquet 63143630 / 65511648 / -3.6% 90585208 / 85276600 / +6.2% 0.70 / 0.77 / -9.3%
tpcds_q35/datafusion:parquet 124141822 / 126922984 / -2.2% 153406657 / 150646646 / +1.8% 0.81 / 0.84 / -4.0%
tpcds_q36/datafusion:parquet 97595758 / 97863638 / -0.3% 127279299 / 126419427 / +0.7% 0.77 / 0.77 / -0.9%
tpcds_q37/datafusion:parquet 49444642 / 50046237 / -1.2% 63986455 / 65033749 / -1.6% 0.77 / 0.77 / +0.4%
tpcds_q38/datafusion:parquet 120205140 / 122147195 / -1.6% 146696215 / 145034869 / +1.1% 0.82 / 0.84 / -2.7%
tpcds_q39/datafusion:parquet 848668369 / 846526498 / +0.3% 870093000 / 859437879 / +1.2% 0.98 / 0.98 / -1.0%
tpcds_q40/datafusion:parquet 35217954 / 35936465 / -2.0% 55167525 / 54650564 / +0.9% 0.64 / 0.66 / -2.9%
tpcds_q41/datafusion:parquet 32423152 / 31200319 / +3.9% 42314302 / 42657926 / -0.8% 0.77 / 0.73 / +4.8%
tpcds_q42/datafusion:parquet 25836064 / 25952126 / -0.4% 45678139 / 43716014 / +4.5% 0.57 / 0.59 / -4.7%
tpcds_q43/datafusion:parquet 27961266 / 27372783 / +2.1% 48569379 / 46844617 / +3.7% 0.58 / 0.58 / -1.5%
tpcds_q44/datafusion:parquet 66919198 / 65006033 / +2.9% 87309083 / 87803178 / -0.6% 0.77 / 0.74 / +3.5%
tpcds_q45/datafusion:parquet 65568228 / 66536274 / -1.5% 85103623 / 87212845 / -2.4% 0.77 / 0.76 / +1.0%
tpcds_q46/datafusion:parquet 108483880 / 106805720 / +1.6% 147760338 / 153607976 / -3.8% 0.73 / 0.70 / +5.6%
tpcds_q47/datafusion:parquet 234657719 / 237808994 / -1.3% 275975530 / 273252482 / +1.0% 0.85 / 0.87 / -2.3%
tpcds_q48/datafusion:parquet 77460734 / 76955857 / +0.7% 111009387 / 105870247 / +4.9% 0.70 / 0.73 / -4.0%
tpcds_q49/datafusion:parquet 113120658 / 118898020 / -4.9% 149237152 / 170084458 / -12.3% 🟢 0.76 / 0.70 / +8.4%
tpcds_q50/datafusion:parquet 91428029 / 92705258 / -1.4% 122569973 / 120435148 / +1.8% 0.75 / 0.77 / -3.1%
tpcds_q51/datafusion:parquet 255733948 / 254091982 / +0.6% 280381719 / 289211985 / -3.1% 0.91 / 0.88 / +3.8%
tpcds_q52/datafusion:parquet 26003551 / 26889958 / -3.3% 47770098 / 45469536 / +5.1% 0.54 / 0.59 / -8.0%
tpcds_q53/datafusion:parquet 36955784 / 36382336 / +1.6% 58859155 / 57842390 / +1.8% 0.63 / 0.63 / -0.2%
tpcds_q54/datafusion:parquet 85878645 / 85254806 / +0.7% 108720996 / 109551589 / -0.8% 0.79 / 0.78 / +1.5%
tpcds_q55/datafusion:parquet 26191078 / 26510566 / -1.2% 45894329 / 46645823 / -1.6% 0.57 / 0.57 / +0.4%
tpcds_q56/datafusion:parquet 53662728 / 54094848 / -0.8% 72335813 / 77335323 / -6.5% 0.74 / 0.70 / +6.1%
tpcds_q57/datafusion:parquet 169568614 / 171894920 / -1.4% 194424981 / 193978047 / +0.2% 0.87 / 0.89 / -1.6%
tpcds_q58/datafusion:parquet 98135096 / 98465482 / -0.3% 123259784 / 125032548 / -1.4% 0.80 / 0.79 / +1.1%
tpcds_q59/datafusion:parquet 104022024 / 103659830 / +0.3% 132897735 / 130225505 / +2.1% 0.78 / 0.80 / -1.7%
tpcds_q60/datafusion:parquet 54458991 / 55741260 / -2.3% 75862823 / 78220449 / -3.0% 0.72 / 0.71 / +0.7%
tpcds_q61/datafusion:parquet 73269942 / 78001000 / -6.1% 101251741 / 106432779 / -4.9% 0.72 / 0.73 / -1.3%
tpcds_q62/datafusion:parquet 27167104 / 27762318 / -2.1% 44470272 / 44527940 / -0.1% 0.61 / 0.62 / -2.0%
tpcds_q63/datafusion:parquet 36507565 / 36196190 / +0.9% 61052012 / 58834211 / +3.8% 0.60 / 0.62 / -2.8%
tpcds_q64/datafusion:parquet 660041674 / 659557758 / +0.1% 740151040 / 742173662 / -0.3% 0.89 / 0.89 / +0.3%
tpcds_q65/datafusion:parquet 104243334 / 100715906 / +3.5% 134005542 / 133981634 / +0.0% 0.78 / 0.75 / +3.5%
tpcds_q66/datafusion:parquet 77310423 / 76575936 / +1.0% 102059323 / 104374000 / -2.2% 0.76 / 0.73 / +3.2%
tpcds_q67/datafusion:parquet 431998102 / 430912350 / +0.3% 505554972 / 500297658 / +1.1% 0.85 / 0.86 / -0.8%
tpcds_q68/datafusion:parquet 107815780 / 108700552 / -0.8% 157916407 / 156742031 / +0.7% 0.68 / 0.69 / -1.6%
tpcds_q69/datafusion:parquet 59324393 / 61003348 / -2.8% 79866216 / 84325988 / -5.3% 0.74 / 0.72 / +2.7%
tpcds_q70/datafusion:parquet 212645618 / 212975306 / -0.2% 246658762 / 246017700 / +0.3% 0.86 / 0.87 / -0.4%
tpcds_q71/datafusion:parquet 38418312 / 39083124 / -1.7% 66743401 / 64662143 / +3.2% 0.58 / 0.60 / -4.8%
tpcds_q72/datafusion:parquet 1744472286 / 1794732356 / -2.8% 1816571670 / 1806078341 / +0.6% 0.96 / 0.99 / -3.4%
tpcds_q73/datafusion:parquet 62045028 / 62856255 / -1.3% 85257806 / 84855052 / +0.5% 0.73 / 0.74 / -1.8%
tpcds_q74/datafusion:parquet 290999950 / 292768250 / -0.6% 325657220 / 331483495 / -1.8% 0.89 / 0.88 / +1.2%
tpcds_q75/datafusion:parquet 196540476 / 193794623 / +1.4% 239064691 / 239131737 / -0.0% 0.82 / 0.81 / +1.4%
tpcds_q76/datafusion:parquet 50212054 / 49958244 / +0.5% 82137294 / 78897199 / +4.1% 0.61 / 0.63 / -3.5%
tpcds_q77/datafusion:parquet 72425192 / 73280301 / -1.2% 104855104 / 98096657 / +6.9% 0.69 / 0.75 / -7.5%
tpcds_q78/datafusion:parquet 212276069 / 211119866 / +0.5% 272508885 / 273491694 / -0.4% 0.78 / 0.77 / +0.9%
tpcds_q79/datafusion:parquet 78574027 / 77375078 / +1.5% 111752604 / 112413871 / -0.6% 0.70 / 0.69 / +2.2%
tpcds_q80/datafusion:parquet 143467594 / 143104068 / +0.3% 193619044 / 191975662 / +0.9% 0.74 / 0.75 / -0.6%
tpcds_q81/datafusion:parquet 108325048 / 106756472 / +1.5% 133595153 / 129378123 / +3.3% 0.81 / 0.83 / -1.7%
tpcds_q82/datafusion:parquet 54175178 / 53582485 / +1.1% 70490564 / 70410662 / +0.1% 0.77 / 0.76 / +1.0%
tpcds_q83/datafusion:parquet 66770060 / 66630048 / +0.2% 84385085 / 85136032 / -0.9% 0.79 / 0.78 / +1.1%
tpcds_q84/datafusion:parquet 35267272 / 36220898 / -2.6% 50007143 / 49805351 / +0.4% 0.71 / 0.73 / -3.0%
tpcds_q85/datafusion:parquet 105879762 / 103848480 / +2.0% 128859148 / 129149354 / -0.2% 0.82 / 0.80 / +2.2%
tpcds_q86/datafusion:parquet 22064770 / 22112695 / -0.2% 39514152 / 39672664 / -0.4% 0.56 / 0.56 / +0.2%
tpcds_q87/datafusion:parquet 120095895 / 122470358 / -1.9% 145598073 / 148224625 / -1.8% 0.82 / 0.83 / -0.2%
tpcds_q88/datafusion:parquet 84603630 / 86047137 / -1.7% 105070547 / 108358632 / -3.0% 0.81 / 0.79 / +1.4%
tpcds_q89/datafusion:parquet 39274056 / 38401756 / +2.3% 63443792 / 64923770 / -2.3% 0.62 / 0.59 / +4.7%
tpcds_q90/datafusion:parquet 17851936 / 18100802 / -1.4% 32471105 / 32273520 / +0.6% 0.55 / 0.56 / -2.0%
tpcds_q91/datafusion:parquet 42647114 / 41738000 / +2.2% 59691260 / 57454843 / +3.9% 0.71 / 0.73 / -1.7%
tpcds_q92/datafusion:parquet 28701948 / 28604120 / +0.3% 48270997 / 47460689 / +1.7% 0.59 / 0.60 / -1.3%
tpcds_q93/datafusion:parquet 61901988 / 63722030 / -2.9% 93571321 / 87405909 / +7.1% 0.66 / 0.73 / -9.3%
tpcds_q94/datafusion:parquet 38686015 / 37847109 / +2.2% 58574212 / 58549059 / +0.0% 0.66 / 0.65 / +2.2%
tpcds_q95/datafusion:parquet 126115553 / 128012922 / -1.5% 148676591 / 149910916 / -0.8% 0.85 / 0.85 / -0.7%
tpcds_q96/datafusion:parquet 21197790 / 20691258 / +2.4% 36626827 / 36951345 / -0.9% 0.58 / 0.56 / +3.4%
tpcds_q97/datafusion:parquet 54826496 / 54645566 / +0.3% 79067730 / 80351616 / -1.6% 0.69 / 0.68 / +2.0%
tpcds_q98/datafusion:parquet 61149825 / 61965680 / -1.3% 86079627 / 83775704 / +2.8% 0.71 / 0.74 / -4.0%
tpcds_q99/datafusion:parquet 42541758 / 42461627 / +0.2% 57748485 / 57802802 / -0.1% 0.74 / 0.73 / +0.3%
duckdb / vortex-file-compressed / ns (1.004x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32581758 / 32726779 / -0.4% 45019739 / 45377689 / -0.8% 0.72 / 0.72 / +0.3%
tpcds_q02/duckdb:vortex-file-compressed 31052438 / 30267290 / +2.6% 44009390 / 44087004 / -0.2% 0.71 / 0.69 / +2.8%
tpcds_q03/duckdb:vortex-file-compressed 13480227 / 13779130 / -2.2% 29251677 / 30718899 / -4.8% 0.46 / 0.45 / +2.7%
tpcds_q04/duckdb:vortex-file-compressed 128013044 / 130206338 / -1.7% 158218850 / 157201556 / +0.6% 0.81 / 0.83 / -2.3%
tpcds_q05/duckdb:vortex-file-compressed 54771386 / 53727511 / +1.9% 80207582 / 83478676 / -3.9% 0.68 / 0.64 / +6.1%
tpcds_q06/duckdb:vortex-file-compressed 58592783 / 58800986 / -0.4% 78151168 / 79094008 / -1.2% 0.75 / 0.74 / +0.8%
tpcds_q07/duckdb:vortex-file-compressed 30610819 / 31168844 / -1.8% 54805234 / 54099517 / +1.3% 0.56 / 0.58 / -3.1%
tpcds_q08/duckdb:vortex-file-compressed 31090905 / 31134683 / -0.1% 42599230 / 41772800 / +2.0% 0.73 / 0.75 / -2.1%
tpcds_q09/duckdb:vortex-file-compressed 56353710 / 55235330 / +2.0% 82558821 / 79107779 / +4.4% 0.68 / 0.70 / -2.2%
tpcds_q10/duckdb:vortex-file-compressed 39470045 / 39038430 / +1.1% 58286985 / 58236826 / +0.1% 0.68 / 0.67 / +1.0%
tpcds_q11/duckdb:vortex-file-compressed 95519780 / 96226126 / -0.7% 112543542 / 112266994 / +0.2% 0.85 / 0.86 / -1.0%
tpcds_q12/duckdb:vortex-file-compressed 17288498 / 17276975 / +0.1% 28831863 / 30254952 / -4.7% 0.60 / 0.57 / +5.0%
tpcds_q13/duckdb:vortex-file-compressed 37833470 / 38940578 / -2.8% 71310931 / 71103229 / +0.3% 0.53 / 0.55 / -3.1%
tpcds_q14/duckdb:vortex-file-compressed 115829402 / 119983268 / -3.5% 133639435 / 140641737 / -5.0% 0.87 / 0.85 / +1.6%
tpcds_q15/duckdb:vortex-file-compressed 60543004 / 60759281 / -0.4% 69881249 / 76171754 / -8.3% 0.87 / 0.80 / +8.6%
tpcds_q16/duckdb:vortex-file-compressed 34683580 / 34771337 / -0.3% 54402452 / 53890958 / +0.9% 0.64 / 0.65 / -1.2%
tpcds_q17/duckdb:vortex-file-compressed 57270676 / 57289182 / -0.0% 79428940 / 81955246 / -3.1% 0.72 / 0.70 / +3.1%
tpcds_q18/duckdb:vortex-file-compressed 83294180 / 82993345 / +0.4% 102870851 / 104424434 / -1.5% 0.81 / 0.79 / +1.9%
tpcds_q19/duckdb:vortex-file-compressed 44958795 / 43899722 / +2.4% 59938311 / 65276395 / -8.2% 0.75 / 0.67 / +11.5%
tpcds_q20/duckdb:vortex-file-compressed 21775740 / 21520304 / +1.2% 35710789 / 34931964 / +2.2% 0.61 / 0.62 / -1.0%
tpcds_q21/duckdb:vortex-file-compressed 35927372 / 28120830 / +27.8% 🔴 69942797 / 62004166 / +12.8% 🔴 0.51 / 0.45 / +13.3%
tpcds_q22/duckdb:vortex-file-compressed 156206104 / 165099230 / -5.4% 174980784 / 170541662 / +2.6% 0.89 / 0.97 / -7.8%
tpcds_q23/duckdb:vortex-file-compressed 182764485 / 185876490 / -1.7% 199860300 / 199673618 / +0.1% 0.91 / 0.93 / -1.8%
tpcds_q24/duckdb:vortex-file-compressed 52362970 / 52636914 / -0.5% 74906197 / 77254623 / -3.0% 0.70 / 0.68 / +2.6%
tpcds_q25/duckdb:vortex-file-compressed 52797538 / 53220034 / -0.8% 76493266 / 75302591 / +1.6% 0.69 / 0.71 / -2.3%
tpcds_q26/duckdb:vortex-file-compressed 26415826 / 26713063 / -1.1% 40893371 / 42934826 / -4.8% 0.65 / 0.62 / +3.8%
tpcds_q27/duckdb:vortex-file-compressed 31177193 / 32585874 / -4.3% 53865529 / 53424233 / +0.8% 0.58 / 0.61 / -5.1%
tpcds_q28/duckdb:vortex-file-compressed 40709748 / 41342696 / -1.5% 63595106 / 66089322 / -3.8% 0.64 / 0.63 / +2.3%
tpcds_q29/duckdb:vortex-file-compressed 52182440 / 51866994 / +0.6% 73539253 / 74066949 / -0.7% 0.71 / 0.70 / +1.3%
tpcds_q30/duckdb:vortex-file-compressed 37627687 / 37914817 / -0.8% 52224829 / 52960815 / -1.4% 0.72 / 0.72 / +0.6%
tpcds_q31/duckdb:vortex-file-compressed 38078073 / 37512062 / +1.5% 53870564 / 53392186 / +0.9% 0.71 / 0.70 / +0.6%
tpcds_q32/duckdb:vortex-file-compressed 13658271 / 13855892 / -1.4% 30658559 / 28855272 / +6.2% 0.45 / 0.48 / -7.2%
tpcds_q33/duckdb:vortex-file-compressed 34505860 / 33813963 / +2.0% 58921937 / 59046480 / -0.2% 0.59 / 0.57 / +2.3%
tpcds_q34/duckdb:vortex-file-compressed 22902752 / 22811725 / +0.4% 37927578 / 39776812 / -4.6% 0.60 / 0.57 / +5.3%
tpcds_q35/duckdb:vortex-file-compressed 66749652 / 66786588 / -0.1% 83508731 / 85242000 / -2.0% 0.80 / 0.78 / +2.0%
tpcds_q36/duckdb:vortex-file-compressed 28953995 / 29806828 / -2.9% 46453857 / 49308472 / -5.8% 0.62 / 0.60 / +3.1%
tpcds_q37/duckdb:vortex-file-compressed 27686357 / 25605208 / +8.1% 75269207 / 74457214 / +1.1% 0.37 / 0.34 / +7.0%
tpcds_q38/duckdb:vortex-file-compressed 65713970 / 62408870 / +5.3% 79855763 / 81156842 / -1.6% 0.82 / 0.77 / +7.0%
tpcds_q39/duckdb:vortex-file-compressed 57854204 / 56168904 / +3.0% 89590866 / 85127364 / +5.2% 0.65 / 0.66 / -2.1%
tpcds_q40/duckdb:vortex-file-compressed 19316843 / 19238372 / +0.4% 35775353 / 35099919 / +1.9% 0.54 / 0.55 / -1.5%
tpcds_q41/duckdb:vortex-file-compressed 19188799 / 18720698 / +2.5% 25746689 / 25500417 / +1.0% 0.75 / 0.73 / +1.5%
tpcds_q42/duckdb:vortex-file-compressed 13924094 / 14015144 / -0.6% 30636447 / 30966847 / -1.1% 0.45 / 0.45 / +0.4%
tpcds_q43/duckdb:vortex-file-compressed 18970400 / 19403602 / -2.2% 32881894 / 32011378 / +2.7% 0.58 / 0.61 / -4.8%
tpcds_q44/duckdb:vortex-file-compressed 27783990 / 28307018 / -1.8% 47942030 / 51668551 / -7.2% 0.58 / 0.55 / +5.8%
tpcds_q45/duckdb:vortex-file-compressed 46804277 / 46586273 / +0.5% 61738739 / 60370446 / +2.3% 0.76 / 0.77 / -1.8%
tpcds_q46/duckdb:vortex-file-compressed 51295666 / 51192653 / +0.2% 77380872 / 75043524 / +3.1% 0.66 / 0.68 / -2.8%
tpcds_q47/duckdb:vortex-file-compressed 79803098 / 80927444 / -1.4% 97754741 / 97094785 / +0.7% 0.82 / 0.83 / -2.1%
tpcds_q48/duckdb:vortex-file-compressed 53355030 / 53155386 / +0.4% 77194828 / 81823473 / -5.7% 0.69 / 0.65 / +6.4%
tpcds_q49/duckdb:vortex-file-compressed 38068542 / 37950044 / +0.3% 77755826 / 78847393 / -1.4% 0.49 / 0.48 / +1.7%
tpcds_q50/duckdb:vortex-file-compressed 32767453 / 32675461 / +0.3% 57046339 / 57051911 / -0.0% 0.57 / 0.57 / +0.3%
tpcds_q51/duckdb:vortex-file-compressed 206001660 / 204779876 / +0.6% 225025640 / 217736852 / +3.3% 0.92 / 0.94 / -2.7%
tpcds_q52/duckdb:vortex-file-compressed 15005586 / 15384257 / -2.5% 29826384 / 31876748 / -6.4% 0.50 / 0.48 / +4.2%
tpcds_q53/duckdb:vortex-file-compressed 22153880 / 22960290 / -3.5% 37277102 / 39000657 / -4.4% 0.59 / 0.59 / +0.9%
tpcds_q54/duckdb:vortex-file-compressed 44701098 / 44886930 / -0.4% 64786209 / 65481173 / -1.1% 0.69 / 0.69 / +0.7%
tpcds_q55/duckdb:vortex-file-compressed 14326594 / 14612501 / -2.0% 31653260 / 30570651 / +3.5% 0.45 / 0.48 / -5.3%
tpcds_q56/duckdb:vortex-file-compressed 32555083 / 32462078 / +0.3% 54857514 / 57717193 / -5.0% 0.59 / 0.56 / +5.5%
tpcds_q57/duckdb:vortex-file-compressed 64295916 / 64171452 / +0.2% 76223466 / 78496038 / -2.9% 0.84 / 0.82 / +3.2%
tpcds_q58/duckdb:vortex-file-compressed 37965170 / 37835588 / +0.3% 60220418 / 64016051 / -5.9% 0.63 / 0.59 / +6.7%
tpcds_q59/duckdb:vortex-file-compressed 52697954 / 53810956 / -2.1% 63921292 / 71107629 / -10.1% 🟢 0.82 / 0.76 / +8.9%
tpcds_q60/duckdb:vortex-file-compressed 35787807 / 35369636 / +1.2% 58003749 / 59793701 / -3.0% 0.62 / 0.59 / +4.3%
tpcds_q61/duckdb:vortex-file-compressed 35695238 / 34298255 / +4.1% 54217177 / 53069753 / +2.2% 0.66 / 0.65 / +1.9%
tpcds_q62/duckdb:vortex-file-compressed 16964978 / 14822514 / +14.5% 🔴 27428774 / 26421769 / +3.8% 0.62 / 0.56 / +10.3%
tpcds_q63/duckdb:vortex-file-compressed 20741534 / 20828409 / -0.4% 38568665 / 38114655 / +1.2% 0.54 / 0.55 / -1.6%
tpcds_q64/duckdb:vortex-file-compressed 120149696 / 118342334 / +1.5% 151667158 / 152181613 / -0.3% 0.79 / 0.78 / +1.9%
tpcds_q65/duckdb:vortex-file-compressed 50050764 / 51466061 / -2.7% 60374874 / 58907342 / +2.5% 0.83 / 0.87 / -5.1%
tpcds_q66/duckdb:vortex-file-compressed 41401202 / 40998564 / +1.0% 58787633 / 58858579 / -0.1% 0.70 / 0.70 / +1.1%
tpcds_q67/duckdb:vortex-file-compressed 277161746 / 277425812 / -0.1% 281694718 / 283678837 / -0.7% 0.98 / 0.98 / +0.6%
tpcds_q68/duckdb:vortex-file-compressed 45407547 / 44593714 / +1.8% 72778406 / 72079771 / +1.0% 0.62 / 0.62 / +0.8%
tpcds_q69/duckdb:vortex-file-compressed 38621783 / 38356528 / +0.7% 59532197 / 59755970 / -0.4% 0.65 / 0.64 / +1.1%
tpcds_q70/duckdb:vortex-file-compressed 24606865 / 25085070 / -1.9% 42338735 / 41516746 / +2.0% 0.58 / 0.60 / -3.8%
tpcds_q71/duckdb:vortex-file-compressed 29080096 / 27715436 / +4.9% 51686497 / 50902781 / +1.5% 0.56 / 0.54 / +3.3%
tpcds_q72/duckdb:vortex-file-compressed 139056013 / 135900823 / +2.3% 161197296 / 164226936 / -1.8% 0.86 / 0.83 / +4.2%
tpcds_q73/duckdb:vortex-file-compressed 19842220 / 20089200 / -1.2% 34580802 / 37315276 / -7.3% 0.57 / 0.54 / +6.6%
tpcds_q74/duckdb:vortex-file-compressed 82874390 / 82722980 / +0.2% 99881520 / 99629718 / +0.3% 0.83 / 0.83 / -0.1%
tpcds_q75/duckdb:vortex-file-compressed 111235680 / 111929736 / -0.6% 138521536 / 139908352 / -1.0% 0.80 / 0.80 / +0.4%
tpcds_q76/duckdb:vortex-file-compressed 27849988 / 27219565 / +2.3% 55536174 / 58492855 / -5.1% 0.50 / 0.47 / +7.8%
tpcds_q77/duckdb:vortex-file-compressed 36646631 / 36316546 / +0.9% 58362731 / 62103115 / -6.0% 0.63 / 0.58 / +7.4%
tpcds_q78/duckdb:vortex-file-compressed 135976608 / 137442428 / -1.1% 160691129 / 159793923 / +0.6% 0.85 / 0.86 / -1.6%
tpcds_q79/duckdb:vortex-file-compressed 37689654 / 37665982 / +0.1% 62353752 / 59874325 / +4.1% 0.60 / 0.63 / -3.9%
tpcds_q80/duckdb:vortex-file-compressed 59103715 / 57541290 / +2.7% 91014248 / 89399248 / +1.8% 0.65 / 0.64 / +0.9%
tpcds_q81/duckdb:vortex-file-compressed 58106824 / 57777750 / +0.6% 70292778 / 71231569 / -1.3% 0.83 / 0.81 / +1.9%
tpcds_q82/duckdb:vortex-file-compressed 29899349 / 26860434 / +11.3% 🔴 77594614 / 77804956 / -0.3% 0.39 / 0.35 / +11.6%
tpcds_q83/duckdb:vortex-file-compressed 21559270 / 21694036 / -0.6% 30679802 / 32263861 / -4.9% 0.70 / 0.67 / +4.5%
tpcds_q84/duckdb:vortex-file-compressed 13378910 / 13366814 / +0.1% 24755782 / 23226339 / +6.6% 0.54 / 0.58 / -6.1%
tpcds_q85/duckdb:vortex-file-compressed 36349624 / 36707151 / -1.0% 53405538 / 56348206 / -5.2% 0.68 / 0.65 / +4.5%
tpcds_q86/duckdb:vortex-file-compressed 17696072 / 16411782 / +7.8% 28468788 / 28182293 / +1.0% 0.62 / 0.58 / +6.7%
tpcds_q87/duckdb:vortex-file-compressed 76221726 / 75201770 / +1.4% 91333284 / 87749398 / +4.1% 0.83 / 0.86 / -2.6%
tpcds_q88/duckdb:vortex-file-compressed 37728773 / 37878092 / -0.4% 48812380 / 49979733 / -2.3% 0.77 / 0.76 / +2.0%
tpcds_q89/duckdb:vortex-file-compressed 24892397 / 24974289 / -0.3% 39283255 / 41888285 / -6.2% 0.63 / 0.60 / +6.3%
tpcds_q90/duckdb:vortex-file-compressed 9858890 / 9843474 / +0.2% 20689605 / 20353435 / +1.7% 0.48 / 0.48 / -1.5%
tpcds_q91/duckdb:vortex-file-compressed 18824638 / 19617013 / -4.0% 29033515 / 29081972 / -0.2% 0.65 / 0.67 / -3.9%
tpcds_q92/duckdb:vortex-file-compressed 14010586 / 13643566 / +2.7% 28166457 / 27682975 / +1.7% 0.50 / 0.49 / +0.9%
tpcds_q93/duckdb:vortex-file-compressed 25062759 / 25876894 / -3.1% 51890658 / 52613864 / -1.4% 0.48 / 0.49 / -1.8%
tpcds_q94/duckdb:vortex-file-compressed 32670374 / 32152022 / +1.6% 47520539 / 47204449 / +0.7% 0.69 / 0.68 / +0.9%
tpcds_q95/duckdb:vortex-file-compressed 96560786 / 97513786 / -1.0% 105910268 / 117615692 / -10.0% 0.91 / 0.83 / +10.0%
tpcds_q96/duckdb:vortex-file-compressed 12350405 / 11752061 / +5.1% 24207763 / 24570663 / -1.5% 0.51 / 0.48 / +6.7%
tpcds_q97/duckdb:vortex-file-compressed 61170432 / 62178961 / -1.6% 81226320 / 82766588 / -1.9% 0.75 / 0.75 / +0.2%
tpcds_q98/duckdb:vortex-file-compressed 26502046 / 26889542 / -1.4% 45045746 / 43917859 / +2.6% 0.59 / 0.61 / -3.9%
tpcds_q99/duckdb:vortex-file-compressed 21938564 / 26072871 / -15.9% 🟢 34163272 / 35980286 / -5.1% 0.64 / 0.72 / -11.4%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41118264 / 43748750 / -6.0% 49822728 / 50433867 / -1.2% 0.83 / 0.87 / -4.9%
tpcds_q02/duckdb:parquet 39723322 / 39630168 / +0.2% 46477100 / 50715675 / -8.4% 0.85 / 0.78 / +9.4%
tpcds_q03/duckdb:parquet 25807872 / 25995732 / -0.7% 36188625 / 36796166 / -1.7% 0.71 / 0.71 / +0.9%
tpcds_q04/duckdb:parquet 205207623 / 203957459 / +0.6% 223850448 / 234181220 / -4.4% 0.92 / 0.87 / +5.3%
tpcds_q05/duckdb:parquet 69202713 / 68357342 / +1.2% 83246071 / 87464497 / -4.8% 0.83 / 0.78 / +6.4%
tpcds_q06/duckdb:parquet 74433120 / 75115975 / -0.9% 88067062 / 89166769 / -1.2% 0.85 / 0.84 / +0.3%
tpcds_q07/duckdb:parquet 59888387 / 62193874 / -3.7% 79302613 / 76707973 / +3.4% 0.76 / 0.81 / -6.9%
tpcds_q08/duckdb:parquet 37800664 / 38663366 / -2.2% 46996020 / 46394278 / +1.3% 0.80 / 0.83 / -3.5%
tpcds_q09/duckdb:parquet 87126749 / 87080988 / +0.1% 97798683 / 101981323 / -4.1% 0.89 / 0.85 / +4.3%
tpcds_q10/duckdb:parquet 52382997 / 52520572 / -0.3% 61913162 / 62695229 / -1.2% 0.85 / 0.84 / +1.0%
tpcds_q11/duckdb:parquet 156678186 / 159415788 / -1.7% 166411668 / 164104249 / +1.4% 0.94 / 0.97 / -3.1%
tpcds_q12/duckdb:parquet 40962499 / 40814548 / +0.4% 47840169 / 48941959 / -2.3% 0.86 / 0.83 / +2.7%
tpcds_q13/duckdb:parquet 71118804 / 69804706 / +1.9% 88758310 / 87793121 / +1.1% 0.80 / 0.80 / +0.8%
tpcds_q14/duckdb:parquet 187394154 / 185753765 / +0.9% 195460560 / 202864595 / -3.6% 0.96 / 0.92 / +4.7%
tpcds_q15/duckdb:parquet 60243706 / 60934452 / -1.1% 68160023 / 69050398 / -1.3% 0.88 / 0.88 / +0.2%
tpcds_q16/duckdb:parquet 37636078 / 37850674 / -0.6% 46004875 / 45839434 / +0.4% 0.82 / 0.83 / -0.9%
tpcds_q17/duckdb:parquet 83121451 / 84076050 / -1.1% 90655941 / 89860905 / +0.9% 0.92 / 0.94 / -2.0%
tpcds_q18/duckdb:parquet 86884092 / 87775860 / -1.0% 96307359 / 98136096 / -1.9% 0.90 / 0.89 / +0.9%
tpcds_q19/duckdb:parquet 47734504 / 47466565 / +0.6% 59504136 / 63007623 / -5.6% 0.80 / 0.75 / +6.5%
tpcds_q20/duckdb:parquet 42848140 / 42342882 / +1.2% 48745779 / 48573403 / +0.4% 0.88 / 0.87 / +0.8%
tpcds_q21/duckdb:parquet 24014992 / 23962194 / +0.2% 30604013 / 28440652 / +7.6% 0.78 / 0.84 / -6.9%
tpcds_q22/duckdb:parquet 164173064 / 166072912 / -1.1% 165535522 / 167098902 / -0.9% 0.99 / 0.99 / -0.2%
tpcds_q23/duckdb:parquet 184514614 / 188036546 / -1.9% 195290989 / 193148517 / +1.1% 0.94 / 0.97 / -2.9%
tpcds_q24/duckdb:parquet 72911763 / 71146241 / +2.5% 84258994 / 82487151 / +2.1% 0.87 / 0.86 / +0.3%
tpcds_q25/duckdb:parquet 50352428 / 51215258 / -1.7% 60970812 / 61288817 / -0.5% 0.83 / 0.84 / -1.2%
tpcds_q26/duckdb:parquet 41606325 / 42361802 / -1.8% 52752630 / 51343370 / +2.7% 0.79 / 0.83 / -4.4%
tpcds_q27/duckdb:parquet 57138828 / 57111037 / +0.0% 75956369 / 81608147 / -6.9% 0.75 / 0.70 / +7.5%
tpcds_q28/duckdb:parquet 91433198 / 93252698 / -2.0% 104455437 / 112178597 / -6.9% 0.88 / 0.83 / +5.3%
tpcds_q29/duckdb:parquet 85096772 / 83041768 / +2.5% 95063984 / 96583021 / -1.6% 0.90 / 0.86 / +4.1%
tpcds_q30/duckdb:parquet 72592351 / 72470468 / +0.2% 81183806 / 81148208 / +0.0% 0.89 / 0.89 / +0.1%
tpcds_q31/duckdb:parquet 99143917 / 98601462 / +0.6% 110397517 / 111465299 / -1.0% 0.90 / 0.88 / +1.5%
tpcds_q32/duckdb:parquet 18112785 / 18353748 / -1.3% 26128550 / 26590155 / -1.7% 0.69 / 0.69 / +0.4%
tpcds_q33/duckdb:parquet 59734340 / 62367010 / -4.2% 73973683 / 73989561 / -0.0% 0.81 / 0.84 / -4.2%
tpcds_q34/duckdb:parquet 33392112 / 33006494 / +1.2% 40375106 / 41889230 / -3.6% 0.83 / 0.79 / +5.0%
tpcds_q35/duckdb:parquet 76982602 / 77399391 / -0.5% 86967098 / 86087567 / +1.0% 0.89 / 0.90 / -1.5%
tpcds_q36/duckdb:parquet 98727666 / 99335950 / -0.6% 112117664 / 112263590 / -0.1% 0.88 / 0.88 / -0.5%
tpcds_q37/duckdb:parquet 40551680 / 41378236 / -2.0% 47942615 / 47554095 / +0.8% 0.85 / 0.87 / -2.8%
tpcds_q38/duckdb:parquet 73948825 / 76468258 / -3.3% 81052316 / 85294747 / -5.0% 0.91 / 0.90 / +1.8%
tpcds_q39/duckdb:parquet 61252508 / 61661639 / -0.7% 69348451 / 67797634 / +2.3% 0.88 / 0.91 / -2.9%
tpcds_q40/duckdb:parquet 27635418 / 27952642 / -1.1% 35466442 / 36118029 / -1.8% 0.78 / 0.77 / +0.7%
tpcds_q41/duckdb:parquet 20714164 / 20143537 / +2.8% 26825317 / 26266476 / +2.1% 0.77 / 0.77 / +0.7%
tpcds_q42/duckdb:parquet 27011821 / 26999602 / +0.0% 36028531 / 36451419 / -1.2% 0.75 / 0.74 / +1.2%
tpcds_q43/duckdb:parquet 27424855 / 28272378 / -3.0% 31928317 / 35793884 / -10.8% 🟢 0.86 / 0.79 / +8.7%
tpcds_q44/duckdb:parquet 59282065 / 60736375 / -2.4% 76767755 / 74562633 / +3.0% 0.77 / 0.81 / -5.2%
tpcds_q45/duckdb:parquet 59803080 / 60622120 / -1.4% 68410755 / 67027287 / +2.1% 0.87 / 0.90 / -3.3%
tpcds_q46/duckdb:parquet 72600590 / 72394963 / +0.3% 83661822 / 88023341 / -5.0% 0.87 / 0.82 / +5.5%
tpcds_q47/duckdb:parquet 91077546 / 90830810 / +0.3% 101454055 / 105146923 / -3.5% 0.90 / 0.86 / +3.9%
tpcds_q48/duckdb:parquet 64929574 / 67648746 / -4.0% 81494556 / 85359866 / -4.5% 0.80 / 0.79 / +0.5%
tpcds_q49/duckdb:parquet 68260236 / 67399774 / +1.3% 84504108 / 92020170 / -8.2% 0.81 / 0.73 / +10.3%
tpcds_q50/duckdb:parquet 42727882 / 45228659 / -5.5% 54680508 / 50910629 / +7.4% 0.78 / 0.89 / -12.0%
tpcds_q51/duckdb:parquet 217348685 / 217340788 / +0.0% 225391493 / 225257376 / +0.1% 0.96 / 0.96 / -0.1%
tpcds_q52/duckdb:parquet 27103042 / 26490668 / +2.3% 39668569 / 37218058 / +6.6% 0.68 / 0.71 / -4.0%
tpcds_q53/duckdb:parquet 34307875 / 34202255 / +0.3% 46088999 / 48232701 / -4.4% 0.74 / 0.71 / +5.0%
tpcds_q54/duckdb:parquet 54338097 / 55357348 / -1.8% 64216828 / 63307482 / +1.4% 0.85 / 0.87 / -3.2%
tpcds_q55/duckdb:parquet 26781170 / 26580602 / +0.8% 35197056 / 38734658 / -9.1% 0.76 / 0.69 / +10.9%
tpcds_q56/duckdb:parquet 68149036 / 68450543 / -0.4% 78754532 / 84208264 / -6.5% 0.87 / 0.81 / +6.5%
tpcds_q57/duckdb:parquet 68624748 / 67905272 / +1.1% 74663287 / 75530496 / -1.1% 0.92 / 0.90 / +2.2%
tpcds_q58/duckdb:parquet 55689543 / 55351262 / +0.6% 65667680 / 67300961 / -2.4% 0.85 / 0.82 / +3.1%
tpcds_q59/duckdb:parquet 61628214 / 61543058 / +0.1% 66943830 / 67498896 / -0.8% 0.92 / 0.91 / +1.0%
tpcds_q60/duckdb:parquet 83124824 / 81154691 / +2.4% 93885214 / 95719978 / -1.9% 0.89 / 0.85 / +4.4%
tpcds_q61/duckdb:parquet 79605341 / 78725636 / +1.1% 94543289 / 94693948 / -0.2% 0.84 / 0.83 / +1.3%
tpcds_q62/duckdb:parquet 19843894 / 21271646 / -6.7% 26298285 / 24742108 / +6.3% 0.75 / 0.86 / -12.2%
tpcds_q63/duckdb:parquet 33878117 / 33973322 / -0.3% 41227462 / 44293841 / -6.9% 0.82 / 0.77 / +7.1%
tpcds_q64/duckdb:parquet 135424216 / 134987804 / +0.3% 151806761 / 149714203 / +1.4% 0.89 / 0.90 / -1.1%
tpcds_q65/duckdb:parquet 94707568 / 92507762 / +2.4% 103984926 / 106732283 / -2.6% 0.91 / 0.87 / +5.1%
tpcds_q66/duckdb:parquet 45626081 / 45574203 / +0.1% 52772689 / 52408182 / +0.7% 0.86 / 0.87 / -0.6%
tpcds_q67/duckdb:parquet 294927189 / 294181831 / +0.3% 293521745 / 294225942 / -0.2% 1.00 / 1.00 / +0.5%
tpcds_q68/duckdb:parquet 63481206 / 61610444 / +3.0% 77534945 / 77643526 / -0.1% 0.82 / 0.79 / +3.2%
tpcds_q69/duckdb:parquet 65899314 / 65821270 / +0.1% 76217947 / 75369095 / +1.1% 0.86 / 0.87 / -1.0%
tpcds_q70/duckdb:parquet 43074750 / 42560156 / +1.2% 55208315 / 50824609 / +8.6% 0.78 / 0.84 / -6.8%
tpcds_q71/duckdb:parquet 41196449 / 41353862 / -0.4% 55248418 / 54241063 / +1.9% 0.75 / 0.76 / -2.2%
tpcds_q72/duckdb:parquet 171754303 / 172146606 / -0.2% 185936396 / 189350126 / -1.8% 0.92 / 0.91 / +1.6%
tpcds_q73/duckdb:parquet 27894780 / 27072398 / +3.0% 37585734 / 37030456 / +1.5% 0.74 / 0.73 / +1.5%
tpcds_q74/duckdb:parquet 213097895 / 216089249 / -1.4% 222135491 / 223017657 / -0.4% 0.96 / 0.97 / -1.0%
tpcds_q75/duckdb:parquet 132487870 / 131891024 / +0.5% 152481016 / 152249842 / +0.2% 0.87 / 0.87 / +0.3%
tpcds_q76/duckdb:parquet 52519200 / 51285484 / +2.4% 63094614 / 65205448 / -3.2% 0.83 / 0.79 / +5.8%
tpcds_q77/duckdb:parquet 54767222 / 54841040 / -0.1% 70894930 / 67440836 / +5.1% 0.77 / 0.81 / -5.0%
tpcds_q78/duckdb:parquet 145322566 / 155747874 / -6.7% 167396946 / 168363678 / -0.6% 0.87 / 0.93 / -6.2%
tpcds_q79/duckdb:parquet 54342300 / 51430181 / +5.7% 66351886 / 64568583 / +2.8% 0.82 / 0.80 / +2.8%
tpcds_q80/duckdb:parquet 83895144 / 82941310 / +1.2% 103603866 / 103690804 / -0.1% 0.81 / 0.80 / +1.2%
tpcds_q81/duckdb:parquet 97657666 / 98572923 / -0.9% 104013811 / 104274293 / -0.2% 0.94 / 0.95 / -0.7%
tpcds_q82/duckdb:parquet 45656772 / 46604344 / -2.0% 52716767 / 52315928 / +0.8% 0.87 / 0.89 / -2.8%
tpcds_q83/duckdb:parquet 27763616 / 28152398 / -1.4% 33461174 / 33185714 / +0.8% 0.83 / 0.85 / -2.2%
tpcds_q84/duckdb:parquet 22515860 / 22751552 / -1.0% 29195885 / 29406408 / -0.7% 0.77 / 0.77 / -0.3%
tpcds_q85/duckdb:parquet 50453366 / 52752074 / -4.4% 60418665 / 62960389 / -4.0% 0.84 / 0.84 / -0.3%
tpcds_q86/duckdb:parquet 25013223 / 25146913 / -0.5% 33695848 / 33004413 / +2.1% 0.74 / 0.76 / -2.6%
tpcds_q87/duckdb:parquet 86022416 / 88695797 / -3.0% 95869906 / 92564858 / +3.6% 0.90 / 0.96 / -6.4%
tpcds_q88/duckdb:parquet 103066114 / 106796080 / -3.5% 110025162 / 111229279 / -1.1% 0.94 / 0.96 / -2.4%
tpcds_q89/duckdb:parquet 38243292 / 37846748 / +1.0% 48011551 / 48196620 / -0.4% 0.80 / 0.79 / +1.4%
tpcds_q90/duckdb:parquet 15304874 / 15015242 / +1.9% 20572620 / 20928242 / -1.7% 0.74 / 0.72 / +3.7%
tpcds_q91/duckdb:parquet 25435986 / 25515043 / -0.3% 33393880 / 33274247 / +0.4% 0.76 / 0.77 / -0.7%
tpcds_q92/duckdb:parquet 23658345 / 22329364 / +6.0% 31947017 / 31995562 / -0.2% 0.74 / 0.70 / +6.1%
tpcds_q93/duckdb:parquet 37204284 / 35799040 / +3.9% 46410960 / 49479404 / -6.2% 0.80 / 0.72 / +10.8%
tpcds_q94/duckdb:parquet 37278840 / 38247234 / -2.5% 48643743 / 46965479 / +3.6% 0.77 / 0.81 / -5.9%
tpcds_q95/duckdb:parquet 80845108 / 81409130 / -0.7% 98982155 / 86595751 / +14.3% 🔴 0.82 / 0.94 / -13.1%
tpcds_q96/duckdb:parquet 17638353 / 17012262 / +3.7% 23231505 / 24425947 / -4.9% 0.76 / 0.70 / +9.0%
tpcds_q97/duckdb:parquet 71597823 / 73153984 / -2.1% 81940647 / 78153554 / +4.8% 0.87 / 0.94 / -6.7%
tpcds_q98/duckdb:parquet 54827125 / 55289756 / -0.8% 67544155 / 66788134 / +1.1% 0.81 / 0.83 / -1.9%
tpcds_q99/duckdb:parquet 25553714 / 24402862 / +4.7% 32845430 / 30438057 / +7.9% 0.78 / 0.80 / -3.0%

Every planner and morsel the driver spawned took its own RowClaim, which
locks the file's Liveness to add its rows and again to release them.
DuckDB runs many threads over one file's Liveness, so on cheap,
high-throughput scans such as TPC-DS's inventory queries that mutex was
taken for every child of every chunk.

A child whose scope lies within its parent's claim now shares that claim
through an Arc, so spawning and retiring it never touch the Liveness. A
parent that narrows while children still share its claim claims the
narrower rows afresh and leaves the shared claim to them, so rows handed
to a child stay claimed until it retires.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
A planner handing out chunks in order spawned each with a new claim and
then narrowed its own, taking the liveness lock twice per chunk. DuckDB
plans every chunk of a file on one thread before its threads start, so
on files with thousands of chunks this delayed the whole scan.

RowClaim::split_front moves a claim's leading rows into a claim of
their own without touching the liveness, since the rows stay claimed. A
spawned child at the front of a claim only its parent holds now takes
those rows over, and the parent's narrowing then finds nothing to
release.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
A benchmark-only experiment, to be reverted: with the driver and engine
liveness wiring unchanged, the ValueCache keeps every value as on
develop. If TPC-DS inventory queries stay slower, the wiring costs the
time; if they recover, early eviction of dictionary values does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
A benchmark-only experiment, to be reverted with af51447: DuckDB scans
run without claims, as before the engines were wired to liveness, while
every other change stays. If TPC-DS inventory queries recover on DuckDB,
its use of liveness costs the time; otherwise a change that does not
involve liveness does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
joseph-isaacs and others added 2 commits November 9, 2026 21:30
Reverts 261823a (DuckDB scans without liveness) and af51447 (dictionary
values kept for the cache's life). With either change the TPC-DS SF10
inventory queries stayed equally slow, and an unrelated PR measured
against the same base shows the same numbers, so their cost comes from
develop since that base rather than from this change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A VortexFile opened with caching shares one ScanCache across its scans.
Each scan's claims were released when it ended, which drained every pin,
so the next scan decoded every dictionary again, as random-access takes
on a cached file do once per take.

The file's scan cache now holds a claim on all of its rows for as long
as the file caches, so the values its scans decode outlive each scan, as
before liveness. A file without caching, and an engine's per-query
cache, still drop them once their scan's work retires.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added action/bench-random-access Run only the random-access benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 9, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-random-access Run only the random-access benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 9, 2026
The previous commit kept a caching file's dictionary values by holding a
claim on the file's rows beside its ScanCache. A caller holding only the
ScanFile lost that claim with the file, and the file's scans still took
the liveness lock for claims that could never evict anything.

ScanCache::retaining_values builds a cache whose values live as long as
it does and which tracks no liveness, so its scans run as before
liveness, with no claims. ScanCache and PreparedScan::liveness return an
Option, and the engines admit through Run::admit_tracked, which tracks
liveness only when the cache has one. VortexFile::with_caching uses a
retaining cache.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added action/bench-random-access Run only the random-access benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 9, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-random-access Run only the random-access benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 9, 2026
Say which ScanCache constructors share values only between overlapping scans and that
retaining_values keeps them for the cache's life, state how long a cached file's V2 state
lives, rename the vortex-file test to what it proves, and reset only the plans when a cached
file's segment source changes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 0fbea339 vs base a1fbac67
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: random-access No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.942x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.970x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.974x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/arrow-ipc-cached 3152543 / 3201772 / -1.5% 3306713 / 3115217 / +6.1% 0.95 / 1.03 / -7.2%
random-access/feature-vectors/correlated/arrow-ipc-reopen 3351372 / 3383559 / -1.0% 10487860 / 13900346 / -24.5% 🟢 0.32 / 0.24 / +31.3%
random-access/feature-vectors/uniform/arrow-ipc-cached 55523146 / 54536828 / +1.8% 55065408 / 54797537 / +0.5% 1.01 / 1.00 / +1.3%
random-access/feature-vectors/uniform/arrow-ipc-reopen 35054042 / 36006451 / -2.6% 129400180 / 168213623 / -23.1% 🟢 0.27 / 0.21 / +26.6%
random-access/nested-lists/correlated/arrow-ipc-cached 61500 / 62775 / -2.0% 59787 / 62477 / -4.3% 1.03 / 1.00 / +2.4%
random-access/nested-lists/correlated/arrow-ipc-reopen 100366 / 106496 / -5.8% 3986816 / 3301738 / +20.7% 🔴 0.03 / 0.03 / -22.0%
random-access/nested-lists/uniform/arrow-ipc-cached 1167846 / 1188621 / -1.7% 1178723 / 1178946 / -0.0% 0.99 / 1.01 / -1.7%
random-access/nested-lists/uniform/arrow-ipc-reopen 1203884 / 1212417 / -0.7% 29694143 / 26521000 / +12.0% 🔴 0.04 / 0.05 / -11.3%
random-access/nested-structs/correlated/arrow-ipc-cached 48834 / 50986 / -4.2% 52764 / 51688 / +2.1% 0.93 / 0.99 / -6.2%
random-access/nested-structs/correlated/arrow-ipc-reopen 88305 / 94961 / -7.0% 3266525 / 2916481 / +12.0% 🔴 0.03 / 0.03 / -17.0%
random-access/nested-structs/uniform/arrow-ipc-cached 847264 / 881720 / -3.9% 842162 / 878903 / -4.2% 1.01 / 1.00 / +0.3%
random-access/nested-structs/uniform/arrow-ipc-reopen 912391.5 / 914059 / -0.2% 26429728 / 20360292 / +29.8% 🔴 0.03 / 0.04 / -23.1%
random-access/taxi/arrow-ipc-cached 67964 / 71029 / -4.3% 68829 / 68723 / +0.2% 0.99 / 1.03 / -4.5%
random-access/taxi/arrow-ipc-reopen 159298 / 170211 / -6.4% 3402750 / 3119188 / +9.1% 0.05 / 0.05 / -14.2%
random-access/taxi/correlated/arrow-ipc-cached 116127 / 122411.5 / -5.1% 114764 / 123455 / -7.0% 1.01 / 0.99 / +2.1%
random-access/taxi/correlated/arrow-ipc-reopen 214908.5 / 225106.5 / -4.5% 1747704 / 2074900 / -15.8% 🟢 0.12 / 0.11 / +13.3%
random-access/taxi/uniform/arrow-ipc-cached 2811118 / 2651867 / +6.0% 2796956 / 2651377 / +5.5% 1.01 / 1.00 / +0.5%
random-access/taxi/uniform/arrow-ipc-reopen 2886833 / 2988260 / -3.4% 33897068 / 34931348 / -3.0% 0.09 / 0.09 / -0.4%
random-access / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-cached 109007 / 108039 / +0.9% 109291 / 115212 / -5.1% 1.00 / 0.94 / +6.4%
random-access/feature-vectors/correlated/vortex-reopen 1887184 / 1907964 / -1.1% 3654449 / 4450459 / -17.9% 🟢 0.52 / 0.43 / +20.5%
random-access/feature-vectors/uniform/vortex-cached 971495 / 997862 / -2.6% 981886 / 979934 / +0.2% 0.99 / 1.02 / -2.8%
random-access/feature-vectors/uniform/vortex-reopen 2959863 / 2940521 / +0.7% 11477510 / 11687844 / -1.8% 0.26 / 0.25 / +2.5%
random-access/nested-lists/correlated/vortex-cached 94776 / 95340 / -0.6% 89841 / 94982 / -5.4% 1.05 / 1.00 / +5.1%
random-access/nested-lists/correlated/vortex-reopen 369215 / 358323 / +3.0% 2055245 / 2644667 / -22.3% 🟢 0.18 / 0.14 / +32.6%
random-access/nested-lists/uniform/vortex-cached 449095 / 446888 / +0.5% 482749 / 440425 / +9.6% 0.93 / 1.01 / -8.3%
random-access/nested-lists/uniform/vortex-reopen 959147.5 / 925509.5 / +3.6% 7696539 / 9190675 / -16.3% 🟢 0.12 / 0.10 / +23.8%
random-access/nested-structs/correlated/vortex-cached 120306 / 120609 / -0.3% 123492 / 119750 / +3.1% 0.97 / 1.01 / -3.3%
random-access/nested-structs/correlated/vortex-reopen 442005 / 454406 / -2.7% 3783358 / 3949068 / -4.2% 0.12 / 0.12 / +1.5%
random-access/nested-structs/uniform/vortex-cached 249655 / 243748.5 / +2.4% 245865 / 237979 / +3.3% 1.02 / 1.02 / -0.9%
random-access/nested-structs/uniform/vortex-reopen 643914 / 652443 / -1.3% 4765675 / 5442066 / -12.4% 🟢 0.14 / 0.12 / +12.7%
random-access/taxi/correlated/vortex-cached 295018 / 295031 / -0.0% 290011 / 293177 / -1.1% 1.02 / 1.01 / +1.1%
random-access/taxi/correlated/vortex-reopen 1244804 / 1256673 / -0.9% 2581321 / 2785595 / -7.3% 0.48 / 0.45 / +6.9%
random-access/taxi/uniform/vortex-cached 887331.5 / 873436 / +1.6% 903773 / 893330 / +1.2% 0.98 / 0.98 / +0.4%
random-access/taxi/uniform/vortex-reopen 3041635 / 3071368 / -1.0% 5309429 / 5972956 / -11.1% 🟢 0.57 / 0.51 / +11.4%
random-access/taxi/vortex-cached 246213.5 / 245818 / +0.2% 242529 / 257028 / -5.6% 1.02 / 0.96 / +6.1%
random-access/taxi/vortex-reopen 1039661 / 1020077 / +1.9% 3426599 / 3616509 / -5.3% 0.30 / 0.28 / +7.6%
random-access / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-cached 10214096 / 10182189 / +0.3% 10193224 / 10187392 / +0.1% 1.00 / 1.00 / +0.3%
random-access/feature-vectors/correlated/parquet-reopen 10457546 / 10474048 / -0.2% 17515352 / 17499104 / +0.1% 0.60 / 0.60 / -0.3%
random-access/feature-vectors/uniform/parquet-cached 132351252 / 132131350 / +0.2% 132506954 / 132164054 / +0.3% 1.00 / 1.00 / -0.1%
random-access/feature-vectors/uniform/parquet-reopen 132658839 / 136349318 / -2.7% 185449702 / 201831906 / -8.1% 0.72 / 0.68 / +5.9%
random-access/nested-lists/correlated/parquet-cached 4666716 / 4644922 / +0.5% 4668323 / 4652102 / +0.3% 1.00 / 1.00 / +0.1%
random-access/nested-lists/correlated/parquet-reopen 4729797 / 4768253 / -0.8% 10856984 / 11497243 / -5.6% 0.44 / 0.41 / +5.0%
random-access/nested-lists/uniform/parquet-cached 37391162 / 40065962 / -6.7% 37383641 / 39080447 / -4.3% 1.00 / 1.03 / -2.4%
random-access/nested-lists/uniform/parquet-reopen 40535628 / 37310636 / +8.6% 52230274 / 61217427 / -14.7% 🟢 0.78 / 0.61 / +27.3%
random-access/nested-structs/correlated/parquet-cached 9154243 / 9036762 / +1.3% 9159413 / 9025453 / +1.5% 1.00 / 1.00 / -0.2%
random-access/nested-structs/correlated/parquet-reopen 9235798 / 9287907 / -0.6% 21561060 / 21910573 / -1.6% 0.43 / 0.42 / +1.1%
random-access/nested-structs/uniform/parquet-cached 36706500 / 36696404 / +0.0% 36729223 / 36875249 / -0.4% 1.00 / 1.00 / +0.4%
random-access/nested-structs/uniform/parquet-reopen 36855801 / 36897968 / -0.1% 41996186 / 45281801 / -7.3% 0.88 / 0.81 / +7.7%
random-access/taxi/correlated/parquet-cached 23615613 / 23655778 / -0.2% 23632155 / 23700581 / -0.3% 1.00 / 1.00 / +0.1%
random-access/taxi/correlated/parquet-reopen 23856072 / 23657906 / +0.8% 24974393 / 27244002 / -8.3% 0.96 / 0.87 / +10.0%
random-access/taxi/parquet-cached 16700462 / 16458662 / +1.5% 16777452 / 16438257 / +2.1% 1.00 / 1.00 / -0.6%
random-access/taxi/parquet-reopen 16611902 / 16750310 / -0.8% 21359425 / 22199459 / -3.8% 0.78 / 0.75 / +3.1%
random-access/taxi/uniform/parquet-cached 37609790 / 37602280 / +0.0% 37704437 / 37346134 / +1.0% 1.00 / 1.01 / -0.9%
random-access/taxi/uniform/parquet-reopen 37706784 / 37371490 / +0.9% 39706273 / 41257601 / -3.8% 0.95 / 0.91 / +4.8%
random-access / lance / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/lance-cached 157394 / 155661 / +1.1% 158718 / 159774 / -0.7% 0.99 / 0.97 / +1.8%
random-access/feature-vectors/correlated/lance-reopen 938080.5 / 979155 / -4.2% 7834741 / 6956234 / +12.6% 🔴 0.12 / 0.14 / -14.9%
random-access/feature-vectors/uniform/lance-cached 1002286 / 1000359 / +0.2% 996962 / 1005203 / -0.8% 1.01 / 1.00 / +1.0%
random-access/feature-vectors/uniform/lance-reopen 1809482 / 1825531 / -0.9% 10936661 / 9273951 / +17.9% 🔴 0.17 / 0.20 / -15.9%
random-access/nested-lists/correlated/lance-cached 114271 / 118159 / -3.3% 120679 / 117792 / +2.5% 0.95 / 1.00 / -5.6%
random-access/nested-lists/correlated/lance-reopen 435545.5 / 449300 / -3.1% 5988138 / 6105647 / -1.9% 0.07 / 0.07 / -1.2%
random-access/nested-lists/uniform/lance-cached 808675 / 847912 / -4.6% 831037 / 821599 / +1.1% 0.97 / 1.03 / -5.7%
random-access/nested-lists/uniform/lance-reopen 1346994 / 1375628 / -2.1% 9903222 / 9330495 / +6.1% 0.14 / 0.15 / -7.7%
random-access/nested-structs/correlated/lance-cached 215754 / 215163 / +0.3% 221513 / 219214 / +1.0% 0.97 / 0.98 / -0.8%
random-access/nested-structs/correlated/lance-reopen 488762 / 492905 / -0.8% 5992602 / 5637578 / +6.3% 0.08 / 0.09 / -6.7%
random-access/nested-structs/uniform/lance-cached 2181486 / 2238168 / -2.5% 2189258 / 2209566 / -0.9% 1.00 / 1.01 / -1.6%
random-access/nested-structs/uniform/lance-reopen 2521258 / 2487385 / +1.4% 16227477 / 14840304 / +9.3% 0.16 / 0.17 / -7.3%
random-access/taxi/correlated/lance-cached 636396.5 / 629094 / +1.2% 631091 / 636351 / -0.8% 1.01 / 0.99 / +2.0%
random-access/taxi/correlated/lance-reopen 1624874 / 1620074 / +0.3% 3802573 / 2837623 / +34.0% 🔴 0.43 / 0.57 / -25.2%
random-access/taxi/lance-cached 432786 / 434132 / -0.3% 423131 / 435522 / -2.8% 1.02 / 1.00 / +2.6%
random-access/taxi/lance-reopen 1268964 / 1270952 / -0.2% 8517082 / 7495514 / +13.6% 🔴 0.15 / 0.17 / -12.1%
random-access/taxi/uniform/lance-cached 6855221 / 6819458 / +0.5% 6863338 / 6787763 / +1.1% 1.00 / 1.00 / -0.6%
random-access/taxi/uniform/lance-reopen 7985352 / 8190290 / -2.5% 28938383 / 25238103 / +14.7% 🔴 0.28 / 0.32 / -15.0%
random-access / litdata / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/litdata-cached 732984.5 / 738480 / -0.7% 750016 / 742476 / +1.0% 0.98 / 0.99 / -1.7%
random-access/feature-vectors/correlated/litdata-reopen 3029804 / 3013832 / +0.5% 3757368 / 3749096 / +0.2% 0.81 / 0.80 / +0.3%
random-access/feature-vectors/uniform/litdata-cached 1117361 / 1102662 / +1.3% 1170934 / 1107059 / +5.8% 0.95 / 1.00 / -4.2%
random-access/feature-vectors/uniform/litdata-reopen 16076763 / 16188510 / -0.7% 32396313 / 31707109 / +2.2% 0.50 / 0.51 / -2.8%
random-access/nested-lists/correlated/litdata-cached 574220 / 583933 / -1.7% 572543 / 582753 / -1.8% 1.00 / 1.00 / +0.1%
random-access/nested-lists/correlated/litdata-reopen 17074650 / 17403432 / -1.9% 24934733 / 25225044 / -1.2% 0.68 / 0.69 / -0.7%
random-access/nested-lists/uniform/litdata-cached 604030.5 / 616306 / -2.0% 600324 / 615105 / -2.4% 1.01 / 1.00 / +0.4%
random-access/nested-lists/uniform/litdata-reopen 17233505 / 17298420 / -0.4% 25521341 / 25249435 / +1.1% 0.68 / 0.69 / -1.4%
random-access/nested-structs/correlated/litdata-cached 652529 / 652498 / +0.0% 650153 / 652122 / -0.3% 1.00 / 1.00 / +0.3%
random-access/nested-structs/correlated/litdata-reopen 17758252 / 18987520 / -6.5% 22572929 / 21835220 / +3.4% 0.79 / 0.87 / -9.5%
random-access/nested-structs/uniform/litdata-cached 713588.5 / 707398 / +0.9% 719012 / 714039 / +0.7% 0.99 / 0.99 / +0.2%
random-access/nested-structs/uniform/litdata-reopen 15951817 / 16271458 / -2.0% 24617156 / 24811280 / -0.8% 0.65 / 0.66 / -1.2%
random-access/taxi/correlated/litdata-cached 1154647 / 1158892 / -0.4% 1166893 / 1159556 / +0.6% 0.99 / 1.00 / -1.0%
random-access/taxi/correlated/litdata-reopen 19773172 / 19854918 / -0.4% 29357620 / 29356258 / +0.0% 0.67 / 0.68 / -0.4%
random-access/taxi/litdata-cached 79562 / 81064 / -1.9% 81691 / 81212 / +0.6% 0.97 / 1.00 / -2.4%
random-access/taxi/litdata-reopen 10749669 / 10900118 / -1.4% 14406155 / 14525096 / -0.8% 0.75 / 0.75 / -0.6%
random-access/taxi/uniform/litdata-cached 1287881 / 1295601 / -0.6% 1286018 / 1299474 / -1.0% 1.00 / 1.00 / +0.4%
random-access/taxi/uniform/litdata-reopen 68781121 / 67893378 / +1.3% 83994758 / 83623508 / +0.4% 0.82 / 0.81 / +0.9%

A V2 scan kept up to 64 MiB of each file's recently read segment bytes in a least recently used
cache behind one mutex, which every segment request took. Scans that track liveness now keep the
arrays decoded from the segments neighbouring chunks share instead: a segment a chunk slices,
which spans a chunk boundary, and a zone table every chunk reads whole. Each array is pinned to
the file rows it covers and dropped once no live work claims them, so later chunks reuse it
without reading or decoding the segment again.

Lookups take a read lock on one of 32 shards rather than updating a shared LRU. A 1 GiB budget
only bounds memory if work is claimed far ahead of its reads. Caches without liveness, as for
VortexFile::with_caching, keep retaining segment bytes as before.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBmU6aRNmSqEsMdKGW
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant