Skip to content

Run more independent CI steps in parallel - #11450

Merged
joseph-isaacs merged 8 commits into
developfrom
ji/confident-allen-2ohb41
Nov 13, 2026
Merged

joseph-isaacs merged 8 commits into
developfrom
ji/confident-allen-2ohb41

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Summary

A follow-up to #11445. Step timings from recent runs showed CI jobs outside the benchmarks still doing independent setup and checks one step at a time. This groups those steps into parallel: blocks, splits the Java job into a matrix, and speeds up the SQL benchmark binary handoff. It also fixes the SQL benchmarks' DuckDB runs, which have been failing since the Rust 1.100 upgrade.

Changes

SQL benchmarks (sql-bench-matrix.yml)

  • The build job packs the bench binaries into one tar with multi-threaded zstd and uploads it with compression-level: 0, instead of letting upload-artifact zip them with single-threaded zlib. Packing and uploading took 12s, down from 64–90s. Each bench job then spends about 4s unpacking, and every bench job starts 50–75s sooner. The tar also keeps the executable bits, so the chmod step is gone.
  • Fix: every DuckDB benchmark failed with libduckdb.so: cannot open shared object file, on other branches too. Rust 1.100's cargo moved build-script output from build/<pkg>-<hash>/out to build/<pkg>/<hash>/out. vortex-duckdb/build.rs keeps its DuckDB cache two levels above OUT_DIR, so the library moved to build/vortex-duckdb/vortex-duckdb-cache/, and the hard-coded upload path matched nothing. upload-artifact skipped the missing file silently. The build now searches target/release_debug/build for the library and fails if it is missing, because duckdb-bench cannot run without it. It loads the library through an absolute rpath, so the archive keeps its relative path.

Pre-merge CI (ci.yml)

  • Java: a matrix of four jobs. One leg runs javadoc check without the Spark compat suites, and one leg runs each Spark compat suite (4.1, 4.2, 4.3). Gradle --parallel only splits work across projects, and all three compat suites live in :vortex-spark-4.0_2.13, so they ran one after another. A "Java" gate job keeps the required check name. It runs with always() and fails if any leg failed or was cancelled, because a skipped required check counts as passed.
  • License check: cargo deny check advisories and check bans licenses sources run at the same time. The advisory warning still runs after them, and now has !cancelled() so it isn't skipped when both checks fail.
  • Python (test): after the main suite has built the extension and synced the environment, the datasets-floor, Polars-floor and docs checks run at the same time.
  • Lightweight checks: the uv setup runs alongside the apt install.

Other PR-path workflows

  • docs-build.yml:
    • Rust, JDK and uv install at the same time.
    • Javadoc (3m41s) builds alongside the Sphinx build (7m15s).
    • The Javadoc is copied into docs/_build/html/_static after the Sphinx build. The docs link to it with raw HTML, and Sphinx only copies _static into the output, so the built site is the same.
  • publish-dry-runs.yml, wheel build: setup-prebuild, Zig and uv install at the same time. The Rust cache still waits for setup-prebuild, because its key includes the rustc version.
  • web.yml, web-build.yml: Rust, wasm-pack, Bun and Node install at the same time.

Fuzz, package and release workflows

  • run-fuzzer.yml, minimize_fuzz_corpus_workflow.yml: runs-on/action and checkout run together, then building or downloading the fuzzer runs alongside the corpus restore.
  • fuzz-coverage.yml: the corpus download (python3 only) runs alongside setup-prebuild.
  • close-fixed-fuzzer-issues.yml: the LLVM setup runs with the cargo-fuzz install. setup-fuzz-linker stays on its own, because both it and the LLVM setup may run apt-get.
  • wasm-fuzz.yml: the wasm32 build runs with the wabt install. setup-fuzz-linker still comes after, because it sets mold RUSTFLAGS.
  • build-fuzzers.yml, package.yml, release-binaries.yml, publish.yml, compat-gen-upload.yml: runs-on/action and checkout run together, and the JDK, Rust, Zig, AWS-credential and artifact-download steps that don't depend on each other run at the same time.

Not changed

  • Windows: splitting the wheel build into its own job was tried and reverted. The runner pool keeps one Windows instance warm and a cold one takes 85–105s to boot, which costs more than the 67s it took off the critical path.
  • Rust tests (cpu-features): "Check CPU features" and the test step compile into the same cargo target directory, so cargo would make them wait for each other.
  • The CUDA, sanitizer, musl and Rust/Clippy jobs: their time is almost all compiling and running tests.
  • No matrix caps max-parallel, so all matrix legs already run at once.

Measured

Before After
SQL bench: package + upload binaries 64–90s 12s
SQL bench: download + unpack, per bench job 16–20s 17–31s
Java, warm Gradle cache 100s 81s longest leg + 2s gate
Java, cold Gradle cache 546–588s the compat suites (about 1.5–2 min each) no longer run in series
License check 92–110s 67–84s
Docs build 11m33s 8m39s–10m36s

The ci.yml wall time is still set by Windows (about 8.5–10.5 min), so these changes shorten individual jobs, not the whole run. The SQL benchmark changes shorten the bench run directly. On the latest commit the SQL benchmarks all finished, each with a "No clear signal" verdict, as expected for a CI-only change.

Checks

  • yamllint --strict -c .yamllint.yaml .github/ passes.
  • For every job in every workflow, I parsed the old and new YAML, flattened the parallel: groups and compared the steps. They are identical apart from the rewritten Javadoc copy step, the !cancelled() on the advisory warning, the Java matrix, and the SQL bench packaging.
  • I ran Cargo 1.100 locally to confirm the new OUT_DIR layout, and checked that the libduckdb.so search matches it.
  • A separate review pass checked each group for shared files, environments, outputs, PATH/GITHUB_ENV needs and apt-lock conflicts.
  • CI on the latest commit is green, including all four Java legs, the Java gate, and the integration smoke tests. An earlier smoke-test failure, where the RustFS bucket creation returned an HTTP error after the health check passed, did not recur.

🤖 Generated with Claude Code

https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N

joseph-isaacs and others added 2 commits November 13, 2026 15:40
Step timings from recent runs show several jobs still doing independent work
one step at a time:

- ci.yml, license check: `cargo deny check advisories` (44s) and
  `check bans licenses sources` (39s) now run at the same time. The advisory
  warning still runs after them.
- ci.yml, Python (test): after the main suite builds the extension and syncs the
  environment, the datasets-floor, Polars-floor and docs checks run at the same
  time.
- ci.yml, lightweight checks: the uv setup runs alongside the apt install.
- publish-dry-runs.yml, wheel build: setup-prebuild, Zig and uv install at the
  same time. The Rust cache still waits for setup-prebuild, because its key
  includes the rustc version.
- docs-build.yml: Rust, JDK and uv install at the same time. Javadoc (3m41s)
  now builds alongside the Sphinx build (7m15s) instead of before it, and is
  copied into docs/_build/html/_static afterwards. The docs link to it with raw
  HTML and Sphinx only copies _static into the output, so the site is the same.
- web.yml and web-build.yml: Rust, wasm-pack, Bun and Node install at the same
  time.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
- run-fuzzer.yml and minimize_fuzz_corpus_workflow.yml: runs-on/action with
  checkout, then building or downloading the fuzzer alongside the corpus
  restore. setup-fuzz-llvm still runs first.
- fuzz-coverage.yml: the corpus download (python3 only) runs alongside
  setup-prebuild.
- close-fixed-fuzzer-issues.yml: setup-fuzz-llvm with the cargo-fuzz install.
  setup-fuzz-linker stays on its own, since both it and the LLVM setup may
  run apt-get.
- wasm-fuzz.yml: the wasm32 build with the wabt install. setup-fuzz-linker
  still comes after, because it sets RUSTFLAGS for mold.
- build-fuzzers.yml, package.yml, release-binaries.yml, publish.yml and
  compat-gen-upload.yml: runs-on/action with checkout, and the JDK, Rust, Zig,
  AWS-credential and artifact-download steps that don't depend on each other.

Also keep the cargo deny advisory warning when bans/licenses/sources fails in
the same group: it now has `!cancelled()`.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Claude <noreply@anthropic.com>
…zzer-issues

When clang or llvm-symbolizer is missing, setup-fuzz-llvm installs LLVM with
aminya/setup-cpp, which can repoint cc and set CC/CXX. That must not happen
while cargo-fuzz is being built, so these steps go back to their original
order. Only runs-on/action and checkout still run together.

I, Joe Isaacs <joe.isaacs@live.co.uk>, hereby add my Signed-off-by to this commit: f9ad7ca

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed

codspeed Bot commented Nov 13, 2026 •

Copy link
Copy Markdown

Merging this PR will not alter performance

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 2 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

✅ 1936 untouched benchmarks
⏩ 50 skipped benchmarks1


Comparing ji/confident-allen-2ohb41 (415ae1d) with develop (1fbf1d6)

Open in CodSpeed

Footnotes

  1. 50 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

Pre-merge CI:
- Windows: the wheel build (67s) ran after the Rust tests on the same runner,
  but shares nothing with them. It now runs as "Windows wheel (x64)" beside
  "Windows tests (x64)". This takes about a minute off the longest PR job.
- Java: the Spark 4.1, 4.2 and 4.3 compat suites live in one Gradle project,
  and Gradle runs one project's tasks one at a time, so they took about 6.5
  minutes in series whenever the JNI library changed. Each suite now runs on
  its own runner, beside the remaining javadoc and check tasks.
- "Windows (x64)" and "Java" become small jobs that gather the split jobs and
  fail if any failed, so required checks with those names still cover
  everything. Skipped jobs count as passed, as before.

Benchmarks:
- sql-bench-matrix.yml: upload-artifact zipped the bench binaries with
  single-threaded zlib (89s on the build job). The build job now packs them
  into a tar with multi-threaded zstd and uploads it uncompressed, as the
  CodSpeed jobs already do. The bench and debuginfo jobs unpack it, and the
  tar keeps the executable bits, so the chmod step is gone.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026
joseph-isaacs and others added 2 commits November 13, 2026 17:07
- Windows: undo the wheel/test split. The pool keeps only one Windows
  instance hot and a cold one takes 85-105s to boot, so a second Windows job
  could cost more than the 67s wheel build it took off the critical path. The
  job is back exactly as it was on develop.
- Java gate: run with `always()`. With `!cancelled()`, cancelling the run
  skipped the gate, and a skipped required check counts as passed.
- sql-bench-matrix.yml: install zstd before unpacking if the runner image
  lacks it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
The SQL benchmark build failed at "Package binaries": the
duckdb-lib-*-prebuilt/libduckdb.so glob matched nothing, so tar got the
literal path and stopped. The old upload-artifact paths skipped a missing
file silently, and the benchmarks ran without it. Expand the glob with
nullglob so a missing libduckdb is left out again, as before.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done b1ca326 clickbench-nvme 1 Explore Profiling Data
🟢 Done b1ca326 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done b1ca326 polarsignals 1 Explore Profiling Data
🟢 Done b1ca326 tpch-nvme-10 1 Explore Profiling Data
🟢 Done b1ca326 fineweb 1 Explore Profiling Data
🟢 Done b1ca326 tpch-s3 1 Explore Profiling Data
🟢 Done b1ca326 tpch-nvme 1 Explore Profiling Data
🟢 Done b1ca326 tpcds-nvme 1 Explore Profiling Data
Previous Runs (6)
Status Commit Job Attempt Link
🟢 Done d9069a4 tpcds-nvme 1 Explore Profiling Data
🟢 Done d9069a4 fineweb 1 Explore Profiling Data
🟢 Done d9069a4 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done d9069a4 tpch-nvme-10 1 Explore Profiling Data
🟢 Done d9069a4 polarsignals 1 Explore Profiling Data
🟢 Done d9069a4 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR b1ca326a vs base 815e3446
Vortex (geomean): hot 1.003x ➖ · cold 1.051x ➖


datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 80868497 / 80331568 / +0.7% 122873807 / 122902391 / -0.0% 0.66 / 0.65 / +0.7%
polarsignals_q01/datafusion:vortex-file-compressed 90103648 / 88444978 / +1.9% 216624258 / 145106688 / +49.3% 🔴 0.42 / 0.61 / -31.8%
polarsignals_q02/datafusion:vortex-file-compressed 11199690 / 11144836 / +0.5% 43752795 / 44529504 / -1.7% 0.26 / 0.25 / +2.3%
polarsignals_q03/datafusion:vortex-file-compressed 90858208 / 92941226 / -2.2% 156416828 / 149484188 / +4.6% 0.58 / 0.62 / -6.6%
polarsignals_q04/datafusion:vortex-file-compressed 9344973 / 9332871 / +0.1% 38938143 / 38710951 / +0.6% 0.24 / 0.24 / -0.5%
polarsignals_q05/datafusion:vortex-file-compressed 11360918 / 11521090 / -1.4% 41786550 / 41903309 / -0.3% 0.27 / 0.27 / -1.1%
polarsignals_q06/datafusion:vortex-file-compressed 23225731 / 23122594 / +0.4% 54972361 / 54844172 / +0.2% 0.42 / 0.42 / +0.2%
polarsignals_q07/datafusion:vortex-file-compressed 10675930 / 10809834 / -1.2% 41557130 / 40475702 / +2.7% 0.26 / 0.27 / -3.8%
polarsignals_q08/datafusion:vortex-file-compressed 133768256 / 133608579 / +0.1% 197231432 / 195300030 / +1.0% 0.68 / 0.68 / -0.9%
polarsignals_q09/datafusion:vortex-file-compressed 10240150 / 10048696 / +1.9% 41518901 / 37635477 / +10.3% 🔴 0.25 / 0.27 / -7.6%
polarsignals_q10/datafusion:vortex-file-compressed 13105970 / 13115917 / -0.1% 51506426 / 49763469 / +3.5% 0.25 / 0.26 / -3.5%
polarsignals_q11/datafusion:vortex-file-compressed 15759608 / 15865172 / -0.7% 48619628 / 47841733 / +1.6% 0.32 / 0.33 / -2.3%
polarsignals_q12/datafusion:vortex-file-compressed 16826706 / 16253500 / +3.5% 47672322 / 46589249 / +2.3% 0.35 / 0.35 / +1.2%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR b1ca326a vs base bcbe4c23
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Engines: DataFusion No clear signal (-3.4%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.981x ➖ · cold 0.994x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.968x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5976590 / 5993266 / -0.3% 19177346 / 21026981 / -8.8% 0.31 / 0.29 / +9.3%
fineweb_q01/datafusion:vortex-file-compressed 9426030 / 8690454 / +8.5% 36594498 / 33991317 / +7.7% 0.26 / 0.26 / +0.7%
fineweb_q02/datafusion:vortex-file-compressed 11022472 / 11922170 / -7.5% 39135441 / 40345011 / -3.0% 0.28 / 0.30 / -4.7%
fineweb_q03/datafusion:vortex-file-compressed 16696270 / 17633929 / -5.3% 106355196 / 101896464 / +4.4% 0.16 / 0.17 / -9.3%
fineweb_q04/datafusion:vortex-file-compressed 64730226 / 65515784 / -1.2% 148551929 / 153366890 / -3.1% 0.44 / 0.43 / +2.0%
fineweb_q05/datafusion:vortex-file-compressed 62381357 / 61760742 / +1.0% 138507179 / 136697442 / +1.3% 0.45 / 0.45 / -0.3%
fineweb_q06/datafusion:vortex-file-compressed 16639785 / 16774718 / -0.8% 106796371 / 103043822 / +3.6% 0.16 / 0.16 / -4.3%
fineweb_q07/datafusion:vortex-file-compressed 16875430 / 16642201 / +1.4% 109417141 / 105058447 / +4.1% 0.15 / 0.16 / -2.6%
fineweb_q08/datafusion:vortex-file-compressed 8456710 / 10781694 / -21.6% 🟢 23621012 / 31325477 / -24.6% 🟢 0.36 / 0.34 / +4.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9446986 / 9321942 / +1.3% 33266383 / 31891708 / +4.3% 0.28 / 0.29 / -2.8%
fineweb_q01/datafusion:parquet 74396704 / 74255006 / +0.2% 163141294 / 162994299 / +0.1% 0.46 / 0.46 / +0.1%
fineweb_q02/datafusion:parquet 75416236 / 74219944 / +1.6% 152840950 / 159967017 / -4.5% 0.49 / 0.46 / +6.3%
fineweb_q03/datafusion:parquet 74459522 / 75994936 / -2.0% 160331563 / 154603499 / +3.7% 0.46 / 0.49 / -5.5%
fineweb_q04/datafusion:parquet 82610918 / 83039984 / -0.5% 165457692 / 159993102 / +3.4% 0.50 / 0.52 / -3.8%
fineweb_q05/datafusion:parquet 79999881 / 80178436 / -0.2% 156801506 / 157268023 / -0.3% 0.51 / 0.51 / +0.1%
fineweb_q06/datafusion:parquet 76989717 / 76085074 / +1.2% 160744814 / 157330567 / +2.2% 0.48 / 0.48 / -1.0%
fineweb_q07/datafusion:parquet 75638368 / 73406176 / +3.0% 161346482 / 153181861 / +5.3% 0.47 / 0.48 / -2.2%
fineweb_q08/datafusion:parquet 73227688 / 75544514 / -3.1% 160138234 / 156339773 / +2.4% 0.46 / 0.48 / -5.4%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2021136 / 2106250 / -4.0% 7276150 / 8406183 / -13.4% 🟢 0.28 / 0.25 / +10.9%
fineweb_q01/duckdb:vortex-file-compressed 8670822 / 8809484 / -1.6% 28883922 / 26335983 / +9.7% 0.30 / 0.33 / -10.3%
fineweb_q02/duckdb:vortex-file-compressed 10466882 / 10892367 / -3.9% 30404433 / 28095366 / +8.2% 0.34 / 0.39 / -11.2%
fineweb_q03/duckdb:vortex-file-compressed 17808332 / 17662966 / +0.8% 92827327 / 90960066 / +2.1% 0.19 / 0.19 / -1.2%
fineweb_q04/duckdb:vortex-file-compressed 68726996 / 68801421 / -0.1% 113397338 / 113066653 / +0.3% 0.61 / 0.61 / -0.4%
fineweb_q05/duckdb:vortex-file-compressed 68104575 / 67419282 / +1.0% 111363590 / 111584136 / -0.2% 0.61 / 0.60 / +1.2%
fineweb_q06/duckdb:vortex-file-compressed 17861636 / 17946955 / -0.5% 91208536 / 92273117 / -1.2% 0.20 / 0.19 / +0.7%
fineweb_q07/duckdb:vortex-file-compressed 19448222 / 19345449 / +0.5% 91512250 / 90650515 / +1.0% 0.21 / 0.21 / -0.4%
fineweb_q08/duckdb:vortex-file-compressed 4352866 / 4248540 / +2.5% 12181398 / 11381149 / +7.0% 0.36 / 0.37 / -4.3%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23407962 / 23165669 / +1.0% 27268493 / 27957721 / -2.5% 0.86 / 0.83 / +3.6%
fineweb_q01/duckdb:parquet 53305297 / 52749744 / +1.1% 71079816 / 72805040 / -2.4% 0.75 / 0.72 / +3.5%
fineweb_q02/duckdb:parquet 60006092 / 58829372 / +2.0% 77673420 / 77701644 / -0.0% 0.77 / 0.76 / +2.0%
fineweb_q03/duckdb:parquet 117734638 / 118888640 / -1.0% 177130970 / 177353223 / -0.1% 0.66 / 0.67 / -0.8%
fineweb_q04/duckdb:parquet 161817308 / 160974695 / +0.5% 207626281 / 205639160 / +1.0% 0.78 / 0.78 / -0.4%
fineweb_q05/duckdb:parquet 156299155 / 162979134 / -4.1% 199547430 / 196403603 / +1.6% 0.78 / 0.83 / -5.6%
fineweb_q06/duckdb:parquet 87182498 / 87840752 / -0.7% 141504256 / 147885440 / -4.3% 0.62 / 0.59 / +3.7%
fineweb_q07/duckdb:parquet 89699595 / 90282770 / -0.6% 141461934 / 144378659 / -2.0% 0.63 / 0.63 / +1.4%
fineweb_q08/duckdb:parquet 28930908 / 28419528 / +1.8% 30130088 / 29609217 / +1.8% 0.96 / 0.96 / +0.0%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR b1ca326a vs base bcbe4c23
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-1.7%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 0.990x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91501948 / 92851951 / -1.5% 152124402 / 144328818 / +5.4% 0.60 / 0.64 / -6.5%
tpch_q02/datafusion:vortex-file-compressed 64824318 / 65159672 / -0.5% 96303060 / 94613492 / +1.8% 0.67 / 0.69 / -2.3%
tpch_q03/datafusion:vortex-file-compressed 63237842 / 63400609 / -0.3% 118057527 / 115186782 / +2.5% 0.54 / 0.55 / -2.7%
tpch_q04/datafusion:vortex-file-compressed 34408982 / 35195549 / -2.2% 69738862 / 73430524 / -5.0% 0.49 / 0.48 / +2.9%
tpch_q05/datafusion:vortex-file-compressed 118310868 / 118984085 / -0.6% 178266401 / 189821706 / -6.1% 0.66 / 0.63 / +5.9%
tpch_q06/datafusion:vortex-file-compressed 8900903 / 10352324 / -14.0% 🟢 55523719 / 53683374 / +3.4% 0.16 / 0.19 / -16.9%
tpch_q07/datafusion:vortex-file-compressed 97181814 / 98545129 / -1.4% 163284760 / 161636775 / +1.0% 0.60 / 0.61 / -2.4%
tpch_q08/datafusion:vortex-file-compressed 141857453 / 144565084 / -1.9% 216016597 / 210515964 / +2.6% 0.66 / 0.69 / -4.4%
tpch_q09/datafusion:vortex-file-compressed 183031547 / 186554647 / -1.9% 267848131 / 278622279 / -3.9% 0.68 / 0.67 / +2.1%
tpch_q10/datafusion:vortex-file-compressed 70124770 / 71288122 / -1.6% 135634493 / 137668480 / -1.5% 0.52 / 0.52 / -0.2%
tpch_q11/datafusion:vortex-file-compressed 45392662 / 45789959 / -0.9% 70219274 / 73375418 / -4.3% 0.65 / 0.62 / +3.6%
tpch_q12/datafusion:vortex-file-compressed 34724563 / 36056595 / -3.7% 79678765 / 77344793 / +3.0% 0.44 / 0.47 / -6.5%
tpch_q13/datafusion:vortex-file-compressed 48668829 / 48568579 / +0.2% 80120380 / 86054112 / -6.9% 0.61 / 0.56 / +7.6%
tpch_q14/datafusion:vortex-file-compressed 20071722 / 20615719 / -2.6% 82620348 / 91350236 / -9.6% 0.24 / 0.23 / +7.6%
tpch_q15/datafusion:vortex-file-compressed 33018228 / 33398012 / -1.1% 87900679 / 91830613 / -4.3% 0.38 / 0.36 / +3.3%
tpch_q16/datafusion:vortex-file-compressed 37332765 / 37079439 / +0.7% 64524543 / 67377685 / -4.2% 0.58 / 0.55 / +5.1%
tpch_q17/datafusion:vortex-file-compressed 179164825 / 176295611 / +1.6% 217968464 / 222937137 / -2.2% 0.82 / 0.79 / +3.9%
tpch_q18/datafusion:vortex-file-compressed 206776698 / 207604685 / -0.4% 268768304 / 266946857 / +0.7% 0.77 / 0.78 / -1.1%
tpch_q19/datafusion:vortex-file-compressed 28141882 / 28389362 / -0.9% 79127820 / 86860807 / -8.9% 0.36 / 0.33 / +8.8%
tpch_q20/datafusion:vortex-file-compressed 60281652 / 59988140 / +0.5% 108932007 / 114610176 / -5.0% 0.55 / 0.52 / +5.7%
tpch_q21/datafusion:vortex-file-compressed 181153768 / 183450387 / -1.3% 234771031 / 242286896 / -3.1% 0.77 / 0.76 / +1.9%
tpch_q22/datafusion:vortex-file-compressed 25373273 / 25225678 / +0.6% 53463731 / 51848672 / +3.1% 0.47 / 0.49 / -2.5%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87505219 / 86804735 / +0.8% 127004341 / 127398471 / -0.3% 0.69 / 0.68 / +1.1%
tpch_q02/datafusion:parquet 175112637 / 173528907 / +0.9% 198353329 / 196965284 / +0.7% 0.88 / 0.88 / +0.2%
tpch_q03/datafusion:parquet 134867722 / 135084850 / -0.2% 183693755 / 180806292 / +1.6% 0.73 / 0.75 / -1.7%
tpch_q04/datafusion:parquet 57475803 / 57260183 / +0.4% 90037741 / 93616292 / -3.8% 0.64 / 0.61 / +4.4%
tpch_q05/datafusion:parquet 167428642 / 166803009 / +0.4% 223469312 / 220992681 / +1.1% 0.75 / 0.75 / -0.7%
tpch_q06/datafusion:parquet 36576606 / 36301253 / +0.8% 77793617 / 78600181 / -1.0% 0.47 / 0.46 / +1.8%
tpch_q07/datafusion:parquet 217083946 / 217206868 / -0.1% 269233373 / 293942542 / -8.4% 0.81 / 0.74 / +9.1%
tpch_q08/datafusion:parquet 217110939 / 217440562 / -0.2% 289686399 / 282455923 / +2.6% 0.75 / 0.77 / -2.6%
tpch_q09/datafusion:parquet 308097424 / 309423480 / -0.4% 369171550 / 367458064 / +0.5% 0.83 / 0.84 / -0.9%
tpch_q10/datafusion:parquet 312059291 / 311603790 / +0.1% 361292787 / 363487477 / -0.6% 0.86 / 0.86 / +0.8%
tpch_q11/datafusion:parquet 128503571 / 127354177 / +0.9% 147888898 / 147890704 / -0.0% 0.87 / 0.86 / +0.9%
tpch_q12/datafusion:parquet 82398729 / 82587380 / -0.2% 118217655 / 117323567 / +0.8% 0.70 / 0.70 / -1.0%
tpch_q13/datafusion:parquet 210299801 / 210946641 / -0.3% 235732781 / 238891918 / -1.3% 0.89 / 0.88 / +1.0%
tpch_q14/datafusion:parquet 86739519 / 87189980 / -0.5% 185329733 / 179925596 / +3.0% 0.47 / 0.48 / -3.4%
tpch_q15/datafusion:parquet 106556169 / 107028715 / -0.4% 149805178 / 153634459 / -2.5% 0.71 / 0.70 / +2.1%
tpch_q16/datafusion:parquet 96326859 / 96079987 / +0.3% 117405558 / 120197128 / -2.3% 0.82 / 0.80 / +2.6%
tpch_q17/datafusion:parquet 214288567 / 214118371 / +0.1% 256944723 / 264548418 / -2.9% 0.83 / 0.81 / +3.0%
tpch_q18/datafusion:parquet 268308884 / 267957693 / +0.1% 313378543 / 312820802 / +0.2% 0.86 / 0.86 / -0.0%
tpch_q19/datafusion:parquet 108569753 / 108511388 / +0.1% 165823757 / 165031333 / +0.5% 0.65 / 0.66 / -0.4%
tpch_q20/datafusion:parquet 185271523 / 184697349 / +0.3% 238471752 / 246169928 / -3.1% 0.78 / 0.75 / +3.5%
tpch_q21/datafusion:parquet 242897261 / 243681129 / -0.3% 304904701 / 303780696 / +0.4% 0.80 / 0.80 / -0.7%
tpch_q22/datafusion:parquet 150449745 / 149826563 / +0.4% 173127000 / 174920410 / -1.0% 0.87 / 0.86 / +1.5%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32641966 / 32841348 / -0.6% 62206790 / 65237962 / -4.6% 0.52 / 0.50 / +4.2%
tpch_q02/duckdb:vortex-file-compressed 28801848 / 28580549 / +0.8% 43377599 / 43763888 / -0.9% 0.66 / 0.65 / +1.7%
tpch_q03/duckdb:vortex-file-compressed 52181527 / 51683868 / +1.0% 97629449 / 96445929 / +1.2% 0.53 / 0.54 / -0.3%
tpch_q04/duckdb:vortex-file-compressed 51751444 / 51947244 / -0.4% 85747725 / 83071830 / +3.2% 0.60 / 0.63 / -3.5%
tpch_q05/duckdb:vortex-file-compressed 67677576 / 67882994 / -0.3% 107030257 / 104255815 / +2.7% 0.63 / 0.65 / -2.9%
tpch_q06/duckdb:vortex-file-compressed 15121827 / 15035417 / +0.6% 46203139 / 45239834 / +2.1% 0.33 / 0.33 / -1.5%
tpch_q07/duckdb:vortex-file-compressed 55102079 / 55168613 / -0.1% 104977361 / 101562289 / +3.4% 0.52 / 0.54 / -3.4%
tpch_q08/duckdb:vortex-file-compressed 84705569 / 85235395 / -0.6% 123398780 / 127359719 / -3.1% 0.69 / 0.67 / +2.6%
tpch_q09/duckdb:vortex-file-compressed 102081117 / 104349342 / -2.2% 153076091 / 147128862 / +4.0% 0.67 / 0.71 / -6.0%
tpch_q10/duckdb:vortex-file-compressed 95878025 / 97091397 / -1.2% 145634927 / 142526275 / +2.2% 0.66 / 0.68 / -3.4%
tpch_q11/duckdb:vortex-file-compressed 12976099 / 13348332 / -2.8% 29825978 / 28282833 / +5.5% 0.44 / 0.47 / -7.8%
tpch_q12/duckdb:vortex-file-compressed 45178290 / 45033696 / +0.3% 77487476 / 76123255 / +1.8% 0.58 / 0.59 / -1.4%
tpch_q13/duckdb:vortex-file-compressed 71126786 / 71327793 / -0.3% 96499355 / 93690792 / +3.0% 0.74 / 0.76 / -3.2%
tpch_q14/duckdb:vortex-file-compressed 27409226 / 27542668 / -0.5% 71422468 / 70017203 / +2.0% 0.38 / 0.39 / -2.4%
tpch_q15/duckdb:vortex-file-compressed 23821991 / 24117873 / -1.2% 60038334 / 58746454 / +2.2% 0.40 / 0.41 / -3.4%
tpch_q16/duckdb:vortex-file-compressed 48997014 / 48963416 / +0.1% 57344038 / 59498639 / -3.6% 0.85 / 0.82 / +3.8%
tpch_q17/duckdb:vortex-file-compressed 35110469 / 35029603 / +0.2% 63738862 / 63261925 / +0.8% 0.55 / 0.55 / -0.5%
tpch_q18/duckdb:vortex-file-compressed 104253168 / 109327891 / -4.6% 117177784 / 121962345 / -3.9% 0.89 / 0.90 / -0.7%
tpch_q19/duckdb:vortex-file-compressed 26988928 / 26739981 / +0.9% 74157161 / 70615501 / +5.0% 0.36 / 0.38 / -3.9%
tpch_q20/duckdb:vortex-file-compressed 41751244 / 41531320 / +0.5% 86300510 / 87911574 / -1.8% 0.48 / 0.47 / +2.4%
tpch_q21/duckdb:vortex-file-compressed 93544179 / 92388274 / +1.3% 141365252 / 139997692 / +1.0% 0.66 / 0.66 / +0.3%
tpch_q22/duckdb:vortex-file-compressed 32813632 / 32543197 / +0.8% 48280642 / 47513933 / +1.6% 0.68 / 0.68 / -0.8%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68062332 / 67879635 / +0.3% 86732772 / 88649513 / -2.2% 0.78 / 0.77 / +2.5%
tpch_q02/duckdb:parquet 86815422 / 87083338 / -0.3% 97358748 / 97172400 / +0.2% 0.89 / 0.90 / -0.5%
tpch_q03/duckdb:parquet 109577509 / 112261731 / -2.4% 140244531 / 140911771 / -0.5% 0.78 / 0.80 / -1.9%
tpch_q04/duckdb:parquet 76856220 / 76995281 / -0.2% 96207493 / 97976523 / -1.8% 0.80 / 0.79 / +1.7%
tpch_q05/duckdb:parquet 123639067 / 122236678 / +1.1% 156919316 / 155130541 / +1.2% 0.79 / 0.79 / -0.0%
tpch_q06/duckdb:parquet 35517080 / 36275869 / -2.1% 57881645 / 57439669 / +0.8% 0.61 / 0.63 / -2.8%
tpch_q07/duckdb:parquet 118772030 / 118386381 / +0.3% 154755754 / 153353417 / +0.9% 0.77 / 0.77 / -0.6%
tpch_q08/duckdb:parquet 148292061 / 148200723 / +0.1% 190187418 / 188375901 / +1.0% 0.78 / 0.79 / -0.9%
tpch_q09/duckdb:parquet 236981707 / 237901237 / -0.4% 277518134 / 277209963 / +0.1% 0.85 / 0.86 / -0.5%
tpch_q10/duckdb:parquet 313914245 / 313998590 / -0.0% 337970336 / 336835043 / +0.3% 0.93 / 0.93 / -0.4%
tpch_q11/duckdb:parquet 43599251 / 43639922 / -0.1% 50857403 / 50251682 / +1.2% 0.86 / 0.87 / -1.3%
tpch_q12/duckdb:parquet 70264345 / 70543096 / -0.4% 90327917 / 91844244 / -1.7% 0.78 / 0.77 / +1.3%
tpch_q13/duckdb:parquet 291951206 / 292910305 / -0.3% 306264680 / 308034589 / -0.6% 0.95 / 0.95 / +0.2%
tpch_q14/duckdb:parquet 100654198 / 104030866 / -3.2% 135780581 / 134391978 / +1.0% 0.74 / 0.77 / -4.2%
tpch_q15/duckdb:parquet 57194137 / 57500112 / -0.5% 87861891 / 85793897 / +2.4% 0.65 / 0.67 / -2.9%
tpch_q16/duckdb:parquet 99407402 / 99983111 / -0.6% 105778467 / 106083755 / -0.3% 0.94 / 0.94 / -0.3%
tpch_q17/duckdb:parquet 81664853 / 82172789 / -0.6% 110489427 / 115949637 / -4.7% 0.74 / 0.71 / +4.3%
tpch_q18/duckdb:parquet 156279370 / 157215082 / -0.6% 173186496 / 171416304 / +1.0% 0.90 / 0.92 / -1.6%
tpch_q19/duckdb:parquet 98155078 / 98207043 / -0.1% 131281081 / 129566888 / +1.3% 0.75 / 0.76 / -1.4%
tpch_q20/duckdb:parquet 146889327 / 147306038 / -0.3% 181559925 / 183373841 / -1.0% 0.81 / 0.80 / +0.7%
tpch_q21/duckdb:parquet 253276012 / 250776306 / +1.0% 276699767 / 271580260 / +1.9% 0.92 / 0.92 / -0.9%
tpch_q22/duckdb:parquet 168089284 / 168512075 / -0.3% 178198286 / 179652648 / -0.8% 0.94 / 0.94 / +0.6%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR b1ca326a vs base bcbe4c23
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (+2.9%, environment too noisy confidence) · DuckDB No clear signal (-5.7%, environment too noisy confidence)
Vortex (geomean): hot 1.057x ➖ · cold 1.050x ➖
Parquet (geomean): hot 1.073x ➖ · cold 1.106x ➖
Shifts: Parquet (control) +7.3% · Median polish +4.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.132x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 207133148 / 226716697 / -8.6% 738307512 / 728956127 / +1.3% 0.28 / 0.31 / -9.8%
tpch_q02/datafusion:vortex-file-compressed 336178716 / 324481966 / +3.6% 707099305 / 626692072 / +12.8% 0.48 / 0.52 / -8.2%
tpch_q03/datafusion:vortex-file-compressed 343896773 / 329380307 / +4.4% 852802378 / 933719075 / -8.7% 0.40 / 0.35 / +14.3%
tpch_q04/datafusion:vortex-file-compressed 241397824 / 170451259 / +41.6% 🔴 470946361 / 433208310 / +8.7% 0.51 / 0.39 / +30.3%
tpch_q05/datafusion:vortex-file-compressed 377159961 / 374203438 / +0.8% 709627924 / 549042803 / +29.2% 0.53 / 0.68 / -22.0%
tpch_q06/datafusion:vortex-file-compressed 240047296 / 112451353 / +113.5% 🔴 447956620 / 284247490 / +57.6% 🔴 0.54 / 0.40 / +35.5%
tpch_q07/datafusion:vortex-file-compressed 440698866 / 420240022 / +4.9% 650168749 / 542542125 / +19.8% 0.68 / 0.77 / -12.5%
tpch_q08/datafusion:vortex-file-compressed 428484523 / 427344826 / +0.3% 550155432 / 576096176 / -4.5% 0.78 / 0.74 / +5.0%
tpch_q09/datafusion:vortex-file-compressed 325363582 / 314093494 / +3.6% 736320875 / 573215172 / +28.5% 0.44 / 0.55 / -19.4%
tpch_q10/datafusion:vortex-file-compressed 392402672 / 367637245 / +6.7% 569733196 / 519247068 / +9.7% 0.69 / 0.71 / -2.7%
tpch_q11/datafusion:vortex-file-compressed 447647541 / 282034300 / +58.7% 🔴 551390188 / 440665314 / +25.1% 0.81 / 0.64 / +26.8%
tpch_q12/datafusion:vortex-file-compressed 271189777 / 219967723 / +23.3% 470696154 / 390319896 / +20.6% 0.58 / 0.56 / +2.2%
tpch_q13/datafusion:vortex-file-compressed 122001832 / 103310725 / +18.1% 365160003 / 331177677 / +10.3% 0.33 / 0.31 / +7.1%
tpch_q14/datafusion:vortex-file-compressed 188714912 / 181693221 / +3.9% 320250379 / 378625285 / -15.4% 0.59 / 0.48 / +22.8%
tpch_q15/datafusion:vortex-file-compressed 301157774 / 297785012 / +1.1% 551173027 / 496531692 / +11.0% 0.55 / 0.60 / -8.9%
tpch_q16/datafusion:vortex-file-compressed 145758618 / 136888247 / +6.5% 367564809 / 306281483 / +20.0% 0.40 / 0.45 / -11.3%
tpch_q17/datafusion:vortex-file-compressed 260942745 / 263661515 / -1.0% 411970184 / 440395626 / -6.5% 0.63 / 0.60 / +5.8%
tpch_q18/datafusion:vortex-file-compressed 253362391 / 238752474 / +6.1% 452719393 / 473311273 / -4.4% 0.56 / 0.50 / +10.9%
tpch_q19/datafusion:vortex-file-compressed 239438966 / 240683089 / -0.5% 420358556 / 378696790 / +11.0% 0.57 / 0.64 / -10.4%
tpch_q20/datafusion:vortex-file-compressed 384790299 / 284965581 / +35.0% 🔴 548472945 / 478937050 / +14.5% 0.70 / 0.59 / +17.9%
tpch_q21/datafusion:vortex-file-compressed 469651518 / 425463823 / +10.4% 664626787 / 791483976 / -16.0% 0.71 / 0.54 / +31.5%
tpch_q22/datafusion:vortex-file-compressed 186428981 / 170326479 / +9.5% 397358078 / 351298010 / +13.1% 0.47 / 0.48 / -3.2%
datafusion / parquet / ns (1.101x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 152181050 / 149203920 / +2.0% 677003632 / 453249205 / +49.4% 🔴 0.22 / 0.33 / -31.7%
tpch_q02/datafusion:parquet 286529329 / 267598362 / +7.1% 558204630 / 430971095 / +29.5% 0.51 / 0.62 / -17.3%
tpch_q03/datafusion:parquet 245720047 / 235226121 / +4.5% 682713971 / 561581406 / +21.6% 0.36 / 0.42 / -14.1%
tpch_q04/datafusion:parquet 451711058 / 135657604 / +233.0% 🔴 505771718 / 281792821 / +79.5% 🔴 0.89 / 0.48 / +85.5%
tpch_q05/datafusion:parquet 336355330 / 334960224 / +0.4% 582658296 / 442477031 / +31.7% 🔴 0.58 / 0.76 / -23.7%
tpch_q06/datafusion:parquet 113782987 / 103156395 / +10.3% 215813577 / 216187977 / -0.2% 0.53 / 0.48 / +10.5%
tpch_q07/datafusion:parquet 325079366 / 333555128 / -2.5% 475025241 / 431516007 / +10.1% 0.68 / 0.77 / -11.5%
tpch_q08/datafusion:parquet 422078845 / 388336599 / +8.7% 543497124 / 515242439 / +5.5% 0.78 / 0.75 / +3.0%
tpch_q09/datafusion:parquet 375546538 / 367890147 / +2.1% 568042571 / 562423754 / +1.0% 0.66 / 0.65 / +1.1%
tpch_q10/datafusion:parquet 293001772 / 287696074 / +1.8% 500109028 / 420035021 / +19.1% 0.59 / 0.68 / -14.5%
tpch_q11/datafusion:parquet 257588488 / 243653558 / +5.7% 392239164 / 332308434 / +18.0% 0.66 / 0.73 / -10.4%
tpch_q12/datafusion:parquet 179412797 / 153167877 / +17.1% 312792561 / 292818299 / +6.8% 0.57 / 0.52 / +9.7%
tpch_q13/datafusion:parquet 272482361 / 274199880 / -0.6% 399327814 / 485481716 / -17.7% 0.68 / 0.56 / +20.8%
tpch_q14/datafusion:parquet 160497179 / 148605169 / +8.0% 311416165 / 279602846 / +11.4% 0.52 / 0.53 / -3.0%
tpch_q15/datafusion:parquet 296952360 / 292877398 / +1.4% 459753793 / 451092205 / +1.9% 0.65 / 0.65 / -0.5%
tpch_q16/datafusion:parquet 103850935 / 98147147 / +5.8% 206801086 / 213528781 / -3.2% 0.50 / 0.46 / +9.3%
tpch_q17/datafusion:parquet 278645913 / 263939156 / +5.6% 400823308 / 369553324 / +8.5% 0.70 / 0.71 / -2.7%
tpch_q18/datafusion:parquet 301275726 / 299662411 / +0.5% 469762503 / 458311518 / +2.5% 0.64 / 0.65 / -1.9%
tpch_q19/datafusion:parquet 170901697 / 160120424 / +6.7% 307909834 / 282873668 / +8.9% 0.56 / 0.57 / -1.9%
tpch_q20/datafusion:parquet 231494366 / 221142687 / +4.7% 363326594 / 382330985 / -5.0% 0.64 / 0.58 / +10.2%
tpch_q21/datafusion:parquet 304328206 / 288686000 / +5.4% 499617276 / 491366719 / +1.7% 0.61 / 0.59 / +3.7%
tpch_q22/datafusion:parquet 156098615 / 156512844 / -0.3% 336388682 / 395397878 / -14.9% 0.46 / 0.40 / +17.2%
duckdb / vortex-file-compressed / ns (0.987x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 252196872 / 228025589 / +10.6% 534204814 / 288710264 / +85.0% 🔴 0.47 / 0.79 / -40.2%
tpch_q02/duckdb:vortex-file-compressed 378968070 / 395397337 / -4.2% 487500114 / 436976710 / +11.6% 0.78 / 0.90 / -14.1%
tpch_q03/duckdb:vortex-file-compressed 405912160 / 405511660 / +0.1% 440359727 / 486809382 / -9.5% 0.92 / 0.83 / +10.7%
tpch_q04/duckdb:vortex-file-compressed 283696665 / 284670790 / -0.3% 302629424 / 307699793 / -1.6% 0.94 / 0.93 / +1.3%
tpch_q05/duckdb:vortex-file-compressed 521917176 / 541130095 / -3.6% 610551137 / 572252786 / +6.7% 0.85 / 0.95 / -9.6%
tpch_q06/duckdb:vortex-file-compressed 155495490 / 177070051 / -12.2% 160942866 / 242980746 / -33.8% 🟢 0.97 / 0.73 / +32.6%
tpch_q07/duckdb:vortex-file-compressed 424275144 / 393235450 / +7.9% 428031426 / 483305008 / -11.4% 0.99 / 0.81 / +21.8%
tpch_q08/duckdb:vortex-file-compressed 626001217 / 576360431 / +8.6% 656605806 / 589879838 / +11.3% 0.95 / 0.98 / -2.4%
tpch_q09/duckdb:vortex-file-compressed 410303625 / 386186354 / +6.2% 474895764 / 453084073 / +4.8% 0.86 / 0.85 / +1.4%
tpch_q10/duckdb:vortex-file-compressed 709303893 / 543817885 / +30.4% 🔴 563658821 / 611842818 / -7.9% 1.26 / 0.89 / +41.6%
tpch_q11/duckdb:vortex-file-compressed 296359672 / 304862067 / -2.8% 348467534 / 387742897 / -10.1% 0.85 / 0.79 / +8.2%
tpch_q12/duckdb:vortex-file-compressed 253998859 / 257996936 / -1.5% 315848498 / 353443089 / -10.6% 0.80 / 0.73 / +10.2%
tpch_q13/duckdb:vortex-file-compressed 251482937 / 578992665 / -56.6% 🟢 267452206 / 287313546 / -6.9% 0.94 / 2.02 / -53.3%
tpch_q14/duckdb:vortex-file-compressed 233505194 / 216456440 / +7.9% 314539325 / 232774258 / +35.1% 🔴 0.74 / 0.93 / -20.2%
tpch_q15/duckdb:vortex-file-compressed 240147362 / 243727992 / -1.5% 337163947 / 315565891 / +6.8% 0.71 / 0.77 / -7.8%
tpch_q16/duckdb:vortex-file-compressed 209033347 / 189816706 / +10.1% 236781752 / 244004295 / -3.0% 0.88 / 0.78 / +13.5%
tpch_q17/duckdb:vortex-file-compressed 307578628 / 297269311 / +3.5% 326746210 / 362439104 / -9.8% 0.94 / 0.82 / +14.8%
tpch_q18/duckdb:vortex-file-compressed 342530987 / 349914327 / -2.1% 337906214 / 347557901 / -2.8% 1.01 / 1.01 / +0.7%
tpch_q19/duckdb:vortex-file-compressed 307096622 / 280036075 / +9.7% 369143211 / 311332425 / +18.6% 0.83 / 0.90 / -7.5%
tpch_q20/duckdb:vortex-file-compressed 343268307 / 348250407 / -1.4% 401178308 / 479892940 / -16.4% 0.86 / 0.73 / +17.9%
tpch_q21/duckdb:vortex-file-compressed 558242870 / 551219040 / +1.3% 707147692 / 803536720 / -12.0% 0.79 / 0.69 / +15.1%
tpch_q22/duckdb:vortex-file-compressed 224796229 / 236262018 / -4.9% 273021598 / 235131490 / +16.1% 0.82 / 1.00 / -18.1%
duckdb / parquet / ns (1.046x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 175555325 / 175671976 / -0.1% 231730979 / 217831535 / +6.4% 0.76 / 0.81 / -6.1%
tpch_q02/duckdb:parquet 443031505 / 437127433 / +1.4% 533694096 / 434950622 / +22.7% 0.83 / 1.01 / -17.4%
tpch_q03/duckdb:parquet 324129647 / 344871956 / -6.0% 418021630 / 430545261 / -2.9% 0.78 / 0.80 / -3.2%
tpch_q04/duckdb:parquet 280780042 / 247996863 / +13.2% 313528821 / 332314279 / -5.7% 0.90 / 0.75 / +20.0%
tpch_q05/duckdb:parquet 506036579 / 505816034 / +0.0% 546151731 / 591026261 / -7.6% 0.93 / 0.86 / +8.3%
tpch_q06/duckdb:parquet 161909739 / 151132657 / +7.1% 219900141 / 182861056 / +20.3% 0.74 / 0.83 / -10.9%
tpch_q07/duckdb:parquet 443297869 / 402051520 / +10.3% 654989815 / 444882217 / +47.2% 🔴 0.68 / 0.90 / -25.1%
tpch_q08/duckdb:parquet 629658297 / 572772628 / +9.9% 764061439 / 700578601 / +9.1% 0.82 / 0.82 / +0.8%
tpch_q09/duckdb:parquet 606688794 / 511944512 / +18.5% 641616005 / 611818453 / +4.9% 0.95 / 0.84 / +13.0%
tpch_q10/duckdb:parquet 620642466 / 537099009 / +15.6% 611502716 / 550610517 / +11.1% 1.01 / 0.98 / +4.0%
tpch_q11/duckdb:parquet 278239832 / 298393376 / -6.8% 307842692 / 262973911 / +17.1% 0.90 / 1.13 / -20.3%
tpch_q12/duckdb:parquet 240973260 / 215468915 / +11.8% 272433117 / 261110858 / +4.3% 0.88 / 0.83 / +7.2%
tpch_q13/duckdb:parquet 391413215 / 377656178 / +3.6% 529645135 / 497364834 / +6.5% 0.74 / 0.76 / -2.7%
tpch_q14/duckdb:parquet 264114618 / 259449939 / +1.8% 330608891 / 300950334 / +9.9% 0.80 / 0.86 / -7.3%
tpch_q15/duckdb:parquet 205861823 / 191047257 / +7.8% 227208247 / 187108396 / +21.4% 0.91 / 1.02 / -11.3%
tpch_q16/duckdb:parquet 301724894 / 267052203 / +13.0% 308325680 / 260084053 / +18.5% 0.98 / 1.03 / -4.7%
tpch_q17/duckdb:parquet 284502754 / 285184258 / -0.2% 363058414 / 344584968 / +5.4% 0.78 / 0.83 / -5.3%
tpch_q18/duckdb:parquet 357668452 / 353174219 / +1.3% 387293300 / 353019835 / +9.7% 0.92 / 1.00 / -7.7%
tpch_q19/duckdb:parquet 253366216 / 245710311 / +3.1% 424159048 / 277892169 / +52.6% 🔴 0.60 / 0.88 / -32.4%
tpch_q20/duckdb:parquet 468660665 / 462296960 / +1.4% 482078803 / 501080233 / -3.8% 0.97 / 0.92 / +5.4%
tpch_q21/duckdb:parquet 486274295 / 449302152 / +8.2% 556332445 / 493460391 / +12.7% 0.87 / 0.91 / -4.0%
tpch_q22/duckdb:parquet 266425290 / 289477537 / -8.0% 301311880 / 306593831 / -1.7% 0.88 / 0.94 / -6.4%

Every SQL benchmark that uses DuckDB failed with "libduckdb.so: cannot
open shared object file", on develop's layout as well as this branch.
Rust 1.100's cargo moved build script output from build/<pkg>-<hash>/out
to build/<pkg>/<hash>/out. vortex-duckdb keeps its DuckDB cache two levels
above OUT_DIR, so the library is now under
build/vortex-duckdb/vortex-duckdb-cache/, and the hard-coded
build/vortex-duckdb-cache/ path matched nothing. upload-artifact skipped
the missing file silently.

Find the library under target/release_debug/build instead, and fail the
build if it is missing, because duckdb-bench cannot run without it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 13, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR b1ca326a vs base bcbe4c23
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 0.982x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.979x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15642849 / 15737951 / -0.6% 42493045 / 43315047 / -1.9% 0.37 / 0.36 / +1.3%
tpch_q02/datafusion:vortex-file-compressed 17379787 / 17230657 / +0.9% 38098942 / 37933809 / +0.4% 0.46 / 0.45 / +0.4%
tpch_q03/datafusion:vortex-file-compressed 19375555 / 19159812 / +1.1% 43130222 / 47216294 / -8.7% 0.45 / 0.41 / +10.7%
tpch_q04/datafusion:vortex-file-compressed 11269786 / 10373191 / +8.6% 35728609 / 36511058 / -2.1% 0.32 / 0.28 / +11.0%
tpch_q05/datafusion:vortex-file-compressed 37498900 / 37440848 / +0.2% 68101695 / 69349381 / -1.8% 0.55 / 0.54 / +2.0%
tpch_q06/datafusion:vortex-file-compressed 4454652 / 4297193 / +3.7% 23610388 / 28670233 / -17.6% 🟢 0.19 / 0.15 / +25.9%
tpch_q07/datafusion:vortex-file-compressed 52361118 / 52631575 / -0.5% 81465631 / 85145763 / -4.3% 0.64 / 0.62 / +4.0%
tpch_q08/datafusion:vortex-file-compressed 52790551 / 52573448 / +0.4% 78978773 / 88828891 / -11.1% 🟢 0.67 / 0.59 / +12.9%
tpch_q09/datafusion:vortex-file-compressed 48656137 / 48753974 / -0.2% 75675185 / 80493105 / -6.0% 0.64 / 0.61 / +6.2%
tpch_q10/datafusion:vortex-file-compressed 17652517 / 17811829 / -0.9% 47294226 / 54189670 / -12.7% 🟢 0.37 / 0.33 / +13.6%
tpch_q11/datafusion:vortex-file-compressed 14505496 / 14352826 / +1.1% 35832998 / 36965783 / -3.1% 0.40 / 0.39 / +4.3%
tpch_q12/datafusion:vortex-file-compressed 18373660 / 18171894 / +1.1% 44518369 / 44553323 / -0.1% 0.41 / 0.41 / +1.2%
tpch_q13/datafusion:vortex-file-compressed 18859229 / 19563720 / -3.6% 40623147 / 37627482 / +8.0% 0.46 / 0.52 / -10.7%
tpch_q14/datafusion:vortex-file-compressed 14432286 / 14088300 / +2.4% 39176673 / 40254355 / -2.7% 0.37 / 0.35 / +5.3%
tpch_q15/datafusion:vortex-file-compressed 18527972 / 18753102 / -1.2% 44110034 / 45512021 / -3.1% 0.42 / 0.41 / +1.9%
tpch_q16/datafusion:vortex-file-compressed 18492313 / 18335775 / +0.9% 38301026 / 39999998 / -4.2% 0.48 / 0.46 / +5.3%
tpch_q17/datafusion:vortex-file-compressed 28580043 / 29124859 / -1.9% 57109407 / 58284334 / -2.0% 0.50 / 0.50 / +0.1%
tpch_q18/datafusion:vortex-file-compressed 36037633 / 36342166 / -0.8% 57611510 / 59841209 / -3.7% 0.63 / 0.61 / +3.0%
tpch_q19/datafusion:vortex-file-compressed 9846456 / 9777888 / +0.7% 35930891 / 37121204 / -3.2% 0.27 / 0.26 / +4.0%
tpch_q20/datafusion:vortex-file-compressed 21037781 / 21033581 / +0.0% 48697898 / 52077151 / -6.5% 0.43 / 0.40 / +7.0%
tpch_q21/datafusion:vortex-file-compressed 35433727 / 34962129 / +1.3% 68862032 / 68194001 / +1.0% 0.51 / 0.51 / +0.4%
tpch_q22/datafusion:vortex-file-compressed 11038782 / 10806703 / +2.1% 30407368 / 30734091 / -1.1% 0.36 / 0.35 / +3.2%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71661355 / 71331888 / +0.5% 87549468 / 89489749 / -2.2% 0.82 / 0.80 / +2.7%
tpch_q02/datafusion:parquet 76964544 / 76307110 / +0.9% 91363812 / 96995641 / -5.8% 0.84 / 0.79 / +7.1%
tpch_q03/datafusion:parquet 81662268 / 81781793 / -0.1% 101529957 / 103854846 / -2.2% 0.80 / 0.79 / +2.1%
tpch_q04/datafusion:parquet 39629264 / 39046946 / +1.5% 57588542 / 59180712 / -2.7% 0.69 / 0.66 / +4.3%
tpch_q05/datafusion:parquet 110425015 / 110493988 / -0.1% 136186563 / 137787066 / -1.2% 0.81 / 0.80 / +1.1%
tpch_q06/datafusion:parquet 31248871 / 31270611 / -0.1% 46897657 / 50177336 / -6.5% 0.67 / 0.62 / +6.9%
tpch_q07/datafusion:parquet 113159112 / 112646177 / +0.5% 138767674 / 140610902 / -1.3% 0.82 / 0.80 / +1.8%
tpch_q08/datafusion:parquet 117590992 / 116790060 / +0.7% 141382314 / 143962120 / -1.8% 0.83 / 0.81 / +2.5%
tpch_q09/datafusion:parquet 137143203 / 137745218 / -0.4% 165878644 / 168474790 / -1.5% 0.83 / 0.82 / +1.1%
tpch_q10/datafusion:parquet 103621674 / 103557399 / +0.1% 124812605 / 128970130 / -3.2% 0.83 / 0.80 / +3.4%
tpch_q11/datafusion:parquet 61930926 / 61871089 / +0.1% 79595418 / 82401829 / -3.4% 0.78 / 0.75 / +3.6%
tpch_q12/datafusion:parquet 63910741 / 63450587 / +0.7% 84377241 / 87278339 / -3.3% 0.76 / 0.73 / +4.2%
tpch_q13/datafusion:parquet 143042361 / 143688094 / -0.4% 162374111 / 163689179 / -0.8% 0.88 / 0.88 / +0.4%
tpch_q14/datafusion:parquet 47850257 / 47217082 / +1.3% 71073471 / 72987233 / -2.6% 0.67 / 0.65 / +4.1%
tpch_q15/datafusion:parquet 74052291 / 73425384 / +0.9% 91317254 / 95120685 / -4.0% 0.81 / 0.77 / +5.1%
tpch_q16/datafusion:parquet 43973926 / 43882673 / +0.2% 60717266 / 66007132 / -8.0% 0.72 / 0.66 / +8.9%
tpch_q17/datafusion:parquet 123864291 / 123594253 / +0.2% 146732819 / 146797562 / -0.0% 0.84 / 0.84 / +0.3%
tpch_q18/datafusion:parquet 120856284 / 121150368 / -0.2% 139958788 / 144827913 / -3.4% 0.86 / 0.84 / +3.2%
tpch_q19/datafusion:parquet 57153750 / 56623927 / +0.9% 78937297 / 86182351 / -8.4% 0.72 / 0.66 / +10.2%
tpch_q20/datafusion:parquet 78284182 / 78054116 / +0.3% 96858921 / 104664188 / -7.5% 0.81 / 0.75 / +8.4%
tpch_q21/datafusion:parquet 113596973 / 113498868 / +0.1% 139513380 / 139368096 / +0.1% 0.81 / 0.81 / -0.0%
tpch_q22/datafusion:parquet 51900294 / 52067622 / -0.3% 66116852 / 69562061 / -5.0% 0.78 / 0.75 / +4.9%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9175033 / 9578786 / -4.2% 20930072 / 20042941 / +4.4% 0.44 / 0.48 / -8.3%
tpch_q02/duckdb:vortex-file-compressed 15125862 / 14855979 / +1.8% 24830369 / 24520650 / +1.3% 0.61 / 0.61 / +0.5%
tpch_q03/duckdb:vortex-file-compressed 19101825 / 18644748 / +2.5% 33966751 / 36445139 / -6.8% 0.56 / 0.51 / +9.9%
tpch_q04/duckdb:vortex-file-compressed 12377533 / 12200826 / +1.4% 26058182 / 26003659 / +0.2% 0.47 / 0.47 / +1.2%
tpch_q05/duckdb:vortex-file-compressed 19865743 / 19468453 / +2.0% 34214613 / 36135529 / -5.3% 0.58 / 0.54 / +7.8%
tpch_q06/duckdb:vortex-file-compressed 5026554 / 4852800 / +3.6% 14953173 / 14013948 / +6.7% 0.34 / 0.35 / -2.9%
tpch_q07/duckdb:vortex-file-compressed 23936779 / 23913515 / +0.1% 39285547 / 41256577 / -4.8% 0.61 / 0.58 / +5.1%
tpch_q08/duckdb:vortex-file-compressed 20700045 / 21156949 / -2.2% 38129276 / 36867229 / +3.4% 0.54 / 0.57 / -5.4%
tpch_q09/duckdb:vortex-file-compressed 22588655 / 22248595 / +1.5% 36853958 / 38018010 / -3.1% 0.61 / 0.59 / +4.7%
tpch_q10/duckdb:vortex-file-compressed 27425136 / 27420316 / +0.0% 46186025 / 45654002 / +1.2% 0.59 / 0.60 / -1.1%
tpch_q11/duckdb:vortex-file-compressed 7921557 / 7882703 / +0.5% 17496423 / 17203296 / +1.7% 0.45 / 0.46 / -1.2%
tpch_q12/duckdb:vortex-file-compressed 14762581 / 14513727 / +1.7% 26948071 / 25927385 / +3.9% 0.55 / 0.56 / -2.1%
tpch_q13/duckdb:vortex-file-compressed 19422926 / 18937782 / +2.6% 32773501 / 31769009 / +3.2% 0.59 / 0.60 / -0.6%
tpch_q14/duckdb:vortex-file-compressed 11297240 / 11056278 / +2.2% 24546474 / 23665261 / +3.7% 0.46 / 0.47 / -1.5%
tpch_q15/duckdb:vortex-file-compressed 8351905 / 8385399 / -0.4% 20973942 / 20182109 / +3.9% 0.40 / 0.42 / -4.2%
tpch_q16/duckdb:vortex-file-compressed 16564860 / 16561126 / +0.0% 23411480 / 22664052 / +3.3% 0.71 / 0.73 / -3.2%
tpch_q17/duckdb:vortex-file-compressed 12695408 / 12623563 / +0.6% 27213923 / 28538307 / -4.6% 0.47 / 0.44 / +5.5%
tpch_q18/duckdb:vortex-file-compressed 24550596 / 24071566 / +2.0% 34473285 / 35264770 / -2.2% 0.71 / 0.68 / +4.3%
tpch_q19/duckdb:vortex-file-compressed 11163769 / 11381671 / -1.9% 25885274 / 25206235 / +2.7% 0.43 / 0.45 / -4.5%
tpch_q20/duckdb:vortex-file-compressed 14302922 / 14454942 / -1.1% 29530954 / 29921409 / -1.3% 0.48 / 0.48 / +0.3%
tpch_q21/duckdb:vortex-file-compressed 48283107 / 48533304 / -0.5% 63577822 / 63574788 / +0.0% 0.76 / 0.76 / -0.5%
tpch_q22/duckdb:vortex-file-compressed 16816477 / 16396434 / +2.6% 27018706 / 26995376 / +0.1% 0.62 / 0.61 / +2.5%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47592351 / 47507008 / +0.2% 53495607 / 53895658 / -0.7% 0.89 / 0.88 / +0.9%
tpch_q02/duckdb:parquet 48366213 / 48314722 / +0.1% 55152182 / 55533866 / -0.7% 0.88 / 0.87 / +0.8%
tpch_q03/duckdb:parquet 60221775 / 60190247 / +0.1% 67675814 / 68691281 / -1.5% 0.89 / 0.88 / +1.6%
tpch_q04/duckdb:parquet 34744383 / 34565439 / +0.5% 42488879 / 43096332 / -1.4% 0.82 / 0.80 / +2.0%
tpch_q05/duckdb:parquet 67149577 / 67004623 / +0.2% 76901156 / 77049869 / -0.2% 0.87 / 0.87 / +0.4%
tpch_q06/duckdb:parquet 22066005 / 21854038 / +1.0% 27362196 / 27044212 / +1.2% 0.81 / 0.81 / -0.2%
tpch_q07/duckdb:parquet 63798870 / 63804598 / -0.0% 71832224 / 73681174 / -2.5% 0.89 / 0.87 / +2.6%
tpch_q08/duckdb:parquet 75784380 / 75805678 / -0.0% 86252279 / 86686499 / -0.5% 0.88 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 107637011 / 107424945 / +0.2% 118867136 / 118831064 / +0.0% 0.91 / 0.90 / +0.2%
tpch_q10/duckdb:parquet 105627610 / 105710242 / -0.1% 117303654 / 117918470 / -0.5% 0.90 / 0.90 / +0.4%
tpch_q11/duckdb:parquet 29334825 / 29326484 / +0.0% 34980101 / 34948270 / +0.1% 0.84 / 0.84 / -0.1%
tpch_q12/duckdb:parquet 37203310 / 37196531 / +0.0% 44153750 / 43948462 / +0.5% 0.84 / 0.85 / -0.4%
tpch_q13/duckdb:parquet 174372666 / 174233686 / +0.1% 183978128 / 182078396 / +1.0% 0.95 / 0.96 / -1.0%
tpch_q14/duckdb:parquet 42529650 / 42136874 / +0.9% 50524676 / 50745045 / -0.4% 0.84 / 0.83 / +1.4%
tpch_q15/duckdb:parquet 32574105 / 32572927 / +0.0% 41168592 / 41274678 / -0.3% 0.79 / 0.79 / +0.3%
tpch_q16/duckdb:parquet 47261228 / 46997990 / +0.6% 52031540 / 52138681 / -0.2% 0.91 / 0.90 / +0.8%
tpch_q17/duckdb:parquet 48023859 / 47847229 / +0.4% 57460996 / 57032398 / +0.8% 0.84 / 0.84 / -0.4%
tpch_q18/duckdb:parquet 73902698 / 73787271 / +0.2% 79410279 / 80689329 / -1.6% 0.93 / 0.91 / +1.8%
tpch_q19/duckdb:parquet 49436264 / 47811163 / +3.4% 53164360 / 58428688 / -9.0% 0.93 / 0.82 / +13.6%
tpch_q20/duckdb:parquet 63476019 / 63417327 / +0.1% 73116609 / 73546036 / -0.6% 0.87 / 0.86 / +0.7%
tpch_q21/duckdb:parquet 107121166 / 106433398 / +0.6% 115561694 / 116060667 / -0.4% 0.93 / 0.92 / +1.1%
tpch_q22/duckdb:parquet 50508494 / 50375257 / +0.3% 58570754 / 58504876 / +0.1% 0.86 / 0.86 / +0.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR b1ca326a vs base bcbe4c23
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.959x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.968x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21167541 / 21209719 / -0.2% 39593807 / 40792437 / -2.9% 0.53 / 0.52 / +2.8%
tpcds_q02/datafusion:vortex-file-compressed 43325248 / 42793114 / +1.2% 63713295 / 66646844 / -4.4% 0.68 / 0.64 / +5.9%
tpcds_q03/datafusion:vortex-file-compressed 11749712 / 11619654 / +1.1% 26744603 / 30046881 / -11.0% 🟢 0.44 / 0.39 / +13.6%
tpcds_q04/datafusion:vortex-file-compressed 79777730 / 80251936 / -0.6% 107193541 / 111738800 / -4.1% 0.74 / 0.72 / +3.6%
tpcds_q05/datafusion:vortex-file-compressed 56869462 / 57210463 / -0.6% 74248332 / 82198398 / -9.7% 0.77 / 0.70 / +10.0%
tpcds_q06/datafusion:vortex-file-compressed 21935814 / 21636036 / +1.4% 41219875 / 41162700 / +0.1% 0.53 / 0.53 / +1.2%
tpcds_q07/datafusion:vortex-file-compressed 26197678 / 26147198 / +0.2% 46864888 / 48846455 / -4.1% 0.56 / 0.54 / +4.4%
tpcds_q08/datafusion:vortex-file-compressed 26096457 / 25716012 / +1.5% 43557051 / 45229324 / -3.7% 0.60 / 0.57 / +5.4%
tpcds_q09/datafusion:vortex-file-compressed 19691148 / 19073356 / +3.2% 35988980 / 39099091 / -8.0% 0.55 / 0.49 / +12.2%
tpcds_q10/datafusion:vortex-file-compressed 29037520 / 29437148 / -1.4% 47659322 / 51387266 / -7.3% 0.61 / 0.57 / +6.4%
tpcds_q11/datafusion:vortex-file-compressed 47803796 / 49324906 / -3.1% 73761943 / 77142190 / -4.4% 0.65 / 0.64 / +1.4%
tpcds_q12/datafusion:vortex-file-compressed 15182008 / 15390044 / -1.4% 30808896 / 33928245 / -9.2% 0.49 / 0.45 / +8.6%
tpcds_q13/datafusion:vortex-file-compressed 30504092 / 30727805 / -0.7% 53400931 / 58954202 / -9.4% 0.57 / 0.52 / +9.6%
tpcds_q14/datafusion:vortex-file-compressed 487609415 / 488395230 / -0.2% 544622979 / 545577971 / -0.2% 0.90 / 0.90 / +0.0%
tpcds_q15/datafusion:vortex-file-compressed 12443606 / 12608832 / -1.3% 30678784 / 33546196 / -8.5% 0.41 / 0.38 / +7.9%
tpcds_q16/datafusion:vortex-file-compressed 18748892 / 18775846 / -0.1% 36727909 / 37453898 / -1.9% 0.51 / 0.50 / +1.8%
tpcds_q17/datafusion:vortex-file-compressed 52267576 / 53400290 / -2.1% 70080000 / 73944405 / -5.2% 0.75 / 0.72 / +3.3%
tpcds_q18/datafusion:vortex-file-compressed 63825509 / 63613860 / +0.3% 66592069 / 73240065 / -9.1% 0.96 / 0.87 / +10.3%
tpcds_q19/datafusion:vortex-file-compressed 16890436 / 17274778 / -2.2% 36106156 / 38845726 / -7.1% 0.47 / 0.44 / +5.2%
tpcds_q20/datafusion:vortex-file-compressed 16693016 / 16476905 / +1.3% 32580783 / 35029108 / -7.0% 0.51 / 0.47 / +8.9%
tpcds_q21/datafusion:vortex-file-compressed 15160488 / 15318014 / -1.0% 33045243 / 35853775 / -7.8% 0.46 / 0.43 / +7.4%
tpcds_q22/datafusion:vortex-file-compressed 49481397 / 49375343 / +0.2% 68868998 / 71571688 / -3.8% 0.72 / 0.69 / +4.1%
tpcds_q23/datafusion:vortex-file-compressed 71902932 / 71625055 / +0.4% 98101044 / 97728723 / +0.4% 0.73 / 0.73 / +0.0%
tpcds_q24/datafusion:vortex-file-compressed 63422970 / 63747084 / -0.5% 85566248 / 88095246 / -2.9% 0.74 / 0.72 / +2.4%
tpcds_q25/datafusion:vortex-file-compressed 44825765 / 44602196 / +0.5% 63998385 / 73024171 / -12.4% 🟢 0.70 / 0.61 / +14.7%
tpcds_q26/datafusion:vortex-file-compressed 26785012 / 26910558 / -0.5% 41736498 / 47774541 / -12.6% 🟢 0.64 / 0.56 / +13.9%
tpcds_q27/datafusion:vortex-file-compressed 50019579 / 54552345 / -8.3% 69350382 / 76138702 / -8.9% 0.72 / 0.72 / +0.7%
tpcds_q28/datafusion:vortex-file-compressed 19205767 / 18334212 / +4.8% 35317954 / 38569106 / -8.4% 0.54 / 0.48 / +14.4%
tpcds_q29/datafusion:vortex-file-compressed 51740224 / 50645480 / +2.2% 70675815 / 74781560 / -5.5% 0.73 / 0.68 / +8.1%
tpcds_q30/datafusion:vortex-file-compressed 27549643 / 27620859 / -0.3% 46038678 / 47382388 / -2.8% 0.60 / 0.58 / +2.7%
tpcds_q31/datafusion:vortex-file-compressed 62763243 / 62778749 / -0.0% 88512818 / 90235117 / -1.9% 0.71 / 0.70 / +1.9%
tpcds_q32/datafusion:vortex-file-compressed 12870236 / 12745910 / +1.0% 29827720 / 31516358 / -5.4% 0.43 / 0.40 / +6.7%
tpcds_q33/datafusion:vortex-file-compressed 28249803 / 27894342 / +1.3% 49180643 / 51426893 / -4.4% 0.57 / 0.54 / +5.9%
tpcds_q34/datafusion:vortex-file-compressed 17549708 / 17380875 / +1.0% 34785910 / 37013003 / -6.0% 0.50 / 0.47 / +7.4%
tpcds_q35/datafusion:vortex-file-compressed 30637602 / 31041715 / -1.3% 51691300 / 55336735 / -6.6% 0.59 / 0.56 / +5.7%
tpcds_q36/datafusion:vortex-file-compressed 47684213 / 47491076 / +0.4% 66221876 / 69220772 / -4.3% 0.72 / 0.69 / +5.0%
tpcds_q37/datafusion:vortex-file-compressed 12447412 / 13085887 / -4.9% 33995734 / 35751782 / -4.9% 0.37 / 0.37 / +0.0%
tpcds_q38/datafusion:vortex-file-compressed 26285032 / 26456920 / -0.6% 45172619 / 50460751 / -10.5% 🟢 0.58 / 0.52 / +11.0%
tpcds_q39/datafusion:vortex-file-compressed 63799581 / 64580322 / -1.2% 85817505 / 87145648 / -1.5% 0.74 / 0.74 / +0.3%
tpcds_q40/datafusion:vortex-file-compressed 22562924 / 23370493 / -3.5% 37028611 / 41914491 / -11.7% 🟢 0.61 / 0.56 / +9.3%
tpcds_q41/datafusion:vortex-file-compressed 19922603 / 19985012 / -0.3% 31080664 / 31957339 / -2.7% 0.64 / 0.63 / +2.5%
tpcds_q42/datafusion:vortex-file-compressed 11528954 / 11600054 / -0.6% 26736354 / 28981983 / -7.7% 0.43 / 0.40 / +7.7%
tpcds_q43/datafusion:vortex-file-compressed 12953368 / 13547704 / -4.4% 30477953 / 34954967 / -12.8% 🟢 0.43 / 0.39 / +9.7%
tpcds_q44/datafusion:vortex-file-compressed 27495844 / 27573528 / -0.3% 49577748 / 51926060 / -4.5% 0.55 / 0.53 / +4.4%
tpcds_q45/datafusion:vortex-file-compressed 17061655 / 17161954 / -0.6% 33101322 / 36914881 / -10.3% 🟢 0.52 / 0.46 / +10.9%
tpcds_q46/datafusion:vortex-file-compressed 23446828 / 23787126 / -1.4% 44927518 / 47841565 / -6.1% 0.52 / 0.50 / +5.0%
tpcds_q47/datafusion:vortex-file-compressed 74399578 / 75658712 / -1.7% 103250134 / 104647548 / -1.3% 0.72 / 0.72 / -0.3%
tpcds_q48/datafusion:vortex-file-compressed 28839336 / 28345621 / +1.7% 49183421 / 52204114 / -5.8% 0.59 / 0.54 / +8.0%
tpcds_q49/datafusion:vortex-file-compressed 58242428 / 55749350 / +4.5% 80505515 / 77305598 / +4.1% 0.72 / 0.72 / +0.3%
tpcds_q50/datafusion:vortex-file-compressed 30689393 / 30585044 / +0.3% 51196907 / 53148168 / -3.7% 0.60 / 0.58 / +4.2%
tpcds_q51/datafusion:vortex-file-compressed 66784084 / 66173003 / +0.9% 88526717 / 89645450 / -1.2% 0.75 / 0.74 / +2.2%
tpcds_q52/datafusion:vortex-file-compressed 11778376 / 11823955 / -0.4% 25659013 / 27995625 / -8.3% 0.46 / 0.42 / +8.7%
tpcds_q53/datafusion:vortex-file-compressed 18453342 / 18119888 / +1.8% 37067444 / 41487911 / -10.7% 🟢 0.50 / 0.44 / +14.0%
tpcds_q54/datafusion:vortex-file-compressed 31860316 / 32109631 / -0.8% 53295242 / 54305244 / -1.9% 0.60 / 0.59 / +1.1%
tpcds_q55/datafusion:vortex-file-compressed 11383107 / 11234789 / +1.3% 25562786 / 29468847 / -13.3% 🟢 0.45 / 0.38 / +16.8%
tpcds_q56/datafusion:vortex-file-compressed 27105970 / 27263961 / -0.6% 46011585 / 49248651 / -6.6% 0.59 / 0.55 / +6.4%
tpcds_q57/datafusion:vortex-file-compressed 62045074 / 62813958 / -1.2% 84487235 / 88733756 / -4.8% 0.73 / 0.71 / +3.7%
tpcds_q58/datafusion:vortex-file-compressed 40538414 / 41543054 / -2.4% 66613667 / 66970788 / -0.5% 0.61 / 0.62 / -1.9%
tpcds_q59/datafusion:vortex-file-compressed 27544564 / 27380702 / +0.6% 54237581 / 52918172 / +2.5% 0.51 / 0.52 / -1.8%
tpcds_q60/datafusion:vortex-file-compressed 26948332 / 27080072 / -0.5% 47069672 / 48377922 / -2.7% 0.57 / 0.56 / +2.3%
tpcds_q61/datafusion:vortex-file-compressed 20653888 / 20125018 / +2.6% 39039729 / 42286950 / -7.7% 0.53 / 0.48 / +11.2%
tpcds_q62/datafusion:vortex-file-compressed 16740396 / 16820928 / -0.5% 33731423 / 35358853 / -4.6% 0.50 / 0.48 / +4.3%
tpcds_q63/datafusion:vortex-file-compressed 18028580 / 18055888 / -0.2% 36337011 / 40827277 / -11.0% 🟢 0.50 / 0.44 / +12.2%
tpcds_q64/datafusion:vortex-file-compressed 188419557 / 189181536 / -0.4% 220983361 / 227461180 / -2.8% 0.85 / 0.83 / +2.5%
tpcds_q65/datafusion:vortex-file-compressed 73846674 / 73151104 / +1.0% 95504676 / 97715562 / -2.3% 0.77 / 0.75 / +3.3%
tpcds_q66/datafusion:vortex-file-compressed 49478742 / 49432704 / +0.1% 68400122 / 70382168 / -2.8% 0.72 / 0.70 / +3.0%
tpcds_q67/datafusion:vortex-file-compressed 51174882 / 51585932 / -0.8% 82565549 / 83966356 / -1.7% 0.62 / 0.61 / +0.9%
tpcds_q68/datafusion:vortex-file-compressed 22986012 / 23039492 / -0.2% 42149673 / 47342893 / -11.0% 🟢 0.55 / 0.49 / +12.1%
tpcds_q69/datafusion:vortex-file-compressed 26929340 / 26957989 / -0.1% 46193955 / 49916482 / -7.5% 0.58 / 0.54 / +7.9%
tpcds_q70/datafusion:vortex-file-compressed 74097800 / 74120665 / -0.0% 94005857 / 97136981 / -3.2% 0.79 / 0.76 / +3.3%
tpcds_q71/datafusion:vortex-file-compressed 19736124 / 19671828 / +0.3% 37217235 / 39249291 / -5.2% 0.53 / 0.50 / +5.8%
tpcds_q72/datafusion:vortex-file-compressed 288829680 / 267052197 / +8.2% 150485727 / 295848201 / -49.1% 🟢 1.92 / 0.90 / +112.6%
tpcds_q73/datafusion:vortex-file-compressed 16299840 / 16548283 / -1.5% 34197277 / 37783006 / -9.5% 0.48 / 0.44 / +8.8%
tpcds_q74/datafusion:vortex-file-compressed 40923545 / 41090042 / -0.4% 63983748 / 68004586 / -5.9% 0.64 / 0.60 / +5.9%
tpcds_q75/datafusion:vortex-file-compressed 137283762 / 136054844 / +0.9% 157649942 / 165364182 / -4.7% 0.87 / 0.82 / +5.8%
tpcds_q76/datafusion:vortex-file-compressed 30019728 / 29502505 / +1.8% 46753781 / 49167315 / -4.9% 0.64 / 0.60 / +7.0%
tpcds_q77/datafusion:vortex-file-compressed 44838281 / 45205090 / -0.8% 65560341 / 68692159 / -4.6% 0.68 / 0.66 / +3.9%
tpcds_q78/datafusion:vortex-file-compressed 59917236 / 60753782 / -1.4% 86539267 / 89848072 / -3.7% 0.69 / 0.68 / +2.4%
tpcds_q79/datafusion:vortex-file-compressed 20134944 / 19986834 / +0.7% 39537493 / 44824396 / -11.8% 🟢 0.51 / 0.45 / +14.2%
tpcds_q80/datafusion:vortex-file-compressed 69322492 / 68828712 / +0.7% 91362269 / 94285877 / -3.1% 0.76 / 0.73 / +3.9%
tpcds_q81/datafusion:vortex-file-compressed 28067995 / 28133841 / -0.2% 45382015 / 46278002 / -1.9% 0.62 / 0.61 / +1.7%
tpcds_q82/datafusion:vortex-file-compressed 13066246 / 12004252 / +8.8% 32590329 / 36564853 / -10.9% 🟢 0.40 / 0.33 / +22.1%
tpcds_q83/datafusion:vortex-file-compressed 34433411 / 35028810 / -1.7% 50414086 / 53805746 / -6.3% 0.68 / 0.65 / +4.9%
tpcds_q84/datafusion:vortex-file-compressed 10577030 / 10315102 / +2.5% 24873774 / 27960134 / -11.0% 🟢 0.43 / 0.37 / +15.3%
tpcds_q85/datafusion:vortex-file-compressed 52149314 / 52556858 / -0.8% 76177124 / 77808046 / -2.1% 0.68 / 0.68 / +1.3%
tpcds_q86/datafusion:vortex-file-compressed 16314910 / 16567710 / -1.5% 33318188 / 35787225 / -6.9% 0.49 / 0.46 / +5.8%
tpcds_q87/datafusion:vortex-file-compressed 26690315 / 26451980 / +0.9% 46660756 / 49679945 / -6.1% 0.57 / 0.53 / +7.4%
tpcds_q88/datafusion:vortex-file-compressed 31411976 / 31010949 / +1.3% 50595753 / 50771770 / -0.3% 0.62 / 0.61 / +1.6%
tpcds_q89/datafusion:vortex-file-compressed 21434428 / 21348331 / +0.4% 40600014 / 43593939 / -6.9% 0.53 / 0.49 / +7.8%
tpcds_q90/datafusion:vortex-file-compressed 10563348 / 10499484 / +0.6% 24955118 / 25392019 / -1.7% 0.42 / 0.41 / +2.4%
tpcds_q91/datafusion:vortex-file-compressed 16353694 / 15624364 / +4.7% 35508615 / 36991812 / -4.0% 0.46 / 0.42 / +9.0%
tpcds_q92/datafusion:vortex-file-compressed 13028762 / 13222760 / -1.5% 29354578 / 31054160 / -5.5% 0.44 / 0.43 / +4.2%
tpcds_q93/datafusion:vortex-file-compressed 20121802 / 19672286 / +2.3% 39950702 / 39607761 / +0.9% 0.50 / 0.50 / +1.4%
tpcds_q94/datafusion:vortex-file-compressed 18373643 / 18935573 / -3.0% 36626096 / 39476016 / -7.2% 0.50 / 0.48 / +4.6%
tpcds_q95/datafusion:vortex-file-compressed 42114173 / 41996576 / +0.3% 61733616 / 63137161 / -2.2% 0.68 / 0.67 / +2.6%
tpcds_q96/datafusion:vortex-file-compressed 7503858 / 7727952 / -2.9% 23722588 / 25586439 / -7.3% 0.32 / 0.30 / +4.7%
tpcds_q97/datafusion:vortex-file-compressed 17289168 / 17397321 / -0.6% 36957788 / 39030424 / -5.3% 0.47 / 0.45 / +5.0%
tpcds_q98/datafusion:vortex-file-compressed 15938680 / 16018287 / -0.5% 33217059 / 35010456 / -5.1% 0.48 / 0.46 / +4.9%
tpcds_q99/datafusion:vortex-file-compressed 16347784 / 16466646 / -0.7% 33847246 / 33865581 / -0.1% 0.48 / 0.49 / -0.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42950441 / 42140183 / +1.9% 56775473 / 62566215 / -9.3% 0.76 / 0.67 / +12.3%
tpcds_q02/datafusion:parquet 54750586 / 54325812 / +0.8% 69292856 / 70626323 / -1.9% 0.79 / 0.77 / +2.7%
tpcds_q03/datafusion:parquet 18865572 / 19043536 / -0.9% 30519316 / 31691695 / -3.7% 0.62 / 0.60 / +2.9%
tpcds_q04/datafusion:parquet 178601326 / 178294510 / +0.2% 202774863 / 200954082 / +0.9% 0.88 / 0.89 / -0.7%
tpcds_q05/datafusion:parquet 66185540 / 67861430 / -2.5% 87187089 / 90556906 / -3.7% 0.76 / 0.75 / +1.3%
tpcds_q06/datafusion:parquet 33966930 / 33388283 / +1.7% 44914620 / 49568163 / -9.4% 0.76 / 0.67 / +12.3%
tpcds_q07/datafusion:parquet 46362846 / 47017018 / -1.4% 61556612 / 66398857 / -7.3% 0.75 / 0.71 / +6.4%
tpcds_q08/datafusion:parquet 31439132 / 31160206 / +0.9% 43479450 / 50091849 / -13.2% 🟢 0.72 / 0.62 / +16.2%
tpcds_q09/datafusion:parquet 33021916 / 31942872 / +3.4% 42474519 / 36941498 / +15.0% 🔴 0.78 / 0.86 / -10.1%
tpcds_q10/datafusion:parquet 44326031 / 43649200 / +1.6% 57832197 / 58732634 / -1.5% 0.77 / 0.74 / +3.1%
tpcds_q11/datafusion:parquet 96182619 / 97537438 / -1.4% 118123908 / 119968982 / -1.5% 0.81 / 0.81 / +0.2%
tpcds_q12/datafusion:parquet 23460672 / 23806406 / -1.5% 33853989 / 34408765 / -1.6% 0.69 / 0.69 / +0.2%
tpcds_q13/datafusion:parquet 46489954 / 46580698 / -0.2% 64390122 / 66558810 / -3.3% 0.72 / 0.70 / +3.2%
tpcds_q14/datafusion:parquet 534726058 / 534209602 / +0.1% 588189845 / 578782769 / +1.6% 0.91 / 0.92 / -1.5%
tpcds_q15/datafusion:parquet 23695369 / 23247556 / +1.9% 36299515 / 37969124 / -4.4% 0.65 / 0.61 / +6.6%
tpcds_q16/datafusion:parquet 37162402 / 36321442 / +2.3% 48894183 / 52158980 / -6.3% 0.76 / 0.70 / +9.1%
tpcds_q17/datafusion:parquet 73363926 / 73093868 / +0.4% 93171205 / 96224592 / -3.2% 0.79 / 0.76 / +3.7%
tpcds_q18/datafusion:parquet 67269776 / 68652774 / -2.0% 89116852 / 86299344 / +3.3% 0.75 / 0.80 / -5.1%
tpcds_q19/datafusion:parquet 29292600 / 29796266 / -1.7% 41149988 / 44102256 / -6.7% 0.71 / 0.68 / +5.4%
tpcds_q20/datafusion:parquet 25439390 / 25326890 / +0.4% 36472472 / 39416602 / -7.5% 0.70 / 0.64 / +8.6%
tpcds_q21/datafusion:parquet 20006394 / 20041418 / -0.2% 30385999 / 31758701 / -4.3% 0.66 / 0.63 / +4.3%
tpcds_q22/datafusion:parquet 77691008 / 77790954 / -0.1% 87796934 / 90306415 / -2.8% 0.88 / 0.86 / +2.7%
tpcds_q23/datafusion:parquet 91035501 / 93277688 / -2.4% 110680123 / 115535888 / -4.2% 0.82 / 0.81 / +1.9%
tpcds_q24/datafusion:parquet 89945868 / 90123078 / -0.2% 111389573 / 116037759 / -4.0% 0.81 / 0.78 / +4.0%
tpcds_q25/datafusion:parquet 81234268 / 80206578 / +1.3% 101366422 / 97098996 / +4.4% 0.80 / 0.83 / -3.0%
tpcds_q26/datafusion:parquet 43310809 / 43319580 / -0.0% 56063789 / 60090512 / -6.7% 0.77 / 0.72 / +7.2%
tpcds_q27/datafusion:parquet 74732594 / 75645408 / -1.2% 97493080 / 98720445 / -1.2% 0.77 / 0.77 / +0.0%
tpcds_q28/datafusion:parquet 29023279 / 28583646 / +1.5% 42447315 / 45298216 / -6.3% 0.68 / 0.63 / +8.4%
tpcds_q29/datafusion:parquet 75125299 / 74365254 / +1.0% 95349694 / 101315034 / -5.9% 0.79 / 0.73 / +7.3%
tpcds_q30/datafusion:parquet 43751752 / 44523236 / -1.7% 54569056 / 58741638 / -7.1% 0.80 / 0.76 / +5.8%
tpcds_q31/datafusion:parquet 81121802 / 80174716 / +1.2% 96274082 / 97798393 / -1.6% 0.84 / 0.82 / +2.8%
tpcds_q32/datafusion:parquet 26682464 / 26808792 / -0.5% 38022193 / 39992774 / -4.9% 0.70 / 0.67 / +4.7%
tpcds_q33/datafusion:parquet 37175449 / 37601260 / -1.1% 51259710 / 54556863 / -6.0% 0.73 / 0.69 / +5.2%
tpcds_q34/datafusion:parquet 23916157 / 23877530 / +0.2% 34229308 / 36270015 / -5.6% 0.70 / 0.66 / +6.1%
tpcds_q35/datafusion:parquet 50589025 / 50249868 / +0.7% 63413057 / 63871180 / -0.7% 0.80 / 0.79 / +1.4%
tpcds_q36/datafusion:parquet 54123434 / 52259094 / +3.6% 67715646 / 73693498 / -8.1% 0.80 / 0.71 / +12.7%
tpcds_q37/datafusion:parquet 21830421 / 21524556 / +1.4% 32356549 / 35250943 / -8.2% 0.67 / 0.61 / +10.5%
tpcds_q38/datafusion:parquet 43175486 / 45468918 / -5.0% 59345588 / 62412312 / -4.9% 0.73 / 0.73 / -0.1%
tpcds_q39/datafusion:parquet 68159704 / 67770550 / +0.6% 82266709 / 85928225 / -4.3% 0.83 / 0.79 / +5.1%
tpcds_q40/datafusion:parquet 30327689 / 30947973 / -2.0% 48889747 / 51241226 / -4.6% 0.62 / 0.60 / +2.7%
tpcds_q41/datafusion:parquet 20324279 / 19905548 / +2.1% 30619401 / 33320924 / -8.1% 0.66 / 0.60 / +11.1%
tpcds_q42/datafusion:parquet 18044374 / 18052704 / -0.0% 28527479 / 30280721 / -5.8% 0.63 / 0.60 / +6.1%
tpcds_q43/datafusion:parquet 19255906 / 19330410 / -0.4% 29883060 / 33287410 / -10.2% 🟢 0.64 / 0.58 / +11.0%
tpcds_q44/datafusion:parquet 35515108 / 34546200 / +2.8% 49838212 / 52415937 / -4.9% 0.71 / 0.66 / +8.1%
tpcds_q45/datafusion:parquet 27686954 / 27500863 / +0.7% 39326409 / 42853539 / -8.2% 0.70 / 0.64 / +9.7%
tpcds_q46/datafusion:parquet 28668266 / 28945294 / -1.0% 43595173 / 45747495 / -4.7% 0.66 / 0.63 / +3.9%
tpcds_q47/datafusion:parquet 96082270 / 97860663 / -1.8% 118378246 / 120617226 / -1.9% 0.81 / 0.81 / +0.0%
tpcds_q48/datafusion:parquet 42719750 / 42390402 / +0.8% 57159342 / 61425859 / -6.9% 0.75 / 0.69 / +8.3%
tpcds_q49/datafusion:parquet 71637563 / 70079702 / +2.2% 89481563 / 101095153 / -11.5% 🟢 0.80 / 0.69 / +15.5%
tpcds_q50/datafusion:parquet 46775221 / 46821283 / -0.1% 63776469 / 66895888 / -4.7% 0.73 / 0.70 / +4.8%
tpcds_q51/datafusion:parquet 74940772 / 75342836 / -0.5% 93131318 / 94932036 / -1.9% 0.80 / 0.79 / +1.4%
tpcds_q52/datafusion:parquet 18583448 / 18646851 / -0.3% 28100829 / 29422670 / -4.5% 0.66 / 0.63 / +4.3%
tpcds_q53/datafusion:parquet 22836559 / 23067664 / -1.0% 35646370 / 40037240 / -11.0% 🟢 0.64 / 0.58 / +11.2%
tpcds_q54/datafusion:parquet 52864870 / 52274895 / +1.1% 66116734 / 68971453 / -4.1% 0.80 / 0.76 / +5.5%
tpcds_q55/datafusion:parquet 18065031 / 18417392 / -1.9% 28647727 / 32537228 / -12.0% 🟢 0.63 / 0.57 / +11.4%
tpcds_q56/datafusion:parquet 42006755 / 44349274 / -5.3% 57642799 / 60250717 / -4.3% 0.73 / 0.74 / -1.0%
tpcds_q57/datafusion:parquet 100970285 / 98479860 / +2.5% 120030463 / 120604693 / -0.5% 0.84 / 0.82 / +3.0%
tpcds_q58/datafusion:parquet 64294292 / 65358871 / -1.6% 80078325 / 85087445 / -5.9% 0.80 / 0.77 / +4.5%
tpcds_q59/datafusion:parquet 47221073 / 46716450 / +1.1% 63360439 / 64624457 / -2.0% 0.75 / 0.72 / +3.1%
tpcds_q60/datafusion:parquet 41489226 / 39810027 / +4.2% 55782220 / 53202210 / +4.8% 0.74 / 0.75 / -0.6%
tpcds_q61/datafusion:parquet 36023006 / 36634534 / -1.7% 48566900 / 52327021 / -7.2% 0.74 / 0.70 / +5.9%
tpcds_q62/datafusion:parquet 25278648 / 25154584 / +0.5% 37171063 / 38124376 / -2.5% 0.68 / 0.66 / +3.1%
tpcds_q63/datafusion:parquet 22026348 / 21985760 / +0.2% 36105885 / 40036485 / -9.8% 0.61 / 0.55 / +11.1%
tpcds_q64/datafusion:parquet 287719707 / 288174264 / -0.2% 324414952 / 325671133 / -0.4% 0.89 / 0.88 / +0.2%
tpcds_q65/datafusion:parquet 122275157 / 124577675 / -1.8% 136164115 / 139906521 / -2.7% 0.90 / 0.89 / +0.8%
tpcds_q66/datafusion:parquet 60120820 / 58489224 / +2.8% 74165155 / 77909989 / -4.8% 0.81 / 0.75 / +8.0%
tpcds_q67/datafusion:parquet 68973652 / 68568614 / +0.6% 90605741 / 93642522 / -3.2% 0.76 / 0.73 / +4.0%
tpcds_q68/datafusion:parquet 28750446 / 28653645 / +0.3% 45605994 / 49078025 / -7.1% 0.63 / 0.58 / +8.0%
tpcds_q69/datafusion:parquet 44139704 / 43803382 / +0.8% 57099348 / 57953561 / -1.5% 0.77 / 0.76 / +2.3%
tpcds_q70/datafusion:parquet 80344566 / 80827916 / -0.6% 95932785 / 99283899 / -3.4% 0.84 / 0.81 / +2.9%
tpcds_q71/datafusion:parquet 24525949 / 25124213 / -2.4% 36306854 / 38514232 / -5.7% 0.68 / 0.65 / +3.6%
tpcds_q72/datafusion:parquet 518496461 / 526465716 / -1.5% 557216863 / 550431846 / +1.2% 0.93 / 0.96 / -2.7%
tpcds_q73/datafusion:parquet 23590826 / 23748202 / -0.7% 33580838 / 37404435 / -10.2% 🟢 0.70 / 0.63 / +10.6%
tpcds_q74/datafusion:parquet 69016548 / 70234898 / -1.7% 85941094 / 85634447 / +0.4% 0.80 / 0.82 / -2.1%
tpcds_q75/datafusion:parquet 149926679 / 153637529 / -2.4% 176132084 / 177429017 / -0.7% 0.85 / 0.87 / -1.7%
tpcds_q76/datafusion:parquet 33347258 / 33172231 / +0.5% 45207302 / 47502719 / -4.8% 0.74 / 0.70 / +5.6%
tpcds_q77/datafusion:parquet 56595996 / 57568385 / -1.7% 74054817 / 76080783 / -2.7% 0.76 / 0.76 / +1.0%
tpcds_q78/datafusion:parquet 87466038 / 87764829 / -0.3% 116884719 / 119664913 / -2.3% 0.75 / 0.73 / +2.0%
tpcds_q79/datafusion:parquet 26321442 / 26834992 / -1.9% 39096527 / 43533067 / -10.2% 🟢 0.67 / 0.62 / +9.2%
tpcds_q80/datafusion:parquet 81496102 / 80567255 / +1.2% 109828512 / 112225870 / -2.1% 0.74 / 0.72 / +3.4%
tpcds_q81/datafusion:parquet 38115520 / 37605610 / +1.4% 48393391 / 55148464 / -12.2% 🟢 0.79 / 0.68 / +15.5%
tpcds_q82/datafusion:parquet 22316876 / 22957496 / -2.8% 33123732 / 37363212 / -11.3% 🟢 0.67 / 0.61 / +9.7%
tpcds_q83/datafusion:parquet 59379256 / 59673867 / -0.5% 69668576 / 78189998 / -10.9% 🟢 0.85 / 0.76 / +11.7%
tpcds_q84/datafusion:parquet 25832656 / 25826997 / +0.0% 37296082 / 39896892 / -6.5% 0.69 / 0.65 / +7.0%
tpcds_q85/datafusion:parquet 81539083 / 79251052 / +2.9% 101983075 / 103444576 / -1.4% 0.80 / 0.77 / +4.4%
tpcds_q86/datafusion:parquet 20892338 / 20788372 / +0.5% 31172651 / 33963988 / -8.2% 0.67 / 0.61 / +9.5%
tpcds_q87/datafusion:parquet 44827134 / 44510670 / +0.7% 59584754 / 60689746 / -1.8% 0.75 / 0.73 / +2.6%
tpcds_q88/datafusion:parquet 37801773 / 37100596 / +1.9% 48391849 / 50324986 / -3.8% 0.78 / 0.74 / +6.0%
tpcds_q89/datafusion:parquet 25535376 / 25585705 / -0.2% 39121946 / 42250629 / -7.4% 0.65 / 0.61 / +7.8%
tpcds_q90/datafusion:parquet 16361401 / 15216870 / +7.5% 25782500 / 27579523 / -6.5% 0.63 / 0.55 / +15.0%
tpcds_q91/datafusion:parquet 32093906 / 33161909 / -3.2% 46107124 / 50270383 / -8.3% 0.70 / 0.66 / +5.5%
tpcds_q92/datafusion:parquet 27050731 / 26342870 / +2.7% 39147628 / 41041041 / -4.6% 0.69 / 0.64 / +7.7%
tpcds_q93/datafusion:parquet 27200713 / 26854483 / +1.3% 40987026 / 47782149 / -14.2% 🟢 0.66 / 0.56 / +18.1%
tpcds_q94/datafusion:parquet 35273066 / 35214738 / +0.2% 48192338 / 48470336 / -0.6% 0.73 / 0.73 / +0.7%
tpcds_q95/datafusion:parquet 65118604 / 63753648 / +2.1% 77281138 / 77833598 / -0.7% 0.84 / 0.82 / +2.9%
tpcds_q96/datafusion:parquet 12875588 / 12890402 / -0.1% 23246367 / 25325983 / -8.2% 0.55 / 0.51 / +8.8%
tpcds_q97/datafusion:parquet 35790594 / 34591491 / +3.5% 50062327 / 51593206 / -3.0% 0.71 / 0.67 / +6.6%
tpcds_q98/datafusion:parquet 24708280 / 24946420 / -1.0% 35635001 / 39898908 / -10.7% 🟢 0.69 / 0.63 / +10.9%
tpcds_q99/datafusion:parquet 29912566 / 29518847 / +1.3% 41337277 / 43057560 / -4.0% 0.72 / 0.69 / +5.6%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15953924 / 15998460 / -0.3% 24052506 / 25279335 / -4.9% 0.66 / 0.63 / +4.8%
tpcds_q02/duckdb:vortex-file-compressed 19609804 / 18586002 / +5.5% 23189738 / 23691648 / -2.1% 0.85 / 0.78 / +7.8%
tpcds_q03/duckdb:vortex-file-compressed 7175183 / 7005848 / +2.4% 15535978 / 16363657 / -5.1% 0.46 / 0.43 / +7.9%
tpcds_q04/duckdb:vortex-file-compressed 58369872 / 58941868 / -1.0% 70482783 / 72184759 / -2.4% 0.83 / 0.82 / +1.4%
tpcds_q05/duckdb:vortex-file-compressed 22846510 / 22760871 / +0.4% 32967400 / 33164301 / -0.6% 0.69 / 0.69 / +1.0%
tpcds_q06/duckdb:vortex-file-compressed 24298598 / 24150568 / +0.6% 37150781 / 39035444 / -4.8% 0.65 / 0.62 / +5.7%
tpcds_q07/duckdb:vortex-file-compressed 22145820 / 22106978 / +0.2% 33903738 / 34845349 / -2.7% 0.65 / 0.63 / +3.0%
tpcds_q08/duckdb:vortex-file-compressed 17475268 / 17283258 / +1.1% 25335407 / 25431806 / -0.4% 0.69 / 0.68 / +1.5%
tpcds_q09/duckdb:vortex-file-compressed 19153720 / 19391651 / -1.2% 29867816 / 28897350 / +3.4% 0.64 / 0.67 / -4.4%
tpcds_q10/duckdb:vortex-file-compressed 27951428 / 27646218 / +1.1% 40973770 / 40492861 / +1.2% 0.68 / 0.68 / -0.1%
tpcds_q11/duckdb:vortex-file-compressed 36751690 / 36034579 / +2.0% 45062396 / 45446228 / -0.8% 0.82 / 0.79 / +2.9%
tpcds_q12/duckdb:vortex-file-compressed 10362468 / 10461966 / -1.0% 17080510 / 16797157 / +1.7% 0.61 / 0.62 / -2.6%
tpcds_q13/duckdb:vortex-file-compressed 19855713 / 20145126 / -1.4% 31786049 / 33256228 / -4.4% 0.62 / 0.61 / +3.1%
tpcds_q14/duckdb:vortex-file-compressed 54753470 / 54835950 / -0.2% 65038986 / 66335159 / -2.0% 0.84 / 0.83 / +1.8%
tpcds_q15/duckdb:vortex-file-compressed 11165566 / 11182244 / -0.1% 17696674 / 17246024 / +2.6% 0.63 / 0.65 / -2.7%
tpcds_q16/duckdb:vortex-file-compressed 24438360 / 24783182 / -1.4% 34813450 / 35207761 / -1.1% 0.70 / 0.70 / -0.3%
tpcds_q17/duckdb:vortex-file-compressed 20319440 / 20280500 / +0.2% 31228992 / 32446918 / -3.8% 0.65 / 0.63 / +4.1%
tpcds_q18/duckdb:vortex-file-compressed 32207104 / 32129649 / +0.2% 42648042 / 42629795 / +0.0% 0.76 / 0.75 / +0.2%
tpcds_q19/duckdb:vortex-file-compressed 20313600 / 20439766 / -0.6% 28394369 / 29191279 / -2.7% 0.72 / 0.70 / +2.2%
tpcds_q20/duckdb:vortex-file-compressed 11027458 / 10935487 / +0.8% 17590615 / 17297916 / +1.7% 0.63 / 0.63 / -0.8%
tpcds_q21/duckdb:vortex-file-compressed 9887972 / 10342111 / -4.4% 23505039 / 23054399 / +2.0% 0.42 / 0.45 / -6.2%
tpcds_q22/duckdb:vortex-file-compressed 17900078 / 17944356 / -0.2% 31209499 / 30318393 / +2.9% 0.57 / 0.59 / -3.1%
tpcds_q23/duckdb:vortex-file-compressed 37568619 / 37566020 / +0.0% 48361085 / 49039413 / -1.4% 0.78 / 0.77 / +1.4%
tpcds_q24/duckdb:vortex-file-compressed 26825878 / 26108210 / +2.7% 36567560 / 37221702 / -1.8% 0.73 / 0.70 / +4.6%
tpcds_q25/duckdb:vortex-file-compressed 19018448 / 19101726 / -0.4% 29781392 / 31424797 / -5.2% 0.64 / 0.61 / +5.1%
tpcds_q26/duckdb:vortex-file-compressed 21720174 / 21710440 / +0.0% 31879828 / 32898015 / -3.1% 0.68 / 0.66 / +3.2%
tpcds_q27/duckdb:vortex-file-compressed 24499664 / 24859010 / -1.4% 35330535 / 36389465 / -2.9% 0.69 / 0.68 / +1.5%
tpcds_q28/duckdb:vortex-file-compressed 15196106 / 15092923 / +0.7% 25667285 / 27757616 / -7.5% 0.59 / 0.54 / +8.9%
tpcds_q29/duckdb:vortex-file-compressed 18780084 / 18517528 / +1.4% 28935857 / 29799561 / -2.9% 0.65 / 0.62 / +4.4%
tpcds_q30/duckdb:vortex-file-compressed 18215912 / 18282706 / -0.4% 26628086 / 27773877 / -4.1% 0.68 / 0.66 / +3.9%
tpcds_q31/duckdb:vortex-file-compressed 17956038 / 18046650 / -0.5% 25686939 / 26720570 / -3.9% 0.70 / 0.68 / +3.5%
tpcds_q32/duckdb:vortex-file-compressed 10173769 / 10206170 / -0.3% 18128237 / 18710281 / -3.1% 0.56 / 0.55 / +2.9%
tpcds_q33/duckdb:vortex-file-compressed 17754100 / 17888560 / -0.8% 27932379 / 28674678 / -2.6% 0.64 / 0.62 / +1.9%
tpcds_q34/duckdb:vortex-file-compressed 12869238 / 13106645 / -1.8% 22399508 / 23396718 / -4.3% 0.57 / 0.56 / +2.6%
tpcds_q35/duckdb:vortex-file-compressed 30780031 / 30377759 / +1.3% 42768985 / 44452052 / -3.8% 0.72 / 0.68 / +5.3%
tpcds_q36/duckdb:vortex-file-compressed 15055778 / 14130368 / +6.5% 24217490 / 24853123 / -2.6% 0.62 / 0.57 / +9.3%
tpcds_q37/duckdb:vortex-file-compressed 9610862 / 9802490 / -2.0% 25601029 / 24943628 / +2.6% 0.38 / 0.39 / -4.5%
tpcds_q38/duckdb:vortex-file-compressed 24233948 / 24330794 / -0.4% 31587322 / 31834118 / -0.8% 0.77 / 0.76 / +0.4%
tpcds_q39/duckdb:vortex-file-compressed 19028502 / 18620041 / +2.2% 32144456 / 32444825 / -0.9% 0.59 / 0.57 / +3.1%
tpcds_q40/duckdb:vortex-file-compressed 11029651 / 11105330 / -0.7% 19601903 / 19595517 / +0.0% 0.56 / 0.57 / -0.7%
tpcds_q41/duckdb:vortex-file-compressed 17183464 / 17136358 / +0.3% 23850549 / 24222303 / -1.5% 0.72 / 0.71 / +1.8%
tpcds_q42/duckdb:vortex-file-compressed 6852285 / 6867572 / -0.2% 15181959 / 15592392 / -2.6% 0.45 / 0.44 / +2.5%
tpcds_q43/duckdb:vortex-file-compressed 9524435 / 9566892 / -0.4% 18438086 / 18900196 / -2.4% 0.52 / 0.51 / +2.1%
tpcds_q44/duckdb:vortex-file-compressed 12942066 / 12669200 / +2.2% 23573259 / 25379067 / -7.1% 0.55 / 0.50 / +10.0%
tpcds_q45/duckdb:vortex-file-compressed 23787626 / 23701446 / +0.4% 29946986 / 30643052 / -2.3% 0.79 / 0.77 / +2.7%
tpcds_q46/duckdb:vortex-file-compressed 31565060 / 31487075 / +0.2% 43516121 / 44128229 / -1.4% 0.73 / 0.71 / +1.7%
tpcds_q47/duckdb:vortex-file-compressed 30846665 / 30927372 / -0.3% 39745020 / 41630659 / -4.5% 0.78 / 0.74 / +4.5%
tpcds_q48/duckdb:vortex-file-compressed 22453906 / 22507799 / -0.2% 34696331 / 35987498 / -3.6% 0.65 / 0.63 / +3.5%
tpcds_q49/duckdb:vortex-file-compressed 18857520 / 18418604 / +2.4% 29077410 / 30521493 / -4.7% 0.65 / 0.60 / +7.5%
tpcds_q50/duckdb:vortex-file-compressed 15072090 / 14708381 / +2.5% 25575736 / 25119917 / +1.8% 0.59 / 0.59 / +0.6%
tpcds_q51/duckdb:vortex-file-compressed 48922794 / 48773388 / +0.3% 75615087 / 76026902 / -0.5% 0.65 / 0.64 / +0.9%
tpcds_q52/duckdb:vortex-file-compressed 7078714 / 7050506 / +0.4% 15719093 / 17085214 / -8.0% 0.45 / 0.41 / +9.1%
tpcds_q53/duckdb:vortex-file-compressed 11300809 / 11436496 / -1.2% 20371812 / 20136724 / +1.2% 0.55 / 0.57 / -2.3%
tpcds_q54/duckdb:vortex-file-compressed 19778050 / 19859173 / -0.4% 31024129 / 29876590 / +3.8% 0.64 / 0.66 / -4.1%
tpcds_q55/duckdb:vortex-file-compressed 6916464 / 6785248 / +1.9% 15193816 / 16628922 / -8.6% 0.46 / 0.41 / +11.6%
tpcds_q56/duckdb:vortex-file-compressed 18187180 / 18177700 / +0.1% 27305136 / 27727674 / -1.5% 0.67 / 0.66 / +1.6%
tpcds_q57/duckdb:vortex-file-compressed 25317406 / 25503716 / -0.7% 32928540 / 34313039 / -4.0% 0.77 / 0.74 / +3.4%
tpcds_q58/duckdb:vortex-file-compressed 20779658 / 20407362 / +1.8% 29960952 / 30428402 / -1.5% 0.69 / 0.67 / +3.4%
tpcds_q59/duckdb:vortex-file-compressed 19797900 / 19323190 / +2.5% 26739127 / 27334736 / -2.2% 0.74 / 0.71 / +4.7%
tpcds_q60/duckdb:vortex-file-compressed 18682702 / 18634674 / +0.3% 27513818 / 29113103 / -5.5% 0.68 / 0.64 / +6.1%
tpcds_q61/duckdb:vortex-file-compressed 20074005 / 19964264 / +0.5% 30130797 / 30767115 / -2.1% 0.67 / 0.65 / +2.7%
tpcds_q62/duckdb:vortex-file-compressed 11214259 / 11299214 / -0.8% 17694501 / 18481267 / -4.3% 0.63 / 0.61 / +3.7%
tpcds_q63/duckdb:vortex-file-compressed 10851590 / 10795688 / +0.5% 19426347 / 19906904 / -2.4% 0.56 / 0.54 / +3.0%
tpcds_q64/duckdb:vortex-file-compressed 52427709 / 52721278 / -0.6% 68045255 / 67042235 / +1.5% 0.77 / 0.79 / -2.0%
tpcds_q65/duckdb:vortex-file-compressed 12961296 / 12770004 / +1.5% 23410741 / 22727017 / +3.0% 0.55 / 0.56 / -1.5%
tpcds_q66/duckdb:vortex-file-compressed 31194873 / 31389174 / -0.6% 38117108 / 39821367 / -4.3% 0.82 / 0.79 / +3.8%
tpcds_q67/duckdb:vortex-file-compressed 55105554 / 54953770 / +0.3% 64901009 / 65266745 / -0.6% 0.85 / 0.84 / +0.8%
tpcds_q68/duckdb:vortex-file-compressed 23187715 / 22797336 / +1.7% 34722020 / 36375150 / -4.5% 0.67 / 0.63 / +6.6%
tpcds_q69/duckdb:vortex-file-compressed 22658536 / 22755364 / -0.4% 37192598 / 37844422 / -1.7% 0.61 / 0.60 / +1.3%
tpcds_q70/duckdb:vortex-file-compressed 14723680 / 14594222 / +0.9% 24468100 / 25504691 / -4.1% 0.60 / 0.57 / +5.2%
tpcds_q71/duckdb:vortex-file-compressed 13054188 / 13212550 / -1.2% 22713506 / 23337677 / -2.7% 0.57 / 0.57 / +1.5%
tpcds_q72/duckdb:vortex-file-compressed 42898326 / 42821092 / +0.2% 56186831 / 56283711 / -0.2% 0.76 / 0.76 / +0.4%
tpcds_q73/duckdb:vortex-file-compressed 11714881 / 11948257 / -2.0% 20703333 / 21075874 / -1.8% 0.57 / 0.57 / -0.2%
tpcds_q74/duckdb:vortex-file-compressed 31582224 / 31598904 / -0.1% 40049973 / 40952742 / -2.2% 0.79 / 0.77 / +2.2%
tpcds_q75/duckdb:vortex-file-compressed 37156390 / 37770372 / -1.6% 49443930 / 50071453 / -1.3% 0.75 / 0.75 / -0.4%
tpcds_q76/duckdb:vortex-file-compressed 12721129 / 12609966 / +0.9% 21696154 / 22498723 / -3.6% 0.59 / 0.56 / +4.6%
tpcds_q77/duckdb:vortex-file-compressed 20814089 / 21008796 / -0.9% 31209663 / 32329023 / -3.5% 0.67 / 0.65 / +2.6%
tpcds_q78/duckdb:vortex-file-compressed 43123694 / 43702260 / -1.3% 54460517 / 53022854 / +2.7% 0.79 / 0.82 / -3.9%
tpcds_q79/duckdb:vortex-file-compressed 16939182 / 16993206 / -0.3% 26996157 / 28041623 / -3.7% 0.63 / 0.61 / +3.5%
tpcds_q80/duckdb:vortex-file-compressed 30307720 / 29448084 / +2.9% 43548389 / 44314343 / -1.7% 0.70 / 0.66 / +4.7%
tpcds_q81/duckdb:vortex-file-compressed 21295986 / 21193559 / +0.5% 30214210 / 31177131 / -3.1% 0.70 / 0.68 / +3.7%
tpcds_q82/duckdb:vortex-file-compressed 10341842 / 10295556 / +0.4% 26542701 / 27238478 / -2.6% 0.39 / 0.38 / +3.1%
tpcds_q83/duckdb:vortex-file-compressed 17588377 / 17436408 / +0.9% 24631567 / 24358320 / +1.1% 0.71 / 0.72 / -0.2%
tpcds_q84/duckdb:vortex-file-compressed 15840070 / 15590550 / +1.6% 22899753 / 23326916 / -1.8% 0.69 / 0.67 / +3.5%
tpcds_q85/duckdb:vortex-file-compressed 25214902 / 25131804 / +0.3% 36361435 / 36439665 / -0.2% 0.69 / 0.69 / +0.5%
tpcds_q86/duckdb:vortex-file-compressed 10338339 / 10264312 / +0.7% 17075695 / 17606568 / -3.0% 0.61 / 0.58 / +3.9%
tpcds_q87/duckdb:vortex-file-compressed 25577618 / 25947975 / -1.4% 33647386 / 33458496 / +0.6% 0.76 / 0.78 / -2.0%
tpcds_q88/duckdb:vortex-file-compressed 30140188 / 29903028 / +0.8% 37194234 / 38487270 / -3.4% 0.81 / 0.78 / +4.3%
tpcds_q89/duckdb:vortex-file-compressed 11794080 / 11758880 / +0.3% 20651231 / 20504807 / +0.7% 0.57 / 0.57 / -0.4%
tpcds_q90/duckdb:vortex-file-compressed 7815894 / 7862216 / -0.6% 14916391 / 14786958 / +0.9% 0.52 / 0.53 / -1.5%
tpcds_q91/duckdb:vortex-file-compressed 14730189 / 14942240 / -1.4% 23981897 / 24085741 / -0.4% 0.61 / 0.62 / -1.0%
tpcds_q92/duckdb:vortex-file-compressed 11001968 / 10766748 / +2.2% 18329431 / 18850268 / -2.8% 0.60 / 0.57 / +5.1%
tpcds_q93/duckdb:vortex-file-compressed 10207832 / 10226306 / -0.2% 22307784 / 23278371 / -4.2% 0.46 / 0.44 / +4.2%
tpcds_q94/duckdb:vortex-file-compressed 21939142 / 22203888 / -1.2% 31582498 / 32334521 / -2.3% 0.69 / 0.69 / +1.2%
tpcds_q95/duckdb:vortex-file-compressed 60741687 / 60444692 / +0.5% 67680621 / 70030543 / -3.4% 0.90 / 0.86 / +4.0%
tpcds_q96/duckdb:vortex-file-compressed 6611318 / 6748670 / -2.0% 16247215 / 17560442 / -7.5% 0.41 / 0.38 / +5.9%
tpcds_q97/duckdb:vortex-file-compressed 23430195 / 23076590 / +1.5% 31251602 / 32245613 / -3.1% 0.75 / 0.72 / +4.8%
tpcds_q98/duckdb:vortex-file-compressed 11209012 / 11317974 / -1.0% 19760014 / 19829323 / -0.3% 0.57 / 0.57 / -0.6%
tpcds_q99/duckdb:vortex-file-compressed 14655438 / 14577288 / +0.5% 22530943 / 23038774 / -2.2% 0.65 / 0.63 / +2.8%
duckdb / parquet / ns (0.996x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23804330 / 23726814 / +0.3% 30333695 / 31125703 / -2.5% 0.78 / 0.76 / +2.9%
tpcds_q02/duckdb:parquet 17783832 / 17574302 / +1.2% 23957741 / 23749110 / +0.9% 0.74 / 0.74 / +0.3%
tpcds_q03/duckdb:parquet 9690517 / 9633572 / +0.6% 15437074 / 15594691 / -1.0% 0.63 / 0.62 / +1.6%
tpcds_q04/duckdb:parquet 119364688 / 117413420 / +1.7% 125646837 / 126172530 / -0.4% 0.95 / 0.93 / +2.1%
tpcds_q05/duckdb:parquet 28196112 / 28078563 / +0.4% 32363054 / 32719119 / -1.1% 0.87 / 0.86 / +1.5%
tpcds_q06/duckdb:parquet 26193272 / 26212342 / -0.1% 34627664 / 36042662 / -3.9% 0.76 / 0.73 / +4.0%
tpcds_q07/duckdb:parquet 30681155 / 32942916 / -6.9% 38296883 / 39267364 / -2.5% 0.80 / 0.84 / -4.5%
tpcds_q08/duckdb:parquet 19663552 / 19579842 / +0.4% 24474532 / 25998860 / -5.9% 0.80 / 0.75 / +6.7%
tpcds_q09/duckdb:parquet 27378680 / 27101055 / +1.0% 31220829 / 30324063 / +3.0% 0.88 / 0.89 / -1.9%
tpcds_q10/duckdb:parquet 32443934 / 32468520 / -0.1% 39883240 / 41014321 / -2.8% 0.81 / 0.79 / +2.8%
tpcds_q11/duckdb:parquet 69884692 / 68033474 / +2.7% 74509541 / 75341207 / -1.1% 0.94 / 0.90 / +3.9%
tpcds_q12/duckdb:parquet 13857360 / 13879832 / -0.2% 18739961 / 19209614 / -2.4% 0.74 / 0.72 / +2.3%
tpcds_q13/duckdb:parquet 31703276 / 30546548 / +3.8% 39386087 / 39184206 / +0.5% 0.80 / 0.78 / +3.3%
tpcds_q14/duckdb:parquet 64775958 / 64791516 / -0.0% 67301856 / 68293832 / -1.5% 0.96 / 0.95 / +1.4%
tpcds_q15/duckdb:parquet 16561908 / 16461266 / +0.6% 22441473 / 22797166 / -1.6% 0.74 / 0.72 / +2.2%
tpcds_q16/duckdb:parquet 30087100 / 29947981 / +0.5% 37398471 / 37207913 / +0.5% 0.80 / 0.80 / -0.0%
tpcds_q17/duckdb:parquet 34299026 / 34454922 / -0.5% 39383807 / 39698488 / -0.8% 0.87 / 0.87 / +0.3%
tpcds_q18/duckdb:parquet 46870970 / 46782568 / +0.2% 53866455 / 54393355 / -1.0% 0.87 / 0.86 / +1.2%
tpcds_q19/duckdb:parquet 18556510 / 18965014 / -2.2% 25241288 / 25315740 / -0.3% 0.74 / 0.75 / -1.9%
tpcds_q20/duckdb:parquet 14788390 / 14663974 / +0.8% 18942628 / 19528935 / -3.0% 0.78 / 0.75 / +4.0%
tpcds_q21/duckdb:parquet 10522304 / 10303602 / +2.1% 16639672 / 17007057 / -2.2% 0.63 / 0.61 / +4.4%
tpcds_q22/duckdb:parquet 20523074 / 20637432 / -0.6% 26180887 / 26882346 / -2.6% 0.78 / 0.77 / +2.1%
tpcds_q23/duckdb:parquet 42854458 / 46160844 / -7.2% 48723182 / 47037175 / +3.6% 0.88 / 0.98 / -10.4%
tpcds_q24/duckdb:parquet 30046088 / 31543622 / -4.7% 35935260 / 35750888 / +0.5% 0.84 / 0.88 / -5.2%
tpcds_q25/duckdb:parquet 30247644 / 30369571 / -0.4% 36233442 / 36336308 / -0.3% 0.83 / 0.84 / -0.1%
tpcds_q26/duckdb:parquet 28688590 / 28700210 / -0.0% 34680815 / 34897669 / -0.6% 0.83 / 0.82 / +0.6%
tpcds_q27/duckdb:parquet 34630074 / 33272820 / +4.1% 41091223 / 41937098 / -2.0% 0.84 / 0.79 / +6.2%
tpcds_q28/duckdb:parquet 25869352 / 25960212 / -0.3% 29899727 / 35457858 / -15.7% 🟢 0.87 / 0.73 / +18.2%
tpcds_q29/duckdb:parquet 32070334 / 32187552 / -0.4% 38374371 / 39432564 / -2.7% 0.84 / 0.82 / +2.4%
tpcds_q30/duckdb:parquet 35121045 / 34996723 / +0.4% 43476499 / 44584127 / -2.5% 0.81 / 0.78 / +2.9%
tpcds_q31/duckdb:parquet 35909768 / 35498929 / +1.2% 42411974 / 42179497 / +0.6% 0.85 / 0.84 / +0.6%
tpcds_q32/duckdb:parquet 14232880 / 14070233 / +1.2% 20273452 / 20682265 / -2.0% 0.70 / 0.68 / +3.2%
tpcds_q33/duckdb:parquet 24364988 / 24057092 / +1.3% 28449650 / 28655771 / -0.7% 0.86 / 0.84 / +2.0%
tpcds_q34/duckdb:parquet 18106814 / 18470468 / -2.0% 23825054 / 24306860 / -2.0% 0.76 / 0.76 / +0.0%
tpcds_q35/duckdb:parquet 35248936 / 35049589 / +0.6% 42683696 / 44135210 / -3.3% 0.83 / 0.79 / +4.0%
tpcds_q36/duckdb:parquet 39867116 / 39674434 / +0.5% 46492701 / 47944887 / -3.0% 0.86 / 0.83 / +3.6%
tpcds_q37/duckdb:parquet 12784950 / 12712061 / +0.6% 19150914 / 19774878 / -3.2% 0.67 / 0.64 / +3.9%
tpcds_q38/duckdb:parquet 29526510 / 29464074 / +0.2% 34218306 / 33507898 / +2.1% 0.86 / 0.88 / -1.9%
tpcds_q39/duckdb:parquet 22966213 / 22919777 / +0.2% 29651594 / 29852941 / -0.7% 0.77 / 0.77 / +0.9%
tpcds_q40/duckdb:parquet 15792142 / 15817682 / -0.2% 20757425 / 21135594 / -1.8% 0.76 / 0.75 / +1.7%
tpcds_q41/duckdb:parquet 11953416 / 11813006 / +1.2% 17986583 / 18152861 / -0.9% 0.66 / 0.65 / +2.1%
tpcds_q42/duckdb:parquet 9503546 / 9413328 / +1.0% 15525613 / 15624452 / -0.6% 0.61 / 0.60 / +1.6%
tpcds_q43/duckdb:parquet 12054976 / 11820573 / +2.0% 17680001 / 18033379 / -2.0% 0.68 / 0.66 / +4.0%
tpcds_q44/duckdb:parquet 21331172 / 20762996 / +2.7% 26429495 / 27539217 / -4.0% 0.81 / 0.75 / +7.1%
tpcds_q45/duckdb:parquet 20874131 / 20722010 / +0.7% 27157113 / 27372728 / -0.8% 0.77 / 0.76 / +1.5%
tpcds_q46/duckdb:parquet 38386436 / 36503674 / +5.2% 43313843 / 43691520 / -0.9% 0.89 / 0.84 / +6.1%
tpcds_q47/duckdb:parquet 34118240 / 34137414 / -0.1% 40497420 / 41775824 / -3.1% 0.84 / 0.82 / +3.1%
tpcds_q48/duckdb:parquet 29319124 / 31008289 / -5.4% 36134012 / 37182932 / -2.8% 0.81 / 0.83 / -2.7%
tpcds_q49/duckdb:parquet 29048547 / 30904250 / -6.0% 35504858 / 36297393 / -2.2% 0.82 / 0.85 / -3.9%
tpcds_q50/duckdb:parquet 19273525 / 19382801 / -0.6% 25419194 / 25604088 / -0.7% 0.76 / 0.76 / +0.2%
tpcds_q51/duckdb:parquet 51602840 / 69485940 / -25.7% 🟢 58647435 / 58770092 / -0.2% 0.88 / 1.18 / -25.6%
tpcds_q52/duckdb:parquet 9612528 / 9608058 / +0.0% 15292836 / 15387836 / -0.6% 0.63 / 0.62 / +0.7%
tpcds_q53/duckdb:parquet 13816540 / 13658214 / +1.2% 20596791 / 20968336 / -1.8% 0.67 / 0.65 / +3.0%
tpcds_q54/duckdb:parquet 24732880 / 24598718 / +0.5% 31753429 / 32380590 / -1.9% 0.78 / 0.76 / +2.5%
tpcds_q55/duckdb:parquet 9482639 / 9346738 / +1.5% 15090753 / 15163337 / -0.5% 0.63 / 0.62 / +1.9%
tpcds_q56/duckdb:parquet 25262984 / 25241342 / +0.1% 30179889 / 30798406 / -2.0% 0.84 / 0.82 / +2.1%
tpcds_q57/duckdb:parquet 30327910 / 30191903 / +0.5% 35598565 / 35779972 / -0.5% 0.85 / 0.84 / +1.0%
tpcds_q58/duckdb:parquet 23878881 / 24638962 / -3.1% 29191123 / 29844640 / -2.2% 0.82 / 0.83 / -0.9%
tpcds_q59/duckdb:parquet 22574790 / 22739790 / -0.7% 28571382 / 28986172 / -1.4% 0.79 / 0.78 / +0.7%
tpcds_q60/duckdb:parquet 27323788 / 27742544 / -1.5% 31450086 / 32703599 / -3.8% 0.87 / 0.85 / +2.4%
tpcds_q61/duckdb:parquet 24721080 / 24951034 / -0.9% 28209459 / 29044712 / -2.9% 0.88 / 0.86 / +2.0%
tpcds_q62/duckdb:parquet 12871584 / 12639110 / +1.8% 17851978 / 18108035 / -1.4% 0.72 / 0.70 / +3.3%
tpcds_q63/duckdb:parquet 13242729 / 13865814 / -4.5% 19519041 / 20075266 / -2.8% 0.68 / 0.69 / -1.8%
tpcds_q64/duckdb:parquet 70372930 / 70435500 / -0.1% 80787678 / 80729913 / +0.1% 0.87 / 0.87 / -0.2%
tpcds_q65/duckdb:parquet 19057810 / 18416790 / +3.5% 26460313 / 25682664 / +3.0% 0.72 / 0.72 / +0.4%
tpcds_q66/duckdb:parquet 33048724 / 33021034 / +0.1% 37673297 / 37889480 / -0.6% 0.88 / 0.87 / +0.7%
tpcds_q67/duckdb:parquet 61432358 / 61015847 / +0.7% 66947319 / 66313100 / +1.0% 0.92 / 0.92 / -0.3%
tpcds_q68/duckdb:parquet 28107170 / 30850392 / -8.9% 35940939 / 36329562 / -1.1% 0.78 / 0.85 / -7.9%
tpcds_q69/duckdb:parquet 25861801 / 26097730 / -0.9% 33697776 / 34621829 / -2.7% 0.77 / 0.75 / +1.8%
tpcds_q70/duckdb:parquet 19239220 / 18957488 / +1.5% 26323707 / 27534381 / -4.4% 0.73 / 0.69 / +6.2%
tpcds_q71/duckdb:parquet 17048618 / 16830181 / +1.3% 23283865 / 24264241 / -4.0% 0.73 / 0.69 / +5.6%
tpcds_q72/duckdb:parquet 52678153 / 52736970 / -0.1% 59308498 / 59223672 / +0.1% 0.89 / 0.89 / -0.3%
tpcds_q73/duckdb:parquet 15283541 / 14625140 / +4.5% 21606785 / 21730119 / -0.6% 0.71 / 0.67 / +5.1%
tpcds_q74/duckdb:parquet 84150816 / 84163970 / -0.0% 89218621 / 91067905 / -2.0% 0.94 / 0.92 / +2.1%
tpcds_q75/duckdb:parquet 43746194 / 45281128 / -3.4% 49630218 / 49641214 / -0.0% 0.88 / 0.91 / -3.4%
tpcds_q76/duckdb:parquet 19078050 / 19145906 / -0.4% 23592794 / 22878067 / +3.1% 0.81 / 0.84 / -3.4%
tpcds_q77/duckdb:parquet 24135050 / 25611593 / -5.8% 30799802 / 31334785 / -1.7% 0.78 / 0.82 / -4.1%
tpcds_q78/duckdb:parquet 78124594 / 77253454 / +1.1% 85016180 / 83226590 / +2.2% 0.92 / 0.93 / -1.0%
tpcds_q79/duckdb:parquet 21417212 / 21316780 / +0.5% 27799671 / 28980914 / -4.1% 0.77 / 0.74 / +4.7%
tpcds_q80/duckdb:parquet 36767779 / 37605848 / -2.2% 43479868 / 44145149 / -1.5% 0.85 / 0.85 / -0.7%
tpcds_q81/duckdb:parquet 36177946 / 36157829 / +0.1% 43672339 / 44384177 / -1.6% 0.83 / 0.81 / +1.7%
tpcds_q82/duckdb:parquet 13432948 / 13133088 / +2.3% 19657172 / 20284645 / -3.1% 0.68 / 0.65 / +5.5%
tpcds_q83/duckdb:parquet 19967832 / 19957232 / +0.1% 24812260 / 25506828 / -2.7% 0.80 / 0.78 / +2.9%
tpcds_q84/duckdb:parquet 22799838 / 22471196 / +1.5% 27852200 / 28724077 / -3.0% 0.82 / 0.78 / +4.6%
tpcds_q85/duckdb:parquet 31970130 / 32276504 / -0.9% 39298505 / 39490050 / -0.5% 0.81 / 0.82 / -0.5%
tpcds_q86/duckdb:parquet 11767294 / 11739520 / +0.2% 16635063 / 17208269 / -3.3% 0.71 / 0.68 / +3.7%
tpcds_q87/duckdb:parquet 31316884 / 31181856 / +0.4% 35353174 / 35142661 / +0.6% 0.89 / 0.89 / -0.2%
tpcds_q88/duckdb:parquet 38439757 / 38235802 / +0.5% 44732390 / 44509976 / +0.5% 0.86 / 0.86 / +0.0%
tpcds_q89/duckdb:parquet 14172582 / 14185909 / -0.1% 21091672 / 21621009 / -2.4% 0.67 / 0.66 / +2.4%
tpcds_q90/duckdb:parquet 9975320 / 9876663 / +1.0% 15195724 / 15122295 / +0.5% 0.66 / 0.65 / +0.5%
tpcds_q91/duckdb:parquet 20880361 / 20987519 / -0.5% 27734761 / 28721295 / -3.4% 0.75 / 0.73 / +3.0%
tpcds_q92/duckdb:parquet 15443514 / 15482658 / -0.3% 22022832 / 22393131 / -1.7% 0.70 / 0.69 / +1.4%
tpcds_q93/duckdb:parquet 14160159 / 14165071 / -0.0% 19818348 / 20627209 / -3.9% 0.71 / 0.69 / +4.0%
tpcds_q94/duckdb:parquet 25369018 / 25161694 / +0.8% 32079976 / 32159484 / -0.2% 0.79 / 0.78 / +1.1%
tpcds_q95/duckdb:parquet 43816800 / 43794167 / +0.1% 48667398 / 49265487 / -1.2% 0.90 / 0.89 / +1.3%
tpcds_q96/duckdb:parquet 8204113 / 8280609 / -0.9% 13733432 / 13613162 / +0.9% 0.60 / 0.61 / -1.8%
tpcds_q97/duckdb:parquet 27224012 / 27308693 / -0.3% 32068740 / 32818228 / -2.3% 0.85 / 0.83 / +2.0%
tpcds_q98/duckdb:parquet 16402359 / 16446614 / -0.3% 22423257 / 23145071 / -3.1% 0.73 / 0.71 / +2.9%
tpcds_q99/duckdb:parquet 18607233 / 18681827 / -0.4% 24361119 / 24773943 / -1.7% 0.76 / 0.75 / +1.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR b1ca326a vs base bcbe4c23
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.993x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.7% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.987x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1241870 / 1240142 / +0.1% 23556845 / 23525845 / +0.1% 0.05 / 0.05 / +0.0%
clickbench_q01/datafusion:vortex-file-compressed 5802158 / 5820340 / -0.3% 32392725 / 34430262 / -5.9% 0.18 / 0.17 / +6.0%
clickbench_q02/datafusion:vortex-file-compressed 10631583 / 11496970 / -7.5% 48063662 / 45891196 / +4.7% 0.22 / 0.25 / -11.7%
clickbench_q03/datafusion:vortex-file-compressed 13034524 / 13003995 / +0.2% 50868361 / 54803700 / -7.2% 0.26 / 0.24 / +8.0%
clickbench_q04/datafusion:vortex-file-compressed 58480212 / 58472905 / +0.0% 101918255 / 103724785 / -1.7% 0.57 / 0.56 / +1.8%
clickbench_q05/datafusion:vortex-file-compressed 76392230 / 77031989 / -0.8% 128311310 / 125047690 / +2.6% 0.60 / 0.62 / -3.4%
clickbench_q06/datafusion:vortex-file-compressed 1242514 / 1257638 / -1.2% 22933286 / 24233953 / -5.4% 0.05 / 0.05 / +4.4%
clickbench_q07/datafusion:vortex-file-compressed 8865095 / 9296292 / -4.6% 37386871 / 34437099 / +8.6% 0.24 / 0.27 / -12.2%
clickbench_q08/datafusion:vortex-file-compressed 77968198 / 80394358 / -3.0% 124238785 / 132034681 / -5.9% 0.63 / 0.61 / +3.1%
clickbench_q09/datafusion:vortex-file-compressed 174406858 / 173787378 / +0.4% 214246082 / 219142748 / -2.2% 0.81 / 0.79 / +2.7%
clickbench_q10/datafusion:vortex-file-compressed 21608482 / 22376874 / -3.4% 67160994 / 67456636 / -0.4% 0.32 / 0.33 / -3.0%
clickbench_q11/datafusion:vortex-file-compressed 23865771 / 25309519 / -5.7% 70115078 / 70070312 / +0.1% 0.34 / 0.36 / -5.8%
clickbench_q12/datafusion:vortex-file-compressed 73973020 / 72610854 / +1.9% 130344432 / 127935224 / +1.9% 0.57 / 0.57 / -0.0%
clickbench_q13/datafusion:vortex-file-compressed 116190024 / 115490058 / +0.6% 183062596 / 180720153 / +1.3% 0.63 / 0.64 / -0.7%
clickbench_q14/datafusion:vortex-file-compressed 75339105 / 76823066 / -1.9% 128047343 / 132363537 / -3.3% 0.59 / 0.58 / +1.4%
clickbench_q15/datafusion:vortex-file-compressed 64389473 / 64213842 / +0.3% 104271350 / 104308957 / -0.0% 0.62 / 0.62 / +0.3%
clickbench_q16/datafusion:vortex-file-compressed 153754112 / 154686478 / -0.6% 214653634 / 220642247 / -2.7% 0.72 / 0.70 / +2.2%
clickbench_q17/datafusion:vortex-file-compressed 154185776 / 154803828 / -0.4% 232672396 / 237433110 / -2.0% 0.66 / 0.65 / +1.6%
clickbench_q18/datafusion:vortex-file-compressed 291338644 / 296533116 / -1.8% 387093654 / 384440804 / +0.7% 0.75 / 0.77 / -2.4%
clickbench_q19/datafusion:vortex-file-compressed 7139965 / 7510846 / -4.9% 43482096 / 46155199 / -5.8% 0.16 / 0.16 / +0.9%
clickbench_q20/datafusion:vortex-file-compressed 68570448 / 71769418 / -4.5% 246226366 / 240231851 / +2.5% 0.28 / 0.30 / -6.8%
clickbench_q21/datafusion:vortex-file-compressed 78984982 / 79064174 / -0.1% 286631504 / 294795297 / -2.8% 0.28 / 0.27 / +2.7%
clickbench_q22/datafusion:vortex-file-compressed 89736702 / 91891747 / -2.3% 391604768 / 398628142 / -1.8% 0.23 / 0.23 / -0.6%
clickbench_q23/datafusion:vortex-file-compressed 92613333 / 83120851 / +11.4% 🔴 396535291 / 388993465 / +1.9% 0.23 / 0.21 / +9.3%
clickbench_q24/datafusion:vortex-file-compressed 8521814 / 8368272 / +1.8% 62101354 / 64200977 / -3.3% 0.14 / 0.13 / +5.3%
clickbench_q25/datafusion:vortex-file-compressed 18331520 / 19052680 / -3.8% 59730120 / 63985825 / -6.7% 0.31 / 0.30 / +3.1%
clickbench_q26/datafusion:vortex-file-compressed 14281024 / 14974198 / -4.6% 67511902 / 59972562 / +12.6% 🔴 0.21 / 0.25 / -15.3%
clickbench_q27/datafusion:vortex-file-compressed 95961180 / 99537990 / -3.6% 252184139 / 253000931 / -0.3% 0.38 / 0.39 / -3.3%
clickbench_q28/datafusion:vortex-file-compressed 556784308 / 561778048 / -0.9% 646345927 / 636050604 / +1.6% 0.86 / 0.88 / -2.5%
clickbench_q29/datafusion:vortex-file-compressed 24084310 / 24577780 / -2.0% 54127043 / 56415060 / -4.1% 0.44 / 0.44 / +2.1%
clickbench_q30/datafusion:vortex-file-compressed 55780138 / 56153435 / -0.7% 111542937 / 110807459 / +0.7% 0.50 / 0.51 / -1.3%
clickbench_q31/datafusion:vortex-file-compressed 63702978 / 64947858 / -1.9% 159664672 / 158579247 / +0.7% 0.40 / 0.41 / -2.6%
clickbench_q32/datafusion:vortex-file-compressed 296178116 / 296883389 / -0.2% 381835022 / 389889816 / -2.1% 0.78 / 0.76 / +1.9%
clickbench_q33/datafusion:vortex-file-compressed 321972066 / 320385408 / +0.5% 432936358 / 438142149 / -1.2% 0.74 / 0.73 / +1.7%
clickbench_q34/datafusion:vortex-file-compressed 321149141 / 321769294 / -0.2% 430344373 / 431969257 / -0.4% 0.75 / 0.74 / +0.2%
clickbench_q35/datafusion:vortex-file-compressed 56785428 / 58806690 / -3.4% 94077703 / 94884702 / -0.9% 0.60 / 0.62 / -2.6%
clickbench_q36/datafusion:vortex-file-compressed 37076143 / 37482760 / -1.1% 68445195 / 67951196 / +0.7% 0.54 / 0.55 / -1.8%
clickbench_q37/datafusion:vortex-file-compressed 20495346 / 20579131 / -0.4% 46708346 / 49042085 / -4.8% 0.44 / 0.42 / +4.6%
clickbench_q38/datafusion:vortex-file-compressed 12965314 / 12874996 / +0.7% 41961503 / 42480944 / -1.2% 0.31 / 0.30 / +1.9%
clickbench_q39/datafusion:vortex-file-compressed 78091508 / 78803932 / -0.9% 112594604 / 114949815 / -2.0% 0.69 / 0.69 / +1.2%
clickbench_q40/datafusion:vortex-file-compressed 10227384 / 10214140 / +0.1% 36479442 / 37396992 / -2.5% 0.28 / 0.27 / +2.6%
clickbench_q41/datafusion:vortex-file-compressed 9477644 / 9687926 / -2.2% 37367573 / 36467273 / +2.5% 0.25 / 0.27 / -4.5%
clickbench_q42/datafusion:vortex-file-compressed 9747139 / 9885244 / -1.4% 36510821 / 35490051 / +2.9% 0.27 / 0.28 / -4.2%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1243177 / 1245656 / -0.2% 50823684 / 51124033 / -0.6% 0.02 / 0.02 / +0.4%
clickbench_q01/datafusion:parquet 16018269 / 15692404 / +2.1% 74876151 / 67637152 / +10.7% 🔴 0.21 / 0.23 / -7.8%
clickbench_q02/datafusion:parquet 18467198 / 18845077 / -2.0% 81188130 / 80589714 / +0.7% 0.23 / 0.23 / -2.7%
clickbench_q03/datafusion:parquet 16741052 / 16682160 / +0.4% 82113619 / 82659910 / -0.7% 0.20 / 0.20 / +1.0%
clickbench_q04/datafusion:parquet 63560814 / 64017090 / -0.7% 128315130 / 130701283 / -1.8% 0.50 / 0.49 / +1.1%
clickbench_q05/datafusion:parquet 88068692 / 88976680 / -1.0% 158988408 / 157166419 / +1.2% 0.55 / 0.57 / -2.2%
clickbench_q06/datafusion:parquet 1275828 / 1239747 / +2.9% 50899438 / 51203711 / -0.6% 0.03 / 0.02 / +3.5%
clickbench_q07/datafusion:parquet 16873512 / 17023306 / -0.9% 70171129 / 70374083 / -0.3% 0.24 / 0.24 / -0.6%
clickbench_q08/datafusion:parquet 84948839 / 85711310 / -0.9% 170124584 / 169919899 / +0.1% 0.50 / 0.50 / -1.0%
clickbench_q09/datafusion:parquet 187701076 / 187262054 / +0.2% 275833429 / 270303738 / +2.0% 0.68 / 0.69 / -1.8%
clickbench_q10/datafusion:parquet 36236008 / 36492432 / -0.7% 103795296 / 102446937 / +1.3% 0.35 / 0.36 / -2.0%
clickbench_q11/datafusion:parquet 42075176 / 42547427 / -1.1% 113463548 / 113053197 / +0.4% 0.37 / 0.38 / -1.5%
clickbench_q12/datafusion:parquet 95956571 / 96868321 / -0.9% 165022102 / 164275735 / +0.5% 0.58 / 0.59 / -1.4%
clickbench_q13/datafusion:parquet 146647713 / 149850491 / -2.1% 228184336 / 229557249 / -0.6% 0.64 / 0.65 / -1.5%
clickbench_q14/datafusion:parquet 100824762 / 102555534 / -1.7% 173825248 / 176411247 / -1.5% 0.58 / 0.58 / -0.2%
clickbench_q15/datafusion:parquet 71623547 / 71940698 / -0.4% 139216012 / 133290867 / +4.4% 0.51 / 0.54 / -4.7%
clickbench_q16/datafusion:parquet 154645024 / 155916448 / -0.8% 237969028 / 236198592 / +0.7% 0.65 / 0.66 / -1.6%
clickbench_q17/datafusion:parquet 155830640 / 157574523 / -1.1% 234553544 / 239833106 / -2.2% 0.66 / 0.66 / +1.1%
clickbench_q18/datafusion:parquet 307934526 / 309662774 / -0.6% 416494388 / 425962987 / -2.2% 0.74 / 0.73 / +1.7%
clickbench_q19/datafusion:parquet 19169892 / 19652411 / -2.5% 82832502 / 80465755 / +2.9% 0.23 / 0.24 / -5.2%
clickbench_q20/datafusion:parquet 177741873 / 179583922 / -1.0% 299099707 / 296693208 / +0.8% 0.59 / 0.61 / -1.8%
clickbench_q21/datafusion:parquet 171559554 / 175612926 / -2.3% 314897959 / 316936538 / -0.6% 0.54 / 0.55 / -1.7%
clickbench_q22/datafusion:parquet 260329824 / 263735096 / -1.3% 458573200 / 458690298 / -0.0% 0.57 / 0.57 / -1.3%
clickbench_q23/datafusion:parquet 1005962496 / 1011412127 / -0.5% 1199688472 / 1191803783 / +0.7% 0.84 / 0.85 / -1.2%
clickbench_q24/datafusion:parquet 29665356 / 29865726 / -0.7% 91063840 / 90448042 / +0.7% 0.33 / 0.33 / -1.3%
clickbench_q25/datafusion:parquet 35985041 / 36729723 / -2.0% 104311407 / 107216852 / -2.7% 0.34 / 0.34 / +0.7%
clickbench_q26/datafusion:parquet 30365026 / 30455742 / -0.3% 92857083 / 94004933 / -1.2% 0.33 / 0.32 / +0.9%
clickbench_q27/datafusion:parquet 192066909 / 194491750 / -1.2% 307910484 / 308195609 / -0.1% 0.62 / 0.63 / -1.2%
clickbench_q28/datafusion:parquet 619663646 / 616774392 / +0.5% 708134575 / 716423965 / -1.2% 0.88 / 0.86 / +1.6%
clickbench_q29/datafusion:parquet 28605538 / 29405461 / -2.7% 89960596 / 91980922 / -2.2% 0.32 / 0.32 / -0.5%
clickbench_q30/datafusion:parquet 89558228 / 89884247 / -0.4% 171781744 / 175406198 / -2.1% 0.52 / 0.51 / +1.7%
clickbench_q31/datafusion:parquet 103905777 / 103710488 / +0.2% 198341799 / 200902420 / -1.3% 0.52 / 0.52 / +1.5%
clickbench_q32/datafusion:parquet 308002330 / 308281088 / -0.1% 428035983 / 432350786 / -1.0% 0.72 / 0.71 / +0.9%
clickbench_q33/datafusion:parquet 377725341 / 379280948 / -0.4% 474241738 / 479311528 / -1.1% 0.80 / 0.79 / +0.7%
clickbench_q34/datafusion:parquet 377185123 / 378534866 / -0.4% 477993658 / 476914551 / +0.2% 0.79 / 0.79 / -0.6%
clickbench_q35/datafusion:parquet 64200240 / 64049997 / +0.2% 125034889 / 124757386 / +0.2% 0.51 / 0.51 / +0.0%
clickbench_q36/datafusion:parquet 73523967 / 73625056 / -0.1% 137972768 / 137918810 / +0.0% 0.53 / 0.53 / -0.2%
clickbench_q37/datafusion:parquet 35720949 / 35455880 / +0.7% 93324525 / 92046087 / +1.4% 0.38 / 0.39 / -0.6%
clickbench_q38/datafusion:parquet 47448596 / 47990791 / -1.1% 110003843 / 109989916 / +0.0% 0.43 / 0.44 / -1.1%
clickbench_q39/datafusion:parquet 143152846 / 144653944 / -1.0% 210332934 / 212461720 / -1.0% 0.68 / 0.68 / -0.0%
clickbench_q40/datafusion:parquet 19830160 / 20024960 / -1.0% 78351221 / 77752039 / +0.8% 0.25 / 0.26 / -1.7%
clickbench_q41/datafusion:parquet 18663809 / 18936744 / -1.4% 76825197 / 77481894 / -0.8% 0.24 / 0.24 / -0.6%
clickbench_q42/datafusion:parquet 19183613 / 19211888 / -0.1% 75988535 / 75789277 / +0.3% 0.25 / 0.25 / -0.4%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2144427 / 2190198 / -2.1% 25886781 / 24376370 / +6.2% 0.08 / 0.09 / -7.8%
clickbench_q01/duckdb:vortex-file-compressed 7063754 / 7671087 / -7.9% 28846492 / 27888309 / +3.4% 0.24 / 0.28 / -11.0%
clickbench_q02/duckdb:vortex-file-compressed 9066780 / 8976283 / +1.0% 35380070 / 34849502 / +1.5% 0.26 / 0.26 / -0.5%
clickbench_q03/duckdb:vortex-file-compressed 14483866 / 13996670 / +3.5% 47751741 / 48871290 / -2.3% 0.30 / 0.29 / +5.9%
clickbench_q04/duckdb:vortex-file-compressed 57411194 / 56105782 / +2.3% 89726173 / 90249107 / -0.6% 0.64 / 0.62 / +2.9%
clickbench_q05/duckdb:vortex-file-compressed 63806582 / 63612175 / +0.3% 93829081 / 91371904 / +2.7% 0.68 / 0.70 / -2.3%
clickbench_q06/duckdb:vortex-file-compressed 2753662 / 2651884 / +3.8% 32034545 / 29865648 / +7.3% 0.09 / 0.09 / -3.2%
clickbench_q07/duckdb:vortex-file-compressed 9416468 / 9548688 / -1.4% 28973747 / 29921319 / -3.2% 0.33 / 0.32 / +1.8%
clickbench_q08/duckdb:vortex-file-compressed 69925552 / 69383476 / +0.8% 104854637 / 104601594 / +0.2% 0.67 / 0.66 / +0.5%
clickbench_q09/duckdb:vortex-file-compressed 91826894 / 91584652 / +0.3% 125571768 / 128240559 / -2.1% 0.73 / 0.71 / +2.4%
clickbench_q10/duckdb:vortex-file-compressed 27138106 / 27259474 / -0.4% 69619819 / 68593256 / +1.5% 0.39 / 0.40 / -1.9%
clickbench_q11/duckdb:vortex-file-compressed 29518806 / 29707281 / -0.6% 71779496 / 74001326 / -3.0% 0.41 / 0.40 / +2.4%
clickbench_q12/duckdb:vortex-file-compressed 68139490 / 68710368 / -0.8% 99618005 / 99601689 / +0.0% 0.68 / 0.69 / -0.8%
clickbench_q13/duckdb:vortex-file-compressed 117043370 / 115997702 / +0.9% 164293899 / 166663277 / -1.4% 0.71 / 0.70 / +2.4%
clickbench_q14/duckdb:vortex-file-compressed 72566532 / 73203631 / -0.9% 102017211 / 102287920 / -0.3% 0.71 / 0.72 / -0.6%
clickbench_q15/duckdb:vortex-file-compressed 76285532 / 76040314 / +0.3% 108583451 / 107917453 / +0.6% 0.70 / 0.70 / -0.3%
clickbench_q16/duckdb:vortex-file-compressed 134871880 / 133021669 / +1.4% 170070185 / 169754496 / +0.2% 0.79 / 0.78 / +1.2%
clickbench_q17/duckdb:vortex-file-compressed 137653506 / 140259934 / -1.9% 173535443 / 169696930 / +2.3% 0.79 / 0.83 / -4.0%
clickbench_q18/duckdb:vortex-file-compressed 254190506 / 253794516 / +0.2% 300381686 / 302855044 / -0.8% 0.85 / 0.84 / +1.0%
clickbench_q19/duckdb:vortex-file-compressed 8804162 / 8836312 / -0.4% 34419076 / 37945926 / -9.3% 0.26 / 0.23 / +9.8%
clickbench_q20/duckdb:vortex-file-compressed 67186313 / 68059222 / -1.3% 171020718 / 169039339 / +1.2% 0.39 / 0.40 / -2.4%
clickbench_q21/duckdb:vortex-file-compressed 72405938 / 74270321 / -2.5% 182544906 / 179992412 / +1.4% 0.40 / 0.41 / -3.9%
clickbench_q22/duckdb:vortex-file-compressed 108137964 / 107578916 / +0.5% 303872158 / 307732163 / -1.3% 0.36 / 0.35 / +1.8%
clickbench_q23/duckdb:vortex-file-compressed 63989434 / 59023555 / +8.4% 177928371 / 176738477 / +0.7% 0.36 / 0.33 / +7.7%
clickbench_q24/duckdb:vortex-file-compressed 17005512 / 17055953 / -0.3% 40043868 / 46281455 / -13.5% 🟢 0.42 / 0.37 / +15.2%
clickbench_q25/duckdb:vortex-file-compressed 18286672 / 18305306 / -0.1% 55958575 / 53653444 / +4.3% 0.33 / 0.34 / -4.2%
clickbench_q26/duckdb:vortex-file-compressed 13935254 / 13808263 / +0.9% 37933020 / 48280088 / -21.4% 🟢 0.37 / 0.29 / +28.4%
clickbench_q27/duckdb:vortex-file-compressed 50773325 / 49738388 / +2.1% 176627946 / 171988632 / +2.7% 0.29 / 0.29 / -0.6%
clickbench_q28/duckdb:vortex-file-compressed 516826684 / 512193092 / +0.9% 568364159 / 564780918 / +0.6% 0.91 / 0.91 / +0.3%
clickbench_q29/duckdb:vortex-file-compressed 16853146 / 16847118 / +0.0% 39610848 / 41959650 / -5.6% 0.43 / 0.40 / +6.0%
clickbench_q30/duckdb:vortex-file-compressed 58794818 / 60597816 / -3.0% 108095729 / 110765427 / -2.4% 0.54 / 0.55 / -0.6%
clickbench_q31/duckdb:vortex-file-compressed 108343228 / 108106376 / +0.2% 196853535 / 197077106 / -0.1% 0.55 / 0.55 / +0.3%
clickbench_q32/duckdb:vortex-file-compressed 361061406 / 361593436 / -0.1% 389084424 / 395589810 / -1.6% 0.93 / 0.91 / +1.5%
clickbench_q33/duckdb:vortex-file-compressed 350853468 / 341142247 / +2.8% 409813721 / 398205522 / +2.9% 0.86 / 0.86 / -0.1%
clickbench_q34/duckdb:vortex-file-compressed 361367132 / 353644823 / +2.2% 413042052 / 415996334 / -0.7% 0.87 / 0.85 / +2.9%
clickbench_q35/duckdb:vortex-file-compressed 58123096 / 57248786 / +1.5% 86447971 / 89041669 / -2.9% 0.67 / 0.64 / +4.6%
clickbench_q36/duckdb:vortex-file-compressed 11170771 / 10992482 / +1.6% 34315442 / 32355787 / +6.1% 0.33 / 0.34 / -4.2%
clickbench_q37/duckdb:vortex-file-compressed 7642938 / 7474343 / +2.3% 29256936 / 27222245 / +7.5% 0.26 / 0.27 / -4.9%
clickbench_q38/duckdb:vortex-file-compressed 7910537 / 7859862 / +0.6% 30846158 / 28543953 / +8.1% 0.26 / 0.28 / -6.9%
clickbench_q39/duckdb:vortex-file-compressed 17796256 / 17442312 / +2.0% 43316386 / 43265528 / +0.1% 0.41 / 0.40 / +1.9%
clickbench_q40/duckdb:vortex-file-compressed 6899280 / 6859266 / +0.6% 28890082 / 30367085 / -4.9% 0.24 / 0.23 / +5.7%
clickbench_q41/duckdb:vortex-file-compressed 7821802 / 7747810 / +1.0% 29643843 / 29552376 / +0.3% 0.26 / 0.26 / +0.6%
clickbench_q42/duckdb:vortex-file-compressed 6986790 / 7070878 / -1.2% 28279630 / 27790632 / +1.8% 0.25 / 0.25 / -2.9%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9298386 / 9771756 / -4.8% 14481733 / 14129689 / +2.5% 0.64 / 0.69 / -7.2%
clickbench_q01/duckdb:parquet 15011647 / 15271935 / -1.7% 22422807 / 20380566 / +10.0% 🔴 0.67 / 0.75 / -10.7%
clickbench_q02/duckdb:parquet 21736916 / 22325978 / -2.6% 29328814 / 30940492 / -5.2% 0.74 / 0.72 / +2.7%
clickbench_q03/duckdb:parquet 22404860 / 22631064 / -1.0% 34149461 / 33341226 / +2.4% 0.66 / 0.68 / -3.3%
clickbench_q04/duckdb:parquet 60650016 / 60967896 / -0.5% 73648080 / 72108167 / +2.1% 0.82 / 0.85 / -2.6%
clickbench_q05/duckdb:parquet 81382980 / 84405534 / -3.6% 98729259 / 93982128 / +5.1% 0.82 / 0.90 / -8.2%
clickbench_q06/duckdb:parquet 20262034 / 20194358 / +0.3% 29704969 / 26827760 / +10.7% 🔴 0.68 / 0.75 / -9.4%
clickbench_q07/duckdb:parquet 16924758 / 16820707 / +0.6% 23947724 / 23035191 / +4.0% 0.71 / 0.73 / -3.2%
clickbench_q08/duckdb:parquet 74574453 / 75085838 / -0.7% 91705264 / 88981302 / +3.1% 0.81 / 0.84 / -3.6%
clickbench_q09/duckdb:parquet 101881008 / 102926246 / -1.0% 119646045 / 118738084 / +0.8% 0.85 / 0.87 / -1.8%
clickbench_q10/duckdb:parquet 41247094 / 41924156 / -1.6% 58003655 / 54974359 / +5.5% 0.71 / 0.76 / -6.8%
clickbench_q11/duckdb:parquet 46732374 / 46690306 / +0.1% 60547169 / 61056430 / -0.8% 0.77 / 0.76 / +0.9%
clickbench_q12/duckdb:parquet 90715324 / 91885534 / -1.3% 104386729 / 103679219 / +0.7% 0.87 / 0.89 / -1.9%
clickbench_q13/duckdb:parquet 148859038 / 151438892 / -1.7% 166842933 / 170433064 / -2.1% 0.89 / 0.89 / +0.4%
clickbench_q14/duckdb:parquet 100460814 / 100803934 / -0.3% 117433342 / 118970612 / -1.3% 0.86 / 0.85 / +1.0%
clickbench_q15/duckdb:parquet 85280836 / 86391304 / -1.3% 97977220 / 98901228 / -0.9% 0.87 / 0.87 / -0.4%
clickbench_q16/duckdb:parquet 167777262 / 163721156 / +2.5% 177508533 / 177162868 / +0.2% 0.95 / 0.92 / +2.3%
clickbench_q17/duckdb:parquet 164472732 / 161939908 / +1.6% 199890173 / 180603555 / +10.7% 🔴 0.82 / 0.90 / -8.2%
clickbench_q18/duckdb:parquet 296270910 / 296918410 / -0.2% 315934598 / 329007039 / -4.0% 0.94 / 0.90 / +3.9%
clickbench_q19/duckdb:parquet 20079094 / 19623703 / +2.3% 25837636 / 26716228 / -3.3% 0.78 / 0.73 / +5.8%
clickbench_q20/duckdb:parquet 181334540 / 185013432 / -2.0% 237130050 / 231811600 / +2.3% 0.76 / 0.80 / -4.2%
clickbench_q21/duckdb:parquet 217868429 / 215695668 / +1.0% 260344173 / 269966784 / -3.6% 0.84 / 0.80 / +4.7%
clickbench_q22/duckdb:parquet 302407800 / 306219834 / -1.2% 372632507 / 354430357 / +5.1% 0.81 / 0.86 / -6.1%
clickbench_q23/duckdb:parquet 173411790 / 173537270 / -0.1% 249346469 / 246939416 / +1.0% 0.70 / 0.70 / -1.0%
clickbench_q24/duckdb:parquet 29601914 / 30164824 / -1.9% 43517114 / 43818401 / -0.7% 0.68 / 0.69 / -1.2%
clickbench_q25/duckdb:parquet 41058928 / 42903528 / -4.3% 58115581 / 57003128 / +2.0% 0.71 / 0.75 / -6.1%
clickbench_q26/duckdb:parquet 30715254 / 31020799 / -1.0% 38705771 / 44994824 / -14.0% 🟢 0.79 / 0.69 / +15.1%
clickbench_q27/duckdb:parquet 183145118 / 190075376 / -3.6% 226421765 / 236337388 / -4.2% 0.81 / 0.80 / +0.6%
clickbench_q28/duckdb:parquet 953748728 / 951400750 / +0.2% 947177588 / 939316531 / +0.8% 1.01 / 1.01 / -0.6%
clickbench_q29/duckdb:parquet 23793446 / 24466274 / -2.8% 30046631 / 30500061 / -1.5% 0.79 / 0.80 / -1.3%
clickbench_q30/duckdb:parquet 104992939 / 104698386 / +0.3% 125274293 / 125386143 / -0.1% 0.84 / 0.84 / +0.4%
clickbench_q31/duckdb:parquet 158040130 / 145386380 / +8.7% 174430461 / 172231432 / +1.3% 0.91 / 0.84 / +7.3%
clickbench_q32/duckdb:parquet 382499617 / 394754694 / -3.1% 415350562 / 409363351 / +1.5% 0.92 / 0.96 / -4.5%
clickbench_q33/duckdb:parquet 469448740 / 497385918 / -5.6% 454229681 / 453267633 / +0.2% 1.03 / 1.10 / -5.8%
clickbench_q34/duckdb:parquet 472784392 / 474360438 / -0.3% 452390340 / 456893061 / -1.0% 1.05 / 1.04 / +0.7%
clickbench_q35/duckdb:parquet 61337488 / 61389178 / -0.1% 73977932 / 74619132 / -0.9% 0.83 / 0.82 / +0.8%
clickbench_q36/duckdb:parquet 29707449 / 30044144 / -1.1% 35919839 / 36141290 / -0.6% 0.83 / 0.83 / -0.5%
clickbench_q37/duckdb:parquet 22732152 / 23253124 / -2.2% 29584784 / 30470098 / -2.9% 0.77 / 0.76 / +0.7%
clickbench_q38/duckdb:parquet 23324038 / 23447114 / -0.5% 29470471 / 30250527 / -2.6% 0.79 / 0.78 / +2.1%
clickbench_q39/duckdb:parquet 53374533 / 52000846 / +2.6% 60091562 / 59990389 / +0.2% 0.89 / 0.87 / +2.5%
clickbench_q40/duckdb:parquet 14618858 / 15107676 / -3.2% 19898624 / 19892662 / +0.0% 0.73 / 0.76 / -3.3%
clickbench_q41/duckdb:parquet 15580898 / 15495804 / +0.5% 20361026 / 20634787 / -1.3% 0.77 / 0.75 / +1.9%
clickbench_q42/duckdb:parquet 14639494 / 14388934 / +1.7% 20445184 / 20461928 / -0.1% 0.72 / 0.70 / +1.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR b1ca326a vs base d81bd4ce
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35363659 / 35687064 / -0.9% 59607421 / 59727902 / -0.2% 0.59 / 0.60 / -0.7%
tpcds_q02/datafusion:vortex-file-compressed 49169201 / 51071520 / -3.7% 77115319 / 73866370 / +4.4% 0.64 / 0.69 / -7.8%
tpcds_q03/datafusion:vortex-file-compressed 20123516 / 20122918 / +0.0% 44123110 / 45522240 / -3.1% 0.46 / 0.44 / +3.2%
tpcds_q04/datafusion:vortex-file-compressed 292516693 / 294488276 / -0.7% 349217889 / 348826657 / +0.1% 0.84 / 0.84 / -0.8%
tpcds_q05/datafusion:vortex-file-compressed 71330586 / 72186978 / -1.2% 99151705 / 98074801 / +1.1% 0.72 / 0.74 / -2.3%
tpcds_q06/datafusion:vortex-file-compressed 42169404 / 42034562 / +0.3% 68282706 / 71314146 / -4.3% 0.62 / 0.59 / +4.8%
tpcds_q07/datafusion:vortex-file-compressed 42133626 / 41936610 / +0.5% 76913630 / 81598206 / -5.7% 0.55 / 0.51 / +6.6%
tpcds_q08/datafusion:vortex-file-compressed 28202685 / 29293898 / -3.7% 53994770 / 54786660 / -1.4% 0.52 / 0.53 / -2.3%
tpcds_q09/datafusion:vortex-file-compressed 44832106 / 43492521 / +3.1% 72836636 / 75585378 / -3.6% 0.62 / 0.58 / +7.0%
tpcds_q10/datafusion:vortex-file-compressed 37039326 / 37575747 / -1.4% 63405179 / 65187408 / -2.7% 0.58 / 0.58 / +1.3%
tpcds_q11/datafusion:vortex-file-compressed 175191578 / 174078024 / +0.6% 216436402 / 212796053 / +1.7% 0.81 / 0.82 / -1.1%
tpcds_q12/datafusion:vortex-file-compressed 18162888 / 17602241 / +3.2% 36323509 / 36804611 / -1.3% 0.50 / 0.48 / +4.6%
tpcds_q13/datafusion:vortex-file-compressed 39053546 / 37777492 / +3.4% 78372310 / 82427050 / -4.9% 0.50 / 0.46 / +8.7%
tpcds_q14/datafusion:vortex-file-compressed 235459698 / 234215656 / +0.5% 271138534 / 269416137 / +0.6% 0.87 / 0.87 / -0.1%
tpcds_q15/datafusion:vortex-file-compressed 40310226 / 40700370 / -1.0% 58981988 / 59132696 / -0.3% 0.68 / 0.69 / -0.7%
tpcds_q16/datafusion:vortex-file-compressed 23785572 / 24140928 / -1.5% 41987455 / 41799402 / +0.4% 0.57 / 0.58 / -1.9%
tpcds_q17/datafusion:vortex-file-compressed 63689852 / 64613948 / -1.4% 88032239 / 96825489 / -9.1% 0.72 / 0.67 / +8.4%
tpcds_q18/datafusion:vortex-file-compressed 68856537 / 68135038 / +1.1% 95610860 / 96678626 / -1.1% 0.72 / 0.70 / +2.2%
tpcds_q19/datafusion:vortex-file-compressed 22704278 / 23065796 / -1.6% 53666829 / 53499164 / +0.3% 0.42 / 0.43 / -1.9%
tpcds_q20/datafusion:vortex-file-compressed 23552382 / 23434874 / +0.5% 39549839 / 39490521 / +0.2% 0.60 / 0.59 / +0.4%
tpcds_q21/datafusion:vortex-file-compressed 50238306 / 46991756 / +6.9% 63595787 / 77561336 / -18.0% 🟢 0.79 / 0.61 / +30.4%
tpcds_q22/datafusion:vortex-file-compressed 435131490 / 436213066 / -0.2% 457989606 / 456238601 / +0.4% 0.95 / 0.96 / -0.6%
tpcds_q23/datafusion:vortex-file-compressed 294366778 / 295445526 / -0.4% 356697778 / 350238393 / +1.8% 0.83 / 0.84 / -2.2%
tpcds_q24/datafusion:vortex-file-compressed 119286514 / 118209681 / +0.9% 160934460 / 163532003 / -1.6% 0.74 / 0.72 / +2.5%
tpcds_q25/datafusion:vortex-file-compressed 62761193 / 58404091 / +7.5% 98086808 / 100148037 / -2.1% 0.64 / 0.58 / +9.7%
tpcds_q26/datafusion:vortex-file-compressed 37324384 / 37624965 / -0.8% 59431441 / 59590326 / -0.3% 0.63 / 0.63 / -0.5%
tpcds_q27/datafusion:vortex-file-compressed 70873086 / 71638275 / -1.1% 109116213 / 105343615 / +3.6% 0.65 / 0.68 / -4.5%
tpcds_q28/datafusion:vortex-file-compressed 42497565 / 42371952 / +0.3% 90610577 / 87727130 / +3.3% 0.47 / 0.48 / -2.9%
tpcds_q29/datafusion:vortex-file-compressed 64918870 / 66811756 / -2.8% 96963720 / 102564955 / -5.5% 0.67 / 0.65 / +2.8%
tpcds_q30/datafusion:vortex-file-compressed 50445478 / 51119143 / -1.3% 76634641 / 75743723 / +1.2% 0.66 / 0.67 / -2.5%
tpcds_q31/datafusion:vortex-file-compressed 198155722 / 200218175 / -1.0% 230823493 / 233152597 / -1.0% 0.86 / 0.86 / -0.0%
tpcds_q32/datafusion:vortex-file-compressed 15246996 / 15152590 / +0.6% 30910056 / 31036644 / -0.4% 0.49 / 0.49 / +1.0%
tpcds_q33/datafusion:vortex-file-compressed 33501946 / 33166894 / +1.0% 68342279 / 66312007 / +3.1% 0.49 / 0.50 / -2.0%
tpcds_q34/datafusion:vortex-file-compressed 41954440 / 40800963 / +2.8% 65393485 / 69572930 / -6.0% 0.64 / 0.59 / +9.4%
tpcds_q35/datafusion:vortex-file-compressed 92390828 / 92953752 / -0.6% 122926311 / 118717623 / +3.5% 0.75 / 0.78 / -4.0%
tpcds_q36/datafusion:vortex-file-compressed 65750882 / 66188984 / -0.7% 96590733 / 100548488 / -3.9% 0.68 / 0.66 / +3.4%
tpcds_q37/datafusion:vortex-file-compressed 22706712 / 28659362 / -20.8% 🟢 41904273 / 39142184 / +7.1% 0.54 / 0.73 / -26.0%
tpcds_q38/datafusion:vortex-file-compressed 79218079 / 79029305 / +0.2% 106974578 / 106760595 / +0.2% 0.74 / 0.74 / +0.0%
tpcds_q39/datafusion:vortex-file-compressed 887148414 / 884718834 / +0.3% 910884490 / 908976999 / +0.2% 0.97 / 0.97 / +0.1%
tpcds_q40/datafusion:vortex-file-compressed 28669842 / 28530688 / +0.5% 47882602 / 48600430 / -1.5% 0.60 / 0.59 / +2.0%
tpcds_q41/datafusion:vortex-file-compressed 19392837 / 19016106 / +2.0% 31842792 / 31973918 / -0.4% 0.61 / 0.59 / +2.4%
tpcds_q42/datafusion:vortex-file-compressed 14046158 / 14446512 / -2.8% 36484617 / 37086223 / -1.6% 0.38 / 0.39 / -1.2%
tpcds_q43/datafusion:vortex-file-compressed 17041003 / 17062690 / -0.1% 38674784 / 37710185 / +2.6% 0.44 / 0.45 / -2.6%
tpcds_q44/datafusion:vortex-file-compressed 42849812 / 43352470 / -1.2% 68999138 / 72038897 / -4.2% 0.62 / 0.60 / +3.2%
tpcds_q45/datafusion:vortex-file-compressed 43637620 / 44364085 / -1.6% 63050541 / 59556323 / +5.9% 0.69 / 0.74 / -7.1%
tpcds_q46/datafusion:vortex-file-compressed 73304425 / 70145033 / +4.5% 103303717 / 104029608 / -0.7% 0.71 / 0.67 / +5.2%
tpcds_q47/datafusion:vortex-file-compressed 174344564 / 173539465 / +0.5% 219777106 / 216035492 / +1.7% 0.79 / 0.80 / -1.2%
tpcds_q48/datafusion:vortex-file-compressed 35798208 / 35623834 / +0.5% 68897325 / 70644306 / -2.5% 0.52 / 0.50 / +3.0%
tpcds_q49/datafusion:vortex-file-compressed 78351876 / 77255316 / +1.4% 113027306 / 116737222 / -3.2% 0.69 / 0.66 / +4.7%
tpcds_q50/datafusion:vortex-file-compressed 58800620 / 55980736 / +5.0% 86425992 / 86230008 / +0.2% 0.68 / 0.65 / +4.8%
tpcds_q51/datafusion:vortex-file-compressed 244097490 / 247038673 / -1.2% 270868209 / 280421401 / -3.4% 0.90 / 0.88 / +2.3%
tpcds_q52/datafusion:vortex-file-compressed 14354540 / 14714848 / -2.4% 37962298 / 38389598 / -1.1% 0.38 / 0.38 / -1.4%
tpcds_q53/datafusion:vortex-file-compressed 22938410 / 22346742 / +2.6% 49210690 / 49846122 / -1.3% 0.47 / 0.45 / +4.0%
tpcds_q54/datafusion:vortex-file-compressed 59788494 / 57426460 / +4.1% 91955935 / 92580497 / -0.7% 0.65 / 0.62 / +4.8%
tpcds_q55/datafusion:vortex-file-compressed 13709958 / 13973340 / -1.9% 36186820 / 38808883 / -6.8% 0.38 / 0.36 / +5.2%
tpcds_q56/datafusion:vortex-file-compressed 32844732 / 33761524 / -2.7% 62949997 / 63265036 / -0.5% 0.52 / 0.53 / -2.2%
tpcds_q57/datafusion:vortex-file-compressed 131252120 / 131113802 / +0.1% 158722327 / 161410678 / -1.7% 0.83 / 0.81 / +1.8%
tpcds_q58/datafusion:vortex-file-compressed 48558174 / 48391922 / +0.3% 84659370 / 84580372 / +0.1% 0.57 / 0.57 / +0.2%
tpcds_q59/datafusion:vortex-file-compressed 54419510 / 55056536 / -1.2% 83094864 / 81170032 / +2.4% 0.65 / 0.68 / -3.4%
tpcds_q60/datafusion:vortex-file-compressed 33943028 / 34937748 / -2.8% 62974801 / 63120098 / -0.2% 0.54 / 0.55 / -2.6%
tpcds_q61/datafusion:vortex-file-compressed 46350648 / 45353798 / +2.2% 67376433 / 72493548 / -7.1% 0.69 / 0.63 / +10.0%
tpcds_q62/datafusion:vortex-file-compressed 19808434 / 18948984 / +4.5% 40007014 / 40635590 / -1.5% 0.50 / 0.47 / +6.2%
tpcds_q63/datafusion:vortex-file-compressed 22784907 / 22886570 / -0.4% 47372419 / 51245739 / -7.6% 0.48 / 0.45 / +7.7%
tpcds_q64/datafusion:vortex-file-compressed 333069843 / 331770842 / +0.4% 403601050 / 405661127 / -0.5% 0.83 / 0.82 / +0.9%
tpcds_q65/datafusion:vortex-file-compressed 74920231 / 74188341 / +1.0% 113271084 / 106874319 / +6.0% 0.66 / 0.69 / -4.7%
tpcds_q66/datafusion:vortex-file-compressed 52042762 / 51726748 / +0.6% 75243157 / 75217399 / +0.0% 0.69 / 0.69 / +0.6%
tpcds_q67/datafusion:vortex-file-compressed 416894908 / 425404384 / -2.0% 518578955 / 518487417 / +0.0% 0.80 / 0.82 / -2.0%
tpcds_q68/datafusion:vortex-file-compressed 66076315 / 67065476 / -1.5% 96774977 / 99957636 / -3.2% 0.68 / 0.67 / +1.8%
tpcds_q69/datafusion:vortex-file-compressed 36499740 / 36411572 / +0.2% 63927385 / 61245093 / +4.4% 0.57 / 0.59 / -4.0%
tpcds_q70/datafusion:vortex-file-compressed 194184886 / 195234258 / -0.5% 227805730 / 223353634 / +2.0% 0.85 / 0.87 / -2.5%
tpcds_q71/datafusion:vortex-file-compressed 26049626 / 24846620 / +4.8% 53394793 / 57873035 / -7.7% 0.49 / 0.43 / +13.6%
tpcds_q72/datafusion:vortex-file-compressed 1597161312 / 1613070819 / -1.0% 1725474854 / 1672817704 / +3.1% 0.93 / 0.96 / -4.0%
tpcds_q73/datafusion:vortex-file-compressed 38515441 / 37798150 / +1.9% 62948277 / 63097488 / -0.2% 0.61 / 0.60 / +2.1%
tpcds_q74/datafusion:vortex-file-compressed 134400054 / 134609600 / -0.2% 169341914 / 169107950 / +0.1% 0.79 / 0.80 / -0.3%
tpcds_q75/datafusion:vortex-file-compressed 157003884 / 157283038 / -0.2% 190595066 / 199539779 / -4.5% 0.82 / 0.79 / +4.5%
tpcds_q76/datafusion:vortex-file-compressed 33583724 / 34141944 / -1.6% 72175751 / 76790189 / -6.0% 0.47 / 0.44 / +4.7%
tpcds_q77/datafusion:vortex-file-compressed 54995390 / 54578544 / +0.8% 88919739 / 87907886 / +1.2% 0.62 / 0.62 / -0.4%
tpcds_q78/datafusion:vortex-file-compressed 140810875 / 139945221 / +0.6% 190374135 / 191111158 / -0.4% 0.74 / 0.73 / +1.0%
tpcds_q79/datafusion:vortex-file-compressed 54299942 / 54551104 / -0.5% 82074270 / 83695427 / -1.9% 0.66 / 0.65 / +1.5%
tpcds_q80/datafusion:vortex-file-compressed 80255688 / 81251883 / -1.2% 124860768 / 126092347 / -1.0% 0.64 / 0.64 / -0.3%
tpcds_q81/datafusion:vortex-file-compressed 56128354 / 57217203 / -1.9% 81563785 / 83290839 / -2.1% 0.69 / 0.69 / +0.2%
tpcds_q82/datafusion:vortex-file-compressed 30946630 / 29527786 / +4.8% 44784952 / 46344112 / -3.4% 0.69 / 0.64 / +8.5%
tpcds_q83/datafusion:vortex-file-compressed 42179558 / 42234106 / -0.1% 64729374 / 65316165 / -0.9% 0.65 / 0.65 / +0.8%
tpcds_q84/datafusion:vortex-file-compressed 12294494 / 12318387 / -0.2% 31154510 / 31461444 / -1.0% 0.39 / 0.39 / +0.8%
tpcds_q85/datafusion:vortex-file-compressed 61124452 / 60351388 / +1.3% 84781554 / 89165946 / -4.9% 0.72 / 0.68 / +6.5%
tpcds_q86/datafusion:vortex-file-compressed 19109013 / 18635084 / +2.5% 38301427 / 40794939 / -6.1% 0.50 / 0.46 / +9.2%
tpcds_q87/datafusion:vortex-file-compressed 78461908 / 77726270 / +0.9% 105699965 / 106793331 / -1.0% 0.74 / 0.73 / +2.0%
tpcds_q88/datafusion:vortex-file-compressed 53306444 / 54134854 / -1.5% 90161545 / 91920123 / -1.9% 0.59 / 0.59 / +0.4%
tpcds_q89/datafusion:vortex-file-compressed 26287502 / 27705445 / -5.1% 52512407 / 52989044 / -0.9% 0.50 / 0.52 / -4.3%
tpcds_q90/datafusion:vortex-file-compressed 13393642 / 12876262 / +4.0% 34401917 / 31193191 / +10.3% 🔴 0.39 / 0.41 / -5.7%
tpcds_q91/datafusion:vortex-file-compressed 19299334 / 19841934 / -2.7% 41264308 / 40517298 / +1.8% 0.47 / 0.49 / -4.5%
tpcds_q92/datafusion:vortex-file-compressed 15559946 / 15586140 / -0.2% 34671655 / 35022452 / -1.0% 0.45 / 0.45 / +0.8%
tpcds_q93/datafusion:vortex-file-compressed 56550729 / 54479092 / +3.8% 91211765 / 91110634 / +0.1% 0.62 / 0.60 / +3.7%
tpcds_q94/datafusion:vortex-file-compressed 21354206 / 21721248 / -1.7% 42161396 / 43008447 / -2.0% 0.51 / 0.51 / +0.3%
tpcds_q95/datafusion:vortex-file-compressed 93487776 / 96025348 / -2.6% 123292649 / 125556657 / -1.8% 0.76 / 0.76 / -0.9%
tpcds_q96/datafusion:vortex-file-compressed 11505661 / 11669502 / -1.4% 30697896 / 29013229 / +5.8% 0.37 / 0.40 / -6.8%
tpcds_q97/datafusion:vortex-file-compressed 38721244 / 39740562 / -2.6% 63988101 / 64433312 / -0.7% 0.61 / 0.62 / -1.9%
tpcds_q98/datafusion:vortex-file-compressed 20365041 / 20279683 / +0.4% 48421378 / 49580667 / -2.3% 0.42 / 0.41 / +2.8%
tpcds_q99/datafusion:vortex-file-compressed 29329354 / 28990486 / +1.2% 48529576 / 46237709 / +5.0% 0.60 / 0.63 / -3.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59956935 / 59467470 / +0.8% 77064561 / 78629990 / -2.0% 0.78 / 0.76 / +2.9%
tpcds_q02/datafusion:parquet 68848331 / 68841136 / +0.0% 92008924 / 92247774 / -0.3% 0.75 / 0.75 / +0.3%
tpcds_q03/datafusion:parquet 27823298 / 28412717 / -2.1% 47123906 / 51484914 / -8.5% 0.59 / 0.55 / +7.0%
tpcds_q04/datafusion:parquet 640137788 / 642280600 / -0.3% 707189080 / 713442164 / -0.9% 0.91 / 0.90 / +0.5%
tpcds_q05/datafusion:parquet 83101772 / 80587203 / +3.1% 117151301 / 114099796 / +2.7% 0.71 / 0.71 / +0.4%
tpcds_q06/datafusion:parquet 90784939 / 91299202 / -0.6% 111795088 / 111123421 / +0.6% 0.81 / 0.82 / -1.2%
tpcds_q07/datafusion:parquet 101420805 / 100516129 / +0.9% 130549458 / 140439595 / -7.0% 0.78 / 0.72 / +8.5%
tpcds_q08/datafusion:parquet 47348099 / 47906314 / -1.2% 76314410 / 77683939 / -1.8% 0.62 / 0.62 / +0.6%
tpcds_q09/datafusion:parquet 76675622 / 75858005 / +1.1% 107799539 / 103150303 / +4.5% 0.71 / 0.74 / -3.3%
tpcds_q10/datafusion:parquet 58618246 / 59911058 / -2.2% 88877881 / 85891230 / +3.5% 0.66 / 0.70 / -5.4%
tpcds_q11/datafusion:parquet 412553829 / 410249982 / +0.6% 454340640 / 453298906 / +0.2% 0.91 / 0.91 / +0.3%
tpcds_q12/datafusion:parquet 40092634 / 40180548 / -0.2% 56780939 / 57554919 / -1.3% 0.71 / 0.70 / +1.1%
tpcds_q13/datafusion:parquet 85649073 / 84877392 / +0.9% 128282546 / 129583250 / -1.0% 0.67 / 0.66 / +1.9%
tpcds_q14/datafusion:parquet 382879519 / 390641226 / -2.0% 409754883 / 422522225 / -3.0% 0.93 / 0.92 / +1.1%
tpcds_q15/datafusion:parquet 50416612 / 51004075 / -1.2% 70441392 / 70096169 / +0.5% 0.72 / 0.73 / -1.6%
tpcds_q16/datafusion:parquet 45644233 / 45319756 / +0.7% 61034100 / 62344760 / -2.1% 0.75 / 0.73 / +2.9%
tpcds_q17/datafusion:parquet 136316186 / 140124091 / -2.7% 164570410 / 173293414 / -5.0% 0.83 / 0.81 / +2.4%
tpcds_q18/datafusion:parquet 110524278 / 110049167 / +0.4% 139425343 / 141644863 / -1.6% 0.79 / 0.78 / +2.0%
tpcds_q19/datafusion:parquet 48467466 / 47382432 / +2.3% 74612580 / 74454407 / +0.2% 0.65 / 0.64 / +2.1%
tpcds_q20/datafusion:parquet 41391308 / 41140804 / +0.6% 53865986 / 53422774 / +0.8% 0.77 / 0.77 / -0.2%
tpcds_q21/datafusion:parquet 61243118 / 60585280 / +1.1% 72443702 / 72359261 / +0.1% 0.85 / 0.84 / +1.0%
tpcds_q22/datafusion:parquet 462582762 / 464956066 / -0.5% 479814948 / 480116418 / -0.1% 0.96 / 0.97 / -0.4%
tpcds_q23/datafusion:parquet 365092098 / 362030230 / +0.8% 420793150 / 423236940 / -0.6% 0.87 / 0.86 / +1.4%
tpcds_q24/datafusion:parquet 242918984 / 238522424 / +1.8% 282659340 / 280988941 / +0.6% 0.86 / 0.85 / +1.2%
tpcds_q25/datafusion:parquet 146169436 / 145856299 / +0.2% 181453573 / 180939258 / +0.3% 0.81 / 0.81 / -0.1%
tpcds_q26/datafusion:parquet 54684092 / 54371764 / +0.6% 76213682 / 78855738 / -3.4% 0.72 / 0.69 / +4.1%
tpcds_q27/datafusion:parquet 205955023 / 208670172 / -1.3% 247112557 / 244008894 / +1.3% 0.83 / 0.86 / -2.5%
tpcds_q28/datafusion:parquet 85764386 / 88438947 / -3.0% 119661428 / 115489704 / +3.6% 0.72 / 0.77 / -6.4%
tpcds_q29/datafusion:parquet 142851044 / 143202262 / -0.2% 173958972 / 175795941 / -1.0% 0.82 / 0.81 / +0.8%
tpcds_q30/datafusion:parquet 99862484 / 99031156 / +0.8% 117559701 / 119707182 / -1.8% 0.85 / 0.83 / +2.7%
tpcds_q31/datafusion:parquet 318255971 / 318865238 / -0.2% 342170460 / 342248409 / -0.0% 0.93 / 0.93 / -0.2%
tpcds_q32/datafusion:parquet 28278793 / 29268206 / -3.4% 46900565 / 43049951 / +8.9% 0.60 / 0.68 / -11.3%
tpcds_q33/datafusion:parquet 52021462 / 54279188 / -4.2% 75332314 / 73291711 / +2.8% 0.69 / 0.74 / -6.8%
tpcds_q34/datafusion:parquet 63111660 / 62880984 / +0.4% 85310064 / 85677254 / -0.4% 0.74 / 0.73 / +0.8%
tpcds_q35/datafusion:parquet 125198869 / 124024507 / +0.9% 159520550 / 152510309 / +4.6% 0.78 / 0.81 / -3.5%
tpcds_q36/datafusion:parquet 97673712 / 96065436 / +1.7% 128747716 / 130472892 / -1.3% 0.76 / 0.74 / +3.0%
tpcds_q37/datafusion:parquet 49813128 / 50326967 / -1.0% 64379584 / 62106792 / +3.7% 0.77 / 0.81 / -4.5%
tpcds_q38/datafusion:parquet 123018620 / 121809162 / +1.0% 145079893 / 148143097 / -2.1% 0.85 / 0.82 / +3.1%
tpcds_q39/datafusion:parquet 847454464 / 850365260 / -0.3% 877219939 / 858244795 / +2.2% 0.97 / 0.99 / -2.5%
tpcds_q40/datafusion:parquet 34957556 / 34460206 / +1.4% 53669167 / 55082629 / -2.6% 0.65 / 0.63 / +4.1%
tpcds_q41/datafusion:parquet 32458655 / 32074791 / +1.2% 42021467 / 42604832 / -1.4% 0.77 / 0.75 / +2.6%
tpcds_q42/datafusion:parquet 25833010 / 26668796 / -3.1% 44615558 / 44471155 / +0.3% 0.58 / 0.60 / -3.4%
tpcds_q43/datafusion:parquet 26824122 / 27798290 / -3.5% 48385210 / 48667153 / -0.6% 0.55 / 0.57 / -2.9%
tpcds_q44/datafusion:parquet 64609439 / 66005414 / -2.1% 84084550 / 85489645 / -1.6% 0.77 / 0.77 / -0.5%
tpcds_q45/datafusion:parquet 64267662 / 66367192 / -3.2% 86881591 / 87700095 / -0.9% 0.74 / 0.76 / -2.3%
tpcds_q46/datafusion:parquet 107768875 / 108262468 / -0.5% 149145999 / 147281576 / +1.3% 0.72 / 0.74 / -1.7%
tpcds_q47/datafusion:parquet 236849236 / 235616338 / +0.5% 265626165 / 274771942 / -3.3% 0.89 / 0.86 / +4.0%
tpcds_q48/datafusion:parquet 77645994 / 79003310 / -1.7% 109879704 / 104369134 / +5.3% 0.71 / 0.76 / -6.6%
tpcds_q49/datafusion:parquet 114967812 / 117557337 / -2.2% 160067590 / 168445239 / -5.0% 0.72 / 0.70 / +2.9%
tpcds_q50/datafusion:parquet 92112020 / 91455979 / +0.7% 123469069 / 121449330 / +1.7% 0.75 / 0.75 / -0.9%
tpcds_q51/datafusion:parquet 256494689 / 257462208 / -0.4% 278380907 / 275612309 / +1.0% 0.92 / 0.93 / -1.4%
tpcds_q52/datafusion:parquet 26927525 / 26582131 / +1.3% 43560042 / 46713825 / -6.8% 0.62 / 0.57 / +8.6%
tpcds_q53/datafusion:parquet 35990728 / 35857856 / +0.4% 57107598 / 60285453 / -5.3% 0.63 / 0.59 / +6.0%
tpcds_q54/datafusion:parquet 86216180 / 84979193 / +1.5% 109127283 / 106622915 / +2.3% 0.79 / 0.80 / -0.9%
tpcds_q55/datafusion:parquet 26361454 / 25716791 / +2.5% 44585498 / 47255907 / -5.7% 0.59 / 0.54 / +8.6%
tpcds_q56/datafusion:parquet 52904226 / 52634930 / +0.5% 73296847 / 72550483 / +1.0% 0.72 / 0.73 / -0.5%
tpcds_q57/datafusion:parquet 170549881 / 171481192 / -0.5% 194812633 / 193556759 / +0.6% 0.88 / 0.89 / -1.2%
tpcds_q58/datafusion:parquet 96111876 / 97417717 / -1.3% 123323278 / 116545953 / +5.8% 0.78 / 0.84 / -6.8%
tpcds_q59/datafusion:parquet 103271922 / 105187850 / -1.8% 128368801 / 128553486 / -0.1% 0.80 / 0.82 / -1.7%
tpcds_q60/datafusion:parquet 54304535 / 53716710 / +1.1% 74741984 / 72468178 / +3.1% 0.73 / 0.74 / -2.0%
tpcds_q61/datafusion:parquet 79131120 / 74726424 / +5.9% 100216928 / 100897235 / -0.7% 0.79 / 0.74 / +6.6%
tpcds_q62/datafusion:parquet 27532522 / 27394960 / +0.5% 43759667 / 44704350 / -2.1% 0.63 / 0.61 / +2.7%
tpcds_q63/datafusion:parquet 36236136 / 36109236 / +0.4% 57034761 / 58190337 / -2.0% 0.64 / 0.62 / +2.4%
tpcds_q64/datafusion:parquet 663947462 / 658028547 / +0.9% 735373435 / 727112413 / +1.1% 0.90 / 0.90 / -0.2%
tpcds_q65/datafusion:parquet 102587484 / 100883629 / +1.7% 135451556 / 133391313 / +1.5% 0.76 / 0.76 / +0.1%
tpcds_q66/datafusion:parquet 77464383 / 77524761 / -0.1% 99606403 / 104064088 / -4.3% 0.78 / 0.74 / +4.4%
tpcds_q67/datafusion:parquet 431836404 / 432898548 / -0.2% 500050528 / 500774321 / -0.1% 0.86 / 0.86 / -0.1%
tpcds_q68/datafusion:parquet 108078868 / 107972369 / +0.1% 153435493 / 153393827 / +0.0% 0.70 / 0.70 / +0.1%
tpcds_q69/datafusion:parquet 61641398 / 59031088 / +4.4% 84231511 / 81368763 / +3.5% 0.73 / 0.73 / +0.9%
tpcds_q70/datafusion:parquet 211225608 / 211356872 / -0.1% 240519158 / 243628971 / -1.3% 0.88 / 0.87 / +1.2%
tpcds_q71/datafusion:parquet 39252596 / 39988372 / -1.8% 61854606 / 63580905 / -2.7% 0.63 / 0.63 / +0.9%
tpcds_q72/datafusion:parquet 1822068824 / 1766291258 / +3.2% 1777463208 / 1717685799 / +3.5% 1.03 / 1.03 / -0.3%
tpcds_q73/datafusion:parquet 63113083 / 62604856 / +0.8% 86788036 / 85382876 / +1.6% 0.73 / 0.73 / -0.8%
tpcds_q74/datafusion:parquet 292902280 / 293543952 / -0.2% 320061940 / 333014708 / -3.9% 0.92 / 0.88 / +3.8%
tpcds_q75/datafusion:parquet 192027830 / 195570109 / -1.8% 237404884 / 227532670 / +4.3% 0.81 / 0.86 / -5.9%
tpcds_q76/datafusion:parquet 50168362 / 50790492 / -1.2% 78509543 / 80279383 / -2.2% 0.64 / 0.63 / +1.0%
tpcds_q77/datafusion:parquet 71234562 / 71696114 / -0.6% 101555233 / 102466534 / -0.9% 0.70 / 0.70 / +0.2%
tpcds_q78/datafusion:parquet 212119294 / 210078458 / +1.0% 258961831 / 262635746 / -1.4% 0.82 / 0.80 / +2.4%
tpcds_q79/datafusion:parquet 76844142 / 78772706 / -2.4% 117050482 / 113848428 / +2.8% 0.66 / 0.69 / -5.1%
tpcds_q80/datafusion:parquet 145044838 / 143215239 / +1.3% 191539877 / 198385628 / -3.5% 0.76 / 0.72 / +4.9%
tpcds_q81/datafusion:parquet 107098947 / 108666647 / -1.4% 126530617 / 126675306 / -0.1% 0.85 / 0.86 / -1.3%
tpcds_q82/datafusion:parquet 54068078 / 54589676 / -1.0% 68599019 / 72577165 / -5.5% 0.79 / 0.75 / +4.8%
tpcds_q83/datafusion:parquet 66230020 / 66004765 / +0.3% 83839372 / 80766410 / +3.8% 0.79 / 0.82 / -3.3%
tpcds_q84/datafusion:parquet 35473297 / 35067368 / +1.2% 48401856 / 49217980 / -1.7% 0.73 / 0.71 / +2.9%
tpcds_q85/datafusion:parquet 105895623 / 106118258 / -0.2% 129836316 / 126965208 / +2.3% 0.82 / 0.84 / -2.4%
tpcds_q86/datafusion:parquet 21970639 / 21856744 / +0.5% 38764576 / 38801034 / -0.1% 0.57 / 0.56 / +0.6%
tpcds_q87/datafusion:parquet 119864840 / 121427887 / -1.3% 144746044 / 146352765 / -1.1% 0.83 / 0.83 / -0.2%
tpcds_q88/datafusion:parquet 83883388 / 85112720 / -1.4% 107365844 / 111247316 / -3.5% 0.78 / 0.77 / +2.1%
tpcds_q89/datafusion:parquet 39393032 / 38253917 / +3.0% 61991596 / 64696968 / -4.2% 0.64 / 0.59 / +7.5%
tpcds_q90/datafusion:parquet 17910586 / 17095194 / +4.8% 30640624 / 32500458 / -5.7% 0.58 / 0.53 / +11.1%
tpcds_q91/datafusion:parquet 42472876 / 41649029 / +2.0% 57994949 / 57973405 / +0.0% 0.73 / 0.72 / +1.9%
tpcds_q92/datafusion:parquet 28406208 / 28701521 / -1.0% 46821961 / 45914012 / +2.0% 0.61 / 0.63 / -2.9%
tpcds_q93/datafusion:parquet 62374598 / 61105564 / +2.1% 90066979 / 86368626 / +4.3% 0.69 / 0.71 / -2.1%
tpcds_q94/datafusion:parquet 38527668 / 38133748 / +1.0% 56419101 / 57944474 / -2.6% 0.68 / 0.66 / +3.8%
tpcds_q95/datafusion:parquet 123544242 / 129222804 / -4.4% 153426609 / 153739120 / -0.2% 0.81 / 0.84 / -4.2%
tpcds_q96/datafusion:parquet 20348336 / 21737938 / -6.4% 37312492 / 38315607 / -2.6% 0.55 / 0.57 / -3.9%
tpcds_q97/datafusion:parquet 55163470 / 54900939 / +0.5% 79135981 / 80044710 / -1.1% 0.70 / 0.69 / +1.6%
tpcds_q98/datafusion:parquet 61821948 / 62068014 / -0.4% 84768844 / 84935164 / -0.2% 0.73 / 0.73 / -0.2%
tpcds_q99/datafusion:parquet 42933336 / 42547334 / +0.9% 57553655 / 57947364 / -0.7% 0.75 / 0.73 / +1.6%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32691592 / 32666622 / +0.1% 44403968 / 44442032 / -0.1% 0.74 / 0.74 / +0.2%
tpcds_q02/duckdb:vortex-file-compressed 30000502 / 31019078 / -3.3% 42974080 / 42210494 / +1.8% 0.70 / 0.73 / -5.0%
tpcds_q03/duckdb:vortex-file-compressed 13806932 / 13791742 / +0.1% 29265598 / 29378226 / -0.4% 0.47 / 0.47 / +0.5%
tpcds_q04/duckdb:vortex-file-compressed 130653294 / 129471634 / +0.9% 152794950 / 151903616 / +0.6% 0.86 / 0.85 / +0.3%
tpcds_q05/duckdb:vortex-file-compressed 53993924 / 54650877 / -1.2% 79495089 / 73147246 / +8.7% 0.68 / 0.75 / -9.1%
tpcds_q06/duckdb:vortex-file-compressed 58669790 / 58713689 / -0.1% 77272494 / 75959131 / +1.7% 0.76 / 0.77 / -1.8%
tpcds_q07/duckdb:vortex-file-compressed 30294844 / 30579528 / -0.9% 53046234 / 52049505 / +1.9% 0.57 / 0.59 / -2.8%
tpcds_q08/duckdb:vortex-file-compressed 31210756 / 30914874 / +1.0% 40987300 / 40665146 / +0.8% 0.76 / 0.76 / +0.2%
tpcds_q09/duckdb:vortex-file-compressed 56385434 / 56913068 / -0.9% 76266494 / 74998255 / +1.7% 0.74 / 0.76 / -2.6%
tpcds_q10/duckdb:vortex-file-compressed 39791628 / 39635552 / +0.4% 56771034 / 57816076 / -1.8% 0.70 / 0.69 / +2.2%
tpcds_q11/duckdb:vortex-file-compressed 95919872 / 95253860 / +0.7% 115005593 / 113706380 / +1.1% 0.83 / 0.84 / -0.4%
tpcds_q12/duckdb:vortex-file-compressed 17716132 / 17712503 / +0.0% 29632400 / 29984002 / -1.2% 0.60 / 0.59 / +1.2%
tpcds_q13/duckdb:vortex-file-compressed 38608632 / 37991460 / +1.6% 68649621 / 69301429 / -0.9% 0.56 / 0.55 / +2.6%
tpcds_q14/duckdb:vortex-file-compressed 118741503 / 121384720 / -2.2% 132944969 / 134734274 / -1.3% 0.89 / 0.90 / -0.9%
tpcds_q15/duckdb:vortex-file-compressed 60553199 / 61299576 / -1.2% 69366863 / 72388428 / -4.2% 0.87 / 0.85 / +3.1%
tpcds_q16/duckdb:vortex-file-compressed 34467566 / 34690472 / -0.6% 52714652 / 52266117 / +0.9% 0.65 / 0.66 / -1.5%
tpcds_q17/duckdb:vortex-file-compressed 58007914 / 57332318 / +1.2% 77959237 / 79066911 / -1.4% 0.74 / 0.73 / +2.6%
tpcds_q18/duckdb:vortex-file-compressed 82516320 / 82923020 / -0.5% 101771701 / 101023706 / +0.7% 0.81 / 0.82 / -1.2%
tpcds_q19/duckdb:vortex-file-compressed 45063128 / 43597316 / +3.4% 60744576 / 62263780 / -2.4% 0.74 / 0.70 / +5.9%
tpcds_q20/duckdb:vortex-file-compressed 22166957 / 22262395 / -0.4% 36138974 / 35610939 / +1.5% 0.61 / 0.63 / -1.9%
tpcds_q21/duckdb:vortex-file-compressed 34975985 / 34748561 / +0.7% 62857158 / 61670816 / +1.9% 0.56 / 0.56 / -1.2%
tpcds_q22/duckdb:vortex-file-compressed 159811438 / 161348692 / -1.0% 170477955 / 172593381 / -1.2% 0.94 / 0.93 / +0.3%
tpcds_q23/duckdb:vortex-file-compressed 181447394 / 183560942 / -1.2% 194080992 / 197879336 / -1.9% 0.93 / 0.93 / +0.8%
tpcds_q24/duckdb:vortex-file-compressed 51966597 / 52262054 / -0.6% 71755681 / 70571615 / +1.7% 0.72 / 0.74 / -2.2%
tpcds_q25/duckdb:vortex-file-compressed 53143599 / 52927888 / +0.4% 73101707 / 72882457 / +0.3% 0.73 / 0.73 / +0.1%
tpcds_q26/duckdb:vortex-file-compressed 28205915 / 26933009 / +4.7% 45331582 / 40955560 / +10.7% 🔴 0.62 / 0.66 / -5.4%
tpcds_q27/duckdb:vortex-file-compressed 31360755 / 32187006 / -2.6% 51273226 / 51949183 / -1.3% 0.61 / 0.62 / -1.3%
tpcds_q28/duckdb:vortex-file-compressed 42417548 / 42552663 / -0.3% 63597784 / 61657569 / +3.1% 0.67 / 0.69 / -3.4%
tpcds_q29/duckdb:vortex-file-compressed 52078359 / 52233606 / -0.3% 72980658 / 71810623 / +1.6% 0.71 / 0.73 / -1.9%
tpcds_q30/duckdb:vortex-file-compressed 37615028 / 38885226 / -3.3% 51743534 / 50464856 / +2.5% 0.73 / 0.77 / -5.7%
tpcds_q31/duckdb:vortex-file-compressed 38004465 / 38098196 / -0.2% 52567878 / 53564287 / -1.9% 0.72 / 0.71 / +1.6%
tpcds_q32/duckdb:vortex-file-compressed 13971656 / 13744550 / +1.7% 29658478 / 29352103 / +1.0% 0.47 / 0.47 / +0.6%
tpcds_q33/duckdb:vortex-file-compressed 34891587 / 34677902 / +0.6% 57074071 / 56234127 / +1.5% 0.61 / 0.62 / -0.9%
tpcds_q34/duckdb:vortex-file-compressed 22363400 / 22969670 / -2.6% 38720066 / 38109259 / +1.6% 0.58 / 0.60 / -4.2%
tpcds_q35/duckdb:vortex-file-compressed 66193333 / 67973400 / -2.6% 87313638 / 87774818 / -0.5% 0.76 / 0.77 / -2.1%
tpcds_q36/duckdb:vortex-file-compressed 28933302 / 29798050 / -2.9% 45419333 / 50744981 / -10.5% 🟢 0.64 / 0.59 / +8.5%
tpcds_q37/duckdb:vortex-file-compressed 27328047 / 27056984 / +1.0% 62210259 / 63501341 / -2.0% 0.44 / 0.43 / +3.1%
tpcds_q38/duckdb:vortex-file-compressed 62021962 / 65418466 / -5.2% 72665582 / 79214533 / -8.3% 0.85 / 0.83 / +3.4%
tpcds_q39/duckdb:vortex-file-compressed 58014284 / 59507598 / -2.5% 85201155 / 85059050 / +0.2% 0.68 / 0.70 / -2.7%
tpcds_q40/duckdb:vortex-file-compressed 19090263 / 18871024 / +1.2% 34584826 / 33673544 / +2.7% 0.55 / 0.56 / -1.5%
tpcds_q41/duckdb:vortex-file-compressed 19579324 / 19805286 / -1.1% 27146788 / 29362971 / -7.5% 0.72 / 0.67 / +6.9%
tpcds_q42/duckdb:vortex-file-compressed 14553552 / 13899774 / +4.7% 29588907 / 29210586 / +1.3% 0.49 / 0.48 / +3.4%
tpcds_q43/duckdb:vortex-file-compressed 19475666 / 19246490 / +1.2% 33093970 / 32560191 / +1.6% 0.59 / 0.59 / -0.4%
tpcds_q44/duckdb:vortex-file-compressed 28016316 / 28025286 / -0.0% 48193316 / 48655091 / -0.9% 0.58 / 0.58 / +0.9%
tpcds_q45/duckdb:vortex-file-compressed 46492372 / 47072534 / -1.2% 58795876 / 59554822 / -1.3% 0.79 / 0.79 / +0.0%
tpcds_q46/duckdb:vortex-file-compressed 51782223 / 50438530 / +2.7% 75591035 / 74694605 / +1.2% 0.69 / 0.68 / +1.4%
tpcds_q47/duckdb:vortex-file-compressed 80675096 / 80023928 / +0.8% 95676114 / 94571206 / +1.2% 0.84 / 0.85 / -0.4%
tpcds_q48/duckdb:vortex-file-compressed 53841782 / 54686811 / -1.5% 77500734 / 74230374 / +4.4% 0.69 / 0.74 / -5.7%
tpcds_q49/duckdb:vortex-file-compressed 38292944 / 37594846 / +1.9% 71992629 / 74467492 / -3.3% 0.53 / 0.50 / +5.4%
tpcds_q50/duckdb:vortex-file-compressed 31682254 / 32781100 / -3.4% 54459781 / 53162237 / +2.4% 0.58 / 0.62 / -5.7%
tpcds_q51/duckdb:vortex-file-compressed 204926581 / 203964206 / +0.5% 217328839 / 219753980 / -1.1% 0.94 / 0.93 / +1.6%
tpcds_q52/duckdb:vortex-file-compressed 15157660 / 14677496 / +3.3% 31684514 / 31526862 / +0.5% 0.48 / 0.47 / +2.8%
tpcds_q53/duckdb:vortex-file-compressed 22302243 / 22186665 / +0.5% 37199212 / 37074470 / +0.3% 0.60 / 0.60 / +0.2%
tpcds_q54/duckdb:vortex-file-compressed 44435354 / 44656646 / -0.5% 64790467 / 64461201 / +0.5% 0.69 / 0.69 / -1.0%
tpcds_q55/duckdb:vortex-file-compressed 14492952 / 14576306 / -0.6% 30906796 / 29207984 / +5.8% 0.47 / 0.50 / -6.0%
tpcds_q56/duckdb:vortex-file-compressed 33393316 / 33782552 / -1.2% 55932039 / 55297615 / +1.1% 0.60 / 0.61 / -2.3%
tpcds_q57/duckdb:vortex-file-compressed 64030931 / 65424170 / -2.1% 82994406 / 78631941 / +5.5% 0.77 / 0.83 / -7.3%
tpcds_q58/duckdb:vortex-file-compressed 37048496 / 38898298 / -4.8% 58487306 / 55844701 / +4.7% 0.63 / 0.70 / -9.1%
tpcds_q59/duckdb:vortex-file-compressed 53285246 / 53884934 / -1.1% 67187368 / 64106634 / +4.8% 0.79 / 0.84 / -5.6%
tpcds_q60/duckdb:vortex-file-compressed 36355190 / 35946234 / +1.1% 57496253 / 56917888 / +1.0% 0.63 / 0.63 / +0.1%
tpcds_q61/duckdb:vortex-file-compressed 34757280 / 35361596 / -1.7% 53952758 / 54931615 / -1.8% 0.64 / 0.64 / +0.1%
tpcds_q62/duckdb:vortex-file-compressed 15426324 / 15642241 / -1.4% 27509276 / 26437775 / +4.1% 0.56 / 0.59 / -5.2%
tpcds_q63/duckdb:vortex-file-compressed 21213028 / 21535454 / -1.5% 38886532 / 37891582 / +2.6% 0.55 / 0.57 / -4.0%
tpcds_q64/duckdb:vortex-file-compressed 118404140 / 118554184 / -0.1% 146312731 / 155152310 / -5.7% 0.81 / 0.76 / +5.9%
tpcds_q65/duckdb:vortex-file-compressed 52171818 / 51795274 / +0.7% 67023878 / 58381044 / +14.8% 🔴 0.78 / 0.89 / -12.3%
tpcds_q66/duckdb:vortex-file-compressed 41643376 / 43175862 / -3.5% 55550149 / 58144026 / -4.5% 0.75 / 0.74 / +1.0%
tpcds_q67/duckdb:vortex-file-compressed 273385570 / 279697525 / -2.3% 284494743 / 286952006 / -0.9% 0.96 / 0.97 / -1.4%
tpcds_q68/duckdb:vortex-file-compressed 44345364 / 43855412 / +1.1% 72101751 / 70889380 / +1.7% 0.62 / 0.62 / -0.6%
tpcds_q69/duckdb:vortex-file-compressed 38598304 / 38928932 / -0.8% 59086461 / 58818393 / +0.5% 0.65 / 0.66 / -1.3%
tpcds_q70/duckdb:vortex-file-compressed 25025370 / 25463294 / -1.7% 40180981 / 40384021 / -0.5% 0.62 / 0.63 / -1.2%
tpcds_q71/duckdb:vortex-file-compressed 28131934 / 28420039 / -1.0% 48098116 / 50106346 / -4.0% 0.58 / 0.57 / +3.1%
tpcds_q72/duckdb:vortex-file-compressed 139386541 / 139979520 / -0.4% 157900821 / 158903169 / -0.6% 0.88 / 0.88 / +0.2%
tpcds_q73/duckdb:vortex-file-compressed 19979065 / 20585262 / -2.9% 34969376 / 34351793 / +1.8% 0.57 / 0.60 / -4.7%
tpcds_q74/duckdb:vortex-file-compressed 82798175 / 82954312 / -0.2% 101298406 / 96750254 / +4.7% 0.82 / 0.86 / -4.7%
tpcds_q75/duckdb:vortex-file-compressed 110796962 / 111812181 / -0.9% 135983749 / 134642468 / +1.0% 0.81 / 0.83 / -1.9%
tpcds_q76/duckdb:vortex-file-compressed 27744448 / 28565848 / -2.9% 52280836 / 50818005 / +2.9% 0.53 / 0.56 / -5.6%
tpcds_q77/duckdb:vortex-file-compressed 36657321 / 37119674 / -1.2% 57426499 / 58001525 / -1.0% 0.64 / 0.64 / -0.3%
tpcds_q78/duckdb:vortex-file-compressed 135776010 / 134376332 / +1.0% 157383242 / 156253992 / +0.7% 0.86 / 0.86 / +0.3%
tpcds_q79/duckdb:vortex-file-compressed 37150610 / 37226774 / -0.2% 61181830 / 64984627 / -5.9% 0.61 / 0.57 / +6.0%
tpcds_q80/duckdb:vortex-file-compressed 58493047 / 60631832 / -3.5% 86665458 / 87730396 / -1.2% 0.67 / 0.69 / -2.3%
tpcds_q81/duckdb:vortex-file-compressed 57067266 / 56945055 / +0.2% 70516353 / 69412304 / +1.6% 0.81 / 0.82 / -1.4%
tpcds_q82/duckdb:vortex-file-compressed 29008078 / 29310453 / -1.0% 68549247 / 66476381 / +3.1% 0.42 / 0.44 / -4.0%
tpcds_q83/duckdb:vortex-file-compressed 21469291 / 22220825 / -3.4% 32057615 / 31287098 / +2.5% 0.67 / 0.71 / -5.7%
tpcds_q84/duckdb:vortex-file-compressed 13240614 / 13235808 / +0.0% 23296104 / 23242568 / +0.2% 0.57 / 0.57 / -0.2%
tpcds_q85/duckdb:vortex-file-compressed 37003180 / 36925374 / +0.2% 53607172 / 51546008 / +4.0% 0.69 / 0.72 / -3.6%
tpcds_q86/duckdb:vortex-file-compressed 16597794 / 17513178 / -5.2% 28795224 / 27253205 / +5.7% 0.58 / 0.64 / -10.3%
tpcds_q87/duckdb:vortex-file-compressed 76836220 / 77864842 / -1.3% 86707334 / 89463261 / -3.1% 0.89 / 0.87 / +1.8%
tpcds_q88/duckdb:vortex-file-compressed 38385577 / 38263800 / +0.3% 48364915 / 48154818 / +0.4% 0.79 / 0.79 / -0.1%
tpcds_q89/duckdb:vortex-file-compressed 24200584 / 24642745 / -1.8% 41295580 / 39097340 / +5.6% 0.59 / 0.63 / -7.0%
tpcds_q90/duckdb:vortex-file-compressed 9973537 / 9989277 / -0.2% 19800151 / 19596667 / +1.0% 0.50 / 0.51 / -1.2%
tpcds_q91/duckdb:vortex-file-compressed 19394800 / 19631830 / -1.2% 29368085 / 28502784 / +3.0% 0.66 / 0.69 / -4.1%
tpcds_q92/duckdb:vortex-file-compressed 13597006 / 13669336 / -0.5% 27278634 / 27546971 / -1.0% 0.50 / 0.50 / +0.4%
tpcds_q93/duckdb:vortex-file-compressed 24891347 / 25614763 / -2.8% 48944699 / 48903940 / +0.1% 0.51 / 0.52 / -2.9%
tpcds_q94/duckdb:vortex-file-compressed 32271074 / 32556908 / -0.9% 47405005 / 46308520 / +2.4% 0.68 / 0.70 / -3.2%
tpcds_q95/duckdb:vortex-file-compressed 95670622 / 94847437 / +0.9% 103505608 / 106019934 / -2.4% 0.92 / 0.89 / +3.3%
tpcds_q96/duckdb:vortex-file-compressed 12046790 / 11913750 / +1.1% 24726202 / 24940175 / -0.9% 0.49 / 0.48 / +2.0%
tpcds_q97/duckdb:vortex-file-compressed 62393031 / 61212860 / +1.9% 81574354 / 78071460 / +4.5% 0.76 / 0.78 / -2.4%
tpcds_q98/duckdb:vortex-file-compressed 27255102 / 27621885 / -1.3% 42892816 / 43376439 / -1.1% 0.64 / 0.64 / -0.2%
tpcds_q99/duckdb:vortex-file-compressed 20646758 / 22726621 / -9.2% 35893886 / 35480133 / +1.2% 0.58 / 0.64 / -10.2%
duckdb / parquet / ns (0.993x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41644928 / 41754509 / -0.3% 49329737 / 49716420 / -0.8% 0.84 / 0.84 / +0.5%
tpcds_q02/duckdb:parquet 38549332 / 39320498 / -2.0% 49011750 / 48014421 / +2.1% 0.79 / 0.82 / -4.0%
tpcds_q03/duckdb:parquet 25748768 / 25927457 / -0.7% 34498852 / 36544174 / -5.6% 0.75 / 0.71 / +5.2%
tpcds_q04/duckdb:parquet 200966098 / 204404258 / -1.7% 223114005 / 225527266 / -1.1% 0.90 / 0.91 / -0.6%
tpcds_q05/duckdb:parquet 68967146 / 69257976 / -0.4% 87947155 / 85239338 / +3.2% 0.78 / 0.81 / -3.5%
tpcds_q06/duckdb:parquet 75003476 / 75009952 / -0.0% 85624399 / 86459760 / -1.0% 0.88 / 0.87 / +1.0%
tpcds_q07/duckdb:parquet 59575006 / 61347346 / -2.9% 74932953 / 78900270 / -5.0% 0.80 / 0.78 / +2.3%
tpcds_q08/duckdb:parquet 37968028 / 39528259 / -3.9% 45630713 / 47045239 / -3.0% 0.83 / 0.84 / -1.0%
tpcds_q09/duckdb:parquet 83920324 / 85242190 / -1.6% 99561867 / 99107059 / +0.5% 0.84 / 0.86 / -2.0%
tpcds_q10/duckdb:parquet 51801395 / 51215596 / +1.1% 62281575 / 60545042 / +2.9% 0.83 / 0.85 / -1.7%
tpcds_q11/duckdb:parquet 158665198 / 157115754 / +1.0% 173113992 / 167096251 / +3.6% 0.92 / 0.94 / -2.5%
tpcds_q12/duckdb:parquet 40384707 / 40352013 / +0.1% 44981968 / 47141692 / -4.6% 0.90 / 0.86 / +4.9%
tpcds_q13/duckdb:parquet 69428757 / 70020372 / -0.8% 88129181 / 85638270 / +2.9% 0.79 / 0.82 / -3.6%
tpcds_q14/duckdb:parquet 187977268 / 184880045 / +1.7% 201679142 / 198443193 / +1.6% 0.93 / 0.93 / +0.0%
tpcds_q15/duckdb:parquet 60193500 / 60771048 / -1.0% 68152537 / 67619690 / +0.8% 0.88 / 0.90 / -1.7%
tpcds_q16/duckdb:parquet 37732782 / 37994630 / -0.7% 45397473 / 45727616 / -0.7% 0.83 / 0.83 / +0.0%
tpcds_q17/duckdb:parquet 83178493 / 83160258 / +0.0% 89331324 / 89114981 / +0.2% 0.93 / 0.93 / -0.2%
tpcds_q18/duckdb:parquet 87406075 / 87879957 / -0.5% 93960362 / 95836133 / -2.0% 0.93 / 0.92 / +1.4%
tpcds_q19/duckdb:parquet 48513157 / 47515380 / +2.1% 61440202 / 61000663 / +0.7% 0.79 / 0.78 / +1.4%
tpcds_q20/duckdb:parquet 41960709 / 43268675 / -3.0% 48048004 / 53319914 / -9.9% 0.87 / 0.81 / +7.6%
tpcds_q21/duckdb:parquet 23982138 / 23792717 / +0.8% 29425985 / 30200345 / -2.6% 0.81 / 0.79 / +3.4%
tpcds_q22/duckdb:parquet 161095092 / 166859429 / -3.5% 163504990 / 164973195 / -0.9% 0.99 / 1.01 / -2.6%
tpcds_q23/duckdb:parquet 183377388 / 185062354 / -0.9% 197058842 / 194317115 / +1.4% 0.93 / 0.95 / -2.3%
tpcds_q24/duckdb:parquet 71986666 / 73795194 / -2.5% 81830835 / 81539892 / +0.4% 0.88 / 0.91 / -2.8%
tpcds_q25/duckdb:parquet 51822679 / 50609986 / +2.4% 58841237 / 59253909 / -0.7% 0.88 / 0.85 / +3.1%
tpcds_q26/duckdb:parquet 42225695 / 42341269 / -0.3% 50864276 / 50367988 / +1.0% 0.83 / 0.84 / -1.2%
tpcds_q27/duckdb:parquet 58473357 / 59273806 / -1.4% 73874711 / 74915572 / -1.4% 0.79 / 0.79 / +0.0%
tpcds_q28/duckdb:parquet 94753672 / 92538077 / +2.4% 107672513 / 108311955 / -0.6% 0.88 / 0.85 / +3.0%
tpcds_q29/duckdb:parquet 84363158 / 85143526 / -0.9% 94618979 / 97322888 / -2.8% 0.89 / 0.87 / +1.9%
tpcds_q30/duckdb:parquet 71367716 / 71883182 / -0.7% 80554972 / 79235601 / +1.7% 0.89 / 0.91 / -2.3%
tpcds_q31/duckdb:parquet 97814126 / 98352300 / -0.5% 111220240 / 110050281 / +1.1% 0.88 / 0.89 / -1.6%
tpcds_q32/duckdb:parquet 18068902 / 18136707 / -0.4% 25857274 / 25667997 / +0.7% 0.70 / 0.71 / -1.1%
tpcds_q33/duckdb:parquet 62008545 / 63106814 / -1.7% 74833371 / 75700594 / -1.1% 0.83 / 0.83 / -0.6%
tpcds_q34/duckdb:parquet 32686652 / 33253224 / -1.7% 41932610 / 39802094 / +5.4% 0.78 / 0.84 / -6.7%
tpcds_q35/duckdb:parquet 75569096 / 75987730 / -0.6% 88377749 / 90314190 / -2.1% 0.86 / 0.84 / +1.6%
tpcds_q36/duckdb:parquet 97061862 / 96353316 / +0.7% 112459017 / 111385494 / +1.0% 0.86 / 0.87 / -0.2%
tpcds_q37/duckdb:parquet 41567436 / 42209048 / -1.5% 48297738 / 47786871 / +1.1% 0.86 / 0.88 / -2.6%
tpcds_q38/duckdb:parquet 73636324 / 77958424 / -5.5% 81492180 / 85349165 / -4.5% 0.90 / 0.91 / -1.1%
tpcds_q39/duckdb:parquet 61491404 / 61486491 / +0.0% 67459970 / 68395844 / -1.4% 0.91 / 0.90 / +1.4%
tpcds_q40/duckdb:parquet 27773541 / 28074760 / -1.1% 35965070 / 35471051 / +1.4% 0.77 / 0.79 / -2.4%
tpcds_q41/duckdb:parquet 20433459 / 20300412 / +0.7% 26607501 / 27039573 / -1.6% 0.77 / 0.75 / +2.3%
tpcds_q42/duckdb:parquet 26619950 / 25832600 / +3.0% 39295975 / 37396731 / +5.1% 0.68 / 0.69 / -1.9%
tpcds_q43/duckdb:parquet 26753219 / 27833256 / -3.9% 36159949 / 37569548 / -3.8% 0.74 / 0.74 / -0.1%
tpcds_q44/duckdb:parquet 61043326 / 61917711 / -1.4% 79605132 / 76056446 / +4.7% 0.77 / 0.81 / -5.8%
tpcds_q45/duckdb:parquet 59823825 / 60935476 / -1.8% 68737360 / 66445419 / +3.4% 0.87 / 0.92 / -5.1%
tpcds_q46/duckdb:parquet 73315844 / 74233802 / -1.2% 88394577 / 85326401 / +3.6% 0.83 / 0.87 / -4.7%
tpcds_q47/duckdb:parquet 90027742 / 91376278 / -1.5% 98880462 / 100561337 / -1.7% 0.91 / 0.91 / +0.2%
tpcds_q48/duckdb:parquet 68270775 / 65415782 / +4.4% 82670925 / 77089178 / +7.2% 0.83 / 0.85 / -2.7%
tpcds_q49/duckdb:parquet 69051612 / 68736560 / +0.5% 84412606 / 88271949 / -4.4% 0.82 / 0.78 / +5.1%
tpcds_q50/duckdb:parquet 44938669 / 44405659 / +1.2% 52392367 / 50047873 / +4.7% 0.86 / 0.89 / -3.3%
tpcds_q51/duckdb:parquet 215158472 / 215203352 / -0.0% 221229546 / 225668772 / -2.0% 0.97 / 0.95 / +2.0%
tpcds_q52/duckdb:parquet 27295648 / 26929999 / +1.4% 36780062 / 37851845 / -2.8% 0.74 / 0.71 / +4.3%
tpcds_q53/duckdb:parquet 35831798 / 35085957 / +2.1% 45349193 / 45697835 / -0.8% 0.79 / 0.77 / +2.9%
tpcds_q54/duckdb:parquet 54703144 / 55066050 / -0.7% 62732239 / 62823873 / -0.1% 0.87 / 0.88 / -0.5%
tpcds_q55/duckdb:parquet 26890679 / 27167385 / -1.0% 35758051 / 36846878 / -3.0% 0.75 / 0.74 / +2.0%
tpcds_q56/duckdb:parquet 68404980 / 69810094 / -2.0% 78170380 / 78191395 / -0.0% 0.88 / 0.89 / -2.0%
tpcds_q57/duckdb:parquet 67372498 / 67924052 / -0.8% 73377151 / 75378836 / -2.7% 0.92 / 0.90 / +1.9%
tpcds_q58/duckdb:parquet 56182432 / 55636208 / +1.0% 66000990 / 67771566 / -2.6% 0.85 / 0.82 / +3.7%
tpcds_q59/duckdb:parquet 60869529 / 60888385 / -0.0% 70792153 / 69281606 / +2.2% 0.86 / 0.88 / -2.2%
tpcds_q60/duckdb:parquet 81362917 / 82995592 / -2.0% 92751008 / 93609037 / -0.9% 0.88 / 0.89 / -1.1%
tpcds_q61/duckdb:parquet 80510774 / 79843582 / +0.8% 94270129 / 96209480 / -2.0% 0.85 / 0.83 / +2.9%
tpcds_q62/duckdb:parquet 18830700 / 22427732 / -16.0% 🟢 24323971 / 26553261 / -8.4% 0.77 / 0.84 / -8.3%
tpcds_q63/duckdb:parquet 34629612 / 32945599 / +5.1% 43003742 / 44810985 / -4.0% 0.81 / 0.74 / +9.5%
tpcds_q64/duckdb:parquet 135663508 / 137730810 / -1.5% 155306445 / 162467301 / -4.4% 0.87 / 0.85 / +3.0%
tpcds_q65/duckdb:parquet 91769750 / 90841106 / +1.0% 103708971 / 98758923 / +5.0% 0.88 / 0.92 / -3.8%
tpcds_q66/duckdb:parquet 48720980 / 46229679 / +5.4% 51505192 / 52011770 / -1.0% 0.95 / 0.89 / +6.4%
tpcds_q67/duckdb:parquet 290663218 / 296484754 / -2.0% 294813708 / 300794460 / -2.0% 0.99 / 0.99 / +0.0%
tpcds_q68/duckdb:parquet 64222455 / 62271290 / +3.1% 76816006 / 79884988 / -3.8% 0.84 / 0.78 / +7.3%
tpcds_q69/duckdb:parquet 65597052 / 66823133 / -1.8% 76073197 / 75751375 / +0.4% 0.86 / 0.88 / -2.3%
tpcds_q70/duckdb:parquet 43840073 / 43502914 / +0.8% 55466176 / 51876494 / +6.9% 0.79 / 0.84 / -5.7%
tpcds_q71/duckdb:parquet 41730800 / 40235578 / +3.7% 56560180 / 53331431 / +6.1% 0.74 / 0.75 / -2.2%
tpcds_q72/duckdb:parquet 170956478 / 171234634 / -0.2% 186250344 / 185887233 / +0.2% 0.92 / 0.92 / -0.4%
tpcds_q73/duckdb:parquet 28100674 / 28539550 / -1.5% 35374147 / 38525179 / -8.2% 0.79 / 0.74 / +7.2%
tpcds_q74/duckdb:parquet 214450291 / 214701141 / -0.1% 225187822 / 226612264 / -0.6% 0.95 / 0.95 / +0.5%
tpcds_q75/duckdb:parquet 130487103 / 136513298 / -4.4% 148584075 / 144305040 / +3.0% 0.88 / 0.95 / -7.2%
tpcds_q76/duckdb:parquet 50049850 / 52107498 / -3.9% 63294422 / 66393995 / -4.7% 0.79 / 0.78 / +0.8%
tpcds_q77/duckdb:parquet 57481772 / 53680122 / +7.1% 72856300 / 68802211 / +5.9% 0.79 / 0.78 / +1.1%
tpcds_q78/duckdb:parquet 145127978 / 146481247 / -0.9% 157573541 / 173928138 / -9.4% 0.92 / 0.84 / +9.4%
tpcds_q79/duckdb:parquet 52007943 / 52912912 / -1.7% 70086057 / 69766888 / +0.5% 0.74 / 0.76 / -2.2%
tpcds_q80/duckdb:parquet 82163588 / 84091399 / -2.3% 101765552 / 101467325 / +0.3% 0.81 / 0.83 / -2.6%
tpcds_q81/duckdb:parquet 97145252 / 96942804 / +0.2% 104323296 / 105070620 / -0.7% 0.93 / 0.92 / +0.9%
tpcds_q82/duckdb:parquet 45551278 / 46487240 / -2.0% 53967718 / 53044060 / +1.7% 0.84 / 0.88 / -3.7%
tpcds_q83/duckdb:parquet 27549892 / 28126860 / -2.1% 32727161 / 33556853 / -2.5% 0.84 / 0.84 / +0.4%
tpcds_q84/duckdb:parquet 22763232 / 22718850 / +0.2% 28629854 / 28854283 / -0.8% 0.80 / 0.79 / +1.0%
tpcds_q85/duckdb:parquet 51763286 / 51569898 / +0.4% 60007963 / 60972055 / -1.6% 0.86 / 0.85 / +2.0%
tpcds_q86/duckdb:parquet 24321462 / 25653376 / -5.2% 31570313 / 32290498 / -2.2% 0.77 / 0.79 / -3.0%
tpcds_q87/duckdb:parquet 87490499 / 86041585 / +1.7% 96488395 / 96073615 / +0.4% 0.91 / 0.90 / +1.2%
tpcds_q88/duckdb:parquet 104795728 / 104156077 / +0.6% 110957146 / 113708809 / -2.4% 0.94 / 0.92 / +3.1%
tpcds_q89/duckdb:parquet 37121006 / 37221714 / -0.3% 47052627 / 52543843 / -10.5% 🟢 0.79 / 0.71 / +11.4%
tpcds_q90/duckdb:parquet 14771762 / 15320644 / -3.6% 20139518 / 19638004 / +2.6% 0.73 / 0.78 / -6.0%
tpcds_q91/duckdb:parquet 25650126 / 25533825 / +0.5% 32309755 / 32629028 / -1.0% 0.79 / 0.78 / +1.4%
tpcds_q92/duckdb:parquet 22677636 / 22457040 / +1.0% 29667156 / 29600706 / +0.2% 0.76 / 0.76 / +0.8%
tpcds_q93/duckdb:parquet 36951864 / 36522483 / +1.2% 49813666 / 49556338 / +0.5% 0.74 / 0.74 / +0.7%
tpcds_q94/duckdb:parquet 37823309 / 38221661 / -1.0% 47494514 / 47915670 / -0.9% 0.80 / 0.80 / -0.2%
tpcds_q95/duckdb:parquet 80176086 / 80753512 / -0.7% 85728829 / 88826826 / -3.5% 0.94 / 0.91 / +2.9%
tpcds_q96/duckdb:parquet 16581176 / 17701885 / -6.3% 24208263 / 22852748 / +5.9% 0.68 / 0.77 / -11.6%
tpcds_q97/duckdb:parquet 72402498 / 72195042 / +0.3% 80430733 / 85867593 / -6.3% 0.90 / 0.84 / +7.1%
tpcds_q98/duckdb:parquet 55290944 / 54526654 / +1.4% 64955554 / 67784295 / -4.2% 0.85 / 0.80 / +5.8%
tpcds_q99/duckdb:parquet 24172014 / 25590772 / -5.5% 31698013 / 32382010 / -2.1% 0.76 / 0.79 / -3.5%

No baseline file sizes found for base commit.

@joseph-isaacs
joseph-isaacs enabled auto-merge (squash) November 13, 2026 20:11
joseph-isaacs added a commit that referenced this pull request Nov 13, 2026
## Summary

Every SQL benchmark that runs DuckDB fails with:

```
duckdb-bench: error while loading shared libraries: libduckdb.so: cannot open shared object file: No such file or directory
```

This started with the Rust 1.100 upgrade (#11446). Rust 1.100's cargo
moved build script output from `build/<pkg>-<hash>/out` to
`build/<pkg>/<hash>/out`. `vortex-duckdb/build.rs` keeps its DuckDB
cache two levels above `OUT_DIR`, so the library moved:

- before:
`target/release_debug/build/vortex-duckdb-cache/duckdb-lib-*/libduckdb.so`
- now:
`target/release_debug/build/vortex-duckdb/vortex-duckdb-cache/duckdb-lib-*/libduckdb.so`

The artifact path still names the old location. upload-artifact leaves
out an unmatched path without an error, so the bench jobs get
`duckdb-bench` without the library that its absolute rpath points to.

## Changes

`sql-bench-matrix.yml`, build job:
- The artifact path matches the library at any depth under
`target/release_debug/build`, so it works with both layouts. It also
matches a DuckDB built from source as well as a prebuilt one.
upload-artifact still roots the artifact at `target/release_debug`, so
the library unpacks at the path the rpath expects.
- A new step fails the build job if `libduckdb.so` is missing. A missing
library now stops the build, instead of letting every DuckDB benchmark
fail later.

A sturdier fix would be for `vortex-duckdb/build.rs` to stop deriving
its cache location from `OUT_DIR`, since cargo can change that layout
again. I kept this PR to the workflow.

Checks:
- `yamllint --strict -c .yamllint.yaml` passes.
- With cargo 1.100, a local build script prints
`OUT_DIR=.../target/debug/build/<pkg>/<hash>/out`.
- I ran the same fix, as a tar-based packaging step, on
#11450. There FineWeb, TPC-H SF=1 and SF=10, TPC-DS
SF=1 and SF=10, ClickBench and TPC-H on S3 all finished with DuckDB
results. Before the fix they failed with the error above, on that PR and
on other branches.

---

---
_Generated by [Claude
Code](https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N)_

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Keep this branch's tar-based packaging of the SQL bench binaries, which
already finds and checks libduckdb.so the way #11462 does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBAMeLpyH1yASJhrK1N
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs merged commit fc93194 into develop Nov 13, 2026
78 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/confident-allen-2ohb41 branch November 13, 2026 20:25

This branch was successfully deployed

1 active deployment
vercel-docs — 415ae1d3 Deployed Nov 13, 2026 by joseph-isaacs via Publish preview / Deploy #9842
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants