Skip to content

duckdb: keep pushed filters visible to the join planner - #10941

Closed
robert3005 wants to merge 1 commit into
developfrom
rk/duckdb-scan-estimates
Closed

robert3005 wants to merge 1 commit into
developfrom
rk/duckdb-scan-estimates

Conversation

@robert3005

Copy link
Copy Markdown
Contributor

Fixes #10933.

Problem

Since #10519 split the TPC-DS tables into many files, DuckDB on Vortex runs out of memory on TPC-DS query 64 at SF=10, and does not finish at SF=100. Queries 1 to 63 did not change.

The Vortex scan took complex filters out of DuckDB's plan, and reported total * 0.2 rows to make up for them. DuckDB uses the scan's row count as the upper limit for the distinct values of a join key (relation_statistics_scan.cpp). So with a post-filter count, a join on a filtered dimension table did not reduce the estimate. Filters that the scan consumed, such as i_color IN (...), were also invisible to DuckDB's own selectivity estimates.

With one file per table, the Vortex min/max statistics hid this. DuckDB drops per-file statistics for a multi-file scan, so after the split, the store_sales side of q64 looked about 25 times larger than it is. DuckDB then picked a plan with a nested loop join on cd1.cd_marital_status != cd2.cd_marital_status under a hash aggregate. At SF=10 that join makes 717,764,544,000 rows (467,100 customer rows × 1,920,800 customer_demographics rows), and the hash aggregate runs out of memory and spill space.

Change

  • pushdown_complex_filter still copies each filter into the scan, so the scan prunes and filters with it. It now returns false, so DuckDB also keeps the filter in its plan and can estimate it. It skips filters that it already holds, because DuckDB can offer a kept filter again.
  • cardinality reports the row count before filters. This removes the 0.2 DEFAULT_SELECTIVITY from Mimic duckdb's post-filter cardinality estimates #7895, and the has_non_optional_filter flag that only fed it.
  • The e2e pushdown tests now check that the Vortex scan lists the filter, not that DuckDB's FILTER operator is gone.
  • New unit test: a scan with pushed filters reports its unfiltered row count.

With this change, every q64 estimate matches DuckDB on Parquet (for example store_sales ⋈ date_dim ~5,759,877 rows, cs_ui ⋈ item ~72,826 rows), and the plan has no nested loop join.

Results

TPC-DS SF=10, split files, duckdb-bench on a 16-core Apple Silicon laptop.

Query Before After
q64 out of memory 245–323 ms
q85 (reason for the 0.2 in #7895) 39 ms 28–29 ms
q19 303 ms 33–41 ms
q72 583 ms 84–92 ms
q88 150 ms 56 ms
q95 349 ms 181 ms
All 99 queries (best of 2 × 3 iterations) 8,447 ms without q64 6,990 ms with q64

Some short queries got slower in both runs: q9 (1.4×), q28 (1.44×), q29 (1.5×), q74 (1.4×), q30 and q81 (1.8×, both under 35 ms). Laptop noise was up to 1.7× on single small queries. One likely cause is that DuckDB now evaluates each kept filter again on the rows that the scan returns; I have not confirmed this with a profile. The nightly benchmark should show if the slowdowns are real.

The DuckDB on Vortex TPC-DS SF=10 and SF=100 nightly jobs should pass again with this change.

Checks

  • cargo check -p vortex-duckdb --tests: no errors or warnings.
  • duckdb-bench tpcds at SF=10 as above: plan and timings.
  • Not run: clippy, fmt, nextest, and the doctests. The changed e2e tests (test_membership_filter_pushdown, spatial_filter_pushes_*) and the new cardinality_ignores_pushed_filters test have not been run locally.

🤖 Generated with Claude Code

The Vortex scan took complex filters out of DuckDB's plan and reported a
post-filter row count (total * 0.2) instead. DuckDB uses the scan's row
count as the upper limit for the distinct values of a join key. With a
post-filter count, joins on a filtered dimension table did not reduce
the estimate, and filters that the scan consumed were invisible to the
join order optimizer.

When the TPC-DS tables were split into many files, DuckDB lost the
per-file min/max statistics that had hidden this. Query 64 then got a
plan with a nested loop join on `cd1.cd_marital_status !=
cd2.cd_marital_status` that makes about 718 billion rows at SF=10, and
the query ran out of memory.

Now the scan copies each complex filter and still evaluates it, but
DuckDB keeps the filter in its plan. The scan reports its row count
before filters. The q64 estimates now match DuckDB on Parquet.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@codspeed

codspeed Bot commented Oct 28, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 10.67%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

❌ 1 regressed benchmark
✅ 2269 untouched benchmarks
⏩ 370 skipped benchmarks1
🗄️ 30 archived benchmarks run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime threshold_neon[64] 3.9 µs 4.4 µs -10.67%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing rk/duckdb-scan-estimates (6c0f397) with develop (3953e98)

Open in CodSpeed

Footnotes

  1. 370 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. 30 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩

@robert3005
robert3005 requested a review from myrrc October 28, 2026 19:12
@robert3005
robert3005 marked this pull request as draft October 28, 2026 19:12
}
assert!(plan.contains("Read Vortex"), "missing Vortex scan:\n{plan}");
assert!(!plan.contains("FILTER"), "filter was not pushed:\n{plan}");
assert!(plan.contains("Filters"), "filter was not pushed:\n{plan}");

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't change the string

@robert3005

Copy link
Copy Markdown
Contributor Author

This fixes the underlying issue of tpcds sf=100 but it's not a good solution imho

@myrrc myrrc added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Oct 29, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Oct 29, 2026
@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6c0f397 vortex-queries 1 Explore Profiling Data
🟢 Done 6c0f397 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 6c0f397 statpopgen 1 Explore Profiling Data
🟢 Done 6c0f397 clickbench-nvme 1 Explore Profiling Data
🟢 Done 6c0f397 job-nvme 1 Explore Profiling Data
🟢 Done 6c0f397 tpch-s3-10 1 Explore Profiling Data
🟢 Done 6c0f397 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 6c0f397 fineweb-s3 1 Explore Profiling Data
🟢 Done 6c0f397 appian-nvme 1 Explore Profiling Data
🟢 Done 6c0f397 polarsignals 1 Explore Profiling Data
🟢 Done 6c0f397 tpch-nvme 1 Explore Profiling Data
🟢 Done 6c0f397 tpch-s3 1 Explore Profiling Data
🟢 Done 6c0f397 tpcds-nvme 1 Explore Profiling Data
🟢 Done 6c0f397 fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark PolarSignals Profiling (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark FineWeb NVMe (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on NVME (pr-full) failed! Check the workflow run for details.

@myrrc

myrrc commented Oct 29, 2026

Copy link
Copy Markdown
Contributor

We can't merge this PR because duckdb expects post-pushdown estimates in cardinality(). The point of pushing down filters is that we don't want to evaluate them twice as some are quite expensive.

This is to some extent already fixed in 2.0 because some optimizer rules can query filters even if they were pushed

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench Sorted on NVME (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on NVME (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 6c0f3973 vs base 768a20ec
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (-6.5%, environment too noisy confidence) · DuckDB No clear signal (+9.0%, environment too noisy confidence)
Vortex (geomean): hot 1.026x ➖ · cold 1.050x ➖
Parquet (geomean): hot 1.016x ➖ · cold 1.103x ➖
Shifts: Parquet (control) +1.6% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.937x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 52025300 / 52746044 / -1.4% 105797302 / 118602157 / -10.8% 0.49 / 0.44 / +10.6%
fineweb_q01/datafusion:vortex-file-compressed 463494818 / 572262490 / -19.0% 678213698 / 610371840 / +11.1% 0.68 / 0.94 / -27.1%
fineweb_q02/datafusion:vortex-file-compressed 379448336 / 367280786 / +3.3% 569884288 / 495589733 / +15.0% 0.67 / 0.74 / -10.2%
fineweb_q03/datafusion:vortex-file-compressed 499670719 / 475500029 / +5.1% 708864807 / 695443381 / +1.9% 0.70 / 0.68 / +3.1%
fineweb_q04/datafusion:vortex-file-compressed 402847387 / 401818550 / +0.3% 456339012 / 413851211 / +10.3% 0.88 / 0.97 / -9.1%
fineweb_q05/datafusion:vortex-file-compressed 411215084 / 632292262 / -35.0% 🟢 451075805 / 591388789 / -23.7% 0.91 / 1.07 / -14.7%
fineweb_q06/datafusion:vortex-file-compressed 842717081 / 1193637664 / -29.4% 753357262 / 963953085 / -21.8% 1.12 / 1.24 / -9.7%
fineweb_q07/datafusion:vortex-file-compressed 639164536 / 467886465 / +36.6% 🔴 628489481 / 545458653 / +15.2% 1.02 / 0.86 / +18.6%
fineweb_q08/datafusion:vortex-file-compressed 217398372 / 213294490 / +1.9% 340028026 / 189108455 / +79.8% 🔴 0.64 / 1.13 / -43.3%
datafusion / vortex-compact / ns (1.068x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 69818660 / 48315540 / +44.5% 🔴 179119359 / 122603125 / +46.1% 🔴 0.39 / 0.39 / -1.1%
fineweb_q01/datafusion:vortex-compact 393206130 / 371181861 / +5.9% 659034775 / 690022639 / -4.5% 0.60 / 0.54 / +10.9%
fineweb_q02/datafusion:vortex-compact 393605370 / 372705769 / +5.6% 479527682 / 480446361 / -0.2% 0.82 / 0.78 / +5.8%
fineweb_q03/datafusion:vortex-compact 680499040 / 551521624 / +23.4% 780720395 / 689233971 / +13.3% 0.87 / 0.80 / +8.9%
fineweb_q04/datafusion:vortex-compact 452256746 / 612623634 / -26.2% 507120105 / 725296223 / -30.1% 🟢 0.89 / 0.84 / +5.6%
fineweb_q05/datafusion:vortex-compact 477452442 / 486700240 / -1.9% 502492507 / 497443795 / +1.0% 0.95 / 0.98 / -2.9%
fineweb_q06/datafusion:vortex-compact 1235745916 / 845439017 / +46.2% 🔴 769393888 / 698683595 / +10.1% 1.61 / 1.21 / +32.7%
fineweb_q07/datafusion:vortex-compact 476771078 / 502547087 / -5.1% 540153935 / 498563424 / +8.3% 0.88 / 1.01 / -12.4%
fineweb_q08/datafusion:vortex-compact 154598924 / 171940946 / -10.1% 183840952 / 182743203 / +0.6% 0.84 / 0.94 / -10.6%
datafusion / parquet / ns (1.069x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 463294776 / 544289321 / -14.9% 1085135542 / 935167167 / +16.0% 0.43 / 0.58 / -26.6%
fineweb_q01/datafusion:parquet 781359737 / 761429392 / +2.6% 844750702 / 734091428 / +15.1% 0.92 / 1.04 / -10.8%
fineweb_q02/datafusion:parquet 823253818 / 772496357 / +6.6% 870524519 / 791804683 / +9.9% 0.95 / 0.98 / -3.1%
fineweb_q03/datafusion:parquet 726711696 / 787946899 / -7.8% 757213536 / 798275637 / -5.1% 0.96 / 0.99 / -2.8%
fineweb_q04/datafusion:parquet 875715182 / 735278246 / +19.1% 1263260066 / 630879167 / +100.2% 🔴 0.69 / 1.17 / -40.5%
fineweb_q05/datafusion:parquet 791870768 / 755970818 / +4.7% 737570192 / 671278274 / +9.9% 1.07 / 1.13 / -4.7%
fineweb_q06/datafusion:parquet 787994053 / 753529070 / +4.6% 742078810 / 624378392 / +18.9% 1.06 / 1.21 / -12.0%
fineweb_q07/datafusion:parquet 1112177332 / 693424474 / +60.4% 🔴 906420286 / 640054672 / +41.6% 🔴 1.23 / 1.08 / +13.3%
fineweb_q08/datafusion:parquet 783355862 / 768967922 / +1.9% 871547501 / 644090038 / +35.3% 🔴 0.90 / 1.19 / -24.7%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 64629216 / 76515490 / -15.5% 57731984 / 70626267 / -18.3% 1.12 / 1.08 / +3.3%
fineweb_q01/duckdb:vortex-file-compressed 459921094 / 482810631 / -4.7% 480162671 / 451621145 / +6.3% 0.96 / 1.07 / -10.4%
fineweb_q02/duckdb:vortex-file-compressed 698095826 / 538910758 / +29.5% 667337297 / 696996785 / -4.3% 1.05 / 0.77 / +35.3%
fineweb_q03/duckdb:vortex-file-compressed 934678206 / 977294291 / -4.4% 997138985 / 1041294074 / -4.2% 0.94 / 0.94 / -0.1%
fineweb_q04/duckdb:vortex-file-compressed 979447472 / 1005138619 / -2.6% 1027155580 / 943572377 / +8.9% 0.95 / 1.07 / -10.5%
fineweb_q05/duckdb:vortex-file-compressed 872940068 / 872874855 / +0.0% 1023227872 / 962209818 / +6.3% 0.85 / 0.91 / -6.0%
fineweb_q06/duckdb:vortex-file-compressed 1274933633 / 1358988648 / -6.2% 1206863065 / 1223248601 / -1.3% 1.06 / 1.11 / -4.9%
fineweb_q07/duckdb:vortex-file-compressed 982601859 / 954451518 / +2.9% 1080152168 / 1066537444 / +1.3% 0.91 / 0.89 / +1.7%
fineweb_q08/duckdb:vortex-file-compressed 405264208 / 392980190 / +3.1% 461471432 / 455978485 / +1.2% 0.88 / 0.86 / +1.9%
duckdb / vortex-compact / ns (1.112x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 62619488 / 74325907 / -15.8% 69463430 / 69396124 / +0.1% 0.90 / 1.07 / -15.8%
fineweb_q01/duckdb:vortex-compact 792663182 / 374849588 / +111.5% 🔴 1105575613 / 437140773 / +152.9% 🔴 0.72 / 0.86 / -16.4%
fineweb_q02/duckdb:vortex-compact 579339562 / 525938596 / +10.2% 610170287 / 582725562 / +4.7% 0.95 / 0.90 / +5.2%
fineweb_q03/duckdb:vortex-compact 1213994476 / 1100423652 / +10.3% 1123855929 / 1257988457 / -10.7% 1.08 / 0.87 / +23.5%
fineweb_q04/duckdb:vortex-compact 1050597212 / 974936026 / +7.8% 1036624213 / 1052368570 / -1.5% 1.01 / 0.93 / +9.4%
fineweb_q05/duckdb:vortex-compact 892333538 / 983902478 / -9.3% 970000090 / 1175230442 / -17.5% 0.92 / 0.84 / +9.9%
fineweb_q06/duckdb:vortex-compact 1144674500 / 1140828474 / +0.3% 1105446919 / 1089841639 / +1.4% 1.04 / 1.05 / -1.1%
fineweb_q07/duckdb:vortex-compact 955500790 / 888100124 / +7.6% 1104085696 / 1008849458 / +9.4% 0.87 / 0.88 / -1.7%
fineweb_q08/duckdb:vortex-compact 389065126 / 340581288 / +14.2% 555445548 / 403854397 / +37.5% 🔴 0.70 / 0.84 / -16.9%
duckdb / parquet / ns (0.966x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 306959047 / 295648528 / +3.8% 437143132 / 357100182 / +22.4% 0.70 / 0.83 / -15.2%
fineweb_q01/duckdb:parquet 558394648 / 544282628 / +2.6% 607225611 / 579295378 / +4.8% 0.92 / 0.94 / -2.1%
fineweb_q02/duckdb:parquet 544089768 / 570825034 / -4.7% 644813777 / 668899725 / -3.6% 0.84 / 0.85 / -1.1%
fineweb_q03/duckdb:parquet 878368598 / 808760346 / +8.6% 1375621979 / 936905790 / +46.8% 🔴 0.64 / 0.86 / -26.0%
fineweb_q04/duckdb:parquet 653409290 / 644538078 / +1.4% 735736480 / 738997035 / -0.4% 0.89 / 0.87 / +1.8%
fineweb_q05/duckdb:parquet 812882297 / 760267902 / +6.9% 833448767 / 783781789 / +6.3% 0.98 / 0.97 / +0.5%
fineweb_q06/duckdb:parquet 807413786 / 938662286 / -14.0% 869515737 / 1501506178 / -42.1% 🟢 0.93 / 0.63 / +48.5%
fineweb_q07/duckdb:parquet 911135049 / 761786130 / +19.6% 993756345 / 809524162 / +22.8% 0.92 / 0.94 / -2.6%
fineweb_q08/duckdb:parquet 344307641 / 579319232 / -40.6% 🟢 440007265 / 721749225 / -39.0% 🟢 0.78 / 0.80 / -2.5%

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Appian on NVME (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench on NVME (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Statistical and Population Genetics (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark JOB on NVME (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-DS SF=1 on NVME (pr-full) failed! Check the workflow run for details.

@robert3005 robert3005 closed this Oct 29, 2026
@robert3005
robert3005 deleted the rk/duckdb-scan-estimates branch October 29, 2026 11:22
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 6c0f3973 vs base 641d1e99
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.7%
Engines: DataFusion No clear signal (-8.6%, environment too noisy confidence) · DuckDB No clear signal (-8.9%, environment too noisy confidence)
Vortex (geomean): hot 0.982x ➖ · cold 1.037x ➖
Parquet (geomean): hot 1.075x ➖ · cold 1.148x ➖
Shifts: Parquet (control) +7.5% · Median polish -1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.076x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 205807534 / 214213200 / -3.9% 704017735 / 825269733 / -14.7% 0.29 / 0.26 / +12.6%
tpch_q02/datafusion:vortex-file-compressed 374259587 / 446028320 / -16.1% 622275483 / 709089130 / -12.2% 0.60 / 0.63 / -4.4%
tpch_q03/datafusion:vortex-file-compressed 399679780 / 378392301 / +5.6% 1015779631 / 939907400 / +8.1% 0.39 / 0.40 / -2.3%
tpch_q04/datafusion:vortex-file-compressed 208933781 / 226957625 / -7.9% 490705437 / 381130445 / +28.7% 0.43 / 0.60 / -28.5%
tpch_q05/datafusion:vortex-file-compressed 423407522 / 394001450 / +7.5% 759135342 / 643555963 / +18.0% 0.56 / 0.61 / -8.9%
tpch_q06/datafusion:vortex-file-compressed 165798239 / 143853003 / +15.3% 346703916 / 270998223 / +27.9% 0.48 / 0.53 / -9.9%
tpch_q07/datafusion:vortex-file-compressed 497062427 / 429290556 / +15.8% 690592794 / 562817494 / +22.7% 0.72 / 0.76 / -5.6%
tpch_q08/datafusion:vortex-file-compressed 766629813 / 471346122 / +62.6% 🔴 798739381 / 840926873 / -5.0% 0.96 / 0.56 / +71.2%
tpch_q09/datafusion:vortex-file-compressed 496564019 / 285549176 / +73.9% 🔴 710609927 / 572693057 / +24.1% 0.70 / 0.50 / +40.1%
tpch_q10/datafusion:vortex-file-compressed 356107192 / 324409159 / +9.8% 711416047 / 519933975 / +36.8% 🔴 0.50 / 0.62 / -19.8%
tpch_q11/datafusion:vortex-file-compressed 271464633 / 395847714 / -31.4% 🟢 418577987 / 557909028 / -25.0% 0.65 / 0.71 / -8.6%
tpch_q12/datafusion:vortex-file-compressed 214856112 / 284054763 / -24.4% 387563382 / 321938579 / +20.4% 0.55 / 0.88 / -37.2%
tpch_q13/datafusion:vortex-file-compressed 143658630 / 129346752 / +11.1% 443125759 / 299421092 / +48.0% 🔴 0.32 / 0.43 / -25.0%
tpch_q14/datafusion:vortex-file-compressed 176131298 / 177026844 / -0.5% 329897050 / 291017322 / +13.4% 0.53 / 0.61 / -12.2%
tpch_q15/datafusion:vortex-file-compressed 328451315 / 317999998 / +3.3% 580353143 / 501149739 / +15.8% 0.57 / 0.63 / -10.8%
tpch_q16/datafusion:vortex-file-compressed 154077654 / 127615466 / +20.7% 361143463 / 269855969 / +33.8% 🔴 0.43 / 0.47 / -9.8%
tpch_q17/datafusion:vortex-file-compressed 253310449 / 263453305 / -3.8% 431648001 / 641959845 / -32.8% 🟢 0.59 / 0.41 / +43.0%
tpch_q18/datafusion:vortex-file-compressed 349446285 / 331739077 / +5.3% 692357151 / 450564472 / +53.7% 🔴 0.50 / 0.74 / -31.4%
tpch_q19/datafusion:vortex-file-compressed 248679564 / 237379074 / +4.8% 370935519 / 351879618 / +5.4% 0.67 / 0.67 / -0.6%
tpch_q20/datafusion:vortex-file-compressed 287090075 / 276806357 / +3.7% 549855874 / 474693412 / +15.8% 0.52 / 0.58 / -10.5%
tpch_q21/datafusion:vortex-file-compressed 755569895 / 459804698 / +64.3% 🔴 1168292171 / 671250103 / +74.0% 🔴 0.65 / 0.68 / -5.6%
tpch_q22/datafusion:vortex-file-compressed 183389132 / 165902797 / +10.5% 441861144 / 375908837 / +17.5% 0.42 / 0.44 / -6.0%
datafusion / vortex-compact / ns (0.942x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 252614858 / 216445046 / +16.7% 866359934 / 786390722 / +10.2% 0.29 / 0.28 / +5.9%
tpch_q02/datafusion:vortex-compact 327170568 / 314296376 / +4.1% 648164660 / 547786185 / +18.3% 0.50 / 0.57 / -12.0%
tpch_q03/datafusion:vortex-compact 341117158 / 325700234 / +4.7% 845440995 / 755633275 / +11.9% 0.40 / 0.43 / -6.4%
tpch_q04/datafusion:vortex-compact 204606360 / 333759891 / -38.7% 🟢 551480930 / 534982380 / +3.1% 0.37 / 0.62 / -40.5%
tpch_q05/datafusion:vortex-compact 369122218 / 475992501 / -22.5% 778235422 / 796191591 / -2.3% 0.47 / 0.60 / -20.7%
tpch_q06/datafusion:vortex-compact 143080509 / 272353655 / -47.5% 🟢 332329644 / 450612730 / -26.2% 0.43 / 0.60 / -28.8%
tpch_q07/datafusion:vortex-compact 416609355 / 513940910 / -18.9% 564215012 / 890161673 / -36.6% 🟢 0.74 / 0.58 / +27.9%
tpch_q08/datafusion:vortex-compact 690427717 / 427239280 / +61.6% 🔴 621653173 / 797381610 / -22.0% 1.11 / 0.54 / +107.3%
tpch_q09/datafusion:vortex-compact 303727694 / 306973336 / -1.1% 658112955 / 549564933 / +19.8% 0.46 / 0.56 / -17.4%
tpch_q10/datafusion:vortex-compact 343276234 / 303521268 / +13.1% 486227824 / 442397448 / +9.9% 0.71 / 0.69 / +2.9%
tpch_q11/datafusion:vortex-compact 269566478 / 295534462 / -8.8% 565350993 / 483640868 / +16.9% 0.48 / 0.61 / -22.0%
tpch_q12/datafusion:vortex-compact 162911135 / 513431547 / -68.3% 🟢 348080453 / 559903430 / -37.8% 🟢 0.47 / 0.92 / -49.0%
tpch_q13/datafusion:vortex-compact 198769789 / 134494332 / +47.8% 🔴 347778000 / 276976938 / +25.6% 0.57 / 0.49 / +17.7%
tpch_q14/datafusion:vortex-compact 199579598 / 246066056 / -18.9% 397187735 / 428302224 / -7.3% 0.50 / 0.57 / -12.5%
tpch_q15/datafusion:vortex-compact 300635815 / 336529381 / -10.7% 505213241 / 619753534 / -18.5% 0.60 / 0.54 / +9.6%
tpch_q16/datafusion:vortex-compact 139315010 / 132870252 / +4.9% 307768503 / 279222686 / +10.2% 0.45 / 0.48 / -4.9%
tpch_q17/datafusion:vortex-compact 274828259 / 287691667 / -4.5% 415769127 / 421130134 / -1.3% 0.66 / 0.68 / -3.2%
tpch_q18/datafusion:vortex-compact 283460934 / 286243821 / -1.0% 454684185 / 402946242 / +12.8% 0.62 / 0.71 / -12.2%
tpch_q19/datafusion:vortex-compact 247619705 / 272958125 / -9.3% 483365565 / 464066238 / +4.2% 0.51 / 0.59 / -12.9%
tpch_q20/datafusion:vortex-compact 271421780 / 356835666 / -23.9% 431973601 / 516267014 / -16.3% 0.63 / 0.69 / -9.1%
tpch_q21/datafusion:vortex-compact 1185452348 / 473247265 / +150.5% 🔴 1980959078 / 896608666 / +120.9% 🔴 0.60 / 0.53 / +13.4%
tpch_q22/datafusion:vortex-compact 177639646 / 163849034 / +8.4% 416157181 / 335637885 / +24.0% 0.43 / 0.49 / -12.6%
datafusion / parquet / ns (1.101x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 248931922 / 178368796 / +39.6% 🔴 546681752 / 445624034 / +22.7% 0.46 / 0.40 / +13.8%
tpch_q02/datafusion:parquet 287970166 / 282281958 / +2.0% 609575614 / 487948144 / +24.9% 0.47 / 0.58 / -18.3%
tpch_q03/datafusion:parquet 309388020 / 222956742 / +38.8% 🔴 781519748 / 741892443 / +5.3% 0.40 / 0.30 / +31.7%
tpch_q04/datafusion:parquet 170364040 / 136016626 / +25.3% 350714307 / 311612808 / +12.5% 0.49 / 0.44 / +11.3%
tpch_q05/datafusion:parquet 408228069 / 377516747 / +8.1% 543498337 / 491988801 / +10.5% 0.75 / 0.77 / -2.1%
tpch_q06/datafusion:parquet 157139230 / 113483220 / +38.5% 🔴 367748694 / 249854205 / +47.2% 🔴 0.43 / 0.45 / -5.9%
tpch_q07/datafusion:parquet 380566259 / 331655857 / +14.7% 750282889 / 426309415 / +76.0% 🔴 0.51 / 0.78 / -34.8%
tpch_q08/datafusion:parquet 459903540 / 451605581 / +1.8% 658350602 / 570363933 / +15.4% 0.70 / 0.79 / -11.8%
tpch_q09/datafusion:parquet 415575109 / 382503360 / +8.6% 584087510 / 518604873 / +12.6% 0.71 / 0.74 / -3.5%
tpch_q10/datafusion:parquet 344882997 / 292836961 / +17.8% 487573301 / 479227472 / +1.7% 0.71 / 0.61 / +15.8%
tpch_q11/datafusion:parquet 257708893 / 252341823 / +2.1% 413624376 / 341149907 / +21.2% 0.62 / 0.74 / -15.8%
tpch_q12/datafusion:parquet 170399438 / 174354687 / -2.3% 345879001 / 348039718 / -0.6% 0.49 / 0.50 / -1.7%
tpch_q13/datafusion:parquet 278297965 / 273468124 / +1.8% 415527449 / 472685940 / -12.1% 0.67 / 0.58 / +15.8%
tpch_q14/datafusion:parquet 174453621 / 149381921 / +16.8% 333439448 / 293864629 / +13.5% 0.52 / 0.51 / +2.9%
tpch_q15/datafusion:parquet 304316467 / 305627943 / -0.4% 546160071 / 469970353 / +16.2% 0.56 / 0.65 / -14.3%
tpch_q16/datafusion:parquet 110978612 / 117657541 / -5.7% 216410086 / 215589187 / +0.4% 0.51 / 0.55 / -6.0%
tpch_q17/datafusion:parquet 315541725 / 299274597 / +5.4% 521130687 / 732567252 / -28.9% 0.61 / 0.41 / +48.2%
tpch_q18/datafusion:parquet 377497359 / 316228682 / +19.4% 726111190 / 453016546 / +60.3% 🔴 0.52 / 0.70 / -25.5%
tpch_q19/datafusion:parquet 171216828 / 172779374 / -0.9% 331984036 / 353376792 / -6.1% 0.52 / 0.49 / +5.5%
tpch_q20/datafusion:parquet 261035334 / 234214402 / +11.5% 408133945 / 369264285 / +10.5% 0.64 / 0.63 / +0.8%
tpch_q21/datafusion:parquet 321465545 / 365616445 / -12.1% 457962271 / 438607099 / +4.4% 0.70 / 0.83 / -15.8%
tpch_q22/datafusion:parquet 166961565 / 151497520 / +10.2% 303383040 / 279272252 / +8.6% 0.55 / 0.54 / +1.4%
duckdb / vortex-file-compressed / ns (0.984x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 255845546 / 255409543 / +0.2% 275834522 / 264114628 / +4.4% 0.93 / 0.97 / -4.1%
tpch_q02/duckdb:vortex-file-compressed 396162729 / 420183148 / -5.7% 513510115 / 455457369 / +12.7% 0.77 / 0.92 / -16.4%
tpch_q03/duckdb:vortex-file-compressed 402129855 / 452570032 / -11.1% 535746030 / 483897321 / +10.7% 0.75 / 0.94 / -19.7%
tpch_q04/duckdb:vortex-file-compressed 259354672 / 325428858 / -20.3% 295008650 / 499436279 / -40.9% 🟢 0.88 / 0.65 / +34.9%
tpch_q05/duckdb:vortex-file-compressed 583722431 / 621038712 / -6.0% 604921319 / 683649339 / -11.5% 0.96 / 0.91 / +6.2%
tpch_q06/duckdb:vortex-file-compressed 188793375 / 152843376 / +23.5% 422179453 / 170451780 / +147.7% 🔴 0.45 / 0.90 / -50.1%
tpch_q07/duckdb:vortex-file-compressed 436831781 / 404795989 / +7.9% 521192979 / 491305582 / +6.1% 0.84 / 0.82 / +1.7%
tpch_q08/duckdb:vortex-file-compressed 599298172 / 668798196 / -10.4% 626081670 / 751786757 / -16.7% 0.96 / 0.89 / +7.6%
tpch_q09/duckdb:vortex-file-compressed 555521848 / 421578379 / +31.8% 🔴 593682390 / 480042290 / +23.7% 0.94 / 0.88 / +6.5%
tpch_q10/duckdb:vortex-file-compressed 570711690 / 502683132 / +13.5% 596835598 / 507516539 / +17.6% 0.96 / 0.99 / -3.5%
tpch_q11/duckdb:vortex-file-compressed 310893796 / 306492283 / +1.4% 352261247 / 349128374 / +0.9% 0.88 / 0.88 / +0.5%
tpch_q12/duckdb:vortex-file-compressed 253353469 / 322353167 / -21.4% 345233127 / 291682938 / +18.4% 0.73 / 1.11 / -33.6%
tpch_q13/duckdb:vortex-file-compressed 378248320 / 272400656 / +38.9% 🔴 357907995 / 235387511 / +52.1% 🔴 1.06 / 1.16 / -8.7%
tpch_q14/duckdb:vortex-file-compressed 226424030 / 232190994 / -2.5% 359508438 / 306148528 / +17.4% 0.63 / 0.76 / -17.0%
tpch_q15/duckdb:vortex-file-compressed 279031443 / 244343163 / +14.2% 414493185 / 271419296 / +52.7% 🔴 0.67 / 0.90 / -25.2%
tpch_q16/duckdb:vortex-file-compressed 211196056 / 216956071 / -2.7% 246556660 / 292436489 / -15.7% 0.86 / 0.74 / +15.5%
tpch_q17/duckdb:vortex-file-compressed 307203227 / 543125139 / -43.4% 🟢 422493276 / 686380777 / -38.4% 🟢 0.73 / 0.79 / -8.1%
tpch_q18/duckdb:vortex-file-compressed 331723694 / 307677029 / +7.8% 413262836 / 365210847 / +13.2% 0.80 / 0.84 / -4.7%
tpch_q19/duckdb:vortex-file-compressed 357567405 / 317071071 / +12.8% 404634185 / 299178194 / +35.2% 🔴 0.88 / 1.06 / -16.6%
tpch_q20/duckdb:vortex-file-compressed 383626865 / 413655532 / -7.3% 711544986 / 408878022 / +74.0% 🔴 0.54 / 1.01 / -46.7%
tpch_q21/duckdb:vortex-file-compressed 662212677 / 868359858 / -23.7% 582372825 / 717311905 / -18.8% 1.14 / 1.21 / -6.1%
tpch_q22/duckdb:vortex-file-compressed 242587458 / 227964836 / +6.4% 296234100 / 288270469 / +2.8% 0.82 / 0.79 / +3.6%
duckdb / vortex-compact / ns (0.931x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 198975896 / 188248573 / +5.7% 228156530 / 244313172 / -6.6% 0.87 / 0.77 / +13.2%
tpch_q02/duckdb:vortex-compact 727242649 / 415579486 / +75.0% 🔴 769102903 / 525142290 / +46.5% 🔴 0.95 / 0.79 / +19.5%
tpch_q03/duckdb:vortex-compact 370889637 / 400164219 / -7.3% 415191134 / 569518041 / -27.1% 0.89 / 0.70 / +27.1%
tpch_q04/duckdb:vortex-compact 210950017 / 231511107 / -8.9% 303595848 / 262794260 / +15.5% 0.69 / 0.88 / -21.1%
tpch_q05/duckdb:vortex-compact 543493692 / 612377020 / -11.2% 563287756 / 835327262 / -32.6% 🟢 0.96 / 0.73 / +31.6%
tpch_q06/duckdb:vortex-compact 163973587 / 200018038 / -18.0% 222904251 / 309696094 / -28.0% 0.74 / 0.65 / +13.9%
tpch_q07/duckdb:vortex-compact 404451599 / 525675651 / -23.1% 508340681 / 712073788 / -28.6% 0.80 / 0.74 / +7.8%
tpch_q08/duckdb:vortex-compact 560803431 / 707998370 / -20.8% 603215782 / 731067040 / -17.5% 0.93 / 0.97 / -4.0%
tpch_q09/duckdb:vortex-compact 432216530 / 469325365 / -7.9% 462072358 / 532241733 / -13.2% 0.94 / 0.88 / +6.1%
tpch_q10/duckdb:vortex-compact 533583294 / 498151019 / +7.1% 685747648 / 542801217 / +26.3% 0.78 / 0.92 / -15.2%
tpch_q11/duckdb:vortex-compact 302784316 / 357556494 / -15.3% 322015562 / 373628602 / -13.8% 0.94 / 0.96 / -1.7%
tpch_q12/duckdb:vortex-compact 219680596 / 286906138 / -23.4% 253467827 / 403380106 / -37.2% 🟢 0.87 / 0.71 / +21.9%
tpch_q13/duckdb:vortex-compact 248784526 / 292190106 / -14.9% 193962091 / 214641831 / -9.6% 1.28 / 1.36 / -5.8%
tpch_q14/duckdb:vortex-compact 230686078 / 229970775 / +0.3% 276552908 / 552868262 / -50.0% 🟢 0.83 / 0.42 / +100.5%
tpch_q15/duckdb:vortex-compact 258813329 / 260847011 / -0.8% 325251888 / 285943896 / +13.7% 0.80 / 0.91 / -12.8%
tpch_q16/duckdb:vortex-compact 226478317 / 186543193 / +21.4% 272344921 / 313218235 / -13.0% 0.83 / 0.60 / +39.6%
tpch_q17/duckdb:vortex-compact 324242407 / 377104567 / -14.0% 369995194 / 404970970 / -8.6% 0.88 / 0.93 / -5.9%
tpch_q18/duckdb:vortex-compact 368812292 / 420180112 / -12.2% 560343336 / 526960454 / +6.3% 0.66 / 0.80 / -17.5%
tpch_q19/duckdb:vortex-compact 354428693 / 313951489 / +12.9% 349366991 / 326457034 / +7.0% 1.01 / 0.96 / +5.5%
tpch_q20/duckdb:vortex-compact 378144355 / 481759175 / -21.5% 648059538 / 456582673 / +41.9% 🔴 0.58 / 1.06 / -44.7%
tpch_q21/duckdb:vortex-compact 509758138 / 654534428 / -22.1% 581531908 / 677495832 / -14.2% 0.88 / 0.97 / -9.3%
tpch_q22/duckdb:vortex-compact 252432654 / 288116166 / -12.4% 315392284 / 309821546 / +1.8% 0.80 / 0.93 / -13.9%
duckdb / parquet / ns (1.050x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 186273894 / 199930632 / -6.8% 276093194 / 233572181 / +18.2% 0.67 / 0.86 / -21.2%
tpch_q02/duckdb:parquet 440826250 / 422395638 / +4.4% 445312935 / 516664244 / -13.8% 0.99 / 0.82 / +21.1%
tpch_q03/duckdb:parquet 401015420 / 348387960 / +15.1% 461020894 / 428301244 / +7.6% 0.87 / 0.81 / +6.9%
tpch_q04/duckdb:parquet 254800275 / 283167717 / -10.0% 321316576 / 389817906 / -17.6% 0.79 / 0.73 / +9.2%
tpch_q05/duckdb:parquet 565879330 / 548001747 / +3.3% 646193573 / 579049202 / +11.6% 0.88 / 0.95 / -7.5%
tpch_q06/duckdb:parquet 261739888 / 170711901 / +53.3% 🔴 428899022 / 168796593 / +154.1% 🔴 0.61 / 1.01 / -39.7%
tpch_q07/duckdb:parquet 424208517 / 463334580 / -8.4% 470491737 / 526547243 / -10.6% 0.90 / 0.88 / +2.5%
tpch_q08/duckdb:parquet 599137123 / 598496566 / +0.1% 648020955 / 632127632 / +2.5% 0.92 / 0.95 / -2.3%
tpch_q09/duckdb:parquet 616932554 / 636643053 / -3.1% 615082267 / 628255359 / -2.1% 1.00 / 1.01 / -1.0%
tpch_q10/duckdb:parquet 625143084 / 584031465 / +7.0% 743941346 / 608595361 / +22.2% 0.84 / 0.96 / -12.4%
tpch_q11/duckdb:parquet 300859778 / 273542640 / +10.0% 306586150 / 248124930 / +23.6% 0.98 / 1.10 / -11.0%
tpch_q12/duckdb:parquet 259944259 / 248001253 / +4.8% 303189656 / 280112190 / +8.2% 0.86 / 0.89 / -3.2%
tpch_q13/duckdb:parquet 360535158 / 374513718 / -3.7% 453287041 / 441987663 / +2.6% 0.80 / 0.85 / -6.1%
tpch_q14/duckdb:parquet 270368412 / 263784463 / +2.5% 297313298 / 310612170 / -4.3% 0.91 / 0.85 / +7.1%
tpch_q15/duckdb:parquet 251540440 / 208840090 / +20.4% 382277587 / 241884484 / +58.0% 🔴 0.66 / 0.86 / -23.8%
tpch_q16/duckdb:parquet 273424012 / 267909819 / +2.1% 603718196 / 277894142 / +117.2% 🔴 0.45 / 0.96 / -53.0%
tpch_q17/duckdb:parquet 398273247 / 289641661 / +37.5% 🔴 592573223 / 399992906 / +48.1% 🔴 0.67 / 0.72 / -7.2%
tpch_q18/duckdb:parquet 381222295 / 310767094 / +22.7% 429433251 / 366761556 / +17.1% 0.89 / 0.85 / +4.8%
tpch_q19/duckdb:parquet 263571668 / 298763210 / -11.8% 333492258 / 394970299 / -15.6% 0.79 / 0.76 / +4.5%
tpch_q20/duckdb:parquet 464706214 / 442679833 / +5.0% 576875396 / 479920639 / +20.2% 0.81 / 0.92 / -12.7%
tpch_q21/duckdb:parquet 436561485 / 482285343 / -9.5% 529611402 / 484795630 / +9.2% 0.82 / 0.99 / -17.1%
tpch_q22/duckdb:parquet 297547205 / 304703986 / -2.3% 437683424 / 314795046 / +39.0% 🔴 0.68 / 0.97 / -29.8%

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Vortex queries (pr-full) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 6c0f3973 vs base 2fb259bf
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.7%
Engines: DataFusion No clear signal (-4.8%, environment too noisy confidence) · DuckDB No clear signal (-6.6%, environment too noisy confidence)
Vortex (geomean): hot 0.911x ➖ · cold 0.934x ➖
Parquet (geomean): hot 0.966x ➖ · cold 0.921x ➖
Shifts: Parquet (control) -3.4% · Median polish -5.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.874x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 372928637 / 417624735 / -10.7% 1322320893 / 1122355070 / +17.8% 0.28 / 0.37 / -24.2%
tpch_q02/datafusion:vortex-file-compressed 511555461 / 653989207 / -21.8% 1127947536 / 1197804541 / -5.8% 0.45 / 0.55 / -16.9%
tpch_q03/datafusion:vortex-file-compressed 645602208 / 1514804562 / -57.4% 🟢 1411543294 / 2431700852 / -42.0% 🟢 0.46 / 0.62 / -26.6%
tpch_q04/datafusion:vortex-file-compressed 484244526 / 465079318 / +4.1% 697415287 / 1062769449 / -34.4% 🟢 0.69 / 0.44 / +58.7%
tpch_q05/datafusion:vortex-file-compressed 722407475 / 747432148 / -3.3% 903199580 / 1020289257 / -11.5% 0.80 / 0.73 / +9.2%
tpch_q06/datafusion:vortex-file-compressed 265934493 / 417199834 / -36.3% 🟢 503135762 / 662084764 / -24.0% 0.53 / 0.63 / -16.1%
tpch_q07/datafusion:vortex-file-compressed 907494591 / 1044842954 / -13.1% 1487076790 / 1177953669 / +26.2% 0.61 / 0.89 / -31.2%
tpch_q08/datafusion:vortex-file-compressed 959352938 / 1229441794 / -22.0% 1200732786 / 1359489456 / -11.7% 0.80 / 0.90 / -11.7%
tpch_q09/datafusion:vortex-file-compressed 1015427784 / 1259035189 / -19.3% 1197064457 / 1262323044 / -5.2% 0.85 / 1.00 / -15.0%
tpch_q10/datafusion:vortex-file-compressed 874642824 / 675381328 / +29.5% 1605092671 / 973871290 / +64.8% 🔴 0.54 / 0.69 / -21.4%
tpch_q11/datafusion:vortex-file-compressed 484871169 / 531910664 / -8.8% 690756279 / 748064876 / -7.7% 0.70 / 0.71 / -1.3%
tpch_q12/datafusion:vortex-file-compressed 613459862 / 405910012 / +51.1% 🔴 943174960 / 606933823 / +55.4% 🔴 0.65 / 0.67 / -2.7%
tpch_q13/datafusion:vortex-file-compressed 369876932 / 348856427 / +6.0% 585041977 / 592770048 / -1.3% 0.63 / 0.59 / +7.4%
tpch_q14/datafusion:vortex-file-compressed 400130801 / 639302561 / -37.4% 🟢 664394157 / 706355760 / -5.9% 0.60 / 0.91 / -33.5%
tpch_q15/datafusion:vortex-file-compressed 650516652 / 704980156 / -7.7% 838805205 / 965830901 / -13.2% 0.78 / 0.73 / +6.2%
tpch_q16/datafusion:vortex-file-compressed 276714424 / 288648332 / -4.1% 425192850 / 423219467 / +0.5% 0.65 / 0.68 / -4.6%
tpch_q17/datafusion:vortex-file-compressed 752417041 / 761226264 / -1.2% 957248396 / 1191658124 / -19.7% 0.79 / 0.64 / +23.0%
tpch_q18/datafusion:vortex-file-compressed 1004719787 / 981533345 / +2.4% 1223550473 / 1028718105 / +18.9% 0.82 / 0.95 / -13.9%
tpch_q19/datafusion:vortex-file-compressed 435890024 / 581365133 / -25.0% 596025053 / 617651967 / -3.5% 0.73 / 0.94 / -22.3%
tpch_q20/datafusion:vortex-file-compressed 590408447 / 647789922 / -8.9% 798792684 / 806879041 / -1.0% 0.74 / 0.80 / -7.9%
tpch_q21/datafusion:vortex-file-compressed 1054447753 / 1167845695 / -9.7% 1161558299 / 1029563380 / +12.8% 0.91 / 1.13 / -20.0%
tpch_q22/datafusion:vortex-file-compressed 371646782 / 486750519 / -23.6% 697353886 / 719348456 / -3.1% 0.53 / 0.68 / -21.2%
datafusion / vortex-compact / ns (0.904x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 370826518 / 425238414 / -12.8% 997578557 / 980961211 / +1.7% 0.37 / 0.43 / -14.2%
tpch_q02/datafusion:vortex-compact 839909868 / 502823519 / +67.0% 🔴 1181895470 / 1002064451 / +17.9% 0.71 / 0.50 / +41.6%
tpch_q03/datafusion:vortex-compact 646297661 / 978713397 / -34.0% 🟢 1391712311 / 1810869385 / -23.1% 0.46 / 0.54 / -14.1%
tpch_q04/datafusion:vortex-compact 432693069 / 347505204 / +24.5% 612856702 / 571706325 / +7.2% 0.71 / 0.61 / +16.2%
tpch_q05/datafusion:vortex-compact 841180263 / 2254301118 / -62.7% 🟢 1215977502 / 1493970659 / -18.6% 0.69 / 1.51 / -54.2%
tpch_q06/datafusion:vortex-compact 329715980 / 368378695 / -10.5% 438487696 / 702181845 / -37.6% 🟢 0.75 / 0.52 / +43.3%
tpch_q07/datafusion:vortex-compact 928450104 / 980249201 / -5.3% 999660803 / 1321450912 / -24.4% 0.93 / 0.74 / +25.2%
tpch_q08/datafusion:vortex-compact 906239784 / 930592625 / -2.6% 1255758781 / 1123015253 / +11.8% 0.72 / 0.83 / -12.9%
tpch_q09/datafusion:vortex-compact 831653904 / 977746349 / -14.9% 1000085034 / 1178118492 / -15.1% 0.83 / 0.83 / +0.2%
tpch_q10/datafusion:vortex-compact 604133973 / 638888147 / -5.4% 888557038 / 954901185 / -6.9% 0.68 / 0.67 / +1.6%
tpch_q11/datafusion:vortex-compact 355355236 / 891377335 / -60.1% 🟢 662881411 / 1301630667 / -49.1% 🟢 0.54 / 0.68 / -21.7%
tpch_q12/datafusion:vortex-compact 352447170 / 363516585 / -3.0% 599281223 / 560999586 / +6.8% 0.59 / 0.65 / -9.2%
tpch_q13/datafusion:vortex-compact 263828761 / 324379031 / -18.7% 625674702 / 707086234 / -11.5% 0.42 / 0.46 / -8.1%
tpch_q14/datafusion:vortex-compact 415083508 / 368895177 / +12.5% 634352152 / 451706988 / +40.4% 🔴 0.65 / 0.82 / -19.9%
tpch_q15/datafusion:vortex-compact 675479276 / 925134936 / -27.0% 869209569 / 1665197511 / -47.8% 🟢 0.78 / 0.56 / +39.9%
tpch_q16/datafusion:vortex-compact 256579286 / 255451766 / +0.4% 446503270 / 433767909 / +2.9% 0.57 / 0.59 / -2.4%
tpch_q17/datafusion:vortex-compact 755221569 / 790147852 / -4.4% 948913026 / 927578165 / +2.3% 0.80 / 0.85 / -6.6%
tpch_q18/datafusion:vortex-compact 720508024 / 733190944 / -1.7% 874730170 / 865364524 / +1.1% 0.82 / 0.85 / -2.8%
tpch_q19/datafusion:vortex-compact 407055472 / 465878772 / -12.6% 525996361 / 648095112 / -18.8% 0.77 / 0.72 / +7.7%
tpch_q20/datafusion:vortex-compact 948086791 / 624991906 / +51.7% 🔴 976247384 / 749726995 / +30.2% 🔴 0.97 / 0.83 / +16.5%
tpch_q21/datafusion:vortex-compact 1157185220 / 998582615 / +15.9% 1393165530 / 1253524179 / +11.1% 0.83 / 0.80 / +4.3%
tpch_q22/datafusion:vortex-compact 316221737 / 324858099 / -2.7% 618216875 / 1099671741 / -43.8% 🟢 0.51 / 0.30 / +73.1%
datafusion / parquet / ns (0.934x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 236381652 / 284726477 / -17.0% 624385451 / 967408455 / -35.5% 🟢 0.38 / 0.29 / +28.6%
tpch_q02/datafusion:parquet 500642564 / 496319796 / +0.9% 1009885677 / 1211202922 / -16.6% 0.50 / 0.41 / +21.0%
tpch_q03/datafusion:parquet 482067726 / 512763379 / -6.0% 906794015 / 1107973137 / -18.2% 0.53 / 0.46 / +14.9%
tpch_q04/datafusion:parquet 243784413 / 379617077 / -35.8% 🟢 553615737 / 542074110 / +2.1% 0.44 / 0.70 / -37.1%
tpch_q05/datafusion:parquet 590213474 / 614647850 / -4.0% 989091549 / 982657633 / +0.7% 0.60 / 0.63 / -4.6%
tpch_q06/datafusion:parquet 207955708 / 185128292 / +12.3% 370696645 / 375845842 / -1.4% 0.56 / 0.49 / +13.9%
tpch_q07/datafusion:parquet 674205904 / 657418964 / +2.6% 754061935 / 817902453 / -7.8% 0.89 / 0.80 / +11.2%
tpch_q08/datafusion:parquet 1250202077 / 776283004 / +61.0% 🔴 1396987767 / 971694965 / +43.8% 🔴 0.89 / 0.80 / +12.0%
tpch_q09/datafusion:parquet 1075410793 / 825991162 / +30.2% 🔴 1308497926 / 1114090675 / +17.4% 0.82 / 0.74 / +10.9%
tpch_q10/datafusion:parquet 1068028874 / 1641053177 / -34.9% 🟢 1431479353 / 1697143825 / -15.7% 0.75 / 0.97 / -22.8%
tpch_q11/datafusion:parquet 389290056 / 501586428 / -22.4% 577221363 / 893550986 / -35.4% 🟢 0.67 / 0.56 / +20.1%
tpch_q12/datafusion:parquet 384742997 / 387610703 / -0.7% 532002900 / 969760215 / -45.1% 🟢 0.72 / 0.40 / +80.9%
tpch_q13/datafusion:parquet 487714356 / 446106749 / +9.3% 705972440 / 707743896 / -0.3% 0.69 / 0.63 / +9.6%
tpch_q14/datafusion:parquet 394034103 / 407104385 / -3.2% 625562132 / 616286380 / +1.5% 0.63 / 0.66 / -4.6%
tpch_q15/datafusion:parquet 578460627 / 607094768 / -4.7% 802329902 / 895654908 / -10.4% 0.72 / 0.68 / +6.4%
tpch_q16/datafusion:parquet 226214508 / 319475396 / -29.2% 438520277 / 494970215 / -11.4% 0.52 / 0.65 / -20.1%
tpch_q17/datafusion:parquet 631889318 / 763208599 / -17.2% 778577415 / 815465399 / -4.5% 0.81 / 0.94 / -13.3%
tpch_q18/datafusion:parquet 644029361 / 806594406 / -20.2% 872025433 / 1008169169 / -13.5% 0.74 / 0.80 / -7.7%
tpch_q19/datafusion:parquet 458974601 / 449842267 / +2.0% 616279080 / 541214785 / +13.9% 0.74 / 0.83 / -10.4%
tpch_q20/datafusion:parquet 699663820 / 839651855 / -16.7% 902697503 / 770184538 / +17.2% 0.78 / 1.09 / -28.9%
tpch_q21/datafusion:parquet 911035011 / 947274950 / -3.8% 1137341021 / 1223704766 / -7.1% 0.80 / 0.77 / +3.5%
tpch_q22/datafusion:parquet 417738335 / 429857091 / -2.8% 953888730 / 786860477 / +21.2% 0.44 / 0.55 / -19.8%
duckdb / vortex-file-compressed / ns (0.948x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 1055629081 / 1025379169 / +3.0% 1556733047 / 1513542447 / +2.9% 0.68 / 0.68 / +0.1%
tpch_q02/duckdb:vortex-file-compressed 670467370 / 558390521 / +20.1% 597197991 / 666185658 / -10.4% 1.12 / 0.84 / +33.9%
tpch_q03/duckdb:vortex-file-compressed 1248165722 / 1399034010 / -10.8% 1527407348 / 1745966384 / -12.5% 0.82 / 0.80 / +2.0%
tpch_q04/duckdb:vortex-file-compressed 1154766742 / 1043016443 / +10.7% 1378909692 / 1300050271 / +6.1% 0.84 / 0.80 / +4.4%
tpch_q05/duckdb:vortex-file-compressed 1271703527 / 1125034244 / +13.0% 1479920949 / 1285927328 / +15.1% 0.86 / 0.87 / -1.8%
tpch_q06/duckdb:vortex-file-compressed 781400996 / 1056779450 / -26.1% 903005215 / 1086608222 / -16.9% 0.87 / 0.97 / -11.0%
tpch_q07/duckdb:vortex-file-compressed 1240521733 / 1776429646 / -30.2% 🟢 1468963255 / 2277064780 / -35.5% 🟢 0.84 / 0.78 / +8.2%
tpch_q08/duckdb:vortex-file-compressed 1527900529 / 1275471735 / +19.8% 1726951213 / 1427594752 / +21.0% 0.88 / 0.89 / -1.0%
tpch_q09/duckdb:vortex-file-compressed 1442357325 / 1505907849 / -4.2% 1949467602 / 1995050480 / -2.3% 0.74 / 0.75 / -2.0%
tpch_q10/duckdb:vortex-file-compressed 1536953260 / 1539298793 / -0.2% 1877284408 / 2145926487 / -12.5% 0.82 / 0.72 / +14.1%
tpch_q11/duckdb:vortex-file-compressed 614857692 / 391884913 / +56.9% 🔴 638301416 / 443475987 / +43.9% 🔴 0.96 / 0.88 / +9.0%
tpch_q12/duckdb:vortex-file-compressed 979646865 / 1082767798 / -9.5% 1201977811 / 1423865179 / -15.6% 0.82 / 0.76 / +7.2%
tpch_q13/duckdb:vortex-file-compressed 406739470 / 574231618 / -29.2% 647559599 / 683612870 / -5.3% 0.63 / 0.84 / -25.2%
tpch_q14/duckdb:vortex-file-compressed 935070511 / 1109783461 / -15.7% 1125433250 / 1198270967 / -6.1% 0.83 / 0.93 / -10.3%
tpch_q15/duckdb:vortex-file-compressed 878625663 / 875304250 / +0.4% 1049833421 / 989007410 / +6.2% 0.84 / 0.89 / -5.4%
tpch_q16/duckdb:vortex-file-compressed 290631748 / 314707908 / -7.7% 393223552 / 434721842 / -9.5% 0.74 / 0.72 / +2.1%
tpch_q17/duckdb:vortex-file-compressed 1031666511 / 1056471005 / -2.3% 1214128284 / 1550489149 / -21.7% 0.85 / 0.68 / +24.7%
tpch_q18/duckdb:vortex-file-compressed 1076938571 / 1421618089 / -24.2% 1281789127 / 1521609557 / -15.8% 0.84 / 0.93 / -10.1%
tpch_q19/duckdb:vortex-file-compressed 1044780938 / 1081660618 / -3.4% 1177534403 / 1110739760 / +6.0% 0.89 / 0.97 / -8.9%
tpch_q20/duckdb:vortex-file-compressed 1115127703 / 1173203984 / -5.0% 1286799183 / 1555762032 / -17.3% 0.87 / 0.75 / +14.9%
tpch_q21/duckdb:vortex-file-compressed 2432050831 / 2596909997 / -6.3% 2527683491 / 2673151487 / -5.4% 0.96 / 0.97 / -1.0%
tpch_q22/duckdb:vortex-file-compressed 360473405 / 473927943 / -23.9% 540287120 / 576133067 / -6.2% 0.67 / 0.82 / -18.9%
duckdb / vortex-compact / ns (0.919x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1007572604 / 961240923 / +4.8% 1250025249 / 1469154539 / -14.9% 0.81 / 0.65 / +23.2%
tpch_q02/duckdb:vortex-compact 524666800 / 641934492 / -18.3% 660902570 / 901334944 / -26.7% 0.79 / 0.71 / +11.5%
tpch_q03/duckdb:vortex-compact 1215475476 / 1225669220 / -0.8% 1525774731 / 1498620581 / +1.8% 0.80 / 0.82 / -2.6%
tpch_q04/duckdb:vortex-compact 883249289 / 981733908 / -10.0% 1190508547 / 1990408475 / -40.2% 🟢 0.74 / 0.49 / +50.4%
tpch_q05/duckdb:vortex-compact 1021269896 / 1128163301 / -9.5% 1246869384 / 1568445549 / -20.5% 0.82 / 0.72 / +13.9%
tpch_q06/duckdb:vortex-compact 732596735 / 824713006 / -11.2% 875651781 / 907285024 / -3.5% 0.84 / 0.91 / -8.0%
tpch_q07/duckdb:vortex-compact 1280632400 / 1202793524 / +6.5% 1787999285 / 1497297229 / +19.4% 0.72 / 0.80 / -10.8%
tpch_q08/duckdb:vortex-compact 1109890164 / 1421270970 / -21.9% 1367627061 / 1737614101 / -21.3% 0.81 / 0.82 / -0.8%
tpch_q09/duckdb:vortex-compact 1306167167 / 1775357030 / -26.4% 1418204727 / 1833812851 / -22.7% 0.92 / 0.97 / -4.9%
tpch_q10/duckdb:vortex-compact 1368704901 / 1584540675 / -13.6% 1579219574 / 2000914359 / -21.1% 0.87 / 0.79 / +9.4%
tpch_q11/duckdb:vortex-compact 528394141 / 424847585 / +24.4% 2972290846 / 508949693 / +484.0% 🔴 0.18 / 0.83 / -78.7%
tpch_q12/duckdb:vortex-compact 988658320 / 1107818419 / -10.8% 1058793349 / 1236729661 / -14.4% 0.93 / 0.90 / +4.2%
tpch_q13/duckdb:vortex-compact 423719206 / 466637708 / -9.2% 504810133 / 663208874 / -23.9% 0.84 / 0.70 / +19.3%
tpch_q14/duckdb:vortex-compact 1101747940 / 1182481603 / -6.8% 1181313135 / 1243268444 / -5.0% 0.93 / 0.95 / -1.9%
tpch_q15/duckdb:vortex-compact 918054676 / 921452434 / -0.4% 999062766 / 1068509183 / -6.5% 0.92 / 0.86 / +6.6%
tpch_q16/duckdb:vortex-compact 307621831 / 368956268 / -16.6% 375511033 / 375408250 / +0.0% 0.82 / 0.98 / -16.6%
tpch_q17/duckdb:vortex-compact 1073380114 / 1340515800 / -19.9% 1083819349 / 1151317918 / -5.9% 0.99 / 1.16 / -14.9%
tpch_q18/duckdb:vortex-compact 1096216652 / 1051189198 / +4.3% 1173905334 / 1273044610 / -7.8% 0.93 / 0.83 / +13.1%
tpch_q19/duckdb:vortex-compact 1241297154 / 1425154535 / -12.9% 1237872124 / 1700466277 / -27.2% 1.00 / 0.84 / +19.6%
tpch_q20/duckdb:vortex-compact 1029829457 / 1285788532 / -19.9% 1244779029 / 1758271373 / -29.2% 0.83 / 0.73 / +13.1%
tpch_q21/duckdb:vortex-compact 2296215005 / 2333226449 / -1.6% 2528166171 / 2477728711 / +2.0% 0.91 / 0.94 / -3.5%
tpch_q22/duckdb:vortex-compact 607542284 / 560005058 / +8.5% 624295793 / 911015834 / -31.5% 🟢 0.97 / 0.61 / +58.3%
duckdb / parquet / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 440495385 / 313433439 / +40.5% 🔴 503696451 / 524811309 / -4.0% 0.87 / 0.60 / +46.4%
tpch_q02/duckdb:parquet 629283789 / 681920127 / -7.7% 796300606 / 923431275 / -13.8% 0.79 / 0.74 / +7.0%
tpch_q03/duckdb:parquet 645044876 / 618862912 / +4.2% 907305681 / 1065906858 / -14.9% 0.71 / 0.58 / +22.5%
tpch_q04/duckdb:parquet 400700735 / 556767775 / -28.0% 602666646 / 777784093 / -22.5% 0.66 / 0.72 / -7.1%
tpch_q05/duckdb:parquet 777498887 / 781181297 / -0.5% 1122333501 / 1048822325 / +7.0% 0.69 / 0.74 / -7.0%
tpch_q06/duckdb:parquet 276172154 / 245349851 / +12.6% 324554802 / 400242617 / -18.9% 0.85 / 0.61 / +38.8%
tpch_q07/duckdb:parquet 880773234 / 950348105 / -7.3% 865759947 / 1012715354 / -14.5% 1.02 / 0.94 / +8.4%
tpch_q08/duckdb:parquet 1043901918 / 1094630162 / -4.6% 880888962 / 1062436739 / -17.1% 1.19 / 1.03 / +15.0%
tpch_q09/duckdb:parquet 1173563160 / 1013414135 / +15.8% 1828490714 / 1151658374 / +58.8% 🔴 0.64 / 0.88 / -27.1%
tpch_q10/duckdb:parquet 878572513 / 839958403 / +4.6% 1100163483 / 1189280538 / -7.5% 0.80 / 0.71 / +13.1%
tpch_q11/duckdb:parquet 367498342 / 330796740 / +11.1% 402159581 / 420863336 / -4.4% 0.91 / 0.79 / +16.3%
tpch_q12/duckdb:parquet 437890855 / 395791299 / +10.6% 588966428 / 515268320 / +14.3% 0.74 / 0.77 / -3.2%
tpch_q13/duckdb:parquet 622256762 / 636691941 / -2.3% 680563506 / 828972304 / -17.9% 0.91 / 0.77 / +19.0%
tpch_q14/duckdb:parquet 592310615 / 557800849 / +6.2% 725077426 / 588866901 / +23.1% 0.82 / 0.95 / -13.8%
tpch_q15/duckdb:parquet 339168183 / 354296760 / -4.3% 384633296 / 454328371 / -15.3% 0.88 / 0.78 / +13.1%
tpch_q16/duckdb:parquet 376937377 / 360290176 / +4.6% 430490812 / 400963749 / +7.4% 0.88 / 0.90 / -2.6%
tpch_q17/duckdb:parquet 469614988 / 431488553 / +8.8% 514239736 / 496225662 / +3.6% 0.91 / 0.87 / +5.0%
tpch_q18/duckdb:parquet 542117581 / 523815033 / +3.5% 826000633 / 575815102 / +43.4% 🔴 0.66 / 0.91 / -27.9%
tpch_q19/duckdb:parquet 601316518 / 622951134 / -3.5% 787678270 / 764071567 / +3.1% 0.76 / 0.82 / -6.4%
tpch_q20/duckdb:parquet 876112237 / 871122497 / +0.6% 809059716 / 2138571974 / -62.2% 🟢 1.08 / 0.41 / +165.8%
tpch_q21/duckdb:parquet 688426210 / 801712626 / -14.1% 726855856 / 724926572 / +0.3% 0.95 / 1.11 / -14.4%
tpch_q22/duckdb:parquet 562558736 / 785687322 / -28.4% 621030939 / 1366963857 / -54.6% 🟢 0.91 / 0.57 / +57.6%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

DuckDB on Vortex fails the TPC-DS nightly since the tables were split into files

2 participants