Repository navigation
Move FastLanes Delta into the preview edition - #11438
Conversation
Polar Signals Profiling ResultsLatest Run
Previous Runs (73)
Powered by Polar Signals Cloud |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
Benchmarks: PolarSignals Profiling 📖Commits: PR datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
No file size changes detected. |
Benchmarks: FineWeb NVMe 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.033x ➖, 0↑ 2↓)
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
duckdb / parquet / ns (0.980x ➖, 0↑ 0↓)
No file size changes detected. |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
Benchmarks: TPC-H SF=1 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 1↓)
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
No file size changes detected. |
|
Outdated: this Generated by Claude Code |
Benchmarks: TPC-H SF=10 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
No file size changes detected. |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
Benchmarks: TPC-DS SF=1 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 1↓)
duckdb / parquet / ns (1.001x ➖, 2↑ 1↓)
No file size changes detected. |
Benchmarks: Clickbench on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.997x ➖, 1↑ 0↓)
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
duckdb / parquet / ns (0.997x ➖, 1↑ 0↓)
No file size changes detected. |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
|
Outdated: this Generated by Claude Code |
Benchmarks: TPC-H SF=1 on S3 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.982x ➖, 2↑ 2↓)
datafusion / parquet / ns (1.084x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed / ns (1.178x ➖, 0↑ 2↓)
duckdb / parquet / ns (1.025x ➖, 0↑ 0↓)
|
Benchmarks: TPC-DS SF=10 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.034x ➖, 0↑ 10↓)
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.024x ➖, 1↑ 8↓)
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
File Size Changes (33 files changed, -10.2% overall, 7↑ 26↓)
Totals:
|
1ead06d to
780788e
Compare
Merging this PR will not alter performance1 warning
Comparing Footnotes
|
Move `fastlanes.delta` from the `unstable` edition into the draft `preview2026.08.0` edition, and enable the default preview edition on the benchmark session so benchmark writes can select the Delta scheme. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01UeniB9qpUTjRzFTWu15i47 Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
`fastlanes.delta` is now in `preview` rather than `unstable`, so `enable_unstable_encodings` enables both editions. The string benchmark sessions, which only call that helper, keep writing Delta. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01UeniB9qpUTjRzFTWu15i47 Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
780788e to
0d0edb4
Compare
Delta's serialized form was settled in #11441, and with the fused decode and kernels (#11428) and the sampled estimator (#11453) it is cheap enough to offer for broad opt-in use. This moves
fastlanes.deltafromunstableinto the draftpreview2026.08.0edition, so Delta's wire format becomes fixed when that edition freezes. Writers that enable onlycorestill never write Delta.Benchmark sessions now enable
previewas well asunstablethroughenable_unstable_encodings, so every benchmark keeps writing Delta. This also enablespreview's other member, thevortex.uncompressed_size_in_bytesaggregate, in benchmark files. PR benchmarks againstdevelop, which already writes Delta throughunstable, are flat.🤖 Generated with Claude Code