Repository navigation
Conversation
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
ArraySlots inline capacity to five
commented
Oct 5, 2026
Merging this PR will degrade performance by 13.65%
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Simulation | take[small_m/shuffled/primitive/nonnull/chunks=2048/indices=64] |
280.1 µs | 482.4 µs | -41.93% |
| ❌ | Simulation | decompress[u8, (4000, 256)] |
34.5 µs | 48.3 µs | -28.57% |
| ❌ | Simulation | take_varbin |
332.8 µs | 415.2 µs | -19.86% |
| ❌ | Simulation | whole_array_sum_partially_valid |
65 µs | 81 µs | -19.66% |
| ❌ | Simulation | decompress[u16, (4000, 256)] |
51.5 µs | 60.5 µs | -14.81% |
| ⚡ | Simulation | bench_many_nulls[0.01] |
60 µs | 32.9 µs | +82.19% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing mk/array-slots-inline-five (89cfd51) with develop (e8e48c8)
Footnotes
-
518 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
commented
Oct 5, 2026
|
How large is this struct now? |
|
@joseph-isaacs I believe |
commented
Oct 5, 2026
|
How does this affect the system do you think? |
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
commented
Oct 5, 2026
Benchmarks: PolarSignals Profiling 📖Commits: PR datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: FineWeb NVMe 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.985x ➖, 0↑ 0↓)
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (0.995x ➖, 2↑ 2↓)
duckdb / parquet / ns (0.978x ➖, 1↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: TPC-H SF=1 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
duckdb / parquet / ns (1.007x ➖, 0↑ 1↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: TPC-DS SF=1 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.001x ➖, 1↑ 3↓)
duckdb / parquet / ns (1.006x ➖, 1↑ 2↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: TPC-H SF=10 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 1↓)
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: PolarSignals Profiling 📖Commits: PR datafusion / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: FineWeb NVMe 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)
datafusion / vortex-compact / ns (0.947x ➖, 2↑ 0↓)
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (0.920x ➖, 4↑ 1↓)
duckdb / vortex-compact / ns (1.064x ➖, 1↑ 3↓)
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: Clickbench on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (0.983x ➖, 2↑ 0↓)
duckdb / parquet / ns (0.988x ➖, 1↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: TPC-H SF=1 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 1↓)
duckdb / vortex-compact / ns (1.008x ➖, 0↑ 2↓)
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: TPC-H SF=1 on S3 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.043x ➖, 1↑ 3↓)
datafusion / parquet / ns (1.006x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed / ns (1.094x ➖, 0↑ 3↓)
duckdb / parquet / ns (1.092x ➖, 0↑ 1↓)
|
commented
Oct 5, 2026
Benchmarks: Clickbench Sorted on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
datafusion / vortex-compact / ns (1.043x ➖, 0↑ 1↓)
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (0.961x ➖, 2↑ 0↓)
duckdb / vortex-compact / ns (1.010x ➖, 0↑ 1↓)
duckdb / parquet / ns (0.992x ➖, 2↑ 0↓)
File Size Changes (200 files changed, -0.0% overall, 92↑ 108↓)
Totals:
|
commented
Oct 5, 2026
Benchmarks: Appian on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: FineWeb S3 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.947x ➖, 1↑ 1↓)
datafusion / vortex-compact / ns (1.230x ➖, 0↑ 2↓)
datafusion / parquet / ns (2.556x ❌, 0↑ 9↓)
duckdb / vortex-file-compressed / ns (1.070x ➖, 0↑ 0↓)
duckdb / vortex-compact / ns (0.968x ➖, 0↑ 0↓)
duckdb / parquet / ns (1.351x ❌, 0↑ 6↓)
|
commented
Oct 5, 2026
Benchmarks: TPC-DS SF=1 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 1↓)
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.000x ➖, 3↑ 3↓)
duckdb / vortex-compact / ns (1.000x ➖, 1↑ 3↓)
duckdb / parquet / ns (0.999x ➖, 1↑ 2↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: TPC-H SF=10 on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
duckdb / vortex-compact / ns (0.981x ➖, 2↑ 0↓)
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: Statistical and Population Genetics 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
datafusion / vortex-compact / ns (1.012x ➖, 0↑ 0↓)
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
duckdb / parquet / ns (1.012x ➖, 0↑ 0↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: Clickbench on NVME 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (0.974x ➖, 5↑ 1↓)
duckdb / vortex-compact / ns (0.985x ➖, 1↑ 2↓)
duckdb / parquet / ns (0.986x ➖, 4↑ 1↓)
No file size changes detected. |
commented
Oct 5, 2026
Benchmarks: TPC-H SF=1 on S3 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-file-compressed / ns (1.043x ➖, 1↑ 4↓)
datafusion / vortex-compact / ns (1.100x ➖, 0↑ 3↓)
datafusion / parquet / ns (1.018x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed / ns (1.026x ➖, 0↑ 1↓)
duckdb / vortex-compact / ns (0.967x ➖, 1↑ 1↓)
duckdb / parquet / ns (1.090x ➖, 0↑ 1↓)
|
commented
Oct 5, 2026
Benchmarks: TPC-H SF=10 on S3 📖Commits: PR How to read Verdict and Engines
datafusion / vortex-compact / ns (0.941x ➖, 5↑ 1↓)
datafusion / parquet / ns (1.025x ➖, 1↑ 0↓)
duckdb / vortex-compact / ns (1.041x ➖, 0↑ 0↓)
duckdb / parquet / ns (0.902x ➖, 0↑ 0↓)
|
commented
Oct 5, 2026
Benchmarks: String Encoding 📖Commits: PR vortex / vortex-file-compressed / ms (1.000x ➖, 0↑ 0↓)
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
|
commented
Oct 5, 2026
Benchmarks: Compression 📖Commits: PR vortex / vortex-file-compressed / ns (0.986x ➖, 0↑ 0↓)
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
vortex / vortex-file-compressed / ratio (0.990x ➖, 0↑ 0↓)
vortex / parquet / ns (1.001x ➖, 0↑ 0↓)
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
vortex / arrow-ipc / ns (0.993x ➖, 1↑ 1↓)
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
|
commented
Oct 5, 2026
Benchmarks: Random Access 📖Commits: PR How to read Verdict and Engines
vortex / arrow-ipc / ns (1.073x ➖, 0↑ 2↓)
random-access / vortex-file-compressed / ns (1.012x ➖, 0↑ 1↓)
random-access / parquet / ns (0.982x ➖, 1↑ 0↓)
random-access / lance / ns (0.992x ➖, 0↑ 0↓)
|
commented
Oct 5, 2026
Benchmarks: Random Access (S3) 📖Commits: PR How to read Verdict and Engines
random-access / vortex-file-compressed / ns (1.280x ➖, 0↑ 8↓)
random-access / parquet / ns (1.089x ➖, 0↑ 2↓)
random-access / lance / ns (1.300x ➖, 1↑ 8↓)
|
commented
Oct 13, 2026
|
Any reason you closed this? |
Summary
#10004 adds a fifth
BitPackedchild slot. WithArraySlots' inline capacity of four, even global-width arrays allocate heap storage for their slots when the new child is absent.Changes
Increase
ArraySlots' inline capacity from 4 to 5. This keeps five-slot arrays inline, at the cost of reserving one additional inline slot in every array header.