Skip to content

build(deps): vortex-jni 0.93.0, with Rust's uuid file statistics - #730

Merged
dfa1 merged 1 commit into
mainfrom
build/vortex-jni-0.93
Nov 12, 2026
Merged

dfa1 merged 1 commit into
mainfrom
build/vortex-jni-0.93

Conversation

@dfa1

@dfa1 dfa1 commented Nov 12, 2026

Copy link
Copy Markdown
Owner

Replaces #720 (dependabot's POM-only bump). That bump passed CI only because no cross-check covered UUID statistics.

Parity fix: vortex.uuid file statistics. From 0.92, Rust imports arrow.uuid as vortex.uuid and records its min and max in the file statistics: a FixedSizeList(U8, 16) scalar, exact, in unsigned byte order. (vortex-data/vortex#11299 is what lets vortex-jni hand these to Java.) FileStatsAccumulator now writes the same, so a UUID column's footer matches vortex-jni's byte for byte. WriteSummary reports the bounds as UUIDs. Note that UUID.compareTo uses a different order, comparing signed longs.

New cross-check FileStatisticsInteropIntegrationTest#uuidColumn_writesTheStatisticsJniWrites covers this. Before the fix, Rust wrote min=4a48…/1 max=4a4b…/1 and Java wrote min=-/0 max=-/0. Unit tests cover the unsigned order, the 16-u8 list scalar, nulls across batches and an all-null column.

Unblocked by 0.93:

  • DictAllTypesInteropIntegrationTest's uuid case. It was skipped because vortex-jni 0.90 couldn't close a writer with a UUID column.
  • JavaWritesRustReadsIntegrationTest#javaWriter_rustReader_nullable_uuid, @Disabled since vortex-jni 0.74. Rust now exports vortex.uuid as Arrow's arrow.uuid (#11224), so the test asserts UUIDs.

Checked, nothing to change:

  • #10995 (canonical decimal widths): Java writes vortex.decimal at its precision's canonical width, and narrows only through vortex.decimal_byte_parts, the same way Rust does.
  • Rust 0.91 → 0.93 has no compressor, scheme or layout changes, so default file sizes are unaffected.

Docs: the 0.91.0 pins move to 0.93.0 (compatibility, reference, explanation, including the jar size), and the WriteSummary docs now describe UUID bounds.

🤖 Generated with Claude Code

https://claude.ai/code/session_011fRbYvRdQi45rxQgF3QMMP

@dfa1
dfa1 force-pushed the build/vortex-jni-0.93 branch 2 times, most recently from ef91d18 to b8e1382 Compare November 12, 2026 20:41
From 0.92 Rust imports arrow.uuid as vortex.uuid and records its min and max
in the file statistics: a FixedSizeList(U8, 16) scalar, exact, in unsigned
byte order (vortex-data/vortex#11299 let vortex-jni hand them back to Java).
FileStatsAccumulator now does the same, so a uuid column's footer matches
vortex-jni's byte for byte, and WriteSummary reports the bounds as UUIDs.
UUID.compareTo is not that order: it compares signed longs.

0.93 also unblocks two uuid cross-checks that were skipped:
- DictAllTypesInteropIntegrationTest's uuid case: vortex-jni 0.90 could not
  close a writer with a uuid column;
- JavaWritesRustReadsIntegrationTest#javaWriter_rustReader_nullable_uuid,
  disabled since vortex-jni 0.74, which could not export vortex.uuid to
  Arrow. Rust now exports it as Arrow's arrow.uuid (vortex-data/vortex#11224),
  so the test reads UUIDs instead of 16-byte binaries.

Rust 0.92's canonical-decimal change (vortex-data/vortex#10995) needs nothing
here: vortex-java writes vortex.decimal at its precision's canonical width
and narrows only through vortex.decimal_byte_parts, as Rust does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011fRbYvRdQi45rxQgF3QMMP
@dfa1
dfa1 force-pushed the build/vortex-jni-0.93 branch from b8e1382 to fcbd900 Compare November 12, 2026 21:12
@dfa1
dfa1 merged commit d2c385a into main Nov 12, 2026
6 checks passed
@dfa1
dfa1 deleted the build/vortex-jni-0.93 branch November 18, 2026 21:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant