You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Page-size check prevents mmap for blob-aligned checkpoints #1031
ChooseMode disables mmap when the checkpoint size is not divisible by the system page size, even if the file is padded to the blob format's 256-byte alignment.
For example, the 4B checkpoint is 5,401,208,832 bytes: divisible by 256, but with a 2,048-byte remainder on a 4,096-byte page system. It therefore falls back to copying the weights into allocated memory instead of using file-backed mappings.
Proposed fix
Relax the file-length alignment requirement from the base page size to kBlobAlign (256 bytes).
The OS accepts partial-page mappings, but inference kernels can read multiple vectors ahead. Retain the blob-alignment guard and fall back to ordinary reads for lengths that do not meet it. Arbitrary-length mmap support would require separate handling of those reads.
changed the title [-]Allow mmap for checkpoints with a partial final page[/-][+]Page-size check prevents mmap for blob-aligned checkpoints[/+]on Sep 15, 2026
Activity
[-]Allow mmap for checkpoints with a partial final page[/-][+]Page-size check prevents mmap for blob-aligned checkpoints[/+]