Skip to content

Migrate gemma_cpp SentencePieceTokenizer to SentencePiece Lite (SentencePieceLiteProcessor), supporting both serialized ModelProto and FlatBuffer (.spm.fb) model blobs. - #1087

Open
copybara-service[bot] wants to merge 1 commit into
devfrom
test_1017935613