bosId top-level constant
int
const bosId
Gemma special-token IDs, added by this package rather than by the loader:
loadEmbeddingTokenizer passes an explicit SentencePieceConfig with
addBosToken/addEosToken false, and every loader version takes the
caller's config over the file's post_processor. So these are the only
terminators encodeForEmbedding produces, whatever the file declares.
Implementation
const int bosId = 2;