BpeTokenizerLoading constructor
const
BpeTokenizerLoading(
- MainBpeTokenizerState mainBpeTokenizerState
Implementation
const BpeTokenizerLoading(MainBpeTokenizerState mainBpeTokenizerState)
: super(mainBpeTokenizerState);