BpeTokenizerCleared constructor
const
BpeTokenizerCleared(
- MainBpeTokenizerState mainBpeTokenizerState
Implementation
const BpeTokenizerCleared(MainBpeTokenizerState mainBpeTokenizerState)
: super(mainBpeTokenizerState);