getCharacterState method
Gest the state for a given character.
symbol
symbol Returns tokenizer state
Implementation
ITokenizerState? getCharacterState(int symbol) => _map.lookup(symbol);
Gest the state for a given character.
symbol
symbol
Returns tokenizer stateITokenizerState? getCharacterState(int symbol) => _map.lookup(symbol);