setCharacterState method
Sets the characters' state.
fromSymbol
first symboltoSymbol
last symbolstate
tokenizer state
Implementation
void setCharacterState(int fromSymbol, int toSymbol, ITokenizerState state) {
_map.addInterval(fromSymbol, toSymbol, state);
}