setCharacterState method

void setCharacterState(
  1. int fromSymbol,
  2. int toSymbol,
  3. ITokenizerState state
)

Sets the characters' state.

  • fromSymbol first symbol
  • toSymbol last symbol
  • state tokenizer state

Implementation

void setCharacterState(int fromSymbol, int toSymbol, ITokenizerState state) {
  _map.addInterval(fromSymbol, toSymbol, state);
}