tokenizeBuffer abstract method

List<Token> tokenizeBuffer(
  1. String buffer
)

Tokenizes a string buffer into a list of tokens structures.

  • buffer A string buffer to be tokenized. Returns A list of token structures.

Implementation

List<Token> tokenizeBuffer(String buffer);