scanTokens method

List<Token> scanTokens(
  1. String source
)

Implementation

List<Token> scanTokens(String source) {
  reset();
  this.source = source;
  start = 0;
  current = 0;
  line = 1;
  tokens.clear();

  while (!isAtEnd()) {
    start = current;
    scanToken();
  }

  tokens.add(_getCachedToken(TokenType.eof, "", null, line));
  return tokens;
}