tokenizeStreamToStrings method

@override List<String?> tokenizeStreamToStrings(IScanner scanner)

Creates a list of token values.

• scanner scanner Returns list of token values

Implementation

@override
List<String?> tokenizeStreamToStrings(IScanner scanner) {
  this.scanner = scanner;
  var stringList = <String?>[];
  for (var token = nextToken(); token != null; token = nextToken()) {
    stringList.add(token.value);
  }
  return stringList;
}