Tokenizer class

Constructors

Tokenizer({bool yieldTokens = false, Set<String>? delimiters})

Properties

delimiters Set<String>
final
hashCode int
The hash code for this object.
no setterinherited
runtimeType Type
A representation of the runtime type of the object.
no setterinherited
yieldTokens bool
final

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
tokenize(String? chunk) Iterable<Token>
toString() String
A string representation of this object.
inherited

Operators

operator ==(Object other) bool
The equality operator.
inherited