TokenizeState enum

This defines the different states the tokenizer can be in while it's scanning through the source code. Tokenizers are state machines, which means the only data they need to store is where they are in the source code and this one "state" or mode value.

One of the main differences between tokenizing and parsing is this regularity. Because the tokenizer stores only this one state value, it can't handle nesting (which would require also storing a number to identify how deeply nested you are). The parser is able to handle that.


COMMENT → const TokenizeState
const TokenizeState(7)
DEFAULT → const TokenizeState
const TokenizeState(0)
HTML_COMMENT → const TokenizeState
const TokenizeState(9)
INTERPOLATION → const TokenizeState
const TokenizeState(6)
NUMBER → const TokenizeState
const TokenizeState(2)
SLASH_COMMENT → const TokenizeState
const TokenizeState(8)
STRING_DOUBLE_QUOTE → const TokenizeState
const TokenizeState(4)
STRING_SINGLE_QUOTE → const TokenizeState
const TokenizeState(3)
STRING_TRIPPLE_QUOTE → const TokenizeState
const TokenizeState(5)
values → const List<TokenizeState>

A constant List of the values in this enum, in order of their declaration.

const List<TokenizeState>
WORD → const TokenizeState
const TokenizeState(1)


index → int

The integer index of this enum.

hashCode → int
The hash code for this object.
read-only, inherited
runtimeType → Type
A representation of the runtime type of the object.
read-only, inherited


toString() → String
Returns a string representation of this object.
noSuchMethod(Invocation invocation) → dynamic
Invoked when a non-existent method or property is accessed.


operator ==(dynamic other) → bool
The equality operator.