LatexTokenizer class

LaTeX Lexical Analyzer

input Complete input text startOffset Starting offset (default 0). Used for incremental tokenization to start scanning from a specific position, so the produced token's SourceRange directly reflects the global position in the input.

Constructors

LatexTokenizer(String input, {int startOffset = 0})

Properties

hashCode → int

The hash code for this object.

no setter, inherited

input → String

final

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

nextToken() → LatexToken

Scans and returns the next token.

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

tokenize() → List<LatexToken>

Executes lexical analysis

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited

Constants

tag → const String