CharTokenizer class

Constructors

CharTokenizer(String text)

Properties

chars ↔ List<String>

getter/setter pair

hashCode → int

The hash code for this object.

no setter, inherited

itos ↔ Map<int, String>

getter/setter pair

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

stoi ↔ Map<String, int>

getter/setter pair

vocabSize → int

no setter

Methods

decode(List<int> l) → String

encode(String s) → List<int>

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited