tokenizer library

Properties

separator → RegExp

final

Functions

tokenizer([dynamic obj, TokenMetaData? metadata]) → List<Token>

Typedefs

Tokenizer = List<Token> Function([dynamic obj, Map<String, dynamic>? metadata])