tokenizer property

VietnameseTokenizerBackend tokenizer
final

Underthesea-compatible token provider.

Implementation

final VietnameseTokenizerBackend tokenizer;