tokenizer property

String tokenizer

The tokenizer to be used in the FTS table. The default value is FtsTokenizer.simple. Tokenizer arguments can be defined with tokenizerArgs.

The tokenizer to use on the FTS table. Built-in available tokenizers are FtsTokenizer.simple,FtsTokenizer.porter and FtsTokenizer.unicode61.

SQLite tokenizers documentation

Implementation

final String tokenizer;