tokenizer property

Tokenizer tokenizer
getter/setter pair

Function for splitting strings into tokens for indexing.

Implementation

Tokenizer tokenizer = lunr.tokenizer;