ftsText function
Prepares ordinary text for assignment to an FTS field.
This function preprocesses the given string containing ordinary text
before it can be assigned to an FTS field to become the subject of FTS
queries. The library configures the "unicode61" tokenizer to accept an
extended set of characters (see tokenCategories); therefore, the
preprocessing step is required to retain standard FTS query behavior for
ordinary text. This preprocessing leaves only those character sequences that
match standard FTS tokens (defined by reFtsTextToken) and joins them with
ASCII spaces.
See also: ftsTerm.
Implementation
String ftsText(String string) => ftsWords(string).join(" ");