core/tree/text_normalizer library

Functions

normaliseForMatch(String s) → String

Shared text-normalisation for the tree pipeline and the match ladder.

tokenise(String normalised) → List<String>

Split an already-normaliseForMatch'd string on single-space boundaries into a token bag.