string/tokenize_sentences_utils library
Tokenize text into sentences and words (roadmap #404).
Functions
-
tokenizeSentences(
String text) → List< String> -
Splits
textinto sentences (split on . ! ? followed by space or end). -
tokenizeWords(
String text) → List< String> -
Splits
textinto words (non-empty runs of letters/numbers).