tokenize abstract method

List<String> tokenize(String text)

Returns exact ordered token strings for cleaned text.

Implementation

List<String> tokenize(String text);