parse method
Parses the given text using mecab and returns mecab's output
Implementation
List<TokenNode> parse(String input) {
if (mecabPtr != null) {
var resultStr =
(parseFfi(mecabPtr!, input.toNativeUtf8())).toDartString().trim();
var items;
if (resultStr.contains('\n')) {
items = resultStr.split('\n');
} else {
items = resultStr.split(' ');
}
List<TokenNode> tokens = [];
for (var item in items) {
tokens.add(TokenNode(item));
}
return tokens;
}
return [];
}