parse method

List<TokenNode> parse(
  1. String input
)

Parses the given text using mecab and returns mecab's output

Implementation

List<TokenNode> parse(String input) {
  if (mecabPtr != null) {
    var resultStr =
        (parseFfi(mecabPtr!, input.toNativeUtf8())).toDartString().trim();

    var items;
    if (resultStr.contains('\n')) {
      items = resultStr.split('\n');
    } else {
      items = resultStr.split(' ');
    }

    List<TokenNode> tokens = [];
    for (var item in items) {
      tokens.add(TokenNode(item));
    }
    return tokens;
  }
  return [];
}