word_segmenter

Splits text at word boundaries with the platform's own text services.

Flutter's engine bundles ICU without the CJK dictionary, so TextPainter.getWordBoundary treats every Chinese or Japanese character as a word. This package asks the operating system instead, which segments 我们今天讨论一下 as 我们 | 今天 | 讨论 | 一下.

No native code or plugin registration is needed: native platforms call the system libraries through dart:ffi.

Usage

import 'package:word_segmenter/word_segmenter.dart';

const text = 'Hello, 世界和平';
final ranges = wordBoundaries(text);
// ['Hello', ',', ' ', '世界', '和平']
print(ranges?.map((range) => range.textInside(text)).toList());

Segments are contiguous UTF-16 ranges covering the whole text; whitespace and punctuation form their own segments. wordBoundaries returns null when the platform has no segmenter available (for example Android below API 31), so callers can fall back to TextPainter.getWordBoundary.

Exact segments come from the platform dictionaries and may differ slightly between platforms.