string/text_chunk_utils library

Text segmentation into chunks for indexing (size and sentence boundaries) — roadmap #430.

Functions

chunkText(String text, {int maxChars = 500, int overlap = 0}) → List<String>

Splits text into chunks of at most maxChars characters, trying to break at sentence boundaries (.). overlap optional characters to overlap between chunks.