addSourceUtf8WithChunking method

Future<SourceAddResult> addSourceUtf8WithChunking(
  1. List<int> bytes, {
  2. String? metadata,
  3. String? name,
  4. ChunkingStrategy? strategy,
  5. Duration? chunkDelay,
  6. void onProgress(
    1. int done,
    2. int total
    )?,
})

Add a document from UTF-8 bytes while avoiding caller-side String inflation. Add a UTF-8 payload while reducing input-side Dart String materialization.

Implementation

Future<SourceAddResult> addSourceUtf8WithChunking(
  List<int> bytes, {
  String? metadata,
  String? name,
  ChunkingStrategy? strategy,
  Duration? chunkDelay,
  void Function(int done, int total)? onProgress,
}) async {
  final content = await rust_document_parser.extractTextFromUtf8(
    fileBytes: bytes,
  );
  return addSourceWithChunking(
    content,
    metadata: metadata,
    name: name,
    strategy: strategy ?? ChunkingStrategy.recursive,
    chunkDelay: chunkDelay,
    onProgress: onProgress,
  );
}