rag_engine_flutter 0.8.0

Native Rust FFI plugin for mobile_rag_engine. Provides high-performance tokenization and HNSW vector indexing for on-device RAG.

Changelog

0.8.0

• Exact Scan Optimization: Implemented brute-force vector scan for source-filtered searches, guaranteeing perfect recall within the selected source.
• Smart Dehyphenation: Fixed Korean text extraction to correctly handle words split by line breaks.
• Dependencies: Bumps mobile_rag_engine compatibility.

0.7.6

• Duplicate Logs Fix: Logger now only uses println! when Dart stream is not connected, preventing duplicate output.
• Log Format: Simplified log format to [LEVEL] message (removed redundant tags).

0.7.5

• BM25 Index Fix: Added rebuild_chunk_bm25_index() function to properly build BM25 index for Source RAG chunks.
• Hybrid Search Fix: BM25 keyword search now correctly works alongside Vector similarity search.
• Initialization: Both HNSW and BM25 indexes are now built during app initialization for existing chunks.

0.7.0

• Metadata Support: Added metadata column to sources table and support in HybridSearchResult.
• Hybrid Search: Enhanced search_hybrid with weighted scoring (Vector + BM25) and metadata retrieval.
• Prompt Optimization: Search results now include metadata for better LLM context construction.

0.6.1

• Updated README to remove specific version constraints in examples.
• Updated Supported Platforms documentation.

0.6.0

• DB Connection Pool: Implemented connection pooling with r2d2 for 50-90% search performance improvement
• Resource Optimization: Eliminated redundant SQLite connections to reduce file descriptor usage
• Refactoring: Updated API to use pooled connections instead of direct file opens

0.5.1

• Unit Tests: Added tests for hnsw_index and document_parser modules
• BM25 Korean Support: Improved Korean tokenization using unicode-segmentation crate for better word boundary detection
• Code Quality: Enhanced test coverage for core Rust modules

0.5.0

• PDF/DOCX Text Extraction: New text extraction with smart dehyphenation
• Markdown Chunking: Structure-aware chunking with header path inheritance
• PDF Fix: Enhanced text normalization to preserve paragraph structure
• Safety: Added 50MB file size processing limit

0.4.0

• Fix binary mismatch: Rebuilt native binaries to resolve hash mismatch with Dart bindings.

0.3.0

• Fix platform directories missing: Include ios/, android/, macos/, linux/, windows/ in package
• Add .pubignore to prevent parent ignore rules from excluding platform configs

0.2.0

• Fix package structure: Include rust/ directory in package for correct pub.dev distribution
• Update platform build configs (iOS, macOS, Android, Linux, Windows) to reference internal rust/ path

0.1.0

• Initial release
• High-performance tokenization with HuggingFace tokenizers
• HNSW vector indexing for O(log n) similarity search
• SQLite integration for persistent vector storage
• Semantic text chunking with Unicode boundary detection
• Prebuilt binaries for iOS, macOS, and Android