services/prompt_compressor library
REFRAG-style prompt compression service.
Reduces token count while preserving key information for LLM context. Uses Rust-based text processing for performance.
Classes
- CompressedContext
- Result of prompt compression.
- PromptCompressor
- Prompt compression service using REFRAG principles.
- ScoredSentence
- Scored sentence with similarity value.
Enums
- CompressionLevel
- Compression level options.