ContextWindowCompressionConfig constructor

ContextWindowCompressionConfig({
  1. int? triggerTokens,
  2. SlidingWindow? slidingWindow,
})

Creates a ContextWindowCompressionConfig instance.

triggerTokens (optional): The number of tokens that triggers the compression mechanism. slidingWindow (optional): The sliding window compression mechanism to use.

Implementation

ContextWindowCompressionConfig({this.triggerTokens, this.slidingWindow});