QueuedCompactionService class abstract

Abstract interface for queued context compaction.

Sessions are enqueued for compaction and processed in batch. Preemptive compaction triggers when the token budget reaches 80% capacity.

Implementers

• QueuedCompactionEngine

Constructors

QueuedCompactionService()

Properties

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

enqueue(String sessionId) → void

Marks a session for compaction by adding it to the processing queue.

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

processQueue() → int

Processes all pending compactions in the queue.

shouldCompactPreemptively(int currentTokens, int maxTokens) → bool

Returns true if preemptive compaction should trigger.

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited