generationMutex property
Mutex
generationMutex
final
Serializes generation across all sessions on this model — concurrent
contexts, serialized inference, matching the FFI/MediaPipe paths. The
@litert-lm/core engine is shared WebGPU/WASM state; parallel
generations would contend for the accelerator. Passed to each session.
Implementation
final Mutex generationMutex = Mutex();