SessionProvider typedef

SessionProvider = Future<LlamaSession> Function()

Resolves the loaded LlamaSession this client generates against.

The session is owned and loaded elsewhere (the model-loading hosted service); the returned future completes once the model is ready.

Implementation

typedef SessionProvider = Future<LlamaSession> Function();