runtime property

LlamaRuntime? get runtime

The runtime that runs this backend's model, or null when the backend cannot tell, as for an auto backend with no model loaded.

Implementation

LlamaRuntime? get runtime;