hasSpeculativeDecodingSupport method

bool hasSpeculativeDecodingSupport()

Whether the loaded LiteRT-LM file supports speculative decoding.

Implementation

bool hasSpeculativeDecodingSupport() {
  final handle = _handle;
  if (handle == null) {
    throw const LiteRtLmException('Capabilities is already disposed.');
  }
  return LiteRtLmNativeRuntime.instance.hasSpeculativeDecodingSupport(handle);
}