cancel method
Cancels the ongoing inference process.
Implementation
Future<void> cancel() async {
final handle = _handle;
if (handle != null) {
LiteRtLmNativeRuntime.instance.cancelConversation(handle);
}
}
Cancels the ongoing inference process.
Future<void> cancel() async {
final handle = _handle;
if (handle != null) {
LiteRtLmNativeRuntime.instance.cancelConversation(handle);
}
}