runPrefill method

Future<void> runPrefill(
  1. List<InputData> inputData
)

Runs the prefill step for the given input data.

Implementation

Future<void> runPrefill(List<InputData> inputData) {
  final handle = _handle;
  if (handle == null) {
    throw const LiteRtLmException('Session is already disposed.');
  }
  return LiteRtLmNativeRuntime.instance.runSessionPrefill(handle, inputData);
}