runForward method

void runForward({
  1. List<double>? inputData,
})

Executes the pre-compiled inference tape. If inputData is provided, it pushes the new raw bytes directly into the VRAM of the inference tensor before running.

Implementation

void runForward({List<double>? inputData}) {
  if (inputData != null && inferInput != null) {
    inferInput!.pushData(inputData);
  }
  if (inferTape != null) {
    GPUEngine.run(inferTape!.bytes());
  }
}