benchmark abstract method

Future<BenchmarkInfo> benchmark(
  1. EngineConfig config, {
  2. required int prefillTokens,
  3. required int decodeTokens,
})

Runs a native benchmark.

Implementation

Future<BenchmarkInfo> benchmark(
  EngineConfig config, {
  required int prefillTokens,
  required int decodeTokens,
});