postBenchmarkRunsWithHttpInfo method

Future<Response> postBenchmarkRunsWithHttpInfo(
  1. Suite suite
)

Admits and queues a benchmark run against a model or your own endpoint, and answers 202 with the receipt.

Admits and queues a benchmark run against a model or your own endpoint, and answers 202 with the receipt. It is an ADMISSION, not a result: the work is done by the harness afterwards and the numbers appear on the leaderboard as it completes them. Cost is bounded by the store rather than by a quota: attempts are append-only and keyed by (benchmark, item, model), so an (item, model) pair already attempted is skipped instead of re-spent, and re-queuing the same run is close to free. Validation is up front and total — a request with neither model nor endpoint is a 400, one with no benchmarks is a 400, and any benchmark id outside the catalog is a 422 naming exactly which ids were unknown, so a typo never silently queues a partial run.

Note: This method returns the HTTP Response.

Parameters:

  • Suite suite (required):

Implementation

Future<Response> postBenchmarkRunsWithHttpInfo(Suite suite,) async {
  // ignore: prefer_const_declarations
  final path = r'/v1/benchmark/runs';

  // ignore: prefer_final_locals
  Object? postBody = suite;

  final queryParams = <QueryParam>[];
  final headerParams = <String, String>{};
  final formParams = <String, String>{};

  const contentTypes = <String>['application/json'];


  return apiClient.invokeAPI(
    path,
    'POST',
    queryParams,
    postBody,
    headerParams,
    formParams,
    contentTypes.isEmpty ? null : contentTypes.first,
  );
}