getBenchmarkHistoryWithHttpInfo method

Future<Response> getBenchmarkHistoryWithHttpInfo({
  1. String? benchmark,
  2. String? model,
})

Returns each model's measured score per run over time, oldest first, with the change between runs.

Returns each model's measured score per run over time, oldest first, with the change between runs. This is the counterweight to a leaderboard: the board shows the latest run because that is what "how good is it" means, and a single latest number cannot distinguish a model that has always been strong from one that just improved, or from one that regressed after a provider changed something. Both matter for routing, and only one of them is visible on a board. Runs with no id — attempts recorded before runs existed — group under the empty run, which is honestly what they are: one undated measurement.

Note: This method returns the HTTP Response.

Parameters:

  • String benchmark: Benchmark is the catalog id to read, defaulting to gpqa_diamond.

  • String model: Model filters to one model. Empty returns every model measured.

Implementation

Future<Response> getBenchmarkHistoryWithHttpInfo({ String? benchmark, String? model, }) async {
  // ignore: prefer_const_declarations
  final path = r'/v1/benchmark/history';

  // ignore: prefer_final_locals
  Object? postBody;

  final queryParams = <QueryParam>[];
  final headerParams = <String, String>{};
  final formParams = <String, String>{};

  if (benchmark != null) {
    queryParams.addAll(_queryParams('', 'Benchmark', benchmark));
  }
  if (model != null) {
    queryParams.addAll(_queryParams('', 'Model', model));
  }

  const contentTypes = <String>[];


  return apiClient.invokeAPI(
    path,
    'GET',
    queryParams,
    postBody,
    headerParams,
    formParams,
    contentTypes.isEmpty ? null : contentTypes.first,
  );
}