getBenchmarkLeaderboardWithHttpInfo method

Future<Response> getBenchmarkLeaderboardWithHttpInfo({ String? benchmark, })

Answers one row per model for the benchmark named — what our own harness measured, beside what the vendor claims, and the gap between them.

Answers one row per model for the benchmark named — what our own harness measured, beside what the vendor claims, and the gap between them. The gap is the point of the arena; provider-reported claims have run materially hot against one standardized harness. The two planes are NEVER blended, and that is the rule to read the rows by: a model we have measured but no vendor has claimed for shows published null, a model with only a claim shows measured null, and gap exists only where both do. n is coverage and is not decoration: two measured numbers taken over different item counts are not comparable, so read the row's n before reading its accuracy.

Note: This method returns the HTTP Response.

Parameters:

• String benchmark: Benchmark is the catalog id to read, defaulting to gpqa_diamond.

Implementation

Future<Response> getBenchmarkLeaderboardWithHttpInfo({ String? benchmark, }) async {
  // ignore: prefer_const_declarations
  final path = r'/v1/benchmark/leaderboard';

  // ignore: prefer_final_locals
  Object? postBody;

  final queryParams = <QueryParam>[];
  final headerParams = <String, String>{};
  final formParams = <String, String>{};

  if (benchmark != null) {
    queryParams.addAll(_queryParams('', 'benchmark', benchmark));
  }

  const contentTypes = <String>[];


  return apiClient.invokeAPI(
    path,
    'GET',
    queryParams,
    postBody,
    headerParams,
    formParams,
    contentTypes.isEmpty ? null : contentTypes.first,
  );
}