Suite class

Constructors

Suite({int? attempts, List<String> benchmarks = const [], String? endpoint, String? model})

Returns a new Suite instance.

Properties

attempts ↔ int?

Attempts is how many times to try each item; the harness's default applies when it is omitted.

getter/setter pair

benchmarks ↔ List<String>

Benchmarks are the catalog ids to run. At least one is required, and every id must be in the catalog.

getter/setter pair

endpoint ↔ String?

Endpoint is your own chat-completions URL, for benchmarking a model this arena does not host. Either this or model is required.

getter/setter pair

hashCode → int

The hash code for this object.

no setter, override

model ↔ String?

Model is the catalog model id to run. Either this or endpoint is required.

getter/setter pair

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toJson() → Map<String, dynamic>

toString() → String

A string representation of this object.

override

Operators

operator ==(Object other) → bool

The equality operator.

override

Static Methods

fromJson(dynamic value) → Suite?

Returns a new Suite instance and imports its values from value if it's a Map, null otherwise.

listFromJson(dynamic json, {bool growable = false}) → List<Suite>

mapFromJson(dynamic json) → Map<String, Suite>

mapListFromJson(dynamic json, {bool growable = false}) → Map<String, List<Suite>>

Constants

requiredKeys → const Set<String>

The list of required keys that must be present in a JSON.