JudgeSpec class

Constructors

JudgeSpec({String? criteria, String? model, String? name})

Returns a new JudgeSpec instance.

Properties

criteria ↔ String?

Criteria is the standard the judge applies, defaulting to a correctness criterion.

getter/setter pair

hashCode → int

The hash code for this object.

no setter, override

model ↔ String?

Model is the model that grades. It defaults to the model under test, so a run with no judge named has the model grade itself.

getter/setter pair

name ↔ String?

Name is the score name the judge's grades are filed under, "llm-judge" by default. A name that is not a legal handle falls back to that default rather than being stored as sent.

getter/setter pair

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toJson() → Map<String, dynamic>

toString() → String

A string representation of this object.

override

Operators

operator ==(Object other) → bool

The equality operator.

override

Static Methods

fromJson(dynamic value) → JudgeSpec?

Returns a new JudgeSpec instance and imports its values from value if it's a Map, null otherwise.

listFromJson(dynamic json, {bool growable = false}) → List<JudgeSpec>

mapFromJson(dynamic json) → Map<String, JudgeSpec>

mapListFromJson(dynamic json, {bool growable = false}) → Map<String, List<JudgeSpec>>

Constants

requiredKeys → const Set<String>

The list of required keys that must be present in a JSON.