QualityEvaluatorBase class abstract

Shared evaluation loop for AI-based quality evaluators (1–5 scale).

Subclasses provide the metric name and evaluation instructions; this class handles calling the model, parsing the tagged response, and interpreting the score.

Implemented types

• Evaluator

Implementers

• CoherenceEvaluator
• CompletenessEvaluator
• EquivalenceEvaluator
• FluencyEvaluator
• GroundednessEvaluator
• IntentResolutionEvaluator
• RelevanceEvaluator
• RetrievalEvaluator
• TaskAdherenceEvaluator
• ToolCallAccuracyEvaluator

Constructors

QualityEvaluatorBase()

Properties

evaluationMetricNames → List<String>

The names of the EvaluationMetrics produced by this evaluator.

no setter, inherited

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

buildEvaluationInstructions(List<ChatMessage> messages, ChatResponse modelResponse, List<EvaluationContext> additionalContext) → List<ChatMessage>?

Builds the evaluation instructions (system + user messages).

evaluate(Iterable<ChatMessage> messages, ChatResponse modelResponse, {ChatConfiguration? chatConfiguration, Iterable<EvaluationContext>? additionalContext, CancellationToken? cancellationToken}) → Future<EvaluationResult>

Evaluates modelResponse and returns an EvaluationResult.

override

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

toString() → String

A string representation of this object.

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited