JudgeScorer typedef

JudgeScorer = Future<JudgeScore?> Function(HumanLabeledTrial labeled)

业务方提供的 judge 评分回调。

输入是 HumanLabeledTrial.input + HumanLabeledTrial.output,输出 是 judge 给出的分值(与人工同刻度)和可选解释。如果 judge 无法判断, 返回 null(被排除在相关性计算之外,但会单独统计)。

Implementation

typedef JudgeScorer = Future<JudgeScore?> Function(HumanLabeledTrial labeled);