JudgeScorer typedef
JudgeScorer =
Future<JudgeScore?> Function(HumanLabeledTrial labeled)
业务方提供的 judge 评分回调。
输入是 HumanLabeledTrial.input + HumanLabeledTrial.output,输出 是 judge 给出的分值(与人工同刻度)和可选解释。如果 judge 无法判断, 返回 null(被排除在相关性计算之外,但会单独统计)。
Implementation
typedef JudgeScorer = Future<JudgeScore?> Function(HumanLabeledTrial labeled);