create abstract method

Future<AgentHarnessSession> create({
  1. required EvalTask task,
  2. required Trial trial,
  3. required EvalContext context,
})

Build a session for one trial. Implementations are responsible for:

  • Instantiating the agent (e.g. a StatefulAgent)
  • Wiring tools / skills
  • Reusing EvalContext.controller so the runner can record transcripts

Implementation

Future<AgentHarnessSession> create({
  required EvalTask task,
  required Trial trial,
  required EvalContext context,
});