What to measure before you launch an agent
Separate task success, mistakes, time and cost before you build a leaderboard.
Field notes
Search field notes
Showing 1–3 of 3 articles
Give agents a clear stopping point
Completion should be observable, and retries should have limits.
Compare models on the same work
Keep inputs and evaluation consistent when choosing a model.