AI agent evals: write a test set to know if your agent got worse
AI agent evals: build a small eval set of 12 cases graded by code, run each case several times, and use a gate that blocks changes that make the agent worse.
Tag · 1 posts
AI agent evals: build a small eval set of 12 cases graded by code, run each case several times, and use a gate that blocks changes that make the agent worse.