Katkat
Onsite

System Design Round: Build an Eval Platform for AI Agents

CrestaSoftware Engineer · Onsite · Sep 2026

System design round They have you design an eval system to evaluate the results of an Agent using different models, e.g. tool usage, response speed, plus testing different system prompts, that kind of thing. The original question is below: > Design a system for evaluating AI agents. Users of the system are going to be teams developing AI agents, e.g. agents which automatically analyze contact cen…

Shared by a candidate · reported Sep 2026. Interview formats change; use it as a guide, not a script.