Katkat
Back

Design an Enterprise Tool-Using Agent

ByteDanceMachine Learning Engineer · Technical Screen
MediumMachine Learning EngineerTechnical ScreenML System Design

Last updated

This question evaluates a candidate's ability to design production-grade LLM agents that integrate external tools, manage long-running and branching workflows, persist complex state, and ensure safety, observability, and reliable evaluation in enterprise settings.

Design an enterprise LLM agent that can use external tools to complete multi-step business tasks. Assume the agent may call tools such as document retrieval, search, SQL or warehouse queries, ticketing systems, messaging APIs, and workflow services.

Discuss the following:

  1. What major problems and failure modes appear when tool-using agents are deployed in real applications?
  2. How would you represent, persist, and maintain complex state across long-running, multi-turn, and potentially branching workflows?
  3. How would you evaluate the quality, reliability, safety, and business usefulness of such a system, both offline and online?

Your answer should cover system architecture, state management, safety and observability, and an evaluation strategy.