Topic
ML System Design interview questions
332 ML System Design questions from 100 companies, with hints, runnable code and solution walkthroughs.
13 easy187 medium132 hard
ML System Design interview questions by the numbers
Last updated
Katkat has 332 ML System Design interview questions from 100 companies; the most come from OpenAI (7%), Meta (7%) and Anthropic (6%). By difficulty: 4% easy, 56% medium and 40% hard. The most common round is Onsite (56%). Frequent concepts include System Design, ML System Design, Scalability and LLM.
Companies (100)
Difficulty
- Easy4% · 13
- Medium56% · 187
- Hard40% · 132
Interview rounds
- Onsite56% · 186
- Technical Screen42% · 138
- Online Assessment2% · 6
- HR Screen1% · 2
Roles
- Machine Learning Engineer54% · 178
- Software Engineer36% · 121
- Applied Scientist4% · 13
- Data Scientist4% · 13
- Member of Technical Staff, ML Systems1% · 2
Frequent concepts
- System Design17% · 56
- ML System Design10% · 32
- Scalability8% · 28
- LLM8% · 26
- RAG8% · 26
- Ranking6% · 20
Most mentioned in interview experiences
- 1.Design a Spam Review Workflow with Classifiers, AI Agents, and Human Labelers2 reports
- 2.Add an LLM-backed recommendation API to an existing service with RAG and prompting1 report
- 3.Applying LLMs to Autonomous Driving Despite Hallucination and Real-Time Limits1 report
- 4.Architect an asynchronous RL post-training system1 report
- 5.Build a Mistral-powered RAG agent1 report
- 6.Build AI chat for spreadsheets1 report
- 7.Choose File Storage Tiers Using Access Predictions1 report
- 8.Compare Single-Agent and Multi-Agent Designs1 report
- 9.Data quality, lineage, monitoring and backfill design for an ML feature store1 report
- 10.Describe model-to-GPU execution pipeline1 report
Counted from 82 candidate interview experiences on Katkat. How we collect and count
Showing 151–180 of 332 results
This question assesses the ability to design an end-to-end machine learning system for real-time credit risk assessment, focusing on data pipelines, model inference, and regulatory compliance.
KikoffSoftware EngineerML System DesignOnsiteThis question evaluates competency in ML system design and operational engineering, covering model packaging and versioning, hardware selection (CPU vs GPU), autoscaling, request routing, multi-tenant isolation, SLO-driven observability, cost controls, and failure handling within a cloud inference platform.
LambdaSoftware EngineerML System DesignHR ScreenThis problem tests your ability to design a closed-loop active learning system for protein or DNA sequence engineering, focusing on the iterative cycle of sequence generation, uncertainty estimation, and experimental validation.
LilaMachine Learning EngineerML System DesignOnsiteThe question evaluates proficiency in end-to-end machine learning system design, covering feature engineering from job post text, candidate generation and ranking, model training and labeling, evaluation metrics, and production concerns such as cold start, bias, and feedback loops.
LinkedInMachine Learning EngineerML System DesignOnsiteAn ML system design question: predict whether a member will click a job displayed to them, using member features, job content and interaction history. It tests defining the supervision signal and training data, choosing a loss, preventing data leakage, building member and job embeddings, and laying out the training and serving components.
LinkedInMachine Learning EngineerML System DesignTechnical ScreenDesign an end-to-end personalized professional feed system and compare pointwise, pairwise, and listwise learning-to-rank formulations across offline training, online serving, and business metrics.
LinkedInMachine Learning EngineerML System DesignTechnical ScreenThis question assesses the ability to build an end-to-end ML pipeline for extracting and normalizing professional skills from unstructured user-generated text, such as job descriptions or member profiles.
LinkedInMachine Learning EngineerML System DesignOnsiteThis question evaluates a machine learning engineer's ability to design an end-to-end ML system for skill inference and recommendation on a professional networking platform, testing competencies in data sourcing and labeling, feature engineering, model selection (including LLM integration), online serving, monitoring, and quality control.
LinkedInMachine Learning EngineerML System DesignOnsiteDesign an ad forecasting and budget pacing architecture that combines predictive ML with deterministic budget guardrails to optimize campaign delivery across non-stationary traffic.
LinkedInMachine Learning EngineerML System DesignTechnical ScreenThis question tests the ability to design an end-to-end configuration management and observability system for LLM applications that ensures reproducibility, safety, and rapid recovery from performance drift.
Luma AISoftware EngineerML System DesignTechnical ScreenDesign an end-to-end talent search and matching engine that combines semantic vector retrieval with structured filtering to handle unstructured resumes, ambiguous queries, and strict hiring constraints.
MercorMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design and implement a lightweight evaluation harness for a locally hosted language model, testing competencies in ML system design, service integration, metrics instrumentation, reliability engineering (timeouts, retries), concurrency control, configuration management, and extensibility.
MercorMachine Learning EngineerML System DesignTechnical ScreenPrepare for an MLE system design interview that combines candidate search, ranking, comparator reliability, and language-model fundamentals. The prompt covers retrieval, ranking feedback loops, top-k reasoning, transformer concepts, and decoding trade-offs without requiring proprietary hiring data.
MercorMachine Learning EngineerML System DesignOnsiteDesign a resilient, multi-tenant orchestration engine tailored for machine learning pipelines that manages versioned DAGs, heterogeneous compute routing, data quality gates, and atomic dataset publication.
MercorMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design an asynchronous reinforcement-learning post-training system for a production chat LLM, testing competencies in ML system architecture, distributed training and serving separation, streaming data engineering, reward modeling and credit assignment, safety/compliance, and deployment/operations.
MetaMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design and implement a retrieval-augmented generation (RAG) system using a large language model API, including document ingestion, chunking, vector indexing and retrieval, streaming completions, service interfaces (CLI and HTTP), and resilience features like retries, persistence, and structured error handling. Commonly asked in the ML System Design domain to assess practical engineering and architectural reasoning, it tests API integration, production-readiness (configuration, error handling, persistence, and testing) and emphasizes practical application with conceptual understanding of retrieval trade-offs.
MetaSoftware EngineerML System DesignOnsiteThis question evaluates competency in designing large-scale machine learning systems for real-time recommendations and notification ranking, covering candidate generation, ranking, feature engineering, online serving, latency management, and multi-objective trade-offs; it is commonly asked to assess the ability to translate product objectives into system architecture and measurable evaluation metrics while addressing freshness, cold-start, moving users, and notification fatigue. The domain is ML system design—recommender systems, ranking, and online serving—and the level spans both high-level conceptual architecture and practical application concerns such as serving latency, data freshness, training labels, and evaluation.
MetaMachine Learning EngineerML System DesignOnsiteThis question evaluates machine learning system design skills specific to recommender systems, including competencies in feature engineering, candidate generation and ranking, data engineering, online serving, latency and real-time context handling, evaluation metrics, and fairness/bias mitigation.
MetaMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design ML-powered developer tooling, covering competencies in LLM orchestration, deterministic tool integration, repository context management, code-analysis heuristics, safety and validation strategies, and inference cost estimation.
MetaSoftware EngineerML System DesignOnsiteAn ML system design question asking you to design a large-scale personalized recommendation system end to end, from candidate retrieval and multi-stage ranking to training data, evaluation, serving and monitoring. It tests problem framing, latency budgeting, cold start, feedback loops and online experimentation.
MetaMachine Learning EngineerML System DesignOnsiteAn AI design question about a chatbot that answers user questions in real time. It tests the low-latency serving and retrieval path, training data collection for fine-tuning and preference learning, reinforcement-learning task and reward design, and the ability to name reward weaknesses and mitigate them.
MetaMachine Learning EngineerML System DesignTechnical ScreenThis question tests your ability to design a multi-stage recommendation pipeline for a high-traffic short-video platform, focusing on candidate retrieval, ranking models, and system scalability.
MetaMachine Learning EngineerML System DesignTechnical ScreenThis problem tests the ability to design an end-to-end ML system for predicting user dissatisfaction, focusing on label definition, feature engineering, and the integration of negative signals into a ranking pipeline.
MetaMachine Learning EngineerML System DesignOnsiteThis question evaluates expertise in large-scale ML system design and distributed training for Mixture-of-Experts (MoE) models, covering competencies in model architecture, parallelism and communication strategies, memory and optimizer sharding, data curation and tokenization, monitoring, checkpointing, and fault tolerance; it is categorized under ML System Design and targets practical application with systems-level architectural reasoning rather than purely theoretical concepts. It is commonly asked to evaluate the ability to balance throughput, stability, and cost when scaling pretraining to hundreds of GPUs, reason about routing and capacity trade-offs, and design production-grade pipelines that can extend to larger clusters.
MetaMachine Learning EngineerML System DesignOnsiteThis question tests the ability to architect an end-to-end multimodal classification pipeline for detecting policy-violating content at scale while balancing precision, recall, and operational latency.
MetaMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design AI-enabled agentic systems for automated ticket investigation, covering competencies in ticket understanding, classification and prioritization, multi-source evidence retrieval (logs, metrics, traces, documentation), root-cause diagnosis, remediation orchestration, and human-in-the-loop safety controls. It is commonly asked in the ML system design domain to assess architectural and integration thinking, data retrieval and evaluation strategies, production monitoring and safety considerations, and tests both high-level conceptual architecture and practical application-level implementation concerns.
MetaSoftware EngineerML System DesignTechnical ScreenDesign an end-to-end LLM-powered coding assistant supporting inline code completion and repository-level chat under strict latency constraints.
MetaMachine Learning EngineerML System DesignOnsiteDesign an end-to-end conversational AI assistant powered by large language models, covering post-training alignment, retrieval/tool orchestration, low-latency serving, and safety guardrails at consumer scale.
MetaMachine Learning EngineerML System DesignOnsiteThis problem evaluates your ability to design a scalable, end-to-end computer vision pipeline capable of identifying copyrighted content within user-uploaded images, including scenarios involving cropping, filters, and collages.
MetaMachine Learning EngineerML System DesignOnsiteThis question tests the ability to design an end-to-end machine learning system for ranking comments, covering feature engineering, model architecture, and the trade-offs between engagement, quality, and latency.
MetaMachine Learning EngineerML System DesignOnsite