Topic
ML System Design interview questions
332 ML System Design questions from 100 companies, with hints, runnable code and solution walkthroughs.
13 easy187 medium132 hard
ML System Design interview questions by the numbers
Last updated
Katkat has 332 ML System Design interview questions from 100 companies; the most come from OpenAI (7%), Meta (7%) and Anthropic (6%). By difficulty: 4% easy, 56% medium and 40% hard. The most common round is Onsite (56%). Frequent concepts include System Design, ML System Design, Scalability and LLM.
Companies (100)
Difficulty
- Easy4% · 13
- Medium56% · 187
- Hard40% · 132
Interview rounds
- Onsite56% · 186
- Technical Screen42% · 138
- Online Assessment2% · 6
- HR Screen1% · 2
Roles
- Machine Learning Engineer54% · 178
- Software Engineer36% · 121
- Applied Scientist4% · 13
- Data Scientist4% · 13
- Member of Technical Staff, ML Systems1% · 2
Frequent concepts
- System Design17% · 56
- ML System Design10% · 32
- Scalability8% · 28
- LLM8% · 26
- RAG8% · 26
- Ranking6% · 20
Most mentioned in interview experiences
- 1.Design a Spam Review Workflow with Classifiers, AI Agents, and Human Labelers2 reports
- 2.Add an LLM-backed recommendation API to an existing service with RAG and prompting1 report
- 3.Applying LLMs to Autonomous Driving Despite Hallucination and Real-Time Limits1 report
- 4.Architect an asynchronous RL post-training system1 report
- 5.Build a Mistral-powered RAG agent1 report
- 6.Build AI chat for spreadsheets1 report
- 7.Choose File Storage Tiers Using Access Predictions1 report
- 8.Compare Single-Agent and Multi-Agent Designs1 report
- 9.Data quality, lineage, monitoring and backfill design for an ML feature store1 report
- 10.Describe model-to-GPU execution pipeline1 report
Counted from 82 candidate interview experiences on Katkat. How we collect and count
Showing 271–300 of 332 results
Design a real-time game recommendation system evaluates ML product requirements, data/labeling, modeling, serving architecture, evaluation, monitoring, and trade-offs in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
RobloxMachine Learning EngineerML System DesignTechnical ScreenOutline the ML inference and labeling pipeline evaluates ML product requirements, data/labeling, modeling, serving architecture, evaluation, monitoring, and trade-offs in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
RobloxSoftware EngineerML System DesignOnsiteThis question tests the ability to design a robust context-management layer for an LLM-based application that balances limited token capacity against competing sources of information.
RogoMachine Learning EngineerML System DesignOnsiteThis interview question evaluates ML product requirements, data/labeling, modeling, serving architecture, evaluation, monitoring, and trade-offs in a realistic interview setting. A strong answer for Design a scalable video search system states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
RunwayMachine Learning EngineerML System DesignTechnical ScreenThis problem tests the ability to design an end-to-end recommendation engine, focusing on the pipeline from data ingestion to real-time inference and model evaluation.
SalesforceSoftware EngineerML System DesignTechnical ScreenDesign an end-to-end recommendation system evaluates ML product requirements, data/labeling, modeling, serving architecture, evaluation, monitoring, and trade-offs in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
SalesforceSoftware EngineerML System DesignTechnical ScreenThis question evaluates competency in integrating hosted LLMs into user-facing applications, including API request design, prompt engineering for structured output, output validation, latency and failure handling, and production readiness.
Scale AISoftware EngineerML System DesignOnsiteThis question evaluates a candidate's proficiency in ML system design, covering API design, service orchestration, data storage modeling, scalability strategies, and reliability/observability when integrating black-box classification and embedding services.
Scale AISoftware EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design end-to-end machine learning systems for personalized product recommendation, assessing competencies in data collection, candidate generation, feature pipelines, model training, online serving, and re-ranking.
ShopifyMachine Learning EngineerML System DesignOnsiteThis question evaluates understanding of ML-driven recommendation and credit-risk systems, including skills in personalization, feature design, risk calibration, fairness and regulatory compliance, explainability, and operational monitoring.
ShopifyMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's competency in designing production-grade hierarchical multi-label classification systems, covering taxonomy normalization, label dependency modeling, loss and decoding strategies, class imbalance handling, evaluation metrics, data labeling at scale, and operational constraints such as latency, model size, and monitoring. Commonly asked in the ML System Design domain to assess both conceptual understanding of hierarchical label structures and practical application-level trade-offs in architecture, training, deployment, and maintenance.
ShopifyMachine Learning EngineerML System DesignOnsiteThis question evaluates an engineer's ability to design an ML-powered search autocomplete system, testing competencies in candidate generation versus ranking architectures, data sourcing and labeling, feature and model selection (including personalization and context), offline training and online serving, experimentation and monitoring, and safety and abuse mitigation within information retrieval. Commonly asked to assess how applicants balance production concerns such as latency, relevance, scalability, cold-start handling, and feedback-loop mitigation, it sits in the ML system design domain and emphasizes practical, applied engineering trade-offs rather than purely conceptual theory.
ShopifyMachine Learning EngineerML System DesignOnsiteThis problem tests your ability to design a scalable multi-modal machine learning pipeline that processes diverse content types to generate standardized taxonomy tags for an e-commerce platform.
SnapchatMachine Learning EngineerML System DesignOnsiteThis problem tests the ability to design an end-to-end ML system for ranking content while balancing engagement metrics with safety, misinformation, and user trust.
SnapchatMachine Learning EngineerML System DesignOnsiteThis question evaluates proficiency in ML system design for harmful-content detection, assessing competencies in multimodal modeling, taxonomy and labeling strategies, data strategy, privacy-aware architecture, real-time inference, human-in-the-loop decisioning, and operational reliability for global consumer platforms.
SnapchatMachine Learning EngineerML System DesignOnsiteThis question evaluates competency in end-to-end ML system design for ranking and recommendation, covering problem definition, data and feature pipelines, offline training, online inference, model refresh, monitoring, and handling cold-start, exploration, feedback loops, and model drift.
SnapchatMachine Learning EngineerML System DesignTechnical ScreenThis problem tests your ability to design a real-time recommendation system that captures dynamic user intent over short sessions, balancing latency, feature freshness, and algorithmic relevance.
SnapchatMachine Learning EngineerML System DesignTechnical ScreenDesign a recommendation model from labels and sampling through features, loss, ranking metrics, online experiments, and production debugging.
SnapchatMachine Learning EngineerML System DesignOnsiteThis question tests the ability to design an end-to-end ads ranking pipeline, focusing on latency constraints, mitigation of position bias, and balancing multi-objective optimization.
SnapchatMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design scalable, low-latency real-time retrieval and personalized ranking systems for geospatial data, testing competencies in spatial indexing and tiling, candidate generation versus re-ranking pipelines, caching and freshness strategies, latency and availability SLOs, deduplication and pagination, and model/ANN decision-making; the domain is ML system design for map-based POI retrieval and it assesses both high-level architectural reasoning and practical engineering trade-offs. Such problems are commonly asked to assess how an engineer balances consistency, stability and freshness under strict latency and availability targets while reasoning about operational concerns like load shedding, offline versus online evaluation, instrumentation and cost.
SnapchatMachine Learning EngineerML System DesignOnsiteThis question evaluates expertise in ML system design, large-scale information retrieval and recommendation engineering, with emphasis on multi-modal video representation, sparse-text handling, indexing/ANN choices, low-latency online serving, and bias mitigation such as popularity bias.
SnapchatMachine Learning EngineerML System DesignTechnical ScreenDesign a pipeline that automatically extracts reusable agent skills for enterprise customers from traces and documents, validates them and delivers them to agents. It tests LLM system design, outcome labeling, offline evaluation against a baseline, tenant isolation, versioning and drift monitoring.
SnowflakeMachine Learning EngineerML System DesignOnsiteThis question evaluates system-design and machine-learning engineering competencies, including streaming versus batch ingestion, audio transcription and chunking, long-context retrieval and prompt/fine-tuning choices, model serving and cost-latency trade-offs, storage and indexing of transcripts and embeddings, evaluation of factual accuracy, and operational monitoring and recovery. Commonly asked to assess the ability to balance latency, throughput, cost, and accuracy in production ML pipelines, it is categorized as ML System Design and tests both conceptual understanding of trade-offs and practical application of scalable, reliable architecture.
SpotifyMachine Learning EngineerML System DesignOnsiteThis problem tests your ability to design a production-grade recommendation pipeline that balances immediate user intent (sequential context) with long-term personalization, while managing latency constraints at scale.
SpotifyMachine Learning EngineerML System DesignOnsiteThis question tests the ability to design an end-to-end ML system for user retention prediction, focusing on feature engineering, model scalability for massive user bases, and real-time inference latency.
SpotifyMachine Learning EngineerML System DesignOnsiteThis question evaluates an engineer's competency in ML systems engineering, specifically understanding of decoder-only Transformer inference, KV cache semantics and which tensors are cached per layer, attention mechanics, memory layout, and correctness under branching and long-context workloads.
Startups.ComMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's ability to design end-to-end machine learning systems for payment fraud detection, covering competencies in labeling, imbalanced learning, feature engineering across users/merchants/cards/devices/IPs and graph relationships, model selection, online serving, latency and feature freshness, monitoring, experimentation, and adversarial robustness. As an ML System Design problem for a Machine Learning Engineer role, it is commonly asked to probe trade-offs between fraud loss, false positives, user friction and latency and requires both conceptual understanding and practical application of production ML concerns such as evaluation metrics, thresholding, retraining, and operational constraints.
StripeMachine Learning EngineerML System DesignTechnical ScreenDesign an LLM math-solving chain evaluates ML product requirements, data/labeling, modeling, serving architecture, evaluation, monitoring, and trade-offs in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
TeslaMachine Learning EngineerML System DesignOnsiteThis question evaluates a candidate's competency in modeling other agents within simulation environments, focusing on designing agent behavior models and assessing their impact on training and evaluation robustness.
TeslaMachine Learning EngineerML System DesignTechnical ScreenThis question evaluates a candidate's competency in ML system design and decision-focused modeling for recommender pipelines, focusing on retrieval-ranking trade-offs, latency and compute cost constraints, and dynamic per-request selection of K.
TikTokMachine Learning EngineerML System DesignOnsite