Machine Learning Interview Questions

Showing 211–240 of 348 results

• OpenAIHard·Machine Learning Engineer
  Debug a transformer training pipeline

  An OpenAI ML engineer technical-screen debugging question: given a PyTorch Transformer training pipeline whose loss diverges and validation accuracy stays near chance (plus mask IndexErrors, AMP crashes, and nondeterminism), identify the distinct bugs and fix them. It tests Transformer internals - attention/causal masking, teacher-forcing label shift, positional encodings, ignore_index loss, optimizer and GradScaler order, determinism, and DDP - along with writing unit tests and a structured debugging plan.

  Machine LearningTechnical Screen
• OpenAIHard·Machine Learning Engineer
  Debug transformer and train classifier

  This question evaluates debugging and practical implementation skills for transformer-based text classification, covering model correctness, training loop integrity, data preprocessing, and evaluation metrics within the Machine Learning / Natural Language Processing domain.

  Machine LearningTechnical Screen
• OpenAIHard·Machine Learning Engineer
  Derive Backpropagation for Matrix-Product Layers

  This question evaluates understanding of backpropagation through linear blocks, matrix calculus, and the computation of gradients with respect to individual weight matrices in a product of trainable matrices, including reasoning about tensor shapes and matrix differentials.

  Machine LearningTechnical Screen
• OpenAIHard·Machine Learning Engineer
  Diagnose Transformer training and inference bugs

  This question evaluates practical debugging skills for Transformer-based sequence models, targeting machine learning engineers who must diagnose intermittent shape/dtype errors and convergence failures simultaneously. It tests deep familiarity with the full training stack — data pipelines, attention masking, positional encoding, optimizer precision, and distributed setup — and the ability to reason about how a single root cause can manifest across multiple symptoms.

  Machine LearningTechnical Screen
• OpenAIMedium·Machine Learning Engineer
  Implement 1NN with NumPy

  Tests your ability to implement a fast, vectorized 1-Nearest Neighbor (1NN) classifier using NumPy, focusing on memory-efficient distance computations and tie-breaking.

  Machine LearningTechnical Screennumpyvectorizationmachine-learning
• OpenAIMedium·Machine Learning Engineer
  Implement Masked Cross-Entropy with Label Smoothing

  Implement a numerically stable, masked cross-entropy loss function with label smoothing and temperature scaling in NumPy, returning both the loss and analytical gradients.

  Machine LearningTechnical Screenmachine-learningnumpydeep-learning
• OpenAIHard·Machine Learning Engineer
  Implement a 1-Nearest-Neighbor Classifier with a Manhattan-Distance Follow-Up

  Implement a 1-nearest-neighbor classifier that labels each query point with the label of its closest training point under Euclidean distance, then extend it to Manhattan distance. Tests vectorized distance computation under memory limits, tie handling and how the choice of metric changes predictions.

  Machine LearningTechnical Screen
• OpenAIHard·Software Engineer
  Implement a minimal reverse-mode autograd engine on PyTorch tensors

  Implement the core of a PyTorch-style autograd system: a tensor wrapper that records addition, multiplication, matrix multiplication, ReLU and sum, plus a backward method that fills in gradients for every input. Tests reverse-mode differentiation, correct ordering of the backward pass, gradient accumulation for tensors used more than once, and verification against PyTorch.

  Machine LearningTechnical Screen
• OpenAIMedium·Software Engineer
  Implement and Debug Backprop in NumPy

  This question evaluates understanding of backpropagation and the chain rule, proficiency in vectorized NumPy implementation, numerical stability of softmax/cross-entropy, and competency in gradient checking and debugging of model gradients.

  Machine LearningTechnical Screen
• OpenAIHard·Machine Learning Engineer
  Improve classifier with noisy multi-annotator labels

  This question evaluates a candidate's ability to analyze noisy multi-annotator labels, design label-aggregation and dataset-splitting strategies, and choose modeling and evaluation approaches for binary text classification.

  Machine LearningTechnical Screen
• OpenAIHard·Machine Learning Engineer
  Train a classifier and analyze dataset

  This question evaluates proficiency in end-to-end supervised machine learning workflows—covering data validation, exploratory data analysis, preprocessing, model training and selection, evaluation metrics and calibration, fairness assessments, and reproducibility—and tests competencies in applied machine learning engineering, statistical reasoning, and model governance within the Machine Learning domain. It is commonly asked in technical interviews because it verifies practical implementation skills and judgment for deploying reliable classifiers, aligning metrics to business goals and diagnosing performance and fairness across slices, with emphasis on practical application informed by conceptual understanding.

  Machine LearningTechnical Screen
• OpenAIMedium·Machine Learning Engineer
  Vectorize One-Nearest-Neighbor and Express It as a Neural Forward Pass

  Tests vectorized distance computation in array libraries and the mathematical equivalence between nearest-prototype classification and an affine neural network layer.

  Machine LearningTechnical Screenvectorizationnearest-neighborslinear-algebra
• OptiverMedium·Data Scientist
  Expected Wait for a Bus That Runs Late Half the Time

  This question evaluates a candidate's understanding of probabilistic modeling and expectation calculations for stochastic arrival processes, touching on renewal-theory concepts and length-biased sampling phenomena relevant to timing and queuing problems.

  Machine LearningTechnical Screen
• OptiverEasy·Quantitative Researcher
  Fermi Estimation with Confidence Intervals: How Many Houses Does One Year of US Netflix Spending Buy?

  This question evaluates a candidate's quantitative estimation and uncertainty-quantification skills, focusing on decomposition into estimable factors, clear articulation of assumptions, calibrated confidence intervals, and updating estimates when new aggregate data are provided.

  Machine LearningTechnical Screen
• OptiverHard·Data Scientist
  Market-Making Estimation Game: Optimal Confidence-Interval Strategy Over 5 Rounds

  This question evaluates probabilistic reasoning, decision-theoretic optimization of confidence intervals, and sequential risk–reward trade-offs by requiring interval estimation under a nonstandard scoring rule, relevant to a Data Scientist and categorized in Machine Learning/statistical decision theory.

  Machine LearningTechnical Screen
• OptiverMedium·Quantitative Trader
  Quant Trading Game: Expected-Value Betting and Market Making on Coins, Dice, and Cards

  This question evaluates probabilistic reasoning, expected-value calculation, risk management, and market-making intuition under time pressure within a simulated trading game.

  Machine LearningTechnical Screen
• OptiverEasy·Quantitative Researcher
  Trading Game: Expected-Value Betting, Kelly Sizing, and Arbitrage Under Time Pressure

  This question evaluates quantitative probability reasoning, expected-value computation, risk-sizing (including Kelly-style sizing), arbitrage recognition, and market-making intuition within a live trading simulation.

  Machine LearningTechnical Screen
• OracleMedium·Data Scientist
  Explain Medical AI Data and Evaluation

  This question tests the ability to design an end-to-end evaluation and data pipeline for a clinical conversational agent, emphasizing safety, bias mitigation, and rigorous validation in a high-stakes environment.

  Machine LearningTechnical ScreenLLMRAGHealthcare AI
• OOtherMedium·Data Scientist
  Design anomaly detection and handle imbalanced logistic regression

  Design a fraud detection setup for 50M transactions at a 0.4% fraud rate: a supervised logistic regression model plus an unsupervised anomaly detector for new merchants with no labels. Cover time-based splits, delayed labels, imbalance, calibration, and a cost-based threshold where a missed fraud costs far more than a false alarm.

  Machine LearningTechnical Screen
• PPPDT PartnersMedium·Machine Learning Engineer
  Project Deep Dive: Low-Latency LSTM Inference at Scale and the LSTM vs Transformer Choice

  A project deep dive on a small LSTM model served for large-scale, latency-sensitive inference. The candidate must explain the deployment hardware, latency requirement and use case, how inference latency was reduced, why an LSTM was chosen over a Transformer, and whether that choice still holds today.

  Machine LearningTechnical Screen
• PayPalHard·Data Scientist
  Build a real-time ATO model

  This question assesses the ability to design an end-to-end, low-latency machine learning pipeline for detecting account takeover (ATO) in payment transactions, focusing on label noise, feature engineering, and system deployment constraints.

  Machine LearningTechnical ScreenReal-time SystemsFraud DetectionFeature Engineering
• PerplexityMedium·Machine Learning Engineer
  Train and improve a scikit-learn binary classifier

  This problem tests your proficiency in the scikit-learn workflow, specifically focusing on data preprocessing, addressing class imbalance in imbalanced datasets, and selecting appropriate metrics beyond accuracy.

  Machine LearningTechnical Screenscikit-learnImbalanced DataModel Evaluation
• PinterestHard·Machine Learning Engineer
  Bias-Variance Tradeoff and Vanishing Gradients in Feedforward Networks

  Tests theoretical and mathematical understanding of the bias-variance decomposition and the vanishing-gradient phenomenon during backpropagation in deep feedforward architectures.

  Machine LearningTechnical ScreenDeep LearningBackpropagationModel Generalization
• PinterestMedium·Machine Learning Engineer
  Explain bias–variance, overfitting, and vanishing gradients

  This question tests the conceptual understanding of the bias-variance tradeoff, methods for diagnosing and preventing overfitting, and the theoretical causes and architectural solutions for vanishing gradients in deep learning.

  Machine LearningTechnical ScreenDeep LearningBias-Variance TradeoffRegularization
• PinterestEasy·Machine Learning Engineer
  Explain learning-rate fluctuation and vanishing gradients

  This question evaluates a candidate's understanding of optimization dynamics (effects of learning rate on training stability) and backpropagation-related issues (vanishing gradients) in deep neural networks, assessing competencies in training behavior and gradient propagation within the Machine Learning domain.

  Machine LearningTechnical Screen
• PinterestHard·Machine Learning Engineer
  Explain overfitting and how to prevent it

  This question evaluates understanding of overfitting, the relationship between training and validation performance and generalization, and knowledge of regularization concepts including differences between L1 and L2 penalties.

  Machine LearningTechnical Screen
• PinterestHard·Machine Learning Engineer
  Explain overfitting, underfitting, and regularization

  This question tests the conceptual understanding of the bias-variance tradeoff and the practical application of regularization to balance model complexity and generalization error.

  Machine LearningTechnical ScreenBias-VarianceRegularizationGeneralization
• PinterestHard·Data Scientist
  Explain your ML project end-to-end

  This question evaluates a data scientist's end-to-end machine learning competencies, including problem framing and metric justification, data sourcing and labeling, model selection and calibration, class-imbalance handling, deployment and monitoring, experimentation design, and post-mortem analysis; it is in the Machine Learning domain and tests both conceptual understanding and practical application across modeling and MLOps. It is commonly asked to assess an interviewee's ability to justify trade-offs, reason about operational constraints such as latency, fairness and cost, design valid evaluation and A/B testing strategies, and define measurable monitoring and rollback criteria.

  Machine LearningTechnical Screen
• PinterestHard·Machine Learning Engineer
  Prevent Vanishing Gradients in Deep Networks

  Tests a candidate's mathematical understanding of the vanishing gradient problem in deep neural networks and their ability to evaluate architectural mitigations including weight initialization, activation functions, residual connections, and normalization layers.

  Machine LearningTechnical ScreenDeep LearningOptimizationNeural Networks
• Point72Medium·Quantitative Researcher
  Defend a Quantitative Factor Research Project

  Practice defending quantitative factor construction, information coefficient, model selection, backtesting, and research improvements.

  Machine LearningTechnical Screen