Analytics & Experimentation Interview Questions

Showing 61–90 of 218 results

• DoorDashMedium·Data Scientist
  Diagnose a Decline in Order Acceptance Rate

  Evaluate a sudden drop in Dasher order acceptance rate by verifying data integrity, decomposing segment-level shifts, and designing an experiment to mitigate downstream marketplace impacts.

  Analytics & ExperimentationOnsiteProduct AnalyticsMetric DecompositionA/B Testing
• DoorDashHard·Data Scientist
  Diagnose cold-food spike and design experiments

  This question evaluates a data scientist's skills in product analytics, metric design, diagnostics, causal inference, and experimental design for diagnosing cold-food complaint spikes using logs, GPS, weather and complaint labels.

  Analytics & ExperimentationOnsite
• DoorDashMedium·Data Scientist
  Diagnose completed orders drop in Los Angeles

  This question evaluates a data scientist's competency in product analytics, causal inference, funnel and metric decomposition, segmentation, and experimentation for marketplace platforms, focusing on diagnosing sustained drops in completed orders.

  Analytics & ExperimentationOnsite
• DoorDashHard·Data Scientist
  Evaluate Account-Partner Onboarding with Success Metrics

  This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Evaluate Account-Partner Onboarding with Success Metrics states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

  Analytics & ExperimentationOnsite
• DoorDashHard·Data Scientist
  Evaluate Biker Feature Success

  This question evaluates experimentation and product analytics skills—metric design, causal inference, and marketplace impact assessment—in the context of a two-sided delivery marketplace, with attention to eligibility, routing, and matching effects.

  Analytics & ExperimentationOnsite
• DoorDashMedium·Data Scientist
  Evaluate Courier-Selected Delivery Distance Limits

  This question tests your ability to design an A/B test for a marketplace feature while accounting for network effects, trade-offs between supply-side control and demand-side fulfillment, and selecting appropriate metrics.

  Analytics & ExperimentationOnsiteA/B TestingMarketplace AnalyticsCausal Inference
• DoorDashHard·Data Scientist
  Evaluate Dasher Initiatives with A/B Testing and Metrics

  This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Evaluate Dasher Initiatives with A/B Testing and Metrics states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

  Analytics & ExperimentationOnsite
• DoorDashMedium·Data Scientist
  Evaluate Impact of $1 Fee on Fast-Food Profitability

  This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Evaluate Impact of $1 Fee on Fast-Food Profitability states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

  Analytics & ExperimentationOnsite
• DoorDashHard·Data Scientist
  Evaluate Top-Dasher Program's Benefits and Challenges

  Evaluate Top-Dasher Program's Benefits and Challenges evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

  Analytics & ExperimentationOnsite
• DoorDashHard·Data Scientist
  Evaluate a new ranking model

  This question evaluates expertise in experimentation design and causal inference within two-sided marketplace environments. It tests the ability to handle interference, SUTVA violations, metric selection, and rollout safety when deploying ranking model upgrades — core competencies for data scientist roles focused on product analytics and A/B testing.

  Analytics & ExperimentationOnsite
• DoorDashHard·Data Scientist
  Experiment on increasing order notifications

  This question evaluates a data scientist's skills in experimental design, causal inference, metric definition and aggregation, power/MDE calculation, and cross‑channel attribution for order‑related messaging campaigns.

  Analytics & ExperimentationOnsite
• DoorDashMedium·Data Scientist
  Investigate Pop-up Impact on Partner Referral Conversions

  This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Investigate Pop-up Impact on Partner Referral Conversions states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

  Analytics & ExperimentationOnsite
• DoorDashMedium·Data Scientist
  Measure Impact of Merchant Variety on Consumer Experience

  This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Measure Impact of Merchant Variety on Consumer Experience states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

  Analytics & ExperimentationOnsite
• ExpediaHard·Data Scientist
  Choose KPIs and prove impact with experiments

  This question evaluates a data scientist's competency in KPI engineering, causal inference, experiment design, metric validation, and multi-touch attribution within the Analytics & Experimentation domain and is focused on profit-oriented search ranking.

  Analytics & ExperimentationOnsite
• FigmaMedium·Data Scientist
  Clarify an Ambiguous Product Question and Define a Metric

  This question tests the ability to transform an abstract product objective into a rigorous measurement framework, focusing on metric selection and experimental design.

  Analytics & ExperimentationOnsiteAnalyticsProduct MetricsExperimentation
• GleanEasy·Data Scientist
  How to measure product success?

  This question evaluates a data scientist's competency in product analytics, metric definition, experiment design, and causal inference, including articulation of a north-star metric, supporting funnel and guardrail metrics, and handling confounding, seasonality, and heterogeneous effects.

  Analytics & ExperimentationOnsite
• GleanMedium·Data Scientist
  Product Case: Define Success Metrics for a Product, Using Enterprise Search as Example

  A data scientist product case: define how to measure the success of a product, practiced on an enterprise search tool. Tests building a metric hierarchy with a north star, input metrics and guardrails, separating users from paying customers, defining a successful search and attributing changes causally.

  Analytics & ExperimentationOnsite
• GoogleHard·Data Scientist
  Analyze time series and design validation experiment

  This problem tests the ability to detect structural changes in time-series data and design a rigorous A/B testing strategy to measure the impact of an intervention on count-based metrics.

  Analytics & ExperimentationOnsiteTime SeriesCausal InferenceA/B Testing
• GoogleHard·Data Analyst
  Choose a North Star Metric for a Malicious-Webpage Classifier

  Choose and measure a malicious-webpage classifier metric using exposure-weighted recall, false-warning guardrails, and unbiased label audits.

  Analytics & ExperimentationOnsite
• GoogleMedium·Data Scientist
  Design A/B Test for Google Maps UI Change

  This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Design A/B Test for Google Maps UI Change states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

  Analytics & ExperimentationOnsite
• GoogleMedium·Data Scientist
  Design A/B Test for Subscription Price Increase Effectiveness

  Evaluates experiment design for SaaS subscription pricing and a multivariate sign-up CTA test. Strong answers address pricing-test risks, LTV metrics, factorial design, interaction effects, and guardrails.

  Analytics & ExperimentationOnsite
• GoogleEasy·Data Scientist
  Design tests to measure latency impact

  A Google Data Scientist onsite case on measuring the causal impact of reduced YouTube video-start latency on engagement. It spans A/B design (primary metric, diagnostics, error/buffering guardrails), randomization unit and interference, power/MDE for heavy-tailed watch time, variance reduction (CUPED, stratification), analysis of conflicting movements, ratio-metric decomposition with Simpson’s paradox, and propensity score matching when randomization isn’t possible.

  Analytics & ExperimentationOnsite
• GoogleMedium·Data Scientist
  Diagnose a metric drop in search time

  This question evaluates a data scientist's competency in precise metric and population definition, time‑to‑event and survival/hazard modeling, time‑series decomposition and change‑point analysis, instrumentation and traffic forensics, and experimental design for root‑cause identification.

  Analytics & ExperimentationOnsite
• GoogleHard·Data Scientist
  Diagnose and reverse an adoption-rate decline

  This question evaluates a data scientist's competency in product analytics and experimentation, covering precise metric definition and validation, instrumentation and event quality checks, rapid triage of adoption regressions, hypothesis generation, experiment design, and causal inference.

  Analytics & ExperimentationOnsite
• GoogleMedium·Data Scientist
  How would you use propensity score matching here

  Evaluates proficiency with propensity score matching and broader causal inference concepts for observational treatment effect estimation, including identification assumptions, propensity score estimation and covariate selection, matching algorithms and common support, balance diagnostics, choice of estimand (ATE vs ATT) and uncertainty quantification, plus sensitivity checks and alternative methods. Common in Analytics & Experimentation interviews for Data Scientist roles because it probes understanding of confounding and identification in nonrandomized settings and requires intermediate-to-advanced applied statistics reasoning about methodological trade-offs.

  Analytics & ExperimentationOnsite
• GoogleHard·Data Analyst
  Investigate a Decrease in Webpage Warnings

  Diagnose falling malicious-webpage warnings by decomposing traffic, scoring, flags, rendering, and labels to separate improvement from failure.

  Analytics & ExperimentationOnsite
• GoogleHard·Data Analyst
  Investigate a Drop in Sales

  Use a structured sales-drop investigation covering metric definitions, data quality, funnel decomposition, segmentation, and causal evidence.

  Analytics & ExperimentationOnsite
• GGrindrMedium·Data Scientist
  Evaluate Dating App Product Changes

  This question tests the ability to design an A/B test for a two-sided marketplace, focusing on network effects, cannibalization of metrics, and the selection of hold-out groups to measure long-term user behavior.

  Analytics & ExperimentationOnsiteA/B TestingMarketplace AnalyticsCausal Inference
• GustoMedium·Data Scientist
  Define Churn and Design Onboarding Experiment

  This question tests the ability to define business-relevant churn metrics for a SaaS platform and design a controlled experiment to optimize user onboarding.

  Analytics & ExperimentationOnsiteAnalyticsExperimentationMetrics
• HDHome DepotEasy·Product Analyst
  Decide whether to keep a negative-margin promotion

  This question evaluates proficiency in analytics, experiment design, causal inference, metric definition, and business-impact analysis for a Product Analyst role, including handling noisy cost data and partial customer identifiers.

  Analytics & ExperimentationOnsite