Topic
Analytics & Experimentation interview questions
560 Analytics & Experimentation questions from 84 companies, with hints, runnable code and solution walkthroughs.
74 easy288 medium198 hard
Analytics & Experimentation interview questions by the numbers
Last updated
Katkat has 560 Analytics & Experimentation interview questions from 84 companies; the most come from Meta (21%), Capital One (11%) and DoorDash (9%). By difficulty: 13% easy, 51% medium and 35% hard. The most common round is Technical Screen (55%). Frequent concepts include Causal Inference, A/B Testing, Experimentation and Metrics.
Companies (84)
Difficulty
- Easy13% · 74
- Medium51% · 288
- Hard35% · 198
Interview rounds
- Technical Screen55% · 306
- Onsite39% · 218
- Online Assessment3% · 16
- HR Screen3% · 14
- Other1% · 6
Roles
- Data Scientist92% · 513
- Software Engineer2% · 13
- Data Analyst2% · 10
- Product Analyst1% · 7
- Data Engineer1% · 5
Frequent concepts
- Causal Inference13% · 73
- A/B Testing12% · 65
- Experimentation8% · 42
- Metrics7% · 41
- Product Analytics5% · 30
- Experiment Design3% · 18
Most mentioned in interview experiences
- 1.Analyze ad watch-time with Excel pivots2 reports
- 2.Define Ultra success and detect suspicious transactions2 reports
- 3.Define Ultra success metrics and detect suspicious transactions2 reports
- 4.Design a flu-shot A/B/n campaign experiment2 reports
- 5.Design an experiment to evaluate a new ads algorithm2 reports
- 6.Diagnose a dip in approval/conversion rate2 reports
- 7.Estimate impact without experiments and pick variant2 reports
- 8.Evaluate Factors Before Renewing TV-Series Contracts2 reports
- 9.How would you investigate a metric decline?2 reports
- 10.Investigate marketplace metrics and experiment rollout2 reports
Counted from 120 candidate interview experiences on Katkat. How we collect and count
Showing 121–150 of 560 results
Calculate a show’s minimum sale price using lost audience value and reinvestment profit, then assess a 60-million-dollar offer.
Capital OneData AnalystAnalytics & ExperimentationTechnical ScreenThis question evaluates unit-economics and quantitative product-launch decision-making skills, focusing on contribution margin metrics, break-even analysis, profit and profit-margin calculations in the Analytics & Experimentation domain for Data Scientist roles, and is primarily a practical application of symbolic and numeric financial modeling with conceptual economic reasoning. It is commonly asked to assess how candidates translate per-unit prices, variable and fixed costs, and observed volumes into go/no-go judgments by reasoning about profitability, required volume targets, and sensitivity to cost or demand trends.
Capital OneData ScientistAnalytics & ExperimentationOnsiteThis question evaluates a candidate's competence in unit economics, break-even and profitability modeling, and the ability to distinguish incremental versus cannibalized customers when assessing voucher-based promotional partnerships, reflecting skills in revenue modeling, cost accounting, and business analytics.
Capital OneData AnalystAnalytics & ExperimentationTechnical ScreenEvaluates price sensitivity and profit-curve reasoning for a network service with downward-sloping demand. Strong answers explain demand curves, profit shape, marginal revenue, marginal cost, and optimal price.
Capital OneData ScientistAnalytics & ExperimentationOnsiteThis question evaluates competency in metric-driven profit analysis, customer economics (LTV/CAC), segmentation effects, and interpretation of A/B experiment results.
ChimeData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates a candidate's competency in experimental design, causal inference, metric definition, statistical diagnostics, and decision-making under data-quality and marketing confounds within the Analytics & Experimentation domain.
ChimeData ScientistAnalytics & ExperimentationTechnical ScreenDetermine Key Metrics for Spend-Tracker Launch Decision evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
ChimeData ScientistAnalytics & ExperimentationTechnical ScreenEvaluate an alternative dataset for an investment pitch through provenance checks, a falsifiable signal hypothesis, and point-in-time validation. Test incremental value, selection bias, revisions, robustness, and costs before presenting the thesis, risks, and invalidation criteria.
CitadelData ScientistAnalytics & ExperimentationTechnical ScreenThis problem tests your ability to design a robust A/B test for a high-stakes identity verification flow, focusing on balancing security metrics with user acquisition and handling potential network interference.
CoinbaseData ScientistAnalytics & ExperimentationOnsiteThis question tests your ability to design a randomized controlled trial to measure the impact of a new identity verification process on user trust and retention, while addressing potential network effects and platform bias.
CoinbaseData ScientistAnalytics & ExperimentationOnsiteThis question evaluates a data scientist's ability in revenue decomposition, diagnostic analytics, causal inference, and experimentation design, covering traffic×CVR×AOV breakdowns, post-purchase deductions, stockout impacts, rapid falsifiable checks, and difference-in-differences-style attribution.
CoinbaseData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Diagnose a Sudden Revenue Decline: Analyses, Metrics, and Root-Cause Tests states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
CoinbaseData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Estimate Super Bowl QR Code Scan Rate Using Historical Data states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
CoinbaseData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Estimate Viewer Engagement with Super Bowl QR Code Promo states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
CoinbaseData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Investigate Anomalies in Coinbase Wallet Engagement Metrics states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
CoinbaseData ScientistAnalytics & ExperimentationTechnical ScreenEvaluate Metrics and Randomization for Onboarding Tutorial Change evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
ConfluentData ScientistAnalytics & ExperimentationOnsiteThis question evaluates your ability to design an A/B test for an operational policy change in a high-traffic environment, focusing on cluster randomization, metric selection, and handling network effects.
CoupangData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates experimental design, causal inference, metric definition, selection bias analysis, logging and privacy considerations, and product analytics competencies for a data scientist working in Analytics & Experimentation.
DiscordData ScientistAnalytics & ExperimentationTechnical ScreenEvaluate subscription-targeting notifications with incrementality metrics, A/A preparation, flat-result diagnosis, and alternative causal designs.
DiscordData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates a data scientist's skills in causal inference, experiment analytics, metric definition and guardrails, confounder adjustment, and rapid decision-making under time pressure.
DisneyData ScientistAnalytics & ExperimentationHR ScreenThis question evaluates operational analytics competencies including cost allocation and attribution for support work, root-cause diagnosis of KPI regressions, and metric design for complaint-driver identification and prevention.
DoorDashAnalytics EngineerAnalytics & ExperimentationTechnical ScreenEvaluates marketplace analytics for launching a bike-courier delivery option in dense delivery markets. Strong answers define stakeholder value, success metrics, market selection, phased rollout, guardrails, and causal evaluation under network effects.
DoorDashData ScientistAnalytics & ExperimentationTechnical ScreenDoorDash analytics prompt on improving mobile web to app-install conversion, covering funnel measurement, attribution, cohorts, install and activation experiments, incentives, guardrails, and long-term retention impact.
DoorDashData ScientistAnalytics & ExperimentationOnsiteThis question tests the ability to design a controlled experiment to evaluate a promotional discount strategy, focusing on causality, profit optimization, and long-term customer value impact.
DoorDashData ScientistAnalytics & ExperimentationOnsiteThis question evaluates a data scientist's ability to decompose per-order operational costs, identify high-impact levers to reduce unit economics, and design rigorous experiments and monitoring for a two-sided delivery marketplace, testing competencies in cost modeling, causal inference, experimentation design, and product analytics.
DoorDashData ScientistAnalytics & ExperimentationOnsiteThis question tests the ability to design a comprehensive evaluation framework for entering a new geographic market by balancing growth, unit economics, and marketplace balance.
DoorDashData ScientistAnalytics & ExperimentationOnsiteThis question tests the ability to design an experimentation framework for a two-sided marketplace, focusing on metric definition, causal inference, and identifying potential gaming behaviors in delivery logistics.
DoorDashData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Design Experiments to Measure Promotion Scheduling Impact states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
DoorDashData ScientistAnalytics & ExperimentationOnsiteThis problem tests your ability to design a controlled experiment in a marketplace with network effects, specifically focusing on how to mitigate spillover interference between treated and control groups.
DoorDashData ScientistAnalytics & ExperimentationOnsiteThis question evaluates competence in experiment design and causal inference for marketplace interventions, covering choice of randomization unit and mitigation of interference/spillovers, stratification and covariate adjustment, power and sample‑size calculations, detection of novelty/steady‑state effects, heterogeneity estimation, and pre-registered guardrail decision rules. It is commonly asked in the Analytics & Experimentation domain because interviewers need to assess both conceptual understanding of causal inference and the practical application of randomized designs and operational measurement to ensure robust, contamination‑aware evaluation of policy changes.
DoorDashData ScientistAnalytics & ExperimentationOnsite