Topic
Analytics & Experimentation interview questions
560 Analytics & Experimentation questions from 84 companies, with hints, runnable code and solution walkthroughs.
74 easy288 medium198 hard
Analytics & Experimentation interview questions by the numbers
Last updated
Katkat has 560 Analytics & Experimentation interview questions from 84 companies; the most come from Meta (21%), Capital One (11%) and DoorDash (9%). By difficulty: 13% easy, 51% medium and 35% hard. The most common round is Technical Screen (55%). Frequent concepts include Causal Inference, A/B Testing, Experimentation and Metrics.
Companies (84)
Difficulty
- Easy13% · 74
- Medium51% · 288
- Hard35% · 198
Interview rounds
- Technical Screen55% · 306
- Onsite39% · 218
- Online Assessment3% · 16
- HR Screen3% · 14
- Other1% · 6
Roles
- Data Scientist92% · 513
- Software Engineer2% · 13
- Data Analyst2% · 10
- Product Analyst1% · 7
- Data Engineer1% · 5
Frequent concepts
- Causal Inference13% · 73
- A/B Testing12% · 65
- Experimentation8% · 42
- Metrics7% · 41
- Product Analytics5% · 30
- Experiment Design3% · 18
Most mentioned in interview experiences
- 1.Analyze ad watch-time with Excel pivots2 reports
- 2.Define Ultra success and detect suspicious transactions2 reports
- 3.Define Ultra success metrics and detect suspicious transactions2 reports
- 4.Design a flu-shot A/B/n campaign experiment2 reports
- 5.Design an experiment to evaluate a new ads algorithm2 reports
- 6.Diagnose a dip in approval/conversion rate2 reports
- 7.Estimate impact without experiments and pick variant2 reports
- 8.Evaluate Factors Before Renewing TV-Series Contracts2 reports
- 9.How would you investigate a metric decline?2 reports
- 10.Investigate marketplace metrics and experiment rollout2 reports
Counted from 120 candidate interview experiences on Katkat. How we collect and count
Showing 91–120 of 560 results
This question evaluates experimental design, statistical power and sample-size calculation, selection of primary and guardrail metrics, segmentation with multiple-testing control or hierarchical modeling, stopping rules for sequential analysis, and revenue-impact calculations for A/B testing of email solicitations.
Capital OneData ScientistAnalytics & ExperimentationOnsiteThis question evaluates product analytics and experimentation competencies—product framing, unit economics, revenue modeling, computation-ready metric design, statistical power/sample-size calculation, A/B test setup, and cost-benefit/breakeven analysis—for a Data Scientist role in the Analytics & Experimentation domain, and is commonly asked to assess the ability to translate product hypotheses into measurable business outcomes and defend decisions under stakeholder scrutiny. It tests both conceptual understanding of segmentation, metric validity, and bias considerations and practical application in defining precise numerators/denominators, computing minimum sample sizes and test duration, and producing actionable ROI models.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates a data scientist's competency in causal inference, experimental and quasi-experimental design, incremental profit measurement from transaction-level data, statistical power and sample-size estimation, and validation and guardrail metric planning.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Determine Optimal Budget Allocation for Maximum Profit states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Determine Rent Price Factors for Multi-Family Apartment Profitability states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates your ability to diagnose statistical modeling trade-offs on noisy operational flight data and perform a structured financial break-even analysis for a new lounge product launch.
Capital OneData ScientistAnalytics & ExperimentationOnsiteThe question evaluates a data scientist's competency in profit decomposition, attribution, experiment design, and diagnostic dashboarding within the Analytics & Experimentation domain.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Estimate Revenue and Profitability for Share Workplace's Paid Tier states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Estimate Venmo Revenue and Boost User Engagement Metrics states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenEvaluates energy transition economics for moving from fossil fuels to renewables. Strong answers compare capex, fixed and variable costs, capacity, contribution margin, required MWh for target return, renewable technology trade-offs, policy incentives, reliability, and risk-adjusted recommendation criteria.
Capital OneData ScientistAnalytics & ExperimentationOnsiteCapital One analytics case on TV-series renewal and sale decisions, covering cost-revenue profit, qualitative factors, viewer value, opportunity cost, NPV, profitability actions, and keep-versus-sell economics.
Capital OneData ScientistAnalytics & ExperimentationOnsiteEvaluates ride-sharing financial feasibility with pricing, capacity, driver costs, fixed costs, and competitive strategy. Strong answers compute driver capacity, daily revenue, driver cost, fixed cost, and profit, then assess pricing and utilization levers with marketplace health guardrails.
Capital OneData ScientistAnalytics & ExperimentationOnsiteEvaluates restaurant profitability from a Groupon-style voucher partnership under discount, commission, capacity, and incrementality assumptions. Strong answers model contribution margin, cannibalization, repeat value, and strategic deal terms.
Capital OneData ScientistAnalytics & ExperimentationOnsiteEvaluate a grocery delivery platform's unit economics across two metro markets, construct an end-to-end marketplace metric framework, and determine whether a proposed dynamic delivery fee increases contribution profit.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Evaluate Joint Campaign Strategies for Credit-Card Growth states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Evaluate Key Metrics for Capital One Ad Campaign states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates cohort-level unit economics, discounted cash-flow (NPV) modeling, and sensitivity/break-even analysis related to customer acquisition and credit-card portfolio economics.
Capital OneData ScientistAnalytics & ExperimentationOnsiteAnalyze ValueInc food-court profitability and membership strategy. Covers missed-profit counterfactuals, breakeven, segment unit economics, price elasticity, vertical integration, members-only gating, shutdown costs, and experiment guardrails.
Capital OneProduct AnalystAnalytics & ExperimentationTechnical ScreenCapital One data-scientist technical-screen case: a rival launched a hit vegan burger -- should your fast-food chain add one, and how would you test it? It exercises pricing and willingness-to-pay/elasticity, operational readiness and capacity, cannibalization vs. incrementality, marketing and labeling, success metrics with guardrails, and a matched store-level RCT (difference-in-differences, CUPED, power) feeding an explicit go/no-go rule.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates skills in customer lifetime value modeling, marketing experiment design, acquisition economics, funnel and credit-risk analysis, fraud and operational-cost assessment, and measurement planning for partnership decisions.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenEvaluates app growth strategy communication in an analytics interview for consumer digital products. Strong answers explain the app, monetization, core metrics, roadmap, first experiment, ROI, and trade-offs for a manager audience.
Capital OneData ScientistAnalytics & ExperimentationOnsiteThis question tests the ability to design a decision-making framework for content renewal by balancing historical performance metrics, acquisition costs, and the risk of cannibalization within a streaming portfolio.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question tests the ability to define a structured framework for business decision-making by balancing quantitative metrics, such as viewership trends and production costs, with qualitative strategic considerations.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates a data scientist's competency in cohort-level financial risk assessment, experiment design, and metrics-driven monitoring for promotional break-even analyses within the Analytics & Experimentation domain.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis problem tests your ability to deconstruct a business proposal, identify underlying behavioral and statistical assumptions, and design a validation strategy to mitigate product risk.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates capacity planning, queuing theory (Little's Law), revenue and cannibalization modeling, A/B experiment design (randomization, sample-size and pre-analysis planning), and quick arithmetic sanity checks for a Data Scientist role in Analytics & Experimentation.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates a data scientist's skills in experiment design, causal inference under interference, metric definition and operational analytics for balancing wait-time reductions with revenue guardrails.
Capital OneData ScientistAnalytics & ExperimentationOnsiteThis question evaluates a data scientist's skills in time-series feature engineering and seasonality handling, data joining and leakage detection, hierarchical effects at route and airport levels, model selection (regression vs classification), metric choice, time-aware cross-validation, visualization critique, and experiment/KPI design.
Capital OneData ScientistAnalytics & ExperimentationTechnical ScreenThis question evaluates a data scientist's skills in analytics and experimentation design, focusing on funnel metric definition, conversion and timing analysis, and A/B test planning within the Analytics & Experimentation domain.
Capital OneData ScientistAnalytics & ExperimentationOnsiteThis question evaluates a candidate's competency in data-driven customer segmentation, expected-revenue modeling, and trade-off analysis between churn risk and monetization.
Capital OneData ScientistAnalytics & ExperimentationTechnical Screen