practice a little every day, paws crossed ♡
Analytics & Experimentation Interview Questions
Practice 9403 coding, system design and machine learning questions from 546 companies, sorted by role, topic and interview round. Every question has step-by-step hints, a code runner that supports 8 languages and an AI mentor; members also get the full solution walkthrough.
- 9403
- Questions
- 546
- Companies
- 11
- Topics
- 8
- Languages
Showing 331–360 of 560 results
- MetaHardData ScientistDetermining the optimal ad load in News Feed
Evaluates optimal News Feed ad-load strategy using marginal revenue, user tolerance, and long-term LTV. Strong answers test ad-load levels, segment tolerance, personalize caps, and monitor revenue, retention, and user-experience guardrails.
Analytics & ExperimentationTechnical Screen - MetaHardData ScientistDiagnose sales correlations without claiming causality
This question tests the ability to design an observational study that identifies associations between a new feature adoption and sales growth while strictly avoiding causal claims in the presence of self-selection bias.
Analytics & ExperimentationTechnical ScreenObservational StudyCausal InferenceAnalytics - MetaHardData ScientistEstimate revenue of organic shopping tab
This question evaluates a data scientist's skills in revenue modeling, funnel construction, causal inference for bias correction, experimentation scaling, and sensitivity analysis using organic engagement and purchase metrics.
Analytics & ExperimentationOnsite - MetaMediumData ScientistEvaluate AI-assisted ad creation
This question evaluates competency in product analytics, experimentation design, causal inference, metric definition, and measurement of downstream business and user-quality impacts for an AI-assisted advertising feature.
Analytics & ExperimentationOnsite - MetaEasyData ScientistEvaluate AI-assisted ads creation feature
This question assesses the ability to design an A/B test for a new AI feature, focusing on metric definition, experiment design, and mitigating potential trade-offs between advertiser efficiency and ad quality.
Analytics & ExperimentationOnsiteA/B TestingProduct MetricsExperiment Design - MetaHardData ScientistEvaluate Facebook Dating launch and validate success
This question evaluates a data scientist's competency in product analytics, experimental design, causal inference, and launch validation by requiring definition of primary and guardrail metrics, test unit and spillover considerations, power/duration planning, behavioral signal expectations, quasi-experimental alternatives, and scale/readiness criteria. Commonly asked in Analytics & Experimentation interviews because organizations need assurance a pilot can be scaled safely and reliably, it tests practical application of experimental methods alongside conceptual understanding of statistical power, spillover risk, diagnostic checks, and operational concerns such as privacy and abuse monitoring.
Analytics & ExperimentationTechnical Screen - MetaMediumData ScientistEvaluate Impact of Increasing Stranger Content in Feeds
This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Evaluate Impact of Increasing Stranger Content in Feeds states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Analytics & ExperimentationTechnical Screen - MetaMediumData ScientistEvaluate Instagram's Short-Video Recommender System Success
Evaluates success metrics and experimentation for Instagram's short-video recommender feed. Strong answers choose a durable user-value metric, understand heavy-tailed engagement distributions, handle metric trade-offs, and outline a safe A/B test with retention, safety, creator, and app-level guardrails.
Analytics & ExperimentationOnsite - MetaHardData ScientistEvaluate Messenger's P2P Payments Feature for Business Viability
Evaluates business viability for a Messenger P2P payments feature. Strong answers define networked adoption and transfer metrics, assess fraud, compliance, support, trust, and unit economics, and propose a beta or experiment design that handles spillovers and contamination.
Analytics & ExperimentationOnsite - MetaHardData ScientistEvaluate New Ad Model with A/B Testing Experiment
This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Evaluate New Ad Model with A/B Testing Experiment states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Analytics & ExperimentationOnsite - MetaMediumData ScientistEvaluate Notification-Based Account Ranking
This question tests the ability to design an experiment to measure the causal impact of a new notification strategy on account ranking quality and user engagement.
Analytics & ExperimentationTechnical ScreenExperimentationCausal InferenceMetrics - MetaMediumData ScientistEvaluate a Live-Stream Group Notification Under Network Effects
This question tests the ability to design an experiment that accounts for spillover effects and user fatigue in a social graph, while proposing causal inference methods for environments where randomization is restricted.
Analytics & ExperimentationTechnical ScreenCausal InferenceNetwork EffectsExperimentation - MetaMediumData ScientistEvaluate a New Ads-Ranking Algorithm
This question tests the ability to design a robust A/B test for an ads-ranking system while accounting for interference effects, budget constraints, and conflicting metric signals.
Analytics & ExperimentationOnsiteA/B TestingAd-TechMetrics - MetaMediumData ScientistEvaluate fake accounts and ad creation
This question tests the ability to design an evaluation framework for identifying malicious actors in an ad-tech environment and measuring the performance of automated content generation tools.
Analytics & ExperimentationOnsiteAnalyticsExperimentationMetric Design - MetaHardData ScientistEvaluate shopping tab pre- and post-launch
This question evaluates a data scientist's competency in causal inference, experiment design, funnel metric instrumentation, revenue modeling, sensitivity analysis, and data‑quality triage within the Analytics & Experimentation domain.
Analytics & ExperimentationTechnical Screen - MetaHardData ScientistEvaluate the Health of Facebook Groups
Evaluates Facebook Group health metrics and threaded-comments experiment design. Strong answers define normalized health scores, compare small and large groups fairly, and test deep interaction with safety guardrails.
Analytics & ExperimentationOnsite - MetaMediumData ScientistEvaluating a 15 % reduction in post‑card height
Evaluates feed UX experimentation for reducing post-card height and diagnosing divergent geographic revenue outcomes. Strong answers measure scroll efficiency, viewability, engagement, ad revenue, device/network effects, and geo-specific decisions.
Analytics & ExperimentationTechnical Screen - MetaMediumData ScientistEvaluating the Facebook ‘Memory’ feature
Evaluates Facebook Memories feature performance beyond click-through rate and surface-level engagement. Strong answers measure incremental engagement, retention, cannibalization, quality guardrails, frequency caps, sensitive-content handling, and launch criteria.
Analytics & ExperimentationTechnical Screen - MetaMediumData ScientistEvaluating the Impact of Duplicate and Stolen Posts on a Content Platform
This question tests the ability to design a measurement framework for evaluating content-quality problems on a large user-generated-content platform. It assesses competency in metric selection, experimentation design, and causal reasoning within the Analytics & Experimentation domain — skills central to data science roles focused on platform health.
Analytics & ExperimentationTechnical Screen - MetaEasyData ScientistExplain why IG Story usage exceeds Facebook
This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Explain why IG Story usage exceeds Facebook states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Analytics & ExperimentationOnsite - MetaMediumProduct ManagerGoals, North-Star Metric and Guardrails for Scam Protection Across Meta's Apps
A metrics question asking a product manager to set goals and success metrics for a scam-prevention product across Meta's apps. It tests goal prioritization, the choice and measurement of a north-star metric, leading indicators by scam type and surface, guardrails against over-enforcement, and measurement under adversarial behavior.
Analytics & ExperimentationOther - MetaMediumData ScientistHow investigate a brand-ad spend drop?
This question evaluates a data scientist's competency in diagnosing ad-spend anomalies, including data validation, attribution and reporting integrity, segmentation and placement effects, and causal inference within advertising analytics.
Analytics & ExperimentationTechnical Screen - MetaMediumData ScientistHow to Validate Friends' Content Engagement Hypothesis?
Evaluates how to validate whether friends' content drives stronger social engagement than unconnected content. Strong answers define socialness metrics, control observational bias, test launch impact for unconnected feed content, and monitor discovery, retention, cannibalization, and quality guardrails.
Analytics & ExperimentationTechnical Screen - MetaEasyData ScientistHow to evaluate a similar-listing notifications feature
A Meta Data Scientist analytics-and-experimentation interview question: a US C2C second-hand marketplace is considering opt-in “similar listings” notifications. You must (1) decide whether to build it — hypotheses, opportunity sizing, risks, MVP plan — and (2) design the post-launch measurement: a user-randomized A/B test with a primary/diagnostic/guardrail metric stack, handling of opt-in selection bias, and a clear launch/rollback rule.
Analytics & ExperimentationTechnical Screen - MetaMediumData ScientistHow to evaluate new listing notifications?
This problem tests your ability to design an A/B test for a marketplace notification feature, focusing on balancing buyer engagement with potential cannibalization and ecosystem health metrics.
Analytics & ExperimentationTechnical ScreenA/B TestingMetricsMarketplace - MetaEasyData ScientistHow would you define and use retention metrics?
This question evaluates a data scientist's competency in product analytics and experimentation by assessing understanding of retention metric definitions, cohorting strategies, short- versus long-term trade-offs, common measurement pitfalls, and A/B test design considerations.
Analytics & ExperimentationTechnical Screen - MetaMediumProduct AnalystHow would you drive product growth?
This question evaluates product growth analytics competencies including experimentation design, funnel decomposition, metric definition and guardrails, segmentation, and causal inference within the Analytics & Experimentation domain for social media and mobile product features.
Analytics & ExperimentationOnsite - MetaEasyData ScientistHow would you evaluate emoji reactions launch?
This question tests the ability to design an experimentation framework for a new feature in a social product, specifically focusing on metric selection, identifying interference, and isolating the causal impact of a feature rollout.
Analytics & ExperimentationOnsiteProduct MetricsA/B TestingCausal Inference - MetaEasyData ScientistHow would you evaluate pixel-issue notifications?
This question tests the ability to build a comprehensive evaluation framework for a new feature, specifically focusing on defining success metrics, identifying potential side effects, and designing an experimental setup for pixel-issue notifications.
Analytics & ExperimentationTechnical ScreenMetric DesignA/B TestingCausal Inference - MetaEasyData ScientistHow would you evaluate upranking shop ads?
This question tests your ability to design an A/B testing framework for evaluating ad ranking changes, including metric selection, segment analysis, and identifying potential biases in historical data.
Analytics & ExperimentationTechnical ScreenA/B TestingMetricsAdTech
Meta