Katkat

How do you make data-driven decisions?

Capital OneProduct Manager · HR Screen

Last updated

Explain how to make data-driven product decisions by defining the decision, primary metrics, diagnostics, guardrails, data quality, experiments, segmentation, uncertainty, reversibility, and stakeholder communication.

How do you make data-driven product decisions? Describe your approach to using data, customer insight, experiments, and judgment to choose a product direction under uncertainty.

Constraints & Assumptions

  • Do not imply that data alone makes decisions.
  • Include product context, metrics, guardrails, data quality, and stakeholder alignment.
  • Explain how you act when data is incomplete or conflicting.
  • Use a relevant example if helpful.

Clarifying Questions to Ask

  • What decision are we making?
  • What metric or business outcome should the decision move?
  • What data exists, and how trustworthy is it?
  • Are there risk, compliance, customer trust, or operational constraints?
  • Is this a reversible decision or a one-way-door decision?

Part 1 - Define The Decision And Metrics

How do you frame a data-driven decision?

What This Part Should Cover

  • Decision, hypothesis, primary metric, diagnostic metrics, guardrails, and time horizon.

Part 2 - Analyze Evidence

What data and customer evidence would you use?

What This Part Should Cover

  • Funnel analysis, segmentation, cohorts, experiments, qualitative research, support tickets, and data-quality checks.
  • Difference between correlation and causation.

Part 3 - Decide Under Uncertainty

How do you make a recommendation when data is incomplete?

What This Part Should Cover

  • Reversibility, risk, sensitivity analysis, confidence levels, MVP tests, and stakeholder communication.

Follow-up questions

  • Tell me about a time data changed your mind.
  • What if qualitative feedback conflicts with metrics?
  • How do you avoid p-hacking?
  • What if the experiment is inconclusive?
  • When would you ship without an A/B test?