Katkat

Prevent data registration outage and reduce loss

Capital OneData Scientist · Technical Screen

Last updated

This question evaluates competency in production data reliability, monitoring and alerting, incident response, reconciliation, and cross-functional leadership for analytics pipelines.

The premium registration pipeline silently failed for three months, causing thousands of missed registrations and revenue loss. As the analytics lead partnering with engineering, propose a concrete prevention and mitigation plan: (a) Define SLIs/SLOs (e.g., end‑to‑end registration success rate, event lag/freshness, daily registration volume vs. forecast) with exact alert thresholds and time windows; include synthetic canaries and data contracts (schema, not‑null/uniqueness, referential integrity). (b) Describe architecture changes (idempotent writes, retries with backoff, circuit breakers, DLQs, exactly‑once semantics, reconciliation jobs comparing app events to billing rows, auto backfills). (c) Design dashboards (funnel, drop‑off by stage, cohort view), on‑call runbooks, and postmortem process. (d) Quantify the expected reduction in loss (e.g., from 6,000 affected users to <300) and how you’d validate with drills and game days. Provide a 30/60/90‑day rollout plan with ownership and risks.