Katkat
Back

Determine Value of Prioritizing Accounts by Unread Notifications

MetaData Scientist · Technical Screen
MediumData ScientistTechnical ScreenAnalytics & Experimentation

Last updated

This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Determine Value of Prioritizing Accounts by Unread Notifications states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

Scenario

A product team wants to introduce a feature that, for users with multiple accounts, orders those accounts by descending count of unread notifications.

Question

How would you determine, using data, whether prioritizing accounts by unread-notification count is a worthwhile idea?

Design an A/B experiment to validate this feature. Specify population, treatment, control, success metrics, and test duration.

Imagine the test shows that the frequency of account switching drops while the total number of active accounts rises. How would you interpret this result and decide next steps?

Hints

Think about exploratory historical analysis, customer behavior segmentation, primary vs. guard-rail metrics, experiment power, and reconciling conflicting short-term and long-term signals.