Measure Causal Impact of Self-Selected App Redesign
LinkedInData Scientist · OnsiteLast updated
LinkedIn causal inference prompt on measuring a self-selected app redesign, covering potential outcomes, ATT, propensity matching or weighting, staggered difference-in-differences, event studies, covariates, balance, and pre-trend validation.
Scenario
A mobile-app redesign is shipped as a new version; users opt-in by upgrading, so a standard A/B test is not possible.
Question
How would you measure the causal impact of the redesign when users self-select into the new version? Describe the causal-inference framework you would use, how you would construct comparable treatment/control groups, which features you would match or weight on besides past engagement, and how you would validate your assumptions.
Hints
Explain propensity-score matching/weighting, covariate selection, balance checks, difference-in-differences or other robustness tests.
Solution walkthrough is for members
Get the full walkthrough with reference code and complexity analysis, plus Kitty Coach at 300 messages a day. Hints, the code runner and community answers stay free.