Evaluate impact of short videos in feed
MetaData Engineer · OnsiteLast updated
This question evaluates competency in metrics definition, causal experimentation, product analytics, and feed system behavior within the System Design and Data Engineering domain.
Scenario
You work on a social app’s main News Feed. The team wants to introduce a short-form video module ("Reels") into the feed.
Prompt
- How would you determine whether adding Reels to the News Feed is successful?
- What metrics would you define (primary + secondary/guardrails)?
- How would you design an experiment / launch plan to measure impact?
Notes / Assumptions
- The feed currently contains mixed content (text, images, long videos, links).
- Reels may affect both consumption (viewing) and distribution (other content getting less exposure).
- You have standard event logging for impressions, clicks, watch time, likes, comments, shares, hides, follows, etc.
Solution walkthrough is for members
Get the full walkthrough with reference code and complexity analysis, plus Kitty Coach at 300 messages a day. Hints, the code runner and community answers stay free.