Design A/B Test for Google Maps UI Change
GoogleData Scientist · Onsite
Last updated
This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Design A/B Test for Google Maps UI Change states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.
Scenario
The product team wants to move the Google Maps search bar from the top to the bottom of the screen.
Question
Design an A/B test to evaluate this UI change. Define hypothesis, primary and guardrail metrics, experiment unit, randomization, sample-size calculation, runtime, and how you would interpret the results.
Hints
Explain success metrics (e.g., searches per session), guardrails (retention, errors), power analysis, novelty effects, and rollout decisions.
Solution walkthrough is for members
Get the full walkthrough with reference code and complexity analysis, plus Kitty Coach at 300 messages a day. Hints, the code runner and community answers stay free.