Katkat
Back

Diagnose Search Issues with Relevant Metrics and Solutions

TikTokData Scientist · Onsite
MediumData ScientistOnsiteAnalytics & Experimentation

Last updated

Evaluates diagnosis of brand-name search relevance and safety issues using analytics and experimentation. Strong answers define relevance, satisfaction, and harmful-content metrics, find root causes, and validate fixes offline and online.

Scenario

Brand clients report that searching their own name (e.g., 'Apple') on the platform surfaces irrelevant or harmful content.

Question

Which metrics would you examine to diagnose the search-relevance problem, and how would you structure an approach to resolve it?

Hints

Consider precision/recall, CTR, dwell time, harmful-content rate, brand-safety violations, time-series before/after model changes.