Katkat
Back

Determine Channel Performance with Additional Metrics Needed

OneMain FinancialData Scientist · Technical Screen
MediumData ScientistTechnical ScreenAnalytics & Experimentation

Last updated

This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Determine Channel Performance with Additional Metrics Needed states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

Scenario

A company sells a product through three channels ­– online, phone and email – and supplies click-through and conversion rates for each.

Question

Given impressions, click-through rate and conversion rate for each channel, compute the expected number of purchases per channel. Rank channels by conversion efficiency and overall expected revenue if an average order value is supplied. Which additional metric(s) would you request to judge channel performance more holistically?

Hints

Conversions = impressions × click rate × conversion rate; compare per-impression or per-click ROI.