Build and evaluate click prediction models
RedditMachine Learning Engineer · Technical ScreenLast updated
This question evaluates skills in supervised probabilistic modeling for click-through rate prediction, including model selection, calibration, evaluation metric choice, cross-validation, hyperparameter tuning, and production concerns like serving and monitoring.
Build a click-through prediction model from the features above. Start with a trivial baseline classifier, then train and compare logistic regression, random forest, and gradient-boosted trees. Explain why you selected each algorithm and why you did not choose plausible alternatives (e.g., SVM, Naive Bayes, simple neural networks), discussing bias–variance, interpretability, and computational trade-offs. Describe your cross-validation strategy and the hyperparameters you would tune for each model. Choose evaluation metrics appropriate for a roughly class-balanced dataset (e.g., ROC AUC, log loss, PR AUC, accuracy) and justify why these are preferred over others; explain what would change if classes were imbalanced. Finally, outline what additional improvements you would pursue with more time.
Solution walkthrough is for members
Get the full walkthrough with reference code and complexity analysis, plus Kitty Coach at 300 messages a day. Hints, the code runner and community answers stay free.