Katkat
Back

Compare XGBoost and LightGBM

TuroData Scientist · Onsite
HardData ScientistOnsiteMachine Learning

Last updated

This question evaluates a data scientist's understanding of gradient-boosted tree implementations and practical model trade-offs, covering competencies in algorithmic differences, performance and memory characteristics, handling of missing and categorical features, regularization risks, and hyperparameter considerations for production models.

In a machine learning interview, explain the key differences between XGBoost and LightGBM for a tabular booking-conversion prediction problem.

Your answer should cover:

  1. What both algorithms have in common.
  2. How their tree-building strategies differ.
  3. Differences in speed, memory usage, and scalability.
  4. How they handle missing values and categorical features.
  5. Regularization and overfitting risks.
  6. Important hyperparameters.
  7. How you would choose between them for a production marketplace model.