What is the difference between GBM, XGBoost, and LightGBM in gradient boosted tree implementations?

Machine Learning Hard

Machine Learning — Hard

What is the difference between GBM, XGBoost, and LightGBM in gradient boosted tree implementations?

Key points

  • GBM is the base algorithm
  • XGBoost adds second-order gradient approximation
  • LightGBM uses histogram-based splitting
  • LightGBM has leaf-wise tree growth
  • LightGBM uses GOSS and EFB for large datasets

Ready to go further?

Start full exam Practice more questions

Related questions