Gradient Boosting
In this video, I take a look at an alternative to bootstrap aggregation & random forest: boosting. We cover a brief history of boosting and see how it works in action with XGBoost and LightGBM.
LINKS AND INFO
Catallaxy Services - https://www.catallaxyservices.com
Keeping It Classy: Designing a Great Classifier -- https://www.catallaxyservices.com/pre...
Slide deck -- https://www.catallaxyservices.com/med...
Demo code -- https://github.com/feaselkl/Keeping-I...
Gradient Boosting in Classification: Not a Black Box Anymore! -- https://blog.paperspace.com/gradient-...
GradientBoosting vs AdaBoost vs XGBoost vs CatBoost vs LightGBM -- https://www.geeksforgeeks.org/gradien...
Greedy function approximation: A gradient boosting machine. -- https://projecteuclid.org/journals/an...
Gradient boosting machines, a tutorial -- https://www.frontiersin.org/articles/...
Getting started with Gradient Boosting Machines - using XGBoost and LightGBM parameters -- https://www.nityesh.com/gradient-boos...
XGBoost: A Scalable Tree Boosting System -- https://arxiv.org/abs/1603.02754
A Gentle Introduction to XGBoost for Applied Machine Learning -- https://machinelearningmastery.com/ge...
XGBoost in Python from Start to Finish -- • XGBoost in Python from Start to Finish
LightGBM: A Highly Efficient Gradient Boosting Decision Tree -- https://www.microsoft.com/en-us/resea...
Welcome to LightGBM's documentation! -- https://lightgbm.readthedocs.io/en/st...
LightGBM Classifier in Python -- https://www.kaggle.com/code/prashant1...