Gradient Boosting Regressor From Scratch

Project Brief

Creating a gradient boosting regressor from scratch and visualising it as well as training it on sklearn diabetes dataset and benchmarking against sklearn gradient boosting regressor method

Accomplishments

• Implemented gradient boosting regressors from scratch using stumps as estimators
• Visualised the step by step process of how gradient boosting works
• Benchmarked my own gradient regression boosting method against sklearn’s gradient boosting regressor on the sklearn diabetes dataset

Technologies Used:

• Pytorch
• Numpy

Gallery