NADAM Optimizer from Scratch in Python
Adam is a very popular optimization techniques for deep learning models. Nesterov Accelerated Gradient has been shown to improve momentum optimizer. Let's combine both into NADAM!
Table of Content:
Introduction: 0:00
Theory: 1:03
Code: 6:00
Conclusion: 13:11
Credit:
If you haven't already checkout this great blog article on the gradient descent techniques for optimization: https://ruder.io/optimizing-gradient-...
Music was taken from Youtube and is named A Brand New Start by TrackTribe, checkout their website they are doing some really cool non-profit stuff: https://tracktribe.com/
Repository:
You can checkout the code over here, all of it is in the Gradient Descent notebook: https://github.com/yacineMahdid/artif...
----
Join the Discord for general discussion: / discord
----
Follow Me Online Here:
Twitter: / codethiscodeth1
GitHub: https://github.com/yacineMahdid
LinkedIn: / yacine-mahdid-809425163
Instagram: / yacine_mahdid
___
Have a great week! 👋