What is Gradient Descent?
Gradient descent (https://en.wikipedia.org/wiki/Gradien...) is a simple, yet powerful, optimization algorithm. It is widely used in machine learning and artificial intelligence because of its flexibility and effectiveness. The iterative nature of gradient descent makes it well suited for many problems a where closed form solution is either not available or computationally hard to find.
Credits:
All animations were made using the manim library: https://docs.manim.community/en/stable/
Source code for the animations in the video: https://github.com/AlgoNeural/what-is...