This video delves into the fundamental idea on how neural networks learn, known as gradient descent, in which a gradient vector is computed, causing the “cost” of the network to descend.
Link to Neural Networks and Deep Learning book: http://neuralnetworksanddeeplearning.com