Visualize Back Propagation: (3) Weight-Space
In this video we transition from iteratively trying out the algorithm in WinPlot to looking at a contour map of the entire weight space. We can then pick starting values for the weight and bias and watch the algorithm compute the next point and proceed onwards. We then plot these points to display the path followed by gradient descent to see how it arrives at the solution.