Visualize Back Propagation: (4) Weight-space
In this video we a third data point into the mix an observe how the error surface changes and how starting our network off in different states leads to different solutions. We then take that third point and the solution we picked off of the graph and bring them back into WinPlot to see how the network responds. Note that the solution for the network does not always correlate to fitting the data exactly, which we see with an overdetermined system.