In this episode we look at how neural networks can be represented with matrices, and create a simple feedforward network in python.
Note: at 2:31 the second bias vector should only have two rows, not three.
Code:
https://github.com/SebLague/Neural-Ne...
I owe a lot to this excellent online book on neural networks:
http://neuralnetworksanddeeplearning....
Learn more about weight initialization:
http://cs231n.github.io/neural-networ...
(note: numpy.random.randn and numpy.random.standard_normal are functionally equivalent, the latter just takes a tuple for the shape parameter).
Support the creation of more tutorials:
/ sebastianlague
https://www.paypal.me/SebastianLague