Reverse mode AD / backprop: explanation, Julia example, and custom rules
Describe basics of how reverse-mode AD (or backprop) works. Derived a couple of examples from scalars to matrices. Then jumped into code using ReverseDiff in Julia. Showed a common type issue and how to resolve. Then showed how to create your own custom rule.