Lecture 5: Derivatives wrt Vector, Matrices and Cross Entropy
This lecture discusses the procedure of writing derivatives wrt vectors and matrix elements for scalar and vector-valued functions while in optimization. This lecture also introduces and provides an understanding of other loss functions like cross-entropy and KL divergences.