Lecture 7 | Acceleration, Regularization, and Normalization
Carnegie Mellon University
Course: 11-785, Intro to Deep Learning
Offering: Fall 2019
For more information, please visit: http://deeplearning.cs.cmu.edu/
Contents:
• Stochastic gradient descent
• Acceleration
• Overfitting and regularization
• Tricks of the trade:
Choosing a divergence (loss) function
Batch normalization
Dropout