Relu Variants Explained | Leaky Relu | Parametric Relu | Elu | Selu | Activation Functions Part 2
This is part 2 of the Activation Function Series. In this video, we will discuss the dying relu problem and then learn about the following variants of Relu activation function:
1. Leaky Relu
2. Parametric Relu
3. Elu
4. Selu
Digital Notes for Deep Learning: https://shorturl.at/NGtXg
👍If you find this video helpful, consider giving it a thumbs up and subscribing for more educational videos on data science! Share your thoughts, experiences, or questions in the comments below. I love hearing from you!
============================
Do you want to learn from me?
Check my affordable mentorship program at : https://learnwith.campusx.in
============================
📱 Grow with us:
CampusX' LinkedIn: / campusx-official
CampusX on Instagram for daily tips: / campusx.official
My LinkedIn: / nitish-singh-03412789
Discord: / discord
✨ Hashtags✨
#ActivationFunctions #ReluVariants #NeuralNetworksExplained
⌚Time Stamps⌚
00:00 - Intro
00:44 - Dying Relu Problem
17:12 - Solutions
20:05 - Leaky Relu
22:47 - Advantages
24:29 - Parametric Relu
25:44 - Exponential Linear Unit
28:40 - Disadvantages
29:09 - Scaled Exponential Linear Unit
33:00 - Outro