What is Machine Learning? Part 3/5: Decision Tree Algorithm explained - Entropy
In this video, we are going to talk about an extremely important part of the decision tree algorithm, namely the metric that tells us where to best split the data. Or in other words, the metric that tells us what questions to ask. And the particular metric that we are going to look at is called entropy.
Edit: in the formula of the overall entropy at 16:35, "Entropy" should also have a subscript "j"
Links:
Corresponding blog post (and slides): https://www.sebastian-mantey.com/post...
"Coding a Decision Tree from Scratch" series: • Coding a Decision Tree from Scratch i...
"What is Machine Learning?" playlist: • What is Machine Learning? Part 1/5: H...