This video introduces the machine learning concept of decision trees. Binary decision trees recursively partition the input space into smaller regions. In order to make a prediction, we simply start at the root of the decision tree and apply the decision rules until we reach a leaf, which then determines the output value. Decision trees work for classification as well as regression. The video also talks about related concepts such as random forests.