Presents theoretical foundations of machine learning. Risk, empirical risk minimization, PAC learnability and its generalizations, uniform convergence, VC dimension, structural risk minimization, regularization, linear models and their generalizations, ensemble methods, stochastic gradient descent, stability, online learning.