Introduction, linear classification, perceptron update rule
Linear regression, estimator bias and variance, active learning
Perceptron convergence, generalization
Kernal regression, kernels
Maximum margin classification
Classification errors, regularization, logistic regression
Midterm
Support vector machine (SVM) and kernels, kernel optimization
Active learning (cont.), non-linear predictions, kernals
Margin and generalization, mixture models
Model selection
oosting, margin, and complexity
Model selection criteria
Description length, feature selection
Combining classifiers, boosting
Mixtures and the expectation maximization (EM) algorithm
EM, regularization, clustering
Clustering
Hidden Markov models (HMMs)
Spectral clustering, Markov models
HMMs (cont.)
Probabilistic inference
Bayesian networks
Learning Bayesian networks
Guest lecture on collaborative filtering
Current problems in machine learning, wrap up