Computer Science and Information for people.

6.867 is an introductory course on machine learning which gives an overview of many concepts, techniques, and algorithms in machine learning, beginning with topics such as classification and linear regression and ending up with more recent topics such as boosting, support vector machines, hidden Markov models, and Bayesian networks. The course will give the student the basic ideas and intuition behind modern machine learning methods as well as a bit more formal understanding of how, why, and when they work. The underlying theme in the course is statistical inference as it provides the foundation for most of the methods covered.

--- Recommended Citation ---
For any use or distribution of these materials, please cite as follows: Tommi Jaakkola, course materials for 6.867 Machine Learning, Fall 2006. MIT OpenCourseWare (http://ocw.mit.edu/), Massachusetts Institute of Technology. Download Course Materials to URL : http://ocw.mit.edu/OcwWeb/Electrical-Engineering-and-Computer-Science/6-867Fall-2006/DownloadthisCourse

--- Lecture Notes ---

Lecture note files.
LEC #	TOPICS
1	Introduction, linear classification, perceptron update rule (PDF)
2	Perceptron convergence, generalization (PDF)
3	Maximum margin classification (PDF)
4	Classification errors, regularization, logistic regression (PDF)
5	Linear regression, estimator bias and variance, active learning (PDF)
6	Active learning (cont.), non-linear predictions, kernals (PDF)
7	Kernal regression, kernels (PDF)
8	Support vector machine (SVM) and kernels, kernel optimization (PDF)
9	Model selection (PDF)
10	Model selection criteria (PDF)
11	Description length, feature selection (PDF)
12	Combining classifiers, boosting (PDF)
13	Boosting, margin, and complexity (PDF)
14	Margin and generalization, mixture models (PDF)
15	Mixtures and the expectation maximization (EM) algorithm (PDF)
16	EM, regularization, clustering (PDF)
17	Clustering (PDF)
18	Spectral clustering, Markov models (PDF)
19	Hidden Markov models (HMMs) (PDF)
20	HMMs (cont.) (PDF)
21	Bayesian networks (PDF)
22	Learning Bayesian networks (PDF)
23	Probabilistic inference Guest lecture on collaborative filtering (PDF)
24	Current problems in machine learning, wrap up