Lecture Notes and Slides on ML, PR, and ANN
The following hot links allow you to retrieve lecture notes (in PDF format). Links will fail if notes have not yet been posted.
"Happy Face Notes" the ones that I intend to cover. "Sad Face Notes" the ones most likely will not be covered.
Supervised techniques
-
Introduction to Pattern Recognition (PDF
format) -
Parameter Estimation Techniques (PDF
format)
-
Non-parametric Estimation Techniques (PDF
format)
-
Kalman Filter and Particle Filter (PDF
format) -
Linear Discriminant Functions (PDF
format)
-
Linear and Logistic Regression (PDF
format)
-
Support Vector Machines (PDF
format) (PDF
format, by Nello Chrisianini, BIOWulf Technlogy)
-
Dimension Reduction Techniques (PDF
format)
-
Decision Trees (PDF
format)
-
Generalization Performance (PDF
format)
-
Introduction to Artificial Neural Networks (PDF
format)
-
Simple Perceptrons (PDF
format)
-
Multi-layer Perceptrons (PDF
format)
-
Deep Learning for Computer Vision (PDF
format)
Advanced topics in supervised techniques
-
Kernel Methods (PDF format)
-
Quadratic Program (PDF format) (QP is used as the workhorse numerical method
in Kernel Methods and SVM. Warning: refresh your linear algebra before proceed)
-
Radial Basis Function Networks (PDF
format)
Unsupervised techniques
-
Un-supervised Clustering & Learning with Mixture Densities (PDF
format)
-
Un-supervised Clustering (PDF
format)
-
Un-supervised Learning (PDF
format)
-
Un-supervised Clustering & Indepdent Component Analysis (PDF
format)
-
Un-supervised Data Mining (PDF
format)
Other topics (to be covered if time permits)
-
Memory Models(PDF
format)
-
Correlated and Time-Varying Events (PDF
format)
-
Reinforcement Learning (PDF
format)
Notes are in PDF format. You need the Acrobat Reader to view them. You can
download the Acrobat Reader for free here 
Important Note: The notes contain many figures and graphs in the book “Pattern Recognition” by Duda, Hart, and Stork. The use is permitted for this particular course, but not for any other lecture or commercial use. Hence, I cannot grant permission of copying or duplicating these notes nor can I release the Powerpoint source files.
