Lecture Number | Date | Topic | Slides | Readings |
---|---|---|---|---|
0 | 5/10/2021 | Logistics and Intro | N/A | |
1 | 5/11/2021 | Perceptron | Lecture 1 of Yaoliang's notes UML Section 9.1 ESL Section 4.5 |
|
2 | 5/13/2021 | Linear Regression | Lecture 2 of Yaoliang's notes UML Section 9.2, 11.2 ESL Section 3.2, 3.4, 7.10 |
|
3 | 5/18/2021 | k-Nearest Neighbour Classification | Lecture 5 of Yaoliang's notes UML Section 19 ESL Section 2.3.2, 13.3 ISL Section 2.2 |
|
4 | 5/20/2021 | Logistic Regression | Lecture 6 of Yaoliang's notes UML Section 9.3 ESL Section 4.4 ISL Section 4.3 |
|
5 | 5/25/2021 | Hard-Margin SVM | Lecture 7 of Yaoliang's notes UML Section 15 ESL Section 12.1-12.3 ISL Section 9.1-9.2 |
|
6 | 5/27/2021 | Soft-Margin SVM | UML Section 15 ESL Section 12.1-12.3 ISL Section 9.1-9.2 |
|
7 | 6/01/2021 | Kernels | UML Section 16 ESL Section 12.3 ISL Section 9.3 |
|
8 | 6/03/2021 | Decision Trees | PDF |
UML Section 18 ESL Section 9.2 ISL Section 8.1 |
9 | 6/08/2021 | Bagging and Boosting | Lecture 11 of Yaoliang's notes UML Section 10 ESL Section 8.2, 8.7, 10 ISL Section 8.2 |
|
10 | 6/10/2021 | Multilayer Perceptrons | Lecture 12 of Yaoliang's notes DL Section 6 D2L Section 4 UML Section 20 |
|
11 | 6/15/2021 | Deep Networks | DL Section 7, 8 D2L Section 5, 11 An overview of gradient descent optimization algorithms, by Sebastian Ruder |
|
12 | 6/17/2021 | Convolutional Neural Networks | DL Section 9 D2L Section 6, 7 |
|
13 | 6/22/2021 | Recurrent Neural Networks | DL Section 10 D2L Section 8, 9 |
|
14 | 6/24/2021 | K-Means Clustering and Mixture Models | Lecture 16 of Yaoliang's notes UML Section 22.2, 24.4 ESL Section 6.8, 8.5, 14.3 ISL Section 10.3 |
|
15 | 6/29/2021 | Autoencoders and Variational Autoencoders |
DL Section 14, 20 Building Autoencoders in Keras, by Francois Chollet An Introduction to Variational Autoencoders, by Diederik Kingma and Max Welling |
|
16 | 7/8/2021 | Generative Adversarial Networks | Lecture 19 of Yaoliang's notes DL Section 20 D2L Section 17 |
|
17 | 7/13/2021 | Robustness | Adversarial Robustness - Theory and Practice by Zico Kolter and Aleksander Madry | |
18 | 7/15/2021 | Privacy | Notes | |
19 | 7/20/2021 | Attention | Lecture 22 of Yaoliang's notes The Annotated Transformer, by Sasha Rush D2L Section 10 Attention Is All You Need Improving Language Understanding with Unsupervised Learning BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Better Language Models and Their Implications Language Models are Few-Shot Learners |
|
20 | 7/22/2021 | Ethics | Private traits and attributes are predictable from digital records of human behavior Sharing learnings about our image cropping algorithm Gender Shades Machine Bias: There’s software used across the country to predict future criminals. And it’s biased against blacks. |