| 8/29 |
1 - Introduction / Logistics |
Kolter |
pdf |
YouTube |
| 8/29 |
2 - ML Refresher / Softmax Regression |
Kolter |
pdf |
YouTube |
| 9/5 |
3 - Manual Neural Networks / Backprop |
Kolter |
pdf |
YouTube (pt 1) YouTube (pt 2) |
| 9/7 |
4 - Automatic Differentiation |
Chen |
pdf |
YouTube |
| 9/12 |
5 - Automatic Differentiation Implementation |
Chen |
ipynb |
YouTube |
| 9/14 |
6 - Optimization |
Kolter |
pdf |
YouTube |
| 9/19 |
7 - Neural Network Library Abstractions |
Chen |
pdf |
YouTube |
| 9/21 |
8 - NN Library Implementation |
Chen |
ipynb |
YouTube |
| 9/26 |
9 - Normalization, Dropout, + Implementation |
Kolter |
pdf |
YouTube |
| 9/28 |
10 - Convolutional Networks |
Kolter |
pdf |
YouTube |
| 10/3 |
11 - Hardware Acceleration for Linear Algebra |
Chen |
pdf |
YouTube |
| 10/5 |
12 - Hardware Acceleration + GPUs |
Chen |
pdf |
YouTube |
| 10/10 |
13 - Hardware Acceleration Implementation |
Chen |
ipynb |
YouTube |
| 10/12 |
14 - Convoluations Network Implementation |
Kolter |
ipynb |
YouTube |
| 10/17 |
No class - Fall Break |
|
|
|
| 10/19 |
No class - Fall Break |
|
|
|
| 10/24 |
15 - Sequence Modeling + RNNs |
Kolter |
pdf |
YouTube |
| 10/26 |
16 - Sequence Modeling Implementation |
Kolter |
ipynb |
YouTube |
| 10/31 |
17 - Transformers and Autoregressive Models |
Kolter |
pdf |
Youtube |
| 11/2 |
18 - Transformers Implementation |
Kolter |
ipynb |
Youtube |
| 11/7 |
No class - Democracy Day |
|
|
|
| 11/9 |
19 - Training Large Models |
Chen |
pdf |
YouTube |
| 11/14 |
20 - Generative Models |
Chen |
pdf |
YouTube |
| 11/16 |
21 - Generative Models Implementation |
Chen |
ipynb |
YouTube |
| 11/21 |
22 - Customize Pretrained Models |
Chen |
pdf |
|
| 11/23 |
No class - Thanksgiving |
|
|
|
| 11/28 |
23 - Model Deployment |
Chen |
pdf |
Youtube |
| 11/30 |
24 - Machine Learning Compilation and Deployment Implementation |
Chen |
ipynb |
Youtube |
| 12/5 |
25 - Future Directions / Q&A |
Both |
|
|
| 12/7 |
26 - Student project presentations |
Students |
|
|