Deep Learning Systems

Cover

Course Info: Deep Learning Systems (dlsyscourse.org) 注：该课程老师之一陈天奇2018年在 University of Washington 开设课程 CSE 599W - Systems for ML，与本课程重合度较高，所以可以翻看网友对 CSE 599W 所作笔记

Lecture & Notes

Slides

Video

1 - Introduction / Logistics

2 - ML Refresher / Softmax Regression

3 - Manual Neural Networks / Backprop

YouTube (pt 1) YouTube (pt 2)

4 - Automatic Differentiation

5 - Automatic Differentiation Implementation

6 - Optimization

7 - Neural Network Library Abstractions

8 - NN Library Implementation

9 - Normalization, Dropout, + Implementation

10 - Convolutional Networks

11 - Hardware Acceleration for Linear Algebra

12 - Hardware Acceleration + GPUs

13 - Hardware Acceleration Implementation

14 - Convoluations Network Implementation

15 - Training Large Models

16 - Generative Adversarial Networks

17 - Generative Adversarial Networks Implementation

18 - Sequence Modeling + RNNs

19 - Sequence Modeling Implementation

20 - Transformers + Attention

21 - Transformers + Attention Implementation

22 - Implicit Layers

24 - Model Deployment

25 - Machine Learning Compilation and Deployment Implementation

26 - Future Directions / Q&A

27 - Student project presentations