a learning-oriented deep learning framework. A finger snap, half of the deep learning frameworks disappears!! Recently, many deep learning framework have been open sourced, it is neccesary to learn how to implement the core features from scratch.
Preresuiste:
- PyTorch:Facebook
- Tensorflow:Google
- Caffe
- MxNet: Amazon Alt-H1 ======
- PaddlePaddle:Baidu
- MindSpore:Huawei
- Jitter:TsingHua
- MegaEngine:Face++
- NCNN:Tencent
- X-Deep Learning: Alibaba
Computational Graph: Static vs Dynamic Eager Mode vs Graph Mode Development vs Research
Parrallel Programming
CNN Transformer
Multiple GPUs & Multiple Machines
memory optimization