Thanos

a learning-oriented deep learning framework. A finger snap, half of the deep learning frameworks disappears!! Recently, many deep learning framework have been open sourced, it is neccesary to learn how to implement the core features from scratch.

Preresuiste:

Deep Learning Frameworks By Now

• PyTorch:Facebook
• Tensorflow:Google
• Caffe
• MxNet: Amazon Alt-H1 ======
• PaddlePaddle:Baidu
• MindSpore:Huawei
• Jitter:TsingHua
• MegaEngine:Face++
• NCNN:Tencent
• X-Deep Learning: Alibaba

Core Features

Tensor

AutoGrad

Computational Graph: Static vs Dynamic Eager Mode vs Graph Mode Development vs Research

GPU Cuda Programming

Parrallel Programming

C++ python mixing programming

Neural Network Basical Modules

CNN Transformer

Mobile First

Advanced Features

Distributed Computing

Multiple GPUs & Multiple Machines

C++ Extension

Performance Optimization

memory optimization