This repo provides different pytorch implementation for training a deep learning model. It uses a simple classification task example for CIFAR10 Dataset to show:
- A simple vanilla, single-GPU implementation
- A multi-GPU, distributed data parallel implementation
- A Pytorch-ligtning implementation along with tracking and visualization in TensorBoard
- A Pytorch-ligtning Hydra implementation for rapid experimentation and prototyping using new models/datasets