MPI4DL v0.6

Added support for:

• Bidirectional and Layer Parallelism (GEMS+LP)
• Bidirectional and Pipeline Parallelism (GEMS+PP)
• Spatial, Bidirectional and Layer Parallelism (SP+GEMS+LP)
• Spatial, Bidirectional and Pipeline Parallelism (SP+GEMS+PP)
• Support for AmoebaNet and ResNet models
• Support for different image sizes and custom datasets

MPI4DL v0.5

Initial release with distributed training support for:

• Layer Parallelism (LP)
• Pipeline Parallelism (PP)
• Spatial Parallelism (SP)
• Spatial and Layer Parallelism (SP+LP)
• Spatial and Pipeline Parallelism (SP+PP)

Currently supports AmoebaNet and ResNet models. A more general model engine is WIP.