Skip to content

KungFu 0.2.0 release
Compare
Choose a tag to compare
@luomai luomai released this 10 Nov 04:44
· 111 commits to master since this release
v0.2.0
cbe2770
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Release notes

The KungFu team has been receiving many valuable feedbacks from the SOSP audience and early industry users. We have tried our best to integrate their feedback to improve the usability of KungFu which is the focus of the 0.2.0 release. The following are the main novel features of this release:

New framework support

KungFu supports TensorFlow 1/2, TensorLayer 1/2, and Keras. This covers most of the models trained with TensorFlow. We have released examples that show how to use KungFu within various TensorFlow programs. Check here.

New advanced examples

KungFu provides many advanced examples that show how to enable KungFu within complex AI models including:

  1. Google BERT
  2. Generative Adversarial Learning (CycleGAN)
  3. Reinforcement learning (Alpha Zero)
  4. ResNet and many useful DNNs for ImageNet
  5. Pose estimation network (OpenPose)

New distributed optimiser

We release a new distributed optimiser SynchronousAveragingOptimizer. This optimiser tries to preserve the property of small-batch training when adopting many parallel workers, making it a useful option for AI models that are restricted to train with small batch sizes. Check here for more details.

Better performance

We have greatly improved the performance of asynchronous training.

Assets 2
Loading