KungFu 0.1.0 pre-release
Pre-release
Pre-release
This is the first release of KungFu.
This release contains two features:
- SynchronousSGDOptimizer: This optimiser implements the classical Synchronous SGD algorithm for distributed training.
- PairAeveragingOptimizer: This optimiser implements communication-efficient asynchronous training while reaching the same evaluation accuracy as the S-SGD.
We have tested and deployed these optimisers in a cloud testbed and a production cluster. Check out their performance in the Benchmark section in README.