Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
elvin committed Jun 29, 2023
1 parent b20cb1c commit 105015e
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion 11-distribute_guide/ddp_demo/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,8 +24,11 @@
## 1.4 Ring AllReduce 原理
- [Ring AllReduce 1](https://picture.iczhiku.com/weixin/message1570798743118.html)
- [Ring AllReduce 2](https://andrew.gibiansky.com/blog/machine-learning/baidu-allreduce/#)

**scatter reduce**
- ![scatter reduce](https://pic3.zhimg.com/v2-4590aeb5fd981b1e6f926cc68605884a_b.webp)
- ![all gather](https://pic4.zhimg.com/v2-c9df34575d7d95ec87d85575d25d6f37_b.webp)
**all gather**
- ![all gather](https://pic4.zhimg.com/80/v2-c9df34575d7d95ec87d85575d25d6f37_720w.webp)

# 2. 常用参数(ARGS)总结
- node: 物理节点,可以是一台机器,也可以是一个容器,节点内部可以有多个GPU;
Expand Down

0 comments on commit 105015e

Please sign in to comment.