Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
BigBalloon8 committed Aug 4, 2023
1 parent 62223ff commit ea11bc1
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions ivy/distributed/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -104,10 +104,14 @@ if group.rank == 2:

```
```bash
ivydist -B torch --nproc_per_node
ivydist -B torch --nproc_per_node main.py
```


## Frontend

frontends have not been fully implemetned yet but the torch frontend is under development with the hope of eventually being able to transpile libraries like colossalai and deepspeed to work with other frameworks
frontends have not been fully implemetned yet but the torch frontend is under development with the hope of eventually being able to transpile libraries like colossalai and deepspeed to work with other frameworks

## Ring & Tree Based Collective Communication

More efficient collective communication algorithms can be implemented using p2p operations, the `ivy.distributed.stateful` is where these operation can be located

0 comments on commit ea11bc1

Please sign in to comment.