wip

m1ser4ble · Apr 7, 2023 · 328f0db · 328f0db
1 parent 809c309
commit 328f0db
Showing 1 changed file with 7 additions and 0 deletions.
diff --git a/_posts/e.markdown b/_posts/e.markdown
@@ -0,0 +1,7 @@
+[DeepSpeed](https://github.com/microsoft/DeepSpeed)
+
+# Model parallelism
+[graphical images](https://colossalai.org/docs/concepts/paradigms_of_parallelism/)
+[hugging face](https://huggingface.co/transformers/v4.9.0/parallelism.html)
+[Megatron-LM](https://arxiv.org/pdf/1909.08053.pdf)
+[ZeRO](https://arxiv.org/pdf/1910.02054.pdf)