feat: add examples of onnx export (#622)

2noise · Jul 29, 2024 · 3ff474d · 3ff474d
1 parent 680e046
commit 3ff474d
Show file tree

Hide file tree

Showing 4 changed files with 1,734 additions and 0 deletions.
diff --git a/examples/onnx/README.md b/examples/onnx/README.md
@@ -0,0 +1,14 @@
+# Export onnx or JIT models for deployment
+
+## Run `pip install onnx -U`.
+
+## Export GPT
+
+3. Run `python examples/onnx/exporter.py --gpt`
+
+
+## Export other models
+Run `python examples/onnx/exporter.py --decoder --vocos`
+
+## Reference
+[Run LLMs on Sophon TPU](https://github.com/sophgo/LLM-TPU)