Skip to content

Commit

Permalink
Update generate-e2e-example.sh
Browse files Browse the repository at this point in the history
  • Loading branch information
natke authored Apr 21, 2024
1 parent 4e4fcc5 commit 590f012
Showing 1 changed file with 3 additions and 7 deletions.
10 changes: 3 additions & 7 deletions examples/python/generate-e2e-example.sh
Original file line number Diff line number Diff line change
@@ -1,8 +1,4 @@
# Description: Example of generate end-to-end usage, including model building and running.
pip install numpy
pip install transformers
pip install torch
pip install onnx
pip install onnxruntime-gpu
# Description: Example of generate end-to-end usage, including model building and running
pip install numpy transformers torch onnx onnxruntime
python3 -m onnxruntime_genai.models.builder -m microsoft/phi-2 -o genai_models/phi2-int4-cpu -p int4 -e cpu -c hf_cache
python3 model-generate.py -m genai_models/phi2-int4-cpu -pr "my favorite movie is" "write a function that always returns True" "I am very happy" -ep cpu -p 0.0 -k 1 -v
python3 model-generate.py -m genai_models/phi2-int4-cpu -pr "my favorite movie is" "write a function that always returns True" "I am very happy" -p 0.0 -k 1 -v

0 comments on commit 590f012

Please sign in to comment.