Skip to content

Commit

Permalink
folder name change for llama3 (meta-llama#469)
Browse files Browse the repository at this point in the history
  • Loading branch information
jeffxtang authored Apr 26, 2024
2 parents 135052a + c68410c commit 05bde78
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,9 @@
"\n",
"Run `ollama pull llama3:70b` to download the Llama 3 70b chat model, also in the 4-bit quantized format with size 39GB.\n",
"\n",
"Then you can run `ollama run llama3` and ask Llama 3 questions such as \"who wrote the book godfather?\" or \"who wrote the book godfather? answer in one sentence.\" You can also try `ollama run llama3:70b`, but the inference speed will most likely be too slow - for example, on an Apple M1 Pro with 32GB RAM, it takes over 10 seconds to generate one token (vs over 10 tokens per second with Llama 3 7b chat).\n",
"Then you can run `ollama run llama3` and ask Llama 3 questions such as \"who wrote the book godfather?\" or \"who wrote the book godfather? answer in one sentence.\" You can also try `ollama run llama3:70b`, but the inference speed will most likely be too slow - for example, on an Apple M1 Pro with 32GB RAM, it takes over 10 seconds to generate one token using Llama 3 70b chat (vs over 10 tokens per second with Llama 3 8b chat).\n",
"\n",
"You can also run the following command to test Llama 3 (7b chat):\n",
"You can also run the following command to test Llama 3 8b chat:\n",
"```\n",
" curl http://localhost:11434/api/chat -d '{\n",
" \"model\": \"llama3\",\n",
Expand Down

0 comments on commit 05bde78

Please sign in to comment.