Skip to content

Commit

Permalink
now use ghcr.io
Browse files Browse the repository at this point in the history
  • Loading branch information
lingo34 committed Sep 4, 2024
1 parent f7244d8 commit 5a7bd2f
Show file tree
Hide file tree
Showing 2 changed files with 14 additions and 11 deletions.
23 changes: 13 additions & 10 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,28 +36,25 @@ Copy and paste the content of `cf-worker.js` into your cloudflare worker and dep

## Docker

build the image
~~~sh
docker build -t sambanova .
~~~
The docker image for this project is hosted on GitHub Container Registry and automatically build via GitHub action.

docker run
~~~sh
docker run \
docker run -d\
--name sambanova-ai-proxy \
-p 11435:11435 \
--read-only \
sambanova
ghcr.io/lingo34/sambanova-ai-proxy:main
~~~

if you want to enable model override and specified a model, you can pass it as an environment variable
if you want to enable model override and specified a model, you can pass it as an environment variable.
~~~sh
docker run \
docker run -d\
--name sambanova-ai-proxy \
-p 11435:11435 \
--read-only \
-e MODEL_OVERRIDE="llama3-405b" \
sambanova
ghcr.io/lingo34/sambanova-ai-proxy:main
~~~

or you can you docker compose: in the project directory, execute:
Expand All @@ -71,7 +68,7 @@ version: '3.8'

services:
node-server:
image: sambanova
image: ghcr.io/lingo34/sambanova-ai-proxy:main
container_name: sambanova-ai-proxy
ports:
- "11435:11435"
Expand All @@ -80,3 +77,9 @@ services:
read_only: true
restart: unless-stopped
~~~

or if you want to build the image yourself

~~~sh
docker build -t sambanova-ai-proxy .
~~~
2 changes: 1 addition & 1 deletion docker-compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ version: '3.8'

services:
node-server:
image: sambanova
image: ghcr.io/lingo34/sambanova-ai-proxy:main
container_name: sambanova-ai-proxy
ports:
- "11435:11435"
Expand Down

0 comments on commit 5a7bd2f

Please sign in to comment.