Skip to content

Commit

Permalink
Update 3_Socle_Production.qmd
Browse files Browse the repository at this point in the history
  • Loading branch information
camillebfly authored Jun 6, 2024
1 parent 0ed68e2 commit 937e8fa
Showing 1 changed file with 2 additions and 6 deletions.
8 changes: 2 additions & 6 deletions III-Deploiements/3_Socle_Production.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ On remarquera que les deux deploiments semblent assez similaires et que la princ
ou

```bash
["python3.9", "-m", "fastchat.serve.openai_api_server", "--host", "0.0.0.0", "--port", "8000", "--api-keys", "dtnumds,dtnum-s56f1esfd,srp-sd5fze21d,dgfip-si2023", "--controller-address", "http://svc-controller"]
["python3.9", "-m", "fastchat.serve.openai_api_server", "--host", "0.0.0.0", "--port", "8000", "--api-keys", "key1", "--controller-address", "http://svc-controller"]
```

Ces commandes sont celles de FastChat mais peuvent être remplacées par votre propre solution de déploiement de modèle.
Expand Down Expand Up @@ -145,7 +145,7 @@ spec:
env:
- name: no_proxy
value: localhost,127.0.0.1,0.0.0.0,svc-controller,svc-llm-mixtral
command: ["python3.9", "-m", "fastchat.serve.openai_api_server", "--host", "0.0.0.0", "--port", "8000", "--api-keys", "dtnumds,dtnum-s56f1esfd,srp-sd5fze21d,dgfip-si2023", "--controller-address", "http://svc-controller"]
command: ["python3.9", "-m", "fastchat.serve.openai_api_server", "--host", "0.0.0.0", "--port", "8000", "--api-keys", "key1", "--controller-address", "http://svc-controller"]
imagePullSecrets:
- name : regcred

Expand Down Expand Up @@ -242,8 +242,6 @@ Enfin, tous ces composants se basent sur des images docker qui continennent tout
FROM python:3.9-buster as llm-api-light

# Set environment variables
ENV https_proxy=http://proxy.infra.dgfip:3128
ENV http_proxy=http://proxy.infra.dgfip:3128
ENV DEBIAN_FRONTEND noninteractive
# Install dependencies
RUN apt-get update -y && apt-get install -y curl
Expand All @@ -262,8 +260,6 @@ RUN pip3 install plotly

#################### BASE LLM BUILD IMAGE ####################
FROM nvidia/cuda:12.1.0-devel-ubuntu22.04 AS base
ENV https_proxy=http://proxy.infra.dgfip:3128
ENV http_proxy=http://proxy.infra.dgfip:3128
ENV DEBIAN_FRONTEND noninteractive
RUN apt-get update -y && apt-get install -y python3.9 curl
RUN apt-get install -y python3-pip git
Expand Down

0 comments on commit 937e8fa

Please sign in to comment.