Skip to content

Commit

Permalink
[CodeGen] Add correct ip to no_proxy list; add no_proxy env for all s…
Browse files Browse the repository at this point in the history
…ervices; add ui response in readme (opea-project#279)

* add no_proxy for all microservices

Signed-off-by: Chun Tao <[email protected]>

* Update readme

Signed-off-by: Chun Tao <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Chun Tao <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
  • Loading branch information
2 people authored and Spycsh committed Jun 19, 2024
1 parent 16083b5 commit f6edeee
Show file tree
Hide file tree
Showing 3 changed files with 15 additions and 0 deletions.
Binary file added CodeGen/assets/img/codeGen_ui_response.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
11 changes: 11 additions & 0 deletions CodeGen/docker/xeon/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,14 @@ Then run the command `docker images`, you will have the following 3 Docker Image

Since the `docker_compose.yaml` will consume some environment variables, you need to setup them in advance as below.

**Append the value of the public IP address to the no_proxy list**

```
export your_no_proxy=${your_no_proxy},"External_Public_IP"
```

```bash
export no_proxy=${your_no_proxy}
export http_proxy=${your_http_proxy}
export https_proxy=${your_http_proxy}
export LLM_MODEL_ID="meta-llama/CodeLlama-7b-hf"
Expand Down Expand Up @@ -139,6 +146,10 @@ To access the frontend, open the following URL in your browser: `http://{host_ip
![project-screenshot](../../assets/img/codeGen_ui_init.jpg)
Here is an example of running CodeGen in the UI:
![project-screenshot](../../assets/img/codeGen_ui_response.png)
## Install Copilot VSCode extension from Plugin Marketplace as the frontend
In addition to the Svelte UI, users can also install the Copilot VSCode extension from the Plugin Marketplace as the frontend.
Expand Down
4 changes: 4 additions & 0 deletions CodeGen/docker/xeon/docker_compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ services:
- "./data:/data"
shm_size: 1g
environment:
no_proxy: ${no_proxy}
http_proxy: ${http_proxy}
https_proxy: ${https_proxy}
HF_TOKEN: ${HUGGINGFACEHUB_API_TOKEN}
Expand All @@ -27,6 +28,7 @@ services:
- "9000:9000"
ipc: host
environment:
no_proxy: ${no_proxy}
http_proxy: ${http_proxy}
https_proxy: ${https_proxy}
TGI_LLM_ENDPOINT: ${TGI_LLM_ENDPOINT}
Expand All @@ -43,6 +45,7 @@ services:
ports:
- "7778:7778"
environment:
- no_proxy=${no_proxy}
- https_proxy=${https_proxy}
- http_proxy=${http_proxy}
- MEGA_SERVICE_HOST_IP=${MEGA_SERVICE_HOST_IP}
Expand All @@ -57,6 +60,7 @@ services:
ports:
- "5173:5173"
environment:
- no_proxy=${no_proxy}
- https_proxy=${https_proxy}
- http_proxy=${http_proxy}
- BASIC_URL=${BACKEND_SERVICE_ENDPOINT}
Expand Down

0 comments on commit f6edeee

Please sign in to comment.