Skip to content

Commit

Permalink
improve ChanQnA manifests
Browse files Browse the repository at this point in the history
Signed-off-by: Yingchun Guo <[email protected]>
  • Loading branch information
daisy-ycguo authored and jfding committed May 29, 2024
1 parent ea30ad2 commit 1b6600c
Show file tree
Hide file tree
Showing 13 changed files with 4 additions and 16 deletions.
4 changes: 2 additions & 2 deletions manifests/ChatQnA/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ For Gaudi:
```
# Deploy Services with Xeon
$ cd ${RepoPath}/ChatQnA/kubernetes/manifests/
$ cd ${RepoPath}/manifests/ChatQnA
$ ./install_all_xeon.sh
```

Expand All @@ -55,7 +55,7 @@ $ ./remove_all_xeon.sh
### Deploy

```
$ cd ${RepoPath}/ChatQnA/kubernetes/manifests/
$ cd ${RepoPath}/manifests/ChatQnA
$ ./install_all_gaudi.sh
```

Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/chaqna-xeon-backend-server.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: chaqna-xeon-backend-server-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/embedding.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: embedding-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/llm.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: llm-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
3 changes: 1 addition & 2 deletions manifests/ChatQnA/qna_configmap_gaudi.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,10 @@ apiVersion: v1
kind: ConfigMap
metadata:
name: qna-config
namespace: default
data:
EMBEDDING_MODEL_ID: "BAAI/bge-base-en-v1.5"
RERANK_MODEL_ID: "BAAI/bge-reranker-large"
LLM_MODEL_ID: "/data/neural-chat-7b-v3-3"
LLM_MODEL_ID: "Intel/neural-chat-7b-v3-3"
TEI_EMBEDDING_ENDPOINT: "http://tei-embedding-gaudi-svc.default.svc.cluster.local:6006"
TEI_RERANKING_ENDPOINT: "http://tei-reranking-svc.default.svc.cluster.local:8808"
TGI_LLM_ENDPOINT: "http://tgi-gaudi-svc.default.svc.cluster.local:9009"
Expand Down
3 changes: 1 addition & 2 deletions manifests/ChatQnA/qna_configmap_xeon.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,10 @@ apiVersion: v1
kind: ConfigMap
metadata:
name: qna-config
namespace: default
data:
EMBEDDING_MODEL_ID: "BAAI/bge-base-en-v1.5"
RERANK_MODEL_ID: "BAAI/bge-reranker-large"
LLM_MODEL_ID: "/data/neural-chat-7b-v3-3"
LLM_MODEL_ID: "Intel/neural-chat-7b-v3-3"
TEI_EMBEDDING_ENDPOINT: "http://tei-embedding-svc.default.svc.cluster.local:6006"
TEI_RERANKING_ENDPOINT: "http://tei-reranking-svc.default.svc.cluster.local:8808"
TGI_LLM_ENDPOINT: "http://tgi-svc.default.svc.cluster.local:9009"
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/reranking.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: reranking-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/retriever.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: retriever-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/tei_embedding_gaudi_service.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: tei-embedding-gaudi-service-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/tei_embedding_service.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: tei-embedding-service-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/tei_reranking_service.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: tei-reranking-service-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/tgi_gaudi_service.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: tgi-gaudi-service-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down
1 change: 0 additions & 1 deletion manifests/ChatQnA/tgi_service.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ apiVersion: apps/v1
kind: Deployment
metadata:
name: tgi-service-deploy
namespace: default
spec:
replicas: 1
selector:
Expand Down

0 comments on commit 1b6600c

Please sign in to comment.