Skip to content

Commit

Permalink
Upgrade tei-gaudi version to 1.5.0 (#494)
Browse files Browse the repository at this point in the history
Signed-off-by: Lianhao Lu <[email protected]>
  • Loading branch information
lianhao authored Oct 25, 2024
1 parent dbd607e commit c6a9c90
Show file tree
Hide file tree
Showing 5 changed files with 20 additions and 5 deletions.
2 changes: 1 addition & 1 deletion helm-charts/chatqna/gaudi-values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ tei:
accelDevice: "gaudi"
image:
repository: ghcr.io/huggingface/tei-gaudi
tag: synapse_1.16
tag: 1.5.0
resources:
limits:
habana.ai/gaudi: 1
Expand Down
17 changes: 16 additions & 1 deletion helm-charts/chatqna/guardrails-gaudi-values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,22 @@ tei:
accelDevice: "gaudi"
image:
repository: ghcr.io/huggingface/tei-gaudi
tag: synapse_1.16
tag: 1.5.0
resources:
limits:
habana.ai/gaudi: 1
securityContext:
readOnlyRootFilesystem: false
livenessProbe:
timeoutSeconds: 1
readinessProbe:
timeoutSeconds: 1

teirerank:
accelDevice: "gaudi"
image:
repository: opea/tei-gaudi
tag: "latest"
resources:
limits:
habana.ai/gaudi: 1
Expand Down
2 changes: 1 addition & 1 deletion helm-charts/common/tei/gaudi-values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ accelDevice: "gaudi"

image:
repository: ghcr.io/huggingface/tei-gaudi
tag: synapse_1.16
tag: 1.5.0

securityContext:
readOnlyRootFilesystem: false
Expand Down
2 changes: 1 addition & 1 deletion microservices-connector/config/manifests/tei_gaudi.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ spec:
optional: true
securityContext:
{}
image: "ghcr.io/huggingface/tei-gaudi:synapse_1.16"
image: "ghcr.io/huggingface/tei-gaudi:1.5.0"
imagePullPolicy: IfNotPresent
args:
- "--auto-truncate"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ The ChatQnA uses the below prebuilt images if you choose a Xeon deployment
Should you desire to use the Gaudi accelerator, two alternate images are used for the embedding and llm services.
For Gaudi:

- tei-embedding-service: ghcr.io/huggingface/tei-gaudi:synapse_1.16
- tei-embedding-service: ghcr.io/huggingface/tei-gaudi:1.5.0
- tgi-service: ghcr.io/huggingface/tgi-gaudi:2.0.5

## Deploy ChatQnA pipeline
Expand Down

0 comments on commit c6a9c90

Please sign in to comment.