K8s Resource Management #32

kevinintel · 2024-06-17T03:45:24Z

K8s Resource Management

eero-t · 2024-08-28T09:14:02Z

K8s Resource Management

@kevinintel Is this referring to DRA or something else?

skaajas · 2024-08-28T11:40:14Z

Current activities regarding K8s resource management include:

Applying of container runtime Node Resource Interface (NRI) (https://github.com/containerd/nri) and its reference policies for efficient management of CPU resources. This is done for both SPR-only OPEA and also Gaudi accelerate case. The objective is to improve node throughput and also use CPU resources as affectively as possible to leave room for adjacent services. The first PR (doc: add Kubernetes platform-optimization README #73) was merged to OPEA v0.9 release and this will further enhanced in the forthcoming releases.
Applying new Gaudi Dynamic Resource Allocation (DRA) driver (https://github.com/intel/intel-resource-drivers-for-kubernetes/blob/main/doc/gaudi/README.md) for OPEA workloads. This has now been validate to work with Gaudi accelerated OPEA ChatQnA service.

Is there something else that should be considered?

skaajas · 2024-08-28T11:43:11Z

There are also other related issues:
Same topic for GenAIInfra: opea-project/GenAIInfra#144
#57
#58

I think we should consolidate or define the exact scope for each of these issues.

* Bump vite from 4.4.9 to 4.5.2 in /SearchQnA/ui Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 4.4.9 to 4.5.2. - [Release notes](https://github.com/vitejs/vite/releases) - [Changelog](https://github.com/vitejs/vite/blob/v4.5.2/packages/vite/CHANGELOG.md) - [Commits](https://github.com/vitejs/vite/commits/v4.5.2/packages/vite) --- updated-dependencies: - dependency-name: vite dependency-type: direct:development ... Signed-off-by: dependabot[bot] <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

kevinintel · 2024-09-26T08:07:20Z

V0.9 #57
V1.0 opea-project/GenAIInfra#144
Q1/25: #58
this issue tracks the status

kevinintel added this to OPEA Jun 17, 2024

kevinintel added the feature New feature or request label Jun 17, 2024

kevinintel removed this from OPEA Jul 1, 2024

Provide feedback