Skip to content

Commit

Permalink
Merge pull request #133 from windsonsea/k8s
Browse files Browse the repository at this point in the history
update images in 0702-k8s-for-genai.md
  • Loading branch information
windsonsea authored Jul 3, 2024
2 parents a9f9ce8 + 3b0d092 commit 0cdc51d
Show file tree
Hide file tree
Showing 9 changed files with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/zh/docs/blogs/0702-k8s-for-genai.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ Kubernetes(K8s)不再只是一个运行工作负载(如 Web 应用和微

### 模型预训练

![模型预训练](./images/genai01.png)
![模型预训练](./images/genai01.jpeg)

在模型预训练阶段,K8s 凭借其无与伦比的可扩展性和韧性,为模型训练提供了坚实的基础。
K8s 可以根据资源需求自动扩缩的能力是其最大的优势之一,这正是 AI/ML 工作负载在面对海量算力需求时所急需的特性。
Expand All @@ -47,13 +47,13 @@ Jupyter Notebooks 和 VS Code 等工具对于 LLM 实验和提示工程来说是

### 模型微调

![模型微调](./images/genai02.png)
![模型微调](./images/genai02.jpeg)

虽然 K8s 拥有开发 LLM 所需的所有工具,但如今许多企业并非从头开始构建大语言模型,而是选用现有的一些模型,根据企业特定环境对模型进行定制和微调。在这种场景下,当您想对现有模型进行微调时,K8s 也是理想的选择,因为它非常具有动态性。与 Slurm 不同,K8s 可以并行处理多个工作负载,这使得训练过程更加高效。另一个优势体现在 K8s 为模型训练构建了丰富的工具生态。比如 Kubeflow(专为 Pytorch、Tensorflow 和 MPI 设计的 Operator)、KubeRay Operator 和 MLflow。

### 模型部署

![模型部署](./images/genai03.png)
![模型部署](./images/genai03.jpeg)

谈到 LLM 模型部署本身或模型推理服务,K8s 提供了一个简化的流程:您只需向数据科学家呈现一个端点。
网络栈简化了向外界发布模型的流程,轻松将模型推向消费侧。K8s 为模型部署提供了全面的工具集和丰富的生态,
Expand All @@ -65,7 +65,7 @@ Jupyter Notebooks 和 VS Code 等工具对于 LLM 实验和提示工程来说是

### 提示工程

![提示工程](./images/genai04.png)
![提示工程](./images/genai04.jpeg)

优势不止于此。部署 LLM 模型后,K8s 在开发应用或让用户参与模型实验时能够提供增强的用户体验。
例如,使用 K8s 在 Gradio 或 Streamlit 等平台上托管应用几乎毫不费力,
Expand Down
Binary file added docs/zh/docs/blogs/images/genai01.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed docs/zh/docs/blogs/images/genai01.png
Binary file not shown.
Binary file added docs/zh/docs/blogs/images/genai02.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed docs/zh/docs/blogs/images/genai02.png
Binary file not shown.
Binary file added docs/zh/docs/blogs/images/genai03.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed docs/zh/docs/blogs/images/genai03.png
Binary file not shown.
Binary file added docs/zh/docs/blogs/images/genai04.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed docs/zh/docs/blogs/images/genai04.png
Binary file not shown.

0 comments on commit 0cdc51d

Please sign in to comment.