From f5ce2ec074a138ca140bdc5377e855c6d4511dd4 Mon Sep 17 00:00:00 2001 From: jakki Date: Fri, 29 Nov 2024 16:01:56 +0200 Subject: [PATCH] Update documentation for Docker support --- docker/README.md | 1 + docs/hardware_support/amd_support.md | 14 ++++++++++++++ 2 files changed, 15 insertions(+) diff --git a/docker/README.md b/docker/README.md index beb0604e10..9e5ca8a229 100644 --- a/docker/README.md +++ b/docker/README.md @@ -164,6 +164,7 @@ Creates a docker image with `torchserve` and `torch-model-archiver` installed fr ./build_image.sh -bt dev -g [-cv cu121|cu118] -cpp ``` +- For ROCm support (*experimental*), refer to [this documentation](../docs/hardware_support/amd_support.md). ## Start a container with a TorchServe image diff --git a/docs/hardware_support/amd_support.md b/docs/hardware_support/amd_support.md index f406f980a6..55de40f6d4 100644 --- a/docs/hardware_support/amd_support.md +++ b/docs/hardware_support/amd_support.md @@ -60,6 +60,20 @@ If you have 8 accelerators but only want TorchServe to see the last four of them > ⚠️ Setting both `CUDA_VISIBLE_DEVICES` and `HIP_VISIBLE_DEVICES` may cause unintended behaviour and should be avoided. > Doing so may cause an exception in the future. +## Docker + +**In Development** + +`Dockerfile.rocm` provides preliminary ROCm support for TorchServe. + +Building and running `dev-image`: + +```bash +docker build --file docker/Dockerfile.rocm --target dev-image -t torch-serve-dev-image-rocm --build-arg USE_ROCM_VERSION=rocm62 --build-arg BUILD_FROM_SRC=true . + +docker run -it --rm --device=/dev/kfd --device=/dev/dri torch-serve-dev-image-rocm bash +``` + ## Example Usage After installing TorchServe with the required dependencies for ROCm you should be ready to serve your model.