Skip to content

Commit

Permalink
Adding new Python package testing pipeline for Cuda Alt (microsoft#22584
Browse files Browse the repository at this point in the history
)

### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
  • Loading branch information
jchen351 authored and ankitm3k committed Dec 11, 2024
1 parent 1889eda commit d431773
Show file tree
Hide file tree
Showing 3 changed files with 28 additions and 18 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
resources:
pipelines:
- pipeline: build
source: 'Python CUDA ALT Packaging Pipeline'
trigger: true
branch: main # branch to pick the artifact, Used only for manual triggered pipeline runs for testing the pipeline itself

stages:
# ****The following Stage depend on all previous tags. ***
# GPU resources are very limited,
# To utilize gpu resource more efficiently, run GPU job only after all cpus jobs succeed
- stage: Linux_Test_CUDA_Alt_x86_64_stage
dependsOn:
jobs:
- template: templates/py-packaging-linux-test-cuda.yml
parameters:
arch: 'x86_64'
machine_pool: 'Onnxruntime-Linux-GPU'
python_wheel_suffix: '_gpu'
timeout: 480
docker_base_image: onnxruntimebuildcache.azurecr.io/internal/azureml/onnxruntime/build/cuda11_x64_almalinux8_gcc11:20241020.1
trt_version: '10.4.0.26-1.cuda11.8'
cuda_version: '11.8'

Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ stages:
# ****The following Stage depend on all previous tags. ***
# GPU resources are very limited,
# To utilize gpu resource more efficiently, run GPU job only after all cpus jobs succeed
- stage: Linux_Test_GPU_x86_64_stage
- stage: Linux_Test_CUDA_x86_64_stage
dependsOn:
jobs:
- template: templates/py-packaging-linux-test-cuda.yml
Expand Down
20 changes: 3 additions & 17 deletions tools/ci_build/github/azure-pipelines/py-package-test-pipeline.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,27 +42,13 @@ stages:

# GPU resources are very limited,
# To utilize gpu resource more efficiently, run GPU job only after all cpus jobs succeed
- stage: Linux_Test_GPU_x86_64_stage
dependsOn:
- Linux_Test_CPU_x86_64_stage
- Linux_Test_CPU_aarch64_stage
- Packages_Somking_Test
jobs:
- template: templates/py-packaging-linux-test-cuda.yml
parameters:
arch: 'x86_64'
machine_pool: 'Onnxruntime-Linux-GPU'
python_wheel_suffix: '_gpu'
timeout: 480
docker_base_image: onnxruntimebuildcache.azurecr.io/internal/azureml/onnxruntime/build/cuda11_x64_almalinux8_gcc11:20241020.1
trt_version: '10.4.0.26-1.cuda11.8'
cuda_version: '11.8'


# if final job not extecuted, it will not run nightlly build
- stage: Final
dependsOn:
- Linux_Test_GPU_x86_64_stage
- Linux_Test_CPU_x86_64_stage
- Linux_Test_CPU_aarch64_stage
- Packages_Somking_Test
jobs:
- job: Final
# Run this step only if all previous steps are succeeded and (this build was triggered by a resource trigger or it was triggered by another build).
Expand Down

0 comments on commit d431773

Please sign in to comment.