-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding a new pipeline for publishing to Python Cuda 12 packages. #18712
Merged
Merged
Changes from all commits
Commits
Show all changes
39 commits
Select commit
Hold shift + click to select a range
9195fc4
Update the template files to correct stage
jchen351 7bedbf1
Adding publishing stage to python cuda-12 pipeline
jchen351 cc57082
Adding publishing stage to python cuda-12 pipeline
jchen351 0d47bbe
Adding publishing stage to python cuda-12 pipeline
jchen351 8dd81af
Adding publishing stage to python cuda-12 pipeline
jchen351 d4d922f
Adding publishing stage to python cuda-12 pipeline
jchen351 9d4fe7e
Adding publishing stage to python cuda-12 pipeline
jchen351 e6d44d2
Adding publishing stage to python cuda-12 pipeline
jchen351 53ecbaa
Adding publishing stage to python cuda-12 pipeline
jchen351 fea8b34
change to use python -m twine
jchen351 495fc0a
remove artifact_feed_url variable
jchen351 816cccc
Update artifact name
jchen351 716cd5e
Update machine pool
jchen351 81cfc74
Adding new pipeline for publishing cuda package to specific feed
jchen351 8218cc7
Adding new pipeline for publishing cuda package to specific feed
jchen351 9962055
Adding new pipeline for publishing cuda package to specific feed
jchen351 a5b2e25
Adding new pipeline for publishing cuda package to specific feed
jchen351 aa656ee
Adding new pipeline for publishing cuda package to specific feed
jchen351 2c51a16
Change eq to ne
jchen351 1c4a997
Update parameteres
jchen351 41c921e
Update DownloadPipelineArtifact
jchen351 6c190f6
Update DownloadPipelineArtifact
jchen351 618356a
Update DownloadPipelineArtifact
jchen351 37b73d1
Update DownloadPipelineArtifact
jchen351 b83db92
Update keyring artifacts-keyring
jchen351 31978b0
Update keyring artifacts-keyring
jchen351 640bf49
Update --config-file $(PYPIRC_PATH)
jchen351 b6187b9
Allow env:
jchen351 69c9dcb
Allow env:
jchen351 d9dbb12
Allow env:
jchen351 6ee946d
Allow env:
jchen351 e14b758
Allow env:
jchen351 1489b12
Allow env:
jchen351 b107d4c
--config-file $(PYPIRC_PATH)
jchen351 e34be18
Merge branch 'main' into Cjian/python-cuda12
jchen351 342cb09
Delete file
jchen351 c7367de
Update file with main
jchen351 520041d
Remove repo-url
jchen351 63c411d
Remove typo
jchen351 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
24 changes: 24 additions & 0 deletions
24
tools/ci_build/github/azure-pipelines/py-cuda-publishing-pipeline.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
parameters: | ||
- name: nightly | ||
type: string | ||
default: '1' | ||
- name: build_id | ||
type: string | ||
default: 'latest' | ||
- name: project | ||
type: string | ||
default: 'Lotus' | ||
- name: pipeline | ||
type: string | ||
default: 'Python-CUDA-Packaging-Pipeline' | ||
|
||
stages: | ||
- template: stages/py-cuda-publishing-stage.yml | ||
parameters: | ||
build_id: ${{ parameters.build_id }} | ||
project: ${{ parameters.project }} | ||
pipeline: ${{ parameters.pipeline }} | ||
${{ if ne(parameters.nightly, '1') }}: | ||
artifact_feed: onnxruntime-cuda-12 | ||
${{ else }}: | ||
artifact_feed: ort-cuda-12-nightly |
51 changes: 51 additions & 0 deletions
51
tools/ci_build/github/azure-pipelines/stages/py-cuda-publishing-stage.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,51 @@ | ||
parameters: | ||
- name: build_id | ||
type: string | ||
- name: project | ||
type: string | ||
- name: pipeline | ||
type: string | ||
- name: artifact_feed | ||
type: string | ||
default: 'onnxruntime-cuda-12' | ||
- name: dependencies | ||
type: string | ||
default: 'none' | ||
|
||
stages: | ||
- stage: Python_Publishing | ||
${{ if ne(parameters.dependencies, 'none') }}: | ||
dependsOn: ${{ parameters.dependencies }} | ||
${{ if eq(parameters.dependencies, 'none') }}: | ||
dependsOn: [] | ||
jobs: | ||
- job: | ||
pool: 'onnxruntime-Ubuntu2004-AMD-CPU' | ||
steps: | ||
- checkout: none | ||
- task: DownloadPipelineArtifact@2 | ||
inputs: | ||
artifact: 'onnxruntime_gpu' | ||
targetPath: '$(Build.SourcesDirectory)/onnxruntime-gpu' | ||
${{ if ne(parameters.build_id, 'latest') }}: | ||
buildType: 'specific' | ||
project: '${{ parameters.project }}' | ||
pipeline: '${{ parameters.pipeline }}' | ||
buildVersionToDownload: 'specific' | ||
buildId: '${{ parameters.build_id }}' | ||
displayName: 'Download Build Artifacts - onnxruntime-gpu' | ||
- task: UsePythonVersion@0 | ||
displayName: 'Use Python 3.x' | ||
- script: 'pip install twine==3.4.2' | ||
displayName: 'Install Twine' | ||
- task: TwineAuthenticate@1 | ||
displayName: 'Twine Authenticate ' | ||
inputs: | ||
artifactFeed: PublicPackages/${{ parameters.artifact_feed }} | ||
- script: 'python -m twine upload -r ${{ parameters.artifact_feed }} --config-file $(PYPIRC_PATH) --non-interactive --skip-existing *.whl' | ||
workingDirectory: '$(Build.SourcesDirectory)/onnxruntime-gpu' | ||
displayName: 'Uploading wheels to ${{ parameters.artifact_feed }}' | ||
retryCountOnTaskFailure: 3 | ||
env: | ||
SYSTEM_ACCESSTOKEN: $(System.AccessToken) | ||
|
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Like this: