Code

Python ADO packaging pipeline#118

Code

Merged

jchen351 merged 136 commits intomainmicrosoft/onnxruntime-genai:mainfrom Cjian/pymicrosoft/onnxruntime-genai:Cjian/pyCopy head branch name to clipboardMar 4, 2024

+1,545-86

Commits

Commits on Feb 21, 2024

• Adding new yml files

  jchen351

  committed
  1fa3af6

  Copy full SHA for 1fa3af6

Commits on Feb 22, 2024

• commit

  jchen351

  committed
  596506f

  Copy full SHA for 596506f

• print nvidia-smi

  jchen351

  committed
  63ae742

  Copy full SHA for 63ae742

• Merge branch 'main' into Cjian/py

  jchen351

  committed
  91ca2b8

  Copy full SHA for 91ca2b8

• Adding windows cpu build

  jchen351

  committed
  2335556

  Copy full SHA for 2335556

• Update esrp

  jchen351

  committed
  56d557f

  Copy full SHA for 56d557f

• enable_windows_gpu

  jchen351

  committed
  dc6b642

  Copy full SHA for dc6b642

• enable_windows_gpu

  jchen351

  committed
  586a9c5

  Copy full SHA for 586a9c5

• enable_windows_gpu

  jchen351

  committed
  c78c1dd

  Copy full SHA for c78c1dd

Commits on Feb 23, 2024

• enable_windows_gpu

  jchen351

  committed
  539403a

  Copy full SHA for 539403a

• esrp

  jchen351

  committed
  a05fb84

  Copy full SHA for a05fb84

• adding debug info

  jchen351

  committed
  88c45a0

  Copy full SHA for 88c45a0

• adding debug info

  jchen351

  committed
  e8dc403

  Copy full SHA for e8dc403

• bash

  jchen351

  committed
  1774b21

  Copy full SHA for 1774b21

• bash

  jchen351

  committed
  d8a92fc

  Copy full SHA for d8a92fc

• cuda_dir

  jchen351

  committed
  ca575fe

  Copy full SHA for ca575fe

• fix download onnxrtuntime

  jchen351

  committed
  ff3020e

  Copy full SHA for ff3020e

• fix zip

  jchen351

  committed
  3397643

  Copy full SHA for 3397643

• fix zip

  jchen351

  committed
  ea8aed5

  Copy full SHA for ea8aed5

• powershell

  jchen351

  committed
  66e024b

  Copy full SHA for 66e024b

• powershell

  jchen351

  committed
  02babb4

  Copy full SHA for 02babb4

• adding linux cpu build

  jchen351

  committed
  419319a

  Copy full SHA for 419319a

• enable linux cpu build

  jchen351

  committed
  115e06b

  Copy full SHA for 115e06b

• scripts

  jchen351

  committed
  6f56c04

  Copy full SHA for 6f56c04

• steps

  jchen351

  committed
  2d0a2b7

  Copy full SHA for 2d0a2b7

• governance-component-detection-steps

  jchen351

  committed
  026c40e

  Copy full SHA for 026c40e

• linux gpu build

  jchen351

  committed
  0432fe6

  Copy full SHA for 0432fe6

• fix win gpu

  jchen351

  committed
  c180cde

  Copy full SHA for c180cde

• fix win gpu

  jchen351

  committed
  560f536

  Copy full SHA for 560f536

• fix win gpu

  jchen351

  committed
  ad82e74

  Copy full SHA for ad82e74

• fix linux gpu

  jchen351

  committed
  29682ca

  Copy full SHA for 29682ca

• Remove nodejs

  jchen351

  committed
  cdcdd12

  Copy full SHA for cdcdd12

• fix esrp

  jchen351

  committed
  5d8e6e4

  Copy full SHA for 5d8e6e4

Commits on Feb 24, 2024

• fix esrp

  jchen351

  committed
  78126e2

  Copy full SHA for 78126e2

• fix esrp

  jchen351

  committed
  acb04db

  Copy full SHA for acb04db

Commits on Feb 25, 2024

• fix esrp

  jchen351

  committed
  8e78eb5

  Copy full SHA for 8e78eb5

• change onnxruntime_genai to onnxruntime-genai

  jchen351

  committed
  82450a0

  Copy full SHA for 82450a0

• adding manylinux

  jchen351

  committed
  bc80bc7

  Copy full SHA for bc80bc7

• adding manylinux

  jchen351

  committed
  eebbeb1

  Copy full SHA for eebbeb1

• adding manylinux

  jchen351

  committed
  4b348b8

  Copy full SHA for 4b348b8

• adding manylinux in pipeline

  jchen351

  committed
  1a1dac0

  Copy full SHA for 1a1dac0

• Merge remote-tracking branch 'origin/Cjian/py' into Cjian/py

  jchen351

  committed
  986880e

  Copy full SHA for 986880e

• Delete dockerfile files for cpu

  jchen351

  committed
  e6f2739

  Copy full SHA for e6f2739

• rolling back inference

  jchen351

  committed
  c74793a

  Copy full SHA for c74793a

• try to fix \build\wheel\

  jchen351

  committed
  1f784af

  Copy full SHA for 1f784af

• copy manylinux_2_28_cpu

  jchen351

  committed
  6174997

  Copy full SHA for 6174997

• fix get_docker_image.py

  jchen351

  committed
  05d0a01

  Copy full SHA for 05d0a01

• cuda

  jchen351

  committed
  165f130

  Copy full SHA for 165f130

• - checkout: manylinux

  Show description for 6c792fa
  jchen351

  committed
  6c792fa

  Copy full SHA for 6c792fa

• adding back requirements.txt

  jchen351

  committed
  6fbfb90

  Copy full SHA for 6fbfb90

• adding back requirements.txt

  jchen351

  committed
  3b928a6

  Copy full SHA for 3b928a6

• change $(Build.SourcesDirectory)/onnxruntime-genai/

  jchen351

  committed
  2ec3ec7

  Copy full SHA for 2ec3ec7

• - task: DownloadGitHubRelease@0

  jchen351

  committed
  3dfc288

  Copy full SHA for 3dfc288

• workingDirectory: '$(Build.SourcesDirectory)/onnxruntime-genai'

  jchen351

  committed
  9188a35

  Copy full SHA for 9188a35

• - ort_version: '1.17.0'

  jchen351

  committed
  6a85c14

  Copy full SHA for 6a85c14

• - name: ort_version

  Show description for a07b119
  jchen351

  committed
  a07b119

  Copy full SHA for a07b119

• - name: ort_version

  Show description for 6da5c70
  jchen351

  committed
  6da5c70

  Copy full SHA for 6da5c70

• displayName: Unzip OnnxRuntime

  jchen351

  committed
  ce05e77

  Copy full SHA for ce05e77

• --multiple_repos

  jchen351

  committed
  ebfbe21

  Copy full SHA for ebfbe21

• x64-gpu

  jchen351

  committed
  889153f

  Copy full SHA for 889153f

• pip3 install -r requirements.txt

  jchen351

  committed
  2046b48

  Copy full SHA for 2046b48

• Dockerfile.manylinux2_28_cuda

  jchen351

  committed
  fea2ecc

  Copy full SHA for fea2ecc

Commits on Feb 26, 2024

• update $(Build.SourcesDirectory)/onnxruntime-genai:/onnxruntime_src

  jchen351

  committed
  e3caed5

  Copy full SHA for e3caed5

• fix genai binskim

  jchen351

  committed
  fbd2611

  Copy full SHA for fbd2611

• try to use python3.8

  jchen351

  committed
  83a72fe

  Copy full SHA for 83a72fe

• try to use python3.8

  jchen351

  committed
  574dd30

  Copy full SHA for 574dd30

• - task: PythonScript@0

  Show description for 75a61e4
  jchen351

  committed
  75a61e4

  Copy full SHA for 75a61e4

• build-cpython.sh

  jchen351

  committed
  4459769

  Copy full SHA for 4459769

• TARGET_NAME

  jchen351

  committed
  e4dd229

  Copy full SHA for e4dd229

• onnxruntime_genai

  jchen351

  committed
  8cb31d3

  Copy full SHA for 8cb31d3

Commits on Feb 27, 2024

• linux_gcc_cuda_release

  jchen351

  committed
  ebe9840

  Copy full SHA for ebe9840

• 60;61;70;75;80;86

  jchen351

  committed
  3c873d8

  Copy full SHA for 3c873d8

• "60;61;70;75;80;86"

  jchen351

  committed
  44557c8

  Copy full SHA for 44557c8

• az login

  jchen351

  committed
  3567a60

  Copy full SHA for 3567a60

• /subscriptions/00c06639-6ee4-454e-8058-8d8b1703bd87/resourcegroups/proj-onnxruntime-dev/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ortcibuild_readonly

  jchen351

  committed
  5b8707d

  Copy full SHA for 5b8707d

• /subscriptions/00c06639-6ee4-454e-8058-8d8b1703bd87/resourcegroups/proj-onnxruntime-dev/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ortcibuild_readonly

  jchen351

  committed
  bf7ad9b

  Copy full SHA for bf7ad9b

• --subscription 00c06639-6ee4-454e-8058-8d8b1703bd87

  jchen351

  committed
  ebde2c8

  Copy full SHA for ebde2c8

• install_centos_gcc11

  jchen351

  committed
  8893b72

  Copy full SHA for 8893b72

• install_centos_gcc11

  jchen351

  committed
  89e7404

  Copy full SHA for 89e7404

• /opt/rh/gcc-toolset-11

  jchen351

  committed
  6dcdcac

  Copy full SHA for 6dcdcac

• Remove requirment for gcc 9 or greater

  jchen351

  committed
  814ac9e

  Copy full SHA for 814ac9e

• --target PyPackageBuild

  jchen351

  committed
  2e28669

  Copy full SHA for 2e28669

• Merge branch 'main' into Cjian/py

  Show description for 7442d06
  jchen351

  committed
  7442d06

  Copy full SHA for 7442d06

• CMAKE_C_COMPILER_VERSION VERSION_LESS 8

  jchen351

  committed
  e8c1bd0

  Copy full SHA for e8c1bd0

• "-DCMAKE_CUDA_ARCHITECTURES=60;61;70;75;80;86"

  jchen351

  committed
  374d9df

  Copy full SHA for 374d9df

• "-DCMAKE_CUDA_ARCHITECTURES=60;61;70;75;80;86"

  jchen351

  committed
  61832cb

  Copy full SHA for 61832cb

Commits on Feb 28, 2024

• Merge branch 'main' into Cjian/py

  Show description for 89b8f8d
  jchen351

  committed
  89b8f8d

  Copy full SHA for 89b8f8d

• span(const std::vector<std::remove_const_t<T> >& s) : p_{const_cast<T*>(s.data())}, length_{s.size()} {}

  jchen351

  committed
  2b959f8

  Copy full SHA for 2b959f8

• remove download_onnxruntime.py

  jchen351

  committed
  28c19e1

  Copy full SHA for 28c19e1

• "$(echo $CUDA_VERSION | cut -d. -f1)" -ge 12

  jchen351

  committed
  a1a35db

  Copy full SHA for a1a35db

• skipping TRT_VERSION for now

  jchen351

  committed
  e7119c8

  Copy full SHA for e7119c8

• cd /tmp/scripts && /tmp/scripts/install_centos.sh && /tmp/scripts/install_deps.sh && rm -rf /tmp/scripts;

  jchen351

  committed
  2ab4a51

  Copy full SHA for 2ab4a51

• push

  jchen351

  committed
  10423a4

  Copy full SHA for 10423a4

Commits on Feb 29, 2024

• push

  jchen351

  committed
  ae70d08

  Copy full SHA for ae70d08

• install_centos

  jchen351

  committed
  0235412

  Copy full SHA for 0235412

• Merge branch 'main' into Cjian/py

  jchen351

  committed
  d03fb31

  Copy full SHA for d03fb31

• Adding nuget publish

  jchen351

  committed
  0658930

  Copy full SHA for 0658930

• Add from_chars replacement for USE_CXX17

  RyanUnderhill

  committed
  28d7bdc

  Copy full SHA for 28d7bdc

• Merge

  RyanUnderhill

  committed
  ab61e44

  Copy full SHA for ab61e44

• Span Test

  RyanUnderhill

  committed
  8408a2e

  Copy full SHA for 8408a2e

• Variation 2

  RyanUnderhill

  committed
  0ec9c05

  Copy full SHA for 0ec9c05

Commits on Mar 1, 2024

• Managed

  jchen351

  committed
  3521eda

  Copy full SHA for 3521eda

• gcc_gpu

  jchen351

  committed
  fc8316d

  Copy full SHA for fc8316d

• add_custom_target(PyPackageBuild ALL

  Show description for da6adbe
  jchen351

  committed
  da6adbe

  Copy full SHA for da6adbe

• WHEEL_TARGET_NAME

  jchen351

  committed
  c9c9e62

  Copy full SHA for c9c9e62

• auditwheel

  jchen351

  committed
  39e40f2

  Copy full SHA for 39e40f2

• -DMANYLINUX=ON

  jchen351

  committed
  ac53234

  Copy full SHA for ac53234

• --exclude

  jchen351

  committed
  bd58c9e

  Copy full SHA for bd58c9e

• MANYLINUX

  jchen351

  committed
  dc77c64

  Copy full SHA for dc77c64

• MANYLINUX

  jchen351

  committed
  974fc0f

  Copy full SHA for 974fc0f

• [a-z]

  jchen351

  committed
  bf73fee

  Copy full SHA for bf73fee

• onnxruntime_genai

  jchen351

  committed
  15a1629

  Copy full SHA for 15a1629

• Contents: '*manylinux*.whl'

  jchen351

  committed
  b3c2813

  Copy full SHA for b3c2813

• repair onnxruntime_genai*linux_x86_64.whl

  jchen351

  committed
  77e2b72

  Copy full SHA for 77e2b72

• auditwheel_exclude_list

  jchen351

  committed
  b72c469

  Copy full SHA for b72c469

• gha

  jchen351

  committed
  9d12230

  Copy full SHA for 9d12230

• "libnvinfer.so.8", "libnvinfer_plugin.so.8", "libnvonnxparser.so.8"

  jchen351

  committed
  c261953

  Copy full SHA for c261953

• modified_exclude_list

  jchen351

  committed
  6ca4b68

  Copy full SHA for 6ca4b68

• build_dir: win-x64

  jchen351

  committed
  dd151b0

  Copy full SHA for dd151b0

• "--exclude"

  jchen351

  committed
  926248b

  Copy full SHA for 926248b

Commits on Mar 2, 2024

• az login --identity -u 63b63039-6328-442f-954b-5a64d124e5b

  jchen351

  committed
  b2a469f

  Copy full SHA for b2a469f

Commits on Mar 3, 2024

• RelWithDebInfo

  jchen351

  committed
  45fd7a6

  Copy full SHA for 45fd7a6

• /Users/jchen351/Workspaces/onnxruntime-genai/.pipelines/stages/jobs/py-win-packaging-job.yml

  jchen351

  committed
  3e602bc

  Copy full SHA for 3e602bc

• az login --identity -u /subscriptions/00c06639-6ee4-454e-8058-8d8b1703bd87/resourcegroups/proj-onnxruntime-dev/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ortcibuild_readonly

  jchen351

  committed
  0562e5b

  Copy full SHA for 0562e5b

• Merge branch 'refs/heads/main' into Cjian/py

  Show description for b6a0682
  jchen351

  committed
  b6a0682

  Copy full SHA for b6a0682

• - task: BinSkim@4

  Show description for 836e233
  jchen351

  committed
  836e233

  Copy full SHA for 836e233

• # BinSkim is skipped because onnxruntime-genai is build as static library

  jchen351

  committed
  8fcda76

  Copy full SHA for 8fcda76

Commits on Mar 4, 2024

• Merge branch 'refs/heads/main' into Cjian/py

  Show description for 9450ab4
  jchen351

  committed
  9450ab4

  Copy full SHA for 9450ab4

• az login --identity --username 63b63039-6328-442f-954b-5a64d124e5b4

  jchen351

  committed
  4412912

  Copy full SHA for 4412912

• reformat files

  jchen351

  committed
  fa7022a

  Copy full SHA for fa7022a

• ENABLE_TESTS

  jchen351

  committed
  d7b57b6

  Copy full SHA for d7b57b6

• ort_version

  jchen351

  committed
  867855f

  Copy full SHA for 867855f

• -DENABLE_TESTS=OFF

  jchen351

  committed
  82c867c

  Copy full SHA for 82c867c

• remove install python

  jchen351

  committed
  eb52540

  Copy full SHA for eb52540

• remove install python

  jchen351

  committed
  f6b6797

  Copy full SHA for f6b6797

• remove install python test

  jchen351

  committed
  668e794

  Copy full SHA for 668e794