onnxruntime/tools/ci_build/github/azure-pipelines/templates/py-packaging-linux-test.yml
Changming Sun eafd67b8fd
Update CUDA version to 11.6 and refactor python packaging pipeline (#13002)
1. Update CUDA version from 11.4 to 11.6.
2. Update Manylinux version
3. Upgrade GCC version from 10 to 11 for most x86_64 pipelines. CentOS 7 ARM64 doesn't have GCC 11 yet.
4. Refactor python packaging pipeline: 
    a. Split Linux GPU build job to two parts, build and test, so that the
build part doesn't need to use a GPU machine
    b. Make the Linux GPU build job and Linux CPU build job more similar: share the same bash script and yaml file.
5. Temporarily disable Attention_Mask1D_Fp16_B2_FusedNoPadding because it is causing one of our packaging pipeline to fail. I have created an ADO task for this.
2022-09-23 00:29:27 -07:00

60 lines
1.6 KiB
YAML

parameters:
- name: arch
type: string
- name: device
type: string
- name: machine_pool
type: string
- name: extra_job_id
type: string
default: ''
- name: python_wheel_suffix
type: string
default: ''
jobs:
- job: Linux_Test_${{ parameters.device }}${{ parameters.extra_job_id }}_${{ parameters.arch }}
timeoutInMinutes: 240
variables:
skipComponentGovernanceDetection: true
workspace:
clean: all
pool: ${{ parameters.machine_pool }}
steps:
- task: DownloadPipelineArtifact@2
displayName: 'Download Pipeline Artifact'
inputs:
preferTriggeringPipeline: true
artifactName: 'drop-linux-${{ lower(parameters.device) }}-${{ parameters.arch }}'
targetPath: '$(Build.BinariesDirectory)/Release'
runVersion: 'latest'
buildType: specific
project: '530acbc4-21bc-487d-8cd8-348ff451d2ff'
definition: 841
- task: DownloadPipelineArtifact@2
displayName: 'Download Pipeline Artifact'
inputs:
preferTriggeringPipeline: true
artifactName: 'onnxruntime${{ parameters.python_wheel_suffix }}'
targetPath: '$(Build.BinariesDirectory)/whl'
runVersion: 'latest'
buildType: specific
project: '530acbc4-21bc-487d-8cd8-348ff451d2ff'
definition: 841
- task: Bash@3
displayName: 'Bash Script'
inputs:
targetType: filePath
filePath: tools/ci_build/github/linux/run_python_tests.sh
arguments: -d ${{ parameters.device }}
- task: mspremier.PostBuildCleanup.PostBuildCleanup-task.PostBuildCleanup@3
displayName: 'Clean Agent Directories'
condition: always()