Move Linux GPU CI pipeline to A10 (#23235)

Move Linux GPU CI pipeline to A10 machines which are more advanced.
Retire onnxruntime-Linux-GPU-T4 machine pool.
Disable run_lean_attention test because the new machines do not have
enough shared memory.

```
skip loading trt attention kernel fmha_mhca_fp16_128_256_sm86_kernel because no enough shared memory
[E:onnxruntime:, sequential_executor.cc:505 ExecuteKernel] Non-zero status code returned while running MultiHeadAttention node. Name:'MultiHeadAttention_0' Status Message: CUDA error cudaErrorInvalidValue:invalid argument
```
This commit is contained in:
Changming Sun 2025-01-04 19:11:37 -08:00 committed by GitHub
parent 4247153bb2
commit b7ef81a034
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
3 changed files with 3 additions and 3 deletions

View file

@ -892,7 +892,7 @@ class TestMultiHeadAttention(unittest.TestCase):
# Run tests sequentially to avoid out of memory issue.
self.run_mha_cpu()
self.run_mha_cuda()
self.run_lean_attention()
# self.run_lean_attention()
self.run_mha_cuda_multi_threading_default()
self.run_mha_cuda_multi_threading_cudnn()
self.run_mha_cuda_multi_threading_efficient()

View file

@ -137,7 +137,7 @@ stages:
skipComponentGovernanceDetection: true
workspace:
clean: all
pool: onnxruntime-Linux-GPU-T4
pool: Onnxruntime-Linux-A10-24G
steps:
- checkout: self
clean: true

View file

@ -21,7 +21,7 @@ BUILD_ARGS=('--config'
"--enable_pybind"
"--build_java"
"--cmake_extra_defines"
"CMAKE_CUDA_ARCHITECTURES=75"
"CMAKE_CUDA_ARCHITECTURES=86"
"onnxruntime_BUILD_UNIT_TESTS=ON"
"onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON")
if [ -x "$(command -v ninja)" ]; then