onnxruntime/tools/ci_build/github/azure-pipelines
Weixing Zhang aec4cb489e
ROCm EP for AMD GPU (#5480)
The ROCm EP is designed and implemented based on AMD GPU software stack named ROCm. Here is the link for the details about ROCm: https://rocmdocs.amd.com/en/latest/

ROCm EP was created based on the following things:
1. AMD GPU programming language: HIP
2. AMD GPU HIP language runtime: amdhip64
3. BLAS: rocBLAS, hipBLAS
4. DNN: miOpen
5. Collective Communication library: RCCL
6. cub: hipCub
7. …

Current status:
BERT-L and GPT2 training can be ran on AMD GPU with data parallel.

Next:
1. Make more GPU code be sharable between ROCm EP and CUDA EP since HIP language and HIP runtime API are very close to CUDA.
2. Continue improving the implementation.
3. Continue GPU kernel optimization.
4. Support model parallelism on ROCm EP.
……

The rocm kernels have been removed from this commit and will be in a separate PR. Since the original PR was too big(~180 files), it was suggested to split the PR into two parts, one is rocm-kernels, the other is non rocm kernels.  

Co-authored-by: Weixing Zhang <wezhan@microsoft.com>
Co-authored-by: sabreshao <sabre.shao@amd.com>
Co-authored-by: anghostcici <11013544+anghostcici@users.noreply.github.com>
Co-authored-by: Suffian Khan <sukha@microsoft.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
2020-10-29 17:13:04 -07:00
..
nodejs Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
nuget Remove MKLML build config (#5559) 2020-10-21 13:11:25 -07:00
templates Publish no-openmp python packages to test pypi (#5610) 2020-10-28 19:49:53 -07:00
android-x86_64-crosscompile-ci-pipeline.yml Android CI update (#5474) 2020-10-14 16:56:50 -07:00
c-api-packaging-pipelines.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
centos-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
featurizers-py-packaging-pipeline.yml Refactor Python packaging builds (#4283) 2020-06-22 17:13:22 -07:00
java-api-packaging-pipelines-gpu.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
java-api-packaging-pipelines.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
linux-ci-pipeline.yml Remove MKLML build config (#5559) 2020-10-21 13:11:25 -07:00
linux-cpu-minimal-build-ci-pipeline.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
linux-dnnl-ci-pipeline.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
linux-gpu-ci-pipeline.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
linux-gpu-cuda-11-pipeline.yml Remove MKLML build config (#5559) 2020-10-21 13:11:25 -07:00
linux-gpu-tensorrt-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
linux-multi-gpu-ci-pipeline.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
linux-multi-gpu-tensorrt-ci-pipeline.yml
linux-ngraph-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-nocontribops-ci-pipeline.yml Update ONNX commit (#5487) 2020-10-21 07:22:20 -07:00
linux-nuphar-ci-pipeline.yml Downgrade GCC (#5269) 2020-09-24 21:14:54 -07:00
linux-openvino-ci-pipeline.yml [OPENVINO-EP] 2021.1 Release (#5431) 2020-10-14 15:56:00 -07:00
linux-openvino-nightly-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-ort-srv-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-ort-srv-nightly-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-pytorch-custom-ops-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
mac-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
mac-ios-ci-pipeline.yml Enable iOS CI pipeline (#5360) 2020-10-02 20:14:45 -07:00
mac-nocontribops-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-linux-ci-pipeline.yml Remove MKLML build config (#5559) 2020-10-21 13:11:25 -07:00
orttraining-linux-gpu-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-linux-gpu-docker-release-pipeline.yml Docker image release build updates (#5326) 2020-10-01 12:25:31 -07:00
orttraining-linux-gpu-e2e-test-ci-pipeline.yml Liqun/remove number matching (#5606) 2020-10-27 21:27:37 -07:00
orttraining-linux-gpu-frontend-test-ci-pipeline.yml Liqun/remove number matching (#5606) 2020-10-27 21:27:37 -07:00
orttraining-linux-gpu-perf-test-ci-pipeline.yml
orttraining-mac-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-pai-ci-pipeline.yml ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
orttraining-py-packaging-pipeline.yml Refactor manylinux docker image and the related pipelines (#4751) 2020-08-17 09:40:31 -07:00
orttraining-win-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-win-gpu-ci-pipeline.yml Promote Cuda version to 10.2 for windows pipelines (#5138) 2020-09-13 20:32:06 -07:00
post-merge-jobs.yml jobs timeout .. 2020-09-21 21:51:59 -07:00
py-packaging-pipeline.yml Refactor Python packaging builds (#4283) 2020-06-22 17:13:22 -07:00
win-arm-crosscompile-ci-pipeline.yml
win-arm64-crosscompile-ci-pipeline.yml
win-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-gpu-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-gpu-cuda-11-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-gpu-reduce-op-ci-pipeline.yml Promote Cuda version to 10.2 for windows pipelines (#5138) 2020-09-13 20:32:06 -07:00
win-gpu-tensorrt-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
win-ngraph-ci-pipeline.yml Revert "remove openmp and scipy from build pipelines (#4305)" 2020-07-02 00:30:02 -07:00
win-nocontribops-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-x86-nocontribops-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00