onnxruntime/tools/ci_build/github/azure-pipelines
liqunfu 96bb4b1ce8
Liqun/havenka/rel 1.8.1 round3 (#8246)
* Revert the cuda algo finding change as this causes a significant memory bloat. (#8181)

* Revert the cuda algo finding change as this causes a significant memory bloat.

* Address PR comment

* Make pipelines to support torch1.8.1 and torch1.9.0 (#8084)

* Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027)

ORTModule requires two PyTorch CPP extensions that are currently JIT compiled. The runtime compilation can cause issues in some environments without all build requirements or in environments with multiple instances of ORTModule running in parallel

This PR creates a custom command to compile such extensions that must be manually executed before ORTModule is executed for the first time. When users try to use ORTModule before the extensions are compiled, an error with instructions are raised

PyTorch CPP Extensions for ORTModule can be compiled by running:
python -m onnxruntime.training.ortmodule.torch_cpp_extensions.install

Full build environment is needed for this

* Patch orttraining-ortmodule pipeline with latest fix on master

* add cuda version to build config

* lib path

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* .

* Remove auto doc gen

Co-authored-by: Pranav Sharma <prs@microsoft.com>
Co-authored-by: Thiago Crepaldi <thiago.crepaldi@microsoft.com>
Co-authored-by: Baiju Meswani <bmeswani@microsoft.com>
2021-06-30 23:02:16 -07:00
..
nodejs [JS] refactor Javascript/Typescript libraries in ONNX Runtime (#7308) 2021-04-16 01:33:10 -07:00
nuget Cherry picks for release - 1.8.1 Round 2 (#8137) 2021-06-26 11:26:29 -07:00
templates Liqun/havenka/rel 1.8.1 round3 (#8246) 2021-06-30 23:02:16 -07:00
android-x86_64-crosscompile-ci-pipeline.yml Improve code coverage report (#7770) 2021-05-25 08:26:01 -07:00
c-api-noopenmp-packaging-pipelines.yml Create Android Package pipeline (#7295) 2021-04-12 17:56:25 -07:00
clean-build-docker-image-cache-pipeline.yml Update build docker image cache cleanup build definition (#7452) 2021-04-26 14:39:46 -07:00
featurizers-py-packaging-pipeline.yml
linux-ci-pipeline.yml Remove openmp related packaging pipeline (#6991) 2021-03-12 10:02:59 -08:00
linux-cpu-minimal-build-ci-pipeline.yml Check kernel def hashes (#7120) 2021-04-01 17:42:58 -07:00
linux-dnnl-ci-pipeline.yml
linux-gpu-ci-pipeline.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
linux-gpu-cuda-11-pipeline.yml Fix CUDA 10.2 pipelines (#7759) 2021-05-19 13:52:06 -07:00
linux-gpu-tensorrt-ci-perf-pipeline.yml Setup EP Dashboard (#7321) 2021-05-11 10:33:39 -07:00
linux-gpu-tensorrt-ci-pipeline.yml Add CMAKE_CUDA_ARCHITECTURES=52 to TensorRT CI pipelines (#7455) 2021-04-27 09:55:23 -07:00
linux-gpu-tensorrt-packaging-pipeline.yml cherry picked commits for rel-1.8.1 (#8076) 2021-06-18 07:44:55 -07:00
linux-multi-gpu-ci-pipeline.yml Fix CUDA 10.2 pipelines (#7759) 2021-05-19 13:52:06 -07:00
linux-multi-gpu-tensorrt-ci-pipeline.yml Upgrade TensorRT to v7.2.2 (#6452) 2021-02-18 04:30:47 -08:00
linux-nocontribops-ci-pipeline.yml Remove openmp related packaging pipeline (#6991) 2021-03-12 10:02:59 -08:00
linux-nuphar-ci-pipeline.yml
linux-openvino-ci-pipeline.yml Openvino ep 2021.3 (#7180) 2021-04-01 11:28:54 -07:00
linux-openvino-nightly-pipeline.yml Remove openmp related packaging pipeline (#6991) 2021-03-12 10:02:59 -08:00
linux-ort-srv-ci-pipeline.yml Update ORT server build pipeline (#7030) 2021-03-16 18:02:09 -07:00
linux-pytorch-custom-ops-ci-pipeline.yml
mac-ci-pipeline.yml Initial Objective-C API (#7366) 2021-04-27 10:06:30 -07:00
mac-coreml-ci-pipeline.yml
mac-ios-ci-pipeline.yml Add static code analyzer to Windows CPU/GPU CI builds and fix the warnings (#7489) 2021-04-29 11:54:57 -07:00
mac-nocontribops-ci-pipeline.yml
orttraining-linux-ci-pipeline.yml
orttraining-linux-gpu-amd-e2e-test-ci-pipeline.yml Add BERT-L perf regression test on MI100 and re-enable batch size test (#7240) 2021-04-05 15:51:52 -07:00
orttraining-linux-gpu-ci-pipeline.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
orttraining-linux-gpu-distributed-e2e-test-pipeline.yml Merge pull request #6973 from microsoft/thiagofc/merge-ortmodule-into-master 2021-03-17 10:30:06 -07:00
orttraining-linux-gpu-distributed-test-ci-pipeline.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
orttraining-linux-gpu-docker-release-pipeline.yml icnrease timeout (#7145) 2021-03-26 11:26:18 -07:00
orttraining-linux-gpu-ortmodule-distributed-test-ci-pipeline.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
orttraining-linux-gpu-ortmodule-test-ci-pipeline.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
orttraining-linux-gpu-ortmodule-test-clear-cache-pipeline.yml Add pipeline to clear the cache for huggingface transormers models (#6813) 2021-02-26 10:39:22 -08:00
orttraining-linux-gpu-perf-test-ci-pipeline.yml Pass arguments to azure_scale_set_vm_mount_test_data from perf test ci pipeline (#7094) 2021-03-22 21:48:32 -07:00
orttraining-mac-ci-pipeline.yml
orttraining-pai-ci-pipeline.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
orttraining-py-packaging-pipeline-cuda102.yml to used cudnn7 to build onnxruntime-training wheel with Cuda 10.2 support (#7760) 2021-05-20 09:18:41 -07:00
orttraining-py-packaging-pipeline-cuda111.yml to used cudnn7 to build onnxruntime-training wheel with Cuda 10.2 support (#7760) 2021-05-20 09:18:41 -07:00
orttraining-py-packaging-pipeline-rocm.yml to used cudnn7 to build onnxruntime-training wheel with Cuda 10.2 support (#7760) 2021-05-20 09:18:41 -07:00
orttraining-py-packaging-pipeline-torch181-cuda102.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
orttraining-py-packaging-pipeline-torch181-cuda111.yml Liqun/havenka/rel 1.8.1 round3 (#8246) 2021-06-30 23:02:16 -07:00
orttraining-py-packaging-pipeline-torch190-cuda102.yml Cherry-picks for release 1.8.1 - Round3 (#8195) 2021-06-30 14:15:33 -07:00
orttraining-py-packaging-pipeline-torch190-cuda111.yml Liqun/havenka/rel 1.8.1 round3 (#8246) 2021-06-30 23:02:16 -07:00
orttraining-win-ci-pipeline.yml
orttraining-win-gpu-ci-pipeline.yml
post-merge-jobs.yml Improve code coverage report (#7770) 2021-05-25 08:26:01 -07:00
py-packaging-pipeline.yml
win-ci-fuzz-testing.yml
win-ci-pipeline.yml Add static code analyzer to Windows CPU/GPU CI builds and fix the warnings (#7489) 2021-04-29 11:54:57 -07:00
win-gpu-ci-pipeline.yml Add static code analyzer to Windows CPU/GPU CI builds and fix the warnings (#7489) 2021-04-29 11:54:57 -07:00
win-gpu-cuda-10-2-pipeline.yml Move the Windows GPU machine pool of Onnxruntime packaging pipelines to a new one (#7161) 2021-03-29 17:32:03 -07:00
win-gpu-reduce-op-ci-pipeline.yml
win-gpu-tensorrt-ci-pipeline.yml Add CMAKE_CUDA_ARCHITECTURES=52 to TensorRT CI pipelines (#7455) 2021-04-27 09:55:23 -07:00
win-wasm-ci-pipeline.yml cherry pick outstanding commits (#7871) 2021-05-28 09:10:40 -07:00