onnxruntime/tools/ci_build/github/azure-pipelines
Thiago Crepaldi 83be3759bc
Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027)
ORTModule requires two PyTorch CPP extensions that are currently JIT compiled. The runtime compilation can cause issues in some environments without all build requirements or in environments with multiple instances of ORTModule running in parallel

This PR creates a custom command to compile such extensions that must be manually executed before ORTModule is executed for the first time. When users try to use ORTModule before the extensions are compiled, an error with instructions are raised

PyTorch CPP Extensions for ORTModule can be compiled by running:
python -m onnxruntime.training.ortmodule.torch_cpp_extensions.install

Full build environment is needed for this
2021-06-28 18:11:58 -07:00
..
nodejs
nuget Delete some unused code in run_dockerbuild.sh and Enable Nuget CUDA tests (#8089) 2021-06-22 18:43:33 -07:00
templates Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027) 2021-06-28 18:11:58 -07:00
android-x86_64-crosscompile-ci-pipeline.yml
c-api-noopenmp-packaging-pipelines.yml
clean-build-docker-image-cache-pipeline.yml
featurizers-py-packaging-pipeline.yml
linux-ci-pipeline.yml Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027) 2021-06-28 18:11:58 -07:00
linux-cpu-minimal-build-ci-pipeline.yml
linux-dnnl-ci-pipeline.yml
linux-gpu-ci-pipeline.yml Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027) 2021-06-28 18:11:58 -07:00
linux-gpu-cuda-11-pipeline.yml
linux-gpu-tensorrt-7-1-ci-pipeline.yml Add TRT 7.1 Pipeline (#8073) 2021-06-21 20:57:04 -07:00
linux-gpu-tensorrt-ci-perf-pipeline.yml Make Perf Test Configurable (#7836) 2021-06-18 11:11:19 -07:00
linux-gpu-tensorrt-ci-pipeline.yml Fix training e2e pipeline (#7942) 2021-06-04 09:37:09 -07:00
linux-gpu-tensorrt-packaging-pipeline.yml
linux-multi-gpu-ci-pipeline.yml
linux-multi-gpu-tensorrt-ci-pipeline.yml Delete some unused code in run_dockerbuild.sh and Enable Nuget CUDA tests (#8089) 2021-06-22 18:43:33 -07:00
linux-nocontribops-ci-pipeline.yml
linux-nuphar-ci-pipeline.yml Delete some unused code in run_dockerbuild.sh and Enable Nuget CUDA tests (#8089) 2021-06-22 18:43:33 -07:00
linux-openvino-ci-pipeline.yml Delete some unused code in run_dockerbuild.sh and Enable Nuget CUDA tests (#8089) 2021-06-22 18:43:33 -07:00
linux-openvino-nightly-pipeline.yml Delete some unused code in run_dockerbuild.sh and Enable Nuget CUDA tests (#8089) 2021-06-22 18:43:33 -07:00
linux-ort-srv-ci-pipeline.yml
linux-pytorch-custom-ops-ci-pipeline.yml Change "Export PyTorch CustomOp" build pipeline to use Ubuntu 20.04 (#8158) 2021-06-28 16:13:55 -07:00
mac-ci-pipeline.yml
mac-coreml-ci-pipeline.yml Update C++ Standard from 14 to 17 (#8041) 2021-06-25 14:08:01 -07:00
mac-ios-ci-pipeline.yml Update C++ Standard from 14 to 17 (#8041) 2021-06-25 14:08:01 -07:00
mac-nocontribops-ci-pipeline.yml
orttraining-linux-ci-pipeline.yml
orttraining-linux-gpu-amd-e2e-test-ci-pipeline.yml
orttraining-linux-gpu-ci-pipeline.yml Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027) 2021-06-28 18:11:58 -07:00
orttraining-linux-gpu-distributed-e2e-test-pipeline.yml Delete some unused code in run_dockerbuild.sh and Enable Nuget CUDA tests (#8089) 2021-06-22 18:43:33 -07:00
orttraining-linux-gpu-distributed-test-ci-pipeline.yml Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027) 2021-06-28 18:11:58 -07:00
orttraining-linux-gpu-docker-release-pipeline.yml
orttraining-linux-gpu-ortmodule-distributed-test-ci-pipeline.yml Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027) 2021-06-28 18:11:58 -07:00
orttraining-linux-gpu-ortmodule-test-clear-cache-pipeline.yml
orttraining-linux-gpu-perf-test-ci-pipeline.yml Delete some unused code in run_dockerbuild.sh and Enable Nuget CUDA tests (#8089) 2021-06-22 18:43:33 -07:00
orttraining-mac-ci-pipeline.yml
orttraining-pai-ci-pipeline.yml Add post-install command to build PyTorch CPP extensions from within onnxruntime package (#8027) 2021-06-28 18:11:58 -07:00
orttraining-py-packaging-pipeline-cuda102.yml
orttraining-py-packaging-pipeline-cuda111.yml
orttraining-py-packaging-pipeline-rocm.yml
orttraining-py-packaging-pipeline-torch181-cuda102.yml make pipelines to support torch1.8.1 and torch1.9.0 (#8084) 2021-06-25 14:55:49 -07:00
orttraining-py-packaging-pipeline-torch181-cuda111.yml make pipelines to support torch1.8.1 and torch1.9.0 (#8084) 2021-06-25 14:55:49 -07:00
orttraining-py-packaging-pipeline-torch190-cuda102.yml make pipelines to support torch1.8.1 and torch1.9.0 (#8084) 2021-06-25 14:55:49 -07:00
orttraining-py-packaging-pipeline-torch190-cuda111.yml make pipelines to support torch1.8.1 and torch1.9.0 (#8084) 2021-06-25 14:55:49 -07:00
orttraining-win-ci-pipeline.yml
orttraining-win-gpu-ci-pipeline.yml
post-merge-jobs.yml
py-packaging-pipeline.yml
win-ci-fuzz-testing.yml
win-ci-pipeline.yml
win-gpu-ci-pipeline.yml Enable C# GPU tests in Windows GPU CI pipeline (#8142) 2021-06-25 08:11:45 -07:00
win-gpu-cuda-10-2-pipeline.yml Remove DML from Windows GPU CUDA 10.2 pipeline 2021-06-15 16:53:24 -07:00
win-gpu-reduce-op-ci-pipeline.yml
win-gpu-tensorrt-ci-pipeline.yml
win-wasm-ci-pipeline.yml