onnxruntime/tools/ci_build/github/azure-pipelines
Chi Lo 92292de135
Tensorrt perf tool (#5436)
* Add YAML file for pipeline

* Modify typo

* Add working directory

* Modify and test

* Modfiy and test

* Modify and test

* Modify and test

* Modify

* Modify

* Modify

* Modify

* Make sure to copy all the result files

* Add clearn up

* Modify

* Modify agent pool name

* Upload only specific artifacts

* Modify

* Integrated CI Pipeline for running TRT perf as well as added the “large amount of models” into perf model target

* Fix bug

* Fix bug

* Add reading the information regarding previously known failing models
and then skip testing them during benchmark/validation

* Modify the script file for CI

* Replace print with logger.info

* Fix bug

* Fix bug

* Refine the code

* Modify the script so that it can capture script segmentation fault while
running ORT

* Fix bug

* fix bug

* fix bug

* Add debug info

* fix bug

* Refine perf code

* Refine the code

* fix bug

* Code refactoring

* change many-models path

* remove metadata after validation/benchmark are done

* Update README.md

* Fix bug so that metadata doesn't hold stale value

* Remove hardcode and update README

* Add arguments to the script to make it run correctly

* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines

* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines

* Fix bug so that metadata doesn't hold stale value

* Fix small bug of finding test dataset directory for FP16 test data, as
well as modification of some output information

* use -i random for perf test of TRT changes

Co-authored-by: Olivia Jain <oljain@microsoft.com>
2020-11-06 12:27:42 -08:00
..
nodejs update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
nuget Nuget packaging no omp (#5666) 2020-11-06 11:43:35 -08:00
templates Add static CRT DLLs to Nuget package (#5661) 2020-11-05 09:26:17 -08:00
android-x86_64-crosscompile-ci-pipeline.yml Android CI update (#5474) 2020-10-14 16:56:50 -07:00
c-api-packaging-pipelines.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
centos-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
featurizers-py-packaging-pipeline.yml Refactor Python packaging builds (#4283) 2020-06-22 17:13:22 -07:00
java-api-packaging-pipelines-gpu.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
java-api-packaging-pipelines.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-cpu-minimal-build-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-dnnl-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-gpu-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-gpu-cuda-11-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-gpu-tensorrt-ci-perf-pipeline.yml Tensorrt perf tool (#5436) 2020-11-06 12:27:42 -08:00
linux-gpu-tensorrt-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
linux-multi-gpu-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-multi-gpu-tensorrt-ci-pipeline.yml
linux-ngraph-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-nocontribops-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-nuphar-ci-pipeline.yml Downgrade GCC (#5269) 2020-09-24 21:14:54 -07:00
linux-openvino-ci-pipeline.yml [OPENVINO-EP] 2021.1 Release (#5431) 2020-10-14 15:56:00 -07:00
linux-openvino-nightly-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-ort-srv-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-ort-srv-nightly-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-pytorch-custom-ops-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
mac-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
mac-ios-ci-pipeline.yml Enable iOS CI pipeline (#5360) 2020-10-02 20:14:45 -07:00
mac-nocontribops-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-linux-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
orttraining-linux-gpu-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-linux-gpu-docker-release-pipeline.yml Docker image release build updates (#5326) 2020-10-01 12:25:31 -07:00
orttraining-linux-gpu-e2e-test-ci-pipeline.yml Liqun/remove number matching (#5606) 2020-10-27 21:27:37 -07:00
orttraining-linux-gpu-frontend-test-ci-pipeline.yml Liqun/remove number matching (#5606) 2020-10-27 21:27:37 -07:00
orttraining-linux-gpu-perf-test-ci-pipeline.yml
orttraining-mac-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-pai-ci-pipeline.yml ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
orttraining-py-packaging-pipeline.yml Refactor manylinux docker image and the related pipelines (#4751) 2020-08-17 09:40:31 -07:00
orttraining-win-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-win-gpu-ci-pipeline.yml Promote Cuda version to 10.2 for windows pipelines (#5138) 2020-09-13 20:32:06 -07:00
post-merge-jobs.yml jobs timeout .. 2020-09-21 21:51:59 -07:00
py-packaging-pipeline.yml Refactor Python packaging builds (#4283) 2020-06-22 17:13:22 -07:00
win-arm-crosscompile-ci-pipeline.yml
win-arm64-crosscompile-ci-pipeline.yml
win-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-gpu-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-gpu-cuda-11-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-gpu-reduce-op-ci-pipeline.yml Promote Cuda version to 10.2 for windows pipelines (#5138) 2020-09-13 20:32:06 -07:00
win-gpu-tensorrt-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
win-ngraph-ci-pipeline.yml Revert "remove openmp and scipy from build pipelines (#4305)" 2020-07-02 00:30:02 -07:00
win-nocontribops-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-x86-nocontribops-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00