Olivia Jain
6fbd0a8233
Change cmake_cuda_architectures to double quotes ( #8990 )
2021-09-08 09:41:52 -07:00
Olivia Jain
a0c9408f0d
Make TRT Version Configurable ( #8864 )
...
* copy changes from trt_and_mem
* second edits
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* change to cuda 11.4
* build with cuda 11.4
* Update Dockerfile.ubuntu_cuda11_1_tensorrt7_2
* add cmake extra defines
* cmake architectures
* fix cmake arch
* Delete ubuntu-18.04.Dockerfile
* Rename Dockerfile.ubuntu_cuda11_1_tensorrt7_2 to Dockerfile.ubuntu_cuda11_4_tensorrt7_2
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* removing previous ort args
* rename to cuda 11.4
* remove cuda 10_2
* delete trt 7.1
* remove 7.1
* Passing in cuda architecture to reduce build time
* always add submodule sync due to recursive cloning
* fix run command
* add and
* take away unused arms and share python installation script
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml
* Update Dockerfile.tensorrt
* cleanup file
* install python directly on dockerfile - move to scripts in future
* Update Dockerfile.custom-trt-perf
* adding cuda 11.1 for missing Libnvrtc.so.11.1
* Delete install_python.sh
2021-09-03 13:32:27 -07:00
Olivia Jain
9cefd1303b
Integrate Anubis ( #8603 )
...
* copy over changes
* Update build_image.sh
* allow for configurable trt
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* reflect previous changes
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* model_list.json
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* checkout trt 7.1
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update post.py
* Update post.py
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update model_list.json
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update post.py
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update model_list.json
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update start_job.ps1
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update run_mem_test_docker.sh
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Separate anubis files
* revert to old pipeline
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* build off master Dockerfile
* Delete Dockerfile.custom-trt-perf
* Delete install_common_deps.sh
* uncomment
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml
* pass in trt container version
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update post.py
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update post.py
* remove sudo
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* add back build number
* allow python 3.8
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* python 3.8 fix trtexec
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* remove prev py38
* Update linux-gpu-tensorrt-ci-perf-pipeline.yml for Azure Pipelines
* add perf dependencies
* Update start_job.ps1
2021-08-16 13:20:28 -07:00
stevenlix
ee99fb400c
Upgrade TensorRT to v8.0.1 ( #8512 )
...
* update onnx-tensorrt parser to master
* disable unsupported tests
* add cuda sm 75 for T4
* update tensorrt pipeline
* update trt pipelines
* update trt pipelines
* Update linux-gpu-tensorrt-ci-pipeline.yml
* update trt cid pipeline
* Update linux-gpu-tensorrt-ci-pipeline.yml
* Update Tensorrt Windows build pool and TensorRT/CUDA/CuDNN version
* update to cuda11.4 in trt ci pipeline
* update base image to cuda11.4
* update packaging pipeline to cuda11.4
* clean up
* remove cuda11.1 and cuda11.3 docker file
* disable unsupported tensorrt tests at runtime
* Update linux-multi-gpu-tensorrt-ci-pipeline.yml
2021-08-02 11:20:31 -07:00
Changming Sun
0510688411
Update compliance tasks in python packaging pipeline and fix some compile warnings ( #8471 )
...
1. Update SDLNativeRules from v2 to v3. The new one allows us setting excluded paths.
2. Update TSAUpload from v1 to v2. And add a config file ".gdn/.gdntsa" for it.
3. Fix some parentheses warnings
4. Update cmake to the latest.
5. Remove "--x86" build option from pipeline yaml files. Now we can auto-detect cpu architecture from python. So we don't need to ask user to specify it.
2021-07-30 17:16:37 -07:00
George Wu
25c49a5fe0
fix issue with cmake path ( #8055 )
2021-06-15 15:09:15 -07:00
Changming Sun
ed5fd919ef
Update dockerfiles to use the latest cmake ( #7933 )
2021-06-03 18:51:00 -07:00
George Wu
025abf996d
fix for using tensorrt:20.12 base image ( #7264 )
2021-04-07 08:48:43 -07:00
Olivia Jain
fb40602ea2
Mem trt ( #6868 )
...
* adding trt comparison and memory consumption
* creating separate docker file
2021-04-05 22:16:12 -07:00
Olivia Jain
db05d53b94
Setup perf in docker and add features ( #6582 )
...
* setup scripts to run in docker
* percent threshold for accuracy
* branch testing
2021-02-25 09:31:03 -08:00
stevenlix
53eb948f4c
Upgrade TensorRT to v7.2.2 ( #6452 )
...
* upgrade to TensorRT 7.2.2
* extend GPU tensorrt CI timeout to 150 minutes
* update docker image name
* disable user interaction to avoid tensorrt container stuck when install tzdata
* upgrade to libssl1.1 for ubuntu20.04
* remove libicu60 from ubuntu20.04
* add libicu66 for ubuntu20.04
* debug
* llvm
* llvm
* disable ReverseSequenceTest.InvalidInput
* disable ReverseSequenceTest.InvalidInput
* fix issues
* fix issues
* Update linux-gpu-tensorrt-ci-pipeline.yml
* disable warning 4458 for TensorRT parser
* update onnx-tensorrt submodule
* disable warnings for TensorRT parser
* update onnx-tensorrt submodule to include latest bug fixes
* update setup_env_trt
* update pool for win trt ci pipeline'
Co-authored-by: George Wu <jywu@microsoft.com>
2021-02-18 04:30:47 -08:00
George Wu
8d2e22558d
unattended-upgrades ( #4804 )
2020-08-14 18:12:27 -07:00
stevenlix
77c69a0325
Upgrade TensorRT to v7.1.3.4 ( #4704 )
...
* upgrade to TensorRT 7.1.3.4
* Upgrade onnx-tensorrt parser for TensorRT 7.1.3.4
* fix format issue
* fix format issue
* fix format issue
* Update tensorrt_execution_provider.cc
* change cmake version to 3.14
* Remove --msvc_toolset 14.16
* change to onnxruntime::make_unique
* use onnxruntime::make_unique
* disable some tests for TensorRT
* disable some tests for TensorRT
* Update upsample_op_test.cc
* Update tile_op_test.cc
* disable some tests for TensorRT
* Update constant_of_shape_test.cc
* update parser
* Update Dockerfile.ubuntu_tensorrt
2020-08-07 17:43:56 -07:00
Changming Sun
0a6d9dd301
Remove Openmp from the GPU docker files
2020-05-25 14:17:48 -07:00
Changming Sun
30efe65e95
Add use_openmp back to the docker files
2020-05-25 14:17:48 -07:00
George Wu
584ba71485
TensorRT dockerfile updates ( #3016 )
...
* change npy installation
* update trt base image version
* update build instructions for arm64/jetson
2020-02-13 14:34:00 -08:00
George Wu
ba0e7daf20
update dockerfiles/README ( #2336 )
2019-11-06 16:54:10 -08:00
George Wu
06a6d74a67
update ngraph dockerfile. add python lib location to LD_LIBRARY_PATH for cuda/tensorrt Dockerfiles. ( #2330 )
2019-11-06 11:29:55 -08:00
Pranav Sharma
69970d1f2a
Include the new Privacy.md file in all release packages. ( #2200 )
2019-10-20 07:58:36 -07:00
stevenlix
544e53e24e
Update TensorRT to version 6.0.1.5 ( #1966 )
...
* remove onnx-tensorrt submodule
* add new onnx-tensorrt submodule (experiment) for trt6
* update engine build for trt6
* update compile and compute for tensorrt6.0
* Update tensorrt_execution_provider.cc
* Update tensorrt_execution_provider.cc
* Update tensorrt_execution_provider.cc
* Update tensorrt_execution_provider.cc
* switch to onnx-tensorrt master for TensorRT6'
* Update tensorrt_execution_provider.cc
* Handle dynamic batch size and add memcpy in TensorRT EP
* update test cases
* Update tensorrt_execution_provider.cc
* update onnx-tensorrt submodule
* Update Dockerfile.ubuntu_tensorrt
* Update Dockerfile.ubuntu_tensorrt
* Update run_dockerbuild.sh
* Update run_dockerbuild.sh
* Update install_ubuntu.sh
* Update concat_op_test.cc
* Update tensorrt_execution_provider.cc
* Upgrade TensorRT to version 6.0.1.5
* Update onnxruntime_providers.cmake
* Update CMakeLists.txt
* Update reduction_ops_test.cc
* Update install_ubuntu.sh
* Update Dockerfile.ubuntu_tensorrt
* Update Dockerfile.tensorrt
* Update BUILD.md
* Update run_dockerbuild.sh
* Update install_ubuntu.sh
* Update onnxruntime_providers.cmake
* Update install_ubuntu.sh
* Update install_ubuntu.sh
* Update gemm_test.cc
* Update gather_op_test.cc
* Update CMakeLists.txt
* Removed submodule
* update onnx-tensorrt submodule
* Add Ubuntu18.04 build option
* Add Ubuntu18.04 build option
* Add Ubuntu18.04 build option
* Add Ubuntu18.04 build option
* Remove redundency
* Fix issue that it does not add memcopy node correctly if some nodes fall back to CUDA EP.
e.g. after partition, there's TRT_Node -> Cuda_node (with CPU memory expected), we still need to add memcpy node between them.
* update for Trt Windows build
* Update onnxruntime_providers.cmake
* Disable opset11 tests on TensorRT
* Update pad_test.cc
* Update build.py
* update scripts for ubuntu18.04
* Disable warning for Windows build
2019-10-06 10:40:53 -07:00
Vinitra Swamy
2a21df2309
Updates to CUDA and TensorRT dockerfiles for v0.5.0 ( #1731 )
...
* updates to cuda and tensorrt dockerfiles for v0.5.0
* add table of build tags
2019-09-13 14:16:47 -07:00
Hector Li
dc9c89546d
Update the docker file for OpenVINO ( #1741 )
...
Update the docker file for OpenVINO which is used for AML
2019-08-30 22:32:24 -07:00
manashgoswami
6d783e8a07
Added license files in the base image ( #1595 )
...
* Update Dockerfile.openvino
* Update Dockerfile.cuda
* Update Dockerfile.cuda
* Update Dockerfile.openvino
* Update Dockerfile.cuda
* added ThirdParty notice file to base image.
* corrected license file name
2019-08-09 13:02:06 -07:00
Vinitra Swamy
6b32c77804
Dockerfiles for TensorRT, CUDA, build from source ( #922 )
...
* dockerfile updates for BYOC scenario
* updates for 3 different build versions
* updating to remove libopenblas, python3, python3-pip
* Including LICENSE-IMAGE.txt for CUDA/TensorRT dockerfiles
* remove unnecessary cmake files
* fixing comment typo
* optimizing dockerfile.source as per review suggestions (not working currently)
* Optimizing dockerfiles with install_dependencies script
* update dockerfile with --cmake_extra_defines version number
* add &&\ for license copy lines
* updates, adding miniconda to path, reincluded clearing the pycache
* adding maintainer note
* update readme instructions
* update tensorrt versioning in dockerfile
2019-07-09 02:03:55 -07:00
