onnxruntime/cmake
stevenlix 54de618c2e
Improve TensorRT engine caching (#5737)
* add profile caching to improve engine caching feature

* Add comments

* fix typo

* add decryption for engine caching

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* update onnx-tensorrt submodule

* set opt profile to max value of the range

* add hash to engine/profile name

* Add calibration based INT8 quantization

* add an option to enable both FP16 and INT8

* Update tensorrt_execution_provider.cc

* add env variable to specify calibration file name

* clean up code

* Add comments and update TRT document

* enable tensorrt basic test and add EngineCachingTest

* clean up

* update envrionment variable in the test

* clean up
2020-11-12 08:56:45 -08:00
..
external Support opset-13 specs of controlflow ops (Loop, If) (#5665) 2020-11-11 23:44:14 -08:00
horovod
patches
tensorboard
CMakeLists.txt [OpenVINO-EP] Enabling Multi Device support (#5740) 2020-11-11 15:16:30 -08:00
CMakeSettings.json
codeconv.runsettings
ConfigureVisualStudioCodeAnalysis.props
EnableVisualStudioCodeAnalysis.props
flake8.cmake
onnxruntime.cmake ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
onnxruntime_codegen.cmake [ORT Mobile] file format schema and file I/O code (#4973) 2020-09-01 11:51:31 +10:00
onnxruntime_common.cmake Upgrade optional implementation to https://github.com/martinmoene/optional-lite. (#5563) 2020-11-03 15:27:47 -08:00
onnxruntime_config.h.in
onnxruntime_csharp.cmake
onnxruntime_flatbuffers.cmake fix build break (#5306) 2020-09-28 00:10:48 -07:00
onnxruntime_framework.cmake Ryanunderhill/backout 5014 (#5167) 2020-09-14 22:48:00 -07:00
onnxruntime_fuzz_test.cmake
onnxruntime_graph.cmake Replace MPI Send and Recv with NCCL Send and Recv (#5054) 2020-09-09 09:39:56 -07:00
onnxruntime_ios.toolchain.cmake Add iOS test pipeline and a sample app. (#5298) 2020-09-29 13:53:11 -07:00
onnxruntime_java.cmake
onnxruntime_java_unittests.cmake
onnxruntime_language_interop_ops.cmake [ORT Mobile] file format schema and file I/O code (#4973) 2020-09-01 11:51:31 +10:00
onnxruntime_mlas.cmake Implement Scale function for quant gemm (#5632) 2020-11-10 23:34:38 -08:00
onnxruntime_nodejs.cmake
onnxruntime_nuphar_extern.cmake
onnxruntime_optimizer.cmake [ORT Mobile] file format schema and file I/O code (#4973) 2020-09-01 11:51:31 +10:00
onnxruntime_providers.cmake Improve TensorRT engine caching (#5737) 2020-11-12 08:56:45 -08:00
onnxruntime_pyop.cmake [ORT Mobile] file format schema and file I/O code (#4973) 2020-09-01 11:51:31 +10:00
onnxruntime_python.cmake ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
onnxruntime_session.cmake [ORT Mobile] file format schema and file I/O code (#4973) 2020-09-01 11:51:31 +10:00
onnxruntime_training.cmake ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
onnxruntime_unittests.cmake Revert "Custom Op on GPU (#5620)" 2020-10-30 21:23:51 -07:00
onnxruntime_util.cmake
precompiled_header.cmake
protobuf_function.cmake Last major set of ORT format model changes (#5056) 2020-09-05 07:59:01 +10:00
set_winapi_family_desktop.h
store_toolchain.cmake Use onecore umbrella lib in onecore builds (#5182) 2020-09-16 10:46:27 -07:00
target_delayload.cmake Use onecore umbrella lib in onecore builds (#5182) 2020-09-16 10:46:27 -07:00
wcos_rules_override.cmake Use onecore umbrella lib in onecore builds (#5182) 2020-09-16 10:46:27 -07:00
wil.cmake
winml.cmake Store/containerized apps support (#4651) 2020-09-09 14:36:35 -07:00
winml_cppwinrt.cmake
winml_sdk_helpers.cmake
winml_unittests.cmake Add WinML Model testing (#5417) 2020-10-15 19:04:12 -07:00