onnxruntime/cmake
stevenlix 54de618c2e
Improve TensorRT engine caching (#5737)
* add profile caching to improve engine caching feature

* Add comments

* fix typo

* add decryption for engine caching

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* update onnx-tensorrt submodule

* set opt profile to max value of the range

* add hash to engine/profile name

* Add calibration based INT8 quantization

* add an option to enable both FP16 and INT8

* Update tensorrt_execution_provider.cc

* add env variable to specify calibration file name

* clean up code

* Add comments and update TRT document

* enable tensorrt basic test and add EngineCachingTest

* clean up

* update envrionment variable in the test

* clean up
2020-11-12 08:56:45 -08:00
..
external Support opset-13 specs of controlflow ops (Loop, If) (#5665) 2020-11-11 23:44:14 -08:00
horovod
patches
tensorboard Introduce training changes. 2020-03-11 14:39:03 -07:00
CMakeLists.txt [OpenVINO-EP] Enabling Multi Device support (#5740) 2020-11-11 15:16:30 -08:00
CMakeSettings.json Fork the WinML APIs into the Microsoft namespace (#3503) 2020-04-17 06:18:54 -07:00
codeconv.runsettings
ConfigureVisualStudioCodeAnalysis.props Initial bootstrap commit. 2018-11-19 16:48:22 -08:00
EnableVisualStudioCodeAnalysis.props Initial bootstrap commit. 2018-11-19 16:48:22 -08:00
flake8.cmake
onnxruntime.cmake ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
onnxruntime_codegen.cmake
onnxruntime_common.cmake Upgrade optional implementation to https://github.com/martinmoene/optional-lite. (#5563) 2020-11-03 15:27:47 -08:00
onnxruntime_config.h.in
onnxruntime_csharp.cmake
onnxruntime_flatbuffers.cmake
onnxruntime_framework.cmake Ryanunderhill/backout 5014 (#5167) 2020-09-14 22:48:00 -07:00
onnxruntime_fuzz_test.cmake
onnxruntime_graph.cmake
onnxruntime_ios.toolchain.cmake
onnxruntime_java.cmake [Android NNAPI EP] Remove dependency on external JD/DNNLibrary (#4576) 2020-07-22 14:08:12 -07:00
onnxruntime_java_unittests.cmake [java] Adds a CUDA test (#3956) 2020-05-18 12:05:51 -07:00
onnxruntime_language_interop_ops.cmake
onnxruntime_mlas.cmake Implement Scale function for quant gemm (#5632) 2020-11-10 23:34:38 -08:00
onnxruntime_nodejs.cmake build: split nodejs binding build and test to avoid timeout issue (#4188) 2020-06-10 19:16:32 -07:00
onnxruntime_nuphar_extern.cmake
onnxruntime_optimizer.cmake [ORT Mobile] file format schema and file I/O code (#4973) 2020-09-01 11:51:31 +10:00
onnxruntime_providers.cmake Improve TensorRT engine caching (#5737) 2020-11-12 08:56:45 -08:00
onnxruntime_pyop.cmake
onnxruntime_python.cmake ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
onnxruntime_session.cmake
onnxruntime_training.cmake ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
onnxruntime_unittests.cmake Revert "Custom Op on GPU (#5620)" 2020-10-30 21:23:51 -07:00
onnxruntime_util.cmake
precompiled_header.cmake Merge windowsai (winml layering) into master (#2956) 2020-02-04 17:12:19 -08:00
protobuf_function.cmake Last major set of ORT format model changes (#5056) 2020-09-05 07:59:01 +10:00
set_winapi_family_desktop.h
store_toolchain.cmake
target_delayload.cmake Use onecore umbrella lib in onecore builds (#5182) 2020-09-16 10:46:27 -07:00
wcos_rules_override.cmake
wil.cmake
winml.cmake
winml_cppwinrt.cmake Add Experimental WinRT API IDL as placeholder for adding new winrt features (#4736) 2020-08-12 12:45:19 -07:00
winml_sdk_helpers.cmake
winml_unittests.cmake