onnxruntime/onnxruntime
Maajid khan ddf83d1ace
Maajid/multi threading 2 (#5568)
* Enabled multi-threading for OpenVino EP

->Enabled support for concurrent_session_runs

*Run UEP using concurrent_session_runs > 1
*Enabled support for ORT_PARALLEL ExecutionMode

->Documentation Added for Enabling MultiThreading

Signed-off-by: MaajidKhan <n.maajidkhan@gmail.com>

* Minor Fixes added
*Configure the value of nireq during Runtime
*Documentation typos rectified and details
added for Multi_Threaded Inference

Signed-off-by: MaajidKhan <n.maajidkhan@gmail.com>

* Some checks added for this fix
*Added checks to invalidate wrong nireq value
and assigned it to default value of 8
*Added new config options for enable_vpu_fast_compile
which were changed w.r.t OpenVINO_2021.1 Release

Signed-off-by: MaajidKhan <n.maajidkhan@gmail.com>
2020-10-27 14:48:12 -07:00
..
contrib_ops GatherGrad optimization (#5524) 2020-10-26 12:53:53 -07:00
core Maajid/multi threading 2 (#5568) 2020-10-27 14:48:12 -07:00
featurizers_ops/cpu
gsl
python Maajid/multi threading 2 (#5568) 2020-10-27 14:48:12 -07:00
test Maajid/multi threading 2 (#5568) 2020-10-27 14:48:12 -07:00
tool/etw Add option ORT_NO_EXCEPTIONS to disable most exception/throw in /onnxruntime/ (#4894) 2020-08-28 23:03:51 -07:00
.style.yapf
__init__.py [C# and Python APIs] Expose knobs to enable/disable platform telemetry collection (#5481) 2020-10-21 10:32:13 -07:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings