saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-13 18:08:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/onnxruntime/python
History
Weixing Zhang 299ace0759
Support to allow user to specify compute stream per session (#3723) 
* Support to allow user to specify compute stream per session

Create computation cuda stream explicitly rather than use default legacy stream or per-thread default stream.

remove some redudant cudaStreamSynchronize

fix gpt2 model test failures

don't use default stream in nccl either.

add stream schronization in OnRunEnd()

using cub::DeviceScan::InclusiveSum which can be called with stream specified.

fix topK failure due to latest rebase

fix tensorrt

support user specified stream

add user_stream support in tensorrt EP

use same stream for both tensort and CUDA EP.

fix ScatterND

specify stream for adasum and p2p kernels.

fix loop

fix CApiTest.custom_op_handler

fix CApiTest.varied_input_custom_op_handler

change for cudaMemcpyFromSymbol

improve provider options for user specified compute stream

* add changes for ROCM EP

* fix GatherGrad UT for ROCM EP

* clean code and fix NonMaxSuppression

* use default stream for ROCM now

* fix CApiTest.custom_op_handler:OrtFormatCustomOpTests.ConvertOnnxModelToOrt

* fix tensorrt ut: CApiTest.io_binding_cuda

Co-authored-by: Weixing Zhang <wezhan@microsoft.com>
2021-02-05 15:48:18 -08:00
..
backend fix py packaging pipeline (#5038) 2020-09-03 09:32:10 -07:00
datasets replace invalid sample (#4567) 2020-07-21 23:51:17 -07:00
tools Lochi/refactor yolov3 quantization (#6290) 2021-01-29 19:28:09 -08:00
training Enable running PEP8 on python scripts using flake8 (#3928) 2020-05-15 07:15:06 +10:00
__init__.py Enable running PEP8 on python scripts using flake8 (#3928) 2020-05-15 07:15:06 +10:00
_ld_preload.py Enable running PEP8 on python scripts using flake8 (#3928) 2020-05-15 07:15:06 +10:00
_pybind_state.py Remove python 3.8 Windows GPU build from python packaging pipeline (#6054) 2020-12-07 10:23:07 -08:00
exported_symbols.lst Initial bootstrap commit. 2018-11-19 16:48:22 -08:00
onnxruntime_inference_collection.py Deprecate Python global configuration functions [Part 2] (#6171) 2021-01-07 10:10:55 -08:00
onnxruntime_pybind_exceptions.h refactor frontend (#3235) 2020-03-19 20:59:41 -07:00
onnxruntime_pybind_mlvalue.cc Support sharing of initializers between session via the Python API (#5407) 2020-10-09 20:26:28 -07:00
onnxruntime_pybind_mlvalue.h Support sharing of initializers between session via the Python API (#5407) 2020-10-09 20:26:28 -07:00
onnxruntime_pybind_state.cc Support to allow user to specify compute stream per session (#3723) 2021-02-05 15:48:18 -08:00
onnxruntime_pybind_state_common.cc Enable passing initial optimizer state while creating training session (#5869) 2020-12-08 21:20:51 -05:00
onnxruntime_pybind_state_common.h Deprecate Python global configuration functions [Part 2] (#6171) 2021-01-07 10:10:55 -08:00
onnxruntime_validation.py Enable running PEP8 on python scripts using flake8 (#3928) 2020-05-15 07:15:06 +10:00
pybind.def Fix a build warning in onnxruntime python extension (#416) 2019-02-01 00:19:41 -08:00
version_script.lds Initial bootstrap commit. 2018-11-19 16:48:22 -08:00