Weixing Zhang 299ace0759 Support to allow user to specify compute stream per session (#3723) ... * Support to allow user to specify compute stream per session Create computation cuda stream explicitly rather than use default legacy stream or per-thread default stream. remove some redudant cudaStreamSynchronize fix gpt2 model test failures don't use default stream in nccl either. add stream schronization in OnRunEnd() using cub::DeviceScan::InclusiveSum which can be called with stream specified. fix topK failure due to latest rebase fix tensorrt support user specified stream add user_stream support in tensorrt EP use same stream for both tensort and CUDA EP. fix ScatterND specify stream for adasum and p2p kernels. fix loop fix CApiTest.custom_op_handler fix CApiTest.varied_input_custom_op_handler change for cudaMemcpyFromSymbol improve provider options for user specified compute stream * add changes for ROCM EP * fix GatherGrad UT for ROCM EP * clean code and fix NonMaxSuppression * use default stream for ROCM now * fix CApiTest.custom_op_handler:OrtFormatCustomOpTests.ConvertOnnxModelToOrt * fix tensorrt ut: CApiTest.io_binding_cuda Co-authored-by: Weixing Zhang <wezhan@microsoft.com>		2021-02-05 15:48:18 -08:00
..
cuda_ops.cu	Enable varied input type for custom op (#6066)	2020-12-09 15:10:42 -08:00
fns_candy_style_transfer.c
onnx_protobuf.h
test_allocator.cc
test_fixture.h
test_inference.cc	Support to allow user to specify compute stream per session (#3723)	2021-02-05 15:48:18 -08:00
test_io_types.cc
test_model_loading.cc	Last major set of ORT format model changes (#5056)	2020-09-05 07:59:01 +10:00
test_nontensor_types.cc	Cosmetic change in non tensor tests (#5317)	2020-09-28 21:23:30 -07:00
test_ort_format_models.cc	Add support for custom ops to minimal build. (#6228)	2021-01-25 10:41:00 +10:00
test_run_options.cc
test_session_options.cc	Add a generic collection of session configurations to the SessionOptions (#4718)	2020-08-18 13:40:40 -07:00
utils.cc	Support to allow user to specify compute stream per session (#3723)	2021-02-05 15:48:18 -08:00
utils.h	Add support for custom ops to minimal build. (#6228)	2021-01-25 10:41:00 +10:00