mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-19 19:00:47 +00:00
* Support to allow user to specify compute stream per session Create computation cuda stream explicitly rather than use default legacy stream or per-thread default stream. remove some redudant cudaStreamSynchronize fix gpt2 model test failures don't use default stream in nccl either. add stream schronization in OnRunEnd() using cub::DeviceScan::InclusiveSum which can be called with stream specified. fix topK failure due to latest rebase fix tensorrt support user specified stream add user_stream support in tensorrt EP use same stream for both tensort and CUDA EP. fix ScatterND specify stream for adasum and p2p kernels. fix loop fix CApiTest.custom_op_handler fix CApiTest.varied_input_custom_op_handler change for cudaMemcpyFromSymbol improve provider options for user specified compute stream * add changes for ROCM EP * fix GatherGrad UT for ROCM EP * clean code and fix NonMaxSuppression * use default stream for ROCM now * fix CApiTest.custom_op_handler:OrtFormatCustomOpTests.ConvertOnnxModelToOrt * fix tensorrt ut: CApiTest.io_binding_cuda Co-authored-by: Weixing Zhang <wezhan@microsoft.com> |
||
|---|---|---|
| .. | ||
| microbenchmark | ||
| callables.h | ||
| callback.cc | ||
| callback.h | ||
| dataitem_request.cc | ||
| dataitem_request.h | ||
| gen_test_models.py | ||
| heap_buffer.cc | ||
| heap_buffer.h | ||
| main.cc | ||
| mem_buffer.h | ||
| onnx_model_info.cc | ||
| onnx_model_info.h | ||
| onnxruntime_event.h | ||
| OrtValueList.h | ||
| pb_helper.cc | ||
| pb_helper.h | ||
| README.txt | ||
| tensorprotoutils.cc | ||
| tensorprotoutils.h | ||
| TestCase.cc | ||
| TestCase.h | ||
| testcase_driver.cc | ||
| testcase_driver.h | ||
| testcase_request.cc | ||
| testcase_request.h | ||
| TestCaseResult.cc | ||
| TestCaseResult.h | ||
| testenv.cc | ||
| testenv.h | ||
| TestResultStat.cc | ||
| TestResultStat.h | ||
onnx_test_runner [options...] <data_root>
Options:
-j [models]: Specifies the number of models to run simultaneously.
-c [runs]: Specifies the number of Session::Run() to invoke simultaneously for each model.
-n [test_case_name]: Specifies a single test case to run.
-p [PLANNER_TYPE]: PLANNER_TYPE could be 'seq' or 'simple'. Default: 'simple'.
-e [EXECUTION_PROVIDER]: EXECUTION_PROVIDER could be 'cpu', 'cuda', 'dnnl', 'tensorrt', 'nuphar' or 'acl'. Default: 'cpu'.
-h: help
The debug version of this program depends on dbghelp.dll. Please make sure it's in your PATH.
How to run node tests:
1. Install onnx from onnxruntime\cmake\external\onnx
2. Execute test data generator:
backend-test-tools generate-data -o <some_empty_folder>
e.g.
backend-test-tools generate-data -o C:\testdata
backend-test-tools is a tool under C:\Python35\Scripts (If your python was installed to C:\Python35)
3. compile onnx_test_runner and run
onnx_test_runner <test_data_dir>
e.g.
onnx_test_runner C:\testdata\node
How to run model tests:
1. Download the test data from Azure
You can get the latest url from tools/ci_build/github/azure-pipelines/templates/set-test-data-variables-step.yml
After downloading, please unzip the downloaded file
2. compile onnx_test_runner and run
onnx_test_runner <test_data_dir>
e.g.
onnx_test_runner C:\testdata