mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-18 18:52:16 +00:00
|
|
||
|---|---|---|
| .. | ||
| microbenchmark | ||
| callables.h | ||
| callback.cc | ||
| callback.h | ||
| dataitem_request.cc | ||
| dataitem_request.h | ||
| gen_test_models.py | ||
| heap_buffer.cc | ||
| heap_buffer.h | ||
| main.cc | ||
| mem_buffer.h | ||
| onnx_model_info.cc | ||
| onnx_model_info.h | ||
| onnxruntime_event.h | ||
| OrtValueList.h | ||
| pb_helper.cc | ||
| pb_helper.h | ||
| README.txt | ||
| tensorprotoutils.cc | ||
| tensorprotoutils.h | ||
| TestCase.cc | ||
| TestCase.h | ||
| testcase_driver.cc | ||
| testcase_driver.h | ||
| testcase_request.cc | ||
| testcase_request.h | ||
| TestCaseResult.cc | ||
| TestCaseResult.h | ||
| testenv.cc | ||
| testenv.h | ||
| TestResultStat.cc | ||
| TestResultStat.h | ||
onnx_test_runner [options...] <data_root>
Options:
-j [models]: Specifies the number of models to run simultaneously.
-c [runs]: Specifies the number of Session::Run() to invoke simultaneously for each model.
-n [test_case_name]: Specifies a single test case to run.
-p [PLANNER_TYPE]: PLANNER_TYPE could be 'seq' or 'simple'. Default: 'simple'.
-e [EXECUTION_PROVIDER]: EXECUTION_PROVIDER could be 'cpu', 'cuda', 'dnnl', 'tensorrt', 'nuphar' or 'acl'. Default: 'cpu'.
-h: help
The debug version of this program depends on dbghelp.dll. Please make sure it's in your PATH.
How to run node tests:
1. Install onnx from onnxruntime\cmake\external\onnx
2. Execute test data generator:
backend-test-tools generate-data -o <some_empty_folder>
e.g.
backend-test-tools generate-data -o C:\testdata
backend-test-tools is a tool under C:\Python35\Scripts (If your python was installed to C:\Python35)
3. compile onnx_test_runner and run
onnx_test_runner <test_data_dir>
e.g.
onnx_test_runner C:\testdata\node
How to run model tests:
1. Download the test data from Azure
You can get the latest url from tools/ci_build/github/azure-pipelines/templates/set-test-data-variables-step.yml
After downloading, please unzip the downloaded file
2. compile onnx_test_runner and run
onnx_test_runner <test_data_dir>
e.g.
onnx_test_runner C:\testdata