onnxruntime/onnxruntime/test/onnx
Changming Sun a2feb29b0d
Fix build break (#3528)
Ignore some known test failures
Install ONNX package before running Windows CI builds
2020-04-14 18:07:56 -07:00
..
microbenchmark Thread pool changes (#3153) 2020-03-30 12:18:40 -07:00
callback.cc Fix perf test executable. (#1598) 2019-08-12 09:49:29 -07:00
callback.h Fix perf test executable. (#1598) 2019-08-12 09:49:29 -07:00
FixedCountFinishCallback.h Use nsync for implementing condition variable 2019-01-21 22:59:42 -08:00
gen_test_models.py Rework CDist (#3393) 2020-04-09 14:05:25 +10:00
heap_buffer.cc Fix perf test executable. (#1598) 2019-08-12 09:49:29 -07:00
heap_buffer.h Fix perf test executable. (#1598) 2019-08-12 09:49:29 -07:00
main.cc Fix build break (#3528) 2020-04-14 18:07:56 -07:00
mem_buffer.h Rename OrtAllocatorInfo to OrtMemoryInfo to make it more obvious. (#1758) 2019-09-05 14:20:37 -07:00
onnxruntime_event.h Use nsync for implementing condition variable 2019-01-21 22:59:42 -08:00
OrtValueList.h Move CXX API global into the header (#2228) 2019-10-23 14:15:53 -07:00
pb_helper.cc Fix some warnings on Windows (#2560) 2020-01-22 15:59:11 -08:00
pb_helper.h Fix some warnings on Windows (#2560) 2020-01-22 15:59:11 -08:00
README.txt Renaming MKL-DNN as DNNL (#2515) 2019-12-03 07:34:23 -08:00
runner.cc Move path_lib from onnxruntime/core/framework to onnxruntime/core/platform. (#3253) 2020-03-18 11:53:46 -07:00
runner.h Update protobuf to 3.11.2 (#1928) 2019-12-27 18:28:18 -08:00
sync_api.cc Replace GSL with GSL-LITE submodule and fix up refs (#1920) 2019-10-01 12:43:29 -07:00
sync_api.h Use Eigen ThreadPool in OnnxRuntime (#323) 2019-01-15 15:19:30 -08:00
tensorprotoutils.cc Add SafeInt bounds checking to memory allocation size calculations. (#3022) 2020-02-20 11:41:03 -08:00
tensorprotoutils.h Fix perf test executable. (#1598) 2019-08-12 09:49:29 -07:00
TestCase.cc Move path_lib from onnxruntime/core/framework to onnxruntime/core/platform. (#3253) 2020-03-18 11:53:46 -07:00
TestCase.h Move path_lib from onnxruntime/core/framework to onnxruntime/core/platform. (#3253) 2020-03-18 11:53:46 -07:00
TestCaseResult.cc
TestCaseResult.h
testenv.cc C++ wrapper for ABI (#958) 2019-05-03 19:32:46 -07:00
testenv.h C++ wrapper for ABI (#958) 2019-05-03 19:32:46 -07:00
TestResultStat.cc Exclude test by onnx version tag (#1073) 2019-05-30 16:19:06 -07:00
TestResultStat.h add immutable exclude list (#1181) 2019-06-10 17:32:42 -07:00

onnx_test_runner [options...] <data_root>
Options:
        -j [models]: Specifies the number of models to run simultaneously.
        -c [runs]: Specifies the number of Session::Run() to invoke simultaneously for each model.
        -n [test_case_name]: Specifies a single test case to run.
        -p [PLANNER_TYPE]: PLANNER_TYPE could be 'seq' or 'simple'. Default: 'simple'.
        -e [EXECUTION_PROVIDER]: EXECUTION_PROVIDER could be 'cpu', 'cuda', 'dnnl', 'tensorrt', 'ngraph', 'nuphar' or 'acl'. Default: 'cpu'.
        -h: help

The debug version of this program depends on dbghelp.dll. Please make sure it's in your PATH.

How to run node tests:
1. Install onnx from onnxruntime\cmake\external\onnx

2. Execute test data generator:
       backend-test-tools generate-data -o <some_empty_folder>
   e.g.
       backend-test-tools generate-data -o C:\testdata
    backend-test-tools is a tool under C:\Python35\Scripts (If your python was installed to C:\Python35)

3. compile onnx_test_runner and run
      onnx_test_runner <test_data_dir>
	e.g.
	  onnx_test_runner C:\testdata\node


How to run model tests:
1. Download the test data from Azure
   You can get the latest url from tools/ci_build/github/azure-pipelines/templates/set-test-data-variables-step.yml
   After downloading, please unzip the downloaded file

2. compile onnx_test_runner and run
   onnx_test_runner <test_data_dir>
   e.g.
	 onnx_test_runner C:\testdata