onnxruntime/onnxruntime/test/onnx
Edward Chen 0a4d76d98b
MLAS AArch64 quantized int4 Gemm kernel (#18031)
- Implement MLAS function for quantized 4-bit int Gemm (Gemm with float A and quantized 4-bit int B) for ARM NEON. This is an initial implementation. Only the M=1 path (with M being number of rows of A and C) has any optimization attempted so far. More optimization to come in future PRs.

- Connect MatMulNBits contrib op to MLAS function.
2023-11-15 09:31:54 -08:00
..
microbenchmark MLAS AArch64 quantized int4 Gemm kernel (#18031) 2023-11-15 09:31:54 -08:00
callables.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
callback.cc
callback.h
dataitem_request.cc Deprecate CustomApi and refactor public API for better safety and consistency (#13215) 2022-10-06 14:57:37 -07:00
dataitem_request.h Fix SDL warnings in CPU EP (#9975) 2021-12-19 20:54:29 -08:00
gen_test_models.py Introduce float 8 types (#14731) 2023-05-30 13:25:58 -07:00
heap_buffer.cc Change some const to constexpr in unit tests code(#10002) 2021-12-10 12:26:59 -08:00
heap_buffer.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
main.cc [QNN EP] Enable option to set QNN context priority (#18315) 2023-11-08 20:56:36 -08:00
mem_buffer.h
onnx_model_info.cc Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
onnx_model_info.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
onnxruntime_event.h
OrtValueList.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
pb_helper.cc
pb_helper.h [wasm] upgrade emsdk to 3.1.44 (#17069) 2023-08-10 16:08:36 -07:00
README.txt Drop nuphar (#11555) 2022-09-07 15:11:18 -07:00
tensorprotoutils.cc [C#, CPP] Introduce Float16/BFloat16 support and tests for C#, C++ (#16506) 2023-07-14 10:46:52 -07:00
tensorprotoutils.h Enable -Wshorten-64-to-32 warning if available. (#16524) 2023-07-07 08:11:44 -07:00
TestCase.cc implement gridsample 20 (#17744) 2023-11-07 10:42:41 -08:00
TestCase.h Enable onnx_test_runner to run the whole models dir in CI machine (#17863) 2023-10-12 12:01:02 +08:00
testcase_driver.cc Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
testcase_driver.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
testcase_request.cc Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
testcase_request.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
TestCaseResult.cc Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
TestCaseResult.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
testenv.cc Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
testenv.h Stop creating static thread pool to fix random hang in onnx_test_runner (#14023) 2022-12-19 19:48:14 -08:00
TestResultStat.cc Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
TestResultStat.h Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00

onnx_test_runner [options...] <data_root>
Options:
        -j [models]: Specifies the number of models to run simultaneously.
        -c [runs]: Specifies the number of Session::Run() to invoke simultaneously for each model.
        -n [test_case_name]: Specifies a single test case to run.
        -p [PLANNER_TYPE]: PLANNER_TYPE could be 'seq' or 'simple'. Default: 'simple'.
        -e [EXECUTION_PROVIDER]: EXECUTION_PROVIDER could be 'cpu', 'cuda', 'dnnl', 'tensorrt' or 'acl'. Default: 'cpu'.
        -h: help

The debug version of this program depends on dbghelp.dll. Please make sure it's in your PATH.

How to run node tests:
1. Install onnx from onnxruntime\cmake\external\onnx

2. Execute test data generator:
       backend-test-tools generate-data -o <some_empty_folder>
   e.g.
       backend-test-tools generate-data -o C:\testdata
    backend-test-tools is a tool under C:\Python35\Scripts (If your python was installed to C:\Python35)

3. compile onnx_test_runner and run
      onnx_test_runner <test_data_dir>
	e.g.
	  onnx_test_runner C:\testdata\node


How to run model tests:
1. Download the test data from Azure
   You can get the latest url from tools/ci_build/github/azure-pipelines/templates/set-test-data-variables-step.yml
   After downloading, please unzip the downloaded file

2. compile onnx_test_runner and run
   onnx_test_runner <test_data_dir>
   e.g.
	 onnx_test_runner C:\testdata