onnxruntime/server
gwang-msft 9e0f5fc7af
The initial PR for NNAPI EP (#4287)
* Move nnapi dnnlib to subfolder

* dnnlib compile settings

* add nnapi buildin build.py

* add onnxruntime_USE_NNAPI_BUILTIN

* compile using onnxruntime_USE_NNAPI_BUILTIN

* remove dnnlib from built in code

* Group onnxruntime_USE_NNAPI_BUILTIN sources

* add file stubs

* java 32bit compile error

* built in nnapi support 5-26

* init working version

* initializer support

* fix crash on free execution

* add dynamic input support

* bug fixes for dynamic input shape, add mul support, working on conv and batchnorm

* Add batchnormalization, add overflow check for int64 attributes

* add global average/max pool and reshape

* minor changes

* minor changes

* add skip relu and options to use different type of memory

* small bug fix for in operator relu

* bug fix for nnapi

* add transpose support, minor bug fix

* Add transpose support

* minor bug fixes, depthwise conv weight fix

* fixed the bug where the onnx model input has mismatch order than the nnapi model input

* add helper to add scalar operand

* add separated opbuilder to handle single operator

* add cast operator

* fixed reshape, moved some logs to verbose

* Add softmax and identity support, change shaper calling signature, and add support for int32 output

* changed the way to execute the NNAPI

* move NNMemory and InputOutputInfo into Model class

* add limited support for input dynamic shape

* add gemm support, fixed crash when allocating big array on stack

* add abs/exp/floor/log/sigmoid/neg/sin/sqrt/tanh support

* better dynamic input shape support;

* add more check for IsOpSupportedImpl, refactored some code

* some code style fix, switch to safeint

* Move opbuilders to a map with single instance, minor bug fixes

* add GetUniqueName for new temp tensors

* change from throw std to ort_throw

* build settings change and 3rd party notice update

* add readme for nnapi_lib, move to ort log, add comments to public functions, clean the code

* add android log sink and more logging changes, add new string for NnApiErrorDescription

* add nnapi execution options/fp16 relax

* fix a dnnlibrary build break

* addressed review comments

* address review comments, changed adding output for subgraph in NnapiExecutionProvider::GetCapability, minor issue fixes

* formatting in build.py

* more formatting fix in build.py, return fail status instead of throw in compute_func

* moved android_log_sink to platform folder, minor coding style changes

* addressed review comments
2020-06-26 00:02:39 -07:00
..
ci Fix ORT server CI build (#4165) 2020-06-15 21:26:19 -07:00
cmake Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
core Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
external Support binding input only for IOBinding in python api. (#4079) 2020-06-25 12:20:02 -07:00
grpc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
http Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
protobuf Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
serializing Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
test Contributing: fix typos (#2905) 2020-01-27 13:39:08 -08:00
CMakeLists.txt The initial PR for NNAPI EP (#4287) 2020-06-26 00:02:39 -07:00
converter.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
converter.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
environment.cc OpenVINO EP v2.0 (#3585) 2020-04-24 04:06:02 -07:00
environment.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
executor.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
executor.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
get_boost.cmake Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
main.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
protobuf_function.cmake Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
server_configuration.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
util.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
util.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00