onnxruntime/server
Valery Chernov b327e89efa
Standalone TVM Executor Provider (#10019)
* squashed commit for standalone tvm execution provider

* critical fix for correct python build with stvm ep

* get tuning log file from ep options. It has priority over AUTOTVM_TUNING_LOG

* updates and fixes

* update parsing of stvm provider options

* add support of external data for onnx model

* add conditional dump of subgraphs

* remove unused code

* get input tensor shapes through provider options. get output shapes for fixed input ones by TVM API

* support AUTO_TVM tuning log file inside ORT. Selector for Ansor and Auto_TVM is provider option (tuning_type)

* add fp16

* add functionality of conversion of model layout to NHWC if need. Necessary parameter was added to STVM provider options

* fix license text in header. fix log format

* small fixes

* fix issues from flake8

* remove model proto construction from GetCapability

* reserve memory for vector of DLTensors

* add simple tutorial for STVM EP

* STVM docs

* jroesch/tvm -> apache/tvm

* remove dead code, unneccessary logs and comments

* fix in readme

* improve tutorial notebook

* tvm update

* update STVM_EP.md

* fix default value

* update STVM_EP.md

* some TODOs for the future development

* shorten long lines

* add hyperlink to STVM_EP.md

* fix Linux CI error

* fix error in csharp test

Co-authored-by: Jared Roesch <jroesch@octoml.ai>
Co-authored-by: Valery Chernov <valery.chernov@deelvin.com>
Co-authored-by: KJlaccHoeUM9l <wotpricol@mail.ru>
2021-12-15 16:59:20 -08:00
..
ci Update ORT server build pipeline (#7030) 2021-03-16 18:02:09 -07:00
cmake Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
core Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
external fix onnx server build failure. (#4347) 2020-06-26 15:15:58 -07:00
grpc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
http Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
protobuf Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
serializing Remove redundant inline specifiers, sync server IsLittleEndianOrder with runtime core (#9856) 2021-11-29 08:32:16 -08:00
test Contributing: fix typos (#2905) 2020-01-27 13:39:08 -08:00
CMakeLists.txt Standalone TVM Executor Provider (#10019) 2021-12-15 16:59:20 -08:00
converter.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
converter.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
environment.cc Standalone TVM Executor Provider (#10019) 2021-12-15 16:59:20 -08:00
environment.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
executor.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
executor.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
get_boost.cmake fix boost download url (#7843) 2021-05-26 16:08:57 -07:00
main.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
protobuf_function.cmake Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
server_configuration.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
util.cc Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00
util.h Split onnxruntime server to a separated folder (#2744) 2019-12-27 11:21:23 -08:00