onnxruntime/server
Valery Chernov b327e89efa
Standalone TVM Executor Provider (#10019)
* squashed commit for standalone tvm execution provider

* critical fix for correct python build with stvm ep

* get tuning log file from ep options. It has priority over AUTOTVM_TUNING_LOG

* updates and fixes

* update parsing of stvm provider options

* add support of external data for onnx model

* add conditional dump of subgraphs

* remove unused code

* get input tensor shapes through provider options. get output shapes for fixed input ones by TVM API

* support AUTO_TVM tuning log file inside ORT. Selector for Ansor and Auto_TVM is provider option (tuning_type)

* add fp16

* add functionality of conversion of model layout to NHWC if need. Necessary parameter was added to STVM provider options

* fix license text in header. fix log format

* small fixes

* fix issues from flake8

* remove model proto construction from GetCapability

* reserve memory for vector of DLTensors

* add simple tutorial for STVM EP

* STVM docs

* jroesch/tvm -> apache/tvm

* remove dead code, unneccessary logs and comments

* fix in readme

* improve tutorial notebook

* tvm update

* update STVM_EP.md

* fix default value

* update STVM_EP.md

* some TODOs for the future development

* shorten long lines

* add hyperlink to STVM_EP.md

* fix Linux CI error

* fix error in csharp test

Co-authored-by: Jared Roesch <jroesch@octoml.ai>
Co-authored-by: Valery Chernov <valery.chernov@deelvin.com>
Co-authored-by: KJlaccHoeUM9l <wotpricol@mail.ru>
2021-12-15 16:59:20 -08:00
..
ci
cmake
core
external
grpc
http
protobuf
serializing Remove redundant inline specifiers, sync server IsLittleEndianOrder with runtime core (#9856) 2021-11-29 08:32:16 -08:00
test
CMakeLists.txt Standalone TVM Executor Provider (#10019) 2021-12-15 16:59:20 -08:00
converter.cc
converter.h
environment.cc Standalone TVM Executor Provider (#10019) 2021-12-15 16:59:20 -08:00
environment.h
executor.cc
executor.h
get_boost.cmake fix boost download url (#7843) 2021-05-26 16:08:57 -07:00
main.cc
protobuf_function.cmake
server_configuration.h
util.cc
util.h