onnxruntime/include/onnxruntime/core
RandySheriffH d5fcb432fa
Generalize native op creation (#11539)
* create op from ep

* read input count from context

* create holder to host nodes

* fix typo

* cast type before comparison

* throw error on API fail

* silence warning from minimal build

* switch to unique_ptr with deleter to host nodes

* fix typo

* fix build err for minimal

* fix build err for minimal

* add UT for conv

* enable test on CUDA

* add comment

* fix typo

* use gsl::span and string view for Node constructor

* Added two APIs - CopyKernelInfo and ReleaseKernelInfo

* pass gsl::span by value

* switch to span<NodeArg* const> to allow for reference to const containers

* fix typo

* fix reduced build err

* fix reduced build err

* refactoring node construction logic

* rename exceptions

* add input and output count as arguments for op creation

* refactor static member

* use ORT_CATCH instead of catch

* cancel try catch

* add static value name map

* format input definition and set err code

* fix comments

* fix typo
2022-06-27 21:12:15 -07:00
..
common Consolidate several types into onnxruntime::ArgType. (#11430) 2022-05-09 14:44:28 -07:00
eager support register external ep lib information (#8897) 2021-08-31 20:51:22 -07:00
framework Retry Rework execution frame to reduce memory allocations (#11897) 2022-06-20 10:29:43 -07:00
graph Generalize native op creation (#11539) 2022-06-27 21:12:15 -07:00
optimizer Remove ORT_ENABLE_RUNTIME_OPTIMIZATION_IN_MINIMAL_BUILD. (#10778) 2022-03-08 16:18:49 -08:00
platform Allow saving on CPU usage for infrequent inference requests by reducing thread spinning (#11841) 2022-06-23 10:04:37 -07:00
providers Share execution context memory between TensorRT subgraphs (#11859) 2022-06-16 22:42:40 -07:00
session Generalize native op creation (#11539) 2022-06-27 21:12:15 -07:00