* OpSet 11 Update for Neg Axis:
scan, flatten, compress, concat, gather, slice, split, squeeze, unsqueeze
* fix flatten op test
* Fix flatten and Squeeze
* fix test cases
* add gather neg indices to both cpu and cuda
* Exclude nGraph from neg axis test
* re-enable test cases
* Fix test cases
Fix a bug in Concat when only part of input has sympy_data
Fix a bug in ConstantOfShape when shape is scalar
Add support for GatherElements and ScatterElements
* Added support for Hetero plugin
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Fixed spelling error in cmake for hetero plugin
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Added listener to print messages from the plugin
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Updated Documentation for VAD-F enablement
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Added VAD-F option for FPGA
*Disabled unit tests and backed tests because FPGA only accepts NCHW models
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Added comment for why tests need to be disabled on VAD-F
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* call MLAS's pooling function as an external call for Nuphar
Note that at the moment Nuphar provider doesn't handle the cases below:
- symbolic height/weight dimensions
- Indices output of MaxPool
- non-default dilations
* unify the pool interface for mti and mti_x86
* Changed ConvBase into a class member variable
Currently, all Conv-family classes inherit from both ConvBase
and OpKernel. Since what ConvBase provides is all about
processing convolution attributes, it's more natural to move it as
a class member variable.
This change renamed ConvBase to ConvAttributes and moved
it into a separate file conv_attributes by its own. Instead of
inheriting from ConvBase, now each Conv-related class has a
class member variable that is of type ConvAttributes.
Hence, we removed unecessary multiple inheritance and increase
composibility. More importantly, the change made it possible for
some other providers such as Nuphar be able to re-use the functionalities
provided by ConvAttributes class.
Note that we also made similar changes to ConvTransposeBase.
* fixed cuda build issue
* Add CumSum and Round for Opset 11
* add back 1 test
* Add back one broken test
* Add back more broken tests
* activate cumsum, round, dynamicquantizelinear tests
* removed python backend tests
* re-comment out dynamicquantizelinear_* tests. ReduceMin(11) not implemented yet
* re-comment out dynamicquantizelinear_* tests. ReduceMin(11) not implemented yet
* comment out cumsum_1d_reverse_exclusive
* Remove few types for csum. Keep only float, int32, int64
* Added friendly error message
* Added double type to pass ONNX tests.
* Don't return shape for non-const initializer in InferenceContextImpl::getInputType
Don't return initializer for non-const initializer in InferenceContextImpl::getInputData
Update graph_utils to support these scenarios
- fix GetConstantInitializer to make sure a name is for an outer scope value before checking a parent graph, as local name could shadow an outer scope initializer.
* call MLAS's pooling function as an external call for Nuphar
Note that at the moment Nuphar provider doesn't handle the cases below:
- symbolic height/weight dimensions
- Indices output of MaxPool
- non-default dilations
* unify the pool interface for mti and mti_x86
* Address two issues:
Thread-safety issue with LTSM/RNN running lambda in parallel
Propagate lambda exceptions and report them when running in
parallel.
Refactor cpu provider's pool ops by extracting pooling attributes
into a separate helper class PoolAttributes. With this change,
other providers such as Nuphar can re-use the same routines
for processing pooling attributes. This refactorying doesn't
have any functional changes.
* add ctor overloads that accept model byte array
* doxygen. mark Init method as private.
* doxygen
* rename test method for clarity
* PR feedback - add two overloads that accept either model path or model byte array
* update native signature to align with latest codebase
* fix native call
Fix issue #1591
Root Cause:
CUDA Equal Greater Less do not support multi-directional broadcast
Fix:
Add code to support the multi-directional broadcast
Also add tests to cover more cases.
* Mention OrtCreateSessionFromArray in C API doc
* Add C API for free dim override
* Add C API for free dim override, fix missing API mention in InferenceTest.cs, fix confusing print statement in perf_test.
* Remaining C#files
* fix c# build
* Run the tests in blame mode. This option is helpful in isolating a problematic test causing the test host to crash.
* fix order
* Avoid variable length stack array variables for VC++ compatibility
Use dynamically allocated arrays or vectors instead.
* windows enabling
* openvino windows build
* Update build instructions
* resolve conflicts for PR
* remove debug messages from cmake
* PR fix for window support
