1. use MlasErf for Gelu. Eigen's erf is very slow.
2. change the ErfUpperAbsRange to 3.925 because MlasErf doesn't return 1 for 3.725
Motivation and Context
* Add Unique operator.
* Enable onnx tests. Disable one with incorrect expected output and add unit test to validate ORT behavior. Need onnx update to fix (will address that separately but don't want to block this checkin on that change).
* Added Scatter and ScatterElements to Nuphar
Implemented Scatter (op_ver 9 - 10) and ScatterElements (op_ver 11)
nuphar.
Because TVM's compute is output-oriented, our current implementation
uses extern calls for simplicity.
* fixed build issue after rebase
* remove dead code
* Address CR
* removed dead code
* use GetAttrOrDefault
* Address more CR feedback
* add GetStrides to codegen/common/utils.h
* added a unit test for Bool input data
* Gelu contrib op & transformer
* Gelu kernels for CPU&cuda
* Merged PR 5034: fix a condition for gelu transformer
The ONNX models doesn't guarantee to assign an unique name to each node, so the previous condition could fail.
(cherry picked from commit e335ef5466444cb0aae45f885ea3a825ed9f1088)
* Fix builds
* remove useless comments
* fix test failure when nocontribp
* Move impelmentation under KMSdomain
* fix comments
* fix linux build
* Fix few comments
* fix linux build
* Update Cast op to use precision of 8 when casting floating point numbers to strings. This matches numpy precision.
Update unit tests to include non-trivial floats in the input.
Update onnx test infrastructure to document why the test cases are disabled
* py fallback initial commit.
* fixes.
* update NGRAPHCustomOp::Initialize() to return Status
* fixes in session.py
* FAIL status to EP_FAIL in ngraph custom op
* disable fallback for backend api
Remove gsl subodule and replace with a local copy of gsl-lite
Refactor for onnxruntime::make_unique
gsl::span size and index are now size_t
Remove lambda auto argument type detection.
Remove constexpr from fail_fast in gsl due to Linux not being happy.
Comment out std::stream support due to MacOS std lib broken.
Move make_unique into include/core/common so it is accessible for server builds.
Relax requirements for onnxruntime/test/providers/cpu/ml/write_scores_test.cc
due to x86 build.
Add ONNXRUNTIME_ROOT to Server Lib includes so gsl is recognized
* Update ops that had strides/dilations documentation updates to default to 1.
Code was already doing this.
Add tests to explicilty test.
* Update optimizers to add opset 11 support where possible
* Fixed a bug of missing tvm in python wheel
* Put Nuphar Python scripts into wheel
* Add note book tutorial
* Some improvements in symbolic shape inference for quantized models
* OpSet 11 Update for Neg Axis:
scan, flatten, compress, concat, gather, slice, split, squeeze, unsqueeze
* fix flatten op test
* Fix flatten and Squeeze
* fix test cases
* add gather neg indices to both cpu and cuda
* Exclude nGraph from neg axis test
* re-enable test cases
* Fix test cases
Fix a bug in Concat when only part of input has sympy_data
Fix a bug in ConstantOfShape when shape is scalar
Add support for GatherElements and ScatterElements
* Added support for Hetero plugin
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Fixed spelling error in cmake for hetero plugin
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Added listener to print messages from the plugin
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Updated Documentation for VAD-F enablement
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Added VAD-F option for FPGA
*Disabled unit tests and backed tests because FPGA only accepts NCHW models
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* Added comment for why tests need to be disabled on VAD-F
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
* call MLAS's pooling function as an external call for Nuphar
Note that at the moment Nuphar provider doesn't handle the cases below:
- symbolic height/weight dimensions
- Indices output of MaxPool
- non-default dilations
* unify the pool interface for mti and mti_x86
