Commit graph

7863 commits

Author SHA1 Message Date
Scott McKay
f052966972
Remove special casing of "None" as a dim_param (#1482)
* Remove special casing of "None" as a dim_param
2019-07-25 17:18:14 +10:00
Yufeng Li
a8e3ff47fd
Add no scale check for resize and upsample (#1484)
Description: Describe your changes.
Add no scale check for resize and upsample
Motivation and Context

Why is this change required? What problem does it solve?
If it fixes an open issue, please link to the issue here.
2019-07-24 22:29:52 -07:00
shahasad
258ff06e42 Revert "publish nuget package to azure blob (#1309)" (#1485)
This reverts commit 1601650161.
2019-07-24 18:07:33 -07:00
daquexian
ec3c553501 NNAPI EP Update (#1483)
* Update DNNLibrary

* Allow fp16 by default

* Add nnapi build in ci

* Fix nnapi ep after #1268

* Remove unused variables

* Support nnapi in onnx_test_runner

* Update DNNLibrary to fix tests

* Update build.py for android build support, solve conflict of
tools/ci_build/build.py

* Support non-ARM Android build, solve conflict of tools/ci_build/build.py

* Enable android test by x86_64 android emulator

* Add dnnlibrary/NNAPI support in build.py

* suppress the verbose adb output

* Remove debug logs

* Install cmake by pip

* Fix undefined host_protoc_path

* cmake==3.13.2 in pypi is actually 3.12.2, so install 3.13.2.post1 instead

* Fix Android ARM64 build

* Use android ndk r20 instead of r19c, fix conflicts in install_deps_android.sh
2019-07-24 13:20:05 -07:00
avidiyal
c0f927c57c docker updated to support openvino R1.1 (#1475)
* docker updated to support openvino R1.1

* Update README.md

Updated Readme to downlaod openvino R1.1
2019-07-24 13:16:23 -07:00
Changming Sun
91d32c9060
Add docs for the fns candy demo (#1479) 2019-07-24 08:38:04 -07:00
jignparm
a8e9e1878e
Reduce artifacts size (#1477)
* Update wildcard pattern to match only relevant archives

* Update TensorRT build to add CUDA VS extensions
2019-07-23 22:23:51 -07:00
Yufeng Li
bb26865758
Optimize the resize and upsample (#1426)
Description: Describe your changes.
Optimize the resize and upsample operators
Motivation and Context

Why is this change required? What problem does it solve?
For case with input with shape [1,128, 267, 200] and scales [1, 1, 1.97, 2], Resize and upsample get 15x gain (w/o: 1020ms, w: 71ms on my local box). It should benefit other scenarios at similar level.
If it fixes an open issue, please link to the issue here.
2019-07-23 21:39:54 -07:00
Pranav Sharma
4aa4ca1502
Relax shape validation checks. Log a warning instead of returning an error. (#1476)
* Mention OrtCreateSessionFromArray in C API doc

* Relax shape validation checks. Log a warning instead of returning an error.
2019-07-23 18:47:46 -07:00
Hariharan Seshadri
c5f2f0f15b
Upgrade version number for ORT in preparation for release (#1468)
* Update version number to 0.5.0 in preparation for release

* Update to README.md to direct to Versioning doc

* Resolve PR comment

* Remove incorrect line generation

* Minor updates to update version script

* Minor comment update
2019-07-23 16:33:06 -07:00
shahasad
1601650161 publish nuget package to azure blob (#1309) 2019-07-23 11:07:35 -07:00
Changming Sun
be02214a17
Add a comment to onnxruntime_cxx_inline.h (#1466) 2019-07-23 08:45:37 -07:00
jignparm
b41f6eef52 Jignparm/copy cuda extensions (#1462)
* Add CUDA extensions for v 10.0

* Add CUDA extensions for v 10.0

* update path

* change 'vsts' to 'github'
2019-07-22 23:27:48 -07:00
Pranav Sharma
818c023535
Add/correct missing SAL annotations + avoid using unsigned types (except where counts are involved). (#1451)
* Add/correct missing SAL annotations + other cosmetic changes.

* Add Outptr

* Don't use unsigned types
2019-07-22 23:25:53 -07:00
Scott McKay
387d4c72bb
Strip invalid dim_param and dim_value values out. Allow re-use in event of shape mismatch if buffer is large enough (#1439)
* Remove invalid dim_param and dim_value values when creating a NodeArg.
* Allow re-use of a large enough buffer if there's a shape mismatch.
* Update handling in python to treat unset dimension the same as a dim_param (equivalent to None).
* Fix GetTensorShapeFromTensorShapeProto to handle neither dim_param and dim_value being set.
2019-07-23 14:55:54 +10:00
Jesse Benson
bbe92035c6 OStreamSink produces interleaved output due to issuing multiple operator<< calls to the underlying stream. (#1465) 2019-07-23 14:54:24 +10:00
shahasad
768ced703c
Expose provider factory C API, especially for CUDA users (#1461)
Exposed provider factory C API, for cpu and cuda providers, into the published packages.
2019-07-22 19:03:06 -07:00
Hector Li
31838fc9ee
remove const_cast which makes it's not thread safe. (#1463) 2019-07-22 17:55:29 -07:00
Yufeng Li
6be93f11e5
build mklml/ngraph without openmp (#1460)
cleanup the option to build mklml/ngraph without openmp
2019-07-22 16:59:32 -07:00
Faith Xu
1f13a9f982
Update to include more samples (#1381)
* Update to include more samples

* Link fix
2019-07-22 16:48:26 -07:00
Hariharan Seshadri
1fc6f8ee5b
Support double type for a few ops (#1450)
* Initial commit

* More ops

* fix missing declarations for ReduceSum and ReduceSumSquare

* Add tests for new ops supporting double

* isable Add_dobule for OpenVINO EP
2019-07-22 16:44:55 -07:00
Changming Sun
9d67292c8c
Document for the C/C++ samples (#1442)
1. Document for the C/C++ samples.
2. Fix a null pointer errorin the imagenet sample.
2019-07-22 16:14:49 -07:00
Pranav Sharma
29de25c5a7 Mention OrtCreateSessionFromArray in C API doc (#1459) 2019-07-22 15:44:46 -07:00
jywu-msft
a5f57f43c2
fix mkldnn linux build break. (#1458) 2019-07-22 12:22:49 -07:00
Hector Li
f938a6e53a
Add test for LSTM/GRU which has shorter sequence in the middle (#1437)
Add test for LSTM/GRU which has shorter sequence in the middle
2019-07-22 11:42:57 -07:00
Klein Hu
227734139a Fix ORTSRV nightly build (#1440)
* Update the build_dir

* Fix indent in the model_zoo_tests.py

* Remove unnecessary tests in the server build.
2019-07-21 19:12:05 -07:00
kile0
ac25a2643b add VS2019 CMake generator instrs (#1441) 2019-07-20 21:57:10 -07:00
jignparm
2c05291908
Jignparm/patch 0001 (#1419)
* remove extra $ from 8592

* fix
2019-07-20 17:07:56 -07:00
jignparm
1a957e0642
Update C-API packaging pipeline to use CUDa 10 (#1445) 2019-07-20 14:27:43 -07:00
jignparm
9e4ac8c66a
remove mkldnn from gpu nuget package (#1443) 2019-07-20 11:51:00 -07:00
Changming Sun
df3a157dd1
Add noexcept to cxx api (#1448) 2019-07-20 08:33:04 -07:00
Ke Zhang
995ec04c7b
add float support for equal op. (#1449) 2019-07-19 21:28:54 -07:00
Tracy Sharpe
414a07a85b
Support Sum opset6 for ONNX 1.2 models (#1447)
The NCHWc transform was missing support for the Sum_6 operator from ONNX 1.2. Older models would add unnecessary reorder ops and also would not use the Conv/Add fusion.
2019-07-19 20:00:59 -07:00
Ryan Hill
9e2fa69785
Ryanunderhill/c api string arg (#1436)
* Add string attribute interface for C API.

* Add string attribute interface for C++ API accordingly.

* Update comment to say that string is also valid
2019-07-19 19:53:37 -07:00
jywu-msft
f0b9a814e5
fix return of flakey mnist test on gpu. (#1446) 2019-07-19 19:47:32 -07:00
Klein Hu
950b863e22 Update ONNX Runtime Server documents for build and usage. (#1444) 2019-07-19 17:15:00 -07:00
Hariharan Seshadri
e5107fd0cb Support MultiD input data for OneHotEncoder op (#1343)
* Support MultiD input data for OneHotEncoder op

* Fix some nits
2019-07-19 15:32:54 -07:00
Hariharan Seshadri
751ee7bb23
Fix bug in TransformerMemcpy (#1413)
* Initial commit

* Add test case

* Revert unintentional change

* Update comments

* Resolve PR feedback

* Craft test casse and add more logs

* Fix build failures

* Fix minor bug in the way modified is updated

* Remove full model inference session test

* Resolve PR comments

* Resolve more PR feedback

* Resolve more PR feedback

* Resolve more PR comments

* Remove logging

* Move GetInitializer() method to memcpy_transformer scope

* Remove some unnecessary blank lines

* Make GetInitializer static
2019-07-19 13:54:08 -07:00
Pranav Sharma
4cbc6e1cf5
Validate input shapes. (#1352)
* Validate input shapes.

* Cache some input def metadata

* Make some methods const and check for negative values of dims instead of just -1.

* Fix shape inferencing test.

* Fix testLabelEncoder test

* Fix more tests

* Fix more tests

* Use size_t for loop variable
2019-07-19 13:42:34 -07:00
Ke Zhang
638398e675
sync onnx to get equal op with float support (#1432)
* sync onnx to get equal op with float support

* doc update

* fix test failure because of updated shape inference logic for roialign.

* filter consum test cases since it's not implemented yet.
2019-07-19 13:19:09 -07:00
Xavier Dupré
7717ed71a9 Fix for issue #1397, disable onnxruntime_PYBIND_EXPORT_OPSCHEMA is --gen_doc is not set up (#1398) 2019-07-19 11:25:03 -07:00
suryasidd
e9e777925f [OpenVINO-EP] Added support for OpenVINO R1.1 (#1438)
* Initial commit for OpenVINO R1

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Fixed MO dynamic shape error

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Add debug messages for failure

* Update install_openvino.sh script

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Try catch included.  Return type of Isgraphsupported function changed to void

* Removed error_msg variable and commented code

* formatting cleanup

* Added missing return statement

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Changed MO to be compatible with both R5 and R1

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Updated docker scripts to include openvino version number

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Ignore compiler warnings from external headers

* Updated dockerfiles

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Code cleanup using clang-format

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Suppress model optimizer info error

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Python code formatting using auto pep8

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Updated documentation

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
2019-07-19 00:52:15 -07:00
Sreekanth Yalachigere
f3c74ec3e9 Reduce memory footprint of MKL-DNN EP (#1429)
* MKL-DNN EP memory fix patch

* Call default provider for Opset10

* opset 10 fix

* removed email header from patch

* UseSubgraph method refactored
2019-07-18 22:57:00 -07:00
Yulong Wang
887930e6c2 inference overheads optimizations (#1392)
This change makes some optimizations on various places. This change consists of a part of PR #1240 (removed the problematic part) and some other trivial fix.

1. reduce unnecessary copy when constructing vector or objects that contains vector as member. use std::move when applicable.
2. use std::vector<std::reference_wrapper<const TensorShape>> instead of std::vector<TensorShape>, when it is only for constant reference usage.
3. calculate key BEFORE (instead of AFTER) acquire lock in SessionState::GetMemoryPatternGroup
other trivial fixes (code should be straightforward and self-explainable).
2019-07-18 19:40:48 -07:00
Tracy Sharpe
07ecd59e8f flatten conv2d when input_width==kernel_width (#1435) 2019-07-18 19:11:45 -07:00
Yuan Yu
c843c393e4 More code cleanup (#1406)
* more cleanup

* More cleanup

* fix build break.

* update
2019-07-18 18:21:16 -07:00
daquexian
bbf64c2c45 Update cgmanifest.json and ThirdPartyNotices.txt for DNNLibrary (#1431) 2019-07-18 14:58:43 -07:00
kile0
7a681fb964 Improve build throughput and enable using the Visual Studio 2019 cmake generator (#1411) 2019-07-18 11:43:11 -07:00
Colin Versteeg
5ee0f185dc Add GRPC support to ONNX Runtime Server (#1144)
* add grpc

* add-submodule

* Revert "add-submodule"

This reverts commit e35994b25035ce310a98909658582bff759ee358.

* fix submodule

* IT BUILDS

* Initial commit of prediction_service_impl.cpp

* Server builds and runs!

* add request id, health and reflection. GRPC is done

* enable channelz for monitoring

* GRPC unit tests

* clang format

* add unit tests

* Add function tests for GRPC

* add grpc to model_zoo_tests

* revert update protobuf to 3.7.0

* update submodules

* builds but runs some gflags tests which fail

* get build working

* confine build changes to onnxruntime_server.cmake

* update build files

* code reveiw comments

* Maik's code review comments

* update cares version to fix compilation issue

* update build to fix c-ares

* code review comments

* update cgmanifest.json

* remove extraneous file

* Klein comments.

* update ci based on discussions for go dependency

* fix tag issue

* fix build issues

* remove stray submodule

* update dockerfile and build script

* dynamic linking changes

* update build script

* code review comments

* update dockerfile

* update script for mount

* code review comments
2019-07-18 11:10:38 -07:00
Yufeng Li
6c41809655
Build Shared Library with cuda 10.1 (#1418)
Description: Describe your changes.
Change the logic to find cublas dll
Motivation and Context
Why is this change required? What problem does it solve?
The name pattern of cublas changed since 10.1. It doesn't include minor version in its name anymore.
If it fixes an open issue, please link to the issue here.
2019-07-18 09:51:19 -07:00