Commit graph

1043 commits

Author SHA1 Message Date
Hariharan Seshadri
1fc6f8ee5b
Support double type for a few ops (#1450)
* Initial commit

* More ops

* fix missing declarations for ReduceSum and ReduceSumSquare

* Add tests for new ops supporting double

* isable Add_dobule for OpenVINO EP
2019-07-22 16:44:55 -07:00
Changming Sun
9d67292c8c
Document for the C/C++ samples (#1442)
1. Document for the C/C++ samples.
2. Fix a null pointer errorin the imagenet sample.
2019-07-22 16:14:49 -07:00
Pranav Sharma
29de25c5a7 Mention OrtCreateSessionFromArray in C API doc (#1459) 2019-07-22 15:44:46 -07:00
jywu-msft
a5f57f43c2
fix mkldnn linux build break. (#1458) 2019-07-22 12:22:49 -07:00
Hector Li
f938a6e53a
Add test for LSTM/GRU which has shorter sequence in the middle (#1437)
Add test for LSTM/GRU which has shorter sequence in the middle
2019-07-22 11:42:57 -07:00
Klein Hu
227734139a Fix ORTSRV nightly build (#1440)
* Update the build_dir

* Fix indent in the model_zoo_tests.py

* Remove unnecessary tests in the server build.
2019-07-21 19:12:05 -07:00
kile0
ac25a2643b add VS2019 CMake generator instrs (#1441) 2019-07-20 21:57:10 -07:00
jignparm
2c05291908
Jignparm/patch 0001 (#1419)
* remove extra $ from 8592

* fix
2019-07-20 17:07:56 -07:00
jignparm
1a957e0642
Update C-API packaging pipeline to use CUDa 10 (#1445) 2019-07-20 14:27:43 -07:00
jignparm
9e4ac8c66a
remove mkldnn from gpu nuget package (#1443) 2019-07-20 11:51:00 -07:00
Changming Sun
df3a157dd1
Add noexcept to cxx api (#1448) 2019-07-20 08:33:04 -07:00
Ke Zhang
995ec04c7b
add float support for equal op. (#1449) 2019-07-19 21:28:54 -07:00
Tracy Sharpe
414a07a85b
Support Sum opset6 for ONNX 1.2 models (#1447)
The NCHWc transform was missing support for the Sum_6 operator from ONNX 1.2. Older models would add unnecessary reorder ops and also would not use the Conv/Add fusion.
2019-07-19 20:00:59 -07:00
Ryan Hill
9e2fa69785
Ryanunderhill/c api string arg (#1436)
* Add string attribute interface for C API.

* Add string attribute interface for C++ API accordingly.

* Update comment to say that string is also valid
2019-07-19 19:53:37 -07:00
jywu-msft
f0b9a814e5
fix return of flakey mnist test on gpu. (#1446) 2019-07-19 19:47:32 -07:00
Klein Hu
950b863e22 Update ONNX Runtime Server documents for build and usage. (#1444) 2019-07-19 17:15:00 -07:00
Hariharan Seshadri
e5107fd0cb Support MultiD input data for OneHotEncoder op (#1343)
* Support MultiD input data for OneHotEncoder op

* Fix some nits
2019-07-19 15:32:54 -07:00
Hariharan Seshadri
751ee7bb23
Fix bug in TransformerMemcpy (#1413)
* Initial commit

* Add test case

* Revert unintentional change

* Update comments

* Resolve PR feedback

* Craft test casse and add more logs

* Fix build failures

* Fix minor bug in the way modified is updated

* Remove full model inference session test

* Resolve PR comments

* Resolve more PR feedback

* Resolve more PR feedback

* Resolve more PR comments

* Remove logging

* Move GetInitializer() method to memcpy_transformer scope

* Remove some unnecessary blank lines

* Make GetInitializer static
2019-07-19 13:54:08 -07:00
Pranav Sharma
4cbc6e1cf5
Validate input shapes. (#1352)
* Validate input shapes.

* Cache some input def metadata

* Make some methods const and check for negative values of dims instead of just -1.

* Fix shape inferencing test.

* Fix testLabelEncoder test

* Fix more tests

* Fix more tests

* Use size_t for loop variable
2019-07-19 13:42:34 -07:00
Ke Zhang
638398e675
sync onnx to get equal op with float support (#1432)
* sync onnx to get equal op with float support

* doc update

* fix test failure because of updated shape inference logic for roialign.

* filter consum test cases since it's not implemented yet.
2019-07-19 13:19:09 -07:00
Xavier Dupré
7717ed71a9 Fix for issue #1397, disable onnxruntime_PYBIND_EXPORT_OPSCHEMA is --gen_doc is not set up (#1398) 2019-07-19 11:25:03 -07:00
suryasidd
e9e777925f [OpenVINO-EP] Added support for OpenVINO R1.1 (#1438)
* Initial commit for OpenVINO R1

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Fixed MO dynamic shape error

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Add debug messages for failure

* Update install_openvino.sh script

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Try catch included.  Return type of Isgraphsupported function changed to void

* Removed error_msg variable and commented code

* formatting cleanup

* Added missing return statement

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Changed MO to be compatible with both R5 and R1

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Updated docker scripts to include openvino version number

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Ignore compiler warnings from external headers

* Updated dockerfiles

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Code cleanup using clang-format

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Suppress model optimizer info error

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Python code formatting using auto pep8

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Updated documentation

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
2019-07-19 00:52:15 -07:00
Sreekanth Yalachigere
f3c74ec3e9 Reduce memory footprint of MKL-DNN EP (#1429)
* MKL-DNN EP memory fix patch

* Call default provider for Opset10

* opset 10 fix

* removed email header from patch

* UseSubgraph method refactored
2019-07-18 22:57:00 -07:00
Yulong Wang
887930e6c2 inference overheads optimizations (#1392)
This change makes some optimizations on various places. This change consists of a part of PR #1240 (removed the problematic part) and some other trivial fix.

1. reduce unnecessary copy when constructing vector or objects that contains vector as member. use std::move when applicable.
2. use std::vector<std::reference_wrapper<const TensorShape>> instead of std::vector<TensorShape>, when it is only for constant reference usage.
3. calculate key BEFORE (instead of AFTER) acquire lock in SessionState::GetMemoryPatternGroup
other trivial fixes (code should be straightforward and self-explainable).
2019-07-18 19:40:48 -07:00
Tracy Sharpe
07ecd59e8f flatten conv2d when input_width==kernel_width (#1435) 2019-07-18 19:11:45 -07:00
Yuan Yu
c843c393e4 More code cleanup (#1406)
* more cleanup

* More cleanup

* fix build break.

* update
2019-07-18 18:21:16 -07:00
daquexian
bbf64c2c45 Update cgmanifest.json and ThirdPartyNotices.txt for DNNLibrary (#1431) 2019-07-18 14:58:43 -07:00
kile0
7a681fb964 Improve build throughput and enable using the Visual Studio 2019 cmake generator (#1411) 2019-07-18 11:43:11 -07:00
Colin Versteeg
5ee0f185dc Add GRPC support to ONNX Runtime Server (#1144)
* add grpc

* add-submodule

* Revert "add-submodule"

This reverts commit e35994b25035ce310a98909658582bff759ee358.

* fix submodule

* IT BUILDS

* Initial commit of prediction_service_impl.cpp

* Server builds and runs!

* add request id, health and reflection. GRPC is done

* enable channelz for monitoring

* GRPC unit tests

* clang format

* add unit tests

* Add function tests for GRPC

* add grpc to model_zoo_tests

* revert update protobuf to 3.7.0

* update submodules

* builds but runs some gflags tests which fail

* get build working

* confine build changes to onnxruntime_server.cmake

* update build files

* code reveiw comments

* Maik's code review comments

* update cares version to fix compilation issue

* update build to fix c-ares

* code review comments

* update cgmanifest.json

* remove extraneous file

* Klein comments.

* update ci based on discussions for go dependency

* fix tag issue

* fix build issues

* remove stray submodule

* update dockerfile and build script

* dynamic linking changes

* update build script

* code review comments

* update dockerfile

* update script for mount

* code review comments
2019-07-18 11:10:38 -07:00
Yufeng Li
6c41809655
Build Shared Library with cuda 10.1 (#1418)
Description: Describe your changes.
Change the logic to find cublas dll
Motivation and Context
Why is this change required? What problem does it solve?
The name pattern of cublas changed since 10.1. It doesn't include minor version in its name anymore.
If it fixes an open issue, please link to the issue here.
2019-07-18 09:51:19 -07:00
Yufeng Li
02ded802ab
cleanup more useless unique_ptr (#1427) 2019-07-18 09:50:48 -07:00
Hector Li
1ff957f96e
CUDNN_RNN_DATA_LAYOUT_SEQ_MAJOR_UNPACKED works with CUDNN_RNN_PADDED_… (#1428)
CUDNN_RNN_DATA_LAYOUT_SEQ_MAJOR_UNPACKED works with CUDNN_RNN_PADDED_IO_ENABLED, so that it will auto fill 0 for the shorter sequences.
2019-07-18 09:17:44 -07:00
Ke Zhang
f720166887
register gpu data transfer only when there's nvidia gpu related eps. (#1420) 2019-07-17 21:12:18 -07:00
Chris Seymour
db61eb4cd7 Update ONNX_Runtime_Perf_Tuning.md (#1378) 2019-07-17 19:14:43 -07:00
Tracy Sharpe
f47f6fd020
Fix MaxPool when using dilation > 1 plus non-zero padding (#1320)
MaxPool with dilation > 1 and padding did not compute the correct start index. Added code to fix and test cases to cover this.
2019-07-17 17:33:29 -07:00
Changming Sun
fbdd905440
Switch some of the linux pipelines to use the new data download script (#1379) 2019-07-17 16:06:02 -07:00
avidiyal
859a57d781 Updated Dockerfile for OpenvinoEP (#1362)
* Updated Dockerfile for OpenvinoEP

Signed-off-by: avidiyal <akhila.vidiyala@intel.com>

* Changed the license

Signed-off-by: avidiyal <akhila.vidiyala@intel.com>

* resolving conflicts

* Reviews fixed
2019-07-17 14:52:59 -07:00
Yuan Yu
93fb62bb3e More code cleanup (#1405)
* More code cleanup

* More cleanup
2019-07-17 14:45:50 -07:00
Yufeng Li
a7b1a8969c
simply nocontribops-ci and fix build break (#1422)
simply nocontribops-ci and fix build break
2019-07-17 13:43:40 -07:00
Tracy Sharpe
4383615cf6
implement conv+clip fusion (#1412)
This change implements Conv+Clip activation fusion for FusedConv and NCHWc convolutions. The Clip operation runs in the thread context that is producing the convolution output.
2019-07-17 12:16:45 -07:00
suryasidd
d2cc086bee [OpenVINO EP] Minor bug fixes (#1388)
* Minor bug fixes for accelerators

* Added dimensionality checks for each graph input for GPU

* Disabled some tests for MYRAID and GPU

* This change is required for running some of the models on
  OpenVINO instead of falling back to default CPU EP

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* PR Feedback

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Fix missing bracket

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
2019-07-17 10:48:54 -07:00
R. G. Esteves
8720fe62e3 Added missing libraries to Windows wheel (#1415) 2019-07-17 05:54:09 -07:00
Changming Sun
c2aa2056b5
Sample for imagenet and batch prediction (#1372)
* Sample for imagenet and batch prediction
(Will add a readme later)
2019-07-16 14:23:45 -07:00
Changming Sun
d38badffdb Disable mklml in Windows Build 2019-07-16 11:09:17 -07:00
Raymond Yang
a203077dcd
Relax timeout in CI system (#1394)
* Relax timeout in CI system (temporary)

* Relax timeout on TensorRT pipeline
2019-07-15 15:10:08 -07:00
Scott McKay
07a2466d9f
Use INFO instead of WARNING for an unused graph input. (#1235)
* Use INFO instead of WARNING for an unused graph input.

* Drop severity of unused initializer as well

* Update to output a warning level message if removing an initializer that is never used, and an info level message if removing an initializer that optimization has made redundant.
2019-07-15 20:29:30 +10:00
Yang Chen
fa4b956f12
replace onnx:: with ONNX_NAMESPACE:: (#1376)
* replace onnx:: with ONNX_NAMESPACE::

* Fixed issue for building shared libs

* address CR feedback

* address more CR feedback
2019-07-15 01:06:53 -07:00
Scott McKay
61b733ce6d
Update optimizers to be able to utilize a constant initializer from an ancestor graph (#1346)
* Now that we check for a constant initializer in an ancestor graph we also need to be able to retrieve and replace that initializer.
Add helpers to do so.
Update optimizers to use the new helpers.
Fix bug in UnsqueezeElimination where it wasn't checking if the initializer it was replacing was constant.
2019-07-15 12:41:01 +10:00
Tracy Sharpe
d4ce31ea6d cleanup fused conv activation handling (#1403)
* cleanup fused conv activation handling

* fix build break

* fix mkldnn build break
2019-07-14 16:34:16 -07:00
Yuan Yu
c139e3ab33 Remove a few useless unique_ptrs (#1401) 2019-07-13 16:15:29 -07:00