Commit graph

836 commits

Author SHA1 Message Date
jignparm
2cf56639ed
Minor update to NuGet package tests -- allow model download in separate step (#1115)
* Update docker scripts to not fetch model data

* Update related files
2019-05-28 03:01:10 -07:00
Scott McKay
b9e8aac5f6 Enable some more tests (#1101)
Restructure a little so permanently disabled tests are clearer.
2019-05-25 08:41:42 -07:00
Ryan Hill
8808efd9e3 Add zero size check before setting thread pool so that the zero default value won't cause a failure. (#1109) 2019-05-24 23:27:36 -07:00
Scott McKay
f6df36b68b
Add rewrite rule to handle Relu + Clip (#1105)
* Remove Relu if followed by Clip. Update Clip 'min' if necessary.
Add unit test.

* Rename to match behaviour a little better.

* Update to match latest RewriteRule interface
2019-05-24 19:42:02 -07:00
Klein Hu
b54a292ba2 Add version and latest commit id to ONNX Runtime Server (#1078)
* Add version and latest commit id to ORT Server

* Update cmake

* Change build id to build number

* Use target_compile_definitions instead of add_definitions
2019-05-24 17:30:40 -07:00
daquexian
ea29a664cd Fix android build when API<23, fix android test, update build doc and pipeline (#884) 2019-05-24 16:26:32 -07:00
stevenlix
2d92b95729
Enable Unsqueeze elimination (#1104) 2019-05-24 16:15:42 -07:00
Konstantinos Karanasos
ee6217972b
Fix when rewrite rule gets registered to multiple op types; update constness of rule methods; enable dropout elimination (#1098) 2019-05-24 13:47:55 -07:00
Ryan Hill
9129a652c5
Ryanunderhill/cxx api2 (#1091)
More C++ API improvements and cleanup
Add templates to tensor creation
Add run method that allows preallocated outputs
Simplify CreateTensor<T> to multiply by sizeof(T)
Convert io_types code
Optimize away vector copies in Session::Run
2019-05-24 11:15:51 -07:00
stevenlix
723d5c782a
Improve TensorRT GetCapability to Enable More Models (#1012)
* Improve TensorRT GetCapability Accuracy

* Update onnxruntime_providers.cmake

* made changes based on feedback

* update unit tests for TensorRT

* update onnx-tensorrt submodule to v5.0 branch

* remove uncessary comments

* convert int32 to int64 at inferencing output

* add more data types in compute

* change returns in compute

* use StatusCode as return in compute
2019-05-24 10:12:55 -07:00
KeDengMS
b44a30bca7 CUDA CPU/GPU sync optimization (#1100)
* CUDA CPU/GPU sync optimization

Even though CUDA device is capable of handling certain ops, it may be better to leave them on CPU especially for dynamic shape computations starting from Shape.

* Fix TensorRT test crash when fused graph may have null node in topological sort
2019-05-24 09:25:48 -07:00
KeDengMS
cd9b9e6102
Accelerate CUDA transpose (#1102)
For NCHW <-> NHWC and 2D case
2019-05-23 21:10:50 -07:00
R. G. Esteves
f4a9ccae99 Enable nGraph Debug ci test. (#1000)
* Enable nGraph Debug ci test.

* nGraph doesn't work with stack trace.

* Fix corrupt patch.
2019-05-23 19:58:35 -07:00
Scott McKay
4a8d75386b
Clarify/state expected usage of non-const references and 'auto' in coding conventions (#1096)
* As we consistently use non-const reference for modifiable arguments that cannot be null, update the conventions to reflect that.

Add a note on qualifying 'auto' to make the intent clearer and it easier to notice accidental copies.

* Address PR comment by adding a statement around disabling copy/assignment/move for new classes until needed.
2019-05-23 19:28:01 -07:00
Pranav Sharma
11243253f2
Disable mvn model test when contrib ops are disabled since this model uses a contrib op (#1097) 2019-05-23 17:01:35 -07:00
Scott McKay
c7d1c007d5
Fix accidental copy where a reference was fine. (#1090)
Clarify a couple of other uses of 'auto'
2019-05-23 16:47:30 -07:00
Scott McKay
0157b6c209
Enable specifying tests for onnx_backend_test_series.py to run via the command line (#1099)
* onnx_backend_test_series.py update to allow specifying a single test to run.

The python unittest filtering is to a test method not test name so can't be used directly.

* Clarify help message.
2019-05-23 16:45:27 -07:00
ybrnathan
7421755198
Optimize ExecutionFrame to avoid mem re-allocation. (#1085) 2019-05-23 10:59:36 -07:00
Changming Sun
055f5af78d
Remove path change in build.py (#1089)
First, we don't need this line of code.
Second, it may change path unintentionally. That, you want to use gcc from /usr/lib/ccache/gcc, but cmake pickup it from /usr/bin.
2019-05-23 10:48:25 -07:00
KeDengMS
d865d34968
Fix CUDA crash in fast RCNN model (#1092)
It seems this model triggers a bug in thrust::fill when size is 300, replacing with a CUDA kernel.
2019-05-23 10:33:01 -07:00
Zhang Lei
2a07dc2fbf Add provider information for kernel in perf test. (#1082) 2019-05-22 21:35:11 -07:00
Bowen Bao
a6a4fef677
Support both Scalar tensor and 1-d tensor for Loop iter/cond input (#1052)
The shape of Loop inputs M and cond, according to below, could either be a scalar(rank 0), or a 1-d tensor(rank 1), and depending on the actual rank it may produce different outputs for subsequent nodes such as Gather. Thus ORT Loop operator cannot hard code these inputs to be rank 1. This PR also include some fixes for test failures caused by updating Conv shape inferences in ONNX(onnx/onnx#1988).

        .Input(
            0,
            "M",
            "A maximum trip-count for the loop specified at runtime. Optional."
            " Pass empty string to skip.",
            "I",
            OpSchema::Optional)
        .Input(
            1,
            "cond",
            "A boolean termination condition. Optional. Pass empty string to skip.",
            "B",
            OpSchema::Optional)
...
        .TypeConstraint(
            "I",
            {"tensor(int64)"},
            "tensor of int64, which should be a scalar.")
        .TypeConstraint(
            "B",
            {"tensor(bool)"},
            "tensor of bool, which should be a scalar.")
2019-05-22 16:13:01 -07:00
jignparm
376a8240ac
Add x86 legs to CI builds (#1005)
* add x86 legs to ci

* minor update

* update platform from x86 to Win32

* remove --use_mklml from x86 build

* add win x64 mklml pipeline

* remove pybind and use_tvm from win x86

* Add build pipelines for --disable_contrib_ops (mac, lnx, win)

* remove --gen-doc generation for x86

* set environment variables during build to disablecontribops=on

* update to match aiinfra pipelines

* update test data url

* update mac pipeline test data

* remove gen_doc from win x64 leg

* update model files for nocontribops

* reset win-ci-pipeline.yml

* remove confidential models
2019-05-22 14:08:28 -07:00
Scott McKay
602028ef19
Remove tests from exclusion list (#1077)
* 3 stale tests were removed from ONNX. Remove them from the list of broken tests that we ignored.

ab52a5d31e

* Also remove some exclude tests that now psas
2019-05-22 12:31:08 -07:00
Pranav Sharma
bc01f7b16f
Ensure the Eigen code that is getting #included is licensed under the MPL2 and possibly more permissive licenses (like BSD). (#1076) 2019-05-22 09:58:06 -07:00
Changming Sun
9f79ff52ba update nuget version (#1075) 2019-05-21 22:47:06 -07:00
jignparm
9673f3d494
Jignparm/minor update linux test (#1074)
* Minor update for pipeline tests

* uncomment data download
2019-05-21 19:32:29 -07:00
Vinitra Swamy
c7cb0c052d
Add the onnx inference on AKS (Azure ML) notebook from //build (#1071) 2019-05-21 17:39:20 -07:00
Dmitri Smirnov
c124f7e81c
Uncomment mvn test. (#1072) 2019-05-21 16:43:39 -07:00
Xavier Dupré
2e01018e33
Fixes #1007, base_value in TreeEnsembleClassifier (#1015)
* Fixes #1007, wrong output when base_value is not empty
2019-05-22 00:05:24 +02:00
Changming Sun
c1b2bd937c
Add -M and -A arg to onnxruntime_perf_test (#1070)
* Add -M and -A arg to onnxruntime_perf_test
2019-05-21 14:26:37 -07:00
Changming Sun
bf6f19c6b7
Use auto when possible (#1058)
* Use auto when possible, for address the review comments in #1051
2019-05-21 11:38:21 -07:00
Changming Sun
15561581f9
Change the INCLUDE path for gemmlowp (#1066)
Remove '..' from INCLUDE PATH.
2019-05-21 11:34:41 -07:00
Tao Qin
64aa55eac8
Re-order InferenceSession::session_state_ in the member declaration (#1068)
* Re-order InferenceSession::session_state_ in the member declaration

* fix initialization list
2019-05-21 11:31:20 -07:00
Bowen Bao
a42222f9de
bump onnx version & fix conv/pool tests (#1067) 2019-05-21 09:52:41 -07:00
Dmitri Smirnov
3209204ef2 Uncomment tests. (#1069) 2019-05-21 09:11:47 -07:00
Klein Hu
2ad626752a Use local ort python package in server model tests (#1027)
* Use local ort python package in server model tests

* Create symlink for onnxruntime during test

* Using generated _pb2.py in the build folder

* Generate onnx_ml_pb2.py from ONNX CMakeList.txt

* Update model tests for python package path

* Only use onnx python package from build

* Revert some changes for pb2.py generation
2019-05-20 18:40:52 -07:00
jignparm
32da12491d
x86 support for C# API (#962)
* Refactor C# to handle x86

* update run script

* Add Native win x86 tests

* Add native x86 tests for Linux

* Update linux tests scripts to control which tests are run

* update linux image name for x86 to prevent using cached image

* update to not run unit python unit tests unless pybind is specified

* remove --build_wheel as a core common arg. Python cannot run on x86 build

* update OrtGetNumOfDimensions to OrtGetDimensionsCount in rest of C#
2019-05-20 15:48:14 -07:00
Ryan Hill
3a32b0eb99
Change function kernels to use CustomOp APIs (#1020)
* Change function signature
* Convert compute to use custom op style APIs
* Remove dead CustomOp function
* Use CustomOp API in TensorRT EP
* Switch to new API in ngraph
2019-05-20 14:57:43 -07:00
jywu-msft
7763f62a09
fix ngraph build (#1062)
* fix ngraph due to incompatibility with PR1019

* temp disable onnx backend test test_operator_repeat_dim_overflow_cpu due to failure in ngraph ep

* disable tiny_yolov2 for ngraph

* temporarily disable operator_repeat_dim_overflow for ngraph due to graph resolve failure
2019-05-18 09:21:59 -07:00
Dmitri Smirnov
58d9f6a145 Enable greater/less tests. (#1061) 2019-05-17 21:15:12 -07:00
Yufeng Li
f90bd234ff
fix warning in scatter op (#1054) 2019-05-17 17:15:44 -07:00
Doris Xin
fd5eb3b351 Remove dropout nodes during inference (#1018)
* initial version. there's a bug

* allow nodes with multiple outputs to be removed if only one output is used by downstream ops

* move node output checks into their own methods

* add test data file

* address comments by @kkaranasos and @skottmckay

* address more comments by @kkaranasos

* a comment to clarify the position of the mask output
2019-05-17 15:05:36 -07:00
Changming Sun
2663b9c443
Remove unnecessary casts from OrtValue to MLValue(#1051) 2019-05-17 07:52:59 -07:00
Ke Zhang
a7039601c4
setting input/output for partitioned function subgraph (#1019)
* setting input/output for partitioned function subgraph

* fixed TensorRT related failure

* fix failures for tvm and ngraph

* update
2019-05-17 11:19:28 +08:00
jignparm
11069765dc
Fix C-API sample (causing internal build failure (#1047) 2019-05-16 15:49:39 -07:00
Changming Sun
99556b111d
Make MemPatternPlanner on/off switchable in model weight loading (#989) 2019-05-16 14:39:09 -07:00
Changming Sun
7bce377113
Fix LTO build failure on ubuntu (#1048)
* Fix LTO build failure on ubuntu
2019-05-16 14:06:38 -07:00
Darío Hereñú
2324f65a22 Fixed typo on paragraph 14 (#997) 2019-05-16 11:30:36 -07:00
Changming Sun
e4225f8234
Combine OrtValue and MLValue into one type (#1043)
* Combine OrtValue and MLValue into one type
2019-05-16 10:22:49 -07:00