Commit graph

624 commits

Author SHA1 Message Date
jignparm
4e3391ef60
Refactor NuGet to allow arbitrary PackageId names (e.g. Microsoft.ML.OnnxRuntime.MKLML) (#797)
* Refactor NuGet to allow arbitrary namespaces

* Move csharp build to end of cmake
2019-04-09 22:48:00 -07:00
Ashwini Khade
e7090d7202
move all removed exp ops to contrib ops (#786)
* move all removed exp ops to contrib ops

* fix cuda build failure

* bug fix

* move some tests to contrib ops + cosmetic changes

* Revert "move some tests to contrib ops + cosmetic changes"

This reverts commit 4cda9297e257a6f6b902724e8113bf5d5a62df29.
2019-04-09 22:26:48 -07:00
Changming Sun
0d4055def4 Integrate tensorflow into onnxruntime_perf_test tool 2019-04-09 15:55:08 -07:00
jignparm
9467c5f967
Update version to 0.3.1 (patch release) (#798)
* bump up version number (#752)

* bump up version number

* Minor change to kick off build

* update version to 0.3.1
2019-04-09 14:48:56 -07:00
Xavier Dupré
ccd7e801a0 Fix #612, TfidfVectorizer handles empty matrices as an input (#702)
* Fix #612, TfidfVectorizer handles empty matrices as an input

* Add more unit tests, better consistency of error messages

* Update tfidfvectorizer.cc

* better comment

* fix comments

* add unit test failure for an empty input {0, 1}
2019-04-09 10:55:24 -07:00
Yufeng Li
39951f35f4
Use template windows-build-tools-setup-steps.yml in win pipelines (#794)
1.  Update nuget restore to 4.3 for capi pipeline
2. Use template windows-build-tools-setup-steps.yml in win piplines.
2019-04-08 21:35:33 -07:00
jywu-msft
d91555f99e
fix for tensorrt_basic_test not being run. (#792) 2019-04-08 13:18:36 -07:00
Hariharan Seshadri
5cf72030b2
Rename misleading test names in ConvTranspose op tests (#788) 2019-04-06 17:01:26 -07:00
jywu-msft
571291c323 build.sh: don't require user to set --use_full_protobuf with --use_tensorrt option. we can set it implicitly. (#780)
* use_full_protobuf if tensorrt build option is enabled.

* update BUILD.md sections on MKLDNN and TensorRT/full_protobuf option
2019-04-06 10:11:57 -07:00
Yufeng Li
cea2a40bf1
Clean up ExecutionProvider in CSharp (#783) 2019-04-05 22:29:54 -07:00
Ryan Hill
fda1d0dce9
Ryanunderhill/ocr custom op (#744)
* Adding a custom op interface to the C API to remove shared library dependency.
* Remove old custom op test
* Rework how custom ops handle inputs/outputs to enable custom op output shape calculation in the compute method
* Add a nicer C++ API for custom ops and switch the tests to use it.
2019-04-05 18:53:20 -07:00
Tao Qin
58ef1306d4
Copy inputs and outputs directly in InferenceSession::SaveModelMetadata (#777)
* Copy required inputs and outputs directly in InferenceSession::SaveModelMetadata

* trivial

* trivial
2019-04-05 15:16:55 -07:00
ybrnathan
3eddb2d61e
Add optimization level as cmd line arguments (#776)
* Add optimization level as cmd line arguments

* fix the help info and add option.
2019-04-05 14:44:28 -07:00
utsabsingharoy
36ed91ee9f CustomRegistry should use composition instead of inheritence
CustomRegistry should use composition instead of inheritence
2019-04-05 14:14:10 -07:00
Changming Sun
867e961ee8 Remove mkldnn_sgemm from math_util.cc
If it is needed, it can be used explicitly in mkldnn provider.
2019-04-05 14:13:10 -07:00
Hariharan Seshadri
ffd9071168
expose graph node name returning non-zero status code (#714)
* Initial commit
2019-04-05 12:50:58 -07:00
Peng Wang (AI FWK)
f4021cf30a fix a minor inaccurate error message 2019-04-05 12:07:28 -07:00
Yufeng Li
ef9a4d98cb
Expose parallel execution option in C# API (#767)
* Expose parallel execution option

* delete unnesary file

* add doc

* update nuget retore to 4.3.0

* resolve comments

* remove unnessary file

* make git ignore csharp/Directory.Build.props

* fix yaml config for nuget 4.3
2019-04-05 12:05:56 -07:00
Changming Sun
43521c0de7 update 2019-04-04 21:22:27 -07:00
Scott McKay
65c50bb25b
Create NodeArg for all initializers if IR version is > 3. (#742)
Previously all initializers had to have matching graph inputs and the NodeArg was guaranteed to be created via graph input processing.
2019-04-05 14:09:27 +10:00
Mika Fischer
2674d9bd8a Fix profiling with C API (#710)
Currently, when using OrtEnableProfiling to enable profiling using the C API,
the profile output file is created but is always empty.

The reason is that InferenceSession::EndProfiling() needs to be called to
write the profiling data to the output file.

However there's currently no way to call this function via the C API.

This adds a call to EndProfiling() to the descructor of the session if
profiling is enabled in the session options.
2019-04-04 16:23:18 -07:00
Raymond Yang
c35d9797d7
Add unique identifier in function subgraph (#771)
* Add unique identifier in function subgraph

* enable test
2019-04-04 13:31:20 -07:00
Changming Sun
289663fd85 reformat onnxruntime_c_api.cc 2019-04-04 13:03:13 -07:00
Changming Sun
290112d614
Update onnx (#761)
* update onnx
2019-04-04 10:58:45 -07:00
Changming Sun
261a9078a5 Remove redundant code in ml::write_scores 2019-04-04 01:21:48 -07:00
Konstantinos Karanasos
512cfdd9fe
Generalize node removal (#743)
Generalize node removal method in graph_utils. This is a higher-level method that keeps the graph consistent so that no Resolve is needed after the removal of a node. 
The new method supports the removal of nodes with a single input (be it an incoming node or an initializer) and a single output (but allowing multiple output edges of that output). It also takes into account the case that one of the output edges is fed to a subgraph.
Also updated the rewrite rules to use this new, less restrictive method, and improved the rules' conditions. Introduced a GraphEdge struct to simplify various methods in graph_utils.
2019-04-03 22:34:20 -07:00
Changming Sun
7af35ac1e6 Fix two warnings in graph lib 2019-04-03 19:41:11 -07:00
Changming Sun
a196085471 Add error messages to FunctionImpl::FunctionImpl 2019-04-03 19:40:49 -07:00
Shawn Callegari
adc00ab5fc ARM32v7 Dockerfile and build instructions update. (#737) 2019-04-03 14:45:24 -07:00
Ashwini Khade
8bc532bfb9 update onnx and add removed experimental ops to contrib ops (#723) 2019-04-02 22:30:00 -07:00
Du Li
6e9ed17adc Fix a shape inference bug for FusedConv and MaxpoolWithMask (#748) 2019-04-02 21:48:06 -07:00
Changming Sun
fc26b24138
onnx_test_runner: use c api for loading non-tensor test data (#751) 2019-04-02 21:47:24 -07:00
Yufeng Li
0cd4a9381c
Handle seqence length == 0 for RNN (#749)
* Handle seqence length == 0 for RNN

* Zero out the output for seq_len=0

* add unit test for rnn seq len equal 0

* minor fix
2019-04-02 20:33:45 -07:00
Ashwini Khade
2dbce4ebcf
csharp api for graph transformers (#741)
* add graph optimization level to csharp api

* format documentation

* changes per review comments
2019-04-02 17:23:14 -07:00
stevenlix
06888437dd Update onnx-tensorrt submodule to master (#753) 2019-04-02 16:34:00 -07:00
jignparm
acc8ac58d2
Fix C-API sample. Update Issue template. (#750)
* Fix C-API sample. Update Issue template.

* switch back to signed int

* update from int to size_t
2019-04-02 13:37:50 -07:00
Hariharan Seshadri
afe3aae29f
Support empty tensor concats in Concat op (#735)
* Concat bug fix

* CUDA concat changes
2019-04-02 11:32:42 -07:00
Rui Xia
7d47cd39b6 Change bind2nd to bind (#747)
`std::bind2nd` is deprecated in C++11 and removed in C++17 (see [MSDN documentation](https://docs.microsoft.com/en-us/cpp/standard-library/functional-functions?view=vs-2017#bind2nd)). Change to `std::bind` with placeholder instead.
2019-04-02 10:46:37 -07:00
Hector Li
b1115f49cd
Update NMS to compatible with both TF & Pytoch models (#636)
* Update NMS to compatible with both TF & Pytoch models

* update text

* set max_output_boxes_per_batch, iou_threshold, score_threshold as optional input to support dynamic value

* fix typo

* Set the last output selected_indices as optional output

* fix shape inference in case the input don't have shape

* Update schema to remove scores & boxes from output. support for class broadcast.

* change max_output_boxes_per_batch to max_output_boxes_per_class

* update schema to remove the class dimension from boxes
2019-04-01 16:08:02 -07:00
Scott McKay
f4b47ad9f6
Move call to log and fmaxf outside of inner loop. (#745) 2019-04-01 15:19:21 +10:00
stevenlix
40839f1f84
Enable multiple session runs for TensorRT (#724)
* Update BUILD.md

* Update README.md

* Update tensorrt_execution_provider.cc

remap node index to handle the case that nodes in graph may be deleted and node index is not continuous.

* Update onnxruntime_providers.cmake

Solve conflicts to onnx-tensorrt

* Update tensorrt_execution_provider.h

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.h

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.h

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update tensorrt_execution_provider.cc

* Update build.py
2019-03-30 11:02:13 -07:00
RandySheriffH
6df54f0285 Eable some onnx test cases (#700) 2019-03-29 10:45:02 -07:00
Mika Fischer
7f96c7f028 Use forward_inference to speed up convolutions with MKLDNN (#731) 2019-03-29 10:42:50 -07:00
Hariharan Seshadri
e6a2bdfacd Handle incorrect perm data in Transpose op gracefully (#739) 2019-03-29 10:42:34 -07:00
Prasanth Pulavarthi
667fa39551 fixing spacing for TensorRT documentation (#645)
* fixing spacing for TensorRT documentation
2019-03-29 00:27:08 -07:00
jignparm
73fc91dc59 Fix preFast native rules warnings (#682)
* Address preFast native rules warnings
2019-03-29 00:26:33 -07:00
Scott McKay
b9b6e3abcb ReverseSequence contrib op (#728) 2019-03-29 00:25:37 -07:00
Hariharan Seshadri
333171f602 Bug fix for Range op (#734) 2019-03-29 00:24:18 -07:00
Ahmad El Husseini
e643ce0e08 Fix inconsistent dimension data type in C-API (#726)
* update dimension type

* update dimension type for items added after 0.2.1

* fix gpu build
2019-03-29 00:23:25 -07:00
Changming Sun
165657ee1a
Refactor the /Qspectre cmake code (#736)
* refactor the /Qspectre cmake code

* Remove /Zi
2019-03-29 00:21:54 -07:00