saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-16 21:00:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
2497 commits 2856 branches 57 tags 1.3 GiB
Commit graph

2497 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ori Levari
6d2d927809
add test to api tests to ensure correct hresult is returned for corrupt model file (#3796) 
Co-authored-by: Ori Levari <orlevari@microsoft.com>
 2020-05-11 13:22:22 -07:00
Sheil Kumar
c7da194313
remove winrt (#3899) 
Co-authored-by: Sheil Kumar <sheilk@microsoft.com>
 2020-05-11 10:47:07 -07:00
Prabhat
ce3678ffaf
Added aarch64 build pipeline (#3841) 
* Added aarch64 build pipeline

* Fix build error

* Remove auditwheel repair which doesn't work with cross compiling

* Statically link C++

* Added auditwheel repair back and fix stdlib.h

* Remove extra space
 2020-05-11 22:56:16 +05:30
Scott McKay
d7e39569da
Use MlasComputeSoftmax in traditional ML ops (#3892) 
* Use MlasSoftmax in ML ops

* Refine when mlas is used based on perf testing.
 2020-05-11 16:28:59 +10:00
Hariharan Seshadri
06985a9922
Stop proceeding with constant folding if a CPU kernel is not found found (#3836) 
* Stop proceeding with constant folding if a CPU kernel is not found for a node

* Fix build

* PR feedback

* Fix typo

* Refine

* Remove unnecessary header inclusion

* Refine

* Fix build

* More changes

* More changes

* More changes

* Fix CentOS build
 2020-05-10 19:08:37 -07:00
Ryan Lai
7fd2c8f9e8
Add signed GPU nuget package to publish ort-nightly nuget feed (#3834) 
* Add signed nuget package to publish ort-nightly nuget feed

* Push managed nuget as well

* Indentation fix

* Indentation fix

* Update gpu.yml to also publish directml nuget

* Fix typo in naming of task
 2020-05-10 16:24:45 -07:00
M. Zeeshan Siddiqui
5e1244eb4d
Update ONNX submodule to ONNX 1.7 release branch. (#3888) 
* Update to ONNX submodule to ONNX 1.7 release branch.

* Update to ONNX submodule to ONNX 1.7 release branch.

* fix version.
 2020-05-10 15:44:44 -07:00
ytaous
96030fdcbc
dashboard integration - output training perf metrics as json (#3809) 
* dashboard integration - first phase

* change a field

* perf scripts

* addressing PR comments

* address comments and fix build

* minor

* make GetConfigFromData() const

* more update for comments

* addressing comments

* more on addressing comments

* minor

* fix build

* add condition check

* more on comments

* retrun status

* remove batch size

* on comments

* rename pkg path

* rename pkg path

* additional commentss

Co-authored-by: Ethan Tao <ettao@microsoft.com>
 2020-05-10 10:29:38 -07:00
M. Zeeshan Siddiqui
8291065e20
Re-enable Dropout(12) ONNX inferencing tests. (#3833) 
* Re-enable disabled Dropout(12) inferencing tests.

* Re-enable disabled Dropout(12) inferencing tests.

* Disable Dropout(12) tests that return boolean value on NGraph EP.
 2020-05-10 06:26:01 -07:00
M. Zeeshan Siddiqui
eb33d5eda9
Do not register Dropout(12) as training ONLY kernel. (#3859) 
* Do not register Dropout(12) as training ONLY kernel.

* Move Dropout forward implementation in inference project.

* fix inference build test failures.

* remove fp16 test since its support is absent on CPU.

* build break.
 2020-05-09 21:38:17 -07:00
Ryan Hill
408f62dd57
Load provider shared libraries relative to core runtime executable (#3884) 
* Load provider DLL relative to core runtime executable
* Use LoadLibraryEx to fix dependent DLL loading
* Fix custom op DLL loading path issue.
 2020-05-09 20:49:15 -07:00
Vincent Wang
3c24841569
Fold Shape Node During Constant Folding (#3748) 
* Fold Shape node in constant folding.

* bugfix

* Fix test failure.

* Bugfix for C++ frontend.

* Bugfix for C++ frontend.

Co-authored-by: Vincent Wang <weicwang@microsoft.com>
 2020-05-09 20:15:03 +08:00
Sheil Kumar
890c945d4c
winml_is_inbox is not accessible in function scope, move it out. (#3886) 
Co-authored-by: Sheil Kumar <sheilk@microsoft.com>
 2020-05-09 00:23:59 -07:00
George Wu
672e40bac2
fix dnnl ep shared lib python packaging. (#3875) 2020-05-08 17:11:29 -07:00
George Wu
93e39b81a7
fix build break on Linux. (#3874) 2020-05-08 17:11:03 -07:00
Sheil Kumar
cf6a1c1715
Fix Windows Inbox build failing on 1) building raw api tests and 2) referencing _winml namespace in onnxruntime.dll (#3872) 
* add build inbox flag

* remove raw tests and wstring for utf filenames

* enable raw tests

* use ToWideString

* create new utf8 helper

* update string helper to utf8

Co-authored-by: Sheil Kumar <sheilk@microsoft.com>
 2020-05-08 15:59:16 -07:00
Pranav Sharma
22a711457f
Fix C# log APIs. Also fixes github issue #3409. (#3840) 
* Fix C# log APIs. Fixes github issue #3409.

* Fix build error due to accidental duplication of GraphOptimizationLevel

* Fix runoptions

* Fix broken test. Add --blame switch to dotnet test cmd line to print the failed test in case of crash.
 2020-05-08 14:31:06 -07:00
Ye Wang
a9b43b05cb
Support more types in MurmurhashOp (#3827) 
* support more types for MurmurhashOp

* resolve comments

* fix comments
 2020-05-07 20:43:11 -07:00
Tracy Sharpe
19e3dc47d7
LSTM performance tweak + cleanup (#3868) 
* avoid unneeded buffer zeroing; includes cleanup

* fix includes
 2020-05-07 19:41:52 -07:00
Hariharan Seshadri
fe5a20f2d1
Fix initial value of graph optimization (#3856) 2020-05-07 18:41:29 -07:00
Tiago Koji Castro Shibata
eb7486d632
WinML Adapter DMLEP tests (#3752) 
* Add DML EP tests

* wip

* Fix DmlCopyTensor

* Cleanup

* Remove leaks in AdapterDmlEpTest

* Fix rebase conflicts

* Move GPUTEST macro to tests instead of suite setup

* Address PR feedback
 2020-05-07 16:25:41 -07:00
Sheil Kumar
e981496cf7
add build inbox flag (#3855) 
Co-authored-by: Sheil Kumar <sheilk@microsoft.com>
 2020-05-07 15:52:43 -07:00
ashbhandare
424a00bf04
Fix enabling gradient as output for easy mode. (#3866) 2020-05-07 15:07:14 -07:00
stevenlix
4ea10c9202
bump up ORT version and extend time limit for windows cpu packaging pipelines (#3852) 2020-05-07 14:22:20 -07:00
Tracy Sharpe
cb554fbc2d
MLAS: Add MlasComputeSoftmax/MlasComputeExp (#3846) 
* add MlasComputeSoftmax

* fix onnxruntime_mlas_test DLLs

* remove unneeded header

* remove unneeded header

* call MlasComputeExp

* call MlasComputeSoftmax

* call MlasComputeSoftmax

* finish off

* fix static analysis warning
 2020-05-07 14:02:01 -07:00
liuziyue
914aaaa1c8
Fuse Attention For One Input bert-base-dynamic Model (#3850) 
match additional mask path for attention
 2020-05-07 13:40:28 -07:00
Tiago Koji Castro Shibata
43b87de7d1
Support wide char paths in CreateModel (#3835) 
* Support wide char paths in CreateModel

* Use UTF-8 in WinML adapter API
 2020-05-07 13:32:19 -07:00
Ryan Hill
3bafc096bb
Fast exit workaround for dnnl test. (#3863) 2020-05-07 11:23:40 -07:00
Wei-Sheng Chin
0aeb383273
Support Pipeline in Training Runner (#3770) 2020-05-06 21:03:36 -07:00
Vincent Wang
c222ed6327
Optimize Where CUDA kernel for UniLMV2. (#3799) 
Co-authored-by: Vincent Wang <weicwang@OrtDevTest2v100.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
 2020-05-07 10:23:54 +08:00
Yulong Wang
65bfece19d
[Node.js API] optimize prebuild (#3844) 
* optimize prebuild

* fix base folder for prepack

* bump dev version
 2020-05-06 15:48:13 -07:00
Faith Xu
9cca219b1a
Add FAQ page (#3324) 
* Create FAQ.md

* Update README.md

* Update README.md

* Update FAQ.md

* Minor update

* Resync readme page from master

* Update structure and wordings

* Minor update

* Updates based on feedback

* Fix links

* Update to include common perf questions

* Update ONNX_Runtime_Perf_Tuning.md

* Update FAQ.md

* Update README.md

* Update FAQ.md

* Update docs/ONNX_Runtime_Perf_Tuning.md

Co-Authored-By: Nat Kershaw (MSFT) <nakersha@microsoft.com>

* Update docs/ONNX_Runtime_Perf_Tuning.md

Co-Authored-By: Nat Kershaw (MSFT) <nakersha@microsoft.com>

* Update docs/ONNX_Runtime_Perf_Tuning.md

Co-Authored-By: Nat Kershaw (MSFT) <nakersha@microsoft.com>

* Update docs/ONNX_Runtime_Perf_Tuning.md

Co-Authored-By: Nat Kershaw (MSFT) <nakersha@microsoft.com>

* Update ONNX_Runtime_Perf_Tuning.md

* Update FAQ.md

* Update README.md

* Update FAQ.md

Co-authored-by: Nat Kershaw (MSFT) <nakersha@microsoft.com>
 2020-05-06 15:43:32 -07:00
Xueyun Zhu
0e59668c1b
add support for symbolic broadcast for Add/Sub/Mul (#3743) 
* add support for symbolic broadcast

* fix comment

* address feedback
 2020-05-06 10:40:57 -07:00
Scott McKay
687edd702c
Add RelWithDebInfo target to the C# projects so that it correctly finds the native build. (#3839) 
Make the cmake file slightly more consistent for the build c# flag.
 2020-05-06 20:01:04 +10:00
Adam Pocock
d38b79c6e5
[Java] Adding missing methods on Session, SessionOptions and RunOptions (v2) (#3832) 
* java - adding support for custom op libraries.

* Adding support for RunOptions and additional methods for SessionOptions and OrtSession.

As a result OrtEnvironment.LoggingLevel moved to be a top level enum
called OrtLoggingLevel.

* java - adding unit tests for RunOptions and SessionOptions.

* java - removing unused releaseNamesHandle method

* java - add test for custom op library.

* java - adding log verbosity methods, and tests for the same.

* java - fixes for custom op loading test on Windows.

* Cleanup after rebase on master.
 2020-05-06 01:19:46 -07:00
Ryan Hill
d5ec353e58
Ryanunderhill/mkldnn dll (#3314) 
First version of allowing providers to work as DLLs, only implemented for DNNL so far.

More improvements to come next!
 2020-05-06 00:57:09 -07:00
M. Zeeshan Siddiqui
9b02b3df6f
Update ONNX submodule to ONNX 1.7 release candidate 3. (#3838) 2020-05-06 00:55:19 -07:00
Hariharan Seshadri
b45ce92542
Fix 3828 (#3837) 2020-05-06 00:05:15 -07:00
Changming Sun
f0c9fbc051
MaxpoolWithMask (#3831) 2020-05-05 22:19:35 -07:00
airockchip
edaf8a542c
Initial PR for RKNPU execution provider (#3609) 
* Initial RKNPU execution provider

    * Init

    * Support Ops:
        Conv, Relu, Clip, LeakyRelu,
        MaxPool, AveragePool, GlobalAveragePool,
        Concat, Softmax, BatchNormalization, Gemm,
        Add, Mul, Sub,
        Reshape, Squeeze, Unsqueeze,
        Flatten, Transpose,
        QLinearConv, DequantizeLinear

    * Add rknpu unittest

    * Update BUILD.md and Add RKNPU-ExecutionProvider.md

* misc code update

* fix CLIP accuracy issue.

* fix "Error: Duplicate definition of name".

* move rknpu_ddk out of onnxruntime submodule.

* remove temporary code.

* add rknpu namespace.

* update misc of node_attr_helper

* add const & comment for onnx_converter

* add const & comment for shaper

* unify variable name

Co-authored-by: dkm <dkm@rock-chips.com>
Co-authored-by: George Wu <jywu@microsoft.com>
 2020-05-05 20:36:47 -07:00
Tianlei Wu
584facf830
Fix build error when DEBUG_NODE_INPUTS_OUTPUTS is on (#3826) 2020-05-05 16:52:33 -07:00
liuziyue
6e341c002f
Add Epsilon Attribute to Skip and Embed Layer Normalization (#3768) 
* add epsilon to SkipLayerNormalization and EmbedLayerNormalization
 2020-05-05 16:36:26 -07:00
Pranav Sharma
e30d2e38b9
Add guidelines for writing a good PR. (#3830) 2020-05-05 16:28:21 -07:00
M. Zeeshan Siddiqui
ef4d73e887
Update ONNX submodule to ONNX 1.7 release candidate 2. (#3818) 
* Update ONNX submodule to ONNX 1.7 release candidate 2.

* fix build error.

* Update ONNX submodule to latest and disable preview op tests.
 2020-05-05 15:08:40 -07:00
Dmitri Smirnov
5db30a470e
[Java] Tidying up the sample MNIST code (#3824) 
* Updating the Java sample to load MNIST in libsvm format.
* java - code formatting fix.
Co-authored-by: Adam Pocock <adam.pocock@oracle.com>
 2020-05-05 14:34:13 -07:00
Bowen Bao
f7ff5a7aa1
Fix state_dict and save_as_onnx for training (#3774) 2020-05-05 11:47:46 -07:00
Yulong Wang
5dfc91db51
Node.js binding for ONNX Runtime (#3613) 
* initial commit for Node.js binding

* add c++ code

* add inference session impl

* e2e working

* add settings.json

* add test data

* adjust binding declaration

* refine tensor constructor declaration

* update tests

* enable onnx tests

* simply refine readme

* refine cpp impl

* refine tests

* formatting

* add linting

* move bin folder

* fix linux build

* manually update test filter list

* update C++ API headers: fix crash in release build

* make (manually) prebuild work

* add test into prepack script

* specify prebuild runtime type (N-API)

* build.ts: update rebuild and include regex

* fix lazy load on electron.js

* update dev version, git link and binary host

* support session options and run options

* bump dev version

* update README

* add 1 example

* move folder

* adjust path

* update document for examples

* rename example 01

* add example 02

* add session option: log severity level

* add example 04

* resolve comments

* fix typo

* remove double guard in header files

* add copyright banner

* move BUILD outside from README

* consume test filter list from onnxruntime
 2020-05-05 11:45:12 -07:00
Hariharan Seshadri
cffa1b7bf2
Fix (#3812) 2020-05-05 02:08:13 -07:00
Changming Sun
bd78364411
Parallel all the activations ops (#3722) 
1. Parallel all the activations ops.
2. Parallel the performance critical path of the LRN op, which makes the ONNX model zoo googlenet model runs 60% faster(latency reduced from 21ms to 13ms).
3. Make the Gemm-Activation fusion support with all the activations ops. Before this change, it only supports LeakyRelu/Relu/Sigmoid/Tanh.
4. Delete onnxruntime/test/framework/op_kernel_test.cc because the file is almost empty.
5. Remove the loggings in KernelRegistry::TryFindKernel, return Status with error message instead.
 2020-05-05 01:18:17 -07:00
Changming Sun
c11fbf68e4
Publish gpu package to nuget feed (#3816) 2020-05-04 21:49:19 -07:00