Commit graph

2180 commits

Author SHA1 Message Date
edgchen1
ead00f97f3
Sync onnx_backend_test_series.py disabled tests (#3603)
Make the set of disabled tests consistent between ort_training and master. Fix some regex patterns.
2020-04-20 18:00:53 -07:00
liqunfu
781e1c36be
Add front-end MNIST test (#3231)
* add frontend minst test

* to use torch nightly with torchvision

* remove incorrect comment per reviewer's comment

* experiment torchvision import failure

* experiment install_deps.sh

* more experiment install_deps.sh

* experiment install_deps.sh with --upgrade

* Experiment with install_deps.sh.

* Experiment with install_ubuntu.sh.

* Use Ubuntu 18.04 and Python 3.6 for CI.

* Update cmake version for CI.

* Install MPI on Ubuntu 18.04 for CI.

* Increase tolerance for MNIST test.

* Go back to Ubuntu 16.04 for CI, fix installing from deadsnakes ppa.

* Clean-up.

* Update ort_trainer.py from ort_training.

* Get default Ubuntu Python ver back to 3.5.

* Add underscore to opset_version parameter name in ORTTrainer constructor.

* Move loss/model wrap before the call for sample output.

* Update expected values for MNIST test.

Co-authored-by: liqun <liqun@OrtTrainingDev4.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Co-authored-by: Sergii Dymchenko <sedymche@microsoft.com>
2020-04-20 11:19:31 -07:00
edgchen1
f180b71f27
Support ONNX test version parsing from path on Windows in onnx_test_runner. (#3588) 2020-04-20 10:02:51 -07:00
edgchen1
52cfc98ec4
Merge pull request #3557 from microsoft/havenka/master-merge
Merge from master
2020-04-18 09:40:32 -07:00
edgchen1
811bd67872
Clean up docs. (#3579)
* Fix orttraining/README.md formatting.

* Delete ORT_TRAINING_BUILDS.md.

* Fix typo.
2020-04-17 22:13:11 -07:00
ytaous
ca1bbff5d4
subgraph type override handling and unit test (#3560)
* unit test for subgraph type override

* unit test - re-wire input properly to subgraph

* update args

Co-authored-by: Ethan Tao <ettao@microsoft.com>
2020-04-17 19:33:34 -07:00
edgchen1
2cb8cb816f
Disable or update flaky tests, improve test random seed accessibility. (#3495)
- Add output of test random seed
- Allow setting of test random seed with environment variable
- Disable / relax tolerance for flaky tests
2020-04-17 15:57:32 -07:00
edgchen1
de543c0308
Add SafeInt include to WinML targets (#3558)
Fixing Windows builds on the ort_training branch in preparation for the merge to master.
SafeInt (included via onnxruntime/core/common/safeint.h) was recently made a dependency of onnxruntime/core/framework/bfc_arena.h. That requires consumers of bfc_arena to compile with the SafeInt include directory.
2020-04-17 09:54:01 -07:00
Edward Chen
be3b9244ac Fix GraphTest.UnusedValueInfoSerializes. 2020-04-16 23:38:41 +00:00
manashgoswami
9fc2b6482b
Ort training README (#3404)
Added README for ORT Training
2020-04-16 14:51:33 -07:00
M. Zeeshan Siddiqui
6c1ccb659f
SoftmaxCrossEntropyLoss-12 forward and backward kernel implementation. (#3465)
* Update ONNX submodule commit to the latest.

* build break.

* SoftmaxCrossEntropyLoss: Forward and backward kernel implementation.

* Revert "build break."

This reverts commit 847cb50d294efbe6c09fa760e7cacf25bfb6146d.

* Add more tests and misc clean up.

* revert unintended changes.

* PR feedback.

* cleanup.

* PR feedback.
2020-04-16 12:27:07 -07:00
edgchen1
0ec90f7019
Put safeint_interface include directory into onnxruntime_common interface include directories to simplify usage by other targets. (#3546) 2020-04-16 10:34:32 -07:00
harshitha
80e0c64e2e merged with master 2020-04-16 17:13:36 +00:00
edgchen1
2f16172e69
Address PR comments and clean up. (#3536)
Address PR comments and clean up.
- https://github.com/microsoft/onnxruntime/pull/3174#discussion_r408549886
- https://github.com/microsoft/onnxruntime/pull/3174#discussion_r408551151
2020-04-15 15:51:52 -07:00
Ye Wang
ec4f6c099b
Resolve comments and make minor changes to Featurizer transformers (#3535) 2020-04-15 13:29:24 -07:00
Hariharan Seshadri
abfb275ac0
Support listing keys in custom metadata map via C/C++ API (#3477)
* Support listing keys in custom metadata map via C/C++ API

* nit

* PR feedback

* Nit
2020-04-15 12:14:03 -07:00
David Brownell
72cd61baae
Removed use of parameters in python wheel build scripts (#3524) 2020-04-15 10:31:14 -07:00
Yulong Wang
cf2fddf760
fix nuget build (#3532) 2020-04-15 10:30:11 -07:00
Jesse Benson
2536e80602 Rename API to onnxruntime.set_seed(<seed>) 2020-04-15 09:44:48 -07:00
Jesse Benson
644bc05830 Add Python API to set random seed: onnxruntime.seed(<seed>) 2020-04-15 09:44:48 -07:00
Changming Sun
b63349c8d6
Fix custom op test failure (#3525) 2020-04-14 20:36:42 -07:00
Adam Pocock
bc9a199b16 Renaming deviceNum to deviceId. 2020-04-14 20:35:03 -07:00
Adam Pocock
e9dc8954ac Adding support for ACL and DML to the Java API. 2020-04-14 20:35:03 -07:00
pengwa
2c7c45076b
MaxBatchSize E2E Test (#3454)
* max batch size e2e test

*update test data snapshot
2020-04-15 09:50:44 +08:00
Changming Sun
a2feb29b0d
Fix build break (#3528)
Ignore some known test failures
Install ONNX package before running Windows CI builds
2020-04-14 18:07:56 -07:00
Negin Raoof
e303f458e4
Add int64 input type for ReduceProd (#3507)
* Add int64 input type

* Fix for cuda

* Fix linking

* Cuda

* Fixed missing registration

* Fix registeration for opsets 1-11

* Adding reduce_matrix_rows for int64

* Update reduction_functions.cu

* Revert cuda
2020-04-14 15:09:28 -07:00
edgchen1
4fa88a0a23
Remove cast to OpKernelContextInternal to get threadpool and directly use OpKernelContext. (#3523) 2020-04-14 14:30:26 -07:00
Ori Levari
f564569a80
Adapter Model and Environment tests (#3469)
*Adapter Model and Environment tests
*winml test macro clean up and extension
2020-04-14 13:36:31 -07:00
Tiago Koji Castro Shibata
560f4c5b16
Make GPUTEST macro consistent among TAEF/googletest (#3518) 2020-04-14 10:55:16 -07:00
Du Li
621b3ac03a
FFT contrib ops (#3381)
* add custom op skeleton

* Adding Rfft, Irfft kernels.

* Fix a few errors:
1. make kernel stateless to avoid race condition
2. reclaim cufft plan

* Adding MLFloat16 support

* Adding fp16 support for fft ops.

* Adding cufft plan cache.

* adding a util func

* adding copyright info.

* Accommodating PR comments.
2020-04-14 10:12:04 -07:00
Tixxx
06b63975c0
Fix fp16 type mismatch when graph output is an fp32-only node (#3411)
* verify output node before changing its type in mixed precision mode
2020-04-14 09:35:19 -07:00
Yufeng Li
baa86f181f
Handle the case that initializers are in graph input (#3449)
warn that initializers are in graph input
provide a tool to move initializer out of graph input
Motivation and Context
ONNX model from IR_VERSION 4 only treats initializers that appear in graph input as non-constant. This may fail some of the graph optimizations, like const folding, operator fusion and etc. Warn the case and provide a tool.
2020-04-14 09:06:04 -07:00
David Brownell
006c5be1b1
Optionally produce a python wheel that includes featurizers (#3491) 2020-04-14 09:00:13 -07:00
Changming Sun
040c28ff39 Remove dead code from HandleNegativeAxis 2020-04-14 01:01:15 -07:00
edgchen1
ba7225f986
Update Graph SetInputs and SetOutputs for training (#3446)
Fix training modification of Graph SetInputs() and SetOutputs(). Originally there were distinct code paths in Graph based on whether the graph was loaded from a GraphProto or created from scratch. The training modifications made that distinction a bit ambiguous - i.e., even though the Graph is loaded from a GraphProto for training, sometimes we rely on the other code path, e.g., to deduce the graph inputs after modifying it. Consequently, there was some odd behavior when using SetInputs(). For correctness, this change separates the cases where the graph is loaded from a GraphProto and where it is created from scratch.
2020-04-13 19:10:44 -07:00
Colin Jermain
06db89cf13 Using logic for finding README.rst to find requirements.txt 2020-04-13 18:59:44 -07:00
Colin Jermain
43d9f9190e Removing unused six package 2020-04-13 18:59:44 -07:00
Colin Jermain
c2c3102aba Tying install_requires to requirements.txt 2020-04-13 18:59:44 -07:00
Ye Wang
66a79d2c9f
fix (#3512) 2020-04-13 18:30:58 -07:00
Dmitri Smirnov
efd9b92482
Handle Scalars in TernaryOps and Where. (#3509)
Handle Scalars in TernaryOps and Where.
2020-04-13 16:24:35 -07:00
Ye Wang
cbe30f3e19
update FeaturizersLibrary (#3511) 2020-04-13 15:47:51 -07:00
Tracy Sharpe
5aab2671f8
Fix crash in DequantizeLinear with scalar tensor (#3508) 2020-04-13 14:52:52 -07:00
Ye Wang
438353abcd
Fix TruncatedSVDFeaturizer's test failure and re-enable it's kernel test (#3458)
* checkin

* fix linux & macos build

* fix test

* revert the changes for a single-aimed PR

* fix
2020-04-13 13:59:38 -07:00
M. Zeeshan Siddiqui
5d99f179b9
Merge pull request #3486 from microsoft/sedymche/merge_master_ort_training
Merge from master into ort_training
2020-04-13 10:55:36 -07:00
Tianlei Wu
54bbbb78ae
Change mask_index input of Attention op to be optional (#3459)
Change Mask Index to optional
2020-04-12 22:55:37 -07:00
Sergii Dymchenko
bf3df41424 Put back SubmoduleCheckoutMode parameter into mac-ci.yml. 2020-04-12 21:49:38 -07:00
Sergii Dymchenko
b670cdc11d Remove usage of DeviceProp (which is removed in ort_training) from cudnn_common.cc. 2020-04-12 21:40:54 -07:00
Sergii Dymchenko
7b2fc196fe Get cudnn_common.cc from master. 2020-04-12 21:10:36 -07:00
Sergii Dymchenko
571a6d52f5 Add to list of failing backend tests from master. 2020-04-12 19:16:53 -07:00
George Wu
7f6e407e09
fix python packaging manylinux1 build break. (#3482) 2020-04-11 06:58:22 +08:00