Commit graph

3881 commits

Author SHA1 Message Date
Jesse Benson
98ea7372d3 Re-enable Lamb unit tests for AMD 2020-12-03 13:06:34 -08:00
Jesse Benson
245d43615d Fix AMD multi-tensor implementation. 2020-12-03 13:06:34 -08:00
Edward Chen
6572a4d306
Disable Python 3.9 for training Python packaging build. (#6012)
Disable Python 3.9 for training Python packaging build. Python 3.9 is not supported by the PyTorch dependency.
2020-12-03 11:42:28 -08:00
Tianlei Wu
cdb91208a3
longformer onnx conversion and benchmark tools (#6007)
* initial implementation of longformer tools for onnx conversion and benchmark

* Support ONNX conversion for transformers 4.0
Add an option to optimize onnx model, and export fp16 model
2020-12-03 11:37:30 -08:00
Cecilia Liu
3b198c9614
Support Fusion for 1 and 2 Inputs Bert Models Converted From tf (#5993)
Support fusion for 1 and 2 inputs Bert models converted from tf
2020-12-03 10:52:33 -08:00
Sherlock
c86a1e5c13
Fix Flaky orttraining tests (#5977)
* Fix Flacky orttraining  tests
2020-12-03 10:24:25 -08:00
Ryan Lai
2878e8eb2e
Fix nuget build error (#6009) 2020-12-03 09:28:39 -08:00
baijumeswani
2b35f7d4f6
Fix build.py bug which prevents running some unit tests (#5990)
Also ignore an exception occurred for execution providers which generate compiled nodes
2020-12-03 08:57:55 -08:00
Xavier Dupré
0acc3837ee
Make operator TreeEnsemble 5x faster for batches of size 100.000 (#5965)
* improves processing time by 10
* extend coverage unit test coverage
* better implementation for the multi regression case
* better comment, keep parallelization by trees when not enough trees
2020-12-03 14:36:42 +01:00
Xavier Dupré
524b9fa899
Initialize a structure in operator ReduceSum (#6005)
* fix initialisation issue
2020-12-03 12:41:26 +01:00
Zhang Lei
648c9c7789
Fix bugs for 1: Calibrator should check model inputs; 2: (#6017)
quantize_inupts forgot to use parameter initializer_use_weight_qtyp.
2020-12-03 00:00:16 -08:00
Xavier Dupré
bdd06f6310
Fix PR #5550 reverted in #5911 (performance improvment for operator Transpose) (#5916)
* Improves implementation of transpose operator
* Fix issue mentioned in #5911
* adding unit test for function DoTransposeImpl
2020-12-03 00:38:18 +01:00
Yufeng Li
f2dcba7afe
Fuse MatMulIntegerToFloat only when scales are scalar (#6008)
MatMulIntegerToFloat fusion fuses per-row and per-column MatMulInteger, which is not supported by the MatMulIntegerToFloat kernel now. Limit the fusion to per-matrix only before we supporting the per-channel fully.
2020-12-02 14:40:17 -08:00
Yufeng Li
4fdfbfd4b4
Add int32_t support for DeQuantizeLinear (#5994)
* Add int32_t support for DeQuantizeLinear

* DequantizeLinear with int32 should have not zero point
2020-12-02 12:35:41 -08:00
Olivia Jain
c727a28735
include gemm_helper.h (#5988) 2020-12-02 11:28:28 -08:00
Xiang Zhang
b4e6cc59c7
skip the check for A channel (#5989) 2020-12-02 11:23:54 -08:00
Guoyu Wang
cdacee6696
[NNAPI] Support non-1d tensor for C of Gemm op (#5982)
* Add support for non-1d tensor for C of Gemm

* check android api level before add squeeze

* Minor update

* Fix to accept c only in format of {1,1,...,1,n}
2020-12-02 00:22:38 -08:00
Guoyu Wang
6846c665ff
Use loose version in build.py (#5998) 2020-12-01 20:57:44 -08:00
Ryan Lai
897310f6fb
Add suspend handler with new telemetry event for UWP scenarios (#5907)
* Add suspend handler with new telemetry event

* Fix build warning

* Use cppwinrt from nuget

* Restore nuget packages

* add dependencies

* Add nuget_helpers

* Cleaned up

* Clean up

* Comment

* Add dependencies for the rest

* Remove unused line

* Update activation string

* PR comment to remove ALL
2020-12-01 20:26:18 -08:00
Edward Chen
6d642a3dba
Replace direct pulls from image cache container registry with get_docker_image.py, build definition clean up. (#5906) 2020-12-01 19:10:23 -08:00
Chun-Wei Chen
c63e8cf7d7
Remove chronological starttime assertion in InferenceTest.cs because it is not determined (#5976)
* remove chronological starttime assertion because it is not determined

* use different vars
2020-12-01 15:58:12 -08:00
Adam Pocock
396074d2a8
Fixing OrtEnvironment.getEnvironment() so it doesn't print a warning if the environment already exists with a non-default name. (#5973) 2020-12-01 15:21:06 -08:00
Scott McKay
30c7fffbab
Expand the documentation on using compiling EPs with a minimal build (#5893)
* Expand the documentation on using compiling EPs with a minimal build to call out a 'simple' option that is easier to use. Provide more background on what happens to help users choose the best option for them.
Tweak conversion script to be noisier about attempted usage of 'all' optimization level.

Co-authored-by: manashgoswami <magoswam@microsoft.com>
2020-12-02 09:12:36 +10:00
Nat Kershaw (MSFT)
46277bfd09
Remove survey link from README (#5979) 2020-12-01 11:36:00 -08:00
Ye Wang
5f516899bf
optimize a bert model converted using tf2onnx (#5492)
* optimize a bert model converted using tf2onnx

* add test data

* update

* remove comments

* format

* Revert "format"

This reverts commit f8ae88cb564bce5caf4780e56561403f3ba3d524.

* Revert "remove comments"

This reverts commit 59d8a693581a731fd0291b70fe2c9cec6c4950fe.

* add a squeeze node to convert a 3-d mask to 2-d

* update

* update

* verify and add comments
2020-12-01 11:19:16 -08:00
Changming Sun
3323fb6082
Update docker files to put 'unattended-upgrades' in a right place(#5983) 2020-12-01 10:45:03 -08:00
Wenbing Li
2ec211ea7b
Support the cross compiling for Apple Silicon (#5974)
* support macos_arm64 cross compiling

* update the build docs

* update as commented.

* Update BUILD.md
2020-12-01 10:00:06 -08:00
Alberto Magni
fb310fba0c
Avoid adding non-existent inputs to new Event nodes (#5915)
During graph resolve non-existent nodes cause shape-inference failures.
2020-12-01 08:21:05 -08:00
Changming Sun
2d9dcc4576
Add python 3.9 support (#5874)
1. Add python 3.9 support(except Linux ARM)
2. Add Windows GPU python 3.8 to our packaging pipeline.
2020-11-30 12:02:48 -08:00
Wenbing Li
1852ade75d
Enable the xcode build for Apple Silicon (arm64 MacOS) (#5924)
* fix the build script for macos/xcode

* add the version check

* correct the osx-arch configuration

* typo
2020-11-30 11:22:08 -08:00
Jesse Benson
45966d878a Code review feedback 2020-11-30 09:24:22 -08:00
Jesse Benson
86e30a2db6 Update CUDA IsAllFinite kernel 2020-11-30 09:24:22 -08:00
Jesse Benson
bd96f60888 Use CUDA's IsAllFinite kernel for ROCm 2020-11-30 09:24:22 -08:00
Moshe David
06ad516a5d
w (#5947)
Co-authored-by: modav <modav@microsoft.com>
2020-11-30 10:35:44 +10:00
Moshe David
5f5d4a10bd
[OpenVINO]Fix memory leak upon exception throwing (#5954)
1. Make sure to free the output_shape vector even if Output names mismatch between OpenVINO and ONNX exception is thrown
2. Piggy back this PR to remove un-needed call to fstream close method

Authored-by: modav <modav@microsoft.com>
2020-11-26 19:44:51 -08:00
Ivan Stojiljkovic
015fbb3dbb
Add support for Python 3.8+ on Windows when CUDA is enabled (#5956) 2020-11-26 15:52:30 -08:00
Moshe David
e207589631
[OpenVINO]Fix memory leak in IsDebugEnabled() under Windows (#5948)
* w

* w

Co-authored-by: modav <modav@microsoft.com>
2020-11-26 15:10:37 -08:00
Guoyu Wang
4afdced775
[NNAPI EP] Update squeeze ops (#5946)
* [NNAPI EP] Update squeeze ops
2020-11-26 21:00:54 +10:00
Guoyu Wang
d52b9aca68
Enable scalar input/output for NNAPI EP (#5922)
* Enable scalar input for NNAPI EP

* Map scalar output ({1} tensor) of NNAPI back to scalar ({} tensor) if necessary

* Enforce NNAPI scalar output has {1} shape

* address CR comments

* minor update
2020-11-25 21:05:50 -08:00
Changming Sun
5fdd9f0fd2
Fix Python Linux GPU package name (#5943)
Fix Python Linux GPU package name. I accidentally added "noopenmp" to it.
2020-11-25 17:46:11 -08:00
Ryan Hill
27513d1fd7
Update BUILD.md with shared provider information (#5944)
* Update build instructions to include information about shared providers
2020-11-25 17:35:34 -08:00
Dmitri Smirnov
c4b55d29fe
Fix publishing pipelines. (#5942)
Fix publishing pipelines.
2020-11-25 16:23:08 -08:00
Changming Sun
1dbabb2362
Update dockerfiles (#5929)
1. Remove conda from the images. Because conda contains a file named /opt/miniconda/lib/libcrypto.so.1.0.0 which can't pass our security scan. Also, it will be easier for us to manage the third party usage registrations.
2. Remove openssh from the images. Because the official openssh package provided by Ubuntu can't pass our security scan.
3. Reduce the image size to 1/3 by using stages. Also, because it contains less packages, it will be less often needed to update.
4. Put the LICENSE-IMAGE.txt file in right place. It is missed in current images. You can see it was added to a temp folder "/code" but it got deleted afterwards.
5. Update the CPU docker image's base image to Ubuntu 18.04. The GPU one is already 18.04. It's better to keep them the same.
6. Remove the build arg ONNXRUNTIME_REPO/ONNXRUNTIME_BRANCH. Instead, the new one always uses the local source. I feel it can reduce confusion.
2020-11-25 15:38:22 -08:00
Changming Sun
c5b4d9091c
Fix a tiny issue in onnxruntime_unittests.cmake (#5901) 2020-11-25 14:21:13 -08:00
Edward Chen
7546d251e0
Expose parameters in clean build Docker image cache build. (#5941)
Expose some parameters in the clean build Docker image cache build. In particular, whether to do a dry-run and the lifetime of unused cache images.
2020-11-25 14:15:54 -08:00
Tianlei Wu
31a6be3d67
Add Longformer Attention Cuda Op(#5932)
Limitation: Global tokens must be at the beginning of sequence.
2020-11-25 13:52:10 -08:00
Maajid khan
e39e82b43a
Bug fix for MaskRCNN and FasterRCNN (#5935)
Signed-off-by: MaajidKhan <n.maajidkhan@gmail.com>
2020-11-25 12:10:09 -08:00
baijumeswani
69b9368c93
Add unit tests to identify configuration migration scenarios for checkpointing (#5678) 2020-11-25 09:40:26 -08:00
sfatimar
8168c91978
Sahar/fix documentation shared lib (#5926)
* Update OpenVINO-ExecutionProvider.Md

update openvino-executionprovider.md for shared library

* Update Build.md

updated --build_shared_lib flag for building openvino shared provider lib

* Update Dockerfile.openvino 

building for shared library with the new changes for openvino shared lib

* Revert "Update Build.md"

This reverts commit c9cf5fee76be7fdc10cadf07259f1d4ed5b45b93.

* Revert "Update Dockerfile.openvino "

This reverts commit e1624e4f93a4cfb425b6f21d7fb71b299a146740.

* Update OpenVINO-ExecutionProvider.md

fix documentation to the shared library

Co-authored-by: sfatimar <sahar.fatima@intel/com>
2020-11-25 08:50:01 -08:00
Guoyu Wang
87368655e2
Make NNAPI EP reject nodes with no-shape inputs (#5927) 2020-11-25 00:21:00 -08:00