Commit graph

2395 commits

Author SHA1 Message Date
gwang-msft
12d7c2f6e4
iOS cross build on MacOS (#3699)
* Enable iOS cross build on MacOS (step#1)

* Changed parallel option

* fixed style issues

* Enable ios arm64 crossbuild on MacOS

* Enable ios arm64 crossbuild on MacOS

* Enable parallel build for xcode

* Fix arm64 function not 4-byte aligned warning

* Rename onnxruntime_ios.cmake to onnxruntime_ios.toolchain.cmake

* change build.py to use the new ios toolchain file name
2020-04-28 17:09:31 -07:00
Scott McKay
29c12c0f07
Handle dim with value of zero in ConvTranspose (#3728)
* Handle dim with value of zero in ConvTranspose
* Update CUDA implementation and disable zero dim test for some EPs that don't support that yet.
2020-04-29 09:58:36 +10:00
Jeff Bloomfield
9a4d1c7720
Merge pull request #3708 from microsoft/jeffbloo/MergeDmlDev
Merge DML Execution Provider updates
2020-04-28 15:19:51 -07:00
Sheil Kumar
f1a948fd62
Enable telemetry on windows zip packages (#3738)
Co-authored-by: Sheil Kumar <sheilk@microsoft.com>
2020-04-28 14:07:11 -07:00
Ori Levari
78fde2c4cb
add downlevel test artifact to windowsai-nuget build (#3711) 2020-04-28 10:05:32 -07:00
S. Manohar Karlapalem
f7cf703d10
[OpenVINO-EP] Optimize MCR Docker image size (#3732)
* updated dockerfile.openvino

* Group all RUN commands and add a 'cd WORKDIR' betwen each

* Update doc with installer and build info

Highlight usage of Online installer package.
Specify --rm option during docker build to avoid caching layer.

Co-authored-by: avidiyal <akhila.vidiyala@intel.com>
2020-04-29 00:08:15 +08:00
edgchen1
1356215bd0
Fix build issues in the Python Packaging pipelines. (#3725) 2020-04-28 08:41:37 -07:00
edgchen1
1bcfd49918
Merge pull request #3731 from microsoft/ettao/ort-2-master
Merge from ort_training to master
2020-04-28 07:56:05 -07:00
George Wu
6b3b4fe43e
remove warning message (#3730) 2020-04-28 03:02:34 -07:00
Jeff Bloomfield
1a11ba8a7e Merge remote-tracking branch 'upstream/master' into jeffbloo/MergeDmlDev 2020-04-28 00:45:22 -07:00
Tianlei Wu
f487cc0b28
Fix Reshape Fusion with graph inputs (#3729)
Use NodeArg to check root input; Add a check on constant initializer
2020-04-28 00:03:16 -07:00
ytaous
75c24a5fac
Revert "Merge from ort_training to master (#3719)" (#3726)
This reverts commit b990ba0059.
2020-04-27 20:42:43 -07:00
ytaous
b990ba0059
Merge from ort_training to master (#3719)
* move cpu/cuda related files to coresponding cpu/cuda folder (#3668)

Co-authored-by: Weixing Zhang <wezhan@microsoft.com>

* type cast for ratio is not necessary for dropout (#3682)

Co-authored-by: Weixing Zhang <wezhan@microsoft.com>

* thrustallocator is not needed since cub is used directly for gather now. (#3683)

Co-authored-by: Weixing Zhang <wezhan@microsoft.com>

* GatherND-12 Implementation (#3645)

* Renamed, UT passing

* Move GatherND CUDA Kerenl into onnxruntime

* Merge GatherNDOpTest

* Refactor Test code

* Merge CPU Kernel Impl

* Handle Negative Indice, Fix UT

* Improve CUDA kernel to handle negative index

* Minor Fixes

* Preserve GatherND-1 Cuda kernel

* Fix Mac build

* fix UT

* Fix Build

* fix GatherNDOpTest.double > CUDA error cudaErrorInvalidDeviceFunction:invalid device function

Co-authored-by: Sherlock Huang <bahuang@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Co-authored-by: Peng Wang (pengwa) <pengwa@microsoft.com>

* Set gradient as output only for easy mode (#3694)

* Support GPU Event Operators (#3653)

* Add GPU event operators to support in-place updates in
gradient accumulator and optimizer for modifying the tensors
passing through those event operators.

* Address comment and polish code

* Merge shared code between CPU and GPU kernels

* Move event test to a new file

* Address comments

* Update onnxruntime/core/providers/cuda/gpu_data_transfer.cc

* fix path of cpu_featurizers_kernels.cc and cpu_featurizers_kernels.h

Co-authored-by: Weixing Zhang <weixingzhang@users.noreply.github.com>
Co-authored-by: Weixing Zhang <wezhan@microsoft.com>
Co-authored-by: Sherlock <baihan.huang@gmail.com>
Co-authored-by: Sherlock Huang <bahuang@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Co-authored-by: Peng Wang (pengwa) <pengwa@microsoft.com>
Co-authored-by: ashbhandare <ash.bhandare@gmail.com>
Co-authored-by: Wei-Sheng Chin <wschin@outlook.com>
Co-authored-by: Ethan Tao <ettao@microsoft.com>
2020-04-27 16:45:21 -07:00
Dmitri Smirnov
4f887b465a
Uncomment celu test. (#3717) 2020-04-27 14:24:54 -07:00
Wei-Sheng Chin
7627e6bcc2
Improve node and node argument name generation (#3649) 2020-04-27 13:57:24 -07:00
Jeff Bloomfield
407492472f Fix build warnings and address PR comment 2020-04-27 13:21:45 -07:00
Weixing Zhang
d03c552992 fix path of cpu_featurizers_kernels.cc and cpu_featurizers_kernels.h 2020-04-27 19:39:42 +00:00
Sherlock
635bc9cd04
Fix graph transformers to support opset 12 ops (#3715) 2020-04-27 11:53:45 -07:00
Ethan Tao
0516e7d22e Merge branch 'ort_public_ort_training' into ettao/ort-2-master 2020-04-27 18:17:17 +00:00
Prabhat
d901640817
Call optimised version of depthwise ConvLayer (#3664)
* Call optimised version of depthwise ConvLayer

* Update if statements
2020-04-27 17:41:33 +05:30
George Wu
c23b484275 add missing deps in Dockerfile.openvino 2020-04-26 22:02:48 -07:00
Jeff Bloomfield
1621a1fef1 Merge remote-tracking branch 'upstream/master' into jeffbloo/MergeDmlDev 2020-04-26 17:20:21 -07:00
Jeff Bloomfield
e51c6c0b3b Fix build warning in DmlOperatorResize.cpp and ReadbackHeap.cpp 2020-04-26 17:20:15 -07:00
Changming Sun
805ffc01e5
Temp remove --enable_wcos --use_winml from CI build (#3707)
The flags "--enable_wcos --use_winml" don't work with the latest VC++ and CMake. I don't know which caused the failure. But it doesn't work. Remove it to make the pipelines work first.
Will add them back before 1.3 release.
2020-04-26 16:10:25 -07:00
Jeff Bloomfield
735caecfe1 Copy disabled ONNX backend tests from WindowsAI 2020-04-26 14:47:41 -07:00
David Brownell
a917023f94
Support for country-specific holidays in the DateTimeTransformer (#3701)
* Support for country-specific holidays in the DateTimeTransformer

Updates the DateTimeTransformer featurizer to support holidays, where holiday information is read from country-specific json files.

* Addressed build breaks

* Enhanced Windows strategies for scenarios when tests run from root dir

* Skipping test for nuget installations
2020-04-26 11:12:26 -07:00
Jeff Bloomfield
02e8d10f3a Fix AdapterSessionTest 2020-04-25 20:49:51 -07:00
Tracy Sharpe
bf1caba2b2
Port MLAS to Power architecture (#3703)
Updates to MLAS to support building for the Power architecture.
2020-04-25 19:31:55 -07:00
Jeff Bloomfield
f1c19f8495 merge master 2020-04-25 19:04:58 -07:00
Jeff Bloomfield
99a0bdf271 Upgrade nuget version in dml.cmake 2020-04-25 18:48:32 -07:00
Jeff Bloomfield
8cc161aec6 Remove problematic change for dxcore.lib 2020-04-25 18:48:07 -07:00
Jeff Bloomfield
c49cc0c937 Increase DML nuget version to 0.0.2 2020-04-25 16:28:19 -07:00
edgchen1
e22d97ba56
Merge pull request #3643 from microsoft/ort_training_for_merge_to_master
Introduce ORT training implementation
2020-04-25 07:15:22 -07:00
Sheil Kumar
a475f2824d
Create the Nuget WindowsAI Pipeline (#3684)
* add windowsai.yml for new Microsoft.AI.MachineLearning nuget

* temporarily add windowsai.yml to gpu.yml

* pass in build arch

* remove install onnx task

* no dml for arm or arm64

* refactor nuget pipeline defs

* update package creation

* pass in build and sources path

* missing hyphens

* copy license file

* fix parameter variable

* disable arm builds for now

* remove commented script block

* download pipeline atifcat name update

* set working dir

* Add bundling nuget script

* path combine

* null path

* combine needs parentheses

* binplace microsoft.* dlls in new nuget package

* update artifact name

* move merged nuget to artifacts directory

* move to merged subfolder in artifacts staging dir

* forward slash to back

* enable arm

* vcvarsall needs x64 vars setup

* Run Tests

* fix tests

* move global variables

* update yml to not have global variable in template

* removed parameters

* fixes

* Add build arch as an env variable

* ne not neq

* %Var% for batch script

* dont pass argument for x64

* disable arm tests

* skip csharp/cxx tests for microsoft nuget package

* remove test-win as it tests only c# cxx and capi

* test build for store apps

* dont build for store

* tools/nuget/generate_nuspec_for_native_nuget.py

* remove args.

* add new props and targets for microsoft.ai

* make windowsai props/targets static

* add dependency

* dont ship dot net props

* Remove c# fom windowsai nuget

* copy license file

* native packages must have win10 as the platform, not win

* cuda header in wrong if branch

* no dml for arm builds

* only build dml for x64/ x86

* User/sheilk/props update (#3616)

* prelim store work

* props

* Fix desktop nuget props/targets

* clean up targets and make store apps work

Co-authored-by: Sheil Kumar <sheilk@microsoft.com>

* update windowsai.yml with latest

* remove extra dloadhelpers

* Add abi headers to abi dir, and reference native includes

* update windowsai.yml

* minor update

* remove parameters

* add doesrp param

* hard code esrp to true

* add directml for x86/x64

* revert gpu yml changes

* add store builds

* add store builds

* add checks again in old way

* dup job names for store and desktop builds

* move all of the runtime binaries to win10 folder

* only set safeseh on x86

* disable the store builds for now... missing msvcprt.lib

* copy paste deletion...

* switch back to win- (#3646)

Co-authored-by: Sheil Kumar <sheilk@microsoft.com>

* use stahlworks

* & not supported in ado

* add cuda to cpu nuget(???) and EnableDelayedExpansion to enable x86 dml package

* revert nocontribops

* add underscore...

* extra win/win10 change

* merged nuget... still not being bundled...

* files in merged directory

* missing parens causing dml to be included in cpu package

* more diagnostic info

* switch dir to get-childitem

* wait for compression to complete

* add winml_adapter to mkml and gpu packages

* enable_wcos

* add mklml binaries

* props and targets missing from mklml

Co-authored-by: Sheil Kumar <sheilk@microsoft.com>
2020-04-24 20:20:04 -07:00
ytaous
1c484ce33f
fix test (#3700)
Co-authored-by: Ethan Tao <ettao@microsoft.com>
2020-04-24 18:09:46 -07:00
Wei-Sheng Chin
72b38f0a8b
Support GPU Event Operators (#3653)
* Add GPU event operators to support in-place updates in
gradient accumulator and optimizer for modifying the tensors
passing through those event operators.

* Address comment and polish code

* Merge shared code between CPU and GPU kernels

* Move event test to a new file

* Address comments

* Update onnxruntime/core/providers/cuda/gpu_data_transfer.cc
2020-04-24 17:43:04 -07:00
edgchen1
8b5d6fbaf5
Remove internal work item links. (#3698) 2020-04-24 15:38:30 -07:00
ytaous
5637cec199
Merge pull request #3697 from microsoft/ettao/merge-from-master
merge from master
2020-04-24 15:30:56 -07:00
ashbhandare
d06763ac1c
Set gradient as output only for easy mode (#3694) 2020-04-24 15:28:28 -07:00
David Brownell
1b7bf481fc
Ensure that setup.py works for all cmake generators and working dirs (#3692) 2020-04-24 15:19:15 -07:00
Ethan Tao
e9f1e7e797 resolve conflicts 2020-04-24 15:15:36 -07:00
edgchen1
4aa033b99e
Addressing review comments (#3690)
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414359326
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414359463
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414360023
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414361667
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414368707
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414371480
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414379362
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414374516
- https://github.com/microsoft/onnxruntime/pull/3681#discussion_r414801087
2020-04-24 14:57:18 -07:00
edgchen1
7347c73139
Revert "resolving conflicts from master (#3691)" (#3696)
This reverts commit c38a60a450.
2020-04-24 14:49:00 -07:00
Tiago Koji Castro Shibata
f48b9e2ea7
Add adapter session tests (#3522)
* Start adapter tests

* Fix more adapter session CMake

* Implememt adapter session tests

* Fix adapter test breaks

* Test fixes, profiling test

* Fix adapter w/ DML tests

* Cleanup

* Fix WinML adapter profiling test

* Fix memory leaks

* Remove FIXME
2020-04-24 14:39:54 -07:00
ytaous
c38a60a450
resolving conflicts from master (#3691)
* resolving conflicts

* resolving conflicts

* resolving conflicts

* resolve conflicts

Co-authored-by: Ethan Tao <ettao@microsoft.com>
2020-04-24 14:38:30 -07:00
Tianlei Wu
63e6c257e4
Disable GeluApproximation transformer by default (#3644)
Disable GeluApproximation by default
2020-04-24 14:29:40 -07:00
Ye Wang
ad8eb921d3
Changes on RollingWindow Transformer (#3679)
* changes on rollingwindow transformer

* fix linux/macos build error

* resolve comments
2020-04-24 13:00:49 -07:00
Ori Levari
66343e2fcf
use map with case insensitive hash and equals functions for learningmodel metadata. add test to verify case insensitive functionality. (#3671)
Co-authored-by: Ori Levari <orlevari@microsoft.com>
2020-04-24 10:46:10 -07:00
Ye Wang
5c7f616431
FeaturizersLibrary update and add variadic Input/Output to TimeSeriesImputer (#3674) 2020-04-24 08:53:00 -07:00
Sherlock
b4d4ea2e5f
GatherND-12 Implementation (#3645)
* Renamed, UT passing

* Move GatherND CUDA Kerenl into onnxruntime

* Merge GatherNDOpTest

* Refactor Test code

* Merge CPU Kernel Impl

* Handle Negative Indice, Fix UT

* Improve CUDA kernel to handle negative index

* Minor Fixes

* Preserve GatherND-1 Cuda kernel

* Fix Mac build

* fix UT

* Fix Build

* fix GatherNDOpTest.double > CUDA error cudaErrorInvalidDeviceFunction:invalid device function

Co-authored-by: Sherlock Huang <bahuang@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Co-authored-by: Peng Wang (pengwa) <pengwa@microsoft.com>
2020-04-24 20:55:30 +08:00