Pranav Sharma
c2c78399ee
Include config keys header file in the release packages for Linux and Mac. ( #5388 )
2020-10-08 15:00:29 -07:00
Changming Sun
09aef240d6
Skip running onnx tests in python mac os pipeline ( #5416 )
2020-10-08 11:49:28 -07:00
Hariharan Seshadri
6f54113a1b
Support OrtValue binding in Python to enable interesting IOBinding scenarios in Python ( #5248 )
2020-10-06 21:14:41 -07:00
Guoyu Wang
b4934b0016
Mitigate pybind11 build break using Xcode 12 on macOS ( #5381 )
...
* turn dev_mode off if we are using macos to build python with xcode 12
* Address CR comments
* Add ways to check compiler version
2020-10-06 19:03:33 -07:00
liqunfu
773992c7d4
Liqun/bert pretrain tb ( #5377 )
...
* add tensor board, remove torch.distributed.lanuch because ort nccl depends on MPI. Use MPI to launch parallel training.
Co-authored-by: liqun <liqun@OrtTrainingDev4.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
2020-10-06 16:28:31 -07:00
Wenbing Li
4721729fdc
Enable iOS CI pipeline ( #5360 )
...
* add the ios ci build.
* no dependency on mac ci pipeline.
* fix the command line.
* keep sync
* automatically retrieve sdpath
* fix the case errors and warnings
* fix the vlog switch issue.
* add parallel flag for build.
* update the display name of the pipeline.
2020-10-02 20:14:45 -07:00
Guoyu Wang
9df0790856
Update linux minimal CI to report Android mininal baseline binary size ( #5361 )
...
* Update linux minimal CI to report Android mininal baseline binary size
* Fix some issues in the script
2020-10-02 17:35:23 -07:00
Chun-Wei Chen
5bd7241839
Raise output mismatch error in ort_test_dir_utils.py ( #5364 )
2020-10-02 16:44:59 -07:00
Ashwini Khade
ce49cfa67c
add support for configurable build dir when building nuget packages ( #5352 )
...
* add support for configurable build dir when building nuget packages
* rename vars
2020-10-02 09:31:35 -07:00
edgchen1
d62873a331
Docker image release build updates ( #5326 )
...
- Update docker image release build to use build commit.
- Use valid default in component governance detection step.
- Use smaller docker build context.
2020-10-01 12:25:31 -07:00
liqunfu
fe50213491
Liqun/bert pretrain2 ( #5327 )
...
* bert single node multi GPU pretrain w/o checkpoint
Co-authored-by: liqun <liqun@OrtTrainingDev4.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
2020-10-01 11:01:26 -07:00
Ashwini Khade
3f00b8db8f
move all experimental ops to version 1 of ms domain ( #5287 )
...
* move all experimental ops to version 1 of ms domain
* deprecate TransposeMatMul in favor of FusedMatMul
* update documentation
2020-09-30 14:50:18 -07:00
Wenbing Li
ed102e9d88
Add iOS test pipeline and a sample app. ( #5298 )
...
* Add iOS test pipeline and a sample app.
* clean up the unused code.
* clean up.
* revert the unknown change
* disable the shared library for iOS.
* add open source notice text.
* ignore the skipped test.
* extract the common ortenv setup
2020-09-29 13:53:11 -07:00
liqunfu
24d8b1bf42
to skip an unstable test to unblock release ( #5314 )
...
Co-authored-by: liqun <liqun@OrtTrainingDev4.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
2020-09-28 22:30:11 -07:00
Scott McKay
1ff3b2d5b8
Add ability to generate multiple test dirs so that different input mixes can be tested. ( #5310 )
2020-09-29 12:55:15 +10:00
Changming Sun
1a04b8f8b7
Add valgrind support to our cmake files ( #5296 )
2020-09-28 09:31:08 -07:00
Changming Sun
17f1178c2e
Downgrade GCC ( #5269 )
...
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
2020-09-24 21:14:54 -07:00
Dmitri Smirnov
89742411ec
Insert telemetry template into GPU build, add telemry build switches. ( #5278 )
2020-09-24 17:13:09 -07:00
Dwayne Robinson
6ad39819c2
Update DirectML Nuget to 1.3.0 ( #5274 )
...
Update to 1.3.0
2020-09-23 22:53:02 -07:00
edgchen1
6d5b93b805
Synchronize training dependency versions between Docker image and Python wheel. ( #5261 )
...
Synchronize training dependency versions between Docker image and wheel, update docs, refactor build scripts.
2020-09-23 19:03:42 -07:00
Guoyu Wang
d957dbebea
Fix possible ios build break after update to Xcode 12 ( #5246 )
...
* Fix possible ios build break after update to Xcode 12
* Address comments
2020-09-22 07:42:54 -07:00
suffian khan
417929b049
jobs timeout ..
2020-09-21 21:51:59 -07:00
Xueyun Zhu
55e4b5d302
add pipeline distributed training test ( #5222 )
...
* add pipeline distributed training test
* fix max line length error in windows build
* function header indent
* fix
* fix flake8 error
2020-09-21 14:35:01 -07:00
Tiago Koji Castro Shibata
cd663d58f5
Fix WinML warnings ( #5228 )
2020-09-19 12:41:42 -07:00
Guoyu Wang
78a29aebbc
[ORT Mobile] ORT Minimal E2E CI ( #5200 )
...
* Modify the ort minimal CI to ort minimal e2e ci
2020-09-19 18:43:22 +10:00
KeDengMS
ce3b67e0cd
[Python] Move symbolic_shape_infer from nuphar to tools ( #5162 )
...
* [Python] Move symbolic shape inference from nuphar to tools
* Fix PEP8 ERROR
2020-09-18 09:31:06 -07:00
Scott McKay
c46a480306
Update conversion script and process to simplify creating ORT format models and a minimal build ( #5217 )
...
* Update conversion script and process to simplify creating ORT format models and a minimal build.
2020-09-18 18:49:54 +10:00
liqunfu
f37e1292a1
--shm-size=1024m to fix nccl shared memory issue ( #5214 )
...
* --shm-size=256m to fix nccl shared memory issue
Co-authored-by: liqun <liqun@OrtTrainingDev4.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
2020-09-17 17:21:47 -07:00
Guoyu Wang
8156e0dd10
[ORT Mobile] Some updates to iOS/Android build settings ( #5184 )
...
* Update android CI and build settings
* add build_java to arm64 also
* Add ios signing param
* fix a small build warning
* address pr comments
2020-09-17 15:53:14 -07:00
Tiago Koji Castro Shibata
f3f119a945
Use onecore umbrella lib in onecore builds ( #5182 )
...
* delayload hack
* Skip tests
* Onecore uses onecore umbrella
* Uncomment tests
* cleanup
* Disable dev mode for WinML
2020-09-16 10:46:27 -07:00
Tiago Koji Castro Shibata
1a2e289d2d
Fix nuget build ( #5163 )
...
* Fix nuget content
* Revert "Fix nuget content"
This reverts commit e2cdcec4e39964c50eac2fb306c7a4bb84352443.
* Nuget packaging
* skip tests
* msbuild path
* Force msbuild version
* Workaround https://github.com/NuGet/Home/issues/7621
* cleanup
2020-09-16 10:37:09 -07:00
Changming Sun
a0a435abc6
Add sympy==1.1.1 to Linux docker image ( #5177 )
2020-09-15 16:08:49 -07:00
Wenbing Li
de6e3fb61d
Reduce IOS shared library size by symbol file. ( #5171 )
2020-09-14 23:59:41 -07:00
Scott McKay
089789c135
Revert change to disable support for loading ORT format models in the packaging pipelines. ( #5168 )
2020-09-15 15:11:06 +10:00
RandySheriffH
1dde215d96
promote cuda version on packacking pipelines ( #5154 )
...
* promote cuda version on packacking pipelines
* fix cudnn version in py packaing template
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
2020-09-14 21:09:09 -07:00
Changming Sun
8946d212bf
Remove the dependency on CUDA SDk's version.txt ( #5155 )
2020-09-14 14:25:28 -07:00
Wenbing Li
2a456d16c0
Enable onnxruntime iOS shared library build. ( #5148 )
2020-09-14 10:32:39 -07:00
RandySheriffH
9392aa2f64
Promote Cuda version to 10.2 for windows pipelines ( #5138 )
2020-09-13 20:32:06 -07:00
Scott McKay
323a1ba8a4
Add option to exclude support for loading ORT format models in full build. ( #5129 )
...
* Add ability to exclude support for loading ORT format models.
Disable support for ORT format models in packages
2020-09-12 12:21:30 +10:00
RandySheriffH
120e3cda74
fix path ( #5131 )
...
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
2020-09-11 12:18:07 -07:00
Changming Sun
c5efb0085d
Update Linux GPU build pipelines to CUDA 10.2 ( #5120 )
...
* Update Linux GPU build pipelines to CUDA 10.2
2020-09-10 17:40:51 -07:00
Changming Sun
a5530358c9
Fix a path problem in Dockerfile.manylinux2014_cuda10_2 ( #5106 )
2020-09-10 10:30:13 -07:00
Tiago Koji Castro Shibata
62848c4de5
Add store builds to nuget packaging ( #5040 )
...
* Nuget store packaging
* Move DNNL workaround to EP
* Fix warning as error
* Disable store tests
* Skip store tests
* msbuild target
* Cross compile protoc in Store
* Disable DML in store
* Move store builds to CPU queue
* Copy uap10 to final nuget
* Fix pip8 error
* Remove extra dml copies
* Fix argparse
* pep8
* Forward IsStoreBuild
* Apply is_store_build to duplicate generate_nuspec
* runtimes
* Refactor uap10
* Store .NET
* uap
* PR feedback
2020-09-09 21:38:14 -07:00
RandySheriffH
5e10cde006
PipelinesForCuda11Cudnn8 ( #4938 )
...
* cancel night build on pyop
* setup win cuda11 pipeline
* add debug build
* test base gpu settings
* setup pipelines to test cuda 10.2 and 11
* rename linux docker images
* rename docker image tag and add clean up job
* fix typo in cuda 11 config
* set cuda11 env
* update linux cuda 11 pipeline
* reset docker image name
* disable uninitialized warning from linux build
* change the way to silence uninitialized warning
* add flags to linux gpu pipeline
* switch docker image for linux cuda 10.2
* switch linuc cuda 10.2 image
* test cuda11 with devtool8
* try latest built images
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
2020-09-09 16:13:58 -07:00
Changming Sun
924ecb0623
Use manylinux2014 for Linux CPU build ( #5091 )
2020-09-09 10:09:52 -07:00
Scott McKay
dbf4e7019d
Add ability to generate configuration file with required operators. ( #5089 )
...
* Add ability to generate configuration file with required operators.
2020-09-09 21:39:17 +10:00
Scott McKay
80ada0291f
Improve the minimal build size on android and linux ( #5086 )
...
Fix bug where linux build fails when python is enabled and rtti is disabled
Update doco for new build settings
2020-09-09 21:38:34 +10:00
gwang-msft
a1a81470e3
Add minimal build binary size verification (arm64) to Android CI ( #5087 )
...
* Add minimal build binary size verification (arm64) to Android CI
* Add comments in the CI ymal
2020-09-09 19:06:20 +10:00
gwang-msft
a40d34386a
Add Linux CPU CI for ORT minimal build ( #5074 )
...
* initial test version
* update yml
* minor updates
* minor updates
* Test minimal build
* update with include ops for minimal build ut only
* error case to see build failure
* test no_exceptio
* Remove error cases
* address pr comments
Co-authored-by: gwang0000 <62914304+gwang0000@users.noreply.github.com>
2020-09-08 17:09:33 -07:00
Cameron Maske
4553b2eecd
Expose DirectML provider to python (conflicts resolved from #3359 ) ( #4630 )
2020-09-08 14:34:09 -07:00