Baiju Meswani
249c4dec7f
Update orttraining release pipelines to use torch 1.11.0 ( #11018 )
...
* Update orttraining release pipelines to use torch 1.11.0
* Change requirements_torch...txt to requirements.txt
* Update cuda cmake architectures and clean up old files
2022-03-31 21:51:06 -07:00
Changming Sun
8e6dbad287
FIX: Nuget pipeline doesn't report binary size for Linux ARM64
...
In #10652 #10637 #10624 , we changed the RID. But I forgot to update this part.
2022-03-31 18:32:05 -07:00
dependabot[bot]
79e4ed8064
Bump pytorch-lightning
...
Bumps [pytorch-lightning](https://github.com/PyTorchLightning/pytorch-lightning ) from 1.5.10 to 1.6.0.
- [Release notes](https://github.com/PyTorchLightning/pytorch-lightning/releases )
- [Changelog](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/CHANGELOG.md )
- [Commits](https://github.com/PyTorchLightning/pytorch-lightning/compare/1.5.10...1.6.0 )
---
updated-dependencies:
- dependency-name: pytorch-lightning
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-31 16:51:24 -07:00
Linnea May
bfcd5bd4a2
remove hardcoded library name ( #11058 )
...
Co-authored-by: Linnea May <linneamay@microsoft.com>
2022-03-31 10:41:31 -07:00
RandySheriffH
9505e8c6c1
fix json format ( #11046 )
...
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
2022-03-30 16:15:33 -07:00
Yulong Wang
179406bd25
[JS] upgrade package-lock.json from v1 to v2 ( #11039 )
...
* upgrade package-lock.json from v1 to v2
* upgrade requirement of nodejs version to 16.x
2022-03-30 13:30:28 -07:00
Yi Zhang
d1bdd2cd94
allow trailing slash in directory ( #11001 )
...
* allow trailing slash in directory
* fix lint
2022-03-30 09:42:57 +08:00
Edward Chen
9371401746
Move node EP assignment for ORT format into SessionState::FinalizeSessionState() ( #10944 )
...
Follow up to #10904 .
- Move node EP assignment for ORT format into SessionState::FinalizeSessionState().
- Add unit test for #10904 .
- Make convert_onnx_models_to_ort.py optimization level configurable via environment variable.
2022-03-28 10:37:22 -07:00
leqiao-1
8ddc45f52d
Add linux and macos arm64 java aritifacts ( #10981 )
2022-03-25 16:23:17 -07:00
Olivia Jain
de384805cd
Custom parameters ( #10964 )
...
* get inputs independently for trtexec
* track one process only
* remove engine and profile files
* change time to commit time
* add runtime option for io binding
* move to commit date
* fixes
* add option for graph optimization
* cleanup docker script
* note second time creation
* allow for parameters to be configured from pipeline at runtime
* uncomment
* include optional arguments at runtime
* post second session creation
* update cmake version
* Revert "update cmake version"
This reverts commit 09a1364eae68610724c8e90eeea777b7ee03f74b.
* Move data format import
2022-03-23 09:47:24 -07:00
Yi Zhang
0efbe92296
fix coverage report error in master build ( #10969 )
...
* fix error in master
* check NNAPI_EP_MASTER
* Revert "check NNAPI_EP_MASTER"
This reverts commit 59c9043b7c9bbcb4b495d2dd121ef6d4271be408.
* rm coverage in PR build
2022-03-23 16:00:57 +08:00
raviskolli
480c793125
Update training packages to Pytorch 1.11.0 ( #10851 )
...
* Update ortmodule training packages to Pytorch 1.11.0
Co-authored-by: Harshitha Venkata <havenka@microsoft.com>
Co-authored-by: Baiju Meswani <bmeswani@microsoft.com>
2022-03-22 16:45:51 -07:00
Yulong Wang
dce5d719c5
add build flag for emscripten settings ( #10963 )
...
* allows multiple '--cmake_extra_defines' flags
* fix flake8 error
* Add build flag for emscripten settings
* remove "emscripten_settings" in generate_build_tree()
* format code
2022-03-22 11:55:45 -07:00
Yulong Wang
2da82fd0b9
allows multiple '--cmake_extra_defines' flags ( #10953 )
...
* allows multiple '--cmake_extra_defines' flags
* fix flake8 error
2022-03-21 19:10:47 -07:00
Sunghoon
6d19c295d0
use lf as eol for node package ( #10965 )
2022-03-21 15:50:03 -07:00
Sunghoon
b34d9f6867
[js/wasm] Add WebAssembly static library build into web CI pipeline ( #10959 )
...
* add webassembly static library build into ci
* add webassembly static library build into ci
* skip publishing on static lib
* fix type
2022-03-21 15:49:49 -07:00
leqiao-1
a6ea278502
add python3.10 support ( #10848 )
...
* add python3.10 support
* upgrade numpy version in build pipeline
* add python 3.10 path
* upgrade torch version in build pipeline
* update docker run arguments
* change torch version
* fix typo
* fix permission issue
* change python version
* remove python3.10 for openvino build
* remove python 3.10 for openvino build
2022-03-21 09:46:02 +08:00
Scott McKay
91722e2bc4
Fix typos ( #10935 )
2022-03-20 08:27:35 +10:00
Yi Zhang
c1e37e4ebf
Android CI Pipeline: Fix post coverage bug ( #10949 )
2022-03-19 11:17:08 -07:00
Yi Zhang
3897b93606
optimize Android CI ( #10938 )
2022-03-19 11:00:21 +08:00
Scott McKay
5cbacec854
Maintain aspect ratio by doing resize + crop in image_to_pb tool ( #10887 )
2022-03-19 07:08:45 +10:00
Tiago Koji Castro Shibata
5ed2f4ad5f
Remove Windows Store specific code
2022-03-17 23:38:14 -07:00
Changming Sun
a3eeb7b0f7
Update orttraining-linux-external-custom-ops.yml for Azure Pipelines
2022-03-17 23:36:53 -07:00
Sunghoon
740870a285
[js] Create npm packaging pipeline ( #10886 )
...
* create npm packaging pipeline
* fix indentations
* Update npm-packaging-pipeline.yml for Azure Pipelines
* Update npm-packaging-pipeline.yml for Azure Pipelines
* Update npm-packaging-pipeline.yml for Azure Pipelines
* react-native-ci as a template
* fix typos
* fix template paths
* add a depencendy
* change a stage name
* set different artifact name for each package
* fix typo
* Update npm-packaging-pipeline.yml for Azure Pipelines
Set a build Id for node npm package as a parameter
* Update npm-packaging-pipeline.yml for Azure Pipelines
Set a build Id for node npm package as a parameter
* Update npm-packaging-pipeline.yml for Azure Pipelines
2022-03-17 16:44:00 -07:00
Chi Lo
aebbb90b79
Integrate C-API tests into Pipelines for release packages ( #10794 )
...
* add c-api test for package
* fix bug for running c-api test for package
* refine run application script
* remove redundant code
* include CUDA test
* Remove testing CUDA EP temporarily
* fix bug
* Code refactor
* try to fix YAML bug
* try to fix YAML bug
* try to fix YAML bug
* fix bug for multiple directories in Pipelines
* fix bug
* add comments and fix bug
* Update c-api-noopenmp-packaging-pipelines.yml
* Remove failOnStandardError flag in Pipelines
2022-03-15 10:18:38 -07:00
Scott McKay
f385c73058
Fix a couple of issues with the python package tools ( #10858 )
...
* Tweaks to the model utils
* Add handling for a dim_value of -1 when replacing the entire input shape. This occurs in models exported from PaddlePaddle
* make pytorch helpers accessible in package
* make QDQ helpers accessible in package
2022-03-15 15:52:12 +10:00
Edward Chen
e53422c6d0
Update convert_onnx_models_to_ort.py to support runtime optimizations. ( #10765 )
...
Add runtime optimization support to ONNX -> ORT format conversion script.
Replace `--optimization_level`, `--use_nnapi`, and `--use_coreml` with a new `--optimization_style` option.
2022-03-14 16:50:41 -07:00
Edward Chen
1a62306db7
Use separate build directories for full and mobile iOS packages. ( #10835 )
2022-03-10 19:33:06 -08:00
Chun-Wei Chen
5202efd11e
remove unused six in code and CIs ( #10832 )
2022-03-10 15:38:44 -08:00
Changming Sun
cc3a3476ed
Uninstall onnxruntime-training before running local tests ( #10827 )
...
* Uninstall onnxruntime-training before running local tests
2022-03-09 18:45:04 -08:00
Changming Sun
cc6bc34c8c
Update protobuf submodule ( #10801 )
2022-03-09 09:37:58 -08:00
Edward Chen
c147c9dda6
Remove ORT_ENABLE_RUNTIME_OPTIMIZATION_IN_MINIMAL_BUILD. ( #10778 )
...
Remove ORT_ENABLE_RUNTIME_OPTIMIZATION_IN_MINIMAL_BUILD as it is now implied by ORT_EXTENDED_MINIMAL_BUILD.
Remove related CMake option.
2022-03-08 16:18:49 -08:00
dependabot[bot]
7e04dccca7
Bump numpy in /tools/ci_build/github/linux/docker/scripts ( #10385 )
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.16.6 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.16.6...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-08 11:02:36 -08:00
Sunghoon
68c8f5a1ef
Change a pipeline vmImage from windows-latest to windows-2019 ( #10804 )
2022-03-08 10:49:59 -08:00
Changming Sun
6260733533
Fix eager mode pipeline ( #10802 )
...
It was still using python 3.6
2022-03-08 09:26:20 -08:00
liqun Fu
da885a72e8
update with onnx 1.11 release ( #10441 )
2022-03-07 21:10:55 -08:00
dependabot[bot]
4d943c9bd3
Bump numpy from 1.16.6 to 1.21.0 in /tools/ci_build/github/linux/docker/scripts/manylinux ( #10387 )
...
* Bump numpy in /tools/ci_build/github/linux/docker/scripts/manylinux
2022-03-07 20:39:49 -08:00
PeixuanZuo
c07a27a008
[FIX] delete python3.6 from AMD python package docker image builder ( #10790 )
...
* [UPDATE] delete python3.6 to cooperate numpy==1.21.0
* [UPDATE] delete python3.6 to cooperate numpy==1.21.0
2022-03-07 18:21:43 -08:00
RandySheriffH
a4b5fa334a
Add type and shape information to profiled numbers ( #10773 )
...
* add func to collect type shape
* reformat
* refactor perf view
* remove obsolete
2022-03-07 10:17:58 -08:00
Changming Sun
d8bf9a479b
Remove python 3.6 from training pipelines ( #10780 )
...
Because the numpy we use doesn't support python 3.6. And inference pipelines already removed python 3.6.
2022-03-07 09:57:24 -08:00
PeixuanZuo
55af7a96a7
update the amd ci pipeline ( #10723 )
...
* [TEST] test to get amd pipeline information
* [FIX] lower the threshold
* [UPDATE] add retry task
* [UPDATE] add retry task
* [ERROR] error to occur retry
* [FIX] error
* [UPDATE] update retryCountOnTaskFailure to 1 time
* [UPDATE] add showmeminfo
2022-03-07 18:39:42 +08:00
Fei Hu
60acfd3dd8
Support CUDA Graph in the CUDA EP ( #9978 )
2022-03-06 20:47:31 -08:00
Olivia Jain
12eb660415
Compare TRT vs ORT-TRT Accurately ( #10565 )
...
* get inputs independently for trtexec
* track one process only
* remove engine and profile files
* change time to commit time
* add runtime option for io binding
* move to commit date
* fixes
* add option for graph optimization
* cleanup docker script
* include remaining changes
* choose graph optimization option
* add space in option
2022-03-04 10:14:18 -08:00
dependabot[bot]
e3c85d4262
Bump numpy
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.19.5 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-04 09:51:32 -08:00
dependabot[bot]
b780a3784e
Bump numpy in /tools/ci_build/github/linux/docker/scripts/training
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.19.5 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-04 09:38:38 -08:00
dependabot[bot]
0b0e8ccf92
Bump numpy
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.19.5 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-04 09:34:58 -08:00
Edward Chen
395a7242d6
[iOS packaging] Minor updates. ( #10755 )
...
* Change storage container, simplify build definition parameters.
* Remove explicit version from Objective-C docs.
* Increase timeout.
* Use real storage account.
* Get static website URL with az cli.
2022-03-04 16:02:53 +10:00
Guoyu Wang
7aa706854f
Pipeline changes to build full ORT package for Android ( #10654 )
...
* Add android package build settings for full build
Co-authored-by: gwang0000 <62914304+gwang0000@users.noreply.github.com>
Co-authored-by: Scott McKay <skottmckay@gmail.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
2022-03-04 15:35:54 +10:00
Scott McKay
6072c6b65e
Simplify QLinearConv registration so type reduction works with it. ( #10747 )
...
* Simplify QLinearConv registration so type reduction works with it.
* Update QLinearMatMul registration to be a standard typed registration
2022-03-04 14:06:04 +10:00
Changming Sun
b3e96d6195
A new pipeline to replace the existing WindowsAI packaging pipeline ( #10646 )
2022-03-03 08:56:49 -08:00