Jian Chen
7a7e372b9f
Remove training cuda 10.2 pipeline ( #12347 )
...
* update to 2022
* Update the VS version
* Rolling back to gcc 10
* Rolling back
* Update cuda home
* remove "CMAKE_CUDA_ARCHITECTURES=52"
* update cuda Architure to 70
* Delete cuda 10.2 training pipeline
* rolling back a mistake
* Update win-gpu-reduce-op-ci-pipeline.yml
* Update win-gpu-reduce-op-ci-pipeline.yml
* Update win-gpu-reduce-op-ci-pipeline.yml
* Delete tools/ci_build/github/linux/docker/scripts/training/ortmodule/stage1/requirements_torch1.10.0_cu10.2 directory
* Delete tools/ci_build/github/linux/docker/scripts/training/ortmodule/stage1/requirements_torch1.11.0_cu10.2 directory
2022-07-28 14:58:17 -04:00
msftlincoln
9cf6912bba
Fix ORT Eager Mode to work with Pytorch 1.12 ( #12323 )
2022-07-27 16:24:46 -04:00
pengwa
2b2367efbf
Fix orttraining-linux-gpu-ci-pipeline (fairscale dependency) ( #12320 )
...
authored by: @pengwa
2022-07-26 15:11:04 -07:00
LironKesem
9647a3be40
Add tests for all unary aten ops supported in eager mode ( #12087 )
...
* Add tests for all uniary aten ops supported in eager mode
* fixing the PR draft
* fixing the merge
* changing eval to be at compile time
* adding requirements for eager
* 1.adding function to {ops}_out
2.cleaning the code
and adding comments
* editing the code according to code review
Co-authored-by: root <root@AHA-LIRONKESE-1>
2022-07-12 08:53:19 -04:00
PeixuanZuo
1c39d22f4e
[ADD] Rocm5.2 for Rocm python packaging pipeline ( #12129 )
...
[ADD] rocm5.2
2022-07-11 11:10:45 +08:00
Wil Brady
fdf12a5c35
Fix windows eager build break by pinning to torch version 1.11.0 ( #12033 )
...
Fix windows and linux eager build to torch 1.11.0.
2022-06-30 07:01:13 -04:00
pengwa
c398ad513f
Fix orttraining-linux-ci-pipeline - Symbolic shape infer ( #11965 )
...
fix symbolic shape error due to upgraded numpy + legacy sympy
2022-06-23 08:23:36 -07:00
Gary Miguel
4bf22e2a40
Update ONNX to 1.12 ( #11924 )
...
Follow-ups that need to happen after this and before the next ORT release:
* Support SequenceMap with https://github.com/microsoft/onnxruntime/pull/11731
* Support signal ops with https://github.com/microsoft/onnxruntime/pull/11778
Follow-ups that need to happen after this but don't necessarily need to happen before the release:
* Implement LayerNormalization kernel for opset version 17: https://github.com/microsoft/onnxruntime/issues/11916
Fixes #11640
2022-06-21 17:19:52 -07:00
Yi Zhang
7f1e9e8c67
Bash: there should be a whitespace after not operator. ( #11910 )
...
add whitespace after not
2022-06-21 05:14:32 +08:00
sfatimar
f97bd38c4f
UEP 4.1 release ( #11834 )
...
* Add pypi build changes to latest Master
* Add ORT training part of OV build
* Disabling SqueezeOpTest.BadAxes
* Add ONNXruntime branch ARG to Docker build
* Changes to include file details versions
* Commit File Version Updates
* Change naming for linux build
* Add fix for pylint format errors
* Fix pylint warnings.
* Fix pylint errors - stage 2
Signed-off-by: Preetha Veeramalai <preetha.veeramalai@intel.com>
* Fix pylint errors - stage 3
* Fix pylint format - stage4
Signed-off-by: Preetha Veeramalai <preetha.veeramalai@intel.com>
* Commit for Wheel Release >0.35.1
Co-authored-by: Preetha Veeramalai <preetha.veeramalai@intel.com>
Co-authored-by: mayavijx <mayax.vijayan@intel.com>
Co-authored-by: Sahar Fatima <sfatima.3001@gmail.com>
Co-authored-by: nmaajidk <n.maajid.khan@intel.com>
2022-06-17 14:49:04 -07:00
Yi Zhang
8bb0062873
add manylinux_2_27 CPU wheel ( #11886 )
...
* add manylinux_2_27
* minor refactory
* change base image
* minor refactor
* add tests
* fix condition
2022-06-17 19:38:38 +08:00
Changming Sun
10478a09ca
Revert "add manylinux_2_27 wheel ( #11832 )"
...
This reverts commit bbace23d0c
2022-06-16 18:28:12 -07:00
Yi Zhang
bbace23d0c
add manylinux_2_27 wheel ( #11832 )
...
* add manylinux_2_27
2022-06-15 10:26:51 +08:00
Vincent Wang
5ecfaef042
ATen Fallback for Inference ( #11597 )
...
* aten op for inference
* fix build error
* more some code to training only
* remove domain from operator name
* move aten_op_executor ext out from ortmodule
* add pipeline
* add exec mode
* fix script
* fix ut script
* fix test pipeline
* failure test
* rollback
* bugfix
* resolve comments
* enable aten for python build only
* fix win build
* use target_compile_definitions
* support io binding
* turn off aten by default
* fix ut
Co-authored-by: Vincent Wang <weicwang@microsoft.com>
Co-authored-by: zhijxu <zhijxu@microsoft.com>
2022-06-09 16:07:30 +08:00
Valery Chernov
4296968f20
[TVM EP] update set input method for VirtualMachine ( #11674 )
...
* update TVM
* get alignment constant from TVM
* update TVM_VM_SetInputs to upstream with TVM API
* fix CI issue: update TVM EP dependencies
* add sudo
* revert changes needed to install missing package
* add package for TVM EP CI
Co-authored-by: Valery Chernov <valery.chernov@deelvin.com>
Co-authored-by: KJlaccHoeUM9l <wotpricol@mail.ru>
2022-06-04 09:31:01 +02:00
leqiao-1
2ac3649752
Update requirements.txt ( #11682 )
...
set protobuf version
2022-06-01 12:31:21 +08:00
Changming Sun
6a45f9f059
Pin protobuf version to 3.18.1 ( #11645 )
2022-05-26 21:14:56 -07:00
PeixuanZuo
c556f5f22f
Add AMD python package ROCm5.1.1+torch1.11 ( #11516 )
...
* [FIX] fix name error
* [ADD] add rocm5.1.1 python package
* [ADD] torch1.10.0 rocm requirements
* [UPDATE] update docker Repository name
2022-05-16 08:14:11 +08:00
Justin Chu
a1f9847b23
[Fix] Add the extra param to match gelu in PyTorch in the contrib symbolic function ( #11318 )
...
Description:
Add the extra param to match gelu in PyTorch in the contrib symbolic function
Motivation and Context
Why is this change required? What problem does it solve?
The symbolic function in /onnxruntime/python/tools/pytorch_export_contrib_ops.py is missing a recently added parameter approximate. We add this parameter and use the exporter defined gelu if approximate is "tanh".
2022-05-04 10:36:38 -07:00
ytaous
eec5187801
Remove Rocm 4.2 from CI Build ( #11130 )
...
* remove rocm42 CI
* update torch to v1.11.0
Co-authored-by: Ethan Tao <ettao@microsoft.com@orttrainingdev7.d32nl1ml4oruzj4qz3bqlggovf.px.internal.cloudapp.net>
2022-04-07 11:42:09 -07:00
Baiju Meswani
f9940f17b1
Remove extra-index-url to avoid nuget security analysis vulnerability ( #11082 )
2022-04-01 18:30:55 -07:00
Baiju Meswani
249c4dec7f
Update orttraining release pipelines to use torch 1.11.0 ( #11018 )
...
* Update orttraining release pipelines to use torch 1.11.0
* Change requirements_torch...txt to requirements.txt
* Update cuda cmake architectures and clean up old files
2022-03-31 21:51:06 -07:00
dependabot[bot]
79e4ed8064
Bump pytorch-lightning
...
Bumps [pytorch-lightning](https://github.com/PyTorchLightning/pytorch-lightning ) from 1.5.10 to 1.6.0.
- [Release notes](https://github.com/PyTorchLightning/pytorch-lightning/releases )
- [Changelog](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/CHANGELOG.md )
- [Commits](https://github.com/PyTorchLightning/pytorch-lightning/compare/1.5.10...1.6.0 )
---
updated-dependencies:
- dependency-name: pytorch-lightning
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-31 16:51:24 -07:00
Yulong Wang
179406bd25
[JS] upgrade package-lock.json from v1 to v2 ( #11039 )
...
* upgrade package-lock.json from v1 to v2
* upgrade requirement of nodejs version to 16.x
2022-03-30 13:30:28 -07:00
raviskolli
480c793125
Update training packages to Pytorch 1.11.0 ( #10851 )
...
* Update ortmodule training packages to Pytorch 1.11.0
Co-authored-by: Harshitha Venkata <havenka@microsoft.com>
Co-authored-by: Baiju Meswani <bmeswani@microsoft.com>
2022-03-22 16:45:51 -07:00
leqiao-1
a6ea278502
add python3.10 support ( #10848 )
...
* add python3.10 support
* upgrade numpy version in build pipeline
* add python 3.10 path
* upgrade torch version in build pipeline
* update docker run arguments
* change torch version
* fix typo
* fix permission issue
* change python version
* remove python3.10 for openvino build
* remove python 3.10 for openvino build
2022-03-21 09:46:02 +08:00
Chun-Wei Chen
5202efd11e
remove unused six in code and CIs ( #10832 )
2022-03-10 15:38:44 -08:00
Changming Sun
cc6bc34c8c
Update protobuf submodule ( #10801 )
2022-03-09 09:37:58 -08:00
dependabot[bot]
7e04dccca7
Bump numpy in /tools/ci_build/github/linux/docker/scripts ( #10385 )
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.16.6 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.16.6...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-08 11:02:36 -08:00
Changming Sun
6260733533
Fix eager mode pipeline ( #10802 )
...
It was still using python 3.6
2022-03-08 09:26:20 -08:00
liqun Fu
da885a72e8
update with onnx 1.11 release ( #10441 )
2022-03-07 21:10:55 -08:00
dependabot[bot]
4d943c9bd3
Bump numpy from 1.16.6 to 1.21.0 in /tools/ci_build/github/linux/docker/scripts/manylinux ( #10387 )
...
* Bump numpy in /tools/ci_build/github/linux/docker/scripts/manylinux
2022-03-07 20:39:49 -08:00
dependabot[bot]
e3c85d4262
Bump numpy
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.19.5 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-04 09:51:32 -08:00
dependabot[bot]
b780a3784e
Bump numpy in /tools/ci_build/github/linux/docker/scripts/training
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.19.5 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-04 09:38:38 -08:00
dependabot[bot]
0b0e8ccf92
Bump numpy
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.19.5 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt )
- [Commits](https://github.com/numpy/numpy/compare/v1.19.5...v1.21.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-03-04 09:34:58 -08:00
leqiao-1
8d06e5a9df
Add openvino base image option ( #10581 )
...
* add selectable python package build pipeline
* update tensorrt version
* update tensorrt version
* Update Dockerfile.ubuntu_openvino
* Update install_ubuntu.sh
* add parameters for openvino base image
* fix syntax error
2022-02-17 17:10:01 +08:00
leqiao-1
f22cd3af5d
Leqiao/add selectable pipeline ( #10560 )
...
* add selectable python package build pipeline
* update tensorrt version
* update tensorrt version
2022-02-16 09:07:29 +08:00
Changming Sun
feae842a7c
Update pytorch-lightning ( #10421 )
2022-01-27 21:15:00 -08:00
Thiago Crepaldi
6a7d3deb22
Update pytorch-lightning ( #10276 )
2022-01-14 16:49:10 -05:00
Abhishek Jindal
d5742f3a43
moving from torch nightly build to stable build ( #10150 )
...
* moving from torch nightly build to stable build
* using torch cpu version
* using torch cpu version from link
2021-12-29 19:35:10 -08:00
Suffian Khan
7e55a942cd
Add torch 1.10 requirements for rocm ( #10028 )
2021-12-13 20:39:58 -08:00
Xavier Dupré
42c176b60c
Update default opset to 14 in ORTModule ( #9743 )
...
* update to torch 1.10
* update torchvision version
* update torchtext version
* remove deprecated option enable_onnx_checker
* add unit test to test gradient of GatherElements
* add ORTMODULE_ONNX_OPSET_VERSION in a docker file
2021-12-09 12:45:35 +01:00
Tang, Cheng
8db49e3d0f
add ortmodule and eager mode test ( #9888 )
...
* add ortmodule and eager mode test
* add ortmodule dependency
* fix eager pipeline
* skip tthe ortmodule test for windows due to win ci issue
* remove useless win ci change
* add torch
Co-authored-by: Abhishek Jindal <abjindal@microsoft.com>
2021-12-02 19:49:18 -08:00
raviskolli
9f4e8cf6a0
Update training pipelines to pytorch 1.10 ( #9709 )
...
* Update training pipelines to pytorch 1.10
* Fixed a typo in cuda version.
* Downgraded gcc to 8 for cuda 10.2
2021-11-15 11:21:55 -08:00
Hariharan Seshadri
b5f7bb7d10
Update ONNX ( #9462 )
2021-10-29 10:33:40 -07:00
baijumeswani
1422a9ba6b
Remove previous temporary fixes and address TODOs ( #9020 )
2021-09-13 10:10:07 -07:00
Ashwini Khade
ec63d10303
add model local function support ( #8540 )
...
* updates for picking pnnx commit
* add tests filter to c# tests
* plus test fixes
* fix versioning for contrib ops
* fix tests
* test filter for optional ops
* more versioning related updates
* fix test
* fix layernorm spec
* more updates
* update docs
* add more test filters
* more filters
* update binary size threshold
* update docs
* draft - enable model local function
* enable model local functions in ORT
* update to latest rel onnx commit
* plus tests
* plus more updates
* plus updates
* test updates
* Fix for nested functions + shape inference
* plus bug fix and updates per review
* plus fixes per review
* plus test updates
* plus updates per review
* plus fixes
* fix a test
2021-09-08 11:47:01 -07:00
liqun Fu
a7f5bd226b
retarget torch181 to torch182 ( #8947 )
...
Co-authored-by: liqun <liqun@OrtTrainingDev4.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
2021-09-03 09:44:42 -07:00
Abhishek Jindal
868c8af9ac
Abjindal/eager mode pipeline ( #8870 )
...
* Adding pipeline file for eager mode
* adding the build eager mode flag
* adding torch wheel files for installation
* Changing pytorch version for change in wheel files
* updating requirements file path
* Removing Java and NodeJS from the build
* removing import torch for testing build of eager mode
* changing the build command
* import torch
* building eager mode separately
* removing Java tests
* python path issues
* changing python path location
* changing the build path file loc
* installing torch before build
* setting environment for building eager mode
* Copying the build file and getting rid of flags
* changing python path
* adding missing packages
* moving build eager mode code
* changing python path to python3
* adding amd_hipify
* adding logger file
* install torch before build
* change requirements file location
* install torch before build eager
* modifying eager mode build
* modifying build location
* adding new docker image
* handling gradle move issue
* Typo fix
* changing deps file
* adding java and nodejs
* changing repo name for docker image
* removing pybind
* building only eager mode
* changing the image name
* removing install wheel package
* build complete onnxruntime with eager mode
* building wheel
* enabling pybind
* adding build eager mode flag in unit tests
* removing build java nodejs
* adding build command
* removing java tests
* moving Debug tests before Release
* building Debug only case
* changing debug test code
* running the build eager mode with tests
* adding build dir
* adding build dir path
* changing build dir path
* changing build command for eager mode
* building eager mode and running tests simultaneously
* adding more flags to the pipeline
* chaning flag
* adding Debug and Release
* changing torch to nightly build
* changing torch version for nightly build
* chaning torch version
* move to Ubuntu image
* adding pool
* adding dockerfile for eager mode
* adding python deps file for eager
* modifying python deps file for eager
* changing deps file
* changing deps file statements
* changing python path
* REMOVING ECHO line
* going to original docker file
* changing docker file
* changing to eager requirements file
* changing python deps file
* changing paths
* changing cmake path
* changing build script
* changing python installation
* running debug mode only
* changing pipeline file
* test name
* test name
* test name2
* changing requirements file
* final flags for eager mode
* previous pipeline
* moving to ubuntu image and including some deps
* adding cmake path
* returning to manylinux image
* removing unncecessary files for pipeline
2021-08-30 18:24:39 -07:00
Changming Sun
9cd7d836f7
Delete Dockerfile.ubuntu_for_android ( #8848 )
2021-08-25 22:25:14 -07:00
