onnxruntime/orttraining/orttraining
Prathik Rao 93e0a15117
implement cos gradient as a function op (#13227)
### Description
Implemented gradient of cos as per the function below.

![image](https://user-images.githubusercontent.com/31260940/193900310-b62a3e77-06d5-45af-ad28-a1d41920bad0.png)

### Motivation and Context
Cos gradient required for [huggingface's diffusers
library](https://github.com/huggingface/diffusers)

### Testing
built ORT from source: `./build.sh --config RelWithDebInfo
--enable_training --use_cuda --cuda_home /usr/local/cuda --cudnn_home
/usr/local/cuda --build_wheel --parallel --skip_tests`
tested CosGrad implementation: `cd build/Linux/RelWithDebInfo/ &&
./onnxruntime_test_all --gtest_filter=GradientCheckerTest.CosGrad`

Co-authored-by: Prathik Rao <prathikrao@microsoft.com>
2022-10-11 10:11:19 -07:00
..
core implement cos gradient as a function op (#13227) 2022-10-11 10:11:19 -07:00
eager Pinning manual seed (#12714) 2022-08-25 10:09:02 -07:00
lazy_tensor Fix typo enviroment => environment (#13195) 2022-10-03 17:02:26 -07:00
models Fix typo enviroment => environment (#13195) 2022-10-03 17:02:26 -07:00
python [ORTModule] Fix Custom Op Registry for Torch 1.13+ (#13250) 2022-10-11 15:20:51 +08:00
test implement cos gradient as a function op (#13227) 2022-10-11 10:11:19 -07:00
training_api Introduce Training C++ Apis (#12994) 2022-10-06 20:13:37 -07:00
training_ops convert singrad to function op and remove cpu kernel (#13263) 2022-10-11 10:11:08 -07:00