onnxruntime/orttraining
pengwa 6d1eb9509e
Refine gradient accumulation (on device training) (#12363)
* a

(cherry picked from commit 43909cdd6e3daf30a82d584292286806d1172a0b)

* optimize inplace accumulator a bit

* fix inputs

* revert logging

* minor fix

* tune perf and resolve comments

* typo

* fix

* fix tests

* move threshold to constexpr.
2022-07-30 10:24:01 +08:00
..
orttraining Refine gradient accumulation (on device training) (#12363) 2022-07-30 10:24:01 +08:00
pytorch_frontend_examples Set black's target version (#11370) 2022-04-27 14:52:19 -07:00
tools [UPDATE] update AMD CI pipeline to Rocm5.2 with torch1.11 (#12162) 2022-07-14 16:38:16 +08:00