onnxruntime/orttraining
pengwa 5ee47e3ffa
legacy_megatron-lm/deepspeed_ZERO1&2 FP16_Optimizer wrapper (#9184)
* megatron-lm FP16_Optimizer Wrap, allow model parallelism aggregation optional

* add deepspeed zero1 and zero2 - checkoverflow & clip norm

* re-structure code and add the copyright

* update the document

* refine the code after validation
2021-10-14 09:01:23 +08:00
..
orttraining legacy_megatron-lm/deepspeed_ZERO1&2 FP16_Optimizer wrapper (#9184) 2021-10-14 09:01:23 +08:00
pytorch_frontend_examples Sync ORTModule branch with master and fix tests (#6526) 2021-02-02 08:59:56 -08:00
tools Switch AMD CI pipeline to use environment image from onnxruntimecibuildenvironment (#9206) 2021-09-28 13:06:16 -07:00