onnxruntime/orttraining
Juliana Franco 36c03b32e9
Using a map of of ops to stages as input of partition function. (#5940)
* New partition algorithm running before AD

* Convert cut_group_info into device map. Work in progress -- works for  bert-tiny with pp=2

* Removing code for partition of bwd graphs

* Remove old code

* Adding some verification code

* Handle Shared Initializer

* Renaming rank with stage

* Added first unit test

* new test

* redundant check

* undo change in bert

* Moved cut-based partition to testing utils file

Co-authored-by: xzhu1900
Co-authored-by: wschin

* New conversion function and tests

* minor

* remove test that is not needed2

* improve GetDeviceAssignment and PR comments

* minor changes

* PR comments

* improving documentation and variable naming

* add documentation

* Variable naming and docs

* more doc improvements

* more doc improvements

* missing static cast

* Fix test file for windows

* Fix test file for windows

* Fix test file for windows

* stage id is not the same as rank id

* PR comments

* PR comments

* More comments

* More comments
2020-12-17 09:03:33 -08:00
..
orttraining Using a map of of ops to stages as input of partition function. (#5940) 2020-12-17 09:03:33 -08:00
pytorch_frontend_examples Enable running the mnist_training sample without cuda (#6085) 2020-12-15 17:06:54 -08:00
tools add dockerfile for ROCm3.10 and update BUILD.md for ROCm EP (#5821) 2020-12-08 23:14:56 -08:00