onnxruntime/orttraining
Ethan Tao 2f1e997e5b Merged PR 5686: fix P100/fp16 issues
1. misaligned address in atomic_add()
2. GatherNDGradKernel to use atomic_add
3. enable/add UTs for GatherNDGrad and reduction_ops using half
- __CUDA_ARCH__ won't take effect on .cc code, leverage HasCudaEnvironment() instead
4. verified convergence graph and perf test
- p100 is much slower than v100 on fp16
- fp16/128 need to reduce batch size from 66 to 64 to avoid OOM issue
5. verify convergence test on Dev3/v100

TBD - broken UTs related to MatmulIntegerOpTest (works on v100/windows, though)
2020-03-12 16:51:45 -07:00
..
docker Introduce training changes. 2020-03-11 14:39:03 -07:00
orttraining Merged PR 5686: fix P100/fp16 issues 2020-03-12 16:51:45 -07:00
pytorch_frontend Introduce training changes. 2020-03-11 14:39:03 -07:00
tools Introduce training changes. 2020-03-11 14:39:03 -07:00