onnxruntime/onnxruntime/contrib_ops
Vincent Wang 4df356d1c9
Train BERT Using BFloat16 on A100 (#6090)
* traing bert using bf16

* Adam support bf16

* bugfix

* add fusedmatmul support

* fix after merge from master.

* bugfix

* bugfix after merge from master

* fast reduction for bf16.

* resolve comments

* fix win build

* bugfix

* change header file.

Co-authored-by: Vincent Wang <weicwang@microsoft.com>
2021-01-14 19:04:32 +08:00
..
cpu MLAS: add fallback implementation for quantized GEMM (#6335) 2021-01-13 10:53:47 -08:00
cuda Train BERT Using BFloat16 on A100 (#6090) 2021-01-14 19:04:32 +08:00
rocm Enable add + softmax fusion for Rocm platform (#6259) 2021-01-13 14:09:09 -08:00