onnxruntime/onnxruntime/test/optimizer
jingyanwangms 20c47ce91c
Simplified layer norm changes (#5028)
* t5 layer norm changes

* add t5 layer norm kernel

* use template for t5 layer norm

* template definition changes

* no build error

* add CPU cuda kernel

* first unit test

* other forward unit tests

* add T5LayerNormGrad

* Add c++ transform and test for T5 LN

* fix and some debug prints

* fix cuda error

* rename from t5 to simplified

* PR comments

* revert change on invertible LM code path

* remove duplicate forward computation

* add GradientCheckerTest.SimplifiedLayerNormGrad

* change back macro

* Fix SimplifiedLayerNorm Gradient

* merge with Sherlockss changes

* changed cuda kernel

* reapply cpu kernel changes

Co-authored-by: Jingyan Wang <jingywa@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Co-authored-by: aishwarya bhandare <aibhanda@microsoft.com>
Co-authored-by: Sherlock Huang <bahuang@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
2020-10-12 11:22:12 -07:00
..
cse_test.cc Allow multiple sessions to share an allocator, optimize constant folding memory usage, expose arena configs. (#4813) 2020-08-22 10:03:17 -07:00
dummy_graph_transformer.h
free_dimension_override_test.cc Enable free dimension override by name 2020-04-15 16:21:52 -07:00
graph_transform_test.cc Simplified layer norm changes (#5028) 2020-10-12 11:22:12 -07:00
graph_transform_test_fixture.h Fix GraphTransformationTests tests. 2020-04-21 18:43:49 +00:00
graph_transform_utils_test.cc Allow multiple sessions to share an allocator, optimize constant folding memory usage, expose arena configs. (#4813) 2020-08-22 10:03:17 -07:00
initializer_test.cc Add support for loading TensorProtos with external data from optimizer Initializer (#3045) 2020-02-28 13:19:16 -08:00
nchwc_optimizer_test.cc NCHWc optimizer fixes for quantized models (#5203) 2020-09-17 09:52:21 -07:00
optimizer_test.cc Pass Model Path to TensorProtoToMLValue from Constant Folding for External Inputs (#5000) 2020-09-02 21:54:40 +08:00
rule_based_graph_transformer_test.cc Avoid some heap allocations in the InferenceSession and Model classes (#3103) 2020-03-12 18:38:10 -07:00