onnxruntime/onnxruntime
Tianlei Wu 5dce9be4f9
Add Attention Fusion Transformer (#2445)
Add Attention Fusion Transformer to fuse multi-head self attention subgraph to one node for optimizing Bert model inference performance.

It supports BERT model exported from PyTorch. It fuses about 20 nodes into one Attention node, and could significantly improve the inference speed of BERT model.

Support symbolic (first dimension for batch size) in input shape.
2019-11-25 14:46:37 -08:00
..
automl_ops Fix kernel registry bug (#2137) 2019-10-17 23:10:54 -07:00
contrib_ops Fuse SkipLayerNorm with Bias (#2453) 2019-11-22 14:20:46 -08:00
core Add Attention Fusion Transformer (#2445) 2019-11-25 14:46:37 -08:00
gsl Downgrade compiler to CentOS 4.8.5 (#1985) 2019-10-03 15:40:46 -07:00
python Direct use python numpy array's memory if already contiguous. (#2355) 2019-11-11 13:46:55 -08:00
server Openvino EP R3.1 onnxrt server (#2357) 2019-11-11 12:22:19 -08:00
test Add Attention Fusion Transformer (#2445) 2019-11-25 14:46:37 -08:00
tool/etw Add Tracelogging for profiling (#1639) 2019-11-11 21:34:10 -08:00
__init__.py Update version number 2019-10-30 08:13:09 -07:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings