onnxruntime/docs/tutorials/inferencing/huggingface.md

title	grand_parent	parent	nav_order
Accelerate Hugging Face	Tutorials	Inferencing	4

Accelerate Hugging Face models

{: .no_toc }

ONNX Runtime can accelerate training and inferencing popular Hugging Face NLP models.

Accelerate Hugging Face model inferencing

• General export and inference: Hugging Face Transformers
• Accelerate GPT2 model on CPU
• Accelerate BERT model on CPU
• Accelerate BERT model on GPU

Additional resources

• Blog post: Faster and smaller quantized NLP with Hugging Face and ONNX Runtime
• Blog post: Accelerate your NLP pipelines using Hugging Face Transformers and ONNX Runtime