mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-30 20:18:08 +00:00
Update Phi-3 on-device blog (#20744)
### Description Updated blog link so it goes directly to the Hugging Face blog site ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. -->
This commit is contained in:
parent
944db3ed6c
commit
a5a36f11a7
2 changed files with 1 additions and 31 deletions
|
|
@ -48,7 +48,7 @@
|
|||
date: 'May 20th, 2024',
|
||||
blurb:
|
||||
"Harness ONNX Runtime to run Phi-3-mini on mobile phones and in the browser.",
|
||||
link: 'blogs/phi-3-on-device',
|
||||
link: 'https://huggingface.co/blog/Emma-N/enjoy-the-power-of-phi-3-with-onnx-runtime',
|
||||
image: Phi3OnDeviceImage,
|
||||
imgalt:
|
||||
'Chart comparing model size (in GB) of ONNX Phi-3-mini for web and mobile with original Phi-3-mini'
|
||||
|
|
|
|||
|
|
@ -1,30 +0,0 @@
|
|||
---
|
||||
title: 'Enjoy the power of Phi-3 with ONNX Runtime on your device'
|
||||
date: '20th May, 2024'
|
||||
description: 'Harness ONNX Runtime and Olive to optimize and run the state-of-the-art Phi-3-mini model on your mobile phone or directly in your browser!'
|
||||
keywords: 'ORT, ONNX Runtime, ONNX, machine learning, deep learning, phi 3, phi-3, webgpu, webnn, webassembly, hugging face, huggingface, transformers.js'
|
||||
authors:
|
||||
[
|
||||
'Emma Ning (Microsoft)',
|
||||
'Scott McKay (Microsoft)',
|
||||
'Guenther Schmuelling (Microsoft)',
|
||||
'Joshua Lochner (Hugging Face)'
|
||||
]
|
||||
authorsLink:
|
||||
[
|
||||
'https://www.linkedin.com/in/qiong-ning-21b554236/',
|
||||
'https://www.linkedin.com/in/scott-mckay-68b5ab/',
|
||||
'https://www.linkedin.com/in/guentherschmuelling/',
|
||||
'https://www.linkedin.com/in/xenova/?originalSubdomain=za'
|
||||
]
|
||||
image: ''
|
||||
url: 'https://onnxruntime.ai/blogs/phi-3-on-device'
|
||||
---
|
||||
|
||||
Want to own a private and powerful chatbot on your device with full data privacy and no need for an internet connection?
|
||||
|
||||
Harness ONNX Runtime and Olive to optimize and run the state-of-the-art Phi-3-mini model on your mobile phone or directly in your browser!
|
||||
|
||||
Enjoy models optimized for mobile and web with a size reduction of over 2.5 times, and run Phi-3-mini at over 70 tokens per second in the browser on an Nvidia RTX 4090!
|
||||
|
||||
Check out the full blog [here](https://huggingface.co/blog/Emma-N/enjoy-the-power-of-phi-3-with-onnx-runtime).
|
||||
Loading…
Reference in a new issue