onnxruntime/docs/ORT_Format_Update_in_1.13.md
Rui Ren 1a48099eea
ORT 1.14.0 release -- cherry pick round1 (#14456)
### Description
<!-- Describe your changes. -->
First round cherry pick, total `19` PRs, as below. Please check here for
[Here](https://github.com/microsoft/onnxruntime/issues?q=label%3Arelease%3A1.14+sort%3Aupdated-asc)
for the total list.
<head>

<meta name=ProgId content=Excel.Sheet>
<meta name=Generator content="Microsoft Excel 15">
<link id=Main-File rel=Main-File

href="file:///C:/Users/ruiren/AppData/Local/Temp/msohtmlclip1/01/clip.htm">
<link rel=File-List

href="file:///C:/Users/ruiren/AppData/Local/Temp/msohtmlclip1/01/clip_filelist.xml">
<style>
<!--table
	{mso-displayed-decimal-separator:"\.";
	mso-displayed-thousand-separator:"\,";}
@page
	{margin:.75in .7in .75in .7in;
	mso-header-margin:.3in;
	mso-footer-margin:.3in;}
tr
	{mso-height-source:auto;}
col
	{mso-width-source:auto;}
br
	{mso-data-placement:same-cell;}
td
	{padding-top:1px;
	padding-right:1px;
	padding-left:1px;
	mso-ignore:padding;
	color:black;
	font-size:11.0pt;
	font-weight:400;
	font-style:normal;
	text-decoration:none;
	font-family:Calibri, sans-serif;
	mso-font-charset:0;
	mso-number-format:General;
	text-align:general;
	vertical-align:bottom;
	border:none;
	mso-background-source:auto;
	mso-pattern:auto;
	mso-protection:locked visible;
	white-space:nowrap;
	mso-rotate:0;}
.xl65
	{text-align:center;}
.xl66
	{color:windowtext;
	text-align:center;
	border:.5pt solid windowtext;
	background:#E2EFDA;
	mso-pattern:black none;}
.xl67
	{color:windowtext;
	text-align:center;
	border:.5pt solid windowtext;}
.xl68
	{color:windowtext;
	text-align:center;
	border:.5pt solid windowtext;
	background:white;
	mso-pattern:black none;}
-->
</style>
</head>

<body link="#0563C1" vlink="#954F72">



Date | PR | # | Commit # | Short #
-- | -- | -- | -- | --
0 | fix headers for training apis | 14350 |
ea7bbd667d | ea7bbd6
1 | Fix post merge jobs pipeline build issues | 14346 |
ae0e090c7b | ae0e090
2 | support ScatterND(18) and ScatterElement(18) | 14224 |
5d6a049141 | 5d6a049
3 | Exclude a multi-stream case from reduced ops build | 14351 |
36ba3d8d21 | 36ba3d8
4 | Support muP in Attention | 14348 |
668586e8f8 | 668586e
5 | Add memory efficient attention from CUTLASS | 14343 |
414b012f42 | 414b012
6 | Add PyTorch 2.0 to ORT transformer benchmarking | 14300 |
72821a6113 | 72821a6
7 | Misc transformer fixes - 3 | 14320 |
2d8ee5251c | 2d8ee52
8 | Update quantization_defs.cc | 14380 |
de7a868d5f | de7a868
9 | Revert "Allow PostAnalysis@2 task to continue on error for
Windows_Pa… | 14375 | cf3661ff6d | cf3661f
10 | Fix fuzz test | 14385 | f03c507cf0 |
f03c507
11 | support Pad(18) | 14219 | 05915d8393
| 05915d8
12 | Ort openvino 4.3 cli | 14341 |
77b455b969 | 77b455b
13 | cpu to support bitwise ops | 14197 |
7b6d880b28 | 7b6d880
14 | Update ORT format v5 change docs to cover limited backwards
compatibility in 1.14. | 14413 |
3bc092b1ea | 3bc092b
15 | Upgrade CUTLASS to v2.11 and add sequence length threshold for
cutlass FMHA | 14401 | 94b1791974 |
94b1791
16 | Add Col2Im CPU op | 12311 |
32c05fcdd1 | 32c05fc
17 | [DML EP] Upgrade DML to 1.10.1 | 14433 |
edb377f2cb | edb377f
18 | cpu support of LpPool(18) | 14205 |
2b1a59f01a | 2b1a59f



</body>

</html>


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
First round cherry-pick for ORT 1.14.0 release.

---------

Signed-off-by: Liqun Fu <liqfu@microsoft.com>
Co-authored-by: Ashwini Khade <askhade@microsoft.com>
Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
Co-authored-by: liqun Fu <liqfu@microsoft.com>
Co-authored-by: RandySheriffH <48490400+RandySheriffH@users.noreply.github.com>
Co-authored-by: Randy Shuai <rashuai@microsoft.com>
Co-authored-by: Ye Wang <52801275+wangyems@users.noreply.github.com>
Co-authored-by: Ubuntu <wy@v100-2.0cdb2e52twzevn1i4fi45bylyg.jx.internal.cloudapp.net>
Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
Co-authored-by: kunal-vaishnavi <115581922+kunal-vaishnavi@users.noreply.github.com>
Co-authored-by: Hariharan Seshadri <shariharan91@gmail.com>
Co-authored-by: Yi Zhang <zhanyi@microsoft.com>
Co-authored-by: Hector Li <hecli@microsoft.com>
Co-authored-by: sfatimar <sahar.fatima@intel.com>
Co-authored-by: Preetha <preetha.veeramalai@intel.com>
Co-authored-by: Thiago Crepaldi <thiago.crepaldi@microsoft.com>
Co-authored-by: Sumit Agarwal <sumitagarwal330@gmail.com>
2023-01-31 14:35:34 -08:00

1.3 KiB

ORT Format Update in 1.13

In ONNX Runtime 1.13, there was a breaking change to the ORT format (version 5) in order to enable additional execution providers with statically registered kernels in a minimal build. More details can be found here.

Backwards Compatibility

ONNX Runtime 1.13

Any older models (prior to ORT format version 5) will no longer work with ONNX Runtime 1.13 and must be re-converted.

ONNX Runtime 1.14+

ONNX Runtime 1.14+ provides limited backwards compatibility for loading older models (prior to ORT format version 5).

  • In a full build, older models may be loaded but any saved runtime optimizations will be ignored.
  • In a minimal build, older models cannot be loaded.

An older model may be re-converted.

It is also possible to load an older ORT format model in a full build and then save it back out as an ORT format model. This process may be used to upgrade an ORT format model. However, any saved runtime optimizations from the older model will be ignored.

Re-converting an ORT format model

Please refer here for instructions on how to convert an ONNX model to ORT format.