saymrwulf/onnxruntime: ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-28 22:56:32 +00:00

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Find a file

dependabot[bot] 2bc3754494 Bump cookie and socket.io in /js/web (#22408 ) Bumps [cookie](https://github.com/jshttp/cookie) and [socket.io](https://github.com/socketio/socket.io). These dependencies needed to be updated together. Updates `cookie` from 0.4.2 to 0.7.2 <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/jshttp/cookie/releases">cookie's releases</a>.</em></p> <blockquote> <h2>v0.7.2</h2> <p><strong>Fixed</strong></p> <ul> <li>Fix object assignment of <code>hasOwnProperty</code> (<a href="https://redirect.github.com/jshttp/cookie/issues/177">#177</a>) bc38ffd</li> </ul> <p><a href="https://github.com/jshttp/cookie/compare/v0.7.1...v0.7.2">https://github.com/jshttp/cookie/compare/v0.7.1...v0.7.2</a></p> <h2>0.7.1</h2> <p><strong>Fixed</strong></p> <ul> <li>Allow leading dot for domain (<a href="https://redirect.github.com/jshttp/cookie/issues/174">#174</a>) <ul> <li>Although not permitted in the spec, some users expect this to work and user agents ignore the leading dot according to spec</li> </ul> </li> <li>Add fast path for <code>serialize</code> without options, use <code>obj.hasOwnProperty</code> when parsing (<a href="https://redirect.github.com/jshttp/cookie/issues/172">#172</a>)</li> </ul> <p><a href="https://github.com/jshttp/cookie/compare/v0.7.0...v0.7.1">https://github.com/jshttp/cookie/compare/v0.7.0...v0.7.1</a></p> <h2>0.7.0</h2> <ul> <li>perf: parse cookies ~10% faster (<a href="https://redirect.github.com/jshttp/cookie/issues/144">#144</a> by <a href="https://github.com/kurtextrem"><code>@kurtextrem</code></a> and <a href="https://redirect.github.com/jshttp/cookie/issues/170">#170</a>)</li> <li>fix: narrow the validation of cookies to match RFC6265 (<a href="https://redirect.github.com/jshttp/cookie/issues/167">#167</a> by <a href="https://github.com/bewinsnw"><code>@bewinsnw</code></a>)</li> <li>fix: add <code>main</code> to <code>package.json</code> for rspack (<a href="https://redirect.github.com/jshttp/cookie/issues/166">#166</a> by <a href="https://github.com/proudparrot2"><code>@proudparrot2</code></a>)</li> </ul> <p><a href="https://github.com/jshttp/cookie/compare/v0.6.0...v0.7.0">https://github.com/jshttp/cookie/compare/v0.6.0...v0.7.0</a></p> <h2>0.6.0</h2> <ul> <li>Add <code>partitioned</code> option</li> </ul> <h2>0.5.0</h2> <ul> <li>Add <code>priority</code> option</li> <li>Fix <code>expires</code> option to reject invalid dates</li> <li>pref: improve default decode speed</li> <li>pref: remove slow string split in parse</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="`d19eaa1a2b`"><code>d19eaa1</code></a> 0.7.2</li> <li><a href="`bc38ffd0ea`"><code>bc38ffd</code></a> Fix object assignment of <code>hasOwnProperty</code> (<a href="https://redirect.github.com/jshttp/cookie/issues/177">#177</a>)</li> <li><a href="`cf4658f492`"><code>cf4658f</code></a> 0.7.1</li> <li><a href="`6a8b8f5a49`"><code>6a8b8f5</code></a> Allow leading dot for domain (<a href="https://redirect.github.com/jshttp/cookie/issues/174">#174</a>)</li> <li><a href="`58015c0b93`"><code>58015c0</code></a> Remove more code and perf wins (<a href="https://redirect.github.com/jshttp/cookie/issues/172">#172</a>)</li> <li><a href="`ab057d6c06`"><code>ab057d6</code></a> 0.7.0</li> <li><a href="`5f02ca8768`"><code>5f02ca8</code></a> Migrate history to GitHub releases</li> <li><a href="`a5d591ce84`"><code>a5d591c</code></a> Migrate history to GitHub releases</li> <li><a href="`51968f94b5`"><code>51968f9</code></a> Skip isNaN</li> <li><a href="`9e7ca51ade`"><code>9e7ca51</code></a> perf(parse): cache length, return early (<a href="https://redirect.github.com/jshttp/cookie/issues/144">#144</a>)</li> <li>Additional commits viewable in <a href="https://github.com/jshttp/cookie/compare/v0.4.2...v0.7.2">compare view</a></li> </ul> </details> <details> <summary>Maintainer changes</summary> <p>This version was pushed to npm by <a href="https://www.npmjs.com/~blakeembrey">blakeembrey</a>, a new releaser for cookie since your current version.</p> </details> <br /> Updates `socket.io` from 4.7.5 to 4.8.0 <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/socketio/socket.io/releases">socket.io's releases</a>.</em></p> <blockquote> <h2>socket.io-client@4.8.0</h2> <h3>Features</h3> <h4>Custom transport implementations</h4> <p>The <code>transports</code> option now accepts an array of transport implementations:</p> <pre lang="js"><code>import { io } from "socket.io-client"; import { XHR, WebSocket } from "engine.io-client"; <p>const socket = io({ transports: [XHR, WebSocket] }); </code></pre></p> <p>Here is the list of provided implementations:</p> <table> <thead> <tr> <th>Transport</th> <th>Description</th> </tr> </thead> <tbody> <tr> <td><code>Fetch</code></td> <td>HTTP long-polling based on the built-in <code>fetch()</code> method.</td> </tr> <tr> <td><code>NodeXHR</code></td> <td>HTTP long-polling based on the <code>XMLHttpRequest</code> object provided by the <code>xmlhttprequest-ssl</code> package.</td> </tr> <tr> <td><code>XHR</code></td> <td>HTTP long-polling based on the built-in <code>XMLHttpRequest</code> object.</td> </tr> <tr> <td><code>NodeWebSocket</code></td> <td>WebSocket transport based on the <code>WebSocket</code> object provided by the <code>ws</code> package.</td> </tr> <tr> <td><code>WebSocket</code></td> <td>WebSocket transport based on the built-in <code>WebSocket</code> object.</td> </tr> <tr> <td><code>WebTransport</code></td> <td>WebTransport transport based on the built-in <code>WebTransport</code> object.</td> </tr> </tbody> </table> <p>Usage:</p> <table> <thead> <tr> <th>Transport</th> <th>browser</th> <th>Node.js</th> <th>Deno</th> <th>Bun</th> </tr> </thead> <tbody> <tr> <td><code>Fetch</code></td> <td>✅</td> <td>✅ (1)</td> <td>✅</td> <td>✅</td> </tr> <tr> <td><code>NodeXHR</code></td> <td></td> <td>✅</td> <td>✅</td> <td>✅</td> </tr> <tr> <td><code>XHR</code></td> <td>✅</td> <td></td> <td></td> <td></td> </tr> <tr> <td><code>NodeWebSocket</code></td> <td></td> <td>✅</td> <td>✅</td> <td>✅</td> </tr> <tr> <td><code>WebSocket</code></td> <td>✅</td> <td>✅ (2)</td> <td>✅</td> <td>✅</td> </tr> <tr> <td><code>WebTransport</code></td> <td>✅</td> <td>✅</td> <td></td> <td></td> </tr> </tbody> </table> <p>(1) since <a href="https://nodejs.org/api/globals.html#fetch">v18.0.0</a> (2) since <a href="https://nodejs.org/api/globals.html#websocket">v21.0.0</a></p> <p>Added in <a href="`f4d898ee96`">f4d898e</a> and <a href="`b11763beec`">b11763b</a>.</p> <h4>Test each low-level transports</h4> <p>When setting the <code>tryAllTransports</code> option to <code>true</code>, if the first transport (usually, HTTP long-polling) fails, then the other transports will be tested too:</p> <pre lang="js"><code>import { io } from "socket.io-client"; </tr></table> </code></pre> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="`d0fc720420`"><code>d0fc720</code></a> chore(release): socket.io@4.8.0</li> <li><a href="`4a0555c671`"><code>4a0555c</code></a> chore(release): socket.io-client@4.8.0</li> <li><a href="`2b60df18a8`"><code>2b60df1</code></a> chore(release): engine.io@6.6.1</li> <li><a href="`d4cb375856`"><code>d4cb375</code></a> ci: ignore tests when publishing to npm</li> <li><a href="`c251ae7ba7`"><code>c251ae7</code></a> chore(release): engine.io-client@6.6.1</li> <li><a href="`8a2f5a3da0`"><code>8a2f5a3</code></a> fix(eio-client): move 'offline' event listener at the top</li> <li><a href="`b04fa64365`"><code>b04fa64</code></a> fix(sio): allow to join a room in a middleware (uws)</li> <li><a href="`7085f0e3e4`"><code>7085f0e</code></a> refactor(sio-client): mangle private attributes</li> <li><a href="`4f66708210`"><code>4f66708</code></a> chore(sio-client): use babel loose mode when transpiling classes</li> <li><a href="`1a95db2145`"><code>1a95db2</code></a> chore(sio-client): add a script to compute the bundle size</li> <li>Additional commits viewable in <a href="https://github.com/socketio/socket.io/compare/socket.io@4.7.5...socket.io@4.8.0">compare view</a></li> </ul> </details> <br /> Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) Dependabot will merge this PR once CI passes on it, as requested by @fs-eire. [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/microsoft/onnxruntime/network/alerts). </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>		2024-10-14 15:47:01 -07:00
.config
.devcontainer
.gdn
.github	Move suggest fixes to a separate CI workflow (#22415 )	2024-10-14 10:26:37 -07:00
.pipelines	[DML EP] Update DML to 1.15.2 (#22247 )	2024-09-27 13:20:29 -07:00
.vscode	Stop VSCode appending file associations to settings.json (#21944 )	2024-08-31 19:04:12 -07:00
cgmanifests	Upgrade absl to the latest released version (#22365 )	2024-10-09 20:21:40 -07:00
cmake	[CUDA] Lean Attention (#22352 )	2024-10-14 14:49:37 -07:00
csharp	[C#] Address Packaging pipeline failure (#22307 )	2024-10-04 17:28:09 -07:00
dockerfiles	[CUDA] Add CUDA_VERSION and CUDNN_VERSION etc. arguments to Dockerfile.cuda (#22351 )	2024-10-09 12:06:33 -07:00
docs	DecoderMaskedMultiHeadAttention CPU kernel. (#22292 )	2024-10-12 13:43:00 -07:00
include/onnxruntime/core	Ovep develop lnl 1.2 (#22424 )	2024-10-14 12:10:01 -07:00
java	RC releases to Maven for Android (#22391 )	2024-10-11 08:58:02 -07:00
js	Bump cookie and socket.io in /js/web (#22408 )	2024-10-14 15:47:01 -07:00
objectivec	Fix Objective-C static analysis warnings. (#20417 )	2024-04-24 11:48:29 -07:00
onnxruntime	[CUDA] Lean Attention (#22352 )	2024-10-14 14:49:37 -07:00
orttraining	Multi-Lora support (#22046 )	2024-09-30 15:59:07 -07:00
rust	Fix typos according to reviewdog report. (#21335 )	2024-07-22 13:37:32 -07:00
samples	Removed all the deprecated python training code and related tests and utils (#18333 )	2023-11-17 18:19:21 -08:00
tools	Fix Xcode 16 iOS build issues (#22379 )	2024-10-14 09:24:38 -07:00
winml	Fix warnings (#21809 )	2024-08-21 14:23:37 -07:00
.clang-format
.clang-tidy
.dockerignore
.gitattributes	Fix typos according to reviewdog report. (#21335 )	2024-07-22 13:37:32 -07:00
.gitignore	Build onnxruntime.dll as arm64x (#18633 )	2023-12-06 16:49:00 -08:00
.gitmodules	Revert "Upgrade emsdk from 3.1.59 to 3.1.62" (#21817 )	2024-08-22 11:21:00 -07:00
.lintrunner.toml	[js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728 )	2024-08-14 16:51:22 -07:00
build.bat
build.sh
build_arm64x.bat	remove unnecessary environment variable (#19166 )	2024-01-16 16:24:37 -08:00
CITATION.cff	Fix citation author name issue (#19597 )	2024-02-22 17:03:56 -08:00
CODEOWNERS
CONTRIBUTING.md
lgtm.yml
LICENSE
NuGet.config	Update C# test projects (#21631 )	2024-09-05 08:21:23 +10:00
ort.wprp	Fully dynamic ETW controlled logging for ORT and QNN logs (#20537 )	2024-06-06 21:11:14 -07:00
ORT_icon_for_light_bg.png
packages.config	[DML EP] Update DML to 1.15.2 (#22247 )	2024-09-27 13:20:29 -07:00
pyproject.toml	Ignore ruff rule `N813` (#21477 )	2024-07-24 17:48:22 -07:00
README.md	Add BrowserStack mention to project ReadMe (#22207 )	2024-09-24 17:14:14 -07:00
requirements-dev.txt	ONNX 1.15 integration (#17125 )	2023-09-26 14:44:48 -07:00
requirements-doc.txt
requirements-lintrunner.txt	Update lintrunner requirements (#22185 )	2024-09-23 18:27:16 -07:00
requirements-training.txt	ONNX 1.15 integration (#17125 )	2023-09-26 14:44:48 -07:00
requirements.txt	Add compatibility for NumPy 2.0 (#21085 )	2024-06-27 13:50:53 -07:00
SECURITY.md
setup.py	[qnn ep] fix naming convention of ort-nightly-qnn package (#22157 )	2024-09-19 17:33:31 -07:00
ThirdPartyNotices.txt	Fix typos according to reviewdog report. (#21335 )	2024-07-22 13:37:32 -07:00
VERSION_NUMBER	bumps up version in main from 1.19 -> 1.20 (#21588 )	2024-08-05 15:46:04 -07:00

README.md

ONNX Runtime is a cross-platform inference and training machine-learning accelerator.

ONNX Runtime inference can enable faster customer experiences and lower costs, supporting models from deep learning frameworks such as PyTorch and TensorFlow/Keras as well as classical machine learning libraries such as scikit-learn, LightGBM, XGBoost, etc. ONNX Runtime is compatible with different hardware, drivers, and operating systems, and provides optimal performance by leveraging hardware accelerators where applicable alongside graph optimizations and transforms. Learn more →

ONNX Runtime training can accelerate the model training time on multi-node NVIDIA GPUs for transformer models with a one-line addition for existing PyTorch training scripts. Learn more →

Get Started & Resources

General Information: onnxruntime.ai
Usage documentation and tutorials: onnxruntime.ai/docs
YouTube video tutorials: youtube.com/@ONNXRuntime
Upcoming Release Roadmap
Companion sample repositories:
- ONNX Runtime Inferencing: microsoft/onnxruntime-inference-examples
- ONNX Runtime Training: microsoft/onnxruntime-training-examples

Builtin Pipeline Status

System	Inference	Training
Windows
Linux
Mac
Android
iOS
Web
Other

This project is tested with BrowserStack.

Third-party Pipeline Status

System	Inference	Training
Linux

Data/Telemetry

Windows distributions of this project may collect usage data and send it to Microsoft to help improve our products and services. See the privacy statement for more details.

Contributions and Feedback

We welcome contributions! Please see the contribution guidelines.

For feature requests or bug reports, please file a GitHub Issue.

For general discussion or questions, please use GitHub Discussions.

Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

License

This project is licensed under the MIT License.