ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
Find a file
sfatimar 52bcef4d4f
Openvino ep 2021.3 (#7180)
* Integrate openvino-ep-2021.3

* operators type

* changed the myriad as it is case sensitive

* logging information for openvino-ep-2021.3

* Unit test fix

* Resize operator added for myriad

* Fixed python tests for CPU and GPU

* data commit for loop tile and gatherelements failure

* adding checks for Where

* fixing gatherelements and loop tests

* disabling instance normalization test for now as there seems to be a
myriad bug, putting loop in ops supported only because all the tests
fail

* gather elements op test taking care of warning message

* condition needs to be an intializers

* Disabled python test for Myriad

* Disable compilation warning for MSVC windows compiler

* softmax_test, threedimaxis0 and 1 test give accuracy mismatch
tensoroptest disables test gives accuracy mismatch
gather test gives accuracy mismatch

* Updated with ov version 2021.3

* Updated with ov version 2021.3

* Updated README

* Disabling python tests for cpu

* Disabling python tests with accuracy mismatch on cpu

* Added fix for Linux CI Pipeline failure

-> Disabled tests that were throwing segfault

Co-authored-by: sfatimar <sahar.fatima@intel/com>
Co-authored-by: MaajidKhan <n.maajidkhan@gmail.com>
Co-authored-by: Aravind <aravindx.gunda@intel.com>
2021-04-01 11:28:54 -07:00
.github Don't mark issues that are marked as enhancement as stale (#6134) 2020-12-14 18:57:40 -08:00
cgmanifests pull onnx latest commit (#7102) 2021-03-29 11:00:38 -07:00
cmake Openvino ep 2021.3 (#7180) 2021-04-01 11:28:54 -07:00
csharp pull onnx latest commit (#7102) 2021-03-29 11:00:38 -07:00
dockerfiles Openvino ep 2021.3 (#7180) 2021-04-01 11:28:54 -07:00
docs Add auto doc gen for ORTModule API during CI build (#7046) 2021-03-22 10:20:33 -07:00
include/onnxruntime/core Enable type reduction for Scatter/ScatterElements CPU kernels (#7171) 2021-03-30 11:02:24 -07:00
java Add Android AAR packaging script for ORT-Mobile (#7138) 2021-03-30 18:42:18 -07:00
nodejs [Node.js binding] upgrade y18n to v4.0.1 (#7185) 2021-03-30 16:09:04 -07:00
onnxruntime Openvino ep 2021.3 (#7180) 2021-04-01 11:28:54 -07:00
orttraining expose session option and provider options (#7112) 2021-03-30 09:49:45 -07:00
package/rpm Bumping up version to 1.7 (#6736) 2021-02-17 19:07:38 -08:00
samples Introduce ORTModule training API to ONNX Runtime 2021-03-10 10:48:10 -08:00
server Update ORT server build pipeline (#7030) 2021-03-16 18:02:09 -07:00
tools Openvino ep 2021.3 (#7180) 2021-04-01 11:28:54 -07:00
winml Change tabs to spaces in Windows.AI.MachineLearning.idl (#7088) 2021-03-22 09:23:18 -07:00
.clang-format
.clang-tidy Add remaining build options and make minor changes in documentation (#39) 2018-11-27 19:59:40 -08:00
.dockerignore Update dockerfiles (#5929) 2020-11-25 15:38:22 -08:00
.flake8 Sync ORTModule branch with master and fix tests (#6526) 2021-02-02 08:59:56 -08:00
.gitattributes
.gitignore Add auto doc gen for ORTModule API during CI build (#7046) 2021-03-22 10:20:33 -07:00
.gitmodules Post merge update for ORTModule 2021-03-16 20:11:59 -07:00
build.amd64.1411.bat
build.bat
build.sh Add iOS test pipeline and a sample app. (#5298) 2020-09-29 13:53:11 -07:00
CODEOWNERS Update code owners for pytorch frontend team (#6329) 2021-02-02 11:09:10 -08:00
CONTRIBUTING.md Add README for docs (#6626) 2021-03-12 15:14:40 -08:00
LICENSE Remove year from license (#6658) 2021-02-12 00:25:56 -08:00
NuGet.config Sync ORTModule branch with master and fix tests (#6526) 2021-02-02 08:59:56 -08:00
ort.wprp Add Tracelogging for profiling (#1639) 2019-11-11 21:34:10 -08:00
packages.config Update DirectML 1.4.1 to 1.4.2 for ORT 1.7 (#6780) 2021-02-23 10:52:10 -08:00
README.md Add direct link to build instructions on readme (#6729) 2021-02-19 10:56:50 -08:00
requirements-dev.txt Sync ORTModule branch with master and fix tests (#6526) 2021-02-02 08:59:56 -08:00
requirements-doc.txt Add auto doc gen for ORTModule API during CI build (#7046) 2021-03-22 10:20:33 -07:00
requirements-training.txt Add missing Python dependencies for ORT training (#7104) 2021-03-23 18:43:19 -07:00
requirements.txt Quantization calibration refactor (#6893) 2021-03-19 01:09:11 -07:00
setup.py Add missing Python dependencies for ORT training (#7104) 2021-03-23 18:43:19 -07:00
ThirdPartyNotices.txt Post merge update for ORTModule 2021-03-16 20:11:59 -07:00
VERSION_NUMBER Bumping up version to 1.7 (#6736) 2021-02-17 19:07:38 -08:00

ONNX Runtime is a cross-platform inference and training machine-learning accelerator compatible with deep learning frameworks, PyTorch and TensorFlow/Keras, as well as classical machine learning libraries such as scikit-learn, and more.

ONNX Runtime uses the portable ONNX computation graph format, backed by execution providers optimized for operating systems, drivers and hardware.

Common use cases for ONNX Runtime:

  • Improve inference performance for a wide variety of ML models
  • Reduce time and cost of training large models
  • Train in Python but deploy into a C#/C++/Java app
  • Run with optimized performance on different hardware and operating systems
  • Support models created in several different frameworks

ONNX Runtime inference APIs are stable and production-ready since the 1.0 release in October 2019 and can enable faster customer experiences and lower costs.

ONNX Runtime training feature was introduced in May 2020 in preview. This feature supports acceleration of PyTorch training on multi-node NVIDIA GPUs for transformer models. Additional updates for this feature are coming soon.

Get Started

http://onnxruntime.ai/

Build Pipeline Status

System CPU GPU EPs
Windows Build Status Build Status Build Status
Linux Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Mac Build Status
Build Status
Android Build Status
iOS Build Status

Data/Telemetry

This project may collect usage data and send it to Microsoft to help improve our products and services. See the privacy statement for more details.

Contributions and Feedback

We welcome contributions! Please see the contribution guidelines.

For feature requests or bug reports, please file a GitHub Issue.

For general discussion or questions, please use Github Discussions.

Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

License

This project is licensed under the MIT License.