mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-16 18:31:27 +00:00
a0f3e30de6
* initial setup and rename "how to" to "setup" * move API to main nav * move api to main nav * add get starated, rework nav order * rename to install move mds out of install section * update api nav and home page * add install docs and python qs updates * python get started work * remove c and obj c for now * move java, python, and obj-c docs under api folder * move java api html to iframe (ugh) * remove api docs w/o details, move api text getstar * remove api docs wo detail updates get started * remvoe iframes * move eco system to main nav * fix api buttons * added more examples moved intro to ORT * fix links * fix get started titles * fix get started titles * fix more links * fix more links * more link fixes * fix nav remove inferencing and training subnav * fix top nav remove inference and training nav * fix title * fix tutorials nav hierarchy * fix python api button * add tenorflow keras example * fix quickstart toc * add imports fix spacing * fix links * update nav and python get started page * move ort training example, add coming soon for iot * update C# get started * fix spacing on quantization * Add some js get started content * fix formatting * fix typo * removed onnx-pytorch and onnx-tf * updated pip install torch and added links iot page * added pytorch tutorial heirarchy * updated web to docs soon added release blog link * add web link
90 lines
No EOL
1.8 KiB
Markdown
90 lines
No EOL
1.8 KiB
Markdown
---
|
|
title: RKNPU
|
|
parent: Execution Providers
|
|
nav_order: 11
|
|
---
|
|
|
|
# RKNPU Execution Provider
|
|
*PREVIEW*
|
|
|
|
RKNPU DDK is an advanced interface to access Rockchip NPU. The RKNPU Execution Provider enables deep learning inference on Rockchip NPU via RKNPU DDK.
|
|
|
|
## Contents
|
|
{: .no_toc }
|
|
|
|
* TOC placeholder
|
|
{:toc}
|
|
|
|
|
|
## Build
|
|
For build instructions, please see the [BUILD page](../build/eps.md#rknpu).
|
|
|
|
## Usage
|
|
**C/C++**
|
|
|
|
To use RKNPU as an execution provider for inferencing, please register it as below.
|
|
```
|
|
Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
|
|
Ort::SessionOptions sf;
|
|
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_RKNPU(sf));
|
|
Ort::Session session(env, model_path, sf);
|
|
```
|
|
The C API details are [here](../get-started/with-c.html.md).
|
|
|
|
|
|
## Support Coverage
|
|
### Supported Platform
|
|
{: .no_toc }
|
|
|
|
* RK1808 Linux
|
|
|
|
*Note: RK3399Pro platform is not supported.*
|
|
### Supported Operators
|
|
{: .no_toc }
|
|
|
|
|
|
The table below shows the ONNX Ops supported using the RKNPU Execution Provider and the mapping between ONNX Ops and RKNPU Ops.
|
|
|
|
| **ONNX Ops** | **RKNPU Ops** |
|
|
| --- | --- |
|
|
| Add | ADD |
|
|
| Mul | MULTIPLY |
|
|
| Conv | CONV2D |
|
|
| QLinearConv | CONV2D |
|
|
| Gemm | FULLCONNECT |
|
|
| Softmax | SOFTMAX |
|
|
| AveragePool | POOL |
|
|
| GlobalAveragePool | POOL |
|
|
| MaxPool | POOL |
|
|
| GlobalMaxPool | POOL |
|
|
| LeakyRelu | LEAKY_RELU |
|
|
| Concat | CONCAT |
|
|
| BatchNormalization | BATCH_NORM |
|
|
| Reshape | RESHAPE |
|
|
| Flatten | RESHAPE |
|
|
| Squeeze | RESHAPE |
|
|
| Unsqueeze | RESHAPE |
|
|
| Transpose | PERMUTE |
|
|
| Relu | RELU |
|
|
| Sub | SUBTRACT |
|
|
| Clip(0~6)| RELU6 |
|
|
| DequantizeLinear | DATACONVERT |
|
|
| Clip | CLIP |
|
|
|
|
|
|
### Supported Models
|
|
{: .no_toc }
|
|
|
|
|
|
The following models from the ONNX model zoo are supported using the RKNPU Execution Provider
|
|
|
|
**Image Classification**
|
|
- squeezenet
|
|
- mobilenetv2-1.0
|
|
- resnet50v1
|
|
- resnet50v2
|
|
- inception_v2
|
|
|
|
**Object Detection**
|
|
- ssd
|
|
- yolov3 |