saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-16 21:00:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/js/react_native/ios/OnnxruntimeModule.h

30 lines
783 B
C
Raw Normal View History

ONNX Runtime React Native Library (#7564) * onnxruntime react native binding * add react native backend * fix lint comments * fix react native backend for ios * remove unnecessary files to check in * move onnxruntime-common to devDependency * create two podspec files for iphoneos and iphonesimulator * revise README.md and add third party notices for react native * rename a package * rename a package and revise README * add a license into package.json * revise README and comments * fix typo * fix lint errors * fix lint errors * add a prepack script. touch index.tsx and App.tsx to resolve CI issue * remove a unsupported tsx format from clang-format * fix a type and add steps tp publish a react native npm package * resolve comments * fix clang format * remove promise wrap. change prepack to typescript
2021-05-11 17:34:40 +00:00
// Copyright (c) Microsoft Corporation. All rights reserved.
// Licensed under the MIT License.
#ifndef OnnxruntimeModule_h
#define OnnxruntimeModule_h
#import <React/RCTBridgeModule.h>
[js/rn] Implement blob exchange by JSI instead of use base64 (#16094) ### Description <!-- Describe your changes. --> - Create `OnnxruntimeJSIHelper` native module to provide two JSI functions - `jsiOnnxruntimeStoreArrayBuffer`: Store buffer in Blob Manager & return blob object (iOS: RCTBlobManager, Android: BlobModule) - `jsiOnnxruntimeResolveArrayBuffer`: Use blob object to get buffer - The part of implementation is reference to [react-native-blob-jsi-helper](https://github.com/mrousavy/react-native-blob-jsi-helper) - Replace base64 encode/decode - `loadModelFromBlob`: Rename from `loadModelFromBase64EncodedBuffer` - `run`: Use blob object to replace input.data & results[].data For [this context](https://github.com/microsoft/onnxruntime/issues/16031#issuecomment-1556527812), it saved a lot of time and avoid JS thread blocking in decode return type, it is 3700ms -> 5~20ms for the case. (resolve function only takes 0.x ms) ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> It’s related to #16031, but not a full implementation for migrate to JSI. It just uses JSI through BlobManager to replace the slow part (base64 encode / decode). Rewriting it entirely in JSI could be complicated, like type convertion and threading. This PR might be considered a minor change. /cc @skottmckay
2023-06-16 09:37:02 +00:00
#import <React/RCTBlobManager.h>
ONNX Runtime React Native Library (#7564) * onnxruntime react native binding * add react native backend * fix lint comments * fix react native backend for ios * remove unnecessary files to check in * move onnxruntime-common to devDependency * create two podspec files for iphoneos and iphonesimulator * revise README.md and add third party notices for react native * rename a package * rename a package and revise README * add a license into package.json * revise README and comments * fix typo * fix lint errors * fix lint errors * add a prepack script. touch index.tsx and App.tsx to resolve CI issue * remove a unsupported tsx format from clang-format * fix a type and add steps tp publish a react native npm package * resolve comments * fix clang format * remove promise wrap. change prepack to typescript
2021-05-11 17:34:40 +00:00
[js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) ### Description See https://github.com/microsoft/onnxruntime/pull/21728/commits/454996d4960c06c73486dc8ee19826b57392d559 for manual changes (excluded auto-generated formatting changes) ### Why Because the toolsets for old clang-format is out-of-date. This reduces the development efficiency. - The NPM package `clang-format` is already in maintenance mode. not updated since 2 years ago. - The VSCode extension for clang-format is not maintained for a while, and a recent Node.js security update made it not working at all in Windows. No one in community seems interested in fixing those. Choose Prettier as it is the most popular TS/JS formatter. ### How to merge It's easy to break the build: - Be careful of any new commits on main not included in this PR. - Be careful that after this PR is merged, other PRs that already passed CI can merge. So, make sure there is no new commits before merging this one, and invalidate js PRs that already passed CI, force them to merge to latest.
2024-08-14 23:51:22 +00:00
@interface OnnxruntimeModule : NSObject <RCTBridgeModule>
ONNX Runtime React Native Library (#7564) * onnxruntime react native binding * add react native backend * fix lint comments * fix react native backend for ios * remove unnecessary files to check in * move onnxruntime-common to devDependency * create two podspec files for iphoneos and iphonesimulator * revise README.md and add third party notices for react native * rename a package * rename a package and revise README * add a license into package.json * revise README and comments * fix typo * fix lint errors * fix lint errors * add a prepack script. touch index.tsx and App.tsx to resolve CI issue * remove a unsupported tsx format from clang-format * fix a type and add steps tp publish a react native npm package * resolve comments * fix clang format * remove promise wrap. change prepack to typescript
2021-05-11 17:34:40 +00:00
[js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) ### Description See https://github.com/microsoft/onnxruntime/pull/21728/commits/454996d4960c06c73486dc8ee19826b57392d559 for manual changes (excluded auto-generated formatting changes) ### Why Because the toolsets for old clang-format is out-of-date. This reduces the development efficiency. - The NPM package `clang-format` is already in maintenance mode. not updated since 2 years ago. - The VSCode extension for clang-format is not maintained for a while, and a recent Node.js security update made it not working at all in Windows. No one in community seems interested in fixing those. Choose Prettier as it is the most popular TS/JS formatter. ### How to merge It's easy to break the build: - Be careful of any new commits on main not included in this PR. - Be careful that after this PR is merged, other PRs that already passed CI can merge. So, make sure there is no new commits before merging this one, and invalidate js PRs that already passed CI, force them to merge to latest.
2024-08-14 23:51:22 +00:00
- (void)setBlobManager:(RCTBlobManager*)manager;
[js/rn] Implement blob exchange by JSI instead of use base64 (#16094) ### Description <!-- Describe your changes. --> - Create `OnnxruntimeJSIHelper` native module to provide two JSI functions - `jsiOnnxruntimeStoreArrayBuffer`: Store buffer in Blob Manager & return blob object (iOS: RCTBlobManager, Android: BlobModule) - `jsiOnnxruntimeResolveArrayBuffer`: Use blob object to get buffer - The part of implementation is reference to [react-native-blob-jsi-helper](https://github.com/mrousavy/react-native-blob-jsi-helper) - Replace base64 encode/decode - `loadModelFromBlob`: Rename from `loadModelFromBase64EncodedBuffer` - `run`: Use blob object to replace input.data & results[].data For [this context](https://github.com/microsoft/onnxruntime/issues/16031#issuecomment-1556527812), it saved a lot of time and avoid JS thread blocking in decode return type, it is 3700ms -> 5~20ms for the case. (resolve function only takes 0.x ms) ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> It’s related to #16031, but not a full implementation for migrate to JSI. It just uses JSI through BlobManager to replace the slow part (base64 encode / decode). Rewriting it entirely in JSI could be complicated, like type convertion and threading. This PR might be considered a minor change. /cc @skottmckay
2023-06-16 09:37:02 +00:00
[js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) ### Description See https://github.com/microsoft/onnxruntime/pull/21728/commits/454996d4960c06c73486dc8ee19826b57392d559 for manual changes (excluded auto-generated formatting changes) ### Why Because the toolsets for old clang-format is out-of-date. This reduces the development efficiency. - The NPM package `clang-format` is already in maintenance mode. not updated since 2 years ago. - The VSCode extension for clang-format is not maintained for a while, and a recent Node.js security update made it not working at all in Windows. No one in community seems interested in fixing those. Choose Prettier as it is the most popular TS/JS formatter. ### How to merge It's easy to break the build: - Be careful of any new commits on main not included in this PR. - Be careful that after this PR is merged, other PRs that already passed CI can merge. So, make sure there is no new commits before merging this one, and invalidate js PRs that already passed CI, force them to merge to latest.
2024-08-14 23:51:22 +00:00
- (NSDictionary*)loadModel:(NSString*)modelPath
options:(NSDictionary*)options;
ONNX Runtime React Native Library (#7564) * onnxruntime react native binding * add react native backend * fix lint comments * fix react native backend for ios * remove unnecessary files to check in * move onnxruntime-common to devDependency * create two podspec files for iphoneos and iphonesimulator * revise README.md and add third party notices for react native * rename a package * rename a package and revise README * add a license into package.json * revise README and comments * fix typo * fix lint errors * fix lint errors * add a prepack script. touch index.tsx and App.tsx to resolve CI issue * remove a unsupported tsx format from clang-format * fix a type and add steps tp publish a react native npm package * resolve comments * fix clang format * remove promise wrap. change prepack to typescript
2021-05-11 17:34:40 +00:00
[js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) ### Description See https://github.com/microsoft/onnxruntime/pull/21728/commits/454996d4960c06c73486dc8ee19826b57392d559 for manual changes (excluded auto-generated formatting changes) ### Why Because the toolsets for old clang-format is out-of-date. This reduces the development efficiency. - The NPM package `clang-format` is already in maintenance mode. not updated since 2 years ago. - The VSCode extension for clang-format is not maintained for a while, and a recent Node.js security update made it not working at all in Windows. No one in community seems interested in fixing those. Choose Prettier as it is the most popular TS/JS formatter. ### How to merge It's easy to break the build: - Be careful of any new commits on main not included in this PR. - Be careful that after this PR is merged, other PRs that already passed CI can merge. So, make sure there is no new commits before merging this one, and invalidate js PRs that already passed CI, force them to merge to latest.
2024-08-14 23:51:22 +00:00
- (NSDictionary*)loadModelFromBuffer:(NSData*)modelData
options:(NSDictionary*)options;
[rn] Add support for loading model from buffer on iOS (#13802) ### Description <!-- Describe your changes. --> -Add support for loading model from buffer on iOS -Update OnnxruntimeModuleTest to use updated loadModelFromBuffer Based on #12676 ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> Issue: #12500 --------- Co-authored-by: rachguo <rachguo@rachguos-Mini.attlocal.net> Co-authored-by: rachguo <rachguo@rachguos-Mac-mini.local>
2023-04-29 00:34:26 +00:00
[js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) ### Description See https://github.com/microsoft/onnxruntime/pull/21728/commits/454996d4960c06c73486dc8ee19826b57392d559 for manual changes (excluded auto-generated formatting changes) ### Why Because the toolsets for old clang-format is out-of-date. This reduces the development efficiency. - The NPM package `clang-format` is already in maintenance mode. not updated since 2 years ago. - The VSCode extension for clang-format is not maintained for a while, and a recent Node.js security update made it not working at all in Windows. No one in community seems interested in fixing those. Choose Prettier as it is the most popular TS/JS formatter. ### How to merge It's easy to break the build: - Be careful of any new commits on main not included in this PR. - Be careful that after this PR is merged, other PRs that already passed CI can merge. So, make sure there is no new commits before merging this one, and invalidate js PRs that already passed CI, force them to merge to latest.
2024-08-14 23:51:22 +00:00
- (void)dispose:(NSString*)key;
[js/rn] Implement dispose native method (#16131) ### Description <!-- Describe your changes. --> Implement `dispose` react native method. ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> Currently we are not able to release the memory used by model in JS runtime if we don't want to use it anymore, we can do that only by reload app on debug or restart app on release.
2023-06-08 23:17:33 +00:00
[js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) ### Description See https://github.com/microsoft/onnxruntime/pull/21728/commits/454996d4960c06c73486dc8ee19826b57392d559 for manual changes (excluded auto-generated formatting changes) ### Why Because the toolsets for old clang-format is out-of-date. This reduces the development efficiency. - The NPM package `clang-format` is already in maintenance mode. not updated since 2 years ago. - The VSCode extension for clang-format is not maintained for a while, and a recent Node.js security update made it not working at all in Windows. No one in community seems interested in fixing those. Choose Prettier as it is the most popular TS/JS formatter. ### How to merge It's easy to break the build: - Be careful of any new commits on main not included in this PR. - Be careful that after this PR is merged, other PRs that already passed CI can merge. So, make sure there is no new commits before merging this one, and invalidate js PRs that already passed CI, force them to merge to latest.
2024-08-14 23:51:22 +00:00
- (NSDictionary*)run:(NSString*)url
input:(NSDictionary*)input
output:(NSArray*)output
options:(NSDictionary*)options;
ONNX Runtime React Native Library (#7564) * onnxruntime react native binding * add react native backend * fix lint comments * fix react native backend for ios * remove unnecessary files to check in * move onnxruntime-common to devDependency * create two podspec files for iphoneos and iphonesimulator * revise README.md and add third party notices for react native * rename a package * rename a package and revise README * add a license into package.json * revise README and comments * fix typo * fix lint errors * fix lint errors * add a prepack script. touch index.tsx and App.tsx to resolve CI issue * remove a unsupported tsx format from clang-format * fix a type and add steps tp publish a react native npm package * resolve comments * fix clang format * remove promise wrap. change prepack to typescript
2021-05-11 17:34:40 +00:00
@end
#endif /* OnnxruntimeModule_h */
Reference in a new issue Copy permalink