mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-05-16 21:00:14 +00:00
ea1a5cf920
### Description <!-- Describe your changes. --> - Create `OnnxruntimeJSIHelper` native module to provide two JSI functions - `jsiOnnxruntimeStoreArrayBuffer`: Store buffer in Blob Manager & return blob object (iOS: RCTBlobManager, Android: BlobModule) - `jsiOnnxruntimeResolveArrayBuffer`: Use blob object to get buffer - The part of implementation is reference to [react-native-blob-jsi-helper](https://github.com/mrousavy/react-native-blob-jsi-helper) - Replace base64 encode/decode - `loadModelFromBlob`: Rename from `loadModelFromBase64EncodedBuffer` - `run`: Use blob object to replace input.data & results[].data For [this context](https://github.com/microsoft/onnxruntime/issues/16031#issuecomment-1556527812), it saved a lot of time and avoid JS thread blocking in decode return type, it is 3700ms -> 5~20ms for the case. (resolve function only takes 0.x ms) ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> It’s related to #16031, but not a full implementation for migrate to JSI. It just uses JSI through BlobManager to replace the slow part (base64 encode / decode). Rewriting it entirely in JSI could be complicated, like type convertion and threading. This PR might be considered a minor change. /cc @skottmckay
29 lines
774 B
Objective-C
29 lines
774 B
Objective-C
// Copyright (c) Microsoft Corporation. All rights reserved.
|
|
// Licensed under the MIT License.
|
|
|
|
#ifndef OnnxruntimeModule_h
|
|
#define OnnxruntimeModule_h
|
|
|
|
#import <React/RCTBridgeModule.h>
|
|
#import <React/RCTBlobManager.h>
|
|
|
|
@interface OnnxruntimeModule : NSObject<RCTBridgeModule>
|
|
|
|
- (void)setBlobManager:(RCTBlobManager *)manager;
|
|
|
|
-(NSDictionary*)loadModel:(NSString*)modelPath
|
|
options:(NSDictionary*)options;
|
|
|
|
-(NSDictionary*)loadModelFromBuffer:(NSData*)modelData
|
|
options:(NSDictionary*)options;
|
|
|
|
-(void)dispose:(NSString*)key;
|
|
|
|
-(NSDictionary*)run:(NSString*)url
|
|
input:(NSDictionary*)input
|
|
output:(NSArray*)output
|
|
options:(NSDictionary*)options;
|
|
|
|
@end
|
|
|
|
#endif /* OnnxruntimeModule_h */
|