mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-05-17 21:10:43 +00:00
c262879214
### Description I've added changes to support CUDA and DML (only on Windows, on other platforms it will throw an error) ### Motivation and Context It fixes this feature request https://github.com/microsoft/onnxruntime/issues/14127 which is tracked here https://github.com/microsoft/onnxruntime/issues/14529 I was working on StableDiffusion implementation for node.js and it is very slow on CPU, so GPU support is essential. Here is a working demo with a patched and precompiled version https://github.com/dakenf/stable-diffusion-nodejs ---------
33 lines
1.1 KiB
Markdown
33 lines
1.1 KiB
Markdown
# ONNX Runtime Node.js Binding
|
|
|
|
ONNX Runtime Node.js binding enables Node.js applications to run ONNX model inference.
|
|
|
|
## Usage
|
|
|
|
Install the latest stable version:
|
|
|
|
```
|
|
npm install onnxruntime-node
|
|
```
|
|
|
|
Refer to [ONNX Runtime JavaScript examples](https://github.com/microsoft/onnxruntime-inference-examples/tree/main/js) for samples and tutorials.
|
|
|
|
## Requirements
|
|
|
|
ONNXRuntime works on Node.js v12.x+ or Electron v5.x+.
|
|
|
|
Following platforms are supported with pre-built binaries:
|
|
|
|
- Windows x64 CPU NAPI_v3
|
|
- Linux x64 CPU NAPI_v3
|
|
- MacOS x64 CPU NAPI_v3
|
|
|
|
To use on platforms without pre-built binaries, you can build Node.js binding from source and consume it by `npm install <onnxruntime_repo_root>/js/node/`. See also [instructions](https://www.onnxruntime.ai/docs/how-to/build.html#apis-and-language-bindings) for building ONNX Runtime Node.js binding locally.
|
|
|
|
# GPU Support
|
|
|
|
Right now, the Windows version supports only the DML provider. Linux x64 can use CUDA and TensorRT.
|
|
|
|
## License
|
|
|
|
License information can be found [here](https://github.com/microsoft/onnxruntime/blob/main/README.md#license).
|