saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-16 18:31:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update troubleshoot.md (#22338)

Browse source
This commit is contained in:
Nat Kershaw (MSFT) 2024-10-09 10:58:14 -07:00 committed by GitHub
parent 36db78c9e8
commit c27ec3edb4
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 18 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

19
docs/genai/howto/troubleshoot.md
View file

@ -31,4 +31,21 @@ The onnxruntime-genai Python package should run without error after this extra s
### Windows CUDA import error
After CUDA toolkit installation completed on windows, ensure that the `CUDA_PATH` system environment variable has been set to the path where the toolkit was installed. This variable will be used when importing the onnxruntime_genai python module on Windows. Unset or incorrectly set `CUDA_PATH` variable may lead to a `DLL load failed while importing onnxruntime_genai`.
```
DLL load failed while importing onnxruntime_genai
```
After CUDA toolkit installation completed on windows, ensure that the `CUDA_PATH` system environment variable has been set to the path where the toolkit was installed. This variable will be used when importing the onnxruntime_genai python module on Windows. Unset or incorrectly set `CUDA_PATH` variable may lead to a `DLL load failed while importing onnxruntime_genai`.
### Transformers / Tokenizers incompatibility with ONNX Runtime generate()
```
RuntimeError: [json.exception.type_error.302] type must be string, but is array
```
Occurs when you generate models with the Model Builder.
There was a change in the HuggingFace transformers version 4.45.0 that caused an incompatibility with onnxruntime-genai versions 0.4.0 and earlier, reasolved in 0.5.0. There are two alternative workarounds that you can employ to fix this issue:
- Option 1: downgrade your transformers version to lower than v4.45.0 (which is the version in which the above change was introduced)
- Option 2: build onnxruntime-genai from source, using these instructions https://onnxruntime.ai/docs/genai/howto/build-from-source.html