saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-17 21:10:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/onnxruntime/python
History
Dmitri Smirnov 08ecf30e0b
Implement numpy array over CPU OrtValues on return values (#20539) 
### Description
Create numpy arrays based on the native buffers of returned OrtValues.
Hold on to the OrtValue until the numpy array is garbage collected.

### Motivation and Context
This saves cpu on tensor copies and addresses customer concerns.
2024-05-08 10:56:36 -07:00
..
backend Bump linter versions (#18341) 2023-11-08 13:04:40 -08:00
datasets
providers/tvm
tools Add simplified layernorm fusion for Gemma (#20572) 2024-05-06 20:07:14 -07:00
torch_cpp_extensions remove const cast for DLManagedTensor (#20015) 2024-03-22 10:39:19 -07:00
training
__init__.py
_ld_preload.py
_pybind_state.py.in
exported_symbols.lst
numpy_helper.h
onnxruntime_collect_build_info.py
onnxruntime_inference_collection.py Implement numpy array over CPU OrtValues on return values (#20539) 2024-05-08 10:56:36 -07:00
onnxruntime_pybind.h
onnxruntime_pybind_exceptions.cc
onnxruntime_pybind_exceptions.h
onnxruntime_pybind_iobinding.cc Implement numpy array over CPU OrtValues on return values (#20539) 2024-05-08 10:56:36 -07:00
onnxruntime_pybind_mlvalue.cc [DML EP] Improve python API perf (#20331) 2024-04-17 17:33:37 -07:00
onnxruntime_pybind_mlvalue.h Implement numpy array over CPU OrtValues on return values (#20539) 2024-05-08 10:56:36 -07:00
onnxruntime_pybind_module.cc Fix warning C4003 in ORT python binding code (#18612) 2023-11-30 08:07:47 -08:00
onnxruntime_pybind_ortvalue.cc Implement numpy array over CPU OrtValues on return values (#20539) 2024-05-08 10:56:36 -07:00
onnxruntime_pybind_quant.cc Block-wise 4b quantization matmul operator change (#18172) 2023-11-03 15:29:43 -07:00
onnxruntime_pybind_schema.cc [DML EP] Improve python API perf (#20331) 2024-04-17 17:33:37 -07:00
onnxruntime_pybind_sparse_tensor.cc Implement numpy array over CPU OrtValues on return values (#20539) 2024-05-08 10:56:36 -07:00
onnxruntime_pybind_state.cc Implement numpy array over CPU OrtValues on return values (#20539) 2024-05-08 10:56:36 -07:00
onnxruntime_pybind_state.h
onnxruntime_pybind_state_common.cc
onnxruntime_pybind_state_common.h OpenVINO EP Rel 1.18 Changes (#20337) 2024-04-19 00:31:38 -07:00
onnxruntime_validation.py fix: "UserWarning: Unsupported Windows version (11). ONNX Runtime sup… (#19845) 2024-03-15 12:41:44 -07:00
pybind.def
version_script.lds
version_script_expose_onnx_protobuf.lds