saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-06-17 01:44:45 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/onnxruntime/test/util/include
History
Scott McKay 8f2e57f5d0
Make session configuration options available to kernels via OpKernelInfo (#18897) 
### Description
<!-- Describe your changes. -->
Pass through the ConfigOptions from the session via OpKernelInfo so that
kernel behavior can be configured.

Initial usage would be to optionally enable a fast path for ARM64 bloat16 GEMM - see #17031
Other usages could be things like selected the exact implementations of the activation functions for RNN operators instead of the default approximations (e.g. use [sigmoid_exact instead of sigmoid](2d6e2e243d/onnxruntime/core/providers/cpu/rnn/rnn_helpers.h (L379-L382)))

OpKernelInfo is already passing through things from the session state, and adding a new member of ConfigOptions
is the simpler update. It's also a more natural fit given it's providing state/info to the kernel.

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-01-13 10:02:43 +10:00
..
test Support SCELossInternal/SCELossInternalGrad run with larger sized input (#16363) 2023-06-30 08:36:06 +08:00
asserts.h Make session configuration options available to kernels via OpKernelInfo (#18897) 2024-01-13 10:02:43 +10:00
capturing_sink.h Separate out operator vs model testing. (#16228) 2023-06-17 12:58:57 +10:00
compare_ortvalue.h Separate out operator vs model testing. (#16228) 2023-06-17 12:58:57 +10:00
current_test_name.h [CoreML EP] Enable inputs with dynamic shape (#16915) 2023-08-03 18:15:00 -07:00
default_providers.h Move some QNN EP provider options to session options (#18877) 2023-12-20 00:13:38 -08:00
file_util.h
inference_session_wrapper.h Functions Ahead Of Time inlininng (#17764) 2023-10-23 17:42:20 -07:00
providers.h [TensorRT EP] Refactor OrtTensorRTProviderOptions initialization and make it easy to add new field (#17617) 2023-10-06 14:12:20 -07:00
scoped_env_vars.h
temp_dir.h Separate out operator vs model testing. (#16228) 2023-06-17 12:58:57 +10:00
tensors_from_file.h Move attention test data to file (#17158) 2023-08-15 21:31:57 -07:00
test_allocator.h
test_environment.h Separate out operator vs model testing. (#16228) 2023-06-17 12:58:57 +10:00
test_random_seed.h
test_utils.h [QNN EP] Fix a bug that can't create context binary if the model has inputs/outputs with different data type (#18722) 2023-12-06 13:07:09 -08:00