onnxruntime/include/onnxruntime/core/framework
Scott McKay 971058fc38
Avoid copy of pre-existing value to subgraph output (#637)
* Add AllocKind::kShare to allow copying the MLValue for a pre-existing value to a graph output when an Identity node is involved. Ideally we can make this handling for an Identity node more general purpose, however the current logic to free an MLValue during execution doesn't take into account a re-use point also needing a free. Due to that, limit the scope and start with a somewhat ugly hardcoded approach.

Migrate some changes from PR497

The existing Loop unit tests exercise the new code. Also manually stepped through the problematic model to verify the unnecessary copy was avoided.

* Fix build error

* Fix missing switch case in debug output of allocation plan

* Limit optimization to Loop
2019-03-19 06:55:59 +10:00
..
alloc_kind.h Avoid copy of pre-existing value to subgraph output (#637) 2019-03-19 06:55:59 +10:00
allocator.h allocator refactor (#467) 2019-02-12 14:14:21 -08:00
custom_ops_author.h Initial bootstrap commit. 2018-11-19 16:48:22 -08:00
customregistry.h Abbreviate ONNXRuntime as Ort in all of our public APIs (#175) 2018-12-14 14:54:23 -08:00
data_types.h Support memory mapping on Linux 2019-03-11 19:39:02 -07:00
environment.h Abbreviate ONNXRuntime as Ort in all of our public APIs (#175) 2018-12-14 14:54:23 -08:00
execution_provider.h Support large model(>2GB) (#520) 2019-03-05 21:27:12 -08:00
fence.h Initial bootstrap commit. 2018-11-19 16:48:22 -08:00
framework_common.h Initial bootstrap commit. 2018-11-19 16:48:22 -08:00
func_api.h Trt execution provider (#382) 2019-03-14 12:00:39 -07:00
kernel_def_builder.h cleanup code (#343) 2019-01-16 17:12:22 -08:00
kernel_registry.h Optimize graph partition 2019-02-20 16:32:04 -08:00
ml_value.h Abbreviate ONNXRuntime as Ort in all of our public APIs (#175) 2018-12-14 14:54:23 -08:00
op_kernel.h Ryanunderhill/custom op (#550) 2019-03-06 19:09:55 -08:00
op_kernel_info.h Make OpKernelInfo not depend on SessionState. (#442) 2019-02-05 22:38:50 -08:00
op_node_proto_helper.h misc: Fix comment in op_node_proto_helper (#460) 2019-02-11 14:38:43 -08:00
run_options.h Remove caching from InferenceSession::Run (#547) 2019-03-06 14:29:42 -08:00
tensor.h Support large model(>2GB) (#520) 2019-03-05 21:27:12 -08:00
tensor_shape.h Fix array feature extractor out of bounds access issue (#194) 2018-12-18 00:30:07 -08:00