Ryan Hill c99aa3a3f3 Ryanunderhill/cuda shared (#7626) ... * First iteration of making cuda a shared provider. Separated out shared OpKernel change, so doing this to merge with that change. * More cuda shared library refactoring * More cuda shared library refactoring * More build options tested, converted the training ops over. * Fix merge breaks * Fix submodules * Fix submodules * Fix submodules * Fix python * Fix compile errors * Duplicate symbol fix * Test fix for ROCM provider * Another ROCM test workaround * ROCM Build Test * ROCM build fix * ROCM * ROCM * ROCM * ROCM * ROCM * ROCM test * Reduce header dependencies * Remove redundant namespace * Test fix for linux * Fix linux build * Fix Eigen build error * Fix unused parameter warning * Test link error * Another linker test * Linker test * Linker test * Another test * Another build test * Fix linux link error * Build test * Fix control flow ops to use common base class with core code * Remove extra qualifiers * Fix template syntax for linux * Fix cuda memory leak * Fix pybind * Test disabling cast * Cleanup * Restore cuda in test * Remove more header dependencies * Test not adding cuda provider to session * Make GetProviderInfo_CUDA throw * No-op cuda provider creation * Fix some setup issues * Fix memory cleanup on unload * Diagnostics * Don't unload library * Add diagnostics * Fix deleting registry at right time. * Test disabling profiler * Fix merge break * Revert profiler change * Move unloading of shared providers into Environment * Free more global allocations before library unloads * Add more diagnostics * Move unloading back to the OrtEnv as there are multiple Environments created during a session. Remove some library dependencies for tests. * Fix more cmake files * ERROR -> WARNING * Fix python shutdown * Test not using dml in pipeline * Change python version and disable dml * Update python version * Test adding unload method for shared providers * Disable DLL test * Python test * Revert "Python test" This reverts commit c7ec2cfe98. * Revert "Disable DLL test" This reverts commit e901cb93aa. * Revert "Test adding unload method for shared providers" This reverts commit c427b78799. * Point to RyanWinGPU * Revert python version * Fix id_to_allocator_map * Another python exit test * Remove extra debug messages Try a more clean python shutdown through DllMain * Revert DllMain idea, it didn't work * Merge conflicts * Fix merge with master issues. * Comments * Undo edit to file * Cleanup + new training ops * Revert yml changes * Fix another merge error * ROCM fix * ROCM fix v2 * Put back Linux hack, it is necessary * Stupid fixes * Fix submodule out of sync * ROCM fix 3 * ROCM 4 * Test java fix * Fix typos * Java test on my VM * Fix build error * Spotless fix * Leave temp file around to load properly * Fix cleanup on exit * Fix break * Java comments * Remove LongformerAttentionBase workaround * Spotless fix * Switch yml back to regular build pool * Revert "Switch yml back to regular build pool" This reverts commit be35fc2a5a. * Code review feedback * Fix errors due to merge * Spotless fix * Fix minimal build * Java fix for non cuda case * Java fix for CPU build * Fix Nuphar? * Fix nuphar 2 * Fix formatting * Revert "Remove LongformerAttentionBase workaround" This reverts commit 648679b370. * Training fix * Another java fix * Formatting * Formatting * For orttraining * Last orttraining build fix... * training fixes * Fix test provider error * Missing pass command * Removed in wrong spot * Python typo * Python typos * Python crash on exit, possibly due to unloading of libraries. * Remove test_execution_provider from training build Only enable python atexit on windows Remove assert on provider library exit * Still can't unload providers in python, alas. * Disable Nvtx temporarily * MPI Kernels for Training * MPI Kernels part 2 * Patch through INcclService * Oops, wrong CMakeLists * Missing namespace * Fix missing () * Move INcclService::GetInstance around to link nicer * Missing } * Missing MPI libraries for Cuda * Add extra GetType functions used by MPI * Missing Nccl library * Remove LOGS statements as a test * Add in a couple more missing GetType methods * Update comments * Missed a logging reference in mpi_context.h * Convert aten_op to shared (due to marge with master) * Test moving DistributedRunContext instance into shared provider layer (with purpose error to verify it's being built properly) * Test passed, now with fix * Missing static * Oops, scope DistributedRunContext to just NCCL * Merge related issues and code review feedback. * Merge error * Bump to rel-1.9.1 (#7684) * Formatting * Code review feedback for Java build on non Windows * Remove cupti library dependency from core library * Test Java pipeline fix * Linux build fix * Revert "Linux build fix" This reverts commit a73a811516. * Revert "Remove cupti library dependency from core library" This reverts commit 6a889ee8bf. * Packaging pipeline fixes to copy cuda shared provider for tensorrt & standard packages * Add cuda to Tensorrt nuget package * onnxruntime_common still has a cuda header dependency Co-authored-by: ashbhandare <ash.bhandare@gmail.com>		2021-05-20 07:53:47 -07:00
..
alloc_kind.h	Add New AllocKind for YieldOp Outputs, Run YieldOp with InferenceSession in UT (#7125)	2021-03-25 15:18:51 +08:00
allocator.h	Some cosmetic changes (#7741)	2021-05-18 00:02:07 -07:00
buffer_deleter.h	Add ability for pre-packed weights of shared initializers to be shared across sessions (#7421)	2021-05-14 20:44:42 -07:00
customregistry.h	Sync ORTModule branch with master and fix tests (#6526)	2021-02-02 08:59:56 -08:00
data_types.h	Change OpKernel class to be shared with shared providers (#6837)	2021-03-02 00:53:48 -08:00
data_types_internal.h	Enable type reduction for Scatter/ScatterElements CPU kernels (#7171)	2021-03-30 11:02:24 -07:00
endian.h	Edgchen1/endian utils (#2181)	2019-10-21 22:28:35 -07:00
execution_provider.h	Change onnxruntime::make_unique to std::make_unique (#7502)	2021-04-29 17:04:53 -07:00
fence.h	Remove Cuda dependency from TensorRT shared provider (#5014)	2020-09-04 11:35:02 -07:00
float16.h	Change OpKernel class to be shared with shared providers (#6837)	2021-03-02 00:53:48 -08:00
framework_common.h	Combine OrtValue and MLValue into one type (#1043)	2019-05-16 10:22:49 -07:00
func_api.h	Sync ORTModule branch with master and fix tests (#6526)	2021-02-02 08:59:56 -08:00
kernel_def_builder.h	Ryanunderhill/cuda shared (#7626)	2021-05-20 07:53:47 -07:00
kernel_registry.h	Check kernel def hashes (#7120)	2021-04-01 17:42:58 -07:00
ml_value.h	Ryanunderhill/cuda shared (#7626)	2021-05-20 07:53:47 -07:00
op_kernel.h	Add ability for pre-packed weights of shared initializers to be shared across sessions (#7421)	2021-05-14 20:44:42 -07:00
op_kernel_context.h	Address comments from ORTModule master merge (#7101)	2021-03-26 16:26:42 -07:00
op_kernel_info.h	Support EPs that compile nodes in a minimal build. (#5776)	2020-11-17 13:52:22 +10:00
op_node_proto_helper.h	Ryanunderhill/cuda shared (#7626)	2021-05-20 07:53:47 -07:00
ortdevice.h	Sync ORTModule branch with master and fix tests (#6526)	2021-02-02 08:59:56 -08:00
ortmemoryinfo.h	Remove Cuda dependency from TensorRT shared provider (#5014)	2020-09-04 11:35:02 -07:00
provider_options.h	Sync ORTModule branch with master and fix tests (#6526)	2021-02-02 08:59:56 -08:00
provider_options_utils.h	Plug n Allocate with external CUDA allocator via PyBind. (#6679)	2021-02-17 18:59:38 -08:00
provider_shutdown.h	Fix shared provider unload crash (#5553)	2020-10-21 13:01:21 -07:00
run_options.h	Add ability for memory arenas to "shrink" periodically (#7284)	2021-05-08 07:53:21 -07:00
sparse_tensor.h	Support for Sparse Initializers (#5540)	2020-10-27 10:32:06 -07:00
tensor.h	Ryanunderhill/cuda shared (#7626)	2021-05-20 07:53:47 -07:00
tensor_shape.h	Filter out info from non-const initializers during shape inferencing (#1806)	2019-09-26 13:44:33 +10:00