onnxruntime/tools/ci_build
wezuo 5b6753ce27
Wezuo/memory analysis (#5658)
* merged alloc_plan

* pass compilation

* Start running, incorrect allocation memory info

* add in comments

* fix a bug of recording pattern too early.

* debugging lifetime

* fix lifetime

* passed mnist

* in process of visualization

* Add code to generate chrome trace for allocations.

* in process of collecting fragmentation

* before rebuild

* passed mnist

* passed bert tiny

* fix the inplace reuse

* fix the exception of weight in pinned memory

* add guards to ensure the tensor is in AllocPlan

* add customized profiling

* debugging

* debugging

* fix the reuse of differnt location type

* add rank

* add the rank

* add fragmentation

* add time_step_trace

* Add summary for each execution step (total bytes, used/free bytes).

* add top k

* change type of top k parameter

* remove prints

* change heap to set{

* add the name pattern

* add the useage for pattern

* add partition

* change to static class

* add custom group

* remove const

* update memory_info

* in process of adding it as runtime config

* change the memory profiling to be an argument

* add some comments

* add checks to recored meomry_info in traaining session

* set the "local rank setting" to correct argument.

* addressing comments

* format adjustment

* formatting

* remove alloc_interval

* update memory_info.cc to skip session when there is no tensor for a particular memory type

* fix memory_info multiple iteration seg-fault

* consolidate mainz changes

* fixed some minor errors

* guard by ORT_MINIMAL_BUILD

* add ORT_MEMORY_PROFILE flag

* added compiler flag to turn on/off memory profiling related code

* clean up the code regarding comments

* add comments

* revoke the onnx version

* clean up the code to match master

* clean up the code to match master

* clean up the code to match master

Co-authored-by: Jesse Benson <benson.jesse@gmail.com>
Co-authored-by: Wei Zuo <wezuo@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Co-authored-by: wezuo <wezuo@az-eus-v100-32gb-5-worker-mgtbby.eastus.cloudapp.azure.com>
Co-authored-by: wezuo <wezuo@az-eus-v100-32gb-5-worker-yclzsf.eastus.cloudapp.azure.com>
2021-01-19 08:30:55 -08:00
..
github Use readelf for minimal build binary size checks. (#6338) 2021-01-15 07:46:02 +10:00
__init__.py Add validation of op registrations (#5817) 2020-11-17 10:44:09 -08:00
amd_hipify.py Pipeline Parallel Experimental Python API (#5815) 2021-01-15 12:07:28 +08:00
build.py Wezuo/memory analysis (#5658) 2021-01-19 08:30:55 -08:00
clean_docker_image_cache.py Fix clean_docker_image_cache.py detection of image pushes. (#6151) 2020-12-16 17:25:22 -08:00
coverage.py Add support for running Android emulator from build.py on Windows. (#6317) 2021-01-13 19:21:49 -08:00
exclude_unused_ops.py Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
gen_def.py Reduce IOS shared library size by symbol file. (#5171) 2020-09-14 23:59:41 -07:00
get_docker_image.py Update get_docker_image.py to enable use without image cache container registry. (#6177) 2020-12-18 19:01:02 -08:00
logger.py Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
op_registration_utils.py Remove nGraph Execution Provider (#5858) 2020-11-19 16:47:55 -08:00
op_registration_validator.py Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00