Ilia Cherniavskii c24c5f9684 Make RecordFunction callbacks thread local and modernize interface (#37491) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/37491 This PR modernizes RecordFunction API and adds thread local callbacks in addition to the global ones Changes: - support for TLS callbacks, this is going to be the foundation of profiler and other tools - modernize interface around simple set of functions (add|remove|has|clear)(Global|ThreadLocal)(Callback) and adding RecordFunctionCallback to easily construct callbacks to be passed - we also add `.setShouldRun` into the callback interface to support cases when simple uniform sampling is not enough - to properly support add/remove introduce the idea of callback handle returned by add - internal implementation still uses SmallVector to store intermediate state (as before) - in this case these are vector of handles of callbacks that were picked to run - to speed up runtime we keep these vectors sorted, this way we can quickly enumerate callbacks that need to be run - added tests for new functionality Test Plan: BUILD_BINARY=1 USE_BLAS=MKL USE_MKLDNN=0 USE_CUDA=0 python setup.py develop install ./build/bin/test_jit CI record_function_benchmark: https://gist.github.com/ilia-cher/f1e094dae47fe23e55e7672ac4dcda2f Imported from OSS Differential Revision: D21300448 fbshipit-source-id: 6d55c26dbf20b33d35c3f1604dcc07bb063c8c43		2020-05-07 14:51:02 -07:00
..
api	[aten] Pass std::function<> to thread_pool by value, instead of const ref. (#37681)	2020-05-05 08:41:38 -07:00
common
dist_autograd
jit	Make RecordFunction callbacks thread local and modernize interface (#37491)	2020-05-07 14:51:02 -07:00
rpc	[TensorPipe] Use the new multi-payload message API (#37919)	2020-05-07 02:52:30 -07:00
tensorexpr	Fix splitWithTail to insert the tail immediately after the outer loop. (#37941)	2020-05-07 00:05:23 -07:00
__init__.py