pytorch/test/cpp/jit
Ilia Cherniavskii f5c95d5cf1 Source code level attribution in profiler (#43898)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/43898

Adding with_source parameter to enable tracking source code
(filename and line) in profiler for eager, torchscript and autograd
modes

Test Plan:
python test/test_profiler.py
```
Name                                 Self CPU total %  Self CPU total   CPU total %      CPU total        CPU time avg     Number of Calls  Source Location
-----------------------------------  ---------------  ---------------  ---------------  ---------------  ---------------  ---------------  --------------------------------------------
ts_method_1                          10.43%           235.364us        36.46%           822.920us        822.920us        1                test/test_profiler.py(70): test_source
aten::add                            7.52%            169.833us        8.88%            200.439us        200.439us        1                test/test_profiler.py(69): test_source
aten::normal_                        6.26%            141.380us        6.26%            141.380us        141.380us        1                test/test_profiler.py(67): test_source
aten::add                            5.80%            130.830us        8.41%            189.800us        63.267us         3                test/test_profiler.py(72): test_source
aten::sum                            5.02%            113.340us        8.39%            189.475us        189.475us        1                test/test_profiler.py(64): ts_method_1
aten::add                            4.58%            103.346us        6.33%            142.847us        142.847us        1                test/test_profiler.py(62): ts_method_1
aten::mul                            4.05%            91.498us         9.62%            217.113us        217.113us        1                test/test_profiler.py(71): test_source
aten::add                            4.03%            90.880us         5.60%            126.405us        126.405us        1                test/test_profiler.py(58): ts_method_2
aten::empty                          3.49%            78.735us         3.49%            78.735us         19.684us         4                test/test_profiler.py(72): test_source
```

Reviewed By: ngimel

Differential Revision: D23432664

Pulled By: ilia-cher

fbshipit-source-id: 83ad7ebe0c2502494d3b48c4e687802db9c77615
2020-09-30 00:57:35 -07:00
..
__init__.py remediation of S205607 2020-07-17 17:19:47 -07:00
CMakeLists.txt port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
README.md port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_alias_analysis.cpp [JIT] improve alias analysis for list constructs (#39111) 2020-09-22 09:38:59 -07:00
test_argument_spec.cpp [jit] gtestify test_argument_spec.cpp (#45019) 2020-09-22 19:44:14 -07:00
test_autodiff.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_backend.cpp
test_class_import.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_class_parser.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_class_type.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_cleanup_passes.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_code_template.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_constant_pooling.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_create_autodiff_subgraphs.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_custom_class.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_custom_class_registrations.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_custom_class_registrations.h gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_custom_operators.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_dce.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_fuser.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_gpu.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_graph_executor.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_inliner.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_interface.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_interpreter.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_ir.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_irparser.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_jit_type.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_lite_interpreter.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_lite_trainer.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_memory_dag.cpp [jit] gtest-ify test_alias_analysis.cpp (#45018) 2020-09-21 12:19:37 -07:00
test_misc.cpp Source code level attribution in profiler (#43898) 2020-09-30 00:57:35 -07:00
test_mobile_type_parser.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_module_api.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_peephole_optimize.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_qualified_name.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_save_load.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_schema_matching.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_subgraph_matcher.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_subgraph_rewriter.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_subgraph_utils.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_utils.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_utils.h port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
tests_setup.py
torch_python_test.cpp [jit] Pull (most) tests out of libtorch_python (#44795) 2020-09-18 14:04:40 -07:00

JIT C++ Tests

Adding a new test

First, create a new test file. Test files should have be placed in this directory, with a name that starts with test_, like test_foo.cpp.

In general a single test suite

Add your test file to the JIT_TEST_SRCS list in test/cpp/jit/CMakeLists.txt.

A test file may look like:

#include <gtest/gtest.h>

using namespace ::torch::jit

TEST(FooTest, BarBaz) {
   // ...
}

// Append '_CUDA' to the test case name will automatically filter it out if CUDA
// is not compiled.
TEST(FooTest, NeedsAGpu_CUDA) {
   // ...
}

// Similarly, if only one GPU is detected, tests with `_MultiCUDA` at the end
// will not be run.
TEST(FooTest, NeedsMultipleGpus_MultiCUDA) {
   // ...
}

Building and running the tests

The following commands assume you are in PyTorch root.

# ... Build PyTorch from source, e.g.
python setup.py develop
# (re)build just the binary
ninja -C build bin/test_jit
# run tests
build/bin/test_jit --gtest_filter='glob_style_filter*'