saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/pytest.ini

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

25 lines
839 B
INI
Raw Normal View History

add a pytest.ini file (#53152) Summary: This shall fix the first three items of https://github.com/pytorch/pytorch/issues/52984 by adding a pytest.ini configuration file. #### `--tb=short` In a failure, pytest will not show the entire traceback nor the docstring. - Without `--tb=short`: <details> ``` $ pytest test/test_typing.py -k tensor_copy ================================================================== test session starts =================================================================== platform linux -- Python 3.8.6, pytest-6.2.1, py-1.10.0, pluggy-0.13.1 rootdir: /home/guilhermel/git/pytorch, configfile: pytest.ini plugins: hypothesis-5.38.1, typeguard-2.10.0 collected 8 items / 7 deselected / 1 selected test/test_typing.py F [100%] ======================================================================== FAILURES ======================================================================== ______________________________________________________________ test_reveal[tensor_copy.py] _______________________________________________________________ path = '/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py', reveal = 'int ' expected_reveal = "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'", lineno = 11 def _test_reveal(path: str, reveal: str, expected_reveal: str, lineno: int) -> None: if reveal not in expected_reveal: > raise AssertionError(_REVEAL_MSG.format(lineno, expected_reveal, reveal)) E AssertionError: Reveal mismatch at line 11 E E Expected reveal: "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'" E Observed reveal: 'int ' test/test_typing.py:156: AssertionError ================================================================ short test summary info ================================================================= FAILED test/test_typing.py::test_reveal[tensor_copy.py] - AssertionError: Reveal mismatch at line 11 ``` </details> - With `--tb=short`: <details> ``` $ pytest test/test_typing.py -k tensor_copy ================================================================== test session starts =================================================================== platform linux -- Python 3.8.6, pytest-6.2.1, py-1.10.0, pluggy-0.13.1 rootdir: /home/guilhermel/git/pytorch, configfile: pytest.ini plugins: hypothesis-5.38.1, typeguard-2.10.0 collected 8 items / 7 deselected / 1 selected test/test_typing.py F [100%] ======================================================================== FAILURES ======================================================================== ______________________________________________________________ test_reveal[tensor_copy.py] _______________________________________________________________ test/test_typing.py:156: in _test_reveal raise AssertionError(_REVEAL_MSG.format(lineno, expected_reveal, reveal)) E AssertionError: Reveal mismatch at line 11 E E Expected reveal: "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'" E Observed reveal: 'int ' ``` </details> Pull Request resolved: https://github.com/pytorch/pytorch/pull/53152 Reviewed By: agolynski Differential Revision: D26846808 Pulled By: walterddr fbshipit-source-id: d16c951b370b0643c8bbedca73d5184c6b65aba7
2021-03-19 00:38:14 +00:00
[pytest]
addopts =
# show summary of all tests that did not pass
Make pytest ending output less chatty (#82262) If you still want this in CI, we should have a separate CI only configuration. The current config is pretty unfriendly for local development. Signed-off-by: Edward Z. Yang <ezyang@fb.com> Pull Request resolved: https://github.com/pytorch/pytorch/pull/82262 Approved by: https://github.com/clee2000
2022-07-27 19:43:30 +00:00
-rEfX
add a pytest.ini file (#53152) Summary: This shall fix the first three items of https://github.com/pytorch/pytorch/issues/52984 by adding a pytest.ini configuration file. #### `--tb=short` In a failure, pytest will not show the entire traceback nor the docstring. - Without `--tb=short`: <details> ``` $ pytest test/test_typing.py -k tensor_copy ================================================================== test session starts =================================================================== platform linux -- Python 3.8.6, pytest-6.2.1, py-1.10.0, pluggy-0.13.1 rootdir: /home/guilhermel/git/pytorch, configfile: pytest.ini plugins: hypothesis-5.38.1, typeguard-2.10.0 collected 8 items / 7 deselected / 1 selected test/test_typing.py F [100%] ======================================================================== FAILURES ======================================================================== ______________________________________________________________ test_reveal[tensor_copy.py] _______________________________________________________________ path = '/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py', reveal = 'int ' expected_reveal = "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'", lineno = 11 def _test_reveal(path: str, reveal: str, expected_reveal: str, lineno: int) -> None: if reveal not in expected_reveal: > raise AssertionError(_REVEAL_MSG.format(lineno, expected_reveal, reveal)) E AssertionError: Reveal mismatch at line 11 E E Expected reveal: "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'" E Observed reveal: 'int ' test/test_typing.py:156: AssertionError ================================================================ short test summary info ================================================================= FAILED test/test_typing.py::test_reveal[tensor_copy.py] - AssertionError: Reveal mismatch at line 11 ``` </details> - With `--tb=short`: <details> ``` $ pytest test/test_typing.py -k tensor_copy ================================================================== test session starts =================================================================== platform linux -- Python 3.8.6, pytest-6.2.1, py-1.10.0, pluggy-0.13.1 rootdir: /home/guilhermel/git/pytorch, configfile: pytest.ini plugins: hypothesis-5.38.1, typeguard-2.10.0 collected 8 items / 7 deselected / 1 selected test/test_typing.py F [100%] ======================================================================== FAILURES ======================================================================== ______________________________________________________________ test_reveal[tensor_copy.py] _______________________________________________________________ test/test_typing.py:156: in _test_reveal raise AssertionError(_REVEAL_MSG.format(lineno, expected_reveal, reveal)) E AssertionError: Reveal mismatch at line 11 E E Expected reveal: "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'" E Observed reveal: 'int ' ``` </details> Pull Request resolved: https://github.com/pytorch/pytorch/pull/53152 Reviewed By: agolynski Differential Revision: D26846808 Pulled By: walterddr fbshipit-source-id: d16c951b370b0643c8bbedca73d5184c6b65aba7
2021-03-19 00:38:14 +00:00
# Make tracebacks shorter
--tb=native
# capture only Python print and C++ py::print, but not C output (low-level Python errors)
--capture=sys
Reduce warning suppression by just disabling pytest warnings plugin (#86255) Fixes https://github.com/pytorch/pytorch/issues/85626 Signed-off-by: Edward Z. Yang <ezyang@fb.com> Pull Request resolved: https://github.com/pytorch/pytorch/pull/86255 Approved by: https://github.com/lezcano, https://github.com/albanD
2022-10-05 03:08:51 +00:00
# don't suppress warnings, but don't shove them all to the end either
-p no:warnings
Reduce pytest prints (#117069) * custom pytest-shard so I can control the verbosity (also index by 1 since it's confusing) * normal runs (not keep-going) always rerun each failed test 9 times (3 per process, 3 processes). Previously it would only run the entire test file 3 times, so if a test before you segfaulted, you only got 2 tries Example of quieter log https://github.com/pytorch/pytorch/actions/runs/7481334046/job/20363147497 "items in shard" only gets printed once at the beginning, and the reruns just say how many got skipped. Pull Request resolved: https://github.com/pytorch/pytorch/pull/117069 Approved by: https://github.com/huydhn
2024-01-23 18:39:30 +00:00
# Use custom pytest shard located in test/pytest_shard_custom.py instead
-p no:pytest-shard
Pytest do not rewrite assertions by default (#117060) From https://pytest.org/en/7.4.x/how-to/assert.html#advanced-assertion-introspection pytest only rewrites test modules directly discovered by its test collection process, so asserts in supporting modules which are not themselves test modules will not be rewritten. In CI we usually call the test file (`python test_ops.py`), which then calls run_test which then calls pytest.main, so the test module is already imported as `__main__`, so pytest does not import the test module itself and relies on the already imported module. (#95844) However, calling `pytest test_ops.py` will rely on pytest to import the module, resulting in asserts being rewritten, so I add --assert=plain by default into the opts so we don't have to worry about this anymore. Another way to make pytest stop assertion rewriting in a file is to include `PYTEST_DONT_REWRITE` somewhere in the file. Pull Request resolved: https://github.com/pytorch/pytorch/pull/117060 Approved by: https://github.com/zou3519
2024-01-10 20:02:41 +00:00
# don't rewrite assertions (usually not a problem in CI due to differences in imports, see #95844)
--assert=plain
add a pytest.ini file (#53152) Summary: This shall fix the first three items of https://github.com/pytorch/pytorch/issues/52984 by adding a pytest.ini configuration file. #### `--tb=short` In a failure, pytest will not show the entire traceback nor the docstring. - Without `--tb=short`: <details> ``` $ pytest test/test_typing.py -k tensor_copy ================================================================== test session starts =================================================================== platform linux -- Python 3.8.6, pytest-6.2.1, py-1.10.0, pluggy-0.13.1 rootdir: /home/guilhermel/git/pytorch, configfile: pytest.ini plugins: hypothesis-5.38.1, typeguard-2.10.0 collected 8 items / 7 deselected / 1 selected test/test_typing.py F [100%] ======================================================================== FAILURES ======================================================================== ______________________________________________________________ test_reveal[tensor_copy.py] _______________________________________________________________ path = '/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py', reveal = 'int ' expected_reveal = "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'", lineno = 11 def _test_reveal(path: str, reveal: str, expected_reveal: str, lineno: int) -> None: if reveal not in expected_reveal: > raise AssertionError(_REVEAL_MSG.format(lineno, expected_reveal, reveal)) E AssertionError: Reveal mismatch at line 11 E E Expected reveal: "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'" E Observed reveal: 'int ' test/test_typing.py:156: AssertionError ================================================================ short test summary info ================================================================= FAILED test/test_typing.py::test_reveal[tensor_copy.py] - AssertionError: Reveal mismatch at line 11 ``` </details> - With `--tb=short`: <details> ``` $ pytest test/test_typing.py -k tensor_copy ================================================================== test session starts =================================================================== platform linux -- Python 3.8.6, pytest-6.2.1, py-1.10.0, pluggy-0.13.1 rootdir: /home/guilhermel/git/pytorch, configfile: pytest.ini plugins: hypothesis-5.38.1, typeguard-2.10.0 collected 8 items / 7 deselected / 1 selected test/test_typing.py F [100%] ======================================================================== FAILURES ======================================================================== ______________________________________________________________ test_reveal[tensor_copy.py] _______________________________________________________________ test/test_typing.py:156: in _test_reveal raise AssertionError(_REVEAL_MSG.format(lineno, expected_reveal, reveal)) E AssertionError: Reveal mismatch at line 11 E E Expected reveal: "/home/guilhermel/git/pytorch/test/typing/reveal/tensor_copy.py:11: note: Revealed type is 'torch.tensor.Tensor'" E Observed reveal: 'int ' ``` </details> Pull Request resolved: https://github.com/pytorch/pytorch/pull/53152 Reviewed By: agolynski Differential Revision: D26846808 Pulled By: walterddr fbshipit-source-id: d16c951b370b0643c8bbedca73d5184c6b65aba7
2021-03-19 00:38:14 +00:00
testpaths =
test
pytest to run test_ops, test_ops_gradients, test_ops_jit in non linux cuda environments (#79898) This PR uses pytest to run test_ops, test_ops_gradients, and test_ops_jit in parallel in non linux cuda environments to decrease TTS. I am excluding linux cuda because running in parallel results in errors due to running out of memory Notes: * update hypothesis version for compatability with pytest * use rerun-failures to rerun tests (similar to flaky tests, although these test files generally don't have flaky tests) * reruns are denoted by a rerun tag in the xml. Failed reruns also have the failure tag. Successes (meaning that the test is flaky) do not have the failure tag. * see https://docs.google.com/spreadsheets/d/1aO0Rbg3y3ch7ghipt63PG2KNEUppl9a5b18Hmv2CZ4E/edit#gid=602543594 for info on speedup (or slowdown in the case of slow tests) * expecting windows tests to decrease by 60 minutes total * slow test infra is expected to stay the same - verified by running pytest and unittest on the same job and check the number of skipped/run tests * test reports to s3 changed - add entirely new table to keep track of invoking_file times Pull Request resolved: https://github.com/pytorch/pytorch/pull/79898 Approved by: https://github.com/malfet, https://github.com/janeyx99
2022-07-19 19:50:57 +00:00
junit_logging_reruns = all
Run tests in USE_PYTEST_LIST through run_tests (#95659) Part of my effort to move everything to pytest and decrease the number of testrunner frameworks in ci Gives xmls but they might look a weird b/c module level tests vs tests in classes. Doesn't give skip/disable test infra because those are tied to classes. (for future ref, could either put tests in classes or move the check_if_enable stuff into a pytest hook) Tested in CI and checked that the same number of tests are run Pull Request resolved: https://github.com/pytorch/pytorch/pull/95659 Approved by: https://github.com/huydhn
2023-02-28 22:09:01 +00:00
filterwarnings =
ignore:Module already imported so cannot be rewritten.*hypothesis:pytest.PytestAssertRewriteWarning
Make numpy/lib vendored tests dynamo traceable (#112147) Follow up https://github.com/pytorch/pytorch/pull/112146 and #112141 : make numpy/lib vendored tests dynamo traceable Pull Request resolved: https://github.com/pytorch/pytorch/pull/112147 Approved by: https://github.com/lezcano
2023-10-27 23:53:32 +00:00
xfail_strict = True
[CI] Reduce CI_SERIAL_LIST list (#124085) Add serial marker for individual tests so the test file can be removed from the ci serial list Run serial marked tests first in serial Run all other tests afterwards in parallel Slowly reduce list and mark individual tests as serial instead Hope # of serial tests is small so sharding evenness doesn't get too messed up Hopefully can do 3 procs for sm86 and cpu? serial no longer looks like a real word to me Pull Request resolved: https://github.com/pytorch/pytorch/pull/124085 Approved by: https://github.com/seemethere, https://github.com/malfet
2024-04-17 00:23:42 +00:00
markers =
serial: marks tests as needs to be run serially (deselect with '-m "not serial"')
Reference in a new issue Copy permalink