rzou a68cf3ef7d update_failures.py: add option to also remove "skipped" tests (#118931) ... Previously, you could run update_failures.py (with a commit hash) and it would add new expected failures and skips for newly failing tests and remove expected failures for newly passing tests. This PR teaches update_failures.py to also remove skips for tests that are now passing without them. The way we do this is: - dynamo_test_failures.py doesn't actually skip tests -- it runs the test and then suppresses the signal. - if the test actually passed, then the test gets skipped with a special skip message - we teach update_failures.py to look for the presence of that skip message. Test Plan: - Used this to generate https://github.com/pytorch/pytorch/pull/118928 Pull Request resolved: https://github.com/pytorch/pytorch/pull/118931 Approved by: https://github.com/yanboliang ghstack dependencies: #118874, #118882		2024-02-02 20:11:01 +00:00
..
common.py	update_failures.py: add option to also remove "skipped" tests (#118931)	2024-02-02 20:11:01 +00:00
download_reports.py	Automatically pull test reports from CI (#118882)	2024-02-02 14:18:56 +00:00
failures_histogram.py	Automatically pull test reports from CI (#118882)	2024-02-02 14:18:56 +00:00
passrate.py	Automatically pull test reports from CI (#118882)	2024-02-02 14:18:56 +00:00
update_failures.py	update_failures.py: add option to also remove "skipped" tests (#118931)	2024-02-02 20:11:01 +00:00