saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/.github
History
Huy Do 2fbc0fab20 Setup sccache for linux test (#84916) 
The TTS alarm in HUD is quite noisy because of `pull / linux-focal-py3.7-gcc7 / test (backwards_compat)`. Some runs take up to 50m, i.e. [4893945786](https://github.com/pytorch/pytorch/actions/runs/3038960118/jobs/4893945786) while others take only 10m, i.e. [4893781147](https://github.com/pytorch/pytorch/actions/runs/3038943635/jobs/4893781147).  Looking closer into their logs, it turns out that the longer runs have a much higher rate of cache miss.  For example, [4893945786](https://github.com/pytorch/pytorch/actions/runs/3038960118/jobs/4893945786)

```
Compile requests                    6487
Compile requests executed           6224
Cache hits                          4975
Cache hits (C/C++)                  4975
Cache misses                        1227
Cache misses (C/C++)                1227
Cache timeouts                         0
Cache read errors                      0
Forced recaches                        0
Cache write errors                     0
Compilation failures                   9
Cache errors                          13
Cache errors (C/C++)                  13
Non-cacheable compilations             0
Non-cacheable calls                   16
Non-compilation calls                247
Unsupported compiler calls             0
Average cache write                0.096 s
Average cache read miss           11.681 s
Average cache read hit             0.040 s
Failed distributed compilations        0

Non-cacheable reasons:
multiple input files                  15
unknown source language                1

Cache location                  S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/)
```

In https://github.com/pytorch/pytorch/pull/82103, we didn't setup `SCCACHE_S3_KEY_PREFIX` for `_linux-test`, which could explain the high rate of cache miss here.  `backwards_compat` is a bit different than other tests in which it compiles PyTorch and gets the benefit from caching.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/84916
Approved by: https://github.com/seemethere
2022-09-13 03:06:14 +00:00
..
actions [BE] Use teardown-linux/chown actions for binary builds (#84449) 2022-09-07 05:52:27 +00:00
ci_commit_pins [vision hash update] update the pinned vision hash (#84913) 2022-09-13 02:43:17 +00:00
ISSUE_TEMPLATE add merge blocking to ci: sev template (#83940) 2022-08-24 02:06:53 +00:00
scripts [GHF][BE] Delete land checks branch when done (#84767) 2022-09-10 02:45:35 +00:00
templates [BE] Use teardown-linux/chown actions for binary builds (#84449) 2022-09-07 05:52:27 +00:00
workflows Setup sccache for linux test (#84916) 2022-09-13 03:06:14 +00:00
actionlint.yaml ci: Switch MPS tests to self hosted runners on AWS (#81772) 2022-07-21 10:05:02 +00:00
ISSUE_TEMPLATE.md
merge_rules.yaml [GHF] Changing the ordering in merge rules to allow more appropriate messages to be raised first (#84359) 2022-09-01 16:56:50 +00:00
PULL_REQUEST_TEMPLATE.md Revert "Update the pull request template (#81991)" (#83025) 2022-08-08 21:54:37 +00:00
pytorch-circleci-labels.yml
pytorch-probot.yml
regenerate.sh
requirements-gha-cache.txt Enable cache action for windows and other minor workflows (#84093) 2022-08-26 21:33:25 +00:00