transformers/.github/workflows
Luc Georges 144852fb6b
refactor: benchmarks (#33896)
* refactor: benchmarks

Based on a discussion with @LysandreJik & @ArthurZucker, the goal of
this PR is to improve transformers' benchmark system.

This is a WIP, for the moment the infrastructure required to make things
work is not ready. Will update the PR description when it is the case.

* feat: add db init in benchmarks CI

* fix: pg_config is missing in runner

* fix: add psql to the runner

* fix: connect info from env vars + PR comments

* refactor: set database as env var

* fix: invalid working directory

* fix: `commit_msg` -> `commit_message`

* fix: git marking checked out repo as unsafe

* feat: add logging

* fix: invalid device

* feat: update grafana dashboard for prod grafana

* feat: add `commit_id` to header table

* feat: commit latest version of dashboard

* feat: move measurements into json field

* feat: remove drop table migration queries

* fix: `torch.arrange` -> `torch.arange`

* fix: add missing `s` to `cache_position` positional argument

* fix: change model

* revert: `cache_positions` -> `cache_position`

* fix: set device for `StaticCache`

* fix: set `StaticCache` dtype

* feat: limit max cache len

* fix script

* raise error on failure!

* not try catch

* try to skip generate compilation

* update

* update docker image!

* update

* update again!@

* update

* updates

* ???

* ??

* use `torch.cuda.synchronize()`

* fix json

* nits

* fix

* fixed!

* f**k

* feat: add TTNT panels

* feat: add try except

---------

Co-authored-by: Arthur Zucker <arthur.zucker@gmail.com>
2024-10-11 18:03:29 +02:00
..
add-model-like.yml Updated workflows to the latest versions (#32405) 2024-08-14 20:18:14 +02:00
benchmark.yml refactor: benchmarks (#33896) 2024-10-11 18:03:29 +02:00
build-ci-docker-images.yml Support MUSA (Moore Threads GPU) backend in transformers (#31913) 2024-08-13 21:10:25 -04:00
build-docker-images.yml CI Build image - move runners (#33530) 2024-09-17 18:12:12 +02:00
build-nightly-ci-docker-images.yml CI Build image - move runners (#33530) 2024-09-17 18:12:12 +02:00
build-past-ci-docker-images.yml CI Build image - move runners (#33530) 2024-09-17 18:12:12 +02:00
build_documentation.yml Docs: add the ability to manually trigger jobs (#33598) 2024-09-20 09:37:39 +01:00
build_pr_documentation.yml [i18n-ar] Add File : docs/source/ar/_toctree.yml (#32696) 2024-09-16 10:02:03 -07:00
check_tiny_models.yml Updated workflows to the latest versions (#32405) 2024-08-14 20:18:14 +02:00
doctest_job.yml Migrate the CI runners to the new clusters (#33849) 2024-10-03 14:39:49 +02:00
doctests.yml Migrate the CI runners to the new clusters (#33849) 2024-10-03 14:39:49 +02:00
model_jobs.yml Update daily ci to use new cluster (#33627) 2024-09-20 21:05:30 +02:00
model_jobs_amd.yml Revive AMD scheduled CI (#33448) 2024-09-12 15:52:15 +02:00
push-important-models.yml Migrate the CI runners to the new clusters (#33849) 2024-10-03 14:39:49 +02:00
release-conda.yml Updated workflows to the latest versions (#32405) 2024-08-14 20:18:14 +02:00
self-nightly-caller.yml Revive Nightly/Past CI (#31159) 2024-06-20 18:57:24 +02:00
self-nightly-past-ci-caller.yml Revive Nightly/Past CI (#31159) 2024-06-20 18:57:24 +02:00
self-past-caller.yml Revive Nightly/Past CI (#31159) 2024-06-20 18:57:24 +02:00
self-pr-slow-ci.yml [PR run-slow] (#33939) 2024-10-04 14:46:15 +02:00
self-push-amd-mi210-caller.yml Fix AMD push CI not triggered (#28029) 2023-12-14 12:44:00 +01:00
self-push-amd-mi250-caller.yml Fix AMD push CI not triggered (#28029) 2023-12-14 12:44:00 +01:00
self-push-amd-mi300-caller.yml CI: update to ROCm 6.0.2 and test MI300 (#30266) 2024-05-13 18:14:36 +02:00
self-push-amd.yml update push CI workflow files for security (#33142) 2024-08-28 18:15:58 +02:00
self-push-caller.yml update github actions packages' version to suppress warnings (#30249) 2024-04-15 15:08:09 +02:00
self-push.yml Migrate the CI runners to the new clusters (#33849) 2024-10-03 14:39:49 +02:00
self-scheduled-amd-caller.yml restructure AMD scheduled CI (#27743) 2023-12-04 15:32:05 +01:00
self-scheduled-amd-mi210-caller.yml Revive AMD scheduled CI (#33448) 2024-09-12 15:52:15 +02:00
self-scheduled-amd-mi250-caller.yml Revive AMD scheduled CI (#33448) 2024-09-12 15:52:15 +02:00
self-scheduled-amd.yml Revive AMD scheduled CI (#33448) 2024-09-12 15:52:15 +02:00
self-scheduled-caller.yml Update daily ci to use new cluster (#33627) 2024-09-20 21:05:30 +02:00
self-scheduled.yml Update daily ci to use new cluster (#33627) 2024-09-20 21:05:30 +02:00
slack-report.yml Revive Nightly/Past CI (#31159) 2024-06-20 18:57:24 +02:00
ssh-runner.yml Update SSH workflow file (#34084) 2024-10-11 10:53:12 +02:00
stale.yml Update stale.yml (#33434) 2024-09-12 11:23:47 +02:00
TROUBLESHOOT.md Fixed minor typos (#28489) 2024-01-15 16:45:15 +00:00
trufflehog.yml feat(ci): set fetch-depth: 0 in trufflehog checkout step (#31663) 2024-07-30 14:49:26 +02:00
update_metdata.yml update github actions packages' version to suppress warnings (#30249) 2024-04-15 15:08:09 +02:00
upload_pr_documentation.yml [doc build] Use secrets (#24079) 2023-06-07 17:33:39 +02:00