transformers/tests/deepspeed
Xuehai Pan 976189a6df
Fix initialization for missing parameters in from_pretrained under ZeRO-3 (#28245)
* Fix initialization for missing parameters in `from_pretrained` under ZeRO-3

* Test initialization for missing parameters under ZeRO-3

* Add more tests

* Only enable deepspeed context for per-module level parameters

* Enable deepspeed context only once

* Move class definition inside test case body
2024-01-09 14:58:21 +00:00
..
ds_config_zero2.json
ds_config_zero3.json
test_deepspeed.py Fix initialization for missing parameters in from_pretrained under ZeRO-3 (#28245) 2024-01-09 14:58:21 +00:00
test_model_zoo.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
vit_feature_extractor.json