pytorch/torch/distributed
Ankita George 70f6aaa786 [OSS] Add kwargs to fsspec reader/writer (#145845)
Summary: Add kwargs to fsspec reader/writer. This will be used when reading/writing from huggingface because it needs a token to access the repositories

Test Plan: https://fburl.com/anp/agkrlas1 ability to read write to hf with fsspec

Differential Revision: D68738777

Pull Request resolved: https://github.com/pytorch/pytorch/pull/145845
Approved by: https://github.com/mhorowitz
2025-01-30 21:00:58 +00:00
..
_composable PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
_shard PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
_sharded_tensor
_sharding_spec
_symmetric_memory [async-TP] Fix scheduling in matmul+reduce-scatter for 2 ranks (#145846) 2025-01-30 18:26:34 +00:00
_tensor
_tools PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
algorithms PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
autograd
benchmarks [BE][CI] bump ruff to 0.8.4 (#143753) 2024-12-24 12:24:10 +00:00
checkpoint [OSS] Add kwargs to fsspec reader/writer (#145845) 2025-01-30 21:00:58 +00:00
elastic Make torchelastic etcd rendezvous publicly importable (#145396) 2025-01-23 23:56:45 +00:00
examples
fsdp PEP585 update - torch/distributed/fsdp (#145162) 2025-01-19 20:04:05 +00:00
launcher PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
nn PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
optim PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
pipelining [NFC] Fix some minor typos. (#145599) 2025-01-24 18:58:59 +00:00
rpc PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
tensor [DTensor] Add pointwise ops strategy for aten.minimum (#145816) 2025-01-29 01:19:01 +00:00
__init__.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
_checkpointable.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
_composable_state.py [FSDP2] Make module-to-state mapping use weakrefs (#139650) 2024-11-05 02:16:52 +00:00
_functional_collectives.py PEP585: Missed conversions (#145342) 2025-01-29 05:24:36 +00:00
_functional_collectives_impl.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
_state_dict_utils.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
argparse_util.py
c10d_logger.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
collective_utils.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
constants.py
CONTRIBUTING.md
device_mesh.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
distributed_c10d.py [NFC] Fix some minor typos. (#145599) 2025-01-24 18:58:59 +00:00
launch.py
logging_handlers.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
remote_device.py
rendezvous.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00
run.py Improve torchrun documentation (#144354) 2025-01-24 20:40:05 +00:00
utils.py PEP585 update - torch/distributed (#145164) 2025-01-21 04:23:29 +00:00