Xilun Wu e799f565eb [DTensor][TP][Random] Introduce TensorParallelRNGTracker to integrate parallel RNG state with Tensor Parallel (#103910) ... This PR enables the automatic use of `TensorParallelRNGTracker` in Tensor Parallel api. Some unit tests are going to be added to cover. Pull Request resolved: https://github.com/pytorch/pytorch/pull/103910 Approved by: https://github.com/wanchaol, https://github.com/fduwjj		2023-06-30 08:06:41 +00:00
..
__init__.py
test_2d_parallel.py	[2D parallel] workaround for FSDP init issue (#104398)	2023-06-29 16:07:07 +00:00
test_parallelize_api.py	[TP] Add an input resharding wrapper for TP and unit test for 2D + AC (#103334)	2023-06-23 04:05:01 +00:00
test_tp_examples.py	[TP] Add an input resharding wrapper for TP and unit test for 2D + AC (#103334)	2023-06-23 04:05:01 +00:00
test_tp_random_state.py	[DTensor][TP][Random] Introduce TensorParallelRNGTracker to integrate parallel RNG state with Tensor Parallel (#103910)	2023-06-30 08:06:41 +00:00
test_tp_style.py
test_view_sharding_dim_change.py