Animesh Jain 289df45cee Revert "[Dynamo] Trace enter/exit of TorchFunctionModes (#135422)" (#136590) ... This reverts commit 7743149b2b. Reverts * https://github.com/pytorch/pytorch/pull/135503 * https://github.com/pytorch/pytorch/pull/135502 * https://github.com/pytorch/pytorch/pull/135422 This passes this test. Earlier, the getitem would stay like a getitem in the Fx graph. But now the fake tensor propagations fails saying that .item is called. It seems that torch function is not getting triggered while fake tensor propagation. ``` import torch from torch.nn.attention.flex_attention import BlockMask, _mask_mod_signature, _score_mod_signature, flex_attention from torch._inductor.lowering import make_pointwise, register_lowering from torch._inductor.virtualized import ops from torch.nn.attention.flex_attention import create_block_mask torch.set_default_device('cuda') flex_attention = torch.compile(flex_attention, dynamic=False) prefix_lengths = torch.arange(8) def prefix_lm(b, h, q, kv): return prefix_lengths[b] >= kv mask = create_block_mask(prefix_lm, 8, None, 512, 512, _compile=True) ``` Pull Request resolved: https://github.com/pytorch/pytorch/pull/136590 Approved by: https://github.com/Chillee		2024-09-25 21:10:43 +00:00
..
ao/sparsity
autograd
backends/xeon
benchmark_utils
bottleneck_test
cpp	[TCPStore] Remove deprecated constructor (#136004)	2024-09-14 04:25:47 +00:00
cpp_api_parity
cpp_extensions	OpenReg: Fix issue when copying on the same device (#135956)	2024-09-14 09:57:45 +00:00
custom_backend
custom_operator
distributed	Revert "[RFC][torchelastic][c10d] Fix store prefix race in rendezvous (#135957)"	2024-09-24 22:24:26 +00:00
distributions
dynamo	Revert "[Dynamo] Trace enter/exit of TorchFunctionModes (#135422)" (#136590)	2024-09-25 21:10:43 +00:00
dynamo_expected_failures	Fix constant propagation in builtins and UserClasses (#131354)	2024-09-25 13:03:40 +00:00
dynamo_skips
edge
error_messages
expect	Add decomps for max_unpool (#133146)	2024-09-20 21:35:25 +00:00
export	Fix meta registry in export (#136492)	2024-09-25 17:53:02 +00:00
forward_backward_compatibility	Change wrapped_linear_prepack and wrapped_quantized_linear_prepacked to private by adding _ as prefix (#135401)	2024-09-08 04:16:24 +00:00
functorch	[aotd] Fix rrelu compilation (#136008)	2024-09-25 11:26:19 +00:00
fx	[torch][fx] Add new replacement_callback to materialize a replacement just in time (#135553)	2024-09-12 18:52:14 +00:00
higher_order_ops	[aotd] Support HOP effects in backward (#132638)	2024-08-23 15:30:58 +00:00
inductor	[Flex Attention] fix block size order (#136657)	2024-09-25 21:08:40 +00:00
jit	[dynamo] Remove skip from jit freeze tests (#135281)	2024-09-08 15:11:12 +00:00
jit_hooks
lazy
mobile
nn	[ROCm] Update to AOTriton 0.7b (#134498)	2024-09-11 20:34:01 +00:00
onnx	[ONNX] Remove the operators test (#136335)	2024-09-25 17:44:18 +00:00
optim
package
profiler	Fix flaky SIGSEGV crash in test_profile_memory (#136304)	2024-09-20 02:56:49 +00:00
quantization	[Quant][PT2E]change flatten recipe for X86InductorQuantizer (#136298)	2024-09-24 04:30:12 +00:00
scripts
test_img
torch_np	[torch/numpy][numpy2.0 compat] Additional changes for tests to run under numpy-2.0 (#136152)	2024-09-18 02:11:22 +00:00
typing
xpu
_test_bazel.py
allowlist_for_publicAPI.json	[reland][dtensor] move DTensor to public namespace (#134203)	2024-09-08 17:08:40 +00:00
conftest.py
create_dummy_torchscript_model.py
delete.py
hi.py
HowToWriteTestsUsingFileCheck.md	[Docs] Update FileCheck doc (#135199)	2024-09-06 08:18:38 +00:00
linear.py
load_torchscript_model.py
minioptest_failures_dict.json
mkl_verbose.py
mkldnn_verbose.py
pytest_shard_custom.py
run_doctests.sh
run_test.py	[ROCm] Update to AOTriton 0.7b (#134498)	2024-09-11 20:34:01 +00:00
simulate_nccl_errors.py
slow_tests.json
test_ao_sparsity.py
test_autocast.py	[MPS] Add support for autocast in MPS (#99272)	2024-09-05 23:23:17 +00:00
test_autograd.py	Run all autograd node post hooks (#134728)	2024-09-06 19:44:28 +00:00
test_autograd_fallback.py
test_autoload.py
test_binary_ufuncs.py
test_bundled_images.py	Fix lint errors in fbcode (#135614)	2024-09-13 02:04:34 +00:00
test_bundled_inputs.py
test_ci_sanity_check_fail.py
test_comparison_utils.py
test_compile_benchmark_util.py
test_complex.py
test_content_store.py
test_cpp_api_parity.py
test_cpp_extensions_aot.py
test_cpp_extensions_jit.py
test_cpp_extensions_mtia_backend.py
test_cpp_extensions_open_device_registration.py	Add torch.serialization.skip_data context manager (#134504)	2024-09-05 16:53:39 +00:00
test_cpp_extensions_stream_and_event.py
test_cuda.py	[CUDA][Expandable Segments] Account for non-gc'able memory in expandable segments tests (#136496)	2024-09-25 01:14:45 +00:00
test_cuda_expandable_segments.py
test_cuda_multigpu.py
test_cuda_nvml_based_avail.py
test_cuda_primary_ctx.py
test_cuda_sanitizer.py
test_cuda_trace.py
test_custom_ops.py	Fix lint errors in fbcode (#135614)	2024-09-13 02:04:34 +00:00
test_dataloader.py	XFAIL test_segfault (#136252)	2024-09-19 04:17:06 +00:00
test_datapipe.py
test_decomp.py	Deprecate _preserve_ops and consolidate with decomp_table (#135080)	2024-09-15 17:01:58 +00:00
test_deploy.py
test_determination.py
test_dispatch.py
test_dlpack.py
test_dynamic_shapes.py	Fix symbolic number's type and tensor's dtype mismatch bug in Tensor ctor (#135433)	2024-09-09 19:32:18 +00:00
test_expanded_weights.py
test_fake_tensor.py	Implementation of scan (#134102)	2024-09-10 04:51:16 +00:00
test_file_check.py	Fix the output of FileCheck when not run and add unit tests (#135345)	2024-09-11 04:13:24 +00:00
test_flop_counter.py
test_foreach.py	fix stride compare failed when size value equal to one in ForeachUtils.h (#134546)	2024-09-19 18:43:41 +00:00
test_function_schema.py
test_functional_autograd_benchmark.py
test_functional_optim.py
test_functionalization.py
test_functionalization_of_rng_ops.py
test_futures.py
test_fx.py	[fx] Implement deepcopy for Proxy (#133706)	2024-08-22 16:37:30 +00:00
test_fx_experimental.py
test_fx_passes.py	[Partitioner] Reuse partition to check whether nodes exist (#135317)	2024-09-21 23:52:02 +00:00
test_fx_reinplace_pass.py
test_hub.py
test_import_stats.py
test_indexing.py
test_itt.py
test_jit.py	[EZ] Restore test_unicode_comments (#134589)	2024-08-27 21:51:06 +00:00
test_jit_autocast.py
test_jit_disabled.py
test_jit_fuser.py
test_jit_fuser_legacy.py
test_jit_fuser_te.py
test_jit_legacy.py
test_jit_llga_fuser.py
test_jit_profiling.py
test_jit_simple.py
test_jit_string.py
test_jiterator.py
test_kernel_launch_checks.py
test_legacy_vmap.py
test_license.py
test_linalg.py	Fix addmm silent correctness on aarch64 (#136371)	2024-09-23 17:10:34 +00:00
test_logging.py
test_masked.py
test_maskedtensor.py	Add MaskedTensor passthrough: unfold, F.Unfold, F.Fold, stack (#125262)	2024-09-06 19:06:23 +00:00
test_matmul_cuda.py	[CUDA][FP8] Skip rowwise scaling test on sm89 (#135718)	2024-09-13 15:07:20 +00:00
test_meta.py
test_metal.py
test_mkl_verbose.py
test_mkldnn.py	Add oneDNN support for Half LSTM on CPU (#132607)	2024-08-29 03:40:10 +00:00
test_mkldnn_fusion.py
test_mkldnn_verbose.py
test_mobile_optimizer.py
test_model_dump.py
test_model_exports_to_core_aten.py	Replace capture_pre_autograd_graph with export_for_training in torch tests (#135623)	2024-09-11 19:23:08 +00:00
test_module_tracker.py	Move module_tracker to logging for confused hierarchy (#134467)	2024-08-26 19:39:08 +00:00
test_modules.py
test_monitor.py
test_mps.py	[MPS] Add upsample_bicubic2d as Metal op (#136123)	2024-09-24 18:58:11 +00:00
test_multiprocessing.py
test_multiprocessing_spawn.py	Create processes in parallel in mp.start_processes for forkserver (#134629)	2024-08-28 21:34:32 +00:00
test_namedtensor.py
test_namedtuple_return_api.py
test_native_functions.py
test_native_mha.py	[ROCm] Update to AOTriton 0.7b (#134498)	2024-09-11 20:34:01 +00:00
test_nestedtensor.py	[SDPA][Nested Tensor] Bump grad_query fudge factor for small GPUs (#135715)	2024-09-25 00:36:10 +00:00
test_nn.py	[MPS] Add upsample_bicubic2d as Metal op (#136123)	2024-09-24 18:58:11 +00:00
test_nnapi.py
test_numba_integration.py
test_numpy_interop.py
test_openmp.py
test_ops.py	tf32 off for test_noncontiguous_samples in test_ops.py (#136484)	2024-09-24 14:26:47 +00:00
test_ops_fwd_gradients.py
test_ops_gradients.py
test_ops_jit.py
test_optim.py
test_out_dtype_op.py
test_overrides.py
test_package.py
test_per_overload_api.py
test_prims.py
test_proxy_tensor.py	Fix bug in functional tensor decomp (#136600)	2024-09-25 17:37:50 +00:00
test_pruning_op.py
test_public_bindings.py	Fix lint errors in fbcode (#135614)	2024-09-13 02:04:34 +00:00
test_python_dispatch.py	make view.dtype always return an alias (#136074)	2024-09-17 03:40:54 +00:00
test_pytree.py
test_quantization.py
test_reductions.py	fix mean_out: op does not update parameter out for BF16/FP16 dtype on CPU (#135174)	2024-09-21 14:21:42 +00:00
test_scatter_gather_ops.py
test_schema_check.py
test_segment_reductions.py
test_serialization.py	Make test_skip_data_serialization regex more flexible (#136580)	2024-09-25 11:27:23 +00:00
test_set_default_mobile_cpu_allocator.py
test_shape_ops.py
test_show_pickle.py
test_sort_and_select.py	[torch/numpy][numpy2.0 compat] Additional changes for tests to run under numpy-2.0 (#136152)	2024-09-18 02:11:22 +00:00
test_sparse.py
test_sparse_csr.py	Add scaling arguments to bsr_dense_addmm (#136104)	2024-09-16 20:26:54 +00:00
test_sparse_semi_structured.py	Revert "Add Triton CPU as an Inductor backend (#133408)"	2024-09-16 18:33:33 +00:00
test_spectral_ops.py
test_stateless.py	Allow optional positional arguments for torch.func.functional_call (#134643)	2024-09-12 15:22:06 +00:00
test_static_runtime.py
test_subclass.py
test_sympy_utils.py	Add TensorReferenceAnalysis and some tests (#135886)	2024-09-14 23:09:40 +00:00
test_tensor_creation_ops.py
test_tensorboard.py
test_tensorexpr.py
test_tensorexpr_pybind.py
test_testing.py
test_throughput_benchmark.py
test_torch.py	Revert "Add deterministic path for CUDA cumsum (#136224)"	2024-09-25 14:11:01 +00:00
test_transformers.py	Add option to configure reduced precision math backend for SDPA (#135964)	2024-09-24 07:11:38 +00:00
test_type_hints.py
test_type_info.py
test_type_promotion.py	Add type checks for Tensor.add_ (#135864)	2024-09-19 03:09:36 +00:00
test_typing.py
test_unary_ufuncs.py
test_utils.py
test_utils_internal.py	[justknobs] Override __bool__ method (#134799)	2024-08-30 04:54:02 +00:00
test_view_ops.py
test_vulkan.py
test_weak.py
test_xnnpack_integration.py
test_xpu.py	Fix xpu memory stats error (#135818)	2024-09-13 02:41:21 +00:00