saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/build.bzl

121 lines
5 KiB
Python
Raw Normal View History

Move //xplat/caffe2:caffe2_serialize to shared build structure Summary: This is a first step to migrate xplat targets to shared build structure. Eventually both xplat buck and open source bazel targets will be generated from shared build.bzl. Test Plan: Should be no-op, rely on CI. Reviewed By: malfet Differential Revision: D35270004 Pull Request resolved: https://github.com/pytorch/pytorch/pull/75847 Approved by: https://github.com/linbinyu
2022-04-15 17:25:29 +00:00
def define_targets(rules):
rules.cc_library(
name = "caffe2_serialize",
srcs = [
"caffe2/serialize/file_adapter.cc",
"caffe2/serialize/inline_container.cc",
"caffe2/serialize/istream_adapter.cc",
"caffe2/serialize/read_adapter_interface.cc",
],
tags = [
"supermodule:android/default/pytorch",
"supermodule:ios/default/public.pytorch",
move version_h to shared build structure in Buck (#75964) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75964 This is already in the shared build structure for Bazel, but we need to implement genrule for fbcode. There's an xplat target that can't build in fbcode yet because the dependencies don't line up, so we have to add a tag to exclude it. ghstack-source-id: 154696020 Test Plan: Rely on CI Reviewed By: malfet Differential Revision: D35443900 fbshipit-source-id: 0768b29906c8218d7aebfdc7c18d69f59a0c9384 (cherry picked from commit bff47be441bd142392a07aa177be02e18aa86f1c)
2022-04-26 12:00:03 +00:00
"-fbcode",
move Bazel version header generation to shared build structure (#75332) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75332 ghstack-source-id: 154678044 Test Plan: Rely on OSS CI. Reviewed By: malfet Differential Revision: D35434229 fbshipit-source-id: 7cdd33fa32d0c485f44477e414c24c9bc4b74963 (cherry picked from commit 60285c613e8703c52f36f0bf1178e35c04574ffa)
2022-04-25 17:45:10 +00:00
"xplat",
Move //xplat/caffe2:caffe2_serialize to shared build structure Summary: This is a first step to migrate xplat targets to shared build structure. Eventually both xplat buck and open source bazel targets will be generated from shared build.bzl. Test Plan: Should be no-op, rely on CI. Reviewed By: malfet Differential Revision: D35270004 Pull Request resolved: https://github.com/pytorch/pytorch/pull/75847 Approved by: https://github.com/linbinyu
2022-04-15 17:25:29 +00:00
],
visibility = ["//visibility:public"],
deps = [
":caffe2_headers",
define the caffe2_serialize target in Bazel (#75942) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75942 This also requires changes to the target definition and the xplat translator to get it working. ghstack-source-id: 154678046 Test Plan: Verify locally and rely on CI. Reviewed By: malfet Differential Revision: D35704597 fbshipit-source-id: 6b0d9f5a044609b24dda656f80233ba6186c097f (cherry picked from commit 6de43c5ca7a973c9f8b71f4d60d4d5e85cc2ba21)
2022-04-25 16:04:57 +00:00
"@com_github_glog//:glog",
"//c10",
"//third_party/miniz-2.0.8:miniz",
Move //xplat/caffe2:caffe2_serialize to shared build structure Summary: This is a first step to migrate xplat targets to shared build structure. Eventually both xplat buck and open source bazel targets will be generated from shared build.bzl. Test Plan: Should be no-op, rely on CI. Reviewed By: malfet Differential Revision: D35270004 Pull Request resolved: https://github.com/pytorch/pytorch/pull/75847 Approved by: https://github.com/linbinyu
2022-04-15 17:25:29 +00:00
],
)
move Bazel version header generation to shared build structure (#75332) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75332 ghstack-source-id: 154678044 Test Plan: Rely on OSS CI. Reviewed By: malfet Differential Revision: D35434229 fbshipit-source-id: 7cdd33fa32d0c485f44477e414c24c9bc4b74963 (cherry picked from commit 60285c613e8703c52f36f0bf1178e35c04574ffa)
2022-04-25 17:45:10 +00:00
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
rules.genrule(
name = "generate-code",
srcs = [
"aten/src/ATen/native/ts_native_functions.yaml",
"aten/src/ATen/templates/DispatchKeyNativeFunctions.cpp",
"aten/src/ATen/templates/DispatchKeyNativeFunctions.h",
"aten/src/ATen/templates/LazyIr.h",
"aten/src/ATen/templates/RegisterDispatchKey.cpp",
"torch/csrc/lazy/core/shape_inference.h",
"torch/csrc/lazy/ts_backend/ts_native_functions.cpp",
":native_functions.yaml",
":tags.yaml",
],
tools = ["//tools/setup_helpers:generate_code"],
outs = _GENERATED_CPP + GENERATED_AUTOGRAD_H + GENERATED_LAZY_H + GENERATED_TESTING_PY,
cmd = "$(location //tools/setup_helpers:generate_code) " +
introduce new --gen-dir flag to generate_code and use it in fbcode (#75800) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75800 This leads to more similarities between OSS CMake and eventually OSS Bazel. We will be able to generate files with the same names and not have different file lists between the builds. ghstack-source-id: 155300043 Test Plan: Verified locally and in CI. Reviewed By: dreiss Differential Revision: D35648586 fbshipit-source-id: 9f1638b5665ebcc64466883f65ef24a2bfd05228 (cherry picked from commit 7f2acff1baa8dfafddefdc720714f8d39feda436)
2022-05-04 13:48:20 +00:00
"--gen-dir=$(RULEDIR) " +
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
"--native-functions-path $(location :native_functions.yaml) " +
"--tags-path=$(location :tags.yaml) " +
"--gen_lazy_ts_backend",
disable the //:generate-code target in Bazel (#76174) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/76174 This is about to conflict with the existing Bazel codegen outputs. Switch to it atomically. ghstack-source-id: 155029309 Test Plan: Verify manually and rely on CI. Reviewed By: dreiss Differential Revision: D35815288 fbshipit-source-id: 8b35e7baeb8572aef13c07cac689ee84dc7335d5 (cherry picked from commit 6dde9831a30fcf664b73fccaa51e30a7049b3251)
2022-05-03 12:05:03 +00:00
tags = [
# Filter this target out for Bazel until we are ready to
# use it. When we refactor this for fbcode it will start
# to conflict with the Bazel code generator.
"-bazel",
],
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
)
move Bazel version header generation to shared build structure (#75332) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75332 ghstack-source-id: 154678044 Test Plan: Rely on OSS CI. Reviewed By: malfet Differential Revision: D35434229 fbshipit-source-id: 7cdd33fa32d0c485f44477e414c24c9bc4b74963 (cherry picked from commit 60285c613e8703c52f36f0bf1178e35c04574ffa)
2022-04-25 17:45:10 +00:00
rules.genrule(
name = "version_h",
srcs = [
":torch/csrc/api/include/torch/version.h.in",
":version.txt",
],
outs = ["torch/csrc/api/include/torch/version.h"],
cmd = "$(location //tools/setup_helpers:gen_version_header) " +
"--template-path $(location :torch/csrc/api/include/torch/version.h.in) " +
"--version-path $(location :version.txt) --output-path $@ ",
tools = ["//tools/setup_helpers:gen_version_header"],
)
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
# These lists are temporarily living in and exported from the shared
# structure so that an internal build that lives under a different
# root can access them. These could technically live in a separate
# file in the same directory but that would require extra work to
# ensure that file is synced to both Meta internal repositories and
# GitHub. This problem will go away when the targets downstream of
# generate-code that use these lists are moved into the shared
# structure as well.
GENERATED_AUTOGRAD_H = [
introduce new --gen-dir flag to generate_code and use it in fbcode (#75800) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75800 This leads to more similarities between OSS CMake and eventually OSS Bazel. We will be able to generate files with the same names and not have different file lists between the builds. ghstack-source-id: 155300043 Test Plan: Verified locally and in CI. Reviewed By: dreiss Differential Revision: D35648586 fbshipit-source-id: 9f1638b5665ebcc64466883f65ef24a2bfd05228 (cherry picked from commit 7f2acff1baa8dfafddefdc720714f8d39feda436)
2022-05-04 13:48:20 +00:00
"torch/csrc/autograd/generated/Functions.h",
"torch/csrc/autograd/generated/VariableType.h",
"torch/csrc/autograd/generated/python_functions.h",
"torch/csrc/autograd/generated/variable_factories.h",
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
]
GENERATED_TESTING_PY = [
introduce new --gen-dir flag to generate_code and use it in fbcode (#75800) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75800 This leads to more similarities between OSS CMake and eventually OSS Bazel. We will be able to generate files with the same names and not have different file lists between the builds. ghstack-source-id: 155300043 Test Plan: Verified locally and in CI. Reviewed By: dreiss Differential Revision: D35648586 fbshipit-source-id: 9f1638b5665ebcc64466883f65ef24a2bfd05228 (cherry picked from commit 7f2acff1baa8dfafddefdc720714f8d39feda436)
2022-05-04 13:48:20 +00:00
"torch/testing/_internal/generated/annotated_fn_args.py",
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
]
GENERATED_LAZY_H = [
introduce new --gen-dir flag to generate_code and use it in fbcode (#75800) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75800 This leads to more similarities between OSS CMake and eventually OSS Bazel. We will be able to generate files with the same names and not have different file lists between the builds. ghstack-source-id: 155300043 Test Plan: Verified locally and in CI. Reviewed By: dreiss Differential Revision: D35648586 fbshipit-source-id: 9f1638b5665ebcc64466883f65ef24a2bfd05228 (cherry picked from commit 7f2acff1baa8dfafddefdc720714f8d39feda436)
2022-05-04 13:48:20 +00:00
"torch/csrc/lazy/generated/LazyIr.h",
"torch/csrc/lazy/generated/LazyNativeFunctions.h",
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
]
_GENERATED_CPP = [
introduce new --gen-dir flag to generate_code and use it in fbcode (#75800) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75800 This leads to more similarities between OSS CMake and eventually OSS Bazel. We will be able to generate files with the same names and not have different file lists between the builds. ghstack-source-id: 155300043 Test Plan: Verified locally and in CI. Reviewed By: dreiss Differential Revision: D35648586 fbshipit-source-id: 9f1638b5665ebcc64466883f65ef24a2bfd05228 (cherry picked from commit 7f2acff1baa8dfafddefdc720714f8d39feda436)
2022-05-04 13:48:20 +00:00
"torch/csrc/autograd/generated/Functions.cpp",
"torch/csrc/autograd/generated/VariableType_0.cpp",
"torch/csrc/autograd/generated/VariableType_1.cpp",
"torch/csrc/autograd/generated/VariableType_2.cpp",
"torch/csrc/autograd/generated/VariableType_3.cpp",
"torch/csrc/autograd/generated/VariableType_4.cpp",
"torch/csrc/autograd/generated/TraceType_0.cpp",
"torch/csrc/autograd/generated/TraceType_1.cpp",
"torch/csrc/autograd/generated/TraceType_2.cpp",
"torch/csrc/autograd/generated/TraceType_3.cpp",
"torch/csrc/autograd/generated/TraceType_4.cpp",
"torch/csrc/autograd/generated/ADInplaceOrViewType_0.cpp",
"torch/csrc/autograd/generated/ADInplaceOrViewType_1.cpp",
"torch/csrc/autograd/generated/python_functions_0.cpp",
"torch/csrc/autograd/generated/python_functions_1.cpp",
"torch/csrc/autograd/generated/python_functions_2.cpp",
"torch/csrc/autograd/generated/python_functions_3.cpp",
"torch/csrc/autograd/generated/python_functions_4.cpp",
"torch/csrc/autograd/generated/python_nn_functions.cpp",
"torch/csrc/autograd/generated/python_fft_functions.cpp",
"torch/csrc/autograd/generated/python_linalg_functions.cpp",
"torch/csrc/autograd/generated/python_return_types.cpp",
"torch/csrc/autograd/generated/python_sparse_functions.cpp",
"torch/csrc/autograd/generated/python_special_functions.cpp",
"torch/csrc/autograd/generated/python_torch_functions_0.cpp",
"torch/csrc/autograd/generated/python_torch_functions_1.cpp",
"torch/csrc/autograd/generated/python_torch_functions_2.cpp",
"torch/csrc/autograd/generated/python_variable_methods.cpp",
move generate-code into shared build structure (#75699) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/75699 ghstack-source-id: 155255334 Test Plan: Rely on CI. Reviewed By: dreiss Differential Revision: D35587412 fbshipit-source-id: 5ab79c07029de279a1fae36519654a73bb61d430 (cherry picked from commit 4896b72a6c0cc087e36889d21d2d885009d94a6d)
2022-05-03 09:48:27 +00:00
]
Reference in a new issue Copy permalink