Yan Zhiwei fe4f8e97cd [Intel GPU] xpu-ops codegen via backend whitelist (#130082) ... # Motivation This PR intends to enhance the codegen to allow generate codes for XPU backend. XPU operators need be registered in an hand-written way currently. Developers have no chance to take the advantage of shared code to handle tensor meta setting (like strides, proxy output, structured kernels). Manually porting code is erro-prone and may lead to high maintaining efforts. We utilize the backend_whitelist argument in `gen.py` to generate XPU needed headers and source codes. # Usage XPU ops lie in `third_pary/torch-xpu-ops`, the codegen process is triggered before the complation of `torch-xpu-ops` We use the following commands to generate XPU operators ` python -m torchgen.gen --source-path path/to/yaml/of/xpu --install-dir build/xpu --per-operator-headers --static-dispatch-backend --backend-whitelist=XPU` The diff lies at `backend-whitelist=XPU`. The backend-whitelist key is an existent argument in torchgen. The input of `gen.py` are code templates and operators yaml. We share the same templates in `aten`. A simplified yaml lies in `third_party/torch-xpu-ops`, which only includes the supported xpu operators. This yaml is a copy-and-modify of `native_functions.yaml`. No extra entry is added, the format is same as the one in `aten` # Result All operators headers are generated in `build/xpu/ATen/ops` independently, which would not affect operators declared/defined by CPU/CUDA or any other backend. XPU operators only include headers in this folder. # Verification * In `third-party/torch-xpu-ops`, we migrate all supported kernels to structured kernels style, where they are registered through `REGISTER_XPU_DISPATCH` or `TORCH_IMPL_FUNC`, and we have UT verification based on `test_ops.py` Pull Request resolved: https://github.com/pytorch/pytorch/pull/130082 Approved by: https://github.com/EikanWang, https://github.com/gujinghui, https://github.com/atalman ghstack dependencies: #130019		2024-07-31 16:31:38 +00:00
..
core	Don't install remaining caffe2 python files (#129067)	2024-06-27 17:25:59 +00:00
perfkernels	Don't install remaining caffe2 python files (#129067)	2024-06-27 17:25:59 +00:00
serialize	Revert "Make c10::string_view an alias of std::string_view (#130417)"	2024-07-12 00:37:04 +00:00
utils	[BE] Remove suppression of inconsistent missing overrides (#131524)	2024-07-24 10:07:36 +00:00
.clang-format
CMakeLists.txt	[Intel GPU] xpu-ops codegen via backend whitelist (#130082)	2024-07-31 16:31:38 +00:00
unexported_symbols.lds
version_script.lds