mirror of
https://github.com/saymrwulf/pytorch.git
synced 2026-05-14 20:57:59 +00:00
0fc02dbba4
# Summary: - I added a new submodule Cutlass pointing to 2.10 release. The inclusion of flash_attention code should be gated by the flag: USE_FLASH_ATTENTION. This is defaulted to off resulting in flash to not be build anywhere. This is done on purpose since we don't have A100 machines to compile and test on. - Only looked at CMake did not attempt bazel or buck yet. - I included the mha_fwd from flash_attention that has ben refactored to use cutlass 2.10. There is currently no backwards kernel on this branch. That would be a good follow up. Pull Request resolved: https://github.com/pytorch/pytorch/pull/81434 Approved by: https://github.com/cpuhrsch |
||
|---|---|---|
| .. | ||
| benchmark@0d98dba29d | ||
| cpuinfo@8ec7bd91ad | ||
| cub@d106ddb991 | ||
| cudnn_frontend@43709ab96c | ||
| cutlass@b72cbf957d | ||
| eigen@3147391d94 | ||
| fbgemm@499cd22f5c | ||
| flatbuffers@d0cede9c90 | ||
| fmt@cd4af11efc | ||
| foxi@c278588e34 | ||
| FP16@4dfe081cf6 | ||
| FXdiv@b408327ac2 | ||
| gemmlowp | ||
| gloo@5b14351326 | ||
| googletest@e2239ee604 | ||
| ideep@77d662b313 | ||
| ios-cmake@8abaed637d | ||
| ittapi@5b8a7d7422 | ||
| kineto@0703c78999 | ||
| miniz-2.1.0 | ||
| nccl | ||
| neon2sse@97a126f08c | ||
| nlohmann@87cda1d664 | ||
| NNPACK@c07e3a0400 | ||
| onnx@f7ee1ac60d | ||
| onnx-tensorrt@c153211418 | ||
| pocketfft@ea778e3771 | ||
| protobuf@d1eca4e4b4 | ||
| psimd@072586a71b | ||
| pthreadpool@a134dd5d4c | ||
| pybind11@aa304c9c7d | ||
| python-enum@4cfedc426c | ||
| python-peachpy@f45429b087 | ||
| python-six@15e31431af | ||
| QNNPACK@7d2a4e9931 | ||
| sleef@e0a003ee83 | ||
| tbb@a51a90bc60 | ||
| tensorflow_cuda_bazel_build/cuda | ||
| tensorpipe@52791a2fd2 | ||
| valgrind-headers | ||
| VulkanMemoryAllocator@a6bfc23725 | ||
| XNNPACK@ae108ef49a | ||
| zstd@aec56a52fb | ||
| BUCK.oss | ||
| BUILD | ||
| build_bundled.py | ||
| cuda.BUILD | ||
| cudnn.BUILD | ||
| eigen.BUILD | ||
| fmt.BUILD | ||
| foxi.BUILD | ||
| generate-cpuinfo-wrappers.py | ||
| generate-xnnpack-wrappers.py | ||
| glog.buck.bzl | ||
| gloo.BUILD | ||
| ideep.BUILD | ||
| kineto.buck.bzl | ||
| kineto.BUILD | ||
| LICENSES_BUNDLED.txt | ||
| METADATA.bzl | ||
| mkl-dnn.BUILD | ||
| mkl.BUILD | ||
| mkl_headers.BUILD | ||
| onnx.BUILD | ||
| README.md | ||
| sleef.BUILD | ||
| sleef.bzl | ||
| substitution.bzl | ||
| tbb.BUILD | ||
| tbb.patch | ||
| tensorpipe.BUILD | ||
| xnnpack.buck.bzl | ||
| xnnpack_src_defs.bzl | ||
| xnnpack_wrapper_defs.bzl | ||
This folder contains vendored copies of third-party libraries that we use.