pytorch/tools
lezcano 42a2359612 Add forward AD for linalg.det and simplify its backward (#79487)
This PR is in preparation for implementing `logdet` and `slogdet` as
structured kernels + implementing them with more efficient derivatives

We implement forward AD for det. We also simplify the implementation of
the backward, and leave a note on how to implement it properly for
singular matrices. We leave thad for future work.

Note (by looking at the OpInfo) that the current implementation passes
the same tests as the one before. We skip the forward-over-backward in
the singular case, as that one was not working in the gradgrad case
either.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/79487
Approved by: https://github.com/nikitaved, https://github.com/albanD
2022-06-24 14:15:17 +00:00
..
amd_build Revert "To add hipify_torch as a submodule in pytorch/third_party (#74704)" 2022-06-21 23:54:00 +00:00
autograd Add forward AD for linalg.det and simplify its backward (#79487) 2022-06-24 14:15:17 +00:00
build_defs [3] move aten targets to shared buck file (#79966) 2022-06-23 15:16:44 +00:00
code_analyzer Re-land BUCK build for pytorch mobile (#77612) 2022-05-17 00:30:13 +00:00
code_coverage [codemod][usort] apply import merging for fbcode (1 of 11) (#78973) 2022-06-06 23:44:28 +00:00
config
coverage_plugins_package Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
fast_nvcc Revert autoformat of tools/fast_nvcc/fast_nvcc.py 2022-05-12 04:02:46 +00:00
gdb Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
iwyu Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
jit [retake][mobile] Fix lightweight dispatch OOM error by introducing selective build 2022-06-13 17:23:02 +00:00
linter Add option to skip binaries when doing pip install for lintrunner (#78668) 2022-06-02 20:50:57 +00:00
lite_interpreter rename BUILD.buck to BUCK.oss (#78792) 2022-06-03 07:23:16 +00:00
lldb Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
onnx [ONNX] Refactor to remove inline imports - attempt 2 (#77448) 2022-05-16 14:44:24 +00:00
pyi ENH: Add a force argument to numpy() (#78564) 2022-06-06 14:14:17 +00:00
rules [AutoAccept][Codemod][FBSourceBuckFormatLinter] Daily arc lint --take BUCKFORMAT (#79692) 2022-06-16 17:01:17 +00:00
setup_helpers [retake][mobile] Fix lightweight dispatch OOM error by introducing selective build 2022-06-13 17:23:02 +00:00
shared [lint] upgrade mypy to latest version 2022-05-03 20:51:34 +00:00
stats [ci] delete JOB_BASE_NAME (#80046) 2022-06-23 21:06:48 +00:00
test [ci] write test suites to rockset 2022-06-10 15:38:09 +00:00
testing [GHA] Add warning when S3 stats for sharding aren't found (#80176) 2022-06-24 04:14:10 +00:00
__init__.py
bazel.bzl move gen_aten and gen_aten_hip into shared build structure 2022-06-15 18:22:52 +00:00
build_libtorch.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
build_pytorch_libs.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
cpuinfo_target_definition.bzl Add all bzl files per D36874458 2022-06-06 09:40:19 -07:00
download_mnist.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
extract_scripts.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
gen_flatbuffers.sh
generate_torch_version.py tools: Add ability to grab release versions 2022-06-01 17:19:17 +00:00
generated_dirs.txt
git_add_generated_dirs.sh
git_reset_generated_dirs.sh
miniz_target_definition.bzl Updating miniz library from version 2.0.8 -> 2.1.0 (#79636) 2022-06-22 15:02:16 +00:00
nightly.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
nvcc_fix_deps.py
perf_kernel_defs.bzl Add all bzl files per D36874458 2022-06-06 09:40:19 -07:00
pytorch.version
README.md [ci] delete old linter stuff 2022-05-11 07:40:44 +00:00
render_junit.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
sgx_aten_target_definitions.bzl Add all bzl files per D36874458 2022-06-06 09:40:19 -07:00
sgx_caffe2_target_definitions.bzl Add all bzl files per D36874458 2022-06-06 09:40:19 -07:00
sgx_target_definitions.bzl Add all bzl files per D36874458 2022-06-06 09:40:19 -07:00
substitute.py move substitute lib to open source (#79093) 2022-06-08 23:00:47 +00:00
target_definitions.bzl Update llvm deps for Buck build (#79919) 2022-06-21 17:54:01 +00:00
update_masked_docs.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00
vscode_settings.py Run Black on all of tools/ 2022-04-20 17:29:41 +00:00

This folder contains a number of scripts which are used as part of the PyTorch build process. This directory also doubles as a Python module hierarchy (thus the __init__.py).

Overview

Modern infrastructure:

  • autograd - Code generation for autograd. This includes definitions of all our derivatives.
  • jit - Code generation for JIT
  • shared - Generic infrastructure that scripts in tools may find useful.
    • module_loader.py - Makes it easier to import arbitrary Python files in a script, without having to add them to the PYTHONPATH first.

Build system pieces:

  • setup_helpers - Helper code for searching for third-party dependencies on the user system.
  • build_pytorch_libs.py - cross-platform script that builds all of the constituent libraries of PyTorch, but not the PyTorch Python extension itself.
  • build_libtorch.py - Script for building libtorch, a standalone C++ library without Python support. This build script is tested in CI.
  • fast_nvcc - Mostly-transparent wrapper over nvcc that parallelizes compilation when used to build CUDA files for multiple architectures at once.
    • fast_nvcc.py - Python script, entrypoint to the fast nvcc wrapper.

Developer tools which you might find useful:

Important if you want to run on AMD GPU:

  • amd_build - HIPify scripts, for transpiling CUDA into AMD HIP. Right now, PyTorch and Caffe2 share logic for how to do this transpilation, but have separate entry-points for transpiling either PyTorch or Caffe2 code.
    • build_amd.py - Top-level entry point for HIPifying our codebase.

Tools which are only situationally useful: