pytorch/tools
albanD d454a84bab derivatives.yaml cleanup + restore codegen code forgotten in refactor (#51721)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51721

Reviewed By: zhangguanheng66

Differential Revision: D26285908

Pulled By: albanD

fbshipit-source-id: 3130736be9146eaee3a8e80be59a66eb2180d536
2021-02-08 08:03:40 -08:00
..
amd_build [ROCm] rename HIP_HCC_FLAGS to HIP_CLANG_FLAGS (#50917) 2021-01-22 07:24:05 -08:00
autograd derivatives.yaml cleanup + restore codegen code forgotten in refactor (#51721) 2021-02-08 08:03:40 -08:00
clang_format_hash [tools] Update clang-format linux hash (#50520) 2021-01-13 20:50:56 -08:00
code_analyzer kill multinomial_alias_setup/draw (#50489) 2021-01-19 00:23:58 -08:00
code_coverage Report test time regressions (#50171) 2021-02-08 07:54:34 -08:00
codegen Support at::cpu on non-structured kernels (#51590) 2021-02-04 09:19:45 -08:00
config
docker
fast_nvcc Abort node in fast_nvcc if ancestor fails (#51043) 2021-01-25 18:12:51 -08:00
jit Remove generated_unboxing_wrappers and setManuallyBoxedKernel (#49251) 2021-01-06 14:22:50 -08:00
pyi Add division overload with rounding_mode selection (#51706) 2021-02-04 13:08:36 -08:00
rules remediation of S205607 2020-07-17 17:19:47 -07:00
setup_helpers Generate header with version #defines for LibTorch (#50073) 2021-02-03 22:18:53 -08:00
shared Introducing TORCH_CUDA_CPP_API and TORCH_CUDA_CU_API to the code (#50627) 2021-01-21 19:09:11 -08:00
__init__.py remediation of S205607 2020-07-17 17:19:47 -07:00
build_libtorch.py Remove Incorrect Comment in tools/build_libtorch and remove Python2 support in the module import (#44888) 2020-09-18 10:03:36 -07:00
build_pytorch_libs.py Cleanup unused code for Python < 3.6 (#47822) 2020-11-13 21:37:01 -08:00
build_variables.bzl [TensorExpr] Resubmit: Introduce ExternalCall nodes to TE IR. (#51594) 2021-02-03 10:22:54 -08:00
clang_format_all.py Replaced whitelist with allowlist (#45796) 2020-10-06 09:18:51 -07:00
clang_format_ci.sh Removed whitelist reference from tools/clang_format_ci.sh (#41636) 2020-07-21 12:32:14 -07:00
clang_format_utils.py Type-annotate tools/generate_torch_version (#51637) 2021-02-03 18:07:01 -08:00
clang_tidy.py Remove __future__ imports for legacy Python2 supports (#45033) 2020-09-23 17:57:02 -07:00
download_mnist.py Remove Incorrect Comment in tools/build_libtorch and remove Python2 support in the module import (#44888) 2020-09-18 10:03:36 -07:00
flake8_hook.py
generate_torch_version.py Type-annotate tools/generate_torch_version (#51637) 2021-02-03 18:07:01 -08:00
generated_dirs.txt
git-clang-format
git-pre-commit [ONNX] Utilize ONNX shape inference for ONNX exporter (#40628) 2020-08-30 18:35:46 -07:00
git_add_generated_dirs.sh
git_reset_generated_dirs.sh
nightly.py Bugfix nightly checkout tool to work on Windows (#49274) 2021-01-06 16:14:51 -08:00
pytorch.version
README.md Bring fast_nvcc.py to PyTorch OSS (#48934) 2020-12-11 08:17:21 -08:00
update_disabled_tests.sh

This folder contains a number of scripts which are used as part of the PyTorch build process. This directory also doubles as a Python module hierarchy (thus the __init__.py).

Overview

Modern infrastructure:

  • autograd - Code generation for autograd. This includes definitions of all our derivatives.
  • jit - Code generation for JIT
  • shared - Generic infrastructure that scripts in tools may find useful.
    • module_loader.py - Makes it easier to import arbitrary Python files in a script, without having to add them to the PYTHONPATH first.

Legacy infrastructure (we should kill this):

  • cwrap - Implementation of legacy code generation for THNN/THCUNN. This is used by nnwrap.

Build system pieces:

  • setup_helpers - Helper code for searching for third-party dependencies on the user system.
  • build_pytorch_libs.py - cross-platform script that builds all of the constituent libraries of PyTorch, but not the PyTorch Python extension itself.
  • build_libtorch.py - Script for building libtorch, a standalone C++ library without Python support. This build script is tested in CI.
  • fast_nvcc - Mostly-transparent wrapper over nvcc that parallelizes compilation when used to build CUDA files for multiple architectures at once.
    • fast_nvcc.py - Python script, entrypoint to the fast nvcc wrapper.

Developer tools which you might find useful:

Important if you want to run on AMD GPU:

  • amd_build - HIPify scripts, for transpiling CUDA into AMD HIP. Right now, PyTorch and Caffe2 share logic for how to do this transpilation, but have separate entry-points for transpiling either PyTorch or Caffe2 code.
    • build_amd.py - Top-level entry point for HIPifying our codebase.

Tools which are only situationally useful: