saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/.ci/docker
History
Gregory Comer 803661526e Update ET pin to 41e7ffa (#145831) 
ExecuTorch pin is failing to update due to a change in the executorch install scripts. The previous install_requirements.sh now only installs dependencies and does not build ET. There is a new script - install_executorch.sh, which both installs dependencies and builds the framework.

This PR updates the relevant CI logic to use install_executorch.sh and bumps the pin forward. This should fix the stuck ET pin.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/145831
Approved by: https://github.com/metascroy
2025-02-07 23:52:20 +00:00
..
almalinux Add safe.directory to Almalinux docker image (#140454) 2024-11-12 23:28:12 +00:00
centos-rocm Let aotriton.cmake detect the best binary package to use, and deprecate aotriton_version.txt (#137443) 2025-01-09 00:00:02 +00:00
ci_commit_pins Update ET pin to 41e7ffa (#145831) 2025-02-07 23:52:20 +00:00
common Update ET pin to 41e7ffa (#145831) 2025-02-07 23:52:20 +00:00
java
libtorch Add CUDA 12.8 libtorch image (#145789) 2025-01-29 02:59:37 +00:00
linter
linter-cuda Install magma from a tarball (#140417) 2024-12-05 15:20:58 +00:00
manywheel Let aotriton.cmake detect the best binary package to use, and deprecate aotriton_version.txt (#137443) 2025-01-09 00:00:02 +00:00
ubuntu Install magma from a tarball (#140417) 2024-12-05 15:20:58 +00:00
ubuntu-cuda Update inductor jobs to use CUDA 12.4 (#142177) 2024-12-09 16:18:38 +00:00
ubuntu-rocm Let aotriton.cmake detect the best binary package to use, and deprecate aotriton_version.txt (#137443) 2025-01-09 00:00:02 +00:00
ubuntu-xpu [CI] change conda to miniforge for XPU images (#134455) 2024-08-28 15:16:14 +00:00
build.sh [CI][CUDA][cuSPARSELt] cusparselt 0.6.3 and cu121 related cleanups (#145793) 2025-01-28 21:01:58 +00:00
README.md Migrate conda, manywheel and libtorch docker builds to pytorch/pytorch (#129022) 2024-07-25 14:36:15 +00:00
requirements-ci.txt [ONNX] Bump onnx and onnxscript versions in CI (#146097) 2025-02-05 21:00:25 +00:00
requirements-docs.txt Revert "Fix deprecated pytorch_sphinx_theme editable installation (#145347)" 2025-01-23 20:06:07 +00:00
triton_version.txt [triton] Update pin for PyTorch 2.6/Triton 3.2 (#139206) 2024-11-22 18:34:32 +00:00

README.md

Docker images for GitHub CI and CD

This directory contains everything needed to build the Docker images that are used in our CI.

The Dockerfiles located in subdirectories are parameterized to conditionally run build stages depending on build arguments passed to docker build. This lets us use only a few Dockerfiles for many images. The different configurations are identified by a freeform string that we call a build environment. This string is persisted in each image as the BUILD_ENVIRONMENT environment variable.

See build.sh for valid build environments (it's the giant switch).

Docker CI builds

  • build.sh -- dispatch script to launch all builds
  • common -- scripts used to execute individual Docker build stages
  • ubuntu -- Dockerfile for Ubuntu image for CPU build and test jobs
  • ubuntu-cuda -- Dockerfile for Ubuntu image with CUDA support for nvidia-docker
  • ubuntu-rocm -- Dockerfile for Ubuntu image with ROCm support
  • ubuntu-xpu -- Dockerfile for Ubuntu image with XPU support

Docker CD builds

  • conda - Dockerfile and build.sh to build Docker images used in nightly conda builds
  • manywheel - Dockerfile and build.sh to build Docker images used in nightly manywheel builds
  • libtorch - Dockerfile and build.sh to build Docker images used in nightly libtorch builds

Usage

# Build a specific image
./build.sh pytorch-linux-bionic-py3.8-gcc9 -t myimage:latest

# Set flags (see build.sh) and build image
sudo bash -c 'PROTOBUF=1 ./build.sh pytorch-linux-bionic-py3.8-gcc9 -t myimage:latest