onnxruntime/dockerfiles

Quick-start Docker containers for ONNX Runtime

CPU Version (Preview)

Linux 16.04, Python Bindings, Compatible with Docker for Windows

1. Retrieve your docker image in one of the following ways.

• Build the docker image from the DockerFile in this repository.

  # If you have a Linux machine, preface this command with "sudo"
  docker build -t onnxruntime-cpu -f Dockerfile.cpu .
  

• Pull the official image from DockerHub.

  # Will be available with ONNX Runtime 0.2.0
  

2. Run the docker image

# If you have a Linux machine, preface this command with "sudo"
# If you have a Windows machine, preface this command with "winpty"

docker run -it onnxruntime-cpu

GPU Version (Preview)

Linux 16.04, Python Bindings, CUDA 10, CuDNN7, Requires Nvidia-Docker version 2.0

0. Prerequisites: Install Nvidia-Docker 2.0

1. Retrieve your docker image in one of the following ways.

• Build the docker image from the DockerFile in this repository.

  # If you have a Linux machine, preface this command with "sudo"  
  
  docker build -t onnxruntime-gpu -f Dockerfile.gpu .
  

  Note that you can change the base CUDA distribution to 9.1 and use nvidia-docker v1 by replacing the first line of the dockerfile with the base image below.

  FROM nvidia/cuda:9.1-cudnn7-devel-ubuntu16.04
  

• Pull the official image from DockerHub.

  # Will be available with ONNX Runtime 0.2.0
  

2. Run the docker image

# If you have a Linux machine, preface this command with "sudo"
# If you have a Windows machine, preface this command with "winpty"

docker run -it --runtime=nvidia --rm nvidia/cuda onnxruntime-gpu

Other options to get started with ONNX Runtime

• Deploy inference for pretrained ONNX models for handwritten digit recognition (MNIST) or facial expression recognition (FER+) using Azure Machine Learning

• Work with ONNX runtime in your local environment using the PyPi release (CPU, GPU)

  • pip install onnxruntime
  • pip install onnxruntime-gpu

• Build ONNX Runtime from the source code by following these instructions for developers.

License

MIT License