Commit graph

6 commits

Author SHA1 Message Date
rakelkar
0f7c01b49b Use exec form of ENTRYPOINT for docker server (#1690)
* Use exec form of ENTRYPOINT for docker server

# Issue
The entrypoint currently uses the shell form - this prevents users from passing in any cmdline arguments... also passing a model_path in means the server only works in the envvar is set... however this is not what the error message says!
```
$ docker run -v /home/rakelkar/try/onnxzoo/style:/mnt/models -it   mcr.microsoft.com/onnxruntime/server --model_path /mnt/models/model.onnx
Version: local_build
Commit ID: default

model_path must be the location of a valid file
Allowed options:
  -h [ --help ]               Shows a help message and exits
  --log_level arg (=info)     Logging level. Allowed options (case sensitive): 
                              verbose, info, warning, error, fatal
  --model_path arg            Path to ONNX model
  --address arg (=0.0.0.0)    The base HTTP address
  --http_port arg (=8001)     HTTP port to listen to requests
  --num_http_threads arg (=4) Number of http threads
  --grpc_port arg (=50051)    GRPC port to listen to requests
```
# Fix
1. remove the env var
2. use the exec form

* Update readme to use model_path arg
2019-08-29 10:18:08 -07:00
Colin Versteeg
5ee0f185dc Add GRPC support to ONNX Runtime Server (#1144)
* add grpc

* add-submodule

* Revert "add-submodule"

This reverts commit e35994b25035ce310a98909658582bff759ee358.

* fix submodule

* IT BUILDS

* Initial commit of prediction_service_impl.cpp

* Server builds and runs!

* add request id, health and reflection. GRPC is done

* enable channelz for monitoring

* GRPC unit tests

* clang format

* add unit tests

* Add function tests for GRPC

* add grpc to model_zoo_tests

* revert update protobuf to 3.7.0

* update submodules

* builds but runs some gflags tests which fail

* get build working

* confine build changes to onnxruntime_server.cmake

* update build files

* code reveiw comments

* Maik's code review comments

* update cares version to fix compilation issue

* update build to fix c-ares

* code review comments

* update cgmanifest.json

* remove extraneous file

* Klein comments.

* update ci based on discussions for go dependency

* fix tag issue

* fix build issues

* remove stray submodule

* update dockerfile and build script

* dynamic linking changes

* update build script

* code review comments

* update dockerfile

* update script for mount

* code review comments
2019-07-18 11:10:38 -07:00
NonStatic
9f9ff19bdc Copy shared library after build ORT Server (#1347) 2019-07-07 20:21:16 -07:00
Vinitra Swamy
3b71701f91
Update onnxruntime server docker file with ONNXRUNTIME_VERSION in cmake files (#1259) 2019-06-21 10:28:06 -07:00
Jorgen Thelin
ba25ea3643 Allow building Docker container based on a different git repo. (#1222)
- Introduce Docker build ARG `ONNXRUNTIME_REPO`
  to allow building Docker container based on a different git repo.

Example docker build command:

```bash
cd dockerfiles
docker build -t onnx-runtime \
  --build-arg ONNXRUNTIME_REPO=https://github.com/jthelin/onnxruntime \
  --build-arg ONNXRUNTIME_SERVER_BRANCH=my-branch \
  -f Dockerfile.server .
```

- Add a basic `.dockerignore` file, to cut down the number of filles passed into the Docker build context.
2019-06-20 09:55:42 -07:00
Harry Yang
2512b0ebeb Adding the onnxruntime Dockerfile and instructions (#968)
* Adding the onnxruntime Dockerfile and instructions

* Adding the onnxruntime server Dockerfile with build and instructions

* Specify more details in instruction

* Update dockerfiles/README.md

Co-Authored-By: tianchijushi <huaimingyang@hotmail.com>

* Update Dockerfile.server

Specify the onnxruntime server build branch during git clone
2019-05-08 18:24:16 -07:00