Commit graph

9 commits

Author SHA1 Message Date
Changming Sun
0fceb33288
Fix onnxruntime server docker file build failure (#3219)
1. Fix onnxruntime server docker file build failure. Tested with the notebook in ONNX tutorial, it works well.
2. Delete the docker files for the other EPs, because currently they don't work and I don't have enough time to update them.
2020-03-15 14:46:46 -07:00
zhijxu
3926ce33f4 add --parallel to speed up compiling source code 2019-10-28 10:03:18 -07:00
Klein Hu
2bf1778a5c Fix ORTSRV docker build (#2160)
* Fix ORTSRV docker build

* More Dockerfile changes
2019-10-17 21:10:21 -07:00
rakelkar
0f7c01b49b Use exec form of ENTRYPOINT for docker server (#1690)
* Use exec form of ENTRYPOINT for docker server

# Issue
The entrypoint currently uses the shell form - this prevents users from passing in any cmdline arguments... also passing a model_path in means the server only works in the envvar is set... however this is not what the error message says!
```
$ docker run -v /home/rakelkar/try/onnxzoo/style:/mnt/models -it   mcr.microsoft.com/onnxruntime/server --model_path /mnt/models/model.onnx
Version: local_build
Commit ID: default

model_path must be the location of a valid file
Allowed options:
  -h [ --help ]               Shows a help message and exits
  --log_level arg (=info)     Logging level. Allowed options (case sensitive): 
                              verbose, info, warning, error, fatal
  --model_path arg            Path to ONNX model
  --address arg (=0.0.0.0)    The base HTTP address
  --http_port arg (=8001)     HTTP port to listen to requests
  --num_http_threads arg (=4) Number of http threads
  --grpc_port arg (=50051)    GRPC port to listen to requests
```
# Fix
1. remove the env var
2. use the exec form

* Update readme to use model_path arg
2019-08-29 10:18:08 -07:00
Colin Versteeg
5ee0f185dc Add GRPC support to ONNX Runtime Server (#1144)
* add grpc

* add-submodule

* Revert "add-submodule"

This reverts commit e35994b25035ce310a98909658582bff759ee358.

* fix submodule

* IT BUILDS

* Initial commit of prediction_service_impl.cpp

* Server builds and runs!

* add request id, health and reflection. GRPC is done

* enable channelz for monitoring

* GRPC unit tests

* clang format

* add unit tests

* Add function tests for GRPC

* add grpc to model_zoo_tests

* revert update protobuf to 3.7.0

* update submodules

* builds but runs some gflags tests which fail

* get build working

* confine build changes to onnxruntime_server.cmake

* update build files

* code reveiw comments

* Maik's code review comments

* update cares version to fix compilation issue

* update build to fix c-ares

* code review comments

* update cgmanifest.json

* remove extraneous file

* Klein comments.

* update ci based on discussions for go dependency

* fix tag issue

* fix build issues

* remove stray submodule

* update dockerfile and build script

* dynamic linking changes

* update build script

* code review comments

* update dockerfile

* update script for mount

* code review comments
2019-07-18 11:10:38 -07:00
NonStatic
9f9ff19bdc Copy shared library after build ORT Server (#1347) 2019-07-07 20:21:16 -07:00
Vinitra Swamy
3b71701f91
Update onnxruntime server docker file with ONNXRUNTIME_VERSION in cmake files (#1259) 2019-06-21 10:28:06 -07:00
Jorgen Thelin
ba25ea3643 Allow building Docker container based on a different git repo. (#1222)
- Introduce Docker build ARG `ONNXRUNTIME_REPO`
  to allow building Docker container based on a different git repo.

Example docker build command:

```bash
cd dockerfiles
docker build -t onnx-runtime \
  --build-arg ONNXRUNTIME_REPO=https://github.com/jthelin/onnxruntime \
  --build-arg ONNXRUNTIME_SERVER_BRANCH=my-branch \
  -f Dockerfile.server .
```

- Add a basic `.dockerignore` file, to cut down the number of filles passed into the Docker build context.
2019-06-20 09:55:42 -07:00
Harry Yang
2512b0ebeb Adding the onnxruntime Dockerfile and instructions (#968)
* Adding the onnxruntime Dockerfile and instructions

* Adding the onnxruntime server Dockerfile with build and instructions

* Specify more details in instruction

* Update dockerfiles/README.md

Co-Authored-By: tianchijushi <huaimingyang@hotmail.com>

* Update Dockerfile.server

Specify the onnxruntime server build branch during git clone
2019-05-08 18:24:16 -07:00