saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-29 20:14:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

onnxrt server documentation update (#2396)

Browse source
This commit is contained in:
avidiyal 2019-11-18 15:31:07 -08:00 committed by George Wu
parent 0e947bd328
commit 95e8c3377e
2 changed files with 19 additions and 12 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
BUILD.md
View file

@ -260,19 +260,9 @@ See more information on the OpenVINO Execution Provider [here](./docs/execution_
./build.sh --config RelWithDebInfo --use_openvino <hardware_option>
```
For Linux:
<code>./build.sh --config RelWithDebInfo --use_openvino <hardware_option> </code>
For Windows:
<code> .\build.bat --config RelWithDebInfo --use_openvino <hardware_option> </code>
*Note: The default Windows CMake Generator is Visual Studio 2017, but you can also use the newer Visual Studio 2019 by passing `--cmake_generator "Visual Studio 16 2019"` to `.\build.bat`*
<code>--use_openvino</code>: Builds the OpenVINO Execution Provider in ONNX Runtime.
<code>--build_server</code>: Using this flag in addition to --use_openvino builds the OpenVINO Execution Provider with ONNX Runtime Server.
* `<hardware_option>`: Specifies the hardware target for building OpenVINO Execution Provider. Below are the options for different Intel target devices.

19
docs/ONNX_Runtime_Server_Usage.md
View file

@ -1,8 +1,25 @@
<h1><span style="color:red">Note: ONNX Runtime Server is still in beta state and may not be ready for production environments.</span></h1>
# How to Use build ONNX Runtime Server for Prediction
ONNX Runtime Server provides an easy way to start an inferencing server for prediction with both HTTP and GRPC endpoints.
The CLI command to build the server is
Default CPU:
```
python3 /onnxruntime/tools/ci_build/build.py --build_dir /onnxruntime/build --config Release --build_server --parallel --cmake_extra_defines ONNXRUNTIME_VERSION=$(cat ./VERSION_NUMBER
```
Openvino EP:
```
python3 /onnxruntime/tools/ci_build/build.py --build_dir /onnxruntime/build --config Release --use_openvino $DEVICE --build_server --parallel --cmake_extra_defines ONNXRUNTIME_VERSION=$(cat ./VERSION_NUMBER)
```
where $DEVICE can be CPU_FP32,GPU_FP32,VAD-M_FP16 or MYRIAD_FP16 as per the execution provider
# How to Use ONNX Runtime Server for Prediction
ONNX Runtime Server provides an easy way to start an inferencing server for prediction with both HTTP and GRPC endpoints. The CLI command to start the server is shown below:
The CLI command to start the server is shown below:
```
$ ./onnxruntime_server