Commit graph

48 commits

Author SHA1 Message Date
shahasad
2c46fff69a
Enable gen-doc on windows CI (#716)
* add --gen_doc to ci_build

* make gen-doc conditional to build/test step

* some fix in the git diff check

* some more trick on doc diff

* updated for input/output

* updated the contrib operator doc

* fix on missing input output descriptions

* fixed the problem of missing doc string, due to protobuf optimization

* fix

* revert last change

* moved gen_doc.py to /tools/python

* fixed typo
2019-05-01 14:58:21 -07:00
nivas-x86
7f14326dab nGraph EP documentation (#939) 2019-04-30 18:38:09 -07:00
tmccrmck
1978b3c953 Add an HTTP server for hosting of ONNX models (#806)
* Simple integration into CMake build system

* Adds vcpkg as a submodule and updates build.py to install hosting dependencies

* Don't create vcpkg executable if already created

* Fixes how CMake finds toolchain file and quick changes to build.py

* Removes setting the CMAKE_TOOLCHAIN_FILE in build.py

* Adds Boost Beast echo server and Boost program_options

* Fixes spacing problem with program_options

* Adds Microsoft headers to all the beast server headers

* Removes CXX 14 from CMake file

* Adds TODO to create configuration class

* Run clang-format on main

* Better exception handling of program_options

* Remove vckpg submodule via ssh

* Add vcpkg as https

* Adds onnxruntime namespace to call classes

* Fixed places where namespaces were anonymous

* Adds a TODO to use the logger

* Moves all setting namespace shortnames outside of onnxruntime namespace

* Add onnxruntime session options to force app to link with it

* Set CMAKE_TOOLCHAIN_FILE in build.py

* Remove whitespace

* Adds initial ONNX Hosting tests (#5)

* Add initial test which is failing linking with no main

* Adds test_main to get hosting tests working

* Deletes useless add_executable line

* Merge changes from upstream

* Enable CI build in Vienna environment

* make hosting_run*.sh executable

* Add boost path in unittest

* Add boost to TEST_INC_DIR

* Add component detection task in ci yaml

* Get tests and hosting to compile with re2 (#7)

* Add finding boost packages before using it in unit tests

* Add predict.proto and build

* Ignore unused parameters in generated code

* Removes std::regex in favor of re2 (#8)

* Removes std::regex in favor of re2

* Adds back find_package in unit tests and fixes regexes

* Adds more negative test cases

* Adding more protos

* Fix google protobuf file path in the cmake file

* Ignore unused parameters for pb generated code

* Updates onnx submodule (#10)

* Remove duplicated lib in link

* Follow Google style guide (#11)

* Google style names
* Adds more 
* Adds an additional namespace
* Fixes header guards to match filepaths

* Consume protobuf

* Unit Test setup

* Json deserialization simple test cases

* Split hosting app to lib and exe for testability

* Add more cases

* Clean up

* Add more comments

* Update namespace and format the cmake files

* Update cmake/external/onnx to checkout 1ec81bc6d49ccae23cd7801515feaadd13082903

* Separate h and cc in http folder

* Clean up hosting application cmake file

* Enable logging and proper initialize the session

* Update const position for GetSession()

* Take latest onnx and onnx-tensorrt

* Creates configuration header file for program_options (#15)

* Sets up PredictRequest callback (#16)

* Init version, porting from prototype, e2e works

* More executor implementation

* Adds function on application startup (#17)

* Attempts to pass HostingEnvironment as a shared_ptr

* Removes logging and environment from all http classes

* Passes http details to OnStart function

* Using full protobuf for hosting app build

* MLValue2TensorProto

* Revert back changes in inference_session.cc

* Refactor logger access and predict handler

* Create an error handling callback (#19)

* Creates error callback

* Logs error and returns back as JSON

* Catches exceptions in user functions

* Refactor executor and add some test cases

* Fix build warning

* Add onnx as a dependency and in includes to hosting app (#20)

* Converter for specific types and more UTs

* More unit tests

* Update onnx submodule

* Fix string data test

* Clean up code

* Cleanup code

* Refactor logging to use unique id per request and take logging level from user (#21)

* Removes capturing env by reference in main

* Uses uuid for logging ids

* Take logging_level as a program argument

* Pass logging_level to default_logging_manager

* Change name of logger to HostingApp

* Log if request id is null

* Update GetHttpStatusCode signature

* Fix random result issue and camel-case names

* Rollback accidentally changed pybin_state.cc

* Rollback pybind_state.cc

* Generate protobuf status from onnxruntime status

* Fix function name in error message

* Clean up comments

* Support protobuf byte array as input

* Refactor predict handler and add unit tests

* Add one more test

* update cmake/external/onnx

* Accept more protobuf MIME types

* Update onnx-tensorrt

* Add build instruction and usage doc

* Address PR comments

* Install g++-7 in the Ubuntu 16.04 build image for vcpkg

* Fix onnx-tensorrt version

* Check return value during initialization

* Fix infinite loop when http port is in use (#29)

* Simplify Executor.cc by breaking up Run method (#27)

* Move request id to Executor constructor

* Refactor the logger to respect user verbosity level

* Use Arena allocator instead of device

* Creates initial executor tests

* Merge upstream master (#31)

* Remove all possible shared_ptrs (#30)

* Changes GetLogger to unique_ptr

* Reserve BFloat raw data vector size

* Change HostingEnvironment to being passed by lvalue and rvalue references

* Change routes to getting passed by const references

* Enable full protobuf if building hosting (#32)

* Building hosting application no longer needs use_full_protobuf flag

* Improve hosting application docs

* Move server core into separate folder (#34)

* Turn hosting project off by default (#38)

* Remove vcpkg as a submodule and download/install Boost from source (#39)

* Remove vcpkg

* Use CMake script to download and build Boost as part of the project

* Remove std::move for const references

* Remove error_code.proto

* Change wording of executable help description

* Better GenerateProtobufStatus description

* Remove error_code protobuf from CMake files

* Use all outputs if no filter is given

* Pass MLValue by const reference in MLValueToTensorProto

* Rename variables to argc and argv

* Revert "Use all outputs if no filter is given"

This reverts commit 7554190ab8e50ba6947648c2f3e2a3d4d9606ce0.

* Remove all header guards in favor of #pragma once

* Reserve size for output vector and optimize for-loop

* Use static libs by default for Boost

* Improves documentation for GenerateResponseInJson function

* Start Result enum at 0 instead of 1

* Remove g++ from Ubuntu's install.sh

* Update cmake files

* Give explanation for Result enum type

* Remove all program options shortcuts except for -h

* Add comments for predict.proto

* Fix JSON for error codes

* Add notice on hosting application docs that it's in beta

* Change HostingEnvironment back to a shared_ptr

* Handle empty output_filter field

* Fix build break

* Refactor unit tests location and groups

* First end-to-end test

* Add missing log

* Missing req id and client req id in error response

* Add one test case to validate failed resp header

* Add build flag for hosting app end to end tests

* Update pipeline setup to run e2e test for CI build

* Model Zoo data preparation and tests

* Add protobuf tests

* Remove mention of needing g++-7 in BUILD.md

* Make GetAppLogger const

* Make using_raw_data_ match the styling of other fields

* Avoid copy of strings when initializing model

* Escape JSON strings correctly for error messages (#44)

* Escape JSON strings correctly

* Add test examples with lots of carriage returns

* Add result validation

* Remove temporary path

* Optimize model zoo test execution

* Improve reliability of test cases

* Generate _pb2.py during the build time

* README for integration tests

* Pass environment by pointer instead of shared_ptr to executor (#49)

* More Integration tests

* Remove generated files

* Make session private and use a getter instead (#53)

* logging_level to log_level for CLI

* Single model prediction shortcut

* Health endpoint

* Integration tests

* Rename to onnxruntime server

* Build ONNX Server application on Windows (#57)

* Gets Boost compiling on Windows

* Fix integer conversion and comparison problems

* Use size_t in converter_tests instead of int

* Fix hosting integration tests on Windows

* Removes checks for port because it's an unsigned short

* Fixes comparison between signed and unsigned data types

* Pip install protobuf and numpy

* Missing test data from the rename change

* Fix server app path (#58)

* Pass shared_ptr by const reference to avoid ref count increase (#59)

* Download test model during test setup

* Make download into test_util

* Rename ci pipeline for onnx runtime server

*  Support up to 10MiB http request (#61)

* Changes minimum request size to 10MB to support all models in ONNX Model Zoo
2019-04-30 18:21:23 -07:00
Ashwini Khade
90544ed766
bump version number for release (#911)
* bump version number for release

* + review comments
2019-04-26 16:28:16 -07:00
Ryan Hill
5ed3db914e
Update custom op help (#914)
* Update AddingCustomOp.md
2019-04-26 11:22:46 -07:00
jignparm
9467c5f967
Update version to 0.3.1 (patch release) (#798)
* bump up version number (#752)

* bump up version number

* Minor change to kick off build

* update version to 0.3.1
2019-04-09 14:48:56 -07:00
Yufeng Li
cea2a40bf1
Clean up ExecutionProvider in CSharp (#783) 2019-04-05 22:29:54 -07:00
Yufeng Li
ef9a4d98cb
Expose parallel execution option in C# API (#767)
* Expose parallel execution option

* delete unnesary file

* add doc

* update nuget retore to 4.3.0

* resolve comments

* remove unnessary file

* make git ignore csharp/Directory.Build.props

* fix yaml config for nuget 4.3
2019-04-05 12:05:56 -07:00
Ashwini Khade
2dbce4ebcf
csharp api for graph transformers (#741)
* add graph optimization level to csharp api

* format documentation

* changes per review comments
2019-04-02 17:23:14 -07:00
shahasad
83ae641425
add documentation for custom ops (#708)
* added tools for doc gen, added doc

* doc updated

* some fixes

* hooked up with build.py

* hooked up with build.py and fail on nonupdated doc

* update
2019-03-26 21:58:01 -07:00
Ashwini Khade
2f1c3028b7
add capi to set graph optimization level (#657)
* add capi to set graph optimization level

* remove 1 unnecessary check + review comment

* plus updates
2019-03-20 17:14:46 -07:00
manashgoswami
bdc2bbb207 Build details for TensorRT execution provider. (#632)
* Fixed typos in docs for 'onnx_test_runner'

* TensorRT Execution Provider (preview) release

Updated build instructions and component governence and third party notices for TensorRT execution provider release.

* test runner option for tensorrt

updated to add option for tensorrt.

* Introduction to TensorRT Execution Provider

Intro README for TensorRT Execution Provider.

* Update BUILD.md

* Update TensorRT-ExecutionProvicer.md

* corrected typo in the filename

* corrected typos

* updated with corrections.

* removed conflicting edits.

* Update BUILD.md
2019-03-15 11:29:00 -07:00
Weixing Zhang
530748ad5c Fix the broken link. 2019-03-08 15:16:23 -08:00
Ryan Hill
1180c60035 Add link to custom ops (#576)
* Add link to custom ops

* Wording
2019-03-08 00:49:10 -08:00
jignparm
4635bcc624 Updating C_API end-to-end test and user samples (#564)
* Updating user sample and C_API unit test

* remove debugging info

* remove precompiled headers

* header file location changed in master...updating
2019-03-07 00:28:15 -08:00
Ryan Hill
af9c554dd3
Ryanunderhill/custom op (#550)
* Prototype version that demonstrates it can work
* Switched to OrtValue and removed the OrtCustomOpTensor code.
* Support multiple outputs and reading of attributes
* Add custom domain handling to custom ops
* Update documentation
* more wording changes
2019-03-06 19:09:55 -08:00
Pranav Sharma
714d4100bd
Update documentation to include openmp dependency. (#545)
* Update documentation to include openmp dependency.

* Update python docs as well
2019-03-05 22:38:40 -08:00
Randy
4c684a133a
bump up version to 0.3.0 (#536)
* bump up version to 0.3.0

* change to op9 and cuda9.1
2019-03-04 13:41:53 -08:00
jignparm
bdf72ad5e3
Update C-API with working example (#503)
* Add working example of C-API

* Section formatting

* Shortened example, and grouped by functionality

* Update C_API.md
2019-02-25 19:06:51 -08:00
Changming Sun
5866e853c4 Add dev notes 2019-02-06 14:10:48 -08:00
Raymond Yang
011a784eaa
Merge back from rel-0.2.1 (#422)
* Addl TPN updates (#403)

* Updated TPN

* Update batch_norm_op_test.cc

* Update ThirdPartyNotices.txt

* Update ThirdPartyNotices.txt

* Update readme with package links

* Update README.md

* Update README.md

* Update README.md

* Merged Ryan and TPN changes into single PR

* minor fix

* added mkldnn to GPU pipeline. Required by C# library as it is the default execution provider

* Bump up version number for 0.2.1 release (#420)
2019-01-31 19:04:33 -08:00
shahasad
d75bdc5194
updated C# API doc (#405)
* updated C# API doc

* Add how to run on GPU
2019-01-29 16:37:04 -08:00
Ryan Hill
09806625cf
Rename OrtInitialize to OrtCreateEnv in preparation for future. (#399)
* Rename OrtInitialize to OrtCreateEnv in preparation for future.
Add version number to structures

* Forgot about exports

* Update documentation
2019-01-29 15:03:18 -08:00
Xavier Dupré
439dbbada9
Adds OnnxTransformer to plug onnxruntime in sckit-learn's pipeline (#389)
Useful for transfer learning
2019-01-29 18:51:24 +01:00
jignparm
571e1e9a6c
Jignparm/updateversion 2.0 (#394)
* Update version to 2.0

* added __init__.pu
2019-01-28 21:22:45 -08:00
Xavier Dupré
8c40313e28
Update documentation to reflect the latest changes (#311)
- removes markdown output
- rename intro into index
- uses skl2onnx anywhere possible instead of onnxmltools
2019-01-11 12:41:42 +01:00
Changming Sun
02962ce9d8
Update ABI.md (#299)
* Update ABI.md
2019-01-10 16:34:42 -08:00
Changming Sun
6b3044ddd3 Update AddingExecutionProvider.md 2019-01-10 11:11:54 -08:00
Pranav Sharma
c5cbdd5a55
Miscellaneous fixes (#123) 2018-12-06 22:21:04 -08:00
shahasad
a53d617b7a
added the icon and logo resources (#124) 2018-12-06 21:22:11 -08:00
Xavier Dupré
0573952499 Update the documentation, run all examples during the generation of the documentation (replace #89) (#103)
* Minor update in the documentation

* Run examples during the generation of the documentation.
2018-12-05 10:12:25 -08:00
R. G. Esteves
c8ae91251e Eliminate the confusing double negative (#92)
* Eliminate the confusing double negative

I was having trouble parsing the caveat NOTE, proposing wording changes that I think reflect the meaning and avoid the confusion.

* Eliminate double negative without further explanation on role of this file.

Incorporate @pranavsharma feedback.
2018-12-04 23:06:09 -08:00
Pranav Sharma
358be0653c
Delete logo as per marketing requirements (#98) 2018-12-04 18:04:59 -08:00
Pranav Sharma
b7cc611563
Minor documentation changes (#78) 2018-12-03 12:55:29 -08:00
Faith Xu
07253fd647 Faxu patch 1 (#63)
* Delete Roadmap.md

* Update README.md

* Update README.md

* Update README.md
2018-11-30 22:10:26 -08:00
Pranav Sharma
21dad1780b
Add logo and link to C# pkg. (#73) 2018-11-30 19:39:30 -08:00
Pranav Sharma
6624dd2778
Rel 0.1.5 (#70)
* updated nuget package metadata for MS compliance (#66)

* fixed metadata element -- use PackageProjectUrl instead of ProjectUrl (#67)

* Change version to 0.1.5
2018-11-30 16:23:47 -08:00
Pranav Sharma
39ebccbc8b
Fix sample example documentation for python pkg (#61) 2018-11-29 17:50:12 -08:00
Faith Xu
7523e76649 Minor wording changes to design doc (#51)
* Update HighLevelDesign.md

* Update HighLevelDesign.md

* Update HighLevelDesign.md
2018-11-28 19:43:03 -08:00
jignparm
2f234e4e78 Minor fixes to nuget README.md file (#49) 2018-11-28 16:30:34 -08:00
Shah Asaduzzaman (ASAD)
6e2a1ceb41 merged from master 2018-11-28 01:29:08 -08:00
Pranav Sharma
3f4589ced5
Add remaining build options and make minor changes in documentation (#39)
* Minor changes in documentation

* Synchronous, not sync

* Add remaining build options after mkldnn fix
2018-11-27 19:59:40 -08:00
Shah Asaduzzaman (ASAD)
d7d43bc13f merged from master 2018-11-27 18:54:06 -08:00
Ryan Hill
3b1140954e Bug bash (#43)
* Update README.md

* Update Versioning.md

* Update rename_manylinux.sh

Remove duplicate word

* Update README.md

Remove a 'the' as ONNX Runtime is a proper noun.

* Update CUDA version to 9.1 cudnn version to 7.1

* Update ReleaseManagement.md

* put tensorflow copy-right headers

there are around 10 lines of code is borrowed from tflite.

* Update README.md

Mention C++ API

* Update README.md

Fix link

* Update C_API.md

Fix broken link to onnxruntime_c_api.h

* Update ABI.md

Delete mention of COM and fix 'ONNX Runtime' to be two words

* Update README.md

* Update README.md

* Update C_API.md
2018-11-27 18:52:50 -08:00
Ryan Hill
3761d2d718
Update C_API.md
Rephrasing
2018-11-26 14:57:54 -08:00
Shah Asaduzzaman (ASAD)
41e1ed8e01 added the CSHarp doc 2018-11-25 22:57:24 -08:00
Pranav Sharma
7aef8a1cca Sync with internal master. 2018-11-22 20:56:43 -08:00
Pranav Sharma
89618e8f1e Initial bootstrap commit. 2018-11-19 16:48:22 -08:00