Commit graph

188 commits

Author SHA1 Message Date
jywu-msft
372b657900 update TRT EP CI's to use latest model.zip (#1637) 2019-08-16 17:44:22 -07:00
shahasad
f9834105aa removed --gen_doc (#1633) 2019-08-16 09:52:36 -07:00
shahasad
c9eb13a638
Copy System.Numerics.Tensors sources from dotnet/corefx into onnxruntime (#1605)
Copy System.Numerics.Tensors sources from dotnet/corefx into onnxruntime
2019-08-15 17:28:47 -07:00
Ashwini Khade
0044be6259
update onnx to latest commit (#1622)
* update onnx to latest commit

* Disable and/or fix failing tests

* disable not yet implemented tests for opset 11

* disable tests

* fix bug in mkldnn fp16 graph check
2019-08-15 17:10:32 -07:00
shahasad
0c5d2c998b
Generate documentation from the registered operator kernels (#1395)
- Added python script for generating markdown doc from the registered opkernels. 
- Made some conditional changes in the pybind to expose necessary python API
- Added some missing type-constraints in the op kernel registrations
2019-08-14 18:12:24 -07:00
Hariharan Seshadri
09db1e06b5
Make changes to pipeline template to include missing headers in tars/zips (#1617) 2019-08-14 13:51:29 -07:00
stevenlix
1c5b15c2b8
Remove memory copy between TensorRT and CUDA (#1561)
* remove memory copy between CUDA and TRT

* add info to RegisterExecutionProvider input

* use new IDeviceAllocator for trt allocator

* remove SetDefaultInputsMemoryType from TRT EP

* remove onnx-tensorrt 5.0

* add submodule onnx-tensorrt branch 5.1

* remove redundancy

* Update transformer_memcpy.cc

* Update tensorrt_execution_provider.cc

* switch to TensorRT 5.1.5.0

* update python binding

* disable failed test case on TensorRT

* Update activation_op_test.cc

* upgrade to TensorRT container 19.06

* update according to feedback

* add comments

* remove tensorrt allocator and use cuda(gpu) allocator

* update onnx-tensorrt submodule

* change ci build cuda directory name
2019-08-08 19:31:39 -07:00
Changming Sun
aeb0bcb4a3 parallel build 2019-08-07 08:38:26 -07:00
Changming Sun
65ff02fdb0
Set job timeout for code coverage pipeline to 120min(#1563) 2019-08-06 07:49:31 -07:00
Changming Sun
7ee8aca1bf
Avoid downloading test data into C:\ (#1562) 2019-08-05 19:53:15 -07:00
jywu-msft
8a6bfe00af
roll back model test update for ngraph provider. (#1551) 2019-08-02 15:53:32 -07:00
daquexian
93cb29f958 [WIP] NNAPI EP Update (#1540) 2019-08-01 22:25:56 -07:00
Hariharan Seshadri
624411bb69
Upload correct ESRP signed package (#1531) (#1534) 2019-08-01 10:56:18 -07:00
Changming Sun
3045a5f88b
Update test data (#1512)
* Update test data
2019-08-01 10:42:08 -07:00
Hariharan Seshadri
28a6f6b11b
Add back MacOS leg of the Python packaging job (#1523) (#1526)
* Add MacOS leg of Python packaging job

* Update copy files source directory for Mac OS leg

* Add a task to display the binaries directories contents after build wheel creation

* Revert some changes

* Add task to log

* Update

* Remove unnecessary logs
2019-07-31 15:57:26 -07:00
Hariharan Seshadri
4d768b3a0f
Fix inclusion of ARM binary in the release pkg (#1513) (#1521)
* Fix inclusion of ARM binary in the release pkg

* Add lib and pdb as well
2019-07-31 15:57:03 -07:00
shahasad
fb5d0fc538
Publish nuget package to azure blob store (#1525)
Publish daily build NuGet package to Azure blob store for sharing among internal partners
2019-07-31 14:17:54 -07:00
shahasad
a86486ab7f
Post binary sizes to dashboard database (#1517)
Python script and necessary changes in the azure-pipelines yaml file to post the binary size data from NuGet package build. Currently only posted from CPU pipeline. GPU and other pipelines may be added as necessary.
2019-07-30 08:59:43 -07:00
Hariharan Seshadri
6df4bc2ebe
Update scripts to access pipeline variables correctly (#1499)
* Update scripts to access IsReleaseBuild pipeline variable correctly

* Correct access of PACKAGENAME pipeline variable

* Fix Linux CUDA 10 package tests

* Enable C# GPU test

* Update
2019-07-25 15:30:32 -07:00
Changming Sun
a7223ed801
Fix android build (#1489) 2019-07-25 13:00:00 -07:00
shahasad
258ff06e42 Revert "publish nuget package to azure blob (#1309)" (#1485)
This reverts commit 1601650161.
2019-07-24 18:07:33 -07:00
daquexian
ec3c553501 NNAPI EP Update (#1483)
* Update DNNLibrary

* Allow fp16 by default

* Add nnapi build in ci

* Fix nnapi ep after #1268

* Remove unused variables

* Support nnapi in onnx_test_runner

* Update DNNLibrary to fix tests

* Update build.py for android build support, solve conflict of
tools/ci_build/build.py

* Support non-ARM Android build, solve conflict of tools/ci_build/build.py

* Enable android test by x86_64 android emulator

* Add dnnlibrary/NNAPI support in build.py

* suppress the verbose adb output

* Remove debug logs

* Install cmake by pip

* Fix undefined host_protoc_path

* cmake==3.13.2 in pypi is actually 3.12.2, so install 3.13.2.post1 instead

* Fix Android ARM64 build

* Use android ndk r20 instead of r19c, fix conflicts in install_deps_android.sh
2019-07-24 13:20:05 -07:00
jignparm
a8e9e1878e
Reduce artifacts size (#1477)
* Update wildcard pattern to match only relevant archives

* Update TensorRT build to add CUDA VS extensions
2019-07-23 22:23:51 -07:00
shahasad
1601650161 publish nuget package to azure blob (#1309) 2019-07-23 11:07:35 -07:00
jignparm
b41f6eef52 Jignparm/copy cuda extensions (#1462)
* Add CUDA extensions for v 10.0

* Add CUDA extensions for v 10.0

* update path

* change 'vsts' to 'github'
2019-07-22 23:27:48 -07:00
shahasad
768ced703c
Expose provider factory C API, especially for CUDA users (#1461)
Exposed provider factory C API, for cpu and cuda providers, into the published packages.
2019-07-22 19:03:06 -07:00
Yufeng Li
6be93f11e5
build mklml/ngraph without openmp (#1460)
cleanup the option to build mklml/ngraph without openmp
2019-07-22 16:59:32 -07:00
Klein Hu
227734139a Fix ORTSRV nightly build (#1440)
* Update the build_dir

* Fix indent in the model_zoo_tests.py

* Remove unnecessary tests in the server build.
2019-07-21 19:12:05 -07:00
jignparm
2c05291908
Jignparm/patch 0001 (#1419)
* remove extra $ from 8592

* fix
2019-07-20 17:07:56 -07:00
jignparm
1a957e0642
Update C-API packaging pipeline to use CUDa 10 (#1445) 2019-07-20 14:27:43 -07:00
jignparm
9e4ac8c66a
remove mkldnn from gpu nuget package (#1443) 2019-07-20 11:51:00 -07:00
Ke Zhang
638398e675
sync onnx to get equal op with float support (#1432)
* sync onnx to get equal op with float support

* doc update

* fix test failure because of updated shape inference logic for roialign.

* filter consum test cases since it's not implemented yet.
2019-07-19 13:19:09 -07:00
suryasidd
e9e777925f [OpenVINO-EP] Added support for OpenVINO R1.1 (#1438)
* Initial commit for OpenVINO R1

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Fixed MO dynamic shape error

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Add debug messages for failure

* Update install_openvino.sh script

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Try catch included.  Return type of Isgraphsupported function changed to void

* Removed error_msg variable and commented code

* formatting cleanup

* Added missing return statement

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Changed MO to be compatible with both R5 and R1

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Updated docker scripts to include openvino version number

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Ignore compiler warnings from external headers

* Updated dockerfiles

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Code cleanup using clang-format

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Suppress model optimizer info error

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Python code formatting using auto pep8

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Updated documentation

Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
2019-07-19 00:52:15 -07:00
Colin Versteeg
5ee0f185dc Add GRPC support to ONNX Runtime Server (#1144)
* add grpc

* add-submodule

* Revert "add-submodule"

This reverts commit e35994b25035ce310a98909658582bff759ee358.

* fix submodule

* IT BUILDS

* Initial commit of prediction_service_impl.cpp

* Server builds and runs!

* add request id, health and reflection. GRPC is done

* enable channelz for monitoring

* GRPC unit tests

* clang format

* add unit tests

* Add function tests for GRPC

* add grpc to model_zoo_tests

* revert update protobuf to 3.7.0

* update submodules

* builds but runs some gflags tests which fail

* get build working

* confine build changes to onnxruntime_server.cmake

* update build files

* code reveiw comments

* Maik's code review comments

* update cares version to fix compilation issue

* update build to fix c-ares

* code review comments

* update cgmanifest.json

* remove extraneous file

* Klein comments.

* update ci based on discussions for go dependency

* fix tag issue

* fix build issues

* remove stray submodule

* update dockerfile and build script

* dynamic linking changes

* update build script

* code review comments

* update dockerfile

* update script for mount

* code review comments
2019-07-18 11:10:38 -07:00
Changming Sun
fbdd905440
Switch some of the linux pipelines to use the new data download script (#1379) 2019-07-17 16:06:02 -07:00
Yufeng Li
a7b1a8969c
simply nocontribops-ci and fix build break (#1422)
simply nocontribops-ci and fix build break
2019-07-17 13:43:40 -07:00
Changming Sun
d38badffdb Disable mklml in Windows Build 2019-07-16 11:09:17 -07:00
Raymond Yang
a203077dcd
Relax timeout in CI system (#1394)
* Relax timeout in CI system (temporary)

* Relax timeout on TensorRT pipeline
2019-07-15 15:10:08 -07:00
jignparm
e580b76305
Fix ARM64 build + Add NuGet pipeline including ARM binaries (#1335)
* Add arm64 nocontribops pipeline

* minor fix

* Added new template for arm build -- disable all tests

* fix build command

* add arm64 flag for msbuild

* add arm leg as upstream dependency

* update platform to arm64 for msbuild

* remove test task from arm build

* remove ESRP signing of C# dlls in arm build

* Updated to work for both --arm and --arm64

* Make the cross compiling cmake flags symmetric

* Add dynamic check for /Wno-error flag, instead of extra build option

* remove extra full-stop
2019-07-11 11:49:17 -07:00
Changming Sun
20f6c84fd2 Switch to use nvidia-docker2 command format 2019-07-10 13:11:07 -07:00
jignparm
57225cd4ee
Add C++ API test for NuGet package (#1364) 2019-07-09 13:51:51 -07:00
Changming Sun
58d6ff3f13 Remove AgentPool setting in CI yaml 2019-07-08 15:40:54 -07:00
Colin Versteeg
a8ff209ab6 Refactor Onnx runtime Server to only use public APIs (#1271)
* replace log sinks

* limit headers to include dir

* first changes to do dynamic linking

* wip for using cxx api

* remove weird dangling dependency

* building with tests failing

* finish updating converters

* fix const

* intital introduction of typedef

* change logging to use spdlog

* get tests passing

* clang format

* map logging levels better

* clean up unused imports

* trent cr comments

* clang-format

* code review comments

* changing buffer use to reserve

* Dynamically link

* revert tvm

* update binary uploading

* catch exceptions by const-ref

* Revert "revert tvm"

This reverts commit 387676dd1018134d15eb71fa126f7caf94380800.

* fix typo

* update versioning of lib
2019-07-04 01:08:14 -07:00
Changming Sun
28759e2f6f Uninstall the preinstalled cmake in tensorrt image because it's too old (#1316) 2019-07-01 15:08:01 -07:00
Matthieu Darbois
04d581995d Use manylinux2010 image to build linux python wheels (#1282)
* Update cuda for python wheels

* Update cuda for python wheels

* Update cuda for python wheels

* Update azure-pipelines-py-packaging.yml

* Update to cuda 10

* Only test win gpu

* Update cuda for python wheels

* Use manylinux2010 image to build linux python wheels

Allow wheels built to truly be compliant with a manylinux policy
2019-06-27 15:45:06 -07:00
Scott McKay
0951f53c80 Update ONNX to d94f99d21a9a0820d58966410ceaf525132f85f1 to pickup change to checker that makes ssd_mobilenet model load 20x faster by avoiding unnecessary copies. (#1307) 2019-06-27 08:39:41 -07:00
jignparm
a56b294428
Activate compliance tasks for private builds, and also set a daily scheduler (#1280)
* add compliance and build schedules

* cpu-esrp-pipeline.yml

* update schedule time for testing

* add schedules to all pipelines
2019-06-25 11:13:55 -07:00
Ashwini Khade
a571ea74a6 update onnx (#1287) 2019-06-24 14:17:27 -07:00
jignparm
d3e5474c1d
Refactor CI pipelines - add GPU NuGet pipelines and ESRP code signing steps (#1247)
* Simplify linux gpu pipeline

* Refactor win-gpu-ci-pipeline.yml

* Set cuda environment variables for testing and version

* Remove variables from starter script

* minor fix

* Add GPU Nuget pipeline

* Set DisableContribOps environment variable for Linux package tests

* Add ESRP tasks

* Add ESRP signing templates

* Test out hardcode value of ERSP

* Test out hardcode value of ERSP

* Test out hardcode value of ERSP

* Test out hardcode value of ERSP

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test out variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* test variable expansion

* update cpu pipeline to conditionally esrp sign

* Set C# GPU tests to run only if env var is set

* Refactor for easy parameter passing

* refactored esrp templates

* remove variables from template

* Add packaging variables back to pipelines

* update C# for cuda 10

* Merge vars ana parameters for gpu pipeline

* remove vars from mklml pipeline

* display envvars on terminal

* Clean up C# cuda tests, and upgrade to Cuda10

* Introduce CUDNN_PATH pipeline varaible

* YAML variable are always uppercased (not true with classic)

* Update C# GPU test to be more meaningful

* remove macos from gpu tests

* remove debugging info for DisableContribOps option

* Remove DisableContrib ops parameters -- use variables only

* Fix typo from = to -

* remove debug steps

* fix typo

* remove unused variable TESTONGPU from some templates

* clean up CUDA env setup scripts

* Remove CUDNN_PATH from setup_env_cuda.bat
2019-06-20 19:41:30 -07:00
Raymond Yang
c96049fe4a Update ONNX version to include new fixes/changes (#1250) 2019-06-18 14:39:36 -07:00