Commit graph

508 commits

Author SHA1 Message Date
Randy
f048fc5fb0 cross compile x86 linux (#562)
* cross compile x86 linux

* fix comments

* install multilib for ubuntu cross compile

* remove tailing slash

* fix -fPIC relocations for x86 target too

* add asm make flag

* fix x86 compile err

* test x86 with zlib and png

* Disable zlib from x86

* install x86 python header

* remove cross-compiling changes

* test 32bit ubuntu

* add x86 ubuntu docker file

* add x86 as arch parametr for docker build

* config pipeline

* avoid dotnet install

* install cmake

* skip dep install

* use latest ubuntu

* install latest cmake

* install x86 deps

* configure cmake

* install ninja

* correct ninja dir

* apt get re2c

* install onnx

* set processor x86

* disable warning

* skip test

* disable test

* disable test

* find lib

* fix typo

* restore test

* disable backend model test

* disable test

* fix test err

* stop installing onnx

* disable onnx test on x86

* restore yml

* mergef with master yml

* cancel needless config setting

* enable x86 flag

* restore all onnx tests

* fix yml typo

* install onnx

* add back x86 flag

* disable cases

* disable case

* disable cases

* add macro to disable cases

* fix typo

* print platform

* remove condition
2019-03-12 09:47:45 -07:00
Changming Sun
3ef273b84b Support memory mapping on Linux 2019-03-11 19:39:02 -07:00
liqunfu
7218be4f1f
support protoc version < 3.2.0 (#594)
* support protoc version < 3.2.0

* add comment to old protobuf code block

* update according to code reviewer's comment
2019-03-11 17:20:44 -07:00
Dmitri Smirnov
59cfafbb9e
Restore tolerance fix and make test_gru_seq_length_cpu run (#595) 2019-03-11 16:28:30 -07:00
Raymond Yang
02ad7daa8b
Add component detection (#592) 2019-03-11 15:30:49 -07:00
Changming Sun
93bbb42e75 Change the way of linking dl lib 2019-03-11 10:46:05 -07:00
Changming Sun
b183df7143
Remove InsertFusedRules from CPUExecutionProvider (#573)
Talked with the original author @souptc , this function is not needed anymore.
2019-03-11 10:45:44 -07:00
Hariharan Seshadri
867eda5262
Support Windows cross-compiling for ARM(64) in ORT build scripts (#549)
* Initial commit

* More changes

* More changes

* More changes

* More changes

* PR feedback

* Commiting Azure build config file

* Fix build pipeline

* Cleanup build dir template addition

* Remove conda modules download step

* PR feedback

* Revert x86 arguments to as they are currently

* More changes
2019-03-08 17:42:20 -08:00
Dmitri Smirnov
6136efc0c0
Promote to ONNX commit that has StringNormalizer (#499)
Promote to ONNX commit that has StringNormalizer
  Adjust implementation to match ONNX spec.
  Remove test exclusions.
  Override BackendTest class to handle strings  comparision
  properly until this is fixed in ONNX.
  Restore test_gru_seq_length_cpu exclusion
2019-03-08 17:15:26 -08:00
Weixing Zhang
530748ad5c Fix the broken link. 2019-03-08 15:16:23 -08:00
Changming Sun
d23edeb8c5
Fix a warning in env.cc (#568)
* Fix a warning in env.cc
2019-03-08 15:09:31 -08:00
Scott McKay
b7298a6deb
Add python script to export subgraphs from Scan/Loop/If nodes in an ONNX model. (#583) 2019-03-08 14:51:30 -08:00
Scott McKay
fb6f091073
Create derived class from onnx BackendTest so we can use the same tolerance values as in onnx_test_runner. Enable GRU test that was failing. (#584) 2019-03-08 14:51:13 -08:00
Scott McKay
b742c3a965
Fix for Scan 8 bug where the sequence length was > 2 (#580) 2019-03-08 13:58:03 -08:00
Jesse Benson
c785fe26d3 Update CreateExecutionProviderFactory_BrainSlice() definition. 2019-03-08 12:53:45 -08:00
Tracy Sharpe
44cb4c4f74
Handle x86_64 -fPIC relocations correctly (#566)
Thanks to cbecker for highlighting the problem in PR#565. That change used the GOT to access MlasMaskMoveAvx, but was incomplete: the GOT has a pointer to the global data, not the data directly. I updated the kernels to use a free register to load the address and then use that for the data. I ran through onnxruntime_mlas_test for AVX and FMA3 to verify the changes.
2019-03-08 10:30:20 -08:00
Pranav Sharma
9fa7b570da Fix publishing of Linux and MacOSX artifacts. (#579) 2019-03-08 05:57:41 -08:00
Ryan Hill
1180c60035 Add link to custom ops (#576)
* Add link to custom ops

* Wording
2019-03-08 00:49:10 -08:00
shahasad
51273b48f6 Use cuda9 1 in c api packaging (#571)
* use CUDA 9.1 for both linux and windows

* added powershell scripts for cuda props setup/cleanup

* fix yml syntax

* set path to cuda9.1 bin

* correct label

* ad --cuda_version

* added some log to browse the directory

* disabled jobs other than win gpu to save some resource while testing

* add msvc_toolset=14.11

* added more logs

* log the props file

* remove setting vcvarsall

* try some modificationi n build.py

* fix typo

* let the config Step modify envoronment

* set some more env vars manually

* try reordering vcvars after cuda props copying

* use single script for build and test

* single line script

* remove extra quote

* cleanup trial changes
2019-03-08 00:48:18 -08:00
Changming Sun
3cd448e05a Fix: IExecutionProvider::GetCapability returns redundant subgraphs 2019-03-07 17:25:31 -08:00
Faith Xu
e272feb60d Readme updates (#570)
* Update readme

* Update table

* Formatting updates

* Formatting

* Formatting

* Update README.md

* Minor updates

* Update README.md

* Update README.md
2019-03-07 16:19:11 -08:00
jignparm
a79c09388f
Fix GPu package testing for CAPI (#569) 2019-03-07 14:51:18 -08:00
Changming Sun
d40a9f894f
Enable Component Detection (#559)
* Enable Component Detection
2019-03-07 11:07:35 -08:00
Xavier Dupré
b4ffcf8258
Fixes #31, add option numpy_version, skip_keras_test to the parser of build.py, add flag PRIVATE for the python bindings (#544)
* add option numpy_version to build against the installed numpy version and not 1.15.0 (hardcoded version number), default is still 1.15.0
* add option skip_keras_test to skip keras test even if keras is installed (still enabled by default)
disable unnecessary warnings about ubuntu
* enable option PRIVATE for the compilation of the Python bindings (settings recommended on pybind11 documentation)
* test on debian 9
2019-03-07 13:08:02 +01:00
jignparm
4635bcc624 Updating C_API end-to-end test and user samples (#564)
* Updating user sample and C_API unit test

* remove debugging info

* remove precompiled headers

* header file location changed in master...updating
2019-03-07 00:28:15 -08:00
David Fan
b68079fe5d
Support int32_t for Split op (#563)
* Support int32_t for Split op

* Support int32_t for Split op
2019-03-07 00:13:11 -08:00
Ryan Hill
af9c554dd3
Ryanunderhill/custom op (#550)
* Prototype version that demonstrates it can work
* Switched to OrtValue and removed the OrtCustomOpTensor code.
* Support multiple outputs and reading of attributes
* Add custom domain handling to custom ops
* Update documentation
* more wording changes
2019-03-06 19:09:55 -08:00
jignparm
0b143d0703
Fix parentheses and commas (#560) 2019-03-06 18:01:49 -08:00
shahasad
b247fced3b
Linux and MacOS C api packaging (#555)
* added linux packaging template and pipeline

* Update linux-packaging-pipeline.yml for Azure Pipelines

* fix path seperator

* update copy command for linux

* fixed linux gpu artifact name, added mac build

* fixed linux gpu artifact name, added mac build

* fixed vmImage syntax

* use 1 model at a time for macos

* added onnx test on Mac CI

* some refactor of the pipeline scripts

* try fixing the tensorproto for x86 build

* try __cdecl

* try C-style cast

* use ORTAPICALL

* put the deleter under the namespace
2019-03-06 14:56:53 -08:00
Faith Xu
98a9c0e715 Fix json error (#557) 2019-03-06 14:53:07 -08:00
Scott McKay
0e65bfe7ae
Remove caching from InferenceSession::Run (#547)
* Remove caching from InferenceSession::Run

* Fix automatic merge of one file

* trigger rerunning checks
2019-03-06 14:29:42 -08:00
Dmitri Smirnov
54eeb7394a
Implement Scatter. (#523)
Implement Scatter.
  Allow reuse of input Tensor for Output.
  Uncomment Scatter tests.
  Comment out StringNormalizer python tests.
2019-03-06 13:19:58 -08:00
Changming Sun
cf41f76d79
Fix some warnings (#551) 2019-03-06 11:46:59 -08:00
Pranav Sharma
714d4100bd
Update documentation to include openmp dependency. (#545)
* Update documentation to include openmp dependency.

* Update python docs as well
2019-03-05 22:38:40 -08:00
Changming Sun
8e0fff7b8d
Support large model(>2GB) (#520)
1. Support the new external data extension in ONNX 1.4 onnx/onnx#678
2. Enable onnxruntime_perf_test in Mac Build
3. move path_lib.h from onnx_test_runner source dir to onnxruntime_framework
4. Enable memory planner for string tensors
5. Make memory planner always enabled, to simplify model loading logic
6. Delete some duplicated code between onnxruntime_perf_test and onnx_test_runner
7. Delete win_getopt_mb lib.
8. Remove the dependency on Pathcch lib, which is only available on Windows 8 and newer.
2019-03-05 21:27:12 -08:00
shahasad
a4a459477a
Windows packaging build pipeline for C-api packages (CPU and GPU) (#535)
* added packaging pipeline

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* put the c-api header file at root instead of under core/session

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* parameterize the windows build script

* Update win-package-pipeline.yml for Azure Pipelines

* fixed indenting

* fixed indenting

* fix parameter reference syntax

* try using arch = amd64 for the vcvarsall

* remove duplicate tasks

* use vcvarsall

* some more refactor

* fix typo

* fix typo

* factored out the packaging step into a template

* add x86 build to package pipeline

* use amd64 for vcvars arg

* added gpu pipeline. added msbuild platform param

* fix the msbuild platform

* use amd64 host for x86 build

* use buildarch=x86 for vcvarsall

* remove vcvars from setup steps

* add some logging for PNG lib, and disable fns_candy demo for win32

* set allocator alignment to 32 bit for win32 compiler

* disable parallel execution test for x86

* use 64 bit toolchain for x86 build

* add missing -T flag for toolset

* fix string delimietr in workingdirectory name for package build test step

* fix gpu pipeline

* make io_types test conditional

* use cuda 10 instead of cuda 9.1, similar to the ci build

* try some workaround on the io test

* undo inadvertent local change in build.py, also reenable the io test

* make all test run single threaded

* blacklist few failing tests for x86

* added some log in build.py

* edit build.py to disable parallel test

* add the failed tests into the blacklist for win32

* add tf_pasnet_large to blacklist

* change control flow for build.py onnx tests

* add README, license and TPN to the package

* updated build.py test sequence for parallel executor

* updated onnx test flow as per review comment

* add type checking log in the compare_mlvalue

* fix type cast

* blacklist some failed test as of now

* one more blacklisted test
2019-03-05 18:12:02 -08:00
Faith Xu
3a2f6c6964 Update cgmanifest and TPN (#529)
* Update cgmanifest 

...to include all custom registered CG components

* Update cgmanifest.json

* Updates based on feedback

* Remove .NET (auto-detected)

* Add registrations

* Update TPN

* Remove google/protobuf 

dup of protocolbuffers/protobuf

* Update TPN with google/re2

* Remove libpng
2019-03-05 17:22:39 -08:00
jignparm
94bd74190a
Revert to cuda 9.1 for package release (#546) 2019-03-05 17:20:51 -08:00
Ke Zhang
47a9abd212
minor change for validating input types (#532)
* minor changes for ValidateInput in inferencesession level api.

* update

* valid real graph input and don't validate initializers

* refine the validation logic.

* remove the unnecessary validatation test.

* ensure that the exact input feeds provided from caller.

* fix tests.

* fix c# test failure.

* fix test case

* don't verify the error message which is hard to maintain.

* fix c# test case

* c# test

* c# test

* fix test cases.

* test update
2019-03-05 16:29:39 -08:00
Changming Sun
bfa21c0b9f Re-enable the tests disabled during C API renaming 2019-03-05 16:06:38 -08:00
jignparm
1288a8caed
Initial check-in to support non-tensor (sequence/map) types (#527)
* Initial check-in to support non-tensor (sequence/map) types

* Added support for String tensors

* address PR comments
2019-03-05 16:00:40 -08:00
Hariharan Seshadri
1d3fcc525a
deps: update onnx to a newer commit and update test exclusions (#542)
* Update onnx dep to a newer commit and update test exclusions

* Keeping shrink excuded in c++ tests

* More changes
2019-03-05 12:03:16 -08:00
Du Li
30be4c1ef8
Fix a bug in test data (#539)
* Fix a bug in test data
2019-03-05 11:23:21 -08:00
Raymond Yang
f5dfbba655
Clarify numpy version requirement (#537)
* update packaging numpy version to 1.15.0

* update version in numpy version in linux

* Install numpy 1.15.0

* Finish up numpy requirement after test

* Try fix

* Fix ci script
2019-03-05 11:07:28 -08:00
Yulong Wang
7aba5fe523
perf_test_runner: support specifying thread number (#538) 2019-03-04 16:17:01 -08:00
Randy
4c684a133a
bump up version to 0.3.0 (#536)
* bump up version to 0.3.0

* change to op9 and cuda9.1
2019-03-04 13:41:53 -08:00
Weixing Zhang
8a59287c46
Create OptimizerExecutionFrame for graph optimization (#526)
* Create OptimizerExecutionFrame for optimizer

With this change, optimizer can easily invoke CPU kernels for graph optimization.
2019-03-04 10:56:41 -08:00
Randy
290c472839 remove mkldnn from linux packages (#533) 2019-03-03 20:52:27 -08:00
Hariharan Seshadri
a697e0b710
Implement Shrink operator (#485)
* Initial commit

* Adding shrink tests

* Fix formatting in shrink_test.cc

* Fix broken build

* More changes

* PR feedback and formatting

* Place files in the right location corresponding to def file location in onnx

* Exclude shrink model test in test_series.py

* Remove shrink from exclusion list in main.cc

* Adding test to exclusion list

* More tests

* Formatting

* PR feedback

* PR feedback

* More changes

* PR feedback

* More changes

* Fix broken build

* Fix nit

* Fix nit
2019-03-01 12:51:22 -08:00
Raymond Yang
9fb80ea927 Fix cast optimizer (#524) 2019-02-28 13:35:52 -08:00