Commit graph

64 commits

Author SHA1 Message Date
Randy
f048fc5fb0 cross compile x86 linux (#562)
* cross compile x86 linux

* fix comments

* install multilib for ubuntu cross compile

* remove tailing slash

* fix -fPIC relocations for x86 target too

* add asm make flag

* fix x86 compile err

* test x86 with zlib and png

* Disable zlib from x86

* install x86 python header

* remove cross-compiling changes

* test 32bit ubuntu

* add x86 ubuntu docker file

* add x86 as arch parametr for docker build

* config pipeline

* avoid dotnet install

* install cmake

* skip dep install

* use latest ubuntu

* install latest cmake

* install x86 deps

* configure cmake

* install ninja

* correct ninja dir

* apt get re2c

* install onnx

* set processor x86

* disable warning

* skip test

* disable test

* disable test

* find lib

* fix typo

* restore test

* disable backend model test

* disable test

* fix test err

* stop installing onnx

* disable onnx test on x86

* restore yml

* mergef with master yml

* cancel needless config setting

* enable x86 flag

* restore all onnx tests

* fix yml typo

* install onnx

* add back x86 flag

* disable cases

* disable case

* disable cases

* add macro to disable cases

* fix typo

* print platform

* remove condition
2019-03-12 09:47:45 -07:00
Raymond Yang
02ad7daa8b
Add component detection (#592) 2019-03-11 15:30:49 -07:00
Hariharan Seshadri
867eda5262
Support Windows cross-compiling for ARM(64) in ORT build scripts (#549)
* Initial commit

* More changes

* More changes

* More changes

* More changes

* PR feedback

* Commiting Azure build config file

* Fix build pipeline

* Cleanup build dir template addition

* Remove conda modules download step

* PR feedback

* Revert x86 arguments to as they are currently

* More changes
2019-03-08 17:42:20 -08:00
Pranav Sharma
9fa7b570da Fix publishing of Linux and MacOSX artifacts. (#579) 2019-03-08 05:57:41 -08:00
shahasad
51273b48f6 Use cuda9 1 in c api packaging (#571)
* use CUDA 9.1 for both linux and windows

* added powershell scripts for cuda props setup/cleanup

* fix yml syntax

* set path to cuda9.1 bin

* correct label

* ad --cuda_version

* added some log to browse the directory

* disabled jobs other than win gpu to save some resource while testing

* add msvc_toolset=14.11

* added more logs

* log the props file

* remove setting vcvarsall

* try some modificationi n build.py

* fix typo

* let the config Step modify envoronment

* set some more env vars manually

* try reordering vcvars after cuda props copying

* use single script for build and test

* single line script

* remove extra quote

* cleanup trial changes
2019-03-08 00:48:18 -08:00
Changming Sun
d40a9f894f
Enable Component Detection (#559)
* Enable Component Detection
2019-03-07 11:07:35 -08:00
shahasad
b247fced3b
Linux and MacOS C api packaging (#555)
* added linux packaging template and pipeline

* Update linux-packaging-pipeline.yml for Azure Pipelines

* fix path seperator

* update copy command for linux

* fixed linux gpu artifact name, added mac build

* fixed linux gpu artifact name, added mac build

* fixed vmImage syntax

* use 1 model at a time for macos

* added onnx test on Mac CI

* some refactor of the pipeline scripts

* try fixing the tensorproto for x86 build

* try __cdecl

* try C-style cast

* use ORTAPICALL

* put the deleter under the namespace
2019-03-06 14:56:53 -08:00
shahasad
a4a459477a
Windows packaging build pipeline for C-api packages (CPU and GPU) (#535)
* added packaging pipeline

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* put the c-api header file at root instead of under core/session

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* Update win-ci-pipeline.yml for Azure Pipelines

* parameterize the windows build script

* Update win-package-pipeline.yml for Azure Pipelines

* fixed indenting

* fixed indenting

* fix parameter reference syntax

* try using arch = amd64 for the vcvarsall

* remove duplicate tasks

* use vcvarsall

* some more refactor

* fix typo

* fix typo

* factored out the packaging step into a template

* add x86 build to package pipeline

* use amd64 for vcvars arg

* added gpu pipeline. added msbuild platform param

* fix the msbuild platform

* use amd64 host for x86 build

* use buildarch=x86 for vcvarsall

* remove vcvars from setup steps

* add some logging for PNG lib, and disable fns_candy demo for win32

* set allocator alignment to 32 bit for win32 compiler

* disable parallel execution test for x86

* use 64 bit toolchain for x86 build

* add missing -T flag for toolset

* fix string delimietr in workingdirectory name for package build test step

* fix gpu pipeline

* make io_types test conditional

* use cuda 10 instead of cuda 9.1, similar to the ci build

* try some workaround on the io test

* undo inadvertent local change in build.py, also reenable the io test

* make all test run single threaded

* blacklist few failing tests for x86

* added some log in build.py

* edit build.py to disable parallel test

* add the failed tests into the blacklist for win32

* add tf_pasnet_large to blacklist

* change control flow for build.py onnx tests

* add README, license and TPN to the package

* updated build.py test sequence for parallel executor

* updated onnx test flow as per review comment

* add type checking log in the compare_mlvalue

* fix type cast

* blacklist some failed test as of now

* one more blacklisted test
2019-03-05 18:12:02 -08:00
Hariharan Seshadri
1d3fcc525a
deps: update onnx to a newer commit and update test exclusions (#542)
* Update onnx dep to a newer commit and update test exclusions

* Keeping shrink excuded in c++ tests

* More changes
2019-03-05 12:03:16 -08:00
Raymond Yang
f5dfbba655
Clarify numpy version requirement (#537)
* update packaging numpy version to 1.15.0

* update version in numpy version in linux

* Install numpy 1.15.0

* Finish up numpy requirement after test

* Try fix

* Fix ci script
2019-03-05 11:07:28 -08:00
Randy
290c472839 remove mkldnn from linux packages (#533) 2019-03-03 20:52:27 -08:00
Pranav Sharma
2f1e883c71
Don't use mkldnn and tvm for release pkgs. (#511)
* support non-tensor types

* support non-tensor types.

* support non-tensor types.

* fix compilation issues

* fix compilation issues

* Build without mkldnn for release packages. We'll default to MLAS.

* Remove tvm as well

* Add openmp
2019-02-22 19:29:06 -08:00
Raymond Yang
ec8ac04f30
Update cast op to support string <-> numeric (#379)
* Update cast kernel to support to/from string

* Update namespace

* Add support for literal numeric case

* Update to support -INF test

* Update kernel registration for cast

* Update ONNX to 1.4.1

* Update registy api

* Resolve some comments

* Update cast kernel implementation

* Resolve comments

* Fixed test data in onnx

* Update cast kernel implementation

* Resolve PR comments

* Update cast_op.cc

* Update onnx commits info

* Update comments
2019-02-12 10:10:56 -08:00
shahasad
8a8d1b0cea
Fix MacOS shared library build (#447)
* try removing the --version-script

* remove --no-undefined flag

* remove the -rpath linker flag

* remove the -rpath linker flag, including the -Wl

* remove the --whole-archive flags

* added -all_load -noall_load flags in place of --whole-archive and --no-whole-archive

* spell correct all-load

* set the MacOS specific cmake configs with if(APPLE) condition

* added --build_shared_lib to mac CI
2019-02-06 15:27:37 -08:00
Raymond Yang
7cd393d697
Fix 3.7 build; Add cuda version in README (#427) 2019-02-06 13:38:04 -08:00
Changming Sun
6ae6853519 Update test data md5 2019-01-31 17:07:25 -08:00
Changming Sun
fb7be27096 Update test dataset 2019-01-31 13:11:45 -08:00
Faith Xu
91ffb980a2 Addl TPN updates (#403)
* Updated TPN

* Update batch_norm_op_test.cc

* Update ThirdPartyNotices.txt

* Update ThirdPartyNotices.txt

* Update readme with package links

* Update README.md

* Update README.md

* Update README.md

* Merged Ryan and TPN changes into single PR

* minor fix

* added mkldnn to GPU pipeline. Required by C# library as it is the default execution provider
2019-01-30 17:28:17 -08:00
Changming Sun
6fc48c60de Add win-ci-pipeline-cg.yml 2019-01-29 20:49:55 -08:00
Changming Sun
7c0a6f3d9c CI: Enable C# tests 2019-01-28 11:40:00 -08:00
shahasad
f94fdad861
Fixes on the dotnet end-to-end test scripts to get it running on linux (#376)
* fixed typo in runtest.sh

* some fixes

* some fixes

* some fixes in the runtest.sh

* added test data url

* fixes on the dotnet test scripts

* fix on prior mistake regarding installation of apt-transport-https

* added verbosity in the test run for easy debugging

* updated comment in the runtest.sh
2019-01-24 13:14:29 -08:00
Scott McKay
bca8daf762
Update ONNX. Implement Scan 9 changes (#366)
* Update ONNX version to pickup Scan spec change that adds scan_output_axes.
Add logic to transpose an output
  - write to temporary buffer when executing subgraph
  - transpose temporary buffer into Scan output when execution completes
Add unit tests

* Update to ONNX dbf3581835e3a05716e10587511d7ab3b2cdc386 to pickup inferencing bugfix.
Update test to match.

* Disable some tests for opset 9 operators that haven't been implemented yet.
2019-01-24 08:10:39 +10:00
jignparm
ea816615eb
remove use_tvm from base script. Put it in yaml configuration (#363) 2019-01-22 16:46:38 -08:00
Changming Sun
948cc03490 upgrade onnx 2019-01-17 13:10:30 -08:00
Changming Sun
6225d5fe1e
Update test data (#334)
* update test data
2019-01-15 17:01:46 -08:00
Changming Sun
7977871740 Split build pipeline 2019-01-15 12:30:59 -08:00
Raymond Yang
0efc48a11a
Install dotnet sdk on linux ci (#320)
* Try install dotnet sdk on linux ci

* Fix install script

* Add configurable os version in docker build script

* Avoid use ARG in docker
2019-01-14 17:51:45 -08:00
edgchen1
34bcc92554 Added test data URL and checksum arguments to build.py. (#302)
* Added test data arguments to build.py, modified win-ci-pipeline build.

* Updated CI builds to use template tasks, added test data args, removed AZURE_BLOB_KEY uses.

* Fixed up set test data step template.
2019-01-09 22:33:14 -08:00
Changming Sun
e318c7317b update 2019-01-09 15:49:27 -08:00
Pranav Sharma
31bbb4598e
Enable tvm in CI builds. (#285)
* Enable tvm in CI builds

* Fix tvm dll path issue
2019-01-07 19:37:06 -08:00
Changming Sun
5e113661a9 Build system upgrades (#281)
* update

* runas normal user
2019-01-07 13:15:24 -08:00
Raymond Yang
ec2cf59baa
Enable building python37 packages (#283) 2019-01-05 18:41:40 -08:00
Dmitri Smirnov
7af1887b33
Introduce basic BFloat16 runtime support (#235)
* Add basic support for BFloat16 type.

* Advance onnx submodule for bfloat16 support.

* Update install_deps for linux.

* Address review comments.
2018-12-21 12:40:59 -08:00
Changming Sun
ac3a081ec5 Enable release build in Windows CI pipelines (#220) 2018-12-19 11:12:43 -08:00
Changming Sun
dc8b37f4c4
update onnx (#209)
* update onnx
2018-12-18 14:50:28 -08:00
jignparm
5fd9024139
[WIP] Initial checking for CSharp GPU support (#176)
* Initial checking for CSharp GPU support

* Enabled C# for GPU build

* Update Onnxruntime to Ort

* Add runtime check for cuda dlls for windows

* Update pretrained model test, for models where name!=model.onnx

* lowered tolerance for float checks to pass new models

* ignore extra ._resnet34v2.onnx file in pretrained test
2018-12-17 21:18:48 +00:00
Changming Sun
fb021b9002 delete azure-pipelines.yml 2018-12-13 18:38:59 -08:00
Changming Sun
0aaaf4663d Update data download script (#171)
* Add cache dir

* update

* disable csharp

* update

* Revert "disable csharp"

This reverts commit e1a80f3272f7e7881f3081a91467756d2769fdf4.

* add output

* update
2018-12-13 14:46:59 -08:00
Changming Sun
618cc51754
Update onnx_backend_test_series.py (#146)
* Update onnx_backend_test_series.py

* Update BUILD.md
2018-12-12 16:25:16 -08:00
Changming Sun
1beeccb89d Enable data cache (#144) 2018-12-10 19:15:03 -08:00
jignparm
6bfb195184
Jignparm/csharp test difftypes (#126)
* Added tests for C# types

* added multithread c# test

* Added pretrained tests

* Added function to load data from PB file

* added exec task for protoc
2018-12-08 01:34:08 +00:00
Pranav Sharma
c5cbdd5a55
Miscellaneous fixes (#123) 2018-12-06 22:21:04 -08:00
Hector Li
a68f5ccfd9
Upgrade gpu build to CUDA 10 + cudnn 7.3 (#112)
* Upgrade gpu build to CUDA 10 + cudnn 7.3

* update the yaml file for python package building

* switch to the cuda9.1 docker file if the CUDA_VER is cuda9.1-cudnn7.1
2018-12-05 17:49:16 -08:00
Hector Li
4801e67104
Hecli/cuda10 upgrade (#111)
* Add build step to remove the cuda msbuildcutomization file after build, otherwise, the cuda high version could impact the lower version build

* update vs path

* update the path
2018-12-05 14:58:40 -08:00
Hector Li
3dcf344f09
switch build agents to the CUDA 10 pool (#106) 2018-12-05 12:48:02 -08:00
Raymond Yang
3b08c6665a
Split the CI pipelines (#94) 2018-12-04 13:51:35 -08:00
Dmitri Smirnov
fbb23a9ed0
Implement StringNormalizer (#69)
* Imlpement StringNormalizer
  Add mixed language tests, test case insentive path.
* Create a locale on the fly. Default locale does not seem to create well.
* Add CI language-pack-en to make default locale available.
  Catch and translate locale creation exception to make the message
  meaningful.
* Make sure locales are configured on Ubuntu.
2018-12-04 13:47:08 -08:00
Raymond Yang
1e59b6f1c2
Minor fixes to CI definitions (#80)
* Align win gpu ci parameters with vsts definition

* Fix linux CI script to avoid docker name conflict
2018-12-03 17:35:23 -08:00
Raymond Yang
fd0d7c5fc0 Add the mac python packaging script (#72)
* Add pipeline for building python wheels for Windows/Linux CPU and GPU

* try enable mkldnn

* remove mklml

* Update python packaging configuration

* Try macos pywheel packaging

* Try removing mkldnn from mac build

* Use conda in mac agents

* Change to build release only

* Add the mac wheel packaging list to the packaging yaml

* Add mkldnn into mac wheels
2018-11-30 17:31:15 -08:00
Raymond Yang
cb1781927f Remove mklml in Linux python wheel packagaing (#53) 2018-11-28 17:37:49 -08:00