saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-06-01 23:30:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/tools/ci_build/github/azure-pipelines
History
Yi Zhang 435e19953e
Fix llama.covert_onnx to make it runnable in CI (#19372) 
### Description
1.  make parity_check use local model to avoid using hf token
2. del the model didn't work because it tried to del the object define
out of the function scope.
     So it caused out of memory in A10.
3. In fact, 16G GPU memory (one T4) is enough. But the conversion
process always be killed in T4 and it works on A10/24G.
     Standard_NC4as_T4_v3 has 28G CPU memory
     Standard_NV36ads_A10_v5 has 440G memory.
     It looks that the model conversion needs very huge memory.

### Motivation and Context
Last time, I came across some issues in convert_to_onnx.py so I use the
onnx model in https://github.com/microsoft/Llama-2-Onnx for testing.
Now, these issues could be fixed. So I use onnx model generated by this
repo and the CI can cover the model conversion.
2024-02-05 07:26:24 +08:00
..
nodejs/templates
nuget/templates Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
stages Fix buildJava from Zip-Nuget-Java-Nodejs Packaging Pipeline (#19187) 2024-01-17 17:20:42 -08:00
templates Add coremltools 7.1 as a dependency (#19389) 2024-02-03 09:42:21 +10:00
triggers
android-arm64-v8a-QNN-crosscompile-ci-pipeline.yml [QNN EP] Update QNN pipelines to use QNN SDK 2.18 by default (#19129) 2024-01-18 14:59:23 -08:00
android-x86_64-crosscompile-ci-pipeline.yml
bigmodels-ci-pipeline.yml Fix llama.covert_onnx to make it runnable in CI (#19372) 2024-02-05 07:26:24 +08:00
binary-size-checks-pipeline.yml
build-perf-test-binaries-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
c-api-noopenmp-packaging-pipelines.yml Move Nuget Test from T4 to A10 to reduce release duration (#19253) 2024-01-24 14:15:07 +08:00
clean-build-docker-image-cache-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
cuda-packaging-pipeline.yml Move Nuget Test from T4 to A10 to reduce release duration (#19253) 2024-01-24 14:15:07 +08:00
linux-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
linux-cpu-aten-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
linux-cpu-eager-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
linux-cpu-minimal-build-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
linux-dnnl-ci-pipeline.yml
linux-gpu-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
linux-gpu-tensorrt-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
linux-gpu-tensorrt-daily-perf-pipeline.yml [EP Perf] Fix missing Azure cli & use onnx zoo model inside image (#18917) 2024-01-01 17:14:39 -08:00
linux-migraphx-ci-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
linux-multi-gpu-tensorrt-ci-pipeline.yml
linux-openvino-ci-pipeline.yml
linux-qnn-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
mac-ci-pipeline.yml
mac-coreml-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
mac-ios-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
mac-ios-packaging-pipeline.yml Revert "iOS packaging pipeline stability" (#19135) 2024-01-16 09:18:35 -08:00
mac-objc-static-analysis-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
mac-react-native-ci-pipeline.yml
npm-packaging-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
nuget-cuda-publishing-pipeline.yml Update Nuget publishing jobs (#18851) 2023-12-19 16:54:46 -08:00
orttraining-linux-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
orttraining-linux-gpu-ci-pipeline.yml
orttraining-linux-gpu-ortmodule-distributed-test-ci-pipeline.yml
orttraining-linux-nightly-ortmodule-test-pipeline.yml ORTModule memory improvement (#18924) 2024-01-16 08:57:37 +08:00
orttraining-mac-ci-pipeline.yml
orttraining-pai-ci-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
orttraining-py-packaging-pipeline-cpu.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
orttraining-py-packaging-pipeline-cuda.yml Updates to training pipelines to reduce CI time (#18116) 2023-10-26 14:58:57 -07:00
orttraining-py-packaging-pipeline-cuda12.yml Training packaging pipeline for cuda12 (#18524) 2023-11-21 13:19:21 -08:00
orttraining-py-packaging-pipeline-rocm.yml [ROCm] Update CI/Packaging pipeline to ROCm6.0 (#18985) 2024-01-03 17:25:15 +08:00
post-merge-jobs.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
publish-nuget.yml Update Nuget publishing jobs (#18851) 2023-12-19 16:54:46 -08:00
py-cuda-package-test-pipeline.yml Adding new pipeline for python cuda testing (#18718) 2023-12-18 18:13:03 -08:00
py-cuda-packaging-pipeline.yml Update the template files to correct stage to fix the python cuda 12 packaging pipeline (#18651) 2023-12-01 07:57:46 -08:00
py-cuda-publishing-pipeline.yml Adding a new pipeline for publishing to Python Cuda 12 packages. (#18712) 2023-12-11 14:17:46 -08:00
py-package-build-pipeline.yml
py-package-test-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
py-packaging-pipeline.yml [QNN EP] Create Windows ARM64 nightly python package (#19128) 2024-01-22 18:14:41 -08:00
qnn-ep-nuget-packaging-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
web-ci-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
win-ci-fuzz-testing.yml Fix Fuzz Testing CI (#19228) 2024-01-22 15:44:57 -08:00
win-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
win-gpu-ci-pipeline.yml Move Windows GPU training job to A10 (#19041) 2024-01-08 09:19:58 -08:00
win-gpu-reduce-op-ci-pipeline.yml Enable Address Sanitizer in CI (#19073) 2024-01-12 07:24:40 -08:00
win-gpu-tensorrt-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00
win-qnn-arm64-ci-pipeline.yml [QNN EP] Update QNN pipelines to use QNN SDK 2.18 by default (#19129) 2024-01-18 14:59:23 -08:00
win-qnn-ci-pipeline.yml Fix a build issue: /MP was not enabled correctly (#19190) 2024-01-29 12:45:38 -08:00