onnxruntime/tools/ci_build/github/azure-pipelines/templates/check_test_result.yml
Yi Zhang 9e0a0f0f32
Check whether required tests are executed. (#19884)
### Description
Check the onnx node tests and model tests worked

### Motivation and Context
onnx node test data and model data are mount in one dir.
And onnxruntime_test_all search the dir and load the data.
If the dir does exist or there's some change in onnxruntime_test_all,
those tests may not be executed.
For example, all onnx node test data is 32M. It's hardly for us aware of
the regression.
So I add the simple check to ensure those tests are executed.

---------

Co-authored-by: Yi Zhang <your@email.com>
2024-03-13 09:59:57 -07:00

20 lines
568 B
YAML

parameters:
- name: FileName
type: string
steps:
- task: UsePythonVersion@0
inputs:
versionSpec: '3.x'
addToPath: true
architecture: 'x64'
- task: PythonScript@0
displayName: 'Check test result yml'
inputs:
scriptSource: 'inline'
script: |
with open('${{parameters.FileName}}', 'r') as file:
content = file.read()
assert 'data_onnx_opset' in content, "operator test not found in test result file"
assert 'models_zoo_opset' in content, "models_zoo model not found in test reuslt file"