saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-20 19:12:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

output all parameters in the bert_perf_test tool (#17379)

Browse source 
Currently, there are some parameters missing in output file. This output
all parameters.

Example output:

Latency(ms) | Latency_P50 | Latency_P75 | Latency_P90 | Latency_P95 |
Latency_P99 | Throughput(QPS) | model | graph_optimization_level |
intra_op_num_threads | batch_size | sequence_length | test_cases |
test_times | use_gpu | use_io_binding | average_sequence_length |
random_sequence_length
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
| -- | -- | --
10.91 | 11.16 | 11.3 | 11.7 | 11.78 | 11.84 | 91.66 | model.onnx |
ENABLE_ALL | 4 | 1 | 512 | 1 | 10 | TRUE | TRUE | 64 | FALSE
This commit is contained in:
Tianlei Wu 2023-09-01 08:17:58 -07:00 committed by GitHub
parent 8b98ecad70
commit e23f16adbf
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 6 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
onnxruntime/python/tools/transformers/bert_perf_test.py
View file

@ -235,7 +235,12 @@ def to_string(model_path, session, test_setting):
option += "graph_optimization_level={},intra_op_num_threads={},".format(
sess_options.graph_optimization_level, sess_options.intra_op_num_threads
).replace("GraphOptimizationLevel.ORT_", "")
option += f"batch_size={test_setting.batch_size},sequence_length={test_setting.sequence_length},test_cases={test_setting.test_cases},test_times={test_setting.test_times},use_gpu={test_setting.use_gpu}"
option += f"batch_size={test_setting.batch_size},sequence_length={test_setting.sequence_length},"
option += f"test_cases={test_setting.test_cases},test_times={test_setting.test_times},"
option += f"use_gpu={test_setting.use_gpu},use_io_binding={test_setting.use_io_binding},"
option += f"average_sequence_length={test_setting.average_sequence_length},"
option += f"random_sequence_length={test_setting.random_sequence_length}"
return option