saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-26 19:52:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

[perf_metric] added inferences per second metric (#10921)

Browse source
This commit is contained in:
soundarthiaga 2022-03-18 21:01:11 -07:00 committed by GitHub
parent 3897b93606
commit eabb14788a
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
onnxruntime/test/perftest/performance_runner.cc
View file

@ -147,6 +147,7 @@ Status PerformanceRunner::Run() {
<< "Average inference time cost: " << performance_result_.total_time_cost / performance_result_.time_costs.size() * 1000 << " ms\n"
// Time between start and end of run. Less than Total time cost when running requests in parallel.
<< "Total inference run time: " << inference_duration.count() << " s\n"
<< "Number of inferences per second: " << performance_result_.time_costs.size() / inference_duration.count() << " \n"
<< "Avg CPU usage: " << performance_result_.average_CPU_usage << " %\n"
<< "Peak working set size: " << performance_result_.peak_workingset_size << " bytes"
<< std::endl;