saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-07 17:15:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

[parallel_inference] added support for parallel inference with timed duration perf test (#10922)

Browse source
This commit is contained in:
soundarthiaga 2022-03-18 19:05:28 -07:00 committed by GitHub
parent 5cbacec854
commit de06d95096
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
onnxruntime/test/perftest/performance_runner.cc
View file

@ -188,7 +188,9 @@ Status PerformanceRunner::RunParallelDuration() {
count++;
counter++;
tpool->Schedule([this, &counter, &m, &cv]() {
session_->ThreadSafeRun();
auto status = RunOneIteration<false>();
if (!status.IsOK())
std::cerr << status.ErrorMessage();
// Simplified version of Eigen::Barrier
std::lock_guard<OrtMutex> lg(m);
counter--;