2019-12-21 01:11:46 +00:00
<!DOCTYPE html>
2020-08-13 02:12:50 +00:00
< html lang = "en" >
2019-12-21 01:11:46 +00:00
< head >
< meta charset = "utf-8" / >
2022-01-04 17:32:40 +00:00
< meta name = "viewport" content = "width=device-width, initial-scale=1.0" / > < meta name = "generator" content = "Docutils 0.17.1: http://docutils.sourceforge.net/" / >
2022-08-03 17:24:42 +00:00
< title > Profile the execution of a simple model — ONNX Runtime 1.13.0 documentation< / title >
2022-01-04 17:32:40 +00:00
< link rel = "stylesheet" type = "text/css" href = "../static/pygments.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/alabaster.css" / >
2021-02-11 00:34:31 +00:00
< link rel = "stylesheet" type = "text/css" href = "../static/graphviz.css" / >
2022-01-04 17:32:40 +00:00
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery-binder.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery-dataframe.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery-rendered-html.css" / >
< script data-url_root = "../" id = "documentation_options" src = "../static/documentation_options.js" > < / script >
2021-02-11 00:34:31 +00:00
< script src = "../static/jquery.js" > < / script >
< script src = "../static/underscore.js" > < / script >
2022-08-03 17:24:42 +00:00
< script src = "../static/_sphinx_javascript_frameworks_compat.js" > < / script >
2021-02-11 00:34:31 +00:00
< script src = "../static/doctools.js" > < / script >
2019-12-21 01:11:46 +00:00
< link rel = "index" title = "Index" href = "../genindex.html" / >
< link rel = "search" title = "Search" href = "../search.html" / >
2021-02-11 00:34:31 +00:00
< link rel = "next" title = "Train, convert and predict with ONNX Runtime" href = "plot_convert_pipeline_vectorizer.html" / >
2020-04-06 22:52:48 +00:00
< link rel = "prev" title = "Metadata" href = "plot_metadata.html" / >
2019-12-21 01:11:46 +00:00
2021-02-11 00:34:31 +00:00
< link rel = "stylesheet" href = "../static/custom.css" type = "text/css" / >
2019-12-21 01:11:46 +00:00
< meta name = "viewport" content = "width=device-width, initial-scale=0.9, maximum-scale=0.9" / >
< / head > < body >
< div class = "document" >
< div class = "documentwrapper" >
< div class = "bodywrapper" >
< div class = "body" role = "main" >
< div class = "sphx-glr-download-link-note admonition note" >
< p class = "admonition-title" > Note< / p >
2021-03-09 18:21:38 +00:00
< p > Click < a class = "reference internal" href = "#sphx-glr-download-auto-examples-plot-profiling-py" > < span class = "std std-ref" > here< / span > < / a >
to download the full example code< / p >
2019-12-21 01:11:46 +00:00
< / div >
2022-01-04 17:32:40 +00:00
< section class = "sphx-glr-example-title" id = "profile-the-execution-of-a-simple-model" >
2022-08-03 17:24:42 +00:00
< span id = "l-example-profiling" > < / span > < span id = "sphx-glr-auto-examples-plot-profiling-py" > < / span > < h1 > Profile the execution of a simple model< a class = "headerlink" href = "#profile-the-execution-of-a-simple-model" title = "Permalink to this heading" > ¶< / a > < / h1 >
2019-12-21 01:11:46 +00:00
< p > < em > ONNX Runtime< / em > can profile the execution of the model.
This example shows how to interpret the results.< / p >
2022-08-03 17:24:42 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > import< / span > < span class = "nn" > numpy< / span >
< span class = "kn" > import< / span > < span class = "nn" > onnx< / span >
2020-08-13 02:12:50 +00:00
< span class = "kn" > import< / span > < span class = "nn" > onnxruntime< / span > < span class = "k" > as< / span > < span class = "nn" > rt< / span >
2022-01-04 17:32:40 +00:00
< span class = "kn" > from< / span > < span class = "nn" > onnxruntime.datasets< / span > < span class = "k" > import< / span > < span class = "n" > get_example< / span >
2020-04-06 22:52:48 +00:00
< span class = "k" > def< / span > < span class = "nf" > change_ir_version< / span > < span class = "p" > (< / span > < span class = "n" > filename< / span > < span class = "p" > ,< / span > < span class = "n" > ir_version< / span > < span class = "o" > =< / span > < span class = "mi" > 6< / span > < span class = "p" > ):< / span >
< span class = "s2" > " onnxruntime==1.2.0 does not support opset < = 7 and ir_version > 6" < / span >
< span class = "k" > with< / span > < span class = "nb" > open< / span > < span class = "p" > (< / span > < span class = "n" > filename< / span > < span class = "p" > ,< / span > < span class = "s2" > " rb" < / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > f< / span > < span class = "p" > :< / span >
< span class = "n" > model< / span > < span class = "o" > =< / span > < span class = "n" > onnx< / span > < span class = "o" > .< / span > < span class = "n" > load< / span > < span class = "p" > (< / span > < span class = "n" > f< / span > < span class = "p" > )< / span >
< span class = "n" > model< / span > < span class = "o" > .< / span > < span class = "n" > ir_version< / span > < span class = "o" > =< / span > < span class = "mi" > 6< / span >
< span class = "k" > if< / span > < span class = "n" > model< / span > < span class = "o" > .< / span > < span class = "n" > opset_import< / span > < span class = "p" > [< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > version< / span > < span class = "o" > < =< / span > < span class = "mi" > 7< / span > < span class = "p" > :< / span >
< span class = "n" > model< / span > < span class = "o" > .< / span > < span class = "n" > opset_import< / span > < span class = "p" > [< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > version< / span > < span class = "o" > =< / span > < span class = "mi" > 11< / span >
< span class = "k" > return< / span > < span class = "n" > model< / span >
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > example1< / span > < span class = "o" > =< / span > < span class = "n" > get_example< / span > < span class = "p" > (< / span > < span class = "s2" > " mul_1.onnx" < / span > < span class = "p" > )< / span >
2020-04-06 22:52:48 +00:00
< span class = "n" > onnx_model< / span > < span class = "o" > =< / span > < span class = "n" > change_ir_version< / span > < span class = "p" > (< / span > < span class = "n" > example1< / span > < span class = "p" > )< / span >
< span class = "n" > onnx_model_str< / span > < span class = "o" > =< / span > < span class = "n" > onnx_model< / span > < span class = "o" > .< / span > < span class = "n" > SerializeToString< / span > < span class = "p" > ()< / span >
2022-01-04 17:32:40 +00:00
< span class = "n" > sess< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > InferenceSession< / span > < span class = "p" > (< / span > < span class = "n" > onnx_model_str< / span > < span class = "p" > ,< / span > < span class = "n" > providers< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > get_available_providers< / span > < span class = "p" > ())< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > input_name< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span >
< span class = "n" > x< / span > < span class = "o" > =< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > array< / span > < span class = "p" > ([[< / span > < span class = "mf" > 1.0< / span > < span class = "p" > ,< / span > < span class = "mf" > 2.0< / span > < span class = "p" > ],< / span > < span class = "p" > [< / span > < span class = "mf" > 3.0< / span > < span class = "p" > ,< / span > < span class = "mf" > 4.0< / span > < span class = "p" > ],< / span > < span class = "p" > [< / span > < span class = "mf" > 5.0< / span > < span class = "p" > ,< / span > < span class = "mf" > 6.0< / span > < span class = "p" > ]],< / span > < span class = "n" > dtype< / span > < span class = "o" > =< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "n" > res< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > (< / span > < span class = "kc" > None< / span > < span class = "p" > ,< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > x< / span > < span class = "p" > })< / span >
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > res< / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [array([[ 1., 4.],
[ 9., 16.],
[25., 36.]], dtype=float32)]
< / pre > < / div >
< / div >
< p > We need to enable to profiling
before running the predictions.< / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > options< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > SessionOptions< / span > < span class = "p" > ()< / span >
< span class = "n" > options< / span > < span class = "o" > .< / span > < span class = "n" > enable_profiling< / span > < span class = "o" > =< / span > < span class = "kc" > True< / span >
2022-01-04 17:32:40 +00:00
< span class = "n" > sess_profile< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > InferenceSession< / span > < span class = "p" > (< / span > < span class = "n" > onnx_model_str< / span > < span class = "p" > ,< / span > < span class = "n" > options< / span > < span class = "p" > ,< / span > < span class = "n" > providers< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > get_available_providers< / span > < span class = "p" > ())< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > input_name< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span >
< span class = "n" > x< / span > < span class = "o" > =< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > array< / span > < span class = "p" > ([[< / span > < span class = "mf" > 1.0< / span > < span class = "p" > ,< / span > < span class = "mf" > 2.0< / span > < span class = "p" > ],< / span > < span class = "p" > [< / span > < span class = "mf" > 3.0< / span > < span class = "p" > ,< / span > < span class = "mf" > 4.0< / span > < span class = "p" > ],< / span > < span class = "p" > [< / span > < span class = "mf" > 5.0< / span > < span class = "p" > ,< / span > < span class = "mf" > 6.0< / span > < span class = "p" > ]],< / span > < span class = "n" > dtype< / span > < span class = "o" > =< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > (< / span > < span class = "kc" > None< / span > < span class = "p" > ,< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > x< / span > < span class = "p" > })< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > prof_file< / span > < span class = "o" > =< / span > < span class = "n" > sess_profile< / span > < span class = "o" > .< / span > < span class = "n" > end_profiling< / span > < span class = "p" > ()< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > prof_file< / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
2022-08-24 20:19:51 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > onnxruntime_profile__2022-08-09_23-21-38.json
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > The results are stored un a file in JSON format.
Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > import< / span > < span class = "nn" > json< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "k" > with< / span > < span class = "nb" > open< / span > < span class = "p" > (< / span > < span class = "n" > prof_file< / span > < span class = "p" > ,< / span > < span class = "s2" > " r" < / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > f< / span > < span class = "p" > :< / span >
< span class = "n" > sess_time< / span > < span class = "o" > =< / span > < span class = "n" > json< / span > < span class = "o" > .< / span > < span class = "n" > load< / span > < span class = "p" > (< / span > < span class = "n" > f< / span > < span class = "p" > )< / span >
< span class = "kn" > import< / span > < span class = "nn" > pprint< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > pprint< / span > < span class = "o" > .< / span > < span class = "n" > pprint< / span > < span class = "p" > (< / span > < span class = "n" > sess_time< / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [{' args' : {},
' cat' : ' Session' ,
2022-08-24 20:19:51 +00:00
' dur' : 64,
2021-02-11 00:34:31 +00:00
' name' : ' model_loading_array' ,
2019-12-21 01:11:46 +00:00
' ph' : ' X' ,
2022-08-24 20:19:51 +00:00
' pid' : 3087,
' tid' : 3087,
2022-01-04 17:32:40 +00:00
' ts' : 1},
2019-12-21 01:11:46 +00:00
{' args' : {},
' cat' : ' Session' ,
2022-08-24 20:19:51 +00:00
' dur' : 228,
2019-12-21 01:11:46 +00:00
' name' : ' session_initialization' ,
' ph' : ' X' ,
2022-08-24 20:19:51 +00:00
' pid' : 3087,
' tid' : 3087,
' ts' : 79}]
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
2022-08-24 20:19:51 +00:00
< p class = "sphx-glr-timing" > < strong > Total running time of the script:< / strong > ( 0 minutes 0.005 seconds)< / p >
2022-08-03 17:24:42 +00:00
< div class = "sphx-glr-footer sphx-glr-footer-example docutils container" id = "sphx-glr-download-auto-examples-plot-profiling-py" >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-download sphx-glr-download-python docutils container" >
2021-03-09 18:21:38 +00:00
< p > < a class = "reference download internal" download = "" href = "../downloads/cfe61aca1f0a89486c7024466ea500fd/plot_profiling.py" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Python< / span > < span class = "pre" > source< / span > < span class = "pre" > code:< / span > < span class = "pre" > plot_profiling.py< / span > < / code > < / a > < / p >
2019-12-21 01:11:46 +00:00
< / div >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-download sphx-glr-download-jupyter docutils container" >
2021-03-09 18:21:38 +00:00
< p > < a class = "reference download internal" download = "" href = "../downloads/ccbbfd4f60683438ab99a4c42d3fbbdf/plot_profiling.ipynb" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Jupyter< / span > < span class = "pre" > notebook:< / span > < span class = "pre" > plot_profiling.ipynb< / span > < / code > < / a > < / p >
2019-12-21 01:11:46 +00:00
< / div >
< / div >
2020-08-13 02:12:50 +00:00
< p class = "sphx-glr-signature" > < a class = "reference external" href = "https://sphinx-gallery.github.io" > Gallery generated by Sphinx-Gallery< / a > < / p >
2022-01-04 17:32:40 +00:00
< / section >
2019-12-21 01:11:46 +00:00
< / div >
< / div >
< / div >
< div class = "sphinxsidebar" role = "navigation" aria-label = "main navigation" >
< div class = "sphinxsidebarwrapper" >
< p class = "logo" > < a href = "../index.html" >
2021-02-11 00:34:31 +00:00
< img class = "logo" src = "../static/ONNX_Runtime_icon.png" alt = "Logo" / >
2019-12-21 01:11:46 +00:00
< / a > < / p >
< h1 class = "logo" > < a href = "../index.html" > ONNX Runtime< / a > < / h1 >
< h3 > Navigation< / h3 >
2021-03-09 18:21:38 +00:00
< ul >
2019-12-21 01:11:46 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "../tutorial.html" > Tutorial< / a > < / li >
2022-03-16 01:13:11 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "../api_summary.html" > API< / a > < / li >
2021-03-09 18:21:38 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "index.html" > Gallery of examples< / a > < / li >
2019-12-21 01:11:46 +00:00
< / ul >
< div class = "relations" >
< h3 > Related Topics< / h3 >
< ul >
< li > < a href = "../index.html" > Documentation overview< / a > < ul >
< li > < a href = "index.html" > Gallery of examples< / a > < ul >
2020-04-06 22:52:48 +00:00
< li > Previous: < a href = "plot_metadata.html" title = "previous chapter" > Metadata< / a > < / li >
2021-02-11 00:34:31 +00:00
< li > Next: < a href = "plot_convert_pipeline_vectorizer.html" title = "next chapter" > Train, convert and predict with ONNX Runtime< / a > < / li >
2019-12-21 01:11:46 +00:00
< / ul > < / li >
< / ul > < / li >
< / ul >
< / div >
< div id = "searchbox" style = "display: none" role = "search" >
< h3 id = "searchlabel" > Quick search< / h3 >
< div class = "searchformwrapper" >
< form class = "search" action = "../search.html" method = "get" >
2022-01-04 17:32:40 +00:00
< input type = "text" name = "q" aria-labelledby = "searchlabel" autocomplete = "off" autocorrect = "off" autocapitalize = "off" spellcheck = "false" / >
2019-12-21 01:11:46 +00:00
< input type = "submit" value = "Go" / >
< / form >
< / div >
< / div >
2022-08-03 17:24:42 +00:00
< script > document . getElementById ( 'searchbox' ) . style . display = "block" < / script >
2020-04-06 22:52:48 +00:00
2019-12-21 01:11:46 +00:00
< / div >
< / div >
< div class = "clearer" > < / div >
< / div >
< div class = "footer" >
2021-02-11 00:34:31 +00:00
© 2018-2021, Microsoft.
2019-12-21 01:11:46 +00:00
|
2022-08-03 17:24:42 +00:00
Powered by < a href = "http://sphinx-doc.org/" > Sphinx 5.1.1< / a >
2020-04-06 22:52:48 +00:00
& < a href = "https://github.com/bitprophet/alabaster" > Alabaster 0.7.12< / a >
2019-12-21 01:11:46 +00:00
|
2021-02-11 00:34:31 +00:00
< a href = "../sources/auto_examples/plot_profiling.rst.txt"
2019-12-21 01:11:46 +00:00
rel="nofollow">Page source< / a >
< / div >
< / body >
< / html >
