2019-12-20 21:38:07 +00:00
2019-10-30 16:35:16 +00:00
<!DOCTYPE html>
2020-08-13 02:12:50 +00:00
< html lang = "en" >
2019-12-20 21:38:07 +00:00
< head >
< meta charset = "utf-8" / >
2020-08-13 02:12:50 +00:00
< meta name = "viewport" content = "width=device-width, initial-scale=1.0" >
< title > ONNX Runtime for Keras — ONNX Runtime 1.4.0 documentation< / title >
2019-12-20 21:38:07 +00:00
< link rel = "stylesheet" href = "../_static/alabaster.css" type = "text/css" / >
< link rel = "stylesheet" href = "../_static/pygments.css" type = "text/css" / >
< link rel = "stylesheet" type = "text/css" href = "../_static/graphviz.css" / >
2020-08-13 02:12:50 +00:00
< link rel = "stylesheet" type = "text/css" href = "../_static/gallery.css" / >
< link rel = "stylesheet" type = "text/css" href = "../_static/gallery-binder.css" / >
< link rel = "stylesheet" type = "text/css" href = "../_static/gallery-dataframe.css" / >
< script id = "documentation_options" data-url_root = "../" src = "../_static/documentation_options.js" > < / script >
< script src = "../_static/jquery.js" > < / script >
< script src = "../_static/underscore.js" > < / script >
< script src = "../_static/doctools.js" > < / script >
< script src = "../_static/language_data.js" > < / script >
2019-12-20 21:38:07 +00:00
< link rel = "index" title = "Index" href = "../genindex.html" / >
< link rel = "search" title = "Search" href = "../search.html" / >
2019-12-21 01:11:46 +00:00
< link rel = "next" title = "Train, convert and predict with ONNX Runtime" href = "plot_convert_pipeline_vectorizer.html" / >
2020-04-06 22:52:48 +00:00
< link rel = "prev" title = "Profile the execution of a simple model" href = "plot_profiling.html" / >
2019-12-20 21:38:07 +00:00
< link rel = "stylesheet" href = "../_static/custom.css" type = "text/css" / >
< meta name = "viewport" content = "width=device-width, initial-scale=0.9, maximum-scale=0.9" / >
2019-10-30 16:35:16 +00:00
2019-12-20 21:38:07 +00:00
< / head > < body >
2019-10-30 16:35:16 +00:00
2019-12-20 21:38:07 +00:00
< div class = "document" >
< div class = "documentwrapper" >
< div class = "bodywrapper" >
< div class = "body" role = "main" >
< div class = "sphx-glr-download-link-note admonition note" >
< p class = "admonition-title" > Note< / p >
2020-08-13 02:12:50 +00:00
< p > Click < a class = "reference internal" href = "#sphx-glr-download-auto-examples-plot-dl-keras-py" > < span class = "std std-ref" > here< / span > < / a > to download the full example code< / p >
2019-10-30 16:35:16 +00:00
< / div >
< div class = "sphx-glr-example-title section" id = "onnx-runtime-for-keras" >
< span id = "l-example-backend-api-tensorflow" > < / span > < span id = "sphx-glr-auto-examples-plot-dl-keras-py" > < / span > < h1 > ONNX Runtime for Keras< a class = "headerlink" href = "#onnx-runtime-for-keras" title = "Permalink to this headline" > ¶< / a > < / h1 >
< p > The following demonstrates how to compute the predictions
of a pretrained deep learning model obtained from
< a class = "reference external" href = "https://keras.io/" > keras< / a >
with < em > onnxruntime< / em > . The conversion requires
< a class = "reference external" href = "https://keras.io/" > keras< / a > ,
< a class = "reference external" href = "https://www.tensorflow.org/" > tensorflow< / a > ,
< a class = "reference external" href = "https://github.com/onnx/keras-onnx/" > keras-onnx< / a > ,
< a class = "reference external" href = "https://pypi.org/project/onnxmltools/" > onnxmltools< / a >
but then only < em > onnxruntime< / em > is required
to compute the predictions.< / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > import< / span > < span class = "nn" > os< / span >
2019-10-30 16:35:16 +00:00
< span class = "k" > if< / span > < span class = "ow" > not< / span > < span class = "n" > os< / span > < span class = "o" > .< / span > < span class = "n" > path< / span > < span class = "o" > .< / span > < span class = "n" > exists< / span > < span class = "p" > (< / span > < span class = "s1" > ' dense121.onnx' < / span > < span class = "p" > ):< / span >
2019-12-21 01:11:46 +00:00
< span class = "kn" > from< / span > < span class = "nn" > keras.applications.densenet< / span > < span class = "kn" > import< / span > < span class = "n" > DenseNet121< / span >
2020-08-13 02:12:50 +00:00
< span class = "n" > model< / span > < span class = "o" > =< / span > < span class = "n" > DenseNet121< / span > < span class = "p" > (< / span > < span class = "n" > include_top< / span > < span class = "o" > =< / span > < span class = "kc" > True< / span > < span class = "p" > ,< / span > < span class = "n" > weights< / span > < span class = "o" > =< / span > < span class = "s1" > ' imagenet' < / span > < span class = "p" > )< / span >
2019-10-30 16:35:16 +00:00
2019-12-21 01:11:46 +00:00
< span class = "kn" > from< / span > < span class = "nn" > keras2onnx< / span > < span class = "kn" > import< / span > < span class = "n" > convert_keras< / span >
2019-10-30 16:35:16 +00:00
< span class = "n" > onx< / span > < span class = "o" > =< / span > < span class = "n" > convert_keras< / span > < span class = "p" > (< / span > < span class = "n" > model< / span > < span class = "p" > ,< / span > < span class = "s1" > ' dense121.onnx' < / span > < span class = "p" > )< / span >
2020-04-06 22:52:48 +00:00
< span class = "n" > onx< / span > < span class = "o" > .< / span > < span class = "n" > ir_version< / span > < span class = "o" > =< / span > < span class = "mi" > 6< / span >
2019-10-30 16:35:16 +00:00
< span class = "k" > with< / span > < span class = "nb" > open< / span > < span class = "p" > (< / span > < span class = "s2" > " dense121.onnx" < / span > < span class = "p" > ,< / span > < span class = "s2" > " wb" < / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > f< / span > < span class = "p" > :< / span >
< span class = "n" > f< / span > < span class = "o" > .< / span > < span class = "n" > write< / span > < span class = "p" > (< / span > < span class = "n" > onx< / span > < span class = "o" > .< / span > < span class = "n" > SerializeToString< / span > < span class = "p" > ())< / span >
< / pre > < / div >
< / div >
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > keras.preprocessing.image< / span > < span class = "kn" > import< / span > < span class = "n" > array_to_img< / span > < span class = "p" > ,< / span > < span class = "n" > img_to_array< / span > < span class = "p" > ,< / span > < span class = "n" > load_img< / span >
2019-10-30 16:35:16 +00:00
< span class = "n" > img< / span > < span class = "o" > =< / span > < span class = "n" > load_img< / span > < span class = "p" > (< / span > < span class = "s1" > ' Sannosawa1.jpg' < / span > < span class = "p" > )< / span >
< span class = "n" > ximg< / span > < span class = "o" > =< / span > < span class = "n" > img_to_array< / span > < span class = "p" > (< / span > < span class = "n" > img< / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "kn" > import< / span > < span class = "nn" > matplotlib.pyplot< / span > < span class = "k" > as< / span > < span class = "nn" > plt< / span >
2019-10-30 16:35:16 +00:00
< span class = "n" > plt< / span > < span class = "o" > .< / span > < span class = "n" > imshow< / span > < span class = "p" > (< / span > < span class = "n" > ximg< / span > < span class = "o" > /< / span > < span class = "mi" > 255< / span > < span class = "p" > )< / span >
< span class = "n" > plt< / span > < span class = "o" > .< / span > < span class = "n" > axis< / span > < span class = "p" > (< / span > < span class = "s1" > ' off' < / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
2020-08-13 02:12:50 +00:00
< img alt = "plot dl keras" class = "sphx-glr-single-img" src = "../_images/sphx_glr_plot_dl_keras_001.png" / >
< p class = "sphx-glr-script-out" > Out:< / p >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > (-0.5, 1279.5, 959.5, -0.5)
< / pre > < / div >
< / div >
2019-10-30 16:35:16 +00:00
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > import< / span > < span class = "nn" > onnxruntime< / span > < span class = "k" > as< / span > < span class = "nn" > rt< / span >
2019-12-21 01:11:46 +00:00
< span class = "kn" > from< / span > < span class = "nn" > onnxruntime.capi.onnxruntime_pybind11_state< / span > < span class = "kn" > import< / span > < span class = "n" > InvalidGraph< / span >
2019-10-30 16:35:16 +00:00
< span class = "k" > try< / span > < span class = "p" > :< / span >
< span class = "n" > sess< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > InferenceSession< / span > < span class = "p" > (< / span > < span class = "s1" > ' dense121.onnx' < / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "n" > ok< / span > < span class = "o" > =< / span > < span class = "kc" > True< / span >
2019-10-30 16:35:16 +00:00
< span class = "k" > except< / span > < span class = "p" > (< / span > < span class = "n" > InvalidGraph< / span > < span class = "p" > ,< / span > < span class = "ne" > TypeError< / span > < span class = "p" > ,< / span > < span class = "ne" > RuntimeError< / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > e< / span > < span class = "p" > :< / span >
< span class = "c1" > # Probably a mismatch between onnxruntime and onnx version.< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > e< / span > < span class = "p" > )< / span >
< span class = "n" > ok< / span > < span class = "o" > =< / span > < span class = "kc" > False< / span >
2019-10-30 16:35:16 +00:00
< span class = "k" > if< / span > < span class = "n" > ok< / span > < span class = "p" > :< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " The model expects input shape:" < / span > < span class = "p" > ,< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > )< / span >
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " image shape:" < / span > < span class = "p" > ,< / span > < span class = "n" > ximg< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > )< / span >
2019-10-30 16:35:16 +00:00
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
2019-12-21 01:11:46 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > The model expects input shape: [' N' , 224, 224, 3]
2019-10-30 16:35:16 +00:00
image shape: (960, 1280, 3)
< / pre > < / div >
< / div >
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "k" > if< / span > < span class = "n" > ok< / span > < span class = "p" > :< / span >
2019-12-21 01:11:46 +00:00
< span class = "kn" > from< / span > < span class = "nn" > skimage.transform< / span > < span class = "kn" > import< / span > < span class = "n" > resize< / span >
2019-10-30 16:35:16 +00:00
< span class = "kn" > import< / span > < span class = "nn" > numpy< / span >
2020-08-13 02:12:50 +00:00
< span class = "n" > ximg224< / span > < span class = "o" > =< / span > < span class = "n" > resize< / span > < span class = "p" > (< / span > < span class = "n" > ximg< / span > < span class = "o" > /< / span > < span class = "mi" > 255< / span > < span class = "p" > ,< / span > < span class = "p" > (< / span > < span class = "mi" > 224< / span > < span class = "p" > ,< / span > < span class = "mi" > 224< / span > < span class = "p" > ,< / span > < span class = "mi" > 3< / span > < span class = "p" > ),< / span > < span class = "n" > anti_aliasing< / span > < span class = "o" > =< / span > < span class = "kc" > True< / span > < span class = "p" > )< / span >
2019-10-30 16:35:16 +00:00
< span class = "n" > ximg< / span > < span class = "o" > =< / span > < span class = "n" > ximg224< / span > < span class = "p" > [< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > newaxis< / span > < span class = "p" > ,< / span > < span class = "p" > :,< / span > < span class = "p" > :,< / span > < span class = "p" > :]< / span >
< span class = "n" > ximg< / span > < span class = "o" > =< / span > < span class = "n" > ximg< / span > < span class = "o" > .< / span > < span class = "n" > astype< / span > < span class = "p" > (< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " new shape:" < / span > < span class = "p" > ,< / span > < span class = "n" > ximg< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > )< / span >
2019-10-30 16:35:16 +00:00
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > new shape: (1, 224, 224, 3)
< / pre > < / div >
< / div >
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "k" > if< / span > < span class = "n" > ok< / span > < span class = "p" > :< / span >
2019-10-30 16:35:16 +00:00
< span class = "n" > input_name< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span >
2020-08-13 02:12:50 +00:00
< span class = "n" > res< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > (< / span > < span class = "kc" > None< / span > < span class = "p" > ,< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > ximg< / span > < span class = "p" > })< / span >
2019-10-30 16:35:16 +00:00
< span class = "n" > prob< / span > < span class = "o" > =< / span > < span class = "n" > res< / span > < span class = "p" > [< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > prob< / span > < span class = "o" > .< / span > < span class = "n" > ravel< / span > < span class = "p" > ()[:< / span > < span class = "mi" > 10< / span > < span class = "p" > ])< / span > < span class = "c1" > # Too big to be displayed.< / span >
2019-10-30 16:35:16 +00:00
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [2.0847994e-05 9.0344076e-07 1.6248664e-06 4.8085840e-06 6.5068948e-06
9.4026956e-07 1.9977851e-06 4.6639366e-07 9.4333046e-07 3.2267365e-06]
2019-10-30 16:35:16 +00:00
< / pre > < / div >
< / div >
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "k" > if< / span > < span class = "n" > ok< / span > < span class = "p" > :< / span >
2019-12-21 01:11:46 +00:00
< span class = "kn" > from< / span > < span class = "nn" > keras.applications.densenet< / span > < span class = "kn" > import< / span > < span class = "n" > decode_predictions< / span >
2019-10-30 16:35:16 +00:00
< span class = "n" > decoded< / span > < span class = "o" > =< / span > < span class = "n" > decode_predictions< / span > < span class = "p" > (< / span > < span class = "n" > prob< / span > < span class = "p" > )< / span >
< span class = "kn" > import< / span > < span class = "nn" > pandas< / span >
< span class = "n" > df< / span > < span class = "o" > =< / span > < span class = "n" > pandas< / span > < span class = "o" > .< / span > < span class = "n" > DataFrame< / span > < span class = "p" > (< / span > < span class = "n" > decoded< / span > < span class = "p" > [< / span > < span class = "mi" > 0< / span > < span class = "p" > ],< / span > < span class = "n" > columns< / span > < span class = "o" > =< / span > < span class = "p" > [< / span > < span class = "s2" > " class_id" < / span > < span class = "p" > ,< / span > < span class = "s2" > " name" < / span > < span class = "p" > ,< / span > < span class = "s2" > " P" < / span > < span class = "p" > ])< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > df< / span > < span class = "p" > )< / span >
2019-10-30 16:35:16 +00:00
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > Downloading data from https://storage.googleapis.com/download.tensorflow.org/data/imagenet_class_index.json
8192/35363 [=====> ........................] - ETA: 0s
40960/35363 [==================================] - 0s 0us/step
class_id name P
0 n09468604 valley 0.673279
1 n09193705 alp 0.267428
2020-04-06 22:52:48 +00:00
2 n09399592 promontory 0.013859
3 n09246464 cliff 0.013251
4 n03792972 mountain_tent 0.007756
2019-10-30 16:35:16 +00:00
< / pre > < / div >
< / div >
2020-08-13 02:12:50 +00:00
< p class = "sphx-glr-timing" > < strong > Total running time of the script:< / strong > ( 0 minutes 6.749 seconds)< / p >
2019-10-30 16:35:16 +00:00
< div class = "sphx-glr-footer class sphx-glr-footer-example docutils container" id = "sphx-glr-download-auto-examples-plot-dl-keras-py" >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-download sphx-glr-download-python docutils container" >
2019-12-20 21:38:07 +00:00
< p > < a class = "reference download internal" download = "" href = "../_downloads/b81c8c31615f9400a26ee60f0641af3f/plot_dl_keras.py" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Python< / span > < span class = "pre" > source< / span > < span class = "pre" > code:< / span > < span class = "pre" > plot_dl_keras.py< / span > < / code > < / a > < / p >
< / div >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-download sphx-glr-download-jupyter docutils container" >
2019-12-20 21:38:07 +00:00
< p > < a class = "reference download internal" download = "" href = "../_downloads/c9f88a9294285c733dcce209fcc939de/plot_dl_keras.ipynb" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Jupyter< / span > < span class = "pre" > notebook:< / span > < span class = "pre" > plot_dl_keras.ipynb< / span > < / code > < / a > < / p >
< / div >
2019-10-30 16:35:16 +00:00
< / div >
2020-08-13 02:12:50 +00:00
< p class = "sphx-glr-signature" > < a class = "reference external" href = "https://sphinx-gallery.github.io" > Gallery generated by Sphinx-Gallery< / a > < / p >
2019-10-30 16:35:16 +00:00
< / div >
2019-12-20 21:38:07 +00:00
< / div >
< / div >
< / div >
< div class = "sphinxsidebar" role = "navigation" aria-label = "main navigation" >
< div class = "sphinxsidebarwrapper" >
< p class = "logo" > < a href = "../index.html" >
< img class = "logo" src = "../_static/ONNX_Runtime_icon.png" alt = "Logo" / >
< / a > < / p >
< h1 class = "logo" > < a href = "../index.html" > ONNX Runtime< / a > < / h1 >
< h3 > Navigation< / h3 >
2020-04-06 22:52:48 +00:00
< ul >
2019-12-20 21:38:07 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "../tutorial.html" > Tutorial< / a > < / li >
< li class = "toctree-l1" > < a class = "reference internal" href = "../api_summary.html" > API Summary< / a > < / li >
2020-04-06 22:52:48 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "index.html" > Gallery of examples< / a > < / li >
2019-12-20 21:38:07 +00:00
< / ul >
< div class = "relations" >
< h3 > Related Topics< / h3 >
< ul >
< li > < a href = "../index.html" > Documentation overview< / a > < ul >
< li > < a href = "index.html" > Gallery of examples< / a > < ul >
2020-04-06 22:52:48 +00:00
< li > Previous: < a href = "plot_profiling.html" title = "previous chapter" > Profile the execution of a simple model< / a > < / li >
2019-12-21 01:11:46 +00:00
< li > Next: < a href = "plot_convert_pipeline_vectorizer.html" title = "next chapter" > Train, convert and predict with ONNX Runtime< / a > < / li >
2019-12-20 21:38:07 +00:00
< / ul > < / li >
< / ul > < / li >
< / ul >
< / div >
< div id = "searchbox" style = "display: none" role = "search" >
< h3 id = "searchlabel" > Quick search< / h3 >
< div class = "searchformwrapper" >
< form class = "search" action = "../search.html" method = "get" >
< input type = "text" name = "q" aria-labelledby = "searchlabel" / >
< input type = "submit" value = "Go" / >
< / form >
2019-10-30 16:35:16 +00:00
< / div >
2019-12-20 21:38:07 +00:00
< / div >
2020-08-13 02:12:50 +00:00
< script > $ ( '#searchbox' ) . show ( 0 ) ; < / script >
2020-04-06 22:52:48 +00:00
2019-12-20 21:38:07 +00:00
< / div >
< / div >
< div class = "clearer" > < / div >
< / div >
< div class = "footer" >
© 2018-2019, Microsoft.
|
2020-08-13 02:12:50 +00:00
Powered by < a href = "http://sphinx-doc.org/" > Sphinx 3.1.2< / a >
2020-04-06 22:52:48 +00:00
& < a href = "https://github.com/bitprophet/alabaster" > Alabaster 0.7.12< / a >
2019-12-20 21:38:07 +00:00
|
< a href = "../_sources/auto_examples/plot_dl_keras.rst.txt"
rel="nofollow">Page source< / a >
< / div >
< / body >
2019-10-30 16:35:16 +00:00
< / html >
