2019-12-21 01:11:46 +00:00
<!DOCTYPE html>
< html xmlns = "http://www.w3.org/1999/xhtml" lang = "en" >
< head >
< meta charset = "utf-8" / >
2020-04-06 22:52:48 +00:00
< title > Train, convert and predict with ONNX Runtime — ONNX Runtime 1.2.0 documentation< / title >
2019-12-21 01:11:46 +00:00
< link rel = "stylesheet" href = "../_static/alabaster.css" type = "text/css" / >
< link rel = "stylesheet" href = "../_static/pygments.css" type = "text/css" / >
< link rel = "stylesheet" type = "text/css" href = "../_static/gallery.css" / >
< link rel = "stylesheet" type = "text/css" href = "../_static/graphviz.css" / >
< script type = "text/javascript" id = "documentation_options" data-url_root = "../" src = "../_static/documentation_options.js" > < / script >
< script type = "text/javascript" src = "../_static/jquery.js" > < / script >
< script type = "text/javascript" src = "../_static/underscore.js" > < / script >
< script type = "text/javascript" src = "../_static/doctools.js" > < / script >
< script type = "text/javascript" src = "../_static/language_data.js" > < / script >
< link rel = "index" title = "Index" href = "../genindex.html" / >
< link rel = "search" title = "Search" href = "../search.html" / >
< link rel = "next" title = "Common errors with onnxruntime" href = "plot_common_errors.html" / >
< link rel = "prev" title = "ONNX Runtime for Keras" href = "plot_dl_keras.html" / >
< link rel = "stylesheet" href = "../_static/custom.css" type = "text/css" / >
< meta name = "viewport" content = "width=device-width, initial-scale=0.9, maximum-scale=0.9" / >
< / head > < body >
< div class = "document" >
< div class = "documentwrapper" >
< div class = "bodywrapper" >
< div class = "body" role = "main" >
< div class = "sphx-glr-download-link-note admonition note" >
< p class = "admonition-title" > Note< / p >
< p > Click < a class = "reference internal" href = "#sphx-glr-download-auto-examples-plot-convert-pipeline-vectorizer-py" > < span class = "std std-ref" > here< / span > < / a > to download the full example code< / p >
< / div >
< div class = "sphx-glr-example-title section" id = "train-convert-and-predict-with-onnx-runtime" >
< span id = "sphx-glr-auto-examples-plot-convert-pipeline-vectorizer-py" > < / span > < h1 > Train, convert and predict with ONNX Runtime< a class = "headerlink" href = "#train-convert-and-predict-with-onnx-runtime" title = "Permalink to this headline" > ¶< / a > < / h1 >
< p > This example demonstrates an end to end scenario
starting with the training of a scikit-learn pipeline
which takes as inputs not a regular vector but a
dictionary < code class = "docutils literal notranslate" > < span class = "pre" > {< / span > < span class = "pre" > int:< / span > < span class = "pre" > float< / span > < span class = "pre" > }< / span > < / code > as its first step is a
< a class = "reference external" href = "http://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.DictVectorizer.html" > DictVectorizer< / a > .< / p >
< div class = "contents local topic" id = "contents" >
< ul class = "simple" >
< li > < p > < a class = "reference internal" href = "#train-a-pipeline" id = "id1" > Train a pipeline< / a > < / p > < / li >
< li > < p > < a class = "reference internal" href = "#conversion-to-onnx-format" id = "id2" > Conversion to ONNX format< / a > < / p > < / li >
< / ul >
< / div >
< div class = "section" id = "train-a-pipeline" >
< h2 > < a class = "toc-backref" href = "#id1" > Train a pipeline< / a > < a class = "headerlink" href = "#train-a-pipeline" title = "Permalink to this headline" > ¶< / a > < / h2 >
< p > The first step consists in retrieving the boston datset.< / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > import< / span > < span class = "nn" > pandas< / span >
< span class = "kn" > from< / span > < span class = "nn" > sklearn.datasets< / span > < span class = "kn" > import< / span > < span class = "n" > load_boston< / span >
< span class = "n" > boston< / span > < span class = "o" > =< / span > < span class = "n" > load_boston< / span > < span class = "p" > ()< / span >
< span class = "n" > X< / span > < span class = "p" > ,< / span > < span class = "n" > y< / span > < span class = "o" > =< / span > < span class = "n" > boston< / span > < span class = "o" > .< / span > < span class = "n" > data< / span > < span class = "p" > ,< / span > < span class = "n" > boston< / span > < span class = "o" > .< / span > < span class = "n" > target< / span >
< span class = "kn" > from< / span > < span class = "nn" > sklearn.model_selection< / span > < span class = "kn" > import< / span > < span class = "n" > train_test_split< / span >
< span class = "n" > X_train< / span > < span class = "p" > ,< / span > < span class = "n" > X_test< / span > < span class = "p" > ,< / span > < span class = "n" > y_train< / span > < span class = "p" > ,< / span > < span class = "n" > y_test< / span > < span class = "o" > =< / span > < span class = "n" > train_test_split< / span > < span class = "p" > (< / span > < span class = "n" > X< / span > < span class = "p" > ,< / span > < span class = "n" > y< / span > < span class = "p" > )< / span >
< span class = "n" > X_train_dict< / span > < span class = "o" > =< / span > < span class = "n" > pandas< / span > < span class = "o" > .< / span > < span class = "n" > DataFrame< / span > < span class = "p" > (< / span > < span class = "n" > X_train< / span > < span class = "p" > [:,< / span > < span class = "mi" > 1< / span > < span class = "p" > :])< / span > < span class = "o" > .< / span > < span class = "n" > T< / span > < span class = "o" > .< / span > < span class = "n" > to_dict< / span > < span class = "p" > ()< / span > < span class = "o" > .< / span > < span class = "n" > values< / span > < span class = "p" > ()< / span >
< span class = "n" > X_test_dict< / span > < span class = "o" > =< / span > < span class = "n" > pandas< / span > < span class = "o" > .< / span > < span class = "n" > DataFrame< / span > < span class = "p" > (< / span > < span class = "n" > X_test< / span > < span class = "p" > [:,< / span > < span class = "mi" > 1< / span > < span class = "p" > :])< / span > < span class = "o" > .< / span > < span class = "n" > T< / span > < span class = "o" > .< / span > < span class = "n" > to_dict< / span > < span class = "p" > ()< / span > < span class = "o" > .< / span > < span class = "n" > values< / span > < span class = "p" > ()< / span >
< / pre > < / div >
< / div >
< p > We create a pipeline.< / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > sklearn.pipeline< / span > < span class = "kn" > import< / span > < span class = "n" > make_pipeline< / span >
< span class = "kn" > from< / span > < span class = "nn" > sklearn.ensemble< / span > < span class = "kn" > import< / span > < span class = "n" > GradientBoostingRegressor< / span >
< span class = "kn" > from< / span > < span class = "nn" > sklearn.feature_extraction< / span > < span class = "kn" > import< / span > < span class = "n" > DictVectorizer< / span >
< span class = "n" > pipe< / span > < span class = "o" > =< / span > < span class = "n" > make_pipeline< / span > < span class = "p" > (< / span >
< span class = "n" > DictVectorizer< / span > < span class = "p" > (< / span > < span class = "n" > sparse< / span > < span class = "o" > =< / span > < span class = "bp" > False< / span > < span class = "p" > ),< / span >
< span class = "n" > GradientBoostingRegressor< / span > < span class = "p" > ())< / span >
< span class = "n" > pipe< / span > < span class = "o" > .< / span > < span class = "n" > fit< / span > < span class = "p" > (< / span > < span class = "n" > X_train_dict< / span > < span class = "p" > ,< / span > < span class = "n" > y_train< / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< p > We compute the prediction on the test set
and we show the confusion matrix.< / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > sklearn.metrics< / span > < span class = "kn" > import< / span > < span class = "n" > r2_score< / span >
< span class = "n" > pred< / span > < span class = "o" > =< / span > < span class = "n" > pipe< / span > < span class = "o" > .< / span > < span class = "n" > predict< / span > < span class = "p" > (< / span > < span class = "n" > X_test_dict< / span > < span class = "p" > )< / span >
< span class = "k" > print< / span > < span class = "p" > (< / span > < span class = "n" > r2_score< / span > < span class = "p" > (< / span > < span class = "n" > y_test< / span > < span class = "p" > ,< / span > < span class = "n" > pred< / span > < span class = "p" > ))< / span >
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
2020-04-06 22:52:48 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > 0.8417222124633904
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< / div >
< div class = "section" id = "conversion-to-onnx-format" >
< h2 > < a class = "toc-backref" href = "#id2" > Conversion to ONNX format< / a > < a class = "headerlink" href = "#conversion-to-onnx-format" title = "Permalink to this headline" > ¶< / a > < / h2 >
< p > We use module
< a class = "reference external" href = "https://github.com/onnx/sklearn-onnx" > sklearn-onnx< / a >
to convert the model into ONNX format.< / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > skl2onnx< / span > < span class = "kn" > import< / span > < span class = "n" > convert_sklearn< / span >
< span class = "kn" > from< / span > < span class = "nn" > skl2onnx.common.data_types< / span > < span class = "kn" > import< / span > < span class = "n" > FloatTensorType< / span > < span class = "p" > ,< / span > < span class = "n" > Int64TensorType< / span > < span class = "p" > ,< / span > < span class = "n" > DictionaryType< / span > < span class = "p" > ,< / span > < span class = "n" > SequenceType< / span >
< span class = "c1" > # initial_type = [(' float_input' , DictionaryType(Int64TensorType([1]), FloatTensorType([])))]< / span >
< span class = "n" > initial_type< / span > < span class = "o" > =< / span > < span class = "p" > [(< / span > < span class = "s1" > ' float_input' < / span > < span class = "p" > ,< / span > < span class = "n" > DictionaryType< / span > < span class = "p" > (< / span > < span class = "n" > Int64TensorType< / span > < span class = "p" > ([< / span > < span class = "mi" > 1< / span > < span class = "p" > ]),< / span > < span class = "n" > FloatTensorType< / span > < span class = "p" > ([])))]< / span >
< span class = "n" > onx< / span > < span class = "o" > =< / span > < span class = "n" > convert_sklearn< / span > < span class = "p" > (< / span > < span class = "n" > pipe< / span > < span class = "p" > ,< / span > < span class = "n" > initial_types< / span > < span class = "o" > =< / span > < span class = "n" > initial_type< / span > < span class = "p" > )< / span >
< span class = "k" > with< / span > < span class = "nb" > open< / span > < span class = "p" > (< / span > < span class = "s2" > " pipeline_vectorize.onnx" < / span > < span class = "p" > ,< / span > < span class = "s2" > " wb" < / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > f< / span > < span class = "p" > :< / span >
< span class = "n" > f< / span > < span class = "o" > .< / span > < span class = "n" > write< / span > < span class = "p" > (< / span > < span class = "n" > onx< / span > < span class = "o" > .< / span > < span class = "n" > SerializeToString< / span > < span class = "p" > ())< / span >
< / pre > < / div >
< / div >
< p > We load the model with ONNX Runtime and look at
its input and output.< / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > import< / span > < span class = "nn" > onnxruntime< / span > < span class = "kn" > as< / span > < span class = "nn" > rt< / span >
< span class = "kn" > from< / span > < span class = "nn" > onnxruntime.capi.onnxruntime_pybind11_state< / span > < span class = "kn" > import< / span > < span class = "n" > InvalidArgument< / span >
< span class = "n" > sess< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > InferenceSession< / span > < span class = "p" > (< / span > < span class = "s2" > " pipeline_vectorize.onnx" < / span > < span class = "p" > )< / span >
< span class = "kn" > import< / span > < span class = "nn" > numpy< / span >
< span class = "n" > inp< / span > < span class = "p" > ,< / span > < span class = "n" > out< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ],< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_outputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
< span class = "k" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " input name=' {}' and shape={} and type={}" < / span > < span class = "o" > .< / span > < span class = "n" > format< / span > < span class = "p" > (< / span > < span class = "n" > inp< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > ,< / span > < span class = "n" > inp< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > ,< / span > < span class = "n" > inp< / span > < span class = "o" > .< / span > < span class = "n" > type< / span > < span class = "p" > ))< / span >
< span class = "k" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " output name=' {}' and shape={} and type={}" < / span > < span class = "o" > .< / span > < span class = "n" > format< / span > < span class = "p" > (< / span > < span class = "n" > out< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > ,< / span > < span class = "n" > out< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > ,< / span > < span class = "n" > out< / span > < span class = "o" > .< / span > < span class = "n" > type< / span > < span class = "p" > ))< / span >
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > input name=' float_input' and shape=[] and type=map(int64,tensor(float))
output name=' variable1' and shape=[None, 1] and type=tensor(float)
< / pre > < / div >
< / div >
< p > We compute the predictions.
We could do that in one call:< / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "k" > try< / span > < span class = "p" > :< / span >
< span class = "n" > pred_onx< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > out< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > inp< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > :< / span > < span class = "n" > X_test_dict< / span > < span class = "p" > })[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
< span class = "k" > except< / span > < span class = "p" > (< / span > < span class = "ne" > RuntimeError< / span > < span class = "p" > ,< / span > < span class = "n" > InvalidArgument< / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > e< / span > < span class = "p" > :< / span >
< span class = "k" > print< / span > < span class = "p" > (< / span > < span class = "n" > e< / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [ONNXRuntimeError] : 2 : INVALID_ARGUMENT : Unexpected input data type. Actual: (class onnxruntime::SequenceType< class std::vector< class std::map< __int64,float,struct std::less< __int64> ,class std::allocator< struct std::pair< __int64 const ,float> > > ,class std::allocator< class std::map< __int64,float,struct std::less< __int64> ,class std::allocator< struct std::pair< __int64 const ,float> > > > > > ) , expected: (class onnxruntime::MapType< class std::map< __int64,float,struct std::less< __int64> ,class std::allocator< struct std::pair< __int64 const ,float> > > > )
< / pre > < / div >
< / div >
< p > But it fails because, in case of a DictVectorizer,
ONNX Runtime expects one observation at a time.< / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > pred_onx< / span > < span class = "o" > =< / span > < span class = "p" > [< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > out< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > inp< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > :< / span > < span class = "n" > row< / span > < span class = "p" > })[< / span > < span class = "mi" > 0< / span > < span class = "p" > ][< / span > < span class = "mi" > 0< / span > < span class = "p" > ,< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "k" > for< / span > < span class = "n" > row< / span > < span class = "ow" > in< / span > < span class = "n" > X_test_dict< / span > < span class = "p" > ]< / span >
< / pre > < / div >
< / div >
< p > We compare them to the model’ < / p >
< div class = "highlight-python notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "k" > print< / span > < span class = "p" > (< / span > < span class = "n" > r2_score< / span > < span class = "p" > (< / span > < span class = "n" > pred< / span > < span class = "p" > ,< / span > < span class = "n" > pred_onx< / span > < span class = "p" > ))< / span >
< / pre > < / div >
< / div >
< p class = "sphx-glr-script-out" > Out:< / p >
2020-04-06 22:52:48 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > 0.9999999999999309
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > Very similar. < em > ONNX Runtime< / em > uses floats instead of doubles,
that explains the small discrepencies.< / p >
2020-04-06 22:52:48 +00:00
< p > < strong > Total running time of the script:< / strong > ( 0 minutes 3.262 seconds)< / p >
2019-12-21 01:11:46 +00:00
< div class = "sphx-glr-footer class sphx-glr-footer-example docutils container" id = "sphx-glr-download-auto-examples-plot-convert-pipeline-vectorizer-py" >
< div class = "sphx-glr-download docutils container" >
< p > < a class = "reference download internal" download = "" href = "../_downloads/500c588edb4417e84924953b39d33cc6/plot_convert_pipeline_vectorizer.py" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Python< / span > < span class = "pre" > source< / span > < span class = "pre" > code:< / span > < span class = "pre" > plot_convert_pipeline_vectorizer.py< / span > < / code > < / a > < / p >
< / div >
< div class = "sphx-glr-download docutils container" >
< p > < a class = "reference download internal" download = "" href = "../_downloads/be7aeaf8b9b95af92780b5d952019035/plot_convert_pipeline_vectorizer.ipynb" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Jupyter< / span > < span class = "pre" > notebook:< / span > < span class = "pre" > plot_convert_pipeline_vectorizer.ipynb< / span > < / code > < / a > < / p >
< / div >
< / div >
< p class = "sphx-glr-signature" > < a class = "reference external" href = "https://sphinx-gallery.readthedocs.io" > Gallery generated by Sphinx-Gallery< / a > < / p >
< / div >
< / div >
< / div >
< / div >
< / div >
< div class = "sphinxsidebar" role = "navigation" aria-label = "main navigation" >
< div class = "sphinxsidebarwrapper" >
< p class = "logo" > < a href = "../index.html" >
< img class = "logo" src = "../_static/ONNX_Runtime_icon.png" alt = "Logo" / >
< / a > < / p >
< h1 class = "logo" > < a href = "../index.html" > ONNX Runtime< / a > < / h1 >
< h3 > Navigation< / h3 >
2020-04-06 22:52:48 +00:00
< ul >
2019-12-21 01:11:46 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "../tutorial.html" > Tutorial< / a > < / li >
< li class = "toctree-l1" > < a class = "reference internal" href = "../api_summary.html" > API Summary< / a > < / li >
2020-04-06 22:52:48 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "index.html" > Gallery of examples< / a > < / li >
2019-12-21 01:11:46 +00:00
< / ul >
< div class = "relations" >
< h3 > Related Topics< / h3 >
< ul >
< li > < a href = "../index.html" > Documentation overview< / a > < ul >
< li > < a href = "index.html" > Gallery of examples< / a > < ul >
< li > Previous: < a href = "plot_dl_keras.html" title = "previous chapter" > ONNX Runtime for Keras< / a > < / li >
< li > Next: < a href = "plot_common_errors.html" title = "next chapter" > Common errors with onnxruntime< / a > < / li >
< / ul > < / li >
< / ul > < / li >
< / ul >
< / div >
< div id = "searchbox" style = "display: none" role = "search" >
< h3 id = "searchlabel" > Quick search< / h3 >
< div class = "searchformwrapper" >
< form class = "search" action = "../search.html" method = "get" >
< input type = "text" name = "q" aria-labelledby = "searchlabel" / >
< input type = "submit" value = "Go" / >
< / form >
< / div >
< / div >
< script type = "text/javascript" > $ ( '#searchbox' ) . show ( 0 ) ; < / script >
2020-04-06 22:52:48 +00:00
2019-12-21 01:11:46 +00:00
< / div >
< / div >
< div class = "clearer" > < / div >
< / div >
< div class = "footer" >
© 2018-2019, Microsoft.
|
2020-04-06 22:52:48 +00:00
Powered by < a href = "http://sphinx-doc.org/" > Sphinx 2.2.1< / a >
& < a href = "https://github.com/bitprophet/alabaster" > Alabaster 0.7.12< / a >
2019-12-21 01:11:46 +00:00
|
< a href = "../_sources/auto_examples/plot_convert_pipeline_vectorizer.rst.txt"
rel="nofollow">Page source< / a >
< / div >
< / body >
< / html >
