2019-12-21 01:11:46 +00:00
<!DOCTYPE html>
2020-08-13 02:12:50 +00:00
< html lang = "en" >
2019-12-21 01:11:46 +00:00
< head >
< meta charset = "utf-8" / >
2022-01-04 17:32:40 +00:00
< meta name = "viewport" content = "width=device-width, initial-scale=1.0" / > < meta name = "generator" content = "Docutils 0.17.1: http://docutils.sourceforge.net/" / >
2022-08-03 17:24:42 +00:00
< title > Train, convert and predict with ONNX Runtime — ONNX Runtime 1.13.0 documentation< / title >
2022-01-04 17:32:40 +00:00
< link rel = "stylesheet" type = "text/css" href = "../static/pygments.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/alabaster.css" / >
2021-02-11 00:34:31 +00:00
< link rel = "stylesheet" type = "text/css" href = "../static/graphviz.css" / >
2022-01-04 17:32:40 +00:00
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery-binder.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery-dataframe.css" / >
< link rel = "stylesheet" type = "text/css" href = "../static/sg_gallery-rendered-html.css" / >
< script data-url_root = "../" id = "documentation_options" src = "../static/documentation_options.js" > < / script >
2021-02-11 00:34:31 +00:00
< script src = "../static/jquery.js" > < / script >
< script src = "../static/underscore.js" > < / script >
2022-08-03 17:24:42 +00:00
< script src = "../static/_sphinx_javascript_frameworks_compat.js" > < / script >
2021-02-11 00:34:31 +00:00
< script src = "../static/doctools.js" > < / script >
2019-12-21 01:11:46 +00:00
< link rel = "index" title = "Index" href = "../genindex.html" / >
< link rel = "search" title = "Search" href = "../search.html" / >
< link rel = "prev" title = "Common errors with onnxruntime" href = "plot_common_errors.html" / >
2021-02-11 00:34:31 +00:00
< link rel = "stylesheet" href = "../static/custom.css" type = "text/css" / >
2019-12-21 01:11:46 +00:00
< meta name = "viewport" content = "width=device-width, initial-scale=0.9, maximum-scale=0.9" / >
< / head > < body >
< div class = "document" >
< div class = "documentwrapper" >
< div class = "bodywrapper" >
< div class = "body" role = "main" >
< div class = "sphx-glr-download-link-note admonition note" >
< p class = "admonition-title" > Note< / p >
2021-03-09 18:21:38 +00:00
< p > Click < a class = "reference internal" href = "#sphx-glr-download-auto-examples-plot-train-convert-predict-py" > < span class = "std std-ref" > here< / span > < / a >
to download the full example code< / p >
2019-12-21 01:11:46 +00:00
< / div >
2022-01-04 17:32:40 +00:00
< section class = "sphx-glr-example-title" id = "train-convert-and-predict-with-onnx-runtime" >
2022-08-03 17:24:42 +00:00
< span id = "l-logreg-example" > < / span > < span id = "sphx-glr-auto-examples-plot-train-convert-predict-py" > < / span > < h1 > Train, convert and predict with ONNX Runtime< a class = "headerlink" href = "#train-convert-and-predict-with-onnx-runtime" title = "Permalink to this heading" > ¶< / a > < / h1 >
2019-12-21 01:11:46 +00:00
< p > This example demonstrates an end to end scenario
starting with the training of a machine learned model
to its use in its converted from.< / p >
< div class = "contents local topic" id = "contents" >
< ul class = "simple" >
< li > < p > < a class = "reference internal" href = "#train-a-logistic-regression" id = "id1" > Train a logistic regression< / a > < / p > < / li >
< li > < p > < a class = "reference internal" href = "#conversion-to-onnx-format" id = "id2" > Conversion to ONNX format< / a > < / p > < / li >
< li > < p > < a class = "reference internal" href = "#probabilities" id = "id3" > Probabilities< / a > < / p > < / li >
< li > < p > < a class = "reference internal" href = "#benchmark-with-randomforest" id = "id4" > Benchmark with RandomForest< / a > < / p > < / li >
< / ul >
< / div >
2022-01-04 17:32:40 +00:00
< section id = "train-a-logistic-regression" >
2022-08-03 17:24:42 +00:00
< h2 > < a class = "toc-backref" href = "#id1" > Train a logistic regression< / a > < a class = "headerlink" href = "#train-a-logistic-regression" title = "Permalink to this heading" > ¶< / a > < / h2 >
2019-12-21 01:11:46 +00:00
< p > The first step consists in retrieving the iris datset.< / p >
2022-01-04 17:32:40 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > sklearn.datasets< / span > < span class = "k" > import< / span > < span class = "n" > load_iris< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > iris< / span > < span class = "o" > =< / span > < span class = "n" > load_iris< / span > < span class = "p" > ()< / span >
< span class = "n" > X< / span > < span class = "p" > ,< / span > < span class = "n" > y< / span > < span class = "o" > =< / span > < span class = "n" > iris< / span > < span class = "o" > .< / span > < span class = "n" > data< / span > < span class = "p" > ,< / span > < span class = "n" > iris< / span > < span class = "o" > .< / span > < span class = "n" > target< / span >
2022-01-04 17:32:40 +00:00
< span class = "kn" > from< / span > < span class = "nn" > sklearn.model_selection< / span > < span class = "k" > import< / span > < span class = "n" > train_test_split< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > X_train< / span > < span class = "p" > ,< / span > < span class = "n" > X_test< / span > < span class = "p" > ,< / span > < span class = "n" > y_train< / span > < span class = "p" > ,< / span > < span class = "n" > y_test< / span > < span class = "o" > =< / span > < span class = "n" > train_test_split< / span > < span class = "p" > (< / span > < span class = "n" > X< / span > < span class = "p" > ,< / span > < span class = "n" > y< / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< p > Then we fit a model.< / p >
2022-01-04 17:32:40 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > sklearn.linear_model< / span > < span class = "k" > import< / span > < span class = "n" > LogisticRegression< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > clr< / span > < span class = "o" > =< / span > < span class = "n" > LogisticRegression< / span > < span class = "p" > ()< / span >
< span class = "n" > clr< / span > < span class = "o" > .< / span > < span class = "n" > fit< / span > < span class = "p" > (< / span > < span class = "n" > X_train< / span > < span class = "p" > ,< / span > < span class = "n" > y_train< / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
2022-08-03 17:24:42 +00:00
< div class = "output_subarea output_html rendered_html output_result" >
< style > # sk-container-id-2 { color : black ; background-color : white ; } # sk-container-id-2 pre { padding : 0 ; } # sk-container-id-2 div . sk-toggleable { background-color : white ; } # sk-container-id-2 label . sk-toggleable__label { cursor : pointer ; display : block ; width : 100 % ; margin-bottom : 0 ; padding : 0.3 em ; box-sizing : border-box ; text-align : center ; } # sk-container-id-2 label . sk-toggleable__label-arrow : before { content : "▸" ; float : left ; margin-right : 0.25 em ; color : #696969 ; } # sk-container-id-2 label . sk-toggleable__label-arrow : hover : before { color : black ; } # sk-container-id-2 div . sk-estimator : hover label . sk-toggleable__label-arrow : before { color : black ; } # sk-container-id-2 div . sk-toggleable__content { max-height : 0 ; max-width : 0 ; overflow : hidden ; text-align : left ; background-color : #f0f8ff ; } # sk-container-id-2 div . sk-toggleable__content pre { margin : 0.2 em ; color : black ; border-radius : 0.25 em ; background-color : #f0f8ff ; } # sk-container-id-2 input . sk-toggleable__control : checked ~ div . sk-toggleable__content { max-height : 200 px ; max-width : 100 % ; overflow : auto ; } # sk-container-id-2 input . sk-toggleable__control : checked ~ label . sk-toggleable__label-arrow : before { content : "▾" ; } # sk-container-id-2 div . sk-estimator input . sk-toggleable__control : checked ~ label . sk-toggleable__label { background-color : #d4ebff ; } # sk-container-id-2 div . sk-label input . sk-toggleable__control : checked ~ label . sk-toggleable__label { background-color : #d4ebff ; } # sk-container-id-2 input . sk-hidden--visually { border : 0 ; clip : rect ( 1 px 1 px 1 px 1 px ) ; clip : rect ( 1 px , 1 px , 1 px , 1 px ) ; height : 1 px ; margin : -1 px ; overflow : hidden ; padding : 0 ; position : absolute ; width : 1 px ; } # sk-container-id-2 div . sk-estimator { font-family : monospace ; background-color : #f0f8ff ; border : 1 px dotted black ; border-radius : 0.25 em ; box-sizing : border-box ; margin-bottom : 0.5 em ; } # sk-container-id-2 div . sk-estimator : hover { background-color : #d4ebff ; } # sk-container-id-2 div . sk-parallel-item :: after { content : "" ; width : 100 % ; border-bottom : 1 px solid gray ; flex-grow : 1 ; } # sk-container-id-2 div . sk-label : hover label . sk-toggleable__label { background-color : #d4ebff ; } # sk-container-id-2 div . sk-serial :: before { content : "" ; position : absolute ; border-left : 1 px solid gray ; box-sizing : border-box ; top : 0 ; bottom : 0 ; left : 50 % ; z-index : 0 ; } # sk-container-id-2 div . sk-serial { display : flex ; flex-direction : column ; align-items : center ; background-color : white ; padding-right : 0.2 em ; padding-left : 0.2 em ; position : relative ; } # sk-container-id-2 div . sk-item { position : relative ; z-index : 1 ; } # sk-container-id-2 div . sk-parallel { display : flex ; align-items : stretch ; justify-content : center ; background-color : white ; position : relative ; } # sk-container-id-2 div . sk-item :: before , # sk-container-id-2 div . sk-parallel-item :: before { content : "" ; position : absolute ; border-left : 1 px solid gray ; box-sizing : border-box ; top : 0 ; bottom : 0 ; left : 50 % ; z-index : -1 ; } # sk-container-id-2 div . sk-parallel-item { display : flex ; flex-direction : column ; z-index : 1 ; position : relative ; background-color : white ; } # sk-container-id-2 div . sk-parallel-item : first-child :: after { align-self : flex-end ; width : 50 % ; } # sk-container-id-2 div . sk-parallel-item : last-child :: after { align-self : flex-start ; width : 50 % ; } # sk-container-id-2 div . sk-parallel-item : only-child :: after { width : 0 ; } # sk-container-id-2 div . sk-dashed-wrapped { border : 1 px dashed gray ; margin : 0 0.4 em 0.5 em 0.4 em ; box-sizing : border-box ; padding-bottom : 0.4 em ; background-color : white ; } # sk-container-id-2 div . sk-label label { font-family : monospace ; font-weight : bold ; display : inline-block ; line-height : 1.2 em ; } # sk-container-id-2 div . sk-label-container { text-align : center ; } # sk-container-id-2 div . sk-container { /* jupyter's `normalize.less` sets `[hidden] { display: none; }` but bootstrap.min.css set `[hidden] { display: none !important; }` so we also need the `!important` here to be able to override the default hidden behavior on the sphinx rendered scikit-learn.org. See: https://github.com/scikit-learn/scikit-learn/issues/21755 */ display : inline-block !important ; position : relative ; } # sk-container-id-2 div . sk-text-repr-fallback { display : none ; } < / style > < div id = "sk-container-id-2" class = "sk-top-container" > < div class = "sk-text-
< / div >
< br / >
< br / > < p > We compute the prediction on the test set
2019-12-21 01:11:46 +00:00
and we show the confusion matrix.< / p >
2022-01-04 17:32:40 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > sklearn.metrics< / span > < span class = "k" > import< / span > < span class = "n" > confusion_matrix< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > pred< / span > < span class = "o" > =< / span > < span class = "n" > clr< / span > < span class = "o" > .< / span > < span class = "n" > predict< / span > < span class = "p" > (< / span > < span class = "n" > X_test< / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > confusion_matrix< / span > < span class = "p" > (< / span > < span class = "n" > y_test< / span > < span class = "p" > ,< / span > < span class = "n" > pred< / span > < span class = "p" > ))< / span >
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
2022-08-03 17:24:42 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [[13 0 0]
2022-08-04 20:43:40 +00:00
[ 0 11 2]
[ 0 0 12]]
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
2022-01-04 17:32:40 +00:00
< / section >
< section id = "conversion-to-onnx-format" >
2022-08-03 17:24:42 +00:00
< h2 > < a class = "toc-backref" href = "#id2" > Conversion to ONNX format< / a > < a class = "headerlink" href = "#conversion-to-onnx-format" title = "Permalink to this heading" > ¶< / a > < / h2 >
2019-12-21 01:11:46 +00:00
< p > We use module
< a class = "reference external" href = "https://github.com/onnx/sklearn-onnx" > sklearn-onnx< / a >
to convert the model into ONNX format.< / p >
2022-01-04 17:32:40 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > skl2onnx< / span > < span class = "k" > import< / span > < span class = "n" > convert_sklearn< / span >
< span class = "kn" > from< / span > < span class = "nn" > skl2onnx.common.data_types< / span > < span class = "k" > import< / span > < span class = "n" > FloatTensorType< / span >
2019-12-21 01:11:46 +00:00
2022-08-03 17:24:42 +00:00
< span class = "n" > initial_type< / span > < span class = "o" > =< / span > < span class = "p" > [(< / span > < span class = "s2" > " float_input" < / span > < span class = "p" > ,< / span > < span class = "n" > FloatTensorType< / span > < span class = "p" > ([< / span > < span class = "kc" > None< / span > < span class = "p" > ,< / span > < span class = "mi" > 4< / span > < span class = "p" > ]))]< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > onx< / span > < span class = "o" > =< / span > < span class = "n" > convert_sklearn< / span > < span class = "p" > (< / span > < span class = "n" > clr< / span > < span class = "p" > ,< / span > < span class = "n" > initial_types< / span > < span class = "o" > =< / span > < span class = "n" > initial_type< / span > < span class = "p" > )< / span >
< span class = "k" > with< / span > < span class = "nb" > open< / span > < span class = "p" > (< / span > < span class = "s2" > " logreg_iris.onnx" < / span > < span class = "p" > ,< / span > < span class = "s2" > " wb" < / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > f< / span > < span class = "p" > :< / span >
< span class = "n" > f< / span > < span class = "o" > .< / span > < span class = "n" > write< / span > < span class = "p" > (< / span > < span class = "n" > onx< / span > < span class = "o" > .< / span > < span class = "n" > SerializeToString< / span > < span class = "p" > ())< / span >
< / pre > < / div >
< / div >
< p > We load the model with ONNX Runtime and look at
its input and output.< / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > import< / span > < span class = "nn" > onnxruntime< / span > < span class = "k" > as< / span > < span class = "nn" > rt< / span >
2022-08-03 17:24:42 +00:00
2022-01-04 17:32:40 +00:00
< span class = "n" > sess< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > InferenceSession< / span > < span class = "p" > (< / span > < span class = "s2" > " logreg_iris.onnx" < / span > < span class = "p" > ,< / span > < span class = "n" > providers< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > get_available_providers< / span > < span class = "p" > ())< / span >
2019-12-21 01:11:46 +00:00
2022-08-03 17:24:42 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " input name=' < / span > < span class = "si" > {}< / span > < span class = "s2" > ' and shape=< / span > < span class = "si" > {}< / span > < span class = "s2" > " < / span > < span class = "o" > .< / span > < span class = "n" > format< / span > < span class = "p" > (< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > ,< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > ))< / span >
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " output name=' < / span > < span class = "si" > {}< / span > < span class = "s2" > ' and shape=< / span > < span class = "si" > {}< / span > < span class = "s2" > " < / span > < span class = "o" > .< / span > < span class = "n" > format< / span > < span class = "p" > (< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_outputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span > < span class = "p" > ,< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_outputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > ))< / span >
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > input name=' float_input' and shape=[None, 4]
2020-08-13 02:12:50 +00:00
output name=' output_label' and shape=[None]
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > We compute the predictions.< / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > input_name< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_inputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > label_name< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_outputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span >
< span class = "kn" > import< / span > < span class = "nn" > numpy< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > pred_onx< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > label_name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > X_test< / span > < span class = "o" > .< / span > < span class = "n" > astype< / span > < span class = "p" > (< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )})[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > confusion_matrix< / span > < span class = "p" > (< / span > < span class = "n" > pred< / span > < span class = "p" > ,< / span > < span class = "n" > pred_onx< / span > < span class = "p" > ))< / span >
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
2022-08-03 17:24:42 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [[13 0 0]
2022-08-04 20:43:40 +00:00
[ 0 11 0]
[ 0 0 14]]
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > The prediction are perfectly identical.< / p >
2022-01-04 17:32:40 +00:00
< / section >
< section id = "probabilities" >
2022-08-03 17:24:42 +00:00
< h2 > < a class = "toc-backref" href = "#id3" > Probabilities< / a > < a class = "headerlink" href = "#probabilities" title = "Permalink to this heading" > ¶< / a > < / h2 >
2019-12-21 01:11:46 +00:00
< p > Probabilities are needed to compute other
relevant metrics such as the ROC Curve.
Let’
scikit-learn.< / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > prob_sklearn< / span > < span class = "o" > =< / span > < span class = "n" > clr< / span > < span class = "o" > .< / span > < span class = "n" > predict_proba< / span > < span class = "p" > (< / span > < span class = "n" > X_test< / span > < span class = "p" > )< / span >
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > prob_sklearn< / span > < span class = "p" > [:< / span > < span class = "mi" > 3< / span > < span class = "p" > ])< / span >
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
2022-08-04 20:43:40 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [[9.60244512e-02 8.88242228e-01 1.57333213e-02]
[2.71799658e-02 9.10234192e-01 6.25858422e-02]
[9.45106278e-01 5.48934527e-02 2.69394014e-07]]
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > And then with ONNX Runtime.
The probabilies appear to be< / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > prob_name< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > get_outputs< / span > < span class = "p" > ()[< / span > < span class = "mi" > 1< / span > < span class = "p" > ]< / span > < span class = "o" > .< / span > < span class = "n" > name< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > prob_rt< / span > < span class = "o" > =< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > prob_name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > X_test< / span > < span class = "o" > .< / span > < span class = "n" > astype< / span > < span class = "p" > (< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )})[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
< span class = "kn" > import< / span > < span class = "nn" > pprint< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > pprint< / span > < span class = "o" > .< / span > < span class = "n" > pprint< / span > < span class = "p" > (< / span > < span class = "n" > prob_rt< / span > < span class = "p" > [< / span > < span class = "mi" > 0< / span > < span class = "p" > :< / span > < span class = "mi" > 3< / span > < span class = "p" > ])< / span >
< / pre > < / div >
< / div >
2022-08-04 20:43:40 +00:00
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > [{0: 0.09602457284927368, 1: 0.8882421851158142, 2: 0.015733299776911736},
{0: 0.027180003002285957, 1: 0.9102342128753662, 2: 0.06258579343557358},
{0: 0.9451063275337219, 1: 0.05489342659711838, 2: 2.693937801723223e-07}]
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > Let’ < / p >
2022-01-04 17:32:40 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > timeit< / span > < span class = "k" > import< / span > < span class = "n" > Timer< / span >
2019-12-21 01:11:46 +00:00
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "k" > def< / span > < span class = "nf" > speed< / span > < span class = "p" > (< / span > < span class = "n" > inst< / span > < span class = "p" > ,< / span > < span class = "n" > number< / span > < span class = "o" > =< / span > < span class = "mi" > 10< / span > < span class = "p" > ,< / span > < span class = "n" > repeat< / span > < span class = "o" > =< / span > < span class = "mi" > 20< / span > < span class = "p" > ):< / span >
< span class = "n" > timer< / span > < span class = "o" > =< / span > < span class = "n" > Timer< / span > < span class = "p" > (< / span > < span class = "n" > inst< / span > < span class = "p" > ,< / span > < span class = "nb" > globals< / span > < span class = "o" > =< / span > < span class = "nb" > globals< / span > < span class = "p" > ())< / span >
< span class = "n" > raw< / span > < span class = "o" > =< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > array< / span > < span class = "p" > (< / span > < span class = "n" > timer< / span > < span class = "o" > .< / span > < span class = "n" > repeat< / span > < span class = "p" > (< / span > < span class = "n" > repeat< / span > < span class = "p" > ,< / span > < span class = "n" > number< / span > < span class = "o" > =< / span > < span class = "n" > number< / span > < span class = "p" > ))< / span >
< span class = "n" > ave< / span > < span class = "o" > =< / span > < span class = "n" > raw< / span > < span class = "o" > .< / span > < span class = "n" > sum< / span > < span class = "p" > ()< / span > < span class = "o" > /< / span > < span class = "nb" > len< / span > < span class = "p" > (< / span > < span class = "n" > raw< / span > < span class = "p" > )< / span > < span class = "o" > /< / span > < span class = "n" > number< / span >
< span class = "n" > mi< / span > < span class = "p" > ,< / span > < span class = "n" > ma< / span > < span class = "o" > =< / span > < span class = "n" > raw< / span > < span class = "o" > .< / span > < span class = "n" > min< / span > < span class = "p" > ()< / span > < span class = "o" > /< / span > < span class = "n" > number< / span > < span class = "p" > ,< / span > < span class = "n" > raw< / span > < span class = "o" > .< / span > < span class = "n" > max< / span > < span class = "p" > ()< / span > < span class = "o" > /< / span > < span class = "n" > number< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Average < / span > < span class = "si" > %1.3g< / span > < span class = "s2" > min=< / span > < span class = "si" > %1.3g< / span > < span class = "s2" > max=< / span > < span class = "si" > %1.3g< / span > < span class = "s2" > " < / span > < span class = "o" > %< / span > < span class = "p" > (< / span > < span class = "n" > ave< / span > < span class = "p" > ,< / span > < span class = "n" > mi< / span > < span class = "p" > ,< / span > < span class = "n" > ma< / span > < span class = "p" > ))< / span >
2019-12-21 01:11:46 +00:00
< span class = "k" > return< / span > < span class = "n" > ave< / span >
2022-08-03 17:24:42 +00:00
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for clr.predict" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " clr.predict(X_test)" < / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for ONNX Runtime" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " sess.run([label_name], {input_name: X_test.astype(numpy.float32)})[0]" < / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > Execution time for clr.predict
2022-08-04 20:43:40 +00:00
Average 8.66e-05 min=7.56e-05 max=0.000104
2019-12-21 01:11:46 +00:00
Execution time for ONNX Runtime
2022-08-04 20:43:40 +00:00
Average 2.74e-05 min=2.42e-05 max=3.36e-05
2020-08-13 02:12:50 +00:00
2022-08-04 20:43:40 +00:00
2.7374654999903216e-05
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > Let’
experiences: the model has to do one prediction at a time
as opposed to a batch of prediction.< / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "k" > def< / span > < span class = "nf" > loop< / span > < span class = "p" > (< / span > < span class = "n" > X_test< / span > < span class = "p" > ,< / span > < span class = "n" > fct< / span > < span class = "p" > ,< / span > < span class = "n" > n< / span > < span class = "o" > =< / span > < span class = "kc" > None< / span > < span class = "p" > ):< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > nrow< / span > < span class = "o" > =< / span > < span class = "n" > X_test< / span > < span class = "o" > .< / span > < span class = "n" > shape< / span > < span class = "p" > [< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
2020-08-13 02:12:50 +00:00
< span class = "k" > if< / span > < span class = "n" > n< / span > < span class = "ow" > is< / span > < span class = "kc" > None< / span > < span class = "p" > :< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > n< / span > < span class = "o" > =< / span > < span class = "n" > nrow< / span >
< span class = "k" > for< / span > < span class = "n" > i< / span > < span class = "ow" > in< / span > < span class = "nb" > range< / span > < span class = "p" > (< / span > < span class = "mi" > 0< / span > < span class = "p" > ,< / span > < span class = "n" > n< / span > < span class = "p" > ):< / span >
< span class = "n" > im< / span > < span class = "o" > =< / span > < span class = "n" > i< / span > < span class = "o" > %< / span > < span class = "n" > nrow< / span >
2022-08-03 17:24:42 +00:00
< span class = "n" > fct< / span > < span class = "p" > (< / span > < span class = "n" > X_test< / span > < span class = "p" > [< / span > < span class = "n" > im< / span > < span class = "p" > :< / span > < span class = "n" > im< / span > < span class = "o" > +< / span > < span class = "mi" > 1< / span > < span class = "p" > ])< / span >
2019-12-21 01:11:46 +00:00
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for clr.predict" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, clr.predict, 100)" < / span > < span class = "p" > )< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "k" > def< / span > < span class = "nf" > sess_predict< / span > < span class = "p" > (< / span > < span class = "n" > x< / span > < span class = "p" > ):< / span >
< span class = "k" > return< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > label_name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > x< / span > < span class = "o" > .< / span > < span class = "n" > astype< / span > < span class = "p" > (< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )})[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
2022-08-03 17:24:42 +00:00
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for sess_predict" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, sess_predict, 100)" < / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > Execution time for clr.predict
2022-08-04 20:43:40 +00:00
Average 0.00817 min=0.00748 max=0.00911
2019-12-21 01:11:46 +00:00
Execution time for sess_predict
2022-08-04 20:43:40 +00:00
Average 0.00152 min=0.00143 max=0.00175
2020-08-13 02:12:50 +00:00
2022-08-04 20:43:40 +00:00
0.0015233170999999857
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for predict_proba" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, clr.predict_proba, 100)" < / span > < span class = "p" > )< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "k" > def< / span > < span class = "nf" > sess_predict_proba< / span > < span class = "p" > (< / span > < span class = "n" > x< / span > < span class = "p" > ):< / span >
< span class = "k" > return< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > prob_name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > x< / span > < span class = "o" > .< / span > < span class = "n" > astype< / span > < span class = "p" > (< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )})[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
2022-08-03 17:24:42 +00:00
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for sess_predict_proba" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, sess_predict_proba, 100)" < / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > Execution time for predict_proba
2022-08-04 20:43:40 +00:00
Average 0.0115 min=0.011 max=0.0136
2019-12-21 01:11:46 +00:00
Execution time for sess_predict_proba
2022-08-04 20:43:40 +00:00
Average 0.0016 min=0.00147 max=0.00227
2020-08-13 02:12:50 +00:00
2022-08-04 20:43:40 +00:00
0.0015962060200003236
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > This second comparison is better as
ONNX Runtime, in this experience,
computes the label and the probabilities
in every case.< / p >
2022-01-04 17:32:40 +00:00
< / section >
< section id = "benchmark-with-randomforest" >
2022-08-03 17:24:42 +00:00
< h2 > < a class = "toc-backref" href = "#id4" > Benchmark with RandomForest< / a > < a class = "headerlink" href = "#benchmark-with-randomforest" title = "Permalink to this heading" > ¶< / a > < / h2 >
2019-12-21 01:11:46 +00:00
< p > We first train and save a model in ONNX format.< / p >
2022-01-04 17:32:40 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "kn" > from< / span > < span class = "nn" > sklearn.ensemble< / span > < span class = "k" > import< / span > < span class = "n" > RandomForestClassifier< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > rf< / span > < span class = "o" > =< / span > < span class = "n" > RandomForestClassifier< / span > < span class = "p" > ()< / span >
< span class = "n" > rf< / span > < span class = "o" > .< / span > < span class = "n" > fit< / span > < span class = "p" > (< / span > < span class = "n" > X_train< / span > < span class = "p" > ,< / span > < span class = "n" > y_train< / span > < span class = "p" > )< / span >
2022-08-03 17:24:42 +00:00
< span class = "n" > initial_type< / span > < span class = "o" > =< / span > < span class = "p" > [(< / span > < span class = "s2" > " float_input" < / span > < span class = "p" > ,< / span > < span class = "n" > FloatTensorType< / span > < span class = "p" > ([< / span > < span class = "mi" > 1< / span > < span class = "p" > ,< / span > < span class = "mi" > 4< / span > < span class = "p" > ]))]< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > onx< / span > < span class = "o" > =< / span > < span class = "n" > convert_sklearn< / span > < span class = "p" > (< / span > < span class = "n" > rf< / span > < span class = "p" > ,< / span > < span class = "n" > initial_types< / span > < span class = "o" > =< / span > < span class = "n" > initial_type< / span > < span class = "p" > )< / span >
< span class = "k" > with< / span > < span class = "nb" > open< / span > < span class = "p" > (< / span > < span class = "s2" > " rf_iris.onnx" < / span > < span class = "p" > ,< / span > < span class = "s2" > " wb" < / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > f< / span > < span class = "p" > :< / span >
< span class = "n" > f< / span > < span class = "o" > .< / span > < span class = "n" > write< / span > < span class = "p" > (< / span > < span class = "n" > onx< / span > < span class = "o" > .< / span > < span class = "n" > SerializeToString< / span > < span class = "p" > ())< / span >
< / pre > < / div >
< / div >
< p > We compare.< / p >
2022-01-04 17:32:40 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > sess< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > InferenceSession< / span > < span class = "p" > (< / span > < span class = "s2" > " rf_iris.onnx" < / span > < span class = "p" > ,< / span > < span class = "n" > providers< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > get_available_providers< / span > < span class = "p" > ())< / span >
2019-12-21 01:11:46 +00:00
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "k" > def< / span > < span class = "nf" > sess_predict_proba_rf< / span > < span class = "p" > (< / span > < span class = "n" > x< / span > < span class = "p" > ):< / span >
< span class = "k" > return< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > prob_name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > x< / span > < span class = "o" > .< / span > < span class = "n" > astype< / span > < span class = "p" > (< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )})[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
2022-08-03 17:24:42 +00:00
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for predict_proba" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, rf.predict_proba, 100)" < / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "s2" > " Execution time for sess_predict_proba" < / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, sess_predict_proba_rf, 100)" < / span > < span class = "p" > )< / span >
< / pre > < / div >
< / div >
< div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > Execution time for predict_proba
2022-08-04 20:43:40 +00:00
Average 1.31 min=1.29 max=1.33
2019-12-21 01:11:46 +00:00
Execution time for sess_predict_proba
2022-08-04 20:43:40 +00:00
Average 0.0022 min=0.00198 max=0.00278
2020-08-13 02:12:50 +00:00
2022-08-04 20:43:40 +00:00
0.002198638819999985
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
< p > Let’ < / p >
2020-08-13 02:12:50 +00:00
< div class = "highlight-default notranslate" > < div class = "highlight" > < pre > < span > < / span > < span class = "n" > measures< / span > < span class = "o" > =< / span > < span class = "p" > []< / span >
2019-12-21 01:11:46 +00:00
< span class = "k" > for< / span > < span class = "n" > n_trees< / span > < span class = "ow" > in< / span > < span class = "nb" > range< / span > < span class = "p" > (< / span > < span class = "mi" > 5< / span > < span class = "p" > ,< / span > < span class = "mi" > 51< / span > < span class = "p" > ,< / span > < span class = "mi" > 5< / span > < span class = "p" > ):< / span >
2020-08-13 02:12:50 +00:00
< span class = "nb" > print< / span > < span class = "p" > (< / span > < span class = "n" > n_trees< / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > rf< / span > < span class = "o" > =< / span > < span class = "n" > RandomForestClassifier< / span > < span class = "p" > (< / span > < span class = "n" > n_estimators< / span > < span class = "o" > =< / span > < span class = "n" > n_trees< / span > < span class = "p" > )< / span >
< span class = "n" > rf< / span > < span class = "o" > .< / span > < span class = "n" > fit< / span > < span class = "p" > (< / span > < span class = "n" > X_train< / span > < span class = "p" > ,< / span > < span class = "n" > y_train< / span > < span class = "p" > )< / span >
2022-08-03 17:24:42 +00:00
< span class = "n" > initial_type< / span > < span class = "o" > =< / span > < span class = "p" > [(< / span > < span class = "s2" > " float_input" < / span > < span class = "p" > ,< / span > < span class = "n" > FloatTensorType< / span > < span class = "p" > ([< / span > < span class = "mi" > 1< / span > < span class = "p" > ,< / span > < span class = "mi" > 4< / span > < span class = "p" > ]))]< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > onx< / span > < span class = "o" > =< / span > < span class = "n" > convert_sklearn< / span > < span class = "p" > (< / span > < span class = "n" > rf< / span > < span class = "p" > ,< / span > < span class = "n" > initial_types< / span > < span class = "o" > =< / span > < span class = "n" > initial_type< / span > < span class = "p" > )< / span >
< span class = "k" > with< / span > < span class = "nb" > open< / span > < span class = "p" > (< / span > < span class = "s2" > " rf_iris_< / span > < span class = "si" > %d< / span > < span class = "s2" > .onnx" < / span > < span class = "o" > %< / span > < span class = "n" > n_trees< / span > < span class = "p" > ,< / span > < span class = "s2" > " wb" < / span > < span class = "p" > )< / span > < span class = "k" > as< / span > < span class = "n" > f< / span > < span class = "p" > :< / span >
< span class = "n" > f< / span > < span class = "o" > .< / span > < span class = "n" > write< / span > < span class = "p" > (< / span > < span class = "n" > onx< / span > < span class = "o" > .< / span > < span class = "n" > SerializeToString< / span > < span class = "p" > ())< / span >
2022-01-04 17:32:40 +00:00
< span class = "n" > sess< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > InferenceSession< / span > < span class = "p" > (< / span > < span class = "s2" > " rf_iris_< / span > < span class = "si" > %d< / span > < span class = "s2" > .onnx" < / span > < span class = "o" > %< / span > < span class = "n" > n_trees< / span > < span class = "p" > ,< / span > < span class = "n" > providers< / span > < span class = "o" > =< / span > < span class = "n" > rt< / span > < span class = "o" > .< / span > < span class = "n" > get_available_providers< / span > < span class = "p" > ())< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "k" > def< / span > < span class = "nf" > sess_predict_proba_loop< / span > < span class = "p" > (< / span > < span class = "n" > x< / span > < span class = "p" > ):< / span >
< span class = "k" > return< / span > < span class = "n" > sess< / span > < span class = "o" > .< / span > < span class = "n" > run< / span > < span class = "p" > ([< / span > < span class = "n" > prob_name< / span > < span class = "p" > ],< / span > < span class = "p" > {< / span > < span class = "n" > input_name< / span > < span class = "p" > :< / span > < span class = "n" > x< / span > < span class = "o" > .< / span > < span class = "n" > astype< / span > < span class = "p" > (< / span > < span class = "n" > numpy< / span > < span class = "o" > .< / span > < span class = "n" > float32< / span > < span class = "p" > )})[< / span > < span class = "mi" > 0< / span > < span class = "p" > ]< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > tsk< / span > < span class = "o" > =< / span > < span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, rf.predict_proba, 100)" < / span > < span class = "p" > ,< / span > < span class = "n" > number< / span > < span class = "o" > =< / span > < span class = "mi" > 5< / span > < span class = "p" > ,< / span > < span class = "n" > repeat< / span > < span class = "o" > =< / span > < span class = "mi" > 5< / span > < span class = "p" > )< / span >
< span class = "n" > trt< / span > < span class = "o" > =< / span > < span class = "n" > speed< / span > < span class = "p" > (< / span > < span class = "s2" > " loop(X_test, sess_predict_proba_loop, 100)" < / span > < span class = "p" > ,< / span > < span class = "n" > number< / span > < span class = "o" > =< / span > < span class = "mi" > 5< / span > < span class = "p" > ,< / span > < span class = "n" > repeat< / span > < span class = "o" > =< / span > < span class = "mi" > 5< / span > < span class = "p" > )< / span >
2022-08-03 17:24:42 +00:00
< span class = "n" > measures< / span > < span class = "o" > .< / span > < span class = "n" > append< / span > < span class = "p" > ({< / span > < span class = "s2" > " n_trees" < / span > < span class = "p" > :< / span > < span class = "n" > n_trees< / span > < span class = "p" > ,< / span > < span class = "s2" > " sklearn" < / span > < span class = "p" > :< / span > < span class = "n" > tsk< / span > < span class = "p" > ,< / span > < span class = "s2" > " rt" < / span > < span class = "p" > :< / span > < span class = "n" > trt< / span > < span class = "p" > })< / span >
2019-12-21 01:11:46 +00:00
2022-01-04 17:32:40 +00:00
< span class = "kn" > from< / span > < span class = "nn" > pandas< / span > < span class = "k" > import< / span > < span class = "n" > DataFrame< / span >
2022-08-03 17:24:42 +00:00
2019-12-21 01:11:46 +00:00
< span class = "n" > df< / span > < span class = "o" > =< / span > < span class = "n" > DataFrame< / span > < span class = "p" > (< / span > < span class = "n" > measures< / span > < span class = "p" > )< / span >
2020-08-13 02:12:50 +00:00
< span class = "n" > ax< / span > < span class = "o" > =< / span > < span class = "n" > df< / span > < span class = "o" > .< / span > < span class = "n" > plot< / span > < span class = "p" > (< / span > < span class = "n" > x< / span > < span class = "o" > =< / span > < span class = "s2" > " n_trees" < / span > < span class = "p" > ,< / span > < span class = "n" > y< / span > < span class = "o" > =< / span > < span class = "s2" > " sklearn" < / span > < span class = "p" > ,< / span > < span class = "n" > label< / span > < span class = "o" > =< / span > < span class = "s2" > " scikit-learn" < / span > < span class = "p" > ,< / span > < span class = "n" > c< / span > < span class = "o" > =< / span > < span class = "s2" > " blue" < / span > < span class = "p" > ,< / span > < span class = "n" > logy< / span > < span class = "o" > =< / span > < span class = "kc" > True< / span > < span class = "p" > )< / span >
2022-08-03 17:24:42 +00:00
< span class = "n" > df< / span > < span class = "o" > .< / span > < span class = "n" > plot< / span > < span class = "p" > (< / span > < span class = "n" > x< / span > < span class = "o" > =< / span > < span class = "s2" > " n_trees" < / span > < span class = "p" > ,< / span > < span class = "n" > y< / span > < span class = "o" > =< / span > < span class = "s2" > " rt" < / span > < span class = "p" > ,< / span > < span class = "n" > label< / span > < span class = "o" > =< / span > < span class = "s2" > " onnxruntime" < / span > < span class = "p" > ,< / span > < span class = "n" > ax< / span > < span class = "o" > =< / span > < span class = "n" > ax< / span > < span class = "p" > ,< / span > < span class = "n" > c< / span > < span class = "o" > =< / span > < span class = "s2" > " green" < / span > < span class = "p" > ,< / span > < span class = "n" > logy< / span > < span class = "o" > =< / span > < span class = "kc" > True< / span > < span class = "p" > )< / span >
2019-12-21 01:11:46 +00:00
< span class = "n" > ax< / span > < span class = "o" > .< / span > < span class = "n" > set_xlabel< / span > < span class = "p" > (< / span > < span class = "s2" > " Number of trees" < / span > < span class = "p" > )< / span >
< span class = "n" > ax< / span > < span class = "o" > .< / span > < span class = "n" > set_ylabel< / span > < span class = "p" > (< / span > < span class = "s2" > " Prediction time (s)" < / span > < span class = "p" > )< / span >
< span class = "n" > ax< / span > < span class = "o" > .< / span > < span class = "n" > set_title< / span > < span class = "p" > (< / span > < span class = "s2" > " Speed comparison between scikit-learn and ONNX Runtime< / span > < span class = "se" > \n< / span > < span class = "s2" > For a random forest on Iris dataset" < / span > < span class = "p" > )< / span >
< span class = "n" > ax< / span > < span class = "o" > .< / span > < span class = "n" > legend< / span > < span class = "p" > ()< / span >
< / pre > < / div >
< / div >
2022-08-03 17:24:42 +00:00
< img src = "../images/sphx_glr_plot_train_convert_predict_001.png" srcset = "../images/sphx_glr_plot_train_convert_predict_001.png" alt = "Speed comparison between scikit-learn and ONNX Runtime For a random forest on Iris dataset" class = "sphx-glr-single-img" / > < div class = "sphx-glr-script-out highlight-none notranslate" > < div class = "highlight" > < pre > < span > < / span > 5
2022-08-04 20:43:40 +00:00
Average 0.0984 min=0.0967 max=0.1
Average 0.00149 min=0.00143 max=0.00152
2019-12-21 01:11:46 +00:00
10
2022-08-04 20:43:40 +00:00
Average 0.162 min=0.158 max=0.164
Average 0.00153 min=0.0014 max=0.00172
2019-12-21 01:11:46 +00:00
15
2022-08-04 20:43:40 +00:00
Average 0.229 min=0.225 max=0.235
Average 0.00157 min=0.00151 max=0.00161
2019-12-21 01:11:46 +00:00
20
2022-08-04 20:43:40 +00:00
Average 0.287 min=0.283 max=0.291
Average 0.00161 min=0.00149 max=0.00184
2019-12-21 01:11:46 +00:00
25
2022-08-04 20:43:40 +00:00
Average 0.35 min=0.349 max=0.352
Average 0.00164 min=0.0015 max=0.00184
2019-12-21 01:11:46 +00:00
30
2022-08-04 20:43:40 +00:00
Average 0.414 min=0.411 max=0.422
Average 0.00165 min=0.0014 max=0.00175
2019-12-21 01:11:46 +00:00
35
2022-08-04 20:43:40 +00:00
Average 0.475 min=0.471 max=0.483
Average 0.00171 min=0.00159 max=0.00178
2019-12-21 01:11:46 +00:00
40
2022-08-04 20:43:40 +00:00
Average 0.532 min=0.527 max=0.536
Average 0.00176 min=0.00165 max=0.00198
2019-12-21 01:11:46 +00:00
45
2022-08-04 20:43:40 +00:00
Average 0.598 min=0.593 max=0.604
Average 0.00179 min=0.00171 max=0.00191
2019-12-21 01:11:46 +00:00
50
2022-08-04 20:43:40 +00:00
Average 0.669 min=0.663 max=0.677
Average 0.00186 min=0.00167 max=0.00213
2020-08-13 02:12:50 +00:00
2022-08-04 20:43:40 +00:00
< matplotlib.legend.Legend object at 0x7f551da12d00>
2019-12-21 01:11:46 +00:00
< / pre > < / div >
< / div >
2022-08-04 20:43:40 +00:00
< p class = "sphx-glr-timing" > < strong > Total running time of the script:< / strong > ( 6 minutes 3.597 seconds)< / p >
2022-08-03 17:24:42 +00:00
< div class = "sphx-glr-footer sphx-glr-footer-example docutils container" id = "sphx-glr-download-auto-examples-plot-train-convert-predict-py" >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-download sphx-glr-download-python docutils container" >
2021-03-09 18:21:38 +00:00
< p > < a class = "reference download internal" download = "" href = "../downloads/c647c128e0cf2b3db04ce60b41ef1a14/plot_train_convert_predict.py" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Python< / span > < span class = "pre" > source< / span > < span class = "pre" > code:< / span > < span class = "pre" > plot_train_convert_predict.py< / span > < / code > < / a > < / p >
2019-12-21 01:11:46 +00:00
< / div >
2020-08-13 02:12:50 +00:00
< div class = "sphx-glr-download sphx-glr-download-jupyter docutils container" >
2021-03-09 18:21:38 +00:00
< p > < a class = "reference download internal" download = "" href = "../downloads/1680115d3d937dfbb2d86adb705d9c5d/plot_train_convert_predict.ipynb" > < code class = "xref download docutils literal notranslate" > < span class = "pre" > Download< / span > < span class = "pre" > Jupyter< / span > < span class = "pre" > notebook:< / span > < span class = "pre" > plot_train_convert_predict.ipynb< / span > < / code > < / a > < / p >
2019-12-21 01:11:46 +00:00
< / div >
< / div >
2020-08-13 02:12:50 +00:00
< p class = "sphx-glr-signature" > < a class = "reference external" href = "https://sphinx-gallery.github.io" > Gallery generated by Sphinx-Gallery< / a > < / p >
2022-01-04 17:32:40 +00:00
< / section >
< / section >
2019-12-21 01:11:46 +00:00
< / div >
< / div >
< / div >
< div class = "sphinxsidebar" role = "navigation" aria-label = "main navigation" >
< div class = "sphinxsidebarwrapper" >
< p class = "logo" > < a href = "../index.html" >
2021-02-11 00:34:31 +00:00
< img class = "logo" src = "../static/ONNX_Runtime_icon.png" alt = "Logo" / >
2019-12-21 01:11:46 +00:00
< / a > < / p >
< h1 class = "logo" > < a href = "../index.html" > ONNX Runtime< / a > < / h1 >
< h3 > Navigation< / h3 >
2021-03-09 18:21:38 +00:00
< ul >
2019-12-21 01:11:46 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "../tutorial.html" > Tutorial< / a > < / li >
2022-03-16 01:13:11 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "../api_summary.html" > API< / a > < / li >
2021-03-09 18:21:38 +00:00
< li class = "toctree-l1" > < a class = "reference internal" href = "index.html" > Gallery of examples< / a > < / li >
2019-12-21 01:11:46 +00:00
< / ul >
< div class = "relations" >
< h3 > Related Topics< / h3 >
< ul >
< li > < a href = "../index.html" > Documentation overview< / a > < ul >
< li > < a href = "index.html" > Gallery of examples< / a > < ul >
< li > Previous: < a href = "plot_common_errors.html" title = "previous chapter" > Common errors with onnxruntime< / a > < / li >
< / ul > < / li >
< / ul > < / li >
< / ul >
< / div >
< div id = "searchbox" style = "display: none" role = "search" >
< h3 id = "searchlabel" > Quick search< / h3 >
< div class = "searchformwrapper" >
< form class = "search" action = "../search.html" method = "get" >
2022-01-04 17:32:40 +00:00
< input type = "text" name = "q" aria-labelledby = "searchlabel" autocomplete = "off" autocorrect = "off" autocapitalize = "off" spellcheck = "false" / >
2019-12-21 01:11:46 +00:00
< input type = "submit" value = "Go" / >
< / form >
< / div >
< / div >
2022-08-03 17:24:42 +00:00
< script > document . getElementById ( 'searchbox' ) . style . display = "block" < / script >
2020-04-06 22:52:48 +00:00
2019-12-21 01:11:46 +00:00
< / div >
< / div >
< div class = "clearer" > < / div >
< / div >
< div class = "footer" >
2021-02-11 00:34:31 +00:00
© 2018-2021, Microsoft.
2019-12-21 01:11:46 +00:00
|
2022-08-03 17:24:42 +00:00
Powered by < a href = "http://sphinx-doc.org/" > Sphinx 5.1.1< / a >
2020-04-06 22:52:48 +00:00
& < a href = "https://github.com/bitprophet/alabaster" > Alabaster 0.7.12< / a >
2019-12-21 01:11:46 +00:00
|
2021-02-11 00:34:31 +00:00
< a href = "../sources/auto_examples/plot_train_convert_predict.rst.txt"
2019-12-21 01:11:46 +00:00
rel="nofollow">Page source< / a >
< / div >
< / body >
< / html >
