mirror of
https://github.com/saymrwulf/nvidia-AI.summerschool17-notebooks.git
synced 2026-11-17 08:55:07 +00:00
519 lines
No EOL
66 KiB
Text
519 lines
No EOL
66 KiB
Text
{
|
|
"metadata": {
|
|
"name": "105-simple-probability"
|
|
},
|
|
"nbformat": 3,
|
|
"nbformat_minor": 0,
|
|
"worksheets": [
|
|
{
|
|
"cells": [
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Title: Sampling from Probability Distributions\n",
|
|
"Author: Thomas Breuel\n",
|
|
"Institution: UniKL"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"\n",
|
|
"from pylab import *"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [],
|
|
"prompt_number": 1
|
|
},
|
|
{
|
|
"cell_type": "heading",
|
|
"level": 1,
|
|
"metadata": {},
|
|
"source": [
|
|
"Sampling from Distributions"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"We can easily sample for distributions in Python.\n",
|
|
"The basic distributions are `randn` (normal density) and `rand` (uniform density)."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"data = randn(10000)\n",
|
|
"_=hist(data,bins=100)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "display_data",
|
|
"png": "iVBORw0KGgoAAAANSUhEUgAAAXUAAAD9CAYAAABDaefJAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAGq5JREFUeJzt3V1sU+cdx/GfQ9ILRChBbUxlM7lbgoIhYK8oibYymUFA\nLSNKy5YuKTQqME1Fq0Sp1pZudGESJN3KRWFC6gXtgiqVsgsImiAKq+quY9oCJVxMqZpsCmvivAwW\nXhIoCyRnFymOTfyWxI7tk+9HQjrY5/H5G+KfnzznOc+xGIZhCABgChnJLgAAED+EOgCYCKEOACZC\nqAOAiRDqAGAihDoAmEjEUL99+7aKi4vlcrnkdDq1a9cuSVJNTY3sdrvcbrfcbrdOnz7tb1NbW6v8\n/HwVFBSoqakpsdUDAIJYos1Tv3XrlmbPnq27d+/q8ccf11tvvaWPPvpI2dnZ2rlzZ9C+ra2tqqqq\n0rlz5+Tz+bRmzRq1tbUpI4NfCABgOkRN29mzZ0uShoaGNDw8rJycHElSqO+ChoYGVVZWKisrSw6H\nQ3l5eWpubo5zyQCAcKKG+sjIiFwul6xWq1atWqUlS5ZIkg4ePKjly5dr69atunbtmiSpu7tbdrvd\n39Zut8vn8yWodADA/TKj7ZCRkaGLFy/q+vXrWrdunbxer1544QW98cYbkqTdu3fr5Zdf1uHDh0O2\nt1gsMT0GAIgu2souMQ92P/jgg1q/fr3Onz+v3NxcWSwWWSwWbdu2zT/EYrPZ1NnZ6W/T1dUlm80W\ntrBU//OrX/0q6TWYpc50qJE6qTPV/8QiYqhfuXLFP7Ty1Vdf6cyZM3K73ert7fXvc/z4cRUWFkqS\nysrKdPToUQ0NDamjo0Pt7e0qKiqKqRAAwNRFHH7p6elRdXW1RkZGNDIyos2bN2v16tV67rnndPHi\nRVksFj366KN65513JElOp1MVFRVyOp3KzMzUoUOHGGoBgGkUMdQLCwt14cKFcY8fOXIkbJvXX39d\nr7/++tQrSwEejyfZJcQkHepMhxol6ow36px+UeepJ+SgFkvM40MAgFGxZCdXBQGAiRDqAGAihDoA\nmAihDgAmQqgDgIkQ6gBgIoQ6AJgIoY4Zae7c+f71i+bOnZ/scoC44eIjzEijy1fc+xnk5xHpgYuP\nAGCGIdQBwEQIdQAwEUIdAEyEUAcAEyHUAcBECHUAMBFCHQBMhFAHABMh1AHARAh1ADARQh0ATIRQ\nBwATiRjqt2/fVnFxsVwul5xOp3bt2iVJ6u/vV2lpqRYtWqS1a9fq2rVr/ja1tbXKz89XQUGBmpqa\nEls9EGcsyYt0F3Xp3Vu3bmn27Nm6e/euHn/8cb311ls6efKkHnroIb3yyit68803dfXqVdXV1am1\ntVVVVVU6d+6cfD6f1qxZo7a2NmVkBH93sPQuki3c0rssyYtUFpeld2fPni1JGhoa0vDwsHJycnTy\n5ElVV1dLkqqrq3XixAlJUkNDgyorK5WVlSWHw6G8vDw1NzdP9X0AAGKUGW2HkZERffvb39a//vUv\nvfDCC1qyZIn6+vpktVolSVarVX19fZKk7u5ulZSU+Nva7Xb5fL6Qr1tTU+Pf9ng88ng8U3gbAGA+\nXq9XXq93Qm2ihnpGRoYuXryo69eva926dfr444+Dnr83/hhOuOcCQx1ItLlz52tg4GqyywAm5P4O\n7549e6K2iXn2y4MPPqj169frs88+k9VqVW9vrySpp6dHubm5kiSbzabOzk5/m66uLtlstlgPASTM\naKAbAX9ikclJU6SdiKF+5coV/8yWr776SmfOnJHb7VZZWZnq6+slSfX19SovL5cklZWV6ejRoxoa\nGlJHR4fa29tVVFSU4LcAJMpd3fsSoJePdBFx+KWnp0fV1dUaGRnRyMiINm/erNWrV8vtdquiokKH\nDx+Ww+HQsWPHJElOp1MVFRVyOp3KzMzUoUOHIg7NAADiK+qUxoQclCmNmGbBUxUlKbYpjUxvRCqJ\ny5RGAFLg+LrF8kDANuPtSC1RZ78AkMbG16XgHrw0MMAQI1IHPXUAMBFCHQBMhOEX4OvxcsAM6KkD\nAfPRgXRHqAPTgCV9MV0IdZhWYJAmVvTlBAKXKeDqVCQSoY60F64XHLzeSyIFLicwQI8cScUVpUh7\nsd7wItIVpZPfjrwfN99APMWSncx+gckwkwUzG8MvMBlmsmBmo6cOJAy/NWD60VMHEobfGjD9CHUA\nMBFCHQBMhFAHABMh1AHARAh1ADARQh0ATIRQBwATIdSBaRd9VUdgsriiFJh2Yzex5qbViLeIPfXO\nzk6tWrVKS5Ys0dKlS3XgwAFJUk1Njex2u9xut9xut06fPu1vU1tbq/z8fBUUFKipqSmx1QMAgkRc\nere3t1e9vb1yuVwaHBzUY489phMnTujYsWPKzs7Wzp07g/ZvbW1VVVWVzp07J5/PpzVr1qitrU0Z\nGcHfHSy9i3gKv8Ru8pfejWWbzwJiFUt2RuypL1iwQC6XS5I0Z84cLV68WD6fT5JCvnBDQ4MqKyuV\nlZUlh8OhvLw8NTc3T7Z+AMAExTymfunSJbW0tKikpERnz57VwYMHdeTIEa1YsUL79+/XvHnz1N3d\nrZKSEn8bu93u/xK4X01NjX/b4/HI4/FM+k0AgBl5vV55vd4JtYnpzkeDg4PyeDz65S9/qfLycv3n\nP//Rww8/LEnavXu3enp6dPjwYb344osqKSnRs88+K0natm2bnnzyST399NPBB2X4BXHE8AtmiikP\nv0jSnTt3tHHjRm3atEnl5eWSpNzcXP+UrG3btvmHWGw2mzo7O/1tu7q6ZLPZpvIeMMOEu98ogNhE\nDHXDMLR161Y5nU7t2LHD/3hPT49/+/jx4yosLJQklZWV6ejRoxoaGlJHR4fa29tVVFSUoNJhRoE3\nix7dBjAREcfUz549q/fff1/Lli2T2+2WJO3bt08ffPCBLl68KIvFokcffVTvvPOOJMnpdKqiokJO\np1OZmZk6dOgQd34BIgq+O1J2do5u3OhPYj1IdzGNqcf9oIypI4z7x8dj+TlJ9zH1+1+LzwbCicuY\nOpBogePoAKaGUEfSBY6jA5gaQh1JQe8cSAxCHUkx1d45XwpAaKzSiBQWODMkS9Kd+54PPNkIQCLU\nkdLGlqgNPeMEwP0YfgEAEyHUAcBECHUAMBFCHQBMhFAHABMh1AHARAh1ADARQh1IUdwwBJPBxUdA\nSsm8b+mD0QuuBga42AqxoacOpJR7V9GyYiUmh1AHABMh1AHARAh1ADARQh0ATIRQBwATIdQBwEQI\ndQAwkYih3tnZqVWrVmnJkiVaunSpDhw4IEnq7+9XaWmpFi1apLVr1+ratWv+NrW1tcrPz1dBQYGa\nmpoSWz0AIIjFMIywVzn09vaqt7dXLpdLg4ODeuyxx3TixAm99957euihh/TKK6/ozTff1NWrV1VX\nV6fW1lZVVVXp3Llz8vl8WrNmjdra2pSREfzdYbFYFOGwmAFGr5oMdau6WLYn0yae7ZPzWnxmEEt2\nRuypL1iwQC6XS5I0Z84cLV68WD6fTydPnlR1dbUkqbq6WidOnJAkNTQ0qLKyUllZWXI4HMrLy1Nz\nc3M83gsAIAYxr/1y6dIltbS0qLi4WH19fbJarZIkq9Wqvr4+SVJ3d7dKSkr8bex2u3w+X8jXq6mp\n8W97PB55PJ5JlA8A5uX1euX1eifUJqZQHxwc1MaNG/X2228rOzs76Ll7q8iFE+65wFAHAIx3f4d3\nz549UdtEnf1y584dbdy4UZs3b1Z5ebmk0d55b2+vJKmnp0e5ubmSJJvNps7OTn/brq4u2Wy2Cb0J\nmEfg0rEsHwtMj4ihbhiGtm7dKqfTqR07dvgfLysrU319vSSpvr7eH/ZlZWU6evSohoaG1NHRofb2\ndhUVFSWwfKSygYGrGltx0Pj67wASKeLsl7/85S/63ve+p2XLlvmHUWpra1VUVKSKigp9+eWXcjgc\nOnbsmObNmydJ2rdvn959911lZmbq7bff1rp168YflNkvM0LwDBcpcAYHs1+Y/YKJiyU7I4Z6ohDq\nM8P4UM/S6Hrh9xDqhDomYspTGoH44gYQQKIR6kBayOSEM2LCPUqBtHDvtxzuV4rI6KkDgIkQ6gBg\nIoQ6AJgIoQ6kHU6aIjxOlAJph5OmCI+eOgCYCKEOACZCqCOuAldmxHTIZCVMBGFMHXE1tjKjNLp2\nCRJrbHxdYowd9NQBwFQIdQAwEUIdAEyEUAcAEyHUAcBECHUAMBFCHQBMhFAHABMh1AHARAh1ADAR\nQh0ATCRqqG/ZskVWq1WFhYX+x2pqamS32+V2u+V2u3X69Gn/c7W1tcrPz1dBQYGampoSUzUAIKSo\nof7888+rsbEx6DGLxaKdO3eqpaVFLS0teuKJJyRJra2t+vDDD9Xa2qrGxkZt375dIyMjiakcADBO\n1FBfuXKlcnJyxj1uGMa4xxoaGlRZWamsrCw5HA7l5eWpubk5PpUCAKKa9NK7Bw8e1JEjR7RixQrt\n379f8+bNU3d3t0pKSvz72O12+Xy+kO1ramr82x6PRx6PZ7KlAIApeb1eeb3eCbWZVKi/8MILeuON\nNyRJu3fv1ssvv6zDhw+H3DfczRICQx0AMN79Hd49e/ZEbTOp2S+5ubn+O61s27bNP8Ris9nU2dnp\n36+rq0s2m20yh0Aa4W5HQOqYVKj39PT4t48fP+6fGVNWVqajR49qaGhIHR0dam9vV1FRUXwqRcoa\nu9vR+PMsAKZX1OGXyspKffLJJ7py5YoWLlyoPXv2yOv16uLFi7JYLHr00Uf1zjvvSJKcTqcqKirk\ndDqVmZmpQ4cO0XsDgGlkMUJNY0n0QS2WkLNnkJ5Gv7gD70saajvScxPdTnb7VH0tScrS6H1Lpezs\nHN240S+YRyzZyY2nAVMZuxE1N6GemVgmAJgBAk9mz507P9nlIIEIdUwKM17SS+DJ7NFtmBWhjklh\nxguQmgh1ADARTpQCppXJ8NgMRE8dMK17M2EYIptJCHUAMBFCHQBMhFAHABMh1AHARAh1RBR4kZHF\n8gAXHAEpjimNiGjsIiNp/EJSAFINPXUAMBFCHQBMhFAHABMh1AHARAh1ADARQh0ATIRQBwATIdQB\nwEQIdQAwEUIdAEwkaqhv2bJFVqtVhYWF/sf6+/tVWlqqRYsWae3atbp27Zr/udraWuXn56ugoEBN\nTU2JqRrAFGT61/CZO3d+sotBnEUN9eeff16NjY1Bj9XV1am0tFRtbW1avXq16urqJEmtra368MMP\n1draqsbGRm3fvl0jIyOJqRzAJI3dEWl0bR+YSdRQX7lypXJycoIeO3nypKqrqyVJ1dXVOnHihCSp\noaFBlZWVysrKksPhUF5enpqbmxNQNgAglEmt0tjX1yer1SpJslqt6uvrkyR1d3erpKTEv5/dbpfP\n5wv5GjU1Nf5tj8cjj8czmVIAwLS8Xq+8Xu+E2kx56d1o62uHey4w1AEk39y584OGY7Kzc3TjRn8S\nK8L9Hd49e/ZEbTOp2S9Wq1W9vb2SpJ6eHuXm5kqSbDabOjs7/ft1dXXJZrNN5hAAptnY2vmMt6ez\nSYV6WVmZ6uvrJUn19fUqLy/3P3706FENDQ2po6ND7e3tKioqil+1AICIog6/VFZW6pNPPtGVK1e0\ncOFC/frXv9Zrr72miooKHT58WA6HQ8eOHZMkOZ1OVVRUyOl0KjMzU4cOHeLWZwAwjSyGYRjRd4vz\nQS0WJeGwmITRL+Vwt7ObyPZU28fztVKpluS/r3ufxeD/6+DnkBpiyU6uKEWQ4BtN81sWkG648TSC\nBN9oWuIG00B6oacOACZCqAMIgzVi0hHDLwDCuLdGjDQwwDBcuqCnjqCTowDSGz113HdylGCfWTL5\nMjcZeurAjDa2DC/MgVAHABMh1AHARAj1GYqTo4A5EeozVPAyqwDMglAHABMh1AHARAh1ADFgyYB0\nwcVHAGLAkgHpgp76DMKMF8D8CPUZhBkvgPkR6gBgIoQ6AJgIoQ4AJkKoA5ggpjemMqY0Apggpjem\nsimFusPh0Ny5czVr1ixlZWWpublZ/f39euaZZ/Tvf/9bDodDx44d07x58+JVLwAggikNv1gsFnm9\nXrW0tKi5uVmSVFdXp9LSUrW1tWn16tWqq6uLS6EAgOimPKZuGMFznk+ePKnq6mpJUnV1tU6cODHV\nQwAAYjSl4ReLxaI1a9Zo1qxZ+ulPf6qf/OQn6uvrk9VqlSRZrVb19fWFbFtTU+Pf9ng88ng8UykF\nAEzH6/XK6/VOqI3FuL+rPQE9PT165JFHdPnyZZWWlurgwYMqKyvT1atX/fvMnz9f/f39wQe1WMb1\n8JEYc+fO//pK0nsCbzAdbTvW/dLttVKplnR/X1kaPXEqZWfn6MaN4M864iuW7JzS8MsjjzwiSXr4\n4Yf11FNPqbm5WVarVb29vZJGQz83N3cqh0AMAtd0uX+KGUsDILHGblwd2HkI/Jlk6uP0mnSo37p1\nSwMDA5KkmzdvqqmpSYWFhSorK1N9fb0kqb6+XuXl5fGpFGEFBndwrxxIjuDOBD+X02nSY+p9fX16\n6qmnJEl3797Vs88+q7Vr12rFihWqqKjQ4cOH/VMaMZ0yWYURmMGmNKY+6YMyph5XoyFuljFas449\nz4z3de9zHfwzGfwcJi/hY+oAgNRCqAOAiRDqAOIkM6Y7a0WarYWpY0EvAHEyttDX6Fh7aGMzY1gQ\nLBHoqacp7jcKIBRCPU1xURGAUBh+ATANuH5iutBTBzANxpYTQGIR6gCSiFvjxRvDLwCSiFvjxRs9\n9RTHnF4AE0FPPQWFWwOdngyAaAj1FDA+xKVYLuIAgPsR6ikg8Aq7UeGCnGlhACJjTD2tMC0MZhZ+\nJgznlmJHTx1Aigg/E4b1YmJHT30a0dsAkGj01KcRvQ0AiUZPPU7C9cLDr6YY29rTADARhHqcBK6a\nGDg9Mfxqipz0BCZnYksLBHasZsLQJ6GeEPTCgcQZ6xANDAxEDevgjpUR4poQcyHUvzbRk5j3f/sH\noxcOTE1mhM9XoNABb7E8EKGtuRcRS0ioNzY2qqCgQPn5+XrzzTcTcYi4CzV84vV6Y9qf8I6FN9kF\nmIw32QXEyDvJdoEdo1g/X4Ft7kRoO7GefrqJe6gPDw/rZz/7mRobG9Xa2qoPPvhAn3/+ebwPE7NY\nTmCG6wl4vV6mIcaNN9kFmIw32QXEyJvsAqK4F/C/ChqWSefPfdynNDY3NysvL08Oh0OS9OMf/1gN\nDQ1avHjxhF/r5s2bOn36tEZGRiRJNptN3/3udyf0GuGmEcZ6aX5w+yzGyYEZIJ2nH8c91H0+nxYu\nXOj/u91u19///vdJvdann36qH/3oR0GPGcZYEAcuhJWdnaMbN/rHPR4s1rVTwu0X293SAaSjcJ/7\nwMezNDq0o3F/D5dBgY9HMpk2od9FnMXak51sjzdcu4GBqxFeM9bHY9kv3Has+6Xba6VSLbyvMXu+\n/pMKtUTbDlVnqv4bh9vnnjth/x4ugyJnU2iTaXNP3EPdZrOps7PT//fOzk7Z7fagfQJ72wCA+In7\nidIVK1aovb1dly5d0tDQkD788EOVlZXF+zAAgBDi3lPPzMzU7373O61bt07Dw8PaunXrpE6SAgAm\nLiHz1J944gl98cUX+uc//6ldu3aF3W///v3KyMhQf//kTggk2u7du7V8+XK5XC6tXr06aFgplfz8\n5z/X4sWLtXz5cj399NO6fv16sksK6Q9/+IOWLFmiWbNm6cKFC8kuZ5x0uL5iy5YtslqtKiwsTHYp\nEXV2dmrVqlVasmSJli5dqgMHDiS7pHFu376t4uJiuVwuOZ3OiFmVCoaHh+V2u7Vhw4bIOxpJ8uWX\nXxrr1q0zHA6H8d///jdZZUR048YN//aBAweMrVu3JrGa8Jqamozh4WHDMAzj1VdfNV599dUkVxTa\n559/bnzxxReGx+MxPvvss2SXE+Tu3bvGt771LaOjo8MYGhoyli9fbrS2tia7rHH+/Oc/GxcuXDCW\nLl2a7FIi6unpMVpaWgzDMIyBgQFj0aJFKfnvefPmTcMwDOPOnTtGcXGx8emnnya5ovD2799vVFVV\nGRs2bIi4X9KWCdi5c6d+85vfJOvwMcnOzvZvDw4O6qGHHkpiNeGVlpYqI2P0v7K4uFhdXV1Jrii0\ngoICLVq0KNllhBR4fUVWVpb/+opUs3LlSuXk5CS7jKgWLFggl8slSZozZ44WL16s7u7uJFc13uzZ\nsyVJQ0NDGh4e1vz5qXmhUVdXl06dOqVt27ZFnWiSlFBvaGiQ3W7XsmXLknH4CfnFL36hb3zjG6qv\nr9drr72W7HKievfdd/Xkk08mu4y0E+r6Cp/Pl8SKzOPSpUtqaWlRcXFxsksZZ2RkRC6XS1arVatW\nrZLT6Ux2SSG99NJL+u1vf+vvvEWSsJtklJaWqre3d9zje/fuVW1trZqamvyPRfvmSaRwde7bt08b\nNmzQ3r17tXfvXtXV1emll17Se++9l4Qqo9cpjf7bPvDAA6qqqpru8vxiqTMVcaVwYgwODuqHP/yh\n3n77bc2ZMyfZ5YyTkZGhixcv6vr161q3bp28Xq88Hk+yywryxz/+Ubm5uXK73RHXo7onYaF+5syZ\nkI//4x//UEdHh5YvXy5p9NeKxx57TM3NzcrNzU1UOWGFq/N+VVVVSe0BR6vz97//vU6dOqWPPvpo\nmioKLdZ/z1QTy/UVmJg7d+5o48aN2rRpk8rLy5NdTkQPPvig1q9fr/Pnz6dcqP/1r3/VyZMnderU\nKd2+fVs3btzQc889pyNHjoRuMC0j/BGk8onStrY2//aBAweMTZs2JbGa8E6fPm04nU7j8uXLyS4l\nJh6Pxzh//nyyywhy584d45vf/KbR0dFh/O9//0vZE6WGYRgdHR0pf6J0ZGTE2Lx5s7Fjx45klxLW\n5cuXjatXrxqGYRi3bt0yVq5cafzpT39KclWReb1e4wc/+EHEfZK+nnoq/9q7a9cuFRYWyuVyyev1\nav/+/ckuKaQXX3xRg4ODKi0tldvt1vbt25NdUkjHjx/XwoUL9be//U3r16/XE088keyS/AKvr3A6\nnXrmmWdS8vqKyspKfec731FbW5sWLlyYtOHAaM6ePav3339fH3/8sdxut9xutxobG5NdVpCenh59\n//vfl8vlUnFxsTZs2KDVq1cnu6yoomWmxTC4Zh8AzCLpPXUAQPwQ6gBgIoQ6AJgIoQ4AJkKoA4CJ\nEOoAYCL/B73iZ+4f++mAAAAAAElFTkSuQmCC\n"
|
|
}
|
|
],
|
|
"prompt_number": 4
|
|
},
|
|
{
|
|
"cell_type": "heading",
|
|
"level": 1,
|
|
"metadata": {},
|
|
"source": [
|
|
"Binomial Distributions"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"If we want a binomial variable with $p=0.1$, we can sample as follows:\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"n = 1000\n",
|
|
"p = 0.1\n",
|
|
"sum(rand(n)<p)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "pyout",
|
|
"prompt_number": 69,
|
|
"text": [
|
|
"109"
|
|
]
|
|
}
|
|
],
|
|
"prompt_number": 69
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"p = 0.5\n",
|
|
"dist = array([sum(rand(n)<p) for i in range(10000)])\n",
|
|
"_=hist(dist,bins=20)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "display_data",
|
|
"png": "iVBORw0KGgoAAAANSUhEUgAAAYEAAAD9CAYAAABazssqAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAG/VJREFUeJzt3XtsW/Xdx/F3orgbekZYO4jT2WXWGmeJaVqytiYgdfNo\nnUK1RqEwjxTR0FBNarepXFY6/tkSnoc6BSFxU5iYUgidtKT7J4lQ5oXCDNsYSVsm0DBaLEhF7CQe\nkIYGCpiW8/yRxWuaC8R2bj6fl2TJ/fmc4++3Sc7HPtcswzAMRETElLLnuwAREZk/CgERERNTCIiI\nmJhCQETExBQCIiImphAQETGxaUOgpqYGq9VKSUnJuPHHHnuM4uJiVq1axf79+xPjfr8fp9NJUVER\nnZ2difETJ05QUlKC0+lk7969aW5BRESSNW0I7Ny5k0AgMG7sz3/+M+3t7bz++uv885//5Be/+AUA\noVCIlpYWQqEQgUCAPXv2MHYKwu7du2lsbCQcDhMOhycsU0RE5se0IbBhwwaWLl06buyJJ57g3nvv\nxWKxAHDZZZcB0NbWRlVVFRaLBYfDQUFBAV1dXQwMDDAyMoLb7QZgx44dtLa2zkYvIiIyQzPeJxAO\nh3nppZcoKyvD4/Fw/PhxAPr7+7Hb7Ynp7HY70Wh0wrjNZiMajaahdBERSVXOTGc4e/Ysp06d4pVX\nXuHYsWP4fD7efvvttBSTlZWVluWIiJhNslcAmvE3AbvdzrZt2wBYv3492dnZvPfee9hsNvr6+hLT\nRSIR7HY7NpuNSCQybtxms025fMMwMvbx61//et5rUG/qT/1l3iMVMw6ByspKXnjhBQB6enqIx+Nc\neumlVFRU0NzcTDwep7e3l3A4jNvtJj8/n9zcXLq6ujAMg8OHD1NZWZlS0SIikh7Tbg6qqqrixRdf\n5P3332fFihXcd9991NTUUFNTQ0lJCUuWLOGZZ54BwOVy4fP5cLlc5OTk0NDQkNi809DQwG233cbH\nH3/Mli1buO6662a/MxER+UJZRqrfJdIoKysr5a82C1kwGMTj8cx3GbMik3sD9bfYZXp/qaw7FQIi\nIotcKutOXTZCRMTEFAIiIiamEBARMTGFgIiIiSkERERMTCEgImJiCgERERNTCIiImJhCQETExBQC\nIiImphAQETExhYCIiIkpBERETEwhIPIl5OYuIysrK+lHbu6y+W5BZFK6lLTIlzB6g6RUfjf1uy2z\nR5eSFhGRpCgERERMTCEgImJi04ZATU0NVquVkpKSCa899NBDZGdnMzQ0lBjz+/04nU6Kioro7OxM\njJ84cYKSkhKcTid79+5NY/kiIpKKaUNg586dBAKBCeN9fX0899xzfOtb30qMhUIhWlpaCIVCBAIB\n9uzZk9hRsXv3bhobGwmHw4TD4UmXKSIic2/aENiwYQNLly6dMH7XXXfxwAMPjBtra2ujqqoKi8WC\nw+GgoKCArq4uBgYGGBkZwe12A7Bjxw5aW1vT2IKIiCRrxvsE2trasNvtrF69etx4f38/drs98W+7\n3U40Gp0wbrPZiEajKZQsIiLpkjOTic+cOcOBAwd47rnnEmPpPva5trY28dzj8eDxeNK6fBGRxS4Y\nDBIMBtOyrBmFwFtvvcXJkydZs2YNAJFIhLVr19LV1YXNZqOvry8xbSQSwW63Y7PZiEQi48ZtNtuU\n73F+CIiIyEQXfkCuq6tLelkz2hxUUlJCLBajt7eX3t5e7HY7r776KlarlYqKCpqbm4nH4/T29hIO\nh3G73eTn55Obm0tXVxeGYXD48GEqKyuTLlhERNJn2hCoqqrimmuuoaenhxUrVvDUU0+Ne330VPpR\nLpcLn8+Hy+Xi+uuvp6GhIfF6Q0MDu3btwul0UlBQwHXXXTcLrYiIyEzp2kEiX4KuHSQLma4dJCIi\nSVEIiIiYmEJAFgVdz19kdmifgCwK871Nfr7fX2Q62icgIiJJUQiIiJjYjM4YFpFk5Yw7ryYZF1+8\nlNOnh754QpEZUAiIzImzpLZPAUZGUgsRkcloc5CIiIkpBERETEwhICJiYgoBERETUwiIiJiYQkBE\nxMQUAiIiJqYQEBExMYWAiIiJKQRERExMISAiYmLThkBNTQ1Wq5WSkpLE2L59+yguLmbNmjVs27aN\nDz74IPGa3+/H6XRSVFREZ2dnYvzEiROUlJTgdDrZu3fvLLQhIiLJmDYEdu7cSSAQGDdWXl7OG2+8\nwWuvvUZhYSF+vx+AUChES0sLoVCIQCDAnj17Ejc52L17N42NjYTDYcLh8IRliojI/Jg2BDZs2MDS\npUvHjXm9XrKzR2e76qqriEQiALS1tVFVVYXFYsHhcFBQUEBXVxcDAwOMjIzgdrsB2LFjB62trbPR\ni4iIzFBKl5I+dOgQVVVVAPT391NWVpZ4zW63E41GsVgs2O32xLjNZiMajU65zNra2sRzj8eDx+NJ\npUQRkYwTDAYJBoNpWVbSIXD//fezZMkStm/fnpZCxpwfAiIiMtGFH5Dr6uqSXlZSIfD000/T0dHB\n888/nxiz2Wz09fUl/h2JRLDb7dhstsQmo7Fxm82WdMEiIpI+Mz5ENBAI8OCDD9LW1sZXv/rVxHhF\nRQXNzc3E43F6e3sJh8O43W7y8/PJzc2lq6sLwzA4fPgwlZWVaW1C5IuN3t4x2YdIppr2m0BVVRUv\nvvgi7733HitWrKCurg6/3088Hsfr9QJw9dVX09DQgMvlwufz4XK5yMnJoaGhIfHH09DQwG233cbH\nH3/Mli1buO6662a/M5FxUr29o4JAMlOWMXYc5wKQlZXFAipHFpDRDxSprsQX8/yjy9Dfh0wmlXWn\nzhgWETExhYCIiIkpBERETEwhICJiYgoBERETUwiIiJiYQkBExMQUAiIiJqYQEBExMYWAiIiJKQRE\nRExMISAiYmIKARERE1MIiIiYmEJARMTEFAIiIiamEBARMTGFgIiIiSkERERMbNoQqKmpwWq1UlJS\nkhgbGhrC6/VSWFhIeXk5w8PDidf8fj9Op5OioiI6OzsT4ydOnKCkpASn08nevXtnoQ1Z6HJzl5GV\nlZX0Q0Rmx7QhsHPnTgKBwLix+vp6vF4vPT09bNy4kfr6egBCoRAtLS2EQiECgQB79uxJ3Ph49+7d\nNDY2Eg6HCYfDE5YpmW9k5BSjN1pP9iEis2HaENiwYQNLly4dN9be3k51dTUA1dXVtLa2AtDW1kZV\nVRUWiwWHw0FBQQFdXV0MDAwwMjKC2+0GYMeOHYl5RERkfuXMdIZYLIbVagXAarUSi8UA6O/vp6ys\nLDGd3W4nGo1isViw2+2JcZvNRjQanXL5tbW1iecejwePxzPTEkVEMlowGCQYDKZlWTMOgfPNxvba\n80NAREQmuvADcl1dXdLLmvHRQVarlcHBQQAGBgbIy8sDRj/h9/X1JaaLRCLY7XZsNhuRSGTcuM1m\nS7pgEfPKSWnnem7usvluQBagGYdARUUFTU1NADQ1NVFZWZkYb25uJh6P09vbSzgcxu12k5+fT25u\nLl1dXRiGweHDhxPziMhMnCWVneujO+dFLmBM4+abbzaWL19uWCwWw263G4cOHTLef/99Y+PGjYbT\n6TS8Xq9x6tSpxPT333+/sXLlSuM73/mOEQgEEuPHjx83Vq1aZaxcudL4+c9/PuX7fUE5sogBBhgp\nPMw+f3pqkMyUys826z8LWBCysrJYQOVIGo3uO0rlZ2v2+dNTg/6+MlMq606dMSwiYmIKARERE1MI\niIiYmEJARMTEFAIiIiamEBARMTGFgIiIiSkERERMTCEgImJiCgERERNTCIiImJhCQETExBQCIiIm\nphAQETExhYCIiIkpBERETEwhICJiYgoBERETUwiIiJhY0iHg9/u54oorKCkpYfv27Xz66acMDQ3h\n9XopLCykvLyc4eHhcdM7nU6Kioro7OxMS/EiIpKapG40f/LkSa699lrefPNNvvKVr/DjH/+YLVu2\n8MYbb3DppZdyzz33cPDgQU6dOkV9fT2hUIjt27dz7NgxotEomzZtoqenh+zs8RmkG81nLt1oXjea\nl9kz5zeaz83NxWKxcObMGc6ePcuZM2f45je/SXt7O9XV1QBUV1fT2toKQFtbG1VVVVgsFhwOBwUF\nBXR3dydVsIiIpE9OMjMtW7aMu+++m8svv5yLLrqIzZs34/V6icViWK1WAKxWK7FYDID+/n7KysoS\n89vtdqLR6KTLrq2tTTz3eDx4PJ5kShQRyVjBYJBgMJiWZSUVAm+99RYPP/wwJ0+e5JJLLuFHP/oR\nv/vd78ZNk5WV9Z9NAJOb6rXzQ0BERCa68ANyXV1d0stKanPQ8ePHueaaa/jGN75BTk4O27Zt4+9/\n/zv5+fkMDg4CMDAwQF5eHgA2m42+vr7E/JFIBJvNlnTRIiKSHkmFQFFREa+88goff/wxhmFw9OhR\nXC4XW7dupampCYCmpiYqKysBqKiooLm5mXg8Tm9vL+FwGLfbnb4uREQkKUltDlqzZg07duxg3bp1\nZGdn893vfpef/OQnjIyM4PP5aGxsxOFwcOTIEQBcLhc+nw+Xy0VOTg4NDQ3TbioSEZG5kdQhorNF\nh4hmLh0iqkNEZfbM+SGiIiKSGRQCIiImphAQETExhYCIiIkpBERETEwhICJiYgoBERETUwiIiJiY\nQkBExMQUAiIiJqYQEBExMYWAiIiJKQRETCMncbOnZB65ucvmuwGZBUldSlpEFqOzpHIV0pERXf49\nE+mbgIiIiSkERERMTCEgImJi2icgXyg3dxkjI6fmuwwRmQW6vaR8odRvDQnzf3vGxT7/QqhBf58L\n1bzcXnJ4eJibbrqJ4uJiXC4XXV1dDA0N4fV6KSwspLy8nOHh4cT0fr8fp9NJUVERnZ2dyb6tiIik\nUdIhsHfvXrZs2cKbb77J66+/TlFREfX19Xi9Xnp6eti4cSP19fUAhEIhWlpaCIVCBAIB9uzZw+ef\nf562JkREJDlJhcAHH3zAX/7yF2pqagDIycnhkksuob29nerqagCqq6tpbW0FoK2tjaqqKiwWCw6H\ng4KCArq7u9PUgoiIJCupHcO9vb1cdtll7Ny5k9dee421a9fy8MMPE4vFsFqtAFitVmKxGAD9/f2U\nlZUl5rfb7USj0UmXXVtbm3ju8XjweDzJlCgikrGCwSDBYDAty0oqBM6ePcurr77K448/zvr167nj\njjsSm37GjJ1qPpWpXjs/BEREZKILPyDX1dUlvaykNgfZ7Xbsdjvr168H4KabbuLVV18lPz+fwcFB\nAAYGBsjLywPAZrPR19eXmD8SiWCz2ZIuWkRE0iOpEMjPz2fFihX09PQAcPToUa644gq2bt1KU1MT\nAE1NTVRWVgJQUVFBc3Mz8Xic3t5ewuEwbrc7TS2IiEiykj5Z7LHHHuOWW24hHo+zcuVKnnrqKc6d\nO4fP56OxsRGHw8GRI0cAcLlc+Hw+XC4XOTk5NDQ0TLupSERE5oZOFpMvpJPFFsL8C6EG/X0uVPNy\nspiIiCx+CgERERNTCIiImJhCQETExBQCIiImphAQETExhYCIiIkpBERETEwhICJiYgoBERETUwiI\niJiYQkBExMQUAiIiJqYQEBExMYWAiIiJKQRERExMISAiYmIKARERE1MIiIiYWEohcO7cOUpLS9m6\ndSsAQ0NDeL1eCgsLKS8vZ3h4ODGt3+/H6XRSVFREZ2dnalWLiEhapBQCjzzyCC6X6z83Iof6+nq8\nXi89PT1s3LiR+vp6AEKhEC0tLYRCIQKBAHv27OHzzz9PvXoREUlJ0iEQiUTo6Ohg165dibvct7e3\nU11dDUB1dTWtra0AtLW1UVVVhcViweFwUFBQQHd3dxrKFxGRVOQkO+Odd97Jgw8+yOnTpxNjsVgM\nq9UKgNVqJRaLAdDf309ZWVliOrvdTjQanXS5tbW1iecejwePx5NsifIfubnLGBk5Nd9liEiaBINB\ngsFgWpaVVAg8++yz5OXlUVpaOmUhWVlZic1EU70+mfNDQNJjNACMFJYw9c9RRObehR+Q6+rqkl5W\nUiHw8ssv097eTkdHB5988gmnT5/m1ltvxWq1Mjg4SH5+PgMDA+Tl5QFgs9no6+tLzB+JRLDZbEkX\nLSIi6ZHUPoEDBw7Q19dHb28vzc3NXHvttRw+fJiKigqampoAaGpqorKyEoCKigqam5uJx+P09vYS\nDodxu93p60JERJKS9D6B841t2vnlL3+Jz+ejsbERh8PBkSNHAHC5XPh8PlwuFzk5OTQ0NEy7qUhE\nROZGljF2aM8CkJWVxQIqJ2OMBm6q+wRS/bnMdw2Lff6FUIP+PheqVNadOmNYRMTEFAIiIiamEBAR\nMTGFgIiIiSkERERMTCEgImJiCgERERNTCIiImJhCQES+pJzEhSGTeeTmLpvvBmQSablshIiYwVlS\nOeN4ZESXilmI9E1ARMTEFAIiIiamEBARMTGFgIiIiSkERERMTCEgImJiCgERERNTCIiImFhSIdDX\n18cPfvADrrjiClatWsWjjz4KwNDQEF6vl8LCQsrLyxkeHk7M4/f7cTqdFBUV0dnZmZ7qRUQkJUnd\nY3hwcJDBwUGuvPJKPvzwQ9auXUtraytPPfUUl156Kffccw8HDx7k1KlT1NfXEwqF2L59O8eOHSMa\njbJp0yZ6enrIzh6fQbrH8OzQPYYzYf6FUIPuUbxQzfk9hvPz87nyyisB+NrXvkZxcTHRaJT29naq\nq6sBqK6uprW1FYC2tjaqqqqwWCw4HA4KCgro7u5OqmARWax07aGFKOV9AidPnuQf//gHV111FbFY\nDKvVCoDVaiUWiwHQ39+P3W5PzGO324lGo6m+tYgsKmPXHkruMTJyah5qznwpXUDuww8/5MYbb+SR\nRx7h4osvHvfaWHpPZarXamtrE889Hg8ejyeVEkVEMk4wGCQYDKZlWUmHwGeffcaNN97IrbfeSmVl\nJTD66X9wcJD8/HwGBgbIy8sDwGaz0dfXl5g3Eolgs9kmXe75ISAiIhNd+AG5rq4u6WUltTnIMAxu\nv/12XC4Xd9xxR2K8oqKCpqYmAJqamhLhUFFRQXNzM/F4nN7eXsLhMG63O+miRUQkPZI6Ouivf/0r\n3/ve91i9enVis47f78ftduPz+XjnnXdwOBwcOXKEr3/96wAcOHCAQ4cOkZOTwyOPPMLmzZsnFqOj\ng2aFjg7KhPkXQg3zP7/WD5NLZd2ZVAjMFoXA7FAIZML8C6GG+Z9f64fJpbLu1J3FFoHc3GU6MkJE\nZoVCYBEYDYBUP4GJiEykaweJiJiYQkBExMQUAiIiJqYQEBExMe0YngM6ukdEFiqFwBzQ0T0islBp\nc5CIiIkpBERETEwhICJiYgoBERETUwiIyCKh21POBh0dJCKLxNjtKZMzMqKj7CajbwIiIiamEBAR\nMTGFgIiIiSkERERMTDuGvwRd+0ckE+Qk7omerIsvXsrp00NpqmdhmNNvAoFAgKKiIpxOJwcPHpzL\nt07Jf6/9k+xjTHDOap57wfkuQFISnO8CZlmQ/x5dlPwjEz8MzlkInDt3jp/97GcEAgFCoRC///3v\nefPNN+fq7ReI4HwXMIuC812ApCQ43wXMsuB8F7BgzdnmoO7ubgoKCnA4HADcfPPNtLW1UVxcPOU8\nZ8+e5b77/o+PPvo46ff9n/+5iIcffjQjE1xE5lpqm5QW4uakOQuBaDTKihUrEv+22+10dXVNO8/Q\n0BD/+791aapAl3IWkVRl3glrcxYCXzY9U91xM82SF8j8yYbaQql/Ol/U22LoYSHPP9s1fJnfzfn+\nP5jv+VNfxuyt45IzZyFgs9no6+tL/Luvrw+73T5uGsNI5dO6iIjM1JztGF63bh3hcJiTJ08Sj8dp\naWmhoqJirt5eREQmMWffBHJycnj88cfZvHkz586d4/bbb592p7CIiMy+OT1P4PrrrycUCnHxxRfz\n8ssvj3vtoYceIjs7m6Gh/+459/v9OJ1OioqK6OzsnMtSk3bu3DlKS0vZunVrYuyxxx6juLiYVatW\nsX///sT4Yuvvwt66u7txu92Ulpayfv16jh07lph2sfXmcDhYvXo1paWluN1uYPTABK/XS2FhIeXl\n5QwPDyemz4T+9u3bR3FxMWvWrGHbtm188MEHiekzob8xmbBumaq/tKxbjDn20EMPGdu3bze2bt2a\nGHvnnXeMzZs3Gw6Hw3j//fcNwzCMN954w1izZo0Rj8eN3t5eY+XKlca5c+fmutwZu7C/F154wdi0\naZMRj8cNwzCMf//734ZhLM7+Luzt+9//vhEIBAzDMIyOjg7D4/EYhrE4ezv/d2/Mvn37jIMHDxqG\nYRj19fXG/v37DcPInP46OzsTde/fvz/j+jOMzFm3TNZfutYtc/pNIBKJ0NHRwa5du8btBL7rrrt4\n4IEHxk3b1tZGVVUVFosFh8NBQUEB3d3dc1nujE3W3xNPPMG9996LxWIB4LLLLgMWX3+T9bZ8+fLE\np8fh4WFsNhuw+HobY1xwYEJ7ezvV1dUAVFdX09raCmROf16vl+zs0VXAVVddRSQSATKnP8icdQtM\n7C9d65Y5DYE777yTBx98MPGLB6MF2+12Vq9ePW7a/v7+cUcP2e12otHonNWajMn6C4fDvPTSS5SV\nleHxeDh+/Diw+PqbrLf6+nruvvtuLr/8cvbt24ff7wcWX28wetjepk2bWLduHb/97W8BiMViWK1W\nAKxWK7FYDMic/s536NAhtmzZAmROf5m0bpmsv3StW+Zsx/Czzz5LXl4epaWlBINBAM6cOcOBAwd4\n7rnnEtNNluZjFtrxteebrD8YPev51KlTvPLKKxw7dgyfz8fbb7896TIWan9T9Xb77bfz6KOPcsMN\nN/CHP/yBmpqacT/L8y3U3sb87W9/Y/ny5bz77rt4vV6KiorGvT52i8KpLMb+NmzYAMD999/PkiVL\n2L59+5TzL8b+/H7/uO3hi3XdApP3l651y5yFwMsvv0x7ezsdHR188sknnD59mh07dnDy5EnWrFkD\njG5yWLt2LV1dXRPOK4hEIonNDQvRZP3deuut2O12tm3bBsD69evJzs7mvffeW1T9TdVbd3c3R48e\nBeCmm25i165dwMRzQhZyb2OWL18OjH6lvuGGG+ju7sZqtTI4OEh+fj4DAwPk5eUBmdPfhg0bePrp\np+no6OD5559PTJsJ/b344ov09vZmxLoFJv/5pW3dkvY9GF9CMBg0fvjDH04Yn2znzaeffmq8/fbb\nxre//W3j888/n+tSk3J+f7/5zW+MX/3qV4ZhGMa//vUvY8WKFYZhLN7+zu+ttLTUCAaDhmEYxtGj\nR41169YZhrH4evvoo4+M06dPG4ZhGB9++KFxzTXXGH/605+Mffv2GfX19YZhGIbf75+w43Sx9/fH\nP/7RcLlcxrvvvjtu+kzp73yLed0yVX/pWrfM2/0EJvt6cv6Yy+XC5/PhcrnIycmhoaFhwX9lO99Y\nrTU1NdTU1FBSUsKSJUt45plngMXd31idTz75JD/96U/59NNPueiii3jyySeBxddbLBbjhhtuAEY3\n391yyy2Ul5ezbt06fD4fjY2NOBwOjhw5AmROf06nk3g8jtfrBeDqq6+moaEhY/o732Jet0zV32ef\nfZaWdUuWYehaDSIiZqXbS4qImJhCQETExBQCIiImphAQETExhYCIiIkpBERETOz/AdMK+/Q77Ap6\nAAAAAElFTkSuQmCC\n"
|
|
}
|
|
],
|
|
"prompt_number": 70
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"print mean(dist),var(dist)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "stream",
|
|
"stream": "stdout",
|
|
"text": [
|
|
"500.114 246.746804\n"
|
|
]
|
|
}
|
|
],
|
|
"prompt_number": 68
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Theoretical values are:\n",
|
|
"\n",
|
|
"$$ \\bar{x} = n ~ p $$\n",
|
|
"$$ v = n ~ p ~(1-p) $$"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"print n*p\n",
|
|
"print n*p*(1-p)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "stream",
|
|
"stream": "stdout",
|
|
"text": [
|
|
"500.0\n",
|
|
"250.0\n"
|
|
]
|
|
}
|
|
],
|
|
"prompt_number": 71
|
|
},
|
|
{
|
|
"cell_type": "heading",
|
|
"level": 1,
|
|
"metadata": {},
|
|
"source": [
|
|
"Parameter Estimation"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"We often estimate parameters from measurements. Let's do this for a normal density.\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"data = randn(1000)\n",
|
|
"print mean(data),var(data)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "stream",
|
|
"stream": "stdout",
|
|
"text": [
|
|
"0.0317909909166 0.877621361124\n"
|
|
]
|
|
}
|
|
],
|
|
"prompt_number": 86
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Note that our parameter estimates themselves have a distribution of errors.\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"means = [mean(randn(1000)) for i in range(1000)]\n",
|
|
"_=hist(means,bins=100)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "display_data",
|
|
"png": "iVBORw0KGgoAAAANSUhEUgAAAXYAAAD9CAYAAACoXlzKAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAFbFJREFUeJzt3V9oW/f9//GXWqffLUtc29Q+caOAQxrT2PEfrabeoO4U\nUjnrSlxnhdCyZaJxxijbb5SMdpTNmzJY60ByU++iYWTFuSnLTTzDhmkYqCVlnbfWgUA3NspMMk9S\nmtpunDjFcXx+F65lK5b19+jfR88HmCo6f/Q5R9KL04/en89x2bZtCwBgjHsK3QAAgLMIdgAwDMEO\nAIYh2AHAMAQ7ABiGYAcAwyQM9s8//1ydnZ1qb29XU1OTXnnlFUlSIBCQ2+2Wx+ORx+PR6OhoXhoL\nAEjOlayOfW5uThs3btTCwoIee+wxnThxQn/+85+1efNmHT16NF/tBACkKGlXzMaNGyVJ8/PzunPn\njqqrqyVJjGsCgOKUNNgXFxfV3t4uy7K0Z88eNTc3S5IGBwfV1tamvr4+zczM5LyhAIDUJO2KWfbZ\nZ59p3759GhgYUFNTk2prayVJ/f39CoVCOn36dOyOXS7nWwsAZSDbHpGUq2Luv/9+PfXUU/r73/+u\nuro6uVwuuVwuHTlyRGNjY+s2jj9bv/zlLwvehmL541xwLjgXif+ckDDYr127Fu1muXXrls6fPy+P\nx6NwOBxd59y5c2ppaXGkMQCA7FUkWhgKheT3+7W4uKjFxUUdOnRIe/fu1fe+9z1dvHhRLpdL27dv\n16lTp/LVXgBAEgmDvaWlRR9++OGa58+cOZOzBpnI6/UWuglFg3OxgnOxgnPhrJR/PE17xy6XY/1F\nAFAunMhOphQAAMMQ7ABgGIIdAAxDsAOAYQh2ADAMwQ4AhiHYAcAwBDsAGIZgBwDDEOwAYBiCHQAM\nQ7ADgGEIdgAwDMFeJiora6J3vaqsrCnIfnPVBgCxmLa3TCzdg3b5/XDuvUlnv7lqA2ASpu0FAKxB\nsAOAYQh2ADAMwQ4AhiHYAcAwBDsAGIZgBwDDJAz2zz//XJ2dnWpvb1dTU5NeeeUVSdLU1JR8Pp8a\nGxvV3d2tmZmZvDQWAJBc0gFKc3Nz2rhxoxYWFvTYY4/pxIkTGhkZ0QMPPKCXX35Zx48f1/T0tAYG\nBmJ3zAClosIAJaA05GWA0saNGyVJ8/PzunPnjqqrqzUyMiK/3y9J8vv9Gh4ezqoRAADnVCRbYXFx\nUV/96lf18ccf64UXXlBzc7MikYgsy5IkWZalSCQSd9tAIBB97PV65fV6HWk0AJgiGAwqGAw6us+U\n54r57LPPtG/fPr322mv69re/renp6eiympoaTU1Nxe6YrpiiQlcMUBryOlfM/fffr6eeekoffPCB\nLMtSOByWJIVCIdXV1WXVCACAcxIG+7Vr16IVL7du3dL58+fl8XjU09OjoaEhSdLQ0JB6e3tz31IA\nQEoSdsVcunRJfr9fi4uLWlxc1KFDh/TSSy9pampKBw8e1OXLl9XQ0KCzZ8+qqqoqdsd0xRQVumKA\n0uBEdjIfe5kg2IHSwHzsAIA1CHYAMAzBDgCGIdgBwDAEOwAYhmAHAMMQ7ABgGIK9zFVW1sjlcsnl\ncqmysmbd54qtDfluI1BKGKBUJtYbHBTv+VwNOnKyDQx2gqkYoAQAWINgBwDDEOwAYBiCHQAMQ7AD\ngGEIdhSZii8qXtY+R2kjkJqkN7MG8mtBS2WMrjjPSbOzd4c+gLtxxQ4AhiHYAcAwBDsAGIZgBwDD\n8OMpCiRe9QsAJ3DFjgJZrnRh8i7AaQQ7ABgmYbBfuXJFe/bsUXNzs3bv3q3XX39dkhQIBOR2u+Xx\neOTxeDQ6OpqXxgIAkks4H3s4HFY4HFZ7e7tu3LihRx55RMPDwzp79qw2b96so0ePrr9j5mMvKsU4\nH3vix+svT7eNQClxIjsT/ni6ZcsWbdmyRZK0adMm7dq1S5OTk5LEFwkAilTKVTETExMaHx/X1772\nNb333nsaHBzUmTNn1NHRoZMnT6qqqmrNNoFAIPrY6/XK6/U60WYAMEYwGFQwGHR0nyndGu/GjRvy\ner36+c9/rt7eXl29elW1tbWSpP7+foVCIZ0+fTp2x3TFFBW6YoDSkJdb492+fVvPPPOMvvvd76q3\nt1eSVFdXF51t78iRIxobG8uqEQAA5yQMdtu21dfXp6amJr344ovR50OhUPTxuXPn1NLSkrsWAgDS\nkrAr5sKFC3r88cfV2toaHSX46quv6q233tLFixflcrm0fft2nTp1SpZlxe6YrpiiQlcMUBqcyM6U\n+tgz2jHBXlQIdqA05KWPHQBQWgh2GKWysobb6KHsMbsjjDI7Oy1uo4dyxxU7ABiGYAcAwxDsAGAY\ngh0ADEOwG8jZypCKIqsySf+WelTKoNwwQMlA6Qw6SmXdRAOBCjFAKd5ypwZcAYXGACUAwBoEOwAY\nhmAHAMMQ7ABgGIIdAAxDsCMnVpcYulz3pV2i6Iz0SyMBEzAJGHJi9WRcsSWK+bRQoNcFCosrdgAw\nDMEOAIYh2AHAMAQ7ABiGYAcAwxDsAGAYgh0ADJMw2K9cuaI9e/aoublZu3fv1uuvvy5Jmpqaks/n\nU2Njo7q7uzUzM5OXxgIAkks4H3s4HFY4HFZ7e7tu3LihRx55RMPDw3rzzTf1wAMP6OWXX9bx48c1\nPT2tgYGB2B0zH3vBFMN87PH3kf/52BOtCxSjnM/HvmXLFrW3t0uSNm3apF27dmlyclIjIyPy+/2S\nJL/fr+Hh4awaAQBwTspTCkxMTGh8fFydnZ2KRCKyLEuSZFmWIpFI3G0CgUD0sdfrldfrzaqxKB6V\nlTVfTBuwGnOzAOkKBoMKBoOO7jOlW+PduHFD3/jGN9Tf36/e3l5VV1drenrlS11TU6OpqanYHdMV\nUzD56IpZWcfJ7pV01qUrBmbKy63xbt++rWeeeUaHDh1Sb2+vpKWr9HA4LEkKhUKqq6vLqhEAAOck\nDHbbttXX16empia9+OKL0ed7eno0NDQkSRoaGooGPgCg8BJ2xVy4cEGPP/64Wltbo32nr732mh59\n9FEdPHhQly9fVkNDg86ePauqqqrYHdMVUzB0xdAVg9LlRHam1Mee0Y4J9oIh2Al2lK689LEDAEoL\nwY5VyrdccflWfpWVNYVuCpA1bo2HVcr3VnLLt/KbnS2/Y4d5uGIHAMMQ7ABgGIIdAAxDsAOAYQj2\nEpdZNcdS9Uu5VsAApqMqpsRlVs2xXP0ilWMFDGA6rtgBwDAEOwAYhmAHAMMQ7ABgGH48NUb5zvMC\nIBZX7MZYrnRhSlqg3BHsAGAYgh0ADEOwA4BhCHYAMAzBDgCGIdiN52QZpAmTh60cQ/yJ05ItB4of\ndezGc/J2dyZMHrZyDPEnTku2HCh+XLEDgGGSBvvhw4dlWZZaWlqizwUCAbndbnk8Hnk8Ho2Ojua0\nkQCA1CUN9ueff35NcLtcLh09elTj4+MaHx/XN7/5zZw1EACQnqTB3tXVperq6jXP2zZD1wGgGGX8\n4+ng4KDOnDmjjo4OnTx5UlVVVWvWCQQC0cder1derzfTl8MqlZU1X9w5CUvyOwHa8vnfvLla169P\n5e11YaZgMKhgMOjoPl12CpfeExMT2r9/vy5duiRJunr1qmprayVJ/f39CoVCOn36dOyOXS6u6nNk\nKcRWV6fYq/6rdR4nW15q6zqzr+XP6Mo5jb98tdXr8hmH05zIzoyqYurq6qK1vkeOHNHY2FhWjQAA\nOCejYA+FQtHH586di6mYAQAUVtI+9ueee07vvPOOrl27pm3btunYsWMKBoO6ePGiXC6Xtm/frlOn\nTuWjrQCAFKTUx57Rjuljzxn62Oljh7kK1scOACheBDvKWLJJzZgQDKWJScBQxpJNasaEYChNXLED\ngGEIdgAwDMEOAIYh2AHAMAQ7kEOVlTVU1SDvqIoBcmhpFk6bqhrkFVfsAGAYgh0ADEOwA4BhCHYA\nMAzBXkDLFRNUTQBwElUxBbRcMbH0mKoJAM7gih0ADEOwA4BhCHYAMAzBDgCGIdgBwDAEO+Cw1WWs\nQCEQ7IDDVspYs7vTPJApgh0ADJM02A8fPizLstTS0hJ9bmpqSj6fT42Njeru7tbMzExOGwkASF3S\nYH/++ec1Ojoa89zAwIB8Pp/+9a9/ae/evRoYGMhZAwEA6Uka7F1dXaquro55bmRkRH6/X5Lk9/s1\nPDycm9YBANKW0VwxkUhElmVJkizLUiQSibteIBCIPvZ6vfJ6vZm8XJmoiFZRbN5crevXpwrcHsSq\noMoFOREMBhUMBh3dp8u27aQ/3U9MTGj//v26dOmSJKm6ulrT09PR5TU1NZqaig0il8ulFHZd1paC\nYvkcxT5OdO7ib7f+vlJbXmrrFkcb471P670/fB+QCieyM6OqGMuyFA6HJUmhUEh1dXVZNQIA4JyM\ngr2np0dDQ0OSpKGhIfX29jraKABA5pJ2xTz33HN65513dO3aNVmWpV/96ld6+umndfDgQV2+fFkN\nDQ06e/asqqqqYndMV0xSdMXQFQPczYnsTKmPPaMdE+xJEewEO3C3gvWxI33L84ekcwu81XOOuFz3\nMf8IgJRwa7w8WZ4/JJ1b4K2+dd7aK0YAiI8rdgAwDMEOAIYh2AHAMAQ7ABiGYAcAwxDsQMYqoiWo\nmZaxxtsu2XIgGQYo5cnKoJWV85JsgFKi5aU6oMfk40n8vq6//O7vSbLlMBsDlAAAaxDsAGAYgh0A\nDEOwA4BhCPY0xatYWG+yrswrGrgNW+mpyHCStgqqX+A4qmLSFK9iIZXpd9OtiimHKpJyOx6nqmZg\nNqpiAABrEOwAYBiCHQAMQ7ADgGEIdgAwDLfGy0qyssR4yyllBJBbXLFnZUErZWmJlttJngMA5xDs\nAGCYrLpiGhoaVFlZqXvvvVcbNmzQ2NiYU+0CAGQoq2B3uVwKBoOqqWE4NAAUi6y7YhjuDADFJesr\n9ieeeEL33nuvfvCDH+j73/9+zPJAIBB97PV65fV6s3m5gqmsrNHs7HShm4GSlmk11Mp2mzdX6/r1\nKWebhYILBoMKBoOO7jOrScBCoZDq6+v1ySefyOfzaXBwUF1dXUs7NmgSsPxO1pWrdUuhjeV9PKne\nMhFmK/gkYPX19ZKk2tpaHThwgB9PAaAIZBzsc3Nzmp2dlSTdvHlTb7/9tlpaWhxrGAAgMxn3sUci\nER04cECStLCwoO985zvq7u52rGEAgMxwo40U0MdejOuWQhvTOx762CEVQR87AKdkdms952/LCBMw\nCRhQFFbPO5R6uC+V4a69up+dZaK5csYVOwAYhmAHAMMQ7ABgGIIdAAxDsAOAYco22JOVia1eDhSH\nijWf12Trri57XP2ZphzSbGU7QCnZIJDkg5JWPy6FdUuhjRxPLl53vYFPxfz9LGcMUAIArEGwA4Bh\nCHYAMAzBDgCGKalgz/RX/XgVMABgqpKaBGz1hEfpTHIUf6Ikwh2AmUrqih0AkBzBDgCGIdgBwDB5\n62O/deuWbt68KUn68pe/rK985Sv5emkAKCt5u2Lv7NyjrVsfktvdqB07mhzYY0WcuV64NRiQmoqE\n35X15lJafpzOHDSZ3r4v3nZ8r1OTtyv269fnND//rqR63bzpRLDffSux2Dk0uDUYkMjK9yfed2W9\nW+4tP169TbJqtUxv3xdvO77XqaGPHQAMk3Gwj46O6uGHH9bOnTt1/PhxJ9tkoGChG1BEgoVuQBEJ\nFroBRSMYDBa6CUbJKNjv3LmjH/3oRxodHdVHH32kt956S//4xz+cbptBgoVuQBEJFroBRSRY6AYU\nDYLdWRkF+9jYmB566CE1NDRow4YNevbZZ/WHP/zB6bYBADKQ0Y+nk5OT2rZtW/Tfbrdbf/3rXxO/\nUMU92rTp/8nl+j/dcw9d+wCQKxkFe6qTaCVaL/OJuFxJHq88F/saideNv12y7ZPvq7jWLYY2Hvvi\nz4n9FsPxFP/7k/x7sN73MbP9prOv1eseO3ZMayV7XcSTUbBv3bpVV65cif77ypUrcrvdMetw2y0A\nKIyM+kQ6Ojr073//WxMTE5qfn9fvf/979fT0ON02AEAGMrpir6io0G9+8xvt27dPd+7cUV9fn3bt\n2uV02wAAGcj4V8wnn3xSf/nLX7R9+3a9+eab6u7u1szMTNx1Dx8+LMuy1NLSEvP81NSUfD6fGhsb\nE25fClI9lvXq/wOBgNxutzwejzwej0ZHR/PVdMekMrbhxz/+sXbu3Km2tjaNj4+ntW0pyeZcNDQ0\nqLW1VR6PR48++mi+mpwzyc7FP//5T33961/Xl770JZ08eTKtbUtNNucirc+FnYWXXnrJPn78uG3b\ntj0wMGD/9Kc/jbveu+++a3/44Yf27t27M9q+FKRyLAsLC/aOHTvs//znP/b8/Lzd1tZmf/TRR7Zt\n23YgELBPnjyZ1zY7KdGxLfvjH/9oP/nkk7Zt2/b7779vd3Z2prxtKcnmXNi2bTc0NNiffvppXtuc\nK6mci6tXr9p/+9vf7J/97Gf2iRMn0tq2lGRzLmw7vc9FVnWHIyMj8vv9kiS/36/h4eG463V1dam6\nujrj7UtBKseSrP7fLuEfnFMZ27D6HHV2dmpmZkbhcNi4cRGZnotIJBJdXsqfhdVSORe1tbXq6OjQ\nhg0b0t62lGRzLpal+rnIKtgjkYgsy5IkWZYV88HMx/bFJJVjiVf/Pzk5Gf334OCg2tra1NfXV3Ld\nUsmOLdE6//vf/5JuW0qyORfSUjnfE088oY6ODv32t7/NT6NzJJVzkYtti1G2x5PO5yLpj6c+n0/h\ncHjN87/+9a/XvGg29aXZbp8P2Z6LRMf3wgsv6Be/+IUkqb+/Xz/5yU90+vTpLFucP6m+d6ZciSaS\n7bm4cOGCHnzwQX3yySfy+Xx6+OGH1dXV5WQT8ybbTDBJtsfz3nvvqb6+PqXPRdJgP3/+/LrLLMtS\nOBzWli1bFAqFVFdXl1ZDs90+37I9F4nq/1evf+TIEe3fv9/BludeKmMb7l7nv//9r9xut27fvp10\n21KS6bnYunWrJOnBBx+UtPS/5QcOHNDY2FjJBnsq5yIX2xajbI+nvr5eUmqfi6y6Ynp6ejQ0NCRJ\nGhoaUm9vb163LyapHEui+v9QKBRd79y5c2sqiIpdKmMbenp6dObMGUnS+++/r6qqKlmWZdy4iGzO\nxdzcnGZnZyVJN2/e1Ntvv11yn4XV0nlv7/4/mHL8XCy7+1yk/bnI5lfeTz/91N67d6+9c+dO2+fz\n2dPT07Zt2/bk5KT9rW99K7res88+a9fX19v33Xef7Xa77d/97ncJty9FqZ6LP/3pT3ZjY6O9Y8cO\n+9VXX40+f+jQIbulpcVubW21n376aTscDuf9GLIV79jeeOMN+4033oiu88Mf/tDesWOH3draan/w\nwQcJty1lmZ6Ljz/+2G5ra7Pb2trs5ubmsjgXoVDIdrvddmVlpV1VVWVv27bNnp2dXXfbUpbpuUj3\nc+Gy7TLo9ASAMsI0iwBgGIIdAAxDsAOAYQh2ADAMwQ4AhiHYAcAw/x+uASDM0VNLDQAAAABJRU5E\nrkJggg==\n"
|
|
}
|
|
],
|
|
"prompt_number": 87
|
|
},
|
|
{
|
|
"cell_type": "heading",
|
|
"level": 1,
|
|
"metadata": {},
|
|
"source": [
|
|
"Extreme Value Distributions"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Another interesting example is extreme value distributions. They matter a great deal in biology and business, where \"the best\" of a population often \"win\" or are measured. They also matter when people tell you statistics like \"90 percent of population X are women/men, therefore there must be bias\".\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"N = 100000\n",
|
|
"maxs = array([amax(randn(N)) for i in range(1000)])\n",
|
|
"_=hist(maxs,bins=100)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "display_data",
|
|
"png": "iVBORw0KGgoAAAANSUhEUgAAAWwAAAD9CAYAAACY0k3rAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAFH9JREFUeJzt3X9oXfX9x/HXadPBN5rbJF+T22JkKdjSpqbN1WLGsHqL\nJl3r2qUTiv26eqetiCDDFSYUVnYV0RT1j1lByiiS/tOtbDQLs2bKxhHUrcEthYJj6iA0LfdeLTcx\niVXbJPf7R5bbe5P74+T+/pz7fEDh5t7zOfedc09eHj/3cz4fKxaLxQQAqHjLyl0AAMAZAhsADEFg\nA4AhCGwAMASBDQCGILABwBAZA/ubb75RZ2enOjo61NbWpsOHD0uSgsGgWlpa5PP55PP5NDg4WJJi\nAaCaWdnGYV+9elW1tbWanp7WPffco1deeUV/+ctfVFdXp0OHDpWqTgCoelm7RGprayVJ165d08zM\njBoaGiRJ3G8DAKWVNbBnZ2fV0dEhr9erbdu2aePGjZKkY8eOafPmzTpw4IDGx8eLXigAVLusXSLz\nvvzyS23fvl29vb1qa2tTU1OTJOnIkSMKhUI6ceJE8o4tq/DVAkAVSBfLjkeJrFy5Ug8++KA++ugj\nNTc3y7IsWZalgwcPamhoKO2bVtq/X/3qV2Wvodr+ccw55tXwr1DHPJOMgX3lypV4d8fXX3+td999\nVz6fT+FwOL7NmTNn1N7e7jT3AQA5qsn0YigUUiAQ0OzsrGZnZ7V//37df//9evTRR3X+/HlZlqU1\na9bo+PHjpaoXAKpWxsBub2/XP//5z0XPnzx5smgFFZvf7y93CVWHY156HPPSK8Uxd/yl45J3bFlZ\n+2MAAMkyZSe3plcZj6cx/oWxx9NY7nIALAFX2FVmbrjl/OfCZwRUGq6wAcAFCGwAMASBDQCGILAB\nwBAENgAYgsAGAEMQ2ABgCAIbAAxBYAOAIQhsADAEgQ0AhiCwAcAQBDYAGILABgBDENgAYAgCGwAM\nQWADgCEIbAAwBIENAIYgsAHAEBkD+5tvvlFnZ6c6OjrU1tamw4cPS5Ki0ai6urq0bt06dXd3a3x8\nvCTFAkA1y7pq+tWrV1VbW6vp6Wndc889euWVVzQwMKBbbrlFzz77rI4ePaqxsTH19vYm75hV0ysS\nq6YDlS2vVdNra2slSdeuXdPMzIwaGho0MDCgQCAgSQoEAurv7y9guQCAVGqybTA7O6s777xT//nP\nf/TUU09p48aNikQi8nq9kiSv16tIJJKybTAYjD/2+/3y+/0FKdo0Hk+jJifHJEl1dQ2amIiW7f0B\nVBbbtmXbtqNts3aJzPvyyy+1fft2vfTSS/rxj3+ssbEbAdDY2KhoNDmE6BK5odzdEAvfny4RoHLl\n1SUyb+XKlXrwwQf1j3/8Q16vV+FwWJIUCoXU3NxcmEoBAGllDOwrV67ER4B8/fXXevfdd+Xz+bR7\n92719fVJkvr6+tTT01P8SgGgymXsErlw4YICgYBmZ2c1Ozur/fv36xe/+IWi0aj27t2rixcvqrW1\nVadPn1Z9fX3yjukSiaNLBIBTmbLTcR92Id+02hDYAJwqSB82AKC8COwK4fE0yrKs+D+PpzHla4nP\nA6gudImUgJMukeRtkrfLt0uFLhHAHHSJAIALENgAYAgCGwAMQWADgCEIbAAwBIENAIYgsAHAEAQ2\nABiCwAYAQxDYAGAIAhsADEFgu1TihFEA3IHAdqm5RXdjSp5QCoDJCGwAMASBDQCGILABwBAENgAY\ngsAuuRqHy33VpBnlkbr9wiXGyoGlzIDiYomwEnCyRFeqJcLStSlG+0Io9+rwgBuwRBgAuEDGwB4d\nHdW2bdu0ceNG3XHHHXrttdckScFgUC0tLfL5fPL5fBocHCxJsQBQzTJ2iYTDYYXDYXV0dGhqakp3\n3XWX+vv7dfr0adXV1enQoUPpd0yXSBxdIgCcypSdNZkarlq1SqtWrZIk3XzzzdqwYYMuX74sSfwx\nAkCJZQzsRCMjIxoeHtb3vvc9ffDBBzp27JhOnjypLVu26NVXX1V9ff2iNsFgMP7Y7/fL7/cXouaK\n4fE0/vcWcKmurkETE9EyV7RUNfERJWbWD5jPtm3Ztu1oW0ejRKampuT3+/XLX/5SPT09+vzzz9XU\n1CRJOnLkiEKhkE6cOJG84yroEnHaBVDJXSKF7MKgSwTIX16jRK5fv66HHnpIP/nJT9TT0yNJam5u\njo+3PXjwoIaGhgpbMQBgkYyBHYvFdODAAbW1temZZ56JPx8KheKPz5w5o/b29uJVCACQlKVL5P33\n39e9996rTZs2xfs6X3zxRZ06dUrnz5+XZVlas2aNjh8/Lq/Xm7xjukTSbkeXCIB0MmUndzrmgcBO\nRmAD+eNORwBwAcfD+lCJbgzLA+B+XGEbbVosAwZUDwIbAAxBYAOAIQhsADAEgQ0AhiCwkbNcliVj\nGTEgd9w4k4dKuHEm9ePc2i/188pWc6r9cXMNkBk3zgCACxDYAGAIAhsADEFgA4AhCGwAMASBXVY1\nSxoSZ5Yahu8BBcZsfWU1P3mTNDckzk1u/G6Tk2773YDy4AobAAxBYAOAIQhsADAEgQ0AhiCwiyCX\nSZEqDZM0AZWHyZ/ykG4io/wncsqlTWEnf3IySdNSfs/Ux8b95wiwVEz+BAAukDGwR0dHtW3bNm3c\nuFF33HGHXnvtNUlSNBpVV1eX1q1bp+7ubo2Pj5ekWACoZhm7RMLhsMLhsDo6OjQ1NaW77rpL/f39\nevPNN3XLLbfo2Wef1dGjRzU2Nqbe3t7kHdMlkril6BKhSwRwIucukVWrVqmjo0OSdPPNN2vDhg26\nfPmyBgYGFAgEJEmBQED9/f0FLhkAsJDjW9NHRkY0PDyszs5ORSIReb1eSZLX61UkEknZJhgMxh/7\n/X75/f68ii0Xj6dRk5NjkqS6ugZNTERTbFVj7IiQOZnqT3xthaTrRanA2XEG3MW2bdm27WhbR6NE\npqamdN999+nIkSPq6elRQ0ODxsbG4q83NjYqGk3+43JTl4izro9Cdk/k0qbc7TNv56RLhO4SIM9R\nItevX9dDDz2k/fv3q6enR9LcVXU4HJYkhUIhNTc3F7BcAEAqGQM7FovpwIEDamtr0zPPPBN/fvfu\n3err65Mk9fX1xYMcAFA8GbtE3n//fd17773atGlTvA/zpZde0t133629e/fq4sWLam1t1enTp1Vf\nX5+8Y7pEEvfgYLtyd2nQJQJUgkzZyZ2ODhDYBDZQKtzpCAAuwIozKAHThzwClYErbJTA/HJhdHEA\n+SCwAcAQBDYAGILABgBDENgAYAhGiaCMGD0CLAWBjTKaHz0yj/AGMqFLBAAMQWADgCEIbAAwBIEN\nAIYgsAHAEAQ2ABiCwAYAQxDYAGAIAhsADEFgA4AhCGwAMERVB7bH0yjLsmRZljyexpTPL56cqCbN\n8yismpSfDVDNqnrVdGeroc+9VkkrkFdm++K+Z6WfS0ChsGo6ALhA1sB+/PHH5fV61d7eHn8uGAyq\npaVFPp9PPp9Pg4ODRS0SAOAgsB977LFFgWxZlg4dOqTh4WENDw/rBz/4QdEKBADMyRrYW7duVUND\nw6Ln6VMEgNLKecWZY8eO6eTJk9qyZYteffVV1dfXL9omGAzGH/v9fvn9/lzfDigKj6dRk5NjkqS6\nugZNTETLXBGqjW3bsm3b0baORomMjIxo165dunDhgiTp888/V1NTkyTpyJEjCoVCOnHiRPKOGSWS\nR/tyvGdl11yscyndOQCUS8FHiTQ3N8fHyB48eFBDQ0N5FQgAyC6nwA6FQvHHZ86cSRpBAgAojqx9\n2Pv27dN7772nK1eu6LbbbtNzzz0n27Z1/vx5WZalNWvW6Pjx46WoFQCqGnc60odtRM30YaNacKcj\nALgAgR3HpE6mWThJF5NEwe1yHoftPtNK/t9xVLq58dOxhJ/53OBuXGEDgCEIbAAwBIENAIYgsAHA\nEK4MbEYPVKvsy4o5Xf6NcwaVyJU3zqS68SVVLQtvmqiWm1BMrDn751eYNtxEg3LjxhkAcAECGwAM\nQWADgCEIbAAwBIENoySO8gCqDYENo9yYP4QRHKg+BDYAGILABgBDENgAYAgCGwAMQWADgCEIbBgg\nv+Xb8h0KmNieSaFQTiwRBgPkt3xb8lJi+bVnGTKUE1fYAGCIrIH9+OOPy+v1qr29Pf5cNBpVV1eX\n1q1bp+7ubo2Pjxe1SACAg8B+7LHHNDg4mPRcb2+vurq69Mknn+j+++9Xb29v0QoEAMzJGthbt25V\nQ0ND0nMDAwMKBAKSpEAgoP7+/uJUBwCIy+lLx0gkIq/XK0nyer2KRCIptwsGg/HHfr9ffr8/l7cD\nANeybVu2bTva1tESYSMjI9q1a5cuXLggSWpoaNDY2Fj89cbGRkWj0eQds0RYHu3L8Z7uq3n+M0//\nOWfed7r2LB2GYir4EmFer1fhcFiSFAqF1NzcnHt1AABHcgrs3bt3q6+vT5LU19ennp6eghYFAFgs\na5fIvn379N577+nKlSvyer16/vnn9aMf/Uh79+7VxYsX1draqtOnT6u+vj55x3SJ5NG+HO/pvprp\nEoGJMmWnoz7sQr9psRHY1Exgw1QF78MGAJQegQ0AhiCwAcAQBDYAGILABgBDENgAYAgCGwAMUSWB\nXcMST6hILD+GpaiSJcJuLDHFEk+oJCw/hqWokitsADAfgQ0AhiCwAcAQBDYAGKJKvnRMVPPf2dfg\nbnzOcJ8qvMKeHzHCFJnuxucM96nCwAYAMxHYAGAIAhsADEFgA4AhCGwAMASBDVS4xAmimCSqulXh\nOGzALIkTRM39zPjyasUVNgAYIq8r7NbWVnk8Hi1fvlwrVqzQ0NBQoeoCACyQV2BbliXbttXYSJ8a\nABRb3l0isRi3/gJAKeR9hf3AAw9o+fLlevLJJ/XEE08kvR4MBuOP/X6//H6/o/16PI3//aJFqqtr\n0MRE1NFrQOE4mzyqWOdj4n7hbrZty7ZtR9tasTwukUOhkFavXq0vvvhCXV1dOnbsmLZu3Tq3Y8vK\n+ep77g9lvm3yfjK9lnqbue0S2yztcTnaU3Ml17zU8zGTdO0XPr+wZv7P1r0yZWdeXSKrV6+WJDU1\nNWnPnj186QgARZRzYF+9elWTk5OSpK+++krvvPOO2tvbC1YYACBZzn3YkUhEe/bskSRNT0/rkUce\nUXd3d8EKAwAky6sPO+OO6cPOoz01V3LN9GGjmIrWhw0gu8S5QAo9D0gx943Kw1wiQJElzgVS6HlA\nirlvVB6usAHAEAQ2ABiCwAYAQxDYAGAIAhsADFExgZ04PClZTdLySOleY0gTSiPf89FZ+3xry/fv\nodDDBRl+WBgVc+NM+hsFnN/okPqmg8xt3HRDBzVX1ns6vQkml/fMvu/8bq7J94agYu/PzbhxBgBc\ngMAGAEMQ2ABgiJLemn7q1CldvnxZkrRs2TL99Kc/ZT1IAHCopIH9xBNP69tvH5b0P6qp+YPWr1+v\nnTt3FmjvzpZ0Akqjcs7HhcuNJS5lxpJ7N2Q6TpWipIEdi0nT089L+l/ddNPHBd77tJK/LQfKqXLO\nx8QJouZ+tlK+Vu2TR2U6TpWCPmwAMASBDQCGILABwBAENgAYgsAGjONkzpFM2yx1zpLk+U8s6zsp\n5wVxPl9I9jlPEveV6T0ztSnWnCXpfs9M71+ouVRYIgwwjpMRKJm2WeoIlsTt59ssHlnifMTJdNbt\nFo7YSPeemdoUa5RHut+zFKNxuMIGAEPkHNiDg4Nav3691q5dq6NHjxayJgBACjkF9szMjJ5++mkN\nDg7q448/1qlTp/Svf/2r0LUBABLkFNhDQ0O6/fbb1draqhUrVujhhx/WH//4x0LXBgBIkNOXjpcv\nX9Ztt90W/7mlpUXnzp3L2m758mWqq/s/LVv2HX377UdatowudABwKqfAdjocKPV278Qf7dixY2EL\nB4+dbpdvm3K3L8d7UrMZ7Yv3nsl/s87ap2uz+O/f6XZLfc/0bZY+AZfT9k6O2VKOjTM5Bfatt96q\n0dHR+M+jo6NqaWlJ2oYlgACgsHLqk9iyZYs+/fRTjYyM6Nq1a/rd736n3bt3F7o2AECCnK6wa2pq\n9Prrr2v79u2amZnRgQMHtGHDhkLXBgBIkPO3fjt27NC///1vffbZZzp8+HAhayqImZkZ+Xw+7dq1\nK+XrP/vZz7R27Vpt3rxZw8PDJa7OnTIdc9u2tXLlSvl8Pvl8Pr3wwgtlqNBdWltbtWnTJvl8Pt19\n990pt+E8L7xsx72Y57prb03/9a9/rba2Nk1OTi567ezZs/rss8/06aef6ty5c3rqqaf097//vQxV\nukumYy5J9913nwYGBkpclXtZliXbttMus8d5XhzZjrtUvHPdlePqLl26pLNnz+rgwYMpv/wcGBhQ\nIBCQJHV2dmp8fFyRSKTUZbpKtmMu8UV0MWQ6ppznxZPtXC7Wue7KwP75z3+ul19+Oe0471TjyC9d\nulSq8lwp2zG3LEsffvihNm/erJ07d+rjjwu9RFz1sSxLDzzwgLZs2aLf/OY3i17nPC+ObMe9mOe6\n67pE/vSnP6m5uVk+n0+2bafdbuF/AStlwVQTOTnmd955p0ZHR1VbW6u3335bPT09+uSTT0pbqMt8\n8MEHWr16tb744gt1dXVp/fr12rp1a9I2nOeFl+24F/Ncd90V9ocffqiBgQGtWbNG+/bt01//+lc9\n+uijSdssHEd+6dIl3XrrraUu1TWcHPO6ujrV1tZKmvvC+vr164pGK2tFatOsXr1aktTU1KQ9e/Zo\naGgo6XXO8+LIdtyLeq7HXMy27dgPf/jDRc+/9dZbsR07dsRisVjsb3/7W6yzs7PUpblWumMeDodj\ns7OzsVgsFjt37lzsu9/9bokrc5evvvoqNjExEYvFYrGpqanY97///dif//znpG04zwvPyXEv5rnu\nui6Rheb/F/D48eOSpCeffFI7d+7U2bNndfvtt+umm27Sm2++Wc4SXSfVMf/973+vN954QzU1Naqt\nrdVvf/vbcpZovEgkoj179kiSpqen9cgjj6i7u5vzvMicHPdinutWLMZX9wBgAtf1YQOAWxHYAGAI\nAhsADEFgA4AhCGwAMASBDQCG+H936GRTzxECtQAAAABJRU5ErkJggg==\n"
|
|
}
|
|
],
|
|
"prompt_number": 102
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"This kind of bias (around 20 percent of the standard deviation here) leads to a bias in maxima.\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"max1s = array([amax(randn(N)+0.2) for i in range(1000)])\n",
|
|
"_=hist(maxs,bins=100,alpha=0.7)\n",
|
|
"_=hist(max1s,bins=100,alpha=0.7)\n",
|
|
"sum(max1s>maxs)*1.0/len(maxs)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "pyout",
|
|
"prompt_number": 103,
|
|
"text": [
|
|
"0.70599999999999996"
|
|
]
|
|
},
|
|
{
|
|
"output_type": "display_data",
|
|
"png": "iVBORw0KGgoAAAANSUhEUgAAAXMAAAD9CAYAAABOd5eOAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAHk9JREFUeJzt3X1MVHfaN/DvUUdnqS7qPjKYgTuQtqSiqENd3eyjt6MU\nXMeF4K1p1tulE5XG0OxLxWSj2ehCsnHZmKaxbO8N2bgN1kTbuNHF3ix39ZFZqsYhXcBu+kaZ4lMg\nzGx9LAqDzOt5/qBn5GWY1zPA/Ph+EhJm5pzfXKfHXh7Pda7fT5JlWQYRESW1eTMdABERxY/JnIhI\nAEzmREQCYDInIhIAkzkRkQCYzImIBBBRMvf5fDAYDCguLgYAVFVVISMjAwaDAQaDAU1NTQkNkoiI\nQlsQyUZnzpxBbm4uBgcHAQCSJKGyshKVlZUJDY6IiCIT9sq8t7cXjY2NKC8vh9JfJMsy2GtERDR7\nhE3mR44cwenTpzFv3pNNJUlCbW0t1q1bh0OHDmFgYCChQRIRURhyCFevXpVfeeUVWZZlubm5Wf7x\nj38sy7IsOxwO2e/3y36/X/71r38tHzx4MOj+APjDH/7whz8x/EQr5B7Hjx+XMzIy5KysLDk9PV1O\nSUmRy8rKxm3T3d0tr1mzZspkLrLf/OY3Mx1Cwoh8bLLM40t2oh9fLLkz5G2WU6dOoaenB93d3bh4\n8SK2b9+Oc+fOob+/P7DN5cuXkZeXF2oYIiJKsIieZgEAWZYhSRIA4Fe/+hXu3r0LSZKQnZ2Nurq6\nhAVIREThRZzMjUYjjEYjAODtt99OVDxJRfnvISKRjw3g8SU70Y8vFtK392cSM7gk8RFGIqIoxZI7\n2c5PRCQAJnMiIgEwmRMRCYDJnIhIAEzmREQCYDInIhIAkzkRkQCYzImIBMBkTkQkACZzIiIBMJkT\nEQmAyZyISABM5kREAoh4ClwSi2m3CfZv7ACA9GXpaLzcOMMREVE8mMznKPs3dugP6wEAfXV9MxwN\nEcUrotssPp8PBoMBxcXFAIAHDx6gsLAQOTk5KCoqwsDAQEKDJCKi0CJK5mfOnEFubm5g2biamhoU\nFhais7MTBQUFqKmpSWiQREQUWthk3tvbi8bGRpSXlwdWvmhoaIDZbAYAmM1mXLlyJbFREhFRSGHv\nmR85cgSnT5/Go0ePAu85HA7odDoAgE6ng8PhmHL/qqqqwO9j1xGl2aOrswv5xvxAIZTFUaLpZbFY\nYLFY4hojZDJ/7733kJaWBoPBMOUXSZIUuP0SzNhkTrOTF17oD+sDhVAWR4mm18QL3erq6qjHCJnM\nb9++jYaGBjQ2NmJkZASPHj1CWVkZdDod7HY70tPT0d/fj7S0tKi/mIiI1BPynvmpU6fQ09OD7u5u\nXLx4Edu3b8fbb7+NkpIS1NfXAwDq6+tRWlo6LcESEVFwUXWAKrdTjh07hmvXriEnJwc3btzAsWPH\nEhIcERFFJuKmoa1bt2Lr1q0AgOXLl+P69esJC4rioxQwWbwkmjs4N4uAlAKm8kQKEYmPyZyISABM\n5kREAmAyJyISAJM5EZEAmMyJiATAZE5EJAAmcyIiATCZExEJgMmciEgATOZERAJgMiciEgCTORGR\nAJjMiYgEEPEUuJTcOC0ukdh4ZT5HcFpcIrGFTeYjIyPYtGkT1q9fj9zcXBw/fhzA6ELNGRkZMBgM\nMBgMaGpqSniwREQUXNjbLFqtFs3NzUhJSYHX68XmzZtx8+ZNSJKEyspKVFZWTkecREQUQkS3WVJS\nUgAAbrcbPp8Py5YtAwDIspy4yIiIKGIRFUD9fj/y8/Nhs9lQUVGB1atX49KlS6itrcW5c+ewYcMG\nvPbaa1i6dOmkfauqqgK/G41GGI1GtWKnadDV2YV8Yz4Lp0QJZLFYYLFY4hojomQ+b948dHR04OHD\nh9ixYwcsFgsqKipw8uRJAMCJEydw9OhRnD17dtK+Y5M5JR8vvNAf1qOvrm+mQyES1sQL3erq6qjH\niOppltTUVOzatQsffvgh0tLSIEkSJElCeXk5Wltbo/5yIiJSR9hkfv/+fQwMDAAAHj9+jGvXrsFg\nMMBuf/KI2+XLl5GXl5e4KImIKKSwt1n6+/thNpvh9/vh9/tRVlaGgoICvPTSS+jo6IAkScjOzkZd\nXd10xEtEREGETeZ5eXloa2ub9P65c+cSEhDFz9Z1D7aWPqDLo/rYSicpABZFiWYRdoAKyOPxQavd\nCI/Hp/rYSicpu0mJZhcmcyIiATCZExEJgMmciEgAnAJXYK7HTuQb8wEANpsNeuhnOCIiShRemQtM\nXiAHipUen/pPthDR7MFkTkQkACZzIiIBMJkTEQmABVCKG7tCiWYekznFTekKBcCpcolmCG+zEBEJ\ngMmciEgATOZERAJgMqcAZb1Pm82WkO2JKHGYzClAWe8z0m7RaLcnosQJmcxHRkawadMmrF+/Hrm5\nuTh+/DgA4MGDBygsLEROTg6KiooCy8oREdHMCJnMtVotmpub0dHRgY8++gjNzc24efMmampqUFhY\niM7OThQUFKCmpma64iUioiDC3mZJSUkBALjdbvh8PixbtgwNDQ0wm80AALPZjCtXriQ2SiIiCils\n05Df70d+/miRq6KiAqtXr4bD4YBOpwMA6HQ6OByOKfevqqoK/G40GmE0GuMOWiQm0z7Y7UNIT1+M\nxsYL0e8/pvuyx2ZH5orn4XK7sUTtQIkoYSwWCywWS1xjhE3m8+bNQ0dHBx4+fIgdO3agubl53OeS\nJEGSpCn3H5vMaTK7fQh6/VX09RXHtv+Y7svPXrVBr7+Kji+1aoZIRAk28UK3uro66jEifpolNTUV\nu3btwj/+8Q/odDrY7aNXg/39/UhLS4v6i4mISD0hk/n9+/cDT6o8fvwY165dg8FgQElJCerr6wEA\n9fX1KC0tTXykREQ0pZC3Wfr7+2E2m+H3++H3+1FWVoaCggIYDAa8+OKLOHv2LLKysvDuu+9OV7xE\nRBREyGSel5eHtra2Se8vX74c169fT1hQNLkwGkmh1PXYiZaOfMhQv4lnbLcn1xIlmn3YATpLKYVR\nu30o6Otg5AUytHv1gCSrHg+7PYlmNyZzIiIBMJkTEQmAyZyISABcNo5mJa4rShQdJnOalbiuKFF0\neJuFiEgATOZERAJgMiciEgDvmScppUBos9nQa3XA5fJClsM3CyW6k1MZXylaspBJND14ZZ6klAKh\nx+eBy+WFVrsxov0S3cmpjK8kcCXOse8RkfqYzImIBMBkTkQkACZzIiIBMJnPEl1dnyM/vxgm076g\n79ts3YHXyjZWaxtGRlwYdg6rEoPL5UZLSytcLrcq402kFEdNu00JGZ9oLgubzHt6erBt2zasXr0a\na9aswRtvvAFgdG3PjIwMGAwGGAwGNDU1JTxYkXm9C4JOcau87/H4A6+VbVwuLyRpEfwqzXgryzK0\n2o0RPRUTi4nFUSJST9hHEzUaDV5//XWsX78eQ0NDeP7551FYWAhJklBZWYnKysrpiJOIiEIIm8zT\n09ORnp4OAFi8eDFWrVqFvr7RuTISdQVHRETRieqe+b1799De3o4f/OAHAIDa2lqsW7cOhw4dCiz8\nTERE0y/iDtChoSHs3bsXZ86cweLFi1FRUYGTJ08CAE6cOIGjR4/i7Nmzk/arqqoK/G40GmE0GuMO\nOhlFsoan2mTZj5aWVixaxEZfotnMYrHAYrHENUZE/5d7PB7s2bMHP/3pT1FaWgoASEtLC3xeXl6O\n4uLioPuOTeZzmbKGZ19f8P9OiSFBq92IkZHWafxOIorWxAvd6urqqMcIe5tFlmUcOnQIubm5ePXV\nVwPv9/f3B36/fPky8vLyov5yIiJSR9gr81u3buH8+fNYu3YtDAYDAODUqVO4cOECOjo6IEkSsrOz\nUVdXl/BgiYgouLDJfPPmzfD7/ZPe37lzZ0ICIiKi6LEyloS6uj6H9zsOeP5t8l+yRDQ3sZ0/CXm9\nC6BZ+LRqnZ9ElPyYzImIBMBkTkQkACZzIiIBsABKgalvg821k8hpcbk+KJF6eGVOgalvQ32WiEnV\nuD4okXqYzImIBMBkTkQkACZzIiIBsAA6y4xd81Ovn5kYEj11rrIWqM1mgx4zdJBEguGV+Swzcc3P\nmTE6da7L5U3I6MpaoB6fJyHjE81FTOZERAJgMiciEgCTORGRAFgAnSHKmqDRFjpd0leQNV64hxdF\n/Z1WaxtGRlywWtui3peIZrewV+Y9PT3Ytm0bVq9ejTVr1uCNN94AADx48ACFhYXIyclBUVERBgYG\nEh6sSJQ1QaMtdMoaL6RiDWREXzx0ubyQpEUJK2wS0cwJm8w1Gg1ef/11fPzxx7hz5w7efPNNfPrp\np6ipqUFhYSE6OztRUFCAmpqa6YiXiIiCCJvM09PTsX79egDA4sWLsWrVKvT19aGhoQFmsxkAYDab\nceXKlcRGSkREU4qqAHrv3j20t7dj06ZNcDgc0Ol0AACdTgeHw5GQAImIKLyIC6BDQ0PYs2cPzpw5\ngyVLloz7TJIkSJIUdL+qqqrA70ajEUajMaZAk41S4ExPX4zGxguB92eiw9PpdMI/4oLHOX/c6/f/\nxwLtd1KimhFRmRI3Ud2hRHORxWKBxWKJa4yI/o/0eDzYs2cPysrKUFpaCmD0atxutyM9PR39/f1I\nS0sLuu/YZD6XKAXOvr7ice8rHZ6ffZY7bbHIsgRJWhRYM1R57fUBWu1GPMJ/RzHW6JS4IyOtCYqW\naO6ZeKFbXV0d9Rhhb7PIsoxDhw4hNzcXr776auD9kpIS1NfXAwDq6+sDSZ6IiKZf2CvzW7du4fz5\n81i7di0MBgMA4He/+x2OHTuGF198EWfPnkVWVhbefffdhAdLRETBhU3mmzdvht8f/Fno69evqx4Q\nERFFj+38NCWn0xnzcnFjp7mNZnvTblNM30c01zGZ05RkOfgTSpGIdppbZXuuBUoUGyZzIiIBMJkT\nEQmAyZyISABM5knAeteEkYVfoqUjP6bZEtWgrAsaa0GUiBKLyTwJuGQ7pGINtHv1gDRTyXR0XVAi\nmp2YzImIBMBkTkQkACZzIiIBMJkTEQmAyZyISABM5kREAmAyJyISANf+UoHJtA8A0Nh4IbBcnLIs\n3EwsEzcdlKXnrNa2mQ6FiMArc1XY7UOw24cCv+v1V+HxjM4BrywTp7wWhbL0nMvlnelQiAgRJPOD\nBw9Cp9MhLy8v8F5VVRUyMjJgMBhgMBjQ1NSU0CCJiCi0sMn8wIEDk5K1JEmorKxEe3s72tvb8aMf\n/ShhARIRUXhhk/mWLVuwbNmySe9zwiUiotkj5gJobW0tzp07hw0bNuC1117D0qVLg25XVVUV+N1o\nNMJoNMb6lSQQq7UNI98WUDdtyp/pcIhmlMVigcViiWuMmJJ5RUUFTp48CQA4ceIEjh49irNnzwbd\ndmwyJ1K4XF4WUIm+NfFCt7q6OuoxYnqaJS0tDZIkQZIklJeXo7W1NZZhiIhIJTEl8/7+/sDvly9f\nHvekCxERTb+wt1n27duHv//977h//z4yMzNRXV0Ni8WCjo4OSJKE7Oxs1NXVTUesREQ0hbDJ/MKF\nC5PeO3jwYEKCSWaidnpGy+Vyo6WlFS6Xe6ZDIZpT2AGqElE7PaMlyzK02o18dJVomjGZExEJgMmc\niEgATOZERALgFLhRUKa3TU9fjMbGyYXhWLikr9DSkQ+X9JUq480WsuwPWghVOj89zvkARqfSjbZg\natptgv0bOwCgp7sHmdmZSF+WjsbLjSG3D7UNUbLjlXkUlOltlelu1SBrvNDu1UPWiNYJKQUthCqd\nn/5v35bl4NuFYv/GDv1hPfSH9XB6nNAf1geSe6jtQ21DlOyYzImIBMBkTkQkACZzIiIBsABKqrBa\n2+ByeRPaLKQUMm02G/SYw222REHwypxU4XJ5odVuTOh3KIVMj8+T0O8hSkZM5kREAmAyJyISAJM5\nEZEAWACdJWSvGy0d+RhZ+CWsd00zHU7EnE4n/N92dGq1U283sfNzqm2GPh2CybRv3PtdnV3IN+az\n8EkUAq/MZwsNoN2rh1SsgUtOnk5FWZbGdXROZWLn51TbaBY+PanD1gsvC59EYYRN5gcPHoROpxu3\nNNyDBw9QWFiInJwcFBUVYWBgIKFBEhFRaGGT+YEDB9DU1DTuvZqaGhQWFqKzsxMFBQWoqalJWIBE\nRBRe2GS+ZcsWLFu2bNx7DQ0NMJvNAACz2YwrV64kJjoiIopITAVQh8MBnU4HANDpdHA4HFNuW1VV\nFfjdaDTCaDTG8pVzkvWuCSMLv4R7eNFMhzJtnINd+Mxtg+ZrRFXsVIqkY6e5ZccoJQuLxQKLxRLX\nGHE/zSJJEiRJmvLzscmcouOS7ZCKNZAbPQCmfgpEJPJ8LzT/sQSevw5GtZ9SJO2r6wu8p3SMfnb0\nM7XDJFLVxAvd6urqqMeI6WkWnU4Hu330iYv+/n6kpaXFMgwREakkpmReUlKC+vp6AEB9fT1KS0tV\nDYqIiKITNpnv27cPP/zhD/H5558jMzMTb731Fo4dO4Zr164hJycHN27cwLFjx6YjViIimkLYe+YX\nLgRf6/L69euqB0NERLFhBygRkQCYzImIBMBkTkQkACZzIiIBcArcGHR1fY78/GKkpy9GY2PwAnE8\nnINd8C90z6nOz3go0+tarW3IgE61cZUOUgDjOkuJZiNemcfA610Avf7qpKla1SLP9452foJTvkZC\nmV7X5fKqOq7SQao/rA8kdaLZismciEgATOZERAJgMiciEgALoHFQCqE2W/dMhzJrybIfLS2tGHYO\nz3QoqmJxlGYbXpnHQSmEejz+mQ5lFpOg1W4Mu0ZosmFxlGYbJnMiIgEwmRMRCYDJnIhIACyAklCU\ntUAB4KN//hO2lj64XO5J2ykFTBYvSRS8MiehKGuB6g/r4Zf90Go3QpYnV1+VAiaLlySKuK7Ms7Ky\n8N3vfhfz58+HRqNBa2urWnEREVEU4krmkiTBYrFg+fLlasVDREQxiPs2S7B/whIR0fSK+8r8hRde\nwPz583H48GG8/PLLk7apqqoK/G40GmE0GuP5yoQwmfbBbh8KTGk78bVarHdNGFn4JVo68uGSvlJt\nXBHIsn9Sl6jV2gaXyxu0gBmKst/EC42xxVGbzQY99PEFTaQSi8UCi8US1xhxJfNbt25h5cqV+Prr\nr1FYWIjnnnsOW7ZsGbfN2GQ+W9ntQ9Drr6Kvrzjoa7W4ZDukYg20/0uPwbc+UXXs5CdN6hJ1ubzQ\najdiUI7uaRNlv0f473HvK8VRAPjs6GdxRUukpokXutXV1VGPEddtlpUrVwIAVqxYgd27d7MASkQ0\nQ2JO5sPDwxgcHAQAOJ1OvP/++8jLy1MtMCIiilzMt1kcDgd2794NAPB6vdi/fz+KiopUC4yIiCIX\nczLPzs5GR0eHmrEIwSV9hZaOfIws/BLWu6Ypt5O9brR05HNpuBi4XG60tLRi0aLo/vjGuh/wpHga\nrGNU+aynuweZ2ZnsKqUZwQ5QlckaL7R79ZCKNXDJIboLNYB2rx6Q+GhntGRZhla7Meo1P2PdD3hS\nPA3WMap85vQ42VVKM4bJnIhIAEzmREQCYDInIhLAnJ4CV+n0tNm6odePX9Nz7Ot4O0GVzk/38CIV\noxeX0+mEf8QFj3M+tNon64hO7AQdu12w/UKNL4foKlWmx7XZbOi1OsZ1oSrFzqk6SK3WNgx9OgST\nad9oN3GIqXY5DS+paU5fmSudnsoanhPX9FRe2+1DcX2P0vnJJ1ciI8sSJGnRmI5QKehUthO3m7zf\n1OOHmlNImR7X4/MEukmV7ZVip8cX/Fy6XF5oFj4d+DMTaqpdTsNLaprTyZyISBRM5kREApgz98yH\nhobwX//1FtxuP55/Phc7dxbGNZ4sy/DID/DF//0tPLiPBXKqSpESEUVvziTzf/3rX3jnnXb4fFvQ\n0/P3qJL5xMIoAMiyDz7tABzPvgff0CPM60uZtJ9zsAv+hW4WPlWiFELVnEPf1nUP+fnF6Pn6H8h8\nOh22rnsYGn6EXqtDte8YSyl6Ak+m4Q3VXRp0jAimaGZxde6ZU7dZFi5cgtTU/Kj3m1gYHTfmv60A\nFklB95Pne1n4VNVoIVRNHo8Pev1VON2j3Zso1gDSwpi6RCOhFD3HFlFDdZcGHePbwn2owjyLq3PP\nnErmRESiYjInIhIAkzkRkQDmTAE00TzzHZzSdpYKVjgNdJW6Rzs7Xa4RtLS0TlqHdOL2jx+PjOtG\ntVrbMDLigtXaFtjWOdiFu4MfI0WXCrd3OFDkTM1YjqHhR/j4f76A9jspkzpaP+r4J1J0qdBo5mPh\n/PnjptMdWzjt6u0NFOKBMR2rXffgfDSEp767GM7Hg7C19AFdo38eTaZ9uPnh/4G00Iv//f0fTBoz\n2ul7JxZYIx0rmo7YsWPGWsidS4XguK7Mm5qa8Nxzz+HZZ5/F73//e7ViShqy90lBVNb4hZrS1t37\n/2Y6BBUFKZx6Ma6zU/52m6m7R5+MMXY/l8sLSVo0rmAqz/cCxQux5D//HX75225ieAPFVa8PQTta\n/fP8WPKf/w4UayZNpzu2cOqVXOP2Uz5DsQayZgFQrIHP7YNWuxEej290G/sQpEUZQLEm6JjRTt87\nscAa6VjRdMSOHXPi9pEufjyXCsExJ3Ofz4ef/exnaGpqwieffIILFy7g008/VTO22c87+ekWUXiE\nSuZBJOZhldlD8OOLdyV7EcWczFtbW/HMM88gKysLGo0GP/nJT/DXv/5VzdiIiChCMSfzvr4+ZGZm\nBl5nZGSgr69PlaASQZIk+Hx2DA29DY0m+HPhUfNLcN+6D3yjznBERLGS5Bjb6f7yl7+gqakJf/rT\nnwAA58+fh9VqRW1t7ZPBJZWSJhHRHBNtao75aRa9Xo+enp7A656eHmRkZMQVDBERxSbm2ywbNmzA\nF198gXv37sHtduOdd95BSUmJmrEREVGEYr4yX7BgAf7whz9gx44d8Pl8OHToEFatWqVmbEREFKG4\nnjPfuXMn7t69i+9973t45513kJubi+PHj0/azmKxIDU1FQaDAQaDAb/97W/j+dpp5/P5YDAYUFxc\nHPTzX/ziF3j22Wexbt06tLe3T3N08Qt1fMl+7rKysrB27VoYDAZs3Bh8kq5kPn/hji/Zz9/AwAD2\n7t2LVatWITc3F3fu3Jm0TbKev3DHFu25i7sDVKvVorm5GSkpKfB6vdi8eTNu3ryJzZs3j9tu69at\naGhoiPfrZsSZM2eQm5uLwcHBSZ81Njaiq6sLX3zxBaxWKyoqKoL+gZvNQh0fkNznTpIkWCwWLF++\nPOjnyX7+wh0fkNzn75e//CVMJhMuXboEr9cLp9M57vNkPn/hjg2I7typMjdLSsroXN5utxs+ny/o\nH6xkLYb29vaisbER5eXlQY+hoaEBZrMZALBp0yYMDAzA4UjMXNiJEO74gOQ9d4pQ8Sf7+QPCn59k\nPX8PHz7EBx98gIMHDwIYvbWbmjp+EZhkPX+RHBsQ3blTJZn7/X6sX78eOp0O27ZtQ25u7rjPJUnC\n7du3sW7dOphMJnzyySdqfO20OHLkCE6fPo1584L/pwr2vH1vb+90hRe3cMeXzOcOGI3/hRdewIYN\nGwKP0Y6V7Ocv3PEl8/nr7u7GihUrcODAAeTn5+Pll1/G8PD4uXOS9fxFcmzRnjtVkvm8efPQ0dGB\n3t5etLS0TGq1zc/PR09PD+7evYuf//znKC0tVeNrE+69995DWloaDAZDyL8hJ36WLM/XR3J8yXru\nFLdu3UJ7ezv+9re/4c0338QHH3wwaZtkPX9A+ONL5vPn9XrR1taGV155BW1tbXjqqadQU1Mzabtk\nPH+RHFu0507VKXBTU1Oxa9cufPjhh+PeX7JkSeBWzM6dO+HxePDgwQM1vzohbt++jYaGBmRnZ2Pf\nvn24ceMGXnrppXHbTHzevre3F/qxU9rNYpEcX7KeO8XKlSsBACtWrMDu3bvR2to67vNkPn9A+ONL\n5vOXkZGBjIwMfP/73wcA7N27F21tbeO2SdbzF8mxRXvu4k7m9+/fx8DAAADg8ePHuHbtGgwGw7ht\nHA5H4G/P1tbRqUhDFWxmi1OnTqGnpwfd3d24ePEitm/fjnPnzo3bpqSkJPDenTt3sHTpUuh0upkI\nN2qRHF+ynjsAGB4eDhR1nU4n3n//feTl5Y3bJpnPXyTHl8znLz09HZmZmejs7AQAXL9+HatXrx63\nTbKev0iOLdpzF/fTLP39/TCbzfD7/fD7/SgrK0NBQQHq6uoAAIcPH8alS5fwxz/+EQsWLEBKSgou\nXrwY79fOCOWfb2OPzWQyobGxEc888wyeeuopvPXWWzMZYlyCHV8ynzuHw4Hdu3cDGP1n7f79+1FU\nVCTM+Yvk+JL5/AFAbW0t9u/fD7fbjaeffhp//vOfhTl/4Y4t2nMX89wsREQ0e3DZOCIiATCZExEJ\ngMmciEgATOZERAJgMiciEgCTORGRAP4/8RM+Q1MvFqkAAAAASUVORK5CYII=\n"
|
|
}
|
|
],
|
|
"prompt_number": 103
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Interestingly, you can get much greater extreme value differences without any bias at all, simply by having more variance in one population than in another.\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"maxs = array([amax(randn(10000)) for i in range(1000)])\n",
|
|
"max2s = array([amax(1.1*randn(10000)) for i in range(1000)])\n",
|
|
"_=hist(maxs,bins=100,alpha=0.7)\n",
|
|
"_=hist(max2s,bins=100,alpha=0.7)\n",
|
|
"sum(max2s>maxs)*1.0/len(maxs)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "pyout",
|
|
"prompt_number": 104,
|
|
"text": [
|
|
"0.82399999999999995"
|
|
]
|
|
},
|
|
{
|
|
"output_type": "display_data",
|
|
"png": "iVBORw0KGgoAAAANSUhEUgAAAXQAAAD9CAYAAACsq4z3AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAHWRJREFUeJzt3X9sU+f9L/D3SQjxKIwfFXG4Tq4Src1KaCD2WDNNcGua\nJgzzTZSMqBpjYAGZENM2tfAP/AFLriaWqUIVZdWEqqwKQ4JWm2Bpl2WFC55pEIm6xFRdf6Rx4TaJ\nYt9SCGqc+Pe5f+R7XCexY/vYjn1O3i8JYY7Pj8/RA58czvN5nkcQRVEEEREpXk6mAyAiotRgQici\nUgkmdCIilWBCJyJSCSZ0IiKVYEInIlKJuBJ6IBCAXq9HXV0dAODBgweoqalBWVkZamtrMT4+ntYg\niYgotrgS+pkzZ1BeXg5BEAAAbW1tqKmpweDgIKqrq9HW1pbWIImIKLaYCX1kZARdXV1obm6GNAap\ns7MTZrMZAGA2m3HlypX0RklERDHFTOgvvfQSXn75ZeTkfLOr0+mEVqsFAGi1WjidzvRFSEREcVky\n35fvvPMOCgoKoNfrYbFYIu4jCELoVUyk74iIKHFyZmWZ9wn91q1b6OzsRGlpKXbv3o3r169j7969\n0Gq1cDgcAICxsTEUFBTMG5Raf/3mN7/JeAy8N94f7099v+SaN6GfOnUKw8PDuHv3Li5duoTnnnsO\nf/7zn1FfX4+Ojg4AQEdHBxoaGmQHQEREqZFQHbr0CuXYsWO4evUqysrKcP36dRw7diwtwRERUfzm\nfYce7tlnn8Wzzz4LAFizZg2uXbuWtqCUwmg0ZjqEtFHzvQG8P6VT+/3JJYjJvLCJdXJBSOp9EBHR\nYiQ3d3LoPxGRSjChExGpBBM6EZFKMKETEakEEzoRkUrEXbZIlAxTowmOhw4Uri5E1+WuTIdDpEp8\nQqcF4XjogO6QDo6HjkyHQqRaTOhERCrBhE5EpBJM6EREKsGETkSkEkzoREQqwYRORKQSTOhERCrB\nhE5EpBJM6EREKsGh/wpgMu2GwzEBACgsXI6urosZjoiIshETugI4HBPQ6d4GAIyO1mU4GiLKVjFf\nubjdblRVVaGyshLl5eU4fvw4AKClpQVFRUXQ6/XQ6/Xo7u5Oe7BERBRdzCd0jUaDGzduYNmyZfD7\n/diyZQvee+89CIKAI0eO4MiRIwsRJxERxRBXp+iyZcsAAF6vF4FAAKtXrwYALgBNRJRF4krowWAQ\nlZWV0Gq12LZtGzZs2AAAOHv2LDZt2oSDBw9ifHw8rYESEdH84uoUzcnJgc1mw6NHj7B9+3ZYLBYc\nPnwYJ0+eBACcOHECR48eRXt7+5xjW1paQp+NRiOMRmNKAiciUguLxQKLxZL0eRKqclm5ciV27tyJ\n999/f0Zibm5uRl1d5OqL8IRORERzzX7YbW1tlXWemK9c7t+/H3qdMjU1hatXr0Kv18Ph+GblmcuX\nL6OiokJWAERElBoxn9DHxsZgNpsRDAYRDAaxd+9eVFdXY9++fbDZbBAEAaWlpTh37txCxEtERFHE\nTOgVFRXo7++fs/38+fNpCYiIiOThSFGKytRoguOhA4WrC9F1uSvT4RBRDJyci6JyPHRAd0gHx0NH\n7J2JKOOY0ImIVIIJnYhIJZjQiYhUggmdiEglWOWyQOQsUiEdY7ffhU6X2HVSuRDG0OAQDEYDALDi\nhSiL8Ql9gUiLVOh0b4cSe7zH+HzBhK8T7zXi4YcfukM6VrwQZTkmdCIilWBCJyJSCSZ0IiKVYKco\nZRVpugGAHbBEiWJCp6wiTTcAAKPnRjMcDZGy8JULEZFKMKETEakEEzoRkUowoRMRqQQ7RSmlEqlS\nkVPRwioYouiY0CmlEqlSkVPRwioYoujmfeXidrtRVVWFyspKlJeX4/jx4wCABw8eoKamBmVlZait\nrcX4+PiCBEtERNHNm9A1Gg1u3LgBm82GDz74ADdu3MB7772HtrY21NTUYHBwENXV1Whra1uoeImI\nKIqYnaLLli0DAHi9XgQCAaxevRqdnZ0wm80AALPZjCtXrqQ3SiIiiinmO/RgMAiDwQC73Y7Dhw9j\nw4YNcDqd0Gq1AACtVgun0xn1+JaWltBno9EIo9GYdNCUWumYQ52I4mexWGCxWJI+T8yEnpOTA5vN\nhkePHmH79u24cePGjO8FQYAgCFGPD0/olJ2kOdRHR+syHQrRojT7Ybe1tVXWeeKuQ1+5ciV27tyJ\nf//739BqtXA4pkvHxsbGUFBQIOviRESUOvMm9Pv374cqWKampnD16lXo9XrU19ejo6MDANDR0YGG\nhob0R0pERPOa95XL2NgYzGYzgsEggsEg9u7di+rqauj1erzwwgtob29HSUkJ3nrrrYWKl4iIopg3\noVdUVKC/v3/O9jVr1uDatWtpC4qIiBLHkaJZSKo6sdvvQqfLdDSZMzQ4BIPRAIDD/Iniwcm5spBU\ndeLzBTMdSkb54YfukA66Q7rQ/C1EFB0TOhGRSjChExGpBBM6EZFKMKETEakEEzphaKQXVpsBn4xa\nYWo0ZTocIpKJZYsEv+DBiiYd4B6F42NWkxApFZ/QiYhUggmdiEglmNCJiFSC79AzYGjoUxgMdUkt\nKDF7UYpMTBdgajSFRnDGOzQ/fDi/3W6HDroZ28O3EVFi+ISeAX7/Euh0b8PhmJB9Dml6AOkcmZgu\nwPHQkfDQ/PDh/L6Ab8728G1ElBgmdCIilWBCJyJSCSZ0IiKVYEInIlIJVrlkETmVKlLFTCqrW0Jx\n/L97cypOolWpRIwtgX1TSaq+4aIYtNjwCT2LyKlUkSpmUlnd8k0cgbnXi1KlEjG2BPZNJan6hoti\n0GITM6EPDw9j27Zt2LBhA55++mm8+uqrAICWlhYUFRVBr9dDr9eju7s77cESEVF0MV+55OXl4ZVX\nXkFlZSUmJibwve99DzU1NRAEAUeOHMGRI0cWIk4iIoohZkIvLCxEYWEhAGD58uVYv349RkdHAQCi\nKKY3OiIiiltCnaL37t3DwMAAfvCDH6Cnpwdnz57F+fPnsXnzZpw+fRqrVq2ac0xLS0vos9FohNFo\nTDZm1UjFFABEpHwWiwUWiyXp88Sd0CcmJtDU1IQzZ85g+fLlOHz4ME6ePAkAOHHiBI4ePYr29vY5\nx4UndJpJ6tAcHa3LdChElEGzH3ZbW1tlnSeuKhefz4ddu3bhZz/7GRoaGgAABQUFEAQBgiCgubkZ\nfX19sgIgIqLUiJnQRVHEwYMHUV5ejhdffDG0fWxsLPT58uXLqKioSE+EREQUl5ivXHp6enDhwgVs\n3LgRer0eAHDq1ClcvHgRNpsNgiCgtLQU586dS3uwREQUXcyEvmXLFgSDcwet7NixIy0BERGRPBz6\nrzCJDvWXhvEDmFNNs7b4f8DldWHKM4EV6Qo4jcKnFuAwfyIO/VecRIf6S8P4Iy2o4fK6sOKn/wsQ\nlDmeIHxqAQ7zJ2JCJyJSDSZ0IiKVYEInIlIJdoqqmKnRhE9Ge/Dh52vxrRXF8HntMDWaAM9KOBwT\n8Hi9czpDhwaH4A/YYf/SAI/PFfXcvb39cLs96O3tR1WVIb03gm86QBdyXnUipeETuoo5HjqQ92MN\nArkuaJp0yPuxBo6HjlBHaaTJ1fzwI+/HGmiadBARvbPU4/FDEPLh8fjTeQsz4lroedWJlIYJnYhI\nJZjQiYhUggmdiEglmNCJiFSCVS5pIg25XyyLV7AKhSjz+ISeJlIlyezh9mrFKhSizGNCJyJSCSZ0\nIiKVYEInIlIJJnQiIpVglUuSlFTN4nK5cKf/AyD3Y9i/NECEb873QbcHPlcuNJoMBUlEsvEJPUlK\nqmYRRQHIWwr81xJomnRzFrYQRQGCkI+gMte7IFr0Yib04eFhbNu2DRs2bMDTTz+NV199FQDw4MED\n1NTUoKysDLW1tRgfH097sEREFF3MhJ6Xl4dXXnkF//nPf3D79m289tpr+Pjjj9HW1oaamhoMDg6i\nuroabW1tCxEvERFFETOhFxYWorKyEgCwfPlyrF+/HqOjo+js7ITZbAYAmM1mXLlyJb2REhHRvBLq\nFL137x4GBgZQVVUFp9MJrVYLANBqtXA6nRGPaWlpCX02Go0wGo2yg6XM83i8sFr7MOmazHQoCTE1\nmkILSReuLkTX5a4MR0T0DYvFAovFkvR54k7oExMT2LVrF86cOYMVK2aucyMIAgRBiHhceEIn5RNF\nERrNM5iYsGQ6lIQ4HjqgOzQ9x8zoudEMR0M00+yH3dbWVlnniavKxefzYdeuXdi7dy8aGhoATD+V\nOxzTTzxjY2MoKCiQFQAREaVGzIQuiiIOHjyI8vJyvPjii6Ht9fX16OjoAAB0dHSEEj0REWVGzFcu\nPT09uHDhAjZu3Ai9Xg8A+N3vfodjx47hhRdeQHt7O0pKSvDWW2+lPVgiIoouZkLfsmULgsFgxO+u\nXbuW8oCIiEgeDv1PkaGhT2Ew1MmaAkA61m6/Cx3Xhkg7aTGOWNUurIwhpeHQ/xTx+5fIngJAOtbn\ni/w/IUotaTEOKVlHI1XGxLMvUTZgQiciUgkmdCIilWBCJyJSCXaKkipIHZ0AYLfboQN7l2nx4RM6\nqYLU0ak7pIMv4It9AJEKMaETEakEEzoRkUowoRMRqQQTOhGRSrDKRSaTaTccjomsHa4/NPQp/N9y\nwvc/OfqUaLHgE7pMDsdEVg/X9/uXIG/pdxAUMx0JES0UJnQiIpVgQiciUgkmdCIilWBCJyJSCSb0\nFAtfrCLSn1PFI3wBq80A99LP8c+ba+Fe+jmsNgM8whcpu4YoBmG19sHt9qC3tz9l5yWi9GBCT7HZ\ni1Wka/EKMc8PTZMOQl0eArkuCHV50DTpIOb5U3gVARrNMxCEfHg8qTwvEaVDzIR+4MABaLVaVFRU\nhLa1tLSgqKgIer0eer0e3d3daQ2SiIhii5nQ9+/fPydhC4KAI0eOYGBgAAMDA/jRj36UtgCJiCg+\nMRP61q1bsXr16jnbRZEjVoiIsonsof9nz57F+fPnsXnzZpw+fRqrVq2KuF9LS0vos9FohNFolHtJ\nioPo94Y6S72T+ZkOh4jiYLFYYLFYkj6PrIR++PBhnDx5EgBw4sQJHD16FO3t7RH3DU/otADyAE2T\nDhP3P4PY5QOQm+mIiCiG2Q+7ra2tss4jq8qloKAAgiBAEAQ0Nzejr69P1sWJiCh1ZCX0sbGx0OfL\nly/PqIAhIqLMiPnKZffu3fjXv/6F+/fvo7i4GK2trbBYLLDZbBAEAaWlpTh37txCxEpERPOImdAv\nXrw4Z9uBAwfSEgwREcnHBS7CSItWFBYuR1fXxZjbFxOXywWrtU9R5apDg0MwGA0AALvdDh3iW4nE\n1GiC46FjxjHh5ypcXYiuy13pCZooCRz6H0ZatMLhmIhr+2IiitPTACiJH37oDumgO6SDL+CL+zjH\nQ8ecY8LP5XjoSEe4REljQiciUgkmdCIilWBCJyJSCXaKUtbp7e2Hx+MPzcNeVWVIy3XkdnSyg5Sy\nFRM6ZR2Pxw+N5hlMCP8nrfOwSx2dADB6bjTtxxGlG1+5EBGpBBM6EZFKMKETEakEEzoRkUqwUzRL\n9d4xwb30c1htBniELzIdTkwejxdWax88Hu+c73p7+0MVK4uVNJ0AwMoYSh8+oWcpj+iAUJcHTZMO\nYl76Kj1SRRRFaDTPRJzrxePxQxDy01qxku2k6QQ4dQClExM6EZFKMKETEakEEzoRkUqwUzQBQ0Of\nwmCoAwDY7Xehi2967aSJfi+stumh5kroII3G5XIhmObh/AtNmgaAHZ2UDfiEngC/fwl0ureh070N\nny+4cBfOAzRNOsV0kEYjioLqOkelaQDY0UnZgAmdiEglYib0AwcOQKvVoqKiIrTtwYMHqKmpQVlZ\nGWprazE+Pp7WIImIKLaYCX3//v3o7u6esa2trQ01NTUYHBxEdXU12tra0hYgERHFJ2ZC37p1K1av\nXj1jW2dnJ8xmMwDAbDbjypUr6YmOiIjiJqvKxel0QqvVAgC0Wi2cTmfUfVtaWkKfjUYjjEajnEuS\nQohiEFZrH9xTk/C5PbBa+zDpmsx0WERZzWKxwGKxJH2epMsWBUGAIAhRvw9P6LQYCNOLU0xYIAj5\noc9EFN3sh93W1lZZ55FV5aLVauFwTJdpjY2NoaCgQNbFiYgodWQl9Pr6enR0dAAAOjo60NDQkNKg\niIgocTET+u7du/HDH/4Qn376KYqLi/HGG2/g2LFjuHr1KsrKynD9+nUcO3ZsIWIlIqJ5xHyHfvHi\nxYjbr127lvJgiIhIPs7lQklxuVywWvsizoOeKGkhDJ8rFxrNzPNHWjhjMeDCGJQIDv2npIjidFVL\nKkgLYQTDfjZI50/FDwwl4sIYlAgmdCIilWBCJyJSCSZ0IiKVYEKPQFrIwmTanelQ6L9JUwoorXPU\n1GiCwWiA3W7PdCi0CDChRyAtZOFwTGQ6FApRZueo1KnpC/gyHQotAkzoREQqwYRORKQSTOhERCrB\nhE5EpBIc+p9leu+Y4F76ObyT+RG/F/1eWG0GiFBuJ5s0nH9qyg2rtQ/5+Zn/azg0OASD0QAAsNvt\n0EEn+3gO0adM4RN6lvGIDgh1edETdh6gadIBgrKqPcKFTxeg0TwDj8ef4YgAP/yhIfZyKlLCj+cQ\nfcoUJnQiIpVgQiciUgkmdCIilch8b1QWMJl2w+GYgN1+F7qwvjBpCoDZ2ynzpLnTe3v7UVVlSOhY\nj8eb1mkEku1gDZ8DPdnj2UG7uPAJHYDDMQGd7m34fMEZ26UpAGZvp8yT5k6X06EqimJapxFItoM1\nfA70ZI9nB+3iktQTeklJCb797W8jNzcXeXl56OvrS1VcRESUoKQSuiAIsFgsWLNmTariISIimZJ+\n5aK02e+IiNQqqYQuCAKef/55bN68Ga+//nqqYiIiIhmSeuXS09ODdevW4csvv0RNTQ2eeuopbN26\ndcY+LS0toc9GoxFGozGZSyZNqmgBgOHhIRQXP5HxKhaP8AWsNsO8Q/7VzOVyIej2wOfKjbmvtNDF\npGtyxnapciWRaQSkcy301APhVTDDd4dRXFoc+h2QV9lCymaxWGCxWJI+T1J/k9etWwcAWLt2LRob\nG9HX1zdvQs8GUkULAHzySTl0urfxySflGY1JzPND06TDxP3PIHb5AMRObGoiigIEIR/BuN7eTU8b\nMDFhmXWO6coVtzuRjnlBxjHJk6pgAOCTo59Ad0gX+l3aRovL7Ifd1tZWWeeR/cplcnISX3/9NYDp\nJ6x3330XFRUVck9HRERJkv2E7nQ60djYCADw+/3Ys2cPamtrUxYYERElRnZCLy0thc1mS2UsRESU\nBA79X2DSfOe9d0yZDkWVpA7WdA7tzxSpMzXacH5pyP9CdKpK1+LUAtmFQ/8XmDTfuUfkkOx0kDpY\n0zm0P1OkztRow/mlIf9ypgtIlHQtTi2QXZjQiYhUggmdiEglmNCJiFSCCZ2ISCUWTZVLtEUsMsX1\n9RCCS72w2gzRF4SmmFwuF6zWPtV1gM4n0tQBQPxTBnABDPVaNE/o0RaxyBQx1w+hLg+aJh0gLJ5k\nlGqiOD18fzEJX0DD5XMlvBgGF8BQr0WT0ImI1I4JnYhIJZjQiYhUggmdiEglVFPlIlWxFBYuR1fX\nxTnbs6W6hRaOtICFe2oSPrcH7/7TAs23ls2piJHmf+nt7UdVlWHGd729/fB4/FHnhZEW1nCHHR/a\nFnZdX5Tzp1ukipjwaphoFTPS50xVwbASRx7VPKFLVSzSakSzt2dLdQstpOkKGH8AEIR8+AOIWBEj\nzf/i8fjnfOfx+OedF0ZaWCP8eGlb+HWjnT/dIlXEhFfDRKuYkT5nqgqGlTjyqCahExEtdkzoREQq\nobh36MFgEB9++CF8Ph+WL1+O7373uwtyXVEUEQy6MT7+7//+88L/95mIaD6KS+hjY2Nobv7fyM0t\nR07OB+jpuTLj+6GhT2Ew1M3pHE2W3/8I3vwxfDj1KwTdU/Dk/F9YbYaoi1V4hC9C3//z5lr4l34N\nq80A16Q9ZTFRaknTCLjDOjJ9rlxoNN/s09vbH/o+UgdrPOefb+GN2eeX9g3fHq2DVeqMnZpyw2rt\nQ35+7H/esztwZ583kWkGInVkhm/Lpk7XdMtUp67iXrmIoojc3LV4/PEWuN1zOzr9/iURO0dTcV3k\nA0u3Pg7hyaUQ8wLQNOmiLlYh5vlD3wdyXaFh/py3JXtJ0wiEd2QGZ+Vrj8c/bwdrPOef74fA7PNL\n+4Zvj9bBKnXGAtPHxtMJO7sDd/YxiUwzEKkjM3xbNnW6plumOnWTSujd3d146qmn8OSTT+L3v/99\nqmJSDO/IV5kOIW3UfG8A70/pLBZLpkPISrITeiAQwC9/+Ut0d3fjo48+wsWLF/Hxxx+nMras51Px\nPxo13xvA+1M6JvTIZCf0vr4+PPHEEygpKUFeXh5+8pOf4G9/+1sqYyMiogTITuijo6MoLi4O/bmo\nqAijo6MpCWo+giAgELiPr776LfLzF64LQBAEwAt4e+5DHPIAEBbs2kRE8RBEmSsD/PWvf0V3dzde\nf/11AMCFCxfQ29uLs2fPfnNygUmPiEgOOalZdtmiTqfD8PBw6M/Dw8MoKipKOiAiIpJH9juLzZs3\n47PPPsO9e/fg9Xrx5ptvor6+PpWxERFRAmQ/oS9ZsgR/+MMfsH37dgQCARw8eBDr169PZWxERJSA\npHoVd+zYgTt37uDxxx/Hm2++ifLychw/fjzivr/+9a/x5JNPYtOmTRgYGEjmsgvG7XajqqoKlZWV\nUe/NYrFg5cqV0Ov10Ov1+O1vf5uBSJMTCASg1+tRV1cX8Xsltl24+e5P6e1XUlKCjRs3Qq/X45ln\nIg90UnL7xbo/Jbff+Pg4mpqasH79epSXl+P27dtz9km47cQUcLlcoiiKos/nE6uqqsSbN2/O+P7v\nf/+7uGPHDlEURfH27dtiVVVVKi67IGLd240bN8S6urpMhJYyp0+fFn/6059GvA8lt51kvvtTevuV\nlJSIX331VdTvld5+se5Pye23b98+sb29XRTF6fwyPj4+43s5bZeSur9ly5YBALxeLwKBANasWTPj\n+87OTpjNZgBAVVUVxsfH4XQ6U3HptIt1b4CyO39HRkbQ1dWF5ubmiPeh5LYDYt8foOz2A+aPX+nt\nB8RuHyW236NHj3Dz5k0cOHAAwPQr7JUrV87YR07bpSShB4NBVFZWQqvVYtu2bSgvL5/xfaSa9ZGR\nkVRcOu1i3ZsgCLh16xY2bdoEk8mEjz76KEORyvPSSy/h5ZdfRk5O5L8KSm47IPb9Kb39BEHA888/\nj82bN4dKiMMpvf1i3Z9S2+/u3btYu3Yt9u/fD4PBgJ///OeYnJycsY+ctktJQs/JyYHNZsPIyAis\nVmvEYbmzf4oqpUY91r0ZDAYMDw/jzp07+NWvfoWGhobMBCrDO++8g4KCAuj1+nmfcpTadvHcn5Lb\nDwB6enowMDCAf/zjH3jttddw8+bNOfsotf2A2Pen1Pbz+/3o7+/HL37xC/T39+Oxxx5DW1vbnP0S\nbbuUDrVcuXIldu7ciffff3/G9tk16yMjI9ApbIHPaPe2YsWK0GuZHTt2wOfz4cGDB5kIMWG3bt1C\nZ2cnSktLsXv3bly/fh379u2bsY+S2y6e+1Ny+wHAunXrAABr165FY2Mj+vr6Znyv5PYDYt+fUtuv\nqKgIRUVF+P73vw8AaGpqQn9//4x95LRd0gn9/v37GB8fBwBMTU3h6tWr0Ov1M/apr6/H+fPnAQC3\nb9/GqlWroNVqk7102sVzb06nM/RTtK+vD6IoRnzPno1OnTqF4eFh3L17F5cuXcJzzz0XaieJUtsO\niO/+lNx+k5OT+PrrrwFMz7X+7rvvoqKiYsY+Sm6/eO5Pqe1XWFiI4uJiDA4OAgCuXbuGDRs2zNhH\nTtslvcDF2NgYzGYzgsEggsEg9u7di+rqapw7dw4AcOjQIZhMJnR1deGJJ57AY489hjfeeCPZyy6I\neO7tL3/5C/74xz9iyZIlWLZsGS5dupThqOWT/junhraLJNL9Kbn9nE4nGhsbAUz/F37Pnj2ora1V\nTfvFc39Kbr+zZ89iz5498Hq9+M53voM//elPSbed7LlciIgouyhuxSIiIoqMCZ2ISCWY0ImIVIIJ\nnYhIJZjQiYhUggmdiEgl/j9qBdnj41BqNwAAAABJRU5ErkJggg==\n"
|
|
}
|
|
],
|
|
"prompt_number": 104
|
|
},
|
|
{
|
|
"cell_type": "heading",
|
|
"level": 1,
|
|
"metadata": {},
|
|
"source": [
|
|
"Conditional Distributions"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Let's look at another important example from statistics. Consider a population of size $N = 1000000$:\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"N = 1000000"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [],
|
|
"prompt_number": 105
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Now assume that about 1:1000 of the population are infected with some disease.\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"infected = (rand(N)<1e-3)\n",
|
|
"sum(infected)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "pyout",
|
|
"prompt_number": 106,
|
|
"text": [
|
|
"1045"
|
|
]
|
|
}
|
|
],
|
|
"prompt_number": 106
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Also, assume we have a test that is 99 percent accurate. We give the test to the entire population and measure the results.\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"testresult = where(rand(N)<1e-2,1-infected,infected)\n",
|
|
"sum(testresult)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "pyout",
|
|
"prompt_number": 107,
|
|
"text": [
|
|
"11120"
|
|
]
|
|
}
|
|
],
|
|
"prompt_number": 107
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"Now, let's look at the population of people whose test result is positive.\n",
|
|
"What fraction of those people are infected?\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [
|
|
"sum(infected[testresult==True])*1.0/sum(testresult==True)"
|
|
],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": [
|
|
{
|
|
"output_type": "pyout",
|
|
"prompt_number": 108,
|
|
"text": [
|
|
"0.092985611510791363"
|
|
]
|
|
}
|
|
],
|
|
"prompt_number": 108
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"(Implications)\n",
|
|
"\n",
|
|
"That's not good: less than 10 percent of the population that tests positive is actually infected. Ninety percent of those who test positive are _false positives_ even though the test is 99 percent accurate.\n",
|
|
"\n",
|
|
"This is a common issue in medicine, anti-terrorism, and many other problems:\n",
|
|
"\n",
|
|
"- testing everybody for HIV infection\n",
|
|
"- testing everybody for prostate cancer / breast cancer\n",
|
|
"- widespread Internet surveillance for \"terrorism\"\n",
|
|
"\n",
|
|
"All of these end up generating enormous numbers of false positives."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"(Bayesian Calculation)\n",
|
|
"\n",
|
|
"Mathematically, we write this in terms of _conditional probabilities_:\n",
|
|
"\n",
|
|
"prior probability: \n",
|
|
"\n",
|
|
"$$P(i)$$\n",
|
|
"\n",
|
|
"probability of test: \n",
|
|
"\n",
|
|
"$$P(t=0|i=0) = 0.99$$\n",
|
|
"$$P(t=1|i=1) = 0.99$$\n",
|
|
"\n",
|
|
"Bayes formula:\n",
|
|
"\n",
|
|
"$$ P(i=1|t=1) = \\frac{P(t=1|i=1) P(i=1)}{P(t=1)} = \\frac{P(t=1|i=1) P(i=1)}{P(t=1|i=0) P(i=0) + P(t=1|i=1) P(i=1) } $$\n",
|
|
"\n",
|
|
"$$ ~~~~~~ = \\frac{0.99 \\cdot 0.001}{ 0.01 \\cdot 0.999 + 0.99 \\cdot 0.001 } \\approx \\frac{0.001}{0.01} = 0.1 $$\n",
|
|
"\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"metadata": {},
|
|
"source": [
|
|
"(Derivation of Bayes Formula)\n",
|
|
"\n",
|
|
"Joint density ($c$ and $x$ could be any variables):\n",
|
|
"\n",
|
|
"$$ p(c,x) $$\n",
|
|
"\n",
|
|
"Conditional density:\n",
|
|
"\n",
|
|
"$$ p(c,x) = P(c|x) ~ p(x) $$\n",
|
|
"\n",
|
|
"Bayes formula:\n",
|
|
"\n",
|
|
"$$ P(c|x) ~ p(x) ~ = ~ p(x|c) ~ P(c) $$\n",
|
|
"\n",
|
|
"$$ P(c|x) = \\frac{p(x|c) P(c)}{p(x)} $$"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"collapsed": false,
|
|
"input": [],
|
|
"language": "python",
|
|
"metadata": {},
|
|
"outputs": []
|
|
}
|
|
],
|
|
"metadata": {}
|
|
}
|
|
]
|
|
} |