Дэвид Хэнд

Темные данные. Практическое руководство по принятию правильных решений в мире недостающих данных


Скачать книгу

id="n_12">

      12

      D. J. Hand, F. Daly, A. D. Lunn, K. J. McConway, and E. Ostrowski, A Handbook of Small Data Sets (London: Chapman and Hall, 1994).

      13

      D. J. Hand, “Statistical challenges of administrative and transaction data (with discussion),” Journal of the Royal Statistical Society, Series A181 (2018): 555-605.

      14

      https://www.quora.com/How-many-credit-and-debit-card-transactions-are-there-every-year, accessed 24 August 2018.

iVBORw0KGgoAAAANSUhEUgAAAfEAAANSCAIAAAD6R2BDAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAAZdEVYdFNvZnR3YXJlAEFkb2JlIEltYWdlUmVhZHlxyWU8AADI3ElEQVR4Xuzdd1zUeP4/cL9X9u527/a2qFssq6KASG+CIAgqgopdsWLvvXfXddVVsbe1Ym9g77333hERLEhTuoCIgL/XTT7Mb1ZgRAiyTF7PP3jkk3wmk8lMXnknzCQl3hVnL168qFatWsmSJX8gIlKGf//7397e3iIEsynemf7gwQMnJ6d79+4FBQUFEhHpuidPnvj5+TVs2FCEYDbFO9Pv37/v7u6enp4u2kREuu7y5cuNGzcWjWyKd6YHBATUq1fv7du3ok1EpOuQ6Y0aNRKNbJjpRETFCTOdiEh3MNOJiHQHM52ISHcUp0zfuXNn69ate/To0a1btz59+oSFhYkJuWCmE5HSFKdMHz58eL9+/W7dunX27NkLFy4kJyeLCblgphOR0hSnTB8yZMi8efNEIw+Y6USkNMUp00eOHNmzZ8/p06dPmDDh8ePHYmzumOlEpDTFKdPHjRtnbGy8Z8+eX375xcrKKjY2VkzIBTOdiJSmOGV6TExMfHy8NOzq6urv7y8NqyHlu3bt2rRp05YtW7Zu3Rp9qlatmpCQICYTEem64pTpmlq0aDF//nzRyIKSHLX57du379y58/DhQz8/P0NDw8TERDGZiEjXFadMHzt27M6dO6VhR0fH3bt3S8O5uX79erVq1V69eiXaRES6rjhl+ubNm83MzFCed+3a1d3dPSUlRUzIBTOdiJSmmJ17QUzPnj17/fr1eTmjwkwnIqUprufT84KZTkRKw0wnItIdzHQiIt3BTCci0h3MdCIi3cFMJyLSHcx0IiLdwUwnItIdzHQiIt3BTCci0h3MdCIi3cFMJyLSHcx0IiLdUcSZnpmZeezYsSlTply9ehXNkJCQD15BN++Y6USkNEWc6d27d3dwcDA1NZ00aRKaXbt2lQZkwUwnIqUpykzftWuXjY0NBmbPnj1y5EgMnD9/HmPkuis0M52IlKYoM93Hx6dz587SgJTpd+/eNTY2fv36tWp6QTHTiUhpijLTT506ZWhoGB8fP2fOnNGjR2NM3759mzVrJk0tOGY6ESlNEZ9PR4VevXp1fX39ChUq2NjYuLi4PHnyREwrMGY6ESlNEWc6hIaGHjp0aNeuXYjgtLQ0MVYOzHQiUpqizPSAgIDIyEjRUEGmL1++PDk5WbQLhplOREpTlJnu6+trZ2cXExMjNdPT09u2bevk5CQ1C46ZTkRKU8TnXkaNGmVpafnkyRMkr6ura4MGDWSMYGY6ESlN0Z9P37hxI2pzGxubYcOGiVEyYaYTkdIUZaY/fvzYz8/vxIkT3t7eNWvWPHz48M6dOw8ePJiZmSl6FAwznYiUpigzfe/evdWrV69du3bDhg2xEHXq1EGyt23bNj09XfQoGGY6ESlN0Z97KTzMdCJSGnkyPSUlJSQkRDSyBAcHP336VDRyERkZ+ebNG9F49+7FixdyfZERmOlEpDTyZDqyuHLlypMnT1b/aGjp0qWlS5c+ceKE1MwREt/a2jowMFC0370bMGDAiBEjRKPAmOlEpDSynXu5cOFC7dq169Wrt2PHjubNm1evXv3w4cNiWi4WLFjw3tVdsDRmZmaalXtBMNOJSGnkPJ8eHR2NurtEiRKVKlV6/PixGJu7xYsXt27dWjRUkMKWlpbMdCKi/JEt01evXq2np9etW7eHDx8OGzasXLly8+fPz8jIEJNzEhoaisydM2dOeHh4QkLCtWvXnJycxo8fLyYXGDOdiJRGnkyPjIxEfb19+3bRfvfu5MmTVapUOXDggGjn4ubNm/Xr1zc2Nkb4WlhYTJkyRftu4KMw04lIaeTJ9Ddv3qDQFo0sGBMbGysaWqHbs2fP5L0oIzDTiUhpZDv3glhPSkqK14Aw1f6LUBTpx48fl+tXo9kx04lIaeTJdBTaZcuWLVmypJ2dnZmZmbFKpUqVzp49K3rkZO/evRUqVLCysho9evStW7dkPOsiYaYTkdLI+T/SMmXKdO3a9fHjx9HR0U+ePAkJCUlJSRGTc4HSfs+ePXiUra2th4fHnDlzgoKCxLQCY6YTkdLIlukQGhrasmVLJycnhKkYlWdxcXFDhgwpUaLEf//7XxcXF4R7YmKimJZfzHQiUho5M12ya9cuCwuLiRMn5uVr5gjc/fv39+rVy9LS0s3Nbd68effu3du9e3ft2rXRFJ3yi5lOREojT6a/fv16+fLlCxcuXLJkyYYNG8aPH//3v/9dT08vODhY9MjJvn37ypQpY25uPmbMmCtXrmieT0fZ7uHhERERIdr5wkwnIqWRJ9MTEhLatWvXpEmT5ipt2rTp2LFjw4YNtZ+EuX///rVr10QjG5T5BfyvKTOdiJRG/nMveXfr1q1Ro0YNGjRoQJY+ffpMnDhRri/AMNOJSGmKMtMXLFhQqVKlCRMmjM4yfPjwGTNmMNOJiPJHnkyPi4tzcXGxtraursHExOTChQuiR04Q3126dBGNQsBMJyKlkSfT09LSTp8+ffz48RMqJ0+ePHv2rLm5+bZt20SPnCDTO3fuLBqFgJlOREpTiOde6tevv2XLFtHIyZw5c5ydnc+cOXM4y8GDB9HkPaaJiPJHnkxPT08PCQkJCgp6pBIcHBwaGlqjRo2tW7eKHjnZt2+ftbW1owZbW9sWLVrwHtNERPkjT6bHxsZWr17dyMjIJIupqelf/vIXpLboURSY6USkNPJkemZmZnJyclIWDKPWdnV19fPzEz2KAjOdiJSmEM+ne3h4aD+fDhs3bqxRowZqfHt7e/w1NjZu3bo1z70QEeWPPJmelpZ25swZ6RsvcOrUqXPnzn3wey+XLl2qXLnyzp07+/Tp06ZNm6tXr7Zt27ZTp05icoEx04lIaeTJ9Li4uNq1a7/3/XQU3efPnxc9cjJz5swOHTpgwMfHZ+TIkRi4c+dOzZo13759q5peUMx0IlKaQjz38kHz589v0qQJBhYsWNC/f38M3L59G3uC1NRU1fSCYqYTkdLIk+kRERF169ZFtS7aefP06VMHB4fHjx8/f/7c1NS0d+/eVlZW3bt3F5MLjJlOREojT6YjlJGe0dHRop1nkZGRUlV+7969ESNGLFy4MI+3wsjL75KY6USkNPJkemhoqImJycfW6fmD3UC7du3Cw8NFO3fMdCJSGnkyHTlbunTpxo0bt2/fvm2WZs2a3bp1S/TIxbVr10aOHHnnzp2HDx926tRp5syZH/wH6c8//9yyZUvR0IqZTkRKI0+mp6amrl27ds6cOXM1+Pj4PHnyRPTISXBwsJmZWefOnR0dHa2srBDWdnZ248aNE5Nz8vLlSxwQ3Lx5U7S1YqYTkdLIk+n5M2/ePC8vLwxMnTpVKr0vXbpkaWmZlpammp6DX3/9Ne9fYGemE5HSyJPp6enpERER4eHhKMzVHj9+nJKSInrkBJnevn17DOzYsWPWrFkYCAgIMDc3f/36tWr6+6Kjo5H4QUFB58+fP3r0qBirITMzE8+YrJKRkYFuRkZGzHQiUg55Mj02NrZkyZKfffZZ9erVLSwsjFUqVap09uxZ0SMn165dQ/+kpCTRVhXszZo1E41sJk2aJN1DY8SIEYMGDZJGasJidOzY0dPTs2nTpi1atKhZs6aent6n+c8tEdGfgWznXvbt24eiuEOHDqGhoaiR4+PjkbDa/+GJqVeuXNH8hZGvry/GiMYf4TjA0NAQi4thBHq/fv2k8ZpwuPD8+XMcIjx9+jQyMlJapDx+OZKISAfIeT4dId6zZ09LS8uDBw+KUfK5ePGitbV1y5Ytvby89PX1y5QpM3fuXDEtFzyfTkRKI2emS86dO2dvb486Wt4COTMzE3W9dKIGdXrfvn2l8Vow04lIaeTJ9OTk5KlTp06YMGHixIkzZ84cMmTIZ599VrJkyfv374sespLupiQauWOmE5HSyJPpyM2hQ4d27969pwqK6OHDh2Pg7t27okdRYKYTkdLIf+4l76Kioi5dunTjxo2LFy+eUzlz5szVq1d5j2kiovyRJ9MjIiLq1av3sd8a3LJlSwkVExOTunXr1qhRw9zcvHHjxrzPERFR/siT6aGhocbGxjExMaKdZ6jNW7ZsaW9vP3/+fNnDl5lOREojT6ZHRUWVLFnSwcGhTp06tbOg7sbcRQ+tbty40adPHysrqzVr1ohRcmCmE5HSyJPp4eHhlSpVWr169a5du7Zn8fPzi4yMFD20QuzOnj37yy+/HDt2rBglB2Y6ESmNbOdeTExMYmNjRTvPXrx4MXnyZCcnp9GjR4eFhYmxMmGmE5HSyJPpSHNEc27X3srNvn37/v73v5coUcLa2rpv377du3dv3br1oEGDMjIyRI+CYaYTkdLIk+mAKjs4OFg0VBc6v337tmjkAh3mzJmzYsWKBQsWzFSZPn36smXLmOlERPkjW6Y3aNDAx8dHNN69O3/+PPI0KipKtIsCM52IlEaeTEeRXrVq1YiICNFWqVWr1tatW0UjF4mJiUuWLOnevXuHDh1GjBhx6dIlMUEOzHQiUhp5Mj0mJsbCwiIoKEi0VZfccnR0PHTokGjnJC0tzcPDo27dutOnT581a9bw4cMrVqzo7+8vJhcYM52IlEa2cy+jR4+2t7ffvXv3jRs3Tpw40b59+3r16mn/Rei6devq1KkjGip79+61s7PjtQGIiPJHtkzPyMhYuHBh7dq1zczMHBwcUHR/8KuNPj4+bdq0EQ2VO3fuIIU/9vszuWGmE5HSyJbp+RAQEFClSpW1a9dGRES8ePEiKCgIi9KjRw8xucCY6USkNHJmOkJ5yZIlv/7665w5cy5cuCDGanXw4MEaNWqYmpoifC0sLPr06SNjBDPTiUhpZMv0bdu26enptWnTBoV2ly5dqlatOmbMGDFNq/T09OjoaJTqsocvM52IlEaeTE9OTkaVrXkbUmS0sbEx5i7aefPy5csWLVo4OTnVr18fQS/G5hcznYiURp5Mf/78OdLzvRSuW7eun5+faOQEz92rVy/U9dLdkfr06dO8efMff/xx48aNO3bsKPh/SpnpRKQ0sp17qVWr1qRJk1JTUzGcmZl54MCBypUra79r6Pz58/X19X/77bdfVCZPnty7d28DA4M3b96IHgXDTCcipZEt0+/fv+/o6GhmZmajYmpqun37djEtFzNmzOjevbtoqAQFBWEO/C4jEVH+yJbpgPo6ICDgwoULN2/eTEhIEGNzN3v2bA8Pj4cPH967d086b8NMJyIqCDkz/T3r1q3r1KlTmzZtjh07Jkb90ebNm8uWLWthYWFsbKyvr29vb4/OGOa5FyKi/JEn01FZr169elYWFODz5s2rUqVK69atJ02ahOcQ/bLJzMzMyMhITk4OCQnZt28fFuXrr7+eNm2aLLcnZaYTkdLIk+mRkZHfffdd06ZNO3To0E7F29sb6bx7927RI28SEhJGjx7t5eWFAj8fd016DzOdiJRGnkwPDQ01NzdPTEwUbZUGDRps2bJFNHLy6NGjly9fioYKavZt27alpKSIdsEw04lIaeTJ9PDw8IoVK0r3mD527Jh0w6P69etrz/RVq1Y5ODioYz01NRUVupOTk9QsOGY6ESmNPJmekJDQsmXLWrVqubi42NnZGRgY1KhRo3Tp0h889zJu3DhTU9PAwMCoqCgbG5uGDRvKGMHMdCJSGnkyXVNGRsaLFy82bdr0448/1qlTp0uXLsePHxfTcoLSHrsBExOTKVOmiFEyYaYTkdLIn+lqhw8f/vnnn0eOHJnbHenu3LkzY8aMVatWtWrVytnZ2dfXd968efjLe0wTEeVPIWb6Bx07dszT07Nr164eHh41atTo3r178+bN+/fvz0wnIsqfosx0yZMnT+rUqWNkZHTixAkxSibMdCJSmiLOdOmq6/h78uTJH3/8cerUqWKCHJjpRKQ0RZnpu3fvrlChwrlz56RmYGCgoaFh165dpWbBMdOJSGkKK9Nfv349Z86ciRMnHj58WIzKBrX5tWvXREPlxYsXAwYMSEpKEu2CYaYTkdIUVqYnJCQ4OTkZGRl5eHg8efJEjP20mOlEpDRFfD599erVNjY2lpaW1ioGBgYtW7bk916IiPKnEDN9y5YtvXv37ty588mTJ8WoPzp//nzlypUPHjzYv3//9u3b3717F51BTC4wZjoRKY08mf769evly5cvXLhwscrvv/++bNmyqlWrNm3adNSoUchu0e+PfHx8OnToIA2MHDkSA4h1R0fHtLQ01fSCYqYTkdLIk+kJCQkotJHgLbJ4eXl9+eWXe/bsET1ysmDBgsaNG2MAO4O+ffti4ObNm8bGxtJNTQuOmU5ESlOI514+eF3G0NBQJyenkJCQ8PBwMzOzzp0742/v3r3F5AJjphOR0hRipru7u/v5+YlGLl6+fCndqe7hw4fjx49fuXKlXEU6MNOJSGnkyfT09PRHjx4FBgYimiEoKOjJkyf29vZbt24VPXISFRWV/fYXp06d4j2miYjyR55Mj42NrV69upGRkYmG77//XvslXJYsWdK+fXvsD0T73bspU6ZYWFhojikIZjoRKY08mZ6ZmZmcnIyiO01FGn7z5g3Gix45SUxMxHM3bdoU/dHs06cP9gqo8aWpBcdMJyKlkfl8Ogr2iIgI0cib4cOHYwmaNWtWr169gt9XWhMznYiURrZMDwsLa9OmTeXKlR0cHNA8fPjwmDFjpEm5iY+Pf/ToUWRkZJcuXfCohw8fPn369PHjx2JygTHTiUhpZMv0+vXr9+/fX/rREJrPnz83MTFBqkpTc7R169affvrJ1NTU1tbWxsbG3NzcwMAA1TrPpxMR5Y88mY4Er1q1alxcXERERI0aNaSRH/x+elpaWmJiIjI3SQUDIJ1blwUznYiURp5MR5qbmZkFBAS8ePFCynQkKQrws2fPSh2KBDOdiJRGtnMvM2bMsLKymjx5soGBwfz58+3t7du2bSumFRFmOhEpjWyZDvv37+/Ro0fz5s07dOiwatUquX46lG/MdCJSGjkz/c+GmU5ESiNPpr99+xYzOv5HR44ciYmJET1ygkehlodkDdmvFpBvzHQiUhp5Mj0qKurbb7+1sLCoUaOGfRYzM7MLFy6IHjnZsmXLV199ZW5ujs6mKoaGhu7u7lq+y5iZmYmMzuOXHZnpRKQ08mR6aGiosbGx9qo8u4iIiObNm//www/Lli0LDw8PDg6+f/8+/uZ2RYHAwMC2bds2bNjQ09Pz6NGjYmzumOk65saNGwMHDkQFgLe1Tp06U6ZMCQsLE9OISEW2TDcxMcnfL/v379/v4OAwYMCAuLg4MSoXjRs3Xrx4MQYOHTqEXQgODqTxuWGm6xIk+N///vcSf1S6dOndu3eLHkQk77kXKysrR0fHGjVqoIbq3bv3zZs3xeQPefv2rY+Pj5OT0+bNm8WobNDn4MGDaarb2mEYT5TbLfHUmOk6Y/bs2SLFs/niiy/OnTsn+hEpnjyZjpDFdoXMhcOHD/v7+3ft2vX7779/9OiR6JGTS5cuoTwfOXLk2LFjp06d6ubmhk20SZMmYnIuUlJSUJo1aNDgg4cFzHTd8Pz58++++05K8BzVrVtXdCVSPHkyPUetWrXau3evaOQEhXbPnj0HZRk1atT48eOnTZum/V+g8+bNQ2k2Y8YM0daQkZERHR39QiUxMfHYsWNGRkbM9OJu3bp1Irxz8fnnnz948ED0JlI2mTMdqZqamoqyHcNv3ryRBmQXEhJiZWWV/dxOTExMhw4dUMI3bty4WbNmjo6Oenp6HzxNT39y2H+L8M7dB0/EESmEbJmOcnjo0KF2dnYmJibW1tatW7fWfuJFDUF89erVM2fOoL+WfUBycvKlS5ewz5CaLVq0WL58uTSshqnx8fGxKikpKSdPnmSdrgOWLVsmkjsXf/vb327fvi16EymbbJnesWNHzOjKlSuBgYF37twZPXo0SumEhAQxORejRo2qVKmShYUFdgPVqlWztbXFHMS0P0pKSsIMEesYjoyMNDY2/uAFwng+XTcEBAR88cUXIr9zgg9PIR0REhU78mR6WFiYoaHhe18WdnJy2rZtm2jkZNeuXeXLl7927ZrUfP369eDBg6VbauTI398f8/T29nZ2dp4yZYoYmztmus7AIaDI75xov5U5kaLIk+kvX75EeqJCF23VaRA7O7uDBw+Kdk58fHw6deokGiqYg6mpKcJdtLOJiYlBUj9//ly0tWKm64w3b97gQFBEuIa//vWvc+fOFZ2ISMZzL7/88gsCdP78+Zs3b16zZk39+vUbNmyo/RssN27cqFu3bnBwsGi/ezdt2rS+ffuKRoEx03VJZmYmDtTq1Knz448/fvvttxUqVGjduvXFixfFZCJSkS3Tsclt3LixTZs2bm5uTZs2nTFjxgdPph84cOCzzz77+uuva9asWatWLeQvyi5LS0sXFxcnJycM5OUCAFow03VSbGzss2fP+LYS5UieTEc9npqaKhpZ4uLioqOjRSMnT58+PXjw4JEjR/aqIOKPHz+Ov1Jz586dBbyaBzOdiJRGnkwPDQ3t3LlzUlKSaKuKKWdn5z179oh2UWCmE5HSyHbuBZnu6OgYGRmJ4eDgYBMTky5dumj/hhnq9I0bN65du3ZdltWrV+/YsSO36zJ+LGY6ESmNbJkOU6ZMcXBw8PPz09fXz8t3DRctWvTll1/i6RtkcXNzw74hj5dH/yBmOhEpjTyZjspaCuLly5d/++23vr6+GMYY9c8+c+Tj44MEF41CwEwnIqWRJ9NjY2NRoZuZmdnZ2VWuXNne3t7S0tLAwED7RVCzfz9dXsx0IlIaeTL97du3t27dQobevHnzzp07N1SuXbuWmJgoeuRk5syZzZo1S0hIiIiICFcJCwv74J0u8o6ZTkRKI+f59I+