prepare_features.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "qb9mY_HmN913"
   },
   "source": [
    "# Домашнее задание для Junior DS по разработке PD модели"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "NbqnB_V8N915"
   },
   "source": [
    "<b>Задание:</b> Необходимо разработать модель предсказания дефолта. Даны финансовые данные 32 395 компаний (выручка, активы, пассивы и т.д). Результат будет оцениваться на скрытой выборке из 200 компаний по метрике качества accuracy_score\n",
    "\n",
    "<b>Цель задания</b> научиться / показать знания в разработке моделей оценки риска - probability of default. Задание приближено к реальному, данные синтетические. Лидерборд для оценки собственного решения и геймификации процесса обучения. Первое место в лидерборде не является целью. Цель - правильно разработанная модель, удовлетворяющая требованиям банковской системы. В случае возникновения вопросов, сотрудники блока Риски готовы проконсультировать и дать обратную связь на модель (телеграм чат).\n",
    "\n",
    "<b>Метрика качества</b> accuracy_score вычисляется, как ( True positive + True negative ) / Total. Если сабмит-файл, неправильного формата или неверное количество строк, метрика будет = 0."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "EJ9_SMqyN916"
   },
   "source": [
    "### Импортируем библиотеки"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 124,
   "metadata": {
    "id": "Vo4g-4Y5N917"
   },
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "from sklearn.metrics import f1_score\n",
    "from matplotlib import pyplot as plt\n",
    "import seaborn as sns\n",
    "from sklearn import preprocessing\n",
    "from sklearn.preprocessing import StandardScaler\n",
    "from sklearn.model_selection import cross_val_score\n",
    "from sklearn.model_selection import train_test_split\n",
    "from sklearn.linear_model import LogisticRegression\n",
    "from imblearn.pipeline import Pipeline\n",
    "from sklearn.model_selection import GridSearchCV\n",
    "from sklearn.metrics import accuracy_score\n",
    "from imblearn.over_sampling import SMOTE\n",
    "pd.set_option('display.max_rows', 500)\n",
    "pd.set_option('display.max_columns', 500)\n",
    "import warnings\n",
    "from pandas.core.common import SettingWithCopyWarning\n",
    "warnings.simplefilter(action=\"ignore\", category=SettingWithCopyWarning)\n",
    "warnings.simplefilter(action='ignore', category=FutureWarning)\n",
    "warnings.simplefilter(action='ignore', category=RuntimeWarning)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "4k8ndBMHN92A"
   },
   "source": [
    "### Подгружаем данные"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 125,
   "metadata": {
    "id": "XwbL4T6rN92G"
   },
   "outputs": [],
   "source": [
    "train_df = pd.read_csv('https://raw.githubusercontent.com/BKHV/risk_models/master/data/PD-data-train.csv', sep=';')\n",
    "test_df = pd.read_csv('https://raw.githubusercontent.com/BKHV/risk_models/master/data/PD-data-test.csv', sep=';')\n",
    "desc_df = pd.read_csv('https://raw.githubusercontent.com/BKHV/risk_models/master/data/PD-data-desc.csv', sep=';')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 126,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 0
    },
    "id": "iYLV8T0mm7qD",
    "outputId": "ecdd3342-f2e5-4d07-ec4c-847680a7a446"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>record_id</th>\n",
       "      <th>ar_revenue</th>\n",
       "      <th>ar_total_expenses</th>\n",
       "      <th>ar_sale_cost</th>\n",
       "      <th>ar_selling_expenses</th>\n",
       "      <th>ar_management_expenses</th>\n",
       "      <th>ar_sale_profit</th>\n",
       "      <th>ar_balance_of_rvns_and_expns</th>\n",
       "      <th>ar_profit_before_tax</th>\n",
       "      <th>ar_taxes</th>\n",
       "      <th>ar_other_profit_and_losses</th>\n",
       "      <th>ar_net_profit</th>\n",
       "      <th>ab_immobilized_assets</th>\n",
       "      <th>ab_mobile_current_assets</th>\n",
       "      <th>ab_inventory</th>\n",
       "      <th>ab_accounts_receivable</th>\n",
       "      <th>ab_other_current_assets</th>\n",
       "      <th>ab_cash_and_securities</th>\n",
       "      <th>ab_losses</th>\n",
       "      <th>ab_own_capital</th>\n",
       "      <th>ab_borrowed_capital</th>\n",
       "      <th>ab_long_term_liabilities</th>\n",
       "      <th>ab_short_term_borrowing</th>\n",
       "      <th>ab_accounts_payable</th>\n",
       "      <th>ab_other_borrowings</th>\n",
       "      <th>bus_age</th>\n",
       "      <th>ogrn_age</th>\n",
       "      <th>adr_actual_age</th>\n",
       "      <th>head_actual_age</th>\n",
       "      <th>cap_actual_age</th>\n",
       "      <th>ul_staff_range</th>\n",
       "      <th>ul_capital_sum</th>\n",
       "      <th>ul_founders_cnt</th>\n",
       "      <th>ul_branch_cnt</th>\n",
       "      <th>ul_strategic_flg</th>\n",
       "      <th>ul_systematizing_flg</th>\n",
       "      <th>default_12m</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>7</td>\n",
       "      <td>52996000.0</td>\n",
       "      <td>48344000.0</td>\n",
       "      <td>48344000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4652000.0</td>\n",
       "      <td>-2608000.0</td>\n",
       "      <td>2044000.0</td>\n",
       "      <td>846000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1198000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>7240000.0</td>\n",
       "      <td>4988000.0</td>\n",
       "      <td>2252000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>255000.0</td>\n",
       "      <td>1198000.0</td>\n",
       "      <td>663000.0</td>\n",
       "      <td>15872000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>11349000.0</td>\n",
       "      <td>4523000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>198</td>\n",
       "      <td>136</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>50000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>13</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>256</td>\n",
       "      <td>135</td>\n",
       "      <td>12</td>\n",
       "      <td>12</td>\n",
       "      <td>12</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>18</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>33</td>\n",
       "      <td>33</td>\n",
       "      <td>28</td>\n",
       "      <td>28</td>\n",
       "      <td>28</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>22</td>\n",
       "      <td>32049000.0</td>\n",
       "      <td>29568000.0</td>\n",
       "      <td>29568000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2481000.0</td>\n",
       "      <td>-260000.0</td>\n",
       "      <td>2221000.0</td>\n",
       "      <td>302000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1919000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4245000.0</td>\n",
       "      <td>4082000.0</td>\n",
       "      <td>163000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>25000.0</td>\n",
       "      <td>1919000.0</td>\n",
       "      <td>2219000.0</td>\n",
       "      <td>3652000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3652000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>185</td>\n",
       "      <td>139</td>\n",
       "      <td>8</td>\n",
       "      <td>8</td>\n",
       "      <td>8</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>300000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>23</td>\n",
       "      <td>16458000.0</td>\n",
       "      <td>14935000.0</td>\n",
       "      <td>14935000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1523000.0</td>\n",
       "      <td>-274000.0</td>\n",
       "      <td>1249000.0</td>\n",
       "      <td>538000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>711000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>8950000.0</td>\n",
       "      <td>8606000.0</td>\n",
       "      <td>344000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>492000.0</td>\n",
       "      <td>711000.0</td>\n",
       "      <td>12439000.0</td>\n",
       "      <td>1279000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1279000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>220</td>\n",
       "      <td>138</td>\n",
       "      <td>27</td>\n",
       "      <td>27</td>\n",
       "      <td>27</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>24</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>100</td>\n",
       "      <td>100</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>350000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>30</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>266</td>\n",
       "      <td>27</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>35000.0</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>37</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>31</td>\n",
       "      <td>31</td>\n",
       "      <td>30</td>\n",
       "      <td>30</td>\n",
       "      <td>30</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>38</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>27</td>\n",
       "      <td>27</td>\n",
       "      <td>26</td>\n",
       "      <td>26</td>\n",
       "      <td>26</td>\n",
       "      <td>[1-100]</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>40</td>\n",
       "      <td>125432000.0</td>\n",
       "      <td>122655000.0</td>\n",
       "      <td>122655000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2777000.0</td>\n",
       "      <td>-63000.0</td>\n",
       "      <td>2714000.0</td>\n",
       "      <td>579000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2135000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>24680000.0</td>\n",
       "      <td>8263000.0</td>\n",
       "      <td>16417000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>106000.0</td>\n",
       "      <td>2135000.0</td>\n",
       "      <td>11267000.0</td>\n",
       "      <td>11912000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13000.0</td>\n",
       "      <td>11899000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>170</td>\n",
       "      <td>132</td>\n",
       "      <td>15</td>\n",
       "      <td>15</td>\n",
       "      <td>15</td>\n",
       "      <td>(100-500]</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   record_id   ar_revenue  ar_total_expenses  ar_sale_cost  \\\n",
       "0          7   52996000.0         48344000.0    48344000.0   \n",
       "1         13          NaN                NaN           NaN   \n",
       "2         18          NaN                NaN           NaN   \n",
       "3         22   32049000.0         29568000.0    29568000.0   \n",
       "4         23   16458000.0         14935000.0    14935000.0   \n",
       "5         24          NaN                NaN           NaN   \n",
       "6         30          NaN                NaN           NaN   \n",
       "7         37          NaN                NaN           NaN   \n",
       "8         38          NaN                NaN           NaN   \n",
       "9         40  125432000.0        122655000.0   122655000.0   \n",
       "\n",
       "   ar_selling_expenses  ar_management_expenses  ar_sale_profit  \\\n",
       "0                  0.0                     0.0       4652000.0   \n",
       "1                  NaN                     NaN             NaN   \n",
       "2                  NaN                     NaN             NaN   \n",
       "3                  0.0                     0.0       2481000.0   \n",
       "4                  0.0                     0.0       1523000.0   \n",
       "5                  NaN                     NaN             NaN   \n",
       "6                  NaN                     NaN             NaN   \n",
       "7                  NaN                     NaN             NaN   \n",
       "8                  NaN                     NaN             NaN   \n",
       "9                  0.0                     0.0       2777000.0   \n",
       "\n",
       "   ar_balance_of_rvns_and_expns  ar_profit_before_tax  ar_taxes  \\\n",
       "0                    -2608000.0             2044000.0  846000.0   \n",
       "1                           NaN                   NaN       NaN   \n",
       "2                           NaN                   NaN       NaN   \n",
       "3                     -260000.0             2221000.0  302000.0   \n",
       "4                     -274000.0             1249000.0  538000.0   \n",
       "5                           NaN                   NaN       NaN   \n",
       "6                           NaN                   NaN       NaN   \n",
       "7                           NaN                   NaN       NaN   \n",
       "8                           NaN                   NaN       NaN   \n",
       "9                      -63000.0             2714000.0  579000.0   \n",
       "\n",
       "   ar_other_profit_and_losses  ar_net_profit  ab_immobilized_assets  \\\n",
       "0                         0.0      1198000.0                    0.0   \n",
       "1                         NaN            NaN                    NaN   \n",
       "2                         NaN            NaN                    NaN   \n",
       "3                         0.0      1919000.0                    0.0   \n",
       "4                         0.0       711000.0                    0.0   \n",
       "5                         NaN            NaN                    NaN   \n",
       "6                         NaN            NaN                    NaN   \n",
       "7                         NaN            NaN                    NaN   \n",
       "8                         NaN            NaN                    NaN   \n",
       "9                         0.0      2135000.0                    0.0   \n",
       "\n",
       "   ab_mobile_current_assets  ab_inventory  ab_accounts_receivable  \\\n",
       "0                 7240000.0     4988000.0               2252000.0   \n",
       "1                       NaN           NaN                     NaN   \n",
       "2                       NaN           NaN                     NaN   \n",
       "3                 4245000.0     4082000.0                163000.0   \n",
       "4                 8950000.0     8606000.0                344000.0   \n",
       "5                       NaN           NaN                     NaN   \n",
       "6                       NaN           NaN                     NaN   \n",
       "7                       NaN           NaN                     NaN   \n",
       "8                       NaN           NaN                     NaN   \n",
       "9                24680000.0     8263000.0              16417000.0   \n",
       "\n",
       "   ab_other_current_assets  ab_cash_and_securities  ab_losses  ab_own_capital  \\\n",
       "0                      0.0                255000.0  1198000.0        663000.0   \n",
       "1                      NaN                     NaN        NaN             NaN   \n",
       "2                      NaN                     NaN        NaN             NaN   \n",
       "3                      0.0                 25000.0  1919000.0       2219000.0   \n",
       "4                      0.0                492000.0   711000.0      12439000.0   \n",
       "5                      NaN                     NaN        NaN             NaN   \n",
       "6                      NaN                     NaN        NaN             NaN   \n",
       "7                      NaN                     NaN        NaN             NaN   \n",
       "8                      NaN                     NaN        NaN             NaN   \n",
       "9                      0.0                106000.0  2135000.0      11267000.0   \n",
       "\n",
       "   ab_borrowed_capital  ab_long_term_liabilities  ab_short_term_borrowing  \\\n",
       "0           15872000.0                       0.0               11349000.0   \n",
       "1                  NaN                       NaN                      NaN   \n",
       "2                  NaN                       NaN                      NaN   \n",
       "3            3652000.0                       0.0                3652000.0   \n",
       "4            1279000.0                       0.0                      0.0   \n",
       "5                  NaN                       NaN                      NaN   \n",
       "6                  NaN                       NaN                      NaN   \n",
       "7                  NaN                       NaN                      NaN   \n",
       "8                  NaN                       NaN                      NaN   \n",
       "9           11912000.0                       0.0                  13000.0   \n",
       "\n",
       "   ab_accounts_payable  ab_other_borrowings  bus_age  ogrn_age  \\\n",
       "0            4523000.0                  0.0      198       136   \n",
       "1                  NaN                  NaN      256       135   \n",
       "2                  NaN                  NaN       33        33   \n",
       "3                  0.0                  0.0      185       139   \n",
       "4            1279000.0                  0.0      220       138   \n",
       "5                  NaN                  NaN      100       100   \n",
       "6                  NaN                  NaN      266        27   \n",
       "7                  NaN                  NaN       31        31   \n",
       "8                  NaN                  NaN       27        27   \n",
       "9           11899000.0                  0.0      170       132   \n",
       "\n",
       "   adr_actual_age  head_actual_age  cap_actual_age ul_staff_range  \\\n",
       "0               3                3               3        [1-100]   \n",
       "1              12               12              12        [1-100]   \n",
       "2              28               28              28        [1-100]   \n",
       "3               8                8               8        [1-100]   \n",
       "4              27               27              27        [1-100]   \n",
       "5               5                5               5        [1-100]   \n",
       "6               7                7               7        [1-100]   \n",
       "7              30               30              30        [1-100]   \n",
       "8              26               26              26        [1-100]   \n",
       "9              15               15              15      (100-500]   \n",
       "\n",
       "   ul_capital_sum  ul_founders_cnt  ul_branch_cnt  ul_strategic_flg  \\\n",
       "0         50000.0                2              0                 0   \n",
       "1         10000.0                5              0                 0   \n",
       "2         10000.0                2              0                 0   \n",
       "3        300000.0                1              0                 0   \n",
       "4         10000.0                2              0                 0   \n",
       "5        350000.0                1              0                 0   \n",
       "6         35000.0                3              0                 0   \n",
       "7         10000.0                2              0                 0   \n",
       "8         10000.0                1              0                 0   \n",
       "9         10000.0                2              0                 0   \n",
       "\n",
       "   ul_systematizing_flg  default_12m  \n",
       "0                     0            0  \n",
       "1                     0            0  \n",
       "2                     0            0  \n",
       "3                     0            0  \n",
       "4                     0            0  \n",
       "5                     0            0  \n",
       "6                     0            0  \n",
       "7                     0            0  \n",
       "8                     0            0  \n",
       "9                     0            0  "
      ]
     },
     "execution_count": 126,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df.head(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "PQgDXmx-QPs_"
   },
   "source": [
    "Описание данных"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 127,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 0
    },
    "id": "15_jhk2bQPs_",
    "outputId": "c14d9f95-25c4-4570-9394-a48450e20751",
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>field</th>\n",
       "      <th>desc_eng</th>\n",
       "      <th>desc_rus</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>ar_revenue</td>\n",
       "      <td>Sales revenue (at the end of the last year)</td>\n",
       "      <td>Выручка от реализации (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ar_total_expenses</td>\n",
       "      <td>Total expenses for the last year</td>\n",
       "      <td>Общие расходы за последний год</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>ar_sale_cost</td>\n",
       "      <td>Cost of sales (at the end of the last year)</td>\n",
       "      <td>Себестоимость продаж (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>ar_selling_expenses</td>\n",
       "      <td>Selling expenses (at the end of the last year)</td>\n",
       "      <td>Коммерческие расходы (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>ar_management_expenses</td>\n",
       "      <td>Administrative expenses (at the end of the las...</td>\n",
       "      <td>Управленческие расходы (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>ar_sale_profit</td>\n",
       "      <td>Profit from sales (at the end of the last year)</td>\n",
       "      <td>Прибыль от реализации (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>ar_balance_of_rvns_and_expns</td>\n",
       "      <td>Balance of income and expenses (at the end of ...</td>\n",
       "      <td>Баланс доходов и расходов (на конец последнего...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>ar_profit_before_tax</td>\n",
       "      <td>Gross Profit (end of last year)</td>\n",
       "      <td>Валовая прибыль (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>ar_taxes</td>\n",
       "      <td>Current income tax (at the end of the last year)</td>\n",
       "      <td>Текущий на налог на прибыль (на конец последне...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>ar_other_profit_and_losses</td>\n",
       "      <td>Other income and expenses (at the end of the l...</td>\n",
       "      <td>Прочие доходы и расходы (на конец последнего г...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>ar_net_profit</td>\n",
       "      <td>Net profit (at the end of the last year)</td>\n",
       "      <td>Чистая прибыль (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>ab_immobilized_assets</td>\n",
       "      <td>Fixed assets for the last year</td>\n",
       "      <td>Основные внеоборотные средства за последний год</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>ab_mobile_current_assets</td>\n",
       "      <td>Current assets (at the end of the last year)</td>\n",
       "      <td>Оборотные активы (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>ab_inventory</td>\n",
       "      <td>Stocks (at the end of the last year)</td>\n",
       "      <td>Запасы (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>ab_accounts_receivable</td>\n",
       "      <td>Accounts receivable (at the end of the last year)</td>\n",
       "      <td>Дебиторская задолженность (на конец последнего...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>ab_other_current_assets</td>\n",
       "      <td>Other current assets (at the end of the last y...</td>\n",
       "      <td>Прочие оборотные активы (на конец последнего г...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>ab_cash_and_securities</td>\n",
       "      <td>Cash and cash equivalents (at the end of the l...</td>\n",
       "      <td>Денежные средства и денежные эквиваленты (на к...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>ab_losses</td>\n",
       "      <td>Retained earnings (at the end of the last year)</td>\n",
       "      <td>Нераспределенная прибыль (на конец последнего ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>ab_own_capital</td>\n",
       "      <td>Capital (at the end of the last year)</td>\n",
       "      <td>Капитал (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>ab_borrowed_capital</td>\n",
       "      <td>Total debt (end of last year)</td>\n",
       "      <td>Общие долговые обязательства (на конец последн...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>ab_long_term_liabilities</td>\n",
       "      <td>Long-term liabilities (at the end of the last ...</td>\n",
       "      <td>Долгосрочный обязательства (на конец последнег...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>ab_short_term_borrowing</td>\n",
       "      <td>Short-term borrowed funds (at the end of the l...</td>\n",
       "      <td>Краткосрочные заемные средства (на конец после...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>ab_accounts_payable</td>\n",
       "      <td>Accounts payable for the last year</td>\n",
       "      <td>Кредиторская задодженность за последний год</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>ab_other_borrowings</td>\n",
       "      <td>Other liabilities (at the end of the last year)</td>\n",
       "      <td>Прочие обязательства (на конец последнего года)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>bus_age</td>\n",
       "      <td>Business duration</td>\n",
       "      <td>Срок ведения бизнеса</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>ogrn_age</td>\n",
       "      <td>Term from the moment the PSRN was assigned</td>\n",
       "      <td>Срок с момента присваивания ОГРН</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>adr_actual_age</td>\n",
       "      <td>Term from the date of registration of the lega...</td>\n",
       "      <td>Срок с момента регистрации юридического адреса</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>head_actual_age</td>\n",
       "      <td>Term since the appointment of the head</td>\n",
       "      <td>Срок с момента назначения руководителя</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>cap_actual_age</td>\n",
       "      <td>Term from the moment of capital installation</td>\n",
       "      <td>Срок с момента установки капитала</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>ul_staff_range</td>\n",
       "      <td>The number of employees</td>\n",
       "      <td>Количество сотрудников</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>ul_capital_sum</td>\n",
       "      <td>Capital amount</td>\n",
       "      <td>Величина капитала</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>ul_founders_cnt</td>\n",
       "      <td>Number of shareholders</td>\n",
       "      <td>Количество акционеров</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>ul_branch_cnt</td>\n",
       "      <td>Number of branches</td>\n",
       "      <td>Количество филиалов</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>ul_strategic_flg</td>\n",
       "      <td>A company of strategic importance</td>\n",
       "      <td>Компания стратегического значения</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>ul_systematizing_flg</td>\n",
       "      <td>Backbone company</td>\n",
       "      <td>Системообразующая компания</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                           field  \\\n",
       "0                     ar_revenue   \n",
       "1              ar_total_expenses   \n",
       "2                   ar_sale_cost   \n",
       "3            ar_selling_expenses   \n",
       "4         ar_management_expenses   \n",
       "5                 ar_sale_profit   \n",
       "6   ar_balance_of_rvns_and_expns   \n",
       "7           ar_profit_before_tax   \n",
       "8                       ar_taxes   \n",
       "9     ar_other_profit_and_losses   \n",
       "10                 ar_net_profit   \n",
       "11         ab_immobilized_assets   \n",
       "12      ab_mobile_current_assets   \n",
       "13                  ab_inventory   \n",
       "14        ab_accounts_receivable   \n",
       "15       ab_other_current_assets   \n",
       "16        ab_cash_and_securities   \n",
       "17                     ab_losses   \n",
       "18                ab_own_capital   \n",
       "19           ab_borrowed_capital   \n",
       "20      ab_long_term_liabilities   \n",
       "21       ab_short_term_borrowing   \n",
       "22           ab_accounts_payable   \n",
       "23           ab_other_borrowings   \n",
       "24                       bus_age   \n",
       "25                      ogrn_age   \n",
       "26                adr_actual_age   \n",
       "27               head_actual_age   \n",
       "28                cap_actual_age   \n",
       "29                ul_staff_range   \n",
       "30                ul_capital_sum   \n",
       "31               ul_founders_cnt   \n",
       "32                 ul_branch_cnt   \n",
       "33              ul_strategic_flg   \n",
       "34          ul_systematizing_flg   \n",
       "\n",
       "                                             desc_eng  \\\n",
       "0         Sales revenue (at the end of the last year)   \n",
       "1                    Total expenses for the last year   \n",
       "2         Cost of sales (at the end of the last year)   \n",
       "3      Selling expenses (at the end of the last year)   \n",
       "4   Administrative expenses (at the end of the las...   \n",
       "5     Profit from sales (at the end of the last year)   \n",
       "6   Balance of income and expenses (at the end of ...   \n",
       "7                     Gross Profit (end of last year)   \n",
       "8    Current income tax (at the end of the last year)   \n",
       "9   Other income and expenses (at the end of the l...   \n",
       "10           Net profit (at the end of the last year)   \n",
       "11                     Fixed assets for the last year   \n",
       "12       Current assets (at the end of the last year)   \n",
       "13               Stocks (at the end of the last year)   \n",
       "14  Accounts receivable (at the end of the last year)   \n",
       "15  Other current assets (at the end of the last y...   \n",
       "16  Cash and cash equivalents (at the end of the l...   \n",
       "17    Retained earnings (at the end of the last year)   \n",
       "18              Capital (at the end of the last year)   \n",
       "19                      Total debt (end of last year)   \n",
       "20  Long-term liabilities (at the end of the last ...   \n",
       "21  Short-term borrowed funds (at the end of the l...   \n",
       "22                 Accounts payable for the last year   \n",
       "23    Other liabilities (at the end of the last year)   \n",
       "24                                  Business duration   \n",
       "25         Term from the moment the PSRN was assigned   \n",
       "26  Term from the date of registration of the lega...   \n",
       "27             Term since the appointment of the head   \n",
       "28       Term from the moment of capital installation   \n",
       "29                            The number of employees   \n",
       "30                                     Capital amount   \n",
       "31                             Number of shareholders   \n",
       "32                                 Number of branches   \n",
       "33                  A company of strategic importance   \n",
       "34                                   Backbone company   \n",
       "\n",
       "                                             desc_rus  \n",
       "0    Выручка от реализации (на конец последнего года)  \n",
       "1                      Общие расходы за последний год  \n",
       "2     Себестоимость продаж (на конец последнего года)  \n",
       "3     Коммерческие расходы (на конец последнего года)  \n",
       "4   Управленческие расходы (на конец последнего года)  \n",
       "5    Прибыль от реализации (на конец последнего года)  \n",
       "6   Баланс доходов и расходов (на конец последнего...  \n",
       "7          Валовая прибыль (на конец последнего года)  \n",
       "8   Текущий на налог на прибыль (на конец последне...  \n",
       "9   Прочие доходы и расходы (на конец последнего г...  \n",
       "10          Чистая прибыль (на конец последнего года)  \n",
       "11    Основные внеоборотные средства за последний год  \n",
       "12        Оборотные активы (на конец последнего года)  \n",
       "13                  Запасы (на конец последнего года)  \n",
       "14  Дебиторская задолженность (на конец последнего...  \n",
       "15  Прочие оборотные активы (на конец последнего г...  \n",
       "16  Денежные средства и денежные эквиваленты (на к...  \n",
       "17  Нераспределенная прибыль (на конец последнего ...  \n",
       "18                 Капитал (на конец последнего года)  \n",
       "19  Общие долговые обязательства (на конец последн...  \n",
       "20  Долгосрочный обязательства (на конец последнег...  \n",
       "21  Краткосрочные заемные средства (на конец после...  \n",
       "22        Кредиторская задодженность за последний год  \n",
       "23    Прочие обязательства (на конец последнего года)  \n",
       "24                               Срок ведения бизнеса  \n",
       "25                   Срок с момента присваивания ОГРН  \n",
       "26     Срок с момента регистрации юридического адреса  \n",
       "27             Срок с момента назначения руководителя  \n",
       "28                  Срок с момента установки капитала  \n",
       "29                             Количество сотрудников  \n",
       "30                                  Величина капитала  \n",
       "31                              Количество акционеров  \n",
       "32                                Количество филиалов  \n",
       "33                  Компания стратегического значения  \n",
       "34                         Системообразующая компания  "
      ]
     },
     "execution_count": 127,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "desc_df.head(50)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Данные нам признаки отражают финансовую отчетность компании. Но сами по себе достаточно слабо отражают ее финансовую устойчивость. Для ее отображения из исходных данных рассчитаем финансовые мультипликаторы"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 128,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 32395 entries, 0 to 32394\n",
      "Data columns (total 37 columns):\n",
      " #   Column                        Non-Null Count  Dtype  \n",
      "---  ------                        --------------  -----  \n",
      " 0   record_id                     32395 non-null  int64  \n",
      " 1   ar_revenue                    17250 non-null  float64\n",
      " 2   ar_total_expenses             17250 non-null  float64\n",
      " 3   ar_sale_cost                  17250 non-null  float64\n",
      " 4   ar_selling_expenses           17250 non-null  float64\n",
      " 5   ar_management_expenses        17250 non-null  float64\n",
      " 6   ar_sale_profit                17250 non-null  float64\n",
      " 7   ar_balance_of_rvns_and_expns  17250 non-null  float64\n",
      " 8   ar_profit_before_tax          17250 non-null  float64\n",
      " 9   ar_taxes                      17250 non-null  float64\n",
      " 10  ar_other_profit_and_losses    17250 non-null  float64\n",
      " 11  ar_net_profit                 17250 non-null  float64\n",
      " 12  ab_immobilized_assets         17250 non-null  float64\n",
      " 13  ab_mobile_current_assets      17250 non-null  float64\n",
      " 14  ab_inventory                  17250 non-null  float64\n",
      " 15  ab_accounts_receivable        17250 non-null  float64\n",
      " 16  ab_other_current_assets       17250 non-null  float64\n",
      " 17  ab_cash_and_securities        17250 non-null  float64\n",
      " 18  ab_losses                     17250 non-null  float64\n",
      " 19  ab_own_capital                17250 non-null  float64\n",
      " 20  ab_borrowed_capital           17250 non-null  float64\n",
      " 21  ab_long_term_liabilities      17250 non-null  float64\n",
      " 22  ab_short_term_borrowing       17250 non-null  float64\n",
      " 23  ab_accounts_payable           17250 non-null  float64\n",
      " 24  ab_other_borrowings           17250 non-null  float64\n",
      " 25  bus_age                       32395 non-null  int64  \n",
      " 26  ogrn_age                      32395 non-null  int64  \n",
      " 27  adr_actual_age                32395 non-null  int64  \n",
      " 28  head_actual_age               32395 non-null  int64  \n",
      " 29  cap_actual_age                32395 non-null  int64  \n",
      " 30  ul_staff_range                32395 non-null  object \n",
      " 31  ul_capital_sum                32395 non-null  float64\n",
      " 32  ul_founders_cnt               32395 non-null  int64  \n",
      " 33  ul_branch_cnt                 32395 non-null  int64  \n",
      " 34  ul_strategic_flg              32395 non-null  int64  \n",
      " 35  ul_systematizing_flg          32395 non-null  int64  \n",
      " 36  default_12m                   32395 non-null  int64  \n",
      "dtypes: float64(25), int64(11), object(1)\n",
      "memory usage: 9.1+ MB\n"
     ]
    }
   ],
   "source": [
    "train_df.info()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "У нас есть 1 категориальный признак, посмотрим на него"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 129,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[1-100]      29281\n",
       "(100-500]     2757\n",
       "> 500          357\n",
       "Name: ul_staff_range, dtype: int64"
      ]
     },
     "execution_count": 129,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df['ul_staff_range'].value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "У него всего 3 значения, которые отражают растущую последовательность, значит можно применить label encoding для его кодирования"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 130,
   "metadata": {},
   "outputs": [],
   "source": [
    "le = preprocessing.LabelEncoder()\n",
    "le.fit(train_df['ul_staff_range'])\n",
    "train_df['ul_staff_range'] = le.transform(train_df['ul_staff_range'])\n",
    "test_df['ul_staff_range'] = le.transform(test_df['ul_staff_range'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 131,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "record_id                       32395\n",
       "ar_revenue                      12893\n",
       "ar_total_expenses               12779\n",
       "ar_sale_cost                    12664\n",
       "ar_selling_expenses              1994\n",
       "ar_management_expenses           1093\n",
       "ar_sale_profit                   7163\n",
       "ar_balance_of_rvns_and_expns     5063\n",
       "ar_profit_before_tax             6526\n",
       "ar_taxes                         2247\n",
       "ar_other_profit_and_losses        595\n",
       "ar_net_profit                    6231\n",
       "ab_immobilized_assets            3498\n",
       "ab_mobile_current_assets        11222\n",
       "ab_inventory                     9143\n",
       "ab_accounts_receivable           8283\n",
       "ab_other_current_assets          1210\n",
       "ab_cash_and_securities           3677\n",
       "ab_losses                        6175\n",
       "ab_own_capital                   9090\n",
       "ab_borrowed_capital             10261\n",
       "ab_long_term_liabilities         2294\n",
       "ab_short_term_borrowing          4896\n",
       "ab_accounts_payable              8797\n",
       "ab_other_borrowings              1437\n",
       "bus_age                           315\n",
       "ogrn_age                          150\n",
       "adr_actual_age                     33\n",
       "head_actual_age                    33\n",
       "cap_actual_age                     33\n",
       "ul_staff_range                      3\n",
       "ul_capital_sum                   2980\n",
       "ul_founders_cnt                   278\n",
       "ul_branch_cnt                      13\n",
       "ul_strategic_flg                    2\n",
       "ul_systematizing_flg                1\n",
       "default_12m                         2\n",
       "dtype: int64"
      ]
     },
     "execution_count": 131,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df.nunique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 132,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Удалим признак record_id так как он не несет информативности для нашей задачи\n",
    "# Так же удалим ul_systematizing_flg, так как у него 1 уникальное значение\n",
    "train_df = train_df.drop(['record_id','ul_systematizing_flg'],axis = 1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 133,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "5805"
      ]
     },
     "execution_count": 133,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Проверим выборку на дубликаты\n",
    "train_df.duplicated().sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 134,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_df = train_df.drop_duplicates()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "В наших данных большое содержание пропусков, давайте сгруппироуем объекты по кол-ву пропусков и посмотрим на их кол-во"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 135,
   "metadata": {},
   "outputs": [],
   "source": [
    "count_nan_in_objects = pd.DataFrame(train_df.isnull().T.sum()).reset_index().groupby(0).count().reset_index()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 136,
   "metadata": {},
   "outputs": [],
   "source": [
    "count_nan_in_objects.columns = ['Количесвоо пропусков в объекте','Количество объектов с этим количеством пропусков']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 137,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Количесвоо пропусков в объекте</th>\n",
       "      <th>Количество объектов с этим количеством пропусков</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>16375</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>24</td>\n",
       "      <td>10215</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Количесвоо пропусков в объекте  \\\n",
       "0                               0   \n",
       "1                              24   \n",
       "\n",
       "   Количество объектов с этим количеством пропусков  \n",
       "0                                             16375  \n",
       "1                                             10215  "
      ]
     },
     "execution_count": 137,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "count_nan_in_objects"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "ЗАметим, что в нашей выборке можно выделить 2 подвыборки по кол-ву пропусков. Посмотрим на объекты "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 138,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ar_revenue</th>\n",
       "      <th>ar_total_expenses</th>\n",
       "      <th>ar_sale_cost</th>\n",
       "      <th>ar_selling_expenses</th>\n",
       "      <th>ar_management_expenses</th>\n",
       "      <th>ar_sale_profit</th>\n",
       "      <th>ar_balance_of_rvns_and_expns</th>\n",
       "      <th>ar_profit_before_tax</th>\n",
       "      <th>ar_taxes</th>\n",
       "      <th>ar_other_profit_and_losses</th>\n",
       "      <th>ar_net_profit</th>\n",
       "      <th>ab_immobilized_assets</th>\n",
       "      <th>ab_mobile_current_assets</th>\n",
       "      <th>ab_inventory</th>\n",
       "      <th>ab_accounts_receivable</th>\n",
       "      <th>ab_other_current_assets</th>\n",
       "      <th>ab_cash_and_securities</th>\n",
       "      <th>ab_losses</th>\n",
       "      <th>ab_own_capital</th>\n",
       "      <th>ab_borrowed_capital</th>\n",
       "      <th>ab_long_term_liabilities</th>\n",
       "      <th>ab_short_term_borrowing</th>\n",
       "      <th>ab_accounts_payable</th>\n",
       "      <th>ab_other_borrowings</th>\n",
       "      <th>bus_age</th>\n",
       "      <th>ogrn_age</th>\n",
       "      <th>adr_actual_age</th>\n",
       "      <th>head_actual_age</th>\n",
       "      <th>cap_actual_age</th>\n",
       "      <th>ul_staff_range</th>\n",
       "      <th>ul_capital_sum</th>\n",
       "      <th>ul_founders_cnt</th>\n",
       "      <th>ul_branch_cnt</th>\n",
       "      <th>ul_strategic_flg</th>\n",
       "      <th>default_12m</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>256</td>\n",
       "      <td>135</td>\n",
       "      <td>12</td>\n",
       "      <td>12</td>\n",
       "      <td>12</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>33</td>\n",
       "      <td>33</td>\n",
       "      <td>28</td>\n",
       "      <td>28</td>\n",
       "      <td>28</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>100</td>\n",
       "      <td>100</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>350000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>266</td>\n",
       "      <td>27</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>2</td>\n",
       "      <td>35000.0</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>31</td>\n",
       "      <td>31</td>\n",
       "      <td>30</td>\n",
       "      <td>30</td>\n",
       "      <td>30</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32364</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>40</td>\n",
       "      <td>40</td>\n",
       "      <td>6</td>\n",
       "      <td>6</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32366</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>107</td>\n",
       "      <td>107</td>\n",
       "      <td>19</td>\n",
       "      <td>19</td>\n",
       "      <td>19</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32383</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>136</td>\n",
       "      <td>136</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>2</td>\n",
       "      <td>9408.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32387</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>237</td>\n",
       "      <td>139</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>161799.0</td>\n",
       "      <td>18</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32389</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>24</td>\n",
       "      <td>24</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>10215 rows × 35 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       ar_revenue  ar_total_expenses  ar_sale_cost  ar_selling_expenses  \\\n",
       "1             NaN                NaN           NaN                  NaN   \n",
       "2             NaN                NaN           NaN                  NaN   \n",
       "5             NaN                NaN           NaN                  NaN   \n",
       "6             NaN                NaN           NaN                  NaN   \n",
       "7             NaN                NaN           NaN                  NaN   \n",
       "...           ...                ...           ...                  ...   \n",
       "32364         NaN                NaN           NaN                  NaN   \n",
       "32366         NaN                NaN           NaN                  NaN   \n",
       "32383         NaN                NaN           NaN                  NaN   \n",
       "32387         NaN                NaN           NaN                  NaN   \n",
       "32389         NaN                NaN           NaN                  NaN   \n",
       "\n",
       "       ar_management_expenses  ar_sale_profit  ar_balance_of_rvns_and_expns  \\\n",
       "1                         NaN             NaN                           NaN   \n",
       "2                         NaN             NaN                           NaN   \n",
       "5                         NaN             NaN                           NaN   \n",
       "6                         NaN             NaN                           NaN   \n",
       "7                         NaN             NaN                           NaN   \n",
       "...                       ...             ...                           ...   \n",
       "32364                     NaN             NaN                           NaN   \n",
       "32366                     NaN             NaN                           NaN   \n",
       "32383                     NaN             NaN                           NaN   \n",
       "32387                     NaN             NaN                           NaN   \n",
       "32389                     NaN             NaN                           NaN   \n",
       "\n",
       "       ar_profit_before_tax  ar_taxes  ar_other_profit_and_losses  \\\n",
       "1                       NaN       NaN                         NaN   \n",
       "2                       NaN       NaN                         NaN   \n",
       "5                       NaN       NaN                         NaN   \n",
       "6                       NaN       NaN                         NaN   \n",
       "7                       NaN       NaN                         NaN   \n",
       "...                     ...       ...                         ...   \n",
       "32364                   NaN       NaN                         NaN   \n",
       "32366                   NaN       NaN                         NaN   \n",
       "32383                   NaN       NaN                         NaN   \n",
       "32387                   NaN       NaN                         NaN   \n",
       "32389                   NaN       NaN                         NaN   \n",
       "\n",
       "       ar_net_profit  ab_immobilized_assets  ab_mobile_current_assets  \\\n",
       "1                NaN                    NaN                       NaN   \n",
       "2                NaN                    NaN                       NaN   \n",
       "5                NaN                    NaN                       NaN   \n",
       "6                NaN                    NaN                       NaN   \n",
       "7                NaN                    NaN                       NaN   \n",
       "...              ...                    ...                       ...   \n",
       "32364            NaN                    NaN                       NaN   \n",
       "32366            NaN                    NaN                       NaN   \n",
       "32383            NaN                    NaN                       NaN   \n",
       "32387            NaN                    NaN                       NaN   \n",
       "32389            NaN                    NaN                       NaN   \n",
       "\n",
       "       ab_inventory  ab_accounts_receivable  ab_other_current_assets  \\\n",
       "1               NaN                     NaN                      NaN   \n",
       "2               NaN                     NaN                      NaN   \n",
       "5               NaN                     NaN                      NaN   \n",
       "6               NaN                     NaN                      NaN   \n",
       "7               NaN                     NaN                      NaN   \n",
       "...             ...                     ...                      ...   \n",
       "32364           NaN                     NaN                      NaN   \n",
       "32366           NaN                     NaN                      NaN   \n",
       "32383           NaN                     NaN                      NaN   \n",
       "32387           NaN                     NaN                      NaN   \n",
       "32389           NaN                     NaN                      NaN   \n",
       "\n",
       "       ab_cash_and_securities  ab_losses  ab_own_capital  ab_borrowed_capital  \\\n",
       "1                         NaN        NaN             NaN                  NaN   \n",
       "2                         NaN        NaN             NaN                  NaN   \n",
       "5                         NaN        NaN             NaN                  NaN   \n",
       "6                         NaN        NaN             NaN                  NaN   \n",
       "7                         NaN        NaN             NaN                  NaN   \n",
       "...                       ...        ...             ...                  ...   \n",
       "32364                     NaN        NaN             NaN                  NaN   \n",
       "32366                     NaN        NaN             NaN                  NaN   \n",
       "32383                     NaN        NaN             NaN                  NaN   \n",
       "32387                     NaN        NaN             NaN                  NaN   \n",
       "32389                     NaN        NaN             NaN                  NaN   \n",
       "\n",
       "       ab_long_term_liabilities  ab_short_term_borrowing  ab_accounts_payable  \\\n",
       "1                           NaN                      NaN                  NaN   \n",
       "2                           NaN                      NaN                  NaN   \n",
       "5                           NaN                      NaN                  NaN   \n",
       "6                           NaN                      NaN                  NaN   \n",
       "7                           NaN                      NaN                  NaN   \n",
       "...                         ...                      ...                  ...   \n",
       "32364                       NaN                      NaN                  NaN   \n",
       "32366                       NaN                      NaN                  NaN   \n",
       "32383                       NaN                      NaN                  NaN   \n",
       "32387                       NaN                      NaN                  NaN   \n",
       "32389                       NaN                      NaN                  NaN   \n",
       "\n",
       "       ab_other_borrowings  bus_age  ogrn_age  adr_actual_age  \\\n",
       "1                      NaN      256       135              12   \n",
       "2                      NaN       33        33              28   \n",
       "5                      NaN      100       100               5   \n",
       "6                      NaN      266        27               7   \n",
       "7                      NaN       31        31              30   \n",
       "...                    ...      ...       ...             ...   \n",
       "32364                  NaN       40        40               6   \n",
       "32366                  NaN      107       107              19   \n",
       "32383                  NaN      136       136              23   \n",
       "32387                  NaN      237       139               2   \n",
       "32389                  NaN       24        24               3   \n",
       "\n",
       "       head_actual_age  cap_actual_age  ul_staff_range  ul_capital_sum  \\\n",
       "1                   12              12               2         10000.0   \n",
       "2                   28              28               2         10000.0   \n",
       "5                    5               5               2        350000.0   \n",
       "6                    7               7               2         35000.0   \n",
       "7                   30              30               2         10000.0   \n",
       "...                ...             ...             ...             ...   \n",
       "32364                6               6               2         10000.0   \n",
       "32366               19              19               2         10000.0   \n",
       "32383               23              23               2          9408.0   \n",
       "32387                2               2               2        161799.0   \n",
       "32389                3               3               2         10000.0   \n",
       "\n",
       "       ul_founders_cnt  ul_branch_cnt  ul_strategic_flg  default_12m  \n",
       "1                    5              0                 0            0  \n",
       "2                    2              0                 0            0  \n",
       "5                    1              0                 0            0  \n",
       "6                    3              0                 0            0  \n",
       "7                    2              0                 0            0  \n",
       "...                ...            ...               ...          ...  \n",
       "32364                2              0                 0            0  \n",
       "32366                1              0                 0            0  \n",
       "32383                2              0                 0            0  \n",
       "32387               18              0                 0            0  \n",
       "32389                4              0                 0            0  \n",
       "\n",
       "[10215 rows x 35 columns]"
      ]
     },
     "execution_count": 138,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Посмотрим на пример объекта с 24 пропусками\n",
    "sum_null_in_object = pd.DataFrame(train_df.isnull().T.sum(),columns = ['count_nans'])\n",
    "ids_with_24_nans = sum_null_in_object.query('count_nans == 24').index\n",
    "train_df.loc[ids_with_24_nans,:]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Заметим, что у объектов с 24 пропусками отсутсвует финансовая отчетность. Поэтому эти подмножества стоит рассматривать отдельно. Но перед этим убедимся, что эти подмножества присутсвует и в тестовой выборке"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 139,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>index</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Кол-во пропусков</th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>82</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>118</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                  index\n",
       "Кол-во пропусков       \n",
       "0                    82\n",
       "24                  118"
      ]
     },
     "execution_count": 139,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pd.DataFrame(test_df.isnull().T.sum(),columns = [\"Кол-во пропусков\"]).reset_index().groupby(\"Кол-во пропусков\").count()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Отлично, группы такие же. Рззделим данные на две подвыборки. Это можно сделать по принципу: 1 группа-0 пропусков, 2 группа - 24 пропуска. Но лучше и проще сделать по наличию одного из финансовых показателей, ведь как мы помним у группы с 24 пропусками отсутсвует финансовая отчетность. Поэтому в нашем случае критерием разделения станет наличие прпуска в параметре ar_revenue"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 140,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_df_part_1 = train_df[train_df['ar_revenue'].isnull()]\n",
    "train_df_part_2 = train_df[~train_df['ar_revenue'].isnull()]\n",
    "\n",
    "test_records_id_part_1 = test_df[test_df['ar_revenue'].isnull()]['record_id']\n",
    "test_records_id_part_2 = test_df[~test_df['ar_revenue'].isnull()]['record_id']\n",
    "test_df = test_df.drop('record_id',axis = 1)\n",
    "test_df_part_1 = test_df[test_df['ar_revenue'].isnull()]\n",
    "test_df_part_2 = test_df[~test_df['ar_revenue'].isnull()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 141,
   "metadata": {},
   "outputs": [],
   "source": [
    "def make_features(frame_input):\n",
    "    frame = frame_input.copy()\n",
    "    # Доля дохода, которая учитывает пост-оплату\n",
    "    frame['frac_post_pay'] = frame['ab_accounts_receivable']/frame['ar_revenue']\n",
    "    frame['OPEX'] = frame['ar_total_expenses'] - frame['ar_selling_expenses'] - frame[\"ar_management_expenses\"]\n",
    "    # ДОля операционных расходов\n",
    "    frame['OER'] = frame['OPEX']/frame['ar_revenue']\n",
    "    frame['frac_comer_exp'] = frame['ar_selling_expenses' ]/ frame['ar_total_expenses']\n",
    "    frame['Net_margin'] = frame['ar_net_profit']/frame['ar_revenue']\n",
    "    frame['gross_profit_margin'] = (frame['ar_revenue'] - frame['ar_sale_cost'])/frame['ar_revenue']\n",
    "    frame['OP_Margin'] = frame['OPEX']/frame['ar_revenue']\n",
    "    frame['ROE'] = frame['ar_net_profit']/frame['ab_own_capital']\n",
    "    frame['ROA'] = frame['ar_net_profit']/(frame['ab_own_capital'] + frame['ab_borrowed_capital'])\n",
    "    frame['Debt/EBIT'] = (frame['ab_long_term_liabilities'] + frame['ab_other_borrowings'] + frame['ab_short_term_borrowing'])/frame['ar_profit_before_tax']\n",
    "    frame['Debt_ratio'] = (frame['ab_long_term_liabilities'] + frame['ab_other_borrowings'] + frame['ab_short_term_borrowing'])/(frame['ab_own_capital'] + frame['ab_borrowed_capital'])\n",
    "    frame['tax_ratio'] = frame['ar_taxes']/frame['ar_profit_before_tax']\n",
    "    frame['time_gap'] = frame['ab_accounts_payable']/(frame['ab_cash_and_securities']+frame['ab_accounts_receivable'])\n",
    "    frame['borrowing_balance'] = frame['ab_accounts_receivable']/frame['ab_accounts_payable']\n",
    "    frame['Debt/Equity'] = (frame['ab_long_term_liabilities'] + frame['ab_other_borrowings'] + frame['ab_short_term_borrowing'])/frame['ab_own_capital']\n",
    "    frame['current_ratio'] = (frame['ab_mobile_current_assets']+frame['ab_other_current_assets'])/(frame['ab_short_term_borrowing']+frame['ab_other_borrowings'])\n",
    "    frame['cash_ratio'] = frame['ab_cash_and_securities']/frame['ab_short_term_borrowing']\n",
    "    frame['fast_pay'] = (frame['ab_cash_and_securities']+frame['ab_accounts_receivable'])/(frame['ab_own_capital'] + frame['ab_borrowed_capital'])\n",
    "    frame['tumover_ratio'] = frame['ar_revenue']/(frame['ab_own_capital'] + frame['ab_borrowed_capital'])\n",
    "    return frame"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Так как у выборок с суфиксом _part_1 нет финансовой отчетности, то и новые признаки создавать не из чего"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 142,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_df_part_2_new_features = make_features(train_df_part_2)\n",
    "test_df_part_2_new_features = make_features(test_df_part_2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Проверим кол-во уникальных значений в получившихся выборках"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 143,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ar_revenue                      12893\n",
       "ar_total_expenses               12779\n",
       "ar_sale_cost                    12664\n",
       "ar_selling_expenses              1994\n",
       "ar_management_expenses           1093\n",
       "ar_sale_profit                   7163\n",
       "ar_balance_of_rvns_and_expns     5063\n",
       "ar_profit_before_tax             6526\n",
       "ar_taxes                         2247\n",
       "ar_other_profit_and_losses        595\n",
       "ar_net_profit                    6231\n",
       "ab_immobilized_assets            3498\n",
       "ab_mobile_current_assets        11222\n",
       "ab_inventory                     9143\n",
       "ab_accounts_receivable           8283\n",
       "ab_other_current_assets          1210\n",
       "ab_cash_and_securities           3677\n",
       "ab_losses                        6175\n",
       "ab_own_capital                   9090\n",
       "ab_borrowed_capital             10261\n",
       "ab_long_term_liabilities         2294\n",
       "ab_short_term_borrowing          4896\n",
       "ab_accounts_payable              8797\n",
       "ab_other_borrowings              1437\n",
       "bus_age                           294\n",
       "ogrn_age                          146\n",
       "adr_actual_age                     33\n",
       "head_actual_age                    33\n",
       "cap_actual_age                     33\n",
       "ul_staff_range                      3\n",
       "ul_capital_sum                   2318\n",
       "ul_founders_cnt                   271\n",
       "ul_branch_cnt                      12\n",
       "ul_strategic_flg                    2\n",
       "default_12m                         2\n",
       "frac_post_pay                   12686\n",
       "OPEX                            12664\n",
       "OER                             13674\n",
       "frac_comer_exp                   2147\n",
       "Net_margin                      13706\n",
       "gross_profit_margin             13674\n",
       "OP_Margin                       13674\n",
       "ROE                             12951\n",
       "ROA                             13783\n",
       "Debt/EBIT                        9670\n",
       "Debt_ratio                       9855\n",
       "tax_ratio                        7730\n",
       "time_gap                        13186\n",
       "borrowing_balance               12466\n",
       "Debt/Equity                      9787\n",
       "current_ratio                    9033\n",
       "cash_ratio                       7586\n",
       "fast_pay                        13387\n",
       "tumover_ratio                   13869\n",
       "dtype: int64"
      ]
     },
     "execution_count": 143,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df_part_2_new_features.nunique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Признаков с 1 уникальным значением не найдено"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 144,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ar_revenue                        0\n",
       "ar_total_expenses                 0\n",
       "ar_sale_cost                      0\n",
       "ar_selling_expenses               0\n",
       "ar_management_expenses            0\n",
       "ar_sale_profit                    0\n",
       "ar_balance_of_rvns_and_expns      0\n",
       "ar_profit_before_tax              0\n",
       "ar_taxes                          0\n",
       "ar_other_profit_and_losses        0\n",
       "ar_net_profit                     0\n",
       "ab_immobilized_assets             0\n",
       "ab_mobile_current_assets          0\n",
       "ab_inventory                      0\n",
       "ab_accounts_receivable            0\n",
       "ab_other_current_assets           0\n",
       "ab_cash_and_securities            0\n",
       "ab_losses                         0\n",
       "ab_own_capital                    0\n",
       "ab_borrowed_capital               0\n",
       "ab_long_term_liabilities          0\n",
       "ab_short_term_borrowing           0\n",
       "ab_accounts_payable               0\n",
       "ab_other_borrowings               0\n",
       "bus_age                         302\n",
       "ogrn_age                        148\n",
       "adr_actual_age                   33\n",
       "head_actual_age                  33\n",
       "cap_actual_age                   33\n",
       "ul_staff_range                    3\n",
       "ul_capital_sum                  964\n",
       "ul_founders_cnt                  55\n",
       "ul_branch_cnt                     9\n",
       "ul_strategic_flg                  1\n",
       "default_12m                       2\n",
       "dtype: int64"
      ]
     },
     "execution_count": 144,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df_part_1.nunique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Кроме 24 признаков с отсутвием значений есть признак ul_strategic_flg, которых хранит в себе только 1 уникальное значение. Добавим его в список на удаление"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Теперь же очистим наши выборки от ненужных столбцов. Для _part_2 это все абсолютные значения финансовых показателей. А для _part_1 это все переменные отвечающие за финансовую отчетность + ul_strategic_flg"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 145,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Выборки с фин отчетностью\n",
    "train_df_part_2_new_features = train_df_part_2_new_features.drop(['ar_revenue','ar_other_profit_and_losses','ar_profit_before_tax', 'ar_taxes', 'ar_total_expenses', 'ar_sale_cost', 'ar_selling_expenses', 'ar_management_expenses','ar_sale_profit', 'ar_balance_of_rvns_and_expns'], axis = 1)\n",
    "test_df_part_2_new_features = test_df_part_2_new_features.drop(['ar_revenue','ar_other_profit_and_losses','ar_profit_before_tax', 'ar_taxes', 'ar_total_expenses', 'ar_sale_cost', 'ar_selling_expenses', 'ar_management_expenses','ar_sale_profit', 'ar_balance_of_rvns_and_expns'], axis = 1)\n",
    "# Выборки без фин отчетности\n",
    "first_24_columns = train_df_part_1.iloc[:,:24].columns.tolist()\n",
    "train_df_part_1 = train_df_part_1.drop(first_24_columns+['ul_strategic_flg'], axis = 1)\n",
    "test_df_part_1 = test_df_part_1.drop(first_24_columns+['ul_strategic_flg'], axis = 1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Посмотрим на новые признаки"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 146,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ar_net_profit</th>\n",
       "      <th>ab_immobilized_assets</th>\n",
       "      <th>ab_mobile_current_assets</th>\n",
       "      <th>ab_inventory</th>\n",
       "      <th>ab_accounts_receivable</th>\n",
       "      <th>ab_other_current_assets</th>\n",
       "      <th>ab_cash_and_securities</th>\n",
       "      <th>ab_losses</th>\n",
       "      <th>ab_own_capital</th>\n",
       "      <th>ab_borrowed_capital</th>\n",
       "      <th>ab_long_term_liabilities</th>\n",
       "      <th>ab_short_term_borrowing</th>\n",
       "      <th>ab_accounts_payable</th>\n",
       "      <th>ab_other_borrowings</th>\n",
       "      <th>bus_age</th>\n",
       "      <th>ogrn_age</th>\n",
       "      <th>adr_actual_age</th>\n",
       "      <th>head_actual_age</th>\n",
       "      <th>cap_actual_age</th>\n",
       "      <th>ul_staff_range</th>\n",
       "      <th>ul_capital_sum</th>\n",
       "      <th>ul_founders_cnt</th>\n",
       "      <th>ul_branch_cnt</th>\n",
       "      <th>ul_strategic_flg</th>\n",
       "      <th>default_12m</th>\n",
       "      <th>frac_post_pay</th>\n",
       "      <th>OPEX</th>\n",
       "      <th>OER</th>\n",
       "      <th>frac_comer_exp</th>\n",
       "      <th>Net_margin</th>\n",
       "      <th>gross_profit_margin</th>\n",
       "      <th>OP_Margin</th>\n",
       "      <th>ROE</th>\n",
       "      <th>ROA</th>\n",
       "      <th>Debt/EBIT</th>\n",
       "      <th>Debt_ratio</th>\n",
       "      <th>tax_ratio</th>\n",
       "      <th>time_gap</th>\n",
       "      <th>borrowing_balance</th>\n",
       "      <th>Debt/Equity</th>\n",
       "      <th>current_ratio</th>\n",
       "      <th>cash_ratio</th>\n",
       "      <th>fast_pay</th>\n",
       "      <th>tumover_ratio</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1198000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>7240000.0</td>\n",
       "      <td>4988000.0</td>\n",
       "      <td>2252000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>255000.0</td>\n",
       "      <td>1198000.0</td>\n",
       "      <td>663000.0</td>\n",
       "      <td>15872000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>11349000.0</td>\n",
       "      <td>4523000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>198</td>\n",
       "      <td>136</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>50000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.042494</td>\n",
       "      <td>48344000.0</td>\n",
       "      <td>0.912220</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.022605</td>\n",
       "      <td>0.087780</td>\n",
       "      <td>0.912220</td>\n",
       "      <td>1.806938</td>\n",
       "      <td>0.072452</td>\n",
       "      <td>5.552348</td>\n",
       "      <td>0.686362</td>\n",
       "      <td>0.413894</td>\n",
       "      <td>1.804148</td>\n",
       "      <td>0.497900</td>\n",
       "      <td>17.117647</td>\n",
       "      <td>0.637942</td>\n",
       "      <td>0.022469</td>\n",
       "      <td>0.151618</td>\n",
       "      <td>3.205080</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1919000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4245000.0</td>\n",
       "      <td>4082000.0</td>\n",
       "      <td>163000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>25000.0</td>\n",
       "      <td>1919000.0</td>\n",
       "      <td>2219000.0</td>\n",
       "      <td>3652000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3652000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>185</td>\n",
       "      <td>139</td>\n",
       "      <td>8</td>\n",
       "      <td>8</td>\n",
       "      <td>8</td>\n",
       "      <td>2</td>\n",
       "      <td>300000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.005086</td>\n",
       "      <td>29568000.0</td>\n",
       "      <td>0.922587</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.059877</td>\n",
       "      <td>0.077413</td>\n",
       "      <td>0.922587</td>\n",
       "      <td>0.864804</td>\n",
       "      <td>0.326861</td>\n",
       "      <td>1.644304</td>\n",
       "      <td>0.622041</td>\n",
       "      <td>0.135975</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>1.645786</td>\n",
       "      <td>1.162377</td>\n",
       "      <td>0.006846</td>\n",
       "      <td>0.032022</td>\n",
       "      <td>5.458866</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>711000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>8950000.0</td>\n",
       "      <td>8606000.0</td>\n",
       "      <td>344000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>492000.0</td>\n",
       "      <td>711000.0</td>\n",
       "      <td>12439000.0</td>\n",
       "      <td>1279000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1279000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>220</td>\n",
       "      <td>138</td>\n",
       "      <td>27</td>\n",
       "      <td>27</td>\n",
       "      <td>27</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.020902</td>\n",
       "      <td>14935000.0</td>\n",
       "      <td>0.907461</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.043201</td>\n",
       "      <td>0.092539</td>\n",
       "      <td>0.907461</td>\n",
       "      <td>0.057159</td>\n",
       "      <td>0.051830</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.430745</td>\n",
       "      <td>1.529904</td>\n",
       "      <td>0.268960</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.060942</td>\n",
       "      <td>1.199738</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>2135000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>24680000.0</td>\n",
       "      <td>8263000.0</td>\n",
       "      <td>16417000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>106000.0</td>\n",
       "      <td>2135000.0</td>\n",
       "      <td>11267000.0</td>\n",
       "      <td>11912000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13000.0</td>\n",
       "      <td>11899000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>170</td>\n",
       "      <td>132</td>\n",
       "      <td>15</td>\n",
       "      <td>15</td>\n",
       "      <td>15</td>\n",
       "      <td>0</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.130884</td>\n",
       "      <td>122655000.0</td>\n",
       "      <td>0.977861</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.017021</td>\n",
       "      <td>0.022139</td>\n",
       "      <td>0.977861</td>\n",
       "      <td>0.189491</td>\n",
       "      <td>0.092109</td>\n",
       "      <td>0.004790</td>\n",
       "      <td>0.000561</td>\n",
       "      <td>0.213338</td>\n",
       "      <td>0.720148</td>\n",
       "      <td>1.379696</td>\n",
       "      <td>0.001154</td>\n",
       "      <td>1898.461538</td>\n",
       "      <td>8.153846</td>\n",
       "      <td>0.712844</td>\n",
       "      <td>5.411450</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>104000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>38004000.0</td>\n",
       "      <td>23189000.0</td>\n",
       "      <td>14815000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>449000.0</td>\n",
       "      <td>104000.0</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>38443000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4986000.0</td>\n",
       "      <td>33457000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>29</td>\n",
       "      <td>29</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.248699</td>\n",
       "      <td>59331000.0</td>\n",
       "      <td>0.995988</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.001746</td>\n",
       "      <td>0.004012</td>\n",
       "      <td>0.995988</td>\n",
       "      <td>10.400000</td>\n",
       "      <td>0.002705</td>\n",
       "      <td>35.112676</td>\n",
       "      <td>0.129665</td>\n",
       "      <td>0.267606</td>\n",
       "      <td>2.191889</td>\n",
       "      <td>0.442807</td>\n",
       "      <td>498.600000</td>\n",
       "      <td>7.622142</td>\n",
       "      <td>0.090052</td>\n",
       "      <td>0.396952</td>\n",
       "      <td>1.549164</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>21608000.0</td>\n",
       "      <td>2094000.0</td>\n",
       "      <td>106180000.0</td>\n",
       "      <td>1180000.0</td>\n",
       "      <td>105000000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>557000.0</td>\n",
       "      <td>21608000.0</td>\n",
       "      <td>90313000.0</td>\n",
       "      <td>18518000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>7500000.0</td>\n",
       "      <td>11018000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>102</td>\n",
       "      <td>102</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>300000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.582929</td>\n",
       "      <td>142075000.0</td>\n",
       "      <td>0.788758</td>\n",
       "      <td>0.103724</td>\n",
       "      <td>0.119961</td>\n",
       "      <td>0.211242</td>\n",
       "      <td>0.788758</td>\n",
       "      <td>0.239257</td>\n",
       "      <td>0.198546</td>\n",
       "      <td>0.347094</td>\n",
       "      <td>0.068914</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.104380</td>\n",
       "      <td>9.529860</td>\n",
       "      <td>0.083045</td>\n",
       "      <td>14.157333</td>\n",
       "      <td>0.074267</td>\n",
       "      <td>0.969917</td>\n",
       "      <td>1.655089</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>71000.0</td>\n",
       "      <td>1269000.0</td>\n",
       "      <td>35349000.0</td>\n",
       "      <td>28034000.0</td>\n",
       "      <td>7237000.0</td>\n",
       "      <td>78000.0</td>\n",
       "      <td>2008000.0</td>\n",
       "      <td>71000.0</td>\n",
       "      <td>94000.0</td>\n",
       "      <td>38532000.0</td>\n",
       "      <td>2866000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>35666000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>24</td>\n",
       "      <td>24</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>2</td>\n",
       "      <td>21000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.204580</td>\n",
       "      <td>4710000.0</td>\n",
       "      <td>0.133145</td>\n",
       "      <td>0.830635</td>\n",
       "      <td>0.002007</td>\n",
       "      <td>0.866855</td>\n",
       "      <td>0.133145</td>\n",
       "      <td>0.755319</td>\n",
       "      <td>0.001838</td>\n",
       "      <td>32.202247</td>\n",
       "      <td>0.074199</td>\n",
       "      <td>0.202247</td>\n",
       "      <td>3.857869</td>\n",
       "      <td>0.202910</td>\n",
       "      <td>30.489362</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.239347</td>\n",
       "      <td>0.915834</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>855000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>11564000.0</td>\n",
       "      <td>8770000.0</td>\n",
       "      <td>2794000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>606000.0</td>\n",
       "      <td>855000.0</td>\n",
       "      <td>865000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>20</td>\n",
       "      <td>20</td>\n",
       "      <td>16</td>\n",
       "      <td>16</td>\n",
       "      <td>16</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.120733</td>\n",
       "      <td>22064000.0</td>\n",
       "      <td>0.953418</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.036946</td>\n",
       "      <td>0.046582</td>\n",
       "      <td>0.953418</td>\n",
       "      <td>0.988439</td>\n",
       "      <td>0.988439</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.200187</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>3.930636</td>\n",
       "      <td>26.753757</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>157000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3879000.0</td>\n",
       "      <td>1643000.0</td>\n",
       "      <td>2236000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>213000.0</td>\n",
       "      <td>157000.0</td>\n",
       "      <td>219000.0</td>\n",
       "      <td>3873000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2387000.0</td>\n",
       "      <td>1486000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>48</td>\n",
       "      <td>48</td>\n",
       "      <td>16</td>\n",
       "      <td>16</td>\n",
       "      <td>16</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.138469</td>\n",
       "      <td>15893000.0</td>\n",
       "      <td>0.984209</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.009723</td>\n",
       "      <td>0.015791</td>\n",
       "      <td>0.984209</td>\n",
       "      <td>0.716895</td>\n",
       "      <td>0.038368</td>\n",
       "      <td>12.116751</td>\n",
       "      <td>0.583333</td>\n",
       "      <td>0.203046</td>\n",
       "      <td>0.606778</td>\n",
       "      <td>1.504711</td>\n",
       "      <td>10.899543</td>\n",
       "      <td>1.625052</td>\n",
       "      <td>0.089233</td>\n",
       "      <td>0.598485</td>\n",
       "      <td>3.946237</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>0.0</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>150000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>150000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>150000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>20</td>\n",
       "      <td>20</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>146000.0</td>\n",
       "      <td>0.169767</td>\n",
       "      <td>0.182482</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.830233</td>\n",
       "      <td>0.169767</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.937500</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>15.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.937500</td>\n",
       "      <td>5.375000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>6677000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>19951000.0</td>\n",
       "      <td>478000.0</td>\n",
       "      <td>19473000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>6677000.0</td>\n",
       "      <td>19393000.0</td>\n",
       "      <td>3283000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3283000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>110</td>\n",
       "      <td>110</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1003750.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.167106</td>\n",
       "      <td>109854000.0</td>\n",
       "      <td>0.942702</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.057298</td>\n",
       "      <td>0.057298</td>\n",
       "      <td>0.942702</td>\n",
       "      <td>0.344299</td>\n",
       "      <td>0.294452</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.168506</td>\n",
       "      <td>5.931465</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.859190</td>\n",
       "      <td>5.138957</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>3809000.0</td>\n",
       "      <td>15190000.0</td>\n",
       "      <td>42655000.0</td>\n",
       "      <td>27666000.0</td>\n",
       "      <td>7020000.0</td>\n",
       "      <td>7969000.0</td>\n",
       "      <td>1410000.0</td>\n",
       "      <td>3809000.0</td>\n",
       "      <td>3764000.0</td>\n",
       "      <td>55491000.0</td>\n",
       "      <td>33928000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>21563000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>73</td>\n",
       "      <td>73</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>2</td>\n",
       "      <td>2100000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.145861</td>\n",
       "      <td>43561000.0</td>\n",
       "      <td>0.905107</td>\n",
       "      <td>0.004889</td>\n",
       "      <td>0.079143</td>\n",
       "      <td>0.094893</td>\n",
       "      <td>0.905107</td>\n",
       "      <td>1.011955</td>\n",
       "      <td>0.064281</td>\n",
       "      <td>7.769178</td>\n",
       "      <td>0.572576</td>\n",
       "      <td>0.127777</td>\n",
       "      <td>2.557888</td>\n",
       "      <td>0.325558</td>\n",
       "      <td>9.013815</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.142266</td>\n",
       "      <td>0.812218</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>24000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>266000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>266000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>24000.0</td>\n",
       "      <td>34000.0</td>\n",
       "      <td>232000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>232000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>32</td>\n",
       "      <td>32</td>\n",
       "      <td>27</td>\n",
       "      <td>27</td>\n",
       "      <td>27</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.057155</td>\n",
       "      <td>4619000.0</td>\n",
       "      <td>0.992480</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.005157</td>\n",
       "      <td>0.007520</td>\n",
       "      <td>0.992480</td>\n",
       "      <td>0.705882</td>\n",
       "      <td>0.090226</td>\n",
       "      <td>7.733333</td>\n",
       "      <td>0.872180</td>\n",
       "      <td>0.200000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>6.823529</td>\n",
       "      <td>1.146552</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>17.496241</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>168000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4425000.0</td>\n",
       "      <td>1673000.0</td>\n",
       "      <td>2752000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>763000.0</td>\n",
       "      <td>168000.0</td>\n",
       "      <td>112000.0</td>\n",
       "      <td>5076000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4873000.0</td>\n",
       "      <td>203000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>41</td>\n",
       "      <td>41</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.392694</td>\n",
       "      <td>6759000.0</td>\n",
       "      <td>0.964469</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.023973</td>\n",
       "      <td>0.035531</td>\n",
       "      <td>0.964469</td>\n",
       "      <td>1.500000</td>\n",
       "      <td>0.032382</td>\n",
       "      <td>21.466960</td>\n",
       "      <td>0.939283</td>\n",
       "      <td>0.259912</td>\n",
       "      <td>0.057752</td>\n",
       "      <td>13.556650</td>\n",
       "      <td>43.508929</td>\n",
       "      <td>0.908065</td>\n",
       "      <td>0.156577</td>\n",
       "      <td>0.677525</td>\n",
       "      <td>1.350810</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>5000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1347000.0</td>\n",
       "      <td>1322000.0</td>\n",
       "      <td>25000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>106000.0</td>\n",
       "      <td>5000.0</td>\n",
       "      <td>18000.0</td>\n",
       "      <td>1435000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1423000.0</td>\n",
       "      <td>12000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>54</td>\n",
       "      <td>54</td>\n",
       "      <td>12</td>\n",
       "      <td>12</td>\n",
       "      <td>12</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.008550</td>\n",
       "      <td>2794000.0</td>\n",
       "      <td>0.955540</td>\n",
       "      <td>0.025462</td>\n",
       "      <td>0.001710</td>\n",
       "      <td>0.044460</td>\n",
       "      <td>0.955540</td>\n",
       "      <td>0.277778</td>\n",
       "      <td>0.003441</td>\n",
       "      <td>284.600000</td>\n",
       "      <td>0.979353</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.091603</td>\n",
       "      <td>2.083333</td>\n",
       "      <td>79.055556</td>\n",
       "      <td>0.946592</td>\n",
       "      <td>0.074491</td>\n",
       "      <td>0.090158</td>\n",
       "      <td>2.012388</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>1683000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>21561000.0</td>\n",
       "      <td>3252000.0</td>\n",
       "      <td>18309000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>15000.0</td>\n",
       "      <td>1683000.0</td>\n",
       "      <td>15061000.0</td>\n",
       "      <td>8199000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2813000.0</td>\n",
       "      <td>5386000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>177</td>\n",
       "      <td>142</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.409094</td>\n",
       "      <td>42665000.0</td>\n",
       "      <td>0.953301</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.037605</td>\n",
       "      <td>0.046699</td>\n",
       "      <td>0.953301</td>\n",
       "      <td>0.111746</td>\n",
       "      <td>0.072356</td>\n",
       "      <td>1.669436</td>\n",
       "      <td>0.120937</td>\n",
       "      <td>0.001187</td>\n",
       "      <td>0.293931</td>\n",
       "      <td>3.399369</td>\n",
       "      <td>0.186774</td>\n",
       "      <td>7.664771</td>\n",
       "      <td>0.005332</td>\n",
       "      <td>0.787790</td>\n",
       "      <td>1.924119</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>9000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1576000.0</td>\n",
       "      <td>1576000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2436000.0</td>\n",
       "      <td>9000.0</td>\n",
       "      <td>11000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>48</td>\n",
       "      <td>48</td>\n",
       "      <td>26</td>\n",
       "      <td>26</td>\n",
       "      <td>26</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>13003000.0</td>\n",
       "      <td>0.996551</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000690</td>\n",
       "      <td>0.003449</td>\n",
       "      <td>0.996551</td>\n",
       "      <td>0.818182</td>\n",
       "      <td>0.818182</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.181818</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>221.454545</td>\n",
       "      <td>1186.181818</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>11082000.0</td>\n",
       "      <td>45407000.0</td>\n",
       "      <td>42342000.0</td>\n",
       "      <td>41791000.0</td>\n",
       "      <td>551000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1358000.0</td>\n",
       "      <td>11082000.0</td>\n",
       "      <td>76274000.0</td>\n",
       "      <td>12833000.0</td>\n",
       "      <td>11985000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>848000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>122</td>\n",
       "      <td>122</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>0</td>\n",
       "      <td>2215329.0</td>\n",
       "      <td>88</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.006382</td>\n",
       "      <td>64235000.0</td>\n",
       "      <td>0.743986</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.128355</td>\n",
       "      <td>0.256014</td>\n",
       "      <td>0.743986</td>\n",
       "      <td>0.145292</td>\n",
       "      <td>0.124367</td>\n",
       "      <td>1.081483</td>\n",
       "      <td>0.134501</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.444212</td>\n",
       "      <td>0.649764</td>\n",
       "      <td>0.157131</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.021424</td>\n",
       "      <td>0.968936</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>794000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4587000.0</td>\n",
       "      <td>4587000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>177000.0</td>\n",
       "      <td>794000.0</td>\n",
       "      <td>2765000.0</td>\n",
       "      <td>2064000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2064000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>72</td>\n",
       "      <td>72</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>300000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>7261000.0</td>\n",
       "      <td>0.939692</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.102757</td>\n",
       "      <td>0.060308</td>\n",
       "      <td>0.939692</td>\n",
       "      <td>0.287161</td>\n",
       "      <td>0.164423</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.034063</td>\n",
       "      <td>11.661017</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>inf</td>\n",
       "      <td>inf</td>\n",
       "      <td>0.036654</td>\n",
       "      <td>1.600124</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>965000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>6440000.0</td>\n",
       "      <td>4556000.0</td>\n",
       "      <td>1884000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>58000.0</td>\n",
       "      <td>965000.0</td>\n",
       "      <td>1224000.0</td>\n",
       "      <td>5274000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1798000.0</td>\n",
       "      <td>3476000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>36</td>\n",
       "      <td>36</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>23</td>\n",
       "      <td>2</td>\n",
       "      <td>10000.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.081280</td>\n",
       "      <td>22064000.0</td>\n",
       "      <td>0.951896</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.041633</td>\n",
       "      <td>0.048104</td>\n",
       "      <td>0.951896</td>\n",
       "      <td>0.788399</td>\n",
       "      <td>0.148507</td>\n",
       "      <td>1.461789</td>\n",
       "      <td>0.276701</td>\n",
       "      <td>0.215447</td>\n",
       "      <td>1.789907</td>\n",
       "      <td>0.542002</td>\n",
       "      <td>1.468954</td>\n",
       "      <td>3.581758</td>\n",
       "      <td>0.032258</td>\n",
       "      <td>0.298861</td>\n",
       "      <td>3.567098</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    ar_net_profit  ab_immobilized_assets  ab_mobile_current_assets  \\\n",
       "0       1198000.0                    0.0                 7240000.0   \n",
       "3       1919000.0                    0.0                 4245000.0   \n",
       "4        711000.0                    0.0                 8950000.0   \n",
       "9       2135000.0                    0.0                24680000.0   \n",
       "10       104000.0                    0.0                38004000.0   \n",
       "11     21608000.0              2094000.0               106180000.0   \n",
       "12        71000.0              1269000.0                35349000.0   \n",
       "14       855000.0                    0.0                11564000.0   \n",
       "15       157000.0                    0.0                 3879000.0   \n",
       "16            0.0                10000.0                       0.0   \n",
       "18      6677000.0                    0.0                19951000.0   \n",
       "19      3809000.0             15190000.0                42655000.0   \n",
       "21        24000.0                    0.0                  266000.0   \n",
       "22       168000.0                    0.0                 4425000.0   \n",
       "24         5000.0                    0.0                 1347000.0   \n",
       "25      1683000.0                    0.0                21561000.0   \n",
       "27         9000.0                    0.0                 1576000.0   \n",
       "28     11082000.0             45407000.0                42342000.0   \n",
       "29       794000.0                    0.0                 4587000.0   \n",
       "30       965000.0                    0.0                 6440000.0   \n",
       "\n",
       "    ab_inventory  ab_accounts_receivable  ab_other_current_assets  \\\n",
       "0      4988000.0               2252000.0                      0.0   \n",
       "3      4082000.0                163000.0                      0.0   \n",
       "4      8606000.0                344000.0                      0.0   \n",
       "9      8263000.0              16417000.0                      0.0   \n",
       "10    23189000.0              14815000.0                      0.0   \n",
       "11     1180000.0             105000000.0                      0.0   \n",
       "12    28034000.0               7237000.0                  78000.0   \n",
       "14     8770000.0               2794000.0                      0.0   \n",
       "15     1643000.0               2236000.0                      0.0   \n",
       "16           0.0                     0.0                      0.0   \n",
       "18      478000.0              19473000.0                      0.0   \n",
       "19    27666000.0               7020000.0                7969000.0   \n",
       "21           0.0                266000.0                      0.0   \n",
       "22     1673000.0               2752000.0                      0.0   \n",
       "24     1322000.0                 25000.0                      0.0   \n",
       "25     3252000.0              18309000.0                      0.0   \n",
       "27     1576000.0                     0.0                      0.0   \n",
       "28    41791000.0                551000.0                      0.0   \n",
       "29     4587000.0                     0.0                      0.0   \n",
       "30     4556000.0               1884000.0                      0.0   \n",
       "\n",
       "    ab_cash_and_securities   ab_losses  ab_own_capital  ab_borrowed_capital  \\\n",
       "0                 255000.0   1198000.0        663000.0           15872000.0   \n",
       "3                  25000.0   1919000.0       2219000.0            3652000.0   \n",
       "4                 492000.0    711000.0      12439000.0            1279000.0   \n",
       "9                 106000.0   2135000.0      11267000.0           11912000.0   \n",
       "10                449000.0    104000.0         10000.0           38443000.0   \n",
       "11                557000.0  21608000.0      90313000.0           18518000.0   \n",
       "12               2008000.0     71000.0         94000.0           38532000.0   \n",
       "14                606000.0    855000.0        865000.0                  0.0   \n",
       "15                213000.0    157000.0        219000.0            3873000.0   \n",
       "16                150000.0         0.0         10000.0             150000.0   \n",
       "18                 10000.0   6677000.0      19393000.0            3283000.0   \n",
       "19               1410000.0   3809000.0       3764000.0           55491000.0   \n",
       "21                     0.0     24000.0         34000.0             232000.0   \n",
       "22                763000.0    168000.0        112000.0            5076000.0   \n",
       "24                106000.0      5000.0         18000.0            1435000.0   \n",
       "25                 15000.0   1683000.0      15061000.0            8199000.0   \n",
       "27               2436000.0      9000.0         11000.0                  0.0   \n",
       "28               1358000.0  11082000.0      76274000.0           12833000.0   \n",
       "29                177000.0    794000.0       2765000.0            2064000.0   \n",
       "30                 58000.0    965000.0       1224000.0            5274000.0   \n",
       "\n",
       "    ab_long_term_liabilities  ab_short_term_borrowing  ab_accounts_payable  \\\n",
       "0                        0.0               11349000.0            4523000.0   \n",
       "3                        0.0                3652000.0                  0.0   \n",
       "4                        0.0                      0.0            1279000.0   \n",
       "9                        0.0                  13000.0           11899000.0   \n",
       "10                       0.0                4986000.0           33457000.0   \n",
       "11                       0.0                7500000.0           11018000.0   \n",
       "12                 2866000.0                      0.0           35666000.0   \n",
       "14                       0.0                      0.0                  0.0   \n",
       "15                       0.0                2387000.0            1486000.0   \n",
       "16                       0.0                 150000.0                  0.0   \n",
       "18                       0.0                      0.0            3283000.0   \n",
       "19                33928000.0                      0.0           21563000.0   \n",
       "21                       0.0                 232000.0                  0.0   \n",
       "22                       0.0                4873000.0             203000.0   \n",
       "24                       0.0                1423000.0              12000.0   \n",
       "25                       0.0                2813000.0            5386000.0   \n",
       "27                       0.0                      0.0                  0.0   \n",
       "28                11985000.0                      0.0             848000.0   \n",
       "29                       0.0                      0.0            2064000.0   \n",
       "30                       0.0                1798000.0            3476000.0   \n",
       "\n",
       "    ab_other_borrowings  bus_age  ogrn_age  adr_actual_age  head_actual_age  \\\n",
       "0                   0.0      198       136               3                3   \n",
       "3                   0.0      185       139               8                8   \n",
       "4                   0.0      220       138              27               27   \n",
       "9                   0.0      170       132              15               15   \n",
       "10                  0.0       29        29               4                4   \n",
       "11                  0.0      102       102               4                4   \n",
       "12                  0.0       24        24               7                7   \n",
       "14                  0.0       20        20              16               16   \n",
       "15                  0.0       48        48              16               16   \n",
       "16                  0.0       20        20               4                4   \n",
       "18                  0.0      110       110               2                2   \n",
       "19                  0.0       73        73              23               23   \n",
       "21                  0.0       32        32              27               27   \n",
       "22                  0.0       41        41               7                7   \n",
       "24                  0.0       54        54              12               12   \n",
       "25                  0.0      177       142               1                1   \n",
       "27                  0.0       48        48              26               26   \n",
       "28                  0.0      122       122              23               23   \n",
       "29                  0.0       72        72               5                5   \n",
       "30                  0.0       36        36              23               23   \n",
       "\n",
       "    cap_actual_age  ul_staff_range  ul_capital_sum  ul_founders_cnt  \\\n",
       "0                3               2         50000.0                2   \n",
       "3                8               2        300000.0                1   \n",
       "4               27               2         10000.0                2   \n",
       "9               15               0         10000.0                2   \n",
       "10               4               2         10000.0                2   \n",
       "11               4               1        300000.0                2   \n",
       "12               7               2         21000.0                1   \n",
       "14              16               2         10000.0                1   \n",
       "15              16               2         10000.0                1   \n",
       "16               4               2         10000.0                1   \n",
       "18               2               2       1003750.0                1   \n",
       "19              23               2       2100000.0                1   \n",
       "21              27               2         10000.0                1   \n",
       "22               7               2         10000.0                2   \n",
       "24              12               2         10000.0                2   \n",
       "25               1               2         10000.0                1   \n",
       "27              26               2         10000.0                5   \n",
       "28              23               0       2215329.0               88   \n",
       "29               5               2        300000.0                1   \n",
       "30              23               2         10000.0                1   \n",
       "\n",
       "    ul_branch_cnt  ul_strategic_flg  default_12m  frac_post_pay         OPEX  \\\n",
       "0               0                 0            0       0.042494   48344000.0   \n",
       "3               0                 0            0       0.005086   29568000.0   \n",
       "4               0                 0            0       0.020902   14935000.0   \n",
       "9               0                 0            0       0.130884  122655000.0   \n",
       "10              0                 0            0       0.248699   59331000.0   \n",
       "11              0                 0            0       0.582929  142075000.0   \n",
       "12              0                 0            0       0.204580    4710000.0   \n",
       "14              0                 0            0       0.120733   22064000.0   \n",
       "15              0                 0            0       0.138469   15893000.0   \n",
       "16              0                 0            0       0.000000     146000.0   \n",
       "18              0                 0            0       0.167106  109854000.0   \n",
       "19              0                 0            0       0.145861   43561000.0   \n",
       "21              0                 0            0       0.057155    4619000.0   \n",
       "22              0                 0            0       0.392694    6759000.0   \n",
       "24              0                 0            0       0.008550    2794000.0   \n",
       "25              0                 0            1       0.409094   42665000.0   \n",
       "27              0                 0            0       0.000000   13003000.0   \n",
       "28              0                 0            0       0.006382   64235000.0   \n",
       "29              0                 0            0       0.000000    7261000.0   \n",
       "30              0                 0            1       0.081280   22064000.0   \n",
       "\n",
       "         OER  frac_comer_exp  Net_margin  gross_profit_margin  OP_Margin  \\\n",
       "0   0.912220        0.000000    0.022605             0.087780   0.912220   \n",
       "3   0.922587        0.000000    0.059877             0.077413   0.922587   \n",
       "4   0.907461        0.000000    0.043201             0.092539   0.907461   \n",
       "9   0.977861        0.000000    0.017021             0.022139   0.977861   \n",
       "10  0.995988        0.000000    0.001746             0.004012   0.995988   \n",
       "11  0.788758        0.103724    0.119961             0.211242   0.788758   \n",
       "12  0.133145        0.830635    0.002007             0.866855   0.133145   \n",
       "14  0.953418        0.000000    0.036946             0.046582   0.953418   \n",
       "15  0.984209        0.000000    0.009723             0.015791   0.984209   \n",
       "16  0.169767        0.182482    0.000000             0.830233   0.169767   \n",
       "18  0.942702        0.000000    0.057298             0.057298   0.942702   \n",
       "19  0.905107        0.004889    0.079143             0.094893   0.905107   \n",
       "21  0.992480        0.000000    0.005157             0.007520   0.992480   \n",
       "22  0.964469        0.000000    0.023973             0.035531   0.964469   \n",
       "24  0.955540        0.025462    0.001710             0.044460   0.955540   \n",
       "25  0.953301        0.000000    0.037605             0.046699   0.953301   \n",
       "27  0.996551        0.000000    0.000690             0.003449   0.996551   \n",
       "28  0.743986        0.000000    0.128355             0.256014   0.743986   \n",
       "29  0.939692        0.000000    0.102757             0.060308   0.939692   \n",
       "30  0.951896        0.000000    0.041633             0.048104   0.951896   \n",
       "\n",
       "          ROE       ROA   Debt/EBIT  Debt_ratio  tax_ratio   time_gap  \\\n",
       "0    1.806938  0.072452    5.552348    0.686362   0.413894   1.804148   \n",
       "3    0.864804  0.326861    1.644304    0.622041   0.135975   0.000000   \n",
       "4    0.057159  0.051830    0.000000    0.000000   0.430745   1.529904   \n",
       "9    0.189491  0.092109    0.004790    0.000561   0.213338   0.720148   \n",
       "10  10.400000  0.002705   35.112676    0.129665   0.267606   2.191889   \n",
       "11   0.239257  0.198546    0.347094    0.068914   0.000000   0.104380   \n",
       "12   0.755319  0.001838   32.202247    0.074199   0.202247   3.857869   \n",
       "14   0.988439  0.988439    0.000000    0.000000   0.200187   0.000000   \n",
       "15   0.716895  0.038368   12.116751    0.583333   0.203046   0.606778   \n",
       "16   0.000000  0.000000         inf    0.937500        NaN   0.000000   \n",
       "18   0.344299  0.294452    0.000000    0.000000   0.000000   0.168506   \n",
       "19   1.011955  0.064281    7.769178    0.572576   0.127777   2.557888   \n",
       "21   0.705882  0.090226    7.733333    0.872180   0.200000   0.000000   \n",
       "22   1.500000  0.032382   21.466960    0.939283   0.259912   0.057752   \n",
       "24   0.277778  0.003441  284.600000    0.979353   0.000000   0.091603   \n",
       "25   0.111746  0.072356    1.669436    0.120937   0.001187   0.293931   \n",
       "27   0.818182  0.818182    0.000000    0.000000   0.181818   0.000000   \n",
       "28   0.145292  0.124367    1.081483    0.134501   0.000000   0.444212   \n",
       "29   0.287161  0.164423    0.000000    0.000000   0.034063  11.661017   \n",
       "30   0.788399  0.148507    1.461789    0.276701   0.215447   1.789907   \n",
       "\n",
       "    borrowing_balance  Debt/Equity  current_ratio  cash_ratio    fast_pay  \\\n",
       "0            0.497900    17.117647       0.637942    0.022469    0.151618   \n",
       "3                 inf     1.645786       1.162377    0.006846    0.032022   \n",
       "4            0.268960     0.000000            inf         inf    0.060942   \n",
       "9            1.379696     0.001154    1898.461538    8.153846    0.712844   \n",
       "10           0.442807   498.600000       7.622142    0.090052    0.396952   \n",
       "11           9.529860     0.083045      14.157333    0.074267    0.969917   \n",
       "12           0.202910    30.489362            inf         inf    0.239347   \n",
       "14                inf     0.000000            inf         inf    3.930636   \n",
       "15           1.504711    10.899543       1.625052    0.089233    0.598485   \n",
       "16                NaN    15.000000       0.000000    1.000000    0.937500   \n",
       "18           5.931465     0.000000            inf         inf    0.859190   \n",
       "19           0.325558     9.013815            inf         inf    0.142266   \n",
       "21                inf     6.823529       1.146552    0.000000    1.000000   \n",
       "22          13.556650    43.508929       0.908065    0.156577    0.677525   \n",
       "24           2.083333    79.055556       0.946592    0.074491    0.090158   \n",
       "25           3.399369     0.186774       7.664771    0.005332    0.787790   \n",
       "27                NaN     0.000000            inf         inf  221.454545   \n",
       "28           0.649764     0.157131            inf         inf    0.021424   \n",
       "29           0.000000     0.000000            inf         inf    0.036654   \n",
       "30           0.542002     1.468954       3.581758    0.032258    0.298861   \n",
       "\n",
       "    tumover_ratio  \n",
       "0        3.205080  \n",
       "3        5.458866  \n",
       "4        1.199738  \n",
       "9        5.411450  \n",
       "10       1.549164  \n",
       "11       1.655089  \n",
       "12       0.915834  \n",
       "14      26.753757  \n",
       "15       3.946237  \n",
       "16       5.375000  \n",
       "18       5.138957  \n",
       "19       0.812218  \n",
       "21      17.496241  \n",
       "22       1.350810  \n",
       "24       2.012388  \n",
       "25       1.924119  \n",
       "27    1186.181818  \n",
       "28       0.968936  \n",
       "29       1.600124  \n",
       "30       3.567098  "
      ]
     },
     "execution_count": 146,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df_part_2_new_features.head(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Заметим, что в некоторых новых признаках присутсвуют знаения inf и nan. Их стоит заменить на 0"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 147,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_df_part_2_new_features = train_df_part_2_new_features.fillna(0)\n",
    "test_df_part_2_new_features = test_df_part_2_new_features.fillna(0)\n",
    "\n",
    "train_df_part_2_new_features = train_df_part_2_new_features.replace(np.inf,0)\n",
    "test_df_part_2_new_features = test_df_part_2_new_features.replace(np.inf,0)\n",
    "train_df_part_2_new_features = train_df_part_2_new_features.replace(-np.inf,0)\n",
    "test_df_part_2_new_features = test_df_part_2_new_features.replace(-np.inf,0)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Отбор признаков на основе IV."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 148,
   "metadata": {},
   "outputs": [],
   "source": [
    "def calc_woe_iv(df, feature, target):\n",
    "    \n",
    "    vals = list(df[feature].unique())\n",
    "    count_all = []\n",
    "    default = []\n",
    "    non_default = []\n",
    "    \n",
    "    for i in vals:\n",
    "        count_all.append(len(df[df[feature] == i]))\n",
    "        default.append(len(df[(df[target] == 1) & (df[feature] == i)]))\n",
    "        non_default.append(len(df[(df[target] == 0) & (df[feature] == i)]))\n",
    "    \n",
    "    data = {'value': vals, 'count_all': count_all, 'default': default, 'non_default': non_default}\n",
    "    df_woe_iv = pd.DataFrame(data)\n",
    "        \n",
    "    df_woe_iv['Distr_non_default'] = df_woe_iv['non_default'] / df_woe_iv['non_default'].sum()\n",
    "    df_woe_iv['Distr_default'] = df_woe_iv['default'] / df_woe_iv['default'].sum()\n",
    "    df_woe_iv['WoE'] = np.log(df_woe_iv['Distr_non_default'] / df_woe_iv['Distr_default'])\n",
    "    df_woe_iv = df_woe_iv.replace({'WoE': {np.inf: 0, -np.inf: 0}})\n",
    "    df_woe_iv['IV'] = (df_woe_iv['Distr_non_default'] - df_woe_iv['Distr_default']) * df_woe_iv['WoE']\n",
    "    iv = df_woe_iv['IV'].sum()\n",
    "    \n",
    "    return df_woe_iv, iv"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 149,
   "metadata": {},
   "outputs": [],
   "source": [
    "# пример использования\n",
    "res_example_woe = calc_woe_iv(train_df_part_2_new_features, 'ul_branch_cnt', 'default_12m')[0]\n",
    "res_example_iv = calc_woe_iv(train_df_part_2_new_features, 'ul_branch_cnt', 'default_12m')[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 150,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>value</th>\n",
       "      <th>count_all</th>\n",
       "      <th>default</th>\n",
       "      <th>non_default</th>\n",
       "      <th>Distr_non_default</th>\n",
       "      <th>Distr_default</th>\n",
       "      <th>WoE</th>\n",
       "      <th>IV</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>16128</td>\n",
       "      <td>771</td>\n",
       "      <td>15357</td>\n",
       "      <td>0.984486</td>\n",
       "      <td>0.993557</td>\n",
       "      <td>-0.009171</td>\n",
       "      <td>0.000083</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>36</td>\n",
       "      <td>0</td>\n",
       "      <td>36</td>\n",
       "      <td>0.002308</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>159</td>\n",
       "      <td>5</td>\n",
       "      <td>154</td>\n",
       "      <td>0.009872</td>\n",
       "      <td>0.006443</td>\n",
       "      <td>0.426705</td>\n",
       "      <td>0.001463</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>9</td>\n",
       "      <td>0.000577</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>11</td>\n",
       "      <td>0.000705</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>3</td>\n",
       "      <td>15</td>\n",
       "      <td>0</td>\n",
       "      <td>15</td>\n",
       "      <td>0.000962</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>10</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0.000128</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "      <td>0.000321</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>6</td>\n",
       "      <td>6</td>\n",
       "      <td>0</td>\n",
       "      <td>6</td>\n",
       "      <td>0.000385</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>20</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0.000128</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>17</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.000064</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>12</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.000064</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    value  count_all  default  non_default  Distr_non_default  Distr_default  \\\n",
       "0       0      16128      771        15357           0.984486       0.993557   \n",
       "1       2         36        0           36           0.002308       0.000000   \n",
       "2       1        159        5          154           0.009872       0.006443   \n",
       "3       5          9        0            9           0.000577       0.000000   \n",
       "4       4         11        0           11           0.000705       0.000000   \n",
       "5       3         15        0           15           0.000962       0.000000   \n",
       "6      10          2        0            2           0.000128       0.000000   \n",
       "7       8          5        0            5           0.000321       0.000000   \n",
       "8       6          6        0            6           0.000385       0.000000   \n",
       "9      20          2        0            2           0.000128       0.000000   \n",
       "10     17          1        0            1           0.000064       0.000000   \n",
       "11     12          1        0            1           0.000064       0.000000   \n",
       "\n",
       "         WoE        IV  \n",
       "0  -0.009171  0.000083  \n",
       "1   0.000000  0.000000  \n",
       "2   0.426705  0.001463  \n",
       "3   0.000000  0.000000  \n",
       "4   0.000000  0.000000  \n",
       "5   0.000000  0.000000  \n",
       "6   0.000000  0.000000  \n",
       "7   0.000000  0.000000  \n",
       "8   0.000000  0.000000  \n",
       "9   0.000000  0.000000  \n",
       "10  0.000000  0.000000  \n",
       "11  0.000000  0.000000  "
      ]
     },
     "execution_count": 150,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "res_example_woe"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 151,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "IV for the feature ul_branch_cnt: 0.0015464149234264888\n"
     ]
    }
   ],
   "source": [
    "print('IV for the feature ul_branch_cnt: {}'.format(res_example_iv))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 152,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ar_net_profit\n",
      "ab_immobilized_assets\n",
      "ab_mobile_current_assets\n",
      "ab_inventory\n",
      "ab_accounts_receivable\n",
      "ab_other_current_assets\n",
      "ab_cash_and_securities\n",
      "ab_losses\n",
      "ab_own_capital\n",
      "ab_borrowed_capital\n",
      "ab_long_term_liabilities\n",
      "ab_short_term_borrowing\n",
      "ab_accounts_payable\n",
      "ab_other_borrowings\n",
      "bus_age\n",
      "ogrn_age\n",
      "adr_actual_age\n",
      "head_actual_age\n",
      "cap_actual_age\n",
      "ul_staff_range\n",
      "ul_capital_sum\n",
      "ul_founders_cnt\n",
      "ul_branch_cnt\n",
      "ul_strategic_flg\n",
      "default_12m\n",
      "frac_post_pay\n",
      "OPEX\n",
      "OER\n",
      "frac_comer_exp\n",
      "Net_margin\n",
      "gross_profit_margin\n",
      "OP_Margin\n",
      "ROE\n",
      "ROA\n",
      "Debt/EBIT\n",
      "Debt_ratio\n",
      "tax_ratio\n",
      "time_gap\n",
      "borrowing_balance\n",
      "Debt/Equity\n",
      "current_ratio\n",
      "cash_ratio\n",
      "fast_pay\n",
      "tumover_ratio\n"
     ]
    }
   ],
   "source": [
    "number_bins = range(1, 20)\n",
    "ivvv = []\n",
    "\n",
    "for feature in train_df_part_2_new_features.columns:\n",
    "    print(feature)\n",
    "    if feature == 'default_12m':\n",
    "        continue\n",
    "    name = 'cut_' + str(feature)\n",
    "    for i in number_bins:\n",
    "        train_df_part_2_new_features[name] = pd.cut(train_df_part_2_new_features[feature], i)\n",
    "        ivvv.append(calc_woe_iv(train_df_part_2_new_features, name, 'default_12m')[1])\n",
    "\n",
    "    bin_iv = {}\n",
    "    for A, B in zip(number_bins, ivvv):\n",
    "        bin_iv[A] = B\n",
    "    cut_bin = max(bin_iv, key=bin_iv.get)\n",
    "\n",
    "    train_df_part_2_new_features[name] = pd.cut(train_df_part_2_new_features[feature], cut_bin)\n",
    "    del train_df_part_2_new_features[feature]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 155,
   "metadata": {},
   "outputs": [],
   "source": [
    "def calc_iv_features(df, target):\n",
    "    ivs = []\n",
    "    feature_names = df.columns\n",
    "    for i in feature_names:\n",
    "        df_woe_iv = calc_woe_iv(df, i, target)[0]\n",
    "        ivs.append(df_woe_iv['IV'].sum())\n",
    "    \n",
    "    data = {'feature_name': feature_names, 'iv': ivs}\n",
    "    df_iv = pd.DataFrame(data)\n",
    "    return df_iv"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 157,
   "metadata": {},
   "outputs": [],
   "source": [
    "res_feature_iv = calc_iv_features(train_df_part_2_new_features, 'default_12m')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 161,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>feature_name</th>\n",
       "      <th>iv</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>cut_ab_losses</td>\n",
       "      <td>0.105468</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>cut_ab_own_capital</td>\n",
       "      <td>0.244801</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>cut_bus_age</td>\n",
       "      <td>0.211274</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>cut_ogrn_age</td>\n",
       "      <td>0.199035</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>cut_OPEX</td>\n",
       "      <td>0.122123</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "          feature_name        iv\n",
       "8        cut_ab_losses  0.105468\n",
       "9   cut_ab_own_capital  0.244801\n",
       "15         cut_bus_age  0.211274\n",
       "16        cut_ogrn_age  0.199035\n",
       "26            cut_OPEX  0.122123"
      ]
     },
     "execution_count": 161,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "res_feature_iv[res_feature_iv['iv'] > 0.1]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Обычно удаляют признаки, чье IV < 0.1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 165,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_df_part_2_new_features_iv = train_df_part_2_new_features[np.array(res_feature_iv[res_feature_iv['iv'] > 0.1]['feature_name'])]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 166,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>cut_ab_losses</th>\n",
       "      <th>cut_ab_own_capital</th>\n",
       "      <th>cut_bus_age</th>\n",
       "      <th>cut_ogrn_age</th>\n",
       "      <th>cut_OPEX</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(188.263, 224.316]</td>\n",
       "      <td>(133.526, 141.263]</td>\n",
       "      <td>(27362421.053, 94192473.684]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(152.211, 188.263]</td>\n",
       "      <td>(133.526, 141.263]</td>\n",
       "      <td>(27362421.053, 94192473.684]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(188.263, 224.316]</td>\n",
       "      <td>(133.526, 141.263]</td>\n",
       "      <td>(-39467631.579, 27362421.053]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(152.211, 188.263]</td>\n",
       "      <td>(125.789, 133.526]</td>\n",
       "      <td>(94192473.684, 161022526.316]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(7.315, 44.053]</td>\n",
       "      <td>(25.211, 32.947]</td>\n",
       "      <td>(27362421.053, 94192473.684]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32388</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(80.105, 116.158]</td>\n",
       "      <td>(79.368, 87.105]</td>\n",
       "      <td>(27362421.053, 94192473.684]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32390</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(44.053, 80.105]</td>\n",
       "      <td>(63.895, 71.632]</td>\n",
       "      <td>(27362421.053, 94192473.684]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32391</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(152.211, 188.263]</td>\n",
       "      <td>(133.526, 141.263]</td>\n",
       "      <td>(-39467631.579, 27362421.053]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32393</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(44.053, 80.105]</td>\n",
       "      <td>(63.895, 71.632]</td>\n",
       "      <td>(94192473.684, 161022526.316]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32394</th>\n",
       "      <td>(-1252947.368, 14263736.842]</td>\n",
       "      <td>(-76824889.0, 20510473.684]</td>\n",
       "      <td>(116.158, 152.211]</td>\n",
       "      <td>(133.526, 141.263]</td>\n",
       "      <td>(27362421.053, 94192473.684]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>16375 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                      cut_ab_losses           cut_ab_own_capital  \\\n",
       "0      (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "3      (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "4      (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "9      (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "10     (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "...                             ...                          ...   \n",
       "32388  (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "32390  (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "32391  (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "32393  (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "32394  (-1252947.368, 14263736.842]  (-76824889.0, 20510473.684]   \n",
       "\n",
       "              cut_bus_age        cut_ogrn_age                       cut_OPEX  \n",
       "0      (188.263, 224.316]  (133.526, 141.263]   (27362421.053, 94192473.684]  \n",
       "3      (152.211, 188.263]  (133.526, 141.263]   (27362421.053, 94192473.684]  \n",
       "4      (188.263, 224.316]  (133.526, 141.263]  (-39467631.579, 27362421.053]  \n",
       "9      (152.211, 188.263]  (125.789, 133.526]  (94192473.684, 161022526.316]  \n",
       "10        (7.315, 44.053]    (25.211, 32.947]   (27362421.053, 94192473.684]  \n",
       "...                   ...                 ...                            ...  \n",
       "32388   (80.105, 116.158]    (79.368, 87.105]   (27362421.053, 94192473.684]  \n",
       "32390    (44.053, 80.105]    (63.895, 71.632]   (27362421.053, 94192473.684]  \n",
       "32391  (152.211, 188.263]  (133.526, 141.263]  (-39467631.579, 27362421.053]  \n",
       "32393    (44.053, 80.105]    (63.895, 71.632]  (94192473.684, 161022526.316]  \n",
       "32394  (116.158, 152.211]  (133.526, 141.263]   (27362421.053, 94192473.684]  \n",
       "\n",
       "[16375 rows x 5 columns]"
      ]
     },
     "execution_count": 166,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_df_part_2_new_features_iv"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [],
   "source": [
    "def filter_function(X_train,y_train,column_target):\n",
    "    \"\"\"\n",
    "    Функция вычисления t статистики\n",
    "    \"\"\"\n",
    "    grouped = X_train.merge(y_train,left_index=True,right_index=True).groupby(column_target)\n",
    "    mean_neg = grouped.mean().iloc[0]\n",
    "    mean_pos = grouped.mean().iloc[1]\n",
    "    std_neg = grouped.std().iloc[0]\n",
    "    std_pos = grouped.std().iloc[1]\n",
    "    count_neg = grouped.count().iloc[0]\n",
    "    count_pos = grouped.count().iloc[1]\n",
    "    t = np.abs(mean_pos - mean_neg)/np.sqrt((count_pos*std_pos**2 + count_neg*std_neg**2)/(count_pos+count_neg))\n",
    "    return t"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train_part_2 = train_df_part_2_new_features.drop('default_12m',axis = 1) \n",
    "y_train_part_2 = train_df_part_2_new_features['default_12m']\n",
    "\n",
    "X_train_part_1 = train_df_part_1.drop('default_12m',axis = 1) \n",
    "y_train_part_1 = train_df_part_1['default_12m']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [],
   "source": [
    "top_features_part_2 =pd.DataFrame(data = filter_function(X_train_part_2,y_train_part_2,'default_12m').to_dict().items())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [],
   "source": [
    "top_features_part_2 = top_features_part_2.sort_values(by = 1, ascending=False).reset_index(drop = True)[:25][0].tolist()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [],
   "source": [
    "top_features_part_1 =pd.DataFrame(data = filter_function(X_train_part_1,y_train_part_1,'default_12m').to_dict().items())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "top_features_part_1 = top_features_part_1.sort_values(by = 1, ascending=False).reset_index(drop = True)[:7][0].tolist()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "steps = [('smote',SMOTE(random_state=42)),('stand',StandardScaler()), ('model', LogisticRegression(max_iter=1000))]\n",
    "LGREG = Pipeline(steps=steps)\n",
    "\n",
    "# Зададим диапазон перебора параметра\n",
    "parametrs_Logreg = {'model__C':np.logspace(0,-5,20),'smote__k_neighbors':range(2,12)}\n",
    "# parametrs_Logreg = {'model__C':[0.0006951927961775605],'smote__k_neighbors':[9]}\n",
    "# Инициализируем кросс-валидационный перебор параметра\n",
    "grid_Logreg_part_2 = GridSearchCV(LGREG,parametrs_Logreg,scoring='accuracy')\n",
    "# Обучим модель\n",
    "grid_Logreg_part_2.fit(X_train_part_2.loc[:,top_features_part_2],y_train_part_2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.5852213740458015"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "grid_Logreg_part_2.best_score_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'model__C': 0.000379269019073225, 'smote__k_neighbors': 10}"
      ]
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "grid_Logreg_part_2.best_params_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0    0.952611\n",
       "1    0.047389\n",
       "Name: default_12m, dtype: float64"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y_train_part_2.value_counts(normalize=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "GridSearchCV(estimator=Pipeline(steps=[('smote', SMOTE(random_state=42)),\n",
       "                                       ('stand', StandardScaler()),\n",
       "                                       ('model',\n",
       "                                        LogisticRegression(max_iter=1000))]),\n",
       "             param_grid={'model__C': array([1.00000000e+00, 5.45559478e-01, 2.97635144e-01, 1.62377674e-01,\n",
       "       8.85866790e-02, 4.83293024e-02, 2.63665090e-02, 1.43844989e-02,\n",
       "       7.84759970e-03, 4.28133240e-03, 2.33572147e-03, 1.27427499e-03,\n",
       "       6.95192796e-04, 3.79269019e-04, 2.06913808e-04, 1.12883789e-04,\n",
       "       6.15848211e-05, 3.35981829e-05, 1.83298071e-05, 1.00000000e-05]),\n",
       "                         'smote__k_neighbors': range(2, 12)},\n",
       "             scoring='accuracy')"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "steps = [('smote',SMOTE(random_state=42)),('stand',StandardScaler()), ('model', LogisticRegression(max_iter=1000))]\n",
    "LGREG = Pipeline(steps=steps)\n",
    "\n",
    "# Зададим диапазон перебора параметра\n",
    "parametrs_Logreg = {'model__C':np.logspace(0,-5,20),'smote__k_neighbors':range(2,12)}\n",
    "# Инициализируем кросс-валидационный перебор параметра\n",
    "grid_Logreg_part_1 = GridSearchCV(LGREG,parametrs_Logreg,scoring='accuracy')\n",
    "# Обучим модель\n",
    "grid_Logreg_part_1.fit(X_train_part_1.loc[:,top_features_part_1],y_train_part_1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.6191874694077337"
      ]
     },
     "execution_count": 86,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "grid_Logreg_part_1.best_score_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'model__C': 1.0, 'smote__k_neighbors': 4}"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "grid_Logreg_part_1.best_params_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [],
   "source": [
    "preds_part_2 = grid_Logreg_part_2.predict_proba(test_df_part_2_new_features.loc[:,top_features_part_2])\n",
    "preds_part_1 = grid_Logreg_part_1.predict_proba(test_df_part_1.loc[:,top_features_part_1])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [],
   "source": [
    "answ_part_1 = pd.DataFrame()\n",
    "answ_part_1['id'] = test_records_id_part_1\n",
    "answ_part_1['predict'] = preds_part_1\n",
    "\n",
    "answ_part_2 = pd.DataFrame()\n",
    "answ_part_2['id'] = test_records_id_part_2\n",
    "answ_part_2['predict'] = preds_part_2\n",
    "\n",
    "answ_df = pd.concat([answ_part_2,answ_part_1],sort=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [],
   "source": [
    "answ_df = answ_df.reset_index(drop = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>predict</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>196</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2813</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>4385</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>6479</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>6726</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>21939</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>24652</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>26235</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>29016</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>29405</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>30467</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>30916</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>31624</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>32056</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>34521</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>34777</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>38972</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>40009</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>45876</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>47192</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>50808</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>53466</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>57994</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>64952</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>78043</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>79306</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>83179</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>90162</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>92944</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>95842</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>112392</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>113120</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>113356</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>116627</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>117125</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>119786</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>121485</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>131839</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>134356</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>137362</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>139017</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>144098</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>146497</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>152597</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>153168</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>153685</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>159784</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>169201</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>48</th>\n",
       "      <td>169826</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>49</th>\n",
       "      <td>171255</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50</th>\n",
       "      <td>173652</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>51</th>\n",
       "      <td>174718</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>52</th>\n",
       "      <td>174839</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>53</th>\n",
       "      <td>176718</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>54</th>\n",
       "      <td>180092</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55</th>\n",
       "      <td>182821</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>56</th>\n",
       "      <td>188227</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>57</th>\n",
       "      <td>192212</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>58</th>\n",
       "      <td>200841</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>59</th>\n",
       "      <td>201539</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>60</th>\n",
       "      <td>202533</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>61</th>\n",
       "      <td>204226</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>62</th>\n",
       "      <td>211271</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>63</th>\n",
       "      <td>214703</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>64</th>\n",
       "      <td>218266</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>65</th>\n",
       "      <td>222139</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>66</th>\n",
       "      <td>222630</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>67</th>\n",
       "      <td>225013</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>68</th>\n",
       "      <td>236286</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>69</th>\n",
       "      <td>244252</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>70</th>\n",
       "      <td>247938</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>71</th>\n",
       "      <td>248523</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>72</th>\n",
       "      <td>253723</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>73</th>\n",
       "      <td>255669</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>74</th>\n",
       "      <td>256511</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75</th>\n",
       "      <td>256566</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>76</th>\n",
       "      <td>260063</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>77</th>\n",
       "      <td>260260</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>78</th>\n",
       "      <td>263728</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>79</th>\n",
       "      <td>264010</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>80</th>\n",
       "      <td>265577</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>81</th>\n",
       "      <td>267566</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>82</th>\n",
       "      <td>1196</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>83</th>\n",
       "      <td>9178</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>84</th>\n",
       "      <td>13143</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>85</th>\n",
       "      <td>13547</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>86</th>\n",
       "      <td>18483</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>87</th>\n",
       "      <td>22367</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>88</th>\n",
       "      <td>26923</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>89</th>\n",
       "      <td>27565</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>90</th>\n",
       "      <td>28085</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>91</th>\n",
       "      <td>30403</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>92</th>\n",
       "      <td>30919</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>93</th>\n",
       "      <td>31002</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>94</th>\n",
       "      <td>31266</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>95</th>\n",
       "      <td>31313</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>96</th>\n",
       "      <td>31766</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>97</th>\n",
       "      <td>34295</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>98</th>\n",
       "      <td>40535</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>99</th>\n",
       "      <td>42198</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>100</th>\n",
       "      <td>43460</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>101</th>\n",
       "      <td>47190</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>102</th>\n",
       "      <td>49278</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>103</th>\n",
       "      <td>52800</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>104</th>\n",
       "      <td>54481</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>105</th>\n",
       "      <td>54913</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>106</th>\n",
       "      <td>55905</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>107</th>\n",
       "      <td>62713</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>108</th>\n",
       "      <td>69506</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>109</th>\n",
       "      <td>69617</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>110</th>\n",
       "      <td>70012</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>111</th>\n",
       "      <td>70255</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>112</th>\n",
       "      <td>70259</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>113</th>\n",
       "      <td>76061</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>114</th>\n",
       "      <td>76873</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>115</th>\n",
       "      <td>78731</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>116</th>\n",
       "      <td>80719</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>117</th>\n",
       "      <td>85779</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>118</th>\n",
       "      <td>85906</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>119</th>\n",
       "      <td>89146</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>120</th>\n",
       "      <td>89155</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>121</th>\n",
       "      <td>92204</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>122</th>\n",
       "      <td>92535</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>123</th>\n",
       "      <td>93892</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>124</th>\n",
       "      <td>95482</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>125</th>\n",
       "      <td>95776</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>126</th>\n",
       "      <td>97272</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>127</th>\n",
       "      <td>98373</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>128</th>\n",
       "      <td>98833</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>129</th>\n",
       "      <td>98836</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>130</th>\n",
       "      <td>100485</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>131</th>\n",
       "      <td>105072</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>132</th>\n",
       "      <td>108281</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>133</th>\n",
       "      <td>109220</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>134</th>\n",
       "      <td>109365</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>135</th>\n",
       "      <td>112977</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>136</th>\n",
       "      <td>114972</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>137</th>\n",
       "      <td>117399</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>138</th>\n",
       "      <td>117569</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>139</th>\n",
       "      <td>117987</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>140</th>\n",
       "      <td>125297</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>141</th>\n",
       "      <td>125400</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>142</th>\n",
       "      <td>126723</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>143</th>\n",
       "      <td>126724</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>144</th>\n",
       "      <td>126967</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>145</th>\n",
       "      <td>128204</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>146</th>\n",
       "      <td>135321</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>147</th>\n",
       "      <td>137343</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>148</th>\n",
       "      <td>139743</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>149</th>\n",
       "      <td>152214</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>150</th>\n",
       "      <td>157209</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>151</th>\n",
       "      <td>158854</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>152</th>\n",
       "      <td>161205</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>153</th>\n",
       "      <td>162494</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>154</th>\n",
       "      <td>165048</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>155</th>\n",
       "      <td>165984</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>156</th>\n",
       "      <td>169020</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>157</th>\n",
       "      <td>169817</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>158</th>\n",
       "      <td>170266</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>159</th>\n",
       "      <td>170872</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>160</th>\n",
       "      <td>174577</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>161</th>\n",
       "      <td>177381</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>162</th>\n",
       "      <td>183852</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>163</th>\n",
       "      <td>184827</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>164</th>\n",
       "      <td>184938</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>165</th>\n",
       "      <td>185211</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>166</th>\n",
       "      <td>188270</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>167</th>\n",
       "      <td>190028</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>168</th>\n",
       "      <td>193157</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>169</th>\n",
       "      <td>199885</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>170</th>\n",
       "      <td>202429</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>171</th>\n",
       "      <td>203061</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>172</th>\n",
       "      <td>209914</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>173</th>\n",
       "      <td>210320</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>174</th>\n",
       "      <td>212354</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>175</th>\n",
       "      <td>221272</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>176</th>\n",
       "      <td>221651</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>177</th>\n",
       "      <td>222803</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>178</th>\n",
       "      <td>224226</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>179</th>\n",
       "      <td>226665</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>180</th>\n",
       "      <td>227266</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>181</th>\n",
       "      <td>227799</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>182</th>\n",
       "      <td>233057</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>183</th>\n",
       "      <td>234428</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>184</th>\n",
       "      <td>239686</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>185</th>\n",
       "      <td>240422</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>186</th>\n",
       "      <td>240489</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>187</th>\n",
       "      <td>248391</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>188</th>\n",
       "      <td>251897</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>189</th>\n",
       "      <td>252117</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>190</th>\n",
       "      <td>255780</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>191</th>\n",
       "      <td>255895</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>192</th>\n",
       "      <td>256100</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>259029</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>194</th>\n",
       "      <td>260740</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>195</th>\n",
       "      <td>262317</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>196</th>\n",
       "      <td>264052</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>197</th>\n",
       "      <td>266648</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>266849</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>271584</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         id  predict\n",
       "0       196        1\n",
       "1      2813        1\n",
       "2      4385        1\n",
       "3      6479        1\n",
       "4      6726        1\n",
       "5     21939        1\n",
       "6     24652        1\n",
       "7     26235        1\n",
       "8     29016        1\n",
       "9     29405        1\n",
       "10    30467        1\n",
       "11    30916        1\n",
       "12    31624        1\n",
       "13    32056        1\n",
       "14    34521        1\n",
       "15    34777        1\n",
       "16    38972        1\n",
       "17    40009        1\n",
       "18    45876        1\n",
       "19    47192        1\n",
       "20    50808        1\n",
       "21    53466        1\n",
       "22    57994        1\n",
       "23    64952        1\n",
       "24    78043        1\n",
       "25    79306        1\n",
       "26    83179        1\n",
       "27    90162        1\n",
       "28    92944        1\n",
       "29    95842        1\n",
       "30   112392        1\n",
       "31   113120        1\n",
       "32   113356        1\n",
       "33   116627        1\n",
       "34   117125        0\n",
       "35   119786        1\n",
       "36   121485        1\n",
       "37   131839        1\n",
       "38   134356        1\n",
       "39   137362        1\n",
       "40   139017        0\n",
       "41   144098        1\n",
       "42   146497        1\n",
       "43   152597        1\n",
       "44   153168        1\n",
       "45   153685        1\n",
       "46   159784        1\n",
       "47   169201        1\n",
       "48   169826        1\n",
       "49   171255        1\n",
       "50   173652        1\n",
       "51   174718        0\n",
       "52   174839        1\n",
       "53   176718        1\n",
       "54   180092        0\n",
       "55   182821        1\n",
       "56   188227        1\n",
       "57   192212        1\n",
       "58   200841        1\n",
       "59   201539        1\n",
       "60   202533        1\n",
       "61   204226        0\n",
       "62   211271        1\n",
       "63   214703        1\n",
       "64   218266        1\n",
       "65   222139        1\n",
       "66   222630        1\n",
       "67   225013        1\n",
       "68   236286        1\n",
       "69   244252        1\n",
       "70   247938        0\n",
       "71   248523        1\n",
       "72   253723        1\n",
       "73   255669        1\n",
       "74   256511        1\n",
       "75   256566        1\n",
       "76   260063        1\n",
       "77   260260        1\n",
       "78   263728        1\n",
       "79   264010        1\n",
       "80   265577        1\n",
       "81   267566        0\n",
       "82     1196        1\n",
       "83     9178        1\n",
       "84    13143        1\n",
       "85    13547        1\n",
       "86    18483        1\n",
       "87    22367        0\n",
       "88    26923        1\n",
       "89    27565        1\n",
       "90    28085        1\n",
       "91    30403        1\n",
       "92    30919        1\n",
       "93    31002        0\n",
       "94    31266        1\n",
       "95    31313        1\n",
       "96    31766        1\n",
       "97    34295        1\n",
       "98    40535        1\n",
       "99    42198        1\n",
       "100   43460        1\n",
       "101   47190        1\n",
       "102   49278        1\n",
       "103   52800        0\n",
       "104   54481        0\n",
       "105   54913        0\n",
       "106   55905        0\n",
       "107   62713        1\n",
       "108   69506        1\n",
       "109   69617        1\n",
       "110   70012        1\n",
       "111   70255        1\n",
       "112   70259        1\n",
       "113   76061        1\n",
       "114   76873        1\n",
       "115   78731        1\n",
       "116   80719        1\n",
       "117   85779        1\n",
       "118   85906        1\n",
       "119   89146        0\n",
       "120   89155        1\n",
       "121   92204        1\n",
       "122   92535        1\n",
       "123   93892        1\n",
       "124   95482        1\n",
       "125   95776        1\n",
       "126   97272        1\n",
       "127   98373        1\n",
       "128   98833        0\n",
       "129   98836        1\n",
       "130  100485        1\n",
       "131  105072        1\n",
       "132  108281        1\n",
       "133  109220        1\n",
       "134  109365        1\n",
       "135  112977        1\n",
       "136  114972        1\n",
       "137  117399        1\n",
       "138  117569        1\n",
       "139  117987        1\n",
       "140  125297        1\n",
       "141  125400        1\n",
       "142  126723        1\n",
       "143  126724        1\n",
       "144  126967        1\n",
       "145  128204        1\n",
       "146  135321        1\n",
       "147  137343        1\n",
       "148  139743        1\n",
       "149  152214        1\n",
       "150  157209        0\n",
       "151  158854        1\n",
       "152  161205        1\n",
       "153  162494        1\n",
       "154  165048        1\n",
       "155  165984        1\n",
       "156  169020        1\n",
       "157  169817        1\n",
       "158  170266        1\n",
       "159  170872        1\n",
       "160  174577        1\n",
       "161  177381        1\n",
       "162  183852        1\n",
       "163  184827        1\n",
       "164  184938        1\n",
       "165  185211        1\n",
       "166  188270        1\n",
       "167  190028        1\n",
       "168  193157        0\n",
       "169  199885        1\n",
       "170  202429        0\n",
       "171  203061        1\n",
       "172  209914        1\n",
       "173  210320        1\n",
       "174  212354        1\n",
       "175  221272        0\n",
       "176  221651        1\n",
       "177  222803        1\n",
       "178  224226        1\n",
       "179  226665        1\n",
       "180  227266        1\n",
       "181  227799        0\n",
       "182  233057        1\n",
       "183  234428        1\n",
       "184  239686        1\n",
       "185  240422        1\n",
       "186  240489        1\n",
       "187  248391        1\n",
       "188  251897        1\n",
       "189  252117        1\n",
       "190  255780        1\n",
       "191  255895        1\n",
       "192  256100        1\n",
       "193  259029        1\n",
       "194  260740        1\n",
       "195  262317        1\n",
       "196  264052        1\n",
       "197  266648        0\n",
       "198  266849        1\n",
       "199  271584        0"
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "answ_df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {},
   "outputs": [],
   "source": [
    "answ_df.to_csv('PD-submit_features_low_thr.csv',index=False, sep=';')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "colab": {
   "collapsed_sections": [],
   "name": "PD_jun_ds",
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}