Tuition_and_Fees.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Tuition and Fees from 2010 - 2020"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As shown on http://otcads.umd.edu/bfa/budgetinfo3.htm, there is a historical tuition and fees page (shown here: http://otcads.umd.edu/bfa/FY20%20Working%20Budget/web/TuitHist%202010%20to%202020%20(Excel).htm).  \n",
    "This dataset has tuition rates for all kinds of students from 2010 to 2020. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import requests\n",
    "import pandas as pd\n",
    "from bs4 import BeautifulSoup\n",
    "import pickle"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Scraping"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "url = 'http://otcads.umd.edu/bfa/FY20%20Working%20Budget/web/TuitHist%202010%20to%202020%20(Excel)_files/sheet001.htm'\n",
    "r = requests.get(url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "soup = BeautifulSoup(r.text,'html.parser')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Extracting the only table there is.\n",
    "len(soup.find_all('table'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "table = soup.find('table')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "str_table = []\n",
    "for e in table.find_all('td'):\n",
    "    if(e.text.strip()):\n",
    "        str_table.append(e.text.strip())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In order to find the parts of the text that is necessary to copy into the dataframe, keywords like 'Undergrad Resident' were used to find the starting and ending indexes. The code directly below can be uncommented to show all the indexes of the parsed text."
   ]
  },
  {
   "cell_type": "raw",
   "metadata": {},
   "source": [
    "str_table\n",
    "for i in range(0, len(str_table)):\n",
    "    print(i, \" \", str_table[i])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Parsing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "tuition_fees = pd.DataFrame(columns=['Fee Type (Total for Fall and Spring)', 'Student Type'] + list(map(str, range(2010, 2021))))\n",
    "\n",
    "i = str_table.index('Undergrad Resident')\n",
    "while(i <= str_table.index('Mandatory Fees') - 1):\n",
    "    descr = str_table[i]\n",
    "    skip = 0\n",
    "    if(str_table[i + 12] == '(fee per credit hour)'):\n",
    "        descr = descr + ' (fee per credit hour)'\n",
    "        skip = 1\n",
    "        \n",
    "    years = list(map(str, range(2010, 2021)))\n",
    "    values = str_table[i+1:i+12]\n",
    "    dictionary = dict(zip(years, values))\n",
    "    dictionary['Student Type'] = descr\n",
    "    \n",
    "    dictionary['Fee Type (Total for Fall and Spring)'] = 'Standard Tuition Rates'\n",
    "    \n",
    "    tuition_fees = tuition_fees.append(dictionary, ignore_index=True)\n",
    "    i = i + 12 + skip \n",
    "    \n",
    "i = str_table.index('Undergrad FT')\n",
    "while(i <= len(str_table) - 2):\n",
    "    descr = str_table[i]\n",
    "    \n",
    "    years = list(map(str, range(2010, 2021)))\n",
    "    values = str_table[i+1:i+12]\n",
    "    dictionary = dict(zip(years, values))\n",
    "    dictionary['Student Type'] = descr\n",
    "    \n",
    "    dictionary['Fee Type (Total for Fall and Spring)'] = 'Mandatory Fees'\n",
    "    \n",
    "    tuition_fees = tuition_fees.append(dictionary, ignore_index=True)\n",
    "    i = i + 12"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Finalizing & Fine-tuning"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The data is now being correctly type casted."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "for year in list(range(2010, 2021)):\n",
    "    tuition_fees[str(year)] = tuition_fees[str(year)].apply(lambda x : x.replace(',', ''))\n",
    "    tuition_fees[str(year)] = tuition_fees[str(year)].astype(float)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "tuition_fees['Student Type'] = tuition_fees['Student Type'].apply(lambda x : x\n",
    "                                                                  .replace('FT', 'Full-Time')\n",
    "                                                                  .replace('PT', 'Part-Time')\n",
    "                                                                  .replace('Non-Res', 'Non-Resident'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Fee Type (Total for Fall and Spring)</th>\n",
       "      <th>Student Type</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "      <th>2016</th>\n",
       "      <th>2017</th>\n",
       "      <th>2018</th>\n",
       "      <th>2019</th>\n",
       "      <th>2020</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Undergrad Resident</td>\n",
       "      <td>6566.0</td>\n",
       "      <td>6763.0</td>\n",
       "      <td>6966.0</td>\n",
       "      <td>7175.0</td>\n",
       "      <td>7390.0</td>\n",
       "      <td>7764.0</td>\n",
       "      <td>8152.0</td>\n",
       "      <td>8315.0</td>\n",
       "      <td>8481.0</td>\n",
       "      <td>8651.0</td>\n",
       "      <td>8824.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Undergrad Non-Resident</td>\n",
       "      <td>22503.0</td>\n",
       "      <td>23178.0</td>\n",
       "      <td>24337.0</td>\n",
       "      <td>25554.0</td>\n",
       "      <td>26576.0</td>\n",
       "      <td>27905.0</td>\n",
       "      <td>29300.0</td>\n",
       "      <td>30179.0</td>\n",
       "      <td>31688.0</td>\n",
       "      <td>33272.0</td>\n",
       "      <td>34936.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Undergrad Part-Time Resident (fee per credit h...</td>\n",
       "      <td>273.0</td>\n",
       "      <td>282.0</td>\n",
       "      <td>290.0</td>\n",
       "      <td>299.0</td>\n",
       "      <td>308.0</td>\n",
       "      <td>324.0</td>\n",
       "      <td>340.0</td>\n",
       "      <td>346.0</td>\n",
       "      <td>353.0</td>\n",
       "      <td>360.0</td>\n",
       "      <td>367.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Undergrad Part-Time Non-Resident (fee per cred...</td>\n",
       "      <td>938.0</td>\n",
       "      <td>966.0</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>1065.0</td>\n",
       "      <td>1108.0</td>\n",
       "      <td>1163.0</td>\n",
       "      <td>1221.0</td>\n",
       "      <td>1258.0</td>\n",
       "      <td>1321.0</td>\n",
       "      <td>1387.0</td>\n",
       "      <td>1456.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Graduate Resident (fee per credit hour)</td>\n",
       "      <td>471.0</td>\n",
       "      <td>500.0</td>\n",
       "      <td>525.0</td>\n",
       "      <td>551.0</td>\n",
       "      <td>573.0</td>\n",
       "      <td>602.0</td>\n",
       "      <td>632.0</td>\n",
       "      <td>651.0</td>\n",
       "      <td>683.0</td>\n",
       "      <td>717.0</td>\n",
       "      <td>731.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Graduate Non-Resident (fee per credit hour)</td>\n",
       "      <td>1016.0</td>\n",
       "      <td>1077.0</td>\n",
       "      <td>1131.0</td>\n",
       "      <td>1188.0</td>\n",
       "      <td>1236.0</td>\n",
       "      <td>1298.0</td>\n",
       "      <td>1363.0</td>\n",
       "      <td>1404.0</td>\n",
       "      <td>1474.0</td>\n",
       "      <td>1548.0</td>\n",
       "      <td>1625.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "      <td>Undergrad Full-Time</td>\n",
       "      <td>1487.0</td>\n",
       "      <td>1653.0</td>\n",
       "      <td>1689.0</td>\n",
       "      <td>1733.0</td>\n",
       "      <td>1771.0</td>\n",
       "      <td>1815.0</td>\n",
       "      <td>1844.0</td>\n",
       "      <td>1866.0</td>\n",
       "      <td>1918.0</td>\n",
       "      <td>1944.0</td>\n",
       "      <td>1955.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>7</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "      <td>Undergrad Part-Time</td>\n",
       "      <td>678.0</td>\n",
       "      <td>761.0</td>\n",
       "      <td>779.0</td>\n",
       "      <td>799.0</td>\n",
       "      <td>818.0</td>\n",
       "      <td>840.0</td>\n",
       "      <td>855.0</td>\n",
       "      <td>866.0</td>\n",
       "      <td>893.0</td>\n",
       "      <td>906.0</td>\n",
       "      <td>910.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>8</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "      <td>Graduate Full-Time</td>\n",
       "      <td>1188.0</td>\n",
       "      <td>1351.0</td>\n",
       "      <td>1383.0</td>\n",
       "      <td>1413.0</td>\n",
       "      <td>1446.0</td>\n",
       "      <td>1490.0</td>\n",
       "      <td>1521.0</td>\n",
       "      <td>1538.0</td>\n",
       "      <td>1590.0</td>\n",
       "      <td>1620.0</td>\n",
       "      <td>1635.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>9</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "      <td>Graduate Part-Time</td>\n",
       "      <td>675.0</td>\n",
       "      <td>757.0</td>\n",
       "      <td>773.0</td>\n",
       "      <td>788.0</td>\n",
       "      <td>806.0</td>\n",
       "      <td>829.0</td>\n",
       "      <td>846.0</td>\n",
       "      <td>855.0</td>\n",
       "      <td>881.0</td>\n",
       "      <td>898.0</td>\n",
       "      <td>902.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  Fee Type (Total for Fall and Spring)  \\\n",
       "0               Standard Tuition Rates   \n",
       "1               Standard Tuition Rates   \n",
       "2               Standard Tuition Rates   \n",
       "3               Standard Tuition Rates   \n",
       "4               Standard Tuition Rates   \n",
       "5               Standard Tuition Rates   \n",
       "6                       Mandatory Fees   \n",
       "7                       Mandatory Fees   \n",
       "8                       Mandatory Fees   \n",
       "9                       Mandatory Fees   \n",
       "\n",
       "                                        Student Type     2010     2011  \\\n",
       "0                                 Undergrad Resident   6566.0   6763.0   \n",
       "1                             Undergrad Non-Resident  22503.0  23178.0   \n",
       "2  Undergrad Part-Time Resident (fee per credit h...    273.0    282.0   \n",
       "3  Undergrad Part-Time Non-Resident (fee per cred...    938.0    966.0   \n",
       "4            Graduate Resident (fee per credit hour)    471.0    500.0   \n",
       "5        Graduate Non-Resident (fee per credit hour)   1016.0   1077.0   \n",
       "6                                Undergrad Full-Time   1487.0   1653.0   \n",
       "7                                Undergrad Part-Time    678.0    761.0   \n",
       "8                                 Graduate Full-Time   1188.0   1351.0   \n",
       "9                                 Graduate Part-Time    675.0    757.0   \n",
       "\n",
       "      2012     2013     2014     2015     2016     2017     2018     2019  \\\n",
       "0   6966.0   7175.0   7390.0   7764.0   8152.0   8315.0   8481.0   8651.0   \n",
       "1  24337.0  25554.0  26576.0  27905.0  29300.0  30179.0  31688.0  33272.0   \n",
       "2    290.0    299.0    308.0    324.0    340.0    346.0    353.0    360.0   \n",
       "3   1014.0   1065.0   1108.0   1163.0   1221.0   1258.0   1321.0   1387.0   \n",
       "4    525.0    551.0    573.0    602.0    632.0    651.0    683.0    717.0   \n",
       "5   1131.0   1188.0   1236.0   1298.0   1363.0   1404.0   1474.0   1548.0   \n",
       "6   1689.0   1733.0   1771.0   1815.0   1844.0   1866.0   1918.0   1944.0   \n",
       "7    779.0    799.0    818.0    840.0    855.0    866.0    893.0    906.0   \n",
       "8   1383.0   1413.0   1446.0   1490.0   1521.0   1538.0   1590.0   1620.0   \n",
       "9    773.0    788.0    806.0    829.0    846.0    855.0    881.0    898.0   \n",
       "\n",
       "      2020  \n",
       "0   8824.0  \n",
       "1  34936.0  \n",
       "2    367.0  \n",
       "3   1456.0  \n",
       "4    731.0  \n",
       "5   1625.0  \n",
       "6   1955.0  \n",
       "7    910.0  \n",
       "8   1635.0  \n",
       "9    902.0  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tuition_fees"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Transpose\n",
    "\n",
    "The transpose will be taken to make 'Year' into one column to make plots easier. This will also make each column a timeseries, which is much easier to handle."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>Fee Type (Total for Fall and Spring)</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Standard Tuition Rates</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "      <td>Mandatory Fees</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>Student Type</td>\n",
       "      <td>Undergrad Resident</td>\n",
       "      <td>Undergrad Non-Resident</td>\n",
       "      <td>Undergrad Part-Time Resident (fee per credit h...</td>\n",
       "      <td>Undergrad Part-Time Non-Resident (fee per cred...</td>\n",
       "      <td>Graduate Resident (fee per credit hour)</td>\n",
       "      <td>Graduate Non-Resident (fee per credit hour)</td>\n",
       "      <td>Undergrad Full-Time</td>\n",
       "      <td>Undergrad Part-Time</td>\n",
       "      <td>Graduate Full-Time</td>\n",
       "      <td>Graduate Part-Time</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2010</td>\n",
       "      <td>6566</td>\n",
       "      <td>22503</td>\n",
       "      <td>273</td>\n",
       "      <td>938</td>\n",
       "      <td>471</td>\n",
       "      <td>1016</td>\n",
       "      <td>1487</td>\n",
       "      <td>678</td>\n",
       "      <td>1188</td>\n",
       "      <td>675</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2011</td>\n",
       "      <td>6763</td>\n",
       "      <td>23178</td>\n",
       "      <td>282</td>\n",
       "      <td>966</td>\n",
       "      <td>500</td>\n",
       "      <td>1077</td>\n",
       "      <td>1653</td>\n",
       "      <td>761</td>\n",
       "      <td>1351</td>\n",
       "      <td>757</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2012</td>\n",
       "      <td>6966</td>\n",
       "      <td>24337</td>\n",
       "      <td>290</td>\n",
       "      <td>1014</td>\n",
       "      <td>525</td>\n",
       "      <td>1131</td>\n",
       "      <td>1689</td>\n",
       "      <td>779</td>\n",
       "      <td>1383</td>\n",
       "      <td>773</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                           0  \\\n",
       "Fee Type (Total for Fall and Spring)  Standard Tuition Rates   \n",
       "Student Type                              Undergrad Resident   \n",
       "2010                                                    6566   \n",
       "2011                                                    6763   \n",
       "2012                                                    6966   \n",
       "\n",
       "                                                           1  \\\n",
       "Fee Type (Total for Fall and Spring)  Standard Tuition Rates   \n",
       "Student Type                          Undergrad Non-Resident   \n",
       "2010                                                   22503   \n",
       "2011                                                   23178   \n",
       "2012                                                   24337   \n",
       "\n",
       "                                                                                      2  \\\n",
       "Fee Type (Total for Fall and Spring)                             Standard Tuition Rates   \n",
       "Student Type                          Undergrad Part-Time Resident (fee per credit h...   \n",
       "2010                                                                                273   \n",
       "2011                                                                                282   \n",
       "2012                                                                                290   \n",
       "\n",
       "                                                                                      3  \\\n",
       "Fee Type (Total for Fall and Spring)                             Standard Tuition Rates   \n",
       "Student Type                          Undergrad Part-Time Non-Resident (fee per cred...   \n",
       "2010                                                                                938   \n",
       "2011                                                                                966   \n",
       "2012                                                                               1014   \n",
       "\n",
       "                                                                            4  \\\n",
       "Fee Type (Total for Fall and Spring)                   Standard Tuition Rates   \n",
       "Student Type                          Graduate Resident (fee per credit hour)   \n",
       "2010                                                                      471   \n",
       "2011                                                                      500   \n",
       "2012                                                                      525   \n",
       "\n",
       "                                                                                5  \\\n",
       "Fee Type (Total for Fall and Spring)                       Standard Tuition Rates   \n",
       "Student Type                          Graduate Non-Resident (fee per credit hour)   \n",
       "2010                                                                         1016   \n",
       "2011                                                                         1077   \n",
       "2012                                                                         1131   \n",
       "\n",
       "                                                        6  \\\n",
       "Fee Type (Total for Fall and Spring)       Mandatory Fees   \n",
       "Student Type                          Undergrad Full-Time   \n",
       "2010                                                 1487   \n",
       "2011                                                 1653   \n",
       "2012                                                 1689   \n",
       "\n",
       "                                                        7                   8  \\\n",
       "Fee Type (Total for Fall and Spring)       Mandatory Fees      Mandatory Fees   \n",
       "Student Type                          Undergrad Part-Time  Graduate Full-Time   \n",
       "2010                                                  678                1188   \n",
       "2011                                                  761                1351   \n",
       "2012                                                  779                1383   \n",
       "\n",
       "                                                       9  \n",
       "Fee Type (Total for Fall and Spring)      Mandatory Fees  \n",
       "Student Type                          Graduate Part-Time  \n",
       "2010                                                 675  \n",
       "2011                                                 757  \n",
       "2012                                                 773  "
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tuition_fees = tuition_fees.transpose()\n",
    "tuition_fees.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "list1 = list(tuition_fees.iloc[0].values)\n",
    "list2 = list(tuition_fees.iloc[1].values)\n",
    "new_columns = ([str(a) + b for a,b in zip(list(map(lambda x : x + \": \", list1)),list2)])\n",
    "tuition_fees.columns = new_columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "tuition_fees = tuition_fees.drop(['Fee Type (Total for Fall and Spring)', 'Student Type'])\n",
    "tuition_fees = tuition_fees.reset_index()\n",
    "tuition_fees = tuition_fees.rename(columns={'index' : 'Year'})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Year</th>\n",
       "      <th>Standard Tuition Rates: Undergrad Resident</th>\n",
       "      <th>Standard Tuition Rates: Undergrad Non-Resident</th>\n",
       "      <th>Standard Tuition Rates: Undergrad Part-Time Resident (fee per credit hour)</th>\n",
       "      <th>Standard Tuition Rates: Undergrad Part-Time Non-Resident (fee per credit hour)</th>\n",
       "      <th>Standard Tuition Rates: Graduate Resident (fee per credit hour)</th>\n",
       "      <th>Standard Tuition Rates: Graduate Non-Resident (fee per credit hour)</th>\n",
       "      <th>Mandatory Fees: Undergrad Full-Time</th>\n",
       "      <th>Mandatory Fees: Undergrad Part-Time</th>\n",
       "      <th>Mandatory Fees: Graduate Full-Time</th>\n",
       "      <th>Mandatory Fees: Graduate Part-Time</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>2010</td>\n",
       "      <td>6566</td>\n",
       "      <td>22503</td>\n",
       "      <td>273</td>\n",
       "      <td>938</td>\n",
       "      <td>471</td>\n",
       "      <td>1016</td>\n",
       "      <td>1487</td>\n",
       "      <td>678</td>\n",
       "      <td>1188</td>\n",
       "      <td>675</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>2011</td>\n",
       "      <td>6763</td>\n",
       "      <td>23178</td>\n",
       "      <td>282</td>\n",
       "      <td>966</td>\n",
       "      <td>500</td>\n",
       "      <td>1077</td>\n",
       "      <td>1653</td>\n",
       "      <td>761</td>\n",
       "      <td>1351</td>\n",
       "      <td>757</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>2012</td>\n",
       "      <td>6966</td>\n",
       "      <td>24337</td>\n",
       "      <td>290</td>\n",
       "      <td>1014</td>\n",
       "      <td>525</td>\n",
       "      <td>1131</td>\n",
       "      <td>1689</td>\n",
       "      <td>779</td>\n",
       "      <td>1383</td>\n",
       "      <td>773</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>2013</td>\n",
       "      <td>7175</td>\n",
       "      <td>25554</td>\n",
       "      <td>299</td>\n",
       "      <td>1065</td>\n",
       "      <td>551</td>\n",
       "      <td>1188</td>\n",
       "      <td>1733</td>\n",
       "      <td>799</td>\n",
       "      <td>1413</td>\n",
       "      <td>788</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>2014</td>\n",
       "      <td>7390</td>\n",
       "      <td>26576</td>\n",
       "      <td>308</td>\n",
       "      <td>1108</td>\n",
       "      <td>573</td>\n",
       "      <td>1236</td>\n",
       "      <td>1771</td>\n",
       "      <td>818</td>\n",
       "      <td>1446</td>\n",
       "      <td>806</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5</td>\n",
       "      <td>2015</td>\n",
       "      <td>7764</td>\n",
       "      <td>27905</td>\n",
       "      <td>324</td>\n",
       "      <td>1163</td>\n",
       "      <td>602</td>\n",
       "      <td>1298</td>\n",
       "      <td>1815</td>\n",
       "      <td>840</td>\n",
       "      <td>1490</td>\n",
       "      <td>829</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6</td>\n",
       "      <td>2016</td>\n",
       "      <td>8152</td>\n",
       "      <td>29300</td>\n",
       "      <td>340</td>\n",
       "      <td>1221</td>\n",
       "      <td>632</td>\n",
       "      <td>1363</td>\n",
       "      <td>1844</td>\n",
       "      <td>855</td>\n",
       "      <td>1521</td>\n",
       "      <td>846</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>7</td>\n",
       "      <td>2017</td>\n",
       "      <td>8315</td>\n",
       "      <td>30179</td>\n",
       "      <td>346</td>\n",
       "      <td>1258</td>\n",
       "      <td>651</td>\n",
       "      <td>1404</td>\n",
       "      <td>1866</td>\n",
       "      <td>866</td>\n",
       "      <td>1538</td>\n",
       "      <td>855</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>8</td>\n",
       "      <td>2018</td>\n",
       "      <td>8481</td>\n",
       "      <td>31688</td>\n",
       "      <td>353</td>\n",
       "      <td>1321</td>\n",
       "      <td>683</td>\n",
       "      <td>1474</td>\n",
       "      <td>1918</td>\n",
       "      <td>893</td>\n",
       "      <td>1590</td>\n",
       "      <td>881</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>9</td>\n",
       "      <td>2019</td>\n",
       "      <td>8651</td>\n",
       "      <td>33272</td>\n",
       "      <td>360</td>\n",
       "      <td>1387</td>\n",
       "      <td>717</td>\n",
       "      <td>1548</td>\n",
       "      <td>1944</td>\n",
       "      <td>906</td>\n",
       "      <td>1620</td>\n",
       "      <td>898</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>10</td>\n",
       "      <td>2020</td>\n",
       "      <td>8824</td>\n",
       "      <td>34936</td>\n",
       "      <td>367</td>\n",
       "      <td>1456</td>\n",
       "      <td>731</td>\n",
       "      <td>1625</td>\n",
       "      <td>1955</td>\n",
       "      <td>910</td>\n",
       "      <td>1635</td>\n",
       "      <td>902</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    Year Standard Tuition Rates: Undergrad Resident  \\\n",
       "0   2010                                       6566   \n",
       "1   2011                                       6763   \n",
       "2   2012                                       6966   \n",
       "3   2013                                       7175   \n",
       "4   2014                                       7390   \n",
       "5   2015                                       7764   \n",
       "6   2016                                       8152   \n",
       "7   2017                                       8315   \n",
       "8   2018                                       8481   \n",
       "9   2019                                       8651   \n",
       "10  2020                                       8824   \n",
       "\n",
       "   Standard Tuition Rates: Undergrad Non-Resident  \\\n",
       "0                                           22503   \n",
       "1                                           23178   \n",
       "2                                           24337   \n",
       "3                                           25554   \n",
       "4                                           26576   \n",
       "5                                           27905   \n",
       "6                                           29300   \n",
       "7                                           30179   \n",
       "8                                           31688   \n",
       "9                                           33272   \n",
       "10                                          34936   \n",
       "\n",
       "   Standard Tuition Rates: Undergrad Part-Time Resident (fee per credit hour)  \\\n",
       "0                                                 273                           \n",
       "1                                                 282                           \n",
       "2                                                 290                           \n",
       "3                                                 299                           \n",
       "4                                                 308                           \n",
       "5                                                 324                           \n",
       "6                                                 340                           \n",
       "7                                                 346                           \n",
       "8                                                 353                           \n",
       "9                                                 360                           \n",
       "10                                                367                           \n",
       "\n",
       "   Standard Tuition Rates: Undergrad Part-Time Non-Resident (fee per credit hour)  \\\n",
       "0                                                 938                               \n",
       "1                                                 966                               \n",
       "2                                                1014                               \n",
       "3                                                1065                               \n",
       "4                                                1108                               \n",
       "5                                                1163                               \n",
       "6                                                1221                               \n",
       "7                                                1258                               \n",
       "8                                                1321                               \n",
       "9                                                1387                               \n",
       "10                                               1456                               \n",
       "\n",
       "   Standard Tuition Rates: Graduate Resident (fee per credit hour)  \\\n",
       "0                                                 471                \n",
       "1                                                 500                \n",
       "2                                                 525                \n",
       "3                                                 551                \n",
       "4                                                 573                \n",
       "5                                                 602                \n",
       "6                                                 632                \n",
       "7                                                 651                \n",
       "8                                                 683                \n",
       "9                                                 717                \n",
       "10                                                731                \n",
       "\n",
       "   Standard Tuition Rates: Graduate Non-Resident (fee per credit hour)  \\\n",
       "0                                                1016                    \n",
       "1                                                1077                    \n",
       "2                                                1131                    \n",
       "3                                                1188                    \n",
       "4                                                1236                    \n",
       "5                                                1298                    \n",
       "6                                                1363                    \n",
       "7                                                1404                    \n",
       "8                                                1474                    \n",
       "9                                                1548                    \n",
       "10                                               1625                    \n",
       "\n",
       "   Mandatory Fees: Undergrad Full-Time Mandatory Fees: Undergrad Part-Time  \\\n",
       "0                                 1487                                 678   \n",
       "1                                 1653                                 761   \n",
       "2                                 1689                                 779   \n",
       "3                                 1733                                 799   \n",
       "4                                 1771                                 818   \n",
       "5                                 1815                                 840   \n",
       "6                                 1844                                 855   \n",
       "7                                 1866                                 866   \n",
       "8                                 1918                                 893   \n",
       "9                                 1944                                 906   \n",
       "10                                1955                                 910   \n",
       "\n",
       "   Mandatory Fees: Graduate Full-Time Mandatory Fees: Graduate Part-Time  \n",
       "0                                1188                                675  \n",
       "1                                1351                                757  \n",
       "2                                1383                                773  \n",
       "3                                1413                                788  \n",
       "4                                1446                                806  \n",
       "5                                1490                                829  \n",
       "6                                1521                                846  \n",
       "7                                1538                                855  \n",
       "8                                1590                                881  \n",
       "9                                1620                                898  \n",
       "10                               1635                                902  "
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tuition_fees"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "tuition_fees.to_pickle('df/tuition_fees')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}