AI_Class/003/Polynomial_regression.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 다항회귀분석  \n",
    "앞에서 살펴본 단순회귀분석은 두 변수간의 관계를 **직선 형태** 로 설명하는 알고리즘  \n",
    "\n",
    "**다항 함수** 를 사용하면 보다 복잡한 **곡선 형태** 의 회귀선을 표현할 수 있음"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Import library"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "import seaborn as sns\n",
    "\n",
    "from sklearn.model_selection import train_test_split\n",
    "from sklearn.linear_model import LinearRegression      #선형회귀분석\n",
    "from sklearn.preprocessing import PolynomialFeatures   #다항식 변환"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Load data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "df = pd.read_csv('../002/auto-mpg.csv', header=None)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Exploratory Data Analysis"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>18.0</td>\n",
       "      <td>8</td>\n",
       "      <td>307.0</td>\n",
       "      <td>130.0</td>\n",
       "      <td>3504.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>70</td>\n",
       "      <td>1</td>\n",
       "      <td>chevrolet chevelle malibu</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>15.0</td>\n",
       "      <td>8</td>\n",
       "      <td>350.0</td>\n",
       "      <td>165.0</td>\n",
       "      <td>3693.0</td>\n",
       "      <td>11.5</td>\n",
       "      <td>70</td>\n",
       "      <td>1</td>\n",
       "      <td>buick skylark 320</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>18.0</td>\n",
       "      <td>8</td>\n",
       "      <td>318.0</td>\n",
       "      <td>150.0</td>\n",
       "      <td>3436.0</td>\n",
       "      <td>11.0</td>\n",
       "      <td>70</td>\n",
       "      <td>1</td>\n",
       "      <td>plymouth satellite</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>16.0</td>\n",
       "      <td>8</td>\n",
       "      <td>304.0</td>\n",
       "      <td>150.0</td>\n",
       "      <td>3433.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>70</td>\n",
       "      <td>1</td>\n",
       "      <td>amc rebel sst</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>17.0</td>\n",
       "      <td>8</td>\n",
       "      <td>302.0</td>\n",
       "      <td>140.0</td>\n",
       "      <td>3449.0</td>\n",
       "      <td>10.5</td>\n",
       "      <td>70</td>\n",
       "      <td>1</td>\n",
       "      <td>ford torino</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      0  1      2      3       4     5   6  7                          8\n",
       "0  18.0  8  307.0  130.0  3504.0  12.0  70  1  chevrolet chevelle malibu\n",
       "1  15.0  8  350.0  165.0  3693.0  11.5  70  1          buick skylark 320\n",
       "2  18.0  8  318.0  150.0  3436.0  11.0  70  1         plymouth satellite\n",
       "3  16.0  8  304.0  150.0  3433.0  12.0  70  1              amc rebel sst\n",
       "4  17.0  8  302.0  140.0  3449.0  10.5  70  1                ford torino"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "데이터의 컬럼명이 없으므로 수정해줌"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "df.columns = ['mpg','cylinders','displacement','horsepower','weight',\n",
    "              'acceleration','model year','origin','name'] "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 데이터 자료형 확인"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 398 entries, 0 to 397\n",
      "Data columns (total 9 columns):\n",
      " #   Column        Non-Null Count  Dtype  \n",
      "---  ------        --------------  -----  \n",
      " 0   mpg           398 non-null    float64\n",
      " 1   cylinders     398 non-null    int64  \n",
      " 2   displacement  398 non-null    float64\n",
      " 3   horsepower    398 non-null    object \n",
      " 4   weight        398 non-null    float64\n",
      " 5   acceleration  398 non-null    float64\n",
      " 6   model year    398 non-null    int64  \n",
      " 7   origin        398 non-null    int64  \n",
      " 8   name          398 non-null    object \n",
      "dtypes: float64(4), int64(3), object(2)\n",
      "memory usage: 28.1+ KB\n"
     ]
    }
   ],
   "source": [
    "df.info()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 데이터 결측치 확인"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "mpg             0\n",
       "cylinders       0\n",
       "displacement    0\n",
       "horsepower      0\n",
       "weight          0\n",
       "acceleration    0\n",
       "model year      0\n",
       "origin          0\n",
       "name            0\n",
       "dtype: int64"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.isna().sum()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 데이터 통계 요약정보 확인"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>mpg</th>\n",
       "      <th>cylinders</th>\n",
       "      <th>displacement</th>\n",
       "      <th>weight</th>\n",
       "      <th>acceleration</th>\n",
       "      <th>model year</th>\n",
       "      <th>origin</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>398.000000</td>\n",
       "      <td>398.000000</td>\n",
       "      <td>398.000000</td>\n",
       "      <td>398.000000</td>\n",
       "      <td>398.000000</td>\n",
       "      <td>398.000000</td>\n",
       "      <td>398.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>23.514573</td>\n",
       "      <td>5.454774</td>\n",
       "      <td>193.425879</td>\n",
       "      <td>2970.424623</td>\n",
       "      <td>15.568090</td>\n",
       "      <td>76.010050</td>\n",
       "      <td>1.572864</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>7.815984</td>\n",
       "      <td>1.701004</td>\n",
       "      <td>104.269838</td>\n",
       "      <td>846.841774</td>\n",
       "      <td>2.757689</td>\n",
       "      <td>3.697627</td>\n",
       "      <td>0.802055</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>9.000000</td>\n",
       "      <td>3.000000</td>\n",
       "      <td>68.000000</td>\n",
       "      <td>1613.000000</td>\n",
       "      <td>8.000000</td>\n",
       "      <td>70.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>17.500000</td>\n",
       "      <td>4.000000</td>\n",
       "      <td>104.250000</td>\n",
       "      <td>2223.750000</td>\n",
       "      <td>13.825000</td>\n",
       "      <td>73.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>23.000000</td>\n",
       "      <td>4.000000</td>\n",
       "      <td>148.500000</td>\n",
       "      <td>2803.500000</td>\n",
       "      <td>15.500000</td>\n",
       "      <td>76.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>29.000000</td>\n",
       "      <td>8.000000</td>\n",
       "      <td>262.000000</td>\n",
       "      <td>3608.000000</td>\n",
       "      <td>17.175000</td>\n",
       "      <td>79.000000</td>\n",
       "      <td>2.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>46.600000</td>\n",
       "      <td>8.000000</td>\n",
       "      <td>455.000000</td>\n",
       "      <td>5140.000000</td>\n",
       "      <td>24.800000</td>\n",
       "      <td>82.000000</td>\n",
       "      <td>3.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "              mpg   cylinders  displacement       weight  acceleration  \\\n",
       "count  398.000000  398.000000    398.000000   398.000000    398.000000   \n",
       "mean    23.514573    5.454774    193.425879  2970.424623     15.568090   \n",
       "std      7.815984    1.701004    104.269838   846.841774      2.757689   \n",
       "min      9.000000    3.000000     68.000000  1613.000000      8.000000   \n",
       "25%     17.500000    4.000000    104.250000  2223.750000     13.825000   \n",
       "50%     23.000000    4.000000    148.500000  2803.500000     15.500000   \n",
       "75%     29.000000    8.000000    262.000000  3608.000000     17.175000   \n",
       "max     46.600000    8.000000    455.000000  5140.000000     24.800000   \n",
       "\n",
       "       model year      origin  \n",
       "count  398.000000  398.000000  \n",
       "mean    76.010050    1.572864  \n",
       "std      3.697627    0.802055  \n",
       "min     70.000000    1.000000  \n",
       "25%     73.000000    1.000000  \n",
       "50%     76.000000    1.000000  \n",
       "75%     79.000000    2.000000  \n",
       "max     82.000000    3.000000  "
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 컬럼 전체의 고유값 확인"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "mpg\n",
      "[18.  15.  16.  17.  14.  24.  22.  21.  27.  26.  25.  10.  11.   9.\n",
      " 28.  19.  12.  13.  23.  30.  31.  35.  20.  29.  32.  33.  17.5 15.5\n",
      " 14.5 22.5 24.5 18.5 29.5 26.5 16.5 31.5 36.  25.5 33.5 20.5 30.5 21.5\n",
      " 43.1 36.1 32.8 39.4 19.9 19.4 20.2 19.2 25.1 20.6 20.8 18.6 18.1 17.7\n",
      " 27.5 27.2 30.9 21.1 23.2 23.8 23.9 20.3 21.6 16.2 19.8 22.3 17.6 18.2\n",
      " 16.9 31.9 34.1 35.7 27.4 25.4 34.2 34.5 31.8 37.3 28.4 28.8 26.8 41.5\n",
      " 38.1 32.1 37.2 26.4 24.3 19.1 34.3 29.8 31.3 37.  32.2 46.6 27.9 40.8\n",
      " 44.3 43.4 36.4 44.6 40.9 33.8 32.7 23.7 23.6 32.4 26.6 25.8 23.5 39.1\n",
      " 39.  35.1 32.3 37.7 34.7 34.4 29.9 33.7 32.9 31.6 28.1 30.7 24.2 22.4\n",
      " 34.  38.  44. ]\n",
      "\n",
      "cylinders\n",
      "[8 4 6 3 5]\n",
      "\n",
      "displacement\n",
      "[307.  350.  318.  304.  302.  429.  454.  440.  455.  390.  383.  340.\n",
      " 400.  113.  198.  199.  200.   97.  110.  107.  104.  121.  360.  140.\n",
      "  98.  232.  225.  250.  351.  258.  122.  116.   79.   88.   71.   72.\n",
      "  91.   97.5  70.  120.   96.  108.  155.   68.  114.  156.   76.   83.\n",
      "  90.  231.  262.  134.  119.  171.  115.  101.  305.   85.  130.  168.\n",
      " 111.  260.  151.  146.   80.   78.  105.  131.  163.   89.  267.   86.\n",
      " 183.  141.  173.  135.   81.  100.  145.  112.  181.  144. ]\n",
      "\n",
      "horsepower\n",
      "['130.0' '165.0' '150.0' '140.0' '198.0' '220.0' '215.0' '225.0' '190.0'\n",
      " '170.0' '160.0' '95.00' '97.00' '85.00' '88.00' '46.00' '87.00' '90.00'\n",
      " '113.0' '200.0' '210.0' '193.0' '?' '100.0' '105.0' '175.0' '153.0'\n",
      " '180.0' '110.0' '72.00' '86.00' '70.00' '76.00' '65.00' '69.00' '60.00'\n",
      " '80.00' '54.00' '208.0' '155.0' '112.0' '92.00' '145.0' '137.0' '158.0'\n",
      " '167.0' '94.00' '107.0' '230.0' '49.00' '75.00' '91.00' '122.0' '67.00'\n",
      " '83.00' '78.00' '52.00' '61.00' '93.00' '148.0' '129.0' '96.00' '71.00'\n",
      " '98.00' '115.0' '53.00' '81.00' '79.00' '120.0' '152.0' '102.0' '108.0'\n",
      " '68.00' '58.00' '149.0' '89.00' '63.00' '48.00' '66.00' '139.0' '103.0'\n",
      " '125.0' '133.0' '138.0' '135.0' '142.0' '77.00' '62.00' '132.0' '84.00'\n",
      " '64.00' '74.00' '116.0' '82.00']\n",
      "\n",
      "weight\n",
      "[3504. 3693. 3436. 3433. 3449. 4341. 4354. 4312. 4425. 3850. 3563. 3609.\n",
      " 3761. 3086. 2372. 2833. 2774. 2587. 2130. 1835. 2672. 2430. 2375. 2234.\n",
      " 2648. 4615. 4376. 4382. 4732. 2264. 2228. 2046. 2634. 3439. 3329. 3302.\n",
      " 3288. 4209. 4464. 4154. 4096. 4955. 4746. 5140. 2962. 2408. 3282. 3139.\n",
      " 2220. 2123. 2074. 2065. 1773. 1613. 1834. 1955. 2278. 2126. 2254. 2226.\n",
      " 4274. 4385. 4135. 4129. 3672. 4633. 4502. 4456. 4422. 2330. 3892. 4098.\n",
      " 4294. 4077. 2933. 2511. 2979. 2189. 2395. 2288. 2506. 2164. 2100. 4100.\n",
      " 3988. 4042. 3777. 4952. 4363. 4237. 4735. 4951. 3821. 3121. 3278. 2945.\n",
      " 3021. 2904. 1950. 4997. 4906. 4654. 4499. 2789. 2279. 2401. 2379. 2124.\n",
      " 2310. 2472. 2265. 4082. 4278. 1867. 2158. 2582. 2868. 3399. 2660. 2807.\n",
      " 3664. 3102. 2875. 2901. 3336. 2451. 1836. 2542. 3781. 3632. 3613. 4141.\n",
      " 4699. 4457. 4638. 4257. 2219. 1963. 2300. 1649. 2003. 2125. 2108. 2246.\n",
      " 2489. 2391. 2000. 3264. 3459. 3432. 3158. 4668. 4440. 4498. 4657. 3907.\n",
      " 3897. 3730. 3785. 3039. 3221. 3169. 2171. 2639. 2914. 2592. 2702. 2223.\n",
      " 2545. 2984. 1937. 3211. 2694. 2957. 2671. 1795. 2464. 2572. 2255. 2202.\n",
      " 4215. 4190. 3962. 3233. 3353. 3012. 3085. 2035. 3651. 3574. 3645. 3193.\n",
      " 1825. 1990. 2155. 2565. 3150. 3940. 3270. 2930. 3820. 4380. 4055. 3870.\n",
      " 3755. 2045. 1945. 3880. 4060. 4140. 4295. 3520. 3425. 3630. 3525. 4220.\n",
      " 4165. 4325. 4335. 1940. 2740. 2755. 2051. 2075. 1985. 2190. 2815. 2600.\n",
      " 2720. 1800. 2070. 3365. 3735. 3570. 3535. 3155. 2965. 3430. 3210. 3380.\n",
      " 3070. 3620. 3410. 3445. 3205. 4080. 2560. 2230. 2515. 2745. 2855. 2405.\n",
      " 2830. 3140. 2795. 2135. 3245. 2990. 2890. 3265. 3360. 3840. 3725. 3955.\n",
      " 3830. 4360. 4054. 3605. 1925. 1975. 1915. 2670. 3530. 3900. 3190. 3420.\n",
      " 2200. 2150. 2020. 2595. 2700. 2556. 2144. 1968. 2120. 2019. 2678. 2870.\n",
      " 3003. 3381. 2188. 2711. 2434. 2110. 2800. 2085. 2335. 2950. 3250. 1850.\n",
      " 2145. 1845. 2910. 2420. 2500. 2905. 2290. 2490. 2635. 2620. 2725. 2385.\n",
      " 1755. 1875. 1760. 2050. 2215. 2380. 2320. 2210. 2350. 2615. 3230. 3160.\n",
      " 2900. 3415. 3060. 3465. 2605. 2640. 2575. 2525. 2735. 2865. 3035. 1980.\n",
      " 2025. 1970. 2160. 2205. 2245. 1965. 1995. 3015. 2585. 2835. 2665. 2370.\n",
      " 2790. 2295. 2625.]\n",
      "\n",
      "acceleration\n",
      "[12.  11.5 11.  10.5 10.   9.   8.5  8.   9.5 15.  15.5 16.  14.5 20.5\n",
      " 17.5 12.5 14.  13.5 18.5 19.  13.  19.5 18.  17.  23.5 16.5 21.  16.9\n",
      " 14.9 17.7 15.3 13.9 12.8 15.4 17.6 22.2 22.1 14.2 17.4 16.2 17.8 12.2\n",
      " 16.4 13.6 15.7 13.2 21.9 16.7 12.1 14.8 18.6 16.8 13.7 11.1 11.4 18.2\n",
      " 15.8 15.9 14.1 21.5 14.4 19.4 19.2 17.2 18.7 15.1 13.4 11.2 14.7 16.6\n",
      " 17.3 15.2 14.3 20.1 24.8 11.3 12.9 18.8 18.1 17.9 21.7 23.7 19.9 21.8\n",
      " 13.8 12.6 16.1 20.7 18.3 20.4 19.6 17.1 15.6 24.6 11.6]\n",
      "\n",
      "model year\n",
      "[70 71 72 73 74 75 76 77 78 79 80 81 82]\n",
      "\n",
      "origin\n",
      "[1 3 2]\n",
      "\n",
      "name\n",
      "['chevrolet chevelle malibu' 'buick skylark 320' 'plymouth satellite'\n",
      " 'amc rebel sst' 'ford torino' 'ford galaxie 500' 'chevrolet impala'\n",
      " 'plymouth fury iii' 'pontiac catalina' 'amc ambassador dpl'\n",
      " 'dodge challenger se' \"plymouth 'cuda 340\" 'chevrolet monte carlo'\n",
      " 'buick estate wagon (sw)' 'toyota corona mark ii' 'plymouth duster'\n",
      " 'amc hornet' 'ford maverick' 'datsun pl510'\n",
      " 'volkswagen 1131 deluxe sedan' 'peugeot 504' 'audi 100 ls' 'saab 99e'\n",
      " 'bmw 2002' 'amc gremlin' 'ford f250' 'chevy c20' 'dodge d200' 'hi 1200d'\n",
      " 'chevrolet vega 2300' 'toyota corona' 'ford pinto'\n",
      " 'plymouth satellite custom' 'ford torino 500' 'amc matador'\n",
      " 'pontiac catalina brougham' 'dodge monaco (sw)'\n",
      " 'ford country squire (sw)' 'pontiac safari (sw)'\n",
      " 'amc hornet sportabout (sw)' 'chevrolet vega (sw)' 'pontiac firebird'\n",
      " 'ford mustang' 'mercury capri 2000' 'opel 1900' 'peugeot 304' 'fiat 124b'\n",
      " 'toyota corolla 1200' 'datsun 1200' 'volkswagen model 111'\n",
      " 'plymouth cricket' 'toyota corona hardtop' 'dodge colt hardtop'\n",
      " 'volkswagen type 3' 'chevrolet vega' 'ford pinto runabout'\n",
      " 'amc ambassador sst' 'mercury marquis' 'buick lesabre custom'\n",
      " 'oldsmobile delta 88 royale' 'chrysler newport royal' 'mazda rx2 coupe'\n",
      " 'amc matador (sw)' 'chevrolet chevelle concours (sw)'\n",
      " 'ford gran torino (sw)' 'plymouth satellite custom (sw)'\n",
      " 'volvo 145e (sw)' 'volkswagen 411 (sw)' 'peugeot 504 (sw)'\n",
      " 'renault 12 (sw)' 'ford pinto (sw)' 'datsun 510 (sw)'\n",
      " 'toyouta corona mark ii (sw)' 'dodge colt (sw)'\n",
      " 'toyota corolla 1600 (sw)' 'buick century 350' 'chevrolet malibu'\n",
      " 'ford gran torino' 'dodge coronet custom' 'mercury marquis brougham'\n",
      " 'chevrolet caprice classic' 'ford ltd' 'plymouth fury gran sedan'\n",
      " 'chrysler new yorker brougham' 'buick electra 225 custom'\n",
      " 'amc ambassador brougham' 'plymouth valiant' 'chevrolet nova custom'\n",
      " 'volkswagen super beetle' 'ford country' 'plymouth custom suburb'\n",
      " 'oldsmobile vista cruiser' 'toyota carina' 'datsun 610' 'maxda rx3'\n",
      " 'mercury capri v6' 'fiat 124 sport coupe' 'chevrolet monte carlo s'\n",
      " 'pontiac grand prix' 'fiat 128' 'opel manta' 'audi 100ls' 'volvo 144ea'\n",
      " 'dodge dart custom' 'saab 99le' 'toyota mark ii' 'oldsmobile omega'\n",
      " 'chevrolet nova' 'datsun b210' 'chevrolet chevelle malibu classic'\n",
      " 'plymouth satellite sebring' 'buick century luxus (sw)'\n",
      " 'dodge coronet custom (sw)' 'audi fox' 'volkswagen dasher' 'datsun 710'\n",
      " 'dodge colt' 'fiat 124 tc' 'honda civic' 'subaru' 'fiat x1.9'\n",
      " 'plymouth valiant custom' 'mercury monarch' 'chevrolet bel air'\n",
      " 'plymouth grand fury' 'buick century' 'chevroelt chevelle malibu'\n",
      " 'plymouth fury' 'buick skyhawk' 'chevrolet monza 2+2' 'ford mustang ii'\n",
      " 'toyota corolla' 'pontiac astro' 'volkswagen rabbit' 'amc pacer'\n",
      " 'volvo 244dl' 'honda civic cvcc' 'fiat 131' 'capri ii' 'renault 12tl'\n",
      " 'dodge coronet brougham' 'chevrolet chevette' 'chevrolet woody'\n",
      " 'vw rabbit' 'dodge aspen se' 'ford granada ghia' 'pontiac ventura sj'\n",
      " 'amc pacer d/l' 'datsun b-210' 'volvo 245' 'plymouth volare premier v8'\n",
      " 'mercedes-benz 280s' 'cadillac seville' 'chevy c10' 'ford f108'\n",
      " 'dodge d100' 'honda accord cvcc' 'buick opel isuzu deluxe'\n",
      " 'renault 5 gtl' 'plymouth arrow gs' 'datsun f-10 hatchback'\n",
      " 'oldsmobile cutlass supreme' 'dodge monaco brougham'\n",
      " 'mercury cougar brougham' 'chevrolet concours' 'buick skylark'\n",
      " 'plymouth volare custom' 'ford granada' 'pontiac grand prix lj'\n",
      " 'chevrolet monte carlo landau' 'chrysler cordoba' 'ford thunderbird'\n",
      " 'volkswagen rabbit custom' 'pontiac sunbird coupe'\n",
      " 'toyota corolla liftback' 'ford mustang ii 2+2' 'dodge colt m/m'\n",
      " 'subaru dl' 'datsun 810' 'bmw 320i' 'mazda rx-4'\n",
      " 'volkswagen rabbit custom diesel' 'ford fiesta' 'mazda glc deluxe'\n",
      " 'datsun b210 gx' 'oldsmobile cutlass salon brougham' 'dodge diplomat'\n",
      " 'mercury monarch ghia' 'pontiac phoenix lj' 'ford fairmont (auto)'\n",
      " 'ford fairmont (man)' 'plymouth volare' 'amc concord'\n",
      " 'buick century special' 'mercury zephyr' 'dodge aspen' 'amc concord d/l'\n",
      " 'buick regal sport coupe (turbo)' 'ford futura' 'dodge magnum xe'\n",
      " 'datsun 510' 'dodge omni' 'toyota celica gt liftback' 'plymouth sapporo'\n",
      " 'oldsmobile starfire sx' 'datsun 200-sx' 'audi 5000' 'volvo 264gl'\n",
      " 'saab 99gle' 'peugeot 604sl' 'volkswagen scirocco' 'honda accord lx'\n",
      " 'pontiac lemans v6' 'mercury zephyr 6' 'ford fairmont 4'\n",
      " 'amc concord dl 6' 'dodge aspen 6' 'ford ltd landau'\n",
      " 'mercury grand marquis' 'dodge st. regis' 'chevrolet malibu classic (sw)'\n",
      " 'chrysler lebaron town @ country (sw)' 'vw rabbit custom'\n",
      " 'maxda glc deluxe' 'dodge colt hatchback custom' 'amc spirit dl'\n",
      " 'mercedes benz 300d' 'cadillac eldorado' 'plymouth horizon'\n",
      " 'plymouth horizon tc3' 'datsun 210' 'fiat strada custom'\n",
      " 'buick skylark limited' 'chevrolet citation' 'oldsmobile omega brougham'\n",
      " 'pontiac phoenix' 'toyota corolla tercel' 'datsun 310' 'ford fairmont'\n",
      " 'audi 4000' 'toyota corona liftback' 'mazda 626' 'datsun 510 hatchback'\n",
      " 'mazda glc' 'vw rabbit c (diesel)' 'vw dasher (diesel)'\n",
      " 'audi 5000s (diesel)' 'mercedes-benz 240d' 'honda civic 1500 gl'\n",
      " 'renault lecar deluxe' 'vokswagen rabbit' 'datsun 280-zx' 'mazda rx-7 gs'\n",
      " 'triumph tr7 coupe' 'ford mustang cobra' 'honda accord'\n",
      " 'plymouth reliant' 'dodge aries wagon (sw)' 'toyota starlet'\n",
      " 'plymouth champ' 'honda civic 1300' 'datsun 210 mpg' 'toyota tercel'\n",
      " 'mazda glc 4' 'plymouth horizon 4' 'ford escort 4w' 'ford escort 2h'\n",
      " 'volkswagen jetta' 'renault 18i' 'honda prelude' 'datsun 200sx'\n",
      " 'peugeot 505s turbo diesel' 'volvo diesel' 'toyota cressida'\n",
      " 'datsun 810 maxima' 'oldsmobile cutlass ls' 'ford granada gl'\n",
      " 'chrysler lebaron salon' 'chevrolet cavalier' 'chevrolet cavalier wagon'\n",
      " 'chevrolet cavalier 2-door' 'pontiac j2000 se hatchback' 'dodge aries se'\n",
      " 'ford fairmont futura' 'amc concord dl' 'volkswagen rabbit l'\n",
      " 'mazda glc custom l' 'mazda glc custom' 'plymouth horizon miser'\n",
      " 'mercury lynx l' 'nissan stanza xe' 'honda civic (auto)' 'datsun 310 gx'\n",
      " 'buick century limited' 'oldsmobile cutlass ciera (diesel)'\n",
      " 'chrysler lebaron medallion' 'ford granada l' 'toyota celica gt'\n",
      " 'dodge charger 2.2' 'chevrolet camaro' 'ford mustang gl' 'vw pickup'\n",
      " 'dodge rampage' 'ford ranger' 'chevy s-10']\n",
      "\n"
     ]
    }
   ],
   "source": [
    "for i in range(len(df.columns.values)):\n",
    "    print(df.columns.values[i])\n",
    "    print(df[df.columns.values[i]].unique())\n",
    "    print()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### horsepower 컬럼에서 \"?\"라는 이상한값 처리해주기"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['horsepower'].replace('?', np.nan, inplace=True)\n",
    "df.dropna(subset=['horsepower'], axis=0, inplace=True)\n",
    "df['horsepower'] = df['horsepower'].astype('float')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 다항식 변환\n",
    "\n",
    "다항회귀분석은 2차함수 이상의 다함함수를 이용하여 두 변수간의 선형관계를 설명하는 알고리즘  \n",
    "예를 들어 2차함수는 y = aX^2 + bX + c로 표시할 수 있으며, 학습을 통해 3개의 계수 a, b, c를 찾아서 모델을 완성함\n",
    "\n",
    "PolynomialFeatures(degree=x)\n",
    "\n",
    "x는 차수를 의미"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "X=df[['weight']]  #독립 변수 X\n",
    "y=df['mpg']       #종속 변수 Y"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### 2차항 적용"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "poly = PolynomialFeatures(degree=2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### X 데이터를 2차항으로 변형"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "X = poly.fit_transform(X)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### train data 와 test data로 구분(7:3 비율)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.3, random_state=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### 데이터 형태 보기"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "훈련 데이터:  (274, 3)\n",
      "검증 데이터:  (118, 3)\n"
     ]
    }
   ],
   "source": [
    "print('훈련 데이터: ', X_train.shape)\n",
    "print('검증 데이터: ', X_test.shape)   "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### train data를 가지고 모델 학습"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "LinearRegression()"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pr = LinearRegression()\n",
    "pr.fit(X_train, y_train)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 모델 정확도 보기"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.708700926297548\n"
     ]
    }
   ],
   "source": [
    "r_square = pr.score(X_test,y_test)\n",
    "print(r_square)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### train data의 산점도와 test data로 예측한 회귀선을 그래프로 출력 "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAlAAAAE8CAYAAAAPPI/5AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8vihELAAAACXBIWXMAAAsTAAALEwEAmpwYAABFSklEQVR4nO3df3Rc5Xkv+u8zkiUZOZIhFpZOwHYNtbvutR0wNuHww/j0HHRyOiwc91jXSU+J3XQVCjeJek8uiUwUNCI6wSckaZ1FcYBTYoe0CZEbYi+mJ0fc9hibEBLZJthOUwhR40Aq2QJiuRb+KT33j5k92jOzf87sPT/2fD9reWm0Z/9499YIPbzv8z6vqCqIiIiIyLtYuRtAREREVG0YQBERERH5xACKiIiIyCcGUEREREQ+MYAiIiIi8okBFBEREZFP9aW82Lx583TRokWlvCQRERFRQQ4ePPiWqrZZvVfSAGrRokU4cOBAKS9JREREVBAROWb3HofwiIiIiHxiAEVERETkEwMoIiIiIp8YQBERERH5xACKiIiIyCcGUEREREQ+MYAiIiIi8qmkdaDCNLznMVx56GFcruM4IW14Y+V9WH3H3eVuVtVLjiSx7dA2jE2Oob25Hd0ruxFfHC93s4iIiMoqEgHU8J7HsOxgL2bLeUCAdoyj9WAvhgEGUUVIjiSReDGBs1NnAQCjk6NIvJgAAAZRRERU0yIxhHfloYdTwZPJbDmPKw89XKYWRcO2Q9sywZPh7NRZbDu0rUwtIiIiqgyRCKAu13Gb7W+VuCXRMjY55ms7ERFRrYhEAHVCLNf5wwmZV+KWREt7c7uv7URERLUiEgHUGyvvwxltyNp2Rhvwxsr7ytSiaOhe2Y2muqasbU11Tehe2V2mFhEREVWGSCSRr77jbgwD6Vl4b+GEzMMb13EWXrGMRHHOwiMiIsomqlqyi61atUoPHDhQsusRERERFUpEDqrqKqv3IjGER0RERFRKDKCIiIiIfPIcQIlInYi8LCLPpr9PiMivReQn6X+/F14ziYiIiCqHnyTybgA/A9Bi2vbnqvqlYJtEREREVNk89UCJyBUA4gD+R7jNISIiIqp8Xofw/gLApwFM52z/uIgcFpEnReTSQFvm0/CexzCWuBrTfa0YS1yN4T2PlbM5ZZMcSaJzVydW7FyBzl2dSI4ky90kIiKiyHENoETkdgAnVPVgzlvbAVwF4BoAowC+bHP8XSJyQEQOjI9bL7lSLGMx4XaMI5ZeTHjZwd6aC6KMxX9HJ0eh0MzivwyiiIiIguWlB+omAHeIyC8BfBvA74rIN1X1uKpOqeo0gCcAXG91sKo+rqqrVHVVW5v1kivF4mLCKUEu/sueLCIiInuuAZSqblHVK1R1EYAPA/gHVf1DEekw7bYewNGQ2uhqvs1iwnbboyqoxX/Zk0VEROSsmDpQXxSRIyJyGMC/A/D/BNQm36ZsbsNue1QFtfivXU9Wz/4e9kYRERHBZwClqntV9fb06ztVdbmqrlDVO1R1NJwmuovl5bY7b4+qoBb/deqxYm8UERFRRCqRT9vcht32qIovjiNxYwIdzR0QCDqaO5C4MeF78V+3HqtC86qIiIiiwk8hzYpVZ9PTZLc9yuKL474DplzdK7uReDGRN4xn5jevioiIKEoi0UVzXKxn99ltJ2fmniw7fvOqiIiIoiQSAdQbK+/DGW3I2nZGG/DGyvvK1KLqF18cx9CGIWy9ZWsgeVVERERREokhvNV33I1hpOpBXa5v4YTMwxvX3YfVd9xd7qZVPWM4cNuhbRibHEN7czu6V3YXPUxIRERUzURVS3axVatW6YEDB0p2PSIiIqJCichBVV1l9V4khvCIiIiISokBFBEREZFPDKCIiIiIfGIARUREROQTAygiIiIinxhAEREREfnEAIqIiIjIJwZQRERERD4xgCIiIiLyKRJLuQDA8J7H0ku5jOOEtOGNlVzKJWjJkSSXdCEiIkJEAqjhPY9h2cFezJbzgADtGEfrwV4MAwyiApIcSSLxYgJnp84CAEYnR5F4MQEADKKIiKjmRGII78pDD6eCJ5PZch5XHnq4TC2Knm2HtmWCJ8PZqbPYdmhbmVpERERUPpEIoC7XcZvtb5W4JdE1NjnmazsREVGURSKAOiFtNtvnlbgl0ZMcSaJzVycUavl+e3N7iVtERERUfpEIoP75spuhOX/fVVPbqXBG3tPo5Kjl+011Tehe2V3iVhEREZVfJJLIf+udFyCSvU0ktZ0KZ5X3ZOho7uAsPCIiqlmRCKAu13FArLYzB6oYdvlNAsHQhqESt4aIiKhyRGIIjzlQ4bDLb2LeExER1TrPAZSI1InIyyLybPr7y0TkORH5efrrpeE109kbK+/DGW3I2nZGG/DGyvvK1KJo6F7Zjaa6pqxtzHsiIiLy1wPVDeBnpu97APy9qv42gL9Pf18Wq++4G0evG8AY2jCtgjG04eh1AyyiWaT44jgSNybQ0dwBgaCjuQOJGxPMeyIioponmjt9zWonkSsA7ATw3wD8V1W9XUReBbBWVUdFpAPAXlVd6nSeVatW6YEDB4JoNxEREVGoROSgqq6yes9rD9RfAPg0gGnTtvmqOgoA6a+XF9NIIiIiomrhGkCJyO0ATqjqwUIuICJ3icgBETkwPm5dMZyIiIiomnjpgboJwB0i8ksA3wbwuyLyTQDH00N3SH89YXWwqj6uqqtUdVVbm/VsuSAM73kMY4mrMd3XirHE1Rje81ho14o6o/r4ip0r0LmrE8mRZLmbREREVFFcAyhV3aKqV6jqIgAfBvAPqvqHAPYA2JTebROA3aG10sXwnsew7GAv2jGOmADtGMeyg70Mogpgrj6uUIxOjiLxYoJBFBERkUkxdaC2ArhNRH4O4Lb092Vx5aGHMVvOZ22bLedx5aGHy9SicIXZQ2RVffzs1FlsO7QtsGsQERFVO1+VyFV1L4C96ddvA/j3wTfJv/k2lcjna/RyroweIiPIMXqIAARSXsCu+rjddiIioloUiUrkUza3Ybe9moXdQ8Tq40RERO4iEWHEsqoruG+vZmH3ELH6OBERkbtIBFD2a+GFN+uvXMLuIWL1cSIiIne+cqAq1Rsr70Prwd6sRPIz2oA3rrsPURt46l7ZnZUDBQTfQxRfHGfARERE5CASPVCr77gbP3lvHBc1BlXgosbwk/fGI7kWXhA9RKzzREREVBxPa+EFJay18Ib3PIaVBz+NOtNMvCkFDl33xUgGUcXIncVnaG1oxZYPbLEMxJIjSWw7tA1jk2Nob25H98pu9lAFiM+XiKgyBbEWXkVbfnBLVvAEAHWS2k7ZrGbxAcDE+QnLgpksrBkuPl8iouoUiQCqEVO+ttcyp9l6Z6fO4v4X7s8a2mNhzXDx+RIRVadIBFDkndtsvWmdzuoJGZ0ctdyPhTWDwcKlRETViQFUjbGq82Tn7NRZxMT6I8LCmsFg4VIiourEAKrGGLP45jbO9bT/tFoXI11zxZoAW1W7WLiUiKg6RaIO1DQEdcifTZjaTlZm18/GyXMnXfeLScwyiNr35r4QWlV7M9KMe6uleyYiioJIBFAxi+DJaXstsytjYKWprsl2vzBydMJeKLlSsXApEVH14RBejbErY2DFKNhpJYwcHc5IIyKiasEAqsb46TmKL46XNEeHM9KIiKhaMICqMV57jowk81IuLswZaUREVC0iEUAdabgGuSvSqKa2UzYvZQxmxWah5/qezPfxxXEMbRjC4U2HMbRhKLR8Hc5IIyKiahGJJPIVn30eo4lFaNffZLaNyaVY8dnny9iq0hl4aQCDrw1iWqcRkxi6lnSh94Zey32tZn2tuWIN9r25r+yzwDgjjYiIqkUkFhP+4Vc344a3n4GY1sNTBV5673r820/uCPx6lWTgpQE8/erTedtvaL8BT/zHJ2yP81MuwLxvS0MLRAQT5yaKCr5qrVwBERFVH6fFhCMRQGlfa1bwlNmugPRPBH69SvL+b7zfttjl1lu2WgYlVqUMmuqaLHOb/JQ9cDpPodcnIiIqF6cAKhI5ULXMLngCkJn+nxxJonNXZ2aR4K0/3uq5XICfsgdO53E7J8sVEBFRNYlEDlQts6sUDqSm/1sVp7RjVS6gkBICbsewXAEREVU79kBVua4lXbbvtTe3++pBsioXUEgJAbdjWK6AiIiqXfQCqB2ny92Ckur9/kXc0H5D3nZj+r/XXh27cgFeyh54OY/bOVmugIiIqolrACUiTSLyYxF5RUR+KiL96e0JEfm1iPwk/e/3wm+utePSNvPNsWnr7VHV348n/uMT2HrLVstil3a9Oq0NrZ6KY+YW0mxtaMXcxrmZ4zYu3ei7yGYpi3MSERGFwXUWnogIgGZVPS0iswC8AKAbwAcBnFbVL3m9WFiz8Ib3PIZrDn4Gs0SB/lNAXwsuqOAn1/13rL7j7sCvFybf0/tFgL4+IJGwPV8UZryx7AEREZVaYGUMROQSpAKoewD8J1RIADVxdTtaf3E8f/tV89H6evUkJnsOdhIJoL8//wQ2gVS1Bx9RCQKJiKi6FB1AiUgdgIMArgbwl6r6GRFJANgM4BSAAwA+pWoqBW4hrADqYt+lqJf00F26BwoALmoM9f2OTaoonbs6LWfJdTR3YGjDkPVBRgGsEtbzyhV2gFbQcyEiIipS0XWgVHVKVa8BcAWA60VkGYDtAK4CcA2AUQBftrn4XSJyQEQOjI+PF9B8d3U7TqUCp/5TqQ3p13U7ToVyvbD4mt6fSCCreqhI6p/NUF4QcutJJUeSmd6h0clRKBSjk6NIvJhAciQZ2HVZ9oCIiCqN70rkItIHYNI8dCciiwA8q6rLnI4tSSVyUw9UtVUiL6inxRjOC7kHym9F8iB7h9gDRURE5VBUD5SItInI3PTr2QD+A4B/EpEO027rARwNoK01raDp/QX0OCVHkrjl27dg+c7lWL5zOW7+1s2uPUZ+K5IH2TvEsgdERFRpvFQi7wCwM50HFQPwHVV9VkSeEpFrACiAXwKojOluC6u3tJWRN+Q7n6ivz/M1kiNJfO4Hn8OF6QuZbRPnJ9D7Qm9WG3L5DYhEBMmRpGvbveRPFfxciIiIQsLFhGuM3XAY4Dwk5nScHbeZcpxdR0RElay2FhOusUrkrnKG+Jx6kpzeW3PFGt+XdlsgmIsKExFRtYpeAHXMemHdmpVTL8ppvTmn9/a9ua+gyxcSsPkZLrSaGUhERBS26AVQ5Kh7ZTdmxWblba+Xesek7EKTwgsJ2LwuKlyKEgpERERWohFA7ThtWQeqZofzjBpRRmKYqUZUfHEcn7/p85jbODeze2tDKwZuHnDMO/Ia1Ji5zZQrdnYdhwCJiKhcopdEXsV1oEIhEkiNqELqQHmZKVdMFfMVO1dAkX9vAsHhTYc9nYOIiMiOUxK5lzIGFe+kvAeX4l9ttkfbwEsDGHxtENM6jZjE0LWkC7039NofYCSV+6wflVtKoKWhBeenzuPM1Jms/fzOoosvjhc84669ud1yZmB7c3vVr/9HRESVLRJDeGdRn9fJopraHmUDLw3g6VefxrSmEuendRpPv/o0Bl4amNkpt0ZUfz/Q319Q8nV8cRxDG4bw0C0P4dzUubzgaW7j3JKWILAbAlxzxRrmRhERUagiEUC162/y6kCJpLZH2eBrg+7bbXqa2uMfLjjAsKtKPrt+dkl7eeKL40jcmEBHcwcEgo7mDiRuTGDfm/vKmhvFmYFERNEXjRyoRoGct9jeAMi50t1fqS3fudz2vSObjsx8Y6yXZ+HRdW3Yvn4+AO9ry1V67lE528fioERE0RH9QprtNrdhtz0iYmJ9f3nbEwnb5V7+cOitzOuxyTFPvSfFlh8IWznbx5mBRES1IRoRxphN8Uy77RHRtaTL+/ZEArj11rzNLWcU3//UP6VeN7R4yh1yKz9Q7iGsci4+HERxUCIiqnyRCKC0pyVVuiBdvsB4rT0t5W1YyHpv6MXGpRszPU4Cwey62fjOq9+xDlz27s3qiVq+YxkA4H1vXwQAbBr8Z0+9J3a5R/HFccvilj37e3DLt28pWSDl1L6wVXrvHBERBSMaOVAisFhLGApASnh/5eSUewMga0p/8o9+gFmn37U8jxFUmfnJHXJadLgWcoGYA0VEFB3Rz4FaYHMbdtsjyC735qEfPZTXI3Tj9v8Do/MaLM9zzzPH8eRDI1nb/PSeOA1V1UIuUDl7v4iIqHSiXSiphtgFLhPn8yuxn506i84vLQEAHNl8NOu9e3ePA0gFUtvXz/edO2RX3NKtnWEpR0HNYoqDEhFRdYhGF83mOZY5UNg8p7ztKqFCc2x+/d5UDG0M3d38NzcBAL62vh2fTr7ru/fEKoE7iHYWgosNExFRWKKRA1WjdaDM7HJvmuqbcPLcybz9WxtacW7qHM5OncU9zxzH6n+axOpXLfKibr01lXzusy0P/eihvN6vIHOBvPQs2eVjea13RUREtS3ya+FpT4v9YsLla1ZJ5a5VZwQVACwDqy0f2JLZ/2vrBd9rbscj++dhyba/mVmAWMR38GS0xZiRF8bwWW6waPQsGdc2sKQAERGFJRo9UAvrIb+ayt++oA5y7GLg1yuVoAIQ4zyjk6OISSyz8PC0TqOjuSP7vHZVy/v6fC9AHBa7nqWYxKCqmWdl3HMu9kAREZEXke+Bwubmma4mUw+UxWoeVcNrL4sXxv7m8xkLEOedN5FI9Trt3TvTE2VYtAj45S9t21uqZG27HqTce1p39Trsfn13Xu9bKQpqEhFRtEUjiTyCgl4SxG4BYMvz2g3bHTtm2QtV6mRtL4noZ6fOYt+b+1hSgIiIQhGNHqgICjp/x+04Yx08cy/SI5/8CJbk7tjfnxdEOQV7YQQr3Su78/K6rIxNjrGkABERhSIaAdSDp7K/7zd9b5HOUw3s6ikVWgbArT5Ta2Nr3pDhf1n9Gzz/vstxyb+MZ+8sAixcmBnOK3Wydm7CvIhkhu/MuHwKERGFJRpDeNZFte23V4GgF8R1qs/UVNcEVbXsRfrbm95jfULTcF451n+LL45jaMMQDm86jC/c/IWyLR5MRES1ybUHSkSaAOwD0Jjef5eq9onIZQCeBrAIwC8B/F+q+pvwmuqgpyVySeR2ZQkKHY4yn290chQCgaYfUGNdo2XFcgD4YvwSXLb12dTx6VoRy3csQ0xi6FpSj961a9H95H2WpRK8BDBBJJ8H/ayirhzV2YmIosa1jIGICIBmVT0tIrMAvACgG8DvA3hHVbeKSA+AS1X1M07nCquMwXRfK2IWAdS0ArF+68CgllkV3XRSL/VYNX8Vnvjg/wCQveDwkc1Hgb4+JD+62vcf5YGXBvD0q09nbePCu+HiYsdERN4VtZiwppxOfzsr/U8BrAOwM719J4APFd/UwtgVy6yVIppmyZEkOnd1YsXOFejc1Wk5E85pRp6Vi3oRL429hEfXteHRdW35O/T3p4bUjt6Iw5sOY2jDkOsf4+RIMi94Akq74LCXZxU1Qc/uJCKqVZ4KaYpIHYCDAK4G8Jeq+hkROamqc037/EZVL7U49i4AdwHAggULrjt27FhQbc/gUi4pXnsXVuxckRm+K8STD41YL/sCZNeNcmBXDBMABILDmw4X2jxParUnxu5nX4pnTkRUbYrqgQIAVZ1S1WsAXAHgehFZ5nKI+djHVXWVqq5qa7PovQhCu81t2G2PoORIEve/cL+n3gW75O6YeHteH9uy2LonCvBcrdxphl4pZs/Vak9MORL+iYiiyFeEoaonAewF8EEAx0WkAwDSX08E3TjyxuhNsZrKD+QHK3Yz/LqWdGFWbFbe8fVSjxvab8jatn39/KxcqIz+/lSyeSLhGEw5/cEuxey5Wl0nL+jZnUREtcrLLLw2ABdU9aSIzAbwHwD8dwB7AGwCsDX9dXeYDXW0eU7kZuH54ZbTlBusOM1au/bya7H1x1tx8txJAEBrQyu2fGAL4ovjGHhpAIOvDWbW0uta0gXc+l7g+ednFh82D+EZKzxbBFJ2xTA3Lt1YkiG0oOtsVQvOWCQiCoaXWXgrkEoSr0Oqx+o7qvqgiLwXwHcALADwKwBdqvqO07lCW0y4rzXzt9ocQKkCUgOz8NxymjYu3egYGAH+prbn7tv7/YsY+GA9hrqeQ+fgbTPHGj+UW2+1XB6mnNPpazUHioiIvHPKgfKURB6U0AKohfWQX03lb19QBzl2MfDrVRqnhGwAmBWbhanpKUwje4ivXuoxcPMAAHgOJpxKINzzzHEAwL27x/PeQ1+f5/yoYhQTCLInhoiIzGoggKqD/Co//0cXxCDH8gOrqPFb18mso7kDACwDsI7mDgxtGMra5hasAalAyjKIsumJCgp7lYiIKEhFz8KreGPWydO22yMmvjiOxI2JTDDkx9jkmK+Eai9J1tvXz8fw0kvy33j+eWDt2tS/ENTqzDoiIiq9aARQPS2pvCcjedx43dNS3naVkLE2nN8gqr253dfUdq9J1p8duCk1bGcwejr37k0FUiEM57kFgrVYOJOIiMIRjQBqx+lU8nj/qdT3xusdp52PiyCraeqzYrMQs/hR10s9uld2+5ra7rQocd6xiURq2A6YSSg3vvb3e7shH5wCQWN4b3RyFArF6OQoEi8mGEQREVFBIhFA6XHroTq77VFmHs4TCDqaO/D5mz6PL9zyBcxtnJvZr7WhFQM3DyC+OG55jF3ekNW+G5dutD92795UEGUEUmYigQ7nOQWCHN4jIqIgudaBqgYyPwZYJJHL/LoytKb8jKDIarvfYwBk1X8ya21otZy5ZgyVZWa3PXlfdlkDM2M4z2JIz+8sOeM9c7mGxrpGAMUVzuRsPSIiyhWJAEo3z7GvA1W+ZkXCwEsDlov+AsDE+Qn0vtALAFn1pMwz4YyhMgCIG6UMjB+W1QzQdDDleB6X4OXsxZmeponzE0i8mEBLQwsmzufXBHPL6SqmHUREFF2RGMKzC5IYPBVv8LVBx/cv6sWsYTDHoTKjl8lqOM/Q3w8kEgUPudkdJyIFLWHCoT8iIrISiQCKwmO3vp6ZeRjM01DZ3r3ZM/Ry9fd7HnLLnVlnV6Nq4tyE5zwvp+u5bSciotoQjQCKs/BCExP3j4h5GMxzSQRzzpMxrGfKkTq8+Uimsrndeaxm1nlpox9+SjwQEVHtiEYARaHpWtLl+L5RCsFgV+ZgdHLUvvZSImHZI3Xv7vG8IOrdC+9mzuG2iLKhqa4Ja65YU1AZAz8lHioJa14REYUrGgHU5jnWhTQ3zylvu0os6D+ayZEk9r25z/b92XWz0TyrGVv2b8lcz6kqumPQkkhkJ5WrIvmLZ/GtDy/N2s1ICk+OJB2H0YyhutaGVjTVN+HpV592zGVyenZN9TMBVGtDq++lYUodzLDmFRFR+KIRQFHgfzTN58vVVNeEjUs3QqGYOD+Rdz2nquiuCdimnqj44jhm18/OfG/0RhnnsBtGM9bwe+iWh3Bu6lympIGV0clR3Pytm/G5H3wu79kNvDSAxIuJrOPPTZ2zb7uFcgQzTHwnIgofA6iICPqPptPw2Nmpsxh8bdD1egUlYOcM55n3NRYovueZ4xibHHMdXvM6xDdxfgIXpi/k3YuXe3RTjmCGie9EROFjABURQf/RdDvObnae+biCE7BNCeZW+967exztze2If2MYiRsTWRXWjcKZuW0phJd7dFOOYIaJ786YH0ZEQYhGAMVZeIH/0XQ7zm52nvm4IBKwH9k/D0c2H8WRzUcBIPP1kf3zgP5+/Pa2v7YsnJkcSRYdMHi5R7c/xuUIZqo18b0UmB9GREGJRgBFgf/RdFo0uKmuCV1Lulyv52eNPTtLtv0Nkr94Fk91Lc7e/tVvZb7aDZHZPZPWhlbX63q5Ry9/jMsRzATx3KOK+WFEFBRRq+U0QrJq1So9cOBA4OfVhXUQi7XwdEEMcmwq8OtVqqDXbDPONzo5ipjEMK3T6GjuyJy35GvEiaTyo/r78956dF0btq+fP7MrBIc3HbZsI4Cs5VmAVDmGOQ1zMHFuIutenO7RrnCnkcRu4Fp6lWPFzhVQ5P83z/i8EBGZichBVV1l9V4k1sIj78wLA8ckhq4lXei9oddyX6cFhnPfT44ksfXHW9Gzvydrn9l1s9FY35gXmBjsggvL7cZaehYBlJFgvn39fDz50Ag+O3CT6z14CWqcjvea3+T2HKl02pvbLYNe5ocRkV+RCKC4mLC3RW9zFwae1unM93ZBlNdrf+4Hn8ubyQYAZ6bO4MzUGcs22bX55RMvY/fru/Pv5aMJxIFUL5RpUeLVT63K6k1a/eq7WHPFGnTu6rQNkIIIavjHuPp0r+zO631kfhgRFSISOVBcTNhbbofdwsBuCwZ7ubZV8GTF3Ca7NruWDzBm6aXLHeTm+wDA7td3h54ozGTt6sP8MCIKSiR6oLD1FHDe9L0xG68BQP5oTyR5GU6ym5bvZcHgQq7ttr/dcZ7LB6QDqfjiOOIfexh4/giAIwCA4TtTuXbDSy/B8O80AwC2NW1z/UPpJ1/J2M78purCIVUiCkI0AqielpnuJtMQnkWuaGR5GU4yEsFzeVkwuJBr22ltbHU8zq6dlkNjRm/U3r0z20SwfMeyzLdG6QPBK8AG+3Z5GQbNlfvH2ChrwIDKHybaE1G1icQQHnkbTrJbGNhtwWAv154Vm+V5f2Pmp12bvZRIKMQ9u0+kAi5ToU6zYqe4s8ZQYfjciKgaufZAiciVAL4BoB3ANIDHVXWbiCQA/AmA8fSu96vq34XVUEccwvM0nGQkinudhedHvdTjArzlQZ06fyrzuqm+KRO0tDa0YssHtiC+OI5rL7/Wc49Ebu/FE9cuwid2v427nrHoFUvP4HvqH5/CZVu/mnXOYquG2wVgW3+8lb0rDpwCVz4nIqpUXobwLgL4lKoeEpH3ADgoIs+l3/tzVf1SeM3zqD0GWNSBQnttdbB5ye3ovaE3kIDJkBxJoveFXlzUi1nbZ8Vm4ZL6SzBxfiLvmPbm9rzhMiB7oV6veSpWw24b/us8rLt6HTr/YB/Wf/OVVM9TjjsHR7D6jkTmWka7iplVZxdonTx3MrMgsZdhwVrDtfuIqBq5RhiqOqqqh9Kv/xXAzwC8L+yG+TJmkwRtt50Cs+3QtrzgCQAuTF+AiNgOxQVVEdruPPve3IehDUO453vHbY8dvvMA3un5ZOqbRYuKnlXnNdBi5etsXLuPiKqRry4aEVkE4FoAP0pv+riIHBaRJ0XkUptj7hKRAyJyYHx83GoXqmJOvQQT5yZsp4wH1evg6Tx9fRheeonlfncOjqRyoo4dK3qKu9PyN17bXYtYDoKIqpHnWXgiMgfA3wL4M1U9JSLbAXweqblunwfwZQAfyz1OVR8H8DiQWsoliEbn4Sy8ksnNN2ppaLEcpgNSPQh2Q3FBFaH0dJ5EAp9d9iI+9M2fZCqWA8DyHcvSy64kgP7+zOy5+5KTeflRXljlob174V3bYUxKYTkIIqpGntbCE5FZAJ4F8L9U9SsW7y8C8KyqLst9zyy0tfBELItmKgAp4Vp/UWeVtzQrNgsXpy/mrS82KzYLn7/p846J31YVof0WNfR6HmO/P9p1LBNE/ct7Z+HfvG2d+L76qVWBFFh0ah/AoIGIqJIVtRaeiAiAvwLwM3PwJCIdqmr8r/96AEeDaGwhph9oQZ1FD9S0AnXlalQEWeUbXZi+gLmNc6GqmZ6WuY1z0XN9j+s6esY5iwkgvJ4ns1/TNghewZyGObhs61fxbxbH0bmrE0Ndz2VqRx3ZfDSQWWBGb93ZqbN5izED8F1zioiIKodrD5SI3AxgP1Ilno2s7PsBfATANUh19PwSwN2mgMpSaD1QC+sgFrPwdEEMcmwq8OvVEvOQndUq9kBhK9n7WkTYY/kCPwFY7n0ZxTbzGOvuFXAfTj1jnbs6LYceU0OKQ57ugYiIwlVUD5SqvgDrZeXKU/PJyuY5zIEKgVUQYKWloaWo845OjqJnfw969vdk7efUK1NI1XC7YwHg1++txwe//DsAUj1QWflRNnIXZza3wa22EafuExFVt9oqlES+WAUBVlKjvMGfF7Cf8l9MGQSrY43gyeA2Cyw5ksRlW79q2163AIlT94mIqhsDKLLltTdk4pz1LLxiz+u0fzE9OG77PPn7V7omkG87tC1rRl/u+d0CJE7dJyKqbgygyJbX3pBCSg8Uu38xPThu+2xfP9/1HLlB2D3PzBTsNHKhnAKkYmtOERFReUUjgNpxOpX7ZKyBZ7zecbq87apyXgpDFtJr4qfgpN35i+nBcbu+41BgIgGI4PDmIwBS+VJHNh/N6o0yEsndAqT44jiGNgzh8KbDGNowxOCJiKiKeKoDFZTQZuH1tUIskshVAen3N7xE2XJnma25Yg32vbkva9YZMFNGoLWxFaqKU+dPOc6MM85rNRPNYEz5N453a4tb28ztGXhpILOoshW3mYXJkSTiV92eVfpg+Y5l2Lh0I3q/n17axjR7r5gZg1R9+PMmiganWXjRCKBYxqBs3GbqeSmO6eWPjVtZALsin6qatVZfU10T1l29Drtf3+2YyO6pnIBb8ny6BEJQRUOpOvDnTRQd0Q+g2ANVNnb1jMyCqG3kVjfJSzsMRlFLO57/2CUSM71MIqkPnPHaoMqaTzWGP2+i6CiqDlRV2HoKOG/63siFagDQX44G1Y4gZr0Vcx1ju59rOAVPucOGjnILbFr1SIlg/brL8ej6y/HkQyP42JbFmbdY8ymaWOOLqDZEI4m83eY27LZTYIKY9VbMdYztfq4RE+vPhdFDUNAwS19fqgeqry/vrXt2n8A9zxzH6lffzdoepZpPyZEkOnd1YsXOFejc1YnkSLLcTSob1vgiqg2RiDAubJoDfaBlpgJ5Xwv0gRZc2DSnvA2rAW4z2oKqbeQ2687q/VmxWaiX+rxjupZ0BV+DyeiNyu2VUkXyF8/i6xsW5l3vkf3zCr9eBTFyfkYnR6HQTEX2Wg2iWOOLqDZEIgdquimG2Ln8+5huFMTO2g/XUDDMSeBeZ+EVex2rc1u9D1jPwgt1lpQRRPX3A7feCjz/fN4ub1+/DO/98dGZvCnjOId19yoVc37ycRYeUTREPol8uq8VMYsk8mkVxPpPBn49CkZyJImHfvQQJs6nEv0FAoX6y0MqEXPZBSMJ3bWd6YDIOHao6zl0Dt42c4w58RxIfe+yeHG5OAUEK3ausFxoupBFpomIKknkk8hlx2nAXMYgnUQuC2JMIq9QyZEkel/ozSoxYPwR9rMwcCnkTks3ktBd22lRwuBD3/wJ4l23z+xjJJ4buVP9/RUXQLkt3Nze3G7ZA8WcHyKKskjkQFH12XZoW1bwlMvrwsCl4LT4sVs7zccOL70E29fPx/Idy9A5eFtqB3PgZBCpqCDKbeFm5vwQUS1iAEVlEVb5g6BngyVHkq71pZzaaX7PsoRBImE5cy+rJ8ouQb0AhTwft2n5XNePiGpRJIbwsHkOYJEDZZGWQRXCbtgndx8/3Iaa/DLO58apnY7DW32/n/rGSB43hvNy8xKNYKrI4b1Cn4+XIbr44jgDJiKqKeyBorLoXtmdV2LArJAhILehJr+chu4Mbu10HN7KDYaseqICVOjz4RAdEVG+aPRAsRJ51TF6K/zOwnOaDRZ0BWi347zMFjTe8zSl3RxQGT1OBqN3ypx0nru/S+9Uoc/H1z0QEdWISJQx4Fp45VVszRun43NrTJ0+fzpvcWAj3yboekRh1Tfyer+Z9666Pf1hlvzhPYNIqubU2rW2gRTrNRER+eNUxiASQ3h2ISBToMJXbBVqp+Nz3zt57mTezL0wZ4OFMXTl537NOUqePP98dq9VDg7FEREFJxJDeKwDVT5OeTVeeqHc8nLccpCA7NlgxjmDGGoKY+jK7/2enTqLp7oW404gP0cqd5jPvN2iF6rY+zH3jrU0tEBEMHFugkN6RFSTojGEJ5KZhJe1HYCU8P5qUbFVqJ2OB2D5Xq5qGoIq5H4dn+XatZZLxQDIzpNauxbYu7fg5WJyZ/DlMoZSXz7xMgZfG8S0TiMmMXQt6ULvDb2+r0dEVAkiX4kcD7SwjEGZFFuF2u14t1IHpR6CKjbfq5D7dXyWe/emvorpfyGs/qfBCLL6+1PHGMd55DYj8ezUWTz4wwfx7sV3M9umdRpPv/o0ADCIIqLIcc2BEpErReR/i8jPROSnItKd3n6ZiDwnIj9Pf700/OZSpSk2r8bpeKv3ZsVmobWhtSwFG4PI93r3wrt5253uFwDOXDzjfg0/JRBye6w89Eh5mcloDp7MBl8b9NKqPEEXRSUiCpKXHqiLAD6lqodE5D0ADorIcwA2A/h7Vd0qIj0AegB8JrymOnjwVPb3/abvmQMVKru8GiA168utp8ZLXo6XHp9ie4bcJEeSuP+F+zPr4Bm85nvZDYHNbZyLnut7so43l3YAgJPnTiLxYmp4bN+b+6zvMZFI9SqtXTtz8tzhPXMvlXnhYnMelU0w5aXwqZ3cZ+aF36KfYf/8iYhy+c6BEpHdAB5J/1urqqMi0gFgr6oudTo2tByoRoGct9jeAMg5juOVmlWwYC43UG3Xc8v/8ZLvZVdCAMivJ+W0r5mvexSrLEGkSh+Ygyyb/x54yYGyey8mMbzy0Vfc22jip+RCqT9vRFQ7AitjICKLAFwL4EcA5qvqKACkv15eZDsL125zG3bbKVRBVwQv9/Xc8n+85Hs5DYHlDgV6Lfzp+x7NwZEx5OdxOC93vbvWhlbMbZybNZS6celGy2O7lnR5b2Oan6Kfpf68EREBPpLIRWQOgL8F8Geqekrs/o82/7i7ANwFAAsWLCikje7GbIYI7LZTqIKuCF7u6zmdx2u+l9sQmHko0M9wmed7vPXW1Ne+vuw19XLLIPT3p/6ZZ/Clv8YTzj06xntBzMLzMzmh1J83IiLAYw+UiMxCKnj6a1X9bnrz8fTQHdJfT1gdq6qPq+oqVV3V1tYWRJvz9bSkZt4Zs++M1z0t4VyPHNn1yPhdHLhSrmd3npjEPA8T2SWImxl/8L3s69a2PMasu0RiJphKJPKH7FRT/8w9UUZQZWbTU9V7Qy9e+egrOLLpCF756CsFz77zMzmhkJ8/E9SJqFheZuEJgL8C8DNV/YrprT0ANqVfbwKwO/jmeWPXz8T+p/IodcXrsK9nd/4v3PwFzzk25iEwO8Yf/Nzhso7mDmxcujG4e8wtYVDIIsY2Fc8LDUxyjwOQ9wwSNyYAIO/8fn/+xc6mJCICPCSRi8jNAPYDOIKZmOR+pPKgvgNgAYBfAehS1XeczsUk8tpR6llRpZiFF9T5C016DvUec4brbKucA5lhwM7B2/JmXhZ6X16Oc9oP8F5hnWsCEpFXTknk0ahEvrAO8qv8/iZdEIMcmwr8elQ9yhnItTa2QlVx6vwpb4sGl3jGmNGG0clRxCSGaZ3G3Ma5+W2+6vbUAUb+VI5H17Xh6xsWorGuERPnJ3DPM8cBANvXzwfgHph4DWiCCnyKrZ5PRLUj+pXIN89hJXLK47eWUNDXO3nuZOa93Gsb/8olt61GrSarNmdamV4GpnNXJ4a6nsPyHctmTjh1NnOue3ePA0gFUPc8cxxfW+884cRrEnhQyeLFVs8nIgJ8ljEgqiaVUE6hVNf2y62tBmMxY3OelJ+A5d7d46nAxKHaudck8KAmC5Q6R4+IoikaAdTWU6meJ6MCufF66ynn4yjSKqWcQimu7Zefdjwcb84KgNqb2/HouuwZtfc8cxxHNh/Fkc1HM9uM14/sn2efTwXvAY3dfmuuWOMrcd0qSb9URTc5+48oOqIxhNceAyxyoFhIs7aVeqjGS/2mShkm8lNrKrfN3Su7kTibAEw9WF/fsBALv/J1AJjJmUpb8tVvpV6khwBzGYHLOz2fxMPxZtucMKtlf9ZcsQa7X9/te5i2HEOopR5SJqJwMcKgyKqEcgqlurZfXmtNWbXZqQcnKxDILY/Q359aUsYmiLpzcASHNx3G0IYh24AivjiOoQ1Dmf32vbmvpMO0xfQgsWI6UbREoweKSeRkwctCxXasZqjlrlnndr3Z9bPx7sV3AaSKbl7Tdg22HdqGLfu3FDXzzs8MPrt9zW0dnRyFQPJmpjndb26wZAQWY5Nj+LPfvxIQ4C9+67s4DCD5i2dTvVKmGb+W7bJo/2vdf4CP3/JWXrkE41ir2XRAcUOlds+s2B4kVkwnihaWMSDK4bRwrtdFat0W3/VzLrfz2p0niPpKXoNNu3u955nj+PqGhRi+80AmgDLvf88zxzOz9rL09SH50dWIX3V71my/eqmHiODC9AXHNhVa08npWRjBZqHXYv0pouoT2GLCFWvzHOulXDbPKW+7qCo5zVDzOuTiZZZbIcM3foaBvO5b7NCS071uXz9/Ziafxf7b18/H8h3LZoIk01IyVte/qBezgiej5pRZMUOlTs+i2B4kzv4jipZoDOHtOJ2dRG7MxlsQA+wn/xBZcvuDGORsO7/DN37+iJeqvpKX/b4YvwQP71zhLXk9XQXd6JMxZvM9uq4tU5zTYK45JRBPQ6NOQ6BOz6LYSQnFDCkTUeWJRgDFHCgKkNsfeS9/ML3OcvM7K8/rH/HkSBIiAqsheqv6SsUEBl7v1Vh3zs72D12OBSNJxJ0Kdlq4d/c4vveH13gaBnPLY3J6Ft0ruy2H94weJC+5aeUuoOpHJVTLJ6pk0RjC23Haug7UjtPlbRdVJacZal6HXLzMcitk+MbLMJARJBjVxd2uWezQktcZfW4e/dDlWYv6Wl2/Xurx8e+9lVdzaqjrufzZfebv06/dhiudnoXT7MOoLVActfshCgOTyIksFDILz+4c5ppF+97cV/T/0bv1DNglK8ckhi/c/AXLaxbb22A+vqWhBSKCiXMTtrPkjPZYBXnmpGq7WXjv9HwSdw6O5J+0r28mcBKZmfmXfu1lHbxCnkXUEsSjdj9EhYr+YsJ9rRCLITxVQPonAr8eUaWw+mO/Zf+WilgsNzmSxP0v3G8bJNmVIfDVTuMX3+q/YxYBVBCBgZ9nDsBzbpZfYQ6xccFlopToz8LjUi5Ug+yGWVobWy33L2UVdC/DiIGsbZdbrDORSAVLRmCV83qo6zl8Yvfblu3JHO/A7pm3NLTYHhPGEFjYQ2xBrTtIFGXRCKB6WqzLGPTY/0eNqNrZ5fOoatmny9uVNohJLJM3FMi0/kQiO4hKJGZKIQCWr9/3pSfs18Ez1uyzWXbG7pmLiGseWJBVx8Ouas6SC0TuojELj6gG2U25P3X+FB665aGyzqCya5uqZtoR2LR+l16jXJ5mwpkDKWTnxFmZODeR9cy9VEgvZggu7KrmLLlA5C4aARTrQFENcppyX+7p8l5LI4TaTnPPVO5Qn1m67lRGJqEyxUtV+dxnbpdrZdx/scvClGKh7HJ/hogqXTSG8Mby8ywctxNFQCUNs+QusrvmijXlb5tFGQPb/VStgywRxK+6HX+065jt4VY5VG4/m2KH4CrpZ09Uq6LRA9XTwkKaVHMqZZjFqjfl6VefztrHbwkIP9cO7P6NnijVrNl9djPSAIv76u/PBFGNdY2ZZzK3cS56ru/xVPHci0J/9k7Pq5hn6eXYUhfmZCFQCls0AiiiGlUJwyxe1v1bc8WaUIKnYobBLFn0QtkNl9mVPrAa8jt7Mfv5BDEE5/dn7/S8ABT8LL38HEL5WRXZJqJiRWMIj5XIicrGS6/J4GuDgV83lJloxlBfX18mmHIdLsspnRC/6nYM33kga6Hj3HblnvOeZ46HPgTn9LyKeZZejg171mAhbSIqVjR6oLgWHlHZeFkLz6oeVLFCnYlmyplyHS4zlzwQwYodyy2H/Mztyj3nvbvHsfArXw+1d6SQ51XMwtnm7WHPGiykTUTFikYARURlY7XIbq6YBN/ZXYqZaAY/w2UFzUDcLAUvneM1v6eloQUT5/NXZlAoYhLztPC0Fbf79bOwdVBK+dmg2sUhPCIqinmRXTtdS7oCv25FzkTr6/PeLruq6R6qof/6//0TjE6O4k+fGfNUhTw5ksS7F9+1fd/rwtNWnO7X78LWQanIzwZFjutaeCLyJIDbAZxQ1WXpbQkAfwJgPL3b/ar6d24X41p4RNE38NIABl8bxLROIyYxdC3pQu8NvaFcq1JnWvlul3ndPheduzox1PUclu9YhiObj2L5jmUA0kntj5wH9u61PMZtmBVApicqqFl4hSxsHZRK/WxQdXFaC8/LEN4OAI8A+EbO9j9X1S8V2TYiCkC5/lhYXbf3ht7QAqZchcxCDOpZ2Z0n7J+FY37P80ccj7nnmePYvn6+7blVtaDFgu1+DnZtndbpTEJ3WD+/SpihStHmGkCp6j4RWVSCthRu6yngvOl7YyivAaxETpFXrinb1ThVPKg2253n5RMvY/fru/2f36lSuiFdp8oIb45sPpr19amuxbaHtja24uS5k7h397hjABV0jpDTBINCnn01fuYouorJgfq4iBwWkSdF5NLAWkREvpRrynY1ThUPqs125xl8bbCw83tZzy9dMT35i2cBIDN0N7z0EgDAnYMjqf2MXKq1azOHuqVqAOHkCFnlIpn5ffbV+Jmj6Co0gNoO4CoA1wAYBfBlux1F5C4ROSAiB8bHx+12K067zW3YbSeKkHJN2a7GqeJBtdlpaCqI8zsxelqMpP3PDtyUCqqMIEk19c/IhUok8MIf/CCrx+rI5qOZOlUCQUdzBxI3Jqx7ccxlGozvfbTVbYKBn2dTjZ85iq6CIgxVPa6qU6o6DeAJANc77Pu4qq5S1VVtbW2FttPZ5jmpxHGj/pPxevOccK5HVEHshl3CnrJdrusWI6g22+1vV64h8GfS15eqgp7+6jh8lUigc/C2TI/V8h3LsHzHMmxfPx8dzR04vOmw8zn6+7MXWza/9hBYxRfHMbRhyDaI8vNsqvEzR9FVUAAlIubfhPUAjgbTnMKc01jeBBbV1HaiqCvXlO1qnCoeVJvtztO1pKs0z8QIVnKDlltvtdw9tJ+VXWBl0bYg2lCNnzmKLi9lDL4FYC2AeQCOA+hLf38NUrW+fwngblV1nSMbVhkD1NcDU1P52+vqgIsXg78eUYWppFl4lZ7MW+2z8AqVHEninZ5P4uF4s3u7jIWVvTD+huSWYrAozZD7bB7ZPw9Ltv2N7/uoxOdL0eRUxsA1gApSaAHU3LnAhEW9p9ZW4OTJ4K9HVEL8gzHDy7Ootedlvt+WhhaICCbOTTjeu9szMr9/eHO6NII5UHLT1wf096Nz8Dbnn4NIat90b9Vr3X+AM//f/8Sdn77SU1CaHEli64+34uS5kwCA1oZWbPnAFv7PAwUm8gGULqyD/Co/eVMXxCDHLHqmiKpE7rRtIDVkYZvwG2FenkWtPS+r+zWzune3Z5T7vpF8nvzFs6nzmHuWcl+nA6dcj65rw9c3LMz/ORjBmCqSI0nEr7odwMwMw6a6Jqy7el2mNIRRx8rY/t2ffxcXpi9kXate6jFw80BJS3gYbY3q56yWOQVQTBIiqmCctj3Dy7Ootedldb9mVvfu9oxy3390XRseXdc2cx6nmlXpUgudg7cByE5Yz1wjdwkbABDBOz2ftGy/uTTEvbvHs7bnBk8AcFEvsoQHlUQ0FhO26H1y3E5UJThte4aXZ1Frz8vLfeXu4/aMct83Cm+Ksd2cHG4OpkyvHa9hHJ/TU5WpY4WZXq/hpZfgY1usC4TalYzIu35uGYYA1NrnjKxFowdqgc1t2G0nqhKctj3Dy7Ootefl5b5y93F7Rr6eoU0Zg/bmdjy6Lr9sTeYc6Z6qDFOvFTDTc/WxLYtx7/dOZGpXATN1rO793gnLdua11WsyvA+19jkja5GIMHTTHOgD2XWg9IEW6CbWgaLqxmnbM7w8i1p7Xm6Vvq3u3e0ZBVVu4OsbFrqfw9RrZXX+promvP2ZT2D1U6uy6litfmoV3v7MJzArNivvmHqpD/fnnUhknpFRjNRoa1Q/Z2QtEkN4sX3XAs8/P7Oh/xQEgNjURCGqFkZCqpfZPlGfFeTlWfh5Xgavzy2I5+tn9puXa+Teb0tDC85cPIPz06nFQc9OncXLJ1729YwKeYZW7W9tbEVjXSNOnT9lP2Pyo6vxzj8uxsM7V6C9uR3v+eN/h9YfvgyBZB1z7eXXpvOLjqKjuSNre/+L/TgzdQZAqqr6f17ynxH/xjDQf/vMhYx8K9OMv4L19yOeSPWexe+8HV9b347WxlaoKrbs34J3ej6Jy7Z+NdWG9LWcfq7Ge6OTo4hJDNM6nXWPVLkiMQtv+oHWmZzE/lOpHqj0agaxBy3KGxBFDGcFFcbrcwvi+fqd/VbINQZeGsDTrz6dt33j0o3ovaHX0zkK5bf9Bd1vTj6T3TnMM/eObD6K5TuWBff7kDPzMPmLZ/NmLa5+ahWG7zyQmV1od58AbGdR8ve3MkS/jEGjQM5bbG8A5Fzp7o+oXDp3dVquet/R3JFa8oMseX1uQTxft3MEcY33f+P9lsnVMYnhlY++4ukchfLb/jCfqdGTAyATQPk9dxYPhUUfXdeG7evnZ653ZPPRVG6Xw30CsHzPvA9/f8uLZQyIIo6zggrj9bkF8Xz9zn4r5Bp2M9OcZqwFxW/7w3ym5vs1J7MX/PtgJL3nLtgMYMWO5Xh0XRvu3T2elegOABDBUNdzWblS5ra4tYe/v5UtGgFUT4v1YsI9LeVtF1GJcFZQYbw+tyCeb6Cz32zYLWZstz1Iftsf5jM1369RhsHvuf20Yfv6+ZmZg8BMIVBjdqG5Debj3NrD39/KFokAyvw/Bk7biKKq1mafBcXrcyvFQrhBXKNrSZev7UHy2/4wn2moizrn1L6ya4NbG7tXdjvOoqzK39+A621VumjMwntwAtMPtAIABGACOdWcYmZO1TKvzy2I5xvm7DeDkSg++NogpnUaMYmha0lX6AnkgP/2h/1MjZl7gf8+5NS+Ms5oXOuprsWpBPG+Yc/3GZlZeP39pQ2iQiiS6kckksgBYDSxCO36G8iDp6APtGBMLkVH4pehXIuIiMov6qU7wubl+Q28NIDvvPodKFKxwuy62ei7sc/6OZtnKJZCCa4X+STyc4ua0NF/DPLgKQCAPHgKHf3HcG6RfYE5IiKqXkZ5gNHJUSgUo5OjSLyYQHIkWe6mVQUvz88oi2EETwBwZuoMtuzfMrNf7tqGxusaGM6LRADVoPkLSjptJyKi6sYFfYvj5fkNvjZoeaxCZ/azm6EYVgBVQQFbJHKgsHlOKvkJyBTSBAAwiZyIKJJYuqM4Xp6f5wWbS8mc91TqIcMckeiBIiKi2sLSHcXx8vycyl9YHm+eoVgDIhFAjcmlM0HowtQtqaa2ExFR9LB0R3G8PD+78hcCsX7OpR5GK3PAFplZeL/p68BcvJv5/iQuwaX99iXyiSh6OCurtvDnXZzAZ+FFUOTXwhve8xiWHezFbNOCeGe0AUevG8DqO+4O/HpEVHm4oDIRBS3yZQyuPPRwVvAEALPlPK489HCZWkREpcZZWURUSpEIoC7XcZvtb5W4JURULpyVRUSlFIkA6oS02WyfV+KWEFG5cFYWEZVSJAKoN1behzPakLXtjDbgjZX3lalFRFRqnJVFRKXkGkCJyJMickJEjpq2XSYiz4nIz9Nfy1ovYPUdd+PodQMYQxumVTCGNiaQE9WY+OI4Ejcm0NHcAYGgo7mDCeREFBrXWXgisgbAaQDfUNVl6W1fBPCOqm4VkR4Al6rqZ9wuFmYZAyIiIqIgFTULT1X3AXgnZ/M6ADvTr3cC+FAxDSQiIiKqJoXmQM1X1VEASH+9PLgmEREREVW20JPIReQuETkgIgfGx63LDRARERFVk0IDqOMi0gEA6a8n7HZU1cdVdZWqrmprsy43QERERFRNCg2g9gDYlH69CcDuYJpDREREVPm8lDH4FoAfAlgqIm+KyB8D2ArgNhH5OYDb0t+X1fCexzCWuBrTfa0YS1yN4T2PlbtJREREtpIjSXTu6sSKnSvQuasTyZFkuZtEPtS77aCqH7F5698H3JaCZS0mLEA7xtF6sBfDAGtBERFRxcld/Hp0chSJFxMAwNplVSISlci5mDAREVUTLn5d/SIRQHExYSIiqiZc/Lr6RSKA4mLCRERUTbj4dfWLRADFxYSJiKiacPHr6ueaRF4NVt9xN4aRyoW6XN/CCZmHN667jwnkRERUkYxE8W2HtmFscgztze3oXtnNBPIq4rqYcJC4mDARERFVi6IWEyYiIiKibAygiIiIiHxiAEVERETkEwMoIiIiIp8YQBERERH5xACKiIiIyCcGUEREREQ+MYAiIiIi8qmkhTRFZBzAsZAvMw8AVxEuHz7/8uLzLy8+//Li8y+vKD7/hapqueBuSQOoUhCRA3ZVQyl8fP7lxedfXnz+5cXnX1619vw5hEdERETkEwMoIiIiIp+iGEA9Xu4G1Dg+//Li8y8vPv/y4vMvr5p6/pHLgSIiIiIKWxR7oIiIiIhCVbUBlIh8UEReFZHXRaTH4n0Rka+m3z8sIivL0c6o8vD814rIhIj8JP3vgXK0M4pE5EkROSEiR23e52c/RB6ePz/7IRKRK0Xkf4vIz0TkpyLSbbEPfwdC4vH518TvQH25G1AIEakD8JcAbgPwJoBhEdmjqv9o2u0/Afjt9L8PANie/kpF8vj8AWC/qt5e8gZG3w4AjwD4hs37/OyHawecnz/Az36YLgL4lKoeEpH3ADgoIs/xv/8l4+X5AzXwO1CtPVDXA3hdVUdU9TyAbwNYl7PPOgDf0JSXAMwVkY5SNzSivDx/Comq7gPwjsMu/OyHyMPzpxCp6qiqHkq//lcAPwPwvpzd+DsQEo/PvyZUawD1PgBvmL5/E/k/QC/7UGG8Ptt/KyKviMj/FJH/szRNI/CzXwn42S8BEVkE4FoAP8p5i78DJeDw/IEa+B2oyiE8AGKxLXc6oZd9qDBenu0hpErgnxaR3wPwPaS60yl8/OyXFz/7JSAicwD8LYA/U9VTuW9bHMLfgQC5PP+a+B2o1h6oNwFcafr+CgD/UsA+VBjXZ6uqp1T1dPr13wGYJSLzStfEmsbPfhnxsx8+EZmF1B/vv1bV71rswt+BELk9/1r5HajWAGoYwG+LyG+JSAOADwPYk7PPHgAfTc/GuAHAhKqOlrqhEeX6/EWkXUQk/fp6pD5rb5e8pbWJn/0y4mc/XOln+1cAfqaqX7HZjb8DIfHy/Gvld6Aqh/BU9aKIfBzA/wJQB+BJVf2piPxp+v2vAfg7AL8H4HUA7wL4o3K1N2o8Pv8NAO4RkYsAzgD4sLJqayBE5FsA1gKYJyJvAugDMAvgZ78UPDx/fvbDdROAOwEcEZGfpLfdD2ABwN+BEvDy/Gvid4CVyImIiIh8qtYhPCIiIqKyYQBFRERE5BMDKCIiIiKfGEARERER+cQAioiIiCLFbdHvnH3/3LTw8WsictLTNTgLj4iIiKJERNYAOI3UmojLfBz3CQDXqurH3PZlDxQRERFFitWi3yJylYh8X0QOish+Efkdi0M/AuBbXq5RlYU0iYiIiHx6HMCfqurPReQDAB4F8LvGmyKyEMBvAfgHLydjAEVERESRll78+EYAg+lVZgCgMWe3DwPYpapTXs7JAIqIiIiiLgbgpKpe47DPhwH8335OSERERBRZqnoKwD+LSBeQWhRZRN5vvC8iSwFcCuCHXs/JAIqIiIgiJb3o9w8BLBWRN0XkjwH8FwB/LCKvAPgpgHWmQz4C4Nt+Fj1mGQMiIiIin9gDRUREROQTAygiIiIinxhAEREREfnEAIqIiIjIJwZQRERERD4xgCIiIiLyiQEUERERkU8MoIiIiIh8+v8BWnvAIBLw0tYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 720x360 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "fig = plt.figure(figsize=(10, 5))\n",
    "ax = fig.add_subplot(1, 1, 1)\n",
    "ax.plot(X_train, y_train, 'o', label='Train Data')  # 데이터 분포\n",
    "ax.plot(X_test, y_hat_test, 'r+', label='Predicted Value') # 모형이 학습한 회귀선\n",
    "ax.legend(loc='best')\n",
    "plt.xlabel('weight')\n",
    "plt.ylabel('mpg')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}