SpaceX_Machine Learning Prediction_Part_5.ipynb

{"cells":[{"cell_type":"markdown","metadata":{},"source":["<p style=\"text-align:center\">\n","    <a href=\"https://skills.network/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDS0321ENSkillsNetwork26802033-2022-01-01\" target=\"_blank\">\n","    <img src=\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/assets/logos/SN_web_lightmode.png\" width=\"200\" alt=\"Skills Network Logo\"  />\n","    </a>\n","</p>\n"]},{"cell_type":"markdown","metadata":{},"source":["# **Space X  Falcon 9 First Stage Landing Prediction**\n"]},{"cell_type":"markdown","metadata":{},"source":["## Assignment:  Machine Learning Prediction\n"]},{"cell_type":"markdown","metadata":{},"source":["Estimated time needed: **60** minutes\n"]},{"cell_type":"markdown","metadata":{},"source":["Space X advertises Falcon 9 rocket launches on its website with a cost of 62 million dollars; other providers cost upward of 165 million dollars each, much of the savings is because Space X can reuse the first stage. Therefore if we can determine if the first stage will land, we can determine the cost of a launch. This information can be used if an alternate company wants to bid against space X for a rocket launch.   In this lab, you will create a machine learning pipeline  to predict if the first stage will land given the data from the preceding labs.\n"]},{"cell_type":"markdown","metadata":{},"source":["![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/landing\\_1.gif)\n"]},{"cell_type":"markdown","metadata":{},"source":["Several examples of an unsuccessful landing are shown here:\n"]},{"cell_type":"markdown","metadata":{},"source":["![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/crash.gif)\n"]},{"cell_type":"markdown","metadata":{},"source":["Most unsuccessful landings are planed. Space X; performs a controlled landing in the oceans.\n"]},{"cell_type":"markdown","metadata":{},"source":["## Objectives\n"]},{"cell_type":"markdown","metadata":{},"source":["Perform exploratory  Data Analysis and determine Training Labels\n","\n","*   create a column for the class\n","*   Standardize the data\n","*   Split into training data and test data\n","\n","\\-Find best Hyperparameter for SVM, Classification Trees and Logistic Regression\n","\n","*   Find the method performs best using test data\n"]},{"cell_type":"markdown","metadata":{},"source":[]},{"cell_type":"markdown","metadata":{},"source":["***\n"]},{"cell_type":"markdown","metadata":{},"source":["## Import Libraries and Define Auxiliary Functions\n"]},{"cell_type":"markdown","metadata":{},"source":["We will import the following libraries for the lab\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["# Pandas is a software library written for the Python programming language for data manipulation and analysis.\n","import pandas as pd\n","# NumPy is a library for the Python programming language, adding support for large, multi-dimensional arrays and matrices, along with a large collection of high-level mathematical functions to operate on these arrays\n","import numpy as np\n","# Matplotlib is a plotting library for python and pyplot gives us a MatLab like plotting framework. We will use this in our plotter function to plot data.\n","import matplotlib.pyplot as plt\n","#Seaborn is a Python data visualization library based on matplotlib. It provides a high-level interface for drawing attractive and informative statistical graphics\n","import seaborn as sns\n","# Preprocessing allows us to standarsize our data\n","from sklearn import preprocessing\n","# Allows us to split our data into training and testing data\n","from sklearn.model_selection import train_test_split\n","# Allows us to test parameters of classification algorithms and find the best one\n","from sklearn.model_selection import GridSearchCV\n","# Logistic Regression classification algorithm\n","from sklearn.linear_model import LogisticRegression\n","# Support Vector Machine classification algorithm\n","from sklearn.svm import SVC\n","# Decision Tree classification algorithm\n","from sklearn.tree import DecisionTreeClassifier\n","# K Nearest Neighbors classification algorithm\n","from sklearn.neighbors import KNeighborsClassifier"]},{"cell_type":"markdown","metadata":{},"source":["This function is to plot the confusion matrix.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["def plot_confusion_matrix(y,y_predict):\n","    \"this function plots the confusion matrix\"\n","    from sklearn.metrics import confusion_matrix\n","\n","    cm = confusion_matrix(y, y_predict)\n","    ax= plt.subplot()\n","    sns.heatmap(cm, annot=True, ax = ax); #annot=True to annotate cells\n","    ax.set_xlabel('Predicted labels')\n","    ax.set_ylabel('True labels')\n","    ax.set_title('Confusion Matrix'); \n","    ax.xaxis.set_ticklabels(['did not land', 'land']); ax.yaxis.set_ticklabels(['did not land', 'landed'])"]},{"cell_type":"markdown","metadata":{},"source":["## Load the dataframe\n"]},{"cell_type":"markdown","metadata":{},"source":["Load the data\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["data = pd.read_csv(\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_2.csv\")\n","\n","# If you were unable to complete the previous lab correctly you can uncomment and load this csv\n","\n","# data = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/dataset_part_2.csv')\n","\n","data.head()"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["X = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_3.csv')\n","\n","# If you were unable to complete the previous lab correctly you can uncomment and load this csv\n","\n","# X = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/dataset_part_3.csv')\n","\n","X.head(100)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  1\n"]},{"cell_type":"markdown","metadata":{},"source":["Create a NumPy array from the column <code>Class</code> in <code>data</code>, by applying the method <code>to_numpy()</code>  then\n","assign it  to the variable <code>Y</code>,make sure the output is a  Pandas series (only one bracket df\\['name of  column']).\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["## TASK  2\n"]},{"cell_type":"markdown","metadata":{},"source":["Standardize the data in <code>X</code> then reassign it to the variable  <code>X</code> using the transform provided below.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["# students get this \n","transform = preprocessing.StandardScaler()"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["We split the data into training and testing data using the  function  <code>train_test_split</code>.   The training data is divided into validation data, a second set used for training  data; then the models are trained and hyperparameters are selected using the function <code>GridSearchCV</code>.\n"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  3\n"]},{"cell_type":"markdown","metadata":{},"source":["Use the function train_test_split to split the data X and Y into training and test data. Set the parameter test_size to  0.2 and random_state to 2. The training data and test data should be assigned to the following labels.\n"]},{"cell_type":"markdown","metadata":{},"source":["<code>X_train, X_test, Y_train, Y_test</code>\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["we can see we only have 18 test samples.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["Y_test.shape"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  4\n"]},{"cell_type":"markdown","metadata":{},"source":["Create a logistic regression object  then create a  GridSearchCV object  <code>logreg_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["parameters ={'C':[0.01,0.1,1],\n","             'penalty':['l2'],\n","             'solver':['lbfgs']}"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["parameters ={\"C\":[0.01,0.1,1],'penalty':['l2'], 'solver':['lbfgs']}# l1 lasso l2 ridge\n","lr=LogisticRegression()\n"]},{"cell_type":"markdown","metadata":{},"source":["We output the <code>GridSearchCV</code> object for logistic regression. We display the best parameters using the data attribute <code>best_params\\_</code> and the accuracy on the validation data using the data attribute <code>best_score\\_</code>.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["print(\"tuned hpyerparameters :(best parameters) \",logreg_cv.best_params_)\n","print(\"accuracy :\",logreg_cv.best_score_)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  5\n"]},{"cell_type":"markdown","metadata":{},"source":["Calculate the accuracy on the test data using the method <code>score</code>:\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["Lets look at the confusion matrix:\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["yhat=logreg_cv.predict(X_test)\n","plot_confusion_matrix(Y_test,yhat)"]},{"cell_type":"markdown","metadata":{},"source":["Examining the confusion matrix, we see that logistic regression can distinguish between the different classes.  We see that the major problem is false positives.\n"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  6\n"]},{"cell_type":"markdown","metadata":{},"source":["Create a support vector machine object then  create a  <code>GridSearchCV</code> object  <code>svm_cv</code> with cv - 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["parameters = {'kernel':('linear', 'rbf','poly','rbf', 'sigmoid'),\n","              'C': np.logspace(-3, 3, 5),\n","              'gamma':np.logspace(-3, 3, 5)}\n","svm = SVC()"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["print(\"tuned hpyerparameters :(best parameters) \",svm_cv.best_params_)\n","print(\"accuracy :\",svm_cv.best_score_)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  7\n"]},{"cell_type":"markdown","metadata":{},"source":["Calculate the accuracy on the test data using the method <code>score</code>:\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["We can plot the confusion matrix\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["yhat=svm_cv.predict(X_test)\n","plot_confusion_matrix(Y_test,yhat)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  8\n"]},{"cell_type":"markdown","metadata":{},"source":["Create a decision tree classifier object then  create a  <code>GridSearchCV</code> object  <code>tree_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["parameters = {'criterion': ['gini', 'entropy'],\n","     'splitter': ['best', 'random'],\n","     'max_depth': [2*n for n in range(1,10)],\n","     'max_features': ['auto', 'sqrt'],\n","     'min_samples_leaf': [1, 2, 4],\n","     'min_samples_split': [2, 5, 10]}\n","\n","tree = DecisionTreeClassifier()"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["print(\"tuned hpyerparameters :(best parameters) \",tree_cv.best_params_)\n","print(\"accuracy :\",tree_cv.best_score_)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  9\n"]},{"cell_type":"markdown","metadata":{},"source":["Calculate the accuracy of tree_cv on the test data using the method <code>score</code>:\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["We can plot the confusion matrix\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["yhat = svm_cv.predict(X_test)\n","plot_confusion_matrix(Y_test,yhat)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  10\n"]},{"cell_type":"markdown","metadata":{},"source":["Create a k nearest neighbors object then  create a  <code>GridSearchCV</code> object  <code>knn_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["parameters = {'n_neighbors': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n","              'algorithm': ['auto', 'ball_tree', 'kd_tree', 'brute'],\n","              'p': [1,2]}\n","\n","KNN = KNeighborsClassifier()"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["print(\"tuned hpyerparameters :(best parameters) \",knn_cv.best_params_)\n","print(\"accuracy :\",knn_cv.best_score_)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  11\n"]},{"cell_type":"markdown","metadata":{},"source":["Calculate the accuracy of tree_cv on the test data using the method <code>score</code>:\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["We can plot the confusion matrix\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":["yhat = knn_cv.predict(X_test)\n","plot_confusion_matrix(Y_test,yhat)"]},{"cell_type":"markdown","metadata":{},"source":["## TASK  12\n"]},{"cell_type":"markdown","metadata":{},"source":["Find the method performs best:\n"]},{"cell_type":"code","execution_count":null,"metadata":{},"outputs":[],"source":[]},{"cell_type":"markdown","metadata":{},"source":["## Authors\n"]},{"cell_type":"markdown","metadata":{},"source":["<a href=\"https://www.linkedin.com/in/joseph-s-50398b136/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDS0321ENSkillsNetwork26802033-2022-01-01\">Joseph Santarcangelo</a> has a PhD in Electrical Engineering, his research focused on using machine learning, signal processing, and computer vision to determine how videos impact human cognition. Joseph has been working for IBM since he completed his PhD.\n"]},{"cell_type":"markdown","metadata":{},"source":["## Change Log\n"]},{"cell_type":"markdown","metadata":{},"source":["| Date (YYYY-MM-DD) | Version | Changed By    | Change Description      |\n","| ----------------- | ------- | ------------- | ----------------------- |\n","| 2021-08-31        | 1.1     | Lakshmi Holla | Modified markdown       |\n","| 2020-09-20        | 1.0     | Joseph        | Modified Multiple Areas |\n"]},{"cell_type":"markdown","metadata":{},"source":["Copyright © 2020 IBM Corporation. All rights reserved.\n"]}],"metadata":{"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.8.8"}},"nbformat":4,"nbformat_minor":4}