geowynn / Pyspark-1.6-for-Beginners Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Introductory jupyter notebook for Pyspark 1.6

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.gitignore		.gitignore
Intro+to+Pyspark+1.6.ipynb		Intro+to+Pyspark+1.6.ipynb
LICENSE		LICENSE
README.md		README.md
cogsley_clients.csv		cogsley_clients.csv
cogsley_sales.csv		cogsley_sales.csv
state_info.csv		state_info.csv

Repository files navigation

Pyspark-1.6-for-Beginners

Introductory jupyter notebook for Pyspark 1.6

Contents

EDA & Getting to know some basic Pyspark 1.6 commands

Some extra functions similar to SQL and Pandas Aggregation Joining tables

MLLib

Linear Regression

Visualisation

Convert spark df to pandas df to use matplotlib/seaborn

Setting up Spark

Connecting to Jupyter notebook

About

Introductory jupyter notebook for Pyspark 1.6

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%