AndreBluhm / Project_Data-Analysis-PySpark Public

Notifications You must be signed in to change notification settings
Fork 3
Star 2

Guided Project using PySpark for Data-Analysis from Coursera.

2 stars 3 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 12 Commits
Coursera_Cleaning-and-Exploring-Big-Data-using-PySpark.png		Coursera_Cleaning-and-Exploring-Big-Data-using-PySpark.png
Coursera_Cleaning-and-Exploring-BigData-using-PySpark.pdf		Coursera_Cleaning-and-Exploring-BigData-using-PySpark.pdf
Data_Analysis_PySpark.ipynb		Data_Analysis_PySpark.ipynb
README.md		README.md

Repository files navigation

Project: Cleaning and Exploring Big Data using PySpark

Task 1 - Install Spark on Google Colab and load datasets in PySpark
Task 2 - Change column datatype, remove whitespaces and drop duplicates
Task 3 - Remove columns with Null values higher than a threshold
Task 4 - Group, aggregate and create pivot tables
Task 5 - Rename categories and impute missing numeric values
Task 6 - Create visualizations to gather insights

About

Guided Project using PySpark for Data-Analysis from Coursera.

big-data coursera pyspark

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%