1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com
pyspark-learn-to-use-apache-spark-with-python.jpg

PySpark Tutorial - Learn to use Apache Spark with Python

PySpark Project-Get a handle on using Python with Spark through this hands-on data processing spark python tutorial.

Users who bought this project also bought

What will you learn

  • What is PySpark?
  • Installing and Configuring PySpark
  • Basic Interaction with Spark Shell using Python API- PySpark
  • Explaining Transformation and Actions using PySpark
  • Learn about logistic regression machine learning model using PySpark as a tool.

What will you get

  • Access to recording of the complete project
  • Access to all material related to project like data files, solution files etc.

Project Description

This series of PySpark project will look at installing Apache Spark on the cluster and explore various data analysis tasks using PySpark for various big data and data science applications.

This video PySpark tutorial explains various transformations and actions that can be performed using PySpark with multiple examples.

Curriculum For This Mini Project

 
  Overview of Project
00:00:48
  What is PySpark
00:01:02
  Install PySpark
00:05:45
  Handshake between Python and Spark
00:12:19
  RDD - Resilient Distributed Data
00:03:23
  RDD operations
00:07:33
  Basic Statistics using PySpark
00:03:30
  Recap
00:02:53
  Basic Statistical Test
00:06:10
  Calculate Correlation
00:02:00
  Chi Squared Test
00:03:28
  Implement Machine Learning
00:09:52
  Logistic Regression Model
00:11:25