Analysis of Community Interactions using Spark GraphX

Analysis of Community Interactions using Spark GraphX

The goal of this spark project is to analyse the level and strength of interactions across areas of coverage of a telecom provider between different areas in the city of Milan.
explanation image

Videos

Each project comes with 2-5 hours of micro-videos explaining the solution.

ipython image

Code & Dataset

Get access to 50+ solved projects with iPython notebooks and datasets.

project experience

Project Experience

Add project experience to your Linkedin/Github profiles.

Customer Love

Read All Reviews
profile image

Mike Vogt linkedin profile url

Information Architect at Bank of America

I have had a very positive experience. The platform is very rich in resources, and the expert was thoroughly knowledgeable on the subject matter - real world hands-on experience. I wish I had this... Read More

profile image

Mohamed Yusef Ahmed linkedin profile url

Software Developer at Taske

Recently I became interested in Hadoop as I think its a great platform for storing and analyzing large structured and unstructured data sets. The experts did a great job not only explaining the... Read More

What will you learn

Introduction to Graphs and why are they essential
Simple Graphs, BIpirate Graphs, Directed, Undirected graphs, Multi Graphs and Property Graphs
Understanding Apache Spark
Understanding Hadoop MapReduce framework
Introduction to Spark GraphX
Visualizations restrictions related to Spark GraphX
The use case for Graph storage and Graph processing
Building a graph structure from our dataset
Downloading the dataset and performing basic EDA
Visualizing edges and nodes of the graph by writing queries in Scala
Use of Spark GraphX graph operators
Analysis of graph using GraphX
Exploring functions and features of Spark GraphX
Performing parallel algorithmic computing like page rank on Graph using GraphX

Project Description

For all telecommunication providers, using the call details record (CDR), it is quite easy to measure the level and strength of interaction across areas of coverage. Such measurement enables the providers to make further decisions regarding sales, promotions and engineering details to improve the quality of service amongst other things.

In this spark graphx project, we will be doing an analysis of the level and strength of interactions between different areas in the city of Milan. Our dataset for this big data project include datasets from Dandelion Open big data website which contains aggregated anonymized call records based on the calls exchanged between Telecom Italia Mobile users.

Similar Projects

Design a Network Crawler by Mining Github Social Profiles

In this big data project, we will look at how to mine and make sense of connections in a simple way by building a Spark GraphX Algorithm and a Network Crawler.

View Project Details

Neo4j Project using Yelp dataset to analyse ratings from users

In this Neo4j project, you will do network analysis using a graph database to find patterns on how a social network affects business reviews and ratings.

View Project Details

Curriculum For This Mini Project

23-Oct-2016
03h 33m
24-Oct-2016
01h 49m