Recap of Hadoop News for December

Recap of Hadoop News for December


News on Hadoop-December 2016

Hadoop News December

Telefonica Gains Real-Time Advantage With Big Data Analytics.Forbes.com,December 5, 2016.

A leading telecommunications company Telefonica in Spain with 3 million customers and more than 17 million mobile customers is making huge profits from Big Data and Business Intelligence . With the help of Big Data and Business Intelligence the company is now able to analyze the preferences of its audience and improve customer satisfaction. With its big data investments Telefonica now builds a customer recommendation profile that gets updated every 24 hours and this result is fed to the real-time TV environment.Telefonica Spain can now recommend personalized programs to a viewer in a specifc time period and context.

(Source:  http://www.forbes.com/sites/oracle/2016/12/05/telefonica-gains-real-time-advantage-with-big-data-analytics/#3f2b69ad4e31 )

Hadoop Online Course

If you would like more information about Big Data Training, please click the orange "Request Info" button on top of this page.

How These Startups Plan to Use Big Data to Transform Women's Health.Fortune.com, December 5,2016.

Companies like ColorGenomics  are using genetic testing to identify customer’s risk of developing different types of cancers. The Vice president of Glow ,Jennifer Tye, says that they need gender specific perspective on lot of different diseases. Glow has developed an app which allows to track the menstrual cycles. She also says that they need more data related to fertility. They are very much anxious to know what the app might do and what they may be able to learn from the aggregated data. 

(Source:  http://fortune.com/2016/12/05/glow-color-genomics-big-data/)

For the complete list of big data companies and their salaries- CLICK HERE

Journey Analytics: A Killer App for Big Data?. Datanami.com, December 6,2016. 

Journey Analytics , an application using big data and advanced analytic technologies helps companies optimize customer interactions to predict future behaviors.Journey Analytics has its own product category with no less than 42 vendors creating tools which tackle various problems like journey automation, journey testing, journey design and data fusion.

(Source: https://www.datanami.com/2016/12/06/journey-analytics-killer-app-big-data/)

Leveraging the Cloud for Big Data Analytics.Healthcareitnews.com, December 13,2016.

A multinational manufacturer of medical devices and bioinformatics, pharmaceutical and consumer health products is focussing prevention, interception and cure for diseases by analysing big data in the cloud. According to the CTO and Vice President of the company-data science is making a transformational impact on health. The manufacturer has diverse types of data- structured, unstructured, voice, image and video datasets on which advanced analytics and data science techniques are leveraged.The manufacturers hybrid cloud architecture runs over 120 applications and is able to make faster, quicker and better decisions.

(Source: http://www.healthcareitnews.com/sponsored-content/leveraging-cloud-big-data-analytics)

Industry's Most Comprehensive Big Data Maturity Survey Reveals Surprising State of Hadoop, Dramatic Rise of Big Data in the Cloud.Yahoo.com,December 14,2016.

AtScale announced the results of 2016 Big data Maturity survey. The survey was conducted in across 77 countries at 1,400 companies and more than 2,550 big data professionals participated in the survey.The survey reveals an increasing surge in cloud deployments for big data. With more than 50% of organizations already deploying big data in the cloud, the survey found that 72% plan to deploy in future. One in five respondents to the survey are using more than 100 nodes, of which 74% are in production.The survey also revealed that BI is the number one workload for big data.2017 might be the year of BI on big data as 75% respondents to the survey plan to use BI on Big Data.

(Source: http://finance.yahoo.com/news/industrys-most-comprehensive-big-data-133000994.html )

The Impact Of Big Data, Open Source On Oil And Gas.epmag.com,December 28,2016.

The breeze of Open Source technologies combined with high pressure wave from analytics has created a storm, which has transformed the whole IT industry and the perspective with which we have been seeing the data. There is no industry which not have been touched by open source technology specifically Hadoop. The most recent being the Oil and Gas Industry, which is the most critical, accident prone, and amalgamation of varied technologies. This creates the native environment for Hadoop, as we all know, the power lies in processing of all types of data. As the oil and gas industry is growing at a very higher rate, the velocity of data has grown too and the need to have a consolidated view of all the data sets from all sorts of world, like legacy databases, sensors, IT, external sources, etc., has pushed this industry to shift to open source analytics technologies like Hadoop, which has helped them to identify potential failures 3 to 4 times faster. Apart from this, using these technologies, companies are able to monitor safety critical equipment deployed in offshore ships, encrypt system data and transmit it, which are located in remote areas connected to a very minimal network bandwidth in real time.

(Source: http://www.epmag.com/impact-big-data-open-source-oil-and-gas-1454511)

Big data analytics will help bridge India's tax gap.Economictimes.com,December 28,2016.

The future of every country lies in their government and the people living in that country. A major contribution in the country’s development is the revenue generated from taxes. The world largest democratic country, India, have the lowest tax revenue as a % of GDP within BRICS. If we estimate, then only 4-5% of India’s total population pays tax. But, various policies like Benami Property Act, demonetization, GST, Jan Dhan, and Aadhar, will help revenue department in collecting data at a very high speed. But gathering data alone will not help in providing a win-win environment for everyone unless there is vision, a proper approach for making this data intelligent. Emergence of new technologies like Big Data and Hadoop, and analytics will help in co-locating all the data and generate insight from that data which in turn will help the tax departments in distressing the malpractices like circular trading, transfer pricing manipulations, hawala, sales under declarations etc.

(Source:http://economictimes.indiatimes.com/news/economy/indicators/big-data-analytics-will-help-bridge-indias-tax-gap-heres-how/articleshow/56214309.cms)

PREVIOUS

Online Hadoop Training

Relevant Projects

Yelp Data Processing using Spark and Hive Part 2
In this spark project, we will continue building the data warehouse from the previous project Yelp Data Processing Using Spark And Hive Part 1 and will do further data processing to develop diverse data products.

Explore features of Spark SQL in practice on Spark 2.0
The goal of this spark project for students is to explore the features of Spark SQL in practice on the latest version of Spark i.e. Spark 2.0.

Data Mining Project on Yelp Dataset using Hadoop Hive
Use the Hadoop ecosystem to glean valuable insights from the Yelp dataset. You will be analyzing the different patterns that can be found in the Yelp data set, to come up with various approaches in solving a business problem.

Data Warehouse Design for E-commerce Environments
In this hive project, you will design a data warehouse for e-commerce environments.

Finding Unique URL's using Hadoop Hive
Hive Project -Learn to write a Hive program to find the first unique URL, given 'n' number of URL's.

Hive Project - Visualising Website Clickstream Data with Apache Hadoop
Analyze clickstream data of a website using Hadoop Hive to increase sales by optimizing every aspect of the customer experience on the website from the first mouse click to the last.

Data processing with Spark SQL
In this Apache Spark SQL project, we will go through provisioning data for retrieval using Spark SQL.

Create A Data Pipeline Based On Messaging Using PySpark And Hive - Covid-19 Analysis
In this PySpark project, you will simulate a complex real-world data pipeline based on messaging. This project is deployed using the following tech stack - NiFi, PySpark, Hive, HDFS, Kafka, Airflow, Tableau and AWS QuickSight.

Movielens dataset analysis using Hive for Movie Recommendations
In this hadoop hive project, you will work on Hive and HQL to analyze movie ratings using MovieLens dataset for better movie recommendation.

Implementing Slow Changing Dimensions in a Data Warehouse using Hive and Spark
Hive Project- Understand the various types of SCDs and implement these slowly changing dimesnsion in Hadoop Hive and Spark.



Tutorials