News on Hadoop - August 2018
Apache Hadoop: A Tech Skill That Can Still Prove Lucrative.Dice.com, August 2, 2018.
In 2017, Gartner announced that organizations were spending close to $800 million on Hadoop distributions , even though only 14% of companies reported that they were relying on hadoop technology.However, several studies have revealed that the adoption and spending on hadoop technology continues to rise high through last year.Dice analysis demonstrates that jobs that intersect with Hadoop and other data analysis platforms really pay off well in terms of salary.However, to land that sort of a top gig for hadoop skills you need to have a right mix of certifications and hands-on experience.Some of the highest paying jobs according to Dice analysis that use Apache Hadoop are - Backend Developer, Big Data Developer, Data Architect, Data Analyst, Data Engineer, DevOps, Data Scientist,Machine Learning Engineer and Python Developer.
(Source - https://insights.dice.com/2018/08/02/apache-hadoop-tech-skill-still-lucrative/ )
Ab fab – Edwards turns to Hadoop in push for smarter semiconductor factories.Diginomica,August 9, 2018
Semiconductor fabrication plants (or ‘fabs’) are among some of the smartest factories in the world.Edwards that builds critical subsystems used in chipmakers fabrication plants is using MapR’s Hadoop distribution as the foundation for predictive maintenance and more.It is using hadoop to develop a big data platform that will analyse data from its equipments located at customer sites across the globe. This will enable the company to provide them with real-time anomaly detection and predictive maintenance services.Apache Hadoop is the right choice for this project as there is large volumes of data involved, each medium-sized semiconductor plant can have as many as 4000 pieces of Edwards equipment inside and a big fab around 8000 or more.
(Source - https://diginomica.com/2018/08/09/ab-fab-edwards-turns-to-hadoop-in-push-for-smarter-semiconductor-factories/ )
Small banks need big data to maintain customer service edge. Americanbanker.com, August 21, 2018.
Big data is not only for big banks.Customers today need advanced internet banking and mobile banking options, and to deliver such services even the smallest banks need to get access to customer data.Origin, a $4.2 billion-asset institution is creating omnichannel for its customers to provide them with the ability to do banking from any channel of their preference. Origin is planning to create a central hub for its customers by providing its customers with the ability to see not just Origin bank accounts but also other external bank accounts through their mobile app. This will help customers save the amount of time they spend on various bank environments whilst continuing to control their finances in an organized way.
(Source -https://www.americanbanker.com/news/small-banks-need-big-data-to-maintain-customer-service-edge )
How Shopin is changing big data in online retail through Blockchain. Cryptovest.com, August 21, 2018.
Big data today is an extremely valuable tool for all online retailers but as big data enters mainstream, customers are becoming cautious about the data they share online. Brooklyn-based blockchain startup Shopin provides its customers with the ownership of their purchase history by allowing them to create a universal shopping profile which is stored on the Blockchain.The customers have complete control over their data and can decide on what information they want to share with the retailers. Shopin rewards its customers with Shopin crypto tokens for sharing their personal data. Shopin recently partnered with two popular retailer Bed Bath & Beyond and Ermenegildo Zegna for a demo pilot program. Existing customers of both the retailers were asked to create Shopin profiles that resulted in 719,000 sign-ups.Shopin has helped both the retailers achieve 22% conversions in sales, resulting in $14.7 million additional sales and 65K new customers joining the retailers directly through Shopin profile.
(Source -https://cryptovest.com/news/how-shopin-is-changing-big-data-in-online-retail--through-blockchain/ )
Candy Crush maker King in Hadoop cluster move to Google Cloud.ComputerWeekly.com, August 22, 2018.
The Candy Crush maker King whose games are played across the globe by more than 270 million people operate’s Europe’s largest Hadoop cluster that data engineers and data scientists use for processing petabytes of data generated by players of its games.Data analysis of player behavior plays a vital role in helping the company stay ahead of its competitors.The major challenge in the gaming industry is to speed, both in terms of the ability to act quickly on player feedback and also to scale with increase in the number of games and players.The company has been evaluating since quite a while on whether to run an on-premise hadoop cluster for quick insights or move to the public cloud for advancing big data capabilities.After weighing on several public cloud options, the company decided to move to the Google Cloud Platform for innovation in machine learning, query processing and speed.
(Source - https://www.computerweekly.com/news/252447221/Candy-Crush-maker-King-in-Hadoop-cluster-move-to-Google-Cloud)
India gears up for big data: DoT to send officers to China for training.IndianExpress.com, August 23, 2018.
DoT (Department of Telecommunications) is gearing up to prepare it’s officers for the impending adoption of analytics and its relevance in telecom sector. DoT has proposed the adoption of emerging technologies such as IoT, Robotics, AI , Cloud Computing and machine-to-machine communications. By end of 2022, the IoT ecosystem is likely to expand to 5 billion connected devices within the country.DoT policy proposed training and re-skilling of one million people in new age technolgoies.As an initiative for re-skilling, DoT will send its officials to China for a training course on understanding the influence of big data and its applications.Officials plant to visit the headquarters of e-commerce giant Alibaba in China for a training session on application of financial risk control and telecom equipment firm Huawei for a training session on applications of public security based on big data.
(Source - https://indianexpress.com/article/technology/tech-news-technology/india-gears-up-for-big-data-dot-to-send-officers-to-china-for-training-5319998/ )