Apache Hadoop was one of the revolutionary technology in the big data space but now it is buried deep by Deep Learning. According to Forrester Research report, declared in March 2017, artificial intelligence will eclipse hadoop. After Hortonworks, now the big guy in the big data world - Cloudera is going public but not as a hadoop distribution platform. Cloudera has shown its excitement and interest in presenting itself as a modern platform for data management , machine learning and advanced data analytics.
(Source : https://www.forbes.com/sites/gilpress/2017/04/03/ai-will-eclipse-hadoop-says-forrester-so-cloudera-files-for-ipo-as-a-machine-learning-platform/#231f41065aa4 )
If you would like more information about Big Data and Hadoop Training, please click the orange "Request Info" button on top of this page.
Commonwealth Bank of Australia recently launched a new business analytics platform for small to medium enterprises that provide them access to big data. The new platform named Daily IQ 2.0 combines various online tools and data feeds from the banks pool of 1.2 billion monthly transaction records. SME’s can use this platform to model any future scenarios depending on the current financial and industry data along with monitoring the performance in real-time. The platform will allow SME’s to check what their competitors are up to and also help them track the spending patterns and behavior of customers.
(Source : http://www.zdnet.com/article/commonwealth-bank-targets-smes-with-new-big-data-analytics-platform/ )
GREAT Zimbabwe University is hosting a 7 day Indian analytics expert camp that will help local academics and industry experts analyse data to nurture growth in organizations for profitable decision making. The bootcamp will be facilitated by an Indian Expert Sai Kumar at the Zimbabwe Centre for High Performance Computing. The bootcamp has already attracted 32 participants from industry and academia. The participants will be introduced to Hadoop World software for computing and analysing data that will help them in the organization's growth.
(Source : https://www.newsday.co.zw/2017/04/05/gzu-partners-indian-expert-big-data-analytics/ )
Despite the hype around NoSQL, SQL is still the go-to query language for relational databases and other emerging novel database technologies. One of the fastest growing use case for SQL is its application on top of hadoop clusters. Hortonworks unveiled this use case of SQL through Apache Hive 2.0 with Live Long Process (LLP) capabilities that runs within memory. Hortonworks HDP 2.6 offers all the advantages of SQL running on a hadoop distribution platform that can handle order of magnitude more data. Hive 2.0 LLP runs in-memory so any query against the data can now be processed in sub-second of time.
(Source : http://www.itbusinessedge.com/blogs/it-unmasked/hortonworks-processes-sql-in-memory-on-hadoop.html )
IBM Corporation has come up with various ways to solve storage issues that will help them stay ahead in this competitive big data world. One such storage solution IBM has come up with is the Hadoop connector on its spectrum scale offering that lets hadoop users run directly on it. IBM has partnered with Hortonworks which certifies Spectrum Scale so that customers will have more confidence in theri storage solutions.
(Source : http://siliconangle.com/blog/2017/04/05/making-sense-data-ibms-take-hadoop-enterprise-storage-dws17/ )
At a recent Gartner Data & Analytics Summit in Sydney, research director Nick Heudecker said that 70% of hadoop deployments are likely to fail in delivering the predicted revenue in 2017. The reason for this is that organizations are finding it difficult to find the required engineering skills and big data experience required to implement big data solutions on hadoop stack.Hadoop ecosystem has a bag of carpentry tools that organizations can leverage but require a highly skilled construction team to implement a complete big data solution. Thus, companies are moving to modern data lake platforms where they just need to furnish the hadoop data lake with data and can easily leverage the power of Hadoop and Spark technologies for analytics.
(Source : http://www.information-age.com/hadoop-rise-modern-data-lake-platform-123465542/ )
A new major version of the fiery beast in the big data space Hadoop 3.0 has been in its alpha stage for past few months. The major enhancements around Hadoop 3.0 are around resource management, replication in HDFS and container support in YARN. Erasure coding is a major enhancement likely to be rolled out as a part of Hadoop 3.0. Erasure coding is an advanced method for replication in HDFS and managing I/O. Erasure Coding in Hadoop 3.0 will make HDFS more reliable, help save disk space and bandwidth.
(Source :http://www.zdnet.com/article/data-works-hadoop-3-0-is-round-the-corner-and-horton-hatches-the-egg/ )
According to Zion Market Research report, global demand for hadoop is estimated to reach 59 billion USD in 2012 growing at a compound annual growth rate of 51% from 2016 to 2021.According to the Hadoop Market report by Zion , the key players include Teradata Corporation, IBM, Cloudera, AWS, Datameer, Karmasphere, Hortonworks and Oracle Corporation. The report analyses the hadoop market based on software segment, regional segment and end use segment.
(Source : http://www.ndmcolumns.com/hadoop-market-grow-59-0-bn-globally-2021/ )
Big data industry in India is anticipated to grow eightfold reaching $16 billion from the present size of $2 billion by end of 2025. California based Hortonworks is targeting the Indian big data market by betting big on selling its support and services for Hadoop to Indian organizations and also for Government’s big data projects like the ID platform Aadhar. Hortonworks’ market capitalisation crossed $1 billion in its initial public offering but later the market cap came down to $662 billion. Hortonworks plans to hire talent from the Indian market to bolster its growth. A new office has been set up in the Silicon Valley of India- Bengaluru that houses the company’s engineering and support teams along with the India sales team.
(Source : http://www.thehindu.com/business/Industry/silicon-valleys-hottest-startup-hortonworks-eyes-indias-big-data/article18056047.ece )
Spanish start-up Shoppermotion is now taking the big data approach to provide retailers and consumer brands with valuable information on customer in-store behaviors and experiences.This will help its customers identify in-store hot zones, blind spots and new opportunities to improve layouts. Shoppermotion is working with customers like IKEA, Unilever and Carrefour. Shoppermotion attaches bluetooth tokens to shopping baskets and sensors are installed in the ceilings of stores. This approach allows organizations to analyse the paths shoppers take through the store and how much time they spend at each aisle and where they tend to spend most of their time.Shoppermotion then sends this information to its customers through a customized analytics dashboard.
(Source : http://diginomica.com/2017/04/21/shoppermotion-pinpoints-customer-locations-journeys-hadoop/ )
Online learning is seeing a great deal of change due to big data as course curriculum designers, administrators , instructors and educational system leverage analytics to make learning experience manageable and engaging.Many educational institutions are making efforts to create a personalized learning experience by leveraging big data analytics.Big data is at the core of improving course operations for students, improving learning materials and understanding the learning process.Finding the relationship between the material presented and the students results using big data could reveal some surprising conclusions that can enhance the learning experience.
(Source : http://www.iotevolutionworld.com/iot/articles/431493-using-big-data-improve-online-learning-experience.htm )
It comes as no surprise that entertainment business is finding use of complex data science algorithms.Entertainment industry now has data ta its power which can help the entertainment industry extract added value and make better business decisions with the help of machine learning algorithms. Use of machine learning algorithms will help the filmmakers do analysis at frame level which could result in interesting conversations on how to build a movie trailer and what % of the movie trailer has the star in it. With big data and data science cross pollinating across diverse domains , surprising novel solutions are likely to emerge in unexpected areas.
(Source : http://siliconangle.com/blog/2017/04/24/big-data-rewrites-script-entertainment-industry-nabshow/ )
Using big data technology to find the best deals and nurture the growth of startups can help venture investors stand out from the crowd. SignalFire , early stage organization launched in San Francisco mines huge amounts of data from proprietary databases in real time to discover investment targets and support their development. Another investment firm NFX Guild is also an accelerator for startups which runs software in the cloud and helps startups find new investors.
(Source : https://www.wsj.com/articles/venture-capital-firms-use-big-data-to-seek-out-the-next-big-thing-1493086200 )