The provider of the leading Unified Analytics Platform, Databricks is hosting a Spark + AI summit conference in San Francisco from June 4-6, 2018. The conference will have Marc Andreessen as the keynote speaker who will participate in Fireside Chat with Databricks Co-founder and CEO, Ali Ghodsi. The Spark + AI summit is a leading event for data engineers, data scientists, and business professionals to converse on hot topics in analytics, big data and practical applications of AI.The agenda also has a talk featured by Matei Zaharia, co-founder of Databricks on why large-scale data processing is important to AI applications and how Spark enables data and AI projects.
(Source : https://globenewswire.com/news-release/2018/04/04/1460213/0/en/Databricks-to-Host-AI-Thought-Leaders-at-Spark-AI-Summit-2018.html )
If you would like more information about Apache Spark Training and Certification, click the Request Info button on top of this page.
MapR Technologies announced the incorporation of some breakthrough capabilities to its data platform across every cloud. The new enhancements to the platform will help build , powerful, real-time streaming and global IoT applications. The novel enhancements to the MapR Converged Data Platform release 6.0.1 and MapR Expansion Pack 5.0 include Event Streams (MapR-ES), Apache Spark and Apache Drill release 1.13.These enhancements will support streaming pipelines which can stretch across millions of endpoints whilst also providing support for rich analytics that can be used to divide and aggregate streams.
(Source : https://www.martechadvisor.com/news/bi-ci-amp-data-visualization/mapr-introduces-new-capabilities-to-build-real-time-streaming-and-iot-applications/ )
Immuta unveiled novel features of its data management platform that includes native Apache Spark SQL policy enforcement and automated governance reporting.These latest additions in Immuta v2.1 will allow organizations to process, secure and audit on massive scale in Apache Spark while providing greater visibility and control on how data is being used with integrated compliance reporting. The latest release extends Immuta’s powerful capability for the Apache Spark ecosystem for large scale processing with native policy enforcement (policies include time windowing, minimization, purpose limitation, dynamix row and column level controls, and automated differential privacy) within spark.
(Source : https://www.businesswire.com/news/home/20180409005470/en/Immuta-Introduces-Apache-Spark-Ecosystem-Support-Automated )
An international team used double -pronged approach of big data and DNA analysis to dig deep into the genetics of prostate cancer.Prostate cancer is among one of the most common types of cancer in men in US with an average of 164,690 cases of prostate cancer and approximately 30,000 deaths to the disease.The researchers took data from 112 men with prostate cancer and combined with data from other studies. A total of 930 patients data was used as a sample for analysis.With the help of latest big data methods , the team gathered novel insights into genetic changes the result in the development and progress of prostate cancer. Having understood the genes involved, they were able to create a map of the proteins that can be coded by these genes.Scientists have found that 80 of the proteins that they have uncovered were potential drug targets and 11 of them were targeted by existing drugs and 7 could be targeted by drugs already present in clinical trials.
(Source -https://www.medicalnewstoday.com/articles/321511.php )
A recent research from “Big Data-as-a-service” company Qubole found that more than three-quarters of organizations depend on multiple open source big data frameworks to glean insights from data.Apache Spark and Presto are among the fastest growing open source big data engines. The findings show that Apache Spark has grown by 365% in the total number of commands run whereas Presto has increased to 420% in its compute hours. Another major big data engine that also witnessed growth is Apache Hive with number of commands increasing by 129% over the year.The study also revealed the number of users accessing each of the big data platforms.Apache Spark and Hadoop saw 171% and 136% increase in users running commands on the platform respectively.
(Source https://www.channele2e.com/software/big-data/spark-presto-apache-hive/ )
According to IDC, big data revenues are expected to cross $187 billion in 2019 as the amount of data continues to double every two years and by end of 2020, the universe will have 4 trillion gigabytes in data. Here are 5 interesting big data trends across the worldwide big data market observed in the Big Data Activation Report 2018 from Qubole -
(Source - https://yourstory.com/2018/04/five-key-things-happening-global-big-data-market/ )