Hortonworks and Hewlett Packard Enterprise Accelerate Apache Spark

01 Mar, 2016, 13:00 ET from Hortonworks, Inc.

SAN FRANCISCO, March 1, 2016 /PRNewswire/ -- Hortonworks, Inc. ® (NASDAQ: HDP) and Hewlett Packard Labs, the central research organization of Hewlett Packard Enterprise (NYSE: HPE), today announced a new collaboration to enhance Apache Spark, one of the most active Apache big data projects. The collaboration will center around an entirely new class of analytic workloads that benefit from large pools of shared memory.

Early results of the collaboration include the following:

  • Enhanced shuffle engine technologies: Faster sorting and in-memory computations, which has the potential to dramatically improve Spark performance.   
  • Better memory utilization: Improved performance and usage for broader scalability, which will help enable new large-scale use cases.

"This collaboration indicates our mutual support of and commitment to the growing Spark community and its solutions," said Scott Gnau, chief technology officer, Hortonworks.  "We will continue to focus on the integration of Spark into broad data architectures supported by Apache YARN as well as enhancements for performance and functionality and better access points for applications like Apache Zeppelin." 

"We're hoping to enable the Spark community to derive insight more rapidly from much larger data sets without having to change a single line of code," said Martin Fink, EVP and CTO, Hewlett Packard Enterprise and Hortonworks Board Member. "We're very pleased to be able to work with Hortonworks to broaden the range of challenges that Spark can address."

Hortonworks and Hewlett Packard Enterprise plan to contribute the new technologies to the Apache Spark community.

About Hortonworks  Hortonworks is an industry leading innovator that creates, distributes and supports enterprise-ready open data platforms and modern data applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. Hortonworks is focused on driving innovation in open source communities such as Apache Hadoop, NiFi and Spark. Along with its 1,600+ partners, Hortonworks provides the expertise, training and services that allow customers to unlock transformational value for their organizations across any line of business.

Hortonworks, HDP and HDF are registered trademarks or trademarks of Hortonworks, Inc. and its subsidiaries in the United States and other jurisdictions. For more information, please visit www.hortonworks.com.  All other trademarks are the property of their respective owners.

About Hewlett Packard Enterprise Hewlett Packard Enterprise is an industry leading technology company that enables customers to go further, faster. With one of the industry's most comprehensive portfolios, spanning the cloud to the data center to workplace applications, our technology and services help customers around the world make IT more efficient, more productive and more secure.

Hortonworks Contact  Michelle Lazzar (408) 828-9681  comms@hortonworks.com

HPE Contact Simon Bowers (650) 857-3518 corpmediarelations@hpe.com 

Logo - http://photos.prnewswire.com/prnh/20140227/SF73721LOGO

Logo - http://photos.prnewswire.com/prnh/20160301/338978LOGO


SOURCE Hortonworks, Inc.