Exar Gives Insight on Maximizing Hadoop Performance with Hardware Compression

Hadoop is an open-source Apache implementation project. The project aims to deal with the big data challenges by facilitating the storage and processing of big data.

Exar (News - Alert) Corporation, a supplier of high performance analog mixed-signal components and data management solutions, recently released a presentation that provides valuable insight designed to address the challenges associated with big data.

The presentation titled, "Maximizing Hadoop Performance with Hardware Compression" reviews the challenges associated with " Big Data", Hadoop's role in addressing big data challenges, and how hardware-based compression increases Hadoop performance.

Robert Reiner, Exar's director of marketing for the Data Compression and Security products, presented the information at the Server Design Summit 2012 in Santa Clara, California. The presentation was delivered as a part of the Accelerating Application Performance session.

According to a recent TMCnet piece, Hadoop enables applications to work with huge amounts of data stored on various servers. 

Hadoop’s functions allow the existing data to be pulled from various places (since now, data is not centralized, but distributed in places using cloud technology) and use the MapReduce technology to push the query code and run a proper analysis, therefore returning the desired results.

As for the more specific functions, Hadoop has a large-scale file system (Hadoop Distributed File System or HDFS), which can write programs, manage the distribution of programs, then accept the results and generate a data result set.

"Hadoop clusters can experience severe I/O bottlenecks in both networking and disk accesses, which restricts the data flow and impacts performance," said Robert Reiner, director of marketing, Data Compression and Security products, Exar, in a statement.

“Exar's hardware accelerated compression technology significantly reduces I/O bottlenecks, maximizes Hadoop cluster performance, lowers CPU utilization and energy consumption, and optimizes cluster efficiency," Reiner added.

Exar's product portfolio includes power management and connectivity components, communications products, and network security and storage optimization solutions.  

Want to learn more about the latest in communications and technology? Then be sure to attend ITEXPO Miami 2013, Jan 29- Feb. 1 in Miami, Florida.  Stay in touch with everything happening at ITEXPO (News - Alert). Follow us on Twitter.

Edited by Brooke Neuman