Mortar Data Makes Hadoop Collaboration Easy
December 05, 2012
By Rory Lidstone
, TMCnet Contributing Writer
Mortar Data is a startup that only just publicly launched in late November. It is also an open-source development framework for Hadoop that is built specifically for collaboration, allowing for easy sharing, repeating and maintaining of code. Mortar was initially only offered as a hosted Hadoop service, but the company has now released the open-source Mortar framework for Hadoop applications.
According to Mortar Data co-founder and CEO K Young, the goal for the framework is not only just to make application development easier, but to make sharing datasets easier as well. Mortar takes much of its inspiration from Ruby on Rails, offering a way to write jobs for processing data with Hadoop via pipelines, much like Cascading, an application framework for Java developers to quickly and easily develop robust Data Analytics and Data Management applications on Apache Hadoop. As such, Mortar also supports programming in Ruby, as well as Python, while still using Apache Pig as the workflow language.
As Young said, though, Mortar's real potential is in how easy it makes it to share datasets. For example, if someone found a public dataset from a city or government, the dataset could be analyzed using Mortar Data, and the code could then be shared on Github. As long as the dataset is stored in Amazon Web Services (News - Alert), anyone cloning the code from Github can connect to it automatically.
However, Hadoop has begun to see growth beyond just batch data processing and as such, Young has acknowledged that Mortar Data will likewise need to expand in the future. Some examples he referenced include YARN, Impala, graph databases and other alternative processing methods currently built on Hadoop. For now at least, he said he feels there's still enough business in batch processing.
Furthermore, it's a bit difficult to predict in exactly which direction Hadoop will expand and grow, so making a pre-emptive move now would be foolish. Regardless, Mortar Data has experienced "good" developer uptake, according to Young, despite the company putting very little emphasis on marketing and support.
Want to learn more about the latest in communications and technology? Then be sure to attend ITEXPO Miami 2013, Jan 29- Feb. 1 in Miami, Florida. Stay in touch with everything happening at ITEXPO (News - Alert). Follow us on Twitter.
Edited by Rachel Ramsey