Yahoo! releases new version of Hadoop

Increases commitment to cloud computing

Yahoo has announced the availability of the Yahoo! Distribution of Hadoop. The new version is based on code available from the Apache Hadoop, an open source project of the Apache Software Foundation.

The new offering has already been tested and deployed at Yahoo! on the Hadoop clusters in the world.

Hadoop’s founder Doug Cutting joined Yahoo! in 2006 and the company began investments in developing Hadoop.

Hadoop now underpins Yahoo! properties including Yahoo! Search, which is reportedly the largest Hadoop application, processing data for web search queries that run on Yahoo!, as well as Yahoo! Mail and various content and advertising services. It also runs on more than 25,000 Yahoo! servers and analyses many web pages.

Shelton Shugar, senior vice president of cloud computing at Yahoo!, said: “Yahoo! was a pioneer in developing the Hadoop technology and now Hadoop provides Yahoo! software infrastructure running on tens of thousands of machines to process data critical to Yahoo!'s core business. By making the Yahoo! Distribution of Hadoop generally available, we are contributing back to the Apache Hadoop community so that the ecosystem can benefit from Yahoo!'s quality and scale investments.

However, Yahoo! has only announced the general availability of Yahoo!'s Hadoop and that reportedly helps companies like Cloudera which continues to collaborate with Yahoo! to include their tested source code in their commercial distribution.

Mike Olson, CEO of Cloudera, said: “Cloudera’s distribution for Hadoop is an enterprise-ready distribution inclusive of tools, utilities, service and support, to help enterprises deploy and manage the Hadoop platform for data processing and management.”

• Share:
• 
• 
• 
• 
• 
• 
• 
• 
•