Open Source Solution Breaks World Sorting Records

allenw writes "In a recent blog post, Yahoo's grid computing team announced that Apache Hadoop was used to break the current world sorting records in the annual GraySort contest. It topped the 'Gray' and 'Minute' sorts in the general purpose (Daytona) category. They sorted 1TB in 62 seconds, and 1PB in 16.25 hours. Apache Hadoop is the only open source software to ever win the competition. It also won the Terasort competition last year."

Comments

Re:I'm sure that I can rock their scores

[Thinboy00]

My sort will totally beat yours!

They won the "Who has the most moneys" award.

[nathan.fulton]

...this cluster had nearly 4 times the number of nodes as the previous records. This competition was testing who had more nodes working together the best, but when you have so many more nodes, it would be hard not to top other clusters.

Java

[cratermoon]

OK, so where are the "Java is slow" comments? o.O

100 bytes, 10 byte keys.

[eddy]

Probably why the second sentence in the article is "All of the sort benchmarks measure the time to sort different numbers of 100 byte records. The first 10 bytes of each record is the key and the rest is the value."

Re:When's it going to be 1.0?

[Anonymous Coward]

It's 0.20 but it's stable and production ready already. I use it with HBase and it scales awesomely.

Re:Overlords - Trivia

[e9th]

Hadoop's name (and mascot) came from Doug [the project leader] Cutting's son's yellow stuffed elephant toy.

Re:Overlords

[ModMeFlamebait]

datasorting for I new one our overlords! welcome