Google Sorts 1 Petabyte In 6 Hours

krewemaynard writes "Google has announced that they were able to sort one petabyte of data in 6 hours and 2 minutes across 4,000 computers. According to the Google Blog, '... to put this amount in perspective, it is 12 times the amount of archived web data in the US Library of Congress as of May 2008. In comparison, consider that the aggregate size of data processed by all instances of MapReduce at Google was on average 20PB per day in January 2008.' The technology making this possible is MapReduce 'a programming model and an associated implementation for processing and generating large data sets.' We discussed it a few months ago. Google has also posted a video from their Technology RoundTable discussing MapReduce."

Comments

Findability without the complexity

[cnnetc]

As information continues to pile up behind the corporate firewall, companies and executives are fast recognizing that effective findability is more than a nice-to-have -- it's a must-have for their business. In fact, in a recent survey by AIIM, 62% of respondents saw findability as "imperative or significant" to their overall business goals and success, while only 5% reported that it wasn't a factor.Findability is a complex problem, and our goal is to provide businesses with a simple solution. That's why we've put together 'Enterprise Findability Without the Complexity' - a look into our philosophy and approach to search for businesses. We've noticed that approaches to findability can vary dramatically, which can have a significant impact on subsequent results. For instance, a traditional architecture, as demonstrated in this video, might include a plethora of servers, such as front-end web servers, index servers, query servers, database servers, and SAN storage. Not to mention load balancing servers, identity servers, disaster recovery servers, patch deployment servers, and volume license management servers. What a mouthful!On the other hand, there is the appliance based model - i.e., one box that does it all. The Google Search Appliance can search 10 million documents with just one box, and pull information together from across a business - whether it lives in a database, intranet, business application or content management system. Not to mention it looks pretty snazzy too.You can read the full document here. We look forward to hearing your thoughts.

Re:Kudos to Niggers

[Anonymous Coward]

Who got sand in your vagina?

How is this flamebait?

[Anonymous Coward]

Mods, he probably should have read the article. If he did, he'd have noticed that what they sorted were tons of 100-byte records. But how does that make it "Flamebait?" People who mod like this should be identified and listed in a Slashdot "Hall of Shame" of some sort and never allowed to mod or meta-mod again. Think that's extreme? Look at how blatantly this moderator failed.

Here's the definition of "Flamebait" from the Slashdot Faq:

Flamebait -- Flamebait refers to comments whose sole purpose is to insult and enrage. If someone is not-so-subtly picking a fight (racial insults are a dead giveaway), it's Flamebait.

Now, someone please tell me how the parent post fits this criteria. I dare the moderator to explain himself or herself. You won't, of course, because that would require balls and the ability to admit that you made a mistake. Y'know, things that respectable people have.

Posted anonymously because I fully expect that, instead of understanding that preventing/correcting such blatant incompetence is the best way to avoid rants like this one, the other mods will instead play shoot-the-messenger and take out their impotent frustrations on me either because I pointed out this stupidity or because I wasn't care-bear nice about it (because that's so much more important than truth, right?).

Re:How is this flamebait?

[Hurricane78]

You should know, that people always block something that would destroy their reality or self-respect too much. It does not matter if it's true.
This is, because else, they would become insane. Ask a studied psychologist about it.

If you really want him to change his mind, you must form your words in a way, that allows him to still accept himself and his reality.
The best way is, to tell him he can make his life even better by changing his mind that way, and that not he was wrong but he fell for a trick or something like that.
Yeah, it's distorting reality. But it's his distorted reality that you use. And do you want it to work, or just flame? :)

I know that our instinct tells us to back-attack like you did. But this does not work if he does not respect your opinion and does not listen to you.
The above way on the other hand works nicely if done right. You can even make new friends out of enemies and fix their distortions somewhat.

By the way: Every human has distortions. But an alpha-male knows how to convince others, that his views are the best. ;)

Re:Kudos to Niggers

[Anonymous Coward]

Your an asshole. If you think that the small subset of blacks you talk about represent them all, then I invite you to many trailer parks in Louisiana full of white people. I will venture a guess that more white 'wiggas' speak the way you describe than black people. In addition, I think it is these white people in America who contribute more to our cultural destruction than any other group. There is way more white trash in America fucking it up than blacks. But I am not supposed to say that because Sarah Palin says those are the "real Americans." You and your kind disgust me, and I hope your dog dies.....

Just for you, I posted this to your shitty blog

[Anonymous Coward]

Hey CNNETC, fuck you and your pathetic attempts to use Slashdot to drive traffic to your blog. You are a bottom-feeder and a carrion eater, not unlike the average cockroach or maggot, only able to leech off of someone else's popularity because you damned sure don't have the talent to build your own. You spamming sack of shit!

You look forward to hearing our thoughts, do you? Your blog says "Your comment has been saved and will be visible after blog owner approval." I hope you enjoy what's in your approval queue you fucking spammer!

Re:Kudos to Niggers

[ironicsky]

Seriously, Admins you need to clean this stuff out. I like reading slashdot at work, but this stuff causes it to be blocked by our "censorship" program. If I cant read slashdot, what am I supposed to do for 8 hours in my cubicle. Work is out of the question! :-)

Re:Kudos to Niggers

[Anonymous Coward]

There's a lot less wiggas than niggas on TV, in movies, in the music business, etc.

It's not about numbers, it's about the public's (black or white) inability to filter out such (wiggas, niggas) crap.

Re:Kudos to Niggers

[Anonymous Coward]

I wonder if your workplace censors the word fuck. Because I say fuck censorship.

Also, here's another nigger for you.