El Reg Says Google Choking on Spam Sites
Grubby Games writes "The Register is reporting that Google is full, and in trouble." From the article: "Recently, we featured a software tool that can create 100 Blogger weblogs in 24 minutes, called Blog Mass Installer. A subterranean industry of sites providing 'private label articles,' or PLAs exists to flesh out 'content' for these freshly minted sites. And as a result, legitimate sites are often caught in the cross fire. But the new algorithms may not be solely to blame. Google's chief executive Eric Schmidt has hinted at another reason for the recent chaos. In Google's earnings conference call last month, Schmidt was frank about the extent of the problem. 'Those machines are full,' he said. 'We have a huge machine crisis.'" James Robertson points out that's a fairly selective bit of quoting.
Thanks!
This issue is a bit more complicated than you think.
With hardware (and bandwidth) getting cheaper, I find it hard to believe that Google has actually run out of space. But certainly the explosion in the number of web pages is an issue, especially with auto-generated pages. One current example is the V7ndotcom Elursrebmem SEO contest (white-hat celiac charity site I'm supporting) - that nonsense phrase returned zero results on January 15th, 2006 ...
but now returns almost 5,000,000 ... of which I gotta believe the
vast majority were NOT typed in by humans.
So maybe it's more that the techniques/algorithms used to spider and index are struggling with the bazillions of web pages out there. Or it could just be disgruntled webmasters PO'ed that their web site isn't listed!
Hulk SMASH Celiac Disease
I'm not a computer person, but couldn't Google just upgrade to a bigger disk drive?
I saw one at bestbuy.com that looks pretty good.
In creating adsense, google opened the floodgates for spammers who do not want to create good content. In fact, there are even people who copy tons of content from wikipedia and throw up adsense on the top and sides of the pages.
There are people who are literally making $10,000 or more per month just putting up junk content sites that are auto generated for the purpose of creating adsense revenue.
Don't get me wrong, I think adsense is a good thing, but Google's allowance of spam sites is giving adsense a bad name.
Meanwhile, for no good reason, here's some gorgeous stats porn on how Google (and Yahoo and MSN) crawled a sample website. The animations and closeups of the trees are very cool.
A stingy old spammer who had been diagnosed with a terminal illness was determined to prove wrong the saying, "You can't take it with you." After much thought and consideration, the old spammer finally figured out how to take at least some of his money with him when he died. He instructed his wife to go to the bank and withdraw enough money to fill two pillow cases. He then directed her to take the bags of money to the attic and leave them directly above his bed. His plan: When he passed away, he would reach out and grab the bags on his way to heaven. Several weeks after the funeral, the deceased spammer's wife, up in the attic cleaning, came upon the two forgotten pillow cases stuffed with cash. "Oh, that darned old fool," she exclaimed. "I knew he should have had me put the money in the basement."
...then eventually the spam sites will actually contain the information you were looking for.