Slashdot Mirror


When Your Site Ceases To Exist

El Lobo writes with a sobering account of how Javalobby dropped off the face of Google last month. The site had been attacked by forum spammers and Google indexed some of their spew before the Javalobby guys could remove it. According to a post in Rich Skrenta's blog, Google is now the de-facto front page for the Internet, accounting for anywhere from 70% to 78% of the search market. The power this conveys is hard to overstate. From the Javalobby saga: "We had completely disappeared from Google's main index! If you run a website, then you know how serious a problem this is. On any given day over 10,000 visitors arrive at Javalobby as a result of Google searches, and suddenly they stopped coming! ... Suddenly we no longer existed in the eyes of Google."

31 of 191 comments (clear)

  1. Never heard of them before, so nothings' changed by tomhudson · · Score: 5, Insightful

    Javalobby? Another slashvertisement ...

  2. What's the problem...? by __aaclcg7560 · · Score: 3, Informative

    I just typed in "Javalobby" in the Google search and their link came up on top. If there was a problem, it looks like it's fixed.

    1. Re:What's the problem...? by stevesliva · · Score: 4, Informative
      I just typed in "Javalobby" in the Google search and their link came up on top. If there was a problem, it looks like it's fixed.
      Phew. At least when you're caught in the crossfire in the spam war, it's just a flesh wound. The seem to be on the third page of a Google search for java.
      --
      Who do you get to be an expert to tell you something's not obvious? The least insightful person you can find? -J Roberts
    2. Re:What's the problem...? by __aaclcg7560 · · Score: 3, Interesting

      If you don't know what the URL is exactly, you may pop the name into Google to find it first. That's very important if you're browsing at work and you don't want to pull up a web page of nude chicks serving java in a lobby. :)

      Seriously, I know a lot of people who Google first to find the link to the website (i.e., type "CNN" to go to the CNN webstie). Some people are too lazy or ignorant to type out the full URL.

  3. Man, I thought it was bad when I lost 50 places... by bennomatic · · Score: 4, Funny
    My joke site (SSLI: Search for Satanic Lyrics) used to be the number one result for "Satanic Lyrics, but about two months ago, ZAP! Gone from the frone page of Google. It's something like number 50 now, so instead of getting... ummm... three visitors a day, I get something like one a week :-)

    --
    The CB App. What's your 20?
  4. The Quick Fix by dj245 · · Score: 3, Funny

    1. Move all forums to Javalobbyforums.com or equivalent
    2. ???
    3. Hire 'little people' in multicoloured pointy hats to help generate traffic for your site not that it is now google acceptable
    4. Profit!

    --
    Even those who arrange and design shrubberies are under considerable economic stress at this period in history.
  5. What problem? by jcarkeys · · Score: 5, Funny

    They're on the Slashdot front page, I don't think they'll mind being off Google for a little while.

  6. Quick Fix Redux by dj245 · · Score: 4, Funny

    5. Have midgets properly proofread all posts

    --
    Even those who arrange and design shrubberies are under considerable economic stress at this period in history.
  7. It's their own fault... by Codename46 · · Score: 5, Insightful

    If they could have implemented one layer of security or verification to prevent spambots from registering (similar to phpBB or vBulletin), they would have prevented all this. But they didn't. There is no image verification on their forum registration page. All it takes is a spammer with a source of disposable e-mails such as dodgeit.com to spam your page to hell.

  8. Is this normal? by rumith · · Score: 3, Insightful

    The problem is indeed deeper than just a headache for a webmaster or two. Let's face it: just as the desktop software market depends on MS Windows, and a lot of software companies will vanish overnight in case Microsoft introduced a new trick [like, signed - for a price - executables only, or backwards-incompatible API, etc], so the web now depends on Google. Should all the Google system administration team take a week off - and voila, you get no new customers, because they don't know where to go, and you're lucky if somebody from your old clients returns using his browser's history. Of course, there's Yahoo, MSN, Nigma, and a hundred of startups, but all of them combined hardly have the same significance that Google enjoys alone. So let's either keep our fingers crossed and hope that Google will not do anything more evil than it does now, or... heh, I don't really know even what else could we do.

  9. Re:Maybe... by Anonymous Coward · · Score: 5, Insightful

    Maybe you should RTFA - they're not relying on Google for "advertising"
    Maybe you should RTFA - they DO actively monitor their forums. They deleted the messages very quickly - but too late, because Googlebot beat them to it.
    Maybe you should RTFA - they DO have a site that people care about and frequently visit. But they want people searching for solutions that appear in their FORUMS to find those postings via search engines.

  10. Alternative result types? by Midnight+Thunder · · Score: 3, Interesting

    Maybe this is where Google needs to provide multiple indexing algorithms. The idea by giving different result types ( most linked, closeness to keywords, flashiness, highest rated, totally random, etc ), this would make it harder for site spammers to know which algorithm to be targeting.

    --
    Jumpstart the tartan drive.
  11. Re:Maybe... by ArsonSmith · · Score: 4, Insightful

    I don't see a double standard, yet. I don't know the GPs opinion on the MS Monopoly.

    --
    Paying taxes to buy civilization is like paying a hooker to buy love.
  12. Re:Never heard of them before, so nothings' change by Kalriath · · Score: 5, Funny

    Dude. Slashdot is the last place I'd want to advertise. Their site will be down in minutes (what with being on the front page, and the article unabbreviated).

    --
    For a site about things like basic rights, Slashdot users sure do like to censor "dissent".
  13. Re:Concentration of power unoticed by Google Fanbo by NineNine · · Score: 3, Funny

    Is there anything worse than Apple fanboys?

    Definitely. Linux fanboys.

  14. Ceases to Exist, but... site is now on Slashdot? by popo · · Score: 4, Interesting

    See the irony?

    I'm going to go out on a limb here and say that your lame site is getting more traffic than its ever received in a single day.

    Which means that you've just been depending on Google too heavily for too little in return.

    Digg it. Sig it. Promote the hell out of it.

    I'd say this is a non-story, but the irony is that it was ultimately a wonderful short term solution to the author's issue.

    Google does *not* own the Internet unless you depend solely on Google.

    --
    ------ The best brain training is now totally free : )
  15. Re:Man, I thought it was bad when I lost 50 places by GoofyBoy · · Score: 4, Funny

    I just visited your site just so I could joke around about being your single weekly hit.

    Joke's on me and my poor eyes; I can't believe that you are ranked so high up at 50.

    --
    The surprise isn't how often we make bad choices; the surprise is how seldom they defeat us.
  16. Of course, google has already re-listed them... by jafo · · Score: 4, Insightful

    In the comments are some strings that one writer of theirs expects to find on their site when searching google, but didn't. I just searched for the "jgoodies data binding" and their site comes up the 7th top level listing on the first results page.

    It seems to me that google worked perfectly here. When 50,000 spam and phishing messages were posted to that site, the ranking of it went way down. When they cleaned them up, the site ranking came back.

    What, would the site owners have google preserve their site ranking even though the content on the site went in the toilet? As a google user, I'm quite happy that google de-listed these folks for a bit, because otherwise these and other searches would have been severely polluted.

    Sean

  17. It exists... by xwizbt · · Score: 3, Funny

    Try typing any mis-spelling of javalobby. Anything. Google offers you the alternative of 'javalobby'. They *so* do not recognise this website... so much so that they dare to *suggest* it as an alternative to a common mis-spelling of the forbidden site. Bastards! How deep does their vitriol run?

  18. Re:Never heard of them before, so nothings' change by KillerBob · · Score: 4, Insightful

    yeah, and if you search for KillerBob on Google, my site comes up at the front. If you type my real name, my personal website isn't even on the front page. On the second page, there's a couple of scripts I wrote over 10 years ago, and a story I submitted to BBSpot years ago, but my personal website still doesn't show up. Selection of keywords. If you type the name of any specific site, you'll get that site first. If you type what the site does, you may find that it's much lower on the page ranking. They probably aren't worried about traffic from people who search for the word "javalobby", because those people probably already know about their site.

    They're worried about the people who search for terms like "java help", which is what somebody who *doesn't* already know about their site would be searching for. In my case, it's quite deliberate. I'm using robots.txt to tell GoogleBot to ignore my personal website. It's *personal*. All it is is an e-mail gateway, anyway; the blog is restricted access. There's no point in having it in Google, so the robots.txt reduces my daily traffic.

    --
    If you believe everything you read, you'd better not read. - Japanese proverb
  19. Re:Never heard of them before, so nothings' change by Cylix · · Score: 3, Interesting

    Yes, downtime will come and go, but the page rank effects will be everlasting!

    --
    "You should always go to other people's funerals; otherwise, they won't come to yours." -- Yogi Berra
  20. Ask Matt! by dekkerdreyer · · Score: 5, Informative

    If you would have tried doing even a little research, you would have found out that Google penalizes hacked sites and even makes an attempt to contact the webmaster to alert them to the problem. Not only that, they'll relist you if you remove the spam.

    1. Fail to follow even basic internet precautions standard since 1998
    2. Whine loudly on Slashdot when search engine behaves as advertised
    3. Get lots of new traffic
    4. Profit

    --
    Dekker Dreyer
  21. Re:Man, I thought it was bad when I lost 50 places by Skidge · · Score: 5, Interesting

    I had a similar, but opposite experience. I started setting up Yet Another Job Site, but I never got around to making it useful (see Click. Hired!). Google decided that it sort of liked it for a while, sending some traffic my way. I went from making nothing on my google ads to a few bucks a day. It wasn't much money, but it was fun seeing the traffic come in. Then google decided it was the crappy site that it was and my traffic went back to its deserved trickle. I wrote an article about it with pretty graphs:

    What Google Giveth, Google Can Taketh Away

    I should have submitted it for a slashvertisement. :)

  22. Re:Anti-trust against Google? by Bert690 · · Score: 4, Informative
    And guess where live.maps.com is on Google's search? Go look... no it's not on the first page.... Go to the second page of results... Ah yes half way down.... HMMMM I think Google has a case to answer here, I simply don't believe Microsoft maps can possibly legitimately be ranked where it is.

    Because you are an idiot. Go back to live.com and see where it shows up in the *search* results for maps (sponsored links DO NOT count, duh!). I tried, and the site appears nowhere in top TOP 50 results.

    Hilarious, come on all you Google fanboys/MS anti-fanboys.... try and spin this one into yet another Microsoft bashing session I dare you, then I can see something truly imaginative.

    You've already succeeded all on your own.

  23. Alex Chiu by tylersoze · · Score: 5, Funny

    Join the club, Alex Chiu has been blacklisted by Google for years.

    http://www.alexchiu.com/spread.htm

    A choice quote:

    "Google controls 50% of the world's searches. This famous website is so controversial that it has been banned by the most popular search engine in the world 'Google'. That's right. You cannot find alexchiu.com in Google system. Some very important people don't want you to know about Alex Chiu. Alex Chiu is on more than 30 TV interviews, 250 radio interviews, and in business ever since 1996. Yet AlexChiu.com cannot show up on Google?"

  24. This Is An Easy Fix! by sgtbenc · · Score: 4, Informative

    It's extremely easy to get reincluded to the Google Index. Just follow the steps on their help: http://www.google.com/support/webmasters/bin/answe r.py?answer=35843

  25. Idiots. by Jessta · · Score: 3, Insightful

    Making your whole business reliant on a single vendor is just stupid.
    Especially a vendor that you don't even have a contract with.

    People act like Google is a public service, Google is a business and as a business there is no reason why they have to index your site.

    --
    ...and that is all I have to say about that.
    http://jessta.id.au
  26. Re:Never heard of them before, so nothings' change by kestasjk · · Score: 4, Informative

    Just because they show up when you enter the name of the site doesn't mean they haven't lost lots of PageRank.

    They probably mean that they used to show up when you searched for "Java", but because the spambots created so many outgoing links they lost their PageRank and now you have to search for "JavaLobby" to get them.

    --
    // MD_Update(&m,buf,j);
  27. Re:Google needs to do more of this. by tomhudson · · Score: 3, Insightful

    Well, anyone stupid enough to buy SCOX deserves what they get ... but I notice the #1 article is boston.com (Boston Globe) - the same people who did the hatchet job on Peter Quinn for advocating ODF for Massechussetts

    We know who was behind THAT one ... Microsoft. And of course they're behind the SCOX stuff ... perhaps this is just another Team99 tactic?

  28. Re:Never heard of them before, so nothings' change by gmack · · Score: 5, Informative

    How many days after a site has been transformed by hijackers/forum spammers/whoever into a pile of crap should it come off the top of googles search results? A day? A week?

    60 days but you can request reinclusion sooner with Google Webmaster tools