Slashdot Mirror


White House Website Limits Iraq-Related Crawling

oscarcar writes "Dan Gillmor is reporting on the White House website's use of its robots.txt file to disable search engines from crawling certain material. Many excluded items in the robots.txt file involve mentions of Iraq, possibly to prevent people from finding changes to past statements and information when archived elsewhere."

5 of 837 comments (clear)

  1. not that far fetched by happyfrogcow · · Score: 2, Offtopic

    Consider the fact that GW Bush has banned media (hello?? freedom of the press? 1st Amendment??) coverage of returning killed soldiers. Why? Because seeing dead soldiers makes people realize that the war is real and people are dieing.

    The current administration is trying its damndest to control infomation that it doesn't like

  2. Re:More American Cencorship by 514x0r · · Score: 1, Offtopic

    isn't that the American people didn't vote for the current administration (they did)

    50,456,169 - bush
    50,996,116 - gore

    it seems like about 539947 more americans voted for the other admin.

    yes, i know that's how the rules are set up, but it's a pretty hard sell to prove that a system in which a candidate can lose by half a million votes and still win is a 'democracy.'

    swear to god, it's not a troll.

    --

    !(^((ri)|(mp))aa$)
  3. Re:Other, arguably more reasonable explanations by DeputySpade · · Score: 0, Offtopic

    Oh, come on! Mod this up, already! It was funny as hell.

    --


    This space intentionally left blank
  4. Re:And your ... by mr100percent · · Score: 0, Offtopic

    How do you know if they are Syrian, Jordanian, or Iranian? Syrian I can't find proof for, save that one guy who got killed.

    Iranians wouldn't add up, because the ayatollahs are not meshing with Iran's policy and want to be separate AND what Iranian in his right mind would car bomb one of the holiest mosques in Iraq?

    I think it's safe to say that there are both many many different freedom-fighting groups as well as just terroristic people there as well. Not all of these attacks are coming from one.

  5. uhh... so what's stopping: by Oriumpor · · Score: 0, Offtopic

    wget -r http://www.whitehouse.gov