You are absolutely right about the caching issue. What is even worse, is that robots.txt is only a gentlemen's agreement. While most propagated browsers/webcrawlers uphold this agreement, I know of some where ignoring robots.txt is a command line flag, and it is certainly easy enough to write you own small bot in Perl/Java that does whatever you want.
Security through obscurity, is NOT security
I wonder if this idea has reached the the Department of Homeland Defense?
Tom Ridge: Let me introduce you America's newest frontline of defense against terrorism on the Internet, Mr. Robo T. Txt. Any questions for Mr. Txt?
So if you are driving your car in South Korea and you see a North Korean tank coming the other way, can you use the phone to wire all you savings off-shore before KIM Il-song takes it and spends it on American movies and Afro Sheen?
After reading the Forbes article, I'm now totally disillusioned with the whole free software movement. What kind of sick organization would have the nerve to enforce a legally binding contract that another party entered into willingly. My God, one or more of the F's in FSF must stand for facist.
If I were a Microsoft spin doctor, I'd use this opportunity to strike a blow to free software by offering my company as an alternative for those out there who shun companies that use legal trickery for the purpose of world domination.
Other than changing schools, a savy user should set up a linux router and keep their P2P machine behind it. This should be the rule for anyone, at any university, that wants a little privacy and a whole lot of security.
Slashdot Mirror
My money going into a shoe box with my election ballots.
The key is to trade all the Indians that run the service stations now with the ones that know IT. Problem solved.
You are absolutely right about the caching issue. What is even worse, is that robots.txt is only a gentlemen's agreement. While most propagated browsers/webcrawlers uphold this agreement, I know of some where ignoring robots.txt is a command line flag, and it is certainly easy enough to write you own small bot in Perl/Java that does whatever you want. Security through obscurity, is NOT security I wonder if this idea has reached the the Department of Homeland Defense? Tom Ridge: Let me introduce you America's newest frontline of defense against terrorism on the Internet, Mr. Robo T. Txt. Any questions for Mr. Txt?
So if you are driving your car in South Korea and you see a North Korean tank coming the other way, can you use the phone to wire all you savings off-shore before KIM Il-song takes it and spends it on American movies and Afro Sheen?
Some time next week, they'll be forced to resort to: "Pretty please, with sugar on top".
After reading the Forbes article, I'm now totally disillusioned with the whole free software movement. What kind of sick organization would have the nerve to enforce a legally binding contract that another party entered into willingly. My God, one or more of the F's in FSF must stand for facist. If I were a Microsoft spin doctor, I'd use this opportunity to strike a blow to free software by offering my company as an alternative for those out there who shun companies that use legal trickery for the purpose of world domination.
Other than changing schools, a savy user should set up a linux router and keep their P2P machine behind it. This should be the rule for anyone, at any university, that wants a little privacy and a whole lot of security.