Completely agree.. So if its wrong, come up with a standard which everyone will agree on, promote it and make everyone adhere to it.. And if you can't do that, then dont complain;-)
Then I recommend you tell that to the 2.04 million sites that discuss the ROBOTS.TXT on Google alone, or the Wiki entry: http://en.wikipedia.org/wiki/Robots.txt
I agree its not a 'legal' standard, has no regulatory body, but like the difference between a door and a window, something thats common accepted by more people than dont. Unfortunately you're a minority, and last time I looked, we're in a democracy, majority rules.. and the majority have accepted that its the way its done.. sorry!
If you don't like it, come up with a better solution?
Exactly, I couldn't agree more.. its unlawful entry if its private and you've made people aware that its a private place by putting socially acceptable ways like, fence, gate, locked door. Thats exactly the same on the web, the ACCEPTED standard is the ROBOTS.TXT.. you're telling spiders that it's a private place..
If you have a field in a huge public place, it's not marked as private land, its not fenced off, its completely open then how is Joe Public supposed to recognise that its private? You have a website in a hugely public place, you have a ROBOTS.TXT - simple.
No, but neither is knocking on a door, opening it and walking through is not a rule.. its an accepted standard.. knocking on a window and climbing through it isn't accepted, but there's no rule against it!
Don't like accepted standards that are accepted by the majority? Stay off the web!
i actually agree with the most part of the environmental debate - especially when it comes to the US and China and the lack of acceptance and moral responsibility towards the issue. I also agree as well with the scientific studies that planets such as Mars and Pluto have also shown unusual warming over the past 10-20 years. But I'm not interested in a flame war - and perhaps should have enclosed my statement in [sarcasm][/sarcasm] tags.
Completely agree.. So if its wrong, come up with a standard which everyone will agree on, promote it and make everyone adhere to it.. And if you can't do that, then dont complain ;-)
Then I recommend you tell that to the 2.04 million sites that discuss the ROBOTS.TXT on Google alone, or the Wiki entry: http://en.wikipedia.org/wiki/Robots.txt I agree its not a 'legal' standard, has no regulatory body, but like the difference between a door and a window, something thats common accepted by more people than dont. Unfortunately you're a minority, and last time I looked, we're in a democracy, majority rules.. and the majority have accepted that its the way its done.. sorry! If you don't like it, come up with a better solution?
Exactly, I couldn't agree more.. its unlawful entry if its private and you've made people aware that its a private place by putting socially acceptable ways like, fence, gate, locked door. Thats exactly the same on the web, the ACCEPTED standard is the ROBOTS.TXT.. you're telling spiders that it's a private place.. If you have a field in a huge public place, it's not marked as private land, its not fenced off, its completely open then how is Joe Public supposed to recognise that its private? You have a website in a hugely public place, you have a ROBOTS.TXT - simple.
No, but neither is knocking on a door, opening it and walking through is not a rule.. its an accepted standard.. knocking on a window and climbing through it isn't accepted, but there's no rule against it!
Don't like accepted standards that are accepted by the majority? Stay off the web!
i actually agree with the most part of the environmental debate - especially when it comes to the US and China and the lack of acceptance and moral responsibility towards the issue. I also agree as well with the scientific studies that planets such as Mars and Pluto have also shown unusual warming over the past 10-20 years. But I'm not interested in a flame war - and perhaps should have enclosed my statement in [sarcasm][/sarcasm] tags.
hahaha, I don't think 30 is having a mid-life crisis.. I run the site! :-)
C'mon.. How long before the tree-huggers and Al Gore find relates this to Global Warming and we're all doomed!