This is extremely sad, but it's really true. I know a lot of people that go "OH NO, TERRORISM? CHILD PORN? WE NEED TO FIX THIS!!!" and don't give a damn about their own rights.
Yes, that's a flaw with most places. And it's exactly the reason that some ISPs can get away with whatever they feel like. (I live in someplace that I can use the local ISP, or switch to comcast, so I don't have a huge choice either in matters).
Or maybe they should use some of their money to build up bigger backbones and the like so bandwidth isn't a problem. Oh wait, no more diamond-lined swimming pools if they don't abide by CAPITALISM.
I'm sure they'd care if they got a lot of complaints, were overwhelmed from said complaints, and then their customers switched ISPs due to the fact that the call center didn't respond in a timely manner, etc.
It's my understanding that the robots.txt file is the first grabbed by a webspider, right?
If you don't want anything crawling your site, just disallow/, no?
Slashdot Mirror
This is extremely sad, but it's really true. I know a lot of people that go "OH NO, TERRORISM? CHILD PORN? WE NEED TO FIX THIS!!!" and don't give a damn about their own rights.
Do you have proof that google crawled your page every 2 seconds? I've heard nothing of this.
But if they USE the money, then it can't pile up in a bank, where it'll never be used. Come on, man, think.
Yes, that's a flaw with most places. And it's exactly the reason that some ISPs can get away with whatever they feel like. (I live in someplace that I can use the local ISP, or switch to comcast, so I don't have a huge choice either in matters).
Yes, they are, but a lot of customers don't know their asshole from their elbow when it comes to anything "on that there interwebbernet".
Or maybe they should use some of their money to build up bigger backbones and the like so bandwidth isn't a problem. Oh wait, no more diamond-lined swimming pools if they don't abide by CAPITALISM.
I'm sure they'd care if they got a lot of complaints, were overwhelmed from said complaints, and then their customers switched ISPs due to the fact that the call center didn't respond in a timely manner, etc.
It's my understanding that the robots.txt file is the first grabbed by a webspider, right? If you don't want anything crawling your site, just disallow /, no?