You could build a trap for such crawlers in the form of randomly generated HTML documents which each reference a few more fake URLs which generate more random HTML documents... Disallow that tree in your robots.txt and let the robots who disregard it suffer.
The best random document generator would be a Markov chainer which had been feed all of the top level category pages from Yahoo! to make sure you have lots of juicy keywords to index.:-)
I've had a mail server completely stuck while I was on vacation... because some fucking spammer was able to send thousands of messages a minute thanks to an open relay, and happened to use a domain I administrate as a fake return address...
And in that case the RBL (which I use) was of no help since all I got was all the bounces...
Actually the RSS could have helped you in that case. If the open relay connected to a mailserver and it said 550 User unknown then the relay itself would be generating the bounce message and trying to send it to you. If you had been using the RSS to block such open relays, bounces like that would have been rejected.
In 1992 I registered ben.com just so I could be ben@ben.com. In the past I've been extremely careful not to let it fall into the hands of spammers, using tricks like others describe (dedicated per-service aliases and the like). Unfortunately I get TONS of spam (20-50 messages per day are automatically filtered, and those are just the ones that get by the RSS/DUL/RBS). As it turns out, people named Ben use my email address as a fake address or a test address all the time. And recently I tracked down one person who was doing it who told me that "ben" means "me" in Turkish, so me@me.com => ben@ben.com in Turkey!
I guess the moral of the story is to choose your primary email address carefully, because even if you aren't deliberately registering domains to catch phony email addresses, you might do it anyway!
Fuji Velvia has incredibly high saturation and fine grain. It is the landscape chrome of choice. However, it butchers skin, which is its major shortcoming.
Competing music compression formats which acheive 10:1 reduction in file size will be irrelevant when the average user has 10x more network bandwidth and storage devices with 10x the density.
So in 5 years when it is feasible to FTP entire albums of uncompressed 44.1kHz 16 bit stereo sound to your home PC and write them onto flash cards which hold 2-10G of data, who will care if the RIAA supports a proprietary compression format for music distribution?
Slashdot Mirror
You could build a trap for such crawlers in the form of randomly generated HTML documents which each reference a few more fake URLs which generate more random HTML documents... Disallow that tree in your robots.txt and let the robots who disregard it suffer.
:-)
The best random document generator would be a Markov chainer which had been feed all of the top level category pages from Yahoo! to make sure you have lots of juicy keywords to index.
And in that case the RBL (which I use) was of no help since all I got was all the bounces ...
Actually the RSS could have helped you in that case. If the open relay connected to a mailserver and it said 550 User unknown then the relay itself would be generating the bounce message and trying to send it to you. If you had been using the RSS to block such open relays, bounces like that would have been rejected.
In 1992 I registered ben.com just so I could be ben@ben.com. In the past I've been extremely careful not to let it fall into the hands of spammers, using tricks like others describe (dedicated per-service aliases and the like). Unfortunately I get TONS of spam (20-50 messages per day are automatically filtered, and those are just the ones that get by the RSS/DUL/RBS). As it turns out, people named Ben use my email address as a fake address or a test address all the time. And recently I tracked down one person who was doing it who told me that "ben" means "me" in Turkish, so me@me.com => ben@ben.com in Turkey!
I guess the moral of the story is to choose your primary email address carefully, because even if you aren't deliberately registering domains to catch phony email addresses, you might do it anyway!
Fuji Velvia has incredibly high saturation and fine grain. It is the landscape chrome of choice. However, it butchers skin, which is its major shortcoming.
Fuji makes some nice portrait films, mainly NPH.
Competing music compression formats which acheive 10:1 reduction in file size will be irrelevant when the average user has 10x more network bandwidth and storage devices with 10x the density.
So in 5 years when it is feasible to FTP entire albums of uncompressed 44.1kHz 16 bit stereo sound to your home PC and write them onto flash cards which hold 2-10G of data, who will care if the RIAA supports a proprietary compression format for music distribution?