Is Microsoft Crawling Google?
triplecoil writes "Jason Dowdell over at WebProNews has written a piece questioning a tactic Microsoft might be using to beef up its new search engine. He thinks they might be dipping into Google's results to supplement its own. Dowdell likens it to leaving your garbage on the curb--anyone could conceivably go through it and take whatever is there for their own."
Add this to robots.txt
/
User-agent: msnbot
Disallow:
I will fight Micro$oft efforts to monopolize another area of the tech industry (to its detriment)
Google: Don't be evil!
Microsoft: Greed is good, greed works!
Obviously my conclusion should be taken as a grain of salt but it's a definite possibility. Microsoft very well could be screen scraping Google (or maybe even using their API, LOL) and crawling the urls it finds. It makes sense from a business case but I wonder if there are any legal issues there. I doubt it.
It's official: 14 year old AOL'ers are now known as "IT journalists."
Call me a literary pedantic, but I don't trust much journalism that includes "LOL".
The old Lie: Dulce et decorum est Pro patria mori
I don't think Google should block Microsoft's IP address ranges. If they did, how would Microsoft's employees get thier work done? You think they use search.msn.com? BAAAAAaaahhhh!
So what?
Bot Assisted Blogging