Slashdot Mirror

← Back to Stories (view on slashdot.org)

WebCrawler Turns 10 Today

Posted by ryuzaki0 on from the young-at-art dept.

Brian Pinkerton writes "WebCrawler, one of the first search engines on the 'Net, turns 10 today. You can read a short history of WebCrawler. When I wrote WebCrawler, one could do a credible job of crawling, indexing, and searching the Web from a single desktop PC. Today, the reality is a little bit different."

2 of 136 comments (clear)

  1. What about the evil web crawlers? by LordHatrus · · Score: 0, Offtopic

    Can't we celebrate their birthday too? :) Or their death day... :devilsh_smiley:

  2. History Link crashes browser by tonejava · · Score: 0, Offtopic

    Anyone else experience this? I click on the History of Web Crawler link (www.thinkpink.com) and my browser crashes - Mozilla FireFox, Netscape 7.1 and IE6...