Slashdot Mirror


WebCrawler Turns 10 Today

Brian Pinkerton writes "WebCrawler, one of the first search engines on the 'Net, turns 10 today. You can read a short history of WebCrawler. When I wrote WebCrawler, one could do a credible job of crawling, indexing, and searching the Web from a single desktop PC. Today, the reality is a little bit different."

1 of 136 comments (clear)

  1. Gopher Broke by Space+cowbcy · · Score: 0, Troll

    WebCrawler is nothing more than a Gopher Ripoff. We knew it then, and we know it now.