Slashdot Mirror

← Back to Stories (view on slashdot.org)

Google URL Index Hits 1 Trillion

Posted by Soulskill on from the orders-of-magnitude dept.

mytrip points out news that Google's index of unique URLs has reached a milestone: one trillion. Google's blog provides some more information, noting, "The first Google index in 1998 already had 26 million pages, and by 2000 the Google index reached the one billion mark. Over the last eight years, we've seen a lot of big numbers about how much content is really out there. To keep up with this volume of information, our systems have come a long way since the first set of web data Google processed to answer queries. Back then, we did everything in batches: one workstation could compute the PageRank graph on 26 million pages in a couple of hours, and that set of pages would be used as Google's index for a fixed period of time. Today, Google downloads the web continuously, collecting updated page information and re-processing the entire web-link graph several times per day."

4 of 249 comments (clear)

  1. Re:Amazing by Freaky+Spook · · Score: 5, Informative

    I couldn't agree more.

    Many of the clients I support are constantly asking me "Is there a program that does this? or Can you find me a program to do this" etc etc.

    I used to be able to just use google to help me get started but these days the top level searches are all those bloody link farms peddling "free" software, even when typing in the word review you come up with link farms that offer no reviews.

  2. No, it didn't. by aiken_d · · Score: 5, Informative

    They have identified that there are 1T pages out there, somewhere. They have indexed 40 billion pages. Read the entire Google post. It says it right there.

    Bad on Google for the misleading post. Bad on the submitter for not reading the misleading post. Bad on Slashdot for further descending into mindless repetition of mindless submissions of mindless PR announcements.

    --
    If I wanted a sig I would have filled in that stupid box.
  3. Re:How long till.. by onedotzero · · Score: 5, Informative

    ... and cut out Experts-Exchange.com from your search results since their pages don't actually return the information you think they do.

    Perhaps you should try scrolling to the bottom of the page... :)

  4. Re:How long till.. by Anonymous Coward · · Score: 5, Informative

    ...and cut out Experts-Exchange.com from your search results since their pages don't actually return the information you think they do.

    If you block cookies from experts-exchange.com you can actually see the answers on any e-e page - after you visit the first time, it normally sets a cookie to not show results next visit, which is how they get Google to index their pages anyway. With cookies from them blocked, you can then see the answers - you just have to scroll 7/8s of the way down the page past all the fake "Please sign up to see this result" boxes.
    (First AC post in years... tee hee. :)