Slashdot Mirror

← Back to Stories (view on slashdot.org)

Searching the 'Deep Web'

Posted by ryuzaki0 on from the sounds-more-like-the-deep-hurting dept.

abysmilliard writes "Salon is running a story on next-generation web crawling technologies, specifically Yahoo's new paid "Content Acquisition Program." The article alleges that current search services like Google manage to access less than 1% of the web, and that the new services will be able to trawl the "deep web," or the 90-odd percent of web databases, forms and content that we don't see. Will access to this new level of specific information change how we deal with companies, governments and private insitutions?"

15 of 193 comments (clear)

  1. With the 10% that is crawled by Trigun · · Score: 5, Funny

    being pretty much total crap, I'd really hate to see the other 90%!

  2. Porn!!!!!!! by Anonymous Coward · · Score: 0, Funny

    Best way to do a full deep search then

  3. Damn ... by Anonymous Coward · · Score: 2, Funny

    I remember browsing the WWW directory in '93 and being able to scroll through all the sites on my VAX session at university. Are you telling me I am one of the few people who actually ever reached the end of the internet?

    1. Re:Damn ... by radicalskeptic · · Score: 1, Funny

      Was the end guy hard?

      --
      WARNING: If accidentally read, induce vomiting.
  4. Oh yeah, a whole new pair of dimes by stienman · · Score: 3, Funny

    Will access to this new level of specific information change how we deal with companies, governments and private insitutions?"

    Yeah. It means I'll be able to use someone else's credit card for more of my transactions, since finding credit cards, SSNs and other...uh...'deep web' stuff will be so much more accessable.

    -Adam

  5. Deep Web? by dingo · · Score: 2, Funny

    Why do I get the feeling that you will get a lot more search results for Linda Lovelace when searching the "Deep Web"

    --
    The Borg assimilated my race & all I got was this lousy T-shirt
  6. Deep web? by hookedup · · Score: 4, Funny

    Doesnt crap sink? Not sure I want to know what the other 90-odd percent is. After tubgirl, goatse, etc.. what else could possibly be next..

  7. deep web? by rjelks · · Score: 4, Funny

    Is it just me, or does this sound like we're gonna get more pr0n when we search?

    -

    --


    Tech News, Reviews and Tutorials
  8. BOFFINS ENHANCE SEARCH BY IGNORING robots.txt by Anonymous Coward · · Score: 0, Funny

    More shocking news at 11am !

  9. Useless statistic of the week by Alomex · · Score: 2, Funny

    The article alleges that current search services like Google manage to access less than 1% of the web.

    There's a useless statistic if you ask me.

    I just wrote a cgi script that, upon requesting the url "http://bogus.com/nnnnn" returns a page with the text "nnnnn" where nnnnn is any number up to 1000 digits long. So there, I just added 10^1000 pages to the "deep web" of which google indexes none! (gasp).

    So there, Google now indexes less than 0.001% of the deep web.

  10. only missing 90 TB? by DeathBunnyRanger · · Score: 2, Funny
    the internet is only 90terrabytes?

    that is what salon says, and I think that is bull, given my favorite porn site offers 20gigs of raunchy action.

  11. More search results by earthforce_1 · · Score: 1, Funny


    So instead of 5,234,169 search results returned, we will see 45,961,384 results?

    Yippee!!!!!

    --
    My rights don't need management.
  12. Insight on the "deep web" by saddino · · Score: 3, Funny

    99% of the "deep web" probably looks like this. Indexable? Sure. Necessary? No.

  13. Re:Deep Web? by Rorschach1 · · Score: 2, Funny

    Doesn't observe it? It probably relies on it - tells you where the good stuff is!

  14. Re:Deep web? by djhertz · · Score: 1, Funny

    I had not seen tubgirl before.. Google found it right away. How... damaging to my eyes and soul.

    --
    Modest doubt is called the beacon of the wise - William Shakespeare