Slashdot Mirror


Online Search Engines Lift Cover Of Privacy

Rican writes "MSNBC has an interesting article about how 'Googledorks' are using the powerful search engine to do searches across the web for sensitive and/or private information. Some of this information includes 'Medical records, bank account numbers, students' grades, and the docking locations of 804 U.S. Navy ships, submarines and destroyers.'"

75 of 460 comments (clear)

  1. Um. by Anonymous Coward · · Score: 5, Insightful

    While googlestalking is scary and bad and I'm not condoning it, in this *specific* case, if the docking locations of U.S. naval ships is something that they do not want made public perhaps they should simply not make them public?

    1. Re:Um. by Anonymous Coward · · Score: 5, Interesting

      The problem comes when google searches down records in web servers, and using partners such as Opera, will crawl into pages that are normally not publicly accessible!

      Here's how it works. Let's say you put a page on your site called

      http://yoursite.com/temporary/hidden/dontreadthi s/ private_document.html

      And it is not linked to ever.

      If you send that URL to someone using Opera with the right settings (but you don't know that) and they read the private document, within minutes GOOGLE WILL CRAWL THAT DOCUMENT!

      Nothing is private any more under situations like that. Let's say that private document then links to all your older private documents. Google can then freely crawl it's way in to read the rest.

      Who's to blame for this then? not you. You've already ensured you hadn't linked to it. Not the opera user, as they have read the document, and respecting your privacy they've not mentioned it to anyone else

      However underhanded tactics like sneaking in a google crawl in this manner is unacceptable to me. My firewall blocks all google crawler bots for this very reason

    2. Re:Um. by Anonymous Coward · · Score: 5, Insightful

      Maybe you should use some kind of security instead of just really -hoping- no one crawls/reads/caches your document.

    3. Re:Um. by mhesseltine · · Score: 4, Informative

      .htaccess anyone?

      That, along with an appropriate robots.txt file should be all you would need to prevent a crawl, right?

      --
      Overrated / Underrated : Moderation :: Anonymous Coward : Posting
    4. Re:Um. by Elwood+P+Dowd · · Score: 4, Informative

      Here's how it works. Let's say you put a page on your site called

      http://yoursite.com/temporary/hidden/dontreadthi s/ private_document.html

      And it is not linked to ever.


      I realize this is redundant, and you were likely trolling, but Google will leave you right the fuck alone, so long as you put another little file at:

      http://yoursite.com/robots.txt

      That contains the text:

      User-agent: *
      Disallow: /

      I realize this is opt-out rather than opt-in, but there's just one place you have to opt, and there isn't another way that Google could possibly do their job. Everybody else seems to understand that the internet is a publicly accessible network.

      So who's to blame? You. You put a sensitive document in a publicly accessible location on the internet, and took no precautions to keep it secure. Not linking to it is not a precaution.

      --

      There are no trails. There are no trees out here.
    5. Re:Um. by ecalkin · · Score: 5, Insightful

      documents that should not be available to the general public should be a) behind firewalls where the general public is on the other side, b) stored on web servers that require authentication to read such pages (where the general public does not have username/password), or c) not be stored on a web server!

      i think that this is somewhat an issues of bad management and somewhat (maybe more) and issue of the weakness of web service security (compared to something like local novell services).

      eric

    6. Re:Um. by pla · · Score: 5, Insightful

      Let's say you put a page on your site
      <snip>
      And it is not linked to ever.

      Then you have still put it in a publically accessible place, and bear full blame for others finding it.

      For a physical-world analogy, let's say that you want to give a note to a friend (which, for some reason, requires a non-conventional mode of delivery). You could leave it at page 416 of "The complete minutes of the Town of Dullsville, 1853 to 1862", which no one had checked out in the past 30 years. Tell your friend where to find it, and 999 times out of 1000, you'd have no problems.

      If you one day used that same method of sending a note, only to discover someone checked out the book and removed the note, would you actually have the gall to blame anyone but yourself?


      Slashdotters, of all people, have heard this over and over and over... Security through obscurity may help in addition to some form of "real" security, but it almost never works by itself. The web counts as a very public place. If you place sensitive information on it with no security beyond a "hidden" URL, don't act surprised when the NYT has it as a headline the next week.

      And for reference, yeah, I too have stuck random files up on my site for a friend to grab. But never when it would have mattered if someone else randomly found those files.

    7. Re:Um. by Elwood+P+Dowd · · Score: 3, Insightful

      It's worth a damn if we're talking about Google or archive.org.

      No, it's not worth a damn if you're talking about actually sensitive data.

      --

      There are no trails. There are no trees out here.
    8. Re:Um. by ameoba · · Score: 3, Interesting

      If it's sensitive, it shouldn't be world readable. Ever. It shouldn't matter if you know that htttp://www.CIA.gov/secret/topsecret/locationsOfAl lAgentsInTheWorld.xls is where the file is; the server shouldn't let anyone load it.

      --
      my sig's at the bottom of the page.
    9. Re:Um. by shaka · · Score: 4, Funny

      If it's sensitive, it shouldn't be world readable. Ever. It shouldn't matter if you know that htttp://www.CIA.gov/secret/topsecret/locationsOfAl lAgentsInTheWorld.xls is where the file is; the server shouldn't let anyone load it.

      Dude, if you think writing "htttp" with three t:s and put a space in the URL is gonna stop people from finding that document, you're pretty behind to tell you the truth.

      I do wonder, however, how YOU knew the location of locationsOfAllAgentsInTheWorld.xls? That's supposed to be a secret!

      --
      :wq!
  2. Kazaa and Gnutella are cooler by baryon351 · · Score: 5, Interesting

    Go into kazaa and gnutella and search for any .doc files. Or some likely sounding names like "resume" or "job application"

    It's surprising what people will sit in their kazaa upload directory, using it like a documents dump. Legal papers, company's employee policy documents, employee records, sensitive stuff, medical records.

    Taken straight from people's HDs, no hacking, cracking or other media-unfriendly terms needed, just the ignorance of the people who leave this stuff open is needed.

    1. Re:Kazaa and Gnutella are cooler by sunrein · · Score: 4, Interesting

      No kidding. I did a search using Poisoned (kazaa, gnutella, etc.) to find some tax software. Some colossal moron had left a copy of his tax papers in pdf format in his upload directory. Good thing I'm a kind soul and let him know about it. That would've been easy pickings for someone looking to do some identity theft.

    2. Re:Kazaa and Gnutella are cooler by tsvk · · Score: 5, Informative
      Go into kazaa and gnutella and search for any .doc files. Or some likely sounding names like "resume" or "job application".

      Other examples are ".dbx", the file name extension for mail folders in Outlook Express. Or ".pwl", the Windows 9x system password file (supposedly easily crackable with the correct tool).

      There are unfortunately clueless users who share their whole hard drive. File sharing programs have however started getting better in discouraging or preventing the users from doing this.

    3. Re:Kazaa and Gnutella are cooler by mcrbids · · Score: 3, Interesting

      Another nasty one to search for is reg.dat... the Windows registry file.

      Here, you can get registered names, phone numbers, software keys, and all kinds of other scary stuff...

      I tried it once, and was shocked at how many I found it in just a few seconds...

      --
      I have no problem with your religion until you decide it's reason to deprive others of the truth.
    4. Re:Kazaa and Gnutella are cooler by cpex · · Score: 3, Funny
      Go into kazaa and gnutella and search for any .doc files. Or some likely sounding names like "resume" or "job application"

      I dont know about you but the more people that see my resume the better.

      JV

  3. Cover of "Privacy" by mobiGeek · · Score: 5, Insightful
    What "privacy"? The information is posted on the WORLD WIDE Web...

    --

    ...Beware the IDEs of Microsoft...

    1. Re:Cover of "Privacy" by IntelliTubbie · · Score: 4, Insightful

      What "privacy"? The information is posted on the WORLD WIDE Web...

      Perhaps a more accurate title would have been "Online Search Engines Remove Delusion Of Privacy."

      Cheers,
      IT

      --

      Power corrupts. PowerPoint corrupts absolutely.

  4. I've heard of "cow orkers"... by Black+Parrot · · Score: 5, Funny


    ...but what the heck are "googled orks"?

    --
    Sheesh, evil *and* a jerk. -- Jade
    1. Re:I've heard of "cow orkers"... by Snad · · Score: 4, Funny

      ...but what the heck are "googled orks"?

      It's the technical term for searching the web for the name of an extra in the big fight scenes in The Lord of the Rings movies.

      This is a very popular pass time in New Zealand, where 95% of the country's population was used in the Minas Tirith scene.

    2. Re:I've heard of "cow orkers"... by jridley · · Score: 4, Insightful

      OT:
      How come Homer and Krusty look like clones?

      It's intentional. MG originally intended it to be a joke; Bart didn't respect his dad, but he worshiped a clown who looked exactly like his dad. He mentioned this on an NPR interview last week.

  5. Why Google? by lostchicken · · Score: 4, Insightful

    Why do people always have to drag Google into this sort of thing? Somewhere, someone is pissed off at Google for putting their medical records on the web, and letting people get at them, when they should be angry at the people who posted them to the web in the first place. It's like calling Southwest Bell your partner in crime because you used DSL to steal from an online bank. It just makes SWBell look bad, just as this makes Google look bad.

    --
    -twb
    1. Re:Why Google? by agentZ · · Score: 4, Insightful

      Google is a tool, and tools can be used for good or for bad.

    2. Re:Why Google? by Xenographic · · Score: 4, Informative

      1) This is old. I remember searching for things like '"index +of" vti' and other such things (try it and modify that search if you like, but it was interesting to find out just what sort of interesting tidbits one might find in such a folder).

      2) This is an article from MSN. This information was available long before Google, but it is, at the very least, curious to see this sort of article from Microsoft when they have been going to the press lately about how Microsoft intends to develop their own search technology...

    3. Re:Why Google? by shird · · Score: 4, Interesting

      And why wouldnt the guy at sears be considered a 'tool'? He is a 'device' _used_ for finding the information you want.

      The same as a metal detector or store directory leaflet - these are tools used for information retrieval.

      --
      I.O.U One Sig.
  6. SS Minnow by flewp · · Score: 4, Funny

    But can they find the last port location of the SS Minnow?!

    --
    WWJD.... for a Klondike bar?
  7. The worst example.. by centralizati0n · · Score: 5, Informative

    The worst example I saw was the FBI NCIC 2000 manual [PDF]. It gives you examples of how to look up criminal records and such... which could be very useful to the criminally vested social engineer.

    1. Re:The worst example.. by scottd18 · · Score: 4, Interesting

      Most of the codes are actually to enter stolen property. To query a CCH on a person you need a name, sex and DOB. You can also use a SSN.

      Most of the info you get back is kinda boring. With the exception of juvenile arrest data, it's all public record. But you'd have to know what court house to go to. the NCIC CCH file brings it all into one place.

      You'd get, name, race, sex, dob, ssn and dl info, along with height, weight, hair and eye color, fingerprint classification along with a listing of arrests, and court dispositions of those arrests.

      If you are going to steal someone's identity, you could do better than stealing a crook's.

      If you know someone has been arrested by the Anytown Police Department. Go to their records section and do an open records act request for the last arrest's booking sheet. Most likely you'll get most of their identifying info except the SSN.

      But whatever you do, don't ever run the President's DL. The Secret Service gets real nasty about that!
      --
      Heck is a place for people that don't believe in gosh.
  8. You can do this on KaZaA too. by leeum · · Score: 5, Interesting

    This isn't anything too new. For kicks, I once searched for "Resume" and "Credit card" on KaZaA and got hundreds of results. Presumably, the trouble is that people sometimes believe that security through obscurity works - or, in the case of KaZaA, a lack of attention leads people to share files they didn't really want to.

    Interestingly, I found a text file with all the user names and passwords for brokerage firms, and bank accounts, of the IT director at the firm I was working in. Scary, considering he was supposed to have "15 years in the IT industry".

  9. Could happen to you by bendelo · · Score: 5, Interesting

    A while back I Googled my credit card number for a laugh. I was shocked to find it in an indexed webserver log for a site I had previously 'tried' to purchase from. (the form timed-out and I gave up).

    A quick call to the bank and a few angry calls to the company sorted it, but I was not impressed.

    Perhaps a tool to search for ones own private details should be developed to keep an eye on this?

    1. Re:Could happen to you by Animaether · · Score: 4, Interesting

      Question is.. do you trust the search engine(s) being used ?

      You say you typed your CC# into Google. Unless I missed something, this means that...
      1. It was transmitted over an unsecure connection
      2. It may have been logged as part of regular access logs
      and for the paranoid
      3. It may have been logged specifically as a potential CC# at Google (either due to the company having such a dubious programme, or a rogue employee / group of employees).

      For all you know now, if you searched Yahoo in the future (for whatever reason), your search query with Google may pop up :)

    2. Re:Could happen to you by bobthemuse · · Score: 4, Funny

      A while back I Googled my credit card number for a laugh.

      I wonder if google has a feature where I can view recent search terms...? You had a laugh, I get a giggle, we're all having fun!

  10. Cue Dr. Evil by Clinoti · · Score: 5, Funny

    The most basic way to keep Google from reaching information in a "Web server", security experts said, is to set up a "digital gatekeeper in the form of an instruction sheet for the search-engine's crawler. That file, which is called "fembots.txt"

    --

    Let's keep in mind that patents are in place to keep lawyers employed and keep them litigating. -CatGrep

  11. Nothing new by dattaway · · Score: 3, Informative

    People have used this for years to find things like Bill Gates' social security number and all kinds of things we think should be private. Chances are, if its in a record somewhere, that information will leak onto the internet sooner than most people think.

    1. Re:Nothing new by Beatbyte · · Score: 4, Funny

      you mean 539-60-5125?

    2. Re:Nothing new by Ivan+the+Terrible · · Score: 4, Insightful

      If Bill Gates is using the same SS # that was leaked in 1995, then he is a total moron. He is not a moron. Therefore he is not using the same SS # that was leaked in 1995. QED

  12. FUD Story to pump MSN Search? by Quizo69 · · Score: 3, Interesting

    Hmmm, let's see:

    1. Microsoft has stated it wants to win the search engine war.

    2. MSNBC (Microsoft owned) puts out story calling Google insecure because it invades your privacy.

    3. MSN Search comes out with "secure, private searching" for only $9.95 a month.

    4. Profit???

    Conclusion: This is nothing more than a FUD story designed to sow the seeds of doubt about Google.

    1. Re:FUD Story to pump MSN Search? by npistentis · · Score: 3, Informative

      it was an AP story- I read the same thing in this morning's washington post.

      --
      Gentlemen, you can't fight in here! This is the War Room!
  13. Homework answers by form3hide · · Score: 4, Funny

    Lets pretend I'm taking a computer science course.

    Lets pretend each week I have a program to code.

    You see if you pretend, of course, I put the filename into google, and clicked search. In pretend, you know what came up?

    The source code to the program I had to write for my university.

    But remember, this is in pretend land.

    1. Re:Homework answers by DiveX · · Score: 3, Funny

      Great. Now I have to shift through about one million pages with the term 'Hello World" in order to find the one I need. It is going to take me like 5 hours to find this when I could write it in a span of 3 minutes. There goes my afternoon.

      --
      Cave, wreck, and deep diver.
  14. Hard to hide by BWJones · · Score: 4, Insightful

    This all brings up one of the central tenets of computer network security: If it is connected to the Internet, it can be accessed, and sometimes the probing computers that are looking leave their little IP footprints all over the place. For instance, I was rather surprised a couple of years ago watching some IP's scroll through while someone/a software bot was accessing my workstation. Whois revealed nothing, but traceroute revealed an IP that allowed me to do a little more poking around to find out the identity as something from a "Special Collections Service" in Maryland. A little more poking around revealed it to be something involving a state department program whereupon I rather quickly decided to stop investigating. I still don't know anything about them or what they do, but it is surprising how hard it can be to be anonymous on the web. Hey, I am sure even all those Slashdot anonymous coward posters are leaving IP's that can and are documented. :-)

    --
    Visit Jonesblog and say hello.
  15. web servers for morons by belmolis · · Score: 5, Insightful

    The real story here is that companies and other organizations and institutions are setting machines up as servers and are too stupid to create an appropriate robots.txt file and/or keep their confidential information elsewhere. Google doesn't just drop in, even on networked machines. I have some sympathy for individuals who don't understand what they are doing when they make their machine a server, but surely any professional sysadmin, even one with limited training and experience, should know better than this. It's the same as leaving your briefcase on the front seat of an unlocked car.

  16. so who owns it, how can we stop it? by HealYourChurchWebSit · · Score: 5, Insightful



    Part of this problem comes out of who owns the daggoned data. For example, let's say a hospital, instead of using clipboards, uses smartcards to hocket about patient records.

    Who own's the data. The hospital, the insurance company paying the bill, or the poor schmuck on the business end of a colonoscopy?

    I ask because without the indiviual having the write to own the data, there seems to me little that can be done to protect oneself other than go through expensive and tedious legal channels.

    And if someone else can own sensitive data about me, then what can we do, as private citizens with limited resources, to make sure larger entities such as insurance companies play by rules like HIPPA?

    --
    --- have you healed your church website?
  17. Geez by Wolfier · · Score: 4, Insightful

    If your information is "sensitive" or "private", do yourself a favor and don't put it on the web.

    Peeps nowadays...

  18. Re:Google threatens privacy and national security by JanneM · · Score: 4, Insightful

    Shouldn't Google take precautions to make sure that sensitive data doesn't fall into the wrong hands?

    No, they should not. They are not in a position to know what _is_ sensitive - and to whom. They can reasonably only assume that anything reachable with an ordinary, polite spider is meant to be accessible to the world at large. If you feel certain information should not be made accessible, bring it up with those actually making it accessible, not with those just indexing it once it is.

    Shooting the messenger is not just pointless, it is counterproductive.

    --
    Trust the Computer. The Computer is your friend.
  19. Re:Google threatens privacy and national security by Concerned+Onlooker · · Score: 4, Insightful
    Sensitive data? Just because it's found through Google online doesn't make it any more sensitive or useful for terrorists. You can walk into any aviation bookstore and buy sectionals for the whole country, and they've got a lot more info than some MapBlast gif file.

    --
    http://www.rootstrikers.org/
  20. nothing new by martin-boundary · · Score: 4, Funny
    People have been doing searches for private, sensitive, pr0n logins and passwords for years...

    Err, not me of course ;-)

  21. docking locations of 804 ships? by usn2fsu03 · · Score: 5, Insightful
    That's more than twice the number of ships currently in service.

    Also, these are not precise locations. Yeah, you can find that the USS Roosevelt (DDG-80) is homeported in Mayport, Florida but you're not going to find the precise pier number.

    As for ships on deployment, one can find their general locations just by looking at the latest issue of the Navy Times and by reading the newspaper of the town that the ship and its battlegroup are from.

    The Navy really tightened up on what get's posted on official ship's websites after 9/11. If there is sensitive information still out there, Google is not at fault, but rather the unit's webmaster, Commanding Officer, and the Operational Security people who are supposed to be looking out for that sort of thing.

  22. Fuck that shit by Anonymous Coward · · Score: 4, Insightful

    Maybe they should just use the fricking robots.txt protocol. That's what it's *FOR*. You can put a little file named robots.txt in the directory you want hidden, put text in it that says "i want this hidden, google", and google will ignore your directory forevermore.

    No one has any right to complain if their page is in a search engine unless they followed the robots.txt protocol and the search engine did not.

    1. Re:Fuck that shit by Anonymous Coward · · Score: 3, Insightful

      The problem with this is, anybody can now download your robots.txt and have a list of your unprotected sensitive data.

    2. Re:Fuck that shit by Senior+Frac · · Score: 4, Insightful

      Not if the robots.txt file prevents you from accessing that data, which it does.

      The robots.txt file prevents nothing. It's merely a request that the spider "not go here." It's not a lock on the door. It's a sign that says, "please do not enter my house."

    3. Re:Fuck that shit by finkployd · · Score: 3, Informative

      Not if the robots.txt file prevents you from accessing that data, which it does.

      No, it does not. It provides absolutely NO access control what so ever. It simply tells the a search engine crawler "please do not catalogue these pages".

      Finkployd

    4. Re:Fuck that shit by micromoog · · Score: 4, Funny
      More specifically, it says "Please do not enter my house and steal my jewelery and banknotes which are in the safe in the bottom-right of the bedroom closet."

      The safe, however, should be locked.

    5. Re:Fuck that shit by saforrest · · Score: 3, Interesting

      The problem with this is, anybody can now download your robots.txt and have a list of your unprotected sensitive data.

      Not really. I mean, you're not really giving much away with

      Disallow: /personal/

      unless going to http://mysite.com/personal/ returns a directory listing.

      The general point is that yes, you do have to trust people to respect the robots.txt. The problem we're talking about is Google, though, and we know they do respect it.

  23. Re:Nothings private by littlerubberfeet · · Score: 4, Interesting

    Nothing is private any more. I wholly agree. But:

    Anyone else notice that the site is msnbc.msn.com? Isn't Microsoft trying to develop a google competitor?

    Am I just another cynical bastard?

    --
    Sig (appended to the end of comments you post, 120 chars)
  24. /. google! by potpie · · Score: 3, Funny

    now's our chance! I think we can slashdot Google!

    --
    Esoteric reference.
  25. What I like by Anonymous Coward · · Score: 5, Informative

    The thing is that most people will literally inadvertantly share their entire hard drive's contents, or at least all "media files".

    What I like to do is go on gnutella or kazaa and search for "DSN" or one of a number of similar prefixes. Why? Because most digital cameras save their files in a specific hardwired format, and the kind of people who leave their entire hard drive shared on kazaa are the kind of people who don't rename their digital cameras.

    You can find the most random, interesting, occationally personal shit that way.

    I'm trying to remember the other common prefixes besides DSN and failing.

    -- Super ugly ultraman

    1. Re:What I like by exhilaration · · Score: 4, Interesting
      Check this out: Random Personal Image Finder -- it searches for image files that use the default names assigned by digital cameras.

      Click on the "show me some pictures" button at the upper-right.

  26. Google can't always hack it by Lifewish · · Score: 5, Interesting

    I am a member of a university organisation called the Assassins Guild, the basic premise being that, on the basis of the most limited possible information, we hunt down and "kill" other guild members with weapons such as cap guns and cardboard swords. As such, I have some personal experience of the use of Google in stalking. I can tell you that, in a university composed presumably of some of the most net-savvy people around, I have only found a photo once. Occasionally I have found a usenet posting or slashdot account. Old schools are common, but the folk at my uni are often those who are mentioned in school newsletters. The average web presence of the average user is approximately nil. In a range of cases, someone may become more prominent (either by accident or design - Darl McBride for example), but on the whole there is very little you can gather from Google. Occasionally it's enough to kill your target, but don't count on bank details.

    --
    For the love of God, please learn to spell "ridiculous"!!!
  27. old skool trick by shird · · Score: 4, Insightful

    An old trick I used to do was searching for something along the lines of

    "http://*:*@" member

    and you would get a bunch of sites with direct links into passworded member sites. Microsoft will put a stop to this with their latest update to IE however.

    --
    I.O.U One Sig.
  28. Get a clue by Chuck+Chunder · · Score: 4, Informative

    The google mediapartners bot which will look at pages for the purposes of advertising such as in Opera is different and seperate from the bot that adds pages to Google's search database. The mediapartners bot does not feed the Google search engine.

    --
    Boffoonery - downloadable Comedy Benefit for Bletchley Park
  29. Re:Nothings private by MrNybbles · · Score: 5, Insightful
    Am I just another cynical bastard?
    Yes, you are a cynical bastard, and the world needs more of you.

    And on a totally unrelated thought. . .

    Online search engines lift cover of privacy
    Is Yuki Noguchi on crack? Google does not do anything to privacy. All Google does is make it easier to find publicly available information. Maybe "Online search engines act as a catalyst to find private information" would be more a accurate title. ". . .cover of privacy" makes it sound like it was protected in the first place.
    --
    Losing faith in humanity one person at a time.
  30. Enough of the bullshit! by Chuck+Chunder · · Score: 3, Informative
    --
    Boffoonery - downloadable Comedy Benefit for Bletchley Park
    1. Re:Enough of the bullshit! by Syre · · Score: 4, Informative
      Hmm... if Opera doesn't send URLs to Google, why does it say on the page you linked (bold and italics mine):

      Opera's interaction with the Google ad system:
      • The Opera browser sends Google the URL of the web page you are
        visiting
        and your IP address (with the exceptions Opera filters
        out -- see below)
      • Google tries to determine your general geographic location based on your
        IP address, to better target the ads
      • The Google ad server consults Google's web database to find out what kind of content
        is on that page
      • Ads that are deemed most relevant are then served based on geographic location
        and the Web page accessed
  31. Tin Foil people, please observe by Shimmer · · Score: 4, Funny

    This article is from the Washington Post, not from Microsoft. Please adjust your conspiracy theories accordingly.

    --
    The most rabid believers in American Exceptionalism are the exact same people whose policies are destroying it.
  32. Primary issue is the historical data problem by xant · · Score: 3, Insightful

    Google and the wayback machine, respectively, have memories. Just because you take something off the web doesn't mean it can't be found by those services; it just means it won't respond to your browser's request. Cached results and so forth are dangerous. If there ever was leaked data about the locations of those ships, it can still probably be found somewhere, and if that information hasn't changed since it was taken off the web, it's still a problem.

    This applies to any information that's ever been stored electronically; I call it the "backup tape problem". Someday, that information may (will?) find its way online, a public service will index it, and the genie will be out of the bottle forever.

    --
    It's rare that you're presented with a knob whose only two positions are Make History and Flee Your Glorious Destiny.
  33. Just gotta watch out for the honey pots by a.koepke · · Score: 4, Interesting

    I was looking at a few examples and tried out intitle:"Index of..etc" passwd. The first result is a honey pot :)

    They have some Webalizer stats for the honey pot too.

    --


    (\(\
    (^.^)
    (")")
    *This is the cute bunny virus, please copy this into your sig so it can spread
  34. Now to use it for good by Felinoid · · Score: 3, Interesting

    How to use this for evil is obveous. (Actually I do searches on myself ever now and then just to see what I look like on the Internet. Do it yourself it's fun.)

    Your an evil badguy and go nuts on Google... Credit Cards... Horray... Now to go nutz.

    Leave it to MS NBC to neglect to mention that this is also a tool for good.

    Your a credit card holder..... Now go google your credit cards... DO IT NOW.
    Did you find it? I didn't.

    I've got 4 credit cards.. two store cards one business visa and one personal mastercard.
    (Oh yeah hackers the name on the card is Felinoid) Yeah they'll buy that.. not...

    Don't need to use Google BTW... Use Alta Vista.. or Microsoft serch.. or Lycos...

    Oh yeah and when your done put your credit cards away (I had to leave desk while entering post an left my wallet on desk... Now my credit cards are gone and I think I saw a stuffed teady bear running down the street yelling "Charge it"... Just kidding got all my cards..).
    (Oh yeah if you do see a teady bear running down the street your missing credit cards are the least of your conserns)

    Now to set up a bot to trap all thies searches on Google....
    (Oh come on it had to be said)

    --
    I don't actually exist.
  35. wait... by djupedal · · Score: 3, Interesting

    Google will leave you right the fuck alone

    All it takes is one cross-link from a site that links, and a number of hits, and google will advertise the cross-link, robots.txt or not.

    1. Re:wait... by djupedal · · Score: 4, Insightful

      Or you realize that putting something on the internet means that it is no longer private..... regardless of how stupid it is to say that google will leave it alone if you just ask..

  36. Re:Uh-huh. by Anonymous Coward · · Score: 5, Informative
    > Want to expand on that or are you just trolling? How did the
    > existance of that page get from Opera to Google such that it
    > could pin-point (not crawl) that page?

    Opera submits URLs browsed to by users, to google, when advert support is turned on.

    http://www.opera.com/adsupport/

    From that page:
    --------
    What is the connection between the Web page and the relevant ad displayed by Google?
    Opera's interaction with the Google ad system:

    The Opera browser sends Google the URL of the web page you are visiting and your IP address (with the exceptions Opera filters out -- see below)
    --------

    Exceptions are https, forms, passwords, cgi, and non-http URLs.

    As an example from my apache log file last night, when I gave a friend a URL to a photo:
    xxxxxxx.upc-g.chello.nl - - [10/Feb/2004:02:23:53 +1100] "GET /temporary/sooted.jpg HTTP/1.1" 200 74339 "-" "Opera/7.23 (X11; Linux i686; U) [en-GB]"
    crawler8.googlebot.com - - [10/Feb/2004:02:28:39 +1100] "GET /temporary/sooted.jpg HTTP/1.0" 200 74339 "-" "Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)"
    It's surprising how many Opera users will deny this happens, despite the evidence. That's a 5 minute delay, google is pretty quick with its crawling. Personally, I don't mind. I put things up in my temporary directory and pull them down fairly soon after. I know nothing is secure if it's just an unprotected URL, so I'm not worried like the grandparent poster. However, Opera does send URLs to google, and google does come back and check them out.
  37. Good! by ottffssent · · Score: 5, Insightful

    Hopefully this sort of flagrant violation will draw at least a modicum of public attention.

    This isn't some hardened criminal mastermind at work. It's not a seasoned cracker attacking military targets. This isn't even some script kiddie poking at IIS. It's a MACHINE. A machine that respects robots.txt for Eris' sake!

    If medical records and other "real" secrets are this visible, something is terribly wrong and I want to see public floggings. Seriously, this is not a case of weak security, or poor security, or incompetent security. It's a case of there not being so much as a screen door between the public and sensitive information.

    This is actually a case where I think the government (or at least the courts) can do some good. You'll notice banks don't get hacked on a daily basis. That's because they'd lose squintillions of dollars if it happened. But nobody cares about my medical records because it costs money not to have incompetent asses running things. On the other hand, if revealing to without were punishible by a $1000 fine per person, per offense, you'd notice a severe tightening of security in a mighty big hurry.

    It's a shame that suing people is sometimes the only way to get their attention, but with the decline of basic civil responsibility it might be inevitable.

  38. There's good stuff out there not on Google by frovingslosh · · Score: 4, Interesting
    Google is great for a quick, lazy first pass. But there is a lot of information out there that Google never indexes, and some of it is full of interesting stuff. Several years ago a company I was working for tried to do a I.P.O. Curiously, the copy of the paperwork that they released to key people internally didn't have the good information in it. But I found the real I.P.O. paperwork on the Security & Exchange Commisions website (www.sec.gov). Great reading. They had to include the salary and perks of the President and all the V.P.'s (including the one I reported to).

    I don't know why Google never indexes this stuff, it's clearly public record and can be of interest to a lot of people, but they never did (I checked them many times, including just now, and they show no indication of the document). I wonder what other good government documents are out there if you only know where to look for them.

    --
    I'm an American. I love this country and the freedoms that we used to have.
  39. Some clues for you by Chuck+Chunder · · Score: 3, Informative

    a) Mediapartners-google does check robots.txt
    b) Opera always has the name "Opera" in it's UA string, even when masquerading as IE.
    c) Mediapartners-google doesn't feed the Google search engine. It is only used for Google adverts.

    --
    Boffoonery - downloadable Comedy Benefit for Bletchley Park
  40. Re:Google threatens privacy and national security by jasonditz · · Score: 3, Funny

    How can we not hold Mapblast (how's that name for irony!) partially responsible for the Two Towers tragedy

    I'd pin most of it on Saruman.

  41. This is *not* Hacking? by DeanFox · · Score: 4, Insightful

    I know this is very late in the discussion.

    But, if I wander into an unprotected system, like a bank or military site, and I start reading confidential documents... Is this not a crime?

    What's the difference if I locate the unprotected documents via a search engine or by using a port scanner with an IP range.

    I think what I'm saying is that port scanning and finding an vunerable system, going into that system and looking around is now a crime.

    But didn't I just describe what's going on with google hacking?

    I don't advocate nor believe any of this is a crime but where and why is a line drawn between them?

    I've often said about hacking that just because I go to the market and forget to lock my front door, that doesn't mean I expect to come home and find someone rumaging through my house.

    If it's an administrator who forgets to lock down a port or one how inadvertantly places confidential materal on the wrong box... Again, Where is the line and how is it drawn, and why, between criminal hacking and "it's on an open system, google found it so it's legal".

    I'm just asking. It's early in the AM and my brain isn't working because it's not seeing the difference. I'm only seeing a very fine line between what one might consider a "public" system versus one that expected to be "private". Is the only difference our "expectation" of privacy that makes one illegal and another a sport?