Slashdot Mirror


DuckDuckGo Search Engine Erects Tor Hidden Service

An anonymous reader writes "Viewable with Tor installed, search engine DuckDuckGo has erected a hidden service for secure, encrypted searches through the Tor network. While past attempts at hidden service search engines failed due to uptime or quality issues, DuckDuckGo marks the first time a real company operating a public search engine has offered a solid search engine as a hidden service for Tor users."

59 of 87 comments (clear)

  1. Beavis & Butthead by KingAlanI · · Score: 3, Funny

    Hidden erection ... hurr hurr hurr

    --
    I listen to both RIAA and non-RIAA stuff if I like the music, tangential business/politics nonwithstanding.
  2. GoodLuckWithThat by rrohbeck · · Score: 2, Interesting

    How long until it's going to be shut down because you can find nasty bits with it?

    1. Re:GoodLuckWithThat by adamofgreyskull · · Score: 3, Funny

      "Nasty bits"? Do you mean 1s or 0s?

    2. Re:GoodLuckWithThat by Greyfox · · Score: 5, Informative
      Oh right, like you can't find nasty bits with a regular search engine. Here, allow me to illustrate. *rolls up sleeves* Oh, Google!
      Clown Porn
      Dolphin Sex
      Live goat porn
      Smurf Sex
      iranian leader Ahmadinejad gets a dirty sanchez... DOH! You have failed me, Google! Go now and think about what you've done!

      So you see, you don't need Tor to find some nasty shit on the Internet. You just need one of those pink things between your ears.

      --

      I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

    3. Re:GoodLuckWithThat by Jah-Wren+Ryel · · Score: 1

      "Nasty bits"? Do you mean 1s or 0s?

      Those are the other bits in the same mask as the evil bit - they are just less significant.

      --
      When information is power, privacy is freedom.
    4. Re:GoodLuckWithThat by julesh · · Score: 1

      How long until it's going to be shut down because you can find nasty bits with it?

      How would somebody go about shutting it down?

    5. Re:GoodLuckWithThat by beckerist · · Score: 3, Interesting

      I can't wait for that last one to show up in Google Trends.

    6. Re:GoodLuckWithThat by SudoGhost · · Score: 1

      Well, unlike other TOR servers, where anonymity hides the server's location, it's pretty obvious who's hosting this server. The Government would just be like "Hey...stop it."

      That's how.

    7. Re:GoodLuckWithThat by Greyfox · · Score: 1

      For that, I'd suggest googling on "Avatar Navi Homoerotic Fanfic". If you're more of a giant robots fan, "Transformers homoerotic fanfic".

      --

      I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

    8. Re:GoodLuckWithThat by julesh · · Score: 2, Interesting

      Well, unlike other TOR servers, where anonymity hides the server's location, it's pretty obvious who's hosting this server. The Government would just be like "Hey...stop it."

      That's how.

      And all they have to do is leak their database and TOR configuration files, and suddenly anyone can run it, and seamlessly for anyone using the TOR service URL. And as long as they lay the groundwork in advance, they can even deny having done it: an appropriate rootkit on their server should suffice to cast doubt on any evidence against them.

    9. Re:GoodLuckWithThat by mseidl · · Score: 1

      Bytes Gone Wild! When bytes expose their naughty bits! Not suitable for people under 18 or Ruby users.

    10. Re:GoodLuckWithThat by cheros · · Score: 1

      *Applaus*

      Congratulations, that was one of the funniest debunks I've seen in a while here. LOL..

      --
      Insert .sig here. Send no money now. Owner may sue, contents will settle. Batteries not included.
    11. Re:GoodLuckWithThat by Rhaban · · Score: 1

      "Nasty bits"? Do you mean 1s or 0s?

      1s into 0s

    12. Re:GoodLuckWithThat by arndawg · · Score: 1

      That would be 1010011010

    13. Re:GoodLuckWithThat by Eponymous+Bastard · · Score: 1

      More like 2s

      I mean, that's just unnatural.

    14. Re:GoodLuckWithThat by John+Hasler · · Score: 1

      DuckDuckGo is located in the USA, not in Europe.

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
    15. Re:GoodLuckWithThat by Nyder · · Score: 1

      I noticed you said regular search engine, then just used google.

      Is that the only regular search engine?

      --
      Be seeing you...
  3. So who is really behind this search engine? by Anonymous Coward · · Score: 1, Funny

    Which is it?

    NSA?
    CIA?
    FBI?

    All of the above?

    Which of the social policing groups (with some Acronym name) do we have to thank for this search engine service?

    1. Re:So who is really behind this search engine? by joe_garage · · Score: 3, Insightful

      nah - this smacks of the Ohio State Police

    2. Re:So who is really behind this search engine? by leuk_he · · Score: 1

      Those are far more interested in tor exit nodes.

      1. They think those are the people who look up material that illegal
      2. Running a sniffer on a tor exit node gives all kind of traffic that is anonymous, but not encrypted.

    3. Re:So who is really behind this search engine? by tepples · · Score: 1

      Running a sniffer on a tor exit node gives all kind of traffic that is anonymous, but not encrypted.

      Doesn't HTTPS work over Tor? Oh wait, plenty of hobbyist sites don't have a TLS certificate to begin with, and a lot of sites (such as Slashdot) save CPU time by redirecting all HTTPS URLs to the corresponding HTTP URL except for payment pages.

    4. Re:So who is really behind this search engine? by yegg · · Score: 1

      I'm behind it: http://ye.gg/

  4. Fail. by Anonymous Coward · · Score: 4, Interesting

    "This site requires JavaScript"

    How stupid is that, for a Tor hidden service? Sure, it may well provide "secure, encrypted searches", but there's going to be no guarantee of privacy for so long as it demands script active to function.

    How is this better than using any other search engine via Tor? At least Google/Scroogle/Ixquick/[many others] don't require script to perform such a very basic task, so at least with those I can feel confident about retaining my privacy, in addition to performing similarly secure, encrypted searches.

    1. Re:Fail. by jack2000 · · Score: 1

      They just want to discover your real ip, hence the javascript.

    2. Re:Fail. by rve · · Score: 2, Funny

      You're an idiot. Stop posting.

    3. Re:Fail. by Anonymous Coward · · Score: 1, Informative

      "How stupid is that, for a Tor hidden service?"

      relax, it's new. let's all provide feedback to the admin of the site with the suggestion of improving it by disabling javascript for the hidden service. the tor website has extensive documentation about hidden services if you don't know what they are, go read. irc for tor devs and users: irc.oftc.net #tor

      duckduckgo hidden service had a topic on the Tor mailinglist (or-talk) public may read and subscribe to these at Tor's website, click on "Docs" at the top, scroll down, subscribe to tor users or-talk.

      the only failure I see here is proper communication through proper channels. did you write to the duckduckgo admin?

      duckduckgo provides a free hidden service and could use a few tweaks but instead a coward moans, "fail." let's see you provide something better, quicker, without anyone quipping at your initial trials.

      "How is this better than using any other search engine via Tor? At least Google/Scroogle/Ixquick/[many others] don't require script to perform such a very basic task"

      do you understand how a hidden service works? searching google directly while using tor is often a useless venture, shooting you to a captcha page which often doesn't work even when you type and retype the same captcha. scroogle only recently wised up and began referring tor users to their SSL enabled page. how many other established search engines do you personally know of offering a free tor hidden service? zero according to my research.

      ssl certs are often duped through tor, i'd trust a hidden service over ssl certs through tor. accessing a site using ssl does have some pitfalls, research browser tech and ssl repeat visits and what, if any, the browser spills about you with repeat visits.

      it's new, it's free, it's unique, have a grain of patience and offer something constructive rather than honking the fail horn, anybody can do that and it requires no effort.

    4. Re:Fail. by CarpetShark · · Score: 2, Insightful

      Why is that? Because you don't get why a Turing-complete language with internet access could be a security threat?

    5. Re:Fail. by TheRaven64 · · Score: 2, Informative

      did you write to the duckduckgo admin?

      I've been using DDG as my main search engine for a few months, and this is well worth doing. I've used the feedback link a couple of times, to report cases where the search results are poor or there's a glitch in the UI, and both times I've had a speedy reply and the issue has been fixed.

      Of course, this might mean that I'm the only person using DDG, but I hope not. They have a very good privacy policy and a much better UI than any of the other search engines that I've tried.

      I used Clusty for a bit, because I liked how they presented the results (DDG actually does something similar for disambiguation), but their index was so small that I kept giving up and going back to Google. DDG has a link to the Google search at the end of their results - I've only clicked on it a couple of times, and in both cases I've also failed to find anything useful with Google.

      --
      I am TheRaven on Soylent News
    6. Re:Fail. by TheRaven64 · · Score: 1

      Example? As I said in an earlier post, I've been using DDG for a while and found it results helpful. There have been a few cases where DDG has only returned a dozen or so results and Google has returned thousands, but I got bored looking through the Google ones after four pages with nothing relevant. Oh, and if you do have JavaScript, you don't have to click on the next page link with DDG - it automatically fetches the next set of results when you scroll to the bottom of the page.

      --
      I am TheRaven on Soylent News
    7. Re:Fail. by julesh · · Score: 1

      Why is that? Because you don't get why a Turing-complete language with internet access could be a security threat?

      It's only a security threat if you can't trust the site that the programs are originating from. Sure, this search engine *may* be able to dump a tracking code into their output and therefore break the TOR privacy[1], but you have to ask how likely to happen is this? And my answer: very unlikely.

      [1] Doing so is, however, hard, an not even obviously possible: the identifying information javascript can access is rather limited, and it doesn't provide any means of bypassing your outgoing proxy server, so I don't *think* there's anything it can get access to that's damaging. It can identify your web browser and operating system, which is info you might be stripping out of HTTP requests with (e.g.) privoxy. It is also be able to list your browser plugins and their versions. Except in very unusual circumstances, I don't think we're talking enough information to identify an individual. And people in those circumstances ought to understand them well enough to be able to avoid the problem (we're basically talking people with custom browser builds, or private browser plugins).

    8. Re:Fail. by TheRaven64 · · Score: 1

      the identifying information javascript can access is rather limited

      Unfortunately, this is entirely wrong. For example, JavaScript can get your browser version, list of installed plugins, and whether you have visited certain sites quite easily. There are also a number of other things that you can do with JS to aid tracking.

      You can get some of this information without JS, of course, for example by providing various object or embed tags and seeing which ones are fetched.

      Of course, just because it's possible doesn't mean that DDG does it. They don't even use tracking information in their preferences cookie (unlike Google) - they just contain a simple preferences string so all users with the same preferences have identical cookies. And they don't leave any cookie unless you modify the preferences.

      --
      I am TheRaven on Soylent News
    9. Re:Fail. by icebraining · · Score: 1

      Oh, and if you do have JavaScript, you don't have to click on the next page link with DDG - it automatically fetches the next set of results when you scroll to the bottom of the page.

      I have the Autopager extension, which does the same for Google and a whole lot of other websites - and I don't need to give JS permissions to the website in question :)

    10. Re:Fail. by arndawg · · Score: 1

      The internet is only insecure if you don't trust the internet. Come one everybody. Let's trust the internet and share the love.

    11. Re:Fail. by drinkypoo · · Score: 1

      It's only a security threat if you can't trust the site that the programs are originating from.

      That's right. And I don't trust it. I only want to use a privacy network that works even if I don't trust all the participants.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    12. Re:Fail. by yegg · · Score: 1

      A non-JS version is imminent.

  5. Doesn't search hiddent Tor sites... by Anonymous Coward · · Score: 1, Informative

    Yeah, a new search engine... It doesn't search hidden services, it just operates as a hidden service. If you want it to...

    Oh, and as noted above it requires JavaScript to see any more results than the first few.

  6. Re:Got milk? by interkin3tic · · Score: 1

    Hee hee... "erect!"

  7. What's in the name? by SharpFang · · Score: 4, Funny

    Infamous 4chan often plays various jokes on the users - like "wordfilters", you post one word, the post contains another. You write "moot", your post contains "doug" and so on. Over some time 4chan wordfiltered "loli" to "duck". The anonymous liked the joke so much that once it was removed, users kept posting "links to duck porn" and so on.

    I can't help but think there's a connection.

    --
    45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    1. Re:What's in the name? by Trepidity · · Score: 3, Informative

      That was a SomethingAwful practice that 4chan later picked up, iirc. Possibly predates SA as well, but I think they popularized it on webforums, at least.

    2. Re:What's in the name? by rainmouse · · Score: 1

      Nonsense, everything cool starts on 4chan, why they invented rickrolling, lolcats, fire, the wheel, penicillin, the theories of evolution and relativity and even putting videos up of your favourite songs along with shitty kids cartoons featuring stupefyingly wide swords. Youtube and the rest of the web just follow along centuries behind the times.

      Before the trolltards come a-flaming me about the accuracy of my post or lack thereof, consider the tone of irony that many lack basic understanding off these days, the same awkward irony one might feel when their wife selects the iron in a game of monopoly.

    3. Re:What's in the name? by SharpFang · · Score: 2, Informative

      rickroll was a variation of duckroll, which in turn came to life after 'loli'='duck' was removed, but in turn 'duck' was wordfiltered to 'egg'. thus eggroll-duckroll...

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    4. Re:What's in the name? by fedxone-v86 · · Score: 2

      > 4chan

      Yeah, everything on the internet is connected to 4chan, right.

      Maybe you think to much about 4chan or loli or zoo sex. Huh, zoo sex? You haven't mentioned zoo sex in your post, at all.

      No, but you have set your fucking /. homepage link to your personal zoo sex / furry page!!! WTF!?

      WTF, dude!?

      --
      (USER WAS PUT ON PROBATION FOR THIS POST)
  8. Re:How can it be hidden? by CarpetShark · · Score: 2, Funny

    It's hiding in plain sight. Like ninjas.

  9. Re:hidden-shmidden by CarpetShark · · Score: 1

    So wouldnt the point of a Tor hidden search engine be that it can not be identified?

    What would be the point of building a website people can't identify? ;)

  10. Tor is compromised by Iamthecheese · · Score: 5, Interesting

    Tor is compromised by the US government. So go have fun on it but fon't get too cocky.
    linky (warning:.pdf)
    linky
    linky

    --
    If video games influenced behavior the Pac Man generation would be eating pills and running away from their problems.
    1. Re:Tor is compromised by bmajik · · Score: 3, Interesting

      Thanks for posting this. The Colorado paper is the key thing to read.

      Once I read that tor chose nodes according to an algorithm, and that the data used by that algorithm was not verified, and that this was done in the name of "performance", I could see where things were going in that paper. It was a "doh!" moment to be sure.

      It strikes me that for the things I'd want to use tor for, _really_ important things (i.e. not media piracy), high bandwidth and low latency are both unimportant. Privacy is more important. I don't want to download a dvd over tor, I want to send a short encrypted email to my conspirators.

      For such an application, I'd prefer onion routing that was buried in a covert channel.. something that didn't even look like a message at all. Something where the routing and the noise were both random, and the payload was simply lost in the mix. A factor of 10:1 or even 100:1 "Garbage" to "payload" would be fine for the average email or image.

      --
      My opinions are my own, and do not necessarily represent those of my employer.
  11. Duck Duck Go should be avoided - Here's why by theskipper · · Score: 3, Interesting

    I registered a domain a while back for an bike hobbyist site that I wanted to start. Nothing major, just swap tips and meetups to help out the community.

    Over the next few months I started getting random emails from some users that my site was "infected" and "hacked", etc. The first thought was that their machines were infected so I didn't think much of it. But I checked to see if there was anything wrong with my server and everything looked ok.

    Next thought was that somehow I got stuck in one of the Google filters in the SERP (i.e. "visiting this site may harm your computer") . Again, no evidence that was the case.

    So I emailed back to a couple of the folks that reported the problem and asked for a screenshot of exactly they were seeing. Sure enough I get a browser screenshot back that has DuckDuckGo plastered all over it, warning about how my site was not to be trusted.

    After some more research, it turns out that anyone browsing with the Duck Duck Go toolbar is hooked into a database at ivegotafang.com (also maintained by the Duck Duck Go folks). It acts as a net nanny and filters out parking pages and other "unsavory" sites on the fly. Sure enough, since the domain I used had previously been parked, it was still flagged as evil.

    To get out of the database you're supposed to go to the site and basically beg to be removed. On principle there was no way I was going to stoop to this level so I just told my users the story and to uninstall the Duck Duck Go toolbar. Everything was fine after that.

    Of course there are very few people using the Duck Duck Go search engine, let alone the toolbar. But the bigger issue is whether this behavior should be encouraged. This isn't like a net-nanny filter for porn. It's for something as innocent as a parking page which lots of sites resolve to while being developed.

    With Google a parked page simply doesn't show up in the index and they reeevaluate periodically. Duck Duck Go says they also reevaluate but that obviously wasn't the case for my site. The warning page is essentially a manifestation of guilty until proven innocent.

    What if there were a hundred for-profit companies like Duck Duck Go, and for each one you were responsible for their erroneous results? And what if you were running a business and just one of your customers saw that screen and started spreading the word that my business can't be trusted because of a false positive on Duck Duck Go? Then you're on the hook for spending hours trying to undo the damage, not Duck Duck Go. Good luck with that.

    Soapbox off. Imho, the whole Duck Duck Go thing is nasty and should be avoided at all costs.

    1. Re:Duck Duck Go should be avoided - Here's why by Anonymous Coward · · Score: 1, Funny

      TL;DR: They tried to do something good for their users, implemented it slightly wrong which affected you in a minor way.

      Telling thousands of users that they are nasty and should be avoided sounds like an appropriate response.

    2. Re:Duck Duck Go should be avoided - Here's why by ukemike · · Score: 1

      Would incorrectly listing a site as untrustworthy count as defamation?

      --
      -- QED
    3. Re:Duck Duck Go should be avoided - Here's why by CSMatt · · Score: 1

      To get out of the database you're supposed to go to the site and basically beg to be removed. On principle there was no way I was going to stoop to this level so I just told my users the story and to uninstall the Duck Duck Go toolbar. Everything was fine after that.

      How exactly is telling Duck Duck Go that your site was incorrectly blocked such a bad thing? So they screwed up. Instead of telling them of the problem and at least giving them the benefit of the doubt that despite their best intentions the reevaluation did not work as advertised, and that they will genuinely try and fix it as well as ensure that their system doesn't allow this to happen again, you immediately tell your visitors that Duck Duck Go is crap*, and not even bother to try and sort out the matter privately?

      If I was running the engine I'd certainly want to know when a false positive happens, and the chances of me finding out through your site or this post are basically slim to none. I don't even know what your site's URL is, so this post doesn't help much either.

      *I apologize if this wasn't the wording you put in your site. Again, I have no leads on how to access it to find out myself.

    4. Re:Duck Duck Go should be avoided - Here's why by yegg · · Score: 2, Informative

      Thx for the feedback. That toolbar is no longer available. The sites it was flagging were parked pages. What happened was is that there was a delay between registration and when the bot could check it out, but it would have been removed automatically. I'm sorry for the inconvenience this caused you.

  12. Clarification? by MikeUW · · Score: 1

    Can someone explain specifically what's special about this? How is this any better than using Tor yourself to search through any other search engine? Presumably, as long as you don't reveal personal information, your searches will be anonymous anyway. If that's the case, how does being able to point your browser to a *.onion domain to access a given service help - is it somehow more anonymous?

    (please don't read sarcasm into my question - I'm actually interested to know this).

    1. Re:Clarification? by moonbender · · Score: 1

      I don't know what's special about it, either; Tor services are interesting, but in this case they don't make a lot of sense. Tor usually prevents the server (and others) from determining the identity of the client. Tor hidden services extend this protection to the server itself, ie. you can access a site in the onion domain (if it works) without having any reliable way to determine the site's IP. The client's IP is unknown in both cases, so no, it's not more anonymous in that respect. I don't see the point in using a hidden service for a website with a well known public identity.

      --
      Switch back to Slashdot's D1 system.
  13. Re:hidden-shmidden by CarpetShark · · Score: 1

    Many sites have been shut down, despite claiming to do only what google does. A search index linking to leaked documents, for instance, would probably be under some pressure lately, especially if they couldn't identify the data sources, but only the index that people were finding them through. Hiding the search engine server would help protect them.

  14. Nastier by Steeltoe · · Score: 1

    More like 1.5, and you don't want those bits on your computer... ever.

  15. tor exit node mitm attacks. by leuk_he · · Score: 1

    Even when they do:

    A exit node can pretend to be the real site, and do a MITM attack. For simple joes you would just send the data unencrypted to the tos user and hope he does not notice it is an unencrypted page. (THIS HAS BEEN OBSERVED IN THE WILD!!!)

    3 letter agencies have their own root certificates and can reencrypt data that would be accepted by the browser as trusted. Only careful examinition of the certificate would show that is was issued by a differt CA.

    The whole point of TOR is that you cannot trust you own governmet police. But browser do give your governmet a root certificate of trust. really.

  16. Tor is nice, I2P is nicer by Steeltoe · · Score: 1

    Default Tor traffic, for normal websites like google.com, go through exitnodes. At the exitnodes, everything needs to be decrypted unless it's ssl or similarly encrypted at the application layer. Additionally the traffic is also directed to the REAL IP address. Combined with cleartext, it is quite a big risk actually.

    Basically, an exitnode needs the decrypted data for usual http / decrypted traffic, and is a heaven for snoopers and adversaries wanting to do man in the middle-attacks. Even SSL becomes insecure, since such a node gets the power to present fake ssl-certificates, so unless you're careful, or running Firefox with its annoying warning pages, you can be bitten even when using internet bank accounts. It's also easier to snoop SSL at such exitnodes, since you can just harvest keys and do very deep packet inspection, unless keys are transferred in another medium (how it always should be).

    Of course, since Tor is used by people seeking anonymity, the reward is higher for snoopers who want to find them. Besides, being an exitnode is a low barrier of entry to become a snooper as well, since every "shady character" is sending data your way. So do good research before using Tor, as care must be taken to preserve anonymity. Don't just run Tor and forget it.

    When using hidden services, everything is encrypted along the whole route. The onionrouting will ensure high barrier of entry for adversaries and snoopers. So such hidden services is indeed more "secure" than using google.com (which you can bet is giving APIs to governments and highest bidders to snoop on us), and any other "normal" internet service, including your ISP..

    What exitnodes and Tor is good at is this:
    Privacy: As in being one "dissident" among thousands of other voices. As long as you don't leak private information in any way, which excludes plugins, java and javascript (disable all such things now, even images can be "unsafe" unless you've anonymized your DNS requests).
    Speed: Snoopers of course wants to snoop on you with the utmost efficiency, so the exitnodes are blazing fast servers, which will be faster than relying on random nodes for reaching a "hidden service".

    But privacy may quickly be offset by bad research, usage of Tor or even unreleased attacks. Security threats may leak private information in the blink of an eye, especially when using exitnodes.
    Don't use Tor unless you REALLY REALLY need it (like getting killed), and do good research and proper setup of the entire machine. Preferably use a prebuilt VM like JanusVM.
    Or use Tor if you don't really care and want to try a new thing, but don't act surprised when your identity is leaked..

    Using this duck-search engine thingy is off limits, since it requires javascript. Forget it. You might as well use google.com or another hidden service which has no javascript requirements.

    If you like anonymity, I like I2P better than Tor. It has a nice community and does have more safe defaults than Tor. In I2P, outproxies, another word for exitnodes, are heavily disencouraged. Instead they're trying to build an entire network of hidden services, to do anonymous search, email, bittorrent, irc, websites, etc. INSIDE the darknet itself. It is like this article, but everything else is built inside the network itself as well. It's a huge project, with lots of volunteers.

    I recommend reading on their site how it works, you'll find they address much more issues than most other "darknets", and is open source and seems "honest" about what they know and don't know:
    http://www.i2p2.de/

    But you never know..

  17. Re:Warning Will Robinson, DANGER DANGER! by rainmouse · · Score: 1

    Are you sure about this? Because if so then that means someone has been looking for this on my Browser? Please be 100% certain in reply.