Slashdot Mirror


Watch DARPA Artificial Intelligence Search For Crime On the "Dark Web"

An anonymous reader shares this bit of news from DARPA. "Of late, DARPA has shown a growing interest in open sourcing its technology, even if its most terrifying creations, like army robot wildcats designed to reach speeds of 50Mph, are understandably kept private. In a week’s time, the wider world will be able to tinker with components of the military research body’s in-development search tool for the dark web. The Memex technology, named after an mechanical mnemonic dreamt up just as the Second World War was coming to a close, has already been put to use by a number of law enforcement agencies, who are looking to counter crime taking place on networks like Tor, where Hidden Services are protected by the privacy-enhancing, encrypted hosting, often for good, often for bad. In its first year, the focus at Memex has been on tracking human trafficking, but the project's scope stretches considerably wider."

35 comments

  1. I think it's bloody insulting by Anonymous Coward · · Score: 2, Interesting

    I spent a large part of my time in university studying the Memex and I find it absolutely insulting that this technology is being kept behind the curtain of classified intelligence technology when it's a decades-old invention intended to make everyone's life easier. Meanwhile any researchers that want to be involved have to make the ethical leap of turning their back on their friends, family and hometown so they can do the bidding of a dark shadow government organization.

    1. Re:I think it's bloody insulting by davester666 · · Score: 2

      It's not a dark shadow government organization anymore. Everyone knows the US gov't is chaotic evil, and the gov't is proud of what it manages to accomplish.

      --
      Sleep your way to a whiter smile...date a dentist!
    2. Re: I think it's bloody insulting by Anonymous Coward · · Score: 0

      well, it appears web, google, wikipedia and discussions on the net are very much the MEMEX thing. Of course if you have transcriptions of phone conversations, this helps.

      I venture to say the latter is not really required. Very small groups can do massive things these days. A proper education helps of course to separate chaff and grain.

    3. Re:I think it's bloody insulting by Anonymous Coward · · Score: 0

      No. The US government is lawful evil or lawful neutral.

      Most people misunderstand chaotic evil and think that just because it's chaotic it's the most evil alignment. That's wrong. Chaotic evil is about lawlessness and destruction.

      The US is pretty obviously conservative. Conservative = lawful.

    4. Re:I think it's bloody insulting by Anonymous Coward · · Score: 0

      From the first line of TFA "Of late, DARPA has shown a growing interest in open sourcing its technology,..."

      You can see the various repositories here: http://www.darpa.mil/opencatalog/

    5. Re:I think it's bloody insulting by Anonymous Coward · · Score: 0

      Conservative just means that you're old and unwilling to change with the times. Has nothing to do with law.

    6. Re: I think it's bloody insulting by Anonymous Coward · · Score: 0

      Thats fucking stupid, you are equating evil with unlawful. The jews were gased legally.

    7. Re: I think it's bloody insulting by Anonymous Coward · · Score: 0

      Also how is the US not disorderly? They "lose" 1 bil worth of funds, they "mistakenly" give al qaeda network 20 mil, they mistakenly drop their weapons above isis.... List goes on. But please, enlighten us further

    8. Re:I think it's bloody insulting by Anonymous Coward · · Score: 0

      You really have no idea what conservative means.

  2. Wow, a whole 50Mph? by Anonymous Coward · · Score: 0

    Mega pico hours? Mega pico hectares?

  3. "Often for good, often for bad" by Kyogreex · · Score: 1

    While I'm glad to hear they're open sourcing some technology... [quote]on networks like Tor, where Hidden Services are protected by the privacy-enhancing, encrypted hosting, often for good, often for bad[/quote] This is what concerns me. Just because the tool is supposedly there to find the bad doesn't mean that it can't be used to go after the good, and not just in the context of the US (though the US has proven itself perfectly willing to go after even journalists doing research into the subject: http://www.forbes.com/sites/sa...). You can't thwart the bad without thwarting the good as well.

    1. Re:"Often for good, often for bad" by Shakrai · · Score: 2

      What's your point?

      Firearms can be used to defend innocents or to kill them. Automobiles can be used to transport sick people to hospital or by drunks to make a beer run. Tor is used by activists to elude hostile regimes and by child porn traffickers. Nuclear fission can be used peacefully, to produce carbon free energy and medical isotopes, or to destroy cities and kill on a mass scale.

      Most technology is capable of being abused in the wrong hands. We don't halt R&D because of these concerns.

      --
      I want peace on earth and goodwill toward man.
      We are the United States Government! We don't do that sort of thing.
    2. Re:"Often for good, often for bad" by Kyogreex · · Score: 2

      Most technology is capable of being abused in the wrong hands. We don't halt R&D because of these concerns.

      And I never said anything to that effect that we should (or shouldn't). My point is exactly what I stated above: that you cannot thwart the bad without thwarting the good. That isn't to say anything about halting R&D or not halting R&D. It is to suggest that it presents a problem for the good as well as for the bad.

    3. Re:"Often for good, often for bad" by Anonymous Coward · · Score: 1

      No, but we can regulate it. Most of the world bans guns and you can't use nuclear fission as a private citizen. With self-driving cars we can safely ban automobiles - as we know them now - as well. The same will be for the internet: regulation is good. Only the government - the State - should have a monopoly on those technologies. Ordinary citizens must be kept on the leash for their own security and the security of the State. End of discussion. By the way, I'm a European and that means you can never, ever contradict me. Suck it up, loser. :)

    4. Re: "Often for good, often for bad" by Anonymous Coward · · Score: 0

      Indeed. If we only had finally a "good secret police". Then we could walk with leashes like dogs do. Only the bad guys would be immediately strangeld to death.

      Heil Sparta !

    5. Re:"Often for good, often for bad" by Anonymous Coward · · Score: 0

      Not every technology is perused though. We'll often halt R&D expressly because there are no "often for bad" implications. If it doesn't kill people or print money the powers that be don't want to know about it.

    6. Re: "Often for good, often for bad" by Anonymous Coward · · Score: 0

      A spy is a spy, one hopes the only people being hurt by leads are the ones holding them. Everyone else is just in a dog park :p

      Though then we're just constantly asking ourselves how much we like our naive freedom.

  4. Of course it does by Anonymous Coward · · Score: 0

    "but the project's scope stretches considerably wider" any scope or mission creep that can be found to use it to oppress people someone will.

  5. Hunting for pedos? by Anonymous Coward · · Score: 0

    Hum, I wonder if the real idea here is to locate brief-lived child pornography sites on TOR.

  6. Soon the computers will do all the police work for by Anonymous Coward · · Score: 1

    And it'll turn out we're all criminals. Oh well.

  7. Check these dank memex by Anonymous Coward · · Score: 0

    I heard you like memex.

  8. On the Dark Web, no one knows you are an AI by chrysosphinx · · Score: 3, Funny

    How long it takes that MEMEX AI will actually start performing criminal acts on Dark Web to justify it's own existence?

    1. Re:On the Dark Web, no one knows you are an AI by Anonymous Coward · · Score: 3, Insightful

      It would be quite amusing if it exposes just how large a share of crime rings are run by the DEA, FBI and similar organisations. I imagine they're the majority.

  9. I sense hype. by SuricouRaven · · Score: 2

    "Advanced web crawling and scraping technologies, with a dose of Artificial Intelligence and machine learning, with the goal of being able to retrieve virtually any content on the Internet in an automated way."

    Congratulations: You have invented the search engine. While there is certainly much room for improving search engine technology, the ideas described in the article do not impress me. Perhaps all the really good stuff is classified.

    1. Re:I sense hype. by Anonymous Coward · · Score: 0

      No, this quote is not about inventing a search engine at all. A search engine allows an end user to search for information that has been gathered. What is being referenced in the quote a different way to do the gathering. Humans interact with the web in a different way than your standard scraper. For one, humans ignore the robots.txt. More importantly though, a lot of information on the web is only available if you are interactive with the web page.

      Consider, for example, the web page that is linked in the original article. You don't go to the page, you go to a landing page (with ad) and eventually you go to the actual page. How would you scrape that? You can't, unless you navigate through the page. Also, you get additional articles that appear after you scroll to the bottom of the page. How would you scrape that? You can't see the comments unless you use a Facebook account or some other way to get past the popup. How would you scrape that? the scraping part of MEMEX is to get around these things

      Yes, they are also creating a search engine to allow a particular type of user to view the subject-specific, dark-web data, with features that might be different than your bog-simple, generic-user google search. But that's not what the quote is about.

  10. Exit nodes? by fred911 · · Score: 2

    So will this confirm compromised exit nodes allowing the network to heal itself?

    --
    09 F9 11 02 9D 74 E3 5B - D8 41 56 C5 63 56 88 C0 45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
  11. Bad Vs Good by Stan92057 · · Score: 1

    Tor, where Hidden Services are protected by the privacy-enhancing, encrypted hosting, often for good, often for bad

    I don't believe that statement one tiny little bit. i believe the bad by huge wide margin use it then the good. I think we shouldn't kid ourselfs by making sugar coated excuses. But im not saying oh we should stop the use of tor no we shouldnt because our govermets have proven they are by a huge margin untrustable scared Corporate tit suckers.

    --
    Jack of all trades,master of none
    1. Re:Bad Vs Good by Anonymous Coward · · Score: 0

      Actually you are wrong. Hidden services probably have a bigger bad than good ratio, but for exit traffic, when the FBI (or whichever 3 character agency) investigated how bad tor was they found that only 3% of the traffic leaving the network was what they defined as bad. Which pretty much means that Tor succeeded in one big goalpost in security, namely that you should be hiding among all kinds of people and not just the "bad guys".

      Also, tor is used by hundreds of thousands of people. If so many people do something wrong, its worth investigating if what they do is actually all that wrong. Sometimes it is, sometimes it is not. If everybody goes above the speed limit, perhaps the speed limit is maximized for revenue rather than safety. Perhaps it not. But keep it in mind. Same with piracy and perhaps the same with what people use tor for.

    2. Re: Bad Vs Good by Anonymous Coward · · Score: 0

      So you bought their meme ?

    3. Re:Bad Vs Good by Anonymous Coward · · Score: 0

      "Bad" is subjective. There is very little happening on the dark web that your average liberal would have a problem with.

    4. Re:Bad Vs Good by Anonymous Coward · · Score: 0

      LOL POLITICS

  12. DARPA Dark Web Dark Web Illicit Activity AI by Anonymous Coward · · Score: 0

    function is_website_illicit(string url){ // this works like 90% of the time
          return true;
    }

  13. 2600 by Anonymous Coward · · Score: 1

    2600 just had a writeup about keeping safe that included from how to properly use hidden services with TOR to booking a 1 way ticket to a country that does not extradite back to your own country.

  14. Trillion to One is now "broad" by Vitriol+Angst · · Score: 1

    Memex has been on tracking human trafficking, but the project's scope stretches considerably wider.

    So like the track record of the NSA; one trillion dollar expense budget to catch one dude -- a low paid security guard who donated to Al Qaeda.

    --
    >>"ad space available -- low rates!!!"