Slashdot Mirror
'Google Search On Steroids' Brings Dark Web To Light
snydeq writes The government agency that brought us the Internet has now developed a powerful new search engine that is shedding light on the contents of the so-called deep Web. DARPA began work on the Memex Deep Web Search Engine a year ago, and this week unveiled its tools to Scientific American and 60 Minutes. "Memex, which is being developed by 17 different contractor teams, aims to build a better map of Internet content and uncover patterns in online data that could help law enforcement officers and others. While early trials have focused on mapping the movements of human traffickers, the technology could one day be applied to investigative efforts such as counterterrorism, missing persons, disease response, and disaster relief."
couldn't this be done since like 2001 or so?
There are three kinds of people in the world. Those that can count, and those that can't.
"... being developed by 17 different contractor teams..."
There's a recipe for failure if even I saw one!
Sounds like this search engine runs on magic dust and could not only find the cure for cancer, but finally get rid of those facial warts that always come back! If you give us XXXX Billions of Dollars, it will keep you safe in your sleep from the bogey man, terrorists and spam!
Ya, sounds like bullshit to me.
Be seeing you...
Whike I am sure that steroid abuse is assisted by :the dark web' , there are more dangerous drugs for sale there, not to mention actual violent crime they should crack down on
Absolutely nothing about Google. But it's a search! Search is Google! That's why it's Google! Duh huh huh huhuh huhuhuh!
before, criminals could keep from being caught by having a robots.txt file.
The sad thing is this isn't a joke
Exactly. That was my take-away as well.
(1) Get a huge government contract
(2) Ignore robots.txt
(3) Profit!
I thought that this sounded ominous for a minute. Then I remembered that government projects like this are designed to have a chilling effect on activity that they cannot monitor, understand or enforce by their very existence and not by being actual potent tools to combat it (i.e. paper tiger). More likely this thing will become a money pit that contractors can use as a sandbox project to allow their employees to play in for implementation of IP that may be works-in-progress for future projects that may be useful, but are just lofty concepts that have no basis in reality. 17 contracting teams is about 15-16 too many hands in the cookie jar for this to be anything more than a Men In Black-wannabe training camp or a glorified propaganda project, most likely both.
Which is it, Deep Web or Darknet?
Excellent reporting there.
So does a shotgun. That's why you need to be specific about your use cases.
My understanding is that these are two different (though related) things. The Deep Web is simply the part of the Web that's not indexed by the major search engines. It might be purposefully hidden, or it might simply be a web page so out of the way that Google hasn't noticed it. The Dark Web is a subset of the Deep Web that is more purposefully hidden because people using it don't want The Man to know what's going on. Sometimes the Dark Web is defined as only places in which nefarious (or at least illegal) things go on, sometimes it's any place that's intentionally hidden, for whatever reason.
Point is that the headline says "Dark Web" while the excerpt says "Deep Web", but then immediately starts talking about law enforcement, which means Dark Web.
"Deep Web" and "Dark Web" are both useful concepts. We should avoid conflating them.
No link to the search page... In fact it seems that there isn't a search page at all.
The only thing Memex has in common with Google is the tracking.
...among computer technologists, going back to 1945. Why reuse it for this? https://en.wikipedia.org/wiki/...
Tom Geller
Other than that this is also a search engine, that is.
If they're this clever at finding things then let them do TLD discovery and we can dispense with that trillion dollar ICANN nonsense that doesn't do anything.
Need Mercedes parts ?
if this dark net gets a light shone on it, another darknet will pop up in its place.
have you seen my sig? there are many others like it but none that are the same
Some people have been using port knocking to allow remote admin yet cut down on the ssh bots trying to login.
It would be trivial to do the same in a cgi where if your ip address is 1.2.232.121 you have to hit /target/232 then /target/121 to get the real data.