The Dark Side of the Web
Barence writes "Beneath the web pages indexed by Google lies an online world that few know exists. It's a realm of huge, untapped reserves of valuable information containing sprawling databases, hidden websites and murky forums. It's a world where academics and researchers might find the data required to solve some of mankind's biggest problems, but also where criminal syndicates operate, and terrorist handbooks and child pornography are freely distributed. Interested? You're not alone. The deep web and its 'darknets' are a new battleground for those who want to uphold the right to privacy online, and those who feel that rights need to be sacrificed for the safety of society. The deep web is also the new frontier for those who want to rival Google in the field of search." The melodrama is tempered, though: "The deep web isn’t half as strange or sinister as it sounds. In computer-science speak, it refers to those portions of the web that, for whatever reason, have been invisible to conventional search engines such as Google."
TFA:
>terrorist handbooks and child pornography are freely distributed. Interested? You're not alone.
No, actually, speak for yourself!
It's called the Metaverse, created by Neal Stephenson in Snow Crash. We now know it as Second Life.
I find it ironic that in the online world there are places where the Terrorists and those who support them are calling us, the Freedom Loving People, terrorists !
By the original Terrorists I mean those who strap bombs to themselves and go KABOOM ! taking themselves with innocent people around them.
What I find ironic is THEY call us terrorists !!
Muchas Gracias, Señor Edward Snowden !
http://www.robotstxt.org/
Says it all really, no need for a melodramatic "article" trying to draw parallels between the non indexed and page ranked portion of the net, and kiddie porn.
Some of us just don't want google indexing out stuff on general principles.
FX, types "brain tumour" into google
up pops page full of links asking me if I want to buy a brain tumour on fleabay...
http://slashdot.org/~GuyFawkes/journal
From what I've seen and heard this 'hidden' information is hidden on a purpose - most such sites I've ever encountered are trafficking (child) porn, software, audio and video - there's next to zero informational value in this undernet. As someone once said "Information wants to be free" and if it isn't let it die.
The real problem which this article doesn't even touch is that sometimes it's getting very hard to find the information buried in millions of pages Google returns to your query.
The author explains that there is a lot of content behind password protected sites. I had no idea that google didn't know your password!
I heard something about a robots.txt file somewhere before, but I thought that all robots where smarter than me anyway.
I also learned about something called freeweb that may or may not be used for good or bad things. I then learned about TOR which also may or may not be used for good or bad things.
This article really opened my eyes to the vastness of the Internets
The article says it was "Posted on 3 Sep 2010 at 15:47". Unless I've missed something, we're still in March 2010...
there is no mystery to this 'deep web'. massive data reserves? quite likely. personal, but unsecured servers hosting copyrighted content? even more likely.
This kind of article will only make things worse for a future defendant trying to explain he wasn't coordinating with 'the deep' in the distribution of his movies from his computer to his Mythbuntu box.
Just maybe not everyone in the world wants to be Google's bitch and allow them to mine their precious information for profit. Information may want to be free, but information is also power. Secrets are valuable to those who hold them, and in a near future world where information becomes increasingly more valuable, those who hold the secrets will be the most powerful.
Now just ask yourself, are you willing to submit to the likes of Google and give up the right and freedom to decide what to do with your information? Your secrets?
Do we continue to sell our individuality, our identity so cheaply?
Darknets are a concern. What is the link with the Deep Web? The only connection seems to be that they're both unindexed by search engines.
I thought the article might get to the point by the last page, but it was still talking about child protection and terrorism (in company databases???) I had wondered whether this confusion was down to an incautious academic, but the doesn't seem to suggest it: http://ai.arizona.edu/research/terror/
The deep web and its 'darknets' are a new battleground for those who want to uphold the right to privacy online, and those who feel that rights need to be sacrificed for the safety of society
Corporations, wealthy individuals and people in power keep their right to privacy. That's not good for the "safety of society". See the ACTA negotiation. Most of the calls about the future of society are made in a non transparent way, by corporations, the psychopaths that run them and corrupt politicians. If I don't keep my right to privacy ( and this looks like a lost cause) then I want them to lose it as well. I want a full public database with detailed information about every dollar owned and every move made by politicians and members of a corporation board. I want every government contract to be published on an easily searchable database. I want all meetings between corporation boards and/or government officials transcribed and published on another publicly search able database.
When his defense asked, "Which computer has Jon Johansen trespassed upon?" the answer was: "His own."
> In computer-science speak, it refers to those portions of the web that, for whatever reason, have been invisible to conventional search engines such as Google."
Spare me your mumbo jumbo, doctor!
Vast collections of literature (many, many LoCs worth) exist outside amazon.com containing esoteric theories, morbid historical narratives and subversive ideas.
Set your phasers on "funky"!
If child pornography is being freely distributed amongst anonymous networks of paranoid people, what is the problem?
The vast majority of people who use onion routing are very cautious people, so very few will be stupid enough to leave a trail which could identify them (such as a payment) as doing anything which is seriously controversial or illegal. It would be absurd to suggest that anybody is going to profit from producing child pornography and distributing it through anonymous networks.
If somebody produced child pornography as a "hobby" (instead of for profit, which would result in a swift arrest anyway), it's pretty obvious that the producer would produce the pornography for themself regardless of whether they distributed it. So again, anonymous networks are not contributing to a problem, nor is the alleged availability of child pornography.
The majority of perpetrators of child sexual abuse are the parents of the child. If people genuinely wanted to stop child abuse, they would focus on protecting children from abusive parents. Instead, politicians and police chiefs tend to focus on matters which score politicial points and win votes; parents are not an acceptable target because they constitute a major component of the electorate. Claming to fight child pornography is much easier for politicians and police chiefs, as they will not lose significant support and they can easily claim a victory without any risk of being exposed as liars; after all, who is going to check the evidence?
"To the future or to the past, to a time when thought is free" ~ Nineteen Eighty-Four
no quite a bit of it is lit by fiber optics.
i thought once I was found, but it was only a dream.
... I came across to this nice article regarding deep web. It has some techniques on how to search, access and exploit deep web. It is worth to look also the other articles of this site...
Until the skies turn blue...
Until the air of freedom strikes us...
I was thinking about exploring those 'darknets' but child porn? I don't even want my browser pre-caching its way into those websites much less directly stumble onto one. At least I was warned. Anyone foolish enough to go there can't expect to feel like a victim if they get caught in a dragnet for showing up on a bad site's web access log.
--- Grow a pair, liberals... stop letting the Republicans bully you!
missing link in above: The Trillion Dollar Bet
It is like going to garage sales. You can expect to see a ton of the same old garbage, but usually someone has 'stored' something they don't care about but you really want. Occassionally there are priceless buried treasures that should be shared with the whole world. If marketers could regularly go through them all, it would provide unparalled insight into what we buy and store. Unfortunately, (or fortunately depending on your point of view) everyone doesn't get to ramble through our garage unless we give them access or they break-in.
They are not really "darknets", a more accurate name is NOYBnets. (None Of Your Business)
If you still remember how to use those BBSs, the IRCs, then you can get back into the 'darknet' world I guess, though today it is also about appearing/disappering websites and botnets. Botnets like Zeus got that whole 'FreeNet' idea and have their own implementation, only it's not exactly free.
You can't handle the truth.
I was recently told by an academic in computer security that only about 13% of the web are indexed by search engines such as Google. Does anyone know anything about this?
I made my forum/website invisible to search engines because I only want members coming from one single place which I have a link on. Then only certain members join and it's actually quite nice and peaceful. That's really all there is to it. No terrorists or anything.
Google's Super Secret Search Algorithm: SELECT @search_results FROM internet WHERE @search_results = 'good'
So the bottom line is there is more private data then public data floating around.
Go figure. *snooze*
---- Booth was a patriot ----
It must be a slow news day for something so technical to show up as a news article. But then again, the article has all of the necessary alarmist features, so I guess they had to let it through.
Every 12, 16 months or so I go "Oh yeah, Freenet exists...I should check it out again." But every time, I can't answer the question: Is there anything actually HERE?
Freenet: Is there actually anything worthwhile on it?
"These people look deep within my soul and assign me a number based on the order in which I joined" --Homer re:
and what place would that be?
Darknets are not new for me. Every porn site I visited had a dark background thus helped me to "penetrate" into it further.
I thought Darknets were private and encrypted vpn based file sharing systems. They work based on invites and trust.
I think the author meant Darkweb
So this is the new term for IPv6?
-- I have a private email server in my basement.
Google has built quite an empire on making people believe that they are the defacto standard for search. They should be commended for the quality of their applications but sadly the marketing has led people astray. I actually took a trip to my local University to do some research. A day login gave me access to thousands of Scientific papers that I would otherwise have to pay hundreds of pounds for. Doing real research takes footwork and hardwork. The web can do a lot but you have to know where to look. See http://narconews.com/Issue64/article4073.html , http://deepwebresearch.blogspot.com/ , http://society.guardian.co.uk/e-public/story/0,13927,1195901,00.html
It's more commonly known as 4chan... or, "the bottom of the internet."
where all the junkies go.
Where everything is fast
And everyone gets slow.
I see you never tried the -robot-follow option in google...
Oh so you're the lunatic that acts first thinks later - the next time you swerve watch out for the kid on a bike you did not see the first time you looked.
Google is actually a good way to find scientific papers, their search engine gives better results than the academic databases offer most of the time... the problem is you usually have to pay. The best thing to do alot of the time is google what you want then log in through your schools VPN or go their library to get the paper without paying.
Fravia's Research:
http://www.searchlores.org/
http://www.searchlores.org/indexo.htm
He was a great guy - it's his "fan club" I couldn't stand.
Watch yourself on the links to some of the "discussion boards".
There's some really good knowledge in what he left us.
~hylas
http://www.pcpro.co.uk/features/356254/the-dark-side-of-the-web/print
Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
... But beware the dark fiber! For it will gloom you!
I've come to... anesthetize you!