Under the Hood of AT&T's Monitoring System
pkbarbiedoll writes "The recent discovery of AT&T's monitoring program has raised more than a few eyebrows. While the class action suit filed by EFF is pending (as well as a seperate suit filed against the NSA filed by the ACLU), interested parties are taking the time to learn more about the scope of this massive invasion of privacy. Bewert examines the Narus architecture used by AT&T in their previously shadowed (and ongoing) collaboration with the NSA."
Is anyone surprised?
And not just for those people who dislike the current administartion. As has been said before, even if you approve of Bush, how will you like President (Clinton, Kerry, Gore, etc) having this same technology at their disposal. It is dangerous for any government to be able to monitor its citizens this thoroughly, no matter what the original intent might be.
All your base really do belong to them.
wow, and I mean just fucking WOW at the processing power alone.
This thing makes echelon look like a toy.
Since I live in the UK, this kind of technology is likely to be used here as well (since we have mandated supreme data retention laws)
This is truly scary
liqbase
We've all heard the saying: "Two wrongs don't make a right". Hasn't the Bush adminstration?
The United States is a nation of LAWS...So many of you constantly remind us of that fact whenever p2p is mentioned here...yet many of these same people believe that our President has the right to IGNORE laws he doesn't want to follow.Why
Why are people so consistently surprised by this kind of news. I've come to simply expect that corporations are in full swing of subjugating the general public.
The latest generation is called NarusInsight, capable of monitoring 10 billion bits of data per second.
That's 1192MB/s, not exactly what I'd call enough to monitor the entire innurnet in real time, which means somewhere along the way, AT+T must be doing some filtering, which is even sadder.
On the other hand, that's roughly 2 CD-sized full-length movies a second, so that's about 2 hours worth of pr0n per second, which means that it takes a stadium packed with 7200 naked NSA agents and a truck full of Kleenex tissues to check out all the videos in real-time...
"A door is what a dog is perpetually on the wrong side of" - Ogden Nash
I couldn't find this software on sourceforge or freshmeat. It really troubles me that the US government is using proprietary software to violate our constitutional rights.
There's no failure quite as dissatisfying as a complete and total solution to the wrong problem.
'Absolute power'.
A democratic government is supposed to have limited power by design. However, as they grow, they tend to cut themselves free of the shackles that their founders placed on them.
If you're going to be suprised about anything, be suprised that it didn't happen sooner.
Seriously. The ISP I work for buys it's bandwidth from AT&T, but this week I'm talking to the boss about dumping them. The whole "we're going to charge Google to send data to our customers" thing was bad enough, and now we find out they're collaborating with the fucking NSA? Monitorying OUR traffic without telling us?
Screw AT&T. They aren't going to get my companies money, and I expect that I'm not the only one who is going to ditch them.
They should be sued into oblivion.
I would assume that any business would set up a encrypted VPN tunnel as soon as their network was to enter the telco. So assumming that this was the case, how would this device (sitting inside the telco cloud) Monitor any of this traffic. Furthermore, I dont see how the device would be able to construct "a total network view" from within the telco even without encryption. (The firewall would block ping sweeps or other reconnasance based attacks) Joe consumer on the other hand, would not have a encrypted connection, so I think its safe to say that the sole purpose of this technology is to spy on citizens. Tor routing would provide the citizen/terrorist with encryption that would circumvent the monitoring device. So in the end, it sounds like this device is a hugely expensive monitoring device that would only catch the dumbest of dumb.
Yes spying and everything is wrong. But with the NSA having more power than ever and needing to acquire/sift through more and more information all the time, wouldn't it be a very cool place to work.
http://www.nsa.gov/careers/ has links to all the areas. The only thing I found extraordinarily interesting is that computer programming type skills (ie Software Engineering) is more under the Computer Engineering/Electrical engineering career track than the computer science one.
The only question is that if you should decide to leave the NSA or are fired, does termination extend to more than your employment? Although seriously it does seem like a very geek friendly place to work.
Tor (http://tor.eff.org/) is a good way to prevent the government (or anyone else) from watching what sites you go to.
It can be a little slow at times, but you do not need to use it all the time (unless you are very paranoid).
Has anyone else been looking for the next frontier of freedom. What I mean is that for the longest time, the USA was the last frontier in freedom. If people in the world wanted to be free, they would find their way to the United States. While the USA is still more free than most places, the deterioration over the last 80 years has been notable.
Since most of the land in the world is claimed by less than free governments, I'm wondering if the next frontier in freedom needs to be sea based. I suppose for the next few decades people can probably use technologies to secure their freedoms, crypto, open source, etc..., but that won't get arround the physical controll problem. Eventually people will need to physically secure their freedoms.
Maybe the solution is for a bunch of liberty minded people to collaberate together to take controll of a small despot country, but that still would make it very vulnerable to larger military powers. Moving to more free states, juridistictions, and countries would probably help, but doen't seem like a permanent solution. Maybe it would be possible to convince all the freedom hating overloards to go somewhere else, but that seems unlikely too.
More people are starting to use the internet for their personal correspondence and business.
There are strict laws governing snail mail to protect against this very abuse we're seeing, among others. Imagine if companies, and the government, were able to know every bit of content in your snail mail? Would you be comfortable with that? What if every bit of your communication is available to the highest bidder? (a possible outcome of all this if something isn't done now)
Change the laws! Why is this information not as important as the stuff that goes on paper? Apply the same mindset that we have with the mail system towards internet traffic. I'd be fine if they recorded traffic's origin and destination, but they shouldn't lawfully have access to the *content* of my correspondence.
Technology is only going to make this oversight easier and easier. We have to educate people and change attitudes starting now.
Ten gigs a second is peanuts, but obviously there's more than one of these things ... and presumably the next generation will be even faster.
which means that it takes a stadium packed with 7200 naked NSA agents and a truck full of Kleenex tissues to check out all the videos in real-time...
Thanks for the image.
The higher the technology, the sharper that two-edged sword.
Well, it seems Ol'Nixon wasn't so bad after all...
Oh well, what the hell...
http://www.wired.com/news/technology/0,70621-0.htm l (Wired). An interview of a guy that works (ed?) for ATT that the EFF has subpoenaed as a witness. Talks about the physical connection made and how/when they did it.
09 F9 11 02 9D 74 E3 5B - D8 41 56 C5 63 56 88 C0 45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
Back then they were talking about how wonderful it was to spy on everyone so some internet traffic could be charged a higher rate to be passed along.
Nearer the top of the page it mentions that previous to September 11, 2001 they wanted to analyze everything to prevent "revenue leakage", which I take to be the industry term of art meaning "a failure to exploit loopholes and monopolies to screw everyone out of every last penny".
Now they can be greedy and "patriotic".
I see even classic Slashdot is now pretty much unusable on dial up anymore.
Shouldn't the editors be able to fix this typo? The article is only a paragraph and might take an editor 5 seconds.
Stupidity is like nuclear power, it can be used for good or evil. And you don't want to get any on you.
Tell your politicans that 1984 is NOT a howto!
Grundgesetz * 23. Mai 1949 - 30. November 2007 - http://www.vorratsdatenspeicherung.de/
What I'd be interested in is if this device does real-time packet reassembly and flow recovery. If not, what's to keep a terrorist from putting "BO" in one packet and "MB" in a following one? Or doing nasty stuff with fragmented IP packets?
Running a packet-oriented grep on a large datastream is not that hard (ie. easily solvable if you throw enough processing power at it). If the government's sniffers can reassemble packets and recover flows real-time, *then* worry.
Error: password can't contain reverse spelling of ancient Chinese emperor
There was not much on the mainstream news sites other than the initial news story last week so I googled ["electronic frontier foundation" narus]. The first link was to a no longer available article at siliconvalley.com. The good news is that the google cache was still there.
w ww.siliconvalley.com/mld/siliconvalley/business/sp ecial_packages/security/2579675.htm+electronic+fro ntier+foundation%22+narus&hl=en&gl=us&ct=clnk&cd=1 "
http://72.14.203.104/search?q=cache:nc4cgqbKTjoJ:
The article appears to be a lead in for a round table discussion where both the EFF and Narus participated but I can not find the details of the conversation. Anyone else able to get their hand on it? Please post it to slashdot.
When a country is run by psychopathic liars who steal elections through rigged voting machines and who abuse the laws to ensure their continued control over the public, their enemies ARE the people.
-FL
OSI and TCP/IP are entirely different protocol suites. TO my knowledge, no complete OSI stack has ever been implimented. Yet there are plenty of OSI protocols, like T.120 and H.323....
TCP/IP operates on a 4-layer model, while the OSI protocols operate on a 7-layer model. As the OSI model started loosing brainshare, people tried to market it as a teaching tool (or vice versa).
OSI protocols seem really weird and complicated when implimented on TCP/IP. You have all sorts of things that have to be emulated, such as separate channels, which means you often have a very large number of sockets used and many of these are dynamically allocated. H.323 is a very good example of this.
LedgerSMB: Open source Accounting/ERP
This page has dissapeared from the server and it can't be found in google cache. Does anyone know much about this model? What sort of processing power is behind it and what are it's capabilities? It looks to have the ability to sniff through 600 mbps each up and downstream from the snippet above, but little else is known.
Also, only this first google result seems to have relevant info on this device. If anyone here has more info, please post. A lot of us are curious, especially considering that the administration has been saying they only sniffed suspicious communications.
Then you don't value your most fundamental right: freedom. The U.S. is founded on a very simple idea: You have the right to be left alone.
;)
And for some follow-up reading: U.S. Constitution, Amend. 4
Oh, yes, so the Clinton Administration was just purchasing some vast computer system, capable of datamining gobs of internet traffic ... and you don't think they were planning on using it as a wide net?
Wake up -- blaming this on anyone one administration, and certainly on any one person, is ridiculously shortsighted. Go ahead and blame it on Bush; the people that actually engineered this sort of policy, wherever they are in the NSA or various other government offices, will probably sell him down the river easily enough. Executives come and go every four or eight years, the attitudes that enable a project like this, even the raw technology itself, takes longer than that to put together.
If you give in to the temptation to blame Bush, along with all the other sheeple over at Daily Kos, you're really ignoring the majority of the problem. It's akin to seeing an iceberg in front of your ship, and sawing off the part you can see above the water and then saying the problem is gone. No it's not, all you did was get rid of the very thing that allowed you to see the problem. The thing that's going to kill you is still lurking below the water. (Ignoring the rather obvious fact that a proportionally equal amount of the iceberg would come back up out of the water as soon as you cut the top off.)
If you build a system that's capable of monitoring everyone's email, it's naive to think that it'll never be used. So the real problem here is that this system was constructed in such a way that it could be used indiscriminately, and to find an answer to why that happened, people have to be willing to look further back into the past than just G.W. Bush, something I'm not sure they're prepared to do. It's too easy and too satisfying to use something like this as political hay, rather than as the wake-up call it ought to be of how systemically out-of-control the government is, and has been for some time.
The behavior of our current and less-than-beloved President is a symptom of a problem, not its root cause.
"Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
The embrace and the tolerance are two indicators, not one.
You would improve the legibility of the sentence by delimiting the participle clauses with commas, particularly with regard to the repetition of the word "and".
Embracing the degradation of standards, and tolerating ignorance and stupidity, are two of the best... etc.
- Sig files: contemptibly familiar the second time around.
Actually I think the reason why we go to war every decade or so has a lot more to do with the American public's desire for it than any demand by the defense contractors. True, they get some benefit from it, but the last few wars that the U.S. has entered into have been done with widespread public support.
I would argue that at the core of the American body politic's psyche there is a core of subconscious uneasiness and malaise, which is fed by the deep-rooted fear that as a nation we are becoming powerless, or at least less powerful. Therefore, every few years it becomes necessary to demonstrate -- less to the rest of the world than to ourselves -- that we are still the Alpha Country. And we do this, in the tradition of any insecure adolescent, by finding someone who is generally disliked and kicking the living shit out of them. It is preferable if the people getting the shit kicked out of them are non-white and non-Christian, since a very large percentage of America, although they may read the NY Times and listen to NPR on the drive in to work, value such lives much less than they do blonde-haired and blue-eyed European derivatives. (Because as diverse as we like to think we are as a country, the US is somewhere between 75-80% white, depending on whose statistics you believe, and people dislike seeing people who look like themselves getting killed on TV.)
In other posts I have said that I think that the closest historical parallel to the current war is the Spanish-American war of 1898. I will not rehash my entire argument here, but suffice it to say that the root causes of both conflicts lie outside the traditional domain of geopolitics: both were heavily dependent on public opinion, which was brilliantly used by a great number of independent actors working for their own gain. But at the heart of it all you have the American public, who as a group are not nearly as adverse to the idea of employing violence for its own sake than many individuals would claim they themselves believe.
"Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
Why am I not surprised? Plus his company is invested in by Walden Israel, a VC division of Walden International. Walden Israel is headed by a guy who spent five years with a company developing optics for the ISRAELI MILITARY.
Why am I not surprised?
First, an Israeli company in charge of Federal wiretapping gets caught selling wiretapping info to drug dealers in LA and the FBI gets upset over their access to Federal wiretaps.
Now this - an NSA guy and an Israeli running the company sucking data into the NSA - and the Mossad?
As I've said before, Israel has figured out that the best way to spy on people is to be the country making all the telecommo hardware and software all the other countries use to spy on people. Brilliant strategy - and it's working.
Richard Steven Hack - This sig is TOO GODDAMN SHORT TO DO ANYTHING USEFUL WITH! MORONS!
[wetfeetl33t@localhost ~]$ traceroute www.slashdot.org | grep att.net
traceroute to www.slashdot.org (66.35.250.151), 30 hops max, 38 byte packets
[wetfeetl33t@localhost ~]$
looks like I'm OK!
Register the editry.
I wanted to comment on the AT&T Thing. Narus is company that was started in America by some ex-Israeli Defense Forces people (unit 8200 alumni) who wanted to bring their Semantic monitoring software to America to sell to big telecom. This was always security software and Israel has always been very very far ahead in that realm (because of the "realities" there. There are a lot of these companies that were formed by ex-Defense people, specificially unit 8200. Checkpoint systems is another fine example.
From this article (direct link:
Anyway, the original goal was to make a bundle of money selling this stuff. Why? Well, it's useful for a number of reasons. Because the internet has been "redesigned" around business and commerce (and the needs of the consumer), the nature of the network has changed. From the original decentralized network (which did use leased phone lines from Ma Bell, so it's not really decentralized from THEM), now there are huge "tier 1" trunks that carry the majority of the transcontenental data. The idea in the late ninties of "IP Network Convergence" or Voice Data Video etc. all coming out of one pipe was the big hot one. Of course, how do you make money when people are only paying for their ISP connection. Enter "usage-based billing".
The idea behind the Narus system was to create a system to track IP traffic and transactions semantically (because you still didn't know where the traffic might be coming from) and create a sort of database of records like they talked about in TFA. Like the old fashioned telcom "call records", these would record a source and target and the data transmitted. The data would only be stored if "relevant", ie: part of a usage-based service or today, "interesting" ie having actionable words or phrases, etc. Of course, then the thing in New York happened and all of a sudden there was a LOT of funding available for people who had the stuff in place or ready to go and a lot of the old red tape was struck down. Remember "karnivore?" Cohen and his more spooky cohorts made a few calls to 8200 friends (IDF and M*s*ad were working "closely" with the administration) and due to the no-bid process (not unlike that of the Iraq contractors and the Katrina and new york ground zero cleanup operations) they got the job in a sec.
Of course, AT&T is going along because they need support for the big merger with SBC (putting most of the baby bells back together. AT&T was once the largest company on earth and they are set to do it again. Guess what, voice calls are still big business and how do you think your cell phone calls go from tower to tower. You guessed it, land lines..............AT&T has always been an evil company.
Anyway, Narus is the key to everything now. The company was the one pushing for convergence from the beginning and now it's possible to monitor all traffic because it's all on IP. How convenient. Even an anonymizing proxy such as ToR cannot provide the protection you need if one of your packets happens to stray across one or more Narus points. It's a simple matter to monitor the packets and put together not only
Cool! Amazing Toys.
If you want your life to be different, live it differently.
> i have to agree that america needs war, but look at how the economy changes for the better everytime there is a war.
...ISN'T to defend our country, ISN'T to protect our liberty, and ISN'T to promote democracy ...it's to MAKE SOME MONEY?!?"
:-D
Reminds me of a debate I got into with one of those neo-con pro-biz warhawks just a few years ago about the (yet to occur) effects of the US war on Iraq. Mr. Warhawk was practically beaming about how occupying and rebuilding Iraq would pay for itself, how the US would reap enormous wealth from the influx of Iraqi oil, and that military spending would actually *strengthen* the American economy -- like the massive military expenditures during the Reagan Years! (Can you say "trickle-down theory"?)
I let him finish gushing about Ronnie Raygun, paused, then said, "Okay, sooooo.... war is the answer."
That kind of took the wind out of his sails. What I didn't say (but in retrospect really wish I had) was, "Therefore, the most important reason to wage a war in which hundreds to thousands of our American troops will be sent to a foreign land to fight and die
Alright, so let's accept the capitalist-pig view that war is all about feeding the money machine. How close (or how far) are we to breaking even on money spent on Iraq? How much is the federal deficit now? How much have gasoline prices changed, *and in what direction*? How much has consumer confidence and employee satisfaction improved (or worsened)?
Also, what of non-economic matters? How much safer (or more frightened) do we Americans feel about another attempted terrorist attack on US soil? How (un)successful have we been in establishing peace and starting a new democracy in Iraq? How much (or how little) respect do we have from the other nations of the world?
What of the veterans who return home (if they ever do -- for many US troops, tours of duty keep getting extended indefinitely)? If you develop PTSD and have screaming nightmares whenever you try to sleep, how much money is that worth? Or if you jump whenever a car backfires or a kid sets off a firecracker within earshot? Or if your mind keeps replaying the memory of a fellow soldier -- maybe a close buddy -- being shot in the head or blown to bloody bits? What amount of value, what price tag, can you possibly assign to that?
Btw, my closest friend is a retired Army master drill sergeant who served in Korea *and* Vietnam. I've seen him wake up in cold sweats during the middle of the night, and he keeps a bowie knife next to his pillow "just in case." Oh, and he despises Dubya.
"All hands, BRACE FOR IMPACT!"
Editors? You must be new here.
I've fallen off your lawn, and I can't get up.
When reading the article linked to please double check the writers math. While the numbers given for the capture rate are large the example seems to state that 10,000 million DSL links at a speed of 256K would be captured @ layer 4 on the 10Gbps links. My math suggests that there are aprox. 3900 DSL links @ 256Kbps each in 1Gbps,a nd therefore approx 39K @ 10Gbps. What is really missing here for me is details about the 'flow', ala Cisco NetFlow, rate per second which would effect the layer 4 processing rate. As we 'converse', i.e. traverse the tier1 transits, we send many frames in a single flow which could occur over several seconds. In a NetFlow like consideration all of such frames would comprise a single flow accounting and thus the 'data rate' to the probe, narus or otherwise, would be considerably smaller. Those tier1 transits probably do have 1000's, even 10's of 1000's of concurrent flows per second. that number is still not overwhelming as I myself have coded and operated NetFlow processing systems that process normalized records into an RDBMS at the rate of 1G records per day which is a per-second rate of under 12000 flows per second on 6x 450mhz SUN system. And I don't find Sparc to be the most powerful or processing environments! Surely the full 10Gbps per second full capture and storage of such feeds IS impressive and any such solution would have to have massive storage capacity on many storage channels opperating concurrently in order to just capture the data for later analysis. But those solutions can be purchased, just think EMC and a bunch of fiber channels. You could even experiment with this on your own DSL, or cable, by loading up ethereal and storing everything to your ata just to see that it is feasible. From there you could bypass all the cannd solution by going straight to libpcap and your homegrown code, Perl being my preference, and readily include your own indexing/tagging scheme to the data being grabbed by libpcap. So, certainly there is great issue here, however i is not one about the amount of hardware needed. I suggest a 'wire speed' collector writing to a large high speed storage with backend systems having read access to that storage for subsequent processing is rather straight forward for the 'average' homebrew.
Its the same thing over again through out history.
100 Revolution
200 Citizens get peacetime
300 Citizens get stupid and complacent
400 Givernment Goons get the upper hand
500 People die, people get upset
600 Government gets out of control
700 goto 100
-Hackus
Got Geometrodynamics? Awe, too hard to figure out? Too bad.
I did a little poking around, and Bloomberg is the only mainstream news service/news website with any stories about the EFF lawsuit or the Mark Klein statement. How come the general media hasn't picked up this story? Isn't it newsworthy that Ma Bell is being sued for colluding with an illegal government domestic spying dragnet?
Huh? I don't know every detail of Clinton's administration, but I believe there was a good bit of Repub effort thrown into making people believe that he was some sort of underworld figure. They even started a rumor that he had murdered a former employee. So when I hear things like your IRS claim, my bullshit alarm goes off. Got any quotes to back that up?
Of course the people that criticize Bush now will be the first to criticise him if there's another attack. Why do you think they'd do anything different?
A strain of paranoid prevention can be worse than the disease, whate'er the intention.
In the big picture, an individual's personal porn preferences is not the problem.
The problem is that all legitimate American governmental power flows directly from the Constitution, and all elected Federal Politicians, as well as all appointed Federal judges have solemnly sworn to uphold and defend the Constitution.
Amendments to the Constitution:
Do you need any help understanding the original intent of the following phrases?
Have Americans' ability to understand simple English degraded to the point that nine old verbose fetishises for black satin moo moos must augur the Constitution's entrails to divine what was meant?
The government was precluded from equivocating on sworn warrants; Jury trials; public - a)presentment of prosecutorial charges, and b)trial; right to challenge witnesses and evidence; right to competent and dedicated representative to aid in defense, and lastly, most importantly, habeas corpus. This is what has been lost. This is why you should care.
There is no "terror" exception. These rights are universal, and bar the government's actions against citizen and non-citizen alike. They were explicitly placed in the possession of humans, not the state. Any governmental representative who takes these rights is participating in an illegitimate tyranny. The abject owardice and lack of faith in the American system is implicit in persons advocating acts which degrade these rights.
A president, "whose character is thus marked by every act which may define a Tyrant, is unfit to be the ruler of a free People".
This is what matters. The Dreamtime America is fading away.
Rush Limbaugh is a perfect real world example of an oxycontinmoron