Under the Hood of AT&T's Monitoring System

pkbarbiedoll writes "The recent discovery of AT&T's monitoring program has raised more than a few eyebrows. While the class action suit filed by EFF is pending (as well as a seperate suit filed against the NSA filed by the ACLU), interested parties are taking the time to learn more about the scope of this massive invasion of privacy. Bewert examines the Narus architecture used by AT&T in their previously shadowed (and ongoing) collaboration with the NSA."

Comments

Worrisome

[Winlin]

And not just for those people who dislike the current administartion. As has been said before, even if you approve of Bush, how will you like President (Clinton, Kerry, Gore, etc) having this same technology at their disposal. It is dangerous for any government to be able to monitor its citizens this thoroughly, no matter what the original intent might be.

Re:Worrisome

[legirons]

"IOW, Clinton did this, not Bush. Remember Carnivore?"

What makes you think it's the president's idea? Surely the NSA does what the NSA does, regardless of the person who's theoretically supposed to be telling them what to do.

People who've watched Yes Minister will know what I mean.

Or if you've been watching the UK Home Office do its "ID cards" thing regardless of which figurehead is nominally in charge of the department. People used to say that it's all David Blunkett's fault, until he left and his old department of civil servants carried on doing exactly the same thing with a new "leader".

People blame one president for what the FBI, NSA, DHS, etc. are up to, and when that president leaves, it all continues as if nothing had changed. Aren't government bureaucracies the same, the world over?

Re:Worrisome

[kimvette]

A lot of conservatives feel let down by Bush, for any number of reasons - growth of government, spending increases, liberalization of handling of illegal aliens, Homeland Security, the Patriot Act, the whole Gitmo thing, not practicing actual forensic science and using profiling in airport security checks out of fear of 'offending' political correctness people, limiting of peaceful protests to alloted "free speech" zones, pledging tax dollars to "economic development" abroad (effectively boosting up our own competitors), not promoting energy independence, and many other reasons.

The Republican party no longer stands for what it once did, but appears (at least at face value) be a form of liberalism of a different sort, bordering on fascism, either that or leading toward the mythical "new world order" which I used to read up on for kicks, but now after watching the Bush administration in action, now think that there may be at least some element of truth to those conspiracy theories which don't seem so crazy any more.

Thankfully some Republicans have awoken and have realized that the GOP is not what it once was.

In the next election whom do we vote for though? A big-government Democrat, or a big-government Republican, both of which seem to want to institute an Orwellian society?

Re:Worrisome

[Paladin144]

People blame one president for what the FBI, NSA, DHS, etc. are up to, and when that president leaves, it all continues as if nothing had changed. Aren't government bureaucracies the same, the world over?

You are very much correct. In the US, we refer to it as the Military-Industrial Complex. Some things don't change every 4 years, and the MIC is one of them. The Military-Industrial Complex is a term coined by Eisenhower to describe the entangled relationship of Congress, the Military and Big Business (industry - especially defense contractors).

I've noticed how somethings in our government really don't change. Take Cuba for example. It's been over 45 years and our policy towards Cuba hasn't changed on iota, even after all the different administrations we've been through. In fact, the military very much wanted to attack Cuba back in the 60's. After JFK was able to defuse that situation they decided to escalate Vietnam instead. You see, we need to have wars every few years in order to keep our poor defense contractors fed. We try to minimize (American) casualties, but it's very important that we bomb the hell out of some poor backwards-ass country every few years so we can test out all our cool new weapons, while using up the old ones. We can't buy too many new bombs until we use up the old ones, and how will we field-test each new generation of soldiers unless there's a real conflict to fight in? War is just a business like any other. In fact, you could say it's the engine of our whole economy. Now that you know the War in Iraq is all about buying yachts for the executives and lobbyists of Boeing, Lockheed, and other megacorps, don't you feel so much better about it? War is the American way.

Re:Worrisome

[Nikker]

Wow, just wow, buddy you need to get out.

Our defense contractors can stay fed by selling new shit to our military, while unloading old technology on other nations. There's plenty of wars out there to keep all of them rich; there's no requirememnt to start new ones.

You believe that eh? It's like saying WallMart doesn't need to make anymore money they have enough already. Microsoft doesn't need any more advertising their market is big enough. Pull your head out of your ass man, when you have this much money it's no longer about having enough money to afford an object of your chosing, do you think these guys are saving up for a bigger pool in their backyard? If they can make more they will do evreything they can to make that happen.

field-testing new soldiers" is rather pointless, as human nature rarely changes. Training is standardized and does not decrease in effectivness. Therefore the only thing to be gained by sending soldiers to war is the development of new tactics and doctrine. However, those things tend to change from conflict to conflict anyway, so starting wars just to develop new tactics is also rather pointless.

You really have your head up your ass on this one, but let me break it down for you anyway. A Pitbull is a type of dog, this dog is known to be agressive by nature and used in dog-fights around the world. Now you may think that these people just get a dog drop it in a ring with another and let em go? No. They beat it, make it angry, provoke it, even after all this it's still not ready you know what they do? They take a little fluffy puppy and make the pitbull rip it apart, now it has the taste of blood and the confidence to kill. Now it makes the first move, now it is battle-hardened, blood and killing no longer scares it or slows it down it just wants more. This is what is happening in Iraq a country with millions of active soilders being told how wars are fought, shooting rounds of ammo in preperation for the one that will kill the other guy. After a while no amount of screaming or preperation can improve their skills as killers they have to actually kill 'a fluffy little dog'. A war they cannot lose a foe that cannot bring the wind out of their sails. They have to see their friends die as well as their enemies and the innocent. Now they go back to the millions and become heros and bring the millions of unready up to a new level, get them frothing at the mouth just waiting for 'fluffy' to rear their head up again. Now have a real core to your army. If you think uncle Sam can pick your scrawny, pale ass give him a gun and your gonna let the frags go like Quake, you would likely shit yourself before you got your first shot off and possibly go into shock when you get real brains splattered all over you.

Now I guess you think you know something really well but look over what was just said....

Where the hell do you get these ideas from?

Re:Worrisome

[SageMusings]

Having spent 20-years in the Marine Corps, let me be the first to say "You are right on target".

I just left a year and a half ago and saw combat in operation Iraqi Freedom. I can say without hesitation, the leadership has their "dicks in their hands" contemplating having a venue in which to "Train" for real. Will people die? Sure, that's never been a problem for the military. They would gladly exchange a few sons for the realism you just can't get in excercises and simulations. The military NEEDS combat veterans. Period. This is an excellent way to grow a new crop. Why the hell did we do Grenada and Panama? Mostly for the opportunity to shake the cobwebs off our war machine.

It is damned refreshing to know some people can actually see what's going on. This not to say I condone these events. I'm just attempting to validate your point of view.

Kudos!

Re:Worrisome

[zenhkim]

> they still need to advertise the new weapons, these american tv-wars are great for that.

Carl Sagan made a wry observation about exactly that, back during Iraq War I when the TV news programs were loaded with glowing reports about the Patriot interceptor missiles, "smart" bombs, etc. "[It] was a massive arms bazaar arranged by the United States to showcase some of the products that you, too, might acquire -- and only for all the critical resources of your society that might otherwise be spent on bettering your people. Line up over here!" (excerpt from the Playboy interview).

China - you are WAY behind

[LiquidCoooled]

All your base really do belong to them.

wow, and I mean just fucking WOW at the processing power alone.
This thing makes echelon look like a toy.

Since I live in the UK, this kind of technology is likely to be used here as well (since we have mandated supreme data retention laws)

This is truly scary

Let's translate in understandable metrics shall we

[Rosco P. Coltrane]

The latest generation is called NarusInsight, capable of monitoring 10 billion bits of data per second.

That's 1192MB/s, not exactly what I'd call enough to monitor the entire innurnet in real time, which means somewhere along the way, AT+T must be doing some filtering, which is even sadder.

On the other hand, that's roughly 2 CD-sized full-length movies a second, so that's about 2 hours worth of pr0n per second, which means that it takes a stadium packed with 7200 naked NSA agents and a truck full of Kleenex tissues to check out all the videos in real-time...

Where's the source?

[Chris Snook]

I couldn't find this software on sourceforge or freshmeat. It really troubles me that the US government is using proprietary software to violate our constitutional rights.

Two words.

[KitesWorld]

'Absolute power'.

A democratic government is supposed to have limited power by design. However, as they grow, they tend to cut themselves free of the shackles that their founders placed on them.
If you're going to be suprised about anything, be suprised that it didn't happen sooner.

Re:Learning to love big brother;)

[mrchaotica]

I've come to simply expect that corporations are in full swing of subjugating the general public.

There's a word for that system of government: Fascism.

Conversation I overheard in a bar

[cortana]

Area 51. You heard of it, right? I worked out there. Most people think they've got aliens from another planet, but I didn't see any flying saucers.

Something's going on underground. I'm a pilot, which means I didn't get access to the main complex, but a lot of rock comes out of there; it's some kind of mine. But what I don't understand is why they're always laying more fiber-optic cables.

You know what I think? I think that's where the UN moved Echelon IV, back when they promised they were going to stop spying on people. They want to centralize everything -- every computer on the planet.

Also, here's an exerpt from a book I stumbled upon:

When one maniac can wipe out a city of twenty million with a microbe developed in his basement, a new approach to law enforcement becomes necessary. Every citizen in the world must be placed under surveillance. That means sky-cams at every intersection, computer-mediated analysis of every phone call, e-mail, and snail-mail, and a purely electronic economy in which every transaction is recorded and data-mined for suspicious activity.

We are close to achieving this goal. Some would say that human liberty has been compromised, but the reality is just the opposite. As surveillance expands, people become free from danger, free to walk alone at night, free to work in a safe place, and free to buy any legal product or service without the threat of fraud. One day every man and woman will quietly earn credits, purchase items for quiet homes on quiet streets, have cook-outs with neighbors and strangers alike, and sleep with doors and windows wide open. If that isn't the tranquil dream of every free civilization throughout history, what is?

(thanks W. Spector et. al.)

Re:Conversation I overheard in a bar

[Guppy06]

"As surveillance expands, people become free from danger, free to walk alone at night, free to work in a safe place, and free to buy any legal product or service without the threat of fraud."

Note that "free to dissent" doesn't appear in that list.

Impressive, but AT&T can bite me

[realmolo]

Seriously. The ISP I work for buys it's bandwidth from AT&T, but this week I'm talking to the boss about dumping them. The whole "we're going to charge Google to send data to our customers" thing was bad enough, and now we find out they're collaborating with the fucking NSA? Monitorying OUR traffic without telling us?

Screw AT&T. They aren't going to get my companies money, and I expect that I'm not the only one who is going to ditch them.

They should be sued into oblivion.

next frontier

[argoff]

Has anyone else been looking for the next frontier of freedom. What I mean is that for the longest time, the USA was the last frontier in freedom. If people in the world wanted to be free, they would find their way to the United States. While the USA is still more free than most places, the deterioration over the last 80 years has been notable.

Since most of the land in the world is claimed by less than free governments, I'm wondering if the next frontier in freedom needs to be sea based. I suppose for the next few decades people can probably use technologies to secure their freedoms, crypto, open source, etc..., but that won't get arround the physical controll problem. Eventually people will need to physically secure their freedoms.

Maybe the solution is for a bunch of liberty minded people to collaberate together to take controll of a small despot country, but that still would make it very vulnerable to larger military powers. Moving to more free states, juridistictions, and countries would probably help, but doen't seem like a permanent solution. Maybe it would be possible to convince all the freedom hating overloards to go somewhere else, but that seems unlikely too.

Re:next frontier

[lamp540]

we're pretty much fucked.

Watergate

[HermanAB]

Well, it seems Ol'Nixon wasn't so bad after all...

Another interesting read.

[fred911]

http://www.wired.com/news/technology/0,70621-0.htm l (Wired). An interview of a guy that works (ed?) for ATT that the EFF has subpoenaed as a witness. Talks about the physical connection made and how/when they did it.

Re:NSA and AT&T

[Waffle Iron]

Your world. Delivered...
to the NSA.

Re:Learning to love big brother;)

[Paladin144]

There's a word for that system of government: Fascism.

I'm surprised that you haven't been modded flamebait already by the (guess who!) fascists. I'm glad you weren't modded down, because you are 100% correct.

I understand those of you who are in denial, however. The idea that America is slowly going fascist is a big, painful pill to swallow. However, the fact remains that corporations have unprecedented control of our society, and our government. Corporations are the primary institution of our time, just as capitalism is primary ideology (not democracy, that's for sure. How often do you vote? How often do you shop? Compare.) of 21st century America. Add to this unfortunate mix the shadow government in the form of the Military-Industrial Complex, and you have a recipe for the hidden hand of fascism.

I leave you with a quote from Mussolini:

"Fascism should more properly be called corporatism because it is the merger of state and corporate power." -- Benito Mussolini

1984 is not a howto!

[NoSuchGuy]

Tell your politicans that 1984 is NOT a howto!

Blaming Bush is just taking the easy way out.

[Kadin2048]

Oh, yes, so the Clinton Administration was just purchasing some vast computer system, capable of datamining gobs of internet traffic ... and you don't think they were planning on using it as a wide net?

Wake up -- blaming this on anyone one administration, and certainly on any one person, is ridiculously shortsighted. Go ahead and blame it on Bush; the people that actually engineered this sort of policy, wherever they are in the NSA or various other government offices, will probably sell him down the river easily enough. Executives come and go every four or eight years, the attitudes that enable a project like this, even the raw technology itself, takes longer than that to put together.

If you give in to the temptation to blame Bush, along with all the other sheeple over at Daily Kos, you're really ignoring the majority of the problem. It's akin to seeing an iceberg in front of your ship, and sawing off the part you can see above the water and then saying the problem is gone. No it's not, all you did was get rid of the very thing that allowed you to see the problem. The thing that's going to kill you is still lurking below the water. (Ignoring the rather obvious fact that a proportionally equal amount of the iceberg would come back up out of the water as soon as you cut the top off.)

If you build a system that's capable of monitoring everyone's email, it's naive to think that it'll never be used. So the real problem here is that this system was constructed in such a way that it could be used indiscriminately, and to find an answer to why that happened, people have to be willing to look further back into the past than just G.W. Bush, something I'm not sure they're prepared to do. It's too easy and too satisfying to use something like this as political hay, rather than as the wake-up call it ought to be of how systemically out-of-control the government is, and has been for some time.

The behavior of our current and less-than-beloved President is a symptom of a problem, not its root cause.

Ori Cohen, "33-year-old Israeli Immigrant"

[Master of Transhuman]

Why am I not surprised? Plus his company is invested in by Walden Israel, a VC division of Walden International. Walden Israel is headed by a guy who spent five years with a company developing optics for the ISRAELI MILITARY.

Why am I not surprised?

First, an Israeli company in charge of Federal wiretapping gets caught selling wiretapping info to drug dealers in LA and the FBI gets upset over their access to Federal wiretaps.

Now this - an NSA guy and an Israeli running the company sucking data into the NSA - and the Mossad?

As I've said before, Israel has figured out that the best way to spy on people is to be the country making all the telecommo hardware and software all the other countries use to spy on people. Brilliant strategy - and it's working.

Remember the Maine

[inKubus]

There's too much to talk about, but I think we should start calling it the Media-Military-Industrial Complex. The media is on the bandwagon now.

I wanted to comment on the AT&T Thing. Narus is company that was started in America by some ex-Israeli Defense Forces people (unit 8200 alumni) who wanted to bring their Semantic monitoring software to America to sell to big telecom. This was always security software and Israel has always been very very far ahead in that realm (because of the "realities" there. There are a lot of these companies that were formed by ex-Defense people, specificially unit 8200. Checkpoint systems is another fine example.

From this article (direct link:

Cautious estimates indicate that in the past few years, unit 8200 veterans have set up some 30 to 40 high-tech companies, including 5 to 10 that were floated on Wall Street. This correlation between serving in the intelligence unit 8200 and starting successful high-tech companies is not coincidental:
Many of the technologies in use around the world and developed in Israel were originally military technologies and were developed and improved by unit veterans.

Anyway, the original goal was to make a bundle of money selling this stuff. Why? Well, it's useful for a number of reasons. Because the internet has been "redesigned" around business and commerce (and the needs of the consumer), the nature of the network has changed. From the original decentralized network (which did use leased phone lines from Ma Bell, so it's not really decentralized from THEM), now there are huge "tier 1" trunks that carry the majority of the transcontenental data. The idea in the late ninties of "IP Network Convergence" or Voice Data Video etc. all coming out of one pipe was the big hot one. Of course, how do you make money when people are only paying for their ISP connection. Enter "usage-based billing".

The idea behind the Narus system was to create a system to track IP traffic and transactions semantically (because you still didn't know where the traffic might be coming from) and create a sort of database of records like they talked about in TFA. Like the old fashioned telcom "call records", these would record a source and target and the data transmitted. The data would only be stored if "relevant", ie: part of a usage-based service or today, "interesting" ie having actionable words or phrases, etc. Of course, then the thing in New York happened and all of a sudden there was a LOT of funding available for people who had the stuff in place or ready to go and a lot of the old red tape was struck down. Remember "karnivore?" Cohen and his more spooky cohorts made a few calls to 8200 friends (IDF and M*s*ad were working "closely" with the administration) and due to the no-bid process (not unlike that of the Iraq contractors and the Katrina and new york ground zero cleanup operations) they got the job in a sec.

Of course, AT&T is going along because they need support for the big merger with SBC (putting most of the baby bells back together. AT&T was once the largest company on earth and they are set to do it again. Guess what, voice calls are still big business and how do you think your cell phone calls go from tower to tower. You guessed it, land lines..............AT&T has always been an evil company.

Anyway, Narus is the key to everything now. The company was the one pushing for convergence from the beginning and now it's possible to monitor all traffic because it's all on IP. How convenient. Even an anonymizing proxy such as ToR cannot provide the protection you need if one of your packets happens to stray across one or more Narus points. It's a simple matter to monitor the packets and put together not only