Slashdot Mirror
The Hardware Behind Echelon Revealed
Whispering Bob writes "Techworld has got an interesting article on the technology behind the Echelon spying networks run by the US, UK, Cananda and Australia. Apparently the super storage and analysing technology used in the US is sold by privately owned Texas Memory Systems. It can deal with one trillion floating point operations per second. Now that's some technology."
Echelon
When anger rises, think of the consequences.
Confucius (551 BC - 479 BC)
You've probably heard about Echelon, the vast listening system run by the US, UK, Canada and Australia that scans the world's voice traffic looking for key words and phrases.
Aside from using the system for industrial espionage and bypassing international and national laws to listen in on people, it is also used to listen out for people like Osama bin Laden and assorted terrorists in the hope of preventing attacks.
All this is out in the relative open thanks to investigative journalists and a European Commission report into the system, concerned and annoyed that the Brits and Yanks has got there first.
It works like this: The calls are recorded by geo-stationary spy satellites and listening stations, such as the UK's Menworth Hill, which combine satellite-intercepted calls and trunk landline intercepts and forward them on to centres, such as the US' Fort Meade, where supercomputers work on the recordings in real time.
But what, you ask, can deal with that overwhelming mass of data that helps our government spy on the world? And how does it work?
Well, a Texas Memory Systems SAM product - a combined solid-state disk (SSD) and DSP (digital signal processor). Woody Hutsell, an executive VP at TMS, said: "Fifty percent of our revenue this year will come from DSP systems, more than last year. The systems are a combination of SSD with DSP ASICs." ASICs are application-specific integrated circuits - chips dedicated to a specific purpose.
TMS has a TM-44 DSP chip which has 8 GFLOPS of processing power - that's eight billion floating point operations per second. The processing uses floating point arithmatic operations to supply the accuracy needed for the analysis. A DSP chip turns analogue signals from a sensor or recorder into digital information usable by a computer. Digital cameras will use a DSP to turn the light signals coming through the lens into digital picture element, or pixel, information.
A SAM-650 product is called a 192 GFLOPS DSP supercomputer by TMS. It is just 3U high and has 24 DSP chips and is positioned as a back-end number cruncher controlled by any standard server - a similar architecture to that used by Cray supercomputers. There are vast streams of information coming from recorded telephone conversations. The ability to have the DSPs work in parallel speeds up analysis enormously. Spinning hard drives can't feed the DSPs fast enough, nor are they quick enough for subsequent software analysis of the data. Consequently TMS uses its solid state technology to provide a buffer up to 32GB that keeps the DSPs operating at full speed.
A cluster of five SAM-650's provides a terra flop of processing power; one trillion floating point operations per second.
Echelon is a global surveillance network set up in Cold War days to provide the US goverment with intelligence data about Russia. One of the main contractors is Raytheon. Lockheed Martin has been involved in writing software for it. Since then it has expanded into a general listening facility, an electronic vacuum cleaner, sucking up the world's telephone conversations. Information about it's existence has been reluctantly revealed, prompted by scandals such as the recordings of Princess Diana's telephone calls by the NSA.
Recorded signals are fed into the TMS SAM systems where the DSPs filter out the noise to produce much clearer signals that software can work on to detect individual voices, perform voice recognition, and listen out for keywords, such as, for example, "Semtex". Decryption of encrypted calls is also a likely activity.
Hutsell says the SAM systems, "are supplied to intelligence agencies and the military though system integrators like Raytheon, Lockheed Martin and Zeta. It's an intelligence community application involving data from various sources. This is loaded into RAM and then real-time analysis is carried out on it. Step one is to filter out the noise and our DSP chips are used for that. Then they look into patterns using other tools - images or voice. It's
By Chris Mellor, Techworld
You've probably heard about Echelon, the vast listening system run by the US, UK, Canada and Australia that scans the world's voice traffic looking for key words and phrases.
Aside from using the system for industrial espionage and bypassing international and national laws to listen in on people, it is also used to listen out for people like Osama bin Laden and assorted terrorists in the hope of preventing attacks.
All this is out in the relative open thanks to investigative journalists and a European Commission report into the system, concerned and annoyed that the Brits and Yanks has got there first.
It works like this: The calls are recorded by geo-stationary spy satellites and listening stations, such as the UK's Menworth Hill, which combine satellite-intercepted calls and trunk landline intercepts and forward them on to centres, such as the US' Fort Meade, where supercomputers work on the recordings in real time.
But what, you ask, can deal with that overwhelming mass of data that helps our government spy on the world? And how does it work?
Well, a Texas Memory Systems SAM product - a combined solid-state disk (SSD) and DSP (digital signal processor). Woody Hutsell, an executive VP at TMS, said: "Fifty percent of our revenue this year will come from DSP systems, more than last year. The systems are a combination of SSD with DSP ASICs." ASICs are application-specific integrated circuits - chips dedicated to a specific purpose.
TMS has a TM-44 DSP chip which has 8 GFLOPS of processing power - that's eight billion floating point operations per second. The processing uses floating point arithmatic operations to supply the accuracy needed for the analysis. A DSP chip turns analogue signals from a sensor or recorder into digital information usable by a computer. Digital cameras will use a DSP to turn the light signals coming through the lens into digital picture element, or pixel, information.
A SAM-650 product is called a 192 GFLOPS DSP supercomputer by TMS. It is just 3U high and has 24 DSP chips and is positioned as a back-end number cruncher controlled by any standard server - a similar architecture to that used by Cray supercomputers. There are vast streams of information coming from recorded telephone conversations. The ability to have the DSPs work in parallel speeds up analysis enormously. Spinning hard drives can't feed the DSPs fast enough, nor are they quick enough for subsequent software analysis of the data. Consequently TMS uses its solid state technology to provide a buffer up to 32GB that keeps the DSPs operating at full speed.
A cluster of five SAM-650's provides a terra flop of processing power; one trillion floating point operations per second.
Echelon is a global surveillance network set up in Cold War days to provide the US goverment with intelligence data about Russia. One of the main contractors is Raytheon. Lockheed Martin has been involved in writing software for it. Since then it has expanded into a general listening facility, an electronic vacuum cleaner, sucking up the world's telephone conversations. Information about it's existence has been reluctantly revealed, prompted by scandals such as the recordings of Princess Diana's telephone calls by the NSA.
Recorded signals are fed into the TMS SAM systems where the DSPs filter out the noise to produce much clearer signals that software can work on to detect individual voices, perform voice recognition, and listen out for keywords, such as, for example, "Semtex". Decryption of encrypted calls is also a likely activity.
Hutsell says the SAM systems, "are supplied to intelligence agencies and the military though system integrators like Raytheon, Lockheed Martin and Zeta. It's an intelligence community application involving data from various sources. This is loaded into RAM and then real-time analysis is carried out on
Direct clicky link for the copy-and-pasting impaired.
Free of Flash! Free of Flash!
direct link to the mirrordot cache
Download from www.pacifica.org the MP3 the interview with the former translator, who worked for the US state agencies. She says that the translation practice is bad. Just download and listen to what real people, who work the system, say. Indeed if the system is so nice, why 9/11 could happen? I guess it is similar to Regan's Star War technology; - to mislead people in believing that they can control everything, to reduce the usage of telephony and e mail.
" A DSP chip turns analogue signals from a sensor or recorder into digital information usable by a computer. "
Um, no that would be a ADC. A DSP is a Digital Signal Processor, which is basically like any other processor just built to do certain types of calculations very fast.
The ACLU has a fairly comprehensive, albeit slightly out of date, site dedicated to ECHELON.
Others are here, here, here and here . The journalistic quality varies. You might have to search for "Kenetech".
As a state gets corrupt, its laws multiply; the most corrupt states have the most numerous laws. (Tacitus, Annales 3:27)
Don't be silly, all those sorts of people use "scrambler" phones and encrypt.... .. a bit like skype really...
http://slashdot.org/~GuyFawkes/journal
it really depends on how many asic's are being used. true the design costs are very high but it still becomes economically more desirable to use the asic platform as long as the production run is high enough (100K units and up). the cost of a production run asic is so low compared to fpga that even with the design costs factored in, its the less expensive way to go. that being said, it probably will not stay that way much longer; the 8 bit microcontroller market for years offered up the devices in flash for small runs or masked rom for large runs. Since the manufacturers naturally want the devices to be as inexpensive as poossible, they tend to migrate the flash devices to the smallest/newest fab technologies which brings the price down alot. We are now seeing flash devices being used for large production runs as well with the programming being handled right on the production line with the added benefits of things like chip serialization being easily handled which was difficult to do with a masked chip. This has not happened yet with FPGA's; the main reason being that FPGA's have considerably larger gate counts but even so it wont be much longer until we see FPGA's being used in all but the most price-critical and the highest volume applications where a few thousand gates and/or a few cents make the difference. a good example of this is the xm radio chipset which has a very high gate count and yet needs to be offered up in a device that will retail at $49. an FPGA would simply cost too much and be too large ad the devices get smaller and cheaper. The other reason why we have not seen more FPGA usage has to do with competition; the 8 bit market has a large number of players who are all offering up products that are in direct competition with eachother and that has naturally driven down the costs and at the same time offered up much in the way of innovation and new features. the FPGA market, while growing does not have quite the same number of players although that is changing as well. a few more years and most of the players will be producing FPGA products and thats when things will really start to get interesting.
You need floating point for a lot of DSP work. Inverse Discrete Cosine Transforms which are used heavily in audio signals is one area that requires floating point.
They only require warrants for the tap order; after the tap order's been issued they recieve each individual communication as an individual, serialized entity. All of the major carriers have a system that ties into their switch, and essentially duplicates calls from/to identified numbers and forwards an electronic copy to the NSA via a connected T-1 (or better) line (Call Content Director Unit). These are present in EVERY telephone switching office in America and are essentially a 4" tall box (or multiples for multiple switches) that give essentially a 'back door' to the NSA. Local techs don't know ANYTHING about these boxes.. they're strictly touched by managers and above (and then only on order from the FCC/NSA). It's also neat to see such things as NSA and FBI smartjacks in Telephone COs... you know that they're doing a lot when, in some places, there are 3-4 smartjack cages of 12/24/36 cards each, each handling a single T1 belonging to some federal entity.
-Anonymous Coward (sure, sure, but I like my job....)
Cryptanalysis of substitution systems or codebooks is dependent on statistics, however, the attacks on many modern cryptosystems are algebraic in nature rather than statistical. From a computer hardware point of view, algebraic attacks will use integer or bit operations. Let me give some examples:
1. DES. The effective known attack is brute force. (Shimars differential cryptanalysis isn't effective in practice) As those involved in the DES Challenge effort are aware, bit operations were the way to go. There are two main approaches, very wide registers and FPGAs. Other articles seem to imply that both were explored.
2. AES. AES has not been broken yet. Most attacks being investigated are algebraic in nature. Although somewhat disputed, there is already an attack on the 256 bit key version of AES which runs in 2^230 operations. This attack uses algebra.
3. Factoring (Public Key crypto). Most approaches to factoring using integer operations. The current key lengths are currently beyond what is possible using publicly known approaches.
So if it were for modern cryptanalysis, the floating point wouldn't be very useful. If it were for voice processing on the other hand, the floating point would be vital.
One thing that gets me about modern CS research is that despite how much ends up being put to ends like this researchers still make a big deal about the non-military applications. DARPA funded voice processing for years so that technology like this could be developed. DARPA did not invest billions of dollars to make computers more accessable for the blind. Yet somehow it's news to CS people that the government massively uses the voice processing technology.
Which, while possible, is very unlikely (it would be the cryptography equivolent of finding a way to turn lead into gold).
.. I've got no clue.
Well, they _may_ have found a method to factor products of large primes more efficiently. There has been made major strides to that goal during the last ten years or so (or so it seems to me, a non-matematician).
TWINKLE broke the 512bit RSA key. Bernstein has a proposal on how a machine could break a 1024bit key. For all we know, the NSA may have found better methods - which are able to factor 2048bit keys in a short timespan.
How likely it is
However, what IS certain is that pure bruteforcing is out of the question. Whatever the paranoids may believe, not even the NSA sit on fast enough computers to break into a single SSH session if they use todays public knowledge on algorithms. Not even all the worlds computers combined would be able to break into such a session with reasonable time. Breaking into lots of them in parallell -- "yeah right".
"Rune Kristian Viken" - http://www.nwo.no - arca
> How on Earth do they manage to get 3 billion warrants every day?!
That's an easy question to answer. (1) They don't need warrants to spy on non-US citizens, (2) the capabilities of ECHELON are vastly exaggerated in an effort to instill fear.
Project: RC5-72 The project to crack a message encrypted with the 72-bit RC5 cipher.
I hope this clarifies my point.
Not very much. Because
- In this (unsophisticated) case, cracking == running (as they're brute forcing the key)
- Linked from the very page you linked to, the FAQ entry:
Which was my original remark to back up someone you followed up to with this:
I hope it's clear now..Anyone know if there is a reason for the floating point reference other than just as a 'gee whiz' number?
Echelon needs to find target words within a spoken converstaion. This implies some heavy-duty voice recognition software, given the large volume of telephone traffic to sift through and low quality of some of the most interesting data (for example, internation calls to thrid-world countries on the other side of the world). Good floating-point performance probably helps in that regard.
Come test your mettle in the world of Alter Aeon!
A former inteligence officer was my mentor in highschool. Although details are skechy about his involvment in Echelon, much of the facts presented in this /. thread thus far, are basically correct.
The area most people overlook is that the NSA/CIA/DoD wherever possible buy normal, everyday PC hardware. e.g Mac xServe G5s
The other detail is that since the original Echelon was created, hardware has improved exponentially. A Dual Xeon with 16 GB of RAM is available today, far cheaper than these RAMSAN unit.
Also, It is also believed that NSA programmers have contributed to the linux kernel. They probably have as many Linux servers as google does, if not more. The 'smoking gun' came during an informal chat with a friend who said kernel patches that originated at the NSA, which were contributed to the kernel under GPL ended up in SCO Unix.