Disappearing Cryptography
The Scoop Cryptography, argues the author, has the potential to balance power relationships between individuals and governments. Forcing people to conduct all communications in publicly-readable forms allows the honest to be oppressed by tyrants, criminals, and pranksters. Why should the innocent suffer to help authories track stupid criminals?
Wayner mainly concentrates on steganography, hiding secret communications in plain sight. Instead of using ciphers and algorithms to generate a message mathematically indistinguishable from pure random noise, one might instead replace the lowest significant bits of a JPG image with the message. Only those who analyze the image may potentially reconstruct the text.
What's to Like? Each chapter has three sections, arranged by increasing complexity. The first contains a short anecdote to illustrate the point of the chapter. (Some make immediate sense, while others seem only tangentially related.) The second section discusses the theory. The final section gets into the guts, mathematics and algorithms, analysis and common problems. This division allows readers to go only as deeply as they prefer.Early sections on information theory lay the framework for later chapters. While discussions of error correction and density don't have the cloak and dagger thrill of spy stuff, they're fundamental to serious analysis of techniques. Serious students would do well to use Wayner's extensive and excellent bibliography of books and papers to improve their knowledge.
The middle of the book is excellent. A lengthy discussion of text mimicry starts with analysis techniques, producing in a program hiding a secret message in an innocent-seeming baseball play-by-play. (It includes a dissertation on effective and reversible context-free grammars.) The next chapter, on Turing machines and reversable computing, is particularly interesting (especially after reading The Diamond Age).
More than just data hiding, the final section of the text covers privacy. Anonymous remailers can provide double-blind communication (but see the caveat below). The Dining Cryptographers algorithm of chapter 11 may be used to send a secret message without divulging the sender's identity. The final chapter adds a philosophical spin, explaining the author's biases and his reasoning for promoting secrecy. (He's Cypherpunk friendly.)
What's to Consider? This is not a book for beginners. Some of the initial theory throws around summations and other pre-calculus constructs as an integral (pardon the pun) explanation of entropy. One of the two large examples is written in Pascal. A second year computer science student should have no trouble understanding the text. A layman might not get past the second chapter (though he could safely skip most of the math.)This book is also dated -- in fact, Hemos recommended it for review partly to prompt the author and publisher to produce a new version. The anonymous remailer chapter is seriously out of date, and it would be nice to have new information about distributed.net, secure peer-to-peer communications, and web stuff. In addition, some of the softwares described have been superceded by new versions and successors.
The Summary Aging but written with the future in the mind, Disappearing Cryptography favors theory and principles, for the most part. It makes a good introduction to steganography and the study of patterns in digital communications, leading naturally to more detailed works. It may also serve as a starting point to new ideas and discussions. Perhaps 2001 will bring us a new version. Table of Contents- Framing Information
- Encryption
- Error Correction
- Secret Sharing
- Compression
- Basic Mimicry
- Grammars and Mimicry
- Turing and Reverse
- Life in the Noise
- Anonymous Remailers
- Secret Broadcasts
- Coda
- Mimic Code
- Baseball CFG
- Reversable Grammar Generator
You can purchase this book at Fatbrain.
I'm not sure exactly what your point is. Of course polititians are people. Does that mean they should not be held responsible for their policy decisions?
Or are you saying that they should be let off the hook because they are just doing what anyone else would do in their shoes? If that's true, (which I suspect it may well be) then the problem is not with the people but with the system in which they operate. Either way we have to remain vigilant.
Come on everybody, there's no day like today for a revolution!
-- It only takes 20 minutes for a liberal to become a conservative thanks to our new outpatient surgical procedure!
By non-targeted, I mean a message that might or might not contain sensitive material. For example, assuming even modest abilities at the NSA, a email containing the string "I'm going to blow up the local mall" is probably a targeted message, but even something as simple as adding a character between the original characters would seem to make a message "non-targeted" (i.e. "I.'.m. .g.o.i.n.g. .t.o. .b.l.o.w. .u.p. .t.h.e. .l.o.c.a.l. .m.a.l.l..."). Obviously, this wouldn't fool a minimal attempt to decrypt it -- as minimal as actually having a real person try and read it -- but wouldn't this slip right past most automated detectors?
How much processing/investigation time does it take to ensure that this message with the above comment isn't actually a terrorist threat?
Assuming the NSA can automatically scan all internet traffic for suspicious words (in every language?) this message gets flagged as a possible target and is stored locally until...
A second program or intellegence anaylyst scans this message to determine whether "blow up" is in the context of a terrorist target or if it refers to "Plastic Patty: the Blow Up Doll That's Fun to be With!".
Obviously, if I'm a research scientist or investment analyst, I'm more likly to be targeted by default and would need a higher level of security.
In other words, I wouldn't rely too heavily on technology, but in my opinion it _may_ be possible to rely on the realities of economoics and time.
Waltz, nymph, for quick jigs vex Bud.
Long live cryptography!
Most of the issues mentioned involving hidden messages in various formats such as jpg's and audio files are not new news however I feel any information published is good to know from an educational perspective as well as a model for those paranoid types who are concerned with big brother based programs such as Echelon and Carnivore.
Applied Cryptography offered some nice information as did Information Security Management Handbook but for relevance as to the extent of big brother watching, some should go to the NSA's website and read up on their archives including Venona, and the Enigma machines to get a grasp of how deep government goes in to get their information and how you can address minimal measures on your own to avoid having your information snooped.
Last September I also wrote a quickie document on Circumventing Carnivore that mentions some of these methods to pass information off without it getting caught up on a steriod induced governmental sniffer. Sure it may not be Harvard type material but it should create interest to anyone not too familiar with encryption, ciphertext, algorithms, a simple how to.
As for the title disappearing crypto I hardly doubt it is disappearing in fact with all the hype surrounding PKI's, and the media's ever mentioning of `[H]ackers* I can see many more books, FAQ's, and companies rushing to release more information on crypto from all levels be it beginners to mathematicians based levels.
/me bounces to fatbrain to place an order with info obtained from creditcard.com crackers (of course I'm kidding)
Sexy Unix Chick
Thanks for the memories
Vintage computer games and RPG books available. Email me if you're interested.
The review makes a somewhat misleading assertion, that steganography obviates the need for cryptography. Encrypting your message first somehow (e.g. making it look like line noise) is actually a good step to take, as it will enhance the protection afforded by steganography - the altered image just looks randomly "noisy." This is especially helpful when using images encoded with lossy compression schemes such as JPEG - since different compression factors can lead to visibly similar images, but with different noise patterns. After all, if the Bad Guys somehow come up with the original image, and compare it to your altered image, you don't want your plaintext just popping out at them instantly, do you? It's like the difference between running 'crack' and 'diff' ... or giving away your one-time pad.
#include "disclaim.h"
"All the best people in life seem to like LINUX." - Steve Wozniak
#include "disclaim.h"
"All the best people in life seem to like LINUX." - Steve Wozniak
"This presented a problem: if Coventry was defended or evacuated, the enemy would realise that their cryptosystems had been compromised, which would cost the English a key strategic advantage. So the city was sacrificed."
;-)
..and if you've ever been to Coventry, you'd know why....
The easiest part to update at this point is the code. The book contains printed Pascal, something that was almost considered a munition before the latest glasnost in the crypto wars.
There is now C code thanks to Jason Penney. He converted the original Pascal code in a pretty direct fashion. I converted the Pascal into Java. You can any of the three versions by sending me email to pcw@flyzone.com. I'm thinking of getting a website going once I figure out the current state of the export regulations. There's some problems with leaving an open site for North Korea, I think.
The program itself is modular so you can write your own grammars for encoding messages without learning C, Pascal, or Java. That means you don't need to use my lame baseball example. One of the neater developments is a website for converting messages into spam, a medium that is quite lame by default:
http://www.spammimic.com/index.shtml
Finally, if you have suggestions for new information hiding techniques or steganographic algorithms to include in a future version, I hope you'll write and suggest them to me. Any help you can give, would be appreciated.
Thanks.
No, it's not security through obscurity. Security through obscurity is reliance on the fact that the encryption method is secret to keep the data from being read. It's dismissed because a poor encryption method is vulnerable to mathematical attack no matter how secret it is, and a good encryption method is relatively invulnerable even if the method is known.
But encryption is not the end-all and be-all of security. While it hides the data you're sending, it doesn't hide the fact that you're sending a message, and is thus absolutely worthless against signals intelligence. For example, if a spy in Beijing is sending encrypted letters adressed to CIA headquarters every day from his home's mailbox, then no matter how well encrypted the message he sends, it's still obvious that he's sending information to the CIA. If he's posting pictures of his kids that have an encrypted message hidden in them to a photos newsgroup, it isn't as obvious.
There's no "we" in team, only "me"
Stenography is often raised as a solution to the covert exchange of data, but I question its validity. There are a group of very bright people employed by governments who have spent 30 years studying ways to detect hidden information, and the government has almost unlimited resources and the root password to the Constitution at its disposal.
the key to stenography is not neccessarily about keeping the government or whoever from reading the information. What stenography is really about is keeping them from realizing there is any information to be read at all. It becomes more difficult if One regularly posts the JPG's to a newsgroup, some with important data (encrypted then embedded) and some without. First the government has to realize something is going on, then they have to analyze all the JPG's to figure out which ones have data, they must then decrypt it (only to find 4 out of 5 of the messages were about golf games) and even after all that, there is no way to tell who the intended reciepient was.
Jesus died for sombodies sins, but not mine.
"Our products just aren't engineered for security,"
-Brian Valentine,VP in charge of MS Windows Development
The problem is that these =people= don't just have a few extra powers... they have powers that they can exercise with little fear of being held responsible for their actions... It may only be one person who decides to take an action but once taken, that person has an enormous shield that even usually prevents their identy being revealed. It is big brother that the individual bureaucrat hides behind.
"It's because they're stupid, that's why. That's why everybody does everything." -Homer Simpson
Interesting (I wish I had some karma to give).
Also, for a brief article, check out The Register today for a brief overview of Tempest:
The Register, TEMPEST
Waltz, nymph, for quick jigs vex Bud.
Mostly true IMHO, but I still believe Bush is a lesser of two evils. Attacks on the constitution have been in progress for quite a while, argueably commencing with FDR. Heck, he added three(?) justices to the supreme court to get his agenda through! Imagine Clinton or Bush making the Supreme court 15 justices. The man had no shame!
While it was only a single issue, I thought the reponses offered by Bush and Gore to the question of school kids getting at pr0n was interesting.
Bush was critisized for recommending that libraries and public schools (public istitution receiving federal funds) implement some sort of filtering software. OK, not great. But did you ever see Penthouse offered in a library or school? Also these are limited to individual machines. Simple to implement and to disable.
Gore offered to force all ISP's to log *all* traffic by IP address. Who gets to see the logs (and who the hell would pay for all the storage?) How long before they would be routinely inspected by law enforcement agencies to protect the public safety and 'the children'? You tell me which is more intrusive and prone to abuse.
Hopefully Bush will renege on Wassemar and remove controls on crypto.
BTW, I voted for Harry Brown.
If you put a collar on for 'protection' today, don't be surprised to find a chain attached tomorrow.
What you propose is essentially security through obscurity, a practice routinely dismissed by those with basic knowledge of cryptographic algorithms and protocols. Perhaps steganography can be used to make such a system valid, but I doubt it.
Moreover, this discussion only pertains to private conversation between two individuals. Even if I perform all data exchanges with my bank, doctor and insurance company via encrypted channels, it doesn't mean squat once they decide to share information with each other or anyone else willing to pay for it. I'd much rather do sensitive business with a company that has poor data protection but a strong privacy policy than the other way around.
As you pointed out, politicians are people. The problem is not a question of finding more ethical people to run the government. If only one leader needed to act ethically, we might maintain some kind of ideal society until such time as we made a mistake and put in the wrong leader. The problem is that governments have been given powers that people did not rightly possess in the first place to give them. I recommend reading Human Action by Ludwig von Mises:
Maybe but only in the most useless of senses.
Let's imagine that I'm 65 years old and I have 200,000 in the bank. I have a choice between one scumbag who is going to take it all or another who is going to take 199,800. Which do I choose? The lesser of two evils of course. At least I can break the news to my wife over a nice dinner.
Since Limbaugh has turned liberal into a dirty word I'll claim to be a progressive, but I still think your guy Brown is a Big Mac with fries better than the grease bags the major parties put up for us to choose from.
Like you I choose to skip them this time.
--
So, would the ethics of todays US Army have cost us the campaign had they been the ethics used by the US Army of WW2?
Sigs are awesome huh?
And as for the ring-road... Gah ! What an abortion. Truly the worst in western Europe.
I've been to nicer, prettier places than Coventry, like Sarajevo, Mostar, Srebrenica...
>So, would the ethics of todays US Army have cost
;^)
>us the campaign had they been the ethics used by
>the US Army of WW2?
You seem to be asking "would disclosure of Enigma's compromise have caused the certain loss of the war?" It's hard to say for sure, even in retrospect. You might as well ask, "would faster dissemination of information to field commanders have given us a tactical edge over Germany, allowing us to finish the war sooner?" Current philosophy and doctrine seem to say "no" to the first question and "probably" to the second.
Remember that even if Germany had found out about Enigma's compromise they didn't really have anything to replace it with, so they'd have been forced to either abandon it completely for something less reliable/fast/secure or somehow recall the encoding wheels and distribute new ones to all of their stations. In either case their communications would be disrupted or interceptable (or both) until a new and better system was in place. Besides, even if they did manage to change the wheels in all of the Nazi stations, how long would it have taken Turing to break the code again if it were based on the same principles? It's kinda like the situation with the DVD CCA and DeCSS modernly...
I'm no historian, though, so take this with a grain of salt...
Travel the Galaxy! Meet fascinating life forms...
Flamebait, No. It is basically the reverse arguement of what all of these governmental conspiracy nuts have been saying.
I want my rights back. I was actually using them when our government stole them after 9/11.
And keep in mind old != outdated. For example Computer Security Basics by the good folks at O'Reilly is old but still very usefull this is because it teaches concepts that do not change and leaves the specifics to the reader. It sounds like the only bits of this book that are outdated are some web addresses and specific versions of apps. All in all it sounds very cool although I don't think I have the math for it.
Cypherpunks: Civil Liberty Through Complex Mathematics. Those who live by the sword die by the arrow.
Given our next President and the impending erosion of freedoms I can understand the motivation though. Once a CIA brat, always a CIA brat...
--
They sacrificed a good deal more than Coventry, and went to extraordinary lengths to keep the Germans from becoming aware of exploited weaknesses in their encryption methods.
But that's an issue of strategy and ethics, not technology. You're really asking whether it's ever proper to sacrifice something (or someone) now for some supposed benefit in the future.
Let's not forget that no cryptography protects you from a good old CRT-refresh cycle tracer. The feds use it from up to thirty yards away, depending on your computer monitor. Someone reply with a link, I haven't actually seen this in awhile...they got it covered up good.
-Yeah, I have 27 karma from my non-coward posts.
I think that judging the agencies who use (and break) encryption is unwise - after all, I want the NSA to break the next Enigma code in the next big war, even if the government has swung too far to the fascist side of things.
As for technology as a double-edged sword, well, that's undeniably true, but the implication of using the word "sword" is a violent one. I prefer to think of technology, and science in general (esp. math!) as a natural resource. We can build computers with it; we can build 100 megaton bombs with it. In the end, the way we use technology is our testament to the ages.
I believe that what you're talking about is Van Eck Phreaking (that is, interrupting the stray RF that the cathode ray tube in your monitor transmits, and recreating the image on another cathode.). This is quite old stuff, and is still in use today. The Tempest stuff that was recently released deals greatly with this. Basically, if you don't have a monitor shielded in metal, you're at risk, and that's that. For more information, you can check out this link for basic information, and Van Eck's original submission, or you can check out this one, and lastly, if you want some info on how to build a Van Eck Phreaking rig, then I would suggest the book at this site. Don't forget to type in Van Eck in the search box to find the box. Happy Van Eck'ing.
--Josh Adams
-knewter
Outguess looks pretty nice, but unless I misunderstood the information on your page, there are no binaries available.
A quick view of the download page reveals only tarballs, so while I guess this is good thing, it would be a hell of a lot better if you actually had a few binaries (for consumer-level platforms) so that Joe Windoze can decide he wants to encrypt his manifesto/novel/pr0n, he can do so without installing a *nix and learning how to MAKE a binary from source.
Remember that the 'envelope' anology works only if *most* people use envelopes (encryption/steganography) around their letters rather than sending (unencrypted) postcards.
Come on, guy. It's not that hard to compile a console-style win32 binary.
The next Slashdot story will be ready soon, but subscribers can beat the rush and slashdot the links early!
They also let ships get sunk, etc. even when they knew the positions of subs.
Sometimes they'd do things like first send out a "surveillance" plane and let the Germans see it. Then the Germans would think that the British had just happened to see them and thus the attack was to be expected. Those Germans must have been getting pretty damn frustrated when every single secret covert operation was discovered by some "chance" flyby from a surveillance plane. But they deserved it for being so damn smug about enigma, not to mention the age old end-user weak link (i.e. people in the field using the same damn keys over and over, trusting that the machine would just magically make all their correspondence uncrackable).
It's 10 PM. Do you know if you're un-American?
It's been written about in several books. There was no advance knowledge of Coventry being bombed. Do a web search, find the refutations. This should be common knowledge by now, it's been refuted so often.
--
Infuriate left and right
That's what bothers me....
You may be glad to hear that this philosophy has changed somewhat. I grew up in Fort Meade, MD and knew several employees of the NSA, including family members of mine. I remember hearing the Coventry story several times, always in the tone of "I'm glad we don't do that anymore".
;^) I've grown up now, and work for the Army in an Intel unit. Army doctrine regarding intelligence gathered from even the most sensitive sources is that it does no one any good if it isn't transmitted to the people who need it (battle ground commander, mayor of the city about to be bombed, etc.) Saving US and civilian lives is the first priority, so at least today's US Army wouldn't sacrifice Coventry to save the Enigma; in fact, just the opposite.
Decisions of that type were made when our intelligence operations were young and took themselves much more seriously than they do now (if that's imaginable
Please don't judge modern intel analysts based on the poor decisions of their forebears
Travel the Galaxy! Meet fascinating life forms...
My SO comes from Coventry and even she agrees with me, it's the pits.
Ian
P.S.
I don't frequent uk.misc.... at all.
Although you obviously have intimate knowledge of those sort of newsgroups.
P.P.S. If you want to flame me then have the courage to post as something other than "anonymous Coward"
HAND
I hate to be picky, but seeing "stenography" (2 : shorthand especially written from dictation or oral discourse) posted repeatedly as the subject line is making me laugh.
;)
It's a book about masked data, not how to dictate your boss' correspondence.
Say it with me... Ste-gan-o-gra-phy
No, it isn't. Stenography is rapid writing system commonly used by secretaries before tape-recorders became commonplace.
I suspect you intended to write steganography!
I see that the it includes some algorithms. Does it include reference implementation in code for these? I usually find these quite helpful.
Yep, I never spell check.
More incorrect spellings can be found he
Seems like there's a bit too much buck-passing and not enough responsibilty, on ALL levels.
It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
Information Hiding Techniques for Steganography and Digital Watermarking by Katzenbeisser and Petitcolas is a book that has just been published last year and contains a lot more detailed technical information. However, Disappearing Cryptography is at least an amusing book to read.
There is also a bunch of software out there that can be used to embed hidden information into images and sound files. However, most of the programs can be detected. Read the paper by Westfeld and Pfitzmann, "Attacks on Steganographic Systems".
I myself have written a tool to hide data into JPEGs. It's called OutGuess.
You can find more software here.
Even the most outdated material can bring back a resurgence of new and updated material for the future. Just look at MUD's. Everyone thought they were outdated but now they're aparently having a resurgence of their own, as is the subspace community. Also, I've noticed among some com sci friends that many are looking back into the older languages.
Let me give you an example. During WW2, the English developed a technology for decrypting the communications of the German military. One of these messages revealed that the city of Coventry was to be attacked. This presented a problem: if Coventry was defended or evacuated, the enemy would realise that their cryptosystems had been compromised, which would cost the English a key strategic advantage. So the city was sacrificed.
Now, the spiritual descendants of these early cryptanalysts work for the NSA. If they have the technology to scan for stenographically concealed data (or even to decrypt PGP) don't expect them to announce the fact. The UK goverment have recently decided that they want to be able to read every packet on the UK Internet backbone: why would they bother if it was that easy to conceal information?
In other words, don't rely too heavily on technology, because it's a two edged sword.