Slashdot Mirror
The Science of Secrecy
Matthew Sparkes writes "Ever since the first codes and ciphers were developed, there has been a battle between those who want to keep their information secret, and those who want to read that information. It has been a purely intellectual war, but one that is often driven by motives from above that are far more violent. This book chronicles that battle, from it's inception, to the modern day, and outlines the techniques used to obfuscate information, and the fascinating history of the application of those techniques." Read the rest of Matthew's review.
The Science of Secrecy - The History of Codes and Codebreaking
author
Simon Singh
pages
224
publisher
Fourth Estate, London
rating
7
reviewer
Matthew Sparkes
ISBN
1841154350
summary
An historical look into cryptography and crypt-analysis, with a significant amount of technical knowledge to impart also.
Cryptography has been a tool largely used by governments to avoid their communications being read by the enemy or other unfriendly states, but historically it has also been utilized by individuals to protect their more questionable or taboo activities from discovery.
This battle is presented in the book as a rather bipolar trend; cryptographers trying to protect data and crypt-analysts trying to discover the meaning of that data. I found this to be slightly misleading. The representation of the history of the field as a constant struggle between two distinct parties does make for a more entertaining read, and adds an element of conflict by conjuring images of an ancient and continual intellectual game, but in reality these two groups are often one and the same.
Whilst I admit that the race to develop stronger codes and ciphers was in many ways separate from the race to break them, they were also inextricably linked, and undertaken by the same people. One has to allow a certain amount of poetic license in popular science books, especially in this case, as it has lightened what could have been a dry topic.
The way in which the book is structured allows a complete novice access. Starting from the first discoveries in cryptography and working forward chronologically, whilst explaining the method behind the discoveries, educates the reader in basic technique without effort. One reads a fascinating historical account, and later realizes that they now have a good understanding of the mathematical concepts behind these approaches they've been reading of.
The book places these techniques into context, giving historical examples of their use. Often they are revealed to have played large and important parts in famous events, ranging from wars and political plots, to events which are not even strictly related to cryptography.
For example it is shown how crypt-analytic approaches were utilized in the deciphering of ancient languages such as hieroglyphics. These languages are dead, in that there are no living individuals who have the ability to read them, and no information was available to help in their deciphering. By studying the frequency of letters or symbols in the text, as when attempting to break a cipher, it was possible to slowly read meaning into the text, and map the alphabet.
Many of these scripts were decrypted by amateur crypt-analysts, rather than academics. One point the author makes is that there are still many that remain a mystery, such as the Etruscan and Indus scripts. One has to wonder whether a book like this, combined with the current national fixation with puzzles such as Soduko, would create a resurgence in interest, and lead to some of these being broken.
One interesting point that the book makes is that the vast majority of work performed by cryptographers is done in secret, largely for security agencies all over the world, and that this has been true for some time. Therefore it is not uncommon for crypt-analysts to receive no recognition for their work, or to have a discovery attributed to them long after their death. These organizations must classify the work in the interest of national security, so in a way this book stands as an anonymous tribute to their cunning and multidisciplinary talent.
Examples from the book of such discoveries include Charles Babbage breaking the Vigenere cipher in 1854, which only came to light in the 1970s. The author suggests that the work was kept secret to aid the Royal Navy, as it occurred just after the Crimean War started. The credit for the discovery instead fell to a retired Prussian army officer who independently discovered it in 1863.
This is shown to be one of the enduring themes of the story of cryptography, leading right through to the 1970s where credit for developing the RSA cryptographic technique went to Diffie, Hellman and Merkle in 1975, despite being developed in 1969 at GCHQ, a fact that was only publicly admitted in 1997.
A section of the book that will be of particular appeal to computer scientists is where cryptography is shown to have given birth to computing. Born from the desire for a method to perform simple operations on numbers very quickly. Computers now dominate the field of cryptography and crypt-analysis, and their ability to perform a task millions of times with no errors has transformed the science. It is also noted how much we rely on cryptography daily, in areas such as e-commerce, where our details are encrypted without us even being aware of the fact.
The final chapter is an examination into the politics of cryptography, and a balanced look into the ethical implications of governmental snooping on communication, versus the possible benefits of reducing serious crime and terrorism. This is clearly a very pertinent point in todays political climate, and a balanced look at this issue is a very valuable thing. With the heightened risk of terrorist attack, or at least the public perception of such, the government are intercepting more and more communications for analysis, and encryption by criminals is becoming more and more popular.
The book covers the topic well; from governmental use, to anecdotes about lovers exchanging secret messages. Throughout this the reader is constantly being eased into the mathematical technique behind, in a manner that does not require a background in mathematics. There is an appendix to the book, in the form of 5 cipher challenges for the reader to attempt to crack. The knowledge gleaned from the book should be preparation enough to do so, and will fascinate the curious nature of the books audience.
Matthew Sparkes' is a journalist and programmer, his homepage is Non-Tech City."
You can purchase The Science of Secrecy from bn.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.
Cryptography has been a tool largely used by governments to avoid their communications being read by the enemy or other unfriendly states, but historically it has also been utilized by individuals to protect their more questionable or taboo activities from discovery.
This battle is presented in the book as a rather bipolar trend; cryptographers trying to protect data and crypt-analysts trying to discover the meaning of that data. I found this to be slightly misleading. The representation of the history of the field as a constant struggle between two distinct parties does make for a more entertaining read, and adds an element of conflict by conjuring images of an ancient and continual intellectual game, but in reality these two groups are often one and the same.
Whilst I admit that the race to develop stronger codes and ciphers was in many ways separate from the race to break them, they were also inextricably linked, and undertaken by the same people. One has to allow a certain amount of poetic license in popular science books, especially in this case, as it has lightened what could have been a dry topic.
The way in which the book is structured allows a complete novice access. Starting from the first discoveries in cryptography and working forward chronologically, whilst explaining the method behind the discoveries, educates the reader in basic technique without effort. One reads a fascinating historical account, and later realizes that they now have a good understanding of the mathematical concepts behind these approaches they've been reading of.
The book places these techniques into context, giving historical examples of their use. Often they are revealed to have played large and important parts in famous events, ranging from wars and political plots, to events which are not even strictly related to cryptography.
For example it is shown how crypt-analytic approaches were utilized in the deciphering of ancient languages such as hieroglyphics. These languages are dead, in that there are no living individuals who have the ability to read them, and no information was available to help in their deciphering. By studying the frequency of letters or symbols in the text, as when attempting to break a cipher, it was possible to slowly read meaning into the text, and map the alphabet.
Many of these scripts were decrypted by amateur crypt-analysts, rather than academics. One point the author makes is that there are still many that remain a mystery, such as the Etruscan and Indus scripts. One has to wonder whether a book like this, combined with the current national fixation with puzzles such as Soduko, would create a resurgence in interest, and lead to some of these being broken.
One interesting point that the book makes is that the vast majority of work performed by cryptographers is done in secret, largely for security agencies all over the world, and that this has been true for some time. Therefore it is not uncommon for crypt-analysts to receive no recognition for their work, or to have a discovery attributed to them long after their death. These organizations must classify the work in the interest of national security, so in a way this book stands as an anonymous tribute to their cunning and multidisciplinary talent.
Examples from the book of such discoveries include Charles Babbage breaking the Vigenere cipher in 1854, which only came to light in the 1970s. The author suggests that the work was kept secret to aid the Royal Navy, as it occurred just after the Crimean War started. The credit for the discovery instead fell to a retired Prussian army officer who independently discovered it in 1863.
This is shown to be one of the enduring themes of the story of cryptography, leading right through to the 1970s where credit for developing the RSA cryptographic technique went to Diffie, Hellman and Merkle in 1975, despite being developed in 1969 at GCHQ, a fact that was only publicly admitted in 1997.
A section of the book that will be of particular appeal to computer scientists is where cryptography is shown to have given birth to computing. Born from the desire for a method to perform simple operations on numbers very quickly. Computers now dominate the field of cryptography and crypt-analysis, and their ability to perform a task millions of times with no errors has transformed the science. It is also noted how much we rely on cryptography daily, in areas such as e-commerce, where our details are encrypted without us even being aware of the fact.
The final chapter is an examination into the politics of cryptography, and a balanced look into the ethical implications of governmental snooping on communication, versus the possible benefits of reducing serious crime and terrorism. This is clearly a very pertinent point in todays political climate, and a balanced look at this issue is a very valuable thing. With the heightened risk of terrorist attack, or at least the public perception of such, the government are intercepting more and more communications for analysis, and encryption by criminals is becoming more and more popular.
The book covers the topic well; from governmental use, to anecdotes about lovers exchanging secret messages. Throughout this the reader is constantly being eased into the mathematical technique behind, in a manner that does not require a background in mathematics. There is an appendix to the book, in the form of 5 cipher challenges for the reader to attempt to crack. The knowledge gleaned from the book should be preparation enough to do so, and will fascinate the curious nature of the books audience.
Matthew Sparkes' is a journalist and programmer, his homepage is Non-Tech City."
You can purchase The Science of Secrecy from bn.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.
Between Silk and Cyanide : A Codemaker's War, 1941-1945; Leo Marks
Enigma; Robert Harris
A feeling of having made the same mistake before: Deja Foobar
First rule is dont talk about it!
The book isn't available at Barnes and Noble, but you can buy it here for as low as $4.86: Science of Secrecy: The Secret History of Codes and Codebreaking. And if you use the "secret" A9.com discount, you can save an extra 1.57%!
dutch agents
A feeling of having made the same mistake before: Deja Foobar
An fun novel by Neal Stephenson about WWII's codebreaking effort and turing machines, among other things.
Polyalphabetic ciphers like the Vigenete are old - 1500s. They replaced the easy to crack alphabetic ciphers used previously. A much more effective cipher was an iterative alphabetic cipher like that used on the Enigma; it was a successive series of alphabetic substitutions, but the substitutions changed based on what letter was typed previously (each letter would rotate the substitution wheels by varying amounts).
Does this book cover the Voynich Manuscript? I'd be interested in seing if someone cracks that (or determines that it says nothing - still, it's interesting that it follows Ziph's law!).
By a scallop's forelocks!
The RSA cryptographic technique was known to have been developed by GCHQ but credit for making the technique applicable went to Diffie, Hellman and Merkle. This article makes it seem like GCHQ received no credit until the late 90s which is simply incorrect. They received credit for their ideas, but they simply were not the first to apply these ideas.
LINUX ONLINE POKER: Linux Poker
Good old 'social engineering'. Actually, the history of cyphers is also a history of social engineering (phishing, spying, deception). For instance, you can have a quite weak code if no one is looking for your code. On the other hand, if you have broken the enemy's code, you don't want them to know about it. Or you could put false information in a weak code and let the enemy find and decode it. I actually find that kind of stuff more interesting than the technical details.
"but historically it has also been utilized by individuals to protect their more questionable or taboo activities from discovery."
... questionable or taboo was the thing you decided to type? Instead of, oh I don't know, my home-office docs ... or just my random thoughts? Why does it always have to be "someone hiding something bad" instead "someone encrypting something because they damn well please"?
Emphasis mine, of course.
For h.christ's sake
Bah.
That is all.
Not being a pacifist, being proactive about security can keep violence from occurring.
Peace, as some say, is patriotic. This statement makes no sense at all.
A yearning for peace can be patriotic in a context for our country and for our compatriots.
Pacifism is NOT patriotic. On the surface it appears to be condusive to peacefulness but under its thin veil lies instibility, weakness, treachery and, ultimately, chaos. The enemy within uses those weapons to bring democracy down from within.
Sincerely,
The enemy of the enemy within.
Take a peek at his website: http://simonsingh.net/. As a math enthusiast, I really liked "Fermat's Last Theorem."
I am not left-handed, either!
Perhaps the best book out there on cryptography is George P. XQLGNIZ's GHTWENBZ HG PBLATZ NRPTKNIYPO. Unfortunately, no one has ever been able to crack the code it's written in.
"It has been a purely intellectual war, but one that is often driven by motives from above that are far more violent."
Oh really. I wonder how many times a cipher was broken by first breaking the senders bones and then asking questions?
The first thing I wanted to know when I looked at this review was, "How is this different from his previous, The Code Book ??
The answer is, not much at all, by the author's own admission:
In other words, if you've already read The Code Book (and you should! It's great!), you won't need to rush out and buy Science of Secrecy -- but if you want to get a gift for someone, a hardback copy of The Science of Secrecy (along with the DVDs of the TV series if available) might server better.
The review sounded rather familiar to me. I've got Singh's book 'The Code Book', turns out that's almost the same.
... (end quote)
From Singh's site:
(quote)
The Science of Secrecy is my second book on cryptography. My first, called The Code Book, covers similar material to the Science of Secrecy. It is already available in paperback so it is somewhat cheaper. The advantages of The Science of Secrecy are that it is in hardback, better illustrated, and follows the structure of the TV series. If you have read The Code Book then you probably would not want to read The Science of Secrecy, but
I really enjoyed reading The Code Book, by the way. It's an accessible introduction to cryptography.
Purchase... well, EIGHT copies are available from the used section - no new copies, as it was originally published in January of 2000.
It sounds like an interesting read, but why post this if it isn't available in even double digit quantities?
That's no secret
Ever since the first codes and ciphers were developed, there has been a battle between those who want to keep their information secret, and those who want to read that information. It has been a purely intellectual war, but one that is often driven by motives from above that are far more violent. This book chronicles that battle, from it's inception, to the modern day, and outlines the techniques used to obfuscate information, and the fascinating history of the application of those techniques.
The book's correct title is "The Code Book: The Science of Secrecy from Ancient Egypt to Quantum Cryptography". (See title at Amazon.)
I'm a little surprised we're seeing a review of it only now; it's 5 or 6 years old. I have it, and greatly enjoyed it.
Is the reviewer clueless of crypto history? "This is shown to be one of the enduring themes of the story of cryptography, leading right through to the 1970s where credit for developing the RSA cryptographic technique went to Diffie, Hellman and Merkle in 1975, despite being developed in 1969 at GCHQ, a fact that was only publicly admitted in 1997" RSA=Rivest Shamir Adleman. Diffie, hellman and Mercle introduced the concept public key crypto. Diffie and Hellman based their DH scheme on the difficulty of the discrete log problem. RSA introduced public key crypto based on the hardness of factorization of a large composite.
The apostrophe (') is used to denote a contraction, that is, letters that are removed from a word or several words to make a shorter word. Therefore, IT'S is a contraction for IT IS, something a six-year-old could tell you.
I'm a huge fan of Cryptonomicon, but if you are interested in the real-life counterpart to it, check out Battle of Wits: The Complete Story of Codebreaking in World War II. Quite technical, but at the same time, action packed (the one and only Ian Fleming is in it!!!), it describes the cryptographic efforts during the war and how they redefined what we now think of Intelligence. It is a must read. Im pretty sure that Stephenson read this book and that is how he came up with the idea for Cryptonomicon.
"There is no teacher but the enemy."-Mazer Rackham
It was a great introduction to encryption. I'd love to see it again to show others but never repeated and couldn't find it.
I wanted to second this. I read this a while back, and it's what really got me interested in modern cryptography; he works up very gently from basic "Boy Scout" type secret-message ciphers (winding a paper tape around a stick, etc.) up to Diffie-Hellman key exchange and a fairly good explanation of quantum cryptography.
The list of further reading in the back, as I recall, is quite good also. I think that's where I first was pointed towards Bruce Schneier's Applied Cryptography, which is a great (if quite dense) tome, once you've decided you're interested in the subject. I think it's much better for someone to cut their teeth on a slightly less-academic book than Schneier's if they're unfamiliar with the subject, however.
"Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
Pot, kettle.
Following your logic:
"he" = "Fred"
Fred smells, because Fred has crapped in Fred's pants.
Fred smells, because Fred has crapped in he's pants.
Semms there's a bit more to grammar than string substitution.
Only three things are certain; death, taxes, and apocryphal quotations - Ben Franklin.
Computationally inexpensive, indeed.
"Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
That's not true for the German Enigma machine. The rotor was stepped once for each key press. Perhaps other rotor machines like the Japanese Purple cipher machine had a variable stepping mechanism.
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
And if you haven't ready either or seen the series, which would be suggested?
While the show may have been shown on the Discovery Channel, it was originally made for the UK's "Channel Four" network by Diverse Productions. It was written by Simon Singh, so the same-name thing is not just a coincidence.
... wide variety of subject matter they deal with. (One might almost call it 'diverse' ... okay, I'm done.)
Diverse lists it on their website, but there's no link to a DVD or any other signs that it exists. Too bad, because at 5, 30-minute episodes it would make a good two disc set (throw one 30-minute reel of extras on there and you'd have two 90 minute DVDs). I'd bet they'd make far more revenue from that then they would from having it sit around in their archives.
Their web page for the series is:
http://www.diverse.tv/programme.aspx?id=8
In a completely unrelated note, they are apparently looking for families who want to be on a show they're filming for TLC here in the US. Very
"Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
good lord, you're a moron...the specific ommission of the apostrophe in the possessive form of the pronoun 'it' (i.e., its) is to exclude confusion with the contraction of 'it is' (i.e., it's).
Is your political life really that empty that no matter what the topic, you still have to defend GWB?
I feel sorry for your wife/girlfriend/boyfriend whatever if you have one.
Infuriate left and right
This book chronicles that battle, from it is inception,
That sounds good to you?
It was to the rest of us. What on earth were you doing sniffing that man's hangdown?
The right hand rotor was stepped once per keypress on the Enigma. The motion of the neighboring rotors was varied.
By a scallop's forelocks!