Slashdot Mirror


Neal Stephenson on Zeta Functions

Introspective writes "Over on Cryptome they have published an Email from Neal Stephenson explaining his use of Zeta functions in Cryptonomicon. It gives a nice insight into writing about advanced cryptography ( in fiction, that is ) and the kind of reactions he gets back from his readers."

47 of 102 comments (clear)

  1. I just have to laugh... by freeBill · · Score: 5

    ...at this...

    But I can assure you that many readers of fiction underestimate just how much of a novel's content is simply made up. There is a common assumption among readers that much of what appears in a novel is thinly veiled and repackaged reality. You can imagine how provoking this is to a novelist who works so hard to invent it.
    ...especially since the brilliance of The Cryptonomicon is the degree to which it blended clearly historical facts with clearly fictional events. I found myself wondering time and again where the line was drawn between what was made up and what was not. Time and again Neal used a series of facts (say Fact A, Fact B, Fact C, Fact D, and Fact E) the first of which (Fact A) was based on history and the last of which (Fact E) clearly could not have happened. The fiction was blended so well with the fact that I couldn't tell where the transition between fact and fiction began (Fact B? Fact C? Fact D?).

    A good example of this was the account of Alan Turing and how he intuited the idea of a digital computer by contemplation of Goedel's Incompleteness Theorem: I knew Turing conceived of the idea of computers long before they were invented. I knew he was very much aware of Goedel (his Noncomputability Theorem rests entirely on Goedel's methods).

    But I had never heard it said that he had figured out that computers were possible based on the implications of Goedel. We can see that today, but we have the benefit of hindsight. Was this just something Neal made up based on that hindsight? Or did Turing really see this back then?

    There were clearly fictional parts of the book's Turing. We can safely assume the bicycle ride was invented. (Am I the only one who noticed the fact that he introduced the bike-chain explanation of why prime numbers are so key to crypto without ever doing anything with it?) The vicar's wife probably never peeked at her bowl full of balls (I think).

    Where did the Goedel inspiration go on this truth-fiction spectrum? Neal's blurring of the line makes it hard to determine from the novel. That's good. It makes for a ripping good yarn. But it also makes me less than sympathetic to the author's complaints about readers. Yeah, those readers just assume more of the novel is real than is actually the case.

    That's right. Mess with our minds and then complain that we're confused.

    For those who are wondering, yes, Enos Root did die in Sweden in 1944 only to reappear 50 years later in a prison in the Philippines. And, for those who are wondering about my question, I have found evidence that Turing's inspiration was indeed based on Goedel.

    Of course, there's always the possibility some reality hacker read the book, decided it was better than the actual story, and started spreading historical references to the Goedellian inspiration of Turing. The universe is, after all, controlled by those who have an understanding of the source code.

    Reading is FUNdamental, according to the vicar's wife. I don't think she peeked. Really.

    --
    Eternal vigilance only works if you look in every direction.
    1. Re:I just have to laugh... by Syberghost · · Score: 2

      ...especially since the brilliance of The Cryptonomicon is the degree to which it blended clearly historical facts with clearly fictional events. I found myself wondering time and again where the line was drawn between what was made up and what was not.

      You should also read the Illuminatus Trilogy. Some key bizarre events in it are factual, but it's pure fiction.

      Or so They want you to think.fnord :-)

      -

    2. Re:I just have to laugh... by schulzdogg · · Score: 5
      There were clearly fictional parts of the book's Turing. We can safely assume the bicycle ride was invented. (Am I the only one who noticed the fact that he introduced the bike-chain explanation of why prime numbers are so key to crypto without ever doing anything with it?) The vicar's wife probably never peeked at her bowl full of balls (I think).

      Incorrect! Turing's bicycle did have a broken chain! He did bury silver as a shore against accupation. Read his biography. It was amazing how realistic some of those things were...

    3. Re:I just have to laugh... by guinsu · · Score: 2

      For those who are wondering, yes, Enos Root did die in Sweden in 1944 only to reappear 50 years later in a prison in the Philippines.

      You know, I didn't get ths part at all. Did he fake his own death? Was I reading this part too late at night and I missed something? Mod me off-topic, just answer me :)

  2. Then there's the FTL drive problem by freeBill · · Score: 5

    If I figure out a really neat idea for a faster-than-light drive but there's just one minor problem with it, I write a hard sci-fi novel based on it, glossing over the problem.

    If I figure out a really neat idea for a faster-than-light drive with no problem, I don't have time to write the novel. I'm out in the back yard building my spaceship.

    --
    Eternal vigilance only works if you look in every direction.
  3. Re:So what is the zeta function ? by nihilogos · · Score: 2

    And if you would like to achieve ever lasting fame and noteriety you could try to prove the Riemann Hypothesis which conjectures that every x satisfying Zeta(x) = 0 has real part 1/2 .

    I'd like to see a proof posted on slashdot.

    --
    :wq
  4. Thanks... by silent_poop · · Score: 2

    ...for warning us about the spoilers.

    --

    --

    --
    silence is poetry.
  5. ... by ruin · · Score: 3

    Now I know why Cryptonomicon was such a thick book...
    --

    --
    share and enjoy
  6. The real history of WWII cryptanalysis by Animats · · Score: 4
    The book to read is "Battle of Wits, The Complete Story of Codebreaking in WWII". This has a broader overview of the entire operation, including pictures of codebreaking machines not previously published. The bombes are of course shown, but there are also film comparators that used 70MM film, as well as a building-sized machine built out of telephone switching equipment by Bell Labs. There's also considerable discussion of the use of standard and modified IBM punched card equipment.

    Most writers on the subject haven't really captured the scale of the operation. This wasn't done by a few smart people. WWI cryptanalysis was like that, but WWII made it into an industrial operation. Friedman was the one who first used IBM gear for cryptanalysis (in 1934, and it was a really tough sell getting the money during that period). Once the operation really got going, tens of thousands of people, and thousands of machines of various types, were involved.

    Cryptanalysis on that scale had ever been done before. The Germans and Japanese had cryptanalytic operations, but at the "small group of smart people" level. Small groups would never have decrypted enough stuff to seriously affect the war. But the industrial-strength effort mounted by the Allies made a real difference.

    It's instructive to look at the pictures. The stuff built by National Cash Register looks like the innards of a cash register. The stuff built by IBM looks like IBM tabulators. The stuff built by Bell Labs looks like a telephone central office. The Colossus machine, though, does have a vague resemblance to an early tube computer, although the big endless loops of paper tape clearly indicate its special purpose nature.

    Colossus was actually based on some prewar British Telephone experiments with electronic switching. And nothing that came out of the crypto work worked anything like a general-purpose computer. All the crypto stuff was very special-purpose. This really isn't where computers came from. Babbage actually had a much more computer-like architectural concept.

    The problem wasn't theoretical. It was that nobody had yet developed a useful high-speed data storage device that didn't involve moving parts. Using two tubes to store one bit was too expensive and bulky to be used for a general purpose computer. Delay line memory came after the war, and was an outgrowth of some radar gear that used delay lines. The stuff during the war stored its state in relays, tubes, paper tape, or punched cards. The hardware for a useful, programmable, general purpose computer just wasn't available yet.

    1. Re:The real history of WWII cryptanalysis by Animats · · Score: 2
      That's a great story in the Dayton Daily News. It mentions that the NCR people had been working on high-speed electronic counters, and seriously looked at building an all-electronic bombe using gas-tube technology. But they decided it was just too complex and too big a step to make happen fast, so they chose to build an electromechanical machine, something NCR could produce in quantity with their existing plant.

      That was the right decision. The mass-produced NCR bombes had a real effect on the war effort. ENIAC, on the other hand, didn't work until after the war.

      The key point here is that using electronics wasn't a conceptual problem. It's that good parts weren't available yet. Much of the early history of vacuum-tube computers revolved around getting better tubes made. That was basically solved by 1950; by the time the UNIVAC I was built, operational tube failures weren't a problem.

      (Why? At every UNIVAC I power-up, the machine was run on "high margins" for a while, with the voltages slightly high. This caused any tubes near failure to fail. Failures were easily detected, and they were then replaced, allowing a day with no tube failures. Tube failures in operation were very rare, probably rarer than Windows crashes. But that was 1950 tube technology, not 1942 tube technology.)

    2. Re:The real history of WWII cryptanalysis by ch-chuck · · Score: 2

      Speaking of bombe's - there was a recent series of articles in the Dayton Daily News about the people behing the NCR / Navy's Enigma cracking machine here. Nice read.

      --
      try { do() || do_not(); } catch (JediException err) { yoda(err); }
  7. NSA Kids Page by Animats · · Score: 2

    There really is a National Puzzle Center run by the NSA. Typical question: Which of the following palettes represents a possible PNG palette?

  8. Zeta Function in Astronmy & Physics (OT) by gnarly · · Score: 2

    Slightly OT, but the Zeta function, in addition to being of significance to primes is important to astronomy. That's because to derive the thermal emission from eg. a star as a function of Temperature you need to integrate the Planck Blackbody Function, which gives Zeta(4) = pi^4/90 The result is known as the Stephan-Boltzmann Law

    --
    :-( is a registered trademark of Despair.com
  9. Re:The BIG U is in print by WNight · · Score: 2

    Ummm... Mute, Ox/Orn/Omnivore, Viscous Circle (series), and a bunch of others. Early Xanth, Incarnations, and Adept books.

    I liked those ones much more than his later work which I stopped reading. I partly outgrew him, but he also got a lot more childish in later books.

    IMHO the 80s were his strong period.

  10. Re:Is this an appropriate posting? by Anonymous Coward · · Score: 2
    Some e-mail has come into my box recently that appears to be a fragment of an exchange between you, or some friend or associate of yours, and Bruce Schneier. The subject is zeta function cryptography in my novel CRYPTONOMICON. The e-mail has been bounced back and forth a few times and so it is not entirely clear to me who was holding down your side of the exchange. I am going to send this message to you in the hopes that you find it of interest and that you will forward it to anyone you think is interested.
    Emphasis mine. Sigh. Please read more carefully.
  11. Well, duh! by Gorobei · · Score: 2
    Think of every mass-market book or movie that touches on a topic you know well (e.g. computers, hang-gliders, math, Egyptian hieroglyphs, rockets, ancient stone-work.) They ALL misexplain the topic. Any rational author will pick a few good concepts and gloss over the details... audiences do not want a hundred pages of footnotes about the current state of the art.

    Live with it, and pray your product isn't mentioned by name. Do you really expect "Sneakers" to provide cryto info, or "Dr Strangelove" to explain nuclear strategy? Any item more complex than a felt-tip pen should be made non-company specific by a rational author/screenwriter.

    1. Re:Well, duh! by K-Man · · Score: 2

      When I was in Grad School there was a certain amount of folklore about books or movies that had accurate Mathematics in them. To my knowledge there is only one, a movie called "It's My Turn", about a Math professor, played by Jill Somebody. She gives an accurate proof of the Snake theorem during a lecture scene.

      Maybe Springer-Verlag should start a film studio - Arnold Schwarzennegger as "The Last Topology Hero", etc.

      --
      ---- "If we have to go on with these damned quantum jumps, then I'm sorry that I ever got involved" - Erwin Schrodinger
  12. Hope for the Clueless? by Alien54 · · Score: 3
    I liked this bit:

    ... I can assure you that many readers of fiction underestimate just how much of a novel's content is simply made up. There is a common assumption among readers that much of what appears in a novel is thinly veiled and repackaged reality. You can imagine how provoking this is to a novelist who works so hard to invent it. Furthermore, since my novel actually does contain an original cryptosystem, readers are even more inclined than usual to assume that all of the crypto mentioned in the book is real.

    I have to laff at all this. Obviously some folks really need to get out more often. Sometimes the reality check bounces. Sometimes paranoia pays, and sometimes it becomes a self-fulfilling prophecy.

    Never seen anything like that around here, of course.

    --
    "It is a greater offense to steal men's labor, than their clothes"
  13. Re:The BIG U is in print by Amphigory · · Score: 2
    My wife has read it, and tells me that it is Really Bad. In fact, she says that it is Late 80's Piers Anthony bad. Maybe even worse.

    Don't buy it to read ... buy it because you collect neil stephenson.

    --

    --
    -- Slashdot sucks.
  14. Re:Dr. Anshel gives a little background by gilroy · · Score: 2
    Blockquoth the poster, quoting someone else:
    A simple acknowledgment in future discussions of this work by the author and his agents that there is a cryptography based on zeta functions,introduced in the open literature by Michael Anshel and Dorian Goldfeld and whose patent rights are assigned to Arithmetica Inc would do for a starter.
    Um, is every sci fi author using nuclear power supposed to reference Fermi, Oppenheimer, Einstein, Curie....?

    The fact of the matter is, zeta functions are fair game, mathematically, and their possible application to cryptography is not all that inobvious. Sure, the company has the patents on one particular system, but it's pretty clear that the system in the book is not that one.

    If Stephenson wants to be nice, he can mention it. But there's no obligation, legal or moral, that he give Arithmetica some free advertising.

    Since the system described in the book is pretty primitve (and eminently breakable) by modern standards, I'm not entirely sure why Arithmetica wants to be associated with it anyway.

  15. Quicksilver by smartin · · Score: 2

    Has anyone heard any rumours on Quicksilver, it's
    been about 2 years since Cryptonomicon was released. Seems about time for the next one.

    --
    The difference between Canada and the USA is that in Canada healthcare is a right and gun ownership is a privilege.
    1. Re:Quicksilver by passion · · Score: 2

      You missed it - they already made a movie out of it.... :)

      --
      - passion
  16. Re:The BIG U is in print by bfields · · Score: 2
    My wife has read it, and tells me that it is Really Bad.

    It's not *that* bad! The plot's a bit loose, the writing might not be up to his usual standards, but it's really, really, funny. I'm almost tempted to read it again....

    --Bruce Fields

  17. Re:Read the prologue online by rgmoore · · Score: 2

    Sadly, it has a typically poor Stephenson ending. He really needs to learn how to write a graceful ending that ties up some of the loose ends he's spent the whole book generating. I find it very frustrating to read about characters for hundreds of pages and develop some empathy for them and then have the book rudely chopped off just before finding out how their personal situations were resolved.

    --

    There's no point in questioning authority if you aren't going to listen to the answers.

  18. Re:The BIG U is in print by Amphigory · · Score: 2
    Keyword. Late eighties. All those were early eighties.

    --

    --
    -- Slashdot sucks.
  19. Re:Special Cryptonomicon? Slightly OT... by cr0sh · · Score: 2

    Thanks for the info - I don't plan on selling, my actual goal is to get NS to sign both of them, and keep them.

    Worldcom - Generation Duh!

    --
    Reason is the Path to God - Anon
  20. Is this an appropriate posting? by johnburton · · Score: 2

    This appears to have been a private communicate so I'm not totally sure it was appropriate for them to publish it on their web page, or slashdot to refer to it here. Interesting though...

    --
    Sig is taking a break!
  21. So what is the zeta function ? by Salsaman · · Score: 2

    Any mathematicans care to explain it ?

    1. Re:So what is the zeta function ? by Schwarzchild · · Score: 2
      One reason why everyone cares about the Riemann Hypothesis (which, on the face of it, is not all that exciting) is that the zeta function is very closely related to the way the prime numbers are distributed. There's some deep magic behind this, to do with contour integration and generating functions and stuff.

      The zeta function is supposed to show the distribution of primes approximately; however, I seem to recall reading that the prime numbers are shown to be distributed in a random manner and that the zeta function also predicts a somewhat random distribution. If the primes truly are distributed randomly then one would think that you could not predict them since they lie randomly about the natural numbers.

      Well one might ask of what benefit is this? Well aren't some crypto systems based on large prime numbers? If you could predict which numbers are prime then some crypto systems would be easily breakable.

      Also I seem to recall a New Scientist article that claimed that the universe is created from randomness and this randomness was also somehow inextricably linked to the randomness of prime numbers. So in some sense mathematics and physics may be linked together in their foundations.

      --

      "sweet dreams are made of this..."

    2. Re:So what is the zeta function ? by Grendel+Drago · · Score: 2

      The zeta function is defined as:

      Zeta(x)=Sum(n=1 to inf){1/(n^x)}

      For instance, Zeta(2) is

      1/1 + 1/4 + 1/9 + 1/16 + ...

      MathWorld probably explained it much better than I could. Sigh.

      --
      Laws do not persuade just because they threaten. --Seneca
    3. Re:So what is the zeta function ? by ElJefe · · Score: 5
      The zeta function is defined as an infinite sum:
      zeta(s) = Sum from n=0 to infinity of 1/n^s

      Here, s can be any real or complex number. For example, zeta(2) = Pi^2 / 6, and zeta(.5 + 14.134i) = 0.

      The Reimann hypothesis is that all the zeroes of the function lie are of the form .5+b*i. where b is some real number. To date, this hasn't been proven and remains one of the great unsolved problems of math.

      From what I've been told, the zeta function also shows up a lot in number theory and quantum mechanics, but I don't really know much about it...

      -Chris
      (I'm an applied mathematician, dammit.)

    4. Re:So what is the zeta function ? by plam · · Score: 2

      Note that the sum for n=[0, infinity] of 1/n^s does not actually converge (is not a complex number) if s is not positive real, if I remember correctly. Fortunately, the sum does behave nicely (is an analytic function) when s is positive real, and you can thus use techniques from complex analysis to extend it uniquely over the entire complex plane. Chris's statement about the Riemann Hypothesis is correct; what we do have are a set of bounds which say that the (nontrivial) zeros of the Riemann zeta function can only occur in certain regions of the complex plane. (re: nontrivial: there are a few zeros of the Riemann zeta function on the real line as well; they are trivial zeros).

  22. Cryptonomicon by xDe · · Score: 2

    Stephenson's points about not linking his fiction too closely to real-world companies are interesting - I wonder if this has any bearing on an oddity in Cryptonomicon : Linux is disguised (barely) under the name Finux - however, if I recall correctly, Windows and Be are identified by name. I'd be interested to know the rationale behind this.

    1. Re:Cryptonomicon by agentZ · · Score: 2
      Also from Neal's web page:
      Persons who wish to interfere with my concentration are politely requested not to do so, and warned that I don't answer e-mail.
    2. Re:Cryptonomicon by Ryan+J.+Evans · · Score: 5

      From Neal's webpage:

      Since Finux was the principal operating system used by the characters in the book, I needed some creative leeway to have the fictitious operating system as used by the characters be different in minor ways from the real operating system called Linux. Otherwise I would receive many complaints from Linux users pointing out errors in my depiction of Linux. This is why Batman works in Gotham City, instead of New York--by putting him in Gotham City, the creators afforded themselves the creative license to put buildings in different places, etc.

  23. The BIG U is in print by YIAAL · · Score: 4

    This is kinda offtopic, but Stephenson's first novel, "The Big U" is now back in print. I just bought a copy. For the many who've been looking for it in used bookstores, it's now available.

    1. Re:The BIG U is in print by MustardMan · · Score: 2

      put me in context here... name a few 80s piers anthony books... everything i've ever read by him i absolutely loved

  24. BIG U warning by freeBill · · Score: 2

    A year or so back when _The Big U_ was pulling down absurd bucks on Ebay Neal made very clear he didn't consider it worth the fuss.

    That warning made, I'll probably buy it myself because I'm such a fanboy.

    --
    Eternal vigilance only works if you look in every direction.
  25. Maybe not, but it's par for the course by agentZ · · Score: 2

    Although explicit permission was given in this case, John Young of Cryptome has a habit of publishing things that other people don't want published. He's gotten in semi-serious trouble for publishing classified documents before (and they're still on-line). Ironically enough, however, he took down the DeCSS code because 'enough other people were mirroring it' (paraphrase, can't find the link right now).

  26. Zeta functions...mmmm... by Telal · · Score: 3

    I'd function Catherine Zeta Jones anytime. :-)

  27. There _is_ a proof by Kaufmann · · Score: 2

    Actually, this wasn't acknowledged by the international scientific comunity, but Mai (no last name), a papua mathematical savant who developed the equivalent of 2500 years of Western number theory from first principles using only the bones of defeated and eaten enemies, has developed an entire proof of the Riemann hypothesis, which has been photographed into microfilm by anthropologist Lucius Zingelberger, and is currently being stored in the local library at the village of Ikai, 200 miles into the deep woods of the island. As far as I know, it has no telephone number or Internet connection, so interested parties should visit Ikai Library in person; I believe the daily fee for borrowing microfilm from it is 8000 human bones (how one will acquire this amount is none of my business). Good luck on the trip, and don't forget to take your shots! (And your shotgun. White man's meat is very much appreciated in Papua New Guine. Just ask Prof. Zingelberger.)

    -- Kaufmann

    --
    To the editors: your English is as bad as your Perl. Please go back to grade school.
  28. One-time pad vs. stream cipher by Another+MacHack · · Score: 2

    I keep seeing references to this or that algorithm being used to generate a one-time pad. The whole point of a one-time pad is that it's generated randomly so that it cannot be uniquely decrypted to any particuar plaintext without knowing the pad used.

    What Stephenson describes is a stream cipher using the zeta function to generate the bits, and using the date as the key. It's no more a one-time pad than would be, say, RC4.

    1. Re:One-time pad vs. stream cipher by DavidTC · · Score: 2
      Nevertheless, it, or things much like it, were used many times during WWII, by both sides. If it takes a month to figure out what function they're using, and what it's keyed off (Using the date was to make it easier to break, it could have just as easily been the tenth word in the London Time from exactly two weeks ago.), then you can safely use it to coordinate a battle. As long as the function is unknown to the other side, they can't decode it, and once it is known, they still have to figure out what your key is.

      It's a very clever solution before the invention of public keys and whatnot, and it's called a psuedo one time pad. In fact, it is still used today, by spys who aren't able to access computers. They just go to a library, and grab last weeks New York Times and do an easy cipher based off line X on page Y in section Z, and vary those (and the paper that was last week's paper changes too, of course) based on some easy formula, like add one to X and subtract three from Y each week. It's not that secure, because it is one piece of information, and once the people you're hiding stuff from knows it, they can decode all your previous and future messages, but it works for short amounts of time. There simply are too many possibly places to get the seed from.

      -David T. C.

      --
      If corporations are people, aren't stockholders guilty of slavery?
  29. Moderate up! by Animats · · Score: 2

    That's right about Turing's bicycle. Please moderate the previous posting up.

  30. Special Cryptonomicon? Slightly OT... by cr0sh · · Score: 2

    I have two copies of the book, one in fully readable condition, and one "strange". I assume the "strange" one to be due to a publishing error, but I wonder how many got out of the publisher, and how many were kept (ie, not returned)?

    Anyhow, my GF got the book for me a couple of xmases ago. She bought it off Amazon, and when I received it, I immediately began reading it. About a third of the way through, the book "repeated" - I thought I was losing my mind, but the text did repeat. I scanned farther forward, and it "repeated" again, never getting more than 50-75 pages "forward". I think there was a production problem, and multiple "leaves"(? Can't remember what the individual page bundles are called in publishing) got inserted. Funny thing was, the bundles weren't from near the end of the area I was at, but instead were from the mid-beginning, from a point I was well past.

    Anyhow, it made the book unreadable, so I had my GF ask for another from Amazon - they complied, but never asked for the original back in return. I just wonder how unique it is...?

    Worldcom - Generation Duh!

    --
    Reason is the Path to God - Anon
  31. Yes by alewando · · Score: 3

    I'd explain it myself, but this page does a pretty good job, and I'd hate to duplicate efforts. It's an important function in number theory, particularly concerning prime numbers.

  32. Re:Unbreakable crypto and my rantings by Salsaman · · Score: 2
    "The coding starts with a continuously generated string of random numbers, say from a satellite put up to broadcast them or from some other source."

    Maybe that's what the 'number stations' are for...