Slashdot Mirror


New Pattern Found In Prime Numbers

stephen.schaubach writes "Spanish Mathematicians have discovered a new pattern in primes that surprisingly has gone unnoticed until now. 'They found that the distribution of the leading digit in the prime number sequence can be described by a generalization of Benford's law. ... Besides providing insight into the nature of primes, the finding could also have applications in areas such as fraud detection and stock market analysis. ... Benford's law (BL), named after physicist Frank Benford in 1938, describes the distribution of the leading digits of the numbers in a wide variety of data sets and mathematical sequences. Somewhat unexpectedly, the leading digits aren't randomly or uniformly distributed, but instead their distribution is logarithmic. That is, 1 as a first digit appears about 30% of the time, and the following digits appear with lower and lower frequency, with 9 appearing the least often.'"

55 of 509 comments (clear)

  1. Other bases? by wiredlogic · · Score: 4, Insightful

    When happens with the primes are represented in base-9 or base-11?

    --
    I am becoming gerund, destroyer of verbs.
    1. Re:Other bases? by Anonymous Coward · · Score: 5, Funny

      It would be bad.

    2. Re:Other bases? by hkz · · Score: 5, Informative

      Benson's Law is actually independent of the number base used. It wouldn't be much of a mathematical property if it wasn't. No matter how you convert a number, you will always see the same bias.

    3. Re:Other bases? by Anonymous Coward · · Score: 5, Funny

      Bad as in "cross the streams" bad, or "according to an AC on Slashdot" bad ?

    4. Re:Other bases? by jonaskoelker · · Score: 4, Insightful

      I don't know; it might be interesting to know that the leading digits of powers-of-k are distributed in some interesting way in base not-k. They obviously all have a leading 1 in base k.

    5. Re:Other bases? by Megaweapon · · Score: 5, Funny

      base-9 or base-11?

      NEVER FORGET

      --
      I'm sure "SlashdotMedia" will improve on all the wonders that Dice Holdings blessed us all with
    6. Re:Other bases? by pdxp · · Score: 5, Informative

      It wouldn't change the logarithmic nature of the distribution of the digits, AFAIK.

      My math degree is getting dusty, but I'm pretty sure that the same pattern could be represented in another base by changing their generalization of Benford's law to include it, and the distribution would look like log(x)/log(9) or log(x)/log(11). Remember, changing the base of a logarithm is easy: for example, log(x)/log(e) = ln(x)

      So you get the same distribution, different base.

    7. Re:Other bases? by Anonymous Coward · · Score: 4, Interesting

      Benson's Law is actually independent of the number base used. It wouldn't be much of a mathematical property if it wasn't.

      Err, what? The study of representations of numbers is a valid field of mathematics itself.

    8. Re:Other bases? by dave1g · · Score: 4, Informative

      from benfords law link:

      "The result holds regardless of the base in which the numbers are expressed, although the exact proportions change."

    9. Re:Other bases? by CaseyB · · Score: 5, Funny

      All your base are belong to Benford.

    10. Re:Other bases? by Lillesvin · · Score: 5, Funny

      I'm pretty sure that in base-2 with no zero-padding, 100% will start with 1. :-p

      --
      "Live free or don't."
    11. Re:Other bases? by stonewallred · · Score: 4, Interesting

      Code this have cryptographical uses? IANAMOG, but I know primes play a role in many crypto schemes.

    12. Re:Other bases? by dynamo52 · · Score: 5, Insightful

      I'm pretty sure that in base-2 with no zero-padding, 100% will start with 1.

      ...and all but one would end with 1 as well.

      --
      Like this comment? I accept Bitcoin! - 153sc8UUBXyp12ofQqfAWDmJrzyiKCYC1x
    13. Re:Other bases? by Anonymous Coward · · Score: 4, Interesting

      But how many would contain all 1s? Answer that, and provide a proof for your answer, and you'll make math history.

    14. Re:Other bases? by Anonymous Coward · · Score: 5, Informative

      Numbers are objects, I wish people would understand that numbers are just distinctions. The whole of mathematics is really just a language of form and structure, a system to systematize and decribe structure and forms (relationships are a type of form).

    15. Re:Other bases? by Sparr0 · · Score: 4, Insightful

      The faux concern, or misplaced real concern, so many people show over 9/11 has made it a relevant target for such jokes since 9/12.

    16. Re:Other bases? by Ibag · · Score: 5, Informative

      Benford's law works by the observation that, when numbers come up in certain real world contexts, the fluctuations you get in numbers should be proportional to the numbers themselves. Phrased differently, variations tend to be relative, not absolute. Because of this, if you have a very large range of random numbers from many real world measurements, then you would expect the number between t and t*(1.0001) not to vary too much for small changes in t. Let us try to use this observation very coarsely. Among the numbers with 6 digits, the number that look like 1xxxxxx (those between 100000 and 200000) should be about the same the number between 200000 and 400000. The same thing happens with the numbers with 5 digits or 7 digits or n digits (assuming that you have a wide range of random numbers, and the numbers are the kind that come from certain sorts of real world measurements). Additionally, you can get distributions for the first two digits, the first three digits, etc.

      This observation doesn't depend on the base that you're working with.

      Now, with the prime numbers, they have a distribution that is different from a lot of real world measurement data. The number of primes between n and n+d is approximately d/ln(n), where ln is the log with base e and d is small compared to n. So the number of primes between 500000 and 600000 is about 100000/ln(500000), and the number of primes between 500000 and 600000 is about 100000/ln(600000). By using this, and being slightly more careful, one can determine fairly easily the distribution of the leading terms of the prime numbers.

      This is not a hard result. I would say that any professional mathematician who knew about the basic distribution of the primes could derive the distribution of the leading digis of the prime numbers fairly easily if anybody actually asked them to. The reason nobody mentioned this before is that nobody actually cares. While Benford's law does have applications to fraud detection, this new result does not. It's one of those things that makes people say "ooh, a pattern!" but which is just an easy and somewhat mundane corollary to a well known theorem.

    17. Re:Other bases? by Anonymous Coward · · Score: 5, Funny

      Knock knock.

      Who's there?

      9/11.

      9/11 who?

      YOU SAID YOU'D NEVER FORGET!

    18. Re:Other bases? by Anonymous Coward · · Score: 5, Funny

      Oh yeah? Well give me two minutes and check again.

    19. Re:Other bases? by Jane+Q.+Public · · Score: 4, Funny

      Some encryption algorithms that were predicted to take forever to crack with today's technology, may in the long run end up taking the logarithm of forever.

    20. Re:Other bases? by Anonymous Coward · · Score: 5, Informative

      They are also distributed as Benson's law describes, providing that k is not a rational power of the base. IAAM.

    21. Re:Other bases? by tuck182 · · Score: 5, Informative

      You mean, how many are Mercene primes?

    22. Re:Other bases? by Bromskloss · · Score: 5, Funny

      I'm pretty sure that in base-2 with no zero-padding, 100% will start with 1. :-p

      100% = 100/100 = 1 = 0b1, which, by the way, looks like "Obi" and sounds like "Obi-Wan" when you say it.

      --
      Swedish plasma phys. PhD student; MSc EE; knows maths, programming, electronics; finance interest; seeks opportunities
    23. Re:Other bases? by jd · · Score: 5, Funny

      "Bad" as in you will see the Message as hinted at by Carl Sagan's "Contact". It's from God and apparently decodes to: "We apologize for the inconvenience".

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    24. Re:Other bases? by PleaseFearMe · · Score: 5, Funny

      It would be bad with binary. All numbers start with 1's.

    25. Re:Other bases? by Simetrical · · Score: 4, Informative

      But how many would contain all 1s? Answer that, and provide a proof for your answer, and you'll make math history.

      For those who didn't get it: it's not known whether there are infinitely many Mersenne primes, which have this form in binary (they're primes of the form 2^n - 1). Similarly, if you could figure out how many primes have only their first and last bits equal to 1, you would answer a longstanding question about Fermat primes (which are primes of the form 2^n + 1).

      --
      MediaWiki developer, Total War Center sysadmin
    26. Re:Other bases? by Anonymous Coward · · Score: 5, Funny

      I will never understand how people do that. You have the link right there. Even if you didn't open it to make sure, the link itself mentions the name "Mersenne Prime", and yet you write Mercene.

    27. Re:Other bases? by spartacus_prime · · Score: 5, Funny

      You have no chance to survive make your prime.

      --
      If you can read this, it means that I bothered to log in.
    28. Re:Other bases? by Anonymous Coward · · Score: 4, Funny

      AND end with 1...this must be a conspiracy

    29. Re:Other bases? by wealthychef · · Score: 4, Funny

      That starts with an "N", which is not a number.

      --
      Currently hooked on AMP
    30. Re:Other bases? by s-orbital · · Score: 4, Funny

      A friend of mine went to Hawaii last week, and I asked her if she'd ever been to Pearl* Harbor, and she said she'd only seen it from the air.
      I replied, hey, just like the Japanese!

      *That was hard not to type "Perl". I failed at first

      --
      Patent: from Latin patere, to be open
    31. Re:Other bases? by Thing+1 · · Score: 5, Funny

      IAAM.

      Wow, first use of "I am a moron" I've seen in the field!

      Hmm, or it is Mormon?

      --
      I feel fantastic, and I'm still alive.
    32. Re:Other bases? by Blakey+Rat · · Score: 4, Interesting

      The whole of mathematics is really just a language of form and structure, a system to systematize and decribe structure and forms (relationships are a type of form).

      So... mathematics is the vaguest thing possible?

  2. Re:9999991 by Aranykai · · Score: 4, Insightful

    Explain one man being hit seven times with lightning. http://en.wikipedia.org/wiki/Roy_Sullivan
    Improbable doesn't mean impossible.

    --
    If sharing a song makes you a pirate, what do I have to share to be a ninja?
  3. Stock market analysis? by MSTCrow5429 · · Score: 4, Interesting

    I am admittedly not a mathematician, but I do have a good understanding of economics and finance, and I am not seeing how a pattern found in prime numbers could have any application to stock market analysis. Where is the interaction between prime numbers and the praxeology of buying and selling securities? Even if you're only focusing on automated buying and selling, those algorithms were still programmed by humans with their own subjective approaches and underlying premises.

    --
    Slashdot: Playing Favorites Since 1997
    1. Re:Stock market analysis? by Rayban · · Score: 4, Funny

      I've always wondering how I could figure out when someone was trying to pass off a list of fraudulent primes. Glad to see that this problem is finally solved!

      --
      æeee!
    2. Re:Stock market analysis? by rackserverdeals · · Score: 4, Funny

      I am admittedly not a mathematician, but I do have a good understanding of economics and finance, and I am not seeing how a pattern found in prime numbers could have any application to stock market analysis. Where is the interaction between prime numbers and the praxeology of buying and selling securities?

      By understanding the patterns in prime numbers you can learn to spot them and avoid the sub-prime mortgage backed securities. Duh.

      --
      Dual Opteron < $600
    3. Re:Stock market analysis? by arth1 · · Score: 4, Interesting

      I've always wondering how I could figure out when someone was trying to pass off a list of fraudulent primes. Glad to see that this problem is finally solved!

      You're jesting, but I imagine that many fields of encryption would benefit from this, like dual key encryption, where the security lies in the ability to trust that the product really is of two primes, and that factoring this would be extremely time consuming.

      Sets with a backdoor inserted may indeed have a different signature, and to be able to quickly see that one set differs would be invaluable. It wouldn't prove anything, but if, say, keys received from a certain company's key generator stood out like a sore thumb in a Benford distribution check, you would have reason to suspect foul play, incompetence or both.

  4. Re:Why do people study "math" in college? by Anonymous Coward · · Score: 4, Funny

    The real question is did his feigned interest result in sexual intercourse?

  5. Cryptography? by PolygamousRanchKid+ · · Score: 5, Funny

    Could this have any applications there?

    "Well, I wasn't expecting The Spanish Mathematician . . ."

    --
    Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    1. Re:Cryptography? by MRe_nl · · Score: 4, Funny

      Our two main powers are insight into the nature of primes, fraud detection
      and stock market analysis.
      I'll come in again...

      --
      "Kill 'em all and let Root sort 'em out"
  6. Re:Why do people study "math" in college? by wjh31 · · Score: 4, Insightful

    hello troll, your inability to understand mathematics does not mean it has no real world application. her little project may well have been able to provide the basis for some ecomonic or social model, or may proove vital in unlocking the bit of physics that enables the next revolution in technology. Besides all these very important uses that skip the average joe, mathematics is often elegant and beautiful, and may be considered a form of art by some people

  7. Good for them by l00sr · · Score: 4, Funny

    Nobody expects the Spanish Mathematicians!

  8. Re:9 not too common? by doti · · Score: 4, Funny

    that makes my /. id even more impressive :)

    --
    factor 966971: 966971
  9. On the density of prime numbers by jonaskoelker · · Score: 4, Insightful

    Prime numbers, meanwhile, become decreasingly common as you get larger and larger, is that not correct?

    Yes, that is correct. There are roughly logarithmically many of them.

    Bertrand's Conjecture (proven by Chebyshev) states than for all n > 1, there's a prime p with n < p < 2n.

    If you look only at powers of two, it's readily seen that there are n primes between 1 and 2^n; setting k=2^n, there are log(k) primes between 1 and k.

    A logarithmic upper bound follows from the Prime Number Theorem, which doesn't have an easy proof (AFAIK). It says something much more specific than just "It's O(log n)", though. Maybe there's a simple theorem from which you can derive O(log n), but I don't know.

    1. Re:On the density of prime numbers by jonaskoelker · · Score: 4, Informative

      Maybe if I had read the prime number theorem, I would have known that it's O(n / log n), which is somewhat bigger...

  10. Plenty of reasons people study math by sirwired · · Score: 4, Insightful

    A few examples:

    For the same reason some people take Philosophy, Ancient Literature, Paleontology, etc. Because they think the subject is cool, and aren't necessarily at school to learn a trade. (Indeed, Engineering students that are paying attention also discover they aren't directly being taught a trade either. Or at least they aren't in any Engineering college worthy of the name.)

    They want to become an actuary. This is a fairly well-paid job that is also rather difficult to do, and even harder to do well.

    They want to become math teachers; a valuable and much-needed profession. Math is a useful tool in teaching students how to think. We certainly don't torture legions of high school students with the details of conic sections because anybody is under the impression this is a directly practical skill for most citizens to have. Nor are hundreds of thousands of college students subjected to the horrors of calculus because of some kind of employment program for math post-docs.

    They are double-majors in a field in which math is extremely important (physics, astronomy, computer science, every type of engineering, linguistics, medicine, biology, etc. Pretty much every field outside the humanities. Oh, and some of the humanities make extensive use of math too.)

    SirWired

  11. If you're dealing with phone numbers by Ralph+Spoilsport · · Score: 5, Interesting
    It has less to do with math and more to do wit physics: as in how to use a an old school phone. Phone numbers, until comparatively recently would "prefer" lower numbers because they are EASIER TO DIAL. If a company had the phone number (909)999-9009 you would HATE dialing that thing. It would take about half a minute just to dial the damn number.

    Ssssshhhhhhik!
    diggadiggadiggadiggadiggadiggadiggadiggadigga!

    Total pain in the finger.

    1 as a first number was reserved for "other stuff" like international calls, so the lowest possible area codes (first numbers) went to places like New York City (212 - very quick to dial) or LA (213) because millions of people would be dialing that number, so it made for an overall faster dialing experience for (on average) more people.

    This is compared to the relatively few people who lived in more obscure parts of the country, like Saginaw MI (989) or Bryan TX (979).

    So, you have millions of phones in 212, thousands in 979. The result: saved effort in dialing.

    Also, to this end there was a preference for exchanges to have lower numbers as well to save on dialing effort, and phone numbers with lower (but NON-ZERO) values were sought after. You'd see advertisments like "Call RotoRooter - 213 464 1111 !" or "Call us NOW for a free analysis! 201 738 1122 !" etc. and so on.

    So, lower numbers in phone numbers have been a product of primitive dialing technology. Now with touchtone - all that is out the window - but the historic trend is still there and quite powerful - people will pay good money for a 212 area code for the distinction of being in the "real" New York Area code...

    RS

    --
    Shoes for Industry. Shoes for the Dead.
    1. Re:If you're dealing with phone numbers by jmp_nyc · · Score: 5, Informative

      While you're absolutely right about the reasoning behind NYC, LA, and Chicago getting 212, 213, and 312, you're a little off on the 989 and 979 area codes, which are much more recent.

      In the original system design, all area codes had a middle digit of 0 or 1. The convention was that a middle digit of 1 was used for area codes that only covered part of a state, while a middle digit of 0 was used for area codes that covered entire states. Furthermore, an area code could not begin with a 1 or a 0. and an area code with a middle digit of 1 couldn't have 1 as the third digit. (This left the shortest dial time area code for a statewide code as 201, which went to New Jersey.)

      As early as the late 1950s, the idea of single area codes for some states went out the window (with NJ splitting into 201 and 609 in 1958) because of increasing population and proliferation of phone service.

      By the late 1980s, the rules were further changed to allow for area codes with middle digits other than 1 or 0. Area codes like 989 and 979 weren't introduced until the late 1980s at the very earliest, by which point very few people were still using rotary phones. At one point, I had heard that the middle digit value of 9 was reserved for the future to allow for four digit area codes, but I can't vouch for the accuracy of that recollection. There are plenty of other rules, some of which you can see summarized here...
      -JMP

  12. Independent Verification by eldavojohn · · Score: 5, Interesting
    Here's what I got on my own counts using the first million primes:

    1: 415441
    2: 77025
    3: 75290
    4: 74114
    5: 72951
    6: 72257
    7: 71564
    8: 71038
    9: 70320

    Which puts the probabilities at:

    1: 0.415441
    2: 0.077025
    3: 0.07529
    4: 0.074114
    5: 0.072951
    6: 0.072257
    7: 0.071564
    8: 0.071038
    9: 0.07032

    My computer is currently crunching the first fifty million primes and I will post those as a reply to this post later today when it is done.

    These ratios on numbers 2-9 seem far too close in range for this to be a true log scale. Hopefully with more data it will be more logarithmic.

    --
    My work here is dung.
    1. Re:Independent Verification by Daimanta · · Score: 4, Funny

      This is one of those moments that I love /.
      Personally, I was trying to calculate the first 50M primes using the sieve of Erastothenes and then contructing a program that categorizes them but since you are doing all the work I say go ahead and I'll wait for the results.

      --
      Knowledge is power. Knowledge shared is power lost.
  13. Enron by Anna+Merikin · · Score: 4, Interesting

    was busted by auditors who found the books were "cooked" by applying the law of first numbers described in the /. blurb and TFA. The independent auditors found the first figures were randomly distributed instead of following Benford's law with the number 1 the most plentiful and nine the least -- therefore, the entries were fraudulent.

    Benford's law knocked my out at the time; I thought of how many bogus figures I had entered in my expense accounts over the years....

  14. Complete bullshit by gnasher719 · · Score: 4, Insightful

    The prime number theorem was conjectured in 1796 by Adrien-Marie Legendre and proved in 1896 independently by Jacques Hadamard and Charles Jean de la Vallée-Poussin. It says that if pi (N) denotes the number of primes p = N, then pi (N) / (N / ln N) converges towards 1; accordingly the number of primes between A and B is about (B / ln B - A / ln A). This shows that there should be slightly more d digit primes starting with 1 than with 2, 3, 4 etc. A reasonably good approximation is that the number of d digit primes starting with 1 is not 1/9 th of all d digit primes, but more precisely (11 1/9 + 5.7 / d) percent. This is all very, very simple maths. I don't think it hasn't been observed before, it was just never considered worth mentioning. However, the prime number theorem alone is not enough to prove this; it would be necessary to prove that convergence happens at a certain speed. So anything that these so-called "mathematicians" claim that depends on observations of large list of primes is pure nonsense.

  15. Some More Information by eldavojohn · · Score: 5, Interesting

    So I read the comments and see that I need to do this in ranges or 1 to 100, 1 to 1000, etc. Which is fine, I've added another R method and would post the code here if it didn't yell at me for junk characters. So here are your Benford lists:

    All Primes 1-100
    Counted Occurances:
    4, 3, 3, 3, 3, 2, 4, 2, 1
    Frequencies:
    0.160, 0.120, 0.120, 0.120, 0.120, 0.080, 0.160, 0.080, 0.040

    All Primes 1-1,000
    Counted Occurances:
    25, 19, 19, 20, 17, 18, 18, 17, 15
    Frequencies:
    0.149, 0.113, 0.113, 0.119, 0.101, 0.107, 0.107, 0.101, 0.089

    All Primes 1-10,000
    Counted Occurances:
    160, 146, 139, 139, 131, 135, 125, 127, 127
    Frequencies:
    0.130, 0.119, 0.113, 0.113, 0.107, 0.110, 0.102, 0.103, 0.103

    All Primes 1-100,000
    Counted Occurances:
    1193, 1129, 1097, 1069, 1055, 1013, 1027, 1003, 1006
    Frequencies:
    0.124, 0.118, 0.114, 0.111, 0.110, 0.106, 0.107, 0.105, 0.105

    All Primes 1-1,000,000
    Counted Occurances:
    9585, 9142, 8960, 8747, 8615, 8458, 8435, 8326, 8230
    Frequencies:
    0.122, 0.116, 0.114, 0.111, 0.110, 0.108, 0.107, 0.106, 0.105

    All Primes 1-10,000,000
    Counted Occurances:
    80020, 77025, 75290, 74114, 72951, 72257, 71564, 71038, 70320
    Frequencies:
    0.120, 0.116, 0.113, 0.112, 0.110, 0.109, 0.108, 0.107, 0.106

    This is the raw data so to turn that into something visual, I dumped it into a Google spreadsheet and made it public (note the scale on the y axis). Enjoy!

    It seems that the curve is flattening out the more data I collect, but the logarithmic curve may be valid. I have the data for 100,000,000 and will add that to the spreadsheet once it completes.

    --
    My work here is dung.
  16. I Found a Fit! by eldavojohn · · Score: 5, Interesting
    The results for all primes between one and one hundred million:

    Counted Occurances:
    686048, 664277, 651085, 641594, 633932, 628206, 622882, 618610, 614821
    Frequencies:
    0.119, 0.115, 0.113, 0.111, 0.110, 0.109, 0.108, 0.107, 0.107

    So there's some more data for you. I added that to this spreadsheet.

    So I hope that satisfies everyone who replied to my thread first of all. I hope 5,761,455 primes between one and one hundred million satisfies you.

    I used a very simple Non Linear Squares model to solve for a single constant on a log of these values. I think I have a fit. Using Benford's model and the NLS Package in R, I found:

    f(x) = 0.020814 * log(161.147689 * ((x+1)/x))

    To fit quite nicely, here's the summary:

    Formula: y ~ Const1 * log(Const2 * ((x + 1)/x))

    Parameters:
    Estimate Std. Error t value Pr(>|t|)
    Const1 0.020814 0.001940 10.7292 1.343e-05 ***
    Const2 161.147689 80.222081 2.0088 0.08452 .
    ---

    Residual standard error: 0.0010413 on 7 degrees of freedom

    Number of iterations to convergence: 8
    Achieved convergence tolerance: 1.8104e-07

    Here is the list of frequencies next to what my model produced:

    Benford Prime Rates
    0.11907548
    0.11529674
    0.11300704
    0.11135972
    0.11002984
    0.10903600
    0.10811193
    0.10737045
    0.10671280

    NLS Model Results
    0.1202106
    0.11422279
    0.11177125
    0.11042794
    0.10957828
    0.10899193
    0.10856276
    0.10823497
    0.10797641

    I would wager that they are correct. Neat discovery!

    --
    My work here is dung.