Slashdot Mirror


2014: The Year We Learned How Vulnerable Third-Party Code Libraries Are

jfruh writes Heartbleed, Shellshock, Poodle — all high-profile vulnerabilities in widely used libraries that rocked the software industry in 2014. Sadly, experts are now beginning to believe that these aren't the only bugs lurking out there in widely used open source code, just the ones that grabbed the most attention. It's beginning to look like one of the foundation concepts of open source — that with enough eyes, all bugs are shallow — is a myth. Of course, probably no one believes that all bugs are instantly shallow, no matter how open is the source, or that open source software is immune from bugs -- particularly ESR, coiner of the phrase.

145 of 255 comments (clear)

  1. Re:Toad in hart by Anonymous Coward · · Score: 1

    Good luck with your "Free Internet" campaign without open source.

  2. But *are* there enough eyes? by tj2 · · Score: 5, Insightful

    The phrase might be true, but we're seeing the effects of insufficient eyes. In reality, how many sets of eyes are actually reviewing these libraries at a source code level? I rather strongly suspect that in most cases they are simply used under the assumption that "well, everyone uses it, it must be okay".

    1. Re:But *are* there enough eyes? by Anonymous Coward · · Score: 1

      +1 if I had it.

      People are lazy, and assume someone else has done the hard work - that's why they're USING the library in the first place. Combine that with assembly-line schools cranking out "developers" and you have this problem.

    2. Re:But *are* there enough eyes? by TheRaven64 · · Score: 4, Insightful

      Exactly. The problem with OpenSSL was that everyone used it, no one looked inside it. Those of us who did look inside it recoiled in horror and didn't do proper code review because 'kill it with fire' was the immediate reaction for anyone looking at the code. Open source isn't magic. People who build their business on a third party library have a lot of choice in terms of who provides the support (bug fixing, code auditing, and so on) for that library. Far more than with a proprietary library, where you're locked into a single source. If everyone choses to get support for the product using the power of wishful thinking, then don't be surprised if the code is crap.

      --
      I am TheRaven on Soylent News
    3. Re:But *are* there enough eyes? by tj2 · · Score: 5, Insightful

      This is just FUD. Whatever the number of the eyes, they are certainly far more than open source. I have already contributed many bug reports and often fixes, would you care to elaborate how I would do that in a closed source model? Because I am *very* curious.

      FUD? Sure, there are *more* eyes in open source than closed source: that's not the point. Are there *enough* eyes to prevent potentially catastrophic bugs from being exploited? I'd submit that we're seeing that there isn't. I'm not suggesting that closed source is superior, but let's not confuse some sort of moral superiority being attributed to open source as being equivalent to automatic technical superiority. In most cases, I'd agree that open source has technical superiority, but it's not automatic.

    4. Re:But *are* there enough eyes? by wierd_w · · Score: 2

      Usually with the closed source applications, you send in the bug report, and it appears to vanish from your end. There is no feedback from the bug treacking team. There is no update on if the issue is pending more data (which you could supply if they ask. Clearly the bug was severe enough to warrant a report, so clearly you must run into it fairly frequently-- but no-- no access to the bug tracker, so you dont see the comments about "Cant reproduce! closing!" getting thrown about in there) or even if the bug gets closed with "Working as expected, wont fix"

      Nope, you get a "Send us a bug report! Fill out this window (which has a max size text field, so keep it contrite!) and hit submit to send it on its way to digital purgatory!

      You dont get informed when a fix will be incorporated, you dont get informed of any work arounds. Nada.

      Compare that with FOSS bug trackers, and it is night and day.

    5. Re:But *are* there enough eyes? by Z00L00K · · Score: 1

      In closed source you don't know anything at all about bugs lurking until someone accidentally encounters it.

      Running a third party library with closed source in a closed source application - well, you have many potential problems there that can be flying for a long time.

      Don't forget that it wasn't long ago that a considerable bug in Windows was found that had been around since Windows 95.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    6. Re:But *are* there enough eyes? by antientropic · · Score: 4, Interesting

      A long time ago, I saw Bertrand Meyer (the Eiffel guy) give a keynote at ICSE, where he pointed out that the "given enough eyeballs, all bugs are shallow" claim is unscientific, because it can't be falsified: if a bug is not found, people can always say that there were not enough eyeballs, so "Linus' Law" still holds.

    7. Re:But *are* there enough eyes? by ledow · · Score: 4, Informative

      Amen.

      I touched OpenSSL once. It was a nightmare. No idea where or how it passed anything as it wasn't at all clear the path that simple things, like certificate checking, were supposed to take.

      In the end, I hacked onto it rather than play with it. The documentation was non-existent. The code samples were incomplete and with almost zero explanation of what you were supposed to be checking for and where things COULD go wrong. Hence 90% of the code I see that touches OpenSSL looks exactly like the samples and nothing more.

      All I wanted to do was have two x509 certificates, and check that both were valid and one properly signed the other, as part of a primitive DRM scheme I was toying with. It turned into a nightmare scenario of IMAGINING every possible outcome and specifically coding for each one, rather than anything sensible.

      I don't think I'd ever touch it again, and was not at all surprised that there were problems with it. I was more surprised that others had had the same problems, yet OpenSSL was still regarded as the "gold standard" library to integrate with.

    8. Re:But *are* there enough eyes? by AmiMoJo · · Score: 1

      Better to pay for an independent review of open source code than to hope you can trust a closed source vendor when they say they are secure.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    9. Re: But *are* there enough eyes? by spongman · · Score: 1

      Yeah, compare that with the "go fix it yourself" response, or the seven year, 200-'me too' obstinate won't-fix-because-that-would-require-admitting-that-my-design-was-broken nightmare.

    10. Re:But *are* there enough eyes? by jones_supa · · Score: 2

      Compare that with FOSS bug trackers, and it is night and day.

      But it isn't much different with FOSS. Often the bug can just sit there without anyone responding to it. Or maybe someone asks for more details, but after I provide them, it's just crickets.

    11. Re:But *are* there enough eyes? by rapiddescent · · Score: 5, Interesting

      one of the issues is that there are indeed *more eyes* but they are incentivised to look for exploits and sell them to the bug-buyers rather than report or fix them. I did a hands up poll (buyer beware) at our local OWASP chapter and over half had sold a bug to such an organisation. pretty shocking.

      certainly, one of the first moderately important bugs I found, I was daft and got in touch with the software vendor and then faced legal action from them which luckily they saw sense and dropped. So many people nowadays just can't be bothered with that problem and can make a fast and low risk buck by selling the 0-day.

    12. Re:But *are* there enough eyes? by Dr.+Evil · · Score: 1

      You would submit a problem ticket. If enough people submit them, it becomes a priority for a paid developer to address the issue.

    13. Re:But *are* there enough eyes? by Phillip2 · · Score: 1

      I am struggling with this. As far as I can say that you are saying you looked at a large code base *once* and you found that it was complicated and you didn't understand it.

      Is this not true with most code bases? I mean, I can look back at my own code from a while back, and it takes me quite a while to work out what it is doing. And long-lived code bases can, ironically, be particularly problematic.

      The ultimate problem here is the funding problem. Free software is much more adaptable because you don't have to tell anyone what you are going to do with it before you do. But someone still has to pay for it at some time. The strange thing is that people and companies have roads coming to their doors which are maintained by the public, but the same is not true of essential software like OpenSSH.

    14. Re:But *are* there enough eyes? by Penguinisto · · Score: 1, Informative

      There is one workaround for this. If it's a security bug, public disclosure with a working demonstration/exploit on the right boards will get their attention awful damned fast, and you'll know when a fix is posted.

      Funny part is, usually it still takes (relatively) longer for the proprietary shop to come up with a workaround/fix than it does a given OSS community.

      --
      Quo usque tandem abutere, Nimbus, patientia nostra?
    15. Re:But *are* there enough eyes? by Immerman · · Score: 1

      >(which has a max size text field, so keep it contrite!)
      keep it concise (giving a lot of information clearly and in a few words; brief but comprehensive.), not contrite (feeling or expressing remorse or penitence; affected by guilt.)

      Though I suppose if I'm struggling to explain a complex bug in 140 characters of less I might be feeling contrite about the quality of my report. More likely though I'm just annoyed at the idiots that made it virtually impossible for me to file an adequate bug report.

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
    16. Re:But *are* there enough eyes? by ledow · · Score: 4, Informative

      "once" = several weeks of fighting with the damn thing to do one simple task, clearly specified, that's way within it's scope.

      There is no serious documentation. The examples are given as documentation and are vastly incomplete.

      It's not a question of "glanced at it, it was horrible", but for anything serious even a quick glance will show whether or not it's a nicely-produced library or not. One quick glance at a library is normally all I do in order to get a handle on whether it's good enough and clean enough for me to program against.

      The problem with OpenSSL was that the only people who knew how it worked never bothered to simplify that or document that enough. There is no "is this certificate valid" function, that returns a enum from a list of potential problems (CERT_EXPIRED, CERT_NOT_YET_VALID, CERT_CORRUPT, CERT_UNTRUSTED, CERT_INSECURE, etc.), for instance. There are lots of things that LOOK like that, but none actually do it in OpenSSL.

      Given that it's a library who's primary purpose is - given a configuration of particular algorithms and keys - to produce a encrypted bitstream from an unencrypted one (or vice versa), it's suprisingly complex to do anything simple with any guarantee that you're doing it right.

    17. Re:But *are* there enough eyes? by phantomfive · · Score: 2
      Yeah, that's what I came here to say. I re-read The Cathedral and the Bazaar recently, and it's talking more about development methodology, rather than making perfect software. Here is ESR's more formal statement explaining what he meant: "Given a large enough beta-tester and co-developer base, almost every problem will be characterized quickly and the fix obvious to someone."

      And here is the context. Note that specifically it is referring to bugs that people notice....if the user-base doesn't notice the security holes, then they are not covered by the topic:

      Linus was directly aiming to maximize the number of person- hours thrown at debugging and development, even at the possible cost of instability in the code and user-base burnout if any serious bug proved intractable.

      --
      "First they came for the slanderers and i said nothing."
    18. Re: But *are* there enough eyes? by Anonymous Coward · · Score: 1

      Having worked in a closed-source shop myself, I think perhaps you overestimate both how much importance companies give to the quality of their software as a competitive advantage, and also how much of an advantage it actually is. Big purchasing decisions are typically not made the by people who are actually forced to use the software in question.

    19. Re:But *are* there enough eyes? by Insanity+Defense · · Score: 1

      You would submit a problem ticket. If enough people submit them, it becomes a priority for a paid developer to address the issue.

      It becomes a priority to fix for the next paid for release. For a patch to the current release? Only if they must.

    20. Re:But *are* there enough eyes? by Ichijo · · Score: 1

      "There are two ways of constructing a software design: One way is to make it so simple that there are obviously no deficiencies, and the other way is to make it so complicated that there are no obvious deficiencies." --C. A. R. Hoare

      --
      Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
    21. Re:But *are* there enough eyes? by WaffleMonster · · Score: 1

      I touched OpenSSL once. It was a nightmare. No idea where or how it passed anything as it wasn't at all clear the path that simple things, like certificate checking, were supposed to take.

      In the end, I hacked onto it rather than play with it. The documentation was non-existent. The code samples were incomplete and with almost zero explanation of what you were supposed to be checking for and where things COULD go wrong. Hence 90% of the code I see that touches OpenSSL looks exactly like the samples and nothing more.

      LOL I agree with you the documentation sucks especially when you have any need to go off the SSL_* rails...yet this is niche + free shit and in that context well in line with a number of open source C APIs or generally what I've come to expect.

      There is a separate .c file for every command verb you can possibly type from openssl CLI in the apps folder.

      I've seen a number of cut and paste jobbers in various projects where authors obviously had taken no time to understand what they were doing yet this is hardly unique to OpenSSL. This kind of thing exists everywhere even where excellent documentation exists.

      All I wanted to do was have two x509 certificates, and check that both were valid and one properly signed the other, as part of a primitive DRM scheme I was toying with. It turned into a nightmare scenario of IMAGINING every possible outcome and specifically coding for each one, rather than anything sensible.

      Here is where my experience diverges... yes the API could be better, documentation could exist yet these arguments about APIs also applies to using OpenSSL from CLI. For many it is a bunch of magical incantations most people just cut and paste parameters from examples without having a firm grasp of underlying structure. The problem is lack of trivial abstractions tailored to specific use cases to make specific peoples jobs as easy as possible.

      The same concepts apply to iptables or ffmpeg... I just want to block an IP or rip a DVD to mkv.. why do I need to know all of this extraneous BS? Well you don't if you used the proper front end/abstraction API. Most systems I've ever screwed with are this way.

      Having taken the time to understand how to manage and check certificates using the OpenSSL API.. it was difficult to find information and understand screwy structures like X509_* vs EVP_PKEY but most of my problems were rooted in lack of knowledge in some specifics about how the technology itself worked even though I've used OpenSSL API and CLI in other contexts for years.

      The API has never failed me yet in the sense I found myself having to resort to low level drudgery operating on levels far beneath what was ideal and whenever I needed a callback to tweak how OpenSSL worked one was available to me. Not ideal, but hardly unexpected, nightmare or more than what I expected going in.

    22. Re:But *are* there enough eyes? by hey! · · Score: 1

      I don't think there's any real disagreement here, other than what the thread should be about.

      The poster didn't say that people couldn't find/post/send patches for bugs. Only that there weren't enough people doing so.

      How many would be "enough"? I suppose enough so that exploits didn't happen before the maintainers were aware of them. Clearly, then, we don't have "enough" eyeballs of the right sort. But we have more than if the libraries were closed-source.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    23. Re:But *are* there enough eyes? by BasilBrush · · Score: 3

      That entirely depends on the company and the seriousness of the defect.

      You're even more likely to get ignored by everyone if reporting a defect on an open source project. Mostly they'll expect you to fix it yourself or wait until someone with the appropriate skills takes an interest. And of course usually almost no-one that experiences the bug has the skills and knowledge of the particular project's internals to be able to fix it.

    24. Re:But *are* there enough eyes? by BasilBrush · · Score: 3

      The only positive there for open source is the visibility. With the defect report as with the source. It's certainly not any more likely to be dealt with in a timely way, or at all with open source. People being paid is the best way to get uninteresting bugs fixed in a timely way, and that happens a lot more often with commercial software.

    25. Re:But *are* there enough eyes? by Dr.+Evil · · Score: 1

      Depends on the company. They can also disappear leaving you without support, decide to abandon the product as non-strategic, or ask you to upgrade when you don't need to.

      Which FOSS project you adopt is equally important. A while ago I was looking for a simple FOSS file upload utility, I found one, installed it, read through the sourceforge site, used it for a good year. Then when somebody was looking for a similar utility, I searched for the utility and found a 5 year old CVE which allowed arbitrary files to be overwritten. The project was still being actively downloaded and there was no mention of it in the forum. I tested my site, found myself vulnerable, and notified the maintainer... no response.

      In hindsight, the vulnerability in the code was glaringly obvious. I *assumed* that a popular project would use basic input validation, or would update the code when a CVE is released... but no.

      Just because there are no patches, negative comments in the forums, and it's a popular project doesn't mean that here's not a major, *glaring*, well-known vulnerability.

      Same applies for closed source I suppose, but if the company is active, there's an incentive to disclose major vulnerabilities to subscribed customers, else they could be sued out of existence.

    26. Re:But *are* there enough eyes? by Capt.Albatross · · Score: 1

      The phrase might be true, but we're seeing the effects of insufficient eyes.

      If there are insufficient eyes, then the truth of the phrase is moot.

    27. Re:But *are* there enough eyes? by LordLimecat · · Score: 1

      There is a qualitative difference between "reviewing code on my spare time when I feel like it" and "Im paid to look for security bugs 9-5".

      Obviously you can argue about whether security is prioritized for any particular closed-source software vendor, but there IS a difference.

    28. Re:But *are* there enough eyes? by umghhh · · Score: 1

      I have worked in maintenance team few years of my life and if product left the active maintenance you will find out that even paying customers get told to sod off if they complain. Unless of course the problem reached customer-vendor relationship busting proportions and vendor thinks it is worthwhile. It all depends. free software often sucks so much that we went on to make our own or buy shit from 3rd party. Often times this 3rd party or our own in-house developer was even worse.

    29. Re: But *are* there enough eyes? by umghhh · · Score: 1

      I have to agree with this working in maintenance of closed source and also in QA - our own fault reports were often ignored because the product part reached end of its active development and there was nobody to pay for a fix. This even in a situation where a customer wrote a bug report on that too. So closed source is just as bad or as good. It all depends or in other words: source v. close source is a false dichotomy - there are good&bad products, development teams etc

    30. Re:But *are* there enough eyes? by kesuki · · Score: 1

      the problem is 'security' software is never as secure as promised. it's like physical keys, you can only make so many types of physical keys, so you would think they would make locks with a larger sample size than the retailer has access to. but no go to any menards you want to, bring the package from your door lock and they will point you to the exact same paired key on the shelf. throwing away your key package is inviting a thief to grab fresh one at the local hardware store and ask if they can get matching keys. the problem is so bad that hotels switched to digital keys that can be controlled by a computer, which as it turns out is no safer as the computer can make a 'maid service' key that unlocks any room. it is not that hard to get a hold of equipment for making magnetic swipe keys either.

    31. Re:But *are* there enough eyes? by tlhIngan · · Score: 1

      The phrase might be true, but we're seeing the effects of insufficient eyes. In reality, how many sets of eyes are actually reviewing these libraries at a source code level? I rather strongly suspect that in most cases they are simply used under the assumption that "well, everyone uses it, it must be okay".

      Well, everyone's assuming that since everyone else is using it, there must be a lot of eyes on it. I mean, surely a project can't grow to be embedded in practically everything and have glaring bugs in it, right? Given so many "beta testers" of the software, all bugs should've been resolved because everyone must be using it in sufficiently different ways that the paths all get exercised, right?

      And yes, I too used OpenSSL and was quite disappointed as to its complexity and lack of documentation. I mean, if everyone else uses it, you'd think there would be some rather great documentation for it - I mean, did everyone else waste a couple of weeks trying to make sense of trying to use it? If it's used so much, it must have well designed APIs and great documentation to go with it to be that popular.

      Then again, I suspect a good reason for its widespread use is it's basic functionality that's not replicated anywhere else.So yes, it's one of those rare exceptions because everyone uses it because it's your only choice, and yes, everyone else has to bang their heads on it for a few weeks to make heads or tails of it.

      And no, big complex things don't have to be complicated - Linux is big and complex, yet has some rather good documentation about it. A good source explorer (or even LXR) and you can easily figure out if an API is doing what you expect. It's just that Linux is well compartmentalized, APIs are generally stable and things are generally written to what you expect. Oh, and people do write documentation about it.

      In fact, Linux is probably more complex because there's a lot of code that is NOT included in the build so you have to sift through mounds of dead code. Or not, since a lot of the time it's obvious.

      The thing is, with Linux, there are people who are willing to document and refactor. OpenSSL is complex because a lot of it grew organically - stuff gets added as time goes on but little gets refactored. In Linux, there are people actively culling bad pieces of code and rewriting it to be cleaner, better, more efficient, whatever. So stuff doesn't generally grow out of control before someone decides to prune it and try to figure out a better way to do these things.

    32. Re:But *are* there enough eyes? by LihTox · · Score: 1

      Potentially, yes. But open source may be running into the Bystander Effect (http://en.wikipedia.org/wiki/Bystander_effect):
      "The bystander effect, or bystander apathy, is a social psychological phenomenon that refers to cases in which individuals do not offer any means of help to a victim when other people are present. The probability of help is inversely related to the number of bystanders."

    33. Re:But *are* there enough eyes? by dkf · · Score: 1

      the problem is 'security' software is never as secure as promised

      And the problem with OpenSSL is that they start out from the position "this is complicated" and then go straight to "so Joe Working Programmer should deal with all the complexity themselves" without properly spelling this out in very clear letters in a large font. That's abysmally awful. It leaves people exposed to trouble without them realising that this so.

      --
      "Little does he know, but there is no 'I' in 'Idiot'!"
    34. Re:But *are* there enough eyes? by Pav · · Score: 1

      I'd imagine elements of this question are amenable to analysis eg. estimates can be made of the number of: * security bugs per 10,000 LOC * the likelyhood of a "set of eyes" to discover these Given these two, how many orders of magnitude "friendly eyes" (of equivalent skill) are required to make a malicious 0-day acceptably unlikely given XYZ million LOC on a given system.

  3. Libraries? by fnj · · Score: 3, Interesting

    Shellshock did not affect a "library", but an executable.

    1. Re:Libraries? by TheRaven64 · · Score: 2

      It depends a bit on your definition of a library. In the broadest sense, it's just a body of code that other things use. Programs that communicate via pipes fall into this category as do language interpreters. Bash definitely meets this definition. There's more to libraries than just linker input.

      --
      I am TheRaven on Soylent News
    2. Re:Libraries? by goarilla · · Score: 1

      In that case the word "code" would have been more appropriate than the word library. This is slashdot after all.

    3. Re:Libraries? by greg1104 · · Score: 1

      On UNIX systems, OpenSSL provides C headers your program compiles against, and then you link against their shared library. The bug was in the shared library part.

      There are builds where all that gets turned into a static executable. The API is still being treated as a library in that case too, it's just all wrapped up on the packaging side.

  4. Open or Closed do you want Speed or Security by Anonymous Coward · · Score: 1

    Open source, closed source, they have the same problem: 1 vulnerability is now shared across every app that uses that library

    So why do we use libraries in the first place if they are so flawed? They cut delivery time and maintenance costs down by a huge chunk

    In context rolling your own code to do the same work seems preferable but its vulnerabilities are limited to YOUR codebase and YOU gotta fix it (versus an army of OSS people who are shitting their pants that their library is in the news again)

    So yeah, despite the problems I'll stick with OSS libraries

    1. Re:Open or Closed do you want Speed or Security by Anonymous Coward · · Score: 1

      You have 3 options:

      1. closed-source. If it's vulnerable, you may never know until it's too late

      2. open-source. As we've seen, having source doesn't guarantee superior quality, but at least you can audit it yourself.

      3, roll-your-own. You control it totally. It's your code, your development expenses, and your bugs. No one else is going to be helping you outside of temporary consultants you might hire.

      Of the 3, I prefer open-source. Especially in matters of security. Vendors have demonstrated a habit of sitting on known weaknesses until it was convenient for them, trusting in Security through Obscurity. Which has been known to fail more than once.

      Roll-your-own security is VERY bad unless you have full-time trained security developers in-house. Most roll-your-own was done by "clever" people who didn't really understand the nuances as well as they thought they did, and especially not the mathematics. And done as an afterthought to "more important" parts of the application. These systems are usually poorly maintained, under-documented (and the original designer isn't there anymore), don't integrate well with standard system components, and very, very often have all the stopping power of wet tissue paper.

  5. So if I'm understanding this correctly by Ukab+the+Great · · Score: 3

    the big news is that people are now thinking that bugs in software is big news.

  6. Magic ball prediction - 2015 by sinij · · Score: 5, Informative

    My magic 8 ball tells me that in 2015 we will learn that proprietary and embedded software is even more vulnerable. My Tarot Card deck tell me that we will see a lot of hacked car wrecks in 2015, now that Volvo released the demon by putting a web browser into in-dash system. Rest of the lemmings are sure to follow. Not that you really need a browser to pwn a car, with Bluetooth-to-CAN-BUS exploits shutting down cars demonstrated as early as 2012.

    1. Re:Magic ball prediction - 2015 by Qzukk · · Score: 3, Funny

      requires physical access to the car.

      Good thing my car stays in a locked server rack in a room with a security guard posted at the door requiring a finger print and an RFID card to access.

      --
      If I have been able to see further than others, it is because I bought a pair of binoculars.
    2. Re:Magic ball prediction - 2015 by Connie_Lingus · · Score: 2

      what...no faraday cage?

      --
      never bring a twinkie to a food fight.
    3. Re:Magic ball prediction - 2015 by QuietLagoon · · Score: 1

      ...My magic 8 ball tells me that in 2015 we will learn that proprietary and embedded software is even more vulnerable. ...

      imo, That's already been proven by Microsoft over the years....

    4. Re:Magic ball prediction - 2015 by Z00L00K · · Score: 1

      A lot of vehicles are now looking at common operating systems like Android, Windows, iOS etc. just because they are common on the market.

      Just be aware that the proprietary systems they are leaving are a lot worse when it comes to bugs, so it's not an option to stick to a proprietary system. However some people in the vehicle industry are still not having a very good knowledge on how to segment networks.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    5. Re:Magic ball prediction - 2015 by sinij · · Score: 1

      Car manufacturers will have to learn that they will have to a) patch cars b) support them out of warranty with security patches c)educate users and independent mechanics to apply security patches. Soon, it will be "Quick Lube and Patch" service stations.

      Personally, I prefer my cars air-gaped. I place negative value into infotainment systems and any car functionality that is no directly related to driving. Unfortunately, I am in the minority.

    6. Re:Magic ball prediction - 2015 by greg1104 · · Score: 1

      That was already 2014 news, it's just going to spread further in the new year.

    7. Re:Magic ball prediction - 2015 by sinij · · Score: 1

      I really hope you are wrong, but I know that unless government regulators step in with massive fines your prediction will likely be true.

      The only reason we see so many recalls recently is because Toyota was massively fined for gross negligence with uncontrolled acceleration issue.

  7. um what? by Charliemopps · · Score: 1

    I don't know anyone that ever thought "Open source" was bug free. The point is that people can more easilly find and fix bugs with open source. With closed source, there could be some obvious and dangerous mistakes in the code but no-one but those with access to the source will know it exists. It's then up to whomever owns the source to decide if it's profitable enough to fix it. The problem with that system is there are people with access to the source... People come and go from every company on earth every day. So they're finding these vulnerabilities, and leaving the company with them. They can sell these to whomever they wished if they so chose. The NSA and others like them probobly have all the major players broken so they can view the source as well. The point being is that closed source is only closed to YOU With open source, you can look at the code yourself, and if you see a bug the general community doesn't think is a big deal and doesn't want to fix... if it's in fact, a big deal to you, you can go right ahead and fix it yourself.

    1. Re:um what? by meta-monkey · · Score: 3, Insightful

      Not only can they fix them, but they do fix them. As soon as these vulnerabilities were discovered (by non-malicious actors) patches were available within days or even hours. Commercial vendors take their good sweet time. Or in the case of Microsoft, discontinue support for the still widely-used Windows XP. Find a vulnerability in that? Too damn bad. It'll never get fixed.

      Nobody's saying open source software is bug-free or even necessarily has fewer bugs than closed source software. It's what happens when a bug is discovered that makes the difference.

      --
      We don't have a state-run media we have a media-run state.
    2. Re:um what? by jones_supa · · Score: 1

      I don't know anyone that ever thought "Open source" was bug free.

      At least back in the day one of the main motivations to move to open source was that it provided a less buggy experience than the proprietary option.

    3. Re:um what? by Immerman · · Score: 2

      Hey now, I'm all for closed-source bashing, but let's be fair: Windows XP is over 13 years old. Yes, if you found a bug in one of it's contemporaries such as Red Hat Linux 6.1, but it's much more likely you'd upgrade to a newer version of the software where the bug has (hopefully) been fixed.

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
    4. Re:um what? by Jamie+Lokier · · Score: 2

      Or in the case of Microsoft, discontinue support for the still widely-used Windows XP. Find a vulnerability in that? Too damn bad. It'll never get fixed.

      Like when Ubuntu Server 13.04 didn't get a fix for Heartbleed because they discontinued support after 1 year despite the criticality of the bug and the servers seeing considerable use? All the official replies were "it's your own fault" and "change distro version immediately". Which you often can't do quickly. No users really expected 12.04, 12.10, 13.10 and 14.04 to get the fix while 13.04 in the middle was left out - except people who read the really, really fine print and took it seriously. Shipping the security fix would have been trivial and saved a lot of people a lot of work; they just refused on principle.

      It was probably the first time many users found out Canonical had changed the support duration (that's why 12.10 got the fix).

    5. Re:um what? by meta-monkey · · Score: 1

      Dick move, for sure, but at least it's able to be patched by the administrators themselves. With a closed source product you'd be SOL.

      --
      We don't have a state-run media we have a media-run state.
    6. Re:um what? by Jamie+Lokier · · Score: 1

      That's good advice.

      But there are plenty of things on most networks that aren't critical servers or devices you have the luxury to control and plan.

      If you regard security patches as essential only for those things, you're doing defense in depth wrong.

      Heartbleed affected clients too, and several things that aren't internet facing services.

  8. overall framework vulnerability by Virtucon · · Score: 1

    Whether it's OpenSSL or Windows APIs hackers are looking at every possible vector to attack systems. To be honest with ourselves, the software engineering community has to realize that security must be given the same priority as any other code quality metric. While we may not be able to test for every possible vector there should be a standard set of vulnerability tests that every organization should be able to test for before releasing code. Likewise regression tests need to be exercised prior to any subsequent release of the system. I also think that software engineers need to be more objective with themselves and to think more along the lines of how their frameworks/systems could be attacked. Of course that's never going to solve the insider problem as far as attack vectors are concerned but it should go a long way in addressing these kinds of problems.

    --
    Harrison's Postulate - "For every action there is an equal and opposite criticism"
  9. The real bug argument by MikeRT · · Score: 1

    Is that with FOSS, decent developers can fix bugs and keep moving on a deadline. We found an oversight in Apache Storm's HDFS integration that affected us, but not most users. So I patched it and sent it along. Had it been an Oracle product, not an Apache product, it would never have happened on a timeline acceptable to our schedule.

    Security bugs? I like to throw this one out there at people who think big companies cannot unleash epic stupid on their paying customers that makes even most 0.0.1 projects on GitHub look production-ready.

  10. Re:not just many eyes by plover · · Score: 4, Interesting

    The security of the open source model isn't really the problem or the answer here. The problem is homogeneity. A million different sites and applications rely on just a few libraries, so that when a bug hits one, it has massive impact on the entire internet.

    We also know that the answer isn't in rolling your own security. Very few people or organizations are likely to be able to securely implement their own version of TLS. Even the best packages of today didn't start out perfect, they had to iterate through several flaws to get to where they are today.

    So perhaps the better answer is in having more packages to choose from? Instead of picking just openssl by default, it would be better to have a broad array of choices. With a dozen packages on the market, that might mean 11 times out of 12 the bad guys wouldn't exploit our site. If the packages are interchangeable, we'd be better positioned to switch them quickly in case of emergency.

    --
    John
  11. Shallow, not psychic by Junta · · Score: 1

    In the cases that were software defects, the defect was rapidly fixed upon discovery. That's really the meaning of all bugs being shallow, not that they won't ever exist.

    That said, POODLE is not a code defect, but defect in the standard (well, except the bit where an implementation skipping validation of the pad). Shellshock was indeed a grave defect, but I think a correct takeaway there is to avoid having a shell language be in the path where untrusted data could be injected as much as possible (as well as fixing it). A fair amount of noise has been made in some circles along the lines of 'told you so, open source is riskier than proprietary', though in the same time frame we've seen Apple's implementation have 'goto fail' and Microsoft's SChannel has also had at least one recent issue.

    The short of it is code is not magic. If code is taken for granted, it will be neglected (whether OpenSSL or some boring proprietary function well out of view of marketing concerns). Neglect in security centric libraries is particularly dangerous. In this case, I think Heartbleed panic was the proverbial tide to rise all boats, causing investment across the industry in scrutinizing all TLS stacks.

    --
    XML is like violence. If it doesn't solve the problem, use more.
  12. Re:Oh, really? apk by rubycodez · · Score: 1

    You are wrong, each and every person connected to the internet is an open source user. Open source iis first and foremost used on the planet, your email for example isn't routed around the globe by Microsoft Exchange servers, nor global DNS done by Active Directory servers.

    The hundreds of thousands of bug reports submitted and successfully used to patch open source prove you are blathering about a process you don't understand.

    You also are a moron with no understanding of how your computing world works.

  13. The sad truth by jones_supa · · Score: 1

    The quality of open source software is kind of crusty these days. No matter how open it is, making stuff work properly should be priority number one.

    For example, try to adjust the display brightness of a laptop under Mint or Ubuntu. It goes in multiple steps because there is multiple listeners for the adjustment event. Even basic stuff like this does not work properly.

  14. Security by ledow · · Score: 1

    Open-source does not make code automatically bug-free. No more than using a safe-malloc-library does, or deploying DEP on your executable, or ASLR, or coding only in a language that's considered "secure".

    What it does is allows certain types of security problems to be POTENTIALLY spotted. It's a +1 on the score, not a game winner. And it doesn't mean that proprietary is -1, either. It just means that you are so confident in the quality of your code, you can show people that by opening it up.

    What gets me about proprietary software is not that they choose to do it so their rivals can't copy (a bogus argument in any country that properly enforces licensing agreements, which is why you can get a peek at MS code if you have a need to), but that they are SO ASHAMED of their code they don't want you to see it.

    The 3DFX card drivers, for decades, basically allowed complete DMA access to all of RAM. It was that easy. But nobody could spot it because nobody could see the 3DFX code. You don't get that in open-source drivers and the SECOND it's spotted, by anyone, it will get fixed. That's the difference - the reaction. When we found these problems, they were urgently fixed immediately. When we find problems in proprietary code, it can be (as recent articles state) known for 90 days or more without anyone bothering to even look at them.

    Open-source isn't security. But it's like saying to a guy, at a security conference, "Here, I'm so confident in my gadget, that I'll let you play with it". Sure, he might break it, he might compromise it live in front of all your customers. But in an technology sector concerned with SECURITY, not profits, that's actually exactly what you want and the perfect impetus to keep improving so that next week you can do the same again, and again, and again until you've ironed out most of the bugs. You'll NEVER get them all.

    But the confidence to do that is critical. I've been at tech conferences for my sector where suppliers hand out products and, in the space of a few minutes, I point out massive flaws and problems with them. They soon stop handing them out for people like me to play with. That's not the attitude to have when it comes to security, but I understand why a business would do that.

    It's not the be-all-and-end-all but it's a nice thing that does not hurt to do. Those that don't understand this do not have security uppermost in their mind, only oneupmanship, and "my OS is better than yours" crap.

    In security, and cryptography especially, given your enemy the source is a show of bravado and confidence. It's like the old backup adage. If you're so confident in your backups, high-availability, failover, etc. then why are you not prepared to let me take an axe to your primary server? If I was in charge of a large company and my IT guy assured me the disaster recovery was so easy and already-in-place, I might well choose to say "Yes... go on. Take an axe to it.", if nothing else than to see their reaction and see the plan kick into place.

    Passing that test would cement your place on my team for a long while. Failing or chickening out of it might well mean I test it more regularly and keep a close eye on you.

    Open-source doesn't have automatic properties. But it a checkmark in your favour if you're claiming to write software well that millions of people might choose to use.

  15. Say what? by Anonymous Coward · · Score: 2, Insightful

    I don't know anyone that ever thought "Open source" was bug free.

    Every FOSS fanatic on Slashdot for the last 17 years has implied that bugs would be found and fixed FAST - not linger for years.

    The point is that people can more easilly find and fix bugs with open source.

    They could but do they? Nope.

    1. Re:Say what? by Livius · · Score: 1

      I don't know anyone that ever thought "Open source" was bug free.

      Everyone who didn't think about it thought exactly that. Which means a very large number.

  16. Misunderstood by TopSpin · · Score: 3, Interesting

    ESR's claim has nothing to do with the frequency or discovery of bugs. All he says is that given enough observers, bugs are quickly characterized. It is implied that any given bug has already been discovered. There is no benevolent cohort of experts continuously auditing code bases and his statement doesn't claim there is.

    --
    Lurking at the bottom of the gravity well, getting old
    1. Re:Misunderstood by phantomfive · · Score: 1

      Yes, exactly this. ESR was saying that if bugs annoy users, the bugs will be fixed before the users go off and find a different kernel.

      --
      "First they came for the slanderers and i said nothing."
  17. Re: not just many eyes by allan572 · · Score: 4, Informative

    So all we need are 11 more sets of programmers to program free version of SSL 2-12?

  18. I strongly disagree by Tsolias · · Score: 1

    (esp. with the title) In 2014, with all that panic, we saw/learnt that professionals (admins,programmers,huge companies, e.t.c.) use the open-source code irresponsibly. Also, 2014 taught us that when someone gives us candy, better double check it before we consume it.

  19. No, that is false by Sycraft-fu · · Score: 3, Insightful

    An open source project can have as few as just one set. There are some projects that nobody other than the developer ever contributes to. Just one guy occasionally working on some little project that some people use. Those all those people COULD look at the code, they don't.

    Likewise commercial firms can, and sometimes do, pay many people to look at the code. In addition to having a big development staff they can have dedicated QA staffs. They can have a person, or many people, who's job it is literally to sit and look over the code for security issues every single day.

    You are buying in to the same fallacy that the article is talking about: That because something is open is just means that more people MUST be looking at it. No it means people can look at it, but they may choose not to.

    1. Re:No, that is false by orlanz · · Score: 1

      I think the number of "commercial firms" actually doing proper QA and code review is minuscule. Its almost a margin of error in the stats. Sure, all the paper work is there with the sigs etc. But I have never seen the actual process ever being properly done by qualified folks with any of the big IT consulting firms. Heck, my small 25k-50k projects don't even get it right... where I am the PM.

      Because the budgets, time constraints, & resources are never setup to do this correctly. With crunch time, code review is the first thing to go out the window, and QA the second (again, the paperwork is all there and signed but it means nothing).

      You show me a project that did proper code review & QA and I will show you a project that was done on time, in budget, and within scope. I understand the fallacies on both sides, but I believe the many eyes to be more effective than commercial code review & QA.

  20. Exactly. Shallow doesn't mean nonexistent by raymorris · · Score: 1

    Exactly. Saying bugs are shallow doesn't mean they don't exist. Shallow vs deep refers to how much effort it takes to characterize and fix - is it a "hard" bug or an "easy" one. Wikipedia explains it well:

    As the Heartbleed bug shows, even shallow bugs[7] may persist in important pieces of open softwareâ"it took two years for the bug to be discovered, and the OpenSSL library containing it is used by millions of servers. Raymond said that in the case of Heartbleed, "there weren't any eyeballs".[8]

    When it was discovered that there was a problem, many eyeballs starting looking at it and it didn't take long (hours) for someone to clearly identify the problem and the solution.

    In contrast, there is code at my workplace that only I look at. There are intermittent problems that have persisted for MONTHS. I'm just not seeing quite what the cause is. If 1,000 other programmers looked at it, one them would probably spot the problem right away. It would be shallow _to_them_.

  21. Statistics and Damnable Lies by stoicio · · Score: 1

    Has anyone noticed that there are now astronomically more OSS users now? The number of OSS users is also growing at an exponential pace.

    What we should expect with those stats is that there should be more cracks and bugs in OSS due to the higher percentage of people programming/using it.

    Also, as the value of OSS increases to the market and more information are handled by OSS there is more incentive for old vested interests to search for the downside as a form of marketing. We never heard about all those MS Windows security deficits until years after the fact. Well after they had been exploited by te NSA.

    It's interesting that SO FEW bugs have caused issues in OSS considering the sale of that ecosystem.

    There is also more incentive for companies protecting turf to pay OSS project insiders to plant exploits as a way to undermine that.

    It's better to rely on 'Repairable By Design' than 'Defective by Design' .

  22. Re:not just many eyes by binarylarry · · Score: 3, Insightful

    So "Security through complexity" then?

    Sounds complex.

    --
    Mod me down, my New Earth Global Warmingist friends!
  23. Re:not just many eyes by Immerman · · Score: 2

    Unfortunately, assuming the number of developers is constant, with 12x as many libraries every one of them is virtually guaranteed to be far less secure than if all the developers were working on improving the same library.

    So the root of the issue is that we need to dedicate more total resources to development, auditing, etc. the fundamental security libraries. Whether the best outcomes would then be seen by focussing all those resources on a single library, or spreading them across multiple competitors, is a seperate question. Somehow though I suspect that having 12x the resources focussed on a single library would be far more effective than having 12 competing libraries all staffed at current levels - wherin the majority of labor would be independently duplicating effort between projects. With enough resources there might be some benefit in having two or three competing implementations under development, but I suspect we're currently a long way away from "enough".

    --
    --- Most topics have many sides worth arguing, allow me to take one opposite you.
  24. The Year Instant Karma Got Some Corporations by Anonymous Coward · · Score: 1

    Corporations like Apple and Google have been making their billions by exploiting open source, without giving much back. These bugs were in libraries that corporations built their businesses on, and lurked while the corporations made their money. Billions of dollars later, these understaffed and underfunded projects still had the bugs, and instant karma got the corporations for a change when the exploits started coming. Shows us a lesson in how vulnerable to exploitation open source is, and big corporations wouldn't have it any other way.

    1. Re:The Year Instant Karma Got Some Corporations by jones_supa · · Score: 1

      This is probably the main problem. For both home users and businesses, open source is often just a way to get free (in beer) software components. The work isn't funded properly and there is not enough resources to do proper QA.

    2. Re:The Year Instant Karma Got Some Corporations by styrotech · · Score: 1

      Corporations like Apple and Google have been making their billions by exploiting open source, without giving much back.

      I thought it was the other way around.

      2014 was the year that Google's Project Zero and similar efforts from other companies like Redhat started proactively taking a deep look at some of these crusty old open source libraries and finding some real doozeys.

      A lot of the big vulnerabilities last year were found and reported by these company security teams. 2015 will have more of these issues come up too, but it is making things better long term.

  25. Re: not just many eyes by plover · · Score: 3, Interesting

    So all we need are 11 more sets of programmers to program free version of SSL 2-12?

    Yes, and demand for them. But the big problem you're correctly implying is there's no economic justification that will drive this behavior. Maybe it will take a dozen big companies and foundations to drive this. Imagine if IBM, Microsoft, Google, RedHat, Yahoo, HP, Dell, Apache, Wikimedia, Mozilla, FSF, Apple, Intel, AMD, nVidia, Bungiesoft, and others each contributed their own versions of openSSL; each written in their own choice of language, using their own code, and building their own implementations of everything from the crypto through the command line interpreter logic. My company may decide we do more business with Intel, so we choose theirs. Or your company may be more Apple focused, so you'd choose theirs. In every case, we'd all nervously watch each other looking for signs of intrusions, hoping we won't be the victims, but knowing that alternatives exist if we are.

    While a 1/12th scale incident of Heartbleed is still a huge problem for a lot of companies, it's no longer the catastrophe-sized disaster that Heartbleed actually was.

    --
    John
  26. Make that THREE other things by calidoscope · · Score: 4, Interesting

    3) Port to to multiple architectures (and OS's) to catch bugs not reported by the original build environment. This is one of the approaches OpenBSD uses to improve security and was quite common in the open source software world when ESR coined the phrase.

    The OpenBSD team found one very long lasting (30+ years) bug in the legacy BSD code when the Sparc64 build barfed.

    --
    A Shadeless room is a brighter room.
    1. Re:Make that THREE other things by thegarbz · · Score: 2

      That's a double edge sword as shown by the clusterfuck that is OpenSSL. When you start supporting many architectures then the strange hacks you need to do to make things work can be the ones that introduce the security risk.

    2. Re:Make that THREE other things by dkf · · Score: 1

      That's a double edge sword as shown by the clusterfuck that is OpenSSL. When you start supporting many architectures then the strange hacks you need to do to make things work can be the ones that introduce the security risk.

      If you're introducing strange hacks, it's probably a sign that the design of some of the rest of the code (being charitable here!) is wrong in the first place. Writing the code to be more portable, to use fewer quirks (ideally none), that's the way to go. Yes, it can make things long-winded, but it's worth it.

      --
      "Little does he know, but there is no 'I' in 'Idiot'!"
    3. Re:Make that THREE other things by thegarbz · · Score: 1

      Depends on what you call nasty hacks. Different architectures work in different ways. You said it yourself: "make things long winded". As soon as you increase your scope and increase the amount of code you use you introduce new places bugs can slip through.

  27. What utter bullshit by Bearhouse · · Score: 1

    2014: The Year We Learned How Vulnerable Third-Party Code Libraries Are

    Really? Like we did not know before?
    I don't think anyone in the industry who is both sane and honest ever pretended that FOSS was bug-free.
    We know that software, ALL software, contains bugs.
    Also, plenty of projects don't have too many contributors, so the "many eyes" principle hardly applies.

    But if you've got the source at least you can have a look, (and really should, if you are considring using something for a mission-critcal application).
    Then fix, if required,and contrib back.

    Certainly, vulnerabilities in FOSS stuff tend to get fixed pretty quickly when found.

    1. Re:What utter bullshit by jones_supa · · Score: 1

      I don't think anyone in the industry who is both sane and honest ever pretended that FOSS was bug-free.

      Why not? We should precisely strive for FOSS being the golden standard for bug-free software. The OpenBSD team is doing pretty good work in this area.

  28. Re:Author is a troll, and yes, they were shallow by jones_supa · · Score: 1

    When the Heartbleed vulnerability was found, there was spotted another OpenSSL security vulnerability which had not been fixed for 4 years and it even had a public CVE record in place.

  29. Re:not just many eyes by DaphneDiane · · Score: 2

    Actually the number of developers ( and developer effective effort ) that would work on such a library is not constant. Once you get too many developers on a single project a larger effort is required to required to just for code / development syncing. The other issue is especially with open source developers is not all developers are interested in working in the same development models among other issues. Which means single projects tend to discourage some potential developers from joining in. There also is the issue of developers wanting to feel helpful a good developer will often feel more appreciated on working on a smaller project.

    Finally just because implementations are separate does not mean that their is not cross pollination. Fundamental concerns found by one project are very likely to be searched for in other projects. Likewise with good ideas introduced in one project will often be picked up by other projects. Further because of a diverse system of libraries it is more likely that good ideas can be experimented with safely in different projects.

  30. Re:LOL, bullshit... apk by Tailhook · · Score: 1

    Apk hits opensores idiots with truth and all they have is downmods to hide it as usual? Yes.

    Apk hits guillible slashtards with best trolls & the laughter NEVER ENDS? Yes... apk

    --
    Maw! Fire up the karma burner!
  31. Open or closed, same problems by ErichTheRed · · Score: 1

    From the perspective of most IT customers, bugs are bugs regardless of closed or open source. They still rely on other people to find them, patch them and release changes.

    Companies who rely on open source libraries may or may not have the ability or spare resources to go digging through the code of a library, finding a security issue, writing a patch for it, recompiling the library, then using that patched copy in production. Companies in the 'service provider' realm may be able to do this, simply because they are staffed appropriately and have a greater IT focus. I do IT work for airline customers. Airlines want as little to do with IT as possible, even though it's a key part of their business...it's not directly related to the surprisingly low-margin business of moving people and planes. I would never advise a customer to roll their own Linux distribution, for example, even if it was based on a commercial one. There's just no appetite for keeping things maintained in a business who doesn't live and breathe technology.

    The problem is that, increasingly, even closed source vendors are relying on open source libraries to provide large blocks of their application's functionality. A company who doesn't write operating systems generally shouldn't try rewriting these very important pieces, of course, but the closed source companies providing applications that use open source libraries need to be on top of these issues and ideally contribute back their patches.

    Whether closed or open source, companies need to be able to respond quickly to security problems, and those problems may end up getting traced back to something like OpenSSL, the Apache stack, etc. Open source has the advantage of "more eyes" looking at the code for vulnerabilities, and less commercial pressure. Closed source companies have the opportunity to provide (usually at a cost) the expertise and support necessary to find and fix a customer problem. I've had both awful and good experiences with both trying to get bugs resolved. If you pay for it, and the closed source vendor has good support, they will move heaven and earth to fix your problem. For non-technology companies, closed source or support-funded open source companies like Red Hat give internal IT teams a good boundary between them and "the vendor" as well as someone to call when they have done their homework and find they can't fix something. For the Googles, Facebooks and maybe some academic institutions, the internal IT department can be staffed with kernel hackers and the like to maintain their own highly-optimized implementations. Techies tend to forget that users and companies have very little desire to mess around with technology, and use it to get their work done.

  32. What's the big deal? by morgauxo · · Score: 1

    So there were a few high-profile security flaws found in important open source software recently. So what? People are talking almost as though this somehow proved that open source is not superior or maybe even inferior to closed source software.

    It isn't like there has never been a high-profile security problem in important closed source software. Nor is it likely there will not be others in the future.

    Here is an awfully safe prediction... in the future there will be more high-profile security bugs found in open source software AND in closed source software too.

    Certainly the age of the code that caused these bugs is reason for concern. Hopefully lessons are being learned and improvements being made. But to even try to make a comparison between open and closed source software regarding security? Good luck with that.

    How can you possibly count the number of zero day exploits in either? By definition you don't know that they are there! At least with open source if you really care you can do something about it.

    1. Re:What's the big deal? by morgauxo · · Score: 1

      "Certainly the age of the code that caused these bugs is reason for concern."

      But.. if those bugs were so obvious and easy to exploit then why didn't "the world end" a long time ago? I'm pretty sure there are an awfull lot of important systems out there that have Bash on them!

  33. Re: not just many eyes by dkman · · Score: 4, Insightful

    Sadly we humans only seem to be able to handle 2 or 3 options. If 12 existed we'd hone in on 3 favorites and 9 would be outliers.

    It's not that just "being open source" automatically means code is being validated by lots of eyes. It means that you can look at the code. All we need is more people interested in doing that, or paid to do so. They also need to have the knowledge/skill necessary to do that.

    And as always, being closed source would not have made the issues easier to find. And then you'd be at their mercy waiting for a fix. These were all found and all fixed relatively quickly, so let's focus on that.

    SSL certainly isn't a simple library. Increased complexity makes it easier to make a mistake and harder to find it.

    --
    I refuse to sign
  34. Re:not just many eyes by westlake · · Score: 1

    it would be better to have a broad array of choices. With a dozen packages on the market, that might mean 11 times out of 12 the bad guys wouldn't exploit our site

    1 Staffing and maintaining a single project is no small feat in itself.

    2 The smaller the piece of the puzzle that you are trying to replace, the more likely you will be driven towards the same solution.

    3 Does even the IT pro have the time and resources to research and test a dozen choices for each of the one hundred, three hundred, or more third party libraries they may need?

  35. Re:use OpenBSD by Celarent+Darii · · Score: 1

    Preach it brother! The whole world should be using BSD!

  36. Re:not just many eyes by xvan · · Score: 1

    What is wrong with security through obscurity?

  37. Re:not just many eyes by amorsen · · Score: 2

    OpenSSL, Netscape NSS, GnuTLS, as well as various proprietary SSL implementations have all had serious bugs over the last few years. Some of the bugs affected multiple unrelated code bases.

    How much diversity do you want? How did the diversity help?

    --
    Finally! A year of moderation! Ready for 2019?
  38. What??? by barbariccow · · Score: 1

    What is up with this article? What about closed-sourced apps like ISS or windows, with tons and tons of vulnerabilities found (and some fixed) every week? Because there have been a very small handful in some high-profile open-source projects means open source doesn't work?

    That's the stupidest thing I've ever heard. If anything, because those bugs were found and fixed shows that open source DOES work. If they were closed products, those bugs may likely still exist and No Such Agency may likely still be exploiting them. Not to mention all the back-doors they force into closed-source software, which is harder to do with open source in the first place.

    The point is, for something to be secure you have to be able to audit it. In the open source world, you can do this. In the closed source world, you have 0 ability to confirm that something is secure, you are just taking a salesperson's word for it. THAT is lack of security awareness.

  39. Re:not just many eyes by Immerman · · Score: 2

    First off, let's be clear - I'm not arguing against alternatives, there are many good reasons to have them. But when the single major widely-used library is already "under-funded", starting a dozen more similar projects all competing for basically the same developer base is unlikely to improve things.

    As for attracting OSS developers, I'm unconvinced. Sure, for "sexy" projects many will prefer a smaller project where their contributions are likely to be more appreciated. On the other hand, for a utility library only ever seen by a tiny percentage of developers, especially one designed to be a drop-in replacement for competitors, that appeal is likely going to be overshadowed by the fact that they're working on "just another implementation of X"

    And perhaps more to the point, those motivations are primarily relevant to *volunteer* developers. But as I understand it for a big, high-visibility project like Linux the majority of code contribution now comes from developers working in the employ of major downstream users. No reason at all they shouldn't be paid to spend a bit more time on high-stakes things like security.

    As for the resources needed - I suspect there are plenty of developers per se already working on the projects - major bugs are after all typically fixed within weeks. What's really needed is better auditing. Which yes, does call for a skillset with considerable overlap with developers, but is not really the same thing.

    And I hear you on the cross-pollination - the point though is that when problem X is discovered in codebase Y, you now also need need enough auditor man-hours to also analyze codebases A,B, C, D, E, and F for similar problems. And if you want the libraries to be drop-in replacements for each other then god forbid you should add a feature or fix a bug that requires an interface update. Assuming the internal architecture is at least moderately different in all the implementations it may not even be possible to change the interface in a way that doesn't require a major rework of one or more implementing projects. Even if it is you're going to be looking at a lot of duplication of effort for any changes.

    --
    --- Most topics have many sides worth arguing, allow me to take one opposite you.
  40. Re:LOL, bullshit... apk by rubycodez · · Score: 1

    Wrong, those devices are connected to the internet where open source rules.

    I'm older than IBM mainframes, boy. You have not been in the field longer than me.

  41. Re:not just many eyes by TechyImmigrant · · Score: 4, Insightful

    >We also know that the answer isn't in rolling your own security. Very few people or organizations are likely to be able to securely implement their own version of TLS.

    TLS is the issue. It isn't simple. It isn't even secure in many compliant configurations. It invites implementation errors.
    A good spec of a secure protocol would make secure implementations easy. If you don't think about the implementability while you're writing a spec, you're doomed, like TLS is.

    "Don't roll your own security" is advice aimed at people who don't know about security. Some of us have to implement and 'roll' the specs. The world looks different when your reputation is tied to your stuff not get broken before senility sets in. You can do it right, but you need all the elements in place including a well thought out spec.

    --
    I should use this sig to advertise my book ISBN-13 : 978-1501515132.
  42. Re: not just many eyes by drinkypoo · · Score: 3, Insightful

    Microsoft, Google, RedHat, Yahoo, HP, Dell, Apache, Wikimedia, Mozilla, FSF, Apple, Intel, AMD, nVidia, Bungiesoft, and others each contributed their own versions of openSSL; each written in their own choice of language, using their own code, and building their own implementations of everything from the crypto through the command line interpreter logic.

    ...and then, due to the nature of software today, you wind up with all of these in your organization, and now if any of them are compromised you have a problem. I'd rather engineers from all of those organizations worked on OpenSSL (or whatever) to make it as secure as possible, perhaps forking it occasionally to solve some particular problem and then merging the code later.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  43. Re:not just many eyes by orlanz · · Score: 2

    I think reuse is far more secure than multiple options. In the long run. Reuse will find more bugs and make it more aware. Reuse will have a much larger impact, but that just ups the priority to get it fixed. Multiple options will only decrease the impact but will open up for duplicate bugs, finding less of them, more entropy for fragmentation, and less priority & longer time for getting them fixed. Multiple options will be less secure... you just won't think it is.

  44. Even the hills have eyes by WaffleMonster · · Score: 1

    I have never been a believer open source code is automatically more secure. Different projects have different code quality. Depends on if/how they are managed and who all is willing to step up contribute their time and effort.

    There have been some advantages unique to open source projects such as static analysis vendors developing, testing and marketing their wares blessing a huge swatch of open source land with the fruits of their labor as well as the ability for savvy users to evaluate willingness to use software based on observation of code quality which can be difficult to discern from commercial software.

    Yet for the most part for most of us mortals the end result is simply a function of who is willing to step up and contribute what.

  45. Mo Code, Mo Problems by TiggertheMad · · Score: 4, Insightful

    I agree that more diversity in the software ecosystem will cause critical bugs to have less impact to the world overall, and will hopefully drive competition to make the offerings more efficient and stable. However I think that this is a straw-man and the real conclusion we should draw is this:

    When you write code, you are going to screw up. If you aren't writing bugs that people notice, you aren't working on anything worthwhile. While the bugs that were found were costly and dangerous, the question is were these found quicker than a closed source solution? Were they fixed faster than a closed source solution? Is there anything that can be done to allow quicker roll back or disabling of vulnerable features? When you write code, you need to design for failure, because it will happen and plan so that the recovery will be as quick as possible.

    Adding additional software library offerings will only add stability in the sense that one particular vector wont affect as much of the Internet, but you introduce more surface area for attackers to poke at, and more vulnerabilities overall. Given the challenges to write really solid code, I think I'd like to have fewer, but really well vetted open source software solutions. Of course, I am not correct in this opinion, as there are no 'right' decisions here.

    --

    HA! I just wasted some of your bandwidth with a frivolous sig!
  46. Signed, Every Developer Ever by Tenebrousedge · · Score: 1

    No, you should feel contrite that you are daring to report a bug in software that is obviously perfect. There are two classes of software error: hardware error, and user error. In the first case, you shouldn't have bought that in the first place, so it reduces to the second case. Our QA process will take advantage of this breakthrough, but the documentation will not be updated.

    --
    Those who advocate genocide deserve every protection afforded by law, and none afforded by common human decency.
    1. Re:Signed, Every Developer Ever by Immerman · · Score: 1

      As a long-time developer, I must disagree. There are of course excessively vocal assholes in the field whose fragile ego will brook no argument, but you'll never get to be *good* with that attitude, no matter how many high-paying jobs it lands you working for similarly egotistical assholes whose self-image requires conflating egotism with competence.

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
  47. Re:not just many eyes by Teckla · · Score: 1

    Very few people or organizations are likely to be able to securely implement their own version of TLS.

    Security and Complexity are enemies. Call me paranoid, but given recent revelations, I suspect TLS was purposefully made complex--so that any implementation was likely to have bugs that could be found and exploited.

    Secure communication shouldn't be, and doesn't have to be, so mind-bendingly complex. It should be relatively easy to implement secure communication libraries. It should be fall-off-a-log easy to use said libraries, so that software developers can get client/client apps, client/server apps, and even server/server apps communicating over a secure channel without needing 20 years of security experience first. The code examples showing how it's done should fit on a single printed page.

    Until the (purposeful?) complexity is ejected, secure communication will continue to be a fantasy.

  48. Re:not just many eyes by Teckla · · Score: 2

    TLS is the issue. It isn't simple. It isn't even secure in many compliant configurations. It invites implementation errors.
    A good spec of a secure protocol would make secure implementations easy. If you don't think about the implementability while you're writing a spec, you're doomed, like TLS is.

    Well said! You deserve +5, Insightful. Get on it, mods!

  49. BS - We've known about this for years - Proof? by cuebei · · Score: 1

    Security researchers have known about vulnerabilities in third-party components for years. Anytime you increase the attack surface of an application through the use of third-party components (commercial or open source), you're potentially introducing vulnerabilities that you didn't create. A formal study was conducted by Aspect Security in 2012. https://www.aspectsecurity.com... which illustrates how big of a problem this actually is. Up until this time, the security community always knew it was a problem, but didn't have much stats to back up their claims. This research (as well as other data points) was essential for OWASP to introduce a new category in the OWASP Top Ten 2013 - A9: Using Components with Known Vulnerabilities. 2014 was not "the year we learned how vulnerable third party code libraries are". It was the year that organizations which had no security best practices in place, paid a much higher price than organizations that did.

  50. Computer Science still newb by cfalcon · · Score: 1

    Computer Science is still a newbie discipline. Much more relevantly, the problems introduced by the sudden social change of what a network is are a pretty big deal.

    Here's how you know it's crazy: look at the hacker hysteria, and how it has barely gotten any better. The vast majority of "hackers" who cracked stuff back in the day were treated entirely ludicrously, like some kind of wizard. Everyone here probably remembers indefinite detention and ludicrous punishments such as "can't use a computer", which would be absolutely unthinkable for even a bank robber who had served his time.

    If you piped your water supply through every enemy state in the world, you would probably want to inspect it before handing it out as drinkable. But, if you did not do that inspection, would you complain about the pipe manufacturers, for not making a pipe no one could interact with? Like, "why isn't this pipe adamantium"? And would you ignore all the enemy nations and go throw in jail the guy who put green food coloring in to show that an actual bad guy could have done something much worse?

    The other big thing is how fast expectations change. Every few years someone has rigged up a specialized framework that solves some set of "needed for profit" set of network issues, and then the advantages of that force migration towards it. While in theory each of these individual solutions could be highly secure, the fact that they are new features hurts that a whole lot.

    As people decide on a feature set that they actually need for certain purposes, and finally discard the idea that something is bad because it is old, we will start to see really solid code that is trusted. In MANY places, we already HAVE this.

    More importantly, in disciplines whose lengths of existence rounds to millenia instead of decades (network security) or a century (computer science), you have things that "everyone knows", and those things have been true for generations. Meanwhile, in computer science, you see holy wars wrapped in holy wars, and a lot of it is due to communication issues.

  51. Security Bugs are Different by Capt.Albatross · · Score: 1

    When everybody has the same goal, as is pretty much the case for usability issues, the shallowness of bugs posited by the many eyes hypothesis would be a good thing. When it comes to security issues, it sets up a race between the white hats and the black hats, and there is more incentive for the black hats (collectively, the rest of us have as much incentive as do the black hats, but that is not the case individually - for one thing, an attacker satisfies his goal by finding just one vulnerability.)

  52. Re:Ok a challengen to you... APK by rubycodez · · Score: 1

    Your manner of writing and your choice of idioms and colloquialisms reveal you to be about half my age; those from my era have a different "look and feel" as it were. Refine your abilities as a poseur, so they will shine in the darkness like a luminescent swamp gas.

  53. Not a myth by Tough+Love · · Score: 1

    Which Linux user actually got hacked by a library vulnerability this year? Speak up now. Oh, hmm, the sound of silence. Certainly not me, and not anyone I know of.

    The thing is, sometimes the many eyes just aren't pointed in the right direction. A publicly disclosed vulnerability changes that instantly, hundreds or thousands of expert eyes to got work, fixes happen fast, and the community learns from the incident, often resulting in the eradication of a whole class of risks.

    --
    When all you have is a hammer, every problem starts to look like a thumb.
  54. Re:"Run, Forrest: RUN!!!", lmao... apk by Oligonicella · · Score: 1

    Give us a name and some links so we can check your assertions.

  55. Re:LOL, bullshit... apk by Oligonicella · · Score: 1

    You do understand that we all think this AC and apk's AC are the same poster pretending to be supporting, right?

  56. Vulnerable Third-Party Code Libraries .. by lippydude · · Score: 1

    What are the number of developers who worked on OpenSSL?

  57. Re:"Run, Forrest: RUN!!!", lmao... apk by rubycodez · · Score: 1

    Do provide links to your identity, so we may marvel at your accomplishments and technical acumen.

  58. Re:not just many eyes by umghhh · · Score: 1

    Life is complex too and it is good so. It is also this complexity that developed as a response to viruses and bacteria. It is probably unavoidable. Connection to interwebs means you are connected to all hackers of the world at once. Using common software means that they had eternity to find weak spots. The cheap and good enough protection that nature had to this problem was complexity and dynamic adaptation to agents of destruction. Theoretically we could develop those things well enough if we tried hard enough but bean counters and our own laziness being forces of nature prevented such positive development.

  59. Re:not just many eyes by Darinbob · · Score: 1

    One difference is that if you use openssl and someone finds a huge bug then it gets fixed. If you've got the proprietary library and it has bugs you will never be told about them and if there are patches you'll have to wait many months to get them (or worse they'll require you to pay to buy an upgrade, you won't ever be able to backport fixes). So yes you may have a dozen solutions, but only 1 out of 12 probably lets you learn about severe vulnerabilities in a timely manner while also letting you supply your own fix. Maybe 3 out of 12 let your in house expert examine the code. Most won't give you free critical patches and definitely won't provide patches for older versions. We have the variety of solutions already however what we need is a variety of open source solutions.

  60. Re:not just many eyes by binarylarry · · Score: 1

    Cool story bro.

    --
    Mod me down, my New Earth Global Warmingist friends!
  61. Poe's Law by Tenebrousedge · · Score: 1

    I'm sorry, one or both of us (depending on how that error is scored) has fallen victim to Poe's Law. If high-paying jobs are a result of egotism I may have to try it some day. For the present I suppose I'll have to send off for another batch of <sarcasm> tags.

    --
    Those who advocate genocide deserve every protection afforded by law, and none afforded by common human decency.
    1. Re:Poe's Law by Immerman · · Score: 1

      Heh.

      Well, take a look at... well basically the entire financial industry for starters. A generally egotistical bunch convinced that their obscene salaries are a reflection of the value they contribute - despite the fact that, statistically speaking, virtually all of them would be outperformed by random number generators.

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
  62. Re:Ok (where's yours, "Forrest"?)... apk by rubycodez · · Score: 1

    The only thing you have blown is any shred of credibility

  63. The Internet is insecure by AndyCanfield · · Score: 1

    2014 was the year we learned that the Internet is insecure. Not a library, not a router, not a hacker, the whole Internet is insecure. There are British security experts building it up, and Japanese security experts tearing it down. Putting nude pictures of yourself on any cloud site is just plain stupid. GIving your credit card number at any prompt is just asking for hacking. The NSA reads your e-mail, and if they didn't the KGB would. I can encrypt my e-mail, but very few people have keys, and what back doors are built in to my encryption software?

    If I have to send someone a user name and password, I send the user name via e-mail and the password via SMS. It is unlikely that anyone has hacked both.

    Face it: the Internet is not secure.

  64. Re:not just many eyes by bigtreeman · · Score: 1

    hang on those dozen packages might still be reliant on the same broken library.

    --
    Go well
  65. Re:Not a myth by WaffleMonster · · Score: 1

    Which Linux user actually got hacked by a library vulnerability this year?

    Strange how this device creeps up now and then in unexpected contexts.

    Well I can't think of one... so that must mean nobody? ...... Right? No harm in drawing conclusions as my experience is a good enough proxy for the remainder of the world.

    The thing is, sometimes the many eyes just aren't pointed in the right direction. A publicly disclosed vulnerability changes that instantly, hundreds or thousands of expert eyes to got work, fixes happen fast, and the community learns from the incident, often resulting in the eradication of a whole class of risks.

    All of these new eyeballs must have forgotten to update the OpenSSL change log with their contributions.

  66. Re: not just many eyes by WaffleMonster · · Score: 1

    The obvious solution is formally verified code. The airline industry can produce it, so it's not outrageously difficult to do. It is expensive, but so is patching SSL after getting hacked every year or so.

    This wouldn't be the same industry busy rolling out untrusted "NextGen" navigation and communications standards?

  67. Re:No the code just sucks by WorBlux · · Score: 1

    Pretty much this. Open source works, but only when you can actually get eyes looking at the code. If you incorporate mission-critical software that works good enough already, you're not likley to be motivated to get involved with the project. The BSD's are sort of a cathederal project, but looking at all the parts systematically is usefull to see problem areas before they blow up in your face.

  68. Spin by wildriver · · Score: 1

    The heartbleed incident does not disprove that 'given enough eyeballs all bugs are shallow'. Instead, it proves the importance of Open Source software. It also illustrates the disadvantage of not having an enormous marketing machine that can spin such incidents. Instead of calling this bug 'catastrophic', we should have called this 'an opportunity to further improve server security'...

  69. Re:LMAO even more (Android flaws, anyone?) by goarilla · · Score: 1

    grow up !

  70. Re:No the code just sucks by Dan+Ost · · Score: 1

    So now that someone has identified ugliness in the Bash code, is an effort being made to clean things up?

    --

    *sigh* back to work...
  71. Question the CONCEPT by SwabianEngineer · · Score: 1

    SSL/TLS is so massively complex I have serious doubts it can be made bug-free. Do we REALLY need this concept ? Cant we just use much more simple symmetric ciphers ? My feeling is the IT industry has been conceptually pwned. We are already very deep in a rabbit hole and its name is "SSL/TLS".

  72. Re:not just many eyes by dkf · · Score: 1

    "Don't roll your own security" is advice aimed at people who don't know about security. Some of us have to implement and 'roll' the specs. The world looks different when your reputation is tied to your stuff not get broken before senility sets in. You can do it right, but you need all the elements in place including a well thought out spec.

    A good start is to have some sort of test suite. When implementing a spec, TDD is very much the way to go. You should also try to make sure you've got tests for all the failure modes that you expect (including all the ones in the spec). Yes, that can be devilishly hard. Do it anyway.

    --
    "Little does he know, but there is no 'I' in 'Idiot'!"
  73. Yawn by SwabianEngineer · · Score: 1

    Wake me up when you have discovered a different free enterprise system.

  74. Indeed, Mr BEANCOUNTER by SwabianEngineer · · Score: 1

    Whenever I hear "metric", I know it is MBA bullshit. Long known as Beancounting. "you can only manage the beans you can count" and similar mantras. Let me pose a little question: How do you "measure" the number of bugs not yet discovered ?? Stop worshipping to pseudo-science from the social engineers.

    1. Re:Indeed, Mr BEANCOUNTER by Virtucon · · Score: 1

      You choose the yardstick then. Unfortunately just throwing your arms up and saying that it's not solvable doesn't help the cause. While the industry has disdain for the cowboy coding methodology we should somehow allow critical frameworks to get a free pass and not have some sort of quality measurement in terms of vulnerability testing? If they do get a free pass then then people who adopt them have no room to bitch or complain when they're compromised because somebody didn't apply a little critical thinking to their testing or design.

      --
      Harrison's Postulate - "For every action there is an equal and opposite criticism"
  75. Re:Not a myth by SwabianEngineer · · Score: 1

    We could technically have simple, Enigma-style cipher machines in every household. But that would threaten the power base of the military so this will never fly. Their buddies in Saudi-Arabia will make sure.

  76. It's an open source myth by yacc143 · · Score: 1

    Because the closed source shops prefer not to discuss these issues. And have you've seen our new glossy product folder, our lowpaid code monkeys^H^H^H^H^H^H^H^H^H^H^H^Hsuperb software development gurus don't make mistakes. No sorry, for whatever reason the legal department does not allows us to give you any warranty on our software.

  77. Re:not just many eyes by lsatenstein · · Score: 1

    The security of the open source model isn't really the problem or the answer here. The problem is homogeneity. A million different sites and applications rely on just a few libraries, so that when a bug hits one, it has massive impact on the entire internet.

    We also know that the answer isn't in rolling your own security. Very few people or organizations are likely to be able to securely implement their own version of TLS. Even the best packages of today didn't start out perfect, they had to iterate through several flaws to get to where they are today.

    So perhaps the better answer is in having more packages to choose from? Instead of picking just openssl by default, it would be better to have a broad array of choices. With a dozen packages on the market, that might mean 11 times out of 12 the bad guys wouldn't exploit our site. If the packages are interchangeable, we'd be better positioned to switch them quickly in case of emergency.

    Today, disk space is very cheap. Memory is very cheap, and I think nothing of having 32gigs of ram. My point-- do away with dynamic linking for your application. Do static linking, except possibly for display libraries. If a flaw is found, its going to require many recompiles, but that is offset by the non-reliance of multiple dynamically linked libraries. As was mentioned, get a flaw or security issue with that library, or create a "man in the middle" attack with one dynamically linked library, and voila, your security is compromised. With static linking, your application is more secure and is known to work with more versions of the operating systems

    --
    Leslie Satenstein Montreal Quebec Canada
  78. Re:not just many eyes by plover · · Score: 1

    I look at it as a methodology to spread the risk.

    We've had a few packages dominate the landscape, and each of them has had some of the best and the brightest people looking at it, reviewing it, analyzing it, looking for flaws, running code analysis, fuzzers, everything. We've done exactly what you've said: we dedicated resources to develop a single (or few) libraries. Yet they still have flaws.

    I don't believe the perfection-alone-model works, because there is no evidence that it does. So far we have evidence that every commercial-grade protocol and implementation has had some kind of security flaw. Therefore we need to stop believing that we can engineer our way out of the situation, because we haven't. We need a completely different and complementary approach. We need to better manage the risk of failure.

    To me it doesn't matter why someone would choose a particular library over another, only that we don't all put our eggs in the one basket. The evidence suggests they're all going to fail at some point; it's only a matter of when.

    --
    John
  79. You FOSS tards are delusional by johncandale · · Score: 1

    Then why are their so many more mission critical program ending bugs in FOSS software then closed source?

  80. Re: not just many eyes by stoatwblr · · Score: 1

    Or 11 more sets of programmers to go over the existing code.

    The shallowness issue isn't to do with the number of eyes using the code, it's the number of eyes looking at the internals.

    The vast majority of "legacy code" has _never_ been audited. Everyone assumes "Someone else already did this. It's safe"

    I've had that exact argument raised by managers (many of whom are computing greybeards who should know better) as reasons for sticking with legacy code instead of moving to newer packages. The stupid thing is that they continue to raise this argument and be proven wrong (the glaring X11 bugs being a classic case - they fell out within minutes of someone going "I wonder if?" and hitting the source with a basic static analyser)

    The opensource code base is enormous but even a couple of small projects systematically looking for the low hanging fruit would be better than status quo. You can pretty much guarantee that blackhats are already doing this but they have no interest in publicising the results.

  81. Re: not just many eyes by stoatwblr · · Score: 1

    There's also a strange mentality at work.

    Many years ago, as a DNS admin I discovered that BIND interprets IP addresses in the configuration files with leading 0s as octal.

    This is an explicit violation of the RFC (which states that IP addresses are dotted decimals) and as such I posted about it on Bugtraq

    Instead of it being fixed, there was a flamewar. Several people (including Bind's author, who was also the RFC author) pointed out that 0xNNN also works and claimed that "it's supposed to work this way".

    When I pointed out the RFC paragraph and stated that either the RFC or the code needed to be altered so that everything was consistent, the response was a flamefest.

    Not long after that, spammers and others started posting URLS of long decimals, binary, octal and various other formats.

    That flaw is STILL in bind, and STILL catching out DNS admins who try 0-padding their config files for readability - and the RFC has never been altered.