Slashdot Mirror


Security — Open Vs. Closed

AlexGr points out an article in ACM Queue, "Open vs. Closed," in which Richard Ford prods at all the unknowns and grey areas in the question: is the open source or the closed source model more secure? While Ford notes that "there is no better way to start an argument among a group of developers than proclaiming Operating System A to be 'more secure' than Operating System B," he goes on to provide a nuanced and intelligent discussion on the subject, which includes guidelines as to where the use of "security through obscurity" may be appropriate.

31 of 101 comments (clear)

  1. What does slashdot think? by Anonymous Coward · · Score: 5, Funny

    I wonder which side slashdot will take in this argument...

    1. Re:What does slashdot think? by mopower70 · · Score: 2, Funny

      Operating System B! We are definitely, firmly on the side of Operating System B!

  2. endless debate by cpearson · · Score: 3, Insightful

    Applications and systems developed that are developed rapidly by a small set of programmers would benifit from closed source security especially when producing software for small niches. Systems that are developed on a large scale and mission critial applications benefit from open source models because that can utilize a large tester base.

    Vista Forum

    --
    Windows Vista Help Forum
    1. Re:endless debate by HomelessInLaJolla · · Score: 3, Insightful

      Systems that are developed on a large scale and mission critial applications benefit from open source m0dels because that can utilize a large tester base I see it in terms of receiving what was paid for.

      A program which costs $200 (typified as the industry and closed source) should not be relying on the consumer to be the (security) beta testers.

      A program which costs nothing, or only a nominal amount (typified as FOSS), is able to ethically rely on the consumer base to be (security) beta testers.

      If I paid for it then it should work (shouldn't break/shouldn't be so easily exploitable). If I didn't pay for it then I should expect to make a contribution.

      Right now the industry is addicted to charging production quality prices for beta (even alpha) quality software.
      --
      the NPG electrode was replaced with carbon blac
  3. closed source is just one aspect by fred+fleenblat · · Score: 5, Insightful

    Businesses that choose to develop closed-source software seem to also choose to ship code prematurely, to over-provision with extra features, to decide on features for marketing rather than security or quality reasons, and generally compromise the product in multiple ways. In that light, closed source isn't itself the security problem, it's just an indicator that there probably are other problems lurking.

    1. Re:closed source is just one aspect by ThinkFr33ly · · Score: 3, Interesting

      But those same companies are at the mercy of consumers, just like anybody else. If there is enough bad press due to the poor security of the product, the company will be forced to fix things. This is especially true for companies that sell software to large corporations.

      Microsoft really is a case in point. They did a lot of what you described, got nailed for it by the press, by consumers, and by corporations, and they really did change their ways. Their Secure Development Lifecycle has turned out some pretty high quality releases. For instance, IIS 6 has far fewer vulnerabilities than Apache. One certainly couldn't say that for IIS 5.

    2. Re:closed source is just one aspect by VolciMaster · · Score: 2, Interesting

      For instance, IIS 6 has far fewer vulnerabilities than Apache. One certainly couldn't say that for IIS 5.

      I've never heard anyone quote such a stat. Where does said statistic come from

    3. Re:closed source is just one aspect by ThinkFr33ly · · Score: 2, Informative

      See: http://blogs.msdn.com/michael_howard/archive/2004/ 10/15/242966.aspx
      See: http://rmh.blogs.com/weblog/2005/05/is_microsoft_i i.html

      Those posts are somewhat old, but the trend apparently continues if you go check Secunia, or your favorite vulnerability lists.

  4. Simple by Anonymous Coward · · Score: 4, Insightful

    The Operating System most secure is the Operating System less used.

    1. Re:Simple by Marillion · · Score: 2, Interesting

      I don't agree.

      The central server for a system of airport flight information display screens (FIDS) where I once worked ran an operating system called iRMX. It had pathetic security. The only thing that kept that system secure was the lock on the door to the room.

      --
      This is a boring sig
    2. Re:Simple by bssteph · · Score: 2, Funny

      The Operating System most secure is the Operating System less used.

      I've written the most secure operating system in the world. No, you can't have it. I forgot where I put it.

    3. Re:Simple by CastrTroy · · Score: 2, Interesting

      Why wouldn't people want to use a secure operating system? I know you're trying to say that the vulnerabilities only show up once the people try to break the system, and crackers only try to break popular systems. However, I don't believe that it's a tautology that a system has to have vulnerabilities. If they developed a system that actually didn't have vulnerabilities, and actually ran all the necessary software, then wouldn't everybody start using that? I think the only thing holding back Linux is good hardware and software support. The "operating system" including the kernel up to the desktop environment is very good. Only problem is that a lot of hardware doesn't work well, and there isn't a lot applications you can run that will run on windows.

      --

      Anthropic principle: We see the universe the way it is because if it were different we would not be here to see it.
    4. Re:Simple by $RANDOMLUSER · · Score: 3, Informative

      That was Intel's Realtime Multitasking eXecutive - a REAL TIME operating system. Security wasn't its job. You may as well ask how the security on QNX or a PLC is. Answer: nobody cares, as long as the I/O completes on time.

      --
      No folly is more costly than the folly of intolerant idealism. - Winston Churchill
  5. You Can't Know Which is More Secure by RAMMS+EIN · · Score: 4, Insightful

    With regards to the question which product is more secure, the only right answer is that you will never know. The problem is that you can't eliminate bias from a test that is supposed to assess this. Since a single product can't be both open source and closed source, you will always be comparing multiple products. As stated earlier, you can't reliably establish the relative security of these products, let alone attribute the result to open vs. closed source.

    --
    Please correct me if I got my facts wrong.
    1. Re:You Can't Know Which is More Secure by RAMMS+EIN · · Score: 4, Interesting

      ``This means there is no way to define a 'more secure' approach, and therefore all we can do is discuss individual products in comparison with one another.''

      And I'm saying that even that is pretty meaningless. Five vulnerabilities were fixed in Mozilla last week, and two in Opera. Which is more secure? Twelve new vulnerabilities have been discovered in Firefox, and one in Opera. Which is more secure? The Apache servers in our sample have been broken into 50 times during the course of our study, compared to 3 break ins for lighttpd. Which is more secure? A team of five experts found three vulnerabilities in the NT kernel and two in Linux. Which is more secure? Static analysis found 10000 possible vulnerabilities in Konqueror and Microsoft reports static analysis found 1000 possible vulnerabilities in MSIE. Which is more secure? Which of the mentioned products should you select, based on the given facts, if your goal is to minimize future break ins?

      I honestly don't know the answer to any of the questions I asked. I really think none of the (fictional) data I gave says anything about the relative security about the products it ostensibly pertains to. I _feel_ more secure running OpenBSD than Windows 2000, and, given the absense of reports of OpenBSD machines being broken into on a large scale, that feeling seems justified. But this is entirely based on something that I _don't_ know. I _don't_ know that OpenBSD machines are massively broken into, and thus, I feel safe. However, I also don't know that they are _not_ massively broken into, so my feeling could be entirely misplaced. I certainly don't know that there are no holes in OpenBSD, so even if it hasn't been massively exploited up to now, it could start tomorrow. All I have is the assurance of the developers that they make great efforts to improve security. I believe them, hope they are indeed doing so, and hope they are actually _achieving_ better security that way. But I don't _know_ that.

      --
      Please correct me if I got my facts wrong.
  6. The Quantity of the Eyes Isn't Always The Issue by ThinkFr33ly · · Score: 4, Insightful

    One supposed advantage of open source software is that, well, it's open. Everybody can take a look and see if the code has holes. The idea being that the more eyes that look at something, the greater a chance of somebody seeing bugs.

    But the quantity of eyes isn't always the issue. I could put the Linux kernel source code in front of 1 million six year olds, and there is very little chance any of them would find a single bug.

    Obviously, we're not talking about six year old eyes here, but continue the scenario. There are some types of bugs that even very experienced coders wouldn't necessarily spot. Not every kind of security hole is a simple buffer overflow. Some kinds of issues will really only be spotted by a highly trained and specialized set of eyes.

    Now, those highly trained eyes may be looking at the open source code, or they may not. All I'm saying is that the quote "Given enough eyeballs, all bugs are shallow" is not particularly accurate.

    1. Re:The Quantity of the Eyes Isn't Always The Issue by danpsmith · · Score: 3, Insightful

      Now, those highly trained eyes may be looking at the open source code, or they may not. All I'm saying is that the quote "Given enough eyeballs, all bugs are shallow" is not particularly accurate.

      I think, however, the "open source is more secure" argument tends to follow the idea that behind the scenes, the code under closed source applications tends to be generally faulty, or, at least, Windows code in particular. There could very well be many exploits that, given the code for MS Vista, amateur programmers could easily pick out, simply because the code base is so vast and the amount of people who have full access to it so few.

      It's just like if I write my own little closed source app, at first it may appear to be flawless to me because I am the only one seeing the code. But I might code in an inherently buggy way that would be easily picked up by another set of eyes. Then, as little problems flood in from end users, instead of fixing my coding methodology, I make little fixes to the code that are basically workarounds around perhaps solving a bigger problem that would require more time (something more fundamental to the way the program is structured). As an effect, the "patches" become more and more around fixing faults than providing the functionality intended in the first place. Whereas with open source, someone might've already just forked my project and coded the idea using different data structures or in a largely more efficient way.

      It's not to say that I couldn't be flawless, but, the odds decrease when nobody can see the results. Using closed source software is like running a car without access to the engine. You see things going wrong, but as far as why and how they are happening, if they are huge problems or only small ones, you can't determine without diving into the actual car's components directly. Closed source doesn't allow this. It's not just the fact that there are multiple eyes, then, it's the fact that those eyes are outside the original coder, potentially, sometimes even being the people having the problems themselves. It takes the "how do we recreate the bug?" discussion out, and oftentimes a sufficient end user can not only support his/herself, but improve the codebase.

      Honestly, seems like a better approach. The hard thing is you can't know which is more secure really. But in practice, let's be honest, Linux and OSS get fixed more quickly if they are a widely used project in the OSS community than MS products and "patch tuesday" where they schedule patch releases and recommend strange workarounds for existing security breaches.

      --
      Judges and senates have been bought for gold; Esteem and love were never to be sold.
  7. Well... by Zebra_X · · Score: 5, Funny

    While Ford notes that "there is no better way to start an argument among a group of developers than proclaiming Operating System A to be 'more secure' than Operating System B,"

    Unless of course Operating System A is Open BSD ;-)

  8. The Wrong Question by ThosLives · · Score: 5, Insightful

    This debate is all about the incorrect question. The reason is that code can be secure or not secure, regardless of its "open" or "closed" status.

    Until the industry realizes that "secure is secure" and stops worrying about the open or proprietary nature of things, this debate will probably prevent things from being as secure as they could be by diverting resources to an analysis rather than any solutions.

    Put another way: Is a homemade door more or less secure than a professionally installed door? My answer is "it depends on the skills of those involved and the quality of materials".

    The same applies to software.

    --
    "There are a dozen opinions on a matter until you know the truth. Then there is only one." - CS Lewis (paraprhase)
  9. Security by Obscurity by $RANDOMLUSER · · Score: 3, Interesting

    Is always a good first line of defense. At least it keeps out the riff-raff. Until someone smarter writes the scripts for them.

    --
    No folly is more costly than the folly of intolerant idealism. - Winston Churchill
  10. I have a pre-canned explanation of open vs closed by Rosco+P.+Coltrane · · Score: 4, Insightful

    Closed security: the Titanic is unsinkable - White Star line
    Open security: the Titanic's hull is made of brittle metal and thus isn't safe - Independent safety inspector

    --
    "A door is what a dog is perpetually on the wrong side of" - Ogden Nash
  11. My Take by RAMMS+EIN · · Score: 4, Interesting

    The same old argument for openness applies to open source. You have to assume the black hats will find and try to exploit vulnerabilities. Without that assumption, there isn't much to worry about. But given that the black hats will find vulnerabilities and use them, the best thing we can do is to make sure the white hats find the vulnerabilities, too. This way, the vulnerabilities can be fixed or worked around (e.g. through firewalls). The vulnerabilities exist whether or not you know about them, but, if you know about them, you can take adequate measures. Open source makes it easier to find vulnerabilities, and thus, to know about vulnerabilities.

    Of course, open source also makes it easier for the black hats to find the vulnerabilities. So there's an arms race here. If the black hats find the vulnerability first, they can exploit it before it gets patched or worked around. If the white hats find it first, it can be fixed or worked around before it is exploited. The same arms race exists for closed source and open source, but, in the case of closed source software, the developers are (supposedly) the only ones with the source code, which gives them a slight edge in the arms race.

    So it seems that both open source and closed source have advantages and disadvantages when it comes to security. Furthermore, I think that both arguments are theoretical, and the advantages that both models have are not always exploited. Having the source available does not help if no white hats are actually auditing it. And this is why open source wins, in my book. With open source, if you're concerned about vulnerabilities in the software and don't trust the rest of the world to have done proper audits and notified you about the results, you can do your own audit. If the developers of the software don't fix the vulnerabilities to your satisfaction, you can do so yourself. With closed source, you are at the mercy of the vendor. If they don't do proper audits, you're out of luck. If they don't fix vulnerabilities, you're out of luck.

    Proprietary software vendors do not always have your best interests in mind. It's not unusual for vendors to keep silent about vulnerabilities found and/or fixed in their software, and some vendors have even threatened or sued people who have disclosed vulnerabilities in the vendor's software. The reputation is more important than the _actual_ security of the product, because the actual security is unknowable. With open source, such tacticts don't work. The source is out there, anyone can find the vulnerabilties and assess the security for themselves. If things are fixed, anyone can make a diff between the two versions and see what was fixed. They can't keep the information from you. Your security benefits from that.

    --
    Please correct me if I got my facts wrong.
  12. His rule of thumb is useful. by Kadin2048 · · Score: 4, Insightful
    Actually, his conclusion contains a far more useful test, although it does boil down to common sense:

    The difference between these cases is simple: determinism. In the case of the encryption software, the outcome is deterministic. Knowing everything about the mechanism doesn't compromise the security of the outcome. In contrast, for antivirus software the system is heuristic. As such, some things benefit from disclosure, and some things don't. In these two cases, it's obvious. Unfortunately, that's the exception, not the rule. The problem is that many systems contain aspects that are heuristic and aspects that are deterministic.
    In essence, the question is to ask whether closing the source really results in any increased security; in the case of DRM systems (his example), it does, because they are broken by default and thus knowledge of the 'algorithm' allows the system to be cracked.

    Personally, I would argue that such 'heuristically secured' systems are broken by default, and that there are good reasons why generations of computer scientists have insisted that security through obscurity is meaningless. The "security" provided by such heuristics are of value only to marketing and legal departments, they are not and should not be confused with the security offered by 'deterministically secured' systems (e.g. cryptography is his example). Saying that an application is "secure," when it depends on an attacker not knowing how it works, borders on unethical false advertising.
    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  13. security through obscurity just another layer by straponego · · Score: 4, Insightful
    Okay, let's look at just one service, SSH. Without security through obscurity, you can do things like keep OpenSSH patched, use very good passwords, disallow root logins, restrict logins to certain users (which is kinda security through obscurity, but...)

    And on servers I run like that, I have yet to have a breakin, but I do get up to thousands of connection attempts from ssh worms, from the same servers, every day (well, they would if I stopped dropping them in iptables, but nevermind that). So it's possible that they could hit a user with a bad password, or one they got from another compromised machine.

    On other boxes, like my home box, I put SSH on a high-numbered port. In a couple of years I've had zero attempts hit that port. It would be quite stupid to rely only on this trick, ignoring good discipline in other areas. But as a supplementary layer, it's quite useful. If nothing else, it saves bandwidth.

    It's not sufficient, but it's not inherently bad.

    1. Re:security through obscurity just another layer by init100 · · Score: 2, Informative

      Without security through obscurity, you can do things like keep OpenSSH patched, use very good passwords, disallow root logins, restrict logins to certain users

      Not to mention disable password logins altogether, and only allow logins using a key pair (known as public key authentication in SSH terminology). This makes a password guessing attack impossible, and an attacker must either guess (or obtain in another way) your private key, or find a security vulnerability in the software itself. This approach is somewhat more cumbersome to administrate though, but very secure.

  14. OT: Things you can't ask about VMS. by Kadin2048 · · Score: 2, Interesting

    This is slightly off-topic, but a while back I got interested in OpenVMS, and VAX stuff in general. (I started doing some research because I thought I was going to get stuck doing some turd polishing of old mainframe software, but it never materialized. But by then I was just interested.) Even in hindsight (given that I think we can agree that UNIX-derivatives seem to have gained traction over VMS), it's extremely difficult to find any sort of rational comparisons of VAX/VMS and its architecture and design paradigms to that of UNIX. Whenever someone asks, the response is basically "don't ask, you don't want to start that." Nobody wants to talk about anything that might invite UNIX/VMS comparisons, because it will cause flamewars -- even though such a discussion, at this point, might be interesting and productive. (There are so many people around who aren't familiar with VMS, or anything other than Windows and UNIX, that any perspective besides those would be worthwhile.)

    At any rate, it struck me as interesting, because sometimes it's easy to assume that Windows/Linux (or Windows/Mac, or Windows/something) is the first Great OS War. But people have been getting emotionally attached to operating systems, probably as long as they have existed; and ever since, it has helped quash rational discussion, both through flamewars themselves, but also because of self-censorship that occurs, in order to try and prevent arguments.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  15. Re:My light fixtures are safe, really, trust me. by ninja_assault_kitten · · Score: 2, Informative

    Closed doesn't mean nobody has seen it. MS for example gives it source code to many 3rd parties for review and analysis. If source code is subject to extensive 3rd party review, closing it to the general public adds an additional layer of security. Security through Obsurity may not be a great stand alone security model, but as part of security indepth it can be. It should be used as one of many layers.

  16. The quality of the unknown eyes is what matters by jd · · Score: 2, Insightful
    With closed source and "security through obscurity", you do not know - nor have any means of knowing - who is examining the code, their qualifications, their abilities or their resources. The same is equally true of open source. The difference is that, for closed source, you eliminate your ability to either compensate for, or exploit, this unofficial work. It will happen - code is stolen all the time, even from companies as closed-up as Cisco - but even to acknowledge it could cause irreparable harm. The number of well-publicized cases is very small, compared to the number of cases that are shown later to have happened.

    Closed-source, then, offers no meaningful protection to the companies involved. Precisely because they have no objection to stealing from competitors, corporations who rely on trade secrets and security through obscurity invalidate the very model they are based upon. If you work on the basis of all people being corruptible, you cannot also work on the basis of people not being corruptible. If you abuse the trust of others, you will inevitably be subjct to the abuse of trust.

    Open source doesn't guarantee that the eyes looking at the code are of any particular quality, or that they'll give information back, or that they won't steal the code anyway. But at least you know the possibilities and accept them, you don't pretend they don't exist.

    In the end, the difference between the two models is that one deludes the managers into believing they have something nobody else has. Open Source has its own delusions - that the developers can do a damn thing if a corporation takes the code, patents it, and sues said developers into oblivion, for example. One could argue that both are virtually unsurvivable disasters and that you might as well go for the one that gets you the money and the groupies. On the other hand, the reality is that programmers don't make money (managers do) and the last geek known to have had groupies was Socrates.

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  17. Open security has to be more secure by 192939495969798999 · · Score: 4, Insightful

    If you can't prove it is secure by showing me how it works, then it's not secure. How do I know that there isn't some bolt in the back of the bank vault, or some skeleton key, unless you allow me to inspect it myself?

    Security by faith or by fact, which would you prefer?

    --
    stuff |
  18. Re:My light fixtures are safe, really, trust me. by TheLink · · Score: 2, Informative

    In my experience there is no big difference between the security of closed and open software.

    1) Even if the source code is available for people to check, if nobody else bothers checking but the author there's no difference right?
    2) It's the quality of the checking not the quantity. A billion stupid monkeys won't know the difference between good code or bad code.

    What you should do is see who made the stuff and what their track record is like.

    I can confidently say Firefox will continue to have regular security bugs for years, and that any claims that it is far more secure than IE are hype. The fact that it is written in an unsafe language and crashes regularly means it has both code quality issues and security issues. Don't even need to look at the source to tell.

    It seems as if that there are fewer than 10 people in the world who know how to code safely in C (or C++) AND actually do it.

    I'm definitely not one of them.

    --
  19. Re:Security = obscurity by TheMeuge · · Score: 2, Funny

    I think you've introduced a new concept here - security through incomprehensibility.