Slashdot Mirror


DARPA-Funded Linux Security Hub Withers

mAriuZ writes "Initially funded by a grant from the Pentagon's DARPA, the Sardonix project aspired to replace the Linux security review process with a public website that meticulously tracks which code has been audited for security holes, and by whom. As conceived by Crispin Cowan, Sardonix was to attract volunteer auditors by automatically ranking them according to the amount of code they've examined, and the number of security holes they've found. Auditors would lose points if a subsequent audit by someone else turned up bugs they missed. ... In the end, though, nobody showed up."

44 of 281 comments (clear)

  1. If a tree falls in a forrest... by Zeinfeld · · Score: 5, Funny

    If there is a bug in the kernel and nobody notices it, can we still flame Microsoft?

    --
    Looking for an Information Security student project suggestion?
    Try http://dotcrimeManifesto.com/
    1. Re:If a tree falls in a forrest... by mattjb0010 · · Score: 3, Funny

      What is a forrest ?

      It's like a box of chocolates.

  2. Really? by Limburgher · · Score: 3, Funny

    NOBODY showed up? I would think having a high Sardonix rating would be a nice piece of "hacker-street-cred", like a low /. ID number, or running Linux on a beowulf cluster of 286s.

    --

    You are not the customer.

    1. Re:Really? by alexandre · · Score: 5, Funny

      So, next time i get an interview i should mention my /. ID ? :-)

    2. Re:Really? by Jason+Earl · · Score: 3, Interesting

      The free market beat them to the punch. Why play for Sardonix "street-cred" when you can start your own security company. Most security companies do a fair share of the advertising on the existing security mailing lists.

      Besides which, the Linux Kernel Mailing Lists already purport to do the same thing. You think that the Linux kernel hackers don't think that they are already creating secure code? By the time a security bug gets through the LKML's brutal peer review the chances that some outsider gunning for "street cred" is going to find it is essentially nil. Why join Sardonix when you can pile right in to the LKML?

    3. Re:Really? by Saeed+al-Sahaf · · Score: 5, Funny

      Holy shit. 53? Your prospective boss should bow down! I assumed that most of the first 1000 where DEAD by now...

      --
      "Who are in control, they are not in control of anything - they don't even control themselves!" - Glen Beck
    4. Re:Really? by rampant+mac · · Score: 4, Funny
      "NOBODY showed up? I would think having a high Sardonix rating would be a nice piece of "hacker-street-cred"

      This isn't Compton.

      You're not going to go on an interview and throw up your Linux "signs."

      Slackware beeyotch. Represent.

      apt-get 4 life, thug.

      Werd.

      --
      I like big butts and I cannot lie.
    5. Re:Really? by wrmrxxx · · Score: 5, Funny

      I'm always sure to mention mine. Has got me some really interesting job offers...

  3. DARPA "funded" !? by gtrubetskoy · · Score: 4, Insightful

    Our model is: review a whole body of code, eventually finding no bugs, and receive a deeper level of appreciation from people who use the code.

    I'm sorry, appreciation does not pay bills.

    1. Re:DARPA "funded" !? by Seahawk91 · · Score: 3, Insightful

      Multi-billion dollar budget and this is for the "bragging rights". Please!!!! If they let go a few crumbs as a prize for .... say, $100k at the end of the year for the best ranked.... you could not beat the takers off with a stick.

      Just my two cents...since Darpa won't give me $100k...or 2 dollars. I want my two dollars.

  4. never heard of it! by Anonymous Coward · · Score: 5, Interesting

    Well, maybe they needed a little more exposure, eh?

    I'm a sysadmin that secures plenty of mission-critical Linux (and FreeBSD) boxes, and I *thought* I kept on top of all the security news, I'd never heard of this project!

    Oh well! Try try again...

  5. Let's be honest by Anonymous Coward · · Score: 5, Insightful

    Auditing is boring. If you've got the skills to audit, you'd probably be much happier writing the code yourself.

    1. Re:Let's be honest by Mysteray · · Score: 3, Informative

      What the AC in post #8154783 seemed to be trying to say is that the leader of the OpenBSD project turned off network-accessible services in the default install, is not forthcoming with the details of these security-related modifications, and acts in a self-promotional manner.

      I don't actually agree with this characterization of OpenBSD; I'm simply trying to provide a translation for the curious. I don't think the AC is using stunningly effective debate technique, either.

    2. Re:Let's be honest by Mr2cents · · Score: 4, Funny

      Auditing is boring.

      Don't forget we live in a world where people collect stamps..

      --
      "It's too bad that stupidity isn't painful." - Anton LaVey
  6. Still A Good Idea by Naked+Chef · · Score: 5, Insightful

    Whose time may eventually come. Part of the problems is, as the article mentions, the "Bugtraq" mentality - people are only interested in the flashy big bugs, not the little ones that "only" increase stability. The other problem seems to simply be one of logistics, which the web site apparently didn't sort out. People are already doing this, on a smaller scale. How to get it into a single group under this Sardonix name without duplicating effort? Still difficult. I'd look for it again, in another form, in a few years :)

  7. Thankless task indeed . . . by Mysteray · · Score: 5, Interesting
    Two years after its hopeful launch, a U.S.-backed research project aimed at drawing skilled eyeballs to the thankless task of open-source security auditing is prepared to throw in the towel.

    It does seem to be a thankless task. For a new guy on a project, criticizing the leaders' work doesn't seem a good way to gain influence. For an old contributor, you might feel compelled to add functionality the userbase is demanding.

    Interestingly, the OpenBSD project has put a lot of effort into auditing, and they also have a reputation of being somewhat, um, "grouchy". I wonder if there's some correlation?

    1. Re:Thankless task indeed . . . by Mysteray · · Score: 3, Insightful
      Didn't OpenBSD get kicked off DARPA funding too?

      Hmm, you're right it did. I don't think there was an official reason given, but many attribute it to the OpenBSD leader saying less-than-supportive things about American military policy.

      Or I suppose it could be that DARPA simply doesn't want people to have genuinely secure software. But that would be a conspiracy theory, wouldn't it?

  8. No reason to play the NSA game... by Saeed+al-Sahaf · · Score: 4, Interesting
    As conceived by Crispin Cowan, Sardonix was to attract volunteer auditors by automatically ranking them according to the amount of code they've examined, and the number of security holes they've found. Auditors would lose points if a subsequent audit by someone else turned up bugs they missed. ... In the end, though, nobody showed up.

    Perhaps this is because for most of the (incredibly smart) people who make contributions to Linux kernel development, it's not about points? Now if they had attached MONEY value to those points, maybe the result would have been different; I mean at least SOME motivation to play the NSA game.

    --
    "Who are in control, they are not in control of anything - they don't even control themselves!" - Glen Beck
  9. If a project falls.... by RedLeg · · Score: 4, Interesting
    If a project fails, and nobody's ever even heard of it, has it really failed?

    I know Crispin Cowan personally, and I have never heard of this project! Maybe some of the DARPA funding should have gone to advertising, publicity, or (God forbid) Marketing?

  10. Securityfocus batting .500 by AndroidCat · · Score: 5, Interesting
    I guess they couldn't decide how to spell Cris Cowan/Cowen's last name so they alternated.

    They should have a volunteer review process to catch spelling mistakes...

    --
    One line blog. I hear that they're called Twitters now.
  11. Re:Classic misdirection by tealover · · Score: 4, Funny

    What size tin-hat do you wear? You might want to try a larger size.

    --
    -- You see, there would be these conclusions that you could jump to
  12. Re:Classic misdirection by Introspective · · Score: 5, Informative

    I don't think so. The NSA released SELinux as source code, it has been reviewed by many people and adopted into the 2.6 kernel. It would be rather difficult to sneak in "hundreds if not thousands of pre-programmed exploits" into the Linux kernel.

    Check the FAQ

  13. You are right by Anonymous Coward · · Score: 4, Insightful

    Your post was Classic misdirection. Also known as FUD.

  14. Definition of root word tells all. by mikeophile · · Score: 3, Interesting
    Sardonic

    sardonic (sar-dnk) adj.

    Scornfully or cynically mocking.

    See Synonyms at sarcastic.

  15. Re:Classic misdirection by tealover · · Score: 3, Insightful

    Where's the misdirection then?

    If they have such considerable resources that they can catalog all the vulnerabilities of Windows and Linux systems, why go through the charade? They can just perform their calculcations heind the scene.

    You sound like a typical paranoid nerd.

    --
    -- You see, there would be these conclusions that you could jump to
  16. Doomed from the start by realmolo · · Score: 5, Insightful

    Here's what they were asking for: WANTED- Extremely experienced Linux coders, familiar with all aspects of security, to verify others undocumented code, so that the federal government doesn't have to do it themselves. Salary starts at 0 dollars per year. Benefits include- No health care No 401k

  17. geek.paranoia++; by RalphBNumbers · · Score: 5, Insightful

    So they wanted people to do possibly the most tedious and unpleasant task in software engineering, over and over, for free, outside of the established (and frankly much more interesting, because they usually involve something besides solitary code reviewing) channels, and they're supprised they didn't get a flood of volunteers?

    Not to mention the job is thankless, it's an infinite loop of paranoia and nit-picking.

    code.insecure = true;
    While(code.insecure) {
    geek.paranoia++;
    geek.review(code);
    }

    --
    "The worst tyrannies were the ones where a governance required its own logic on every embedded node." - Vernor Vinge
  18. Re:Classic misdirection by tealover · · Score: 3, Insightful

    It's so incredible, with all the evidence of government deceit and treachery all around us that we would still have people giving them the benefit of the doubt!

    I know! It's very exciting, isn't it!


    Power corrupts, and absolute power corrupts absolutely, and our government is as close to wielding absolute power as anyone ever has.


    I know! Who knows, they may even invent a device that allows them to maintain communictation even in the event of a nuclear war, allowing them to continue to assemble and attack some more !

    And you want to trust them to coordinate auditing open-source software? I can't imagine a more naive posture to take!

    Tell me about it! Letting them get their hands on Open-Source software where everyone can look at and review the code ! It's downright scary !

    --
    -- You see, there would be these conclusions that you could jump to
  19. Re:Classic misdirection by NixLuver · · Score: 5, Insightful
    Hrm... So you assert that SELinux fixes trivial security issues in order to encourage users to select Linux (less secure) over OpenBSD (more secure), and all this without introducing any trojan code into SELinux.

    The question I have is this: If there are hundreds of invisible exploits in the SELinux kernel, how are we to know that the same situation doesn't exist in OpenBSD?

    Furthermore, how are we to be certain that OpenBSD (oft touted as the most secure OS in the world, and I'll certainly grant it's one of the most secure out of the box OS's I've ever seen) isn't some clandestine creation of the NSA created to lull paranoid psychotics into believing that they were secured against intrusion?

  20. Re:DARPA "funded" !? SETI @ Home by gtrubetskoy · · Score: 4, Insightful
    If they could just find a way to tap into _that_ enthusiasm.

    Ah give me a break!

    As someone who has written open source software, I can tell you that there is no enthusiasm that you "tap into".

    When you are an agency that is part of a department of the government whose budget is in the billions (or is it trillions?), no sane "enthusiast" is going to do jack for you for "appreciation", especially when you are a military organization...

    But even if this wasn't DOD we were talking about, I find the assumption that people will perform valuable services for simple recognition just plain weird. People who think this way just don't get it - you want someone to do something for you, you pay for it.

    When I feel like releasing code to the public is a good idea, I will do it, but don't think that I am some sort of an OSS monkey who jumps at every opportunity to work for free!

  21. Maybe nobody took the idea seriously by qtp · · Score: 4, Funny
    And with a name like "Sardonix" who could blame them:

    ~$ dict -d wn sardonic
    1 definition found

    From WordNet (r) 2.0 (August 2003) [wn]:

    sardonic
    adj : disdainfully or ironically humorous; scornful and mocking;"his rebellion is the bitter, sardonic laughter of all great satirists"- Frank Schoenberner; "a wry pleasure to be...reminded of all that one is missing"- Irwin Edman [syn: {wry}]
    --
    Read, L
  22. Too low profile by adamsc · · Score: 4, Informative

    I follow the security community pretty closely, monitor a fair number of techie news sites and otherwise try to stay aware of this sort of thing. The first I heard of the project was this story - I must have missed it the last time it was mentioned two years ago. Not many sites linked to sardonix.org after the initial news stories, either.

    1. Re:Too low profile by AndroidCat · · Score: 4, Interesting

      Perhaps the seven responses to the original story should have been a tipoff that raising visibility of the project would have been a good idea. (Of course, that would have risked coming on too strong.)

      --
      One line blog. I hear that they're called Twitters now.
  23. Project remit: appropriation increase? by Lucius+Sour · · Score: 3, Interesting

    A lot of government and military projects have the sole purpose of attracting money to, or showing deference to whatever fashioanble political/buzzword compliant initiative that has sway that week. This isn't news to slashdotters, I know, but I wonder what real hopes the project had, or was it one of those "impress the boss and get a cheque to swell the department" projects. It seems that's the way things work in the government service and industry these days. Whatever happened to doing the bloody job?

    --

    Hands up everyone who refuses to obey orders.

  24. Re:Really? Haha by Venner · · Score: 3, Funny

    I didn't create an account on slashdot until almost a year after I'd first started visiting and I have this horribly high UID to show for it. Who could have known that, years later, a low UID would be such a symbol of power, fear, and respect!

    I'm glad I didn't have to say that in person; I couldn't possibly have kept a straight face :-)

    --
    A preposition is a terrible thing to end a sentence with.
  25. Re:Classic misdirection by Muggins+the+Mad · · Score: 3, Informative
    So you assert that SELinux fixes trivial security issues...
    I never asserted anything of the kind. SELinux is about implementing access control, which has little if anthing to do with enhancing the kind of security being discussed here, i.e., getting root.

    But access control is very much related to stopping exploits. A good set of access controls (SELinux or LIDS or RSBAC or the like) means that when, say, apache gets exploited, the attacker can't do any real damage and certainly can't fork a command shell.

    It means that when your mail client gets exploited through an attachment type hole, the executed attachment can't access your address book or send mail itself. All good stuff.

    It also means that very few programs need to be run as root thus providing even fewer avenues for the attacker to use.

    - Muggins the Mad
  26. Sardonyx is NOT a good name for this project. by 0x1337 · · Score: 3, Funny

    Who can blame the project for having failed, when it was named for the famous "stone of all bad" Sardonyx, i.e. Chtrag Sardius, the opposite of the Orb, or Chtrag Yaska?

    Who 'lead' the project, Ctuchik The Grolim High Priest?

    ------>

    Ok, ok... I'm a dork. Read David Eddings' "Belgariad" and "Malloreon" though - they make for a great read.

  27. Re:Classic misdirection by NixLuver · · Score: 3, Insightful
    I never asserted anything of the kind. SELinux is about implementing access control, which has little if anthing to do with enhancing the kind of security being discussed here, i.e., getting root.

    Well, this would indicate to me that you have no idea what issues SELinux might or might not address. Perhaps you should research the topics of your closely held opinions somewhat. From the FAQ:

    It [SELinux] has no concept of a "root" super-user, and does not share the well-known shortcomings of the traditional Linux security mechanisms (such as a dependence on setuid/setgid binaries).

    I would say this rather soundly addresses the concept of "getting root", wouldn't you?

    Linux tends to be more focused on utility and performance.

    This is exactly the situation that SELinux hopes to address, isn't it?

    The question you should be asking yourself is why organizations like the NSA and DARPA, which are after all dedicated to eavesdropping and intelligence gathering, would want to spend time and resources making the computer systems of target nations more secure.

    Come on, that one is too easy... the security of the parent system has absolutely nothing to do with the security of an isolated data stream - i.e., email, instant messenger, http, ftp - you name it. SELinux also does little to address the security of daemons like, say, MySQL - it simply isolates the components so that a compromise of the apache code doesn't translate to a compromise of the system.

    There is also the fact that the NSA and DARPA don't have to work to compromise our security - after all, the RIAA and MPAA may engineer us into a government-controlled cryptographic system with government (or copyright holder!) held keys - for Intellectual Properties enforcement, of course.

  28. It never helped me get started by bluGill · · Score: 4, Interesting

    I visited the site a few times, but didn't see anything to help me get started. Just some "we need to get project X reviewed". Then a complex point system that sounded motivating, but didn't do anything.

    I just wanted to get started. All they said was "read this code and look for problems". No duh, but how about some examples. Some help. I'd learn much more if 30 people read one file, each commented on it, and I could read them all. Once I learn to think of everything 30 people think of (who have expirence reading code) I'll do some more on my own. Nothing gets me started though. I'm an okay programer (better than most really, but that isn't saying much considering the typical programer I've seen), and I need to learn how to do this. How do expert code reviewers think?

    I just got back from wineconf, Alexander personally reads every single line that is commited to Wine. I know it can be done, but I need expirence before I could possibly do that, and noone bootstraps me to get the expirence.

    I understand this is a hard thing. I've developed before, and I can't document my code any better than anyone else. They made it their stated goal to help me, but then never did anything useful.

  29. Shoe's On The Other Foot by Dark+Bard · · Score: 3, Interesting

    Very interesting attitude. I've gotten into several very heated exchanges on Slashdot concerning copyrights. The universal answer was copyright laws favor the artists too much and they should do it out of love and there's nothing wrong with downloading music and movies for free even if it robs the artist. I was given the pious example of people writing open source code for free. I was never given an example of how they were suppose to feed themselves while they worked for free. Now I hear code writers should aways be paid for their work even if it's for the benefit of all. Feels different when the shoes on the other foot. If all intellectual property should be free why aren't code writers working for free and working at the local 7 eleven to pay their bills? I realize no one wants to hear this and I'm sure this post will get a low mod because it's tradition to kill the messenger but you can't have it both ways. Everyone has a right to earn a living and working for free or giving away your work ain't going to pay the bills. I'm thrilled people write open source code for free. Artist often work for free and work a disturbing number of unpaid hours. The hardest thing for an artist is generally getting some one to pay for their work in the first place. Free market basically works, inspite of a few bumps. Change the law and allow people to go into a famer's field and pick the crops without paying and see how quick people give up on farming. Sorry there's no difference.

  30. Augment, Not "Replace" by Crispin+Cowan · · Score: 5, Insightful
    The /. story says that Sardonix "aspired to replace the Linux security review process. This is not true, and it doesn't even say that in Poulsen's article. Sardonix sought to augment existing software auditing practices, trying to give more credit to people doing the work, and more clearly document the work done. Sardonix was also about open source software in general, and not the Linux kernel in particular.

    Crispin
    ----
    Crispin Cowan, Ph.D.
    CTO, Immunix Inc.

  31. Re:Classic misdirection by hangareighteen · · Score: 4, Insightful
    The question you should be asking yourself is why organizations like the NSA and DARPA, which are after all dedicated to eavesdropping and intelligence gathering, would want to spend time and resources making the computer systems of target nations more secure.

    I would say it's a strech to call the Defence Advanced Research Projects Agency an organization dedicated to eavesdropping and intelligence gathering. Their entire purpose is simply to research things that might be useful to the Department of Defence; however, I will grant you that a large part of what the DoD does is intelligence gathering and eavesdropping -- but it's part of their job, and they don't really shy away from telling the citizens that. On top of all that, if you're going to be so overly paranoid about government involvement in public projects, then why in the hell are you using the internet anyways? It began its life as a DARPA project, as research into self-healing networks.

    Also, the NSA isn't dedicated to eavesdropping or intelligence gathering. If you read their original charter, it seems that it was originally created to help organize and distribute intelligence information gathered from the various intelligence agencies working for the US. That isn't all they do either, as this country has changed and their existence become more widely known, their role has changed somehwat as well. Specifically, they also play a role in securing this country (meaning it's citizens, businesses and government) from foreign attack, espionage, and intelligence gathering/manipulation. They are, after all, the National Security Agency.

    So, as part of the ideal of securing the nation, they decided that it would be a good idea to make a highly securable operating system available to the public (meaning it's citizens, businesses and government) for free. Given that, it's not too hard to see why they chose Linux as their candidate: It's already available freely, it's already somewhat securely designed, and already implements a unix-style user-based security model. Not only that, but they realized for the system to be truly secure, that it's source code and thus it's development also had to be open to the public and freely available.

    I don't think there is any doubt that the NSA has been entirely up front with everyone on this. If it weren't the case, there is no way that the SELinux security model would be included in Linux today, and I don't see any directives from the Ministry Of Coding demanding it's implementation. On the other point, the DARPA was just throwing around some research money (it's what they do best) and decided that this project might turn out something useful; they were wrong, but it didn't really seem as if they had any opportunity for misdirection anyways.

  32. A few reasons why... by slamb · · Score: 4, Insightful
    There are a few reasons why this project never took off:

    First, they widely advertised it and then took forever to get the site going. I think most people had forgotten about it or given up on it by that point. And then they never publicized it again. (Specifically, it was initially slashdotted on 6 Feb 2002. On 13 Oct 2002, a message on the Sardonix mailing list mentioned that it had been mostly live for a couple weeks, and that the point system still wasn't online. No wider announcement.)

    Second, all the packages listed there for review were fairly well-respected blocks of code written by skilled coders. Consequently, most of the reviews were of the form "yup, this code essentially looks good". They were also extremely large projects, so people said "I didn't do a full review; I just tried this automated tool". It doesn't really mesh up with what he said in the article:

    Cowen believes Sardonix was a casualty of security community culture, which he says rewards researchers who find clever or splashy holes in a program, but not for making software more secure. "The Bugtraq model is: find a bug, win a prize -- a modest amount of fame," says Cowen. "Our model is: review a whole body of code, eventually finding no bugs, and receive a deeper level of appreciation from people who use the code.

    "It seems the Sardonix lesson is people don't want to play this game, they want to play the Bugtraq game."

    There was no "making software more secure [...] eventually finding no bugs"; I don't think anyone ever really found a significant bug through this project.

    If they had targeted lots of small projects on freshmeat (like web stuff - PHP, mod_perl, JSP/servlet, etc.), it would have been much more interesting. Those projects have all kinds of security bugs. They could have taught the people in question some good security practices and actually accomplished what they set out to do. Maybe they would have eventually branched out into certifying these infrastructure projects, but it wasn't a good initial goal.

    Lastly, who knows they did with that DARPA funding. Plenty of open source projects with no funding do much more impressive works than that website, and in much less time, too.

  33. code audits by Tom · · Score: 3, Insightful

    This is then the 3rd or 4th Linux code audit project to fail. (I was a participant in 2 others)

    Why? Because auditing code is

    * difficult and tricky
    * unrewarding
    * lots of hard work

    It simply isn't something you want to do unless you are as passionate and fanatic about your project as the OpenBSD guys are.

    --
    Assorted stuff I do sometimes: Lemuria.org