Slashdot Mirror


The Fedora-Red Hat Crisis

jammag writes "When Linux journalist Bruce Byfield tried to dig for details about the security breach in Fedora's servers, a Red Hat publicist told him the official statement — written in non-informative corporate-speak — was all he would get. In the wake of Red Hat's tight-lipped handling of the breach, even Fedora's board was unhappy, as Byfield details. He concludes: 'If Red Hat, one of the epitomes of a successful FOSS-based business, can ignore FOSS when to do so is corporately convenient, then what chance do we have that other companies — especially publicly-traded ones — will act any better?'"

263 comments

  1. Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 5, Insightful
    I liked the way that Debian handled its server breach, and the more recent SSL bug. They realized that their first responsibility was to the users. They knew that not just Debian but all Debian derivatives like Ubuntu would be effected, and that the best way to handle it was to publish the full details and what they were doing to fix them. They came out of both situations looking better than Red Hat has this time. And it's not what Fedora looks like. Red Hat obviously took control, shutting off outside reporting in a way that never would have flown with a real Open Source project rather than a company dominating an Open Source project, and thus Red Hat got the loss of credibility.

    The problem with a lot of corporate Open Source is that they ignore the ethical foundation of Open Source. And eventually we find out that Open Source isn't quite as good without the ethics.

    Bruce

    1. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 5, Interesting

      I pretty much agree: Fedora was obviously squelched by Red Hat corporate who was apparently afraid of the reaction of their paying customers. Despite the token board openings and motions about openness, after this nobody can pretend that Fedora is on anything but a *very* short leash held by Red Hat.

      On the one hand, as a user I found myself trusting that Fedora's infrastructure crew were plugging away and probably handling things about as well as could be. On the other hand, the vague statements and lack of hard facts was (and still is) disturbing.

      They should have come clean, and allowed the the community to vett their process.

      Ob-FUD [just to poking Bruce for fun]: If they do come forth with details, it will be interesting to see if it was an ssh key compromised by the Debian flaw that caused this mess.

    2. Re:Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 4, Interesting

      Ob-FUD [just to poking Bruce for fun]: If they do come forth with details, it will be interesting to see if it was an ssh key compromised by the Debian flaw that caused this mess.

      I got an email from Starfield a while back offering to re-key my SSL certificates because they had figured out that my original request was using Debian's compromised OpenSSL. I had already rekeyed by then.

      Thawte is Debian based. I wonder if they had a problem.

    3. Re:Consider Red Hat's response vs. Debian's by cryptoluddite · · Score: 1

      Did you consider that Red Hat may not have legally been able to give much more information? It probably took serious effort to compromise their system, more than some random hacker.

      You're touting Debian, but what I wonder is would they even know they were hacked? Last time their servers were compromised wasn't it like several months before they even discovered it? Seriously, what good is 'oss reporting' of the problem if it has gone undetected for months? IIRC there was at least one ~2003 and one ~2006, but I don't remember how long between hack, discovery, and recovery.

    4. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 1, Funny

      /. needs a +1 Bruce Perens option

    5. Re:Consider Red Hat's response vs. Debian's by atomic-penguin · · Score: 5, Interesting

      Thawte is Debian based. I wonder if they had a problem.

      I checked our Thawte keys/certs against the SSL blacklist released by Debian. I checked several from Thawte, and could not find a potential compromised key/cert.

      Also, we are a Red Hat customer. I have to agree, I prefer the way Debian handled their incident, versus the way this Red Hat incident is being handled. After reading the Red Hat Security Announcement the details are so vague, I am still not sure of the scope and reach of this vulnerability.

      --
      /^([Ss]ame [Bb]at (time, |channel.)){2}$/
    6. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 1, Funny

      Why not just give him a +5 karma bonus on every post?

      I also recommend adding a large red border to every post, and banner image containing the text: 'OMG! It's Bruce Perens!' flashing like a Las Vegas slot machine.

    7. Re:Consider Red Hat's response vs. Debian's by Elektroschock · · Score: 3, Insightful

      Bruse Byfield is a troll. So why debate his accusations?

      Yes, there are many problems: patents, open standards, dmca restrictions and so forth. But open source is still the best of all worlds.

      RedHat as a company applies the usual tactics but as a community member gives a lot. Sure corporations are vulnerable to money. Novell is a good example...

    8. Re:Consider Red Hat's response vs. Debian's by wumingzi · · Score: 3, Insightful

      I pretty much agree: Fedora was obviously squelched by Red Hat corporate who was apparently afraid of the reaction of their paying customers///////////// shareholders. Despite the token board openings and motions about openness, after this nobody can pretend that Fedora is on anything but a *very* short leash held by Red Hat.

      As they say on that snarky message board across town, fixed it for ya.

      As a publicly traded company, Red Hat's primary responsibility is to produce a profit for its shareholders. That is the law. If the officers of the company do anything which interferes with that solemn legal duty, they risk lawsuits, and even jail time for breach of fiduciary responsibility.

      If an overly open disclosure policy is perceived to affect future sales or the value of the brand (i.e. "goodwill"), legal will tell them to say nothing unless they are breaking a bigger law (i.e. gross negligence) by saying nothing.

      It's strange, but it makes money, which the law says is the only thing that matters.

    9. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      Why not just give him a +5 karma bonus on every post?

      I also recommend adding a large red border to every post, and banner image containing the text: 'OMG! It's Bruce Perens!' flashing like a Las Vegas slot machine.

      Your mauther's a slot.

    10. Re:Consider Red Hat's response vs. Debian's by rtfa-troll · · Score: 4, Insightful

      Reading between the lines, it seems there's an ongoing investigation into the incident and they aren't allowed to communicate. I'll wait until I know much more about this before I make my final decision on how RedHat behaved.

      --
      =~ s,(.*),<sarcasm>$1</sarcasm>,g if any_point_you_wish();
    11. Re:Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 4, Informative
      Red Hat has an accepted path to make vulnerability information available, through CERT. There are no super crackers or super vulnerabilities that you can't talk about. Probably it was like the Debian situation. Someone got sloppy and had their password sniffed. Then once on the system a privilege-escalation vulnerability was used.

      The Debian compromise lasted about two hours. The attacker had sniffed a developer password some time before then, but it wasn't until he could get root that he did anything dangerous, and he did stuff that revealed him to the site admins. The main problem was in the kernel, which had the privilege-escalation bug. Red Hat was vulnerable too.

      Bruce

    12. Re:Consider Red Hat's response vs. Debian's by the_B0fh · · Score: 0, Redundant

      Wow. You should be working in the elections - why debate the issues when you dismiss a person.

      Even better - redhat might suck, but all the other companies suck even more, so it's still ok...

      I have just lost a little more hope in this world.

    13. Re:Consider Red Hat's response vs. Debian's by Tubal-Cain · · Score: 1

      This is what the "Friend" feature is for.

    14. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      They knew that not just Debian but all Debian derivatives like Ubuntu would be effected

      I know that on average correct affect/effect use is a miss on /. but from Bruce? Sad times.

    15. Re:Consider Red Hat's response vs. Debian's by InlawBiker · · Score: 3, Insightful

      That is ridiculous. The law does certainly not say that making money is the only thing that matters. Companies private and public have a responsibility to act in an ethical manner. That's what Sarbanes Oxley and ethics officers are for. Besides that it's poor public relations. It would have been in Red Hat's best interest to disclose details. If they had then maybe their credibility wouldn't be called into question.

    16. Re:Consider Red Hat's response vs. Debian's by that+this+is+not+und · · Score: 3, Interesting

      Anybody who has been on Slashdot long enough knows that the reason UID numbers are emblazoned right up on the top of each comment was because of Bruce Perens' hissy fit when someone with a slightly misspelled copy of his name came on Slashdot and started masquerading as him (in a fashion to mock him, for the most part).

      Slashdot became ever so slightly less egalitarian that day, when 'UID cred' became something touted right up on the header of each comment.

      So here's a long belated: Thanks, Bruce.

    17. Re:Consider Red Hat's response vs. Debian's by hdparm · · Score: 3, Funny

      Collective anxiety on Slashdot is unbearable. We sure hope that the info will be available soon, so we can find out what your final decision is. No doubt, Red Hat feels the same.

    18. Re:Consider Red Hat's response vs. Debian's by cryptoluddite · · Score: 3, Informative

      According to reports, Debian detected one compromise because of a faulty rootkit that, props to the author, but it had many, many flaws. The other compromise was detected by a 'filesystem integrity check' -- if you think that inspires confidence in people then GTFO. Those hackers screwed up... basically Debian only discovered their systems were compromised by dumb luck and simplistic checks.

      This is why Debian isn't used by anybody even moderately serious about system security.

      Probably it was like the Debian situation. Someone got sloppy and had their password sniffed. Then once on the system a privilege-escalation vulnerability was used.

      "Probably" meaning "you hope", because it makes Debian look better by comparison. What you are engaging in is idle speculation, but what's known is that Red Hat are very serious about security.

    19. Re:Consider Red Hat's response vs. Debian's by Wheat · · Score: 2, Interesting

      If an overly open disclosure policy is perceived to affect future sales or the value of the brand (i.e. "goodwill"), legal will tell them to say nothing unless they are breaking a bigger law (i.e. gross negligence) by saying nothing.

      However, The Red Hat brand is synonymous with openness and trustworthiness - if they say nothing they could be affecting the value of their brand and breaking the law. But I've never studied any of the laws governing shareholder responsibility. Anyone with knowledge of these things care to comment on how these laws could be interpreted in this case?

    20. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      AC who wrote the parent here. Mods: are you so completely clueless that you can't see a joke.

      I wasn't even being sarcastic, it would be frickin' genius if Bruce Perens had a flashing banner. Better if the banner is obnoxious Flash, double-plus good (irony points) if it's a Silverlight banner.

    21. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      I think you mean the ethical foundations of Free Software. The foundations of Open Source are you and ESR trying to trick corporations into freeing their code.

    22. Re:Consider Red Hat's response vs. Debian's by anticlimate · · Score: 1

      Butterfingers!
      Sorry, I accidentally rated you Troll (was thinking on clicking Infomrative) - now I hope writing here will revert it...

    23. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 1, Insightful

      As a publicly traded company, Red Hat's primary responsibility is to produce a profit for its shareholders. That is the law. If the officers of the company do anything which interferes with that solemn legal duty, they risk lawsuits, and even jail time for breach of fiduciary responsibility.

      But nowhere does it say that it has to be short term profit at the cost of anything else, although CEOs and their ilk appear to understand it that way, since that is the way they themselves profit the most.

    24. Re:Consider Red Hat's response vs. Debian's by segedunum · · Score: 5, Insightful

      I liked the way that Debian handled its server breach, and the more recent SSL bug.

      Unfortunately, that uncovered something perhaps more serious at the heart of Debian. Stop hacking on stuff downstream that you don't have any real idea about and that will only affect you if it blows up. The SSL thing has been a disaster waiting to happen, and it will probably happen again.

    25. Re:Consider Red Hat's response vs. Debian's by michaelmuffin · · Score: 5, Informative

      That is ridiculous. The law does certainly not say that making money is the only thing that matters.

      i agree that it's ridiculous. it is however true.

      http://en.wikipedia.org/wiki/Dodge_v._Ford_Motor_Company

    26. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      Sorry for being a grammar nazi to THE Bruce Perens, however:
      +1 Insightful
      +1 Correct use of "it's"
      -1 Doesn't know the difference between "effect" and "affect"

    27. Re:Consider Red Hat's response vs. Debian's by 1u3hr · · Score: 2, Interesting
      That is ridiculous. The law does certainly not say that making money is the only thing that matters.
      i agree that it's ridiculous. it is however true.
      http://en.wikipedia.org/wiki/Dodge_v._Ford_Motor_Company

      Interesting article. However, that case was specifically about whether a company should invest in things, as opposed to paying dividends and maximising short-term income.

      To generalise this to "do nothing unless it's profitable" is a gross simplification, and I believe not justifiable. In the Red Hat case, the courses of action are not so simple. They are about the best thing for the reputation of the company and either course could be chosen, depending on the judgement of the executives. I really doubt a court could rule that being more open was damaging the interests of the shareholders.

      However, corporate assholes love to cite such cases as they shrug off any non-fiduciary considerations. Perhaps they should remember a later case that established that morality is not waived by being in a chain of command: Nuremberg Defence:

      "The fact that a person acted pursuant to order of his Government or of a superior does not relieve him from responsibility under international law, provided a moral choice was in fact possible to him."

    28. Re:Consider Red Hat's response vs. Debian's by Elektroschock · · Score: 2, Informative

      The point is that Byfield raises these issues on purposes, he makes them up.

    29. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      Oh, come on now, who modded this troll, he was obviously trying for +5 funny!

    30. Re:Consider Red Hat's response vs. Debian's by Enleth · · Score: 0, Flamebait

      basically Debian only discovered their systems were compromised by dumb luck and simplistic checks.

      Isn't that how you find security breaches? I mean, using, er "simplistic" checks, that aren't in fact that simplistic because they perform an extensive comparison of lots and lots of little details?

      Oh, I know - you don't do any integrity checks because you are *absolutely sure* no one would break into your servers, right? Well, that's an interesting approach to security, indeed. It's a pity it won't actually work.

      Nice trolling, but generalizations, "ad hominem" arguments, insults and Red Hat zealotry pretty much uncover it. Go away, troll. Shooo.

      Disclaimer: no, I'm not a Debian user. In fact, I don't like using Debian at all because of the dpkg and its frontends, there's not a single one that suited me.

      --
      This is Slashdot. Common sense is futile. You will be modded down.
    31. Re:Consider Red Hat's response vs. Debian's by mwlewis · · Score: 1

      But nowhere does it say that it has to be short term profit at the cost of anything else, although CEOs and their ilk appear to understand it that way, since that is the way they themselves profit the most.

      Agreed, but the reason for that is that shareholders (and prospective shareholders, analysts, etc) have made it loud and clear that short term (quarterly) results are the be all, end all. If investors could be put into a spectrum, from day trader to, say, Warren Buffet (Ok, no analogy is perfect, but if you have problems with this, just imagine I said something about cars), I'd say that the day trader end of the spectrum is generally having a greater effect than the Buffet side of the equation.

      --
      JOIN US FOR PONG!
    32. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 4, Interesting

      The reference to Dodge vs Ford is irrelevant. The claim was about the law. However, the problem in the Ford case was the company charter. The case was lost, because the Ford charter was about making money. The law simply said that Ford has to stick to its own charter. For instance, in Google's case the charter contains the famous "do no evil" bit, but obviously also the money-making part. Therefore, Google shareholders cannot complain if Google for moral reasons turns down a profit opportunity.

    33. Re:Consider Red Hat's response vs. Debian's by nimbius · · Score: 2

      agreed. ive been a fedora/redhat user for over 10 years, and i like the fedora project. The vague disclosure and corporate shoosh time overlord mentality taken by redhat is deplorable.

      this breech is obviously a larger problem, as the update servers have gone silent for the most part (i havent seen new packages in over 3 weeks.)
      after fedora 9 neutering its xen, going production with buggy kde, and losing openGL support in Xorg, my favorite distro has become rather dull and aggravating. now theres a mysterious security breech that, even on fedora forums has been whitewashed to corporate zombiespeak?

      this is the latest release from Jesse Keating at fedoraforum.com: "In a few hours, updates for Fedora 8 and Fedora 9 will start hitting mirrors. These updates are designed to transition users from our old repo locations to new locations that have all our updates re-signed with a new set of keys. Most users will simply need to apply the offered updates, and later apply any further updates, and verify/import the new GPG key.

      The process to getting new updates is two stage.
      Stage 1) Users configured to get updates from existing repos will see a small set of updates available in the next few hours/days. These updates include fedora-release, PackageKit, gnome-packagekit, and unique (for Fedora 8, only fedora-release is offered). These updates should be applied as soon as possible.

      Stage 2) Once the above updates have been applied, your update tools (yum, PackageKit, pirut) will see a new repository and a larger set of updates available. This is your new standard flow of updates, that will continue to see new updates as the lifetime of Fedora 8 and 9 progress.

      There will be further milestones in the future that involve redirection of release package repos to match that of updates, and removing of old gpg key from rpm trust."

      --
      Good people go to bed earlier.
    34. Re:Consider Red Hat's response vs. Debian's by shallot · · Score: 1

      This is why Debian isn't used by anybody even moderately serious about system security.

      what's known is that Red Hat are very serious about security.

      Your post could have really been worthy of a +5 Insightful moderation, had it not been for these blatant generalizations.

    35. Re:Consider Red Hat's response vs. Debian's by gbjbaanb · · Score: 1

      only discovered their systems were compromised by dumb luck and simplistic checks.

      yep, that's the way the world works. The alternative is total monitoring of everyone by erm.. robotic overloads.

      It reminds me of the old stories about terrorist atrocities prevented by the traffic cop who stopped the bad guys because their tail light was out.

      So Debian stopped the bads guys by a simple daily report from AIDE that checked /usr. Good. Job done. I'm sure RedHat have exactly the same security processes in place.

    36. Re:Consider Red Hat's response vs. Debian's by jareds · · Score: 1

      First, it's of course not literally true. For example, the law does not place making money above obeying the law.

      Second, it's not important to this case. There are rational reasons both for and against full disclosure (for example, disclosure helps the company's credibility). I doubt people incorporate in Delaware because its courts are prone to question the business judgment of management. Note that, according to your article, Ford "told his fellow shareholders that the value of this strategy to them was not a primary consideration in his plans", which probably helped prove their case.

    37. Re:Consider Red Hat's response vs. Debian's by ThePhilips · · Score: 1

      Case of TiVo is very different from RH's one. And for TiVo, as end user you have alternative to build your own appliance with MythTV. TiVo tries to protect its hardware on one side and follow its contract obligations to content distributors on another.

      With RH's governance and support strict guidelines, many users found themselves in situation they were with commercial *nices: do not touch anything, do not change anything, wait for us to do it.

      Having source code for RH is already meaningless, because if you would change something, they would (very likely) refuse to support you.

      With small/medium business being largest (by user count) user of RH, its focus on Fortune 100 companies, screws royally everybody else. And as small/medium business, you would never ever get the same treatment from RH as its Fortune 100 customers.

      Another difference is that nobody forces you to buy TiVo. But many companies literally have to use Fedora/buy RHEL because they have to be compatible with software stack their bigger partners are using. And running the same software is easiest way to accomplish that and only way which guarantees 100% trouble free relationships. That again is major regression from F/LOSS to ways of old proprietary *nices and M$Windows.

      --
      All hope abandon ye who enter here.
    38. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      Fanboism and flavorism apart, this is just the hugest historic failure of Linux servers, and just prove that Linux is insecure and cannot be used for anything, besides some sexless-geek playtoys.
      So, when is Apple coming forth with their server version? Time to destroy both Windows and Linux forever...

    39. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0
    40. Re:Consider Red Hat's response vs. Debian's by ThePhilips · · Score: 1

      And hey! It worked!! For at least one company: Apple

      Though I think Apple's reasons were quite different from being lobbied. Jobs once quoted saying that it's not his work to do products. His work is to keep business out of way of the engineers who do the products.

      Apple got many young graduates, many of whom worked before and grew up on Linux and BSD. And of course the people had something for F/LOSS and I personally think that Apple really understood the fact that most software layers in modern computers are pretty much standardized so it make no sense to reinvent the wheel. But what make sense is to try to take advantage of all what was already developed out there. Contributing back is also no-brainer and take little of time, while giving developers (otherwise hidden deep in corporate org-charts) some visible credit.

      --
      All hope abandon ye who enter here.
    41. Re:Consider Red Hat's response vs. Debian's by squidguy · · Score: 1

      As a publicly traded company, Red Hat's primary responsibility is to produce a profit for its shareholders. That is the law. ,

      Sounds like the boys from Redmond... Seriously, this has huge implications re trust and assurance. We, the /. Community have long pitched Red Hat as the mainstream solution to replace Windows in the enterprise and government. DoD, once a large user of Solaris and Windows, is increasing its RHEL use (still using Windows and Solaris too).

      PS - the statements other posters have made re Sarbanes Oxley are spot on.

    42. Re:Consider Red Hat's response vs. Debian's by OldHawk777 · · Score: 0

      "Debian handled their incident..."

      Management Incidence Response (MER) is frequently just another Single Point Of Obvious Failure (SPOOF) for Biz, hardware, software, services ... architectures.

      MIR SPOOF is reactionary, but most business/government models can only function at a MIR SPOOF level of competence (or is that incompetence).

      --
      Unaccountable leaders are masters, and unrepresented people are slaves. How do US and EU fare?
    43. Re:Consider Red Hat's response vs. Debian's by discord5 · · Score: 1

      Debian isn't used by anybody even moderately serious about system security

      Red Hat are very serious about security.

      You've managed to convince me. I mean, with those kind of arguments it's a wonder all my boxes aren't compromised by sheer arrogance and willpower alone.

      This super-hacker you speak of, surely he must exist purely out of those two elements alone. It's a good thing we're able to filter out sarcasm from the Internet with iptables these days, or we'd all be in serious trouble.

    44. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 1, Informative

      One noticable thing from the Debian breach is that we never knew anything about who did it. That is a failure. Possibly at the time of the incident handling, it was already a fact of life. Possibly it was a less bad failure than an alternative failure, but it's still bad. I'm hoping that RedHat is doing it's best to avoid that failure.

      If RedHat still hopes to find the people who did this, then the method those people used to crack systems may be critical evidence in correctly identifying them. A correct description of the method used gives lots of extra credibility to a criminal confession. Assuming RedHat or the FBI are still hoping to catch the people responsible for the breach there's a trade off they (or more likely, the investigating FBI officers; RedHat should have only limited say at this point if things have been done correctly) have to make; where information that might help both customers and the investigation is involved. However, an already known vulnerability, such as password sniffing, isn't something which they should be giving away.

      You keep repeating "breach". Let me; as a user of Ubuntu, Debian, CentOS, Fedora and RedHat (fully commercial; large install) just put this from my point of view. I have been told my packages, the ones RedHat officially distributed, were not breached. I've also found that, since I mostly followed RedHat and Fedora's security guidelines, I was reasonably able to verify that this wasn't a thing which could compromise me. If they aren't lying and are competent then, from my point of view, there is no known breach of RedHat Linux ; there was a breach of a server RedHat uses for internal development. There was a breach of the signing process. There was not a breach of the distribution (as was possible in the Debian 2003 breach) nor of the RedHat signing keys. Had this been MicroSoft, we would never have even heard that the problem happened.

      The most important thing here is that it wasn't an accident that I wasn't breached. The choice by RedHat to invest in a hardware signing key kept their key safe from the intruder. The choice to use staging and controls between signing and release kept the binaries that were generated from being distributed. Neither Debian (nor for that matter Fedora, CentOS or Ubuntu) have made the choices which kept me from being compromised.

      Personally, I think the RedHat comms was pretty bad. I think that there should have been a move clear initial message. When I thought that packages would be compromised I as pretty annoyed. When I found out they had good reason to believe no packages were compromised I managed to completely stop worrying. From my understanding no system following proper RedHat security procedures seems to have been compromised, so now that's clear reason to relax and slow down and wait some time.

      Bruce, you have done many good things for many people; I have lots of respect for many things you have done but right now you look like you are getting the boot in against a competitor whilst they are down and not able to answer. Please give them a little space yet. If you still feel the need to kick a bit, then a targetted list of questions that they should be able to answer even if an investigation is ongoing would be a better way of going at this. Run the list past an experienced forensic computer investigator and/or lawyer with appropriate background. Put the list up on your web site and formally ask RedHat to respond.

    45. Re:Consider Red Hat's response vs. Debian's by wanderingknight · · Score: 1

      I think you meant ESR.

    46. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      SO don't incorporate in Michigan and you'll be fine...

    47. Re:Consider Red Hat's response vs. Debian's by DoofusOfDeath · · Score: 2, Insightful

      Slashdot became ever so slightly less egalitarian that day, when 'UID cred' became something touted right up on the header of each comment.

      So here's a long belated: Thanks, Bruce.

      Like we about the opinion of a seven-digiter...

    48. Re:Consider Red Hat's response vs. Debian's by KGIII · · Score: 1

      A few of my customers use Thawte as their cert providers. When I learned of the issue I forwarded the information to them and they had their certificates regenerated. As far as I know they had all had them regenerated with little or no hassle. It took a few days for them all to get the process done but it was pretty painless.

      --
      "So long and thanks for all the fish."
    49. Re:Consider Red Hat's response vs. Debian's by rubycodez · · Score: 1

      Sarbanes Oxley is to protect against accounting scandals, you know, fraudulent money counting. It's all about money, and people who use the word "ethics" usually just mean conforming to a set of rules made by power and money grubbing dirtbags to control and take wealth away from dominated group of people.

    50. Re:Consider Red Hat's response vs. Debian's by KGIII · · Score: 1

      For instance, in Google's case the charter contains the famous "do no evil" bit, but obviously also the money-making part. Therefore, Google shareholders cannot complain if Google for moral reasons turns down a profit opportunity.

      A quick look says otherwise.

      Download PDF version:
      http://investor.google.com/pdf/cert_inc_082404.pdf

      Not sure what the mods where thinking.

      --
      "So long and thanks for all the fish."
    51. Re:Consider Red Hat's response vs. Debian's by vrmlguy · · Score: 3, Insightful
      --
      Nothing for 6-digit uids?
    52. Re:Consider Red Hat's response vs. Debian's by greg_barton · · Score: 0, Offtopic

      Slashdot became ever so slightly less egalitarian that day

      God, what a whiner.

      Fetch me my bucket, boy!

    53. Re:Consider Red Hat's response vs. Debian's by Alpha830RulZ · · Score: 2, Insightful

      Technically speaking, there isn't any law that says they have to maximize profits, it's a fiduciary responsibility, for which they could incur civil liability, and/or lose their jobs. They wouldn't be breaking any law to take action in favor of the users/customers/third parties, but the Board of Directors might choose to end their employment for doing so. Or not.

      Top level management has a lot of freedom in acting in the interests of the company. The main control is the Board of Directors removing them from management if the board disagrees with the approach.

      --
      I was taught to respect my elders. The trouble is, it's getting harder and harder to find some.
    54. Re:Consider Red Hat's response vs. Debian's by Alpha830RulZ · · Score: 1

      At least he used a complete, grammatically correct sentence. ;-)

      Oh, my kingdom for a verb...

      --
      I was taught to respect my elders. The trouble is, it's getting harder and harder to find some.
    55. Re:Consider Red Hat's response vs. Debian's by DoofusOfDeath · · Score: 1

      At least he used a complete, grammatically correct sentence. ;-)

      Oh, my kingdom for a verb...

      Oh, my kingdom for the ability to go back and edit stupid typos on /. :)

    56. Re:Consider Red Hat's response vs. Debian's by Znork · · Score: 1

      agree that it's ridiculous. it is however true.

      However, the executive and board gets to decide what they think is the most profitable strategy. Business judgment, as is. The law may prevent outright deliberate destruction of shareholder value, but as long as the executive can reasonably motivate their decisions as being in the interest of the shareholders, long or short term, your options as a shareholder, if you disagree, is to sell the stock or vote to replace the executive.

      In the Dodge_v._Ford case you cite, the argument forwarded by Ford had very little to do with shareholder value. Had he done the exact same thing, but motivated it for purposes of expanding market share and increasing future production capacity to meet demand, with any altruistic or external motives being secondary and purely incidental to the business goals, it would probably have been ok.

    57. Re:Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 1
      One noticable thing from the Debian breach is that we never knew anything about who did it.

      Don't accuse an individual of perpetrating a security penetration unless you are doing so to the police and ultimately the district attorney. Just saying "X did it" outside of that context will get you sued, and you will lose because no conviction exists. The accused has the right to be tried by a jury of their peers, after all.

      The situation is different when you are talking about a security problem - not an individual - that may effect you. Yes, the entire problem this time has been in Red Hat's communications. When they communicate this way, they leave you with no way to verify what the problem actually was. And security is not about trusting others, you have to be able to verify yourself, because just trusting puts a potential failure point in your security system - not everyone is trustworthy, and big companies with conflicted interest are rather low on the list of potentially trustworthy entities. Consider HP, bigger than Red Hat, and the fact that their head attorney had to take the 5th in front of Congress. The situation is worse because some people (Fedora insiders, RH employees, customers they told under NDA) know the full details and potentially have power over your system that you would not like them to have.

      Bruce

    58. Re:Consider Red Hat's response vs. Debian's by oldhack · · Score: 1

      I thought down-stream hackability is the point of GPL. Whether a particular downstream modification is net plus or net minus, depends on the particulars, and Debian pays for its judgment. Also, if the Debian people "don't have a real idea about" a particular package, perhaps it should not even be included in the distribution.

      --
      Fuck systemd. Fuck Redhat. Fuck Soylent, too. Wait, scratch the last one.
    59. Re:Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 2, Informative
      The other compromise was detected by a 'filesystem integrity check'

      Debian runs the same security tools as any high-security organization. Indeed, they made some of the ones that others are using, and are in general the prototype for process among Linux distributions. They had a cryptographic trust network before other distributions, there was an SELinux version of Debian before Red Hat picked it up, etc.

    60. Re:Consider Red Hat's response vs. Debian's by Knara · · Score: 1

      "do nothing unless it's profitable" isn't the issue

      It is, "do not do anything that may negatively effect profits". It is, indeed, the overriding job of a public company to make money for its shareholders.

      I also agree this isn't necessarily a good thing (the relatively recent obsession with quarterly profits, for example, has basically destroyed long-term investments in things like R&D by companies in the US), but it is what it is.

    61. Re:Consider Red Hat's response vs. Debian's by bendodge · · Score: 0, Offtopic

      Perhaps it's just me, but I'm not so sure egalitarian is better for a site like Slashdot. :P

      --
      The government can't save you.
    62. Re:Consider Red Hat's response vs. Debian's by Knara · · Score: 1

      I'd mod you insightful if I could. Buffet was lucky in that he was working for a company and in a time, where his sort of investment was welcomed by his employer (and it obviously worked out well for him). These days it's all about quarterly profits and what not, and if you have a bunch of quarters where Carl Ichon is unhappy with how you've made his stock price behave, he throws a fit and goes on a rampage (for example).

      Long term thinking is not rewarded in public companies at the present time in the US, sadly.

    63. Re:Consider Red Hat's response vs. Debian's by Knara · · Score: 1

      Tee hee.

    64. Re:Consider Red Hat's response vs. Debian's by 1u3hr · · Score: 1
      It is, "do not do anything that may negatively effect profits"

      ANY act can "negatively [a]ffect profits". It's not at all clear, and not likely provable in a court, that being more open would do so, in any but the very short term.

    65. Re:Consider Red Hat's response vs. Debian's by againjj · · Score: 1

      http://en.wikipedia.org/wiki/Dodge_v._Ford_Motor_Company

      Interesting article. However, that case was specifically about whether a company should invest in things, as opposed to paying dividends and maximising short-term income.

      Not a good summary. Rather it was specifically about whether a for-profit company could be run for charitable purposes. A quote from the article:

      The Court was called upon to decide whether the minority shareholders could prevent Ford from operating the company for the charitable ends that he had declared.

    66. Re:Consider Red Hat's response vs. Debian's by HiThere · · Score: 1

      Sorry, but you have causal sequences in the wrong order. This short term perspective originated (well, was made acceptable by) the Harvard School of Business Administration.

      At the time it started to become acceptable, it was widely decried by prominent voices in the business community...but Harvard is a strong brand, and it was, indeed, buoyed by short-sighted investors and mobile executives (who didn't worry about what would happen to the company after they left). These acted to reinforce the short-termism, but they had always been present. But Harvard made they actions socially acceptable.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    67. Re:Consider Red Hat's response vs. Debian's by HiThere · · Score: 1

      I think you need to reread that post. The gp was in favor of Slashdot being less egalitarian.

      I can see many reasons why that's a good thing, but I commonly don't pay attention to User ID numbers anyway. (I consider karma points more significant...and I don't think they should top out at 50. [Maybe they don't anymore? Who could tell.])

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    68. Re:Consider Red Hat's response vs. Debian's by HiThere · · Score: 1

      What we know is that their communication was bafflegab.

      I agree that they might be constrained in what they could say, but they don't appear to have even said THAT. (I'd be more definite, but I don't intend to read their PR release again.)

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    69. Re:Consider Red Hat's response vs. Debian's by greg_barton · · Score: 1

      It is my perogative as a four digiter to ignore the contents of posts when I comment about them.

      (You also get to spell prerogative wrong.)

    70. Re:Consider Red Hat's response vs. Debian's by HiThere · · Score: 1

      There's good points here and bad points.

      Debian maintainers are various in understanding and skill, though they're usually pretty good. Unfortunately, the hack on the SSH package caused it to install and run without noticeable problems. So nobody looked at it carefully for a fairly long time. Eventually the problem was noticed, and the reason was clear. UGH, but it was clear. And it was fixed.

      For most packages, this kind of problem can't happen. If it doesn't work, it's pretty obvious, or easy to test for. (So there are regression tests.)

      But Debian distributes lots of packages that they don't really understand. If you don't understand that, then you should use something else (just what depends on your precise needs). Debian has lists of "orphaned packages" where they are looking for a volunteer maintainer. The criteria are that you've got to be willing to do the job and keep the package running as the system changes underneath you. Most maintainers *DON'T* understand the package that they are maintaining in any depth. They try to keep the bug fixes current, and are usually behind the most current version of the package that's being distributed. (Debian *testing* went to Python 2.5 this year, while Python is trying to get to 2.6/3.0 this year. And Python is a major package with lots of support.)

      If you don't want to accept how Debian does things, you should probably go to a major commercial Linux. They'll pretend that they understand all of the packages. Of course, they won't, and there won't be nearly as many packages, but they'll pretend for you, at a price.

      All that said, yes, the SSH package problem was a major blunder on the part of Debian. But once they noticed it, they handled it well.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    71. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      I'm fairly confident that I figured out what Redhats problem was and told them. The problem is that it requires a next release to fix because of its complexity and it will be fixed in the next release based on what I've already read. Exposing the problem at this time would put many at risk unnecessarily.

    72. Re:Consider Red Hat's response vs. Debian's by insllvn · · Score: 1

      Fantastic wikipedia article! Particularly this bit here.

      Your thoughts?

    73. Re:Consider Red Hat's response vs. Debian's by Knara · · Score: 1

      All anyone cares about these days is the short term, when it comes to "investing".

    74. Re:Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 1
      The UIDs were up there before I made the statement about the real Bruce having my UID, otherwise I would not have been able to make it.

      If anyone is to blame, it is Tio Paco for refusing to turn off posting privileges for users with handles that are obvious attempts to defraud regarding their own identity.

    75. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      Yes, it did work! And Apple's hardly a bastion of ethics--which further supports my point: it's fooling to talk about the ethical foundations of Open Source, especially after the term 'Free Software' was abandoned by the founders of Open Source specifically to hide the ethics.

    76. Re:Consider Red Hat's response vs. Debian's by michaelmuffin · · Score: 1

      Fantastic wikipedia article! Particularly this bit here.

      Your thoughts?

      i think that section was added today by the wikipedia user Vrmlguy. there is also a slashdot user vrmlguy taking part in this discussion. i shall instead attach my thoughts to his post here: http://slashdot.org/comments.pl?sid=959099&cid=24946229

    77. Re:Consider Red Hat's response vs. Debian's by michaelmuffin · · Score: 1

      GP is right and you are wrong.

      could be, i'm not an expert

    78. Re:Consider Red Hat's response vs. Debian's by lsatenstein · · Score: 1
      I believe that RH handled it the right way. The problem they encountered required decisive action. The changes to key certificates had to be programmed so that anyone downloading updates would be able to fetch them. It also meant a full recreation of the packages and many libraries. Coupled with those changes are the substantial amounts of testing to be done.

      By going wide open with the public, what would be gained? If the security breach was widespread, the other distributions would have been shutdown as well. As it is, they may be ignoring the problem until RH has the fixes well debugged.

      --
      Leslie Satenstein Montreal Quebec Canada
    79. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      Transparency Begets Trust.

    80. Re:Consider Red Hat's response vs. Debian's by cryptoluddite · · Score: 1

      Debian uses a hardware cryptography devices so that hackers can't get the key even if the systems are compromised?

      Debian has trusted servers not connected to the internet?

      Debian has systems with one function (hg, db, etc)?

      Debian has IDS software monitoring the network?

      Afaik those are all 'no' for debian and 'yes' for Red Hat. Tell me where I'm wrong...

    81. Re:Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 3, Informative

      Debian uses a hardware cryptography devices so that hackers can't get the key even if the systems are compromised?

      Last I checked, an eToken Pro cost less than $50. I have one on my keychain. It works with OpenSSL. I can sign with it, and the private key never leaves the device. This is not rocket science. Lots of folks use smartcards rather than the eToken to do this, the eToken is just smaller and doesn't require a reader.

      Debian has trusted servers not connected to the internet?

      "Server" is the wrong word here. Debian has non-writable resources that are used to check the writable, on-net resources. These are also available for individual Debian users to create for checking their own systems, using one of the Debian security packages that is available to everyone. This again is not rocket science, it's been really cheap and easy to do since CD writing became available.

      Debian has systems with one function (hg, db, etc)?

      Oh yes, for more than 10 years. Debian has lots of donations of system resources, meaning entire systems and network homes for them all over the world, and more money than it needs to do this stuff.

      Debian has IDS software monitoring the network?

      It's more than one network, since Debian has geographical diversity, but yes various Debian systems are behind IDS, and the packages for making your own IDS are part of Debian.

      You do know that you're talking about really basic security stuff, right?

    82. Re:Consider Red Hat's response vs. Debian's by Bruce+Perens · · Score: 2, Informative

      You should take a look at Debian's user security manual. This will give you some idea of how seriously they take it. Also, there's a lot of material under www.debian.org/security/ that is worth looking at.

    83. Re:Consider Red Hat's response vs. Debian's by Anonymous Coward · · Score: 0

      I meant "foolish".

  2. welcome to the world by timmarhy · · Score: 0, Troll
    maybe when your a bare foot long haired hippy like stallman you can afford the luxury of disclosing everything to the world, but when your a company with peoples futures and jobs on the line often its not a good idea to expose all of the details.

    frankly anyone who can't see that has never been in a real business situation before

    --
    If you mod me down, I will become more powerful than you can imagine....
    1. Re:welcome to the world by earnest+murderer · · Score: 3, Insightful

      It's happened numerous times. Consider the Bruce's comment regarding Debian above.

      Frankly "a real business situation" sounds a lot like a metaphor for covering your ass at other people's expense.

      --
      Platform advocacy is like choosing a favorite severely developmentally disabled child.
    2. Re:welcome to the world by robo_mojo · · Score: 5, Insightful

      "Frankly" when business is more important than the customer, often the business isn't worth a damn.

    3. Re:welcome to the world by sleeponthemic · · Score: 1

      "Frankly" when business is more important than the customer, often the business isn't worth a damn.

      I don't know who this Frank bloke is - but I'd like to smoke some of the plants in his garden.

      --
      I record my sleeptalking
    4. Re:welcome to the world by sweet_petunias_full_ · · Score: 2, Informative

      "Welcome to the world"

      Not exactly.

      "Welcome to another company controlled by lawyers."

      Fixed it for you.

      (And I even did it without shredding the evidence, NDA/gag orders, DMCA take down letters or all of the other CYA tactics peculiar to the legal profession.)

      --
      You can't send a takedown notice to an already printed newspaper.
    5. Re:welcome to the world by BiggerIsBetter · · Score: 1

      Frankly "a real business situation" sounds a lot like a metaphor for covering your ass at other people's expense.

      That would be "risk management" and yes, it's a real business situation and S.O.P. in many places. Bruce's comment about "taking control" is exactly what I would expect from Red Hat from a business angle. It's just not what's expected from a community angle, where issues like the Debian situation are played out in the public eye.

      --
      Forget thrust, drag, lift and weight. Airplanes fly because of money.
    6. Re:welcome to the world by Loki+P · · Score: 1

      But you're only talking about Red Hat's employees' futures and jobs. Instead, they should consider how many companies use their distribution, and consider all _those_ companies' employees' futures and jobs first.

      > "when your a company with peoples futures and jobs on the line often its not a good idea to expose all of the details"

    7. Re:welcome to the world by ckedge · · Score: 1

      > That would be "risk management"

      Whose risk does it manage?

      > it's a real business situation

      What the **** does that mean? It doesn't sound like a good thing. You know there are lots of "real business situations" where both the company and the company's customers LOSE because the "business men" are greedy morons or idiots or both.

      > S.O.P. in many places.

      Yeah, it's SOP for submarines to dive and airplanes to go up and come down...

      > is exactly what I would expect from Red Hat from a business angle

      Are you criticizing them, congratulating them, or making excuses?

      > It's just not what's expected from a community angle

      So if there's a community involved, somehow right and wrong and good and bad are different?

      I can't figure out what you mean to say, and so far you have said NOTHING of value. No offence, I honestly can't tell what you're saying.

    8. Re:welcome to the world by oldhack · · Score: 1

      > That would be "risk management" Whose risk does it manage?

      Risk of bad PR blowing up and getting their asses fired, what else? Stop being a pest. ;-)

      --
      Fuck systemd. Fuck Redhat. Fuck Soylent, too. Wait, scratch the last one.
  3. Press Releases... by Z34107 · · Score: 1

    A "Linux journalist" talking to a "publicist" was told to read the press release?

    I, too, without RTFA, would think most any company would be wary about talking about a recent server breach.

    But, it doesn't matter - it's all open source, you can look at the lines of code and verify for yourself that they're safe, right? Not like what you can('t) do with Windows.

    --
    DATABASE WOW WOW
    1. Re:Press Releases... by Martin+Blank · · Score: 2

      There are still ways to handle this which cover both the need to minimize chances of a recurrence and the desire of users to know what happened and whether they are also at risk. This could include specifying whether this was due to a software bug still under investigation, a configuration error which has been fixed, or possibly an internal sabotage. Exact details could remain forthcoming until such time as complete mitigating solutions are in place, especially if a patch needs to be released to handle it, which should take no more than a few weeks.

      --
      You can never go home again... but I guess you can shop there.
    2. Re:Press Releases... by FlyingBishop · · Score: 4, Informative
      No, you can't...

      This goes back to the whole "trusting trust" concept. You have no way of knowing if the source you've been given reflects the binary you're using, unless you yourself compiled it (and hand-crafted the compiler you're using in assembly, and made the assembly language for your CPU, and made your CPU, but those are a different discussion.)

      The point is, Red Hat signs their packages. If their signing mechanism has been compromised, it is quite conceivable that every single Red Hat package is untrustworthy. The dates on the packages are only as trustworthy as the key, so there is no beginning or end time for this: you must throw out all Red Hat packages on your system, because any could be compromised.

      Source really gives you very little assurance unless you compile it.

      If we want to look at this in contrast to Windows, there's not really any comparison, since we barely even begin to have a grasp of their Byzantine updating system, and couldn't even speculate as to the effects of a similar problem on their side.

    3. Re:Press Releases... by eggnoglatte · · Score: 4, Informative

      But, it doesn't matter - it's all open source, you can look at the lines of code and verify for yourself that they're safe, right?

      Wrong. I know this is common wisdom in the open source community, but it really isn't that simple when compilers are involved.

      The reason is that the hackers COULD potentially have modified the binary of the compiler used to bootstrap the whole RedHat distribution. You can modify the compiler such that it takes harmless code and compiles backdoors into it. In particular you could modify it so that it always propagates the change when it compiles a version of itself. Since every system bootstraps from an already compiled version of the compiler, a well hidden backdoor could propagate forever, unless people actually analyze the machine code.

      Read Ken Thompson's 1984(!) Turing Award lecture for the full nitty gritty details. This should be required reading for everybody in security (and all open source advocates, for that matter):

      http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.91.5728&rep=rep1&type=pdf
      (PDF)

    4. Re:Press Releases... by Elektroschock · · Score: 3, Insightful

      Yeah, but that is the techie paranoia.

      Just because something can be done doesn't mean it actually happens. If I go to holidays and leave the door of my house open, it does not mean that something actually happens.

      The point is, Red Hat signs their packages. If their signing mechanism has been compromised, it is quite conceivable that every single Red Hat package is untrustworthy.... you must throw out all Red Hat packages on your system, because any could be compromised.

      Nonsense. Why should you "trust" RedHat Packages signed by employees?

      The whole signing shit is a troll for the privacy church. What they forget are the proportions and what is really important. We know exactly that the problem didn't affect us in the past and it won't affect us in the future now we found out. No need to panic.

    5. Re:Press Releases... by cgenman · · Score: 1

      If we want to look at this in contrast to Windows, there's not really any comparison, since we barely even begin to have a grasp of their Byzantine updating system, and couldn't even speculate as to the effects of a similar problem on their side.

      Considering that signed executeables on windows has been a no-go for years, I think you're seeing the effects.

    6. Re:Press Releases... by saccade.com · · Score: 1

      If you want to understand just how scary a break-in like this is, read Ken Thompson's classic Turing Award Lecture, Reflections on Trusting Trust.

    7. Re:Press Releases... by BlortHorc · · Score: 1

      The whole signing shit is a troll for the privacy church. What they forget are the proportions and what is really important. We know exactly that the problem didn't affect us in the past and it won't affect us in the future now we found out. No need to panic.

      Wow. I can't really imagine a more concise way of saying "Never, ever consider hiring me for a technical role in any capacity at all". I mean, seriously.

    8. Re:Press Releases... by Elektroschock · · Score: 4, Insightful

      Nice try. The problem with Techies is that they don't get the larger picture. They focus on the blinking red herrings they are so used to and where they believe in.

      We are talking about a serious flaw of a security model. True. But consider that most people run operating systems where executables are not signed at all.

      There is no indication here at all that anyone externally found out about the problem before. It is basically that you found out that what you did over the last two years was vulnerable to potential attacks. How will it affect the future? Not at all, as the issue gets fixed.

      Ah, and right now no one unauthorised actually has the key yet. It is only technically possible to crack it much easier...

    9. Re:Press Releases... by TheRaven64 · · Score: 4, Informative

      This is why the GCC build process builds the compiler three times. First it builds it with the existing compiler. Next it builds it with the new version. Finally, it builds it with the version built with itself and compares the binaries. If the last two are different, then the old compiler is likely to have been trojaned.

      --
      I am TheRaven on Soylent News
    10. Re:Press Releases... by Thundersnatch · · Score: 1

      But consider that most people run operating systems where executables are not signed at all.

      No, most people run Windows, where most binaries are signed. Microsoft signs all of its executables with authenticode signatures.

      You can even configure Windows to run *only* executables signed by certain keys. Not many people even know it can do that, or do it in practice. We have use that feature for locking down web kiosks at conferences.

    11. Re:Press Releases... by JasterBobaMereel · · Score: 2, Insightful

      Sorry but

      Company has a problem with a server breach - no publicity, no comment - note even a hint

      FOSS project - We're busy go away ...

      Fedora - We have a problem we're sorting it out, we'll let you know when we know, the Server is Red Hat's and they have the same problem so they are dealing with it ....

      Looks fair enough to me ....

      --
      Puteulanus fenestra mortis
    12. Re:Press Releases... by mapsjanhere · · Score: 1

      You can see how serious that article is by checking it's tagging - an article on a security breach at Red Hat and issues with Fedora is tagged with Microsoft and windows.

      --
      I'm aging rapidly, I bought a new game and had no idea if my machine was good for it.
    13. Re:Press Releases... by ozphx · · Score: 1

      If the compiler has any optimisation improvements, then they will be different anyway.

      Furthermore, if the trojaning process is deterministic, the both versions of the compiler emit the binaries with the trojan in the same place.

      --
      3laws: No freebies, no backsies, GTFO.
    14. Re:Press Releases... by oldhack · · Score: 1

      Yeah, but that is the techie paranoia...
      The whole signing shit is a troll for the privacy church...
      Nice try. The problem with Techies is that they don't get the larger picture...

      Then why have signing in the first place? Blaming the customers and this bogeyman "Techie" after your shit blows up is a pathetic PR move.

      --
      Fuck systemd. Fuck Redhat. Fuck Soylent, too. Wait, scratch the last one.
    15. Re:Press Releases... by againjj · · Score: 3, Insightful

      And if the original compiler was gcc, and trojaned in the way the paper describes, then the triple compilation wouldn't catch it. Why? Step 1: the existing compiler builds binary 1 and inserts the backdoor. Step 2: Binary 1 builds binary 2 and inserts the backdoor. Step 3: Binary 2 builds binary 3 and inserts the backdoor. Step 4: binary 2 and binary 3 are compared, and if they are different, then there is an error. However, since all versions have the backdoor, there is no difference, and no error will be flagged. Try reading the linked article again.

      The triple compilation is not for detecting trojans, but "because the compiler will be tested more completely and could also have better performance."

    16. Re:Press Releases... by Xtifr · · Score: 2, Interesting

      And if the original compiler was gcc, and trojaned in the way the paper describes, then the triple compilation wouldn't catch it.

      But given the significant, massive changes that have been made to gcc over the years (not to mention all the other compilers that have been used to build it), the hack that the paper describes would need to involve hard-AI beyond what we have been able to achieve, and would probably take weeks to complete a single pass of compilation on the typical sort of machine used to compile gcc.

      Systems were smaller, simpler, and hadn't been evolving for as many years (or had as many major components rewritten from scratch) back in the days Thompson wrote that paper.

      (I built gcc with a C interpreter once, and then used the interpreted gcc to compile gcc. I did it mostly as a stress test of the interpreter, but it also served as a quick check for Thompson's trojan, which I didn't find--not that I was expecting to for the reasons cited above.)

      You are correct about the purpose of the triple compilation, though. Trying to catch Thompson's hack that way would be pointless both because it wouldn't detect the hack and because the hack is no longer practical.

    17. Re:Press Releases... by Elektroschock · · Score: 1

      Ah, that is interesting.

      Security is relative.

      You have a amored door set in a tent.

      People find out that someone might have gotten the key code and thus change the code. Techie cries: "Oh, the door is insecure." In fact the door was not as safe as was expected. But you always need to consider the larger perspective.

      Generally speaking more security does not harmm it makes it more difficult to intrude. Absolute security is impossible.

      When you have a security system it is important that you detect vulnerabilities and resolve them. Most of the time vulnerabilities are about what could have happened.

      That is clearly better than leaving vulnerabilities unresolved and create a market place for extra guardiansm I just say "antivir".

      I spoke of a privacy church. This is exactly the problem of the Pharisee. He believes in the rules and forgets about their purpose. For many humans it seems to be either-or. People want religious rules to be strict and sacrosanct even when they break them.

      The role of security is in short to prevent shit from happening. When you have a security to protect a person sometimes incidents happen. One time its a pie in the face the other day a man with a gun. Security means to reduce the probability of such actions or activities. This is a weak concept. When you detect a vulnerability in your steel door lock and the money in the safe you can simply resolve the problem and change the key.

  4. Crapper by Tablizer · · Score: 1

    Shit! I have stock in RedHat

  5. The real world is a bit different than that. by Bruce+Perens · · Score: 2, Insightful
    The problem with not coming clean by 1) saying what happened and what you did wrong and 2) saying how you're going to fix it is that nobody will ever trust you again afterwards. IT managers now know that RH is going to go unresponsive when there's a problem. How can they trust Red Hat again? It might be different if RH was the only game in town, but there is an accepted standard for performance by thousands of Open Source projects in this sort of situation, and it's known as the best practice in the entire IT field, and Red Hat fell short.

    They have to buy people's trust again now with their actions, and it's going to take years, if they even do it.

    1. Re:The real world is a bit different than that. by The+End+Of+Days · · Score: 1

      The problem with not coming clean by 1) saying what happened and what you did wrong and 2) saying how you're going to fix it is that nobody will ever trust you again afterwards.

      That's only true for fairly limited definitions of nobody. Otherwise Microsoft would be a hell of a lot smaller than they are.

    2. Re:The real world is a bit different than that. by adamchou · · Score: 1

      The problem with not coming clean by 1) saying what happened and what you did wrong and 2) saying how you're going to fix it

      This is a problem with Redhat's security so why would they need to disclose how the breach occurred and how they fixed it? You don't need to know my security protocols and infrastructure or the weaknesses in them so what makes you think Redhat is going to disclose to you theirs?

      nobody will ever trust you again afterwards.

      You're wrong here. No one that doesn't run a business will ever trust them again. But frankly, its not the consumer they're after anyways. Redhat has a reputation for leading the industry and releasing quality products in the past. This one incident isn't going to tarnish their name enough to stop using them

      And if you'll RTFA, the issue the author is arguing about is

      Under these circumstances, the company's wish to proceed cautiously and with as little publicity as possible is perfectly natural. The problem is that, in moving to defend its own credibility, Red Hat has neglected Fedora's.

      Frankly, you have to understand that Redhat is a publicly traded corporation. They report to a board and to their investors. They did disclose what was wrong and the fixed it. Most likely, they fixed it as quickly as they could. They don't report to you or anyone else in the open source community. So don't expect them to sacrifice their own interests for the FOSS community.

      Besides that, I still fail to see the real harm they caused the F/OSS community besides delaying what had happened. Anyone care to enlighten me?

    3. Re:The real world is a bit different than that. by Bruce+Perens · · Score: 0, Troll
      They harmed the FOSS community because they got in the way of the FOSS developers responding appropriately to their own security problem.

      They harmed their customers because a business with more than 50 people has SOx to deal with, and to pass their own audits must be able to assure their own security with more than just a "you're OK, we promise". Even if they didn't have SOx to deal with, it would be bad practice for any security officer to accept "just trust me".

      Bruce

    4. Re:The real world is a bit different than that. by Anonymous Coward · · Score: 0

      The Red Hat statement said that no customer was affected. Yet you say no one will ever
      trust them again? What is this? Fatuous week? Personally, it's Bruce Byfield I trust less, for
      making such a fuss over nothing.

    5. Re:The real world is a bit different than that. by Anonymous Coward · · Score: 0

      it's known as the best practice in the entire IT field, and Red Hat fell short.

      Best Practice = Everyone Does It = Mediocrity

      (Thanks, Scott.)

    6. Re:The real world is a bit different than that. by Anonymous Coward · · Score: 0

      Ok Bruce, so we now Officially know you live in a different space/time continuum. Because 1) RedHat came out almost immediately (if you have an idea of how corporations can be slow) with warning users and customers that they had a breach and 2) said *very clearly* that the breach did not affect users/customers.

      Now I understand your need to say Red Hat is worst than Debian, but frankly, GET YOUR FACTS RIGHT, or YOU loose your credibility.

      Red Hat may have not handled the communication (especially for the Fedora side) in the way YOU like it, but you ALSO forget that Red Hat implied an investigation is underway, and you should know that there is so much you can tell in such cases.

      *If* Red Hat and Fedora will not explain what happened *exactly* when the investigation is over, *then* you will be allowed to claim they have not been transparent enough.

      And btw WTH has FOSS to do with a criminal computer system breach ?

    7. Re:The real world is a bit different than that. by ThePhilips · · Score: 1

      Redhat has a reputation for leading the industry and releasing quality products in the past.

      You either: never used RH or used only RH.

      RH has two major sicknesses.

      1. Pushing untested alpha, unversioned(!) stuff on their customers. glibc and gcc pretty much always bear "CVS112234433435343" monikers instead of real versions. Number of applied patches to some program make most version numbers pretty meaningless.

      2. "Not invented here" syndrom. SuSE did something for many years. Debian did something for many years. Users even ported that over to RH. Next version we see that RH finally woke up and ... right: disregarded everything what already there and build something from scratch. See #1 why it never worked and took couple of version for them to stabilize the software. ("2 service packs before deployment" rule from Windows world was and is also applicable to RH.)

      Not that I have something against system I have to use occasionally, but pretty much everybody I know who runs RH (be it Fedora or RHEL) runs it for one sole reason: "we have to, our bigger partners are using it." I yet to meet single person who uses OS from RH for some other reasons.

      --
      All hope abandon ye who enter here.
    8. Re:The real world is a bit different than that. by KGIII · · Score: 1

      In my past conversations with you I have learned a few things about you such as that you're a firm believer in what you believe to be the truth and you're unwilling (not a bad thing necessarily) to accept alternative views.

      I'll try to make this short but I do want some context.

      For instance you're quite a zealot about what you believe in but you're open and honest about it and you aren't even on my foes list though I'm usually happy to put extremists on that list so that I can better filter their comments.

      With all that being said, I don't think they've actually harmed anyone. I'm not seeing any harm here.

      What I am seeing is some people WITHIN THE COMMUNITY who are displeased. The CEO, CIO, and CSO at Big Business USA aren't at all unhappy with RHEL. The people buying the product (not the users using the Fedora project) are also in a business environment where they probably don't give out more information about security issues than is required.

      Now, on the other hand, I can see why this would be upsetting. As members, prominent ones even, of the FOSS community full disclosure was expected in a timely manner. This information may still be coming, it may not be as well. Trust is a tough thing, it is difficult to earn and even more difficult to get back when it is lost.

      From a business standpoint I have no complaints about their response at this time. That is just me. I can certainly see the validity of your complaints but I have to wonder if this is heartfelt or if it is logical. *My* logic says that this will have no impact on FOSS or RH other than the small wave of displeasure we are seeing from purists who believe that everything must be made available.

      At risk of seeming snarky I would ask if articles such as this and the heated exchanges are actually beneficial or detrimental to the community at large. When a clueless C-level reads this sort of stuff does it leave a good or bad taste in their mouth? How about with Joe Sixpack who's looking for an alternative to Vista? What happens when they walk away with the perception of a lack of unity, in-fighting, and discontent within the community?

      As always, I ask these things not to argue but to understand your perspective and truly wish answers from any willing to provide them.

      --
      "So long and thanks for all the fish."
    9. Re:The real world is a bit different than that. by Bruce+Perens · · Score: 2, Insightful
      The practice followed by Debian is that preferred by professional security engineers. They quickly closed the vulnerability, and then once the vulnerability was closed they reported how they failed, what the impact was on others, and how they'd fix it. There was sufficient information to convince the customer that they'd done the right thing.

      Less than full disclosure is a problem because when you trust people, you place more potential points of failure in your security system than when you can verify something on your own. Real security does not trust, they check everything.

      The problem is made worse by the fact that some people have all of the information. People in Red Hat and Fedora, and some customers that they've told under NDA, and whoever the perpetrator told. Those folks all have power over your system, potentially, that you would not want them to have.

      Read Schneiner, he's a good independent source on this.

      And if you please, "zealot" isn't polite. We all have our own beliefs, you same as I, for what we percieve to be good reasons.

      Bruce

    10. Re:The real world is a bit different than that. by KGIII · · Score: 1

      Hmm... Two more things. Three really.

      I'll refrain from "zealot" in the future - in your case I meant it more as a compliment instead of the atypical derogatory sense. While some of your opinions are different than my own I appreciate your willingness to stand up for them, explain them, and hold true to them.

      Security is a process of compromise IMHO. Basically it is doing what you need to do with as little risk as possible, again IMHO. It is financially and logistically impossible to check everything. At some point trust must be given. The prefered way wasn't followed in this case but if the end result is secure (a point we could debate for hours, longer still given who may have this information) and we find a way to trust them then is the process that important?

      Finally, in my prior reponse I asked about the perceptions that people might have of the community when they see things like this. No one has answered those - I figured you were a good source for information on that or at least would have an opinion.

      --
      "So long and thanks for all the fish."
    11. Re:The real world is a bit different than that. by Bruce+Perens · · Score: 1

      Well, I think the whole community's strength is in openness. We discuss how we do things, we fix them the best we know how, all in public where others can see. It attracts the knowledgible, and scares away the ignorant. I remember someone who wrote that he won't use Linux because he saw a comment "/* What does this do? */" in the kernel. Of course, nobody knows the entire kernel, and "what does this do?" is generally the first statement in a conversation that fixes a bug or removes dead code. I'd rather be able to ask "what does this do?" than suffer in ignorance.

    12. Re:The real world is a bit different than that. by LordMorgul · · Score: 1

      Red Hat was not 'unresponsive' in this issue, they clearly stated their systems were compromised, user's systems were not due to the lack of compromised packages in the mirrors, and the procedure being undertaken to make sure none of the mirrored packages are compromised in the future using signing keys that may have been compromised (i.e. replacing the entire signing key and resigning every single package). How exactly is that being unresponsive? It tells an administrator every fact they need: are my own systems compromised, how do I verify that, and how do I know they will not be compromised in the future due to this issue. The security breach details of the Red Hat servers is not something an administrator needs to know in order to trust that Red Hat made an appropriate decision regarding this breech. If you feel you need to know every tiny detail in order to trust the company, you are in a sad state of affairs... because you do not trust anyone at all and never will; that level of disclosure simply does not exist with any outside vendor company, software or hardware, and will not, and if you think you're getting it from anyone you are deceiving yourself.

    13. Re:The real world is a bit different than that. by KGIII · · Score: 1

      Thanks again Bruce. As always, I appreciate your insight. In summary, I *hope* that this isn't going to mean a great deal and while I don't think that F/OSS is the only path I truly appreciate the time and effort you give in explaining my difficult (behavior, not intellect) questions.

      To digress a bit, I am unhappy with the vocal minority of F/OSS (see, I do listen - I even remembered to not just refer to it as OSS which means your time is not wasted in answering my questions and that I do appreciate the answers) "activists." You don't, in my opinion, fall into that category. Instead I see you more as, and this is just my view from having read a lot of your posts and communicated via /. with you, more as an advocate.

      (I think a part of that might be my own views with what "activists" do in some extreme examples and so, to me, it seems wrong to associate that word with you. Activism is great but many activists are mostly interested in disruption whilst you seem eager to educate instead. Instead of saying that something is wrong you are saying what is wrong, why you feel it is wrong, and what you think needs to change. All while maintaining a level of civility that must be hard given the likes of me.)

      I love OSS. I even contribute where/when I am able. Our views aren't so disparate that I'm unable/unwilling to understand you. For that, the acts of kindness where you have taken the time to explain your views, I thank you. For the sake of the computer using community I thank you. The time you have taken to answer just my questions is above and beyond what is required from anyone and I wanted to make sure that you knew that I appreciated that time and effort.

      --
      "So long and thanks for all the fish."
    14. Re:The real world is a bit different than that. by True+Grit · · Score: 1

      That's only true for fairly limited definitions of nobody. Otherwise Microsoft would be a hell of a lot smaller than they are.

      If MS had to compete on a level playing field with many other vendors, all producing a compatible version of a commodity OS (with that compatibility allowing users to relatively easily switch between vendors), then yes they would be *much* smaller now... probably nonexistent.

      RH doesn't have the luxury of controlling 90% of its market.

  6. in a word- by Anonymous Coward · · Score: 0

    shareholders.

  7. Linux for suits? by mkcmkc · · Score: 1

    maybe when your [sic] a bare foot [sic] long haired [sic] hippy like stallman... [blah, blah, blah]

    So you're saying that RedHat is now the Linux for suits? Quality is not the highest priority? I for one am not quite ready to believe it...

    --
    "Not an actor, but he plays one on TV."
    1. Re:Linux for suits? by adamchou · · Score: 1

      This is nonsense. Them not wanting to disclose the reasons behind the security breach has nothing to do with the quality of their work.

    2. Re:Linux for suits? by the_B0fh · · Score: 1

      How can you tell? Was it caused by a lack of quality in their processes? Did some programmer post his private key in some hacker board? Without details, you simply can't tell.

  8. Crisis? by grilled-cheese · · Score: 1

    What exactly qualifies this as a crisis?

  9. Does this justify the word "crisis?" by bogaboga · · Score: 5, Insightful

    Does this justify the word "crisis?" I doubt it does. In my opinion "conundrum" would be a better word.

    At first read, the heading made me think that Red Hat and Fedora communities were bickering big time, threatening timely releases of software we have [all] come to rely on. Of course this is not the case.

    So why the sensational heading?

    1. Re:Does this justify the word "crisis?" by mikesd81 · · Score: 1

      Because it is a crisis when a distro's server was penetrated and packages are possibly untrustworthy. Maybe the title would be less confusing if it was Redhat/Fedora?

      --
      That which does not kill me only postpones the inevitable.
    2. Re:Does this justify the word "crisis?" by Bruce+Perens · · Score: 1

      "Crisis" is polite language for what is really meant :-)

    3. Re:Does this justify the word "crisis?" by Anonymous Coward · · Score: 0

      "Conundrum" is harder to spell.

      But since you ask,

      crisis
      c.1425, from Gk. krisis "turning point in a disease" (used as such by Hippocrates and Galen), lit. "judgment," from krinein "to separate, decide, judge," from PIE base *krei- "to sieve, discriminate, distinguish" (cf. Gk. krinesthai "to explain;" O.E. hriddel "sieve;" L. cribrum "sieve," crimen "judgment, crime," cernere (pp. cretus) "to sift, separate;" O.Ir. criathar, O.Welsh cruitr "sieve;" M.Ir. crich "border, boundary"). Transferred non-medical sense is 1627. A Ger. term for "mid-life crisis" is Torschlusspanik, lit. "shut-door-panic," fear of being on the wrong side of a closing gate.

      conundrum
      1596, Oxford University slang for "pedant," also "whim," etc., later (1790) "riddle, puzzle," also spelled quonundrum; the sort of ponderous pseudo-Latin word that was once the height of humor in learned circles.

      I'll go with the 'turning point', myself.

  10. People don't like it... by slyn · · Score: 1

    ... when a major open source company/advocate isn't open. News at 11.

  11. Affecting me to effect change has a good effect. by Anonymous Coward · · Score: 1, Informative

    They knew that not just Debian but all Debian derivatives like Ubuntu would be effected

    Affected. The word is affected, not effected. Sorry Bruce, but I can't help it -- I'm an Anonymous Coward.

  12. Don't be fooled. by fahrbot-bot · · Score: 1, Informative
    Fedora is independent from Red Hat as Saturn is (was) from GM. Ya, it's a little bit of a stretch, but stick with me, I think there's a parallel -- i.e., Saturn exists to benefit GM, not to build better cars.

    From: GM'S SATURN PROBLEM

    Saturn wouldn't merely blossom as a division with protected status, free from the labor strife, stifling bureaucracy, and all the other dysfunctions of the mother corporation. No, it would also infect the rest of the company with its enlightened and effective management techniques. ...

    Problem was, most Saturn buyers never traded up. While Saturn achieved its goal of attracting buyers who weren't typically interested in GM cars, it didn't change their opinions of the company. When owners sold their first Saturn, they typically bought a second one, or they shopped elsewhere. ...

    For Saturn to survive, it needed to boost sales volume, cut engineering and manufacturing costs by borrowing more GM resources, and develop additional products in higher-profit segments by adapting existing GM designs. ...

    Increasingly, pieces of the original Saturn were stripped away in the interest of efficiency, and the once-independent company was slowly integrated into GM.

    Push come to shove, Fedora's needs will never come before Red Hats interests.

    --
    It must have been something you assimilated. . . .
    1. Re:Don't be fooled. by Cro+Magnon · · Score: 1

      Problem was, most Saturn buyers never traded up

      I have owned 3 GM cars, and one of those was a Saturn. Trust me, going from a Saturn to another GM isn't "trading up".

      --
      Slow down, cowboy! It has been 4 hours since you last posted. You must wait another few hours.
  13. Semantic games by 93+Escort+Wagon · · Score: 1

    'If Red Hat, one of the epitomes of a successful FOSS-based business, can ignore FOSS when to do so is corporately convenient, then what chance do we have that other companies â" especially publicly-traded ones â" will act any better?'

    You can argue that they are ignoring the spirit that many FOSS advocates believe in; but how is not making the details of this intrusion public "ignoring FOSS"? Is there a line somewhere in the GPL that states "If you're running GPL software, and someone hacks your system, you must make all details of the hack known"?

    If solving the hack required Red Hat to modify code, they'll have to make the source available - but AFAIK that's all they're required to do.

    --
    #DeleteChrome
    1. Re:Semantic games by pavera · · Score: 1

      The problem is that they are eating their own dogfood. If they were to disclose the method of attack, they would be protecting all of their customers, as their customers could take steps to prevent the same attack from succeeding against them. As it is, they are just leaving all of their customers open to a known hole.

      Further, the fact that they have been so mum about the attack leaves people with 0 ability to mitigate any damage that may have been done. They admit that the attacker was able to sign modified SSH packages and distribute them. Fedora says the attacker was not able to sign any packages because they didn't have the passphrase and couldn't hack it.... So does RedHat not have a passphrase on their signing key? Do they keep it in plaintext on the signing server? Was theirs just really easy to guess? Point being, it looks to me like RedHat seriously dropped the security ball. They ought to admit it, and move on.

    2. Re:Semantic games by bursch-X · · Score: 3, Funny

      "If you're running GPL software, and someone hacks your system, you must make all details of the hack known"?

      Sure you must, under the GPL even a hack would count as a derivative work, so the hackers have to make the source available, wouldn't they? ;-P

      --
      There are two rules for success:
      1. Never tell everything you know.
    3. Re:Semantic games by melonman · · Score: 5, Interesting

      Exactly. It's not a breach of any FOSS licence. It's possibly a breach of FOSS project best practice, but that isn't clear either, because we don't know how the problem happened or what code had to be modified to fix it.

      Even if some FOSS code was modified, there is no licence obligation to distribute the changes unless you are distributing the binaries.

      As I understand it, the security breach was that someone gained remote access to their servers. It doesn't necessarily follow that any of the code served by the servers was faulty. Last time I checked, not all the code running Redhat sites was open-source.

      And the breach could well have been down to a sys admin error, rather than a problem with the codebase itself. It would obviously be acutely embarassing if Redhat's in-house team turned out to have made the kind of mistake that causes people to fail their RHCE exam, but it wouldn't have anything to do with FOSS.

      Also, there may not be a simple answer to the 'what does this mean for me?' question. In the Debian case, the answer was quite simple, and so was the solution. The Redhat announcements sounded to me like "We know there was a breach, we don't know exactly what happened as a result, we don't think anything serious happened, but, to be on the safe side, we are changing all the locks."

      Redhat's PR department obviously misjudged the best way to handle this incident, but the expectations of the FOSS community also seem unrealistic. When a company open-sources some code, it doesn't mean that anyone in the world gets unfettered access to all the information in the company. Reading TFA, I can't help but think that it is at least partly motivated by the blogger's outrage that Redhat didn't roll out the red carpet all the way to the server room for his terribly important blog.

      --
      Virtually serving coffee
    4. Re:Semantic games by LordMorgul · · Score: 1

      Uhm, no, if someone hacks THEY must make the details known, but not the person who was hacked (its not a derivative work YOU produced). Of course given the obvious sarcasm, it is an interesting sticky situation, and we all know someone isn't going to release their own hacked source (at least until its been fixed).

    5. Re:Semantic games by bursch-X · · Score: 1

      Of course they have to, after all they offer the hacked software on their servers so sources must be made available.

      --
      There are two rules for success:
      1. Never tell everything you know.
  14. gotta say, this is BAD by pavera · · Score: 3, Insightful

    I used to be 100% redhat and fedora... Now I've moved almost all my systems to ubuntu, but I still run centos on a few servers.

    Every reputable tech company I deal with (ISP, Software, Hosting, Colo) has very clear, very open policies about outages, breaches, and security in general. If they don't I don't do business with them.

    I know the ins and outs of my ISP, Hosting, and Colo companies processes because I get emailed whenever I have an outage that says "we experienced an outage from x-y on day z, the outage was caused by our dumb admin who tripped on the power cable, we rewired our entire data center to move all of the power cables to the ceiling to prevent a similar outage in the future".

    Obviously that is a made up report, but it is extremely standard practice to let all your customers know a) when the problem happened, b) what caused the problem, c) concrete steps taken or procedures implemented to prevent similar problems in the future

    That RedHat has fallen so miserably short of this basic tenet of IT procedures is extremely scary.

    1. Re:gotta say, this is BAD by Jailbrekr · · Score: 4, Interesting

      I work for a 500 million dollar a year company, and we're a Redhat shop. We have no intent of switching because the "breach" had ZERO effect on its customers. Even though it had zero effect, they still released scripts to seek out and detect any potential vulnerabilities that were even remotely related to the "breach" (surprise surprise, our 850 RHEL4/5 installs had none). Redhat caught the "breach", made sure the damage was isolated to non production servers, and then informed its customer base and the public. The fact that they're not releasing the explicit details suurrounding the "breach" seems to suggest that they still investigating the source of the "breach" and quite possibly have law enforcement involved.

      Redhat is doing the right thing, and for you to base your decision to switch on a grossly misinterpreted reaction reflects poorly on you, not them.

      --
      Feed the need: Digitaladdiction.net
    2. Re:gotta say, this is BAD by bill_mcgonigle · · Score: 1

      I know the ins and outs of my ISP, Hosting, and Colo companies processes because I get emailed whenever I have an outage that says "we experienced an outage from x-y on day z, the outage was caused by our dumb admin who tripped on the power cable, we rewired our entire data center to move all of the power cables to the ceiling to prevent a similar outage in the future".

      Those are events with short-term fixes and you get notification after the fix is implemented, right?

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    3. Re:gotta say, this is BAD by pavera · · Score: 1

      Sorry,
      I didn't mean to imply that I switched because of this, although upon re-reading my original post, I agree it reads that way....

      I started switching after Fedora 3, which was such a colossal flop, and caused me way too many headaches... I moved most systems to centos at that time, then, since Ubuntu has released their server product, I've been using it and migrating systems from centos...

      I unfortunately don't work for a 500 mil/yr company, and so can't afford 1500-2500/yr/server for security updates. I worked for 1 company that had the resources for RHEL licenses, and we never in 2 years called support, nor used anything but RHN for security updates... No way can I justify that expense for security updates to my current employer... Our systems run enough virtualized instances, and have enough processor sockets to require the Advanced Platform licenses which start at 1500/yr/server...

    4. Re:gotta say, this is BAD by the_B0fh · · Score: 3, Interesting

      Bleh. I've worked for multiple Fortune 100 companies, and for the most part, issues such as these do not make the radar of these companies. The most trouble you'll get is out of a few disgruntled users. Once a contract is signed, unless you pissed off the top brass, you typically have no problems.

      OTOH, I'll disagree with you. Full disclosure means just that. At this point, they have not even said that they're going to disclose anything else, and it reflects poorly on you to go defend them.

    5. Re:gotta say, this is BAD by Bruce+Perens · · Score: 5, Insightful

      surprise surprise, our 850 RHEL4/5 installs had none

      You're very trusting with all that money. Someone else in the same situation might truthfully report: my vendor is keeping me the dark, I don't know the nature and degree of my own exposure.

      This would make me nervous.

    6. Re:gotta say, this is BAD by pavera · · Score: 1

      not necessarily... My colo recently had a major power outage which because of the nature of the outage (a brownout, then a complete drop) fooled the generator into turning on while the power was still on (during the brownout), then because the power was still on the generator shut itself down, and put itself in a state which required manual intervention to start up.. so when the power actually failed about 2 minutes later, the whole datacenter went down (after the 2-5 minutes of battery ran out)...

      Anyway it was a major outage, but they sent a detailed email of what happened about 2 hours after the incident, once they had manually reset things and restored power and AC to the datacenter floor (the power outage lasted 2 days). Then, within another 4-6 hours, sent a detailed email specifying exactly what changes they were making to their power infrastructure to mitigate the problem in the future. These changes took more than a month to implement involving work from the power company, the generator company, and various electrical contractors. I received 1-2 emails per week detailing progress of the work, exactly what state everything was in, and estimated completion dates for everything.

      I guess my point is, no, these aren't short term fixes and I get notification prior to the fix being implemented if it is a major issue.

      My ISP is equally forthcoming about issues which cause outages on their network. Sure if its a small thing that they've already fixed, I'll get the notification after the fix, but for large issues, or issues which require ongoing work to actually remedy, I am kept in the loop as the situation is ongoing.

      Seems to me going without security updates for 2-3 weeks would classify as a major outage. Further, if redhat has identified the attack vector, they should release it, as millions of other redhat servers are probably vulnerable to the same attack, and customers need to know so they can mitigate their exposure.

    7. Re:gotta say, this is BAD by Jah-Wren+Ryel · · Score: 1

      The fact that they're not releasing the explicit details suurrounding the "breach" seems to suggest that they still investigating the source of the "breach" and quite possibly have law enforcement involved.

      If that were the case, then they would have no excuse not to tell you that was the case and that full details would be forthcoming once it was no longer necessary to keep them secret.

      Since they did not do that, it seems to suggest that your hypothesis is false.

      --
      When information is power, privacy is freedom.
    8. Re:gotta say, this is BAD by Anonymous Coward · · Score: 0

      I know the ins and outs of my ISP, Hosting, and Colo companies processes...

      Wow. What providers do you use?

    9. Re:gotta say, this is BAD by QuantumG · · Score: 2

      Why are you putting quotes around "breach". It was a breach.. they said it was a breach. Are you debating Red Hat's press release that it was a breach?

      --
      How we know is more important than what we know.
    10. Re:gotta say, this is BAD by Anonymous Coward · · Score: 5, Interesting

      Someone else in the same situation might truthfully report: my vendor is keeping me the dark, I don't know the nature and degree of my own exposure.

      That would be me - our RHEL5 system has the trojanized versions of OpenSSH mentioned in the Red Hat Security Advisory installed, and Red Hat did not provide the most crucial information for me: what harm these packages are able to cause (i.e. which passwords should I change, whether to look for secondary breaches on other - non-RHEL - systems, etc.), and how they got into my system. Also, they were pretty slow releasing the details. The packages were signed by their key on August 13, Fedora servers were taken offline a day or two later (so they definitely knew about the problem really soon), but the advisory was published on August 21. As far as I know I had the trojanized packages installed since August 15, so my system has been 0wned for 6 days, thanks to Red Hat delaying the information.

    11. Re:gotta say, this is BAD by betterunixthanunix · · Score: 1

      People are missing one crucial detail here: the investigation of this breach may involve the FBI or the NSA, both of which contract with Red Hat and both of which would have an interest in keeping their investigations under wraps until they have reached their conclusions. Don't assume that it is only Red Hat making the decisions about what to disclose to the general public. I wouldn't be too surprised if, a month from now, Red Hat suddenly releases details on what happened and how they're going to stop it from happening again.

      --
      Palm trees and 8
    12. Re:gotta say, this is BAD by Lumpy · · Score: 1

      I worked for a 3.4billion dollar a year company and even when there are breaches or instability or other issues we don't change anything. Cripes one of our biggest Billing systems vendors were compromised for months and had issues that blew my mind and we stayed with them.

      Executives dont give a rats ass unless it costs them lots of money right now. If the redhat breach cost a company 30 million right now, then and ONLY THEN would a change even be considered.

      Hell I have had vendors infect our entire network with a virus from a laptop that cost us $100,000US to fix and we still used them for years...

      --
      Do not look at laser with remaining good eye.
    13. Re:gotta say, this is BAD by Shados · · Score: 1

      Bleh. I'm working for a multi-billion company, and they post their vendor account information and authentication details on the intranet for everyone to see.

      I've worked for one of the 10 largest companies in the world, where consultants had full access to the production sales servers without any kind of auditing or control.

      I've worked for banks where third party firms had direct access to the financing database servers.

      So that a 500 million company didn't care about something like this happening is pretty much what I'd expect.

    14. Re:gotta say, this is BAD by Jailbrekr · · Score: 1

      We have a good team which helps mitigate any disasters, and always test before deployment.

      I never got the impression that we were kept in the dark. They made an announcement, gave us tools to test for the vulnerability, and assured us that the vulnerability did not hit any production servers. As we do not blindly update without testing first (as should be the case for anyone and everyone in a similar position), the breach was a non issue.

      I can appreciate what you're trying to say, but I think this whole thing is getting blown WAY out of proportion. They got hacked and are keeping their mouth shut wrt to the technical details. IMO The fact that they went public about the breach at all shows that they ARE committed to full disclosure.

      So I can truthfully report: My vendor reported a security breach, reported the level of exposure to its customers, and provided tools to sniff out possible customer exposure to said security breach.

      --
      Feed the need: Digitaladdiction.net
    15. Re:gotta say, this is BAD by buysse · · Score: 1

      They weren't owned for 6 days due to a redhat delay -- the trojaned packages didn't let the attackers install them remotely without hacking something else first.

      You should change everything -- it doesn't matter what the openssh packages did, honestly, because they had root on the box. Did you reinstall the boxes, or just replace the SSH packages?

      How much do other machines trust those, or have similar other (possibly zero-day) vulnerabilities? Do you know how they got in? Redhat's release of information related to this breach *had nothing to do with your servers being owned.* It had everything to do with you *discovering* they were owned.

      --
      -30-
    16. Re:gotta say, this is BAD by Spoke · · Score: 1

      RedHat specifically said that packages obtained through RHN were safe. Do you get all your packages through RHN?

      http://www.redhat.com/security/data/openssh-blacklist.html

      They also said that if you detected blacklisted packages on your system, to contact RedHat support by either opening a ticket, calling your local support center or contacting your Technical Account Manager. Did you?

      It's not absolutely clear to me whether or not the blacklisted packages have been trojaned or not, but it is clear that all updates obtained through RHN are safe.

      What would be interesting to know is how exactly did you get your blacklisted packages installed on your system? Did you get them through RHN or some other channel?

    17. Re:gotta say, this is BAD by HiThere · · Score: 1

      How do you know that it is having no impact? My suspicion is that you are trusting the honesty of Red Hat...but for many people this process has severely damaged their trust in Red Hat.

      My trust in their actions (as opposed to their intentions) was damaged so severely several years ago that I switched away from them with considerable effort. OTOH, I'm not a $500 million company...or even a $1 million company. Perhaps they treat you a bit better.

      But while I may still (usually) trust their intentions, I no longer trust their actions. Each action now needs to justify itself. This one doesn't. (I accept that it's probably a communications problem, but it's a doozy of a communications problem.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    18. Re:gotta say, this is BAD by Bruce+Perens · · Score: 1

      Uh-oh. Red Hat said those didn't get out. Send me an email, or call me at 510-984-1055, please.

    19. Re:gotta say, this is BAD by Anonymous Coward · · Score: 0

      Red Hat said those didn't get out _through_RHN_.
      Which may be true. From the install time of those packages I think they were not installed during a regular nightly "yum update" run.

    20. Re:gotta say, this is BAD by Anonymous Coward · · Score: 0

      They weren't owned for 6 days due to a redhat delay

      OK, let's reword it as "6 days more due to a Red Hat delay".

      Redhat's release of information related to this breach *had nothing to do with your servers being owned.* It had everything to do with you *discovering* they were owned.

      Well, they might know how their own servers got hacked, and the vulnerability may be the same to the one through which my own server was hacked.

      Also, I wonder why the attackers needed to install _signed_ packages, when they already had a root access, and can install any rootkit they wish. Maybe the vulnerability in question is not a full root-access one, but some kind of a lower-impact attack, which needs officially signed packages. But then again, only Red Hat knows at this time.

       

    21. Re:gotta say, this is BAD by Anonymous Coward · · Score: 0

      The compromised package never made it to RHN. So the admin of that machine had to install it by hand from some unofficial source. But RH cannot be held responsible for that action, there is reason why RHEL has it's own official update channels.

  15. This is an ongoing investigation by chill · · Score: 5, Interesting

    This seems to be, from reading the Fedora and Red Hat statements, an ongoing investigation. The same way the police don't comment about investigations in progress, Red Hat is keeping mum. Keep in mind, the breach may be very complex and not something that they can confidently say "we understand" without a very detailed analysis.

    They announced the issue immediately and took steps. For now, give them the benefit of the doubt that further details will be forthcoming once a proper investigation has been completed.

    --
    Learning HOW to think is more important than learning WHAT to think.
    1. Re:This is an ongoing investigation by Just+Brew+It! · · Score: 1

      It has been nearly a month since the original breach was noticed. That's an awful long time for people to be left hanging, wondering whether their systems are running potentially compromised packages.

    2. Re:This is an ongoing investigation by betterunixthanunix · · Score: 1

      I would guess that the FBI or NSA is involved in the investigation as well, since both agencies have contracts with Red Hat and since this is a major security breach.

      --
      Palm trees and 8
    3. Re:This is an ongoing investigation by WindShadow · · Score: 1
      There are three ways that a breach of such "inside information" like a signing key could be accomplished:
      - a rouge employee (or contributor)
      - someone had a key stolen (however you define stolen)
      - there is a serious hole in server security

      It's that last one which worries me, because if they have the hole, it's likely that I have it, too. And the fact that they refuse to categorize the problem indicates that they have a different view of good practice than mine. The first two causes are in the "it happens" category, the last doesn't. If your users have a potential hole they should know it so they can make their own decision what to do, and if the problem is known not to be on other systems the users should know that, too.t if there is a problem common to Fedora systems, users should be aware of it so they can make informed decisions.

      "Security through obscurity" is a failed approach, what you don't know can hurt you. Every vendor has problems, how they are handled is what differentiates the good from the bad.

    4. Re:This is an ongoing investigation by chill · · Score: 1

      Option 4: A misconfiguration of their server, such as a lazy admin who configured SSH certificate logins but not requiring a password on his workstation.

      What I'm saying is if it IS a hole in server security, it could be an indirect and complicated hole. It could be hard to trace exactly what and how. There is a reason many security people don't "fix" compromised servers. Because it is quite possible you will NEVER know 100% of what happened and how. The only way to be certain of future integrity is start from a fresh install of known good sources. Proper forensic analysis can take quite some time.

      --
      Learning HOW to think is more important than learning WHAT to think.
    5. Re:This is an ongoing investigation by WindShadow · · Score: 1
      That's why I said "however you define stolen" in case two. Administrative failures happen, but like the rogue employee case, there's no reason why I feel at increased risk from those issues, just as good practice at the Fedora servers doesn't protect me against bad practices on mine.

      What does concern me is if there was a way and outside attack could get into the Fedora servers, and that I have the same hole. I don't need to know details until there's a fix in that case, just that even more monitoring would be useful.

  16. Re:Affecting me to effect change has a good effect by Anonymous Coward · · Score: 2, Funny

    Disregard that. OP has it right. I suck cock and need grammar lessons.

  17. Example of a broader oddity. by fuzzyfuzzyfungus · · Score: 1

    I'm not at all surprised that Redhat felt free to do whatever they felt like, fedora be damned, under the circumstances. What I don't understand, though, is why would doing what they did seem like a good idea?

    Sure, getting compromised sucks, and having to admit it sucks; but in a world of fast moving internet gossip, paranoid *nixheads, and potential leaks, oozing some smarmy nonsense, losing face, and still having to admit it sucks even more.

    I can understand why they would be tempted, if they thought that full concealment was possible; but why would anybody go with half concealment? It seems like you get the worst of both worlds. Everybody finds out anyway, and you look like a slimy suit. Why would you do that?

  18. oh well... by Sfing_ter · · Score: 1

    I stopped using RedHat (deadrat), about the time they went "fedora" - i did not care for some of the changes.

    I do know that the govt. likes them a lot, and if you are a govt. contractor, sometimes you can only say certain things...

    --
    A computer once beat me at chess, but it was no match for me at kick boxing. Emo Philips
  19. I don't see this as anti FOSS by Dr_Marvin_Monroe · · Score: 4, Interesting

    There are a number of possible scenarios that would recommend against being 100% candid on how far you were breached. If I was violated, I think I'd like to take a moment to do a "self-check" on all of my important bits before I started telling everyone all of the nitty-gritty details. As the article pointed out, people were told that there was a breach, and that they should not update for a few days. How is this "anti-FOSS"?

    Perhaps they were on the trail of who did this? Perhaps they were comparing notes with the Ubuntu breach cited in the article, with the goal of finding the M.O? Perhaps, like any police detective, they were keeping certain clues to themselves while they investigated further? If the crimes were found to have similar approaches, keeping quiet might improve the odds of capture?

    I use Fedora, and had been using Red Hat before Fedora came along. I don't think this kind of hysterical "anti-FOSS" reaction is really fits the facts as I just read them. Perhaps they have not handled this in the best possible way, but that's far from "anti-FOSS." Just because you didn't get your precious packages today, doesn't mean they've gone all corporate spin-zone on the FOSS community. Again, I'm not saying that they've handled it as well as they could have, I'm just making the point that there might be reasons for not detailing publicly the many many disgusting ways that each and every one of their private bits have been violated and penetrated numerous times, over and over again....

    Give-em a break guys, I'd be more concerned if they didn't tell anyone about the break-in at all. That would really be "corporate" behavior. Simply deny the breach and lawyer-up. As it is, they're trying to fix it, and if you're so antsy to get your packages immediately, the source and diff's are there for you to check yourself. If they start getting in the habit of this, folks will start contributing to, and using other distro's.. isn't that how FOSS is supposed to work?

    1. Re:I don't see this as anti FOSS by Slashcrap · · Score: 1

      If I was violated, I think I'd like to take a moment to do a "self-check" on all of my important bits before I started telling everyone all of the nitty-gritty details.

      You're a Slashdot poster. You're unlikely to be getting violated anytime soon, no matter how hard you wish for it.

    2. Re:I don't see this as anti FOSS by The_reformant · · Score: 1

      This is exactly the wrong way to think in a corporate culture. Releasing full details before patches are available increases the risk to the customers. Not all linux systems run webservers you know. Many systems must go through rigorous testing before any maintenance is applied so as not to introduce regressions. Perhaps the machine cant come down for amintenance for another 3 months? This means that a production server could be months behind on security maintenance, sending the full details of how to exploit that doesnt sound like the best idea to me.

      Red Hat are putting their customers first which is exactly what I'd expect them to do.

      --
      I have discovered a truly remarkable sig which this post is too small to contain.
    3. Re:I don't see this as anti FOSS by rahvin112 · · Score: 2, Informative

      And most importantly, as a public company Redhat likely notified the FBI of the breach and the FBI told them they couldn't reveal any details until the investigation was complete under penalty of being charged with interfering with an investigation. This is SOP for the FBI, they don't want details out there so that if they question the actual person that did the break in and he/she reveals details that aren't public they can use it against him/her in court.

    4. Re:I don't see this as anti FOSS by Anonymous Coward · · Score: 0

      If I was violated, I think I'd like to take a moment to do a "self-check" on all of my important bits before I started telling everyone all of the nitty-gritty details.

      Considering where you are, I doubt anybody would be interested in being near you, much less violating you.

  20. The Jury is Still Out by bill_mcgonigle · · Score: 5, Interesting

    IT managers now know that RH is going to go unresponsive when there's a problem.

    The issue isn't even fully known, so you're jumping to conclusions.

    For some reason Fedora has to re-key all their repos and, while I think that's done, it's still being mirrored. One would assume a signing key has been lost.

    Redhat isn't doing that. They apparently have a signing server, and a user's credentials were apparently lost, and some packages got signed, but not put in the repos. If you run a RedHat machine and get an unsolicited contact to install some new OpenSSH packages - don't.

    I think Fedora has the bigger problem at the moment. Let them work through the problem, they know how to do this. When the users are safe (still an ongoing topic of discussion on how to best ensure this) my guess is they'll be releasing more information. I further suspect we'll learn that prior disclosure would have put users at more risk. We'll see.

    How can they trust Red Hat again?

    Historically the Fedora guys have been trustworthy to the extreme. That's why not everybody is jumping on them right now, despite the distro-partisans who smell blood in the water. Again, we'll re-evaluate our position on that once the dust settles.

    --
    My God, it's Full of Source!
    OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    1. Re:The Jury is Still Out by awrowe · · Score: 1

      I'm a relative newcomer to open source politics and whats more, I know very little beyond the basics about Red Hat/Fedora, but is it possible Fedora is re-keying all their repos because they no longer trust the Red Hat ones? Losing a signing key might be the reason, but coming so soon after Red Hat's security breach, I don't think so.

      Just looking at the body language here, I think Fedora is more grumpy about the way Red Hat is dealing with this than they are letting on.

      'Course I could be completely wrong, but thats what it reads like to me.

      --
      A.I. Research. The peculiar science in which we know the question and we know the answer, but can't show the working
    2. Re:The Jury is Still Out by Jellybob · · Score: 1

      You're definately new. Fedora is the development/free version of Red Hat, using largely the same packages, and managed by the same company.

    3. Re:The Jury is Still Out by awrowe · · Score: 1

      I realise that.

      However, from what I can see, either the fedora team haven't been told the whole story and are grumpy about it, or the fedora team have some autonomy and RH don't trust them not to spill the beans, making fedora purse lipped about the lack of trust.

      Yes, they both dip from the same well, but to some extent they must be separate organisations.

      --
      A.I. Research. The peculiar science in which we know the question and we know the answer, but can't show the working
    4. Re:The Jury is Still Out by WindShadow · · Score: 1

      IT managers now know that RH is going to go unresponsive when there's a problem.

      The issue isn't even fully known, so you're jumping to conclusions.

      For some reason Fedora has to re-key all their repos and, while I think that's done, it's still being mirrored. One would assume a signing key has been lost.

      Redhat isn't doing that. They apparently have a signing server, and a user's credentials were apparently lost, and some packages got signed, but not put in the repos. If you run a RedHat machine and get an unsolicited contact to install some new OpenSSH packages - don't.

      Given that enterprise RHEL and CentOS users did get a notify that there was an updated ssh package at that time, are you claiming that it was a forgery rather than a preemptive fix? This is either big news or bad advice.

    5. Re:The Jury is Still Out by bill_mcgonigle · · Score: 1

      Given that enterprise RHEL and CentOS users did get a notify that there was an updated ssh package at that time, are you claiming that it was a forgery rather than a preemptive fix? This is either big news or bad advice.

      Don't take me as a primary news source, but I heard there was an OpenSSH package that got signed that wasn't legit. But it never made it to any channels, the sysadmin would have to be tricked into installing it.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  21. The jury must be very patient, indeed by Bruce+Perens · · Score: 4, Insightful

    The issue isn't even fully known, so you're jumping to conclusions.

    I would have phrased it differently: The issue isn't fully known, thus there's a problem.

    There's been quite a lot of time.

    1. Re:The jury must be very patient, indeed by bill_mcgonigle · · Score: 3, Informative

      I would have phrased it differently: The issue isn't fully known, thus there's a problem.

      There's been quite a lot of time.

      That's true. The issue is can you say confidently that disclosure of the problem wouldn't put users at risk?

      That's the only reasonable reason for the delay that I can see. Since these guys are usually quite reasonable I'm making the assumption that's what's going on (or something I've completely missed). It may turn out my trust was misplaced - we should know shortly. Jessee Keating just announced updates are going out to the mirrors since I last posted.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    2. Re:The jury must be very patient, indeed by Bruce+Perens · · Score: 1
      That's true. The issue is can you say confidently that disclosure of the problem wouldn't put users at risk?

      Well, in Red Hat's position, I would have pushed out fixes already if that was the case. And there's no evidence that they've done so.

      Bruce

    3. Re:The jury must be very patient, indeed by HiThere · · Score: 1

      Were THAT the problem, then one would have expected for them to have told us so.

      Note that it's not inherently necessary for details to be disclosed, merely for the communication to be honest, and not intentionally confusing. They have failed at this.

      I presume that there is SOME legitimate, or at least quasi-legitimate, reason for their actions. Unfortunately it appears that the technicians talked to the PR guys who talked to the lawyers who talked to other PR guys and told them what to say. Almost no information made it's way through the chain of translation. And what did get through merely served to cast suspicion upon the rest. I'm not saying that everyone involved wasn't well intentioned. Merely that this is not a way to create trust. In the ideal world the technicians would have written the PR release, passed it to PR for vetting. It would have cycled back and forth a few times. Then the lawyers would have criticized it, and the techs would have rewritten it to their criteria. This clearly isn't what happened.

      When PR writes to techs, the techs tend to rightfully distrust what is said, even when it's not clearly wrong. This is from lots of bitter experience. When the message has been stripped of useful information, then the distrust escalates, and a bit of bitterness is added.

      I don't distrust Red Hat's intent here, but I certainly distrust their communication. And I'm made slightly dubious about even their intent, even though I'm fairly certain that it's just a lousy bureaucratic organization.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
    4. Re:The jury must be very patient, indeed by bill_mcgonigle · · Score: 1

      I don't distrust Red Hat's intent here, but I certainly distrust their communication. And I'm made slightly dubious about even their intent, even though I'm fairly certain that it's just a lousy bureaucratic organization.

      Very well put. I hope that's all it is.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  22. So what exactly is Red Hat hiding? by Rolman · · Score: 4, Insightful

    OK, some servers got hacked, the attackers didn't inject rogue packages into the repository servers so no customers/users were affected. Red Hat/Fedora responded by auditing everything and releasing a statement, along with tools to detect packages with the attackers' signature. Big deal.

    Seriously, what else is there to be known about it?

    Yeah, say whatever you want, but it's not as if Debian never had its servers compromised in a similar fashion, and never had to perform some PR damage control.

    Unlike Debian, Red Hat is a publicly traded company with a whole bunch of customers with signed SLAs. Handling such matters without press trolls all rolling over it spreading FUD and causing unnecessary panic is _not_ an easy task, as can be beautifully shown by TFA.

    I respectfully disagree with Bruce Perens. The Debian OpenSSL fiasco was so much more serious, damaging and dangerous to users all over the world, it's not even fair to compare. We're talking about millions of known networks and sessions compromised in Debian over a year and a half period, versus none in Red Hat over a week.

    I appreciate how Debian acted _after_ the fact, but was there any other way to handle such a terrible mishap?

    This is not about flawed Open Source policies, this is about seriously flawed journalism, where conspiracy theories are used to make a story where there is none.

    --
    - Otaku no naka no otaku, otaking da!!!
    1. Re:So what exactly is Red Hat hiding? by Intrinsic · · Score: 1

      Yea I tended to agree with this. I RTFA and it just sounds like he wants to look like he his right about this whole issue. I think he is going over the top with his ranting and raving. Its reads like someone personally attacked him and now he is fighting back.

    2. Re:So what exactly is Red Hat hiding? by Anonymous Coward · · Score: 0

      The Debian OpenSSL fiasco was so much more serious, damaging and dangerous to users all over the world, it's not even fair to compare. We're talking about millions of known networks and sessions compromised in Debian over a year and a half period, versus none in Red Hat over a week.

      Ah, but that's because we don't know how many RH based compromises are happening. For all you (we) know, it could be an issue in the source tree. It could be far deeper rooted. And it could be that RH is trying to figure out how to address the issue for all of their customers (and all of the RH derivative projects).

      Or (as I am not reading this anywhere), it could just be that RH has no fucking idea how it happened, which is far scarier.

    3. Re:So what exactly is Red Hat hiding? by aproposofwhat · · Score: 1

      OK, some servers got hacked, the attackers didn't inject rogue packages into the repository servers so no customers/users were affected. Red Hat/Fedora responded by auditing everything and releasing a statement [redhat.com], along with tools [redhat.com] to detect packages with the attackers' signature. Big deal.

      Hmmm...

      On the one hand, no customers/users were affected.

      On the other, Red Hat released tools to detect the affected packages.

      If no customers were affected, why release the tools?

      Something does not add up here.

      --
      One swallow does not a fellatrix make
    4. Re:So what exactly is Red Hat hiding? by Rolman · · Score: 1

      One word: mirrors

      The main repositories may have not been compromised, but there's the possibility you're getting a backdoored package if you're downloading from a mirror that was somehow compromised and is not yet in sync.

      --
      - Otaku no naka no otaku, otaking da!!!
    5. Re:So what exactly is Red Hat hiding? by iburrell · · Score: 1

      I would not be surprised if the breach was caused by the Debian OpenSSL fiasco. A user account with a weak key could have been compromised and escalated from there.

    6. Re:So what exactly is Red Hat hiding? by Anonymous Coward · · Score: 0

      One word: mirrors

      What, you mean a mirror of RHEL that isn't under Red Hat control? A third-party mirror? Where?

    7. Re:So what exactly is Red Hat hiding? by Rolman · · Score: 1

      1) Fedora mirrors managed by community members in many countries (Fedora was attacked, too)
      2) CentOS mirrors (Their releases are behind Red Hat's, even for months)
      3) RHEL/CentOS repositories not pertaining to the distribution, eg. centosplus (which contains packages with bumped versions and can easily supercede openssh 'accidentally')
      4) Red Hat Satellite / Spacewalk inside organizations, behind firewalls/proxies so not in sync all the time and vulnerable to local exploits
      5) Thousands of repositories created with the createrepo command on public servers

      This is *Open Source*, right? Releasing tools to detect rogue packages even if you're using other sources (read: not coming from RHN) was just the responsible thing to do ;)

      --
      - Otaku no naka no otaku, otaking da!!!
  23. Re:Affecting me to effect change has a good effect by Bruce+Perens · · Score: 1, Informative
    People have been dinging me on Effect vs. Affect for 3 decades. They are all right and all wrong, because legitimate dictionaries give one of the definitions of "affect" as "to have an effect upon".

    Emerson to them all!

  24. New Fedora Key by FrankDrebin · · Score: 5, Informative

    TFA says:

    However, as of September 8, the crisis continues, with Fedora users still unable to get security updates or bug-fixes.

    Not true. Go here: https://fedoraproject.org/wiki/Enabling_new_signing_key, follow the instructions and voila... updates available.

    --
    Anybody want a peanut?
  25. Re:Affecting me to effect change has a good effect by 75th+Trombone · · Score: 2, Informative

    "Affect" DOES mean "to have an effect upon". That's not the disputed definition.

    Perhaps when you switch them in your defense of your chronic switching of them, that's evidence that you're wronger than the other wrong people. :)

    [Meant lightheartedly, I don't honestly care what you type.]

    --
    The United States of America: We do what we must because we can.
  26. It ain't over yet by pembo13 · · Score: 2, Insightful

    You can't really say they are keeping things quiet while things are still in progress. This isn't being swept under the rug, this seems to be pursued in all areas currently. If after everything, there is still no more information, then that is a story.

    --
    "Thanks for all the money you paid to us. We've used it to buy off ISO among other things" -Microsoft
    1. Re:It ain't over yet by Anonymous Coward · · Score: 0

      It isn't over, but it *has* been an unusually long time for the few vague statements issued so far to be "enough".

  27. Re:Affecting me to effect change has a good effect by Anonymous Coward · · Score: 1, Informative

    legitimate dictionaries give one of the definitions of "affect" as "to have an effect upon".

    Indeed. Though you have attacked the wrong horn of the problem.

    Affect = to have an effect on; to influence [something pre-existing]
    Effect = to bring about, to implement [until finalized, hence more than an influence]; to cause to come into being [something not pre-existing]

    It can't be easier for a non-native English speaker than for a native one, or can it?

  28. Which law? Quotes please. by jotaeleemeese · · Score: 4, Interesting

    I see very often this quoted without any substantiation.

    I thought that the responsibility of a company was to stick to whatever they say they will do in their chapters of incorporation, then shareholders sharing that vision would finance the venture.

    If the companies' own rules mandate that openness and accountability are part of how the company functions, and shareholders used their judgement and accepted that, profit may take a second seat in the view that in the long term, the business strategy of transparency is deemed to be necessary in turn to make the enterprise profitable.

    The problem with many investors is their short-sighted, quarterly short termism and companies that do not ensure ways to handle that in a way that makes sense in a longer term.

    --
    IANAL but write like a drunk one.
  29. Well yes. by jotaeleemeese · · Score: 1, Insightful

    But they already know what happened.

    You would expect they disclose what went wrong, that would save time and money to everybody.

    Now, how can anybody running a Red Hat system know it is safe?

    Openness is an advantage over closed systems, and it is why many of us buy from companies that are more open, in all the senses of the world.

    Losing sight of what makes them different, and thus desirable, is a recipe for financial trouble (their lawyers will be paid in any way, so they should actually use them to ensure maximum disclosure).

    --
    IANAL but write like a drunk one.
  30. You can rebuild everything from a known base. by jotaeleemeese · · Score: 1

    At some point, you should have a compiler that is consider clean. You use that to compile, from reviewed source code, the latest and greatest compiler and generate the rest from there.

    --
    IANAL but write like a drunk one.
    1. Re:You can rebuild everything from a known base. by eggnoglatte · · Score: 2, Insightful

      Well, gee. Thanks for explaining the meaning of "bootstrapping" to me.

      The problem is: when can you consider a compiler "clean"? The only way to be sure is to develop it yourself in machine language (no, you can't even use an assembler, because it could generate a backdoor, too), or to fully scrutinize the machine language of an existing compiler binary.

      In practice, if you are using gcc, you have a compiler that has been recompiled by itself over and over again for at least a decade. Can you be absolutely sure that there wasn't somebody somewhere in that chain who added some malicious code that has propagated on? Not unless you audit the machine code of a specific gcc binary. The most likely party to have performed such an audit would be the NSA, but I am not sure I would trust them if they report there is no backdoor (in fact, they are pretty high on the list of who might want to plant a backdoor to begin with).

    2. Re:You can rebuild everything from a known base. by __aairzc8228 · · Score: 2, Interesting

      You could just build yourself a tiny ELF binary with it and take a look..

  31. Buy your "What Would Debian Do?" wristbands... by mapnjd · · Score: 1

    While Bruce and Debian are probably right, I do feel a certain "holier than thou" approach going on here.

    If you owned a company and a junior engineer had done something _really_ stupid, you may not want to fully disclose the incompetence of one person as it would make your whole company look that bad.

    In that case, a bit of corporate blather may look better than full disclosure...

    --
    Bus error in your favour. Collect 200kB
  32. We do have Feodra's account of the incident by Sits · · Score: 2, Informative

    For some reason Fedora has to re-key all their repos and, while I think that's done, it's still being mirrored. One would assume a signing key has been lost.

    Have you already read the Fedora report? Fedora did release a report about the incident. Within it they say that while an attacker was able to reach a Fedora signing system they do not believe that the key's passphrase was compromised. However it states that as precaution they have decided to create a new key.

    The Red Hat side of things is different and far... trickier. I point you towards this LWN article about the intrusion as I think it's hard to say such simple statements about it.

  33. No.Consider Red Hat's legal position vs. Debian's by Anonymous Coward · · Score: 1, Insightful
    Byfield doesn't notice that there is a legal issue here. He cites the Board Minutes, which make clear what the issue is, and it's not a "corporate interests first" deal:

    Ongoing tension between Fedora being able to act independently and Red Hat being liable for Fedora's actions...

    * one potential flow through could be Red Hat Legal

    I think that is sufficiently clear, that there were legal concerns, that Red Hat has certain responsibilities and so it *has* to get Fedora to cooperate, and lawyers are naturally going to ask people to behave responsibly and in harmony with certain known best practices. That's not anti FOSS. It's anti STUPID.

    Debian... well, who is tempted to sue them? Red Hat, with deep pockets, is a target. It's apples and oranges. Byfield betrays his bias, which is Novell, good; everyone else, bad. And he shows he missed the actual answer to the why question. Bias works like that. You can't see the forest because you already have mapped out the trees you like to get where you plan to end up. Without the bias, he might have noticed those phrases and if he doesn't understand the law, he could have inquired. When you want to bad mouth someone, it's cheap and easy to do it, but it leaves a bad taste in the mouth of your readers.

  34. Re:Affecting me to effect change has a good effect by Anonymous Coward · · Score: 0

    Disregard that, OP has it wrong, sucks etc etc

  35. How is this "ignoring FOSS"? by itsdapead · · Score: 5, Informative

    If Red Hat, one of the epitomes of a successful FOSS-based business, can ignore FOSS when to do so is corporately convenient

    Sorry, but I must have missed the clause in the GPL that requires full and immediate public disclosure of any security breach on your servers, or a duty to maintain 100% availability.

    OTOH I do remember loads of stuff in the GPL about how there was no warranty.

    There also seems to be a presumption that this "breach" represents some sort of systemic vulnerability in the Fedora/Red Hat product - TFA and several comments here reference the Debian SSL problem. What about the good old standbys of "inside job", "social engineering", "weak password" or "bugger, I knew I should have password-protected my SSH key"?

    What if they're planning to fire someones ass, or even press criminal charges over the incident? That would place serious restrictions on what they could publicly announce.

    --
    In a survey of 100 programmers, 111111 thought that duck-typing was a good idea.
  36. Fedora 9 Yum updates by smartin · · Score: 1

    I've noticed that all updates for Fedora 9 have stopped since this happened. Have they released any information about when they will start again?

    --
    The difference between Canada and the USA is that in Canada healthcare is a right and gun ownership is a privilege.
    1. Re:Fedora 9 Yum updates by betterunixthanunix · · Score: 1

      Today, actually. I am updating right now.

      --
      Palm trees and 8
  37. Ubuntu astroturfing by Anonymous Coward · · Score: 0

    So this is what it looks like when Ubuntu fanboys start astroturfing....

  38. Hat shortage? by MrMickS · · Score: 3, Funny

    I initially read the article title as The Fedora Hat Crisis. I was wondering if there was a hat shortage brought about by FOSS people wanting to Cosplay. I now realise my error but have this mental imagine of people walking into a Linux conference all bedecked in red Fedoras.

    --
    You may think me a tired, old, cynic. I'd have to disagree about the tired bit.
  39. Re:Affecting me to effect change has a good effect by Anonymous Coward · · Score: 0

    Sure it can. A non-native speaker doesn't have an entire lifetime of bad habit to overcome.

    I personally haven't ever had much of a problem sorting affect from effect, but the word significant, for example, has always been an issue for me.

    My inclination is always to spell it signifigant, because that's how it's generally pronounced in my accent. I was nearly twenty before I really came to grips with the error, and even though I know quite well how to spell it these days, if I'm typing quickly or thinking more about the content of my writing than its immediate form, signifigant tends to slip out even now.

  40. Re:Affecting me to effect change has a good effect by Shimmer · · Score: 2, Informative

    I hope they continue to ding you, because you still have it wrong. Here's a rule that works 99% of the time:

    • "Affect" is a verb.
    • "Effect" is a noun.

    So if you find yourself writing "effected" again, all you have to do is recognize that you want a verb and then use "affected" instead.

    --
    The most rabid believers in American Exceptionalism are the exact same people whose policies are destroying it.
  41. Fallacious Questions by darkvizier · · Score: 1

    'If Red Hat, one of the epitomes of a successful FOSS-based business, can ignore FOSS when to do so is corporately convenient, then what chance do we have that other companies - especially publicly-traded ones - will act any better?'

    If a Linux journalist asks fallacious questions, then what hope do we have for the rest of the media?

  42. Fedora updates have just been re-enabled by stupido · · Score: 2, Informative

    https://www.redhat.com/archives/fedora-devel-list/2008-September/msg00842.html

    In due time you can probably expect a more complete picture of what happened. I think the "Fedora/RedHat keeps us in the dark" view is overly alarmist.

  43. Track record by nurb432 · · Score: 1

    If you look at the track record of most linux 'organizations', the long term solution is clear: FreeBSD.
    And no its not a troll, just take a look at how most of the companies formed to distribute linux have 'evolved' over the years: From 'we love OSS, love us too', to 'we are now commercial, pay up or be sued' to 'we are folding, help us'. ( Tho i must say that Debian is the lone exception to the rule, they have been consistant with their goals from day one. )
    At least in the FreeBSD world its been consistant and you know what to expect, and can plan ahead accordingly

    --
    ---- Booth was a patriot ----
  44. I am not sure you are fully informed. by Anonymous Coward · · Score: 0

    Bruce, I'm a Red Hat customer, and they told me what was going on. From what I read here it seems pretty clear most people did not get the information I got (rather early on).

    You are right that there are problems for Fedora inherent in the way this incident played out. But there are no issues for (paying) users of Red Hat Network.

    Someone got access to a system inside Red Hat's firewalls. That person was able to submit some packages to the signing queue, which is hardware restricted in order to prevent anyone from stealing the private keys. This was detected by Red Hat. The intruder is believed to have gotten away with copies of the signed packages, but those packages were never placed in any distribution channel controlled by Red Hat.

    This means that someone, somewhere, has the ability to compromise systems that are being run in violation of Red Hat's customer agreements and US trademark laws. Persons who have entered into contracts with Red Hat have no problems; in fact Red Hat went out of their way to provide their paying customers with extra protection by distributing a detection tool and by publishing a higher version in their distribution channels.

    CentOS removes Red Hat's trademarks from the Red Hat packages that CentOS is based on. CentOS is legal as far as Red Hat is concerned. Loading bootleg Red Hat Enterprise Linux packages that have not been sanitized CentOS-fashion is arguably illegal for anyone, and a violation of the Red Hat EULA for Red Hat Enterprise Linux customers. So, in a sense Red Hat could say "serves you right, cheater" if you got bit by this. They have not done so.

    There have been other incidents at Red Hat; for example a disgruntled ex-employee sold a list of customer e-mail addresses to spammers. Red Hat does not tell people who are not customers about these incidents, it's restricted to paying customers only. They rather aggressively and quite effectively went after the spammers, BTW, which I'm sure you realize is very difficult.

    Fedora needs to shake off all Red Hat controls, yes, OK, you have a good solid point. There is definitely a trust issue for Fedora. But paying Red Hat customers know that Red Hat's activities essentially put Red Hat Network customers first and the Fedora community a distant second, so I don't think your analysis of the impact of Red Hat's decision on IT managers is anywhere near correct.

    --Charlie

    PS: Is anyone considering that the criminals who stole the signed packages might have access to a botnet sufficiently powerful to derive the super-seekret Red Hat private key? That's what I'd be worrying about if I were a techie at Red Hat, and I'd be putting in a new key tout de suite just in case.

    --C

  45. Nah, you didn't understand by Nicolas+MONNET · · Score: 1

    Not sure if it's actually true, but here's what the author is saying.
    Say you have GCC5.2 installed, and you're compiling GCC5.3 from source.
    It will compile gcc53a from the 5.3 sources with the GCC 5.2. It will then use gcc53a to compile gcc53b, and gcc53b to compile a gcc53c. 53b and 53c should be equal (but not 53a with either).

    1. Re:Nah, you didn't understand by ozphx · · Score: 2, Informative

      Ah I see.

      Still if 5.2 is trojaned then it will take the clean 5.3 source and emit gcc53at. 53at will then emit 53bt. 53bt will then emit 53ct.

      53b and 53c should be equal, and the trojan will also be equal, so 53bt == 53ct. You could comsider the trojan as part of an "optimisation pass", which will be performed by all builds of gcc.

      A trojan compiler that always compiled printf with an extra check for if("crashme") exit; and always compiled the preprocessor with the printf mangler would always emit:
      * A compiler that repeatably compiles printf with the trojan.
      * A compiler that repeatably compiles the preprocessor with the trojanned preprocessor.

      --
      3laws: No freebies, no backsies, GTFO.
  46. Corporately conevnient? by Anonymous Coward · · Score: 0

    Companies do stuff because it's corporately convenient. It's their job, it's their business, that's what companies do. Collect your toys, grow up, and come back when you have understood the world a little bit.

  47. Sign. I *usually* like Red Hat by HiThere · · Score: 2, Interesting

    I usually like Red Hat, but every once in awhile they do a really abusive something. This is another.

    I was a Red Hat customer for years. Then they dropped the professional edition without ANY warning. Fedora didn't show up for over a year (or so it seemed). Well, now I use Debian, and occasionally investigate one of the other distributions. (Ubuntu, Mandrake*, one of the small ones...NOT Novell's offering. I don't trust them.)

    I still want to trust Red Hat. I feel that their corporate intentions are honorable...most of the time. OTOH, I'm not about the rely on them again. They aren't trustworthy, merely well intentioned. So I want to trust them, but I know it's a bad idea.

    OTOH, CentOS *seems* to have come through this without scars. Their comments indicate that they got cooperation from Red Hat in containing the problem. Perhaps companies can trust Red Hat more than individuals can...perhaps. Or maybe they were just lucky this time.

    *I know they're officially Mandriva, but that's for garbage legal reasons. To me they're still Mandrake. (This isn't totally good. They've pulled some boners too.)

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  48. Public traded companies and ongoing investigations by buysse · · Score: 2

    Debian's a non-profit. Comparing the two isn't useful, for a couple of simple reasons. If a Debian build server is owned, what's the financial damage, and to who? How about Redhat?

    It's a lot easier for RH to show direct and indirect financial damage due to a breach, which brings in the FBI. Once the FBI is involved, your whole reply is a "No comment." It's an ongoing federal investigation. If somebody found the trojaned openssh on a DoD server, you can bet that the NSA is probably involved as well.

    Once the feds are involved, their hands are tied. If I'm right, it took a lot of work and negotiation by the lawyers to release as much info as they did.

    --
    -30-
  49. I for one agree with Red Hat's approach on this... by McNihil · · Score: 2, Interesting

    one. It was pretty evident there was something being done because none of the update servers were available. By knowing this it was just a matter of minutes to realize that something fundamental was wrong. Me knee jerk reaction was to conclude that they had been compromised to some extent and that spawned an special hands-on audit on all of my systems running with any derivative of Red Hat. Less than a day after we get a post telling us that they are working on it... meaning it is deep and they haven't found the rabbit in the hole yet. For me this is enough information to go in "extra alert mode" on all my machines that would be in the realm of the same problems.

    remote logins log checking being a mere fraction of the full audit.

    What is the diff against Microsoft and similar? Big difference... I had the choice to compile my version of sshd (and other remote offerings) and prep it on the servers that I had that could potentially be effected by a bad transient build. I could do the diff between the updated packages if there was any, on source level. Maybe this is going too far BUT at least it gave me the option to do my stuff pre-emptively while waiting for the final dictum from Red Hat and their investigation. I call this Pro-active guarding.

    Most likely... once all major customers had done something similar they were able to disclose a bit more of the problem.

  50. I have a referencing trusting trust rule by Sits · · Score: 2, Insightful

    Anyone who mentions Ken Thompson's Reflections on Trusting Trustshould also mention David A. Wheeler's "Countering Trusting Trust". Those who don't should be punished by having to argue both sides of the debate.

    I occasionally post the counter argument in a reply but no one sees it... Next time you see someone else with this behaviour tr, here's ammo for countering it.

    (I believe the gcc rebuilds aren't so much to remove this type of intentional bugging but rather ensure the final binary is free from things like first compilation optimisation issues... Comparing the compiler binaries would probably indicate differences due to things like dates being present BUT hopefully what they would output on a given source would be the same)

    1. Re:I have a referencing trusting trust rule by Bill,+Shooter+of+Bul · · Score: 1

      Yeah, I think thats because its not a convincing counter argument. You have to have a trusted computer to start with. How the heck do you get that? And if you had that, what's the point? Just always pull a magical trusted computer out of the sky.

      --
      Well.. maybe. Or Maybe not. But Definitely not sort of.
  51. Dinging to effect change has little effect :) by ReedYoung · · Score: 1

    Emerson to them all!

    Emerson? The poet, Ralph Waldo? What about him?

    People have been dinging me on Effect vs. Affect for 3 decades. They are all right and all wrong, because legitimate dictionaries give one of the definitions of "affect" (verb) as "to have (verb) an effect (noun) upon".

    Unfortunately, when one attempts to just verb the noun "effect," the different usage also affects its meaning. A verb "effect" does exist, but it means "to cause, or to bring into existence," as in "Bruce Perens was instrumental in effecting the 'Open Source Definition,' and continues to effect changes to it, as well as affecting changes effected by others."

    I'm always careful to get these things right, because one never knows when one will meet a stickler who not only knows such trivia, but will tell point it out when you're wrong. Also, it's a far more stable subject to master than computer security. Less logical, in English, but the stupid rules are the same as they were 10 years ago.

    I think of compulsive grammarian disorder like body odor; if nobody in your circle of acquaintances is annoyingly attentive to grammar, it's probably you. And I don't know anybody more careful about grammar than me.

    :D

    --
    "I can't imagine how things could get any worse!" (some guy) "That could just be failure of imaginatioÂn on your p
    1. Re:Dinging to effect change has little effect :) by Bruce+Perens · · Score: 1

      Emerson? The poet, Ralph Waldo? What about him?

      His famous quote: a foolish consistency is the hobgoblin of little minds.

  52. Re:Sign. I *usually* like Red Hat by LordMorgul · · Score: 1

    HiThere: "Then they dropped the professional edition without ANY warning." Yikes, you weren't paying much attention at that time, as I was only using RH at home to tinker with and was WELL AWARE of the warning and timelines when that happened.

  53. Countering Trusting Trust should be required by Sits · · Score: 1

    ...reading for anyone who references Trusting Trust alone! Here are links to the original Ken Thompson's "Reflections on Trusting Trust" (HTML/non-PDF version) and David A. Wheeler's "Countering Trusting Trust" which offers potential solutions to the issues raised in the original.

    Basically so long as I have another set of compilers AND at least one is trustworthy then there is process I can follow to build a compiler I can trust (but where it would help to have the compiler sources). There are other reasons why such an issue might find it hard to propagate in a changing software stack but that's a side note.

    This seems to be a very popular Slashdot meme - people keep mentioning Trusting Trust without also answering the points offered in more recent literature.

  54. Re:Sign. I *usually* like Red Hat by HiThere · · Score: 1

    Perhaps so. I knew that they were planning *some* changes, but they were always planning some changes. I didn't find out what the changes were until they had already been implemented.

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  55. ...don't be hatin' ! by Anonymous Coward · · Score: 0

    i don't know about Red Hat (which a different story anyway - are'nt those, who complain now, the same ones, who called the Red Hat admins, after they makde the exploit public paranoid? in this business you can never be paranoid enough, if you ask me...), but pointing fingers at Debian is'nt fair. haven'nt you even ever read that programs are "distributed in the hope that they will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE"? linux is'nt really much more safer than anything else. you got to know how to secure it and do it yourself. i use Debian for everything, even for routing and firewalling, and was'nt annoyed when i heard of the ssl thingy (by the way:there are still people using lsh, you know). what shell's? is there any distro out there that profound and versatile at once? i don't think so. instead of mocking around, you should all be thankful for how much effort the Debian folks put into making a high quality OS for free and being honest at the same time about it's flaws over years. money can't buy you 100% security, because there's nothing which could be granted to be sure for "100%". Debian _IS_ useful and i give a damn fuck about warranties anyway...

  56. here's how I remember it by tacokill · · Score: 1

    affect is a verb
    effect is a noun

    Yea, I know - it's not perfect. But it does help me keep them straight...

  57. Seething fucking rage by mrmeval · · Score: 1

    I had a harddrive fail so I grabbed Fedora Core 9 and it had me frothing worse than Vista.

    I now run Debian and it has taken some effort to unravel some of their idiocy concerning media players, orphaned software and other annoyances it does work.

    I despise guhnome.

    --
    I'd go on a Vegan diet but the delivery time from Vega is too long. --brownkitty
  58. 6 August 2001 by ReedYoung · · Score: 1

    Just because something can be done doesn't mean it actually happens. If I go to holidays and leave the door of my house open, it does not mean that something actually happens.

    What's your address, and when are you going on holiday next? I lock my door so any thief who decides my house is the one he wants to rob, at least has some obstacle. If I forgot to lock my door on my last holiday and nothing was stolen, it doesn't mean I would assume I would be so lucky every time, and intentionally leave the door open thereafter.

    There is no indication here at all that anyone externally found out about the problem before. It is basically that you found out that what you did over the last two years was vulnerable to potential attacks. How will it affect the future? Not at all, as the issue gets fixed.

    So, fixing the vulnerability is the right thing to do, as soon as you know it's vulnerable. Why wait until after it's been exploited, once you know you have a vulnerability that is greater than it could be? Minimize every identifiable risk, up to but not past the point that the cost equals the benefit. What's so difficult, or costly, about ditching a few keys and replacing with better ones?

    Ah, and right now no one unauthorised actually has the key yet. It is only technically possible to crack it much easier...

    To assume that a bad thing that has not happened yet therefore cannot happen in the future is very, very stupid -- whenever anything of value is involved. And of course we are discussing something of value, or else I wouldn't be bothering to argue about it. Would you?

    Nice try. The problem with Techies is that they don't get the larger picture. They focus on the blinking red herrings they are so used to and where they believe in.
    ...
    The whole signing shit is a troll for the privacy church. What they forget are the proportions and what is really important.

    I agree with some of what you've said above. For example your statement to the effect that RedHat generally is a positive contributor to the Open Source community is agreeable.

    RedHat as a company applies the usual tactics but as a community member gives a lot. Sure corporations are vulnerable to money. Novell is a good example...

    But I don't see good reasons for your other, general statements about signing, privacy, proportions, what is important, and whether patching known vulnerabilities before a known exploit occurs is a good idea. That seems to be what you're calling a "red herring" and that to me is absurd. Patching known vulnerabilities is clever like a fox.

    --
    "I can't imagine how things could get any worse!" (some guy) "That could just be failure of imaginatioÂn on your p
    1. Re:6 August 2001 by Elektroschock · · Score: 1

      Exactly, vulnerabilities need to get fixed. That is good. I don't see any negative news in the fact that it gets fixed.

  59. Don't forget... by Anonymous Coward · · Score: 0

    ...to pay your $699 licensing fee you cock smoking teabaggers!

  60. Diverse Double-Compiling by QuestionsNotAnswers · · Score: 2, Interesting

    When can you consider a compiler "clean"?

    Countering "Trusting Trust"

    If you have any concerns with that, they should be answered in: David A. Wheeler's Page on Countering Trusting Trust through Diverse Double-Compiling (Trojan Horse attacks on Compilers)

    If you find any holes in the theory that were not discussed, then consider writing up your findings for publication.

    --
    Happy moony
    1. Re:Diverse Double-Compiling by eggnoglatte · · Score: 1

      I'll quote from the overview paragraph of the second page you link:

      Simply recompile the source code twice: once with a second (trusted) compiler, and again using the result of the first compilation. If the result is bit-for-bit identical with the untrusted binary, then the source code accurately represents the binary.

      So, you have to have a trusted compiler to begin with, a classic chicken-and-egg problem. Clearly the method is better than doing nothing, but at the same time you can hardly claim that it completely solves the problem. The "trusted" compiler has its own chain of bootstrapping and potential attack vectors. In particular, if your "trusted" compiler is actually a compromised older version of the same code base as the new compiler, it is easy to see how the double compilation could miss the trojan.

    2. Re:Diverse Double-Compiling by QuestionsNotAnswers · · Score: 1
      From Schneier:

      Now you might read this and think: "What's the big deal? All I need to test if I have a trusted compiler is...another trusted compiler. Isn't it turtles all the way down?"

      Not really. You do have to trust a compiler, but you don't have to know beforehand which one you must trust. If you have the source code for compiler T, you can test it against compiler A. Basically, you still have to have at least one executable compiler you trust. But you don't have to know which one you should start trusting.

      And the definition of "trust" is much looser. This countermeasure will only fail if both A and T are infected in exactly the same way. The second compiler can be malicious; it just has to be malicious in some different way: i.e., it can't have the same triggers and payloads of the first. You can greatly increase the odds that the triggers/payloads are not identical by increasing diversity: using a compiler from a different era, on a different platform, without a common heritage, transforming the code, etc.

      Also, the only thing compiler B has to do is compile the compiler-under-test. It can be hideously slow, produce code that is hideously slow, or only work on a machine that hasn't been produced in a decade. You could create a compiler specifically for this task. And if you're really worried about "turtles all the way down," you can write Compiler B yourself for a computer you built yourself from vacuum tubes that you made yourself. Since Compiler B only has to occasionally recompile your "real" compiler, you can impose a lot of restrictions that you would never accept in a typical production-use compiler. And you can periodically check Compiler B's integrity using every other compiler out there.

      --
      Happy moony
  61. Gosh dangit by Anonymous Coward · · Score: 0

    Why does everything in this story have to be 'informative' or 'interesting'?!

    I come here for my humor, you insensitive clods.

  62. Hardware is more difficult but... by Sits · · Score: 1

    As mentioned in the counter argument article I'm not sure why double diverse could not be applied (using a range of "hardware") to help you ferret out the problem (assuming portable code). What you are saying is that every piece of hardware (old/new coupled with different architectures and VMs) I could choose to do testing with has been trojaned. It's not impossible but...

    I'm not saying it would be easy to find, I'm not even saying you wouldn't have to build/verify hardware yourself but I believe it could be made to exist if you had the resources and it didn't exist already.

    1. Re:Hardware is more difficult but... by Bill,+Shooter+of+Bul · · Score: 1

      I do think it could be done, I also think it would be very difficult in practice. I guess barring a situation where some one early on warped the minds of all compiler and hardware designers to include maliciousness in compiler generation, we are mostly safe and the Double diverse trick will work. But there is a part of me that realizes I can never be 100% sure of that, with out learning all of the Compiler and Chip design magic. Plus wasn't it Richie that came up with this? Probably, made it public so we wouldn't be suspicious of his Unix code.

      Paranoia is so easy to fall for, the only way to not succumb is to be paranoid about paranoia.

      --
      Well.. maybe. Or Maybe not. But Definitely not sort of.
  63. Re:Distrubing, is this a real problem? by Anonymous Coward · · Score: 0

    Mr. Byfield is known for slinging mud on free software.

    No, Mr. Byfield is known for bitch-slapping Slashdot trolls who try to take their "Look At Me, Everybody! I Hate Microsoft! LOOK AT ME!!!" act on the road.