Slashdot Mirror


What To Do When an Advised BIOS Upgrade Is Bad?

Bomarc writes "Twice now I've been advised to 'flash the BIOS to the latest,' once by a (major) hard drive controller maker (RAID); once by an OEM (who listed the update as 'critical,' and has removed older versions of the BIOS). Both times, the update has bricked an expensive piece of equipment. Both times, the response after the failed flash was 'It's not our problem, it's out of warranty.' Given that they recommended / advised that the unit be upgraded, shouldn't they shoulder the responsibility of BIOS upgrade failure? Also, if their design had sockets rather than soldering on parts, one could R/R the faulty part (BIOS chip), rather than going to eBay and praying. Am I the only one that has experienced this type of problem? Have you been advised to upgrade a BIOS (firmware); and the upgrade bricked the part or system? If so, what did you do? Should I name the companies?"

31 of 467 comments (clear)

  1. Yes by platypusfriend · · Score: 5, Interesting

    You should name the companies.

    1. Re:Yes by Bomarc · · Score: 5, Informative
      Hard drive RAID controller: by LSI

      System: Dell PE 1950; critical update for the BMC controller.

      ... BTW: EMS firmware upgrade for the BSM V 2.50 bricked two motherboards. The motherboard for system #1 *may* have had a faulty BMC, however system #2 was working perfectly.

    2. Re:Yes by Bomarc · · Score: 4, Informative

      LSI: I ran into problems with later hard drives being recognized. I was advised to flash the BIOS. It bricked the controller. After the advice of "buy another"; I removed all of the (in service) LSI controllers, as the risk of data loss (and the need for later hard drive compatibility) forced me to remove them.

    3. Re:Yes by Z00L00K · · Score: 4, Insightful

      Yes - buy another is definitely going to make you buy one of their products again.

      Just tell them that you will look at competitors. And there are a few around to select between.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    4. Re:Yes by Anonymous Coward · · Score: 5, Informative

      What's the failure mode on each of {the BMC, the PERC}? I have some experience handling failures of this nature.

      In particular, it's been my experience that on some Dell models of that generation, if you update the BMC firmware without updating the NIC firmware as well, the BMC will fail to be reachable on the network. Fortunately a NIC F/W update fixes this readily enough.

      I wish they told you that.

      [Too lazy to log in.]

    5. Re:Yes by greg1104 · · Score: 5, Interesting

      I tell anyone who is considering a serious deployment of hardware RAID that they should buy two of the cards from day one, to have one in a backup server. Then you can run experiments on unrecognized drives or firmware updates on the backup. Also, if something fails on the main server, it increases the odds you'll be able to get to the data if it's still intact. Needing spares around is unfortunately part of the overhead of having this sort of hardware.

      RAID controllers are pretty low volume products compared to a lot of other computer parts. And the problem where a new drive doesn't work with an old controller is depressingly common too. You could just as easily run into this same issue with any other RAID hardware. LSI at least does keep updating things. I have a drawer full of old RAID cards that stopped being useful mainly because the manufacturer gave up on updates.

      Ever since 3ware was assimilated by LSI, there aren't many viable alternatives to them, if you must have hardware RAID. The only good reason to prefer it over software RAID nowadays, where you can move the drives anywhere and read them, is that booting is preserved in more failure cases. It's easy to let the boot area of a software RAID1 volume be mismatched.

    6. Re:Yes by Firethorn · · Score: 5, Insightful

      I don't mean to be a knob but I think the fault doesn't particularly lie with the vendor.

      I view it differently. The vender advised the work. If I called up Toyota and asked advice about something for my 10 year old truck*, while it might be out of warranty if their advice resulted in major damage I think they should be liable for something.

      Your advice seems to be along the lines of 'buy hundreds of thousands of dollars of equipment every year to replace equipment that is still functional solely to keep the warranty up'.

      That's not good for the company's wallet, the environment, etc...

      *Not that old yet, but still

      --
      I don't read AC A human right
    7. Re:Yes by lightknight · · Score: 5, Insightful

      Wait, wait, wait. A BIOS flash should (almost) completely erase the BIOS, then reprogram it.

      Are you telling me that some companies use incremental BIOS upgrades? And why?

      This is particularly worrying to me, as I have a SuperMicro L8i SAS controller I just installed in my main machine, and LSI is apparently behind the chipset.

      --
      I am John Hurt.
    8. Re:Yes by MikeBabcock · · Score: 5, Informative

      This is one of the many reasons I order Dell servers.

      One of the others being that their next-business-day 5 yr warranty really means next-business-day.

      --
      - Michael T. Babcock (Yes, I blog)
    9. Re:Yes by Anonymous Coward · · Score: 4, Informative

      Or, you know... Use RAID how it's intended: To guard against disk failure. It's never a replacement for backups.

      RAID is for availability of the system, not for keeping your data safe.

    10. Re:Yes by AmiMoJo · · Score: 4, Informative

      As usual Slashdot posters don't mention where they are, but in the UK you would still be able to get the controller fixed or partially refunded (plus possibly costs incurred due to having to switch brand) thanks to the Sale of Goods Act. Doesn't your country have any consumer protection from douchbag vendors?

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    11. Re:Yes by hairyfeet · · Score: 4, Insightful

      Moral of the story: If a company screws you NEVER buy from them again. Abit screwed me on their CPU support list which turned out if the chip wasn't released prior to the board? They didn't test squat, just looked at the voltage which of course doesn't magically tell you if the CPU will work so I never bought from them again, same thing with Biostar when I had to buy a new board because their CPU support list said the X6 was supported and it turned out that like Abit they were ONLY looking at the watts on the box and ignoring that later Phenoms have turbocore which requires a boost to wattage when it activates.

      At the end of the day all you can do is not buy from them again and warn others, just as I was warning others before it came out Nvidia had made a batch with faulty solder or how I warn people now that Seagate drives over 500GB seem to be having crazy high failure rates.

      I DO have a question though, what was the firmware number you were on and which did you try to upgrade to, if you remember? As I stated in an earlier posting a lot of those devices can NOT have in between firmware skipped without serious risk of bricking so I am curious whether you applied the previous updates and it still bricked, or if you tried to go straight to the latest and that is when it crapped out.

      --
      ACs don't waste your time replying, your posts are never seen by me.
    12. Re:Yes by Bomarc · · Score: 4, Insightful

      Why on earth are you repurposing ~7-10 year old server hardware?.

      I don't believe that just because it's old it should be thrown away. The speed is comparable with "modern" (current) equipment, the maintiance cost is less. I'm tired of "Oh, this is the latest, you must have it." I don't fall for that marketing hype, it's a shame that so many do.

    13. Re:Yes by X0563511 · · Score: 4, Insightful

      We protect the vendors from consumers, around here.

      --
      For large sets, this will be our guide even unto death, for the LORD will work for each type of data it is applied to...
    14. Re:Yes by dcollins117 · · Score: 4, Insightful

      LSI at least does keep updating things

      I admire your optimism, sir. Sure, the updates brick his controllers, but at least they come often. It's that glass-is-half-full spirit we don't see enough of these days.

    15. Re:Yes by DES · · Score: 5, Interesting

      I work for an organization that has a large number of Dell servers, all of them with 5-year support contracts: a mix of 4-hour and next-business-day. In my experience, Dell have never, ever, ever solved an issue within the specified period of time. They also frequently refuse to replace failing parts until after they've actually failed (which AFAIK is a breach of the support contract), and they once told me that six DIMMs were a “large order” that would take a week to fill (after I'd already spent a week just getting them to agree that they needed replacing). They simply don't give a shit. I've had far better experiences with HP, but they also far more expensive.

    16. Re:Yes by ChrisMaple · · Score: 4, Funny

      You should sue the schools that claim to have educated you.

      --
      Contribute to civilization: ari.aynrand.org/donate
  2. What you're really asking... by Let's+All+Be+Chinese · · Score: 5, Insightful

    is what the legal status of their "recommendations" is and whether you ought to sue them.

    The tried-and-true andwer to that is: Ask a lawyer. I'm quite sure it can and does swing either way depending on local laws and any number of details you haven't provided.

    1. Re:What you're really asking... by Anonymous Coward · · Score: 4, Interesting

      So if a company notifies me that my call may be recorded, does that count as two party consent if I want to record that call?

  3. hello, bob! (oblig. xkcd) by sdnoob · · Score: 5, Interesting
  4. Name names by edcheevy · · Score: 4, Interesting

    I generally exercise some degree of distrust towards computer manufacturer recommendations when my product is no longer under warranty and their legal team likely has them relatively well protected against your situation, but I'd definitely name names. Send a note to the Consumerist, find a few execs and contact them directly. It may be legal, but it's a dishonest approach for those companies to take. It doesn't cost you much time and energy to bring unwanted attention to the companies and that attention is sometimes enough to suddenly get your components replaced. It won't cause systematic change, but at least you're better off.

    Not one to miss an opportunity for a car analogy: if a critical recall fix bricked your ride, I think most everyone would agree it is the manufacturer's responsibility to make things right even if the vehicle is out of warranty. Of course, there's obviously more regulation involved and a more direct correlation to physical safety in the case of cars (i.e., you are putting yourself at risk of bodily harm if you choose to disregard the recall fix).

  5. Do a public service and let us know by Johnny+Loves+Linux · · Score: 5, Informative

    It's been almost 4 years since I built my last box. I'm planning on building another desktop this summer and would like to know who to avoid as I'm intending to purchase a motherboot that's supported by coreboot so I don't have to deal with UEFI. If there's a motherboard vendor doing evil stuff and they're listed I would like to avoid them if I can. Here's the link for supported motherboards: http://www.coreboot.org/Supported_Motherboards

    1. Re:Do a public service and let us know by SCPRedMage · · Score: 5, Insightful

      Corporations are not people; they do not care about you, nor should you truly care about them.

      The only thing corporations are concerned about are their bottom line; if doing something helps them profit, they'll do it. If doing something HURTS their bottom line (such as, oh, I don't know, paying taxes), they'll avoid doing it as best as they can.

      Any example you might provide to prove otherwise is only an example of image control, a calculated effort to improve their standing in the eyes of their consumers.

      Bottom line: report what corporations do. If it's bad, it'll help your fellow consumers avoid being screwed over. If it's good, it'll steer them towards companies that care enough about their image to not be total dickbags.

      --
      My sig can beat up your sig.
    2. Re:Do a public service and let us know by greenbird · · Score: 4, Insightful

      When corporations do not put out quality products or keep their customers happy, they end up being bankrupt corporations.

      Ummm...or end up getting bailed out with our tax dollars while the corporate upper management that drove said company to bankruptcy in the first place walks away with more money than they paid the entire bottom 80% of the employees over 10 years. Or in many cases only the second part...*cough* Nortel *cough*...

      Companies today don't look at how to make great products or keep their customers happy. Their multi-million dollar salaried CEOs simple look at how to get their bonuses triggered no matter how bad it screws up the company. That and figuring out which politicians to pay off and which lawyers to hire to kill off any potential competition.

      Hell if someone offered me millions of dollars to drive a healthy company into bankruptcy I'd be tempted to take it. Wouldn't you?

      --
      Who is John Galt?
  6. Don't fix it if it aint broke by flyingfsck · · Score: 5, Insightful

    If it is working, then an "upgrade" cannot make it better. It can only be the same or worse.

    --
    Excuse me, but please get off my Pennisetum Clandestinum, eh!
  7. Re:Flashed hundreds of devices - no problems. by Sipper · · Score: 4, Insightful

    It's you. I've flashed firmwares of hundreds of devices - motherboards, phones, video cards, embedded systems, routers, etc, and I have never once had one of them brick.

    That's not a fair statement, because the specific devices and firmware versions have not yet been stated, so your statement is completely based on an assumption based solely on your experiences, which may nor may not have any relevance to this hardware in question. Thus what you're doing is known as "blaming the victim".

  8. Ummmm, no by Sycraft-fu · · Score: 5, Informative

    That is not at all the case. BIOS/firmware/driver updates/upgrades can potentially do four things for a working system:

    1) Add new features. Many products get new features as their life goes on. My desktop board, an Intel, has gotten a number of new BIOS features during its life. When you update the code that runs something, no surprise that code can add features.

    2) Improve performance. Sometimes, a faster/more efficient way of doing something is discovered. It takes an update to make that happen. I remember a big one back in the day with 3com switches. A firmware update provided a major improvement in through put and CPU usage.

    3) Fix a bug that you haven't hit yet, but could. This is why you'll see updates tagged as urgent. Just because you never hit a bug that got discovered, doesn't mean the bug isn't there. So you want to get it fixed, BEFORE you hit it. There have been firmware updates that fixed some nasty ones, like data corruption with SSDs. Some people never got hit, but that doesn't mean the update wasn't a good idea.

    4) Security issues. Same deal as with the bugs, just a different kind of bug. If a security issue is discovered, it'll take a patch to fix it and the system will be working before the patch.

    The "Don't fix it if it ain't broke," really is not a valid ideology for systems administration.

  9. Re:Consider it a (technology) life lesson by Firethorn · · Score: 5, Interesting

    I think the most 'robust' anti-brick motherboard I've ever seen had two bios chips - and a hardware switch selecting which one was active. The active one was rendered read-only, you could only flash the inactive one.

    To update the machine you'd flash the inactive, power down the system, flip the switch, power back on and hope it worked*. If it worked, generally you just trucked on on 'B' instead of 'A', in case there was something hidden borked that you didn't find for a while. If the update was borked you simply powered down again and flipped the switch back.

    *Like with any bios update...

    --
    I don't read AC A human right
  10. Good Samaritan Laws by obtuse · · Score: 5, Insightful

    My main concern is this: If the manufacturer gets punished for failing to properly support out of warranty hardware, they'll just stop altogether. Too many manufacturers will already refuse to talk to you about out of warranty equipment.

    Since they tried to help, I'd prefer not to see them punished for this mistake. Think of it like good samaritan laws: They protect a person who stops to offer aid to the injured, from being sued.

    My other thought is that perhaps there was some hidden problem that something in the update triggered. Updates often have new functionality, or may write to memory not used before, so it isn't too hard to imagine them tickling an existing bug. For a car analogy, imagine you bought a used car from a friend and complained that it shook horribly at 75, but since your friend never went over 65 he never noticed when the tires and alignment deteriorated to that point.

    Finally, I'm appalled that they don't make old firmware versions available. That would be the appropriate response to your problem. Hopefully you can find someone helpful who has the old firmware around, either inside or outside the companies. Definitely appropriate for people to be warned that these updates can cause problems.

    --
    Assembly is the reverse of disassembly.
  11. It is possible to unbrick! I did it before by leehwtsohg · · Score: 5, Interesting

    I'm too far down for this comment to really matter, but in general, it is possible to unbrick a failed BIOS flash. The reason is that already for some time all (or maybe almost all) manufacturers have two parts of the BIOS - one that gets updated, and a second part that never does, or maybe can't. The second part (actually it is the first), only has very rudimentary software. It can read floppy disks, but not much more than that. The idea is exactly that you can recover from a failed flash.

    That means that to recover, you need to get the right program into a floppy, with the right BIOS on it. You then boot into this special flash mode, which often means pressing some key combination. I've done it on an LE1700 that I bought of e-bay, and I'm pretty sure you can do it on almost any computer.
    In some more modern BIOSes you don't need a floppy, but can do it with a USB stick.
    I'm too lazy to do a thorough search for the exact procedure, but here are two good links that I found:
    http://www.mydellmini.com/forum/dell-mini-10v/18080-how-unbrick-mini-10v-using-floppy-drive.html (this will work also on other computers, I think)
    http://www.wikihow.com/Reflash-BIOS
     

  12. Re:Consider it a (technology) life lesson by AmiMoJo · · Score: 4, Informative

    You are thinking of Gigabyte motherboards. Dual-BIOS has been standard for over a decade on those.

    --
    const int one = 65536; (Silvermoon, Texture.cs)
    SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC