Slashdot Mirror


Massive VMware Bug Shuts Systems Down

mattmarlowe writes "Imagine if Red Hat released a version of Linux, and after it was deployed, customers noticed that any processes with a start date of today would refuse to run? Well, that's what happened to VMware — a company that wants nearly all server applications running in virtual machines within a matter of years." Supposedly a fix will be available ... in 36 hours.

33 of 410 comments (clear)

  1. Re:Ummm... How? by cduffy · · Score: 4, Informative

    If you read the article, you'd know it's the license-management code. Licenses expire.

  2. Workaround available by fredr1k · · Score: 4, Informative

    A workaround is possible Turn off NTP time on the host. And manually (using the VIC) change that date to one week backwards in time. Voila all set to work.

    --
    "Never EVER mess with a jumper you don't know about, even if it's labeled 'sex and free beer'." - Dave Haynie
    1. Re:Workaround available by d_ron_218 · · Score: 5, Informative

      The only way to run a Windows domain controller in VMware is to tie its clock to the physical host's clock. And lots of things break if your domain controllers have the wrong time (Kerberos authentication, NTP across the Windows network, etc, etc). So changing the host clock would generally be a bad idea.

    2. Re:Workaround available by exi1ed0ne · · Score: 4, Informative

      1) edit the vmware config file to include the line:

      host.cpukHz = XXXXX

      Where XXXXXis your CPU in kilohertz

      2) enable time sync via vmware tools

      3) modify Type in HKLM\System\CurrentControlSet\Services\W32Time\Parameters from "Nt5DS" to "NoSync"

      That's always taken care of clock skew issues on DCs for me.

      --
      Pessimists.net - as if life wasn't depressing enough.
  3. Re:what do you expect? by ray-auch · · Score: 4, Informative

    USB license dongle for the application software running on the VM.

    Seriously. Last week.

  4. Re:License Management Software!? by Cyberax · · Score: 2, Informative

    LARGE corporations usually just buy site licenses. It's easier for them this way.

  5. Re:Patch Tuesday by prandal · · Score: 4, Informative

    Rebooting a host doesn't power down the VM.

    The licence checking is done at VM power up, apparently.

  6. Re:what do you expect? by Anonymous Coward · · Score: 2, Informative

    They're working on it. Apparently there is a major release due in a few weeks. Not sure when, but maybe before October?

    http://forums.virtualbox.org/viewtopic.php?t=8528

  7. Re:Utility computing w/o virtualization by Cyberax · · Score: 3, Informative

    Isolation and easy management.

    Isolation of applications in OSGi containers is leaky, one bad-behaving application can bring down the whole containers.

    Lightweight containers (OpenVZ, Virtuozzo) have almost no overhead and allow cool features like load-balancing of ALL applications between cluster nodes. However, all lightweight containers use the same kernel, and one kernel bug can bring down all virtual nodes.

    XEN/KVM have a bit more overhead but with even more isolation (each node has its own kernel).

  8. License Management Server by Comatose51 · · Score: 3, Informative

    Unless something has changed dramatically, an expired license won't bring down any already deployed VMs. It simply won't allow you to deploy undeployed ones. It doesn't shut down the VMs as the headline makes it sound nor is it a bug in the hypervisor. Yes it's embarrassing that this got out but can we have a less sensationalist headline and summary?

    --
    EvilCON - Made Famous by /.
    1. Re:License Management Server by Slashcrap · · Score: 2, Informative

      Unless something has changed dramatically, an expired license won't bring down any already deployed VMs. It simply won't allow you to deploy undeployed ones. It doesn't shut down the VMs as the headline makes it sound nor is it a bug in the hypervisor. Yes it's embarrassing that this got out but can we have a less sensationalist headline and summary?

      No it just makes it impossible to start up VMs, restart VMs or VMotion them. I can't imagine why everyone's getting upset.

      Yes, there's a workaround - you just put back the date on the server. Unless you're in a business where randomly changing the dates on servers is frowned upon for compliance reasons.

  9. it has USB support by reaktor · · Score: 2, Informative

    Virtualbox has USB support...

  10. Re:what do you expect? by Anonymous Coward · · Score: 1, Informative

    I'm not trolling, I'm honestly curious. What USB hardware do you need in your VMs?

    Bluetooth

    My PDA's dock

    A canon SLR camera, the remote capture software for which doesn't run on x64

    my wacom tablet

  11. misleading headline by andrew.hill · · Score: 1, Informative

    Nothing gets "Shut Down". You can't power on VMs, use vmotion, or DRS.

  12. Re:Utility computing w/o virtualization by Anonymous Coward · · Score: 5, Informative

    Simple...power. Right now our datacenter is strapped for power, and power isn't cheap. Neither is cooling. For 10U and 8000 watts I can install a fully loaded blade chassis with 128 CPU cores and 1 Terabyte of RAM, attach it to a SAN and run 150 VMs in it. Or I can install 150 rack and stack servers at taking up 4 racks and 75000 watts. Let me think here...

    And while I'm thinking about it, let's also remember that using VMWare gives you options like DRS and VMotion that you don't get with physical hardware. Or you can replicate your SAN to another SAN at your DR site and have a VMWare cluster waiting there for recovery. Then instead of having to do a bunch of restores to bare metal hardware, you could potentially get your servers back up and running in minutes instead of hours.

    There are many, many benefits to virtualization. If there weren't then people wouldn't have been using for decades in one form or another.

  13. Re:License Management Software!? by aix+tom · · Score: 2, Informative

    I would count those software using "license servers" that check on startup and then deny startup of the application into the "license enforcement" category, not in the "license management" category.

    On the other hand, we have one special software that doesn't enforce any license checks during runtime, but offers a "license audit" tool that outputs your concurrent users, maximum users, etc.. during a specific time period. That way you can check easily if you have enough licenses every now and then. And there is a condition in the license agreement that you have to check at least once a year. That is acceptable in my opinion.

    Then as a bad example we have this other software that is a pain in the ass to get to run because they needs a hardware ID to get it to run. Thankfully we were able to fake that hardware ID in VMWare. Because it wouldn't fit in our disaster recovery otherwise.

  14. No! Don't set the time back! by Animats · · Score: 5, Informative

    VMware is suggesting setting the system time backwards to work around their license manager problem. That's a desperation move. Not only will it mess up everything from Kerberos to CVS to "make", if you're running certain licensed software, in particular software licensed via FlexLM, that software will stop working. FlexLM will disable your licenses if the clock goes backwards by more than 24 hours. Now your expensive high-end software protected by FlexLM (Rational, Avid, Matlab, National Instruments, ANSYS, Cisco Unity, Clearcase, Nokia network management, etc.) will stop working. Setting the clock forward again may not re-enable it, either; there's tamper detection.

    Also, if you have server/client licensing with FlexLM, or multiple license servers, and the clocks disagree significantly, FlexLM gets suspicious and turns licenses off.

  15. Re:License Management Software!? by alohatiger · · Score: 4, Informative

    What is a "disadvantaged business" anyway, and why would someone actually use that as a sales point?

    Government work. Some government contracts require a percentage of the work to be done by minority/women/veteran/disadvantaged owned businesses.

    --
    Bigtime Consulting - "We're the best because we cost the most"
  16. Only in an ideal world by Len · · Score: 2, Informative

    In a major corporation, fear of massive fines and prosecution is enough to stop them from pirating your software.

    Sadly, not true in the real world, as my company has discovered on more than one occasion.

  17. NOT the *OpenSource Edition* by DrYak · · Score: 3, Informative

    Support for USB, iSCSI and RDP (along with USB-over-RDP) are only available in the closed source variants of VirtualBox.
    The opensource edition of Virtual Box doesn't have them.

    Also the USB support may lock the system when in fast emulation/patching/ring-2 mode, and only works flawlessly when using the slower mode with virtualisation CPU extensions (my brother tried using it to get old USB hardware accessible when moving to Vista 64 but since then he ended up buying newer hardware)

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  18. Re:License Management Software!? by Skjellifetti · · Score: 3, Informative

    In a major corporation, fear of massive fines and prosecution is enough to stop them from pirating your software.

    Not true. I worked for a smallish software companies that had their software replicated in at least one large customer installation well beyond the number of seats that were actually paid for. When confronted, the reaction was "so sue us..." We eventually settled for about 1/10 of what we would have made if they had obeyed the license terms because the cost of litigation coupled with the delay tactics they could have used would have meant that we would be out of business long before the court case was over. Size just means that they have more resources to defend their slimy actions.

  19. work is in progress.... by DrYak · · Score: 2, Informative

    If a virtual machine would support something like DirectX or OpenGL so that I could have the kids running their games in a virtual machine (and being able to install them, etc.) I would have them set up with a locked down OS with a virtual system for their games. {...} But I'm sure the technology is getting closer.

    Yup. Indeed. /. mentioned recently "VMGL".
    The extension is open source but currently only works for X11 OSes at both end.
    But as you said, a working acceleration layer is bound to be developed in the near future for Windows too.

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  20. Re:License Management Software!? by tsstahl · · Score: 4, Informative

    I'm looking at you North Winds Software. I'll BUY a support contract! If you offered such a thing. If you answered the phone.

    Um, isn't North Winds the name of the company that comes with the sample Access database? They're not real, you know... ;)

  21. Re:what do you expect? by nurb432 · · Score: 2, Informative

    Ya, its free, and virtual box is no enterprise solution either. So we are comparing apples and oranges here..

    Sure, its cool on a persons desktop to run non critical stuff on, but its no where close to being a product you would run off and virtualize 1000+ production servers with, which is the target market for ESX

    --
    ---- Booth was a patriot ----
  22. Re:License Management Software!? by initdeep · · Score: 3, Informative

    you've never been to a heart surgeon have you?

    Many of them are minorities.

    in fact, in my experience (having a parent formerly work for one, and the other now seeing one regularly), the people considered minorities in society make up the majority of the heart surgeons.

  23. Re:what do you expect? by Anonymous Coward · · Score: 1, Informative

    Use USBAnywhere. It sucks they don't support native USB passthru yet, but this works in the meantime.

  24. Re:License Management Software!? by operagost · · Score: 2, Informative

    Isn't the sort of thing that the BSA (no, not Boy Scouts) is useful for? Maybe you should join?

    --

    Gamingmuseum.com: Give your 3D accelerator a rest.
  25. Re:what do you expect? by tlacuache · · Score: 2, Informative

    As far as I understood it, VirtualBox does support USB in the binary distribution you can download here. VirtualBox's "Open Source Edition (OSE)" doesn't support USB, see here. But if you're running VMWare Player (a closed-source product) anyway, the non-Free/Open aspect of it must not be a hangup for you (nor is it for me). So what's your holdup for running the "closed" distribution of VirtualBox. You'd have USB and, unlike VMware Player, could actually create new virtual machines.

  26. You have to also mention Countering Trusting Trust by Sits · · Score: 2, Informative

    How can you reference Ken Thompson's "Reflections on Trusting Trust" (HTML/non-PDF version) without also mentioning David A. Wheeler's "Countering Trusting Trust" (as found via Bruce Schneier's blog)? So to answer your question:

    What if you can't even trust your compiler?

    Well so long as I have another set of compilers AND at least one is trustworthy then there is process I can follow to build a compiler I can trust. After spotting differences in the resulting binary I would also need to (ah-ha) examine the source code of the used compilers and find out which one is mis-generating the binary and fix it.

    At some point I need to be able to understand binary and read the source of the compiler that generated that binary to ensure that someone else is not jacking me.

  27. Re:License Management Software!? by matuscak · · Score: 2, Informative

    FWIW, ESX does in fact use FlexLM. In this case, it's not the license server that has gone down, but the code in ESX that is interperting the what the license server is returning that is broke.

  28. Re:Utility computing w/o virtualization by peacefinder · · Score: 2, Informative

    "VMWare licenses for ESX server cost something like $5k apiece."

    That's an exaggeration by a factor of five. Admittedly it ain't cheap, but one can get three dual-processor (unlimited core) ESX licenses and a management software license for $2700, or just ESX server for $1000.

    Of course, today it doesn't look real attractive...

    --
    With reasonable men I will reason; with humane men I will plead; but to tyrants I will give no quarter. -- William Lloyd
  29. Re:License Management Software!? by Arterion · · Score: 2, Informative

    Don't you love the way that everyone in the world gets more respect than the local IT department? Anything a vendor, friend, or the internet says is completely valid and true, but if it comes out of the mouth of the IT department, it must be wrong.

    --
    "That which does not kill us makes us stranger." -Trevor Goodchild
  30. Set DRS Cluster to Manual by mrpolyrhythm · · Score: 2, Informative

    The article also says that he'd recommend disabling DRS because that would remove resource pools, and goes on to say set the sensitivity to 5. What would be the more correct course of action, would be to set your DRS Cluster to Manual, which is indicating no automation, DRS will not place or move VMs.