Slashdot Mirror


Inside VMware's 'Virtual Datacenter OS'

snydeq writes "Neil McAllister cuts through VMware's marketing hype to examine the potential impact of VMware's newly pronounced 'virtual datacenter OS' — which the company has touted as the death knell for the traditional OS. Literally an operating system for the virtual datacenter, VDC OS is an umbrella concept to build services and APIs that make it easier to provision and allocate resources for apps in an abstract way. Under the system, McAllister writes, apps are reduced to 'application workloads' tailored through vApp, a tool that will allow developers to 'encapsulate the entire app infrastructure in a single bundle — servers and all.' The concept could help solve the current bugbear of programming, parallel processing, McAllister concludes, assuming VMware succeeds."

37 of 121 comments (clear)

  1. Nothing to sell here, move along by $RANDOMLUSER · · Score: 3, Insightful

    According to VMware execs, VDC OS will not be a product as such. Instead, it is an umbrella concept covering a range of capabilities that VMware will build into the next generation of its Virtual Infrastructure products.

    So it's not just vaporware, it's an "umbrella concept" that will be built into future products.

    --
    No folly is more costly than the folly of intolerant idealism. - Winston Churchill
    1. Re:Nothing to sell here, move along by eric-x · · Score: 5, Funny

      Well, since there were complains from the /. community about vaporware (if not an actual product) and slashvertizements (if an actual product) we thought it would be an improvement to avoid these and hence introduce the "umbrella concept".

    2. Re:Nothing to sell here, move along by ionix5891 · · Score: 2, Funny

      well clouds are made of vapor...

  2. We've come full circle by timeOday · · Score: 4, Interesting
    The whole point of time-sharing operating systems in the first place was to allow many competing applications to get along yet protect them from each other. We have layer upon layer of redundancy built in; a Java VM running on an x86 VM running on a CPU operating in protected mode. Then somebody comes along and says, "hey I have a breakthrough idea, let's just use ONE of those layers!"

    The real nut of my questions is, what would we need to add to more conventional OS's (linux) to get the job done? For my money, the biggest problem is package interdependencies. IMHO much VM usage is actually just to address that issue. We need package management that isolates applications from each other, giving the appearance of a custom chroot environment for each, while silently sharing resources (such as .so's) that just happen to be the same in multiple applications.

    1. Re:We've come full circle by giuntag · · Score: 2, Interesting

      in short, are you advocating usage of virtuozzo?

    2. Re:We've come full circle by tji · · Score: 3, Informative

      They are not replacing Linux. You still run your what you want on Linux, but do you run everything on ONE Linux box? If yes, you're not a good candidate for a Datacenter OS. If you run many servers, then there is almost definitely room for efficiency in that structure.

      Rather than dedicating the full bare hardware to your App, you deploy as a VM in your Virtual Datacenter ( mini cloud ). The DCOS takes care of managing the resources, things like:

      - Moving your server VM from compute node to compute node to automatically balance load and optimize performance,
      - Move VMs to work around failures, allow hardware upgrades, etc. without downtime.
      - Expand capacity by dropping another compute node into the cloud (the big difference between the old mainframe world and the new DCOS. This scales easily with cheap powerful nodes)
      - Move the machine images around your storage infrastructure, to allow for management, maintenance, upgrade, expansion, etc.
      - Provide recovery and even fault tolerance of hardware. Servers can automatically move and re-start on hardware failure; or they can even run in lockstep to maintain full operation through a node failure.

      This is VMware's big lead (and big need to leverage, as the revenue from the hypervisor layer dries up). They provide the management layer that enables all the above, and they keep improving it. From a central GUI, I can manage all my VMs, manage the compute resources as a cluster.

    3. Re:We've come full circle by ArsonSmith · · Score: 2, Informative

      Not exactly. VDC-OS does actually replace Windows and/or Linux. Think of it as a Linux kernel, and instead of InitV startup your app starts up. You don't maintain users and directories or storage or even log into a shell. The OS is reduced to just enough to run 1 application and only 1 application.

      This OS/App bundle is created with a basic config file and is then started just like you'd start a virtual machine on an ESX server or server cluster. ESX can then handle the migration and resources of all the ESX servers in the cluster and your App will move between them to the one that will service it best.

      I'm sure there will be a debug environtment that may included a more advanced shell like interface to run traces and such, but a stable app shouldn't need any of this. (By stable I mean well tested and developed to one specific environment of which this will provide. Think cartrage console game vs. PC game)

      --
      Paying taxes to buy civilization is like paying a hooker to buy love.
    4. Re:We've come full circle by Ralish · · Score: 3, Interesting

      One of my main problems with VMWare is that a VM itself takes so much disk space that it takes a long time to work with (copy, archive etc) and I can't fit many on my laptop. Somewhat paradoxically, it must be possible to snapshot an application with its entire environment so you have a known working version.

      If I'm understanding you correctly, the solution you are after is already offered by VMware:
      http://vmware.com/products/thinapp/

      Make sure to check the features tab for a more summarized and technical overview of what exactly ThinApp does and is capable of. Unfortunately, ThinApp is currently Windows only; I have no idea if they are intending to support Unix OS's in the future.

      Is this the sort of functionality you are thinking about? Apologies if I've misintepreted your comment.

  3. Summary by wombatmobile · · Score: 2, Insightful

    FTFA: "In short, if done properly, a meta-operating system based on networked virtual machines could streamline software development, make IT more flexible, and save customers money."

    It is hard to argue with a truism. But what does "done properly" entail?

    1. Re:Summary by davester666 · · Score: 5, Funny

      In this case, if you ONLY use VMWARE products throughout your organization, then you have configured your systems properly.

      --
      Sleep your way to a whiter smile...date a dentist!
  4. I cant get them to use it now! by funwithBSD · · Score: 2, Interesting

    Getting traditional "silo" orientated programmers to use distributed computing is hard now!

    This server is for chocolate, this one for peanut butter... don't let them touch!

    Even GRID enabled software like Informatica is hard to get them to understand. Don't worry where it runs, don't try to segregate workloads... the software is smarter than you!

    Let it do it's damn job.

    --
    Never answer an anonymous letter. - Yogi Berra
  5. encapsulation and abstraction by Anonymous Coward · · Score: 4, Interesting

    I have used VDC OS. Ultimately it is just a convergence of the existing technologies Vmware has already been developing, upgraded to a new level. I can say, it is very, very nice and clean.

    What it gives a data center manager is abstraction and ease of use. The physical way everything is deployed one-off into a datacenter, you need a new application, it involves buying new servers, racks, power and whatnot. If you need to move those servers to another center, or deal with business continuance and disaster recovery, it is a new discrete project.

    With VDC, no more. You build all of that into the datacenter "OS", and when a new application comes along they are put into the VDC OS and they inherit everything, not just HA but BC, DR and all of the ease of use. If they don't want BC or DR, they don't pay into that bucket.

    Need to move a Datacenter? Use the DR solutions in VDC OS, and you can do it in the middle of the day without your users noticing more than a slight 5-minute bump (or so--largely to let the network routes update).

    VMware is so far beyond everybody else in the virutalization industry, it is almost comical to hear other people shout the battle cry of 'Xen' or 'Hyper-V'. Those are nice toys, but the surrounding tools are klunky and almost non-functional, leaving just the hypervisor. What VMware is trying to say with "VDC OS" is that the game already left the hypervisor, that is why everybody is all but giving the hypervisor away for free now.

    I may sound like a fanboy, but after having worked in the datacenter for 15+ years I can say this technology really works, and its about time. We can now move the datacenter from the hobbiest market it has been in up to now, into the dialtone it should be.

    1. Re:encapsulation and abstraction by Anonymous Coward · · Score: 2, Informative

      I have to disagree with AC that "vmware is the only solution", 6 months ago we evaluated both vmware (which we had been using in dev and test for years) and the Citrix Xen product and decided to go for Xen for our production systems based upon performance we saw (yes yes YMMV) cost, and the open nature of the API. The problem was finding a strong partner/integrator to help us swing our server estate from physical to virtual in the time allotted.

      So far the systems have been solid, and required only a couple of noncritical updates/patches to maintain. I agree that its not about the hypervisor (any more), with Hyper-V being practically free ($40-bucks?), but I would disagree that VMWare is the only game in town.

      We were prepared to question the accepted wisdom in search of performance and savings, and it worked out well for us (so far). I can't comment on the other versions of Xen from Sun, Oracle, and Co, but we found Citrix Xen and a hardware virtualization appliance a solid, manageable system.

    2. Re:encapsulation and abstraction by cain · · Score: 4, Funny

      With VDC, no more. You build all of that into the datacenter "OS", and when a new application comes along they are put into the VDC OS and they inherit everything, not just HA but BC, DR and all of the ease of use. If they don't want BC or DR, they don't pay into that bucket

      Yeah, but what about TR, WD, RF, and GH? Not to mention NR, SS, and BD? How could they leave thouse out - I mean WTF?

    3. Re:encapsulation and abstraction by kscguru · · Score: 4, Insightful

      6 months ago we evaluated both vmware (which we had been using in dev and test for years) and the Citrix Xen product and decided to go for Xen for our production systems based upon performance we saw (yes yes YMMV) cost, and the open nature of the API. The problem was finding a strong partner/integrator to help us swing our server estate from physical to virtual in the time allotted.

      Then you missed the GP's point. If XenSource (Citrix XenSource : VMware VI as Xen : ESX) satisfies your needs, then you aren't doing anything for which you need a datacenter OS. (And if you evaluated anything more expensive than the cheapest VMware offering, you botched your product search too.)

      For server consolidation and bare-bones start/stop management, there is not much difference between VMware, Xen, and Hyper-V. They all have roughly the same performance; ESX degrades least when overloaded and there's a small premium for an ESX cluster because of it. Go to the next tier where you need automated load-balancing, automated availability solutions, and automated backup, and VMware is the only game in town. (Short of IBM mainframes.)

      Server consolidation != datacenter OS, despite the "me too!" claims of MSFT and Citrix. MSFT's roadmap puts them in the same ballpark in 2-3 years, Citrix 3 years back on the VMware roadmap, and VMware is there right now.

      --

      A witty [sig] proves nothing. --Voltaire

    4. Re:encapsulation and abstraction by Ralish · · Score: 2, Informative

      To clear up the acronym soup a little:

      HA = High Availability
      Technology that aims to ensure (high) availability of virtual machines across a virtualised cluster through intelligent monitoring of VM's and cluster resources.
      http://www.vmware.com/products/vi/vc/ha.html

      DR = Distributed Resource Scheduler (I assume that's what parent meant)
      Provides much more advanced and fine-grained control of the available resources in a virtualised cluster.
      http://www.vmware.com/products/vi/vc/drs.html

      BC = Consolidated Backup (guessing)
      Backup technology for virtualised clusters, providing backup features specific to virtualisation scenarios that conventional backup products don't traditionally offer, although, BC can integrate with them to an extent.
      http://www.vmware.com/products/vi/consolidated_backup.html

    5. Re:encapsulation and abstraction by mattmarlowe · · Score: 2, Informative

      You apparently missed the the announcement from Cisco that they've released their own virtual switch with enterprise features to replace the limited capabilities in VMware's. And, yes, vmware will fully support it and it will be plug and play compatible. Furthermore, on a cluster of ESX hosts, you can have multiple Cisco supervisor appliances running for HA/management, while a Cisco switch configuration/etc is shared across all nodes and ports being logically linked to each vm, regardless of where vm is located and even during vmotion.

      Cisco details at: http://www.cisco.com/en/US/products/ps9902/index.html

  6. It's just that all current OS's are lacking by Colin+Smith · · Score: 4, Insightful

    Except from IBM of course.

    vmware is simply the logical extension of what the OS should be doing anyway.

    or put another way.

    Those who don't buy IBM kit are condemned to reimpliment (badly, and for the rest of their lives) what IBM have been doing for decades.

    --
    Deleted
    1. Re:It's just that all current OS's are lacking by Anonymous Coward · · Score: 2, Funny

      IBM: the only company who can pack mainframe complexity into 2U.

      No, thanks. Give me Sun over IBM ANY day of the week. Every time I have to deal with IBM/AIX, I wind up with a headache.

    2. Re:It's just that all current OS's are lacking by sphealey · · Score: 2, Insightful

      > Those who don't buy IBM kit are condemned to reimpliment
      > (badly, and for the rest of their lives) what IBM have been
      > doing for decades.

      First, the troll rating is utterly unjustified. Mod parent up.

      IBM is not without its own faults. Perhaps less so now than in the 1970s and 80s when the push for PCs took root, but it has its own weaknesses. Even taking that into account it _is_ ridiculous to see the Wintel world groping toward the kind if high availability and virtualization that IBM, DEC, CDC, and others perfected in the 1960s/70.

      sPh

  7. Network security in a "virtual datacenter OS" by infomodity · · Score: 4, Interesting

    We have IEEE and RFC for standardization of ethernet/switching and routing respectively. What standards exist for virtual environments? As commercial security vendors move into this space, we're headed back into a cycle of supporting multiple architectures. "Security Vendor X" must now understand how VMWare, Hyper-V, Xen, and other VM environments perform their networking. Virtualization of the entire OSI model renders the physical and data link layers obsolete. Why emulate them at that point? Not to say ethernet will disappear, but I can see a point where operating systems evolve branches that run in pure play virtual environments. Those offshoots will shed unnecessary things like MAC addresses as the VM vendors begin defining the new network standards themselves.

  8. Hmm OpenMosix by Culture20 · · Score: 2, Interesting

    Openmosix project closed earlier this year and suddenly vmware has a way to run one "OS" over multiple computers. Hmmm...

  9. All of IBM's old ideas are new again by Lictor · · Score: 3, Insightful

    VM? LPAR? Parallel Sysplex? Haven't IBM mainframes been doing this since the '70s (okay, Parallel Sysplex has only been since the '90s)?

    No doubt a "cloud" of UNIX boxes is harder to marshall than a couple of zSeries though.

    1. Re:All of IBM's old ideas are new again by image77 · · Score: 5, Insightful

      Maybe, but IBM mainframes don't use cheap off the shelf components that you can pick up at the local Fry's. You can build a small VMware cluster with HA, DRS, etc for a few thousand bucks. How much is an IBM mainframe these days?

      Once you have that VMware cluster you can run your choice of 70+ operating systems and millions of apps on it. Can you run Exchange on a mainframe? Sieble? Your existing billing and accounting app?

    2. Re:All of IBM's old ideas are new again by BASICman · · Score: 2, Insightful

      Once you have that VMware cluster you can run your choice of 70+ operating systems and millions of apps on it. Can you run Exchange on a mainframe? Sieble? Your existing billing and accounting app?

      Well, you can run whatever runs on Linux on top of a mainframe. And if you're a Fortune 500 corporation, chances are your existing billing and accounting applications are *already* running on a mainframe. That is, after all, what the old girl is built for.

      --
      An enlightenment painter would paint a grand house on a lawn; A romantic painter would paint it on fire.
    3. Re:All of IBM's old ideas are new again by image77 · · Score: 4, Insightful

      Well, you can run whatever runs on Linux on top of a mainframe.

      Only if you recompile those apps to run on the special versions of Linux that run on mainframes. Let's see: I can recompile my app to run on some weird offshoot of Linux on expensive, proprietary hardware or I can take it and "P2V" it onto VMware running which ever flavor of mainstream Linux I prefer? Oh, and I can P2V my Windows apps onto that same VMware cluster? And all that for a fraction of the price? Sold.

      Just to be clear I'm not saying that the mainframe has no place in the modern datacenter, I'm just saying that VMware is a better fit in many situations. (And it's certainly an order of magnitude cheaper.)

      And if you're a Fortune 500 corporation, chances are your existing billing and accounting applications are *already* running on a mainframe. That is, after all, what the old girl is built for.

      Not sure where the F500 argument came from, but since 486 out of those 500 already use VMware I think they're already sold. (All 100 of the F100, BTW.) http://www.vmware.com/customers/

      In any case, my original point remains. Mainframes are expensive and proprietary whereas VMware is cheap and offers the flexibility to run whatever app on whatever OS you choose. This new VDC-OS stuff just builds on an already good thing. We'll be happy to renew our ELA when it comes up next year.

    4. Re:All of IBM's old ideas are new again by image77 · · Score: 2, Insightful

      You're missing the point. No matter how you slice it the x86 stuff (even the high end x86 stuff) is WAY cheaper than an IBM mainframe, and if I need some memory or a CPU or something I can find it practically anywhere. That was my only point, and IMHO it's one that really can't be argued.

      As for the point that I think you were trying to make - of course architecting for redundancy is important. VMware makes that easy too. Even if one of the cheap nodes in my VMware cluster unexpectedly melts down the VMs will automatically restart on another node. I can take my time to repair the broken node and add it back into the cluster when I'm done - at that point DRS automatically rebalances load across the cluster. Same deal with adding capacity.

      BTW, with ESXi you don't even need any local disks (which as you said are the most likely component to break down.) You run the hypervisor from flash memory and store the VMs on some sort of shared disk like SAN, iSCSI, or even NFS. (Using proper RAID technology and backup proccedures of course.)

      Of course you'll also want to address disaster recovery and business continuity. Those are also something that VMware can help you accomplish with their SRM and VCB products.

      Anyway, VMware is the ONLY company right now that has products to address EVERY aspect of virtualization. They can do it all and they do it all very well. Sure, mainframes still have a place in some datacenters but VMware is natural fit for almost every datacenter. That's my last post on the subject - I don't want to be accused of being a marketing drone or something. (I'm not - I'm just a happy customer.)

    5. Re:All of IBM's old ideas are new again by Comatose51 · · Score: 2, Interesting

      VMware isn't claiming these ideas are new. IBM and computer science departments around the world has been talking about these ideas for many years. The difference is that VMware has an implementation that will work on x86 hardware that can bring the benefits of these ideas to a large market. In some sense we've come full circle as we moved from mainframes and room size computers to PCs and commodity hardware and now back to computers in a datacenter (a very big room). However, you can't just dismiss the new-old idea and say "I told you so" because there are differences between the current implementation and the old one. The x86 hardware is one difference. Another is the fact that the computing hardware are clusters of relatively inexpensive servers rather than a few large boxes. These kinds of hardware are more much prolific than the IBM hardware and thus the VMware solution is more accessible. I can't say if one solution is technically better than the other. However, the VMware solution works in the current x86 environment/market that is a result of the history of the industry.

      --
      EvilCON - Made Famous by /.
  10. THAT is why VMWare is on the right track with this by khasim · · Score: 3, Insightful

    Getting traditional "silo" orientated programmers to use distributed computing is hard now!

    And (for many of them) it's never going to get any easier.

    It is too easy for them to just think of "one program, one OS, one machine".

    Their app takes all the resources it sees from the OS it sees on the machine it sees.

    So VMWare "solves" this by making it easy (for a price) for each app to believe that it has it's own machine. So the programmers can keep working they've always worked.

  11. Re:done already by TheRaven64 · · Score: 2, Informative
    Samsung did some work with Xen (not sure if it's published yet) on 'partial migration' where a group of independent machines appeared to be a single SMP (or, ideally, AMP) machine from the perspective of the OS and pages were synchronised between different nodes using a cache coherency protocol as required. Marathon have a Xen version which synchronises two VM instances in remote locations allowing either to act as a transparent fail-over for the other if one set of hardware goes down. Moving it down to the storage layer doesn't sound like it provides anything more than existing SAN solutions which can be deployed on most VMs already.

    Oh, and Simon's a bright guy, but he works more on the marketing side of things. If you want technical comments, go to Ian or Keir.

    --
    I am TheRaven on Soylent News
  12. What about Microsoft? by joib · · Score: 5, Funny

    And after a few years when Microsoft follows VMWare, we'll have Microsoft DataCenter OS, abbreviated MS-DOS.

  13. Re: what about persistent TCP connections? by Ritchie70 · · Score: 2, Informative

    I think it is, actually.

    We've got some VMware guys at my job doing a proof of concept for us. (I work for one of those big companies where people hear the name and that cha-ching noise happens in their head.)

    Each VM has its own MAC address, and the virtualization layer includes a network switch. So long as the switch knows where to send the packets, and the other end of the TCP connection is willing to tolerate a few moments of silence while the VM moves, it should work.

    --
    The preferred solution is to not have a problem.
  14. Re: what about persistent TCP connections? by image77 · · Score: 2, Informative

    Yep - the "cutover" happens faster that the TCP timeout window. The connection stays alive, and even if a packet is lost it simply gets resent when the ACK goes missing.

  15. Re: what about persistent TCP connections? by Ralish · · Score: 2, Informative

    Yes, VMware provides a technology for its datacenter level products called VMotion that does exactly that, moving VM's between physical virtualised servers in a cluster while preserving all active networking connections.

    I don't know the specifics of how it works and manages that feat, but I have seen tech demos that show it in action. I watched one a while ago published by Dell showing a VMotion task in progress, I'm sure you can find it on the web somewhere with some digging around.

    Regardless, it does work and has been available as part of its enterprise products for some time.

    If you want to know more:
    http://www.vmware.com/products/vi/vc/vmotion.html

  16. This is the real deal by Natales · · Score: 4, Interesting

    Disclaimer: I work for VMware, and I just came back from VMworld in Vegas (exhausted BTW).

    In all my 5 years in the company, I must say that this is the most comprehensive re-thinking of the long-term strategy for virtualization I've seen to date. It brings a new sense of direction that matches where the markets are going.

    I agree with most of the comments in this thread regarding the benefits of the VDC-OC, but this is just one part of this picture. IMHO, the biggest change is the "Federation with the Cloud" strategy, where a company may choose to use, move or spawn new or existing workloads directly into a service provider on-demand, maintaining the SLAs (from security to capacity) and then bring them back to the internal cloud if needed.

    I mean, go a talk to a CFO or a COO, and they'll [most of the time] politely complain about IT being expensive, and not fast enough to react to the changes the company needs. Shared services are still seen as optional and many business units still prefer to implement their own thing. With this model, IT becomes a true utility, with a pay-as-you-go menu that implements a coherent chargeback model that will bring a smile to the guys in dark suits.

    Even if VMware doesn't succeed in these efforts, the genie is out of the bottle and somebody else will make it happen.

    Really interesting times to be in IT.

  17. (Open) Solaris by d3xt3r · · Score: 2, Informative

    Solaris 10 and Open Solaris have the concept of zones and containers. The computer runs a single Solaris instance but can run isolated process trees in zones which share common libraries but can be updated for dependencies independently. The containers concept (in conjunction with zones) allows a fair share scheduler to guarantee a service level for each allocated zone (CPU/memory sharing, etc). IMHO, must better than Virtuozzo, VMware and Xen.

  18. Re:Trigence website; the usual crap by uassholes · · Score: 2, Insightful
    Great... maybe. I just took at look at their website and found a lot of shit written by sales and marketing that I just don't have the patience to try to understand what they are babbling about.

    And, of course the obligatory photos of models pretending to be employees, happy customers, or drunken vagrants; who the fuck knows.

    And why do the marketeers that they hire to advise them on their "onlin presence" insist on that shit?

    Does anyone here get a boner when they see those fucking pictures of happy corporate people on every fucking corporate website?