Slashdot Mirror


IBM Promises Logical Volume Management For Linux

Several folks wrote in with news that IBM has announced via mailing list its intention to release a Logical Volume Management (LVM) architecture for Linux. Here is the LVM white paper referred to below. Neither the note below nor the IBM Web site seem to declare what sort of license it will be released under, but the expressed hope "that the release of this technology will lead to a world class logical volume management system for Linux" would fit logically with the GPL, wouldn't it? ;) (More)

An Anonymous Coward writes: "I found the following message posted to several Linux mailing lists:

************************* Begin Message **************

Hello! Since IBM has begun to publicly support Linux, many of our customers have started showing an interest in Linux. We have received many requests from our customers asking us to enhance certain areas of Linux (logical volume management in particular) in order to make Linux a more acceptable platform for their IT operations. Furthermore, we have been asked to provide a migration path from existing platforms (both IBM and non-IBM) to Linux. IBM has been moving to satisfy these requests by contributing developers and technology to the Linux Community. This is what drove IBM's decision to release JFS to the Linux Community, and it is driving the decision to release logical volume management technology to the Linux Community.

IBM is releasing one of its most advanced architectures for a Logical Volume Management System. This architecture is quite interesting as it completely integrates all disk and volume management into a single, highly extensible, easy to use entity. We hope that the release of this technology will lead to a world class logical volume management system for Linux, one which satisfies the requirements of our customers as well as those of the Linux Community.

The first of several white papers describing the LVMS architecture can be found at the IBM Linux Technology Center website:

link

Since we would like to have an honest, open discussion about this, I would suggest that all interested parties post their comments to the LVM mailing list (unless someone has a better suggestion!). All comments are welcome!

Thanks!

Ben Rafanello

IBM Linux Technology Center

PS - Information about the LVM mailing list can be found at:

link

***************** End Message *************************

Well, the message sounded interesting so I checked out their website. I found the specified white paper in the "Documents / White Papers" section. After giving it a quick read, I must say that this isn't like any other LVM I've ever heard of! The use of "plug-in modules" to control what devices the LVM sees, how it partitions those devices, and how it uses those partitions to create a volume is incredibly flexible. I also like the part about the LVM working with the filesystem on a volume so that a volume can be resized without any data loss (and without all of the manual steps that must currently be done on Linux). The paper discusses this LVM as an architecture, and it avoids discussing user interfaces and implementation issues. I wonder if this is some pie in the sky vision or if they have any code to back this up?"

41 of 195 comments (clear)

  1. Re:Just say "No" to "logical volumes"... by dublin · · Score: 3

    Your objections don't even make sense, and it's clear you've never worked with enterprise environments:

    LVs complicate system management; in particular, they make it more difficult to figure out what physical devices a file system actually depends on, and they make it much more likely that you make a mistake when setting up disks.

    Not really, the LVM is always happy to tell you what maps to what, and this is not problem unless you create a logical root volume in which case you deserve what you get. Disks are too cheap these days for that sort of foolishness, and if you need LVM you can afford it.

    LVs break the correspondence between block numbers and head positions. With simple physical mappings, small differences in block numbers usually correspond to small head movements, something file system designs tend to rely on, but with LVs, all bets are off.

    What planet have you been living on, Mr. Jetson? The geometry the OS sees has had little or no relation to the physical geometry of the disk since disk controllers became more intelligent than the first PCs several years ago. Where things will actually land physically on modern disks has been totally out of your control for years, which is the reason Sun dropped the ability to twiddle cylinder groups way back in the move from SunOS to Solaris.

    If you take advantage of LVs spanning multiple disks, you just multiplied your risk of data loss, because if any one of those disks goes, so does the whole file system.

    That's why LVMs and RAID travel in packs - they form a symbiotic realtionship. With disks as cheap as they are, mnay people just use 0+1 (mirroring and striping), which eliminates this concern. If you're cheap and don't mind abysmal performance in degraded mode, you can go with 5.

    If you need file systems bigger than a single disk, use RAID.

    Have you ever done this? RAID tools that do this are inherently *doing* LVM, even if they're not calling it that and it's not a separate tool. RAID per se typically handles Mirroring, Striping and Parity, the volume manager handles concatenation. These are often merged in a single tool, but concatenation of disks is not strictly speaking a RAID function.

    GNU Parted and PartitionMagic already provide you with the ability to resize partitions without a full backup and restore; you don't need LVMs for that.

    While decent, these are hardly enterprise-class tools. I also sincerely doubt that either is capable of resizing volumes that span physical disks, since that *does* imply LVM functionality, unless there's an LVM hiding under the covers and lying to these tools. There are people that have a real need for single files that are tens or hundreds of gigabytes, so *not* spanning disks isn't really an option.

    One of these days, Linux may get concatenated mounts, which would give you another, very reliable and simple way of having file systems span multiple disks. Adding concatenated mounts would probably not be any harder than hacking in an LVM.

    I'll confess to being ignorant of concatenated mounts (although I asume this would allow simply allow concatenation at mount time, but LVMs have significant benefits, and the people who need them have been using them quite successfully for years. There's certainly noting that's going to prevent the need for them in the near term. LVMs make "big computing" possible on small computers. There's just no effective way around that.

    LVMs may have thier shortcomings, and they aren't appropriate everywhere. Most people won't need them, and the ones that do can handle the minimal incremental complexity. Further, what are often called LVMs are usually today also RAID and JFS tools. This sort of capabilty is not easily duplicated in other ways or we'd have been doing it already for years.

    It seems you really are living in Jetson-land as your ID indicates if you think things like "object based disk storage systems" are going to have large-scale real-world impacts anytime soon. Ah, the naivete of youth...

    --
    "The future's good and the present is nothing to sneeze at." - Roblimo's last ./ post
  2. Re:Cool! Now, what about smit? by jetson123 · · Score: 2
    I used and installed AIX for several years and I don't share your enthusiasm.

    Smit was not bad as a text based admin tool (I found the X11 version very cumbersome). But the problem with it was that for many operations, it was, in fact, the only choice you had, because command line equivalents either didn't exist at all or were not well documented.

    Another problem with AIX system management was that much of the configuration information went into a big binary database somewhere. That made it nearly impossible to manipulate that information from scripts. Furthermore, if AIX ran out of space while writing the system management database, the system would become unstable or unbootable.

    What AIX has going for it is that it's a robust, stable system once it's running (in part, due to the hardware). But I don't think AIX system management is a good model for Linux to aim for. That's why they make all different kinds. If you like AIX or NT, they are widely available; I see no need to turn Linux into either of them.

  3. It will be interesting to see... by Marrow · · Score: 2

    Most of the Linux community does not fully understand just how robust and featured the AIX platform is. Bear in mind that the features that Linux is JUST NOW beginning to think about have been in AIX for TEN YEARS. Thats like a Millenium in computer years. It will be interesting to see the stunned look on peoples faces when the fully realize just how far Linux has to go to catch up!

    1. Re:It will be interesting to see... by SoftwareJanitor · · Score: 2

      I dunno... I work with Solaris and Digital UNIX (a.k.a. Tru64) on a daily basis. I worked extensively with AIX at my previous job. Linux has already come a hell of a long way towards catching up with the commercial UNIXes, and isn't that far behind anymore. At the rate it is progressing, it will be able to compete with any commercial UNIX feature for feature within the next 6 months to a year. Virtually all of the important enterprise checklist items have either been knocked off already, have beta level support in Linux or have announced active projects working on them already.

  4. Re:Can We Trust IBM? by dublin · · Score: 2

    Oh, gad, let's hope not. SMIT is great for those illiterate in Unix, and a nightmare for the literati. (Although it's "show me the command line of how you'd do this" option can be a good leaning tool for admins.)

    I remember way back in the early AIX days discovering the hard way that S*IT didn't keep it's state in the config files, but in the ODB, so any changes you made by hand would be silently undone when S*IT realized the config file didn't match the ODB, forcing you to do nearly everything through S*IT if you wanted the changes to stick. AAAARGH!

    --
    "The future's good and the present is nothing to sneeze at." - Roblimo's last ./ post
  5. Re:Just say "No" to "logical volumes"... by dublin · · Score: 2

    I never said I was an expert on IBM's LVM, in fact, I haven't used it since 1994-ish. I have a fair amount of experience doinf these things, though, using half a dozen LVM systems, including Veritas Volume Manager and Sun's Solstice Disk Suite.

    The whole point of LVM is to put more than one disk in a VG, so I don't get your comment at all. That *would* explain your problems with JFS, though, since any disk failure is guaranteed to take out your log volume!

    If properly configured, all of these things work, and work well. That's why people use them!

    --
    "The future's good and the present is nothing to sneeze at." - Roblimo's last ./ post
  6. Re:Just say "No" to "logical volumes"... by dublin · · Score: 2

    I usually refrain from ad hominem attacks, but in this case, it was warranted - the guy clearly was talking without knowing his subject. It's fair to call him on that, and to point out those factual errors for the rest of the community.

    Despite your worries that I'm a latcomer "IT boss", my slashdot ID is about 130,000 lower than yours, and I was a participant here for several years before I bothered to register at the advent of moderation. What *I've* seen Slashdot becoming over that time is a community that is increasingly populated by clueless newbies shooting their mouths off and a signal to noise ratio approaching zero. And yes, sometimes that ticks me off.

    My comments weren't intended to be arrogant (sorry if that's what came across), but simply to inject some factual basis into the discussion where little existed previously. The reason I bothered to do this is that I've seen such little things lead to big misconceptions among the community in the past. I would hope that we all recognize that experience is the best teacher and those that have experience doing something can ofer a lot to those of us that haven't.

    --
    "The future's good and the present is nothing to sneeze at." - Roblimo's last ./ post
  7. That's a relief.... by Denor · · Score: 3

    because those illogical volumes are really a bitch to manage. Like herding cats....

    --
    -Denor
  8. Linux LVM by Anonymous Coward · · Score: 4

    A good LVM for Linux is here.

    1. Re:Linux LVM by x0 · · Score: 2

      HP-UX allows you to resize a partition with it's LVM without unmounting the filesystem (on 10.20, I haven't tried this with 11.).

      At first it looks like this doesn't work as SAM pukes when it is attempted. The trick is to resize the volume using the command line.

      I suppose I should qualify the above by saying that resize == grow. If I recall correctly, shrinking a volume is verboten. I don't have the documentation to back it up, but I also believe that the LVM included with HP-UX is actually a licensed Veritas VxFS.

      --
      In the immortal words of Socrates, who said; 'I drank what?'
    2. Re:Linux LVM by SoftwareJanitor · · Score: 2

      Actually, I always thought the LVM implementation (as well as jfs) are some of the parts of AIX that are the least horrible. There is a good reason for them to port the AIX LVM to Linux -- compatibility. If you could use jfs and lvm interchangably between Linux and AIX, it would make it a lot easier to co-exist Linux in an AIX shop. That would be good for IBM, as it could provide a smooth transition path for their customers (and a possible up-switch for them to AIX), and good for Linux, as it would make Linux an even better sell into IBM shops.

      What I'd really hope is that IBM will license the code in such a way that the current LVM project could possibly use it to help the development.

      IBM's work on releasing a port of jfs to the Linux community doesn't seem to have hurt the development of ReiserFS, ext3 or SGI's xfs. A little competition can often be a good thing.

    3. Re:Linux LVM by DaveTerrell · · Score: 2

      The IBM LVM for AIX allows for things like resizing filesystems without unmounting the partition, something no other LVM does (including Linux's). Without that, I consider LVM to be littler more than a toy (in serious environments, growing something like /var requires taking the machine down to single user mode, at which point dumping and restoring to a new bigger partition isn't a much bigger inconvenience).

    4. Re:Linux LVM by weave · · Score: 2
      Without that, I consider LVM to be littler more than a toy (in serious environments, growing something like /var requires taking the machine down to single user mode, at which point dumping and restoring to a new bigger partition isn't a much bigger inconvenience).

      Sorry, but this isn't true. I've been growing live file systems on DG/UX (data general) since 1994. A friend of mine working at a large Tru64 shop says that his file systems grow automatically as needed.

      The IBM LVM news is great news.

  9. Can We Trust IBM? by tealover · · Score: 3

    Look at what they're doing with Sun and Java. After working with Sun for 4 years, they refuse to ratify Sun's version of EJB, in effect leaving Sun out to dry. IBM was given access to all of Sun's java IP and this is how they repay them?

    I'm just a bit leery (sp ?) of IBM cozying up with Linux and Apache. They may think everyone has forgotten how predatory they are but some of us haven't. I think most people see them as a MS foil and as a result consider them to be one of the good guys. Just remember, folks. 15 years ago, IBM was the oppressor of the tech industry. The only reason they aren't as powerful today is because they got too big and unresponsive, which led them to make several bad decisions.

    --
    -- You see, there would be these conclusions that you could jump to
    1. Re:Can We Trust IBM? by _Swank · · Score: 5
      One of the main reasons that IBM left "Sun out to dry" as you put it was due to Sun's backtracking on putting Java in the hands of an open standards body and instead to keep it under their own control. You seem to be upset with IBM for standing up for the "open standards are good" that you (and purt near everyone on /.) believe in. And despite this, IBM remains one of the biggest backers (if not the) of Java in the industry. Hardly "leaving Sun out to dry."


      The only reason they aren't as powerful today is because they got too big and unresponsive, which led them to make several bad decisions.

      That you feel IBM is less powerful today than the late 80's surprises me. By almost every indication financially the company is doing better and the general public (specifically the IT industry) has a more positive view of the company and not (I believe) for the reason you site. So IBM may not have a stranglehold on the tech industry lilke they used to, but that is "power" that they don't want. Look where it got them, and look where it is getting Microsoft.

      As for bad decisions hurting IBM, they made their share of them. Their major mistake being their structural divisions of the company into different operating units in preparation for the governments forced breakup that never came. The ways in which they did this killed IBM in more ways than anyone not in the company at the time can even imagine. So even if Microsoft doesn't get divided, it could be very interesting anyway.

      And I think that IBM's strategic movements towards Linux and other open source projects are much too broad and pervasive to be an IBM version of Microsoft's "embrace, extend, extinguish" that you believe it is.
    2. Re:Can We Trust IBM? by SEE · · Score: 2

      Look at what they're doing with Sun and Java. After working with Sun for 4 years, they refuse to ratify Sun's version of EJB, in effect leaving Sun out to dry.

      And Sun deserved such a fate. IBM made huge contributions to Java with the understanding that it would be standardized; instead, Sun abandons the standardization process and charges $$$ for work that was in significant part done by IBM.

      IBM's our best hope for a widely-adopted non-proprietary Java. IBM needs to integrate mainframes, Windows machines, OS/2 machines, Linux machines, and more; an open Java is a critical component of their buisness strategy. Sun wants to make money selling the replacement for Windows -- closed Java is they way they expect to do that.

      Steven E. Ehrbar

    3. Re:Can We Trust IBM? by carlos_benj · · Score: 2
      Well, IBM was the godfather of FUD before MS stole that crown.

      However, some of this sounds a lot like the LVM for AIX - like expanding a volume's size on the fly. Wonder if they'll include smit/smitty or something like that? (Anybody else remember AT&T's FACE?)

      carlos

      --

      --

      As a matter of fact, I am a lawyer. But I play an actor on TV.

    4. Re:Can We Trust IBM? by / · · Score: 3

      As long as it's released under a liscense like the GPL, we don't need to trust them -- it's out of their hands and into ours if it's a good piece of code. In general, we should trust them about as much as any other self-serving corporate interest, although they get bonus points for having given something to the community in the past and for being the enemy of our enemy (MS).

      --
      "If one is really a superior person, the fact is likely to leak out without too much assistance" -- John Andrew Holmes
    5. Re:Can We Trust IBM? by EvlG · · Score: 3

      Look at what they're doing with Sun and Java. After working with Sun for 4 years, they refuse to ratify Sun's version of EJB, in effect leaving Sun out to dry. IBM was given access to all of Sun's java IP and this is how they repay them?

      I thought this was because Sun was charging licensing fees for thr EJB spec, and IBM didn't think that was fair. Thus, they register a protest by refusing to ratify it.

  10. Biting the Hand that Feeds You... by Carnage4Life · · Score: 5

    Okay, on behalf of all the slashdotters who realize how much IBM is contributing to Open Source I would like to apologize to all IBMers who read the above post.
    Besides Linux pure-plays like RedHat and VA Linux no company gets it more than IBM. Their contributions to Apache are impressive, they are releasing laptops with Linux, implementing a better JDK than Sun's for Linux plus they are behind the AlphaWorks site.But instead of thanking them or being grateful for their contributions certain people feel that they should bitch and moan about how IBM will turn on Open Source (how? By stealing GPLed code???). The tiff with Sun you describe is simply that IBM licenses some Java technologies but refused to pay Sun's exorbitant licensing fees for the J2EE brand. Wow, that is so evil, they implement a better version of Java than Sun then refuse to pay Sun for the permission to call it Enterprise Java.

    Ingratitude is sad to witness.

  11. Bah! by Greyfox · · Score: 2
    I've been working with them on and off for a decade now. I was in Boca during the days when OS/2 seemed like it might actually win out against Microsoft. IBM truly believed that they could pull it off when they talked about OS/2 everywhere -- and they DID talk about it. They talked about it both internally and at many of the big trade shows. Efforts were underway to get parts of it running on the bigger iron.

    That lasted for all of a couple of years after I signed on with them. Several factors contributed to the decline of OS/2, including the internal infighting that you mention. And of course Microsoft was always happy to give the knife an extra twist at every chance.

    I suspect a lot of IBMers are taking some pleasure in the hurts Linux is putting on Microsoft. I'm sure they're enjoying establishing Linux as a good solid leader in the features race, too.

    --

    I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

  12. Re:Cool! Now, what about smit? by Greyfox · · Score: 2

    You can compile bash for AIX. Which was always the first thing I did on encountering a new AIX box. Or try zsh, which I believe also features tab completion. If you're really feeling masochistic and have a sufficiently late version of AIX, you could even compile everything you need to run Gnome. I saw a fellow running Enlightenment on an AIX box at IBM once. That was cool.

    --

    I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

  13. SMIT's not *that* inflexible by henley · · Score: 2

    I'd agree that AIX adds a separate, proprietory binary configuration database (the ODM) to the UNIX flat-file configuration model, and I'd agree that the way in which the ODM is bolted-on to the UNIX model leaves some ugliness at the boundaries.

    However, to say "SMIT is the only choice" for configuration is somewhat misleading. One of SMIT's strengths is that *everything* is implemented via commands and scripts, under the covers. Indeed, it's fairly easy to extend SMIT itself to perform custom per-system administration tasks by adding menu / form definitions and the actions needed to implement to the ODM database (which is what SMIT reads to produce the menus, as well as being AIX's authoratitive source of config. data).

    Result? Everything that can be done via SMIT can also be done direct from the command line. In AIX, most (but lamentably not all) commands that change flat-file configuration also "behind the scenes update the ODM also. For instance, the user configuration commands (mkuser, rmuser, lsuser etc) not only affect the filesystem directly (modifying /etc/passwd, /etc/group, /etc/security/passwd, home/ etc), but also update the ODM. Likewise for most of the the device configuration commands (certainly the common TCP/IP commands have this dual-mode operation).

    --

    --
    I'd rather have a bottle in front of me than a frontal lobotomy
  14. This is good news for Linux in the enterprise by Loge · · Score: 2

    As the LVM for Linux page points out, the LVM concept was initially developed by IBM and subsequently adopted by other systems, so this is an area that IBM understands probably better than anyone else (except maybe for third parties such as Veritas). Indeed, LVM was one of the main selling points for IBM's AIX when it first appeared in the early 90's, and helped IBM greatly to make inroads against incumbents Sun and HP.

    Even though this technology obviously won't make it into the 2.4 release, it will dramatically strengthen Linux's enterprise capabilities when 2.6 ships, particularly when coupled with the journaling file system in that release. Flexible volume management is taken for granted by most commercial users today, and capable LVM functions in Linux will put its storage capabilities on par with almost every other operating system available.

    Note, though, that regardless of the design of the LVM itself, there are some tricky issues that need to be resolved in the implementation with an actual file system. For example, it turns out that growing volumes is fairly straightforward, but shrinking them is much more difficult. The paper mentions that specific support is needed from the underlying file system to enable shrinking, so even with this "gift" from IBM, there is still a lot of work to be done to come up with a useable solution.

  15. Re:OpenSource LVM already exists. by Syberghost · · Score: 3

    IBM would do well to work with the existing project, or at least to establish a good-faith basis for communucation with the developer community already committed to solutions under public license.

    The same could be said of Linus and FreeBSD. I think we're all better off with competition, because Open Source competition benefits both projects.

    --

  16. JFS & other code out to dry by tmu · · Score: 3

    The real question is 'will they actually develop it and make it work?'. The reason it's a question is that IBM has been releasing code to the community for a little while now and targetting it at Linux, but they have not put sufficient developer time into making it work.

    Their JFS (journalling file system) is a good example of this. released quite some time ago, no effort to port it to current versions on the kernel and no apparent discussion about that is going on.

    The LVM could be similar. *IF* they had released the LVM last year and *IF* they had supported it with a reasonable amount of programming resources we might care (and I say this as a person who has used and *loved* IBM's LVM on AIX). On the other hand, if they just release the code but don't support the transition and don't make an active effort to participate in community development of it, who cares?

    Contrast this to SGI who, for all of their failings as a company, are releasing code *and* supporting its inclusion into the kernel through active participation in the linux-kernel list, web sites and other mailing lists. I'd like to see IBM get on board in the same way.

    1. Re:JFS & other code out to dry by shaggykl · · Score: 3

      I'd say 2.3.99-pre6 is a pretty recent version of the kernel. I'm testing my current changes on 2.4.0-test1-ac19, but it's not ready for the rest of the world yet. There hasn't been a whole lot of discussion, but we do reply when something is sent to the jfs-discussion mailing list. As far as the kernel mailing list. We do read it, as well as linux-fsdevel. If we haven't been posting, it's because we're still in the porting stage and are still learning about the existing design. We'll be contributing more after 2.4 is stable and the real journaling discussion gets hot on the 2.5 kernel.

  17. Ben Rafanello responds by BenR · · Score: 5
    I see that IBM's announcement has generated some confusion as well as many questions. I will try to answer all of the questions I can.

    First the easy ones:

    I wonder if this is some pie in the sky vision or if they have any code to back this up?"

    Yes, we have code. IBM has a prototype of this LVMS on at least one of its platforms that I know of.

    As long as it's released under a liscense like the GPL, we don't need to trust them

    We are currently releasing the technology to the Linux Community. The current white paper provides a high level view of the basic architecture. As the architecture is discussed with the Linux Community, additional white papers will be produced to explain, in greater detail, various aspects of the architecture. Should things progress to the point where we are actually releasing code for some or all of it, then any code we release will be under the GPL.

    Heinz Maulshagen and team have already written an LVM for Linux. This LVM is already in the 2.3.x series of kernels. What is IBM's reasoning for this duplication of effort? Might it not be more effective to assist in the current LVM implementation instead of bringing additional complexity? Or are there advantages in IBM's approach to logical volume management?

    Heinz and his team have done an excellent job with their LVM. However, we feel that our design has some advantages, and that we are looking at the problem from a different perspective. Let me explain.

    IBM's initial concept of a logical volume management system was not all that different from what we find in the Linux Community today. However, over the years, IBM's concept has evolved based upon input from our customers, as well as usability studies performed on our customer base. Our current concept of a logical volume management system integrates disk partitioning and management, bad block relocation, software RAID, encryption, filesystems, logical volume creation, deletion, and management, etc. into a single, coherent, open ended architecture. All of the components of this architecture communicate with the Logical Volume Manager, who co-ordinates their activities and handles all interactions with the user. The Logical Volume Manager is a single program with three interfaces: a command line interface, a text mode interface, and a graphical user interface. Thus, there is a single place for the user to turn to for any aspect of logical volume management. This makes logical volume management easier for the user to learn and use, and it reduces the chances for user error and data loss.

    As an example of IBM's concept, lets examine the case where an encrypted volume is to be shrunk. We will assume that the user has already been through any authentication process which may be required to access the encrypted volume and has been granted full access. The user would start the LVM. The LVM would allow the user to select a volume. Once selected, the user would indicate that the volume should be shrunk. The LVM would examine the volume, find which features are in use on the volume (encryption, in this case), find what filesystem is in use on the volume, and then ask each feature that would be affected by the shrink if that feature can handle having the volume shrunk without data loss. If a feature indicates that it can NOT handle having the volume shrunk, then the LVM informs the user that the volume can NOT be shrunk without data loss. If all of the features indicate that they can handle having the volume shrunk, then the LVM would ask the filesystem on the volume how much the filesystem can be shrunk without data loss. If the filesystem indicates that it can't be shrunk without losing data, the LVM will inform the user appropriately. If the filesystem can be shrunk, it will indicate how much it can be shrunk before data loss begins. The LVM will then present this value to the user and allow the user to specify how much to shrink the volume by, limiting the user's choice to only those values that prevent data loss. Once the user has specified how much the volume is to be shrunk by, the LVM will then notify the filesystem to shrink itself. Once the filesystem is done shrinking itself, the LVM will notify the features on the volume that the volume is about to be shrunk. After this, the LVM will actually shrink the volume. Once the volume has been shrunk, the LVM will notify the features on the volume that the shrink has been completed. The filesystem will also be notified that the shrink has been completed. Once all of this has been completed, then the user will be notified that the volume has been successfully shrunk.

    The above example is quick and dirty, and it leaves out quite a bit, but I hope it gives you an idea of what we are trying to accomplish. Basically, we are trying to bring together all of the various aspects of logical volume management into a single, cohesive, seamless entity. Furthermore, we are trying to do this in a way which is as flexible and expandable as possible. Consider the following:

    The LVMS architecture uses logical disks. Logical disks are created and controlled by plug-in modules called "Device Managers". Thus, anything that can be made to appear as a logical disk through the use of a plug-in "Device Manager" module can be used by the LVMS. As an example, lets say we have a "Device Manager" plug-in which can access a Storage Area Network (SAN). By just adding this plug-in to an existing system, the LVMS would be able to allocate storage on a SAN, make it appear as a logical disk, and then use any of the LVM capabilities that could be used on a local disk. No code in the LVMS, existing plug-in modules, or LVM utilities needs to be modified or changed.

    The LVMS Architecture uses logical partitions. Logical partitions are controlled by plug-in modules called "Partition Managers". If you wanted to access a drive that was partitioned for use with a Mac, you would just need a "Partition Manager" plug-in module that understands the partitioning scheme used by the Mac. No LVMS, existing plug-in module, or LVM utility needs to have its code changed. All that needs to be done is have the Mac "Partition Manager" plug-in added to the system.

    The LVMS Architecture employs something we call "Feature Plug-ins". Feature Plug-ins control how logical partitions are combined into logical volumes, such as through drive linking, the various forms of mirroring, or software RAID. They can also be used to filter I/O to a volume, as would be the case for encryption. They can also be used to redirect I/O, as in the case of bad block relocation. Furthermore, Feature Plug-ins can be stacked to produce a volume, so that multiple Feature Plug-ins can be used on a single volume (encryption combined with software RAID and bad block relocation, for example). Every volume in the system can employ different Feature Plug-ins, and volumes which do use the same Feature Plug-ins can have them stacked differently. Thus, the user has an enourmous amount of flexibility. One final point to make here is that, since all of the plug-in modules communicate with the LVM, the LVM can coordinate their activities to ensure that the user doesn't do something which will result in the loss of data (at least without adequate warning).

    Given all of the above, I hope everyone understands why we think the LVMS Architecture we are releasing has some advantages over other approaches.

    Well, this post has gotten excessively long, and I apologize for that. I will try to address additional questions/comments/concerns later, hopefully with smaller posts!

    Ben Rafanello

    IBM Linux Technology Center

  18. Re:LVMS is /not/ LVM by EvlG · · Score: 2

    Do they make you wear the stiff white shirt of a specific color of computer lore, or are they like lots and lots of tech companies, that recognize being productive means being comfortable (ie, wearing what you like and working how you like?)

    Not that this is not intended as a troll...I'm generally interested. I'll be graduating with a BS in CS in 2 years, and I'm trying to get a head start on job prospecting. As such, I don't want to work for a place that imposes arbitrary rules on work habits and the like.

  19. IBM and Linux by Greyfox · · Score: 4
    Linux gives IBM the ability to make good on the IBM dream of having a single OS running across all its hardware platforms. It was originally to be OS/2 but they screwed that up pretty well. They tried to port AIX to the PC archetecture. AIX for Microchannel was probably the shortest-lived creation in the history of information services. Most of their mainframe OSes kind of look like one another but are still pretty different from anything on the PC.

    Many IBMers expressed relief (on the IBM internal forums) that Linux was beyond the control of IBM, so the company couldn't screw it up the way they did with OS/2. Many of them are still bitter about that. Many of the old OS/2 guard have moved to Linux, happy to have an OS that lets them work the way they want to work.

    I think it's cool that they're adding neat features to the OS. Having them contributing cool features why not trying to manage or market the OS seems to be the right way of doing things. Perhaps they should look at modifying their other business units to work in this sort of paradigm, with IBMers only contributing to projects managed by other business units...

    --

    I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

  20. OpenSource LVM already exists. by Jeremiah+Cornelius · · Score: 3
    There is already an OpenSource LVM for Linux, at:

    http://linux.msede.com/lvm/

    Check Freshmeat for updates.

    IBM would do well to work with the existing project, or at least to establish a good-faith basis for communucation with the developer community already committed to solutions under public license.

    Jeremiah

    --
    "Flyin' in just a sweet place,
    Never been known to fail..."
  21. This will be really good! by ShamballaJones · · Score: 2

    I just spent most of a day reorganising the partitions on several machines (backup, repartition, restore, repeat etc.). A LVM would have been an enormous help.

    As for it's being ready or not; IBM don't usually make this kind of announcent unless they've pretty much gotten the technology down so I'd expect the project to be well on it's way.

    --
    [ Blairism is the continuation of Thatcherism by other means. ]
  22. Logical? by Signal+11 · · Score: 4
    As opposed to .. what.. illogical volumes? I can just see it now...

    ~# mount -t ext2 /dev/sda2 /home
    Error: fuzzy dice in foo buffer found.

    ~# mount -t ext2 /dev/sda2 /home -o fuzzy_dice

    Error: fuzzy dice requires car.o module

    ~# insmod car.o
    Unresolved symbols: car_need_oil, car_need_gas

    ~# dd if=/dev/cash of=/dev/bank bs=1 count=300
    0+300 records in
    0+300 records out

    ~# dd if=/dev/bank of=/dev/wallet bs=1 count=50
    0+50 records in
    0+50 records out

    ~# insmod car.o io=/dev/wallet

    ~# mount -t ext2 /dev/sda2 /home -o fuzzy_dice
    Succeeded.

    ~# cd /home
    ~# ls

    KERNEL PANIC!

    000:000 FF 00 CC G0 BB LE DE G0 0K

    Goddamn illogical drives...

  23. Re:IBM is making good on promises... by SoftwareJanitor · · Score: 2

    I would agree that many people are too hard on IBM. I have to admit, that at first I was skeptical as hell about their involvement in the free software/open source world. But I have to say that so far they are doing a much better job of living up to their promises than I ever thought they would have.

    I think that if IBM can clean up their act like they have, that maybe there is possibly some hope that Microsoft may someday decide that they don't have to play dirty tricks all the time too. I'm not all that optimistic that will happen any time soon, but I won't say it could never happen.

    Unfortunately, for IBM it took a large scale turnover at the top levels of their management to get them to change their status quo. If anything, the replacement of Akers by Gerstner was the key turning point for IBM. Microsoft upper management is still firmly entrenched with Gates and his inner circle. As long as they stay where they are, it is unlikely they will change.

  24. Cool! Now, what about smit? by Pinball+Wizard · · Score: 2
    I've had to administer an AIX box for the last few years. I know there are a lot of posts about already existing LVM's, but the AIX LVM works really well and its stable.

    If they do this, I hope they give Linux the tools to make the LVM usable. Particularly the mksysb command(can be configured to back up your root volume) and especially smit.

    Smit is about the best sysadmin tool I've ever used. Its much better than linuxconf IMO. I know the purists out there think "a real sysadmin always uses the command line", however what smit gives you is the command line, in a convenient menu form. Rather than wading through the man page, you basically have a menu that comprises each command line option with a description of what it means. You can also hit F6 at any time to see the command you are about to execute. Which also makes it a great tool to learn Unix.

    --

    No, Thursday's out. How about never - is never good for you?

  25. IBM is making good on promises... by ejbst25 · · Score: 3

    IBM promised to bring more and more stuff to Linux..And they are doing it

    In this article at ZDNET, they talk about how IBM is releasing their Small Business Pack for Linux. They are trying to port more and more over to Linux. A lot of people don't seem to give them credit. I support this outright...and hope they release more stuff under a more flexible license like the GPL. I think that every corporation can see the light eventually. Here's to hoping.

  26. Re:Just say "No" to "logical volumes"... by SoftwareJanitor · · Score: 2

    Since Linux is open source, and still has an important constituant market in smaller systems, there is no reason to think that incorporation of LVMs has to be exclusive to the current simple partitioning systems. LVMs should remain an optional thing for people who want or need them.

    Support for LVMs, particularly the IBM one, if it is compatible with AIX could be important for Linux acceptance in the large enterprise market for that very reason. For that reason alone, I am happy to see IBM bring this to Linux.

  27. Re:SMIT by SoftwareJanitor · · Score: 2

    That was a really necessary feature in SMIT, as some of the low level sysadmin commands and file formats in AIX so were wretchedly different from the standards. The nonstandard wackiness at that level was the thing I hated most about AIX when I had to administer it (in the early 90s). It wasn't so bad for actual use, but the administration took an awful lot of getting used to no matter if you were used to BSDish systems (I had been administering 4.3BSD, SunOS 4.x and Ultrix before that) or SysVish systems (also had been doing SysV on AT&T and Motorola hardware).

  28. Not surprising by babbage · · Score: 4
    All the posts about IBM's relationship with Linux seem a bit odd to me; I can't see why it's such a big surprise or matter of debate.

    Think about it. IBM sells a *wide* variety of products, from laptops to mainframes and from software to service. It complicates matters for them if they have to be "multilingual" with their platform systems; Linux gives them a way around this by, as suggested in the Halloween documents, treating the OS as basically a generic commodity.

    The more popular Linux gets, and the better IBM's equipment works with it, the better their bottom line gets. If Linux gives them a platform to standardize around, then they can sell more hardware and support services and not have to worry as much about certain problems (compatibility, stability, etc) that live at the OS level. This is very much in their interest, but it's also in the interest of consumers as well, if Linux becomes a reliable system component along the lines of, say, a hard drive or a word processor. The consumer gets the benefit or a robust & rewarding system platform that works on most any equipment available; IBM gets the benefit of having their entire product range appeal to customers because it all speaks the lingua franca of the computer world that they are positively contributing to.

    Consider EBCDIC. Wasn't that the standard text format on IBM machines back in the day? Is it in use on any modern system? [I'm asking -- not rhetorical...] It seems to me that they had the wisdom to (eventually) switch to the open ASCII standard before, and are promoting the new Linux standard now. I see no reason to be suspicious of this behavior -- everyone stands to benefit, or at least everyone that isn't trying to shill a proproetary in-house OS... :)



  29. Just say "No" to "logical volumes"... by jetson123 · · Score: 5
    I have used LVM for a number of years, including IBM's LVM. As far as I am concerned, logical volumes are a bad idea. Why?

    • LVs complicate system management; in particular, they make it more difficult to figure out what physical devices a file system actually depends on, and they make it much more likely that you make a mistake when setting up disks.
    • LVs break the correspondence between block numbers and head positions. With simple physical mappings, small differences in block numbers usually correspond to small head movements, something file system designs tend to rely on, but with LVs, all bets are off.
    • If you take advantage of LVs spanning multiple disks, you just multiplied your risk of data loss, because if any one of those disks goes, so does the whole file system.

    There are better solutions to the problem LVs are supposed to address:

    • If you need file systems bigger than a single disk, use RAID.
    • GNU Parted and PartitionMagic already provide you with the ability to resize partitions without a full backup and restore; you don't need LVMs for that.
    • If you use several file systems to limit how much space particular applications can eat up, consider using quotas instead.
    • One of these days, Linux may get concatenated mounts, which would give you another, very reliable and simple way of having file systems span multiple disks. Adding concatenated mounts would probably not be any harder than hacking in an LVM.

    IBM's LVM was one of the reasons I hated using AIX (they did similarly oddball and nonstandard stuff in some other areas). I consider it a poorly designed facility. While we can't keep people from porting stuff to Linux, I hope Linux distributions will not incorporate that kind of nonsense; Linux configuration and system management needs to get simpler, not more complex.

    The drive for systems like LVM is understandable because UNIX and Linux file systems and large scale data management are not perfect. For example, a big ISP that runs out of disk space on some important partition and needs more space quickly has a legitimate problem. But rather than rushing to a half-baked solution like LVMs, let's identify what the problems are we really want to solve and come up with good solutions to them. With upcoming technologies like object-based disk storage systems, there seem to be much more straightforward and reliable answers than LVM.

  30. LVMS is /not/ LVM by Will+the+Chill · · Score: 5

    Allrighty, everybody. I think that anyone who starts to think "why would we need another LVM?" should /definitely/ go read the LVMS whitepaper. It's not the same thing as the previous LVM or LVM's that may have existed. Go. Read.

    Let me tell you one of the neato things about working at IBM in Austin - I got to talk to Ben (yes, Ben Rafanello, the guy who posted the stuff to the linux mailing lists) all about this last night, and he told me he was planning on posting that stuff. So anyway, I read the LVMS whitepaper last night, and it is /definitely/ something that the Linux community is going to want to jump at.

    For those of you who are wondering about what license it will be released under - well, I can't say for sure. Just remember that IBM GPL'd their JFS, and we continue to work on that here as well. (I'm actually working on the JFS here in Austin.)

    And yes, IBM /has/ changed alot. They're actually pretty damned cool! I would highly recommend anyone looking for a cool Linux-related job to consider IBM. Hey, look at me! I'm getting paid to write Open-Source Software!

    -Will the Chill

    --
    Creator of RPerl, Scouter, Juggler, Mormon, Perl Monger, Serial Entrepreneur, Aspiring Astrophysicist, Community Organiz