Slashdot Mirror


Ubuntu Plans To Make ZFS File-System Support Standard On Linux

An anonymous reader writes: Canonical's Mark Shuttleworth revealed today that they're planning to make ZFS standard on Ubuntu. They are planning to include ZFS file-system as "standard in due course," but no details were revealed beyond that. However, ZFS On Linux contributor Richard Yao has said they do plan on including it in their kernel for 16.04 LTS and the GPL vs. CDDL license worries aren't actually a problem. Many Linux users have been wanting ZFS on Linux, but aside from the out of tree module there hasn't been any luck in including it in the mainline kernel or with tier-one Linux distributions due to license differences.

49 of 279 comments (clear)

  1. Re:ZFS is nice... by Anonymous Coward · · Score: 4, Insightful

    Why would you need nvidia drivers on a file server? Use Ubuntu Server, it's made for, well, being a server.

  2. Re:ZFS is nice... by gilgongo · · Score: 2

    What was the Nvidia video driver doing on a server?

    --
    "And the meaning of words; when they cease to function; when will it start worrying you?"
  3. Re:ZFS is nice... by Frnknstn · · Score: 3, Interesting

    I run ZFS on any / every machine I can, server or not. That is one filesystem where the features outweigh all possible concerns.

    --
    If it's in you sig, it's in your post.
  4. What he didn't say by n1ywb · · Score: 3, Informative

    is anything like "ZFS will be the default". He just said that it would be in the distro.

    --
    -73, de n1ywb
    www.n1ywb.com
    1. Re:What he didn't say by tomhath · · Score: 2

      He also didn't say it would be the default on "Linux" (whatever that is). Just Ubuntu.

  5. BTRFS is getting there by DarkOx · · Score: 4, Insightful

    I don't why so many in the Linux community are so hooked on ZFS. BTRFS has a feature set that is rapidly getting there, its becoming more a more mature in terms of code that is already in the upstream.

    Why not just put your energy there?

    --
    Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    1. Re:BTRFS is getting there by Phil+Urich · · Score: 5, Interesting

      Hell, it's already in many cases a superior experience on Linux, starting with that you can shrink a BTFS volume but you still can't shrink a ZFS volume. I suppose in the enterprise-centric world that ZFS is aimed at that's pretty much never an issue, but I've even run into it personally multiple times myself working for a small business and have been glad that I was running BTRFS instead. Frankly, for many use-cases it seems like running ZFS on Linux is more hassle for the sake of then more hassle later on.

      --
      I remember sigs. Oh, a simpler time!
    2. Re:BTRFS is getting there by Guspaz · · Score: 4, Interesting

      Because BTRFS is and has always been redundant? ZFS is far more mature, and stories abound of BTRFS failing on people. BTRFS is still unstable, particularly their RAID5/6 support. Developers should be putting their efforts into ZFS instead of BTRFS.

    3. Re:BTRFS is getting there by TrekkieGod · · Score: 4, Interesting

      I don't why so many in the Linux community are so hooked on ZFS. BTRFS has a feature set that is rapidly getting there, its becoming more a more mature in terms of code that is already in the upstream.

      Why not just put your energy there?

      As someone who uses both zfs (for file server storage) and btrfs (for the OS), my reason for using zfs is raidz. If btrfs implemented something similar, I'd drop zfs.

      --

      Warning: Opinions known to be heavily biased.

    4. Re:BTRFS is getting there by rl117 · · Score: 5, Informative

      It's really quite simple. ZFS is a great filesystem. It's reliable, performant, featureful, and very well documented. Btrfs has a subset of the ZFS featureset, but fails on all the other counts. It has terrible documentation and it's one of the least reliable and least performant filesystems I've ever used. Having used both extensively over several years, and hammered both over long periods, I've suffered from repeated Btrfs dataloss and performance problems. ZFS on the other hand has worked well from day one, and I've yet to experience any problems. Neither are as fast as ext4 on single discs, but you're getting resilience and reliability, not raw speed, and it scales well as you add more discs; exactly what I want for storing my data. And having a filesystem which works on several operating systems has a lot of value. I took the discs comprising a ZFS zpool mirror from my Linux system and slotted them into a FreeBSD NAS. One command to import the pool (zpool import) and it was all going. Later on I added l2arc and zil (cache and log) SSDs to make it faster, both one command to add and also entirely trouble-free.

      Over the years there have been lots of publicity about the Btrfs featureset and development. But as you said in your comment that it's "rapidly getting there". That's been the story since day one. And it's not got there. Not even close. Until its major bugs and unfortunate design flaws (getting unbalanced to unusability, silly link limits) are fixed, it will never get there. I had high hopes for Btrfs, and I was rewarded with severe dataloss or complete unusability each and every time I tried it over the years since it was started. Eventually I switched to ZFS out of a need for something that actually worked and could be relied upon. Maybe it will eventually become suitable for serious production use, but I lost hope of that a good while back.

    5. Re:BTRFS is getting there by danbob999 · · Score: 2

      I don't why so many in the Linux community are so hooked on ZFS. BTRFS has a feature set that is rapidly getting there, its becoming more a more mature in terms of code that is already in the upstream.

      Why not just put your energy there?

      The fact is that 99% of the users couldn't care less about ZFS or BTRFS. Ext4 is just fine, and ext3 was also fine before, for 99% of the use cases. Hence, most people will just stick to their default FS.
      Likewise, most Windows users are fine with NTFS, and wouldn't switch to ZFS even if it became available on Windows.

    6. Re:BTRFS is getting there by ArmoredDragon · · Score: 4, Interesting

      I've been using ZFS on Linux for about 3.5 years now, it's been pretty stable. I can't say I've heard of a case of it failing for somebody other than user error.

    7. Re:BTRFS is getting there by Guspaz · · Score: 4, Informative

      zfsonlinux hit both unstable and stable releases on Linux earlier than btrfs: if your only definition of stable is how long it's been around on Linux, then btrfs is still less mature.

      Being in-tree says nothing about the stability of a module, but ZFS doesn't need to be under the GPL to be in Linus' tree: the GPL does not forbid code aggregation. That said, neither Linus nor the ZoL team want ZoL in Linus' tree.

    8. Re:BTRFS is getting there by cas2000 · · Score: 4, Interesting

      Because there's really no comparison between btrfs and ZFS. ZFS is years ahead in both stability and features. Only someone who's never used both would say that they are in any way close.

      The only really useful thing that btrfs does that ZFS does not is rebalancing - that's a great feature and i'd love to see it in ZFS (but it will probably never get there).

      ZFS has lots of features that btrfs doesn't have and likely never will.

    9. Re:BTRFS is getting there by rl117 · · Score: 3, Informative

      I mean the performance gains as you add more discs.

      And regarding adding discs to an array, you certainly can. Just add addtional raid sets to the pool. That is, rather than adding discs to the existing array, you scale it up by adding additional arrays to the same pool. See the documentation.

    10. Re:BTRFS is getting there by rl117 · · Score: 4, Insightful

      It can certainly work when everything is working correctly. Have you tested its behaviour when things don't work correctly, for example by pulling the cable on one of the discs as it's running? Does it carry on running, does it transparently recover when you plug it back in? When I had a cable become unseated and the connection glitched, Btrfs happily toasted the data on the drive, and its mirror, and panicked the kernel whenever the discs were plugged in; I had to zero them out on another system before I could even try to reformat them. One of the major historical weak points has been that the failure codepaths were poorly tested, and this can come to bite you quite badly.

    11. Re:BTRFS is getting there by Anonymous Coward · · Score: 2, Interesting

      13.1% of the code changed between 0.6.4 and 0.6.5:

      http://fossies.org/diffs/zfs/0.6.4_vs_0.6.5/index.html

      That is far from being frozen. Even Linux does not have that percentage of its code change between releases:

      http://fossies.org/diffs/linux/4.2_vs_4.3-rc1/

      It would be interesting if someone checked out much fs/btrfs changes between releases.

    12. Re:BTRFS is getting there by mi · · Score: 2

      I don't why so many in the Linux community are so hooked on ZFS.

      Because it is good. In particular, it offers the only sensible way to make good use of the ephemeral storage offered by Amazon's Web Services (AWS) in a general case — the fast (SSD) storage can be used as read-cache for a ZFS stable of mount-points.

      Why not just put your energy there?

      Why do put any energy into reinventing the wheel? And struggle with triangular "wheels" in the process?

      --
      In Soviet Washington the swamp drains you.
    13. Re:BTRFS is getting there by ZorinLynx · · Score: 4, Interesting

      Likewise; we use it all over the place in our department. We have a bunch of 96TB/80TB usable ZFS file servers based on 24 4TB SATA drives. The performance is amazing for the price and they are rock solid under all kinds of heavy load, except for one tiny bug we hit recently that has been fixed already.

    14. Re:BTRFS is getting there by ZorinLynx · · Score: 2

      >neither Linus nor the ZoL team want ZoL in Linus' tree.

      I bang my head on my desk frequently over Linus' stubborn nature, then I realize it's that same stubborn nature that makes Linux as great as it is, so I forgive him.

      If ZFS were part of the kernel, bugfixes and updates would have to follow the Linux kernel release schedule, which would make it a huge hassle to update the code on running systems without building custom kernels.

      Building custom kernels is something you shouldn't be doing in a production environment unless it's either 1995 or you're a masochist. :)

    15. Re:BTRFS is getting there by Bengie · · Score: 2, Interesting

      BTRFS is the SystemD of filesystems. Lots of features, poor design. Features can be great, but they come at a cost. To summarize the issues with BTRFS, is it violates the principle of least surprise, which can result in some completely unexpected gotchas. The other thing is it is not truly transactional/atomic. By design, it requires fsck, which means the filesystem can be left in an inconsistent state. This opens the doors for a host of issues that ZFS is guaranteed to never have.

      Not to mention, there are still plenty of people complaining about it eating their data.

    16. Re:BTRFS is getting there by Bengie · · Score: 2

      As much as I love ZFS over BTRFS, monoculture is bad. If anything, BTRFS is a learning experience for the entire community, but I do think ZFS needs first class support.

    17. Re:BTRFS is getting there by ZorinLynx · · Score: 4, Interesting

      I recently "fixed" one of our ZFS fileservers at work which was performing very poorly by *removing* a failing drive. The drive was taking a few seconds to read blocks, obviously dying, so it was slowing down the entire system. As soon as I pulled it ZFS finally declared it dead and the filesystem was running at full performance again.

      I felt so confident being able to just walk up and yank the troublesome drive; that's how much trust I've built in ZFS. It's incredibly stable and fault tolerant.

    18. Re:BTRFS is getting there by Bengie · · Score: 5, Insightful

      Nearly all of the original Sun devs that created ZFS in the first place, still work on OpenZFS full time and are paid to do so. OpenZFS is very actively developed. They have 2 or more presentations per year about all of the changes they're constantly making and some of the upcoming big changes. Currently they are focusing on standardizing ZFS between FreeBSD, Luminos, and Linux. It's a large refactoring effort to have all ZFS's code bases to live in the same tree. One OpenZFS code tree for all OSes. Everyone will be in sync.

      While you can't shrink ZFS pools because they cannot do that atomically, and they refuse to do anything that allows the end user to shoot themselves in the foot, like leaving the FS in an inconsistent state, you can create a new pool that is smaller and import your larger pool into the smaller one, as long as it fits. Can't do it in-place, but you can do it. It just sucks to do that with a 1PiB+ pool. But who shrinks those?

    19. Re:BTRFS is getting there by Bengie · · Score: 2

      Don't use RAID5. When one drive dies, there is a very good chance another drive will die, even if the that drive is a different model or brand.

    20. Re:BTRFS is getting there by Bengie · · Score: 2

      They recently said that pointer-rewrite, which is required for re-balancing, will not happen. They have looked at the issue for a few years now and cannot figure out a safe way to make it work that wouldn't open up a window for dataloss. The only way to rebalance or shrink is to make a new pool on another set of drives, and import the existing pool.

    21. Re:BTRFS is getting there by fnj · · Score: 2, Informative

      I don't know what your definition of "significant" is, but the BTRFS wiki says "The one missing piece, from a reliability point of view, is that it is still vulnerable to the parity RAID 'write hole', where a partial write as a result of a power failure may result in inconsistent parity data." ZFS RAIDZ is expressly free from the write hole. That is very significant to me.

      RAIDZ's write hole advantage is a product of three specifics: (1) RAID5 has n data disks plus one dedicated parity-only disk; ZFS distributes all data and all parity across all disks - (2) ZFS updates metadata before data; RAID5 has no concept of metadata - and (3) COW (both have this).

      And before you object "but UPS" - UPSs and power supplies can fail, too - and a kernel panic is essentially a "power failure" too; one which a UPS is powerless to prevent.

      If that Wiki should be out of date, you can show me something that isn't, but all I find out there is a lot of outdated stuff.

    22. Re:BTRFS is getting there by rahvin112 · · Score: 3, Informative

      The features you list as "specific" to zfs exist in btrfs. btrfs can have dedicated parity drives or you can spread the data and parity across multiple drives in any order or pattern you would like.

      The write hole in btrfs is AFIAK also present in zfs and listed as a risk of a power failure during write on a raid pool with COW filesystems. This risk is that loss of power during write can result in multiple different parity blocks for the same data and that in such an instance the filesystem cannot identify the correct data or parity (depending on the order you write them) and there are only a few solutions to this that involve resorting to a known good (older) copy and result in lost data (from the write).

      IIRC this is a listed risk in the FAQ for ZFS. Just as the same write hole risk exists in btrfs. Also IIRC ZFS takes the path of writing parity before data such that it will lose new data rather than risk a corruption of existing parity blocks. Whereas, again IIRC btrfs COW's the new data then COW's the parity block which risks inconsistent parity but at less risk of data loss (as parity can be recomputed).

      Two different solutions to the same problem that is intrinsic to COW filesystems with parity data. Neither is particularly better IMO as both run the risk of data loss in an extreme event. Though such events are rare.

    23. Re:BTRFS is getting there by rahvin112 · · Score: 2

      There are people that argue you shouldn't use raid at all unless it's 10. Raid isn't a backup solution. It's a performance and reliability solution. If you need data backup you should be using real backups, not raid.

    24. Re:BTRFS is getting there by mcrbids · · Score: 2

      5 years ago, it seemed that BTRFS was rapidly getting there, and its inclusion into the kernel made it feel like a rather sure bet!

      (crickets)

      5 years later, BTRFS is still "rapidly" getting there. I've tried it numerous times and had horrible data loss events literally every single time, and this as recently as a month ago.

      Meanwhile, we're using ZFS on Linux in a complex production environment in a worst-case mixed read/write use case and it's been absolutely rock solid bullet proof, demonstrably more stable than EXT4. Yes. More stable than EXT4. And this while bring so many incredible features to the administration table! Until you've lived with snapshots, replication, clones, pools, zvols, extendable pools, and dynamic resource allocation, it's like trying to explain Monet to a blind person.

      I sincerely hope that ZFS finally becomes a first class citizen in the Linux community.

      --
      I have no problem with your religion until you decide it's reason to deprive others of the truth.
    25. Re:BTRFS is getting there by Jezral · · Score: 2

      I used to use ZFS on my hacky home backup solution (Linux in VirtualBox with USB storage - yes, I know), but it would corrupt the disks once per month or so. Switched to btrfs, and it just works.

      Features that btrfs has over ZFS, and I use:
      - Mutable snapshots. It is infuriating that ZFS's snapshots are immutable. Mind you, I very rarely modify snapshots, but I damn well want to be able to without having to dump+reload all data. This alone is reason enough that I'll never again use ZFS where btrfs is available.
      - Offline on-demand deduplication. Being able to dedup files when I want is very nice. cp --reflink is also super.
      - Sane hardware requirements. ZFS is designed for extremely high quality hardware (and lots of RAM) that doesn't lie to the OS, which is just not what most of us are running. btrfs is designed for everyday use.

      Features that I miss from ZFS:
      - Online live deduplication. But it's sooo sloooow and requires so much memory, that I don't miss it much.

      Asides from that they're pretty equal in my experience. They both offer transparent compression, which is what I really want.

    26. Re:BTRFS is getting there by geggo98 · · Score: 2

      ZFS is more battle tested. BTRFS is a very fine file system, but it is still stabilizing. They just recently added support for RAID 5 and 6, a quite big features with lots of changes. A file system just takes a few years in the wild, before it can be considered stable. There are just weird corner cases, misbehaving hardware, subtile bugs and so on that you will only find in the wild. When BTRFS with RAID 5 is about 5 to 10 years old, it can be considered stable. Until then, ZFS is the first choice for everything that holds real data.

    27. Re:BTRFS is getting there by Fweeky · · Score: 2

      This is one of the things the Solaris-derived versions have tended to be better at handling - ZFS expects failing drives to be detected/managed by an external fault management service (fmd) which doesn't exist on other OS's. ZFS itself doesn't mark a drive as bad itself unless it outright disappears from the system.

  6. Re:ZFS is nice... by Anonymous Coward · · Score: 2, Interesting

    So how are they doing this without license conflict? Are they doing a clean-room implementation of ZFS?

  7. Re:ZFS is nice... by Guspaz · · Score: 2, Funny

    My file server has a very low-end nVidia graphics card in it. There was some sort of issue with the stock drivers that shipped with the distro, such that I got no video output at all, and I don't have any GUI installed, just text-mode console. I had to install the nVidia drivers to get it working.

  8. Re:ZFS is nice... by __aaclcg7560 · · Score: 2

    Being unable to SSH into my Ubuntu file server was usually the first indication that the automatic update went FUBAR. The black screen from the video card didn't help either.

  9. Re:ZFS is nice... by Anonymous Coward · · Score: 2, Informative

    To name a few: A variety of flavors of built-in RAID / replication. Built in error detection and correction. Snapshots. The ability to send and receive deltas between snapshots from one server to another.

  10. Re:ZFS is nice... by sexconker · · Score: 3, Insightful

    A typical home Linux server - AKA an old PC - won't have IPMI. Actual servers typically will have IPMI, but they cost $BIG_BUCKS$. And even then, IPMI is extremely limited.

    On the Dell servers I bought a few months ago I can't do anything useful with it beyond power on/off or text-only console redirection over serial (over LAN) before the OS loads (I can get into BIOS and the RAID controller ROM, not much else).
    Unless of course I pony up more cash for their iDRAC Standard/Pro/Enterprise/etc. shit. THEN I can get graphical console redirection, some storage space to flash firmware from, and even USB/optical drive redirection.

  11. Re:ZFS is nice... by Bengie · · Score: 4, Funny

    It makes other FSs look like FAT32.

  12. Re:ZFS is nice... by ZorinLynx · · Score: 2

    This is what I wonder as well.

    What's frustrating is that it's not the ZFS license that's the problem. It's the GPL. Oracle couldn't give a flying fuck if someone put ZFS into the Linux kernel, but the GPL zealots would probably raise a huge stink about it and keep it from happening.

    For the record, I support open source; I just don't like the "viral" nature of the GPL. The ZFS situation is a case where it's doing more harm than good.

  13. Re:ZFS is nice... by caseih · · Score: 2

    Sorry but that's simply not true. It was Sun and now Oracle that purposely chose an incompatible license for ZFS. Nothing to do with the GPL here. Your complaints are like the people that buy up land around an airport, build houses, and then complain about the noise.

    Anyway, if you read the fine articles you'd discover that what Ubuntu is going to do is include ZoL modules in their kernel packages. This takes advantage of GPLv2's aggregation clause which lets you ship non GPL binaries with GPL'd binaries because they aren't linked together (think an OS distribution). Once the modules get loaded, that taints the kernel but since it's the end user that initiates this by choosing to use ZFS, there's no copyright violation. ZoL has always operated this way, actually.

    In other words ZoL will not be compiled into the kernel, as to do so by Ubuntu would be a license violation. But Ubuntu plans to ship and support the binary kernel modules. Sounds eminently reasonable to me. Hopefully we'll see this approach adopted by other distributions, athough ZoL is not that hard to get running at all.

  14. Re:ZFS is nice... by __aaclcg7560 · · Score: 2

    ZFS wasn't design for mobile systems. FreeNAS requires a minimum of 8GB RAM and 1GB per every 1TB of raw storage for optimal ZFS performance.

  15. Re:ZFS is nice... by evilviper · · Score: 2, Insightful

    I don't have a serial terminal, so having video output when needed is very important

    So that's three-strikes... You're 1) using a regular PC as a server (no IPMI), 2) that PC doesn't even have a serial port to be used as an OoBM console, and finally 3) you've got some issue with the video card not even displaying text-mode. With all three strikes against your server, I just can't muster any sympathy for the predicament you put yourself in, relying on an unsuitable cheap piece of crap equipment.

    In fact it's probably FOUR strikes... Presumably your video problem was an issue with KMS or similar, and 4) you didn't bother to figure out how to fix/disable/bypass it, and use plan old text-mode. Instead you went with the quickest (but obviously flawed and easily breakable) option of depending on a proprietary video driver. That's just not thinking things through. Reminds me of folks who has just a switchable PDU as their sole method of OoBM... works right up until they acidentally do a clean shutdown of a remote server.

    --
    Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  16. CDDL and GPL don't mix by Bruce+Perens · · Score: 3, Informative

    Regardless of what Ubuntu has convinced themselves of, in this context the ZFS filesystem driver would be an unlicensed derivative work. If they don't want it to be so, it needs to be in user-mode instead of loaded into the kernel address space and using unexported APIs of the kernel.

    A lot of people try to deceive themselves (and you) that they can do silly things, like putting an API between software under two licenses, and that such an API becomes a "computer condom" that protects you from the GPL. This rationale was never true and was overturned by the court in the appeal of Oracle v. Google.

  17. Re:ZFS is nice... by dk20 · · Score: 2

    As someone who has 50TB on a system with 16GB ram i agree with you.
    I wish people would stop spreading this "1gb ram/tb" FUD.

    It is the recommendation for DEDUP, not for standard ZFS.

  18. Re:ZFS is nice... by TheRaven64 · · Score: 3, Insightful

    No. RAID isn't better handled at other layers. If you don't know about the filesystem semantics then you need NVRAM or journalling at the block level to avoid the RAID-5 write hole. RAID-Z doesn't have this problem. If you're recovering a failed block-level RAID, then you need to copy all of the data, including unused space. With ZFS RAID (all levels), you only copy the used data. There are numerous other advantages to rearranging the layers, including being a lot more flexible in the provisioning.

    It's also a mistake to think of ZFS as a layer. ZFS has three layers: the lowest handles physical disks and presents a linear address space, the middle presents a transactional object store, and the top presents something that looks like a filesystem (or a block device, which is useful for things like VM disk images).

    --
    I am TheRaven on Soylent News
  19. Re: ZFS is nice... by __aaclcg7560 · · Score: 2

    When I tested wireless clients at Cisco, I installed the GUI with Fedora or Mint because I needed to run YouTube video in a loop. The division chief wanted to fire me for using 75% of the wireless bandwidth for YouTube. He didn't realize that I had 30 laptops running YouTube video and supporting 300 users without a hiccup in network performance. All the YouTube videos were from the Cisco channel, which included several interview with him. Nothing like seeing your face on 30 screens.

  20. Re:ZFS is nice... by ilsaloving · · Score: 2

    Wow, with all the hostile responses your post has been getting, I almost started thinking that I had joined the LKML by mistake.

  21. Re:ZFS is nice... by Frnknstn · · Score: 2

    One GREAT advantage it has over your bog-standards filesystems like NTFS and ext4 is its copy-on-write architecture, and the essentially free and near-instant snapshot system it provides.

    When you take a snapshot of a filesystem, it simply makes a copy of the superblock. All of the space on the devices remain marked as in-use, and both snapshots share exactly the same physical storage.

    When you make a change to one of the snapshots, it simply writes the changed blocks to a different location on the underlying devices and leaves the still-in-use original block alone.

    --
    If it's in you sig, it's in your post.