Slashdot Mirror


OpenSUSE 13.2 To Use Btrfs By Default

An anonymous reader writes "OpenSUSE has shared features coming to their 13.2 release in November. The big feature is using Btrfs by default instead of EXT4. OpenSUSE is committed to Btrfs and, surprisingly, they are the first major Linux distribution to use it by default. But then again, they were also big ReiserFS fans. Other planned OpenSUSE 13.2 features are Wayland 1.4, KDE Frameworks 5, and a new Qt5 front-end to YaST."

53 of 91 comments (clear)

  1. Beta testers by Anonymous Coward · · Score: 5, Insightful

    Finally someone who beta tests btrfs for me!

    1. Re:Beta testers by complete+loony · · Score: 3, Interesting

      I've lost data with btrfs, but I did have a failing drive that I didn't notice was going bad. I didn't have a redundant copy of meta-data and couldn't seem to change that.

      All of those things have changed since then. You can set up a cron job to scrub your data instead of being blind to sectors going bad. And you have much better control over the redundancy of your data.

      --
      09F91102 no, 455FE104 nope, F190A1E8 uh-uh, 7A5F8A09 that's not it, C87294CE no. Ah! 452F6E403CDF10714E41DFAA257D313F.
    2. Re:Beta testers by caseih · · Score: 3, Interesting

      Been beta testing BtrFS for about 3 years now. Haven't had any problems. This is home desktop use. All my laptops run it, and I'm starting to use snapshotting more and more. Snapshotting a single VM disk image file is very handy.

    3. Re:Beta testers by buchner.johannes · · Score: 5, Interesting

      You can create a file system on a file on your disk (similar to a swap file).
      Contrary to popular believe this is not slower than a partition, because if the file is mostly continuous, it can be mapped to disk directly by the kernel. Here I create a file system using a sparse file:
      $ truncate +20G mylocal.fs
      $ mkfs.btrfs mylocal.fs
      $ mkdir -p mylocal; sudo mount mylocal.fs mylocal/

      You can use such file systems, for example, to bundle directories with many files, which are deleted/created many times. This causes fragmentation in the file system. Contrary to another popular believe, yes, this is a problem on Linux file systems, and it slows down reads. None of the file system currently has a defragger implemented. Btrfs is actually developing one, but I think it is not in the release yet. The recommended solution is rewriting files (shake).

      Sub file system containers can be easily resized, and with sparse files only use up the space filled with data. I use them for the linux kernel build directory (you shouldn't build in /usr/src), for portage (many files, changing frequently), and scientific data directories, to limit the fragmentation, and keep speed high. I use reiserfs for this -- find a managing script here: https://github.com/JohannesBuc...

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    4. Re:Beta testers by AvitarX · · Score: 2

      More likely scenario,

      Most OpenSUSE users use it because they generally like, and trust, the choices of OpenSUSE. This trust may be misplaced, we'll know soon, but in the learning, we'll have a MUCH better understanding of how ready btrfs is to move past the beta testing zone (or if OpenSUSE bosses are right, proven to be past there).

      Defaults matter, reputations of Linux distros can shatter on them, because we're not passive users, and thought they aren't all drop in replacements, as non-passive users, they're close enough.

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
    5. Re:Beta testers by relisher · · Score: 2

      BTRFS inode limitations once cause my system to go completely bonkers. I lost a huge amount of data due to a "limitation of space" when in reality it was an inode limit.

    6. Re:Beta testers by ls671 · · Score: 1

      I still click on ext3 on new installs....

      --
      Everything I write is lies, read between the lines.
    7. Re:Beta testers by ls671 · · Score: 1

      To be objective; did btrfs got more stable lately? Did suse tweak it?

      --
      Everything I write is lies, read between the lines.
    8. Re:Beta testers by felipou · · Score: 1

      Damn, man, your comment surely should have a higher than five rating.

      You should definitely make a blog post about this!

    9. Re:Beta testers by Menkhaf · · Score: 4, Interesting

      I experimented a bit with btrfs some months ago as part of my parttime job at my university. The departments file server had disk failures after a power glitch, so I decided to rebuild it and add in a UPS. I'm running Debian jessie on the system, which is just a small 2U SuperMicro rack case with 12 3 TB SATA drives and 16 GB ECC RAM. ZFSonLinux needs a fairly recent kernel, otherwise I'd probably have gone with stable.

      I was initially pretty impressed with btrfs, but before the UPS arrived there was another power glitch (which is fairly unusual in these parts of the world; northern Europe) and it completely trashed btrfs. I was unable to mount, scrub or do anything productive to the FS. Absolutely no luck doing anything.

      After that I've switched to ZFS. I'm really happy with ZFS, even though ZFS on Linux still has some bugs. For some reason zfs threads sometimes crash when doing zfs send | zfs receive, something I've noticed a few times. Performance is pretty good. For reference I'm using raidz3. My offline, off-site backup is done on a clone of the server (OS only) and uses zfs send and receive to transfer the ZFS snapshots which are done nightly.

      --
      A proud member of the Onion-in-Hand alliance
    10. Re:Beta testers by evilviper · · Score: 1

      OpenSUSE users beta test EVERYTHING for everyone. I thought Fedora was bad, but OpenSUSE puts them to shame...

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    11. Re:Beta testers by vikingpower · · Score: 1

      Absolutely agree. This guy could earn good money as a Linux guru.

      --
      Religous speak to God. Insane are spoken to by God. When all shut up, one can finally hear Shostakovich in peace
    12. Re:Beta testers by Eunuchswear · · Score: 1

      Pah. My phone uses btrfs.

      --
      Watch this Heartland Institute video
    13. Re:Beta testers by AvitarX · · Score: 1

      I'm pretty sure that it's constantly getting more stable, and if OpenSUSE is using it, they probably did vet it.

      I'm pretty sure the only point of distros like OpenSUSE or Fedora are to get wide testing on new technologies (this is good, and running them is a great way to give back to the community).

      I would guess that in a year btrfs is going to be the default in general, but it takes someone to make the leap of faith to start that rolling. If no main stream distro adopts ever, it will by tautology never be the default.

      Props to OpenSUSE!, good luck to their users, or more realistically, not bad luck.

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
    14. Re:Beta testers by torsmo · · Score: 1

      I use btrfs for /home, and I'm currently in a place (high mountains) where sudden power outages are not uncommon. Besides power loss, there's a problem with fluctuations in voltage as well (this place doesn't have a UPS or even a stabilizer). So on a few occasions, the btrfs partition has refused to mount after encountering the above scenario ("parent transid verify failed on ..."). But to be fair, that borked the root fs mounted on ext4 as well. I think I followed some instructions suggested on a stackoverflow thread, and was able to get full functionality back without any loss of data. I would say it has reasonably good fault tolerance. It is a bit slow compared to other more mature fs's, but still very satisfactory. Oh, and the kernel version is 3.12

    15. Re:Beta testers by PincushionMan · · Score: 1

      I'd leave you for my lawyer too, if you let BTRFS microwave me!

    16. Re:Beta testers by Anonymous Coward · · Score: 1

      "autodefrag" seems to habe been in since 3.0:
      https://btrfs.wiki.kernel.org/index.php/Mount_options

    17. Re:Beta testers by speculatrix · · Score: 1

      pah, ext3 is too new fangled. ext2 was good enough for my grandpa, is good enough for me, and is good enough for my kids. on a serious note, when ext3 was still new, I used to format /boot as ext2 and not ext3 so that all the various rescue disks would be able to fix it.

    18. Re:Beta testers by speculatrix · · Score: 1

      I've used opensuse for many years, I guess because when I wanted to adopt the linux desktop, a colleague used it so I did too.

      I usually lag behind new releases by months, unless I'm setting up a new computer and so I don't have anything to lose

      our experience at work of BTRFS having poor and inconsistent performance have put me off ever using it personally except as experimental. OTOH, we found ZFS to be very good.

    19. Re:Beta testers by g1zmo · · Score: 1

      FWIW, Netgear's ReadyNAS lines have been using btrfs for about a year now.

      --
      I have found there are just two ways to go.
      It all comes down to livin' fast or dyin' slow.
      -REK, Jr.
  2. But then again, they were also big ReiserFS fans. by fustakrakich · · Score: 3, Funny

    I don't get it. Is Chris Mason about to murder his wife/girlfriend?

    --
    “He’s not deformed, he’s just drunk!”
  3. If you live on the bleeding edge by Anonymous Coward · · Score: 1

    Be prepared to bleed.

    1. Re:If you live on the bleeding edge by rubycodez · · Score: 1

      Hans, is that you?

  4. An inspiring decision by MoonlessNights · · Score: 2

    It surprising but nice to see someone stepping outside of the "just do what we have done before" box but I suppose there is precedent for SUSE (given the mention of ReiserFS).

    Personally, I have been using BTRFS on a few of my systems for a little over a year and it is quite nice. Later versions have some really intriguing snapshot delta capabilities but my main win, with a slightly older version, is the big benefit of reduced disk I/O via transparent compression.

    The way that it manages storage pools looks good, as well, although I haven't tried playing with it yet (the systems using it have lopsided disk geometries so it wouldn't be appropriate).

    1. Re:An inspiring decision by Dcnjoe60 · · Score: 1

      How is the btrfs speed compared to ext4 in your experience? Most tests I see has it slower with the explanation that it actually does more than ext4. Many of us still have magnetic drives instead of SSDs so, speed could be an issue. On the otherhand, reduced disk I/O should be a speed improvement. So, how does it perform?

    2. Re:An inspiring decision by fnj · · Score: 1

      Red Hat can't get the stability and/or performance out of it - they are going with XFS.

      Quite possibly Red Hat intends to GA RHEL7 before November and it doesn't give them as much time for testing as OpenSuse has. Other than the simple fact that RHEL and Suse are enterprise, and OpenSuse is not.

      I sure as hell won't be using Btrfs for any data I care about in the foreseeable future (not through 2015 at least). I consider Zfs On Linux to be much more reliable and well-tested as well as far superior.

    3. Re:An inspiring decision by grumbel · · Score: 1

      Does XFS still shred your files on system crashes or power loss? FAQ claims they fixed that in 2.6.22, yet with 2.6.27 it was still shredding files like crazy for me. This was however years ago, has anything changed still then?

    4. Re:An inspiring decision by rubycodez · · Score: 1

      no

      but recently there was little bug where xfs_growfs would sometimes panic kernel (filesystem recoverable)

      it's been fixed

    5. Re:An inspiring decision by DuckDodgers · · Score: 1

      I can't speak to its reliability because I only used it a little bit. But in terms of features, from what I understand it the two killer features that slow btrfs down by make it so attractive (assuming it doesn't corrupt your files) are snapshots and live volume resizing. Those two things do what you might from the name - snapshots let you tag a certain point in time in the filesystem, and in the future you can revert your filesystem to look exactly as it did at that point in time. That is of course incredibly handy in the case of failed upgrades or accidental file deletions. Live volume resizing lets you grow and shrink partitions and I believe even add an additional storage device to an existing btrfs volume while the system is still mounted.

      I think the slowdown versus ext4 is measurable but not killer, 5-10%. I'm more concerned with the stability.

    6. Re:An inspiring decision by grumbel · · Score: 1

      "Shred" as in files getting cut to 0 bytes. With XFS there was a 50/50 chance that your desktop wouldn't boot after a powerloss as half the config files where suddenly empty.

    7. Re:An inspiring decision by MoonlessNights · · Score: 1

      Yes, the ability to add/remove storage devices is done on the live file system.

      I haven't played with it myself but I know that there was talk of using this for OS installation (beyond the more obvious live disk replacement possibility):
      -boot from live DVD
      -start installation is just "add new device to pool" (returns immediately), followed by "remove DVD device from pool"
      -the "remove" doesn't return until it has finished migrating (and possibly balancing, if you added several devices as the target)
      -once "remove" finishes, it ejects the DVD and tells you that installation has completed

      It is neat since it means that your installation is "complete" at the moment you tell it to "start". You can start using the system immediately without waiting for the installation to actually write anything and no reboot is required.

    8. Re:An inspiring decision by DuckDodgers · · Score: 1

      Very cool, thanks for letting me know about that.

  5. Too Slow by AaronW · · Score: 1

    I tried setting up btrfs about a year ago on one of my servers running imap (which is continually backed up). I gave up in disgust since btrfs was insanely slow just untarring all of the files (Cyrus Imap stores each email as a separate file). This was on a relatively fast Intel SSD drive. As more and more files were added, the speed continued to drop.

    The other problem I have is that I could not find an adequate answer with respect to free space. When files are deleted it sounds like they really aren't deleted. This being the case, what happens when the drive fills up?

    I have since gone back to using XFS and EXT4 for my files. I have never had any issues with XFS (even when some nasty RAID issues occurred) and have been running it for years and love the tools available for it (xfs_fsr, xfsdump, etc.).

    --
    This post is encrypted twice with ROT-13. Documenting or attempting to crack this encryption is illegal.
  6. Re:But then again, they were also big ReiserFS fan by RITjobbie · · Score: 2

    He _did_ used to work at Namesys for Hans. Joking aside, his wife is pretty cool. She teaches IT/networking at my alma mater, RIT. I've met a few other (now former) Namesys employees in the past, probably some of the brightest minds I've ever known.

  7. Re:tm abbrevs mk it hrd 2 rd. by Wolfrider · · Score: 2

    --A fairly accurate summation. I would only amend it thusly:

    EXT4 = most current open journaling filesystem in widespread use on Linux systems; Successor to ext3 and generally faster

    btrfs = journaling filesystem with more bells and whistles than ext4; Functionally designed to compete with (and mostly equivalent to) ZFS, and may have more features for home/average non-Enterprise users

    frontend to YaST = graphical utility to command line versions of various Linux setup/configuration tools

    --
    .
    == WolfriderV6 == I'm willing to admit that *I just might* be wrong... Are you??
  8. Have they fixed the need to manually rebalance? by csirac · · Score: 4, Informative

    I've been using btrfs on all my machines/laptops for more than 2 years now. I've never had corruption or lost data (btrfs has actually coped rather well with failing/dying disks in my experience), unlike ext4. COW, subvolumes and snapshots are nifty.

    But too many times I've had the dreaded "no space left of device" (despite 100GBs remaining) when you run out of metadata blocks. The fix is to run btrfs balance start /volume/path - I now have a weekly cron job on my non-SSD machines - but it's hugely inconvenient having your machine go down because you're expected to babysit the filesystem.

    Recent months of Docker usage has made me encounter this condition twice this year already.

    I'll continue using btrfs because I've experienced silent corruption with ext4 before which I believe btrfs would have protected me against, and I like snapshots and ability to test my firmware images cheaply with cp --reflink pristine.img test.img.

    1. Re:Have they fixed the need to manually rebalance? by broken_chaos · · Score: 1

      You can run into the same sort of error, if I understand correctly, from other filesystems running out of inodes. Typically the solution there is to know what kind of workload (roughly) you'll be doing with the filesystem, and set the inode-to-block ratio appropriately. I imagine btrfs should have something similar for metadata allocation?

    2. Re:Have they fixed the need to manually rebalance? by Swistak · · Score: 2

      This is actually a horrible flaw in my opinion. I've also installed btrfs on one of my laptop drives and it was a horrible mistake. If you run out of space it's possible in some edge cases that you won't be able to free your space!
      You'd expect `rm huge_file` to work, but no it won't. Some pages recomend echo "">huge_file but that not always help either if the reason the disk got full is metadata
      I honestly cannot understand how anyone can create filesystem that A) lies about free disk space B) Does not allow you to free up space when it's full.

    3. Re:Have they fixed the need to manually rebalance? by trynis · · Score: 1

      I've been using btrfs on all my machines/laptops for more than 2 years now. I've never had corruption or lost data

      How do you know?

      --
      This is not a sig.
    4. Re:Have they fixed the need to manually rebalance? by ssam · · Score: 1

      Because BTRFS actually checks for corruption unlike older file-systems.

    5. Re:Have they fixed the need to manually rebalance? by csirac · · Score: 1

      ZFS, and BTRFS are designed to cope with bitrot. Perhaps you believe the implementation renders the design ineffective, all I know is that ext4 doesn't even try.

    6. Re:Have they fixed the need to manually rebalance? by csirac · · Score: 1

      BTRFS is so mature already, I never lost my data with it

      Dude, nobody said BTRFS is mature. Did you read the part where I've had to manually rebalance several volumes on multiple occasions? I'm sorry that you interpreted this statement as a ringing endorsement of a mature filesystem - but it's not the case that users should have to do this kind of babysitting in a mature technology.

      I *have* had BTRFS fill my logs with checksum failures on a couple of dying disks, and I was able to recover everything intact (the bulk of this data had shasums thanks to some deduplication I had been doing months earlier).ext4 on the other hand (by its very design, unless you count recent kernels where metadata may be checksummed) happily allows the disk (or whatever) to take a shit all over your data without so much as the slightest hint that something might be wrong until you go to open a file years later and discover it's zero bytes long, truncated, or full of garbage.

      The data integrity features of the new file systems are nice only if you can assume them to be bug free.

      No shit. But if your idea of data integrity is to start with something that doesn't even try, there just isn't any hope of that is there?

  9. Re:tm abbrevs mk it hrd 2 rd. by WuphonsReach · · Score: 1

    Successor to ext3 and generally faster

    Create a (non-sparse) 1GB or larger file on ext3. Then time how long it takes to delete it. For large file handling, ext4's use of extents rather then allocating individual blocks is far superior to ext3. (It's not an edge case either these days, not with MKV & MP4 files measured in 100s of megabytes. Or disks measured in terabytes.)

    Plus you get the faster fsck times at boot. And a bunch of other useful features (shrink/growing the file system, faster handling of directories with lots of files inside, etc.)

    All in all, ext4 is pretty darned good for its purpose of storing files. And while I'm looking forward to BTRFS, it's just not ready yet, and ext4 serves me well enough.

    --
    Wolde you bothe eate your cake, and have your cake?
  10. Re:tm abbrevs mk it hrd 2 rd. by Barsteward · · Score: 2

    so you'd agree with his definition of KDE Frameworks and QT5?

    --
    "The hands that help are better far than lips that pray." - Robert Ingersoll (1833-1899)
  11. Make sense by ssam · · Score: 1

    I have been using BTRFS for a while now with no problems. Even been through a couple of unclean shut downs, and unplugging mounted drives.

    I suspect that some of people reporting corruption have bad hardware. If they run ext4 the corruption happens, but they never notice. When they switch to BTRFS it spots the corruption quickly because of checksumming, and makes noise about it. Not to say that BTRFS is bug free, but neither is any other file system.

  12. Re:tm abbrevs mk it hrd 2 rd. by Eunuchswear · · Score: 1

    [ext4 vs ext3] a bunch of other useful features (shrink/growing the file system, faster handling of directories with lots of files inside, etc.)

    Uh, ext3 has online grow (but not shrink). Does ext4 do online shrink?

    And ext3 hahes big directories for faster access too.

    Not that there are no advantages, but you seem to be claiming ones that don't exist.

    --
    Watch this Heartland Institute video
  13. Re:But then again, they were also big ReiserFS fan by tlhIngan · · Score: 1

    Why can't Reiser continue? Just because he is in prison?

    Yes, exactly because he's in prison, where they don't allow you your own personal computer hardware or general access to the internet.

    Shocking, I know. They'll be locking him in at night next!

    You don't need a PC to code. Seriously, you don't. If he's allowed visitors and they can leave him printed materials, that's all that's needed to code.

    Hell, he can sit and think through a lot of the flaws of the filesystem by doing it all mentally or on paper the passing criticism or design updates to his visitors.

    You don't have to start coding anything by having an idea, starting up an editor and beginning from int main(). You can start development by documenting the idea, the design, implementation and then work out if the design has flaws. And all of it can be done without a computer.

  14. Lost data recently by sl3xd · · Score: 1

    I've lost data recently with btrfs, in the past two weeks. Redundant metadata & data didn't help me. Neither did the snapshots.

    Thankfully, I had a backup of the data.

    So my review of btrfs: Not ready. Slow. May eat your data.

    --
    -- Sometimes you have to turn the lights off in order to see.
  15. Re:Standards? Standards anyone? by rafjaimes · · Score: 1

    But you do know openSUSE 13.2 is "pretty far away"? It won't be released until November 2014.

  16. Re:Standards? Standards anyone? by Lord+Apathy · · Score: 1

    There is a reason to sick to the ext3/4 filesystem as the standard filesystem. Because it is the standard. Almost every filesystem tool in the linux world expects to be working with ext3/ext4. Sure you have special versions for vanity filesystems such as reiser and this one, but most tools expect ext3/ext4. There is nothing wrong with running a specialized filesystem specialized applications such as databases but not as your main default system. And certainly not a damn beta filesystem.

    Not off topic but completely on topic. People are doing stupid things with a experimental filesystem and I'm call it what it is. Stupid.

    --

    Supporting World Peace Through Nuclear Pacification

  17. Re:Standards? Standards anyone? by DuckDodgers · · Score: 1

    The ZFS filesystem from Solaris Unix has some features that ext4 does not, especially filesystem snapshots. That gives you the ability to take a filesystem snapshot at a certain date, and if the system has a filesystem problem in the future that is not from a hardware failure, you can instantly revert your filesystem to the snapshot. Here's a common use case: you take a snapshot, then apply a software upgrade to your system. If the upgrade goes well, you snapshot again. If the upgrade fails, you revert to the original snapshot and the system acts as if the failed upgrade never happened.

    This is one of the reasons so many big companies use Solaris Unix. Unfortunately, the software license of ZFS prevents it from being incorporated into the Linux kernel by default. You have to download and install it separately.

    Adding that feature to ext4 without completely rewriting it is impossible. That's why btrfs was created, to give many of the good features of ZFS to Linux. The thing is, btrfs needs to be battle-tested before businesses will use it on mission critical servers. You have to start somewhere. Maybe OpenSUSE 13.2 is too soon, maybe it needs another few years as alpha software. But maybe all of the people on this forum complaining about file corruption ran into bugs that have already been patched.

  18. Re:Standards? Standards anyone? by Lord+Apathy · · Score: 1

    The ZFS filesystem from Solaris Unix has some features that ext4 does not, especially filesystem snapshots.

    I don't really conceder ZFS to be an experimental fliesystem. I would regard it as a mature and tested file system and I would not have the same issues with someone using it as a specialized file system like I mentioned. But at the same time I wouldn't regard it as a standard file system the same way ext3/ext4 is.

    The snapshot feature you mentioned, I admit, would be very handy, but you can achieve the same thing using logical volumes and ext4. Unlike ZFS logical volume management is a standard part of all linux distos. I've not used ZFS so I don't know how complex its snapshot feature is and how it would compare to LVM snapshot feature. Using LVM does add an extra layer of complexities in file system management but if you are using a 3rd party file system then the complexities that lvm adds shouldn't be a problem for someone capable of using ZFS.

    --

    Supporting World Peace Through Nuclear Pacification

  19. Re:Standards? Standards anyone? by DuckDodgers · · Score: 1

    I'm sorry if my post was a little confusing - I don't consider ZFS experimental either. I meant that ZFS is a commonly used Unix filesystem that has more features than ext4, and it can't be part of the Linux kernel. btrfs is an attempt to bring ZFS to Linux without violating any software licenses.

    I didn't know about LVM snapshots, thanks for informing me. I also didn't realize LVM supports adding and removing storage devices to the volume while the system is live. I considered snapshots and growth and shrinking of storage the two killer btrfs features, and now I see that one can get those from LVM + ext4.

    Okay, I find the argument for adapting btrfs as a primary filesystem weaker. I hope there's something I'm missing.