Slashdot Mirror


How To Move Your Linux Systems To ext4

LinucksGirl writes "Ext4 is the latest in a long line of Linux file systems, and it's likely to be as important and popular as its predecessors. As a Linux system administrator, you should be aware of the advantages, disadvantages, and basic steps for migrating to ext4. This article explains when to adopt ext4, how to adapt traditional file system maintenance tool usage to ext4, and how to get the most out of the file system."

48 of 304 comments (clear)

  1. Not for the casual user by halivar · · Score: 4, Informative

    ext4fs is designed to be used in systems requiring many terabytes of storage and vast directory trees. It is unlikely the common desktop (or even, for that matter, the common server) will see appreciable performance increase with it.

    1. Re:Not for the casual user by Anonymous Coward · · Score: 5, Funny

      Do you realize how much porn some people have?

    2. Re:Not for the casual user by Vellmont · · Score: 5, Informative


      It is unlikely the common desktop (or even, for that matter, the common server) will see appreciable performance increase with it.

      Disk sizes are going up. In a few years you'll see a terabyte on a single drive. I'd also say that features like undelete, and online de-frag are important to anyone.

      So while you may not see any real performance increases, that's really beside the point.

      --
      AccountKiller
    3. Re:Not for the casual user by Anonymous Coward · · Score: 5, Funny

      Instead of waiting a few years, go to your local computer store. They should have terabyte drives now.

    4. Re:Not for the casual user by A+nonymous+Coward · · Score: 4, Funny

      Disk sizes are going up. In a few years you'll see a terabyte on a single drive. Unlike those two 1000 GB (or is it 1024) drives I have on my desk now.
    5. Re:Not for the casual user by miscz · · Score: 3, Interesting

      I can't wait for faster fsck. It takes something like an hour on my 500GB ext3 partition. Terabytes of storage are not that far away.

    6. Re:Not for the casual user by Uncle+Focker · · Score: 4, Informative

      Disk sizes are going up. Since last year we've seen a terabyte on a single drive. Fix'd it for you.
    7. Re:Not for the casual user by XenoPhage · · Score: 5, Funny

      All you young kids want these days is a faster, more convenient fsck.. What about the old days where fscking was about the technique, not the speed or the size...

      --
      XenoPhage
      Technological Musings
    8. Re:Not for the casual user by stuporglue · · Score: 3, Interesting

      I have the following disks in my computer:

      1 TB
      500 GB
      300 GB

      When they decide to fsck at the same time, it can take 1/2 hour or longer to get to the login screen.

      --
      https://www.facebook.com/digitizeicm -- Show your support for the digitization of the Iron County Miner newspaper archiv
    9. Re:Not for the casual user by LWATCDR · · Score: 3, Insightful

      But EXT4 because really useful when you have many terabytes of disk storage. With just one or two EXT3 is probably good enough.
      Now when we have ten TB drives....
      Good grief people Yea just keep a few thousand TV shows on your desktop.

      --
      See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
    10. Re:Not for the casual user by EvilRyry · · Score: 5, Interesting

      This is why we have XFS. I fscked a 9TB partition is under 10 minutes. Hopefully they've done some improvements for ext4 in this area. A volume that takes days to fsck might as well just die completely.

    11. Re:Not for the casual user by techno-vampire · · Score: 5, Funny
      I can't wait for faster fsck.


      I can tell you're a slashdotter. When most people fsck they want it to last as long as possible.

      --
      Good, inexpensive web hosting
    12. Re:Not for the casual user by drinkypoo · · Score: 4, Funny

      What about the old days where fscking was about the technique, not the speed or the size...

      I'm just happy when it's done for me, and I don't have to handle it manually. When fscking fails at the beginning, it can ruin your whole day if you're not an expert.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    13. Re:Not for the casual user by Daimanta · · Score: 4, Funny

      I fscked a 9TB partition is under 10 minutes. That's what you get when you throw a harddrive in a bathtub with water.
      --
      Knowledge is power. Knowledge shared is power lost.
    14. Re:Not for the casual user by diegocgteleline.es · · Score: 4, Interesting

      Ext4 has a lot of performance improvements, like extents or delayed allocation. Desktop users will notice that ext4 is much faster

      That said, ext4 is unstable. It can easily eat your data. Just say NO to moving your filesystem to ext4 - for now.

    15. Re:Not for the casual user by CrazedWalrus · · Score: 4, Funny

      No kidding. Sometimes I'm just not into fscking either, but if you're failing at the beginning, you may want to call an expert.

      Usually my problem is that my fsck gets a "fsck-completed-normally", when the media is really only half fscked.

      But don't worry -- fscking takes practice. If you got a quality media, you can half-fsck it many times before the media fails completely.

      May I also suggest fscking aids? There are many tools on the market that can help when your fscking routinely fails doesn't complete. They're usually lightweight and easy to use, and can help to save your media from getting fscked elsewhere.

      As you said, when all else fails, sometimes you really do just need to handle it manually.

    16. Re:Not for the casual user by stanleypane · · Score: 4, Funny

      You obviously haven't been married ;)

    17. Re:Not for the casual user by SpaceLifeForm · · Score: 3, Funny
      That should be 'dick' sizes if you're going to be waving your hard drives around here.

      --
      You are being MICROattacked, from various angles, in a SOFT manner.
    18. Re:Not for the casual user by erlehmann · · Score: 5, Funny

      Good grief people Yea just keep a few thousand TV shows on your desktop.
      This could make for RIAA settlements in an order of magnitude of the GDP of a small country !
    19. Re:Not for the casual user by whmac33 · · Score: 3, Informative

      from
      man fsck
      "filesystems on different drives will be checked at the same time to utilize parallelism available in the hardware."

      If / is small it will be quicker. If / is a large partition then it hinders any parallelism.

                    The sixth field, (fs_passno), is used by the fsck(8) program to deter-
                    mine the order in which filesystem checks are done at reboot time. The
                    root filesystem should be specified with a fs_passno of 1, and other
                    filesystems should have a fs_passno of 2. Filesystems within a drive
                    will be checked sequentially, but filesystems on different drives will
                    be checked at the same time to utilize parallelism available in the
                    hardware. If the sixth field is not present or zero, a value of zero
                    is returned and fsck will assume that the filesystem does not need to
                    be checked.

    20. Re:Not for the casual user by Xabraxas · · Score: 3, Informative

      Ext4 has a lot of performance improvements, like extents or delayed allocation. Desktop users will notice that ext4 is much faster

      XFS has both extents and delayed allocation. I really don't know why we need Ext4. XFS has been a very solid fs for quite some time now, it's sad that more attention hasn't been payed to it from kernel hackers. The whole idea behind Ext4 seems to be more of a NIH syndrome than anything else. I could understand if it was radically different but it isn't.

      --
      Time makes more converts than reason
    21. Re:Not for the casual user by oddfox · · Score: 5, Insightful

      One of many reasons right here

      I messed around with Ext4 for a little while on my machine (Like a couple days, just toying with it and seeing how its performance compares to Ext3 and Reiser4) a while back, like maybe a little bit before it was merged as experimental in the mainstream kernel. It is fast, backwards-compatible and extremely featureful. XFS is not a bad filesystem, but it has some problems, in my eyes. Metadata-only journaling, aggressive caching that makes it a potentially dangerous choice if you don't have a UPS, very slow metadata and deletion operations.

      That's great that XFS has a lot of features Ext4 is bringing to the playing field, and has had them for a long time. To pretend, however, that the developers of Ext4 simply have a NIH syndrome is just silly and disregards the fact that there is a lot that Ext4 already provides that XFS doesn't, and even more that it will soon. You might not see what the big deal is, but really, I can assure you that it won't be very long before the new ideas Ext4 employs are in widespread use.

      Here's an interesting article that really caught my eye with this: "Storage snapshot: The financial firm has more than 14 Petabytes of active storage and plans to add "several more Pbytes" within the next 12 months."

      --
      "We invented personal computing." - Bill Gates
  2. Wikipedia entry by drgould · · Score: 5, Informative

    Link to Ext4 entry on Wikipedia for people who aren't familar with it (like me).

    1. Re:Wikipedia entry by miscz · · Score: 3, Funny

      Because nobody on Slashdot knows that primary filesystem used on Linux is called Ext3 and we're too stupid to figure out what Ext4 might be. Come on.

    2. Re:Wikipedia entry by discord5 · · Score: 3, Funny

      Because nobody on Slashdot knows that primary filesystem used on Linux is called Ext3

      Now now, don't give us too much credit

      we're too stupid to figure out what Ext4 might be

      It's like ext2 times two, stupid.

    3. Re:Wikipedia entry by Anonymous Coward · · Score: 5, Funny

      My Linux box goes to ext11.

  3. Preempting the prefix war by A+beautiful+mind · · Score: 3, Insightful

    Yes, Terabyte is not entirely correct according to SI, but Tebibyte just sounds lame and language is a tool, to facilitate written and oral communication.

    Of course, in this case you have to balance the confusion stemming from the Tera in IT context meaning 1024 in some cases. To be honest, people insisting on the new naming, they should have come up with a sensible sounding name and promoted that. You have to remember that language, even technical language is for the people. There are lots of ways to craft a beautiful, logical, symmetrical language that no sane person would use because it just doesn't sound convenient.

    Maybe a linguist can pitch in to explain why tebibyte sounds so awful?

    --
    It takes a man to suffer ignorance and smile
    Be yourself no matter what they say
    1. Re:Preempting the prefix war by Dachannien · · Score: 4, Funny

      Maybe a linguist can pitch in to explain why tebibyte sounds so awful? Tebibyte-buh: It's bad-buh because-buh it makes-buh you sound-buh like Mushmouth-buh.

      Hey hey hey!

  4. To all ext3 users... by c0l0 · · Score: 5, Informative

    ...who are on the lookout for a new fs to entrust with keeping their precious data: make sure to check out btrfs ( http://oss.oracle.com/projects/btrfs/ ). It's a really neatly spec'd filesystem (with all the zfsish stuff like data checksumming and so on), developed by Oracle employees under GPLv2, which will feature a converter application for ext3's on-disk-format - so you can migrate from ext3 to the much more feature-packed and modern btrfs without having to mkfs anew.

    On a related sidenode: I'm very happy with SGI's xfs right now. ext\d isn't the only player in the field, so please, go out and boldly evaluate available alternatives. You won't be disappointed, I promise.

    --
    :%s/Open Source/Free Software/g

    YTARY!
    1. Re:To all ext3 users... by Anonymous Coward · · Score: 3, Interesting

      I'm an XFS fan as well. I have been using it for years. I usually have my root/boot partition as ext3 (so grub works) and all data on XFS.

      XFS kills ext in terms of not losing data. I have recovered lots of data from failed drives that were XFS formatted. Not so with ext3 which tends to flake out and destroy itself when it gets bad data.

      And don't even mention ReiserFS, that has always sucked. I have lost more data to Reiser than any other filesystem (ext is a close second though). Sometimes it would corrupt files just from rebooting the machine. I have never lost data on an XFS partition that wasn't due to hardware failure.

    2. Re:To all ext3 users... by Jherek+Carnelian · · Score: 4, Interesting

      btrfs -- How fast are deletes?

      ext3 is both so slow and so bottlenecked that mythtv had to implement a special "slow delete" mode which gradually truncates files instead of just unlinking them. Without the "slow deletes" mode, you get hiccups in any shows that are being recorded while old shows are deleted.

      On my system, deleting a 20GB file can take a minute on ext3 (and the filesystem is completely locked - all other processes are blocked), but on ntfs it is almost instantaneous.

    3. Re:To all ext3 users... by glwtta · · Score: 3, Insightful

      On a related sidenode: I'm very happy with SGI's xfs right now.

      I seem to be plugging XFS in every fs thread recently, so I'll second that - I'm really surprised it's not more popular.

      ext3 may have, more or less, caught up to XFS in IO speed recently, but file operations on large filesystems are still a disaster - just try deleting a 2TB tree with a couple million files in ext3, I dare you.

      --
      sic transit gloria mundi
  5. Re:But does it run... by 2muchcoffeeman · · Score: 4, Funny

    Reiser4 will absolutely kill ext4.[/badtastedaemon]

    --
    Prevent Windows piracy. Use Linux instead.
  6. undelete by Nimey · · Score: 4, Informative

    Oh, please. ext2 had "undelete" capability, just as it had filesystem compression capability. Neither were ever implemented.

    --
    Hail Eris, full of mischief...

    E pluribus sanguinem
  7. Re:But does it run... by Sentry21 · · Score: 5, Funny

    From what I've read, Reiser4 completely kills Ext4 in performance... then it disposes of ext4's kernel module, removes one of its redundant drives, and then cleans the free space left on its array.

  8. Indulging the prefix war by JustinOpinion · · Score: 4, Insightful

    Of course, in this case you have to balance the confusion stemming from the Tera in IT context meaning 1024 in some cases. It's worse than that. According to SI prefixes, "Tera" should mean 10^12 (1,000,000,000,000), but in common usage applied to computers it sometimes means 2^40 (1,099,511,627,776). But it also sometimes means "1024 Giga", where the Giga could be using either convention (and, for all you know, the "Mega" implied within could have been computed using either convention). So you can get a gradient of "mixed numbers" that conform to neither standard. You might say that only a non-professional would make such a stupid mistake... but on the other hand, if you see a column of numbers listed in "Gigabytes" and you want to convert them to Terabytes, what conversion factor would you use? How would you know what conversion factor the previous author had used? How could you guarantee that you were doing it right? Would you be able to confidently convert it into an exact number of bytes?

    Personally, I think the whole thing is a mess, and computer professionals should be working harder to enforce a consistent scheme. Unfortunately, only a minority of computer professionals seem interested in changing the status quo confusion.

    Maybe a linguist can pitch in to explain why tebibyte sounds so awful? I'm no linguist, but I don't think "Tebibyte" sounding silly is the real problem. I admit that I laughed when I first heard the binary prefixes. They sound lame. But who cares? "Quark" was silly when it was first coined. So was "Yahoo" and "Google" and "Linux" and "WYSIWYG" and "SCSI" and "Drupal" and so on... Silly names become second-nature once they are used enough.

    I think the real problem is that people, inherently, are loathe to change. They are more apt to come up with rationalizations and justifications for doing things "the old way" rather than put in the work to learn (and code!) a new system. Sorry if this sounds harsh, but I find the people who say the binary prefixes "sound dumb" or say that "the current (inconsistent)* system works fine" are just coming up with excuses to avoid doing the work to use a properly consistent standard/notation.

    Maybe you're right, and that if the new prefixes had sounded "cooler", then adoption would have been faster... but I'm not so sure. Even if true, it doesn't absolve any of us for allowing the confusion to persist: cool or not, we (geeks especially!) should have the discipline to use proper standards.

    * The current system can be roughly described as: SI prefixes are powers of 10 everywhere except in computer science, when they become powers of 2. But only when referring to memory, and some data structure sizes, but not when referring to transmission rates or disk space (unless it's a flash drive, sometimes), and other kinds of data structures.
  9. Re:Wait, what? by Waffle+Iron · · Score: 4, Informative
    They're probably using a 64-bit number to hold the timestamp. That gives you 1.8e19 discreet time intervals, so you're going to get ridiculous precision, dates ridiculously far into the future, or both. I assume that they went for precision because that arguably has more potential for use in the real world than worrying about files thousands of years into the future.

    IIRC, today's PCs have high-resolution timers available that surpass the old 14.318MHz clock chip. If you can't get accurate nanoseconds out of the timers yet, they'll just round the numbers off. No big deal.

    BTW, NTFS uses 100ns timestamp granularity, and it was designed when systems were almost 100X slower than today. So it had a similar amount of overkill, but that certainly doesn't seem to have had any negative impact on the acceptance of NTFS.

  10. Re:But does it undelete... by mlwmohawk · · Score: 3, Informative

    The whole "undelete" thing is a DOS FAT stupidity. The *only* reason why people think that you *can* undelete is that the DOS FAT file system was designed in such a way that file changes could be recovered *IF* you managed not to change the file system too much. DOS being a mainly single tasker, with the exception of the standard "indos" flag games.

    POSIX was not and should not be designed in such a way that "undelete" is reliably possible. That's like saying can I unlight that match. Can I unbreak that egg?

    An unreliable system that may, on the odd chance that the file structure has not changed too much, recover files from a disk that have not been over-written yet is no replacement for NOT being an idiot and being careful when you delete something.

  11. Re:But does it run... by electricbern · · Score: 5, Funny

    But it is too verbose, and that ends up being a problem.

    --
    alias possession='chmod 666 satan && ls /dev > il && tail daemon.log'
  12. Why bother? by jabuzz · · Score: 3, Informative

    ext4 is the biggest waste of time and effort in Linux. There are already good extent based filesystems for Linux. Why anyone would consider using what is an experimental filesystem for a multi TB production filesystem is beyond me.

    What ever they do XFS and JFS will have way more testing and use than ext4 will ever have. I just don't get the point of ext4. It would be far more useful to fix the one remaining issue with XFS, the inability to shrink the filesystem none destructively, than to flog the dead horse which is ext2/3 even more with ext4, which is not one disk compatible anyway.

    1. Re:Why bother? by skulgnome · · Score: 3, Insightful

      It has value as an experiment, even if it ultimately doesn't turn into much. These people have ideas, and they want to implement them. They aren't maintenance programmers and should not be shoehorned into that task even at the level of J. Random Person On Slashdot's thought.

      Remember how reiserfs was the first filesystem to have journaling in Linux, and how some people were ready to state that there is no need to do an ext3 any more?

  13. Re:But does it undelete... by Anonymous Coward · · Score: 3, Funny

    Perhaps you should try prm (pansy rm) or psh (pansy shell).

  14. Comment removed by account_deleted · · Score: 4, Funny

    Comment removed based on user account deletion

  15. What about comparison to other filesystems? by Khopesh · · Score: 4, Informative

    Those features may be new to ext3, but not to the real competitors. I see nothing that might grant an edge over JFS or XFS. The real justifications will come from performance tests.

    This reminds me of the recent NTFS article here, which actually suggested that since Hans Reiser is in jail and reiser4 is dead, we should consider NTFS. WTF? The ludicrousness of using NTFS as the primary filesystem is further justified in this article by its similar performance to ZFS, but both run in user-space (and are thus horrible in performance), so neither is really an option. What the heck is wrong with JFS and XFS?

    Here are some real comparisons: First, Wikipedia's Comparison of file systems gets you started with a nice mapping of features. Second, a benchmarking of filesystems from 2006 which is still quite applicable (though it doesn't yet cover ext4). What we need is a comparison of EXT4 to XFS and JFS (et al), with EXT2/3 in there for reference.

    Recall that the biggest reason for using ext3 is that it is supported best of all the filesystems. If all hell breaks loose, even Tomsrtbt (an ancient rescue floppy pre-dating knoppix) can fix it. Ext4 breaks this backwards-compatibility to ext2. Therefore, I see no reason to use it. One might as well use something more stable and proven, especially while we lack numbers suggesting it performs as well or better.

    --
    Use my userscript to add story images to Slashdot. There's no going back.
    1. Re:What about comparison to other filesystems? by Sentry21 · · Score: 3, Informative

      If your recovery procedures involve using pre-knoppix floppy recovery tools, you shouldn't be administering any systems with important data on them.

      Aside from the fact that no non-obsolete machine I've seen in the last few years has a disk drive, 'backwards compatibility with ext2' is a pretty lousy minimum requirement for a filesystem.

      Heck, I can do recovery on Ext2/3, ReiserFS, JFS, XFS, and more using only a few-dozen-meg Debian netinstall image. I don't even want to know what an Ubuntu or Knoppix LiveCD could recover from.

  16. Re:But does it run... by CatOne · · Score: 3, Funny

    How would you know? It's as if the old Ext4 system just... vanished.

    Even if you found a platter under the front seat.

  17. Re:But does it run... by erlehmann · · Score: 5, Funny

    You apparently didn't get the whole picture. It's not about single files - Reiser4 is just a better choice for partitioning your wife.

  18. Re:But does it undelete... by Blakey+Rat · · Score: 3, Insightful

    Please.

    The greatest feature of modern software is "Undo." Everything I can screw up on the computer should have an Undo-- that's what the Recycle Bin (or Trash Can for Mac users) is there for, although it's a bit more awkward than pressing control-Z.

    Call it stupidity if you want, but my system files (you know, the ones that file permissions actually protect from malware) are worth approximately zero, and my personal files (the ones that malware can delete no question asked) are worth hundreds of man-hours, if not thousands, and ten times that in dollar value.

    Windows Shadow Copy has an exact template on how to implement it, now go implement it.

    (And yes, I keep backups, as should everybody. But there's no excuse not to use spare disk space as another layer of defense.)