Slashdot Mirror

← Back to Stories (view on slashdot.org)

What's the Damage? Measuring fsck Under XFS and Ext4 On Big Storage

Posted by timothy on from the disks-groaning-with-shame dept.

An anonymous reader writes "Enterprise Storage Forum's long-awaited Linux file system Fsck testing is finally complete. Find out just how bad the Linux file system scaling problem really is."

9 of 196 comments (clear)

  1. fsck speed, want safety by Anonymous Coward · · Score: 3, Insightful

    How fast a full fsck scan is is my last concern. What about how successful they are at recovering the filesystem?

    1. Re:fsck speed, want safety by h4rr4r · · Score: 5, Insightful

      If you need to fsck you should already be restoring from backups onto another machine.

    2. Re:fsck speed, want safety by rickb928 · · Score: 4, Insightful

      More helpful advice from the Linux community. Thank you ever so much, once again right on point, timely, and effective.

      --
      deleting the extra space after periods so i can stay relevant, yeah.
    3. Re:fsck speed, want safety by chuckymonkey · · Score: 5, Insightful

      You're fairly wrong there, you can actually back that much data up. You just have to be willing to pay for some seriously large tape libraries and they're not cheap. We're in the process of installing a 700TB array with a 1.5PB tape library backup. You just have to do the backups using filesystem snapshots and run them pretty much constantly.

      --
      "Some books contain the machinery required to create and sustain universes."-Tycho
    4. Re:fsck speed, want safety by phorm · · Score: 3, Insightful

      If you're in a scenario where "Backups are not really an option", somebody is doing something wrong...

      How long did it take you to get to 0.5PB? If you use a differential backup/sync, then you should generally only need to copy *NEW* data, and the old stuff will already be there.

    5. Re:fsck speed, want safety by h4rr4r · · Score: 3, Insightful

      Most people are worried more about cost then reliability.

      Most people is often a category that does not do things the best way or the right way.

    6. Re:fsck speed, want safety by chuckymonkey · · Score: 3, Insightful

      I know I'm posting to an AC here, but I want to point something out. "Backups simply are not really an option past 20+ terabytes of storage, and simply not feasible if the storage is volatile in nature." He was claiming that it's not feasible to back up more than 20+ TB of storage when in fact it is. I was pointing out that yes you can, but it's pretty expensive.

      --
      "Some books contain the machinery required to create and sustain universes."-Tycho
  2. Who would engineer a storage system like that? by Anonymous Coward · · Score: 2, Insightful

    A single file system that big without checking features that file systems like ZFS or clustering file stores provide seems insane to me.

  3. Re:linux is fail by gweihir · · Score: 4, Insightful

    A cranky coward from the shadows is not s reliable source of information.

    I have used AIX and Solaris, and I can say that a lot of stuff is easier on Linux.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.