Slashdot Mirror


Apple Discontinues ZFS Project

Zaurus writes "Apple has replaced its ZFS project page with a notice that 'The ZFS project has been discontinued. The mailing list and repository will also be removed shortly.' Apple originally touted ZFS as a feature that would be available in Snow Leopard Server. A few months before release, all mention of ZFS was removed from the Apple web site and literature, and ZFS was notably absent from Snow Leopard Server at launch. Despite repeated attempts to get clarification about their plans from ZFS, Apple has not made any official statement regarding the matter. A zfs-macos Google group has been set up for members of Apple's zfs-discuss mailing list to migrate to, as many people had started using the unfinished ZFS port already. The call is out for developers who can continue the forked project." Daring Fireball suggests that Apple's decision could have been motivated by NetApp's patent lawsuit over ZFS.

329 comments

  1. Great by tjones · · Score: 5, Funny

    Now if you're using zfs on Mac OS, you can't complain if it loses your data. You already knew it was forked.

  2. God forbid... by Anonymous Coward · · Score: 0, Informative

    God forbid the summary tell us what ZFS is

    1. Re:God forbid... by mister_playboy · · Score: 5, Funny

      Please hand in your geek card as you leave.

      http://en.wikipedia.org/wiki/ZFS

      --
      Do what thou wilt shall be the whole of the Law ::: Love is the law, love under will
    2. Re:God forbid... by Anonymous Coward · · Score: 5, Funny

      My sense of entitlement demands that everyone hand everything to me on a silver platter as well! I shouldn't be required to click on a link, much less do a Google search. You and I are in agreement. BTW, you owe me for that.

    3. Re:God forbid... by zach_the_lizard · · Score: 3, Informative

      God forbid the summary tell us what ZFS is

      It is a filesystem, available in (Open)Solaris and at least FreeBSD, possibly other BSDs as well. It has some interesting features, which you can check out here. I have heard it claimed that ZFS has good performance, but I have not evaluated any of those claims.

      --
      SSC
    4. Re:God forbid... by NoYob · · Score: 5, Funny
      Holy shit!

      All this time, I thought folks were talking about file management with a phony French accent!

      Save zee file to zee FS and you will see that zee bytes go ...

      --
      It's NOT me! It's the meds! I'm on 1000mg of Fukitol.
    5. Re:God forbid... by causality · · Score: 1

      God forbid the summary tell us what ZFS is

      It is a filesystem, available in (Open)Solaris and at least FreeBSD, possibly other BSDs as well. It has some interesting features, which you can check out here. I have heard it claimed that ZFS has good performance, but I have not evaluated any of those claims.

      It's a complete and total coincidence, but I just remembered a humorous Web site.

      --
      It is a miracle that curiosity survives formal education. - Einstein
    6. Re:God forbid... by Anonymous Coward · · Score: 0

      All this time, I thought folks were talking about file management with a phony French accent!

      Well, that explains your UID.

    7. Re:God forbid... by Anonymous Coward · · Score: 0, Redundant

      Yeah that site is pretty good. Not as good as this one, though.

    8. Re:God forbid... by dangitman · · Score: 3, Funny

      I thought it referred to "Zaphod, For Sure!" which is Zaphod Beeblebrox's Re-election slogan.

      --
      ... and then they built the supercollider.
    9. Re:God forbid... by Anonymous Coward · · Score: 0

      Holy shit!

      All this time, I thought folks were talking about file management with a phony French accent!

      Save zee file to zee FS and you will see that zee bytes go ...

      Brilliant! You have a fan in me :)

    10. Re:God forbid... by Provocateur · · Score: 1

      ...before ze Germans get here...

      --
      WARNING: Smartphones have side effects--most of them undocumented.
    11. Re:God forbid... by ozmanjusri · · Score: 2, Informative
      You have a fan in me

      That must sting a bit.

      --
      "I've got more toys than Teruhisa Kitahara."
    12. Re:God forbid... by Per+Wigren · · Score: 1

      No, zee FS in not zee FS, but zed FS is. Parse that, monsieur!

      --
      My other account has a 3-digit UID.
  3. The straight dope by Anonymous Coward · · Score: 5, Interesting

    Posting anon, lest someone guess who my sources are.

    The long and short of it was, Apple and Sun couldn't come to terms on the licensing. Sun wanted a lot of money for giving it to Apple under different terms and the amount they wanted was in the range of "hell, we could do it ourselves for that".

    Add to that, the Oracle buyout and Sun going into management paralysis, and Apple decided to go it alone.

    Apple's CoreOS team includes several of the lead engineers from the ZFS project (who fled the remnants of Sun in the Schwartz melt-down), and the architect of the BeFS. I'm expecting Apple to do their own next-generation file system, probably in the 10.7 timeframe.

    1. Re:The straight dope by Lemming+Mark · · Score: 1

      Posting anon, lest someone guess who my sources are.

      The long and short of it was, Apple and Sun couldn't come to terms on the licensing. Sun wanted a lot of money for giving it to Apple under different terms and the amount they wanted was in the range of "hell, we could do it ourselves for that".

      That sounds odd to me. Why would they need different licensing terms? Especially as they apparently had a port that was already somewhat distributed, at least in developer builds - presumably they thought that the license allowed them to do that at the time?

    2. Re:The straight dope by Culture20 · · Score: 5, Insightful

      Why would they need different licensing terms?

      They probably wanted to rename it without changing it. Apple likes renaming things. Microsoft OTOH, loves using the same name as everyone else, and changing stuff to break interop.

    3. Re:The straight dope by adolf · · Score: 1, Insightful

      Dear AC,

      Why should we place any higher value on your particular commentary, than all of the other rampant speculation which will be posted below by additional ACs?

      Best regards.

    4. Re:The straight dope by segedunum · · Score: 4, Interesting

      The long and short of it was, Apple and Sun couldn't come to terms on the licensing. Sun wanted a lot of money...

      That doesn't make any sense. I fail to see why Apple should agree licensing terms for a CDDL licensed open source project or how Sun could demand money for the privilege. Sun were positively overflowing with love towards Apple (as they usually are) when they heard that anyone would actually be interested in their uber new filesystem.

    5. Re:The straight dope by larry+bagina · · Score: 1

      I don't know why they'd have a problem with the CDDL... they have support for dtrace, which is also CDDL. The CDDL only applies to the contents of the original files, and zfs is down in the darwin level where most everything is already open source. Maybe they wanted more explicit patent protection/indemnification given that they're becoming a patent troll magnet.

      --
      Do you even lift?

      These aren't the 'roids you're looking for.

    6. Re:The straight dope by Anonymous Coward · · Score: 0

      Why should we place any higher value on your particular commentary, than all of the other rampant speculation which will be posted below by additional ACs?

      Believe it or don't. No skin off my nose either way.

    7. Re:The straight dope by Lemming+Mark · · Score: 1

      Haha, that did make me laugh :-) You compressed quite a lot of truth into a very small amount of text. There is a certain elegant symmetry to the two companies when you put it like that.

    8. Re:The straight dope by BrentH · · Score: 3, Informative

      "The flip side is that I've heard that Apple's file systems team is full steam ahead on their own next-generation file system. And, perhaps not coincidentally, they're hiring." from http://daringfireball.net/linked/2009/10/23/zfs

      This is pretty shitty because it'll fragment the momentum ZFS had in being the next-gen ubiquitous file system. When it was clear ZFS wasn't coming to Linux, those guys got btrfs going, now Apple is doing their own, while ZFS obviously will stay around too. Microsoft obviously wasnt on board for any of this, and without the momentum behind ZFS it never will. This nonsense isnt helping, and I think the best Oracle could do it release it under all the licenses that'll get it into OSX/Linux and perhaps even Windows. Can Oracle go over Sun's head on this or Sun==Oracle?

    9. Re:The straight dope by saleenS281 · · Score: 3, Insightful

      Why would Apple need different terms? CDDL and BSD are compatible, hence FreeBSD integrating ZFS. Furthermore, Apple already integrated DTRACE under the CDDL. Claiming a licensing issue doesn't make sense... at all. The only thing that does make sense is that Apple was trying to add a bunch of proprietary code to ZFS and didn't want to release their changes. Boo hoo.

    10. Re:The straight dope by dangitman · · Score: 4, Insightful

      Microsoft obviously wasnt on board for any of this, and without the momentum behind ZFS it never will.

      Microsoft is never on board for anything useful, so I'm not sure it really makes any difference.

      --
      ... and then they built the supercollider.
    11. Re:The straight dope by Grishnakh · · Score: 1, Insightful

      How did Microsoft get into this? If MS ever adopted ZFS, they'd change a bunch of things just to make it intentionally incompatible.

      What's going to happen is the status quo will remain unchanged: every major vendor will use a different standard filesystem, and only Linux users will be able to read them all (though there may be a little time before they've fully developed the drivers to do so). After all Linux users can already use btrfs natively, and ZFS using FUSE. Anything new that Apple makes will likely be open-source since it'll be at the Darwin level so Linux can use that too (though perhaps only through FUSE because of licensing again), and anything MS makes will of course be reverse-engineered so it'll take the longest to support.

    12. Re:The straight dope by Robotbeat · · Score: 5, Interesting

      "The flip side is that I've heard that Apple's file systems team is full steam ahead on their own next-generation file system. And, perhaps not coincidentally, they're hiring." from http://daringfireball.net/linked/2009/10/23/zfs

      This is pretty shitty because it'll fragment the momentum ZFS had in being the next-gen ubiquitous file system. When it was clear ZFS wasn't coming to Linux, those guys got btrfs going, now Apple is doing their own, while ZFS obviously will stay around too. Microsoft obviously wasnt on board for any of this, and without the momentum behind ZFS it never will. This nonsense isnt helping, and I think the best Oracle could do it release it under all the licenses that'll get it into OSX/Linux and perhaps even Windows. Can Oracle go over Sun's head on this or Sun==Oracle?

      (emphasis mine)

      Unfortunately, btrfs isn't "going" anywhere. Guess who their development was funded by? That's right, Oracle! Notice that they haven't released anything new since BEFORE Sun's shareholders approved the acquisition? (Latest release on the btrfs wiki is v .19, released in June 2009) It's not exactly improving at a breakneck pace... If btrfs is going to go anywhere, they need some real development money.

      Dang Oracle.

    13. Re:The straight dope by Anonymous Coward · · Score: 0

          Yes,"I'm Posting anon, lest someone guess who my sources are" too. Wow I can do that.
            What monies ? Apple hired a developer to port zfs, see the archived zfs mailing list to see this.
            DTrace is on OS-X, exact same license as ZFS.

          Yes, Mr (or Ms) Anon, you're talking bull.

    14. Re:The straight dope by jcr · · Score: 1

      This is pretty shitty because it'll fragment the momentum ZFS had in being the next-gen ubiquitous file system.

      The momentum that has had all their best developers jumping ship since Schwartz got the CEO gig?

      Oracle bought Sun for Java. I see no indication that Oracle cares about ZFS or any of Sun's other technologies.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    15. Re:The straight dope by ThePhilips · · Score: 3, Interesting

      Probably because Apple hadn't felt like supporting an FS on its own?

      Mac OS X already includes pile of licensed technologies. The sole purpose of that is to offload work from R&D so that they can do something more useful than reinventing a wheel.

      Licensing deal likely would have been needed so that if Sun/whatever goes tits up, Apple would retain all rights to the code so that they can develop and maintain it further on their own - without being in mercy of whoever buys Sun after that.

      --
      All hope abandon ye who enter here.
    16. Re:The straight dope by ThePhilips · · Score: 1

      ... it'll fragment the momentum ZFS had ...

      After reading an opinion piece of one of the ZFS authors about Btrfs, I stopped thinking that ZFS deserves to have the momentum.

      Can't find the link, but ZFS (as first Sun's take on files system) has made several design mistakes which cannot be fixed without redesign. Developed later Btrfs learned on that and avoided the mistakes.

      IOW, ZFS might have had a very short momentum, but thanks to the licensing + general insanity of Sun management (which managed in past decade to lose all talented people) I'd say in long term it never had a chance to become ubiquitous to begin with.

      --
      All hope abandon ye who enter here.
    17. Re:The straight dope by toby · · Score: 1

      The reason they abandoned the ZFS effort was probably not licensing, imho.

      --
      you had me at #!
    18. Re:The straight dope by Anonymous Coward · · Score: 0

      The long and short of it was, Apple and Sun couldn't come to terms on the licensing. Sun wanted a lot of money for giving it to Apple under different terms and the amount they wanted was in the range of "hell, we could do it ourselves for that".

      Apple took DTrace with its CDDL license, why couldn't they just take ZFS?

      Apple's CoreOS team includes several of the lead engineers from the ZFS project (who fled the remnants of Sun in the Schwartz melt-down), and the architect of the BeFS. I'm expecting Apple to do their own next-generation file system, probably in the 10.7 timeframe.

      Apple has a lot of smart people, and Sun is known for their engineering (if not their marketing) so I'm sure they gained more, but part of me is kind of sad that they're re-inventing the wheel. While nothing is perfect, ZFS has some great features and functionality now, with more on the way (de-dupe, encryption, etc.). It's too bad that an agreement couldn't be reached.

      I'm hoping that as Apple integrates FreeBSD code like it has in the past, it will also take in the work done on ZFS. FreeBSD 7.x has ZFS in a "preview" fashion, and the upcoming 8.0 has it marked as "production ready".

    19. Re:The straight dope by rattaroaz · · Score: 1

      That still doesn't make any sense. If sun relicensed zfs or went bankrupt, the existing zfs under CDDL is still valid, and can be forked. Sort of like if sun relicensed mysql, the gpl version is still gpl.

    20. Re:The straight dope by Anonymous Coward · · Score: 0

      I thought MS just added 'active' or 'direct' as a prefix and 'X' as a suffix and just hawk the same old shit.

    21. Re:The straight dope by Anonymous Coward · · Score: 0

      Why would they need different licensing terms?

      Fiduciary duty to protect Apple patents would be my guess.

    22. Re:The straight dope by ThePhilips · · Score: 4, Interesting

      It doesn't make sense to you. But it does to every other business.

      Free, open source software != costs nothing. (*)

      Sun wanted Apple to share development and maintenance costs. Apple wanted some long-term guarantees that Sun wouldn't stop development and would also help Apple to solve problems of ZFS under Mac OS X.

      Similar deals happen all the time.

      It's just this time the companies couldn't agree on price and/or terms. Obviously acquisition by Oracle contributed to the volatility of situation.

      (*) File system as file system is a rather trivial thing with well defined interface. ZFS is not only a file system, but also volume manager and network service. And long list of management tools for all that. Those are big money involved in development, maintenance and support of all that stuff.

      --
      All hope abandon ye who enter here.
    23. Re:The straight dope by setagllib · · Score: 4, Informative

      You really need to subscribe to the mailing list. The rate of development is only growing -- it's just now moved on to a lot of smaller features and improvements, now that most of the work is already done.

      --
      Sam ty sig.
    24. Re:The straight dope by seanadams.com · · Score: 1, Insightful

      You have gravely underestimated the capacity for lawyers and bean counters to fuck up a great idea.

    25. Re:The straight dope by Anonymous Coward · · Score: 0

      That doesn't make any sense.

      That's the same thing Apple said, and that's why they're not going to continue with ZFS.

    26. Re:The straight dope by rattaroaz · · Score: 1

      I understand now. But I wonder whether your speculations are accurate. Not saying they are not, just that I wonder. When apple started implementing zfs, the sun folks were very clear that apple did so without so much as contacting sun ahead of time. It seems unusual for a company to implement something, then later decide to license it for support, rather than license first, then implement. Well, maybe not THAT unusual, as apple might have just realized they bit off more than they could chew. But that is just speculation on my part.

    27. Re:The straight dope by Sulphur · · Score: 1

      If they have source, then what would they reverse engineer?

      --

      We cannot solve our problems using the same thinking we used when we created them. Einstein

    28. Re:The straight dope by FiloEleven · · Score: 3, Insightful

      Apple's CoreOS team includes several of the lead engineers from the ZFS project (who fled the remnants of Sun in the Schwartz melt-down), and the architect of the BeFS.

      If this (potentially) verifiable information is accurate, that along with the claim of sources are two things missing from most if not all of the other AC speculation. The scenario is plausible and credible, so it is reasonable in the absence of contrary evidence to lend more weight to the AC above.

      How much more weight will of course vary amongst individuals, but it seems the mods have deemed it worthy. Wisdom of crowds and all that.

    29. Re:The straight dope by ishobo · · Score: 1

      Bzzt! Oracle bought Sun because Oracle wants to be a systems company.

      Ellison said, "We're keeping everything: tape, storage, x86, Sparc, he said. "I'm not sure if for (the same price) we could buy IBM, HP or Sun (that) we wouldn't pick Sun. Sun has fantastic technology, great microprocessor technology and leading tape archival storage."

      http://blog.internetnews.com/dneedle/2009/09/ellison-sun-losing-100-million.html

      --
      Slashdot - The great and glorious cluster fuck of Internet wisdom.
    30. Re:The straight dope by ishobo · · Score: 1

      BTRFS has design mistakes too, and some new filesystem will be invented that will avoid those mistakes. Repeat.

      but thanks to the licensing

      There is nothing wrong with the license.

      --
      Slashdot - The great and glorious cluster fuck of Internet wisdom.
    31. Re:The straight dope by ppanon · · Score: 1

      several of the lead engineers from the ZFS project who fled the remnants of Sun in the Schwartz melt-down

      Of course all heavy elements like lead developers are blown off during the supernova. Good thing too, because once Sun shrinks below the Schwarzchild radius, no developers will be able to escape.

      --
      Laissez lire, et laissez danser; ces deux amusements ne feront jamais de mal au monde. - Voltaire
    32. Re:The straight dope by SanityInAnarchy · · Score: 1

      Are they really? Or are they just getting paranoid?

      After all, while I do get the arguments for using h.264 for web content, Theora is easier to support everywhere, and Safari is the only browser I know of which supports HTML5 but not Theora. Why? Because they're paranoid about patent trolls.

      --
      Don't thank God, thank a doctor!
    33. Re:The straight dope by r7 · · Score: 0, Flamebait

      If MS ever adopted ZFS, they'd change a bunch of things just to make it intentionally incompatible.

      And the same would occur if ZFS ever went GPL i.e., RMS would fork it and introduce meaningless incompatibilities, as was done with make, pgp, sort, and numerous other utilities. It's the same reason Postifx, Apache, MPL, and ISC licenses were worded the way they are.

      So let Apple develop their own ZFS-alike. It's unlikely to be adopted outside of Apple, and unlikely to influence any other filesystem's developer or end-user momentum.

    34. Re:The straight dope by Anonymous Coward · · Score: 0

      Whereas Apple adds an X as a prefix.

    35. Re:The straight dope by jone1941 · · Score: 2, Insightful

      I'm sorry, perhaps I'm just a bit dense, but what is the benefit of a "ubiquitous file system" that is largely targeted for server infrastructures. Generally speaking I agree that parallel efforts to accomplish a similar / identical task can be deemed wasted efforts on some level. However, that trend is pretty much the standard for all open source projects? Linux vs BSD, WebKit vs Gecko, mysql vs postgres, php/perl/python/ruby the list goes on and on. There are a multitude of reasons projects (corporate backed or otherwise) choose to go their own way. In some cases I'm sure there are benefits to universalizing implementations of certain technologies (perhaps huge projects like gcc), but specifically server grade file systems? I just don't see what the big deal is. Yes ZFS has a large feature list, but clearly if there are patent concerns it's probably for the best that it didn't end up in the Linux kernel (or in OS X).

      When I hear that people are working btrfs I don't think "Oh no, this will only lead to server file system adoption fragmentation". Instead I think "that sounds like an interesting project for someone, I'll be sure to track it's progress and I look forward to seeing the benefit of it someday". When I heard that ZFS was not going to be merged into the linux kernel I wasn't particularly concerned. I'm sure that it provided useful features, but I'm also sure that there are a lot of intelligent people working on linux who could come up with something similarly useful if they felt it was worth while. Like I said, it's entirely possible that I'm missing the boat here, please feel free to correct me.

      --
      Fear trumps hope and ignorance trumps both
    36. Re:The straight dope by dgatwood · · Score: 1

      Even if BTRFS were technically perfect, it would still have one fatal flaw that ensures it will never get any serious adoption outside of Linux: its license. The GPL is to commercial adoption what a moat filled with alligators was to knights in the Middle Ages. If they were seriously trying to replace ZFS, they should have started with a license that is more palatable outside of the Linux community.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    37. Re:The straight dope by Anonymous Coward · · Score: 1, Informative

      That's EXACTLY right. Sun's management loved the idea. Sun's lawyers ruined it for everyone.

      Worse, ZFS was basically ready to ship. Unfortunately, the latest version available publicly is over a year old.

      Fortunately, any developer who got ANY developer seed with any newer version of ZFS (assuming newer versions were seeded) has a legal right under the CDDL license to send a letter to Apple and demand a copy of newer sources, and they cannot legally keep it under an NDA. I would encourage members of the Apple developer community to do so. It would probably save the newly created public fork's developers a lot of time.

      Sincerely,
      A friend of ZFS

    38. Re:The straight dope by QuoteMstr · · Score: 1

      Have you considered that the point is to drive Linux adoption? Yes, it can't be used outside the Linux community. That's the point.

    39. Re:The straight dope by dgatwood · · Score: 1

      The sorts of people who get excited about new filesystems are already Linux users, generally speaking. Therefore, using that to drive Linux adoption is an exercise in futility. :-)

      Also, a filesystem that cannot be used on multiple platforms is vendor lock-in, and whether it comes from Linux or Microsoft, it is just as wrong.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    40. Re:The straight dope by QuoteMstr · · Score: 1

      What are our options for truly cross-platform read-write filesystems these days? FAT32? Ext2? Filesystem lock-in is just the reality, unfortunately, and there's not much one can do to change it. But as long as there are cross-platform dump and restore tools, and as long as files themselves are portable, I really don't see much of a problem.

    41. Re:The straight dope by caseih · · Score: 2, Interesting

      Simply untrue. Oracle is still committed to BtrFS. In fact in one article I read, they quoted lead developers as saying that BtrFS fit Oracle's needs better than ZFS. This led to speculation that in the long term BtrFS would replace ZFS. Of course licensing issues would necessitate a clean-room implementation, likely. Probably what will really happen is that ZFS will remain with Solaris while BtrFS becomes the standard across the Linux world, and will obviously be heavily used by Oracle database users. The fact also is that BtrFS is a better design than ZFS. ZFS was revolutionary, no doubt about it. But BtrFS has more of a future and more potential due to its ingenious use of btrees in a way (I don't know the particulars) that was previously not thought to be possible, which is why ZFS did it differently. So while they are very similar file systems in effect and characteristics (COW, etc), under the hood they are very different and BtrFS seems to be technically superior, though lacking in features so far (no RAID-5 yet).

      Most Linux kernel developers consider Ext4 to be a stopgap until BtrFS is ready. And it is being developed fairly intensely still, the lack of release notwithstanding. Once it is ready, I expect and hope a windows driver will surface, allowing it to be a more universal file format.

    42. Re:The straight dope by Anonymous Coward · · Score: 0

      That particular piece of information is accurate, but it is well-known and not news (at least if you follow the Mac world).

    43. Re:The straight dope by Anonymous Coward · · Score: 0

      If you s/BtrFS/WinFS/g the Slashdot hive mind will scream vapourware (I know that BtrFS has actual code, but so is Duke Nukem Forever...).

    44. Re:The straight dope by EvilNTUser · · Score: 1

      Case in point: MSHTML breaks the standards, while many people whine about how others using WebKit* are leeching off Apple's innovation.

      *KHTML

      --
      My Sig: SEGV
    45. Re:The straight dope by MattBD · · Score: 1

      It's depressing that we so often wind up getting stuck with using the lowest common denominator filesystem if we want to share a hard drive partition or flash drive among formats. It's not so much of an issue with hard drives unless you're dual-booting, but with flash memory and portable devices such as iPods I think it's a big deal. Flash memory is a relatively recent invention (mid-90's I believe), but we're stuck using a filesystem that predates it and was never designed to work with it, and flash-based devices are hobbled by having to use a filesystem that's not designed for them. Take the iPod. You've got two choices - Windows formatting (basically FAT32), which is not designed for such a device, or HFS+, which isn't exactly the greatest choice for a filesystem for an iPod anyway, and isn't supported on Windows, and has only limited support in Linux. It's less of an issue with hard-drive based iPods, but I strongly suspect that with flash memory becoming more prominent in iPods then a decent cross-platform filesystem designed for flash memory is long overdue. Someone really needs to create one (call it something like Universal Flash File System), and release it under a liberal enough license that it can be included by default with all modern OS's -something like the BSD or MIT license.

    46. Re:The straight dope by jipn4 · · Score: 1

      Sun wanted Apple to share development and maintenance costs. Apple wanted some long-term guarantees that Sun wouldn't stop development and would also help Apple to solve problems of ZFS under Mac OS X.

      That doesn't make sense either. Apple has reasonably capable kernel engineers. Any "problems" that Apple would encounter with ZFS, their own engineers could solve themselves.

      Those are big money involved in development, maintenance and support of all that stuff.

      And that's probably the real reason: ZFS is a solution in search of a problem; most desktop users (and probably most server users as well) simply do not need anything as complicated as ZFS.

    47. Re:The straight dope by jipn4 · · Score: 1

      Of course licensing issues would necessitate a clean-room implementation, likely.

      Why can't Oracle just change the ZFS license? They will own the code.

      Once it is ready, I expect and hope a windows driver will surface, allowing it to be a more universal file format.

      Linux file systems have always been superior to Windows file systems, yet they have never been adopted on Windows. Why should that change now.

    48. Re:The straight dope by ThePhilips · · Score: 2, Interesting

      ZFS is a solution in search of a problem

      ZFS is more or less a direct competitor to Veritas (VxFS).

      If you know what later is, then you know where ZFS belongs.

      ZFS is so much hyped mainly for two reasons: (1st) Veritas is f***ing expensive and (2nd) all Solaris file system(s) before sucked terribly. (Think of Win7 type of hype: it is so much better than Vista!)

      --
      All hope abandon ye who enter here.
    49. Re:The straight dope by jipn4 · · Score: 1

      It's not just NIH, ZFS is simply a poor match to Apple's needs.

      (I'd argue it's a poor match to anybody's needs. Parts of it are useful, parts of it are a nuisance.)

    50. Re:The straight dope by Sparky+McGruff · · Score: 1

      Bzzt! Oracle bought Sun because Oracle wants to be a systems company.

      Ellison said, "We're keeping everything: tape, storage, x86, Sparc, he said. "I'm not sure if for (the same price) we could buy IBM, HP or Sun (that) we wouldn't pick Sun. Sun has fantastic technology, great microprocessor technology and leading tape archival storage."

      Well, that settles it. Larry Ellison would never fudge the truth.

    51. Re:The straight dope by Anonymous Coward · · Score: 0

      What? In which respect is ext3 better than NTFS? I don't really see that.

    52. Re:The straight dope by segedunum · · Score: 1

      Probably because Apple hadn't felt like supporting an FS on its own?

      Yer, and?

      Licensing deal likely would have been needed so that if Sun/whatever goes tits up, Apple would retain all rights to the code...

      ZFS is licensed under the CDDL and is probably clearer than most other pieces of software that could be used, and yes, it's clear that if Sun does go tits up it wouldn't affect existing CDDL licensed code. If Sun went then it wouldn't stop Apple's ability to maintain it in any way. There was no dialogue whatsoever to be had with Sun there.

    53. Re:The straight dope by segedunum · · Score: 1

      Sun wanted Apple to share development and maintenance costs. Apple wanted some long-term guarantees that Sun wouldn't stop development and would also help Apple to solve problems of ZFS under Mac OS X.

      That has nothing to do with licensing issues though that previous posts have implied. It's a support deal, if indeed that dialogue ever took place. Apple were still going to have to maintain a lot of ZFS expertise in-house and nothing was going to change that. They could never expect to just go to Sun and have them solve any issues they were having.

    54. Re:The straight dope by renoX · · Score: 1

      Your point doesn't make sense:
      >>Sun wanted Apple to share development and maintenance costs. Apple wanted some long-term guarantees that Sun wouldn't stop development and would also help Apple to solve problems of ZFS under Mac OS X.

      So instead of paying for a share of the development&maintenance of ZFS, now Apple has to spend the whole development and maintenance cost of their own solution..

      I smell more an ego clash or something, because from a money POV it can only be more expensive..

    55. Re:The straight dope by Sir_Lewk · · Score: 1

      RMS would fork it and introduce meaningless incompatibilities

      Last I checked RMS didn't do kernel work (outside of GNU HURD, and that does not count). He would have very little to do with implementing ZFS in linux.

      --
      "linux is just DOS with a UNIX like syntax" -- Galactic Dominator (944134)
    56. Re:The straight dope by Grishnakh · · Score: 1

      I was referring to anything MS might develop. MS doesn't do open-source. And even when they co-opt it (like they did with Kerberos), they add proprietary "extensions" that would have to be reverse-engineered.

    57. Re:The straight dope by zdzichu · · Score: 1

      Uhm, are you feeling OK? Btrfs is in Linux kernel, it is constantly being ,,released'' -- repositiories are wide open for everyone at http://git.kernel.org/?p=linux/kernel/git/mason/btrfs-unstable.git;a=summary . Look into the mailinglist, contributions are comming from many companies (Red Hat included). Sun aquisition have exactly zero effect on btrfs development.

      That said, as a ZFS fan, I'm dissapointed by Apple's move. Support in another high-profile operating system would be good for ZFS.

      --
      :wq
    58. Re:The straight dope by Anonymous Coward · · Score: 0

      Dear AC,

      Why should we place any higher value on your particular commentary, than all of the other rampant speculation which will be posted below by additional ACs?

      Best regards.

      What difference does it make what value you place on it? Whether it's true or not, you don't have any input into Apple's decisions anyway.

    59. Re:The straight dope by ishobo · · Score: 1

      I realize it is easier for you to believe the anonymous poeple that post here rather than the CEO of Oralce. Afterall, the people that post on Slashdot know more about the operations of Oracle than the person that actually runs Oracle.

      --
      Slashdot - The great and glorious cluster fuck of Internet wisdom.
    60. Re:The straight dope by caseih · · Score: 1

      I wasn't talking about bringing ZFS to linux. Oracle very well could bring ZFS to linux, which be nice for migrating away from Solaris to Linux and reading ZFS disks. I was referring to porting BtrFS to Solaris. Unless Oracle owns all the copyrights on the BtrFS code (given the contributors from the kernel community this is unlikely), it can't be placed into Solaris.

    61. Re:The straight dope by Anonymous Coward · · Score: 0

      vendor lock in with free software is as possible as jailing someone who owns all the jail's keys.

    62. Re:The straight dope by Anonymous Coward · · Score: 0

      The problem is, we've seen time and time again the extent that Apple fanboys/astroturfers will go to to suggest Apple is always void of any blame and posting anonymously with the claim of sources is well within the bounds of that.

      If it was some other company, then it may add a little weight, but Apple has so many followers that defy belief when defending Apple such that they'll just time and time again outright lie to protect their reputation then frankly, the claim of having sources adds absolutely nothing whatsoever in this case.

      But then, isn't that just the problem with fanboys, astroturfers and zealots? They lie about so many things it makes it impossible to tell when comments like this really are true, so the only real course of action is to take such a comment with a strong dose of scepticism effectively meaning their bs is entirely self defeating in that those who aren't fellow fanboys have to assume the worst, else face being taken in by outright lies like an idiot.

      That's not to say Apple is the only company that has fanbases guilty of this, it's not like Microsoft or Sony fanboys are much different in this respect. Anyway, the point is it doesn't matter what an AC says they have inside knowledge of, base your view on what they actually say and can provide verifiable evidence for, not what they claim to have evidence for but never actually provide.

    63. Re:The straight dope by Anonymous Coward · · Score: 0

      the people that post on Slashdot know more about the operations of Oracle than the person that actually runs Oracle.

      More like, the people on /. who post about oracle don't have hundreds of millions of dollars at stake on Oracle's stock price, so they don't have the same incentives to always portray the company in a positive light that the notorious skirt-chaser who runs the place does.

    64. Re:The straight dope by Anonymous Coward · · Score: 0

      Did I say a goddamned thing about blame?

      Do you have any information to contribute, or do you just like to hear yourself bitch? Do you know ANY FUCKING THING about the ZFS situation at Apple and their negotiations with sun? No, you FUCKING DON'T. A buyer and a seller didn't come to terms. Deals fall through every day. Doesn't mean either side is guilty of anything.

      But hey, don't let that stop you from just spewing your ignorance.

    65. Re:The straight dope by jcr · · Score: 1

      Sun's lawyers ruined it for everyone.

      Are you telling us that Sun's lawyers don't obey Sun's management?

      I've heard some bizarre things about Sun since Schwartz got the top job there, but that's really surprising.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    66. Re:The straight dope by jcr · · Score: 1

      ZFS was basically ready to ship

      Do you mean like "ready to use if bug fixes are forthcoming", or "ready to depend on even if it's an orphaned project"?

      I wish the guys who are continuing the public fork all the best. Not sure I'd consider ZFS on Mac OS X anything but a curiosity if it's not going to be supported by either Apple or Sun.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    67. Re:The straight dope by Anonymous Coward · · Score: 0

      Ah, so you are just a troll that made it all up after all.

    68. Re:The straight dope by Guy+Harris · · Score: 1

      Apple's CoreOS team includes several of the lead engineers from the ZFS project (who fled the remnants of Sun in the Schwartz melt-down), and the architect of the BeFS.

      If this (potentially) verifiable information is accurate,

      The bit about the architect of BeFS is verifiable if you believe his home page (I do).

    69. Re:The straight dope by Trillan · · Score: 1

      Blameless? I wouldn't say that.

      What I would say instead is there's no blame to be handed out on this. Apple decided not to integrate ZFS. That's their choice, isn't it? If you need ZFS, don't use Mac OS X.

  4. The Reason is Probably Technical by segedunum · · Score: 4, Interesting

    I doubt that it's a legal issue as the primary reason that this has happened, especially considering that the project seems to have stagnated steadily in successive versions of OS X. There just doesn't seem to have been the will within the OS X development group to make this work and to support and fully integrate ZFS into the inner workings of the OS. Given the pretty extensive functionality and plumbing of ZFS its probably been too much of a big ask to integrate a filesystem like that into a desktop. They might well have come to the conclusion that ZFS was simply complete overkill on a desktop and that it just wasn't possible.

    However, they still desperately need a next generation filesystem and according to the linked article they're hiring filesystem engineers. I don't see any evidence that this was anything other than a technical avenue that they've explored that has fallen by the wayside as so many have before.

    1. Re:The Reason is Probably Technical by jcr · · Score: 5, Interesting

      There just doesn't seem to have been the will within the OS X development group to make this work and to support and fully integrate ZFS into the inner workings of the OS.

      I can't agree with that. Spend ten minutes with the filesystem engineers at WWDC, and you wouldn't come away thinking there was any shortage of will to make ZFS fly on the Mac.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    2. Re:The Reason is Probably Technical by mysidia · · Score: 2, Insightful

      However, they still desperately need a next generation filesystem and according to the linked article they're hiring filesystem engineers.

      That doesn't make any sense.

      It only makes sense to engineer a new filesystem if the other options are inadequate or unusable.

      Engineering a new filesystem is hard and expensive.

      For them to seek to do that, they must have rejected the effort to integrate ZFS for some technical reason.

      The complexity of integrating ZFS pales into comparison to the massive cost of engineering and implementing a new filesystem from the ground up.

      Let-alone getting the new filesystem to a level of maturity where you can trust it with your data (safelty)

      I think the chance of Apple wanting to engineer a new FS so lightly are pretty slim.

      More likely, they would add new features to HFS+ or make an incremental update.

    3. Re:The Reason is Probably Technical by 4iedBandit · · Score: 1

      I doubt that it's a legal issue as the primary reason that this has happened...

      I've dealt with people in Sun who were close to ZFS and who were also excited to have it in Mac OS. It wasn't pulled because it wasn't technically ready.

      ZFS is the next generation file system that all others will have to live up to. I've never felt compelled by any file system. Use whatever is there or whatever my peers are comfortable with. ZFS is the first file system that's compelling enough to make me take a stand. I use it on servers daily at work, and I was looking forward to having it on my Macs at home. Bit rot is a very real problem. ZFS handles it automagically. And if you think your mirror or your raid 5 array has you protected, you are dead wrong. Those handle failure at the hardware level. What handles failure at the data level? Nothing. Hope you make backups of your arrays.

      --
      "The avalanch has already started, it is too late for the pebbles to vote." -Kosh
    4. Re:The Reason is Probably Technical by segedunum · · Score: 1

      Spend ten minutes with the filesystem engineers at WWDC, and you wouldn't come away thinking there was any shortage of will to make ZFS fly on the Mac.

      The proof of the pudding, as they say. By any stretch of the imagination ZFS within Mac OS is a project that has stagnated and gone completely stillborne from 10.5 and onwards. It's not something you could ever consider using semi-reliably, nor did you get the impression that it would ever reach that stage.

      I'm sure there was no shortage of soundbites and excitement that someone was interested in Sun's pretty new baby, and Sun themselves gave overtures to that effect. That does not mean that it was ever going to work though.

    5. Re:The Reason is Probably Technical by trentblase · · Score: 1

      Amen... I was running a file-level checksum database in a vain attempt to detect bitrot until I discovered zfs. To be honest, I think it would be fairly easy to add bitrot detection in any existing fs (for a developer of course, not me)... Just add a hash to each sector. but you wouldn't get all the robust goodies baked into zfs.

    6. Re:The Reason is Probably Technical by segedunum · · Score: 1, Funny

      That doesn't make any sense. It only makes sense to engineer a new filesystem if the other options are inadequate or unusable.

      It makes perfect sense. HPFS is simply far too long in the tooth now.

      For them to seek to do that, they must have rejected the effort to integrate ZFS for some technical reason.

      Yer................

      The complexity of integrating ZFS pales into comparison to the massive cost of engineering and implementing a new filesystem from the ground up.

      What's even more difficult is to integrate an existing filesystem into your OS that wasn't designed with your OS and your use cases in mind. It becomes virtually impossible to then change anything.

    7. Re:The Reason is Probably Technical by dangitman · · Score: 0, Flamebait

      Engineering a new filesystem is hard and expensive.

      It's so hard, it often makes the developers murder their (ex) girlfriends and remove the seats of their cars.

      --
      ... and then they built the supercollider.
    8. Re:The Reason is Probably Technical by jcr · · Score: 2, Insightful

      Engineering a new filesystem is hard and expensive.

      Sure, but when you have a team on hand that knows how to do it, and has been through the development of several different filesystems between them, why not build your own?

      I think the chance of Apple wanting to engineer a new FS so lightly are pretty slim.

      Who says they're doing it lightly? Have you seen who they've got in that group?

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    9. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 1, Informative

      T
      It makes perfect sense. HPFS is simply far too long in the tooth now.

      Did you mean HFS?

      HPFS is the old OS/2 filesystem created by Microsoft in 1985 (d. in 1987) and now replaced by NTFS and JFS

      Hand in your geek card on the way out

    10. Re:The Reason is Probably Technical by segedunum · · Score: 4, Interesting

      ZFS is the next generation file system that all others will have to live up to.

      I'm sure it will, but I'm afraid that doesn't mean that made it practical for Apple to integrate into OS X or that it fitted the use cases they needed for many desktop scenarios. The FreeBSD people still haven't been able to run and integrate it reliably.

      I use it on servers daily at work, and I was looking forward to having it on my Macs at home. Bit rot is a very real problem. ZFS handles it automagically.

      The ZFS advocates trot those lines out every time and they're total nonsense. Ultimately, the only way to deal with silent data corruption or 'bit rot' is to have multiple levels of redundancy several times over for your data - which ZFS has and deals with. No desktop Mac can ever have that. Anyone who thinks that is anywhere near being practical to deal with on a desktop system is an idiot, and no, I'm afraid booting OpenSolaris with ZFS on your desktop system at home and not having it crash and burn does not even approach the kind of issues and corner cases that Apple's engineers will have to deal with, especially in a desktop system like OS X.

      By no stretch of the imagination does ZFS handle this 'magically'. There is a severe price to be paid. If you don't have redudancy then you will simply risk losing your ZFS pool if there is corruption.

      What handles failure at the data level? Nothing. Hope you make backups of your arrays.

      I'm afraid that hardware, bad sector and disk issues are far, far more prevalent problems than data corruption at an OS level. Many apparent corruption issues at the OS level are usually down to hardware issues somewhere down the line. It might be a problem for operating systems with fairly shitty and poorly maintained disk and controller device drivers with a poor history on x86 and widely used hardware (hello Solaris!) but I'm afraid it's just not a primary concern for everyone else or for those developing desktop operating systems.

    11. Re:The Reason is Probably Technical by segedunum · · Score: 2

      HPFS is simply far too long in the tooth now.

      ???????!!!!! Far too late here now. That should of course be HFS(+).

    12. Re:The Reason is Probably Technical by jcr · · Score: 3, Interesting

      By any stretch of the imagination ZFS within Mac OS is a project that has stagnated and gone completely stillborne from 10.5 and onwards.

      And you know this because you were sitting in on their meetings, I suppose?

      Apple's had a top-flight team working on ZFS for several years. I'm sure that their replacement will top it.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    13. Re:The Reason is Probably Technical by pantherace · · Score: 1

      You seem to be implying that Apple's team has designed several. If so, please specify which they have...

    14. Re:The Reason is Probably Technical by 4iedBandit · · Score: 5, Informative

      I'm sure it will, but I'm afraid that doesn't mean that made it practical for Apple to integrate into OS X or that it fitted the use cases they needed for many desktop scenarios.

      Um, the technical work was already done. It could have shipped with Snow Leopard. Again, the reason it didn't has nothing to do with the technical feasibility of it.

      Ultimately, the only way to deal with silent data corruption or 'bit rot' is to have multiple levels of redundancy several times over for your data - which ZFS has and deals with. No desktop Mac can ever have that.

      Why? Because you say so?

      Anyone who thinks that is anywhere near being practical to deal with on a desktop system is an idiot

      While I may be an idiot, you have to convince me that ZFS is not practical for a desktop. Again, just because you say so is not reason enough. I stand by my statement that ZFS is the only file system with enough benefit to make me explicitly choose it for building servers. You may argue that there's a difference between a server and a desktop but those really are nothing more than abstract concepts. A file system that has too much overhead for my desktop has too much overhead for my servers. Performance matters. ZFS may not be the fastest, but it is no slouch either and the other benefits it brings to the table far outweigh miniscule performance concerns.

      By no stretch of the imagination does ZFS handle this 'magically'. There is a severe price to be paid.

      What exactly is this severe price? Can you spell it out? Exactly? "Any sufficiently advanced technology is indistinguishable from magic." In that respect yes I will say it is magic because it is head and shoulders more advanced than anything else I've had the pleasure of working with. File systems have not had this kind of improvement in decades.

      I'm afraid that hardware, bad sector and disk issues are far, far more prevalent problems than data corruption at an OS level...but I'm afraid it's just not a primary concern for everyone else or for those developing desktop operating systems.

      How do you know? It's not a significant problem till the data you need is unavailable when you need it. At home my own modest media library sits on just 500 Gig with no guarantee that any of it will still be whole in 6 months. Sure I back it up. Routinely. But until you access the file you don't know if it's been corrupted. Then how long as it been corrupted? Do your backups go back far enough to compensate? Yes you can checksum everything routinely and maintain a database of checksums to validate file change. Part of the beauty of ZFS is it does this with every thing you put in it, at the block level, and it validates the checksum every time you read the data. If a block fails the check, it not only sends you the valid block from the mirrored copy (You do have redundancy right? Even ZFS won't save you if you only have one copy.) but also replaces the bad block with a copy of the good one.

      Storage capacity is skyrocketing. Going to backup to fix problems is a real problem in itself. Are the tapes on-site? Do we have to go to the vault to find an uncorrupted copy? Did the media pool get recycled and now there is no uncorrupted copy? Do you enjoy explaining to an executive why the data they want is unavailable despite spending millions on enterprise class storage and backup solutions? The problems of enterprise storage are becoming problems of home users. I have three terabytes of storage just to backup my home system in a replication layout I'm okay with, but I really would have loved the protection ZFS offers against bit rot to top it off. Stick your head in the sand if you want, but I consider my data and it's availability a little more important. ZFS handles it elegantly, in the background, with negligible performance hit.

      --
      "The avalanch has already started, it is too late for the pebbles to vote." -Kosh
    15. Re:The Reason is Probably Technical by jedidiah · · Score: 1

      Like the other guy said... "the proof is in the pudding".

      Lip service given in private meetings in Cupertino doesn't really amount to anything.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    16. Re:The Reason is Probably Technical by reidconti · · Score: 1

      Given the pretty extensive functionality and plumbing of ZFS its probably been too much of a big ask to integrate a filesystem like that into a desktop. They might well have come to the conclusion that ZFS was simply complete overkill on a desktop and that it just wasn't possible.

      Why say in 4 words what can be said, while nounning a verb, in 6?

    17. Re:The Reason is Probably Technical by Just+Some+Guy · · Score: 1

      The FreeBSD people still haven't been able to run and integrate it reliably.

      It's now marked as production quality in FreeBSD, and it's now entirely possible to have ZFS-only systems. My home server boots directly into a ZFS root filesystem without any UFS filesystems to help it. Given those two facts, I'd say they've been able to run and integrate it quite nicely.

      --
      Dewey, what part of this looks like authorities should be involved?
    18. Re:The Reason is Probably Technical by dasmoo · · Score: 1

      By no stretch of the imagination does ZFS handle this 'magically'. There is a severe price to be paid. If you don't have redudancy then you will simply risk losing your ZFS pool if there is corruption. I'm afraid that hardware, bad sector and disk issues are far, far more prevalent problems than data corruption at an OS level. Many apparent corruption issues at the OS level are usually down to hardware issues somewhere down the line. It might be a problem for operating systems with fairly shitty and poorly maintained disk and controller device drivers with a poor history on x86 and widely used hardware (hello Solaris!) but I'm afraid it's just not a primary concern for everyone else or for those developing desktop operating systems.

      What have you got against better data integrity, where ever it's coming from? Do you hate data or something?

      I've been using ZFS for a few years and I haven't lost anything yet, which is more than I can say for my experience with ext3, reiser, jfs, NTFS, FAT, HFS+ and XFS (oh and VMFS, that shit just disappears). I've lost data, had systemic corruption or just had whole datasets vanish on me through all of those file systems. The data is usually recoverable for me, but I shouldn't have to be wasting my time looking for shitty little files on a broken file system. I'm sure that ZFS will break for me one day and then I'll complain about it too, however I'd normally have been burnt by now.

    19. Re:The Reason is Probably Technical by BitZtream · · Score: 1

      The FreeBSD people still haven't been able to run and integrate it reliably.

      Where did you get that from? I've got a machine thats been up since a few days after FBSD 7.2 was released that only has ZFS and serves data constantly. Its been moving filling my gigabit ethernet links for about 8 hours today alone, and this isn't the first time its done a lot of IO for me.

      I admit, I don't really 'stress' the system, but the only problem with ZFS on FBSD is its inability to cope with low memory situations. FBSD 64 bit with 4 gigs of ram and you won't see a problem unless you screw with the ARC and mess it up.

      ZFS DOES have multiple layers of redundancy. Including block level checksuming. Why can no desktop mac have that? Two drives, mirrored vdev, turn on checksuming, set copies=2. You now have three layers of protection and correction against bit rot and failure. Any of those layers detect a problem during a read and they pull the data from a new place. Have you actually read anything about ZFS from someone who knew what they were talking about?

      I'm not sure what you mean by 'doesn't handle it magically' but I've pulled a drive out of a zraid vdev, written random data to a random location and it was happy to detect it and correct it on the fly, letting me know it happened in syslog.

      I don't think you actually know anything about ZFS, but then again, I am a self admitting ZFS fanboy.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    20. Re:The Reason is Probably Technical by jcr · · Score: 3, Informative

      They have core developers from the HFS+, BeFS, and ZFS teams, not to mention all the work they've done in-house on the other filesystems they support.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    21. Re:The Reason is Probably Technical by jcr · · Score: 1

      Actually, it's "the proof of the pudding is in the eating."

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    22. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 0

      Yup, that's what it is. And ZFS is a big pudding that Apple isn't eating.

    23. Re:The Reason is Probably Technical by TheRaven64 · · Score: 1

      By any stretch of the imagination ZFS within Mac OS is a project that has stagnated and gone completely stillborne from 10.5 and onwards

      Obviously you were not paying attention. The ZFS project on MacOS X Forge (i.e. the topic of the article) was shipping ZFS kernel modules that provided read-write support and most of the ZFS features on 10.5 and (I think) 10.6. It wasn't shipped with OS X, because it was not finished. That said, I think porting ZFS to OS X is a good 90:10 rule example; the first 90% took 90% of the effort, and the remaining 10% took the other 90% of the effort. Looking at the remaining bugs, it seemed that they could only really be fixed by implementing a new version of the ZPL, which would be a lot of effort. I think they were also using quite an old version of ZFS, so merging their changes and rewriting the ZPL probably would have ended up being almost as much effort as writing a new FS from scratch, especially for someone like Dominic Giampaolo.

      --
      I am TheRaven on Soylent News
    24. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 0

      I'm afraid that hardware, bad sector and disk issues are far, far more prevalent problems than data corruption at an OS level...but I'm afraid it's just not a primary concern for everyone else or for those developing desktop operating systems.

      How do you know?

      From my experiences, there are things that make ZFS panic (such as failing to write data in certain circumstances) the system that are not quite as drastic as other filesystems. Having a single disk ZFS volume and then having a write error on that volume would be sufficient for that to happen. How many laptops and desktops have dual disks in them, by default, for mirroring? What would be the cost to Apple's product line to put two disks in everything where ZFS is going to be found? (And that's ignoring the problems that the panic's are going to cause apple due to hardware failures.)

    25. Re:The Reason is Probably Technical by segedunum · · Score: 1

      Um, the technical work was already done. It could have shipped with Snow Leopard. Again, the reason it didn't has nothing to do with the technical feasibility of it.

      Errrrrr, no. The technical work has not been done and was only just beginning. ZFS in OS X has always been an unstable beta project, and getting to a point where you can just about read and write from and to a filesystem means little. It's like saying that Ext2/3 is integrated into Windows because there is a driver that allows you to handle it. The filesystem has not been integrated into core services like Time Machine or within other services in OS X, and when you do that there are a ton of corner cases like performance to handle.

      Booting a system with ZFS support and saying "OMG, it didn't fail it must be stable for everyday use!" is plain stupid.

      Why? Because you say so?

      Hmmmmm. So you've completely discredited yourself there then? The only way to deal with and recover from data corruption is to have a good copy somewhere else that can be manually or automatically brought in. That's what ZFS does, and Sun themselves say that you will risk data loss without redundancy. If you think ZFS magically handles everything to the point where redundancy isn't required then I'm afraid you've been drinking a lot of anti-freeze.

      While I may be an idiot, you have to convince me that ZFS is not practical for a desktop. Again, just because you say so is not reason enough.

      That's bizarre logic. Apple rejecting it is reason enough because they make desktops for a living. The memory and redundancy requirements (as I've mentioned clearly) are simply not practical at all on a thin Apple laptop. You aren't going to see Apple laptops with at least two disks to accomodate a filesystem who's major selling point is redundancy and data integrity. That's clear. Yes I'm afraid you are an idiot.

      What exactly is this severe price? Can you spell it out? Exactly?

      Memory requirements, redundancy requirements, checksumming overheads, RAID logic and code in a system that doesn't use RAID............ They all have to be factored in and tested in a lot of scenarios. I'm amused that you've been modded +5 informative with absolutely nothing informative to add yourself other than "I don't believe you".

      How do you know? It's not a significant problem till the data you need is unavailable when you need it. At home my own modest media library sits on just 500 Gig...

      So you're a fanboy with no knowledge whatsoever about storage other than the MP3s you've got sitting on some system somewhere - and someone somewhere thinks that you're informative? Give me a fucking break.

      Yes you can checksum everything routinely and maintain a database of checksums to validate file change.

      Checksumming will tell you that something went wrong, but without redundant copies of the data that can be brought in and the hardware to make that work then you've lost your data. If you don't know that then.........I don't want you around storage. Ever. Like I said - on systems with shitty device drivers then maybe you need this.

      Do you enjoy explaining to an executive why the data they want is unavailable despite spending millions on enterprise class storage and backup solutions?

      That's because it doesn't happen in those systems. Amazon store possibly more data in S3 than has been put on any ZFS system anywhere. ZFS might make the chores of storing that data a bit easier but it is no silver bullet in some magical pixie world where redundancy isn't required.

      I canot believe I replied to this shit.

    26. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 0

      Part of the beauty of ZFS is it does this with every thing you put in it, at the block level, and it validates the checksum every time you read the data. If a block fails the check, it not only sends you the valid block from the mirrored copy (You do have redundancy right? Even ZFS won't save you if you only have one copy.) but also replaces the bad block with a copy of the good one.

      A bit like your hard disk controller already does then? Or did you think ZFS was somehow the first technology to think of doing this?

    27. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 0

      No, I don't think the hard disk controller does that. Where does it store the checksums?

    28. Re:The Reason is Probably Technical by JayAEU · · Score: 1

      The parent probably meant to write task instead ask...

    29. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 0

      Like the other guy said... "the proof is in the pudding".

      Er, no, the proof is not in the pudding. The other guy said "The proof of the pudding...". As in, "The proof of the pudding is in the eating."

    30. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 0

      I'll admit I know nothing about ZFS, but I do understand coding theory.

      "Ultimately, the only way to deal with silent data corruption or 'bit rot' is to have multiple levels of redundancy several times over for your data"

      This is in the general sense outright false. Bit rot refers to the idea where, over time, individual bits may be come corrupt or unreadable, when this happens in relation to the data the amount of bits lost is small scale, else it's something much more serious than bit rot, like an outright failing storage medium. As such there are many algorithms you can employ that can handle error checking and error correction by storing only a relatively tiny amount of additional data, but fundamentally the amount of additional data per block of data you wish to protect depends on how rapid you might expect bit rot to occur. It's effectively a sliding scale, but for general computing usage the amount of data you would need to store in addition would be quite small, the premise that you need to store much additional data such that there's a major price is false- particularly as we lose space with many file systems anyway due to block sizes.

      Of course, you can have noticable cost to data integrity if you're intent on supporting unreliable storage mediums or data transfer systems like say, heavily failing hard drives or low power wireless communications from probes orbiting Mars or wherever.

      I do not understand why you would suggest a home system could not support the negligible levels of redundancy required to ensure data integrity capable of protecting against bit rot, unless you're confusing bit rot with the idea of supporting heavily unreliable storage systems, but in that case it's more like agressive terminal cancer than rot.

    31. Re:The Reason is Probably Technical by jhol13 · · Score: 1

      Why would ZFS require redundancy any more than any other FS? Why is non-redundant HFS+ better than non-redundant ZFS?

      Actually detecting errors even without redundancy (i.e. data loss) is IMHO much better than undetected errors. You seem to think device drivers are the only place errors can happen ... this is, of course, utter bullshit. Besides, you can have "copies=2" for important data, something which HFS+ does not support. Most laptops do have big enough HD for that (in most cases).

    32. Re:The Reason is Probably Technical by Anonymous Coward · · Score: 0

      I'm going to agree anonymously. Anyone that's used ZFS knows it's kind of a memory pig. Anyone that's tried to use OS X for anything more than light server duty has discovered how weak its virtual memory capability is. Lean on it and it stays true to it's Mach underpinnings and thrashes. Getting ZFS to work well would require the solid VM subsystem a server grade monolithic kernel provides, and Apple doesn't have it.

      It's easy to forget how good the Solaris kernel is when you're distracted by all the old SVR4 cruft that surrounds it. It's VM system is in a league of its own. If Oracle somehow finds religion and decides to open ZFS, I'd expect only the BSD's and Linux to be able to handle it, and then possibly only after some growing pains.

  5. Github project taking up the slack by KillNateD · · Score: 5, Informative

    Dustn Sallings put the code on Github and has already hacked some basic Snow Leopard support and a minimal installer:

    http://dustin.github.com/2009/10/23/mac-zfs.html

    Code's here, fork away:

    http://github.com/dustin/mac-zfs

    1. Re:Github project taking up the slack by Tolkien · · Score: 1

      Why is it every time I see Github with a lowercase "H" I always read it as Gith tub?

    2. Re:Github project taking up the slack by reuteler · · Score: 1

      not sure what didn't work about zfs and snow leopard. i've been using the last package from macosxforge since snow leopard came out.

      --
      david reuteler
    3. Re:Github project taking up the slack by pHDNgell · · Score: 1

      It was reported to work on Snow Leopard with a 32-bit kernel. It did not work with a 64-bit kernel. The source would build, but there were missing symbols.

      Of course, there's more to do, but you can at least read your volumes again now.

      --
      -- The world is watching America, and America is watching TV.
  6. With SSDs, who needs it? by a09bdb811a · · Score: 1

    Upgrade to an SSD, and it hardly matters what crusty old filesystem you're using. You're still going to have far greater speed and no mechanical failures. As far as I can see, the only vaguely useful ZFS feature is snapshots... it doesn't even do encryption. I don't think this is a major loss.

    1. Re:With SSDs, who needs it? by BoneFlower · · Score: 4, Insightful

      When SSDs come down A LOT in price, and up in size, maybe.

      Go do a search on Newegg. Biggest they've got is 256GB, of those, the cheapest is $595. You can get several terabytes for that price with a magnetic hard drives.

      SSDs have a place, but as a general replacement for magnetic hard drives they are too expensive with too little capacity.

      There is also more to the file system than access speed.

    2. Re:With SSDs, who needs it? by Anonymous Coward · · Score: 1, Insightful

      Significant use (desktop systems) + the necessary need for OSes to write a lot to a drive = low life for an SSD, regardless of wear leveling.

      SSDs are only good for low-use computers (netbooks) and as a replacement for storage media like optical media where you do much more reading than writing.

      Until we get a device that doesn't have this issue, SSDs will NOT replace HDs. Please, PLEASE do not even consider killing plain HDs like this goddamn industry did to CRTs which are vastly superior to LCDs (even the best of which still have lag and motion tearing issues, no matter what people might say).

      If it's not broke, DON'T REPLACE IT.

    3. Re:With SSDs, who needs it? by Culture20 · · Score: 1

      Notice that this was intended for OSX server, not OSX. I don't know why someone would buy one, but Apple does sell disk arrays for use with their xserves.

    4. Re:With SSDs, who needs it? by BoneFlower · · Score: 1

      For simple image quality, especially fast animation, yes, CRTs are superior.

      The desk space advantage of an LCD can be very significant though. It's enough space to fit stuff like books that you wouldn't be able to put in a convenient place otherwise. This is the primary reason I'm a fan of LCDs.

      Granted, if I was more of a gamer or used the computer mainly as a media center, I'd give CRTs a closer look. But for many real world tasks, the desk space advantage can be a big practical benefit to LCDs.

    5. Re:With SSDs, who needs it? by EdIII · · Score: 1

      What?

      Ignoring the high cost and low amount of space what about write endurance? Wear leveling? Asymmetric I/O speeds? Poor I/O performance? Everybody talks about the super fast read speeds while ignoring the fact that write speeds are never the same, tend to be far lower, and are not consistent.

      In any case I don't see how faster speed is going to make up for anything in a file system. If you are trying to use them in a server environment it makes no sense either. SSD's don't perform nearly as well as 4 SATA drives in a decent RAID setup.

      For the cost of 5 large SSD drives you would be better off going with one of the new offerings from FusioIO or OCZ. At least they have ramped up the write speeds considerably and much closer to the read speed.

    6. Re:With SSDs, who needs it? by Anonymous Coward · · Score: 0

      Why do people always say desk space is the most important thing? Can you really not get a bigger desk? Mine's not even that freaking big but it's got a nice little shelf on top which is PLENTY big enough for my 19" CRT.

      If desk space is the ONLY thing marrying everyone to LCDs, then you really need to rethink things.

    7. Re:With SSDs, who needs it? by Mprx · · Score: 1

      The new 120Hz LCDs aren't bad. I've been using a Iiyama Vision Master Pro 454 CRT for years, but I recently switched to a ViewSonic VX2268wm LCD. There's still visible sample and hold blurring, but unlike on a 60Hz LCD you only notice it when you're actively looking for it (assuming your frame rate doesn't drop below 120fps). Black level and color accuracy are poor as you'd expect from a TN panel, but I find motion quality much more important. No noticeable input lag. It's easily the best LCD I've used, and the convenience of an LCD (much shorter warmup time, small size, perfect geometry linearity, lower power consumption) outweighs the slight image quality/motion quality loss as compared to a CRT. Being able to run 120Hz at full resolution is also useful, because before I had to switch modes for gaming/movies because my CRT only did 100Hz at the highest usable resolution. I don't trust SSDs for long term reliability, but the performance boost is too big to ignore. I'm using a OCZ Vertex in combination with mechanical drives.

    8. Re:With SSDs, who needs it? by Grishnakh · · Score: 3, Insightful

      Don't forget the power savings. I just got a new 24" LG panel with LED backlighting that, I believe, uses only 26W at full power. Compared to the old 19" CRT it replaced, it's a huge savings (that one used over 140W I think). Not only does this affect my power bill, but also the temperature in my poorly-ventilated office. Now it doesn't get so darn hot in there. (Yes, I could turn up the A/C, but then the rest of the house would be freezing, so that doesn't make much sense.)

      The picture is nice and bright, and as you'd expect with an LCD, not distorted at all, as I've found most large CRTs to be. Yes, CRTs definitely have better color (at least better than the 6-bit TN panels which are common for LCDs), but ones supporting 1900x1080 or better resolution are downright gigantic, and use a ton of power, and the picture seems to have distortion problems too. I really don't miss having to muck around with all the image adjustment (centering, size, moire, trapezoid, etc. etc.) controls that I had to on every CRT I used.

    9. Re:With SSDs, who needs it? by AHuxley · · Score: 1
      --
      Domestic spying is now "Benign Information Gathering"
    10. Re:With SSDs, who needs it? by RocketRabbit · · Score: 1

      This is a huge loss. Clearly you haven't managed a datacenter.

    11. Re:With SSDs, who needs it? by Anonymous Coward · · Score: 1, Interesting

      You're saying CRT's never had tearing? My LCD has a 85Hz refresh rate, and it was cheap. You seem to be remembering CRT's as having infinite refresh speed for some reason. Hell, the fact that CRT's actually *blank* and LCD's don't makes CRT's far worse as that particular family of artifact goes.

      As for color gamut, yeah the cheap one isn't quite up to it. But LED TV's are out now tho and they have a gamut that's bigger than any CRT ever was. That'll be coming to monitors real soon now.

    12. Re:With SSDs, who needs it? by pseudonomous · · Score: 1

      Actually, one of the purported benifits of ZFS is that it's supposed to be able to increase performance on systems that have a combination of SSD and spinning platter disks by caching files on the SSD. I don't know what it buys you in practice, but it's one of Sun's big selling points of the filesystem, in fact they were building some servers specifically to take advantage of SSD + spinning platter "hybrid storage".

    13. Re:With SSDs, who needs it? by Mprx · · Score: 1

      Is that real 85Hz or dropping frames to 60Hz? I'm not aware of any LCD with a genuine maximum refresh rate of 85Hz.

      CRT blanking is a very good thing, because it eliminates sample and hold blur. Good article on motion representation:
      http://www.microsoft.com/whdc/archive/temprate.mspx

    14. Re:With SSDs, who needs it? by Kjella · · Score: 2, Interesting

      Grab a small SSD for apps/games and a 5400RPM terabyte disk for all your music/movies/series/home video/whatever. 64/80GB disks seems to be the sweetspot now, which even leaves some space for apps after installing Win7 ;)

      --
      Live today, because you never know what tomorrow brings
    15. Re:With SSDs, who needs it? by pyite · · Score: 1

      SSD's don't perform nearly as well as 4 SATA drives in a decent RAID setup.

      What are you smoking?

      These are conservative numbers, and they show a commodity (Intel X25-M) MLC flash drive doing over 1,000 IOPS, but a typical 7,200 RPM SATA drive doing 100 IOPS. (Note, I rounded down for the SSD and up for the spinning disk.) So, SSDs are an order of magnitude faster at IOPS than platters. To get a 10x increase of write IOPS on a spinning disk, you'd need to use RAID-0 across ten disks. Hardly a good idea.

      --

      "Nature doesn't care how smart you are. You can still be wrong." - Richard Feynman

    16. Re:With SSDs, who needs it? by Anonymous Coward · · Score: 0

      No they don't they discontinued that years ago now.

    17. Re:With SSDs, who needs it? by supertux · · Score: 1

      SSDs are tiny compared to the spinning rust variety.

      But here is where ZFS kicks butt. You can attach SSDs to be the read and/or write cache for your large array of magnetic disk. You use an MLC SSDs for read cache, and a SLCs for write cache. If you do this you effectively turn your big slow array into crazy crazy fast storage.

      I set up a opensolaris/zfs setup like this at home. I connect to it from my gaming pc, and have my apps installed on an iscsi target on opensolaris through regular gigabit. Do you know how crazy fast games launch? All games? It is like I am playing them all from a ram drive. I probably can't express how awesome it is.

      Also, from a recent conference on ZFS it looks like they will have the ability to increase/decrease widths of strips, encryption, and single instance storage soon. Single instance storage will be great for me since my home systems get their disk from the server like I mentioned about.

    18. Re:With SSDs, who needs it? by EdIII · · Score: 2, Insightful

      Must not be as good as what you are smoking. You are being simplistic.

      Total IOPS on SSD's are higher, but that is mostly READ IOPS and not WRITE IOPS. SSD's have typically performed very poorly with random writes. Obviously you don't understand that they mostly refer to TOTAL IOPS because it sounds good. What about the write IOPS? You are conveniently leaving that out. That and the fact that in some cases read IOPS and write IOPS on some SSD's are not anywhere near each other. This creates problems in a server environment depending on what you want to do. Since we are talking about ZFS here, I doubt we are talking in the context of a home user.

      Quite recently write endurance and wear leveling were major concerns. There is no way that a generation 1 SSD could ever compete against SATA in the datacenter when you take everything into consideration. AFAIK, they still have not fixed the write performance in commodity SSD's on the market. FusioIO and OCZ have taken steps, expensive steps, to bring their offerings with much better write performance.

      Theoretically, if SSD was that much better we would see people making RAID setups with them and seeing stellar results. Yeah.... Quite a few people report that the performance was really slow when logic told them it was going to be really fast.... I wonder why.

      RAID can benefit you depending on what RAID you are using and WHY you are using it. You need to consider what you need first. Read performance? Fault tolerance? Write performance? Application requirements? You just can't throw an SSD at the problem and say, "Uhhh.. Solid State will solve the problem dawg".

      If you are trying to create a database server that is going to be doing hundreds of thousands of updates a day... you are NOT going to succeed doing it with SSD drives.

      Bottom line, if all you want is really high READ IOPS, and don't need the fast write capability, than yeah.. go with an SSD. Just don't blow smoke up people's butts by claiming its performance alone can negate the need for newer and higher performance filing systems. Puhleeeze.

    19. Re:With SSDs, who needs it? by supertux · · Score: 2, Informative

      People don't do enough research and buy the wrong stuff. If you need fast writes, you get the Intel X25-E. If you need fast reads, the Intel X25-M is fine. If you need the SSD to take a punishing amount of writes over the years, you get the X25-E again. If you aren't planning on punishing it with writes, the X25-M is again fine. If you need cheap, then you get an extra helping of crappy write I/O. :-)

      If you want to have monstrously fast storage, you build a raid with zfs, and use one or two X25-Ms for the L2ARC cache and a mirrored (through zfs) X25-M pair for the zil cache.

      I'd rather use SSD to supplement traditional storage rather than to run straight off it. But that said, I have been running my mythtv box off of an 8GB Transcend compact flash for the OS for over two years now with great results. It is a gentoo system, so I compile stuff on it all the time. Of course it has a mysql database that gets updated daily because of the schedules it pules down for mythtv. No problems there, and no regrets.

      But more to your point, the problems that plagued crappy SSD controllers and designs are being worked out, and probably somewhat soonish won't be a relevant issue anymore for most people.

    20. Re:With SSDs, who needs it? by agnosticnixie · · Score: 1

      For a bigger desk, most people would need a bigger office, they don't make buildings with spare dimensions yet.

    21. Re:With SSDs, who needs it? by quercus.aeternam · · Score: 1

      How about hybrid zfs?

      Having a high performance SSD cache for your data seems extremely nice - especially considering the small working set for most consumers.

      Think 'readyboost on steroids.' No thumb drive can /touch/ SATA II speeds.

    22. Re:With SSDs, who needs it? by bcrowell · · Score: 3, Interesting

      Go do a search on Newegg. Biggest they've got is 256GB, of those, the cheapest is $595. You can get several terabytes for that price with a magnetic hard drives.

      Yeah, but a lot of people don't need terabytes worth of storage. I just built a machine for my wife with a 64 Gb SSD, which cost $180. She's currently only using about 25% of the space. The good thing is that the machine is really fast on some tasks she does that require a lot of hard-disk access.

    23. Re:With SSDs, who needs it? by Anonymous Coward · · Score: 0

      A 19" CRT (for example, a ViewSonic E790) is only 18" viewable. That practice was dropped with LCD's, so a 19" LCD is 19" viewable. The CRT is also 4:3 while widescreen is readily available in LCD's. So your big 19" CRT is pretty tiny compared to a 24" or even 22" LCD. And you simply won't find a 30" CRT with the same DPI of available 30" LCD's.

    24. Re:With SSDs, who needs it? by Mad+Merlin · · Score: 1

      What?

      Ignoring the high cost and low amount of space what about write endurance? Wear leveling? Asymmetric I/O speeds? Poor I/O performance? Everybody talks about the super fast read speeds while ignoring the fact that write speeds are never the same, tend to be far lower, and are not consistent.

      I'm sorry, but your comments make no sense with regards to SLC SSDs. Their random read/write speeds are more than an order of magnitude faster than even 15k RPM spinning rust. Not to mention their sequential read/write speeds, which are typically 2-3x faster.

      MLC SSDs are what you're referring to, and they're junk, no question about it. But please, read up on SLC vs MLC before speaking up again.

    25. Re:With SSDs, who needs it? by Maxhrk · · Score: 0

      Why do people always say desk space is the most important thing? Can you really not get a bigger desk? Mine's not even that freaking big but it's got a nice little shelf on top which is PLENTY big enough for my 19" CRT.

      If desk space is the ONLY thing marrying everyone to LCDs, then you really need to rethink things.

      I don't want CRT because of my eyes and low chance of getting killed by laser in accidental situation. SO in order to maximizing my chance of survival I will rather go with LCD. :P

    26. Re:With SSDs, who needs it? by EdIII · · Score: 1

      The person I was replying to was not talking about SLC SSD's. In fact, they did not specifically mention SLC or MLC. However, when most people are speaking about SSD's and making unsupportable claims, they still refer to the cheaper MLC crap.

      In another post I already mentioned that using the SLC hardware in a datacenter is the only time it can make sense.

    27. Re:With SSDs, who needs it? by symbolset · · Score: 4, Interesting

      SATA attach SSD has achieved price parity with enterprise SAS, the density is almost there, and the performance completely blows it away. We're not at the end of spinning disc, but you can see it from here.

      The new performance tier of storage is PCIe attach SSD. At two terabytes of storage and 1.5GB/s per slot, we're getting close to what we used to get from Ramdisk in performance and adequate density at 3TB per rack unit including server (HP DL785 G5 or equivalent). Yes, this is expensive right now, but the performance tier always has been. This is for trading platforms, HPC and such. These are approaching 2M IOPS and 40TB per 7U server.

      The second tier is 2.5" 256GB SATA SSDs. You get 3TB per rack unit including the server. About the same cost as SAS for 10x the performance. Software options enable you to scale this to infinity in both bulk and performance. Great for databases, VMDK files and iSCSI. Get the hot-swap version and leave some open bays so that when the 1TB 2.5" SSDs come out you can migrate your LUNS with no downtime.

      The third tier is SAS spinning disk. At something like 20TB/Rack unit (excluding servers) you can use this to serve frequently used files.

      The fourth tier now is SATA spinning disk. At roughly the same density as SAS spinning disk for one-fourth the cost, this is a good candidate for deduplicated targets like virtual tape libraries or deduplicated NAS. It's also a good place to store your snapshots. With modern snapshot technologies there's no good reason to not store snaps every 15 minutes or so. Typically you would park this storage offsite for DR purposes so you can avoid the Premium Microsoft danger eXperience(**).

      Storage pros probably would note that I neglected to mention tape and Fiber Channel. That's neither accident nor ignorance. The only reason for tape is legally mandated tape backups, and I consider this the IT equivalent of legally mandated hitching posts outside every business (which laws persist in some places) - if you gotta, you gotta, but there's no reason any more to consider it a necessary or good practice. As for Fiber Channel, it just doesn't fit in the model any more. I know this hurts the feelings of folks who just dropped a million bucks for a single rack of SAN storage with 100TB, or worse - popped for the new 8GBit stuff complete with a converged ethernet/FCoE solution, but it's true. There's just no reason for fiber channel any more. It just doesn't have the bandwidth to support a modern storage solution and it costs too much. Sure, it's got redundancy from the disc to the file server, but so what: modern file servers use redundant storage and clustered redundancy and don't need the diminishing returns of embarassingly expensive drives, head nodes, capacity licensing and annual support contracts. By the time you figure in oversubscribed ports in your FC network, you've lost the supposed reliable performance benefit of the whole thing. This isn't bad news for Cisco - they're going to sell a lot of 10Gbit Ethernet ports before they get cheap and they haven't lost anything by being also compatible with FC. It really bites to be EMC this week, but they'll figure it out.

      Check the specs on this server, this card, this drive and this array. This is off-the-shelf stuff, not pie in the sky. The interconnect people need to get off their butts, but this is all doable right now. The compute side becomes an almost trivial cost of what it takes to maintain this storage bandwidth and capacity. If you like proprietary solutions HP sells a thing called the LeftHand Virtual San App

      --
      Help stamp out iliturcy.
    28. Re:With SSDs, who needs it? by Rakishi · · Score: 1

      19"? Hahahahaha. People still use monitors that small?

      I've got a 21" and a 15" lcd at home on those swinging arms so I can reposition them as needed. I had two 15" when lcds were becoming popular. At work I have a 24" and some coworkers have TWO 24" lcd.

      So yeah, I'll take triple the resolution and size in the same area over unimportantly worse image quality.

    29. Re:With SSDs, who needs it? by phantomcircuit · · Score: 1

      The main advantage of ZFS is the silent data corruption becomes non existent. All of your data is protected with a string checksum.

    30. Re:With SSDs, who needs it? by symbolset · · Score: 1

      I had prepared a long and eloquent disposition on how stupid your statements are. Regrettably my toddler stepped on the power switch before I clicked Submit. Since my comment was not yet commited to disk, it's lost forever.

      Let me just say that available individual SSDs are capable of 200,000 IOPS and 1.5GB/s (not Gb/s. It's not a typo.) both read and write. They RAID as well as spinning discs do.

      If you are trying to create a database server that is going to be doing hundreds of thousands of updates a day... you are NOT going to succeed doing it with SSD drives.

      If you are trying to create a database server that is going to be doing hundreds of thousands of updates a second ... you are NOT going to succeed doing it with Magnetomechanical drives.

      In short, your information is about ten years old. Get with the program if you're going to try to school people on /.

      --
      Help stamp out iliturcy.
    31. Re:With SSDs, who needs it? by EdIII · · Score: 0

      Uh huh. Maybe the newer SLC SSD offerings can do what you claim, but not the majority of the crap that has been sold the last few years. We both know SSD's have typically not had anywhere near the write speeds you mention.

      How expensive are they? What are their capacities? The poster I replied to was talking like they were the ultimate solution and could make up for the lack of ZFS alone. It isn't true.

      So try mentioning prices and model numbers. The commodity SSD stuff out there, admittedly the last time I was interested enough to check, was not suitable for a datacenter. Anything coming close to doing so was very expensive and gave you capacity far less than SATA.

      Sorry, the FACT that SSD has had write performance problems, wear leveling, and write endurance issues is by no means 10 year old information. It's 2-3 years old at best, and has not changed with respect to the commodity hardware out there.

    32. Re:With SSDs, who needs it? by BitZtream · · Score: 1

      And block level checksumming, and RAID5 with single and double parity, and mirroring, and compression, and sharing freespace between mount points.

      SSDs can be used as read only cache in a zpool to speed up random access.

      While you're sitting there crying about the no mechanical failures you had, but with a corrupted drive because of a controller failure on the drive, I'll just replace the drive and move on ... with my snapshots too.

      And just for reference:

      http://www.google.com/search?hl=en&source=hp&q=zfs+encryption&aq=0&oq=zfs+encr&aqi=g5g-m3

      Its got encryption.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    33. Re:With SSDs, who needs it? by MartinSchou · · Score: 3, Informative

      How expensive are they?

      If you're looking at hundreds of thousands of writes a day to your database, you really only need somewhere between 10 and 100 IO/second (there are 86,400 seconds in a day). Most hard drives handle that somewhat decently, especially if you use a good RAID configuration.

      Looking at 100,000,000 updates a day (1,158 writes/second)? Intel's X25-M is rated at more than 4 times that

      Iometer* Queue Depth 32
      Random 4 KB Write:
      80 GB - Up to 6.6 K IOPS
      160 GB - Up to 8.6 K IOPS

      Let's compare that to a 15k.2 Seagate Savvio harddrive. Oh, right, they don't list their IOPS ratings. Let's look at what they do have though:

      Not including controller overhead (msec):
      Single track, typical: 0.2 (read) 0.42 (write)
      Average, typical: 2.9 (read) 3.3 (write)

      Intel lists these figures:

      Latency Specification:
      - Read: 65 micro seconds
      - Write: 85 micro seconds

      In other words, for a single track, the Intel drive will be almost 5 times as quick to start the write, and on average the Intel drive will be 38 times faster.

      Or looking at it in another way, the absolute best case scenario where we simply ignore actually writing something, the Seagate drive can achieve 205,714,286 write operations per day (86,400 seconds/0.42 milliseconds). The Intel drive will hit 1.016.470.588.

      While I can't find anyone benchmarking Intel's SSD offerings directly against the Savvio, I can find a mix of tests. From Tom's Hardware we see that SAS drives tops out at about 400 IOPS for any given task.

      Using Tom's Hardware for a comparison, their review of the X25-M had it bottoming out at around 900 IPOS, making it perform 225% better at its worst, compared to the SAS drive's best.

      Prices:
      Newegg.com doesn't have the Savvio, so I'm using Google instead:
      Seagate Savvio 15k.2 146 GB edition: US$ 226.44 or US$1.55/GB
      Intel X25-M 160 GB edition: US$ 439 or US$ 2.74/GB

      Considering the performance advantage of at least 225%, you'd have to spend at least US$ 509.49 just to get the same kind of performance as you'd get from the US$ 439 drive from Intel. And that's just their mainstream edition. AND we're talking SSD's worst case scenario vs. SAS's best case scenario. Realistically we're talking much greater advantages for the SSD.

      And you keep talking about "commodity SSDs" but refer to datacenters. A commodity harddrive is a 7.200 RPM 8 MB SATA drive, and they aren't suitable for a datacenter either. Duh! So why the fixation of comparing commodity hardware from one technology to enterprise hardware from another? Stop buying commodity hardware for your datacenter needs.

      Sorry, the FACT that SSD has had write performance problems, wear leveling, and write endurance issues is by no means 10 year old information.

      And yet you haven't caught on to the fact, that this isn't that big of a problem. Anandtech wrote an excellent paper on write performance problems, and his benchmarks are based on used drives (the drive has to perform deletes before writing), and he got these performances:

      4KB Random Write Speed
      Intel X25-E 31.7 MB/s
      Intel X25-M 23.1 MB/s
      Western Digital VelociRaptor 1.63 MB/s

      The VelociRaptor i

    34. Re:With SSDs, who needs it? by jipn4 · · Score: 1

      CRT blanking is a very good thing, because it eliminates sample and hold blur.

      No, it does not. The phosphors on CRTs have persistence that is matched to the retrace interval. The effect is similar to sample-and-hold but reduced slightly, at the cost of lower display brightness.

      In theory, you could build LCDs that fade exactly like CRTs. People don't because the extra brightness you get from sample and hold for static scenes is far more important than any slight increase in motion blur relative to CRTs.

    35. Re:With SSDs, who needs it? by jipn4 · · Score: 1

      People don't because

      Turns out, recently, you have been able to get such LCDs:

      http://www.hometheatermag.com/gearworks/707gear/

      So, if you want to, you can get an LCD that flashes the image and then turns dark until the next frame.

    36. Re:With SSDs, who needs it? by Mprx · · Score: 1

      CRT phosphors fade with exponential decay, tuned for very fast decay. This means that very faint ghosting is visible, but it's not enough to cause perceptible sample and hold blur. The bulk of the decay is finished in microseconds. Ghosting would be completely intolerable if slow phosphors were used.

      Just flickering the backlight is not enough to imitate a CRT, because it would require buffering the whole frame instead of displaying it line by line, increasing latency. The correct method is to use a grid of LEDs, sweeping the lit part in time with the current line. This also allows for much less ugly dynamic contrast.

    37. Re:With SSDs, who needs it? by jipn4 · · Score: 1

      CRT phosphors fade with exponential decay,

      Yup, they have to.

      Ghosting would be completely intolerable if slow phosphors were used.

      It's not quite that simple. Older TVs had much slower decay times and did have some ghosting. That has slowly improved over time.

      Just flickering the backlight is not enough to imitate a CRT, because it would require buffering the whole frame instead of displaying it line by line

      Yet, that's just what many recent LCDs do.

      The correct method is to use a grid of LEDs,

      There is no "correct" method; it's all tradeoffs. Using a "grid of LEDs" is much more expensive for something most people probably don't even notice.

      Do you use a regular LCD? A CRT? An LCD with fancy illumination? And HDR LCD? I don't. I still use a four year old plain old LCD because it's good enough.

    38. Re:With SSDs, who needs it? by Anonymous Coward · · Score: 1, Insightful

      Your discussion about SAS, SSD, SATA notwithstanding, your dig on fibre channel makes no sense. You say that FC is dead, but offer no alternative architectures that provide what FC provides, such as multi-host connectivity, storage sharing among multiple hosts, storage mirroring over distance and replication.

      Dedicating 20TB of SAS, SSD, SATA, etc. to every host is simply wasteful, both from a cost, and a real capacity standpoint.

      Are you saying that it will all be replaced by file servers? That doesn't make any sense either, as file servers can't compete with the storage throughput that you mentioned.

      FC will be around. FCoE isn't even a reality, let alone a viable solution today. 10GE ports are coming down, but are very expensive as well. Can your system get any work done when dealing with 6.6 million (10ge/1500bytes per packet) interrupts per second? This limits 10GE significantly without expensive and complex HBA adapters.

      The new technologies you mention may combine into really high-performance solutions. However, I don't expect those technologies to combine for every server in a 1000 server data data center.

    39. Re:With SSDs, who needs it? by Mprx · · Score: 1

      I recently switched from a CRT to a 120Hz LCD with steady fluorescent backlight. Motion quality is slightly worse (although much better than any 60Hz LCD), but the other advantages of LCD make up for it.

    40. Re:With SSDs, who needs it? by symbolset · · Score: 1

      Your discussion about SAS, SSD, SATA notwithstanding, your dig on fibre channel makes no sense. You say that FC is dead, but offer no alternative architectures that provide what FC provides, such as multi-host connectivity, storage sharing among multiple hosts, storage mirroring over distance and replication.

      The last link in my post goes to the product page for a SAS array that offers all these things.

      --
      Help stamp out iliturcy.
    41. Re:With SSDs, who needs it? by Anonymous Coward · · Score: 0

      Except SSDs don't actually perform anywhere near either their specs or some micro benchmarks.

      They degrade significantly under mixed read/write loads and they degrade even more once they fill up.

      If you use SSD in a e.g. ZIL, if you have lot's of writes (meaning that your write journal is always at or near capacity) you will be lucky to get a tenth of the stated performance from most SSDs.

    42. Re:With SSDs, who needs it? by MartinSchou · · Score: 1

      If you use SSD in a e.g. ZIL, if you have lot's of writes (meaning that your write journal is always at or near capacity) you will be lucky to get a tenth of the stated performance from most SSDs.

      And why would you want to use most types of SSDs in an enterprise solution?

      Most cars would be hopelessly useless in a Formula 1 race. Obviously there is absolutely no point in even having those kinds of races, as the useless cars to useful cars ratio for Formula 1 is several hundred million to one.

      Hint: Don't use crappy products and expect stellar performance.

    43. Re:With SSDs, who needs it? by MrNemesis · · Score: 1

      We use a cluster of HP LeftHand appliances at work which does all those things without FC; the discs are 7k SATA and some 10k SAS and everything goes over 10Gb iSCSI, which is shared between two HP blade centres, each holding ten nodes of dual Xeon 5500 and 96GB RAM, connected via a pair of Cisco Nexus switches. Performance is limited somewhat by the fact that some mope overruled me speccing the LeftHand's with a primary 10Gb interface and secondary bonded 2x1Gb interfaces but the cluster will still easily do 600MB/s and ~2000 IOPS which is more than enough for our 300 or so VM's (and we've still got kit dedicated to dev and testing at the moment). The LeftHand's mirror the data to our other data centre synchronously, and VMware lets us do quick migration between sites to maintain loads (and we can run everything from a single site without a hitch).

      I had my doubts over iSCSI as well, and it did take alot more hand-holding than my old beloved 2Gb fibre from our EMC Celerra to get it to decent performance (mostly due to Broadcom's crappy NIC not supporting 9k jumbo frames) but iSCSI is a good way to do high performance storage for considerably less than FC. We're mulling testing FCoE on the same hardware to avoid iSCSI/network misconfiguration pitfalls but we're perfectly happy with it for now.

      Not disagreeing with you saying that FC isn't dead (I still think it's great where you can afford it, and EMC quoted us a fantastic deal on a CX4 & Brocade 4 and 8Gb switches - just the LeftHand solution gave us 150% as much storage for the same price, and all our VMware licensing thrown in. Recessions are great for getting a good deal.

      --
      Moderation Total: -1 Troll, +3 Goat
  7. Please mod this up by causality · · Score: 3, Funny

    THIS is an example of what deserves to get a "+1, Funny" mod, not the ten thousandth retelling of an "in Soviet Russia" joke or some other tired meme.

    Of course, there's also no better way to prove his point than to get offended by it.

    --
    It is a miracle that curiosity survives formal education. - Einstein
    1. Re:Please mod this up by Anonymous Coward · · Score: 0

      Aggressive sarcasm is nice and appropriate in this case, but no, it isn't funny.

    2. Re:Please mod this up by Anonymous Coward · · Score: 1, Funny

      Yeah, well.. in soviet russia the anonymous cowards think you're Funny.

    3. Re:Please mod this up by Sulphur · · Score: 0, Redundant

      Sorry about that.

    4. Re:Please mod this up by Anonymous Coward · · Score: 0

      in Soviet Russia, +1 funny mods you.

    5. Re:Please mod this up by DaVince21 · · Score: 1

      What if someone makes a really good "in Soviet Russia" joke?

      --
      I am not devoid of humor.
  8. Another nextgen FS on the way? Hmmm. by Lemming+Mark · · Score: 4, Insightful

    Interesting - we're chugging happily along in Linux / Windows / Mac / Unix land having a load of competing filesystems where all the popular ones have *roughly* similar capabilities. Then ZFS appears in OpenSolaris and filesystem design becomes cool again. Everyone starts either porting ZFS or making filesystems with similar features ... Now a major player that actually *had* ported ZFS (somewhat) is seemingly deciding to go it alone. It seems as though the next-gen filesystem space is also going to have a variety of competing filesystems.

    I generally think this is a good thing, lets just hope that a reasonable degree of interoperability becomes possible anyway.

  9. Yeah - so unlike Microsoft... by Anonymous Coward · · Score: 2, Funny

    ...who don't even *have* a next-generation filesystem project to cancel.

    (see - I can troll, too!)

    1. Re:Yeah - so unlike Microsoft... by BoneFlower · · Score: 3, Insightful

      Well, technically, they do, I don't think WinFS has been nuked yet.

      It might as well be. Better odds of seeing Duke Nukem Forever.

    2. Re:Yeah - so unlike Microsoft... by dangitman · · Score: 1

      I don't think WinFS has been nuked yet.

      No, the Windows Failure System is still going strong.

      --
      ... and then they built the supercollider.
  10. This is devastating... by mysidia · · Score: 5, Funny

    Hearing that ZFS support was upcoming in Snowleopard is one of the things that encouraged me to switch my desktop from Windows XP to MacOS.

    It is an understatement to say i'm disappointed to see Apple abandoning this.

    Support for ZFS is not just a little feature checkbox, it's a major component of the OS.

    It'd be like if Microsoft dropped/cancelled support for Solitaire from Windows....

    1. Re:This is devastating... by je+ne+sais+quoi · · Score: 1

      I know you're only joking, but I'm actually using zfs on a sun cluster right now... whatever technical merits it might possess are lost on me because when I type in "df -h" and it doesn't report anything meaningful -- it always shows 2 GB free however much of my 1 TB disk quota I happen to be using. To get meaningful disk usage, you have to type in "df -h .". While it's certainly trivial to do that, I find that having to directly specify the directory in order to get meaningful disk usage data is just weird.

      My experience with zfs has been tepid at best, it's not terrible. I won't miss not having it though.

      --
      Gentlemen! You can't fight in here, this is the war room!
    2. Re:This is devastating... by gomek-ramek · · Score: 2, Funny

      It would have been like Microsoft dropping WinFS for Vista, right?

    3. Re:This is devastating... by Anonymous Coward · · Score: 0

      Try zfs list.

    4. Re:This is devastating... by Anonymous Coward · · Score: 0

      Nah, we knew WinFS was a joke.

    5. Re:This is devastating... by mysidia · · Score: 2, Informative

      Because 'df' shows mounted filesystems in the more traditional physical fashion. It's best to inspect dataset properties to see their status

      zfs get available pool/path/to/dataset

      zfs get all pool/path/to/dataset | grep used

      zfs list

      Another thing that can throw you off, if you have compression enabled (lzjb) and do dd if=/dev/zero of=blah.txt

      And ^C it later... you can have a 50gb file using 0 bytes on disk

      du -m blah.txt

      Will show 0 bytes, but ls -l blah.txt will show its logical size.

      It drives people unaware of zfs compression nuts.

      Yes, there's a learning curve to some of the things in zfs... but it's all so totally worth it.

      There are some things that are harder in zfs than otherwise. Most things are a hell of a lot easier, especially volume management with pools VS traditional volume managers.

    6. Re:This is devastating... by je+ne+sais+quoi · · Score: 1

      but it's all so totally worth it.

      What is all so totally worth it? I haven't seen any advantages of zfs over hfsplus. You say:

      Most things are a hell of a lot easier, especially volume management with pools VS traditional volume managers.

      Great, so my IT administrator has his life made easier but my, the user's, life is made harder? Thanks, but no thanks. I want ease of use, I have seen nothing in zfs that delivers that. For what it's worth, I tried the zfs commands you suggested but there aren't any of those available in my path, and my cluster was built and configured by Sun itself. Fuck that shit... I'll take hfsplus with all it's possible btree corruptions over zfs any day.

      --
      Gentlemen! You can't fight in here, this is the war room!
    7. Re:This is devastating... by mysidia · · Score: 5, Informative

      I tried the zfs commands you suggested but there aren't any of those available in my path,

      The two programs used to work with zfs are 'zfs' and 'zpool'. Both of them are normally located in /usr/sbin

      If your PATH is broken so you can't easily access the tools, it doesn't matter what filesystem you're using, you'll have a bad time. I would suggest adding /usr/sbin to your PATH if it's not, or else use "/usr/sbin/zfs list" etc.

      the user's, life is made harder?

      The user's life is not made harder. It's no harder to learn "Zfs list" than to learn "df"

      What is all so totally worth it? I haven't seen any advantages of zfs over hfsplus.

      Copy on write filesystem, performance is excellent..

      Unlimited impact snapshots which have no I/O performance impact, and has the ability to rollback to most recent snap, clone snapshot, etc; makes backup, replication type tasks easy. The ability to implement transactional unbreakable system upgrades, ala apt-clone.

      RaidZ, to protect against drive failure

      Ditto blocks and checksums to ensure data integrity, protect against silent data corruption, heal bad disk blocks.

      No need to 'fsck'

      No need to decide the size of each file system at creation time, 'quotas' are soft and can be changed, instead of having to re-format/fdisk to change sizes of a dataset.

      No need to manage individual disks. No limits on number of disks imposed by the filesystem layers.

      No arbitrary limits in zfs. ZFS can scale to (in theory) 256 quadrillion zettabytes. Other filesystems have a max file size limit, and a max filesystem size limit.

      Sharing a folder is a simple invokation of a "share" command.

    8. Re:This is devastating... by Anonymous Coward · · Score: 0

      Hearing that ZFS support was upcoming in Snowleopard is one of the things that encouraged me to switch my desktop from Windows XP to MacOS.

      It is an understatement to say i'm disappointed to see Apple abandoning this.

      Support for ZFS is not just a little feature checkbox, it's a major component of the OS.

      It'd be like if Microsoft dropped/cancelled support for Solitaire from Windows....

      Actually, it would be like Microsoft dropped support of WinFS from Vista. Which they got, and still gets, a ton of grief for. It is interesting that Apple can repeat exactly what MS did, with almost no negative reaction at all in comparison.

    9. Re:This is devastating... by jipn4 · · Score: 1

      No need to manage individual disks.

      Managing disks is hard and complicated; when you add and remove them, there are complicated decisions to be made. The choices ZFS makes by default are wrong for me and probably for most desktop users, and getting it to do the right thing is hard.

      Sharing a folder is a simple invokation of a "share" command.

      Sharing is hard and complicated because it involves security, users, name spaces, and networking. If there's a "simple command" to do it, that tells me that ZFS isn't doing it right.

      No need to decide the size of each file system at creation time

      Translation: ZFS takes over the whole disk; it misuses the term "file system" to mean some internal construct that is meaningless to the rest of the world. Another strike against it.

    10. Re:This is devastating... by Anonymous Coward · · Score: 0

      Managing disks is hard and complicated; when you add and remove them, there are complicated decisions to be made. The choices ZFS makes by default are wrong for me and probably for most desktop users, and getting it to do the right thing is hard.

      What "choices" are you referring to and how are they "wrong"?

      Sharing is hard and complicated because it involves security, users, name spaces, and networking. If there's a "simple command" to do it, that tells me that ZFS isn't doing it right.

      In other words, you have no clue how it works, so you base your criticism on the perception that if it is simple therefore it must be inadequate. You don't know but you feel that you have license to run your mouth like a jibbering buffoon.

      Translation: ZFS takes over the whole disk; it misuses the term "file system" to mean some internal construct that is meaningless to the rest of the world. Another strike against it.

      Another wrong statement from an idiot who doesn't have a clue.

      ZFS can be used on a partition or the whole disk (preferred).

      I love it when imbeciles who don't know a damned thing about a particular topic deem themselves worthy and credibly sources of information on that topic.

    11. Re:This is devastating... by TheRaven64 · · Score: 2, Funny

      Why do you need WinFS? OFS that came with Cairo already did everything you might need...

      --
      I am TheRaven on Soylent News
    12. Re:This is devastating... by mysidia · · Score: 1

      Translation: ZFS takes over the whole disk; it misuses the term "file system" to mean some internal construct that is meaningless to the rest of the world. Another strike against it.

      That above translation is basically nonsense. ZFS does work better when it is managing entire disks, that's how it's meant to be used. I can't quite see how you're claiming the ability to re-allocate space between disk labels is a disadvantage.

      The number of times are beyond count, where i've seen systems run out of space on /usr, when there was _massive_ free space, the only problem was it was all in /var. Humans suck at planning ahead.

      ZFS is built on the same concepts used by computers to manage RAM. "Volume managers" (such as LVM) were a major hack. ZFS by comparison is a highly elegant solution.

      Managing disks is hard and complicated;

      Why do you say that?

      Of course you can do the complicated things with ZFS, such as setting up multiple disk slices and running zfs on a slice but you don't need to, and there are good reasons not to.

      Your thinking of proper volume management is probably quite wrong if you want to 'split up' disks. It really is a lot better to just use one or two pools, and manage only entire disks.

      Sharing is hard and complicated because it involves security, users, name spaces, and networking. If there's a "simple command" to do it, that tells me that ZFS isn't doing it right.

      You can of course setup all those things, but you don't have to. There are a lot of ways to implement security which don't require you implement share level security. In most NAS environments, physical isolation is the preferred method of security

      You can do such things as

      zfs set shareiscsi=on pool1/zvol1

      zfs set sharenfs=on pool1/folder1

      This does not preclude you from having setup portals, iniators, and access lists in your iscsitadm, or in OpenSolaris, COMSTAR.

      And the original share command is still available, i.e.

      share -F nfs -o ro=@172.16.0.0/24 pool1/folder1

      Before ZFS, you had to generally manually edit a file, and restart your NFS services, if you wanted to share something.

  11. Re:Not surprised. by larry+bagina · · Score: 3, Funny

    No shit. I can't wait to switch to Windows 7 with the totally awesome WinFS.

    --
    Do you even lift?

    These aren't the 'roids you're looking for.

  12. Too bad, ZFS has some nice features by mbessey · · Score: 3, Interesting

    Leaving aside all the crazy storage pool stuff (great for servers, not necessarily that useful for desktops), there are some interesting features in ZFS that I hope make their way into Mac OS X in some filesystem.

    Snapshots and Copy-On-Write filesystem clones seem like a great way to improve the Time Machine backup feature, and would make it easy for applications to provide backup-on-save very efficiently.

    The compression and encryption features would likely be useful for some people. I don't think the increased filesystem limits (number of files, size of files) would matter for most folks.

  13. You've... by Anonymous Coward · · Score: 0

    ...played too much Planescape?

    When I see Github I think two things:

    - Githyanki

    - Github for Lesbians! (Thanks, xkcd)

    1. Re:You've... by Tolkien · · Score: 1

      I've never played Planescape.

  14. Maybe they should look at HAMMER FS by Lemming+Mark · · Score: 2, Informative

    http://en.wikipedia.org/wiki/HAMMER

    Should be under a suitable license for their usage. It's written for DragonflyBSD which has a funny filesystem driver interface but AIUI the developer had ports to other OSes in mind, so it should still be doable. It can do cheap filesystem snapshots so it would support Time Machine-style operation well. The question is whether it could be adapted to fit Apple's uses well enough. Given one of the linked articles suggests Apple are hiring FS developers my guess would be that they've decided they'd rather build a ground-up filesystem that supports all the (slightly odd set of) features MacOS X wants.

    1. Re:Maybe they should look at HAMMER FS by Renderer+of+Evil · · Score: 5, Funny

      Steve Jobs commented on HAMMER FS inclusion in 10.7 during WWDC 2009. He said "due to legal and technical constraints we can't touch that"

    2. Re:Maybe they should look at HAMMER FS by Lemming+Mark · · Score: 1

      Steve Jobs commented on HAMMER FS inclusion in 10.7 during WWDC 2009. He said "due to legal and technical constraints we can't touch that"

      Really? I'm somewhat surprised and impressed that somebody thought to ask him! Do you have a reference for that at all? Or do should I go watch the keynote? I'd be interested to see the context (and for that matter to know who thought to put the question).

      The legal constraints can't be a license issue but perhaps they're worried about some particular patents. Hard to imagine that they could come up with next gen FS features, even if they chose a different implementation, which didn't potentially infringe *some* patents (as Sun and NetApp are also learning / demonstrating). Maybe there was something particular about HAMMER that tickled the patent lawyers in a way they didn't like.

      The technical constraints claim sounds a bit more vague. Dragonfly's filesystem driver API is quite different to other OS structures AIUI; I had heard that the code was designed with a nod towards porting to other systems, though. Maybe it just doesn't do what they want.

    3. Re:Maybe they should look at HAMMER FS by saleenS281 · · Score: 1

      It was a joke... MC Hammer... "You can't touch this"...

    4. Re:Maybe they should look at HAMMER FS by nxtw · · Score: 4, Funny

      Thanks for breaking it down. Too bad Apple had to stop HAMMER time.

    5. Re:Maybe they should look at HAMMER FS by mmkkbb · · Score: 1
      --
      -mkb
    6. Re:Maybe they should look at HAMMER FS by Lemming+Mark · · Score: 2, Insightful

      OMG I fail so hard!

    7. Re:Maybe they should look at HAMMER FS by Lemming+Mark · · Score: 1

      OK, this is scary. Two people have politely explained how I didn't get the joke (which I completely missed). Nobody has posted a "woosh". What has happened to the real Slashdot!?

      (thanks, by the way)

    8. Re:Maybe they should look at HAMMER FS by syousef · · Score: 1

      I can't believe it's not btrfs.

      --
      These posts express my own personal views, not those of my employer
    9. Re:Maybe they should look at HAMMER FS by Junior+J.+Junior+III · · Score: 1

      HAMMER FS... instead of a Permission Denied error when you don't have rights to a file, you get a U Can't Touch This error.

      --
      You see? You see? Your stupid minds! Stupid! Stupid!
    10. Re:Maybe they should look at HAMMER FS by mister_playboy · · Score: 1

      Whoooosh!

      --
      Do what thou wilt shall be the whole of the Law ::: Love is the law, love under will
    11. Re:Maybe they should look at HAMMER FS by BitZtream · · Score: 1

      You realize that DragonflyBSD is just an older FreeBSD with a different installer for all intents and purposes, right? Not exactly a funny FS interface considering its shared with 4 other OSes, one of which is dead.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    12. Re:Maybe they should look at HAMMER FS by Renegade88 · · Score: 1

      You do realize you're a complete idiot, right?

      What an ignorant thing to say. Dragonfly BSD split from FreeBSD 4.8 more than 5 years ago and it has evolved far on its own.

      Enough so that backporting HAMMER to FreeBSD is not trivial (if even possible) due to architectural differences.

      Stop spreading BS about a good project.

    13. Re:Maybe they should look at HAMMER FS by Renegade88 · · Score: 1

      Sorry, the idiot blast wasn't warranted.

      However, HAMMER is not a drop-in replacement FS. I understand it requires specific functionality of the Dragonfly kernel to work. Porting to other OS's, even other BSDs, will be difficult although apparently some people are trying.

    14. Re:Maybe they should look at HAMMER FS by Anonymous Coward · · Score: 0

      I see you heard of DragonflyBSD. But you obviously never bothered to even look at their website.

    15. Re:Maybe they should look at HAMMER FS by Lemming+Mark · · Score: 1

      Thanks, now I feel more at home ;-)

    16. Re:Maybe they should look at HAMMER FS by Lemming+Mark · · Score: 1

      It's a fork of FreeBSD 4.x on which they've spent years refactoring the kernel (and updating the userland, come to that). The VFS interface has had a lot of refactoring so that they can pull tricks other OSes aren't well suited for. As such it's now, as I understand it, really quite different from the norm and certainly not shared with the other BSDs.

    17. Re:Maybe they should look at HAMMER FS by Lemming+Mark · · Score: 1

      There was a GSOC project to port it to Linux, don't know how far that got. Matt Dillon has said, I think, that he separated most Dfly-specific interfacing out reasonably cleanly when he was writing the filesystem in the first place.

    18. Re:Maybe they should look at HAMMER FS by TheRaven64 · · Score: 1

      HAMMER is totally unsuitable for a desktop. It makes some decisions, like 8MB blocks and the delete semantics, that are great for clusters but would be horrendous on a laptop or desktop.

      --
      I am TheRaven on Soylent News
    19. Re:Maybe they should look at HAMMER FS by TheRaven64 · · Score: 1

      Replying to a person calling you an idiot by following up one incorrect statement with another is not a good idea. HAMMER was written to be portable, and Matt Dillon wrote some documentation on how to port it, which you can find on the DragonFly site.

      --
      I am TheRaven on Soylent News
  15. Re:Another nextgen FS on the way? Hmmm. by trentblase · · Score: 1

    Luckily, networking and filesharing systems are robust enough to make interoperability a minor concern these days. It's not like we're exchanging zfs floppies.

  16. It's not just a filesystem by fnj · · Score: 1

    Yes, I realize it contains the letters "FS", but ZFS is not just a filesystem. It incorporates a lot more than that. That's one of the reasons it's really hard to integrate into an OS, given the architecture of most OS's.

    1. Re:It's not just a filesystem by Lemming+Mark · · Score: 1

      True, although a lot of the characteristics I find particularly interesting about it relate to the filesystem layer. Various of the "competitors" are incorporating functions that are also (to some extent) outside the normal remit of the filesystem. Btrfs in particular, however its volume management and RAID-ing functionality is not used outside of that filesystem. Whereas I believe ZFS can subsume most storage management, although AFAIK only Solaris really takes this idea to its logical conclusion. ZFS has been ported to BSD already though and AFAIK they didn't need to replace their whole storage stack, so it can be done.

      The thing that I thought was particularly interesting was that, for a while, it looked like everyone (except Linux and Windowsfor various reasons) was agreeing on ZFS as *the* next-gen filesystem. If Apple is now going in another direction too then that appears to no longer be the case - the next gen filesystem world is going to be as varied / competitive / cluttered / confusing / interesting (delete as appopriate) as our existing filesystem "market" is.

    2. Re:It's not just a filesystem by TheRaven64 · · Score: 1

      On FreeBSD, ZFS slots into GEOM, which is a modular architecture connecting providers and consumers of various filesystem-related services. You can use ZFS with a (slightly modified) ZPL and get the same top-to-bottom ZFS stack that you use on Solaris. Or you can put some other GEOM providers underneath the ZFS stack, so you are using ZFS, for example, on an encrypted file that is connected to a vnode on an existing filesystem (you probably wouldn't want to do this, but you can) or even to remote iSCSI targets or anything else that can look like a block device in FreeBSD. Similarly, you can put any filesystem that FreeBSD supports into a ZVOL, so you are using the middle and bottom layers of ZFS. You could use this, for example, for an ext2 volume that you create and mount locally, then export a clone of over iSCSI and let Linux workstations use it. Each of your Linux machines gets something that looks like an ext2 disk mounted over iSCSI and your FreeBSD server can clone and snapshot them, and is using copy-on-write from the original to save space.

      --
      I am TheRaven on Soylent News
  17. Correction by toby · · Score: 4, Informative

    A lot of confusion has resulted from labelling ZFS a "filesystem". It actually combines both volume management and filesystem layers to achieve unique levels of performance, manageability, and data protection. Merits close study, as the concepts of ZFS overtake current best practices, conventional filesystems and RAID. You can get this taste of the future today, if you're using Solaris 10/OpenSolaris/FreeBSD.

    --
    you had me at #!
    1. Re:Correction by melikamp · · Score: 2, Insightful

      Merits close study, as the concepts of ZFS overtake current best practices

      That is, assuming that having the file system and the volume manager tied to each other is a good thing. I think I can come up with a bunch of reasons for why this is a pretty terrible idea and why modularity here is a good thing.

    2. Re:Correction by balbeir · · Score: 2, Informative

      AIX has had a similar "filesystem" for a long time BTW so it's not such a novel idea

    3. Re:Correction by SanityInAnarchy · · Score: 4, Insightful

      Modularity is a good thing, if you draw the modules in the correct place. And ZFS is indeed modular...

      Take all of this with a grain of salt, as I haven't actually used ZFS, only designed something similar, then found ZFS did it already, then decided I didn't care and used Linux anyway.

      My understanding is that there's a storage layer, where you can simply request storage for some purpose, and it gives you that storage with an id -- kind of like an inode. You could build a filesystem on top of that, managing all the metadata yourself. Or you could build something else -- a database, for example. And the filesystem layer still handles all kinds of things, like permissions, directories, etc, it's just that the allocation has been separated out.

      Thus, the allocation layer can make smart decisions about things like which disk to allocate something on, or what actually needs to be replicated, etc.

      For example: Think about any kind of RAID, even striping. If RAID can only work with whole volumes, that means the entire discs have to be synced (in RAID1) or checksummed/paritied (in RAID5), including free space. In ZFS, not only can you avoid replicating free space, but I believe you could also specify which files are important and which ones aren't -- and only the important ones are replicated, thus saving space on the ones which aren't.

      Another, more theoretical example: SSDs are a bunch of hacks on top of hacks. See, erasing and then writing to the same flash cell over and over wears it out, and there's no seek time. Largely because of Windows, I would guess, SSDs these days implement wear-leveling in the firmware, so that the OS sees only a logical disk that pretends to be a hard drive. But this means they always have to keep a number of cells unallocated, and it slows down writes to have to erase each cell before writing.

      So, someone came up with the ATA TRIM command, where the OS could tell the SSD which blocks are no longer in use, and the SSD can actually erase them.

      Compare this to the old solution -- implement wear-leveling in software. There were a few filesystems written to run directly on the flash, and it was actually the filesystem doing the wear-leveling. This meant the filesystem could intelligently spread new writes over free space, instead of having to keep some arbitrary number of blocks in reserve...

      This is getting fairly technical, and also boring, as ultimately, it's not that much of a difference. But this just shows the potential modularity of a system like ZFS. See, if ZFS separates out the allocation, that means you could replace that part without touching the filesystem, database, or anything else. And you could probably replace it with something that knows how to deal directly with a flash device -- something which, for example, erases blocks as ZFS snapshots are deleted.

      --
      Don't thank God, thank a doctor!
    4. Re:Correction by BitZtream · · Score: 5, Informative

      Warning: I have become a ZFS fanboy, my statements may not be entirely rational.

      Use ZFS for a week on something like a file server, you'll be more than willing to ignore traditional Unix logic (which I firmly believe in) in order to use the goodness that is ZFS.

      I'll admit, I'm a ZFS fanboy now, and I've only used it on FBSD 7.2, which is using a much older version of ZFS (v6, current is 13 I think). In 7.2 its not considered production ready and its still awesome to work with for me.

      I shoved 4 PATA and 4 SATA drivers in a case, 2 gigs of ram (really the minimum for FBSD and ZFS on a 64 bit machine, which is where it sings). The 4 SATA drivers are in the zraid vdev, 2 of the PATA drives are in another mirrored vdev, and the final 2 in a second mirror vdev. So all the drives have redundancy and they are all in one big zpool with the total space available as one big chunk.

      Now thats all well and good, but heres where it gets awesome. Want more space? Add some drives, create a new vdev, add it too the pool, instant space available. Okay, so thats not that impressive in and of itself. I can also add in a SSD as a 'cache' drive, which the ZFS system will then populate with a read only copy of data that gets accessed often in a random way, for a speed increase for your random IO needs.

      Okay, so I've got a few terabytes of data available, but I need a to create a share for backup using TimeMachine on my Mac. Well time machine will be happy to consume all the space on the drive. No problem, create a new mount point in the zpool, limit it to 1TB. It will only consume up to 1TB, IF space is available in the zpool. I can also reserve the space if I want to ensure its there for the backups. You can use the same system for quotas of individual users.

      I also have a bunch of ISOs with uncompressed data on them that I mount from virtual machines for various reasons, full of essentially text data. Welp, for that create another mountpoint on the same zpool, turn on compression, now my 5TB of text gets compressed into a few hundred gigs automatically and transparently. Its read only, and very important. I have backups, but they are in another state and transfering them back would be a painfully slow process which would cost me a lot of time. So I set the mount point to read only and set copies=2. Now the mount point is read only, and the data is stored twice, on 2 different vdevs. So not only is the data on a raid or a mirror, its on BOTH. If I was really worried I could set copies=3 and it would be on all the vdevs, so as long as one is usable I have my data, assuming all the vdevs have enough space to store the data. One of them doesn't, so copies=2 is the only useful option to me.

      I also have a software archive of all my commercial windows software, I want to keep it safe from any sort of infection or modification, so I set that mount point readonly.

      So far, I've done nothing that can't be done already with existing methods, but what I've done it across a common shared data pool. Free space is shared across all of them.

      I thought ZFS was a waste of time until I started using it. I am by no means a ZFS master, but I've learned that it can do some pretty powerful things. My setup is small, I only use it at home until FBSD 8 is released, which will have what is considered to be a production ready implementation, but I will be moving to it at that point in our internal office servers.

      I know I haven't listed any life changing reasons to use it, but its turned me into a fanboy.

      Technically, it IS modular, even if it doesn't have well defined zones. If you look at ZFS in a slight different way, it can be just one layer of the system. You can create virtual devices in a zpool and treat them as a block device (its just another /dev entry). Just to see how it worked, I created a virtual device on top of the zpool, formatted it with UFS, put some files on it, expanded the virtual device, ran growfs and had a larger UFS mount point.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    5. Re:Correction by Guy+Harris · · Score: 1

      That is, assuming that having the file system and the volume manager tied to each other is a good thing. I think I can come up with a bunch of reasons for why this is a pretty terrible idea and why modularity here is a good thing.

      And some other people might disagree with your reasons.

    6. Re:Correction by melikamp · · Score: 1

      Heh, half of that rant is a trivial telescoping sum. He is using that as an illustration for why it's OK to ditch the stack in favor of the monolithic design. This makes absolutely no sense. It would be better if he cut the bullshit and just said "it's easy to deploy when you don't really understand how the storage works". I want to hear one good reason for the RAID layer to be glued to the POSIX layer in a way that you cannot replace one without replacing the other.

    7. Re:Correction by jipn4 · · Score: 1

      It actually combines both volume management and filesystem layers to achieve unique levels of performance, manageability, and data protection

      That's the theory. You can even concoct benchmarks. But there's not a shred of evidence that in real world scenarios it actually does this.

      Do you get paid by Sun for doing their marketing?

    8. Re:Correction by jabuzz · · Score: 1

      But it does not do quota's so that is not much use then in a real working environment. I can hardly build a SMB server to hand out profiles to a few thousand users if I cannot quota it.

      It is also not clustered, so I cannot deploy a high availability, high throughput clustered Samba solution using CTDB. This is sucking quite a bit more then.

      It has no notion of storage pool hierarchy, so I cannot mix 15kr pm SAS/FC with 7.2k rpm SATA and write policies to allocate different files to different disks, and move files between the disk types. Hum, it is now sucking quite a lot then.

      It also has no HSM, so actually pretty useless really, and I can go back to using IBM's GPFS which is a *vastly* superior file system.

    9. Re:Correction by Anonymous Coward · · Score: 0

      It does not do quota's what?

    10. Re:Correction by TheRaven64 · · Score: 4, Informative
      ZFS is modular, it just doesn't have layers in the same places at the conventional block device, filesystem, vfs layers.

      At the bottom layer, you have the pooled storage layer. This is comprised of several modules. The lowest layer is responsible for combining virtual devices into storage pools. This handles things like stripping and mirroring, but it does so with dynamically sized block ranges, rather than static ones (i.e. partitions). On top of this you have the transactional I/O layer. This handles things like checksums, encryption and compression, and provides support for transactions. Every disk access goes via this layer. That means that every single block device access from the upper layers gets transaction support, so you can guarantee that the block devices are always in a recoverable state; every group of low-level I/O operation either worked or failed, it never partially worked. Above this is the adaptive replacement cache, which handles caching and, with the L2ARC can also perform caching in Flash as well as RAM.

      On top of that, you have the transactional object layer. While the pooled storage layer works with a flat 128-bit address space, the transactional object layer works with objects and sets of objects. Any higher-level I/O is expressed in terms of transactions containing modifications to sets of objects. This is a very powerful abstraction. An object can be a complete filesystem, some metadata, or a file; there is no difference at this layer. Anything that you can do with one, you can do with any of the others. There are a few other things in this layer, like the ZFS intents log, which handles a higher-level (finer-grained) transactional model.

      On top of this is the user interface layer. There are two things here, the ZFS POSIX Layer (ZPL) and ZVOL. The former produces something that looks like a UNIX filesystem, with NFSv4 ACLs and a few other nice features. This is close to a filesystem in the traditional model, but also a bit like a VFS. It provides something that looks like UFS on top of lower-level features, but these are not on-disk structures. ZVOL is simpler; it provides something that looks like a block device. You can export this via iSCSI, for example, and put any kind of filesystem you want into it. Unlike a real block device, this one supports copy-on-write, snapshots, transactions, and so on. You can, for example, have a Windows VM (or real system) with a FAT or NTFS filesystem in a ZVOL mounted via iSCSI. You can snapshot it with the same O(1) snapshots that the rest of ZFS has, and then restore it later. You can also use zfs send and zfs receive to stream the changes across the network to another machine, irrespective of whether you're using ZPL or ZVOL + some filesystem. You can also use ZVOL for things like UDF images for burning, creating a skeleton image, cloning it, and using the native copy-on-write support to make small changes to it.

      --
      I am TheRaven on Soylent News
    11. Re:Correction by TheRaven64 · · Score: 3, Informative
      Depends on what you need from quotas. From the start, ZFS has allowed volumes with limits. That means that you can create a new volume for each user's home directory and give it a quota. It will then be allowed to grow until this limit is reached. Per use and per group quotas on volumes were only implemented in March, so they aren't available on older versions of ZFS.

      Not sure about clustering, but you can export ZVOLS via iSCSI, so if you wanted to distribute the load that way, you can.

      Your third point makes no sense. VDEVs can be combined in arbitrary ways, including hierarchically, in the pooled storage layer. Perhaps you are confusing storage pools with VDEVs. With the L2ARC, you can use faster disks (e.g. flash) as a cache for the slower ones.

      --
      I am TheRaven on Soylent News
    12. Re:Correction by melikamp · · Score: 1

      This is an impressive list of features :) Thanks.

    13. Re:Correction by TheRaven64 · · Score: 1

      If you'd like to read a bit more about ZFS, I'd recommend thispage on the OpenSolaris site and this article that I wrote a couple of years ago (somewhat out of date now; both of the limitations I listed have since been addressed). There are also some good presentations on how ZFS works linked to from the OpenSolaris docs. You will find a lot of criticisms of ZFS come from people who don't really understand how it works, or claim to need some esoteric feature that their current FS doesn't support either, but something like Veritas does.

      --
      I am TheRaven on Soylent News
    14. Re:Correction by Rich0 · · Score: 1

      There are a couple of optimizations that are possible when you cross layers. Sure, it could be done in a way that retains the ability to swap layers, but the individual layers would need to expose a LOT more information to each other about their implementations. It would be difficult to abstract as well.

      You asked for a good reason - here is an example:

      Suppose I want to modify a 10kb text file. Since ZFS uses copy-on-write it picks a new allocation unit on the disk to write to. Now, it could just pick any old empty area on the disk. However, instead it can find a stripe on the RAID that is completely empty, and fit that 10kb file in with another few MB of other writes and put them all in the same stripe. Then it can pick a stripe that happens to be near where the cache was recently flushed. Since the whole stripe is being written only a single disk write to each component drive is needed.

      Suppose you did the same thing with ext4 over lvm and md. Now the filesystem is going to overwrite the existing file in place. From the filesystem's perspective it isn't a big deal - either way we're overwriting one block with another. However, the filesystem doesn't realize that there is RAID underneath, so the md layer eventually gets a request to modify a few blocks in the middle of a stripe. The md layer of course does what it can to combine operations, but ext4 isn't doing anything to make this easier. Chances are that the whole stripe is going to get read (using all but one of the disks for raid 5), a small area inside will be modified, and then the stripe will get written again. While the stripe is being written the old stripe is being destroyed, so if anything goes wrong the previous contents of everything on that stripe will be lost - most of it EVEN if there is full data journaling at the ext4 layer (although the md layer could implement is own journal).

      By crossing layers you can minimize the amount of work the drives need to do, and at the same time provide a higher level of data security by avoiding overwrites whenever possible.

      Now, you could abstract these layers a bit more to make them more interchangeable, but the behavior of the filesystem is going to need to change based upon whether the underlying layer is striped or not, and of course that is already muddying the waters.

    15. Re:Correction by Anonymous Coward · · Score: 0

      Dude, ZFS sucks rocks. Even most dyed-in-the-wool Solaris shops won't touch it with a ten foot pole. Apple dodged themselves a bullet. And I say that as someone who's an admin with nearly 20 years experience at a shop with over 1500 Sun servers.

    16. Re:Correction by Anonymous Coward · · Score: 0

      It does not do quota's sir!

    17. Re:Correction by Hucko · · Score: 1

      So it isn't a filesystem it is a storagesystem?

      --
      Semi-automatic amateur armchair Australian philosopher; conjecture ready at any moment...
    18. Re:Correction by Anonymous Coward · · Score: 0

      ZFS: so good, its advocates are smugger than Mac users.

    19. Re:Correction by jcr · · Score: 1

      This situation kind of reminds me of when Apple dropped Display Postscript. At the time, I was very concerned that whatever they came up with for a replacement was going to be harder to use, offer less performance, etc. Turns out we did lose something in the DPS to Quartz transition, which was the ability to redirect the postscript commands to a remote host, but what we picked up in local display performance was more than worth it.

      My need for ZFS isn't immediate and urgent, so I'm content to see what that team at Apple develops before I shed any tears for ZFS.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
  18. Re:Another nextgen FS on the way? Hmmm. by newcastlejon · · Score: 1

    You make an excellent point: over distance the file-system is moot.

    Unfortunately when you're moving a terabyte or so from room/building to another you'll find yourself holding something that has to use the lowest common denominator.

    Worse still, it's Fucking Antiquated Trash.

    --
    If God forks the Universe every time you roll a die, he'd better have a damned good memory.
  19. You can still undevastate yourself by fnj · · Score: 2, Interesting

    I suggest you drop MacOS like a hot potato, send a nastygram to Apple giving them a piece of your mind, and check out both OpenSolaris and FreeBSD. They both support ZFS, OpenSolaris because Sun invented ZFS, and FreeBSD because they have competent management AND engineering. Unlike certain others (and I'm not pointing the finger at linux).

    Once again, FreeBSD has shown the fools in Cupertino how it's done.

    1. Re:You can still undevastate yourself by Anonymous Coward · · Score: 0

      I suggest you drop MacOS like a hot potato, send a nastygram to Apple giving them a piece of your mind, and check out both OpenSolaris and FreeBSD. They both support ZFS, OpenSolaris because Sun invented ZFS, and FreeBSD because they have competent management AND engineering. Unlike certain others (and I'm not pointing the finger at linux).

      Once again, FreeBSD has shown the fools in Cupertino how it's done.

      Whoever modded OP troll is a retard.

    2. Re:You can still undevastate yourself by exley · · Score: 1

      Once again, FreeBSD has shown the fools in Cupertino how it's done.

      Yeah, Steve is gonna cry himself to sleep on a huge pile of cash tonight.

      (Not sure if parent was a troll or totally serious... It's hard to tell around here sometimes!)

    3. Re:You can still undevastate yourself by Anonymous Coward · · Score: 0

      to slashdot welcome

  20. Too bad [FOR APPLE], ZFS has some nice features by fnj · · Score: 4, Insightful

    Too bad for Apple, not for ZFS. OpenSolaris and FreeBSD support ZFS just fine. I do think it's best suited to servers, and OpenSolaris and FreeBSD are greatly superior server operating systems anyway.

  21. Schwatz on the netapp lawsuit.. ala 2007 by aphaenogaster · · Score: 1

    You may want to check out SUNs ceo's comments on the netapp issues... This dates all the way back to 2007. From the comments above this appeared to be something new. http://blogs.sun.com/jonathan/entry/harvesting_from_a_troll

  22. Yes. by toby · · Score: 1

    I predicted that they were working on a ZFS-alike on 2 Sept. NIH Syndrome does seem the most likely explanation. Which is disappointing. Cooperation on ZFS seemed a natural and powerful cross-endorsement for both Apple and Sun.

    --
    you had me at #!
    1. Re:Yes. by jcr · · Score: 1, Insightful

      How can it be NIH syndrome when the people implementing the replacement are former Sun ZFS developers?

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    2. Re:Yes. by toby · · Score: 2, Interesting

      For the reason I stated: That using Sun's ZFS left them without control of development, and tracking an outside codebase has reputational risks to which Apple in particular is averse. Having ex-Sun people work on a new filesystem is great, but they still need to navigate the patent minefield that Sun has sown around ZFS.

      Interesting that Sun non-competes did not stop their engineers walking down the street to work on directly competitive technology... (First I heard that engineers left Sun for Apple, actually. I thought the ZFS team was quite small, and it is obvious from the list that the key people remain at Sun.)

      --
      you had me at #!
    3. Re:Yes. by Anonymous Coward · · Score: 0

      California law doesn't generally allow non-compete clauses except for senior management.

    4. Re:Yes. by Anonymous Coward · · Score: 0

      I predicted that they were working on a ZFS-alike on 2 Sept.
      NIH Syndrome does seem the most likely explanation. Which is disappointing. Cooperation on ZFS seemed a natural and powerful cross-endorsement for both Apple and Sun.

      Yes, and I predict that whenever Slashdot posts a ZFS article, you can be relied upon to make an entirely inane and ill-informed comment. Do I get a prize?

    5. Re:Yes. by jcr · · Score: 1

      That's not NIH syndrome you're describing. NIH is the practice of rejecting something regardless of its merits just because it's not an in-house project.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
  23. Re:Another nextgen FS on the way? Hmmm. by pseudonomous · · Score: 1

    Unless you want to dual boot and share /home; it's a royal pain in the ass between BSD / Linux / Solaris ; then your only real option is ext2. Add windows and it becomes very hard; you're pretty much down to using NTFS or fat32 and then doing hackery with the mount options and even THEN it only really works if you have one partition for each user who's going to have a $HOME shared between OSes. (And this is the only reason why I ONLY boot linux)

  24. another fucking wheel being made by Anonymous Coward · · Score: 0

    Upgrade to an SSD, and it hardly matters what crusty old filesystem you're using. You're still going to have far greater speed and no mechanical failures. As far as I can see, the only vaguely useful ZFS feature is snapshots... it doesn't even do encryption. I don't think this is a major loss.

    And how do you know the data you read off your disk is the same data you wrote to it? ZFS is the only production-ready file system that uses checksums to make sure your data is consistent and there hasn't been bit rot (and can fix bit rot if you have redundancy).

    ZFS is also able to shim in SSDs so that you can get the cheap capacity of SATAs, but the speed and latency of SSDs at the fraction of the price:

    http://blogs.sun.com/brendan/entry/hybrid_storage_pool_top_speeds

    Snapshots are awesome, especially when you can replicate them to a remote system over SSH:

    http://www.markround.com/archives/38-ZFS-Replication.html

    It's linear time finding changed blocks, and not like rsync where you have to stat() every single file on a file system. You can actually snapshot every five seconds, and do near real-time replication over an oceanic link (which one of the ZFS developers did between China and California).

    According to a recent talk by the head people of ZFS (Bonwick and Moore), crypto and de-dupe are expected to be committed by the end of this year. The crypto code has public patches available for code review.

    Trust me, it's a big loss. I'm sure the smart people at Apple will think of something good, but ZFS has had a lot of pounding on it for many years (e.g., CERN with a lot of their LHC testing), and starting from scratch means another fucking wheel being created.

  25. Does he know something nobody else knows? by argent · · Score: 1

    Re: That's true for any licensee - in fact, Net App could adopt ZFS today and receive the same protection. The port is done to FreeBSD, the OS on which Net App's filers are built.

    Last I checked NetApp was using some NetBSD-derived components in their Filer OS. I haven't heard that it's "based on FreeBSD".

    Is he mixing up NetApp with Apple?

    1. Re:Does he know something nobody else knows? by Anonymous Coward · · Score: 0

      Maybe you missed the point of the article, but a company called NetApp is suiing Sun over ZFS and patent claims. The speculation is that Apple is staying away from ZFS to avoid the same lawsuit.

    2. Re:Does he know something nobody else knows? by beardz · · Score: 1

      Perhaps you're confusing NetBSD with FreeBSD ?

      To quote, "Interestingly, our advanced ONTAP GX architecture is built on top of a full UNIX release. We took Data ONTAP, including WAFL and RAID, combined it with the new code from our Spinnaker acquisition, and hosted the combined result on FreeBSD in a combination of user processes and kernel modules. For security and simplicity we have disabled and hidden many parts of FreeBSD." : http://blogs.netapp.com/dave/2007/04/is_data_ontap_b.html

    3. Re:Does he know something nobody else knows? by Guy+Harris · · Score: 1

      Re: That's true for any licensee - in fact, Net App could adopt ZFS today and receive the same protection. The port is done to FreeBSD, the OS on which Net App's filers are built.

      Last I checked NetApp was using some NetBSD-derived components in their Filer OS.

      Check more recently, please.

      OK, to be fair, ONTAP Classic, while it has a fair bit of BSD code in it (some commands, the networking stack, etc.) isn't built on anything that matches "*BSD", so the person to whom you're replying is overstating the case. ONTAP GX, however, is FreeBSD-based.

    4. Re:Does he know something nobody else knows? by argent · · Score: 1

      No, I wasn't aware of their new product.

  26. Did ZFS ever support FIleIDs? by anarkhos · · Score: 1

    Hopefully, whatever Apple develops next will. It would really suck if the only persistent way to refer to a file was its path.

    --
    >80 column hard wrapped e-mail is not a sign of intelligent
    >life
    1. Re:Did ZFS ever support FIleIDs? by Ilgaz · · Score: 1

      I keep suspecting the lack of special, unique HFS+ features support or the technical or even political issues implementing them to a pure UNIX filesystem was preventing ZFS on OS X.

      Ever spoke with a nerd about HFS+, Resource Forks and even changeable icons on Finder with some weird Apple only flags? They say it is lame, I say "It is HOW Mac works!" and even "It is how they can sell NeXT/UNIX to people." They don't even understand why OS X comes with case insensitive HFS+ by default. For example, does ZFS support case insensitive filenames? Sounds lame but it is a must on OS X Pro desktops.

    2. Re:Did ZFS ever support FIleIDs? by Anonymous Coward · · Score: 1, Informative

      Case insensitivity support was specifically added to later editions of ZFS to help out Apple.

    3. Re:Did ZFS ever support FIleIDs? by Guy+Harris · · Score: 1

      Hopefully, whatever Apple develops next will. It would really suck if the only persistent way to refer to a file was its path.

      In Mac OS X, the only guaranteed persistent way to refer to a file is its path. Some file systems have persistent file IDs, but not all the file systems that Apple ships do. The main local file system does, but there ain't no such guarantees about, say, SMB or NFS.

    4. Re:Did ZFS ever support FIleIDs? by jabuzz · · Score: 1

      Does it support random shit in the file name?

      It seems to be a feature of MacOS users, but they do put the wackiest shit in their filenames. There is the whole putting a space at the start of the file name so it comes out top in finder shit, and I I thought I has seen it all with question marks, asterix's and back ticks.

      How wrong was I though, because they put newlines in the middle of a file name. You have got to be trying some to manage that one, and it was not random accident because I had thousands of the files like this.

  27. ZFS looks grand, but glad they did not do it now by herojig · · Score: 1

    At this point in life, HFS is working fine, and the drobo is quietly humming away. I'm glad snow leopard was relatively painless to upgrade too, and not sure this would have been the case if ZFS had been included in 10.6.

    --
    I think therefore I can't be ~TTNH
  28. Re:Another nextgen FS on the way? Hmmm. by Jesus_666 · · Score: 1

    We are, however, going to exchange SDXC cards. And those come with a next-gen filesystem. With extremely limited interoperability (read: none). If we had something better than FAT32 that actually worked on all OSes we could just ignore the specification and use that, even if it's something as overblown (for flash cards) as ZFS.

    It seems that FAT32 is still the apex of filesystem interoperability, closely followed by NTFS, courtesy of reverse-engineered drivers. That's kind of sad.

    --
    USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
  29. Dictionary by andersh · · Score: 1

    Really? Do you know what "yob" means? Yob, a rude, noisy, and aggressive young man.

  30. Re:Another nextgen FS on the way? Hmmm. by hoggoth · · Score: 1

    So there is a great opportunity here.

    Someone needs to take an open source filesystem and develop it into a seamlessly cross-platform filesystem. Release drivers for all popular filesystems. Maybe start with ext2, maybe with something better. Release a simple install for Windows, Mac, and Linux so we can all share it easily. Release proof of concepts drivers for RockBox so the MP3 player manufacturers will have an easy time porting it. etc. etc.

    --
    - For the complete works of Shakespeare: cat /dev/random (may take some time)
  31. Has nothing to do with Sun ZFS by kriston · · Score: 1

    Does this have nothing to do with Sun ZFS? I hope I didn't miss something.

    --

    Kriston

    1. Re:Has nothing to do with Sun ZFS by kriston · · Score: 1

      HOH boy yes I did miss something.
      Sigh.

      --

      Kriston

  32. Apple is Dying by repetty · · Score: 1

    None of this matters: Apple is dying. It's a matter of record.

    1. Re:Apple is Dying by Guy+Harris · · Score: 1

      None of this matters: Apple is dying. It's a matter of record.

      Does Netcraft confirm it?

  33. Disappointing... by Anonymous Coward · · Score: 0

    This is very disappointing. Although ZFS wasn't a make-or-break deal for me as to whether or not I'd go fully Apple at home (and I have..all members of my family have their own Apple system), this was a feature that I was really looking forward to. It would have been very useful on mHowever, it is what it is. I wouldn't be surprised if Apple took some of the concepts from ZFS and improved on them to make it their own.

    1. Re:Disappointing... by Anonymous Coward · · Score: 0

      You know what would be really, really stupid?

      Apple letting an internal project that doesn't meet their corporate direction continue after missing its release date twice.

      I'm sure they've had a plan B in motion to deliver the features they care about, and they'll now shift extra resources to it. And hopefully, it will manage to succeed.

  34. Likely in the works by Anonymous Coward · · Score: 2, Informative

    I'm sure Apple is planning something, OS X's file system is showing its age. Ars had a very good article about it here: From BFS to ZFS

    1. Re:Likely in the works by BitZtream · · Score: 1

      Citation needed.

      HFS+J case sensitive is essentially a modified UFS2.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    2. Re:Likely in the works by Guy+Harris · · Score: 1

      Citation needed.

      HFS+J case sensitive is essentially a modified UFS2.

      Citation needed. (Executive summary: no, they're not, the on-disk format is completely different. And, yes, that paper applies to HFS+, whether journaled or not, and whether it's case-sensitive HFSX or not.)

    3. Re:Likely in the works by YesIAmAScript · · Score: 1

      HFS+ uses B-trees and actually stores all files in all directories on a volume in a single database (two files). To move a file or directory to a new directory, you just change its parent node ID in the data structures. The file name is used as a key and so HFS+ directories are inherently sorted by name. You can iterate up to the root from a file/directory (create a full path to it) by looking at its parent ID, then stat-ing that, etc. until you reach node 2 (the root).

      UFS2 uses the standard UNIX inode system where files are stores in inodes and directories are basically lists of inodes. The files (inodes) in a directory are stores in the directory itself and thus to move an item to a new directory you have to remove it from one directory structure and put it in another. The items in a directory are stored in apparently random order, new items go at the end for convenience sake. If you want to view a directory in order, you have to iterate it and then sort it. Inodes don't have parents, if you want to create the full path to something you only have the inode number for, you have to start from the root and search down through every directory until you fine one that has the item with the same inode number as the one you were looking for. Now you've found the parent of the item you had. Now repeat this process (searching every directory on the entire disk) until you find the parent of the new item you just found. Continue this process until you find your item in the root directory. Obviously it may be possible to cache somewhat to streamline this, but you'll likely end up searching the entire volume at least once. Because of this, full paths are the only realistic way to keep track of UFS (UNIX) files, whereas Macs once had FSSpecs and FSRefs which only used volume identifier, parent directory ID and filename.

      So in short, they're not at all alike.

      --
      http://lkml.org/lkml/2005/8/20/95
  35. You know what a non-compete agreement is? by toby · · Score: 1

    After all these years, Sun knows how to cover themselves. ZFS engineers can't just cross the road to Apple and work on a directly comparable product.

    Also, the "lead engineers" are still at Sun, if the ZFS list is anything to go by. In particular Jeff Bonwick.

    --
    you had me at #!
    1. Re:You know what a non-compete agreement is? by Weedhopper · · Score: 1

      After all these years, Sun knows how to cover themselves. ZFS engineers can't just cross the road to Apple and work on a directly comparable product.

      Also, the "lead engineers" are still at Sun, if the ZFS list is anything to go by. In particular Jeff Bonwick.

      Non compete clauses are not enforceable in California except in a very narrow set of circumstances. This includes out of state agreements.

  36. Linux AND Mac compatible filesystem? by mcrbids · · Score: 1

    Ext2/Ext3 aren't supported by Macs. MSDOS doesn't support the extended attributes. HFS support on Linux sucks. The only one I've been able to find was UFS. It's not terrible, but it does seem to corrupt more often than I'd like.

    Anybody know of any better options?

    --
    I have no problem with your religion until you decide it's reason to deprive others of the truth.
    1. Re:Linux AND Mac compatible filesystem? by BrentH · · Score: 1

      Believe it or not, NTFS. With reliable and fast userspace FS packages for both OSX and Linux NTFS is a breeze (cough). NTFS-3g is the name.

    2. Re:Linux AND Mac compatible filesystem? by TyFoN · · Score: 1

      I think you can use EXT2/3 on mac via FUSE

  37. ZFS is overhyped and not a good fit for desktop OS by Anonymous Coward · · Score: 1, Informative
    If you take a look at look at the features and limitations of ZFS: http://en.wikipedia.org/wiki/ZFS#Limitations

    You can see that it has missing functionality such as encryption support and it does not seem to be a good fit for systems with removable media. It is also counterintuitive for the average user to grasp the concept that drives are part of a "pool". Finally, it is prone to fragmentation.

    Given all of the problems and lack of completeness, I cannot understand how anyone in their right mind would advocate using ZFS for any system at the time. I think that ZFS, should it continue to be developed, could be a useful FS for a SAN device but I don't see it as ever being a good fit for a desktop OS.

  38. Finder "empty trash" ? by Ilgaz · · Score: 1

    I have heard (from mailing list) that Finder on OS X, including SL (Cocoa) does some block level stuff while emptying trash and it was the reason that poster gave up ZFS without Apple support.

    As I use Finder for years and know how strange things it does sometimes, it sounded valid to me. Perhaps you should empty your own trash via Terminal?

    1. Re:Finder "empty trash" ? by Guy+Harris · · Score: 1

      I have heard (from mailing list) that Finder on OS X, including SL (Cocoa) does some block level stuff while emptying trash

      Good luck with that over SMB and NFS (and, yes, Finder works over SMB and NFS). Whoever told you that was, to use the technical term, "completely full of shit" (unless you misinterpreted what that person said); even if it specifically checks for HFS+, it'll have to ask the superuser's permission to do "some block level stuff":

      $ df /
      Filesystem 512-blocks Used Available Capacity Mounted on
      /dev/disk0s2 311909984 280623864 30774120 91% /
      $ ls -ld /dev/disk0s2
      brw-r----- 1 root operator 14, 2 Oct 11 17:37 /dev/disk0s2

      unless it does some fcntl and that does "block level stuff" inside the file system - which doesn't count here.

      Now, what the Finder does do for "secure remove" is the same stuff srm does (at least at one point it actually ran srm, as I remember), and srm Doesn't Do What You Might Think It Does on copy-on-write file systems such as ZFS - if you overwrite a file's contents N times before removing it, that doesn't do any good on a COW file system, because the old data isn't overwritten, new blocks are allocated when the write is done, so the old data is still there until the old blocks are released (which won't happen until they're no longer in any snapshots) and are reused (which could also take a while). Yes, one could do that with an fcntl, or some other way to say "snapshots be damned, I want this data gone, even if I later want it back", at least for a local file system (that wouldn't help you with, say, a NetApp NFS server, as WAFL is also a COW file system, and there's no "please make sure this data isn't preserved anywhere" NFS file removal operation).

  39. Why would MS bother? by Ilgaz · · Score: 1

    MS is happy with their NTFS, Apple and even professional users are happy with HFS+ especially after the addition of journaling. Only unhappy people are techies, a small percentage of them.

    Of course, if you are Pixar, you got XSan etc. as option.

    1. Re:Why would MS bother? by dangitman · · Score: 1

      Only unhappy people are techies

      That's not true. I've met some techies who are happy... well, one or two, maybe. Oh god, kill me now.

      --
      ... and then they built the supercollider.
    2. Re:Why would MS bother? by Anonymous Coward · · Score: 0

      Professional users aren't really happy with HFS+ as it's pretty fragile and doesn't come with maintenance tools. I know there are third-party tools like DiskWarrior, but if the filesystem's designers can't repair it you're not going to want to trust it very far.

    3. Re:Why would MS bother? by jcr · · Score: 1

      Apple and even professional users are happy with HFS+ especially after the addition of journaling.

      No, Apple's quite aware of the need for something better than HFS+, and that's why they did all that work on ZFS. Bummer that it didn't work out.

      -jcr

      --
      The only title of honor that a tyrant can grant is "Enemy of the State."
    4. Re:Why would MS bother? by jbolden · · Score: 2, Interesting

      One small problem is that HFS+ sits on top of HFS and thinks like block allocations fall apart after 1TB. Apple has to switch filesystems. While the problems aren't severe at 2TB or 4TB at 50TB they are going to devastating.

    5. Re:Why would MS bother? by Anonymous Coward · · Score: 0

      $ which fsck_hfs
      /sbin/fsck_hfs

      TUCKER MAX FAIL!!!!

  40. Re:ZFS looks grand, but glad they did not do it no by Lucid+3ntr0py · · Score: 1

    At this point in life, HFS is working fine, and the drobo is quietly humming away. I'm glad snow leopard was relatively painless to upgrade too, and not sure this would have been the case if ZFS had been included in 10.6.

    I doubt that including support for ZFS would have caused a terrible pain. It isn't like it would implement the ZFS files system in an upgrade.

  41. Fsck by tsa · · Score: 1

    My two rabbits have been checking their filesystems all afternoon yesterday.

    --

    -- Cheers!

  42. None of the lead engineers have left Sun. by Anonymous Coward · · Score: 0

    You are wrong about "several of the lead engineers from the ZFS project ...".

    How do I know this?

    A simple grep on the source code commit history, joined with the password database in NIS tells me this.

    None of the lead engineers from the ZFS project have left Sun. Yes people who have made changes are no longer there, but those people are NOT the lead engineers of ZFS.

    I therefore challenge you to provide any evidence to back up your claim.

    So, if you have been untruthful about one aspect of your comment, then it is likely that other "facts" are incorrect as well.

    1. Re:None of the lead engineers have left Sun. by Anonymous Coward · · Score: 0

      A simple grep on the source code commit history, joined with the password database in NIS tells me this.

      Hmm... and this information is available to others how, exactly? This NIS you mention isn't public information, is it?

      I therefore challenge you to provide any evidence to back up your claim.

      Right back at you. You claim to have seen evidence. Produce it.

  43. You know nothing of ZFS beyond Wikipedia by Anonymous Coward · · Score: 0

    You can see that it has missing functionality such as encryption support

    Encryption support is in the works. This isn't a particularly needed and commonly used feature, though, is it? NTFS supports file-level encryption, but do HFS/etc. support it (maybe they do, just asking)?

    it does not seem to be a good fit for systems with removable media

    Then don't use it for removable media. You can still use other filesystems!

    It is also counterintuitive for the average user to grasp the concept that drives are part of a "pool".

    The average user would not need to expose theirselves to the concept of a storage pool because they would very likely only be using one disk per pool. How is this any worse than having to configure a RAID array with a typical RAID controller or software RAID?

    Finally, it is prone to fragmentation.

    This is something I see referenced on Wikipedia (the sole source of your criticism apparently), but how much of an actual issue is this in the real world? And its not as if Apple's adoption of it would not have also led to an independent effort to create a defragger, if it was deemed nessecary.

    Fragmentation, though, is only an occurrence in a very specific scenario. What is your beef?

    I cannot understand how anyone in their right mind would advocate using ZFS for any system at the time.

    So what do you recommend as an alternative? That's right, you don't have one. You just have an axe to grind never apparently having used it before and know nothing of it beyond Wikipedia.

    What do you say to the many thousands of Solaris systems that run terabytes of ZFS storage with high reliability? Chances are that you are interacting with ZFS indirectly in your every day activities that involve computers.

    1. Re:You know nothing of ZFS beyond Wikipedia by aristotle-dude · · Score: 1
      You have yet to give one solid reason for using ZFS. Having encryption being "in the works" means that it does not exists at all or in a stable form that could be included in a shipping commercial desktop OS. HFS+ does not include file level encryption either but I'm looking for reasons why effort should be made to use ZFS over HSF+.

      Then don't use it for removable media. You can still use other filesystems!

      Most people use some form of removable media. I use a Firewire 800 external drive for my Time Machine backups. Time Machine backs up my entire boot partition including all permissions making it a viable disc for doing a restore from onto another machine should my iMac suddenly die. To ensure compatibility, you would usually want to use the same file system for your main drive and any backup drive.

      The average user would not need to expose theirselves to the concept of a storage pool because they would very likely only be using one disk per pool. How is this any worse than having to configure a RAID array with a typical RAID controller or software RAID?

      I get the feeling that you don't have a clue of how OS X works or how a typical user would use a mac.

      This is something I see referenced on Wikipedia (the sole source of your criticism apparently), but how much of an actual issue is this in the real world? And its not as if Apple's adoption of it would not have also led to an independent effort to create a defragger, if it was deemed nessecary.

      Fragmentation, though, is only an occurrence in a very specific scenario. What is your beef?

      My beef is that it should not occur in a newly developed filesystem.

      I have to ask you again, have you ever used OS X for any period of time? Do you own a mac? Have you ever been a windows user? I have a mac at home and I develop software on the windows platform at the office. Before switching to a eMac back in 2002, I had plenty of experience with defragging drives. I have yet to have the need to defrag a drive on any of the OS X machines that I have owned and I do not even own a utility to defragment my drives as HFS+ defragments on the fly. Explain to me why ZFS is needed given that it is inferior in this respect and you have yet to explain why it is superior to HFS+.

      So what do you recommend as an alternative? That's right, you don't have one.

      What is the alternative? HSF+ for the desktop and OS X desktop. It is perfectly capable of handling Terrabytes of storage. I currently have a terrabyte Time Machine backup drive and a Terrabyte data drive in addition to my 320GB internal drive.

      For other server applications, you can use UFS.

      BTW. I was the GP AC.

      --
      Jesus was a compassionate social conservative who called individuals to sin no more.
  44. Re:Another nextgen FS on the way? Hmmm. by Jesus_666 · · Score: 1

    The problem is reaching critical mass. The filesystem needs to be out with rock solid drivers for Linux and especially OS X and Windows within short time of the first affordable SDXC cards hiting market. (That would be within the next two or three months.) Right now, Apple offers no way of reading/writing standard SDXC cards (and yes, SDHC readers can access SDXC cards, just not at the new speeds; at least with a firmware update). That might change if they do decide to license exFAT.

    If the replacement FS really gained traction we'd see all Mac and Linux users use it for their SDXC cards and recommend it to their Win-using friends. Then we'd just somehow need to convince the entire electronics industry that every device capable of working with SDXC cards needs to support three different file systems (FAT32, exFAT, whatever we use).

    Remember, the manufacturers don't care about what works with Rockbox, they only care about what makes them money. All Linux users demanding something is irrelevant and all Mac users demanding something can only faze a few manufacturers that mostly cater to them. We'd need a significant part of all Windows users to decide they want to use some other file system over exFAT, which works with all devices and most computers.

    In short, we'd need to implement a vastly superior alternative that works on every major operating system and is more appealing to the general public than (the actually pretty decent) exFAT and start a media blitz about it, all within three months.


    From that perspective I expect that the whole thing will end with Windows and later OS X using exFAT and Linux users either paying for the commercial exFAT driver or not using SDXC at all.

    --
    USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
  45. 640 GB should be enough for anyone by Anonymous Coward · · Score: 0

    The compression and encryption features would likely be useful for some people. I don't think the increased filesystem limits (number of files, size of files) would matter for most folks.

    So 640 KB^H^H TB should be enough for anyone?

  46. Re:ZFS is overhyped and not a good fit for desktop by Anonymous Coward · · Score: 0

    Why does everyone think that there can only be one file system supported by the OS? Keep removable media as HFS+ (what the file system was designed for back in the 80s!) and keep your local storage as ZFS.

  47. Software patents FTW by Anonymous Coward · · Score: 0

    Looks like another great example of how software patents spur innovation and improve the lives of the general public!

  48. Re:Another nextgen FS on the way? Hmmm. by nine-times · · Score: 1

    I generally think this is a good thing, lets just hope that a reasonable degree of interoperability becomes possible anyway.

    I agree. Having options is good, especially since there isn't a clear winner yet. Still, I'd like to have a filesystem that will be usable (ideally read/wire + boot) by all major operating systems.

  49. I would suggest this could be a technical issue. by Roskolnikov · · Score: 1

    I have never believed this to be an issue of licensing, but one of technical difficulty, having a fair amount of experience with ZFS, Solaris and MacOS I can say a few things with some conviction.

    1. ZFS is very aggressive and can expect a lot of a system, look at its early effects on Oracle DB and NFS and you will see a lot has gone into its implementation in Solaris.

    2. ZFS boot took a good amount of time to get working in a supported fashion on Solaris, it would be an assumption that boot would be one of the requirements/reasons to port this to MacOS, the snapshot/backup/upgrade possibilities would be to great to pass.

    3. It would not be unfair to say that the Darwin kernel is not as mature as the Solaris kernel in regards to fine tuning, especially in the area of memory management, if you doubt this, take two comparable systems and load them up.

    4. I've got an external drive that I was at one point sharing with both a Solaris host and a MacOS host, when I put the Mac under a heavy load and than let it get idle strange things would start to happen, I suspect but can't say for a fact that some of the aggressive caching mentioned in my first point ended up in a VM file, and I suspect that my third point would explain this, Solaris can/does limit the amount of ZFS memory cache dynamically so that this scenario will in most cases simply not occur.

    --
    Unix, an obscure operating system developed by bored researchers in an attempt to get a better game playing experience.
  50. I don't think it's licensing. by toby · · Score: 1

    Existence of the NetApp/Sun suit, while most likely a loss for NetApp, is IMHO enough to prevent Apple betting the farm on ZFS in the heart of OS X.

    --
    you had me at #!
  51. Mac OS X quality is failing by Anonymous Coward · · Score: 0

    Context: I've been a software engineer for 25+ years. Solaris is the best server O/S. MacOSX is the best desktop O/S. In my home I have Solaris server and multiple Macs.

    The dropping of ZFS by Apple is disappointing.

    It is yet one more symptom of the degrading state of Apple software. Over the last year I've seen noticeable and serious drop in quality. It's starting to look awful familiar to me (having lived it with various employers) - more and more "features", more and more "date-driven" releases, less and less quality. If they keep on this path they may eventually not be any better than Windows.

    Apple, and Apple users, would be much better off if they stopped trying to develop and maintain an inferior operating system and spent their resources on applications and the user environment. A Solaris core with Mac user environment and applications would be the best of both worlds.

    Of course this will never happen as egos and marketing BS will prevent it.

    1. Re:Mac OS X quality is failing by Anonymous Coward · · Score: 0

      A Solaris core with Mac user environment and applications would be the best of both worlds.

      You're on crack. Apple is not going to live with Solaris-style patch hell.

  52. Patent Indemnification by ThrowAwaySociety · · Score: 1

    The long and short of it was, Apple and Sun couldn't come to terms on the licensing. Sun wanted a lot of money...

    That doesn't make any sense. I fail to see why Apple should agree licensing terms for a CDDL licensed open source project or how Sun could demand money for the privilege. Sun were positively overflowing with love towards Apple (as they usually are) when they heard that anyone would actually be interested in their uber new filesystem.

    Scuttlebutt on the web seems to be that Sun wanted Apple to stand on its own if it was sued over ZFS, and Apple wanted Sun to pay its costs if it was sued over ZFS.

  53. Ha, ha... by mbessey · · Score: 1

    ZFS and HFS+ have nearly-identical limits on everything except number of files. The maximum size of files and volumes with HFS+ is 2^63 bytes, rather than 2^64 bytes for ZFS. On the number of files per volume, there's a more-significant difference, 2^32 vs 2^48.

    I can (just) imagine someone running into the number-of-files limit in a non-pathologic case, in a few decades or so. On a terabyte-sized drive, if you divide the whole thing up into 2^32 tiny files, each file would be 255 bytes long. Actually, they wouldn't, because the minimum allocation unit on HFS+ is 512 bytes, and you wouldn't hit the number-of-files limit at all.

    The allocation units scale up in size from there, so on a 330 Terabyte drive (which'll be average in 10 years, if trends continue), each file would take up at least 90KB. I still don't see that as much of a disadvantage. I wonder what the average file size on my current drives is? Certainly a *lot* of the bulk of the files are digital photos and audio/video files, which are several megabytes in size. File sizes for media are likely going to increase over time, from higher resolution.

  54. Re:I would suggest this could be a technical issue by Anonymous Coward · · Score: 0

    Mac OS X already boots from RAID and other nonstandard volumes by using an HFS+ helper partition that contains the booter, the kernel, and any drivers required for booting. The code to support that mode for nonstandard filesystems is probably already there, too; UFS worked that way because Open Firmware didn't understand UFS.

  55. Re:ZFS is overhyped and not a good fit for desktop by aristotle-dude · · Score: 1

    Why does everyone think that there can only be one file system supported by the OS? Keep removable media as HFS+ (what the file system was designed for back in the 80s!) and keep your local storage as ZFS.

    Why do you think software development is so cheap that man hours can be thrown away just to add a feature that is unstable and almost nobody would ever use? Speaking as a software developer with over a decade of experience, I can tell you that good software does not arrive on the scene by having just a bunch of code monkeys slaving away without any analysis or plan in mind.

    --
    Jesus was a compassionate social conservative who called individuals to sin no more.
  56. FreeBSD and ZFS by cracauer · · Score: 1

    FreeBSD is about to release 8.0, with ZFS, and ZFS has officially been labeled production-ready:

    http://www.freebsd.org/news/status/report-2009-04-2009-09.html#FreeBSD/ZFS

    Myself, it works good for me on a storage server. There are some edge cases left, for example I could provoke a panic by combining ZFS on a 3-disk array with automatically parking the disks on timeout. Accessing the filesystem with power down disks didn't go so well. This was in 9-current, though.

    ZFS is still the only thing out there providing all of:
    - snapshots
    - compression
    - attributes such as compression can be turned on and off by directory tree
    - a "filesystem-aware raid", aka something that avoids the RAID hole
    - and as mentioned optional extra redundancy (more than one disk can die) and the checksumming. That means, for example, you can have your filesystem like raid-5 but some directories as redundant as raid-6

    Until Linux gets BTRFS (and I'm not sure how complete it is with regards to all those features) it's the best thing for a storage server out there.

    %%

    Apple's diversion either means they do their own thing (ZFS seems excessively hard to integrate) or is based on patent concerns, or the former because of the latter.

    But if you look at the core of it, NetApp tries to claim patents on everything that does filesystem-integrated snapshots (as opposed to the lame LVM raw device layer snapshots in Linux). Reimplementing a filesystem with snapshots, whether you call it ZFS or not, won't help here.

  57. Jeff Bonwick claims it was a licensing issue by Guy+Harris · · Score: 1

    In a message to the zfs-discuss list, he says that "the essence of [the issue]" was that Apple and Sun couldn't come to mutually agreeable terms on a license.

  58. wzz by Anonymous Coward · · Score: 0
  59. "ZFS is a solution in search of a problem".... by jotaeleemeese · · Score: 1

    Poor sod, have you ever worked with multimillion $ ( or £ or € ) complex systems?

    Even with a basic setup, the advantages for a real pro become obvious in no time.

    --
    IANAL but write like a drunk one.
  60. Not for desktops? by jotaeleemeese · · Score: 1

    Backups become immensely simpler with ZFS.

    Any desktop user with tons of media files would appreciate that.

    The GNOME file manager in Solaris is being integrated with ZFS features, so snapshots become a point and click task.

    Backup your snapshots (incremental backups for all practical means) and you will be in business without needing to understand complex backup policies.

    --
    IANAL but write like a drunk one.
    1. Re:Not for desktops? by mbessey · · Score: 1

      I did mention that snapshots would be useful for a desktop system, specifically for backups...

  61. The important points by FreekyGeek · · Score: 1

    Y'all seem to be forgetting a couple very important points. First, ZFS is here. Now. In production. Officially supported. It had years and years of development and testing, and has been in Solaris 10 for years after that. It's solid and it's here and it works great. Btrfs, on the other hand, whether you think it's technically better or technically worse, is still *YEARS* away from any kind of stable release. It doesn't even have RAID 5 yet, fer chrissakes. Even if it were 100% feature complete today, it would still be *years* before I or anyone else would even dream of using it in production.

    Say what you want about Sun, their engineering is top notch. They put ZFS through hell while testing it, and it's been out for some time now. Btrfs has just barely reach infancy.

    Second, one of the things I consider *most* important about ZFS is that it's EASY TO USE. I always had a hell of a time trying to understand all the million complex concepts and commands in Veritas and other volume managers. After a lonmg time as a sysadmin I still have trouble with it. You know what? I learned ZFS in about twenty minutes. The way they're organized and written the commands makes it so dead easy to use it amazing. I can do with *one* ZFS command what would have taken an hour of head-scratching and manual-referencing with Veritas.

    Btrfs, on the other hand, despite the assertion in the mission statement that usability is a main goal, shows every sign of becoming yet another filesystems where doing anything involves 15 different commands to do different things, each with 22 bizarre options. The scanty "man pages" that exist are nearly impossible to find (not on the btrfs web site) and when you do finally track down something like a command syntax or parameter reference, it appears that btrfs commands are going to be just as - if not more - incredibly complex and intimidating as Veritas.

    If the btrfs project people want folks to adopt that filesystem rapidly and enthusiastically, they need to *completely* rewrite the interface, take a page from ZFS, make it one or two command with a simple, english-like syntax. hell, since ZFS is sort-of open sourced, they could probably steal the entire ZFS syntax verbatim - legally. The code itself may be under some kind of license, but I doubt anyone could get sued for using the same commands. They're just words, and I don't think something released under any kind of open source license could claim copyright violation over non-code text. If btrfs really wants to grow, thrive, and be accepted, they have to pay a LOT more attention to the usability issue. One of the huge reasons so many people like ZFS so much, including myself, is it's something that's extremely powerful on one hand but I can learn to use rapidly and become an expert on in no time. The syntx is so english-like it's almost like talking to another person.

    Oh, BTW - just bite the bullet and call it 'BFS". "btrfs" is freaking awkward and stupid. It rolls off the tongue as easily as the abomination "GNU/Linux".

  62. Re:ZFS is overhyped and not a good fit for desktop by ggendel · · Score: 1

    On most systems that support ZFS, there is already the capability to to encryption via the loop back interface. They are working on zfs native encryption and it has been under test internal in Sun for awhile. De-dup capabilities will be available soon. The development of zfs has been incredibly fast for a file system. Considering the Mac implementation is at rev 8 and I've got 14 on my OpenSolaris system should say something... Apple hasn't really put much effort into keeping up with the state-of-the-art of ZFS.

    I've never had corruption issues on ZFS over the several years of heavy use, ups crashes, lightning strikes, etc. During the same time, I've seen several XFS, NTFS, and HFS+ filesystems in adjacent servers get twisted beyond repair.