Apple Looking at ZFS For Mac OS X
Udo Schmitz writes "Apples Filesystem Development Manager, Chris Emura, is looking into porting Sun Microsystems' file system ZFS to OS X. At least this is what Sun's Eric Kustarz states on the ZFS mailing list. Is this a glimpse of hope for all those of us who think HFS+ isn't up to par for a 21st century OS? Next thing you know and they'll rewrite the Finder ..."
Have a look at wikipedia's Comparison of file systems page to see the difference between ZFS & HFS+.
The main advantage for HFS+ users (I mean who's really going to need a 16,000,000 Gigabyte file) would be the introduction of journalling beyond metadata (and even this is unlikely to be useful to most people).
There are shills on slashdot. Apparently, I'm one of them.
ufs does not work with all software especially stupid applications made by microsoft
The war with islam is a war on the beast
The war on terror is a war for peace
A story that consists of a link to wikipedia and a mailing list posting about an OS possibly (maybe, potentially) switching filesystems.
Beats the heck out of story about a blog posting that's just a regurgitation of an MSNBC article that doesn't know what the frack it's talking about.
There are many reasons why Apple might be looking at ZFS. Only one is that Apple intends to actually make Mac OS X use it as a home filesystem.
Now, here's a reason the write-up author didn't think of: Apple is rumoured to be working on a virtualization layer for OS X, with the intent being that OS X will run in parallel with multiple operating systems. Even if that rumour is false, it's clear that with BootCamp, Apple is taking the idea of Macs running multiple operating systems (albeit not at the same time...) seriously. Solaris and GNU/Linux are the two most popular Intel platforms save for Mac OS X and Windows.
Isn't it more likely that Apple wants Mac OS X its multi-OS Macs to "just work" with the other operating systems, able to achieve a high degree of interoperability without forcing the other platforms to support HFS+?
I'm not saying a move to ZFS would be a bad thing, though it doesn't, so far as I can see, support arbitrary metadata so it'd be as practical as UFS in its current form, which is barely used by Mac users. I just think a port of the main Solaris file systems is, in practice, something Apple would be doing anyway, as part of the Intel OS-agnostic direction they're going in.
You are not alone. This is not normal. None of this is normal.
There are probably two things that Apple would be looking for in ZFS: a shiny feature they can point to for their enterprise and video production markets, and for the consumer market, the promise of a simple, reliable way to back up and grow the storage of a Mac without have to worry about mounting/copying/moving volumes, managing backups, etc.
Supporting lots of filesystems is hard. Mistakes are difficult to track down and harshly punished, licenses and API's generally aren't amenable to straight ports, and it's a lot of work for what's typically a fairly small ROI. Also, porting one filesystem doesn't generally make porting another significantly easier. You might as well ask:
"But why just a skyscraper? Why not add a warehouse or a subterranean bunker as well? Why not add in a bridge while you're at it?"
Might be nice to have them all, and they certainly share certain requirements, but trying to build them all at once isn't necessarily a good idea when all most people want is a nice place to keep things.
Yeah, it's pretty clear that for heavy-duty use, HFS+ is not really the way to go. With ZFS, Apple can build on what Sun has done, while at the same time they don't have to touch HFS+ at all, or fix all the it-doesn't-quite-work-like-HFS+ issues that UFS has. It makes a lot more sense for them to get ZFS to "just work" than to put that work into the existing UFS implementation.
It's the same deal with the problem with Classic. All 3 items you link to are for OSX 10.0 and have been fixed since then. The number of UFS problems now is minute compared to then.
Obligatory: Why are you waiting on your ass for a feature in an OS for which you have all the code? Drive the development of ZFS on Linux yourself. Ask for help when you get lost, but don't just sit around wasting oxygen.
So now with the Intel Macs and no need for Mac OS 9 support, Apple can tell all their developers that all Universal apps must be able to run on UFS. That way should Apple decide to adopt ZFS it should be a painless transition. Holding on to HFS + with the Intel Macs for this long will hamper any transition into a future filesystem. This will prepare Adobe and Microsoft to write their new Universal versions to be able to accept any type of filesystem and not rely on the resource fork of HFS
That's my 2 cents.
I read that Darwin has trouble scaling thread concurrency. Maybe Apple should just switch to Solaris, either licensed or OpenSolaris, and get ZFS with it. (Of course they would still run the MacOS personality and GUI environment on top of it.)
I just wish we could come up with a network file system that's worth the trouble. Right now, I'm using a Linux server with three Macs (two Tiger, one Panther), and everything is over NFS. Most of the time, it works fine, but if there's a weird hiccup, then the Mac will freeze solid and has to be hard power-cycled. Also, some apps simply won't run from a network share (or they'll run, but one thing or another won't be right). Install that app to a local drive, and it works fine. And this isn't even to mention security issues.
/Server/Shared or /Server/Apps.
I've looked at AFP, but that essentially mounts the remote system as if it were an external drive, and assigns everything to the logged in user, so ownership, permissions, etc., are all really screwy. Plus that gets even worse if you use fast user switching -- now two people are independently trying to mount the same network drive, each claiming to own it outright. And it doesn't look as seamless as, say, simply going to
SMB isn't much better.
There's always AFS, but that's so bloody complicated that I'd take a lot of convincing before I seriously considered it.
This isn't even to mention the problems that most apps have in working in a networked environment -- applications simply aren't designed for, say, networked home directories, and *especially* aren't designed to be running simultaneously on multiple systems. So if I've got Mail.app running in the den and I log in upstairs to check mail just before I go to bed, things could get messed up.
I'm not sure there's even been a new network file system since the mid 90's, has there? Certainly, nothing with broad support that fixes some of these issues? All I want is UNIX filesystem features -- simple locking (I guess), owners, regular permissions. Doesn't even need to do ACLs. Transparently mounted so it looks like it's part of the local filesystem. And at least reasonably tolerant of network glitches, so a momentary drop at the server (or whatever else happens to screw NFS connections to the wall) doesn't put all apps which have even heard of the mount point into an uninterruptible kernel-level deep-freeze (what's the point of kill -9, dammit?). Is that so difficult?
ZFS is one of the more interesting filesystem developments of late. While the address space is nice, it's the data replication features included that make this a potential candidate to threaten the proprietary (and expensive) DR features of modern SAN and NAS storage systems. Need a synchronous or asynchronous mirror? No problem. Just issue a ZFS command on your OSX/Solaris/Linux server...
There exists no way of exchanging information without making judgments. --Bene Gesserit Axiom
Speaking of resource forks, I miss ResEdit. It was an awsome little program, and it did awsome things...
Sig (appended to the end of comments you post, 120 chars)
Even so, all of the other features of ZFS are worth much more than this. If Apple is anything more than a consumer widget company now, ZFS should definitely be under consideration.
ZFS is far from "just another filesystem," and comparing it to existing filesystems indicates a lack of understanding. Take a look at this presentation for more information.
I know this is just a little comment at the end of the story and not the main topic but the Finder really does need to be rewritten. It has a surprising lack of multithreading, even compared to Mac OS 9. This is most apparent (and most annoying) when you are navigating a slow network volume in the Finder. Quite often, you just can't do anything with but wait for the network to time out.
Unlike Open Source projects Apple has to do a lot of regression testing and QA, and already isn't perfect there. I imagine they take a lot of time already. Imagine having to run all those tests on five or so filesystems not only for all the OS bits, but for all their other software projects.
Also imagine Disk Utility having a popup to format a Disk that made users choose between:
EXT3
FAT
HFS+
HFS+ (case sensitive)
JFS
UFS
XFS
ZFS
Then try to explain to Grandma which is the correct one for them to choose in a litle help blurb.
Sometimes Apple has to make choices as to which is the best approach which limit things that might annoy power users, but make things simpler for everyone else. If Apple took the Linux approach, OS X would run on every piece of hardware out there, would have three or four window managers, five filesystems, fourty text editors, and would be hated by typical users for the brief time Apple was around before they went out of business.
Hyperbole is the worst thing ever.
The more I think about it, the more it makes sense for Apple to buy SUN. Their products nicely complement each other. Apple is strong in the consumer market and in the creative sector, SUN has good presence in the enterprise, tech and finance sectors. Apple has great brand value and knows marketing like no other computer vendor, SUN has technical excellence, but it's been struggling in the last years to actually sell their stuff. Their products portfolios have little overlap, and together they offer a very complete spectrum of computer products.
Mac OS X is a great consumer OS, but performance at the high end is sub-par. For servers, Solaris is fast and scalable, has nifty features like ZFS and DTrace, but the UI is pretty crude. Imagine a merger of these. Looking at their market caps, Apple can afford it.
Thanks to this, a lot of interesting stuff becomes possible, such as the fast file system creation which is demonstrated in this very cool demo.
If you don't consider ZFS a quantum leap in file system technology, I wonder what it would take for you to use that expression (set aside for the moment the people who argue that "wuantum leap" should in fact mean the opposite :-) ).
But Dvorak said Apple was switching to Windows! How could this possibly be true?
Don't confuse possibilities with defaults. There's two mechanisms already established for giving advanced users more choices: Option-click a control or menu item to get more choices. Or a show-advanced-options preference without a GUI interface that you can turn on with the "defaults write" command.
Plus the whole "Advanced Options" kind of button....
Ugh... I tried reposting listing anonymously for a higher rating, but I forgot that posting as AC removes karma and logged in bonus... so here I go being TREBLY redundant.
/System/Library/Filesystems/ /System/Library/Filesystems/AppleShare/afpfs.kext
For the record, if I had mod points I would have modded GP up as "Informative"
Last login: Thu Apr 20 18:20:18 on ttyp1
Welcome to Darwin!
[athena:~] aibrahim% ls -l
total 8
drwxr-xr-x 9 root wheel 306 Apr 4 11:14 AppleShare
drwxr-xr-x 7 root wheel 238 Apr 2 2005 URLMount
lrwxr-xr-x 1 root wheel 49 Nov 4 02:45 afpfs.fs ->
drwxr-xr-x 6 root wheel 204 Feb 24 22:08 cd9660.fs
drwxr-xr-x 3 root wheel 102 Mar 26 2005 cddafs.fs
drwxr-xr-x 4 root wheel 136 Nov 4 02:45 ftp.fs
drwxr-xr-x 5 root wheel 170 Nov 4 02:45 hfs.fs
drwxr-xr-x 4 root wheel 136 Mar 26 2005 msdos.fs
drwxr-xr-x 3 root wheel 102 Mar 20 2005 nfs.fs
drwxr-xr-x 6 root wheel 204 Sep 4 2005 ntfs.fs
drwxr-xr-x 3 root wheel 102 Mar 26 2005 smbfs.fs
drwxr-xr-x 6 root wheel 204 Apr 29 21:33 udf.fs
drwxr-xr-x 4 root wheel 136 Mar 20 2005 ufs.fs
drwxr-xr-x 4 root wheel 136 Mar 26 2005 webdav.fs
Don't post innacurate information
If you do, I swear by my pretty floral bonnet I will end you.
I've made a few "what about UFS?" comments in this story, but I hope I don't come across as some weird filesystem fanboy. It's just that I can't figure out why this announcement is so exciting. ZFS is cool, sure, but I see it as an incremental improvement to widely used Unix filesystems rather than a quantum leap.
I think part of what makes this story so interesting is that despite the past few years' developments, most of us still expect Apple to act as it used to with regard to adopting new technology. In other words, we expect Apple to adhere to the 1980s and 1990s playbook of "NIH" - in other words, if Apple didn't come up with it, it's crap.
I think Steve Jobs changed all that, but I think there are lots of us who still find it interesting when Apple drops some in-house technology (Intel chipset over Apple's ASICs, Mach over NuKernel, KHTML over ????, etc.) for free software or technology for equal or better alternatives. We spent years wishing they'd do it, and now they are.
If the rumor is true, someone somewhere got ZFS working already, made a cool demo of a feature, showed it someone who showed it to Jobs, and now it's a real, honest-to-God feature.
I think that you have to inform better, Raiser has journaling. From namesys site: "Reiser4 is an atomic filesystem, which means that your filesystem operations either entirely occur, or they entirely don't, and they don't corrupt due to half occuring. We do this without significant performance losses, because we invented algorithms to do it without copying the data twice"
It helps to have knowledgeable moderators, but posts still have to be moderated to be useful for a general audience. In this case, the post in question doesn't tell you much if you don't happen to be very familiar with different file systems for OSX and the compatibility of OSX software with those file systems.
Is the grandparent post flamebait? maybe not. Without minus_273's though, its probably not useful enought to be modded up either. Whether the moderation system is right or wrong, isn't the point here, but the as the guidlines say http://slashdot.org/moderation.shtml/ in the FAQ, question 5:
By the above def, the grandparent is no more than an average comment that maybe leans a bit towards flamebait and probably shouldn't have been modded up or down.
There's a bunch of resource fork utilities in /Developer/Tools/. Just add it to your $PATH
Yes, Dominic Giampaolo works at Apple and is in charge of filesystems there.
I can tell you grew up in the UNIX world. Everything I read about ZFS reminds me very much of VMS. Twenty years ago. If you read the UNIX Hater Handbook (published 12 years ago), then you will find a very nice rant about how the UNIX concept of partitions is a huge step back from what VMS offered. Now, over a decade later, it seems someone has listened.
I am TheRaven on Soylent News
I agree that there was a lot in VMS that the world has "lost". I think that modern UNIX implementations should look at what VMS had, to reuse some of the good ideas that we still have not replicated. My favorite is the security system -- various small capabilities that each user (or program) could be granted. And the super-user only had one capability by default: the ability to grant privileges. I also appreciated the automated versioning, with the ability to pull up a previous version from the filesystem without having to use any special programs.
And yes, I know that Windows NT is sort of descended from VMS. But I've not seen many of the concepts make it up to userland cleanly implemented.
And I'm also aware that VMS is still around. It may not be on life-support yet, but it's clearly in the nursing home already.
Software sucks. Open Source sucks less.
I guess it worked.
Dewey, what part of this looks like authorities should be involved?
Reiser4 is transaction-oriented, just like ZFS. The two actually use a similar principle (not journaling) to maintain consistency, based on COW'ing blocks in a tree, then committing the change atomically by swapping the pointer to the root of the tree in the parent node. Reiser4, however, instead of using the traditional block tree ZFS does, uses "dancing trees", which is kind of a B*-tree with ideas from log-structured filesystems mixed in.
A deep unwavering belief is a sure sign you're missing something...
Apart from those pluses mentioned by lokedhs (snapshotting is no trivial feature to have, if you're running databases, for example, or want admin abilities like rollback) - What ZFS offers that no other Linux filesystem offers, let alone HFS+, is end-to-end data integrity and self-healing. That's why I picked Solaris 10 for a high-integrity database app recently. Nobody else could offer the integrity guarantees (apart from some SAN vendors perhaps).
you had me at #!
"People just don't think that way until they've been conditioned to do so by Unix."
Demonstrably not true. I've thought that way since I learned to read. In fact, I was confused the first time I dealt with an MS-DOS machine (before I ever heard of Unix), because the instructions showed commands in upper case and I thought I had to type them that way. Everything I do is based on identifying and classifying differences - "F" and "f" are patently not the same thing to me.
People, at least people familiar with written romance languages, use capitalization explicitly throughout their lives. You can argue that they don't think that way until they've been conditioned by literacy, but don't drag Unix into it.
KeS
Quite to the contrary! The most unreliable element in your laptop is your drive. It will fail at some point, have no doubts about it. ZFS will detect silent failures through its checksumming.
ZFS also makes it possible to do super-fast backups to external disk. Combine that with snapshots and you have the kind of data security enterprises pay a whole lot of money for. Here's how it works:
See? It can be that simple. And there's more:
So what if ZFS does things that VMS did. No-one else has made anything quite like the summit of cool stuff that ZFS is. Apple makes a living bringing cool stuff together and making it cooler. It's a natural match :)
ZFS would yet again boost OS X's position as ultimate laptop OS. Here's hoping that Apple does implement it.