Native ZFS Is Coming To Linux Next Month
An anonymous reader writes "Phoronix is reporting that an Indian technology company has been porting the ZFS filesystem to Linux and will be releasing it next month as a native kernel module without a dependence on FUSE. 'In terms of how native ZFS for Linux is being handled by this Indian company, they are releasing their ported ZFS code under the Common Development & Distribution License and will not be attempting to go for mainline integration. Instead, this company will just be releasing their CDDL source-code as a build-able kernel module for users and ensuring it does not use any GPL-only symbols where there would be license conflicts. KQ Infotech also seems confident that Oracle will not attempt to take any legal action against them for this work.'"
How open are the two open source licenses if they prevent you from using the software?
Mod me down, my New Earth Global Warmingist friends!
It's open source in the sense that the source is open. Free to view, and free to use as long as you don't distribute it.
No, really. I had a bunch of questions going in, and they were all answered. This is rare enough to warrant a shout out to Michael Larabel.
I disagree with some of his subjective claims like x86_64 being a substantive limitation or ZFS on Linux remaining niche (I guess that depends on how you define the niche...) but he got the national lab project, the zpool version, the Oracle (nee Sun) patent problem. Kudos.
FreeBSD 9 is probably where ZFS will wind up finding a proper home, I'm guessing.
My God, it's Full of Source!
OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
BTRFS will end ZFS if Oracle does not kill that too.
I hope this idea http://blogs.sun.com/brendan/entry/test also works with the port (and will be working with btrfs one day!?):
Transparently adding an SSD into the slow-HD-to-fast-CPU-register cache hierarchy. Are there ways to make something like this work with current FSes?
I hear that every install of ZFS for Linux comes with a pre-installed Steam client, and a free copy of Team Fortress 2 For Linux!
ZFS has becoming vapor ware since apple announced snow kitty wasnt gunna support it.
I do not think that word means what you think it means.
Looks like I'll finally have a reason to get around to rebuilding my home server. Well, as soon as WD finishes warrantying one of the drives in the array that is. Current estimates put ZFS and the drive arriving at the same time!
Seems a little early to be putting faith in that. It's feature list looks good, on par with other modern desktop file systems like HFS+ and NTFS. However it is currently unstable. When will that be fixed? Who knows? Maybe it moved full steam ahead and we have a stable, capable file system next month. Maybe the project loses steam and languishes and 4 years from now it is still "unstable" and "coming soon."
You can't really say how well it'll work until there is stable code to test. Remember designing a file system isn't the real hard part. I'm not saying it is trivial work or that it is unimportant but it is by far the easier part of all this. You can write out a specification that sounds great on paper, but then you have to implement it. That is the much harder part. You have to make it fast, stable, not corrupt data, able to do everything it should and so on.
This is part of the reason why NTFS on Linux has been so tricky. It is actually pretty well documented in the Windows Internals book, and other places, but it is a complex file system. FAT, on the other hand, is real simple and thus not hard to implement.
As an example you can look at driver sized. The NTFS driver in Windows is 1.6MB. The FAT driver, on the other hand which supports multiple versions of FAT, is only 200k. The NTFS kernel driver is one of the very largest in the system, only the ATi video driver (much larger) and TCP/IP stack (a bit larger) are bigger than it on my system.
So we'll see what happens with btrfs. As of late, there's not been much activity. The last version update was June 2009. Maybe they are rolling up final testing for production release, or maybe things have slowed down and release is not near. We'll just have to wait and see, but it is foolish to believe this will be the Next Big Thing(tm) at this point.
We've heard much about ZFS, but being a slashdotter, I can't recklessly go on and RTFA. So, maybe someone here can recap its main benefits. Maybe a power point slide?
Fuck systemd. Fuck Redhat. Fuck Soylent, too. Wait, scratch the last one.
This sounds great.
However, some of the authors comments in the Phoronix thread (such as "FUSE is crap") -- and the fact that he's announcing this on Phoronix instead of via some other technical channel temper my enthusiasm just a bit...
Just ask freenas and openfiler and, heck, even opensolaris
Oh, and this:
23212 [root@place]/mnt/Scratch: zfs get utf8only
bad property list: invalid property 'utf8only'
Know why? Cuz you don't get any choice in the matter outside Solaris proper.
Without dedupe and without the ability to use non-UTF8 in filenames (try creating a directory called Télépopmusik in a ZFS pool), ZFS is a future-former. I hear they name filesystems after murderers these days just for the street cred.
You did not read it here first, but I'll take the heat.
It was deployed to desktops, and on by default, in Windows Vista/7. It does copy on write and maintains old snapshots of files automatically. On the server side, there is some more management of this if you like. This snapshotting feature is also used by backup utilities to do hot backups. Ghost and TrueImage can image a running system using it. They can snapshot the state for backup and new data can be committed while they work, without messing with anything. Works great. That is also independent of the maintaining of old versions so you can shut that down if you like and still do snapshots for backups.
http://www.opensolaris.org/jive/thread.jspa?threadID=131604
http://www.opensolaris.org/jive/thread.jspa?messageID=270957
Long story short: disk pools in ZFS can only grow, so don't make any mistakes unless you can afford to do a full dump and restore. Sun had been "working on" this for years. Anyone heard any news lately?
I'm not holding my breath, but god damn...
If this ever happens, my wildest dreams will have come true. Forget the threesome with now-hideous-and-leathery-old-but-once-hot porn stars from my youth! Not having to deal with any more Solaris or FreeBSD for a 'modern filesystems' would be incredible.
Like I said, not holding my breath (or even breathing heavily!). If it happens it'll happen only at the fringes, and poorly.
~/ssh slashdot.org ssh: connect to host slashdot.org port 22: too many beers
I don't know about you, but I've gotten nothing but top-notch bug-free, reliable, and maintainable code from Indian companies...
154 comments and nobody mentions btrfs? Seriously, we don't need zfs anymore... And most definately not some half-assed probably-patent-encumbered version that will never make it upstream - mark my words: it will be unmaintained within 10 minor kernel versions.
Its easy to DOS the BTRFS and kill the system. A normal user can do it. Just create a couple of big files. Then, copy a large number of small files. You will get ENOSPC at around 90%. Then, delete the large files. Even with most of the space being free, it won't allow you to create new files. All new requests will get ENOSPC. Bug is at: https://bugzilla.kernel.org/show_bug.cgi?id=16508 BTRFS is a mess. Go read their mailing lists.
And the source is available now: http://github.com/behlendorf/zfs/wiki
Has nobody seen this?
Given that Oracle were pushing BTRFS, they also push linux, and they now own Sun (and thus ZFS), suing over ZFS development on Linux would kinda be shooting themselves in the foot.
I can't see how oracle being able to use ZFS on linux and then easily upgrade their customers to Solaris + ZFS as needs change would be a bad thing for them?
I run: Windows, OS X, Linux, FreeBSD. Just because you have a hammer, doesn't mean everything is a nail.
Oracle probably has a ton of patents around ZFS as well, so merely complying with the license is probably not enough. Just look at Java...
That's not the GPL's fault. It's the fault of the IP lawyers who are dicing permissions exceedingly fine. The GPL is designed to guarantee certain freedoms at the cost of others. It does its job very well, and is well architected with a lot of forethought considering we're only on version three after 21 years. At least one of those two revisions can be blamed not on the faults of the license but on the changing legal and IP environment.
Believe it or not once upon a time if you wrote some code somebody found interesting you just sent it to them. No patents. No copyrights. No approvals from management or legal. You just sent it, happy that someone else might benefit from not redoing the work you'd done once already. The idea of profiting from the derivatives they might make, or the derivatives of the derivatives, was simply not an idea that would occur to a normal person. If you had suggested such a thing at that time we'd have thought it hilarious.
And now I have to point to the onion on my belt, which was the fashion in my day.
Help stamp out iliturcy.
ZFS is nice but it doesn't have an fsck, partly because of its design philosophy. I think this is an omission and http://www.osnews.com/story/22423/Should_ZFS_Have_a_fsck_Tool_ explains why (links to many examples where ZFS won't open a zpool after an abrupt shutdown, possibly due to ZFS bugs or disks that lie about flushing cache to disk).
There is a new zpool recovery feature - discussed in http://www.c0t0d0s0.org/archives/6071-No,-ZFS-really-doesnt-need-a-fsck.html - the command is "zpool clear -F data" which is a very specific sort of fsck - it just unwinds the last few transactions, enabling you to have a valid zpool but losing a few recent updates, which is usually better than a complete restore from backups. The feature is mentioned at http://www.c0t0d0s0.org/archives/6067-PSARC-2009479-zpool-recovery-a.html (PSARC 2009/479) and is available since Opensolaris build b128 (ref: http://opensolaris.org/jive/thread.jspa?threadID=127689&tstart=0 )
For those who want a ZFS based NAS, have a look at NexentaStor (which has a proprietary GUI, free for up to 12 TB of disk) or Nexenta Core (just the OS without GUI, and open source) - NexentaStore has some nice features to get you started quickly, or you can use the open source napp.it GUI with the Nexenta Core. Nexenta uses a very recent zpool version (v24) and is based on OpenSolaris build b134 so it includes the above zpool reocvery feature.
Nexenta generally will move to using the Illumos fork of OpenSolaris when that's stable, so it should have a future as long as NetApp don't sue them. If they do get sued you could move to a more community-based distro based on Illumos.
Key question is whether the ZFS on Linux port will be updated to the Solaris b134 code to include this feature. Without it, you are in for some painful recovery using zdb (filesystem debugger) - but in any case you need up to date backups of your entire zpool. FreeBSD does have ZFS but using a much older zpool version without this feature - from my point of view, it's best to use the latest Solaris ZFS code to get the best stability, despite the limitations of Solaris hardware support.
ZFS recovery is an interesting topic given commodity hardware - see http://opensolaris.org/jive/message.jspa?messageID=292794 - there are other failure modes not addressed buy this zpool recovery feature.
.... you rarely have to make a volume smaller.
I know that is not an excuse, but frankly I personally could not care less since that is a feature that would not be used at all...
Software has at the very least 2 actors that interact with it, the developer of the software and the user of the software.
So when you say "The BSD license is less restrictive than the GPL", who are you talking about? Which interests are you defending or promoting?
If you are an user, BSD software is a pain in the neck, since often you can't do anything about troubleshooting a problem except dutifully waiting for the company providing it to fix the problem (so for users BSD licensing can, and often is, akin to closed source software).
If you are a developer, GPL is a pain in the neck, since you can't distribute your work without granting the same rights you received when you used GPLEd software as part of your project (even then you can profit from your software without giving the source away if you actually don't distribute anything, a situation quite prevalent in the Internet if you have not noticed).
So your absolutis nonsensical statment clearly requires more context, I am sick an tired of people stating this nonsense when the situation is far more nouanced than they would like it to be.
gfgfg gdsdsrhbjdfa ;)
Does anybody know, how former Sun strategists think today of their license game?
cb
ZFS fits amazingly well to Apple's future and their style of computing. Right after this Netapp thing, they switched on "panic mode" and got rid of it. If they had a brain, 10.6 could be running HFSZ now.
Funny is, they will eventually switch to something which has ZFS features, don't forget "be nice to Apple if you want to deal with Disney/Pixar" factor. Some suits will really wonder if it was really worth it when World's trend leader uses something instead of their patents.
They could license it for cheap without hurting their main line of business. It is not like soon World will switch to Xserve blades you know. Apple is a company who can even license "Arial" from MS, a cheap mock up of Helvetica. SJobs isn't exactly rms.
...than hearing there's yet another FS coming to Linux.
If you look at the major features of ZFS, none of them apply to phones:
1) pooled storage management
2) integrity + self healing
3) snapshots
etc
To get the real payoffs with ZFS you need to have device redundancy. Also, a ZFS stack likes a lot of RAM. There's no real reason to run it on a phone or even a laptop (for most people). There are plenty of suitable filesystems for these situations.
you had me at #!
But it's aimed at the bigger system/server market, which does tend to be 64 bit. The 32 bit end is not going to get as much love.
Also see what TheRaven64 wrote above.
you had me at #!
... there was much of it. Very much of it!
I am also capable of making a politically loaded definition of freedom that fits my goals but then I would feel like a dirty car salesman who writes his own definition of one year warranty that is out of line with the common meaning.
I don't want a file system that is described as not that unstable really. I'll take just plain stable thank you.