Slashdot Mirror


Reiser4 Filesystem Released

trixie_czech writes "It's finally arrived. Go to namesys for reasons to use reiser4 as a filesystem and benchmarks. Go here to download. Enjoy!" The Namesys homepage in its current stage reminds me of a cross between The Secret Guide to Computers and the GNU Manifesto -- which is to say, there is a lot to read here, not just a bullet-pointed feature list.

162 of 637 comments (clear)

  1. ext3 to reiser4 ? by Anonymous Coward · · Score: 4, Interesting

    Will I be able to convert my exsisting ext3 fs to reiser4 fs withou having to reformat?

    1. Re:ext3 to reiser4 ? by Aardpig · · Score: 5, Informative

      Will I be able to convert my exsisting ext3 fs to reiser4 fs withou having to reformat?

      No, you will have to reformat. However, I recommend the upgrade; I've seen a number of studies showing that the performance of ext3 is awful compared to reiserfs. The only arguable advantage of ext3 is its compatibility with the baseline ext2.

      --
      Tubal-Cain smokes the white owl.
    2. Re:ext3 to reiser4 ? by Dwonis · · Score: 4, Insightful

      I doubt it. In general, that's not necessarily possible (though you can get away with it in special cases). In any case, doing that without a UPS would probably be risky, since there would be a (probably very long) period of time where the filesystem is totally incomprehensible to BOTH filesystem drivers (old and new), and if the system dies during that time, say bye-bye to your data.

    3. Re:ext3 to reiser4 ? by David+M.+Andersen · · Score: 5, Informative

      Possibly using convertfs, but I have no idea if it works or not.

      This page seems to have more info about it.

    4. Re:ext3 to reiser4 ? by treat · · Score: 3, Insightful
      No, you will have to reformat. However, I recommend the upgrade; I've seen a number of studies showing that the performance of ext3 is awful compared to reiserfs. The only arguable advantage of ext3 is its compatibility with the baseline ext2.

      ext3 has fewer bugs and has been through more testing. ext3 has a functioning fsck, reiserfs does not.

      For most applications the reliability of the filesystem is far more important than the performance.

      I'm definitely excited about reiser4 but I don't expect to be using it in production systems for years, unless I have an application that specifically requires it. If an fsck for reiser4 is never released, I might never use it.

    5. Re:ext3 to reiser4 ? by Aardpig · · Score: 4, Insightful

      Would it be possible to copy all data from the ext3 partiton to a network mountpoint(nfs, ftp, samba, etc...) format the drive to reiserfs, and then copy all the data back?

      Yes! Some advice, however: if possible, make two separate copies of your data on different remote servers. Also, check the integrity of your copies using something like md5sum -- there's nothing worse than moving data to a new location and finding out it's corrupted only after you have deleted the originals.

      --
      Tubal-Cain smokes the white owl.
    6. Re:ext3 to reiser4 ? by Aardpig · · Score: 5, Informative

      yeah, that, and *stability*. reiserfs has a noteable history of people losing their data because of filesystem problems.

      Not over the past couple of years -- the original corruption problems with reiserfs, although pretty severe, are well in the past now.

      --
      Tubal-Cain smokes the white owl.
    7. Re:ext3 to reiser4 ? by Aardpig · · Score: 4, Informative

      ext3 has a functioning fsck, reiserfs does not.

      I myself have never had any problems with reiserfsck -- what exactly is wrong with it?

      --
      Tubal-Cain smokes the white owl.
    8. Re:ext3 to reiser4 ? by shish · · Score: 2, Informative
      in ext3 there is no such thing as fast fsck after bad shutdown

      AFAIK, with journalling, there shouldn't be *any* fsck after a bad shutdown - with the few times I've pulled out power cords, I've never seen an ext3 fscking.

      Then it seems that reiser spends about a second doing a fast fsck every boot, whether is was shut down cleanly or not...

      --
      I mod down anyone who says "I will be modded down for this", regardless of the rest of their comment
    9. Re:ext3 to reiser4 ? by EMN13 · · Score: 5, Informative

      Nope convertfs won't work... From the horses mouth:

      To upgrade from reiserfs V3 to V4, use tar, or sponsor us to
      write a convertfs.

      The lkml posting is probably cached all kinds of places, but kerneltrap also reproduces it in full.

      Then again, reiserfs v4 and v3 have nothing to do with each other (unlike ext2 and ext3 for instance), so there's no quick fix possible probably.

      On the other hand - reiser4 is completely untested (compared to reiser v3 and jfs, xfs, ext2, heck even the wine-dll emulation layered ntfs writing driver...), so do yourself a favour and don't do anything quite so crazy as not just using it for a production machine but also trying to convert an existing system to it with 'smart' tricks... Give it a little while... or make a lot of backups...

    10. Re:ext3 to reiser4 ? by Anonymous Coward · · Score: 5, Informative

      >MD5 has been proven to have collisions.

      Statistically speaking you are more likely to get malaria in Arizona than experience a random MD5 collision.

    11. Re:ext3 to reiser4 ? by gordyf · · Score: 4, Funny

      Um, every hashing algorithm has collisions. There are more things to hash than there are resulting hashes.

    12. Re:ext3 to reiser4 ? by EMN13 · · Score: 4, Informative

      All hash functions have collisions; that's not the point... It's extremely unlikely for one to occur non-maliciously. The MD5 collision found was only found after some trivial mathematics done as a matter of principle by your network card just to spite you (okay, just kidding).
      It's still perfectly fine to use MD5 to check the validity of your files for bit-errors. Then again, so is CRC32.
      I do have a question to anyone more knowledgeable in MD5's weakness: although MD5 can now be spoofed , it's not clear to me from reading the news - is it only directly applicable to messages of a certain type/length or to all messages?

    13. Re:ext3 to reiser4 ? by 1000StonedMonkeys · · Score: 4, Informative

      Sure MD5 has been proving to have collisions, but that really isn't news. All hash algorithms have collisions simply because of the nature of what they do.

      Suppose you've got a 1K file. There are 2^1K possible values that file can assume. If you map those 2^1K values to the 2^160 values a SHA1 hash can assume, you have an average of 2^944 1K files that collide on any give SHA1 hash.

      What differentiates hash algorithms is their ability to prevent people from generate a text that matches a given hash. It is currently not possible to do this for either MD5 or SHA1. It has been speculated that MD5 is nearing the end of it's life in this regard though. I don't follow the field closely enough to weigh in on the matter, but I can tell you that the only thing that finding an actual md5 collision will do is demonstrate what was rather easily proved in the previous paragraph.

      As far as verifying files is concerned, the cryptographic strength of the hash algorithm is irrelevant. Unless you suspect someone will be tampering with your results, use whatever algorithm you can find a useful tool for, be it md5, sha1, or even crc32.

    14. Re:ext3 to reiser4 ? by menscher · · Score: 2, Informative
      I gained a healthy fear of ReiserFS a while back when it had some issues with playing nice with NFS. Basically, if I created an arbitrary link in my home-dir, it would sometimes screw up and the destination of the link would be the contents of someone else's file. A file which I do not have permissions to read. Needless to say, it's not hard to hack up a while loop that creates links and then does the ls -l and saves the output for later perusal.

      In any case, if you're looking for a really nice filesystem, use XFS. It was developed by professionals (SGI), is fast and stable, and is now released as open source.

      I suppose it's just a coincidence that the reiser benchmarks page doesn't compare it to XFS... or maybe they were too embarassed to show the results?

    15. Re:ext3 to reiser4 ? by Lisandro · · Score: 2, Interesting

      EXT3 sucks compared to (almost) every other filesystem in everything but one thing: it's stability. I've lost data to ReiserFS in the past, but i've *never* lost a byte under EXT3, even under extreme conditions.

      I still want to see what the fuzz is all about though ;) I'll be installing it on a spare HD this week.

    16. Re:ext3 to reiser4 ? by EMN13 · · Score: 3, Informative

      It is now possible to generate a bitstream that matches a given MD5 hash. It's recent news too...
      Some postings can be found here, and google is your friend :-).

      --Eamon

    17. Re:ext3 to reiser4 ? by 13Echo · · Score: 5, Informative
      ext3 has fewer bugs and has been through more testing. ext3 has a functioning fsck, reiserfs does not.


      "man reiserfsck"

      But ReiserFS doesn't need an "fsck" type program in normal circumstances. In power outages, etc., it's rock-solid. But for things like drive failures and the likes that tend to actually corrupt the data, then yes; EXT3 is the better choice. The reiserfsck program isn't intended to be run on the event of just any power outage or failed unmount, because those sorts of things don't tend to damage the filesystem.

      I've been using ReiserFS 3 for years and I've really been happy with the results. The only times (once or twice) that I've had problems were when I had severe hardware malfunctions (due to failing mobo capacitors and a dying hard drive), and my own carelessness when trying to repair the bad data.
    18. Re:ext3 to reiser4 ? by WindBourne · · Score: 5, Insightful
      In any case, if you're looking for a really nice filesystem, use XFS. It was developed by professionals (SGI), is fast and stable, and is now released as open source.

      And Reiserfs (and for that matter, Linux kernel) is not developed by professionals? Reiserfs is fully funded and the designers/coders are paid; By definition, PROFESSIONAL. But they are also talented

      I suppose it's just a coincidence that the reiser benchmarks page doesn't compare it to XFS... or maybe they were too embarassed to show the results?

      Please quit being a total twit. XFS has its' place, but for now, we are discussing ReiserFS. Just for the record, ReiserFS has been around for years, and does a great job with mixing loads of little to medium files. While XFS does an ok job, it really excells with the large files, in particular, very large sparse files.

      For what it is worth, I have used Reiserfs, XFS, JFS, EXT3, EXT2, and minix for linux FSs. I have found that they all have advantages depending on what you are doing. minix works for compatability (with very OLD linux); Ext2 does a great job with a mostly read only fs (think boot or /usr; Ext3 has the advantage of data journaling, but it is soooooo slllloooowwww; Jfs, XFS, and Reiserfs are my main ones and they always work.

      --
      I prefer the "u" in honour as it seems to be missing these days.
    19. Re:ext3 to reiser4 ? by FooAtWFU · · Score: 2, Interesting

      This is hearsay, mind you (think I found it in the manual for Gentoo at some point, comparing filesystems), but I hear that XFS isn't too good for ordinary computers' filesystems, because it "agressivele caches data in memory", which means that in the event of a system power failure or other crash, you lose a LOT. You apparently should have a good UPS with it.

      --
      The World Wide Web is dying. Soon, we shall have only the Internet.
    20. Re:ext3 to reiser4 ? by jasoneyre · · Score: 2, Informative

      I'll bite... Every hashing algorithm has collisions. Even SHA-1. It just has "less" collisions (infinities are strange) than MD5. XeeRz, Jason

      --
      THSsMCHshrtrTHN160chrs -- And I don't even like to SMS!
    21. Re:ext3 to reiser4 ? by Lshmael · · Score: 4, Informative
      You must be referring to section 4d in the Gentoo Handbook:
      XFS is a filesystem with metadata journaling which comes with a robust feature-set and is optimized for scalability. We only recommend using this filesystem on Linux systems with high-end SCSI and/or fibre channel storage and an uninterruptible power supply. Because XFS aggressively caches in-transit data in RAM, improperly designed programs (those that don't take proper precautions when writing files to disk and there are quite a few of them) can lose a good deal of data if the system goes down unexpectedly.
      Incidentally, the Handbook is very pro-ReiserFS (although it also says ext3 is "an excellent filesystem," reiserfs is used as the default filesystem in all of the examples). If you spend time on the Gentoo Forums, you will find a number of people who claimed reiserfs tried to kill their computer, and an equal number who swear by it.
    22. Re:ext3 to reiser4 ? by SaDan · · Score: 5, Informative

      I've successfully recovered a trashed array running ReiserFS after losing a CPU.

      reiserfsck is there, and does work.

      I've had more problems with the Ext filesystems than I care to mention, and we do not use Ext2 or Ext3 on any production machines that run Linux any more. Everything's ReiserFS v3, and once we start testing Reiser4, we'll move to that.

      Ext3 was a hack for compatibility with Ext2. It serves its purpose, which is easy upgrades and backwards compatibility.

    23. Re:ext3 to reiser4 ? by ePhil_One · · Score: 3, Informative
      It's true tho that a full *forced* fsck takes just as long on ext3 as it does on ext2...

      Its also true that by default after 6 months or 30 mounts an ext3 volume *will* perform a full fsck. This can be very painful if the volume is large enough/holds enough files that an fsck will take 24 hours plus (I've seen this several times)

      Personally, I'm a fan of IBM's jfs. I had some early problems with it but they were real responsive to every issue I found while punishing it as an NFS volume in a test system.

      --
      You are in a maze of twisted little posts, all alike.
    24. Re:ext3 to reiser4 ? by 1000StonedMonkeys · · Score: 2, Informative

      Thanks for the link. I actually wasn't aware of that particular attack. I'm still not sure that it means that's it's possible to generate a message with a given hash though. The attack presented talkes about generating two messages, M and M' such that M and M' have the same md5 hash. This is a potential problem, but it's still a step away from being able to generate a message that matches a particular hash.

    25. Re:ext3 to reiser4 ? by Anonymous Coward · · Score: 5, Funny

      I myself have never had any problems with reiserfsck -- what exactly is wrong with it?

      You don't know? The problem with reiserfsck is that it is invisible to those who are dogmatically anti-Reiser. Hans is currently working on a ReiserDecloak() function to address this.

    26. Re:ext3 to reiser4 ? by ispeters · · Score: 2, Insightful

      I'm not very knowledgeable in this department, but don't all hash algorithms have collisions? There's a hell of a lot of 128-bit numbers, but there are a lot more 256-bit numbers than 128-bit numbers, so hashing two arbitrary 256-bit files could result in the same hash value. And a 256-bit file is pretty freaking small, so hashing any two arbitrary files could, potentially, result in a collision, no?

      Ian

    27. Re:ext3 to reiser4 ? by zenyu · · Score: 2, Interesting

      When ever someone mentions data loss from ReiserFS it's always "other people", "a friend", etc. I've been running ReiserFS on a number of machines for several years, never had the slightest problem with it.

      I lost some data on a ReiserFS partition that went bad. Nothing that wasn't backed up, but it was still a PITA. It was scary because it was silently eating my files, it wasn't like the ext2/FAT problems I was used to where fsck told you something useful. This was years ago, and I've had ReiserFS partition last 2 years now on a laptop without problems.

    28. Re:ext3 to reiser4 ? by vocaro · · Score: 2, Interesting

      Unless it is a perfect hash, of course.

    29. Re:ext3 to reiser4 ? by macz · · Score: 2, Informative

      Joux has apparently proved (though no utilities are out yet) that you can:

      Create a file with a pre-determined hash, and do so in a computationally feasible way (rumor has it: using _only_ 2^40 calculations...)

      That is it. This means that at compute time you can MD5 a file and get its hash, and then create a garbage binary file with the same hash. In just 2^40 steps.

      Big Damn Deal.

      One thing that is interesting from a performance standpoint is that MD5 is great for keys (provided you don't have a rogue admin with a lot of time on their hands and heretofore unreleased MD5 hacking utilities), but MD5 is terrible for indices. Since MD5's are absolutely random there is as much chance as an MD5 being next to another as 2^128 key spaces away.

      --
      ...But I digress. TREMBLE PUNY HUMANS!ONE DAY MY SPECIES WILL DESTROY YOU ALL!
    30. Re:ext3 to reiser4 ? by Aardpig · · Score: 2, Informative

      Doesn't Linux have any byte-by-byte comparison tools ? It seems like a total waste to compute MD5s to compare two local files...

      Yes, it does -- diff. However, the point here is that the files aren't side-by-side; one is on the local machine, and the other on a remote server. Hence MD5.

      --
      Tubal-Cain smokes the white owl.
    31. Re:ext3 to reiser4 ? by minion · · Score: 5, Informative

      I suppose it's just a coincidence that the reiser benchmarks page doesn't compare it to XFS... or maybe they were too embarassed to show the results?
      ---

      Please quit being a total twit. XFS has its' place, but for now, we are discussing ReiserFS. Just for the record, ReiserFS has been around for years, and does a great job with mixing loads of little to medium files. While XFS does an ok job, it really excells with the large files, in particular, very large sparse files.


      I just wanted to add my two cents to this: We had done internal benchmarks at our company, and found XFS to be the fastest filesystem, and seemed to have a good track record with the community. (We didn't consider reiserfs because of its lack of bad block handling).
      Either way, we converted ONE of our 2 Terabyte mount points to XFS. Whenever a file would be created on that mount point that exceeded 4G, bdflush would peg the cpu at 100%, commits to the disk would cease, and file system corruption ensured.

      This was with kernel 2.4.23.. The problem was fixed in 2.4.25 (maybe 2.4.24, but we never tested that kernel). When we had this issue, and linked it to XFS (through another test system), we quickly migrated away from XFS, back to ext3.

      We never had a problem like that was the ext's. We've lost data with both reiserfs and XFS. And if you grep the changelog for the kernels on XFS, you'll see tons of fixes for "deadlocks, race conditions, oopses", etc. These were all fixes AFTER 2.4.23..

      Lesson: Stop playing with something that works, and be happy your servers serve. We never made it to testing JFS, and we probably won't. Ext3 might not be the fastest kid on the street, but it has been the most reliable for us.

      --

      -- If we don't stand up for our rights, now, there will be no right to stand up for them later.
    32. Re:ext3 to reiser4 ? by diamondsw · · Score: 2, Informative
      Hold on a second - according to your own link, one CANNOT create a file that matches a given hash. They can create two streams with matching hashes, but they can't take an arbitrary existing file and create another file with the same hash.

      An attacker can generate two messages M and M' such that Hash(M) = Hash(M'). Currently this is possible for MD5 but we have to consider the possibility that it will be eventually possible for SHA-1. Note that he cannot (currently) generate a message M such that Hash(M) is a given hash value, nor can he generate a message M' such that it hashes the same as a fixed message M.
      --
      I don't know what kind of crack I was on, but I suspect it was decaf.
    33. Re:ext3 to reiser4 ? by AvantLegion · · Score: 3, Funny
      >> Statistically speaking you are more likely to get malaria in Arizona than experience a random MD5 collision.

      I've been feeling ill ever since I came home from Flagstaff...

    34. Re:ext3 to reiser4 ? by Emil+Brink · · Score: 2, Informative

      diff(1) is primarily a text comparison tool, it tries to find the minimum difference between two text files and is very handy for creating e.g. patches to source code. For comparing arbitrary files though, you might want a tool that simply compares them byte-by-byte, and in that case you need to use cmp(1).

      --
      main(O){10<putchar(4^--O?77-(15&5128 >>4*O):10)&&main(2+O);}
    35. Re:ext3 to reiser4 ? by Anonymous Coward · · Score: 2, Interesting

      My experience has been the reiserfsck generally does a less good job of recovering slightly borked filesystems than e2fsck. This is kind of what you'd expect, since ext2 gets borked far more often than Reiser, so it's fsck gets thoroughly tested,
      and ext3 can then use almost the same code to recover if it has a problem.

      Obviously, it isn't possible to make a fair comparison between the two, because they don't run on the same filesystems and the FS structures are
      different enough that it doesn't make much sense to talk about ``similar levels of corruption''.

      Having said that, the only reason I'm running ext3 now rather than reiser is that this machine dual boots with FreeBSD, which supports the ext family but not Reiser. Reiser is a seriously cool piece of code, but not yet perfect.

    36. Re:ext3 to reiser4 ? by Wavicle · · Score: 2, Insightful
      Because I can show you a collision in MD5. It's not that hard.
      # echo "There's gold in them thar hills!" |md5sum
      208b337f8c1a507ffd9fdf39e6178edb
      There's a message and its hash. If it isn't that hard, produce a collision. Preferably one that could potentially be either a corrupted version of the original or a malicious alteration. After that we'll see if it is truly "easy" to produce something similar embedded in a .tar.gz file.
      --
      Education is a better safeguard of liberty than a standing army.
      Edward Everett (1794 - 1865)
    37. Re:ext3 to reiser4 ? by kimba · · Score: 3, Insightful

      Apparently, Omnifarious is stubbornly concerned that someone might hack into this guy's computer when he is transferring from ext3 to reiser4, spend significant (hypothetical even) resources in generating identical files that have the same md5 sum in the brief window of opportunity before the file transfer is complete. And what would be the attacker's gain? Nothing more than pissing this guy off by having a couple of corrupted files.

      Yes, MD5 collisions have been shown. That has NOTHING to do with the problem at hand regarding checking file corruption when transferring between two disks. The argument that MD5 should be abandoned for this purpose is ridiculous.

    38. Re:ext3 to reiser4 ? by ASkGNet · · Score: 2, Funny

      Except the fact that perfect hash does not support changing of dataset after performing the conversion to a perfect hash.

      So please, take all possible files, run a perfect hash on them (remember, it will take at least O(N) and at worst - infinite amount of time), brew some coffee while you are at it, and you may want to steal a Cray or a thousand of them.

      Also, by the Murphy's law, you will get busted by FBI in the last second before it completes running - since all the possible files include all the MPAA and RIAA-protected files.

      (note, I am aware that the number of possible files is infinite - aleph 0 in fact - but let that slip for now)

    39. Re:ext3 to reiser4 ? by boaworm · · Score: 4, Insightful

      This is the danger of ext3 journaling (and possibly others as well). It makes people beleive that just because the filesystem passed as "clean" during boot, no corruption occured. Try a full fsck after a year or so of running (with a number of power failures/OOPS'es), and you will probably find a number of ext3 fs corruptions not detected by the "fast" fscking.

      As far as reiserfs is conserned, bring me quota and i'll consider it. Until then, it's ext3 with full fsck's at boot.

      --
      Probable impossibilities are to be preferred to improbable possibilities.
      Aristotele
    40. Re:ext3 to reiser4 ? by Anonymous Coward · · Score: 2, Insightful

      Great! Now let's just wait a few years until "original corruption problems with reiserfs 4" are well in the past, too, and we can start using it.

      You're missing an important point, which is that so far there haven't been any reports of corruption with Reiser4.

      Your attitude is a bit like saying that you'll never touch Linux 2.6 because of those problems early in the 2.4 series. Like, WTF?

    41. Re:ext3 to reiser4 ? by ttldkns · · Score: 2, Informative

      Alternatively use rsync's checksum feature! here are rsyncs best options to get an exact copy of your data: rsync -Ppogrtlhc *old location* *new loation* the options are permissions, progress, owners, groups, recursive, cant remember t, soft links, hard links, checksum. Not really for the overly paranoid but its always worked fine for me and i still have a functioning OS, just one with slightly better partitions!

      --
      How many computers are too many?
    42. Re:ext3 to reiser4 ? by chtephan · · Score: 3, Informative

      That was because reiserfs only hat a writeback journal then. The means that it could happen (very often) that the metadata was written before the actual data was and you would end up with random data in the files that were written just before the crash.

      I know it because I had the same problems.

      But the current 2.6 kernels have a lot of improvements. reiserfs now also has data=ordered and data=journal journalling modes (with ordered-data being the default now). This means that the actual data is written before the metadata is committed. I've never had those problems again.

      And, BTW, it's hardly the fault of the filesystem that you lose some data if your system crashes.

      The current reiserfs in 2.6 also has a lot of other improvements. A better block allocator, quota and ACL support. If you need those for 2.4, SUSE has had the patches in their kernels for some time now.

    43. Re:ext3 to reiser4 ? by Aardpig · · Score: 2, Funny

      Like what? Stop trolling arsehole. Please point to a significant amount of racist posts, or shut the hell up.

      Ah, good to see that the BNP is here!

      --
      Tubal-Cain smokes the white owl.
    44. Re:ext3 to reiser4 ? by Anonymous Coward · · Score: 2, Insightful

      Yes, but remember Reiser4 is a complete rewrite. There is no basis for extending the trust for Reiser3 to Reiser4, especially as the immature Reiser3 was unstable.

    45. Re:ext3 to reiser4 ? by phoenix_rizzen · · Score: 2, Informative

      The problem with reiserfsck is that is will halt a boot of a RedHat system (waiting for someone to type "Yes" or "No" to run the fsck), that it is not named the same as the rest of the fsck tools (you can't use "fsck -t reiserfs"), and the output is completely different from the rest of the fsck tools.

      Why can't all the filesystem designers rename, or provide links on install, their fs utils to match the standard fs utils??

    46. Re:ext3 to reiser4 ? by Heywood+Jablonski · · Score: 2, Informative
      Suppose you've got a 1K file. There are 2^1K possible values that file can assume.

      2^8K possible values, unless you meant a 1Kbit file.

  2. Windows port? by Anonymous Coward · · Score: 3, Interesting

    Will we ever have a Windows port of ResierFS or any alternative filesystems?

    1. Re:Windows port? by Coneasfast · · Score: 5, Informative

      there is rfstool for reiserfs (afaik not v4)
      and many for ext2/3

      if OTOH, you are looking for a fully featured driver that can be used for production use, then i wouldn't count on it

      --
      Marge, get me your address book, 4 beers, and my conversation hat.
    2. Re:Windows port? by Aardpig · · Score: 4, Informative

      Will we ever have a Windows port of ResierFS or any alternative filesystems?

      I'm not sure about ReiserFS, but there is already a program -- Explore2fs -- which lets you mess around with Ext2 and Ext3 partitions from Windows. Why you would want to do that is beyond me, but there you go.

      Of course, you may be talking about a native Windows implementation of Ext2/3 and/or ReiserFS. Which is a totally different kettle of fish...

      --
      Tubal-Cain smokes the white owl.
    3. Re:Windows port? by Stevyn · · Score: 2, Insightful

      You're talking about porting a file system assuming the operating system is unaware of it. We can look at the source code and linux and find that answer out, but with windows it's more difficult to tell. Since Microsoft seems to only support FAT, FAT32, and NTFS, I'm sure that's built into the kernel for speed. So unless you're going to make something that emulates NTFS on top of reiser, I doubt it would ever work. And if you're going to do that, what's the point at the end of the day?

      For windows and linux compatibility, I always use FAT32. Linux isn't perfectly stable with NTFS and Microsoft only touches microsoft formats (hey, why not?).

    4. Re:Windows port? by Daverd · · Score: 3, Informative

      I'm not sure about ReiserFS, but there is already a program -- Explore2fs -- which lets you mess around with Ext2 and Ext3 partitions from Windows. Why you would want to do that is beyond me, but there you go.

      I have a hard drive with Windows installed on it and a hard drive with Linux, and I use both OSes. Explore2fs is handy when I'm in Windows but I need to grab a file on my Linux drive.

    5. Re:Windows port? by j3110 · · Score: 2, Informative

      YAReg

      http://yareg.akucom.de/index.html

      works for me now.... I have to say I would much prefer a real driver, but beggers can't be choosers.

      --
      Karma Clown
    6. Re:Windows port? by itzdandy · · Score: 2, Interesting

      try this, run bochs with a small linux distro, no gui just bash. install samba to have access to ALL linux compatible filesystems and export you /mnt folder via samba.

      this would also allow you to 'map a network drive' and give your samba share a drive letter.

    7. Re:Windows port? by irc.goatse.cx+troll · · Score: 2, Informative

      Explore2fs is nice, but if you want something better, take a look at ext2fsd. You can actually mount the partition(eg, G:\ or whatever) and have all your data usable by any windows app, rather than having to navigate inside explore2fs and copy it out.

      It can read/write ext2 and readonly ext3, and hasnt messed my data up yet. if you're scared leave it in its default readonly mode and you should be fine.

      google will find a link, its also linked to at the official ext2fs homepage on sourceforge.

      --
      Pain lasts, kid. Its how you know you're alive. Sometimes I think this growing up thing is just pain management-TheMaxx
  3. oooooo, dancing trees! by fishbert42 · · Score: 5, Funny

    ... but can they tango?

    1. Re:oooooo, dancing trees! by peculiarmethod · · Score: 4, Informative

      "* Reiser4 uses dancing trees, which obsolete the balanced tree algorithms used in databases (see farther down)"

      that's what he meant.

      oh, and whoever moderated offtopic didnt rtfa, either. damn, peeps.. what is wrong with this community these days?

      pm

      --
      ** "It's not my job to stand between the people talking to me, and the ones listening to me." -- Pego the Jerk
    2. Re:oooooo, dancing trees! by Jeremi · · Score: 4, Funny

      I don't know about you, but for me the tfa isn't about algorithms at all, but rather is a very short piece regarding "server timeouts". :^P

      --


      I don't care if it's 90,000 hectares. That lake was not my doing.
    3. Re:oooooo, dancing trees! by Fortyseven · · Score: 2, Funny

      Not just trees, but ATOMIC DANCING TREES. Crazy shit, and obviously representing a superior filesystem. :D

  4. Only one question... by Pathway · · Score: 4, Interesting

    I only have one question (And I obviously have not researched an answer...):

    Is there an easy and non-destructive way for me to migrate my ReiserFS version 3 to a version 4 Filesystem?

    --Pathway

    1. Re:Only one question... by EMN13 · · Score: 5, Informative

      Well, Mr. Reiser Dude suggests tar in his posting to lkml which can also be viewed on kerneltrap.org.

      In other words,

      no.

    2. Re:Only one question... by jrcamp · · Score: 3, Insightful

      Star does though.

    3. Re:Only one question... by codemachine · · Score: 2, Informative

      Too bad ReiserFS doesn't have a dump utility.

    4. Re:Only one question... by pnatural · · Score: 2, Informative

      And the answer is cheap! You should view the namesys.com support page:

      $25 gets you an answer to a question about anything.

      BTW, I'd like to know the answer, too. Could you go pay and ask the question, then come back and tell us all the answer?

  5. Reiser4 may be great.... by moosesocks · · Score: 3, Funny

    but will it save Namesys from a slashdotting?

    Seriously.... their server admins must be FSCKing angry.

    --
    -- If you try to fail and succeed, which have you done? - Uli's moose
    1. Re:Reiser4 may be great.... by hansreiser · · Score: 3, Funny

      We only have a 100 megabit fiber optic connection to the internet, and it can't handle this load, sigh.... Slashdot is amazing....

      Hans

  6. Been using Reiser4 on the / for 2 weeks now by Anonymous Coward · · Score: 2, Informative

    Yea, I would definitely recommend it. It's extremely speedy.

  7. Helpful Mirror by Anonymous Coward · · Score: 4, Informative

    Reasons why Reiser4 is great for you:

    * Reiser4 is the fastest filesystem, and here are the benchmarks.
    * Reiser4 is an atomic filesystem, which means that your filesystem operations either entirely occur, or they entirely don't, and they don't corrupt due to half occuring. We do this without significant performance losses, because we invented algorithms to do it without copying the data twice.
    * Reiser4 uses dancing trees, which obsolete the balanced tree algorithms used in databases (see farther down). This makes Reiser4 more space efficient than other filesystems because we squish small files together rather than wasting space due to block alignment like they do. It also means that Reiser4 scales better than any other filesystem. Do you want a million files in a directory, and want to create them fast? No problem.
    * Reiser4 is based on plugins, which means that it will attract many outside contributors, and you'll be able to upgrade to their innovations without reformatting your disk. If you like to code, you'll really like plugins....
    * Reiser4 is architected for military grade security. You'll find it is easy to audit the code, and that assertions guard the entrance to every function.

    V3 of reiserfs is used as the default filesystem for SuSE, Lindows, FTOSX and Gentoo. We don't touch the V3 code except to fix a bug, and as a result we don't get bug reports for the current mainstream kernel version. It shipped before the other journaling filesystems for Linux, and is the most stable of them as a result of having been out the longest. We must caution that just as Linux 2.6 is not yet as stable as Linux 2.4, it will also be some substantial time before V4 is as stable as V3.

    1. Re:Helpful Mirror by dubl-u · · Score: 3, Funny

      Sure, the text might be helpful, but I think much of the value of this article comes from the images that go with it. E.g., this one.

      No, really, they use a bunch of illustrations like this in the linked article. It dumbfounds me.

    2. Re:Helpful Mirror by PingXao · · Score: 4, Insightful

      "Reiser4 is architected for military grade security."

      DING * DING * DING * DING

      Alarm bells going off here. There is no commonly accepted definition of what constitutes "military grade security". Authors and vendors should avoid this terminology like the plague. It reeks of snake oil and most security profressionals will look askance at anything that touts this "feature". Having said that, I've used Reiser3 and I think it's great. There's no reason to think Reiser4 won't be even better. Given its plugin architecture there's also no reason to think that secure plugins can't be developed for it in a transparent way that actually provide good security. Maybe my complaint here is pedantic. Never say never, but no software program should ever use the phrase "military grade security" if it wants to be taken seriously. There is no standard of "military grade security" by which such claims can be measured. Why would you want your software to be grouped with fraudulent security products, even if yours really is secure.

    3. Re:Helpful Mirror by JamesKPolk · · Score: 5, Insightful

      When you're being paid by the military and being told what their needs are, you can say military all you want.

    4. Re:Helpful Mirror by JamesKPolk · · Score: 3, Informative

      Plus, for filesystems, there *is* a definition: Mandatory Access Controls are a published NIST standard.

    5. Re:Helpful Mirror by tonyr60 · · Score: 2, Informative

      " Reasons why Reiser4 is great for you:

      * Reiser4 is the fastest filesystem, and here are the benchmarks."

      All the benchmarks show is that Reiser4 is a bit faster than EXT3. No mention of Sun's new fs (ZFS) or any other. I don't see how it can justifiably called the fastest file system.

    6. Re:Helpful Mirror by zmooc · · Score: 2, Insightful

      How does your test tell us anything at all about the speed of the filesystem? I think it tells us more about how many times you can fork() touch in a certain amount of time:P

      --
      0x or or snor perron?!
  8. I know everyone's thinking it... by Elote · · Score: 3, Interesting

    IT'S ABOUT FREAKING TIME!!!!!

    I did an informal comparisson of this fs against several others for one of my classes, and my results had it winning _hands down_.

    But on a more serious note, I hope this release is stable. From lurking on their mailing list, it seems that it hasn't been too long since they were in bug-squashing mode.

    1. Re:I know everyone's thinking it... by Elote · · Score: 2, Insightful

      Yeah, of course it won't be as stable as V3 initially, but I just have a problem with them saying that it is "released". If they had said that a "release candidate" had been released or that it had been released to the mm tree(not vanilla yet) then this would have irked me a little less. Saying "it is released" implies a little more than what they meant.

  9. Who's got the balls... by Stevyn · · Score: 4, Interesting

    ...to use it for a while. I'm sure it's been tested very extensively, but there are always bugs initially in any major release like this. I'm sure nobody running a server will touch this for a while even with the benchmarks.

    I'm not trying to spread FUD on reiser at all, I run reiser 3 and I've never had any problems. I'm just raising the question of how long does it take until people will put it in production servers and their main desktops?

    Anyone who maintains servers care to shed some light on this?

    1. Re:Who's got the balls... by dtfinch · · Score: 5, Informative

      When deciding which filesystem would be best for our first critical samba file servers, this post and other scattered rumors of unreliability scared us away from reiser3 for the time being:

      http://www.redhat.com/archives/fedora-list/2004-Ju ly/msg00418.html

      The date of the post caught my eye. The test was very recent. Ext3 won in this particular case, by a longshot, leading a Red Hat employee to respond "Your investigation proves that we default to the right mode ;)".

      I haven't seen ext3 (ordered) lose in any reliability benchmarks versus jfs, xfs, or reiserfs, though it's hard to find many such benchmarks.

    2. Re:Who's got the balls... by SaDan · · Score: 5, Interesting

      It hasn't been my experience that ext2 or ext3 filesystems are more reliable than ReiserFS. At least, not where I work (I only run ReiserFS at home).

      Over the past year, we've had some fairly serious filesystem failures on some of our DB and large FS servers. Ext3 on failed in every instance, Reiser was recoverable (similar RAID/hardware/useage/failure).

      We pound the living hell out of our machines, day and night, with billions of small files every year. ReiserFS makes Linux work for us.

      There are some instances where ReiserFS v3 is slower than Ext3, but we don't care about that any more. We're finished with Ext2/3, and are looking forward to testing ReiserFS4 now that it's been released.

    3. Re:Who's got the balls... by uhoreg · · Score: 3, Informative
      That's old news. That particular case of ReiserFS corruption is due to the fact that ReiserFS (until a little while ago) only did metadata jounalling and did not ensure that data is written before metadata. The problem could have been fixed by applying a well-known patch (at least well-known among the ReiserFS community), which has recently been merged into the mainline kernel (at least the 2.6 series, though I'm sure 2.4 has it too).

      Reiser4 does not have such a problem, as it operates in data=ordered mode by default.

      --

      To get something done, a committee should consist of no more than three persons, two of them absent.

    4. Re:Who's got the balls... by amorsen · · Score: 2, Informative

      In the test, the filesystem eventually failed to mount, and reiserfsck failed to fix it. Not very nice at all. Some lost data is one thing, a lost filesystem is quite another.

      --
      Finally! A year of moderation! Ready for 2019?
    5. Re:Who's got the balls... by hansreiser · · Score: 5, Interesting

      Keep in mind that redhat kernels are highly patched and they don't apply reiserfs bugfix patches out of a deliberate policy to exclude them (yes, we offered to supply them but were rejected), so we don't recommend the use of redhat kernels for reiserfs, we recommend the official kernel, or the SuSE kernel.

      RedHat are the guys that at one point shipped their kernel with REISERFS_DEBUG turned on just to make us look slow.....

      I don't know why RedHat regards us as in the enemy SuSE camp just because we took money from SuSE, we would take money from RedHat too if it was offered....;-)

      These distro rivalries are distasteful to me.

      Hasn

    6. Re:Who's got the balls... by Oestergaard · · Score: 2, Interesting

      Well, several of the ext3 people are employed by RedHat - it makes sense that they don't want to work with Reiser but rather spend time on ext3.

      As a company, when you have good employees who like to do A and don't want to do B, you can either force them to do B and deal with the possible consequences, or simply prioritize B lower and be happy with A.

      I'm not surprised that RedHat did what they did - it's the problem of limited ressources.

      And no, I don't mean to bash RedHat - no distributor is big enough to do everything 100%.

    7. Re:Who's got the balls... by justins · · Score: 3, Insightful
      I'm not surprised that RedHat did what they did - it's the problem of limited ressources.

      Read what Hans wrote again. Shipping their kernel with REISERFS_DEBUG turned on isn't a question of limited resources, it's a deliberate attempt to undermine the performance of Reiserfs on that platform.

      (and yes, I've read the excuses for this, and no, I don't use reiserfs, so it's not like I'm carrying water for them, but Redhat's behavior in this regard has been awful)
      --
      Now before I get modded down, I be to remind whoever might read this that what I am saying is FACT. - bogaboga
  10. What's with that link? by Chordonblue · · Score: 3, Funny

    There doesn't seem to be a Windows version of Reiser on that li....

    Oh...

    --
    "...Well, there's egg and bacon; egg sausage and bacon; egg and spam; egg bacon and spam; egg bacon sausage and spam..."
  11. Yea that homepage looks like alot of others by TigerTime · · Score: 3, Funny

    "The Namesys homepage in its current stage is reminds me of a cross between The Secret Guide to Computers and the GNU Manifesto " Yea, i see "This page cannot be found" on alot of websites

  12. Stability by Anonymous Coward · · Score: 3, Insightful

    I remember reading something a while back about how ReiserFS would occasionally barf and corrupt data... And that the Dev response was something to the effect of 'so what?'.

    How stable in this new version in terms of data loss? Is this something that's optimized to run on a RAID array--with, say mirroring--that gets it's speed from dangerous shortcuts that are only acceptable in a non-single-disk environment?

    1. Re:Stability by Wesley+Felter · · Score: 4, Insightful

      If your filesystem has bugs, no amount of RAID will save you.

    2. Re:Stability by Anonymous Coward · · Score: 2, Funny

      Not even this much?

    3. Re:Stability by hansreiser · · Score: 4, Informative

      Our response is definitely not so what. We might have told you that metadata journaling (what V3 uses) provides a level of service in which, like FFS and many other filesystems before it, if you crash during a write the write gets garbled.

      Reiser4 is fully atomic though, and a write will either make it to disk entirely or not at all, with no data garbling. In other words, assuming that metadata journaling was what made you unhappy, we listened, but waited until a deep rewrite could allow us to fix it with no significant performance loss.

      We are very happy that the use of wandering logs allowed us to make things atomic without losing any significant performance.

    4. Re:Stability by Anonymous Coward · · Score: 4, Funny

      Dancing trees, wandering logs - sounds like the ReiserFS development lab is more of an anthropomorphic lumbermill.

  13. His thoughts on NTFS... by blackketter · · Score: 5, Interesting

    IF you can get to the site, you'll find this juicy reference at the end:

    [NTFS]

    "Inside the Windows NT File System" the book is written by Helen Custer, NTFS is architected by Tom Miller with contributions by Gary Kimura, Brian Andrew, and David Goebel, Microsoft Press, 1994, an easy to read little book, they fundamentally disagree with me on adding serialization of I/O not requested by the application programmer, and I note that the performance penalty they pay for their decision is high, especially compared with ext2fs. Their FS design is perhaps optimal for floppies and other hardware eject media beyond OS control. A less serialized higher performance log structured architecture is described in [Rosenblum and Ousterhout]. That said, Microsoft is to be commended for recognizing the importance of attempting to optimize for small files, and leading the OS designer effort to integrate small objects into the file name space. This book is notable for not referencing the work of persons not working for Microsoft, or providing any form of proper attribution to previous authors such as [Rosenblum and Ousterhout]. Though perhaps they really didn't read any of the literature and it explains why theirs is the worst performing filesystem in the industry....

    1. Re:His thoughts on NTFS... by irgu · · Score: 3, Informative
      The "Inside the Windows NT File System" book is 10 years old and discusses an at least 14-15 years old design. However over the last 10 years, apparently Microsoft worked hard on NTFS because it was improved a lot performance (pre-fetching data, metadata rearrangements, block allocation optimizations, etc), features (sparse file, compression, encryption, quota, symlinks support, etc) and reliablility-wise.

      NTFS was usually between Reiserfs and Reiser4 in the benchmarks I've seen so far. Reiser4 being always the fastest by about 5-20%.

  14. Re:ATOMIC FILE-ING SYSTEM HERE I COME by ctr2sprt · · Score: 3, Informative
    I'm sorry, but when you're talking about hard drives, there is no "atomic." It's as simple as a power failure while the disk drive is in the middle of writing a block (albeit a block sent atomically by the OS). Or as simple as a RAID controller with a write cache, or a hard drive with a write cache. Or hell, you could lose power while bits are flying across the controller cables.

    And yeah, you'd better believe it happens. The BSDs use a similar approach called SoftUpdates (basically odrered writes). If power craps out in the middle of a write, you will have corruption. The main advantage is that, because writes aren't scattered all over, you only lose the file(s) you were most recently working on. This focuses the damage, it doesn't reduce it at all.

  15. Well? by iamdrscience · · Score: 2, Funny

    Somebody post a bulleted list of featuress already! I'm a busy man, I don't have time to read anything longer than two and a half pages of double-spaced 12pt Courier, and that's only for the executive summary of my encyclopedia A-L anyways.

  16. Re:here is the text from namesys.com by Tyir · · Score: 4, Informative

    Actually, v3 is NOT the default filesystem of Gentoo, Gentoo has no default filesystem, you pick what you want. They give the easy option of ext2/3 xfs and reiser

  17. Sweet! by chizu · · Score: 3, Insightful

    Now when will we see it in the vanilla kernel?

    1. Re:Sweet! by hansreiser · · Score: 4, Informative

      If we go for a week in -mm with no bug reports, I send it to Linus.

  18. First Post by HermanAB · · Score: 2, Funny

    Damn ext3...

    --
    Oh well, what the hell...
  19. Comment removed by account_deleted · · Score: 2, Informative

    Comment removed based on user account deletion

  20. No compelling reason to upgrade by Anonymous Coward · · Score: 5, Funny

    I'm going to stick w/ Emacs for my filesystem thank you.

  21. adoption of new features will be an uphill battle by dekeji · · Score: 2, Interesting

    ReiserFS is great, and this seems like a tasteful way of implementing some of the complex things people seem to want to do with file systems.

    But I would feel uncomfortable relying on any of these features right now because any software that does would fail with any other file system. ReiserFS is free software, but you still end up needing to run software on other file systems in many cases.

    I think for these features to become widely adopted, we need some kind of library-based emulation, something that uses ReiserFS if it runs on it and otherwise emulates ReiserFS features like files-as-directories in user mode on top of existing file systems (by using funny file names, etc., similar to UMSDOS).

  22. Huh? by Enahs · · Score: 5, Informative

    Um, yes, there is an advantage. That's what the journal is for (duh.)

    It astounds me that your post was marked as "Informative," because it's downright wrong.

    Now, if you're talking about fsck after a certain number of boots, or a full fsck for whatever reason, then no, there's no advantage over ext2. It's ext2 + improvements + journal, for the most part.

    For my money, using ext3 without btree hash dirs is stupid nowadays. Go back and bench reiser vs. ext3. ext3 is usually still slower, but the gap is narrower nowadays.

    --
    Stating on Slashdot that I like cheese since 1997.
    1. Re:Huh? by timeOday · · Score: 5, Interesting
      I did a comparo of ReiserFS and Ext3 a while back and these were my main findings:

      1) Reiser destroyed Ext3 for directories with many thousands of files in them. However, now you say ext3 has btree hash dirs, probably minimizing the difference
      2) Resier was much more space efficient if the average file sizes on the filesystem is very small (say, well under 4k). However, no *real* filesystems I found were like this.
      3) The two were about the same in speed for large numbers of small reads and writes.
      4) Ext3 was a bit faster for big sustained reads/writes. But it wasn't a huge difference and might not apply to Reiser4.

      In short, Reiser4 was more robust to unusual filesystem usage, at a slight penalty to normal usage.

      In fairness, this is because Ext has been around for so long, it is optimized for normal usage, and software is tailored not to step on the toes of Ext's deficiencies. For instance, to store huge numbers of small files, people usually use a database of some sort (even if only flat file). Reiser opens the possibility of simplifying life by replacing simple databases of small records with the filesystem; for instance, it might be practical for a Usenet newsreader to store every cached message in a separate file.

      But for the most part, I think Reiser will stand on its new gee-whiz features (plugins), rather than raw performance, since there are so many filesystems with roughly comparable performance for normal usage scenarios. As with Longhorn's fancy new filesystem, the question is whether people really want feature-rich files.

    2. Re:Huh? by hansreiser · · Score: 5, Informative

      ext3 btrees are not well done performance wise. Most users are best off not using them, because they significantly slow performance unless directories are large, and I think that is why they are not on by default.

      V3 of reiserfs paid a performance penalty for saving space and handling large directories efficiently. This irritated the shit out of me, the author, and we fixed it in V4 and then some.:)

      V4 is finally to where it is sweet, and works like I fondly imagined earlier version of reiserfs would. We fixed deep design errors, and V4 is a complete rewrite from scratch reflecting all our regrets accumulated over 10 years of learning what the hell we were doing. We were beginners when we started out, as everyone is.

      Now, the space savings makes things go faster not slower, and does not add seeks. We learned from XFS also, and allocation on flush works very well. Thanks SGI, for taking the time to explain to me why I should adopt allocation on flush in ReiserFS. XFS is a great filesystem.

      Now that the performance advantage is ours for the now, and there aren't irritating flaws bothering me, we should and will move to semantic features not performance as our focus. The post above is right about that. Semantics matter more than performance.

  23. Re:ATOMIC FILE-ING SYSTEM HERE I COME by Geiger581 · · Score: 5, Informative

    Err, the point of atomicity w/ journaling in a heirarchical system is that if you lose power during a write, it is data to which no parent i-node or directory points. The data being created or altered is written first, then its updated directory, and then its parent directory on up to the root. Or you have one journal level, where the file is written to journal and then the journal entry is copied over the original location. If power dies when the journal is being written, data is lost but the FS maintains integrity, or if the power goes during the copy, the journal exist. Atomicity means that a transaction either happens all the way or not at all, and Reiser4 does guarantee this. In-flight data can be lost so long as partially written data does not leave the system or some other API-level atomic transaction partially completed.

  24. MANIFESTO by YetAnotherName · · Score: 2, Funny

    Yes, that certainly comes across more like a manifesto than a detailed exposition of software architecture. I have to admit, reading through it, my KOOK Alert was almost reaching critical stages ... if they only included SOME ALL CAPS SECTIONS as well as a reference to Einstein, who was on the brink of making a similar discovery, but was forced to suppress it DUE TO GOVERNMENT INTERVENTION, then the KOOK alarms would be blaring and I'd've discounted the entire thing.

    Now, all I'm interested in doing is exploring the potential of doing everything in the "manifesto" literary style. My next letter to the editor? Manifesto. My thank-you note to grandma? Manifesto. My resume? Manifesto. My next Slashdot posting? Manifesto.

    Oh yes ... they never trusted me at the academy ... but they'll learn the hard way ... mwuahaha, er ... ha.

  25. Re:here is the text from namesys.com by drinkypoo · · Score: 2, Informative

    Actually they give the easy option of ext2/3, xfs, reiser, and jfs, and really it's no harder to use any other filesystem - though why would you want to? - that is fully supported by linux including support from some bootloader. Pick your filesystems, emerge the proper tools, make your filesystems, and keep going. Admittedly, they only document the steps for xfs, jfs, ext3, and reiser.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  26. Encrypted filesystems by SteamyMobile · · Score: 2, Informative
    Finally, we have a way of having an encrypted FS in Linux that's not an ugly kludge like loopback. The modular system is great because we can add encryption, access control, all kinds of things without having to go through the trouble of writing an FS from scratch.

    It's very disappointing that it took Linux all these years to get something as basic as a secure, encrypted way to store files. Even Windows has had FS encryption for a while.

    The next release of Suse is going to be a doozy. KDE 3.3, Reiser 4.

  27. Re:ATOMIC FILE-ING SYSTEM HERE I COME by ceswiedler · · Score: 2, Informative

    The point isn't to guarantee that data was flushed to disk. But if it wasn't, you know it wasn't, and you have a previous copy of all the blocks in the transaction.

    Atomicity isn't the same thing as synchronous writes, where the OS won't return from the write() call until the data has truly been flushed successfully to the disk controller (and with controllers which support it, to the platter itself). Atomicity says that a set of writes either happens completely, or not at all.

  28. How reliable is an "unstable 1.0" anyway? by JavaScrybe · · Score: 2, Insightful

    I have to wonder. ReiserFS does really nice with all the hard-work partitions I have over here, and I'm more than willing to convert (yes, using tar if I must), risking crashes and data losses.

    But what crashes/corruptions are we talking about? Will I lose my entire filesystem? Will files randomly disappear? Will it install Windows on my Linux box? (Lords no!)

    How tested was this 1.0 release? I have to assume it was "thoroughly but not fully" tested, am I right? After all, why release a 1.0 if you're not ready to "promise" at least basic stability to normal users?

    --
    Lex
    1) /. post 2) .sig 3) ??? 4) Profit!
    1. Re:How reliable is an "unstable 1.0" anyway? by hansreiser · · Score: 4, Informative

      Our approach is to first get it to where nobody in the developer team using all known filesystem crashing scripts collected over 10 years can crash it, and then ask our mailing list to crash it, and only then ask real users to try it.

      That said, if you have a mission critical server, be sensible, wait a bit.

      It is in the -mm kernel, if it goes without a bug report for a week, we send it to Linus. I hav been surprised by the lack of bug reports after going into -mm. All we have is one apache 2 bug report that we cannot reproduce yet.

  29. Re:here is the text from namesys.com by auzy · · Score: 5, Interesting

    Ok, so thats the standard response, but the main benefits will be stuff like: encryption plugins (so easy per directory encryption).. Finally maybe we'll have fully encrypted home directories easily. and stuff like the winFS system integrated into the filesystem possibly. its also 2X faster then reiserfs, and 4X faster then NTFS The big issue though is that until freebsd gets these benefits, apps aren't likely to get these capabilities :( so maybe someone should work on porting this, then maybe theres a good chance these technologies will be used extensively..

  30. Re:what are you talking about? by noahm · · Score: 3, Interesting
    it sounds like you're referring to reiserfs as not compatible with programs? The only types of programs that wouldn't be compatible with reiser4 would be things like fsck that are designed for a file system.

    Well, the Reiser4 plugin infrastructure allows for more functionality to be added to the filesystem. Depending on the plugins created, the processes accessing this filesystem may need to know about them. E.g. GNU tar is incapable of preserving extended attributes and ACLs when copying data. Or look at the NTFS streams feature. This kind of thing needs at least some support in userspace, or else it can't be accessed.

    It will very much be possible for people to write code that needs to run on Reiser4 in order to work properly. It will be interesting to see if this happens, and if so, how widely adopted it becomes. I think there's a lot of potential here, but I understand how people might be reluctant...

    noah

  31. Re:ATOMIC FILE-ING SYSTEM HERE I COME by Brandybuck · · Score: 2, Insightful

    Unless you have *synchronous* atomic commits, you'll still lose data on power loss. And while I think a synchronous atomic filesystem would appeal to a bank, most end users want something a little quicker than frozen molasses.

    --
    Don't blame me, I didn't vote for either of them!
  32. Transactions? by ceswiedler · · Score: 4, Interesting

    How large (and long) can Reiser atomic transactions be?

    Can I write an installation program which creates, replaces, moves, and deletes many files and directories, and have it all be under one transaction with a single commit at the end? Do other 'sessions' not see the transaction until it is complete? Are sessions based on processes or threads or something else?

    That would be pretty amazing, to be able to roll back large sets of changes in case of an error. I know that database rollbacks can take large amounts of time (they optimize for the commit, which makes perfect sense) but nonetheless having rollback support in applications would be sensational.

    1. Re:Transactions? by ceswiedler · · Score: 2, Insightful

      Reiser4 implements a resier4() syscall with new semantics for their custom operations. That's the interesting thing about this; they're adding onto the Unix APIs. Therefore (from a syscall standpoint at least) they can do things like transactions which open() and write() can't support. Of course, this comes at the expense of compatibility with other filesystems, but if it works as advertised, I'd have no problem writing code which takes advantage of it.

    2. Re:Transactions? by hansreiser · · Score: 5, Informative

      Our atomicity does not provide isolation or rollback, it is only atomic in the sense of whether it survives a crash. That is, a reiser4 atomic set of operations will either all survive the crash or none of them will.

      You can say that this is not really atomic, and by database traditions that is correct, but I believe we have implemented the aspect of atomicity that for sure should be implemented by the file system and not by the layers above.

      Later we may support more isolation and rollback, but we started with allowing people to define a set of fs modifying operations that would either all be preserved across a crash or none of them would be preserved. I tried using the term "transcrash" instead of atom, but no one but me loved the term.

      I must caution though that the API for defining an atomic set of filesystem operations is still being debugged. The core infrastructure is rock solid though, as it is what we use for atoms defined internal to the FS. We shipped as soon as our core code was rock solid, and plan to incrementally finish the other stuff over the coming year.

  33. User Report by vandan · · Score: 3, Informative
    I've been using reiser4 for quite some time here at work. I'm booting from a 'redeeman' boot disk ( Gentoo hacker ) and then installing Gentoo unstable onto our work PCs :)

    It rocks. Very, very fast. Whereas an:
    emerge -up --deep system

    would have taken about 20 seconds to run under reiser3, it takes about 5 seconds under reiser4. Very impressive.

    I haven't had any stability issues with it. There were ( last time I checked ) 2 outstanding bugs - one nfs ( files on server with reiser4 ) bug, and one strange bug that made adn OpenOffice compile fail miserably. Bug (1) doesn't affect us, as our nfs server is running reiser3, and bug (2) I got around by creating a reiser3 partition, mounting /var/tmp/portage on it, emerging OpenOffice, and building a package of it for all the other PCs.

    I just can't get over how fast it is.
    1. Re:User Report by hansreiser · · Score: 3, Informative

      I think those bugs were fixed a while ago.

  34. Boot CD with reiser4progs 1.0 by bulletman · · Score: 3, Informative

    Over the past few days (ever since reiser4 was accepted into the mm kernels) I've been looking for a boot CD with reiser4progs 1.0. I want to try reiser4, but need a boot CD to format my new drives and mount my current partitions for copying.

    The only boot CD I was able to find was the (R)ecovery (I)s (P)ossible Linux rescue system:

    http://www.tux.org/pub/people/kent-robotti/loopl in ux/rip/

    It was released yesterday (22 Aug) and is still warm to the touch.

    Stephen

  35. EVERY computer needs a u.p.s. by FrankHaynes · · Score: 5, Insightful

    Write on the blackboard 10^10000000 times:

    "EVERY computer needs an uninterruptible power supply. EVERY one."

    There are so many problems of which you might not be aware, aside from those requiring you to run fsck afterwards, which are solved by a good u.p.s. that you'd be penny-wise, pound-foolish for not putting a u.p.s. on every machine in sight.

    My clients think that I can walk on water simply because I eliminated a large share of unexplainable wierdnesses from their machines by installing an inexpensive u.p.s. on every single one.

    Solid, clean power is very important to a stable computing system. I cannot stress this enough.

    --
    slashdot: A failed experiment.
    1. Re:EVERY computer needs a u.p.s. by FrankHaynes · · Score: 2, Interesting

      Funny you should ask that.

      This past week I was shutting down this here Win2k system when I was done with it because my APC 450 V.A. u.p.s. had exhausted its second set of batteries and would not hold through these brief power glitches (likely caused by Florida Power and Light cutting in replacement transformers around here) that we have been getting.[1]

      A buddy gave me a large u.p.s. that had been in commercial service, so I hooked up two 12 volt deep cycle marine batteries in series to it and it fired up fine. Right while I was reading /. last night POW! the thing just shuts down a.c. output on me for no friggin reason. Yes, I was very upset.[2]

      Nonetheless, I stand by my assertion unwaveringly. I was primarily thinking of power outages lasting no more than a few seconds, which are the most common where I have lived and worked. These are more troubling because they leave hardware gates and c.p.u.s in unknown states due to their brevity and result in the "wierdness" that I spoke of in my original post.

      You are free to calculate a costs/benefits analysis of replacement hardware under a scenario in which a power failure fried your motherboard, but no matter how good you are at backups, if you actually *use* your computer you will have data that has not yet been backed up. I don't know about you, but my time is far more valuable than this pile of P.L.A.s and capacitors and printed circuits and I don't want to add to the potential to waste that time by going without a u.p.s. and suffering the ensuing headaches. A u.p.s. is a very worthwhile investment, as is a r.a.i.d. and other enhancements.

      The primary reason for posting my original comments is that I assume that most subscribers here are software types, so they probably don't have the interest in or experience with these hardware considerations. Words to the wise; the rest can suffer.

      SO: when you read a proponent of ReiserFS claim "Well, my ext3 fs lost data on me so it's no better than ReiserFS", ask them if they had a u.p.s. supplying clean power to the box running ext3 before jumping to any conclusions. Back on topic.

      ***

      [1] By the way, turning the machine on and off places it under greater thermal stresses from heating and cooling cycles, thus shortening the life of box. My machine normally stays on all the time.

      [2] This has happened about a dozen times to this NTFS in the past week and I haven't lost any data; I'm wondering about the motives of the subscriber who earlier commented that NTFS is the worst file system of all the ones being discussed here.

      --
      slashdot: A failed experiment.
  36. Re:Why ReiserFS is worth using by Junta · · Score: 2, Interesting

    Reiser? Stable? Now those are two words that don't belong in the same sentence.

    In dealing with ext3, JFS, and XFS, Reiser has proved the most annoying because first, I have to do a full fsck on it most frequently, and second, a quarter of the time it is the root fs and needs rebuild-tree, which is annoying as freaking hell because you can't even have it mounted read-only. XFS I've had issues with two, but never having to completely umount to fsck. JFS has issues where it's journalling doesn't seem to catch something and it later in the middle of operating, figures out it is inconsistant and remounts read-only for fsck, which is also highly annoying. In all cases, get ready to dig through lost+found and figure out what filenames those inodes used to be associated with.

    If you seek stablity (which is extremely key for filesystems), the only way I've found to work is ext3. It is a real slug (a *real* slug), but I would trust it much more readily than any other fs.

    --
    XML is like violence. If it doesn't solve the problem, use more.
  37. Uh, excuse me? by Lethyos · · Score: 4, Informative
    Finally, we have a way of having an encrypted FS in Linux that's not an ugly kludge like loopback.

    I think you misunderstand, that's the beauty of it. Basically, Linux (and FreeBSD with GBDE) allows you to encrypt a device at the block level. Everything is written to the disk encrypted, including the file system itself and not just the data. This also allows you to abstract the device. It could be a big file sitting on an existing device or the device itself. It's very flexible.

    Some of the other advantages of this are fairly important. Here's a few off the top of my head.

    1. It is easier to build a more secure and more reliable encryption system that works with all means of storing to a device rather than an encryption system for every one of those means. (1 versus an arbitrary number.) To simplify to more practical terms, it is better to write one encryption mechanism that can work with 10 file systems rather than 10 encryption mechanisms to work with each of those.
    2. If you want to encrypt data, you might not always be writing a filesystem to a device. If I have a database that makes raw access to a device for its storage, but I want encryption, I need it at the block device level.
    3. You do not want to make the file system any more complicated than it needs to be. Adding encryption would produce a disaster. Aside from making it easier to corrupt data, you lose a great deal of performance and security. How? Let's say you encrypted your data and sorted or indexed it by the plaintext. You are giving lots of clues to a potential attacker regarding the contents. If you do not follow this convention, you have to decrypt every byte to figure out whether or not its what you want. Horrible! (This may be an over-simplification. Anyone care to check me on this? Still, the basic principle should apply.)
    4. Keeping encryption outside the filesystem makes it easy, even trivial to arbitrarily choose the cypher, the key size, and even the block size. The filesystem would undoubtably impose limitations on all these choices if the encryption were built in.

    On the plus-side, filesystem level encryption lets you choose to encrypt on an as-needed basis (such as with NTFS), but the uses of this are minimal and questionable at best (what about swap, temporary files, and data that you forget to encrypt?)

    all kinds of things without having to go through the trouble of writing an FS from scratch.

    I think you may have learned from my previous comments how you accomplish this. Hint: you don't encrypt at the filesystem layer.

    It's very disappointing that it took Linux all these years to get something as basic as a secure, encrypted way to store files. Even Windows has had FS encryption for a while.

    Using the loopback device to encrypt data has been available for longer than NTFS has had encryption.

    --
    Why bother.
  38. This looks very cool. by squidinkcalligraphy · · Score: 4, Insightful

    This looks very cool.

    Using files are both files and directories is really nice - throw ACLs, metadata, whatever in a directory the same name as the file: access it as a file and it is the file, access it as a directory and it provides access to the metadata. It doesn't break things. Well, not much. As mentioned, this will break things like tar a bit. But the VFS has managed to deal with resource forks from HFS, albeit in a slightly ugly fashion. This is a little nicer, and perhaps with time will be the framework for slowly abandoning outdated filesystem concepts.

    How would you mofidy tar to deal with this? Add a .reiser_meta folder in each directory to store the corresponding file directories? Or is there another way?

    --
    "I think it would be a good idea" Gandhi, on Western Civilisation
    1. Re:This looks very cool. by squidinkcalligraphy · · Score: 3, Informative

      Now that I think about it, the main problem would be with programs knowing that files can also be accessed as directories. tar would work fine provided that the readdir() system call (or whatever you'd use to get a directory's contents) returns both a file and a directory for each file.

      --
      "I think it would be a good idea" Gandhi, on Western Civilisation
    2. Re:This looks very cool. by IamTheRealMike · · Score: 2, Interesting
      Yeah, i'd have to echo this sentiment. Tar is a legacy hangover, not something to be treasured and preserved. Technically the ZIP format used on Windows is far better, and to be frank I'd much rather see the Linux community move to using a simplified filing system that supports all the features we want mounted via the loopback device. ie, rather than "extract a tar.gz, edit the files, possibly recreate" you'd "mount the .box file, edit the files, unmount". GNOME and KDE could provide easy access to this so you could box/unbox anything. Meanwhile the on-disk format would be extensible.

      MacOS already does something similar with DMG files, it might be worth moving in a similar direction.

  39. Re:what are you talking about? by sirsnork · · Score: 4, Interesting

    I'm hanging out for a SQL pluging. Being able to "SELECT filename FROM filesystem WHERE size > 1000000" would be fantatstic (note very basic example). Not to mention meta data plugins that can index your media files and store that data in the filesystem (again with SQL access)

    --

    Normal people worry me!
  40. Re:LVM2 by Lethyos · · Score: 2, Informative

    Flesystems do not typically care about what the underlying device is (of course I'm not talking about "filesystems" devoting to the task of distributing the storage mechanism, such as NFS, AFS, CODA, and friends). Device access is handled at a "lower level" by drivers, I/O, etc. In otherwords, with Unix at least, a device capable of storing bits (including metadata about how to store that information, AKA a filesystem) is presented to the user and what's actually behind it is unimportant. It could be a hard disk, a chunk of physical RAM, a RAID array, a floppy disk, or a even another file sitting on an existing file system. To get a better idea for how all this works, read up on losetup which is available on pretty much any Linux system (assuming support for the loopback device is present in the kernel... which it should be).

    --
    Why bother.
  41. Re:Why ReiserFS is worth using by SaDan · · Score: 2, Interesting

    Usually, unstable Reiser filesystems point towards misconfigured or faulty hardware.

    I maintain ReiserFS v3 filesystems on terabyte arrays, on database servers, and on our machines that go out to client sites. ReiserFS has performed very well for my company. We are a 24/7/365 shop. Downtime isn't in our vocabulary.

  42. Interopability by Anonymous Coward · · Score: 2, Interesting

    With so many filesystems around, it is strange that nobody is working on interopability. Till today no filesystem exists which works well both in windows and linux.

    1. FAT - comes close but does not support very large paritions and files larger than 4GB
    2. NTFS - Poor write support in linux
    3. EXT2/3 - Writing hardly works in windows and does not support large files.
    4. ResierFS/XFS - Have limited support in windows.

    Any multi-OS file system out there?

    1. Re:Interopability by soulsteal · · Score: 2, Interesting

      What about FAT32 with VFAT for long filenames? Linux seems to handle that fine, as well as all flavors of Windows since Windows 95B.

  43. Re:Anybody know how to ghost it? by Lethyos · · Score: 2, Informative

    When you image a device, you're not imaging data selectively, you're just getting whatever is there. In otherwords, you don't care what's on the disk, just that you are reading bits off of it sequentially.

    Real world example: if I run dd if=/dev/hda it will (in addition to spewing bytes to stdout) start at the very first bit on the disk and continue reading the next after the next until the disk reports (specifically, the disk driver) that there are no more bits to be read. Whether or not that disk happens to be formatted with reiserfs or NTFS is irrelevant.

    It is in this way that tools like dd or Ghost back-up and restore a disk exactly how you see it at the time of imaging.

    (Cool tip: you don't need Ghost to take a disk image and store it across a network. All you need is dd, ssh and a target machine running the SSH daemon. Run: dd if=<the device to image> | ssh <user>@<target host> "cat > backup.img" . There are tweaks you can do to improve the performance of that (such as setting a larger block size on dd), but that is an exercise left to the reader.)

    --
    Why bother.
  44. Why I use ext3 (Was Re:ext3 to reiser4) by SealBeater · · Score: 2, Interesting
    No, you will have to reformat. However, I recommend the upgrade; I've seen a number of studies showing that the performance of ext3 is awful compared to reiserfs. The only arguable advantage of ext3 is its compatibility with the baseline ext2.


    I have to take exception to this, as according to everything I know, this is a bit deceptive. As you would normally want to use a journaling
    filesystem on very large discs (whether this be regular hard drives, which is bad enough, but can get very large when dealing with raid arrays, for
    instance). This is the single most important factor when it came to deciding what filesystem to run, namely, can reiserfs 4 be upgraded to new
    versions easily? In the past, the only way to upgrade rieiserfs was to reformat the device. This is a point that I don't think people pay enough
    attention to, especially in production enviroments. Say I have a 500 Gig raid array. I use reiserfs, (which is an excellent filesystem) and it is
    later discovered to have a security flaw or a bug that causes data corruption. In order to upgrade to a new version of reiserfs, you have to
    reformat the entire array. With ext3, you unmount the device, mount it as ext2, unmount it and remount it as ext3. Done. This is hugely important.
    I am completely uninterested in having to maintain a 1Tb of drive space, in order to upgrade a 500G array.
    Well, that wouldn't happen, you say? It did. Google
    Also, I do seem to remember some problems running LVM and NFS on reiserfs as well, but I am willing to be corrected.

    SealBeater

    P.S. I am only really interested in knowing if I can upgrade a reiserfs filesystem without having to reformat.
    --
    -- Its survival of the fittest...and we got the fucking guns!!!
    1. Re:Why I use ext3 (Was Re:ext3 to reiser4) by Aardpig · · Score: 4, Informative

      This is the single most important factor when it came to deciding what filesystem to run, namely, can reiserfs 4 be upgraded to new versions easily?

      Yes; as I understand it, ReiserFS 4 is designed with a plug-in architecture, so that future improvements to the filesystem can be incorporated in a non-destructive manner. You can read more about this functionality in the summary of the new features in v.4.

      --
      Tubal-Cain smokes the white owl.
  45. Re:Okay, how about a WinXP driver by macz · · Score: 2, Interesting
    Besides that crappy HPFS driver from OS/2 are there any non MS filesystem drivers anywhere? NFS doesn't count because it is a "Network" file system.

    If you don't want FAT16, FAT32, NTFS (4 or 5), or the OS2 thingy, aren't you out of luck? How would you even install it? Much less mount it, format it, or take advantage of it.

    I am not being facetious either, I really want to know

    --
    ...But I digress. TREMBLE PUNY HUMANS!ONE DAY MY SPECIES WILL DESTROY YOU ALL!
  46. Re:atomic v. journaled by Jetson · · Score: 5, Informative
    Is Reiser V4 journaled? Is an 'atomic filesystem' the same, or is it better, or just different? If different, what is the difference?

    Journaled: The data is written to a temporary queue and then copied to the main storage. If the system dies while writing to the temporary queue then the main storage is unaffected; if the system dies while writing the queue to main storage then the system will notice when it reboots and will resume writing the queue to main storage.
    PRO: Safer than non-journaled since you can never end up with half a buffer written to disk.
    CON: Writes everything twice, causing delays. Very bad things could happen if data and associated metadata are in separate transactions and the system crashes between them.

    Atomic: The file data is written to unallocated space on the disk. Once that has completed, the directory record is updated by writing a copy of that record to unallocated space. The directory's parent is then updated by writing *it* to a new region of the disk, and so on up the tree. Since each write doesn't take effect until the next has completed, any interruption results in complete reversion.
    PRO: Safe. Faster than journaled since there is no double-posting.
    CON: More complicated to impliment, I suppose. I would expect it to be slighly slower than journalled method when writing very small changes to existing files as journalled can optimise the writes in the queue whereas atomic has to finish what it started...

  47. Filesystems seem to be like VWs by mcrbids · · Score: 4, Insightful

    There are two kinds of people, when it comes to the original VW Beetle: Those who love them, and those who hate them.

    People who do not fall in one of the above two categories have never really used or owned an original VW Beetle.

    It seems filesystems are the same way. I'm a long-term Ext2/3 user and have never had any particular issue with it. For the medium-power stuff I work with, it does fine. The filesystem on my laptop has been ext2/3 for almost 5 years now, I still have email, documents, etc. from 5 years ago on it. (It's been copied a few times - it originated on an AMD K6 system, now it's on a Dell Centrino Laptop)

    So, I guess I'm in the "Ext3 is all good" camp.

    Reading these posts, there are those who love Reiser, and those who hate it. Those in the middle haven't apparently used it.

    I've found Ext3 to be slow when you have more than about 5000 files in a directory. If I had a specific need for that, I'd consider Reiser if my particular distro (RedHat migrating to Debian) supported it "out of the box".

    Other than that, why bother? I've delivered millions upon millions of email messages and many millions of website hits on servers running Ext3.

    So, for me, what filesystem I use is sort of like what tires I use on the car. I might care slightly when installing, but otherwise I wouldn't give even a rat's ass.

    --
    I have no problem with your religion until you decide it's reason to deprive others of the truth.
    1. Re:Filesystems seem to be like VWs by metamatic · · Score: 3, Insightful

      There are two kinds of people, when it comes to ReiserFS: people who love it, and people who have tried to run it on RedHat.

      --
      GCHQ Quantum Insert installed. If only our tongues were made of glass, how much more careful we would be when we speak
  48. I gave reiser a boot in the a$$ right out the door by ZeekWatson · · Score: 3, Informative
    I feel for you man. I had 3 different installations with Reiser3 corrupt on me. Turns out reiserfs is a POS.

    On reliability:
    "After 3 or 4 power cycles, ReiserFS became corrupted to the point that the system would not boot up (the fsck failed and the bootup stopped there)." - http://www.redhat.com/archives/fedora-list/2004-Ju ly/msg00418.html

    On code maturity:
    "In contrast, ReiserFS' fsck is in its infancy..." - http://www-106.ibm.com/developerworks/linux/librar y/l-fs7/

    Hans and co's attitude:
    "For $25 you get an answer to any question we can answer with less than half an hour of working on it. fsck support sometimes takes more than half an hour" - http://www.namesys.com/support.html

  49. Re:here is the text from namesys.com by poptones · · Score: 2, Interesting
    I'm STILL (re)learning my way around the command line in linux and only recently had the courage to completely remove windows from my machine - but even I have been able to "easily" add an encrypted home directory to my machine. In fact, I encrypt /var and /tmp and /usr, too - and its almost entirely done using the Mandrake install wizard (although it likely works with Suse too). There's bugs in there that had to be figured out and the wizard tells you it can't do things you have to learn to do - but I did it without even knowing (at the beginning) how fstab worked or what a modprobe was. Admittedly it took a few weeks and what seems like hundreds of reinstallations (mostly because I didn't know how to repair a botched job) to figure it out, but once learned it ain't hard to do. And just to save others from having to do "hundreds of reinstalls" I even made a quickie HOWTO and posted it to alt.os.inux.mandrake.

    Now I have added scripts to my system that give me all the point and shoot functionality of pgpdisk in windows. All it took was a bit of time to learn the tools (mountloop, mount, umount, etc) and a hack of a shell script I found online and now opening an encrypted filesystem is as easy as clicking it, typing the pass, and pressing enter.

    What makes the present system great is its level of abstraction. Having a "thing" one can move around to ANY media without having to create new tools every time is a thing of beauty. It takes a tweaky (and now proprietary) add-on to do this in windows - sticking all the encryption in the fs itself would just be a step back to doing things the Redmond way.

  50. Three things came out of Berkeley... by loonicks · · Score: 2, Funny

    Good to hear the Linux filesystem envelope is being pushed further. The illustrations make me wonder if LSD had anything to do with Reiser4, but... whatever helps, I suppose.

  51. It's important only by warrax_666 · · Score: 2, Interesting

    if you can intentionally cause collisions by modifying messages appropriately. Then the hash becomes useless for verifying message integrity (because someone could have modified the message while keeping the hash identical).

    --
    HAND.
  52. Re:ATOMIC FILE-ING SYSTEM HERE I COME by hansreiser · · Score: 4, Informative

    No, atomic is the only option for reiser4, there is no metadata journaling even as an option. So, it both goes faster and keeps your data safer. It is nice when experiments with algorithms work.... :)

    Hans

  53. Re:here is the text from namesys.com by hansreiser · · Score: 3, Interesting

    The gentoo guys have not complained about my characterization, if they do in an email I will change it. As the other poster said, gentoo seems to prefer reiserfs in what they write and say.

    Hans

  54. Atomic, journalled, log-structured. by 0x0d0a · · Score: 2, Informative

    Close. I will confess that I don't know *exactly* the precise definition of journalled -- I believe that roughly it's "write out each operation guaranteed to be atomic to the disk before that operation is committed"

    Atomicity is not an alternative to journalling. Journalling is a mechanism often used to provide atomicity. Atomicity simply means that a change is either entirely committed to disk, or not committed to disk. There can be atomicity at various levels -- database transactions are also atomic, for instance, as is each operation on filesystem metadata in ext3 (which simply means that the filesystem metadata will not become corrupt on power loss).

    An example of the difference between atomicity provided via journalling and atomicity provided without journalling -- if a filesystem recieved a write of 20 bytes to the end of a file, a write that fit within a block, it could simply read the contents of the existing block on the hard drive, and then write the modified block back, since block-level writes are guaranteed to be atomic on hard drives (assuming, of course, that the filesystem stores the associated length data in the block). This would not be journalled, because the change is never written to a separate location, but it *would* be atomic, since the filesystem is never in an inconsistent state -- either the change is written or it is not written.

    There is also a mechanism similar to journalling (though different) called logging -- there are "log-structured filesystems". I am not familiar with the difference between journalling and logging. Just guessing from distributed systems knowledge, it's likely that logging means that every operation is written to a log in order, and that a filesystem's state can be reproduced by playing back the log.

  55. Bad blocks, etc. by warrax_666 · · Score: 4, Informative
    (We didn't consider reiserfs because of its lack of bad block handling).

    Oh, dear. Bad block handling is not needed on modern drives, all moderns drives have automatic remapping of failing blocks, and if you have a drive which actually has bad blocks which are visible to the OS you should not be storing any data on that drive.

    Just to add a data point: I've also had very mixed experiences with XFS. I installed it and it seemed to be chugging along fine for ~1 year (just regular desktop machine, no particular I/O load to speak of) until suddenly the initial root mount showed an empty /. I was never able to track the cause down, but I promptly changed to ReiserFS and haven't looked back since.
    --
    HAND.
  56. Windows vs Linux: encrypted filesystems by 0x0d0a · · Score: 4, Insightful

    There are also some severe disadvantages to block-level encryption -- from a user standpoint, WinNT-style filesystem-level encryption is generally preferable. Among other things:

    * Filesystem-level encryption can outperform block-level encryption.

    * It's easy for a Windows NTFS user to "start encrypting something" -- they right-click a directory and check a box. Linux requires a new mounted filesystem running through a new loopback device. Since this isn't doable at the user level in any distro that I'm aware of, it pretty much means that each user doesn't have their private files encrypted separately.

    * Choosing as-needed performance is not trivial. I currently maintain individual files encrypted with GPG. I don't want to have to have my P2P software making my kernel blow cycles constantly and unnecesarily encrypting and decrypting software.

    * Unless I'm doing something really grotty, like putting a filesystem on block-level encryption on an LVM virtual volume, if I'm using block-level encryption, I'm forced to choose how much space to allocate to each encrypted area -- how much to put towards my ~/.private directory, how much to put in my ~/main/notes/passwords directory, and so forth. If I'm using filesystem-level encryption, I'm taking available space from a shared pool.

    * While not strictly a block-level vs filesystem-level encryption issue, no major distro that I'm aware of provides a nice interface for setting up encrypted directories (well, mount points with block-level encryption) and home directories, with a user's login password used to decrypt keys used to access the encrypted filesystems. Windows is significantly more user-friendly (including providing the option of administrative key recovery) here.

    The block-level approach is ideologically clean and modular, but has serious drawbacks. It cannot replace filesystem-level encryption.

  57. Re:ATOMIC FILE-ING SYSTEM HERE I COME by hansreiser · · Score: 4, Informative

    No, actually, waiting before deleting the old copy is not enough. You need to make sure that there are not two copies.

    Think of classic banking example: credit savings and debit checking are a single atomic operation. You must ensure that you don't get the credit preserved and the debit lost by a crash.

    The poster above you was right.

  58. How about a undo or at least a trashcan/undelete? by grumbel · · Score: 3, Interesting

    One of the things I still miss most under Linux are a proper trashcan/undelete (at filesystem level, not at GUI level that doesn't help on the shell) or even better a full blown 'undo' operation on the filesystem. Even MSDOS provided a very basic undelete operation and I can't really believe that we are still without it on Linux.

    Does ReiserFSv4 provide stuff like that? Or in case it don't, are the 'Plugins' that it supports
    powerfull enough for that and are there maybe already plugins awailable that add an undelete/undo? Better yet would of course be a fullblown versioned filesystem, how about that, is that doable with ReiserFSv4 plugins?

    And how do the plugins relate to for example GNU Hurds translators or LUFS? Do they act at a similar level, or are they completly different?

  59. Reiser blew it with me. by rew · · Score: 2, Interesting
    I've encountered a few things with respect to ReiserFS:
    • I get to upgrade my filesystem so that I don't get to downgrade my kernel should I run into trouble.
    • Whenever something doesn't work right, (which never happened to me on Ext2), Hans Reiser tells me that "it's fixed in the newest version", and I get to upgrade my kernel and on-disk-format without the possiblity to back out.
    • When things DO go wrong, (which never happend to me on ext2/ext3), it seems I need to tell reiserfsck which sub-version of the filesystem is on my disk (Hans knows that very well on his disks, but I just use filesystems to store my files). Otherwise reiser-fsck may make a bigger mess than it started with.
    • When reiser-fsck is neccesary, it often requires a "rebuild-tree", which is time-consuming.
    • My filesystem was "suspect". So I start reiserfsck. It apparently does nothing, as it's done in 2 seconds (which is unlikely on a 640Gb partition) When reiser-fsck --rebuild-tree is started it informs me that it's going to take some 5 hours to complete. As I didn't have that time, I interrupt it. Filesystem gone. Apparently the first thing it does is invalidate the old structures. Now instead of "suspect" I don't have a filesystem at all, and have to sit out the 5 hours for which I don't have the time....
    • I sometimes have a disk-image of a different filesystem on my disk in a file. Hans Reiser tells me that a rebuild-tree would link the files inside the image into my filesytem! Fixed in newest version. Phew.
    Too many (serious) problems, that I'm not ever going to try Reiserfs again. Sorry.
    1. Re:Reiser blew it with me. by Anonymous Coward · · Score: 2, Insightful

      Honey I just saw a plane crash. I'm *never* going to fly again.

      I just got sunburnt. I'm never going sunbathing again.

      I just got in a car crash. I'm never driving again.

      I just fell off a ladder. I'm never climbing one again.

      I just watched the twin towers fall. I'm never going to trust a Muslim again.

      Ad infinitum, ad nauseam. Honestly.

  60. Re:On the other hand ... by martinde · · Score: 4, Funny

    > The cause was a hardware problem, true, but fs should not be a toast because of it.

    When you develop software that is immune to hardware failure, be sure to let us all know ;-)

  61. German magazine iX by MemoryDragon · · Score: 3, Interesting

    Ran a huge article on Reiser4 a while ago. (Around 2 issues ago)
    They said it was blazingly fast, but had problems, that the performance went down the drain once the processor did something not reiserfs related, thus IO is a higher burden on the processor, due to the tree structure they use.

    The other problem is fragmentation, which should be resolved by a defrag daemon/tool running in the background, which was not available back then.

    So my question, have those two problems been resolved already?

  62. AC by Luyseyal · · Score: 3, Funny

    You saw Anonymous Coward at OLS? SWEET! That dude posts like MAD around here!

    -l

    --
    Help cure AIDS, cancer, and more. Donate your unused computer time to worldcommunitygrid.org. Join Team Slashdot!
  63. Hashing and CRC by NoMercy · · Score: 2, Informative

    Yes ever hashing system has collisions, but really to check two files are the same which might have been corrupted naturally, use CRC, MD5 and other secure hashing alogrythums are just better against inteligent tampering. CRC's will catch an insanely large percentage of random data corruption and is faster than pretty much anything else, MD5's and SHA's are slower but much harder to fake.

  64. Plugins == VMS fs? by wandazulu · · Score: 2, Interesting

    So with a plugin, could you make a Reiser4 fs work like VMS' file system (i.e. foo.c;1, foo.c;2, etc.)? To me this is the holy grail of file systems...built in versioning by the file system itself, not a 3rd-party app like CVS.

  65. Resize Goof by Mark_MF-WN · · Score: 2, Interesting

    I was able to use reisersfsck to repair a partition resize that had gone wrong. I was pretty impressed -- only three files lost out of 20,000 (and fortunately they weren't important files!)

    So I'd say it works pretty well.

  66. Re:I gave reiser a boot in the a$$ right out the d by metamatic · · Score: 2, Interesting

    Ever notice that all the reports of ReiserFS corruption seem to be from RedHat users?

    This should tell you something.

    --
    GCHQ Quantum Insert installed. If only our tongues were made of glass, how much more careful we would be when we speak
  67. Re:How about a undo or at least a trashcan/undelet by grumbel · · Score: 2, Interesting

    I have a 120gb drive and only around 20gb real data, maybe 10gb for the OS itself, add a another 30gb random junk to that and I still have 60gb of my HD virtually completly unused. Even if tempfiles are not handled special it will take basically forever before my filesystem fills up, its really a non-issue these days.

    Beside that, I am taking about an 'intelligent' trashcan, not these "Your trashcan is full, please empty manually" ones. If the HD fills up, the trashcan should of course free itself and overwrite old stuff, possibly with custom threshold and such, no problem there, since in most cases you will find the error you did that lead to file loss relativly quickly anyway.

    ### Even the MSDOS undelete only worked provided that you didn't overwrite the data with something else (if I recall correctly).

    Yes, it did and its undelete weren't much powerfull or anything, but it was there and it worked already quite fine on old 386er with lausy 200mb harddrives, hardware improved quite a bit since then, undelete features however didn't for no obvious reason.

    ### In the end I think we would be better served by a smarter 'rm' and a better GUI trash can (not the cheap hack the KDE team came up with).

    Such stuff will NEVER be enough, I don't actually 'rm' my files, in most cases I overwrite them with 'convert', via piping or whatever. And thats exactly the reason why I want undelete at filesystem level, since the filesystem can track all these without problems, something implemented at the GUI level however can only ever track a very small fraction of excidental deletes or overwrites, if at all.

    The hardware to handle a versioned filesystem without problems has at least existed for a decade, its really just the software that still hasn't improved, neither on Linux nor on Windows or MacOS.

  68. Re:Patch against 2.6.8.1 ? by TeknoHog · · Score: 2, Informative

    The READ.ME clearly states which version of Linux is required. It's some funky 2.6.8-rc2-mmsomething. I for one wait for Reiser4's inclusion in the vanilla tree. Meanwhile I'm testing XFS and JFS too see how they stack up against Reiser3 (which I've used without problems since early 2001).

    --
    Escher was the first MC and Giger invented the HR department.