Slashdot Mirror


Interview With Reiser4 Author Hans Reiser

An anonymous reader writes "KernelTrap has an interesting interview with Hans Reiser, the author of two revolutionary Linux filesystems, Reiser3 and Reiser4. Reiser3 was the first journaling Linux filesystem. Reiser4 is a complete rewrite that is claimed to offer amazing performance and a new plugin architecture offering semantic enhancements to rival Microsoft's WinFS and Apple's Spotlight. Comparing Reiser4 to WinFS, Reiser says in the interview, "Reiser4 is a much more mature design, representing a 10 year effort"."

382 comments

  1. No one cares, but . . . by Yocto+Yotta · · Score: 0, Offtopic

    "Comparing Reiser4 to WinFS, Reiser says in the interview, "Reiser4 is a much more mature design . . ."."

    What is better than having the file system's author make unbiased competitive claims about their own products?

    LAST POST!!

    --
    A B A C A B B
    1. Re:No one cares, but . . . by lordsilence · · Score: 3, Insightful

      Having other people agree with him?

    2. Re:No one cares, but . . . by shmlco · · Score: 4, Insightful

      It's an INTERVIEW with the system's author and he's giving his opinion. Which, come to think of it, is what one DOES in an interview, you know, ask someone what they think? Sheesh.

      --
      Any sect, cult, or religion will legislate its creed into law if it acquires the political power to do so.
    3. Re:No one cares, but . . . by Yocto+Yotta · · Score: 0

      I'm not saying Reiser4 isn't the shiznit (or whatever the kids say these days), but I just come from a time and place where being objective and modest about your own trade or art speaks far stronger than unmodest self-PR work. If he had said, "these people said this about my work," which from my understanding, many people have said many positve things about Reiser4, I would never have posted a comment entitled, "No one cares, but . . . "

      In other words, "0MG WTF!?!! STFU >@! LOL"

      --
      A B A C A B B
    4. Re:No one cares, but . . . by h4rm0ny · · Score: 4, Insightful


      I just come from a time and place where being objective and modest about your own trade or art speaks far stronger than unmodest self-PR work.

      Having read the entire interview, I found nothing in it that made me think of Hans Reiser as engaged in unmodest self-PR work. Contrary to the tiny snippet you quoted, he doesn't slate WinFS. He says that it is doing interesting work. Nor is it particularly immodest to say that his file system is considerably more mature when he's spent almost 10 years more on it than the other.

      Reading the article, the parts that you consider immodest seem to me, to be just sincere enthusiasm for his work. And there's nothing wrong with that.

      Contrary to the title being "no one cares", I think the replies so far show that people do. :)

      --

      Aide-toi, le Ciel t'aidera - Jeanne D'Arc.
    5. Re:No one cares, but . . . by FidelCatsro · · Score: 0

      Ad homonym circumstantial ...
      Though I admit in this case it may be perfectly justified to accuse him of this. Though Reiser FS actually exists and WinFS still is not even in the public hands in any real form .So it defiantly is more mature

      --
      The only things certain in war are Propaganda and Death. You can never be sure which is which though
    6. Re:No one cares, but . . . by shark72 · · Score: 1

      " It's an INTERVIEW with the system's author and he's giving his opinion. Which, come to think of it, is what one DOES in an interview, you know, ask someone what they think? Sheesh."

      You are very correct, but it's interesting to compare this to the reaction a few months back when an interview with Bill Gates was referenced on /. When Bill was asked his opinion of the level of threat that Linux presented and Bill gave his expected answer, it was quite a sight to see: everybody was taking their turn calling him variations on "arrogant" and "+5, Insightful"s were being handed out like Fun Sized Snickers bars at Halloween. Meanwhile, here on September 13th, Hans Reiser makes a similar statement (as is his prerogative) and folks are largely basking in the sunshine that is pouring out of his ass.

      --
      Sitting in my day care, the art is decopainted.
    7. Re:No one cares, but . . . by drsmithy · · Score: 0
      Nor is it particularly immodest to say that his file system is considerably more mature when he's spent almost 10 years more on it than the other.

      It's worth pointing out that Microsoft have spent even longer creating "WinFS". Back in the early '90s, it (or, rather, the functionality) was part of their grand vision called "Cairo".

      This is before we even get to the actual filesystem WinFS sits on top of - NTFS - that's been kicking around since at least 1993. Reiser4 doesn't appear to be doing a great deal more than NTFS was designed to do 15 years ago.

    8. Re:No one cares, but . . . by SirPavlova · · Score: 1

      Reiser4 doesn't appear to be doing a great deal more than NTFS was designed to do 15 years ago.

      I don't know about other functionality, but NTFS is slower than FAT32 in most situations, while Reiser4 is a good deal faster.

      --
      Yar.
  2. Maturity by Anonymous Coward · · Score: 1, Interesting
    "Reiser4 is a much more mature design, representing a 10 year effort"."
    If Hans himself had not also shown the maturity of a ten-year-old, his filesystem would've made the mainstream Linux kernel by now.
    1. Re:Maturity by nocomment · · Score: 1

      ya he must have been the one behind the site design of TFA. scrolling, scrolling scrolling scrolling scrolling, ....

      --
      /* oops I accidentally made a comment, sorry */
      /* http://allyourbasearebelongto.us */
    2. Re:Maturity by nutshell42 · · Score: 4, Informative

      Anything more specific? I'm the first to admit that he can be rather immature, spoiled and inflammatory but a quick look at the link you offered showed none of these attitudes. Actually the discussion sounded quite civilized, so what's the problem?

      --
      Don't think of it as a flame---it's more like an argument that does 3d6 fire damage
    3. Re:Maturity by HawkinsD · · Score: 4, Insightful
      The emotional maturity of the author seems irrelevant to the benchmarks for the filesystem.

      If benchmarks are even halfway legit, then this is indeed something amazing.

      --
      Never attribute to malice that which can be explained by mere idiocy.
    4. Re:Maturity by Tourney3p0 · · Score: 2, Insightful

      I definitely don't want to get into an argument of "He said/she said" here, but after looking at that link I don't see anything about the maturity of a ten-year-old. If anything, I wasn't too fond of someone saying that *anything* "had no place in Linux".

    5. Re:Maturity by rca66 · · Score: 4, Informative
      If Hans himself had not also shown the maturity of a ten-year-old, his filesystem would've made the mainstream Linux kernel by now.
      Could you explain this remark? In the e-Mails exchange one can read there, it is clear, that Linus is not willing to put Reiser4 into the kernel - for pure technical reasons, not because something Reiser did or did not.
    6. Re:Maturity by Anonymous Coward · · Score: 2, Funny

      I was trolling.

    7. Re:Maturity by MemoryDragon · · Score: 3, Informative

      The german magazine iX ran benches on Reiser4 a while ago, and the benchmarks indeed were impressing with two huge downsides however, one is already mentioned in the interview, a reallocator is needed because Reiser4 has a tendency to fragment. And the other one being a much higer CPU usage than every other filesystem.

    8. Re:Maturity by nutshell42 · · Score: 2, Informative

      Now having read all of the ML discussion in the link GP posted I still don't see how it shows Reiser's immaturity. He may be a bit overconfident about his ideas but that's not necessarily a bad thing. That said I wanted to add that the link is a very good read and it is about features of Reiser4 that may be more important than raw speed (especially raw speed according to benchmarks on Reiser's own homepage =).

      --
      Don't think of it as a flame---it's more like an argument that does 3d6 fire damage
    9. Re:Maturity by BenjyD · · Score: 2, Interesting

      Is there any information on reliability, though? Saving a few seconds copying files is great, but if I end up losing data after a power failure it's not much use.
      Personally, I've found ext3 to survive crashes the best: xfs, jfs and reiser have all lost me data.

    10. Re:Maturity by g2devi · · Score: 5, Informative

      My understanding is that the kernel developers have pointed out flaws in the benchmarks and he has accepted the criticisms but points out that they are just benchmarks and all benchmarks have flaws. This would not be a problem if he didn't keep referring to the benchmarks when trying to ram a change into the kernel. You can't have it both ways.

      It's also my understanding that the key reason kernel developers don't want to accept his patches is that they don't like big megapatches that affect many systems or replicate functionality that is already in the kernel -- it's bad for maintenance. It's also my understanding that he doesn't want to break up the patches himself and he has refused help from others who are eager to do it for him. For him, it's an all or nothing deal -- take it or leave it. The kernel developers say "fine, we'll leave it", but he doesn't accept their decision and continues to complain. Again, you can't have it both ways.

      Reiser may be a genius, but even geniuses have to (*gasp*) live in the real world and negotiate with real people. Even if Reiser is smarter than all the kernel developers (doubtful), it pays to treat your so-called "inferiors" with respect. Even janitors and garbage collectors can have wisdom that we don't have and things they can teach us.

    11. Re:Maturity by cloudmaster · · Score: 2, Interesting

      Personally, I've found Reiser to be the best. I've lost data on ext2 and ext3, as well as jfs (and reiser, once). Overall, I've also lost weeks of time waiting for ext to fsck on an "unscheduled" reboot. :)

      Of course, this is moot since none of them will regularly lose files, and anything important is regularly backed up. Not to mention that a single UPS to weather minor power interruptions costs under $100... Right? ;)

    12. Re:Maturity by Anonymous Coward · · Score: 0

      If any mod had actually took the time to read the exchange, linked by the parent, you would see the parent is pure flamebait.

    13. Re:Maturity by Nigel_Powers · · Score: 2, Funny

      He struck me as having a disdain for authority and a dislike of hierarchy for the sake of hierarchy. I would think he's highly creative with a touch of genius. The proof is in his filesystem.

      I'm much the same way -- well, except I'm a dumbass.

    14. Re:Maturity by Spy+der+Mann · · Score: 1, Funny

      The emotional maturity of the author seems irrelevant to the benchmarks for the filesystem.

      Hey, if the emotional maturity of Bill Gates was related to the quality of his OS, th...

      nevermind.

    15. Re:Maturity by LWATCDR · · Score: 3, Interesting

      Actually I didn't see much immaturity. Okay Linus saying microsoft will get a files system right when hell freezes over seemed a little immature.
      Frankly Reiser4 looks like a good project.

      --
      See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
    16. Re:Maturity by Doc+Ruby · · Score: 1

      I dunno, I don't see any evidence of "immaturity" in that thread, except the playful "flame Christoph" bits which are completely immaterial. What is your agenda in disparaging Reiser, and his 10-year effort, Anonymous sniping Coward? Bill Gates, is that you? Or maybe Rupert, Gates's immature 10 year effort?

      --

      --
      make install -not war

    17. Re:Maturity by crotherm · · Score: 1



      Oh yeah, and how mature is it to flame someone behind the mask of anonymity?

      --
      "Those who make peaceful revolution impossible, make violent revolution inevitable" - JFK
    18. Re:Maturity by globalar · · Score: 5, Insightful

      Yeah, that's not a good link. Try this kerneltrap one. Things have been brewing. I haven't kept up with the most recent stuff, though.

      It's really a design/people issue. There are the lingering issues of stability and similar, but these are not (as I understand) the original problem.

      Reiser4 incorporates some sophisticated metadata concepts ("semantics") that are in effect a software layer over the fs - which is why Hans can compare it to WinFS. Some of these features step into the functionality domain of the VFS and the kernel. Not a bad thing, per se.

      Now, we all know the stereotypical kernel dev - technically conservative, concerned about maintenaince, not really keen on making big compromises, and annoyed by ego (again, a stereotype). Keep that in mind.

      Hans of course wants Reiser4 into the kernel. What's the holdup (from a technical design standpoint)? Well, individuals like Andrew Morton want functionality in the kernel that can be reused in a file-system nuetral fashion. Reiser4 has a plugin system, but it's a Reiser4 plugin system. Reiser4 and Hans want to extend Linux as an API, which right now will just be for Reiser4.

      There are also some lingering details of how this will change the course of filesystem integration in the kernel, in regards to traditional POSIX and Unix-like behavior. I don't recall any enduser problems, but there are few complaints.

      Why might this be annoying? Well, Hans wants his fs into the kernel now and he makes the case of its superiority, the markets demand, and the need to compete with companies like Microsoft. I wouldn't be the one to tell kernel devs that they need to compete with MS, but Hans is - to say the least - confident. And he did name the filesystem after himself, so I'm not how this couldn't be personal on some level.

      The middle ground is to say to Hans: we'll take Reiser4, but we want these Reiser-only features to be ultimately modified for all capable filesystems. Hans insists - and I'm sort of generalizing here - that the details can be sorted out, but right now we should go with Reiser4 and not worry about making it anything but a great fs.

      So, Hans took a "assertive" position on why Reiser4 should not only be included in the Linux kernel but also change the kernel. Linus, Morton, and a few others took a stand and said - in so many words - "Hans, we aren't putting your ego into our kernel. Not even experimental."

      It would be interesting to see if end users put enough momentum behind Reiser4 to put in into mainline or start it in 2.7.

      Is that worth a few flames? ;) If I butchered anybody's perspective, please correct me. I don't do kernel dev or psychology.

    19. Re:Maturity by donscarletti · · Score: 1
      He's clearly got an immense ego on him, probably big enough to warrant being divided up into 12 separate egos for tax purposes, but he did seem genuinely cooperative in that discussion.

      The guy seemed reluctant to back down over doing things his way and reluctant to go to the trouble of explaining things as well as he should. This isn't perfect, but it isn't any worse than I have seen from any other open source developer I've met. There are FAR bigger jerks than him on the loose.

      --
      When Argumentum ad Hominem falls short, try Argumentum ad Matrem
    20. Re:Maturity by iminplaya · · Score: 1

      Well, let's just see who would win a chair throwing contest. How about a spittin' an' cussin' competitiion? Place your bets.

      --
      What?
    21. Re:Maturity by CdBee · · Score: 2, Interesting

      Also, a lot of the truly great programmers of our age have had personality flaws.. possibly a degree of autism-like inability to interface to other people is symptomatic of the mindset that understands computer systems. God knows, we geeks face dumber forms of that assumption every day!

      --
      I have been a user for about 10 years. This ends Feb 2014. The site's been ruined. I'm off. Dice, FU
    22. Re:Maturity by Arandir · · Score: 2, Interesting

      Now, we all know the stereotypical kernel dev - technically conservative, concerned about maintenaince, not really keen on making big compromises, and annoyed by ego

      You make that sound like a bad thing!

      I'm not a kernel developer, but as a professional software engineer I do know that conservative development is the best policy. Users tend to want the opposite unfortunately. They don't care how rotten and worm-ridden the inside of the apple is, so long as the outside is bright and shiny.

      --
      A Government Is a Body of People, Usually Notably Ungoverned
    23. Re:Maturity by Surt · · Score: 1

      I have to agree with other posters here ... it's Linus who appears to have the least emotional maturity among the posters on that thread.

      --
      "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
    24. Re:Maturity by lxs · · Score: 1

      ya he must have been the one behind the site design of TFA. scrolling, scrolling scrolling scrolling scrolling, ....

      Raw HIIIIIDE!!!

    25. Re:Maturity by tanguyr · · Score: 1

      They don't care how rotten and worm-ridden the inside of the apple is, so long as the outside is bright and shiny.

      Which is ironic, given the fact that they're the ones who are going to eat the damn thing - and then complain about the taste. I sometimes get the impression that users expect you to make it pretty during office hours and then come back on your own time and actually make it work.

      --
      #!/usr/bin/english
    26. Re:Maturity by ratta · · Score: 4, Insightful

      More CPU % time is used because Reiser4 is faster. What should be compared is the overall CPU power needed for a filesystem operation. And even if reiser4 is really using more CPU, remember that the CPU power is growing much faster than hd speed.

      --
      Wondering why i am doing so strange posts? I am trying to get a "+5,Flamebait" or "-1,Insightful" rating.
    27. Re:Maturity by iabervon · · Score: 1

      Well, he's in the process of getting it into the kernel; looks moderately unlikely for 2.6.14 (which has closed already for some purposes), but likely for 2.6.15, as there seems to be agreement on what will be suitable at that stage. Reaching the necessary agreement on what should go in, however, has taken a while due to all of the flaming and lack of communication.

      There are a number of cases where a trivial disagreement and misunderstanding prevented progress for a while, until the thread died out and the issue got brought up in a different way. E.g., Reiser4 is full of asserts that weren't considered suitable for inclusion; Hans fought long and hard for having asserts, but having them is a standard kernel practice. The issues were just that the code used messages that weren't meaningful to anybody else, didn't use the kernel's standard assert mechanism, rebooted the computer when there were problems with only one filesystem, and duplicated checks for conditions automatically caught (such as dereferencing a NULL pointer). Getting this clear to everybody took a while, involving a digression about Christoph Hellwig's haircut and much delay.

    28. Re:Maturity by Anonymous Coward · · Score: 0

      Sounds like it is developing into a nice little flame war. Though it couldn't possibly be as satisfying as the emails that killed off CML2.

    29. Re:Maturity by m50d · · Score: 1

      Linus was less mature than he was.

      --
      I am trolling
    30. Re:Maturity by bani · · Score: 1

      the philosophy of reiserfs has been -- use cpu now to save i/o later. and it has worked very, very well indeed.

      almost all other fs's (ext3 included) are moving toward this philosophy as i/o is almost always the bottleneck, not cpu.

    31. Re:Maturity by bani · · Score: 1

      i can confirm this. out of 50-60 production servers, we have had numerous catastrophic filesystem failures with ext3, and zero with reiserfs.

      we eventually migrated all our servers to reiserfs.

    32. Re:Maturity by bani · · Score: 1

      hmm. reading that thread it looks like linus is the one being immature. but then linus is often that way.

    33. Re:Maturity by bani · · Score: 1

      from what i can see it is linus that is being immature in the thread, not hans. everything i read indicated hans was being polite and clear.

      hans has invested a lot of r&d into the problem, everyone else has invested a big fat zero. obviously he's convinced his way is the right way, and a lot of people agree with him.

      linus has been wrong in the past (often, even). this may be just another one of those times.

    34. Re:Maturity by Omnifarious · · Score: 1

      Yes, but with too much conservativism, you never end up with anything new. As a developer, I'm _very_ annoyed with the face that ReiserFS4 is not in the Linus kernel. I want to use it and play with it. It's people like me who'll find problems or be able to suggest what API might be good for something that will work for all filesystems. But that can't happen til people like me get to play with it.

      Personally, I don't have the time or inclination to sit around all day fiddling with various patches to my kernel trying to get the right combo to add it in myself. I rely on distributions to do that for me, and they won't put reiser4 in until it's in the Linus kernel. I've played with experimental patches before. I used to run a kernel with a special patch for CIPE, and for LVM way back before LVM 1 was in there by default. It's annoying, time consuming and isn't worth it.

    35. Re:Maturity by Omnifarious · · Score: 1

      Ahh, now that's interesting. I'm not so annoyed at the kernel developers as I once was.

      Well, someone who's eager to split up the patches should just do so whether Hans Reiser wants them to or not. This is GPL software we're talking about here after all. Reiser4 is too nice not to go in. Filesystem technology needs to improve, and ext2 and ext3 are ancient designs.

    36. Re:Maturity by swillden · · Score: 5, Insightful

      There's nothing a janitor or garbage collector can teach me or you, or most others on Slashdot.

      How about humility?

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    37. Re:Maturity by Anonymous Coward · · Score: 0

      Ha ha ha ha. This!

    38. Re:Maturity by rbarreira · · Score: 1

      Is that just a troll or a joke?

      Since you're so smart, you tell me - how do you prove the sentence you just said?

      --

      The AACS key is NOT 0xF606EEFD628B1CA427BEA93A9CA9773F
    39. Re:Maturity by maelstrom · · Score: 1

      Jeez dude, what are you doing that you've lost data on so many file systems?

      I've lost data on ext2, and well there was that time that I wrote a movie to my friend's /dev/hda instead of /dev/hda1. Oops.

      --
      The more you know, the less you understand.
    40. Re:Maturity by iangoldby · · Score: 1

      So what is the minimum speed CPU you need to see a speed advantage running Reiser4?

      (I know it depends on usage, disk speed, etc, but are we talking 75MHz, 750MHz, or into the GHz range?)

    41. Re:Maturity by mpcooke3 · · Score: 1

      Yes.

      Another issue is that a lot of the functionality he wants to add is in the plugin system within reiser. Other kernel developers believe it should sit in a virtual layer (VFS) above the actual filesystem so that they could work with any file system.

      Mainly I agree with the kernel developers although I have some sympathy with Hans Reiser as his argument is normally that reiserFS is so good why bother with the VFS layer stuff and it is pretty good technically compared to say ext3.

      I suspect that ReiserFS is technically superior but may lose out if Hans Reiser doesn't compromise a bit. After all eventually other linux filesystems might catch up technically.

    42. Re:Maturity by cloudmaster · · Score: 1

      I've been a *nix sysadmin for about a decade, and in that time I have tested several fairly unstable hardware configurations - not to mention the experimenting I do on my home network. The more stuff you mess with the more likely you are to run in to / cause failures, even though failure's still a very low percentage overall. :)

      Generally, though, problems are introduced through too many unclean shutdowns (due to lower-level development), or flaky hardware of some sort.

    43. Re:Maturity by m50d · · Score: 1

      The kernel developers aren't really that conservative, reiser4 is twice as stable as plenty of things that have gone into 2.6, easily. This is pure politics.

      --
      I am trolling
    44. Re:Maturity by Anonymous Coward · · Score: 0

      Now, we all know the stereotypical kernel dev - technically conservative, concerned about maintenaince

      You're not really talking about the 2.6 line, right? 2.6 is definitely not being conservative, it is being treated as the development line... and it dosen't seem they really take all that care about maintenance...

      , not really keen on making big compromises,

      Oh sure...

      and annoyed by ego (again, a stereotype).

      This is most correct. But i think it would de "annoyed by egos which are not their own". ;)

    45. Re:Maturity by Anonymous Coward · · Score: 0

      "Maturity (Score:1, Interesting)
      by Anonymous Coward on Tuesday September 13, @11:58AM"

      People like you, & this type of response you made?

      I have to reply on it, as it truly makes me VERY upset.

      After all, when it comes down to cases - what have YOU done of equal import/magnitude for the "Penguin Cause" vs. the Reiser 3/4 filesystem?

      Answer me that. Answer us ALL that.

      Now, as to your STUPID reply:

      If the man got upset in another post, it shows me 2 things:

      1.) He is passionate about his work, which HAS DONE WELL in the Linux world.

      &

      2.) He is ONLY HUMAN. Anyone, & I mean anyone, has a breaking point... especially if you "push" them hard enough.

      Now above all:

      If you'd show a little passion for your work in this field (which you probably have ZERO of, & are just another 'talk alot, done nothing bullshitter' imo), & achieve something 1/10th the order of magnitude of achievement he did?

      Then, feel free to open your mouth.

      (Oh, NewFlash: What's this? You haven't created a filesystem yourself that has achieved the same notoriety as the work done in the Reiser 3/4 filesystems?? I thought not!)

      Big Talker... that's ALL you are!

      A piece of STRONG advice you need to 'drink in & digest' loudmouth - Until you have?

      "STFU!"

      APK

      P.S.=> Amazing - Slashdotters with NOTHING TO THEIR CREDIT OF TECHNICAL MERIT ON THE LEVELS OF THIS REISER3/4 JOURNALLING FILESYSTEM (afaik, 1st of its kind for Linux) giving criticism?

      Ever heard the saying "You're up a creek without a paddle"?

      That's where YOU are on this one/this topic, as far as I am concerned... because whowever you are??

      Show us all something YOU HAVE DONE that is equally (or superior to) that filesystem of his. OK?

      LOL, I mean, YOU?

      Without having done something of worth in this field themselves, no less, contributing to Linux as this man has??

      You're Full of SHIT, point-blank! And, a piece of shit. A loudmouth, do-nothing, piece of shit.

      LOL, no less, by trying to put down a person that created something that has done very well in the Linux world!

      (Which many/most of you here @ SlashDot are "pro-linux" imo... This I have gathered as much/noted in my time here (around 6 months or so hanging about here)) ... & I tolerate it, even though I find many of you way, WAY too "Anti-Microsoft". Neither OS family is "going away" after a decade, & have plenty of 'followers/users', & neither will seize the market in its entirety. Accept that as fact, if more than a decade hasn't shown/taught you that already. Making them work together? Now, THAT is constructive, & not b.s. (try it sometime).

      So... bottom-line:

      Let's see YOU, Mr. Anonymous Coward, do the same type of work he did in Reiser 3/4, & do as well in the Linux World... ok?

      Like I said above, I'll probably be waiting until the "12th of never" for that to happen, you "BIG TALKER"....

      Ordinarily, I won't defend anything "Linux" other than saying I respect KDE & Linux 2.6x cores because they ARE great achievements by this point, but replies like this STOOGE here wrote?

      Well, let's see HIM do better work... that's all... & we all know, whoever he is, he NEVER will!apk

    46. Re:Maturity by nusuth · · Score: 1
      I can't give you any speed rating, I have no idea. However given a benchmark completed in X1,X2 seconds using Y1,Y2 seconds of CPU time with reiser4 and another filesystem, you can deduce a conservative limit of the relative CPU speed where r4 should still be faster or just as fast. r4 has at least Y2-Y1 seconds to burn CPU. if the CPU is X1/(Y2-Y1+X1) times fast, benchmark wt r4 will not take more than Y2 seconds complete. Even if other filesytem is unaffected by slower CPU, r4 will still be faster.

      This calculation gives you a very conservative estimate (it assumes all CPU time used by benchmark is due to filesystem in r4 case, and none of the CPU time is used by filesystem during benchmark wt. another fs) and it may not even be in the ballpark of the true value.

      --

      Gentlemen, you can't fight in here, this is the War Room!

    47. Re:Maturity by Arandir · · Score: 1

      It's not about stability, it's about not fitting into current kernel paradigms. Stability (as in not crashing) is only one of a dozen things to consider.

      --
      A Government Is a Body of People, Usually Notably Ungoverned
    48. Re:Maturity by m50d · · Score: 1

      Having reiser4 in there alongside the VFS layer would seem to fit in perfectly with the kernel paradigm that insisted the ide driver remained separate from the scsi one and on the same level, even when that requires introducing the separate block device layer above them.

      --
      I am trolling
    49. Re:Maturity by Prune · · Score: 1

      Why is it that 'feel good' euphemisms have more standing than reason? Consider that for better or for worse, humility will not help you succeed in today's world.

      --
      "Politicians and diapers must be changed often, and for the same reason."
    50. Re:Maturity by Prune · · Score: 1

      Do you really think if I were a troll I'd be posting starting at +2?

      --
      "Politicians and diapers must be changed often, and for the same reason."
    51. Re:Maturity by swillden · · Score: 2, Insightful

      Why is it that 'feel good' euphemisms have more standing than reason?

      What are the odds that your lack of humility is actually reasonable? I was a freaking genius until I got out of college and met the real world.

      And, if you must compare yourself to others, be very, very careful about doing it based on how they earn their living. I've known some pretty amazing janitors, for example, including one who was a very skilled Unix admin and programmer. I know another who janitor who is an extremely accomplished SCUBA diver who devours academic papers on decompression theory and writes his own software to calculate deco schedules for multi-stage, mixed-gas diving -- that's very complex stuff. He's also a skilled mechanic, welder, finish carpenter and a general jack of all trades -- but one who doesn't like to be tied to a job he can't just walk away from at any time. I know a garbage man who I call whenever I need help with my car or boat engines. I know a mail room guy who left a position as head chef of a top-notch restaurant, because he didn't like the stress. If you were to talk to him for a couple of minutes, you'd realize he's smart enough to do just about anything he wants... but what he wants is a low-stress, easy job that lets him focus on his life. He's an amazingly good mail room guy.

      Judging people by their occupations is not just arrogance... it's high foolishness.

      And all of that is just "hard" knowledge. There's a vast oceean of softer wisdom whose acquisition depends less on intelligence and more on time and, for lack of a better word, open-mindedness. A willingness to learn from anyone, ranging from the director of a research lab to a fifteen year-old kid with Downs Syndrome, will teach you more useful lessons about how to live a productive, happy life than you'll ever be able to discover on your own. Collectively, all of the people around you are much smarter than you are, even if you're individually smarter than every one of them.

      I'm still working on learning how to put aside my prejudices and get what I can from everyone I meet. It's really hard, but well worth it.

      Consider that for better or for worse, humility will not help you succeed in today's world.

      But arrogance will regularly torpedo you. I've also known some great programmers who were such prima donna SOBs that they eventually couldn't find employment.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    52. Re:Maturity by rbarreira · · Score: 1

      Usually not, but I've seen some trolls who have good karma many times...

      --

      The AACS key is NOT 0xF606EEFD628B1CA427BEA93A9CA9773F
    53. Re:Maturity by Anonymous Coward · · Score: 0

      I'm guessing that a physical labourer could teach an elitist pussy like you a stiff lesson in RESPECT without even breaking a sweat.

    54. Re:Maturity by Anonymous Coward · · Score: 0

      Do you really think if I were a troll I'd be posting starting at +2?
      That would depend on how many of your accounts you regularly use for running off your bigotted mouth. Those on which you don't will still have good karma and some mod points to waste on yourself. Remember that the people here are harder to impress than your neighbours in Buttream, Idaho. Try harder.

  3. Homework by mysqlrocks · · Score: 3, Funny

    Berkeley was a lot better than junior high school, but it still involved homework, which deep down in my heart I could never believe in.

    I hear you. I always avoided homework as much as possible too.

    1. Re:Homework by Spy+der+Mann · · Score: 1

      "Berkeley was a lot better than junior high school, but it still involved homework, which deep down in my heart I could never believe in."

      I hear you. I always avoided homework as much as possible too.

      Your comment might be funny, but remember that according to Penn State researchers, too much homerwork can be counterproductive... Reiser might have a point after all.

    2. Re:Homework by fsterman · · Score: 1

      Ahh, finally people understand my point! I keep telling people the reason I am not in college is becuase I am allergic to homework. I break in hives, it's awful!

      --
      Is there anything better than clicking through Microsoft ads on Slashdot?
  4. I was actually just wondering by mcc · · Score: 2, Interesting

    I was wondering over the weekend, on a whim, whether it would make sense to create a cross-platform library that abstracts meta-data/search functionality. Like, it would provide one uniform set of utility functions, and this would turn into calls to WinFS on windows, calls to Spotlight on OS X, and calls to ReiserFS on Linux.

    But I don't know enough about WinFS OR Spotlight Or ReiserFS to know if this would be even remotely useful or is just nonsense ;)

    1. Re:I was actually just wondering by Chosen+Reject · · Score: 0, Offtopic

      I was actually thinking wouldn't it be cool if all the major OS's had a basic set of libraries that were all the same. Things like create window, make a net connection, I/O, that kind of thing. They could each still have their own API's that did their own fandangled cool-look-what-our-OS-can-do type stuff, but the basic API's would allow an App, to be quickly ported from one OS to the next. At least the basic stuff. If an App had more OS-specific calls, it might take longer to port that part, but at least getting the app to show up would be a huge relief.

      --
      Stop Global Warming!
      Just say no to irreversible processes!
    2. Re:I was actually just wondering by RAMMS+EIN · · Score: 2, Insightful

      Like if the only popular OS that hasn't done so yet properly implemented POSIX?

      --
      Please correct me if I got my facts wrong.
    3. Re:I was actually just wondering by Loco3KGT · · Score: 1

      patent first, ask feasibility second.

      --
      Blessed be he who reads this post, Cursed be he who tells my boss.
    4. Re:I was actually just wondering by Anonymous Coward · · Score: 0, Insightful

      Can you say Trolltech Qt Toolkit?

    5. Re:I was actually just wondering by RAMMS+EIN · · Score: 3, Insightful

      It would be difficult to design. If you look at what APIs exist for this sort of functionality, pretty much the only one that has a significant amount of traction is SQL. And SQL isn't exactly the nicest language to work with. It's implemented with various degrees of compliance and non-standard extensions by various databases. Outside of SQL, the landscape is even more scattered.

      SQL language itself is somewhere in between being a very restrictive domain specific language and a full programming language. The way it is used in practice is by calling it from a real programming language, usually through an interface that leaves the door wide open for injection vulnerabilities.

      I believe the problem is that it's difficult to figure out what functionality goes where.

      If you want to get a list of all files that have been modified since monday and whose name does not start in a period, how do you proceed? Do you get a list of all files, then throw away all but the ones modified since monday, then discard all the ones whose names start in periods?

      Do you get a list of all files whose names do not start in periods, then discard all files that have been modified since monday? That requires your search interface and implementation to somehow support intelligent matching of the names (more difficult than getting all files whose names start in periods).

      Or do you directly query the system for what you want? In that scenario, your interface and implementation have to support complex queries, with subqueries, unequality operators, etc. Are you going to implement all this functionality, just because someone might need it? Is anyone going to be able to understand or implement your interface?

      I would love it if a good and cross-platform interface were available, but I don't think it's ever going to happen. If not for the technical difficulties, than because Microsoft won't want to adhere to the standard.

      --
      Please correct me if I got my facts wrong.
    6. Re:I was actually just wondering by Donny+Smith · · Score: 1

      >ever going to happen. If not for the technical difficulties, than (sic!) because Microsoft won't want to adhere to the standard.

      Unless it is Microsoft to make that software (as their standard) - it should be easiest for them because popular Linux filesystems are open.
      OSS licenses permitting such integration, of course.

    7. Re:I was actually just wondering by Jeremi · · Score: 0
      Can you say Trolltech Qt Toolkit?


      Actually, I can't -- I never know whether to pronounce it as "kyoo-tee" or "kyoot".

      --


      I don't care if it's 90,000 hectares. That lake was not my doing.
    8. Re:I was actually just wondering by 4of12 · · Score: 1
      If you look at what APIs exist for this sort of functionality, pretty much the only one that has a significant amount of traction is SQL. And SQL isn't exactly the nicest language to work with.

      For API, how about Google? I know, I know, the API is 0wn3d, but it is cross-platform.

      Something interesting could be built from using a browser plug-in or proxy (say, squid) to collect every searched keyword, time, hit-frequency, pathgraph of URLs clicked taken whenever I do a
      http://www.google.com/search?q=YourTermHere
      so that dynamic graphs could be built up as alternatives to static filesystems.

      Then, instead of coming up with a crappy static set of folders/subdirectories, I'd let this application build up
      ~/YourTermHere
      ~/YourPreviousTermHere

      all cached up.

      Kind of combining my Google Search history with my Bookmarks(indicate I think something is important), with my History (with the longest connected graphs in the URL click history showing the most interesting lines to pursue).

      And, to decrease dependence on Google, one could simply create a GoogleIntercept proxy that normally refers out to Google, but can do other things should the need arise.

      --
      "Provided by the management for your protection."
    9. Re:I was actually just wondering by ScrewMaster · · Score: 1

      And if, like, that OS's manufacturer didn't have a thoroughly vested interest in not making its applications portable to other operating systems?

      --
      The higher the technology, the sharper that two-edged sword.
    10. Re:I was actually just wondering by hansreiser · · Score: 2, Informative


      How about the semantics described in The ReiserFS Future Vision Whitepaper ;-)


      Regarding how to compute it, the standard algorithm traditional to boolean algebra works reasonably well, in which you take the intersection of all of the sets matching the subnames, starting the computation with the smallest of those sets.


      Hans

    11. Re:I was actually just wondering by Anonymous Coward · · Score: 0

      You call that a whitepaper?

    12. Re:I was actually just wondering by RAMMS+EIN · · Score: 1

      ``How about the semantics described in The ReiserFS Future Vision Whitepaper ;-)''

      Looks very good. I've not read the whole paper (it's a bit longish for just figuring out the syntax and semantix of queries), but here's how I understand it (and do correct me if I'm wrong):

        - A query is a list of things to match
        - These things can be simple keywords, ordered keywords, pruners, or subqueries (groups).

      So a simple search would be something like [book store Miami], which would find anything somehow related to book and store and Miami; most likely book stores in Miami. If you wanted to make that explicit, you could say something like [type/store selling/books location/Miami] (I've avoided the use of pruners; they seem like a less general form of ordered keywords). And if you want a store in Miami that sells books by Tolkien you could try [store Miami [books by Tolkien]]. Am I on track so far?

      I think the key point you're making is that any sort of organization can be helpful in some circumstances, but create barriers in others. Therefore, the only structure you can safely impose without a-priori knowledge of the data and how it will be used is no structure. This is very true, as anybody who has maintained databases should know (or probably anybody who has organized data).

      Now, here are a few problems that I haven't seen addressed:

      1. What if I want to have unequal relations? A store selling books older than 1960? Or a store selling books which are not The Lord of the Rings?

      2. You mention "Custom programmed syntax" (which is a great feature to have), but no mechanism to actually introduce this. Also, does such syntax live within the same constraints your syntax already imposes (like Lisp macros), or can you freely extend the syntax in any way imaginable?

      3. How does one create those queries programmatically? The problem with most other systems is that the syntax of the query language is sufficiently different from that of the programming language that the only mechanism flexible enough to compose queries is string concatenation. Unfortunately, that also opens the door to injection vulnerabilities. Practice shows that programmers are not smart enough to consistently escape user-supplied data, or to create wrappers that do so automatically. Do you have a plan to address this problem?

      ``Regarding how to compute it, the standard algorithm traditional to boolean algebra works reasonably well, in which you take the intersection of all of the sets matching the subnames, starting the computation with the smallest of those sets.''

      Yes, of course. My question about the computation was more related to where it happens: in the database, or in the program querying the database. Your paper puts all the computation in the database, which I think is the right approach, especially when you can extend what the database can do (stored procedures in SQL, custom syntax in your case). The tradeoff here is complexity of the database and query language vs. efficiency and duplication of work. I think reiser4's plugins are a great way to sidestep this problem; the database is simple at the core, but can be extended to match pretty much any degree of complexity. But again, the question arises: can you load these plugins through the query interface (as an unprivileged operation), or does it have to be done externally (and possibly as a privileged operation), like Linux kernel modules?

      All these questions severely impact the flexibility and safety of the system, and I'm afraid there's no one size fits all solution.

      --
      Please correct me if I got my facts wrong.
  5. WinFS? by Anonymous Coward · · Score: 2, Funny

    Does that actually exist?

    I thought It was dead...

    Let's try to keep our comparisons to real entities...

    1. Re:WinFS? by UWC · · Score: 3, Informative

      WinFS exists and is still in development. It's just not set to debut as part of Vista. Whether that means it will debut significantly after that I don't know, though. I think there's an alpha or beta version of WinFS available to developers now.

    2. Re:WinFS? by tjstork · · Score: 4, Informative

      There's a beta version available to developers now. There was a lot of criticism of it when it was first unveiled so they went back to the drawing board and released a new version that claims to address those concerns.

      --
      This is my sig.
    3. Re:WinFS? by WillAffleckUW · · Score: 1

      WinFS exists and is still in development. It's just not set to debut as part of Vista. Whether that means it will debut significantly after that I don't know, though. I think there's an alpha or beta version of WinFS available to developers now.
      --


      So basically it will get tossed aside at some future date?

      --
      -- Tigger warning: This post may contain tiggers! --
    4. Re:WinFS? by Anonymous Coward · · Score: 0
      Does that actually exist? I thought It was dead... Let's try to keep our comparisons to real entities...
      Or, we could keep our comparisons to subjects that we actually know something about. But, if we did that you'd have to know that WinFS is in Beta release right now. Or you'd have to shut up about it.
    5. Re:WinFS? by WindBourne · · Score: 1
      Let's try to keep our comparisons to real entities...

      Why start now? the commercial industry really seems to prefer working with an abstract abstraction until more money is needed.

      --
      I prefer the "u" in honour as it seems to be missing these days.
  6. Who's on first? by Anonymous Coward · · Score: 0

    " Reiser3 and Reiser4. Reiser3 was the first journaling Linux filesystem."

    The first? XFS, and JFS.

    1. Re:Who's on first? by Anonymous Coward · · Score: 0

      XFS and JFS may have existed earlier, but Reiserfs was first in the Linux kernel. XFS came from SGI and JFS from IBM.

    2. Re:Who's on first? by MindStalker · · Score: 4, Informative

      XFS beta came out 9/22/2000 (its source code was first publically available on 3/30/2000) The first journaling version of reiserFS was release in november of 1999.

      JFS came later than XFS though I can't find the date.

      Of course officially ext3 came out before reiserFS in september of 1999, though ext3 is the real winner. Which produced workable code first I have no idea.

    3. Re:Who's on first? by ivan256 · · Score: 1

      That first XFS beta was actually usable. The others, well, weren't. ext3 performed like crap, and crashed. ReiserFS crashed, and changed the on-disk format several times (which is beyond annoying), and couldn't be used on drives you wanted to NFS export.

      It doesn't matter who was first though. It's not like journaling filesystems were new technology. This is almost as silly as claiming to be the first to run Windows for Workgroups v3.11 on an Opteron. Imagine how much sooner we would have had a modern filesystem on Linux if all these guys had stopped fighting for credit and worked with each other.

  7. Hans and Franz by Anonymous Coward · · Score: 4, Funny

    I am Hans, and this is Franz, and we want to [clap] journal your filesystem.
    Ya. Ya. All you little girly men with your FAT and NTFS!
    Really, Ya. Makes me sad to see such pathetic file systems!

    1. Re:Hans and Franz by Anonymous Coward · · Score: 0

      Please help me complete this lymerick:

      There once was a hacker named Hans,
      who taught his trees how to dance.
      When unlinking filenames, each inode proclaims,
      ".....".

      chance? france? advance? romance...

      TIA.

    2. Re:Hans and Franz by Anonymous Coward · · Score: 0

      There once was a hacker named Hans,
      who taught his trees how to dance.
      When unlinking filenames, each inode proclaims,
      Chance France, advance romance.

      Works for me.

    3. Re:Hans and Franz by Alien+Being · · Score: 3, Funny

      On our keyboards we admins did pound.
      It was quite a thunderous sound.
      Some bastard named Hans
      taught his trees how to dance.
      Now our files are in lost+found

    4. Re:Hans and Franz by Omnifarious · · Score: 0, Flamebait

      ext2 and ext3 need to be counted among the ranks of pathetic filesystems. IMHO, any 'modern' filesystem that handles a directory containing thousands of small files so incredibly inefficiently is awful, and should be migrated away from.

      I'm highly disappointed that I cannot get a Linus kernel with reiser4 in it yet.

    5. Re:Hans and Franz by RealProgrammer · · Score: 2, Funny

      There once was a hacker named Hans,
      Who taught his B-trees how to dance.
      When unlinking filenames,
      Each inode proclaims,
      Our FS pwns Bill girly man's!

      --
      sigs, as if you care.
    6. Re:Hans and Franz by ttocs_47 · · Score: 1

      There once was a hacker named Hans,
      who taught his trees how to dance.
      When unlinking filenames, each inode proclaims,
      "It's like I have fire in my pants!"

    7. Re:Hans and Franz by Anonymous Coward · · Score: 0

      Man I laughed so hard and actually fell out of my chair. That was pure comic relief.

    8. Re:Hans and Franz by RobKow · · Score: 2, Informative

      ext3 with the dir_index feature does just fine by me, although I'm not sure what kernel version it was added in, if at all (I've got it by default in my Red Hat Enterprise Linux 4 installs).

    9. Re:Hans and Franz by bani · · Score: 1

      reiserfs doesnt have lost+found ...

    10. Re:Hans and Franz by Omnifarious · · Score: 1

      Even with that feature, it would handle small files very poorly. I find it highly amusing that I get moderated flamebait for my comment. I guess some people just don't like reading the truth.

    11. Re:Hans and Franz by Anonymous Coward · · Score: 0

      just go with the limerick, you douchebag.

    12. Re:Hans and Franz by Anonymous Coward · · Score: 0

      no. fuck you.

  8. What exactly is "amazing" performance? by CyricZ · · Score: 2, Insightful

    How does the performance of Reiser4 compare to that of Reiser3, XFS, JFS, EXT2/3, UFS, UFS2, etc., in quantitative terms, for various applications?

    --
    Cyric Zndovzny at your service.
    1. Re:What exactly is "amazing" performance? by Anonymous Coward · · Score: 0
      Sorry, this gets a little chopped by ./ HTML.

      Quantitive comparison table, Reiser4 vs.:
      Reiser3 | 2
      XFS | 2.7
      JFS | 3
      EXT2 | 5
      EXT3 | 4.5
      UFS | 3
      UFS2 | 2.5

    2. Re:What exactly is "amazing" performance? by varmittang · · Score: 4, Informative

      This one is pretty old review back when Reiser4 was still Experimental. More recent one would be here, but it too is over a year old.

      --
      -----BEGIN PGP SIGNATURE-----
      12345
      -----END PGP SIGNATURE-----
    3. Re:What exactly is "amazing" performance? by Anonymous Coward · · Score: 0

      way to karma whore by not doing any research and just posting a question. i'll save my next 5 overrated just for you.

    4. Re:What exactly is "amazing" performance? by CyricZ · · Score: 1

      Yeah, I had found those links as well. But I was hoping that somebody had done a more recent (ie. within the last month, if not sooner) evaluation of the performance of various filesystems. A lot of developments take place within the course of a year, so I would be hesitant to take such results as worthwhile in this day and age.

      --
      Cyric Zndovzny at your service.
    5. Re:What exactly is "amazing" performance? by otisg · · Score: 4, Informative

      This is a type of question that, unfortunately, cannot be answered correctly. Well, it can: it depends. But that's not what you are after. As Hans himself pointed out, there are some fsync performance problems with ReiserFS. If you look at PostgreSQL config files, you'll notice a "fsync" setting, and if you look at pgsql-performance mailing list, you'll see frequent mentions of fsync. Obviously, fsync affects DBs (not just PostgreSQL), and ReiserFS may not currently be so great for DBs. However, it is apparently good for large directories (1 directory, lots of files in it). So, it depends how you use your FS.
      Describe how you use your FS, and maybe somebody can provide good feedback.

      --
      Simpy
    6. Re:What exactly is "amazing" performance? by Anonymous Coward · · Score: 1, Informative

      A new review available in the German magazine this month:
      http://www.linux-magazin.de/Artikel/ausgabe/2005/1 0

      Unfortunately not free...

    7. Re:What exactly is "amazing" performance? by Arandir · · Score: 1

      A better question is: if you're a home desktop user what benefit does a journaling file system give you? If the only benefit is the elimination of file system checks after an abrupt shutdown, then who the fsck [sic] cares which one you use?

      The metadata searching stuff sounds interesting, but I still fail to see the necessity of putting that functionality in the file system. Do we really need to dumb everything down to the Windows-idiot level?

      --
      A Government Is a Body of People, Usually Notably Ungoverned
    8. Re:What exactly is "amazing" performance? by RealNecator · · Score: 2, Informative

      A better question is: if you're a home desktop user what benefit does a journaling file system give you?
      The thing is, Reiser ist not only about journalizing but also about performance because of stuffing things together in a more intelligent way. Therefore you don't waste harddisk space and the access of the data is also faster (especially with many small files).
      Therefore you get benefits even on your home desktop

    9. Re:What exactly is "amazing" performance? by Arandir · · Score: 1

      Therefore you don't waste harddisk space...

      Considering the average size of harddrives for desktop systems, your argument is almost pointless. Older systems with smaller drives aren't going to like reiserfs because of its overhead in other areas. ...and the access of the data is also faster

      How much faster? Is it noticable enough to bother switching filesystems? Has anyone switched from jfs, xfs, etc, to reiserfs and seen a difference on the *desktop*? Can they quantify their experience objectively, or is it just another subjective fuzzy feeling?

      --
      A Government Is a Body of People, Usually Notably Ungoverned
    10. Re:What exactly is "amazing" performance? by RealNecator · · Score: 1
      Considering the average size of harddrives for desktop systems, your argument is almost pointless.

      Of course you are right. And also the speed-argument is somewhat right. It won't make your applications lightning-fast. (Of course depends on your application. The (non-desktop) application like courier-imapd rocks with reiser.

      But why not use it, if you can get it all for free?
      People (hmm ... gamers) upgrade their processor for less advantage ...

    11. Re:What exactly is "amazing" performance? by Sgt+Pinback · · Score: 1

      Maybe a stupid question, but am I the only one who wants his filesystems checked after a crash? (I could do without the check-after-N-mounts thing.)

      --

      --

      I do not like the men on this space ship!
  9. What the hell? by Enoch+Lockwood · · Score: 0
    What the hell?

    When asked about GPL the guy sounds like he thinks it's something unpleasant that we have to live for the time being! Jesus. And I had always had lots of respect for Hans. :-(

    1. Re:What the hell? by Anonymous Coward · · Score: 0

      Truth hurts, huh?

    2. Re:What the hell? by babyblink · · Score: 1

      I always have "any later version" clause applied for my (most of the time-GP) license, so FSF, I trust, can fix it if bad things happen. I'm glad that I always share the kind of politic model. Well, just for me, too bad this isn't in Linux's.

      --
      [self dealloc];
    3. Re:What the hell? by bheading · · Score: 1

      Hans lives in the real world and has to earn a living for himself. It's alright for Stallman and co, with a charitable foundation to support them. You can love free software as much as you want (I do), but you're merely exceptionally lucky if you can find a way to make it pay the rent.

    4. Re:What the hell? by Anonymous Coward · · Score: 0
  10. Interface to metadata? by Gothmolly · · Score: 2, Insightful

    Journalled filesystems are so 90s. Everyone is raving about how the new whizbang filesystems of the 21st century are going let you do metadata searches, and harken back to the beloved (?) BeOS. Well, what I want to know is: How do I get to this metadata? Some extra tool? Some right-click option that I have to select every time I create a file? Will all File dialog boxes have to be rewritten, and will I have to manually input all this info?
    I'm happier with Google desktop, which can, effectively, search many types of my files, and has a relatively familiar interface (for all but RMS).
    Once there's an application which can find all pictures of my dog, or songs with piano in them, and store THAT in the metadata, which I can search somehow, call me. Otherwise I'll stick to ext3fs and NTFS.
    Wake me when the revolution starts.

    --
    I want to delete my account but Slashdot doesn't allow it.
    1. Re:Interface to metadata? by Trigun · · Score: 1

      Her ya go!

      But if you wanted to do all that you claimed to do, would you really devote the resources to supplying relevant metadata to your files?

    2. Re:Interface to metadata? by diegocgteleline.es · · Score: 2, Insightful

      Somehow I think they will be useful. The file/directory concept was born (IIRC) at Multics, and that was because people was starting to have too many files (until then there was no directories, just "files")

      The file/directory idea got spread by unix (except for CP/M, who invented the "unit" bastardization which was inherited by DOS and NT) and it has been nice for 30 years

      But now we have the same problem: We have too many files. The "file/diretory" thing was enought in the 70's because people didn't have too many files. But now, we have thousands and thousands of files, the "file/directory" idea is not enought.

      I've suffered from this limitation several times. When I try to classify Joaquín Sabina's (a spanish musician who writes good lyrics) poems book, I don't know if I must save it under "~/musica/Joaquín_Sabina" or "~/docs" or what. What I really want is to have it in *both* sides, and while symlinks are nice, what I really want is a database query. This is where all those filesystems come to help - the world has been using the file/directory unix paradigm for 30 years, but that doesn't means it'll be forever the same, and the fact that unix didn't have it doesn't makes it a bad idea.

    3. Re:Interface to metadata? by Bogtha · · Score: 4, Interesting

      Well, what I want to know is: How do I get to this metadata? Some extra tool?

      One of the driving concepts behind ReiserFS is that metadata is nothing special, and it should be presented in the same namespace as the files themselves. If you read the article, it talks about using 'cat' and other simple tools to manipulate the metadata. Think something like 'cat /home/foo/music/some.mp3/artist' to display the person who performed a song.

      Some right-click option that I have to select every time I create a file?

      It depends on the metadata. Think about file permissions. That's metadata. All the files you create are given defaults based on your umask, and you can go in and change them at any time.

      In order to expose some of this metadata to the end-user in a GUI, yes, there will probably need to be some new UI work done. It doesn't all just magically work, it has to be presented to the end-user in some way that will make sense to them. So what I would expect is that the filesystem and plugins will be finished and done, and able to be manipulated by programs and shell scripts, and then it will take further work to integrate this metadata support into GUIs and file managers in a way that's useful to non-power-users.

      --
      Bogtha Bogtha Bogtha
    4. Re:Interface to metadata? by peragrin · · Score: 0, Troll

      If your not smart enough to remember how you file things, how are you going to be smart enough to remember the metadata needed to extract the files out of a database?

      Second people complain of Resier4's system overhead. What your proposing is every one needs three different computers so they have enough CPU power to play a game. Because that game is going to need to make a few thousand database queries in a short order to load up a map.

      --
      i thought once I was found, but it was only a dream.
    5. Re:Interface to metadata? by RAMMS+EIN · · Score: 2, Interesting

      ``Well, what I want to know is: How do I get to this metadata? Some extra tool? Some right-click option that I have to select every time I create a file? Will all File dialog boxes have to be rewritten, and will I have to manually input all this info?''

      How does metadata get into the ID3 tags of MP3s and the comments in Ogg Vorbis files? Wouldn't it be nice if that info were available through a standard interface? Wouldn't it be nice if the same interface provided access to metadata about movies? Webpages? Images? Search for all movies longer than 2 hours, or search for images of 1024x768 resolution? BeOS has a pretty nice interface to metadata. These sorts of searches are now starting to crop up in Windows, too.

      Reiser4 is about the only file system that implements metadata properly and efficiently. This could be a killer feature for Linux, if only Reiser4 were accepted in the kernel and some software written to take advantage of the features. It shouldn't be too hard to put some functionality in GIMP, Nautilus, some command-line tools, etc.

      ``Once there's an application which can find all pictures of my dog, or songs with piano in them, and store THAT in the metadata, which I can search somehow, call me.''

      AI is soooo 1960s. ;-) Maybe we should revive LISP and use reiser4 for efficient storage of CLOS objects? It's an idea I've been toying with for a while...it's crazy enough that it might just work. In the meantime, I already have a simple filesystem for Scheme objects on paper...I just have to get enough time one day to implement it and see if it's usable in practice.

      --
      Please correct me if I got my facts wrong.
    6. Re:Interface to metadata? by Anonymous Coward · · Score: 0

      And if YOUR not smart enough to even grasp basic grammar, how do YOU expect to judge other people's intellectual capabilities?

      thanx for the ensitefull poste dummace

    7. Re:Interface to metadata? by AvitarX · · Score: 1

      what is the "unit" bastardization?

      I looked up cp/m unit filesystem and have no idea how it differs for file/director, inquiring minds want to know.

      I am happy for an explanation or links (not too long though). please reeply, as I am wasting my mod points posting this.

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
    8. Re:Interface to metadata? by diegocgteleline.es · · Score: 4, Insightful

      If your not smart enough to remember how you file things, how are you going to be smart enough to remember the metadata needed to extract the files out of a database?

      Remember what?

      When I query something, I query what I _want_. Filesystem should provide me my files - there's nothing to remember. I'm already quering amarok interface with song names and it doesn't hurts. Same for spotlight - people likes it.

      Second people complain of Resier4's system overhead

      I don't understand those complains. I've seen benchmarks where reiser4 eats the double of CPU time than other filesystem. But then, it finishes the task in half of the time.

      Which is the whole point of a filesystem, mind you. If your filesystem is eating few CPU cycles, it means it's wasting time waiting for the disk. In a "perfect world", any filesystem would eat 100% - it'd avoid all the I/O. Reiser 4 complains about eating too many CPU can be partly because it is fast at I/O. I guess their algorightms are also very complex and burn lots of cpu cycles too - if you want to avoid I/O you need complex algorithms after all, right?

      CPU cycles are cheap. What do you prefer, a fast filesystem which doesn't eats cpu cycles (because it sucks and spends all the time waiting for the disk) or a filesystem which eats CPU power because it is fast?

    9. Re:Interface to metadata? by sasami · · Score: 4, Insightful

      Well, what I want to know is: How do I get to this metadata? Some extra tool? Some right-click option that I have to select every time I create a file?

      Anytime you save a file today, you're already manually specifying several pieces of metadata: the filename and the location.

      Anytime you access a file today, you're already manually specifying that metadata also.

      Consider how many clicks it takes to (graphically) navigate to a file from the root directory. That is exactly the number of metadata labels that you yourself supplied for that unique file's creation.

      So, the obvious generalization of this is to get rid of the hierarchy concept entirely. Then, as an earlier poster described, I can naturally tag my music by artist and by genre, instead of using symlinks to cut across trees.

      More practically, it would allow applications to install themselves using a unique tag, so that uninstalling (or moving, or archiving) the application requires just one query on just one tag, and is guaranteed to turn up any associated file regardless of its "location."

      --
      Dum de dum.

      --
      Freedom is not the license to do what we like, it is the power to do what we ought.
    10. Re:Interface to metadata? by 99BottlesOfBeerInMyF · · Score: 3, Informative

      Well, what I want to know is: How do I get to this metadata? ...Once there's an application which can find all pictures of my dog, or songs with piano in them, and store THAT in the metadata, which I can search somehow, call me.

      I take it you have not actually tried to use any of these new filesystems and their metadata. Metadata comes from lots of places. It comes from an internet database of music CD and movie DVDs. It comes from the OS intelligently reading the text contained within various file types (like text, rtf, .doc, PDF, PS, etc. etc.) and extendable by a plug-in type architecture. It comes from applications who assign it based upon given criteria, or from applications that create files which are now starting to assign more and more metadata to those files. It comes from hardware, like when your digital camera or PVR assigns dates to files it creates. It comes from users inputing it by hand, like when they go through their vacation photos and add a description for each picture.

      I use this metadata and perform searches on it every day. Why shouldn't I be able to do an easy search on my computer for every document, application, library, etc. that has the string "vpn" in it? Shouldn't I be able to find all references to MPLS in my files, whether or not they are in in text, .doc, .pdf, or some other file format? Shouldn't applications on my system be able to find and edit this data as well? Well, now I can (and they can) and I really, really like it.

      For some reason you are looking at the current limitations of metadata, i.e. optical recognition can't reliably identify my dog, instead of the advantages, which is all the information that can be reliably searched. Maybe right now I can't search for all my mp3's with a piano in them, but I can automatically tag all the audio coming in over the mic I have attached to the piano with metadata that says it is piano. Now fast forward 10 years and suddenly all of your files have a wealth of automatically generated data associated with them. In 10 years I will be able to search for all the mp3's that have piano in them, because my audio mixing program labels all the files with input from the piano mic with the proper metadata and why not. For a few seconds work up front I, and everyone using my files, gets additional functionality. Now apply that to all files from all sources and suddenly metadata has greatly improved the computing experience.

      Get with the times, metadata in the filesystem is here and it is very useful and it is becoming more and more useful every day.

    11. Re:Interface to metadata? by diegocgteleline.es · · Score: 2, Informative

      The "unit bastardization" is the A:, B:, C: thing

      It breaks the filesystem namespace, it's ugly, there's a nice paper from Rob Pike and Peter J Weinberg where they compare and explain different namespace choices for several operative systems (unix, plan9, dos, VMS): The Hideous Name

    12. Re:Interface to metadata? by ArsonSmith · · Score: 5, Interesting

      Another thing I thought sounded cool was the ability to cat /home/foo/music/some.mp3/raw > /dev/dsp and the mp3 would just play by using a plugin that ran it through an mp3 library. This would allow application developers to just access file/raw rather than worrying about file types and conversions.

      If I'm writing an image viewing program I no longer have to worry about hooks to libjpg, libungif, libpng, libevery image file type available. Let the OS care about file types and let applications deal with raw data and focus on interface rather than file types.

      --
      Paying taxes to buy civilization is like paying a hooker to buy love.
    13. Re:Interface to metadata? by AvitarX · · Score: 1

      thanks, my own intuition lead me to believe that from the reading, but I didn't want to sound dumb so I didn't include it.

      --
      Wow, sent an e-mail as suggested when clicking on "use classic" banner, and got a fast response that addressed my msg
    14. Re:Interface to metadata? by Bob+Uhl · · Score: 1
      If your not smart enough to remember how you file things, how are you going to be smart enough to remember the metadata needed to extract the files out of a database?

      One could just as well ask what benefit directories buy one if one can't remember one's flat-file naming conventions.

      iTunes provides a rudimentary metadata search which does a decent job; future research will no doubt reveal even better ways to handle it.

    15. Re:Interface to metadata? by LordMyren · · Score: 1

      Well, what I want to know is: How do I get to this metadata? Some extra tool? Some right-click option that I have to select every time I create a file? Will all File dialog boxes have to be rewritten, and will I have to manually input all this info?

      Its called the command line.

      The idea is basically to turn the FS into a big REST system, pretty much. Any old file will have what appear to be directories and files within them that perform functions by their plugins. So nothing changes for the FS. For some reason ... (as paralleled to . and ..) has become the popular item i've seen for accessing files "metadata" (this "meta" distinction is bullshit, IMO. is it still metadata if the plugin transforms data in the actual file?). Anyways, that lets you do stuff like /var/music/.../blues to fetch a directory full of all your blues. /var/music/.../blues+year=1960- to get blues before 1960, or other wacky stuff like that. Google desktop with its amazing astounding grep and grep -c (aka PageLink) capabilities could be accessed with /home/gothmolly/docs/.../keyword=foo+sort=referenc es. Presto! Multi-dimensional drilling through your file system.

      The idea is that /nothing/ changes. Apps can utilize this infrastructure to do the stupid GUI based crap you talk about, but ultimately it is merely the combined inherent godliness and flexibility of heirachy and the command line which will save us all.

      Figuring out how to dumb down the infinite possibility of the command line into a GUI is a job for whatever poor bastard gets slapped the unsightly task by whatever HCI department feeling spiteful enough to do so. The real point is that people dont have to learn the command line to access this new power, they just have to be able to construct and label file names. Sure, google proved to us all that eliminating AND, OR, NOT, and braces wins you gold medals for usability, but I have yet to see a user interface - graphical or textual - simpler OR more powerful than the command line which allows users to construct simple multi-dimensional database queries. Which is what we need, which is what users want to do now. A UI which provides anything simpler is inherently not powerful enough for the future. People think multi-dimensionally, its what makes them better than computers.

      And yes, there will be tools. Every plugin needs some kind of way to build the metadata. So maybe we'll all have our own copy of del.icio.us running on our computer to do tagging. We'll probably have command line tools: tag ./thismusicfile blues. But these tools are ancillary to the fact.

      The point is dead fucking simple. Everything else is a search system, is a method of finding. This is just a metamethod. Its the method that all other methods can use. The net aggregate is a flexible semantically empowered filesystem. Its hard to elaborate further, by now your either wetting your pant or you'll just have to wait until after the Revolution has happened.

      -Lord "+1 for Flamebait This Time" Myren

      Keep in mind that I basically just made up these semantics. But thats part of the system, you can just start making semantics up (if you dnt mind coding a plugin).

    16. Re:Interface to metadata? by corpsiclex · · Score: 1

      It seems to me no revolution is going to start because everyone is asleep and waiting for it.

      --

      eBayDig 1s a typo saerch engien
    17. Re:Interface to metadata? by LordMyren · · Score: 1

      if your not smart enough to remember how you file things, how are you going to be smart enough to remember the metadata needed to extract the files out of a database?

      His problem was that he couldnt remember which of the many possible classification schemes he chose for a particular peice fo media. The media inherently has multiple indexes, as to the author, genre, and media format (poem, music, what). If its a conventional heirarchy, he cant remember which index he chose for the particualr piece. After you finish reading the fucking comment, try understanding what the man is saying before you spew unto the world your ignorant-ass reply: When I try to classify Joaquín Sabina's (a spanish musician who writes good lyrics) poems book, I don't know if I must save it under "~/musica/Joaquín_Sabina" or "~/docs" or what. What I really want is to have it in *both* sides, and while symlinks are nice, what I really want is a database query.

      Second people complain of Resier4's system overhead. What your proposing is every one needs three different computers so they have enough CPU power to play a game. Because that game is going to need to make a few thousand database queries in a short order to load up a map.

      Further, your game example is utter rubbish. You'd have to be a pretty crappy game designer to store your level such that you'd have to be doing a multitude of unoptimized multidimensional lookups. Learn something before you open your mouth; Reiser4 uses much of the same high performance infrastuctrue is Reiser3. Supposedly even faster! (cite: the fscking-article) Conventional FS access has no need to go through the semantic plugins. They're called plugins because they're just that, thoroughly non integral.

      -Myren

    18. Re:Interface to metadata? by jeepeagle · · Score: 1

      But files are shared between applications - how does this handle dependencies?

    19. Re:Interface to metadata? by bani · · Score: 1

      Tagging by artist and genre _is_ using a heirarchy concept. So no, you don't get rid of it entirely.

      Heirarchies are good for simplfiying multiuser access control. A dbfs is more akin to a flat filesystem. I'm sure there will be security implications from dbfs.

      And what about network filesystems? How do you handle namespace collisions?

    20. Re:Interface to metadata? by Anonymous Coward · · Score: 0

      Anytime you save a file today, you're already manually specifying several pieces of metadata: the filename and the location.

      Anytime you access a file today, you're already manually specifying that metadata also.


      Trouble is, every application from 'cat' to 'Matlab R14' today is equipped to do it that way, and ONLY that way.

    21. Re:Interface to metadata? by larry+bagina · · Score: 1
      Well, what I want to know is: How do I get to this metadata?

      In BeOS, often the application would provide some of the extra metadata. An MP3 Player could save the id3 info as metadata, etc. an imageviewer might save the image dimension metadata, etc.

      --
      Do you even lift?

      These aren't the 'roids you're looking for.

    22. Re:Interface to metadata? by larry+bagina · · Score: 1
      Why don't you just use a library that provides one interface for raw image data (or whatever) and handles filetype conversions on the back end?

      Or would you enjoy recompiling the kernel every time there's an update or security fix for mp3, ogg, png, gif, etc etc.?

      --
      Do you even lift?

      These aren't the 'roids you're looking for.

    23. Re:Interface to metadata? by Skye16 · · Score: 1

      I've been wasting away in the vast pits of RDF and the "Semantic Web" for the last year at work. Here's a relatively nifty tool developed by some grad students at some university or another. PhotoStuff. Lots of stuff is being done with RDF - in particular with inferencing (using tools like RDF Gateway and the like). If you want to know my opinion on the subject: I hate it. But overtime, I've also come to respect it. Developing with it may not be my cup o' tea, but it can still be used to do some pretty nifty stuff.

    24. Re:Interface to metadata? by Anonymous Coward · · Score: 0

      L33t level is directly proportional to the number of times the kernel had to be recompiled in order to support something that should of been standard 5 years ago. A Linux guru has no issues with recompiling.

    25. Re:Interface to metadata? by CoughDropAddict · · Score: 2, Insightful

      This would allow application developers to just access file/raw rather than worrying about file types and conversions.

      Is that raw data big-endian or little-endian? How many bits per sample? What's the sample rate? How many channels? Interleaved or no?

      Will that pseudo-file support seeking? What sort of units will you seek in -- bytes, samples, frames, or seconds?

      What if I try to read 3 bytes, but the frame size is 4 bytes? My 3-byte read will never return any data, even though there's data left in the file. Or maybe it will return data, but return only a partial sample.

      What I'm getting at is that this stuff is more complicated than you might wish. It would be nice to say "the filesystem understands formats, now I never have to worry about them again!" But there is no canonical way to represent "raw" data -- part of what a format does is explain what that data is!

      Also, there's a cost associated with converting between formats -- trying to hide that will only impair the ability of application developers to optimize for their use cases.

    26. Re:Interface to metadata? by sasami · · Score: 1

      But files are shared between applications - how does this handle dependencies?

      Clearly, my two-line description won't address all the nuances that surface when you work out the full design of any large system.

      But dependency is just another kind of metadata. (Except that today it's not metadata, it's just luck, and is one of my biggest peeves in both Linux and Windows). One solution might be to allow some types of tags to act like hardlinks, in that the file doesn't get deleted until it has no more hard references.

      An application-owned shared library (like libgimp.so) should have only "gimp" as its default hardlink. Another application that wants to use it can add its own hardlink. The library would live until both applications are uninstalled.

      On the other hand, a system-owned library like libz.so would have a stable identity of its own (like, say, "libz") that persists even after its clients get uninstalled.

      Or something.

      --
      Dum de dum.

      --
      Freedom is not the license to do what we like, it is the power to do what we ought.
    27. Re:Interface to metadata? by Just+Some+Guy · · Score: 1
      Another thing I thought sounded cool was the ability to cat /home/foo/music/some.mp3/raw > /dev/dsp and the mp3 would just play by using a plugin that ran it through an mp3 library.

      This is exceptionally cool, and it's currently well supported by KDE's kioslaves. I much prefer that to a kernelspace solution because it means I get the same cool toys on FreeBSD as on Linux as on Solaris (and soon as on Windows).

      --
      Dewey, what part of this looks like authorities should be involved?
    28. Re:Interface to metadata? by ArsonSmith · · Score: 1

      One word, Plugins. No diffrent than upgrading the libs needed to do this anyway.

      --
      Paying taxes to buy civilization is like paying a hooker to buy love.
    29. Re:Interface to metadata? by sasami · · Score: 1

      Of course a dbfs will generate little inconvenient quirks all its own. Maybe I'll hate them once they become available. But who knows?

      Heirarchies are good for simplfiying multiuser access control.

      The DB model subsumes this functionality in many ways, I think. If every file I create is tagged with my username, this seems pretty similar to giving me a "home directory" which, purely incidentally, tends to be named using one's username.

      Groups can be handled the same way. And hey look, now a file can be shared between two groups.

      And what about network filesystems? How do you handle namespace collisions?

      As I said in the other post, my brief description isn't meant to be a design. It's a wishlist. And these kinds of objections are irrelevant to my reasons for wanting the wishlist. They are quite relevant to the practicality and adoption of the wishlist, which is not unimportant but is a different topic.

      That said, how are namespace collisions handled today? Mainly by glomming extra identifiers onto each object, no? I don't have collisions with my server's filesystem because everything the mount point acts as the namespace uniquifier. I don't see this being any different in a dbfs.

      --
      Dum de dum.

      --
      Freedom is not the license to do what we like, it is the power to do what we ought.
    30. Re:Interface to metadata? by sasami · · Score: 1

      Trouble is, every application from 'cat' to 'Matlab R14' today is equipped to do it that way, and ONLY that way.

      There's no reason the string "/home/foo/mp3/titles/mahnamahna.mp3" could not be interpreted by the filesystem as a string of tags, so long as it resolves to a unique file.

      The string "/tmp/archive/artists/henson/mahnamahna.mp3" could resolve to exactly the same physical file, and the legacy application would be none the wiser.

      What the legacy application would be unable to process is the query "artists+simon-garfunkel". If it did, it would show you a "directory" containing the files you asked for.

      Of course, this isn't perfect. If the application asked for "/" it might get the whole world, which is clearly not correct -- except when you do, in fact, want the whole world. I'm sure someone will have (or has already had) some clever solution though.

      --
      Dum de dum.

      --
      Freedom is not the license to do what we like, it is the power to do what we ought.
    31. Re:Interface to metadata? by bani · · Score: 1

      the problem here is that humans traditionally operate in heirarchical space in real life. files, folders, volumes, etc. it's a natural interface. this is why the GUI works better than character mode interfaces -- because it's "natural".

      dbfs tries to make everything into searchable flatspace. this has been tried several times before and it never really worked in terms of an interface.

      what did work was a good metadata API. but you don't need a dbfs for that. apple proved that.

      when you look at how databases are organized, they are also almost always organized into heirarchies. because that's the way humans operate.

    32. Re:Interface to metadata? by Anonymous Coward · · Score: 0

      One of the driving concepts behind ReiserFS is that metadata is nothing special, and it should be presented in the same namespace as the files themselves.

      Yes, data=metadata. Why have an arbitrarily separate category of data, and extra complexity in the kernel, at all?

      I think people talking about kernel supported metadata are guilty of fuzzy thinking. They need to be much more rigorous about what they are trying to achieve.

      Any metadata creation/access is better done in userspace for flexibility, maintainablity etc. The only metadata manipulation that should be done in the kernel is security related metadata because, in the absence of a microkernel and capabilities, only the kernel can be trusted.

      If there is a metadata performance problem at user level it's a sign that the underlying data file system has been badly implemented, not that things will mystically improve when arbtrary user space processes that happen to be called "metadata" (anything can be called metadata) are moved into the kernel.

    33. Re:Interface to metadata? by shutdown+-p+now · · Score: 2, Insightful
      Is that raw data big-endian or little-endian? How many bits per sample? What's the sample rate? How many channels? Interleaved or no?
      Well, noone stops you from opening and reading 'file/raw/bps', 'file/raw/endianness' etc. As long as we can agree on the common namespace for all audio files, I don't see why it won't work.
      Will that pseudo-file support seeking?
      Yes, if the plugin supports it.
      What sort of units will you seek in -- bytes, samples, frames, or seconds?
      Since file (even a pseudo one) is a stream of bytes, you obviously operate in terms of bytes.
      What if I try to read 3 bytes, but the frame size is 4 bytes? My 3-byte read will never return any data, even though there's data left in the file. Or maybe it will return data, but return only a partial sample.
      You know how TCP sockets present you a continuous stream of data, when in fact under the hood there are distinct packets of certain size sent back and forth? This problem has been solved ages ago.
      It would be nice to say "the filesystem understands formats, now I never have to worry about them again!"
      Oh, you certainly will still have to care. You just get a higher level of abstaction, such as 'audio stream' vs 'video stream' vs 'static image', as opposed to mp3/ogg/avi/mpg/gif/jpg...
    34. Re:Interface to metadata? by Anonymous Coward · · Score: 0

      What you say is true if Reiser4 uses the same or less total CPU time, just at a faster rate.

                  rate X time = quantity
              CPU/sec. X sec. = CPU

      Does Reiser4 use less or more total CPU time (or cycles)?

      You said that it uses double, which would slow other programs wanting CPU time on my systems, but I'm not sure that that's what you meant:

      I've seen benchmarks where reiser4 eats the double of CPU time than other filesystem. But then, it finishes the task in half of the time.

    35. Re:Interface to metadata? by Anonymous Coward · · Score: 0

      Uh, I'm not so sure about this. I've seen plenty of people dump EVERYTHING onto their desktops (and I don't just mean the computer software kind).

      Some people work heirarchially. For others, it's a real challenge. Hell, I've had a hard time getting my developers to create namespaces for their classes that are more than one level deep. If they won't do it, what makes you think Mom, Pop, and Grandmama are going to?

    36. Re:Interface to metadata? by CoughDropAddict · · Score: 2, Interesting

      Well, noone stops you from opening and reading 'file/raw/bps', 'file/raw/endianness' etc. As long as we can agree on the common namespace for all audio files, I don't see why it won't work.

      OK, but that won't work for the "cat file.mp3/raw > /dev/dsp" case.

      The point of my criticism is that raw audio data isn't self-describing, so unlike text, you can't pipe it around without supplying some metadata. IMO a better solution than what you propose is to support an interface like file.mp3/wav, which is raw data, but has a WAV header to tell you how to interpret it.

    37. Re:Interface to metadata? by JabberWokky · · Score: 1
      Do they still have drive letters in Windows? Gah... I thought that had been removed when they did the whole "My Music" and stuff.

      --
      Evan

      --
      "$30 for the One True Ring. $10 each additional ring!" -- JRR "Bob" Tolkien
  11. Non-wide page link by Alan · · Score: 4, Informative

    Here's a link to the page that hides the asshats making the pages super-wide with lame comments.

    1. Re:Non-wide page link by Anonymous Coward · · Score: 0

      Thank you.

      I do enjoy the exercise of scrolling the window back and forth to read every line. But, I'm in a rush, so I'll go with your non scroller.

    2. Re:Non-wide page link by Anonymous Coward · · Score: 0

      I don't get it. They looked the same to me (FF 1.5b1).

    3. Re:Non-wide page link by jc42 · · Score: 1

      So what's the difference. I opened both in two mozilla windows, and they look exactly the same. I was expecting something that would eliminate the stupid horizontal scroll bar and wrap text dynamically, but that doesn't happen. As for wide, both fit ok side by side on my 1600x1200 screen, and also on my 1440x900 screen. This is with the right margin of both covering up the rightmost ad column.

      What's supposed to happen that's different?

      --
      Those who do study history are doomed to stand helplessly by while everyone else repeats it.
  12. Silly question by Anonymous Coward · · Score: 0

    Does anybody know the correct way to pronounce reiser?

    1. Re:Silly question by Anonymous Coward · · Score: 1, Informative

      rye-sir.

      It's my last name, too.

    2. Re:Silly question by HermanAB · · Score: 0

      Actually, it is 'ray-sir' - Hans ist een Hollander.

      --
      Oh well, what the hell...
  13. I for one.. by cameronking · · Score: 0, Offtopic

    .. welcome our Reiser4 dancing tree's, plug-in based architecture overlords.

    -You can't lose karma you don't have.

  14. When will it be "safe" to use? by bad_outlook · · Score: 2, Interesting

    I've been waiting until it's deemed "safe" to use, but it seems it's going on 2 years now or "not ready yet". I know it's ready when it's ready, but is there a timetable for it? I don't have a fast enough spare box to test it out, and I want to dig the faster FS perf on an SATA harddrive. Keep going Hans!

    1. Re:When will it be "safe" to use? by uhoreg · · Score: 2, Interesting

      Many people (including myself) have been using Reiser4 for quite a while now without any problems. The developers have stopped being able to find bugs, as far as I've heard, although the occasional bug does pop up on the mailing list (and is fixed rather promptly by the developers). When Reiser4 gets included into the mainline kernel and the number of users increases by an order of magnitude, it will be likely that some new bugs will be found. I might not trust million-dollar, mission-critical data on it just yet, but for personal use, it seems to be stable enough.

      --

      To get something done, a committee should consist of no more than three persons, two of them absent.

    2. Re:When will it be "safe" to use? by Anonymous Coward · · Score: 3, Interesting

      It is very stable already - I use it as the root filesystem on my laptops (mostly because laoptop disks are sooo slow and reiser4 mitigates this considerably).

      I have not suffered any problems whatsoever in more than a year. I have had power-cuts, battery problems, and even a few kernel panics and so forth due to ACPI bugs, and reiser4 hasn't lost a single file or even needed a fsck.

      Not to mention that its fast as hell.

      I still do make weekly backups though, since I don't trust the disk to survive very long - but I trust reiser4 enough to use it as my root fs (only other fs is ext2 for /boot) on my main machine.

    3. Re:When will it be "safe" to use? by bad_outlook · · Score: 1

      Thanks - what distro(s) are you running on? I want to run it on my workstation, running Ubuntu (breezy pre-release). I have / (resier3) /home (reiser3) and /boot (ext2) - but would redo the entire drive if I could use reiser4. Is it an option during install? Does it need a spec kern? Thanks for the advice, I also backup my workstation to my server (an rsyc over ssh job daily at noon) so I have that covered - just want more speed from my 3.2G Pen4 with the SATA harddrive...

    4. Re:When will it be "safe" to use? by Anonymous Coward · · Score: 0

      I don't know about reiserfs4, but reiserfs3 just eats your data.

    5. Re:When will it be "safe" to use? by uhoreg · · Score: 1
      Since Reiser4 is not in mainline kernel yet, you need to compile your own kernel (either use the -mm branch, or download the patches from the Namesys web page, or wait for Reiser4 to be added to mainline). Of course, this also means that you need to do a little bit of swapping in order to use it as your root filesystem, since no distribution offers it by default.

      I don't know about the GP poster, but I use Debian, which includes the Reiser4 utilities.

      --

      To get something done, a committee should consist of no more than three persons, two of them absent.

    6. Re:When will it be "safe" to use? by m50d · · Score: 1

      It's ready, the stable release was a few months back, it's just not in the kernel for political reasons.

      --
      I am trolling
    7. Re:When will it be "safe" to use? by Anonymous Coward · · Score: 0

      really? then why does reiser corrupt filesystems nightly on our SuSE 9.3 HP Opteron desktops we just got?

    8. Re:When will it be "safe" to use? by smartdreamer · · Score: 1
      I'm waiting since a long time for reiser4... When it was marked "safe to test" I was ready to install but heard a couple of complains. Could someone tell me if resizing is now supported? I'm on LVM2 and don't want to lose the ability to resize on the fly like I have with my reiserfs3 partitions.

      Also, I was told xattr(ibutes) weren't supported. That's not so bad, but I wanted to be sure since beagle and other begin to adopt this.

      Thanks and viva reiser4!

    9. Re:When will it be "safe" to use? by Omnifarious · · Score: 1

      It hasn't eaten any of my data, and I've run it for years. The worst I've ever had happen was when some null characters got appended to log files on unexpected power outages because the metadata for the filesize got written out before the file data. And that was sometime in 2000 or 2001. I haven't had a problem since then.

      I don't abuse my filesystem heavily though. Just personal use. Though personal use for me includes software development and mucking about with source trees in the 10s of megabytes sometimes.

    10. Re:When will it be "safe" to use? by LLuthor · · Score: 1

      I personally use gentoo on the older laptop (for max speed), and CentOS (with a custom kernel) on the newer one (for convenience + max security). Though, any distro will do, as long as you can use a hand-compiled kernel.

      --
      LL
    11. Re:When will it be "safe" to use? by nutshell42 · · Score: 1
      I've used Reiser4 for my root partition about half the time over the last year (I was trying out different distros but now I'm back to Debian =). No problems, no mysterious files appearing or disappearing, seems rock solid. It's only anecdotal evidence but with all the other posters saying the same thing...

      Kanotix (a Knoppix spin-off, 100% debian-unstable compatible, I don't know whether Knoppix itself also offers Reiser4) offers Reiser4 out of the box if you want to try it out without recompiling your kernel and shuffling your root partition around. Launch the graphical installer, choose your installation settings, save the settings to a file, open the config file and set the root filesystem to reiser4 (it's documented in the config file it's just not offered in the graphical installer), restart the graphical installer, load the config file. Much easier and faster than my last stunt with vanilla debian.

      --
      Don't think of it as a flame---it's more like an argument that does 3d6 fire damage
    12. Re:When will it be "safe" to use? by uhoreg · · Score: 1

      Resizing is not yet supported (but will be when the repacker is released), and neither are xattr.

      --

      To get something done, a committee should consist of no more than three persons, two of them absent.

    13. Re:When will it be "safe" to use? by smartdreamer · · Score: 1
      Thanks for the info.

      Now I know what I want for Christmas : a super repacker!

  15. OS/2 was first... by tjstork · · Score: 1

    OS/2 actually had file meta deta way back in the days of OS/2 2.0. They called them "Extended Attributes". Unfortunately HPFS was not journaled or transacted, so in the event of system failures, your meta data would get screwed up and you would have to run some goofy utility to fix things.

    --
    This is my sig.
    1. Re:OS/2 was first... by Anonymous Coward · · Score: 0

      ... your meta data would get screwed up and you would have to run some goofy utility to fix things.

      But wasn't that only true if the FAT file system was used instead of HPFS because on FAT all the meta data was kept on a different file per drive (EA DATA.SF?) but on HPFS it was kept as part of the file?

  16. Not to sound negative... by Anonymous Coward · · Score: 0

    Frankly, I am perfectly satisfied with the speed of Reiser3. What I want to see is increased reliability and recovery. Performing fsck --rebuild-tree is a Royal pain and takes an eternity on large partitions and the need to perform this operation is far to frequent.

    As for new features, I don't need WinFS like features, rlocate is good enough for searching for now. However, the ability to undelete a file would be a KILLER feature as would snapshotting, think Novell NSS with its undelete and copy on write features.

    1. Re:Not to sound negative... by metamatic · · Score: 1
      Frankly, I am perfectly satisfied with the speed of Reiser3. What I want to see is increased reliability and recovery. Performing fsck --rebuild-tree is a Royal pain and takes an eternity on large partitions and the need to perform this operation is far to frequent.

      That's interesting, as in several years of running servers on Resier3 I've never had to do a tree rebuild. How many servers are you running, and what distribution(s) are you using?

      --
      GCHQ Quantum Insert installed. If only our tongues were made of glass, how much more careful we would be when we speak
  17. For desktop use: UFS2 versus ReiserFS3. by CyricZ · · Score: 2, Interesting

    I recently switched a laptop from Linux with ReiserFS3 filesystems to FreeBSD 5.4 using UFS2 filesystems. The size of the filesystems were the same, and the usage pattern (program development, web browsing, etc.) the same.

    The UFS2 filesystems had the feel of being quicker than the ReiserFS3 filesystems. That said, I do not have any numerical data to back this up. However, untarring a large tarball consisting of many smallish files under FreeBSD felt quicker than doing the same under Linux.

    Would this difference be caused by the filesystems themselves, or would it most likely be a difference between the Linux and FreeBSD IO subsystems? Would ReiserFS4 be more comparable, if not better than, FreeBSD's UFS2 for workstation-style workloads?

    --
    Cyric Zndovzny at your service.
    1. Re:For desktop use: UFS2 versus ReiserFS3. by tenfoot · · Score: 0

      Hey slashdot, I've just compared an apple to an orange. One is orange and juicy. The other is green and crunchy. Differences between the kernels and IO systems will cancel out any file system differences

    2. Re:For desktop use: UFS2 versus ReiserFS3. by CyricZ · · Score: 1

      Of course the implementation of Linux differs significantly from FreeBSD. Nobody is suggesting otherwise. But from the perspective of an end user, especially when using them as workstation operating systems, the two systems appear nearly identical.

      That said, if I can untar the latest Mozilla source snapshot far faster under FreeBSD than Linux, for whatever reason, I'll use FreeBSD. But I would like to know why the UFS2 filesystem of FreeBSD appears so to be faster than of the ReiserFS3 filesystem of Linux. And also if the ReiserFS4 filesystem will offer improved performance under Linux.

      --
      Cyric Zndovzny at your service.
    3. Re:For desktop use: UFS2 versus ReiserFS3. by ctr2sprt · · Score: 1

      There could be a lot of reasons. Because of soft updates, FreeBSD is much more aggressive about metadata caching, which might explain why you're noticing the improvements for creating large number of smallish files (most of the I/O there is metadata updates). There is also just one filesystem for FreeBSD, making optimizations much easier. On Linux, optimizing for e[23]fs may really hurt the performance of XFS and vice versa, for example. Also, journalling filesystems are always slightly slower on writes than non-journalling ones because of the overhead of writing the log. This would, again, become most evident when creating lots of small files.

    4. Re:For desktop use: UFS2 versus ReiserFS3. by Anonymous Coward · · Score: 1, Interesting

      Small files are a tough problem. Of the mainstream Linux filesystems (ext2/3, xfs, jfs), JFS lacks many other features (quotas), xfs is fast on large files but slow on small files, and ext3 turns out to be really good at millions of small files. Reiser has the disadvantage of not being stable, and only comparable to ext3 in performance. That said, I still prefer XFS for the more mature quota system and large (4T+) filesystem capability.

  18. Huh ? by drsmithy · · Score: 3, Interesting
    Comparing Reiser4 to WinFS, Reiser says in the interview, "Reiser4 is a much more mature design, representing a 10 year effort"."

    Comparing ReiserFS and WinFS is a bit like comparing Qt and Explorer - nonsensical. They're different things, operating at different levels, to serve different purposes.

    Come on, how are the parties involved supposed to carry any credibility when making such a *basic* and *fundamental* misunderstanding - /WinFS is not a filesystem/. They also seem to misunderstand what Spotlight is - again comparing it as a filesystem, when it isn't.

    1. Re:Huh ? by Kelson · · Score: 1

      On top of that, I remember reading about the nifty stuff that was going to be in WinFS way back when Windows NT 4.0 came out -- in 1996!

      WinFS has also been a long time coming. Though I suppose 9 years isn't as exciting as 10.

    2. Re:Huh ? by operagost · · Score: 1, Funny
      WinFS is not a filesystem
      Ironic, eh? Kind of like "GNU is Not Unix."
      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
    3. Re:Huh ? by quasi_steller · · Score: 5, Informative

      Comparing ReiserFS and WinFS is a bit like comparing Qt and Explorer - nonsensical.

      Are you sure you understand what ReiserFS is suppose to do? What about WinFS? I don't think compairing WinFS to ReisierFS is quite like compairing Qt to Explorer. The functionality of WinFS is (as I understand things) a proper subset of the functionality of ReiserFS.

      They're different things, operating at different levels, to serve different purposes.

      Again, there purposes are not really different. Sure, ReiserFS is a full blown filesystem, and WinFS is not a filesystem, however the functionality of WinFS is included in ReiserFS. The fact that they operate at different levels is the reason for Reiser's remarks concerning ReiserFS and WinFS. That's his point. WinFS works on a user level to provide functionality that ReiserFS provides at the filesystem level, and Reiser feels that this is a more mature design.

      --
      ...interesting if true.
    4. Re:Huh ? by manyoso · · Score: 3, Funny

      "/WinFS is not a filesystem/"

      Then what does the FS stand for in the name? "Full 'o Shit"?

      And on the other side, I think I'm going to trust that Hans fucking Reiser knows what a filesystem is. Idiot.

    5. Re:Huh ? by Itchy+Rich · · Score: 2, Informative

      Sure, ReiserFS is a full blown filesystem, and WinFS is not a filesystem, however the functionality of WinFS is included in ReiserFS. The fact that they operate at different levels is the reason for Reiser's remarks concerning ReiserFS and WinFS. That's his point. WinFS works on a user level to provide functionality that ReiserFS provides at the filesystem level, and Reiser feels that this is a more mature design.

      Just in case anyone else has been watching this all go over their head: WinFS wikipedia entry

    6. Re:Huh ? by rpdillon · · Score: 1
      I see your point with Spotlight, but, as far as I can tell, WinFS is a file system.

      Of course, wikipedia's article says it isn't a file system, because it uses NTFS underneath, or is at least based on NTFS. Even so, most sources can agree that the best definition is WinFS is a file system with some added features.

      Anyway, I don't think the comparison is so bad. Spotlight, WinFS and Reiser4 may not technically work the same, but they all have the goal of presenting the user with a database interface and allowing the user to query that interface, much like a desktop search, only built into the OS itself. It is this level, the interface level, at which comparison is apporpriate. Not at the implementation level, as you already mentioned.

    7. Re:Huh ? by Deviate_X · · Score: 1

      WinFS has its origins with the Object File System of the Microsoft Cairo project circa 1992.

    8. Re:Huh ? by Anonymous Coward · · Score: 0

      Apple added a case-sensitive journaling function to the previous filesystem "elvis" in tiger. It is a pretty robust filesystem that supports all of the goodies like support for resources forks, long filenames full of virtually any character as well as the obvious journaling that is demanded in any operating systems.

      Spotlight on the other hand is awful IMO and a drag on the system in my book. I still prefer to troll my system for three minutes with locate and them have files truly in an instant, but not until i hit the return key.

    9. Re:Huh ? by Kelson · · Score: 1

      Ah, thanks! I was trying to remember the name.

      1992, though -- that's older than I thought. I figured it had been in the works for a while if it showed up in a "What's next after NT4" chapter.

    10. Re:Huh ? by AnObfuscator · · Score: 2
      Then what does the FS stand for in the name? "Full 'o Shit"

      Future Storage.

      and technically, GP is right -- WinFS is an organisational system overlayed onto NTFS.

      Before you call someone else an idiot, try reading this: http://en.wikipedia.org/wiki/WinFS

      --
      multifariam.net -- yet another nerd blog
    11. Re:Huh ? by uhoreg · · Score: 1
      Sure, ReiserFS is a full blown filesystem, and WinFS is not a filesystem, however the functionality of WinFS is included in ReiserFS.
      To be more precise, the functionality of WinFS is included in what ReiserFS will be able to do when it is completed. As of right now, Reiser4 is just a normal storage system with no capabilities above the other filesystems that are included in Linux (ext3, JFS, XFS, etc.) In a few years, we will have what is currently referred to as Reiser6, which will have the extended semantics that has been in planning for over 10 years. But it is not there yet.
      --

      To get something done, a committee should consist of no more than three persons, two of them absent.

    12. Re:Huh ? by LordMyren · · Score: 1

      This is going to be one of the most important Apples to Oranges comparison of the 21st century.

      Filesystem or no, both systems are attempting to serve much teh same niche.

      Myren

    13. Re:Huh ? by Anonymous Coward · · Score: 0

      9 years mature just isnt as good as 10 i guess. ;)

    14. Re:Huh ? by Anonymous Coward · · Score: 0

      Before you call someone else an idiot, try reading this: http://en.wikipedia.org/wiki/WinFS

      And before you get all worked up about how WinFS is "not a filesystem" and try to support your claim with a link to a notoriously unreliable source that any idiot can edit, may I point out that a certain company called Microsoft, who may just be in a position to say whether WinFS is officially considered a file system or not, describe it as "WinFS, the new relational file system for Windows" (emphasis mine; source).

    15. Re:Huh ? by jiushao · · Score: 4, Informative
      Are you sure you understand what ReiserFS is suppose to do? What about WinFS? I don't think compairing WinFS to ReisierFS is quite like compairing Qt to Explorer. The functionality of WinFS is (as I understand things) a proper subset of the functionality of ReiserFS.

      Sorry, but ReiserFS v4 is a tiny subset of WinFS. I would say that the grandparents analogy is apt.

      To clarify: ReiserFS adopts database concepts in two ways. It uses a B-tree variation to allow efficient hierarchical storage layout and it uses it to allow single-process atomicity. That is all.

      WinFS on the other hand is an actual factual relational database (actually parts of MS SQL-Server) built on top of NTFS; a NTFS file is a special datatype among many others. One can specify relations and constraints as one would in a relational database. It has full atomicity (ACID), whereas ReiserFS's atomicity just gives a rollback local to a process. That is, any read or write may be transactionally inconsistent if there is more than one process dealing with the data whereas in WinFS one gets full support for transactions.

      In addition to the above WinFS of course provides the obvious big end-user features; Fast queries over all the data in a relational way, and triggers that allow actions performed when data is changed or queried (both of which OSX provides in a slightly more ad-hoc way on the side).

      So where does ReiserFS fit in? Well, the complaint that Hans Reiser has against WinFS is that not everything is a file, rather files is a special case mapping down to NTFS streams. Small auxilliary data is handled by other data-types in an SQL-like manner in WinFS, which to me at least seems like a quite sane approach. ReiserFS instead just optimizes the heck out of small files, planning to just take the UNIX principle to the limit, everything is a file, even if you just want to store a small integer. This makes everything fit into the classic filesystem namespace in a good way, but it is really less structured than the WinFS approach. WinFS relates whereas ReiserFS just provides really fast unstructured primitives.

      Overall I don't expect ReiserFS to be overly relevant to the OSS answer to WinFS, mostly because I don't really expect a OSS answer to WinFS on that level. While Microsofts approach is a great piece of engineering is is also a huge amount of work. More likely is that the Apple approach will continue to be the important one; Just add the stuff needed to get the actually important end-user features today, work on the low-level programmer features later.

      On the other hand ReiserFS v4 really appears to be very very fast. No doubt great features can be built on top of it, but on the other hand the classic VFS abstraction is a good thing. Swapping filesystems without impacting the userland is a feature that is really useful, so it seems fairly likely that the simpler approaches like Beagle will get to add the basic end-user features instead of fattening up the file systems (I highly disagree with Reiser that it is on the actual FS-level things should happen in the future). People who need databases can, *gasp*, use a database instead.

      In fact, I am suprised to not yet have seen systems like Gnome and KDE fire up a stripped down PostgreSQL process or something similar to provide applications with an excellent database for whatever their needs might be. For Microsoft doing a thing like that hurts the bottom line (they do charge a fair bit of money for SQL-Server after all), but there is no reason why an OSS platform should not utilize the best technology it has available at every turn.

      Oh well, getting off track. Summary: ReiserFS v4 is a tiny subset of WinFS feature-wise, it just does it very very fast.

    16. Re:Huh ? by Jeremi · · Score: 1
      a *basic* and *fundamental* misunderstanding - /WinFS is not a filesystem/


      What does the "FS" part of the name stand for?

      --


      I don't care if it's 90,000 hectares. That lake was not my doing.
    17. Re:Huh ? by fabioaquotte · · Score: 1

      Comparing ReiserFS and WinFS is a bit like comparing Qt and Explorer

      Actually it would be more like comparing Doom 3 and Duke Nukem Forever..

      --
      Fabio Aquotte
    18. Re:Huh ? by ScrewMaster · · Score: 1

      No, "Free Software".

      --
      The higher the technology, the sharper that two-edged sword.
    19. Re:Huh ? by tal256 · · Score: 1

      If the guys at Penny Arcade ever need someone to step up and write a guest strip I think they have their man.

    20. Re:Huh ? by Q2Serpent · · Score: 1

      Mod this up, if you get it (am I too late?)

    21. Re:Huh ? by Feztaa · · Score: 1

      WinFS is not a File System

      While technically true, I found this statement funny. It's a recursive acronym along the same lines as "Wine Is Not an Emulator" or "GNU's Not Unix" ;)

    22. Re:Huh ? by iotaborg · · Score: 1

      You have to think recursively...

      WinFS: [W]inFS [I]s [N]ot a [F]ile [S]ystem

      Maybe?

    23. Re:Huh ? by TrickiDicki · · Score: 1

      Why not just strip all the metadata extensions out and provide us with a real-fast OS that we can drop in and use today, no modifications required? Heck, why not even port it to Windows and give us an alternative to NTFS?

    24. Re:Huh ? by jiushao · · Score: 1
      Stripping out the stuff that is not actually used for anything interesting now and getting a real good simple filesystem is exactly what the lkml has been going for, Hans Reiser refuses to make ReiserFS v4 fit in the VFS however. Basicly it comes down to how one sees the filesystem future, Reiser wants filesystems to expand to do a whole lot of new stuff whereas the lkml favours keeping the simple filesystem abstraction that is in place.

      It is somewhat important to note that not only does Apple do well building carefully on a classic filesystem, but really, Microsoft has a very advanced system that still maintains the simple filesystem at the bottom. Merging ReiserFS v4 under the current VFS (which can of course be extended a bit here and there as needed) does seem to be the correct way to me as well.

    25. Re:Huh ? by bluGill · · Score: 1

      In fact, I am suprised to not yet have seen systems like Gnome and KDE fire up a stripped down PostgreSQL process or something similar to provide applications with an excellent database for whatever their needs might be.

      It called SQLITE and KDE has been debating making it a part of core for years. Qt provides an excellend database abstraction layer though, so it seems pointless to enforce sqlite when some users might prefer mySql or Postgresql.

      I'm guessing GNOME does much the same, but I don't follow that desktop.

    26. Re:Huh ? by jiushao · · Score: 1
      SQLite is a great piece of software, especially since it does not really matter what the desktop as such thinks about things, an application can easily deploy it itself and it'll work great. On the other hand PostgreSQL would fare better as a central repository, allowing many applications to deal with the same data simultaneously (something that SQLite supports flawlessly, but with very poor parallel performance since it uses file-locking to do it).

      With PostgreSQL behind the scenes one could take advantage of a myriad of really nice PostgreSQL features in a interprocess way. In fact, it could very well be used to replace a lot of old infrastructure in the desktop systems in a more robust and uniform way. Think triggers and listeners and so on for tons of nice IPC, use in-memory tables for volatile operations and get flawless performance. But pretty much foremost: Think excellent robustness and integrity.

      I am very happy to see SQLite really bring a lot of nice database features to the people in a very easy to use way, I would however really like to see a global database process with a known "system schema" replace and enhance a lot of functionality already in desktop systems. Pretty much all functionality that changes any persistent state would be well served to go through a database at some point (even if it is a file that will be kept by the underlying filesystem there are things like recently-used lists, and maybe some triggers would be useful, and so on).

      But but, time will tell. Will be interesting at any rate.

    27. Re:Huh ? by Anonymous Coward · · Score: 0

      You can store the future on it! 1.1 jigawatts marty!!!!

  19. Did they ever fix the performance issue? by james_shoemaker · · Score: 3, Interesting

    Last time I used Reiser I had to reformat back to ext. The starving problem basically made the kernel freeze when flushing buffers during large streaming writes. Is the Large writes starve reads issue gone yet? When I say large I am referring to streaming 12 gig (hour of DV) in a continuous write.

    James

    1. Re:Did they ever fix the performance issue? by cloudmaster · · Score: 1

      That's somewhat irrelevent, since reiser isn't the filesystem you ideally want to be using for a few really large files. You want XFS for that (or possibly ext3). Reiser's big thing is good journaling, awesome performance and space usage with a bunch of really small files (think maildirs, where each message is a separate file and probably less than a single filesystem block) or "regular" usage. It works with huge files, but that's not really where it shines.

      That said, I have no problems with reads during the creation of 4-6GB files on recent revisions of Reiser 3 (BTW, I use Reiser because performance isn't as critical and I'm familiar with the recovery tools - after a crash isn't the time to be learning about how to recover a damaged filesystem). I haven't done any formal benchmarking, but I have done things that do in fact read from files while a big one's being written, and I don't have 6GB RAM so I know it's not being cached. :)

    2. Re:Did they ever fix the performance issue? by pe1chl · · Score: 3, Interesting

      The problem is not really related to large files.
      When you copy a big tree from one disk to another, where the destination is Reiserfs (source may be Reiserfs as well) it is going to be slow.
      There is something in Reiserfs that causes the system to keep too much filedata in memory during writes. At some point it even starts to swapout running programs to make room for buffers for the writing, instead of just writing them to disk and freeing for new operations.
      The result is the "freeze" problem: everything you touch happens to be swapped out and needs to be brought back in, and all system RAM is used for useless buffers.

      Try copying something like 20-30GB on a system with 1GB or less of RAM, that should show the problem.

    3. Re:Did they ever fix the performance issue? by Anonymous Coward · · Score: 0

      I have experienced the same problem with ReiserFS 3 when capturing streaming data. I switched to plain old Ext2 for the file system which I use for capture because it's fast and simple and I rarely have more than a few files on it. Don't get me wrong, ReiserFS 3 is very good and very stable and robust. However, for fast capture of streaming data without stalls or dropouts, Ext2 is better.

    4. Re:Did they ever fix the performance issue? by m50d · · Score: 1

      Isn't that a linux option that you can change in /proc (how much to use for file buffers)?

      --
      I am trolling
    5. Re:Did they ever fix the performance issue? by bani · · Score: 1

      strange, I do 50-60gb DV captures under reiserfs without any problems whatsoever.

      i also do 100gb copies across gigabit ethernet without any performance or starvation issues.

      so I guess the answer for you is yes, the issue is long gone, since I've never had it.

    6. Re:Did they ever fix the performance issue? by pe1chl · · Score: 1

      There seems to be a possibility but it is hard to find.
      When there is an obvious improvement to be made I would expect a user interface to be available in YaST (SuSE is a big advocate of Reiserfs), but I have not found it.

      I like Reiserfs in general, I have installed many systems and never lost a filesystem, and my own system has over 1TB in Reiserfs disks, but the write problem has always been present...

    7. Re:Did they ever fix the performance issue? by nutshell42 · · Score: 1
      The file is called swappiness and it's in /proc if you just want to try it out use echo.

      For a more permanent solution, on most distributions adding

      vm.swappiness=20
      to your /etc/sysctl.conf should do the trick. The value can be between 1 and 100. A low value makes the kernel more reluctant to swap.
      --
      Don't think of it as a flame---it's more like an argument that does 3d6 fire damage
    8. Re:Did they ever fix the performance issue? by pe1chl · · Score: 1

      Thanks, I'll try that

    9. Re:Did they ever fix the performance issue? by james_shoemaker · · Score: 1

      I had the issue in the 2.2 kernel era. I even replaced the drive I was capturing to before I realized that the problem was the file system. That really soured me on reiser. I am glad it seems to be gone for you.
          If I ever leave ext3 for my video raid I will likely go to xfs, it seems best suited to streaming large files.

      James

  20. it's stable. by jrationalk · · Score: 1

    I've used it on / for over a year. All other execelent features aside, I really want attributes as files. It's a powerful feature; one could implement something like del.icio.us in a few lines if each link has it's own tags. transparent compression? You know you want it.

  21. anyone know anything about by petermgreen · · Score: 1

    reiser1 and reiser2

    did they exist? if so what were they like?

    --
    note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    1. Re:anyone know anything about by Anonymous Coward · · Score: 0
      note: I don't care if you're known as The Artist formerly known as AssHat, lets not use it as a sig.

      Sincerely,
      - the Consortium of Users against Mediocre Signatures who Hardly Acknowledge Righteous Decisions

    2. Re:anyone know anything about by slavemowgli · · Score: 1

      RTFA. Jeremy asks exactly the same question, and Hans answers it.

      --
      quidquid latine dictum sit altum videtur.
  22. RTFA by uhoreg · · Score: 1

    Eventually, Reiser4 will allow storing metadata in plain old files, so that no special tools will have to be used. It will also allow queries done straight through the filesystem. In the interview, Hans says that that functionality is about 3-5 years away when fully implemented, but it will be implemented gradually, so some functionality will be available earlier.

    --

    To get something done, a committee should consist of no more than three persons, two of them absent.

  23. Sillier question by Anonymous Coward · · Score: 0
    But is "Danger" your middle name?

    Hah, I thought not puny man.

  24. I noted that bit from the blurb as well... by jeblucas · · Score: 0, Troll
    "A 10-year effort", but by whom? Hans and friends? I have a 10-year effort going on being a millionaire right now, but you know who'd be better at it? Someone with a million dollars. Also, what is he implying by saying this effort is 10-years old? Is there 10-year old code in there? Isn't this what Microsoft gets harangued about every time they release an operating system? Or, is he stating that design work and implementation strategies have been in process for 10 years--hasn't Microsoft been making it's own OS's for 22 years? Should we ignore any expertise garnered? If we do, why not ignore efforts Reiser made for Reiser3?

    That comment is remarkably infantile. "If I have seen further than others, it is because I have stood on the shoulders of giants--DUMB GIANTS THAT SUCK!"

    --
    blarg.
    1. Re:I noted that bit from the blurb as well... by Danuvius · · Score: 1
      "A 10-year effort", but by whom? Hans and friends? I have a 10-year effort going on being a millionaire right now, but you know who'd be better at it? Someone with a million dollars. Also, what is he implying by saying this effort is 10-years old? Is there 10-year old code in there? Isn't this what Microsoft gets harangued about every time they release an operating system? Or, is he stating that design work and implementation strategies have been in process for 10 years--hasn't Microsoft been making it's own OS's for 22 years? Should we ignore any expertise garnered? If we do, why not ignore efforts Reiser made for Reiser3?

      That comment is remarkably infantile. "If I have seen further than others, it is because I have stood on the shoulders of giants--DUMB GIANTS THAT SUCK!"
      You are right... obviously you have to be right. I mean you are... well... nobody?

      Whereas Hans Reiser is merely the creator of two of the best filesystems that exist.

      Thanks for clearing things up for us...

      ... though admittedly you do give the impression of a pointlessly babbling idiot, truth be told.
      --
      Akarsz Magyar Gentoo fórumot? Akkor
    2. Re:I noted that bit from the blurb as well... by digidave · · Score: 1

      It's a good comment because filesystem design is very complex. You can only ever do it right by watching where others make mistakes and by making mistakes yourself.

      Reiser4 has been a ten year project of trying things, making mistakes and fixing them. The design has changed several times and the code has changed even more.

      His argument is that you can't make a good filesystem if you design and code it quickly. The code might be just as good, but there is not enough time to make the mistakes that help you learn. Those mistakes will still be in the final product.

      Actually, Hans gives a good example of this when he talks about how MS gave up making WinFS a real filesystem because it was too hard. Namesys worked for years to overcome the problems that MS gave up on.

      --
      The global economy is a great thing until you feel it locally.
    3. Re:I noted that bit from the blurb as well... by TheRaven64 · · Score: 1
      It's also worth noting that BFS was just over a six-month effort by two guys who were also working on other bits of BeOS at the time. I have yet to see a filesystem that beats it in terms of functionality and simplicity.

      The author is now working for Apple - although from what I've seen of Spotlight he does his best work when his resources are constrained, a situation he is not experiencing with Apple.

      --
      I am TheRaven on Soylent News
    4. Re:I noted that bit from the blurb as well... by NoOneInParticular · · Score: 1
      If I have seen further than others, it is because I have stood on the shoulders of giants--DUMB GIANTS THAT SUCK!

      Pretty bad. If you want to insult a man, do it like Sir Isaac Newton did. His remark about the giants was not originally his, but what was original was that it was send to Robert Hooke. Hooke had claimed repeatedly that Newton stole much of his work. The real nastiness of Newton's letter to Hooke can be found in the fact that Hooke is often described as a dwarf.

    5. Re:I noted that bit from the blurb as well... by jeblucas · · Score: 1
      You are right... obviously you have to be right. I mean you are... well... nobody?
      Whereas Hans Reiser is merely the creator of two of the best filesystems that exist.
      Thanks for clearing things up for us...
      ... though admittedly you do give the impression of a pointlessly babbling idiot, truth be told.
      Thanks for not getting it. I'm not saying Hans is not talented. He certainly is. What I am saying is that he shouldn't at a breath badmouth every other team developing operating systems, because he is drawing on his "10-year effort." He begrudgingly throws a qualified compliment to Dominic Giampaolo because he thinks Spotlight is "neat", and then spends four questions crapping WinFS. [The WinFS team] gave up on this, they gave up on that, they can't plan for 10 years like me, etc. But he counts Reiser3 as dev for Reiser4? But NTFS is somehow not dev for WinFS? I don't understand this disconnect, and I feel like he lacks humility to a fault.

      You can have your opinion of Hans and of me and express them, but don't get riled up because I don't agree. This is a forum for comment and discussion--I'm sorry it's not all going your way.

      --
      blarg.
    6. Re:I noted that bit from the blurb as well... by jeblucas · · Score: 1
      The author is now working for Apple - although from what I've seen of Spotlight he does his best work when his resources are constrained, a situation he is not experiencing with Apple.
      Is Spotlight not some of his best work because of design, or because of execution? I've heard the real drags on Spotlight performance come from where it is defaulted to index, not necessarily the manner in which it does that indexing. At Be, Giampaolo and Meurillon had to do everything themselves, by and large. So their talented vision is evinced throughout. At Apple, he's on the file system and Spotlight teams; but is he making final decision on all the hooks his products have on ship?
      --
      blarg.
  25. From the interview by rmcd · · Score: 1

    Jeremy Andrews: Reiser3 is in the 2.4 and 2.6 kernels. Reiser4 is in Andrew Morton's -mm kernel, aiming for eventual inclusion into the 2.6 kernel. What happened to Reiser1 and Reiser2?

    Hans Reiser: Just before journaling got added, one of the programmers put two versions up on our website, and bumped the major version number when he should have bumped the minor version number. I was not willing to go backwards in version numbers to fix it because one should never go backwards in version numbers. Oh well. In retrospect, probably I should have gone backwards. Not doing it now.....;-)

  26. Filesystems in Userspace, Dammit! by RAMMS+EIN · · Score: 3, Interesting

    The thread you link to nicely illustrates the political manoevering necessary to get a filesystem accepted into the kernel. This is one good reason why filesystems should be implementable in userspace.

    There are so many wonderful things that can be done with filesystems once they can be added from userspace. How about transparently accessing files through SSH or FTP, from any application?

    There are various tricks that allow filesystems to be implemented in userspace, such as LUFS and FUSE. Other filesystems (especially the ones that are portable to other systems) pretend to be NFS.

    All of these suffer a performance penalty, but I wonder how much that really matters when you're interacting with disks or networks, which are very slow compared to the CPU and RAM anyway.

    Many things besides filesystems would benefit from being implementable in userspace, but filesystems are what I personally have thought about most.

    --
    Please correct me if I got my facts wrong.
    1. Re:Filesystems in Userspace, Dammit! by oliverthered · · Score: 1

      None of that has anything to do with the FS being in kernel or user space, there's no reason why I cannot create a FS module that allows people to mount SSH or FTP or anything else just like they can mount NFS or ReiserFS

      The key benefit of a Userspace system is security.

      If you really want user space filing systems then all you have to do is overload whatever library gives you file io, then any application that attempts file io can be rerouted if the mount point is a userspace mount.

      --
      thank God the internet isn't a human right.
    2. Re:Filesystems in Userspace, Dammit! by RAMMS+EIN · · Score: 3, Informative

      ``None of that has anything to do with the FS being in kernel or user space, there's no reason why I cannot create a FS module that allows people to mount SSH or FTP or anything else just like they can mount NFS or ReiserFS''

      I don't know if you've actually tried this, but I have. Between the fact that the VFS system is poorly documented and all Linux kernel internals are subject to change without notice, writing filesystems for Linux is a total nightmare. And then you have to do the work again for FreeBSD, NetBSD, and OpenBSD.

      Having things in userspace provides some form of shielding, and practice has shown that it lowers the barrier to implementing filesystems. Witness the great number of useful "filesystems" available through LUFS, FUSE, KDE, mc, GNOME, and others.

      --
      Please correct me if I got my facts wrong.
    3. Re:Filesystems in Userspace, Dammit! by Anonymous Coward · · Score: 1, Informative

      Just fyi: there actually is a ssh filesystem called shfs. And from what I know isn't LUFS deprecated in favor of FUSE now?

    4. Re:Filesystems in Userspace, Dammit! by Nasarius · · Score: 1
      This is one good reason why filesystems should be implementable in userspace.

      Linus remains staunchly pro-monolithic, so it's unlikely to happen in Linux any time soon. We need another Linus Torvalds type to rejuvenate interest in a microkernel OS.

      --
      LOAD "SIG",8,1
    5. Re:Filesystems in Userspace, Dammit! by fossa · · Score: 1

      I respectfully disagree. I think the key benefit is that it becomes much easier to create and maintain oddball filesystems completely independently of kernel development (possibly more cross platform as well).

      I've used sshfs through LUFS, and it absolutely rocks (well, it was a bit sluggish.. server's fault, but the fact that I could use my remote machine's files with *any* program was fantastic). Is there a kernel module for an ssh fs?

      Even I, with hardly any coding experience, might try to make a "filesystem" that could, for example, talk to a web based wiki. I would *never* attempt this in kernel space because I am afraid of the kernel, and I feel something like my example doesn't belong anywhere near kernel space.

    6. Re:Filesystems in Userspace, Dammit! by DarkOx · · Score: 1

      It all depends on what you are doing. If you are opening a word document then NO it does not matter. If you are trying to record realtime video capture then yes chances are you need the greatest FS throughput possible and you also can't spare tons of extra CPU to make that happen. Some holds true if you are running a big database or acting as a busy file server.

      FUSE and LUFS are great ideas and should be included in the kernel, it would be nice if there was a way to run most or all FSes as clients for them in some way, as that could come in handy often. I don't think a user space implementation should ever become the conventional approach to file system design on Linux in the near future though.

      --
      Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    7. Re:Filesystems in Userspace, Dammit! by RAMMS+EIN · · Score: 3, Interesting

      ``I don't think a user space implementation should ever become the conventional approach to file system design on Linux in the near future though.''

      Indeed, because Linux does not make an efficient microkernel. But the benefits of microkernels are well known, and things like QNX prove that performance does not need to be a problem. I think it's very possible that the next big open source OS is going to have a great microkernel as its killer feature. DragonflyBSD, perhaps? Or maybe some new incarnation of MINIX?

      --
      Please correct me if I got my facts wrong.
    8. Re:Filesystems in Userspace, Dammit! by LordMyren · · Score: 1

      Please stop mentioning LUFS, its dead. ;) FUSE is great, has good libraries including SULF for C#/mono. Fuse is really fscking cool, I cant understand why there was any resistance to putting it in kernel. Userland is definately the way to go for many many FS. I will resist the DragonflyBSD rant here, but look into it if you are interested.

      However, I think ReiserFS is the other side of the coin. Blazing fast extensible FS. One built for semantic extension. Very necessary.

      Myren

    9. Re:Filesystems in Userspace, Dammit! by oliverthered · · Score: 1

      'I think the key benefit is that it becomes much easier to create and maintain oddball filesystems completely independently of kernel development (possibly more cross platform as well).'

      That seems like a kernel development issue and nothing to do with the drivers being in user of kernel space (well, except that the kernel interfaces are changing all the time which make driver development a nightmare).

      There is nothing preventing you from writing File IO 'drivers' in user space except for the semantics of getting applications to use them.

      --
      thank God the internet isn't a human right.
    10. Re:Filesystems in Userspace, Dammit! by Anonymous Coward · · Score: 0

      FUSE will probably be included in the linux kernel:
      http://seclists.org/lists/linux-kernel/2005/Sep/06 71.html

    11. Re:Filesystems in Userspace, Dammit! by oojah · · Score: 3, Informative

      sshfs/ftpfs/anything you want-fs: take a look at http://lufs.sourceforge.net/lufs/

      Fun stuff.

      Roger

      --
      Do you have any better hostages?
    12. Re:Filesystems in Userspace, Dammit! by cHALiTO · · Score: 1

      Andy? is that you?

      --
      "Luck is my middle name," said Rincewind, indistinctly. "Mind you, my first name is Bad." -- Terry Pratchett
    13. Re:Filesystems in Userspace, Dammit! by abdulla · · Score: 2, Funny
      I think it's very possible that the next big open source OS is going to have a great microkernel as its killer feature.
      Do you mean GNU/Hurd? :)
      The L4 microkernel architecture does seem quite impressive though.
    14. Re:Filesystems in Userspace, Dammit! by Anonymous Coward · · Score: 0

      Actually both v9fs and FUSE made it into 2.6.14-rc1, also DCCP is in too - can't have too much of a good thing.

      No ReiserFS though.

      http://www.kernel.org/pub/linux/kernel/v2.6/testin g/ChangeLog-2.6.14-rc1

    15. Re:Filesystems in Userspace, Dammit! by richlv · · Score: 1

      according to this thread
      http://kerneltrap.org/node/5627
      at least as far as i can understand, fuse will be included in 2.6.14, right ?

      if so, does this mean that i will be finally able to mount ssh "filesystems" ? :)

      will there be a need for special utilities (mount etc) ?

      i tried searching for more detailed information, but i didn't find any 'featurelist' for general population ...ok, after some more searches i found http://fuse.sourceforge.net/ :)
      from that page i gather that special utilities and even libraries will be needed. hopefully distributions will cach up on this fast enough then.

      --
      Rich
  27. bring on the meta data by cerelib · · Score: 2, Interesting

    I really would like a metadata driven system. Instead of the traditional file dialog for saving or opening files it would be cool to just specify some metadata and have it thrown on a heap of files. I think this is kind of what winFS is trying to accomplish, but above the filesystem level. Hopefully that is in the future of every OS. And if not, or is some better idea comes along, then I guess some time in the future I will pick up a database implementation book and a file systems book, study up and work on it myself.

  28. 10 years? by jshaped · · Score: 2, Funny

    "Reiser4 ... representing a 10 year effort"

    obligatory comment:

    by the time longhorn (vista?) is released, it too will be a 10+ year effort.

  29. 10 year maturity by LordMyren · · Score: 3, Interesting

    Normally you have to release something before it can mature. OTherwise its called development...

    Still waiting on that plugin system, thanks. Should be good though. No hurry, but if you could even begin to release some info on /how/ its structured, how devels will be able to use it, how we'll be architecting solutions with Reiser4 plugins, it'd be much appreciated.

    -Lord "I hope I havent missed anything in all these years waiting" Myren

    1. Re:10 year maturity by bobbuck · · Score: 2, Informative
      Go to the Namesys website, it gives a very complete discussion of the filesystem and the source code is well documented. Regular files and directories are plugins if I understand it right. You can use that as a starting point. Oh, and it's fast.

      www.namesys.com

    2. Re:10 year maturity by killjoe · · Score: 1

      " Normally you have to release something before it can mature. OTherwise its called development..."

      Maybe in a corporate environment. That's not the way it works in open source.

      --
      evil is as evil does
  30. You've quote Torvalds and attributed it to Reiser by brokeninside · · Score: 1

    But in either case, I'm not quite certain that its valid to assume that all /. readers agree with everything that either Linus or Hans has to say. There are technical arguments for each point of view. You'll find /. adherents on both sides of the issue.

    Aside from which, please don't claim that Microsoft has released a true micro-kernel architecture. They haven't.

  31. Required reading by grahamlee · · Score: 2, Informative

    People who think they need to implement spotlight, HFS+ xattrs or Reiser should read Practical FileSystem Design (pdf) then just go away and use BeFS instead.
    [Actually, the person who implemented HFS+ xattrs and worked in the Spotlight team was the guy who wrote Practical FileSystem Design, so I think that counts :-)]

    1. Re:Required reading by Anonymous Coward · · Score: 0

      Two quick points. It is called BFS, not BeFS. In addition to writing the book, he also wrote the BeOS Filesystem.

    2. Re:Required reading by TheRaven64 · · Score: 1

      According to Apple's docs, HFS+ has supported indexed arbitrary metadata for longer than Dominic Giampaolo has been working for them. I would still recommend the book though. It contains more than enough information to implement BFS, which is still the best desktop filesystem I've seen to date.

      --
      I am TheRaven on Soylent News
  32. Yeah but does it... by dark-br · · Score: 1

    run Linux... oops, I mean, will 2.6.14 ship with it?

  33. Other filesystems: XFS (SGI) and GPFS (IBM) by otisg · · Score: 2, Informative

    There are 2 other significant players in the FS field that Hans doesn't mention:
    XFS (from SGI) and GPFS from IBM.

    GPFS has a different focus, but XFS seems to be aimed at solving similar problems as ReiserFS (scalability, high performance, journaling).

    --
    Simpy
    1. Re:Other filesystems: XFS (SGI) and GPFS (IBM) by uhoreg · · Score: 1
      GPFS has a different focus, but XFS seems to be aimed at solving similar problems as ReiserFS (scalability, high performance, journaling).
      Actually, no. The ultimate goal of ReiserFS is the semantic enhancements described in this paper: http://www.namesys.com/whitepaper.html All the other stuff is just prerequisites.
      --

      To get something done, a committee should consist of no more than three persons, two of them absent.

    2. Re:Other filesystems: XFS (SGI) and GPFS (IBM) by bani · · Score: 1

      xfs exists mainly to ease integration/migration of linux into existing irix sites.

    3. Re:Other filesystems: XFS (SGI) and GPFS (IBM) by arth1 · · Score: 1
      xfs exists mainly to ease integration/migration of linux into existing irix sites.

      This is just plain wrong. XFS has a loyal following of Linux users, because of its speed and features. It's _the_ choice to use for a file system shared with Samba, for example, due to the stream support.

      In practice, xfs and reiserfs have much of the same performance, with reiser being the winner for small files and xfs for large files.

      When something goes wrong, XFS and reiserfs behave pretty differently. With XFS, there's a much greater risk of _file_ corrruption -- usually losing the data of a file which gets emptied out during xfs.fsck, while with ReiserFS, it's far from uncommon to lose the file system integrity, and the only recourse might be to backup all available files from single user mode and mkfs/restore.

      Also note that xfs is more resilient to fragmentation, as it divides a partition up into subpartitions (transparent to the user) depending on write size. Even so, xfs also comes with a defragmenting program, xfs_fsr, which reiserfs lacks. I definitely wouldn't put busy log files on a reiserfs volume due to this.

      Regards,
      --
      *Art
    4. Re:Other filesystems: XFS (SGI) and GPFS (IBM) by bani · · Score: 1

      did they ever fix the bug preventing you from fsck'ing a readonly mounted xfs filesystem? if your root xfs fs is borked, the only way to fsck it is to boot off a rescue cd, because it whines that the filesystem is 'in use' even though it's r-o mounted.

  34. Re:Kernel vs User Mode for filesystem by juanescalante · · Score: 2, Informative

    It was not Hans who wrote that, it was Linus in response to Hans' claims that Reiser4 is important because it can compete with WinFS and Spotlight.

  35. Re:Kernel vs User Mode for filesystem by Anonymous Coward · · Score: 0

    I think this was due to a misunderstanding betweek Linus and Hans. Hans wants VFS changes to make Reiserfs better-integrated in order to make it possible to create things _such_as_WinFS_, while Linus says WinFS will probably be implemented in usermode so it doesn't matter.

    Indeed, WinFS is basically a queryable object store built on NTFS, which can store metadata about files on the filesystem (as well as objects that are not files). It will provide features that ReiserFS4 will also provide, but is not really a filesystem itself. NTFS already provides things, either shipping or in beta, that Reiser needs to do, such as file compression, transactions, and metadata. Reiser either does these already, or will be doing them soon, but there's no good interface for them.

    The problem Hans has isn't copying WinFS, so he shouldn't be talking about it. The problem is that the old Unix filesystem API doesn't support doing things like starting transactions or querying metadata. And god forbid you should want a standard way of using ACLs that would work across different filesystems!

    dom

  36. I for one by Fwoggus · · Score: 0, Redundant

    would welcome our new reiser 4 overlords once it gets integrated into 2.6.x mainline.

    --
    The _best_ 3D pr0n -> http://www.hookup3d.com
  37. Is it really good? by Anonymous Coward · · Score: 0

    As far as ReiserFS is concerned, the two issues that seem to pop up all the time are the following:

          1) It is supposed to be much faster than other filesystems, but under certain circumstances - when one has lots of small files, I believe.

          2) Its usage is fraught with danger - there is a steady stream of horror stories out there about disasters caused by this filesystem.

          This is why I haven't touched it yet. What I find worrying is that it's been around for a few years now, and such horror stories keep coming.

    1. Re:Is it really good? by Anonymous Coward · · Score: 0

      Mostly because such horror stories still happen.
      I do not know if it still happens with recent
      versions, but there are enough older versions around, and the last machine running reiser I know of in this building just collapsed the last week....

  38. Re:Kernel vs User Mode for filesystem by Anonymous Coward · · Score: 0
    What he's actually criticizing is the fact that WinFS isn't actually a filesystem. It's a usermode library shell on top of the NTFS filesystem, similar to familiar Gnome and KDE tricks.

    NTFS still runs in the kernel. Microsoft's "pure" microkernel architecture was heavily diluted in favor of improved real-world performance after NT 3.51. That's why we've seen so many BSOD jokes over the years.

  39. Chicken make lousy housepet? by StressGuy · · Score: 1

    just trying to date the reference...

    --
    A goal is a dream with a deadline
  40. rlocate is good for single user systems by Trigun · · Score: 2, Interesting

    but it is horrible for a large networked filestore. The heirarchies that the secretaries at work come up with are convoluted at best, and it takes a long weekend to even attempt to comprehend the logic of their naming convention. When they lose a file, or forget what it was named, when they last worked on it, but can tell you that it was an ISO file (which in itself is ironic), coupled with the fact that they often change the file extensions on their files to random numbers, or try to change it to .pdf to save it as a pdf file, metadata makes a lot of sense.

    1. Re:rlocate is good for single user systems by globalar · · Score: 1

      Practically no one thinks there shouldn't be more metadata and relationships in files. The question is where in the system stack should the logic of these changes take place and what are acceptable performance penalties. As you say, single-users have different requirements from multiusers. So any good engineer would conclude we should not target a design at just one user type.

      Now, in a perfect world, a high-level component would differentiate between "secretary's stuff" and "network share". The lower level components would be more generic. But in the real world secretaries often put their stuff in network shares. In the same way, the relational logic tends to bleed into the system design. We need better abstraction.

      The API has to change and we may eventually need a new, more system-neutral API. Right now though, we are still working on system-specific API's and integrating core functionality. I take this as a sign that, in general, we are all still figuring out how these new concepts will work out and what patterns will emerge. We are still figuring out how these new concepts fit into the overall system design. It's evolutionary.

      The only way to find out where we are going is to let a few mutations take place. Again, the question under debate is where in the system these mutations should take place. Because we know that once we make major changes, there will be lessons learned and better ideas proposed. I would say we set up a petre dish and not turn major components of the kernel into a petre dish.

    2. Re:rlocate is good for single user systems by Trigun · · Score: 1
      This is a very interesting take on the subject, and something that I have been screaming for (but not willing to pony up either money or programming). I want a good middle-ware application that integrates into an office suite, like open-office, that you save to a repository like SVN, and it handles all of the drudgery for you. You could extend it to many different filesystems, make it platform agnostic, and extend the framework to work on all different types of files.

      The pros of this would be
      • versioning of files
      • easily stored metadata
      • metadata that would spread across versions
      • No need to do internal versioning, eliminating the secret data problem
      • unified method of rights access
      • snapshotting and central back-up procedure
      • greater searchability, findability, and accountability
      • ability to span multiple volumes, filesystems, and even computers
      • redundant file systems

      But of course, the cons would be a bit daunting

      • increased overhead of a client/server app
      • Would need a method of using heterogenous authentication types (NT, LDAP, Kerberos, AD)
      • Types of nodes that would allow or disallow versioning, i.e. No versioning of MP3 files or movies
      • Programs would have to make use of the repository*
      • Everyone would have to agree that it is a good idea**


      * I think that Gnome and KDE would have a leg up on MS for this, as it would be easily incorporated into a file chooser, but for MS it would have to be custom coded, perhaps program by program.
      ** As with everything, I guess that's why I said SVN like, as svn is widely accepted

      I've tried the web-apps and the biggest drawback is people don't like using the browser, and hate saving things locally then having to upload them. Especially in the latter case, it just won't make it there. It has to be integrated into the file->open and file-save option.

      If I've missed any projects out there, somebody PLEASE hit me with a cluebat. I really want something like this, and I'm sure that I'm not alone!
  41. Re:Kernel vs User Mode for filesystem by uhoreg · · Score: 2, Insightful
    The problem isn't that Microsoft is using a microkernel (which they aren't, BTW -- at least not the last I heard). It's that WinFS is a separate library that sits on top of the storage layer. This means that programs must use a completely different API to access WinFS, rather than just using normal filesystem calls.

    You also seem to be mixing up the issue of microkernels and monolithic kernels. Apple's OS X uses a microkernel, but the operating system is still monolitic, so all the important stuff is still part of a single big process; the microkernel is basically just an abstraction layer. Hurd is a microkernel but uses multiple servers, so all the subsystems are separate.

    And /. is not one monolitic entity either.

    --

    To get something done, a committee should consist of no more than three persons, two of them absent.

  42. Re:Kernel vs User Mode for filesystem by Cid+Highwind · · Score: 1

    The point here isn't that Windows and MacOS are moving filesystems out of the kernel (they aren't) or that microkernel = bad. It's that WinFS and Spotlight aren't filesystems, they're just userspace tools that simulate a database-style filesystem (meaning they still use plain old NTFS or HFS+ on disk). Therefore, the existence of WinFS and Spotlight are not convincing arguments for adopting reiser4, since Linux developers could build a similar tool that works with ext3, reiser3, xfs, etc.

    In the future, please try reading and comprehending the article before you leap into slashdot bashing...

    --
    0 1 - just my two bits
  43. xfs first appeared on Iirix/SGI by Anonymous Coward · · Score: 0

    xfs is/was the file system for >= Irix 6.2 (and maybe an earlier version or two). In other words, it was pretty mature by the time it got ported to linux.

  44. Re:Kernel vs User Mode for filesystem by hansreiser · · Score: 4, Informative

    I never said the above words attributed to "Rieser".

    I am sure of it becuase I would absolutely never say that "Linux kernel developers do what's right because it is _right_, not because somebody else does it.".

    I am just not that nice a guy that I would say such a thing.:-/ I am guilty of saying the opposite at various times. I am known for this, and not particularly liked for it.:-)

    This is a forged quote. Note the false defensiveness put into it in the sentence "So there's really no point in trying to push your agenda by trying to scare people with MS activities." That really sounds like someone at MS posted this.

    It does not matter so deeply that MS put it into or out of the kernel, what matters is how they layered the code relative to itself --- that is, do they use the FS API, which lacks an insert or excise operation, to repack small objects that they squished together within a file, and does that layering make things slow. I think it almost certainly does make it slow, and it definitely is inelegant.

    Hans Reiser
    Reiser4 Architect
    Namesys

  45. Re:No ReiserFS for me. by Kelson · · Score: 1

    A bit extreme, but I see your point. I've found ext3 and Reiser3 to be of roughly the same stability, but I've had much better success with ext3's recovery tools than Reiser's.

    When they're working, they both work great, and they both handle unexpected shutdowns well. But when they crash and burn, you're more likely to be able to salvage a broken ext3 system than a broken Reiser3 system.

  46. Re:No ReiserFS for me. by arodland · · Score: 1

    I see this comment in danger of getting modded into oblivion, so let me back it up.

    I haven't used Reiser for years for exactly the same reason. The two times that I had had any trouble with a reiser partition that required the use of recovery tools, the reiserfsprogs segfaulted, and then destroyed all of my data in the name of "recovering" it. Even e2fsprogs is far more stable (and useful) than that.

  47. Re:Kernel vs User Mode for filesystem by digidave · · Score: 1

    His point is that WinFS is in user mode because it's not a filesystem, it's an application that runs in the background.

    Yes, that sucks.

    --
    The global economy is a great thing until you feel it locally.
  48. Been using Reiser 3 for a long time by ericzundel · · Score: 2, Interesting
    We used Reiser 3 for a long time on our systems in with the 2.4 series kernels. It may not have been the "first" journaling filesystem for linux, but at the time we installed, it was the first production ready version. We were very thankful for it reducing the time to reboot and fsck on our (at the time) very large filesystems.

    Over the past several years, we had pretty good luck with using Reiser on root and data filesystems. Good luck in the sense that we never encountered something we couldn't recover from. However, we did have more than one instance of filesystem corruption that would crash the kernel (We used it on several of our development servers). The warnings on the 'rebuild tree' utility weren't very reassuring, but it always seemed to work. We also had instances of corrupt files by sticking random bits of data of other files at the end.

    I'm migrating our servers slowly over to ext3 as we upgrade them, mainly because it is more mainstream and I prefer my source code sunny side up as opposed to scrambled. I noticed that the same number of files seems to take up less room (10% or so?) on the disk overall with Reiser than with Ext3 (as reported by df).

    1. Re:Been using Reiser 3 for a long time by bani · · Score: 1

      we migrated to reiser away from ext3 due to the numerous catastrophic filesystem failures we had with ext3. for us, reiserfs has been far more reliable.

      I noticed that the same number of files seems to take up less room (10% or so?) on the disk overall with Reiser than with Ext3 (as reported by df).

      that's due to reiserfs tailmerging. a nice feature indeed.

  49. Re:You've quote Torvalds and attributed it to Reis by Anonymous Coward · · Score: 0

    > But in either case, I'm not quite certain that its valid to assume that all /. readers agree with everything that either Linus or Hans has to say.

    Really? But, *everybody* on /. says there's this uber-mind thing, and everyone thinks alike.

  50. general FS question by nickos · · Score: 2, Interesting

    I've been thinking about starting up a file system project (as you do), and was wondering if anyone has thought of using something like the FUSE kernel module with a database (say MySQL or Berkeley DB) to create an easily indexible file system. The idea is to create a basic proof of concept using FUSE and if it gets any interest turn it into a proper (kernelspace) FS.

    What sort of problems can I expect to face?

    1. Re:general FS question by Intron · · Score: 1

      You want the database design to be efficient at handling any size file. When extending, truncating or changing a file it can't, for example, read the whole file and rewrite it. You want a software layer that converts file operations into database operations cleverly (consolidate writes, etc.). And you want to be able to recover when something goes wrong in the middle of an update - like unexpected power off, software gone amuck, or device full. Also, you want to store not only the conventional hierarchical filesystem structure, but also all the metadata that would be useful for doing queries for a content-addressed scheme. That means some fairly sophisticated indexing. While you're at it, through in versioning, snapshot copy and automatic backup. Report back next week.

      --
      Intron: the portion of DNA which expresses nothing useful.
    2. Re:general FS question by nickos · · Score: 1

      Next week! - I've got loads of outstanding patches to review and merge with some existing projects, along with loads of work for my dayjob.

      Apart from that though you've given me enough to think about for the time being. Thanks for the reply :)

    3. Re:general FS question by SiggyTheViking · · Score: 1

      >What sort of problems can I expect to face?

      Warnocking on /.

  51. Re:Kernel vs User Mode for filesystem by hansreiser · · Score: 2, Funny

    Ah that's hilarious, ok, yeah, it was Linus saying it. Apologies for not remembering and thinking it was someone at MS.:-))) Can't imagine why the poster put my name on it though.....

    Hans Reiser

  52. Re:Kernel vs User Mode for filesystem by Yokaze · · Score: 3, Informative

    Those are the words of Linus Torvalds in response to someone suggesting that Reiser4 should be merged, in order to stay competetive with WinFS and Spotlight. To counter the reasoning, Linus Torvalds stated the following seperate points:

    1. WinFS is not the real filesystem, the real filesystem (NTFS) still runs in kernel mode. WinFS is "merely" a set of libraries in user-space, like gnome-storage. So, you can't derive a need to push such functionality into the Linux kernel.
    2. Trying to push some functionality into the kernel with the reason to compete with Microsofts development won't work, because they do what they think is right, not in order to compete with someone else.

    --
    "Between strong and weak, between rich and poor [...], it is freedom which oppresses and the law which sets free"
  53. Does Reiser4 work in a 64bit environment on AMD64? by t35t0r · · Score: 2, Interesting

    The topic in channel #gentoo-amd64 on irc.freenode.net has said "Reiser4 is evil" for more than a year. Does anyone know if Reiser4 actually works in a x86_64 environment?

  54. Re:No ReiserFS for me. by Arjuna+Theban · · Score: 1

    Exactly.. You'd think a filesystem recovery tool would be more stable than that.

    Here I was thinking "oh, it's a journaling filesystem, all I have to do is run this nifty tool and it'll correct any problems, after all, this is why I'm using this filesystem, right?" and the next thing I see is a segfault.

  55. Holy crap someone get this guy a financial advisor by bogie · · Score: 1

    Did nobody else read this quote?

    "I will probably keep on doing GPL work for now. It is not an easy life, I am $200k or more in debt and drive a 1989 CRX Si"

    $200,000 in debt? I hope that's in pesos. That or he's just counting a mortgage as debt or something. Otherwise he has some serious budgeting problems.

    --
    If you wanna get rich, you know that payback is a bitch
  56. IBM's JFS by jd · · Score: 2, Interesting
    I believe IBM's JFS (which, as its name implies, is a journalling filesystem!) was one of the first journalling filesystems for Linux - it beat SGI's XFS on being first out the door, although IBM took longer to get it stable. SGI were really quick to move from a mere code dump to a usable filesystem.


    Not really looked at GPFS, but if IBM's history is anything to go by (JFS, M:N threading, the DAISY code translator, etc) it'll be revolutionary, be an inspiration to a thousand projects, and get forgotten as it is overtaken.


    Sad, but true - IBM has done masses for Linux, in terms of proof-of-concpet, forcing the pace and introducing new idead. Unfortunately, they then drop the ball. It hasn't mattered much, as others have gone running with the ideas, but it would be nice if IBM saw a real return on their investment by keeping on until their technology is adopted.

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
    1. Re:IBM's JFS by jabuzz · · Score: 1

      Wrong XFS beat JFS out the door by a couple of months. However JFS beat XFS into the kernel. I know I spent several years patching my kernels to use XFS. Of all the Linux filesystems only XFS supports filesystem freezes, so it is the one that I continue to use. You cannot beat 1 second backup windows :)

    2. Re:IBM's JFS by Rutulian · · Score: 1

      Well, maybe this is revisionist history, but I do seem to remember ReiserFS being the first journalling filesystem. XFS and JFS came soon after, but ReiserFS was in the main kernel first and was supported by mainstream distributions right away. I remember because at the time there was a really big deal about Linux not having a journalling filesystem, and then there was ReiserFS. Feel free to correct me, though, if you can find an old news blurb or something.

  57. Benchmarks by jd · · Score: 1

    This was discussed in Slashdot some time ago. The general consensus seemed to be that they were legit, with provisos. Those being that a more general range of tests failed to show nearly as much gain with Reiser4, but for specific problem-spaces, Reiser4 was undoubtably the best. It just wasn't universally the best. XFS could beat it in some things, I believe, as could JFS.

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  58. Lameness filter?!? by Vorondil28 · · Score: 1

    How the hell did that get past the lameness filter?!?

    I'm no expert on slashcode, but if that won't trip the filter, what the heck will?

    --
    This sig rocks the casbah.
    1. Re:Lameness filter?!? by MattWhitworth · · Score: 1

      The Empire State building - life size - in ASCII I reckon. Ah well, adios karma!

    2. Re:Lameness filter?!? by Anonymous Coward · · Score: 0
      I'm no expert on slashcode, but if that won't trip the filter, what the heck will?

      Legitimate posts.

  59. Re:Kernel vs User Mode for filesystem by hansreiser · · Score: 3, Interesting

    Well, that makes a lot more sense now, and surely the poster was just confused rather than malicious.

    Linus and I disagree on this point, a pity that.

  60. Re:Does Reiser4 work in a 64bit environment on AMD by Make · · Score: 2, Informative

    last week, I formatted my new USB hard drive with reiser4. It works well with both 32 and 64 bit (kernel and userspace), no problems so far.

  61. Re:Holy crap someone get this guy a financial advi by Anonymous Coward · · Score: 0

    Urm, a mortgage is debt.

  62. Re:Holy crap someone get this guy a financial advi by mr.capaneus · · Score: 1

    Mortgage debt is real debt. I assumed he was talking about that. Otherwise, he is seriously screwed.

  63. Whatware? by halber_mensch · · Score: 1

    This is interesting and all...

    But why classify this in the hardware section? Wouldn't the Linux section be more appropriate?

    --
    perl -e "eval pack(q{H*},join q{},qw{70 72696e74207061636b28717b482a7d2c717b343 637323635363534323533343430617d293b})"
    1. Re:Whatware? by pingveno · · Score: 1

      Just a guess: Maybe because Reiser is so closely tied to the hardware...

      --
      "it's not about aptitude, it's the way you're viewed" - Galinda
  64. Except that by Anonymous Coward · · Score: 0

    Hans takes it up the ass, much like his faggot zealot buddy (and all slashdot faggot zealots, for that matter) linusux whorevalds does. monkeys could write better code.

  65. Maybe you should actually TRY it by WebCowboy · · Score: 1

    Perhaps this is troll/flame bait material but I'll bite...

    I've been using ReiserFS exclusively for about four years now and in that time have NEVER had problems attributed to ReiserFS.

    1) It is supposed to be much faster than other filesystems, but under certain circumstances - when one has lots of small files, I believe.

    Such cases are extreme. IIRC it isn't merely a problem with small files--it is when those small files are all contained within a single directory. They have to be very small files, and many many thousands in number. In practice the ONLY time I've ever encountered such a situation is when running benchmarks--most sane individuals would have the sense to organise such files in subfolders, and one might even re-examine their application to remove the requirement to have such an insane configuration.

    2) Its usage is fraught with danger - there is a steady stream of horror stories out there about disasters caused by this filesystem.

    As I stated I've NEVER experienced a "horror story" first hand, nor have I even seen any evidence of such except for a handful of anecdotal stories. OTOH, I've seen and personally witnessed MANY distressing situations involving filesystems like EXT2 and FAT (word to the wise--you are REALLY inviting trouble if you are running MySQL--without innodb--on an EXT2 filesystem. If you have a power interruption at just the wrong time you are doomed if you even remotely care about your data).

    I do suspect this is flamebait as every statement you make is unsupported. As with any project there are bugs, but "horror stories"? Honestly--point me to ONE single article that is a true ReiserFS disaster--and not one on an ancient, obsolete pre-journalling version of ReiserFS or someone complaining about a test/alpha/beta release eating his data. In my experience Reiser3 as included on all production Linux distros is mature, extremely stable and performs admirably (when I converted a mail server to ReiserFS--all hardware remaining the same--the difference in handling very large mailboxes was amazing).

    1. Re:Maybe you should actually TRY it by Anonymous Coward · · Score: 0

      Run Reiser3 on anything not x86 ( sparc for example ) and watch it die within 48 hours. I've done it at least 5 or 6 times in an attempt to test things. Eventually the filesystem would break in some way and all the tools would segfault or otherwise fail attempting to rebuild my filesystem. We are talking small disks here as well ( 9gb and 4gb SCSI ). I haven't unleashed Reiser3 on my Powerbook yet although I have some space so I might try it out and see if it is just as broken. Not everyone runs Linux on x86 ;)

    2. Re:Maybe you should actually TRY it by ebichete · · Score: 1

      Entirely true story.

      I was a poor coder working in a country with unreliable power and a company that didn't have UPS's set up. Occasional power glitches would reboot my development station and force me to sit through the loooong fsck times (a long fsck'ing wait).

      When Reiser3 came out with SuSE Linux, I was estatic. It felt somewhat faster for my usage patterns and my long fsck times were gone.

      After a while I noticed that occasionally when resuming my interrupted work, blocks from one file I had open at the time would get stuck in the middle of another file. Code that was working before would fail at compile time with horrible screenfuls of bizarre errors.

      This was okay, because it was pretty obvious what had broken and the time recovered from fsck could be used to restore the file from an older copy.

      That was until I had a file that came very close to compiling. The chunk interchanged was such that the compiler was complaining about an undeclared function (missing header file problem in C). I almost "fixed" this automatically, when I realised that the function should not have existed in that file !!

      I was suddenly worried about the state of the entire codebase, not just the section I was working on. What had changed, when and why were no longer questions I could answer with confidence. So I switched back to ext2 (and later to ext3).

      When working on a difficult problem there are some things I need to have high levels of confidence in, and these include my OS and filesystem.

      PS: This is one of the major reasons I run Linux.

  66. The problem with proprietary closed source work by hackwrench · · Score: 1

    is that nobody can tell how much time has been spent on it. Also, it draws from previous work. I would find it highly unlikely that a useful mesure of such metrics can be established in this case. Also there is differring of features to be considered. For example, say one browser has tabbed browsing. and rudimentary rendering standards support, and another has support for many standards, but no tabbed browsing, and still another will render standards correctly but also handle content that doesn't conform to standards. Which is more mature?

    1. Re:The problem with proprietary closed source work by Skye16 · · Score: 1

      The one with boobs.

  67. You can have that now, today by Anonymous Coward · · Score: 0

    1. Buy a mac
    2. Press command-space

  68. Re:Kernel vs User Mode for filesystem by RoLi · · Score: 1

    Linus said that, not Reiser.

  69. 10 years * X, but so what? by Roadkills-R-Us · · Score: 1

    OK, let's look at actual time invested in each FS over 10 years...

    ResierFS = what? 50 man years? 100 man years?
    WinFS =~ 10K man years? 100k man years?

    Both at 10 years old. But... Some 10 year olds are fairly mature while some are essentially two year olds still running around yelling "No!", just in bigger bodies.

    Physical age is no indicator of maturity.

  70. Re:Kernel vs User Mode for filesystem by colinrichardday · · Score: 3, Informative

    The quote is genuine, but it is from Linus Torvalds. Gee, he really believes that Linux kernel developers do things because those things are right? How'd have thought that?

  71. Re:No ReiserFS for me. by MrHanky · · Score: 1

    If you haven't used ReiserFS in years, then you are perhaps not qualified to comment on it anymore, but I'm sure you'll find people who agree with you. Personally, I have recently (july?) had a different experience. I did a fresh install of Debian on a new drive, but after a short while, I got errors on two file systems, perhaps because of bugs in the tools used in the installer, or perhaps because of power outages: / (ext2) and /home (Reiser3). Reiser3 needed a fsck --rebuild-tree, and worked after that with no problems. I tried three different binaries of e2fsck, which all segfaulted; the one on the installer, the one in Debian Sid, and a statically compiled downloaded elsewhere. Eventually, I just copied / to /home, made a fresh / and copied it back, and I've had no problems unrelated to Apples shit implementation of OpenFirmware since then.

    Just a story to tell that YMMV.

  72. The filesystem should not rehash /bin by Julian+Morrison · · Score: 1

    The trouble with making the filesystem too fancified, is that you end up with 2 namespaces of tool programs - the stuff in /bin and the stuff in filesystem plugins. And, there's not necessarily any sensible dividing line as to what belongs where. He talks about a "childcat" plugin that would merge the contents of a diretory into a single virtual file. But why seperate this from the existing cat command?

    You can see the confusingness in the command line he gives, "cat /home/reiser/mp3s/..../childcat > /dev/dsp". Two totally different ways of performing two very similar tasks, strung together in a single command line. You'd need to understand both to begin making sense of it - how to call them, how to pass options. You'd need to understand that "cat" was available to the whole system but "childcat" only on disks formatted reiser4. You'd need to learn which tasks were divvied up into what sphere. Can you imagine the difficulties in explaining this all to a Unix beginner?

    Reiser4 looks nice in many ways, but it does seem to suffer from "if all you've got is a hammer..."

  73. Re:Does Reiser4 work in a 64bit environment on AMD by Anonymous Coward · · Score: 1, Informative

    we had problems with amd64 for up until this may when one nice company http://t-platforms.ru/ lended us dual amd64 mobo for couple months which was enough to get rid of couple annoying bitmap operation bugs....

    so ... i guess it works... real evil is an oil war.

  74. copy-on-write? by rbrewer123 · · Score: 1

    Regarding Hans's comments about cp, I've recently been wondering why no filesystems seem to support copy-on-write semantics. Instead of physically copying all that data around, just mark it as copy-on-write with a new name somewhere else in the filesystem. Later, if one of the copies is changed, it then automatically gets copied. This could be a nice foundation for certain types of backups and versioning. It's similar to hard-links, but the link breaks automatically when one copy is changed.

    1. Re:copy-on-write? by rcpitt · · Score: 1
      While it is not cp or copy, using rsync will achieve this for backups. Do a cp -al to an archive area which simply links the files (and thereby saves the space but eats up lots of inodes) and when rsync next looks at the original and finds a difference it copies the original and unlinks it from the copy - then applies the changes to the new file leaving the old one alone.

      so the functionality is somewhere buried in rsync - maybe a plugin can be made.

      --
      Been there, done that, paid for the T-shirt
      and didn't get it
    2. Re:copy-on-write? by rbrewer123 · · Score: 1

      Thanks for mentioning that... actually I do use rsync for backups in the way you mention. :)

    3. Re:copy-on-write? by ebichete · · Score: 1

      There are some issues. The first that comes to mind is when you incrementally make changes to different sections of a file.

      Copy-on-write applied to a filesystem can ensure that logically sequential blocks end up scattered all over the disk. In memory it doesn't matter as much but on disks this can kill your IO rates.

      At the rate disk sizes are growing it's way less complicated to waste disk space.

  75. Re:Holy crap someone get this guy a financial advi by uhoreg · · Score: 1
    Otherwise he has some serious budgeting problems.
    He pays some of his developers' salaries from his own pocket. He doesn't have budgeting problems; he has funding problems.
    --

    To get something done, a committee should consist of no more than three persons, two of them absent.

  76. Re:Kernel vs User Mode for filesystem by Taladar · · Score: 1

    Building something that is called FS (filesystem) but actually works on top of the real (in-kernel)filesystem and runs in userspace doesn't count as microkernel architecture.

  77. Just 3 and 4? by JourneyExpertApe · · Score: 2, Funny

    ...Hans Reiser, the author of two revolutionary Linux filesystems, Reiser3 and Reiser4.

    So who authored Reiser1 and Reiser2? Was it Paul Reiser? Do you have to be named Reiser to work on the filesystem, or was it just a coincidence? Inquiring minds want to know.

    --
    If you can read this sig, you're too close.
    1. Re:Just 3 and 4? by The+Original+Yama · · Score: 1

      Paul Reiser was in Reiser2, but he was killed by an alien.

  78. Legacy Shouldn't Hold Us Back by Slicker · · Score: 1

    The uses for semantics, plugins, and massively superior performance are all very compelling. Yes, some of the world needs to be redesigned around it--but some of these redesigns are long past due, anyway.

    Breaking backward compatibility--if necessary--is worthwhile and certainly not unprecidented in the kernel (Remember a.out, remember the big conversion from libc to glibc). What it unnerves is some people's warm feelings about Ext3, regardless of technical merit. It's largely, I think, those same people who claim Reiser 3.6 is unstable.... Funny how, on my systems over the years, that's only been the case on Red Hat--not even on Mandrake which is based on Red Hat.

    Matthew C. Tedder

    1. Re:Legacy Shouldn't Hold Us Back by mibus · · Score: 1

      I have warm feelings about ext3, but only because I know that if it fscks up, ext2 tools that have been around for alot longer than either ext3 or reiserfs are available to help me.

      I chose to use ext3 back when it first came out - no reformat, no "hard work" other than a recompile, and if it didn't work - switch back to ext2, the "baseline" filesystem.

      Now, I feel comfortable using ext3 because I've been using it so long with no problems. One day I might use another FS, but that will require quite a bit of time on my part (to decide which FS is best, then reformat/install with that in mind).

      IMHO It's about ease and comfort.

  79. We are using reiserfs3 in production by PeFu · · Score: 1

    We (my company) deliver servers to printing houses in europe, asia and even to the US. Okay: We have had some trouble with reiserfs in the early days (this was with Linux 2.2.14).

    I have never experienced serious trouble with systems from 2.4.18 and up that was not caused by a hardware failure. Even than: With reiserfsck --rebuildtree volume it was sometimes possible to recover from some of the damage caused by disk read failures.

    Of course I've to admit that 80% of our customers run SuSE Linux and the SuSE kernels always differed somehow from the official http://kernel.org/ kernels.

    The performance gain of reiserfs compared to ext3 makes a big difference in our application area. I'm looking forward to find some time evaluating reiser4 and I like the work of Hans Reiser.

    --
    Peter Funk, Oldenburger Str.86, D-27777 Ganderkesee, Germany
  80. Re:No ReiserFS for me. by bani · · Score: 1

    if you havent used reiserfs in years (as you claim) then your experience is completely outdated and no longer relevant to the discussion.

  81. Re:Holy crap someone get this guy a financial advi by mrm677 · · Score: 1

    Urm, a mortgage is debt.

    Urm, but usually you can sell your house and be debt-free. And you will be making "debt payments" to your own debt if you own, or the possible debt of your landlord.

  82. Re:Kernel vs User Mode for filesystem by Omnifarious · · Score: 1

    WindowsNT is not really a true micro-kernel. And neither is OS X. They both technically use 'Mach' underneath, but they are otherwise largely monolithic OSes. Linux, even though it isn't a microkernel, is actually much less monolithic than either OS X or NT.

    And, as Hans pointed out, WinFS is evil not because it's in user space, but because it isn't really a filesystem from the point of view of most programs. It's an add-on API layered over the filesystem, so programs have to do extra special things to use it.

  83. QOTA by MonoSynth · · Score: 1

    "It takes more than a license to make code open"

  84. Re:OS/2 had first metadata fs: Extended Attributes by Anonymous Coward · · Score: 1, Informative

    yes, the native hpfs in os/2 did store the EA as part of the fs, not hashed off like it was for FAT.

    man, those were the days - sweet sweet os/2.

    surprisingly, while ibm made many useful improvements in the joint venture with apple on TALIGENT (eg the collection classes in SOMObjects were derived from taligent), one of the issues IBM did _not_ bring to the table at Taligent was it's meta-data experience with os/2.

    this was a disappointing ommission.

    to counter the perfidious microsoft 'traitors' inside ibm, os/2 was always looking for a "killer app" -- ironic that the building blocks were always right there in the fs staring everyone in the face.

    a bit of trivia: surprisingly, the workplaceshell was not orginally mandated to use somobjects; thus the wps might have had to access the meta-data in the extended attributes directly. perhaps becuase SOM did such a wonderful job of abstracting access to the EA, developers never truly appprecaited its elegance & power.

    i dont reacall how the BENTO-based compound storage mechanism for OPENDOC made use, at all, of the extended attributes; my recollection of the bento API is that each content model had its own semantics, privately represented inside bento - so perhaps there was no need/ability to publish this information externally in the core fs ... i dont this design choice (internal vs external storage of EA metadata) was not due to any inherent limitation in the orginainating platform at apple - because the HFS eventually supported multiple forks, which would have easily supported a 'slot' for something like extended attributes. But that was a while ago, so it's hard to say clearly.

    Anyone have any more direct recollections?

    cheers:dlf

  85. i know at least its better than crap ext3 by cheekyboy · · Score: 1

    Look, ext3/2 blows, its garbage

    I put 2 120gig HDs in my system and ext3 wouldnt mount the 2nd one, so I gave up and use finaly reiser3 and bingo it mounts.

    DUDES, if you gona code and make some thing fail, learn how to communicate a decent error message.

    That goes to apple too, darn -3136 errors , its not like the HD space is low for 500chars of text.

    --
    Liberty freedom are no1, not dicks in suits.
  86. small file contribution? by adrianmonk · · Score: 1

    The interview says this:

    In terms of a contribution to computer science, V3 [ of reiserfs ] was able to show that you could store small files in the filesystem as files.

    Is that really anything new? SGI's XFS filesystem, which came out on IRIX 5.3 in late 1994, had special features for storing small files' contents inside the i-node instead of in data blocks. Here's some text from an XFS whitepaper on the subject:

    Very small files

    Most symbolic links and directory files are small files. XFS allows these files to be stored in inodes for increased performance. XFS also uses delayed writes to wait to gather the entire small file in the buffer cache before writing to disk. This reduces the number of writes to disk and extents used for a file.

    I am not that familiar with the reiserfs history, but did reiserfs come out before 1994? My guess is that it didn't. If not, then perhaps it uses a different approach to storing small files or takes it to a new level, but it doesn't appear to be the first filesystem ever to put special emphasis on storing small files efficiently.

    I'm not saying that reiserfs sucks or anything, but it does seem like an evolutionary improvement more than a revolutionary one.

  87. The mythical man month by mechsoph · · Score: 1

    Classic bit of coding wisdom, there.

  88. Re:Kernel vs User Mode for filesystem by Jeremi · · Score: 1
    I'm just trying to understand the /. POV.


    The first thing to understand is that there is no "/. POV", because there are thousands of different people posting to Slashdot. You are going to see people advocating on both sides of every issue. That doesn't mean there is a double standard, only that there are diverse opinions.


    Or, to put it more rudely: if something strikes you as stupid, think a minute before posting and make sure it isn't you.

    --


    I don't care if it's 90,000 hectares. That lake was not my doing.
  89. Re:Holy crap someone get this guy a financial advi by hansreiser · · Score: 1

    Not some, I pay almost all.:-/ Unfortunately a lot of the debt is to the people whose salaries are overdue. I thank uhoreg for understanding that funding not budgeting is the problem. Budgeting is easy to do, it is funding that is not so easy.

  90. Re:copy-on-write? Look at ZFS by ChrisA90278 · · Score: 1

    "why no filesystems seem to support copy-on-write semantics"

    Look at Sun's "ZFS". It does this. It also supports pointin time recovery. And being transactional you can back it up whioe it is in use. Another great ZFS feature is that it includesthe "storage manager" layer in the FS. So mirrors and raid ad spanning volumes as well as access by a cluster of machines is al in the FS. You can do things lie add a new physical drive to the FS while the system is running. ANd being a 128 bit file system you are not likely to fill it up soon I've read about Sun's testing. Seems they have crashed system intentionally write doing heavy write manymany thousands of times and have yet tosee any data corrution. Now that Solaris is Open Source we may oneday be able to know who this works.

  91. Re:Does Reiser4 work in a 64bit environment on AMD by Anonymous Coward · · Score: 0

    Not working in gentoo hardly means that it's broken.

  92. Before WinFS by Nailer · · Score: 1

    Besides indexing stuff that has no user-space support yet, I'd like decent recovery tools, at least on par with Ext3, and no memory of Reiser getting into fist fights with such basic stuff as NFS. Does it even work with SELinux yet?

  93. Re:Kernel vs User Mode for filesystem by drsmithy · · Score: 1
    Apple's OS X uses a microkernel [...]

    Not really. OS X is about as much a microkernel as NT is - which is to say, in theory but not in practice.

    Both are designed around discrete modules providing services via messaging, like a microkernel.

    Unfortunately, they also both run just about everything in kernel mode, removing the stability benefit of a microkernel design (in exchange for better performance).

    However, I suspect both would be relatively easy to turn back into a real microkernel (move most stuff back into user mode) if the hardware ever gets fast enough (which it might, with multicore CPUs starting to appear) due to their extremely modular designs.

  94. Re:copy-on-write? Look at ZFS by rbrewer123 · · Score: 1

    Sounds rockin'. I'll have to look into that. Not that I'll be running Solaris anytime soon, but it's always nice to get some more ideas.

  95. ext3 v. reiser3 on big FS by gbnewby · · Score: 1

    I'm just chiming in with the folks who want to love Reiser (v3) but have had poor experiences. On my big SATA system, I started with three 1.7TB ReiserFS v3 filesystems (3Ware with 8 drives each on RAID5). These get hammered pretty hard for research, for database, and for public anonymous FTP servers.

    Eventually, I changed them to ext3 instead. The reason is that when a problem occurred requiring fsck (such as a power outage or kernel panic) it was always the ReiserFS volume that required recovery, and fsck.reiser would take many hours. The ext3 filesystems (once changed over: same hardware, same usage) just didn't have such problems, and when unmounted uncleanly would take just a few seconds to fsck.ext3.

    A 1.7TB filesystem (currently kernel 2.6.11 on a dual Xeon box with 12GB of RAM) is still relatively big, so I wanted to share my experience.

    I'm ready to try Reiser v4 any time, though. In my benchmarks, it was much faster for dealing with small files, for big directories, and other things that are common on big research systems. But ext3 seems a bit more stable, and as others have mentioned is far faster & easier at recovery from problems.

  96. Re:Holy crap someone get this guy a financial advi by Lord+Maud'Dib · · Score: 1

    Can you point me in the direction of your donations page? (if you have one) I've used reiserfs on several computers and its worked out great. So I'm more than happy to help you out a bit when I can.

  97. Re:No ReiserFS for me. by arodland · · Score: 1

    It shows that they don't know how to build a decent set of tools before "releasing" a filesystem, and that maybe after ten years this one still isn't ready to take out of the oven.

  98. Re:No ReiserFS for me. by bani · · Score: 1

    well gee ext2fsck segfaults on me too. i guess that means ext2 isnt ready to take out of the oven either.

    hell i can make the _kernel_ panic on ext2 errors, i guess that means linux isn't ready either.

  99. Re:No ReiserFS for me. by arodland · · Score: 1

    well gee ext2fsck segfaults on me too. i guess that means ext2 isnt ready to take out of the oven either.
    All I can say is I've never seen it, and I've put a lot more use into ext2/3 than I ever have Reiser (and yet Reiser's failed more).

    hell i can make the _kernel_ panic on ext2 errors, i guess that means linux isn't ready either.
    So can I. mount option "errors=panic" or superblock equivalent ;)

  100. Metadata schmetadata by TrickiDicki · · Score: 1

    Having metadata is one thing. Having a database engine that can actually perform magic with that metadata is another. Unless ReiserFS implements a DB engine as well, then comparisons against WinFS are pointless.

  101. Re:No ReiserFS for me. by bani · · Score: 1

    well, we ran ext3 and experienced numerous catastrophic system failures on production servers. our reiserfs servers never experienced catastrophic failures. so we switched. no more failures.

    about 30 production servers. enough data points for us. shrug.

  102. Re:Holy crap someone get this guy a financial advi by uhoreg · · Score: 1

    While not a donations page per se, you can visit their support page: http://www.namesys.com/support.html where they accept credit card payments for technical support. I'm sure that they wouldn't mind if you dropped some money in there and told them that it's a donation rather than a support request.

    --

    To get something done, a committee should consist of no more than three persons, two of them absent.

  103. Peanuts by bluGill · · Score: 1

    $200,000? Thats peanuts to a real business. Frankly I'm surprised it is that low. Many small startups burn through more than that per month, and they end up just fine.

    Now he has been in business for 10 years, so I would hope that he has a plan to make money. It wouldn't take that many sales to pay off the dept. However that doesn't mean it is easy.

    I'd suggest that he needs salesmen, but I'm not sure who they sell to. If they don't have a business plan, they need that. If they have a plan, then it is just a matter of not going bankrupt before the sales kick in. (When and if they will kick in I don't know)

  104. Re:Kernel vs User Mode for filesystem by Anonymous Coward · · Score: 0

    Hans,

      Keep up the good work. Despite all the negative comments here, you are doing a fanatasic job. Few remember that until you started work on reiserFS, not one filesystem included in Linux had journaling! IMO, you definately kicked off the Journaling FS movement for Linux.

    One important feature, would be to provide an API set that provides journaling at the file level. For instance, a developer might create an app that stores data in a group of files, and if the app crashes or the machine unexpected shuts down, the file data managed by the app might be come corrupted. By providing a ReiserFS4 plug-in and API set for App journalling will be huge advantage.

    I am looking forward to working with ReiserFS4 for quite some time. Thanks for all your time and hard effort!

  105. Did You Mean Horst von Brand is A Contrary Child? by Anonymous Coward · · Score: 0

    I read through that thread and the only person I saw acting like a contrary child was one Horst von Brand. If you're so emotionally invested in that thread you can't comment without blatant bias then you should leave it to the impartial people to comment.

    He was unnecessarily confrontational and appeared to be a class A trouble maker taking any opportunity he could to mis-state facts and misrepresent the parents words in order to ridicule.

    This is the independent eye view of a normal man who doesn't have his head firmly wedged up anyones butt displaying dog-like slave-love or have a size 12 chip on my shoulder.

  106. Re:Frost piss by Anonymous Coward · · Score: 0

    HIV+ semen -- goes down smooth!