Slashdot Mirror


Microsoft Announces ReFS, a New Filesystem For Windows 8

bonch writes "Microsoft has shared details about its new filesystem called ReFS, which stands for Resilient File System. Codenamed 'Protogon,' ReFS will first appear as the storage system for Windows Server and later be offered to Windows clients. Microsoft plans to deprecate lesser-used NTFS features while maintaining 'a high degree of compatibility' for most uses. NTFS has been criticized in the past for its inelegant architecture."

46 of 459 comments (clear)

  1. My preview of ReFS by TechGuys · · Score: 5, Funny

    After my initial tests, I must say that ReFS is incredible advangement. ReFS supports named streams, object IDs, short names, compression, file level encryption (EFS), user data transactions, sparse, hard-links, extended attributes and quotas. It is basically all the best filesystems compiled into one.

    Not only is this good for Windows system, but overall network architecture.

    1. Re:My preview of ReFS by Anonymous Coward · · Score: 3, Interesting

      How does it compare to ZFS in terms of resilience? After all, it's in the damn name.

    2. Re:My preview of ReFS by Anon-Admin · · Score: 4, Insightful

      So they are starting to catch up with the ext3 filesystem.

    3. Re:My preview of ReFS by gnalre · · Score: 4, Funny

      After my initial tests, I must say that ReFS is incredible advangement. ReFS supports named streams, object IDs, short names, compression, file level encryption (EFS), user data transactions, sparse, hard-links, extended attributes and quotas. It is basically all the best filesystems compiled into one.

      Not only is this good for Windows system, but overall network architecture.

      and of course will be an open standard(Sarcasm Alert)

      --
      Choose your allies carefully, it is highly unlikely you will be held accountable for the actions of your enemies
    4. Re:My preview of ReFS by DarkOx · · Score: 5, Informative

      That's very interesting given the article says

      There are some NTFS features for which Microsoft plans to drop support with ReFS, specifically named streams, object IDs, short names, compression, file level encryption (EFS), user data transactions, sparse, hard-links, extended attributes, and quotas, Verma blogged. That said, one of Microsoftâ(TM)s goals with ReFS is to âoemaintain a high degree of compatibility with a subset of NTFS features that are widely adopted while deprecating others that provide limited value at the cost of system complexity and footprint,â Verma said.

      --
      Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    5. Re:My preview of ReFS by ledow · · Score: 3, Interesting

      Great. What does that mean for users?

      Amateurs: Nothing at all.
      "Know-a-bit's": Almost nothing.
      Professional users: Nothing we couldn't do before.
      State-of-the-art, top-dog, storage-gods: Nothing very special or new at all.

      Now, if you'd said that it finally supported WinFS-style file tagging and searching, then you'd have ticked lots of boxes for all manner of users. As it is, it's a "slightly better filesystem than before" and hardly newsworthy (out of all your "features", I only spot one that you can't already do with Windows alone and that would ever be exposed to someone NOT using bit-level access to the drive - file level encryption).

    6. Re:My preview of ReFS by vlm · · Score: 5, Funny

      End users: We still live in a world of 8.3 filenames. Sorry. Till the last PC is burned in a bonfire...

      You know what would be a funny graph of google data? How many are still serving up .htm files instead of .html files vs year.

      20 years from now my grandkids are going to have to answer on Jeopardy why computer filenames are still in a 8.3 filename format.

      --
      "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
    7. Re:My preview of ReFS by SpryGuy · · Score: 4, Informative

      You need to RTFA. The grandparent was a spoof. ReFS doesn't support compression. Or short-names. etc.

      --

      - Spryguy
      There are three kinds of people in this world: those that can count and those that can't
    8. Re:My preview of ReFS by Enderandrew · · Score: 4, Insightful

      Not everything that Microsoft makes is bad. Just because someone says a particular product or technology is good doesn't make them a troll. In fact, as much as Windows drives me up a wall, I am a really big fan of Microsoft Security Essentials.

      Assuming that everything Microsoft is terrible conversely is trolling.

      --
      http://blindscribblings.com - Tasty pop-culture in conceptual fashion.
    9. Re:My preview of ReFS by Anonymous Coward · · Score: 5, Insightful

      Or maybe, just maybe, his post is actually a joke, wherein he copy/pasted the list of features being dropped (see paragraph 5 in TFA), claiming they were the advancements.

      But no, conspiracy theories are much more fun.

    10. Re:My preview of ReFS by compro01 · · Score: 3, Informative

      Some of those features are actually useful

      Yes, and they're DROPPING those features.

      --
      upon the advice of my lawyer, i have no sig at this time
    11. Re:My preview of ReFS by andydread · · Score: 4, Insightful

      Actually for Windows MSE works pretty decent compared to the others with seeming less resource usage. Didn't they purchase that technology from someone else? I can't remember. However TechGuys is a known paid shill. At this point I don't even know why he bothers. The problem with this new filesystem is that it features very poor interoperability with non Microsoft products leaving your data at the mercy of Microsoft even worse than before. Now-a-days you can boot up Windows computer with a Linux live CD and rescue your files when windows is borked. That won't happen now. Microsort is doing everything in their power to break interoperability with open source and competing operating systems.

    12. Re:My preview of ReFS by Canazza · · Score: 4, Informative

      TechGuy's a troll who's gotten the most first-posts in the last week AND every one has either promoted an MS product or bashed a Google one. One even said "Use Silverlight instead of Dreamweaver for making a website".

      --
      It pays to be obvious, especially if you have a reputation for being subtle.
    13. Re:My preview of ReFS by anonymov · · Score: 3, Informative

      Yeah, he's also very, very fast to be able a) read the article, b) concoct a funny answer, c) post it the same minute the article was published.

      All that without subscriber account, note.

      He's really agile with the keyboard, this guy, he does it fourth time already today.

    14. Re:My preview of ReFS by reasterling · · Score: 5, Insightful

      I use linux (arch linux) on all my machines. I agree with you that this will break interoperability, but even I (a die hard linux user) recognize that Microsoft has a right to try to improve their file system. NTFS has been around a long time (version 1.0 released in 1993). Sometimes laying an old project to rest and starting new is the right choice. This does not mean that they are doing this to break "system rescue cd" or some other live linux environment.

      --
      "For I desired mercy, and not sacrifice" -- God
    15. Re:My preview of ReFS by Missing.Matter · · Score: 3, Informative

      Does anyone knows what happens between research and productivization at MS?

      Management.

    16. Re:My preview of ReFS by SteveFoerster · · Score: 3, Informative

      I work for a Wniversity

      Ha, dude, you're busted! You were trying to say "university" and it came out "Windows"! ;-)

      --
      Space game using normal deck of cards: http://BattleCards.org
    17. Re:My preview of ReFS by Creepy · · Score: 4, Informative

      The "resilience" is from copy on write (CoW), which is used in Volume Shadow Copy and Microsoft SQL server. It is also able to cloud data across multiple volumes on different machines from what I read. Since both CoW and ZFS's copy work a lot like RAID0 (as far as I can tell), I'd expect them to be similar in this respect, however ZFS also does checksum tests and NTFS doesn't BUT I don't know if ReFS will or not.

      That said, ZFS is a WAY better file system, and I'll give you a few reasons why:
      No max path length restriction (TFA says there still be one for ReFS)
      Variable Block sizes and Sparse Files
      Allocate on Flush
      Block Journaling (aka Journaling File System) as opposed to Metadata only Journaling (NTFS and probably ReFS) which is less reliable
      Logical Volume Management
      and that is just naming a few off the top of my head with some links to what they mean if it seemed like it may not be obvious (the others are fairly commonly talked about IMO - if you don't know them, they should be easy to search for)

        I'm fairly certain NTFS still doesn't support user metadata, either, and I believe zfs does (most modern FS's do), so I doubt ReFS will (what I mean by this is I can tag a piece of data as, say "photos" and then when I search for photos, those are found first - this is a feature like what was planned for WinFS's and what Apple's Spotlight does).

    18. Re:My preview of ReFS by willy_me · · Score: 4, Informative

      Apple's OSX uses file extension exclusively to determine what sort of file it is. They used to use creator codes, but those have been removed and now it relies entirely on file extension.

      No, creator and type metadata take precedent over file extension. The big change in OSX is that the API and developer tools promote file extensions over metadata. There was a big push to ensure that OSX would work correctly even if it was using a file system that didn't support metadata.

      Try this, go to the Finder and select "Get Info" on a data file. Now go to where it says "Open With" and select a different application. Unlike Windows where this selection is forgotten after it opens, on OSX the choice is remembered. The Finder sets the creator metadata of the data file to ensure that it is always opened with the selected application.

      So metadata is still used in OSX, but extensions now also play a prominent role.

    19. Re:My preview of ReFS by cbhacking · · Score: 4, Informative

      Windows also allows you to change the Open With association (and has for many years) but it's stored in the registry as a global configuration for the file type. It's not specific to any given file.

      Just thought I'd clear that up.

      --
      There's no place I could be, since I've found Serenity...
  2. Starts with 'R' by uigrad_2000 · · Score: 5, Funny

    This is a bad idea.

    Now we can count on some guy named 'Hans Resilient" to be tried and found guilty of murder.

    --
    Free unix account: freeshell.org
  3. Interesting by msobkow · · Score: 4, Interesting

    I can't say that I've ever used any of the NTFS features they're planning to drop.

    I do wish Windows had a sane soft-link system like *nix does; I've yet to run into an application that automatically dereferences a .lnk when opening it. You have to futz around with opening the link manually, reading it's redirect, and then opening THAT instead. Very crude and ugly.

    But more to the point, I didn't see much about what might be NEW with this file system, only what's OLD and being discarded.

    Mind you, some basic feature cleanup never hurt anyone. But if that's the case, why not NTFS2 instead of a marketing buzzword?

    --
    I do not fail; I succeed at finding out what does not work.
    1. Re:Interesting by EvanED · · Score: 5, Informative

      I do wish Windows had a sane soft-link system like *nix does; I've yet to run into an application that automatically dereferences a .lnk when opening it. You have to futz around with opening the link manually, reading it's redirect, and then opening THAT instead. Very crude and ugly.

      Man, if only.

      (OK, it's not quite sane considering you have to distinguish between links to files and links to directories at creation time. I'm not sure what happens if you flip it behind its back.)

    2. Re:Interesting by anonymov · · Score: 5, Informative

      There's a blog post linked from the article.

      There's all kinds of promising stuff, like data corruption resilience and dropped/extended limits.

      Much more interesting read than the linked ZDNet article.

    3. Re:Interesting by SpryGuy · · Score: 4, Informative

      But more to the point, I didn't see much about what might be NEW with this file system, only what's OLD and being discarded.

      Let's see: 32K file name and path limits (instad of 255), on-line recovery from corruption (no more "Check Disk" or offline recovery-rebuild), faster performance, built in recovery of data on failed disks (via Storage Spaces), hot-adding-more-storage to volumes, better control of allocation and localization on the drive, attribute checksums (and auto detection and recovery from "bitrot")....

      Did you RTFA at all?

      --

      - Spryguy
      There are three kinds of people in this world: those that can count and those that can't
  4. My Preview of Cold Fusion Reactors by eldavojohn · · Score: 3, Funny

    After my initial tests

    Wait, what? From the article:

    Officially named ReFS — for Resilient File System — the new file system will be made available via a staged “evolution,” according to a January 16 post on the “Building Windows 8 blog.

    So you're saying something that was just announced and will be made available via a staged evolution has already been tested by you? Impressive!

    It is basically all the best filesystems compiled into one.

    Thanks for summing it up for me there, bud. I didn't realize it was the greatest goddamn filesystem I could imagine, why didn't you just say "Imagine what your dream filesystem will be able to do, this is it." I wonder though, will it have the homicide capacity of ReiserFS?

    This reminds me of my initial tests of cold fusion. I must say that cold fusion is incredible dvangement. Cold fusion supports providing us with unlimited power from a glass of water, it prints money, it gives the user eternal life, it allows the user to travel faster than the speed of life and -- when activated -- attractive women jump out of the core reactor demanding money shot after money shot.

    --
    My work here is dung.
  5. You gotta be kidding me?! by Robert+Zenz · · Score: 5, Funny
    From the blog post:

    Today, NTFS is the most widely used, advanced, and feature rich file system in broad use.

    If this is true...it's a very sad world we live in...

  6. Re:linux driver by SJHillman · · Score: 5, Funny

    There's already no Linux driver for it... so does that mean you're going to switch? And if someone makes a Linux driver will you switch back to not using it?

  7. Warning by TBedsaul · · Score: 5, Funny

    If you're married to "Hans Resilient", you'll want to start running now.

  8. More things to patent.... by Sir_Sri · · Score: 5, Funny

    Sounds like they're due for a refresh so they can get some new patents on their filesystem to make sure all the device makers need to continue to pay them money.

  9. Re:linux driver by NJRoadfan · · Score: 5, Insightful

    That might be motivation for creating ReFS. Third party NTFS drivers finally became mature enough to safely read/write the file system... so lets create a new undocumented filesystem and make data exchange between other OSes a PITA again. It also means WinFS is completely dead and never coming back.

  10. NTFS up to EXT4 speeds? by Moses48 · · Score: 4, Interesting

    I'm not a filesystem guru. I stick to programming in the application space mostly. But I have noticed a large time discrepency compiling a large project using EXT4 vs NTFS. EXT4 being multiple times faster then doing the same compile on an NTFS. My question now is, will ReFS bring those times up to similar values?

    PS. Also looking at the dropped support for short names, i think quite a few server batch files will be broken.

  11. Re:Great! by uigrad_2000 · · Score: 3, Insightful

    I'll agree.

    As ugly as NTFS is, the one thing I've liked about it is that it's the only FS used by Windows and Windows Servers for a dozen years.

    With Linux, on the other hand, I've had to deal with ext2, ResierFS, ext3, ext4, and those are only the popular ones! There are a ton of other specialized filesystems for other features, such as encryption or use on flash memory!

    --
    Free unix account: freeshell.org
  12. Microsoft plans to deprecate lesser-used features by IGnatius+T+Foobar · · Score: 4, Insightful

    "Microsoft plans to deprecate lesser-used features" --- such as the reasonable level of compatibility that has started to show up in non-Microsoft implementations of NTFS over the last couple of years. We may be assured that ReFS is a patent minefield.

    --
    Tired of FB/Google censorship? Visit UNCENSORED!
  13. When NTFS was introduced... by QuietLagoon · · Score: 5, Interesting
    ... it was hyped, among other things, as a file system that would never need to be defragmented.

    .
    I have to wonder how much of the pre-release ReFS hype will prove to be true in the coming years.

  14. Compatibility Grief is What I See Coming by BoRegardless · · Score: 3, Insightful

    All the file utilities for both Mac and PC and how you handle these different systems including forward/backward compatibility, Parallels, VMWare, Backup software, hard drives and tape devices will all go through teeth nashing debugs as we try to get everything to work with a new file system.

    That may be OK when you are an IT professional.

    For someone who "just wants it to work" there is likely to be lots of surprises ahead.

  15. NTFS is resilient! by DigiShaman · · Score: 4, Interesting

    A few weeks ago, I pulled "Hail Mary" with regards to saving an SBS 2003 server. For whatever reason, the server would not boot after a power failure. The RAID cache was not dirty on the card, and the RAID volume passed a manual parity consistency check. Unfortunately, the server would still not boot into the OS. It kept throwing a BSOD or hung at finding the hal.dll file. Attempting to access the recovery console or other F8 invoked options failed. Any Server 2003 disk would throw a BSOD the moment it attempted to mount the boot "C" volume. It wasn't the RAID drivers, but actual NTFS corruption causing the kernel panic. Serious shit. However, a Server 2008 R2 disk did save my ass. I was able to mount the volume through a command recovery console. A chkdsk revealed massive amounts of corruption. Server is fucked right? NO! A "chkdsk /R" command was able to find and repair all errors. No data loss what-so-ever.

    Basically, the server must have been busy with installing updates or something when the power died. An old UPS battery will do that. But this goes to show how remarkably resilient the NTFS system is. Absolute respect!

    --
    Life is not for the lazy.
    1. Re:NTFS is resilient! by Anonymous Coward · · Score: 5, Insightful

      Respect?? That's absolutely terrible.

      A modern journalling filesystem should not experience any corruption after a crash, because journal recovery is supposed to keep data structures consistent.

      Not only that, but NO filesystem, journalling or not, should cause a kernel crash if it is corrupted.

      Microsoft has done one thing well, and that is to lower the expectations of their users so far, that what should have been a few second journal recovery turned into a big outage and manual recovery of a massively corrupted filesystem, and that gains them "Absolute respect".

    2. Re:NTFS is resilient! by 0123456 · · Score: 3, Interesting

      Journalling most certainly does not rely on luck and timing! Under heavy I/O, journalling can guarantee filesystem data integrity (modulo coding bugs).

      Back in the real world, journalling is generally only used for metadata, and many hard drives lie when you ask them to flush their cache to disk. So even if the drive doesn't lie and your journal works, the actual file data -- you know, the stuff you actually care about -- may well be trashed.

  16. Re:Full of sound and fury, signifying an idiot by anonymov · · Score: 3, Informative

    Yes, you see that asterisk right next to his nickname that means "a subscriber account"... Oh, wait, there's none.

  17. Then I guess we live in a sad world by Sycraft-fu · · Score: 3, Insightful

    When it comes down to it, NTFS is a pretty good file system. If you look in to things you find that the feature list for BTRFS reads an awful like a feature set of current NTFS.

    None of that is to say that NTFS couldn't stand improvement, and indeed it is being improved, but I've yet to see the amazing widely used file system that is so much better than it. Ext3 is functional, but leaves much to be desired.

  18. Windows doesn't need a new disk based filesystem. by Anonymous Coward · · Score: 3, Interesting

    It needs some way to securely mount a remote filesystem. SMB and non-anonymous FTP shouldn't be used over the internet ever. It wouldn't be too bad except that FTP is incredibly difficult to reliably tunnel due to it opening connections in both directions on random ports. I would be a happy person if Windows added native support for sftp.

  19. Re:Eliminate Drive Letters by amliebsch · · Score: 3, Informative

    You're reversing cause and effect. A volume isn't boot because it's C:\, it's assigned C:\ because it's boot. Behind the scenes the drive letters don't exist. It's an abstraction, in a similar way that sda, sdb, sdc are.

    --
    If you don't know where you are going, you will wind up somewhere else.
  20. Re:32K long file names? That'll be useful... by Thing+1 · · Score: 4, Informative

    ... to not one.

    The real world disagrees with your statement: we have TFS projects with long directory and file names, such that we cannot map the entire TFS source in a single folder. Even naming it e.g. "c:\x" (or "d:\", putting it on a separate drive), the paths and files still exceed MAX_PATH (which is 260, not 255).

    So, this feature will be useful to our shop.

    It's also useful for "rolling backups"; I administer family machines, and one has been upgraded from a desktop, to a laptop, to another laptop. The first upgrade, I copied all the files to "c:\e" (old machine was an eMachine). That laptop died, we used a restoration company that started with a "G" to get the data back (now we backup via WHS), and I saved that in "c:\g" (so there's a "c:\g\e" with the desktop's files). The third machine (second laptop) has "c:\h" (which also contains "c:\h\g\e"). Other times I've saved backups with more descriptive names, like "Backup of the Dell Inspiron 5150, 2011-11-11", and sometimes those backups fit inside each other like expressed above.

    So, I have examples from both home and work where having longer-than-MAX_PATH file/path names would be useful.

    --
    I feel fantastic, and I'm still alive.
  21. Re:Then what file system should we all use? by bearfx · · Score: 4, Informative
    I use zfs quite a bit. Huge zfs fan.

    How much data did you have on a single large zdev that it required that amount of time? I tend to group mine into groups of 8 disks with raidz2. When I have to rebuild, it does so at the write speed of the new disk (100+MB/sec). If you have a relatively small array and it still takes 45 days to rebuild then you have a hardware issue, or you are using an siig card, which has horrible performance under all the unix/linux variants I have used.

    I use zfs on linux at home with an 8 disk raidz2 array for network storage. On a core 2 duo / 2.5ghz using an lsi 1068 based card, I achieve a rebuild speed of 80+MB per second, a scrub speed of 150+MB/sec. At work, I use it to store spatial data / 3d video using zfs on linux. Multiple 8 disk raidz2 devices connected via lsi 9200 card. I achieve a rebuild speed of 80+MB per second, a scrub speed of 250+MB/sec.

    If you use junk cards, you get junk performance.

  22. Re:Hi, GreatBunzinni--a message from the accused by GreatBunzinni · · Score: 3, Interesting

    You are confused. The only time I've bothered pointing out that the bonch account and Overly Critical Guy accounts are sockpuppet accounts was in this comment, after I read this comment blowing your cover. And since then I've also stumbled on this comment, which provides further evidence. Are you also going to claim that I am chrb?

    And rest assure. I have some time to spare about now which I will waste replying to bonch/overly critical guy posts with messages pointing out that they are sockpuppet accounts. You can thank your personal attacks for this one.

    --
    Slashdot, fix your code or at least hire someone who is competent at it to do it for you.