Slashdot Mirror


Microsoft Announces ReFS, a New Filesystem For Windows 8

bonch writes "Microsoft has shared details about its new filesystem called ReFS, which stands for Resilient File System. Codenamed 'Protogon,' ReFS will first appear as the storage system for Windows Server and later be offered to Windows clients. Microsoft plans to deprecate lesser-used NTFS features while maintaining 'a high degree of compatibility' for most uses. NTFS has been criticized in the past for its inelegant architecture."

31 of 459 comments (clear)

  1. My preview of ReFS by TechGuys · · Score: 5, Funny

    After my initial tests, I must say that ReFS is incredible advangement. ReFS supports named streams, object IDs, short names, compression, file level encryption (EFS), user data transactions, sparse, hard-links, extended attributes and quotas. It is basically all the best filesystems compiled into one.

    Not only is this good for Windows system, but overall network architecture.

    1. Re:My preview of ReFS by Anon-Admin · · Score: 4, Insightful

      So they are starting to catch up with the ext3 filesystem.

    2. Re:My preview of ReFS by gnalre · · Score: 4, Funny

      After my initial tests, I must say that ReFS is incredible advangement. ReFS supports named streams, object IDs, short names, compression, file level encryption (EFS), user data transactions, sparse, hard-links, extended attributes and quotas. It is basically all the best filesystems compiled into one.

      Not only is this good for Windows system, but overall network architecture.

      and of course will be an open standard(Sarcasm Alert)

      --
      Choose your allies carefully, it is highly unlikely you will be held accountable for the actions of your enemies
    3. Re:My preview of ReFS by DarkOx · · Score: 5, Informative

      That's very interesting given the article says

      There are some NTFS features for which Microsoft plans to drop support with ReFS, specifically named streams, object IDs, short names, compression, file level encryption (EFS), user data transactions, sparse, hard-links, extended attributes, and quotas, Verma blogged. That said, one of Microsoftâ(TM)s goals with ReFS is to âoemaintain a high degree of compatibility with a subset of NTFS features that are widely adopted while deprecating others that provide limited value at the cost of system complexity and footprint,â Verma said.

      --
      Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    4. Re:My preview of ReFS by vlm · · Score: 5, Funny

      End users: We still live in a world of 8.3 filenames. Sorry. Till the last PC is burned in a bonfire...

      You know what would be a funny graph of google data? How many are still serving up .htm files instead of .html files vs year.

      20 years from now my grandkids are going to have to answer on Jeopardy why computer filenames are still in a 8.3 filename format.

      --
      "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
    5. Re:My preview of ReFS by SpryGuy · · Score: 4, Informative

      You need to RTFA. The grandparent was a spoof. ReFS doesn't support compression. Or short-names. etc.

      --

      - Spryguy
      There are three kinds of people in this world: those that can count and those that can't
    6. Re:My preview of ReFS by Enderandrew · · Score: 4, Insightful

      Not everything that Microsoft makes is bad. Just because someone says a particular product or technology is good doesn't make them a troll. In fact, as much as Windows drives me up a wall, I am a really big fan of Microsoft Security Essentials.

      Assuming that everything Microsoft is terrible conversely is trolling.

      --
      http://blindscribblings.com - Tasty pop-culture in conceptual fashion.
    7. Re:My preview of ReFS by Anonymous Coward · · Score: 5, Insightful

      Or maybe, just maybe, his post is actually a joke, wherein he copy/pasted the list of features being dropped (see paragraph 5 in TFA), claiming they were the advancements.

      But no, conspiracy theories are much more fun.

    8. Re:My preview of ReFS by andydread · · Score: 4, Insightful

      Actually for Windows MSE works pretty decent compared to the others with seeming less resource usage. Didn't they purchase that technology from someone else? I can't remember. However TechGuys is a known paid shill. At this point I don't even know why he bothers. The problem with this new filesystem is that it features very poor interoperability with non Microsoft products leaving your data at the mercy of Microsoft even worse than before. Now-a-days you can boot up Windows computer with a Linux live CD and rescue your files when windows is borked. That won't happen now. Microsort is doing everything in their power to break interoperability with open source and competing operating systems.

    9. Re:My preview of ReFS by Canazza · · Score: 4, Informative

      TechGuy's a troll who's gotten the most first-posts in the last week AND every one has either promoted an MS product or bashed a Google one. One even said "Use Silverlight instead of Dreamweaver for making a website".

      --
      It pays to be obvious, especially if you have a reputation for being subtle.
    10. Re:My preview of ReFS by reasterling · · Score: 5, Insightful

      I use linux (arch linux) on all my machines. I agree with you that this will break interoperability, but even I (a die hard linux user) recognize that Microsoft has a right to try to improve their file system. NTFS has been around a long time (version 1.0 released in 1993). Sometimes laying an old project to rest and starting new is the right choice. This does not mean that they are doing this to break "system rescue cd" or some other live linux environment.

      --
      "For I desired mercy, and not sacrifice" -- God
    11. Re:My preview of ReFS by Creepy · · Score: 4, Informative

      The "resilience" is from copy on write (CoW), which is used in Volume Shadow Copy and Microsoft SQL server. It is also able to cloud data across multiple volumes on different machines from what I read. Since both CoW and ZFS's copy work a lot like RAID0 (as far as I can tell), I'd expect them to be similar in this respect, however ZFS also does checksum tests and NTFS doesn't BUT I don't know if ReFS will or not.

      That said, ZFS is a WAY better file system, and I'll give you a few reasons why:
      No max path length restriction (TFA says there still be one for ReFS)
      Variable Block sizes and Sparse Files
      Allocate on Flush
      Block Journaling (aka Journaling File System) as opposed to Metadata only Journaling (NTFS and probably ReFS) which is less reliable
      Logical Volume Management
      and that is just naming a few off the top of my head with some links to what they mean if it seemed like it may not be obvious (the others are fairly commonly talked about IMO - if you don't know them, they should be easy to search for)

        I'm fairly certain NTFS still doesn't support user metadata, either, and I believe zfs does (most modern FS's do), so I doubt ReFS will (what I mean by this is I can tag a piece of data as, say "photos" and then when I search for photos, those are found first - this is a feature like what was planned for WinFS's and what Apple's Spotlight does).

    12. Re:My preview of ReFS by willy_me · · Score: 4, Informative

      Apple's OSX uses file extension exclusively to determine what sort of file it is. They used to use creator codes, but those have been removed and now it relies entirely on file extension.

      No, creator and type metadata take precedent over file extension. The big change in OSX is that the API and developer tools promote file extensions over metadata. There was a big push to ensure that OSX would work correctly even if it was using a file system that didn't support metadata.

      Try this, go to the Finder and select "Get Info" on a data file. Now go to where it says "Open With" and select a different application. Unlike Windows where this selection is forgotten after it opens, on OSX the choice is remembered. The Finder sets the creator metadata of the data file to ensure that it is always opened with the selected application.

      So metadata is still used in OSX, but extensions now also play a prominent role.

    13. Re:My preview of ReFS by cbhacking · · Score: 4, Informative

      Windows also allows you to change the Open With association (and has for many years) but it's stored in the registry as a global configuration for the file type. It's not specific to any given file.

      Just thought I'd clear that up.

      --
      There's no place I could be, since I've found Serenity...
  2. Starts with 'R' by uigrad_2000 · · Score: 5, Funny

    This is a bad idea.

    Now we can count on some guy named 'Hans Resilient" to be tried and found guilty of murder.

    --
    Free unix account: freeshell.org
  3. Interesting by msobkow · · Score: 4, Interesting

    I can't say that I've ever used any of the NTFS features they're planning to drop.

    I do wish Windows had a sane soft-link system like *nix does; I've yet to run into an application that automatically dereferences a .lnk when opening it. You have to futz around with opening the link manually, reading it's redirect, and then opening THAT instead. Very crude and ugly.

    But more to the point, I didn't see much about what might be NEW with this file system, only what's OLD and being discarded.

    Mind you, some basic feature cleanup never hurt anyone. But if that's the case, why not NTFS2 instead of a marketing buzzword?

    --
    I do not fail; I succeed at finding out what does not work.
    1. Re:Interesting by EvanED · · Score: 5, Informative

      I do wish Windows had a sane soft-link system like *nix does; I've yet to run into an application that automatically dereferences a .lnk when opening it. You have to futz around with opening the link manually, reading it's redirect, and then opening THAT instead. Very crude and ugly.

      Man, if only.

      (OK, it's not quite sane considering you have to distinguish between links to files and links to directories at creation time. I'm not sure what happens if you flip it behind its back.)

    2. Re:Interesting by anonymov · · Score: 5, Informative

      There's a blog post linked from the article.

      There's all kinds of promising stuff, like data corruption resilience and dropped/extended limits.

      Much more interesting read than the linked ZDNet article.

    3. Re:Interesting by SpryGuy · · Score: 4, Informative

      But more to the point, I didn't see much about what might be NEW with this file system, only what's OLD and being discarded.

      Let's see: 32K file name and path limits (instad of 255), on-line recovery from corruption (no more "Check Disk" or offline recovery-rebuild), faster performance, built in recovery of data on failed disks (via Storage Spaces), hot-adding-more-storage to volumes, better control of allocation and localization on the drive, attribute checksums (and auto detection and recovery from "bitrot")....

      Did you RTFA at all?

      --

      - Spryguy
      There are three kinds of people in this world: those that can count and those that can't
  4. You gotta be kidding me?! by Robert+Zenz · · Score: 5, Funny
    From the blog post:

    Today, NTFS is the most widely used, advanced, and feature rich file system in broad use.

    If this is true...it's a very sad world we live in...

  5. Re:linux driver by SJHillman · · Score: 5, Funny

    There's already no Linux driver for it... so does that mean you're going to switch? And if someone makes a Linux driver will you switch back to not using it?

  6. Warning by TBedsaul · · Score: 5, Funny

    If you're married to "Hans Resilient", you'll want to start running now.

  7. More things to patent.... by Sir_Sri · · Score: 5, Funny

    Sounds like they're due for a refresh so they can get some new patents on their filesystem to make sure all the device makers need to continue to pay them money.

  8. Re:linux driver by NJRoadfan · · Score: 5, Insightful

    That might be motivation for creating ReFS. Third party NTFS drivers finally became mature enough to safely read/write the file system... so lets create a new undocumented filesystem and make data exchange between other OSes a PITA again. It also means WinFS is completely dead and never coming back.

  9. NTFS up to EXT4 speeds? by Moses48 · · Score: 4, Interesting

    I'm not a filesystem guru. I stick to programming in the application space mostly. But I have noticed a large time discrepency compiling a large project using EXT4 vs NTFS. EXT4 being multiple times faster then doing the same compile on an NTFS. My question now is, will ReFS bring those times up to similar values?

    PS. Also looking at the dropped support for short names, i think quite a few server batch files will be broken.

  10. Microsoft plans to deprecate lesser-used features by IGnatius+T+Foobar · · Score: 4, Insightful

    "Microsoft plans to deprecate lesser-used features" --- such as the reasonable level of compatibility that has started to show up in non-Microsoft implementations of NTFS over the last couple of years. We may be assured that ReFS is a patent minefield.

    --
    Tired of FB/Google censorship? Visit UNCENSORED!
  11. When NTFS was introduced... by QuietLagoon · · Score: 5, Interesting
    ... it was hyped, among other things, as a file system that would never need to be defragmented.

    .
    I have to wonder how much of the pre-release ReFS hype will prove to be true in the coming years.

  12. NTFS is resilient! by DigiShaman · · Score: 4, Interesting

    A few weeks ago, I pulled "Hail Mary" with regards to saving an SBS 2003 server. For whatever reason, the server would not boot after a power failure. The RAID cache was not dirty on the card, and the RAID volume passed a manual parity consistency check. Unfortunately, the server would still not boot into the OS. It kept throwing a BSOD or hung at finding the hal.dll file. Attempting to access the recovery console or other F8 invoked options failed. Any Server 2003 disk would throw a BSOD the moment it attempted to mount the boot "C" volume. It wasn't the RAID drivers, but actual NTFS corruption causing the kernel panic. Serious shit. However, a Server 2008 R2 disk did save my ass. I was able to mount the volume through a command recovery console. A chkdsk revealed massive amounts of corruption. Server is fucked right? NO! A "chkdsk /R" command was able to find and repair all errors. No data loss what-so-ever.

    Basically, the server must have been busy with installing updates or something when the power died. An old UPS battery will do that. But this goes to show how remarkably resilient the NTFS system is. Absolute respect!

    --
    Life is not for the lazy.
    1. Re:NTFS is resilient! by Anonymous Coward · · Score: 5, Insightful

      Respect?? That's absolutely terrible.

      A modern journalling filesystem should not experience any corruption after a crash, because journal recovery is supposed to keep data structures consistent.

      Not only that, but NO filesystem, journalling or not, should cause a kernel crash if it is corrupted.

      Microsoft has done one thing well, and that is to lower the expectations of their users so far, that what should have been a few second journal recovery turned into a big outage and manual recovery of a massively corrupted filesystem, and that gains them "Absolute respect".

  13. Re:32K long file names? That'll be useful... by Thing+1 · · Score: 4, Informative

    ... to not one.

    The real world disagrees with your statement: we have TFS projects with long directory and file names, such that we cannot map the entire TFS source in a single folder. Even naming it e.g. "c:\x" (or "d:\", putting it on a separate drive), the paths and files still exceed MAX_PATH (which is 260, not 255).

    So, this feature will be useful to our shop.

    It's also useful for "rolling backups"; I administer family machines, and one has been upgraded from a desktop, to a laptop, to another laptop. The first upgrade, I copied all the files to "c:\e" (old machine was an eMachine). That laptop died, we used a restoration company that started with a "G" to get the data back (now we backup via WHS), and I saved that in "c:\g" (so there's a "c:\g\e" with the desktop's files). The third machine (second laptop) has "c:\h" (which also contains "c:\h\g\e"). Other times I've saved backups with more descriptive names, like "Backup of the Dell Inspiron 5150, 2011-11-11", and sometimes those backups fit inside each other like expressed above.

    So, I have examples from both home and work where having longer-than-MAX_PATH file/path names would be useful.

    --
    I feel fantastic, and I'm still alive.
  14. Re:Then what file system should we all use? by bearfx · · Score: 4, Informative
    I use zfs quite a bit. Huge zfs fan.

    How much data did you have on a single large zdev that it required that amount of time? I tend to group mine into groups of 8 disks with raidz2. When I have to rebuild, it does so at the write speed of the new disk (100+MB/sec). If you have a relatively small array and it still takes 45 days to rebuild then you have a hardware issue, or you are using an siig card, which has horrible performance under all the unix/linux variants I have used.

    I use zfs on linux at home with an 8 disk raidz2 array for network storage. On a core 2 duo / 2.5ghz using an lsi 1068 based card, I achieve a rebuild speed of 80+MB per second, a scrub speed of 150+MB/sec. At work, I use it to store spatial data / 3d video using zfs on linux. Multiple 8 disk raidz2 devices connected via lsi 9200 card. I achieve a rebuild speed of 80+MB per second, a scrub speed of 250+MB/sec.

    If you use junk cards, you get junk performance.