Slashdot Mirror


Measuring Fragmentation in HFS+

keyblob8K writes "Amit Singh takes a look at fragmentation in HFS+. The author provides numbers from his experiments on several HFS+ disks, and more interestingly he also provides the program he developed for this purpose. From his own limited testing, Apple's filesystem seems pretty solid in the fragmentation avoidance department. I gave hfsdebug a whirl on my 8-month-old iMac and the disk seems to be in good shape. I don't have much idea about ext2/3 or reiser, but I know that my NTFS disks are way more fragmented than this after similar amount of use."

417 comments

  1. Huh? by Anonymous Coward · · Score: 5, Insightful

    but I know that my NTFS disks are way more fragmented than this after similar amount of use

    Is this based off of instinct, actual data, or what?

    1. Re:Huh? by lpangelrob2 · · Score: 5, Funny

      Maybe he ran defrag in windows and measured how many bright blue blocks were next to the medium blue blocks and the dark blue blocks. :-)

    2. Re:Huh? by Anonymous Coward · · Score: 0

      Maybe he had Brainator, Guardian of Security, use his vast mental power to defrag the drive.

      It's a Dilbert reference.

    3. Re:Huh? by Anonymous Coward · · Score: 1, Funny

      the plural of anecdote is anecdotes, not data

    4. Re:Huh? by Ann+Elk · · Score: 4, Informative

      My own experience, using a small tool I wrote to analyze NTFS fragmentation:

      NTFS is pretty good at avoiding fragmentation when creating new files if the size of the file is set before it is written. In other words, if the file is created, the EOF set, and then the file data is written, NTFS does a good job of finding a set of contiguous clusters for the file data.

      NTFS does a poor job of avoiding fragmentation for files written sequentially. Consider a file retrieved with wget. An empty file is created, then the contents are written sequentially as it is read from the net. Odds are, the file data will be scattered all over the disk.

      Here's a concrete example. Today, I downloaded Andrew Morton's 2.6.6-mm4.tar.bz2 patch set. (Yes, I run WinXP on my Toshiba laptop -- deal with it.) Anyway, the file is less than 2.5MB, but it is allocated in 19 separate fragments. I copied it to another file, and that file is unfragmented. Since the copy command sets EOF before writing the data, NTFS can try ot allocate a contiguous run of clusters.

      Note - This was done on uncompressed NTFS. My feeling is that compressed NTFS is even worse about fragmentation, but I don't have any numbers to back that up.

    5. Re:Huh? by Anonymous Coward · · Score: 0

      The plural of antidote is antidotes, not data.

    6. Re:Huh? by Anonymous Coward · · Score: 0

      Maybe you should try looking up a word you don't know, rather than asserting that it doesn't exist? It's not our responsability to remedy the shortcomings of your vocabulary.

    7. Re:Huh? by bfg9000 · · Score: 4, Insightful

      (Yes, I run WinXP on my Toshiba laptop -- deal with it.)

      Why would anybody have a problem with you running Windows XP on your laptop? I'm a card-carrying Linux Zealot, and I don't have a problem with it.

      --

      I'm not normally an irrational zealous dickhead, but I figure "When in Rome..."

    8. Re:Huh? by EvilAlien · · Score: 4, Funny
      "'m a card-carrying Linux Zealot, and I don't have a problem with it."

      Apparently you are actually a closet Rational Linux Advocate. I'm sure there are a few people in the drooling horde reading these comments that will have a problem with someone being foolish enough to actually choose to run Windows on anything ;)

      I run Gentoo on my laptop, but the specs on the crusty old thing are so low that my only other "choice" would be the run Windows 95, and I'd sooner eat my usb key than do that.

      --
      perl -e 'print $i=pack(c5, (41*2), sqrt(7056), (unpack(c,H)-2), oct(115), 10)'
    9. Re:Huh? by Anonymous Coward · · Score: 0

      From personal experience I would say that NTFS (on windows 2000) does fragment really bad on a smaller drive 4GB with less than 1GB free. With larger drives it's not really a problem to worry about - just defrag every 6 months to a year.

    10. Re:Huh? by Anonymous Coward · · Score: 0

      He was criticizing the validity of the information. It was two very-poorly-structured measurements, which the parent's parent called "data" and which this fellow is asserting were nothing more than anecdotal evidence.

    11. Re:Huh? by bogie · · Score: 4, Interesting

      Actually the number of Windows users dwarfs the numbers of Linux users here these days. Sure Widows gets beatup on more because of the constant worms etc but have a look at the average "is linux ready for the desktop" thread. You get post after post of people critical of Linux on the desktop. At best some people will agree that linux is fine in some very specific situations. As I've said many times there is a reason why Slashdot won't show recent web browser statistics. My guess is it over 80% IE and not just because people are at work.

      For the record I also use XP on my laptop. Until everything works perfectly out of the box, ACPI and all, I'm not installing any nix on it.

      --
      If you wanna get rich, you know that payback is a bitch
    12. Re:Huh? by Anonymous Coward · · Score: 0

      What's a "responsability"? Some kind of cross between a response and an ability? I'm sorry, but that word isn't in my vocabulary.

    13. Re:Huh? by Rakefighter · · Score: 2, Informative

      Those are stange numbers...

      When you download a file with internet explorer, it downloads to a temporary directory, and then copies it to the location you selected in the "Save" dialog (using Windows copy facilities). According to your logic, the file that you downloaded should not be fragmented, at all.

      Care to explain yourself?

      --

      --Life may have no meaning, or, even worse, it may have a meaning of which you disapprove.

    14. Re:Huh? by Anonymous Coward · · Score: 0

      You know, he did mention 'wget' by name. It's entirely possible that this person is running Cygwin.

      On a dual-boot machine, Cygwin is almost a requirement. Helps to keep your CLI experience more universal, allows you to treat your XP box like a *nix box. Gives you the bash you're used to, the Perl you're used to, the little utilities you can't live without.

      Perl, wget and an X11 client are the reasons I have Cygwin. Sure, they're all available for XP in other forms, but I happen to like the *nix-ish way. Something tells me the parent to your post likes it too.

    15. Re:Huh? by Anonymous Coward · · Score: 0

      It dosen't COPY. It MOVES. All that's happening is the shufling of the location of a pointer to a location. Hence, the resulting file is the exact same thing, in the exact same place(s) (on the disk, not on the representation of the filesystem).... Unless, of course, the temporary drectory, and the final location of the download are on different filesystems, then yes, it does get copied.

    16. Re:Huh? by Ann+Elk · · Score: 1

      In my example, I retrieved the file with wget. It just reads the stream from the net and writes them to the local file. No copy.

      But you're right -- a file retrieved with IE would probably not be heavily fragmented. Of course, given the behavior of NTFS, IE's local cache does get fragmented. Here are the fragmentation stats from my "Temporary Internet Files" directory:

      File Count = 500
      Total Extents = 532
      Avg Extents = 1.06
      1 : 472 [094%]
      2 : 24 [004%]
      3 : 4 [000%]
      Dir Count = 4
      Total Extents = 5
      Avg Extents = 1.25
      1 : 3 [075%]
      2 : 1 [025%]

      500 files total: 472 files with 1 extent, 24 files with 2 extents, and 4 files with 3 extents. Not bad, but I don't use IE much.

      I just did another small experiment. I retrieved 2.6.6-mm4.bz2 from kernel.org using both Moz 1.6 and IE. Moz just retrieves the file directly where you want it (i.e. "in place"). The file was badly fragmented. I deleted it, and retrieved the file with IE. The copy in the cache was fragmented, but the copy in my target directory was not fragmented at all. Not exactly scientific, but it seems to support your theory.

    17. Re:Huh? by Anonymous Coward · · Score: 0

      and the word you were looking for was anecdotes.

    18. Re:Huh? by Anonymous Coward · · Score: 0

      The plural of antidote is antidotes, not data.

      Please save us from those poisonous lies!

      *cough*anecdote*cough*

    19. Re:Huh? by Anonymous Coward · · Score: 0

      Now compare to BFS.

    20. Re:Huh? by Sj0 · · Score: 1, Offtopic

      Browser statistics and OS statistics are two different things. For one thing, mozilla for example is 99.9% compatible with anything on the web, which is just as good as any given version of IE, seeing as Microsoft has this horrible habit of breaking webpages with browser revisions(I worked for a school board in 2k, and IE6SP2 broke the Cisco Networking Academies curriculum. You can imagine our suprise when a few of the new labs we set up during the summer called up the helpdesk with a frantic "what the hell is wrong with our cisco??". )

      with integrated tabbed browsing, popup blocking, spyware invunerability, greater speed and many other great features, in my view(and I'm not alone -- Many people I've met, after using mozilla or firebird for a week, swore by it. It's all we use in my household, and that's not by MY decision. :) ) the only people who still use IE are those who haven't gotten around to switching for whatever reason, or don't know about it yet.

      --
      It's been a long time.
    21. Re:Huh? by Anonymous Coward · · Score: 0, Funny

      Yes, I run WinXP on my Toshiba laptop -- deal with it

      Actually, me thinks it's actually you who will need to "deal with it" ;)

    22. Re:Huh? by Anonymous Coward · · Score: 0

      Actually, it copies.

    23. Re:Huh? by rixstep · · Score: 1

      We have beer parties. Everyone gets a bag of popcorn. Then everybody puts money on a colour. We had one dork picked purple. We split his money later and bought more beer. I usually pick blue and somehow almost always win. But waiting until 4 AM to pick up the pot is a bit frustrating.

    24. Re:Huh? by linzeal · · Score: 1

      Smoking marijuana at 4 AM, do you mean 420?

    25. Re:Huh? by TykeClone · · Score: 1
      Browser statistics and OS statistics are two different things. For one thing, mozilla for example is 99.9% compatible with anything on the web

      The only problem that keeps me from rolling it out where I work is that some of the things that we require need IE. It's a bummer, but that's the way that they're designed.

      Always do try to push the vendors in the right direction. Now, if we could get our core system to run on Linux, I'd be very happy.

      --
      A fine is a tax you pay for doing wrong and a tax is a fine you pay for doing all right.
    26. Re:Huh? by robosmurf · · Score: 1

      I've often run into this at work using 2000.

      I commonly unzip large (800MB) files to NTFS partitions. These files often end up with thousands of fragments (I think the worst I've seen was something like 17000 fragments).

      If you take a copy of the file, then the copy will not be significantly fragmented.

      This seems to be worse in 2000, as the 2000 built-in defragmenter doesn't seem to make any attempt to defragment the free space.

    27. Re:Huh? by Tukla · · Score: 1

      No, it does copy. Given a large file and a slow machine, it can take 10 or 15 seconds to copy the file to its final location, even on the same partition, and you even get a progress window. (Note: This is my experience under Win98. I don't know about recent Windows versions.)

  2. HFS+ defrag source by revscat · · Score: 5, Informative

    As mentioned in the article, HFS+ does defragging on the fly when files are opened if they are less than 20MB. The source code for this is available here, as is a discussion about it that contains input from some Darwin developers.

    1. Re:HFS+ defrag source by dealsites · · Score: 1

      That certainly sounds like a good idea. What are the trade-offs though? I guess it may take slightly longer to open a file, but that seems like it would be worth it in my opinion. Are there any other drawbacks? What about files larger than 20M?

      --
      New deal processing engine online: http://www.dealsites.net/livedeals.html

    2. Re:HFS+ defrag source by Unnngh! · · Score: 1

      Yeah, my freebsd system (FFS?) does the same thing and works quite well. I've never seen performance issues from its defragging.

    3. Re:HFS+ defrag source by rharder · · Score: 3, Interesting

      I still wish there was a reliable, preferrably included, defrag program. I do a lot of video work, and I not only want defragmented files, I want large contiguous sections of free space on my hard drive. I've not had much luck with 3rd party degrag programs (though I've yet to try SpeedDisk).

    4. Re:HFS+ defrag source by Joe5678 · · Score: 2, Insightful

      I guess it may take slightly longer to open a file, but that seems like it would be worth it in my opinion.

      That would seem to defeat the purpose to me. The main reason you want to avoid fragmentation of the data is that fragmented data takes longer to pull from the disk. So if by preventing fragmentation you slow down pulling data from the disk, you have just defeated your purpose.

    5. Re:HFS+ defrag source by aristotle-dude · · Score: 1

      Umm. No, I believe you and the parent are both wrong. Defrag on the fly occurs when files are written to the disk, not during write operations. Fragmentation would slow down both read and write operations. I could be wrong though concerning my first point. :)

      --
      Jesus was a compassionate social conservative who called individuals to sin no more.
    6. Re:HFS+ defrag source by shotfeel · · Score: 4, Interesting

      I thought this was a feature of Panther, not HFS+.

      HFS+ has been around since OS 8.5 (?? somewhere in OS 8). So either this is a feature of HFS+ that hasn't been implemented until now, or its a bit of code added to Panther. Or has HFS+ been updated?

    7. Re:HFS+ defrag source by NMerriam · · Score: 0, Interesting

      He didn't mention, however, that when system updates are installed, the final stage of setup is to defragment. Apple is very proactive about avoiding fragmentation, and OSX really does a great job of making sure things run smoothly without requiring the user to know anything about it.

      --
      Recursive: Adj. See Recursive.
    8. Re:HFS+ defrag source by Exitthree · · Score: 5, Interesting

      You've only defeated the purpose if you re-fragment the file again after opening it. If this isn't the case, the amortized cost (the initial cost of de-fragmentation when opening the first time minus the speed benefits from a file in a single chunk) over the many times the file is read yields a speed bonus, not a speed loss.

      A good example is me, installing a program from disk onto my computer. I run the program and it accesses a group of files that have been fragmented when copied to my hard drive. The first time it opens the files it spends a little extra time de-fragmenting them. However, subsequent times that I open the program, these files will load faster.

    9. Re:HFS+ defrag source by ericdano · · Score: 4, Informative
      Intech's Speedtools is a good set of utilities and includes a good defragmenter. For a complete defrag, something like Drive 10 or TechTool 4 work better.


      Good luck

      --
      It's either on the beat or off the beat, it's that easy.
      I moderate therefore I rule!
      --
    10. Re:HFS+ defrag source by ahknight · · Score: 4, Informative

      As stated in the article, this is a feature of the HFS+ code in Panther. The filesystem cannot have a defrag feature as the filesystem is just a specification. The implementation of that specification, however, can do most anything to it. :)

    11. Re:HFS+ defrag source by Anonymous Coward · · Score: 0, Troll

      Uh-huh... Last time I checked filesystems were also operatining system components. Often these components might be referred to as drivers. And one might say that the HFS+ driver has a defrag feature. And thus one might say that the defrag is a feature of the filesystem.

      Do you actually work with file systems or do you just sit around pushing obscure semantics in an attempt to sound smart?

    12. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      Defrag on the fly occurs when files are written to the disk, not during write operations.
      Are you sure that it's not done during writing?

      Seems like you have your base covered.

    13. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      It's hard for me to take seriously a company with a name so close to Initech...

    14. Re:HFS+ defrag source by DrEldarion · · Score: 0

      Isn't the whole point of defragmenting to make it so files don't take as long to open? Wouldn't adding a defragmentation step make it so that it actually takes LONGER to open a fragmented file the first time you want it?

      What's the advantage of this over having your system defragment itself every night while you're sleeping?

    15. Re:HFS+ defrag source by meme_police · · Score: 1

      Source of that information?

      --

      The meme police, They live inside of my head

    16. Re:HFS+ defrag source by Mitz+Pettel · · Score: 1

      Parent is mistaken. The lengthy "optimization" process at the end of installation is consists of updating prebinding information, not performing defragmentation.

    17. Re:HFS+ defrag source by MattHaffner · · Score: 5, Insightful

      Are you talking about the "Optimizing System" phase? As far as I know, that updates binary-library prebindings--not fragmentation. You can read more about it here:

      http://developer.apple.com/documentation/Perform an ce/Conceptual/LaunchTime/Tasks/Prebinding.html

      In theory, when you install anything (on any system) and have a reasonable amount of contiguous free space on your disk, the installed files should always be unfragmented since I believe that's what most file systems look for first to allocate: a large chunk of contiguous space.

      Fragmentation typically occurs more when you open a file, increase its size, and write it back out. But operations that write large files to disk that do not know beforehand what the final size may also do this to some files that were only written once to your disk. For example, some of the largest fragmented files on my HFS+ volume are things snagged with BitTorrent. The fragments in these files are very regular chunks of blocks, which could be the typical 'buffer' size BT grabs when writing.

    18. Re:HFS+ defrag source by ahknight · · Score: 4, Insightful

      Last time I checked filesystems were also operatining system components. Often these components might be referred to as drivers.

      Then you didn't check hard. Again, HFS+ is a specification of how to write data to media in order to organize another collection of data. The implementation is what handles the defragging. There are no drivers involved as drivers are the software component of a hardware/software union and there is no hardware involved at this level (just logical organization).

    19. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      first time? yes
      subsequent times? no
      Amortize it ^_^

      It'll be a little worse than doing it while you sleep, *except* that it won't bother defragmenting files that you're never using, so in total will do less work. This may or may not actually be a benefit, depending on whether you want your computer doing anything else while you sleep.

    20. Re:HFS+ defrag source by Anonymous Coward · · Score: 4, Informative

      You just made his point. The DRIVER does the defragging. The HFS+ is a specification for how the files are laid out and written to the disk, such that a driver that understands this specification can read it. Linux has HFS+ drivers, but I doubt they defrag on the fly. Supposedly (though I don't know), Mac OS versions prior to 10.3 didn't defrag either.

      So therefore it might be a part of the operating system's filesystem. That's the system that deals with files. But that's not what was asked. What was asked was whether it was an inherent feature of HFS+, and that's not possible, since HFS+ doesn't tell the OS what to do when a file is opened, only how the stuff is stored on the disk.

      Perhaps you didn't understand the dual nature of the word filesystem: it can be the subsystem of the OS that handles files, or it can be the physical representation of the data on to the hard drive. If you assume it's only the first, your explanation makes sense. If you assume the second one (which would be the usage intended and understood by most people given the fact that the question and response were about HFS+ (physical filesystem) compared to Panther (OS filesystem)), then you'd be wrong.

      And I've been trolled, but who cares.

    21. Re:HFS+ defrag source by Daniel_Staal · · Score: 5, Informative

      I believe the actual sequence is this:

      1. Get request for file
      2. Open File
      3. Buffer file to memory
      4. Answer request for file
      5. If needed, defragment file

      In other words, it defrangments after the file has been returned to the program needing it, as a background process. The buffer to memory is a pre-existing optimization, so the only real trade off is the background processor usage goes up. If you aren't doing major work at the time, you'll never notice. (And if you are doing major work, you probably are using files larger than 20MB in size anyway.)

      Files larger than 20MB just aren't defragmented, unless you have another tool to do it.

      --
      'Sensible' is a curse word.
    22. Re:HFS+ defrag source by javax · · Score: 2, Informative

      hmmm... the advantage would be that your system wouldn't need to get defragmented every night you're asleep.

      The real advantage is that it will speed up things immediately for the 2nd time the file is read. Though you can still defrag your disk overnight if you like that.

    23. Re:HFS+ defrag source by jazman_777 · · Score: 1
      What's the advantage of this over having your system defragment itself every night while you're sleeping?

      You can skip sleep, since you don't need to do it so your filesystems can get defragged.

      --
      Slashdot: Failed Car Analogies. Amateur Lawyering. Anecdote Battles.
    24. Re:HFS+ defrag source by OrenWolf · · Score: 1

      BTW, this particular BitTorrent annoyance was fixed in version 3.3.

    25. Re:HFS+ defrag source by solios · · Score: 2, Informative

      HFS+ was one of the major features of the OS 8.1 update. OS 8.0 and earlier can't "see" HFS+ volumes- they see a tiny disk with a simpletext file titled "where have all my files gone?" which, if I remember correctly, gives a brief explanation that the disk is HFS+ and requires 8.1 or higher to view. :)

      Journalling didn't show up until one of the Jaguar updates, where it could be enabled via the command line on clients and via disk utility on Server.

    26. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      Haha you just answered my question about whether you work with filesystems or not. That magical "code" you keep referring to.. those who understand OS architecture will know that it is in the kernel as drivers. So you obviously don't know what you are talking about technically. And for you to then try and argue over the supposed rules for using the words "file system" is amusing. Apparently you had best tell the rest of us in the development community that we should stop referring to our drivers as file systems. You might wanna have Apple and Microsoft update their operating system documentation too.

    27. Re:HFS+ defrag source by MattHaffner · · Score: 1

      Oh, nice! Thanks for the tip. Boy, did that URL (in my parent post) get mangled... suck.

    28. Re:HFS+ defrag source by jimfrost · · Score: 3, Informative
      No, FFS does not do after-the-fact defragmentation. It attempts to allocate blocks that have low seek latency as files are extended. For the most part this avoids the problem entirely.

      If you ever wondered why there is a "soft limit" on FFS filesystems, the reason why is that its allocator's effectiveness breaks down at about the point where the filesystem is 90% full. So they sacrifice 10% of the filesystem space so that they can avoid fragmentation problems. It's not a bad tradeoff, particularly these days.

      I didn't know that HFS+ used an after-the-fact defragmentation system, but they've been around for awhile too. Significant research was done into such things as part of log-based filesystem research in the early 1990s (reference BSF LFS and Sprite). You had to have a "cleaner" process with those filesystems anyway (to pick up abandoned fragments of the log and return them to the free pool) so it made sense to have it also perform some optimization features.

      --
      jim frost
      jimf@frostbytes.com
    29. Re:HFS+ defrag source by ahknight · · Score: 1

      In Mac OS X the HFS+ filesystem is implemented as a kernel extension. A kernel extension can be a driver (video, USB devices, etc.), a filesystem (HFS, FAT, AFP, NFS, etc.), or kernel-level features (ipfw, ppp, etc.).

      Your point is not proven by saying "haha you don't know it's a driver!" You actually need to reference something other than your opinion to make a statement useful. I have a small hope of that happening, so I hope you learn from your elder and understand the traditional sense of the term rather than using it as some small group of code monkeys do (what the Linux kernel folk refer to as a "driver" is merely an "extension" or a "plug in"; a driver drives something and a filesystem cannot be driven).

    30. Re:HFS+ defrag source by bofkentucky · · Score: 1

      FreeBSD uses UFS or UFS+S (UFS with Softupdates), UFS+S is a very nice FS that a lot of people dislike b/c it is not a true journaling FS.

      --
      09f911029d74e35bd84156c5635688c0
    31. Re:HFS+ defrag source by Entropy2016 · · Score: 1

      Are you sure it's a Panther feature?

      I thought this was a very low-level functionality inside of Darwin.
      If so, it's worth noting since it's possible to run Darwin outside of Apple hardware.

    32. Re:HFS+ defrag source by ahknight · · Score: 1

      It's a feature of the HFS+ kernel extension in Darwin 7, which is the version of Darwin included in Panther.

    33. Re:HFS+ defrag source by ahknight · · Score: 1

      one of the Jaguar updates

      10.2.2.

    34. Re:HFS+ defrag source by shamino0 · · Score: 5, Informative
      HFS+ was one of the major features of the OS 8.1 update. OS 8.0 and earlier can't "see" HFS+ volumes- they see a tiny disk with a simpletext file titled "where have all my files gone?" which, if I remember correctly, gives a brief explanation that the disk is HFS+ and requires 8.1 or higher to view. :)

      And the person who came up with this idea was a genius. This is far far better than what most other operating systems do (refuse to mount the volume.)

      If I boot MS-DOS on a machine that has FAT-32 or NTFS volumes, I simply don't find any volume. I can't tell the difference between an unsupported file system and an unformatted partition. If the file system would create a FAT-compatible read-only stub (like HFS+ does), it would be much better for the user. Instead of thinking you have a corrupt drive, you'd know that there is a file system that your OS can't read.

    35. Re:HFS+ defrag source by MrChuck · · Score: 1
      It's rare but it happens. I've seen it with partitions just a couple times in 15 years. On Solaris, SunOS, BSD (all FFS1 without softupdates or much of the "since 2000" work.

      One symptom was a box that was at 86% but couldn't write more files. It took a while to figure that out (at 11PM over the phone with a semi-frantic customer).

      There is defrag software, but I've gotten around it by rsync'ing to another partition (or was it tar....)

      Back on topic, I find HFS interesting, but until it's actually running on more than an Apple machine, it's mainly irrelevant. I dunno if it's part of what Apple made Open in Darwin, but it's still a 1 OS pony.

      I'd much RATHER have FFS2 (with snapshots) in OS X. Or at least an understanding that "Makefile" and "makefile" are not the same file.

      But it's not a BSD kernel, so there's more work involved.

    36. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      The point is that the term file system is used for more than one thing. When you look through Apple's OS documentation or the M$ IFS/DDK docs you will see kernel components (called drivers by the rest of the world) that implement certain file storage specifications being referred to as file systems. This is how it is, there is no if ands or buts. So you are therefor unjustified in complaining when someone refers to a file system implementation in the context of a running OS as a file system.

      I'm sorry if the rest of the development community adopting the term driver to refer to kernel components that don't directly talk to hardware offends your wrikley old behind, but times change. Call up M$ and tell them that you don't approve. Maybe the entire industry can change to accomodate you.

    37. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      Haha why cause I know what I'm talking about? At least I didn't use the term filter driver or else your heads might have exploded.

    38. Re:HFS+ defrag source by ahknight · · Score: 1

      The point is that the term file system is used for more than one thing.

      No, it is not.

    39. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      That pages says:

      "Most operating systems provide a file system."

      So um when I install OS X it provides me with a document with a specification in it? :-)

    40. Re:HFS+ defrag source by moongha · · Score: 2, Interesting

      Case sensitivity is available on HFS+, it's just not the default.

      You can also use UFS.

    41. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      It doesn't take any longer to open the file. The Open request is handled first, then the file is defragged as a background process. It also doesn't auto-defrag files larger than 20 MB. If you really need that extra processor power and disk throughput that this eats, then your files are most likely larger than 20 MB, because you're probably doing serious work involving photo retouching or rendering video.

    42. Re:HFS+ defrag source by Dick+Faze · · Score: 1

      How would files be written to disk without a write operation?

    43. Re:HFS+ defrag source by TheNetAvenger · · Score: 1, Insightful

      And yet not only was NTFS one of the first file systems to assist in preventing fragmentation and the performance issues of fragmented files from the MFT stucture, in Windows 2000 and newer NT platforms also perform defragging while the system is idle, moving files not only to be degragged, but for optimal performance.

      So glad Apple was the innovator here again... Geesh. (except they are still following in the footsteps of the NT team).

      Do a performance anayalsis of files that are even fragmented on NTFS compared to files that are fragmented on HFS+ and you will get part of what I am talking about. Peformance degredation is not as much as an issue with NTFS as it is even with HFS+, read the NTFS whitepapaers.

      Additional, critical speed files (like paging files, user hives, etc are always automatically defragged during login and logoff, in addtion to be processed during idle machine time.)

      The irony is that NT has been doing this for years, and even Win98 had background defrag and file optimization techniques even with FAT32.

      So tell me again about this great HFS+ innovation and how it works so much better at defragging files than NTFS.

      I haven't defragged the laptop I am typing this on now for months, and yet, only a small about of large downloads are the files that are fragmented.

      Apple geeks get a new feature that everyone has had for years, and they think Job invented the wheel.

      Geesh..!!!

    44. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      I'd much RATHER have FFS2 (with snapshots) in OS X. Or at least an understanding that "Makefile" and "makefile" are not the same file.

      The "feature" that permits you to have two files with the same name but differing case is a major brokenness of the Unix system. The number of cases where it is actually useful are vanishingly small.

      Tech support: "Okay, now open the file called 'foo' and edit the user details in the first line."
      User: "There aren't any user details in it."
      Tech: "What does it say?"
      User: "It's something about frobnication."
      Tech: "Ah, you opened 'Foo'. You need to close that and open 'foo' instead."

      Nice stuff.

    45. Re:HFS+ defrag source by MrChuck · · Score: 1
      Then I missed the "join the 90s" button on my last clean disk HFS+ install (for 10.3). Alas.

      you can also use UFS

      Um, except that it's the UFS in FreeBSD 3.x. Which is about 3 years behind during some very ACTIVE programming years.

      So apple is missing:

      • Dirhash
      • Softupdates
      • Snapshots
      • background fsck (KILLER when you hard stop a box with 500GB disk.
    46. Re:HFS+ defrag source by Frogbert · · Score: 1

      You must be new here, all lists must end with:

      6. ???
      7. Profit

    47. Re:HFS+ defrag source by haxor.dk · · Score: 1

      "And the person who came up with this idea was a genius. This is far far better than what most other operating systems do (refuse to mount the volume.)"

      That's Apple in a nutshell. Attention to the little details that makes you computer more user friendly and intuitive to use.

    48. Re:HFS+ defrag source by VirtualWolf · · Score: 1

      HFS+ has been around since OS 8.5 (?? somewhere in OS 8).

      HFS+ was introducted in Mac OS 8.1.

    49. Re:HFS+ defrag source by sootman · · Score: 1

      But if Windows *did* recognize foreign filesystems (like ext2) then we wouldn't get to play endless rounds of that cool "you cannot delete a partition which contains logical drives"/"there are no logical drives in this partition" game in FDISK! :-)

      --
      Dear Slashdot: next time you want to mess with the site, add a rich-text editor for comments.
    50. Re:HFS+ defrag source by k8to · · Score: 1

      In my professional experience in the software industry, the term is used both ways frequently. You may be correct that filesystem was originally intended to refer to the layout only, but the term has become frequently attached (without any additional linguistic ornament) to the code which accesses and modifies said disk layout.

      In short, whenever discussing such topics, be sure to disambiguate, if it matters. I also feel it's of limited value to debate which of the two meanings is valid, since they are both in common usage.

      --
      -josh
    51. Re:HFS+ defrag source by Queer+Boy · · Score: 1
      I do a lot of video work, and I not only want defragmented files, I want large contiguous sections of free space on my hard drive.

      If you're doing that much video work, you should have a drive devoted to video.

      --
      Not since Marie-Antoinette played milkmaid has looking simple and honest been so fake and complicated.
    52. Re:HFS+ defrag source by dasmegabyte · · Score: 1

      But then, files larger than 20 meg generally aren't accessed very often, and when they are, they are generally accessed sequentially. Therefore, the fragmentation isn't that big a deal -- unless that file happens to be a database, in which case your database engine should be doing the defrag work itself.

      --
      Hey freaks: now you're ju
    53. Re:HFS+ defrag source by dasmegabyte · · Score: 2, Insightful

      Which is why Apple is such a great company.

      At some companies, a developer would go to his project manager, propose this feature, and get a head shake. Too much work to test and spec, not worth the gains. Let's devote our time to our core competencies.

      Apple on the other hand was built on details like this. In fact, one of my favorite things about OS 10.3 is Expose...a feature nobody really asked for, and now I can't live without it (fuck virtual desktops...I want one desktop I can use!)

      --
      Hey freaks: now you're ju
    54. Re:HFS+ defrag source by TheLink · · Score: 1

      "background fsck (KILLER when you hard stop a box with 500GB disk. "

      And what happens if there indeed is an error in your filesystem? Wouldn't letting the services run risk screwing up the filesystem even more?

      --
    55. Re:HFS+ defrag source by TheLink · · Score: 1

      If you want to play multiple videos together, it's actually faster to have the files interleaved than totally defragmented.

      But for most people should be ok to just do disk mirroring and striping.

      BTW keep your data off your O/S disk(s).

      --
    56. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      OK let me put this in nice easy terms for your small mind, "tech": one need not have your exceptional mental capacity in order to grasp the concept of case.

      I gather you aren't in the right league to be able to comment on UNIX's "brokenness", so I'll assume you're just a mindless Microsoft lackey. In which case, let me ask you this, what would your hero Mr. Tech do if a user had the files "100" and "one hundred" in the same directory, one of which needed to be opened?

    57. Re:HFS+ defrag source by Swedentom · · Score: 1

      HFS+ has been around since OS 8.5 (?? somewhere in OS 8).

      Yeah, it has been available since 8.1.

      --
      Sig Nature
    58. Re:HFS+ defrag source by squiggleslash · · Score: 1
      Haha you just answered my question about...
      Has anyone told you you're both obnoxious and wrong?

      The word file system, while correctly used to describe operating system components that implement file systems, is also used to describe the layouts themselves. Indeed, at one time, it was additionally used to describe the higher level operating system layers (the implementation of the open, read, close, etc, calls) in addition to both of those.

      The guy you responded to, correctly, said that the defrag feature of Panther was tied to Panther's HFS+ implementation, not to the HFS+ specification for laying out data on disks itself.

      --
      You are not alone. This is not normal. None of this is normal.
    59. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      Wow thats great dude. If you had been paying attention you would have noticed that the discussion was about whether or not the term file system can be used to describe the operating system components too. He was saying it could ONLY be used to describe the actual specification and NOT the implementation. And that is wrong.

      And you're wrong because the higher level API calls for file I/O are NEVER referred to as a file system since their whole job is to abstract the file systems in the first place! You don't work with file systems either, do you? You just read some facts on the Internet and then spew them back like you're playing a game of Trivial Pursuit. Try to comprehend what you read. There, was that obnoxious enough for you?

    60. Re:HFS+ defrag source by squiggleslash · · Score: 1
      And you're wrong because the higher level API calls for file I/O are NEVER referred to as a file system since their whole job is to abstract the file systems in the first place!
      No, I'm right. Sorry. In the late seventies and early eighties, when I first started using computers, it was common to refer to the entire part of the operating system dealing with files (not merely the raw driver or file system handler) as a file system. It was also common to call that part, seperated from the rest of the OS, a Disk Operating System.

      You may not like it. You may feel it's wrong. But I'm right in saying that was commonplace, and you're an idiot to contradict me.

      But then, as you're actively lying in an effort to backtrack about your claims that only a device driver can be called a file system, that's not entirely surprising is it? I've re-read the thread and can see nothing the guy you were conversing with said that can be interpreted as meaning that the term "file system" is limited to the layout of the disks. What he said, correctly, is that there's nothing about defragmentation inherent in the HFS+ disk layout, and that the term "file system" shouldn't be assumed to exclusively refer to the software that implements a disk layout.

      He's correct, and I suggest that you bite the bullet and admit it, rather than persist in this.

      --
      You are not alone. This is not normal. None of this is normal.
    61. Re:HFS+ defrag source by Anonymous Coward · · Score: 0

      Wow. Ok so thats great too man. You'll notice my statement was in the present tense. And so whatever pimply low-paid geeks did in the 70s isn't relevent. My statement that higher level APIs are not referred to as file systems today is correct. End of story. Sucka.

      Second, if you cannot see the posts where he is saying that the term file system ONLY applies to specifications and NOT to OS components, then thats not my problem. Its there. Read it. Anyhow, also I never said that file systems were ONLY OS components. Dude you can't seem to figure out what either of us is saying. They didn't teach reading comprehension at your school?

      At no point was he and I ever arguing over defrag being part of the HFS+ spec. Its not. Whats to argue? The ENTIRE arguement, EVERY post, has been about whether or not the term file system is applicable to OS components. I say yes. He says no. He's wrong.

      So you come here, misread all of our posts and then make your own posts argueing with me about things that were not being debated to begin with? And I'm the idiot? Wow I wish I had gotten my first computer way back in the early 80's. Oh wait I did! Haha. Dumbass.

  3. File allocation Table by SirChris · · Score: 4, Interesting

    what type of file system is there where there is no main allocation table just a header then the file then a header then the file so you could theoretically break a disk and still read the half that was good because all pertinent information relating to a file was in one place?

    1. Re:File allocation Table by SirChris · · Score: 0, Offtopic

      why is everyone marking this flamebait and troll i was asking a serious question. does anyone have an answer?

    2. Re:File allocation Table by jdunn14 · · Score: 2, Interesting

      In general, such a file system would have *horrible* performance, especially for writes, since it could require rearranging data on disk in order to allocate more space for a growing file. However, I would bet that some simple embedded filesystems do this sort of thing, especially if they are meant to be mainly read-only. Sorry, I can't just tell you the name of one, but you won't find such a filesystem made for regular desktop usage. Gonna be a special-purpose thing.

    3. Re:File allocation Table by Anonymous Coward · · Score: 0

      1. Try breaking up your run-on sentences.
      2. Use proper capitalization and punctuation.

    4. Re:File allocation Table by marcus · · Score: 1

      Are you hinting at a tape file system?

      --
      Good judgement comes from experience, and experience comes from bad judgement.
      - W. Wriston, former Citibank CEO
    5. Re:File allocation Table by SideshowBob · · Score: 4, Insightful

      That isn't a filesystem that is a tape. Any number of tape systems exist, pick whichever one you like.

    6. Re:File allocation Table by johannesg · · Score: 1
      Although you are modded troll for some unfathomable reason, there are certainly examples of what you ask: the Amiga's filing systems (both OFS and FFS) work like this. Each directory is simply a doubly linked list of file header blocks, with only the first block located in a fixed location (center of the disk, IIRC). Each header block controls a limited number of file blocks, after which an extension block is required - thus a file is also implemented as a doubly linked list.

      As another poster has already suggested, this approach is not particularly fast. Especially on floppies the Amiga's filesystem performance is atrocious (harddisks are ok, unless you need to deal with extreme numbers of files in a directory). To compensate, a third filing system augmented FFS with a cache - essentially a part of the disk was allocated to mirror all the header and extension blocks in one place.

      Defragmentation strategies for the Amiga tend to revolve around getting the linked list into a group of contiguous blocks, making directory scans faster, but at the cost of opening individual files.

      Not all is woe though: the Amiga filing systems are extremely recoverable in case of problems, because there is no reliance on any centralized structure. A block by block scan of the disk will uncover all the header, extension, and data blocks, and if all the blocks of a file are recoverable, then the entire file is.

    7. Re:File allocation Table by Anonymous Coward · · Score: 0

      too bad the FastFileSystem is anything but fast these days.

      Center of the disk... ugh.

    8. Re:File allocation Table by AKAImBatman · · Score: 4, Informative

      There are a couple things that you have to consider. For one, if part of the disk corrupts, how will you identify a header? Or for that matter, how would you identify the header space vs. file space in a non-corrupted file system?

      You're probably thinking "just store the size of the file", This is perfectly valid, but it does have certain implications. You see, in Comp-Sci, we refer to a list like this as a "linked list". The concept basically being that each item in the list has information (i.e. a "link") that helps identify the next item in the list. Such a data structure has a worst case access time of O(n). Or in other words, if your item is at the end of the list,and you have you have 2000 files, you'll have to check through all two thousand headers before finding your file.

      Popular file systems circumvent this by using what's called a Tree structure. A tree is similar to a linked list, but allows for multiple links that point to children of the node. A node that has no children is referred to as a "leaf node". In a file system the directories and files are nodes of a tree, with files being leaf nodes. This configuration gives us two performance characteristics that we must calculate for:

      1. The maximum number of children in a node.
      2. The maximum depth of the tree.

      Let's call them "c" for children and "d" for depth. Our performance formula is now O(c*d) and is irrespective of the number of items in the data structure. Let's make up and example to run this calculation against:

      Path: /usr/local/bin/mybinary

      Nodes:
      / (34) /usr (10) /usr/local (9) /usr/local/bin (72)

      Longest path: /usr/X11R6/include/X11

      Plugging the above numbers (72 for c, 4 for d) we get a worst case of 72*4 = 288 operations. Thus our worst case is much better than the linked list. And if we calculate the real case to access /usr/local/bin/mybinary, we get 34+10+9+72 = 134 operations.

      Hope this helps. :-)

    9. Re:File allocation Table by Elwood+P+Dowd · · Score: 1

      TAR files work exactly like that, afaik. That is why you spray them into tapes.

      --

      There are no trails. There are no trees out here.
    10. Re:File allocation Table by Anonymous Coward · · Score: 0

      tar -cf /xxx /dev/hda1

    11. Re:File allocation Table by Anonymous Coward · · Score: 0

      There have been a number of filesystems that use metadata that is stored near actual file data. One of the earliest was the Apple II DOS 3.3 file system. In the directory structure there was a pointer to the allocation block of the file, then at that allocation block you had a list of data blocks in the file. However it'd be kind of stupid to totally avoid having a whole disk block allocation map, because how the hell do you know where your free space is? Many UFS derived file systems have enough data to recover files if you so desire.

      But having a header, then a file, then a header, then a file would also be exceptionally dumb. You'd have a hard time deleting, growing, shrinking, etc. files.

    12. Re:File allocation Table by johannesg · · Score: 1

      _Logical_ center, obviously. The block in the middle rather than the hole...

    13. Re:File allocation Table by efflux · · Score: 1
      Technically, your worst case scenario is still big O of n, it just depends on the particular instance of your tree--unless we had some sort of balanced tree structure.

      Now, I have a question: I've seen it mentioned that some file systems do indeed have a btree implementation. How is this accomplished? What does this mean? I am fairly certain that this "tree" does not refer to a directory hierachy as it would be imposible to exert this sort of balanced stipulation on that. Is there then, some sort of exernal behind-the-scenes heirachy in place? Or is the btree only for individual directory lists? Thanks to whoever will answer this question (I'm going to do a little research on this myself as well...I'm just not certain I will find anything definitive).

      --
      Do I contradict myself? Very well, then I contradict myself, I am large, I contain multitudes. -- Walt Whitman
  4. HFS+ by Anonymous Coward · · Score: 0

    Doesn't Panther include some sort of on the fly defrag built into the system? So when files are used more often they grouped together?

    1. Re:HFS+ by Anonymous Coward · · Score: 0

      XP and 2000 do that too.

    2. Re:HFS+ by jeremyp · · Score: 1

      XP on my PC and laptop don't seem to. Or the doiks get fragmented in spite of it according to the defrag tool.

      --
      All I want is a secure system where it's easy to do anything I want. Is that too much to ask ~~ Randall Munroe
  5. Re:This is Unix... by Anonymous Coward · · Score: 1, Funny

    This seems especially relevant with the novel dinosaur advertisement. :)

  6. Re:Anonymous by o0zi · · Score: 3, Informative

    Ext2/3 and reiserfs both have inbuilt defragmentation capabilities. This can be seen, for instance, when you boot an ext2 system after an unclean shutdown and it checks the integrity of the filesystem. Ext3 and reiserfs are both journaling filesystems, which also helps with this problem. This is often strange for new Linux users, as they're used to worrying about their Windows NTFS/FAT32 filesystems. In Linux, it's just not necessary (nor in any Unix derivative such as AIX or BSD that uses those filesystems).

  7. Measuring fragmentation in NTFS by Anonymous Coward · · Score: 2, Informative

    Goto My Computer. Right click the drive to be analyzed. Select tools/defragment now.../Analyze.

    This was my PhD Thesis.

    1. Re:Measuring fragmentation in NTFS by strictnein · · Score: 1

      Volume fragmentation
      Total fragmentation = 16 %
      File fragmentation = 33 %
      Free space fragmentation = 0 %

      I win!

    2. Re:Measuring fragmentation in NTFS by Anonymous Coward · · Score: 0

      This was my PhD Thesis.

      Great! Any idea how to do this in ext2/3 ??

    3. Re:Measuring fragmentation in NTFS by moonbender · · Score: 4, Interesting

      I wrote a script some time ago to more easily let me check how badly my partitions are fragmented, here's it's current output:
      C: 5,72 GB Total, 1,97 GB (34%) Free, 4% Fragmented (8% file fragmentation)
      D: 40,00 GB Total, 1,00 GB (2%) Free, 41% Fragmented (82% file fragmentation)
      E: 66,69 GB Total, 105 MB (0%) Free, 10% Fragmented (21% file fragmentation)
      F: 30,00 GB Total, 1,21 GB (4%) Free, 3% Fragmented (7% file fragmentation)
      G: 10,00 GB Total, 1,54 GB (15%) Free, 5% Fragmented (9% file fragmentation)
      H: 35,03 GB Total, 551 MB (1%) Free, 39% Fragmented (79% file fragmentation)

      D ("Dump") and H ("Online") get a lot of throughput, by personal computing standards anyway, E ("Games") doesn't get changed that much, but if it does, a lot of data leaves and comes. Seems like whenever I defrag D or H, they're back to the values above within days. I guess Win XP has a hard time doing the internal on-the-fly defragging of the hard drives that rarely have moer than 1% free space... Guess I should just get a new HD and have some more free space that way - but I bet I'd have that filled up with junk after some weeks, anyway.

      That said, I'm not sure how relevant this is for NTFS partitions, anyway. I recall hearing that they aren't affected by fragmentation as much as FAT partitions (which were a nightmare), however I'm not sure if that means they don't fragment that easily (heh) or whether accessing data isn't slowed down as much by any existing fragmentation.

      I've also rarely heard anyone talking about fragmentation in the popular Linux file systems, a Unix partisan I know actually thought they didn't fragment full stop, which I don't believe is possible, at least not if you consider situations which might not occur in practice. But then again, I suppose Linux might solve it the same way Apple seems to - I guess I'll know more after a couple of hundred comments on this article. :)

      --
      Switch back to Slashdot's D1 system.
    4. Re:Measuring fragmentation in NTFS by Anonymous Coward · · Score: 0

      Volume fragmentation
      Total fragmentation = 22 %
      File fragmentation = 45 %
      Free space fragmentation = 0 %

      130 GB NTFS Drive, installed little over 2 months ago...

      Just normal desktop-use, never defragged

    5. Re:Measuring fragmentation in NTFS by Unregistered · · Score: 2, Insightful

      You need at least 10% free space for windows to keep the fs reasonably defragmented. put some larger hdds in there and it'll work much better

    6. Re:Measuring fragmentation in NTFS by el_gordo101 · · Score: 1

      If you have running processes that are accessing files on these partiton (like SQL Server accessing a database file or a SourceSafe repository) then the Windows defrag utility will not attempt to defrag these files. If this is true in your case, try and shut down these apps or services and it should be able to defrag these files.

      --
      TODO: Insert witty sig
    7. Re:Measuring fragmentation in NTFS by Anonymous Coward · · Score: 0

      You stated that you wrote a script that shows you how badly the partitions are fragmented. can you post/email me that script? As a side note, if these are partitions, not drives, in NTFS, you may be experiencing performance loss as a result of partitioning the same physical drive. Several windowsXP tweaking guides stat that you shouldn't split up a hd if you can avoid it.

    8. Re:Measuring fragmentation in NTFS by moonbender · · Score: 1
      Sure. It's a PHP script, though, so it won't work on a "vanilla" WinXP system.
      <?

      $drives = array('c', 'd', 'e', 'f', 'g', 'h');

      print "<pre>Testing partitions...<br><br>";

      foreach ($drives as $letter)
      {
      unset($results);
      exec("defrag -a $letter:", $results);
      print(strtoupper($letter) . ": " . $results[4] . "<br>\n");
      }

      print "</pre>";

      ?>
      Don't shoot me if this does anything untoward to your system, you have been warned. :)

      As for performance losses due to having multiple partitions, got any resources that go into some detail why this should happen? Credible ones, preferably. I haven't heard anything like that so far...
      --
      Switch back to Slashdot's D1 system.
  8. NTFS is not so bad by W2k · · Score: 5, Interesting

    It must be pretty damn good if it can outdo NTFS. I have three computers with WinXP (NTFS 5.1) that I run quite a bit of data through on a daily basis, and neither needs to be defragmented very often at all (two of them have never needed defragmentation in more than a year of use). Mind you, I might fall into some special category of people who don't fall victim to fragmentation for some reason. Anyway, my point is, before you make remarks regarding how well this compares to NTFS, and/or how much "Microsoft sucks", consider how well NTFS still holds up considering its age. Another bonus is, I don't risk losing file system integrity if there's a power failure. ;)

    --
    Quality, performance, value; you get only two, and you don't always get to pick.
    1. Re:NTFS is not so bad by pjt33 · · Score: 2, Informative

      HFS+ is also journalled by default.

    2. Re:NTFS is not so bad by MemoryDragon · · Score: 5, Informative

      Ntfs does not fragment that strongly as long as you dont hit the 90% full mark of your disk, once you reach that, see the files becoming fragmented in no time. NTFS uses the open space for write access and then probably relocates the files in time, once it hits 90% the open space usage algorithm does not seem to work anymore.

    3. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      Microsoft DOES suck even if "NTFS still holds up considering its age". There are numerous OTHER reasons why Microsoft sucks and everyone is welcome to pipe up and say it. Therefore: MICROSOFT SUCKS You don't have file system integrity to start with so, of course you don't risk losing what you don't have in the first place.

    4. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      I have never had any Microsoft OS file system get corrupted. I can't say the same about Linux.

      This is one of very few things Microsoft actually does have going for them.

    5. Re:NTFS is not so bad by Malc · · Score: 4, Interesting

      You must be too young to remember FAT-based systems. Lost clusters and cross-linked chains... oooh, didn't I enjoy them! NTFS has proven rock-solid and I haven't looked back since I jumped Win95 to WinNT4.

    6. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      HUH?? NTFS is HORRID for fragmentation.

      mostly because of microsoft's fault on how their software installers work.

      Install a FRESH W2K or XP-pro install, then go look at the fragmentation.. the drive is horribly fragmented for the amount of data that is on it. every time you install something it get's worse nothing will install cleanly.

      NTFS is not at fault, Microsoft is though with it's crappy install prooceedures and it's installer model that every onese follows.

    7. Re:NTFS is not so bad by Anonymous Coward · · Score: 1, Informative

      Well I have 32 Linux servers and 87 Linux desktops in the domain I administer. Never had a corrupted fs on any of those in the 1 /2 years I've been here, on the other hand we also run 143 Win desktops and I currently have 14 associates' hard drives with corrupted fs sitting in front of me (granted 11 of them are Win98).

    8. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      I have... not a nice story either, but to Microsoft's credit, it was PartitionMagic's fault.

      Hint: When merging your documents partition with your main partition, BACK IT UP. Otherwise, data gets moved, but neither MFT points to it anymore - at least, that's what happens when PartitionMagic dumps core at 68%

    9. Re:NTFS is not so bad by nbvb · · Score: 1

      Good thing it started life in OS/2 as HPFS386 .......

    10. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      So these Corrupted Linux filesystems of yours...how'd you do it?

      Filesystems don't 'just go bad' by themselves. I've had Linux filesystems lose data on me, because I was fucking with the drive. I've seen FAT drives just up and DIE for no reason-what-so-ever, But a format made them usable again which tells me the Allocation Table lost it's own data

    11. Re:NTFS is not so bad by Daytona955i · · Score: 2, Insightful

      Do you actually check your drives? I just got a laptop with XP and I've been using it for less than a month now. After reading this thread I though well my computer is fairly new but I'll see how it looks anyway. After running Disk Defragmenter and clicking analyze I get:
      Analysis is complete for: (C:)
      You should defragment this volume.

      I then looked at the report and found the following:
      Total fragmentation = 21%
      File fragmentation = 42%
      Free space fragmentation = 1%

      Pretty bad especially considering I've only had the laptop for less than a month and that I still have over half the 40 gig drive free. Oh and HFS+ in panther is journaled so no loss of file system integrity there. So compared to HFS+ in panther, I'd say that NTFS in XP sucks! It would be interesting if someone has done similar research on ext3.

    12. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      You've never had an NTFS volume corrupt from an improper shutdown? It can happen chief. NTFS does not have a full journaling implementation.

    13. Re:NTFS is not so bad by 13Echo · · Score: 2, Insightful

      NTFS isn't technically "as old" as you might think. Each version of NT over the past few years has added several upgrades to NTFS.

      http://en.wikipedia.org/wiki/NTFS

      NTFS has its strong points. It is reliable and has several extensions that make it quite flexible. On the other hand, it's not hard to "outdo NTFS" in some respects. There are many things that HFS+ and ReiserFS do better than NTFS. There are many things that NTFS does better.

      I think that NTFS is pretty good when it comes to cataloging changes to the drive. NTFS' speed leaves something to be disired though, and the nature of its fragmentation (though better than FAT32) still presents even more performance problems.

    14. Re:NTFS is not so bad by 222 · · Score: 4, Informative

      For proof, check out this. This drive was defragged about a week ago, and although it does go through heavy use, the current low disk space causes massive fragmentation.

    15. Re:NTFS is not so bad by radish · · Score: 1

      There is a setting in XP to enable background defragging. I haven't read docs for it, but from what I can tell, when the screensaver's running and the disk system is idle, it starts defragging on a background thread. I've certainly seen the disk light go crazy while it's otherwise sitting there doing nothing. Seems to keep fragmentation on my (50% used or so) disk low.

      --

      ---- Den ene knappen er powerknapp, den andre er Bender voice knapp "Bite My Shiny Metal Ass"

    16. Re:NTFS is not so bad by Brandybuck · · Score: 1

      and neither needs to be defragmented very often at all

      I use UFS and I have *NEVER* had to defragment. There's a little bit of fragmentation, to be sure, but never enough to warrant the need to actually go and defrag it. I'm sure ext3, reiserfs, xfs, etc, are in the same category.

      --
      Don't blame me, I didn't vote for either of them!
    17. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      Not to mention the fact that if you have less then 15% free space the defrag program pretty much just gives up.

    18. Re:NTFS is not so bad by throx · · Score: 1

      No it didn't. NTFS drew a lot of concepts from HPFS and other file systems in it's development but it certainly wasn't a derivative of HPFS/386. If it was, IBM would have certainly had a few things to say about it.

      --

      Fear: When you see B8 00 4C CD 21 and know what it means

    19. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      Lost clusters and cross-linked chains... oooh, didn't I enjoy them!

      Those were great! If you had a lot of mpeg files (all the same resolution and bitrate) a file error could result in random cuts between videos.

    20. Re:NTFS is not so bad by 1010011010 · · Score: 1
      This Win2k machine was installed from a Ghost image, meaning that it began life perfectly defragmented.


      • Volume fragmentation
        Total fragmentation = 21 %
        File fragmentation = 43 %
        Free space fragmentation = 0 %

        File fragmentation
        Total files = 54,224
        Average file size = 250 KB
        Total fragmented files = 1,448
        Total excess fragments = 47,054
        Average fragments per file = 1.86

        Pagefile fragmentation
        Pagefile size = 753 MB
        Total fragments = 593

        Directory fragmentation
        Total directories = 3,953
        Fragmented directories = 257
        Excess directory fragments = 2,670

        Master File Table (MFT) fragmentation
        Total MFT size = 65,202 KB
        MFT record count = 58,577
        Percent MFT in use = 89 %
        Total MFT fragments = 2



      NTFS is very bad at avoiding fragmentation. This drive has amost 50% disk space free.
      --
      Napster-to-go says "Fill and refill your compatible MP3 player", which is a lie. It's not MP3. It's WMA with DRM.
    21. Re:NTFS is not so bad by DashEvil · · Score: 1

      My UFS2 slices have never gone beyond 1% fragmentation, no matter how much I abuse them.

      --
      -If God wanted people to be better than me, he would have made them that way.
    22. Re:NTFS is not so bad by Atomic+Frog · · Score: 3, Informative

      No, it doesn't take much to outdo NTFS.

      NTFS fragments _very_ fast on me, after a few months of use, it is in the 20% or more range.

      Same user (i.e. me), so same usage pattern, on my HPFS disks (yes, HPFS, that would be OS/2, not OS X), the fragmentation after 3 _years_ is less than 2% on ALL of my HPFS disks.

    23. Re:NTFS is not so bad by archen · · Score: 1

      There is also a problem there. Is there any way to defrag a drive other than just removing and recopying the information? I ran into a problem where a ext3 partition ended up fragmented to hell and couldn't find any tools to defragment the drive. The fact that 99% of us using ext2/3 and ufs never really need to defrag is a good thing, but not having any tools available when you need them isn't neccesarily good either.

    24. Re:NTFS is not so bad by michael_cain · · Score: 2, Insightful
      You must be too young to remember FAT-based systems.

      Youngster. Go back far enough in UNIX and it required PERFECT disk packs to function -- no handling of bad sectors. Of course, those were the days when disk "drives" were the size of a small washing machine, the top opened, and you loaded/unloaded the multi-platter disk pack that was the size of a hat box. Was always interesting to see one of the gurus arrive to troubleshoot your system carrying their own disk pack with their specialized utilities... :^)

    25. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      Yeah dude you can set a scheduled task to run defrag in Windows when you aren't around. You can do that with Windows 95 if you want. The idea here is that you don't run defrag ever on OS X because the file system keeps itself defragged on the fly as it is in use.

    26. Re:NTFS is not so bad by Jeff+DeMaagd · · Score: 1

      I think NTFS is on something like its seventh revision, at least according to Norton's defrag and their Ghost program.

      In terms of stability, I've never had a problem with NTFS going corrupt. I was using NT4.0 on a couple Alphas for five years, and Windows 2000 on three x86 machines for maybe three years.

      Fragmentation is something of an issue but it really didn't seem to slow down my SCSI drives noticably.

    27. Re:NTFS is not so bad by chrwei · · Score: 1

      Another bonus is, I don't risk losing file system integrity if there's a power failure.

      bullshit. NTFS is sudo-journaled not true journaled and uses a file which is just as suseptable to bitrot (term used loosely) as the rest of the disk, uses "blocks", and can certainly loose integrity.

      we have a machine here that has a PC based controler that runs NT4 with NTFS, there's a flag you can set to disble the "dirty bit" check on boot so that no matter what NT won't check the disk on bootup. They do this because it's not uncomon for their target users, machinists, to turn off the PC with the big red E-Stop button and the long chkdsk process anoys them. So after a couple power outages and failure of the too-small UPS they installed the system started refusing to boot due to a loss of file system integrity. yes, machinists are more anoyed at waiting for a chkdsk than the machine being down for a couple days because of a failed system. Go figure.

      Yes, NTFS chkdsk's on boot, and NEEDS to be to hold integrety. It even makes those lovely FOUND.### files that fat32+scandisk does.

      --
      - Disclaimer: Information in this post deemed reliable but not guaranteed.
    28. Re:NTFS is not so bad by ionpro · · Score: 1

      In my experience, dealing with large files gives you tons of fragmentation on NTFS. Mind you, we may have different definitions of large files: mine is anything > 200MB (typ. 400MB, mostly videos). I also do a lot of deletion/insertion (I typically download something, watch it, and then delete it). I had no defragmentation for the first month, and when I finally got around to installing Diskeeper, my fragmentation was "58%" (something like 5 fragments/file). I usually run on the hairy edge of free space (80-95%), so this contributes a large percentage of the framentation.

    29. Re:NTFS is not so bad by Kent+Recal · · Score: 1

      If it was, IBM would have certainly had a few things to say about it.

      They probably have but SCO intimidated them so they shut up.

    30. Re:NTFS is not so bad by itwerx · · Score: 2, Insightful

      Pretty bad especially considering I've only had the laptop for less than a month...

      Any new machine will have an image dumped onto the hard-drive by the manufacturer.
      Most imaging apps don't bother with defragmenting so you probably started out with it fairly fragmented from the initial build of the image.

    31. Re:NTFS is not so bad by Bobas · · Score: 1

      AFAIK *BSD UFS is still unable to cope with bad sectors. It leaves it to the disk controller to allocate replacement sectors for the bad ones. And the disk is potentially unusable if there's at least on bad sector.

    32. Re:NTFS is not so bad by Anonymous Coward · · Score: 0

      Ooo, you must not have been caught by the Win XP SP1, McAfee, Outlook bug. Miraculously, 100+MB of email gone, .pst file size 0b. NTFS sucks rocks, it inherently fragments, it's slow, and, should anything ever happen to your binary data, good luck trying to recover it. Oh, and the registry is fun too, journeling my ass. If it truly journeled, it wouldn't regular go fubar on the registry with no installs or removals. Just seems to be time based. (Why do I say if it was truly journeled? Because if it was truly journeled, it could recover from that one power failure that exceeded the UPS and wouldn't have registry issues since that time period.)

      Well, enough of that rant, but seriously, I used FAT for a long time as a common data area for multiple OSes. No problems with it. When I used FAT for NT's boot disk (multi-boot) I only had to use a dos boot disk to correct a boot.ini and ntloader issue once in 6 years. The NTFS boot partition has completely cratered 3 times in 2 years. (Yet my 2 linux boxes run on, 5 years and several kernel revisions later) Another FS that ran circles around NTFS both in performance and fragmentation was HPFS. It was a sad day when MS quit supporting it. JFS is its journeling big brother.

    33. Re:NTFS is not so bad by Axello · · Score: 1

      Pfah! You youngsters had removable disk packs. I always brought along a pack of punchcards with my special Algol 68 utilities. That was bliss. Before that you had to toggle your utilities in binary using the switches on the front. :-)

    34. Re:NTFS is not so bad by slittle · · Score: 1

      For me, HPFS after a fresh install was upto 20%. And of course my BBS's message base files fragmented severely quite quickly.

      The rest was pretty decent though.

      As I recall, HPFS even when fragmented didn't suffer so badly as other FSs, since if the file fragments managed to stay in the same band, the heads didn't have far to go. HPFS deliberately caused Disk fragmentation to avoid File fragmentation. Most others put everything up one end, so when there's no more room to expand a file, they're off to the other end of the disk. Pretty decent tradeoff - I think even by OS/2's peak we were pretty much past needing to keep important files at the 'fast spots' on the HDD.

      --
      Opportunity knocks. Karma hunts you down.
  9. HFS Filesystem vs. ReiserFS by dTaylorSingletary · · Score: 2, Interesting

    I've had a continued problem on my iBook for the past year or so.

    Under HFS+ in Mac OS X Jaguar or Panther, after about a day of having a clean install, fresh partition and format my hard drive starts making clunking noises and the system locks up (without actually freezing) -- then when reboot attempts are made they take aeons.

    Under ReiserFS in Gentoo Linux for PPC: never have the problem. Same hard drive. Months of use, never once hear the hard drive being funky. No lockups.

    Do I put the blame on HFS? OS X? I just can't figure out this strange problem.

    --
    d. Taylor Singletary,
    reality technician techra.el
    1. Re:HFS Filesystem vs. ReiserFS by Anonymous Coward · · Score: 0

      Your hard disk is hosed. Buy a new hard drive NOW before you lose more data!

    2. Re:HFS Filesystem vs. ReiserFS by sith · · Score: 2, Interesting

      Clunk clunk from a drive is the drive saying "I cry out in pain! Replace me!"

      Seriously - it's likely that gentoo just isn't using the particular sector on the drive that OSX is - perhaps there is a file there that doesn't get accessed regularly or something. In any case, Clunk-Clunk is never ok.

    3. Re:HFS Filesystem vs. ReiserFS by maczilla · · Score: 1

      > my hard drive starts making clunking noises
      > and the system locks up

      The 'clunk' is a clue that it's a hardware problem...

      --
      'Nature's got a way, brothers, of scraping the bowl'
    4. Re:HFS Filesystem vs. ReiserFS by Daniel+Dvorkin · · Score: 2, Insightful

      What everybody else said. Back up your data and replace that drive NOW.

      --
      The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
    5. Re:HFS Filesystem vs. ReiserFS by axonal · · Score: 1

      I encountered the same problem with my iBook. This is a malfunction with the drive. I've had to have my iBook's hard drive replaced 4 times by applecare to get it solved. As for difference in ReiserFS and HFS+, I encountered the problem both with Mac OS and Gentoo as well. My friend suggested that it might do with unexpected shock during read/writes.

    6. Re:HFS Filesystem vs. ReiserFS by sterwill · · Score: 2, Informative

      Grab smartmontools and run them on your drive (like "smartctl -a /dev/hda" or similar). Most SCSI and most newer ATA drives will maintain a SMART error log of any defects/problems. smartmontools will also print drive attributes (for most drives) that can tell you when a drive is about to fail, before it actually does.

  10. My stats by Twirlip+of+the+Mists · · Score: 4, Informative
    I throw these out there for no real reason but the common interest.

    I've got a G4 with an 80 GB root drive which I use all day, every day. Well, almost. It's never had anything done to it, filesystem-maintenance-wise, since I last did an OS upgrade last fall, about eight months ago.
    Out of 319507 non-zero data forks total, 317386 (99.34 %) have no fragmentation.
    Not too shabby, methinks.
    --

    I write in my journal
    1. Re:My stats by Anonymous Coward · · Score: 1, Interesting

      how full is your disk. it's easier to stay mostly defragmented if you have lots of free space to play with.

    2. Re:My stats by Anonymous Coward · · Score: 0

      "I've got a G4 with an 80 GB root drive which I use all day, every day."

      I doubt Minesweeper will clutter up your disk. Just pointing out what you do "all day, every day" is very relavant here.

      Um.. looking at porn wouldn't clutter either.

    3. Re:My stats by haxor.dk · · Score: 1

      "Um.. looking at porn wouldn't clutter either."

      Yes, it will. Ever heard of browser cache ?

  11. Re:Give it a rest by chasingporsches · · Score: 3, Informative

    i believe the topic at hand is fragmentation, not how well it works as a filesystem. in that regard, FAT32 and NTFS do have horrible problems with fragmentation, while HFS+ defragments on the fly.

  12. Big frag issues under EXT2 too by freelunch · · Score: 1

    I Never really had a problem under Linux until I started using P2P..

    I know that Reiser does extremely well with space management on small files (CDDB database is a great example). Do any of the other Linux FSs do better than EXT2 with frag?

    1. Re:Big frag issues under EXT2 too by EsbenMoseHansen · · Score: 1

      Reiser has a kernel option "Stats in /proc/fs/reiserfs". I do not know what information is output, though.

      --
      Religion is regarded by the common people as true, by the wise as false, and by rulers as useful.
    2. Re:Big frag issues under EXT2 too by 42forty-two42 · · Score: 4, Informative
      Manually run e2fsck it'll tell you how fragmented it is, as in:
      $ e2fsck -f -n knoppix.img
      knoppix.img: 453/7680 files (3.1% non-contiguous), 12180/30720 blocks
    3. Re:Big frag issues under EXT2 too by chtephan · · Score: 1

      The reiserfs block allocator has some improvements in the latest 2.6-mm kernel.

      The main problem with p2p is that the filesystem don't allocate space for the file from the beginning even if the file is shown with its full size in the directory. The blocks are allocated when actual data is written. Since writes occur randomly and only very slowly this is some sort of nightmare for the filesystem.

    4. Re:Big frag issues under EXT2 too by Anonymous Coward · · Score: 0

      I would think that it's hard for most other file systems to do better since Reiserfs stores small files in the filesystem itself (unless you use the notail mount option - which you have to on a boot partition).

    5. Re:Big frag issues under EXT2 too by Ziviyr · · Score: 1

      A solution would be to download ta a partition where you don't care about fragging, then move the files elsewhere when they are done (defragging them in the process, naturally).

      --

      Someone set us up the bomb, so shine we are!
    6. Re:Big frag issues under EXT2 too by freelunch · · Score: 1

      Err... How do you tell?

      In my case the tip-off was slow throughput when copying the files. cat'ing them to /dev/null results in only a 6-7 MB/sec read rate.

      A couple of simultaneous downloads would also complicate things (combined with other desktop activity). I doubt it would be much of a problem on an otherwise quiescent system.

    7. Re:Big frag issues under EXT2 too by pseudochaotic · · Score: 1

      Can e2fsck also defragment? I looked at the man page, but didn't see anything about that.

      --
      And the l33t shall inherit the 34r7h.
    8. Re:Big frag issues under EXT2 too by 42forty-two42 · · Score: 1

      There's a e2defrag program but you shouldn't normally need it. Also, I can't vouch on how safe it is. Safest would be a tar/untar.

    9. Re:Big frag issues under EXT2 too by diegocgteleline.es · · Score: 1

      Actually there's a better tool: frag (in defrag debian package)

      frag -s /etc
      summary:
      2% file fragmentation (66 of 2903 files contain fragments)
      20% block fragmentation (3056 of 15241 blocks are in fragments)
      0% overall fragmentation (73 fragments out of 15241 blocks)
      Average inter-fragment gap length = 4616

      frag -s /var
      summary:
      4% file fragmentation (560 of 11432 files contain fragments)
      46% block fragmentation (149948 of 324734 blocks are in fragments)
      0% overall fragmentation (945 fragments out of 324734 blocks)
      Average inter-fragment gap length = 55889

      And BTW; Windows XP _defragments_ the filesystem, so that means you can correct fragmentation. Unix filesystems have good algorithms for this but what happens if the filesystem changes? If you deleted a file the decisions made by those algorithms are no longer valid. (Windows XP actually recolects information of the programs more frecuently used and defragments automatically the filesystem according those data. So the apps you use more often are arranged in a way they load faster, ie: you put the shared libraries near the data files some app is going to use, so the disk loads it faster instead of seeking over the disk. Theres nothing like that under *nix i think)

  13. Re:Anonymous by Malc · · Score: 4, Interesting

    To be honest, I don't worry too much about NTFS. It seems reliable and for my needs performs satisfactorily. I wonder if fragmentation was an issue overly-promoted by companies like Symantec. What does it mean to have a fragmented disk at logical level when the physical layout is hidden by the drive electronics, which could in fact be translating sectors? Do these defragmentation tools take things like the number of platters in to consideration, and can neighbouring sectors be assumed to be in the same cylinder across platters?

  14. Re:Anonymous by inertia187 · · Score: 1

    Do these defragmentation tools take things like the number of platters in to consideration, and can neighbouring sectors be assumed to be in the same cylinder across platters?

    Actually, I'm guessing it's the other way around.

    --
    A programmer is a machine for converting coffee into code.
  15. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  16. NTFS fragmentation. by caluml · · Score: 0, Troll

    Slashdot wouldn't be Slashdot without an un-backed-up dig at Microsoft, would it? Come on people, there's enough wrong with Microsoft that has evidence to back it up without cheap, snide shots like that.

    1. Re:NTFS fragmentation. by Anonymous Coward · · Score: 0

      You must be new here...

    2. Re:NTFS fragmentation. by caluml · · Score: 0, Troll

      No. Maybe just a little older and wiser than most of the kiddies on here.
      Do you know how stupid the community looks when chairmen of companies look at comments like that? There are slick suits from Microsoft, and dumb comments on Slashdot. Hmm. Hard choice, that.

    3. Re:NTFS fragmentation. by Anonymous Coward · · Score: 0

      I agree. Slashdot could possibly be the most anti-microsoft biased site on the planet. I love the news clips, but the fact that there is basically nothing ever positive said about any of Microsoft's ventures makes me say "Ugh".

      All I have to say is the computing world needs an operating system to be widespread, without it we are sent back to the dark ages of having to deal with "compatibility issues", which drive me nuts.

      I'm not here to say Microsoft is our savior, only that I believe they deserve more respect then they receive on this site. =(

    4. Re:NTFS fragmentation. by Pieroxy · · Score: 1

      Well, yes, then you must be new here. Because you are under the assumption that the Slashdot community takes itself more seriously than it does. The average slashdot poster doesn't care if a chairman will ever consider his post. They just post for the fun of it and that's all.

      Now if you don't like it, please move on.

    5. Re:NTFS fragmentation. by Anonymous Coward · · Score: 0

      you should be modded up sir... wise reply... thank you - and who the fsck in their right mind gives an cr4p about who is reading what before posting, otherwise we might have intellligent conversation? ;-)

    6. Re:NTFS fragmentation. by caluml · · Score: 1

      I am not suggesting that the Chairmen read Slashdot. But with all the little digs, and jabs at Microsoft, I'm sure it rubs off on to people working in IT at these companies, and just makes their pro-Open Source arguments sound religious.
      "But, Big Boss, we should move to Linux cos NTFS gets more fragmented than HFS."
      "Do you have any proof for this? Where did you read about it?"
      "Erm, no, but I'm sure it was well researched..."

    7. Re:NTFS fragmentation. by NDPTAL85 · · Score: 1, Flamebait

      Its not a cheap snide shot. Its common knowledge by now that NTFS is a fragmenting nightmare. Do not take your anger out on Slashdot because you are one of the last people to find this out.

      --
      Mac OS X and Windows XP working side by side to fight back the night.
    8. Re:NTFS fragmentation. by Jeremy+Erwin · · Score: 1

      "But, Big Boss, we should move to Linux cos NTFS gets more fragmented than HFS."
      Given that most linux machines use ext2/3 or perhaps ReiserFS, that particular argument doesn't make much sense. HFS+ is primarily a MacOS system.

    9. Re:NTFS fragmentation. by dave+at+hostwerks · · Score: 1

      My personal favorite is irregardless. Look that one up at dictionary.org.

      --
      d a v e
      "Hmmm...upgrades."
  17. Re:Give it a rest by marktoml · · Score: 3, Insightful

    Agreed and the fragmentation on NTFS can have subtle effects (such as fragmenting the MFT) that are NOT easily fixed by simply running a defragmentation tool.

  18. Re:Anonymous by operagost · · Score: 2, Interesting

    NTFS is a modern journaling filesystem. There is no reason for concern while using it over other journaling file systems.

    --

    Gamingmuseum.com: Give your 3D accelerator a rest.
  19. Re:Anonymous by Malc · · Score: 1

    Wouldn't that imply then that defragmenting might degrade performance, or at best make little difference? To be honest, I stopped defragging years ago it never seemed to make enough noticable difference to me.

  20. that's not a good measurement... by Chuck+Bucket · · Score: 5, Funny

    it's not how fragmented your disk is, it's what you can do with your fragmented disk that counts.

    CVB

  21. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  22. Panther Defrag by stang7423 · · Score: 5, Interesting

    I'm sure someone else will point this out as well but its worth noting. In 10.3 there is kernel level defragmentation. When a file is accessed the kernel checks to see if its fragmented, then moves it to a area of the disk where it can exist unfragmented. I think there is a limitation to file size under 20MB but it may be higher. This still gets rid of a great deal of fragmenation. Just food for thought.

    1. Re:Panther Defrag by Anonymous Coward · · Score: 0

      kernel level defrag?

      That requires the kernel contain all filesystem drivers directly doesn't it?

      I assume this approach is incompatible with dynamic filesystem drivers, and that you recompile your kernel to add or change any filesystem driver code?

    2. Re:Panther Defrag by aristotle-dude · · Score: 2, Informative

      Have you heard of kernel extensions aka kernel modules? Drivers on OSX end with a .kext which denotes a kernel extension.

      --
      Jesus was a compassionate social conservative who called individuals to sin no more.
    3. Re:Panther Defrag by Anonymous Coward · · Score: 0

      Yeah, cause we ALL recompile our Panther kernels weekly...

  23. HPFS by gmuslera · · Score: 2, Interesting
    When i had OS/2, i enjoyed the low hpfs fragmentation. When you copy a file it gives to it the next free block that fit in that size, as long you have a big enough free chunk of the disk, the file were not fragmentated. But also it unfragmented when more operations where done with the directory or the file system. I remember that a basic "unfragment" script was to go thru all directories and just copy or even rename the files to unfragment them.

    But not sure how this are managed in linux filesystems, not just ext2/3 and reiserfs, but also in xfs and jfs.

  24. Looks like I have a problem... by spankalee · · Score: 1
    aiee, here's my output:

    btreeReadNode(105): diff = 2048, this should *NEVER* have happened!
    initSpecialFile(202): failed to retrieve extents for the Catalog file.
    hfsdebug: failed to access the Catalog File.

    I can't find any info about this on the site. Is anyone else getting this error?

    1. Re:Looks like I have a problem... by Anonymous Coward · · Score: 0

      I'm getting it too, though my 'diff ' is 3072. I did just try rebooting and doing a /sbin/fsck -fy and it didn't find any errors. Next step is to take the iBook home and try DiskWarrior session.

    2. Re:Looks like I have a problem... by Tokerat · · Score: 1


      I'm no expert, but it looks like your B-Tree is corrupted, and this could possibly be a MAJOR problem, and it could also lead to some major problems later on. Run Norton or DiskWarrior or something, and do it soon. Even Disk Utility should be able to repair the volume.

      --
      CAn'T CompreHend SARcaSm?
    3. Re:Looks like I have a problem... by and+by · · Score: 1

      Read the notice at the bottom of the download page for hfsdebug. Apparently, that's a common error and there's a fix in the works.

    4. Re:Looks like I have a problem... by Anonymous Coward · · Score: 0

      Better than my results - I found out what the nifty multi-lingual kernel panic screen looks like (upon trying hfsdebug -f).

  25. ReiserFS and fragmentation by chrysalis · · Score: 1, Interesting

    Recent 2.6-mm kernels contains Chris Mason's work in order to dramatically reduce the fragmentation of ReiserFS filesystems.

    It's really good on filesystems with a lot of files or on databases.

    --
    {{.sig}}
    1. Re:ReiserFS and fragmentation by Anonymous Coward · · Score: 1, Interesting

      It's a crock and evenyone knows it. It was only put into the kernel to make him stop his whining. Only a fool uses reiserfs for a thing other than a freak show. A fool and his data are soon parted.

    2. Re:ReiserFS and fragmentation by Bombcar · · Score: 2, Funny

      parted? I thought that was only used to fiddle with FAT...

      Parted

    3. Re:ReiserFS and fragmentation by Anonymous Coward · · Score: 0

      "(Score;1, Interesting)"??

      A moderator and his points are soon parted.

  26. Who even cares about Fragmentation anymore? by greymond · · Score: 4, Interesting

    Seriously, with NTFS and HFS+ I see very little fragmentation on both my Wintel and Apple machines.

    Both have 40gig HD's and both have applications installed/uninstalled quite often. My PC feels the worst of this as he gets games installed and uninstalled in addition to the apps.

    For example the last time I reinstalled either of these machines was back in january(new year fresh install) and since then my pc has felt the install/uninstal of various games usually ranging from 2-5 gigs each. The Apple has been installed and with the exception of updates, plugins, video codecs and basic small apps that get added/upgraded often has done alright.

    Right now Norton System Works on my PC is saying the drive is 4% fragmented. Disk Warrior on my Apple is saying the drive is 2% fragmented.

    Conclusion: Fragmentation is no longer an issue for the HOME USER(note how i'm not saying your companies network doesn't need to be concerned), unless there still running a FAT32 partition >. which well they deserve to have there computer explode at that point anyway.

    1. Re:Who even cares about Fragmentation anymore? by Anonymous Coward · · Score: 0

      You are right, NTFS and HFS+ are good enough to make this a non-issue for the home user...almost. Installing and removing programs is not the worst culprit in creating fragmented files anymore. If joe-the-average-home-user uses P2P software, chances are they will end up with extremely fragmented files. Some applications try to handle that problem, most don't. I can remember looking on my disk and finding downloads with 700+ fragments on an NTFS disk.

    2. Re:Who even cares about Fragmentation anymore? by Anonymous Coward · · Score: 0

      It depends entirely on your usage patterns. If you use for example BitTorrent a lot or other P2P software, and especially if you use several at the same time, the fragmentation can be massive. Let's see.. I last defragmented about two months ago, the total fragmentation on my various drives is now averaging at 40% and file fragmentation is over 60%. No point in defragmenting though since the disk usage rate is over 95% on 250GB.

      That's on NTFS with an average download of about a GB a day. Not your Average Joe's usage model, but certainly a lot of Slashdotters fit the profile.

    3. Re:Who even cares about Fragmentation anymore? by Trillan · · Score: 1

      My NTFS drive is at 8% after 6 months. When do you think it becomes a problem?

    4. Re:Who even cares about Fragmentation anymore? by Halo1 · · Score: 1
      Disk Warrior on my Apple is saying the drive is 2%
      DiskWarrior only tells you about B-Tree items that are out of order, it doesn't measure file fragmentation.
      --
      Donate free food here
  27. Other FSs by ManikSurtani · · Score: 1

    Has anyone got a similar prog to measure fragmentation for reiserfs, ext2/ext3, and NTFS? And, what the heck, FAT32 as well? Could be very useful...

    --
    -- Manik Surtani
    1. Re:Other FSs by chrwei · · Score: 1

      ntfs: point, click, drool.
      ext2/3: fsck, the little report at the end tells you but it's not detailed
      reiserfs: [waves hand] this is not the fragmentation you are looking for

      --
      - Disclaimer: Information in this post deemed reliable but not guaranteed.
  28. Bzzt! Nope. Close, though! by danaris · · Score: 3, Informative

    That's not quite correct. In Panther (Mac OS X 10.3, for the uninitiated), journaling is enabled by default: that is, when you first install Panther, it will add journaling to your existing HFS+ disk, and if you're reformatting, it will default to HFS+ (Journaled). However, prior to Panther, there was no journaling support in HFS+, to my knowledge.

    Dan Aris

    --
    Fun. Free. Online. RPG. BattleMaster.
  29. Re:Anonymous by EsbenMoseHansen · · Score: 3, Insightful

    The main problem with fragmentation is cache-faults. The disk drives assume that you will be reading the following sector;: when you don't, you'll have to wait for the sector you requested to be brought in from disk. This applies even in the face of the tricks you mention.

    --
    Religion is regarded by the common people as true, by the wise as false, and by rulers as useful.
  30. Centrifugal Force by Prince+Vegeta+SSJ4 · · Score: 5, Funny

    I just put my hard drive in my drier when it is fragmented. Since the group of unfragmented bits weighs more than the fragmented ones, The spinning action causes all of those stray bits to attach to the greater mass.

    1. Re:Centrifugal Force by jameskojiro · · Score: 0

      Yeah, well I pull out the platters and Iron them on an Irony board.

      --
      Tsukasa: All I really want, is to be left alone...
    2. Re:Centrifugal Force by gmaestro · · Score: 1

      Ugh, you peasant. Those bits are reshuffled by centripetal force. Centrifugal force is a myth put forth by the religious right.

  31. Unsupported diss, unsupported support by ls-lta · · Score: 1

    Describe, then the automatic capabilities of WinXP's implementation NTFS 5.1. What happens when you run a third party defrag tool, how often do you run it?

    Mind you, I might fall into some special category of people who don't fall victim to fragmentation for some reason.

    Why? How do you use your system?

    1. Re:Unsupported diss, unsupported support by W2k · · Score: 1

      I don't think I understand you. I don't use a third party defrag tool, I use the one Microsoft provides, and it works fine. I don't know how NTFS works internally to prevent defragmentation, clearly it does something, because (as everyone with a clue will likely already know) NTFS deals with fragmentation far better than many other file systems, most notably FAT.

      As for my "special category" remark, I was merely proactively defending against the massive amounts of "NTFS sucks, my drive is fragmented to death"-themed replies I was expecting. After all, it would be naive of me to assume that just because NTFS works for me, it automatically works for everyone else. There's no good explanation for this, but the easiest way to explain it is that I am simply somehow special and that's why it works for me. :)

      --
      Quality, performance, value; you get only two, and you don't always get to pick.
    2. Re:Unsupported diss, unsupported support by cft_128 · · Score: 1
      NTFS deals with fragmentation far better than many other file systems, most notably FAT

      That is like saying "My car performs notably better than many other cars, notably the Yugo". We should be comparing it to real filesystems, like ext2/3, ReiserFS, HSF+, XFS, UFS and JFS (not meant to be exhaustive).

      --

      Underloved Movies and Pub Quiz: donotquestionme.org

    3. Re:Unsupported diss, unsupported support by W2k · · Score: 1

      How exactly is FAT not a "real" file system? It's still very widely in use, particularly on devices smaller than 2 GB (digital cameras come to mind). It's still useful because it's so simple, well-known, and easy to implement. That makes it real enough to be "real" to most people with a clue.

      My comparison between NTFS and FAT is valid because if you are running Windows, those are the only two filesystems you have to choose between. Comparing NTFS with, for instance, ReiserFS is not really interesting because they're not really alternatives to each other. Unless you choose your operating system based on what filesystems it supports...

      --
      Quality, performance, value; you get only two, and you don't always get to pick.
    4. Re:Unsupported diss, unsupported support by cft_128 · · Score: 2, Insightful
      How exactly is FAT not a "real" file system? It's still very widely in use, particularly on devices smaller than 2 GB (digital cameras come to mind). It's still useful because it's so simple, well-known, and easy to implement. That makes it real enough to be "real" to most people with a clue.

      OK, I was being a bit snobbish in saying it is not a 'real filesystem', it does have its uses - small devices, floppies, etc. BUT, even when it was originally designed it was considered primitive it had many known flaws, among those: it is very easily fragmented (what we are all talking about, no redundancy to help recover from failure and wastes quite a bit of disk space.

      My comparison between NTFS and FAT is valid because if you are running Windows, those are the only two filesystems you have to choose between. Comparing NTFS with, for instance, ReiserFS is not really interesting because they're not really alternatives to each other. Unless you choose your operating system based on what filesystems it supports...

      The article was comparing HFS+ to NTFS, not windows filesystems. You your self said NTFS deals with fragmentation far better than many other file systems, most notably FAT (emphasis mine) which implies you were not only comparing NTFS to other windows file systems but to many other filesystems. It was the apparent straw man argument that I was pointing out. NTFS is leaps and bounds better than FAT, I 100% agree with you on that. It could be better, and I wish it was open source (last I checked it was not) but is still the best option window users have.

      --

      Underloved Movies and Pub Quiz: donotquestionme.org

  32. Re:HFS Filesystem vs. ReiserFS (apple bug) by funkdid · · Score: 1, Informative

    You are the victim of the "click of death" this is a very well documented HD defect (not an FS defect). Tell Apple about it, or go to an Apple store. They will replace your HD free of charge.

    --

    I boycott signatures

  33. Defrag = placebo? by justforaday · · Score: 3, Interesting

    I've often wondered if defragging and defrag utils are more of a placebo for people concernced with system performance. In my experience I've never noticed any perceivable difference after using a defrag util, on either OS8/9, OSX, 95, 98SE or XP. Then again, I've always made sure to have plenty of free space on my disks [and made sure they were fast enough] whenever I've done anything seriously disk intensive like multitrack audio...

    --
    I'll turn into a supernova and burn up everything. Well I'll turn into a black little hole and you'll turn into string.
    1. Re:Defrag = placebo? by Greyfox · · Score: 5, Interesting
      It shouldn't really be an issue post-FAT. I think most people's obsesison with fragementation are a remnant of having to defragment FAT drives regularly. One did it superstitiously in those days because an overly fragmented filesystem did slow down considerably. No modern filesystem has an excuse for not handling fragmentation with no interference from the user.

      As a cute side note, I remember having to explain fragmentation to my high school FORTRAN class and teacher back in the '80's. I'd changed schools in my senior year and the new school had just started using the Apple II FORTRAN environment, which happened to be the same as the Aple II Pascal environment that I'd used at the previous school. The file system was incapable of slapping files into whatever blocks happened to be available (I'm not even sure it used blocks. Probably not...) so you would not be able to save your files if it was too fragmented, even if there was enough space available to do so. Ah those were the days...

      --

      I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

    2. Re:Defrag = placebo? by Anonymous Coward · · Score: 0

      Of course it is a placebo. A fragmentation percentage is a useless measure, unless someone can show me the connection between it and disk operation time. And IF the connection exists, the penalty is probably of the order of milliseconds. Unnoticable.

      People spend more time worrying about disk fragmentation than the time they lose because of disk fragmentation.

    3. Re:Defrag = placebo? by ThomaMelas · · Score: 1

      It's going to depend on how often you defrag and how much reading/writing you do to the drive. I used defrag monthly on my machine and saw little effect. My wife let hers go for about a year and a half without a defrag and she noticed a large differance. I've had clients that let it go for a few years and they noticed a huge differance. It's one of those things that creeps up slowly and regular maintance can prevent. Now all of those were on FAT32/16 drives. NTFS seems a bit more robust.

    4. Re:Defrag = placebo? by hey! · · Score: 1

      It's not placebo in some cases. I have had dramatic (and audible) differences after defragging on my laptop using Win2K professional. I've had system crawling and making sounds like somebody was dropping ball bearings on the platters, then get resurrected after a defrag.

      The dramatic impact may be from the limitations of the particular HD I have in the laptop (an IBM T30). I've heard that modern desktop IDE HDs handle fragmentated filesystems much better. I wouldn't know because all the users in my company have Windows laptops, and all the servers are either Linux or Windows on SCSI HDs.

      Another key with NTFS is that it works pretty well if the filesystem is kept less than 80% full. The rate of fragmentation seems to get exponentially worse so that if I run the FS at 90%, weekly defrags are called for. Pruning my files to get back into 75% range seems to make this.

      A few tips:
      If your user preferences files get fragmented, you have to defrag as a different user.

      If your page file gets fragmented, you're screwed; it can't be defragged because it is always in use. There are commercial utilities which will defrag on startup, which is the only possible fix other than reinstalling.It would be smart to preallocate a fairly generous page file size to avoid this problem.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    5. Re:Defrag = placebo? by Woody77 · · Score: 2, Insightful

      I'm a software developer (C++, mostly msdev). As such, I recompile a LOT. With a drive dedicated to mostly source and intermediate files, about 6GB of a 9GB drive, it regularly fragments itself into molasses. It normally takes a while, but it happens. The continual replacement of files just dries NTFS up a wall. This is using both win2k and xp. I end up needed to defrag about once a month.

      The problem really rears it's head once the space between the files isn't big enough for the new files, and then things start getting fragmented in a hurry.

      And does it make a difference? In disk-intensive things like compiling (lots of small modules that get compiled into big binaries/debug symbol files), it really has an impact. The more the heads have to move around, the slower it all gets.

      I also use lots of partitions to isolate things, so that even as it fragments, the fragments don't get too far apart. However, if you do a lot of swapping to disk, the partitions will kill you, unless the swap is on the same partition as where you're working. So I tend to foist the swap off on another drive entirely (all SCSI) so that the seeking is reduced as much as possible.

      Placebo? probably is for most people that aren't continually writing/rewriting to disk. But if you're constantly reading/writing/erasing files, it is useful.

      Now if I could just figure out a way to safely split up my root filesystem on linux to keep the heavily used trees separate from the not-so-heavily used ones (performance experiment). Mainly my /var/tmp/*, which gets used heavily for compiling (gentoo and portage).

    6. Re:Defrag = placebo? by dustman · · Score: 1

      And IF the connection exists, the penalty is probably of the order of milliseconds. Unnoticable.

      Correct, Incorrect.

      The seek time of a drive is measured in milliseconds. The speed of doing I/O is typically dominated by the seek time, rather than the throughput rate.

      Consider an average eide hard drive: 10ms seek rate, ata100 interface.

      If you need to save a 100kb file, it will take 10ms (1/100th of a second) to seek to the first block, and then, assuming everything is perfect, it will take 100MB/sec / 100kb = 1/1000th of a second to write the file... so, seeking to the start of the file took 10 times as long as writing it!

      If your file is fragmented, then it will require multiple seeks when it needs to jump to a new block.

      Of course, there will be overhead from OS and such, and cache on the drives/controllers themselves, which would alleviate the numbers here a little bit... But consider that most files on your filesystem are smaller than 100kb, and the numbers would get much worse.

      So, keeping files unfragmented is very necessary to filesystem performance.

      Whether or not you need to "manually" defragment any more is a different issue. The OS's we use are pretty good at it.

      My winxp system is probably a pathological case. I have less than 2% free space on my C drive, mostly because of Office and some other programs that "need" to be on the C drive (or at least, put a ton of stuff there).

      And, NTFS is anecdotally relatively good at maintaining a fragment-free FS, until your disk starts filling up, then it's very bad.

      Anyway, I'm very full, and I just used the defrag tool to see the state of my system. I recently downloaded the newest half-life 2 movie from E3. It is 700MB, and my drive has 400MB currently free (after grabbing that over)...

      The defrag tool says the file has 10,907 fragments...

      So, using the numbers I said earlier, it would take 7 seconds at 100MB/sec to read the actual data. But, it will take 10.9 seconds to seek through the fragmented file... And this is on a very large file...

      (Admittedly, that's a pathological case, caused by me using up almost all the remaining space on my drive with one very large file)

    7. Re:Defrag = placebo? by jimfrost · · Score: 1
      You may find that the fact that fragmentation doesn't seem to be so bad these days, on Windows systems at least, is that they're doing extensive caching and pre-reading of disk blocks. If there were a way to tune down the size of the filesystem cache to mid-1980s levels (say, 8k :-) you'd be a little more cognizant of it. I dunno about you, but my Windows systems tend to have a couple hundred megabytes of filesystem cache ... enough to hide a lot of sins. Use a "constrained" XP system with like 128M (it bugs me that that's now considered small) and ho boy will you feel it.

      --
      jim frost
      jimf@frostbytes.com
    8. Re:Defrag = placebo? by chrwei · · Score: 1

      I'm guessing you're one of those poeple that can't tell when one of the tires on your car is so flat that the rim is almost on the ground either.

      --
      - Disclaimer: Information in this post deemed reliable but not guaranteed.
    9. Re:Defrag = placebo? by jimfrost · · Score: 2, Informative
      Consider an average eide hard drive: 10ms seek rate, ata100 interface.

      If you need to save a 100kb file, it will take 10ms (1/100th of a second) to seek to the first block, and then, assuming everything is perfect, it will take 100MB/sec / 100kb = 1/1000th of a second to write the file... so, seeking to the start of the file took 10 times as long as writing it!

      This gross simplification actually trivializes the real effect. The 10ms seek figure is an average track-to-track seek delay between adjacent tracks. The farther apart the tracks are the longer a seek takes (it's more or less linear although there is a per-seek overhead). You also don't deal with the fact that you're going to have to perform seeks on larger files no matter what.

      I note that there is a similar latency issue with head switches.

      There is a big difference between the delay necessary to pull a sector off of a track adjacent to where the heads currently are and one 1000 tracks away -- the delay can be an appreciable fraction of a second just for that single seek.

      The problem with simplistic filesystem block allocators is they do not weight their block allocations according to seek time. Usually they just pick whatever's first in the free list. This results, over time, to random block placement and therefore seek times that will on average approach 50% of worst case. I'd have to look closely to give a good figure with today's drives, but order-of-magnitude degredation is certainly possible. What you would prefer is blocks placed such that they're within a few percent of best case if at all possible.

      This is not hard to do, and to my knowledge BSD FFS was the first to attempt it -- and it was wildly successful at it.

      As an aside, I've never seen a fragmentation analysis program that took noncontiguous-but-well-placed into account. It's entirely possible to create a block layout that those programs think is awful that is within 90% of optimum. I think, actually, that BSD FFS would typically show up that way although I never investigated.

      I also note that smart block allocation makes a defragmenter's job a heck of a lot easier.

      --
      jim frost
      jimf@frostbytes.com
    10. Re:Defrag = placebo? by MyHair · · Score: 2, Informative
      It shouldn't really be an issue post-FAT. I think most people's obsesison with fragementation are a remnant of having to defragment FAT drives regularly. One did it superstitiously in those days because an overly fragmented filesystem did slow down considerably. No modern filesystem has an excuse for not handling fragmentation with no interference from the user.

      Head seek and rotational latency is still much slower than contiguous blocks. True, modern systems deal with it better, partially due to b-tree and other file indexing strategies and partially due to having plenty of RAM for metadata caching and predictive caching. But fragmentation is still a major issue for me on multiuser Windows PCs and periodic disk cleanup and defragmentation is necessary for reasonable operation speed.

      <MS gripe>
      In particular, the hidden "Content.IE5" cache of IE on 20-100 user PCs fills up hard drives in a big hurry, and I haven't found a way of controlling this except for periodically deleting with the following batch file I made for Win2k. (Limiting the cache size doesn't seem to affect these files.)
      @echo off
      echo.
      echo ***** WARNING!!!!! This will wipe out
      echo ***** C:\Documents and Settings\*\Local Settings\Temporary Internet Files contents.
      echo ***** Press Control-C to abort or any other key to delete all temp files.
      echo.
      pause
      for /D %%x in (c:\"Documents and Settings"\*) do rd /s /q "%%x\Local Settings\Temporary Internet Files\Content.ie5"
      This needs to be done preventatively, though. In addition to fragmenting data, 20-100 user PCs with large numbes of files (and Content.IE5 is my killer in my situation) fill up the MFT and then fragment it, and once you get the MFT fragmented you're basically screwed.
      </MS gripe>

      Admittedly the biggest problem PCs have disks less than 12G and I don't have as much of a problem with 20G+ systems. But have you ever run defrag after a clean install, even with an enormous hard drive? You'd think it could at least install itself without severe fragmentation. Oh well.
    11. Re:Defrag = placebo? by Anonymous Coward · · Score: 0

      It shouldn't really be an issue post-FAT. I think most people's obsesison with fragementation are a remnant of having to defragment FAT drives regularly. One did it superstitiously in those days because an overly fragmented filesystem did slow down considerably.

      If you work with video files, you'll quickly learn the value of doing a defrag prior to attempting a capture. Or, as another poster pointed out, working with lots of small files like source code.

      No modern filesystem has an excuse for not handling fragmentation with no interference from the user.

      Well, sadly, modern file systems like NTFS don't handle fragmentation well so user "interference" is required.

    12. Re:Defrag = placebo? by AaronD12 · · Score: 1
      I've often wondered if defragging and defrag utils are more of a placebo for people concernced with system performance.

      I couldn't agree more. For years now, I've recommended that people do not use DEFRAG on their systems -- even FAT systems. Why? Because DEFRAG does not defragment the FAT table. That makes it pretty much useless.

      Other applications, such as Norton Speed Disk (or OPTUNE for the DOS/Windows 3.x/FAT16 users out there), defragment the FAT table and the files, making caching a lot more efficient.

    13. Re:Defrag = placebo? by TrashGod · · Score: 1

      ...the Apple II Pascal environment...was incapable of slapping files into whatever blocks happened to be available. I'm not even sure it used blocks.

      The Apple II Pascal environment was based on the UCSD p-System. Disks were indeed block structured devices, and all files were contiguous. The algorithm for allocating a new file was to take half of the largest unused space or all of the second largest unused space, whichever was larger. The built in disk utility had a "Krunch" command that sqeezed the unused blocks into a contiguous chunk.

      It was murder on a floppy, but big fun to watch on a hard drive:-)

    14. Re:Defrag = placebo? by Greyfox · · Score: 1
      Now that's actually cool. How on earth do you 1) find out about that to begin with and 2) remember it after all these years? Or are you still using it now?

      For my senior project I wrote a Pascal graphing program using turtle graphics. It was able to do bar graphs and line graphs with point labels. I had pie graphs in the spec but had to remove them due to space limitations. I was so hard up for memory that I had to swap the keyboard routines to floppy. Ouch. It was fun, though :-)

      --

      I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

    15. Re:Defrag = placebo? by TrashGod · · Score: 1

      The algorithm was documented in the manual. I had written firmware for a SASI/SCSI disk controller; the Krunch (defrag) command was a provocative test/demo. I still get a kick out of watching the progress of a defrag utility, even if it's a bit of a placebo:-)

  34. Re:Anonymous by Malc · · Score: 1

    The cache on the disk, or the system cache operated by the OS? My system cache (NT5) is currently at 255MB so cache misses aren't a big deal for most operations. Searching through all the files on a disk, or perhaps even burning CDs or DVDs flushes the cache and it's only then that I start seeing a temporary system performance degredation. If you're referring to the small cache on the hard drive, then do we really know what algorithm it uses?

  35. Your racist comments... by Anonymous Coward · · Score: 0

    were entirely devoid of glowing praise for all things Apple. Amen.

    I trust you will not be so reckless in the future. YOU HAVE BEEN WARNED!

  36. Disk Fragmentation by List+of+FAILURES · · Score: 5, Insightful

    A lot of people simply equate disk fragmentation with slow application execution and opening of data files. While this is the most visible effect that fragmentation has on a system, it's not the only one. If you are dealing with large files (multi track audio, video, databases) then you will get a different kind of performance hit due to the non-contiguous nature of the free space you are writing to. If you want to capture video with no dropouts, you really want a drive that has all of it's free space basically in one location. This allows you to write those large files with no physical disruption in location. Please do not think that the only benefit to unfragmented space is just "my programs launch faster". If you do any real kind of work on your system with large data files, you should know that a defragmented drive is a godsend.

    1. Re:Disk Fragmentation by mobby_6kl · · Score: 1

      also, data recovery should be easier and more sucessful on less fragmented disks.
      So if a part of disk is damaged, only few files would be lost, but if the same space continued parts of many different files, those files would most probably be lost.

    2. Re:Disk Fragmentation by flaming-opus · · Score: 1

      This is two forms of the same problem. Most people here have been talking about a fragmented file, which slows access to an existing file. You're talking about fragmented free-space which slows creation of a new file (or new data to an existing file). The problem with fragmentation avoidance schemes, is that they tend to fix file fragmentation at the expense of free-space fragmentation.

      For most users that's a good trade-off, as reads tend to dominate writes by a factor of 5.

    3. Re:Disk Fragmentation by crisco · · Score: 1

      So true, I was just using a consumer grade capture card to grab some shots off a VHS tape on my buddy's P4 2.4 GHz running XP. With his disk very nearly full it was dropping roughly 10 frames/sec. Cleaning some stuff off it didn't help a bit. After a defrag capture ran beautifully, both uncompressed and compressing to mpeg4 realtime, no dropped frames over the 30 second spot.

      --

      Bleh!

  37. Re:HFS Filesystem vs. ReiserFS (apple bug) by dTaylorSingletary · · Score: 1

    I know the drive is hosed. But no data ever actually seems to get corrupt. For the past year I've moved stuff on and off and never have seen any major problems with the data itself, and thus to be safe I never put anything really important.

    HD replacement: will they do this for free even if you aren't an Applecare customer? My warranty ran out about a year before this problem began.

    --
    d. Taylor Singletary,
    reality technician techra.el
  38. sysinternals.com by FatSean · · Score: 2, Insightful

    I have a program from there that at startup will check the MFT, swapfiles and other important files and will make each one contiguous collection of disk blocks. Gotta be done then, as you can't lock them once Windows is completely up.

    --
    Blar.
  39. XP users don't defrag? by funkdid · · Score: 0

    I'm on a WinXP PC day 15 after install (NTFS). This PC has been used for web surfing/e-mail only. -No downloads -No Multimedia content According to the Windows Disk Defragmenter: "You should Defragment this Volume" upon closer inspection: "Total Fragmentation = 12%" "File Fragmentation = 24%" It is 85% free space. Hmmmmmm. Any explanations?

    --

    I boycott signatures

    1. Re:XP users don't defrag? by mrchaotica · · Score: 1

      becha it's all browser cache and temporary files, and malware

      --

      "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

    2. Re:XP users don't defrag? by Anonymous Coward · · Score: 1, Insightful

      windows is fragmented upon install.

      windows install process is a frigging mess copying thing to the drive, uncompressing thenm, then deleteing them... plus other really stupid way's of installing and setting the whole system up.

      if you want to increase your fragmentation to 50% install office 2003... that app will thrash the disks for a good 10 minutes during install...

    3. Re:XP users don't defrag? by Anonymous Coward · · Score: 0

      Hmmmmmm. Any explanations?

      The 250 gigs of pron you downloaded over the past 15 days.

    4. Re:XP users don't defrag? by funkdid · · Score: 0

      Nope using mozilla Firebird, all is cleared. Funny I guess it shows how little I know about fragmentation. I thought fragmentation occurred from creating/deleting files. My machine at home (XP Pro as well NTFS) is fragmented something awful. That I can see at I routinly will create / delete many 300 Meg plus files daily. It's this lame internet PC being so fragmented that surprised me.

      --

      I boycott signatures

  40. On-the-fly defragmentation for NTFS disks in WinNT by exwhyze · · Score: 3, Informative

    Buzzsaw and Dirms -- I admit, the site looks a little seedy, but I've used both of these programs on several machines for upwards of a year and they've done a superb job of keeping my NTFS disks defragmented.

  41. Re:Anonymous Moron by aichpvee · · Score: 0

    http://dictionary.reference.com/search?q=Anecdote

    anecdote n.

    1. A short account of an interesting or humorous incident.

    2. pl. anecdotes or anecdota (-dt) Secret or hitherto undivulged particulars of history or biography.

    --
    The Farewell Tour II
  42. How to determine fragmentation... by Calibax · · Score: 5, Funny

    This is a very arcane procedure in XP. I shall try to explain, but only a professional should attempt this.

    1. Right click on drive icon, select properties
    2. Select Tools tab and click on "Defragment Now"
    3. Click on "Analyze"
    4. When analysis finishes, click on "View Report"

    This shows two list windows, one containing general properties of the disk such as volume size, free space, total fragmentation, file fragmentation and free space fragmentation. The second list shows all fragmented files and how badly they are fragmented.

    1. Re:How to determine fragmentation... by spectecjr · · Score: 4, Insightful

      This is a very arcane procedure in XP. I shall try to explain, but only a professional should attempt this.

      1. Right click on drive icon, select properties
      2. Select Tools tab and click on "Defragment Now"
      3. Click on "Analyze"
      4. When analysis finishes, click on "View Report"

      This shows two list windows, one containing general properties of the disk such as volume size, free space, total fragmentation, file fragmentation and free space fragmentation. The second list shows all fragmented files and how badly they are fragmented.


      If you're not using the same tool to measure fragmentation on each OS, how do you know that they're using the same semantics to decide what a fragmented file is?

      IIRC, the Linux tools use a different metric to calculate fragmentation than the NT ones.

      --
      Coming soon - pyrogyra
    2. Re:How to determine fragmentation... by hey! · · Score: 1, Funny

      Damn you! There goes my job security.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    3. Re:How to determine fragmentation... by Anonymous Coward · · Score: 0

      Wait, wait, wait, wait, wait....

      You mean that in order to analyze my disk for fragmentation and build a report, but NOT defragment it, I have to click on a button called "DEFRAGMENT NOW"???

      And I thought clicking the Start button in order to shut down the machine was stupid. What idiots designed this user interface?

    4. Re:How to determine fragmentation... by twbecker · · Score: 1

      How many ways are there do define fragmented files? If I can read the file starting from the byte address of the first byte of the file sequentially all the way to the EOF, it isn't fragmented. Otherwise, every time I have to jump to a non-sequential byte address, that's another fragment. Am I missing something?

      --
      "The problem with internet quotations is that many are not genuine" -Abraham Lincoln
    5. Re:How to determine fragmentation... by Tim+C · · Score: 1

      No - you can also right click "My Computer", choose "Manage", choose "Disk Defragmenter", click "Analyze".

      I agree with you about the Start button thing, though...

    6. Re:How to determine fragmentation... by pantherace · · Score: 4, Informative
      Well, all modern operating systems handle it so that any program, except certain tools such as the defragmenter, which either look at it directly, or use a lower level call.

      NTFS is horrible. on a system installed less than a week ago, and a few programs (nwn, firefox, avg, itunes, aa, nvdvd, windows updates, and a couple more programs, it has 9.3GB used, and it is reported that it has "Total Fragmentation: 22%, File Fragmentation: 45%"

      So yes there are various methods of calculating file fragmentation. (2 I can think of: (# of files with fragments)/(total number of files) = 0 for a totally defragemented hd (& gives nice percentages) & (# of file fragments)/(total number of files) = 1 for a perfectly defragmented hd. or variations on those, and I haven't been able to find what calculations Windows, & e2fstools use, so I can't tell.

    7. Re:How to determine fragmentation... by megarich · · Score: 1

      On a related note, when you install a fresh new version of windows on a nice shiney new hard drive, you think there shouldn't be too much fragmentation should there? Well that's not the case. I've seen now after two installation of windows where virtually the whole drive is fragmented.......

    8. Re:How to determine fragmentation... by ProfessionalCookie · · Score: 3, Funny

      What's a "Right Click"?????

      -Faithful Macuser
      (ok I have a 3 button logitech)

    9. Re:How to determine fragmentation... by theguitarizt · · Score: 2, Funny

      the opposite of a wrong click.

    10. Re:How to determine fragmentation... by spectecjr · · Score: 3, Informative

      How many ways are there do define fragmented files? If I can read the file starting from the byte address of the first byte of the file sequentially all the way to the EOF, it isn't fragmented. Otherwise, every time I have to jump to a non-sequential byte address, that's another fragment. Am I missing something?

      As an example, look up the docs on ext2. Note that file fragments are not necessarily the same as fragmented files. Also note that people use the "file fragment" number as an indicator of how fragmented their ext2 partition is - which is wrong.

      --
      Coming soon - pyrogyra
    11. Re:How to determine fragmentation... by jerw134 · · Score: 1

      What's a "Macuser"?????

      -Faithful Windows user
      (ok I have a Mac, too)

    12. Re:How to determine fragmentation... by swilver · · Score: 3, Interesting
      I've managed to get my download drive (NTFS) so fragmented that the defrag tool in Win2k/XP is unable to defragment it, no matter how often you run it.

      The files on the drive had an average size of 200 MB, were downloaded in 1kB increments several files at a time over a period of a week on average per file.

      The reason for it failing on defraging (it doesn't say it fails, it just doesn't do much and stops after a while) is because the free space was also so badly fragmented that it couldn't even defragment a single file (it expects there is free space in a single chunk large enough to defragment one file... which is hard since the files are all quite large). The worst fragmented files had all well over 5000 fragments, and none less than 100 orso.

      Even after making more than 50% space free on the drive, it was still suffering from fragmented free space and refused to defrag. After a while I decided it was far easier to just copy the whole drive (30 GB) and copy it back... writing the 30 GB back was about 20-30 times faster compared to reading the drive for the initial copy...

      On a side note, I've put the exact same stress on a ext3fs disc, and it also fragmented very badly, despite claims that ext3fs doesn't need defragmentation "because it won't fragment your files much". If free space was also very fragmented, I cannot say, but I assume it was as deleting a very fragmented file would result in a very fragmented area of free space.

      --Swilver

    13. Re:How to determine fragmentation... by Tukla · · Score: 1

      A late, great magazine.

    14. Re:How to determine fragmentation... by bursch-X · · Score: 1

      Someone who accuses Mac users??

      --
      There are two rules for success:
      1. Never tell everything you know.
  43. Re:HFS Filesystem vs. ReiserFS (apple bug) by funkdid · · Score: 0

    Mmmm the key here would be that it is somewhere documented in their database. IE: You complained about HD noise at some point while you were under Applecare waranty (and they had a record of the complaint). You could always sign up now for Applecare, telling them that everything is working fine. Then luck have it, in a week or so, all of a sudden -the HD starts making noise!

    --

    I boycott signatures

  44. Re:Bzzt! Nope. Close, though! by Steveftoth · · Score: 4, Informative

    Jaguar (10.2) has journaled support as well, but you had to enable it as it was not a default option.

    Even in 10.3 it's optional, not required, but it's the new default for new disks. Probably because Apple decided that their code was solid enough to put into production. After testing it on 10.2 I agree with them.

  45. haha by VAXGeek · · Score: 0, Troll

    Is this the article that is supposed to make me feel better about not having defrag in OS X?

    --
    this sig limit is too small to put anything good h
  46. Im still impressed... by 222 · · Score: 1

    at how Microsoft still manages to convince everyone that fragmentation is "part of the computing experience".

    1. Re:Im still impressed... by 98jonesd · · Score: 0

      Did microsoft say that?
      Have you any proof they said that? ;-)

  47. Re:Bzzt! Nope. Close, though! by tenton · · Score: 1

    You could enable journalling on HFS+ drives in later versions of Jaguar. It wasn't on by default, though.

  48. I'm not one to nitpick... by IshanCaspian · · Score: 1

    I'm not one to nitpick, but for Pete's sake, couldn't you have done better than "un-backed-up"? That's just pathetic.... I don't even want to look at your posting history...you probably are one of those people who uses words like "funner," aren't you?

    --

    But there is another kind of evil that we must fear most... and that is the indifference of good men.
    1. Re:I'm not one to nitpick... by bestguruever · · Score: 1

      I used to get terribly aggravited when my grandparents nagged at me for using words like "funner". Now I'm on the other side of the coin with my girlfriend. Its even more aggravating because I can't say anything about it as she makes life much painfuller when I do stuff like correct her on her grammer.

      --
      if you think this is bad, you should have seen my last sig
  49. Apple updated their stand recently by djupedal · · Score: 4, Informative

    http://docs.info.apple.com/article.html?artnum=256 68

    Mac OS X: About Disk Optimization

    Do I need to optimize?

    You probably won't need to optimize at all if you use Mac OS X. Here's why:

  50. Don't confuse Fragments vs. Fragmentation by Anonymous Coward · · Score: 0

    BSD filesystems like UFS have a thing called fragments, which are like partial blocks. Fragments help keep the wasted space of partially used blocks to a minimum. This number is often reported by fsck.

    These kind of Fragments should not be confused with 'Fragmentation', which is when the blocks composing a file are spread all over the place.

  51. Re:Give it a rest by Mr_Silver · · Score: 1
    i believe the topic at hand is fragmentation, not how well it works as a filesystem. in that regard, FAT32 and NTFS do have horrible problems with fragmentation, while HFS+ defragments on the fly.

    Which means this isn't a valid test. If the OS did not defragment HFS+ on the fly then you would have a far better test to see which fragments better.

    So either you turn it off, or you check FAT32 and NTFS using an OS that defragments those on the fly too.

    The defragmentation-on-the-fly feature is skewing the results. Thats not to say that HFS+ wouldn't be better (after all isn't FAT32 and NTFS far older technology?), but the gap would be rather closer.

    --
    Avantslash - View Slashdot cleanly on your mobile phone.
  52. Re:Anonymous Moron by Anonymous Coward · · Score: 0

    [a. Fr. anecdote, or ad. its source, med.L. anecdota (see sense 1), a. Gr. things unpublished, f. priv. + - published, f. - to give out, publish: applied by Procopius to his ‘Unpublished Memoirs’ of the Emperor Justinian, which consisted chiefly of tales of the private life of the court; whence the application of the name to short stories or particulars.]

    2. a. The narrative of a detached incident, or of a single event, told as being in itself interesting or striking. (At first, an item of gossip.)

  53. Fragmentation is an issue? by Spoing · · Score: 1

    Except for FAT and similar ancient file systems, hasn't this been a dead issue for 10 or so years?

    --
    A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
    1. Re:Fragmentation is an issue? by Brandybuck · · Score: 1

      You don't use Windows, do you?

      Unfortunately, they make me use it at work. I just analyzed my "C:" drive. It has 31% file fragmentation. With half the hardrive not used, this is an absurd number. With UFS at home on FreeBSD, I have never seen fragmentations over 5%, even on the tmp and var partitions.

      --
      Don't blame me, I didn't vote for either of them!
    2. Re:Fragmentation is an issue? by Spoing · · Score: 1
      1. You don't use Windows, do you?

      Not unless I can't help it!

      1. Unfortunately, they make me use it at work.

      (Bill Clinton moment: "I feel your pain!".)

      1. I just analyzed my "C:" drive. It has 31% file fragmentation. With half the hardrive not used, this is an absurd number. With UFS at home on FreeBSD, I have never seen fragmentations over 5%, even on the tmp and var partitions.

      If it is Windows 98/ME/..., that's a shame.

      If it is Windows NT/2000/..., convert the disk to NTFS. From memory, I think the command is "convert /fs:ntfs c:" or some such, though I could be wrong. Requires one reboot and from 10 to 40 minutes of time for the conversion at boot time.

      --
      A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
  54. Re:Anonymous by 13Echo · · Score: 1

    Fragmentation problems are mostly something that has carried over from the MSDOS and Win9x days. FAT32 was problematic when it wrote data to the first available spot on the drive, and things got scattered about in a strange manner. NTFS and UNIX filesystems don't exhibit the same behaviors.

    It's pretty much a non-issue these days, as long as you can break away from the Windows9x mindset.

  55. Re:Anonymous by muck1969 · · Score: 3, Informative

    The most significant display I've ever seen for the benefits of defragmentation was on a 386 box that had Win 3.11 in 1992. The boot time was cut from two minutes down to 40 seconds and response was very noticeable. I didn't defrag due to any outside encouragement; I happened to find the utility in some drawer on a job site and gave it a try.

    Fragmentation is a performance killer for Win 9x on older machines ... presuming that Win 9x actually performs.

    --
    m.mmm..myyy ... sssissxxxtthh bbboottle offf mmmmmoouunnnttain ddeeewww.. in thhe pppassst ffffif
  56. Defragging XP now... by PhilHibbs · · Score: 2, Interesting

    My new laptop, with a 60GB 7200RPM disk, is under two months old, and I'm defragmenting it now. It's been running for 5 minutes, and is 3% complete, on a disk that is 62% full.

    20 minutes later, and it's on 17%. That's pretty damn fragmented, in my opinion.

    1. Re:Defragging XP now... by ewhac · · Score: 3, Insightful

      No, it's just that the defragger built-in to Win2K/XP is shite. Its runs like molasses in liquid helium, and it almost never does a complete job in a single run. You have to run it several times in a row before it's even close to doing a reasonable job. And if it's your system drive, then there are some files (including the swap file) that it simply won't touch no matter how badly the blocks are scattered. This can be a real pain in the posterior if you're trying to defrag a drive in preparation for a Linux install.

      Schwab

    2. Re:Defragging XP now... by Anonymous Coward · · Score: 0

      This can be a real pain in the posterior if you're trying to defrag a drive in preparation for a Linux install.

      That line really knocked me for a loop until I realized you must be referring to resizing the NTFS partition.

      How safe is that anyways?

    3. Re:Defragging XP now... by ewhac · · Score: 3, Informative
      How safe is [resizing an NTFS partition] anyways?

      With the latest versions of ntfsresize, fairly safe. I did it on a machine at work with very important data on it (yes, I backed it up first), and had no trouble at all. However, all ntfsresize can do is truncate an NTFS partition's free space. In other words, it won't relocate blocks to other free areas of the disk. So the most you can shrink it is by however much free space you have at the end of the partition. ((After Googling around a bit, I've learned that the most recent versions of ntfsresize will now move datablocks around, so apparently that restriction is now gone. I have not personally tested this, however.))

      Incidentally, ntfsresize is part of Knoppix, and gets run through QTPartEd, a partition editing tool. It is an older, non-relocating version, however.

      Schwab

  57. Defraggling is the Key by Random+Juxtaposition · · Score: 1

    There is a fairly comprehensive procedure for Defraggling your Motherdisc here. Good Luck!

    1. Re:Defraggling is the Key by DLWormwood · · Score: 1

      Wow. I didn't know my computer had a little "electric-one-eyed-nerd" in it! I better get a toothbrush to clean it! (-;

      --
      Those who complain about affect & effect on /. should be disemvoweled
  58. Re:HFS Filesystem vs. ReiserFS (apple bug) by bw5353 · · Score: 1

    I doubt that. They replaced mine, but that was only three days after the warranty ran out and after the entire harddisk had shuffled off this mortal coil. Every single byte was lost. (But luckily backed up beforehand.)

  59. Re:Anonymous Moron by simcop2387 · · Score: 1

    only if you are thinking they are part of the same syllybal(i can't spell today)

    anecdote ~= An Ek Dote

  60. my stats by MyDixieWrecked · · Score: 2, Interesting
    Out of 232167 non-zero data forks total, 231181 (99.58 %) have no fragmentation.
    Out of 6528 non-zero resource forks total, 6478 (99.23 %) have no fragmentation.

    Not bad. That's 8 months of heavy use since my last format.

    I gotta bring this to work today and see what that machine's like. My co-worker has been complaining that he doesn't have a defrag utility since he got OSX. I've been telling him that I don't think it matters. Now I can prove it to him.

    I remember back in the days of my Powermac 8100/80av, we would leave the 2 800mb drives defragging over the weekend because they had like 75% fragmentation.

    --



    ...spike
    Ewwwwww, coconut...
  61. Re:Anonymous by flynn_nrg · · Score: 3, Informative

    What are you talking about?

    Ext2/3 and reiserfs both have inbuilt defragmentation capabilities.

    No, they don't. But since they borrow their design from BSD's FFS they don't need it either.

    This can be seen, for instance, when you boot an ext2 system after an unclean shutdown and it checks the integrity of the filesystem. On journaled filesystems, the log is replayed. IBM's jfs also runs a modified fsck.

    Erm, that's fsck. fsck doesn't do defragmentation.

    In Linux, it's just not necessary (nor in any Unix derivative such as AIX or BSD that uses those filesystems).

    It's true, however performance is severely degraded when disk usage reaches around 90% for classic FFS-like filesystems. While the BSDs can mount ext2 partitions none of them uses ext[23] as default. AIX uses a JFS version that's a bit different from the one you see in Linux, which was based on OS/2's code. I think you're mixing up filesystem integrity with fragmentation. In classic BSD UFS/FFS data is stored in datablocks, which are partitioned in fragments, usually 1/4th of the datablock size. A fragmented file is a file that's stored in non-contiguous fragments. Just that. The performance impact of fragmented files vs the time needed to reorganize the data shows that it's not worth running a defrag program on FFS filesystems.

    This paper has some more info on the subject.

  62. Let me be the first to say: by Anonymous Coward · · Score: 0

    Straw man. HAND.

  63. Oh please. by warrax_666 · · Score: 2, Insightful
    Which means this isn't a valid test.

    It's a perfectly valid test -- it measures how much fragmentation can be observed after a certain amount of use. According to your logic we couldn't compare any properties of NTFS/ReiserFS/FAT32/HFS+ because they work differently.
    --
    HAND.
  64. Re:Defrag = placebo? - yes and no by NeedleSurfer · · Score: 4, Interesting

    Yes and no, it won't have any long time effect on your performance but there is a short time effect that can be usefull when dealing with audio. On a Mac, using a drive with block sizes of 64K to 256K (ideal when dealing with digital audio, as long as you set the buffer per track size of your daw to the same size as the blocks on your drive) you can gain up to 8 tracks by defraging your drive. Sometimes on large projects I have to record a file or playback the entire session in edit mode (no tracks frozen, everything real-time and not bounced), after editing for a while the daw refuses to play the project, lags, stutter or present some serious drop-outs, I defrag and this is where I get this 6-8 tracks headroom, but that will last only for a day of work and even then (Pro-Tools, Nuendo, Cubase, MOTU DP all present this caracteristic, as for the other I haven't tested them enough to provide meaningfull data).

    however, defraging is not the same for every defrag utility. For example, I was working with Avid Audiovision about 5-6 years ago on a TV show, it seems that defraging a drive hosting files created or edited with Audiovision with Speed Disk by Symantec would actually corrupt the entire projects contained on the drive (the biggest mistake and the only serious one I had in my career, I didn't loose my job but my boss did loose his temper, live and learn!), audio file were not readable at all after, it was actually a documented bug of Audiovision and I even think it was affecting every OMF files not just the ones used by Audiovision (not sure about this though), thats what happens when your boss won't let you RTFM. Only Disk Express, some Avid defrager or, later, Techtool could defrag those drives.

    On a side note, in the Classic mac (7-9.2), defragmenting your drive was also a way to prevent data corruption, actually its the other way around, not defraging would lead to data corruption. I don't know if its also the case with NTFS, EXT2 et al.

  65. I rarely see XP drives w/ bad fragmentation probs by Larry_Dillon · · Score: 4, Funny

    Mostly because they end up re-installing the OS every year or so!

    --
    Competition Good, Monopoly Bad.
  66. Typo: should be 18% by Trillan · · Score: 1

    Beg pardon, I meant 18% fragmentation. My question remains.

    1. Re:Typo: should be 18% by greymond · · Score: 1

      in my opinion, 12% and higher is probably when I notice the "Hay is my system running slow?" (Checks) (Defrags)

  67. Re:Anonymous by EsbenMoseHansen · · Score: 2, Informative

    The cache on the disk. And while we do not REALLY know, the described behaviour is a common and proven strategy. Remember that the disk does not have a lot of information to go by; it basically just sees request to read individual sectors. More or less.

    --
    Religion is regarded by the common people as true, by the wise as false, and by rulers as useful.
  68. Re:Anonymous by Anonymous Coward · · Score: 0

    Just ask anyone who deals with large video files. Fragmentation is a very real issue, unless you happen to like dropped frames.

  69. Great way to defrag by Anonymous Coward · · Score: 0

    A great way to defraggle your harddrive is described here:
    http://www.datadocktorn.nu/us_frag1.php

    It looks like it works both with Windows and Macintosh drives.

  70. portable fragmenter by harlows_monkeys · · Score: 2, Interesting
    Here's how you can write a portable fragmenter, if you need to get a disk very fragmented for testing.
    1. Create small files until you run out of disk space.
    2. Pick a few thousand of the small files at random, and delete them.
    3. Create a large file, large enough to fill the free space.
    4. Go back to #2, unless you are out of small files.
    5. Pick one of the large files, and delete it.

    Result: you have a bunch of large files, all very fragmented, and the free space is very fragmented.

  71. fragmentation and dimension by philge · · Score: 1

    fragmentaton is highly probable on essentially one dimentional datastorage system like a drive. If you had a two dimensional system it would be less likely. How many dimensions, I wonder would you need, to make it extremely unlikely. No I will not post pictures of my 4 dimensional harddrive ;-)

    1. Re:fragmentation and dimension by jimfrost · · Score: 2, Informative

      A drive is not one dimensional, it is three dimensional: Rotation, platter, track. It is this geometry that BSD FFS takes advantage of to avoid large fragmentation-related delays, since while there may only be one "optimal" sector to use there are quite a few that are "nearby" in terms of rotation, seek, or platter.

      --
      jim frost
      jimf@frostbytes.com
    2. Re:fragmentation and dimension by MarcQuadra · · Score: 1

      Please place the drive over on the kitchen table and wait five minutes for that program to become available.

      --
      "Sometimes, I think Trent just needs a cup of hot chocolate and a blankie." -Tori Amos on Nine Inch Nails
  72. Re:HFS Filesystem vs. ReiserFS (apple bug) by Anonymous Coward · · Score: 0

    But no data ever actually seems to get corrupt.

    Seriously, get a new drive. The most important thing on your entire computer is the data, if you have ANYTHING worthwhile on the computer it's worth it. If you can't afford a new drive, then consider backing up your data nearly every day. Bad enough that regular people aren't prepared when their drives crap out, but when you've been hearing the click of death and lose everything you'll be kicking yourself.

  73. Re:Anonymous by Anonymous Coward · · Score: 0

    RAID 0+1???

  74. fragmentation of Linux file systems by juan2074 · · Score: 1
    For more information about defragmentation on Linux file systems (especially ext2 and ext3), read the 'Defragmenting a disk' section of Resizing and defragmenting Linux filesystems.

    This article, Interview With the People Behind JFS, ReiserFS & XFS asks the developers directly about fragmentation. XFS, JFS, and ReiserFS are extent-based file systems, which keep fragmentation to a minimum.

  75. Re:I rarely see XP drives w/ bad fragmentation pro by Ziviyr · · Score: 1

    I dunno, somehow back when I used Windows. Just after installing and updating on a freshly formatted drive, I'd notice it was due for a defragging.

    --

    Someone set us up the bomb, so shine we are!
  76. It's the drive. Or cron. by solios · · Score: 1

    I've noticed that my home file server, work file server, and workstations go CLUNK and hughalhughalahughalahughala around four in the morning ("bedtime")- when cron runs by default. This causes iTunes and VLC to skip on a G4, and brought my fileserver to its KNEES. (nothing chungs like an SCA drive! :D)

    It's a unix. It has timed jobs that optimize the system. My powerbook ran like ASS until I left the thing on and running for 24 hours, after which it seemed to get its act together.

  77. Write your own defragmentation tool? by multiOSfreak · · Score: 2, Funny
    from the article:

    If you are really bent upon defragmenting your HFS+ volume, a more appropriate way would be to write your own defragmentation tool.


    Does anyone else think that statement is a bit odd? Maybe it's just me, but I think he's being a little bit presumptuous about the programming skills of the average geek site browser.

  78. Re:Anonymous by kryps · · Score: 1

    BTW: XFS has a online defragmentation tool which iteratively deframents the most fragmented file.

    See man xfs_fsr for details.

    -- kryps

  79. Not Exciting by Anonymous Coward · · Score: 0

    As far as disk optimizations go, defragmenting is the dumbest, least interesting thing you can do. In fact, if you don't have a defrag utility for your FS, just copy all of your stuff somewhere else (disk/tape/network) and copy it back. Tada. Unfortunetly, it is still useful for most of the filesystems today.

    Defragmenting is stupid because it only works on the file level. And only helps in situations where files are read entirely in sequence. This usually tends to be media files and config files.

    Executables, shared libraries are usually mapped into memory, and only read from disk when needed. Database files are rarely read sequentually.

    What you actually need to do is to FRAGMENT your FS. Analyze what blocks are most commonly used, and bunch blocks together that are used at similar times. This would bunch all of your startup executables/scripts together on the disk. And, when you execute openoffice.org, only the most often used parts of the executable are cached/ loaded.

    Ideally you wouldn't see your harddrive thrash when booting, or starting OO, but this is something that a standard defrag won't help.

    Programs that have a lot of data files will need to seek to each file. This is why a defrag at the file level is not always helpful.

    1. Re:Not Exciting by Anonymous Coward · · Score: 0

      I never really understood why people got excited about defragging their hard drives. It always sounds like they are "working" on something, or have accomplished something.

      "Yeah, I'd get to work on that document, but right now I am currently busy defragging my hard drive."

      "Yesterday I defragged my hard drive."

      Good job! That will increase your productivity by 100% today!

    2. Re:Not Exciting by greck · · Score: 2, Informative

      Ideally you wouldn't see your harddrive thrash when booting...

      actually, Darwin/OS X has a really nifty feature called BootCache that collects information at boot time and primes the read-ahead on subsequent boots to smooth things out... everyone found out the hard way when it was mildly broken in an update to 10.2 exactly how much difference it makes (it knocks about 2/3 off the boot time of my PowerBook).

      see Amit Singh's excellent article for more info, there's a chunk on BootCache at the bottom of this page.

  80. 90% usage and fragmentation by Anonymous Coward · · Score: 0

    Oye.. This one bit me in the arse awhile back. Thought i'd defragment one day, and found that most of my drive (well over 70%) was fragmented. To top it, windows built in defrag could do nothing to help it.. Each pass would clean up maybe 1 percent. In the end, I basically wiped the drive and started fresh.. wasn't worth the hassle. And yes, it does feel zippier now.

  81. Re:Anonymous by Anonymous Coward · · Score: 0

    I can't remember the conductor of the test, but someone challenged Microsoft's claim that fragmentation was a non-issue in terms of performance on NTFS, compared to FAT filesystems. The test that was run showed a ~25% increase in speed (dunno what specific aspect of speed) after defragmenting the drive.

    Consider this an anecdote. If I can find the source of the test, I'll post again with the details, plus a link or a bibliographical reference.

  82. end of the season? by MachineShedFred · · Score: 1

    ... I hate cliffhangers!

    --
    Slashdot still doesnâ(TM)t support Unicode after it was added to the HTML standard in 1997.
    1. Re:end of the season? by djupedal · · Score: 1

      ...follow the link.

  83. HPFS fragments could be good by wardk · · Score: 2, Informative

    My reccollection of the OS/2 HPFS file system from IBM was that in many cases it would purposely fragment to take advantage of the disk spin, thus using fragmentation to increase performance.

    Defrag utils for OS/2 had options to only defrag if there were more than 3 extents, to avoid nullifying this effect.

    funny, years after the death of OS/2, it still kicks ass on much what we use now.

    1. Re:HPFS fragments could be good by cbiffle · · Score: 1

      This is similar to what FFS and UFS do. Not by fragmenting files per se, but by distributing file data across heads and platters in the drive to parallelize access without actually having to move anything.

      I'm sure HPFS used some of those techniques, as FFS was published public-domain in about '86, iirc.

      Now-adays, most cheap desktop drives are single-sided single-platter jobs, so I'm not sure if this optimization is really useful for most of us.

    2. Re:HPFS fragments could be good by gerardrj · · Score: 2, Informative

      There used to be several disk access optimizations

      Vendors used to do interleaving with the format/fdisk commands I recall. The idea was that writing the sectors in a continuous stream was not very efficient as the drives of the time could not move data to or from the disk so quickly. You'd read sector 1, and by the time you were ready to read sector two, sector 3 was under the head, so you had to wait almost an entire disk revolution to find sector 2 again.
      The interleave told the OS to skip X physical disk sectors for each 1 logical sector.

      For example, assume a disk with 12 sectors on a track such that when stationary the disk's sectors align with the hours on a clock face. With interleave of 3 the OS would put sector 1 at 1:00, sector 2 at 4:00, sector 3 at 7:00, sector 4 at 10:00, sector 5 at 2:00, and so on. The OS would occasionally skip more than the "interleave" number of sectors in order to not overwrite previous sectors. This meant that by the time that logical sector 1 was read and transferred to the computer, logical sector 2 would just about be under the heads for reading, thus eliminating or at least minimizing the rotational latency.

      Another big advantage was placing the directory structures in the middle tracks of the drive. This minimized the longest seek that would have to be performed. Unless a single file was very large or in just the wrong spot, it would usually be positioned completely on the inside or outside half of the tracks. After reading, the head only had to move at most half way across the disk to locate the next file or cluster/fragment to read or write; the again at most 1/2 the disk to perform the next operation.
      Most of today's file systems start placing directory/catalog information at the start of the disk, this effectively doubling average seek times to the data stored on the disk.

      As others mentioned, on some "faster" drives, there were filesystems that essentially treated the platters in a drive as individual units and managed then like a RAID 0, a RAIP so to speak (Redundant Array of Independent Platters).

      File fragmentation in today's fast, large buffer drives is, I think, the least of our worries. Fragmented or not we need more optimization of data structures on the drive. I'd rather have related files fragmented and near-by each other than contiguous and spread evenly across the drive.

      --
      Article X: The powers not delegated... by the Constitution...are reserved...to the people
  84. Microsoft really pisses me off by jimfrost · · Score: 4, Interesting
    Ok, we have this filesystem fragmentation buggaboo that's been plaguing MS-DOS and Windows for more than twenty years. We've got a whole industry built around building tools to fix it.

    That would be well and good if the problem were otherwise insurmountable. But, it turns out, we've known how to minimize, if not entirely eliminate, filesystem fragmentation for twenty years now - since the introduction of the BSD Fast File System.

    It doesn't take expensive (in time, if not in money) tools. All it takes is a moderately clever block allocation algorithm - one that tries to allocate a block close in seek time to the previous one, rather than just picking one at random.

    The fundamental insight that the authors of FFS had was that while there may only be one "optimal" block to pick for the next one in a file, there are tens of blocks that are "almost optimal" and hundreds that are "pretty darn good." This is because a filesystem is not a long linear row of storage bins, one after another, as it is treated by many simplistic filesystems. The bins are stacked on top of each other, and beside each other. While the bin right next to you might be "best", the one right next to that, or in another row beside the one you're on, or in another row above or below, is almost as good.

    The BSD folk decided to group nearby bins into collections and try to allocate from within collections. This organization is known as "cylinder groups" because of the appearance of the group on the disk as a cylinder. Free blocks are managed within cylinder groups rather than across the whole disk.

    It's a trivial concept, but very effective; fragmentation related delays on FFS systems are typically within 10% of optimum.

    This kind of effectiveness is, unfortunately, difficult to achieve when the geometry of the disk is unknown -- and with many modern disk systems the actual disk geometry is falsely reported (usually to work around limits or bugs in older controller software). There has been some research into auto-detecting geometry but an acceptable alternative is to simply group some number of adjacent blocks into an allocation cluster. In any case, many modern filesystems do something like this to minimize fragmentation-related latency.

    The gist of this is that Microsoft could have dramatically reduced the tendency towards fragmentation of any or all of their filesystems by doing nothing else but dropping in an improved block allocator, and done so with 100% backward compatibility (since there is no change to the on-disk format).

    Maybe it was reasonable for them to not bother to so extravagantly waste a few days of their developers' time with MS-DOS and FAT, seeing as they only milked that without significant improvement for eight or nine years, but it's hard to explain the omission when it came to Windows NT. NTFS is a derivative of HPFS which is a derivative of FFS. They had to have known about cylinder group optimizations.

    So the fact that, in 2004, we're still seeing problems with filesystem fragmentation absolutely pisses me off. There's no reason for it, and Microsoft in particular ought to be ashamed of themselves. It's ridiculous that I have to go and degragment my WinXP box every few months (which takes like 18 hours) when the FreeBSD box in the basement continues to run like a well-oiled machine despite the fact that it works with small files 24 hours a day, 365 days a year.

    Hey Microsoft: You guys have like fifty billion bucks in the bank (well, ok, 46 or 47 billion after all the antitrust suits) and yet you can't even duplicate the efforts of some hippy Berkeleyite some twenty years after the fact? What's up with that?

    (I mean "hippy Berkeleyite" in an affectionate way, Kirk. :-)

    --
    jim frost
    jimf@frostbytes.com
    1. Re:Microsoft really pisses me off by Anonymous Coward · · Score: 0

      Hey Microsoft: You guys have like fifty billion bucks in the bank (well, ok, 46 or 47 billion after all the antitrust suits) and yet you can't even duplicate the efforts of some hippy Berkeleyite some twenty years after the fact? What's up with that?

      Either because of the NIH (Not Invented Here) syndrome or because "open source is the devil's handiwork" mantra.

    2. Re:Microsoft really pisses me off by jimfrost · · Score: 1
      Microsoft has no problem with open source, HPFS and their TCP stack were both derived from BSD, and Bill only knows what else. What they don't like is the GPL because it doesn't give them the ability to modify the code in proprietary ways, as BSD's license does.

      In any case the technique is not rocket science; any remotely competant filesystem implementor could make their own version pretty easily. I've seen several implementations layered on top of UFS, for instance, and of course HPFS doesn't use the original BSD technique.

      --
      jim frost
      jimf@frostbytes.com
    3. Re:Microsoft really pisses me off by runderwo · · Score: 1
      What they don't like is the GPL because it doesn't give them the ability to modify the code in proprietary ways, as BSD's license does.
      They can modify GPL code in as many proprietary ways as they feel like. They just can't make it available for free or for sale without either offering the source code under the GPL, or {asking,paying for} extra permissions from the copyright holder.

    4. Re:Microsoft really pisses me off by jimfrost · · Score: 1
      They can modify GPL code in as many proprietary ways as they feel like.

      proprietary adj. something that is used, produced, or marketed under exclusive legal right of the inventor or maker

      I submit that it's not "proprietary" if you have to give it to everyone else :-).

      --
      jim frost
      jimf@frostbytes.com
    5. Re:Microsoft really pisses me off by Anonymous Coward · · Score: 0

      Actually, I don't think that the disk-layout sensitivity of the FFS optimizations is relevant on modern drives, which probably don't even report a correct layout, but the division into cylinder groups, allocation strategies (rotor with quadratic rehash), the placement of inodes and blocks are all still beneficial.

      But while file fragmentation isn't much of an issue on Unix systems, file access pattern fragmentation has recently become one, and it's a much harder problem. With demand paging, even with readahead starting up a program with lots of shared libraries (try ldd on Mozilla, OpenOffice, any KDE or GNOME app...), none of which are cached, can get pretty painful...

    6. Re:Microsoft really pisses me off by runderwo · · Score: 1
      As I said, they don't have to give the source code to everyone else if their proprietary modifications are used only in-house. To suggest otherwise demonstrates a fundamental misunderstanding of the GPL.

    7. Re:Microsoft really pisses me off by jimfrost · · Score: 1
      As I said, they don't have to give the source code to everyone else if their proprietary modifications are used only in-house

      It wouldn't be very Microsoftish to not try to make money with it :-).

      --
      jim frost
      jimf@frostbytes.com
    8. Re:Microsoft really pisses me off by Anonymous Coward · · Score: 0

      "Ok, we have this filesystem fragmentation buggaboo that's been plaguing MS-DOS and Windows for more than twenty years. We've got a whole industry built around building tools to fix it."

      It's not the only industry that survives due to MS incompetence. Unfortunately, due to so many industries that depends solely on MS ways, it won't change easily. People now accept the fact that all the nasty stuff is part of owning a computer. Complexity == serious machine, simple == toys. IT people need complexity to survive, so they'll recommend Windows regardless how inappropriate the decision is (remember forced migrations under the guise of saving money from supporting a single platform?).

      People don't believe that spywares and other malwares are not pervasive in OS X/linux/BSD. You wanna blame someone? Blame the system in addition to Microsoft.

  85. Panther. by Raven42rac · · Score: 1

    Panther optimizes on the fly and after any installation. Fragmentation is really a non-issue.

    --
    I hate sigs.
    1. Re:Panther. by Anonymous Coward · · Score: 0

      Panther defragments on-the-fly, but when installers on MacOS X say they're "optimizing", that isn't optimizing files to reduce fragmentation, it's updating prelinking information for shared libraries.

  86. And the most fragment file I have is.... by Anonymous Coward · · Score: 0

    Panther:/Users/coyote/VPCs/Windows 2000.vpc6/Windows 2000 Drive 1.vhdp/BaseDrive.vhd

    Ah, so its Windows!

  87. editing DV with Final Cut Pro by Anonymous Coward · · Score: 0

    Self defragmenting my arse!!

    Try editing digital video using Final Cut Pro for a couple months. My filesystem got so fragmented on a data drive (120GB), that FCP became unusable. I had to buy another drive and copy all the files from the fragmented disk to it. And it took *days* to do the copy. This process repeats every couple months.

    1. Re:editing DV with Final Cut Pro by Axello · · Score: 1

      As mentioned somewhere above, and in the article, HFS+ does defragging on the fly when files are opened if they are LESS THAN 20MB.

      I highly doubt your FCP files are less than 20 MB.

    2. Re:editing DV with Final Cut Pro by dasmegabyte · · Score: 1

      And I doubt that copying 120 gig, fragmented or not, took him "days." Took me about three hours to do it today over a friggin 100 baseT line.

      --
      Hey freaks: now you're ju
  88. Huh. by wazzzup · · Score: 1

    All this time I thought defragging my hard drive meant removing my copy of Quake from it.

    Live and learn.

    1. Re:Huh. by Anonymous Coward · · Score: 0

      Bored?

  89. Re:Anonymous by pelicaneng · · Score: 1

    HFS+ is also journaled by default on OSX 10.3 - and as an option on OSX 10.2.

  90. NTFS is pretty good at avoiding fragmentation?! by Anonymous Coward · · Score: 0

    If what you say is true, I'd like to know what eMule and BitTorrent (3.2 and before) do to mess with it. 'Cos they both pre-allocate files with the size of the download, and these files _always_ get freaking heavily fragmented even before being written to (and yes, with plenty contiguous free space available).

    1. Re:NTFS is pretty good at avoiding fragmentation?! by orangesquid · · Score: 1

      But they probably "pre-allocate" a lot of zero-blocks, which often are not ever written to disk... it's like a sparse matrix.

      At least, this is my experience with ed2k under linux... after copying about 200 ed2k URLs in, I had a directory whose files had a total size of dozens of gigabytes.

      du -s showed the truth; the directory was only a few hundred megs (but growing fast).

      --
      --TheOrangeSquid Is it any wonder things seem so awry? We swim in a sea of confusion and don't have to think to survive
    2. Re:NTFS is pretty good at avoiding fragmentation?! by devilspgd · · Score: 1

      In BitTorrent's case, it doesn't actually allocate the file all at once. All the "preallocate" option does is incrementally increase the file by small chunks over and over until it's reached the correct size.

      It's amazingly braindead.

      --
      Give a man a fish, he'll eat for a day, but teach a man to phish...
  91. Short answer: NO n/t by chrwei · · Score: 1

    n/t means no text... duh
    so why are you reading this

    --
    - Disclaimer: Information in this post deemed reliable but not guaranteed.
  92. Re:Bzzt! Nope. Close, though! by l-ascorbic · · Score: 1

    As a minor aside, it seems that the latest iPod update enables journalling on HFS+ iPods. This would be fine in most cases, but I found this out the hard way as I also use my iPod with my Debian box. The new hfsplus module in the 2.6 kernel doesn't seem to understand HFS + (journalled) yet, and would only mount it read-only until I disabled the journal.

  93. Re:Bzzt! Nope. Close, though! by danaris · · Score: 1

    Oh, right; that's true. However, it was not introduced until 10.2.8, which might (not sure about this) have been released after Panther was released. It was certainly released after WWDC 2003, when Panther was announced.

    So there was no support for it before Panther, but there is support for it in pre-Panther versions. My nits stand picked ;-)

    Dan Aris

    --
    Fun. Free. Online. RPG. BattleMaster.
  94. Exactly. by solios · · Score: 1

    One of the reasons I've stuck with Apple over the years- it's the little details like this that seriously add to the experience, and make older versions of the operating system so painless to troubleshoot. :D

  95. File types and fragnentation by Artifakt · · Score: 4, Informative

    There are so many comments already posted to this topic that seem to not grasp the following point, that I think the best way to deal with it is to start a completely new thread. I'm sorry if it seems more than a little obvious to some of you:

    There are fundamentally only a few types of files when it comes to fragmentation.

    1. There are files that simply never change size, and once written don't get overwritten. (Type 1). Most programs are actually type 1, if you use sufficiently small values of never :-), such as until you would need to perform disk maintenace anyway for lots of other reasons in any 'reasonable' file system. A typical media file is probably Type 1 in 99%+ of cases.

    2. There are files that will often shorten or lengthen in use, for example a word processor document in .txt format, while it is stll being edited by its creator. (type 2). (That same document may behave as effectively Type 1 once it is finished, only to revert to type 2 when a second edition is created from it.)

    Of type 2, there are files of type 2a. Files that may get either longer or shorter with use, on a (relatively) random basis. (as a relatively simple case, a .doc file, that may become longer for obvious reasons like more text, but may also become longer for less obvious reasons (such as the hidden characters created when you make some text italic or underlined). (These are reasons that are not obvious to most end users, and often not predictable in detail even to people who understand them better). The default configuration for a Windows swap file is type 2a. It is likely to be hard for an automated system to predict the final size of Type 2a files, as that would imply a software system of near human level intelligence to detect patterns that are not obvious and invariant to a normal human mind. It may be possible to predict in some cases only because many users are unlikely to make certain mistakes, (i.e. cutting and pasting an entire second copy of a text file into itself is unusual, while duplicating a single sentence or word isn't).

    Then there are files of type 2b. Files that get longer or shorter only for predictable reasons, (such as a Windows .bmp, which will only get larger or smaller if the user changes the color depth or size of the image, and not if he just draws something else on the existing one.). A good portion of users (not all by any means) will learn
    what to expect for these files, which suggests a well-written defragger could theoretically also auto-predict the consequences of the changes a user is making).

    3. Then there are type 3 files, which only get longer. These too have predictable and unpredictable subtypes. Most log files for example, are set up to keep getting longer on a predictable basis when their associated program is run (type 3b). Anything that has been compressed (i.e. .zip) is hopefully a 3b, but only until it is run, then the contents may be of any type. A typical Microsoft patch is a 3a (it will somehow always end up longer overall, but you never know just what parts will vary or why).

    4. Type 4 would be files that always get smaller, but there are no known examples of this type :-).

    These types are basic in any system, as they are implied by fundamental physical constraints. However, many defrag programs use other types instead of starting from this model, often with poor results.

    In analyizing what happens with various defrag methods, such as reserving space for predicted expansion or defragging in the background/on the fly methods, the reader should try these various types (at least 1 through 3), and see what will happen when that method is used on each type. Then consider how many of those type files will be involved in the overall process, and how often.

    For example, Some versions of Microsoft Windows (tm) FAT32 defragger move files that have been accessed more than a certain number of times (typically f

    --
    Who is John Cabal?
    1. Re:File types and fragnentation by gerardrj · · Score: 1

      There are files that simply never change size, and once written don't get overwritten. (Type 1). Most programs are actually type 1...

      Except that simply isn't true. Today's programs are large entities which are updated rather often (the ship first, debug later syndrome). There are programs on my computer that are updated more often than the files I view with them.

      Ex: on my Mac, I used iTunes to rip my CDs. I've updated iTunes I think 4 times now, but those AAC rips haven't changed yet. iTunes is probably more "fragmented" than the files it access.

      Not to rip on MS, but I do find their OS installation process to be particularly odd. I think it's the only OS I've installed where the disk is significantly fragmented in files and free space after a fresh install. Then, it's the only major OS that does it's install from a live copy of itself on the HD being installed to. GNU/Linux, MacOS and Solaris all install from some other media (bootable CD or network,or another HD) to an otherwise idle volume. Not to say that these other OSes have an optimized volume after install.

      --
      Article X: The powers not delegated... by the Constitution...are reserved...to the people
    2. Re:File types and fragnentation by imroy · · Score: 1

      I've also wondered about the NT/2K/XP installer. It appears to be DOS, but I may be wrong. Does anyone know if the installer is DOS or some super-stripped down text-mode NT-based OS? It is suspicious that it first copys files from the CD into a FAT filesystem on the disk. It then reboots and seems to do the actual extraction and installation then. At some stage it has to run a FAT-to-NTFS converter. My father and I can't believe that MS is still using ancient DOS and such a convoluted installation procedure. Linux, and presumebly the BSD's, just have a boot floppy or CD with a stripped-down version of the OS. It simplifies everything because the installation procedure has (well, almost) axactly the same capabilities as the final OS. Which allows it to make use of all manner of CD's, DVD's, the network or even the internet for installation media. Of course it helps that they're also Open Source(tm) and don't have to be paranoid about piracy.

    3. Re:File types and fragnentation by nsayer · · Score: 1

      It's not DOS. It's XP. Watch sometimes as it goes through all of the module loads just after you boot from the CD. One of the things it loads is the NT kernel. During one of the reboots between the time it writes the embryonic installation FS and it starts the GUI install procedure, it upgrades the FAT filesystem to NTFS (if you told it to). If you install with FAT and don't upgrade at install time, there is a filesystem migrator which will reboot and do the same thing - upgrade the FAT filesystem to NTFS.

    4. Re:File types and fragnentation by Anonymous Coward · · Score: 0

      Many files of "type 2" should effectively be files of "type 1", although sadly all programs that should treat them that way don't.

      The correct way to update a smallish file that is modified by some program is not to destructively overwrite it, but to write a new file (allocating new blocks) and replace the old one with it.

      If a destructive overwrite is aborted for whatever reason, you end up with a file containing part of the old data and part of the new data, which leaves you with neither an in tact old version or an in tact new version.

      Other than if the filesystem is too full to make it possible, there is seldom a reason to ever destructively overwrite a file that isn't in a format that makes partial updates meaningful (e.g. database).

  96. Re:NTFS is so bad by Weasel+Boy · · Score: 1

    I have to disagree with you. Back when I had NT4, I could defrag my drive and be back to >90% fragmentation in three weeks. My XP box is less than two months old, the drive is only 35% full, and my file fragmentation is 50%. In my experience, NTFS fragments like nobody's business.

  97. Fine by Prince+Vegeta+SSJ4 · · Score: 1
    Because an object in motion (constant linear velocity) will move in a straight line unless a force acts upon it, in order for an object to travel in a circular motion inside of a dryer a centripetal force must be applied. Of course the centripetal force always points towards the center of the circle. In this case the walls of the dryer (basket?) provide that force.

    In order for the Hard Drive to remain Static in relation to the point of contact on the dryer, an equal but opposite force must be applied. This causes those bits to be reshuffled. Next up Mechanics of Deformable Bodies.

    Which brings us an interesting concept, the inward and outward forces on the drive would act as a form of compression, thereby freeing up even more space on the hard drive. Maybe SCO would like to patent this form of Data compression.

    1. Re:Fine by gmaestro · · Score: 1
      Maybe SCO would like to patent this form of Data compression.

      Whew, for a minute I thought you might think I was serious. :^)

  98. Re:Bzzt! Nope. Close, though! by Angostura · · Score: 1

    Nope, you're wrong. 10.2.8 was out well before the release of Panther

  99. Re:Offtopic by revscat · · Score: 1, Offtopic

    This was not an old shell either. Iraq didn't have binary chemical capabilities before the first Gulf War.

    Is that what Hannity is parroting this week? Or maybe Fox News? Do tell, do you manage to find time to fit the "Kerry is boring" meme in, too? Or was that last weeks talking point? Now that I think about it, I think this week's meme is "the libruhl media isn't spending enough time on the Berg murder." Sorry, with all the lies it's hard to keep it all straight.

    Tell ya what: FOAD. Bush lied, Bush continues to lie, and our country is far, FAR more in danger now than when we started this stupid fucking war. Bush said he was 100% certain that Saddam had massive stores of WMD and a nuclear program. That was a fucking lie.

    Oh, but of course, he never ACTUALLY said it. He just IMPLIED it, which makes it all ok, doesn't it? It was a failure of intelligence, which means it ain't his fault! Nothing is his fault! And I mean shit, who needs morals when you're having to deal with them dirty hippie commie faggot libruhls and that libruhl media?

  100. Re:Bzzt! Nope. Close, though! by tenton · · Score: 2, Informative

    Journalling has existed since 10.2.2 (at least on the Server end; I believe the consumer end too, except you had to enable it via a terminal command), so... ^_^

  101. Re:Offtopic by Sj0 · · Score: 1, Offtopic

    WHAT?! You'd better go tell that to Hans Blix, because that cheeky bastard is going around telling everyone that it's probably an old shell from pre-gulf war Iraq.

    Just run up to the UN, and go:

    "Quickly! I'm toupsie from slashdot! Hans Blix may have dedicated ten years of his life to hunting these weapons, but I'm here to tell you that he doesn't know JACK! This was NOT an old shell!"

    and they'll go "Wow! Thanks for this vital information! We have to ask you though, and this is just a formality, you understand, what your qualifications to be making this statement are -- the press is going to want to know. Have you spent time in Iraq?"

    "well, no..."

    "OK, have you been keeping up to date on the 900 page reports by the weapons inspectors over the past 10 years?"

    "well no..."

    "well, what is it which makes you qualified to make such a declaration?"

    "well, I did stay at a holiday inn express last night!"

    Bring a video camera. I want to see it when you get laughed out of the building.

    --
    It's been a long time.
  102. Bring on the browser stats! by WgT2 · · Score: 3, Insightful

    A word about browsers (and any thing else that requires change):
    People, in general (more than 50% of them), prefer to resist change, and for that matter, extra work and/or thinking. It's just the way they are. It's what explains product loyalty. In this case, the product loyalty is browser based.

    In my job, as a web server support admin, I find that 95%, or more, of the people I speak with in support situations are not even aware of the alternatives available to them. In fact, just last Sunday, a friend of mine was showing off his new Power Book to me (by the way, even though I am a complete Linux advocate, you have to give credit where credit is due: Mac has a great GUI). I had to laugh during his enthusiastic demo of Mac OS X's features when my friend opens up Safari and goes, "Check this out. It's a feature called 'tabbed browsing.'" He was a kid in a candy store and had just found new, profound flavor of buble-gum or something. But, how could I not laugh at this previously 100% Windows user's intron to me of something that I began using in Opera, back around 5.x-6.x (I really don't remember if 5.x had tabs or not. I really don't care since that browser drives me crazy. But that's just me.) Translation: it's be around for years. In my work day I begin with 12-13 of them opening in FireFOx (NT 2000 doesn't like that, even with 512MB RAM, but it gets by well enough). The number of tabs only increase from there, unless there's an accident of closing a tab. But no big deal there either, I just open another one and then drag it back between where I normally would have it in my list of tabs. You won't find any thing like that in a browser direct from MS.

    Another example: my co-workers, particularly the NT techs. Most, certainly not all (thank God), of our NT techs still use IE for their work. I don't really know what they need for their work, but I've seen their desktops and their taskbars; WHAT A MESS! It's beyond me why they would waste their time with a browser (read: IE) that doesn't organize their open web pages into one taskbar entity, because they DO use other programs on the NT 2000 desktop, which we all must use at my job, regardless of the servers we admin for. (If you haven't guessed yet, I don't admin for NT servers, I get the please and ease of admining for Linux boxes. And a big THANK GOD for that!)

    Back to my point: most people are not aware of features in other browsers AND if they are aware of new inovations (read: tab browsing, which is one reason I will never go back to IE) they are not in any hurry to change and think and evaluate something that, however troubling it can be at times: pop-ups, vulnerbilities, "________________" [fill in the blank], lack of inovation, etc.

    So what if most of /. visitors are Windows based? There are plenty of better choices to MS products, even on their own OS platform. But, people the world over resist change; they get stuck in a rut, good or bad in it's results, and they either don't like to change, don't "need" to change, or cannot change. Thus, the end result is resistance to change; for the better or for the worst.

    1. Re:Bring on the browser stats! by Nexx · · Score: 2, Informative

      FWIW, WinXP will, when you have a tonne of browsers open, place them under one entry on your taskbar. Same goes with Excel windows, vi windows, etc. I think it goes by the process names.

      What's not too obvious is that a lot of Windows administration tools are instances of one executable (though I imagine it executing different things), so they all get lumped under one entry on my taskbar too.

    2. Re:Bring on the browser stats! by WgT2 · · Score: 1

      Yes, that annoying feature of grouping 'similar' tasks that I also disable in my KDE environment.

      But, that's not an issue in my work environment, where we only use NT 2000 which, thankfully doesn't group by 'similar' tasks. Also, it is only at work where I extensively use a Windows environment.

  103. Re: It is NTFS! by Brandybuck · · Score: 1

    convert the disk to NTFS

    <bigger>It is NTFS!</bigger>

    --
    Don't blame me, I didn't vote for either of them!
  104. Re:It's the drive. Or cron. by horigath · · Score: 1

    If you aren't in the habit of leaving your macs running 24/7, you can use macjanitor to run these tasks from a nice, friendly GUI.

  105. Have you noticed? by Anonymous Coward · · Score: 0

    Seems to be an incredible drop off in the intelligence level of right wing sympathisers in recent weeks. All you see on the boards and chatrooms are pathetic 'me-too' types, parroting back whatever pointless point the 'pundits' and scream-radio hosts are trotting out. Used to be, you had some folks making rational, reasoned, well thought out arguments. Now, all the smart people have jumped ship or shut up. All that's left are the dregs, but they are in absolute flood-mode, squatting and dropping their smelly little memes in the most inappropriate places.

  106. Re:Offtopic by Goo.cc · · Score: 0, Offtopic

    There could be lots of reasons for this but I wouldn't trust US intelligence to provide the answer. In any case, we "really" attacked to "liberate" Iraq from a dictator. It will be interesting to see if we are as willing to liberate China or North Korea; countries with an actual military.

  107. NTFS Swap Avoidence in 2 Steps by Epoch+of+Entropy · · Score: 1

    1. Create a partition at the end of the drive that is the size of the paging (swap) file you wish to use.

    2. Move the swap file there. (2000/XP - Control Panel>System > [Advanced]> Performance Options > Change Virtual Memory

    Remember to set the pagefile on your system/data drives to blank fields (instead of 0), and that every change you make you MUST USE THE SET BUTTON.

    Using this I only need to defrag every once in awhile, instead of regularly. I also find windows runs faster, and I don't have to re-install as often.

    Cheers!

  108. fragmentation delays are always within 10% of opt by Anonymous Coward · · Score: 1, Interesting

    On any file system. You can have a very fragmented file system in some situations, but typically ANY file system is losing very little performance to fragmentation.

    And fragmentation is not a bugaboo. It's a fact. When you have random allocation on a volume, it will get fragmented. You can go back after the fact and unfragment it, but doing so in any serious fashion when writing files actually degrades performance due to the extra effort required.

    Also note NTFS is not a derivative of HPFS. I cannot speak as to whether HPFS is a derivative of FFS.

    HFS+ does nothing to prevent fragmentation except for use super-clusters. That is, when you extend a file, you get more than one block at at time. When you close the file, some of those blocks might be scavenged, or might not. NTFS could do this, but I believe they do not. However, NTFS on servers has an allocation block size of 8K, which isn't far off of the super-cluster size on HFS+ which I believe is 16K.

    Finally, note that on modern drives, you can seek all the way across the disk in only about 30-50% more time than you can seek a short seek. Thus keeping your blocks close to the current cylinder but not in it has very limited value. Note that this is not the case on optical (CD/DVD) disks.

  109. Re:Offtopic by toupsie · · Score: 1
    Nice avoidance of the statement with insults and innuendo. Stellar job. However, it still stands. If Saddam Hussein was stripped of his WMDs, how did an artillery shell filled with a gallon of sarin using an advanced binary system end up as IED in Iraq? Remember, one drop of which can kill the average man. If we say there are 25 drops in an ounce, that is roughly the same death toll from 9/11 from this one shell.

    Now lets try again. Without resorting the usual base partisan hysteria, please explain how there are no WMDs in Iraq. Its Ok to be wrong. No one is going to call you names.

    Beware, we also have found mustard gas in Iraq as well.

    --
    Strange women lying in ponds distributing swords is no basis for a system of government.
  110. Re:Offtopic by bnenning · · Score: 2, Insightful

    Tell ya what: FOAD.

    Ah, liberal tolerance rears its head again.

    Bush lied, Bush continues to lie, and our country is far, FAR more in danger now than when we started this stupid fucking war.

    I'd be interested in the metric you use to compute danger, seeing as how there have been exactly zero terrorist attacks on US soil since 9/11. (By the way, were you out protesting the "stupid fucking war" in Serbia, or are Democrats allowed to invade sovereign nations who pose no external threat?)

    Bush said he was 100% certain that Saddam had massive stores of WMD and a nuclear program.

    Is it just barely possible that maybe he really did believe that, and he was mistaken? Intelligence agencies have been known to make mistakes before. Never mind, I forgot he's from Texas and worked in the oil industry so he's obviously made a pact with Satan.

    Oh, but of course, he never ACTUALLY said it. He just IMPLIED it, which makes it all ok, doesn't it? It was a failure of intelligence, which means it ain't his fault! Nothing is his fault! And I mean shit, who needs morals when you're having to deal with them dirty hippie commie faggot libruhls and that libruhl media?

    It's amusing watching you guys get progressively more unhinged. Kerry should be leading Bush by a healthy margin given the Iraq situation and that the economic recovery isn't completely visible yet, but when your talking points are all variations on "Bush is a fascist", you can't expect much from the middle. I'm not a huge fan of Bush, but I'll be enjoying his victory on election night just envisioning the enragement of the left.

    --
    How to solve most of our problems: 1.Lots of nuclear plants. 2.Cure aging.
  111. Compared to WHAT? by quarkscat · · Score: 1

    As a user of NTFS 4(WinNT 4.0) for five years,
    I noticed a huge problem went I switched to NTFS
    5 (Win2K). During the D/L of big files, I would
    get an OS alert that there was not enough disk
    space free: the report would claim insufficient
    space for a 50 MB file while I had over 2 GB free.
    The disk analysis tool (MS) would report perhaps
    20% fragmentation.

    The only way I could proceed with the 50 MB file
    D/L would be to log in as the administrator,
    defrag the partition (sometimes more than once),
    and reboot the system. This problem NEVER
    occurred with NTFS 4. And, being the cheapskate
    that I am, I never used anything but the MS-
    supplied defragmentation tool.

    I have never experienced these types of file-
    system problems with ANY other OS, including
    hpux (10.x), irix (6.x), linux (2.x), solaris
    (2.5/6/7/8), or my mac (10.x). The Win2K
    filesystem is worst than any of those supported
    by any of these other OSes (and the defrag tool
    is worst than in WinNT 4).

    If I could get (native) support in Win32 for
    XFS and HPFS+, I wouldn't use NTFS at all.
    (Or better still, rock solid binary support
    for those Win32 applications under linux or
    max osx, and do away with Win2K completely).

  112. Very cool by rixstep · · Score: 1

    Very cool, very cool hack.

    Damn, that was my next project...

  113. Re:Offtopic by amRadioHed · · Score: 2, Interesting
    I'd be interested in the metric you use to compute danger, seeing as how there have been exactly zero terrorist attacks on US soil since 9/11.
    And I'd be interested in the metric you use. Tell me, how often did we have terrorist attacks on US soil before 9/11? Well let's see, there was Oklahoma city, but that was an American so it doesn't really apply does it. So that leaves The first WTC bombing as the most recent attack preceding 9/11. 8 years lie between those two attacks.

    If we take the extremely generous assumption that foreign terrorists attack the US every 8 years, for you to make an even remotely reality based assessment of our relative security since 9/11 I'd say you need to wait at least 12 years without any attacks.

    Granted, the grandparent would have difficulty proving his assertion that we are in much greater danger now, but I'm sure it could be proven that we have many more enemies. That's not exactly comforting.
    --
    We hope your rules and wisdom choke you / Now we are one in everlasting peace
  114. Sweet! Kernel Panic! by jriskin · · Score: 1

    I haven't seen one of those in a loooooooong time!

    (note to self, save open documents before running experimental software)

  115. Re:Offtopic by Arctic+Fox · · Score: 0, Offtopic

    Well, at this time, China isn't really a problem. They're pretty sane. MAD somewhat applies between the US and China. You have a point about NorK. However, Saddam had the world's 4th largest army in 1991. But he didn't have nukes either....

  116. Re:fragmentation delays are always within 10% of o by Sangui5 · · Score: 1

    Finally, note that on modern drives, you can seek all the way across the disk in only about 30-50% more time than you can seek a short seek. Thus keeping your blocks close to the current cylinder but not in it has very limited value. Note that this is not the case on optical (CD/DVD) disks.

    Bzzt. Wrong. Thanks for playing.

    Seagate Barracuda 7200.7 Plus product manual. This is a modern drive. Look at page 17 of the PDF, section 2.7, "Seek Time". Track to track seek is listed as sub 1ms, while average seek is 8.5ms (for read). Latency (the rotational aspect), which is separate, is an average of 4.16 (as it should be for a 7200 RPM drive). So a short seek is 8 times faster than an average seek, much less a whole-drive seek. So keeping your blocks close to the current cylinder but not in it still has high value.

    Additionally, if you can keep your data in the same track, you don't have any seek time, just rotational latency. And the size of track groups has been growing as densities have been growing. So there are lots and lots of blocks in the same track that aren't within readahead range.

    And fragmentation is not a bugaboo. It's a fact. When you have random allocation on a volume, it will get fragmented.

    Now you misuse the term "random allocation". When talking about disk, random allocation means that you randomly choose your next block--which certainly will cause fragmentation. I think what you are looking for is random file creation. However, under FFS, if you maintain sufficient free space, it is very unlikely that real fragmentation will occur even with random file creation/deletion. Yes, you won't be able to store all of your files contiguously. But as the grandparent points out, the old FFS block allocator finds "nearly optimal" blocks. From the original paper on FFS, you don't get serious fragmentation-related performance issues until you reach 90% disk utilization (there's an '86 FFS paper I can't find an electronic copy of which does a better analysis, but even the '84 paper has the 90% figure). At 90% utilization, nearly every file system ever starts getting severe performance problems due to fragmentation.

    You can go back after the fact and unfragment it, but doing so in any serious fashion when writing files actually degrades performance due to the extra effort required.

    You should read about log-structured file systems sometime. Like Sprite. The base idea of a log-structured file system (LFS) is that you don't try to keep your blocks the same. You write a log of changes, and stream that out continuously to make maximum use of your available write bandwidth. This has the severe downside of causing horrific freespace fragmentation, since every change to a file means the affected blocks are reallocated, and the old blocks are now garbage. So you have continuous freespace compaction (called segment cleaning in the paper). LFSs didn't catch on because at the time, they needed a large amount of free space compared to more traditional "overwrite" file systems to maintain performance. However, recent work with log file systems shows that the changing performance characteristics of disks (much higher bandwidth but same seek/rotational delays) have tipped the balance to log structuring. Regardless, the cleaning process is precisely going back and unfragmenting your data, and is necessary for a LFS.

    HFS+ does nothing to prevent fragmentation except for use super-clusters.

    As pointed out by others, Apple's later implementations do defragmentation of smaller files when they are accessed.

    NTFS could do this, but I believe they do not. However, NTFS on servers has an allocation block size of 8K

  117. Re:fragmentation delays are always within 10% of o by jimfrost · · Score: 1
    Thanks for the defense :-). The thing that I think is funny is that intra-track reads are so much faster now, what with the ability to read sectors back-to-back, twice the rotational speed, and four times the number of sectors on a single track. What used to be about a factor of fifteen difference between intra-track read performance and inter-track performance is upwards of a hundred now. If it weren't for hyper-aggressive caching NTFS would positively suck.

    Anyway, the other guy claimed that NTFS was not a derivative of HPFS. That is not my understanding; I would have learned about the etymology in either the NTFS internals book or Showstopper!, both of which were from Microsoft, but a bit of work with Google shows that the belief is widespread (for whatever reason). In any case HPFS is a very direct descendent of FFS; really the only significant thing they did was simplify the block allocator so they didn't need to know the disk geometry.

    So no matter how I look at it, Microsoft knew about the technique no later than 1989. Too bad the only thing they put it in was OS/2, which nobody used.

    --
    jim frost
    jimf@frostbytes.com
  118. defrag on OSF1 by TopherC · · Score: 1

    Sorry, slightly OT here. I always wondered why a sysadmin ran nightly defragmentation jobs on home disks on an OSF1 system. Every night from about 1am to 4am, the system would become completely useless. By "useless" I mean it might take 30 seconds to respond to "ls" in a directory with 20 files. Productive work was impossible, and overnight jobs weren't getting much time. Logging onto the file server, I would see about 10 defrag proceses running. I never talked to him much about it, but from your post I'm surprised it was necessary at all, particularly on a DAILY basis!

    I don't know what filesystem he was using -- I know virtually nothing about OSF1 from a sysadmin perspective. Well, this was 5 years ago. Now I think he's still running OSF1 for a fileserver that you can't log into, because the OSF1 filesystem is "so much more advanced" than any Linux offerings. Now with LVM2 and the various mature journaling filesystems in Linux, I very much doubt that's true anymore. He's always been of the mindset that you get what you pay for. Our compute servers are all running Linux these days, and that's what I really care about.

  119. Re:Give it a rest by drsmithy · · Score: 1
    [...] while HFS+ defragments on the fly

    This is a function of the OS, not the filesystem.

  120. Re:Offtopic by toupsie · · Score: 2, Informative
    And I'd be interested in the metric you use. Tell me, how often did we have terrorist attacks on US soil before 9/11? Well let's see, there was Oklahoma city, but that was an American so it doesn't really apply does it. So that leaves The first WTC bombing as the most recent attack preceding 9/11. 8 years lie between those two attacks.

    You are forgetting two embassies in Africa and an American Warship. All of those are American soil. So it is not an attack every eight years.

    --
    Strange women lying in ponds distributing swords is no basis for a system of government.
  121. Fast! by rixstep · · Score: 2, Informative

    One thing people rarely talk about is how fast HFS+ is. Or perhaps how slow UFS on the Mac with OS X is. But the difference is more than dramatic: a clean install of OS X using HFS+ can take less than half an hour - including the developers tools. The same procedure using UFS seems to never end.

    It might be the way they've 'frobbed' UFS for use with OS Server, but UFS really gives high priority to disk ops with GUI ops taking the back seat, and yet HFS+ is in comparison blazingly fast.

    I believe in a good clean machine like anyone, and I do see the probability DiskWarrior will be needed now and again, but the speed alone is quite a pedigree for HFS+ IMHO.

  122. defrag algorithms? by TheLink · · Score: 1

    Anyone have pointers to the algorithms used for defragging HDDs? I've looked before but couldn't find much info.

    --
  123. Re:Offtopic by Sj0 · · Score: 1

    I'm not a huge fan of Bush, but I'll be enjoying his victory on election night just envisioning the enragement of the left.


    Hey, it's just the next generations money he's squandering and sending off to foreign countries by the truckload, why should you worry about that? It's just a half trillion here, a half trillion there, nobodys going to miss it!

    --
    It's been a long time.
  124. Re:Offtopic by revscat · · Score: 1

    Avoid, my ass. There's nothing to avoid. After an almost endless line of lies and deceptions, let's just say that my skepticism about any of this shit is just a *weeeeeee* bit higher than normal. Winnebagoes of Mass Destruction, anyone? But I forgive you. You have to grasp at whatever straws you can. I mean, everything else this administration has said and done has turned out to be flat-out wrong. Your ego is far more important than the nation's security, after all. So I don't blame you for buying in to this whole hog.

    No, on second thought I do. The Republican spin machine is going to get us all killed.

  125. Re:Offtopic by revscat · · Score: 1, Troll

    Ah, liberal tolerance rears its head again.

    I am intolerant of corrupt, stupid, anti-democratic presidents who have done more to harm the nation than to help it. Ah, another conservacliche. What's next? A rant about Jesse Jackson? Perhaps something about the libruhl media? Or maybe you'll even manage to slip in the good ol' "libruhls is lazy socialist hippies!"

    (By the way, were you out protesting the "stupid fucking war" in Serbia, or are Democrats allowed to invade sovereign nations who pose no external threat?)

    80% of my bitch is about the incompetence in which this war has been run. The Serbian war had ZERO American casualties. None. Nada. We were in, out, and for the most part done. But this arrogant fuck of a president and his controllers have this idealistic notion of how easy it would be to install a new government, and they have done NOTHING but fuck it up. To take one example, the looting immediately after the war -- that is costing the American people BILLIONS of dollars -- could have easily been prevented if Uncle Don had gotten his head out of his ass and listened to the experts that said we'd need tens of thousands of more troops in country. But no, he didn't. Instead they ridiculed that general, demoted him, and had him reassigned. Guess what. He was right. Rummy fucked up. AGAIN. And both our troops and the people of Iraq are still paying the price.

    Is it just barely possible that maybe he really did believe that, and he was mistaken? Intelligence agencies have been known to make mistakes before. Never mind, I forgot he's from Texas and worked in the oil industry so he's obviously made a pact with Satan.

    But of course. Nothing is his responsibility, is it? He never fucks up, and whenever there is a fuckup it's not his fault, it's someone elses. Intelligence failures. Failures of subordinates. An isolated incident. It wasn't really treason. Don't you get tired of having to find excuses for this guy?

    And by the way: I'm fifth generation Texan.

    It's amusing watching you guys get progressively more unhinged.

    You ain't seen nothin' yet, babycakes.

  126. Re: It is NTFS! by Spoing · · Score: 1
    1. It is NTFS!

    Well, OK then! :}

    --
    A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
  127. Re:Offtopic by toupsie · · Score: 1
    Once again, I ask. If we have found a gallon of sarin in an artillery shell that uses a binary system for the chemical reaction, how can you say that Saddam was stripped of WMD before the war?

    Come on, you can get past hyperbole.

    --
    Strange women lying in ponds distributing swords is no basis for a system of government.
  128. Re:Offtopic by revscat · · Score: 1

    First off:

    hyperbole (n.) - A figure of speech in which exaggeration is used for emphasis or effect, as in I could sleep for a year or This book weighs a ton.

    If you're going to try and speak English at least learn how to use it correctly.

    Second, I'm not gullible enough to think it will ever be confirmed. Third, EVEN IF IT IS one gallon of sarin found over a year after Saddam's fall proves exactly squat. It could have been missed by the inspectors and misplaced (or fotten about!) by an incompetent bureacracy (yup, it do happen.) It could have been brought in by al Qaeda or any number of groups that would just love to kill a whole buncha "Zionist imperialist Americans." It could be an unexploded bomb used against the Kurds in the 1980s. Any number of plausible intepretations could be laid forth. And because of this little thing called "chain of evidence" there's no way of knowing for sure. Of course, this happens to show what a flimsy case the admin had -- no big surprise there -- so you will of course not buy any of it.

    Saddam was stripped of his WMD because he was. He posed no threat to us or the region, and the war proved this. Ergo, Bush lied or is completely incompetent. Take your pick. You can be pedantic -- which I fully expect -- and say that "there was sarin there! Obviously you're wrong!" -- to which I say: You ain't foolin' anyone, bub. Fourth and finally, it doesn't change the fact that this administration has screwed absolutely everything up that they have touched, including looking for WMD. Remember the looting of the government offices? Think some documents in there might have been helpful? Hmm.

  129. Re:Offtopic by Ender_Wiggin · · Score: 1
    Two US soldiers suffered slight reactions to the gas. This was probably just an old 1980s shell of the sort used against the Kurds and Iranians, and nothing suggests many of these remain or are still operative. The insurgents who used it may not even have known what it was. (It was not marked). A couple left-over stray such shells does not prove that there were WMD in Iraq in any signifcant sense. No doubt it will set off a frenzy among the latter-day Juan Ponce de Leones looking vainly for the Fountain of WMDs. It is virtually a non-story.

  130. Re:Offtopic by toupsie · · Score: 1
    The Republican spin machine is going to get us all killed

    Hyperbole. Learn to speak English yourself, sonny. But I am most satisfied you have learned to use Dictionary.com.

    So far all you have is conjecture. No facts, no proof that WMD were destroyed by Saddam. Where is the paper work required by the UN that shows that 155mm Sarin Artillery Shells were destroyed? If Saddam was stripped of them, you shouldn't have any problems producing the paperwork.

    Please write back when you have the URLs to the paperwork,

    --
    Strange women lying in ponds distributing swords is no basis for a system of government.
  131. Re:Offtopic by revscat · · Score: 1

    God you're an idiot.

    You can't prove a negative. Can't be done. Can't prove there is no Bigfoot, can't prove there aren't aliens among us, can't prove there is no God. Can't be done. Similarly, no one can prove there are no WMD in Iraq. But that's irrelevant because the burden of proof is on the administration; they're the ones who claimed Saddam was a threat because of his vast quantities of WMD, a threat large enough to justify going to war over. Not me.

    I answered your question, you change the subject. Piss off. Your Glorious Leader is a fuckup and all you can offer are parroted RNC talking points.

  132. Neat. by solios · · Score: 1

    That's handy! And I wouldn't have known about it otherwise- thanks!

  133. Re:Offtopic by toupsie · · Score: 1
    God you're an idiot. You can't prove a negative. Can't be done. Can't prove there is no Bigfoot, can't prove there aren't aliens among us, can't prove there is no God. Can't be done. Similarly, no one can prove there are no WMD in Iraq. But that's irrelevant because the burden of proof is on the administration; they're the ones who claimed Saddam was a threat because of his vast quantities of WMD, a threat large enough to justify going to war over. Not me.

    Obviously, you can't prove anything. Saddam was required to document the destruction of all his WMDs by the UN. If he had 155mm sarin shells, he would have to declare them in order to not violate the UN Resolutions. If he declared these, there would be paperwork. Produce the paperwork. If you cannot, then the sarin shells are undeclared WMD.

    The insults are doing you any good. You look unhinged, nervous and desperate. Its OK to be wrong. We won't laugh at you -- that much.

    --
    Strange women lying in ponds distributing swords is no basis for a system of government.
  134. Changing the subject won't help by revscat · · Score: 1

    I don't have to prove a goddamned thing. You asked how the shell with sarin fit into the WMD debate, I told you. Now you're changing the question, which ain't gonna work. One shell found a year after Saddam's fall proves dick all. That thing could be 20 years old for all you know.

    And I could give a rat fuck if you think I look unhinged, jerkoff. Go back to getting ass fucked by the cock that is the right wing media. Maybe enough propaganda and rhetorical trickery will change the facts, but I'm thinking probably not.

    Oh, and by the way: how are Bush's poll numbers looking, babycakes? They hit the 30's yet? And what's the burn rate on those vaunted millions in campaign contributions? And how's that scar on dipshit in chief's chin lookin?

    You goddamned egotistical fool. You got ramrodded and aren't man enough to admit it. Pride cometh before the fall, though. I mean, Eye-raq was such a huge fucking threat! Goddamn! At least, that's what IRAN was telling us. Iran told Chalabi, Chalabi told Cheney, and Cheney told Bush. We were a proxy for Iran! Did their work for 'em! Suckers! He was a goddamned spy for Iran, but shit, that's good enough to sit behind Lady Laura at the State of the Union!

    Ain't that a total cunt.

    Not that you'd know what one of those are.

    (signed)
    Mr. Proudly Unhinged