Data Loss Bug In OS X 10.5 Leopard
An anonymous reader writes "Leopard's Finder has a glaring bug in its directory-moving code, leading to horrendous data loss if a destination volume disappears while a move operation is in progress. This author first came across it when Samba crashed while he was moving a directory from his desktop over to a Samba mount on his FreeBSD server."
Normally while moving you ensure the copy completed before deleting the original. Apple must be using some discount programmers.
A feeling of having made the same mistake before: Deja Foobar
I lost a huge amount of data being MOVED (not copied) from one volume into a virtual volume DMG file. Lost and gone forever, lots of important files. What happened? I simply bumped the laptop Mac Book Pro during the move... zap... gone forever. The DMG file was blank! Yes, complely zero bytes except for a bit of header non-file data. It sucks bad.
It's kind of strange that this didn't come up while people were beta testing OS X 10.5. Samba is used in many places. I hope they get it fixed soon.
This is part of the file copy sandboxing that prompts "Do you wish to currupt data on loss of destination media? Cancel or Allow?"
Dumb users just don't know how to answer. This is a PEBKAC problem as OS X is infallible.
...As if millions of fanboys suddenly cried out in terror and were suddenly silenced.
But entirely fixable.
Knowing it exists means you can also work around it by doing copies every time and only manually deleting the source entry when you're sure the copy has completed properly. Now all you need to do is be mindful every time you want to move a file anywhere.
Sucks to be a Mac user (I am one, I know) but I'm sure Apple will have this fixed pretty quick.
I drink to make other people interesting!
This is where everybody plays gotcha. It makes a lot of sense. Apple doesn't want the data and I support it. I don't want any user to lose data. This is a serious problem and data is important. That's why Apple has failed us. If a user is going to lose data, let's not argue over who's fault it is but begin to ask "What is this data really for?".
Exactly which decade did you fall into your recently awkened from coma in? Testing? Testing? Nobody tests anything anymore, they just go play with all the new toys and stare at the eye-candy. Actual mundane, humdrum testing? That's an SEP if ever I didn't see one.
A feeling of having made the same mistake before: Deja Foobar
This is the new Leopard "iLostMyFrigginFiles" feature, next version they will add a badass black hole effect when it does that!
Software has bugs?? OMFG! This world is rolling straight to heck.
No offense meant here, but normal move/copy operations are traditionally highly destructive events on MacOS anyway. For instance there is absolutely no simple way to merge two folders contents together on the mac. If you drag a folder called "Documents" into your home directory and click on "OK", the Mac OS will happily delete your entire documents folder. I was reminded of this enormous frustration while recovering from some multi-volume backups recently, having to resort to an obscure OS X commandline tool 'pax' and Leopard's newfound support of hardlinks to make some simple file copies play nice and not unnecessarily consume 3 times the disk space they should have.
For all of the flack the Windows file copy interface gets, it is both safer and more flexible than trying to use the Finder: an interface that makes file management so stupefying it becomes impossible.
This is exactly why they release Time Machine at the same time! :)
Just point Time Machine to a network volume before copying any files and you are all set.
Unless you lose the share in which case you're screwed.
Not to be glib, but.. This would be a great demonstration of the value of "Time Machine" backups. Time Machine is not perfect, but it is a good start on a backup system well integrated into the OS. The example problem, data loss, would be really easily recovered via Time Machine.
Beyond the basics that every decent backup app does, the things I like about Time Machine are:
- Integration into Applications. For example: "Show me what my iTunes library or iPhoto library looked like last Thursday"
- Integration into OS install. In the case of disk failure, recovery to previous state is simple - rather than multi-step with a separate backup app.
Some things that need improving:
- Better handling of file exceptions. I keep work data in encrypted disk volumes (DMGs). If I change one byte, the whole huge file needs to be backed up as each change is detected (generating MANY copies of that big DMG). The only other choice is to say "ignore this file/directory". Same thing applies to any large file, such as a VMware VM file. A better option would be to say "Back this file up, but only keep 'n' versions".
- Time Machine has gotten twice, pegging the CPU/fans on my MacBook Pro.
Honestly, who is using Finder anyway? Why wouldn't you just open Terminal and use cp and rm? Sheesh.
Oh, yeah, it's not easy to pad these out to 120 characters.
With software being in it's infancy relatively compared to other engineering disciplines, I can't wait to see what an OS is going to look like even twenty years from now... much less fifty.
I thought AmigaOS was the sh*t way back when so already I'm impressed even with bugs.
Shh.
hehe... sorry, I just love that quote. This is apparently how move works in "The Apple Way". The same thing can happen to your bank account when purchasing Apple products... flame on, troll, whatever lol...
Not that I engage in schadenfreude all the time but I feel a little warm feeling inside that makes me smile when those jerks @ the PDX Apple store have their cake and eat it too. Try n' make me feel like they're doing ME a favor by selling me an ipod... sheesh...
Unbelieveable. Forgot to check the result of the copy operation eh? So basically this is a catastropic defect for people who deal with very large media files to and from remote stores or people who deal with virtual machine images.
Back in the day when I used to use my mac I dropped a directory (A) into another directory (B) but there was an existing directory (C) with the same name as (A). The finder asked me something, I clicked OK. I was dismayed to find that the dialog had asked me "Would you like to replace directory C, with A?" - Why on earth would that ever be the default option for a directory move? From the users perspective you aren't really moving the directory, the intention is to move the files, thus the sane response would be to merge A with C not replace it.
Whatever.
Advert on Amazon Mechanical Turk:
Write OS-X compatible application to Move a file between two filesystem devices..
Time Allotted:: 6 hours. Reward: $10.00..
"A nation that forgets its past is doomed to repeat it." - Churchill
The original submission:
I don't want to start a holy war here, but what is the deal with you Mac fanatics? I've been sitting here at my freelance gig in front of a Mac (a 8600/300 w/64 Megs of RAM) for about 20 minutes now while it attempts to copy a 17 Meg file from one folder on the hard drive to an SMB share that disappeared...
Dear Slashdot: next time you want to mess with the site, add a rich-text editor for comments.
I guess, more bugs are to be revealed when the number of users continue to rise, but they will also be fixed, so the system will become more and more stable with the time.
The difference is, how the media and people in general reacts to an error of such a kind. Could yu imagine what people would scream and cry is Vista happened to just loss a bite of information? Oh, christ, I don't want to even THINK about this. Now, Abble, does that mistake, and... that's OK, nobody is perfect... Will get fixed.... People have double standards, but in the end, Vista was not THAT bad, and Abble's OSX was not THAT good. The true, is as always there, somewhere in the middle.
It's time to realise that Abble's products are the biggest abomination these days. Just say NO to the dumb iAbble way!!
Apple beta tests software through the AppleSeed program. You have to pay to be able to participate in the program (What? Don't most companies pay the people that test their software?).
There aren't nearly as many AppleSeeders than there were free Vista beta testers for instance. This is why Vista has no data loss bugs. The sick bugs are more likely to get caught when there are more testers.
Viable Slashdot alternatives: https://pipedot.org/ and http://soylentnews.org/
Nothing for you to see here. Please move along. Oh wait...
Move is usually a destructive operation, on almost every platform I have ever used. Here are my experiences
Target diskete failure doing a move from C: to A: on DOS, yep your data is gone.
Network error moving from one windows box to another, yep your data is gone.
NFS write failure on Linux 2.4, check your data is gone.
Maybe move should be implemented as copy, completly then delete but its often not. I don't think there is any convention that demands it be that way. If you care about the data, at all you should always copy, check(maybe cursory, maybe md5 depending on how much you care) then delete.
I tell my users all the time, "move it only if you can lose it."
I don't think this is really a "bug" so much as a behavior, ie there is no handling of media exceptions when doing a move. Now if you data sometime went bye bye with two working devices that would be bug, and that is not what is being described here.
I don't think its fair to single MAC OS out for this either. As far as I know most mainstream OS seem to handle move operations with media exceptions badly. I am also not a MAC appologist. I don't have nor have every had any Apple products. Sure maybe the OS should copy, check at least no exception events happened durring and then delete but its not a bug. I don't think you can blame the OS for problems when the hardware under it be it a disk, NIC card, or memory flakes out. If it handles it gracefully then that is a virtue of the system, if does not handle it then its room for improvement in terms of features but not really a "bug".
Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
Sir, how dare you complain of flaws in OSX? No doubt this "bug" you speak of is actually a feature. John Gruber will set us straight soon enough.
Apple employes monkey's to make their Leopard
If it's true that Apple's products seem less-tested these days, it's because they've tossed lots of seasoned customer quality-assurance testers to the wayside.
Many years ago, think System 7, Apple had this great Customer Quality Feedback (CQF) program. We tortured our systems between the alpha-testers and the great unwashed masses. There were Apple staff who (gasp) listened to our bug reports and got back to us reasonably quickly. It was grand.
Then someone got fired, or promoted, or whatever, and the CQF program got lost in the shuffle. Every few years I get an email from someone at Apple telling me that they're reconstituting it, but nothing ever comes of it, and - you know - it's hard to understand how they can ignore a free, highly-motivated bunch of fanboys.
I was born not knowing and have had only a little time to change that here and there. -- Richard Feynman
This may be a bug in the Finder thread code. Why?
Think about it: safe data movement has been around since filesystems existed. However, the new Finder is multi-threaded. It could be that the error handler is doing the wrong thing with the thrown exception...after all, what -do- you do with an exception in a subthread? What mechanism do you use to throw it upwards to the parent thread?
That's the joy of error handling, which is totally separate (though completely integral) to your normal architecture issues.
Terrible bug. Entirely fixable I'm sure, but what about those who lost all their files?
As a user unlucky enough to run Windows you'll have to work around it by doing copies every time and only manually deleting the source entry when you're sure the copy has completed properly. Now what you need to do is be mindful every time you want to move a file anywhere.
Sucks to be a Windows user - I'm sure MS will have this fixed pretty quick but it doesn't help those who've lost hugely important files.
Okay, this is a terrible bug, but to me the real news is that the Finder has a move operation. I've only ever used the simple drag (ie copy) when transferring files to other disks. That might also be why I've never had this disconnection-delete problem.
The workaround is trivial - copy files until you're certain. In fact, I'd recommend doing that in all OSs anyway. Moves or cut-pastes are fraught with potential badness. I've lost files in Windows doing that, and always wondered what's wrong with just moving and deleting manually later on.
Why is every destructive computer bug that happens tagged with "haha"?
Data Loss Bug In OS X 10.5 Leopard
bug, macosx, apple, haha
Symantec Updates Cause Chaos in China
haha, security, bug, windows, feature
Banner Ad on Myspace Serves Adware to 1 Million
haha, myspace, pwnd, security, adware
Ubuntu May Be Killing Your Laptop's Hard Drive
linux, haha, storage, bug, spam
Islamists exploit buffer overflow, hack U.S. nuclear command; world doomed
eschaton, religion, waronterror, haha
OK, I made one of those up. But it doesn't even matter what OS or company is responsible for the problem - whoever makes the tags seems to take great delight in all computer snafus. How does the tagging system work anyway? It's always been mysterious to me.
Grr! Arg!
s/is/are;s/it/they/
~ Obi-Wan "Gramma Nazi" Kenobi
You can say that again, but good luck trying to have a reasonable conversation with the Mac fanatics! Myself, I've been sitting here at my freelance gig in front of a Mac (a Imac w/4 Gigs of RAM) for about 20 minutes now while it attempts to copy a 17 Meg file from one folder on the hard drive to another folder. 20 minutes. At home, on my Pentium Pro 200 running Linux 2.4, which by all standards should be a lot slower than this Mac, the same operation would take about 2 minutes. If that.
In addition, during this file transfer, Itunes will not work. And everything else has ground to a halt. Even BBEdit Lite is straining to keep up as I type this.
I won't bore you with the laundry list of other problems that I've encountered while working on various Macs, but suffice it to say there have been many, not the least of which is I've never seen a Mac that has run faster than its Wintel counterpart, despite the Macs' faster chip architecture. My 486/66 with 8 megs of ram runs faster than this 2.4 GHz machine at times. From a productivity standpoint, I don't get how people can claim that the Macintosh is a superior machine.
Mac addicts, mod me down if you like, but wouldn't it be better instead to post some intelligent reasons why anyone would choose to use a Mac over other faster, cheaper, (not to mention more stable) systems?
Er, haven't your read, the same problem occurs under Tiger too...
10.5.0 has only been out for a week and all I've seen so far are people bitching about 10.5.0's ultra lean firewall which has actually regressed from 10.4.10; the Java incompatibilities; the Trojan, dressed as a codec specially for the Mac and now fundemental problems copying from one volume to another external volume. Though it pains me to say it, it's a big software project which only gets bigger at every release and things will never be perfect from day one. Even Apple make mistakes. Long gone are the days when testing was everything. Face it, YOU are the test and hopefully, it might be fixed in a point release if enough people are vocal about it.
The problem for Apple is that if they manage to gain new customers who purchase Leopard, it'll be harder to hide behind some of Microsoft's recent own goals in Windows Vista when they have some whoppers of their own to deal with. That core, evangelistic following of everything 'i' will have a smaller voice against the swell of must-have junkies that might be tempted to switch because they already own an IPod or IPhone but cry foul when they see no real difference with their Windows experience. Apple sets itself up with such lofty values and ideals and at a measureable premium, no wonder people are upset with even the little things.
Someone should point out that by default, the Finder will copy files dragged to a different volume. You have to hold down a modifier (Command) to force a move operation. So while this is a severe bug that should be fixed immediately, it's much less likely to happen by accident than the article implies.
That's the rub -- not knowing about it until after you've lost irreplacable files.
Reminds me of this old poster I had on the wall with Moses looking down at a broken tablet, while thundering out of the cloud above him were these words: XI Thou Shalt Make Backups
A feeling of having made the same mistake before: Deja Foobar
Hunter Kressel has been warning people about this for years now.
I don't always use unix-like operating systems; but when I do, I prefer FreeBSD.
This story proves that BSD is dying along with linsux.
There fixed it for you.
1, how big is the impact of this bug? As far as I know, people barely do inter-volume move.
2, does the time machine thing bring the disappeared directory back?
There is a spark in every single flame bait point.
The other quirk that I really hate with Mac OS X, is that if you drop a folder with some data in it onto another folder of the same name in another directory with it's own data, all the data in directory you copy onto gets DELETED without so much of a warning.
I know this is a UNIX thing, but even Windows isn't that mean.
READY.
PRINT ""+-0
"This story proves that BSD is dying..."
No, in this case it's just the onset of a computer version of Alzheimer's disease.
In my own limited experience, the Finder is the single worst feature of the Mac. Its interface is really bad and losing data is just another manifestation of a rotten design.
Excuse me, but please get off my Pennisetum Clandestinum, eh!
This has been standard Mac OS operation for a long time. I know for sure that the same happens under OSX 10.4, and as I recall, older versions of the Mac OS (7/8/9) all did the same thing. Granted this is a stupid way of implementing file moving, the alarmist headline is a little unnecessary.
Go Here: http://developer.apple.com/bugreporter/ And File a bug. And They'll fix it.
There are 10 types of people in this world, those who can count in binary and those who can't.
Someone wanna clue me in on what I'm missing, here?
The blog post sure appears to be full of crap. I especially love the "pseudocode" that the move function "probably" looks like. The detail he has in the post is totally inadequate to implicate the OS itself.
that's bizarre. I love OS X, but I have no use whatsoever for the finder. it's not like it's actually a good file manager or anything. seriously, if the finder just disappeared one day it would be a long time before I noticed.
There's absolutely no reason that a modern "move" command shouldn't already be implementing the exact process you've just described, no matter where it is moving to.
+5 logical!
Is that clear? If you don't have a backup procedure in place, stop right now, whatever you are doing and establish one.
If you have not followed this advice and experience data loss, it is your responsibility and your fault.
macs are for HOMOs
There is a good chance the disk drive or the networked computer is giving the finder an "OK I got it" signal BEFORE the data is actually written to the physical disk drive. So it gives this signal, then the finder deletes the old data and then the disk drive "goes away" before the data is written out of the cache and to the drive. Don't blame Finder, blame those huge disk caches where many megabytes sit and wait to be written to the drive.
If this is true then the bug is im the copy of Samba running on the file server. We do not yet have enough information to know.
That's it, moving a file, network failure and poof, moved files deleted from the source. Most probably a bizarre coincidence, but after it happened a few times i now copy and then delete when working on a SMB network.
(Or maybe Samba has something to do with it?)
Why doesn't move act like copy and delete? Why must it delete right away during the moving?
Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
Only geeks would think that this is a bug!
It's always the human/machine-interface unit at Apple, who has the last word. By questioning their massive testing fleet of 'ordinary guys' they found out that 85% of their potential customers think of files as digital sausages (which can be sent through a series of tubes: the internet).
So Apple has implemented this feature just like a normal person(tm) would think. When moving he puts his file (the virtual sausage) into a tube, which is going to deliver it to another disk. When the tube is removed from the target before it can squeetze out the complete sausage, only a chunk of it is going be on the target disk - the rest cut off and stuck in the tube. So if you find posts like "How can I get the rest of my file out of the tube" you know what they are trying to express.
You could possibly find and fix it yourself (and submit the fix).
http://www.opensource.apple.com/darwinsource/10.5/
Does it fail in the same way with mv? And if so, is this maybe an expression of some BSD bug?
-fb Everything not expressly forbidden is now mandatory.
oh no apple has a flaw, the earth is gonna end
destiny, chance, fate, fortune; they're all ways of claiming your fortunes, without claiming your failures. -gerrard
Simon.
Physicists get Hadrons!
another lesson to be learned, don't disconnect drives while doing destructive commands.
try copy if you desire un-mounting mid copy.
god knows what OS X will do if you trying moving files while unplugging the computer.
hopefully slashdot will save a headline for that one
Sounds like he's living in a cave and using an old bicycle to deliver the energy for his server park.
This has been common on all OSes for awhile now -- not sure how it maps to Apple's "command" vs "control" buttons, but here:
ctrl+drag: copy
shift+drag: move
right-click+drag: pop-up menu with a choice between the two, or maybe more
(On OS X, it's been awhile, but I'll guess that command+drag is copy, and ctrl+drag is pop-up.)
Similarly:
select, press 'del' key: (usually) prompt for move to trash
select, shift+del: delete immediately, or prompt to delete -- permanent, no trash
Don't thank God, thank a doctor!
/me clicks link to read story.
"Error 500 - Internal server error
An internal server error has occured!
Please try again later."
Webmaster needs to be reminded not to demonstrate this bug to people on his production server.
You heard me!! This never happens to Microsoft products! Never! Bugs don't exist! Patches are our friends! Our Data is secure on NTFS. Steve Ballmer knows what he's talking about! Boycott Apple products and Steve jobs. Make the switch to MS! You'll regret every moment you don't do it and after you'll feel the same on MS!!! So make the switch to Linux/Unix! You just won't be able to play games or get devices to work right! So make the switch to Plan 9! You'll regret every moment you try to understand and use such a stupid operating system. In fact the smartest thing you can do is uninstall it. You're saved data? Well, there was none to begin with.
Apple just wants you to use the Time Machine to look for it ;)
signature is pants
In any case, you should be using Shadow Copy...er...Time Machine which would have protected you from going and losing track of your own files.
Great! So now not only don't we know where our data is but when it is. Perhaps in a week or two's time the data will materialize in the folder it was supposed to be moved to with an accompanying "whorping" sound coming from the speakers?
Very old troll posting.
Similiar to the FreeBSD IS DIEING netcraft comfirms it... troll posts that are cut and pasted.
Ignore him and moderators do your job.
http://saveie6.com/
I swear I saw a post almost exactly like this on the Craigslist Apple forum one day about 8 months ago, this one has been slightly edited, but pretty much the same thing. Almost like a copy...
And I agree with the other reply, it really sounds like a hardware issue or possibly a corrupted file is in the batch you are copying. A 17MB copy or duplication on the same drive on my 1.67 PowerBook G4 takes about 2 secs. Maybe try the copy one at a time and see if you can ID any corruption.
Or, boot from the install/restore disc that came with it: insert disc, File>restart..., then hold the 'option' key down when you hear the chime, wait a min, select the hardware test button and run the tests.
See what happens.
I am absolutely amazed at the comments that seem to be proposing that Time Machine is a reasonable solution for this. As if a backup feature cancels out a bug that makes files go *poof*. If Ubuntu did this (or any large FOSS distro), they wouldn't be able to live it down. And if Microsoft did it, well...it'd be another Monday, I guess.
Geeks like to think that they can ignore politics, you can leave politics alone, but politics won't leave you alone.-rms
Speaking as one of those IT people, NTFS is probably one of the coolest pieces of software ever to come out of Redmond. ACLs, alternate data streams, directory junctions, single-instance stores, shadow copy, the list of useful features is huge. Even more surprisingly, it works pretty much as advertised. Frickin' cool.
There's another angle, though. On paper, Vista's NTFS-based backup technology walks all over Time Machine. However, the USABILITY of Vista's technology is crap. This morning, I enabled Time Machine by plugging in a USB drive and clicking "Use as Backup Disk" when prompted. To do restores, I launch the cleverly named "Time Machine" application. I've already used it twice today just because it's fun to watch the spacey animations.
Compare that to Vista's clunky "Backup and Restore Center", which you have to use if you want to backup your files on an alternate volume. I guarantee you that using "Backup and Restore Center" is beyond most average users. Sure, it might be "better", but what good is it if it never gets used?
This
I thought the slow copy problem in Vista was horrible, but it is nothing compared to this horrendous bug in Leopard
How can you have a 5-digit UID and still have never seen the 17MB troll? Did you buy your account on ebay? P200. How old do you think the troll is?
Put identity in the browser.
They are on a very strict diet of bullshit, you know.
Government's idea of a balanced budget: take money from the right pocket to balance...oh who am I kidding?
The workaround for this is to not use Finder, basically.
Apple, fix the fucking finder. At the very least dig the fucking source code to the NeXT file manager out of the crypt and put it up under the APSL so we can take over for you with a file manager that isn't based on the rotting corpse of Classic Mac OS.
Finder is pretty much the last revenant shred of the grave-cloths of the old Mac. We know you're really really into it, but it's really really bloody horrid. Let it go to its rest, 'kay?
On OS X Tiger. I tried doing a move (command-drag) to an AppleShare IP volume I had mounted, and then pulling my ethernet jack in mid copy. Got the beachball of death. Could no longer eject my CD. The right side of my menu bar stopped responding to clicks. The Finder crashed and relaunched, leaving an orphaned Spotlight search window which forever hung there in an unusable state. Pretty much everything that could go wrong, did go wrong, short of a kernel panic, EXCEPT the original file was right there where I left it -- no data was lost. Perhaps in pre-Leopard versions of OS X, the Finder was just too flaky for anyone to get as far as discovering this bug? After all, if your Finder tends to crash and hang-requiring-a-force-quit whenever you pull a volume mid-copy (especially network volumes, which face it are the only place this is at all likely to happen accidentally) -- then it's not going to get as far as remembering to fuck you over in the way its buggy programming dictates. Leopard's Finder doesn't hang on network problems; therefore it is free to happily and incorrectly erase your data. If I *ever* used command-copy, I think I would prefer the old behaviour, but seeing as there is NO GOOD REASON to ever use this modifier key, I don't much care. Didn't anyone else have a moment of pause in contemplation of executing a volume-to-volume move, thinking, yeah ... yknow what? I just don't trust hard drives THAT much. I want to verify that the copy looks kosher before I pull the trigger on the delete. This is the way I've always felt about that function. This is not to excuse Apple for fucking it up -- I'm just saying that this bug is extremly, extremely obscure in my view, though quite potentially destructive.
Oh and by the way, for those of you constantly complaining that copying a folder COMPLETELY replaces the contents of the one with the same name ... if you only knew, how much time I have spent over the years digging through unexpectedly 'merged' folders on Windows systems to separate out the intended wheat from the should-have-been-deleted chaff, you would realise that this is simply a matter of habit and of taste. There are way more instances when I want a folder to replace another completely, then to have them merged. When you know what your OS is going to do then there is no problem (and the Mac OS has NEVER wavered from its approach, and I'd like to remind you that drawing an analogy from the file behaviour, what happens with folders in the Mac OS is exactly what you would intuitively expect to happen had you not been trained on a conflicting system).
If the Mac swiched to the Windows/LINUX way now, I would end up wasting a WHOLE lot of my time picking merged folders back apart. For the sake of something which, to me, makes no intuitive sense, anyway. YMMV.
You can pull a USB drive out.
You can kill smbd on another Mac.
You can pull your bloody network cable out.
don't disconnect drives while doing destructive commands.
It happens. You're right, this is only a problem when you're faced with an unexpected I/O error. The thing is, when that occurs, you're supposed to recover from it and NOT complete the copy-and-delete as if it hadn't.
This troll has been going around the slashdots for near on ten years now.
http://www.kottke.org/98/11/my-mac-sucks
I believe this is the original version. You can see that with a little modification it becomes an easy trap for internoobs, producing much lulz.
I may make you feel, but I can't make you think.
I think there might pe a broplem with your keypoarq.
I don't want to start a holy war here, but what is the deal with you Leopard fanatics? I've been sitting here at my freelance gig in front of a fresh install of Leopard (on a iMac w/ 2 gigs of RAM) for about 20 minutes now while it attempts to copy a 17 Meg file from one folder on the hard drive to another network folder. 20 minutes. And it lost my files after my cat decided to pee on my Airport base station. At home, on my ancient Alienware Quad-Core running Vista, which by all standards should be a lot slower than this machine, the same operation would take about 2 minutes. If that. And not lose my data. In addition, during this file transfer, Finder will not work. And everything else has ground to a halt. Even iTunes is straining to keep up as I type this. I won't bore you with the laundry list of other problems that I've encountered while working on various file transfers, but suffice it to say there have been many, not the least of which is I've never seen a Leopard that has run faster than its Longhorn counterpart, despite the Leopards's faster leg architecture. My Vista box with 8 gigs of ram copies files without data loss better than this 4000 mhz machine at times. From a productivity standpoint, I don't get how people can claim that Leopard is a superior operating system. Leopard lovers, flame me if you'd like, but I'd rather hear some intelligent reasons why anyone would choose to use Leopard over other faster, cheaper, not-going-to-lose-my-files-during-a-transfer systems.
Tard.
For all intensive purposes, "whom" is no longer a word. That begs the question, "who cares"?
I don't move them, I put them in the trash, thén move them to another partition. If something goes wrong, it's still there, if everything's going to plan, it's already in the trash. Stupid, but works for me. Sinds '96 :)
All those moments will be lost in time, like tears in rain. Time to die.
Well I don't believe that I am here to flame, although I am sure there will be others that say otherwise. I cannot for the life of me believe that there are Mac fanatics out there that are actually trying to defend Apple with a serious bug like this. If this bug actually is a real one then this is a serious problem. You have to be able to rely on your operating system to provide you with the most fundamental operations. Apple's developers are human, and humans make mistakes and have bugs in their code. I am certain that Apple will fix this bug quickly as well. I am just surprised how blind people can get when they get caught in the hype of a company that they believe can do no wrong. No company can do that. I can only imagine what these same people would say if Vista had the same bug. For me I use Linux (which also has plenty of bugs, but anyone can fix them).
I've been using a Mac user since System 6, and never knew about the command-drag behavior. Of course now that I do know about it, I can't actually use it because of this bug. But, um, theoretically speaking it sure would be handy.
As I said on tomkarpik.com:
I had a horrible time installing Leopard. I tried to Archive and Install preserving network and user settings, and at the end I got a "OS X 10.5 Install Unsuccessful. Could not migrate previous user directory. Press here to reboot and try again." I rebooted and tried an upgrade instead, only to find that archive and install had only copied part of my home folder but already moved it, and upgrade deleted my old home folder. It did not save my documents folder or desktop in the previous system folder. I blog about it here: http://problemstosolve.com/os-x/leopard-archive-and-install-wipes-away-documents-unsolved/ Another problem I have about Apple's copying is how there are a number of errors that will make it fail in the middle of a large copy, and you have to start all over again. These include file names that are too long and permission/file in use errors. If I'm copying 48 GB and it fails halfway through, it just quits, and if I fix that file and start over, it may just fail again on another file. I've found rsync and ditto to work somewhat better, and the free GUI tool iBackup to be the best at doing complete copies and logging instead of quitting.
I've used macs for a long time and I rarely was stuck when non-recursively merging two folders:
Open folder A
Open folder B
Select all
Drag into folder A
Pick Replace
Recursive merging, thats what rsync, psync, pax, or ssync are for.
My expectations are such that I never was surprised by the folder replace option; same name files replace why wouldn't same name folders? Its consistent (plus I learned to read dialog boxes.) A non-recursive merge is manually possible in a few intuitive steps. A recursive merge that doesn't complicate the GUI for beginners I'd like to see. Now if you learned conventions from other systems I don't see how you can expect a 'beginner friendly' system to follow those conventions when their target user is not you.
Democracy Now! - uncensored, anti-establishment news
As long as a process can see the starting inode of a file, one can start to copy it. Once a program copies after inode 0, it can procced to the next linked inode. Easy enough.
/here /there || true && rm /here
While this process is copying, we can use the "rm" program which removes inode 0 from the superblock tables. inode 1 still links to 2 and on and on. rm just removes the start block.
I'm betting that Apple's finder does exactly this: cp
This reminds me of a lesson I learned A LONG time ago. Doing a move operation on important files is a BAD idea. In my case it involved Windows NT Workstation 4.0 and a Novell 3.12 server, but I'm sure the result was the same. Some files made it, some that hadn't been moved yet were still there... about twenty or so files out of a couple thousand were simply missing. The next couple of hours were spent archiving and recovering data from a backup tape. I don't think that you can really blame Apple for hardware failures. It's not like Macs come with Battery-Backed Write Cache enabled RAID arrays.
Your post is hilarious! You clicked OK without reading the dialog, then call the behavior "insane" because it doesn't behave like the Windows File Manager.
Hee hee hee hee hee hee...heh.
I'm installing KDE just so I can go into a K-hole.
Reading that resulted in me just having the textual equivalent of someone calling my name and it not being for me. Yeah yeah, ot, first post, etc.
I encountered this error last month. I lost 195gb of data.
I was moving an 8gb folder from my iBook to my external drive. The drive was connected to my iBook via firewire. I'm not sure what went wrong because I was hurrying but I noticed that the transfer wasn't working so I cancelled it. I tried it again and after a while it began moving 195gb of data, but I was only transferring a 8gb folder. I immediately hit cancel and 195gb on my DESTINATION drive disappeared.
I spent a week and a half using every tool known to Mac to get that data back, but it was gone. I believe these bugs are related, but unlike this one I was never able to recreate the other bug. I had always attributed it to user error because I was rushing or hard drive read/write errors. The drive was totaled after this. Bad blocks everywhere. Now I wonder if the bug caused the hard drive errors. It would be nice to have Apple to blame. I lost a big video project when that drive failed.
I realize we take our chances with ephemeral digital media, and I certainly backup all my personal data, but this project was enormous. I didn't have room to duplicate it on another drive. Sure hope all this attention gets the fire under Apple's butt to look into this problem and fix it.
The Splintered Mind - Overcoming
The Finder does have an Undo command. Work's fine over a networked drive too.
That's a pretty big tip to the iceberg but in fact it's a lot worse.
1. All Cocoa file operations are written to fail if the destination exists. Think about it: there's no way you can overwrite any file (or complement any directory) with Apple's current API. If a Unix file doesn't have the 'w' bit set you get sent away; in Cocoa this situation can never occur. At all.
2. The sanity check code that any self-respecting file system normally has is totally absent in Apple's rewrite of NeXTSTEP. Both NSWorkspace and NSFileManager can do almost anything to corrupt a file system. Cyclical operations aren't caught and neither are no-brainers like trying to overwrite a directory with a file and so forth. These issues have been brought to the attention of Apple many times but are always summarily dismissed with 'works as designed'. Personal comment: if that's truly 'works as designed' it's got to be one of the crappiest designs ever.
3. Any number of third party applications such as file managers, editors, M$ Office apps, et al each have their own sanity check code to prevent file systems trying to overwrite themselves, overwrite directories with files, and so forth. None of this is integrated into the file system APIs where it should be.
4. At least earlier versions of Finder would fail on some cyclical operations out of pure dumb luck: trying to copy a directory onto itself would not result in a diagnostic that the user is round the bend but that 'the destination is currently in use by another process'. There is no other process - it was the Finder not knowing its right arm from its left.
5. GNUstep code is not written like this what I've seen. At multiple levels the GNUstep code is going through the same sanity checks all over again. It's redundant but it's also very careful. It's not only that Apple show no such care but that by all accounts this code used to be in NeXTSTEP/OpenStep but at some time after the NeXT/Apple merger was ripped out. Some of it perhaps migrated to Arno Goudrol's Finder; some of it may have been dropped.
A file system API provided by the OS vendor that does not protect itself is not much of an API. This is not only about user error through a file management tool: these APIs are exposed throughout the system and can be used by any application in the system; and the slightest error in any third party application can hose the HDD whilst the file system APIs stand back and refuse to comment.
Apple's first ever build of Safari contained a fatal flaw: using comparable APIs Safari somehow managed to hose the user home directory with a download - another case of a file overwriting a directory. Within hours people were aware of the issue and within hours Apple silently replaced 'build 48' with another 'build 48' and pretended nothing had happened. Smart users compared message digests and discovered that Apple had made a replacement without commenting. To this day Apple refuse to comment on the issue.
File management the Apple way is downright stupid: it's ripe with dangers not present in other more prevalent systems and the risk of massive destruction is always imminent. You have to wonder - especially in light of this latest disaster - what exactly they think they're doing. Cover Flow is not a lot of fun if there are no files left to browse.
I'm sure I can remember seeing a similar situation under Solaris 2.5.1 many eons ago, and it's nothing new under SMB/Samba. Finder is still appalling with network drives - try mounting your iDisk on the Desktop, which is quite easy to do by mistake if you have a .mac account, and go and make a drink while the OS tries to come to terms with connecting to a WebDAV device several thousand miles away.
This is actually a problem in the way that BSD based Unixes handle files. In fact mv[8], which is still the underlying command here, is stateless, and sequentially writes to destination and deletes from source until the filehandle closes, so if *anything* interrupts the process, the state of the file will be incorrect in both source and destination, which I would guess (I haven't looked too deeply into Unix filesystems for a very long time) would affect the way in which it is reported to the GUI: you would end up with a chunk of data that is missing inode information at both ends but that is still on the disc, so the GUI just stops reporting it. I can definitely recall this happening in CDE/Motif in Solaris 2.5.1.
However, unless you're telling it otherwise like you are here, the default action for transferring data to any external drive is copy rather than move, which is *safe*. If you want verification, use rsync, which was invented partially because of these issues over SMB/Samba.
So in short, nothing new here. It's not an acceptable situation but it's an existing problem, and it's been found in Leopard because it's the latest version of the first genuine mass market Unix based OS.
Sometimes I wish I wasn't so sensible.
I don't think this is an OSX specific bug. Just this weekend I moved some video files over from a Windows desktop pc to my also Windows media pc (Windows based custom box) to a shared folder, then I went out for a tea, came back in, and I forgot the move was in process, and I switched off the media pc. About half an hour later I went back to my desktop pc, to see an error message about a failed write, then all the files I wanted to move have been deleted from the desktop pc. Checking the media pc, the first file was there, but damaged.
I am putting myself to the fullest possible use, which is all I can think that any conscious entity can ever hope to do.
First: This bug is inexcuseable......
/Cycler
But still.... if anyone is MOVING data then they should now that this can happen...
If you want to move a directory tree you ALWAYS _COPY_ the tree to the destination point.
AFTER it's finished you can check the directory size and number of files to ensure that everything
is copied. THEN you delete the original.
This is also faster then to move individuel files.
I've had Windows truncating MP3-files with coping aswell.... guess nothing is perfect...:)
Speaking of perfect, a big apologize for my bad english. I'm in a hurry and I feel this post isn't one of my
better ones regarding language...
First of all, files should never be deleted, they should only be hidden, unless the disk is full, of course.
Secondly, "move" across different devices should be copy and then delete.
Thirdly, if you copy a folder over another one with the same name, the computer should ask you what the purpose is: merge or replace? merge is often as catastrophic as replace if merging results in undesirable file combinations.
Forthly, files should be versioned by the O/S, as in VMS. It was a great feature, I don't know why it's missing from all modern O/Ses.
With the first link, the chain is forged.
When I am booted into OSX(86), I don't use most of the GUI utils for simple operations. So everyone who uses
/Volumes/newdir; tar xvf -) ...probably won't run into this bug.
sudo tar cf - . |(cd
This is a bug with the FINDER ONLY, just so everyone is clear. The Unix "mv" command in Leopard is NOT affected by this.
http://www.macintouch.com Obviously this is the front page story today.
This only affects "move" operations between logical volumes. You have to hold down Command while you're doing this, inside the Finder, to get this to happen. Yes, it's a bad bug. It's not something, however, that you're going to run into if you're thinking sensibly about how you treat important data, or if you didn't know that the Command-drag functionality was built into the Finder (which I didn't, and I can't think of a time when I would use it now that I do, even if it was working correctly).
I vaguely remember, in the timeslieceocene era of Win95 encountering exactly the same bug, but wouldn't that mean ????
it couldn't be.......
Nooooooooooooooooooo!!!!!!!!!
Remote File System semantics are HARD. Very hard.
It is not at all clear that Windows (CIFS or SMB) semantics are correct.
NFS is more so, but users tend to subvert the protocol (early "OK" returns) for performance.
NFS allows a power fail on the file server, and have the server rebooted (after possible repairs), without affecting clients (except for a potentially long delay in calls).
But then, users complain "NFS causes my application to hang up". Basically this move problem cannot be solved without an end-to-end solution. Which isn't in the CIFS/SMB design. Which is also why I am frustrated that Microsoft doesn't include an NFS client fs (I don't know about Apple).
(And, it forces me to put SAMBA on the file servers as well).
Just another "Cubible(sic) Joe" 2 17 3061
doesn't mean todays hot shot 80 grand a year 'senior software engineers' will think to test against it.
Old-hand Mac users like myself have not even developed any sort of habit yet to use the "move" command since it is relatively new. The procedure has always been: drag to make a copy, then delete the original manually.
But Windows has had moves for much longer, so users who start there expect it to work the same over in Apple territory. Wham!
The HORROR!
I can already see the headlines: "USER TELLS COMPUTER TO DELETE STUFF AND COMPUTER DELETES STUFF".
This must be among the most stupid things I've ever read on Slashdot. And while we're at it, your statement applies to Windows, Konqueror and Nautilus, too - which file manager does merge the contents? None that *I* know does. No, Windows doesn't, no matter you are claiming in your post.
Who is General Failure and why is he reading my hard disk?
The fact that someone mentioned complexity associated with command-line actions means the conversation is over. Apple's model for file copy has NOTHING to do with the command-line, switches or flags. That complexity is abstracted from the customer.
rsync is VERY powerful. VERY powerful. In order to glean benefit of that power, you have to be educated about how to use it. Could Apple have defaulted the app to use the "include apple-specific-stuff?" Sure. Should they have? Probably.
Regardless, rsync is HARD and complex for "joe sixpack" and it's not simpler for him to run
rsync -e ssh --recursive -l -t -g --compress * joe@destination:dest_dir
than it is to run
rsync -e ssh --recursive -l -t -g --compress * joe@destination:dest_dir --includeAppleSpecificStuffHere
It's the same to them - all gibberish.
But Herr Heisenberg, how does the electron know when I'm looking?
Maybe Steve Jobs should get the guys at Microsoft to check over their code. Sounds like they can use a bit of help, since Apple's Quality Assurance department isn't assuring quality.
But hey, what good is grossly overpaying for a computer, then a service pack, if it doesn't break all the time? When you have either Apple or Teh Lunix, you need to carry that cross on your back. And make sure everyone knows it's there, of course- it's not worth using teh lunix or Apple unless you make sure everyone who will listen knows you are using teh lunix or Apple.
Woosh
Why not rename the old folder to "old version of name" or something like that?
I agree with several posters here that the Mac is being more consistent but I also agree that it can destroy a lot of data.
Several have stated that dragging the contents of one folder to another will duplicate what Windows does, but this is not true. If there are subfolders it will replace them in the destination, while Windows (and rsync and cp and tar) will merge the contents of the subfolders.
Something that would be consistent would be to have any attempt to replace something of the same name pop up a question box that asks what to do. The exact same question would be asked for *both* folders and files:
replace = this is what the Mac does all the time, and Windows does with files
don't replace = don't make any change
rename old one = rename the old copy so it does not interfere with new one or any other files.
rename new one = rename the new copy
merge = this is what Windows does with folders. However this could be applied to *any* file, provided the program that owns the file knows what to do. I could imagine a user wants their Word documents by the same name concatenated. If merging is not possible then it does rename or something.
It will pop up this file for every file, and if merge is selected it will recursively pop up this box for files inside the merged folders. Add the Windows-style "do this for all files" checkmark so the user does not have to put up with this.
Renaming on the same device (partition) may be trivial using the rename() system call but copying between devices isn't especially if you want good performance and in any case it's hardly worth the effort to reinvent the wheel err mv. The overhead of exec() clearly does not matter in this case as it's completely neglible compared to the human latency and you can see that you don't need to execute mv once per file but only once per selection. In fact, many file managers do exactly that. They use cp, mv etc.
Apple bug - "Oh it's ok it'll be fixed soon." "No big deal, you can just work around it"
Vista bug - "OMG hahahah Windows sucks!!!" "Vista is horrible, they can't even program"
Keke
http://discussions.apple.com/thread.jspa?messageID=5766747� It's been around a while now...which is scary. I love my mac's but that's not a good thing to keep in the system. This is NOT a fix, this is just annoying.
You mentioned Apple and something sexual in the same para. By default, Apple fanbois think you are saying they are homosexual. Probably, guilt conscious. Just watch what happens to this post! 3...2...1...
...but I don't want the Zealots of Mac (tm) to mod me down to -1, Flamebait.
668: Neighbour of the Beast
Sheesh, whine whine bitch bitch.
it's Mac OS X, in order to run into this bug, you have to override the default behavior of the OS.
if you drag and drop from one valume to another it always copies. then delete if you want. if the extra step of changing the behavior to move feels faster than the extra step of delete then cheers to you finding it.
Dear Apple Applogist Fanboi
What took you so long to make a splashing entry in this thread apparently discussion something bad about Apple and Mac? Perhaps, you were listening to cool funky music on your cool funky ipod drooling over cool funky Steve Jobs' speech on your cool funcy iphone. And thats perfectly fine.
And thanks again for enlightening all of again that the fault is _ACTUALLY_ with Windows again. Mac OS is perfectly fine, and just works.
Regards,
A Windows luser
I found another one (well actually one of my customers did, by accident). It has been around for some time now.
Imagine the following scenario:
1) Mount a CD (or network volume, firewire disk, etc...) and copy the files you want to work on to your Mac. You can also duplicate an existing file to work on a duplicate.
2) Go to the program you want to work in and open the files (don't doubleclick them in the Finder, open them _from_ that application!).
3) Do half a day worth of work in that program (not essential to reproduce this bug, but that's what my client did). Save your work.
4) Then go to the Finder and accidentally press Apple-Z (undo). Then watch in horror as you see all your modified files disappear into nothingness...
(I would expect the Finder would be able to see the file has been modified but it doesn't take that into account.)
Verified in 10.4.10. Haven't got 10.5 yet, maybe you can try it there?
I've sent this to Apple (although not "officially" as a bug but as feedback) but so far the problem is still there.
Then it would have rhymed with "gold digger" and with a word considered offensive.
Furthermore, The Walt Disney Company manages a famous fiction franchise "Winnie the Pooh" that includes a character named Tigger. This franchise generates more revenue than the Mickey Mouse franchise that Disney originated. Because Apple introduced Tiger (April 2005) before Disney bought Steve Jobs and Pixar (January 2006), there might have been a lawsuit had Apple used the "Tigger" name at that time.
That's what I've done since the earliest years of PCs such as the TRS-80: copy the directory to the destination, check that it all arrived, only THEN delete the original.
I mean, its not like anything important is going missing like _Deleted_ or _Deleted_ or _Deleted_. Heck, I never really needed _Deleted_ in the first place. But I will miss that _Deleted_ on my _Deleted_ that I shared with _Deleted_ at the _Deleted_. I doubt any of that was work safe or even legal. At least it wasn't _Deleted_ or _Deleted_ or _Deleted_ or that stuff on _Deleted_ where they _Deleted_ or IRC where _Deleted_. Man those people are sick _Deleted_ in the head.
The Rapture is NOT an exit strategy.
I've been using rsync to back up 3 macs (g4 mini, g4 ibook, macbook) to the same firewire drive for years, on 10.4.
Perhaps in your father's case PEBKAC?
I don't have the error message handy, but rsync would puke with nasty internal errors, consistently, on the same four or five files out of the tens of thousands it was operating on. Google confirmed that it was a problem with Apple's build of rsync, and investigation of other rsync builds turned up no viable solution, i.e. all the other builds had their own shortcomings or missing features too.
--fw, on another account
...presently, however, the entire Apple campus has more serious concerns. Namely, debating whether to make the new reflective dock more opaque and less reflective, or more reflective and less opaque. No decision will be made in this more pressing matter until all viable options have been weighed and cross-checked violently against the Human Interface Guidelines by interns prepared to impale themselves upon the nearest pixel for The Cause, or until Steve Jobs has a screaming jag and fires some poor sap who didn't genuflect long enough. Whichever comes first. For now, don't move any files, mmkay?
Its been like this (loosing data while transferring things to a device that disconnects) for a while they do need to fix that part of finder. People have been literally screaming for it.
A bug update from Apple for MacOSX 10.5.1 arrived this morning. Looking down the list we find the following relevant fix noted:
"System and Finder: Addresses a potential data loss issue when moving files across partitions in the Finder.".
Let's start testing it boys and girls and report back on how it went... Thanks.
http://docs.info.apple.com/article.html?artnum=306907