Slashdot Mirror


Sharing a Firewire Drive Between Mac and Linux?

jhealy1024 asks: "I was getting short of disk space on my iBook, so I got an external 100GB FireWire drive to expand my storage space. It works like a charm, and so my storage problems are relieved -- for now. Then I realized that my Linux server has several IEEE 1394 ports on it -- maybe I could use the drive to back up files from my Linux server as well! Unfortunately, after an afternoon of frustration, I haven't been able to do it. The problem seems to be that there are no (fully working) formats that both the Linux box and the Mac can use. HFS+ and UFS are supported by both machines, but write support on the Linux side is reportedly still in beta for both. I don't feel that I can trust it yet for backing up files. I've tried UDF, but the versions aren't compatible (Linux likes 2+, and OSX only goes to 1.5). Not to mention, Mac OS doesn't seem to like a whole block device formatted as UDF (mmm... kernel panic). The closest I got was by using FAT32 as the partition type, which does work on both machines. Unfortunately, the max file size is 4GB, which won't cut it if I use the Mac for DVD mastering or DV editing (20 minutes of video == 4+GB). I know I could just partition the drive, but I'd really just like to share files on one device (especially things like MP3s). Has anyone found a good way to share physical devices between Mac OS X and Linux?"

23 of 56 comments (clear)

  1. You may need a "transfer" partition... by Analog+Penguin · · Score: 2, Informative

    HFS+ support for Linux is almost non-existant. There are tools to do it, but they're kludgy. HFS (no plus) is supported, IIRC. Your best bet may be to have a separate HFS partition and use it as a temporary storage disk--mount it in OS X, copy files to it, mount it in Linux, get the files off, copy any Linux files you need in OS X to it, etc.

  2. Could UDF be the solution? by Matthias+Wiesmann · · Score: 2
    One format that seems to be supported by both Mac OS X and Linux is the UDF format. This format is
    • Standard.
    • Designed for large data sets (1 GB).
    • Designed for large file transfers.
    That said, UDF is usually used in DVDs and I don't know if and how a firewire drive can be formatted in UDF, but it might be worthwhile to check it out.
    1. Re:Could UDF be the solution? by raxhonp · · Score: 2, Informative

      It's not going to help it, see its post:
      I've tried UDF, but the versions aren't compatible (Linux likes 2+, and OSX only goes to 1.5). Not to mention, Mac OS doesn't seem to like a whole block device formatted as UDF (mmm... kernel panic).

  3. hmm, windows + mac? by Hadlock · · Score: 2

    i'm in the same boat, but with a mac & win98/2000 box.... anyone have any idea how well an OS X 10.2 box plays with a NTFS(+?) (i think) filesystem hard drive? i have yet to play w/the firewire drive and windows, as i don't want windows trying to format everything on my 100 gig drive. i'd rather not have to buy any "read mac formats on pc!" software...

    any help/suggestions?

    --
    moox. for a new generation.
    1. Re:hmm, windows + mac? by MrResistor · · Score: 2

      First of all, if OS X were FreeBSD, samba support for it would be way past beta by now.

      Secondly, FreeBSD doesn't use the Mach kernel, it uses the BSD kernel, although newer versions of Mach are binary compatible with FreeBSD according to the Mach4 homepage.

      Lastly, Samba has always been for accessing windows drives over a network. It's a free version of SMB, a protocol developed by MS and IBM for transfering data across a network. It has never been for use with internal drives, and probably never will be, because it is a network protocol.

      --
      Under capitalism man exploits man. Under communism it's the other way around.
    2. Re:hmm, windows + mac? by Valdrax · · Score: 2

      It doesn't play with NTFS -- not at all. Nothing does as far as I'm aware.

      --
      If it's for-profit but free, you're not the customer -- you're the product (e.g., the Slashdot Beta's "audience").
    3. Re:hmm, windows + mac? by Midnight+Thunder · · Score: 2

      Format the disc in FAT32 and it will work with MacOS X, Linux and Windows.

      --
      Jumpstart the tartan drive.
  4. Simple solution...not the best though by cuyler · · Score: 2, Informative

    Not the best solution but a solution never the less would be two partitions on the disk. One parition set up as HFS+ for the DVD mastering since you require support for large files and another as a FAT32 for sharing of files between the Mac and Linux systems.

    Since you didn't mention DVD mastering on the Linux box I'll assume you don't do that. HFS+ read support is support under linux (write support has a warning of being dangerous the last time I compiled a kernel). If required you could still back up the large files from the DVD mastering partition to the Linux machine - you just couldn't safely write them back (you could use something like sftp, or rsync to copy them over an network connection if required later on).

  5. More things I've tried (from the poster) by jhealy1024 · · Score: 4, Informative

    It's been a while since I submitted this article, so I'll bring you guys up to speed on my other attempts:

    While I appreciate the two-partition suggestions, they're not quite what I'm looking for, as I don't want to split the disk in half for the two different machines. The "transfer partition" (a small partition in HFS that both machines can read) idea is a good one, but when I get to that point it's easier to just network the machines together and copy the files rather than waste the disk space.

    On that front, I've tried NFS and Samba between the linux box and the ibook, without much success. I suspect it may have to do with large file support on the linux side.

    The NFS mount works okay, but then randomly craps out (I get read errors) on large files. I've tried tuning the NFS connection params (different version numbers, TCP/UDP, buffer sizes) without much luck.

    With Samba, I'm smacking into the large file size limit on linux. I wanted to try an SMB mount from the linux to the ibook. The ibook seems to be exporting the full sizes on the files, but the linux size can't see files over 2GB. I've recompiled Samba on both, but that didn't help. Therefore, I think I need to patch my kernel for large file support in SMBfs and try again.

    I just bought Jaguar, so I'm hoping that I might get a little help in the new release. Also, I haven't tried AFS yet... =)

    1. Re:More things I've tried (from the poster) by BitGeek · · Score: 2



      Well, there's one thing you might try: instead of sharing the drive between two machines over firewire, share the *machines* over firewire.

      Since you seem to be working with video, its no surprise that ethernet isn't working (over smb). And the file format issues are going to always be suspect (in my mind) even if both machines officially supported the same format.

      So, what I would try to do is network the machines using firewire and Firewire IP, and then share the drive using whatever protocol works from the Mac to the Linux box.

      The big wrinkle of course is whether both support firewire IP. I'm not even sure the Mac does, and IU suspect Linux doesn't yet, but I could be wrong. It seems to be a pretty new standard.

      --
      Yeah, and you guys panned the ipod too: http://apple.slashdot.org/article.pl?sid=01/10/23/ 1816257
    2. Re:More things I've tried (from the poster) by earlytime · · Score: 2

      How is using "firewire IP" (whatever that is...) different from using "ethernet IP"? If there's no common filesystem that both machines can handle, you still need NFS or SMB or something similar to share filesystems.
      Connectivity is not the issue, it's compatability. Unlike USB, firewire allows more than one cpu on a chain, so both machines can see the drive on the same firewire chain.

      --

  6. Re:sharing between Linux and Mac OS X by MrResistor · · Score: 2

    Mac OS X should be able to see all partition types that FeeBSD can see. Linux too.

    I was thinking that, too. I have no experience OS X, of course, but everybody keeps talking about how it's a *nix. It would be pretty lame if something as dumb as support for open file system formats was the thing that killed that notion.

    --
    Under capitalism man exploits man. Under communism it's the other way around.
  7. Re:Low and dirty by divbyzero · · Score: 3, Informative

    In spite of the hasty moderation, this is not a bad suggestion at all. Captain Pedantic was suggesting to use tar in the mode which writes directly to the disk without any filesystem. Tar has this ability primarily so that it can write to tapes, which don't have filesystems, but it can be used with any device. Since tar uses the same format on both OSes (or at least GNU tar does, which is available for both), the data should be available to both. Plus, tar works well with big files. The big drawback is that this will only work for backing up and restoring; you can't use the files directly from the disk with any program other than tar.

    --
    But my grandest creation, as history will tell,
    Was Firefrorefiddle, the Fiend of the Fell.
  8. HFS by fault0 · · Score: 2

    Why not just format the drive as HFS (no plus).

    Does MacOSX still support it, or did Apple drop support of it?

    The last time I used HFS with Linux, it was fine. Back then, there was NO HFS+ support in Linux, but apparently there is some now.

    Another solution might be fat32... does MacOS have any support for it? I used to be able to use fat32 formatted zip drives way back when in classic MacOS. Unfortuantly, I don't have a mac anymore to test any of these things with.

    1. Re:HFS by fooguy · · Score: 2

      HFS Classic has a 2GB Size Limit, which is worse than FAT16 (4GB).

      Speaking of, the poster made an error. FAT32 does not have a 4GB partition limit - FAT16 does.

      --
      "All I ever wanted was to see Larry Wall give Bill Gates a Perl necklace."
      http://www.eisenschmidt.org/jweisen
    2. Re:HFS by Keith+Russell · · Score: 3, Informative
      FAT32 does not have a 4GB partition limit - FAT16 does.

      The poster was talking about the file size limit, not the partition size. I double checked MSDN to be sure, and both FAT16 and FAT32 limit files to 2^32 - 1 bytes. It's a shame OS X can't use NTFS. The file size limit there is 2^64 - 1 bytes. That much pr0n and MP3 can kill a man. :-)

      --
      This sig intentionally left blank.
  9. No filesystem at all? by fm6 · · Score: 2, Interesting
    You know, you don't need a filesystem to use a disk. The filesystem just makes it a lot easier.

    One approach: Use tar to create an archive in the raw partition. This is what tar was originally invented to do, though with tape device files, rather than disk device files. I suppose that's good for archiving stuff, but not much else. Do you mind copying your video files to internal disk before working on them?

    Another approach: create a partition the same size as the file you want to put on the disk... Well, that could get weird.

    Too strange, too complicated? Probably. Just brainstorming here.

  10. Re:sharing between Linux and Mac OS X by eyez · · Score: 2

    Mac OS X should be able to see all partition types that FeeBSD can see. Linux too.

    Not entirely true; Mac OS X has a FreeBSD compatibility layer, but is not based on the FreeBSD kernel. It uses a Mach Microkernel, similar to GNU HURD. Although they can technically port any filesystem drivers from FreeBSD over to OS X, this is not true for Linux filesystem drivers- Since Linux is covered under the GPL, filesystem drivers in Linux are also covered. Hence, without GPL'ing OS X (at least their entire Kernel), they can't pull anything from Linux.

    So, you won't likely see anything like reiserfs in OS X anytime soon.

    Does anyone know if it's easy / possible to create a third-party filesystem driver for OS X? I don't like Apple stuff, so I don't know much about that part of OS X internals. Do they have a Loadable Kernel Module interface? Anything like that?

    --
    get 0wned. irc.w30wnzj00.com
  11. Grow Up Cliff! by fm6 · · Score: 2
    It seems likely that both of us were zapped by Cliff or some other editor. If that's true, then the mod system isn't broken. (It's a little flaky, of course. Always has been, always will be.) It's just an editor abusing his infinite mod points.

    Rob, you listening? What purpose do IMPs serve? Aside from destroying the credibility of the moderation system, that is.

    I do want to disagree with Captain Pendantic (hey, I'm sometimes known as Lord of the Nitpicks, I guess we haven't met) on one point. The moderation system is not a system of rewards and punishments. It's a filtering system. Of course, in this case, it failed as a filtering system, by removing extremely relevent comments from the discussion.

  12. Re:How about using a real OS? by Jeremiah+Cornelius · · Score: 2
    Yeah, Dude!

    Any UNIX OS that supports UFS is a Real OS. 1. So get a real Unix (not that Linux crud), and you will no longer have any problems. 2. So, Solaris, Any of the BSD's (FreeBSD preferred; it shits all over Linux), etc. 3. No more FS problems! 4. ??? 5. PROFIT!!!!
    None of those crappy, "Fake" OS's for me!

    I'm dumping IRIX, Unicos, QNX and VMS!

    --
    "Flyin' in just a sweet place,
    Never been known to fail..."
  13. Re:sharing between Linux and Mac OS X by MrResistor · · Score: 2

    Somebody doesn't know what 'microkernel' means, nor understand the GPL.

    First, microkernels are all about modules, in fact, modularized drivers are the whole point of having a microkernel. So, yes, in theory a third party could write drivers. However, as you have already pointed out, at least indirectly, the OS X kernel is a closed Mach variant, so who really knows if it's possible to create driver modules for third party file systems? It seems like it would be a stupid thing to prevent, but I'm sure an MBA could make a reasonable-sounding case for it.

    Also, while we're on the subject, It's the Mach kernel which is BSD compatible, since at least Mach3. That isn't something special that Apple added.

    Now as for the GPL, they could use the GPL code only in the module, which would mean that only the module would be subject to the GPL, or they could write their own code which interfaces with the APIs (or whatever they are called) for reiser/ext3/whatever and none of their code would be subject to the GPL.

    Don't buy the FUD. The GPL is not nearly as viral as Microsoft would have you believe.

    --
    Under capitalism man exploits man. Under communism it's the other way around.
  14. Re:sharing between Linux and Mac OS X by eyez · · Score: 2

    Actually, last I read, under the GPL, modules which are inserted into running code count as derivative works. The linux kernel makes a special exception saying that binary-only modules are allowed. In any case, it's a sticky subject, and they'd need to at least secure permission for this specific use of the code.

    My question about whether or not third-party modules could be created was meant as "has apple made the interface for this an open specification?".. That is, I know how microkernels work, but I don't know how feasible it is for mac os X. Do they include the right header files and provide an API for third-party (especially open-source-- They can very possibly put some sticky licensing into a developer license for the API) modules?

    As for the "viral" nature of the GPL, It's so called because a large number of open-source licenses allow their code to be included into GPL'd code, but the GPL does not allow that same liberty.

    --
    get 0wned. irc.w30wnzj00.com
  15. Those silly rules by fm6 · · Score: 2
    You tell that to the people who have a +1 posting bonus, or to those who can only post twice a day.
    I take it you consider these bonuses and penalties wrong. That's less than obvious to me.
    Also, moderation should only ever be done at -1, oldest first. With no influence from the friends and foes crap, and if at all possible, anonymously. If a comment is going to be moderated up or down, let it be done so, soley on its content, not the author.
    Do you have a point? None of this is news. It's all in the mod guideliness, though not as concisely worded.