Slashdot Mirror

← Back to Stories (view on slashdot.org)

OS X 10.8 vs. Ubuntu On Apple Hardware, Benchmarked

Posted by timothy on from the apt-get-me-a-new-version dept.

An anonymous reader writes "OS X 10.8 has been benchmarked against Ubuntu Linux with some interesting results. From the tests on a Apple Mac Mini and Apple MacBook Pro, OS X Mountain Lion was clearly superior when it came to the graphics performance, but the rest of the time the operating systems performed quite closely with no clear winner. OS X also seems to have greater performance issues with solid-state drives than Linux."

33 of 130 comments (clear)

  1. surprise surprise by shentino · · Score: 5, Informative

    Apple hardware performs better when run by Apple device drivers.

    News at 11.

    1. Re:surprise surprise by maccodemonkey · · Score: 4, Informative

      For graphics, what Apple device drivers?

      The graphics drivers are written in house at NVidia and AMD. Apple doesn't actually write their own drivers. And the GPUs are just bog standard AMD, NVidia, and Intel GPUs (expect for some of the graphics switching.). There is not reason Linux should be at a disadvantage.

      And if they did I'd expect worse performance. Back when Apple used to write their own drivers they were totally awful. Apple has less experience writing graphics drivers, I'm not actually sure why you'd expect Apple written drivers to perform better.

    2. Re:surprise surprise by SwedishPenguin · · Score: 2

      The hardware tested had an Intel HD 3000 integrated graphics, the Linux Intel drivers are known for being slow, but the Nvidia drivers are just as fast (or slightly faster in some cases) as the Windows-equivalent and presumably OSX as well. ATI I'm not sure, but they're at least closer to Windows performance than Intel is.

    3. Re:surprise surprise by Gr8Apes · · Score: 2

      What would you like run? Pretty sure you can go do a little research at www.insanelymac.com or www.tonymacx86.com for example and see some benchmarks on hackintoshes.

      --
      The cesspool just got a check and balance.
    4. Re:surprise surprise by hairyfeet · · Score: 2, Insightful

      I just wish people would be happy with what they like instead of the constant "X is better than Y" flamewars. If OSX is to your liking and you think Apple hardware is worth the extra scratch? Then please enjoy, wish you nothing but luck. If you think Linux is worth the hassle, are a programmer and need the ability to script, or one of the lucky few that manages to find hardware that is never broken by an update? Great, I wish you nothing but luck and happiness. If you are one of those people for whom the large software library of Windows is required and are able to avoid the crappy releases like Vista and 8, or want to play AAA gaming? Please enjoy, nothing but luck to you.

      But please just stop with the ridiculous notion that what works for you will work for everyone else because ya know what? It don't. If the programs I need run on Windows then Linux really isn't gonna help. If my workflow is built around OSX then Windows is gonna drive me batshit and if I need to be able to futz with the low level internals than Windows and OSX is gonna be worthless.

      I do have to wonder though, who in their right mind is gonna pay the extra cost associated with Apple hardware to run...Ubuntu? That don't make no damned sense at all, if you want to run Ubuntu you can buy any OEM, many of which has better hardware specs than Apple for cheaper, or even better buy a machine actually BUILT for Ubuntu from someone like System76 and support a market for FOSS systems. Paying all that extra money just to run on a free OS on Apple gear just seems...well kinda retarded to me.

      --
      ACs don't waste your time replying, your posts are never seen by me.
    5. Re:surprise surprise by maccodemonkey · · Score: 2

      The only reason is that they can throw $billions are getting the most experienced coders (e.g. from the linux community) to trim nanoseconds off the drivers they rely on most....

      Not seeing how that matters. The end user experience is what it is. What you said is an excuse, not a solution.

    6. Re:surprise surprise by shentino · · Score: 4, Interesting

      I love how you're biased in calling linux a hassle to program and saying that one must know how to script to use it properly.

      There are actually, contrary to rumor, a few user friendly distros out there that don't require a PhD in computer science to make use of.

      And Microsoft at least HAS been caught hiding APIs that gives its own programs a performance advantage.

      My comment isn't about which is better, anyway. It's about which ones cheat on their benchmarks by giving themselves a proprietary boost not available to the competition.

      See also the scandal of either nvidia or ati making its own hardware's performance deliberately go down the crapper when it detected the competition's chips.

    7. Re:surprise surprise by CAIMLAS · · Score: 5, Insightful

      The graphics drivers are written in house at NVidia and AMD. Apple doesn't actually write their own drivers. And the GPUs are just bog standard AMD, NVidia, and Intel GPUs (expect for some of the graphics switching.). There is not reason Linux should be at a disadvantage.

      What, you mean aside from the fact that Linux drivers for all those respective device manufacturers don't really get a whole lot of attention from the developers compared to Windows and OS X?

      But really, that's not important. What people need to pay attention to is that this is something done by Phoronix. This means you need to consider a couple things:

      * This benchmark is almost meaningless. Time and time again, I have seen them (falsely) correlate data with an assumption.
      * The review was done by someone who doesn't really know what they're talking about.
      * These are synthetics. Without context or understanding of what the benchmarks are doing (there is no explanation) or what may have led to the
      * The discrepancies are, in most cases, severe enough that you have to assume (at least) one of the following: their benchmark suite was not properly/identically configured for all architectures, or there are drastic implementation discrepancies within the benchmark tool they're using (eg. it wasn't designed but with a specific use case in mind).

      The reason there is "no clear winner" is because it's all rubbish. They're throwing 100 things at two different targets and comparing what misses and saying "no conclusion". Really? You'd have better consistency with an ink blot test of random participants, with ink blots generated by a true random number generator.

      Some of the graphics benchmarks don't stand out; the ones that stand out the most are the computational ones involving (very) standard libraries or frameworks which then contradict later results.

      For instance, CompileBench and Threaded I/O Tester: OS X falls flat on its face. The threaded I/O tester I believe, because I've seen the same with db and server performance. But earlier, they've got bgbench giving OS X four times the performance for postgresql as Linux. Is that even rational, given that even FileMaker has shyed away from OS X as a preferred platform due to threading and filesystem performance?

      Then, they go on to fail to explain these things and why they're fundamentally inconsistent. Not just "this doesn't quite line up, we can write it off due to different library version overhead" but in line with "this car goes faster because its engine is smaller". What?

      On a more personal level, I have used their suite of benchmark tools and come away fairly underwhelmed by the results. They're inconsistent and inexplicable, such as those seen in this review.

      Here's a hint, benchmarkers:

      * when you benchmark something, you must compare things and try to figure out why they are performing as they do.
      * If there are gross discrepancies which belay a reasonable expectation or contradicts other information, investigate it, because it's probably important
      * Be sure of what you're comparing. If you've got (more or less) identical binaries on different platforms and the hardware, you're just comparing the kernel. Is that what's happening here? Are their tools linked against native libraries (which would, you know, be an honest benchmark of said platform) or do they use their own stack?

      Anyway, I could go on, but you get the idea. This benchmark is stupid on its face. The only benchmarks I'd trust from this roundup here are those that are straight up "measure something real" (frames per second in x, time to complete concrete task y). They make a very different picture than when the synthetics are thrown in to the whole: overall OS X performance is pretty abysmal, but is marginally better at graphical things than Linux. This fits pretty close with my (personal) observation that OS X is about 10-15% slower than linux on general things, markedly slower on threaded things, and a dog at file manipulations while having a firm grasp on display management/graphical stuff - so it might just be my "uneducated Apple-hating bias" speaking. :)

      --
      ~/ssh slashdot.org ssh: connect to host slashdot.org port 22: too many beers
    8. Re:surprise surprise by epyT-R · · Score: 2

      ..the bias shows because his initial point is that all of them are hassles to different people, then he explicitly suggests linux is a hassle by default.

  2. Why is Linux's SSD performance so terrible? by MrEricSir · · Score: 4, Interesting

    I made the mistake of "upgrading" two Ubuntu 12.04 desktops to solid state drives, only to find the performance increase was trivial.

    What gives? The difference between magnetic drives and SSDs on OS X is incredible. Is this a driver issue, or what?

    --
    There's no -1 for "I don't get it."
    1. Re:Why is Linux's SSD performance so terrible? by Sparticus789 · · Score: 5, Interesting

      PEBKAC. When I upgraded my Ubuntu laptop to SSD, boot time was under 10 seconds and my battery life while surfing the internet went from 3 hours to almost 5 hours. Not all SSDs are made the same, you have to research the performance of each, power draw, etc.

      That being said, I bought the SSD with the second-lowest power usage and middle-of-the-road performance.

      --
      sudo make me a sandwich
    2. Re:Why is Linux's SSD performance so terrible? by Hatta · · Score: 4, Informative

      Linux caches disk reads pretty aggressively. If you have plenty of RAM, you might only notice a difference the first time you start an app.

      --
      Give me Classic Slashdot or give me death!
    3. Re:Why is Linux's SSD performance so terrible? by cpu6502 · · Score: 5, Insightful

      That's Not what the article said. It said OS X had performance issues with solid state drives.

      Also I'm kinda curious: Why would spend twice as much to buy an Intel Mac PC if they're just running linux? I'd buy a regular PC for 1/2 to 2/3rd the cost.

      --
      My AC stalker: " I personally agree with your posts most of the time, but that won't keep me from modding you troll"
    4. Re:Why is Linux's SSD performance so terrible? by 0123456 · · Score: 5, Informative

      I made the mistake of "upgrading" two Ubuntu 12.04 desktops to solid state drives, only to find the performance increase was trivial.

      If a process isn't disk-intensive, an SSD will make no difference. If it's not seek intensive, a cheap SSD may actually be worse; if I remember correctly, sustained reads from my 'Green' hard drive are 80-100MB per second, whereas one of my SSDs only gets about 40MB per second.

      The big benefit is reduced seek time, and a lesser benefit from faster sustained reads on the more modern and/or expensive SSDs. It won't make games run faster unless they're streaming from disk, or improve CPU-intensive 3D rendering, or anything much else that doesn't require a lot of disk seeks.

    5. Re:Why is Linux's SSD performance so terrible? by idsfa · · Score: 2

      Linux default config is optimized for spinning platters. You have to tweak a few things to get the best performance.

    6. Re:Why is Linux's SSD performance so terrible? by ByOhTek · · Score: 2

      True for notebooks, but I've know a lot of people who've gotten mac displays and put them on PCs... Though, there is some competition now, if you don't mind spending some absurd money. http://www.newegg.com/Product/Product.aspx?Item=N82E16824002660 Not sure how it's image quality compares with an Apple monitor though - usually you can't do better, only get parity.

      --
      Self proclaimed typo king, and inventor of the bear destroying coffee table (patent not pending).
    7. Re:Why is Linux's SSD performance so terrible? by willy_me · · Score: 3, Interesting

      I would guess it is because OS X defragments the drive as it is being written. The overhead is largely not noticed when writing to a traditional hard drive while. Due to SSDs greater speed, it will make it appear that OS X has performance issues. The thing about performing inline defragmentation is it improves speed as the computer ages and as the HD begins to fill. Because all of the benchmarks were performed with fresh systems, the benefits of a defragmented drive would not be noticed.

      The question I have is with the low seek times of SSDs, is there still a need to defragment drives? Probably, but to what degree as it surely is not as important as when one is using a traditional hard drive.

    8. Re:Why is Linux's SSD performance so terrible? by Sparticus789 · · Score: 4, Informative

      Defragmenting SSDs is not recommended, as it causes unnecessary use of the storage transistors. The speed associated with a SSD is a result of any block of data being accessible at any time, no hardware movement required.

      --
      sudo make me a sandwich
    9. Re:Why is Linux's SSD performance so terrible? by omnichad · · Score: 5, Informative

      Hope you mean TRIM and not defragmenting, which occurs when a file is deleted on an SSD, not when one is written. You don't defragment an SSD, as there's no gain at all.

    10. Re:Why is Linux's SSD performance so terrible? by CharlyFoxtrot · · Score: 3, Insightful

      Footprint, noise (or lack thereof), the ability to run all major OS (OSX, Windows, Linux) on the same machine, low power usage and nice looking sturdy construction. If you're going to be putting it on a desk the Mini is a nice little package.

      --
      If all else fails, immortality can always be assured by spectacular error.
    11. Re:Why is Linux's SSD performance so terrible? by Sparticus789 · · Score: 2

      By PEBKAC, I mean the user is at fault for not doing his/her research and making sure the right SSD was purchased. He/she could have bought the wrong kind of SSD for what the user is doing, sequential read/writes or random read/writes.

      I saw a large performance increase in Ubuntu 12.04 by going to SSD, in boot time, application launch time, and any program which used swap space.

      --
      sudo make me a sandwich
  3. Summary of tests? by GoNINzo · · Score: 5, Interesting

    15 pages of a review, with a poor summary of the results, results in the most number of page views. It would have been nice if they had some sort of summary or benchmark to compare the two against rather than individual tests spread across this. Perhaps a summary chart?

    Also, comparing a well tuned video device driver versus the (usually) hastily written Linux one is a poor comparison.

    I really doubt people choose a mac over Linux over this kind of test. There more solid reasons to choose one or the other.

    --
    Gonzo Granzeau
    "Nothing the god of biomechanics wouldn't let you into heaven for.." -Roy Batty
    1. Re:Summary of tests? by butalearner · · Score: 2

      15 pages of a review, with a poor summary of the results, results in the most number of page views. It would have been nice if they had some sort of summary or benchmark to compare the two against rather than individual tests spread across this. Perhaps a summary chart?

      Funny, I never bothered looking at the link, but from this comment alone it was obvious that it's a Phoronix article.

  4. Worthless... by Thinine · · Score: 5, Insightful

    Yet another worthless benchmarking from Phoronix (Moronix, amirite?). They switch between compilers, compiler versions, and even use Xcode itself for some of these comparisons, which make it essentially worthless. Add to that absolutely zero investigations of the reason for differences between the platforms (aside from the obvious mention of graphics drivers) and this is yet another piece of benchmark porn from a site dedicated to it.

  5. Re: Why an Intel Mac PC to run linux? by sl956 · · Score: 5, Informative

    Also I'm kinda curious: Why would spend twice as much to buy an Intel Mac PC if they're just running linux? I'd buy a regular PC for 1/2 to 2/3rd the cost.

    I looked for a silent small footprint linux pc. I was unable to find one. That's why I bought a Mac Mini. It runs Linux flawlessly... and silently thanks to the fanless design and SSD.

    People wanting an HD screen on a laptop might also have to buy Apple hardware even though they plan to use only Linux.

  6. Re:Bottom line.. by Anonymous Coward · · Score: 2, Funny

    Not if the cancer gets you first.

  7. Wrong interpretation of the results, favors OSX by tstrunk · · Score: 3, Informative

    If you read the whole article you will see that there are many computing intensive benchmarks, where Linux outperforms OSX by nearly a factor of two. Saying that there is no noticeable difference is simply wrong (see Page 11, Page 12).

    1. Re:Wrong interpretation of the results, favors OSX by tlhIngan · · Score: 2

      If you read the whole article you will see that there are many computing intensive benchmarks, where Linux outperforms OSX by nearly a factor of two. Saying that there is no noticeable difference is simply wrong (see Page 11, Page 12).

      That makes sense. Mac OS X is a "microkernel" based system and does a lot stuff passing around Mach messages.

      OS X is also inefficient in that each process gets its own address space - for a 32-bit process, that's 4GB of address space it can use all of (no 2/2 or 3/1 user/kernel split - every process, including the kernel gets it's own independent 4GB area). The problem with this is that in order to access application buffers (system calls, say), the kernel must map the buffer into its address space first, which is far more expensive than translating a pointer and dereferencing that.

      OS X should be slower purely because it's a higher overhead OS.

  8. Re: Why an Intel Mac PC to run linux? by dfghjk · · Score: 2

    Mac Minis are not fanless designs nor are they silent.

  9. Re: OS X Mountain Lion was clearly superior by jo_ham · · Score: 2

    LOL. Lin-sux loses AGAIN. Time to give up, dipshits. Open source should be renamed open failure.

    Think different.
    Think BETTER.
    Think Apple!

    I think you're trying too hard, kid.

    0/10.

  10. Lots of graphs, worthless analysis by CadentOrange · · Score: 3, Insightful

    The compilation benchmarks are not comparable as the compilers are different, not only in version number but in architecture! OS X ships with llvm-gcc, which is a different compiler from GCC. Think of it a LLVM pretending to be GCC (accepting GCC options, etc) for backward compatibility. This would explain the huge discrepancies between the results of the compilation benchmarks

    Disk performance is another thorny issue. The Postmark benchmark shows Ubuntu 12.04 being 3x faster than OS X 10.8 (246 tps vs 80 tps), yet the postgresql database benchmark shows OS X to be 3x faster than Ubuntu. No explanation is even attempted. Why? Readers would like to know! How can OS X be faster at a database benchmark when a raw disk benchmark shows it to be a lot slower than Ubuntu?! Perhaps there's something screwy with the configuration of Postgres on Ubuntu? Does this mean that OS X is *THE* choice for hosting busy databases? My suspicion is that this is due to fsync (http://www.postgresql.org/docs/8.1/static/runtime-config-wal.html). If fsync is enabled, the database waits for the transaction log to be flushed to disk every time a transaction is committed. It's basically down to defaults, and who knows what the default values are for Postgresql on OS X vs Ubuntu?

    The graphs raise far too many questions that are not addressed. Many of them should have raised warning flags, like the one about disk performance vs actual database performance. As such, the results are thoroughly suspect and no reasonable conclusions can be drawn. Pity, because they clearly have the kit just not the knowhow.

  11. Re: Why an Intel Mac PC to run linux? by CharlyFoxtrot · · Score: 4, Informative

    I have the older style Mini and when the HDD goes to sleep and it runs on SSD-only it's damn near completely silent. The fan will only come on when really stressing the cpu.

    --
    If all else fails, immortality can always be assured by spectacular error.
  12. Open source drivers by Chemisor · · Score: 2

    Intel graphics on Linux uses the open source Mesa/Gallium stack, which still has significantly lower performance than the proprietary drivers. Frankly, I'm wondering if the GPU is being used at all. I have a Radeon 6870, and with open source radeon driver I don't see any acceleration. For example, a full-screen xterm with Midnight Commander takes a full half-second to draw the frame with only 160x50 char cells. With fglrx 12.8, the drawing time is not noticeable at all. The Mesa radeon feature matrix says R600 should have full GPU acceleration for all X calls, but something is just not working right. I'm guessing something similar might have happened with the benchmarks.