Slashdot Mirror


FreeBSD 8.0 vs. Ubuntu 9.10 Benchmarks

An anonymous reader writes "Phoronix has brought benchmarks comparing the FreeBSD 8.0-RC and Ubuntu 9.10 Alpha 6 operating systems. FreeBSD rather ends up taking a wallop to Ubuntu Linux, but there are a few areas where FreeBSD 8 ran well. They also posted benchmarks comparing this near-final FreeBSD 8.0 build to that of FreeBSD 7.2 to show performance improvements there but with a few regressions."

16 of 268 comments (clear)

  1. Let's see these against my Gentoo... by Jurily · · Score: 5, Funny

    ...once I'm done compiling.

    1. Re:Let's see these against my Gentoo... by wall0159 · · Score: 4, Funny

      Given that, I think it'd be fairer to compare Gentoo against Ubuntu 10.04, don't you?

  2. What's the point. by hedwards · · Score: 4, Insightful

    I'm sort of curious what the point is of comparing an alpha to a release candidate. Additionally it's a minor update versus a major update. Throwing in an older release makes it all the more pointless as I'm not seeing anywhere in the summary that they disabled debugging.

    1. Re:What's the point. by bostei2008 · · Score: 5, Insightful

      Just a plug for the Phoronix Test Suite?

    2. Re:What's the point. by hedwards · · Score: 5, Interesting

      Well, with the number of distros out there, it's inevitable that they'd leave out most of them. But I must admit that leaving out every other distro makes it kind of hard to know if Ubuntu is doing better than the pack or about the same.

      It's kind of suspect, in my opinion, that the older release was doing so much better than the newer one, considering all the time that's been spent in recent times on optimizing various portions of the source. It's also worth noting that probably a much larger portion of the FreeBSD user base will recompile their kernel pretty much immediately with basic optimizations and removing the cruft that they don't need or want.

    3. Re:What's the point. by geminidomino · · Score: 4, Informative

      Is there any actual benefit to be gained from removing "cruft", other than saving a smidgen of memory?

      Long, but not long enough answer:

      Performance: Unless the cruft is a bunch of data or NOPs, it will be executed at some point, which is pointless (or it wouldn't be cruft.) And whether it's data or instruction, if "good" data is swapped out of the cache in favor of the cruft, then it will have to be read back in (cache misses).

      Security: Bugs love to hide in cruft.

      tl;dr version: Yes.

    4. Re:What's the point. by kad77 · · Score: 4, Interesting

      I'm sort of curious why the slashdot story summary is so annoyingly biased in it's phrasing - "FreeBSD rather ends up taking a wallop to Ubuntu Linux, but there are a few areas where FreeBSD 8 ran well", when the arguably flawed test suite shows NO SUCH THING!

      The FreeBSD system has very comparable or better benchmarks on nearly every metric in the test, just click through TFA and see for yourself.

      Tripe.

      Besides the needless and counterproductive bias, the phrase X "rather ends up taking a wallop to" Y is clunky and sophomoric. Editors, get a life.

    5. Re:What's the point. by WinterSolstice · · Score: 4, Insightful

      I must say that I'm really fed up with these sorts of benchmarks. They insult the intelligence of IT/technical people AND business people/endusers.

      I need to find or create a site that actually benchmarks a variety of systems (windows/linux/unix/bsd) for ACTUAL scenarios that the users of the systems expect them to perform. Not sure how important LAME encoding is for BSD people - I know I don't use it for that. Not sure how many Ubuntu users run DB servers or firewall routers.

      Can anyone point me to someplace like this? Someplace where I can see, for example, DB driven dynamic pages served per second - concurrent DB users, scalability to 4+ processors, etc?

      I want metrics like SAN performance, DB performance, mail server performance, HA, clustering, firewall performance etc for server "distros" (Windows Server, AIX, Solaris, BSD, Linux, OSX Server)
      I want metrics like graphics benchmarks, app response time, those classic GUI task tests for desktop "distros" (Windows, OSX, Linux, BSD).

      It annoys me that I see benchmarks that are so narrow and pointless. I can't make reasonable non-fanboy type comparisons when the benchmark doesn't include anything that matters to me.

      --
      An operating system should be like a light switch... simple, effective, easy to use, and designed for everyone.
  3. Summary by __aaxwdb6741 · · Score: 5, Insightful

    The article is of little use other than tell the general populace of Slashdot that FreeBSD 8.0 and Ubuntu 9.10 are right around the corner, and that we should be hyped. Also FreeBSD 8 is a little faster than FreeBSD 7.2 but a lot slower than Ubuntu Linux 9.10

    I'm not surprised, however I do belong to the group that does not really care about relative performance to other OS's as performance is only one of the aspects from the vector of decisions we had to make to finally choose FreeBSD for mass-scale deployment.

  4. Ubuntu *is* Linux for a lot of people by elrous0 · · Score: 5, Interesting

    When my friends ask me about Linux, I usually steer them toward Ubuntu first, as it's the most user friendly and well-supported distro out there. Canonical really puts a lot of development work into it, and it shows (in this result and many others). In the past, I usually avoided the Linux topic altogether, as there were so many confusing distros that even trying to explain the concept of Linux to non-geeks (and even many geeks) was a huge pain in the ass. So, I for one welcome our new Ubuntu overlords.

    --
    SJW: Someone who has run out of real oppression, and has to fake it.
  5. Truly crap-tastic charts by vrmlguy · · Score: 5, Insightful

    Eight pages of bar charts, each gray-on-gray. On half of them, shorter bars mean better performance, on the other half, longer is better; the only way to know which is which is in a legend, written in a small font.

    Here's a suggestion: color-code the bars! Green is good, red is bad, yellow is in the middle of the road. For bonus points, choose the saturation based on magnitude of the differences. If the numbers are close, go with grayer bars, if the differences are dramatic, use dramatic colors.

    Finally, how about a line chart at the end showing all of the numbers in one place? Yeah, you'd need to convert everything to be consistent if longer or shorter is better, but that's a good idea anyway.

    --
    Nothing for 6-digit uids?
  6. Re:Safe to assume? by Ian+Alexander · · Score: 4, Funny

    Yes, because the masses of casual users struggling under the crushing weight of FreeBSD that was preinstalled on their PC will naturally flock to Ubuntu...

  7. Re:Benchmarks... by nxtw · · Score: 4, Informative

    Does Ubuntu provide a stable platform to build a server? No. It, like most linux distros, changes whole versions during updates. That isn't stable.

    Ubuntu has LTS (long-term support) releases which are supported for 5 years on the server side. The last was 8.04 and the next will be 10.04.

    I prefer RHEL/CentOS, however. I wonder how many people use Ubuntu LTS instead of using RHEL or SLES instead.

    Does Ubuntu provide a way to strip itself down to the bare metal? Ain't as easy as the BSD's.

    How often is this important? I can think only of a few situations, such as when fitting a system into a small/cheap flash.

    But really, Comparing FreeBSD to Ubuntu is like comparing OpenSolaris to Windows 7. FreeBSD is largely a server operating system were as Ubuntu is an end user operating system. And if you are comparing server operating systems, there are far more important criteria than "speed". Things like version stability are vastly more important.

    Ubuntu has a separate 'server' version (which really just includes a different set of packages and a different kernel build.)

  8. FreeBSD is still in debugging mode by Just+Some+Guy · · Score: 5, Informative

    From the update notes in /usr/src/UPDATING:

    NOTE TO PEOPLE WHO THINK THAT FreeBSD 8.x IS SLOW:
    FreeBSD 8.x has many debugging features turned on, in both the kernel and userland. These features attempt to detect incorrect use of system primitives, and encourage loud failure through extra sanity checking and fail stop semantics. They also substantially impact system performance. If you want to do performance measurement, benchmarking, and optimization, you'll want to turn them off. This includes various WITNESS- related kernel options, INVARIANTS, malloc debugging flags in userland, and various verbose features in the kernel. Many developers choose to disable these features on build machines to maximize performance. (To disable malloc debugging, run ln -s aj /etc/malloc.conf.)

    Since the article didn't mention anything about disabling all the debugging options, I'll consider this an invalid benchmark until shown otherwise.

    --
    Dewey, what part of this looks like authorities should be involved?
  9. Phoronix? Moronix more like. by LizardKing · · Score: 4, Informative

    Yet again a benchmark against a pre-release version of FreeBSD where the testers didn't even bother reading the documentation. Anyone actually familiar with the FreeBSD development and release process would know that a release candidate has a considerable amount of debugging options turned on. This is to help diagnose any problems as the last issues are shaken out of a release, but has an adverse impact on performance.

  10. Compiling in FreeBSD by phorm · · Score: 5, Interesting

    Actually, you'll probably do quite a bit of compiling in FreeBSD too. While you can pull binary packages, most people I know prefer to use a package manager like portsnap and compile source packages.

    If you have a script to take care of compiling the common stuff, then just "make config" everything that need user input and let it fly. Granted, most servers I've used BSD on have been dual or quad core Xeon/AMD PC's with a fair bit of RAM, so it is overall a fairly quick process, though it was still not too bad on a few P4-era celerons.

    The nice thing about FreeBSD source-compiled apps that I truly did love compared to BSD is the little tweaks you could do to avoid tons of crap dependencies. Debian used to be fairly "clean" as far as deps, but both Ubuntu and Deb are now getting quite ugly in that you get rather unwanted stuff in order to get the package you want. In most FreeBSD stuff, for example, I can check the "No X Server" box and happily compile my apps without any X support whatsoever. On Debian/Ubuntu I end up trying to install some CLI system monitoring tool or CUPS, whatever, and end up with a whackload of x.org stuff because it's tied to some font which is loosely tied to the actual package I'm trying to install. On Ubuntu desktops, trying to exorcize the demons of "Evolution" without having it remove other important stuff due to deps is near impossible. Sometimes there's a separate branch for a "cleaner" install, but often enough not.

    Of course, BSD ain't perfect. Linux tends to have a lot of "new" stuff that BSD is a little more "conservative" in bringing into the mainline (iSCSI support for example was a fairly recent addition compared to 'nix), but overall the package system is powerful indeed.

    Having not used Gentoo (yet) but knowing others who have, it seems like it might be somewhat similar in concept. The issues I've heard with are mostly in people getting to the up-and-running stage, but - similar to BSD - avoid annoying little conflicts or unwanted cruft is a lot easier than Debian/Ubuntu's precompiled binaries. Of course, I've also heard of much frustration in both if you have find halfway through a *long* compile that you missed something you should have flagged/included.