Slashdot Mirror


35,000 Linux Benchmarks In a Week

G3ckoG33k writes "Openbenchmarking.org has received 37,027 benchmarks (mainly Linux, and some Macs) in the first week since its inauguration. 241,384 completed tests using 468,344 components from 438 hardware vendors. All results submitted by end users. I guess the hardware support for Linux must become even better thanks to this effort. Yes, the benchmarks are easy to install and run, and you can readily compare your own system anonymously with the results already submitted, using any or all of hundreds of free applications in 47 categories."

65 comments

  1. Whatever gets me the best FPS by Anonymous Coward · · Score: 0

    That's all that matters, right?

    1. Re:Whatever gets me the best FPS by ciaran_o_riordan · · Score: 4, Funny

      First Post Slashdot? I didn't know the kernel was getting that specialised, but you proved it is.

    2. Re:Whatever gets me the best FPS by __aardcx5948 · · Score: 1

      I'm not so interested in the FPS, but rather filesystem performance between different kernel versions and possible regressions (in any benchmark) so I know what kernel versions to avoid.

  2. And they all were.... by soupbowl · · Score: 0

    And they all were done poorly and showed nothing useful for the real world.

  3. Great concept by WiiVault · · Score: 4, Interesting

    My biggest issue with most benchmarks is the underhanded deals between sites/mags and tech companies who provide incentives and free hardware. While I take individual benchmarks with a grain of salt as well for a lot of reasons, I'm far more confident that thousands of people haven't been bought and sold in the way ad supported publications seem to be.

    1. Re:Great concept by .tekrox · · Score: 2

      I really don't get this, GeekBench has been around - on all three major platforms for several years...
      It has a results browser too - http://browse.geekbench.ca/

    2. Re:Great concept by Raenex · · Score: 1

      I really don't get this, GeekBench has been around - on all three major platforms for several years...
      It has a results browser too - http://browse.geekbench.ca/

      Yeah, but it's got a Canadian domain. Who wants to go to a ca site? Mostly joking, but you know there's some truth to this, stupid as it may be.

    3. Re:Great concept by Anonymous Coward · · Score: 0

      Doesn't seems to be opensource !

    4. Re:Great concept by fast+turtle · · Score: 1

      Hell if I have to pay for the benchmark app, it's useless to me. Sorry but I'm a tightwad (definately use a choke)

      --
      Mod me up/Mod me down: I wont frown as I've no crown
  4. Re:Less Linux, more OS X please! by ustolemyname · · Score: 2

    Probably because you can benchmark every mac made in the last three years in a couple days. You don't find many people wondering about which part they should upgrade on their mac.

    Also, it's crowd sourced software that runs on OS X, so mac users probably just aren't as motivated.

  5. Re:Less Linux, more OS X please! by tomhudson · · Score: 2

    I'm not sure why they are spending so much time on Linux, when it is used so little for actual desktop work. This site should really set its focus on OS X which certified Unix (unlike Linux which is just a non-standard proprietary clone).

    By your same logic, they should also devote more time to SCO products ...

  6. Re:nouveau on Fermi achieves 70% speed by Anonymous Coward · · Score: 0

    mod down

  7. Re:Less Linux, more OS X please! by ustolemyname · · Score: 1

    Would like to add: it's not just a matter of mac users being motivated to benchmark their machines, but Phoronix.com targets a linux user audience, though they do benchmark OS X frequently.

  8. Goatse!!!!! by stms · · Score: 0

    DONT CLICK THAT LINK!!!!!

  9. Listen! by Mitchell314 · · Score: 1

    Yes, that's Ganon's trap.

    --
    I read TFA and all I got was this lousy cookie
  10. Re:Less Linux, more OS X please! by valros · · Score: 0

    Would also like to add: Benchmarking most(?) installations of OSX being on hardware(Macbooks) not designed for large processing would not be entirely useful. True that OSX could probably be improved but the need to or excitement of benchmarking the os isn't really there. Kind of a mindset that OSX gets you in to, its there and does everything the way you should want it to be done and you shouldn't try to change or disagree with its ways.

  11. Re:nouveau on Fermi achieves 70% speed by Anonymous Coward · · Score: 0

    you keep doing this in multiple discussions.

    all you're going to accomplish is that nobody clicks on tinyurl and goo.gl links anymore. that means you are cutting off your own source of amusement you stupidass.

    you sure are a cunt. a dirty, nasty, AIDS and herpes-infested cunt with giant meat curtains, a clit like a penis, and a gaping cavern of a vagina. go fuck yourself because no one else is going to.

  12. Re:Less Linux, more OS X please! by valros · · Score: 1

    Yeah I guess you could say that, lol.

  13. Unreadable by Anonymous Coward · · Score: 0

    The look of the site (and the results page in particular) reminds me of the Dilbert series about User Interface Poisoning from UIs designed by engineers. (http://www.guuui.com/images/20020924.gif)

    This site is unreadable.

    1. Re:Unreadable by Anonymous Coward · · Score: 0

      I agree. Can't make anything out on that horribly designed web site.

  14. Re:Less Linux, more OS X please! by houstonbofh · · Score: 1

    Yes... Mac is all that and more. http://www.guardian.co.uk/commentisfree/2011/feb/28/charlie-brooker-pfroblem-with-macs Of course all of my desktops and laptops at home and at work are Linux.

  15. Re:nouveau on Fermi achieves 70% speed by Anonymous Coward · · Score: 0

    Is it 2001 again?

  16. Windows Users Are Out Cold by purplemecha · · Score: 1

    Windows users have nothing like this. Too bad for them. Although the Phoronix test suite is actually coming to Windows. The Windows version is very alpha right now. Be an interesting twist if Windows users can take advantage of this in the future.

    To quote Phoronix.
    "The Phoronix Test Suite support on Windows is very early in development and is not targeted for normal end-users with most areas not yet being implemented but will be later on in the Phoronix Test Suite 2.4 development cycle. At this time the Phoronix Test Suite client is dependent upon PHP being installed to C:\Program Files (x86)\PHP\php. The Phoronix Test Suite also uses CPU-Z for much of the hardware detection support on Windows and is dependent upon CPU-Z being installed to C:\Program Files\CPUID\CPU-Z\cpuz.exe."

    1. Re:Windows Users Are Out Cold by Anonymous Coward · · Score: 1

      And on the other hand, other operating systems don't have tools as good as xperf for really analyzing programs and drivers. Good luck figuring out which driver is causing all those interrupt latency spikes without it :P.

    2. Re:Windows Users Are Out Cold by Gaygirlie · · Score: 2

      Windows users have nothing like this. Too bad for them.

      Windows users have hundreds of different benchmarking tools to choose from, so they are in kind of a better position. 3DMark Vantage + Aida64 is already plenty enough to benchmark more-or-less all components of your system and if you're still not satisfied then throw PCMark in the bunch. Phoronix Test Suite apparently allows you to craft custom tests too, but aside from that it doesn't offer that much functionality that isn't available for Windows users already. Linux users on the other hand have lack of good benchmarking tools and suites and for them Phoronix Test Suite is one of the few and arguably the most full-featured one.

    3. Re:Windows Users Are Out Cold by Anonymous Coward · · Score: 0

      "Linux users on the other hand have lack of good benchmarking tools" Because linux performance is so much better!

    4. Re:Windows Users Are Out Cold by Anonymous Coward · · Score: 0

      It's not about functionality that is missing from either OS, it's about database of results, where every user can see what hardware can suit their needs based on hardware benchmarks of other people.
      And BTW, most tests are based on real applications, that are used on daily basis, meaning they are actually good testing tools. As well as the fact, phoronix did loads of Linux/Windows benchmarks, pretty much everywhere, apart from 3d graphics and energy consumptions(and there difference in majority of places was not that big, the fresher tests were) Linux DID Windows. And I am NOT trolling, go to their site and check for yourself.

  17. Re:Afro Ingenuity by tabrnaker · · Score: 1
    Yes, but they were happy and spent their time singing and dancing in joy.

    White people needed to build all these things to try and find that elusive happiness and joy.

    Now, which do you think is the smarter people?

  18. But in PHP? Seriously? by MikeBabcock · · Score: 0

    Update me when this isn't written in PHP.

    --
    - Michael T. Babcock (Yes, I blog)
  19. Re:nouveau on Fermi achieves 70% speed by avgjoe62 · · Score: 1

    you sure are a cunt. a dirty, nasty, AIDS and herpes-infested cunt with giant meat curtains, a clit like a penis, and a gaping cavern of a vagina. go fuck yourself because no one else is going to.

    I think you're wrong about that. My ex-wife doesn't frequent Slashdot.

    --

    How come Slashdot never gets Slashdotted?

  20. This website is incomprehensible by psychonaut · · Score: 5, Insightful

    The article summary here intrigued and excited me. I headed to the site, eagerly hoping to compare the performance of my system against the 35,000 submissions, and to submit my own results for the community to share. But when I got there, I was lost and confused. The site is almost completely incomprehensible to me. Navigation is a nightmare. I can't figure out how to see the results for a given system. When I do, by accident, stumble upon a page with some graphs, I can't figure out how to compare these with another system. There seems to be no rhyme nor reason to the hyperlinks, and precious little in the way of explanations and guidance. It's a pity that a site which has the potential to be such a useful resource has been rendered completely unusable by poor organization and UI design.

    1. Re:This website is incomprehensible by devent · · Score: 4, Informative

      Are you kidding me?

      I can't figure out how to see the results for a given system.

      Maybe you overlooked in the middle of the homepage with big blue letters:

      Top Searches AMD Phenom II X6 1055T Debian 6.0 FreeBSD Intel Core i5-2500K Intel Core i7 970 Intel Core i7-2820QM Linux 2.6.38- NVIDIA GeForce GTX 580 Radeon HD 4850 Ubuntu 10.04 Ubuntu 10.10 Ubuntu 11.04 Top Hardware AMD Phenom II X4 955 AMD Phenom II X6 1055T ATI Radeon HD 5700 1024MB InnoTek VirtualBox Intel Core 2 Duo Intel Core 2 Duo E8400 Intel Core 2 Quad Q6600 Intel Core i5-2500K Intel Mobile 4 IGP 256MB MacBook Pro VMware SVGA II innotek VirtualBox v1.2 Top Software Arch Debian 6.0 Debian testing Fedora 14 Fedora release 14 (Laughlin) Linux Mac OS X 10.6.6 Microsoft Windows [ 6.1.7600] SUSE LINUX 11.3 Ubuntu 10.04 Ubuntu 10.10 Ubuntu 11.04

      Now, just click what you like and after that you will get a site with the benchmarks. Click a benchmark and you have the comparison. You can even group different benchmarks together and get a comparison.

      Also you have: 1. Most Popular Tests 2. Apache Benchmark 3. 7-Zip Compression 4. C-Ray 5. LAME MP3 Encoding 6. OpenArena 1. Most Popular Suites 2. Audio Encoding 3. Timed Code Compilation 4. Chess Test Suite 5. Timed File Compression 6. Disk Test Suite 1. Latest Test Profiles 2. Xonotic 3. X-Plane Image Quality 4. X-Plane 5. x264 6. x11perf

      I'm sorry but if there was 35,000 benchmarks in just one week then the site can't be that bad. That's 5000 benchmarks a day.

      --
      http://www.mueller-public.de - My site http://www.anr-institute.com/ - Advanced Natural Research Institute
    2. Re:This website is incomprehensible by psychonaut · · Score: 2

      Yes, I see all the same pretty labels that you do. Clicking on them doesn't result in the information I expected, or in information presented in a way in which it is easy for me to understand and manipulate. If you were able to figure it out, then I bow to your superior intellectual prowess. But I couldn't make sense of the site, and please believe me when I say I spent a long time trying. From the other comments posted here I see I'm not the only one frustrated with the interface to this site.

      To take just one example, I clicked on "NVIDIA GEFORCE GTX 580" from the home page. The first thing that pops up is a list of OSes, drivers, and display servers. To me this implies that the benchmarks are categorized by OS, driver, and display server. That is, I can see different performance results for the NVIDIA GEFORCE GTX 580 on, say, Linux 2.6.31-14-generic using the nouveau driver, and maybe compare them to those with the same OS using the proprietary nvidia driver. But no -- clicking on one of those OSes, drivers, or display servers just takes me to some generic page about them.

      I'm sure you (or someone else) will be along soon to explain to me how it all works, but at this point I don't particularly care. If the site was properly designed to begin with I wouldn't need someone to tell me how to use it.

    3. Re:This website is incomprehensible by devent · · Score: 1

      I did the same as you and I had a nice graph with compared the Ubuntu 10.04 benchmarks with different settings and the benchmarks are all including the Nvidia Geforce Gtx 580.

      The site is complicated because the benchmarks are not just generic score, like X is 10 points better then Y, but a detailed benchmark, with different software. The first benchmark have it use if you are a consumer, searching a fast CPU, the latter have use for "power user" who want to know what hardware and system runs the Apache server fast.

      I'm sorry that you are not the audience for the openbenchmarks.org site. But the site have a big audience nevertheless.

      --
      http://www.mueller-public.de - My site http://www.anr-institute.com/ - Advanced Natural Research Institute
    4. Re:This website is incomprehensible by psychonaut · · Score: 1

      Ah, yes, "The user must be an idiot"—the last desperate defence of poor UI design. Is it not possible for you to accept criticism of something's usability without calling into question (quite mistakenly, in this case) the critic's technical credentials? If so, I hope I never have the misfortune of using any interface designed by you.

    5. Re:This website is incomprehensible by Anonymous Coward · · Score: 5, Informative

      This is Michael Larabel, the one that wrote all of the code for OpenBenchmarking.org, including the interface side... The OpenBenchmarking.org user-interface does have some known areas for improvement and the site will continue to be refined over the coming days, weeks, and months. Your constructive feedback is welcome and appreciated.

      Any comments like "The user must be an idiot" or "I'm sorry that you are not the audience for the openbenchmarks.org site" does not come from anyone affiliated with the work.

      -- Michael

    6. Re:This website is incomprehensible by mtippett · · Score: 1

      Feel free to contact me (I'm not posting an email address here), but it shouldn't be difficult for you to find me (visit Phoronix-Test-Suite.com or openBenchmarking.org). I'm more than happy to explore your experience and look how it can be made.

    7. Re:This website is incomprehensible by Dracolytch · · Score: 1

      This site is useless in it's current state. I wanted to compare the performance of different netbooks... Searching doesn't get me the results I want. Browsing by computer type is useless. I can find two different netbooks, but if I can't get them on the same page together, then I can't ask the site to compare their results.

      Needs major refinement. Major. Refinement.

      --
      This sig has been enciphered with a one-time pad. It could say almost anything.
    8. Re:This website is incomprehensible by godrik · · Score: 1

      I agree with OP. It is very hard to understand. I'd like to see the difference between operation systems for the same machine. But I can not find a way of doing it.

  21. Just say 'Phoronix' in TFS by JonJ · · Score: 1, Informative

    So that I don't actually have to visit the site to find out it's useless.

    --
    -- Linux user #369862
    1. Re:Just say 'Phoronix' in TFS by Anonymous Coward · · Score: 0

      Why would it be useless? I worked right away for me.

  22. Power usage by P1ON33R · · Score: 2

    I've had a quick look, this is still about "bigger numbers are better". It would be nice te have more focus on power usage of modern computers!

  23. You are a self-admitted MICROSOFT shill by Anonymous Coward · · Score: 3, Informative

    Your old blog from 2007 at http://blogs.technet.com/b/jonjah/ tells us right away that you are a shill, a self-admitted MICROSOFT shill at that.

    Go get a life.

  24. Ubuntu 10.10 by l0b0 · · Score: 2

    Here's what it has to say about that:

    Lenovo ubuntu 10.10 is a motherboard. This product is available from Lenovo. The Lenovo ubuntu 10.10 has been tested via the Phoronix Test Suite in the configurations listed below.

    Let me know when they've sanitized their DB.

  25. Where's the useful view? by shish · · Score: 1

    I see a lot of data, but no organisation -- all I really want is a simple table like this one

    --
    I mod down anyone who says "I will be modded down for this", regardless of the rest of their comment
    1. Re:Where's the useful view? by Anonymous Coward · · Score: 0

      A simple table is coming very soon. First I was waiting on sufficient data (test results) before working on that area but some advancements in a 'simple view' area are imminent.

      -- Michael Larabel

    2. Re:Where's the useful view? by Anonymous Coward · · Score: 0

      Simple tables now @ http://openbenchmarking.org/index

  26. Bigger numbers in battery minutes are better by Anonymous Coward · · Score: 0

    ""bigger numbers are better". It would be nice te have more focus on power usage of modern computers!"

    And how is bigger numbers in battery minutes different?!

    Bigger numbers _are_ better, when you ask the right question.

  27. Re:Afro Ingenuity by Anonymous Coward · · Score: 0

    Your comment is disappointing and It highlights your ignorance.

    Firstly you are not intelligent enough to realize that your post is completely irrelevant to the topic at hand (we are talking about benchmarks of the Linux kernel). Secondly your post shows how bad parenting can produce bat shit crazy people.

    Also using something for more than one purpose is a sign of intelligence. Improvising shows that you have enough wits about you to analyst your surroundings and make do with what is available instead of things going to waste. That is something that we could all benefit from and may learn the hard way if oil becomes less available.

  28. Best benchmark by Compaqt · · Score: 2

    So what is the best benchmark (however that is defined)?

    Phoronix test suite

    The venerable UnixBench BYTE magazine lineage, updated by Yahoo.

    Geekbench

    --
    I'm not a lawyer, but I play one on the Internet. Blog
    1. Re:Best benchmark by Anonymous Coward · · Score: 0

      Agreed! Looking at Phoronix test suite, it does a really lame job at computational performance. None of Phoronix computational tests measure how well any of the tested systems would do computationally. Stressing the CPU computationally requires something like tonto, wrf, gamess, lesile3d or lbm, certainly not something as lame as GMPbench

      Phoronix is merely another lame linux site

  29. Re:But in PHP? Seriously? by mtippett · · Score: 1

    PHP has allowed Phoronix Test suite to support everything from embedded ARM systems to cloud compute infrastructure. The fact it uses PHP makes it extremely portable. Virtually anywhere that there is a compiler and PHP, Phoronix Test Suite can run. Note that the benchmarking itself is not in PHP, it's done in whatever native language the benchmark needs.

  30. Mod parent up by ustolemyname · · Score: 1

    +1 informative.

    (I already commented, dammit!)

  31. Re:But in PHP? Seriously? by MikeBabcock · · Score: 1

    Right, because PHP is the most common and portable language in the world. Not.

    Here's an idea, why not use something like PERL that really IS portable? Better yet, when writing a benchmark, why not use a language that's efficient so you're benchmarking the system not the quality of the implementation of the interpreter on that system?

    Any interpreted language is to be avoided for benchmarking unless it happens to be the system in use on that platform anyway (such as Java on a portable device). All we're otherwise seeing is "my platform is better suited to the Zend interpreter than yours" -- except when comparing same-platform systems to each other, in which case portability wouldn't have been an issue anyway.

    --
    - Michael T. Babcock (Yes, I blog)
  32. Re:But in PHP? Seriously? by mtippett · · Score: 1

    Okay. It's clear you haven't looked into the Phoronix Test Suite. (PTS)

    The software product itself is a Test Execution Environment. The suite's value add is that it simplifies the download and execution of the actual tests and benchmarks that are executed. Those test or benchmarks are in whatever language the author of that test profile wanted to write it in.

    PHP is not involved in any actual _measuring_ of performance, but is involved in the orchestration, interpretation and aggregation of the results.

    Check out the version of PTS in your local convenient distribution (it's in most of the recent ones).