Slashdot Mirror


Java Performance On Ubuntu Vs. Windows Vista

Henckle writes "Phoronix did a comparison of the Java performance between Ubuntu and Windows Vista. They tested both Java and OpenJDK on Ubuntu 8.10 and Java on Windows Vista Premium SP1, all with stock configurations. To no-one's surprise, Ubuntu was faster in a majority of the tests. The two OSs were similar in ray-tracing, and Vista was faster at Java OpenGL due to shortcomings with the Linux graphics driver."

17 of 258 comments (clear)

  1. I must say... by Thelasko · · Score: 4, Funny

    that new 64-bit Java plugin for Linux is smokin! No waiting for applets to load or anything.

    --
    One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
  2. Interesting, but lacking some crucial details... by Smidge207 · · Score: 4, Insightful

    Just out of professional curiosity: what was the partition layout on the laptop? As benchmarks in some articles have shown, the early part of a drive is faster than later part (sequential transfer rate). With a constant areal density, data flies under the read/write heads faster on the outer larger-radius tracks.

    This is a something that's hard to get right when benching win vs. lin on the same HW, since usually you have a fairly normal dual-boot install, and one has the advantage of the outer tracks.

    It's probably not a big deal if you have two adjacent 10 or 15GB partitions, with a big data partition somewhere else.

    Ideally you'd re-partition and run benchmarks with each system installed to the first few GB. To get reasonable numbers for I/O dependent tests, you could make a scratch partition that you reformat to ext3 or ntfs before running the tests. Then have I/O benchmarks do their work in that scratch partition). (or XFS, see my previous posts for XFS tuning . XFS's delayed allocation means it doesn't start writing until you runs low on RAM, or it otherwise decides it's time to start. This means uninterrupted reading for longer = less seeks = faster.) This tests fresh filesystems, not somewhat worn filesystems that everyone will actually have after even a day of use, but usually it's not a big difference because most filesystems don't suck that badly when they're not close to full.

    I thought Vista SP1 was supposed to fix slow file I/O. Oh, IIRC, that was just slow file copying when you do it via the GUI shell. So never mind, I guess either your partitioning really skewed things in favour of GNU/Linux, Vista sucks at the file-encryption workload, or it was CPU-limited and the older JVM on Vista loses on that code.

    Oh, well, sorry for the rambling, just my $1.00-.98....

    =Smidge=

    --
    Is it just my observation, or is eldavojohn an idiot?
  3. that's odd by z-j-y · · Score: 4, Insightful

    those tests (CPU burners) should perform the same on Linux or Windows, I don't see why JVM would behave differently.

    1. Re:that's odd by Shados · · Score: 4, Informative

      They -are- different JVM builds, so its possible (as is common in the JVM's history) that some bug fixes improve performance wildly... Not across the board though, so something's wrong, either with the JVM, or with Windows itself... but something is seriously messed up.

  4. always trust phronix to mess a benchmark up by MancunianMaskMan · · Score: 5, Insightful

    they used java 1.6.0_10 on linux and 1.6.0_07 on windows. Hate to give the benefit of the doubt to ballmer & co but in spite of the minor version number, a lot of work in performance has been done on Java recently. The result is pretty meaningless.

    1. Re:always trust phronix to mess a benchmark up by hansamurai · · Score: 4, Informative

      Excellent point, u10 was the next "major" minor release after u07, check out the release notes for it here, they're... long.

      http://java.sun.com/javase/6/webnotes/6u10.html

  5. Fairness by abigsmurf · · Score: 4, Insightful
    I love the way in every test test Vista loses it's "Ubuntu is faster" but in the test where Vista wins, they explain and excuse it going "bad opengl drivers".

    Either give possible reasons for slow performance of one OS each time or don't do it at all. To excuse bad performances in a benchmark in such a selective manner reeks of bias. Who's to say the Vista performance gap wasn't caused by bad drivers? Indeed the a lot of the tests where it was slower are ones involving disk access and Vista is known for being slow at this sort of thing.

    1. Re:Fairness by Vellmont · · Score: 5, Insightful


      I love the way in every test test Vista loses it's "Ubuntu is faster" but in the test where Vista wins, they explain and excuse it going "bad opengl drivers".

      Maybe that's because Ubuntu is an open source application where we actually know why the test gave bad performance, and actually know that it's going to improve in the future?

      Who's to say the Vista performance gap wasn't caused by bad drivers?

      Don't dismiss the advantages of an open system where you can actually understand what's under the hood as just "test bias".

      --
      AccountKiller
  6. Re:That's my laptop! by Anonymous Coward · · Score: 4, Insightful

    You're having a hard time picking between Linux or Windows? Go Linux, it's cheaper to change your mind.

  7. Re:Ray tracing in Java by Yetihehe · · Score: 5, Interesting

    Yes. Sunflow is one example. I did my own tests, java vs c++ (almoste the same code) and java was only about 1.3 times slower.

    --
    Extreme Programming - Redundant Array of Inexpensive Developers
  8. Re:3D in Java? by Nicopa · · Score: 5, Informative

    I think you should check the Java port of Quake then: http://bytonic.de/html/jake2.html

  9. I was surprised by spottedkangaroo · · Score: 5, Insightful

    To no-one's surprise, Ubuntu was faster

    I'm surprised.

    I'd expect Java to go faster in windows. I don't think the reasons for using Linux are speed and software availability. I'd expect much more attention is paid to the windows versions.

    --
    Imagine if you weren't allowed to use roads because a bus company complained about your driving 3 times. --skunkpussy
    1. Re:I was surprised by LWATCDR · · Score: 4, Interesting

      You shouldn't be.
      Most java development these days takes place on the server side. Linux is has a large precentage of the server market. Then you must know that Sun is a Unix company. They push Solaris and java on Solaris. Solaris is a lot more like Linux than Windows. The the final piece is that in the Windows server market Java shares space with .net.
      So as far as the amount of attention I would say that Solaris/Linux/Unix gets just as much attention as Windows does.

      --
      See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
  10. Re:Interesting, but lacking some crucial details.. by xouumalperxe · · Score: 4, Insightful

    Indeed, you're rambling. Partitioning schemes are not very relevant for this test suite. The only test that could realistically be considered HDD-bound is the file encryption one, and even then the performance difference is too large to be attributed to which bit of the disk you're reading. I'd guess that on-the-fly encryption is must more CPU-bound than it is HDD-bound, and under that light that test proves consistent with all the other raw maths performance tests.

    If anything, what I'd like to see is the 3D rendering bit redone with an nVidea card (that actually has decent drivers), to actually test their assertion that the performance loss on the linux side is really due to the graphics drivers.

  11. Re:Interesting, but lacking some crucial details.. by chrb · · Score: 5, Insightful

    Various problems with the Phoronix test methodology have been noted before and before that. Without going over the same stuff, here are some potential questions about this benchmarking:

    • Where is the statistical analysis of these results - ok, you ran a test once and it was 30% slower. Is this reproducible? What is the variance? Is there any statistical difference between openjdk/sun java?
    • Why is the Java minor version different? Do you see the same results if the same minor version is used?
    • As mentioned in the previous discussions, exactly why is Windows slower on the file encryption task - it should be either limited by disk throughput, or by CPU throughput, so observing a 40% drop in performance attributed to the underlying I/O handling of the operating system is somewhat surprising; are you sure the test methodology is sound here, and if so, how do you explain the results?
    • Are these results applicable to both 32 and 64 bit distributions and JDKs?
    • How do you know that the 2D benchmark performance on Linux is attributable to poor graphics drivers? Why not run the test on another PC and then swap out graphics cards (hence eliminating all other factors) and report on the results?

    There are a lot of questions that this benchmarking should have answered, and a lot of assumptions made that could potentially be invalid.

  12. Re:Interesting, but lacking some crucial details.. by chrb · · Score: 4, Informative

    even then the performance difference is too large to be attributed to which bit of the disk you're reading

    No it isn't. How do you know that a particular sector of the hard disk isn't failing, causing access to that one sector to be a thousand times slower than other sectors? This is why experiments are supposed to be run many times, across different platforms, and the aggregate results taken. Without multiple experimental replicates you have no way of showing that the results you observe generalise at all; the observed problem could just be one bad run.

  13. Re:Interesting, but lacking some crucial details.. by ozphx · · Score: 4, Informative

    Yeah its pretty much assclowing IMO. I just booted my Vista laptop this morning. Process explorer shows 9300B idle cycles vs around 200B for other shit (mostly Opera, Steam, and sony's shitty phone sync). Taking them out we're left with bugger all - around 10B cycles "wasted" by default Vista services etc (well, actually SetPoint, AVG, Daemon tools, but regardless). Most of these aren't actually doing anything, just sitting there having started and are now idle. Looks like close as makes no odds 100% CPU avaliable for their JVM.

    So according to this, the OS has fuck all overhead in terms of services. So either the kernel is managing the 50% overhead we saw in the SciMark test - or their tests / JVM are crap.

    I'd tend towards thinking the latter.

    --
    3laws: No freebies, no backsies, GTFO.