Slashdot Mirror


Tom's Hardware Pits Newest Firefox, Opera and Chrome Against Each Other

An anonymous reader writes "Firefox 7 was released a couple days ago, and now the latest Web browser performance numbers are in. This article is the same series that ran benchmarks on Mac OS X Lion last month. This time around the new Mozilla release is going against Chrome 14 and Opera 11.51 in 40+ different tests on Windows 7. Testing comes from every category of Web browsing performance I can think of: startup time, page load time, JS, CSS, DOM, HTML5, Flash, hardware acceleration, WebGL, Java, Silverlight, reliable page loads, memory usage/management, and standards conformance. The article also has a little feature on the Futuremark Peacekeeper browser benchmark. An open beta of the next revision has just been made public. This new version adds HTML5, video codecs, and WebGL tests to the benchmark. It's also designed to run on any browser/OS/device combination — e.g. Windows desktop, iPad, Droid 2, MacBook, Linux flavors, etc. Another great read, a must for Web browser fanatics!"

42 of 272 comments (clear)

  1. Is performance really an issue? by Kenja · · Score: 5, Insightful

    I've not worried about browser performance for a long while, lets face it, they're all fast enough. What matters to me is how they behave, their interface and site compatibility.

    --

    "Have you ever thought about just turning off the TV, sitting down with your kids, and hitting them?"
    1. Re:Is performance really an issue? by mgiuca · · Score: 3, Insightful

      In the mobile versions it's very important, especially JavaScript performance.

    2. Re:Is performance really an issue? by abhi_beckert · · Score: 2

      I would argue it doesn't even depend on site compatibility anymore. They are all plenty good enough in that regard.

      So that leaves the interface, and how they behave. For me, that puts Safari squarely at the top on Mac OS X, and Chrome on windows.

    3. Re:Is performance really an issue? by cyfer2000 · · Score: 2

      or play a fun father (or maybe mother) and kids game called upgrade.

      --
      There is a spark in every single flame bait point.
    4. Re:Is performance really an issue? by Psx29 · · Score: 3, Insightful

      On OS X 10.7 Firefox is significantly slower than Safari and Chrome. Chrome and Safari are both pretty similar in performance but Safari is hands down the fastest browser on OS X because it is the only one that has complete GPU acceleration (likely due to Apple using hidden API calls). Using Windows on the same machine both Firefox and Chrome seem to run so much faster than their OS X counterparts it is mind boggling.

    5. Re:Is performance really an issue? by Kjella · · Score: 4, Insightful

      I promised myself I wouldn't become an old fart but when the suggestion is to upgrade a P4 in order to surf the net, I cringe. It's a fscking gigahertz processor, for crying out loud. It's amazing what kind of computing power you can waste just drawing up a web page, even with javascript and flash to kill performance.

      --
      Live today, because you never know what tomorrow brings
    6. Re:Is performance really an issue? by Anonymous+Brave+Guy · · Score: 2

      Exactly. Speed is always nice, but I would rather Firefox fixed the basic usability/functionality gaps:

      • Give us independent tabs, so the browser doesn't freeze every time I open half a dozen bookmarks at once.
      • Fix the basic drawing bugs: poor kerning for text, embedded content not redrawing properly any time you scroll the window...
      • Sort out H.264 support. (I don't care if it's not free-as-in-whatever, it's a much better format, and it seems like it's starting to win with an increasing number of sites I visit offering only that format via either HTML5 video or Flash).
      --
      If you disagree, post your argument. (-1, Overrated) isn't your personal censorship tool for views you don't like.
    7. Re:Is performance really an issue? by V!NCENT · · Score: 2

      Don't forget that you can count full HD 1080p movie streaming and soon WebGL to that list. The web is becomming partialy not just streaming content, but also software to run it.

      CSS and Javascript are non-binary works of Widgets and that has to be run in a user proces.

      I wouldn't cringe if I were you; new abstraction layers always cause a performance hit. This has been going on for ages:
      -From assembly to C;
      -From CLI to GUI;
      -From simple framebuffer rendering to Compositing;
      -From static to dynamic GUIs;
      -From 2D to 3D games;
      -From OpenGL to Raytracing;
      -From triangles to voxels.

      Acknowledge things move beyond their previous itterations, and also except that Slashdot would be a pain to navigate in HTMLv1, for example...

      --
      Here be signatures
    8. Re:Is performance really an issue? by Anonymous Coward · · Score: 2, Interesting

      Sort out H.264 support. (I don't care if it's not free-as-in-whatever

      You may not, but the Firefox developers do, and they care because Firefox is a free product and they're the ones who will be sued by MPEG-LA.

      it's a much better format

      Let's all pretend you can notice the difference between H.264 and WebM at the resolutions and bitrates employed for streaming on the Internet.

    9. Re:Is performance really an issue? by Joce640k · · Score: 2

      I promised myself I wouldn't become an old fart but when the suggestion is to upgrade a P4 in order to surf the net, I cringe. It's a fscking gigahertz processor, for crying out loud.

      It's usually not the CPU that's the problem, it's the RAM. Old machines have less RAM. Less then 1Gb will cripple modern browsers (especially on Windows XP which has an *awful* RAM manager).

      I regularly use a 900mHz Celeron, 2Gb RAM machine for web browsing and it's fine.

      --
      No sig today...
    10. Re:Is performance really an issue? by Anonymous+Brave+Guy · · Score: 2

      You may not, but the Firefox developers do, and they care because Firefox is a free product and they're the ones who will be sued by MPEG-LA.

      Sure, but if they want to compete with the other browsers, that's their problem. IE can do it. Chrome can do it (though they pretended they were going to stop for a while). Browsers on mobile devices can do it. Firefox can't do it. One of these is losing to all of the others.

      Let's all pretend you can notice the difference between H.264 and WebM at the resolutions and bitrates employed for streaming on the Internet.

      I do notice, because one of my jobs is working on a site that provides custom high quality videos. In our experience, H.264 also takes significantly less bandwidth than the open(ish) video formats for the same quality, and that means reduced operating costs for us.

      As a user, the same applies when I'm visiting someone else's site. I guess that's why the trend for serving H.264 only, via either HTML5 video or Flash, has been so noticeable over the past few weeks.

      --
      If you disagree, post your argument. (-1, Overrated) isn't your personal censorship tool for views you don't like.
  2. A+++++ WOULD BUY AGAIN... by fuzzyfuzzyfungus · · Score: 5, Funny

    "Another great read, a must for Web browser fanatics!"

    Seriously? Could you sound any more astroturfy if you tried?

  3. Outdated by Anonymous Coward · · Score: 4, Funny

    No point - by the time you finish reading it, FF8 will be out and the benchmarks will be obsolete.

  4. Something's missing... by trogdor8667 · · Score: 2

    Why doesn't the summary have the fact that they say Firefox 7 as the winner? Seems like a big glaring omission from this summary...

  5. Now if only they could measure user experience... by bl4nk · · Score: 5, Insightful

    The constant barrage of updates for Firefox is frustrating to say the least. Having to go through the installer every month and have your extensions checked for compatibility and consistently get disabled... it's just not worth it. I switched to Chrome and have progressed through 8 whole versions without ever noticing and without ever having my extensions break. It's divine, and how all software upgrades should be done (in a perfect world).

  6. Will this finally shut the trolls up? by hedwards · · Score: 2

    Seems like just about every article that comes out about Firefox there's a dozen or so folks that keep complaining about how slow Firefox is and how much memory it leaks. Perhaps this will point out to them that it's really not that bad, it's actually quite good over all in that respect.

    Or, they'll just keep posting it over and over again like a meme because it hasn't been about actual performance in a long time.

    1. Re:Will this finally shut the trolls up? by Baloroth · · Score: 2

      The problem isn't how well a browser behaves with properly coded sites and no addons. It's how it behaves with all the other sites, the ones that have crappy JS and Flash animations while the user has 15 addons loaded. You know, the real world? This test is interesting and gives some general idea about how a browser should behave... but should rarely equals does.

      --
      "None can love freedom heartily, but good men; the rest love not freedom, but license." --John Milton
    2. Re:Will this finally shut the trolls up? by Reality+Master+101 · · Score: 5, Insightful

      Seems like just about every article that comes out about Firefox there's a dozen or so folks that keep complaining about how slow Firefox is and how much memory it leaks.

      ... And this is the problem with Firefox. The horrible memory leak problems have been traditionally dismissed by the Firefox team as only seen by "trolls". I gave on Firefox because it constantly sucked more and more and more memory, and I had to constantly restart the damn thing when it got over 2 gigabytes with a handful of tabs open.

      Now, maybe the Firefox team (FINALLY) fixed it, and maybe they didn't. But we can't tell from this test, because they didn't do a memory leak test. What they need to do is open 41 sites, close 40 sites, open 40 sites, close 40 sites, on and on and see what happens. I know what will happen with Chrome -- since it uses a process per tab, all that memory will intrinsically get given back to the O/S. Firefox -- who knows?

      But what I do know is that it's too little, too late for me. I love Chrome, and Firefox has no compelling features to make me come back.

      --
      Sometimes it's best to just let stupid people be stupid.
    3. Re:Will this finally shut the trolls up? by AK+Marc · · Score: 4, Interesting

      The problem is that people compare performance of add-on-free Firefox against the others, then compare features as if every possible add-on were installed and working perfectly with no decrease in performance. That's why I like Opera. It's like Firefox with the add-ons I like, but I can leave the add-ons on and not take a performance hit. Given the performance/features of Opera, they beat Firefox for every test that isn't contrived by Firefox fanatics where they are similarly featured.

    4. Re:Will this finally shut the trolls up? by slimjim8094 · · Score: 2

      For what it's worth, I have 14 tabs open right now, all with big demanding webpages, and my browser's been running for at least 5 days. I'm using less than a GB, which I don't mind because it gives me instant back.

      I should note that I have more than 2GB free on my machine at the moment, and that's after Windows 7's aggressive caching. When I become RAM-starved, Firefox drops down by about half.

      I haven't ever had memory leak issues with Firefox, at least not in the last 5 years, so I'm inclined to believe the devs when they say it's shitty extensions that are causing the problems...

      --
      I have developed a truly marvelous proof of this comment, which this signature is too narrow to contain.
    5. Re:Will this finally shut the trolls up? by syousef · · Score: 2

      I haven't ever had memory leak issues with Firefox, at least not in the last 5 years, so I'm inclined to believe the devs when they say it's shitty extensions that are causing the problems...

      So what if it is. THEY designed the plugin system did they not? Is there a way to easily identify and stop offending apps? No. Is there a reason to install Firefox apart from the extensions? Not really. This cop out has always irked me. It is buck passing at it's worst!

      --
      These posts express my own personal views, not those of my employer
    6. Re:Will this finally shut the trolls up? by pmontra · · Score: 2

      I checked that on my Linux box right now: 10 tabs open in Firefox: 1% CPU, 3 tabs open in Chromium on Google Docs: 6% CPU. Is it possible that your 15% CPU usage depends on the sites you have opened in your tabs? You should start with an empty browser, add one site per time and check if any of them makes your CPU usage spike.

  7. Browser wars by mgiuca · · Score: 5, Insightful

    Although it's only been one month since Web Browser Grand Prix VI: Firefox 6, Chrome 13, And Mac OS X Lion, the browser wars show no signs of subsiding.

    Browser wars? It's competition, baby, not war. We're not waiting for a war to end so we can announce a winner and all switch to that browser. We're enjoying every glorious moment of a many-browser ecosystem. The "browser wars" were a time of nasty piling on of proprietary features in an attempt to gain an advantage. This is a glorious golden age of competition and (mostly) an emphasis on standards compliance.

    1. Re:Browser wars by mgiuca · · Score: 2

      The problem with all of those technologies is that they were Microsoft Windows only. Not like some of the Chrome features which are "Chrome only" (but anybody can implement them and hopefully one day they'll become part of a standard, e.g., NaCl), but truly Windows only and could never possibly hope to become standardised (unless Windows extinguished all other platforms forever). Take #1, ActiveX, and compare it to NaCl of today's Chrome. Yes, it took ten years to get back to the same native speed applications being delivered over the web, but that's how long it takes to get it right. ActiveX could never possibly have been supported by any other platform since it essentially let websites dig straight through to the Windows API. Sure, you got nice fast applications, but it wasn't really the web at all.

      #3 is not really a web feature but an operating system feature -- I'm not sure why Microsoft took it out but I think Gnome 3 is doing something like that.

  8. Re:Now if only they could measure user experience. by zullnero · · Score: 4, Insightful

    It's not that difficult. I'd rather have more updates...including security updates...than fewer and far between. People who complain about updates are like people who complain about having to have bumpers on their car or safety belts on a plane. Besides, the updates install themselves now automatically. Good for you, switching to Chrome for that reason...it only does the exact same thing Firefox does now.

  9. Re:Results by Baloroth · · Score: 5, Informative

    Umm, actually, no. It's 1) Firefox 7 2) Chrome 14 3 )Opera 4) IE 9 5) Safari. Might look like IE>Opera if you only glance at the results. Read closer.

    However, as far as I can tell they don't seem to be weighting categories (page and browser load times, IMHO, are much more important than WebGL, for instance, which they seem to have counted as 0 for those which don't support it.) Silverlight, especially, should deserve practically no weight in the final results at all. That said, the main browser problem isn't benchmarks or tests, its how well the browser behaves on sites that are poorly coded and therefore far more resource intensive than they should be. In my experience, those are the only times I notice a browser actually slowing down on anything like a fairly recent machine. Well, that and interface/ addon support.

    Disclaimer: I use and love Opera.

    --
    "None can love freedom heartily, but good men; the rest love not freedom, but license." --John Milton
  10. Re:This is one of the worse bench compil ever by Baloroth · · Score: 5, Interesting

    Where are you getting 438MB for Firefox 1 tab? The value listed is 42.3MB, and 475.3MB for 40 pages. I agree about the memory management thing (kinda). Firefox probably caches the pages to reload in case you open them immediately, though, so the fact it unloads that memory later but not immediately might be counting for it... IDK.

    --
    "None can love freedom heartily, but good men; the rest love not freedom, but license." --John Milton
  11. Re:Possible Categories by AK+Marc · · Score: 2

    Who has tabs? Mouse gestures? Text to speech? Who has a flash capture built-in so that no extra programs or plug-ins need to be loaded to save YouTube and other videos for later off-line viewing? Who has the easiest tools for blocking unwanted content? Who has the best (most useful and least intrusive) warnings about poor security (cross-site scripting, cookie issues, certificate errors, etc.)? There are a lot of usability issues that are mostly minor, but taken in whole point to a more usable browser than others, but when nobody is comparing those features, and people like you essentially state that there's no difference in usability, so there's no reason to even try to compare usability.

  12. Stability Tests by ohnocitizen · · Score: 4, Interesting

    I'd love to see a multi-platform (where possible) stability benchmark across the major browsers:

    Opening the same site in 10 tabs. in 100. At what point does the browser crash? What is the memory usage?
    Now open the same youtube video in 10 tabs. In 100. Repeat the above.
    Do the same with trailers.apple.com.

    Next, open a youtube video in 10 tabs for each browser, and log how long that pid remains active. Is it still there after a day? After a week? Or does it crash with no user interaction?

    I wonder where Firefox would stand in the ranks after tests like the above.

    1. Re:Stability Tests by higuita · · Score: 2

      you know that plugins run now at a separated process, right? so all the constant crash of the past are gone... also, update your flash, java, whatever, FF by itself doesnt crash for me, but flash did crash alot... and i usually have MANY tabs open for several weeks

      --
      Higuita
  13. Re:This is one of the worse bench compil ever by jlebar · · Score: 2

    Lots of memory in Firefox gets released on a timer -- in particular, the Javascript GC runs on a timer when the browser is idle, and the GC is responsible for collecting whole windows in Firefox -- whereas in Chrome, memory gets released as soon as you close a tab, since that kills a process. So it's not at all surprising that Firefox takes some time to release memory.

  14. Re:Kraken de zit cream by Anonymous Coward · · Score: 2, Insightful

    I feel as though you have strong opinions, but your inability to speak without metaphor has clouded what they might actually be.

  15. Re:Now if only they could measure user experience. by Kjella · · Score: 5, Insightful

    Really? Is the release cycle really the problem for you or something vague about extensions?

    People have a problem with the rapid release cycle because of extensions, the point has been made many times now with all the subtlety of a sledge hammer. If you can't wrap your head around that concept, you must be a Firefox developer.

    --
    Live today, because you never know what tomorrow brings
  16. Re:Firefox 7 STILL by BZ · · Score: 2

    I'd love to fix this. Reproducing would be a good start. Please point me to a url that shows the problem?

  17. Re:a must for Web browser fanatics by aztracker1 · · Score: 2

    As someone working in business eLearning, which has been dominated by flash for the past decade, I am very interested. I've also been interested in some of the better scaling backend systems as well. We're almost to a point where we can nuke flash player. Still need a broad implementation for compressed audio and video streams from the client.... Also, in need of a few other tweaks, such as better offline support. Most of all, what's needed is better tooling. So far Adobe, Microsoft and Sencha seem to be at the forefront. Though Adobe seems a little relaxed, and MS is pushing a lot of stuff for IE10 that nobody else has even thought of implementing. IE10's DB model is interesting, and the grid and multicolumn stuff is cool, still need other web browsers to cross adopt a bit more to make it really useful... Webkit is the major player for smart phones and tablet browsing, and IE only has about 40-50% of the desktop, at varying versions.

    --
    Michael J. Ryan - tracker1.info
  18. Re:Now if only they could measure user experience. by TheJodster · · Score: 2

    I agree with bl4nk. This new release schedule sucks. As an example, Firefox doesn't have a global setting for zoom. You have to zoom each page individually. I hunted down an addon to fix this called NoSquint. Works like a champ. It always worked right up until they started this ridiculous release schedule. Now it's disabled and my browser is back to everything being tiny again. That's not the only one... that's just the one that broke the camel's back.

    I switched to Chrome this weekend. It has a global zoom setting. It seems to work wonderfully and I'm not going back until Firefox stops releasing a major version number every three weeks. There is nothing wonderful about the user experience in Firefox as far as I can see.

    --
    A little misunderstanding? Galileo and the Pope had a little misunderstanding...
  19. Re:This is one of the worse bench compil ever by _|()|\| · · Score: 2

    Light memory usage (1 tab):
    firefox: 438MB
    chrome: 134MB

    memory management (after closing 40 tabs):
    * firefox: 438MB immediately after, 161MB five minutes later
    * chrome: 134MB immediately after, 94MB five minutes later

    You're misinterpreting the "memory management" chart, because of the poorly worded lead in.

    The actual "light load" numbers from the first chart (one tab) are Firefox 43.2 MB, Chrome 72.5 MB. Slight edge to Firefox.

    The "heavy load" numbers from the second chart (forty tabs) are Firefox 475.3 MB, Chrome 1,057.2 MB. Big (and, frankly, surprising) win for Firefox.

    The "memory management" numbers in the third chart show memory usage after closing thirty-nine of the forty tabs. This looks like a big win for Chrome. I don't know why Adam wrote, "We combined the two memory management tests into a single chart," or why he declared Firefox the winner of this test.

    Memory usage has long been my biggest disappointment with Safari, Firefox, and Chrome (in that order). Safari may win the occasional benchmark sprint, but it eventually slows to a crawl, dragging my system down with it. Firefox is pretty much the same, but less so. Too soon to tell how Firefox 7 is faring. (Maybe the real point of rapid releases is to force you to restart the browser periodically.) Chrome is better about releasing memory, but it just seems to fall apart with too many tabs: too high a water mark and lots of spurious redraws (a nuisance that Safari 5.1 has also acquired).

    JavaScript has made huge strides due to renewed competition. Hopefully memory usage will too.

  20. Re:Not really. by smellotron · · Score: 2

    The hundred milliseconds will ALMOST NEVER be noticed because most humans do not immediately scroll down the bottom of the page to see if all elements are completely loaded. No, for most, browsing a webpage begins much earlier.

    I wish. Most websites have inline ads that delay content display. Most successful websites also spend a lot of time on optimizing their "branding" at the expense of usability for a partial page load. If my browser doesn't know the dimensions of yet-to-be-loaded components on a page, it has to delay final rendering. Watching a page flicker as margins get adjusted is insanely distracting.

  21. Re:a must for Web browser fanatics by aitan · · Score: 2

    But do you know why it won't be possible to use those new grid features introduced in IE10 for a long time?

    You won't be able to use them because IE10 will be available only in newer versions of Windows, (I don't know if even Vista is supported), so taking into account the people that just stick with the browser that came preinstalled and the long time until all those older versions of Windows disappear, it will take several years until the number of users with those versions is low enough.

    The rest of the people with Firefox, Chrome, Opera will update at a more steady pace, so when the developers add those features you'll know that in a few months you could start using it if you're able to ignore old IE versions.

  22. Re:Now if only they could measure user experience. by thegarbz · · Score: 3, Informative

    Besides, the updates install themselves now automatically. Good for you, switching to Chrome for that reason...it only does the exact same thing Firefox does now.

    No they don't, not even remotely. When Chrome updates I normally hear about it on a Slashdot post. It does so without any user interaction at all, and without breaking any updates. It does so when the browser is not being used via the Google Update service so there's never even a blip in the user experience.

    Firefox downloads updates while running. On next restart it pops up a window and as it updates it blocks you from using the browser until it's done, and requires user interaction. When it finishes it frequently disables plugins due to compatibility issues. Then after you hit ok it pops up YET ANOTHER BLOODY WINDOW in a browser tab this time to let you know YET AGAIN that it has updated something, just in case the last 5 minutes of your life weren't any indication. Not a problem if you're just starting the browser but if you open the browser by clicking on a link the least it could do after wasting 5 minutes of my life is actually show the bloody link I clicked on.

    There is nothing automatic about Firefox's update process that is even remotely comparable to that of Google Chrome's. Actually it is only marginally better than any other application which has an update process, and even then only because it downloads first and asks questions later not giving the user the ability to ignore critical updates.

  23. Re:measuring browsers by speed alone is retarded by mikechant · · Score: 2

    MLS for realtors is a famous example of a page that wants to be IE only

    Just tried the Canadian and US MLS sites and they work fine in Firefox 7, no warnings or anything.

  24. Re:Now if only they could measure user experience. by bill_mcgonigle · · Score: 2

    . When it finishes it frequently disables plugins due to compatibility issues.

    Even better - if there are no compatibility issues, it sits there waiting for you to click 'OK' instead of going about its job of reloading your tabs.

    Yes, even if an upgrade is totally successful, you're forced to babysit the upgrade. I guess we should be grateful we don't have to dismiss a "Congratulations!" dialog...

    --
    My God, it's Full of Source!
    OUTSIDE_IP=$(dig +short my.ip @outsideip.net)