Slashdot Mirror


Benchmark Battle October 2016: Chrome Vs. Firefox Vs. Edge (venturebeat.com)

Krystalo quotes a report from VentureBeat: It's been more than a year since our last browser benchmark battle, and the competition remains fierce. Google Chrome, Mozilla Firefox, and Microsoft Edge have all gained a variety of new features and improvements over the past year. It's time to see if any of them have managed to pull ahead of the pack. It appears that Edge has made the biggest gains since last year. That said, browser performance is improving at a very rapid pace, and it shouldn't be your only consideration when picking your preferred app for consuming Internet content. You can click on individual tests below to see the details:

SunSpider: Edge wins!
Octane: Edge wins!
Kraken: Chrome wins!
JetStream: Edge wins!
Oort Online: Firefox wins!
Peacekeeper: Firefox wins!
WebXPRT: Edge wins!
HTML5Test: Chrome wins!

You can also read all about the setup used for the benchmark tests here. VentureBeat used a custom desktop PC, featuring an Intel Core i5 4440 processor (6M Cache, 3.10 GHz), 8GB of DDR3 1600MHz RAM, a 500GB SATA hard drive (7200 RPM), an Nvidia GeForce GTX 460 graphics card, and a 24-inch widescreen LED monitor (1920 x 1080).

68 of 137 comments (clear)

  1. Not surprised by Anonymous Coward · · Score: 1, Informative

    The newest version of Chrome is garbage. Crash city. I had to go back to Firefox.

    1. Re:Not surprised by Anonymous Coward · · Score: 5, Insightful

      In normal everyday use, I have never had any meaningful performance problems with any of the major browsers. In real life use, you're more likely to have issues with a shitty Internet connection or a website that's a horribly designed shitshow. And all the performance in the world doesn't mean a thing if the UI of the browser sucks donkey balls. Palemoon FTW.

    2. Re:Not surprised by donaldm · · Score: 1

      The newest version of Chrome is garbage. Crash city. I had to go back to Firefox.

      I am running version 54.0.2840.71 (latest as far as Fedora 24 is concerned) and don't have any problems. Maybe it's the operating system you are running it on.

      --
      There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
    3. Re:Not surprised by gustygolf · · Score: 1

      Besides, aren't those all JavaScript benchmarks?

      I couldn't care less about JS performance.

      The most lag for me comes from the network connection's lag and the overloaded servers on the other end that take hundreds of milliseconds to respond.

      If we discount those, the important thing is the layout engine's performance. I don't think any of those benchmarks test it. It's something you can't really test without a physical stopwatch anyway.

      The most slowness comes from the megabyte of HTML, megabyte of CSS, and megabyte of JavaScript the browser has to parse on every page load because nobody knows how to write light web pages any more, since eeeeverything needs jquery and a couple of other frameworks.

      --
      "Slow Down Cowboy! It's been 58 minutes since you last successfully posted a comment" -- slashdot, driving users away.
    4. Re:Not surprised by ElizabethGreene · · Score: 1
      >> I couldn't care less about JS performance.

      You are mistaken. The page where I'm typing this reply has 27 seperate Javascript files loaded. Slow parsing and execution of those files can hurt page performance just as much as a slow server connection or busted renderer.

  2. Re:Fuck Slashdot Subdomains by imgod2u · · Score: 2

    Chrome on mobile has a neat feature that takes certain web pages with a lot of text (articles) and allows you to choose a "mobile optimized" version. It is so much faster than the normal bloatware site.

    I wish there were a way to make it default.

  3. Palemoon and Chromium by unixisc · · Score: 1

    Wonder how Palemoon and Chromium fared? I use Palemoon on my Windows laptop, and on my PC-BSD, which doesn't have Chrome, I have Chromium. How different would Chromium be from Chrome?

  4. Firefox extensions still make it the best by realmolo · · Score: 3, Insightful

    uBlock Origin, uMatrix, Tab Mix Plus...

    I can't live without them. I worry that they'll all go away when Firefox abandons their extensions system in the future, like they are talking about.

    1. Re:Firefox extensions still make it the best by MSG · · Score: 1

      In particular, the ability to have extensions on the mobile app is a major advantage.

    2. Re:Firefox extensions still make it the best by mjwx · · Score: 1

      In particular, the ability to have extensions on the mobile app is a major advantage.

      Its been a while since I looked at Firefox for Android. Nice to see uBlock in there. However I switched to Ghostery browser a while ago and haven't looked back. Still, good to have Firefox as an alternative.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
    3. Re:Firefox extensions still make it the best by jjbenz · · Score: 1

      you forgot noscript.

  5. Re:Fuck Slashdot Subdomains by psyclone · · Score: 1

    But at least /. uses subdomains in a meaningful way. It is annoying to allow cookies for *.slashdot.org though.

    Speaking of unnecessary web shit: uBlock shows me 25 blocked resources on this page.

  6. Re:Fuck Slashdot Subdomains by psyclone · · Score: 2

    Firefox also has Reader Mode that does something similar.

  7. Edge. LOL! by Chas · · Score: 5, Insightful

    Edge could have won EVERYTHING and I still wouldn't use it.

    --


    Chas - The one, the only.
    THANK GOD!!!
  8. Re:Fuck Slashdot Subdomains by Anonymous Coward · · Score: 2, Insightful

    So do we all agree that this "benchmark battle" is archaic? The ability to quickly render bloatware sites is fine, but the ability to remove the bloat is much more important. I hope that in 5 years that's how we'll be scoring browsers.

  9. Re: Fuck Slashdot Subdomains by corychristison · · Score: 2

    I was going to mention Reader Mode on Firefox but someone already beat me to it. Though it should be noted this feature is not just limited to the Mobile Browser, and is available on the Desktop version as well.

  10. WHAT ABOUT MEMORY USAGE!!! by halfdan+the+black · · Score: 1, Troll

    All browsers are fast, OK we get it. Now what about the real issue, MEMORY USAGE!!!

    Memory consumption is the big problem with modern browsers, how inefficient are they, how much memory do they consume over time, how often do you need to restart them because they consume all the memory on your machines. I don't use Windows, but I can say on OS X, Chrome is probably about the absolute worst with memory usage, it will typically hog about 200-500 MB per freaking web page. Yes, half a freaking gig just for a damned web page, thats utterly ridiculous.

    When you start comparing efficiency, let me know.

    1. Re:WHAT ABOUT MEMORY USAGE!!! by dbIII · · Score: 2

      Now what about the real issue, MEMORY USAGE!!!

      Chrome, the current Firefox and a few others are designed with the assumption that memory usage is not a real issue while speed is - hence all that stuff in tabs being kept in memory. Yes it sucks if you want to use anything other than their application at the same time or have an older machine with less memory than the maxed out dev machines, but those developers do not care about such a situation.
      The answer is an older version or a project that has a goal of a low memory footprint.

    2. Re:WHAT ABOUT MEMORY USAGE!!! by halfdan+the+black · · Score: 1

      Huge memory usage brings with it a range of problems. Instead of the browser itself choking on a page (rarely happens), now the entire operating system chokes because the browser gobbles up all the available memory. I have a bad habit of keeping lots of tabs open, and over time, each of them consumes more memory. I've fairly regularly have a 8GB 2015 iMac completely lock up because the browser used up all the available memory.

      Its just plain sloppy careless coding. If you're not paying attention to how much memory a systems level component (like browsers are becoming), then you have no business writing systems software.

      So, I say, lets have a memory usage shootout, and try it on different operating systems.

    3. Re:WHAT ABOUT MEMORY USAGE!!! by halfdan+the+black · · Score: 2

      I do use AdBlock, in fact, I would say that today's internet is literally unusable without AdBlock. Go to a page like cnn or nbcnews without AdBlock and about 500,000 adware, crapware loading scripts are running killing you with this taboola revcontent garbage. Ads have become so incredibly obtrusive that browsing without an adblocker is next to impossible, especially on a tablet with limited memory and processor power.

    4. Re:WHAT ABOUT MEMORY USAGE!!! by dbIII · · Score: 1

      Instead of the browser itself choking on a page (rarely happens), now the entire operating system chokes because the browser gobbles up all the available memory

      That's a WIN for the average application developer. Why would you want to run anything else on your computer other than their masterpiece?

      Thus needing to look outside the mainstream for something to do the job the way you want it instead of the trendy way.

    5. Re:WHAT ABOUT MEMORY USAGE!!! by donaldm · · Score: 1

      Now what about the real issue, MEMORY USAGE!!!

      Chrome, the current Firefox and a few others are designed with the assumption that memory usage is not a real issue while speed is - hence all that stuff in tabs being kept in memory. Yes it sucks if you want to use anything other than their application at the same time or have an older machine with less memory than the maxed out dev machines, but those developers do not care about such a situation. The answer is an older version or a project that has a goal of a low memory footprint.

      Having 16GB of DDR4 memory is great except I rarely exceed 4GB of usage even with multiple web browsers and tabs. Most of the time I use Chrome and my overall memory utilization (includes system applications as well) is around 1.5GB to 3GB. Just for your edification, I opened 20 tabs in Chrome and my memory utilization jumped from 2GB to 3GB. Maybe you are running Chrome on the wrong operating system.

      BTW. I run Fedora 24 and on login I automatically run Konsole (six shells) , Dolphin, Ktorrent, System monitor and VLC. I actually am running a video at the moment as well as the twenty tabs in Chrome and I have barely gone over 3GB in memory. Of course having a Skylake Core i7 6700 (not into overclocking hence I never bothered with the "K" model) does help.

      --
      There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
    6. Re:WHAT ABOUT MEMORY USAGE!!! by dbIII · · Score: 1

      Once someone opens a PDF in chrome on linux that memory usage increases a LOT and doesn't reduce when the tab is closed. The same goes with some other plugins. I've had a few people on 8GB go into swap until they close chrome but each time they may have had that instance of chrome running for a couple of months.

    7. Re:WHAT ABOUT MEMORY USAGE!!! by donaldm · · Score: 1

      Once someone opens a PDF in chrome on linux that memory usage increases a LOT and doesn't reduce when the tab is closed. The same goes with some other plugins. I've had a few people on 8GB go into swap until they close chrome but each time they may have had that instance of chrome running for a couple of months.

      I am using the QupZilla browser to reply to you on this.

      When I start Chrome my memory utilization goes from 2.3GB to 2.5GB
      Start four tabs and open up some large (3 over 4MB PDF's - one was 35MB). Memory utilization now at 3.38GB.
      Remove the four tabs that contain the PDF's. Memory utilzation now at 3.2GB and is still dropping but very slowly.
      Close Chrome. Memory utilization drops to 2.36GB, which was where I started before firing up Chrome.

      I do concure with what you said but I normally close my browser when I have no use for it. Of course other people may prefer to leave their browser up and all tabs open but since it only takes me about a second to start Chrome, approx two for Firefox, a secod for QupZilla and a second for Konqeror I don't care. SSD's on a SATA 3 bus are really quite fast.

      I rarely use my Chrome browser to open up PDF's prefering Ocular or any of the other image viewers I have installed on my system such as Geeqie, Gwenview or E-Book Viewer. I can even use The Gimp if I want although I don't.

      If I am not using an applicaion I normally close it although there are some applications I always have runing. Since I have been using virtual desktops (my default is four) for well over twenty years I could leave multiple instances of browsers or applicaions up but I do prefer clean desktops. In fact the only icon I have on my desktop is the trashcan. For favourites I have a auto hiding bar and of course my Favorites tab in my application launcher.

      This is why I like Linux. If you are a messy worker you can be messy, if you prefer neet you can be that too, but whatever customisations, layouts and styles you are comfortable with, you are in control.

      --
      There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
    8. Re:WHAT ABOUT MEMORY USAGE!!! by dbIII · · Score: 1

      Thanks for the reply.
      The problems (minor ones really) were with Chrome with the Adobe PDF plugin and not the current version of Chrome that renders PDF files itself.
      It had a very bad habit of keeping an "acroread" process running after the tab had closed.

  11. Re:Checks out anecdotally by FyRE666 · · Score: 1

    Chrome is actually significantly faster with WebGL / GPU accelerated content, when compared to Firefox. I've found FF to feel slower and less stable for some time now.

  12. MathML by Trogre · · Score: 2

    MathML: Firefox wins!

    Mostly on account of the other browsers not supporting it at all.

    --
    "Nine times out of ten, starting a fire is not the best way to solve the problem." - my wife
    1. Re:MathML by hcs_$reboot · · Score: 1

      It seems Chrome had good reasons to remove MathML

      --
      Slashdot, fix the reply notifications... You won't get away with it...
    2. Re:MathML by Trogre · · Score: 1

      The "good reason" being a security bug that no one could be bothered fixing so they just ripped out the whole implementation.

      Never mind that it's an important part of the HTML5 specification and MathJax, while nice, is too slow for many situations and shouldn't be necessary on modern browsers at all.

      --
      "Nine times out of ten, starting a fire is not the best way to solve the problem." - my wife
    3. Re:MathML by hcs_$reboot · · Score: 1

      MathJax is used a lot by Mathematics Stack Exchange

      --
      Slashdot, fix the reply notifications... You won't get away with it...
  13. Opera? by 0100010001010011 · · Score: 1

    I've since switched to Opera (with built in ad blocking) and things seem faster.

    Unlike FIrefox which would crawl to a stop randomly.

    1. Re:Opera? by tginouye · · Score: 1

      Yea, I still have an old copy of their "latest" Presto build on my PC for old times sake, but that change to "Chrome dressed in Red" kinda killed it. I still enjoy it's mouse gestures, but nothing that Otter Browser can't do. I'm still in the market to find something else, currently using Otter, Sleipnir, Opera, and Edge when necessary. I wish they could've a) kept presto, and b) not been bought by the Chinese.

    2. Re:Opera? by zerocommazero · · Score: 1

      I've also switched about 2 months ago or so after trying Opera for a while and have been happy.

    3. Re:Opera? by mister_playboy · · Score: 1

      The old Presto version received a security update earlier this year... version 12.18. Grab it if you haven't already.

      ftp://ftp.opera.com/pub/opera/...

      The most notable fix is for the code 40 HTTPS errors on Cloudflare sites. Windows only unfortunately.

      --
      Do what thou wilt shall be the whole of the Law ::: Love is the law, love under will
    4. Re:Opera? by tginouye · · Score: 1

      Thanks for the update. I have noticed that Otter is slow in progress, but I have my fingers crossed! I'll take a look at Seamonkey and see how I like it. It may enter my rotation. And yea, I really don't do much on Opera, mostly just for accessing my junk email/when I click on that Red "O" out of habit.

  14. Who the fuck cares by Anonymous Coward · · Score: 1, Insightful

    Nobody

  15. Something's missing.... Flash! by theendlessnow · · Score: 3, Funny

    Where are the Flash benchmarks?

    Preparing to watch this post sink to the ocean floor....

  16. Rigid by PopeRatzo · · Score: 1

    These tests are totally rigged. No mention at all of Netscape Navigator. It's a disgrace.

    --
    You are welcome on my lawn.
    1. Re:Rigid by Anonymous Coward · · Score: 1

      Netscape? I'm still using Mosaic.

    2. Re:Rigid by theendlessnow · · Score: 1

      Mosaic? Lynx for the win!

  17. Vivaldi by vel-ex-tech · · Score: 2

    What about Vivaldi I'm wondering. I've been using it for a few months now on both Win7 and Gentoo, and I've been liking it.

  18. the test should be on a local LAN server and a mix by Joe_Dragon · · Score: 1

    The test should be on a local LAN server and a mix of different hardware to test on.

    also re-image the system after each browser change so that so caching can't mess up the tests.

  19. The only thing that matters is... by 110010001000 · · Score: 1

    ...adblock.

  20. Look at the plot axes. by willy_me · · Score: 1

    All the plots in the referenced article do not start at zero. This leads to very misleading plots so be warned.

  21. Lynx wins! by dbIII · · Score: 2

    Lynx, the text mode browser, beats the lot in speed.
    How is that for an illustration that features matter and Edge needs more than speed to measure up to the web browsers that have been developed for longer.

    1. Re:Lynx wins! by DMFNR · · Score: 1

      Lynx is a bloated mess, I don't understand how something meant just for web browsing can use over two megabytes of memory, that's like a quarter emacs, or one five millionth an LOC, absolutely ridiculous. Real power users should be using either retawq or netrik.

    2. Re:Lynx wins! by dbIII · · Score: 2

      Yes I totally agree (I remember this being discussed when an attempt was made to build lynx for DSLinux on the Nintendo DS) but it's the text mode browser most people have heard of so that is why I used it as an example.

    3. Re:Lynx wins! by DMFNR · · Score: 1

      I was just being a smartass really, but it's amazing what difference a change in perspective can make! If you really want to get lightweight check out the ancient line mode browser co-authored by Tim Berners Lee: https://www.w3.org/LineMode/ Only uses 1.2 mb on my system!

  22. Re:Checks out anecdotally by Anonymous Coward · · Score: 1

    Chrome is actually significantly faster with WebGL / GPU accelerated content

    Got a benchmark for that? This WebGL benchmark says otherwise.

  23. Competition by markdavis · · Score: 4, Insightful

    >"The competition remains fierce. Google Chrome, Mozilla Firefox, and Microsoft Edge have all gained a variety of new features and improvements over the past year."

    Isn't it nice to not have just one mega browser? Competition is a wonderful thing.... Edge is not multiplatform, nor open, so not sure it can count, completely. Chrome is not really open-source (the base is, as Chromium), but at least is multiplatform. Firefox is completely open and very multiplatform, but seems to be turning into Chrome for some reason (gotta piss off your user base, you know). But all three are winners in various benchmarks.

    1. Re:Competition by iampiti · · Score: 1

      You'll probably won't read this but if those are your only requeriments Firefox also fits them. I use it both on Windows and my Android phone with syncing and everything and it works well

  24. Zero index your bar charts by Anonymous Coward · · Score: 1

    Notice that in most of the ones where edge won they didn't zero the bar charts (bottom at zero) so it looks like edge won by a lot. But on most of the other bar charts they did zero them so it looks like the other browsers barely beat edge.

    1. Re:Zero index your bar charts by dcooper_db9 · · Score: 1

      That's a good point. It got me playing with charts to see what they'd look like using different ranges. The results are on my website. http://www.database9.com/blog/...

      --
      I do not block ads. I do block third party scripts.
  25. Re:Edge. LOL! by DNAgent · · Score: 1

    Point me to the version of Edge I can install from the Debian repos.... Yeah, not a contender.

  26. It's mostly "Wins!" by a hair by Fencepost · · Score: 4, Insightful

    Most of the results (despite how the graphs are distorted) are actually really close.

    Sunspider differences were actually big with Edge 108ms, Chrome 190ms, Firefox 254ms

    Octane had Edge winning with 33489, Chrome second with 31839, Firefox last with 30307. That means Edge was about 10% faster than Firefox, with Chrome splitting the difference. Not huge.

    Kraken had Chrome at 938ms, Edge 1160ms, Firefox 1224ms, so around 25% slower for Firefox - enough to be noticeable, depending on what you're doing.

    Jetstream had Edge winning with 219, Chrome with 184, Firefox trailing badly at 154, so again a fairly substantial gap. Looking a little at the details, all had around the same throughput and whatever's being measured on latency was the driver for the differences.

    For the Oort WebGL graphics, Firefox was best with 10000, Chrome second at 9940, Edge third at 9920. Those are not differences that excite me.

    Peacekeeper (no longer maintained) had Firefox first at 4655, Chrome second at 4325 and Edge trailing badly at 3091 - not quite as lopsided as the Sunspider results, but quite the reversal.

    For WebXPRT (HTML5+JS), Edge won with 448, Firefox at 402, Chrome at 396. That's 10% faster for Edge, but margin of error for Chrome and Firefox.

    And finally for the HTML5 test Chrome had 499, Firefox 462, Edge 460 - again around a 10% difference between slowest and fastest.

    --
    fencepost
    just a little off
  27. Better analysis? by jgoemat · · Score: 1

    Nice of them to run these benchmarks, but a little better analysis would be nice. Like the Oort Online test. Chrome got 9960 and Firefox "left it in the dust" with 10,000. That's 0.4%. The difference in frame rate would be 59.76 fps vs 60.00 fps if the results are translatable.

    Also, I doubt their results are generalizable across all computers. I just ran the peacekeeper benchmark on all three browsers on my laptop and chrome won.

    Me: Chrome: 3191, Firefox 2908 (-283), Edge 2158 (-1033)

    Them: Firefox 4655, Chrome 4325 (-330), Edge 3091 (1564)

    Just take all benchmark results with a grain of salt, especially ones where all are withing 1% of each other. Saying "Edge won 4 out of 8 benchmarks" is virtually meaningless.

  28. Re:Edge. LOL! by donaldm · · Score: 1

    Point me to the version of Edge I can install from the Debian repos.... Yeah, not a contender.

    Can't find the Edge browser in Fedora or Mint repos so I will have to make do with Chrome, Firefox, QupZilla and Konqueror not to mention the other web browsers I can install in a few minutes if I feel like it.

    --
    There ain't no such thing as proprietary standards only proprietary formats. Standards are by definition open.
  29. What about other browsers? by LightNecromancer · · Score: 1

    Why not include other browsers such as Opera, Vivaldi, or even Safari?

  30. Wrong contest by Alain+Williams · · Score: 1

    the biggest problem that I have is not browser performance, but crap web sites that are badly designed.
    * Download insane amounts of JavaScript from third parties (facebook, linked in, google analytics, ...) none of which improve my experience
    * Have large images or auto start playing some video advert
    * Badly written - fail the W3 validator suite
    * Javascript that sits in a loop using large amounts of CPU doing nothing (that I can see)
    We need a survey for major web sites using metrics like this. The problem is web sites far more than browsers.

    Then there is privacy, but that is another issue. How many web sites fail when you run Ad blockers or Javascript blockers.

  31. Re:Checks out anecdotally by rtb61 · · Score: 1

    How about comparing edge of windows 10 to Firefox on Ubuntu and then see which is truly faster, no comparison, Firefox on Ubuntu eats the probe alive. The only advantage edge gets is the coding lie, already running in the background whether you use the browser or not (edge prying into your life, even when you run Firefox), just like the lie about faster boots with delayed service start (most applications will simply not run until delayed start services have finally launched). Just more M$ marketing bullshit and you can bet they make sure that Firefox runs as slow as possible on Windows anal probe 10.

    --
    Chaos - everything, everywhere, everywhen
  32. Who cares about the benchmarks? Really, who? by QuietLagoon · · Score: 2
    Who are the people for whom the benchmarks are the most important thing about a browser.?

    .
    For me, my concern is more with the disaster that the Firefox UI has turned in to.That affects me whenever I use Firefox.

    How fast does a page load? They all load quickly enough, once I disable advertisements.

  33. would like to see... by buddyglass · · Score: 1

    I'd like to see a Mac version of this, pitting Chrome, Firefox and Safari running natively on the latest OS and recent hardware.

  34. FTW? by dcooper_db9 · · Score: 1

    WTFDTM?

    --
    I do not block ads. I do block third party scripts.
  35. Re:Checks out anecdotally by neoritter · · Score: 1

    Queue salty tears and overreaction.

  36. Dear Microsoft: by emil · · Score: 1

    Open the source and we will talk. Until such time, keep your black box to yourself.

  37. Don't use Ghostery on KitKat or lower. by emil · · Score: 1

    It uses /system/lib/libwebcore.so, which has a massive amount of bugs.

    Firefox has a ghostery extension. Use this instead, because Gecko will stay updated. Webkit should be avoided on the Android platform, because you have no idea what you are getting.

  38. Take with a grain of salt by Shirley+Marquez · · Score: 1

    Read carefully. Some of the bar graphs seriously distort the truth by using a non-zero origin. Notably, the one for Oort Online makes it look like there are big differences between the three browsers, despite the fact that the slowest browser is less than 1% slower than the fastest one.

  39. NoScript Anywhere by martrootamm · · Score: 1

    There is NoScript Anywhere for Firefox for Android. Be forewarned, though, that Firefox Reader Mode requires that a site be whitelisted for JavaScript; apparently, Reader Mode requires JavaScript.