A Real World HTML 5 Benchmark

KidCompy writes "The newest browsers boast huge performance improvements, but how much do you trust benchmarks trotted out to prove those claims? Do they reflect the real uses to which developers will put HTML 5 and JavaScript? We've extracted several benchmarks from our existing programs to measure actual versus theoretical performance."

Comments

Re:Could you please post your scores + H/W Specs?

[dakohli]

Here are my scores: Galaxy S Captivate ('droid Cellphone): 2158

eLocity A7 ('droid Tablet): 3969

Acer L100 (GeForce 6150/Linux Mint 9)

(Athlone 6400 x2 w/ 2Gb Ram)

Mozilla 3.6.13: 4938 Opera 10.60: 6335 Safari 531.2: 6410

I have some Windows boxes around, but they are shut down right now. Not really sure how good these scores are

My stats

[UBfusion]

Firefox Portable v3.6.13, Score: 6536/50000 rwb points

Firefox Portable v4 beta 8, Score: 8006/50000 rwb points

Opera Portable v11: Score: 10756/50000 rwb points

Chrome v8.0.552.224, Score: 11464/50000 rwb points

OS: Win7 x64, PC: Intel Core 2 Quad Q6700 @2.66, 4GB RAM, VGA: Radeon HD 4670, Catalyst 10.10, Core@750, Memory@800

Real World HTML 5 Benchmark?

[Haedrian]

Strangely enough I don't think bots which smack into each other and have collision sensors are very much real world. I don't plan on using my browser to animate bots colliding into each other in the forseeable future...

Re:Real World HTML 5 Benchmark?

[SanityInAnarchy]

Not to mention, it kind of looked like they were running some sort of BASIC on top of JavaScript...

PC ability

[rhade]

How much of this is dependent on the pc?

Re:PC ability

[rhade]

and how do we know this is being done the most efficient way? The code needs to be peer reviewed

Re:PC ability

[BeforeCoffee]

Most efficient? No. First of all, we want to accentuate the positive with HTML5, and that means leveraging Web Workers and freeing up the DOM thread to do DOM-like things. That is tricky though, lotsa delicate messaging required between modules, and we only halfway refactored the code for that before the Christmas release deadline hit. So, I anticipate all Web Worker-capable browsers will double in Tasty script interpreter performance once we get a chance to implement that. But, as for now, we're single-threaded on the DOM thread.

Also, Chromatic is a computer languages and VM expert since he's been knee deep in Parrot code for years, and once he can get some wrench time in, I'm sure he'll provide all sorts of optimizations. What I put together isn't horrible architecture-wise, so don't let me sell myself too short.

Anyways, for now you'll have to settle for this being a measurement of how well your favorite JavaScript engine's optimizers can JIT compile my less-than-optimal Javascript into okay-fine machine code. :)

Re:Could you please post your scores + H/W Specs?

[msclrhd]

Firefox 4.0b9pre (Mozilla/5.0 (X11; Linux x86_64; rv:2.0b9pre) Gecko/20101224 Firefox/4.0b9pre)

Score: 7203/50000

#1 -- 438 iterations, JS/engine: 10, DOM: 8, JS/mem: 3. Math: 1, JS/flow: 4, Graphics: 9
#2 -- 37 iterations, JS/engine: 5, DOM: 10, JS/mem: 0. Math: 2, JS/flow: 10, Graphics: 10
#3 -- 4208 iterations, JS/engine: 6, DOM: 0, JS/mem: 0. Math: 5, JS/flow: 10, Graphics: 1

Ubuntu 10.10 x64 (Gnome 2.32.0 / Kernel 2.6.35-22-generic) on a 4GB Intel i7 (Q720 @ 1.60GHz) with 1GB NVidia GeForce GT 230M using NVidia driver 260.19.06

scores + H/W Specs

[surveyork]

All browsers = 32 bit.

Firefox 4.0 beta 8: 7794

Opera 11: 11569

Pale Moon (Firefox) 3.6.13: 6381

Firefox 3.6.13: 6555

CPU: AMD Phenom II X2 550 Processor 3.10 GHz
RAM: 8 GB
Windows 7 Enterprise 64 bit
GPU: ATI Radeon HD 4200

Re:Could you please post your scores + H/W Specs?

[beelsebob]

Safari 5.0.3 using WebKit r74228: 11984
Chrome 8.0.552.231: 11565
Firefox 3.6.13: 6316

Oddly both chrome and safari came up as "Safari version 534.10" in the benchmark.

MacBook Pro 3.06Ghz Core2Duo with 8GB RAM running Mac OS 10.6.5

An aside: The programs you're giving to kids look pretty awful. I know a lot of people have nostalgia about programming their Amiga etc, but I don't think it had anything to do with the crappy programming languages they used to do it. Instead it was simply that those systems allowed you to relatively quickly get together something that actually represented something close to a commercial game. I think all you're doing is making the task harder for kids wanting to learn by giving them such a crappy language to work with.

Re:Could you please post your scores + H/W Specs?

[gnalle]

Epiphany 2.30.6 on Debian Sid GNU/Linux on a Dell Inspiron 6400
Linux kernel 2.32-5 with opensource radeon driver

Score: 6347/50000 rwb points
BumperBots w/ Sprite Collisions Iterations run 382
Title Screen Painter Iterations run 5
Title Mandelbrot Set Fractal Zoomer Iterations run 4146

By the way. Your site is pretty cool, but I would like it even more if you didn't use BASIC. Perhaps you could add a slightly more modern language as an alternative.

Re:Not much faith in their programmers...

[Carewolf]

Chrome is reporting both as safari and as chrome, it even includes a safari version number, as a minimum safari-version it is compatible with. When Chrome is spoofing to anyone not specifically testing for Chrome, it is hard to blame anyone misdetecting them.

My Results

[bgarcia]

My results (running on quad-core Windows Vista 32-bit):

Chrome 8.0.552.224: 8641
Firefox 3.6.13: 5082
Internet Explorer 8.0.6001.18999: 2145

Interpreted languages ftw

[ponos]

Well, seeing a Mandelbrot algorithm running on an interpreted language on top of an interpreted language and
struggling on my super powerful quad core makes me suffer. I had coded the Mandelbrot fractal in assembly
and it ran faster on a 80386...

Now get out of my lawn...

Re:Interpreted languages ftw

[Seth Kriticos]

Don't you worry, one of these days, someone will write a full 386 emulator in JavaScript bringing the full Web 2.0 fidelity to your lawn.

And if you have an especially powerful rig, you'll even be able to use the 'turbo' button.

FarmVille

[tepples]

I don't plan on using my browser to animate bots colliding into each other in the forseeable future

Video game developers do. If HTML5 proponents want it to replace Flash, it needs to be able to do so for FarmVille, Tetris, and all the other popular browser games.

OS X and virtual Win + Ubuntu 10.10, 4 browsers

[jovius]

MacBook Pro mid 2010 i5 2.4GHz, latest public browser versions

Firefox: 5055 / window minimized: 4930
Safari: 10628 / 11210
Opera: 9121 / 9487
Chrome: 10903 / 11035


On virtualized Windows XP home SP3 (Parallels desktop 6):

Firefox: 5878 / 6749
Opera: 9170 / 9734
ie 8: 1463 / 1440
Chrome: 10920 / 11392


Another reference point, virtualized Ubuntu 10.10

Firefox: 5165 / 6040
Chrome: 10769 / 11064
Opera: 8942 / 9500


Chrome was identified as safari 534.10 on all OS's. The results seem to fluctuate a bit from run to run, from 10 to 1500 points (i did some of the tests two - three times). It seems I get different results each time the test is run.

Re:Could you please post your scores + H/W Specs?

[kainosnous]

I don't understand why people are still using IE. Is there a test that it can pass? I would just put in some conditional comments (which should just be ignored), and give them an "upgrade" link to get a real browser.

Obligatory result

[rshane]

Core i5-650
8gb RAM
Windows 7

Firefox 4.0b8 - 8246/50000
Chrome 8.0.552.224 - 12611/50000

Re:Could you please post your scores + H/W Specs?

[yiffyfox]

Win 7 64bit AMD 965 oc 4.0GHz 8GBram (nvidia 295):

13809 (762, 108, 8631) - Chrome 8.0.552.224 / safari 534.10
13061 (750, 45, 8550) - Opera 11 build 1156 / opera 11.00
12924 (703, 68, 8678) - Safari 5.0 (7533.16) / safari 533.16
8429 (495, 37, 5256) - Firefox 3.6.13 / mozilla 1.9.2.13
2873 (123, 5, 2533) - IE 8.0.7600.16385 64bit / msie 8.0
2855 (123, 5, 2505) - IE 8.0.7600.16385 32bit / msie 8.0

Win XP AMD 940 3GHz 2.75GBram:

12130 (748, 35, 7320) - Opera 11 build 1156 / opera 11.00
11860 (662, 72, 7596) - Chrome 8.0.552.224 / safari 534.10
8621 (392, 51, 6780) - Safari 5.0.3 (7533.19.4) / safari 533.19.4
7093 (435, 28, 4209) - Firefox 3.6.12 / mozilla 1.9.2.12
2098 (114, 2, 1537) - IE 8.0.6001.18702 / msie 8.0

iPad 16gb wifi:
2756 (177, 3, 1635) - safari 531.21.10

iPhone 3Gs:
1980 (119, 2, 1290) - safari 528.18