Slashdot Mirror


Acid3 Test Released

An anonymous reader writes ""The Web Standards Project has announced the release of Acid3, the latest test designed to expose flaws in the implementation of mature Web standards in browsers. 'By making sure their software adheres to the test, the creators of these products can be more confident that their software will display and function with Web pages correctly both now and with Web pages of the future. The Acid3 Test is designed to test specifications for Web 2.0, and exposes potential flaws in implementations of the public ECMAScript 262 and W3C Document Object Model 2 standards.' Screenshots at the Drunken Fist site show the success of Safari 3 (which originally scored 31, but is now Scoring 87/100) IE6, and IE7 (massive fail, of course)'." There are additional discussions of the new test happening around the web.

68 of 309 comments (clear)

  1. Bad day for IE8 by Anonymous Coward · · Score: 5, Funny

    It gets... 17. Heard at Microsoft "ACID3? We just passed ACID2! AH CRAP!"

    1. Re:Bad day for IE8 by Jugalator · · Score: 2, Informative

      At least that beta doesn't crash. When I ran on a recent Opera 9.50 beta build, it counted, stalled, stalled, crashed. ;-)

      --
      Beware: In C++, your friends can see your privates!
    2. Re:Bad day for IE8 by jimbojw · · Score: 5, Funny

      Hey now, at least it passes the reference rendering, which is more than I can say for some browsers (*cough* lynx *cough*)

    3. Re:Bad day for IE8 by 99BottlesOfBeerInMyF · · Score: 2, Informative

      At least that beta doesn't crash. When I ran on a recent Opera 9.50 beta build, it counted, stalled, stalled, crashed. ;-)

      What OS? Opera 9.5 beta works fine for me on OS X and gets 59/100. The only things that crashed for me were Shiira on OS X and Konquerer 3.5.2 on Kubuntu.

      Note, the best score I'm getting is from Safari 3.0.4 with a nightly Webkit on OS X, with a score of 86/100.

    4. Re:Bad day for IE8 by hmallett · · Score: 3, Funny

      Lynx spoils you. I prefer wget.

    5. Re:Bad day for IE8 by cbiltcliffe · · Score: 2, Funny

      Real die hards telnet directly to the server and pass the HTTP commands themselves.
      Telnet? Man, you kids have it easy. We used to compose individual network packets manually by coding assembly on the fly......
      --
      "City hall" in German is "Rathaus" Kinda explains a few things......
  2. Firefox by BlowHole666 · · Score: 2, Insightful

    success of Safari 3 (which originally scored 31, but is now Scoring 87/100) IE6, and IE7 (massive fail, of course)'." Umm what did Firefox get on this? What about Opera? If you are going to report something why not report all the facts. You listed three browsers where are the other two+ ?
    --
    I smoked pot once. But I DID NOT inhale. Will you hire me?
    1. Re:Firefox by brunascle · · Score: 5, Informative

      the test is here.

      i'm getting a 50/100 in Firefox.

    2. Re:Firefox by Jugalator · · Score: 2, Informative

      Ooh, my Opera 9.50 weekly actually didn't crash this time. Maybe the test was changed, or something in Opera did.

      Anyway, Opera 9.50.9807 receives a 65.

      --
      Beware: In C++, your friends can see your privates!
    3. Re:Firefox by caerwyn · · Score: 4, Interesting

      Interestingly, I'm not getting an 87 with Safari 3.0.4- I'm getting a 39.

      --
      The ringing of the division bell has begun... -PF
    4. Re:Firefox by Cap'n.Brownbeard · · Score: 2, Informative

      Same score for me using FF 2.0.0.12 on WinXP.

    5. Re:Firefox by CrazedWalrus · · Score: 2, Insightful

      I was wondering the same thing. Isn't it FF3 that just began rendering ACID2 correctly?

      Besides, I see these as a process or goal -- giving the browser makers something concrete and visual to shoot for, as well as an easy way for users to judge the quality of their browser of choice. If the thing was just released, I'm not really surprised that many of the browsers don't pass it completely. Now a year or two from now is a different story, after the browser makers have had some time to address the issues the test points out.

    6. Re:Firefox by bunratty · · Score: 5, Informative

      The test consists largely of 100 JavaScript tests designed to throw an assertion on failure and return a certain value on pass. The score is how many of the tests out of 100 pass. You can see which tests failed by clicking or shift-clicking the A in Acid3 after the test completes. In the sense that each test can relatively independently pass or fail (although some tests depend on previous tests), yes, it is a quantitative test.

      The other part of the test is rendering the Acid3 text with shadow and the colored rectangles. By seeing how the Acid3 test fails in many other browsers, you can see that it can also render X, Fail, and a picture of a cat on failure of some rendering tests, typically in red so they stand out.

      --
      What a fool believes, he sees, no wise man has the power to reason away.
    7. Re:Firefox by Random+BedHead+Ed · · Score: 5, Funny

      Hey, me too. Are you also using Netscape Navigator 4.01?

    8. Re:Firefox by dal20402 · · Score: 5, Informative

      It's misleading for the summary to say "Safari" gets 87/100 when the version of Safari that does that is not yet released.

      Run current WebKit nightlies to get the high score now. The changes will be in the upcoming Safari 3.1 release.

    9. Re:Firefox by caerwyn · · Score: 2, Informative

      Good point. Running now gets me a 90 with the webkit nightly, and examining the earlier failure shows at least one test (69) which explicitly states may be a networking issue- something that seems highly likely given how overloaded the acid3 server was earlier in the day.

      --
      The ringing of the division bell has begun... -PF
    10. Re:Firefox by John+Whitley · · Score: 2, Interesting

      With Firefox 3.0 beta 3, I upped that to 59/100 by turning off AdBlock Plus on the test page.

    11. Re:Firefox by zerocool^ · · Score: 2, Interesting


      Besides, I see these as a process or goal -- giving the browser makers something concrete and visual to shoot for, as well as an easy way for users to judge the quality of their browser of choice.

      Bullshit. The Acid tests have become the SAT's of the browser world. People *think* it's a measure of how standards compliant your browser is, but all it *really* is, is a measure of how well your browser does on the acid test.

      That's it, nothing more, nothing less. The acid test is incredibly nit-picky and it's possible to even argue some of the decisions the guy has made about how things should be rendered (i.e. questioning his interpretation of the standard). And it's important that if your browser fails the acid test, but looks fine when you surf fark/slashdot/cnn/myspace, then whothefuck cares? The browser exists to deliver content to you; not to make some jackass feel happy that his CSS and Ajax code is the hardest thing to render in the known fucking universe.

      I really, really wish people would get over the Acid tests; perhaps in favor of "the CNN test", or the "does it work with my proprietary intranet badly-coded webapps?" test. If it passes these, then just roll with it.

      ~Wx

      --
      sig?
  3. Firefox 2.0.0.12 by poetmatt · · Score: 2, Informative

    I get a 51/100 with firefox 2....wonder how 3 will do.

    1. Re:Firefox 2.0.0.12 by The+MAZZTer · · Score: 4, Informative

      3b3 gets a 61. Opera 9.5 is the best I tested at 65. Safarai 3.0.4 for Windows got a 39. IE7 got a 12 and also managed to mangle the page the most.

    2. Re:Firefox 2.0.0.12 by thornomad · · Score: 5, Funny

      Woo hoo! IE 6.0 displays this just fine: http://acid3.acidtests.org/reference.html Read 'em and weep Firefox!

    3. Re:Firefox 2.0.0.12 by Jugalator · · Score: 3, Interesting

      Opera 9.5 is the best I tested at 65. It better be good, since Håkon Wium Lie, Chief Technical Officer of Opera Software, worked together with Bert Bos to develop the CSS standard.

      I'm not sure how many actually knows this. *shrug*
      --
      Beware: In C++, your friends can see your privates!
    4. Re:Firefox 2.0.0.12 by kamikaez · · Score: 2, Insightful

      This is a javascript / DOM test, not CSS.
      It was developed by Netscape, so I guess they will do best.. Oh well..

      --
      This is a signature..
    5. Re:Firefox 2.0.0.12 by 99BottlesOfBeerInMyF · · Score: 2, Interesting

      3b3 gets a 61. Opera 9.5 is the best I tested at 65. Safarai 3.0.4 for Windows got a 39. IE7 got a 12 and also managed to mangle the page the most.

      Your numbers are quite different than mine. I scripted all the browsers/OS's I had handy from the sunspider javascript test last week and ran them on Acid3. The results are here.

      Where do you get a nightly of Opera? I ran the beta version they have up tonight and got 59/100 on OS X and it crashed on Linux and Windows XP. In any case, the best number I got was Safari 3.0.4 with a week old nightly of Webkit on OS X, which got 86/100. The Firefox 3 beta also did well getting 67/100 on OS X and Linux (but only 59 on Windows for some reason). Other people have gotten slightly better numbers for both using a more recent nightly of Firefox or Webkit.

  4. Link to the actual test by I+kan+Spl · · Score: 4, Informative

    Why does slashdot keep linking to dead blogs?

    The actual test is http://acid3.acidtests.org/ here.

    --
    My UID is prime and so is this number: 09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0.
  5. Re:Of Course IE will fail, ACID test is biased... by setagllib · · Score: 5, Insightful

    Yes, biased towards conforming with open international published standards, rather than to any specific vendor's implementation. It just happens the best of the best web browsers try to conform to the same standards, scoring much higher than Microsoft's offering which is deliberately designed to break from the standard to ensure lockin.

    --
    Sam ty sig.
  6. I'd read TFA but... by Fozzyuw · · Score: 4, Funny

    My browser won't render the page properly.

    --
    "The past was erased, the erasure was forgotten, the lie became truth." ~1984 George Orwell
  7. Latest Safari nightly scores... by The+Ancients · · Score: 5, Informative

    90/100.

    Getting pretty close.

  8. Re:Opera by wile_e_wonka · · Score: 4, Informative

    I just tried it on Opera 9.5 Beta, build 9755. I got a 60/100. Then I tried again and got a 61/100. Then a 60/100 on a third try.

    All of the rectangles are grey (two different shades), the test name is red and does not have a shadow, and there is an x in the upper right hand corner.

  9. Re:Of Course IE will fail, ACID test is biased... by moderatorrater · · Score: 5, Insightful

    Not quite. When none of the browsers are getting 100/100 and the only browser to get over a 60 is a safari beta, I think it's safe to say that it's a test designed so that every browser will fail. That's the point: they're giving solid targets to browser developers and giving a concise score to everyone else so that they know where the browsers stand in the next generation of web tech.

    So, I guess what I'm saying is that complaining about it being designed so that IE would fail is like saying that American Gladiators was designed so that my 8 year old brother would fail. Sure, it has that effect in the end, but the fact that he's under-equipped for such a competition isn't American Gladiators' fault.

  10. Failure by mrbah · · Score: 2, Insightful

    The Acid tests would be a lot more productive if they were oriented more towards the practical non-compliance issues than obscure ones. A back-asswards JavaScript implementation or a horrible box model is more of an issue than the inability to display base64 images encoded directly into the page markup. Total compliance is great, but it's much more pragmatic to get the fundamental issues fixed first.

  11. Re:Geek version of a measuring contest? by gerbalblaste · · Score: 4, Insightful

    No this is a measurement of compliance to international standards.

  12. Konqueror by kevmatic · · Score: 5, Informative

    I haven't seen anybody answer konqueror yet!

    I tried it in Konqi 3.5.8 with Gentoo. It asked me what I wanted to do with "empty.txt" then segfaulted. Anyone fairing better?

    1. Re:Konqueror by Anonymous Coward · · Score: 5, Informative

      That crash is fixed in 3.5.9 (which does 41)... 4.0.2 does 61, 4.1-pre 63. Early 4.0.x versions do less.

  13. Re:Of Course IE will fail, ACID test is biased... by Ambiguous+Coward · · Score: 4, Funny

    Comment on your analogy:

    I think the mere fact that American Gladiators is considered tv-worthy indicates that we, as a nation, have failed. Also, sorry about your brother. That was really brutal when they knocked him into the pool.

    Just sayin'.

    -G

    --
    Their may be a grammatical error, misspeling, or evn a typo in this post.
  14. Slashdoted by fluch · · Score: 5, Funny

    Conclusion: ACID3 test didn't pass Slashdot test. Too bad.

    1. Re:Slashdoted by The+Ancients · · Score: 4, Funny

      It's ok here. I've even scripted 700 machines here to reload the page repeatedly just to ensure it isn't.

  15. Re:Firefox 3 beta 3 by corychristison · · Score: 2, Informative

    ... and 64/100 for Firefox 3.0b5pre ("Minefield")

  16. Results in major browsers by Lobais · · Score: 4, Informative

    See http://browsershots.org/http://acid3.acidtests.org/ for the test in 75 different browsers.
    Wikipedia: http://en.wikipedia.org/wiki/Acid3 also lists the results for the developversions of browsers:
    Webkit: 87
    Firefox: 67

  17. Firefox by zulater · · Score: 4, Funny

    I got a 100/100 on the reference image.

  18. Re:Of Course IE will fail, ACID test is biased... by moderatorrater · · Score: 2, Funny

    no browser can make it to 100 even if somebody had everything working With an attitude like that I don't expect any browser to ever make it ;)
  19. Re:Of Course IE will fail, ACID test is biased... by gsnedders · · Score: 2, Informative

    Actually, trying to make IE fail it wasn't an aim: the aim was to include tests that one of Firefox, Safari, and Opera fails. If IE happens to fail them too, so be it.

  20. Thunderbird ;] by Przemo-c · · Score: 4, Funny

    Thunderbird 2.0.0.12 with thunderbrowse scores 52/100 ;]

  21. 100% score on IE8 by spacemky · · Score: 4, Funny

    I got a 100% score rendering Acid3 on IE8! All I had to do was add the following line to the top of the page!

    <meta http-equiv="X-UA-Compatible" content="IE=8" />

    Once that meta tag is there, all web pages look just as they're supposed to! I'm so glad Microsoft finally fixed this whole compatibility fiasco.

    --
    640YB ought to be enough for anybody.
  22. Web 2.0? by Tatsh · · Score: 3, Insightful

    Someone again try to explain to me the definition of web 2.0, and don't tell me flash.

    I personally think it's the move of the entire web (the content that matters) to valid XHTML, CSS, etc (of course everything is controlled dynamically by PHP/Perl/whatever you want). I also hope there can be an open standard soon to do the same functionality that Youtube's Flash container that runs on everything and that everyone agrees upon. Silverlight is obviously closed and so is Flash. We need an open source mid-quality (and high-quality) video player that loads quickly and is OS-independent, just like Flash. I think that is all that is missing in this 'Web 2.0'.

  23. Not to mention... by rsborg · · Score: 2, Informative
    The latest webkit (Safari) nightly is just amazingly fast.

    Faster than FF3 beta 4, much much faster than FF2 or IE7.

    --
    Make sure everyone's vote counts: Verified Voting
  24. Re:Of Course IE will fail, ACID test is biased... by Goaway · · Score: 2, Insightful

    Actually, it's tests that one, or preferably more than one, of Firefox, Safari, Opera or IE fail.

  25. Re:Firefox 3 beta 3 by BZ · · Score: 3, Informative

    Why? The test expressly picked things that one of Opera, Safari, and Firefox would fail, preferably more than one, and tried to balance the number of tests each would fail.

    Put another way it looked really hard for things to test that would give browsers low scores.

    There's nothing to say that the things it tests are necessarily useful. Some are, some are not.

  26. Re:Perhaps.... by bunratty · · Score: 5, Insightful

    Yes, there is almost no correlation between how well a browser does on Acid tests and how well it renders pages on the web. The purpose of the Acid tests is to break the chicken-and-egg problem of web development. The web developers tend not to use features unless all popular browsers support them. On the other hand, the developers of the web browsers tend not to add features that are not used by web developers. Without anyone willing to go first, the implementation and use of new web standards stalls.

    The purpose of the Acid tests is to break this logjam by using these new standards in a very public way so that web developers will be motivated to implement them. The "my browser does better than your browser" posturing is a bit immature, but as a side effect it popularizes the faults of browsers and motivates the browser developers to fix them. Then, the web developers use the new features after they are well supported.

    --
    What a fool believes, he sees, no wise man has the power to reason away.
  27. Re:Perhaps.... by ivan256 · · Score: 2, Informative

    The ideal here actually is that if a reasonable number of mainstream browsers scored 100 on the test, web developers could use all of the features the test exercises and have a reasonable expectation that their page will display correctly for end users.

    The test is about making life better for web developers, and about making the web more interoperable, instead of having sites which jump through browser predicated hoops, or restrict users to "IE7.0 or newer on 32-bit Windows" or the like. Thus having your favorite browser, and your least favorite browser score well is in the best interests of all web users.

  28. Re:Too late for IE8? by edwdig · · Score: 4, Informative

    If they actually implemented the standards well, they wouldn't have to worry about specific tests, they would just do well on them by default.

    Have you ever tried reading the HTML/CSS specs? They're huge and often vaguely worded. There were often sections that just weren't intuitive, and the only real approach to implementing them was to just figure out what other browser did and copy it. The specs were created by people who have no intention of implementing them themselves, and it really shows.

  29. Re:Unfair browser bashing? by bunratty · · Score: 3, Insightful

    You're exactly correct that the Acid tests test specific browser flaws. They are testing exactly the flaws that plague web developers. That way, when all popular browsers pass the Acid tests, web developers don't need to work around the flaws in each different browser. We all benefit by getting web sites with fancy new features that work in all browsers. The scores are not meaningful, but are a way to motivate the developers of web browsers to fix their flaws so they're not embarrassed by a low or non-passing score.

    --
    What a fool believes, he sees, no wise man has the power to reason away.
  30. Re:IE8 Cheats ACID2!! by Anonymous Coward · · Score: 2, Informative

    This was already explained, and the behavior should have been updated as per a previous slashdot story.

    IE8 fails when it runs in quirks mode, and passes when in standards mode. Before it would run in quirks by default, and only change behavior when it visited certain key sites, or sites had a tag.

    That url would be one of those "key sites"

    However if the previous slashdot story is true, IE8 should eventually operate in standards mode by default, so it will pass both.

  31. How do the acid-test creators test the acid test? by dskoll · · Score: 4, Interesting

    Seriously... if no browser gets 100/100, how do the test creators generate the reference image? And how do they know there are no bugs in their test? I'm genuinely curious...

  32. What would be really useful.... by CodeShark · · Score: 2, Insightful

    Is if there was a way to not only get a copy of the acid test fails, but a quick list of which browsers fail which test and what that should mean. So that us legions of OS coders or even Mozilla, Opera, or Safari's own guys could get busy and fix it in their next releases.

    Anyone have this or know some web location where it's happening?

    --
    ...Open Source isn't the only answer -- but it's almost always a better value than the alternatives...
  33. Re:Web 2.0? - My definition by Tatsh · · Score: 2, Insightful

    "Web 2.0 is a bullshit buzzword made up to describe everything new that is happening on the web. It is mostly meaningless marketing speak. Treat it as such."

    I agree, and thought this ever since I heard the term, so I hereby propose abolishment of the term.

  34. Re:I would check out the screen captures, but... by emilper · · Score: 5, Funny

    yes, looks like the acid tests are failing the slashdot test.

  35. Re:IE8 Cheats ACID2!! by ejtttje · · Score: 2, Informative

    Both work for me with Safari 3...

  36. Re:How do the acid-test creators test the acid tes by kryten_nl · · Score: 4, Funny

    Magic

    --
    For the perfect anti-Unix, write an OS that thinks it knows what you're doing better than you do and let it be wrong.
  37. Just found it for Firefox 3.0 Beta (3) by CodeShark · · Score: 2, Interesting
    Passes 59 tests in Xp. Interesting Stats:
    • 37 of the tests that fail in FF 2.X are also fails in FF 3.0 beta.
    • Three of the fails are significantly different, not sure if this means progress or not
    • 1 fail is a minor difference
    • Firefox 2 passed a test (#69) that FF 3 did not
    • and finally, FF 3.0 passes 8 tests directly that FF 2.0 does not.

      • That said, I looked at a couple of the notes on Bugzilla for Firefox and they are already looking at the bug list... wonder who will be the fastest to fix the most....

    --
    ...Open Source isn't the only answer -- but it's almost always a better value than the alternatives...
  38. Re:Of Course IE will fail, ACID test is biased... by djcapelis · · Score: 2, Informative

    I believe the standard for the last 16 tests were webkit and firefox trunk must fail.

    So IE or Opera failing was actually regarded as insufficient.

    --
    I touch computers in naughty places
  39. Re:How do the acid-test creators test the acid tes by djcapelis · · Score: 2, Funny

    The reference implementation is Ian Hickson's brain.

    --
    I touch computers in naughty places
  40. Re:How do the acid-test creators test the acid tes by Anonymous Coward · · Score: 2, Funny

    The FBI have their own browser, specially developed in house in collaboration with Bill Gates, Steve Jobs, Jimmy Wales, Linus Torvalds, RMS, Kevin Mitnick and Hugh Jackman (not many people realise this, but 'Swordfish' was actually a documentary on his life).

    This browser is the absolute mutt's nuts of browsers. Not only does it render every web standards test 100%, it has done so since version 0.05b (now up to 3.1). By that I mean that version 0.05b will render Acid3 100/100 out of the box (and, I can assure you, Acid4 when it is released).

    Anyway, the FBI don't release it to the general public as it would make the web-browsing experience too enjoyable and, when people stopped doing their business due to too much time spent online, then society as we know it would crumble (the US sub-prime disaster and Enron were directly linked to a copy which was smuggled out of the FBI and used by senior partners in influential financial firms). They do produce a *png for Acid3 though and email it back for the reference image.

    So now you know.

  41. W3C validator by atomic-penguin · · Score: 3, Interesting
    If these acid tests are based on standards. Why is the only acid test that passes the W3C validator, the Acid 1 test?

    1. Acid 1
    2. Acid 2
    3. Acid 3


    Perhaps, I am missing the point of these acid tests. I'm not a web developer by trade, so I don't claim to be an expert on CSS. From personal experience, CSS has allowed me to use much less complex HTML in the little web publishing I have done. I never seem to get consistent results when I test my pages in different browsers. I hope that these "standards" Acid tests lead to greater compatibility across browsers.

    Do these tests increase compatibility by pushing the envelope on new standards, or are they just a browser-war pissing contest?
    --
    /^([Ss]ame [Bb]at (time, |channel.)){2}$/
    1. Re:W3C validator by Millennium · · Score: 4, Informative

      If these acid tests are based on standards. Why is the only acid test that passes the W3C validator, the Acid 1 test?

      Because more recent Web standards include sections on how certain kinds of errors are supposed to be handled. These need to be tested just like everything else, but up until Acid2 many browsers weren't very good about that.

      Remember, the point of Acid tests is to be a thorn in browser developers' sides: find areas of the standard that no one currently does well and test for them. Browsers shouldn't pass Acid tests when the tests first come out: that would be missing the point of the tests in the first place.

  42. Re:How do the acid-test creators test the acid tes by CaptainPinko · · Score: 4, Insightful

    They don't. They read through their spec carefully and presumably do it by hand. I believe with the first ACID test their was a bug with the reference image that was reported by someone implementing a browser.

    --
    Your CPU is not doing anything else, at least do something.
  43. Re:IE8 Cheats ACID2!! by Bodero · · Score: 4, Informative

    Why Isn't IE8 Passing ACID2?

    Basically, it fails because of XSS on the other sites.

  44. Re:Browser rundown by bunratty · · Score: 2, Insightful

    When was Opera ever standards king? Before Opera 7 I couldn't use Opera because it couldn't reflow web pages correctly to handle DHTML. The Mozilla and IE of the day could handle reflow just fine. I couldn't use Opera 8 because it didn't support XSLT, and one website that I frequented used XSLT. The IE and Firefox of the day could handle XSLT just fine. Opera's got good standards support, generally about as good as Firefox or Safari, but it seems like it's often playing catch-up in at least one area. But standards king? I think not.

    --
    What a fool believes, he sees, no wise man has the power to reason away.