Slashdot Mirror


Crowdsourcing JavaScript Testing

snitch writes "John Resig, creator of the jQuery JavaScript library, has released Test Swarm, a platform for distributed continuous integration testing for client-side JavaScript. Frustrated with traditional JavaScript testing environments that don't scale, John's new project, which is currently in private alpha, aims to provide a system for outsourcing browser-related testing to large groups of people or communities."

12 of 41 comments (clear)

  1. Crowdsourcing by Darkness404 · · Score: 2, Insightful

    Crowdsourcing is a bad buzzword that combines the worst of both betas and open source. Far too often "crowdsourcing" is "we want you to find all our bugs for us while we do nothing". By crowdsourcing something you doom it to a perpetual beta while usually not making it fully OSS so it can be really transformed and used.

    --
    Taxation is legalized theft, no more, no less.
  2. Trendsourcing by MrEricSir · · Score: 4, Interesting

    Def. trendsource
    -verb: to solve problems using popular buzzwords

    ("The developers trendsourced the project by integrating crowdsourcing with Agile methodologies automated with a SOAP communication layer.")

    --
    There's no -1 for "I don't get it."
    1. Re:Trendsourcing by Jurily · · Score: 4, Funny

      ("The developers trendsourced the project by integrating crowdsourcing with Agile methodologies automated with a SOAP communication layer.")

      Translation: they got posted on /. and now they're putting out the fire in the server room.

    2. Re:Trendsourcing by gandhi_2 · · Score: 4, Funny

      The folksomonie's synergistic frision brings a best-in-breed game-changer to the clowns-as-a-service paradigm.

  3. Crowdsource this! by girlintraining · · Score: 2, Funny

    If I have to bear witness to another buzzword in a slashdot article title, I will turn Richard Stallman into a Juicer and ship him in a crate to Slashdot HQ. Because nothing says mega-damage like a character from RIFTS. I swear I will. He's already half-way there. You've seen his code, you know he's already got a caffeine drip. It won't be hard. Plus, I'm kinda bloated and cranky right now, so I might just come with. Don't tempt me.

    --
    #fuckbeta #iamslashdot #dicemustdie
  4. Coincidentally... by pushing-robot · · Score: 3, Interesting

    I happen to be working on "A system for euphemising poor coding practices using the latest buzzwords". It'll be awesome!

    Seriously, who needs a "crowd" at all? There are only a handful of popular browsers. They'd be much better off running tests in-house until they feel their code is rock solid.

    From TFA:

    100 tests in 12 browsers run on every commit by a human is just insane.

    And uploading your code to a public server on every commit and twiddling your thumbs waiting for good samaritans to randomly log in with various browsers and test it for you is...sane?

    --
    How can I believe you when you tell me what I don't want to hear?
    1. Re:Coincidentally... by Dynedain · · Score: 4, Informative

      There may only be a handful of browsers, but that doesn't mean there are only a handful of test cases. When it comes to javascript, there are quite a few variations that can cause problems beyond just the browser name.

      One example that I've been specifically dealing with on MooTools involves bugs relating to font antialiasing on Internet Explorer. The issue presents itself on IE 7 when system font smoothing is enabled, but NOT on IE6 or IE8. Furthermore, in only presents itself if the user utilizes "Cleartype" (recommended for LCDs) but not if they use Standard font smoothing. It took me quite some time to narrow down exactly where the problem was.

      This isn't an issue on Firefox 2,3, Safari 2,3 (although other kinds of font issues may arise with FF on OSX, and with Safari on Windows). Counting the variations of system settings, major OS and browser versions, that makes for 51 test cases, not including point versions of the OS or browsers, beta versions, and limiting it to the big 3 of browsers.

      --
      I'm out of my mind right now, but feel free to leave a message.....
    2. Re:Coincidentally... by Dynedain · · Score: 3, Informative

      Correction, 40 test cases:

      Firefox 2,3 on WinXP,WinVista * 3 system font smoothing settings
      Firefox 2,3 on OSX
      Safari 2,3 on Win2K,WinXP,WinVista,OSX
      IE 6, FF 2,3, on Win2k
      IE 6 on WinXP * 3 system font smoothing settings
      IE 7,8 on WinXP,WinVista * 3 system font smoothing settings

      And of course other issues will have larger sets of test cases. I'm able to narrow it down here because Safari has its own font smoothing that is unaffected by which version of Windows it is running on or what the system font smoothing is set to, and Win2k doesn't have any native font smoothing.

      --
      I'm out of my mind right now, but feel free to leave a message.....
  5. Different JS Versions and DOM/Layout Issues by caffeinejolt · · Score: 2, Informative

    Javascript 1.5 (aka ECMAScript ECMA-262 Edition 3) is what most developers target for good reason. But there are supersets found primarily in Gecko based browsers. But then you throw in the various DOM quirks between browsers and before you know it, programming anything large in Javascript that will be used across a wide variety of browsers can really start to suck due to minor quirks between different implementations. It will be interesting to see how their test cases support/address layout issues, if they do at all.

  6. Re:private alpha == Vaporware by acidrainx · · Score: 3, Interesting

    Knowing John Resig, I doubt this is vaporware. He's come up with some really amazing stuff and is constantly posting interesting JavaScript tidbits and information for developing real production code on his blog.

  7. Lots of Javascript developers call this "release" by Kenja · · Score: 2, Insightful

    Want to get a lot of people to test your Javascript? Call it version one and release it.

    --

    "Have you ever thought about just turning off the TV, sitting down with your kids, and hitting them?"
  8. More importantly. by dex.pdx · · Score: 2, Informative

    Before jumping into some gauntlet of distributed (or aggregated or what ever you want to call it) JavaScript testing. Shouldn't there be a FOSS [cross]platform for unit testing JavaScript under multiple "rendering kits/engines" that can be plugged into Rake, TAP or Nose or any other unit testing harness.
    For most applications things like Selenium are more trouble or cost to much money then they are worth. I would like to see something that would allow me to test my JS code across multiple browsers with a simple "make test" within my build environment. Of course there are things like JSLint and Rhino etc... but they don't really handle the issue of making the tests easy to write and run (which means dev's will actually write the tests) on top of Rhino not really representing an actual or even a mock of a particular browsers DOM. I don't relish the idea of having to build an special application into my test harness and then direct my browser to a URL in order to run my JavaScript unit tests. There are plenty of systems out there that compile test reports across multiple platforms from a standard harness (CPAN Testers for one). The problem is not test reporting - it's having an easy way to write and run the tests.