Slashdot Mirror


Crowdsourcing JavaScript Testing

snitch writes "John Resig, creator of the jQuery JavaScript library, has released Test Swarm, a platform for distributed continuous integration testing for client-side JavaScript. Frustrated with traditional JavaScript testing environments that don't scale, John's new project, which is currently in private alpha, aims to provide a system for outsourcing browser-related testing to large groups of people or communities."

41 comments

  1. Crowdsourcing by Darkness404 · · Score: 2, Insightful

    Crowdsourcing is a bad buzzword that combines the worst of both betas and open source. Far too often "crowdsourcing" is "we want you to find all our bugs for us while we do nothing". By crowdsourcing something you doom it to a perpetual beta while usually not making it fully OSS so it can be really transformed and used.

    --
    Taxation is legalized theft, no more, no less.
    1. Re:Crowdsourcing by moderatorrater · · Score: 1

      Resig never uses that term himself, TFA added it by himself, possibly to make it buzzword compliant.

      In this instance, the tool itself is open source and it's being used to unit test an open source JS library. jQuery itself is quite a good library that's very actively developed with an active community.

  2. Trendsourcing by MrEricSir · · Score: 4, Interesting

    Def. trendsource
    -verb: to solve problems using popular buzzwords

    ("The developers trendsourced the project by integrating crowdsourcing with Agile methodologies automated with a SOAP communication layer.")

    --
    There's no -1 for "I don't get it."
    1. Re:Trendsourcing by Anonymous Coward · · Score: 1, Insightful

      Put it in the cloud and we will have a new paradigm.

    2. Re:Trendsourcing by Jurily · · Score: 4, Funny

      ("The developers trendsourced the project by integrating crowdsourcing with Agile methodologies automated with a SOAP communication layer.")

      Translation: they got posted on /. and now they're putting out the fire in the server room.

    3. Re:Trendsourcing by Aminion · · Score: 1

      ("The developers trendsourced the project by integrating crowdsourcing with Agile methodologies automated with a SOAP communication layer.") Sounds very interesting! But can't we get XML-RPC?! SOAP is such a bloated piece of crap.

    4. Re:Trendsourcing by MrNonchalant · · Score: 1

      It's only buzz if you use it that way.

      I can develop an app to crowdsource movie recommendations using Agile methodologies and heavy automation with SOAP communication between layers.

      If I wrote a few paragraphs concerning this project these words would have far more meaning within the context of the description. This is a valid use of the word "crowdsourcing," because it's within the context of a real project and it communicates a real concept.

    5. Re:Trendsourcing by gandhi_2 · · Score: 4, Funny

      The folksomonie's synergistic frision brings a best-in-breed game-changer to the clowns-as-a-service paradigm.

    6. Re:Trendsourcing by daveime · · Score: 1

      SOAP is even more of a bloated piece of crap than XML.

      There, fixed that for you.

    7. Re:Trendsourcing by badkarmadayaccount · · Score: 1

      You got anything better, buster?

      --
      I know tobacco is bad for you, so I smoke weed with crack.
  3. 1200 tests doesn't scale? by Chris_Jefferson · · Score: 1

    While this sounds like a cool idea, I think the problem is being exaggerated slightly. The suggestion is that doing 1200 tests per commit doesn't scale is simply not true. In general necessary to run the tests for every commit, if commit N passes, and commit N+5 passes, it really doesn't seem necessary to check the ones inbetween. We run a lot more than 1200 tests on 3 operating systems and one dual-core computer with VMs is more than enough to keep up.

    --
    Combination - fun iPhone puzzling
    1. Re:1200 tests doesn't scale? by Sybert42 · · Score: 1

      Yeah, but when N+100 fails, and they are all related, oops. Just don't wait to put in the tough stuff until the end of the project, I suppose! How do you do a binary search with 1200 tests?

    2. Re:1200 tests doesn't scale? by Anonymous Coward · · Score: 0

      +1

    3. Re:1200 tests doesn't scale? by AuMatar · · Score: 1

      You don't binary search the tests, you binary search the releases. If you run the tests every 10 checkins, you then do a binary search finding which checkin broke it. It's definitely possible to do. Although I think in practice it wouldn't work- too much stuff gets broken in interim checkins in any decent sized project, much of it so minor you don't really care or thats not worth fixing right now.

      --
      I still have more fans than freaks. WTF is wrong with you people?
  4. Crowdsource this! by girlintraining · · Score: 2, Funny

    If I have to bear witness to another buzzword in a slashdot article title, I will turn Richard Stallman into a Juicer and ship him in a crate to Slashdot HQ. Because nothing says mega-damage like a character from RIFTS. I swear I will. He's already half-way there. You've seen his code, you know he's already got a caffeine drip. It won't be hard. Plus, I'm kinda bloated and cranky right now, so I might just come with. Don't tempt me.

    --
    #fuckbeta #iamslashdot #dicemustdie
    1. Re:Crowdsource this! by syousef · · Score: 0, Flamebait

      If I have to bear witness to another buzzword in a slashdot article title, I will turn Richard Stallman into a Juicer and ship him in a crate to Slashdot HQ. Because nothing says mega-damage like a character from RIFTS. I swear I will. He's already half-way there. You've seen his code, you know he's already got a caffeine drip. It won't be hard. Plus, I'm kinda bloated and cranky right now, so I might just come with. Don't tempt me

      PMS fueled tantrum about slashdot buzzword usage, threatening to use RMS as a weapon. Can I just say I'm in awe. It sounds like some plot out of a twisted remake of Wizard of Oz.

      --
      These posts express my own personal views, not those of my employer
  5. Coincidentally... by pushing-robot · · Score: 3, Interesting

    I happen to be working on "A system for euphemising poor coding practices using the latest buzzwords". It'll be awesome!

    Seriously, who needs a "crowd" at all? There are only a handful of popular browsers. They'd be much better off running tests in-house until they feel their code is rock solid.

    From TFA:

    100 tests in 12 browsers run on every commit by a human is just insane.

    And uploading your code to a public server on every commit and twiddling your thumbs waiting for good samaritans to randomly log in with various browsers and test it for you is...sane?

    --
    How can I believe you when you tell me what I don't want to hear?
    1. Re:Coincidentally... by Dynedain · · Score: 4, Informative

      There may only be a handful of browsers, but that doesn't mean there are only a handful of test cases. When it comes to javascript, there are quite a few variations that can cause problems beyond just the browser name.

      One example that I've been specifically dealing with on MooTools involves bugs relating to font antialiasing on Internet Explorer. The issue presents itself on IE 7 when system font smoothing is enabled, but NOT on IE6 or IE8. Furthermore, in only presents itself if the user utilizes "Cleartype" (recommended for LCDs) but not if they use Standard font smoothing. It took me quite some time to narrow down exactly where the problem was.

      This isn't an issue on Firefox 2,3, Safari 2,3 (although other kinds of font issues may arise with FF on OSX, and with Safari on Windows). Counting the variations of system settings, major OS and browser versions, that makes for 51 test cases, not including point versions of the OS or browsers, beta versions, and limiting it to the big 3 of browsers.

      --
      I'm out of my mind right now, but feel free to leave a message.....
    2. Re:Coincidentally... by Dynedain · · Score: 3, Informative

      Correction, 40 test cases:

      Firefox 2,3 on WinXP,WinVista * 3 system font smoothing settings
      Firefox 2,3 on OSX
      Safari 2,3 on Win2K,WinXP,WinVista,OSX
      IE 6, FF 2,3, on Win2k
      IE 6 on WinXP * 3 system font smoothing settings
      IE 7,8 on WinXP,WinVista * 3 system font smoothing settings

      And of course other issues will have larger sets of test cases. I'm able to narrow it down here because Safari has its own font smoothing that is unaffected by which version of Windows it is running on or what the system font smoothing is set to, and Win2k doesn't have any native font smoothing.

      --
      I'm out of my mind right now, but feel free to leave a message.....
    3. Re:Coincidentally... by Anonymous Coward · · Score: 0

      But, wouldn't it be better to just have test cases posted on an issue tracker?

      Especially for something like font antialiasing (which you would have to see visually), this "crowd sourcing" seems to be redundant and difficult to automate.

      Rather than trying to "crowdsource" tests, wouldn't it be far more useful to make reporting problems easier? Such as something like those error pop-ups that ask you to "send an error report" or a dev version of the library with asserts.

      What would be the reason to have this "crowdsourcing" instead of the usual "in-house" unit tests, followed by the release of an alpha/beta to be tested by the public, who then submit tickets to be fixed before final release?

    4. Re:Coincidentally... by jonaskoelker · · Score: 1

      I happen to be working on "A system for euphemising poor coding practices using the latest buzzwords".

      Please get a business method patent on it and enforce it vigorously and aggressively!

    5. Re:Coincidentally... by Anonymous Coward · · Score: 0

      FYI: IE7 has an issue with cleartype and filters.

      If you are using a filter/DXImageTransform (e.g. alpha or alphaimageloader) on a div, then IE7 disables the cleartype for that element and its children.

  6. Different JS Versions and DOM/Layout Issues by caffeinejolt · · Score: 2, Informative

    Javascript 1.5 (aka ECMAScript ECMA-262 Edition 3) is what most developers target for good reason. But there are supersets found primarily in Gecko based browsers. But then you throw in the various DOM quirks between browsers and before you know it, programming anything large in Javascript that will be used across a wide variety of browsers can really start to suck due to minor quirks between different implementations. It will be interesting to see how their test cases support/address layout issues, if they do at all.

  7. Sh*tsourcing or Crowdsh*ting by Bubba · · Score: 1, Insightful

    Eitherway, it's a better buzzword than crowdsourcing.

  8. Already exists... by syousef · · Score: 1

    It's called Google Beta.

    --
    These posts express my own personal views, not those of my employer
  9. Proofread it if you expect me to read it! by tqk · · Score: 1

    Damnit!

    "... which is currently is private ..."

    "... to provide a systems for ..."

    Is this how little you care about those you're writing for, that you can't even be bothered to read it yourself?!? Do you write code like this? How do you manage to get it past a compiler?

    This is *so* lazy, and *so* simple to eliminate. Don't post if you can't be bothered to proofread, and no, a Spellchecker is not an adequate substitute.

    You're publishing your thoughts to the world. Think!

    I see we have a "typo" tag; may I suggest a "!fsck'in proofread" tag, please?

    Rasafrackinjiggafriggindoublemarshmellowstriplefudgecake.

    --
    "Tongue tied and twisted, just an Earth bound misfit ..." -- Pink Floyd.
  10. private alpha == Vaporware by sethstorm · · Score: 0, Redundant

    private alpha

    In other words, this is just a puff piece for something that may not even exist.

    --
    Twitter supports and protects racists - by smearing their critics with the "Hate Speech" label.
    1. Re:private alpha == Vaporware by acidrainx · · Score: 3, Interesting

      Knowing John Resig, I doubt this is vaporware. He's come up with some really amazing stuff and is constantly posting interesting JavaScript tidbits and information for developing real production code on his blog.

  11. Lots of Javascript developers call this "release" by Kenja · · Score: 2, Insightful

    Want to get a lot of people to test your Javascript? Call it version one and release it.

    --

    "Have you ever thought about just turning off the TV, sitting down with your kids, and hitting them?"
  12. SOAP? Do Not Want! by Anonymous Coward · · Score: 1, Funny

    >> ("The developers trendsourced the project by integrating crowdsourcing with Agile methodologies automated with a SOAP communication layer.")

    > Translation: they got posted on /. and now they're putting out the fire in the server room.

    Not true! Real Slashdotters avoid SOAP like the plague!

  13. Re:Lots of Javascript developers call this "releas by syousef · · Score: 1

    Want to get a lot of people to test your Javascript? Call it version one and release it.

    Sergey Brin, is that you??? No wait you said version one not version one beta. Never mind.

    --
    These posts express my own personal views, not those of my employer
  14. useful by Anonymous Coward · · Score: 0

    for the Cornify project

  15. More importantly. by dex.pdx · · Score: 2, Informative

    Before jumping into some gauntlet of distributed (or aggregated or what ever you want to call it) JavaScript testing. Shouldn't there be a FOSS [cross]platform for unit testing JavaScript under multiple "rendering kits/engines" that can be plugged into Rake, TAP or Nose or any other unit testing harness.
    For most applications things like Selenium are more trouble or cost to much money then they are worth. I would like to see something that would allow me to test my JS code across multiple browsers with a simple "make test" within my build environment. Of course there are things like JSLint and Rhino etc... but they don't really handle the issue of making the tests easy to write and run (which means dev's will actually write the tests) on top of Rhino not really representing an actual or even a mock of a particular browsers DOM. I don't relish the idea of having to build an special application into my test harness and then direct my browser to a URL in order to run my JavaScript unit tests. There are plenty of systems out there that compile test reports across multiple platforms from a standard harness (CPAN Testers for one). The problem is not test reporting - it's having an easy way to write and run the tests.

    1. Re:More importantly. by dex.pdx · · Score: 1

      sorry for the poor formatting - I hit submit instead of "continue editing" :)

  16. Re:Obama Policies Will Bankrupt USA Tsarkon Report by gandhi_2 · · Score: 0, Offtopic

    the trolls are hungry too...

    twist the pie charts by leaving welfare, workfare, interest on debt, social security, Medicare and Medicaid out

    Fine, except the 2009 chart you supplied didn't leave those things out.

    2009 Pie chart, detailed, Federal Budget, USA

  17. no need for this if using jQuery by Anonymous Coward · · Score: 0

    The beauty of using jQuery is that you don't have to test! If your selector doesn't find any elements, the subsequent code is just ignored:

    $('div#results').append('Success!').fadeIn()

    If the results div doesn't exist, don't worry - all that other stuff is just ignored without throwing an error - so nothing to test!

    Perfect for most of today's web "engineers".

    (note: I kid because I love...)

    1. Re:no need for this if using jQuery by daveime · · Score: 0

      So let me get this right ...

      If the div named results exists, then fade in a "success" message.

      And if it doesn't exist, let the poor dumb user sit there for 30 years, wondering if the AJAX query (which runs in the background and gives NO visible indication it's doing anything), has submitted, completed, failed or just "ceased-to-be and become an EX-query" ?

      This is why the web is such a mess, script kiddys like this who don't even think about usability.

  18. Re:Lots of Javascript developers call this "releas by SolitaryMan · · Score: 1

    Which means he is Bill Gates!

    --
    May Peace Prevail On Earth
  19. Shape up mods! Re:Crowdsource this! by Anonymous Coward · · Score: 0

    Come on mods that's funny! Isn't the blockbuster movie already playing in your mind?

    "WOF/OSS is not Wizards of F/OSS" aka WOF/OSS will be directed by that XKCD guy and rated R for eveRything.