Slashdot Mirror


Over 40% of New Mechanical Turk Jobs Involve Spam

An anonymous reader writes "An NYU study reveals that over 40% of the jobs posted by new employers on MTurk are some sort of spam request, such as fake account creation, fraudulent ad clicks, or fake comments, tweets, likes and votes. The study also shows that the bad jobs could be automatically filtered with 95% accuracy, but Amazon is not interested."

6 of 56 comments (clear)

  1. Hmmm by sexconker · · Score: 4, Interesting

    So when 40% of their MT service usage is contrary to the ToS, everything's fine and dandy.

    But when Wikileaks is in full compliance with the ToS of their EC2 service, they get the boot?

  2. And that was before Google Places appeared in Web by Animats · · Score: 4, Interesting

    That data is from two months back, before Google Places appeared in web search. Now, it's worse. There's a whole mini-industry in the "black hat" search engine "optimization" community creating phony Google Places entries. Here's an ad on Mechanical Turk today:

    Reno Gym - Google Maps Promotion (Client QMDHKOB)
    Requester: Smartsheet.com Clients
    HIT Expiration Date: Dec 18, 2010 (10 hours 52 minutes) Time Allotted: 60 minutes
    Reward: $0.25 HITs Available: 2
    Description:

    • Follow Instructions on PDF attached for BUSINESS ADDRESS (1)
    • Repeat Instructions on page 5 to 14 for BUSINESS ADDRESS (2) and (3) below.
      GMAIL ADDRESS: [Create a new Gmail Account] PASSWORD:
      BUSINESS ADDRESSES:
      • (1) 6370 Mae Anne Avenue, Reno, NV 89523
      • (2) 4784 Caughlin Parkway, Reno, NV 89519
      • (3) 18603 Wedge Parkway, Reno, NV 89511

      BUSINESS TITLE AND FULL ADDRESSES:

      • (1) Anytime Fitness 6370 Mae Anne Avenue, Reno, NV 89523 (775) 746-8400
      • (2) Anytime Fitness 4784 Caughlin Parkway, Reno, NV 89519 (775) 622-8034
      • (3) Anytime Fitness 18603 Wedge Parkway, Reno, NV 89511 (775) 852-7007

      WEBSITE URL: http://renogyms.org/
      GOOGLE PLACES URLs:

    Keywords: Smartsheet, Reno, Gym, Google, Maps, Promotion, QMDHKOB

    Google Places spamming hasn't been fully automated yet, so we get to watch spammers outsource their manual spamming. Spamming Google Places is incredibly easy, much easier than creating the link farms required to spam Google's old web search. See the instructions in "Dominating Google Maps- The Most Effective Spam Ever And What You Can Learn From It".

    Google Places has been 0wned.

  3. Is the filtering of bad workers the same? by YesIAmAScript · · Score: 3, Interesting

    I find it interesting that the people placing the HITs have to decide whether the work done is good quality and then decide to pay or not. So that means for each tiny job you farm out, you have to do your own tiny bit of make work to decide whether to pay or not. Can you farm this out on the turk too? If not, maybe there's a market for a service that let's you do so...

    --
    http://lkml.org/lkml/2005/8/20/95
  4. Only 40%? by D+J+Horn · · Score: 3, Interesting

    From my time exploring mturk I would have guessed it to be much higher than that, non-spam related jobs were definitely the minority of what I saw.

    The creepiest (and highest paying) job I saw though involved watching surveillance footage from airports, making sure the automated face tracker stayed on target...

  5. Re:Wait, humans taking over robot jobs? by icebike · · Score: 3, Interesting

    The surprise is that anyone noticed all these HIT requests.

    Who, other than the utterly unemployable, has time to take on meaningless tasks dished out by machine for pennies. You can find more money laying on the ground in a parking lot.

    A casual perusal didn't find one task I would do for fun or profit.

    --
    Sig Battery depleted. Reverting to safe mode.
  6. Re:And that was before Google Places appeared in W by Animats · · Score: 5, Interesting

    I'm also surprised at how low the wages are at this Turk thing. ... I thought spammers had to at least sweat through that manual task by themselves.

    It's like $0.25 per human-generated spam. Automation seems to be coming. I'm seeing mentions on black hat SEO forums that an automated tool for doing this in bulk will be released early next month.

    Marketing fake numerical addresses in between legit ones ensures that Google Pagerank rates your "unique" business as #1...

    Sometimes. That technique is mostly used to give real businesses extra bogus locations. Check out "New York City locksmith", for example. Other heavily spammed terms are "carpet cleaning" and "divorce lawyer".

    This week's new technique is described at "How To Spam Google Maps For Top Google Place Listings". This is like SQL injection for mailing addresses. The trick depends on Google's parsing of mailing addresses from the top, while USPS standards say they should be parsed from the bottom line upward. So a mailing address with two street addresses is parsed differently by the USPS and Google, allowing the spammer to redirect Google's confirmation postcard to some mail drop.

    Google seems to be out to lunch in this area. The same exploits have been working for months. Yet Google doesn't list any such issues under "Known Issues. Over on Matt Cutts' blog, where you'd expect to see some discussion of this, he reports that he's writing a novel.

    It's even worse at Bing. Bing emulated Google's October 27th merger of Places into web search within a few days. But they weren't ready. Look up "New York City locksmith" in Bing, and the five "Places" entries are all the same business.