I now believe in mechanical turk

18 replies
Hi all,

I never even visited Mechanical Turk until yesterday.

Two stories here.

First of all I have a very good friend who needed to give a speech in another language. (Hindi) He has a working knowledge of that language but he felt like he needed some help in preparing the speech.

He broke the speech down sentence-by-sentence and submitted each sentence on Mturk as a HIT. Each HIT had 10 offers (don't know if I'm getting the lingo correct as I just started with MTurk)

He told the "workers" to translate the sentences in their own words in their native language. Being Hindi, HITS were limited to India.

He made it a term of acceptance that no bable fish translations would be accepted. He put each sentence into Bablefish so he would recognize the Bable fish translation and rejected all BF translations.

He got his sentences all back with several unique translations each and picked the sentences he liked, even using parts of some combined with others.

He gave his final draft to a good friend who is fluent in Hindi and it passed with flying colors. The speech was a hit.

Just to add to my friend’s idea if I was going to give a live presentation to a group of people who spoke another language other than mine I'd pay someone to "translate" it to English Phonics.

Now, my friend’s success with MT made me take another look at it for my IM business.

My experinence:

I posted a HIT for a 100+ word article and got back a good 144-word article.

I took two key words from that article and posted another HIT. I'm waiting to see what happens.

Before I thought MT was just a bunch of people taking advantage of people in dire straights. I suppose there is a lot of that going on, however, it's helping a lot of people too. You can offer decent payment.

Of course, for me, these articles are "seed articles," just to get my juices flowing and writing. I often need that and I think I've found a way to kick my brain into action and crush writer's block.

Plus dipping my toes into the waters of outsourcing felt great also.

My friend got a note from one of the workers that said in part, "Thank you for this assignment, it helped me and my family very much, a dollar goes a long, long way where I live."

George Wright P.S. Besides the low cost the most impressive thing is the turn around time. My article was sent to me 3 hours after I posted the HIT, even though I gave a 24hr time limit.
#mecanical #turk
  • Profile picture of the author Alan Petersen
    I've heard good things of mturk and I tried to use it a couple years ago but found it a bit complicated. I'll need to re-check it out.

    What was the actual out of pocket cost of that 144 article? I don't know the lingo so I don't have a clue what a HIT is.
    Signature
    {{ DiscussionBoard.errors[2471837].message }}
    • Profile picture of the author Jeff Henshaw
      What was the actual out of pocket cost of that 144 article? I don't know the lingo so I don't have a clue what a HIT is.
      Yep the HIT bit confused me too.

      So I'd like clarification as well please.

      Thanks and Regards,

      Jeff.
      {{ DiscussionBoard.errors[2471845].message }}
      • Profile picture of the author Tina Golden
        Each task is called a HIT by the Mturk system.

        Tina
        Signature
        Discover how to have fabulous, engaging content with
        Fast & Easy Content Creation
        ***Especially if you don't have enough time, money, or just plain HATE writing***
        {{ DiscussionBoard.errors[2471849].message }}
    • Profile picture of the author George Wright
      Originally Posted by Alan Petersen View Post

      I've heard good things of mturk and I tried to use it a couple years ago but found it a bit complicated. I'll need to re-check it out.

      What was the actual out of pocket cost of that 144 article? I don't know the lingo so I don't have a clue what a HIT is.
      $00.55.

      HIT = Human Intelligence Tasks Their motto is "Artificial Artificial Intelligence."

      George Wright
      Signature
      "The first chapter sells the book; the last chapter sells the next book." Mickey Spillane
      {{ DiscussionBoard.errors[2471876].message }}
  • Profile picture of the author Sparhawke
    As far as I understand it a HIT is a "human intelligence task", something that AI may not be able to perform, it could be anything I think like proofreading and grammar checks to identifying a particular song if thats your thing.

    However, this is the first time I have ever heard of this :p
    Signature
    “Thinking is easy, Acting is difficult
    And to put one's thoughts into action is the most difficult thing in the world ~ Goethe”
    {{ DiscussionBoard.errors[2471868].message }}
  • Profile picture of the author tpw
    George, I used mturk for a couple of years... For some things, you get good stuff back... For other things, you get junk back...

    Even having short articles written, depending on the topic, you can get some decent articles at a range of prices... I have played with pricing and guidelines, and strictly depending on the topics, it sometimes works out...

    When it is good, it is good... When it is bad, it is hideous...

    I instructed everyone not to copy other websites to respond to my hits... I told em I would check, and I always did...

    A couple people who did not get paid, because they copied website pages entirely, tried to threaten action for non-payment through mturk management... I contacted support and they said they would never take sides...

    I responded to the one lady that I do not pay for stolen content, and if she had a problem with that, I invited her to contact mturk support and gave her the url.... Never heard back from her...

    I learned thru trial and error that if you pull two sentences from a submission, and run them thru google inside quotes, you can quickly find the stolen work online using 6-8 words in the search query... Less than 6 words, you get too many false positives... Some times, you do need to increase to the 8 words to eliminate false positives...

    Take one sentence from the front of the article and one from near the end of the article...

    I never got content back that could stand on its own, but I often got content that could be made to work as a starting base point... I edited the final product and used the edited version for my own needs...

    It worked well for me for a while, because I could do the editing to make it suit my final needs... I could never take the content straight and use it, but I could take the content, edit it, and then have something special...

    It worked esp well in niches where I had little experience of my own to stand on... Like dating from a woman's perspective... Last I checked, I cannot see the dating scene as a woman sees it...

    I pretty much stopped using mturk a year and a half ago, when I tried to get one job for 15 articles done... I ordered the 15 articles, at a decent rate, one that was much larger than what most people pay at mturk... All 15 were stolen from other sites... I reissued the order -- rinse and repeat... After submitting the job order a second time, all articles were stolen... When I gave up, I had submitted job orders for 125 articles and 123 of the submissions were stolen from other websites...

    I still have a couple hundred in credits there, and I still have articles that I bought and paid for that I will use one day...

    But with my two experiences -- only one mentioned here -- where I could not find honest people to do an honest job, I pretty much gave up on mturk as a source for reliable work... I am sure one day I might figure out how to use the rest of my money over there, but right now, I am drawing blanks...

    p.s. I have tested article creation prices from $2 per hit to $35 per hit. For the complicated stuff, I needed to pay at least $20 to get the good results... For those niches where consumers can share personal experiences, such as dating, I could get some pretty decent stuff for $2 per hit...

    Either way you look at though, whatever cost you pay to mturk, you will also need to factor in the cost of an editor to get your stuff right.... I was paying my editors $10 an article...
    Signature
    Bill Platt, Oklahoma USA, PlattPublishing.com
    Publish Coloring Books for Profit (WSOTD 7-30-2015)
    {{ DiscussionBoard.errors[2471873].message }}
    • Profile picture of the author Kevin Marshall
      Originally Posted by tpw View Post

      George, I used mturk for a couple of years... For some things, you get good stuff back... For other things, you get junk back...

      Even having short articles written, depending on the topic, you can get some decent articles at a range of prices... I have played with pricing and guidelines, and strictly depending on the topics, it sometimes works out...

      When it is good, it is good... When it is bad, it is hideous...

      I instructed everyone not to copy other websites to respond to my hits... I told em I would check, and I always did...

      A couple people who did not get paid, because they copied website pages entirely, tried to threaten action for non-payment through mturk management... I contacted support and they said they would never take sides...

      I responded to the one lady that I do not pay for stolen content, and if she had a problem with that, I invited her to contact mturk support and gave her the url.... Never heard back from her...

      I learned thru trial and error that if you pull two sentences from a submission, and run them thru google inside quotes, you can quickly find the stolen work online using 6-8 words in the search query... Less than 6 words, you get too many false positives... Some times, you do need to increase to the 8 words to eliminate false positives...

      Take one sentence from the front of the article and one from near the end of the article...

      I never got content back that could stand on its own, but I often got content that could be made to work as a starting base point... I edited the final product and used the edited version for my own needs...

      It worked well for me for a while, because I could do the editing to make it suit my final needs... I could never take the content straight and use it, but I could take the content, edit it, and then have something special...

      It worked esp well in niches where I had little experience of my own to stand on... Like dating from a woman's perspective... Last I checked, I cannot see the dating scene as a woman sees it...

      I pretty much stopped using mturk a year and a half ago, when I tried to get one job for 15 articles done... I ordered the 15 articles, at a decent rate, one that was much larger than what most people pay at mturk... All 15 were stolen from other sites... I reissued the order -- rinse and repeat... After submitting the job order a second time, all articles were stolen... When I gave up, I had submitted job orders for 125 articles and 123 of the submissions were stolen from other websites...

      I still have a couple hundred in credits there, and I still have articles that I bought and paid for that I will use one day...

      But with my two experiences -- only one mentioned here -- where I could not find honest people to do an honest job, I pretty much gave up on mturk as a source for reliable work... I am sure one day I might figure out how to use the rest of my money over there, but right now, I am drawing blanks...

      p.s. I have tested article creation prices from $2 per hit to $35 per hit. For the complicated stuff, I needed to pay at least $20 to get the good results... For those niches where consumers can share personal experiences, such as dating, I could get some pretty decent stuff for $2 per hit...

      Either way you look at though, whatever cost you pay to mturk, you will also need to factor in the cost of an editor to get your stuff right.... I was paying my editors $10 an article...
      I also had a lot of problems with Mturk. I tried posting HITS for articles on several different niches. In some niches, no one would reply to the HIT. In other niches, I got stolen content. Sometimes I would get a good writer, but usually the writing was terrible.

      I had to reject a lot of work as the articles were hideous.
      Signature

      Confused about SEO? Facebook? Adwords? Send me a PM to apply for your free 30 minute consultation today!



      {{ DiscussionBoard.errors[2472017].message }}
  • Profile picture of the author delong8
    Does MT do anything with solving wordpress problems. Is there a fee to use the service
    Signature
    Deborah Long, Sassy Food Gal
    Single Guys and College Guys Learn To Cook
    Memberships Available for WSO Special Price
    Read the Warrior Forum Post here
    {{ DiscussionBoard.errors[2471877].message }}
    • Profile picture of the author tpw
      Originally Posted by delong8 View Post

      Does MT do anything with solving wordpress problems. Is there a fee to use the service
      The people who participate as service providers at mturk may do WP work, but I would definitely change your passwords after they leave...

      The cost is 10% of what you pay the service provider...

      On a $5 job, the cost is 50 cents...

      On a $20 job, the cost is $2
      Signature
      Bill Platt, Oklahoma USA, PlattPublishing.com
      Publish Coloring Books for Profit (WSOTD 7-30-2015)
      {{ DiscussionBoard.errors[2471900].message }}
  • Profile picture of the author ccasselman
    I tried it last week as well - just asking for each person to give me their opinion on something and go great results.

    Most of the things I have tried with has been kicked out for violating their terms, but with the right jobs - you can get really good results.
    {{ DiscussionBoard.errors[2472067].message }}
  • Profile picture of the author George Wright
    Originally Posted by bikaidus View Post

    Can you really make money with mechanical turk?
    Hi,

    It depends on where you live. If $10 or $20 goes far where you live then yes. But I don't think so if you need $100 or more a day. Of course if you are reselling the MK work in your own products then yes you can make money.

    George Wright
    Signature
    "The first chapter sells the book; the last chapter sells the next book." Mickey Spillane
    {{ DiscussionBoard.errors[2472088].message }}
  • Profile picture of the author George Wright
    Ok,

    My second article for 50 cents just came back within 3 hours. It's really decent. Really just as good as a lot of stuff I've seen on ezinearticles.com

    Now for my next test I put up a HIT and made it "good" for only one hour instead of 24 hours.

    This is actually fun. A nice pass time for a Sat. Afternoon and it's only costing me 55 cents a pop.



    George Wright
    Signature
    "The first chapter sells the book; the last chapter sells the next book." Mickey Spillane
    {{ DiscussionBoard.errors[2472152].message }}
    • Profile picture of the author nickjoselle
      Wow 50 cents? I'd check that for originality.

      I used to use plagiarism checker, but then ran the same copy through Grammarly, and Grammarly found a bunch of dupe content that plagiarism checker wasn't picking up....worth a look.
      {{ DiscussionBoard.errors[2472247].message }}
      • Profile picture of the author davidjames42973
        I haven't had any good articles written from MTurk. It was either stolen content or content that was really bad.

        The only thing I've had luck with when using MTurk is having something simple done such as having people go one of my youtube videos and make a comment.
        {{ DiscussionBoard.errors[2472651].message }}
        • Profile picture of the author heyada
          Thanks for the reviews everyone. really helps since I'm looking into using Mturk but wanted to hear other experiences. Has anyone tried using it for getting backlinks?
          {{ DiscussionBoard.errors[4767477].message }}
  • Profile picture of the author Paperchasing
    Originally Posted by George Wright View Post

    Hi all,

    I never even visited Mechanical Turk until yesterday.

    Two stories here.

    First of all I have a very good friend who needed to give a speech in another language. (Hindi) He has a working knowledge of that language but he felt like he needed some help in preparing the speech.

    He broke the speech down sentence-by-sentence and submitted each sentence on Mturk as a HIT. Each HIT had 10 offers (don't know if I'm getting the lingo correct as I just started with MTurk)

    He told the "workers" to translate the sentences in their own words in their native language. Being Hindi, HITS were limited to India.

    He made it a term of acceptance that no bable fish translations would be accepted. He put each sentence into Bablefish so he would recognize the Bable fish translation and rejected all BF translations.

    He got his sentences all back with several unique translations each and picked the sentences he liked, even using parts of some combined with others.

    He gave his final draft to a good friend who is fluent in Hindi and it passed with flying colors. The speech was a hit.

    Just to add to my friend’s idea if I was going to give a live presentation to a group of people who spoke another language other than mine I'd pay someone to "translate" it to English Phonics.

    Now, my friend’s success with MT made me take another look at it for my IM business.

    My experinence:

    I posted a HIT for a 100+ word article and got back a good 144-word article.

    I took two key words from that article and posted another HIT. I'm waiting to see what happens.

    Before I thought MT was just a bunch of people taking advantage of people in dire straights. I suppose there is a lot of that going on, however, it's helping a lot of people too. You can offer decent payment.

    Of course, for me, these articles are "seed articles," just to get my juices flowing and writing. I often need that and I think I've found a way to kick my brain into action and crush writer's block.

    Plus dipping my toes into the waters of outsourcing felt great also.

    My friend got a note from one of the workers that said in part, "Thank you for this assignment, it helped me and my family very much, a dollar goes a long, long way where I live."

    George Wright P.S. Besides the low cost the most impressive thing is the turn around time. My article was sent to me 3 hours after I posted the HIT, even though I gave a 24hr time limit.
    I've done some work on the other side, so I have some perspective on what people are doing. There are a number of companies and people getting content from there. I've written for a guy doing 150 word BMR posts. Another content company that submits large batches of more detailed writing for turkers to do, etc. Another requester spins articles by having workers rewrite single sentences in their own words. There are entire businesses built around issuing the work to people on MTurk.

    If you want better quality work on MTurk, there are two things you should definitely do to start. Well, three, really, but "pay an acceptable wage" really goes without saying (or it should, anyway). First, qualify your workers. Create a qualification test so that your workers know what to expect of you and can submit sample work to make sure that they are qualified. Second, register an account at turkopticon.com and communicate with your workforce there. You'll learn things like if your directions are confusing and what your workers are struggling with.
    {{ DiscussionBoard.errors[4767607].message }}
  • Profile picture of the author tpw
    Wow, that was a blast from the past.

    I've never used it for backlinks, nor would I trust it for such.
    Signature
    Bill Platt, Oklahoma USA, PlattPublishing.com
    Publish Coloring Books for Profit (WSOTD 7-30-2015)
    {{ DiscussionBoard.errors[4767663].message }}
  • Profile picture of the author Paperchasing
    Heh, I didn't even check the date...another necro bump. I hope my suggestions were helpful anyway.
    {{ DiscussionBoard.errors[4767700].message }}

Trending Topics