We need your help to make sure Turker Nation stays online. Please click the thermometer to learn more.
Note: clicking on the above banners and making ANY purchase returns a commission to Turker Nation.
If you can't see the ad, please click on Shop on Amazon instead. | Want to advertise here? PM Spamgirl to learn more!




Results 1 to 4 of 4

Thread: First time requesters need advice on how to use eligibility criteria for workers

  1. #1

    First time requesters need advice on how to use eligibility criteria for workers

    We are looking for participants in an academic survey. However, we are only looking for workers who fulfil a series of criteria, e.g. not having lived in the US for longer than a specified period. We do not find the MTurk guidance and support geared towards absolute newbies like us. However, if we understand MTurk correctly, we can create specific worker requirements like the one cited above, but this requires some knowledge of programming/coding, which none of us have (‘Command Line Tools’ or ‘API-based tools’ does not mean anything to us).

    Is there a way to add requester-created worker requirements without having to learn coding? If not, are you aware of any other way by which we could ensure that only workers fulfilling the eligibility criteria accept the HIT to avoid frustration for both sides?

    Our apologies for what must look like very stupid questions to old hands, but as complete newbies we are really stumped. Any help is greatly appreciated!

    Thank you very much.

  2. #2
    Community Manager spamgirl's Avatar
    Join Date
    Aug 2011
    Gender
    Female
    Location
    Canada
    Posts
    11,866
    Thanks
    2,491
    Thanked 6,470 Times in 2,098 Posts

    Quote Originally Posted by IOPsychResearch View Post
    Is there a way to add requester-created worker requirements without having to learn coding? If not, are you aware of any other way by which we could ensure that only workers fulfilling the eligibility criteria accept the HIT to avoid frustration for both sides?

    Our apologies for what must look like very stupid questions to old hands, but as complete newbies we are really stumped. Any help is greatly appreciated!

    Thank you very much.
    Here is what you can do:

    1) Set up a 5c HIT as a screener that asks demographic questions including how long they've lived in the US. Be sure to use the US only qualification on this HIT. To avoid the 40% fee, use https://uniqueturker.myleott.com/ so you can post a ton of individual screener HITs instead of one which can be done by a lot of different people. That way you're at least paying people to do the screener, so they don't get mad at you for disqualifying them mid-survey.

    2) Once you have enough workers who meet your criteria, cancel any remaining screener HITs and grant a qualification to those who meet your criteria. Then post a HIT just for those people (again using UniqueTurker to avoid the 40% fee) and make it only open to those with that qualification.

    The cost of a paid screener is worth keeping your Turkopticon rating high.
    It's all good.

  3. The Following User Says Thank You to spamgirl For This Useful Post:


  4. #3
    Quote Originally Posted by spamgirl View Post
    Here is what you can do:

    1) Set up a 5c HIT as a screener that asks demographic questions including how long they've lived in the US. Be sure to use the US only qualification on this HIT. To avoid the 40% fee, use https://uniqueturker.myleott.com/ so you can post a ton of individual screener HITs instead of one which can be done by a lot of different people. That way you're at least paying people to do the screener, so they don't get mad at you for disqualifying them mid-survey.

    2) Once you have enough workers who meet your criteria, cancel any remaining screener HITs and grant a qualification to those who meet your criteria. Then post a HIT just for those people (again using UniqueTurker to avoid the 40% fee) and make it only open to those with that qualification.

    The cost of a paid screener is worth keeping your Turkopticon rating high.
    Thank you, spamgirl! This is an excellent idea and one we will adopt for future projects.

    We will still have to find another solution for the current project, though. We are looking for about 200 completed surveys and want to offer $3.50 each. Our entire budget is $1,000 (to pay Turkers and the MTurk fees).

    We have a fairly long list of qualifying questions (nine in total). If we start with a completely random population, I do not expect more than maybe 1% to meet all criteria. In order to get to 200 responses, we would have to screen 20,000 people. At 5c, this would completely exhaust our budget (not even taking into account the MTurk fees) and there would be nothing left to conduct the study proper. In future projects we can build the fee for the screener into the grant application, but for this project the idea, excellent as it is, is not financially viable. But we obviously do not want to disqualify thousands of Turkers mid-survey, either.

    If anyone has a stroke of genius how to solve our conundrum in this specific case, we would be really grateful.

  5. #4
    A link and access code will be provided to you through mturk's messaging system within 48 hours of completion. What does this mean?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •