First time requesters need advice on how to use eligibility criteria for workers
We are looking for participants in an academic survey. However, we are only looking for workers who fulfil a series of criteria, e.g. not having lived in the US for longer than a specified period. We do not find the MTurk guidance and support geared towards absolute newbies like us. However, if we understand MTurk correctly, we can create specific worker requirements like the one cited above, but this requires some knowledge of programming/coding, which none of us have (‘Command Line Tools’ or ‘API-based tools’ does not mean anything to us).
Is there a way to add requester-created worker requirements without having to learn coding? If not, are you aware of any other way by which we could ensure that only workers fulfilling the eligibility criteria accept the HIT to avoid frustration for both sides?
Our apologies for what must look like very stupid questions to old hands, but as complete newbies we are really stumped. Any help is greatly appreciated!
Thank you very much.
Here is what you can do:
Originally Posted by IOPsychResearch
1) Set up a 5c HIT as a screener that asks demographic questions including how long they've lived in the US. Be sure to use the US only qualification on this HIT. To avoid the 40% fee, use https://uniqueturker.myleott.com/ so you can post a ton of individual screener HITs instead of one which can be done by a lot of different people. That way you're at least paying people to do the screener, so they don't get mad at you for disqualifying them mid-survey.
2) Once you have enough workers who meet your criteria, cancel any remaining screener HITs and grant a qualification to those who meet your criteria. Then post a HIT just for those people (again using UniqueTurker to avoid the 40% fee) and make it only open to those with that qualification.
The cost of a paid screener is worth keeping your Turkopticon rating high.
The Following User Says Thank You to spamgirl For This Useful Post:
Thank you, spamgirl! This is an excellent idea and one we will adopt for future projects.
Originally Posted by spamgirl
We will still have to find another solution for the current project, though. We are looking for about 200 completed surveys and want to offer $3.50 each. Our entire budget is $1,000 (to pay Turkers and the MTurk fees).
We have a fairly long list of qualifying questions (nine in total). If we start with a completely random population, I do not expect more than maybe 1% to meet all criteria. In order to get to 200 responses, we would have to screen 20,000 people. At 5c, this would completely exhaust our budget (not even taking into account the MTurk fees) and there would be nothing left to conduct the study proper. In future projects we can build the fee for the screener into the grant application, but for this project the idea, excellent as it is, is not financially viable. But we obviously do not want to disqualify thousands of Turkers mid-survey, either.
If anyone has a stroke of genius how to solve our conundrum in this specific case, we would be really grateful.
A link and access code will be provided to you through mturk's messaging system within 48 hours of completion. What does this mean?