To put these costs in perspective, even the highest pay rate we have used on MTurk of $.50 for a
5-minute survey (an effective hourly rate of $6.00) is still associated with a per-respondent cost of $.55
(including Amazon.comís 10 percent surcharge) or $.11 per survey minute. By contrast, per subject costs
for typical undergraduate samples are about $5-10, for non-student campus samples about $30 (Kam et al.
2007), and for temporary agency subjects between $15 and $20. Outside of the campus setting, private
survey firms we have worked with charge at least $10 per subject for a 5-minute survey when respondents
are drawn from an Internet-panel. MTurk is, in short, extremely inexpensive relative to nearly every
alternative other than uncompensated students.8