Questions tagged [mechanical-turk]

For questions about using the services of participants in the Amazon Mechanical Turk job bank as subjects in psychological testing

Filter by
Sorted by
Tagged with
11 votes
3 answers
444 views

Are there third party providers of Mechanical Turk psychology experiment services?

For various reasons it can be difficult to run a Mechanical Turk experiment (i.e., you don't have the technical expertise, you don't reside in the United States, etc.) Have any third-party providers ...
Jeromy Anglim's user avatar
9 votes
2 answers
2k views

How to use Mechanical Turk for longer studies (i.e., 30 minutes+)?

I'm interested in using Mechanical Turk as a means of recruiting participants for online psychology studies. I have never used it for any research. However, many of my studies take around 30 minutes ...
Jeromy Anglim's user avatar
7 votes
1 answer
2k views

Manipulating cognitive load in online experiments

I'm under the impression that standard cognitive load manipulations (e.g., remember a 7-digit number while completing some other task) wouldn't work for online subject pools like Mechanical Turk. Are ...
amanda's user avatar
  • 71
6 votes
2 answers
1k views

How should multiple Mechanical Turk research subjects from the same IP address be handled?

I saw this question on Twitter from Jay Van Bavel (@jayvanbavel), and thought it was a good fit for the site. Does anyone find that multiple subjects from the same IP address in their #MTurk data?...
Jeromy Anglim's user avatar
4 votes
1 answer
1k views

How do you run a risk / gambling experiment using Qualtrics or Amazon Turk?

I want to run a simple probability matching gambling experiment: Each round has the participant pick Up or Down. The computer picks Up with a probability (p=0.7). If the participant gets it correct, ...
chongman's user avatar
  • 143
2 votes
0 answers
22 views

How to crowdsource behaviour across > 100.000 humans while each human only solves a very short task (< 10 sec)

I'd like to carry out a behavioural experiment that involves humans classifying a very simple image into one of two classes and there is no right or wrong answer. For the question of the study it is ...
user45893's user avatar
  • 121
1 vote
2 answers
827 views

Can I use Mechanical Turk for a longitudinal study?

My thesis looks at depression and social support. My design involves participants answering taking a survey every other day for a total of 10 times. Is is the same set of questions that they will ...
Marisha Vashi's user avatar