Collecting Narrative Data on Amazon's Mechanical Turk

Applied Cognitive Psychology

Volumn 29, Issue 4, 2015, Pages 573-583

  Grysman, Azriel ^a  

^a HAMILTON COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; AMAZON MECHANICAL TURK; ARTICLE; COLLEGE STUDENT; CONTROLLED STUDY; DATA COLLECTION METHOD; DEMOGRAPHY; DOCUMENTATION; EMOTION; FEMALE; HUMAN; INTERNET; LINGUISTICS; MAJOR CLINICAL STUDY; MALE; MEMORY; MENTAL STRESS; PRIORITY JOURNAL; PSYCHOLOGY; QUESTIONNAIRE; RELIABILITY; SELF REPORT;

EID: 84947484625     PISSN: 08884080     EISSN: 10990720     Source Type: Journal    
DOI: 10.1002/acp.3140     Document Type: Article

References (45)

1. Bates, J. A., & Lanza, B. A. (2013). Conducting psychology student research via the Mechanical Turk crowdsourcing service. North American Journal of Psychology, 15, 385-394.
2. Bauer, J. J., McAdams, D. P., & Sakaeda, A. R. (2005). Interpreting the good life: Growth memories in the lives of mature, happy people. Journal of Personality and Social Psychology, 88, 203-217.
3. Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012). Evaluating online labor markets for experimental research: Amazon.com's Mechanical Turk. Political Analysis, 20, 351-368.
4. Bohn, A., & Berntsen, D. (2008). Life story development in childhood: The development of life story abilities and the acquisition of cultural life scripts from late middle childhood to adolescence. Developmental Psychology, 44(4), 1135-1147.
5. Bruner, J. (1986). Actual minds, possible worlds. Cambridge: Harvard University Press.
6. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A new source of inexpensive, yet high quality, data? Perspectives on Psychological Science, 6, 3-5.
7. Casler, K., Bickell, L., & Hackett, E. (2013). Separate but equal? A comparison of participants and data gathered via Amazon's MTurk, social media, and face-to-face behavioral testing. Computers in Human Behavior, 29, 2156-2160.
8. Eriksson, K., & Simpson, B. (2010). Emotional reactions to losing explain gender differences in entering a risky lottery. Judgment and Decision Making, 5, 159-163.
9. Fivush, R. (2008). Remembering and reminiscing: How individual lives are constructed in family narratives. Memory Studies, 1(1), 49-58.
10. Fivush, R., & Baker-Ward, L. (2005). The search for meaning: Developmental perspectives on internal state language in autobiographical memory. Journal of Cognition and Development, 6, 455-462.
11. Gergen, K. J., & Gergen, M. M. (1988). Narrative and the self as relationship. Advances in Experimental Social Psychology, 21(1), 17-56.
12. Goodman, J. K., Cryder, C. E., & Cheema, A. (2013). Data collection in a flat world: The strengths and weaknesses of Mechanical Turk samples. Journal of Behavioral Decision Making, 26, 213-224.
13. Grysman, A. (2014). The roles of gender and temporal distance in the recall of dissonant self-related memories. Consciousness and Cognition, 29, 10-22.
14. Grysman, A. (2015). The Meaning in Memories Scale (MIMS): Measuring narrative content, self-report, and well-being in autobiographical memories. Paper presented at the meeting of the Society for Applied Research in Memory and Cognition, Victoria, BC.
15. Grysman, A., Anglin, S. M., Prabakhar, J., & Hudson, J. A. (2015). Self-enhancement and the life script in future thinking across the lifespan. Memory, 23, 774-785.
16. Grysman, A., Merrill, N., & Fivush, R. (under review). Emotion, gender and gender identity in autobiographical memory.
17. Guidelines for Academic Requesters. (nd). Dynamo Wiki. http://wiki.wearedynamo.org/index.php/Guidelines_for_Academic_Requesters (accessed 17 March 2015).
18. Habermas, T., & Bluck, S. (2000). Getting a life: The emergence of the life story in adolescence. Psychological Bulletin, 126(5), 748-769.
19. Habermas, T., & de Silveira, C. (2008). The development of global coherence in life narratives across adolescence: Temporal, causal, and thematic aspects. Developmental Psychology, 44(3), 707-721.
20. Horton, J. J., Rand, D. G., & Zeckhauser, R. J. (2011). The online laboratory: Conducting experiments in a real labor market. Experimental Economics, 14, 399-425.
21. Ipeirotis, P. (2009). Turker demographics vs. Internet demographics. http://behind-the-enemy-lines.blogspot.com/2009/03/turker-demographics-vs-internet.html (accessed 3 July 2014).
22. Levine, B., Svoboda, E., Hay, J. F., Winocur, G., & Moscovitch, M. (2002). Aging and autobiographical memory: Dissociating episodic from semantic retrieval. Psychology and Aging, 17, 677-689.
23. Mansfield, C. D., McLean, K. C., & Lilgendahl, J. P. (2010). Narrative traumas and transgressions: Links between narrative processing, wisdom, and well-being. Narrative Inquiry, 20, 246-273.
24. Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon's Mechanical Turk. Behavioral Research Methods, 44, 1-23.
25. McAdams, D. P. (2006). The redemptive self: Stories Americans live by. New York, NY: Oxford University Press.
26. McAdams, D. P., & McLean, K. C. (2013). Narrative identity. Current Directions in Psychological Science, 22(3), 233-238.
27. McLean, K. C. (2005). Late adolescent identity development: Narrative meaning making and memory telling. Developmental Psychology, 41, 683-691.
28. Nelson, K. (1996). Language in cognitive development: Emergence of the mediated mind. New York: Cambridge University Press.
29. Nelson, K., & Fivush, R. (2004). The emergence of autobiographical memory: A social cultural developmental theory. Psychological Review, 111(2), 486-511.
30. Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45, 867-872.
31. Paolacci, G., & Chandler, J. (2014). Inside the Turk: Understanding Mechanical Turk as a participant pool. Current Directions in Psychological Science, 23, 184-188.
32. Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010). Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5, 411-419.
33. Pasupathi, M. (2001). The social construction of the personal past and its implications for adult development. Psychological Bulletin, 127(5), 651-672.
34. Pasupathi, M., Mansour, E., & Brubaker, J. R. (2007). Developing a life story: Constructing relations between self and experience in autobiographical narratives. Human Development, 50(2-3), 85-110.
35. Pasupathi, M., McLean, K. C., & Weeks, T. (2009). To tell or not to tell: Disclosure and the narrative self. Journal of Personality, 77(1), 89-124.
36. Pennebaker, J. W. (1997). Opening up. New York: Guilford.
37. Pennebaker, J. W., Booth, R. J., & Francis, M. E. (2007). LIWC2007: Linguistic inquiry and word count. Austin, TX: liwc.net.
38. Rouse, S. V. (2015). A reliability analysis of Mechanical Turk data. Computers in Human Behavior, 43, 304-307.
39. Rubin, D. C., & Berntsen, D. (2003). Life scripts help to maintain autobiographical memories of highly positive, but not highly negative, events. Memory & Cognition, 31(1), 1-14.
40. Rubin, D. C., Berntsen, D., & Hutson, M. (2009). The normative and the personal life: Individual differences in life scripts and life story events among USA and Danish undergraduates. Memory, 17(1), 54-68.
41. Schlagman, S., Schultz, J., & Kvavilashvili, L. (2006). A content analysis of involuntary autobiographical memories: Examining the positivity effect in old age. Memory, 14, 161-175.
42. Schneider, N. (2015). Intellectual piecework. The Chronicle of Higher Education. http://chronicle.com/article/Intellectual-Piecework/190039/?cid=at&utm_source=at&utm_medium=en [accessed February 19 2015].
43. Sprouse, J. (2011). A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behavior Research Methods, 43, 155-167.
44. Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 211, 453-458.
45. Waters, T. E., Shallcross, J. F., & Fivush, R. (2013). The many facets of meaning making: Comparing multiple measures of meaning making and their relations to psychological distress. Memory, 21, 111-124.