Online recruitment and testing of infants with Mechanical Turk

Journal of Experimental Child Psychology

Volumn 156, Issue , 2017, Pages 168-178

  Tran, Michelle ^a   Cabral, Laura ^a   Patel, Ronak ^a   Cusack, Rhodri ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Amazon Mechanical Turk; Crowdsourcing; Infant behavior; Online research

Indexed keywords

ATTENTION; CHILD BEHAVIOR; CROWDSOURCING; EVALUATION STUDY; FEMALE; HUMAN; INFANT; INTERNET; MALE; PATIENT SELECTION; REPRODUCIBILITY; SOFTWARE; TELEVISION;

ATTENTION; CROWDSOURCING; FEMALE; HUMANS; INFANT; INFANT BEHAVIOR; INTERNET; MALE; PATIENT SELECTION; REPRODUCIBILITY OF RESULTS; SOFTWARE; TELEVISION;

EID: 85009115315     PISSN: 00220965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jecp.2016.12.003     Document Type: Article

References (36)

1. Buhrmester, M., Kwang, T., Gosling, S.D., Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data?. Perspectives on Psychological Science 6 (2011), 3–5.
2. Bushnell, I.W.R., Sai, F., Mullin, J.T., Neonatal recognition of the mother's face. British Journal of Developmental Psychology 7 (1989), 3–15.
3. Cooper, R.P., Aslin, R.N., Preference for infant-directed speech in the first month after birth. Child Development 61 (1990), 1584–1595.
4. Costa-Giomi, E., Ilari, B., Infants’ preferential attention to sung and spoken stimuli. Journal of Research in Music Education 62 (2014), 188–194.
5. Crump, M.J.C., McDonnell, J.V., Gureckis, T.M., Evaluating Amazon's Mechanical Turk as a tool for experimental behavioral research. PLoS ONE, 8(3), 2013, e57410.
6. Di Giorgio, E., Turati, C., Altoè, G., Simion, F., Face detection in complex visual displays: An eye-tracking study with 3- and 6-month-old infants and adults. Journal of Experimental Child Psychology 113 (2012), 66–77.
7. Farroni, T., Johnson, M.H., Menon, E., Zulian, L., Faraguna, D., Csibra, G., Newborns’ preference for face-relevant stimuli: Effects of contrast polarity. Proceedings of the National Academy of Sciences of the United States of America 102 (2005), 17245–17250.
8. Franchak, J.M., Heeger, D.J., Hasson, U., Adolph, K.E., Free viewing gaze behavior in infants and adults. Infancy 21 (2015), 262–287.
9. Frank, M.C., Vul, E., Johnson, S.P., Development of infants’ attention to faces during the first year. Cognition 110 (2009), 160–170.
10. Gilmore, R.O., Thomas, A.L., Fesi, J.D., Children's brain responses to optic flow vary by pattern type and motion speed. PLoS ONE, 11(6), 2016, e0157911.
11. Goodman, J.K., Cryder, C.E., Cheema, A., Data collection in a flat world: The strengths and weaknesses of Mechanical Turk samples. Journal of Behavioral Decision Making 26 (2013), 213–224.
12. Goodrich, S.A., Pempek, T.A., Calvert, S.L., Formal production features of infant and toddler DVDs. Archives of Pediatrics & Adolescent Medicine 163 (2009), 1151–1156.
13. Hamlin, J.K., Wynn, K., Bloom, P., Social evaluation by preverbal infants. Nature 450 (2007), 557–559.
14. Jouen, F., Lepecq, J.-C., Gapenne, O., Bertenthal, B.I., Optic flow sensitivity in neonates. Infant Behavior and Development 23 (2000), 271–284.
15. Kipp, M. (2001). Anvil—A generic annotation tool for multimodal dialogue. In: P. Dalsgaard, B. Lindberg, H. Benner, & Z.-H. Tan (Eds.), Proceedings of the 7th European Conference on Speech Communication and Technology (EUROSPEECH) (pp. 1367–1370). Aalborg, Denmark.
16. Kittur, A., Chi, E.H., Suh, B., Crowdsourcing user studies with Mechanical Turk. CHI ‘08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2008, ACM, New York, 453–456.
17. LaBarbera, J.D., Izard, C.E., Vietze, P., Parisi, S.A., Four- and six-month-old infants’ visual responses to joy, anger, and neutral expressions. Child Development 47 (1976), 535–538.
18. Levin, S.R., Anderson, D.R., The development of attention. Journal of Communication 26 (1976), 126–135.
19. Lewis, M., Sugarman, E., Frank, M.C., The structure of the lexicon reflects principles of communication. Bello, P., Guarini, M., McShane, M., Scassellati, B., (eds.) Proceedings of the 36th Annual Meeting of the Cognitive Science Society, 2014, Cognitive Science Society, Austin, TX.
20. Mason, W., Suri, S., Conducting behavioral research on Amazon's Mechanical Turk. Behavioral Research Methods 44 (2011), 1–23.
21. Maye, J., Werker, J.F., Gerken, L., Infant sensitivity to distributional information can affect phonetic discrimination. Cognition 82 (2002), 101–111.
22. Montague, D.P.F., Walker-Andrews, A.S., Peekaboo: A new look at infants’ perception of emotion expressions. Developmental Psychology 37 (2001), 826–838.
23. Nakata, T., Trehub, S.E., Infants’ responsiveness to maternal speech and singing. Infant Behavior and Development 27 (2004), 455–464.
24. Open Science Collaboration. Estimating the reproducibility of psychological science. Science, 349, 2015, 10.1126/science.aac4716.
25. Paolacci, G., Chandler, J., Ipeirotis, P.G., Running experiments on Amazon Mechanical Turk. Judgment and Decision Making 5 (2010), 411–419.
26. Peterson, D., The baby factory: Difficult research objects, disciplinary standards, and the production of statistical significance. Socius: Sociological Research for a Dynamic World 2 (2016), 1–10, 10.1177/2378023115625071.
27. Piff, P.K., Stancato, D.M., Côté, S., Mendoza-Denton, R., Keltner, D., Higher social class predicts increased unethical behavior. Proceedings of the National Academy of Sciences of the United States of America 109 (2012), 4086–4091.
28. Pontin, J., Artificial intelligence, with help from the humans. 2007, The New York Times Retrieved from http://www.nytimes.com/2007/03/25/business/yourmoney/25Stream.html?_r=0.
29. Schneider, R.M., Yurovsky, D., Frank, M.C., Large-scale investigations of variability in children's first words. Noelle, D.C., Dale, R., Warlaumont, A.S., Yoshimi, J., Matlock, T., Jennings, C.D., Maglio, P.P., (eds.) Proceedings of the 37th Annual Meeting of the Cognitive Science Society, 2015, Cognitive Science Society, Austin, TX.
30. Starmans, C., Bloom, P., Windows to the soul: Children and adults see the eyes as the location of the self. Cognition 123 (2012), 313–318.
31. Susman, E.J., Visual and verbal attributes of television and selective attention in preschool children. Developmental Psychology 14 (1978), 565–566.
32. Sweeny, K., Andrews, S.E., Nelson, S.K., Robbins, M.L., Waiting for a baby: Navigating uncertainty in recollections of trying to conceive. Social Science and Medicine 141 (2015), 123–132.
33. Trainor, L.J., Infant preferences for infant-directed versus non-infant-directed playsongs and lullabies. Infant Behavior and Development 19 (1996), 83–92.
34. Trainor, L.J., Tsang, C.D., Cheung, V.H.W., Preference for sensory consonance in 2- and 4-month-old infants. Music Perception: An Interdisciplinary Journal 20 (2002), 187–194.
35. Viera, A.J., Garrett, J.M., Understanding interobserver agreement: The kappa statistic. Family Medicine 37 (2005), 360–363.
36. Woodward, A.L., Infants selectively encode the goal object of an actor's reach. Cognition 69 (1998), 1–34.