Conducting spoken word recognition research online: Validation and a new timing method

Behavior Research Methods

Volumn 48, Issue 2, 2016, Pages 553-566

  Slote, Joseph ^a   Strand, Julia F ^a  

^a CARLETON COLLEGE   (United States)

Author keywords

Online data collection; Reaction time; Spoken word recognition

Indexed keywords

BEHAVIORAL RESEARCH; DECISION MAKING; FEMALE; HUMAN; INTERNET; MALE; METHODOLOGY; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REACTION TIME; RECOGNITION; SPEECH PERCEPTION; VALIDATION STUDY; YOUNG ADULT;

BEHAVIORAL RESEARCH; DECISION MAKING; FEMALE; HUMANS; INTERNET; MALE; NEUROPSYCHOLOGICAL TESTS; PSYCHOMOTOR PERFORMANCE; REACTION TIME; RECOGNITION (PSYCHOLOGY); RESEARCH DESIGN; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84929689004     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-015-0599-7     Document Type: Article

References (46)

1. Adenot, P., & Wilson, C. (2015). Web audio API (W3C editor’s draft). Retrieved January 8, 2015, from http://webaudio.github.io/web-audio-api/
2. Balota, D. A., Yap, M. J., Cortese, M. J., Hutchison, K. A., Kessler, B., Loftis, B., & Treiman, R. (2007). The english lexicon project. Behavior Research Methods, 39, 445–459. doi:10.3758/BF03193014
3. Benichov, J., Cox, L., Tun, P., & Wingfield, A. (2012). Word recognition within a linguistic context: Effects of age, hearing acuity, verbal ability and cognitive function. Ear and Hearing, 32, 250–256. doi:10.1097/AUD.0b013e31822f680f.Word
4. Brysbaert, M., & New, B. (2009). Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Methods, 41, 977–990. doi:10.3758/BRM.41.4.977
5. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5. doi:10.1177/1745691610393980
6. Connine, C. M., Mullennix, J., Shernoff, E., & Yelen, J. (1990). Word familiarity and frequency in visual and auditory word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 1084–1096. doi:10.1037/0278-7393.16.6.1084
7. Cooke, M., Barker, J., Garcia Lecumberri, M., & Wasilewski, K. (2011). Crowdsourcing for word recognition in noise. In P. Cosi, R. De Mori, G. Di Fabbrizio, & R. Pieraccini (Eds.), Proceedings of Interspeech 2011 (pp. 3049–3052). Grenoble, France: International Speech Communication Association.
8. Cooke, M., Barker, J., Lecumberri, M. L. G., & Wasilewski, K. (2013). Crowdsourcing for speech perception. In M. Eskenazi, G. Levow, & H. Meng (Eds.), Crowdsourcing for speech processing: Applications to data collection, transcription and assessment (pp. 137–172). New York, NY: Wiley.
9. Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013). Evaluating Amazon’s Mechanical Turk as a tool for experimental behavioral research. PLoS ONE, 8, e57410. doi:10.1371/journal.pone.0057410
10. Dahan, D., & Magnuson, J. S. (2006). Spoken word recognition. In M. J. Traxler & M. A. Gernsbacher (Eds.), Handbook of psycholinguistics (2nd ed., pp. 249–283). San Diego, CA: Academic Press.
11. Field, A. (2009). Discovering statistics using SPSS. London, UK: Sage.
12. Goh, W. D., Suárez, L., Yap, M. J., & Tan, S. H. (2009). Distributional analyses in auditory lexical decision: Neighborhood density and word-frequency effects. Psychonomic Bulletin & Review, 16, 882–887. doi:10.3758/PBR.16.5.882
13. Goldinger, S. D. (1996). Auditory lexical decision. Language & Cognitive Processes, 11, 559–568. doi:10.1080/016909696386944
14. Google, Inc. (2014). reCAPTCHA. Retrieved from www.google.com/recaptcha
15. Kaiser, A. R. (2003). Talker and lexical effects on audiovisual word recognition by adults with cochlear implants. Journal of Speech, Language, and Hearing Research, 46, 390–404. doi:10.1044/1092-4388(2003/032)
16. Kuperman, V., Stadthagen-Gonzalez, H., & Brysbaert, M. (2012). Age-of-acquisition ratings for 30,000 English words. Behavior Research Methods, 44, 978–990. doi:10.3758/s13428-012-0210-4
17. Luce, P. A., Goldinger, S. D., Auer, E. T., & Vitevitch, M. S. (2000). Phonetic priming, neighborhood activation, and PARSYN. Perception, 62, 615–625. doi:10.3758/BF03212113
18. Luce, P. A., & Pisoni, D. B. (1998). Recognizing spoken words: The neighborhood activation model. Ear and Hearing, 19, 1–36. doi:10.1097/00003446-199802000-00001
19. Luce, P. A., Pisoni, D., & Goldinger, S. (1990). Similarity neighborhoods of spoken words. In G. Altmann (Ed.), Cognitive models of speech processing (pp. 122–147). Cambridge, MA: MIT Press.
20. Mason, W., & Suri, S. (2011). Conducting behavioral research on Amazon’s Mechanical Turk. Behavior Research Methods, 44, 1–23. doi:10.3758/s13428-011-0124-6
21. Mayo, C., Aubanel, V., & Cooke, M. (2012). Effect of prosodic changes on speech intelligibility. In Proceedings of Interspeech 2012 (pp. 1708–1711). Grenoble, France: International Speech Communication Association.
22. McClelland, J. L., Elman, J. L., & Diego, S. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1–86. doi:10.1016/0010-0285(86)90015-0
23. McDonnell, J. V., Martin, J. B., Markant, D. B., Coenen, A., Rich, A. S., & Gureckis, T. M. (2012). psiTurk (Version 1.02) [Software]. New York, NY: New York University. Retrieved from https://github.com/NYUCCL/psiTurk
24. Nygaard, L. C., & Pisoni, D. B. (1998). Talker-specific learning in speech perception. Perception & Psychophysics, 60, 355–376.
25. Paolacci, G., Chandler, J., & Ipeirotis, P. (2010). Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5, 411–419.
26. Pisoni, D. B. (1996). Word identification in noise. Language & Cognitive Processes, 11, 681–688. doi:10.1080/016909696387097
27. Plant, R. R., & Turner, G. (2009). Millisecond precision psychological research in a world of commodity computers: New hardware, new problems? Behavior Research Methods, 41, 598–614. doi:10.3758/BRM.41.3.598
28. Psychology Software Tools, Inc. (2014). Sound startup latency tests [Software]. Retrieved from www.pstnet.com/eprimestartup.cfm
29. Reimers, S., & Stewart, N. (2014). Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments. Behavior Research Methods. doi:10.3758/s13428-014-0471-1
30. Savin, H. B. (1963). Word-frequency effect and errors in the perception of speech. Journal of the Acoustical Society of America, 35, 200.
31. Schubert, T. W., Murteira, C., Collins, E. C., & Lopes, D. (2013). ScriptingRT: A software library for collecting response latencies in online studies of cognition. PLoS ONE, 8, e67769. doi:10.1371/journal.pone.0067769
32. Simcox, T., & Fiez, J. A. (2014). Collecting response times using Amazon Mechanical Turk and Adobe Flash. Behavior Research Methods, 46, 95–111. doi:10.3758/s13428-013-0345-y
33. Smus, B. (2012). Developing game audio with the Web audio API. Retrieved from http://html5rocks.com
34. Sommers, M. S. (1996). The structural organization of the mental lexicon and its contribution to age-related declines in spoken-word recognition. Psychology and Aging, 11, 333–341. doi:10.1037/0882-7974.11.2.333
35. Sommers, M. S. (2002). Washington University Speech and Hearing Lab Neighborhood Database. Retrieved from http://neighborhoodsearch.wustl.edu/Home.asp
36. Sommers, M. S., & Danielson, S. M. (1999). Inhibitory processes and spoken word recognition in young and older adults: The interaction of lexical competition and semantic context. Psychology and Aging, 14, 458–472.
37. StatCounter. (2015). StatCounter global stats. Retrieved from http://gs.statcounter.com
38. Strand, J. F. (2014). Phi-Square Lexical Competition Database (Phi-Lex): An online tool for quantifying auditory and visual lexical competition. Behavior Research Methods, 46, 148–158. doi:10.3758/s13428-013-0356-8
39. Strand, J. F., & Sommers, M. S. (2011). Sizing up the competition: Quantifying the influence of the mental lexicon on auditory and visual spoken word recognition. Journal of the Acoustical Society of America, 130, 1663. doi:10.1121/1.3613930
40. Turner, J. E., Valentine, T., & Ellis, A. W. (1998). Contrasting effects of age of acquisition and word frequency on auditory and visual lexical decision. Memory & Cognition, 26, 1282–1291. doi:10.3758/BF03201200
41. Vitevitch, M. S., & Luce, P. A. (1998). When words compete: Levels of processing in perception of spoken words. Psychological Science, 9, 325–329. doi:10.1111/1467-9280.00064
42. Vitevitch, M. S., & Luce, P. A. (2004). A Web-based interface to calculate phonotactic probability for words and nonwords in English. Behavior Research Methods, Instruments, & Computers, 36, 481–487. doi:10.3758/BF03195594
43. Vitevitch, M. S., Luce, P. A., Pisoni, D. B., & Auer, E. T. (1999). Phonotactics, neighborhood activation, and lexical access for spoken words. Brain and Language, 68, 306–311. doi:10.1006/brln.1999.2116
44. Weber, A., & Scharenborg, O. (2012). Models of spoken-word recognition. Wiley Interdisciplinary Reviews: Cognitive Science, 3, 387–401. doi:10.1002/wcs.1178
45. Wilson, C. (2013). A tale of two clocks—Scheduling Web audio with precision. Retrieved from www.html5rocks.com/en/tutorials/audio/scheduling/
46. Wolters, M. K., Isaac, K. B., & Renals, S. (2010). Evaluating speech synthesis intelligibility using Amazon Mechanical Turk. In Y. Sagisaka & K. Tokuda (Eds.), Proceedings of the 7th Speech Synthesis Workshop (SSW7) (pp. 136–141). Kyoto, Japan: National Institute of Information and Communications Technology. Retrieved from http://isw3.naist.jp/~tomoki/ssw7/www/doc/ssw7_proceedings_rev.pdf