The tug of war between phonological, semantic and shape information in language-mediated visual search

Journal of Memory and Language

Volumn 57, Issue 4, 2007, Pages 460-482

  Huettig, Falk ^a,b   McQueen, James M ^b  

^a GHENT UNIVERSITY   (Belgium)

^b MAX PLANCK INSTITUTE FOR PSYCHOLINGUISTICS   (Netherlands)

Author keywords

Attention; Eye movements; Phonological representations; Semantic representations; Visual representations

Indexed keywords

EID: 34748822327     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2007.02.001     Document Type: Article

References (46)

1. Allopenna P.D., Magnuson J.S., and Tanenhaus M.K. Tracking the time course of spoken word recognition using eye movements: evidence for continuous mapping models. Journal of Memory and Language 38 (1998) 419-439
2. Altmann G.T.M., and Kamide Y. Incremental interpretation at verbs: restricting the domain of subsequent reference. Cognition 73 (1999) 247-264
3. Coltheart M., Rastle K., Perry C., Langdon R., and Ziegler J. DRC: a Dual Route Cascaded model of visual word recognition and reading aloud. Psychological Review 108 (2001) 204-256
4. Cooper R.M. The control of eye fixation by the meaning of spoken language: a new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology 6 (1974) 84-107
5. Cree G.S., and McRae K. Analyzing the factors underlying the structure and computation of the meaning of chipmunk, cherry, chisel, cheese, and cello (and many other such concrete nouns). Journal of Experimental Psychology: General 132 (2003) 163-201
6. Dahan D., Magnuson J.S., and Tanenhaus M.K. Time course of frequency effects in spoken-word recognition: evidence from eye movements. Cognitive Psychology 42 (2001) 317-367
7. Dahan D., Magnuson J.S., Tanenhaus M.K., and Hogan E.M. Subcategorical mismatches and the time course of lexical access: evidence for lexical competition. Language and Cognitive Processes 16 (2001) 507-534
8. Dahan D., and Tanenhaus M. Looking at the rope when looking for the snake: conceptually mediated eye movements during spoken-word recognition. Psychonomic Bulletin & Review 12 (2005) 453-459
9. Dell G.S., Schwartz M.F., Martin N., Saffran E.M., and Gagnon D.A. Lexical access in aphasic and nonaphasic speakers. Psychological Review 104 (1997) 810-838
10. Griffin Z.M., and Bock K. Constraint, word frequency, and the relationship between processing levels in spoken word production. Journal of Memory and Language 38 (1998) 313-338
11. Henderson J.M., and Ferreira F. Scene perception for psycholinguists. In: Henderson J.M., and Ferreira F. (Eds). The interface of language, vision and action (2004), Psychology Press, Hove 1-58
12. Huettig F., and Altmann G.T.M. The online processing of ambiguous and unambiguous words in context: evidence from head-mounted eye-tracking. In: Carreiras M., and Clifton C. (Eds). The on-line study of sentence comprehension: Eyetracking, ERP and beyond (2004), Psychology Press, New York, NY 187-207
13. Huettig F., and Altmann G.T.M. Word meaning and the control of eye fixation: semantic competitor effects and the visual world paradigm. Cognition 96 (2005) B23-B32
14. Huettig, F. & Altmann, G. T. M. (in press). Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness. Visual Cognition.
15. Huettig F., Quinlan P.T., McDonald S.A., and Altmann G.T.M. Models of high-dimensional semantic space predict language-mediated eye movements in the visual world. Acta Psychologica 121 (2006) 65-80
16. Jakimik K., Cole R.A., and Rudnicky A.I. Sound and spelling in spoken word recognition. Journal of Memory and Language 24 (1985) 165-178
17. Landauer T.K., and Dumais S.T. A solution to Plato's problem: the Latent Semantic Analysis theory of acquisition, induction and representation of knowledge. Psychological Review 104 (1997) 211-240
18. Levelt W.J.M., Roelofs A., and Meyer A.S. A theory of lexical access in speech production. Behavioral and Brain Sciences 22 (1999) 1-75
19. Levelt W.J.M., Schriefers H., Vorberg D., Meyer A.S., Pechmann T., and Havinga J. The time course of lexical access in speech production: a study of picture naming. Psychological Review 98 (1991) 122-142
20. Luce P.A., and Pisoni D.B. Recognizing spoken words: the Neighborhood Activation Model. Ear and Hearing 19 (1998) 1-36
21. Marslen-Wilson W.D. Functional parallelism in spoken word-recognition. Cognition 25 (1987) 71-102
22. McClelland J.L., and Elman J.L. The TRACE model of speech perception. Cognitive Psychology 18 (1986) 1-86
23. McDonald, S. A. (2000). Environmental determinants of lexical processing effort. Unpublished doctoral dissertation, University of Edinburgh, Scotland. Retrieved December 10, 2004, from http://www.inf.ed.ac.uk/publications/thesis/online/IP000007.pdf.
24. McMurray B., Tanenhaus M.K., and Aslin R.N. Gradient effects of within-category phonetic variation on lexical access. Cognition 86 (2002) B33-B42
25. McQueen J.M., Dahan D., and Cutler A. Continuity and gradedness in speech processing. In: Schiller N.O., and Meyer A.S. (Eds). Phonetics and phonology in language comprehension and production: Differences and similarities (2003), Mouton de Gruyter, Berlin 39-78
26. McQueen, J. M. & Viebahn, M. (in press). Tracking recognition of spoken words by tracking looks to printed words. Quarterly Journal of Experimental Psychology.
27. Morsella E., and Miozzo M. Evidence for a cascade model of lexical access in speech production. Journal of Experimental Psychology: Learning, Memory, and Cognition 28 (2002) 555-563
28. Nelson, D. L., McEvoy, C. L., & Schreiber, T. A. (1998). The University of South Florida word association, rhyme, and word fragment norms. http://www.usf.edu/FreeAssociation/.
29. Norris D. Shortlist: a connectionist model of continuous speech recognition. Cognition 52 (1994) 189-234
30. Norris D., Cutler A., McQueen J.M., and Butterfield S. Phonological and conceptual activation in speech comprehension. Cognitive Psychology 53 (2006) 146-193
31. Norris D., McQueen J.M., Cutler A., and Butterfield S. The possible-word constraint in the segmentation of continuous speech. Cognitive Psychology 34 (1997) 191-243
32. Parker R.E. Picture-processing during recognition. Journal of Experimental Psychology: Human Perception and Performance 4 (1978) 284-293
33. Peterson R.R., and Savoy P. Lexical selection and phonological coding during language production: evidence for cascaded processing. Journal of Experimental Psychology: Learning, Memory, and Cognition 24 (1998) 539-557
34. Plaut D.C., McClelland J.L., Seidenberg M.S., and Patterson K. Understanding normal and impaired word reading: computational principles in quasi-regular domains. Psychological Review 103 (1996) 56-115
35. Plaut D.C., and Shallice T. Deep dyslexia: a case study of connectionist neuropsychology. Cognitive Neuropsychology 10 (1993) 377-500
36. Pollatsek A., Rayner K., and Collins W.E. Integrating pictorial information across eye movements. Journal of Experimental Psychology: General 113 (1984) 426-442
37. Salverda A., Dahan D., and McQueen J.M. The role of prosodic boundaries in the resolution of lexical embedding in speech comprehension. Cognition 90 (2003) 51-89
38. Seidenberg M.S., and Tanenhaus M.K. Orthographic effects on rhyme monitoring. Journal of Experimental Psychology: Human Learning and Memory 5 (1979) 546-554
39. Shatzman K.B., and McQueen J.M. The modulation of lexical competition by segment duration. Psychonomic Bulletin & Review 13 (2006) 966-971
40. Shatzman K.B., and McQueen J.M. Segment duration as a cue to word boundaries in spoken-word recognition. Perception & Psychophysics 68 (2006) 1-16
41. Slowiaczek L.M., Soltano E.G., Wieting S.J., and Bishop K.L. An investigation of phonology and orthography in spoken-word recognition. Quarterly Journal of Experimental Psychology 56A (2003) 233-262
42. Strain E., Patterson K.E., and Seidenberg M.S. Semantic effects in single-word naming. Journal of Experimental Psychology: Learning, Memory, and Cognition 21 (1995) 1140-1154
43. Tanenhaus M.K., Spivey-Knowlton M.J., Eberhard K.M., and Sedivy J.C. Integration of visual and linguistic information in spoken language comprehension. Science 268 (1995) 1632-1634
44. Van Orden G.C., Johnston J.C., and Hale B.L. Word identification proceeds from spelling to sound to meaning. Journal of Experimental Psychology: Learning, Memory, and Cognition 14 (1988) 371-386
45. Yee E., and Sedivy J.C. Eye movements to pictures reveal transient semantic activation during spoken word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 32 (2006) 1-14
46. Ziegler J.C., and Ferrand L. Orthography shapes the perception of speech: the consistency effect in auditory word recognition. Psychonomic Bulletin & Review 5 (1998) 683-689