Language processing in the natural world

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 363, Issue 1493, 2008, Pages 1105-1122

  Tanenhaus, Michael K ^a   Brown Schmidt, Sarah ^b  

^a UNIVERSITY OF ROCHESTER   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Conversation; Eye movements; Language comprehension; Parsing; Speech perception; Spoken word recognition

Indexed keywords

AUDITORY CUE; EYE; HEARING; LANGUAGE; MOVEMENT; NERVOUS SYSTEM; PERCEPTION; REAL TIME;

EID: 38549143101     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.2007.2162     Document Type: Review

References (92)

1. Allen, J. F., Byron, D. K., Dzikovska, M., Ferguson, G., Galescu, L. & Stent, A. 2001 Towards conversational human-computer interaction. AI Mag. 22, 27-35.
2. Allopenna, P. D., Magnuson, J. S. & Tanenhaus, M. K. 1998 Tracking the time course of spoken word recognition: evidence for continuous mapping models. J. Mem. Lang. 38, 419-439. (doi:10.1006/jmla.1997.2558)
3. Altmann, G. T. M. & Kamide, Y. 1999 Incremental interpretation at verbs: restricting the domain of subsequent reference. Cognition 73, 247-264. (doi:10.1016/S0010-0277(99)00059-1)
4. Altmann, G. T. M. & Steedman, M. J. 1988 Interaction with context during human sentence processing. Cognition 30, 191-238. (doi:10.1016/0010-0277(88)90020-0)
5. Austin, J. L. 1962 How to do things with words. Cambridge, MA: Harvard University Press. Bard, E. G., Anderson, A. H., Sotillo, C., Aylett, M., Doherty-Sneddon, G. & Newlands, A. 2000 Controlling the intelligibility of referring expressions in dialogue. J. Mem. Lang. 42, 1-22. (doi:10.1006/jmla.1999.2667)
6. Barsalou, L. 1999 Language comprehension: archival memory or preparation for situated action? Discourse Process. 28, 61-80.
7. Beun, R.-J. & Cremers, A. H. M. 1998 Object reference in a shared domain of conversation. Pragm. Cogn. 6, 121-151.
8. Bock, J. K. 1995 Sentence production: from mind to mouth. In Handbook of perception and cognition, vol. 11 (eds J. Miller & P. Eimas). Speech, language, and communication, pp. 181-216. New York, NY: Academic Press.
9. Bock, J. K., Irwin, D. E., Davidson, D. J. & Levelt, W. J. M. 2003 Minding the clock. J. Mem. Lang. 48, 653-685. (doi:10.1016/S0749- 596X(03)00007-X)
10. Bloom, P. 1997 Intentionality and word learning. Trends Cogn. Sci. 1, 9-12. (doi:10.1016/S1364-6613(97)01006-1)
11. Brennan, S. E. 2005 How conversation is shaped by visual and spoken evidence. In Approaches to studying worldsituated language use: bridging the language-as-product and language-as-action traditions (eds J. C. Trueswell & M. K. Tanenhaus), pp. 95-129. Cambridge, MA: The MIT Press.
12. Brennan, S. E. & Hulteen, E. 1995 Interaction and feedback in a spoken language system: a theoretical framework. Knowledge-Based Syst. 8, 143-151. (doi:10.1016/0950-7051(95)98376-H)
13. Brown, P. & Dell, G. 1987 Adapting production to comprehension: the explicit mention of instruments. Cogn. Psychol. 19, 441-472. (doi:10.1016/0010-0285(87)90015-6)
14. Brown-Schmidt, S. & Tanenhaus, M. K. 2006 Watching the eyes when talking about size: an investigation of message formulation and utterance planning. J. Mem. Lang. 54, 592-609. (doi:10.1016/j.jml.2005.12. 008)
15. Brown-Schmidt S. & Tanenhaus, M. K. In press. Real-time investigation of referential domains in unscripted conversation: a targeted language game approach. Cogn. Sci.
16. Brown-Schmidt, S., Campana, E. & Tanenhaus, M. K. 2005 Real-time reference resolution in a referential communication task. In Processing world-situated language: bridging the language-as-action and language-as-product traditions (eds J. C. Trueswell & M. K. Tanenhaus), pp. 153-172. Cambridge, MA: The MIT Press.
17. Brown-Schmidt, S., Gunlogson, C. & Tanenhaus, M. K. In press. Addressees distinguish shared from private information when interpreting questions during interactive conversation. Cognition.
18. Chambers, C. G., Tanenhaus, M. K., Eberhard, K. M., Filip, H. & Carlson, G. N. 2002 Circumscribing referential domains in real-time sentence comprehension. J. Mem. Lang. 47, 30-49. (doi:10.1006/jmla.2001. 2832)
19. Chambers, C. G., Tanenhaus, M. K. & Magnuson, J. S. 2004 Action-based affordances and syntactic ambiguity resolution. J. Exp. Psychol. Learn. Mem. Cogn. 30, 687-696. (doi:10.1037/0278-7393.30.3.687)
20. Chomsky, N. 1965 Aspects of the theory of syntax. Cambridge, MA: The MIT Press.
21. Clark, H. H. 1992 Arenas of language use. Chicago, IL: University of Chicago Press.
22. Clark, H. H. 1996 Using language. Cambridge, UK: Cambridge University Press.
23. Clark, H. H. & Wilkes-Gibbs, D. 1986 Referring as a collaborative process. Cognition 22, 1-39. (doi:10.1016/0010-0277(86)90010-7)
24. Colby, C. L. & Goldberg, M. E. 1999 Space and attention in parietal cortex. Annu. Rev. Neurosci. 22, 97-136. (doi:10.1146/annurev. neuro.22.1.319)
25. Coltheart, M. 1999 Modularity and cognition. Trends Cogn. Sci. 3, 115-120. (doi:10.1016/S1364-6613(99)01289-9)
26. Cooper, R. M. 1974 The control of eye fixation by the meaning of spoken language: a new methodology for the real-time investigation of speech perception, memory, and language processing. Cogn. Psychol. 6, 84-107. (doi:10.1016/0010-0285(74)90005-X)
27. Crain, S. & Steedman, M. 1985 On not being led up the garden path: the use of context by the psychological parser. In Natural language parsing: psychological, computational, and theoretical perspectives (eds D. Dowty, L. Karttunen & A. Zwicky), pp. 320-358. Cambridge, UK: Cambridge University Press.
28. Crosswhite, K., Masharov, M., McDonough, J. M. & Tanenhaus, M. K. In preparation. Phonetic cues to word length in the online processing of onset-embedded word pairs.
29. Dahan, D. & Tanenhaus, M. K. 2004 Continuous mapping from sound to meaning in spoken-language comprehension: evidence from immediate effects of verb-based constraints. J. Exp. Psychol. Learn. Mem. Cogn. 30, 498-513. (doi:10.1037/0278-7393.30.2.498)
30. Dahan, D. & Tanenhaus, M. K. 2005 Looking at the rope when looking for the snake: conceptually mediated eye movements during spoken-word recognition. Psychol. Bull. Rev. 12, 455-459.
31. Dahan, D., Magnuson, J. S. & Tanenhaus, M. K. 2001a Time course of frequency effects in spoken word recognition: evidence from eye movements. Cogn. Psychol. 42, 317-367. (doi:10.1006/cogp.2001. 0750)
32. Dahan, D., Magnuson, J. S., Tanenhaus, M. K. & Hogan, E. 2001b Subcategorical mismatches and the time course of lexical access: evidence for lexical competition. Lang. Cogn. Process. 16, 507-534. (doi:10.1080/01690960143000074)
33. Dahan, D., Tanenhaus, M. K. & Salverda, A. P. 2007 How visual information influences phonetically-driven saccades to pictures: effects of preview and position in display. In Eye movements: a window on mind and brain (eds R. P. G. van Gompel, M. H. Fischer, W. S. Murray & R. L. Hill), pp. 471-486. Oxford, UK: Elsevier.
34. Davis, M. H., Marslen-Wilson, W. D. & Gaskell, M. G. 2002 Leading up the lexical garden-path: segmentation and ambiguity in spoken word recognition. J. Exp. Psychol. Hum. Percept. Perform. 28, 218-244. (doi:10.1037//0096-1523.28.1.218)
35. Dell, G. S. 1986 A spreading activation theory of retrieval in language production. Psychol. Rev. 93, 283-321. (doi:10.1037/0033-295X.93. 3.283)
36. Eberhard, K. M., Spivey-Knowlton, M. J., Sedivy, J. C. & Tanenhaus, M. K. 1995 Eye-movements as a window into spoken language comprehension in natural contexts. J. Psychol. Res. 24, 409-436. (doi:10.1007/BF02143160)
37. Ferreira, V. S. & Dell, G. S. 2000 The effect of ambiguity and lexical availability on syntactic and lexical production. Cogn. Psychol. 40, 296-340. (doi:10.1006/cogp.1999.0730)
38. Fodor, J. A. 1983 Modularity of mind. Cambridge, MA: Bradford Books.
39. Gandhi, S. P., Heeger, M. J. & Boyton, G. M. 1998 Spatial attention affects brain activity in human primary visual cortex. Proc. Natl Acad. Sci. USA 96, 3314-3319. (doi:10.1073/pnas.96.6.3314)
40. Glenberg, A.M. & Robertson, D. A. 2000 Symbol grounding and meaning: a comparison of high-dimensional and embodied theories of meaning. J. Mem. Lang. 43, 379-401. (doi:10.1006/jmla.2000.2714)
41. Goldin-Meadow, S. 1999 The role of gesture in communication and thinking. Trends Cogn. Sci. 3, 419-429. (doi:10.1016/S1364-6613(99)01397-2)
42. Gregory, M. L., Joshi, A., Grodner, D. & Sedivy, J. C. 2003 Adjectives and processing effort: so, uh, what are we doing during disfluencies? Paper presented at the 16th Annual CUNY Sentence Processing Conf., March, Cambridge, MA.
43. Grice, H. P. 1957 Meaning. Phil. Rev. 66, 377-388. (doi:10.2307/2182440)
44. Griffin, Z. M. & Bock, J. K. 2000 What they eyes say about speaking. Psychol. Sci. 11, 274-279. (doi:10.1111/1467-9280.00255)
45. Hanna, J. E., Tanenhaus, M. K. & Trueswell, J. C. 2003 The effects of common ground and perspective on domains of referential interpretation. J. Mem. Lang. 49, 43-61. (doi:10.1016/S0749-596X(03)00022-6)
46. Hayhoe, M. & Ballard, D. 2005 Eye movements in natural behavior. Trends Cogn. Sci. 9, 188-194. (doi:10.1016/j.tics.2005.02.009)
47. Indefrey, P. & Levelt, W. J. M. 2004 The spatial and temporal signatures of word production components. Cognition 92, 101-144. (doi:10.1016/j.cognition.2002.06.001)
48. Keysar, B. & Barr, D. J. 2005 Coordination of action and belief in communication. In Approaches to studying world situated language use: bridging the language-as-product and language-as-action traditions (eds J. C. Trueswell & M. K. Tanenhaus), pp. 71-94. Cambridge, MA: The MIT Press.
49. Keysar, B., Barr, D. J., Balin, J. A. & Paek, T. S. 1998 Definite reference and mutual knowledge: process models of common ground in comprehension. J. Mem. Lang. 39, 1-20. (doi:10.1006/jmla.1998. 2563)
50. Keysar, B., Barr, D. J., Balin, J. A. & Brauner, J. S. 2000 Taking perspective in conversation: the role of mutual knowledge in comprehension. Psychol. Sci. 11, 32-38. (doi:10.1111/1467-9280.00211)
51. Keysar, B., Lin, S. & Barr, D. J. 2003 Limits on theory of mind use in adults. Cognition 89, 25-41. (doi:10.1016/S0010-0277(03)00064- 7)
52. Krauss, R. M. & Weinheimer, S. 1966 Concurrent feedback, confirmation, and the encoding of referents in verbal communication. J. Person. Social Psychol. 4, 343-346. (doi:10.1037/h0023705)
53. Land, M. 2004 Eye movements in daily life. In The visual neurosciences, vol. 2 (eds L. Chalupa & J. Werner), pp. 1357-1368. Cambridge, MA: The MIT Press.
54. Levelt, W. J. M. 1989 Speaking: from intention to articulation. Cambridge, MA: The MIT Press.
55. Levelt, W. J. M., Roelofs, A. P. A. & Meyer, A. S. 1999 A theory of lexical access in speech production. Behav. Brain Sci. 22, 1-37. (doi:10.1017/S0140525X99001776)
56. Liversedge, S. P. & Findlay, J. M. 2000 Saccadic eye movements and cognition. Trends Cogn. Sci. 4, 6-14. (doi:10.1016/S1364-6613(99) 01418-7)
57. Luce, P. A. & Pisoni, D. B. 1998 Recognizing spoken words: the neighborhood activation model. Ear Hear. 19, 1-36.
58. Magnuson, J. S. 2005 Moving hand reveals dynamics of thought. Proc. Natl Acad. Sci. USA 102, 9995-9996. (doi:10.1073/pnas.0504413102)
59. Magnuson, J. S., Dixon, J. A., Tanenhaus, M. K. & Aslin, R. N. 2007 The dynamics of lexical competition during spoken word recognition. Cogn. Sci. 31, 1-24. (doi:10.1207/s15516709cog000_90)
60. Marslen-Wilson, W. D. 1973 Linguistic structure and speech shadowing at very short latencies. Nature 244, 522-523. (doi:10.1038/244522a0)
61. Marslen-Wilson, W. D. 1975 Sentence perception as an interactive parallel process. Science 189, 226-228. (doi:10.1126/science.189.4198.226)
62. Marslen-Wilson, W. & Warren, P. 1994 Levels of perceptual representation and process in lexical access. Psychol. Rev. 101, 653-675. (doi:10.1037/0033-295X.101.4.653)
63. Marslen-Wilson, W. D. & Welsh, A. 1978 Processing interactions and lexical access during word recognition in continuous speech. Cogn. Psychol. 10, 29-63. (doi:10.1016/0010-0285(78)90018-X)
64. Marslen-Wilson, W., Levy, E. & Tyler, L. K. 1982 Producing interpretable discourse: the establishment and maintenance of reference. In Speech, place and action (eds R. J. Jarvella & W. Klein), pp. 339-378. New York, NY: Wiley.
65. McClelland, J. L. & Elman, J. L. 1986 The TRACE model of speech perception. Cogn. Psychol. 18, 1-86. (doi:10.1016/0010-0285(86) 90015-0)
66. McNeill, D. (ed.) 2000Language and gesture, Cambridge, UK: Cambridge University Press.
67. Metzing, C. & Brennan, S. E. 2003 When conceptual pacts are broken: partner-specific effects on the comprehension of referring expressions. J. Mem. Lang. 49, 201-213. (doi:10.1016/S0749-596X(03)00028-7)
68. Miller, G. A. 1962 Some psychological studies of grammar. Am. Psychol. 17, 748-762. (doi:10.1037/h0044708)
69. Miller, G. A. & Chomsky, N. 1963 Finitary models of language users. In Handbook of mathematical psychology (eds R. D. Luce, R. R. Bush & E. Galanter), pp. 421-491. New York, NY: Wiley.
70. Nadig, A. & Sedivy, J. 2002 Evidence for perspective-taking constraints in children's on-line reference resolution. Psychol. Sci. 13, 329-336. (doi:10.1111/j.0956-7976.2002.00460.x)
71. Norris, D., McQueen, J. M. & Cutler, A. 2002 Bias effects in facilitatory phonological priming. Mem. Cogn. 30, 399-411.
72. Pickering, M. J. & Garrod, S. C. 2004 Towards a mechanistic theory of dialog. Behav. Brain Sci. 7, 169-190.
73. Pulvermüller, F., Härle, M. & Hummel, F. 2001 Walking or talking? Behavioral and neurophysiological correlates of action verb processing. Brain Lang. 78, 143-168. (doi:10.1006/brln.2000.2390)
74. Rayner, K. 1998 Eye movements in reading and information processing: twenty years of research. Psychol. Bull. 124, 372-422. (doi:10.1037/0033-2909.124.3.372)
75. Roberts, C. 2003 Uniqueness in definite noun phrases. Linguist. Philos. 26, 287-350. (doi:10.1023/A:1024157132393)
76. Sabbagh, M. A. & Baldwin, D. A. 2001 Learning words from knowledgeable versus ignorant speakers: links between preschoolers' theory of mind and semantic development. Child Dev. 72, 1054-1070. (doi:10.1111/1467-8624.00334)
77. Salverda, A. P. & Altmann, G. T. M. 2005 Cross-talk between language and vision: interference of visually-cued eye movements by spoken language. Poster presented at the Architectures and Mechanisms in Language Processing (AMLaP) Conf., September 2005, Gent.
78. Salverda, A. P., Dahan, D. & McQueen, J. M. 2003 The role of prosodic boundaries in the resolution of lexical embedding in speech comprehension. Cognition 90, 51-89. (doi:10.1016/S0010-0277(03)00139-2)
79. Salverda, A. P., Dahan, D., Tanenhaus, M.K., Crosswhite, K., Masharov, M. & McDonough, J. M. 2007 Effects of prosodically modulated sub-phonetic variation on lexical competition. Cognition. 105, 466-476. (doi:10.1016/j.cognition.2006.10.008)
80. Schegloff, E. A. & Sacks, H. 1973 Opening up closings. Semiotica 8, 289-327.
81. Searle, J. R. 1969 Speech acts. An essay in the philosophy of language. Cambridge, UK: Cambridge University Press.
82. Sedivy, J. C. 2003 Pragmatic versus form-based accounts of referential contrast: evidence for effects of informativity expectations. J. Psycholinguis. Res. 32, 3-23. (doi:10.1023/A:1021928914454)
83. Spivey, M. J. & Dale, R. 2004 On the continuity of mind: toward a dynamical account of cognition. In The psychology of learning and motivation, vol. 45 (ed. B. Ross), pp. 87-142. Amsterdam, The Netherlands: Elsevier.
84. Spivey, M. J., Tanenhaus, M. K., Eberhard, K. M. & Sedivy, J. C. 2002 Eye movements and spoken language comprehension: effects of visual context on syntactic ambiguity resolution. Cogn. Psychol. 45, 447-481. (doi:10.1016/S0010-0285(02)00503-0)
85. Spivey, M. J., Grosjean, M. & Knoblich, G. 2005 Continuous attraction toward phonological competitors. Proc. Natl Acad. Sci. USA 102, 10 393-10 398. (doi:10.1073/pnas.0503903102)
86. Stalnaker, R. C. 1978 Assertion. In Syntax and semantics: pragmatics, vol. 9 (ed. P. Cole), pp. 315-332. New York, NY: Academic Press.
87. Stalnaker, R. C. 2002 Common ground. Linguist. Philos. 25, 701-721. (doi:10.1023/A:1020867916902)
88. Tanenhaus, M. K. 2004 On-line sentence processing: past, present and, future. In On-line sentence processing: ERPS, eye movements and beyond (eds M. Carreiras & C. Clifton), pp. 371-392. London, UK: Psychology Press.
89. Tanenhaus, M. K. & Trueswell, J. C. 1995 Sentence comprehension. In Speech, language, and communication (eds J. Miller & P. Eimas), pp. 217-262. San Diego, CA: Academic Press.
90. Tanenhaus, M. K., Carlson, G. & Seidenberg, M. S. 1985 Do listeners compute linguistic representations? In Natural language parsing: psychological, computational, and theoretical perspectives (eds D. Dowty, L. Kartunnen & A. Zwicky), pp. 359-408. Cambridge, UK: Cambridge University Press.
91. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M. & Sedivy, J. C. 1995 Integration of visual and linguistic information in spoken language comprehension. Science 268, 1632-1634. (doi:10.1126/science. 7777863)
92. Trueswell, J. C., Sekerina, I., Hill, N. & Logrip, M. 1999 The kindergarten-path effect: studying on-line sentence processing in young children. Cognition 73, 89-134. (doi:10.1016/S0010-0277(99)00032- 3)