Crossmodal identification

Trends in Cognitive Sciences

Volumn 2, Issue 7, 1998, Pages 247-253

  Calvert, Gemma A ^a,c   Brammer, Michael J ^b,c   Iversen, Susan D ^c  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b KING'S COLLEGE LONDON   (United Kingdom)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIOR; COORDINATION; HUMAN; INFORMATION PROCESSING; MAGNETOENCEPHALOGRAPHY; NEUROANATOMY; NUCLEAR MAGNETIC RESONANCE IMAGING; PERCEPTION; PSYCHOPHYSICS; PSYCHOPHYSIOLOGY; REVIEW;

EID: 0031852014     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1364-6613(98)01189-9     Document Type: Review

References (55)

1. Stein, B.E. and Meredith, M.A. (1993) The Merging of the Senses, MIT Press
2. Driver, J. and Spence, C. (1998) Attention and the crossmodal construction of space Trends Cognit Sci. 2. 254-262
3. Stein, B.E., Huneycutt, W.S. and Meredith, M.A. (1988) Neurons and behaviour: the same rules of muitisensory integration apply Brain Res. 448, 355-358
4. Stein, B.E. et al. (1989) Behavioural indices of multisensory integration: orientation to visual cues is affected by auditory stimuli J. Cogn. Neurosci. 1, 12-24
5. Bermant, R.I. and Welch, R.B. (1976) The effect of degree of visual-auditory stimulus separation and eye position upon spatial interaction of vision and audition Percept. Motor Skills 43, 487-493
6. Choe, C.S. et al. (1975) The 'ventriloquist effect': visual dominance or response bias? Percept. Psychophys. 18, 55-60
7. Bertelson, P. and Radeau, M. (1981) Oossmodal bias and perceptual fusion with auditory-visual spatial discordance Percept. Psychophys. 29, 578-584
8. SSumby, W.H. and Polack, I. (1954) Visual contribution to speech intelligibility in noise J. Acoust. Soc. Am. 26, 212-215
9. McGurk, H. and MacDonald, J.W. (1976) Hearing lips and seeing voices Mature 264, 746-748
10. Saldana, H.M. and Rosenblum, L.D. (1993) Visual influences on auditory pluck and bow judgements Percept. Psychophys. 54, 406-416
11. Massaro, D.W. and Cohen, M.M. (1993) Perceiving asynchronous bimodaf speech in consonant-vowel and vowel syllables Speech Commun. 13(1-2), 127-134
12. Summerfield, A.Q. and McGrath, M. (1984) Detection and resolution of audio-visual incompatibility in the perception of vowels 0. J. Exp. Psychol. 36A, 51-74
13. Bertelson, P. (1994) The cognitive architecture behind auditory-visual interaction in scene analysis and speech identification Cahiers de Psychologie Cognitive 13, 69-75
14. Stein, B.E. et at. (1996) Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis J. Cogn. Neursosci. 8, 497-506
15. Fisher, B.D. (1992) Integration of visual and auditory information in the perception of speech events Dissertation Abstracts International, 52, 3324B
16. Bertelson, P. et al. (1994) Exploring the relation between McGurk interference and ventriloquism Proc. 1994 Int. Conf. on Spoken Lang. Process. 2, 559-562
17. Jones, J.A. and Munhall, K.G. (1997) The effects of separating auditory and visual sources on audio-visual integration of speech Canadian Acoustics 2, 13-19
18. Fisher, B.D. and Pylyshyn, Z.W. (1994) The cognitive architecture of bimodal event perception: a commentary and addendum to Radeau, 1994 Cahiers de Psychologie Cognitive 13, 92-96
19. Jack, C.E. and Thurlow, W.R. (1973) Effects of degree of visual association and angle of displacement on the 'ventriloquism' effect Percept Motor Skills 37, 967-979
20. Welch, R.B. and Warren, D.H. (1980) Immediate perceptual response to intersensory discrepancy Psychol. Bull. 88, 638-667
21. Massaro, D.W., Cohen, M.M. and Smeele, P.M. (1996) Perception of asynchronous and conflicting visual and auditory speech J. Acoust. Soc. Am. 100, 1777-1786
22. Munhall, K.G. et al. (1996) Temporal constraints on the McGurk effect Percept. Psychophys. 58, 351-362
23. Bertelson, P., Vroomen, J. and de Gelder, B. (1997) Auditory-visual interaction in voice localization and in bimodal speech recognition: the effect of desynchronisation, in Proc. Workshop on Audio-visual Speech Processing, Cognitive and Computational Approaches (Benoit, C. and Campbell, R., eds), Rhodes, 26-27 September, 1997, pp. 97-100
24. Ungerteider, L.G. and Mishkin, M. (1982) Two cortical visual systems, in The Analysis of Visual Behavior (Ingle, D.J., Mansfield, R.J.W. and Goodale, M.D., eds), pp. 549-586. MIT Press
25. Knudsen, E.I. and Brainard, M.S. (1995) Creating a unified representation of visual and auditory space in the brain Annu. Rev. Neumsci. 18, 19s13
26. Welch, R.B. and Warren, D.H. (1986) Intersensory interactions, in Handbook of Perception and Human Performance (Vol. 7: Sensory Processes and Perception) (Boof, K.R., Kaufman, L. and Thomas, J.P., eds), pp. 1-36, John Wiley & Sons
27. Ellis, W.D. (1938) A Source Book of Gestalt Psychology, Kegan Paul, Trench, Trubner
28. Radeau, M. (1994) Auditory-visual spatial interaction and modularity. Cahiers de Psychologie Cognitive 13, 3-51
29. Summerfield, Q. (1987) Some preliminaries to a comprehensive account of audio-visual speech perception, in Hearing by Eye: The Psychology of Up-Reading (Dodd, B. and Campbell, R., edsj, pp. 3-51, Erlbaum
30. Massaro, D.W. (1998; Perceiving Talking Faces: From Speech Perception to a Behavioral Principle, MIT Press
31. King, A.J. and Palmer, A.R. (1985) Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus Exp. Brain Res. 60, 492-500
32. Frens, M.A. and van Opstal, A.J. (1997) Monkey superior colliculus activity during short-term saccadic adaptation Brain Res. Bull. 43, 473-483
33. Wallace, M.T., Wilkinson, LK. and Stein, B.E. (1996) Representation and integration of multiple sensory inputs in primate superior colliculus J. Neurophysiol. 76, 1246-1266
34. Schneider, G.E. (1969) Two visual systems: brain mechanisms for localization and discrimination are dissociated by tectal and cortical lesions Science 163, 895-902
35. Wurtz, R.H. and Albano, I.E. (1980) Visual-motor function of the primate superior colliculus Anna. Rev. Neurasci. 3, 189-226
36. Meredith, M.A., Nemitz, J.W. and Stein, B.E. (1987) Determinants of multisensory integration in superior colliculus neurons: I. Temporal factors J. Neurosci. 10, 3215-3229
37. Meredith, M.A. and Stein, B.E. (1986) Spatial factors determine the activity of multisensory neurons in cat superior colliculus Brain Res. 365, 350-354
38. Stein, B.E. and Wallace, M.T. (1996) Comparisons of crossmodality integration in midbrain and cortex, in Progress in Brain Research (Norita, M., Bando, T. and Stein, B., eds), 112, 289-299
39. Pandya, D.N. and Seltzer, B. (1985) Association areas of the cerebral cortex Trends Neurosd. 5, 286-290
40. Banati, R.B. et al. (1997) The functional anatomy of sensory integration in man Neuroimage 5(4), 5213
41. Chee, M.W. et al. (1997) Auditory and visual word processing studied with fMRI Neuroimage 5(4), S557
42. Ettlinger, G. and Wilson, W.A. (1990) Cross-modal performance: behavioural processes, phylogenetic considerations and neural mechanisms Behav. Brain Res. 40, 169-192
43. Mesulam, M-M. (1990) Large-scale neurocognitive networks and distributed processing for attention, language and memory Ann. Neural. 28, 597-613
44. Mesulam, M-M. (1994) Neurocognitive networks and selectively distributed processing Revue Neural. (Paris) 150, 564-569
45. Streicher, M. and Ettlinger, G. (1987) Crossmodal recognition of familiar and unfamiliar objects by the monkey: the effects of ablation of polysensory neocortex or of the amygdaloid complex Behav. Brain Res. 23, 95-107
46. Mesulam. M-M. et al. (1992) Differential cholinergk innervation within functional subdivisions of the human cerebral cortex; a choline acetyltransferase study J. Comp. Neurol. 318, 316-328
47. Seltzer, B. and Pandya, D.N. (1978) Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey Brain Res. 149, 1-24
48. Jones, E.G. and Powell, T.P.S. (1970) An anatomical study of converging sensory pathways within the cerebral cortex of the monkey Brain 93, 37-56
49. Wernicke, C. (1874,1 Der Aphasische Symptomenkomplex,
50. M, Cohn and Weigert, Breslau, Poland SOGraziano, M.S.A. and Gross, C.G. (1995) The representation of extrapersonal space: a possible role for bimodal, visual-tactile neurons, in The Cognitive Neurosciences (Gazzaniga, M., ed.), pp. 1021-1034, MIT Press
51. Ogawa, S. et al. (1990) Oxygenation-sensitive contrast in magnetic resonance image of a rodent brain at high magnetic fields Mag. Resonance Med. 14, 68-78
52. Calvert, G.A. et al. (1997) Activation of auditory cortex during silent lipreading Science 276, 593-596
53. Hadjikhani, N. and Roland, P.E. (1998) Cross-modal transfer of information between the tactile and the visual representations in the human brain: a positron emission tomographic study J. Neurosci. 18, 1072-1084
54. Sams, M. ef at. (1991) Seeing speech: visual information from lip movements modified activity in the human cortex Neurosci. Lett. 127, 141-145
55. Zeki, S. and Shipp, S. (1988) The functional logic of cortical connections Nature 335, 311-317