Neural correlates of coherent audiovisual motion perception

Cerebral Cortex

Volumn 17, Issue 6, 2007, Pages 1433-1443

  Baumann, Oliver ^a,b   Greenlee, Mark W ^a  

^a UNIVERSITY OF REGENSBURG   (Germany)

^b UNIVERSITY OF OSLO   (Norway)

Author keywords

Audiovisual integration; Brain imaging; Coherence; Multimodal; Superior temporal gyrus; Supramarginal gyrus

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; CORRELATION FUNCTION; EVOKED CORTICAL RESPONSE; EYE MOVEMENT; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING ACUITY; HUMAN; HUMAN EXPERIMENT; MENTAL PERFORMANCE; MOVEMENT PERCEPTION; NERVE CELL; PRIORITY JOURNAL; VISUAL STIMULATION; ATTENTION; AUDITORY CORTEX; BRAIN CORTEX; FRONTAL LOBE; HEMISPHERIC DOMINANCE; MALE; NUCLEAR MAGNETIC RESONANCE IMAGING; PARIETAL LOBE; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOPHYSICS; SOUND DETECTION; VISUAL CORTEX;

ACOUSTIC STIMULATION; ADULT; ATTENTION; AUDITORY CORTEX; CEREBRAL CORTEX; EYE MOVEMENTS; FEMALE; FRONTAL LOBE; FUNCTIONAL LATERALITY; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTION PERCEPTION; PARIETAL LOBE; PHOTIC STIMULATION; PSYCHOPHYSICS; SOUND LOCALIZATION; VISUAL CORTEX;

EID: 34347255770     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhl055     Document Type: Article

References (76)

1. Ahissar M, Ahissar E, Bergman H, Vaadia E. 1992. Encoding of sound-source location and movement: activity of single neurons and interactions between adjacent neurons in the monkey auditory cortex. J Neurophysiol 67:203-215.
2. Alais D, Blake R. 1999. Neural strength of visual attention gauged by motion adaptation. Nat Neurosci 2:1015-1018.
3. Andersen RA. 1997. Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annu Rev Neurosci 20:303-330.
4. Baumgart F, Gaschler-Markefski B, Woldorff MG, Heinze H, Scheich H. 1999. A movement-sensitive area in auditory cortex. Nature 400:724-726.
5. Beauchamp MS, Cox RW, DeYoe EA. 1997. Graded effects of spatial and featural attention on human area MT and associated motion processing areas. J Neurophysiol 78:516-520.
6. Beer AL, Roder B. 2004. Attention to motion enhances processing of both visual and auditory stimuli: an event-related potential study. Cogn Brain Res 18:205-225.
7. Beer AL, Roder B. 2005. Attending to visual or auditory motion affects perception within and across modalities: an event-related potential study. Eur J Neurosci 21:1116-1130.
8. Belin P, Zatorre RJ, Hoge R, Evans AC, Pike B. 1999. Event-related fMRI of the auditory cortex. Neuroimage 10:417-429.
9. Benevento LA, Fallon J, Davis BJ, Rezak M. 1977. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp Neurol 57:849-872.
10. Bhattacharya J, Shams L, Shimojo S. 2002. Sound-induced illusory flash perception: role of gamma band responses. Neuroreport 13:1727-1730.
11. Binder JR, Frost JA, Hammeke TA, Bellgowan PSF, Rao SM, Cox RW. 1999. Conceptual processing during conscious resting state: a functional MRI study. J Cogn Neurosci 11:80-95.
12. Bremmer F, Schlack A, Shah NJ, Zafiris O, Kubischik M, Hoffmann K, Zilles K, Fink GR. 2001. Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29:287-296.
13. Bruce C, Desimone R, Gross CG. 1981. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol 46:369-384.
14. Buechel C, Josephs O, Rees G, Turner R, Frith CD, Friston KJ. 1998. The functional anatomy of attention to visual motion: a functional MRI study. Brain 121:1281-1294.
15. Bushara KO, Weeks RA, Ishii K, Catalan M-J, Tian B, Rauschecker JP, Hallet M. 1999. Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans. Nat Neurosci 2:759-766.
16. Calvert GA, Campbell R, Brammer MJ. 2000. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10:649-657.
17. Calvert GA, Spence C, Stein BE. 2004. The handbook of multisensory processes. Cambridge, England: Bradford Book.
18. Chaudhuri A. 1990. Modulation of the motion aftereffect by selective attention. Nature 344:60-62.
19. Chawla D, Rees G, Friston KJ. 1999. The physiological basis of attentional modulation in extrastriate visual areas. Nature 7:671-676.
20. Colby CL, Duhamel J, Goldberg ME. 1996. Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. J Neurophysiol 76:2841-2852.
21. Courtney SM, Ungerleider LG, Keil K, Haxby JV. 1996. Object and spatial visual working memory activate separate neural systems in human cortex. Cereb Cortex 6:39-49.
22. Culham JC, Brandt SA, Cavanagh P, Kanwisher NG, Dale AM, Tootell RB. 1998. Cortical fMRI activation produced by attentive tracking of moving targets. J Neurophysiol 80:2657-2670.
23. Falchier A, Clavagnier S, Barone P, Kennedy H. 2002. Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22:5749-5759.
24. Felleman DJ, Van Essen DC. 1991. Distributed hierarchical processing in primate visual cortex. Cerebral Cortex 1:1-47.
25. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE. 2000. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Cogn Brain Res 10:77-83.
26. Friston KJ, Ashburner J, Poline JB, Frith CD, Heather JD, Frackowiak RSJ. 1995a. Spatial registration and normalization of images. Hum Brain Mapp 2:165-189.
27. Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, Frackowiak RSJ. 1995b. Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2:189-210.
28. Fujisaki W, Nishida S. 2005. Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals. Exp Brain Res 166:455-464.
29. Giard MH, Peronnet F. 1999. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473-490.
30. Godschalk M, Mitz AR, van Duin B, van der Burg H. 1995. Somatotopy of monkey premotor cortex examined with microstimulation. Neurosci Res 23:269-279.
31. Gondan M, Roder B. 2006. A new method for detecting interactions between the senses in event-related potentials. Brain Res 1073-1074:389-397.
32. Griffiths TD, Rees G, Rees A, Green GGR, Witton C, Rowe D, Büchel C, Turner R, Frackowiak RSJ. 1998. Right parietal cortex is involved in the perception of sound movement in humans. Nat Neurosci 1:74-79.
33. Hall DA, Haggard MP, Akeroyd MA, Palmer AR, Summerfield AQ, Elliott MR, Gurney EM, Bowtell RW. 1999. "Sparse" temporal sampling in auditory fMRI. Hum Brain Mapp 7:213-223.
34. Haxby JV, Horwitz B, Ungerleider LG, Maisog JM, Pietrini P, Grady CL. 1994. The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations. J Neurosci 14:6336-6353.
35. Holmes AP. 1994. Statistical issues in functional brain mapping [Doctoral dissertation]. University of Glasgow.
36. Holmes AP, Blair RC, Watson JDG, Ford I. 1996. Non-parametric analysis of statistic images from functional mapping experiments. J Cereb Blood Flow Metab 16:7-22.
37. Hyvarinen J, Shelepin Y. 1979. Distribution of visual and somatic functions in the parietal associative area 7 of the monkey. Brain Res 169:561-564.
38. Jonides J, Smith EE, Koeppe RA, Awh E, Minoshima S, Mintun MA. 1993. Spatial working memory in humans as revealed by PET. Nature 363:623-625.
39. Kayser C, Petkov CI, Augath M, Logothetis NK. 2005. Integration of touch and sound in auditory cortex. Neuron 48:373-384.
40. Kimmig H, Greenlee MW, Huethe F, Mergner T. 1999. MR-Eyetracker: a new method for eye movement recording in functional resonance imaging. Exp Brain Res 126:443-449.
41. LaBar KS, Gitelman DR, Parrish TB, Mesulam M. 1999. Neuroanatomic overlap of working memory and spatial attention networks: a functional MRI comparison within subjects. Neuroimage 10:695-704.
42. Lancaster JL, Summerln JL, Rainey L, Freitas CS, Fox PT. 1997. The Talairach Daemon, a database server for Talairach atlas labels. Neuroimage 5:633.
43. Lancaster JL, Woldorff MG, Parsons LM, Liotti M, Freitas CS, Rainey L, Kochunov PV, Nickerson D, Mikiten SA, Fox PT. 2000. Automated Talairach atlas labels for functional brain mapping. Hum Brain Mapp 10:120-131.
44. Law I, Svarer C, Holm S, Paulsen OB. 1997. The activation pattern in normal humans during suppression, imagination and performance of saccadic eye movements. Acta Physiol Scand 161:419-434.
45. Lewis JW, Beauchamp MS, DeYoe EA. 2000. A comparison of visual and auditory motion processing in human cerebral cortex. Cereb Cortex 10:873-888.
46. Lewis JW, Van Essen DC. 2000. Cortico-cortical connections of visual, sensorimotor, and multimodal processing. Neuroimage 7:378.
47. Macaluso E, Frith CD, Driver J. 2000. Modulation of human visual cortex by crossmodal spatial attention. Science 289:1206-1208.
48. Maldjian JA, Laurienti PJ, Kraft RA, Burdette JH. 2003. An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 19:1233-1239.
49. McCarthy G, Blamire AM, Puce A, Nobre AC, Bloch G, Hyder F, Goldman-Rakic P, Shulman RG. 1994. Functional magnetic resonance imaging of human prefrontal cortex activation during a spatial working memory task. Proc Natl Acad Sci USA 91:8690-8694.
50. Meyer GF, Wuerger SM, Röhrbein F, Zetschke C. 2005. Low-level integration of auditory and visual motion signals requires spatial co-localisation. Exp Brain Res 166:538-547.
51. Miller J. 1982. Divided attention: evidence for coactivation with redundant signals. Cognit Psychol 14:247-279.
52. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ. 2002. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res 14:115-128.
53. Morein-Zamir S, Soto-Faraco S, Kingstone A. 2003. Auditory capture of vision: examining temporal ventriloquism. Cogn Brain Res 17:154-163.
54. Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ. 2004. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 15:963-974.
55. O'Craven KM, Rosen BR, Kwong KK, Treisman A, Savoy RL. 1997. Voluntary attention modulates fMRI activity in human MT-MST. Neuron 18:591-598.
56. Patterson RD, Uppenkamp S, Johnsrude IS, Griffiths TD. 2004. The processing of temporal pitch and melody information in auditory cortex. Neuron 36:767-776.
57. Pavani F, Macaluso E, Warren JD, Driver J, Griffiths TD. 2002. A common cortical substrate activated by horizontal and vertical sound movement in human brain. Curr Biol 12:1584-1590.
58. Petit L, Dubois S, Tzourio N, Dejardin S, Crivello F, Michel C, Etard O, Denise P, Roucoux A, Mazoyer B. 1999. PET study of human foveal fixation system. Hum Brain Mapp 8:28-43.
59. Raos V, Franchi G, Gallese V, Fogassi L. 2003. Somatotopic organization of the lateral part of area F2 (dorsal premotor cortex) of the macaque monkey. J Neurophysiol 89:1503-1518.
60. Rees G, Friston K, Koch C. 2000. A direct quantitative relationship between the functional properties of human and macaque V5. Nat Neurosci 3:716-723.
61. Reulen JPH, Marcus JT, Koops D, de Vries FR, Tiesinga G, Boshuizen K, Bos JE. 1988. Precise recording of eye movement: the IRIS technique Part 1. Med Biol Eng Comput 26:20-26.
62. Rizzolatti G, Fogassi L, Gallese V. 1997. Parietal cortex: from sight to action. Curr Opin Neurobiol 7:562-567.
63. Sekuler R, Ball K. 1977. Mental sets alters visibility of moving targets. Science 198:60-62.
64. Shams L, Kamitani Y, Thompson S, Shimojo S. 2001. Sound alters visual evoked potentials in humans. Neuroreport 12:3849-3852.
65. Sheliga BM, Riggio L, Rizzolatti G. 1995. Spatial attention and eye movements. Exp Brain Res 105:261-275.
66. Shulman GL, Corbetta M, Buckner RL, Raichle ME, Fiez JA, Miezin FM, Petersen SE. 1997. Top-down modulation of early sensory cortex. Cereb Cortex 7:193-206.
67. Simon SR, Meunier M, Piettre L, Berardi AM, Segebarth CM, Boussaoud D. 2002. Spatial attention and memory versus motor preparation: premotor cortex involvement as revealed by fMRI. J Neurophysiol 88:2047-2057.
68. Soto-Faraco S, Lyons J, Gazzaniga M, Spence C, Kingstone A. 2002. The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. Cogn Brain Res 14:139-146.
69. Soto-Faraco S, Spence C, Kingstone A. 2004. Cross-modal dynamic capture: congruence effects in the perception of motion across sensory modalities. J Exp Psychol Hum Percept Perform 30:330-345.
70. Spitzer H, Desimone R, Moran J. 1988. Increased attention enhances both behavioral and neuronal performance. Science 240:338-340.
71. Stein BE, Meredith MA. 1993. The merging of the senses. Cambridge, MA: MIT Press.
72. Van Essen DC. 2002. Windows on the brain: the emerging role of atlases and databases in neuroscience. Curr Opin Neurobiol 12:574-579.
73. Van Essen DC, Drury HA, Dickson J, Harwell J, Hanlon D, Anderson CH. 2001. An integrated software suite for surface-based analyses of cerebral cortex. J Am Med Inform Assoc 8:443-459.
74. von Grunau MW, Bertone A, Pakneshan P. 1998. Attentional selection of motion states. Spat Vis 11:329-347.
75. Wagner H, Kautz D, Poganiatz I. 1997. Principles of acoustic motion detection in animals and man. Trends Neurosci 20:583-588.
76. Wickens TD. 2001. Elementary signal detection theory. Oxford, England: Oxford University Press.