Effect of auditory input on activations in infant diverse cortical regions during audiovisual processing

Human Brain Mapping

Volumn 34, Issue 3, 2013, Pages 543-565

  Watanabe, Hama ^a   Homae, Fumitaka ^b   Nakano, Tamami ^c   Tsuzuki, Daisuke ^d   Enkhtur, Lkhamsuren ^e   Nemoto, Kiyotaka ^e   Dan, Ippeita ^d   Taga, Gentaro ^a,f  

^a UNIVERSITY OF TOKYO   (Japan)

^b TOKYO METROPOLITAN UNIVERSITY   (Japan)

^c JUNTENDO UNIVERSITY   (Japan)

^d JICHI MEDICAL UNIVERSITY   (Japan)

^e UNIVERSITY OF TSUKUBA   (Japan)

^f JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

Activation; Audio visual processing; Cortical development; Deactivation; Hemodynamics; Multisensory perception; Near infrared spectroscopy

Indexed keywords

ARTICLE; AUDITORY STIMULATION; BRAIN DEVELOPMENT; FEMALE; HEMODYNAMICS; HUMAN; INFANT; MALE; MENTAL FUNCTION; PARIETAL CORTEX; PREFRONTAL CORTEX; PRIORITY JOURNAL; SENSORY STIMULATION; SIGNAL PROCESSING; SPATIOTEMPORAL ANALYSIS; TEMPORAL CORTEX; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; AUDITORY PATHWAYS; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; FEMALE; HUMANS; INFANT; MALE; OXYHEMOGLOBINS; PHOTIC STIMULATION; SOUND; SPECTROSCOPY, NEAR-INFRARED; TIME FACTORS; VISUAL PERCEPTION; WAKEFULNESS;

EID: 84873421308     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.21453     Document Type: Article

References (114)

1. Adolphs R ( 2001): The neurobiology of social cognition. Curr Opin Neurobiol 11: 231-239.
2. Adolphs R ( 2003): Cognitive neuroscience of human social behavior. Nat Rev Neurosci 4: 165-178.
3. Allman BL, Meredith MA ( 2007): Multisensory processing in "unimodal" neurons: Cross-modal subthreshold auditory effects in cat extrastriate visual cortex. J Neurophysiol 98: 545-549.
4. Alpert GF, Hein G, Tsai N, Naumer MS, Knight RT ( 2008): Temporal characteristics of audiovisual information processing. J Neurosci 28: 5344-5349.
5. Altaye M, Holland SK, Wilke M, Gaser C ( 2008): Infant brain probability templates for MRI segmentation and normalization. Neuroimage 43: 721-730.
6. Amedi A, Jacobson G, Hendler T, Malach R. Zohary E ( 2002): Convergence of visual and tactile shape processing in the human lateral occipital complex. Cereb Cortex 12: 1202-1212.
7. Amedi A, von Kriegstein K, van Atteveldt NM, Beauchamp MS, Naumer MJ ( 2005): Functional imaging of human crossmodal identification and object recognition. Exp Brain Res 166: 559-571.
8. Anderson AK, Christoff K, Stappen I, Paints D, Ghahremani DG, Glover G, Gabrieli JD, Sobel N ( 2003): Dissociated neural representations of intensity and valence in human olfaction. Nat Neurosci 6: 196-202.
9. Bahrick LE ( 1992): Infants' perceptual differentiation of amodal and modality-specific audio-visual relations. J Exp Child Psychol 53: 180-199.
10. Bahrick LE, Lickliter R ( 2000): Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Dev Psychol 36: 190-201.
11. Bahrick LE, Lickliter R ( 2004): Infants' perception of rhythm and tempo in unimodal and multimodal stimulation: A developmental test of the intersensory redundancy hypothesis. Cogn Affect Behav Neurosci 4: 137-147.
12. Batschelet E ( 1981): Circular Statistics in Biology. London: Academic Press.
13. Beauchamp MS ( 2005): See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex. Curr Opin Neurobiol 15: 145-153.
14. Beauchamp MS, Lee KE, Haxby JV, Martin A ( 2002): Parallel visual motion processing streams for manipulable objects and human movements. Neuron 34: 149-159.
15. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A ( 2004a): Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nat Neurosci 7: 1190-1192.
16. Beauchamp MS, Lee KE, Argall BD, Martin A ( 2004b): Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41: 809-823.
17. Benjamini Y, Hochberg Y ( 1995): Controlling the false discovery rate: A practical and powerful approach to multiple testing. J R Stat Soc Ser B 57: 289-300.
18. Benjamini Y, Krieger AM, Yekutieli D ( 2006): Adaptive liner step-up procedures that control the false discovery rate. Biometrika 93: 491-507.
19. Blair RJR, Morris JS, Frith CD, Perrett DL, Dolan RJ ( 1999): Dissociable neural responses to facial expressions of sadness and anger. Brain 122: 883-893.
20. Blasi A, Fox S, Everdell N, Volein A, Tucker L ( 2007): Investigation of depth dependent changes in cerebral haemodynamics during face perception in infants. Phys Med Biol 52: 6849-6864.
21. Blood AJ, Zatorre RJ, Bermudez P, Evans AC ( 1999): Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat Neurosci 2: 382-387.
22. Bortfeld H, Wruck E, Boas DA ( 2007): Assessing infants' cortical response to speech using near-infrared spectroscopy. Neuroimage 34: 407-415.
23. Brett M, Johnsrude IS, Owen AM ( 2002): The problem of functional localization in the human brain. Nat Rev Neurosci 3: 243-249.
24. Burgund ED, Kang HC, Kelly JE, Buckner RL, Snyder AZ, Petersen SE, Schlaggar BL ( 2002): The feasibility of a common stereotactic space for children and adults in fMRI studies of development. Neuroimage 17: 184-200.
25. Calvert GA ( 2001): Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cereb Cortex 11: 1110-1123.
26. Calvert GA, Brammer MJ, Bullmore ET, Campbell R, Iversen SD, David AS ( 1999): Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10: 2619-2623.
27. Castillo M, Butterworth GE ( 1981): Neonatal localisation of a sound in visual space. Perception 10: 331-338.
28. Colombo J ( 2001): The development of visual attention in infancy. Annu Rev Psychol 52: 337-367.
29. Csibra G, Henty J, Volein A, Elwell C, Tucker L, Meek J, Johnson MH ( 2004): Near infrared spectroscopy reveals neural activation during face perception in infants and adults. J Pediatr Neurol 2: 85-89.
30. Dehaene-Lambertz G, Hertz-Pannier L, Dubois J, Mériaux S, Roche A, Sigman M, Dehaene S ( 2006): Functional organization of perisylvian activation during presentation of sentences in preverbal infants. Proc Natl Acad Sci USA 103: 14240-14245.
31. Devor A, Tian P, Nishimura NI, Teng C, Hillman EMC, Narayanan SN, Ulbert I, Boas DA, Kleinfeld D, Dale AM ( 2007): Suppressed neuronal activity and concurrent arteriolar vasoconstriction may explain negative blood oxygenation level-dependent signal. J Neurosci 27: 4452-4459.
32. Dodd B ( 1979): Lip reading in infants: Attention to speech presented in- and out-of-synchrony. Cogn Psychol 11: 478-484.
33. Driver J, Noesselt T ( 2008): Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57: 11-23.
34. Genovese CR, Lazar NA, Nichols T ( 2002): Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 15: 870-878.
35. Gervain J, Macagno F, Cogoi S, Peña M, Mehler M ( 2008): The neonate brain detects speech structure. Proc Natl Acad Sci USA 105: 14222-14227.
36. Giard MH, Peronnet F ( 1999): Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. J Cogn Neurosci 11: 473-490.
37. Grill-Spector K, Malach R ( 2004): The human visual cortex. Annu Rev Neurosci 27: 649-677.
38. Grill-Spector K, Kushnir T, Edelman S, Itzchak Y, Malach R ( 1998): Cue-invariant activation in object-related areas of the human occipital lobe. Neuron 21: 191-202.
39. Henson RNA, Price CJ, Rugg MD, Turner R, Friston KJ ( 2002): Detecting latency differences in event-related BOLD responses: Application to words versus nonwords and initial versus repeated face presentations. Neuroimage 15: 83-97.
40. Hill J, Dierker D, Neil J, Inder T, Knutsen A, Harwell J, Coalson T, van Essen D ( 2010): A surface-based analysis of hemispheric asymmetries and folding of cerebral cortex in term-born human infants. J Neurosci 30: 2268-2276.
41. Homae F, Watanabe H, Nakano T, Asakawa K, Taga G ( 2006): The right hemisphere of sleeping infant perceives sentential prosody. Neurosci Res 54: 276-280.
42. Homae F, Watanabe H, Nakano T, Taga G ( 2007): Prosodic processing in the developing brain. Neurosci Res 59: 29-39.
43. Homae F, Watanabe H, Otobe T, Nakano T, Go T, Konishi Y, Taga G ( 2010): Development of global cortical networks in early infancy. J Neurosci 30: 4877-4882.
44. Jurcak V, Okamoto M, Singh A, Dan I ( 2005): Virtual 10-20 measurement on MR images for inter-modal linking of transcranial and tomographic neuroimaging methods. Neuroimage 26: 1184-1192.
45. Kanwisher N, Wojciulik E ( 2000): Visual attention: Insights from brain imaging. Nat Rev Neurosci 1: 91-100.
46. Kanwisher N, Chun MM, McDermott J, Ledden PJ ( 1996): Functional imaging of human visual recognition. Cogn Brain Res 5: 55-67.
47. Kawabata H, Zeki S ( 2004): Neural correlates of beauty. J Neurophysiol 91: 1699-1705.
48. Kayser C, Petkov C, Augath M, Logothetis NK ( 2007): Functional imaging reveals visual modulation of specific field in auditory cortex. J Neurosci 27: 1824-1835.
49. Kourtzi Z, Kanwisher N ( 2001): Representation of perceived object shape by the human lateral occipital complex. Science 24: 1506-1509.
50. Kraemer DM, Macrae CN, Green AE, Kelley WM ( 2005): Sound of silence activates auditory cortex. Nature 434: 158.
51. Larsson J, Heeger DJ ( 2006): Two retinotopic visual areas in human lateral occipital cortex. J Neurosci 26: 13128-13142.
52. Laurienti PJ, Burdette JH, Wallance MT, Yen YF, Field AS, Stein BE ( 2002): Deactivation of sensory-specific cortex by cross-modal stimuli. J Cogn Neurosci 14: 420-429.
53. Lehmann C, Herdener M, Esposito F, Hubl D, Disalle F, Scheffler K, Bach D, Federspiel A, Kretz R, Dierks T ( 2006): Differential patterns of multisensory interactions in core and belt areas of human auditory cortex. Neuroimage 31: 294-300.
54. Lewkowicz DJ ( 1992): Infants' response to temporally based intersensory equivalence: The effect of synchronous sounds on visual preferences for moving stimuli. Infant Behav Dev 15: 297-324.
55. Lewkowicz DJ ( 1996): Perception of auditory-visual temporal synchrony in human infants. J Exp Psychol Hum Percept Perform 22: 1094-1106.
56. Lewkowicz DJ ( 2000): Perceptual development: Visual, auditory, and speech perception in infancy. America J Psychol 113: 488-500.
57. Lewkowicz DJ ( 2002): Heterogeneity and heterochrony in the development of intersensory perception. Cogn Brain Res 14: 41-63.
58. Lickliter R, Bahrick LE ( 2000): The development of infant intersensory perception: Advantages of comparative convergent-operations approach. Psychol Bull 126: 260-280.
59. Macaluso E ( 2006): Multisensory processing in sensory-specific cortical areas. Neuroscientist 12: 327-338.
60. Maki A, Yamashita Y, Watanabe E, Miyanagi Y, Koizumi H ( 1995): Spatial and temporal analysis of human motor activity using noninvasive NIR topography. Med Phys 22: 1997-2005.
61. Malach R, Peppas JB, Benson RR, Kwong KK, Jiang H, Kennedy WA, Ledden PJ, Brady TJ, Rosen BR, Tootell RBH ( 1995): Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci USA 92: 8135-8139.
62. Marois R, Leung HC, Gore JC ( 2000): A stimulus-driven approach to object identity and location processing in the human brain. Neuron 25: 717-728.
63. Martuzzi R, Murray MM, Michel CM, Thiran JP, Maeder PP, Clarke S, Meuli RA ( 2007): Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb Cortex 17: 1672-1679.
64. Meek JH, Firmank M, Elwell CE, Atkinson J, Braddick O, Wyatt JS ( 1998): Regional hemodynamic responses to visual stimulation in awake infants. Pediatr Res 43: 840-843.
65. Miller EK ( 2000): The prefrontal cortex and cognitive control. Nat Rev Neurosci 1: 59-65.
66. Minagawa-Kawai Y, Mori K, Naoi N, Kojima S ( 2007): Neural attunement processes in infants during the acquisition of a language-specific phonemic contrast. J Neurosci 27: 315-321.
67. Minagawa-Kawai Y, Matsuoka S, Dan I, Naoi N, Nakamura K, Kojima S ( 2009): Prefrontal activation associated with social attachment: Facial-emotion recognition in mothers and infants. Cereb Cortex 19: 284-292.
68. Munoz DP, Everling S ( 2004): Look away: The anti-saccade task and the voluntary control of eye movement. Nat Rev Neurosci 5: 218-228.
69. Nakano T, Homae F, Watanabe H, Taga G ( 2008): Anticipatory cortical activation precedes auditory events in sleeping infants. PLoS ONE 3: e3912.
70. Nakano T, Watanabe H, Homae F, Taga G ( 2009): Prefrontal cortical involvement in young infants' analysis of novelty. Cereb Cortex 19: 455-463.
71. Neil PA, Chee-Ruiter C, Scheier C, Lewkowicz DJ, Shimojo S ( 2006): Development of multisensory spatial integration and perception in humans. Dev Sci 9: 454-464.
72. Noesselt T, Hillyard SA, Woldorff MG, Schoenfeld A, Hagner T, Jäncke L, Tempelmann C, Hinrichs H, Heinze HJ ( 2002): Delayed striate cortical activation during spatial attention. Neuron 35: 575-587.
73. Noesselt T, Rieger JW, Schoenfeld MA, Kanowski M, Hinrichs H, Heinze H, Driver J ( 2007): Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J Neurosci 27: 11431-11441.
74. Obrig H, Wenzel R, Kohl M, Horst S, Wobst P, Steinbrink J, Thomas F, Villringer A ( 2000): Near-infrared spectroscopy: Does it function in functional activation studies of the adult brain? Int J Psychophysiol 35: 125-142.
75. Okamoto M, Dan I ( 2005): Automated cortical projection of head-surface locations for transcranial functional brain mapping. Neuroimage 26: 18-28.
76. Okamoto M, Dan H, Sakamoto K, Takeo K, Shimizu K, Kohno S, Oda I, Isobe S, Suzuki T, Kohyama K, Dan I ( 2004): Three-dimensional probabilistic anatomical cranio-cerebral correlation via the international 10-20 system oriented for transcranial functional brain mapping. Neuroimage 21: 99-111.
77. Otsuka Y, Nakato E, Kanazawa S, Yamaguchi MK, Watanabe S, Kakigi R ( 2007): Neural activation to upright and inverted faces in infants measured by near infrared spectroscopy. Neuroimage 34: 399-406.
78. Peña M, Maki A, Kovacic D, Dehaene-Lambertz G, Koizumi H, Bouquet F, Mehler J ( 2003): Sounds and silence: An optical topography study of language recognition at birth. Proc Natl Acad Sci USA 100: 11702-11705.
79. Pierrot-Deseilligny C, Milea D, Müri RM ( 2004): Eye movement control by the cerebral cortex. Curr Opin Neurol 17: 17-25.
80. Prechtl HFR, Hopkins B ( 1986): Developmental transformations of spontaneous movements in early infancy. Early Hum Dev 14: 233-238.
81. Rauschecker J, Tian B ( 2000): Mechanisms and streams for processing of "what" and "where" in auditory cortex. Proc Natl Acad Sci USA 97: 11800-11806.
82. Raz A, Buhle J ( 2006): Typologies of attentional networks. Nat Rev Neurosci 7: 367-379.
83. Reynolds EO, Wyatt JS, Azzopardi D, Delpy DT, Cady EB, Cope M, Wray S ( 1988): New non-invasive methods for assessing brain oxygenation and haemodynamics. Br Med Bull 44: 1052-1075.
84. Rockland KS, Ojima H ( 2003): Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50: 19-26.
85. Scheier C, Lewkowicz D, Shimojyo S ( 2003): Sound induces perceptual reorganization of an ambiguous motion display in human infants. Dev Sci 6: 233-244.
86. Seifritz E, Esposito F, Hennel F, Mustovic H, Neuhoff JG, Bilecen D, Tedeschi G, Scheffler K, Salle FD ( 2002): Spatiotemporal pattern of neural processing in the human auditory cortex. Science 297: 1706-1708.
87. Senkowski D, Schneider TR, Foxe JJ, Engel A ( 2008): Crossmodal binding through neural coherence: Implication for multisensory processing. Trends Neurosci 31: 401-409.
88. Shi F, Yap P-T, Wu G, Jia H, Gilmore JH, Lin W, Shen D ( 2011): Infant brain atlases from neonates to 1- and 2-year-olds. PLoS ONE 6: e18746.
89. Shmuel A, Yacoub E, Pfeuffer J, Van de Moortele PF, Adriany G, Hu X, Ugurbil K ( 2002): Sustained negative BOLD, blood flow and oxygen consumption response and its coupling to the positive response in the human brain. Neuron 36: 1195-1210.
90. Shmuel A, Augath M, Oeltermann A, Logothetis NK ( 2006): Negative functional MRI response correlates with decreases in neuronal activity in monkey visual area V1. Nat Neurosci 9: 569-577.
91. Singh AK, Dan I ( 2006): Exploring the false discovery rate in multichannel NIRS. Neuroimage 33: 542-549.
92. Singh AK, Okamoto M, Dan H, Jurcak V, Dan I ( 2005): Spatial registration of multichannel multi-subject fNIRS data to MNI space without MRI. Neuroimage 27: 842-851.
93. Smith AT, Williams AL, Singh KD ( 2004): Negative BOLD in the visual cortex: Evidence against blood stealing. Hum Brain Mapp 21: 213-220.
94. Spelke ES ( 1976): Infants' intermodal perception of events. Cogn Psychol 8: 533-560.
95. Spelke ES, Born WS, Chu F ( 1983): Perception of moving, sounding objects by four-month-old infants. Perception 12: 719-732.
96. Sridharan D, Levitin D, Chafe C, Berger J ( 2007): Neural dynamics of event segmentation in music: Converging evidence for dissociable ventral and dorsal networks. Neuron 55: 521-532.
97. Stein BE, Stanford TR ( 2008): Multisensory integration: Current issues from the perspective of the single neuron. Nat Rev Neurosci 9: 255-266.
98. Stricanne B, Andersen RA, Mazzoni P ( 1996): Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. J Neurophysiol 76: 2071-2076.
99. Taga G, Asakawa K ( 2007): Selectivity and localization of cortical response to auditory and visual stimulation in awake infants aged 2 to 4 months. Neuroimage 36: 1246-1252.
100. Taga G, Asakawa K, Maki A, Konishi Y, Koizumi H ( 2003). Brain imaging in awake infants by near-infrared optical topography. Proc Natl Acad Sci USA 100: 10722-10727.
101. Taga G, Homae F, Watanabe H ( 2007): Effects of source-detector distance of near infrared spectroscopy on the measurement of the cortical hemodynamic response in infants. Neuroimage 38: 452-460.
102. Tootell RBH, Hadjikhani N ( 2001): Where is 'dorsal V4' in human visual cortex? Retinotopic, topographic and functional evidence. Cereb Cortex 11: 298-311.
103. Tsuzuki D, Jurcak V, Singh AK, Okamoto M, Watanabe E, Dan I ( 2007): Virtual spatial registration of stand-alone fNIRS data to MNI space. Neuroimage 34: 1506-1518.
104. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M ( 2002): Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15: 273-289.
105. Villringer A, Chance B ( 1997): Non-invasive optical spectroscopy and imaging of human brain function. Trends Neurosci 20: 435-442.
106. Voisin J, Bidet-Caulet A, Bertrand O, Fonlupt P ( 2006): Listening in silence activates auditory areas: A functional magnetic response imaging study. J Neurosci 26: 273-278.
107. Watanabe H, Taga G ( 2006): General to specific development of movement patterns and memory for contingency between action and events in young infants. Infant Behav Dev 29: 402-422.
108. Watanabe H, Taga G ( 2009): Flexibility in infant actions during arm- and leg-based learning in a mobile paradigm. Infant Behav Dev 32: 79-90.
109. Watanabe H, Homae F, Nakano T, Taga G ( 2008): Functional activation in diverse regions of the developing brain of the human infant. Neuroimage 43: 346-357.
110. Watanabe H, Homae F, Taga G ( 2010): General to specific development of functional activation in the cerebral cortexes of 2- to 3-month-old infants. Neuroimage 50: 1536-1544.
111. Weissman DH, Woldrff MG ( 2005): Hemispheric asymmetries for different components of global/local attention occur in distinct temporal-parietal loci. Cereb Cortex 15: 870-876.
112. Wilcox T, Bortfeld H, Woods R, Wruck E, Boas DA ( 2005): Using near-infrared spectroscopy to assess neural activation during object processing in infants. J Biomed Opt 10: 11010.
113. Wood JN, Grafman J ( 2003): Human prefrontal cortex: Processing and representational perspectives. Nat Rev Neurosci 4: 139-147.
114. Zatorre RJ, Bouffard M, Ahad P, Belin P ( 2002): Where is 'where' in the human auditory cortex. Nat Neurosci 5: 905-909.