메뉴 건너뛰기




Volumn 213, Issue 2-3, 2011, Pages 309-320

Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools

Author keywords

Crossmodal; Functional connectivity; Functional magnetic resonance imaging; Independent component analysis; Jasper van den Bosch and Michael WibraCrossmodal; Multisensory; Object perception; Object perception The authors Marcus J. Naumer

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY DISCRIMINATION; BRAIN CORTEX; BRAIN FUNCTION; BRAIN MAPPING; EXPERIMENT; FEMALE; FRONTAL LOBE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; HYPOTHESIS; INDEPENDENT COMPONENT ANALYSIS; INTERMETHOD COMPARISON; MALE; NEUROIMAGING; NORMAL HUMAN; OCCIPITAL LOBE; PARIETAL LOBE; PATTERN RECOGNITION; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; SENSORY ANALYSIS; SPATIAL DISCRIMINATION; STATISTICAL MODEL; STIMULUS; TEMPORAL LOBE; VISUAL DISCRIMINATION; VISUAL STIMULATION; VISUAL THRESHOLD;

EID: 85027957606     PISSN: 00144819     EISSN: 14321106     Source Type: Journal    
DOI: 10.1007/s00221-011-2669-0     Document Type: Article
Times cited : (9)

References (60)
  • 2
    • 69449087069 scopus 로고    scopus 로고
    • Multisensory integration: Psychophysics, neurophysiology, and computation
    • Angelaki DE, Gu Y, DeAngelis GC (2009) Multisensory integration: Psychophysics, neurophysiology, and computation. Curr Opin Neurobiol 19:452-458
    • (2009) Curr Opin Neurobiol , vol.19 , pp. 452-458
    • Angelaki, D.E.1    Gu, Y.2    DeAngelis, G.C.3
  • 3
    • 33751311989 scopus 로고    scopus 로고
    • Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information
    • Baier B, Kleinschmidt A, Müller NG (2006) Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information. J Neurosci 26:12260
    • (2006) J Neurosci , vol.26 , pp. 12260
    • Baier, B.1    Kleinschmidt, A.2    Müller, N.G.3
  • 4
    • 21244470358 scopus 로고    scopus 로고
    • The chronoarchitecture of the cerebral cortex
    • Bartels A, Zeki S (2005) The chronoarchitecture of the cerebral cortex. Phil Trans R Soc B Biol Sci 360:733
    • (2005) Phil Trans R Soc B Biol Sci , vol.360 , pp. 733
    • Bartels, A.1    Zeki, S.2
  • 5
    • 20544448036 scopus 로고    scopus 로고
    • See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex
    • Beauchamp MS (2005a) See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex. Curr Opin Neurobiol 15:145
    • (2005) Curr Opin Neurobiol , vol.15 , pp. 145
    • Beauchamp, M.S.1
  • 6
    • 21344455127 scopus 로고    scopus 로고
    • Statistical criteria in fMRI studies of multisensory integration
    • DOI 10.1385/NI:03:02:93
    • Beauchamp MS (2005b) Statistical criteria in fMRI studies of multisensory integration. Neuroinformatics 3:93-113 (Pubitemid 40905175)
    • (2005) Neuroinformatics , vol.3 , Issue.2 , pp. 93-113
    • Beauchamp, M.S.1
  • 7
    • 1542268973 scopus 로고    scopus 로고
    • Integration of auditory and visual information about objects in superior temporal sulcus
    • DOI 10.1016/S0896-6273(04)00070-4, PII S0896627304000704
    • Beauchamp MS, Lee KE, Argall BD, Martin A (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41(5):809-823 (Pubitemid 38326842)
    • (2004) Neuron , vol.41 , Issue.5 , pp. 809-823
    • Beauchamp, M.S.1    Lee, K.E.2    Argall, B.D.3    Martin, A.4
  • 9
    • 0029411030 scopus 로고
    • An information-maximization approach to blind separation and blind deconvolution
    • Bell AJ, Sejnowski TJ (1995) An information-maximization approach to blind separation and blind deconvolution. Neural Comput 7:1129-1159
    • (1995) Neural Comput , vol.7 , pp. 1129-1159
    • Bell, A.J.1    Sejnowski, T.J.2
  • 10
    • 0029999731 scopus 로고    scopus 로고
    • Linear systems analysis of functional magnetic resonance imaging in human V1
    • Boynton GM, Engel SA, Glover GH, Heeger DJ (1996) Linear systems analysis of functional magnetic resonance imaging in human V1. J Neurosci 16:4207-4221 (Pubitemid 26192416)
    • (1996) Journal of Neuroscience , vol.16 , Issue.13 , pp. 4207-4221
    • Boynton, G.M.1    Engel, S.A.2    Glover, G.H.3    Heeger, D.J.4
  • 11
    • 0035033714 scopus 로고    scopus 로고
    • Spatial and temporal independent component analysis of functional MRI data containing a pair of task-related waveforms
    • DOI 10.1002/hbm.1024
    • Calhoun VD, Adali T, Pearlson GD, Pekar JJ (2001) Spatial and temporal independent component analysis of functional MRI data containing a pair of task-related wave-forms. Hum Brain Mapp 13:43-53 (Pubitemid 32374513)
    • (2001) Human Brain Mapping , vol.13 , Issue.1 , pp. 43-53
    • Calhoun, V.D.1    Adali, T.2    Pearlson, G.D.3    Pekar, J.J.4
  • 12
    • 10644246948 scopus 로고    scopus 로고
    • A method for comparing group fMRI data using independent component analysis: Application to visual, motor and visuomotor tasks
    • DOI 10.1016/j.mri.2004.09.004, PII S0730725X04002772
    • Calhoun V, Adali T, Pekar J (2004) A method for comparing group fMRI data using independent component analysis: Application to visual, motor and visuomotor tasks. Magn Reson Imaging 22(9):1181-1191 (Pubitemid 39647716)
    • (2004) Magnetic Resonance Imaging , vol.22 , Issue.9 , pp. 1181-1191
    • Calhoun, V.D.1    Adali, T.2    Pekar, J.J.3
  • 13
    • 0035186436 scopus 로고    scopus 로고
    • Crossmodal processing in the human brain: Insights from functional neuroimaging studies
    • Calvert G (2001) Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cereb Cortex 11:1110-1123 (Pubitemid 33108238)
    • (2001) Cerebral Cortex , vol.11 , Issue.12 , pp. 1110-1123
    • Calvert, G.A.1
  • 15
    • 55549137386 scopus 로고    scopus 로고
    • Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration
    • Doehrmann O, Naumer MJ (2008) Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration. Brain Res 1242:136-150
    • (2008) Brain Res , vol.1242 , pp. 136-150
    • Doehrmann, O.1    Naumer, M.J.2
  • 16
    • 77749341543 scopus 로고    scopus 로고
    • Audio-visual fMRI adaptation reveals multisensory integration effects in object-related sensory cortices
    • Doehrmann O, Weigelt S, Altmann CF, Kaiser J, Naumer MJ (2010) Audio-visual fMRI adaptation reveals multisensory integration effects in object-related sensory cortices. J Neurosci 30:3370-3379
    • (2010) J Neurosci , vol.30 , pp. 3370-3379
    • Doehrmann, O.1    Weigelt, S.2    Altmann, C.F.3    Kaiser, J.4    Naumer, M.J.5
  • 17
    • 37549045258 scopus 로고    scopus 로고
    • Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments
    • Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57:11
    • (2008) Neuron , vol.57 , pp. 11
    • Driver, J.1    Noesselt, T.2
  • 18
    • 44949223465 scopus 로고    scopus 로고
    • A cross-modal system linking primary auditory and visual cortices: Evidence from intrinsic fMRI connectivity analysis
    • DOI 10.1002/hbm.20560
    • Eckert MA, Kamdar NV, Chang CE, Beckmann CF, Greicius MD, Menon V (2008) A cross-modal system linking primary auditory and visual cortices: Evidence from intrinsic fMRI connectivity analysis. Hum Brain Mapp 29:848-857 (Pubitemid 351813086)
    • (2008) Human Brain Mapping , vol.29 , Issue.7 , pp. 848-857
    • Eckert, M.A.1    Kamdar, N.V.2    Chang, C.E.3    Beckmann, C.F.4    Greicius, M.D.5    Menon, V.6
  • 20
    • 0028946011 scopus 로고
    • Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a clustersize threshold
    • Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC (1995) Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a clustersize threshold. Magn Reson Med 33:636-647
    • (1995) Magn Reson Med , vol.33 , pp. 636-647
    • Forman, S.D.1    Cohen, J.D.2    Fitzgerald, M.3    Eddy, W.F.4    Mintun, M.A.5    Noll, D.C.6
  • 23
    • 33745044194 scopus 로고    scopus 로고
    • Is neocortex essentially multisensory?
    • Ghazanfar A, Schroeder C (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10:278
    • (2006) Trends Cogn Sci , vol.10 , pp. 278
    • Ghazanfar, A.1    Schroeder, C.2
  • 25
    • 34547453628 scopus 로고    scopus 로고
    • Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas
    • DOI 10.1523/JNEUROSCI.1740-07.2007
    • Hein G, Doehrmann O, Müller NG, Kaiser J, Muckli L, Naumer MJ (2007) Object familiarity and semantic congruency modulate responses in cortical audio-visual integration areas. J Neurosci 27:7881-7887 (Pubitemid 47173312)
    • (2007) Journal of Neuroscience , vol.27 , Issue.30 , pp. 7881-7887
    • Hein, G.1    Doehrmann, O.2    Muller, N.G.3    Kaiser, J.4    Muckli, L.5    Naumer, M.J.6
  • 26
    • 3042594840 scopus 로고    scopus 로고
    • Validating the independent components of neuroimaging time series via clustering and visualization
    • DOI 10.1016/j.neuroimage.2004.03.027, PII S1053811904001661
    • Himberg J, Hyvärinen A, Esposito F (2004) Validating the independent components of neuroimaging time series via clustering and visualization. NeuroImage 22:1214-1222 (Pubitemid 38829210)
    • (2004) NeuroImage , vol.22 , Issue.3 , pp. 1214-1222
    • Himberg, J.1    Hyvarinen, A.2    Esposito, F.3
  • 27
    • 55549088637 scopus 로고    scopus 로고
    • The role of the posterior superior temporal sulcus in audiovisual processing
    • Hocking J, Price CJ (2008) The role of the posterior superior temporal sulcus in audiovisual processing. Cereb Cortex 18:2439-2449
    • (2008) Cereb Cortex , vol.18 , pp. 2439-2449
    • Hocking, J.1    Price, C.J.2
  • 28
    • 85027957606 scopus 로고    scopus 로고
    • 319
    • Exp Brain Res (2011) 213:309-320 319
    • (2011) Exp Brain Res , vol.213 , pp. 309-320
  • 29
    • 0032629347 scopus 로고    scopus 로고
    • Fast and robust fixed-point algorithms for independent component analysis
    • Hyvärinen A (1999) Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans Neural Netw 10:626-634
    • (1999) IEEE Trans Neural Netw , vol.10 , pp. 626-634
    • Hyvärinen, A.1
  • 30
    • 34548575471 scopus 로고    scopus 로고
    • Do early sensory cortices integrate cross-modal information?
    • Kayser C, Logothetis NK (2007) Do early sensory cortices integrate cross-modal information? Brain Struct Funct 212:121
    • (2007) Brain Struct Funct , vol.212 , pp. 121
    • Kayser, C.1    Logothetis, N.K.2
  • 31
    • 79957959255 scopus 로고    scopus 로고
    • Audio-visual perception of everyday natural objects-Hemodynamic studies in humans
    • In: Naumer MJ, Kaiser J (eds) Springer, New York
    • Lewis JW (2010) Audio-visual perception of everyday natural objects-Hemodynamic studies in humans. In: Naumer MJ, Kaiser J (eds) Multisensory object perception in the primate brain. Springer, New York, pp 155-190
    • (2010) Multisensory object perception in the primate brain , pp. 155-190
    • Lewis, J.W.1
  • 32
    • 33744955456 scopus 로고    scopus 로고
    • Isolation and minimization of head motion-induced signal variations in fMRI data using independent component analysis
    • DOI 10.1002/mrm.20893
    • Liao R, McKeown MJ, Krolik JL (2006) Isolation and minimization of head motion-induced signal variations in fMRI data using independent component analysis. Magn Reson Med 55:1396-1413 (Pubitemid 43856778)
    • (2006) Magnetic Resonance in Medicine , vol.55 , Issue.6 , pp. 1396-1413
    • Liao, R.1    McKeown, M.J.2    Krolik, J.L.3
  • 33
    • 33745892399 scopus 로고    scopus 로고
    • Multisensory processing in sensory-specific cortical areas
    • Macaluso E (2006) Multisensory processing in sensory-specific cortical areas. Neuroscientist 12:327
    • (2006) Neuroscientist , vol.12 , pp. 327
    • Macaluso, E.1
  • 34
    • 33846976193 scopus 로고    scopus 로고
    • Towards natural stimulation in fMRI-issues of data analysis
    • Malinen S, Hlushchuk Y, Hari R (2007) Towards natural stimulation in fMRI-issues of data analysis. NeuroImage 35:131
    • (2007) NeuroImage , vol.35 , pp. 131
    • Malinen, S.1    Hlushchuk, Y.2    Hari, R.3
  • 38
    • 84858278379 scopus 로고    scopus 로고
    • Interactions between auditory and visual semantic stimulus classes: Evidence for common processing networks for speech and body actions
    • In press
    • Meyer GF, Wuerger S, Greenlee M (In press) Interactions between auditory and visual semantic stimulus classes: Evidence for common processing networks for speech and body actions. J Cogn Neurosci
    • J Cogn Neurosci
    • Meyer, G.F.1    Wuerger, S.2    Greenlee, M.3
  • 39
    • 0037305179 scopus 로고    scopus 로고
    • Power spectrum ranked independent component analysis of a periodic fMRI complex motor paradigm
    • DOI 10.1002/hbm.10081
    • Moritz CH, Rogers BP, Meyerand ME (2003) Power spectrum ranked independent component analysis of a periodic fMRI complex motor paradigm. Hum Brain Mapp 18(2):111-122 Naumer MJ, Kaiser J (eds) (2010) Multisensory object perception in the primate brain. Springer, New York (Pubitemid 36150931)
    • (2003) Human Brain Mapping , vol.18 , Issue.2 , pp. 111-122
    • Moritz, C.H.1    Rogers, B.P.2    Meyerand, M.E.3
  • 42
    • 35448976795 scopus 로고    scopus 로고
    • Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices
    • DOI 10.1523/JNEUROSCI.2252-07.2007
    • Noesselt T, Rieder JW, Schoenfeld MA, Kanowski M, Hinrichs H, Heinze HJ, Driver J (2007) Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J Neurosci 27:11431-11441 (Pubitemid 47621322)
    • (2007) Journal of Neuroscience , vol.27 , Issue.42 , pp. 11431-11441
    • Noesselt, T.1    Rieger, J.W.2    Schoenfeld, M.A.3    Kanowski, M.4    Hinrichs, H.5    Heinze, H.-J.6    Driver, J.7
  • 43
    • 39349083875 scopus 로고    scopus 로고
    • The effect of prior visual information on recognition of speech and sounds
    • DOI 10.1093/cercor/bhm091
    • Noppeney U, Josephs O, Hocking J, Price CJ, Friston KJ (2008) The effect of prior visual information on recognition of speech and sounds. Cereb Cortex 18:598-609 (Pubitemid 351264229)
    • (2008) Cerebral Cortex , vol.18 , Issue.3 , pp. 598-609
    • Noppeney, U.1    Josephs, O.2    Hocking, J.3    Price, C.J.4    Friston, K.J.5
  • 44
    • 77953078834 scopus 로고    scopus 로고
    • Perceptual decisions formed by accumulation of audiovisual evidence in prefrontal cortex
    • Noppeney U, Ostwald D, Werner S (2010) Perceptual decisions formed by accumulation of audiovisual evidence in prefrontal cortex. J Neurosci 30:7434-7446
    • (2010) J Neurosci , vol.30 , pp. 7434-7446
    • Noppeney, U.1    Ostwald, D.2    Werner, S.3
  • 46
    • 34548047531 scopus 로고    scopus 로고
    • Assessing functional connectivity in the human brain by fMRI
    • DOI 10.1016/j.mri.2007.03.007, PII S0730725X07002238
    • Rogers BP, Morgan VL, Newton AT, Gore JC (2007) Assessing functional connectivity in the human brain by fMRI. Magn Reson Imaging 25:1347-1357 (Pubitemid 350122908)
    • (2007) Magnetic Resonance Imaging , vol.25 , Issue.10 , pp. 1347-1357
    • Rogers, B.P.1    Morgan, V.L.2    Newton, A.T.3    Gore, J.C.4
  • 47
    • 66249097750 scopus 로고    scopus 로고
    • Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processes
    • Sadaghiani S, Maier JX, Noppeney U (2009) Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processes. J Neurosci 29:6490-6499
    • (2009) J Neurosci , vol.29 , pp. 6490-6499
    • Sadaghiani, S.1    Maier, J.X.2    Noppeney, U.3
  • 48
    • 23044480166 scopus 로고    scopus 로고
    • Multisensory contributions to lowlevel, 'unisensory' processing
    • Schroeder CE, Foxe JJ (2005) Multisensory contributions to lowlevel, 'unisensory' processing. Curr Opin Neurobiol 15:454
    • (2005) Curr Opin Neurobiol , vol.15 , pp. 454
    • Schroeder, C.E.1    Foxe, J.J.2
  • 50
    • 34247526791 scopus 로고    scopus 로고
    • Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects
    • DOI 10.1007/s00221-006-0770-6
    • Stevenson R, Geoghegan M, James T (2007) Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects. Exp Brain Res 179(1):85-95 (Pubitemid 46659222)
    • (2007) Experimental Brain Research , vol.179 , Issue.1 , pp. 85-95
    • Stevenson, R.A.1    Geoghegan, M.L.2    James, T.W.3
  • 51
    • 69549107669 scopus 로고    scopus 로고
    • An additive-factors design to disambiguate neuronal and areal convergence: Measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI
    • Stevenson RA, Kim S, James TW (2009) An additive-factors design to disambiguate neuronal and areal convergence: Measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI. Exp Brain Res 198:183-194
    • (2009) Exp Brain Res , vol.198 , pp. 183-194
    • Stevenson, R.A.1    Kim, S.2    James, T.W.3
  • 52
    • 0003261386 scopus 로고    scopus 로고
    • Co-planar stereotaxic atlas of the human brain
    • New York
    • Talairach J, Tournoux P (1998) Co-planar stereotaxic atlas of the human brain. Thieme Medical, New York
    • (1998) Thieme Medical
    • Talairach, J.1    Tournoux, P.2
  • 53
    • 0036430903 scopus 로고    scopus 로고
    • Noise reduction in BOLD-based fMRI using component analysis
    • DOI 10.1006/nimg.2002.1200
    • Thomas CG, Harshman RA, Menon RS (2002) Noise reduction in BOLD-based fMRI using component analysis. Neuroimage 17:1521-1537 (Pubitemid 35333871)
    • (2002) NeuroImage , vol.17 , Issue.3 , pp. 1521-1537
    • Thomas, C.G.1    Harshman, R.A.2    Menon, R.S.3
  • 54
    • 3242678182 scopus 로고    scopus 로고
    • Integration of letters and speech sounds in the human brain
    • DOI 10.1016/j.neuron.2004.06.025, PII S0896627304003964
    • van Atteveldt NM, Formisano E, Goebel R, Blomert L (2004) Integration of letters and speech sounds in the human brain. Neuron 43:271-282 (Pubitemid 38942966)
    • (2004) Neuron , vol.43 , Issue.2 , pp. 271-282
    • Van Atteveldt, N.1    Formisano, E.2    Goebel, R.3    Blomert, L.4
  • 55
    • 77649101857 scopus 로고    scopus 로고
    • FMRadaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex
    • van Atteveldt NM, Blau VC, Blomert L, Goebel R (2010) fMRadaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex. BMC Neuroscience 11:11
    • (2010) BMC Neuroscience , vol.11 , pp. 11
    • Van Atteveldt, N.M.1    Blau, V.C.2    Blomert, L.3    Goebel, R.4
  • 56
    • 3042776628 scopus 로고    scopus 로고
    • Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest
    • DOI 10.1002/hbm.20022
    • van de Ven VG, Formisano E, Prvulovic D, Roeder CH, Linden DEJ (2004) Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest. Hum Brain Mapp 22:165-178 (Pubitemid 38890996)
    • (2004) Human Brain Mapping , vol.22 , Issue.3 , pp. 165-178
    • Van De Ven, V.G.1    Formisano, E.2    Prvulovic, D.3    Roeder, C.H.4    Linden, D.E.J.5
  • 58
    • 67651051877 scopus 로고    scopus 로고
    • Neural network of speech monitoring overlaps with overt speech production and comprehension networks: A sequential spatial and temporal ICA study
    • van de Ven V, Esposito F, Christoffels IK (2009) Neural network of speech monitoring overlaps with overt speech production and comprehension networks: A sequential spatial and temporal ICA study. Neuroimage 47:1982-1991
    • (2009) Neuroimage , vol.47 , pp. 1982-1991
    • Van De Ven, V.1    Esposito, F.2    Christoffels, I.K.3
  • 59
    • 77249168190 scopus 로고    scopus 로고
    • Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization
    • Werner S, Noppeney U (2010a) Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J Neurosci 30:2662-2675
    • (2010) J Neurosci , vol.30 , pp. 2662-2675
    • Werner, S.1    Noppeney, U.2
  • 60
    • 77952619551 scopus 로고    scopus 로고
    • Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization
    • Werner S, Noppeney U (2010b) Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization. Cereb Cortex 20(8):1829-1842
    • (2010) Cereb Cortex , vol.20 , Issue.8 , pp. 1829-1842
    • Werner, S.1    Noppeney, U.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.