The use of fMRI to assess multisensory integration

The Neural Bases of Multisensory Processes

Volumn , Issue , 2011, Pages 131-146

  James, Thomas W ^a   Stevenson, Ryan A ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85059451592     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (43)

1. Allman, B.L., and M.A. Meredith. 2007. Multisensory processing in "unimodal" neurons: Cross-modal sub-threshold auditory effects in cat extrastriate visual cortex. Journal of Neurophysiology 98:545-9.
2. Allman, B.L., L.P. Keniston, and M.A. Meredith. 2008. Subthreshold auditory inputs to extrastriate visual neurons are responsive to parametric changes in stimulus quality: Sensory-specific versus non-specific coding. Brain Research 1242:95-101.
3. Alvarado, J.C., J.W. Vaughan, T.R. Stanford, and B.E. Stein. 2007. Multisensory versus unisensory integration: Contrasting modes in the superior colliculus. Journal of Neurophysiology 97:3193-205.
4. Attwell, D., and C. Iadecola. 2002. The neural basis of functional brain imaging signals. Trends in Neurosciences 25:621-5.
5. Barraclough, N.E., D. Xiao, C.I. Baker, M.W. Oram, and D.I. Perrett. 2005. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience 17:377-91.
6. Beauchamp, M.S. 2005. Statistical criteria in FMRI studies of multisensory integration. Neuroinformatics 3:93-113.
7. Beauchamp, M.S., B.D. Argall, J. Bodurka, J.H. Duyn, and A. Martin. 2004a. Unraveling multisensory integra-tion: Patchy organization within human STS multisensory cortex. Nature Neuroscience 7:1190-2.
8. Beauchamp, M.S., K.E. Lee, B.D. Argall, and A. Martin. 2004b. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809-23.
9. Benevento, L.A., J. Fallon, B.J. Davis, and M. Rezak. 1977. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Experimental Neurology 57:849-72.
10. Binder, J.R., J.A. Frost, T.A. Hammeke et al. 1999. Conceptual processing during the conscious resting state. A functional MRI study. Journal of Cognitive Neuroscience 11:80-95.
11. Boynton, G.M., S.A. Engel, G.H. Glover, and D.J. Heeger. 1996. Linear systems analysis of functional mag-netic resonance imaging in human V1. Journal of Neuroscience 16:4207-21.
12. Boynton, G.M., and E.M. Finney. 2003. Orientation-specific adaptation in human visual cortex. The Journal of Neuroscience 23:8781-7.
13. Bruce, C., R. Desimone, and C.G. Gross. 1981. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. Journal of Neurophysiology 46:369-84.
14. Calvert, G.A., M.J. Brammer, E.T. Bullmore et al. 1999. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10:2619-23.
15. Calvert, G.A., R. Campbell, and M.J. Brammer. 2000. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 10:649-57.
16. Calvert, G.A., P.C. Hansen, S.D. Iversen, and M.J. Brammer. 2001. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage 14:427-38.
17. Dale, A.M., and R.L. Buckner. 1997. Selective averaging of rapidly presented individual trials using fMRI. Human Brain Mapping 5:329-40.
18. Friston, K.J., E. Zarahn, O. Josephs, R.N. Henson, and A.M. Dale. 1999. Stochastic designs in event-related fMRI. NeuroImage 10:607-19.
19. Glover, G.H. 1999. Deconvolution of impulse response in event-related BOLD fMRI. NeuroImage 9:416-29.
20. Heeger, D.J., A.C. Huk, W.S. Geisler, and D.G. Albrecht. 2000. Spikes versus BOLD: What does neuroimaging tell us about neuronal activity? Nature Neuroscience 3:631-3.
21. Heeger, D.J., and D. Ress. 2002. What does fMRI tell us about neuronal activity? Nature Reviews Neuroscience 3:142-51.
22. Hikosaka, K., E. Iwai, H. Saito, and K. Tanaka. 1988. Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. Journal of Neurophysiology 60:1615-37.
23. James, W. 1890. The Principles of Psychology. New York: Henry Holt & Co.
24. Laurienti, P.J., T.J. Perrault, T.R. Stanford, M.T. Wallace, and B.E. Stein. 2005. On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Experimental Brain Research 166:289-97.
25. Logothetis, N.K., and B.A. Wandell. 2004. Interpreting the BOLD signal. Annual Review of Physiology 66:735-69.
26. Meredith, M.A. 2002. On the neuronal basis for multisensory convergence: A brief overview. Brain Research. Cognitive Brain Research 14:31-40.
27. Meredith, M.A., and B.L. Allman. 2009. Subthreshold multisensory processing in cat auditory cortex. Neuroreport 20:126-31.
28. Meredith, M.A., and B.E. Stein. 1983. Interactions among converging sensory inputs in the superior colliculus. Science 221:389-91.
29. Meredith, M.A., and B.E. Stein. 1986. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology 56:640-62.
30. Molyneux, W. 1688. Letter to John Locke. In E.S. de Beer (ed.), The correspondence of John Locke. Oxford: Clarendon Press.
31. Perrault Jr., T.J., J.W. Vaughan, B.E. Stein, and M.T. Wallace. 2003. Neuron-specific response characteristics predict the magnitude of multisensory integration. Journal of Neurophysiology 90:4022-6.
32. Scannell, J.W., and M.P. Young. 1999. Neuronal population activity and functional imaging. Proceedings of the Royal Society of London. Series B. Biological Sciences 266:875-81.
33. Stanford, T.R., and B.E. Stein. 2007. Superadditivity in multisensory integration: Putting the computation in context. NeuroReport 18:787-92.
34. Stark, C.E., and L.R. Squire. 2001. When zero is not zero: The problem of ambiguous baseline conditions in fMRI. Proceedings of the National Academy of Sciences of the United States of America 98:12760-6.
35. Stein, B.E., and M.A. Meredith. 1993. The Merging of the Senses. Cambridge, MA: The MIT Press.
36. Stein, B.E., and T.R. Stanford. 2008. Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience 9:255-66.
37. Stein, B.E., T.R. Stanford, R. Ramachandran, T.J. Perrault Jr., and B.A. Rowland. 2009. Challenges in quantify-ing multisensory integration: Alternative criteria, models, and inverse effectiveness. Experimental Brain Research 198:113-26.
38. Stevens, S.S. 1946. On the theory of scales of measurement. Science 103:677-80.
39. Stevenson, R.A., and T.W. James. 2009. Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition. NeuroImage 44:1210-23.
40. Stevenson, R.A., M.L. Geoghegan, and T.W. James. 2007. Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects. Experimental Brain Research 179:85-95.
41. Stevenson, R.A., S. Kim, and T.W. James. 2009. An additive-factors design to disambiguate neuronal and areal convergence: Measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI. Experimental Brain Research 198:183-94.
42. Thompson, J.K., M.R. Peterson, and R.D. Freeman. 2003. Single-neuron activity and tissue oxygenation in the cerebral cortex. Science 299:1070-2.
43. van Atteveldt, N.M., E. Formisano, L. Blomert, and R. Goebel. 2007. The effect of temporal asynchrony on the multisensory integration of letters and speech sounds. Cerebral Cortex 17:962-74.