Visuo-haptic neuronal convergence demonstrated with an inversely effective pattern of BOLD activation

Journal of Cognitive Neuroscience

Volumn 24, Issue 4, 2012, Pages 830-842

  Kim, Sunah ^a,b   Stevenson, Ryan A ^a,c   James, Thomas W ^a  

^a INDIANA UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c VANDERBILT UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BINOCULAR CONVERGENCE; BOLD SIGNAL; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INSULA; INTRAPARIETAL SULCUS; LEFT HEMISPHERE; MALE; NORMAL HUMAN; PREMOTOR CORTEX; PRIORITY JOURNAL; SENSORY STIMULATION; TOUCH; VISION; VISUOHAPTIC NEURONAL CONVERGENCE;

ADULT; BRAIN; BRAIN MAPPING; FEMALE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PATTERN RECOGNITION, PHYSIOLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; TOUCH; YOUNG ADULT;

EID: 84863168007     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00176     Document Type: Article

References (55)

1. Amedi, A., Malach, R., Hendler, T., Peled, S., & Zohary, E. (2001). Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience, 4, 324-330.
2. Amedi, A., Raz, N., Azulay, H., Malach, R., & Zohary, E. (2010). Cortical activity during tactile exploration of objects in blind and sighted humans. Restorative Neurology and Neuroscience, 28, 143-156.
3. Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M. S., & Naumer, M. J. (2005). Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research, 166, 559-571.
4. Banati, R. B., Goerres, G. W., Tjoa, C., Aggleton, J. P., & Grasby, P. (2000). The functional anatomy of visual-tactile integration in man: A study using positron emission tomography. Neuropsychologia, 38, 115-124.
5. Culham, J. C., & Kanwisher, N. G. (2001). Neuroimaging of cognitive functions in human parietal cortex. Current Opinion in Neurobiology, 11, 157-163.
6. Dijkerman, H. C., & de Haan, E. H. (2007). Somatosensory processes subserving perception and action. Behavioral and Brain Sciences, 30, 189-201; discussion 201-139.
7. Dragovic, M. (2004). Towards an improved measure of the Edinburgh Handedness Inventory: A one-factor congeneric measurement model using confirmatory factor analysis. Laterality, 9, 411-419.
8. Gao, J. H., Parsons, L. M., Bower, J. M., Xiong, J., Li, J., & Fox, P. T. (1996). Cerebellum implicated in sensory acquisition and discrimination rather than motor control. Science, 272, 545-547.
9. Gentile, G., Petkova, V. I., & Ehrsson, H. H. (2011). Integration of visual and tactile signals from the hand in the human brain: An fMRI study. Journal of Neurophysiology, 105, 910-922.
10. Gepshtein, S., Burge, J., Ernst, M. O., & Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity. Journal of Vision, 5, 1013-1023.
11. Grefkes, C., Weiss, P. H., Zilles, K., & Fink, G. R. (2002). Crossmodal processing of object features in human anterior intraparietal cortex: An fMRI study implies equivalencies between humans and monkeys. Neuron, 35, 173-184.
12. Hadjikhani, N., & Roland, P. E. (1998). Cross-modal transfer of information between the tactile and the visual representations in the human brain: A positron emission tomographic study. Journal of Neuroscience, 18, 1072-1084.
13. Helbig, H. B., & Ernst, M. O. (2007). Knowledge about a common source can promote visual-haptic integration. Perception, 36, 1523-1533.
14. Holmes, N. P. (2007). The law of inverse effectiveness in neurons and behaviour: Multisensory integration versus normal variability. Neuropsychologia, 45, 3340-3345.
15. Holmes, N. P. (2009). The principle of inverse effectiveness in multisensory integration: Some statistical considerations. Brain Topography, 21, 168-176.
16. Hufner, K., Stephan, T., Flanagin, V. L., Deutschlander, A., Stein, A., Kalla, R., et al. (2009). Differential effects of eyes open or closed in darkness on brain activation patterns in blind subjects. Neuroscience Letters, 466, 30-34.
17. James, T. W., Culham, J., Humphrey, G. K., Milner, A. D., & Goodale, M. A. (2003). Ventral occipital lesions impair object recognition but not object-directed grasping: An fMRI study. Brain, 126, 2463-2475.
18. James, T. W., Humphrey, G. K., Gati, J. S., Servos, P., Menon, R. S., & Goodale, M. A. (2002). Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia, 40, 1706-1714.
19. James, T. W., & Kim, S. (2010). Dorsal and ventral cortical pathways for visuo-haptic integration revealed using fMRI. In M. J. Naumer & J. Kaiser (Eds.), Multisensory object perception in the primate brain (pp. 231-250). New York: Springer.
20. James, T. W., Kim, S., & Fisher, J. S. (2007). The neural basis of haptic object processing. Canadian Journal of Experimental Psychology, 61, 219-229.
21. James, T. W., Servos, P., Kilgour, A. R., Huh, E., & Lederman, S. (2006). The influence of familiarity on brain activation during haptic exploration of 3-D facemasks. Neuroscience Letters, 397, 269-273.
22. James, T. W., & Stevenson, R. A. (2011). The use of fMRI to assess multisensory integration. In M. Wallace & M. Murray (Eds.), Frontiers in the neural bases of multisensory processes (pp. 131-146). London: Taylor and Francis Group.
23. James, T. W., Stevenson, R. A., & Kim, S. (in press). Inverse effectiveness in multisensory processing. In B. Stein (Ed.), The new handbook of multisensory processes. Cambridge, MA: MIT Press.
24. Joseph, J. E., & Farley, A. B. (2004). Cortical regions associated with different aspects of object recognition performance. Cognitive, Affective & Behavioral Neuroscience, 4, 364-378.
25. Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2005). Integration of touch and sound in auditory cortex. Neuron, 48, 373-384.
26. Kilgour, A. R., Kitada, R., Servos, P., James, T. W., & Lederman, S. J. (2005). Haptic face identification activates ventral occipital and temporal areas: An fMRI study. Brain and Cognition, 59, 246-257.
27. Kim, S., & James, T. W. (2010). Enhanced effectiveness in visuo-haptic object-selective brain regions with increasing stimulus salience. Human Brain Mapping, 31, 678-693.
28. Kim, S., & James, T. W. (2011). Hierarchical neural pathways of haptic object processing. In M. Hertenstein & S. Weiss, (Eds.), The handbook of touch (pp. 143-160). New York: Springer Publications.
29. King, A. J., & Palmer, A. R. (1985). Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Experimental Brain Research, 60, 492-500.
30. Marx, E., Deutschlander, A., Stephan, T., Dieterich, M., Wiesmann, M., & Brandt, T. (2004). Eyes open and eyes closed as rest conditions: Impact on brain activation patterns. Neuroimage, 21, 1818-1824.
31. Marx, E., Stephan, T., Nolte, A., Deutschlander, A., Seelos, K. C., Dieterich, M., et al. (2003). Eye closure in darkness animates sensory systems. Neuroimage, 19, 924-934.
32. Meredith, M. A., Nemitz, J. W., & Stein, B. E. (1987). Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. Journal of Neuroscience, 7, 3215-3229.
33. Meredith, M. A., & Stein, B. E. (1983). Interactions among converging sensory inputs in the superior colliculus. Science, 221, 389-391.
34. Meredith, M. A., & Stein, B. E. (1986a). Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research, 365, 350-354.
35. Meredith, M. A., & Stein, B. E. (1986b). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56, 640-662.
36. Miller, L. M., & D'Esposito, M. (2005). Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 25, 5884-5893.
37. Naumer, M. J., Ratz, L., Yalachkov, Y., Polony, A., Doehrmann, O., van de Ven, V., et al. (2010). Visuohaptic convergence in a corticocerebellar network. European Journal of Neuroscience, 31, 1730-1736.
38. Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9, 97-113.
39. Peltier, S., Stilla, R., Mariola, E., LaConte, S., Hu, X., & Sathian, K. (2007). Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception. Neuropsychologia, 45, 476-483.
40. Perrault, T. J., Jr., Vaughan, J. W., Stein, B. E., & Wallace, M. T. (2005). Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli. Journal of Neurophysiology, 93, 2575-2586.
41. Pietrini, P., Furey, M. L., Ricciardi, E., Gobbini, M. I., Wu, W. H., Cohen, L., et al. (2004). Beyond sensory images: Object-based representation in the human ventral pathway. Proceedings of the National Academy of Sciences, U.S.A., 101, 5658-5663.
42. Prather, S. C., Votaw, J. R., & Sathian, K. (2004). Task-specific recruitment of dorsal and ventral visual areas during tactile perception. Neuropsychologia, 42, 1079-1087.
43. Reed, C. L., Klatzky, R. L., & Halgren, E. (2005). What vs. where in touch: An fMRI study. Neuroimage, 25, 718-726.
44. Sternberg, S. (1969). Memory-scanning: Mental processes revealed by reaction-time experiments. American Science, 57, 421-457.
45. Stevenson, R. A., Altieri, N. A., Kim, S., Pisoni, D. B., & James, T. W. (2010). Neural processing of asynchronous audiovisual speech perception. Neuroimage, 49, 3308-3318.
46. Stevenson, R. A., & James, T. W. (2009). Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition. Neuroimage, 44, 1210-1223.
47. Stevenson, R. A., Kim, S., & James, T. W. (2009). An additive-factors design to disambiguate neuronal and areal convergence: Measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI. Experimental Brain Research, 198, 183-194.
48. Stevenson, R. A., VanDerKlok, R. M., Pisoni, D. B., & James, T. W. (2011). Discrete neural substrates underlie complementary audiovisual speech integration processes. Neuroimage, 55, 1339-1345.
49. Stilla, R., & Sathian, K. (2008). Selective visuo-haptic processing of shape and texture. Human Brain Mapping, 29, 1123-1138.
50. Stoesz, M. R., Zhang, M., Weisser, V. D., Prather, S. C., Mao, H., & Sathian, K. (2003). Neural networks active during tactile form perception: Common and differential activity during macrospatial and microspatial tasks. International Journal of Psychophysiology, 50, 41-49.
51. Strick, P. L., Dum, R. P., & Fiez, J. A. (2009). Cerebellum and nonmotor function. Annual Review of Neuroscience, 32, 413-434.
52. Tal, N., & Amedi, A. (2009). Multisensory visual-tactile object related network in humans: Insights gained using a novel crossmodal adaptation approach. Experimental Brain Research, 198, 165-182.
53. Talairach, J., & Tournoux, P. (1988). Co-planar sterotaxic atlas of the human brain. New York: Theme Medical Publishers.
54. Werner, S., & Noppeney, U. (2009). Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization. Cerebral Cortex, 20, 1829-1842.
55. Zhang, M., Weisser, V. D., Stilla, R., Prather, S. C., & Sathian, K. (2004). Multisensory cortical processing of object shape and its relation to mental imagery. Cognitive, Affective & Behavioral Neuroscience, 4, 251-259.