Dual pathways for haptic and visual perception of spatial and texture information

NeuroImage

Volumn 57, Issue 2, 2011, Pages 462-475

  Sathian, K ^a,b,c   Lacey, Simon ^a   Stilla, Randall ^a   Gibson, Gregory O ^a   Deshpande, Gopikrishna ^d,e,f   Hu, Xiaoping ^d   LaConte, Stephen ^d,g,h   Glielmi, Christopher ^d,i  

^a EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b EMORY UNIVERSITY   (United States)

^c ATLANTA VA MEDICAL CENTER   (United States)

^d GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^e AUBURN UNIVERSITY   (United States)

^f AUBURN UNIVERSITY   (United States)

^g VIRGINIA TECH CARILION SCHOOL OF MEDICINE   (United States)

^h VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

ⁱ Siemens Healthcare   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN PARIETOFRONTAL CORTEX; CONTROLLED STUDY; EYE MOVEMENT; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; INTRAPARIETAL SULCUS; MALE; NORMAL HUMAN; PARIETAL CORTEX; PARIETAL OPERCULUM; PRIORITY JOURNAL; SOMATOSENSORY SYSTEM; SPATIAL ORIENTATION; SURFACE PROPERTY; TACTILE DISCRIMINATION; TACTILE STIMULATION; VISUAL CORTEX; VISUAL DISCRIMINATION; VISUAL FIELD; VISUAL STIMULATION;

ADOLESCENT; BRAIN; BRAIN MAPPING; FEMALE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; NEURAL PATHWAYS; TOUCH PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 79958706097     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2011.05.001     Document Type: Article

References (101)

1. Alain C., Arnott S.R., Hevenor S., Graham S., Grady C.L. "What" and "where" in the human auditory system. Proc. Natl. Acad. Sci. U. S. A. 2001, 98:12301-12306.
2. Amedi A., Malach R., Hendler T., Peled S., Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 2001, 4:324-330.
3. Amorapanth P.X., Widick P., Chatterjee A. The neural basis for spatial relations. J. Cogn. Neurosci. 2010, 22:1739-1753.
4. Arnott S.R., Binns M.A., Grady C.L., Alain C. Assessing the auditory dual-pathway model in humans. Neuroimage 2004, 22:401-408.
5. Auvray M., Spence C. The multisensory perception of flavor. Conscious. Cogn. 2008, 17:1016-1031.
6. Beason-Held L.L., Purpura K.P., Krasuski J.S., Maisog J.M., Daly E.M., Mangot D.J., Desmond R.E., Optican L.M., Schapiro M.B., VanMeter J.W. Cortical regions involved in visual texture perception: a fMRI study. Cogn. Brain Res. 1998, 7:111-118.
7. Burton H. Second somatosensory cortex and related areas. Cerebral Cortex 1986, vol. 5:31-98. Plenum Publishing Corporation, New York. E.G. Jones, A. Peters (Eds.).
8. Burton H., Sathian K., Dian-Hua S. Altered responses to cutaneous stimuli in the second somatosensory cortex following lesions of the postcentral gyrus in infant and juvenile macaques. J. Comp. Neurol. 1990, 291:395-414.
9. Cant J.S., Goodale M.A. Attention to form or surface properties modulates different regions of human occipitotemporal cortex. Cereb. Cortex 2007, 17:713-731.
10. Cant J.S., Arnott S.R., Goodale M.A. fMR-adaptation reveals separate processing regions for the perception of form and texture in the human ventral stream. Exp. Brain Res. 2009, 192:391-405.
11. Caselli R.J. Ventrolateral and dorsomedial somatosensory association cortex damage produces distinct somesthetic syndromes in humans. Neurology 1993, 43:762-771.
12. Cauda F., Geminiani G., D'Agata F., Sacco K., Duca S., Bagshaw A.P., Cavanna A.E. Functional connectivity of the posteromedial cortex. PLoS One 2010, 5:e13107.
13. Corbetta M., Shulman G.L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 2002, 3:201-215.
14. Cusick C.G., Wall J.T., Felleman D.J., Kaas J.H. Somatotopic organization of the lateral sulcus of owl monkeys: area 3b, S-II, and a ventral somatosensory area. J. Comp. Neurol. 1989, 282:169-190.
15. De Santis L., Spierer L., Clarke S., Murray M.M. Getting in touch: segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging. Neuroimage 2007, 37:890-903.
16. Denys K., Vanduffel W., Fize D., Nelissen K., Peuskens H., Van Essen D., Orban G.A. The processing of visual shape in the cerebral cortex of human and nonhuman primates: a functional magnetic resonance imaging study. J. Neurosci. 2004, 24:2551-2565.
17. Deshpande G., Hu X., Stilla R., Sathian K. Effective connectivity during haptic perception: a study using Granger causality analysis of functional magnetic resonance imaging data. Neuroimage 2008, 40:1807-1814.
18. Deshpande G., LaConte S., James G.A., Peltier S., Hu X. Multivariate Granger causality analysis of fMRI data. Hum. Brain Mapp. 2009, 30:1361-1373.
19. Deshpande G., Sathian K., Hu X. Assessing and compensating for zero-lag correlation effects in time-lagged Granger causality analysis of fMRI. IEEE Trans. Biomed. Eng. 2010, 57:1446-1456.
20. Deshpande G., Hu X., Lacey S., Stilla R., Sathian K. Object familiarity modulates effective connectivity during haptic shape perception. Neuroimage 2010, 49:1991-2000.
21. Dijkerman H.C., de Haan E.H.F. Somatosensory processes subserving perception and action. Behav. Brain Sci. 2007, 30:189-239.
22. Duvernoy H.M. The human brain. Surface, blood supply and three-dimensional sectional anatomy 1999, Springer, New York. 2nd ed.
23. Ehrsson H.H., Spence C., Passingham R.E. That's my hand! Activity in premotor cortex reflects feeling of ownership of a limb. Science 2004, 305:875-877.
24. Eickhoff S.B., Grefkes C., Zilles K., Fink G.R. The somatotopic organization of cytoarchitectonic areas on the human parietal operculum. Cereb. Cortex 2007, 17:1800-1811.
25. Ellison A., Cowey A. TMS can reveal contrasting functions of the dorsal and ventral visual processing streams. Exp. Brain Res. 2006, 175:618-625.
26. Ellison A., Cowey A. Differential and co-involvement of areas of the temporal and parietal streams in visual tasks. Neuropsychologia 2009, 47:1609-1614.
27. Fitzgerald P.J., Lane J.W., Thakur P.H., Hsiao S.S. Receptive field properties of the macaque second somatosensory cortex: evidence for multiple functional representations. J. Neurosci. 2004, 24:11193-11204.
28. Friedman D.P., Murray E.A., O'Neill J.B., Miskin M. Cortical connections of the somatosensory fields of the lateral sulcus of macaques: evidence for a corticolimbic pathway for touch. J. Comp. Neurol. 1986, 252:323-347.
29. Gauthier I., Hayward W.G., Tarr M.J., Anderson A.W., Skudlarski P., Gore J.C. BOLD activity during mental rotation and viewpoint-dependent object recognition. Neuron 2002, 34:161-171.
30. Genovese C.R., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 2002, 15:870-878.
31. Goodale M., Milner A. Separate visual pathways for perception and action. Trends Neurosci. 1992, 15:20-25.
32. Granger C.W.J. Investigating causal relations by econometric models and cross-spectral methods. Econometrica 1969, 37:424-438.
33. Graziano M.S.A., Hu X.T., Gross C.G. Visuospatial properties of ventral premotor cortex. J. Neurophysiol. 1997, 77:2268-2292.
34. Grill-Spector K., Malach R. fMR-adaptation: a tool for studying the functional properties of human cortical neurons. Acta Psychol. 2001, 107:293-321.
35. Guest S., Catmur C., Lloyd D., Spence C. Audiotactile interactions in roughness perception. Exp. Brain Res. 2002, 146:161-171.
36. Hampstead B.M., Stringer A.Y., Stilla R.F., Deshpande G., Hu X., Moore A.B., Sathian K. Activation and effective connectivity changes following explicit-memory training for face-name pairs in patients with mild cognitive impairment: a pilot study. Neurorehabil. Neural Repair 2011, 25:210-222.
37. Haxby J.V., Horwitz B., Ungerleider L.G., Maisog J.M., Pietrini P., Grady C.L. The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations. J. Neurosci. 1994, 14:6336-6353.
38. Hollins M., Bensmaia S.J. The coding of roughness. Can. J. Exp. Psychol. 2007, 61:184-195.
39. Hollins M., Faldowski R., Rao S., Young F. Perceptual dimensions of tactile surface texture: a multidimensional scaling analysis. Percept. Psychophys. 1993, 54:697-705.
40. Inui K., Wang X., Tamura Y., Kaneoke Y., Kakigi R. Serial processing in the human somatosensory system. Cereb. Cortex 2004, 14:851-857.
41. Jiang W., Tremblay F., Chapman C.E. Neuronal encoding of texture changes in the primary and the secondary somatosensory cortical areas of monkeys during passive texture discrimination. J. Neurophysiol. 1997, 77:1656-1662.
42. Klatzky R.L., Lederman S.J. Multisensory texture perception. Multisensory Object Perception in the Primate Brain 2010, 211-230. Springer Science+Business Media, New York. M.J. Naumer, J. Kaiser (Eds.).
43. Koch K.W., Fuster J.M. Unit activity in monkey parietal cortex related to haptic perception and temporary memory. Exp. Brain Res. 1989, 76:292-306.
44. Konen C.S., Kastner S. Two hierarchically organized neural systems for object information in human visual cortex. Nat. Neurosci. 2008, 11:224-231.
45. Krekelberg B., Boynton G.M., van Wezel R.J.A. Adaptation: from single cells to BOLD signals. Trends Neurosci. 2006, 29:250-256.
46. Krubitzer L., Clarey J., Tweedale R., Elston G., Calford M. A redefinition of somatosensory areas in the lateral sulcus of macaque monkeys. J. Neurosci. 1995, 15:3821-3839.
47. Lacey S., Tal N., Amedi A., Sathian K. A putative model of multisensory object representation. Brain Topogr. 2009, 21:269-274.
48. Lacey S., Hagtvedt H., Patrick V.M., Anderson A., Stilla R., Deshpande G., Hu X., Sato J.R., Reddy S., Sathian K. Art for reward's sake: visual art recruits the ventral striatum. Neuroimage 2011, 55:420-433.
49. LaConte S., Peltier S., Heberlein K., Hu X. Predictive eye estimation regression (PEER) for simultaneous eye tracking and fMRI. Proc. Intl. Soc. Magn. Reson. Med. 2006, 2808.
50. LaConte S., Glielmi C., Heberlein K., Hu X. Verifying visual fixation to improve fMRI with predictive eye estimation regression (PEER). Proc. Intl. Soc. Magn. Reson. Med. 2007, 3438.
51. Ledberg A., O'Sullivan B.T., Kinomura S., Roland P.E. Somatosensory activations of the parietal operculum of man. A PET study. Eur. J. Neurosci. 1995, 7:1934-1941.
52. Lucan J.N., Foxe J.J., Gomez-Ramirez M., Sathian K., Molholm S. Tactile shape discrimination recruits human lateral occipital cortex during early perceptual processing. Hum. Brain Mapp 2010, 31:1813-1821.
53. Macaluso E. Orienting of spatial attention and the interplay between the senses. Cortex 2010, 46:282-297.
54. Merabet L., Thut G., Murray B., Andrews J., Hsiao S., Pascual-Leone A. Feeling by sight or seeing by touch?. Neuron 2004, 42:173-179.
55. Merabet L.B., Swisher J.D., McMains S.A., Halko M.A., Amedi A., Pascual-Leone A., Somers D.C. Combined activation and deactivation of visual cortex during tactile sensory processing. J. Neurophysiol. 2007, 97:1633-1641.
56. Mishkin M. Analogous neural models for tactual and visual learning. Neuropsychologia 1979, 17:139-151.
57. Mur M., Ruff D.A., Bodurka J., Bandettini P.A., Kriegeskorte N. Face-identity change activation outside the face system: "release from adaptation" may not always indicate neuronal selectivity. Cereb. Cortex 2010, 20:2027-2042.
58. Murray E.A., Mishkin M. Relative contributions of SII and area 5 to tactile discrimination in monkeys. Behav. Brain Res. 1984, 11:67-83.
59. Nicolelis M.A.L., Ghazanfar A.A., Stambuagh C.R., Oliveira L.M.O., Laubach M., Chapin J.K., Nelson R.J., Kaas J.H. Simultaneous encoding of tactile information by three primate cortical areas. Nat. Neurosci. 1998, 1:621-630.
60. O'Sullivan B.T., Roland P.E., Kawashima R. A PET study of somatosensory discrimination in man. Microgeometry versus macrogeometry. Eur. J. Neurosci. 1994, 137-148.
61. Patel R.S., Bowman F.D., Rilling J.K. A Bayesian approach to determining connectivity of the human brain. Hum. Brain Mapp. 2006, 27:267-276.
62. Peltier S., Stilla R., Mariola E., LaConte S., Hu X., Sathian K. Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception. Neuropsychologia 2007, 45:476-483.
63. Peuskens H., Claeys K.G., Todd J.T., Norman J.F., Van Hecke P., Orban G.A. Attention to 3-D shape, 3-D motion, and texture in 3-D structure from motion displays. J. Cogn. Neurosci. 2004, 16:665-682.
64. Pietrini P., Furey M.L., Ricciardi E., Gobbini M.I., Wu W.-H.C., Cohen L., Guazzelli M., Haxby J.V. Beyond sensory images: object-based representation in the human ventral pathway. Proc. Natl. Acad. Sci. U. S. A. 2004, 101:5658-5663.
65. Pons T.P., Garraghty P.E., Friedman D.P., Mishkin M. Physiological evidence for serial processing in somatosensory cortex. Science 1987, 237:417-420.
66. Pons T.P., Garraghty P.E., Mishkin M. Serial and parallel processing of tactual information in somatosensory cortex of rhesus monkeys. J. Neurophysiol. 1992, 68:518-527.
67. Pruett J.R., Sinclair R.J., Burton H. Response patterns in second somatosensory cortex (SII) of awake monkeys to passively applied tactile gratings. J. Neurophysiol. 2000, 84:780-797.
68. Puce A., Allison T., Asgari M., Gore J.C., McCarthy G. Differential sensitivity of human visual cortex to faces, letterstrings and textures: a functional magnetic resonance imaging study. J. Neurosci. 1996, 16:5005-5215.
69. Raczkowski D., Kalat J.W., Nebes R. Reliability and validity of some handedness questionnaire items. Neuropsychologia 1974, 12:43-47.
70. Randolph M., Semmes J. Behavioral consequences of selective subtotal ablations in the postcentral gyrus of Macaca mulatta. Brain Res. 1974, 70:55-70.
71. Rauschecker J.P., Tian B. Mechanisms and streams for processing of "what" and "where" in auditory cortex. Proc. Natl. Acad. Sci. U. S. A. 2000, 97:11800-11806.
72. Reed C.L., Caselli R.J., Farah M.J. Tactile agnosia. Underlying impairment and implications for normal tactile object recognition. Brain 1996, 119:875-888.
73. Reed C.L., Klatzky R.L., Halgren E. What vs. where in touch: an fMRI study. Neuroimage 2005, 25:718-726.
74. Reed C.L., Hagler D.J., Marinkovic K., Dale A., Halgren E. Sequences of cortical activation for tactile pattern discrimination using magnetoencephalography. Neuroreport 2009, 20:941-945.
75. Renier L.A., Anurova I., De Volder A.G., Carlson S., VanMeter J., Rauschecker J.P. Multisensory integration of sounds and vibrotactile stimuli in processing streams for "what" and "where". J. Neurosci. 2009, 29:10950-10960.
76. Rizzolatti G., Craighero L. The mirror-neuron system. Annu. Rev. Neurosci. 2004, 27:169-192.
77. Roebroeck A., Formisano E., Goebel R. Mapping directed influence over the brain using Granger causality and fMRI. Neuroimage 2005, 25:230-242.
78. Rogers B.P., Katwal S.B., Morgan V.L., Asplund C.L., Gore J.C. Functional MRI and multivariate autoregressive models. Magn. Reson. Imaging 2010, 28:1058-1065.
79. Roland P.E. Somatosensory detection of microgeometry, macrogeometry and kinesthesia after localized lesions of the cerebral hemispheres in man. Brain Res. Rev. 1987, 12:43-94.
80. Roland P.E., O'Sullivan B., Kawashima R. Shape and roughness activate different somatosensory areas in the human brain. Proc. Natl. Acad. Sci. U. S. A. 1998, 95:3295-3300.
81. Saito D.N., Okada T., Morita Y., Yonekura Y., Sadato N. Tactile-visual cross-modal shape matching: a functional MRI study. Cogn. Brain Res. 2003, 17:14-25.
82. Sathian K. Tactile sensing of surface features. Trends Neurosci. 1989, 12:513-519.
83. Sathian, K., in press. Cross-modal recruitment of sensory cortical regions. In: Stein, B.E. (Ed.), The New Handbook of Multisensory Processes. MIT Press, Cambridge, MA.
84. Schippers M.B., Renken R., Keysers C. The effect of intra- and inter-subject variability of hemodynamic responses on group level Granger causality analyses. Neuroimage 2011, 33:22-36.
85. Sereno A.B., Maunsell J.H.R. Shape selectivity in primate lateral intraparietal cortex. Nature 1998, 395:500-503.
86. Servos P., Lederman S., Wilson D., Gati J. fMRI-derived cortical maps for haptic shape, texture and hardness. Cogn. Brain Res. 2001, 12:307-313.
87. Sestieri C., Di Matteo R., Ferretti A., Del Gratta C., Caulo M., Tartaro A., Olivetti Belardinelli M., Romani G.L. "What" versus "where" in the audiovisual domain: an fMRI study. Neuroimage 2006, 33:672-680.
88. Shikata E., McNamara A., Sprenger A., Hamzei F., Glauche V., Büchel C., Binkofski F. Localization of human intraparietal areas AIP, CIP, and LIP using surface orientation and saccadic eye movement tasks. Hum. Brain Mapp. 2008, 29:411-421.
89. Sinclair R.J., Pruett J.R., Burton H. Responses in primary somatosensory cortex of rhesus monkey to controlled application of embossed grating and bar patterns. Somatosens. Mot. Res. 1996, 13:287-306.
90. Smith S.M., Miller K.L., Salimi-Khorshidi G., Webster M., Beckmann C.F., Nichols T.E., Ramsey J.D., Woolrich M.W. Network modelling methods for FMRI. Neuroimage 2011, 54:875-891.
91. Stilla R., Sathian K. Selective visuo-haptic processing of shape and texture. Hum. Brain Mapp. 2008, 29:1123-1138.
92. Stilla R., Deshpande G., LaConte S., Hu X., Sathian K. Posteromedial parietal cortical activity and inputs predict tactile spatial acuity. J. Neurosci. 2007, 27:11091-11102.
93. Stilla R., Hanna R., Hu X., Mariola E., Deshpande G., Sathian K. Neural processing underlying tactile microspatial discrimination in the blind: a functional magnetic resonance imaging study. J. Vis. 2008, 8:1-19. http://journalofvision.org/8/10/13/,doi:10.1167/8.10.13.
94. Tal N., Amedi A. Multisensory visual-tactile object related network in humans: insights gained using a novel crossmodal adaptation approach. Exp. Brain Res. 2009, 198:165-182.
95. Talairach J., Tournoux P. Co-planar stereotaxic atlas of the brain 1988, Thieme Medical Publishers, New York.
96. Ungerleider L.G., Mishkin M. Two cortical visual systems. Analysis of Visual Behavior 1982, 549-586. MIT Press, Cambridge, MA. D.J. Ingle, M.A. Goodale, R.J.W. Mansfield (Eds.).
97. Van Boven R.W., Ingeholm J.E., Beauchamp M.S., Bikle P.C., Ungerleider L.G. Tactile form and location processing in the human brain. Proc. Natl. Acad. Sci. U. S. A. 2005, 102:12601-12605.
98. Whitaker T.A., Simões-Franklin C., Newell F.N. Vision and touch: independent or integrated systems for the perception of texture?. Brain Res. 2008, 1242:59-72.
99. Zhang H.Q., Zachariah M.K., Coleman G.T., Rowe M.J. Hierarchical equivalence of somatosensory areas I and II for tactile processing in the cerebral cortex of the marmoset monkey. J. Neurophysiol. 2001, 85:1823-1835.
100. Zhang M., Weisser V.D., Stilla R., Prather S.C., Sathian K. Multisensory cortical processing of object shape and its relation to mental imagery. Cogn. Affect. Behav. Neurosci. 2004, 4:251-259.
101. Zhang M., Mariola E., Stilla R., Stoesz M., Mao H., Hu X., Sathian K. Tactile dsirimination of grating orientation: fMRI activation patterns. Hum. Brain Mapp. 2005, 25:370-377.