Crossmodal interactions of haptic and visual texture information in early sensory cortex

NeuroImage

Volumn 75, Issue , 2013, Pages 123-135

  Eck, Judith ^a,b   Kaas, Amanda L ^a   Goebel, Rainer ^a,b,c  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b BRAIN INNOVATION B V   (Netherlands)

^c NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

Author keywords

Crossmodal interaction; Haptic; Somatosensory cortex; Texture processing; Visual; Visual cortex

Indexed keywords

ARTICLE; BOLD SIGNAL; COGNITION; CONTROLLED STUDY; EVOKED VISUAL RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROIMAGING; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; PERCEPTION; PRIORITY JOURNAL; SENSORY CORTEX; SOMATOSENSORY CORTEX; TACTILE STIMULATION; TEXTURE PERCEPTION; VISUAL CORTEX; VISUAL STIMULATION; VOLUNTEER;

ADULT; BRAIN MAPPING; FEMALE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; SOMATOSENSORY CORTEX; TOUCH PERCEPTION; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 84875769667     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.02.075     Document Type: Article

References (62)

1. Amedi A., Malach R., Hendler T., Peled S., Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 2001, 4(3):324-330. 10.1038/85201.
2. Bauer M., Oostenveld R., Fries P. Tactile stimulation accelerates behavioral responses to visual stimuli through enhancement of occipital gamma-band activity. Vision Res. 2009, 49(9):931-942. 10.1016/j.visres.2009.03.014.
3. Bensmaia S.J., Craig J.C., Yoshioka T., Johnson K.O. SA1 and RA afferent responses to static and vibrating gratings. J. Neurophysiol. 2006, 95(3):1771-1782. 10.1152/jn.00877.2005.
4. Bergmann Tiest W.M. Tactual perception of material properties. Vision Res. 2010, 50(24):2775-2782. 10.1016/j.visres.2010.10.005.
5. Borra E., Rockland K.S. Projections to early visual areas v1 and v2 in the calcarine fissure from parietal association areas in the macaque. Front. Neuroanat. 2011, 5(35):1-12. 10.3389/fnana.2011.00035.
6. Boynton G.M., Engel S.A., Glover G.H., Heeger D.J. Linear systems analysis of functional magnetic resonance imaging in human V1. J. Neurosci. 1996, 16(13):4207-4221.
7. Buracas G.T., Fine I., Boynton G.M. The relationship between task performance and functional magnetic resonance imaging response. J. Neurosci. 2005, 25(12):3023-3031. 10.1523/JNEUROSCI.4476-04.2005.
8. Burton H., Sinclair R.J., Wingert J.R., Dierker D.L. Multiple parietal operculum subdivisions in humans: tactile activation maps. Somatosens. Mot. Res. 2008, 25(3):149-162. 10.1080/08990220802249275.
9. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 2000, 10(11):649-657.
10. Cant J.S., Goodale M.A. Attention to form or surface properties modulates different regions of human occipitotemporal cortex. Cereb. Cortex 2007, 17(3):713-731. 10.1093/cercor/bhk022.
11. Cant J.S., Goodale M.A. Scratching beneath the surface: new insights into the functional properties of the lateral occipital area and parahippocampal place area. J. Neurosci. 2011, 31:8248-8258. 10.1523/JNEUROSCI.6113-10.2011.
12. Cant J.S., Xu Y. Object ensemble processing in human anterior-medial ventral visual cortex. J. Neurosci. 2012, 32(22):7685-7700. 10.1523/JNEUROSCI.3325-11.2012.
13. Cappe C., Barone P. Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur. J. Neurosci. 2005, 22(11):2886-2902. 10.1111/j.1460-9568.2005.04462.x.
14. Cavina-Pratesi C., Kentridge R.W., Heywood C.A., Milner A.D. Separate processing of texture and form in the ventral stream: evidence from fMRI and visual agnosia. Cereb. Cortex 2009, 20:433-446. 10.1093/cercor/bhp111.
15. Cavina-Pratesi C., Kentridge R.W., Heywood C.A., Milner A.D. Separate channels for processing form, texture, and color: evidence from fMRI adaptation and visual object agnosia. Cereb Cortex 2010, 2319-2332. 10.1093/cercor/bhp298.
16. Chen L.M., Friedman R.M., Ramsden B.M., LaMotte R.H., Roe A.W. Fine-scale organization of SI (area 3b) in the squirrel monkey revealed with intrinsic optical imaging. J. Neurophysiol. 2001, 86(6):3011-3029.
17. Connor C.E., Hsiao S.S., Phillips J.R., Johnson K.O. Tactile roughness: neural codes that account for psychophysical magnitude estimates. J. Neurosci. 1990, 10(12):3823-3836.
18. Dépeault A., Meftah E.-M., Chapman C. Tactile perception of roughness: raised-dot spacing, density and disposition. Exp. Brain Res. 2009, 197(3):235-244. 10.1007/s00221-009-1907-1.
19. Deshpande G., Hu X., Stilla R., Sathian K. Effective connectivity during haptic perception: a study using Granger causality analysis of functional magnetic resonance imaging data. Neuroimage 2008, 40(4):1807-1814. 10.1016/j.neuroimage.2008.01.044.
20. Deshpande G., Hu X., Lacey S., Stilla R., Sathian K. Object familiarity modulates effective connectivity during haptic shape perception. Neuroimage 2010, 49(3):1991-2000. 10.1016/j.neuroimage.2009.08.052.
21. Dionne J.K., Meehan S.K., Legon W., Staines W.R. Crossmodal influences in somatosensory cortex: interaction of vision and touch. Hum. Brain Mapp. 2010, 31(1):14-25. 10.1002/hbm.20841.
22. Eck J., Kaas A.L., Goebel R. The effect of sensory modality and previous experience on perceived roughness. Paper presented at the World Haptics Conference (WHC) 2011, IEEE, Instanbul, Turkey.
23. Fikes T.G., Klatzky R.L., Lederman S.J. Effects of object texture on precontact movement time in human prehension. J. Mot. Behav. 1994, 26(4):325-332. 10.1080/00222895.1994.9941688.
24. Forman S.D., Cohen J.D., Fitzgerald M., Eddy W.F., Mintun M.A., Noll D.C. Improved assessment of significant activation in functional Magnetic Resonance Imaging (fMRI): use of a cluster-size threshold. Magn. Reson. Med. 1995, 33(5):636-647.
25. Friedman R.M., Chen L.M., Roe A.W. Modality maps within primate somatosensory cortex. Proc. Natl. Acad. Sci. U. S. A. 2004, 101(34):12724-12729. 10.1073/pnas.0404884101.
26. Goebel R., Esposito F., Formisano E. Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: from single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Hum. Brain Mapp. 2006, 27(5):392-401.
27. Guzman-Martinez E., Ortega L., Grabowecky M., Mossbridge J., Suzuki S. Interactive coding of visual spatial frequency and auditory amplitude-modulation rate. Curr. Biol. 2012, 22(5):383-388. 10.1016/j.cub.2012.01.004.
28. Hiramatsu C., Goda N., Komatsu H. Transformation from image-based to perceptual representation of materials along the human ventral visual pathway. Neuroimage 2011, 57:482-494. 10.1016/j.neuroimage.2011.04.056.
29. Hollins M., Lorenz F., Harper D. Somatosensory coding of roughness: the effect of texture adaptation in direct and indirect touch. J. Neurosci. 2006, 26(20):5582-5588. 10.1523/JNEUROSCI.0028-06.2006.
30. James T.W., Stevenson R.A. The use of fMRI to assess multisensory integration. The Neural Bases of Multisensory Processes 2012, CRC Press, Boca Raton (FL). M.M. Murray, M.T. Wallace (Eds.).
31. Johansen-Berg H., Lloyd D.M. The physiology and psychology of selective attention to touch. Front. Biosci. 2000, 5:D894-904.
32. Kaas A.L., van Mier H., Visser M., Goebel R. The neural substrate for working memory of tactile surface texture. Hum. Brain Mapp. 2012, 10.1002/hbm.21500.
33. Kao M.-H., Mandal A., Lazar N., Stufken J. Multi-objective optimal experimental designs for event-related fMRI studies. Neuroimage 2009, 44(3):849-856. 10.1016/j.neuroimage.2008.09.025.
34. Karns C.M., Knight R.T. Intermodal auditory, visual, and tactile attention modulates early stages of neural processing. J. Cogn. Neurosci. 2009, 21(4):669-683. 10.1162/jocn.2009.21037.
35. Kassuba T., Klinge C., Holig C., Roder B., Siebner H.R. Vision holds a greater share in visuo-haptic object recognition than touch. Neuroimage 2012, 10.1016/j.neuroimage.2012.09.054.
36. Kim S., James T.W. Enhanced effectiveness in visuo-haptic object-selective brain regions with increasing stimulus salience. Hum. Brain Mapp. 2009, 31(5):678-693. 10.1002/hbm.20897.
37. Kim S., Stevenson R.A., James T.W. Visuo-haptic neuronal convergence demonstrated with an inversely effective pattern of BOLD activation. J. Cogn. Neurosci. 2012, 24(4):830-842. 10.1162/jocn_a_00176.
38. Kitada R., Hashimoto T., Kochiyama T., Kito T., Okada T., Matsumura M., Lederman S.J., Sadato N. Tactile estimation of the roughness of gratings yields a graded response in the human brain: an fMRI study. Neuroimage 2005, 25(1):90-100. 10.1016/j.neuroimage.2004.11.026.
39. Kitada R., Kito T., Saito D.N., Kochiyama T., Matsumura M., Sadato N., Lederman S.J. Multisensory activation of the intraparietal area when classifying grating orientation: a functional magnetic resonance imaging study. J. Neurosci. 2006, 26(28):7491-7501. 10.1523/JNEUROSCI.0822-06.2006.
40. Lacey S., Sathian K., Grunwald M. Haptically evoked activation of visual cortex. Human Haptic Perception: Basics and Applications 2008, 251-257. Birkhäuser Basel, Basel. M. Grunwald (Ed.).
41. Lacey S., Tal N., Amedi A., Sathian K. A putative model of multisensory object representation. Brain Topogr. 2009, 21(3-4):269-274. 10.1007/s10548-009-0087-4.
42. Lacey S., Flueckiger P., Stilla R., Lava M., Sathian K. Object familiarity modulates the relationship between visual object imagery and haptic shape perception. Neuroimage 2010, 49(3):1977-1990. 10.1016/j.neuroimage.2009.10.081.
43. Lederman S.J., Abbott S.G. Texture perception: studies of intersensory organization using a discrepancy paradigm and visual versus tactual psychophysics. J. Exp. Psychol. 1981, 7(4):902-915.
44. Lunghi C., Binda P., Morrone M.C. Touch disambiguates rivalrous perception at early stages of visual analysis. Curr. Biol. 2010, 20(4):R143-R144. 10.1016/j.cub.2009.12.015.
45. Macaluso E., Frith C.D., Driver J. Modulation of human visual cortex by crossmodal spatial attention. Science 2000, 289(5482):1206-1208.
46. Meehan S.K., Staines W.R. Task-relevance and temporal synchrony between tactile and visual stimuli modulates cortical activity and motor performance during sensory-guided movement. Hum. Brain Mapp. 2009, 30(2):484-496. 10.1002/hbm.20520.
47. Merabet L., Thut G., Murray B., Andrews J., Hsiao S., Pascual-Leone A. Feeling by sight or seeing by touch?. Neuron 2004, 42(1):173-179.
48. Merabet L.B., Swisher J.D., McMains S.A., Halko M.A., Amedi A., Pascual-Leone A., Somers D.C. Combined activation and deactivation of visual cortex during tactile sensory processing. J. Neurophysiol. 2007, 97(2):1633-1641. 10.1152/jn.00806.2006.
49. Mouraux A., Diukova A., Lee M.C., Wise R.G., Iannetti G.D. A multisensory investigation of the functional significance of the "pain matrix". Neuroimage 2011, 54(3):2237-2249. 10.1016/j.neuroimage.2010.09.084.
50. Nordmark P.F., Pruszynski J.A., Johansson R.S. BOLD responses to tactile stimuli in visual and auditory cortex depend on the frequency content of stimulation. J. Cogn. Neurosci. 2012, 24(10):2120-2134. 10.1162/jocn_a_00261.
51. Pei Y.C., Denchev P.V., Hsiao S.S., Craig J.C., Bensmaia S.J. Convergence of submodality-specific input onto neurons in primary somatosensory cortex. J. Neurophysiol. 2009, 102(3):1843-1853. 10.1152/jn.00235.2009.
52. Peuskens H., Claeys K.G., Todd J.T., Norman J.F., Hecke P.V., Orban G.A. Attention to 3-D shape, 3-D motion, and texture in 3-D structure from motion displays. J. Cogn. Neurosci. 2004, 16(4):665-682. 10.1162/089892904323057371.
53. Picard D. Partial perceptual equivalence between vision and touch for texture information. Acta Psychol. (Amst) 2006, 121(3):227-248. 10.1016/j.actpsy.2005.06.001.
54. Roland P.E., Brendan O. Shape and roughness activate different somatosensory areas in the human brain. Proc. Natl. Acad. Sci. U. S. A. 1998, 95(6):3295-3300.
55. Roland P.E., Mortensen E. Somatosensory detection of microgeometry, macrogeometry and kinesthesia in man. Brain Res. Rev. 1987, 12(1):1-42.
56. Sathian K., Lacey S. Cross-modal involvement of visual cortex in tactile perception. Spatial Processing in Navigation, Imagery and Perception 2007, 119-134. Springer, New York. F.W. Mast, L. Jäncke (Eds.).
57. Sathian K., Lacey S., Stilla R., Gibson G.O., Deshpande G., Hu X., LaConte S., Glielmi C. Dual pathways for haptic and visual perception of spatial and texture information. Neuroimage 2011, 57(2):462-475. 10.1016/j.neuroimage.2011.05.001.
58. Simões-Franklin C., Whitaker T.A., Newell F.N. Active and passive touch differentially activate somatosensory cortex in texture perception. Hum. Brain Mapp. 2011, 32(7):1067-1080. 10.1002/hbm.21091.
59. Sterr A., Shen S., Zaman A., Roberts N., Szameitat A. Activation of SI is modulated by attention: a random effects fMRI study using mechanical stimuli. Neuroreport 2007, 18(6):607-611. 10.1097/WNR.0b013e3280b07c34.
60. Stilla R., Sathian K. Selective visuo-haptic processing of shape and texture. Hum. Brain Mapp. 2008, 29(10):1123-1138. 10.1002/hbm.20456.
61. Zangaladze A., Epstein C.M., Grafton S.T., Sathian K. Involvement of visual cortex in tactile discrimination of orientation. Nature 1999, 401(6753):587-590. 10.1038/44139.
62. Zhang M., Mariola E., Stilla R., Stoesz M., Mao H., Hu X., Sathian K. Tactile discrimination of grating orientation: fMRI activation patterns. Hum. Brain Mapp. 2005, 25(4):370-377. 10.1002/hbm.20107.