Multisensory convergence of visual and haptic object preference across development

Neuropsychologia

Volumn 56, Issue 1, 2014, Pages 381-392

  Joanne Jao, R ^a   James, Thomas W ^a   Harman James, Karin ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Development; FMRI; Haptics; Multisensory interaction; Object recognition; Vision

Indexed keywords

ADULT; ARTICLE; BINOCULAR CONVERGENCE; BOLD SIGNAL; BRAIN MAPPING; BRAIN REGION; CHILD; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INTRAPARIETAL SULCUS; LATERAL OCCIPITAL COMPLEX; LATERAL OCCIPITAL TACTILE VISUAL REGION; MALE; MENTAL TASK; NORMAL HUMAN; OBJECT MANIPULATION; PRESCHOOL CHILD; SCHOOL CHILD; SENSORIMOTOR INTEGRATION; TASK PERFORMANCE; VISUAL STIMULATION; DEVELOPMENT; NUCLEAR MAGNETIC RESONANCE SCANNER; OBJECT PREFERENCE VISUOHAPTIC CONVERGENCE; OBJECT RECOGNITION; RECOGNITION; TACTILE STIMULATION; VISUAL MEMORY;

DEVELOPMENT; FMRI; HAPTICS; MULTISENSORY INTERACTION; OBJECT RECOGNITION; VISION;

ADULT; AGE FACTORS; ANALYSIS OF VARIANCE; BRAIN MAPPING; CHILD; CHILD, PRESCHOOL; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OCCIPITAL LOBE; OXYGEN; TOUCH PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84896809702     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2014.02.009     Document Type: Article

References (86)

1. Amedi A., Malach R., Hendler T., Peled S., Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience 2001, 4:324-330.
2. Amedi A., Jacobson G., Hendler T., Malach R., Zohary E. Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex 2002, 12:1202-1212.
3. Amedi A., von Kriegstein K., van Atteveldt N.M., Beauchamp M.S., Naumer M.J. Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research 2005, 166:559-571.
4. Binkofski F., Buccino G., Stephan K.M., Rizzolatti G., Seitz R.J., Freund H.J. A parieto-premotor network for object manipulation: Evidence from neuroimaging. Experimental Brain Research 1999, 128:210-213.
5. Bodegard A., Geyer S., Grefkes C., Zilles K., Roland P.E. Hierarchical processing of tactile shape in the human brain. Neuron 2001, 31:317-328.
6. Bova S.M., Fazzi E., Giovenzana A., Montomoli C., Signorini S.G., Zoppello M., et al. The development of visual object recognition in school-age children. Developmental Neuropsychology 2007, 31:79-102.
7. Brown T.T., Petersen S.E., Schlaggar B.L. Does human functional brain organization shift from diffuse to focal with development?. Developmental Science 2006, 9(1):9-11.
8. Bushnell E.W., Baxt C. Children[U+05F3]s haptic and cross-modal recognition with familiar and unfamiliar objects. Journal of Experimental Psychology: Human Perception and Performance 1999, 25(6):1867-1881.
9. Bushnell E.W., Boudreau J.P. Motor development and the mind: The potential role of motor abilities as a determinant of aspects of perceptual development. Child Development 1993, 64:1005-1021.
10. Casey B.J., Galvan A., Hare T.A. Changes in cerebral functional organization during cognitive development. Current Opinion in Neurobiology 2005, 15:239-244.
11. Crookes K., McKone E. Early maturity of face recognition: No childhood development of holistic processing, novel face encoding, or face-space. Cognition 2009, 111(2):219-247.
12. Culham J.C., Cavina-Pratesi C., Singhal A. The role of parietal cortex in visuomotor control: What have we learned from neuroimaging?. Neuropsychologia 2006, 44:2668-2684.
13. Culham J.C., Kanwisher N.G. Neuroimaging of cognitive functions in human parietal cortex. Current Opinion Neurobiology 2001, 11:157-163.
14. Deibert E., Kraut M., Kremen S., Hart J. Neural pathways in tactile object recognition. Neurology 1999, 52:1413-1417.
15. Dekker T., Mareschal D., Sereno M.I., Johnson M.H. Dorsal and ventral stream activation patterns and object recognition performance in school-age children. NeuroImage 2011, 57:659-670.
16. Durston S., Davidson M.C., Tottenham N., Galvan A., Spicer J., Fossella J.A., et al. A shift from diffuse to focal cortical activity with development. Developmental Science 2006, 9(1):1-8.
17. Faillenot I., Sakata H., Costes N., Decety J., Jeannerod M. Visual working memory for shape and 3D-orientation: A PET study. Neuroreport 1997, 8(4):859-862.
18. Gori M., Del Viva M., Sandini G., Burr D.C. Young children do not integrate visual and haptic form information. Current Biology 2008, 18:694-698.
19. Grefkes C., Weiss P.H., Zilles K., Fink G.R. Crossmodal processing of object features in human anterior intraparietal cortex: An fMRI study implies equivalencies between humans and monkeys. Neuron 2002, 35:173-184.
20. Grill-Spector K., Golarai G., Gabrieli J. Developmental neuroimaging of the human ventral visual cortex. Trends in Cognitive Science 2008, 12:152-162.
21. Grill-Spector K., Kourtzi Z., Kanwisher N. The lateral occipital complex and its role in object recognition. Vision Research 2001, 41:1409-1422.
22. Grill-Spector K., Kushnir T., Hendler T., Malach R. The dynamics of object-selective activation correlate with recognition performance in humans. Nature Neuroscience 2000, 3:837-843.
23. Golarai G., Ghahremani D.G., Whitfield-Gabrieli S., Reiss A., Eberhardt J.L., Gabrieli J.D., et al. Differential development of high-level visual cortex correlates with category-specific recognition memory. Nature Neuroscience 2007, 10(4):512-522.
24. Held R., Hein S. Movement-produced stimulation in the development of visually guided behavior. Journal of Comparative and Physiological Psychology 1963, 56:872-876.
25. Houdé O., Rossi S., Lubin A., Joliot M. Mapping numerical processing, reading, and executive functions in the developing brain: An fMRI meta-analysis of 52 studies including 842 children. Developmental Science 2010, 13(6):876-885.
26. James K.H. Sensori-motor experience leads to changes in visual processing in the developing brain. Developmental Science 2010, 13(2):279-288.
27. James K.H., Engelhardt L. The effects of handwriting experience on functional brain development in pre-literate children. Trends in Neuroscience and Education 2012, 1:32-42.
28. James, K. H., Jones, S. S., Smith, L. B., & Swain, S. (2013). Young children's self-generated object views and object recognition. Journal of Cognition and Development, online view.
29. James T.W., Humphrey G.K., Gati J.S., Menon R.A., Goodale M.A. The effects of visual object priming on brain activation before and after recognition. Current Biology 2000, 10:1017-1024.
30. James T.W., Humphrey G.K., Gati J.S., Menon R.A., Goodale M.A. Differential effects of viewpoint on object-driven activation in dorsal and ventral streams. Neuron 2002, 35(4):793-801.
31. James T.W., Humphrey G.K., Gati J.S., Servos P., Menon R.S., Goodale M.A. Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 2002, 40:1706-1714.
32. James T.W., James K.H. Expert individuation of objects increases activation in the fusiform face area of children. NeuroImage 2013, 67:182-192.
33. James T.W., James K.H., Humphrey G.K., Goodale M.A. Do visual and tactile object representations share the same neural substrate?. Touch and blindness: Psychology and neuroscience 2005, Lawrence Erlbaum, Mahwah, NJ. M.A. Heller, S. Ballesteros (Eds.).
34. James T.W., Kim S. Dorsal and ventral cortical pathways for visuo-haptic shape integration revealed using fMRI. Multisensory object perception in the primate brain 2010, Springer, New York. M.J. Naumer, J. Kaiser (Eds.).
35. James T.W., Kim S., Fisher J.S. The neural basis of haptic object processing. Canadian Journal of Experimental Psychology 2007, 61:219-229.
36. James W. The principles of psychology 1890, vol. I. Henry Holt and Co., New York, NY.
37. Jones S.S., Smith L.B. Object name learning and object perception: A deficit in late talkers. Journal of Child Language 2005, 32(1):223-240.
38. Juttner M., Muller A., Rentschler I. A developmental dissociation of view-dependent and view-invariant object recognition in adolescence. Behavioral Brain Research 2006, 175:420-424.
39. Kalagher H., Jones S.S. Developmental change in young children[U+05F3]s use of haptic information in a visual task: The role of hand movements. Journal of Experimental Child Psychology 2011, 108(2):293-307.
40. Kim S., James T.W. Enhanced effectiveness in visual-haptic object-selective brain regions with increasing stimulus salience. Human Brain Mapping 2010, 31:678-693.
41. Kim S., Stevenson R.A., James T.W. Visuo-haptic neuronal convergence demonstrated with an inversely effective pattern of BOLD activation. Journal of Cognitive Neuroscience 2012, 24(4):830-842.
42. Klatzky R.L., Lederman S.J., Reed C.L. There[U+05F3]s more to touch than meets the eye: The salience of object attributes for haptics with and without vision. Journal of Experimental Psychology: General 1987, 116:356-369.
43. Kourtzi Z., Kanwisher N. Representation of perceived object shape by the human lateral occipital complex. Science 2001, 293:1506-1509.
44. Kraut M., Hart J., Soher B.J., Gordon B. Object shape processing in the visual system evaluated using function MRI. Neurology 1997, 48:1416-1420.
45. Kriegeskorte N., Simmons W.K., Bellgowan P.S.F., Baker C.I. Circular analysis in systems neuroscience: The dangers of double dipping. Nature Neuroscience 2009, 12(5):535-540.
46. Lacey S., Pappas M., Kreps A., Lee K., Sathian K. Perceptual learning of view-independence in visuo-haptic object representations. Experimental Brain Research 2009, 198(2-3):329-337.
47. Lacey S., Peters A., Sathian K. Cross-modal object recognition is viewpoint-independent. PLoS One 2007, 2(9):1-6.
48. Large M., Aldcroft A., Vilis T. Task-related laterality effects in the lateral occipital complex. Brain Research 2007, 1128:130-138.
49. Lederman S.J., Klatzky R.L. Extracting object properties through haptic exploration. Acta Psychologica 1993, 84:29-40.
50. Lederman S.J., Klatzky R.L. Haptic classification of common objects: Knowledge-driven exploration. Cognitive Psychology 1990, 22:421-459.
51. Lederman S.J., Klatzky R.L. Hand movements: A window into haptic object recognition. Cognitive Psychology 1987, 19:342-368.
52. Lungarella, M., & Sporns, O. (2005, July). Information self-structuring: Key principle for learning and development. In: Proceedings of the fourth IEEE international conference on development and learning; Osaka, Japan. pp. 25-30.
53. Lungarella M., Sporns O. Mapping information flow in sensorimotor networks. PLoS Computational Biology 2006, 2(10):1301-1312.
54. Malach R., Reppas J.B., Benson R.R., Kwong K.K., Jiang H., Kennedy W.A., et al. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proceedings of the National Academy of Sciences of the United States of America 1995, 92:8135-8139.
55. Mondloch C.J., Geldart S., Maurer D., Le Grand R. Developmental changes in face processing skills. Journal of Experimental Child Psychology 2003, 86:67-84.
56. Mondloch C.J., Le Grand R., Maurer D. Configural face processing develops more slowly than featural face processing. Perception 2002, 31:553-566.
57. Mondloch C.J., Maurer D., Ahola S. Becoming a face expert. Psychological Science 2006, 17(11):930-934.
58. Mounoud P., Duscherer K., Moy G., Perraudin S. The influence of action perception on object recognition: A developmental study. Development Science 2007, 10:836-852.
59. Nishimura M., Scherf S., Behrmann M. Development of object recognition in humans. F1000 biology reports 2009, 1:56.
60. Peltier S., Stilla R., Mariola E., LaConte S., Hu X., Sathian K. Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception. Neuropsychologia 2007, 45:476-483.
61. Pereira A.F., Smith L.B. Developmental changes in visual object recognition between 18 and 24 months of age. Developmental Science 2009, 12(1):67-80.
62. Pietrini P., Furey M.L., Ricciardi E., Gobbini M.I., Wu W.H., Cohen L., et al. Beyond sensory images: Object-based representation in the human ventral pathway. Proceedings of the National Academy of Sciences of the United States of America 2004, 101:5658-5663.
63. Prather S.C., Votaw J.R., Sathian K. Task-specific recruitment of dorsal and ventral visual areas during tactile perception. Neuropsychologia 2004, 42:1079-1087.
64. Reed C.L., Shoham S., Halgren E. Neural substrates of tactile object recognition: An fMRI study. Human Brain Mapping 2004, 21:236-246.
65. Roland P.E., O'Sullivan B., Kawashima R. Shape and roughness activate different somatosensory areas in the human brain. Proceedings of the National Academy of Sciences of the United States of America 1998, 95:3295-3300.
66. Ruff H.A. Infants[U+05F3] manipulative exploration of objects: Effects of age and object characteristics. Developmental Psychology 1984, 20:9-20.
67. Ruff H.A. Components of attention during infants[U+05F3] manipulative exploration. Child Development 1986, 57:105-114.
68. Ruff H.A. The infant[U+05F3]s use of visual and haptic information in the perception and recognition of objects. Canadian Journal of Psychology 1989, 43:302-319.
69. Saito D.N., Okada T., Morita Y., Yonekura Y., Sadato N. Tactile-visual cross-modal shape matching: A functional MRI study. Cognitive Brain Research 2003, 17:14-25.
70. Sakata H., Taira M., Kusunoki M., Murata A., Tanaka Y., The TINS Lecture The parietal association cortex in depth perception and visual control of hand action. Trends in Neurosciences 1997, 20(8):350-357.
71. Sathian K., Lacey S., Stilla R., Gibson G.O., Deshpande G., Hu X., et al. Dual pathways for haptic and visual perception of spatial and texture information. NeuroImage 2011, 57:462-475.
72. Sathian K., Zangaladze A., Hoffman J.M., Grafton S.T. Feeling with the mind[U+05F3]s eye. Neuroreport 1997, 8:3877-3881.
73. Scherf K.S., Behrmann M., Humphreys K., Luna B. Visual category-selectivity for faces, places and objects emerges along different developmental trajectories. Developmental Science 2007, 10(4):F15-F30.
74. Schlaggar B.L., McCandliss B.D. Development of neural systems for reading. Annual Review of Neuroscience 2007, 30:475-503.
75. Shaywitz B.A., Shaywitz S.E., Blachman B.A., Pugh K.R., Fulbright R.K., et al. Development of left occipitotemporal systems for skilled reading in children after a phonologically-based intervention. Biological Psychiatry 2004, 55:926-933.
76. Shikata E., Hamzei F., Glauche V., Koch M., Weiller C., Binkofski F., et al. Functional properties and interaction of the anterior and posterior intraparietal areas in humans. European Journal of Neuroscience 2003, 17(5):1105-1110.
77. Smith L.B. Action alters perceived shape. Cognitive Science 2005, 29:665-679.
78. Smith L.B. From fragments to geometric shape: Changes in visual object recognition between 18 and 24 months. Current Directions in Psychological Science 2009, 18:290-293.
79. Son J.Y., Smith L.B., Goldstone R.L. Simplicity and generalization: Short-cutting abstraction in children[U+05F3]s object categorizations. Cognition 2008, 108(3):626.
80. Stiles J., Moses P., Passarotti A., Dick F.K., Buxton R. Exploring developmental change in the neural bases of higher cognitive functions: The promise of functional magnetic resonance imaging. Developmental Neuropsychology 2003, 24(2-3):641-668.
81. Stilla R., Sathian K. Selective visuo-haptic processing of shape and texture. Human Brain Mapping 2008, 29:1123-1138.
82. Stoesz M.R., Zhang M., Weisser V.D., Prather S.C., Mao H., Sathian K. Neural networks active during tactile form perception: Common and differential activity during macrospatial and microspatial tasks. International Journal of Psychophysiology 2003, 50:41-49.
83. Tal N., Amedi A. Multisensory visual-tactile object related network in humans: Insights gained using a novel crossmodal adaptation approach. Experimental Brain Research 2009, 198(2-3):165-182.
84. Talairach J., Tournoux P. Co-planar stereotaxic atlas of the human brain: 3-dimensional proportional system-An approach to cerebral imaging 1988, Thieme Medical Publishers, New York.
85. Tootell R.B.H., Dale A.M., Sereno I., Malach R. New images from the human visual cortex. Trends in Neuroscience 1996, 19:481-489.
86. Zhang M., Weisser V.D., Stilla R., Prather S.C., Sathian K. Multisensory cortical processing of object shape and its relation to mental imagery. Cognitive Affective Behavior Neuroscience 2004, 4:251-259.