Visuo-haptic multisensory object recognition, categorization, and representation

Frontiers in Psychology

Volumn 5, Issue JUL, 2014, Pages

  Lacey, Simon ^a   Sathian, K ^a,b  

^a EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b ATLANTA VA MEDICAL CENTER   (United States)

Author keywords

Cross modal; Effective connectivity; Face processing; fMRI; Viewpoint dependence; Visual imagery

Indexed keywords

EID: 84904716961     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00730     Document Type: Review

References (168)

1. Adhikari, B. M., Sathian, K., Epstein, C. M., Lamichhane, B., and Dhamala, M. (2014). Oscillatory activity in neocortical networks during tactile discrimination near the limit of spatial acuity. Neuroimage 91, 300-310. doi: 10.1016/j.neuroimage.2014.01.007
2. Allen, H. A., and Humphreys, G. W. (2009). Direct tactile stimulation of dorsal occipito-temporal cortex in a visual agnosic. Curr. Biol. 19, 1044-1049. doi: 10.1016/j.cub.2009.04.057
3. Amedi, A., Jacobson, G., Hendler, T., Malach, R., and Zohary, E. (2002). Convergence of visual and tactile shape processing in the human lateral occipital complex. Cereb. Cortex 12, 1202-1212. doi: 10.1093/cercor/12.11.1202
4. Amedi, A., Malach, R., Hendler, T., Peled, S., and Zohary, E. (2001). Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 4, 324-330. doi: 10.1038/85201
5. Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S.,et al. (2007). Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex. Nat. Neurosci. 10, 687-689. doi: 10.1038/nn1912
6. Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M. S., and Naumer, M. J. (2005). Functional imaging of human crossmodal identification and object recognition. Exp. Brain Res. 166, 559-571. doi: 10.1007/s00221-005-2396-5
7. Andresen, D. R., Vinberg, J., and Grill-Spector, K. (2009). The representation of object viewpoint in human visual cortex. Neuroimage 45, 522-536. doi: 10.1016/j.neuroimage.2008.11.009
8. Arno, P., De Volder, A. G., Vanlierde, A., Wanet-Defalque, M.-C., Streel, E., Robert, A.,et al. (2001). Occipital activation by pattern recognition in the early blind using auditory substitution for vision. Neuroimage 13, 632-645. doi: 10.1006/nimg.2000.0731
9. Axelrod, V., and Yovel, G. (2012). Hierarchical processing of face viewpoint in human visual cortex. J. Neurosci. 32, 2442-2452. doi: 10.1523/JNEUROSCI.4770-11.2012
10. Bar, M. (2007). The proactive brain: using analogies and associations to generate predictions. Trends Cogn. Sci. 11, 280-289. doi: 10.1016/j.tics.2007.05.005
11. Berryman, L. J., Yau, J. M., and Hsiao, S. S. (2006). Representation of object size in the somatosensory system. J. Neurophysiol. 96, 27-39. doi: 10.1152/jn.01190.2005
12. Biederman, I., and Cooper, E. E. (1992). Size invariance in visual object priming. J. Exp. Psychol. Hum. Percept. Perform. 18, 121-133. doi: 10.1037/0096-1523.18.1.121
13. Blajenkova, O., Kozhevnikov, M., and Motes, M. A. (2006). Object-spatial imagery: a new self-report imagery questionnaire. Appl. Cogn. Psychol. 20, 239-263. doi: 10.1002/acp.1182
14. Bliss, I., and Hämäläinen, H. (2005). Different working memory capacity in normal young adults for visual and tactile letter recognition task. Scand. J. Psychol. 46, 247-251. doi: 10.1111/j.1467-9450.2005.00454.x
15. Buelte, D., Meister, I. G., Staedtgen, M., Dambeck, N., Sparing, R., Grefkes, C.,et al. (2008). The role of the anterior intraparietal sulcus in crossmodal processing of object features in humans: an rTMS study. Brain Res. 1217, 110-118. doi: 10.1016/j.brainres.2008.03.075
16. Bülthoff, I., and Newell, F. N. (2006). The role of familiarity in the recognition of static and dynamic objects. Prog. Brain Res. 154, 315-325. doi: 10.1016/S0079-6123(06)54017-8
17. Bushnell, E. W., and Baxt, C. (1999). Children's haptic and cross-modal recognition with familiar and unfamiliar objects. J. Exp. Psychol. Hum. Percept. Perform. 25, 1867-1881. doi: 10.1037/0096-1523.25.6.1867
18. Cant, J. S., Arnott, S. R., and Goodale, M. A. (2009). fMR-adaptation reveals separate processing regions for the perception of form and texture in the human ventral stream. Exp. Brain Res. 192, 391-405. doi: 10.1007/s00221-008-1573-8
19. Cant, J. S., and Goodale, M. A. (2007). Attention to form or surface properties modulates different regions of human occipitotemporal cortex. Cereb. Cortex 17, 713-731. doi: 10.1093/cercor/bhk022
20. Casey, S. J., and Newell, F. N. (2005). The role of long-term and short-term familiarity in visual and haptic face recognition. Exp. Brain Res. 166, 583-591. doi: 10.1007/s00221-005-2398-3
21. Casey, S. J., and Newell, F. N. (2007). Are representations of unfamiliar faces independent of encoding modality? Neuropsychologia 45, 506-513. doi: 10.1016/j.neuropsychologia.2006.02.011
22. Combe, E., and Wexler, M. (2010). Observer movement and size constancy. Psychol. Sci. 21, 667-675. doi: 10.1177/0956797610367753
23. Cooke, T., Jäkel, F., Wallraven, C., and Bülthoff, H. H. (2007). Multimodal similarity and categorization of novel, three-dimensional objects. Neuropsychologia 45, 484-495. doi: 10.1016/j.neuropsychologia.2006.02.009
24. Craddock, M., and Lawson, R. (2008). Repetition priming and the haptic recognition of familiar and unfamiliar objects. Percept. Psychophys. 70, 1350-1365. doi: 10.3758/PP.70.7.1350
25. Craddock, M., and Lawson, R. (2009a). Do left and right matter for haptic recognition of familiar objects? Perception 38, 1355-1376. doi: 10.1068/p6312
26. Craddock, M., and Lawson, R. (2009b). The effect of size changes on haptic object recognition. Atten. Percept. Psychophys. 71, 910-923. doi: 10.3758/APP.71.4.910
27. Craddock, M., and Lawson, R. (2009c). Size-sensitive perceptual representations underlie visual and haptic object recognition. PLoS ONE 4:e8009. doi: 10.1371/journal.pone.0008009
28. Craddock, M., and Lawson, R. (2010). The effects of temporal delay and orientation on haptic object recognition. Atten. Percept. Psychophys. 72, 1975-1980. doi: 10.3758/APP.72.7.1975
29. De Santis, L., Clarke, S., and Murray, M. M. (2007a). Automatic and intrinsic auditory 'what' and 'where' processing in humans revealed by electrical neuroimaging. Cereb. Cortex 17, 9-17. doi: 10.1093/cercor/bhj119
30. De Santis, L., Spierer, L., Clarke, S., and Murray, M. M. (2007b). Getting in touch: segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging. Neuroimage 37, 890-903. doi: 10.1016/j.neuroimage.2007.05.052
31. Deshpande, G., Hu, X., Lacey, S., Stilla, R., and Sathian, K. (2010). Object familiarity modulates effective connectivity during haptic shape perception. Neuroimage 49, 1991-2000. doi: 10.1016/j.neuroimage.2009.08.052
32. De Volder, A. G., Toyama, H., Kimura, Y., Kiyosawa, M., Nakano, H., Vanlierde, A.,et al. (2001). Auditory triggered mental imagery of shape involves visual association areas in early blind humans. Neuroimage 14, 129-139. doi: 10.1006/nimg.2001.0782
33. Dijkerman, H. C., and de Haan, E. H. F. (2007). Somatosensory processes subserving perception and action. Behav. Brain Sci. 30, 189-239. doi: 10.1017/S0140525X07001392
34. Dopjans, L., Bülthoff, H. H., and Wallraven, C. (2012). Serial exploration of faces: comparing vision and touch. J. Vis. 12, 6. doi: 10.1167/12.1.6
35. Easton, R. D., Greene, A. J., and Srinivas, K. (1997a). Transfer between vision and haptics: memory for 2-D patterns and 3-D objects. Psychon. Bull. Rev. 4, 403-410. doi: 10.3758/BF03210801
36. Easton, R. D., Srinivas, K., and Greene, A. J. (1997b). Do vision and haptics share common representations? Implicit and explicit memory within and between modalities. J. Exp. Psychol. Learn. Mem. Cogn. 23, 153-163. doi: 10.1037/0278-7393.23.1.153
37. Eck, J., Kaas, A. L., and Goebel, R. (2013). Crossmodal interactions of haptic and visual texture information in early sensory cortex. Neuroimage 75, 123-135. doi: 10.1016/j.neuroimage.2013.02.075
38. Eger, E., Ashburner, J., Haynes, J-D., Dolan, R. J., and Rees, G. (2008a). fMRI activity patterns in human LOC carry information about object exemplars within category. J. Cogn. Neurosci. 20, 356-370. doi: 10.1162/jocn.2008.20019
39. Eger, E., Kell, C. A., and Kleinschmidt, A. (2008b). Graded size-sensitivity of object-exemplar-evoked activity patterns within human LOC regions. J. Neurophysiol. 100, 2038-2047. doi: 10.1152/jn.90305.2008
40. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433. doi: 10.1038/415429a
41. Ewbank, M. P., Schluppeck, D., and Andrews, T. J. (2005). fMR-adaptation reveals a distributed representation of inanimate objects and places in human visual cortex. Neuroimage 28, 268-279. doi: 10.1016/j.neuroimage.2005.06.036
42. Feinberg, T. E., Rothi, L. J., and Heilman, K. M. (1986). Multimodal agnosia after unilateral left hemisphere lesion. Neurology 36, 864-867. doi: 10.1212/WNL.36.6.864
43. Gaißert, N., Bülthoff, H. H., and Wallraven, C. (2011). Similarity and categorization: from vision to touch. Acta Psychol. 138, 219-230. doi: 10.1016/j.actpsy.2011.06.007
44. Gaißert, N., and Wallraven, C. (2012). Categorizing natural objects: a comparison of the visual and haptic modalities. Exp. Brain Res. 216, 123-134. doi: 10.1007/s00221-011-2916-4
45. Gaißert, N., Wallraven, C., and Bülthoff, H. H. (2008). "Analyzing perceptual representations of complex, parametrically-defined shapes using MDS," in Proceedings of the Sixth International Conference EuroHaptics 2008, Lecture Notes in Computer Science - Haptics: Perception, Devices and Scenarios, Vol. 5024 (Heidelberg: Springer Berlin Heidelberg), 265-274.
46. Gaißert, N., Wallraven, C., and Bülthoff, H. H. (2010). Visual and haptic perceptual spaces show high similarity in humans. J. Vis. 10, 2. doi: 10.1167/10.11.2
47. Gaißert, N., Waterkamp, S., Fleming, R. W., and Bülthoff, I. (2012). Haptic categorical perception of shape. PLoS ONE 7:e43062. doi: 10.1371/journal.pone.0043062
48. Gallace, A. (2013). "Somesthetic mental imagery," in Multisensory Imagery, eds S. Lacey and R. Lawson (New York: Springer), 29-50. doi: 10.1007/978-1-4614-5879-1_3
49. Gallace, A., and Spence, C. (2009). The cognitive and neural correlates of tactile memory. Psychol. Bull. 135, 380-406. doi: 10.1037/a0015325
50. Garvill, J., and Molander, B. (1973). Effects of standard modality, comparison modality and retention interval on matching of form. Scand. J. Psychol. 14, 203-206. doi: 10.1111/j.1467-9450.1973.tb00111.x
51. Gauthier, I., Hayward, W. G., Tarr, M. J., Anderson, A. W., Skudlarski, P., and Gore, J. C. (2002). BOLD activity during mental rotation and view-dependent object recognition. Neuron 34, 161-171. doi: 10.1016/S0896-6273(02)00622-0
52. Goodale, M. A., and Milner, A. D. (1992). Separate visual pathways for perception and action. Trends Neurosci. 15, 20-25. doi: 10.1016/0166-2236(92)90344-8
53. Graf, M. (2010). "Categorization and object shape," in Towards a Theory of Thinking: Building Blocks for a Conceptual Framework, eds B. M. Glatzeder, V. Goel, and A. von Müller (Berlin: Springer-Verlag), 73-101. doi: 10.1007/978-3-642-03129-8_6
54. Grefkes, C., Geyer, S., Schormann, T., Roland, P., and Zilles, K. (2001). Human somatosensory area 2: observer-independent cytoarchitectonic mapping, interindividual variability, and population map. Neuroimage 14, 617-631. doi: 10.1006/nimg.2001.0858
55. Grill-Spector, K., Henson, R., and Martin, A. (2006). Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn. Sci. 10, 14-23. doi: 10.1016/j.tics.2005.11.006
56. Grill-Spector, K., Kushnir, T., Edelman, S., Avidan, G., Itzchak, Y., and Malach, R. (1999). Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24, 187-203. doi: 10.1016/S0896-6273(00)80832-6
57. Haag, S. (2011). Effects of vision and haptics on categorizing common objects. Cogn. Process. 12, 33-39. doi: 10.1007/s10339-010-0369-5
58. Harel, A., Kravitz, D., and Baker, C. I. (2013). Beyond perceptual expertise: revisiting the neural substrates of expert object recognition. Front. Hum. Neurosci. 7:885. doi: 10.3389/fnhum.2013.00885
59. Harvey, D. Y., and Burgund, E. D. (2012). Neural adaptation across viewpoint and exemplar in fusiform cortex. Brain Cogn. 80, 33-44. doi: 10.1016/j.bandc.2012.04.009
60. Helbig, H. B., and Ernst, M. O. (2007). Optimal integration of shape information from vision and touch. Exp. Brain Res. 179, 595-606. doi: 10.1007/s00221-006-0814-y
61. Helbig, H. B., Ernst, M. O., Ricciardi, E., Pietrini, P., Thielscher, A., Mayer, K. M.,et al. (2012). The neural mechanisms of reliability weighted integration of shape information from vision and touch. Neuroimage 60, 1063-1072. doi: 10.1016/j.neuroimage.2011.09.072
62. Iriki, A., Tanaka, M., and Iwamura, Y. (1996). Attention-induced neuronal activity in the monkey somatosensory cortex revealed by pupillometrics. Neurosci. Res. 25, 173-181. doi: 10.1016/0168-0102(96)01043-7
63. Ishai, A., Haxby, J. V., and Ungerleider, L. G. (2002). Visual imagery of famous faces: effects of memory and attention revealed by fMRI. Neuroimage 17, 1729-1741. doi: 10.1006/nimg.2002.1330
64. James, T. W., Humphrey, G. K., Gati, J. S., Menon, R. S., and Goodale, M. A. (2002a). Differential effects of view on object-driven activation in dorsal and ventral streams. Neuron 35, 793-801. doi: 10.1016/S0896-6273(02)00803-6
65. James, T. W., Humphrey, G. K., Gati, J. S., Servos, P., Menon, R. S., and Goodale, M. A. (2002b). Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 40, 1706-1714. doi: 10.1016/S0028-3932(02)00017-9
66. James, T. W., Servos, P., Kilgour, A. R., Huh, E., and Lederman, S. (2006a). The influence of familiarity on brain activation during haptic exploration of 3-D facemasks. Neurosci. Lett. 397, 269-273. doi: 10.1016/j.neulet.2005.12.052
67. James, T. W., James, K. H., Humphrey, G. K., and Goodale, M. A. (2006b). "Do visual and tactile object representations share the same neural substrate?" in Touch and Blindness: Psychology and Neuroscience, eds M. A. Heller and S. Ballesteros (Mahwah, NJ: Lawrence Erlbaum Associates), 139-155.
68. James, T. W., Stevenson, R. W., Kim, S., VanDerKlok, R. M., and James, K. H. (2011). Shape from sound: evidence for a shape operator in the lateral occipital cortex. Neuropsychologia 49, 1807-1815. doi: 10.1016/j.neuropsychologia.2011.03.004
69. Jäncke, L., Kleinschmidt, A., Mirzazade, S., Shah, N. J., and Freund, H.-J. (2001). The role of the inferior parietal cortex in linking the tactile perception and manual construction of object shapes. Cereb. Cortex 11, 114-121. doi: 10.1093/cercor/11.2.114
70. Jolicoeur, P. (1987). A size-congruency effect in memory for visual shape. Mem. Cogn. 15, 531-543. doi: 10.3758/BF03198388
71. Jones, B. (1981). "The developmental significance of cross-modal matching," in Intersensory Perception and Sensory Integration, eds R. D. Walk and H. L. Jr. Pick, (New York: Plenum Press), 108-136.
72. Kassuba, T., Klinge, C., Hölig, C., Röder, B., and Siebner, H. R. (2013). Vision holds a greater share in visuo-haptic object recognition than touch. Neuroimage 65, 59-68. doi: 10.1016/j.neuroimage.2012.09.054
73. Kilgour, A. R., de Gelder, B., and Lederman, S. (2004). Haptic face recognition and prosopagnosia. Neuropsychologia 42, 707-712. doi: 10.1016/j.neuropsychologia.2003.11.021
74. Kilgour, A. R., Kitada, R., Servos, P., James, T. W., and Lederman, S. J. (2005). Haptic face identification activates ventral occipital and temporal areas: an fMRI study. Brain Cogn. 59, 246-257. doi: 10.1016/j.bandc.2005.07.004
75. Kilgour, A. R., and Lederman, S. (2002). Face recognition by hand. Percept. Psychophys. 64, 339-352. doi: 10.3758/BF03194708
76. Kilgour, A. R., and Lederman, S. (2006). A haptic face-inversion effect. Perception 35, 921-931. doi: 10.1068/p5341
77. Kiphart, M. J., Hughes, J. L., Simmons, J. P., and Cross, H. A. (1992). Short-term haptic memory for complex objects. Bull. Psychon. Soc. 30, 212-214. doi: 10.3758/BF03330444
78. Klatzky, R. L., Abramowicz, A., Hamilton, C., and Lederman, S. J. (2011). Irrelevant visual faces influence haptic identification of facial expressions of emotion. Atten. Percept. Psychophys. 73, 521-530. doi: 10.3758/s13414-010-0038-x
79. Klatzky, R. J., and Lederman, S. J. (1992). Stages of manual exploration in haptic object identification. Percept. Psychophys. 52, 661-670. doi: 10.3758/BF03211702
80. Klatzky, R. L., and Lederman, S. J. (1995). Identifying objects from a haptic glance. Percept. Psychophys. 57, 1111-1123. doi: 10.3758/BF03208368
81. Klatzky, R. L., Lederman, S. J., and Metzger, V. A. (1985). Identifying objects by touch: an 'expert system'. Percept. Psychophys. 37, 299-302. doi: 10.3758/BF03211351
82. Klatzky, R. L., Lederman, S. J., and Reed, C. L. (1987). There's more to touch than meets the eye: the salience of object attributes for haptics with and without vision. J. Exp. Psychol. Gen. 116, 356-369. doi: 10.1037/0096-3445.116.4.356
83. Konkle, T., and Oliva, A. (2011). Canonical visual size for real-world objects. J. Exp. Psychol. Hum. Percept. Perform. 37, 23-37. doi: 10.1037/a0020413
84. Kozhevnikov, M., Hegarty, M., and Mayer, R. E. (2002). Revising the visualiser-verbaliser dimension: evidence for two types of visualisers. Cogn. Instr. 20, 47-77. doi: 10.1207/S1532690XCI2001_3
85. Kozhevnikov, M., Kosslyn, S. M., and Shephard, J. (2005). Spatial versus object visualisers: a new characterisation of cognitive style. Mem. Cogn. 33, 710-726. doi: 10.3758/BF03195337
86. Krekelberg, B., Boynton, G. M., and van Wezel, R. J. A. (2006). Adaptation: from single cells to BOLD signals. Trends Neurosci. 29, 250-256. doi: 10.1016/j.tins.2006.02.008
87. Lacey, S., and Campbell, C. (2006). Mental representation in visual/haptic crossmodal memory: evidence from interference effects. Q. J. Exp. Psychol. 59, 361-376. doi: 10.1080/17470210500173232
88. Lacey, S., Flueckiger, P., Stilla, R., Lava, M., and Sathian, K. (2010a). Object familiarity modulates the relationship between visual object imagery and haptic shape perception. Neuroimage 49, 1977-1990. doi: 10.1016/j.neuroimage.2009.10.081
89. Lacey, S., Hall, J., and Sathian, K. (2010b). Are surface properties integrated into visuo-haptic object representations? Eur. J. Neurosci. 31, 1882-1888. doi: 10.1111/j.1460-9568.2010.07204.x
90. Lacey, S., and Lawson, R. (2013). "Imagery questionnaires: vividness and beyond," in Multisensory Imagery, eds S. Lacey and R. Lawson (New York: Springer), 271-282.
91. Lacey, S., Lin, J. B., and Sathian, K. (2011). Object and spatial imagery dimensions in visuo-haptic representations. Exp. Brain Res. 213, 267-273. doi: 10.1007/s00221-011-2623-1
92. Lacey, S., Peters, A., and Sathian, K. (2007). Cross-modal object representation is viewpoint-independent. PLoS ONE 2:e890. doi: 10.1371/journal.pone0000890
93. Lacey, S., and Sathian, K. (2011). Multisensory object representation: insights from studies of vision and touch. Prog. Brain Res. 191, 165-176. doi: 10.1016/B978-0-444-53752-2.00006-0
94. Lacey, S., Stilla, R., Sreenivasan, K., Deshpande, G., and Sathian, K. (2014). Spatial imagery in haptic shape perception. Neuropsychologia doi: 10.1016/j.neuropsycholopia.2014.05.008 [Epub ahead of print].
95. Lacey, S., Tal, N., Amedi, A., and Sathian, K. (2009a). A putative model of multisensory object representation. Brain Topogr. 21, 269-274. doi: 10.1007/s10548-009-0087-4
96. Lacey, S., Pappas, M., Kreps, A., Lee, K., and Sathian, K. (2009b). Perceptual learning of view-independence in visuo-haptic object representations. Exp. Brain Res. 198, 329-337. doi: 10.1007/s00221-009-1856-8
97. Lawson, R. (2009). A comparison of the effects of depth rotation on visual and haptic three-dimensional object recognition. J. Exp. Psychol. Hum. Percept. Perform. 35, 911-930. doi: 10.1037/a0015025
98. Lawson, R. (2011). An investigation into the cause of orientation-sensitivity in haptic object recognition. Seeing Perceiving 24, 293-314. doi: 10.1163/187847511X579052
99. Lawson, R. (2014). Recognizing familiar objects by hand and foot: haptic shape perception generalizes to inputs from unusual locations and untrained body parts. Atten. Percept. Psychophys. 76, 541-558. doi: 10.3758/s13414-013-0559-1
100. Lederman, S. J., and Klatzky, R. L. (1987). Hand movements: a window into haptic object recognition. Cogn. Psychol. 19, 342-368. doi: 10.1016/0010-0285(87)90008-9
101. Loomis, J., Klatzky, R. L., and Lederman, S. J. (1991). Similarity of tactual and visual picture recognition with limited field of view. Perception 20, 167-177. doi: 10.1068/p200167
102. Lucan, J. N., Foxe, J. J., Gomez-Ramirez, M., Sathian, K., and Molholm, S. (2010). Tactile shape discrimination recruits human lateral occipital complex during early perceptual processing. Hum. Brain Mapp. 31, 1813-1821. doi: 10.1002/hbm.20983
103. Malach, R., Reppas, J. B., Benson, R. R., Kwong, K. K., Jiang, H., Kennedy, W. A.,et al. (1995). Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc. Natl. Acad. Sci. U.S.A. 92, 8135-8139. doi: 10.1073/pnas.92.18.8135
104. Marr, D. (1976). Early processing of visual information. Philos. Trans. R. Soc. Lond. B Biol. Sci. 275, 483-524. doi: 10.1098/rstb.1976.0090
105. Matsumiya, K. (2012). Haptic face aftereffect. Iperception 3, 97-100.
106. Matsumiya, K. (2013). Seeing a haptically explored face: visual facial-expression aftereffect from haptic adaptation to a face. Psychol. Sci. 24, 2088-2098. doi: 10.1177/0956797613486981
107. Maurer, D., Le Grand, R., and Mondloch, C. J. (2002). The many faces of configural processing. Trends Cogn. Sci. 6, 255-260. doi: 10.1016/S1364-6613(02)01903-4
108. Mechelli, A., Price, C. J., Friston, K. J., and Ishai, A. (2004). Where bottom-up meets top-down: neuronal interactions during perception and imagery. Cereb. Cortex 14, 1256-1265. doi: 10.1093/cercor/bhh087
109. Mullin, C. R., and Steeves, J. K. E. (2011). TMS to the lateral occipital cortex disrupts object processing but facilitates scene processing. J. Cogn. Neurosci. 23, 4174-4184. doi: 10.1162/jocn_a_00095
110. Mur, M., Ruff, D. A., Bodurka, J., Bandettini, P. A., and Kriegeskorte, N. (2010). Face-identity change activation outside the face system: "release from adaptation" may not always indicate neuronal selectivity. Cereb. Cortex 20, 2027-2042. doi: 10.1093/cercor/bhp272
111. Nabeta, T., and Kawahara, J. (2006). Congruency effect of presentation modality on false recognition of haptic and visual objects. Memory 14, 307-315. doi: 10.1080/09658210500277398
112. Nassi, J. J., and Callaway, E. M. (2009). Parallel processing strategies of the primate visual system. Nat. Rev. Neurosci. 10, 360-372. doi: 10.1038/nrn2619
113. Négyessy, L., Nepusz, T., Kocsis, L., and Bazsó, F. (2006). Prediction of the main cortical areas and connections involved in the tactile function of the visual cortex by network analysis. Eur. J. Neurosci. 23, 1919-1930. doi: 10.1111/j.1460-9568.2006.04678.x
114. Newell, F. N., Ernst, M. O., Tjan, B. S., and Bülthoff, H. H. (2001). View dependence in visual and haptic object recognition. Psychol. Sci. 12, 37-42. doi: 10.1111/1467-9280.00307
115. Newman, S. D., Klatzky, R. L., Lederman, S. J., and Just, M. A. (2005). Imagining material versus geometric properties of objects: an fMRI study. Cogn. Brain Res. 23, 235-246. doi: 10.1016/j.cogbrainres.2004.10.020
116. Nicholson, K. G., and Humphrey, G. K. (2003). The effect of colour congruency on shape discriminations of novel objects. Perception 32, 339-353. doi: 10.1002/hbm.20983
117. Palmer, S. E., Rosch, E., and Chase, P. (1981). "Canonical perspective and the perception of objects," in Attention and Performance IX, eds J. Long and A. Baddeley (Hillsdale, NJ: Lawrence Erlbaum Associates), 135-151.
118. Pascual-Leone, A., Amedi, A., Fregni, F., and Merabet, L. B. (2005). The plastic human brain. Annu. Rev. Neurosci. 28, 377-401. doi: 10.1146/annurev.neuro.27.070203.144216
119. Pascual-Leone, A., and Hamilton, R. H. (2001). The metamodal organization of the brain. Prog. Brain Res. 134, 427-445. doi: 10.1016/S0079-6123(01)34028-1
120. Pasqualotto, A., Finucane, C., and Newell, F. N. (2005). Visual and haptic representations of scenes are updated with observer movement. Exp. Brain Res. 166, 481-488. doi: 10.1007/s00221-005-2388-5
121. Pasqualotto, A., and Newell, F. N. (2007). The role of visual experience on the representation and updating of novel haptic scenes. Brain Cogn. 65, 184-194. doi: 10.1016/j.bandc.2007.07.009
122. Peissig, J. J., and Tarr, M. J. (2007). Visual object recognition: do we know more now than we did 20 years ago? Annu. Rev. Psychol. 58, 75-96. doi: 10.1146/annurev.psych.58.102904.190114
123. Pensky, A. E. C., Johnson, K. A., Haag, S., and Homa, D. (2008). Delayed memory for visual-haptic exploration of objects. Psychon. Bull. Rev. 15, 574-580. doi: 10.3758/PBR.15.3.574
124. Peterson, M. A., and Rhodes, G. (2003). Perception of Faces, Objects, and Scenes: Analytic and Holistic Processes. Oxford: Oxford University Press.
125. Pietrini, P., Furey, M. L., Ricciardi, E., Gobbini, M. I., Wu, W.-H. C., Cohen, L.,et al. (2004). Beyond sensory images: object-based representation in the human ventral pathway. Proc. Natl. Acad. Sci. U.S.A. 101, 5658-5663. doi: 10.1073/pnas.0400707101
126. Pitzalis, S., Galletti, C., Huang, R. S., Patria, F., Committeri, G., Galati, G.,et al. (2006). Wide-field retinotopy defines human cortical visual area V6. J. Neurosci. 26, 7962-7973. doi: 10.1523/JNEUROSCI.0178-06.2006
127. Pourtois, G., Schwarz, S., Spiridon, M., Martuzzi, R., and Vuilleumier, P. (2009). Object representations for multiple visual categories overlap in lateral occipital and medial fusiform cortex. Cereb. Cortex 19, 1806-1819. doi: 10.1093/cercor/bhn210
128. Prather, S. C., Votaw, J. R., and Sathian, K. (2004). Task-specific recruitment of dorsal and ventral visual areas during tactile perception. Neuropsychologia 42, 1079-1087. doi: 10.1016/j.neuropsychologia.2003.12.013
129. Reales, J. M., and Ballesteros, S. (1999). Implicit and explicit memory for visual and haptic objects: cross-modal priming depends on structural descriptions. J. Exp. Psychol. Learn. Mem. Cogn. 25, 644-663. doi: 10.1037/0278-7393.25.3.644
130. Reed, C. L., Klatzky, R. L., and Halgren, E. (2005). What vs. where in touch: an fMRI study. Neuroimage 25, 718-726. doi: 10.1016/j.neuroimage.2004.11.044
131. Renier, L., Collignon, O., Tranduy, D., Poirier, C., Vanlierde, A., Veraart, C.,et al. (2004). Visual cortex activation in early blind and sighted subjects using an auditory visual substitution device to perceive depth. Neuroimage 22, S1.
132. Renier, L., Collignon, O., Poirier, C., Tranduy, D., Vanlierde, A., Bol, A.,et al. (2005). Cross modal activation of visual cortex during depth perception using auditory substitution of vision. Neuroimage 26, 573-580. doi: 10.1016/j.neuroimage.2005.01.047
133. Rice, N. J., Valyear, K. F., Goodale, M. A., Milner, A. D., and Culham, J. C. (2007). Orientation sensitivity to graspable objects: an fMRI adaptation study. Neuroimage 36, T87-T93. doi: 10.1016/j.neuroimage.2007.03.032
134. Riesenhuber, M., and Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025. doi: 10.1038/14819
135. Sack, A. T. (2006). Transcranial magnetic stimulation, causal structure-function mapping and networks of functional relevance. Curr. Opin. Neurobiol. 16, 593-599. doi: 10.1016/j.conb.2006.06.016
136. Saito, D. N., Okada, T., Morita, Y., Yonekura, Y., and Sadato, N. (2003). Tactile-visual cross-modal shape matching: a functional MRI study. Cogn. Brain Res. 17, 14-25. doi: 10.1016/S0926-6410(03)00076-4
137. Sathian, K. (2005). Visual cortical activity during tactile perception in the sighted and the visually deprived. Dev. Psychobiol. 46, 279-286. doi: 10.1002/dev.20056
138. Sathian, K., Deshpande, G., and Stilla, R. (2013). Neural changes with tactile learning reflect decision-level reweighting of perceptual readout. J. Neurosci. 33, 5387-5398. doi: 10.1523/JNEUROSCI.3482-12.2013
139. Sathian, K., and Lacey, S. (2007). Journeying beyond classical somatosensory cortex. Can. J. Exp. Psychol. 61, 254-264. doi: 10.1037/cjep2007026
140. Sathian, K., Lacey, S., Stilla, R., Gibson, G., Deshpande, G., Hu, X.,et al. (2011). Dual pathways for somatosensory information processing. Neuroimage 57, 462-475. doi: 10.1016/j.neuroimage.2011.05.001
141. Sathian, K., Zangaladze, A., Hoffman, J. M., and Grafton, S. T. (1997). Feeling with the mind's eye. Neuroreport 8, 3877-3881. doi: 10.1097/00001756-199712220-00008
142. Sawamura, H., Georgieva, S., Vogels, R., Vanduffel, W., and Orban, G. A. (2005). Using functional magnetic resonance imaging to assess adaptation and size invariance of shape processing by humans and monkeys. J. Neurosci. 25, 4294-4306. doi: 10.1523/JNEUROSCI.0377-05.2005
143. Silvanto, J., Schwarzkopf, D. S., Gilaie-Dotan, S., and Rees, G. (2010). Differing causal roles for lateral occipital complex and occipital face area in invariant shape recognition. Eur. J. Neurosci. 32, 165-171. doi: 10.1111/j.1460-9568.2010.07278.x
144. Skinner, A. L., and Benton, C. P. (2010). Anti-expression aftereffects reveal prototype-referenced coding of facial expressions. Psychol. Sci. 21, 1248-1253. doi: 10.1177/0956797610380702
145. Smith, E. E., Patalano, A. L., and Jonides, J. (1998). Alternative strategies of categorization. Cognition 65, 167-196. doi: 10.1016/S0010-0277(97)00043-7
146. Snow, J. C., Strother, L., and Humphreys, G. W. (2014). Haptic shape processing in visual cortex. J. Cogn. Neurosci. 26, 1154-1167. doi: 10.1162/jocn_a_00548
147. Stilla, R., and Sathian, K. (2008). Selective visuo-haptic processing of shape and texture. Hum. Brain Mapp. 29, 1123-1138. doi: 10.1002/hbm.20456
148. Stoesz, M., Zhang, M., Weisser, V. D., Prather, S. C., Mao, H., and Sathian, K. (2003). Neural networks active during tactile form perception: common and differential activity during macrospatial and microspatial tasks. Int. J. Psychophysiol. 50, 41-49. doi: 10.1016/S0167-8760(03)00123-5
149. Streri, A., and Molina, M. (1994). "Constraints on intermodal transfer between touch and vision in infancy," in The Development of Intersensory Perception: Comparative Perspectives, eds D. J. Lewkowicz and R. Lickliter (Hove: Lawrence Erlbaum Associates), 285-307.
150. Takahashi, C., and Watt, S. J. (2014). Visual-haptic integration with pliers and tongs: signal 'weights' take account of changes in haptic sensitivity caused by different tools. Front. Psychol. 5:109. doi: 10.3389/fpsyg.2014.00109
151. Tal, N., and Amedi, A. (2009). Multisensory visual-tactile object related network in humans: insights gained using a novel crossmodal adaptation approach. Exp. Brain Res. 198, 165-182. doi: 10.1007/s00221-009-1949-4
152. Tarr, M. J., and Pinker, S. (1989). Mental rotation and orientation dependence in shape recognition. Cogn. Psychol. 21, 233-282. doi: 10.1016/0010-0285(89)90009-1
153. Ueda, Y., and Saiki, J. (2007). Viewpoint independence in visual and haptic object recognition. Jpn. J. Psychon. Sci. 26, 11-19.
154. Ueda, Y., and Saiki, J. (2012). Characteristics of eye movements in 3-D object learning: comparison between within-modal and cross-modal object recognition. Perception 41, 1289-1298. doi: 10.1068/p7257
155. Ungerleider, L. G., and Mishkin, M. (1982). "Two cortical visual systems," in Analysis of Visual Behavior, eds D. J. Ingle, M. A. Goodale, and R. J. W. Mansfield (Cambridge, MA: MIT Press), 549-586.
156. Uttl, B., Graf, P., and Siegenthaler, A. L. (2007). Influence of object size on baseline identification, priming, and explicit memory. Scand. J. Psychol. 48, 281-288. doi: 10.1111/j.1467-9450.2007.00571.x
157. Valyear, K. F., Culham, J. C., Sharif, N., Westwood, D., and Goodale, M. A. (2006). A double dissociation between sensitivity to changes in object identity and object orientation in the ventral and dorsal streams: a human fMRI study. Neuropsychologia 44, 218-228. doi: 10.1016/j.neuropsychologia.2005.05.004
158. Wallraven, C. (2014). Touching on face space: comparing visual, and haptic processing of face shapes. Psychon. Bull. Rev. doi: 10.3758/s13423-013-0577-y [Epub ahead of print].
159. Wallraven, C., Bülthoff, H. H., Waterkamp, S., van Dam, L., and Gaiβert, N. (2013). The eyes grasp, the hands see: metric category knowledge transfers between vision and touch. Psychon. Bull. Rev. doi: 10.3758/s13423-013-0563-4 [Epub ahead of print].
160. Wallraven, C., and Dopjans, L. (2013). Visual experience is necessary for efficient haptic face recognition. Neuroreport 24, 254-258. doi: 10.1097/WNR.0b013e32835f00c0
161. Wilson, K., and Farah, M. J. (2006). Distinct patterns of viewpoint-dependent BOLD activity during common-object recognition and mental rotation. Perception 35, 1351-1366. doi: 10.1068/p5571
162. Woods, A. T., Moore, A., and Newell, F. N. (2008). Canonical views in haptic object perception. Perception 37, 1867-1878. doi: 10.1068/p6038
163. Woods, A. T., O'Modhrain, S., and Newell, F. N. (2004). The effect of temporal delay and spatial differences on crossmodal object recognition. Cogn. Affect. Behav. Neurosci. 4, 260-269. doi: 10.3758/CABN.4.2.260
164. Yildirim, I., and Jacobs, R. A. (2013). Transfer of object category knowledge across visual and haptic modalities: experimental and computational studies. Cognition 126, 135-148. doi: 10.1016/j.cognition.2012.08.005
165. Yin, R. K. (1969). Looking at upside-down faces. J. Exp. Psychol. 81, 141-145. doi: 10.1037/h0027474
166. Zangaladze, A., Epstein, C. M., Grafton, S. T., and Sathian, K. (1999). Involvement of visual cortex in tactile discrimination of orientation. Nature 401, 587-590. doi: 10.1038/44139
167. Zhang, M., Weisser, V. D., Stilla, R., Prather, S. C., and Sathian, K. (2004). Multisensory cortical processing of object shape and its relation to mental imagery. Cogn. Affect. Behav. Neurosci. 4, 251-259. doi: 10.3758/CABN.4.2.251
168. Zhou, Y.-D., and Fuster, J. M. (1997). Neuronal activity of somatosensory cortex in a cross-modal (visuo-haptic) memory task. Exp. Brain Res. 116, 551-555. doi: 10.1007/PL00005783