Visual and haptic perceptual spaces show high similarity in humans

Journal of Vision

Volumn 10, Issue 11, 2010, Pages

  Gaißert, Nina ^a   Wallraven, Christian ^b   Bülthoff, Heinrich H ^a,b  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b Korea University   (South Korea)

Author keywords

Haptics; Multidimensional scaling; Perceptual spaces; Similarity ratings; Vision

Indexed keywords

ARTICLE; COMPARATIVE STUDY; HUMAN; PATTERN RECOGNITION; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME;

DISCRIMINATION (PSYCHOLOGY); HUMANS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME;

EID: 79955132415     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/10.11.2     Document Type: Article

References (47)

1. cwdAmedi, A., Malach, R., Hendler, T., Peled, S., & Zohary, E. (2001). Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience, 4, 324-330.
2. Ashby, F. G., Maddox, W. T., & Lee, W. W. (1994). On the dangers of averaging across subjects when using multidimensional-scaling or the similarity-choice model. Psychological Science, 5, 144-151.
3. Bara, F., Gentaz, E., Cole, P., & Sprenger-Charolles, L. (2004). The visuo-haptic and haptic exploration of letters increases the kindergarten-children's understanding of the alphabetic principle. Cognitive Development, 19, 433-449.
4. Borg, I., & Groenen, P. (2005). Modern multidimensional scaling. New York: Springer.
5. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436.
6. Bushnell, E. W., & Baxt, C. (1999). Children's haptic and cross-modal recognition with familiar and unfamiliar objects. Journal of Experimental Psychology: Human Perception and Performance, 25, 1867-1881.
7. Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657.
8. Chuang, L. L., Vuong, Q. C., Thornton, I. M., & Bülthoff, H. H. (2007). Human observers use personal exploration patterns in novel object recognition. Perception, 36, 49-49.
9. Cooke, T., Jäkel, F., Wallraven, C., & Bülthoff, H. H. (2007). Multimodal similarity and categorization of novel, three-dimensional objects. Neuropsychologia, 45, 484-495.
10. Cooke, T., Kannengiesser, S., Wallraven, C., & Bülthoff, H. H. (2006). Object feature validation using visual and haptic similarity ratings. ACM Transactions on Applied Perception, 3, 239-261.
11. Cox, T. F., & Cox, M. A. (2001). Multidimensional scaling (vol. 2). London, UK: Chapman & Hall/CRC.
12. Cutzu, F., & Edelman, S. (1998). Representation of object similarity in human vision: Psychophysics and a computational model. Vision Research, 38, 2229-2257.
13. DiCarlo, J. J., & Cox, D. D. (2007). Untangling invariant object recognition. Trends in Cognitive Sciences, 11, 333-341.
14. Dopjans, L., Wallraven, C., & Bülthoff, H. H. (2009). Cross-modal transfer in visual and haptic face recognition. IEEE Transactions on Haptics, 2, 236-240.
15. Edelman, S. (1999). Representation and recognition in vision. Cambridge, MA: The MIT Press.
16. Edelman, S., Bülthoff, H. H., & Bülthoff, I. (1999). Effects of parametric manipulation of inter-stimulus similarity on 3D object categorization. Spatial Vision, 12, 107-123.
17. Fowler, D. R., Meinhardt, H., & Prusinkiewicz, P. (1992). Modeling seashells. ACM Transactions on Computer Graphics, 26, 379-387.
18. Gibson, E. J. (1988). Exploratory-behavior in the development of perceiving, acting, and the acquiring of knowledgeV9. Annual Review of Psychology, 39, 1-41.
19. Goldstone, R. L. (1994). The role of similarity in categorization: Providing a groundwork. Cognition, 52, 125-157.
20. Goldstone, R. L., & Son, J. (2005). The Cambridge handbook of thinking and reasoning, chapter 2, similarity. In K. J. Holyoak & R. G. Morrison (Eds.), The Cambridge handbook of thinking and reasoning (pp. 13-36). New York: Cambridge University Press.
21. Graf, M., Schwaninger, A., Wallraven, C., & Bülthoff, H. H. (2002). Psychophysical results from experiments on recognition & categorisation (Technical Report No. IST-2000-29375).
22. Harman, K. L., Humphrey, G. K., & Goodale, M. A. (1999). Active manual control of object views facilitates visual recognition. Current Biology, 9, 1315-1318.
23. Jäkel, F., Schölkopf, B., & Wichmann, F. A. (2008). Generalization and similarity in exemplar models of categorization: Insights from machine learning. Psychonomic Bulletin & Review, 15, 256-271.
24. James, K. H., Humphrey, G. K., & Goodale, M. A. (2001). Manipulating and recognizing virtual objects: Where the action is. Canadian Journal of Experimental PsychologyVRevue Canadienne De Psychologie Experimentale, 55, 111-120.
25. James, T. W., Humphrey, G. K., Gati, J. S., Servos, P., Menon, R. S., & Goodale, M. A. (2002). Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia, 40, 1706-1714.
26. Klatzky, R. L., Lederman, S. J., & Metzger, V. A. (1985). Identifying objects by touch: An "expert system". Perception & Psychophysics, 37, 299-302.
27. Kleiner, M., Brainard, D. H., & Pelli, D. G. (2007). What's new in Psychtoolbox-3? Perception, 36 (ECVP 2007 Abstract Supplement).
28. Kourtzi, Z., Erb, M., Grodd, W., & Bülthoff, H. H. (2003). Representation of the perceived 3-D object shape in the human lateral occipital complex. Cerebral Cortex, 13, 911-920.
29. Kruskal, J. B., & Wish, M. (1978). Multidimensional scaling. Beverly Hills, CA: Sage Publications.
30. Langer, M. S., & Bülthoff, H. H. (2001). A prior for global convexity in local shape-from-shading. Perception, 30, 403-410.
31. Norman, J. F., Clayton, A. M., Norman, H. F., & Crabtree, C. E. (2008). Learning to perceive differences in solid shape through vision and touch. Perception, 37, 185-196.
32. Norman, J. F., Norman, H. F., Clayton, A. M., Lianekhammy, J., & Zielke, G. (2004). The visual and haptic perception of natural object shape. Perception & Psychophysics, 66, 342-351.
33. Op de Beeck, H. P., Torfs, K., & Wagemans, J. (2008). Perceived shape similarity among unfamiliar objects and the organization of the human object vision pathway. Journal of Neuroscience, 28, 10111-10123.
34. Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437-442.
35. Plaisier, M. A., Tiest, W. M., & Kappers, A. M. (2009). Salient features in 3-D haptic shape perception. Attention, Perception & Psychophysics, 71, 421-430.
36. Reales, J. M., & Ballesteros, S. (1999). Implicit and explicit memory for visual and haptic objects: Cross-modal priming depends on structural descriptions. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 644-663.
37. Reed, C. L., Shoham, S., & Halgren, E. (2004). Neural substrates of tactile object recognition: An fMRI study. Human Brain Mapping, 21, 236-246.
38. Rosch, E. (1988). Principles of categorization. San Mateo, CA: Morgan Kaufmann Publishers.
39. Shepard, R. N. (1962). The analysis of proximities: Multidimensional scaling with an unknown distance functionVII. Psychometrika, 27, 219-246.
40. Shepard, R. N. (1987). Toward a universal law of generalization for psychological science. Science, 237, 1317-1323.
41. Shepard, R. N. (2001). Perceptual-cognitive universals as reflections of the world. Behavioral Brain Science, 24, 581-601; discussion 652-571.
42. Stone, J. V. (1999). Object recognition: View-specificity and motion-specificity. Vision Research, 39, 4032-4044.
43. Sugihara, T., Edelman, S., & Tanaka, K. (1998). Representation of objective similarity among three-dimensional shapes in the monkey. Biological Cybernetics, 78, 1-7.
44. Thorpe, S., Fize, D., & Marlot, C. (1996). Speed of processing in the human visual system. Nature, 381, 520-522.
45. Torgerson, W. S. (1952). Multidimensional scaling: I. Theory and method. Psychometrika, 17, 401-419.
46. Ullman, S. (1979). The interpretation of visual motion. Cambridge, MA: MIT Press.
47. van der Horst, B. J., & Kappers, A. M. (2008). Using curvature information in haptic shape perception of 3D objects. Experimental Brain Research, 190, 361-367.