Transfer of object category knowledge across visual and haptic modalities: Experimental and computational studies

Cognition

Volumn 126, Issue 2, 2013, Pages 135-148

  Yildirim, Ilker ^a   Jacobs, Robert A ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Categorization; Computational modeling; Experimentation; Learning; Multisensory perception; Touch; Vision

Indexed keywords

ADULT; ARTICLE; COGNITION; EXPERIMENTAL STUDY; FEMALE; GRIP STRENGTH; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NEUROPHYSIOLOGY; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; TACTILE STIMULATION; TOUCH; TRANSFER OF OBJECT CATEGORY KNOWLEDGE; VISION; VISUAL STIMULATION;

FEMALE; FORM PERCEPTION; HUMANS; KNOWLEDGE; LEARNING; MALE; MODELS, PSYCHOLOGICAL; PHYSICAL STIMULATION; RECOGNITION (PSYCHOLOGY); TOUCH; TOUCH PERCEPTION; TRANSFER (PSYCHOLOGY); VISION, OCULAR; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84871801993     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2012.08.005     Document Type: Article

References (45)

1. Amedi A., Jacobson G., Hendler T., Malach R., Zohary E. Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex 2002, 12:1202-1212.
2. Amedi A., Von Kriegstein K., Van Atteveldt N., Beauchamp M.S., Naumer M.J. Functional imaging of human cross-modal identification and object recognition. Experimental Brain Research 2005, 166:559-571.
3. Ballesteros S., Gonzalez M., Mayas J., Garcia-Rodriguez B., Reales J.M. Cross-modal repetition priming in young and old adults. European Journal of Cognitive Psychology 2009, 21:366-387.
4. Barsalou L.W. Grounded cognition. Annual Review of Psychology 2008, 59:617-645.
5. Biederman I. Recognition-by-components: A theory of human image understanding. Psychological Review 1987, 94:115-147.
6. Bishop C.M. Pattern recognition and machine learning 2006, Springer, New York.
7. Brainard D.H. The psychophysics toolbox. Spatial Vision 1997, 10:433-436.
8. Easton R.D., Srinivas K., Greene A.J. Do vision and haptics share common representations? Implicit and explicit memory within and between modalities. Journal of Experimental Psychology: Learning, Memory and Cognition 1997, 23:153-163.
9. Feldman J., Singh M. Bayesian estimation of the shape skeleton. Proceedings of the National Academy of Sciences 2006, 103:18014-18019.
10. Fine I., Wade A.R., Brewer A.A., May M.G., Goodman D.F., Boynton G., et al. Long-term deprivation affects visual perception and cortex. Nature 2003, 6:915-916.
11. Gaißert N., Bülthoff H.H., Wallraven C. Similarity and categorization: From vision to touch. Acta Psychologica 2011, 138:219-230.
12. Gaißert N., Wallraven C. Categorizing natural objects: A comparison of the visual and the haptic modalities. Experimental Brain Research 2012, 216:123-134.
13. Gaißert N., Wallraven C., Bülthoff H.H. Analyzing perceptual representations of complex, parametrically-defined shapes using MDS. Haptics: Perception, devices and scenarios, 6th international conference (EuroHaptics 2008) 2008, 265-274. Springer, Berlin, Germany.
14. Gaißert N., Wallraven C., Bülthoff H.H. Visual and haptic perceptual spaces show high similarity in humans. Journal of Vision 2010, 10(11:2):1-20.
15. Goldstone R.L., Barsalou L. Reuniting perception and conception. Cognition 1998, 65:231-262.
16. Grubbs F.E. Sample criteria for testing outlying observations. Annals of Mathematical Statistics 1950, 21:27-58.
17. Haag S. Effects of vision and haptics on categorizing common objects. Cognitive Processes 2011, 12:33-39.
18. Hayward W.G., Williams P. Viewpoint dependence and object discriminability. Psychological Science 2000, 11:7-12.
19. Held R. Visual-haptic mapping and the origin of cross-modal identity. Optometry and Vision Science 2009, 86:595-598.
20. Held R., Ostrovsky Y., de Gelder B., Gandhi T., Ganesh S., Mathur U., et al. The newly sighted fail to match seen with felt. Nature Neuroscience 2011, 14:551-553.
21. Homa D., Kahol K., Tripathi P., Bratton L., Panchanathan S. Haptic concepts in the blind. Attention, Perception & Psychophysics 2009, 71:690-698.
22. James T.W., Humphrey G.K., Gati J.S., Servos P., Menon R.S., Goodale M.A. Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 2002, 40:1706-1714.
23. Jordan M.I., Rumelhart D.E. Forward models: Supervised learning with a distal teacher. Cognitive Science 1992, 16:307-354.
24. Lacey S., Peters A., Sathian K. Cross-modal object representation is viewpoint-independent. PLoS ONE 2007, 2:e890.
25. Lacey S., Tal N., Amedi A., Sathian K. A putative model of multisensory object representation. Brain Topography 2009, 21:269-274.
26. Lawson R. A comparison of the effects of depth rotation on visual and haptic three-dimensional object recognition. Journal of Experimental Psychology: Human Perception and Performance 2009, 35:911-930.
27. Lederman S.J., Klatzky R.L. Hand movements: A window into haptic object recognition. Cognitive Psychology 1987, 19:342-368.
28. Marr D., Nishihara H.K. Representation and recognition of the spatial organization of three-dimensional shapes. Proceedings of the Royal Society of London. Series B. Biological Sciences 1978, 200(1140):269-294.
29. Miller A., Allen P.K. Graspit!: A versatile simulator for robotic grasping. IEEE Robotics and Automation Magazine 2004, 11:110-122.
30. Minda J.P., Smith J.D. Prototype models of categorization: Basic formulation, predictions, and limitations. Formal approaches in categorization 2011, 40-64. Oxford University Press, New York. E.M. Pothos, A.J. Wills (Eds.).
31. Norman J., Norman H., Clayton A., Lianekhammy J., Zielke G. The visual and haptic perception of natural object shape. Perception and Psychophysics 2004, 66:342-351.
32. Ostrovsky Y., Andalman A., Sinha P. Vision following extended congenital blindness. Psychological Science 2006, 17:1009-1014.
33. Pascual-Leone A., Hamilton R. The metamodal organization of the brain. Progress in Brain Research 2001, 134:427-445.
34. Pelli D.G. The videotoolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 1997, 10:437-442.
35. Quiroga R.Q., Kraskov A., Koch C., Fried I. Explicit encoding of multimodal percepts by single neurons in the human brain. Current Biology 2009, 19:1308-1313.
36. Reales J.M., Ballesteros S. Implicit and explicit memory for visual and haptic objects: Cross-modal priming depends on structural descriptions. Journal of Experimental Psychology: Learning, Memory, and Cognition 1999, 25:644-663.
37. Santello M., Flanders M., Soechting J.F. Postural hand synergies for tool use. Journal of Neuroscience 1998, 18:10105-10115.
38. Tal N., Amedi A. Multisensory visual-tactile object related network in humans: insights gained using a novel crossmodal adaptation approach. Experimental brain research 2009, 198(2):165-182.
39. Tarr M.J. Visual object recognition: Can a single mechanism suffice?. Perception of faces, objects, and scenes: analytic and holistic processes 2003, 177-211. Oxford University Press, New York. M.A. Peterson, G. Rhodes (Eds.).
40. Taylor K.I., Moss H.E., Stamatakis E.A., Tyler L.K. Binding cross-modal object features in perirhinal cortex. Proceedings of the National Academy of Sciences USA 2006, 103:8239-8244.
41. Thakur P.H., Bastian A.J., Hsiao S.S. Multidigit movement synergies of the human hand in an unconstrained haptic exploration task. Journal of Neuroscience 2008, 28:1271-1281.
42. Wilcoxon F. Individual comparisons by ranking methods. Biometrics Bulletin 1945, 1:80-83.
43. Williams, P. (1997). Prototypes, exemplars, and object recognition. Unpublished doctoral dissertation, Department of Psychology, Yale University.
44. Wolpert D.M., Flanagan J.R. Forward models. The Oxford companion to consciousness 2009, 294-296. Oxford University Press, New York. T. Bayne, A. Cleeremans, P. Wilken (Eds.).
45. Wolpert D.M., Kawato M. Multiple paired forward and inverse models for motor control. Neural Networks 1998, 11:1317-1329.