Reinforcing robot perception of multi-modal events through repetition and redundancy and repetition and redundancy

Interaction Studies

Volumn 7, Issue 2, 2006, Pages 171-196

  Fitzpatrick, Paul ^a   Arsenio, Artur ^a   Torres Jara, Eduardo R ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Body schema; Humanoid robotics; Object recognition; Sensor fusion

Indexed keywords

EID: 84883705133     PISSN: 15720373     EISSN: 15720381     Source Type: Journal    
DOI: 10.1075/is.7.2.05fit     Document Type: Article

References (43)

1. Alho, K., Kujala, T., Paavilainen, P., Summala, H., and Näätänen, R. (1993). Auditory processing in visual brain areas of the early blind: evidence from event-related potentials. Electroencephalography and Clinical Neurophysiology, 86(6): 418-427.
2. Arsenio, A. (2004). Cognitive-Developmental Learning for a Humanoid Robot: A Caregiver's Gift. PhD thesis, Massachusetts Institute of Technology. Available as MIT technical report AITR-2004-006.
3. Arsenio, A. and Fitzpatrick, P. (2003). Exploiting cross-modal rhythm for robot perception of objects. In Proceedings of the Second International Conference on Computational Intelligence, Robotics, and Autonomous Systems, Singapore, December 15-18.
4. Arsenio, A., Fitzpatrick, P., Kemp, C.C., and Metta, G. (2003). The whole world in your hand: Active and interactive segmentation. In Proceedings of the Third International Workshop on Epigenetic Robotics, pages 49-56, Boston, MA, USA.
5. Bahrick, L.E. (2003). Development of intermodal perception. In Nadel, L., editor, Encyclopedia of Cognitive Science, volume 2, pages 614-617. Nature Publishing Group, London, UK.
6. Bahrick, L.E. (2004). The development of perception in a multimodal environment. In Bremner, G. and Slater, A., editors, Theories of infant development, pages 90-120. Blackwell Publishing, Malden, MA, USA.
7. Bahrick, L.E. and Lickliter, R. (2000). Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology, 36: 190-201.
8. Baron-Cohen, 1995, S. (1995). Mindblindness. MIT Press, Cambridge, MA, USA.
9. Bashford, J.A., Brubaker, B.S., and Warren, R.M. (1993). Cross-modal enhancement of repetition detection for very long period recycling frozen noise. Journal of the Acoustical Society of America, 93(4): 2315.
10. Bouguet, J. -Y. (1999). Pyramidal implementation of the Lucas-Kanade feature tracker. In OpenCV Documentation. Microprocessor Research Labs, Intel Corporation.
11. Brooks, R.A., Breazeal, C., Marjanovic, M., Scassellati, B., and Williamson, M.M. (1999). The Cog project: Building a humanoid robot. In Nehaniv, C.L., editor, Computation for Metaphors, Analogy and Agents, volume 1562 of Springer Lecture Notes in Artificial Intelligence, pages 52-87. Springer-Verlag.
12. Churchland, P., Ramachandran, V., and Sejnowski, T. (1994). In Koch, C. and Davis, J., editors, Large-Scale Neuronal Theories of the Brain. MIT Press.
13. Cohen, M. and Massaro, D. (1990). Synthesis of visible speech. Behaviour Research Methods, Instruments and Computers, 22(2): 260-263.
14. Fitzpatrick, P. (2003a). Object lesson: discovering and learning to recognize objects. In Proceedings of the Third International Conference on Humanoid Robots, pages 2a-2, Karlsruhe and Munich, Germany, October 1-3.
15. Fitzpatrick, P. (2003b). Perception and perspective in robotics. In Proceedings of the 25th AnnualConference of the Cognitive Science Society, pages 408-413, Boston, MA, USA. Cognitive Science Society, Inc.
16. Fitzpatrick, P. and Torres-Jara, E. (2004). The power of the dark side: using cast shadows for visually-guided reaching. In Proceedings of the 4th IEEE/RAS International Conference on Humanoid Robots, volume 1, pages 437-449, November 10-12.
17. Gallup, G., Anderson, J.R., and Shillito, D.J. (2002). The mirror test. In Bekoff, M., Allen, C., and Burghardt, G.M., editors, The Cognitive Animal: Empirical and Theoretical Perspectives on Animal Cognition, pages 325-33. Bradford Books, Cambridge, MA, USA.
18. Gibson, J.J. (1986). The Ecological Approach to Visual Perception. LawrenceErlbaumAssociates, Hillsdale, NJ, USA.
19. Hendriks-Jansen, H. (1996). Catching Ourselves in the Act. MIT Press, Cambridge, MA, USA.
20. Hernandez-Reif, M. and Bahrick, L.E. (2001). The development of visual-tactual perception of objects: Amodal relations provide the basis for learning arbitrary relations. Infancy, 2(1): 51-72.
21. Hershey, J. and Movellan, J. (2000). Audio-vision: Using audio-visual synchrony to locate sounds. In Solla, S.A., Leen, T.K., and Muller, K.R., editors, Advances in Neural Information Processing Systems, number 12, pages 813-819, Cambridge, MA, USA. MIT Press.
22. Hu, H.H., Gooch, A.A., Creem-Regehr, S.H., and Thompson, W.B. (2002). Visual cues for perceiving distances from objects to surfaces. Presence: Teleoperators and Virtual Environments, 11(6): 652-664.
23. Hu, H.H., Gooch, A.A., Thompson, W.B., Smits, B.E., Rieser, J.J., and Shirley, P. (2000). Visual cues for imminent object contact in realistic virtual environments. In Proceedings of the 11th IEEE Conference on Visualization, pages 179-185, Salt Lake City, UT, USA, October 8-13.
24. Hubona, G.S., Shirah, G., and Jennings, D. (2004). The effects of cast shadows and stereopsis on performing computer-generated spatial tasks. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 34(4): 483-493.
25. Hubona, G.S., Wheeler, P.N., Shirah, G.W., and Brandt, M. (1999). The relative contributions of stereo, lighting, and background scenes in promoting 3D depth visualization. ACM Transactions on Computer-Human Interaction, 6(3): 214-242.
26. Kaernbach, C. (1993). Temporal and spectral basis of the features perceived in repeated noise. Journal of the Acoustical Society of America, 94(1): 91-97.
27. Knudsen, E.I. and Knudsen, P.F. (1985). Vision guides the adjustment of auditory localization in young barn owls. Science, 230: 545-548.
28. Kozima, H. and Yano, H. (2001). A robot that learns to communicate with human caregivers. In Proceedings of the First International Workshop on Epigenetic Robotics, pages 47-52, Lund, Sweden, September 17-18.
29. Kozima, H. and Zlatev, J. (2000). An epigenetic approach to human-robot communication. In Proceedings of the IEEE International Workshop on Robot and Human Interaction, pages 346-351, Osaka, Japan, September 27-29.
30. Krotkov, E., Klatzky, R., and Zumel, N. (1995). Robotic perception of material: Experiments with shape-invariant acoustic measures of material type. In Khatib, O. and Salisbury, K., editors, Proceedings of the 4th International Symposium on Experimental Robotics, pages 204-211. Springer-Verlag.
31. Lee, D.N. (1980). The optic flow field: the foundation of vision. Philosophical Transactions of the Royal Society of London B, 290(1038): 169-179.
32. Lewkowicz, D.J. (2000). The development of intersensory temporal perception: an epigenetic systems/limitations view. Psychological Bulletin, 126: 281-308.
33. Lewkowicz, D.J. (2003). Learning and discrimination of audiovisual events in human infants: The hierarchical relation between intersensory temporal synchrony and rhythmic pattern cues. Developmental Psychology, 39(5): 795-804.
34. Lewkowicz, D.J. and Turkewitz, G. (1980). Cross-modal equivalence in early infancy: Auditory-visual intensity matching. Developmental Psychology, 16: 597-607.
35. Metta, G. and Fitzpatrick, P. (2003). Early integration of vision and manipulation. Adaptive Behavior, 11(2): 109-128.
36. Pavani, F. and Castiello, U. (2004). Binding personal and extrapersonal space through body shadows. Nature Neuroscience, 7(1): 14-15.
37. Prince, C.G. and Hollich, G.J. (2005). Synching models with infants: a perceptual-level model of infant audio-visual synchrony detection. Journal of Cognitive Systems Research, 6(3): 205-228.
38. Rochat, P. and Striano, T. (2002). Who's in the mirror? self-other discrimination in specular images by four-and nine-month-old infants. Child Development, 73(1): 35-46.
39. Scassellati, B. (2001). Foundations for a Theory of Mind for a Humanoid Robot. PhD thesis, Massachusetts Institute of Technology.
40. Shelov, S.P. and Hannemann, R.E., editors (1998). Caring for Your Baby and Young Child: Birth to Age 5. Bantham Books, New York.
41. Stoytchev, A. (2003). Computational model for an extendable robot body schema. Technical report, Georgia Institute of Technology, College of Computing. GIT-CC-03-44.
42. von der Malsburg, C. (1995). Binding in models of perception and brain function. Current Opinion in Neurobiology, 5: 520-526.
43. Wertheimer, M. (1961). Psychomotor coordination of auditory and visual space at birth. Science, 134: 1692.