A hierarchical system for a distributed representation of the peripersonal space of a humanoid robot

IEEE Transactions on Autonomous Mental Development

Volumn 6, Issue 4, 2014, Pages 259-273

  Antonelli, Marco ^a   Gibaldi, Agostino ^b   Beuth, Frederik ^c   Duran, Angel J ^a   Canessa, Andrea ^b   Chessa, Manuela ^b   Solari, Fabio ^b   Del Pobil, Angel P ^d   Hamker, Fred ^c   Chinellato, Eris ^e   Sabatini, Silvio P ^b  

^a UNIVERSITAT JAUME I   (Spain)

^b UNIVERSITY OF GENOA   (Italy)

^c CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

^d Sungkyunkwan University   (South Korea)

^e UNIVERSITY OF LEEDS   (United Kingdom)

Author keywords

Humanoid robot; Implicit distributed representation; Object recognition; Sensorimotor learning; Visual cortex

Indexed keywords

ANTHROPOMORPHIC ROBOTS; BRAIN; COGNITIVE SYSTEMS; HIERARCHICAL SYSTEMS; OBJECT RECOGNITION;

COGNITIVE ARCHITECTURES; DISTRIBUTED REPRESENTATION; HUMANOID ROBOT; PERCEPTION AND ACTIONS; POSTERIOR PARIETAL CORTICES; SENSORIMOTOR LEARNING; UNSTRUCTURED ENVIRONMENTS; VISUAL CORTEXES;

ROBOTS;

EID: 84919763903     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2014.2332875     Document Type: Article

References (81)

1. M. Bertero, T. A. Poggio, and V. Torre, "Ill-posed problems in early vision," Proc. IEEE, vol. 76, no. 8, pp. 869-889, Aug. 1988.
2. J. Aloimonos, I. Weiss, and A. Bandyopadhyay, "Active vision," Int. J. Comput. Vision, pp. 333-356, 1988.
3. F. Wörgötter, A. Agostini, N. Krüger, N. Shylo, and B. Porr, "Cognitive agents: A procedural perspective relying on the predictability of Object-Action-Complexes (OACs)," Robot. Autonom. Syst., vol. 57, no. 4, pp. 420-432, Apr. 2009.
4. B. Rasolzadeh and M. Björkman, "An active vision system for detecting, fixating and manipulating objects in the real world," Int. J. Robot. Res., vol. 29, no. 2-3, pp. 1-40, 2010.
5. P. Azad, T. Asfour, and R. Dillmann, "Stereo-based 6d object localization for grasping with humanoid robot systems," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), 2007, pp. 919-924.
6. S. Calinon, F. Guenter, and A. Billard, "On learning, representing, and generalizing a task in a humanoid robot," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 2, pp. 286-98, Apr. 2007.
7. T. Shibata, S. Vijayakumar, J. Conradt, and S. Schaal, "Biomimetic oculomotor control," Adapt. Behav., vol. 9, no. 3-4, pp. 189-207, 2001.
8. H. Hoffmann, W. Schenck, and R. Möller, "Learning visuomotor transformations for gaze-control and grasping," Biol. Cybern., vol. 93, no. 2, pp. 119-130, 2005.
9. S. McBride, J. Law, and M. Lee, "Integration of active vision and reaching from a developmental robotics perspective," IEEE Trans. Autonom. Mental Develop., vol. 2, no. 4, pp. 355-366, Dec. 2010.
10. B. Grzyb, E. Chinellato, A. Morales, and A. P. del Pobil, "A 3d grasping system based on multimodal visual and tactile processing," Ind. Robot, vol. 36, no. 4, pp. 365-369, 2009.
11. F. Hamker, "The emergence of attention by population-based inference and its role in distributed processing and cognitive control of vision," Comput. Vis. Image Understanding, vol. 100, no. 1-2, pp. 64-106, Oct. 2005.
12. E. Chinellato, B. J. Grzyb, N. Marzocchi, A. Bosco, P. Fattori, and A. P. del Pobil, "The dorso-medial visual stream: From neural activation to sensorimotor interaction," Neurocomp., vol. 74, no. 8, pp. 1203-1212, 2011.
13. M. A. Goodale and A. D. Milner, Separate Visual Pathways for Perception Action, vol. 15, no. 1, pp. 20-25, Jan. 1992.
14. M. Goodale and D. Westwood, "An evolving view of duplex vision: Separate but interacting cortical pathways for perception and action," Current Opinion Neurobiol., vol. 14, no. 2, pp. 203-211, 2004.
15. M. Chessa, S. P. Sabatini, and F. Solari, "A fast joint bioinspired algorithm for optic flow and two-dimensional disparity estimation," in Proc. ICVS, 2009, pp. 184-193.
16. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Robust object recognition with cortex-like mechanisms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 411-426, Mar. 2007.
17. A. Gibaldi, M. Chessa, A. Canessa, S. P. Sabatini, and F. Solari, "A cortical model for binocular vergence control without explicit calculation of disparity," Neurocomput., vol. 73, pp. 1065-1073, 2010.
18. Y. Wang and B. Shi, "Improved binocular vergence control via a neural network that maximizes an internally defined reward," IEEE Trans. Autonom. Mental Develop., vol. 3, no. 3, pp. 247-256, Sep. 2011.
19. E. Chinellato, M. Antonelli, B. Grzyb, and A. P. del Pobil, "Implicit sensorimotor mapping of the peripersonal space by gazing and reaching," IEEE Trans. Autonom. Mental Develop., vol. 3, no. 1, pp. 45-53, Mar. 2011.
20. B. Girard and A. Berthoz, "From brainstem to cortex: Computational models of saccade generation circuitry," Progress Neurobiol., vol. 77, no. 4, pp. 215-251, 2005.
21. I. Ohzawa, R. Freeman, and G. DeAngelis, "Stereoscopic depth discrimination in the visual cortex: Neurons ideally suited as disparity detectors," Science, vol. 249, pp. 1037-1041, 1990.
22. S. Prince, B. Cumming, and A. Parker, "Range and mechanism of encoding of horizontal disparity in macaque v1," J. Neurophysiol., vol. 87, pp. 209-221, 2002.
23. N. K. Logothetis, J. Pauls, and T. Poggio, "Spatial reference frames for object recognition. tuning for rotations in depth," in AI Memo 1533. Cambridge, MA, USA: MIT Press, 1995.
24. A. Takemura, Y. Inoue, K. Kawato, C. Quaia, and F. Miles, "Single-unit activity in cortical area mst associated with disparity-vergence eye movements: Evidence for population coding," J. Neurophysiol., vol. 85, no. 5, pp. 2245-2266, 2001.
25. J. T. Enright, "Changes in vergence mediated by saccades," J. Physiol., vol. 350, pp. 9-31, 1984.
26. E. Castet and G. S. Masson, "Motion perception during saccadic eye movements," Nature Neurosci., vol. 3, no. 2, pp. 177-183, 2000.
27. H. Deubel, "Separate adaptive mechanisms for the control of reactive and volitional saccadic eye movements," Vis. Res., vol. 35, no. 23-24, pp. 3529-3540, Dec. 1995.
28. D. Munoz and R. Wurtz, "Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cells," J. Neurophysiol., vol. 73, no. 6, pp. 2313-2333, 1995.
29. U. Büttner and J. A. Büttner-Ennever, "Present concepts of oculomotor organization," Progress Bain Res., vol. 151, pp. 1-42, Jan. 2006.
30. C. J. Bruce and M. E. Goldberg, "Primate frontal eye fields. I. Single neurons discharging before saccades," J. Neurophysiol., vol. 53, no. 3, pp. 603-35, Mar. 1985.
31. J. D. Schall, "Neuronal activity related to visually guided saccades in the frontal eye fields of rhesus monkeys: Comparison with supplementary eye fields," J. Neurophysiol., vol. 66, no. 2, pp. 559-79, Aug. 1991.
32. F. H. Hamker, "The reentry hypothesis: The putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eyemovement," Cereb. Cortex, vol. 15, no. 4, pp. 431-47, Apr. 2005.
33. S. Szczepanski and Y. Saalmann, "Human fronto-parietal and parieto-hippocampal pathways represent behavioral priorities in multiple spatial reference frames," Bioarchitecture, vol. 3, no. 5, pp. 147-152, 2013.
34. C. A. Buneo, M. R. Jarvis, A. P. Batista, and R. A. Andersen, "Direct visuomotor transformations for reaching," Nature, vol. 416, no. 6881, pp. 632-6, Apr. 2002.
35. N. Marzocchi, R. Breveglieri, C. Galletti, and P. Fattori, "Reaching activity in parietal area V6A of macaque: Eye influence on arm activity or retinocentric coding of reaching movements?," Eur. J. Neurosci., vol. 27, no. 3, pp. 775-789, 2008.
36. A. Bosco, R. Breveglieri, E. Chinellato, C. Galletti, and P. Fattori, "Reaching activity in the medial posterior parietal cortex of monkeys is modulated by visual feedback," J. Neuroscience, vol. 30, no. 44, pp. 14 773-14 785, 2010.
37. C. Galletti, D. Kutz, M. Gamberini, R. Breveglieri, and P. Fattori, "Role of the medial parieto-occipital cortex in the control of reaching and grasping movements," Exp. Brain Res., vol. 153, no. 2, pp. 158-170, 2003.
38. P. Fattori, R. Breveglieri, V. Raos, A. Bosco, and C. Galletti, "Vision for action in the macaque medial posterior parietal cortex," J. Neuroscience, vol. 32, no. 9, pp. 3221-3234, 2012.
39. C. A. Buneo and R. A. Andersen, "Integration of target and hand position signals in the posterior parietal cortex: Effects of workspace and hand vision," J. Neurophysiol., vol. 108, no. 1, p. 187, 2012.
40. M. Antonelli, E. Chinellato, and A. P. del Pobil, "On-line learning of the visuomotor transformations on a humanoid robot," in Intelligent Autonomous Systems 12, ser. ser. Advances in Intelligent Systems and Computing, S. Lee, H. Cho, K.-J. Yoon, and J. Lee, Eds. Berlin, Germany: Springer-Verlag, 2013, vol. 193, pp. 853-861.
41. D. H. Hubel and T. N. Wiesel, "Receptive fields and functional architecture of monkey striate cortex," J. Physiol., vol. 195, no. 1, p. 215, 1968.
42. D. Albrecht and D. Hamilton, "Striate cortex of monkey and cat: Contrast response function," J. Neurophysiol, vol. 48, no. 1, 1982.
43. N. Qian, "Computing stereo disparity and motion with known binocular cell properties," Neural Comput., vol. 6, no. 3, pp. 390-404, 1994.
44. S. P. Sabatini, G. Gastaldi, F. Solari, K. Pauwels, M. V. Hulle, J. Diaz, E. Ros, N. Pugeault, and N. Krüger, "A compact harmonic code for early vision based on anisotropic frequency channels," Comput. Vis. Image Understanding, vol. 114, no. 6, pp. 681-699, 2010.
45. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol., vol. 160, no. 1, p. 106, 1962.
46. F. Beuth, J. Wiltschut, and F. Hamker, "Attentive stereoscopic object recognition," in Proc. Workshop New Challenges Neural Computation, T. Villmann and F.-M. Schleif, Eds., Chemnitz, Germany, 2010, p. 41.
47. M.W. Spratling, "Learning viewpoint invariant perceptual representations from cluttered images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 753-61, May 2005.
48. M. Teichmann, J. Wiltschut, and F. H. Hamker, "Learning invariance from natural images inspired by observations in the primary visual cortex," Neural Comput., vol. 24, no. 5, pp. 1271-96, May 2012.
49. M. Riesenhuber and T. Poggio, "Hierarchical models of object recognition in cortex," Nature Neurosci., vol. 2, pp. 1019-1025, 1999.
50. L. Itti and C. Koch, "Computational modelling of visual attention," Nature Rev. Neurosci., vol. 2, no. 3, pp. 194-203, Mar. 2001.
51. G. Masson, C. Busettini, and F. Miles, "Vergence eye movements in response to binocular disparity without depth perception," Nature, vol. 389, pp. 283-286, 1997.
52. O. D. Faugeras, Q.-T. Luong, and T. Papadopoulo, The Geometry of Multiple Images - The Laws That Govern the Formation of Multiple Images of a Scene and Some of Their Applications. Cambridge, MA, USA: MIT Press, 2001.
53. M. Hansard and R. Horaud, "Patterns of binocular disparity for a fixating observer," Adv. Brain, Vis., Artif. Intell., pp. 308-317, 2007.
54. Y. Chen and N. Qian, "A coarse-to-fine disparity energy model with both phase-shift and position-shift receptive fieldmechanisms," Neural Comput., vol. 16, no. 8, pp. 1545-1577, 2004.
55. W. M. Theimer and H. A. Mallot, "Phase-based binocular vergence control and depth reconstruction using active vision," Comput. Vis. Image Understanding, vol. 60, no. 3, pp. 343-358, 1994.
56. M. J. Morgan and E. Castet, "The aperture problem in stereopsis," Vis. Res., vol. 37, pp. 2737-2744, 1997.
57. A. Gibaldi, A. Canessa, M. Chessa, S. P. Sabatini, and F. Solari, "A neuromorphic control module for real-time vergence eye movements on the icub robot head," in IProc. EEE/RAS Int. Conf. Humanoid Robots, 2011, pp. 1065-1073.
58. J. Park and I. W. Sandberg, "Universal approximation using radial-basis-function networks," Neural Comput., vol. 3, no. 2, pp. 246-257, Jun. 1991.
59. E. Salinas and P. Thier, "Gain modulation: A major computational principle of the central nervous system," Neuron, vol. 27, no. 1, pp. 15-21, Jul. 2000.
60. A. Pouget and L. Snyder, "Computational approaches to sensorimotor transformations," Nature Neurosci., vol. 3, pp. 1192-1198, 2000.
61. N. B. Karayiannis and A. N. Venetsanopoulos, "Fast learning algorithms for neural networks," IEEE Trans. Circuits Syst. II, Briefs, vol. 39, no. 7, pp. 1-22, Jul. 1992.
62. E. Chinellato, M. Antonelli, and A. P. del Pobil, "A pilot study on saccadic adaptation experimentswith robots," in Biomimetic Biohybrid Syst., ser. ser. LNCS, T. J. Prescott, N. F. Lepora, A. Mura, and P. F. Verschure, Eds. : Springer Berlin Heidelberg, 2012, vol. 7375, pp. 83-94.
63. G. Metta, P. Fitzpatrick, and L. Natale, "Yarp: Yet another robot platform," Int. J. Adv. Rob. Syst., vol. 3, pp. 043-048, Jan. 2006.
64. S. Patel, B. Jiang, and H. Ogmen, "Vergence dynamics predict fixation disparity," Neural Comput., vol. 13, no. 7, pp. 1495-1525, 2001.
65. J. Bruske, M. Hansen, L. Riehn, and G. Sommer, "Biologically inspired calibration-free adaptive saccade control of a binocular camera-head," Biol. Cybern., vol. 77, no. 6, pp. 433-446, 1997.
66. P. Forssén, "Learning saccadic gaze control via motion prediciton," in Proc. 4th Can. Conf. Comput. Robot Vis. (CRV), 2007, pp. 44-54.
67. RobinLab, "A hierarchical System for a Distributed Representation of the Peripersonal space of a humanoid robot," 2014 [Online]. Available: https://www.youtube.com/watch?v=gE9cTqj-16g
68. F. Chao, M. Lee, and J. Lee, "A developmental algorithm for ocular-motor coordination," Robot. Auton. Syst., vol. 58, no. 3, pp. 239-248, 2010.
69. S. McBride and M. Lee, "Fast learning mapping schemes for robotic hand-eye coordination," Cogn. Comput., Jan. 2010.
70. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
71. M. Zirnsak, F. Beuth, and F. H. Hamker, "Split of spatial attention as predicted by a systems-level model of visual attention," Eur. J. Neurosci., vol. 33, no. 11, pp. 2035-45, Jun. 2011.
72. A. Gibaldi, A. Canessa, M. Chessa, F. Solari, and S. P. Sabatini, "Population coding for a reward-modulated hebbian learning of vergence control," in Proc. Int. Joint Conf. Neural Netw. (IJCNN), 2013, pp. 1-8, IEEE.
73. A. Gibaldi, A. Canessa, M. Chessa, F. Solari, and S. P. Sabatini, "How a population-based representation of binocular visual signal can intrinsically mediate autonomous learning of vergence control," Procedia Comput. Sci., vol. 13, pp. 212-221, 2012.
74. M. Antonelli, A. J. Duran, and A. P. Del Pobil, "Application of the visuo-oculomotor transformation to ballistic and visually-guided eye movements," in Proc. Int. Joint Conf. Neural Netw. (IJCNN), 2013, pp. 1-8, IEEE.
75. A. Stenzel, E. Chinellato, M. A. T. Bou, A. P. del Pobil, M. Lappe, and R. Liepelt, "When humanoid robots become human-like interaction partners: Corepresentation of robotic actions," J. Exp. Psychol. Human., vol. 38, no. 5, pp. 1073-1077, 2012.
76. P. Földiák, "Forming sparse representations by local anti-Hebbian learning," Biol. Cybern., vol. 64, pp. 165-170, 1990.
77. J. Heinzle, "A model of the local cortical circuit of the frontal eye fields," Ph.D. dissertation, Swiss Federal Inst. Technol.,, 2006.
78. A. Segraves and E. Goldberg, "Functional properties of corticotectal neurons in the monkey's frontal eye field," J. Neurophysiol., vol. 58, no. 6, pp. 1387-1419, 1987.
79. J. Schall, K. Thompson, N. Bichot, A. Murthy, and T. Sato, "Visual processing in the macaque frontal eye field," in The Primate Visual System, J. Kaas and C. Collins, Eds. New York, NY, USA: Wiley, 2004, pp. 205-230.
80. R. P. Hasegawa, B.W. Peterson, and M. E. Goldberg, "Prefrontal neurons coding suppression of specific saccades," Neuron, vol. 43, no. 3, pp. 415-25, Aug. 2004.
81. J. Schall, "Neural basis of saccade target selection," Rev. Neurosci., vol. 6, pp. 63-85, 1995.