Development of object and grasping knowledge by robot exploration

IEEE Transactions on Autonomous Mental Development

Volumn 2, Issue 4, 2010, Pages 368-383

  Kraft, Dirk ^a   Detry, Renaud ^b   Pugeault, Nicolas ^c   Başeski, Emre ^a   Guerin, Frank ^d   Piater, Justus H ^b   Krüger, Norbert ^a  

^a UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^b UNIVERSITY OF LIÈGE   (Belgium)

^c UNIVERSITY OF SURREY   (United Kingdom)

^d UNIVERSITY OF ABERDEEN   (United Kingdom)

Author keywords

Active exploration of environment; hardware platform for development; robots with development and learning skills; using robots to study development and learning

Indexed keywords

ACTIVE EXPLORATIONS; AFFORDANCES; COGNITIVE ROBOTS; DEVELOPMENTAL STAGE; HARDWARE PLATFORM FOR DEVELOPMENT; INTERNAL REPRESENTATION; OBJECT REPRESENTATIONS; ROBOT EXPLORATION; USING ROBOTS TO STUDY DEVELOPMENT AND LEARNING;

COGNITIVE SYSTEMS; HARDWARE;

ROBOTS;

EID: 78650141931     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2010.2069098     Document Type: Article

References (73)

1. D. Vernon, G. Metta, and G. Sandini, "A survey of artificial cognitive systems: Implications for the autonomous development of mental capabilities in computational agents," IEEE Trans. Evol. Comput., vol. 11, no. 2, pp. 151-180, Apr. 2007.
2. R. Brooks, "Intelligence without reason," in Proc. Int. Joint Conf. Artif. Intell., Sydney, NSW, Australia, 1991, pp. 569-595.
3. J. Locke, Essay Concerning Human Understanding 1690.
4. S. Geman, E. Bienenstock, and R. Doursat, "Neural networks and the bias/variance dilemma," Neural Comput., vol. 4, pp. 1-58, 1992.
5. T. G. R. Bower Development in Infancy. San Francisco, CA: Freeman, 1982.
6. P. Fitzpatrick and G. Metta, "Grounding vision through experimental manipulation," Philos. Trans. Roy. Soc. Math. Phys. Eng. Sci., vol. 361, no. 1811, pp. 2165-2185, Oct. 2003.
7. E. Spelke, "Principles of object perception," Cogn. Sci., vol. 14, pp. 29-56, 1990.
8. J. G. Bremner Infancy. Cambridge, MA: Blackwell, 1994.
9. B. C. L. Touwen, "A study on the development of some motor phenomena in infancy," Develop. Med. Child Neurol., vol. 13, pp. 435-446, 1971.
10. D. A. Caruso, "Dimensions of quality in infants' exploratory behavior: Relationships to problem-solving ability," Inf. Behav. Develop., vol. 16, no. 4, pp. 441-454, Oct. 1993.
11. E. J. Gibson, "Perceptual learning in development: Some basic concepts," Ecol. Psychol., vol. 12, no. 4, pp. 295-302, Oct. 2000.
12. R. Detry, N. Pugeault, and J. Piater, "A probabilistic framework for 3-D visual object representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1790-1803, Oct. 2009.
13. D. Kraft, R. Detry, N. Pugeault, E. Başeski, J. Piater, and N. Krüger, "Learning objects and grasp affordances through autonomous exploration," in Computer Vision Systems, ser. Lecture Notes Comput. Sci. Berlin, Germany: Springer-Verlag, 2009, vol. 5815, ch. 24, pp. 235-244.
14. R. Detry, D. Kraft, A. G. Buch, N. Krüger, and J. Piater, "Refining grasp affordance models by experience," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Anchorage, AK, 2010, pp. 2287-2293.
15. M. Popović, D. Kraft, L. Bodenhagen, E. Basȩski, N. Pugeault, D. Kragic, T. Asfour, and N. Krüger, "A strategy for grasping unknown objects based on co-planarity and colour information," Robot. Autonom. Syst., vol. 58, no. 5, pp. 551-565, May 2010.
16. N. Pugeault, F. Wörgötter, and N. Krüger, "Accumulated visual representation for cognitive vision," in Proc. Brit. Mach. Vis. Conf. (BMVC), Leeds, U.K., 2008.
17. K. Shimoga, "Robot grasp synthesis algorithms: A survey," Int. J. Robot. Res., vol. 15, no. 3, pp. 230-266, 1996.
18. A. Bicchi and V. Kumar, "Robotic grasping and contact: A review," in Proc. IEEE Int. Conf. Robot. Autom., San Francisco, CA, 2000, pp. 348-353.
19. A. Saxena, J. Driemeyer, and A. Y. Ng, "Robotic grasping of novel objects using vision," Int. J. Robot. Res., vol. 27, no. 2, pp. 157-173, Feb. 2008. (Pubitemid 351169712)
20. C. de Granville, J. Southerland, and A. H. Fagg, "Learning grasp affordances through human demonstration," in Proc. Int. Conf. Develop. Learn. (ICDL'06), New Delhi, India, 2006.
21. L. Montesano and M. Lopes, "Learning grasping affordances from local visual descriptors," in Proc. IEEE 8th Int. Conf. Develop. Learn. (ICDL), Shanghai, China, Jun. 2009.
22. E. Chinellato, A. Morales, E. Cervera, and A. P. del Pobil, "Symbol grounding through robotic manipulation in cognitive systems," Robot. Autonom. Syst., vol. 55, no. 12, pp. 851-859, Dec. 2007.
23. E. Sahin, M. Cakmak, M. Dogar, E. Ugur, and G. Ucoluk, "To afford or not to afford: A new formalization of affordances toward affordancebased robot control," Adapt. Behav., vol. 15, no. 4, pp. 447-472, Dec. 2007.
24. J. Modayil and B. Kuipers, "Bootstrap learning for object discovery," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), Sendai, Japan, 2004, vol. 1, pp. 742-747.
25. J. Modayil and B. Kuipers, "Autonomous development of a grounded object ontology by a learning robot," in Proc. AAAI Spring Symp. Contr. Mech. Spatial Knowledge Process. Cogn./Intell. Syst., Stanford, CA, 2007.
26. A. Stoytchev, "Toward learning the binding affordances of objects: A behavior-grounded approach," in Proc. AAAI Symp. Develop. Robot., Stanford, CA, 2005, pp. 17-22.
27. A. Stoytchev, "Learning the affordances of tools using a behavior-grounded approach," in Towards Affordance-Based Robot Control, ser. Lecture Notes in Comp. Sci. Berlin, Germany: Springer-Verlag, 2008, vol. 4760, ch. 10, pp. 140-158.
28. Video "Grasping Without Object Knowledge" [Online]. Available: http://www.mip.sdu.dk/covig/videos/graspingReflexCompressed.divx
29. Video "Grasping and Accumulation" [Online]. Available: http://www. mip.sdu.dk/covig/videos/grasping.And.Accumulation.New.wmv
30. R. P. A. Petrick, D. Kraft, N. Krüger, and M. Steedman, "Combining cognitive vision, knowledge-level planning with sensing, and execution monitoring for effective robot control," in Proc. 4th Workshop Plann. Plan Execution Real-World Syst. ICAPS, Thessaloniki, Greece, Sep. 2009, pp. 58-65.
31. R. S. Siegler Emerging Minds: The Process of Change in Children's Thinking. London, U.K.: Oxford Univ. Press, 1998.
32. P. Willatts, "Development of problem-solving strategies in infancy," in Childrens Strategies: Contemporary Views of Cognitive Development, D. Bjorklund, Ed. Hillsdale, NJ: Erlbaum, 1990, pp. 23-66.
33. A. Baddeley Working Memory, Thought, and Action. London, U.K.: Oxford Univ. Press, 2007.
34. E. Averbach and G. Sperling, "Short term storage of information in vision," in Information Theory. London, U.K.: Butterworths, 1961, pp. 196-211.
35. J. Piaget The Origins of Intelligence in Children. London, U.K.: Routledge, 1936.
36. N. Krüger, M. Lappe, and F. Wörgötter, "Biologically motivated multimodal processing of visual primitives," Interdis. J. Artif. Intell. Simul. Behav., vol. 1, no. 5, pp. 417-428, 2004.
37. N. Pugeault, F. Wörgötter, and N. Krüger, "Visual primitives: Local, condensed, and semantically rich visual descriptors and their applications in robotics," Int. J. Humanoid Robot. (Special Issue Cogn. Humanoid Vis.), accepted for publication.
38. E. Bas ̧eski, N. Pugeault, S. Kalkan, L. Bodenhagen, J. H. Piater, and N. Krüger, "Using multi-modal 3-D contours and their relations for vision and robotics," J. Vis. Commun. Image Rep., 2010, accepted for publication.
39. M. Ciocarlie and P. Allen, "Hand posture subspaces for dexterous robotic grasping," Int. J. Robot. Res., vol. 28, no. 7, pp. 851-867, 2009.
40. J. Pearl Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann, 1988.
41. E. B. Sudderth, "Graphical Models for Visual Object Recognition and Tracking," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, MA, 2006.
42. B. W. Silverman Density Estimation for Statistics and Data Analysis. London, U.K.: Chapman & Hall, 1986.
43. J. J. Gibson The Ecological Approach to Visual Perception. Boston, MA: Houghton Mifflin, 1979.
44. D. Kraft, N. Pugeault, E. Bas ̧eski, M. Popović, D. Kragic, S. Kalkan, F. Wörgötter, and N. Krüger, "Birth of the object: Detection of objectness and extraction of object shape through object action complexes," Special Issue "Cogn. Humanoid Robot." Int. J. Humanoid Robot., vol. 5, pp. 247-265, 2009.
45. Video "Learning Grasp Affordance Densities' [Online]. Available: http://www.mip.sdu.dk/covig/videos/grasp\-densities.avi
46. S. Pinker How the Mind Works. New York: Norton, 1999.
47. T. N. Wiesel and D. H. Hubel, "Ordered arrangement of orientation columns in monkeys lacking visual experience," J. Compar. Neurol., vol. 158, no. 3, pp. 307-318, Dec. 1974.
48. I. Gödecke and T. Bonhoeffer, "Development of identical orientation maps for two eyes without common visual experience," Nature, vol. 379, pp. 251-255, 1996.
49. M. Sur, P. Garraghty, and A. Roe, "Experimentally induced visual projections into auditory thalamus and cortex," Science, vol. 242, no. 4884, pp. 1437-1441, Dec. 1988.
50. B. Chapman, M. P. Stryker, and T. Bonhoeffer, "Development of orientation preference maps in ferret primary visual cortex," J. Neurosci., vol. 16, no. 20, pp. 6443-6453, 1996. (Pubitemid 26337368)
51. B. Olshausen and D. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol. 381, no. 6583, pp. 607-609, 1996.
52. N. Krüger and F. Wörgötter, "Statistical and deterministic regularities: Utilisation of motion and grouping in biological and artificial visual systems," Adv. Imaging Electr. Phys., vol. 131, pp. 82-147, 2004.
53. A. Yonas, L. Pettersen, and C. E. Granrud, "Infants' sensitivity to familiar size as information for distance," Child Develop., vol. 53, no. 5, pp. 1285-1290, Oct. 1982.
54. P. Kellman and M. Arterberry The Cradle of Knowledge. Cambridge, MA: MIT Press, 1998.
55. R. Held, E. Birch, and J. Gwiazda, "Stereo acuity in human infants," Proc. Nat. Acad. Sci., vol. 77, no. 9, pp. 5572-5574, Sep. 1980.
56. N. Chater, J. Tenenbaum, and A. Yuille, "Probabilistic models of cognition: Conceptual foundations," Trends Cogn. Sci., vol. 10, no. 7, pp. 287-291, Jul. 2006.
57. W. Köhler The Mentality of Apes. New York: Harcourt Brace and World, 1925.
58. K. C. Soska and S. P. Johnson, "Development of three-dimensional object completion in infancy," Child Develop., vol. 79, no. 5, pp. 1230-1236, Sep. 2008.
59. K. C. Soska, K. E. Adolph, and S. P. Johnson, "Systems in development: Motor skills acquisition facilitates 3-D object completion," Develop. Psychol., vol. 46, no. 1, pp. 129-138, 2010.
60. J. Piaget La contruction du reel chez l'enfant. Neuchatel, Germany: Delachaux and Niestle, 1937.
61. I. C. Uzgiris and J. M. Hunt Assessment in Infancy: Ordinal Scales of PsychologicalDevelopment. Urbana, IL:Univ. of Illinois Press, 1975.
62. A. Gordon, "Development of the reach to grasp movement," in Insights Into the Reach to Grasp Movement, Advances in Psychology, 105, K. Bennett and U. Castiello, Eds. Amsterdam, The Netherlands: Elsevier, 1994.
63. E. Oztop, N. S. Bradley, and M. A. Arbib, "Infant grasp learning: A computational model," Exp. Brain Res., vol. 158, pp. 480-503, 2004.
64. D. C. Witherington, "The development of prospective grasping control between 5 and 7 months: A longitudinal study," Infancy, vol. 7, no. 2, pp. 143-161, Apr. 2005.
65. A. Streri and J. Féron, "The development of haptic abilities in very young infants: From perception to cognition," Inf. Behav. Develop., vol. 28, no. 3, pp. 290-304, Sep. 2005.
66. C. von Hofsten and E. S. Spelke, "Object perception and object-directed reaching in infancy," J. Exp. Psychol.: General, vol. 114, no. 2, pp. 198-212, 1985.
67. J. Fagard, "Linked proximal and distal changes in the reaching behavior of 5-to 12-month-old human infants grasping objects of different sizes," Inf. Behav. Develop., vol. 23, no. 3-4, pp. 317-329, Mar. 2000.
68. L. B. Smith, "From fragments to geometric shape: Changes in visual object recognition between 18- and 24-months," Current Direct. Psychol. Sci., vol. 18, no. 5, pp. 290-294, Oct. 2009.
69. T. Wilcox, "Object individuation: Infants' use of shape, size, pattern, and color," Cognition, vol. 72, no. 2, pp. 125-166, Sep. 1999.
70. L. B. Cohen and C. H. Cashon, "Infant perception and cognition," in Comprehensive Handbook of Psychology. Volume 6, Developmental Psychology. II. Infancy, R. Lerner, A. Easterbrooks, and J. Mistry, Eds. New York: Wiley, 2003, pp. 65-89.
71. J. Kaufman, D. Mareschal, and M. H. Johnson, "Graspability and object processing in infants," Inf. Behav. Develop., vol. 26, no. 4, pp. 516-528, Dec. 2003.
72. M. Carpenter, K. Nagell, and M. Tomasello, "Social cognition, joint attention, and communicative competence from 9 to 15 months of age," Monographs Soc. Res. Child Develop., vol. 63, no. 4, pp. i-174, 1998.
73. D. R. Faria, J. Prado, P. Drews, Jr., and J. Diasozto, "Object shape retrieval through grasping exploration," in Proc. 4th Eur. Conf. Mobile Robot., ECMR'09, Mlini/Dubrovnik, Croatia, Sep. 2009.