What's next: Recruitment of a grounded predictive body model for planning a robot's actions

Frontiers in Psychology

Volumn 3, Issue OCT, 2012, Pages

  Schilling, Malte ^a,b   Cruse, Holk ^b  

^a INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

^b BIELEFELD UNIVERSITY   (Germany)

Author keywords

Anticipation; Internal body model; Internal simulation; Minimal cognitive system; Prediction; Recurrent neural network; Robotic architecture

Indexed keywords

EID: 84870892842     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00383     Document Type: Article

References (75)

1. Anderson, M. L. (2010). Neural reuse: a fundamental organizational principle of the brain. Behav. Brain Sci. 33, 254-313.
2. Bernstein, N. A. (1967). The Coordination and Regulation of Movements. Oxford: Pergamon Press Ltd.
3. Bläsing, B. (2006). Crossing large gaps: a simulation study of stick insect behavior. Adapt. Behav. 14, 265-285.
4. Bongard, J., Zykov, V., and Lipson, H. (2006). Resilient machines through continuous self-modeling. Science 314, 1118-1121.
5. Botvinick, M., and Cohen, J. (1998). Rubber hands 'feel' touch that eyes see. Nature 391, 756-756.
6. Braitenberg, V. (ed.). (1986). Vehicles - Experiments in Synthetic Psychology. Cambridge: MIT Press.
7. Briggman, K. L., and Kristan, W. B. (2008). Multifunctional pattern-generating circuits. Annu. Rev. Neurosci. 31, 271-294.
8. Brooks, R. A. (1991). "Intelligence without reason," in Proceedings of the 12th Inter-National Joint Conference on Artificial Intelligence (IJCAI-91), eds J. Myopoulos and R. Reiter (San Mateo,CA: Morgan Kaufmann Publishers Inc.), 569-595.
9. Butz, M. V., Herbort, O., and Hoffmann, J. (2007). Exploiting redun-dancyforflexiblebehavior: unsupervised learning in a modular sensorimotor control architecture. Psychol. Rev. 4, 1015-1046.
10. Castiello, U. (2005). The neuroscience of grasping. Nat. Rev. Neurosci. 6, 726-736.
11. Clark, A. (in press). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci.
12. Cleeremans, A. (2005). "Computational correlates of consciousness," in Progress in Brain Research, Vol. 150, ed. S. Laureys (Oxford: Elsevier), 81-98.
13. Cothros, N., Wong, J. D., and Gribble, P. L. (2006). Are there distinct neural representations of object and limb dynamics? Exp. Brain Res. 173, 689-697.
14. Cruse, H. (1979). The control of the anterior extreme position of the hindleg of a walking insect. Physiol. Entomol. 4, 121-124.
15. Cruse, H. (1999). Feeling our body - the basis of cognition? Evol. Cogn. 5, 162-173.
16. Cruse, H. (2009). "Substrate der Entscheidungsfindung," in Das Ich und sein Gehirn, Die Heraus-forderungen der Neurobiologischen Forschung für das (Straf-) Recht. Göttinger Studien zu den Krim-inalwissenschaften, ed. G. Duttge (Germany: Universitätsverlag Göttingen), 63-74.
17. Cruse, H., and Steinkühler, U. (1993). Solution of the direct and inverse kinematic problems by a common algorithm based on the mean of multiple computations. Biol. Cybern. 69, 345-351.
18. Davidson, P. R., and Wolpert, D. M. (2004). Internal models underlying grasp can be additively combined. Exp. Brain Res. 155, 334-340.
19. Desmurget, M., and Grafton, S. (2000). Forward modeling allows feedback control for fast reachingmovements. Trends Cogn. Sci. (Regul. Ed.) 4, 423-431.
20. Doya, K., Ishii, S., Pouget,A., and Rao,R. P. N. (2007). Bayesian Brain: Probabilistic Approaches to Neural Coding. Cambridge: The MIT Press.
21. Dürr, V. (2001). Stereotypic leg searching-movements in the stick insect: kinematic analysis, behavioural context and simulation. J. Exp. Biol. 204, 1589-1604.
22. Dürr, V., Schmitz, J., and Cruse, H. (2004). Behaviour-based modelling of hexapod locomotion: linking biology and technical application. Arthropod Struct. Dev. 33, 237-250.
23. Dürr, V., and Schütz, C. H. (2011). Active tactile exploration for adaptive locomotion in the stick insect. Philos. Trans. R Soc. Lond. B Biol. Sci. 366, 2996-3005.
24. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433.
25. Flash, T., and Hochner,B. (2005). Motor primitives in vertebrates and invertebrates. Curr. Opin. Neurobiol. 15, 1-7.
26. Funk, M., Shiffrar, M., and Brugger, P. (2005). Hand movement observation by individuals born without hands: phantom limb experience constrains visual limb perception. Exp. Brain Res. 164, 341-346.
27. Gallese, V., and Lakoff, G. (2005). The brain's concepts: the role of the sensory-motor system in conceptual knowledge. Cogn. Neuropsychol. 22, 455-479.
28. Gibson, J. J. (1979). The Ecological Approach to Visual Perception. New Jersey: Lawrence Erlbaum Associates.
29. Grush, R. (2004). The emulation theory of representation: motor control, imagery, and perception. Behav. Brain Sci. 27, 377-442.
30. Haggard, P., and Wolpert, D. M. (2005). "Disorders of body scheme," in Higher-Order Motor Disorders, eds H.-J. Freund, M. Jeannerod, M. Hallett, and R. Leiguarda (Oxford: University Press), 261-271.
31. Herbort, O., Butz, M. V., and Pedersen, G. (2010). "The SURE_REACH model for motor learning and control of a redundant arm: from modeling human behavior to applications in robotics," in From Motor Learning to Interaction Learning in Robots, eds O. Sigaud and J. Peters (Berlin: Springer), 85-106.
32. Hesslow, G. (2002). Conscious thought as simulation of behaviour and perception. Trends Cogn. Sci. (Regul. Ed.) 6, 242-247.
33. Hoffmann, M., Marques, H., Arieta, A. H., Sumioka, H., Lungarella, M., and Pfeifer, R. (2010). Body schema in robotics: a review. IEEE Trans. Auton. Ment. Dev. 2, 304-324.
34. Honegger, H. W. (1981). A preliminary note on a new optomotor response in crickets: antennal tracking of moving targets. J. Comp. Physiol. A Neuroethol. Sens. Neural Behav. Physiol. 142, 419-421.
35. Imamizu, H., and Kawato, M. (2008). Neural correlates of predictive and postdictive switching mechanisms for internal models. J. Neurosci. 28, 10751-10765.
36. Kawato, M. M. (1999). Internal models for motor control and trajectory planning. Curr. Opin. Neurobiol. 9, 718-727.
37. Li, Y., and Strausfeld, N. J. (1999). Multimodal efferent and recurrent neuronsinthemediallobesofcockroach mushroom bodies. J. Comp. Neurol. 409, 647-663.
38. Loula, F., Prasad, S., Harber, K., and Shiffrar, M. (2005). Recognizing people from their movement. J. Exp. Psychol. Hum. Percept. Perform. 31, 210-220.
39. Maes, P. (1991). "A bottom-up mechanism for behaviour selection in an artificial creature," in From Animals to Animats, eds J. A. Meyer and S. Wilson (Cambridge, MA: MIT Press), 238-246.
40. Makin, T. R., Holmes, N. P., and Ehrsson, H. H. (2008). On the other hand: dummy hands and peripersonal space. Behav. Brain Res. 191, 1-10.
41. Maravita, A., and Iriki, A. (2004). Tools for the body (schema). Trends Cogn. Sci. (Regul. Ed.) 8, 79-86.
42. Matheson, M., and Dürr, V. (2003). Load compensation in targeted limb movements of an insect. J. Exp. Biol. 206, 3175-3186.
43. McFarland, D., and Bösser, T. (1993). Intelligent Behavior in Animals and Robots. Cambridge: MIT Press.
44. Miall, R., Weir, D., Wolpert, D. and Stein, J. (1993). Is the cerebellum a smith predictor? J. Mot. Behav. 25, 203-216.
45. Möller, R., and Schenck, W. (2008). Bootstrapping cognition from behavior - a computerized thought experiment. Cogn. Sci. 32, 504-542.
46. Morasso, P., and Sanguineti, V. (1994). "Self-organizing topographic maps and motor planning,"in SAB94: Proceedings of the Third International Conference on Simulation of Adaptive Behavior: From Animals to Animats 3 (Cambridge,MA: MIT Press), 214-220.
47. Muller,C. M. P., Brenner, E., and Smeets, J. B. J. (2009). Maybe they are all circles: clues and cues. J. Vis. 9, 10.1-10.5.
48. Niven, J. E., Buckingham, C. J., Lumley, S., Cuttle, M. F., and Laughlin, S. B. (2010). Visual targeting of forelimbs in ladder-walking locusts. Curr. Biol. 20, 86-91.
49. Page, K. L., Zakotnik, J., Dürr, V., and Matheson, T. (2008). Motor control of aimed limb movements in an insect. J. Neurophysiol. 99, 484-499.
50. Paillard, J. (1999). "Body schema and body image - a double dissociation in deafferented patients," in Motor Control: Today and Tomorrow, eds G. Gantchev, S. Mori, and J. Massion (Sofia:Academic Publishing House), 197-214.
51. Pezzulo, G., Butz, M. V., Castelfranchi, C., and Falcone, R. (eds.) (2008). "The challenge of anticipation, a unifying framework for the analysis and design of artificial cognitive systems," in Lecture Notes in Computer Science, Vol. 5225 (Berlin: Springer).
52. Prinz, W. (1997). Perception and action planning. Eur. J. Cogn. Psychol. 9, 129-154.
53. Rosenbaum, D. A., Engelbrecht, S., Bushe, M., and Loukopoulos, L. (1993). Knowledge model for selecting and producing reaching movements. J. Mot. Behav. 25, 217-227.
54. Rosenbaum, D. A., Meulenbroek, R. J., Vaughan, J., and Jansen, C. (2001). Posture-based motion planning: applications to grasping. Psychol. Rev. 108, 709-734.
55. Schilling, M. (2009). "Dynamic equations in MMC networks: construction of a dynamic body model," in Proceedings of the 12th International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines (CLAWAR), Istanbul.
56. Schilling, M. (2011a). Universally manipulable body models - dual quaternion representations in layered and dynamic MMCs. Auton. Robots 30, 399-425.
57. Schilling, M. (2011b). "Learning by seeing - associative learning of visual features through mental simulation of observed action," in Proceedings of the ECAL2011,ed.R.Doursat (Paris: MIT Press), 731-738.
58. Schilling, M., and Cruse, H. (2008). "The evolution of cognition - from first order to second order embodiment," in Modeling Communication with Robots and Virtual Humans, eds I. Wachsmuth and G. Knoblich (Berlin: Springer), 77-108.
59. Schilling, M., Paskarbeit, J., Schneider, A., and Cruse, H. (2012). "Flexible internal body models for motor control: on the convergence of constrained dual quaternion mean of multiple computation networks," in Proceedings of the International Joint Conference on Neural Networks 2012, Brisbane.
60. Schilling, M., Paskarbeit, J., Schmitz, J., Schneider, A., and Cruse, H. (in press). Grounding an Internal Body Model of a Hexapod Walker - Control of Curve Walking in a Biological Inspired Robot - Control of Curve Walking inaBiological Inspired Robot. Accepted for publication at IROS 2012.
61. Shadmehr, R., and Wise, S. P. (2005). The Computational Neurobiology of Reaching and Pointing: A Foundation for Motor Learning (Computational Neuroscience). Cambridge: MIT Press.
62. Steels, L. (2003). Intelligence with representation. Philos. Transact. A Math. Phys. Eng. Sci. 361, 2381-2395.
63. Steinkühler, U., and Cruse, H. (1998). A holistic model for an internal representation to control the movement of a manipulator with redundant degrees of freedom. Biol. Cybern. 79, 457-466.
64. Strauss, R., and Pichler, J. (1998). Persistence of orientation toward a temporarily invisible landmark in Drosophila melanogaster. J. Comp. Physiol. A 182, 411-423.
65. Sturm, J., Plagemann, C., and Burgard,W. (2009). Body schema learning for robotic manipulators from visual self-perception. J. Physiol. 103, 220-231.
66. Thoroughman, K. A., and Shadmehr, R. (2000). Learning of action through adaptive combination of motor primitives. Nature 407, 742-747.
67. Toussaint, M. (2006). A sensori-motor map: modulating lateral interactions for anticipation and planning. Neural Comput. 18, 1132-1155.
68. van Beers, R., Wolpert, D., and Haggard, P. (2002). When feeling is more important than seeing in sensorimotor adaptation. Curr. Biol. 12, 834-837.
69. Verschure, P., Voegtlin, T., and Douglas, R. (2003). Environmentally mediated synergy between perception and behaviour in mobile robots. Nature 425, 620-624.
70. Webb, B. (2004). Neural mechanisms for prediction: do insects have forward models? Trends Neurosci. 27, 278-282.
71. Wessnitzer, J., and Webb, B. (2006). Multimodal sensory integration in insects - towards insect brain control architectures. Bioinspir. Biomim. 1, 63-75.
72. Wolpert, D., Ghahramani, Z., and Jordan, M. (1995). An internal model for sensorimotor integration. Science 269, 1880-1882.
73. Wolpert,D. M., and Flanagan, J. (2001). Motor prediction. Curr. Biol. 11, 729-732.
74. Wolpert, D. M., and Ghahramani, Z. (2000). Computational principles of movement neuroscience. Nat. Neurosci. 3, 1212-1217.
75. Wolpert, D. M., and Kawato, M. (1998). Multiple paired forward and inverse models for motor control. Neural Netw. 11, 1317-1329.