Extending sensorimotor contingency theory: Prediction, planning, and action generation

Adaptive Behavior

Volumn 21, Issue 6, 2013, Pages 423-436

  Maye, Alexander ^a   Engel, Andreas K ^a  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

action selection; dead reckoning; robot control; sensor failure resilience; Sensorimotor account

Indexed keywords

EID: 84887475241     PISSN: 10597123     EISSN: 17412633     Source Type: Journal    
DOI: 10.1177/1059712313497975     Document Type: Article

References (43)

1. Bernstein N.The co-ordination and regulation of movements. Oxford, England: Pergamon Press; 1967:.
2. Bolado-Gomez R.,Gurney K.A biologically plausible embodied model of action discovery.Frontiers in Neurorobotics. 2013;7:4.
3. Boots B.,Siddiqi S.,Gordon G.Closing the learning-planning loop with predictive state representations.The International Journal of Robotics Research. 2011;30 (7): 954-966.
4. Botvinick M. M.Multilevel structure in behaviour and in the brain: a model of Fuster's hierarchy.Philosophical Transactions of the Royal Society B: Biological Sciences. 2007;362 (1485): 1615-1626.
5. Bovet S.,Pfeifer R.Emergence of delayed reward learning from sensorimotor coordination. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); 2005; 2005. 2272.
6. Chen L. L.,Lee D.,Fukushima K.,Fukushima J.Submovement composition of head movement.PLoS ONE. 2012;7 (11): e47565.
7. Choe Y.,Yang H.-F.,Eng D.-Y.Autonomous learning of the semantics of internal sensory states based on motor exploration.International Journal of Humanoid Robotics. 2007;4:211-243.
8. Cisek P.Cortical mechanisms of action selection: the affordance competition hypothesis.Philosophical Transactions of the Royal Society B: Biological Sciences. 2007;362 (1485): 1585-1599.
9. Cisek P.,Kalaska J. F.Neural mechanisms for interacting with a world full of action choices.Annual Review of Neuroscience. 2010;33 (1): 269-298.
10. Crabbe F. L.Compromise strategies for action selection.Philosophical Transactions of the Royal Society B: Biological Sciences. 2007;362 (1485): 1559-1571.
11. Dogar M.,Ugur E.,Sahin E.,Cakmak M.Using learned affordances for robotic behavior development. Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on (3802-3807); 2008; 2008.
12. Drescher G. L.Made-Up Minds: A Constructivist Approach to Artificial Intelligence. Cambridge: MIT Press; 1991:.
13. Fine P.,Di Paolo E.,Izquierdo E.Adapting to your body. Ninth European Conference on Artificial Life; 2007; 2007. 203.
14. Gawthrop P.,Loram I.,Lakie M.,Gollee H.Intermittent control: a computational theory of human control.Biological Cybernetics. 2011;104 (1-2): 31-51.
15. Gibson J. J.The Ecological Approach to Visual Perception. Boston: Houghton Mifflin; 1979:.
16. Hoffmann M.,Schmidt N.,Pfeifer R.,Engel A. K.,Maye A.From Animals to Animats 12. Ziemke T.Balkenius C.Hallam J., ed. Berlin, Heidelberg: Springer; 2012:54-64.
17. Holmes M. P.,Isbell C. L.Schema learning: experience-based construction of predictive action models.Advances in Neural Information Processing Systems. 2005;17:585-592.
18. Howard R.Readings in Decision Analysis. Howard R.Matheson J. E.Miller K. L., ed. Menlo Park, California: SRI International; 1977:431-465.
19. James M.,Singh S.,Littman M.Planning with predictive state representations. Machine Learning and Applications, 2004. Proceedings. 2004 International Conference on; 2004; 2004. 304.
20. Kaelbling L. P.,Littman M. L.,Cassandra A. R.Planning and acting in partially observable stochastic domains.Artificial Intelligence. 1998;101 (1-2): 99-134.
21. Littman M.,Sutton R.,Singh S.Predictive representations of state.Advances in Neural Information Processing Systems. 2002;14:1555-1561.
22. Maye A.,Engel A.A discrete computational model of sensorimotor contingencies for object perception and control of behavior. Robotics and Automation, 2011. ICRA 2011. IEEE International Conference on (3810-3815); 2011; 2011.
23. Maye A.,Engel A.Brain-Inspired Cognitive Systems 2012 (BICS 2012). Zhang H., ed. Berlin, Heidelberg: Springer; 2012a:240-249.
24. Maye A.,Engel A.From Animals to Animats 12. Ziemke T.Balkenius C.Hallam J., ed. Berlin, Heidelberg: Springer; 2012b:106-116.
25. McGann M.Enactive theorists do it on purpose: Toward an enactive account of goals and goal-directedness.Phenomenology and the Cognitive Sciences. 2007;6 (4): 463-483.
26. Modayil J.,White A.,Sutton R.From Animals to Animats 12. Ziemke T.Balkenius C.Hallam J., ed. Berlin, Heidelberg: Springer; 2012:299-309.
27. Möller R.,Schenck W.Bootstrapping cognition from behavior - a computerized thought experiment.Cognitive Science. 2008;32 (3): 504-542.
28. O'Regan J.,Noë A.A sensorimotor account of vision and visual consciousness.Behavioral and Brain Sciences. 2001;24:939-1031.
29. Oudeyer P.-Y.,Kaplan F.Intelligent adaptive curiosity: a source of self-development. Proceedings of the 4th International Workshop on Epigenetic Robotics; 2004; 2004. 127.
30. Pfeifer R.,Scheier C.Sensory-Motor Coordination: The Metaphor and Beyond.Robotics and Autonomous Systems. 1997;20:157-178.
31. Ribes A.,Cerquides J.,Demiris Y.,Mantaras R. de.Incremental learning of an optical flow model for sensorimotor anticipation in a mobile robot. Development and Learning and Epigenetic Robotics (ICDL), 2012 IEEE International Conference on; 2012; 2012. 1.
32. Russel S.,Norvig P.Pearson Education Inc; 2003:.
33. Sahin E.,Cakmak M.,Dogar M. R.,Ugur E.,Ücoluk G.To afford or not to afford: A new formalization of affordances towards affordance based robot control.Adaptive Behavior. 2007;15 (4): 447-472.
34. Schneider K.,Schmalt H.Motivation. 1994). Motivation (2 ed.). Stuttgart: Verlag W. Kohlhammer.Stuttgart: Verlag W. Kohlhammer; 1994:.
35. Seo M.,Lee E.,Averbeck B. B.Action selection and action value in frontal-striatal circuits.Neuron. 2012;74 (5): 947-60.
36. Seth A. K.The ecology of action selection: insights from artificial life.Philosophical Transactions of the Royal Society B: Biological Sciences. 2007;362 (1485): 1545-58.
37. Child Development. Sporns O.Edelman G. M., ed. 1993:960-981.
38. Sutton R.,Barto A.Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press; 1998:.
39. Sutton R.,Modayil J.,Delp M.,Degris T.,Pilarski P.,White A.,Precup D.Horde: A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems; 2011; 2011. 761.
40. Ugur E.,Dogar M.,Cakmak M.,Sahin E.Curiosity-driven learning of traversability affordance on a mobile robot. Development and Learning, 2007. ICDL 2007. IEEE 6th International Conference on; 2007; 2007. 13.
41. Ugur E.,Oztop E.,Sahin E.Affordance learning from range data for multi-step planning. Proceedings of the Ninth International Conference on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems; 2009; 2009. 177.
42. Ugur E.,Oztop E.,Sahin E.Going beyond the perception of affordances: Learning how to actualize them through behavioral parameters. Robotics and Automation, 2011. ICRA 2011. IEEE International Conference on (4768-4773); 2011; 2011.
43. Ugur E.,Sahin E.,Oztop E.Predicting future object states using learned affordances. Computer and Information Sciences, 2009. ISCIS 2009. 24th International Symposium on; 2009; 2009. 415.