Towards an adaptive hierarchical anticipatory behavior control system

AAAI Fall Symposium - Technical Report

Volumn FS-05-05, Issue , 2005, Pages 83-90

  Herbort, Oliver ^a   Butz, Martin V ^a   Hoffmann, Joachim ^a  

^a UNIVERSITY OF WÜRZBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS; CONTROL SYSTEM ANALYSIS; NEUROLOGY; PSYCHOLOGY COMPUTING;

BEHAVIOR CONTROL SYSTEM; LIMB CONTROL; NEUROSCIENCE;

BEHAVIORAL RESEARCH;

EID: 33646011241     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (46)

1. Barlow, J. S. 2002. The cerebllum and adaptive control. New York, NY: Cambridge University Press.
2. Barto, A. G., and Mahadevan, S. 2003. Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems 13:341-379.
3. Berthier, N. E.; Singh, S. P.; Barto, A. G.; and Houk, J. C. 1992. A cortico-cerebellar model that learns to generate distributed motor commands to control a kinematic arm. Advances in Neural Information Processing Systems 4:611-618.
4. Butz, M. V.; Swarup, S.; and Goldberg, D. E. 2004. Effective online detection of task-independent landmarks. IlliGAL report 2004002, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign.
5. Butz, M. V. 2005. Kernel-based, ellipsoidal conditions in the real-valued XCS classifier system. GECCO 2005: Genetic and Evolutionary Computation Conference: Volume 2 1835-1842.
6. Cruse, H.; Steinkühler, U.; and Burkamp, C. 1998. MMC - a recurrent neural network which can be used as manipulable body model. In Pfeifer, R.; Blumberg, B.; Meyer, J.-A.; and Wilson, S., eds., From Animal to Animals 5, 381-389. Cambridge, MA: MIT Press.
7. Dietz, V. 2003. Spinal cord pattern generators for locomotion. Clinical Neurophysiology 114:1379-1389.
8. Elsner, B., and Hommel, B. 2001. Effect anticipations and action control. Journal of Experimental Psychology 27(1):229-240.
9. Georgopoulus, A. P. 1995. Current issues in directional motor control. Trends Neuroscience 18(11):506-510.
10. Gibson, J. J. 1979. The Ecological Approach to Visual Perception. Mahwah, NJ: Lawrence Erlbaum Associates.
11. Giese, M. A., and Poggio, T. 2003. Neural mechanisms for the recogniton of biological movements. Nature Reviews Neuroscience 4:179-192.
12. Haruno, M.; Wolpert, D. M.; and Kawato, M. 2001. Mosaic model for sensorimotor learning and control. Neural Computation 13(10):2201-2220.
13. Haykin, S. 2002. Adaptive filter theory. Upper Saddle River, NJ: Prentice Hall, 4th edition edition.
14. Hebb, D. O. 1949. The Organization of Behavior. New York: John Wiley.
15. Herbart, J. F. 1825. Psychologie als Wissenschaft neu gegründet auf Erfahrung, Metaphysik und Mathematik. Zweiter analytischer Teil. August Wilhelm Unzer.
16. Herbort, O.; Butz, M. V.; and Hoffmann, J. 2005. Towards the advantages of hierarchical anticipatory behavioral control. In Opwis, K., and Penner, I.-K., eds., Proceedings of the KogWis05. The German Cognitive Science Conference, 77-82. Basel: Schwabe.
17. Hirayama, M.; Kawoto, M.; and Jordan, M. I. 1993. The cascade neural network model and a speed-accuracy trade-off of arm movement. Journal of Motor Behaviour 25(3):162-174.
18. Hoffmann, J. 1993. Vorhersage und Erkenntnis. Göttingen, Germany: Hogrefe.
19. James, W. 1890. The principles of psychology, volume 1. New York: Holt.
20. Jordan, M. I., and Rumelhart, D. E. 1992. Forward models: Supervised learning with a distal teacher. Cognitive Science 16:307-354.
21. Kaiman, R. E. 1960. A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82(Series D):35-45.
22. Kalveram, K. T.; Schinauer, T.; Beirle, S.; Richter, S.; and Jansen Osmann, P. 2005. Threading neural feedforward into a mechanical spring - how biology exploit sphysics in limb control. Biological Cybernetics.
23. Kalveram, K. T. 2004. The inverse problem in cognitve, perceptual and proprioceptive control of sensorimotor behaviour: towards a biologically plausible model of the control of aiming movements. International Journal of Sport and Exercise 2:255-273.
24. Kawato, M.; Furukawa, K.; and Suzuki, R. 1987. A hierarchical neural-network model for control and learning of voluntary movement. Biological Cybernetics 57:169-185.
25. Kersting, K.; Van Otterlo, M.; and DeRaedt, L. 2004. Bellman goes relational. Proceedings of the Twenty-First International Conference on Machine Learning (ICML-2004) 465-472.
26. Knill, D. C., and Pouget, A. 2004. The bayesian brain: the role of uncertainty in neural coding and computation. Trends in Neurosciences 27(12):712-719.
27. Kunde, W.; Koch, I.; and Hoffmann, J. 2004. Anticipated action effects affect the selection, initiation, and execution of actions. The Quarterly Journal of Experimental Psychology. Section A: Human Experimental Psychology 57:87-106.
28. Kunde, W. 2001. Response-effete compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance 27(2):387-394.
29. Loeb, G. E.; Brown, I.; and Cheng, E. 1999. A hierarchical foundation for models of sensorimotor control. Experimental Brain Research 126:1-18.
30. Miall, R. C.; Weir, D. J.; Wolpert, D. M.; and Stein, J. F. 1993. Is the cerebellum a smith predictor? Journal of Motor Behavior 25(3):203-216.
31. Poggio, T., and Bizzi, E. 2004. Generalization in vision and motor control. Nature 431:768-774.
32. Powers, W. T. 1973. Behavior: The Control of Perception. New York: Aldine de Gruyter.
33. Rao, R. P. N., and Ballard, D. H. 1999. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2(1):79-87.
34. Riesenhuber, M., and Poggio, T. 1999. Hierarchical models of object recognition in cortex. Nature Neuroscience 2(11):1019-1025.
35. Salinas, E., and Abbott, L. F. 1995. Transfer of coded information from sensory to motor networks. Journal of Neuroscience 15(10):6461-6474.
36. Shadmehr, R., and Brashers-Krug, T. 1997. Functional stages in the formation of human long term motor memory. Journal of Neuroscience 17(1):409-419.
37. Simon, H. A. 1969. Sciences of the Artificial. Cambridge, MA: MIT Press.
38. Simsek, O., and Barto, A. G. 2004. Using relative novelty to identify useful temporal abstractions in reinforcement learning. Proceedings of the Twenty-First International Conference on Machine Learning (ICML-2004) 751-758.
39. Stock, A., and Hoffmann, J. 2002. Intentional fixation of behavioral learning or how R-E learning blocks S-R learning. European Journal of Cognitive Psychology 14(1):127-153.
40. Stroeve, S. 1996. Linear combined feedback and feedforward control of a musculoskeletal system. Biological Cybernetics 75:73-83.
41. Stroeve, S. 1997. A learning feedback and feedforward neuromuscular control model for two degrees of freedom human arm movements. Human Movement Science 16:621-651.
42. Sutton, R. S., and Barto, A. G. 1998. Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
43. Sutton, R. S. 1990. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proceedings of the Seventh International Conference on Machine Learning 216-224.
44. Todorov, E., and Jordan, M. I. 2002. Optimal feedback control as a theory of motor coordination. Nature Neuroscience 5(11):1226-1235.
45. Urban, J.-P.; Bruessler, J. L.; and Gresser, J. 1998. Neural networks for visual servoing in robotics. In Jain, L. C., and Fukuda, T., eds., Soft Computing for Intelligent Robotic Systems. Springer. 81-111.
46. Wolpert, D. M., and Kawato, M. 1998. Multiple paired forward and inverse models for motor control. Neural Networks 11(7-8):1317-1329.