Artificial curiosity with planning for autonomous perceptual and cognitive development

2011 IEEE International Conference on Development and Learning, ICDL 2011

Volumn , Issue , 2011, Pages

  Luciw, Matthew ^a   Graziano, Vincent ^a   Ring, Mark ^a   Schmidhuber, Jürgen ^a  

^a UNIVERSITY OF LUGANO   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE DEVELOPMENT; CONTINUAL LEARNING; DIMENSIONALITY REDUCTION; DYNAMIC NATURE; EXTERNAL VALUE; FORWARD MODELS; HIGH-DIMENSIONAL; INTRINSIC REWARDS; LEAST SQUARE; POLICY ITERATION; REINFORCEMENT LEARNING APPROACH; SAMPLING SCHEMES; TEMPORAL MODELS; VISUAL ENVIRONMENTS; VISUAL OBSERVATIONS;

REINFORCEMENT LEARNING;

AUTONOMOUS AGENTS;

EID: 80055020279     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2011.6037356     Document Type: Conference Paper

References (24)

1. G.A. Carpenter, S. Grossberg, and D.B. Rosen. Fuzzy art: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural networks, 4(6):759-771, 1991.
2. F. Fernndez and D. Borrajo. Two steps reinforcement learning. International Journal of Intelligent Systems, 23(2):213-245, 2008.
3. Baldassarre G. Adaptive Behaviour in Anticipatory Learning Systems, chapter Forward and bidirectional planning based on reinforcement learning and neural networks in a simulated robot, pages 179-200. Berlin: Springer Verlag, 2003.
4. Linus Gisslén, Matt Luciw, Vincent Graziano, and Jürgen Schmidhuber. Sequential Constant Size Compressors and Reinforcement Learning. In AGI'll, 2011.
5. Alexander Gloye, Fabian Wiesel, Oliver Tenchio, and Mark Simon. Reinforcing the driving quality of soccer playing robots by anticipation. Information Technology, 47(5):250-257, 2005.
6. Vincent Graziano, Jan Koutnik, and Juergen Schmidhuber. Unsupervised modeling of partially observable environments. In European Conference on Machine Learning, 2011.
7. P.W. Keller, S. Mannor, and D. Precup. Automatic basis function construction for approximate dynamic programming and reinforcement learning. In Proceedings of the 23rd international conference on Machine learning, pages 449-456. ACM, 2006.
8. M.G. Lagoudakis and R. Parr. Least-squares policy iteration. The Journal of Machine Learning Research, 4:1107-1149, 2003.
9. S. Lange and M. Riedmiller. Deep auto-encoder neural networks in reinforcement learning. In Neural Networks (IJCNN), The 2010 International Joint Conference on, pages 1-8, July 2010.
10. L.J. Lin. Reinforcement learning for robots using neural networks. School of Computer Science, Carnegie Mellon University, 1993.
11. Jonathan Masci, Ueli Meier, Dan Ciresan, and Juergen Schmidhuber. Stacked convolutional auto-encoders for hierarchical feature extraction. In International Conference on Artificial Neural Networks, 2011.
12. I. Menache, S. Mannor, and N. Shimkin. Basis function adaptation in temporal difference reinforcement learning. Annals of Operations Research, 134(1):215-238, 2005.
13. Pierre-Yves Oudeyer, Frédéric Kaplan, and Verena Hafner. Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation, 11(6), 2007.
14. Mark B. Ring. Continual Learning in Reinforcement Environments. PhD thesis, University of Texas at Austin, Austin, Texas 78712, August 1994.
15. J.C. Santamaria, R.S. Sutton, and A. Ram. Experiments with reinforcement learning in problems with continuous state and action spaces. Adaptive behavior, 6(2): 163, 1997.
16. Tom Schaul, Leo Pape, Tobias Glasmachers, Vincent Graziano, and Jürgen Schmidhuber. Coherence Progress: A Measure of Interestingness Based on Fixed Compressors. In Proceedings of the Fourth Conference on Artificial General Intelligence, 2011.
17. J. Schmidhuber. An on-line algorithm for dynamic reinforcement learning and planning in reactive environments. In Proc. IEEE/INNS International Joint Conference on Neural Networks, San Diego, volume 2, pages 253-258, 1990.
18. J. Schmidhuber. Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990-2010). Autonomous Mental Development, IEEE Transactions on, 2(3):230-247, 2010.
19. Yi Sun, Faustino Gomez, and Jürgen Schmidhuber. Planning to be surprised: Optimal bayesian exploration in dynamic environments. In AGI'll, 2011.
20. R. S. Sutton. First results with DYNA, an integrated architecture for learning, planning and reacting. In Proceedings of the AAAI Spring Symposium on Planning in Uncertain, Unpredictable, or Changing Environments, 1990.
21. R.S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. Advances in neural information processing systems, pages 1038-1044, 1996.
22. Hugo Vieira Neto and Ulrich Nehmzow. Visual novelty detection with automatic scale selection. Robot. Auton. Syst., 55:693-701, September 2007.
23. J. Weng. Developmental robotics: Theory and experiments. International Journal of Humanoid Robotics, 1(2):199-236, 2004.
24. J. Weng and M. Luciw. Dually optimal neuronal layers: Lobe component analysis. Autonomous Mental Development, IEEE Transactions on, 1(1):68-85, 2009.