AutoIncSFA and vision-based developmental learning for humanoid robots

IEEE-RAS International Conference on Humanoid Robots

Volumn , Issue , 2011, Pages 622-629

  Kompella, Varun Raj ^a   Pape, Leo ^a   Masci, Jonathan ^a   Frank, Mikhail ^a   Schmidhuber, Jürgen ^a  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPACT CODE; DEVELOPMENTAL LEARNING; HIGH-DIMENSIONAL; HUMANOID ROBOT; INPUT STREAMS; SENSORY INPUT; SPATIO-TEMPORAL ABSTRACTION; VISION BASED;

REINFORCEMENT LEARNING;

ANTHROPOMORPHIC ROBOTS;

EID: 84856318058     PISSN: 21640572     EISSN: 21640580     Source Type: Conference Proceeding    
DOI: 10.1109/Humanoids.2011.6100865     Document Type: Conference Paper

References (33)

1. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: a survey," Journal of AI research, vol. 4, pp. 237-285, 1996.
2. R. Sutton and A. Barto, Reinforcement learning: An introduction. Cambridge, MA, MIT Press, 1998.
3. J. Schmidhuber, "Curious model-building control systems," in Proceedings of the International Joint Conference on Neural Networks, Singapore, vol. 2, pp. 1458-1463, IEEE press, 1991.
4. J. Storck, S. Hochreiter, and J. Schmidhuber, "Reinforcement driven information acquisition in non-deterministic environments," in Proceedings of the International Conference on Artificial Neural Networks, Paris, vol. 2, pp. 159-164, EC2 & Cie, 1995.
5. J. Schmidhuber, "Artificial curiosity based on discovering novel algorithmic predictability through coevolution," in Congress on Evolutionary Computation (P. Angeline, Z. Michalewicz, M. Schoenauer, X. Yao, and Z. Zalzala, eds.), pp. 1612-1618, IEEE Press, 1999.
6. J. Schmidhuber, "Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts," Connection Science, vol. 18, no. 2, pp. 173-187, 2006. (Pubitemid 43982721)
7. J. Schmidhuber, "Formal theory of creativity, fun, and intrinsic motivation (1990-2010)," IEEE Transactions on Autonomous Mental Development, vol. 2, no. 3, pp. 230 -247, 2010.
8. G. E. Hinton and R. S. Zemel, "Autoencoders, minimum description length, and helmholtz free energy," in Advances in Neural Information Processing Systems 6, pp. 3-10, Morgan Kaufmann, 1994.
9. V. R. Kompella, M. D. Luciw, and J. Schmidhuber, "Incremental slow feature analysis," in IJCAI, pp. 1354-1359, 2011.
10. R. Legenstein, N. Wilbert, and L. Wiskott, "Reinforcement learning on slow features of high-dimensional input streams," PLoS Computational Biology, vol. 6, no. 8, p. e1000894, 2010.
11. M. Franzius, H. Sprekeler, and L. Wiskott, "Slowness and sparseness lead to place, head-direction, and spatial-view cells," PLoS Computational Biology, vol. 3, no. 8, p. e166, 2007.
12. L. Wiskott and T. Sejnowski, "Slow feature analysis: Unsupervised learning of invariances," Neural Computation, vol. 14, no. 4, pp. 715-770, 2002.
13. J. Schmidhuber and D. Prelinger, "Discovering predictable classifications,"Neural Computation, vol. 5, no. 4, pp. 625-635, 1993.
14. I. T. Jolliffe, Principal Component Analysis. New York: Springer-Verlag, 1986.
15. J. Weng, Y. Zhang, and W. Hwang, "Candid covariance-free incremental principal component analysis," Pattern Analysis and Machine Intelligence, vol. 25, no. 8, pp. 1034-1040, 2003.
16. E. Oja, "Principal components, minor components, and linear neural networks," Neural Networks, vol. 5, no. 6, pp. 927-935, 1992. (Pubitemid 23581250)
17. T. Chen, S. Amari, and N. Murata, "Sequential extraction of minor components," Neural Processing Letters, vol. 13, no. 3, pp. 195-201, 2001.
18. D. Peng, Z. Yi, and W. Luo, "Convergence analysis of a simple minor component analysis algorithm," Neural Networks, vol. 20, no. 7, pp. 842-850, 2007. (Pubitemid 47361678)
19. P. Vincent, L. Hugo, Y. Bengio, and P.-A. Manzagol, "Extracting and composing robust features with denoising autoencoders," in Proceedings of the 25th international conference on Machine learning, ICML '08, (New York, NY, USA), pp. 1096-1103, ACM, 2008.
20. S. Hochreiter and J. Schmidhuber, "Feature extraction through LOCOCODE,"Neural Computation, vol. 11, no. 3, pp. 679-714, 1999.
21. S. Hochreiter and J. Schmidhuber, "Flat minima," Neural Computation, vol. 9, no. 1, pp. 1-42, 1997.
22. M. Ranzato, F. J. Huang, Y.-L. Boureau, and Y. LeCun, "Unsupervised learning of invariant feature hierarchies with applications to object recognition," in Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, pp. 1 -8, june 2007.
23. B. A. Olshausen and D. J. Field, "Sparse coding with an overcomplete basis set: A strategy employed by v1?," Vision Research, vol. 37, pp. 3311-3325, December 1997.
24. M. Scholz and R. Vigário, "Nonlinear pca: a new hierarchical approach,"in ESANN, pp. 439-444, 2002.
25. S. Lange and M. Riedmiller, "Deep auto-encoder neural networks in reinforcement learning," in Neural Networks (IJCNN), The 2010 International Joint Conference on, pp. 1 -8, july 2010.
26. C. Ekanadham, "Sparse deep belief net model for visual area v2," in Advances in Neural Information Processing Systems 20, MIT Press, 2008.
27. G. Metta, G. Sandini, D. Vernon, L. Natale, and F. Nori, "The icub humanoid robot: an open platform for research in embodied cognition," in Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, PerMIS '08, (New York, NY, USA), pp. 50-56, ACM, 2008.
28. J. Schmidhuber, "Driven by compression progress: A simple principle explains essential aspects of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes," in Anticipatory Behavior in Adaptive Learning Systems. From Psychological Theories to Artificial Cognitive Systems (G. Pezzulo, M. V. Butz, O. Sigaud, and G. Baldassarre, eds.), vol. 5499 of LNCS, pp. 48-76, Springer, 2009.
29. J. Schmidhuber, "Learning to generate sub-goals for action sequences,"in Artificial Neural Networks (T. Kohonen, K. Mäkisara, O. Simula, and J. Kangas, eds.), pp. 967-972, Elsevier Science Publishers B.V., North-Holland, 1991.
30. M. B. Ring, "Incremental development of complex behaviors through automatic construction of sensory-motor hierarchies," in Machine Learning: Proceedings of the Eighth International Workshop (L. Birnbaum and G. Collins, eds.), pp. 343-347, Morgan Kaufmann, 1991.
31. M. Wiering and J. Schmidhuber, "HQ-learning," Adaptive Behavior, vol. 6, no. 2, pp. 219-246, 1998.
32. B. Bakker and J. Schmidhuber, "Hierarchical reinforcement learning based on subgoal discovery and subpolicy specialization," in Proc. 8th Conference on Intelligent Autonomous Systems IAS-8 (F. G. et al., ed.), (Amsterdam, NL), pp. 438-445, IOS Press, 2004.
33. H. R. Maei and R. S. Sutton, "Gq (): A general gradient algorithm for temporal-difference prediction learning with eligibility traces," Proceedings of the 3d Conference on Artificial General Intelligence AGI10, pp. 1-6, 2010.