Intrinsically motivated information foraging

2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program

Volumn , Issue , 2010, Pages 101-107

  Fasel, Ian ^a   Wilt, Andrew ^a   Mafi, Nassim ^a   Morrison, Clayton T ^a  

^a University of Arizona   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION FORAGING; INFORMATION GATHERING; INTELLIGENT EXPLORATION; INTRINSIC REWARDS; LIMITED MEMORY; LONG-TERM EFFECTS; MOTOR ACTIONS; NEGATIVE ENTROPIES; PRIOR INFORMATION; SENSOR NOISE; TIME STEP;

SENSORS;

INTELLIGENT AGENTS;

EID: 78149267893     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DEVLRN.2010.5578859     Document Type: Conference Paper

References (26)

1. J.R. Movellan. An Infomax Controller for Real Time Detection of Social Contingency. ICDL, 2005.
2. Nicholas J. Butko and Javier R. Movellan Optimal scanning for faster object detection. In CVPR, pages 2751-2758, 2009.
3. N.J. Butko and J.R. Movellan. I-POMDP: An infomax model of eye movement. IEEE, 2008.
4. D Lindley. On a measure of the information provided by an experiment. Annals of Mathematical Statistics, 27(4), 1956.
5. S. Luttrell. The use of transinformation in the design of data sampling schemes for inverse problems. Inverse Problems, 1:199-218, 1985.
6. K Chaloner and I Verdinelli. Bayesian experimental design: A review. Statistical Science, 10(3):273-304, 1995.
7. J. Denzler and C. Brown. Optimal selection of camera parameters for state estimation of static systems: An information theoretic approach. Tech. Report 732, Univ. Rochester, 2000.
8. Y.-B. He and Z Geng. Active learning of causal networks with intervention experiments and optimal designs. Journal of Machine Learning Research, 9:2523-2547, 2008.
9. C. Yoo, G. F. Cooper, and M. Schmidt. A control study to evaluate a computer-based microarray experiment design recommendation system for gene-regulation pathways discovery. Journal of Biomedical Informatics, 39(2):126-146, 2006.
10. J. Nelson and J. Movellan. Active inference in concept learning. In Advances in neural information processing, 13., 2000.
11. David J.C. MacKay. Information-Based Objective Functions for Active Data Selection. Neural Computation, 4:590-604, 1992.
12. Daniel R Cavagnaro, Jay I Myung, Mark a Pitt, and Janne V Kujala. Adaptive Design Optimization: A Mutual Information- Based Approach to Model Discrimination in Cognitive Science. Neural computation, 22(4):1-15, April 2010.
13. Mohan Sridharan, Jeremy L. Wyatt, and Richard Dearden. Hippo: Hierarchical pomdps for planning information processing and sensing actions on a robot. In ICAPS, 346-354, 2008.
14. J.R. Movellan. Tutorial on pomdps and infomax control. http://mplab.ucsd.edu.
15. Sebastian Thrun, Wolfram Burgard, and Dieter Fox. Probabilistic Robotics. MIT Press, 2005.
16. Ian Fasel, Paul Ruvolo, Tingfan Wu, and Javier Movellan. Infomax control for social robots. In NIPS Workshop on Probabilistic Approaches for Robotics and Control, 2009.
17. Özgür Şimşek and Andrew G. Barto. An intrinsic reward mechanism for efficient exploration. ACM International Conference Proceeding Series; Vol. 148, 2006.
18. Eiji Uchibe and Kenji Doya. Constrained reinforcement learning from intrinsic and extrinsic rewards. In 2007 IEEE 6th International Conference on Development and Learning, pages 163-168. IEEE, July 2007.
19. Frank Sehnke, Christian Osendorfer, Thomas R̈uckstieß, Alex Graves, Jan Peters, and J̈urgen Schmidhuber. Parameterexploring policy gradients. Neural Networks, in press, 2010.
20. Christian Igel, Thorsten Suttorp, and Nikolaus Hansen. A computational efficient covariance matrix update and a (1+1)- cma for evolution strategies. In GECCO, pages 453-460, 2006.
21. Schaul Tom, Justin Bayer, Daan Wierstra, Yi Sun, Martin Felder, Frank Sehnke, Thomas R̈uckstieß, and Jürgen Schmidhuber. Pybrain. Journal of Machine Learning Research, 11:743-746, 2010.
22. Jonathan Baxter and Peter L. Bartlett. Infinite-horizon policygradient estimation. Journal of Artificial Intelligence Research, 15:319-350, 2001.
23. Nathan Sprague and Dana Ballard. Eye Movements for Reward Maximization, NIPS, 2003.
24. Tom Erez and William D. Smart. Coupling perception and action using minimax optimal control. In IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2009), pages 58-65, 2009.
25. Pierre-Yves Oudeyer, Frdric Kaplan, and Verena V. Hafner. Intrinsic Motivation Systems for Autonomous Mental Development. IEEE Transactions on Evolutionary Computation, 11(2):265-286, April 2007.
26. Jürgen Schmidhuber. Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts. Connection Science, 18(2):173-187, 2006.