Curiosity-driven optimization

2011 IEEE Congress of Evolutionary Computation, CEC 2011

Volumn , Issue , 2011, Pages 1343-1349

  Schaul, Tom ^a   Sun, Yi ^a   Wierstra, Daan ^b   Gomez, Fausino ^a   Schmidhuber, Jurgen ^a  

^a UNIVERSITY OF LUGANO   (Switzerland)

^b EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE EXPLORATIONS; BLACK-BOX OPTIMIZATION; CLOSED-FORM EXPRESSION; DATA POINTS; DATA SELECTION; EVOLUTIONARY SEARCH; EXPECTED INFORMATIONS; FITNESS FUNCTIONS; GAUSSIAN PROCESS REGRESSION; MODEL ESTIMATES; MULTI OBJECTIVE; PARETO-FRONT;

DATA REDUCTION; EVOLUTIONARY ALGORITHMS;

OPTIMIZATION;

EID: 80052015039     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.2011.5949772     Document Type: Conference Paper

References (31)

1. J. Schmidhuber, "Curious model-building control systems", IEEE International Joint Conference on Neural Networks, pp. 1458-1463, 1991.
2. -, "Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts", Connection Science, vol. 18, pp. 173-187, 2006. (Pubitemid 43982721)
3. -, "Driven by compression progress: A simple principle explains essential aspects of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes", Anticipatory Behavior in Adaptive Learning Systems, from Sensorimotor to Higherlevel Cognitive Capabilities, 2009.
4. A. Booker, J. J. Dennis, P. Frank, and D. Serafini, "Optimization using surrogate objectives on a helicopter test example", Computational Methods in Optimal Design and Control, 1998.
5. A. Krause and C. Guestrin, "Nonmyopic active learning of gaussian processes: An exploration-exploitation approach", in Proceedings of the International Conference on Machine Learning, 2007.
6. D. R. Jones, "A taxonomy of global optimization methods based on response surfaces", Journal of Global Optimization, vol. 21, pp. 345-383, 2001. (Pubitemid 33672374)
7. A. W. Moore and J. Schneider, "Memory-based stochastic optimization", in Advances in Neural Information Processing Systems, 1996.
8. D. R. Jones, M. Schonlau, and W. J. Welch, "Efficient global optimization of expensive black-box functions", Journal of Global Optimization, vol. 13, pp. 455-492, 1998. (Pubitemid 128507405)
9. J. Storck, J. Hochreiter, and J. Schmidhuber, "Reinforcement-driven information acquisition in non-deterministic environments", in International Conference on Artificial Neural Networks (ICANN), Paris, 1995, pp. 159-164.
10. M. P. Deisenroth, C. E. Rasmussen, and J. Peters, "Gaussian process dynamic programming", Neurocomputing, pp. 1508-1524, 2009.
11. T. Pfingsten, "Bayesian active learning for sensitivity analysis", in Machine Learning: ECML 2006, 2006, pp. 353-364. (Pubitemid 44618845)
12. L. Itti and P. Baldi, "Bayesian surprise attracts human attention", in Advances in Neural Information Processing Systems, Y. W. Platt, B. Schölkopf, and J., Eds. MIT Press, 2006, pp. 547-554.
13. J. Schmidhuber, "Simple algorithmic principles of discovery, subjective beauty, selective attention, curiosity and creativity", Lecture Notes In Artificial Intelligence, vol. 4754, 2007.
14. V. V. Fedorov, Theory of optimal experiments. New York: Academic press, 1972.
15. J.-N. Hwang, J. J. Choi, S. Oh, and R. J. I. Marks, "Query-based learning applied to partially trained multilayer perceptrons", IEEE Transactions on Neural Networks, vol. 2, pp. 131-136, 1991.
16. D. J. C. MacKay, "Information-based objective functions for active data selection", Neural Computation, vol. 4, pp. 550-604, 1992.
17. M. Plutowski, G. Cottrell, and H. White, "Learning mackey-glass from 25 examples, plus or minus 2", in Advances in Neural Information Processing Systems, 1994, pp. 1135-1142.
18. D. A. Cohn, "Neural network exploration using optimal experiment design", in Advances in Neural Information Processing Systems, 1994, pp. 679-686.
19. K. Chaloner and I. Verdinelli, "Bayesian experimental design: A review", Statistical Science, vol. 10, pp. 273-304, 1995.
20. Y. Zhang, W. Xu, and J. Callan, "Exploration and exploitation in adaptive filtering based on bayesian active learning", in International Conference on Machine Learning (ICML), 2003, pp. 896-903.
21. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II", IEEE Transactions on Evolutionary Computation, vol. 6, pp. 182-197, 2002. (Pubitemid 34555372)
22. D. A. Cohn, Z. Ghahramani, and M. I. Jordan, "Active learning with statistical models", Journal of Artificial Intelligence Research, vol. 4, pp. 129-145, 1995. (Pubitemid 126646151)
23. C. E. Rasmussen and C. K. I. Williams, Gaussian processes for machine learning. MIT Press, 2006.
24. D. Büche, N. N. Schraudolph, and P. Koumoutsakos, "Accelerating Evolutionary Algorithms with Gaussian Process Fitness Function Models", IEEE Transactions on Systems, Man, and Cybernetics, vol. C 35, no. 2, pp. 183-194, 2005. (Pubitemid 40654431)
25. S. Seo, M. Wallat, T. Graepel, and K. Obermayer, "Gaussian process regression: Active data selection and test point rejection", in Proceedings of the International Joint Conference on Neural Networks (IJCNN). IEEE, 2000, pp. 241-246.
26. L. Csató and M. Opper, "Sparse on-line gaussian processes", Neural Computation, vol. 14, 2002.
27. D. Wierstra, T. Schaul, J. Peters, and J. Schmidhuber, "Natural Evolution Strategies", in Proceedings of the Congress on Evolutionary Computation (CEC08), Hongkong. IEEE Press, 2008.
28. T. Glasmachers, T. Schaul, Y. Sun, D. Wierstra, and J. Schmidhuber, "Exponential Natural Evolution Strategies", in Genetic and Evolutionary Computation Conference (GECCO), Portland, OR, 2010.
29. T. Schaul, J. Bayer, D. Wierstra, Y. Sun, M. Felder, F. Sehnke, T. Rückstieß, and J. Schmidhuber, "PyBrain", Journal of Machine Learning Research, vol. 11, pp. 743-746, 2010.
30. P. Bosman, J. Grahl, and D. Thierens, "Enhancing the performance of maximumlikelihood gaussian edas using anticipated mean shift", in Parallel Problem Solving from Nature PPSN X, 2008, pp. 133-143.
31. M. Locatelli, "Bayesian algorithms for one-dimensional global optimization", Journal of Global Optimization, pp. 57-76, 1997. (Pubitemid 127502305)