A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: Easy Bayesian computing for real parameter spaces

Statistics and Computing

Volumn 16, Issue 3, 2006, Pages 239-249

  Ter Braak, Cajo J F ^a  

^a WAGENINGEN UNIVERSITY   (Netherlands)

Author keywords

Block updating; Evolutionary Monte Carlo; Metropolis algorithm; Population Markov Chain Monte Carlo; Simulated Annealing; Simulated Tempering; Theophylline Kinetics

Indexed keywords

EID: 33745603720     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11222-006-8769-1     Document Type: Article

References (26)

1. Gelman A., Carlin J. B., Stern H. S. and Rubin D. B. 2004. Bayesian data analysis, 2nd edition. London, Chapman & Hall.
2. Gilks W. R., Richardson S. and Spiegelhalter D. J. 1996. Markov chain monte carlo in practice. London, Chapman & Hall.
3. Gilks W. R. and Roberts G. O.1996. Strategies for improving MCMC. In Markov chain monte carlo in practice. Gilks W. R., Richardson S. and Spiegelhalter D. J., (eds.), London, Chapman & Hall, pp. 89-114.
4. Gilks W. R., Roberts G. O. and George E. I. 1994. Adaptive direction sampling. The Statistician 43: 179-189.
5. Haario H., Saksman E. and Tamminen J. 2001. An adaptive Metropolis algorithm. Bernoulli 7: 223-242.
6. Lampinen J. 2001. A bibliography of Differencial Evolution algorithm. Lappeenranta University of Technology, Lappeenranta, www.lut.fi/~jlampine/ debiblio.htm.
7. Lampinen J. and Zelinka I. 2000. On stagnation of the Differential Evolution algorithm. Proceedings of MENDEL 2000, 6th International Mendel Conference on Soft Computing, Brno, pp. 76-83.
8. Laskey K. B. and Myers J. W. 2003. Population Markov Chain Monte Carlo. Machine Learning 50: 175-196.
9. Liang F. 2002. Dynamically weighted importance sampling in Monte Carlo computation. Journal of the American Statistical Association 97: 807-821.
10. Liang F. M. and Wong W. H. 2001. Real-parameter evolutionary Monte Carlo with applications to Bayesian mixture models. Journal of the American Statistical Association 96: 653-666.
11. Liu J. and Hodges J. S. 2003. Posterior bimodality in the balanced oneway random-effects model. Journal of the Royal Statistical Society Series B 65: 247-255.
12. Lunn D. J., Thomas A., Best N. and Spiegelhalter D. 2000. WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing 10: 325-337.
13. Mengersen K. and Robert C. P. 2003. IID sampling using self-avoiding population Monte Carlo: the pinball sampler. In Bernardo J. M., Bayarri M. J., Berger J. O., Dawid A. P., Heckerman D., Smith A. F. M. and West M. (eds.), Bayesian Statistics 7, Oxford, Clarendon Press, pp. 277-292.
14. Mengersen K. L. and Tweedie R. L. 1996. Rates of convergence of the Hastings and Metropolis algorithms. Annals of Statistics 24: 101-121.
15. Pinheiro J. C. and Bates D. M. 2000. Mixed-Effects Models in S and S-PLUS. New York, Springer Verlag.
16. Price K. 1999. An introduction to differential evolution. In Corne D., Dorigo M. and Glover F. (eds.), New Ideas in Optimization, London, McGraw-Hill, pp. 79-108.
17. Price K. and Storn R. 1997. Differential Evolution. Dr Dobb's Journal 264: 18-24.
18. R Development Core Team 2003. R: A language and environment for statistical computing. Vienna, Austria, R Foundation for Statistical Computing, www.r-project.org.
19. Robert C. P. and Casella G. 2004. Monte Carlo Statistical Methods, 2nd ed., New York, Springer Verlag.
20. Roberts G. O. and Rosenthal J. S. 2001. Optimal scaling for various Metropolis-Hastings algorithms. Statistical Science 16: 351-367.
21. Schmitt L. M. 2004. Theory of genetic algorithms II: models for genetic operators over string-tensor representation of populations and convergence to global optima for arbitrary fitness function under scaling. Theoretical Computer Science 310: 181-231.
22. Spiegelhalter D., Thomas A., Best N., and Lunn D. 2003. WinBUGS User Manual version 1.4. www.mrc-bsu.cam.ac.uk/bugs.
23. Storn R. and Price K. 1995 Differential Evolution - a simple and efficient adaptive scheme for global optimization over continuous spaces. International Computer Science Institute, Berkeley, TR-95-012, http://www.icsi.berkeley.edu/~storn/litera.html.
24. Storn R. and Price K. 1997. Differential Evolution - a simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimisation 11: 341-359.
25. Strens M. Bernhardt M. and Everett N. 2002. Markov chain Monte Carlo sampling using direct search optimization. ICML, Sydney, pp. 602-609.
26. Waagepetersen R. and Sorensen D. 2001. A tutorial on reversible jump MCMC with a view toward applications in QTL-mapping. International Statistical Review 69: 49-61.