Information theoretic justification of Boltzmann selection and its generalization to Tsallis case

2005 IEEE Congress on Evolutionary Computation, IEEE CEC 2005. Proceedings

Volumn 2, Issue , 2005, Pages 1667-1674

  Dukkipati, Ambedkar ^a   Murty, M Narasimha ^a   Bhatnagar, Shalabh ^a  

^a INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; INFORMATION THEORY; PARAMETER ESTIMATION; STATISTICAL METHODS;

BOLTZMANN DISTRIBUTION; BOLTZMANN SELECTION; PARAMETER GENERALIZATION; TSALLIS STATISTICS;

EVOLUTIONARY ALGORITHMS;

EID: 27144536837     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Alain Cercueil and Olivier Francois, "Monte Carlo simulation and population-based optimization," in Proceedings of the 2001 Congress on Evolutionary Computation (CEC2001). 2001, pp. 191-198, IEEE Press.
2. R. Cerf, "The dynamics of mutation-selection algorithms with large population sizes," Ann. Inst. H. Poincaré, vol. 32, pp. 455-508, 1996.
3. R. Cerf, "A new genetic algorithm," Ann. Appl. Probab., vol. 6, pp. 778-817, 1996.
4. James D. Nulton and Peter Salamon, "Statistical mechanics of combinatorial optimization," Physical Review A, vol. 37, no. 4, pp. 1351-1356, 1988.
5. S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, "Optimization by simulated annealing," Science, vol. 220, no. 4598, pp. 671-680, 1983.
6. E. T. Jaynes, Papers on Probability, Statistics and Statistical Physics, D. Reidel publishing Co., Dordrecth, Holland, 1983.
7. C. Tsallis, "Possible generalization of Boltzmann Gibbs statistics," J. Stat. Phys., vol. 52, pp. 479, 1988.
8. Constantino Tsallis, "Generalized entropy-based criterion for consistent testing," Physical Review E, vol. 58, pp. 1442-1445, 1998.
9. Aristoklis D. Anastasiadis and George D. Magoulas, "Nonextensive statistical mechanics for hybrid learning of neural networks," Physica A, vol. 344, pp. 372-382, 2004.
10. Constantino Tsallis and Daniel A. Stariolo, "Generalized simulated annealing," Physica A, vol. 233, pp. 345-406, 1996.
11. N. Metropolis, A. Rosenbluth, M. Rosenbluth, A. Teller, and E. Teller, "Equation of state calculation by fast computing machines," Journal of Chemical Physics, vol. 21, pp. 1087-1092, 1953.
12. D. A. Stariolo and C. Tsallis, "Optimization by simulated annealing: Recent progress," in Annual Reviews of Computational Physics, D. Staufer, Ed., vol. 2, p. 343. World Scientific, Singapore, 1995.
13. Z. X. Yu and D. Mo, "Generalized simulated annealing algorithm applied in the ellipsometric inversion problem," Thin Solid Films, vol. 425, pp. 108, 2003.
14. M. A. Moret, P. G. Pascutti, P. M. Bisch, and K. C. Mundim, "Stochastic molecular optimization using generalized simulated annealing," J. Comp. Chemistry, vol. 19, pp. 647, 1998.
15. T. J. P. Penna, "Traveling salesman problem and Tsallis statistics," Physical Review E, vol. 51, pp. R1, 1995.
16. M. de la Maza and B. Tidor, "An analysis of selection procedures with particular attention paid to proportional and Boltzmann selection," in Proceedings of the Fifth International Conference on Genetic Algorithms, S. Forrest, Ed., San Mateo, CA, 1993, pp. 124-131, Morgan Kaufmann Publishers.
17. Adam Prügel-Bennett and Jonathan Shapiro, "Analysis of genetic algorithms using statistical mechanics," Physical Review Letters, vol. 72, no. 9, pp. 1305-1309, 1994.
18. David B. Fogel, "An introduction to simulated evolutionary optimization," IEEE Transactions on Neural Networks, vol. 5, no. 1, pp. 3-14, January 1994.
19. Thomas Back, Ulrich Hammel, and Hans-Paul Schwefel, "Evolutionary computation: Comments on the history and current state," IEEE Transactions on Evolutionary Computation, vol. 1, no. 1, pp. 3-17, April 1997.
20. J. H. Holland, Adaptation in Natural and Artificial Systems, The University of Michigan Press, Ann Arbor, MI, 1975.
21. Thomas Back, "Selective pressure in evolutionary algorithms: A characterization of selection mechanisms," in Proceedings of the First IEEE Conference on Evolutionary Computation, Piscataway, NJ, 1994, pp. 57-62, IEEE Press.
22. E. Aarts and J. Korst, Simulated Annealing and Boltzmann Machines-A Stochastic Approach to Combinatorial Optimization and Neural Computing, Wiley, New York, 1989.
23. Thilo Mahnig and Heinz Mühlenbein, "A new adaptive Boltzmann selection schedule sds," in Proceedings of the Congress on Evolutionary Computation (CEC'2001). 2001, pp. 183-190, IEEE Press.
24. Ambedkar Dukkipati, M. Narasimha Murty, and Shalabh Bhatnagar, "Cauchy annealing schedule: An annealing schedule for Boltzmann selection scheme in evolutionary algorithms," in Proceedings of the Congress on Evolutionary Computation(CEC'2004). 2004, pp. 55-62, IEEE Press.
25. S. Kullback, Information Theory and Statistics, Wiley, New York, 1959.
26. John E. Shore, "Properties of cross-entropy minimization," IEEE Transactions on Information Theory, vol. IT-27, no. 4, pp. 472-482, 1981.
27. J. N. Kapur and H. K. Kesavan, Entropy Optimization Principles with Applications, Academic Press, 1997.
28. J. E. Shore and R. W. Johnson, "Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy," IEEE Transactions on Information Theory, vol. IT-26, no. 1, pp. 26-37, 1980.
29. A. S. Cherney and V. P. Maslov, "On minimization and maximization of entropy in various disciplines," SIAM journal of Theory of Probability and Its Applications, vol. 48, no. 3, pp. 447-464, 2004.
30. E. M. F. Curado and C. Tsallis, "Generalized statistical mechanics: connections with thermodynamics," J. Phys. A: Math. Gen., vol. 24, pp. 69-72, 1991.
31. Constantino Tsallis, Renio S. Mendes, and A. R. Plastino, "The role of constraints within generalized nonextensive statistics," Physica A, vol. 261, pp. 534-554, 1998.
32. A. Plastino and A. R. Plastino, "From Gibbs micro-canonical ensemble to Tsallis generalized canonical distribution," Phys. Lett. A, vol. 193, pp. 140, 1994.
33. C. Tsallis, "What are the numbers that experiments provide?," Quimica Nova, vol. 17, pp. 468, 1994.
34. Ioan Andricioaei and John E. Straub, "On Monte Carlo and molecular dynamics methods inspired by Tsallis statistics: Methodology, optimization, and application to atomic clusters," J. Chem. Phys., vol. 107, no. 21, pp. 9117-9124, 1997.
35. Heinz Mühlenbein and Dirk Schlierkamp-Voosen, "Predictive models for the breeder genetic algorithm," Evolutionary Computation, vol. 1, no. 1, pp. 25-49, 1993.
36. Constantino Tsallis, "Nonextensive statistics: Theoretical, experimental and computational evidences and connections," Brazilian Journal of Physics, vol. 29, pp. 1, 1999.