A decentralized parallel implementation for parallel tempering algorithm

Parallel Computing

Volumn 35, Issue 5, 2009, Pages 269-283

  Li, Yaohang ^a   Mascagni, Michael ^b   Gorin, Andrey ^c  

^a North Carolina Agricultural and Technical State University   (United States)

^b Florida State University   (United States)

^c OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Markov Chain Monte Carlo; Parallel random numbers; Parallel tempering

Indexed keywords

BENCHMARK FUNCTIONS; COMMUNICATION OVERHEADS; COMPUTATIONAL RESULTS; GLOBAL SYNCHRONIZATIONS; INTER-PROCESSOR COMMUNICATIONS; LOAD-BALANCED; LOAD-BALANCING; MARKOV CHAIN MONTE CARLO; MASSIVELY PARALLEL SYSTEMS; MESSAGE PASSING INTERFACES; NON-BLOCKING; OBJECTIVE FUNCTIONS; PARALLEL IMPLEMENTATIONS; PARALLEL RANDOM NUMBER GENERATORS; PARALLEL RANDOM NUMBERS; PARALLEL TEMPERING; PARALLEL TEMPERING ALGORITHMS; PHYSICAL SYSTEMS; PSEUDO RANDOM NUMBER GENERATORS; REPLICA EXCHANGES;

BLOCK CODES; COMMUNICATION; MARKOV PROCESSES; MESSAGE PASSING; MONTE CARLO METHODS; NUMBER THEORY; PHOTOTRANSISTORS; RANDOM NUMBER GENERATION; TEMPERING; UNCERTAIN SYSTEMS;

PARALLEL ALGORITHMS;

EID: 65349128689     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2008.12.009     Document Type: Article

References (36)

1. Marinari E., and Parisi G. Simulated tempering: a new Monte Carlo scheme. Europhysics Letters 19 (1992) 451-458
2. Geyer C.J., and Thompson E.A. Annealing Markov Chain Monte Carlo with applications to ancestral inference. Journal of the American Statistical Association 90 (1995) 909-920
3. Falcioni M., and Deem M.W. A biased Monte Carlo Scheme for zeolite structure solution. Journal of Chemical Physics 110 (1999) 1754-1766
4. Schug A., Herges T., Verma A., and Wenzel W. Investigation of the parallel tempering method for protein folding. Journal of Physics: Condensed Matter 17 (2005) 1641-1650
5. Sikorski A. Properties of star-branched polymer chains - Application of the replica exchange Monte Carlo method. Macromolecules 35 18 (2002) 7132-7137
6. Schug A., and Wenzel W. Predictive in-silico all atom folding of a four helix protein with a free energy model. Journal of the American Chemical Society 126 (2004) 16737
7. Y. Li, C.E.M. Strauss, A. Gorin, Parallel tempering in rosetta practice, in: Proceedings of International Conference on Bioinformatics and its Applications (ICBA'04), Fort Lauderdale, Florida, 2004.
8. Mascagni M., and Srinivasan A. Algorithm 806: SPRNG: A scalable library for pseudorandom number generation. ACM Transactions on Mathematical Software 26 (2000) 436-461
9. A. Sokal, Monte Carlo methods in statistical mechanics: foundations and new algorithms, in: Functional Integration (Cargèse, 1996), Plenum, New York, 1997, pp. 131-192.
10. Li Y., Protopopescu V.A., and Gorin A. Accelerated simulated tempering. Physics Letters A 328 4 (2004) 274-283
11. J.S. Liu, F. Liang, W.H. Wong, The Use of Multiple-Try Method and Local Optimization in Metropolis Sampling, Technical Report, Department of Statistics, Stanford University, 1998.
12. Srinivasan A., Mascagni M., and Ceperley D. Testing parallel random number generators. Parallel Computing 29 (2003) 69-94
13. Y. Li, J. Clark, X. Zhang, Parallel implementation of the accelerated simulated tempering method, in: Proceedings of 3rd NPSC Conference, Atlanta, 2006.
14. Y. Li, V.A. Protopopescu, N. Arnold, X. Zhang, A. Gorin, Hybrid Parallel Tempering/Simulated Annealing Method, submitted to Physical Review E, 2006.
15. J.S. Vetter, M.O. McCracken, Statistical scalability analysis of communication operations in distributed applications, in: Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPOPP), 2001.
16. Rathore N., Chopra M., and de Pablo J.J. Optimal allocation of replicas in parallel tempering simulations. Journal of Chemical Physics 122 (2005) 024111
17. Hansmann U.H.E., and Okamoto Y. Generalized-ensemble Monte Carlo method for systems with rough energy landscape. Physical Review E 56 20 (1997) 2228-2233
18. Kone A., and Kofke D.A. Selection of temperature intervals for parallel temerping simulations. Journal of Chemical Physics 122 20 (2005) 206101
19. Sugita Y., and Okamoto Y. Replica-exchange molecular dynamics method for protein folding. Chemical Physics Letters 314 (1999) 141-151
20. Zhang W., Wu C., and Duan Y. Convergence of replica exchange molecular dynamics. Journal of Chemical Physics 123 (2005) 154105
21. M. Eleftheriou, A. Rayshubski, J.W. Pitera, B.G. Fitch, R. Zhou, R.S. Germain, Parallel implementation of the replica exchange molecular dynamics algorithm on blue Gene/L, in: Proceedings of Parallel and Distributed Processing Symposium, 2006.
22. Sugita Y., and Okamoto Y. Replica-exchange multicanonical algorithm and multicanonical replica exchange method for simulating systems with rough energy landscape. Chemical Physics Letters 329 3 (2000) 261-270
23. Katzgraber H.G., Palassini M., and Young A.P. Monte Carlo simulations of spin glasses at low temperatures. Physical Review B 63 (2001) 184422
24. Ackley D. An empirical study of bit vector function optimization. Genetic Algorithms and Simulated Annealing (1987) 170-215
25. Torn A., and Zilinskas A. Global Optimization. Lecture Notes in Computer Science vol. 350 (1989), Springer-Verlag, Berlin
26. Schwefel H.P. Numerical Optimization of Computer Models (1981), John Wiley & Sons
27. Rosenbrock H.H. An automatic method for finding the greatest or least value of a function. Computer Journal 3 (1960) 175-184
28. L.A. Rastrigin, Extremal Control Systems, Theoretical Foundations of Engineering Cybernetics Series, vol. 3, Nauka, Moscow, 1974.
29. Mascagni M., and Ren J. New development in the scalable parallel random number generator (SPRNG) library. The Institute of Statistical Mathematics Cooperative Research Report 210 (2008) 120-125
30. Y. Li, M. Mascagni, A. Gorin, Decentralized replica exchange parallel tempering: an efficient implementation of parallel tempering using MPI and SPRNG, in: Proceedings of International Conference on Computational Science and Its Applications (ICCSA), Kuala Lumpur, 2007.
31. Schug A., Herges T., and Wenzel W. Allatom folding of the three helix HIV accessory protein with an adaptive parallel tempering method. Proteins 57 (2004) 792
32. Schug A., Herges T., Verma A., and Wenzel W. Investigation of the parallel tempering Method for Protein Folding 17 (2005) 1641-1650
33. Roberts G.O., Gelman A., and Gilks W.R. Weak convergence and optimal scaling of random walk metropolis algorithms. Annals of Applied Probability 7 (1997) 110-120
34. Earl D.J., and Deem M.W. Parallel tempering: theory, applications, and new perspectives. Physical Chemistry Chemical Physics 7 (2005) 3910-3916
35. Earl D.J., and Deem M.W. Optimal allocation of replicas to processors in parallel tempering simulations. Journal of Physical Chemistry B 108 (2004) 6844-6849
36. Zuckerman D.M., and Lyman E. A second look at canonical sampling of biomolecules using replica exchange simulation. Journal of Chemical Theory and Computation 2 (2006) 1200-1202