Improving samc using smoothing methods: Theory and applications to bayesian model selection problems

Annals of Statistics

Volumn 37, Issue 5 B, 2009, Pages 2626-2654

  Liang, Faming ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Markov chain Monte Carlo; Model selection; Reversible jump; Smoothing; Stochastic approximation Monte Carlo

Indexed keywords

EID: 69049089832     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/07-AOS577     Document Type: Article

References (43)

1. Aerts, M., Augustyns, I. and Janssen, P. (1997). Smoothing sparse multinomial data using local polynomial fitting. J. Nonparametr. Statist. 8 127-147. MR1486997 (Pubitemid 127541911)
2. Andrieu, C., Moulines, É. and Priouret, P. (2005). Stability of stochastic approximation under verifiable conditions. SIAM J. Control Optim. 44 283-312. MR2177157
3. Atchadé, Y.F. and Liu, J. S. (2007). The Wang-Landau algorithm in general state spaces: Applications and convergence analysis. Technical report, Dept. Statistics, Univ. Michigan.
4. Barry, D. and Hartigan, J. A. (1993). A Bayesian analysis for change point problems. J. Amer. Statist. Assoc. 88 309-319. MR1212493
5. Benveniste, A., Metivier, M. and Priouret, P. (1990). Adaptive Algorithms and Stochastic Approximations. Springer, New York. MR1082341
6. Berg, B.A.andNeuhaus, T. (1991). Multicanonical algorithms for 1st order phase-transitions. Phys. Lett. B 267 249-253.
7. Burman, P. (1987). Smoothing sparse contingency tables. Sankhyā Ser. A 49 24-36. MR0917903
8. Chen, H.-F. (2002). Stochastic Approximation and Its Applications. Kluwer Academic Publishers, Boston. MR1942427
9. Cheon, S.Y. and Liang, F. (2007). Phylogenetic tree reconstruction using stochastic approximation Monte Carlo. BioSystems. To appear.
10. Dong, J. and Simonoff, J. S. (1994). The construction and properties of boundary kernels for smoothing sparse multinomials. J. Comput. Graph. Statist. 3 57-66.
11. Fan, J., Heckman, N. E. and Wand, M. P. (1995). Local polynomial kernel regression for generalized linear models and quasi-likelihood functions. J. Amer. Statist. Assoc. 90 141-150. MR1325121
12. Folland, G. B. (1990). Restimates in Taylor's theorem. American Math. Monthly 97 233-235. MR1048439
13. Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Machine Intelligence 6 721-741.
14. Geyer, C. J. (1991). Markov chain Monte Carlo maximum likelihood. In Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface (E. M. Keramigas, ed.) 156-163. Interface Foundation, Fairfax.
15. Geyer, C.J. and Thompson, E. A. (1995). Annealing Markov chain Monte Carlo with applications to ancestral inference. J. Amer. Statist. Assoc. 90 909-920.
16. Gilks, W.R., Roberts, R. O. and Sahu, S. K. (1998). Adaptive Markov chain Monte Carlo through regeneration. J. Amer. Statist. Assoc. 93 1045-1054. MR1649199
17. Green, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82 711-732. MR1380810
18. Gu, M.G. and Kong, F. H. (1998). A stochastic approximation algorithm with Markov chain Monte Carlo method for incomplete data estimation problems. Proc. Natl. Acad. Sci. USA 95 7270-7274. MR1630899
19. Hall, P. and Heyde, C. C. (1980). Martingale Limit Theory and Its Application. Academic Press, New York. MR0624435
20. Hall, P. and Titterington, D. M. (1987). On smoothing sparse multinomial data. Austral. J. Statist. 29 19-37. MR0899373
21. Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57 97-109.
22. Hesselbo, B. and Stinchcomble, R. B. (1995). Monte Carlo simulation and global optimization without parameters. Phys. Rev. Lett. 74 2151-2155.
23. Hukushima K. and Nemoto, K. (1996). Exchange Monte Carlo method and application to spin glass simulations. J. Phys. Soc. Jpn. 65 1604-1608. (Pubitemid 126456584)
24. Kou, S.C., Zhou, Q. and Wong, W. H. (2006). Equi-energy sampler with applications to statistical inference and statistical mechanics (with discussion). Ann. Statist. 34 1581-1619. MR2283711
25. Kushner, H.J.andYing, G. G. (2003). Stochastic Approximation and Recursive Algorithms and Applications. Springer, New York. MR1993642
26. Liang, F. (2005). Generalized Wang-Landau algorithm for Monte Carlo computation. J. Amer. Statist. Assoc. 100 1311-1327. MR2236444
27. Liang, F. (2007). Annealing stochastic approximation Monte Carlo for neural network training. Machine Learning 68 201-233.
28. Liang, F., Liu, C. and Carroll, R. J. (2007). Stochastic approximation in Monte Carlo computation. J. Amer. Statist. Assoc. 102 305-320. MR2345544
29. Liang, F. and Wong, W. H. (2000). Evolutionary Monte Carlo sampling: Applications to Cp model sampling and change-point problem. Statist. Sinica 10 317-342.
30. Liang, F. and Wong, W. H. (2001). Real parameter evolutionary Monte Carlo with applications in Bayesian mixture models. J. Amer. Statist. Assoc. 96 653-666. MR1946432
31. Marinari, E. and Parisi, G. (1992). Simulated tempering: A new Monte Carlo scheme. Europhys. Lett. 19 451-458.
32. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. and Teller, E.(1953). Equation of state calculations by fast computing machines. J. Chem. Phys. 21 1087-1091.
33. Mitsutake, A., Sugita, Y. and Okamoto, Y. (2003). Replica-exchange multicanonical and multicanonical replica exchange Monte Carlo simulations of peptides. I. Formula and benchmark test. J. Chem. Phys. 118 6676-6688.
34. Phillips, D. B. and Smith, A. F. M. (1996). Bayesian model comparison via jump diffusions. In Markov Chain Monte Carlo in Practice (W. R. Gilks, S. Richardson and D. J. Spiegelhalter, eds.) 215-239. Chapman and Hall, London. MR1397970
35. Roberts, G. O. and Tweedie, R. L. (1996). Geometric convergence and central limit theorems for multidimensional Hastings and Metropolis algorithms. Biometrika 83 95-110. MR1399158
36. Rosenthal, J. S. (1995). Minorization conditions and convergence rate for Markov chain Monte Carlo. J. Amer. Statist. Assoc. 90 558-566. MR1340509
37. Simonoff, J. S. (1998). Three sides of smoothing: categorical data smoothing, nonparametric regression, and density estimation. Internat. Statist. Rev. 66 137-156.
38. TadiĆ, V. (1997). On the convergence of stochastic iterative algorithms and their applications to machine learning. A short version of this paper was published in Proc. 36th Conf. on Decision and Control 2281-2286. San Diego, USA.
39. Tibshirani, R. and Hastie, T. (1987). Local likelihood estimation. J. Amer. Statist. Assoc. 82 559-568. MR0898359
40. Venables, W. N. and Ripley, B. D. (1999). Modern Applied Statistics with S-PLUS, 3rd ed. Springer, New York. MR1337030
41. Wang, F. and Landau, D. P. (2001). Efficient, multiple-range random walk algorithm to calculate the density of states. Phys. Rev. Lett. 86 2050-2053.
42. Wong, W.H. and Liang, F. (1997). Dynamic weighting in Monte Carlo and optimization. Proc. Natl. Acad. Sci. 94 14220-14224. MR1492410
43. Younes, L. (1999). On the converges of Markovian stochastic algorithms with rapidly decreasing ergodicity rates. Stochastic Stochastic Rep. 65 177-228. MR1687636