Divide and conquer: A mixture-based approach to regional adaptation for MCMC

Journal of Computational and Graphical Statistics

Volumn 20, Issue 1, 2011, Pages 63-79

  Bai, Yan ^a   Craiu, Radu V ^a   Di Narzo, Antonio F ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b SWISS INSTITUTE OF BIOINFORMATICS   (Switzerland)

Author keywords

Adaptive MCMC; Mixture model; Online EM

Indexed keywords

EID: 79952777602     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2010.09035     Document Type: Article

References (29)

1. Andrieu, C., and Moulines, E. (2006), "On the Ergodicity Properties of Some Adaptive MCMC Algorithms," The Annals of Applied Probability, 16, 1462-1505. [63-65] (Pubitemid 44662199)
2. Andrieu, C., and Robert, C. P. (2001), "Controlled MCMC for Optimal Sampling," technical report, Université Paris Dauphine. [63]
3. Andrieu, C., and Thoms, J. (2008), "A Tutorial on AdaptiveMCMC," Statistics and Computing, 18, 343-373. [64, 69,70]
4. Andrieu, C., Moulines, E., and Priouret, P. (2005), "Stability of Stochastic Approximation Under Verifiable Conditions," SIAM Journal on Control and Optimization, 44, 283-312. [64]
5. Barrett, M., Galipeau, P., Sanchez, C., Emond, M., and Reid, B. (1996), "Determination of the Frequency of Loss of Heterozygosity in Esophageal Adeno-Carcinoma by Cell Sorting, Whole Genome Amplification and Microsatellite Polymorphisms," Oncogene, 12, 1873-1878. [73] (Pubitemid 26154658)
6. Cappé, O., and Moulines, E. (2009), "Online EM Algorithm for Latent Data Models," Journal of the Royal Statistical Society, Ser. B, 71, 593-613. [65]
7. Craiu, R. V., Rosenthal, J. S., and Yang, C. (2009), "Learn From Thy Neighbor: Parallel-Chain Adaptive and Regional MCMC," Journal of the American Statistical Association, 104, 1454-1466. [64,69]
8. Crawford, S. L. (1994), "An Application of the Laplace Method to Finite Mixture Distributions," Journal of the American Statistical Association, 89 (425), 259-267. [75]
9. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977), "Maximum Likelihood From Incomplete Data via the EM Algorithm," Journal of the Royal Statistical Society, Ser. B, 39, 1-22. [65]
10. Desai, M. (2000), "MixtureModels for Genetic Changes in Cancer Cells," Ph.D. thesis, University ofWashington. [73]
11. Gelman, A., and Rubin, D. B. (1992), "Inference From Iterative Simulation Using Multiple Sequences" (with discussion), Statistical Science, 7, 457-511. [64]
12. Geyer, C. J., and Thompson, E. A. (1994), "Annealing Markov Chain Monte CarloWith Applications to Ancestral Inference," Technical Report 589, University of Minnesota. [64]
13. Giordani, P., and Kohn, R. (2010), "Adaptive Independent Metropolis-Hastings by Fast Estimation of Mixtures of Normals," Journal of Computational and Graphical Statistics, 19, 243-259. [64]
14. Guan, Y., and Krone, S. M. (2007), "Small-World MCMC and Convergence to Multi-Modal Distributions: From Slow Mixing to Fast Mixing," The Annals of Applied Probability, 17, 284-304. [68]
15. Haario, H., Saksman, E., and Tamminen, J. (2001), "An Adaptive Metropolis Algorithm," Bernoulli, 7, 223-242. [63,68] (Pubitemid 33793059)
16. Haario, H., Saksman, E., and Tamminen, J. (2005), "Componentwise Adaptation for High DimensionalMCMC," Computational Statistics, 20, 265- 273. [63] (Pubitemid 44070756)
17. Kou, S., Qing, Z., and Wong, W. (2006), "Equi-Energy Sampler With Applications in Statistical Inference and Statistical Mechanics," The Annals of Statistics, 34, 1581-1619. [64] (Pubitemid 44875071)
18. Meyn, S. P., and Tweedie, R. L. (1993), Markov Chains and Stochastic Stability. Communications and Control Engineering Series, London: Springer-Verlag. [70]
19. Neal, R. M. (1994), "Sampling From Multimodal Distributions Using Tempered Transitions," Technical Report 9421, University of Toronto. [64]
20. Neal, R. M. (2001), "Annealed Importance Sampling," Statistics and Computing, 11 (2), 125-139. [64] (Pubitemid 33638185)
21. Richardson, S., and Green, P. J. (1997), "On Bayesian Analysis of Mixtures With an Unknown Number of Components" (with discussion), Journal of the Royal Statistical Society, Ser. B, 59 (4), 731-792. [64, 75] (Pubitemid 127686979)
22. Roberts, G. O., and Rosenthal, J. S. (2001), "Optimal Scaling for Various Metropolis-Hastings Algorithms," Statistical Science, 16 (4), 351-367. [68] (Pubitemid 33636356)
23. Roberts, G. O., and Rosenthal, J. S. (2007), "Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms," The Annals of Applied Probability, 44 (2), 458-475. [64,70]
24. Roberts, G. O., Gelman, A., and Wilks, W. (1997), "Weak Convergence and Optimal Scaling of Random Walk Metropolis Algorithms," The Annals of Applied Probability, 7, 110-120. [68]
25. Small, M. J., Sutton, M. C., and Milke, M. W. (1988), "Parametric Distributions of Regional Lake Chemistry: Fitted and Derived," Environmental Science Technology, 22, 196-204. [75] (Pubitemid 18051234)
26. Sminchisescu, C., and Triggs, B. (2001), "Covariance-Scaled Sampling for Monocular 3D Body Tracking," in IEEE International Conference on Computer Vision and Pattern Recognition, Vol. 1, Hawaii, Washington, DC: IEEE Computer Society Press, pp. 447-454. [64]
27. Titterington, D. M., Smith, A. F. M., and Makov, U. (1985), Statistical Analysis of Finite Mixture Distributions, Chichester: Wiley. [65]
28. Warnes, G. (2001), "The Normal Kernel Coupler: An Adaptive Markov Chain Monte Carlo Method for Efficiently Sampling From Multi-Modal Distributions," technical report, George Washington University. [73]
29. West, M. (1993), "Approximating Posterior Distributions by Mixtures," Journal of the Royal Statistical Society, Ser. B, 55, 409-422. [64]