A Monte Carlo metropolis-hastings algorithm for sampling from distributions with intractable normalizing constants

Neural Computation

Volumn 25, Issue 8, 2013, Pages 2199-2234

  Liang, Faming ^a   Jin, Ick Hoon ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; COMPUTER SIMULATION; HUMAN; INFORMATION PROCESSING; LETTER; MONTE CARLO METHOD; MORTALITY; NEOPLASM; SOCIAL SUPPORT; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTOMATIC DATA PROCESSING; BAYES THEOREM; COMPUTER SIMULATION; HUMANS; MODELS, THEORETICAL; MONTE CARLO METHOD; NEOPLASMS; SOCIAL SUPPORT;

EID: 84880992075     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00466     Document Type: Letter

References (46)

1. c& Roberts, G. O. (2009). The pseudo-marginal approach for efficient Monte Carlo computations. Annals of Statistics, 37, 697-725.
2. Bartz, K., Blitzstein, J.,&Liu, J. S. (2008). MonteCarlo maximum likelihood for exponential random graph models: From snowballs to umbrella densities (Tech. Rep.). Cambridge, MA: Department of Statistics, Harvard University.
3. Beaumont, M. A. (2003). Estimation of population growth or decline in genetically monitored populations. Genetics, 164, 1139-1160.
4. Besag, J. E. (1974). Spatial interaction and the statistical analysis of lattice systems (with discussion). J. R. Statist. Soc. B, 36, 192-236.
5. Bickel, P. J., & Doksum, K. A. (2000). Mathematical statistics: Basic ideas and selected topics (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
6. Chen, M.-H., & Shao, Q.-M. (1997). On Monte Carlo methods for estimating ratios of normalizing constants. Annals of Statistics, 25, 1563-1594.
7. Childs, A. M., Patterson, R. B., & MacKay, D. J. C. (2001). Exact sampling from nonattractive distributions using summary states. Phys. Rev. E., 63, 036113.
8. Corander, J., Dahmström, K., & Dahmström, P. (1998). Maximum likelihood estimation for Markov graphs (Research Rep. 8). Stockholm: Department of Statistics, University of Stockholm.
9. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via EM algorithm. J. R. Stat. Soc. B, 39, 1-38.
10. Efron, B., & Tibshirani, R. J. (1993), An introduction to the bootstrap. London: Chapman & Hall.
11. Frank, I., & Strauss, D. (1986). Markov graphs. Journal of the American Statistical Association, 81, 832-842.
12. Gelman, A., & Meng, X.-L. (1998). Simulating normalizing constants: From importance sampling to bridge sampling to path sampling. Statistical Science, 13, 163- 185.
13. Gelman, A.,&Rubin, D. B. (1992). Inference from iterative simulation usingmultiple sequences (with discussion). Statistical Sciences, 7, 457-511.
14. Geyer, C. J. (1991).Markov chain MonteCarlo maximum likelihood. In E.M.Keramigas (Ed.), Computing science and statistics: Proceedings of the 23rd Symposium on the Interface (pp. 156-163). Fairfax: Interface Foundation.
15. Geyer, C., & Thompson, E. (1992). Constrained Monte Carlo maximum likelihood for dependent data. Journal of the Royal Statistical Society, Series B, 54, 657- 699.
16. Green, P. J., & Richardson, S. (2002). Hidden Markov models and disease mapping. Journal of the American Statistical Association, 97, 1055-1070.
17. Hunter, D. (2007). Curved exponential family models for social network. Social Networks, 29, 216-230.
18. Hunter, D. R., Goodreau, S. M., & Handcock, M. S. (2008). Goodness of fit of social network models. Journal of the American Statistical Association, 103, 248- 258.
19. Hunter, D., & Handcock, M. (2006). Inference in curved exponential family models for network. Journal of Computational and Graphical Statistics, 15, 565-583.
20. Hurn, M., Husby, O., & Rue, H. (2003). A tutorial on image analysis. Lecture Notes in Statistics, 173, 87-141.
21. Liang, F. (2007). Continuous contour Monte Carlo for marginal density estimation with an application to a spatial statistical model. J. Comput. Graph. Statist., 16, 608-632.
22. Liang, F. (2010). A double Metropolis-Hastings sampler for spatial models with intractable normalizing constants. Journal of Statistical Computing and Simulation, 80, 1007-1022.
23. Lubbers, M., & Snijders, T. A. B. (2007). A comparison of various approaches to the exponential random graph model:Areanalysis of 104 student networks in school classes. Social Networks, 29, 489-507.
24. Madras, N. (2000). Lectures on Monte Carlo Methods. Providence, RI: AmericanMathematical Society.
25. McCulloch, C. E., Searle, S. R., & Neuhaus, J. M. (2008). Generalized, linear, and mixed models (2nd ed.). Hoboken, NJ:Wiley.
26. Meng, X.-L., &Wong,W. H. (1996). Simulating ratios of normalizing constants via a simple identity: A theoretical exploration. Statistica Sinica, 6, 831-860.
27. Møller, J., Pettitt, A. N., Reeves, R., & Berthelsen, K. K. (2006). An efficient Markov chain Monte Carlo method for distributions with intractable normalizing constants. Biometrika, 93, 451-458.
28. Morris, M., Handcock, M. S., & Hunter, D. R. (2008). Specification of exponentialfamily random graph models: Terms and computational aspects. Journal of Statistical Software, 24 (4). http://www.jstatsoft.org/v24/i04
29. Murray, I.,Ghahramani, Z.,&MacKay, D. J. C. (2006).MCMCfor doubly-intractable distributions. In Proc. 22nd Annual Conference on Uncertainty in Artificial Intelligence. San Francisco: Morgan Kaufmann.
30. Preisler, H. K. (1993). Modeling spatial patterns of trees attacked by bark-beetles. Appl. Statist., 42, 501-514.
31. Propp, J. G., & Wilson, D. B. (1996). Exact sampling with coupled Markov chains and applications to statistical mechanics. Random Structures and Algorithms, 9, 223-252.
32. Resnick, M. D., Bearman, P. S., Blum, R. W., Bauman, K. E., Harris, K. M., Jones, J., et al. (1997). Protecting adolescents from harm: Findings from the national longitudinal study on adolescent health. Journal of the American Medical Association, 278, 823-832.
33. Riggan,W.B., Creason, J. P.,Nelson,W. C.,Manton, K. G.,Woodbury,M.A., Stallard, E., et al. (1987). U.S. cancer mortality rates and trends, 1950-1979. Washington, DC: U.S. Government Printing Office.
34. Robins, G., Pattison, P.,Kalish,Y.,&Lusher,D. (2007).An introduction to exponential random graph (p*) models for social networks. Social Networks, 29, 173-191.
35. Rue, H., & Held, L. (2005), Gaussian Markov random fields: Theory and applications. London: Chapman & Hall/CRC.
36. Sherman, M., Apanasovich, T. V., & Carroll, R. J. (2006). On estimation in binary autologistic spatial models. J. Statist. Comput. Simu., 76, 167-179.
37. Snijders, T.A. B. (2002).Markov chain MonteCarlo estimation of exponential random graph models. Journal of Social Structure, 3, article 2.
38. Snijders, T. A. B., Pattison, P. E., Robins, G. L., & Handcock, M. S. (2006). New specifications for exponential random graph models. Sociological Methodology, 36, 99-153.
39. Strauss, D., & Ikeda, M. (1990). Pseudo-likelihood estimation for social Network. Journal of the American Statistical Association, 82, 204-212.
40. Tierney, L. (1994).Markov chains for exploring posterior distributions (with discussion). Annals of Statistics, 22, 1701-1762.
41. Torrie, G. M., & Valleau, J. P. (1997). Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling. Journal of Chemical Physics, 23, 187-199.
42. Udry, J. R., & Bearman, P. S. (1998). New methods for new research on adolescent sexual behavior. In R. Jessor (Ed.), New perspectives on adolescent risk behavior (pp. 241-269). Cambridge: Cambridge University Press.
43. van Duijn, M. A. J., Gile, K. J., & Handcock, M. S. (2009). A framework for the comparison of maximum pseudo-likelihood andmaximum likelihood estimation of exponential family random graph models. Social Networks, 31, 52-62
44. Wasserman, S, & Robins, G. (2005). An introduction to random graphs, dependence graphs, and p*. In P. J. Carrington, J. Scott, & S. Wasserman (Eds.), Models and methods in social network analysis (pp. 148-191). Cambridge: Cambridge University Press.
45. Wei, G.,&Tanner, M. (1990).AMonteCarlo implementation of theEMalgorithm and the poor man's data augmentation algorithm. Journal of the American Statistical Association, 85, 699-704.
46. Wu, H., & Huffer, F. W. (1997). Modeling the distribution of plant species using the autologistic regression model. Ecological Statistics, 4, 49-64.