Simulating ratios of normalizing constants via a simple identity: A theoretical exploration

Statistica Sinica

Volumn 6, Issue 4, 1996, Pages 831-860

  Meng, Xiao Li ^a   Wong, Wing Hung ^a  

^a NONE

Author keywords

Bayes factor; Bridge sampling; Free energy difference; Hellinger distance; Importance sampling; Iterative simulation; Likelihood ratio; Markov chain Monte Carlo; Posterior odds

Indexed keywords

EID: 21444451325     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (29)

1. Bennett, C. H. (1976). Efficient estimation of free energy differences from Monte Carlo data. J. Comput. Phys. 22, 245-268.
2. Besag, J. and Green, P. J. (1993). Spatial statistics and Bayesian computation (with discussion). J. Roy. Statist. Soc. Ser.B 55, 25-37.
3. Bock, R. D. and Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika 46, 443-459.
4. Chen, M.-H. and Shao, Q. M. (1994). On Monte Carlo methods for estimating ratios of normalizing constants. Research Report 627, Department of Mathematics, National University of Singapore.
5. DiCiccio, T. J., Kass, R. E., Raftery, A. and Wasserman, L. (1996). Computing Bayes factors by combining simulation and asymptotic approximations. J. Amer. Statist. Assoc., to appear.
6. Gelfand, A. E. and Dey, D. K. (1994). Bayesian model choice: asymptotics and exact calculations. J. Roy. Statist. Soc. Ser.B 56, 501-514.
7. Gelfand, A. E. and Smith, A. F. M. (1990). Sampling based approaches to calculating marginal densities. J. Amer. Statist. Assoc. 85, 398-409.
8. Gelman, A. and Meng, X. L. (1994). Path sampling for computing normalizing constants: identities and theory. Technical Report 376, Department of Statistics, University of Chicago.
9. Gelman, A. and Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences (with discussion). Statist. Sci. 7, 457-511.
10. Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images. IEEE Trans. on Pattern Analysis and Machine Intelligence 6, 721-741.
11. Geyer, C. J. (1994). Estimating normalizing constants and reweighting mixtures in Markov chain Monte Carlo. Technical Report 568, School of Statistics, University of Minnesota.
12. Geyer, C. J. and Thompson, E. A. (1992). Constrained Monte Carlo maximum likelihood for dependent data (with discussion). J. Roy. Statist. Soc. Ser.B 54, 657-699.
13. Green, P. J. (1992). Discussion of "Constrained Monte Carlo maximum likelihood for dependent data" by Geyer and Thompson J. Roy. Statist. Soc. Ser.B 54, 683-684.
14. Irwin, M., Cox, N. and Kong, A. (1994). Sequential imputation for Multilocus linkage analysis. Proc. Nat. Acad. Sci. U.S.A. 91, 11684-11688.
15. Kass, R. E. and Raftery, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90, 773-795.
16. Meng, X. L. (1994). Multiple imputation inference under uncongenial sources of input (with discussion). Statist. Science 9, 538-573.
17. Meng, X. L. and Schilling, S. (1996). Fitting full-information factor models and an empirical investigation of bridge sampling. J. Amer. Statist. Assoc. to appear.
18. Meng, X. L. and Schilling, S. (1996a). Bridge sampling after transformation. Technical Report 432, Department of Statistics, University of Chicago.
19. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. and Teller, E. (1953). Equation of state calculations by fast computing machines. J. Chem. Phys. 21, 1087-1092.
20. Newton, M. A. and Raftery, A. E. (1994). Approximate Bayesian inference with the weighted likelihood bootstrap (with discussion). J. Roy. Statist. Soc. Ser.B 56, 3-48.
21. Ogata, Y. (1989). A Monte Carlo method for high dimensional integration. Numer. Math. 55, 137-157.
22. Ogata, Y. (1990). A Monte Carlo method for an objective Bayesian procedure. Ann. Inst. Statist. Math. 42, 403-433.
23. Ott, J. (1979). Maximum likelihood estimation by counting methods under polygenic and mixed models in human pedigrees. Amer. J. Hum. Genet 31, 161-175.
24. Smith, A. F. M. and Roberts, G. O. (1993). Bayesian computation via the Gibbs Sampler and related Markov chain Monte Carlo methods (with discussion). J. Roy. Statist. Soc. Ser.B 55, 3-23.
25. Tanner, M. A. and Wong, W. H. (1987). The calculation of posterior distributions by data augmentation (with discussion). J. Amer. Statist. Assoc. 82, 528-550.
26. Torrie, G. M. and Valleau, J. P. (1977). Nonphysical sampling distributions in Monte Carlo free-energy estimation: umbrella sampling. J. Comput. Phys. 23, 187-199.
27. Voter, A. F. (1985). A Monte Carlo method for determining free-energy differences and transition state theory rate constants. J. Chem. Phys. 82, 1890-1899.
28. Wei, G. C. G. and Tanner, M. A. (1990). A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms. J. Amer. Statist. Assoc. 85, 699-704.
29. Wu, C. F. J (1983). On the convergence properties of the EM algorithm. Ann. Statist. 11, 95-103.