Model-based analysis to improve the performance of iterative simulations

Statistica Sinica

Volumn 12, Issue 3, 2002, Pages 751-767

  Liu, Chuanhai ^a   Rubin, Donald B ^a  

^a LUCENT TECHNOLOGIES   (United States)

Author keywords

Bayesian methods; Markov chain Monte Carlo; Maximum likelihood estimation; Multiple imputation; The CA DA algorithm; The DA algorithm; The EM algorithm; The Gibbs sampler; The PX EM algorithm

Indexed keywords

EID: 0036660835     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (34)

1. Besag, J. and Green, P.J. (1993). Spatial statistics and Bayesian computation (with discussion). J. Roy. Statist. Soc. Ser. B 55, 25-37.
2. Bishop, Y.M.M., Fienberg, S.E. and Holland, P.W. (1975). Discrete Multivariate Analysis: Theory and Practice. The MIT Press.
3. Carlin, B.P. and Louis, T.A. (2000). Bayes and Empirical Bayes Methods for Data Analysis, 2nd Edition. Chapman and Hall, New York.
4. Dempster, A.P., Laird, N.M. and Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39, 1-38.
5. Efron, B. and R. Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy (with discussion). Statist. Sci. 1, 54-96.
6. Erkanli, A., Mazzuchi, T.A. and Soyer, R. (1998). Bayesian computations for a class of reliability growth models. Technometrics 40, 14-23.
7. Gelfand, A.E. and Smith, A.F.M. (1990). Sampling based approaches to calculating marginal densities. J. Amer. Statist. Assoc. 85, 398-409.
8. Gelman, A., Carlin, J.B., Stern, H.S. and Rubin, D.B. (1995). Bayesian Data Analysis. Chapman and Hall, New York.
9. Gelman, A. and Rubin, D.B. (1992). Inference from iterative simulation using multiple sequences. Statist. Sci. 7, 457-511.
10. Goodman J. and Sokal, A.D. (1988). Multigrid Monte Carlo methods: Conceptual foundations. Phys. Rev. D 40, 2035-2071.
11. Hamada, M. and Wu, C.F.J. (1995). Analysis of censored data from fractionated experiment: a Bayesian approach. J. Amer. Statist. Assoc. 90, 467-477.
12. Hastings, W.K. (1970). Monte Carlo sampling methods Using Markov chains and their applications. Biometrika 57, 97-109.
13. Liu, C. (2001). Covariance adjustment for Markov chain Monte Carlo sampling - a general framework and the covariance-adjusted data augmentation algorithm. Under revison for J. Amer. Statist. Assoc.
14. Liu, C. and Rubin, D.B. (1994). The ECME algorithm: An simple extension of EM and ECM with faster monotone convergence. Biometrika 81, 633-48.
15. Liu, C. and Rubin, D.B. (1996). Markov-normal analysis of iterative simulations before their convergence. J. Econometrics 75, 69-78.
16. Liu, C., Rubin, D.B. and Wu, Y. (1998). Parameter expansion for EM acceleration - the PX-EM algorithm. Biometrika, 85, 755-770.
17. Liu, C. and Sun, D.X. (2000). Analysis of interval censored data from fractionated experiments using covariance adjustments. Technometrics 42, 353-365.
18. Liu, J.S. (1994). The collapsed Gibbs sampler in Bayesian computations with applications to a gene regulation problem. J. Amer. Statist. Assoc. 89, 958-966.
19. Liu, J.S., Wong, W.H. and Kong, A. (1994). Covariance structure of the Gibbs sampler with applications. Biometrika 81, 27-40.
20. Liu, J.S. and Wu, Y. (1999). Parameter expansion scheme for data augmentation. J. Amer. Statist. Assoc. 94, 1264-1274.
21. Meng, X.L. and van Dyk, D. (1999). Seeking efficient data augmentation schemes via conditional and marginal augmentation. Biometrika 86, 301-320.
22. Meng, X.L. and Rubin, D.B. (1993). Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika 80, 267-78.
23. Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N. and Teller, A.H. (1953). Equations of state calculations by fast computing machines. J. Chemical Physica 21, 1087-1091.
24. Metropolis, N., and Ulam, S. (1949). The Monte Carlo methods. J. Amer. Statist. Assoc. 44, 335-341.
25. Phadke, M.S. (1986). Design optimization case studies. AT&T Tech. J. 65, 51-68.
26. Roberts, G.O. and Sahu, S.K. (1997). Updating schemes, correlation structure, blocking and parameterization for the Gibbs sampler. J. Roy. Statist. Soc. Ser. B 59, 291-317.
27. Rubin, D.B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. Ann. Statist. 12, 1151-1172.
28. Rubin, D.B. (1987a). A noniterative sampling-importance resampling alternative to the data augmentation algorithm for creating a few imputations when fractions of missing information are modest: The SIR algorithm. Comment on "The calculation of posterior distributions by data augmentation" by M.A. Tanner and W.H. Wong. J. Amer. Statist. Assoc. 82, 543-546.
29. Rubin, D.B. (1987b). Multiple Imputation for Nonresponse in Surveys. Wiley, New York.
30. Swendsen, R.H. and Wang, J.S. (1987). Nonuniversal critical dynamics in Monte Carlo simulations. Phys. Rev. Lett. 58, 86-88.
31. Tanner, M.A. and Wong, W.H. (1987). The calculation of posterior distributions by data augmentation (with discussion). J. Amer. Statist. Assoc. 82, 528-550.
32. Tierney, L. (1994). Markov chains for exploring posterior distributions (with discussion). Ann. Statist. 22, 1701-1762.
33. Tukey, J.W. (1993). Major challenges for multiple-response (and multiple-adjustment) analysis. In Multivariate Analysis: Future Directions (Edited by C.R. Rao), 401-421. North-Holland, New York.
34. Wei, G.C.G. and Tanner, M.A. (1990). A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithm. J. Amer. Statist. Assoc. 85, 699-704.