Alternating subspace-spanning resampling to accelerate Markov chain Monte Carlo simulation

Journal of the American Statistical Association

Volumn 98, Issue 461, 2003, Pages 110-117

  Liu, Chuanhai ^a  

^a LUCENT TECHNOLOGIES   (United States)

Author keywords

Bayesian computation; Covariance adjustment; Data augmentation algorithm; Gibbs sampler; Partial resampling

Indexed keywords

EID: 0037364874     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214503388619148     Document Type: Article

References (45)

1. Besag, J., and Green, P. J. (1993), "Spatial Statistics and Bayesian Computation" (with discussion), Journal of the Royal Statistical Society, Ser. B, 55, 25-37.
2. Besag, J., Green, P. J., Higdon, D., and Mengerson, K. (1995), "Bayesian Computation and Stochastic Systems" (with discussion), Statistical Science, 10, 3-66.
3. Bishop, Y. M. M., Fienberg, S. E., and Holland, P. W. (1975), Discrete Multivariate Analysis: Theory and Practice. Cambridge, MA: MIT Press.
4. Brooks, S., and Gelman, A. (1998), "General Methods for Monitoring Convergence of Iterative Simulations," Journal of Computational and Graphical Statistics, 7, 434-455.
5. Chen, M. H., and Liu, C. (1999), Comments on "Simulated Sintering: Markov Chain Monte Carlo With Spaces of Varying Dimensions" by J. S. Liu and C. Sabatti, in Bayesian Statistics 6, J. M. Bernardo, J. O. Berger, A. P. David, and A. F. Smith (Eds.), Oxford University Press, 402-405.
6. Chen, M. H., Shao, Q. M., and Ibrahim, J. G. (2000), Monte Carlo Methods in Bayesian Computation, New York: Springer-Verlag.
7. Cochran, W. G. (1957), "Analysis of Covariance: Its Nature and Uses," Biometrics, 13, 261-281.
8. _ (1980), "Fisher and the Analysis of Variance," in R. A. Fisher: An Appreciation, eds. S. E. Fienberg and D. V. Hinkley, New York: Springer-Verlag, pp. 17-34.
9. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977), "Maximum Likelihood From Incomplete Data via the EM Algorithm (with discussion), Journal of the Royal Statistical Society, Ser. B, 39, 1-38.
10. Fisher, R. A. (1932), Statistical Methods for Research Workers (4th ed.), Edinburgh: Oliver and Boyd.
11. _ (1958), Statistical Methods for Research Workers (13th ed. rev.), New York: Hafner.
12. Gelfand, A. E., Sahu, S. K., and Carlin, B. P. (1995), "Efficient Parameterization for Normal Linear Mixed Models," Biometrika, 82, 479-488.
13. Gelfand, A. E., and Smith, A. F. M. (1990), "Sampling-Based Approaches to Calculating Marginal Densities," Journal of the American Statistical Association, 85, 398-409.
14. Gelman, A., and Rubin, D. B. (1992), "Inference From Iterative Simulation Using Multiple Sequences," Statistical Science, 7, 457-511.
15. Gilks, W. R., Clayton, D. G., Spiegelhalter, D. J., Best, N. G., McNeil, A. J., Sharples, L. D., and Kirby, A. J. (1993), "Modelling Complexity: Applications of the Gibbs Sampling in Medicine" (with discussion), Journal of the Royal Statistical Society, Ser. B, 55, 39-52.
16. Goodman, J., and Sokal, A. (1989), "Multigrid Monte Carlo Method: Conceptual Foundations," Physical Review D, 40, 2035-2071.
17. Green, P. J. (1995), "Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination," Biometrika, 82, 711-732.
18. _ (1997), Comment on "The EM algorithm - An Old Folk Song Sung to a Fast New Tune," by X. L. Meng and D. A. van Dyk, Journal of the Royal Statistical Society, Ser. B, 59, 554-555.
19. Hamada, M., and Wu, C. F. J. (1995), "Analysis of Censored Data From Fractionated Experiment: A Bayesian Approach," Journal of the American Statistical Association, 90, 467-477.
20. Higdon, D. M. (1998), "Auxiliary Variable Methods for Markov Chain Monte Carlo With Applications," Journal of the American Statistical Association, 93, 585-595.
21. Liu, C. (1998), "Covariance Adjustment for Markov Chain Monte Carlo - A General Framework and the Covariance-Adjusted Data Augmentation Algorithm," technical report. Bell Labs, Lucent Technologies.
22. _ (2001), "Bayesian Analysis of Multivariate Probit Models - Comments on "The Art of Data Augmentation" by Van Dyk and Meng," Journal of Computational and Graphical Statistics, 10, 75-81.
23. _ (2003), "An Example of Algorithm Mining: Covariance Adjustment to Accelerate EM and Gibbs," in Development of Modern Statistics - On the Occasion of Professor Yiao-Ting Zhang's 70th Birthday, eds. J. Huang and H. Zhang, to appear.
24. Liu, C., and Protassov, R. S. (2001), "Bayesian Estimation of the Multivariate Ordinal Probit Regression Model," Qualifying paper, Harvard University, Dept. of Statistics.
25. Liu, C., and Rubin, D. B. (1994), "The ECME Algorithm: A Simple Extension of EM and ECM with faster monotone convergence," Biometrika, 81, 633-648.
26. _ (1996), "Markov-Normal Analysis of Iterative Simulations Before Their Convergence," Journal of Econometrics, 75, 69-78.
27. _ (2002), "Model-Based Analysis to Improve the Performance of Iterative Simulations," Statistica Sinica, 12, 751-767.
28. Liu, C., Rubin, D. B., and Wu, Y. N. (1998), "Parameter Expansion to Accelerate EM: The PX-EM Algorithm," Biometrika, 85, 755-770.
29. Liu, C., and Sun, D. X. (2000), "Analysis of Interval-Censored Data From Fractionated Experiments Using Covariance Adjustments," Technometrics, 42, 353-365.
30. Liu, J., (1994), "The Collapsed Gibbs Sampler in Bayesian Computations With Applications to a Gene Regulation Problem," Journal of the American Statistical Association, 89, 958-966.
31. Liu, J., and Sabatti, C. (1998), "Generalised Multigrid Monte Carlo for Bayesian Computation," technical report, Standford University.
32. _ (2000), "Generalised Gibbs Sampler and Multigrid Monte Carlo for Bayesian Computation," Biometrika, 87, 353-369.
33. Liu, J., Wong, W. H., and Kong, A. (1994), "Covariance Structure of the Gibbs Sampler with Applications," Biometrika, 81, 27-40.
34. Liu, J. S., and Wu, Y. (1999), "Parameter Expansion Scheme for Data Augmentation," Journal of the American Statistical Association, 94, 1264-1274.
35. Meng, X. L., and Rubin, D. B. (1993), "Maximum Likelihood Estimation via the ECM Algorithm: A General Framework," Biometrika, 80, 267-278.
36. Meng, X. L., and van Dyk, D. (1999), "Seeking Efficient Data Augmentation Schemes via Conditional and Marginal Augmentation," Biometrika, 86, 301-320.
37. Mira, A., and Tierney, L. (1998), "On the Use of Auxiliary Variables in Markov Chain Monte Carlo Sampling," Technical report, University of Pavia and University of Minnesota.
38. Phadke, M. S. (1986), "Design Optimization Case Studies," AT&T Technical Journal, 65, 51-68.
39. Roberts, G. O., and Sahu, S. K. (1997), "Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler," Journal of the Royal Statistical Society, Ser. B, 59, 291-317.
40. Smith, A. F. M., and Roberts, G. O. (1993), "Bayesian Computation via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods" (with discussion), Journal of the Royal Statistical Society, Ser. B, 55, 3-23.
41. Taguchi, G. (1987), System of Experimental Design, White Plains, NY: Unipub/Kraus International.
42. Tanner, M. A., and Wong, W. H. (1987), "The Calculation of Posterior Distributions by Data Augmentation" (with discussion), Journal of the American Statistical Association, 82, 528-550.
43. Tierney, L. (1994), "Markov Chains for Exploring Posterior Distributions" (with discussion), The Annals of Statistics, 21, 1701-1762.
44. van Dyk, D. A., and Meng, X.-L. (2001), "The Art of Data Augmentation" (with discussion), Journal of Computational and Graphical Statistics, 10, 1-111.
45. Wu, C. F. J., and Hamada, M. S. (2000), Experiments: Planning, Analysis, and Parameter Design Optimization, New York: Wiley.