Toward black-box sampling: A random-direction interior-point markov chain approach

Journal of Computational and Graphical Statistics

Volumn 7, Issue 1, 1998, Pages 1-22

  Chen, Ming Hui ^a   Schmeiser, Bruce ^b  

^a Worcester Polytechnic Institute   (United States)

^b SCHOOL OF INDUSTRIAL ENGINEERING   (United States)

Author keywords

Bayesian computation; Gibbs sampler; Hit and Run; Metropolis Hastings algorithm; Monte Carlo; Multidimensional integrals; Posterior distributions; Prior distributions; Simulation

Indexed keywords

EID: 0032221061     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.1998.10474758     Document Type: Article

References (36)

1. Albert, J.H., and Chib, S. (1993), “Bayesian Analysis of Binary and Polychotomous Response Data,” Journal of the American Statistical Association, 88, 669-679.
2. Bélisle, C.J.P., Romeijn, H.E., and Smith, R.L. (1993), “Hit-and-Run Algorithms for Generating Multivariate Distributions,” Mathematics of Operations Research, 18, 2, 255-266.
3. Berger, J.O. (1993), “The Present and Future of Bayesian Multivariate Analysis,” in Multivariate Analysis: Future Directions, ed. C.R. Rao, Amsterdam: North-Holland, pp. 25-53.
4. Berger, J.O., and Chen M.-H. (1993), “Determining Retirement Patterns: Prediction for a Multinomial Distribution with Constrained Parameter Space,” The Statistician, 42, 427-443.
5. Chen, M.-H. (1994), “Importance Weighted Marginal Bayesian Posterior Density Estimation,” Journal of the American Statistical Association, 89, 818-824.
6. Chen, M.-H., Nandram, B, and Ross, E.W. (1996), “A Gibbs Sampling Approach for Predicting Shelf-Life of a Military Ration with Sensory Data,” Journal of Agricultural, Biological and Environmental Statistics, 1, 377-392.
7. Chen, M.-H., and Schmeiser, B.W. (1993), “Performance of the Gibbs, Hit-and-Run, and Metropolis Samplers,” Journal of Computational and Graphical Statistics, 2, 251-272.
8. Chen, M.-H., and Schmeiser, B.W (1994), “Random-Direction Interior-Point Markov Chains: A Family of Black-Box Samplers,” in Proceedings of the Section on Bayesian Statistical Science, Alexandria, VA: American Statistical Association, pp. 1-6.
9. Chen, M.-H., and Schmeiser, B.W (1996), “General Hit-and-Run Monte Carlo Sampling for Evaluating Multidimensional Integrals,” Operations Research Letters, 19, 161-169.
10. Cowles, M.K. (1996), “Accelerating Monte Carlo Markov Chain Convergence for Cumulative-link Generalized Linear Models,” Statistics and Computing, 6, 101-111.
11. Cowles, M.K., and Carlin, B.P. (1996), “Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review,” Journal of the American Statistical Association, 91, 883-904.
12. Gelfand, A. E., and Smith, A.F.M. (1990), “Sampling Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398-409.
13. Gelfand, A.E., Smith, A.F.M., and Lee, T.M. (1992), “Bayesian Analysis of Constrained Parameter and Truncated Data Problems Using Gibbs Sampling,” Journal of American Statistical Association, 87, 523-532.
14. Gelman A., and Rubin, D.B. (1992), “Inference from Iterative Simulation Using Multiple Sequences,” Statistical Science, 7, 457-511.
15. Geman, S., and Geman, D. (1984), “Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
16. Geweke, J. (1989), “Bayesian Inference in Econometrics Models Using Monte Carlo Integration,” Economet-rica, 57, 1317-1340.
17. Geyer, C.J. (1992), “Practical Markov Chain Monte Carlo,” Statistical Science, 7, 473-511.
18. Gilks, W.R. (1992), “Derivative-Free Adaptive Rejection Sampling for Gibbs Sampling,” in Bayesian Statistics 4, eds. J.M. Bernardo, J.O. Berger, D.V. Lindley, and A.F.M. Smith, London: Oxford University Press, pp. 641-665.
19. Gilks, W.R., Thomas, A., and Spiegelhalter, D.J. (1994), “A Language and Program for Complex Bayesian Modeling,” The Statistician, 43, 169-177.
20. Goel, P.K. (1988), “Software for Bayesian Analysis: Current Status and Additional Needs,” in Bayesian Statistics 3, eds. J.M. Bernardo, M.H.DeGroot, D.V.Lindley, and A.F.M. Smith, London: Oxford University Press, pp. 173-188.
21. Hastings, W.K. (1970), “Monte Carlo Sampling Methods Using Markov Chains and Their Applications,” Biometrika, 57, 97-109.
22. JRSSB (1993), Discussion on the Meeting on the Gibbs Sampling and Other Markov Chain Monte Carlo Methods, Journal of the Royal Statistical Society, Ser. B, 55, 53-102.
23. Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., and Teller, E. (1953), “Equations of State Calculations by Fast Computing Machines,” Journal of Chemical Physics, 21, 1087-1092.
24. Müller, P. (1991), “A Generic Approach to Posterior Integration and Gibbs Sampling,” Technical Report #91-09, Purdue University, Dept, of Statistics.
25. Nandram, B., and Chen, M.-H. (1996), “Reparameterizing the Generalized Linear Model to Accelerate Gibbs Sampler Convergence,” Journal of Statistical Computation and Simulation, 54, 129-144.
26. Pedrosa, A.M.C., and Schmeiser, B.W. (1994), “Estimating Variance of the Sample Mean: Optimal Batch Size Estimation and 1-2-1 Overlapping Batch Means,” Technical Report SMS94-3, Purdue University, School of Industrial Engineering.
27. Ritter, C, and Tanner, M.A. (1992), “Facilitating the Gibbs Sampler: The Gibbs Stopper and the Griddy-Gibbs Sampler,” Journal of the American Statistical Association, 87, 861-868.
28. Schmeiser, B.W., Avramidis, T.N., and Hashem, S. (1990), “Overlapping Batch Statistics,” in Proceedings of the 1990 Winter Simulation Conference, pp. 395-398.
29. Schmeiser, B.W., and Chen, M.-H. (1991), “On Hit-and-Run Monte Carlo Sampling for Evaluating Multidimensional Integrals,” revision of Technical Report 91-39, Dept, of Statistics, Purdue University.
30. Smith, R. L. (1984), “Efficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions,” Operations Research, 32, 1297-1308.
31. Spiegelhalter, D.J., Thomas, A., and Best, N.G. (1996), “Computation on Bayesian Graphical Models,” in Bayesian Statistics 5, eds. J.M. Bemado, J.O. Berger, A.P. Dawid, and A.F.M. Smith, London: Oxford University Press, pp. 407-426.
32. Tanner, M.A. (1996), Tools for Statistical Inference, (3rd ed.), New York: Springer Verlag.
33. Tanner, M.A., and Wong, W. H. (1987), “The Calculation of Posterior Distributions by Data Augmentation,” Journal of the American Statistical Association, 82, 528-550.
34. Thomas, A., Spiegelhalter, D.J., and Gilks, W.R. (1992), “BUGS: A Program to Perform Bayesian Inference Using Gibbs Sampling,” in Bayesian Statistics 4, eds. J.M. Bernardo, J.O. Berger, D.V. Lindley, and A.F.M. Smith, London: Oxford University Press, pp. 837-842.
35. Tierney, L. (1994), “Markov Chains for Exploring Posterior Distributions” (with discussion), The Annals of Statistics, 22, 1701-1762.
36. Wolpert, R.L. (1991), “Monte Carlo Importance Sampling in Bayesian Statistics,” in Statistical Multiple Integration, eds. N. Flournoy and R. Tsutakawa, Contemporary Mathematics, 116, 101-115.