Continuous contour Monte Carlo for marginal density estimation with an application to a spatial statistical model

Journal of Computational and Graphical Statistics

Volumn 16, Issue 3, 2007, Pages 608-632

  Liang, Faming ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Autologistic models; Kernel density estimation; Reversible jump Markov chain monte carlo; Stochastic approximation; Wang Landau algorithm

Indexed keywords

EID: 35348968551     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186007X238459     Document Type: Article

References (67)

1. Augustin, N., Mugglestone, M., and Buckland, S. (1996), "An Autologistic Model for Spatial Distribution of Wildlife," Journal of Applied Ecology, 33, 339-347.
2. Berger, J.O., Liseo, B., and Wolpert, R.L. (1999), "Integrated Likelihood Methods for Estimating Nuisance Parameters," Statistical Science, 14, 1-28.
3. Besag, J.E. (1974), "Spatial Interaction and the Statistical Analysis of Lattice Systems" (with discussion), Journal of the Royal Statistical Society, Series B, 36, 192-236.
4. Besag, J., York, J., and Mollié (1991), "Bayesian Image Restoration with Two Applications in Spatial Statistics," Annals of the Institute of Statistical Mathematics, 43, 1-59.
5. Blum, J.R. (1954), "Multidimensional Stochastic Approximation Method," Annals of Mathematical Statistics, 25, 737-744.
6. Chen, M.-H. (1994), "Importance-Weighted Marginal Bayesian Posterior Density Estimation," Journal of the American Statistical Association, 89, 818-824.
7. Chen, M.-H., and Shao, Q.-M. (1997a), "On Monte Carlo Methods for Estimating Ratios of Normalizing Constants," The Annals of Statistics, 25, 1563-1594.
8. (1997b), "Estimating Ratios of Normalizing Constants for Densities with Different Dimensions," Statistica Sinica, 7, 607-630.
9. Chib, S. (1995), "Marginal Likelihood from the Gibbs Output," Journal of the American Statistical Association, 90, 1313-1321.
10. Chib, S., and Jeliazkov, I. (2001), "Marginal Likelihood from the Metropolis-Hastings Output," Journal of the American Statistical Association, 96, 270-281.
11. Dempster, A.P., Laird, N., and Rubin, D.B. (1977), "Maximum Likelihood from Incomplete Data via the EM Algorithm," Journal of the Royal Statistical Society, Series B, 39, 1-38.
12. Efron, B., and Tibshirani, R.J. (1993), An Introduction to the Bootstrap, London: Chapman and Hall.
13. Fan, J., and Marron, J.S. (1994), "Fast Implementations of Nonparametric Curve Estimators," Journal of Computational and Graphical Statistics, 3, 35-56.
14. Gelfand, A.E., Smith, A.F.M., and Lee, T.M. (1992), "Bayesian Analysis of Constrained Parameter and Truncated Data Problems using Gibbs Sampling," Journal of the American Statistical Association, 85, 398-409.
15. Gelman, A., and Meng, X.L. (1998), "Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling," Statistical Science, 13, 163-185.
16. Geman, S., and Geman, D. (1984), "Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
17. Geyer, C.J. (1991), "Markov Chain Monte Carlo Maximum Likelihood," in Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, ed. E.M. Keramigas, Fairfax, VA: Interface Foundation, pp. 156-163.
18. (1994), "Estimating Normalizing Constants and Reweighting Mixtures in Markov Chain Monte Carlo," Revision of Technical Report No. 568, School of Statistics, University of Minnesota.
19. Geyer, C.J., and Thompson, E.A. (1992), "Constrained Monte Carlo Maximum Likelihood for Dependent Data," Journal of the Royal Statistical Society, Series B, 54, 657-699.
20. Ghosh, B.K., and Huang, W. (1992), "Optimum Bandwidths and Kernels for Estimating Certain Discontinuous Densities," Annals of the Institute of Statistical Mathematics, 44, 563-577.
21. Green, P.J. (1995), "Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination," Biometrika, 82, 711-732.
22. Green, P.J., and Richardson, S. (2002), "Hidden Markov Models and Disease Mapping," Journal of the American Statistical Association, 97, 1055-1070.
23. Gu, C. (1993), "Smoothing Spline Density Estimation: A Dimensionless Automatic Algorithm," Journal of the American Statistical Association, 88, 495-504.
24. Gu, C., and Qiu, C. (1993), "Smoothing Spline Density Estimation: Theory," Annals of Statistics, 21, 217-234.
25. Gu, M.G., and Zhu, H. (2001), "Maximum Likelihood Estimation for Spatial Models by Markov Chain Monte Carlo Stochastic Approximation," Journal of the Royal Statistical Society, Series B, 63, 339-355.
26. Hall, P., Lahiri, S.N., and Truong, Y.K. (1995), "On Bandwidth Choice for Density Estimation with Dependent Data," Annals of Statistics, 23, 2241-2263.
27. Hastings, W.K. (1970), "Monte Carlo Sampling Methods Using Markov Chains and their Applications," Biometrika, 57, 97-109.
28. Hart, J.D., and Vieu, P. (1990), "Data-Driven Bandwidth Choice for Density Estimation Based on Dependent Data," Annals of Statistics, 18, 873-890.
29. Heikkinen, J., and Högmander, H. (1994), "Fully Bayesian Approach to Image Restoration with an Application in Biogeography," Applied Statistics, 43, 569-582.
30. Hesselbo, B., and Stinchcomble, R.B. (1995), "Monte Carlo Simulation and Global Optimization Without Parameters," Physical Review Letters, 74, 2151-2155.
31. Huang, F., and Ogata, Y. (1997), "Comparison of Two Methods for Calculating the Partition Functions of Various Spatial Statistical Models," Research Memorandum, 643, Tokyo: The Institute of Statistical mathematics.
32. (1999), "Improvements of the Maximum Pseudo-Likelihood Estimators in Various Spatial Statistical Models," Journal of Computational and Graphical Statistics, 8, 510-530.
33. Ishwaran, H., James, L.F., and Sun, J. (2001), "Bayesian Model Selection in Finite Mixtures by Marginal Density Decompositions," Journal of the American Statistical Association, 96, 1316-1332.
34. Jones, M.C. (1993), "Simple Boundary Correction for Kernel Density Estimation," Statistics and Computing, 3, 135-146.
35. Kooperberg, C. (1998), "Bivariate Density Estimation With an Application to Survival Analysis," Journal of Computational and Graphical Statistics, 7, 322-341.
36. Kooperberg, C., and Stone, C.J. (1991), "A Study of Logspline Density Estimation," Computational Statistics and Data Analysis, 12, 327-348.
37. Liang, F. (2005), "Generalized Wang-Landau Algorithm for Monte Carlo Computation," Journal of the American Statistical Association, 100, 1311-1327.
38. (2006), "A Theory on Flat Histogram Monte Carlo Algorithms," Journal of Statistics Physics, 122, 511-529.
39. Liang, F., and Wong, W. H. (2001), "Real Parameter Evolutionary Monte Carlo with Applications in Bayesian Mixture Models," Journal of the American Statistical Association, 96, 653-666.
40. Loader, C. (1999), Local Regression and Likelihood, New York: Springer.
41. Loftsgaarden, P.O., and Quesenberry, C.P. (1965), "A Nonparametric Estimate of a Multivariate Probability Density Function," Annals of Mathematical Statistics, 28, 1049-1051.
42. Meng, X.L. and Wong, W.H. (1996) Simulating ratios of normalizing constants via a simple identity: A theoretical exploration. Statistica Sinica, 6, 831-860.
43. Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.M., and Teller, E. (1953), "Equation of State Calculations by Fast Computing Machines," Journal of Chemical Physics, 21, 1087-1091.
44. Møller, J., Pettitt, A.N., Reeves, R., and Berthelsen, K.K. (2006), "An Efficient Markov Chain Monte Carlo Method for Distributions with Intractable Normalising Constants," Biometrika, 93, 451-458.
45. Müller, P. (1991), "A Generic Approach to Posterior Integration and Gibbs Sampling," Technical report, Purdue University, West Lafayette, Indiana.
46. Müller, H.G., and Stadtmüller, U. (1999), "Multivariate Boundary Kernels and a Continuous Least Squares Principle," Journal of the Royal Statistical Society, Series B, 61, 439-458.
47. Neal, R.M. (2003), "Slice Sampling" (with discussion), The Annals of Statistics, 31, 705-767.
48. Nevelson, M.B., and Hasminskii, R.Z. (1973), Stochastic Approximation and Recursive Estimation, American Mathematical Society.
49. Pettitt, A.N., Friel, N., and Reeves, R. (2003), "Efficient Calculation of the Normalizing Constant of the Autologistic and Related Models on the Cylinder and Lattice," Journal of the Royal Statistical Society, Series B, 42, 510-514.
50. Preisler, H.K. (1993), "Modeling Spatial Patterns of Trees Attacked by Bark-Beetles," Applied Statistics, 42, 501-514.
51. Reeves, R., and Pettitt, A.N. (2004), "Efficient Recursions for General Factorisable Models," Biometrika, 91, 751-757.
52. Riggan, W.B., Creason, J.P., Nelson, W.C., Manton, K.G., Woodbury, M.A., Stallard, E., Pellom, A.C., and Beaubier, J. (1987), U.S. Cancer Mortality Rates and Trends, 1950-1979. (Vol. IV: Maps), U.S. Environmental Protection Agency, Washington, D.C.: U.S. Government Printing Office.
53. Ripley, B.D. (1981), Spatial Statistics, New York: Wiley.
54. Rydén, T., and Titterington, D.M. (1998), "Computational Bayesian Analysis of Hidden Markov Models," Journal of Computational and Graphical Statistics, 7, 194-211.
55. Robbins, H., and Monro, S. (1951), "A Stochastic Approximation Method," Annals of Mathematical Statistics, 22, 400-407.
56. Robert, C.P., and Casella, G. (2004), Monte Carlo Statistical Methods (2nd ed), New York: Springer.
57. Scott, D.W. (1992) Multivariate Density Estimation: Theory, Practice, and Visualization, New York: Wiley.
58. Sherman, M., Apanasovich, T.V., and Carroll, R.J. (2006), "On Estimation in Binary Autologistic Spatial Models," Journal of Statistical Computation and Simulation, 76, 167-179.
59. Terrell, G.R., and Scott, D.W. (1992), "Variable Kernel Density Estimation," Annals of Statistics, 20, 1236-1265.
60. Venables, W.N., and Ripley, B.D. (1999), Modern Applied Statistics with S-PLUS (3rd ed.), New York: Springer.
61. Verdinelli, I., and Wasserman, L. (1995), "Computing Bayes Factors using a Generalization of the Savage-Dickey Density Ratio," Journal of the American Statistical Association, 90, 614-618.
62. Wand, M.P. (1994), "Fast Computation of Multivariate Kernel Estimators," Journal of Computational and Graphical Statistics, 3, 433-445.
63. Wand, M.P., and Jones, M.C. (1995), Kernel Smoothing, London: Chapman and Hall.
64. Wang, F., and Landau, D.P. (2001), "Efficient, Multiple-Range Random Walk Algorithm to Calculate the Density of States," Physical Review Letters, 86, 2050-2053.
65. Wei, G.C.G., and Tanner, M.A. (1990), "A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms," Journal of the American Statistical Association, 85, 699-704.
66. Wu, H., and Huffer, F.W. (1997), "Modeling the Distribution of Plant Species using the Autologistic Regression Model," Ecological Statistics, 4, 49-64.
67. Yu, B. (1993), "Density Estimation in the L∞ Norm for Dependent Data, with Applications to the Gibbs Sampler," Annals of Statistics, 21, 711-735.