Bayesian density estimation and inference using mixtures

Journal of the American Statistical Association

Volumn 90, Issue 430, 1995, Pages 577-588

  Escobar, Michael D ^a   West, Mike ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b DUKE UNIVERSITY   (United States)

Author keywords

Kernel estimation; Mixtures of Dirichlet processes; Multimodality; Normal mixtures; Posterior sampling; Smoothing parameter estimation

Indexed keywords

EID: 84950937290     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.1995.10476550     Document Type: Article

References (36)

1. Antoniak, C. E. (1974), “Mixtures of Dirichlet Processes With Applications to Nonparametric Problems,” The Annals of Statistics, 2, 1152–1174.
2. Besag, J., and Green, P. J. (1993), “Spatial Statistics and Bayesian Computation,” Journal of the Royal Statistical Society, Ser. B, 55, 25–37.
3. Bush, C., and MacEachern, S. N. (1993), “A Semiparametric Bayesian Model for Randomized Block Designs,” ISDS Discussion Paper #93-A22, Duke University.
4. Escobar, M. D. (1988), “Estimating the Means of Several Normal Populations by Nonparametric Estimation of the Distribution of the Means,” unpublished Ph.D. dissertation, Yale University, Dept. of Statistics.
5. —— (1992), Comment on “Bayesian Analysis of Mixtures: Some Results on Exact Estimability and Identification,” by J.-P. Florens, M. Mouchart, and J.-M. Rolin, in Bayesian Statistics 4, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U.K.: Oxford University Press, pp. 142–144.
6. —— (1994), “Estimating Normal Means With a Dirichlet Process Prior,” Journal of the American Statistical Association, 89, 268–277.
7. —— (in press), “Nonparametric Bayesian Methods in Hierarchical Models,” The Journal of Statistical Inference and Planning.
8. Feller, W. (1971), An Introduction to Probability Theory and Its Applications, Vol. 2 (2nd ed.), New York: John Wiley.
9. Ferguson, T. S. (1973), “A Bayesian Analysis of Some Nonparametric Problems,” The Annals of Statistics, 1, 209–230.
10. —— (1983), “Bayesian Density Estimation by Mixtures of Normal Distributions,” in Recent Advances in Statistics, eds. H. Rizvi and J. Rustagi, New York: Academic Press, pp. 287–302.
11. Gelfand, A. E., and Smith, A. F. M. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398–409.
12. Hartigan, J. A., and Hartigan, P. M. (1985), “The Dip Test of Unimodality,” The Annals of Statistics, 13, 17–84.
13. Hasting, W. K. (1970), “Monte Carlo Sampling Methods Using Markov Chains and Their Applications,” Biometrika, 57, 97–109.
14. Kuo, L. (1986), “Computations of Mixtures of Dirichlet Processes,” SI AM Journal of Scientific and Statistical Computing, 7, 60–71.
15. Lindsay, B. G. (1983), “The Geometry of Mixture Likelihoods, Part I: A General Theory,” The Annals of Statistics, 11, 86–94.
16. Lo, A. Y. (1984), “On a Class of Bayesian Nonparametric Estimates: 1. Density Estimates,” The Annals of Statistics, 12, 351–357.
17. MacEachern, S. N. (1994), “Estimating Normal Means With a Conjugate-Style Dirichlet Process Prior,” Communication in Statistics: Simulation and Computation, 23, 727–741.
18. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953), “Equations of State Calculations by Fast Computing Machines,” Journal of Chemical Physics, 21, 1087–1091.
19. Meyn, S. P., and Tweedie, R. L. (1993), Markov Chains and Stochastic Stability, New York: Springer-Verlag.
20. Nummelin, E. (1984), General Irreducible Markov Chains and Nonnegative Operators, Cambridge, U.K.: Cambridge University Press.
21. Postman, M., Huchra, J. P., and Geller, M. J. (1986), “Probes of Large-Scale Structure in the Corona Borealis Region,” The Astronomical Journal, 92, 1238–1247.
22. Press, W. H., Teukolsky, S. A., Vettering, W. H., and Flannery, B. P. (1992), Numerical Recipes in Fortran (2nd ed.), Cambridge, U.K.: Cambridge University Press.
23. Ritter, C., and Tanner, M. A. (1991), “Facilitating the Gibbs Sampler: The Gibbs Stopper and the Griddy–Gibbs Sampler,” Journal of the American Statistical Association, 87, 861–868.
24. Roeder, K. (1990), “Density Estimation With Confidence Sets Emplified by Superclusters and Voids in the Galaxies,” Journal of the American Statistical Association, 85, 617–624.
25. Silverman, B. W. (1981), “Using Kernel Density Estimates to Investigate Multimodality,” Journal of the Royal Statistical Society, Ser. B, 43, 9799.
26. —— (1986), Density Estimation for Statistics and Data Analysis, New York: Chapman and Hall.
27. Smith, A. F. M., and Roberts, G. O. (1993), “Bayesian Computation via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods,” Journal of the Royal Statistical Society, Ser. B, 55, 3–23.
28. Tanner, M. A., and Wong, W. H. (1987), “The Calculation of Posterior Distributions by Data Augmentation” (with discussion), Journal of the American Statistical Association, 82, 528–550.
29. Tierney, L. (1991), “Exploring Posterior Distributions using Markov Chains,” in Computer Science and Statistics: 23rd Symposium on the Interface, ed. E. M. Keramidas, Alexandria, VA: ASA, pp. 563–570.
30. —— (1994), “Markov Chains for Exploring Posterior Distributions,” The Annals of Statistics.
31. Titterington, D. M., Smith, A. F. M., and Makov, U. E. (1985), Statistical Analysis of Finite Mixture Distributions, Chichester, U.K.: John Wiley.
32. West, M. (1990), “Bayesian Kernel Density Estimation,” Discussion Paper 90-A02, Duke University, Institute of Statistics and Decision Sciences.
33. —— (1992a), “Modelling With Mixtures” (with discussion), in Bayesian Statistics 4, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U.K.: Oxford University Press, pp. 503–524.
34. —— (1992b), “Hyperparameter Estimation in Dirichlet Process Mixture Models,” ISDS Discussion Paper 92-A03, Duke University.
35. West, M., and Cao, G. (1993), “Assessing Mechanisms of Neural Synaptic Activity,” in Bayesian Statistics in Science and Technology: Case Studies, eds. C. Gatsonis, J. Hodges, R. Kass, and N. Singpurwalla, New York: Springer-Verlag, pp. 416–428.
36. West, M., Müller, P., Escobar, M. D. (1994), “Hierarchical Priors and Mixture Models, With Applications in Regression and Density Estimation,” in Aspects of Uncertainty: A Tribute to D. V. Lindley, eds. A. F. M. Smith and P. Freeman, New York: John Wiley, pp. 363–386.