Dirichlet prior sieves in finite normal mixtures

Statistica Sinica

Volumn 12, Issue 3, 2002, Pages 941-963

  Ishwaran, Hemant ^a   Zarepour, Mahmoud ^a  

^a LERNER RESEARCH INSTITUTE   (United States)

Author keywords

Bose Einstein distribution; Dirichlet process; Identification; Method of sieves; Random probability measure; Relative entropy; Weak convergence

Indexed keywords

EID: 0036661094     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (44)

1. Barron, A.R. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Technical Report 7, Department of Statistics, University of Illinois, Champaign, IL.
2. Billinglsey, P. (1968). Convergence of Probability Measures. Wiley, New York.
3. Celeux, G., Hurn, M and Robert, C.P. (2000). Computational and inferential difficulties with mixture posterior distributions. J. Amer. Assoc. 95, 957-970.
4. Chen, J. (1995). Optimal rate of convergence for finite mixture models. Ann. Statist. 23, 221-233.
5. Chib, S. (1995). Marginal likelihood from the Gibbs output. J. Amer. Statist. Assoc. 90, 1313-1321.
6. Chow, Y.S. and Teicher, H. (1978). Probability Theory: Independence, Interchangeability, Martingales. Springer-Verlag, New York.
7. Diebolt, J. and Robert, C.P. (1994). Estimation of finite mixture distributions through Bayesian sampling. J. Roy. Statist. Soc. Ser. B 56, 363-375.
8. Escobar, M.D. (1988). Estimating the means of several normal populations by nonparametric estimation of the distribution of the means. Unpublished Ph.D. thesis, Department of Statistics, Yale University.
9. Escobar, M.D. (1994). Estimating normal means with a Dirichlet process prior. J. Amer. Statist. Assoc. 89, 268-277.
10. Escobar, M.D. and West, M. (1995). Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90, 577-588.
11. Ferguson, T.S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1, 209-230.
12. Ferguson, T.S. (1974). Prior distributions on spaces of probability measures. Ann. Statist. 2, 615-629.
13. Ferguson, T.S. (1983). Bayesian density estimation by mixtures of normal distributions. In Recent Advances in Statistics (Edited by M.H. Rizvi, J. Rustagi and D. Siegmund), 287-302. Academic Press, New York.
14. Geman, S. and Hwang, C.R. (1982). Nonparametric maximum likelihood estimation by the method of sieves. Ann. Statist. 10, 401-414.
15. Genovese, C.R. and Wasserman, L. (2000). Rates of convergence for the Gaussian mixture sieve. Ann. Statist. 028, 1105-1127.
16. Ghosal, S., Ghosh, J.K. and Ramamoorthi, R.V. (1999). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27, 143-158.
17. Ghosal, S. and van der Vaart, A.W. (2001). Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities. Ann. Statist. 29, 1233-1263.
18. Green, P., and Richardson, S. (2001). Modelling heterogeneity with and without the Dirichlet process. Scand. J. Statist. 28, 355-377.
19. Grenader, U. (1981). Abstract Inference. Wiley, New-York.
20. Ishwaran, H. and James, L.F. (2001). Gibbs sampling methods for stick-breaking priors. J. Amer. Statist. Assoc. 96, 161-173.
21. Ishwaran H., James, L.F. and Sun, J. (2001). Bayesian model selection in finite mixtures by marginal density decompositions. J. Amer. Statist. Assoc. 96, 1316-1332.
22. Ishwaran, H. and Zarepour, M. (2000). Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models. Biometrika 87, 371-390.
23. Ishwaran, H. and Zarepour, M. (2002). Exact and approximate sum-representations for the Dirichlet process. Canad. J. Statist. 30, 1-15.
24. Kemperman, J.H.B. (1969). On the optimum rate of transmitting information. Ann. Math. Statist. 40, 2156-2177.
25. Kingman, J.F.C. (1975). Random discrete distributions. J. Roy. Statist. Soc. Ser. B 37, 1-22.
26. Kingman, J.F.C. (1993). Poisson Processes. Oxford University Press, Oxford.
27. Kuo, L. (1986). Computations of mixtures of Dirichlet processes. SIAM J. Sci. Statist. Comput. 7, 60-71.
28. Lindsay, B.G. (1995). Mixture Models: Theory, Geometry and Applications. NSF-CBMS Regional Conference Series in Probability and Statistics, Volume 5. IMS, California.
29. Lo, A.Y. (1984). On a class of Bayesian nonparametric estimates: I. Density estimates. Ann. Statist. 12, 351-357.
30. MacEachern, S.N. (1994). Estimating normal means with a conjugate style Dirichlet process prior. Comm. Statist. Simulation Comput. 23, 727-741.
31. McLachlan, G. and Peel, D. (2000). Finite Mixture Models. Wiley, New-York.
32. Muliere P. and Secchi, P. (1995). A note on a proper Bayesian bootstrap. Technical report No. 18, Dipartimento di Economia Politica e Metodi Quantitativi, Università degli Sudi di Pavia.
33. Neal, R.M. (2000). Markov chain sampling methods for Dirichlet process mixture models. J. Comput. Graph. Statist. 9, 249-265.
34. Pitman, J. (1996). Some developments of the Blackwell-MacQueen urn scheme. In Statistics, Probability and Game Theory (Edited by T.S. Ferguson, L.S. Shapley and J.B. MacQueen), 245-267. IMS Lecture Notes-Monograph series, Vol 30. Hayward CA: Institute of Mathematical Statistics.
35. Priebe, C.E. (1994). Adaptive mixtures. J. Amer. Statist. Assoc. 89, 796-806.
36. Resnick, S.I. (1987). Extreme Values, Regular Variation, and Point Processes. Springer-Verlag, New York.
37. Richardson, S. and Green, P.J. (1997). On Bayesian analysis of mixtures with an unknown number of components. J. Roy. Statist. Soc. Ser. B 59, 731-792.
38. Roeder, K. (1992). Semiparametric estimation of normal mixture densities. Ann. Statist. 20, 929-943.
39. Roeder, K. and Wasserman, L. (1997). Practical Bayesian density estimation using mixtures of normals. J. Amer. Statist. Assoc. 92, 894-902.
40. Shen, X. and Wong, W.H. (1994). Convergence rate of sieve estimates. Ann. Statist. 22, 580-615.
41. Teicher H. (1960). On the mixture of distributions. Ann. Math. Statist. 31, 55-73.
42. Teicher H. (1963). Identifiability of finite mixtures. Ann. Math. Statist. 32, 1265-1269.
43. Wong, W.H. and Shen, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23, 339-363.
44. Zhang, C.H. (1990). Fourier methods for estimating mixing densities and distributions. Ann. Statist. 18, 806-831.