Modeling with normalized random measure mixture models

Statistical Science

Volumn 28, Issue 3, 2013, Pages 313-334

  Barrios, Ernesto ^a   Lijoi, Antonio ^b   Nieto Barajas, Luis E ^a   Prünster, Igor ^c  

^a INSTITUTO TECNOLÓGICO AUTÓNOMO DE MÉXICO   (Mexico)

^b UNIVERSITY OF PAVIA   (Italy)

^c UNIVERSITY OF TURIN   (Italy)

Author keywords

Bayesian nonparametrics; Clustering; Completely random measure; Density estimation; Dirichlet process; Increasing additive process; Latent variables; Mixture model; Normalized generalized gamma process; Normalized inverse Gaussian process; Normalized random measure; Normalized stable process.

Indexed keywords

EID: 84878550348     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/13-STS416     Document Type: Article

References (49)

1. ARGIENTO, R., GUGLIELMI, A. and PIEVATOLO, A. (2010). Bayesian density estimation and model selection using nonparametric hierarchical mixtures. Comput. Statist. Data Anal. 54 816-832. MR2580918
2. BERRY, D. A. and CHRISTENSEN, R. (1979). Empirical Bayes estimation of a binomial parameter via mixtures of Dirichlet processes. Ann. Statist. 7 558-568. MR0527491
3. BLACKWELL, D. (1973). Discreteness of Ferguson selections. Ann. Statist. 1 356-358. MR0348905
4. BRIX, A. (1999). Generalized gamma measures and shot-noise Cox processes. Adv. in Appl. Probab. 31 929-953. MR1747450
5. BURDEN, R. L. and FAIRES, J. D. (1993). Numerical Analysis. PWS Publishing Company, Boston.
6. BUSH, C. A. andMACEACHERN, S. N. (1996). A semiparametric Bayesian model for randomised block designs. Biometrika 83 275-285.
7. DALEY, D. J. andVERE-JONES, D. (2008). An Introduction to the Theory of Point Processes. Vol. II, General Theory and Structure, 2nd ed. Springer, New York. MR2371524
8. DAMIEN, P.,WAKEFIELD, J. andWALKER, S. (1999). Gibbs sampling for Bayesian non-conjugate and hierarchical models by using auxiliary variables. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 331-344. MR1680334
9. DE IORIO, M., MÜLLER, P., ROSNER, G. L. and MACEACHERN, S. N. (2004). An ANOVA model for dependent random measures. J. Amer. Statist. Assoc. 99 205-215. MR2054299
10. ESCOBAR, M. D. and WEST, M. (1995). Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90 577-588. MR1340510
11. FAVARO, S., LIJOI, A. and PRÜNSTER, I. (2012). On the stickbreaking representation of normalized inverse Gaussian priors. Biometrika 99 663-674. MR2966776
12. FAVARO, S. and TEH, Y. W. (2013). MCMC for normalized random measure mixture models. Statist. Sci. 28 335-359.
13. FERGUSON, T. S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1 209-230. MR0350949
14. FERGUSON, T. S. (1974). Prior distributions on spaces of probability measures. Ann. Statist. 2 615-629. MR0438568
15. FERGUSON, T. S. (1983). Bayesian density estimation by mixtures of normal distributions. In Recent Advances in Statistics 287- 302. Academic Press, New York. MR0736538
16. FERGUSON, T. S. and KLASS, M. J. (1972). A representation of independent increment processes without Gaussian components. Ann. Math. Statist. 43 1634-1643. MR0373022
17. GELFAND, A. E., DEY, D. K. and CHANG, H. (1992). Model determination using predictive distributions with implementation via sampling-based methods. In Bayesian Statistics 4 147-167. Oxford Univ. Press, New York. MR1380275
18. ISHWARAN, H. and JAMES, L. F. (2001). Gibbs sampling methods for stick-breaking priors. J. Amer. Statist. Assoc. 96 161-173. MR1952729
19. JAMES, L. F., LIJOI, A. and PRÜNSTER, I. (2006). Conjugacy as a distinctive feature of the Dirichlet process. Scand. J. Stat. 33 105-120. MR2255112
20. JAMES, L. F., LIJOI, A. and PRÜNSTER, I. (2009). Posterior analysis for normalized random measures with independent increments. Scand. J. Stat. 36 76-97. MR2508332
21. KINGMAN, J. F. C. (1967). Completely random measures. Pacific J. Math. 21 59-78. MR0210185
22. KINGMAN, J. F. C. (1975). Random discrete distribution. J. Roy. Statist. Soc. Ser. B 37 1-22.
23. KINGMAN, J. F. C. (1993). Poisson Processes. Oxford Studies in Probability 3. Oxford Univ. Press, New York. MR1207584
24. LIJOI, A., MENA, R. H. and PRÜNSTER, I. (2005). Hierarchical mixture modeling with normalized inverse-Gaussian priors. J. Amer. Statist. Assoc. 100 1278-1291. MR2236441
25. LIJOI, A., MENA, R. H. and PRÜNSTER, I. (2007). Controlling the reinforcement in Bayesian non-parametric mixture models. J. R. Stat. Soc. Ser. B Stat. Methodol. 69 715-740. MR2370077
26. LIJOI, A. and PRÜNSTER, I. (2010). Models beyond the Dirichlet process. In Bayesian Nonparametrics (N. L. Hjort, C. C. Holmes, P. Müller and S. G. Walker, eds.) 80-136. Cambridge Univ. Press, Cambridge. MR2730661
27. LIJOI, A., NIPOTI, B. and PRÜNSTER, I. (2013). Bayesian inference with dependent normalized completely random measures. Bernoulli. To appear. DOI:10.3150/13-BEJ521.
28. LO, A. Y. (1984). On a class of Bayesian nonparametric estimates. I. Density estimates. Ann. Statist. 12 351-357. MR0733519
29. MACEACHERN, S. N. and MÜLLER, P. (1998). Estimating mixtures of Dirichlet process models. J. Comput. Graph. Statist. 7 223-238.
30. MACEACHERN, S. and MÜLLER, P. (2000). Efficient MCMC schemes for robust model extensions using encompassing Dirichlet process mixture models. In Robust Bayesian Analysis. Lecture Notes in Statist. 152 295-315. Springer, New York. MR1795222
31. MARRON, J. S. andWAND, M. P. (1992). Exact mean integrated squared error. Ann. Statist. 20 712-736. MR1165589
32. MULIERE, P. and TARDELLA, L. (1998). Approximating distributions of random functionals of Ferguson-Dirichlet priors. Canad. J. Statist. 26 283-297. MR1648431
33. MÜLLER, P. and QUINTANA, F. A. (2004). Nonparametric Bayesian data analysis. Statist. Sci. 19 95-110. MR2082149
34. MÜLLER, P. and VIDAKOVIC, B. (1998). Bayesian inference with wavelets: Density estimation. J. Comput. Graph. Statist. 7 456- 468.
35. NIETO-BARAJAS, L. E., PRÜNSTER, I. and WALKER, S. G. (2004). Normalized random measures driven by increasing additive processes. Ann. Statist. 32 2343-2360. MR2153987
36. NIETO-BARAJAS, L. E. and PRÜNSTER, I. (2009). A sensitivity analysis for Bayesian nonparametric density estimators. Statist. Sinica 19 685-705. MR2514182
37. ORBANZ, P. andWILLIAMSON, S. (2011). Unit-rate Poisson representations of completely random measures. Technical report.
38. PAPASPILIOPOULOS, O. and ROBERTS, G. O. (2008). Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models. Biometrika 95 169-186. MR2409721
39. PITMAN, J. (2003). Poisson-Kingman partitions. In Statistics and Science: A Festschrift for Terry Speed (D. R. Goldstein, ed.). Institute of Mathematical Statistics Lecture Notes-Monograph Series 40 1-34. IMS, Beachwood, OH. MR2004330
40. REGAZZINI, E., LIJOI, A. and PRÜNSTER, I. (2003). Distributional results for means of normalized random measures with independent increments. Ann. Statist. 31 560-585. MR1983542
41. RICHARDSON, S. and GREEN, P. J. (1997). On Bayesian analysis of mixtures with an unknown number of components. J. Roy. Statist. Soc. Ser. B 59 731-792. MR1483213
42. ROEDER, K. and WASSERMAN, L. (1997). Practical Bayesian density estimation using mixtures of normals. J. Amer. Statist. Assoc. 92 894-902. MR1482121
43. SATO, K. (1990). Lévy Processes and Infinitely Divisible Distributions. Cambridge Univ. Press, Cambridge.
44. SETHURAMAN, J. (1994). A constructive definition of Dirichlet priors. Statist. Sinica 4 639-650. MR1309433
45. SILVERMAN, B. W. (1986). Density Estimation for Statistics and Data Analysis. Chapman & Hall, London. MR0848134
46. TIERNEY, L. (1994). Markov chains for exploring posterior distributions. Ann. Statist. 22 1701-1762. MR1329166
47. WALKER, S. G. (2007). Sampling the Dirichlet mixture model with slices. Comm. Statist. Simulation Comput. 36 45-54. MR2370888
48. WALKER, S. and DAMIEN, P. (2000). Representations of Lévy processes without Gaussian components. Biometrika 87 477- 483. MR1782492
49. WOLPERT, R. L. and ICKSTADT, K. (1998). Poisson/gamma random field models for spatial statistics. Biometrika 85 251-267. MR1649114