A blocked Gibbs sampler for NGG-mixture models via a priori truncation

Statistics and Computing

Volumn 26, Issue 3, 2016, Pages 641-661

  Argiento, Raffaele ^a   Bianchini, Ilaria ^b   Guglielmi, Alessandra ^b  

^a CNR   (Italy)

^b POLITECNICO DI MILANO   (Italy)

Author keywords

A priori truncation method; Bayesian nonparametric mixture models; Blocked Gibbs sampler; Finite dimensional approximation; Normalized generalized gamma process

Indexed keywords

EID: 84922750134     PISSN: 09603174     EISSN: 15731375     Source Type: Journal    
DOI: 10.1007/s11222-015-9549-6     Document Type: Article

References (39)

1. Argiento, R., Guglielmi, A., Pievatolo, A.: Bayesian density estimation and model selection using nonparametric hierarchical mixtures. Comput. Stat. Data Anal. 54, 816–832 (2010)
2. Argiento, R., Cremaschi, A., Guglielmi, A.: A “density-based” algorithm for cluster analysis using species sampling Gaussian mixture models. J. Comput. Graph. Stat. 23, 1126–1142 (2014)
3. Barrios, E., Lijoi, A., Nieto-Barajas, L.E., Prünster, I.: Modeling with normalized random measure mixture models. Stat. Sci. 28, 313–334 (2013)
4. Bianchini, I.: A Bayesian nonparametric model for density and cluster estimation: the ε-NGG mixture model. Tesi di laurea magistrale, Ingegneria Matematica, Politecnico di Milano (2014a)
5. Bianchini, I.: A new finite approximation for the NGG mixture model: an application to density estimation. In: The Contribution of Young Researchers to Bayesian Statistics: Proceedings of BAYSM2014. Springer, Berlin (2015)
6. Caron, F.: Bayesian nonparametric models for bipartite graphs. In: NIPS, pp. 2060–2068 (2012)
7. Caron, F., Fox, E.B.: Bayesian nonparametric models of sparse and exchangeable random graphs. arXiv preprint. arXiv:1401.1137 (2014)
8. Chen, C., Ding, N., Buntine, W.: Dependent hierarchical normalized random measures for dynamic topic modeling. arXiv preprint. arXiv:1206.4671 (2012)
9. Cho, R.J., Campbell, M.J., Winzeler, E.A., Steinmetz, L., Conway, A., Wodicka, L., Wolfsberg, T.G., Gabrielian, A.E., Landsman, D., Lockhart, D.J., Davis, R.W.: A genome-wide transcriptional analysis of the mitotic cell cycle. Mol. Cell. 2, 65–73 (1998)
10. Escobar, M., West, M.: Bayesian density estimation and inference using mixtures. J. Am. Stat. Assoc. 90, 577–588 (1995)
11. Favaro, S., Teh, Y.: MCMC for normalized random measure mixture models. Stat. Sci. 28(3), 335–359 (2013)
12. Favaro, S., Walker, S.G.: Slice sampling σ-stable Poisson-Kingman mixture models. J. Comput. Graph. Stat. 22(4), 830–847 (2013)
13. Favaro, S., Guglielmi, A., Walker, S.: A class of measure-valued Markov chains and Bayesian nonparametrics. Bernoulli 18(3), 1002–1030 (2012)
14. Ferguson, T.S., Klass, M.: A representation of independent increment processes without Gaussian components. Ann. Math. Stat. 43, 1634–1643 (1972)
15. Gelfand, A.E., Kottas, A.: A computational approach for full nonparametric Bayesian inference under Dirichlet process mixture models. J. Comput. Graph. Stat. 11, 289–305 (2002)
16. Gradshteyn, I., Ryzhik, L.: Table of Integrals, Series, and Products, 6th edn. Academic Press, San Diego (2000)
17. Griffin, J., Walker, S.G.: Posterior simulation of normalized random measure mixtures. J. Comput. Graph. Stat. 20, 241–259 (2011)
18. Griffin, J.E.: An adaptive truncation method for inference in Bayesian nonparametric models. Stat. Comput. doi:10.1007/s11222-014-9519-4 (2014)
19. Griffin, J.E., Kolossiatis, M., Steel, M.F.: Comparing distributions by using dependent normalized random-measure mixtures. J. R. Stat. Soc. B 75(3), 499–529 (2013)
20. Ishwaran, H., James, L.: Gibbs sampling methods for stick-breaking priors. J. Am. Stat. Assoc. 96, 161–173 (2001)
21. Ishwaran, H., Zarepour, M.: Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models. Biometrika 87, 371–390 (2000)
22. Ishwaran, H., Zarepour, M.: Exact and approximate sum representations for the Dirichlet process. Can. J. Stat. 30, 269–283 (2002)
23. James, L., Lijoi, A., Prünster, I.: Posterior analysis for normalized random measures with independent increments. Scand. J. Stat. 36, 76–97 (2009)
24. Kallenberg, O.: Random Measures, 4th edn. Akademie, Berlin (1983)
25. Kalli, M., Griffin, J.E., Walker, S.G.: Slice sampling mixture models. Stat. Comput. 21(1), 93–105 (2011)
26. Kingman, J.F.C.: Poisson Processes, vol. 3. Oxford University Press, Oxford (1993)
27. Lijoi, A., Mena, R.H., Prünster, I.: Controlling the reinforcement in Bayesian nonparametric mixture models. J. R. Stat. Soc. B 69, 715–740 (2007)
28. Lijoi, A., Prunster, I., Walker, S.G.: Investigating nonparametric priors with Gibbs structure. Stat. Sin. 18, 1653–1668 (2008)
29. Lijoi, A., Nipoti, B., Prunster, I.: Bayesian inference with dependent normalized completely random measures. Bernoulli 20, 1260–1291 (2014)
30. MacEachern, S.N.: Computational methods for mixture of Dirichlet process models. In: Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statistics, vol. 133, pp. 23–43. Springer, New York (1998)
31. Muliere, P., Tardella, L.: Approximating distributions of random functionals of Ferguson-Dirichlet priors. Can. J. Stat. 26(2), 283–297 (1998)
32. Neal, R.: Markov chain sampling methods for Dirichlet process mixture models. J. Comput. Graph. Stat. 9, 249–265 (2000)
33. Papaspiliopoulos, O., Roberts, G.O.: Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models. Biometrika 95, 169–186 (2008)
34. Pitman, J.: Some developments of the Blackwell-Macqueen urn scheme. In: Ferguson TS, Shapley LS, Macqueen JB (eds) Statistics, Probability and Game Theory: Papers in Honor of David Blackwell. IMS Lecture Notes-Monograph Series, vol. 30, pp. 245–267. Institute of Mathematical Statistics, Hayward (1996)
35. Pitman, J.: Poisson-Kingman partitions. In: Science and Statistics: A Festschrift for Terry Speed. IMS Lecture Notes-Monograph Series, vol. 40, pp. 1–34. Institute of Mathematical Statistics, Hayward (2003)
36. Pitman, J.: Combinatorial Stochastic Processes. Lecture Notes in Mathematics, vol. 1875, pp. 1–34. Springer, New York (2006)
37. Regazzini, E., Lijoi, A., Prünster, I.: Distributional results for means of random measures with independent increments. Ann. Stat. 31, 560–585 (2003)
38. Sethuraman, J.: A constructive definition of Dirichlet priors. Stat. Sinica 4(2), 639–650 (1994)
39. Walker, S.G.: Sampling the Dirichlet mixture model with slices. Commun. Stat. Simulat. 36, 45–54 (2007)