Parallel Markov chain Monte Carlo for Pitman-Yor mixture models

Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014

Volumn , Issue , 2014, Pages 142-151

  Dubey, Avinava ^a   Williamson, Sinead A ^b   Xing, Eric P ^a  

^a Carnegie Mellon University   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; MARKOV PROCESSES;

AUXILIARY VARIABLES; DATA SET SIZE; INFERENCE ALGORITHM; MARKOV CHAIN MONTE-CARLO; MIXTURE MODEL; NUMBER OF CLUSTERS; POWER-LAW BEHAVIOR; PROCESS-BASED MODELS;

INFERENCE ENGINES;

EID: 84923316887     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Asuncion, A., Smyth, P., and Welling, M. (2008). Asynchronous distributed learning of topic models. In Advances in Neural Information Processing Systems.
2. Blunsom, P. and Cohn, T. (2011). A hierarchical Pitman-Yor process HMM for unsupervised part of speech induction. In Association for Computational Linguistics: Human Language Technologies (HLT).
3. Chang, J. and Fisher III, J. W. (2013). Parallel sampling of DP mixture models using sub-clusters splits. In Advances in Neural Information Processing Systems.
4. Doshi-Velez, F., Knowles, D., Mohemed, S., and Ghahramani, Z. (2009). Large scale nonparametric Bayesian inference: Data parallelisation in the Indian buffet process. In Advances in Neural Information Processing Systems.
5. Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. Annals of Statistics, 1(2):209-230.
6. Gal, Y. and Ghahramani, Z. (2013). Pitfalls in the use of parallel inference for the Dirichlet process. In Workshop in Big Learning, NIPS.
7. Goldwater, S., Griffiths, T., and Johnson, M. (2006). Interpolating between types and tokens by estimating powerlaw generators. In Advances in Neural Information Processing Systems.
8. Ishwaran, H. and James, L. (2001). Gibbs sampling methods for stick-breaking priors. Journal of the American Statistal Association, 96(453):161-173.
9. Lovell, D., Adams, R., and Mansinghka, V. (2012). Parallel Markov chain Monte Carlo for Dirichlet process mixtures. In Workshop on Big Learning, NIPS.
10. Neal, R. (1998). Markov chain sampling methods for Dirichlet process mixture models. Technical Report 9815, Dept. of Statistics, University of Toronto.
11. Perman, M., Pitman, J., and Yor, M. (1992). Size-biased sampling of Poisson point processes and excursions. Probability Theory and Related Fields, 92(1):21-39.
12. Pitman, J. and Yor, M. (1997). The two-parameter Poisson-Dirichlet distribtion derived from a stable subordinator. Annals of Probability, 25(2):531-1010.
13. Teh, Y.-W. (2006a). A Bayesian interpretation of interpolated Keyser-Ney. Technical Report TAR2/06, National University of Singapore.
14. Teh, Y.-W. (2006b). A hierarchical Bayesian language model based on Pitman-Yor processes. In ACL.
15. Teh, Y.-W., Jordan, M., Beal, M., and Blei, D. (2006). Hierarchical Dirichlet processes. Journal of the American Statistical Association, 101(476):1566-1581.
16. Williamson, S., Dubey, A., and Xing, E. (2013). Parallel Markov chain Monte Carlo for nonparametric mixture models. In International Conference on Machine Learning.
17. Wood, F., Archambeau, C., Gasthaus, J., James, L., and Teh, Y.-W. (2009). A stochastic memoizer for sequence data. In International Conference on Machine Learning.
18. Zipf, G. (1935). The Psychobiology of Language. Houghton-Mifflin