Forgetting counts: Constant memory inference for a dependent hierarchical Pitman-Yor process

ICML 2010 - Proceedings, 27th International Conference on Machine Learning

Volumn , Issue , 2010, Pages 63-70

  Bartlett, Nicholas ^a   Pfau, David ^a   Wood, Frank ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISCRETE DATA; DISCRETE SEQUENCE PREDICTION; LINEAR TIME; MONTE CARLO INFERENCE; PROCESS MODEL; SEQUENCE PREDICTION; STATE OF THE ART;

LEARNING SYSTEMS;

EID: 77956519108     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Bell, T., Witten, I.H., and Cleary, J.G. Modeling for text compression. ACM Computing Surveys (CSUR), 21(4):557-591, 1989.
2. Blackwell, D. and Mac Queen, J. Ferguson distributions via Polya urn schemes. The Annals of Statistics, 1:353-355, 1973.
3. Brockwell, P.J. and Davis, R.A. Time series: theory and methods. Springer, 1991.
4. Caron, F., Davy, M., and Doucet, A. Generalized polya urn for time-varying Dirichlet process mixtures. In 23rd Conference on Uncertainty in Artificial Intelligence (UAI'2007), Vancouver, Canada, July 2007, 2007a.
5. Caron, F., M., Davy, and Doucet, A. Stationary Pitman-Yor processes. Poster, Isaac Newton Institute Workshop on Construction and Properties of Bayesian nonparametric regression models, August 2007b.
6. Csató, L. and Opper., M. Sparse online Gaussian processes. Neural Computation, pp. 641-668, 2002.
7. Deutsch, P. et al. GZIP file format specification version 4.3, 1996.
8. Doucet, A., de Freitas, N., and Gordon, N. Sequential Monte Carlo Methods in Practice. Springer, 2001.
9. Ewens, WJ and Tavare, S. The Ewens sampling formula. Multivariate Discrete Distributions. Wiley, New York, 1995.
10. Gasthaus, J., Wood, F., and Teh, Y. W. Lossless compression based on the Sequence Memoizer. In Data Compression Conference 2010, pp. 337-345, 2010.
11. Griffin, J.E. and Steel, M.F.J. Order-based dependent Dirichlet processes. Journal of the American Association of Statistics, 101(473):179-194, 2006.
12. Kingman, JFC. Random partitions in population genetics. Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences, 361 (1704): 1-20, 1978.
13. Lawrence, N., Seeger, M., and Herbrich, R. Fast sparse Gaussian process methods: The informative vector machine. Advances in neural information processing systems, pp. 625-632, 2003.
14. MacEachern, S. N. Dependent Dirichlet processes. Technical report, Department of Statistics, Ohio State University, 2000.
15. Pitman, J. Exchangeable and partially exchangeable random partitions. Probability Theory and Related Fields, 102(2): 145-158, 1995.
16. Pitman, J. and Yor, M. The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. Annals of Probability, 25:855-900, 1997.
17. Seward, J. bzip2. Go online to http://www.spec.org/osg/cpu2000/CINT2000/- 256.bzip2/docs/256.bzip2.html, 1999.
18. Snelson, E. and Ghahramani, Z. Sparse Gaussian processes using pseudo-inputs. In Advances in Neural Information Processing Systems 18, pp. 1257-1264. MIT press, 2006.
19. Srebro, N. and Roweis, S. Time-varying topic models using dependent Dirichlet processes. Technical Report UTML-TR-2005-003, Department of Computer Science, University of Toronto, 2005.
20. Teh, Y. W. A hierarchical Bayesian language model based on Pitman-Yor processes. In Proceedings of the Association for Computational Linguistics, pp. 985-992, 2006.
21. Teh, Y. W., Jordan, M. I., Beal, M. J., and Blei, D. M. Hierarchical Dirichlet processes. Journal of the American Statistical Association, 101(476): 1566-1581, 2006.
22. Wood, F., Archambeau, C., Gasthaus, J., James, L., and Teh, Y. W. A stochastic memoizer for sequence data. In Proceedings of the 26th International Conference on Machine Learning, pp. 1129-1136, Montreal, Canada, 2009.