A stochastic memoizer for sequence data

Proceedings of the 26th International Conference On Machine Learning, ICML 2009

Volumn , Issue , 2009, Pages 1129-1136

  Wood, Frank ^a   Archambeav, Cédric ^b   Gasthaus, Jan ^a   James, Lancelot ^c   Teh, Yee Whye ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN; LANGUAGE MODEL; MARGINALIZATION; NON-PARAMETRIC MODEL; PREDICTIVE DISTRIBUTIONS; PREDICTIVE INFERENCES; PREDICTIVE PERFORMANCE; SEQUENCE DATA; STATISTICAL STRENGTH; TIME AND SPACE; TRAINING SEQUENCES;

COAGULATION; COMPUTATIONAL LINGUISTICS; ROBOT LEARNING;

PERSONNEL TRAINING;

EID: 71149086686     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Bengio, Y., Ducharme, R., Vincent, P., & Jauvin, C. (2003). A neural probabilistic language model. Journal of Machine Learning Research, 3, 1137-1155.
2. Cleary, J. G. & Teahan, W. J. (1997). Unbounded length contexts for PPM. The Computer Journal, 40, 67-75.
3. Goodman, N. D., Mansinghka, V. K., Roy, D., Bonawitz, K., & Tenenbaum, J. B. (2008). Church: a language for generative models. In Uncertainty and Artificial Intelligence. to appear.
4. Ho, M. W., James, L. F., & Lau, J. W. (2006). Coagulation fragmentation laws induced by general coagulations of two-parameter Poisson-Dirichlet processes. http://arxiv.org/abs/math.PR/0601608.
5. Ishwaran, H. & James, L. F. (2001). Gibbs sampling methods for stick-breaking priors. Journal of American Statistical Association, 96(453), 161-173.
6. Michie, D. (1968). Memo functions and machine learning. Nature, 218, 19-22.
7. Mnih, A. & Hinton, G. (2009). A scalable hierarchical distributed language model. In Neural Information Processing Systems 22. to appear.
8. Mochihashi, D. & Sumita, E. (2008). The infinite Markov model. In Advances in Neural Information Processing Systems 20, (pp. 1017-1024).
9. Perman, M. (1990). Random Discrete Distributions Derived from Subordinators. PhD thesis, Department of Statistics, University of California at Berkeley.
10. Pitman, J. (1999). Coalescents with multiple collisions. Annals of Probability, 27, 1870-1902.
11. Pitman, J. & Yor, M. (1997). The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. Annals of Probability, 25, 855-900.
12. Sudderth, E. B. & Jordan, M. I. (2009). Shared segmentation of natural scenes using dependent pitman-yor processes. In Neural Information Processing Systems 22. to appear.
13. Teh, Y. W. (2006). A hierarchical Bayesian language model based on Pitman-Yor processes. In Proceedings of the Association for Computational Linguistics, (pp. 985-992).
14. Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006). Hierarchical Dirichlet processes. Journal of the American Statistical Association, 101(476), 1566-1581.
15. Ukkonen, E. (1995). On-line construction of suffix trees. Algorithmica, 14, 249-260.
16. Weiner, P. (1973). Linear pattern matching algorithms. In IEEE 14th Annual Symposium on Switching and Automata Theory, (pp. 1-11).
17. Wood, F. & Teh, Y. W. (2009). A hierarchical nonparametric Bayesian approach to statistical language model domain adaptation. In Journal of Machine Learning, Workshop and Conference Proceedings: Artificial Intelligence in Statistics 2009, volume 5, (pp. 607-614).