Bayesian unsupervised word segmentation with nested Pitman-Yor language modeling

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 100-107

  Mochihashi, Daichi ^a   Yamada, Takeshi ^a   Ueda, Naonori ^a  

^a NTT Communication Science Laboratories   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; COMPUTATIONAL LINGUISTICS; DYNAMIC PROGRAMMING; NATURAL LANGUAGE PROCESSING SYSTEMS;

ARBITRARY LANGUAGES; BAYESIAN; BAYESIAN MODEL; GIBBS SAMPLERS; LANGUAGE MODEL; WORD MODELING; WORD N-GRAMS; WORD SEGMENTATION;

MODELING LANGUAGES;

EID: 84859895217     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1687878.1687894     Document Type: Conference Paper

References (26)

1. David Aldous, 1985. Exchangeability and Related Topics, pages 1-198. Springer Lecture Notes in Math. 1117.
2. Rie Kubota Ando and Lillian Lee. 2003. Mostly-Unsupervised Statistical Segmentation of Japanese Kanji Sequences. Natural Language Engineering, 9(2):127-149.
3. Peter F. Brown, Vincent J. Della Pietra, Robert L. Mercer, Stephen A. Della Pietra, and Jennifer C. Lai. 1992. An Estimate of an Upper Bound for the Entropy of English. Computational Linguistics, 18:31-40.
4. Arnaud Doucet, Christophe Andrieu, and Roman Holenstein. 2009. Particle Markov Chain Monte Carlo. in submission.
5. Tom Emerson. 2005. SIGHAN Bakeoff 2005. http://www.sighan.org/ bakeoff2005/.
6. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter. 1996. Markov Chain Monte Carlo in Practice. Chapman & Hall / CRC.
7. Sharon Goldwater, Thomas L. Griffiths, and Mark Johnson. 2005. Interpolating Between Types and Tokens by Estimating Power-Law Generators. In NIPS 2005.
8. Sharon Goldwater, Thomas L. Griffiths, and Mark Johnson. 2006. Contextual Dependencies in Unsupervised Word Segmentation. In Proceedings of ACL/COLING 2006, pages 673-680.
9. Sharon Goldwater, Thomas L. Griffiths, and Mark Johnson. 2009. A Bayesian framework for word segmentation: Exploring the effects of context. Cognition, in press.
10. Yang He. 1988. Extended Viterbi algorithm for second order hidden Markov process. In Proceedings of ICPR 1988, pages 718-720.
11. Mark Johnson and Sharon Goldwater. 2009. Improving nonparameteric Bayesian inference: experiments on unsupervised word segmentation with adaptor grammars. In NAACL 2009.
12. Mark Johnson, Thomas L. Griffiths, and Sharon Goldwater. 2007. Bayesian Inference for PCFGs via Markov Chain Monte Carlo. In Proceedings of HLT/NAACL 2007, pages 139-146.
13. Reinhard Kneser and Hermann Ney. 1995. Improved backing-off for m-gram language modeling. In Proceedings of ICASSP, volume 1, pages 181-184.
14. Sadao Kurohashi and Makoto Nagao. 1998. Building a Japanese Parsed Corpus while Improving the Parsing System. In Proceedings of LREC 1998, pages 719-724. http://nlp.kuee.kyoto-u.ac.jp/nl-resource/corpus.html.
15. Brian MacWhinney and Catherine Snow. 1985. The Child Language Data Exchange System. Journal of Child Language, 12:271-296.
16. Daichi Mochihashi and Eiichiro Sumita. 2007. The Infinite Markov Model. In NIPS 2007.
17. Kevin Murphy. 2002. Hidden semi-Markov models (segment models). http://www.cs.ubc.ca/.murphyk/Papers/segment.pdf.
18. Masaaki Nagata. 1996. Automatic Extraction of New Words from Japanese Texts using Generalized Forward-Backward Search. In Proceedings of EMNLP 1996, pages 48-59.
19. Abel Rodriguez, David Dunson, and Alan Gelfand. 2008. The Nested Dirichlet Process. Journal of the American Statistical Association, 103:1131-1154.
20. Steven L. Scott. 2002. Bayesian Methods for Hidden Markov Models. Journal of the American Statistical Association, 97:337-351.
21. Jun Suzuki, Akinori Fujino, and Hideki Isozaki. 2007. Semi-Supervised Structured Output Learning Based on a Hybrid Generative and Discriminative Approach. In Proceedings of EMNLP-CoNLL 2007, pages 791-800.
22. Yee Whye Teh. 2006a. A Bayesian Interpretation of Interpolated Kneser-Ney. Technical Report TRA2/06, School of Computing, NUS.
23. Yee Whye Teh. 2006b. A Hierarchical Bayesian Language Model based on Pitman-Yor Processes. In Proceedings of ACL/COLING 2006, pages 985-992.
24. FrankWood and Yee Whye Teh. 2008. A Hierarchical, Hierarchical Pitman-Yor Process Language Model. In ICML 2008 Workshop on Nonparametric Bayes.
25. Jia Xu, Jianfeng Gao, Kristina Toutanova, and Hermann Ney. 2008. Bayesian Semi-Supervised Chinese Word Segmentation for Statistical Machine Translation. In Proceedings of COLING 2008, pages 1017-1024.
26. Hai Zhao and Chunyu Kit. 2008. An Empirical Comparison of Goodness Measures for Unsupervised Chinese Word Segmentation with a Unified Framework. In Proceedings of IJCNLP 2008.