Improving nonparameteric Bayesian inference: Experiments on unsupervised word segmentation with adaptor grammars

NAACL HLT 2009 - Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Conference

Volumn , Issue , 2009, Pages 317-325

  Johnson, Mark ^a   Goldwater, Sharon ^b  

^a BROWN UNIVERSITY   (United States)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN INFERENCE; ERROR REDUCTION; F-SCORE; NON-PARAMETRIC BAYESIAN; NONPARAMETERIC; WORD SEGMENTATION;

BAYESIAN NETWORKS; INFERENCE ENGINES;

COMPUTATIONAL LINGUISTICS;

EID: 84863393433     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. N. Bernstein-Ratner. 1987. The phonology of parent-child speech. In K. Nelson and A. van Kleeck, editors, Children's Language, volume 6. Erlbaum, Hillsdale, NJ.
2. Daniel Blanchard and Jeffrey Heinz. 2008. Improving word segmentation by simultaneously learning phonotactics. In CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning, pages 65-72, Manchester, England, August.
3. David Blei, Thomas L. Griffiths, Michael I. Jordan, and Joshua B. Tenenbaum. 2004. Hierarchical topic models and the nested chinese restaurant process. In Sebastian Thrun, Lawrence Saul, and Bernhard Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA.
4. Rens Bod. 1998. Beyond grammar: an experience-based theory of language. CSLI Publications, Stanford, California.
5. M. Brent and T. Cartwright. 1996. Distributional regularity and phonotactic constraints are useful for segmentation. Cognition, 61:93-125. (Pubitemid 126410830)
6. M. Brent. 1999. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning, 34:71-105.
7. Jeffrey Elman. 1990. Finding structure in time. Cognitive Science, 14:197-211.
8. Margaret M. Fleck. 2008. Lexicalized phonotactic word segmentation. In Proceedings of ACL-08: HLT, pages 130-138, Columbus, Ohio, June. Association for Computational Linguistics.
9. Sharon Goldwater, Thomas L. Griffiths, and Mark Johnson. 2006a. Contextual dependencies in unsupervised word segmentation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 673-680, Sydney, Australia. Association for Computational Linguistics.
10. Sharon Goldwater, Tom Griffiths, and Mark Johnson. 2006b. Interpolating between types and tokens by estimating power-law generators. In Y. Weiss, B. Schölkopf, and J. Platt, editors, Advances in Neural Information Processing Systems 18, pages 459-466, Cambridge, MA. MIT Press.
11. Sharon Goldwater, Thomas L. Griffiths, and Mark Johnson. 2007. Distributional cues to word boundaries: Context is important. In David Bamman, Tatiana Magnitskaia, and Colleen Zaller, editors, Proceedings of the 31st Annual Boston University Conference on Language Development, pages 239-250, Somerville, MA. Cascadilla Press.
12. H. Ishwaran and L. F. James. 2003. Generalized weighted Chinese restaurant processes for species sampling mixture models. Statistica Sinica, 13:1211-1235. (Pubitemid 38042014)
13. Mark Johnson, Thomas Griffiths, and Sharon Goldwater. 2007a. Bayesian inference for PCFGs via Markov chain Monte Carlo. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference, pages 139-146, Rochester, New York, April. Association for Computational Linguistics.
14. Mark Johnson, Thomas L. Griffiths, and Sharon Gold-water. 2007b. Adaptor Grammars: A framework for specifying compositional nonparametric Bayesian models. In B. Schölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19, pages 641-648. MIT Press, Cambridge, MA.
15. Mark Johnson. 2008. Using adaptor grammars to identifying synergies in the unsupervised acquisition of linguistic structure. In Proceedings of the 46th Annual Meeting of the Association of Computational Linguistics, Columbus, Ohio. Association for Computational Linguistics.
16. Aravind Joshi. 2003. Tree adjoining grammars. In Ruslan Mikkov, editor, The Oxford Handbook of Computational Linguistics, pages 483-501. Oxford University Press, Oxford, England.
17. David J.C. MacKay. 2003. Information Theory, Inference, and Learning Algorithms. Cambridge University Press.
18. Radford M. Neal. 2003. Slice sampling. Annals of Statistics, 31:705-767.
19. J. Pitman and M. Yor. 1997. The two-parameter Poisson-Dirichlet distribution derived from a stable subordina-tor. Annals of Probability, 25:855-900.
20. J. Pitman. 1995. Exchangeable and partially exchangeable random partitions. Probability Theory and Related Fields, 102:145-158.
21. Christian P. Robert and George Casella. 2004. Monte Carlo Statistical Methods. Springer.
22. Andreas Stolcke and Stephen Omohundro. 1994. Inducing probabilistic grammars by Bayesian model merging. In Rafael C. Carrasco and Jose Oncina, editors, Grammatical Inference and Applications, pages 106-118. Springer, New York.
23. Y. W. Teh, M. Jordan, M. Beal, and D. Blei. 2006. Hierarchical Dirichlet processes. Journal of the American Statistical Association, 101:1566-1581.