Discovering morphological paradigms from plain text using a dirichlet process mixture model

EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2011, Pages 616-627

  Dreyer, Markus ^a   Eisner, Jason ^b  

^a SDL Language Weaver   (United States)

^b Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALL-AT-ONCE; BELIEF PROPAGATION; DIRICHLET PROCESS MIXTURE MODEL; EMPIRICAL BAYES; GENERATIVE MODEL; GRAPHICAL MODEL; INFERENCE ALGORITHM; MONTE CARLO; PLAIN TEXT; POTENTIAL FUNCTION; PREDICTION ERRORS; WEIGHTED FINITE-STATE TRANSDUCERS;

COMPUTATIONAL LINGUISTICS; DYNAMIC PROGRAMMING; INFERENCE ENGINES; SPEECH RECOGNITION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053262881     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. A. C. Albright. 2002. The Identification of Bases in Morphological Paradigms. Ph.D. thesis, University of California, Los Angeles.
2. D. Aldous. 1985. Exchangeability and related topics. École d'été de probabilités de Saint-Flour XIII, pages 1-198.
3. C. E. Antoniak. 1974. Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems. Annals of Statistics, 2(6):1152-1174.
4. R. H Baayen, R. Piepenbrock, and L. Gulikers. 1995. The CELEX lexical database (release 2)[cd-rom]. Philadelphia, PA: Linguistic Data Consortium, University of Pennsylvania [Distributor].
5. M. Baroni, J. Matiasek, and H. Trost. 2002. Unsupervised discovery of morphologically related words based on orthographic and semantic similarity. In Proc. of the ACL-02 Workshop on Morphological and Phonological Learning, pages 48-57.
6. M. Baroni, S. Bernardini, A. Ferraresi, and E. Zanchetta. 2009. The WaCky Wide Web: A collection of very large linguistically processed web-crawled corpora. Language Resources and Evaluation, 43(3):209-226.
7. David Blackwell and James B. MacQueen. 1973. Ferguson distributions via Pòlya urn schemes. The Annals of Statistics, 1(2):353-355, March.
8. David M. Blei and Peter I. Frazier. 2010. Distance-dependent Chinese restaurant processes. In Proc. of ICML, pages 87-94.
9. E. Chan. 2006. Learning probabilistic paradigms for morphology in a latent class model. In Proceedings of the Eighth Meeting of the ACL Special Interest Group on Computational Phonology at HLT-NAACL, pages 69-78.
10. M. Creutz and K. Lagus. 2005. Unsupervised morpheme segmentation and morphology induction from text corpora using Morfessor 1.0. Computer and Information Science, Report A, 81.
11. H. Déjean. 1998. Morphemes as necessary concept for structures discovery from untagged corpora. In Proc. of the Joint Conferences on New Methods in Language Processing and Computational Natural Language Learning, pages 295-298.
12. Markus Dreyer and Jason Eisner. 2009. Graphical models over multiple strings. In Proc. of EMNLP, Singapore, August.
13. Markus Dreyer, Jason Smith, and Jason Eisner. 2008. Latent-variable modeling of string transductions with finite-state methods. In Proc. of EMNLP, Honolulu, Hawaii, October.
14. Markus Dreyer. 2011. A Non-Parametric Model for the Discovery of Inflectional Paradigms from Plain Text Using Graphical Models over Strings. Ph.D. thesis, Johns Hopkins University.
15. T.S. Ferguson. 1973. A Bayesian analysis of some non-parametric problems. The annals of statistics, 1(2):209-230.
16. Y. Freund and R. Schapire. 1999. Large margin classification using the perceptron algorithm. Machine Learning, 37(3):277-296.
17. J. Goldsmith. 2001. Unsupervised learning of the morphology of a natural language. Computational Linguistics, 27(2):153-198.
18. S. Goldwater, T. Griffiths, and M. Johnson. 2006a. Interpolating between types and tokens by estimating power-law generators. In Proc. of NIPS, volume 18, pages 459-466.
19. S. Goldwater, T. L. Griffiths, and M. Johnson. 2006b. Contextual dependencies in unsupervised word segmentation. In Proc. of COLING-ACL.
20. P.J. Green. 1995. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82(4):711.
21. M. A Hafer and S. F Weiss. 1974. Word segmentation by letter successor varieties. Information Storage and Retrieval, 10:371-385.
22. Z. S. Harris. 1955. From phoneme to morpheme. Language, 31(2):190-222.
23. G.E. Hinton. 2002. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800.
24. Klara Janecki. 2000. 300 Polish Verbs. Barron's Educational Series.
25. E. T. Jaynes. 2003. Probability Theory: The Logic of Science. Cambridge Univ Press. Edited by Larry Bretthorst.
26. D. Jurafsky, J. H. Martin, A. Kehler, K. Vander Linden, and N. Ward. 2000. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. MIT Press.
27. M. Kay. 1987. Nonconcatenative finite-state morphology. In Proc. of EACL, pages 2-10.
28. M. Kurimo, S. Virpioja, V. Turunen, and K. Lagus. 2010. Morpho Challenge competition 2005-2010: Evaluations and results. In Proc. of ACL SIGMORPHON, pages 87-95.
29. P. H. Matthews. 1972. Inflectional Morphology: A Theoretical Study Based on Aspects of Latin Verb Conjugation. Cambridge University Press.
30. Christian Monson, Jaime Carbonell, Alon Lavie, and Lori Levin. 2007. ParaMor: Minimally supervised induction of paradigm structure and morphological analysis. In Proc. of ACL SIGMORPHON, pages 117-125, June.
31. J. Naradowsky and S. Goldwater. 2009. Improving morphology induction by learning spelling rules. In Proc. of IJCAI, pages 1531-1536.
32. J. Pitman and M. Yor. 1997. The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. Annals of Probability, 25:855-900.
33. P. Schone and D. Jurafsky. 2001. Knowledge-free induction of inflectional morphologies. In Proc. of NAACL, volume 183, pages 183-191.
34. J. Sethuraman. 1994. A constructive definition of Dirich-let priors. Statistica Sinica, 4(2):639-650.
35. N. A. Smith, D. A. Smith, and R. W. Tromble. 2005. Context-based morphological disambiguation with random fields. In Proceedings of HLT-EMNLP, pages 475-482, October.
36. G. T. Stump. 2001. Inflectional Morphology: A Theory of Paradigm Structure. Cambridge University Press.
37. Y.W. Teh, M.I. Jordan, M.J. Beal, and D.M. Blei. 2006. Hierarchical Dirichlet processes. Journal of the American Statistical Association, 101(476):1566-1581.
38. Yee Whye Teh. 2006. A hierarchical Bayesian language model based on Pitman-Yor processes. In Proc. of ACL.
39. K. Toutanova and R.C. Moore. 2002. Pronunciation modeling for improved spelling correction. In Proc. of ACL, pages 144-151.
40. D. Yarowsky and R. Wicentowski. 2000. Minimally supervised morphological analysis by multimodal alignment. In Proc. of ACL, pages 207-216, October.