Knowledge-rich morphological priors for bayesian language models

NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 1206-1215

  Chahuneau, Victor ^a   Smith, Noah A ^a   Dyer, Chris ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

BAYESIAN; FINITE STATE TRANSDUCERS; FORMATION PROCESS; INDEPENDENCE ASSUMPTION; LANGUAGE MODEL; MULTINOMIAL DISTRIBUTIONS; NON-PARAMETRIC BAYESIAN MODELING; PRIOR DISTRIBUTION; STATISTICAL STRENGTH; WORD FORMATIONS;

MODELING LANGUAGES;

EID: 84961288808     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (47)

1. H. Al-Haj and A. Lavie. 2010. The impact of Arabic morphological segmentation on broadcoverage English-to-Arabic statistical machine translation. Proc. of AMTA.
2. Cyril Allauzen, Michael Riley, Johan Schalkwyk, Wojciech Skut, and Mehryar Mohri. 2007. OpenFst: A general and efficient weighted finite-state transducer library. In Implementation and Application of Automata, pages 11-23.
3. Ebru Arsoy, Brian Roark, Izhak Shafran, and Murat Saraclar. 2008. Discriminative n-gram language modeling for Turkish. In Proc. of Interspeech.
4. Issam Bazzi. 2002. Modelling out-of-vocabulary words for robust speech recognition. Ph. D. Thesis, MIT.
5. K. R. Beesley and L. Karttunen. 2003. Finite-state morphology: Xerox tools and techniques. CSLI, Stanford.
6. Jeff A. Bilmes and Katrin Kirchhoff. 2003. Factored language models and generalized parallel backoff. In Proc. of NAACL.
7. Ondrej Bojar and Magdalena Prokopová. 2006. Czech-English word alignment. In Proc. of LREC.
8. Michael R. Brent, Sreerama K. Murthy, and Andrew Lundberg. 1995. Discovering morphemic suffixes: A case study in MDL induction. In Proceedings of the Fifth International Workshop on Artificial Intelligence and Statistics.
9. Peter F. Brown, Vincent J. Della Pietra, Stephen A. Della Pietra, Robert L. Mercer, and Jennifer C. Lai. 1992. An estimate of an upper bound for the entropy of English. Computational Linguistics, 18(1):31-40.
10. P. F. Brown, V. J. D. Pietra, S. A. D. Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
11. Bob Carpenter. 2005. Scaling high-order character language models to gigabytes. In Proceedings of the ACL Workshop on Software.
12. Mauro Cettolo, Christian Girardi, and Marcello Federico. 2012. WIT3: Web inventory of transcribed and translated talks. In Proc. of EAMT.
13. Stanley F. Chen and Joshua Goodman. 1998. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Harvard University.
14. Mathias Creutz and Krista Lagus. 2007. Unsupervised models for morpheme segmentation and morphology learning. ACM Transactions on Speech and Language Processing, 4(1).
15. M. Creutz, T. Hirsimäki, M. Kurimo, A. Puurula, J. Pylkkönen, V. Siivola, M. Varjokallio, E. Arisoy, M. Saraclar, and A. Stolcke. 2007. Morph-based speech recognition and modeling of out-of-vocabulary words across languages. ACM Transactions on Speech and Language Processing, 5(1):3.
16. Carl G. de Marcken. 1996. Unsupervised Language Acquisition. Ph. D. Thesis, MIT.
17. Chris Dyer, Victor Chahuneau, and Noah A. Smith. 2013. A simple, fast, and effective reparameterization of IBM Model 2. In Proc. of NAACL.
18. J. Goldsmith. 2001. Unsupervised learning of the morphology of a natural language. Computational Linguistics, 27(2):153-198.
19. S. Goldwater and D. McClosky. 2005. Improving statistical MT through morphological analysis. In Proc. of EMNLP.
20. Sharon Goldwater, Thomas L. Griffiths, and Mark Johnson. 2011. Producing power-law distributions and damping word frequencies with two-stage language models. Journal of Machine Learning Research, 12:2335-2382.
21. Nizar Habash and Owen Rambow. 2005. Arabic tokenization, part-of-speech tagging, and morphological disambiguation in one fell swoop. In Proc. of ACL.
22. Nizar Habash and Fatiha Sadat. 2006. Arabic preprocessing schemes for statistical machine translation. In Proc. of NAACL.
23. Nizar Habash, Owen Rambow, and Ryan Roth. 2009. MADA+TOKAN: A toolkit for Arabic tokenization, diacritization, morphological disambiguation, POS tagging, stemming and lemmatization. In Proceedings of the Second International Conference on Arabic Language Resources and Tools.
24. Jan Hajic, P. Krbec, P. Kveton, K. Oliva, and V. Petrovic. 2001. Serial combination of rules and statistics. In Proc. of ACL.
25. D. Z. Hakkani-Tür, Kemal Oflazer, and G. Tür. 2000. Statistical morphological disambiguation for agglutinative languages. In Proc. of COLING.
26. Harold Stanley Heaps. 1978. Information Retrieval: Computational and Theoretical Aspects. Academic Press.
27. M. Hulden. 2009. Foma: A finite-state compiler and library. In Proc. of EACL.
28. Ronald M. Kaplan and Martin Kay. 1994. Regular models of phonological rule systems. Computational Linguistics, 20(3):331-378.
29. Lauri Karttunen and Kenneth R. Beesley. 2005. Twentyfive years of finite-state morphology. In Inquiries into Words, Constraints and Contexts, pages 71-83. CSLI.
30. Kimmo Koskenniemi. 1984. A general computational model for word-form recognition and production. In Proc. of ACL-COLING.
31. O. Lyaševskaya, I. Astaf'yeva, A. Bonch-Osmolovskaya, A. Garejšina, Y. Grišina, V. D'yackov, M. Ionov, A. Koroleva, M. Kudrinskij, A. Lityagina, Y. Lucina, Y. Sidorova, S. Toldova, S. Savcuk, and S. Koval'. 2010. Ocenka metodov avtomaticeskogo analiza teksta: morfologiceskie parseri russkogo yazyka. Komp'juternaya lingvistika i intellektual'nye texnologii (Computational linguistics and intellectual technologies).
32. Einat Minkov, Kristina Toutanova, and Hisami Suzuki. 2007. Generating complex morphology for machine translation. In Proc. of ACL.
33. Christof Monz. 2011. Statistical machine translation with local language models. In Proc. of EMNLP.
34. Kemal Oflazer and Ilknur Durgar El-Kahlout. 2007. Exploring different representational units in English-to-Turkish statistical machine translation. In Proc. of StatMT.
35. K. Oflazer. 1994. Two-level description of Turkish morphology. Literary and Linguistic Computing, 9(2):137-148.
36. Carolina Parada, Mark Dredze, Abhinav Sethy, and Ariya Rastrow. 2011. Learning sub-word units for open vocabulary speech recognition. In Proc. of ACL.
37. Jim Pitman and Marc Yor. 1997. The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. Annals of Probability, 25(2):855-90.
38. Brian Roark. 2009. Open vocabulary language modeling for binary response typing interfaces. Technical Report CSLU-09-001, Oregon Health & Science University.
39. M. Ali Basha Shaik, David Rybach, Stefan Hahn, Ralf Schluüter, and Hermann Ney. 2012. Hierarchical hybrid language models for open vocabulary continuous speech recognition using wfst. In Proc. of SAPA.
40. M. Silfverberg, K. Lindén, and M. Hyvärinen. 2012. Predictive text entry for agglutinative languages using unsupervised morphological segmentation. In Proc. of Computational Linguistics and Intelligent Text Processing.
41. Noah A. Smith, David A. Smith, and Roy W. Tromble. 2005. Context-based morphological disambiguation with random fields. In Proc. of EMNLP.
42. Matt G. Snover and Michael R. Brent. 2001. A Bayesian model for morpheme and paradigm identification. In Proc. of ACL.
43. Benjamin Snyder and Regina Barzilay. 2008. Unsupervised multilingual learning for morphological segmentation. In Proc. of ACL.
44. Yee Whye Teh. 2006. A hierarchical Bayesian language model based on Pitman-Yor processes. In Proc. of ACL.
45. Reut Tsarfaty, Djamé Seddah, Yoav Goldberg, Sandra Kübler, Marie Candito, Jennifer Foster, Yannick Versley, Ines Rehbein, and Lamia Tounsi. 2010. Statistical parsing of morphologically rich languages: What, how and whither. In Proc. of Workshop on Statistical Parsing of Morphologically Rich Languages.
46. F. Tyers and M. S. Alperen. 2010. South-east european times: A parallel corpus of Balkan languages. In Proceedings of the LREC workshop on Exploitation of multilingual resources and tools for Central and (South) Eastern European Languages.
47. M. Talha Cakmak, Süleyman Acar, and Gülsen Eryigit. 2012. Word alignment for English-Turkish language pair. In Proc. of LREC.