Context-based morphological disambiguation with random fields

HLT/EMNLP 2005 - Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2005, Pages 475-482

  Smith, Noah A ^a   Smith, David A ^a   Tromble, Roy W ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; SYNTACTICS;

ACCURACY MEASURES; CHARACTER LEVEL; ERROR RATE REDUCTION; LOCAL CONTEXTS; MORPHOLOGICAL DISAMBIGUATION; MORPHOLOGICAL PROCESS; SOURCE CHANNELS; SOURCE MODELING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053244386     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1220575.1220635     Document Type: Conference Paper

References (34)

1. K. R. Beesley and L. Karttunen. 2003. Finite State Morphology. CSLI.
2. T. Buckwalter. 2004. Arabic morphological analyzer version 2.0. LDC2004L02.
3. J. Cha, G. Lee, and J.-H. Lee. 1998. Generalized unknown morpheme guessing for hybrid POS tagging of Korean. In Proc. of VLC.
4. K. Darwish. 2002. Building a shallow Arabic morphological analyser in one day. In Proc. of ACL Workshop on Computational Approaches to Semitic Languages.
5. E. Daya, D. Roth, and S. Wintner. 2004. Learning Hebrew roots: Machine learning with linguistic constraints. In Proc. of EMNLP.
6. M. Diab, K. Hacioglu, and D. Jurafsky. 2004. Automatic tagging of Arabic text: From raw text to base phrase chunks. In Proc. of HLT-NAACL.
7. A. Freeman. 2001. Brill's POS tagger and a morphology parser for Arabic. In Proc. of ACL Workshop on Arabic Language Processing.
8. C. Genest and J. V. Zidek. 1986. Combining probability distributions: A critique and an annotated bibliography. Statistical Science, 1:114-48.
9. N. Habash and O. Rambow. 2005. Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. In Proc. of ACL.
10. J. Hajič, P. Krbec, P. Květoň, K. Oliva, and V. Petkevič. 2001. Serial combination of rules and statistics: A case study in Czech tagging. In Proc. of ACL.
11. J. Hajič. 1998. Building a syntactically annotated corpus: The Prague Dependency Treebank. In Issues of Valency and Meaning.
12. D. Z. Hakkani-Tür, K. Oflazer, and G. Tür. 2000. Statistical morphological disambiguation for agglutinative languages. In Proc. of COLING.
13. C.-H. Han, N.-R. Han, E.-S. Ko, H. Yi, and M. Palmer. 2002. Penn Korean Treebank: Development and evaluation. In Proc. Pacific Asian Conf. Language and Comp.
14. N.-R. Han. 2004. Klex: Finite-state lexical transducer for Korean. LDC2004L01.
15. G. Hinton. 1999. Products of experts. In Proc. of ICANN.
16. J. Hlavácová. 2001. Morphological guesser of Czech words. In Proc. of TSD.
17. F. Jelinek. 1976. Continuous speech recognition by statistical methods. Proc. of the IEEE, 64(4):532-557.
18. R. M. Kaplan and M. Kay. 1981. Phonological rules and finitestate transducers. Presented at Linguistic Society of America.
19. S. Khoja. 2001. APT: Arabic part-of-speech tagger. In Proc. of NAACL Student Workshop.
20. G. Kiraz. 2000. Multitiered nonlinear morphology using multitape finite automata: A case study on Syriac and Arabic. Computational Linguistics, 26(1):77-105.
21. K. Koskenniemi. 1983. Two-level morphology: A general computational model of word-form recognition and production. Technical Report 11, University of Helsinki.
22. T. Kudo, K. Yamamoto, and Y. Matsumoto. 2004. Applying conditional random fields to Japanese morphological analysis. In Proc. of EMNLP.
23. J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. of ICML.
24. M. Levinger, U. Ornan, and A. Itai. 1995. Learning morpholexical probabilities from an untagged corpus with an application to Hebrew. Computational Linguistics, 21(3):383-404.
25. D. C. Liu and J. Nocedal. 1989. On the limited memory method for large scale optimization. Mathematical Programming B, 45(3):503-28. (Pubitemid 20660315)
26. M. Maamouri, A. Bies, H. Jin, and T. Buckwalter. 2003. Arabic Treebank part 1 version 2.0. LDC2003T06.
27. L. Mangu, E. Brill, and A. Stolcke. 1999. Finding consensus among words: Lattice-based word error minimization. In Proc. of ECSCT.
28. E. Mráková and R. Sedlacek. 2003. From Czech morphology through partial parsing to disambiguation. In Proc. of CLITP.
29. F. Peng, F. Feng, and A. McCallum. 2004. Chinese segmentation and new word detection using conditional random fields. In Proc. of COLING.
30. V. Petkevič. 2001. Grammatical agreement and automatic morphological disambiguation of inflectional languages. In Proc. of TSD.
31. F. Sha and F. Pereira. 2003. Shallow parsing with conditional random fields. In Proc. of HLT-NAACL.
32. D. A. Smith and N. A. Smith. 2004. Bilingual parsing with factored estimation: Using English to parse Korean. In Proc. of EMNLP.
33. A. Smith, T. Cohn, and M. Osborne. 2005. Logarithmic opinion pools for conditional random fields. In Proc. of ACL.
34. C. Sutton and A. McCallum. 2005. Cliquewise training for undirected models. In Proc. of UAI.