Part-of-speech tagging of modern Hebrew text

Natural Language Engineering

Volumn 14, Issue 2, 2008, Pages 223-251

  Bar Haim, Roy ^a   Sima'An, Khalil ^b   Winter, Yoad ^c,d  

^a BAR ILAN UNIVERSITY   (Israel)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^d Netherlands Institute for Advanced Study in the Humanities and Social Sciences NIAS KNAW   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL GRAMMARS; ERROR ANALYSIS; HIDDEN MARKOV MODELS; TEXT PROCESSING; WORD PROCESSING;

GRAMMATICAL MODEL; MODERN HEBREW TEXT; PART-OF-SPEECH TAGGING; SEMITIC LANGUAGE;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 40949110156     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S135132490700455X     Document Type: Article

References (41)

1. Adler, M. and Elhadad, M. 2006. An unsupervised morpheme-based HMM for Hebrew morphological disambiguation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Sydney, Australia, pp. 665-672. East Stroudsburg, PA: Association for Computational Linguistics.
2. Bar-Haim, R., Sima'an, K. and Winter, Y. 2005. Choosing an optimal architecture for segmentation and POS-tagging of Modern Hebrew. In Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages, Ann Arbor, pp. 39-46, MI. East Stroudsburg, PA: Association for Computational Linguistics.
3. Baum, L. 1972. An inequality and associated maximization technique in statistical estimation for probabilistic functions of a Markov process. In Inequalities III: Proceedings of the Third Symposium on Inequalities, University of California, Los Angeles, pp. 1-8.
4. Brants, T. 2000. TnT: A statistical part-of-speech tagger. In Proceedings of the 6th Conference on Applied Natural Language Processing Seattle, WA.
5. Brill, E. 1995. Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging. Computational Linguistic 21: 784-789.
6. Buckwalter, T. 2002. Buckwalter Arabic Morphological Analyzer Version 1.0. Linguistic Data Consortium (LDC). LDC Catalog No.: LDC2002L49, ISBN:1-58563-257-0.
7. Carmel, D. and Maarek, Y. 1999. Morphological disambiguation for Hebrew search systems. In Proceedings of the 4th international workshop, NGITS-99.
8. Charmak, E., Hendrickson, C., Jacobson, N. and Perkowitz, M. 1993. Equations for part-of-speech tagging. In National Conference on Artificial Intelligence, pp. 784-789.
9. Church, K. W. 1988. A stochastic parts program and noun phrase parser for unrestricted text. In Proc. of the Second Conference on Applied Natural Language Processing, Austin, TX, pp. 136-143.
10. Cutting, D., Kupiec, J., Pedersen, J. and Sibun, P. 1992. A practical part-of-speech tagger. In Proceedings of the third conference on Applied natural language processing, Association for Computational Linguistics pp. 133-140.
11. Danon, G. 2001. Syntactic definiteness in the grammar of Modern Hebrew. Linguistics 39: 1071-1116.
12. Daya, E., Roth, D. and Wintner, S. 2004. Learning Hebrew roots: Machine learning with linguistic constraints. In Proceedings of EMNLP'04, Barcelona, Spain, pp. 357-364.
13. Dermatas, E. and Kokkinakis, G. 1995. Automatic stochastic tagging of natural language texts. Computational Linguistics 21(2): 137-163.
14. DeRose, S. J. 1988. Grammatical category disambiguation by statistical optimization. Computational Linguistics 14(1): 31-39.
15. Diab, M., Hacioglu, K. and Jurafsky, D. 2006. Automatic Tagging of arabic text: From raw text to base phrase chunks. In D. M. S. Dumais and S. Roukos (eds), HLT-NAACL 2004: Short Papers, Boston, MA, pp. 149-152. East Stroudsburg, PA: Association for Computational Linguistics.
16. Elworthy, D. 1994. Does Baum-Welch re-estimation help taggers? In Proceedings of the fourth conference on Applied natural language processing, Morgan Kaufmann Publishers Inc. pp. 53-58.
17. Glinert, L. 1989. The Grammar of Modern Hebrew. Cambridge, England: Cambridge University Press.
18. Goldsmith, J. 2001. Unsupervised learning of the morphology of a natural language. Computational Linguistics 27(2): 153-198.
19. Good, I. J. 1953. The population frequencies of species and the estimation of population parameters. Biometrika 40: 237-264.
20. Habash, N. and Rambow, O. 2005. Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05), pp. 573-580, Ann Arbor, MI. Association for Computational Linguistics.
21. Hakkani-Tür, D., Oflazer, K. and Tür, G. 2000. Statistical morphological disambiguation for agglutinative languages. In Proceedings of the 18th International Conference on Computational Linguistics (COLING 2000).
22. ISO. 1999. Information and documentation - conversion of Hebrew characters into Latin characters - part 3: Phonemic conversion, ISO/FDIS 259-3: (E).
23. Katz, S. M. 1987. Estimation of probabilities from sparse data from the language model component of a speech recognizer. IEEE Transactions of Acoustics, Speech and Signal Processing 35(3): 400-401.
24. Lee, Y. S., Papineni, K., Roukos, S., Emam, O. and Hassan, H. 2003. Language model based arabic word segmentation. In ACL '03: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, Morristown, NJ, USA, pp. 399-406. East Stroudsburg, PA: Association for Computational Linguistics.
25. Levinger, M., Ornan, U. and Itai, A. 1995. Morphological disambiguation in Hebrew using a priori probabilities. Computational Linguistics 21: 383-404.
26. Levinger, M. 1992. Morphological Disambiguation in Hebrew. Master's thesis, Computer Science Department, Technion, Haifa, Israel. In Hebrew.
27. Maamouri, M., Bies, A., Buckwalter, T. and Mekki, W. 2004. The Penn Arabic Treebank: Building a large-scale annotated Arabic corpus. In NEMLAR International Conference on Arabic Language Resources and Tools Cairo.
28. Merialdo, B. 1994. Tagging English text with a probabilistic model. Computational Linguistics 20(2): 155-171.
29. Nakagawa, T. 2004. Chinese and japanese word segmentation using word-level and character-level information. In Proceedings of Coling 2004, Geneva, Switzerland, pp. 466-472.
30. Nigam, K., Mccallum, A. K., Thrun, S. and Mitchell, T. 2000. Text classification from labeled and unlabeled documents using EM. Machine Learning 39(2-3): 103-134.
31. Rogati, M., McCarley, S. and Yang, Y. 2003. Unsupervised learning of Arabic stemming using a parallel corpus. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL'03 Sapporo, Japan, pp. 391-398.
32. Schone, P. and Jurafsky, D. 2000. Knowledge-free induction of morphology using latent semantic analysis. In Proceedings of CoNLL-2000 and LLL-2000, Lisbon, Portugal, pp. 67-72.
33. Segal, E., 2000. Hebrew Morphological Analyzer for Hebrew Undotted Texts. Master's thesis. Computer Science Department, Technion, Haifa, Israel. http://www.cs.technion.ac.il/-~erelsgl/bxi/hmntx/teud.html
34. Sima'an, K., Itai, A., Winter, Y., Altman, A. and Nativ, N. 2001. Building a tree-bank of Modern Hebrew text. Traitment Automatique des Langues 42: 347-380.
35. Stolcke, A. 2002. SRILM - an extensible language modeling toolkit. In ICSLP, Denver, CO, pp. 901-904.
36. Viterbi, A. J. 1967. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Transaction of Information Theory IT-13(2): 260-269.
37. Watson, J. C. E. 2002. The Phonology and Morphology of Arabic. Oxford University Press, Oxford.
38. Weischedel, R., Schwartz, R., Palmucci, J., Meteer, M. and Ramshaw, L. 1993. Coping with ambiguity and unknown words through probabilistic models. Computational Linguistics 19(2): 361-382.
39. Wintner, S. 2000. Definiteness in the Hebrew noun phrase. Journal of Linguistics 36: 319-363.
40. Xue, N. 2003. Chinese word segmentation as character tagging. International Journal of Computational Linguistics and Chinese 8 1): 29-48.
41. Yarowsky, D. and Wicentowski, R. 2000. Minimally supervised morphological analysis by multimodal alignment. In Proceedings of ACL-2000, Hong Kong, pp. 207-216.