Word segmentation, unknown-word resolution, and morphological agreement in a Hebrew parsing system

Computational Linguistics

Volumn 39, Issue 1, 2013, Pages 121-160

  Goldberg, Yoav ^a   Elhadad, Michael ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

FORESTRY;

ANNOTATION SCHEME; COMPUTATIONAL MODEL; LANGUAGE RESOURCES; LEXICAL COVERAGE; MORPHOLOGICAL ANALYZER; PARSING METHODS; PIPELINE-BASED MODEL; WORD SEGMENTATION;

COMPUTATIONAL LINGUISTICS;

EID: 84874618096     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/COLI_a_00137     Document Type: Article

References (57)

1. Abeillé, Anne, Lionel Clément, and François Toussenel. 2003. Building a treebank for French. In A. Abeillé, editor. Treebanks: Building and Using Parsed Corpora. Springer, Berlin, pages 165-188.
2. Adler, Meni. 2001. Hidden Markov model for Hebrew part-of-speech tagging. Master's thesis, Ben-Gurion University of the Negev.
3. Adler, Meni. 2007. Hebrew Morphological Disambiguation: An Unsupervised Stochastic Word-based Approach. Ph.D. thesis, Ben-Gurion University of the Negev.
4. Adler, Meni and Michael Elhadad. 2006. An unsupervised morpheme-based HMM for Hebrew morphological disambiguation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 665-672, Sydney.
5. Adler, Meni, Yoav Goldberg, David Gabay, and Michael Elhadad. 2008a. Unsupervised lexicon-based resolution of unknown words for full morphological analysis. In Proceedings of ACL-08: HLT, pages 728-736, Columbus, OH.
6. Adler, Meni, Yael Netzer, David Gabay, Yoav Goldberg, and Michael Elhadad. 2008b. Tagging a Hebrew corpus: The case of participles. In Proceedings of LREC 2008, pages 3167-3174, Marrakech.
7. Attia, Mohammed, Jennifer Foster, Deirdre Hogan, Joseph Le Roux, Lamia Tounsi, and Josef van Genabith. 2010. Handling unknown words in statistical latent-variable parsing models for Arabic, English and French. In Proceedings of the NAACL HLT 2010 First Workshop on Statistical Parsing of Morphologically-Rich Languages, pages 67-75, Los Angeles, CA.
8. Bar-Haim, Roy, Khalil Sima'an, and Yoad Winter. 2005. Choosing an optimal architecture for segmentation and POS-tagging of Modern Hebrew. In Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages, pages 39-46, Ann Arbor, MI.
9. Bar-Haim, Roy, Khalil Sima'an, and Yoad Winter. 2008. Part-of-speech tagging of Modern Hebrew text. Natural Language Engineering, 14(2):223-251.
10. Billott, Sylvie and Bernard Lang. 1989. The structure of shared forests in ambiguous parsing. In Proceedings of the 27th Annual Meeting of the Association for Computational Linguistics, pages 143-151, Vancouver.
11. BGU Computational Linguistics Group. 2008. Hebrew morphological tagging guidelines. Technical report, Ben Gurion University of the Negev.
12. Cai, Shu, David Chiang, and Yoav Goldberg. 2011. Language-independent parsing with empty elements. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 212-216, Portland, OR.
13. Candito, Marie and Benoît Crabbé. 2009. Improving generative statistical parsing with semi-supervised word clustering. In Proceedings of the 11th International Conference on Parsing Technologies (IWPT'09), pages 138-141, Paris.
14. Candito, Marie, Benoît Crabbé, and Djamé Seddah. 2009. On statistical parsing of French with supervised and semi-supervised strategies. In EACL 2009 Workshop Grammatical Inference for Computational Linguistics, pages 49-57, Athens.
15. Chappelier, J., M. Rajman, R. Aragues, and A. Rozenknop. 1999. Lattice parsing for speech recognition. In Sixth Conference sur le Traitement Automatique du Langage Naturel (TANL'99), pages 95-104, Cargése.
16. Charniak, Eugene and Mark Johnson. 2005. Coarse-to-fine n-best parsing and maxent discriminative reranking. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05), pages 173-180, Ann Arbor, MI.
17. Cohen, Shay B. and Noah A. Smith. 2007. Joint morphological and syntactic disambiguation. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 208-217, Prague.
18. Collins, Michael and Terry Koo. 2005. Discriminative reranking for natural language parsing. Computational Linguistics, 31(1):25-69.
19. Crabbé, Benoît and Marie Candito. 2008. Expériences d'analyses syntaxique statistique du français. In Proceedings of TALN, pages 45-54, Avignon.
20. Dantzig, G. B. and P. Wolfe. 1960. Decomposition principle for linear programs. Operations Research, 8:101-111.
21. Falk, Yehuda N. 2001. Lexical-Functional Grammar: An Introduction to Parallel Constraint-Based Syntax. CSLI Publications, Stanford, CA.
22. Glinert, Lewis. 1989. The Grammar of Modern Hebrew. Cambridge University Press.
23. Goldberg, Yoav, Meni Adler, and Michael Elhadad. 2008. EM can find pretty good HMM POS-taggers (when given a good start). In Proceedings of ACL-08: HLT, pages 746-754, Columbus, OH.
24. Goldberg, Yoav and Michael Elhadad. 2011. Joint Hebrew segmentation and parsing using a PCFGLA lattice parser. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 704-709, Portland, OR.
25. Goldberg, Yoav and Reut Tsarfaty. 2008. A single generative model for joint morphological segmentation and syntactic parsing. In Proceedings of ACL-08: HLT, pages 371-379, Columbus, OH.
26. Goldberg, Yoav, Reut Tsarfaty, Meni Adler, and Michael Elhadad. 2009. Enhancing unlexicalized parsing performance using a wide coverage lexicon, fuzzy tag-set mapping, and EM-HMM-based lexical probabilities. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), pages 327-335, Athens.
27. Green, Spence and Christopher D. Manning. 2010. Better Arabic parsing: Baselines, evaluations, and analysis. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pages 394-402, Beijing.
28. Guthmann, Noemie, Yuval Krymolowski, Adi Milea, and Yoad Winter. 2009. Automatic annotation of morpho-syntactic dependencies in a Modern Hebrew Treebank. In Proceedings of the 1st Workshop on Treebanks and Linguistic Theories (TLT), pages 1-12, Groningen.
29. Hall, Keith. 2005. Best-first Word-lattice Parsing: Techniques for Integrated Syntactic Language Modeling. Ph.D. thesis, Brown University.
30. Huang, Zhongqiang and Mary Harper. 2009. Self-training PCFG grammars with latent annotations across languages. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 832-841, Singapore.
31. Itai, Alon and ShulyWintner. 2008. Language resources for Hebrew. Language Resources and Evaluation, 42(1):75-98.
32. Jiang, Wenbin, Liang Huang, and Qun Liu. 2009. Automatic adaptation of annotation standards: Chinese word segmentation and POS tagging-a case study. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 522-530, Suntec.
33. Johnson, Mark. 1998. PCFG models of linguistic tree representations. Computational Linguistics, 24:613-632.
34. Klein, Dan and Christopher D. Manning. 2003. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 423-430, Sapporo.
35. Lang, Bernard. 1974. Deterministic techniques for efficient non-deterministic parsers. In J. Loeckx, editor, Automata, Languages and Programming, volume 14 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg, pages 255-269.
36. Lang, Bernard. 1988. Parsing incomplete sentences. In Proceedings of COLING, pages 365-371, Budapest.
37. Matsuzaki, Takuya, Yusuke Miyao, and Jun'ichi Tsujii. 2005. Probabilistic CFG with latent annotations. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05), pages 75-82, Ann Arbor, MI.
38. Netzer, Yael, Meni Adler, David Gabay, and Michael Elhadad. 2007. Can you tag the modal? You should! In Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources, pages 57-64, Prague.
39. Petrov, Slav. 2009. Coarse-to-Fine Natural Language Processing. Ph.D. thesis, University of California at Berkeley.
40. Petrov, Slav. 2010. Products of random latent variable grammars. In Proceedings of NAACL, pages 19-27, Los Angeles, CA.
41. Petrov, Slav, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 433-440, Sydney.
42. Petrov, Slav and Dan Klein. 2007. Improved inference for unlexicalized parsing. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference, pages 404-411, Rochester, NY.
43. Petrov, Slav and Dan Klein. 2008. Parsing German with latent variable grammars. In Proceedings of the Workshop on Parsing German, pages 33-39, Columbus, OH.
44. Pollard, Carl and Ivan A. Sag. 1994. Head-driven phrase structure grammar. University of Chicago Press.
45. Prescher, Detlef. 2005. Inducing head-driven PCFGs with latent heads: Refining a treebank grammar for parsing. In Proceedings of the European Conference on Machine Learning (ECML), pages 292-304, Porto.
46. Rush, Alexander M, David Sontag, Michael Collins, and Tommi Jaakkola. 2010. On dual decomposition and linear programming relaxations for natural language processing. In Proceedings of EMNLP, pages 1-11, Cambridge, MA.
47. Sima'an, Khalil. 1996. Computational complexity of probabilistic disambiguation by means of tree grammars. In Proceedings of COLING, pages 1175-1180, Copenhagen.
48. Sima'an, Khalil. 1999. Learning Efficient Disambiguation. Ph.D. thesis, ILLC Dissertation Series, University of Amsterdam.
49. Sima'an, Khalil, Alon Itai, Yoad Winter, Alon Altman, and Noa Nativ. 2001. Building a tree-bank of Modern Hebrew text. Traitement Automatique des Langues, 42(2):1-32.
50. Smith, Noah A., David A. Smith, and Roy W. Tromble. 2005. Context-based morphological disambiguation with random fields. In Proceedings of EMNLP, pages 475-482, Vancouver.
51. Tsarfaty, Reut. 2006a. Integrated morphological and syntactic disambiguation for Modern Hebrew. In Proceedings of the COLING/ACL 2006 Student Research Workshop, pages 49-54, Sydney.
52. Tsarfaty, Reut. 2006b. The Interplay of Syntax and Morphology in Building Parsing Models for Modern Hebrew. In Proceedings of ESSLI Student Session, pages 263-274, Malaga.
53. Tsarfaty, Reut. 2010. Relational-Realizational Parsing. Ph.D. thesis, ILLC Dissertation Series, University of Amsterdam.
54. Tsarfaty, Reut and Khalil Sima'an. 2007. Three-dimensional parametrization for parsing morphologically rich languages. In Proceedings of the Tenth International Conference on Parsing Technologies, pages 156-167, Prague.
55. Tsarfaty, Reut and Khalil Sima'an. 2008. Relational-realizational parsing. In Proceedings of CoLING, pages 889-896, Manchester.
56. Tsarfaty, Reut and Khalil Sima'an. 2010. Modeling morphosyntactic agreement in constituency-based parsing of Modern Hebrew. In Proceedings of the NAACL HLT 2010 First Workshop on Statistical Parsing of Morphologically-Rich Languages, pages 40-48, Los Angeles, CA.
57. Tsarfaty, Reut, Khalil Sima'an, and Remko Scha. 2009. An alternative to head-driven approaches for parsing a (relatively) free word-order language. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 842-851, Singapore.