Parsing the internal structure of words: A new paradigm for Chinese word segmentation

ACL-HLT 2011 - Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies

Volumn 1, Issue , 2011, Pages 1405-1414

  Li, Zhongguo ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CHINESE CHARACTERS; CHINESE WORD SEGMENTATION; INTERNAL STRUCTURE; MORPHOLOGICAL ANALYSIS; PENN CHINESE TREEBANK; PHRASE STRUCTURE; PROBABILITY MODELS; WORD STRUCTURES;

COMPUTATIONAL LINGUISTICS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84857305661     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. S. Abney, S. Flickenger, C. Gdaniec, C. Grishman, P. Harrison, D. Hindle, R. Ingria, F. Jelinek, J. Klavans, M. Liberman, M. Marcus, S. Roukos, B. Santorini, and T. Strzalkowski. 1991. Procedure for quantitatively comparing the syntactic coverage of English grammars. In E. Black, editor, Proceedings of the workshop on Speech and Natural Language, HLT '91, pages 306-311, Morristown, NJ, USA. Association for Computational Linguistics.
2. Adam L. Berger, Vincent J. Della Pietra, and Stephen A. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71.
3. Daniel M. Bikel and David Chiang. 2000. Two statistical parsing models applied to the Chinese treebank. In Second Chinese Language Processing Workshop, pages 1-6, Hong Kong, China, October. Association for Computational Linguistics.
4. Eugene Charniak and Mark Johnson. 2005. Coarse-tofine n-best parsing and maxent discriminative reranking. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL '05, pages 173-180, Morristown, NJ, USA. Association for Computational Linguistics.
5. Eugene Charniak. 1997. Statistical parsing with a context-free grammar and word statistics. In Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence, AAAI'97/IAAI'97, pages 598-603. AAAI Press.
6. Michael Collins and Terry Koo. 2005. Discriminative reranking for natural language parsing. Computational Linguistics, 31:25-70, March.
7. Michael Collins. 1999. Head-Driven Statistical Models for Natural Language Parsing. Ph.D. thesis, University of Pennsylvania.
8. Michael Collins. 2003. Head-driven statistical models for natural language parsing. Computational Linguistics, 29(4):589-637. (Pubitemid 39056498)
9. Pascale Fung, Grace Ngai, Yongsheng Yang, and Benfeng Chen. 2004. A maximum-entropy Chinese parser augmented by transformation-based learning. ACM Transactions on Asian Language Information Processing, 3:159-168, June.
10. Jianfeng Gao, Andi Wu, Cheng-Ning Huang, Hong qiao Li, Xinsong Xia, and Hauwei Qin. 2004. Adaptive Chinese word segmentation. In Proceedings of the 42nd Meeting of the Association for Computational Linguistics (ACL'04), Main Volume, pages 462-469, Barcelona, Spain, July.
11. Jianfeng Gao, Mu Li, Andi Wu, and Chang-Ning Huang. 2005. Chinese word segmentation and named entity recognition: A pragmatic approach. Computational Linguistics, 31(4):531-574. (Pubitemid 43677934)
12. Yoav Goldberg and Reut Tsarfaty. 2008. A single generative model for joint morphological segmentation and syntactic parsing. In Proceedings of ACL-08: HLT, pages 371-379, Columbus, Ohio, June. Association for Computational Linguistics.
13. Wenbin Jiang, Liang Huang, Qun Liu, and Yajuan Lü. 2008. A cascaded linear model for joint Chinese word segmentation and part-of-speech tagging. In Proceedings of ACL-08: HLT, pages 897-904, Columbus, Ohio, June. Association for Computational Linguistics.
14. Wenbin Jiang, Liang Huang, and Qun Liu. 2009. Automatic adaptation of annotation standards: Chinese word segmentation and POS tagging - a case study. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 522-530, Suntec, Singapore, August. Association for Computational Linguistics.
15. Canasai Kruengkrai, Kiyotaka Uchimoto, Jun'ichi Kazama, Yiou Wang, Kentaro Torisawa, and Hitoshi Isahara. 2009. An error-driven word-character hybrid model for joint Chinese word segmentation and POS tagging. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Process- ing of the AFNLP, pages 513-521, Suntec, Singapore, August. Association for Computational Linguistics.
16. Zhongguo Li and Maosong Sun. 2009. Punctuation as implicit annotations for Chinese word segmentation. Computational Linguistics, 35:505-512, December.
17. Junhui Li, Guodong Zhou, and Hwee Tou Ng. 2010. Joint syntactic and semantic parsing of Chinese. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 1108- 1117, Uppsala, Sweden, July. Association for Computational Linguistics.
18. Xiaoqiang Luo. 2003. A maximum entropy Chinese character-based parser. In Michael Collins and Mark Steedman, editors, Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pages 192-199.
19. Hwee Tou Ng and Jin Kiat Low. 2004. Chinese part-ofspeech tagging: One-at-a-time or all-at-once? wordbased or character-based? In Dekang Lin and Dekai Wu, editors, Proceedings of EMNLP 2004, pages 277-284, Barcelona, Spain, July. Association for Computational Linguistics.
20. Richard Sproat and Thomas Emerson. 2003. The first international Chinese word segmentation bakeoff. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, pages 133-143, Sapporo, Japan, July. Association for Computational Linguistics.
21. Richard Sproat, William Gale, Chilin Shih, and Nancy Chang. 1996. A stochastic finite-state wordsegmentation algorithm for Chinese. Computational Linguistics, 22(3):377-404. (Pubitemid 126420355)
22. Honglin Sun and Daniel Jurafsky. 2004. Shallow semantc parsing of Chinese. In Daniel Marcu Susan Dumais and Salim Roukos, editors, HLT-NAACL 2004: Main Proceedings, pages 249-256, Boston, Massachusetts, USA, May 2 - May 7. Association for Computational Linguistics.
23. Mengqiu Wang, Kenji Sagae, and Teruko Mitamura. 2006. A fast, accurate deterministic parser for chinese. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 425-432, Sydney, Australia, July. Association for Computational Linguistics.
24. Andi Wu and Jiang Zixin. 1998. Word segmentation in sentence analysis. In Proceedings of the 1998 International Conference on Chinese information processing, Beijing, China.
25. Andi Wu. 2003. Customizable segmentation of morphologically derived words in Chinese. Computational Linguistics and Chinese language processing, 8(1):1-28.
26. Nianwen Xue, Fei Xia, Fu-Dong Chiou, and Martha Palmer. 2005. The Penn Chinese Treebank: phrase structure annotation of a large corpus. Natural Language Engineering, 11(2):207-238. (Pubitemid 40794934)
27. Nianwen Xue. 2003. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing, 8(1):29-48.
28. Yue Zhang and Stephen Clark. 2007. Chinese segmentation with a word-based perceptron algorithm. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 840-847, Prague, Czech Republic, June. Association for Computational Linguistics.
29. Yue Zhang and Stephen Clark. 2008. Joint word segmentation and POS tagging using a single perceptron. In Proceedings of ACL-08: HLT, pages 888-896, Columbus, Ohio, June. Association for Computational Linguistics.
30. Yue Zhang and Stephen Clark. 2009. Transition-based parsing of the Chinese treebank using a global discriminative model. In Proceedings of the 11th International Conference on Parsing Technologies, IWPT '09, pages 162-171, Morristown, NJ, USA. Association for Computational Linguistics.
31. Hai Zhao. 2009. Character-level dependencies in Chinese: Usefulness and learning. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), pages 879-887, Athens, Greece, March. Association for Computational Linguistics.
32. Guodong Zhou and Jian Su. 2003. A Chinese efficient analyser integrating word segmentation, part-ofspeech tagging, partial parsing and full parsing. In Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, pages 78-83, Sapporo, Japan, July. Association for Computational Linguistics.