How large a corpus do we need: Statistical method versus rule-based method

Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010

Volumn , Issue , 2010, Pages 1672-1677

  Zhao, Hai ^a,b   Song, Yan ^a   Kit, Chunyu ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH PROCESSING;

CHINESE WORD SEGMENTATION; CORPUS-BASED; INPUT DATAS; INVERSE RELATIONSHIP; RULE-BASED METHOD; SEGMENTATION TECHNIQUES; STATISTICAL LEARNING; TRAINING CORPUS;

COMPUTATIONAL LINGUISTICS;

EID: 84873966124     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Michele Banko and Eric Brill. 2001. Scaling to very very large corpora for natural language disambiguation. In ACL-2001, pages 26-33, Toulouse, France.
2. Gina-Anne Levow. 2006. The third international Chinese language processing bakeoff: Word segmentation and named entity recognition. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, pages 108-117, Sydney, Australia, July 22-23.
3. Fuchun Peng, Fangfang Feng, and Andrew McCallum. 2004. Chinese segmentation and new word detection using conditional random fields. In COLING 2004, pages 562-568, Geneva, Switzerland, August 23-27.
4. Yan Song, Jiaqing Guo, and Dongfeng Cai. 2006. Chinese word segmentation based on an approach of maximum entropy modeling. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, pages 201-204, Sydney, Australia, July.
5. Nianwen Xue. 2003. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing, 8(1):29-48.
6. Hai Zhao and Chunyu Kit. 2008a. Exploiting unlabeled text with different unsupervised segmentation criteria for chinese word segmentation. In Research in Computing Science, Volume 33, pages 93-104.
7. Hai Zhao and Chunyu Kit. 2008b. Unsupervised segmentation helps supervised learning of character tagging for word segmentation and named entity recognition. In The Sixth SIGHAN Workshop on Chinese Language Processing, pages 106-111, Hyderabad, India, January 11-12.
8. Hai Zhao, Chang-Ning Huang, and Mu Li. 2006a. An improved Chinese word segmentation system with conditional random field. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, pages 162-165, Sydney, Australia, July 22-23.
9. Hai Zhao, Chang-Ning Huang, Mu Li, and Bao-Liang Lu. 2006b. Effective tag set selection in Chinese word segmentation via conditional random field modeling. In Proceedings of the 20th Asian Pacific Conference on Language, Information and Computation, pages 87-94, Wuhan, China, November 1-3.
10. George Kingsley Zipf. 1949. Human Behavior and the Principle of Least Effort. Addison-Wesley, Cambridge, MA.