Chinese web page classification based on statistical word segmentation

Proceedings of the IEEE International Conference on Systems, Man and Cybernetics

Volumn 1, Issue , 2002, Pages 616-620

  Ke, Huang ^a   Shaoping, Ma ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Computer network; Machine learning; Statistical word segmentation; Text categorization

Indexed keywords

CLASSIFICATION (OF INFORMATION); LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; STATISTICAL METHODS;

WORD SEGMENTATION;

WORLD WIDE WEB;

EID: 0038344771     PISSN: 08843627     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Aito Chen, Jianzhang He, Liangjie Xu, Fredric C. Gey, Jason Meggs. Chinese Text Retrieval Without Using a Dictionary. SIGIR '97: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, P42-49, 1997.
2. Cheng, Kwok-Shing, Gilbert H. Young, and Kam-Fai Wong. A study on word-based and integral-bit Chinese text compression algorithms. Journal of the American Society for Information Science, 50(3):218- 228, 1999.
3. China Internet Network Information Center. http://www.cnnic.net.cn.
4. Fuchun Peng, Dale Schuurmans. Self-supervised Chinese Word Segmentation. Proceedings of the 4th International Symposium of Intelligent Data Analysis, P238-247, 2001.
5. Jian-Yun Nie, Jiangfeng Gao, Jian Zhang, Ming Zhou. On the Use of Words and N-grams for Chinese Information Retrieval. http://www.iro.umontreal.ca/̃nie/Publication/IRAL200 0.ps,2000.
6. Palmer, D. and Burger, J. Chinese Word Segmentation and Information Retrieval. AAAI Spring Symposium on Cross-Language Text and Speech Retrieval, Electronic Working Notes, 1997.
7. Salton, Gerard. Introduction to modern information retrieval. Auckland: McGraw-Hill, 1983.
8. Sina Website. http://www.sina.com.cn.
9. Wang Huan, Chang Baoru. Frequency Dictionary of Modern Chinese. Beijing Institute of Language Press, 1986.
10. W.J.Teahan. Test Classification and Segmentation Using Minimum Cross-entropy. International Conference on Content-Based Multimedia Information Access (RIAO, pages 943-961), 2000.
11. Wu Zimin and Gwyneth Tseng. Chinese text segmentation for text retrieval: achievements and problems. JASIS, 44(9):532-542, 1993.
12. Xianping Ge, Wanda Pratt, Padhraic Smyth. Discovering Chinese Words from Unsegmented Text. SIGIR'99, P271-272, 1999.
13. Yang, Y., Pedersen, J.O.. A Comparative Study on Feature Selection in Text Categorization. Proc. of the 14th International Conference on Machine Learning ICML97, pp. 412-420, 1997.
14. Yiming Yang. An Evaluation of Statistical Approaches to Text Categorization. Journal of Information Retrieval, Vol 1, No. 1/2, pp 67-88, 1999.
15. Yin Jianping. Automatic Word Segmentation Methods for the Chinese Language. Computer Engineering and Science, Vol20, NO.3, pp60-66, 1998(Chinese).