Internet news headlines classification method based on the N-Gram language model

Proceedings - 2012 International Conference on Computer Science and Information Processing, CSIP 2012

Volumn , Issue , 2012, Pages 826-828

  Liu, Xin ^a   Gao, Rujia ^a   Song, Liufu ^a  

^a CHANGCHUN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Frequency statistics; Internet news headlines; N Gram language model; short text classification

Indexed keywords

CLASSIFICATION ALGORITHM; CLASSIFICATION METHODS; CLASSIFICATION MODELS; CLASSIFICATION PERFORMANCE; CLASSIFICATION PROCESS; N-GRAM LANGUAGE MODELS; PREPROCESSING MODULES; TEXT CLASSIFICATION; TRAINING MODULES;

ALGORITHMS; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; COMPUTER SCIENCE; DATA PROCESSING;

INTERNET;

EID: 84868542358     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSIP.2012.6308980     Document Type: Conference Paper

References (13)

1. Xu Yi, Research of text classification algorithm based on short text, Information Security Engineering of Shanghai Jiaotong University, January 2010
2. IL. Wiznieski. Effective text compression with simultanous diagram and trigram encoding. Journal of Information Science, 1987: 581-602
3. M. Damashek. Gauging similarity with n-Grams: languageindependent categorization of text. Science, 1995(267): 843-848
4. Y. Ogawa et al. Overlapping Statistical word indexing: A new indexing method for Japenese text. Proceeding of the 20th ACM SIGIR Conference, 1997: 226-234
5. Yu Jinkai, Wang Yingxue, An improve text feature extraction algorithm Based on N-Gram, Library and Information Service, August 2004.
6. He Hao, Yang Haitang, Approach of chinese Document Automatic Classification Based on the Frequency of N-Gram Chinese, Journal of the China Society for Scientific and Technical Information, 2002, 21 (4): 218 .
7. Liu Yongquan. New progress of China's Computer and natural language processing. Information Science, 1987, 8 (1): 64-70
8. Chai Chunmei, Key technology on the Internet short text message classification, Information Security Engineering of Shanghai Jiaotong University, January 2009
9. Wang Dan, Fan Xinghua Named entity recognition for a short text, Journal of Computer Applications, January 2009.
10. Zhou Qiang, Based on the corpus and statistical natural language processing technology introduced [J], Computer Science, 1995, 22 (4): 36-40. Press, 2002.
11. Zhou Xindong, Wang Ting, Text classification based on N-Gram language model, January 2005, Computer Applications.
12. Wang Xiaojie, Chang Baobao, Natural language processing technology base [M], Beijing University of Posts and Telecommunications Publishing House, 2002.
13. Wang Sheng, Fan Xinghua, Chen Xianlin, Chinese short text classification base on hyponymy relation, Journal of Computer Applications, March 2010