Automatic identification of stop words in chinese text classification

Proceedings - International Conference on Computer Science and Software Engineering, CSSE 2008

Volumn 1, Issue , 2008, Pages 718-722

  Hao, Lili ^a   Hao, Lizhu ^b  

^a JILIN UNIVERSITY   (China)

^b NORTHEAST NORMAL UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC IDENTIFICATIONS; CHI-SQUARED; CHINESE CORPORA; CHINESE TEXT CLASSIFICATIONS; CONTINGENCY TABLES; ENGLISH LANGUAGES; FUNDAMENTAL TOOLS; NATURAL LANGUAGE PROCESSING; PRE-PROCESSING; REAL-WORLD; RESEARCH AREAS; SPEED-UP; STATISTICAL CORRELATIONS; STOP WORDS; TEXT CLASSIFICATIONS;

AUTOMATION; COMPUTATIONAL LINGUISTICS; COMPUTERS; ELECTRONIC DATA INTERCHANGE; INDUSTRIAL RESEARCH; INFORMATION SERVICES; NATURAL LANGUAGE PROCESSING SYSTEMS; SOFTWARE ENGINEERING;

TEXT PROCESSING;

EID: 61949113526     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSSE.2008.829     Document Type: Conference Paper

References (15)

1. P. S. Mark, and W. C. David. Evolving better stoplists for document clustering and web intelligence. Proceedings of the 7th WSEAS Int'l Conf. on Artificial Intelligence, 1015-1023, 2003.
2. G. W. Hart. To decode short cryptograms. Communications of the ACM, New York: Association for Computing Machinery, 37(9): 102-108, 1994.
3. C. J. Van Rijsbergen. Information retrieval. London: Butter-worths, 1979.
4. C. Silva, and B. Ribeiro. The importance of stop word removal on recall values in text categorization. Neural Networks, 320-24, 2003
5. C. Fox. Lexical analysis and stoplists. Information Retrieval: Data Structures and Algorithms, Upper Saddle River, New Jersey: Prentice Hall, 102-130, 1992.
6. Y. M. Yang. Noise Reduction in a Statistical Approach to Text Categorization. In Proceedings of the 18th ACM International Conference on Research and Development in Information Retrieval (SIGIR'95), 256-263, 1995.
7. R. Lo, B. He, and I. Ounis. Automatically Building a Stopword List for an Information Retrieval System. Proceedings of the 5th Dutch-belgian Information Retrieval Workshop, Utrecht, the Netherlands, 141-148, 2005.
8. M. P. Sinka, and D. W. Corne. Web intelligence WI 2003. Proceedings IEEE/WIC International Conference on Soc. Los Alamitos: IEEE Comput, 396-402, 2003.
9. K. H. Chen, and H. H. Chen. Cross-Language Chinese Text Retrieval in NTCIR Workshop: towards Cross-Language multilingual Text Retrieval. ACM SIGIR Forum, 35(2): 12-19, 2001.
10. H. Nakagawa, H. A. Kojima, and Maeda. Chinese term extraction from web pages based on compound word productivity. IJCNLP, 269-279, 2005.
11. F. Zou, F. L. Wang, X. S. Deng, Han, and L. Wang. Stop Word List Construction and Application in Chinese Language Processing. WSEAS Transanction on Information Science and Applications, 3(6): 1036-1045, 2006.
12. Alan Agresti. Categorical Data Analysis. John Wiley and Sons, Inc., Hoboken, New Jersey, 2002.
13. K. Nigam, A. McCallum, S. Thrun, and T. Mitchell. Text Classification from Labeled and Unlabeled Documents using EM. Machine Learning, 39(2/3): 103-134, 2000.
14. P. Langley, W. Iba, and K. Thompson. An Analysis of Bayesian Classifiers. Proc. of the 10th National Conf. on Artificial Intelligence, Menlo Park, AAAI Press, 223-228, 1992.
15. Y. Yang. An evaluation of statistical approaches to text categorization. Information Retrieval, 1(1): 76-88, 1999.