Using chi-square statistics to measure similarities for text categorization

Expert Systems with Applications

Volumn 38, Issue 4, 2011, Pages 3085-3090

  Chen, Yao Tsung ^a   Chen, Meng Chang ^b  

^a NATIONAL PENGHU UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

^b INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

Author keywords

Machine learning; Nonparametric statistics; Text mining

Indexed keywords

CHI-SQUARE STATISTICS; CHI-SQUARE TESTS; COSINE SIMILARITY; MACHINE-LEARNING; MISS-RATE; NON-PARAMETRIC STATISTICS; OPTIMAL THRESHOLD; RANDOM SAMPLE; TEXT CATEGORIZATION; TEXT MINING; THEORETICAL PERFORMANCE;

LEARNING SYSTEMS; STATISTICS; TEXT PROCESSING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 78650694104     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.08.100     Document Type: Article

References (21)

1. J. Allan, J. Carbonell, G. Doddington, J. Yamron, and Y. Yang Topic detection and tracking pilot study: Final report Darpa Proceedings of the DARPA broadcast news transcription and understanding workshop 1998 Morgan Kaufmann 194 218
2. Y. Bi, D. Bell, H. Wang, G. Guo, and K. Greer Combining multiple classifiers using Dempster's rule of combination for text categorization V. Torra, Y. Narukawa, Proceedings of the 1st international conference on modelling decisions for artificial intelligence (MDAI'04) 2004 Springer 127 138 (Pubitemid 39080790)
3. 2-test for text categorization. In T. Nishida, Z. Shi, U. Visser, X. Wu, J. Liu, B. Wah, et al. (Eds.) Proceeding of the 2006 IEEE/WIC/ACM international conference on web intelligence (WI'06) (pp. 305-308). IEEE.
4. H. Fang, T. Tao, and C.X. Zhai A formal study of information retrieval heuristics K. Järvelin, M. Sanderson, P. Bruza, J. Allan, Proceedings of the 27th ACM SIGIR conference on research and development in information retrieval (SIGIR'04) 2004 ACM 49 56
5. C. Fellbaum, WordNet: An electronic lexical database 1998 MIT Press Cambridge, MA
6. C. Fox Lexical analysis and stop lists W. Frakes, R. Baeza-Yates, Information retrieval: Data structures and algorithms 1992 Prentice-Hall NJ 102 130
7. P.E. Greenwood, and M.S. Nikulin A guide to chi-squared testing 1996 John Wiley & Sons New York
8. B. He, T. Tao, and K.C.-C. Chang Organizing structured web sources by query schemas: A clustering approach D.A. Evans, L. Gravano, O. Herzog, C.X. Zhai, M. Ronthaler, Proceedings of the 13th conference on information and knowledge management (CIKM'04) 2004 ACM 22 31 (Pubitemid 40673420)
9. H.O. Lancaster The chi-squared distribution 1969 John Wiley & Sons New York
10. Lewis, D. D. (1992). Representation and learning in information retrieval. Ph.D. Thesis. Amherst, MA: Computer Science Dept.; Univ. of Massachusetts.
11. R. Nallapati Discriminative models for information retrieval M. Sanderson, K. Järvelin, J. Allan, P. Bruza, Proceedings of the 27th ACM SIGIR conference on research and development in information retrieval (SIGIR'04) 2004 ACM 64 71
12. K. Pearson On a criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling Philosophy Magazine 50 5 1900 157 175
13. M.F. Porter An algorithm for suffix stripping Program 14 3 1980 130 137
14. S. Robertson, and S. Walker Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval W.B. Croft, C.J. van Rijsbergen, Proceedings of the 17th ACM SIGIR conference on research and development in information retrieval (SIGIR'94) 1994 ACM 232 241
15. S. Robertson, and S. Walker On relevance weights with little relevance information F. Can, E. Voorhees, N.J. Belkin, A.D. Narasimhalu, P. Willett, W. Hersh, Proceedings of the 20th ACM SIGIR conference on research and development in information retrieval (SIGIR'97) 1997 ACM
16. A. Singhal Modern information retrieval: A brief overview Bulletin of the IEEE Computer Society Technical Committee on Data Engineering 24 4 2001 35 43
17. Y. Yang A study on thresholding strategies for text categorization D.H. Kraft, W.B. Croft, D.J. Harper, J. Zobel, Proceedings of the 24th ACM SIGIR conference on research and development in information retrieval (SIGIR'01) 2001 ACM 137 145
18. Y. Yang, T. Ault, T. Pierce, and C.W. Lattimer Improving text categorization methods for event tracking N.J. Belkin, P. Ingwersen, M.-K. Leong, Proceedings of the 23rd ACM SIGIR conference on research and development in information retrieval (SIGIR'00) 2000 ACM 65 72
19. Y. Yang, and X. Liu A re-examination of text categorization methods F. Gey, M. Hearst, R. Tong, Proceedings of the 22nd ACM SIGIR conference on research and development in information retrieval (SIGIR'99) 1999 ACM 42 49
20. Y. Yang, and J.O. Pedersen A comparative study on feature selection in text categorization D.H. Fisher, Proceeding of the 14th international conference of machine learning (ICML'97) 1997 Morgan Kaufmann 412 420
21. C. Zhai, and J. Lafferty A study of smoothing methods for language models applied to ad hoc information retrieval D.H. Kraft, W.B. Croft, D.J. Harper, & J. Zobel, Proceedings of the 24th ACM SIGIR conference on research and development in information retrieval (SIGIR'01) 2001 ACM 334 340