Exploiting probabilistic topic models to improve text categorization under class imbalance

Information Processing and Management

Volumn 47, Issue 2, 2011, Pages 202-214

  Chen, Enhong ^a   Lin, Yanggang ^a   Xiong, Hui ^b   Luo, Qiming ^a   Ma, Haiping ^a  

^a Hefei University of Technology   (China)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

Class imbalance; Noisy data; Probabilistic topic model; Rare class analysis; Text categorization

Indexed keywords

CLASS IMBALANCE; NOISY DATA; PROBABILISTIC TOPIC MODEL; RARE CLASS; TEXT CATEGORIZATION;

INFORMATION DISSEMINATION; SEMANTICS; TEXT PROCESSING;

MODELS;

EID: 79951944700     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2010.07.003     Document Type: Article

References (29)

1. G.E.A.P.A. Batista, R.C. Prati, and M.C. Monard A study of the behavior of several methods for balancing machine learning training data SIGKDD Explorations Newsletter 6 1 2004 20 29
2. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent dirichlet allocation The Journal of Machine Learning Research 3 2003 993 1022
3. Brank, J.; Grobelnik, M. (2003). Training text classifiers with SVM on very few positive examples. Tech. Rep. MSR-TR-2003-34, Microsoft Research, Redmond.
4. G. Casella, and E.I. George Explaining the Gibbs sampler The American Statistician 46 3 1992 167 174
5. Chang, C.-C.; Lin, C.-J. (2001). LIBSVM: A library for support vector machines. < http://www.csie.ntu.edu.tw/cjlin/libsvm >.
6. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer Smote: Synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 321 357 (Pubitemid 43057176)
7. N. Cristianini, and J. Shawe-Taylor An introduction to support vector machines and other Kernel-based learning methods 2000 Cambridge University Press
8. M. DeGroot, and M. Schervish Probability and statistics 3rd ed. 2001 Addison Wesley
9. T.L. Griffiths, and M. Steyvers Finding scientific topics Proceedings of the National Academy of Sciences of the United States of America 101 Suppl. 1 2004 5228 5235 (Pubitemid 38469131)
10. Han, E.-H.; Boley, D.; Gini, M.; Gross, R.; Hastings, K.; Karypis, G.; et al. (1998). Webace: A web agent for document categorization and exploration. In AGENTS '98 (pp. 408-415).
11. P.E. Hart The condensed nearest neighbor rule IEEE Transactions on Information Theory IT-14 1968 515 516
12. Japkowicz, N. (2000). The class imbalance problem: Significance and strategies. In IC-AI'2000 (Vol. 1, pp. 111-117).
13. N. Japkowicz, and S. Stephen The class imbalance problem: A systematic study Intelligent Data Analysis 6 5 2002 429 449
14. O. Maimon, L. Rokach, The data mining and knowledge discovery handbook 2005 Springer
15. Y. Ko, and J. Seo Text classification from unlabeled documents with bootstrapping and feature projection techniques Information Processing and Management 45 1 2009 70 83
16. Kubat, M.; Matwin, S. (1997). Addressing the curse of imbalanced training sets: One-sided selection. In ICML 1997 (pp. 179-186).
17. Laurikkala, J. (2001). Improving identification of difficult small classes by balancing class distribution. Tech. Rep. A-2001-2, University of Tampere.
18. D.D. Lewis, Y. Yang, T.G. Rose, and F. Li Rcv1: A new benchmark collection for text categorization research Journal of Machine Learning Research 5 2004 361 397
19. F. Paradis, and J.-Y. Nie Contextual feature selection for text classification Information Processing and Management 43 2 2007 344 352 (special issue on AIRS2005: Information Retrieval Research in Asia) (Pubitemid 44646716)
20. F. Sebastiani Machine learning in automated text categorization ACM Computing Surveys 34 1 2002 1 47
21. Steyvers, M.; Griffiths, T. (2007). Probabilistic topic models. In Handbook of latent semantic analysis.
22. S. Tan Neighbor-weighted k-nearest neighbor for unbalanced text corpus Expert Systems with Applications 28 4 2005 667 671 (Pubitemid 40583844)
23. P.-N. Tan, M. Steinbach, and V. Kumar Introduction to data mining 2005 Addison Wesley
24. I. Tomek Two modifications of cnn IEEE Transactions on Systems Man and Cybernetics 769 1976 772
25. D.L. Wilson Asymptotic properties of nearest neighbor rules using edited data IEEE Transactions on Systems, Man and Cybernetics 2 3 1972 408 421
26. Wu, J.; Xiong, H.; Wu, P.; Chen, J. (2007). Local decomposition for rare class analysis. In KDD '07 (pp. 814-823). (Pubitemid 350229267)
27. Yang, Y.; Liu, X. (1999). A re-examination of text categorization methods. In SIGIR '99 (pp. 42-49).
28. Z. Zheng, X. Wu, and R. Srihari Feature selection for text categorization on imbalanced data SIGKDD Explorations Newsletter 6 1 2004 80 89
29. X. Zhu, and X. Wu Class noise vs. attribute noise: A quantitative study Artificial Intelligence Review 22 3 2004 177 210