An improved K-nearest-neighbor algorithm for text categorization

Expert Systems with Applications

Volumn 39, Issue 1, 2012, Pages 1503-1509

  Jiang, Shengyi ^a   Pang, Guansong ^a   Wu, Meiling ^a   Kuang, Limin ^a  

^a GUANGDONG UNIVERSITY OF FOREIGN STUDIES   (China)

Author keywords

KNN text categorization; One pass clustering; Spam filtering; Text categorization

Indexed keywords

CLASSIFICATION METHODS; CLASSIFICATION MODELS; EMPIRICAL RESULTS; K NEAREST NEIGHBOR ALGORITHM; K-NN ALGORITHM; ONE-PASS; SPAM FILTERING; TEXT CATEGORIZATION; TEXT CATEGORIZATION ALGORITHMS; TEXT DATA; TEXT SIMILARITY;

SUPPORT VECTOR MACHINES; TEXT PROCESSING;

CLUSTERING ALGORITHMS;

EID: 81855164825     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.08.040     Document Type: Article

References (31)

1. Z.A. Aghbari Array-index: A plug & search K nearest neighbor's method for high-dimensional data Data & Knowledge Engineering 52 3 2005 33 352
2. Androutsopoulos, I.; Koutsias, J.; & Chandrinos, K. V. (2000a). An evaluation of Naive Bayesian anti-spam filtering. In Proceedings of the Workshop on Machine Learning in the New Information Age, 11th European Conference on Machine Learning, Barcelona (pp. 9-17).
3. Androutsopoulos, I.; Paliouras, G.; & Karkaletsis V. (2000b). Learning to Filter Spam E-Mail: A Comparison of a Naive Bayesian and a Memory-Based Approach. In Proceedings of the Workshop on Machine Learning and Textual Information Access (pp. 1-13).
4. Chidanand. Apte, Fred. Damerau, M. Sholom, and Weiss Automated learning of decision rules for text categorization ACM Transactions on Information Systems (TOIS) 12 3 1994 233 251
5. E. Blanzieri, and A. Bryl A survey of learning-based techniques of email spam filtering Artificial Intelligence Review 29 1 2008 63 92
6. R.C. Chen, and C.H. Hsieh Web page classification based on a support vector machine using a weighted vote schema Expert Systems with Applications 31 2 2006 427 435
7. A. Esuli, T. Fagni, and F. Sebastiani Boosting multi-label hierarchical text categorization Information Retrieval 11 4 2008 287 313
8. Eibe Frank, and R. Bouckaert Naive Bayes for text classification with unbalanced classes Knowledge Discovery in Databases 2006 503 510
9. G. Guo, H. Wang, and D. Bell kNN model-based approach and its application in text categorization Computational Linguistics and Intelligent Text Processing, LNCS 2945 2004 559 570
10. P.Y. Hao, J.H. Chiang, and Y.K. Tu SVM classification based on support vector clustering method and its application to document categorization Expert Systems with Applications 33 3 2007 627 635
11. Xiulan. Hao, Xiaopeng. Tao, and Hexiang. Xu A strategy to class imbalance problem for kNN text classifier Journal of Computer Research and Development 46 1 2009 52 61
12. A.K. Jain, M.N. Murty, and P.J. Flynn Data clustering: A review ACM Computing Surveys 31 3 1999 264 323
13. Jiang ShengYi.; (2006). Efficient Classification Method for Large Dataset. In Proceedings of the Fifth International Conference on Machine Learning and Cybernetics, Dalian (pp. 1190-1194).
14. ShengYi Jiang, Xiaoyu Song, and Wang Hui A clustering-based method for unsupervised intrusion detections Pattern Recognition Letters 27 5 2006 802 810
15. Kohavi, R. (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, Morgan Kaufmann (pp. 1137-1143).
16. I. Koprinska, J. Poon, and J. Clark Learning to Classify E-Mail Information Sciences 177 2007 2167 2187
17. Lewis, D. D.; Schapire, R. E.; & Callan, J. P. (1996). Training algorithms for linear text classifiers. In Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 298-306).
18. RongLu Li, and YunFa Hu A density-based method for reducing the amount of training data in kNN text classification Journal of Computer Research and Development 41 4 2004 539 545
19. J. Rocchio Relevance feedback in information retrieval The SMART System 1971 67 88
20. M.E. Ruiz, and P. Srinivasan Hierarchical text categorization using neural networks Information Retrieval 5 1 2002 87 118
21. Sakkis, G.; Androutsopoulos, I.; & Paliouras, G. (2001). Stacking Classifiers for Anti-spam Filtering of E-mail, In Proceedings of the 6th Conference on Empirical Methods in Natural Language Processing (pp. 44-50).
22. G. Salton, A. Wong, and C.S. Yang A vector space model for automatic indexing Communications of the ACM 18 11 1975 613 620
23. G. Salton, and C. Buckley Term-weighting approaches in automatic text retrieval Information Processing and Management 24 5 1988 513 523
24. F. Sebastiani Machine learning in automated text categorization ACM Computing Surveys 34 1 2002 1 47
25. JinShu Su, BoFeng Zhang, and Xin Xu Advances in machine learning based text categoriza-tion Journal of Software 17 9 2006 1848 1859
26. S. Tan Neighbor-weighted k-nearest neighbor for unbalanced text corpus Expert Systems with Applications 28 4 2005 667 671
27. S. Tan An improved centroid classifier for text categorization Expert Systems with Applications 35 1 2008 279 285
28. Vries, A. d.; Mamoulis, N.; & Nes, N. (2002). Efficient k-NN search on vertically decomposed data. In Proceedings of the 2002 ACM SIGMOD international conference on Management of data, Madison, WI, USA (pp. 322-333).
29. Wang Yu.; & Wang ZhengOu. (2007). A Fast KNN Algorithm for text categorization. In Proceedings of the 6th International Conference on Machine Learning and Cybernetics, Hong Kong (pp. 3436-3441).
30. Yang, Y.; & Liu, X. (1999). A re-examination of text categorization methods. In Proceedings 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-99), Berkeley (pp. 42-49).
31. Q. Ye, Z. Zhang, and Rob. Law Sentiment classification of online reviews to travel destinations by supervised machine learning approaches Expert Systems with Applications 36 3 2009 6527 6535