Naive Bayes text classifiers: A locally weighted learning approach

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 25, Issue 2, 2013, Pages 273-286

  Jiang, Liangxiao ^a   Cai, Zhihua ^a   Zhang, Harry ^b   Wang, Dianhong ^a  

^a CHINA UNIVERSITY OF GEOSCIENCES   (China)

^b UNIVERSITY OF NEW BRUNSWICK   (Canada)

Author keywords

complement naive Bayes; locally weighted learning; multinomial naive Bayes; naive Bayes; text classification; the one versus all but one model

Indexed keywords

CLASSIFICATION PERFORMANCE; CONDITIONAL INDEPENDENCE ASSUMPTION; CONDITIONAL INDEPENDENCES; LOCALLY WEIGHTED LEARNING; MULTINOMIAL NAIVE BAYES; NAIVE BAYES; NAIVE BAYES TEXT CLASSIFIER; TEXT CLASSIFICATION;

BENCHMARKING; CLASSIFICATION (OF INFORMATION); TEXT PROCESSING;

CLASSIFIERS;

EID: 84877669890     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/0952813X.2012.721010     Document Type: Article

References (31)

1. Atkeson, CG, and, Moore, AW. 1997. Locally Weighted Learning. Artificial Intelligence Review, 11: 11-73.
2. Berger, A. 1999. Error-correcting Output Coding for Text Classification. in Proceedings of IJCAI-99 Workshop on Machine Learning for Information Filtering,. Stockholm, Sweden
3. Domingos, P, and, Pazzani, M. 1997. On the Optimality of the Simple Bayesian Classifier Under Zero-One Loss. Machine Learning, 29: 103-130.
4. Duda, RO, and, Hart, PE. 1973. Pattern classification and scene analysis, New York, NY: Wiley and Sons.
5. Forman, G. 2003. An Extensive Empirical Study of Feature Selection Metrics for Text Classification. Journal of Machine Learning Research, 3: 1289-1305.
6. Frank, E., Hall, M., and Pfahringer, B. (2003), Locally Weighted Naive Bayes, in Proceedings of the Conference on Uncertainty in Artificial Intelligence, San Mateo, CA: Morgan Kaufmann, pp. 249-256
7. Friedman, N, Geiger, D, and, Goldszmidt, M. 1997. Bayesian Network Classifiers. Machine Learning, 29: 131-163.
8. Han, E., and Karypis, G. (2000), Centroid-based Document Classification: Analysis and Experimental Results, in Proceedings of the 4th European Conference on the Principles of Data Mining and Knowledge Discovery, Berlin: Springer Press, pp. 424-431
9. Jiang, L. 2011. Random One-dependence Estimators. Pattern Recognition Letters, 32: 532-539.
10. Jiang, L, Li, C, and, Cai, Z. 2009. Decision Tree with Better Class Probability Estimation. International Journal of Pattern Recognition and Artificial Intelligence, 23: 745-763.
11. Jiang, L, Wang, D, and, Cai, Z. 2012. Discriminatively Weighted Naive Bayes and its Application in Text Classification. International Journal on Artificial Intelligence Tools, 21: 1250007-1-1250007-19.
12. Keerthi, SS, Shevade, SK, Bhattacharyya, C, and, Murthy, KRK. 2001. Improvements to Platt's Smoalgorithm for Svm Classifier Design. Neural Computation, 13: 637-649.
13. Kohavi, R. (1996), Scaling up the Accuracy of Naive-Bayes Classifiers: A Decision-tree Hybrid, in Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, Palo Alto, CA: AAAI Press, pp. 202-207
14. Koller, D., and Sahami, M. (1997), Hierarchically Classifying Documents Using Very Few Words, in Proceedings of the Fourteenth International Conference on Machine Learning, San Mateo, CA: Morgan Kaufmann, pp. 170-178
15. Langley, P., Iba, W., and Thomas, K. (1992), An Analysis of Bayesian Classifiers, in Proceedings of the Tenth National Conference of Artificial Intelligence, Palo Alto, CA: AAAI Press, pp. 223-228
16. Li, C, and, Li, H. 2011. One Dependence Value Difference Metric. Knowledge-Based Systems, 24: 589-594.
17. Li, C, and, Li, H. 2012. A Modified Short and Fukunaga Metric Based on the Attribute Independence Assumption. Pattern Recognition Letters, 33: 1213-1218.
18. McCallum, A, and, Nigam, K. 1998. " A Comparison of Event Models for Naive Bayes Text Classification ". In in Working Notes of the AAAI/ICML Workshop on Learning for Text, 41-48. Palo Alto, CA: AAAI Press.
19. Mitchell, TM. 1997. Machine Learning, 1st, New York: McGraw-Hill.
20. Nadeau, C, and, Bengio, Y. 2003. Inference for the Generalisation Error. Machine Learning, 52: 239-281.
21. Nigam, K., McCallum, A., Thrun, S., and Mitchell, T. (1998), Learning to Classify Text From Labeled and Unlabeled Documents, in Proceedings of the Fifteenth National Conference of Artificial Intelligence, Palo Alto, CA: AAAI Press, pp. 792-799
22. Pearl, J. 1988. Probabilistic Reasoning in Intelligent Systems, San Francisco, CA: Morgan Kaufmann.
23. Platt, J. 1998. " Fast training of support vector machines using sequential minimal optimization ". In Advances in Kernel Methods-Support Vector Learning, Edited by: Schoelkopf, B., Burges, C. and Smola, A. 185-208. Cambridge, MA: MIT Press.
24. Quinlan, JR. 1993. C4.5: Programs for Machine Learning, 1st, San Mateo, CA: Morgan Kaufmann.
25. Rennie, J.D., Shih, L., Teevan, J., and Karger, D.R. (2003), Tackling the Poor Assumptions of Naive Bayes Text Classifiers, in Proceedings of the Twentieth International Conference on Machine Learning, San Mateo, CA: Morgan Kaufmann, pp. 616-623
26. Sahami, M. (1996), Learning Limited Dependence Bayesian Classifiers, in Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, Palo Alto, CA: AAAI Press, pp. 335-338
27. Su, J., and Zhang, H. (2006), A Fast Decision Tree Learning Algorithm, in Proceedings of the Twenty-First National Conference on Artificial Intelligence, Palo Alto, CA: AAAI Press, pp. 500-505
28. Tan, PN, Steinbach, M, and, Kumar, V. 2006. Introduction to data mining, 1st, Boston, MA: Pearson.
29. Witten, IH, and, Frank, E. 2005. Data Mining: Practical Machine Learning Tools and Techniques, 2nd, San Francisco, CA: Morgan Kaufmann.
30. Zhang, H. 2005. Exploring Conditions for the Optimality of Naive Bayes. International Journal of Pattern Recognition and Artificial Intelligence, 19: 183-198.
31. Zhang, T, and, Oles, FJ. 2001. Text Categorization Based on Regularized Linear Classification Methods. Information Retrieval, 4: 5-31.