An information-theoretic filter method for feature weighting in naive bayes

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 28, Issue 5, 2014, Pages

  Lee, Chang Hwan ^a  

^a Dongguk University   (South Korea)

Author keywords

classification; Data mining; feature weighting; naive Bayes

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING;

DATA MINING APPLICATIONS; FEATURE WEIGHTING; FILTER METHOD; KULLBACK-LEIBLER MEASURE; NAIVE BAYES; NAIVE BAYESIAN; STATE-OF-THE-ART METHODS;

CLASSIFIERS;

EID: 84905459963     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001414510070     Document Type: Article

References (20)

1. C. G. Atkeson, A. W. Moore and S. Schaal, Locally weighted learning, Artif. Intell. Rev. 11 (1997) 11-73.
2. L. Breiman, Random forests, Mach. Learn. 45 (2001) 5-32.
3. P. Domingos and M. Pazzani, On the optimality of the simple bayesian classifier under zero-one loss, Mach. Learn. 29 (1997) 103-130.
4. U. M. Fayyad and K. B. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, Int. Joint Conf. Artificial Intelligence (1993), pp. 1022-1029.
5. A. Frank and A. Asuncion, UCI machine learning repository (2010).
6. N. Friedman, D. Geiger, M. Goldszmidt, G. Provan, P. Langley and P. Smyth, Bayesian network classifiers, Mach. Learn. (1997) 131-163.
7. T. Gärtner and P. A. Flach, Wbcsvm: Weighted bayesian classification based on support vector machines, ICML '01: Proc. Eighteenth Int. Conf. Machine Learning (2001), pp. 154-161.
8. M. Hall, A decision tree-based attribute weighting filter for naive bayes, Knowl.-Based Syst. 20 (2007) 120-126.
9. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann and I. H. Witten, The weka data mining software, An Update, SIGKDD Explorations 11 (2009) 10-18.
10. H. He and E. A. Garcia, Learning from imbalanced data, IEEE Trans. Knowl. Data Eng. 21 (2009) 1263-1284.
11. R. Kohavi, Scaling up the accuracy of naive-bayes classifiers: A decision-tree hybrid, Second Int. Conf. Knoledge Discovery and Data Mining (1996), pp. 202-207.
12. R. Kohavi and G. H. John, Wrappers for feature subset selection, Artif. Intell. 97 (1997) 273-324.
13. A. Kolcz and A. Chowdhury, Improved naive Bayes for extremely skewed misclassification costs, PKDD (2005), pp. 561-568.
14. S. Kullback and R. A. Leibler, On information and sufficiency, Ann. Math. Stat. 22 (1951) 79-86.
15. P. Langley and S. Sage, Induction of selective bayesian classifiers, in Proc. Tenth Conf. Uncertainty in Artificial Intelligence (1994), pp. 399-406.
16. C.-H. Lee, F. Gutierrez and D. Dou, Calculating feature weights in naive Bayes with kullback-leibler measure, 11th IEEE Int. Conf. Data Mining (2011), pp. 1146-1151.
17. J. R. Quinlan, C4.5: Programs for Machine Learning (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1993).
18. A. Quinten and W. Raaijmakers, Effectiveness of different missing data treatments in surveys with likert-type data: Introducing the relative mean substitution approach, Edu. Psychol. Meas. 49 (1999) 725-748.
19. D. Wettschereck, D. W. Aha and T. Mohri, A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms, Artificial Intell. Rev. 11 (1997) 273-314.
20. H. Zhang and S. Sheng, Learning weighted naive bayes with accurate ranking, ICDM '04: Proc. Fourth IEEE Int. Conf. Data Mining (2004), pp. 567-570.