Calculating feature weights in naive Bayes with Kullback-Leibler measure

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2011, Pages 1146-1151

  Lee, Chang Hwan ^a   Gutierrez, Fernando ^b   Dou, Dejing ^b  

^a Dongguk University   (South Korea)

^b UNIVERSITY OF OREGON   (United States)

Author keywords

Classification; Feature weighting; Naive Bayes

Indexed keywords

DATA MINING APPLICATIONS; DATA SETS; EMPIRICAL RESULTS; FEATURE WEIGHT; FEATURE WEIGHTING; KULLBACK-LEIBLER MEASURE; NAIVE BAYES; NAIVE BAYESIAN;

CLASSIFICATION (OF INFORMATION); CLASSIFIERS;

DATA MINING;

EID: 84863137187     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2011.29     Document Type: Conference Paper

References (15)

1. Peter Clark and Robin Boswell. Rule induction with cn2: some recent improvements. In EWSL-91: Proceedings of the European working session on learning on Machine learning, pages 151-163, 1991.
2. Pedro Domingos and Michael Pazzani. On the optimality of the simple bayesian classifier under zero-one loss. Machine Learning, 29(2-3), 1997.
3. Usama M. Fayyad and Keki B. Irani. Multi-interval discretization of continuous-valued attributes for classification learning. In International Joint Conference on Artificial Intelligence, pages 1022-1029, 1993.
4. A. Frank and A. Asuncion. UCI machine learning repository, 2010.
5. Nir Friedman, Dan Geiger, Moises Goldszmidt, G. Provan, P. Langley, and P. Smyth. Bayesian network classifiers. In Machine Learning, pages 131-163, 1997.
6. Thomas Gärtner and Peter A. Flach. Wbcsvm: Weighted bayesian classification based on support vector machines. In ICML '01: Proceedings of the Eighteenth International Conference on Machine Learning, 2001.
7. Mark Hall. A decision tree-based attribute weighting filter for naive bayes. Knowledge-Based Systems, 20(2), 2007.
8. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H. Witten. The weka data mining software. An Update; SIGKDD Explorations, 11(1), 2009.
9. Ron Kohavi. Scaling up the accuracy of naive-bayes classifiers: A decision-tree hybrid. In Second International Conference on Knoledge Discovery and Data Mining, 1996.
10. Ron Kohavi and George H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2):273-324, 1997.
11. S. Kullback and R. A. Leibler. On information and sufficiency. The Annals of Mathematical Statistics, 22(1):79-86, 1951.
12. Pat Langley and Stephanie Sage. Induction of selective bayesian classifiers. In in Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, pages 399-406, 1994.
13. J. Ross Quinlan. C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1993.
14. C. A. Ratanamahatana and D. Gunopulos. Feature selection for the naive bayesian classifier using decision trees. Applied Artificial Intelligence, 17(5-6):475-487, 2003.
15. Dietrich Wettschereck, David W. Aha, and Takao Mohri. A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artificial Intelligence Review, 11:273-314, 1997.