A decision tree-based attribute weighting filter for naive Bayes

Knowledge-Based Systems

Volumn 20, Issue 2, 2007, Pages 120-126

  Hall, Mark ^a  

^a UNIVERSITY OF WAIKATO   (New Zealand)

Author keywords

Attribute weighting; Bayesian learning; Machine learning

Indexed keywords

COMPUTATIONAL COMPLEXITY; LEARNING ALGORITHMS; LINEAR SYSTEMS; MATHEMATICAL MODELS;

ATTRIBUTE WEIGHTING; BAYESIAN LEARNING; EXECUTION TIME;

DATA MINING;

EID: 33847166276     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2006.11.008     Document Type: Article

References (28)

1. Aha D.W. Tolerating noisy, irrelevant, and novel attributes in instance-based learning algorithms. Int. J. Man Mach. Stud. 36 (1992) 267-287
2. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, University of California, Irvine, Department of Information and Computer Science, 1998. Available from: www.ics.uci.edu/∼mlearn/MLRepository.html.
3. Cardie C., and Howe N. Improving minority class prediction using case-specific feature weights. Proceedings of the 14th International Conference on Machine Learning (1997), Morgan Kaufmann 57-65
4. Cardie C. Using decision trees to improve case-based learning. Proceedings of the 10th International Conference on Machine Learning (1993), Morgan Kaufman 25-32
5. Creecy R.H., Masand B.M., Smith S.J., and Waltz D.L. Trading MIPS and memory for knowledge engineering. Communications of the ACM 35 (1992) 48-64
6. Domingos P., and Pazzani M.J. On the optimality of the simple Bayesian classifier under zero-one loss. Mach. Learn. 29 2-3 (1997) 103-130
7. Domingos P. Context-sensitive feature selection for lazy learners. Artif. Intell. Rev. 11 227-253 (1997)
8. Fayyad U.M., and Irani K.B. Multi-interval discretization of continuous-valued attributes for classification learning. Proceedings of the 13th International Joint Conference on AI (1993), Morgan Kaufman 1022-1027
9. Ferreira J.T.A.S., Denison D.G.T., and Hand D.J. Data mining with products of trees. Proceedings of the 4th International Conference on Advances in Intelligent Data Analysis (2001), Springer 167-176
10. M. Hall, Correlation-based feature selection for discrete and numeric class machine learning, in: Proceedings of the 17th International Conference on Machine Learning, 2000, pp. 359-366.
11. Howe N., and Cardie C. Examining locally varying weights for nearest neighbor algorithms. Case-Based Reasoning Research and Development: 2nd International Conference on Case-Based Reasoning (1997), Springer 455-466
12. John G., Kohavi R., and Pfleger K. Irrelevant features and the subset selection problem. Proceedings of the 11th International Conference on Machine Learning (1994), Morgan Kaufman 121-129
13. S. Kim, H. Seo, H. Rim, Poisson naive Bayes for text classification with feature weighting, in: Proceedings of the 6th International Workshop on Information Retrieval with Asian Languages, 2003, pp. 33-40.
14. Kira K., and Rendell L. A practical approach to feature selection. Proceedings of the Ninth International Conference on Machine Learning (1992), Morgan Kaufman 249-256
15. R. Kohavi, P. Langley, Y. Yun, The utility of feature weighting in nearest-neighbor algorithms. in: M. van Someren, G. Widmer (Eds.), Poster Papers: Ninth European Conference on Machine Learning, Prague, Czech Republic, 1997, Unpublished.
16. R. Kohavi, Scaling up the accuracy of naive-Bayes classifiers: a decision tree hybrid, in: Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, 1996, pp. 202-207.
17. Kubat M., Flotzinger D., and Pfurtscheller G. Discovering patterns in EEG signals: comparative study of a few methods. Proceedings of the 1993 European Conference on Machine Learning (1993), Springer, Verlag 367-371
18. Langley P., and Sage S. Induction of selective Bayesian classifiers. Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence (1994), Morgan Kaufmann 399-406
19. C. Nadeau, Y. Bengio. Inference for the generalization error. Advances in Neural Information Processing Systems, 12, MIT Press, 1999, pp. 307-313.
20. Quinlan R. C4.5: Programs for Machine Learning (1993), Morgan Kaufman
21. Ratanamahatana C.A., and Gunopulos D. Feature selection for the naive Bayesian classifier using decision trees. Appl. Artif. Intell. 17 5-6 (2003) 475-487
22. Robnik-Sikonja M., and Kononenko I. Theoretical and empirical analysis of Relieff and RRelieff. Mach. Learning 53 1-2 (2003) 23-69
23. Salzberg S.L. A nearest hyperrectangle learning method. Mach. Learning 6 (1991) 251-276
24. Stanfill C., and Waltz D. Toward memory-based reasoning. Commun. Assoc. Comput. Mach. 29 (1986) 1213-1228
25. Wettschereck D., Aha D.W., and Mohri T. A review and empirical comparison of feature weighting methods for a class of lazy learning algorithms. Artif. Intell. Rev. 11 (1997) 273-314
26. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations (2000), Morgan Kaufmann
27. H. Zhang, S. Sheng, Learning weighted naive Bayes with accurate ranking, in: Proceedings of the 4th IEEE International Conference on Data Mining, 2004, pp. 567-570.
28. Zheng Z., and Webb G.I. Lazy learning of Bayesian rules. Mach. Learning 41 1 (2000) 53-84