Attribute bagging: Improving accuracy of classifier ensembles by using random feature subsets

Pattern Recognition

Volumn 36, Issue 6, 2003, Pages 1291-1302

  Bryll, Robert ^a   Gutierrez Osuna, Ricardo ^b   Quek, Francis ^a  

^a Wright State University   (United States)

^b Texas A M University   (United States)

Author keywords

Attribute bagging; Bagging; Classifier ensembles; Ensemble learning; Feature subset selection; Hand pose recognition; Voting

Indexed keywords

ALGORITHMS; CLASSIFIERS; SET THEORY;

ATTRIBUTE BAGGING;

PATTERN RECOGNITION;

PATTERN RECOGNITION;

EID: 0242515926     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(02)00121-8     Document Type: Article

References (22)

1. R.O. Duda, P.H. Hart, D.G. Stork, Pattern Classification, Wiley-Interscience, New York, 2000.
2. T.G. Dietterich, Machine learning research: four current directions, AI Magaz. 18 (1997) 97-136.
3. L. Breiman, Bagging predictors, Mach. Learning 24 (1996) 123-140.
4. J.R. Quinlan, Bagging, boosting, and C4.5, Proceedings of AAAI/IAAI (13th American Association for Artificial Intelligence National Conference on Artificial Intelligence, Portland, Oregon), Vol. 1, 1996, pp. 725-730.
5. K. Tumer, J. Ghosh, Classifier combining: analytical results and implications, Working notes from the Workshop 'Integrating Multiple Learned Models', 13th National Conference on Artifical Intelligence, August 1996, Portland, Oregon.
6. K. Tumer, N.C. Oza, Decimated input ensembles for improved generalization, Proceedings of the International Joint Conference on Neural Networks, Washington, DC, 1999.
7. P. Langley, Selection of relevant features in machine learning, Proceedings of the AAAI Fall Symposium on relevance, New Orleans, LA, AAAI Press, 1994.
8. G.H. John, R. Kohavi, K. Pfleger, Irrelevant features and the subset selection problem, in: W.W. Cohen, H. Hirsh (Eds.), Machine Learning: Proceedings of the 11th International Conference, Morgan Kaufmann Publishers, San Francisco, CA, 1994, pp. 121-129.
9. J. Yang, V. Honavar, Feature subset selection using a genetic algorithm, Genetic Programming 1997: Proceedings of the 2nd Annual Conference, Morgan Kaufmann, Stanford University, CA, 1997, pp. 380-386.
10. M.A. Hall, L.A. Smith, Feature subset selection: a correlation based filter approach, Proceedings of the Fourth International Conference on Neural Information Processing and Intelligent Information Systems (ICONIP'97), New Zealand, Springer, Berlin, 1997, Vol. 2, pp. 855-858.
11. H. Liu, R. Setiono, A probabilistic approach to feature selection - a filter solution, Proceedings of the 13th International Conference on Machine Learning (ICML'96), Bari, Italy, 1996, pp. 319-327.
12. Z. Zheng, G.I. Webb, Stochastic attribute selection committees, Proceedings of the Australian Joint Conference on Artificial Intelligence, Springer, Berlin, 1998, pp. 321-332.
13. Z. Zheng, G.I. Webb, K.M. Ting, Integrating boosting and stochastic attribute selection committees for further improving the performance of decision tree learning, Proceedings of the 10th International Conference on Tools with Artificial Intelligence, Los Alamitos, CA, IEEE Computer Society Press, Silver Spring, MD, 1998, pp. 216-223.
14. S.D. Bay, Combining nearest neighbor classifiers through multiple feature subsets, Proceedings of the 17th International Conference on Machine Learning, Madison, WI, 1998, pp. 37-45.
15. E.B. Kong, T.G. Dietterich, Error-correcting output coding corrects bias and variance, Proceedings of the Twelfth National Conference on Artificial Intelligence, Morgan Kauffman, San Francisco, CA, 1995, pp. 313-321.
16. Meide Zhao, F. Quek, Xindong Wu, RIEVL: recursive induction learning in hand gesture recognition, IEEE Trans. Pattern Anal. Mach. Intell. 20 (1998) 1174-1185.
17. S.K. Murthy, S. Kasif, S. Salzberg, A system for induction of oblique decision trees, J. Artif. Intell. Res. 2 (1994) 1-32.
18. J.R. Quinlan, Induction of decision trees, Mach. Learning 1 (1986) 81-106.
19. J.R. Quinlan, C4.5:Programs for Machine Learning, Morgan Kaufmann, USA, 1993.
20. R. Boswell, Manual for NewID Version 6.1, Technical Report TI/P2154/RAB/4/2.5, The Turing Institute, Glasgow, 1990.
21. X. Wu, The HCV induction algorithm, in: S.C. Kwasny, J.F. Buck (Eds.), Proceedings of the 21st ACM Computer Science Conference, ACM Press, New York, 1993, pp. 168-175.
22. P. Clark, T. Niblett, The CN2 induction algorithm, Mach. Learning 3 (1989 261-283.