EROS: Ensemble rough subspaces

Pattern Recognition

Volumn 40, Issue 12, 2007, Pages 3728-3739

  Hu, Qinghua ^a   Yu, Daren ^a   Xie, Zongxia ^a   Li, Xiaodong ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Attribute reduction; Ensemble learning; Multiple classifier system; Rough set; Selective ensemble

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); PATTERN RECOGNITION; RANDOM PROCESSES; ROUGH SET THEORY;

ATTRIBUTE REDUCTION; ENSEMBLE LEARNING; GENERALIZATION; ROUGH SUBSPACES;

LEARNING SYSTEMS;

EID: 34547654182     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.04.022     Document Type: Article

References (50)

1. Czyz J., Kittler J., and Vandendorpe L. Multiple classifier combination for face-based identity verification. Pattern Recognition 37 (2004) 1459-1469
2. Aksela M., and Laaksonen J. Using diversity of errors for selecting members of a committee classifier. Pattern Recognition 39 (2006) 608-623
3. Ho T.K. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20 (1998) 832-844
4. Q.H. Hu, D.R. Yu, M.Y. Wang, in: Constructing Rough Decision Forests, D. Slezak et al. (Eds.), RSFDGrC 2005, Lecture Notes in Artificial Intelligence, vol. 3642, 2005, pp. 147-156.
5. Cao J., Ahmodi M., and Shridhar M. Recognition of handwritten numerals with multiple feature and multistage classifier. Pattern Recognition 28 (1995) 153-160
6. Stamatatos a E., and Gerhard Widmer. Automatic identification of music performers with learning ensembles. Artif. Intell. 165 (2005) 37-56
7. Dietterich T.G. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization. Mach. Learn. 40 (2000) 139-157
8. Kittler J., Hatef M., Duin R.P.W., and Matas J. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20 (1998) 226-239
9. Geman S., Bienenstock E., and Doursat R. Neural networks and the bias/variance dilemma. Neural Comput. 4 (1992) 1-58
10. Krogh A., and Vedelsby J. Neural network ensembles. In: Tesauro G., Touretzky D.S., and Leen T.K. (Eds). Advances in Neural Information Processing Systems (1995), MIT Press, Cambridge, MA 231-238
11. Breiman L. Bagging predictors. Mach. Learn. 24 (1996) 123-140
12. Granitto P.M., Verdes P.F., and Ceccatto H.A. Neural network ensembles: evaluation of aggregation algorithms. Artif. Intell. 16 (2005) 3139-3162
13. Breiman L. Random forests. Mach. Learn. 45 (2001) 5-32
14. Cherkauer K.J. Human expert level performance on a scientific image analysis task by a system using combined artificial neural networks. Proceedings of 13th AAAI workshop on integrating multiple learned models for improving and scaling machine algorithms (1996) 15-21
15. Maclin R., and Shavlik J.W. Combining the predictions of multiple classifiers: using competitive learning to initialize neural networks. Proceedings of the 14th international joint conference on artificial intelligence (1995), Morgan Kaufmann, San Mateo, CA 524-530
16. Zhou Z.H., and Jiang Y. NeC4.5: Neural Ensemble Based C4.5. IEEE Trans. Knowledge Data Eng. 16 (2004) 770-773
17. Schapire R.E. The strength of weak learnability. Mach. Learn. 5 (1990) 197-227
18. Freund Y. Boosting a weak learning algorithm by majority. Proceedings of the Third Annual Workshop on Computational Learning Theory (1990) 202-216
19. Freund Y. Boosting a weak learning algorithm by majority. Inform. Comput. 121 (1996) 256-285
20. Freund Y., and Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. Proceedings of the Second European Conference on Computational Learning Theory (1995), Springer 23-37
21. Bryll R., Gutierrez-Osuna R., and Quek F. Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets. Pattern Recognition 36 (2003) 1291-1302
22. Zhou Z.H., and Yu Y. Ensembling local learners through multimodal perturbation. IEEE Trans. SMC-Part B: Cybernetics 35 (2005) 725-735
23. Tumer K., and Oza N.C. Input decimated ensembles. Pattern Anal. Appl. 6 (2003) 65-77
24. Gunter S., and Bunke H. Feature selection algorithms for the generation of multiple classifier systems and their application to handwritten word recognition. Pattern Recognition Lett. 25 (2004) 1323-1336
25. Kim Y. Toward a successful CRM: variable selection, sampling, and ensemble. Decision Support Systems 41 (2006) 542-553
26. Pawlak Z. Rough Sets-Theoretical Aspects of Reasoning about Data (1991), Kluwer Academic, Dordrecht
27. L. Polkowski, T.Y. Lin, S. Tsumoto (Eds.), in: Rough Set Methods and Applications: New Developments in Knowledge Discovery in Information Systems (Studies in Fuzziness and Soft Computing), vol. 56, Physica-Verlag, 2000.
28. Wang J., and Wang J. Reduction algorithms based on discernibility matrix: the ordered attributes method. J. Comput. Sci. Technol. 16 6 (2001) 489-504
29. Roman W., and Skowron S. Rough set methods in feature selection and recognition. Pattern Recognition Lett. 24 (2003) 833-849
30. Hassanien A.E. Rough set approach for attribute reduction and rule generation: a case of patients with suspected breast cancer. J. Am. Soc. Inform. Sci. Technol. 55 (2004) 954-962
31. Jensen R., and Shen Q. Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches. IEEE Trans. Knowledge Data Eng. 16 (2004) 1547-1571
32. Hu Q., Yu D., and Xie Z. Information-preserving hybrid data reduction based on fuzzy rough techniques. Pattern Recognition Lett. 27 (2006) 414-423
33. Wu Q., Bell D., and Mcginnity M. Multiknowledge for decision making. Knowledge Inform. Systems 7 (2005) 246-266
34. Shen Q., and Jensen R. Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring. Pattern Recognition 37 (2004) 1351-1363
35. Hu Q., Yu D., and Xie Z. Hybrid data reduction for classification with a fuzzy-rough set technique. Fifth SIAM Conference on Data Mining (2005)
36. Bhatt R.B., and Gopal M. On fuzzy-rough sets approach to feature selection. Pattern Recognition Lett. 26 (2005) 965-975
37. Skowron A., and Rauszer C. The discernibility matrices and functions in information systems. Intelligent Decision Support: Handbook of Applications and Advances of Rough Set Theory (1991) pp. 331-362
38. Jelonek J., Krawiec K., and Slowinski R. Rough set reduction of attributes and their domains for neural networks. Comput. Intell. 11 (1995) 339-347
39. Wang G.Y. Rough reduction in algebra view and information view. Int. J. Intell. Systems 18 (2003) 679-688
40. Y.M. Sun, M.S. Kamel, A.K.C. Wong, Empirical study on weighted voting multiple classifiers, Lecture Notes in Computer Science, vol. 3686, 2005, pp. 335-344.
41. C. Blake, E. Keogh, C.J. Merz, UCI Repository of Machine Learning Databases. Dept. Inf. Comput. Sci., Univ. California, Irvine, CA, 1998, 〈http://www.ics.uci.edu/~mlearn/MLRepository.html〉.
42. Shin H.W., and Sohn S.Y. Selected tree classifier combination based on both accuracy and error diversity. Pattern Recognition 38 (2005) 191-197
43. Zhou Z.H., Wu J.X., and Tang W. Ensembling neural networks: many could be better than all. Artif. Intell. 137 (2002) 239-263
44. Windeatt T. Diversity measures for multiple classifier system analysis and design. Information Fusion 6 (2005) 21-36
45. Aksela M., and Laaksonen J. Using diversity of errors for selecting members of a committee classifier. Pattern Recognition 39 (2006) 608-623
46. Nguyen M.H., Abbass H.A., and McKay R.I. Stopping criteria for ensemble of evolutionary artificial neural networks. Appl. Soft Comput. 6 (2005) 100-107
47. Schapire R.E., and Singer Y. Improved boosting algorithms using confidence-rated predictions. Mach. Learn. 37 (1999) 297-336
48. Kuncheva L.I., and Whitaker C.J. Measures of diversity in classifier ensembles. Mach. Learn. 51 (2003) 181-207
49. 2 | U / C |)). Chinese J. Comput. 29 (2006) 391-399
50. Liu S., Sheng Q., Wu B., Shi Z., and Hu F. Research on efficient algorithms for rough set methods. Chinese J. Comput. 26 5 (2003) 1-6