Rotation-based ensemble classifiers for high-dimensional data

Advances in Computer Vision and Pattern Recognition

Volumn 64, Issue , 2014, Pages 135-160

  Xia, Junshi ^a   Chanussot, Jocelyn ^a,b   Du, Peijun ^c   He, Xiyan ^a  

^a GIPSA LAB   (France)

^b UNIVERSITY OF ICELAND   (Iceland)

^c NANJING UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84986218314     PISSN: 21916586     EISSN: 21916594     Source Type: Book Series    
DOI: 10.1007/978-3-319-05696-8_6     Document Type: Chapter

References (93)

1. Achlioptas, D (2001) Database-friendly random projections. In: Proceedings of the twentieth ACM SIGMOD-SIGACT-SIGART symposium on principles of database systems, New York, NY, USA, 2001, pp 274-281
2. Aksela M, Laaksonen J (2006) Using diversity of errors for selecting members of a committee classifier. Pattern Recogn 39(4):608-623
3. Bakos KL, Gamba P (2011) Hierarchical hybrid decision tree fusion of multiple hyperspectral data processing chains. IEEE Trans Geosci Remote Sens 49(1-2):388-394
4. Benediktsson JA, Chanussot J, Fauvel M (2007) Multiple classifier systems in remote sensing: from basics to recent developments. Lect Notes Comput Sci 4472:501-512
5. Benediktsson JA, Sveinsson JR (1997) Hybrid consensus theoretic classification. IEEE Trans Geosci Remote Sens 35(4):833-843
6. Benediktsson JA, Swain PH (1992) Consensus theoretic classification methods. IEEE Trans Syst Man Cybern 22(4):688-704
7. Biggio B, Fumera G, Roli F (2010) Multiple classifier systems for robust classifier design in adversarial environments. J Mach Learn Cybern 1:27-41
8. Braun AC, Weidner U, Hinz S (2012) Classification in high-dimensional feature spaces assessment using SVM, IVM and RVM with focus on simulated EnMap data. IEEE J Sel Top Appl Earth Observations Remote Sens 5(2):436-443
9. Breiman L (1996) Bagging predictors. Mach Learn 24(2):123-140
10. Breiman L (2001) Random forest. Mach Learn 45(1):5-32
11. Briem G, Benediktsson J, Sveinsson J (2002) Multiple classifiers applied to multisource remote sensing data. IEEE Trans Geosci Remote Sens 40(10):2291-2299
12. Brown G, Wyatt J, Harris R, Yao X (2005) Diversity creation methods: a survey and categorisation. Inf Fusion 6(1):5-20
13. Bryll RK, Gutierrez-Osuna R, Quek FKH (2003) Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets. Pattern Recogn 36(6):1291-1302
14. Chan JC, Paelinckx D (2008) Evaluation of Random Forest and AdBboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery. Remote Sens Environ 112(6):2999-3011
15. Chandra A, Yao X (2006) Evolving hybrid ensembles of learning machines for better generalisation. Neurocomputing 69(7-9):686-700
16. Cheriyadat A, Bruce LM (2003) Why principal component analysis is not an appropriate feature extraction method for hyperspectral data. In: Proceedings of IEEE geoscience and remote sensing symposium (IGARSS), Toulouse, France, 2003, pp 3420-3422
17. Cunningham P, Carney J (2000) Diversity versus quality in classification ensembles based on feature selection. In: 11th European conference on machine learning, Barcelona, Spain, 2000, pp 109-116
18. Dell’Acqua F, Gamba P, Ferari A, Palmason BJA, Arnason K (2004) Exploiting spectral and spatial information in hyperspectral urban data with high resolution. IEEE Geosci Remote Sens Lett 1(4):322-326
19. Dietterich TG, Bakiri G (1995) Solving multiclass learning problems via error-correcting output codes. J Artif Intell Res 2(1):263-286
20. Doan HTX, Foody GM (2007) Increasing soft classification accuracy through the use of an ensemble of classifiers. Int J Remote Sens 28(20):4609-4623
21. Du P, Xia J, Zhang W, Tan K, Liu Y, Liu S (2012) Multiple classifier system for remote sensing image classification: a review. Sensors 12(4):4764-4792
22. Du P, Zhang W, Xia J (2011) Hyperspectral remote sensing image classification based on decision level fusion. Chin Optics Lett 9(3):31002-31004
23. Duca R, Frate FD (2008) Hyperspectral and multiangle CHRIS-PROBA images for the generation of land cover maps. IEEE Trans Geosci Remote Sens 10:2857-2866
24. Fauvel M, Chanussot J, Benediktsson JA (2009) Kernel principal component analysis for the classification of hyperspectral remote sensing data over urban areas. EURASIP J Adv Signal Process 2:1-15
25. Fleiss J (1981) Statistical methods for rates and proportions. Wiley, New York
26. Foody GM (2009) Classification accuracy comparison: hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority. Remote Sens Environ 113(8):1658-1663
27. Foody GM, Boyd DS, Sanchez-Hernandez C (2007) Mapping a specific class with an ensemble of classifiers. Int J Remote Sens 28:1733-1746
28. Freund Y, Schapire RE (1996) Experiments with a new Boosting algorithm. In: International conference on machine learning, Bari, Italy, 1996, pp 148-156
29. Gao J, Liang F, Fan W, Sun Y, Han J (2013) A graph-based consensus maximization approach for combining multiple supervised and unsupervised models. IEEE Trans Knowl Data Eng 25(1):15-28
30. Giacinto G, Roli F (2001) Design of effective neural network ensembles for image classification. Image Vis Comput J 19(9/10):697-705
31. Giacinto G, Roli F, Fumera G (2000) Selection of image classifiers. Electron Lett 36:420-422
32. Giacinto G, Roli F, Vernazza G (1997) Comparison and combination of statistical and neural network algorithms for remote-sensing image classification. Neurocomputation in remote sensing data analysis. Springer, Berlin, pp 117-124
33. Gislason PO, Benediktsson JA, Sveinsson JR (2006) Random forests for land cover classification. Pattern Recogn Lett 27(4):294-300
34. Gmez-Chova L, Fernndez-Prieto D, Calpe-Maravilla J, Soria-Olivas E, Vila-Francs J, Camps-Valls G (2006) Urban monitoring using multi-temporal SAR and multi-spectral data. Pattern Recogn Lett 27(4):234-243
35. Guyon I, Gunn S, Nikravesh M, Zadeh L (2006) Feature extraction: foundations and applications. Springer, New York
36. Ham J, Chen Y, Crawford MM, Ghosh J (2005) Investigation of the random forest framework for classification of hyperspectral data. IEEE Trans Geosci Remote Sens 43(3):492-501
37. Hansen LK, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12(10):993-1001
38. He Z, Xu X, Deng S (2005) A cluster ensemble method for clustering categorical data. Inf Fusion 6(2):143-151
39. Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832-844
40. Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55-63
41. Iam-On N, Boongoen T, Garrett S, Price C (2011) A link-based approach to the cluster ensemble problem. IEEE Trans Pattern Anal Mach Intell 33(12):2396-2409
42. Richards JA, Jia X (2006) Remote sensing digital image analysis: an introduction. Springer, New York
43. Kang H-J, Lee S-W (2000) An information-theoretic strategy for constructing multiple classifier systems. In: International conference on pattern recognition (ICPR), Barcelona, Spain, 2000, pp 2483-2486
44. Kawaguchi K, Nishii R (2007) Hyperspectral image classification by bootstrap AdaBoost with random decision stumps. IEEE Trans Geosci Remote Sens 45(11-2):3845-3851
45. Kohavi R, Wolpert DH (1996) Bias plus variance decomposition for zero-one loss functions. In: 13th international conference on machine learning (ICML), Bari, Italy, 1996, pp 275-283
46. Kong Z, Cai Z (2007) Advances of research in fuzzy integral for classifiers’ fusion. In: Proceedings of the eigth ACIS international conference on software engineering, artificial intelligence, networking, and parallel/distributed computing, Washington, DC, USA pp 809-814
47. Krogh A, Vedelsby J (1995) Neural network ensembles, cross validation, and active learning. Adv Neural Inf Process Syst 7:231-238
48. Kumar S, Ghosh J, Crawford MM (2002) Hierarchical fusion of multiple classifiers for hyper-spectral data analysis. Pattern Anal Appl 5:210-220
49. Kuncheva L, Whitaker C, Shipp C, Duin R (2000) Is independence good for combining classifiers? In: International conference on pattern recognition (ICPR), 2000, p 2168
50. Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley-Interscience, New Jersey
51. Kuncheva LI (2005) Diversity in multiple classifier systems. Inf Fusion 6(1):3-4
52. Kuncheva LI, Rodriguez JJ (2007) An experimental study on rotation forest ensembles. In: Proceedings of the 7th international workshop on multiple classifier systems, Prague, Czech Republic, 2007, pp 459-468
53. Kuncheva LI, Whitaker CJ (2003) Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach Learn 51(2):181-207
54. Landgrebe DA (1984) Signal theory methods in multispectral remote sensing. Wiley, New York
55. Lawrence R, Bunna A, Powellb S, Zambon M (2004) Classification of remotely sensed imagery using stochastic gradient boosting as a refinement of classification tree analysis. Remote Sens Environ 90(3):331-336
56. Lu D, Weng Q (2007) A survey of image classification methods and techniques for improving classification performance. Int J Remote Sens 28(5):823-870
57. Margineantu DD, Dietterich TG (1997) Pruning adaptive boosting. In: Proceedings of the fourteenth international conference on machine learning, San Francisco, CA, USA, 1997, pp 211-218
58. Martinez-Munoz G, Suarez A (2005) Switching class labels to generate classification ensembles. Pattern Recogn 38(10):1483-1494
59. Melgani F, Bruzzone L (2004) Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans Geosci Remote Sens 42(8):1778-1790
60. Michail P, Benediktsson JA, Ioannis K (2002) The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion. IEEE Trans Geosci Remote Sens 39(11):2539-2546
61. Mojaradi B, Abrishami-Moghaddam H, Zoej M, Duin R (2009) Dimensionality reduction of hyperspectral data via spectral feature extraction. IEEE Trans Geosci Remote Sens 47(7):2091-2105
62. Moon H, Ahn H, Kodell RL, Baek S, Lin C-J, Chen JJ (2007) Ensemble methods for classification of patients for personalized medicine with high-dimensional data. Artif Intell Med 41(3):197-207
63. Moreno-Seco F, Inesta J, Ponce De Leon P, Mico L (2006) Comparison of classifier fusion methods for classification in pattern recognition tasks. Lect Notes Comput Sci 4109:705-713
64. Navalgund RR, Jayaraman V, Roy PS (2007) Remote sensing applications: an overview. Current 93(12):1747-1766
65. Nemmour H, Chibani Y (2006) Multiple support vector machines for land cover change detection: an application for mapping urban extensions. ISPRS J Photogrammetry Remote Sens 61(2):125-133
66. Ozcift A, Gulten A (2011) Classifier ensemble construction with rotation forest to improve medical diagnosis performance of machine learning algorithms. Comput Methods Programs Biomed 104(3):443-451
67. Pal M, Foody GM (2010) Feature selection for classification of hyperspectral data by SVM. IEEE Trans Geosci Remote Sens 48(5):2297-2307
68. Partridge D, Krzanowski W (1997) Software diversity: practical statistics for its measurement and exploitation. Inf Softw Technol 39(10):707-717
69. Plaza A, Martinez P, Plaza J, Perez R (2005) Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations. IEEE Trans Geosci Remote Sens 43(3):466-479
70. Rahman A, Fairhurst M (1999) Serial combination of multiple experts: a unified evaluation. Pattern Anal Appl 2:292-311
71. Ranawana R, Palade V (2006) Multi-classifier systems: review and a roadmap for developers. Int J Hybrid Intell Syst 3(1):1-41
72. Rodriguez JJ, Kuncheva LI (2009) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28(10):1619-1630
73. Rodriguez-Galianoa VF, Ghimireb B, Roganb J, Chica-Olmoa M, Rigol-Sanchezc JP (2011) An assessment of the effectiveness of a random forest classifier for land-cover classification. ISPRS J Photogrammetry Remote Sens 67:93-104
74. Rokach L (2010) Pattern classification using ensemble methods. World Scientific, Singapore
75. Ruitenbeek F, Debba P, Meer F, Cudahy T, Meijde M, Hale M (2006) Mapping white micas and their absorption wavelengths using hyperspectral band ratios. Remote Sens Environ 102 (3-4):211-222
76. Ruta D, Gabrys B (2000) An overview of classifier fusion methods. Comput Inf Syst 7(1):1-10
77. Schölkopf B, Platt JC, Shawe-Taylor J, Smola AJ, Williamson RC (2001) Estimating the support of a high-dimensional distribution. Neural Comput 13(7):1443-1471
78. Smits PC (2002) Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection. IEEE Trans Geosci Remote Sens 40:801-813
79. Steele BM (2000) Combining multiple classifiers: an application using spatial and remotely sensed information for land cover type mapping. Remote Sens Environ 74(3):545-556
80. Sugiyama M (2007) Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. J Mach Learn Res 27(8):1021-1064
81. Sun Q, Ye XQ, Gu WK (2000) A new combination rules of evidence theory (in chinese). Acta Electronica Sinica 8(1):117-119
82. Tsoumakas G, Partalas I, Vlahavas I (2009) An ensemble pruning primer. In: Okun O, Valentini G (eds) Applications of supervised and unsupervised ensemble methods. Springer, Berlin, pp 1-13
83. Vapnik VN (1995) The nature of statistical learning theory. Springer, Berlin
84. Waske B, Benediktsson JA, Arnason K, Sveinsson JR (2009) Mapping of hyperspectral aviris data using machine-learning algorithms. Can J Remote Sens 35:106-116
85. Waske B, Van Der Linden S, Benediktsson JA, Rabe A, Hostert P (2010) Sensitivity of support vector machines to random feature selection in classification of hyperspectral data. IEEE Trans Geosci Remote Sens 48(7):2880-2889
86. Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67-82
87. Woods K, Kegelmeyer WP, Bowyer K (1997) Combination of multiple classifiers using local accuracy estimates. IEEE Trans Pattern Anal Mach Intell 19(4):405-410
88. Wozniak M, Grana M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fusion 16(1):3-17
89. Xia J, Du P, He X, Chanussot J (2014) Hyperspectral remote sensing image classification based on rotation forest. IEEE Geosci Remote Sens Lett 11:239-243
90. Xu L, Krzyzak A, Suen CY (1992) Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans Syst Man Cybern 22(3):418-435
91. Yang J-M, Kuo B-C, Yu P-T, Chuang C-H (2010) A dynamic subspace method for hyperspectral image classification. IEEE Trans Geosci Remote Sens 48(7):2840-2853
92. Zeng H, Triosell HJ (2004) Dimensionality reduction in hyperspectral image classification. In: IEEE International Conference on Image Processing (ICIP), Singapore, 2004, pp 913-916
93. Zhang Y (2010) Ten years of technology advancement in remote sensing and the research in the crc-agip lab in gce. Geomatica 64(2):173-189