A new objective function for ensemble selection in random subspaces

Proceedings - International Conference on Pattern Recognition

Volumn 4, Issue , 2006, Pages 185-188

  Ko, Albert Hung Ren ^a   Sabourin, Robert ^a   De Souza Britto Jr , Alceu ^b  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b PONTIFICAL CATHOLIC UNIVERSITY OF PARANÁ   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

CORRELATION METHODS; FUNCTION EVALUATION;

ENSEMBLE SELECTION; OBJECTIVE FUNCTIONS; RANDOM SUBSPACES;

FEATURE EXTRACTION;

EID: 34147172745     PISSN: 10514651     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPR.2006.124     Document Type: Conference Paper

References (18)

1. L. I. Kuncheva and C. J. Whitaker, "Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy," Machine Learning, vol. 51, no. 2, pp. 181-207, 2003
2. T.K. Ho, "The random space method for constructing decision forests," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 832-844, 1998
3. G. Brown, J. Wyatt and P. Sun, "Between Two Extremes: Examining Decompositions of the Ensemble Objective Function," International Workshop on Multiple Classifier Systems (MCS 2005), pp. 296-305, 2005
4. G. Giacinto and F. Roli, "Design of effective neural network ensembles for image classification purposes," Image and Vision Computing, vol. 19, no. 9-10, pp. 699-707, 2001
5. D. Ruta and B. Gabrys, "Classifier Selection for Majority Voting," International Journal of Information Fusion, pp. 63-81, 2005
6. R.P.W. Duin, "Pattern Recognition Toolbox for Matlab 5.0+," available free at: ftp://ftp.ph.tn.tudelft.nl/pub/bob/prtools
7. E. Pekalska, M. Skurichina and R. P. W. Duin, "Combining Dissimilarity-Based One-Class Classifiers," International Workshop on Multiple Classifier Systems (MCS 2004), pp. 122-133, 2004
8. D. Partridge and W. Krzanowski, "Software diversity: practical statistics for its measurement and exploitation," Information and Software Technology, vol. 39, pp. 707-717, 1997
9. G. Brown, J. Wyatt, R. Harris and X. Yao, "Diversity Creation Methods: A Survey and Categorisation," International Journal of Information Fusion, vol. 6, no. 1, pp. 5-20, 2005
10. H. Zouari, L. Heutte, Y. Lecourtier and A. Alimi, "Building Diverse Classifier Outputs to Evaluate the Behavior of Combination Methods: the Case of Two Classifiers," International Workshop on Multiple Classifier Systems (MCS 2004), pp. 273-282, 2004
11. B. E. Geman, S. and R. Dorsat, "Neural Networks and the Bias/Variance Dilemma," Neural Computation, no. 4, pp. 1-58, 1992
12. A. Krogh and J. Vedelsby, "Neural Network Ensembles, Cross Validation, and Active Learning," Advances in Neural Information Processing Systems, vol. 7, pp. 231-238, 1995
13. L. I. Kuncheva, M. Skurichina, and R. P. W. Duin, "An Experimental Study on Diversity for Bagging and Boosting with Linear Classifiers," International Journal of Information Fusion, vol. 3, no. 2, pp. 245-258, 2002
14. J. Kittler, M. Hatef, R. Duin, and J. Matas, "On Combining Classifiers," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226-239, 1998
15. K. Tumer and J. Ghosh, "Error Correlation and Error Reduction in Ensemble Classifiers", Connection Science, vol. 8, no. 3-4, pp. 385-403, 1996
16. G. James, "Variance and Bias for General Loss Functions," Machine Learning, vol. 51, no. 2, pp. 115-135, 2003.
17. P. Domingos, "A Unified Bias-Variance Decomposition and its Applications," International Conference on Machine Learning (ICML 2000), pp. 231-238, 2000
18. B. E. Rosen, "Ensemble Learning using Decorrelated Neural Networks", Connection Science, vol. 8, no. 3-4, pp. 373-384, 1996