Random Aggregated and Bagged Ensembles of SVMs: An Empirical Bias-Variance Analysis

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3077, Issue , 2004, Pages 263-272

  Valentini, Giorgio ^a  

^a UNIVERSITY OF MILAN   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; PROBABILITY DISTRIBUTIONS; SUPPORT VECTOR MACHINES;

BASE LEARNERS; ENSEMBLE METHODS; EXPERIMENTAL BIAS; SUBSAMPLING TECHNIQUES; TRAINING SETS; VARIANCE ANALYSIS; VARIANCE COMPONENTS; VARIANCE REDUCTIONS;

AGGREGATES;

EID: 35048868343     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-25966-4_26     Document Type: Article

References (15)

1. Breiman, L.: Bagging predictors. Machine Learning 24 (1996) 123-140
2. Dietterich, T.: An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting and randomization. Machine Learning 40 (2000) 139-158
3. Bousquet, O., Elisseeff, A.: Stability and Generalization. Journal of Machine Learning Research 2 (2002) 499-526
4. Valentini, G., Dietterich, T.G.: Bias-variance analysis of Support Vector Machines for the development of SVM-based ensemble methods. Journal of Machine Learning Research (accepted for publication)
5. Valentini, G., Dietterich, T.: Bias-variance analysis and ensembles of SVM. In: MCS2002, Cagliari, Italy. Vol. 2364 of Lecture Notes in Computer Science., Springer-Verlag (2002) 222-231
6. Andersen, T., Rimer, M., Martinez, T.R.: Optimal artificial neural network architecture selection for voting. In: Proc. of the IEEE International Joint Conference on Neural Networks IJCNN'Ol, IEEE (2001) 790-795
7. Kim, H., Pang, S., Je, H., Kim, D., Bang, S.: Pattern Classification Using Support Vector Machine Ensemble. In: Proc. of ICPR'02. Vol. 2., IEEE (2002) 20160-20163
8. Breiman, L.: Pasting Small Votes for Classification in Large Databases and On-Line. Machine Learning 36 (1999) 85-103
9. Joachims, T.: Making large scale SVM learning practical. In Scholkopf B., Burges C., S.A., ed.: Advances in Kernel Methods - Support Vector Learning. MIT Press, Cambridge, MA (1999) 169-184
10. Chawla, N., Hall, L., Bowyer, K., Moore, T., Kegelmeyer, W.: Distributed pasting of small votes. In: MCS2002, Cagliari, Italy. Vol. 2364 of Lecture Notes in Computer Science., Springer-Verlag (2002) 52-61
11. Valentini, G.: Ensemble methods based on bias-variance analysis. PhD thesis, DISI, Università di Genova, Italy (2003), ftp://ftp.disi.unige. it/person/ValentiniG/Tesi/finalversion/vale-th-2003-04.pdf.
12. Domingos, P.: A Unified Bias-Variance Decomposition for Zero-One and Squared Loss. In: Proc. of the Seventeenth National Conference on Artificial Intelligence, Austin, TX, AAAI Press (2000) 564-569
13. Valentini, G., Masulli, F.: NEURObjects: an object-oriented library for neural network development. Neurocomputing 48 (2002) 623-646
14. Merz, C., Murphy, P.: UCI repository of machine learning databases (1998) www.ics.uci.edu/mlearn/MLRepository.html.
15. Evgeniou, T., Perez-Breva, L., Pontil, M., Poggio, T.: Bounds on the Generalization Performance of Kernel Machine Ensembles. In Langley, P., ed.: Proc. of the Seventeenth International Conference on Machine Learning (ICML 2000), Morgan Kaufmann (2000) 271-278