Bias–variance analysis and ensembles of SVM

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2364, Issue , 2002, Pages 222-231

  Valentini, Giorgio ^a,b   Dietterich, Thomas G ^c  

^a UNIVERSITY OF GENOA   (Italy)

^b INFM   (Italy)

^c Oregon State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING ALGORITHMS; SUPPORT VECTOR MACHINES;

BASE LEARNERS; ENSEMBLE METHODS; GAIN INSIGHT; KERNEL PARAMETER; TWO DIRECTIONS; VARIANCE ANALYSIS; VARIANCE DECOMPOSITION;

LEARNING SYSTEMS;

EID: 84947560298     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-45428-4_22     Document Type: Conference Paper

References (16)

1. [1] L. Breiman. Bias, variance and arcing classifiers. Technical Report TR 460, Statistics Department, University of California, Berkeley, CA, 1996.
2. [2] S. Cohen and N. Intrator. Automatic Model Selection in a Hybrid Peceptron/Radial Network. In In J. Kittler and F. Roli (eds.) MCS 2001, Cambridge, UK, pages 349–358, 2001.
3. [3] T.G. Dietterich. Ensemble methods in machine learning. In J. Kittler and F. Roli (eds.), MCS 2000, Cagliari, Italy, pages 1–15, 2000.
4. [4] P. Domingos. A Unified Bias-Variance Decomposition for Zero-One and Squared Loss. In Proc. of the 17th National Conference on Artificial Intelligence, pages 564–569, Austin, TX, 2000.
5. [5] P. Domingos. A Unified Bias-Variance Decomposition and its Applications. In Proc. of the 17th ICML, pages 231–238, Stanford, CA, 2000.
6. [6] J.H. Friedman. On bias, variance, 0/1 loss and the curse of dimensionality. Data Mining and Knowledge Discovery, 1:55–77, 1997.
7. [7] S. Geman, E. Bienenstock, and R. Doursat. Neural networks and the bias-variance dilemma. Neural Computation, 4(1):1–58, 1992.
8. [8] T.K. Ho. Data Complexity Analysis for Classifiers Combination. In J. Kittler and F. Roli (eds.), MCS 2001, Cambridge, UK, pages 53–67, 2001.
9. [9] T. Joachims. Making large scale SVM learning practical. In Advances in Kernel Methods - Support Vector Learning, pages 169–184. Cambridge, MA, 1999.
10. [10] R. Kohavi and D.H. Wolpert. Bias plus variance decomposition for zero-one loss functions. In Proc. of the 13th ICML, pages 275–283, Bari, Italy, 1996.
11. [11] E. Kong and T.G. Dietterich. Error - correcting output coding correct bias and variance. In Proc. of the 12th ICML, pages 313–321, San Francisco, CA, 1995.
12. [12] L.I. Kuncheva, F. Roli, G.L. Marcialis, and C.A. Shipp. Complexity od Data Subsets Generated by the Random Subspace Method: An Experimental Investigation. In J. Kittler and F. Roli (eds.), MCS 2001, Cambridge, UK, pages 349–358, 2001.
13. [13] C.J. Merz and P.M. Murphy. UCI repository of machine learning databases, 1998. http://www.ics.uci.edu/mlearn/MLRepository.html.
14. [14] R. Tibshirani. Bias, variance and prediction error for classification rules. Technical report, University of Toronto, Canada, 1996.
15. [15] G. Valentini and F. Masulli. NEURObjects: an object-oriented library for neural network development. Neurocomputing. (in press).
16. [16] V. Vapnik. Statistical Learning Theory. Wiley, New York, 1998.