The Use of the Ambiguity Decomposition in Neural Network Ensemble Learning Methods

Proceedings, Twentieth International Conference on Machine Learning

Volumn 1, Issue , 2003, Pages 67-74

  Brown, Gavin ^a   Wyatt, Jeremy ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BIAS-VARIANCE DECOMPOSITION; NEGATIVE CORRELATION (NC) LEARNING; SQUARE WAVE FUNCTIONS;

APPROXIMATION THEORY; BACKPROPAGATION; COMPUTER SCIENCE; ERROR ANALYSIS; EVOLUTIONARY ALGORITHMS; FUNCTIONS; MATHEMATICAL MODELS; NEURAL NETWORKS; PROBLEM SOLVING; REGRESSION ANALYSIS;

LEARNING SYSTEMS;

EID: 1942485305     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Breiman, L. (1996). Bagging predictors. Machine Learning, 24, 123-140.
2. Carney, J., & Cunningham, P. (1999). Tuning diversity in bagged neural network ensembles (Technical Report TCD-CS-1999-44). Trinity College Dublin.
3. Domingos, P. (2000). A unified bias-variance decomposition and its applications. Proc. 17th International Conf. on Machine Learning (pp. 231-238). Morgan Kaufmann, San Francisco, CA.
4. Freund, Y., & Schapire, R. E. (1996). Experiments with a new boosting algorithm. Proceedings of the 13th International Conference on Machine Learning. Morgan Kaufmann.
5. Krogh, A., & Vedelsby, J. (1995). Neural network ensembles, cross validation, and active learning. NIPS, 7, 231-238.
6. Liu, Y. (1998). Negative correlation learning and evolutionary neural network ensembles. Doctoral dissertation, University College, The University of New South Wales, Australian Defence Force Academy, Canberra, Australia.
7. Liu, Y., & Yao, X. (1997). Negatively correlated neural networks can produce best ensembles. Australian Journal of Intelligent Information Processing Systems, 4, 176-185.
8. Mason, L., Baxter, J., Bartlett, P. L., & Frean, M. (2000). Advances in large margin classifiers, chapter Functional gradient techniques for combining hypotheses, 221-246. Cambridge, MA: MIT Press.
9. McKay, R., & Abbass, H. (2001). Analyzing anticorrelation in ensemble learning. Proceedings of 2001 Conference on Artificial Neural Networks and Expert Systems (pp. 22-27). Otago, New Zealand.
10. Opitz, D. (1999). Feature selection for ensembles. Proceedings of 16th National Conference on Artificial Intelligence (AAAI) (pp. 379-384).
11. Opitz, D. W., & Shavlik, J. W. (1996). Generating accurate and diverse members of a neural-network ensemble. NIPS, 8, 535-541.
12. Oza, N. C., & Turner, K. (2001). Input decimation ensembles: Decorrelation through dimensionality reduction. LNCS, 2096, 238-247.
13. Rosen, B. E. (1996). Ensemble learning using decorrelated neural networks. Connection Science - Special Issue on Combining Artificial Neural Networks: Ensemble Approaches, 8, 373-384.
14. Ueda, N., & Nakano, R. (1996). Generalization error of ensemble estimators. Proceedings of International Conference on Neural Networks (pp. 90-95).