Neural network ensembles: Evaluation of aggregation algorithms

Artificial Intelligence

Volumn 163, Issue 2, 2005, Pages 139-162

  Granitto, P M ^a   Verdes, P F ^a   Ceccatto, H A ^a  

^a INSTITUTO DE FÍSICA ROSARIO   (Argentina)

Author keywords

Ensemble methods; Machine learning; Neural networks; Regression

Indexed keywords

BENCHMARKING; CLASSIFICATION (OF INFORMATION); DATABASE SYSTEMS; ERROR ANALYSIS; GENETIC ALGORITHMS; HEURISTIC METHODS; LEARNING SYSTEMS; REGRESSION ANALYSIS;

BAGGING; BOOSTING; ENSEMBLE METHODS; REGRESSION AGGREGATES;

NEURAL NETWORKS;

EID: 14544297375     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2004.09.006     Document Type: Article

References (24)

1. R. Avnimelech, and N. Intrator Boosting regression estimators Neural Comput. 11 1999 499 520
2. L. Breiman Bagging predictors Machine Learning 24 1996 123 140
3. L. Breiman Random forests Machine Learning 45 2001 5 32
4. L. Breiman, Out-of-bag estimation, Technical Report, University of California, Berkeley, CA, 1996
5. J. Carney, and P. Cunningham Tuning diversity in bagged ensembles Internat. J. Neural Systems 10 2000 267 280
6. H. Drucker Improving regressors using boosting techniques D.H. Fisher Jr. Proceedings of the Fourteenth International Conference on Machine Learning 1997 Morgan Kaufmann San Mateo, CA 107 115
7. H. Drucker Boosting using neural networks A.J.C. Sharkey Combining Artificial Neural Nets 1999 Springer London 51 77
8. N. Duffy, and D. Helmbold Leveraging for regression Proc. COLT'00 2000 208 219
9. B. Efron, and R. Tibshirani An Introduction to the Bootstrap 1993 Chapman and Hall London
10. Y. Freund, and R. Schapire A decision-theoretic generalization of on-line learning and an application to boosting Proceedings of the Second European Conference on Computational Learning Theory 1995 Springer Berlin 23 37
11. J. Friedman, Greedy function approximation: a gradient boosting machine. Technical Report, Department of Statistics, Stanford University, 1999
12. S. Geman, E. Bienenstock, and R. Doursat Neural networks and the bias/variance dilemma Neural Computation 4 1992 1 58
13. P.M. Granitto, P.F. Verdes, H.D. Navone, and H.A. Ceccatto A late-stopping method for optimal aggregation of neural networks Internat. J. Neural Systems 11 2001 305 310
14. K. Ikeda Multiple valued stationarity state and its instability of the transmitted light by a ring cavity system Opt. Commun. 301 1979 257 261
15. G. Karakoulas, and J. Shawe-Taylor Towards a strategy for boosting regressors A. Smola P. Bartlett B. Schölkopf D. Schuurmans Advances in Large Margin Classifiers 2000 MIT Press Cambridge, MA 247 258
16. K.-R. Müller, A. Smola, G. Rätsch, B. Schölkopf, J. Kohlmorgen, and V. Vapnik Predicting time series with support vector machines B. Schölkopf C.J.C. Burges A.J. Smola Advances in Kernel Methods - Support Vector Learning 1999 MIT Press Cambridge, MA 243 254
17. H.D. Navone, P.M. Granitto, P.F. Verdes, and H.A. Ceccatto A learning algorithm for neural network ensembles Revista Iberoamericana de Inteligencia Artificial 3 2001 70 74
18. U. Naftaly, N. Intrator, and D. Horn Optimal ensemble averaging of neural networks Network: Comput. Neural Systems 8 1997 283 296
19. G. Rätsch, A. Demiriz, and K.P. Bennett Sparse regression ensembles in infinite and finite hypothesis spaces Machine Learning 48 1-3 2002 189 218
20. G. Ridgeway, D. Madigan, and T. Richardson Boosting methodology for regression problems D. Heckerman J. Whittaker Proc. Artificial Intelligence and Statistics 1999 152 161
21. B. Rosen Ensemble learning using decorrelated neural networks Connection Science (Special Issue on Combining Artificial Neural Nets: Ensemble Approaches) 8 3-4 1996 373 384
22. A.J.C. Sharkey Combining Artificial Neural Nets 1999 Springer London
23. R. Zemel, and T. Pitassi A gradient-based boosting algorithm for regression problems T.K. Leen T.G. Dietterich V. Tresp Advances in Neural Information Processing Systems vol. 13 2001 MIT Press Cambridge, MA 696 702
24. Z.-H. Zhou, J. Wu, and W. Tang Ensembling neural networks: many could be better than all? Artificial Intelligence 137 2002 239 263