Training regression ensembles by sequential target correction and resampling

Information Sciences

Volumn 195, Issue , 2012, Pages 154-174

  Ñanculef, Ricardo ^a   Valle, Carlos ^a   Allende, Héctor ^a   Moraga, Claudio ^b,c  

^a DEPARTAMENTO DE FÍSICA   (Chile)

^b EUROPEAN CENTRE FOR SOFT COMPUTING   (Spain)

^c TU DORTMUND UNIVERSITY   (Germany)

Author keywords

AdaBoost; Bagging; Diversity; Ensemble learning; Negative Correlation; Regression estimation

Indexed keywords

BAGGING; DIVERSITY; ENSEMBLE LEARNING; NEGATIVE CORRELATION; REGRESSION ESTIMATION;

ADAPTIVE BOOSTING; ALGORITHMS; DATA PROCESSING; ERRORS; ESTIMATION;

REGRESSION ANALYSIS;

EID: 84858446140     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.01.035     Document Type: Article

References (46)

1. M.A.H. Akhand, Md. Monirul Islam, and K. Murase Progressive interactive training: a sequential neural network ensemble learning method Neurocomputing 73 1-3 2009 260 273
2. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, 1998.
3. O. Bousquet, and A. Elisseeff Stability and generalization Journal of Machine Learning Research 2 2002 499 526 (Pubitemid 135712570)
4. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140 (Pubitemid 126724382)
5. G. Brown, Diversity in Neural Network Ensembles, PhD thesis, School of Computer Science, University of Birmingham, 2003.
6. G. Brown, J. Wyatt, R. Harris, and X. Yao Diversity creation methods: a survey and categorisation Information Fusion Journal (Special issue on Diversity in Multiple Classifier Systems) 6 1 2004 5 20
7. G. Brown, J.L. Wyatt, and P. Tiňo Managing diversity in regression ensembles Journal of Machine Learning Research 6 2005 1621 1650
8. H. Drucker, Improving regressors using boosting techniques, in: Fourteenth International Conference on Machine Learning, 1997, pp. 107-115.
9. S.E. Fahlman, C. Lebiere. The cascade-correlation learning architecture, in: D.S. Touretzky (Ed.), Advances in Neural Information Processing Systems, vol. 2, Denver 1989, Morgan Kaufmann, San Mateo, 1990, pp. 524-532.
10. X.Z. Fern, and C.E. Brodley Solving cluster ensemble problems by bipartite graph partitioning ICML '04: Proceedings of the Twenty-First International Conference on Machine Learning 2004 ACM Press New York, NY, USA 36 43
11. J.H. Friedman Multivariate adaptive regression splines Annals of Statistics 19 1 1991 1 141
12. Y. Grandvalet, Bagging down-weights leverage points, in: IJCNN, vol. IV, 2000, pp. 505-510.
13. Y. Grandvalet Bagging equalizes influence Machine Learning 55 3 2004 251 270
14. M. Haindl, J. Kittler, F. Roli (Eds.), Multiple Classifier Systems, 7th International Workshop, MCS 2007, Prague, Czech Republic, May 23-25, 2007, Proceedings, Lecture Notes in Computer Science, vol. 4472, Springer, 2007.
15. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning 2001 ed. 2001 Springer
16. P. Huber, Robust Statistics, Wiley Series in Probability and Mathematical Statistics, 1981.
17. R. Jacobs, M. Jordan, S. Nowlan, and G. Hinton Adaptative mixtures of local experts Neural Computation 3 1 1991 79 87
18. A. Krogh, and J. Vedelsby Neural network ensembles, cross-validation and active learning Neural Information Processing Systems 7 1995 231 238
19. L. Kuncheva Combining Pattern Classifiers: Methods and Algorithms 2004 Wiley InterScience
20. L. Kuncheva, and C. Whitaker Measures of diversity in classifier ensembles Machine Learning 51 2 2003 181 207
21. Y. Liu, Negative Correlation Learning and Evolutionary Neural Network Ensembles, PhD thesis, University College, The University of New South Wales, Australian Defence Force Academy, Canberra, Australia, 1998.
22. Y. Liu, and X. Yao Negatively correlated neural networks can produce best ensemble Australian Journal of Intelligent Information Processing Systems 4 3/4 1997 176 185
23. Y. Liu, and X. Yao Ensemble learning via negative correlation Neural Networks 12 10 1999 1399 1404
24. T. Mitchell Machine Learning first ed. 1997 Mc Graw-Hill
25. U. Naftaly, N. Intrator, and D. Horn Optimal ensemble averaging of neural networks Network: Computation in Neural Systems 8 1997 283 296 (Pubitemid 127729018)
26. D. Opitz, and R. Maclin Popular ensemble methods: an empirical study Journal of Machine Learning Research 11 1999 169 198 (Pubitemid 129628763)
27. N.C. Oza, R. Polikar, J. Kittler, F. Roli (Eds.), Multiple Classifier Systems, 6th International Workshop, MCS 2005, Seaside, CA, USA, June 13-15, 2005, Proceedings, Lecture Notes in Computer Science, vol. 3541, Springer, 2005.
28. T. Poggio, R. Rifkin, S. Mukherjee, Bagging Regularizes, Technical Report 214/AI Memo 2002-003, MIT CBCL, 2002.
29. T. Poggio, and S. Smale The mathematics of learning: dealing with data Notices of the American Mathematical Society 50 5 2003 537 544
30. R. Polikar Ensemble based systems in decision making IEEE Circuits and Systems 24 4 2006 21 45
31. R. Polikar Bootstrap inspired techniques in computational intelligence IEEE Signal Processing 6 3 2007 56 72
32. G. Rätsch, S. Mika, B. Schölkopf, and Klaus-Robert Müller Constructing boosting algorithms from SVMs: an application to one-class classification IEEE Transactions on Pattern Analysis and Machine Intelligence 24 9 2002 1184 1199 (Pubitemid 35242580)
33. B. Rosen Ensemble learning used decorrelated neural networks Connection Science (Special Issue on Combining Artificial Neural Networks: Ensemble Approaches) 8 3-4 1999 373 384
34. R. Schapire, A short introduction to boosting, in: Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, 1999, pp. 771-780.
35. R. Schapire, Theoretical views of boosting, in: Computational Learning Theory: Fourth European Conference, 1999, pp. 1-10.
36. B. Schölkopf, and A.J. Smola Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond 2001 MIT Press
37. A. Strehl, J. Ghosh, Cluster ensembles-a knowledge reuse framework for combining partitionings, in: Proceedings of AAAI 2002. AAAI, Edmonton, Canada, 2002, pp. 93-98.
38. A. Tikhonov, and V. Arsenin Solutions of Ill-posed Problems 1977 Winston
39. G. Tsoumakas, L. Angelis, and I. Vlahavas Selective fusion of heterogeneous classifiers Intelligent Data Analysis 9 6 2005 511 525
40. N. Ueda, R. Nakano, Generalization error of ensemble estimators, in: Proceedings of International Conference on Neural Networks, 1996, pp. 90-95.
41. A. Ulas, M. Semerci, O.T. Yildiz, and E. Alpaydin Incremental construction of classifier and discriminant ensembles Information Sciences 179 9 2009 1298 1318
42. V. Vapnik Statistical Learning Theory 1998 ed. 1998 Wiley-Interscience
43. P. Vlachos. StatLib datasets archive, 2005.
44. D.H. Wolpert Stacked generalization Neural Networks 5 2 1992 241 259
45. J. Xiao, C. He, X. Jiang, and D. Liu A dynamic classifier ensemble selection approach for noise data Information Sciences 180 2010 3402 3421
46. P. Zhang A neural network ensemble method with jittered training data for time series forecasting Information Sciences 177 2007 5329 5346