Selective negative correlation learning approach to incremental learning

Neurocomputing

Volumn 72, Issue 13-15, 2009, Pages 2796-2805

  Tang, Ke ^a   Lin, Minlong ^a   Minku, Fernanda L ^b   Yao, Xin ^a,b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Incremental learning; Negative correlation learning; Neural network ensemble; Selective ensemble

Indexed keywords

CLONING; EVOLUTIONARY ALGORITHMS;

BIOINFORMATICS DATA; ENSEMBLE LEARNING APPROACH; INCREMENTAL LEARNING; NEGATIVE CORRELATION LEARNING; NEURAL NETWORK ENSEMBLES; OBJECTIVE FUNCTIONS; SELECTIVE ENSEMBLES; TRAINED NEURAL NETWORKS;

LEARNING ALGORITHMS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOINFORMATICS; DATA BASE; INTERMETHOD COMPARISON; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL PARAMETERS; PRIORITY JOURNAL;

EID: 78149452320     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.09.022     Document Type: Article

References (33)

1. H.A. Abbass, An evolutionary artificial neural networks approach for breast cancer diagnosis, Artificial Intelligence in Medicine 25 (2002) 265-281.
2. G. Brown, Diversity in neural network ensembles, Ph.D. Thesis, School of Computer Science, University of Birmingham, 2004.
3. G.A. Carpenter, S. Grossberg, J.H. Reynolds, ARTMAP: supervised real-time learning and classification of nonstationary data by a self organizing neural network, Neural Networks 4 (1991) 565-588.
4. G.A. Carpenter, S. Grossberg, N. Markuzon, J.H. Reynolds, Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps, IEEE Transactions on Neural Networks 3 (1992) 698-713.
5. Z.S.H. Chan, N. Kasabov, A preliminary study on negative correlation learning via correlation-corrected data (NCCD), Neural Processing Letters 21 (2005) 207-214.
6. A. Chandra, X. Yao, Ensemble learning using multi-objective evolutionary algorithms, Journal of Mathematical Modelling and Algorithms 5 (2006) 417-445.
7. K. De Jong, Evolutionary Computation: A Unified Approach, MIT Press, Cambridge, 2006.
8. C. Giraud-Carrier, A note on the utility of incremental learning, AI Communications 13 (2000) 215-223.
9. H. Inoue, H. Narihisa, Self-organizing neural grove and its applications, in: Proceedings of the 2005 International Joint Conference on Neural Networks (IJCNN'05), Montreal, Canada, 2005, pp. 1205-1210.
10. Y. Jin, B. Sendhoff, Pareto-based multi-objective machine learning: an overview and case studies, IEEE Transactions on Systems, Man, and Cybernetics, Part C-Applications and Reviews 38 (2008) 397-415.
11. N. Kasabov, Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning, IEEE Transactions on Systems, Man, and Cybernetics, Part B-Cybernetics 31 (2001) 902-918.
12. L. Kuncheva, C. Whitaker, Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy, Machine Learning 51 (2003) 181-207.
13. M. Lin, K. Tang, X. Yao, Selective negative correlation learning algorithm for incremental learning, in: Proceedings of the 2008 International Joint Conference on Neural Networks (IJCNN'08), Hongkong, China, 2008, pp. 2526-2531.
14. Y Liu, Negative correlation learning and evolutionary neural network ensembles, Ph.D. Thesis, University College, The University of New South Wales, Australian Defence Force Academy, 1998.
15. Y Liu, X. Yao, Negatively correlated neural networks can produce best ensembles, Australian Journal of Intelligent Information Processing Systems 4 (1997)176-185.
16. Y Liu, X. Yao, Ensemble learning via negative correlation, Neural Networks 12 (1999)1399-1404.
17. Y Liu, X. Yao, Simultaneous training of negatively correlated neural networks in an Ensemble, IEEE Transactions on Systems, Man, and Cybernetics, Part B-Cybernetics 29 (1999) 716-725.
18. Y Liu, X. Yao, T. Higuchi, Evolutionary ensembles with negative correlation learning, IEEE Transactions on Evolutionary Computation 4 (2000) 380-387.
19. Z. Michalewicz, Genetic Algorithms + Data Structure - Evolution Programs, Springer, Berlin, 1996.
20. F.L. Minku, H. Inoue, X. Yao, Negative correlation learning in incremental learning, Natural Computing Journal (Special Issue on Nature-inspired Learning and Adaptive Systems), (2008), in press, doi: 10.1007/s11047-007-9063-7.
21. D. Newman, S. Hettich, C. Blake, C. Merz, UCI repository of machine learning databases, 1998. URL 〈http://www.ics.uci.edu/~mlearn/MLRepository.html〉.
22. R. Polikar, L. Udpa, S.S. Udpa, V. Honavar, Learn + +: an incremental learning algorithm for supervised neural networks, IEEE Transactions on Systems, Man, and Cybernetics Part C-Applications and Reviews 31 (2001) 497-508.
23. G. Pugalenthi, A. Bhaduri, R. Sowdhamini, GenDiS: genomic distribution of protein structural domain superfamilies, Nucleic Acids Research 33 (2005) D252-D255.
24. G. Pugalenthi, P.N. Suganthan, R. Sowdhamini, S. Chakrabarti, MegaMotif-Base: a database of structural motifs in protein families and superfamilies, Nucleic Acid Research 36 (2008) D218-D221.
25. G. Pugalenthi, K. Tang, P.N. Suganthan, G. Archunan, R. Sowdhamini, A machine learning approach for the identification of odorant binding proteins from sequence-derived properties, BMC-Bioinformatics 8 (2007) 351.
26. G. Pugalenthi, Ke Tang, P.N. Suganthan, S. Chakrabarti, Identification of structurally conserved residues of proteins in absence of structural homologs using neural network ensemble, Bioinformatics 25 (2) (2009) 204-210.
27. R.E. Schapire, The boosting approach to machine learning: an overview, in: D.D. Denison, M.H. Hansen, C. Holmes, B. Mallick, B. Yu (Eds.), Nonlinear Estimation and Classification, Springer, Berlin, 2003.
28. T. Seipone, J.A. Bullinaria, Evolving improved incremental learning schemes for neural network systems, in: Proceedings of the 2005 IEEE Congress on Evolutionary Computation (CEC'05), Edinburgh, UK, vol. 3, 2005, pp. 2002-2009.
29. E.L. Sonnhammer, S.R. Eddy, R. Durbin, Pfam: a comprehensive database of protein domain families based on seed alignments, Proteins 28 (1997) 405-420.
30. E.K. Tang, P.N. Suganthan, X. Yao, An analysis of diversity measures, Machine Learning 65 (2006) 247-271.
31. X. Yao, M. Fischer, G. Brown, Neural network ensembles and their application to traffic flow prediction in telecommunications networks, in: Proceedings of the 2001 International Joint Conference on Neural Networks (IJCNN'01), Washington, DC, vol. 1, 2001, pp. 693-698.
32. X. Yao, Y. Liu, Making use of population information in evolutionary artificial neural networks, IEEE Transactions on Systems, Man and Cybernetics, Part B-Cybernetics 28 (1998) 417-425.
33. Z. Zhou, J. Wu, W. Tang, Ensembling neural networks: many could be better than all, Artificial Intelligence 137 (2002) 239-263.