The build of a dynamic classifier selection ICBP system and its application to pattern recognition

Neural Computing and Applications

Volumn 19, Issue 1, 2010, Pages 123-137

  Dai, Qun ^a  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Circular back propagation neural network (CBP); Discriminant adaptive nearest neighbor (DANN) metric; Dynamic classifier selection (DCS); Improved circular back propagation neural network (ICBP); Local accuracy estimation (LA); Multiple classifier system (MCS); Neural network ensemble (NNE)

Indexed keywords

EID: 74449084730     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-009-0263-1     Document Type: Article

References (39)

1. Hansen LK, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12(10): 993-1001.
2. Zhou ZH, Wu J, Tang W (2002) Ensembling neural networks: many could be better than all. Artif Intell 137(1-2): 239-263.
3. Sollich P, Krogh A (1996) Learning with ensembles: how over-fitting can be useful. In: Touretzky DS, Mozer MC, Hasselmo ME et al (eds) Advances in neural information processing systems 8. MIT Press, Cambridge, pp 190-196.
4. Gutta S, Wechsler H (1996) Face recognition using hybrid classifier systems. In: Proceedings of ICNN-96. IEEE Computer Society Press, Los Alamitos, pp 1017-1022.
5. Huang FJ, Zhou Z-H, Zhang H-J, Chen TH (2000) Pose invariant face recognition. In: Proceedings of 4th IEEE international conference on automatic face and gesture recognition. IEEE Computer Society Press, Grenoble, pp 245-250.
6. Drucker H, Schapire R, Simard P (1993) Improving performance in neural networks using a boosting algorithm. In: Hanson SJ, Cowan JD, Giles CL (eds), Advances in neural information processing systems 5. Morgan Kaufmann, Denver, pp 42-49.
7. Hansen LK, Liisberg L, Salamon P (1992) Ensemble methods for handwritten digit recognition. In: Proceedings of IEEE workshop on neural networks for signal processing. IEEE Press, Helsingoer, pp 333-342.
8. Mao J (1998) A case study on bagging, boosting and basic ensembles of neural networks for OCR. In: Proceedings of IJCNN-98, vol 3. IEEE Computer Society Press, Anchorage, pp 1828-1833.
9. Cherkauer KJ (1996) Human expert level performance on a scientific image analysis task by a system using combined artificial neural networks. In: Chan P, Stolfo S, Wolpert D (eds) Proceedings of AAAI-96 workshop on integrating multiple learned models for improving and scaling machine learning algorithms. AAAI Press, Portland, pp 15-21.
10. Cunningham P, Carney J, Jacob S (2000) Stability problems with artificial neural networks and the ensemble solution. Artif Intell Med 20(3): 217-225.
11. Breiman L (1996) Bagging predictors. Machine Learning 24(2): 123-140.
12. Efron B, Tibshirani R (1993) An introduction to the Bootstrap. Chapman & Hall, New York.
13. Schapire RE (1990) The strength of weak learnability. Mach Learn 5(2): 197-227.
14. Clemen RT, Winkler RL (1985) Limits for the precision and value of information from dependent sources. Oper Res 33: 427-442.
15. Perrone M, Cooper LN (1993) When networks disagree: ensemble methods for hybrid neural networks. In: Mammone RJ (ed) Neural networks for speech and image processing. Chapman & Hall, London.
16. Liu Y, Yao X (1999) Simultaneous training of negatively correlated neural networks in an ensemble. IEEE Trans Syst Man Cybern B Cybern 29: 716-725.
17. Chan ZSH, Kasabov N (2005) Fast neural network ensemble learning via negative-correlation. IEEE Trans Neural Netw 16(6): 1707-1710.
18. Domany E (1999) Superparamagnetic clustering of data-the definitive solution of an ill-posed problem. Phys A 263(1-4): 158-169.
19. Yuansong Liao, John Moody (1999) Constructing heterogeneous committees using input feature grouping: application to economic forecasting. In: Advance in neural information processing system 1999: 921-927.
20. Xu L, Krzyzak A, Suen CY (1992) Methods for combining multiple classifiers and their applications to handwriting recognition. IEEE Trans Syst Man Cybern 22(3): 418-435.
21. Giacinto G, Roli F, Fumera G (1997) Adaptive selection of image classifiers, image analysis and processing. In: Proceedings of the 9th international conference, ICIAP'97, vol 1, Florence, 17-19 September 1997, pp 38-45.
22. Giacinto G, Roli F (2000) A theoretical framework for dynamic classifier selection. In: International conference on pattern recognition (ICPR'00), vol II. IEEE Computer Society, Barcelona, 3-8 September 2000, pp 2008-2011.
23. Didaci L, Giacinto G (2004) Dynamic classifier selection by adaptive k-nearest-neighbourhood rule, multiple classifier systems. In: Proceedings of 5th international workshop, MCS 2004, Cagliari, 9-11 June 2004, pp 174-183.
24. Woods K, Kegelmeyer WP, Bowyer K (1997) Combination of multiple classifiers using local accuracy estimates. IEEE Trans Pattern Anal Mach Intell 19(4): 405-410.
25. Ridella S, Rovetta S, Zunino R (1997) Circular back-propagation networks for classification. IEEE Trans Neural Netw 8(1): 84-97.
26. Ridella S, Rovetta S, Zunino R (1999) Circular back-propagation networks embed vector quantization. IEEE Trans Neural Netw 10(4): 972-975.
27. Ridella S, Rovetta S, Zunino R (1997) CBP networks as a generalized neural model. Int Conf Neural Netw 210-214.
28. Dai Q, Chen SC, Zhang BZ (2003) Improved CBP neural network model with applications in time series prediction. Neural Process Lett 18: 197-211.
29. Dai Q, Chen SC (2003) The research on multi-step and robust time series prediction techniques based on ICBP networks, Thesis of Master degree, Computer Science Department of Nanjing University of Aeronautics and Astronautics, March 2003.
30. Zhang BZ (2001) The research on the performance and applications of improved BP neural networks, Thesis of Master degree, Computer Science Department of Nanjing University of Aeronautics and Astronautics, February 2001.
31. Zhang BZ, Chen SC (2001) Equivalence between vector quantization and ICBP networks. Journal of Data Acquis Process (in Chinese) 16(3): 291-294.
32. Zhang BZ, Chen SC (2001) The equivalence between ICBP and the Bayesian classifier, Tech. Report No. 021, Department of Computer Science and Engineering, Nanjing University of Aeronautics and Astronautics.
33. Haykin S (1999) Neural networks. A comprehensive foundation. Prentice-Hall, Englewood Cliffs.
34. Hastie T, Tibshirani R (1996) Discriminant adaptive nearest neighbor classification. IEEE Trans Pattern Anal Mach Intell 18(6): 607-615.
35. Weijters A (1995) The BP-SOM architecture and learning rule. Neural Process Lett 2(6): 13-16.
36. Weijters A, Bosch VD, Herik HJ (1997) Intelligible neural networks with BP-SOM. Marcke and Daelemans, pp 27-36.
37. Eggermont J (1998) Rule-extraction and learning in the BP-SOM architecture. Thesis of master degree, Computer Science Department of Leiden University.
38. Prechelt L, Proben1 (1994) A set of neural network benchmark problems and benchmarking rules. Technical Report 24/94, Fakultat fur informatic, University Karlsruhe, Germany.
39. UCI repository of machine learning databases available at http://www. ics. uci. edu/~mlearn/MLRepository. html or ftp. ics. uci. edu: pub/machine-learning-databases.