Analysis of decision boundaries in linearly combined neural classifiers

Pattern Recognition

Volumn 29, Issue 2, 1996, Pages 341-348

  Tumer, Kagan ^a   Ghosh, Joydeep ^a  

^a The University of Texas at Austin   (United States)

Author keywords

Combining; Decision boundary; Hybrid networks; Neural networks; Pattern classification; Variance reduction

Indexed keywords

DECISION THEORY; ERROR ANALYSIS; MATHEMATICAL MODELS; NEURAL NETWORKS; PARAMETER ESTIMATION;

COMBINED NEURAL CLASSIFIERS; DECISION BOUNDARY; HYBRID NETWORKS; PATTERN CLASSIFICATION; VARIANCE REDUCTION;

PATTERN RECOGNITION;

EID: 0030085913     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/0031-3203(95)00085-2     Document Type: Article

References (21)

1. E. Levin, N. Tishby and S. A. Solla, A statistical approach to learning and generalization in layered neural networks, Proc. IEEE 78(10), 1568-1574 (October 1990).
2. D. H. Wolpert, A mathematical theory of generalization, Complex Syst. 4, 151-200 (1990).
3. S. Geman, E. Bienenstock and R. Doursat, Neural networks and the bias/variance dilemma, Neural Comput. 4(1), 1-58 (1992).
4. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. Wiley, New York (1973).
5. K. Fukunaga, Introduction to Statistical Pattern Recognition. Academic Press, New York (1990).
6. J. Ghosh and K. Turner, Structural adaptation and generalization in supervised feed-forward networks, J. Artif. Neural Networks 1(4), 431-458 (1994).
7. D. H. Wolpert, Stacked generalization, Neural Networks 5, 241-259 (1992).
8. W. P. Lincoln and J. Skrzypek, Synergy of clustering multiple back propagation networks, Adv. Neural Inf. Process. Syst. 2, 650-657 (1990).
9. M. P. Perrone and L. N. Cooper, When networks disagree: Ensemble methods for hybrid neural networks, Neural Networks for Speech and Image Processing, R. J. Mammone, ed. Chapman-Hall, New York (1993).
10. K. Tumer and J. Ghosh, A framework for estimating performance improvements in hybrid pattern classifiers, Proc. of the World Congress Neural Networks, Vol. III, pp. 220-225. INNS Press (1994).
11. J. Ghosh, S. Beck and C. C. Chu, Evidence combination techniques for robust classification of short-duration oceanic signals, SPIE Conf. Adapt. Learning Syst. SPIC Proc. Vol. 1706, pp. 266-276. Orlando, Florida (April 1992).
12. J. Ghosh, K. Turner, S. Beck and L. Deuser, Integration of neural classifiers for passive sonar signals, DSP Theory and Applications. C. T. Leondes, ed. Academic Press, New York (to be published).
13. L. Xu, A. Krzyzak and C. Y. Suen, Methods of combining multiple classifiers and their applications to handwriting recognition, IEEE Trans. Syst. Man Cybernet. 22(3), 418-435 (May 1992).
14. G. Rogova, Combining the results of several neural network classifiers, Neural Networks 7(5), 777-781 (1994).
15. D. Heckerman, Probabilistic interpretation for MY-CIN's uncertainty factors, Uncertainty in Artificial Intelligence, L. N. Kanal and J. F. Lemmer, eds, pp. 167-196. North-Holland, Amsterdam (1986).
16. M. D. Richard and R. P. Lippmann, Neural network classifiers estimate Bayesian a posteriori probabilities, Neural Comput. 3(4), 461-483 (1991).
17. P. A. Shoemaker, M. J. Carlin, R. L. Shimabukuro and C. E. Priebe, Least squares learning and approximation of posterior probabilities on classification problems by neural network models, Proc. 2nd Workshop Neural Networks, pp. 187-196. WNN-AIND91, Auburn (February 1991).
18. S. Hashem, Optimal Linear Combinations of Neural Networks. Ph.D. thesis, Purdue University (December 1993).
19. M. P. Perrone, Improving Regression Estimation: Averaging Methods for Variance Reduction with Extensions to General Convex Measure Optimization. Ph.D. thesis, Brown University (May 1993).
20. X. Zhang, J. P. Mesirov and D. L. Waltz, Hybrid system for protein secondary structure prediction, J. Mol. Biol. 225, 1049-1063 (1992).
21. K. Turner and J. Ghosh, Boundary variance reduction for improved classification through hybrid networks (Invited paper), Applications and Science of Artificial Neural Networks, Proc. SPIE, Vol. 2492, pp. 573-584 (April 1995).