Competition among networks improves committee performance

Advances in Neural Information Processing Systems

Volumn , Issue , 1997, Pages 592-598

  Munro, Paul W ^a   Parmanto, Bambang ^a  

^a UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIAS AND VARIANCE; COMPETITIVE LEARNING; ERROR REDUCTION; GENERALIZATION ERROR; GENERALIZATION PERFORMANCE; INDIVIDUAL NETWORK; MISCLASSIFICATIONS; WINNER TAKE ALLS;

EID: 84898967199     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Bates, J.M., and Granger, C.W. (1969) "The combination of forecasts," Operation Research Quarterly, 20(4), 451-468.
2. Breiman, L, (1992) "Stacked Regressions", TR 367, Dept. of Statistics, Univ. of Cal. Berkeley.
3. Caruana, R (1995) "Learning many related tasks at the same time with backpropagation," In:Advances in Neural Information Processing Systems 7. D. S. Touretsky, ed. Morgan Kaufmann.
4. Chauvin, Y. (1989) "A backpropagation algorithm with optimal use of hidden units." In Touretzky D., (ed.), Advances in Neural Information Processing i, Denver, 1988, Morgan Kaufmann.
5. Geman, S., Bienenstock, E., and Doursat, R. (1992) "Neural networks and the bias/variance dilemma," Neural Computation 4,1-58.
6. Hashem, S. (1994). Optimal Linear Combinations of Neural Networks., PhD Thesis, Purdue University.
7. Jacobs, R.A., Jordan, M.I., Nowlan, S.J., and Hinton, G.E. (1991) "Adaptive mixtures of local experts," Neural Computation, 3,79-87
8. Le Cun, Y., Denker J. and Solla, S. (1990). Optimal Brain Damage. In D. Touretzky (Ed.) Advances in Neural Information Processing Systems 2, San Mateo: Morgan Kaufmann. 598-605.
9. Morgan, N. & Boulard, H. (1990) Generalization and parameter estimation in feedforward nets: some experiments. In D. Touretzky (Ed.) Advances in Neural Information Processing Systems 2 San Mateo: Morgan Kaufmann.
10. Parmanto, B., Munro, P.W., Doyle, H.R., Doria, C, Aldrighetti, L., Marino, I.R., Mitchel, S., and Fung, J.J. (1994) "Neural network classifier for hepatoma detection," Proceedings of the World Congress of Neural Networks
11. Parmanto, B., Munro, P.W., Doyle, H.R. (1996) "Improving committee diagnosis with resampling techniques," In: D. S. Touretzky, M. C. Mozer, M. E. Hasselmo, eds. Advances in Neural Information Processing Systems 8. MIT Press: Cambridge, MA.
12. Perrone, M.P. (1993) "Improving Regression Estimation: Averaging Methods for Variance Reduction with Extension to General Convex Measure Optimization," PhD Thesis, Department of Physics, Brown University.
13. Rumelhart. D.E and Zipser, D. (1986) "Feature discovery by competitive learning," In: Rumelhart, D.E.and McClelland, J.E. (Eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition. MIT Press, Cambridge, MA.
14. Wolpert, D. (1992). Stacked generalization, Neural Networks, 5,241-259.