Reducing Variance of Committee Prediction with Resampling Techniques

Connection Science

Volumn 8, Issue 3-4, 1996, Pages 405-426

  Parmanto, Bambang ^a   Munro, Paul W ^a   Doyle, Howard R ^b  

^a UNIVERSITY OF PITTSBURGH   (United States)

^b UNIVERSITY OF PITTSBURGH MEDICAL CENTER   (United States)

Author keywords

Bias variance; Bootstrap; Committee; Cross validation; Ensemble; Regularization; Resampling techniques

Indexed keywords

EID: 0030352275     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/095400996116848     Document Type: Article

References (13)

1. Breiman, L. (1992) Stacked Regressions. Technical Report 367, Department of Statistics, University of California, Berkeley.
2. Breiman, L. (1994) Bagging Predictors. Technical Report 421, Department of Statistics, University of California, Berkeley, CA.
3. Doyle, H.R., Parmanto, B. & Munro, P.W. (1995) Building clinical classifiers using incomplete observations - a neural network ensemble for hepatoma detection in patients with cirrhosis. Methods in Information and Medicine, 34, 253-258.
4. Efron, B. & Tibshirani, R.J. (1993) An Introduction to the Bootstrap. London: Chapman and Hall.
5. Geman, S., Bienenstock, E. & Doursat, R. (1992) Neural networks and the bias/variance dilemma. Neural Computation, 4, 1-58.
6. Hashem, S. (1994) Optimal Linear Combinations of Neural Networks. PhD Thesis, Purdue University, West Lafayette, IN.
7. Meir, R. (1994) Bias, Variance and the Combination of Estimators: The Case of Linear Least Suares. Technical Report, Department of Electrical Engineering, Technion, Israel.
8. Murphy, P.M. & Aha, D.W. (1994) UCI Repository of Machine Learning Databases [ftp: ics.uci.edu/pub/ machine-learning-databases/].
9. Parmanto, B., Munro, P.W., Doyle, H.R., Doria, C., Aldrighetti, L., Marino, I.R., Mitchel, S. & Fung, J.J. (1994) Neural network classifier for hepatoma detection. Proceedings of the World Congress of Neural Networks, San Diego.
10. Parmanto, B., Munro, P.W. & Doyle, H.R. (1996) Improving committee diagnosis with resampling techniques. In D. Touretsky, M. Mozer & M. Hasselmo (Eds), Advances in Neural Information Processing Systems - 8. Cambridge, MA: MIT Press.
11. Perrone, M.P. (1993) Improving Regression Estimation: Averaging Methods for Variance Reduction with Extension to General Convex Measure Optimization. PhD Thesis, Department of Physics, Brown University, Providence, RI.
12. Smith, J.W., Everhart, J.E., Dickson, W.C., Knowler, W.C. & Johannes, R.S. (1988) Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In Proceedings of the Symposium on Computer Applications and Medical Care. IEEE Computer Society Press, pp. 261-265.
13. Wolpert, D. (1992) Stacked generalization. Neural Networks, 5, 241-259.