Bootstrapping with Noise: An Effective Regularization Technique

Connection Science

Volumn 8, Issue 3-4, 1996, Pages 355-372

  Raviv, Yuval ^a   Intrator, Nathan ^a,b  

^a TEL AVIV UNIVERSITY   (Israel)

^b BROWN UNIVERSITY   (United States)

Author keywords

Clinical data analysis; Combining estimators; Noise injection; Pattern classification; Two spiral problem

Indexed keywords

EID: 0030374103     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/095400996116811     Document Type: Article

References (31)

1. Baum, E. & Lang, K. (1991) Constructing hidden units using examples and queries. In R. P. Lippmann, J. E. Moody & D. S. Touretzky (Eds), Advances in Neural Information Processing Systems, Vol. 3. San Mateo, CA: Morgan Kaufmann, pp. 904-910.
2. Bishop, C.M. (1995) Training with noise is equivalent to Tikhonov regularization. Neural Computation, 7, 108-116.
3. Brazdil, P. & Henery, R. (1994) Analysis of results. In D. Michie, D. J. Spiegelhalter & C. C. Taylor (Eds), Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood, pp. 175-212.
4. Breiman, L. (1994) Bagging Predictors. Technical Report TR-421, Department of Statistics, University of California, Berkeley, CA.
5. Deffuant, G. (1995) An algorithm for building regularized, piecewise linear discrimination surfaces: the perception membrane. Neural Computation, 7, 480-489.
6. Detrano, R. (1989) Accuracy curves: An alternative graphical representation of probability data. Journal of Clinical Epidemiology, 42, 983-986.
7. Detrano, R., Janosi, A., Steinbrunn, W., Pfisterer, M., Schmid, J., Sandhu, S., Guppy, K., Lee, S. & Froelicher, V. (1989) International application of a new probability algorithm for the diagnosis of coronary artery disease. American Journal of Cardiology, 64, 304-310.
8. Efron, B. & Tibshirani, R. (1993) An Introduction to the Bootstrap. New York: Chapman and Hall.
9. Fahlman, S.E. (1989) Fast-learning variations on back-propagation: An empirical study. In D. Touretzky, G. Hinton & T. Sejnowski (Eds), Proceedings of the 1988 Connectionist Models Summer School. San Mateo, CA: Morgan Kaufmann, pp. 38-51.
10. Fahlman, S.E. & Lebiere, C. (1990) The Cascade-Correlation Learning Architecture. Cmu-cs-90-100, Carnegie Mellon University, Pittsburgh, PA.
11. Geman, S., Bienenstock, E. & Doursat, R. (1992) Neural networks and the bias-variance dilemma. Neural Computation, 4, 1-58.
12. Gennari, J.H., Langley, P. & Fisher, D. (1988) Models of incremental concept formation. Artificial Intelligence, 40, 11-61.
13. Goodenough, D.J., Rossmann, K. & Lusted, L.B. (1974) Radiographic applications of receiver operating characteristic (ROC) curves. Radiology, 110, 89-95.
14. Hanley, J.A. & McNeil, B.J. (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29-36.
15. Hansen, L.K. & Salamon, P. (1990) Neural networks ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12, 993-1001.
16. Hastie, T. & Tibshirani, R. (1986) Generalized additive models. Statistical Science, 1, 297-318.
17. Hastie, T. & Tibshirani, R. (1990) Generalized Additive Models. London: Chapman and Hall.
18. Henderson, A.R. (1993) Assessing test accuracy and its clinical consequences: a primer for receiver operating characteristic curve analysis. Annals of Clinical Biochemistry, 30, 521-539.
19. Hoaglin, D.C., Mosteller, F. & Tukey, J.W. (1983) Understanding Robust and Exploratory Data Analysis. New York: Wiley.
20. Hogg, R.V. & Craig, A.T. (1970) Introduction to Mathematical Statistics (3rd edn). Toronto, Canada: Macmillan.
21. Krogh, A. & Hertz, J.A. (1992) A simple weight decay can improve generalization. In J. E. Moody, S. J. Hanson & R. P. Lippmann (Eds), Advances in Neural Information Processing Systems, Vol. 4. San Mateo, CA: Morgan Kaufmann, pp. 950-957.
22. Lang, K.J. & Witbrock, M.J. (1988) Learning to tell two spirals apart. In D. S. Touretzky, J. L. Ellman, T. J. Sejnowski & G. E. Hinton (Eds), Proceedings of the 1988 Connectionists Models, pp. 52-59.
23. Lehmann, E.L. (1975) Nonparametrics: Statistical Methods Based on Ranks. San Francisco, CA: Holden and Day.
24. Lippmann, R.P., Kukolich, L. & Shahian, D. (1995) Predicting the risk of complications in coronary artery bypass operations using neural networks. In G. Tesauro, D. Touretzky & T. Leen (Eds), Advances in Neural Information Processing Systems, Vol. 7. Cambridge, MA: MIT Press, pp. 1055-1062.
25. Murphy, P.M. & Aha, D.W. (1992) UCI Repository of machine learning databases. Department of Information and Computer Science, University of California at Irvine.
26. Perrone, M.P. (1993) Improving Regression Estimation: Averaging Methods for Variance Reduction with Extensions to General Convex Measure Optimization. PhD thesis, Brown University, Institute for Brain and Neural Systems, Providence, RI.
27. Ripley, B.D. (1996) Pattern Recognition and Neural Networks. Oxford Press.
28. Sietsma, J. & Dow, R.J.F. (1991) Creating artificial neural networks that generalize. Neural Networks, 4, 67-79.
29. Stensmo, M. (1995) Adaptive Automated Diagnosis. PhD thesis, Royal Institute of Technology, Stockholm, Sweden
30. Ultragem Data Mining (UDM) (1996) Esprit Statlog Benchmarks. Technical Report, Boulder Creek, CA.
31. Wolpert, D.H. (1992) Stacked generalization. Neural Networks, 5, 241-259.