A Robust Back Propagation Learning Algorithm for Function Approximation

IEEE Transactions on Neural Networks

Volumn 5, Issue 3, 1994, Pages 467-479

  Chen, David S ^a   Jain, Ramesh C ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; ERROR CORRECTION; FUNCTION EVALUATION; INTERPOLATION; ITERATIVE METHODS; LEARNING SYSTEMS; MATHEMATICAL MODELS; MATHEMATICAL TRANSFORMATIONS; NEURAL NETWORKS;

FUNCTION APPROXIMATION; GROSS ERRORS; ROBUST BACK PROPAGATION LEARNING ALGORITHM;

ALGORITHMS;

EID: 0028428006     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.286917     Document Type: Article

References (27)

1. P. Besl and J. Jain, “Segmentation through variable-order surface fitting,” IEEE Trans. Pattern Anal. Machine Intell., vol. 10, no. 2, pp. 167-192, Mar. 1988.
2. D. S. Chen, “Function representation and approximation by neural networks,” Ph.D. dissertation, Univ. Michigan, Ann Arbor, 1991.
3. D. S. Chen and J. P. Allebach, “Analysis of error in reconstruction of two-dimensional signals from irregularly spaced samples,” IEEE Trans. Acoust. Speech, Signal Processing, vol. ASSP-35, no. 2, pp. 173-180, 1987.
4. P. Diaconis and M. Shahshahani, “On linear functions of linear combinations,” SIAM J. Sci. Stat. Comput., vol. 5, no. 1, pp. 175-191, 1984.
5. D. L. Donoho and I. M. Johnstone, “Projection-based approximation and a duality with kernel methods,” Ann. Statist., vol. 17, no. 1, pp. 58-106, 1989.
6. B. Efron and R. Tibshirani, “Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy,” Statist. Sci., vol. 1, pp. 54-77, 1988.
7. J. H. Friedman and W. Stuetzle, “Projection pursuit regression,” J. Amer. Statist. Assoc., vol. 76, pp. 817-823, 1981.
8. J. H. Friedman, “Classification and multiple regression through projection pursuit,” Dep. Statist., Standford Univ. and Stanford Linear Accelerator Center, Tech. Rep. LCS 12, 1985.
9. E. J. Hartman, J. E. Keeler, and J. M. Kowalski, “Layered neural networks with Gaussian hidden units as universal approximations,” in Neural Computation, vol. 2. Cambridge, MA: MIT Press, 1990, pp. 210-215.
10. K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks, vol. 2, pp. 359-366, 1989.
11. F. R. Hampel, P. J. Rousseeuw, and E. Ronchetti, “The change-of-variance curve and optimal redescending M-estimators,” J. Amer. Statist. Assoc., vol. 76, no. 375, pp. 643-648, 1981.
12. F. R. Hampel, P. J. Rousseeuw, E. M. Ronchetti, and W. A. Stahel, Robust Statistics—The Approach Based on Influence Function. New York: Wiley, 1986.
13. F. R. Hampel, “The influence curve and its role in robust estimation,” J. Amer. Statist. Assoc., vol. 69, no. 346, pp. 383-393, 1974.
14. K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Netowrks. vol. 2, pp. 359-366, 1989.
15. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
16. C. Ji, R. R. Snapp, and D. Psaltis, “Generalizing smoothness constraints from discrete samples,” Neural Computation, vol. 2, pp. 188-197, 1990.
17. Y. Le Cun, “A theoretical framework for backpropagation,” in Proc. 1988 Connectionist Models Summer School, D. Touretzky, G. Hinton, and T. Sejnowski, Eds. June 17-26, 1988. San Mateo, CA: Morgan Kaufmann, pp. 21-28.
18. N. McKay. “Some mathematical properties of three-layer perceptron-like neural nets.” General Motors Research Labs. Warren, MI, Res. Memo 50-510, 1990.
19. R. Hetch-Neilsen, “Theory of the backpropagation neural network.” in Proc. 1989 IEEE 3rd Int. Conf. Neural Networks, 1989.
20. T. Poggio, and F. Girosi, “Networks for approximation and learning,” Proc. IEEE. vol. 78, no. 9, pp. 1481-1497. 1990.
21. P. J. Rousseeuw, and M. A. Leroy. Robust Regression and Outlier Detection. New York: Wiley. 1987.
22. D. E. Rummelhart, G. E. Hinton, and R. J. Williams, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. I. MIT Press, ch. 8.
23. S. Sinha and B. Schunck, “A two stage algorithm for discontinuity preserving surface reconstruction.” IEEE Trans. Pattern Anal. Machine Intell., to be published
24. G. Wahba, Spline Models for Observational Data (CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 59). Soc. Industrial Applied Mathematics, 1990.
25. B. Widrow and M. E. Hoff. “Adaptive switching circuits.” in 1960 IRE WESCON Convention Rec., part 4. pp. 96-104. 1960.
26. M. Vidyasagar, Nonlinear Systems Analysis. Englewood Cliffs. NJ: Prentice-Hall, 1978.
27. B. Widrow, R. G. Winter, and R. A. Baxter. “Layered neural nets for pattern recognition,” IEEE Trans. Acoust., Speech. Signal Processing, vol. 36, no. 7, pp. 1109-1118. 1988.