Estimations of error bounds for neural-network function approximators

IEEE Transactions on Neural Networks

Volumn 10, Issue 2, 1999, Pages 217-230

  Townsend, Neil W ^a   Tarassenko, Lionel ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Error prediction; Neural networks; Perturbation models; Radial basis function networks

Indexed keywords

APPROXIMATION THEORY; ERROR ANALYSIS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PERTURBATION TECHNIQUES; VECTORS;

RADIAL BASIS FUNCTION (RBF) NETWORKS;

NEURAL NETWORKS;

EID: 0033100605     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.750542     Document Type: Article

References (30)

1. D. R. Hush and B. Horne, "Progress in supervised neural networks," IEEE Signal Processing Mag., Jan. 1993, pp. 8-39.
2. C. M. Bishop, "Novelty detection and neural network validation," Proc. Inst. Elect. Eng. Vision, Image, Signal Processing, vol. 141, no. 4, pp. 217-222, Aug. 1994.
3. N. W. Townsend, Neural Networks for Mobile Robot Localisation Using Infrared Range Sensing, D.Phil, dissertation, Oxford Univ., 1995.
4. L. Xu, A. Kryzak, and A. Yuille, "On radial basis function nets and kernal regression: Statistical consistency, convergence rates, and receptive field size," Neural Networks, vol. 7, no. 4, pp. 609-628, 1994.
5. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Networks, vol. 2, pp. 302-309, Mar. 1991.
6. J. Moody and C. J. Darken, "Fast learning in networks of locally-tuned processing units," Neural Comput., vol. 1, pp. 281-294, 1989.
7. T. Kohonen, "Self-organized formation of topologically correct feature maps," Biol. Cybern., vol. 43, pp. 59-69, 1982.
8. _, "The self-organizing map," Proc. IEEE, vol. 78, pp. 1464-1480, 1990.
9. L. Tarassenko and S. Roberts, "Supervised and unsupervised learning in radial basis function classifiers," Proc. Inst. Elect. Eng. Vision, Image, Signal Processing, vol. 141, no. 4, pp. 210-216, 1994.
10. A. Kryzak, T. Linder, and G. Lugosi, "Nonparametric estimation and classification using radial basis function nets and empirical risk minimization," IEEE Trans. Neural Networks, vol. 7, pp. 475-487, Mar. 1996.
11. E. Hartman and J. D. Keeler, "Predicting the future: Advantages of semilocal units," Neural Comput., vol. 3, pp. 566-578, 1992.
12. M. Stevenson, R. Winter, and B. Widrow, "Sensitivity of feedforward neural networks to weight errors," IEEE Trans. Neural Networks, vol. 1, pp. 71-80, Mar. 1990.
13. R. Tibshirani, "A comparison of some error estimates for neural network models," Neural Comput., vol. 8, pp. 152-163, 1996.
14. J. S. Denker and Y. Le Cun, "Transforming neural-net output levels to probability distributions," in Advances in Neural Information Processing Systems, R. P. Lippmann, et al., Eds., vol. 3. San Mateo, CA: Morgan Kaufmann, 1991, pp. 853-859.
15. N. Tishby, E. Levin, and S. A. Solla, "Consistent inference of probabilities in layered networks: Predictions and generalization," in Proc. Int. Joint Conf. Neural Networks, Washington, D.C., 1989, pp. 403-409.
16. D. J. C. MacKay, "A practical bayesian framework for backpropagation networks," Neural Comput., vol. 4, pp. 448-472, 1992.
17. D. H. Wolpert, "Bayesian backpropagation over I/O functions rather than weights," 1994, SFI tech. rep. Available ftp://archive.cis.ohios-state.edu/pub/neuroprose/wolpert.nips-93.ps.Z
18. C. Bishop, "Mixture density networks," Tech. Rep. NCRG/94/004, Aston University, NCRG, Aston University, Birmingham, B4 7ET, UK, 1994. Available http://neural-server.aston.ac.uk/Papers/postscript/NCRG_94_004.ps.Z
19. D. A. Nix and A. S. Weigend, "Learning local error bars for nonlinear regression," in Advances Neural Inform. Processing Syst., 1995.
20. P. M. Williams, "Using neural networks to model conditional multivariate densities," Neural Comput., vol. 8, pp. 843-854, May 1996.
21. C. M. Bishop and C. S. Qazaz, "Bayesian inference of noise levels in regression," in Proc. 1996 Int. Conf. Neural Networks, July 1996, pp. 59-64.
22. G. Chryssolouris, M. Lee, and A. Ramsey, "Confidence interval prediction for neural network models," IEEE Trans. Neural Networks, vol. 7, pp. 229-232, Jan. 1996.
23. L. S. Shapiro and J. M. Brady, "Rejecting outliers and estimating errors in an orthogonal regression framework," Tech. Rep., Robot. Res. Group, Dept. Eng. Sci., Oxford Univ., U.K., 1993.
24. G. Cybenko, "Approximation by superposition of a sigmoidal function," Math. Contr., Signals, Syst., vol. 2, no. 4, pp. 303-314, 1989.
25. J. Park and I. W. Sandberg, "Universal approximation using radial-basis-function networks," Neural Comput., vol. 3, pp. 246-257, 1991.
26. H. S. Weng, T. S. Huang, and N. Ahuja, "Motion and structure from two perspective views: Algorithms, error analysis, and error estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 451-476, May 1989.
27. W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes in C. Cambridge, U.K.: Cambridge Univ. Press, 1988.
28. N. Ayache, Vision Stéréoscopique et Perception Multisensorielle, Applications à la Robotique Mobile. Paris, France: InterEditions, 1989.
29. M. Brownlow, A Time-of-Flight Optical Range Sensor for Mobile Robot Navighation., D.Phil, dissertation, Oxford Univ., Oct. 1993.
30. N. W. Townsend and L. Tarassenko, "Neural networks for mobile robot localisation using infrared range sensing," Neural Comput. Applicat., 1997, submitted.