Decision boundary and generalization performance of feed-forward networks with Gaussian lateral connections

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 3390, Issue , 1998, Pages 314-321

  Kothari, Ravi ^a   Ensley, David ^b  

^a 705 Engineering Research Center   (United States)

^b AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

Approximation; Classification; Feed forward neural networks; Lateral connections; Multi layered perceptrons; Radial basis function networks

Indexed keywords

CLASSIFICATION (OF INFORMATION); NEURONS; RADIAL BASIS FUNCTION NETWORKS;

APPROXIMATION; FEED-FORWARD NETWORK; GENERALIZATION PERFORMANCE; HIDDEN LAYER NEURONS; LATERAL CONNECTIONS; LINEAR DECISION BOUNDARY; MULTI-LAYERED FEED-FORWARD NEURAL NETWORKS; MULTILAYERED PERCEPTRONS;

MULTILAYER NEURAL NETWORKS;

EID: 85077000723     PISSN: 0277786X     EISSN: 1996756X     Source Type: Conference Proceeding    
DOI: 10.1117/12.304820     Document Type: Conference Paper

References (14)

1. D. E. Rumelhart. G. E. Hintou, and R. J. Williams, "Learning Internal Representations by Back-Propagating Errors." Nature, vol. 332. pp. 533-536, 1986.
2. See also Parallel Distributed Processing: Explorations in the Micro structure of Cognition, Vol. 1. pp. 318-362, MA: MIT Press, 1986.
3. M. J. D. Powell, "'Radial Basis Functions for Multivariable Interpolation: A Review, " In J. C. Mason, and M. J. Cox (Eds.), Algorithms for Approximation, pp. 143-167. Oxford: Clarendon Press. 1987.
4. D. S. Broomhead. and D. Lowe. "Multivariable Function Interpolation and Adaptive Networks, " Complex Systems. Vol. 2. pp. 321-355, 1988.
5. J. Moody, and C. Darken, "Fast Learning in Networks of Locally Tuned Processing Units, " Neural Computation, Vol. 1, pp. 281-294, 1989.
6. G. Cybenko, "Approximation by Superpositions of a Sigmoidal Function, " Math. Contr. Signals, Syst., vol. 2, pp. 303-314, 1989.
7. K. Hornik, M. Stinchcombe, and H. White, "Universal Approximation of an Unknown Mapping and its Derivatives Using Multilayer Feedforward Networks, " Neural Networks, vol. 3, pp. 551-560, 1990.
8. n by Multilayer Feedforward Networks and Related Problems, " IEEE Transactions on Neural Networks, vol. 6, pp. 25-30, 1995.
9. J. Park, and I. W. Sandberg, "Universal Approximation Using Radial-Basis Function Networks, " Neural Computation, Vol. 3, pp. 245-257, 1991.
10. K. S. Narendra, and K. Wakatsuki, "A Comparative Study of two Neural Network Architectures for the Identification and Control of Nonlinear Dynamical Systems, " Technical Report of the Center for Systems Science, Yale University, 1991.
11. F. Girosi, and T. Poggio, "Networks and the Best Approximation Property, " Biological Cybernetics, Vol. 63, pp. 169-176, 1990.
12. C. M. Bishop, Neural Networks for Pattern Recognition, NY: Oxford University Press, 1995.
13. R. Kothari, and K. Agyepong, "On Lateral Connections in Feed-Forward Neural Networks, " Proc. IEEE International Conference on Neural Networks, pp. 13-18, 1996.
14. K. Agyepong, and R. Kothari, "Controlling Hidden Layer Capacity through Lateral Connections, " Neural Computation, Vol. 9, No. 6, pp. 1381-1402, 1997.