Multilayer feedforward networks with adaptive spline activation function

IEEE Transactions on Neural Networks

Volumn 10, Issue 3, 1999, Pages 672-683

  Guarnieri, Stefano ^b   Piazza, Francesco ^a,b   Uncini, Aurelio ^a,b  

^a IEEE

^b UNIVERSITÀ POLITECNICA DELLE MARCHE   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; DATA PROCESSING; LEARNING ALGORITHMS; LEARNING SYSTEMS; PATTERN RECOGNITION; POLYNOMIALS;

ADAPTIVE SPLINE ACTIVATION FUNCTION; FUNCTION SHAPE AUTOTUNING; GENERALIZED SIGMOIDAL FUNCTIONS; MULTILAYER FEEDFORWARD NETWORKS;

FEEDFORWARD NEURAL NETWORKS;

EID: 0032643084     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.761726     Document Type: Article

References (25)

1. W. S. McCulloch and W. Pitts, "A logical calculus of the ideas imminent in nervous activity," Bull. Math. Biophys., vol. 5, pp. 115-133, 1943.
2. D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing (PDP): Exploration in the Microstructure of Cognition, vol. 1. Cambridge, MA: MIT Press, 1986.
3. Widrow and M. Lehr, "30 years of adaptive neural networks: Perceptron, adaline and backpropagation," in Proc. IEEE, vol. 78, no. 9, Sept. 1990.
4. C. Z. Tang and H. K. Kwan, "Convergence and generalization properties of multilayer feedforward neural networks," in Proc. IEEE Int. Symp. Circuits Syst., San Diego, CA, 1992, pp. I-65-68.
5. C. T. Chen and W. D. Chang, "A feedforward neural network with function shape autotuning," Neural Networks, vol. 9, no. 4, pp. 627-641, June 1996.
6. G. Cybenko, "Approximation by superposition of a sigmoidal function," Math. Contr. Signals Syst., no. 2, 1989.
7. T. Chen and H. Chen, "Approximation of continuous functionals by neural networks with application to dynamic systems," IEEE Trans. Neural Networks, vol. 4, pp. 910-918, Nov. 1993.
8. n) by multilayer feedforward networks and related problems," IEEE Trans. Neural Networks, vol. 6, pp. 25-30, Jan. 1995.
9. K. Hornik, M. Stinchombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, vol. 2, pp. 359-366, 1989.
10. _, "Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks," Neural Networks, vol. 3, pp. 551-560, 1990.
11. M. Stinchcombe and H. White, "Universal approximation using feedforward networks with nonsigmoid hidden layer activation functions," in Proc. IJCNN, Washington, D.C., 1989, pp. I 613-617.
12. _, "Approximating and learning unknown mappings using multilayer feedforward networks with bounded weights," in Proc. IJCNN, San Diego, CA, 1990, pp. III 7-16.
13. S. Amari and N. Murata, "Statistical theory of learning curves under entropie loss criterion," Neural Comput., vol. 5, pp. 140-153, 1993.
14. S. Amari, "A universal theorem on learning curves," Neural Networks, vol. 6, no. 2, pp. 161-166, 1993.
15. M. Marchesi, G. Orlandi, F. Piazza, and A. Uncini, "Fast neural networks without multipliers," IEEE Trans. Neural Networks, vol. 3, pp. 101-120, Nov. 1992.
16. Piazza, A. Uncini, and M. Zenobi, "Artificial neural networks with adaptive polynomial activation function," in Proc. IJCNN, Beijing, China, Nov. 1992, pp. II-343-349.
17. _, "Neural networks with digital LUT activation function," in Proc. IJCNN, Nagoya, Japan, 1993, pp. II-1401-1404.
18. I. J. Schoenberg, "Contributions to the problem of approximation of equidistant data by analytic functions," Quart. Appl. Math., vol. 4, pp. 45-99, 1946.
19. R. E. Barnhill and R. F. Riesenfeld, Eds., Computer Aided Geometric Design. New York: Academic, 1974.
20. E. Catmull and R. Rom, "A class of local interpolating splines," in Computer-Aided Geometric Design, R. E. Barnhill and R. F. Riesenfeld, Eds. New York: Academic, 1974, pp. 317-326.
21. F. Piazza, S. Smerilli, A. Uncini, M. Griffo, and R. Zunino, "Fast spline neural networks for image compression," in Proc. IX Wrkshp. Parallel Architectures and Neural Networks, V. S. Mare (SA), Ed. Berlin, Germany: Springer-Verlag, May 1996.
22. M. Mackey and L. Glass, "Oscillation and chaos in physiological control systems," Science, vol. 197, p. 287, 1977.
23. K. S. Narendra, "Adaptive control of dynamical systems using neural networks," Handbook of Intelligent Control. New York: Van Nostrand Reinhold, 1992, pp. 141-183.
24. J.-N. Hwang, S.-R. Lay, M. Maechler, R. D. Martin, and J. Schimert, "Regression modeling in backpropagation and projection pursuit learning," IEEE Trans. Neural Networks, vol. 5, pp. 342-353, 1994.
25. F. Filippetti, A. Uncini, F. Piazza, P. Campolucci, C. Tassoni, and G. Franceschini, "Neural-network architectures for fault diagnosis and parameter recognition in induction machines," in Proc. IEEE Melecon '96, Bari, Italy, May 1996.