Function approximation - a fast-convergence neural approach based on spectral analysis

IEEE Transactions on Neural Networks

Volumn 10, Issue 4, 1999, Pages 725-740

  Citterio, Cesare ^b   Pelagotti, Andrea ^c   Piuri, Vincenzo ^a,d   Rocca, Luca ^e  

^a IEEE

^b Foster Wheeler Italiana   (Italy)

^c TXT Ingegneria Informatica SpA   (Italy)

^d POLITECNICO DI MILANO   (Italy)

^e Alcatel Italia   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; ERROR ANALYSIS; ESTIMATION; FREQUENCY DOMAIN ANALYSIS; FUNCTION EVALUATION; LEARNING ALGORITHMS; SPECTRUM ANALYSIS;

ERROR PREDICTION; NONLINEAR FUNCTION APPROXIMATION;

FEEDFORWARD NEURAL NETWORKS;

EID: 0032637954     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.774207     Document Type: Article

References (29)

1. K. Hornik, M. Stinchombe, and H. White, "Multilayered feedforward networks are universal approximators," Neural Networks, vol. 2, no. 5, pp. 359-366, 1989.
2. J.-K. Wu, Neural Networks and Simulation Methods. New York: Marcel Dekker, 1994.
3. J. Hertz, A. Krogh, and R. Palmer, Introduction to the Theory of Neural Computation. Redwood City, CA: Addison-Wesley, 1991.
4. M. Mezard and J.-P. Nadal, "Learning in feedforward layered networks: The tiling algorithm," J. Phys. A: Math. and Gen., vol. 22, pp. 2191-2203, 1989.
5. M. Frean, "The Upstart algorithm: A method for constructing and training feedforward neural networks," Neural Comput., vol. 2, no. 2, p. 1989, 1990.
6. M. Marchand, M. Golea, and P. Rujan, "A convergence theorem for sequential learning in two-layer perceptrons," Europhys. Lett., vol. 18, pp. 487-492, 1990.
7. Y. Hirose, K. Yamashita, and S. Hijiya, "Backpropagation algorithm which varies the number of hidden units," Neural Networks, vol. 4, pp. 61-66, 1991.
8. D. Martinez and D. Esteve, "The offset algorithm: Building and learning method for multilayered neural networks," Europhys. Lett., vol. 11, pp. 95-100, 1992.
9. D. L. Gray and A. N. Michel, "A training algorithm for binary feedforward neural networks," IEEE Trans. Neural Networks, vol. 3, pp. 176-194, 1992.
10. S. Mukhopadhyay, A. Roy, L. S. Kim, and S. Govil, "A polynomial time algorithm for generating neural networks for pattern classification: Its stability properties and some test results," Neural Comput., vol. 5, no. 2, pp. 317-330, 1993.
11. B. Fritzke, "Supervised learning with growing cell structures," Advances in Neural Information Processing Systems, J. D. Cowan, G. Tesauro, and J. Alspector, Eds. San Mateo, CA: Morgan Kaufmann, vol. 6, pp. 255-262, 1994.
12. C. L. Giles, D. Chen, G.-Z. Sun, H.-H. Chen, Y.-C. Lee, and M. W. Goudreau, "Constructive learning of recurrent neural networks: Limitations of recurrent cascade correlation and a simple solution," IEEE Trans. Neural Networks, vol. 6, pp. 829-836, July 1995.
13. J. M. Torres Moreno and M. B. Gordon, "Efficient adaptive learning for classification tasks with binary units," Neural Comput., vol. 10, no. 4, pp. 1007-1030, 1998.
14. T. Ash, "Dynamic node creation in backpropagation networks," Connection Sci., vol. 1, pp. 365-375, 1989.
15. S. E. Fahlman and C. Labiere, "The cascade-correlation learning architecture," Advances Neural Inform. Processing Syst., D. S. Touretzky, Ed., vol. 2. San Mateo, CA: Morgan Kaufmann, pp. 524-532, 1990.
16. T. D. Sanger, "Basis-function trees as a generalization of local variable selection methods for function approximation," Advances in Neural Information Processing Systems, R. P. Lippmann, J. E. Moody, and D. S. Touretzky, Eds., vol. 3. San Mateo, CA: Morgan Kaufmann, pp. 700-706, 1991.
17. J. Platt, "A resource allocating network for function interpolation," Neural Comput., vol. 3, no. 2, pp. 213-225, 1991.
18. E. K. Blum and L. K. Li, "Approximation theory and feedforward networks," Neural Networks, vol. 4, no. 4. pp. 511-515, 1991.
19. M. Wynn-Jones, "Node splitting: A constructive algorithm for feedforward neural networks," Neural Comput. Applicat., vol. 1, no. 1, pp. 17-22, 1993.
20. T. M. Nabhan and A. Y. Zomaya, "Toward generating neural network structures for function approximation," Neural Networks, vol. 7, no. 1, pp. 89-99, 1994.
21. T. Y. Kwok and D. Y. Yeung, "Constructive algorithms for structure learning in feedforward neural networks for regression problems," IEEE Trans. Neural Networks, vol. 7, pp. 1168-1183, Sept. 1996.
22. _, "Objective functions for training new hidden units in constructive neural networks," IEEE Trans. Neural Networks, vol. 8, pp. 1131-1148, Sept. 1997.
23. N. B. Karayiannis and G. W. Mi, "Growing radial basis neural networks: Merging supervised and unsupervised learning with network growth techniques," IEEE Trans. Neural Networks, vol. 8, pp. 1492-1506, 1997.
24. A. Pelagotti and V. Piuri, "Spectral analysis and synthesis of three-layered feedforward neural networks for function approximation," in Proc. IEEE MicroNeuro, Lausanne, Switzerland, Feb. 1996, pp. 239-245.
25. C. Citterio, A. Pelagotti, V. Piuri, and L. Rocca, "Spectral approximation of functions by using three-layered feedforward neural networks," in Proc. IEEE Int. Conf. Neural Networks ICNN96, Washington, D.C., June 1996, pp. 1830-1834.
26. A. Pelagotti and V. Piuri, "Neural spectral composition for function approximation," in Proc. IEEE-INNS Int. Joint Conf. Neural Networks IJCNN97, Houston, TX, June 1997, pp. 860-864.
27. A. V. Oppenheim and R. W. Schafer, Discrete-Time Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
28. J. E. Dennis and J. J. Moré, "Quasi Newton methods, motivation and theory," SIAM Rev., vol. 19, no. 1, pp. 46-89, Jan 1977.
29. D. S. Watkins, Fundamentals of Matrix Computations. New York: Wiley, 1991.