Constructive backpropagation for recurrent networks

Neural Processing Letters

Volumn 9, Issue 3, 1999, Pages 271-278

  Lehtokangas, Mikko ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION; MATHEMATICAL MODELS; PROBLEM SOLVING; TIME SERIES ANALYSIS;

CONSTRUCTIVE BACKPROPAGATION;

RECURRENT NEURAL NETWORKS;

EID: 0032688309     PISSN: 13704621     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1018620424763     Document Type: Article

References (17)

1. S. Geman, E. Bienenstock and R. Doursat, "Neural networks and the bias/variance dilemma," Neural Computation, Vol. 4, pp. 1-58, 1992.
2. R. Reed, "Pruning algorithms - a survey," IEEE Transactions on Neural Networks, Vol. 4, No. 5, pp. 740-747, 1993.
3. T. Kwok and D. Yeung, "Constructive algorithms for structure learning in feedforward neural networks for regression problems," IEEE Transactions on Neural Networks, Vol. 8, No. 3, pp. 630-645, 1997.
4. A. Weigend and N. Gershenfeld (eds), Time Series Prediction: Forecasting the Future and Understanding the Past, Addison-Wesley: Reading, 1994.
5. P. Angeline, G. Saunders and J. Pollack, "An evolutionary algorithm that constructs recurrent neural networks," IEEE Transactions on Neural Networks, Vol. 5, No. 1, pp. 54-65, 1994.
6. D. Obradovic, "On-line training of recurrent neural networks with continuous topology adaptation," IEEE Transactions on Neural Networks, Vol. 7, No. 1, pp. 222-228, 1996.
7. L. Leerink and M. Jabri, "Constructive learning using internal representation conflicts," Advances in Neural Information Processing Systems, Vol. 6, pp. 279-284, 1993.
8. T. Cholewo and J. Zurada, "Sequential network construction for time series prediction," Proceedings of International Conference on Neural Networks, Vol. 4, pp. 2034-2038, 1997.
9. S. Fahlman, "The recurrent cascade-correlation architecture," Technical Report CMU-CS-91-100, 1991.
10. C. Giles, D. Chen, G. Sun, H. Chen, Y. Lee and M. Goudreau, "Constructive learning of recurrent neural networks: limitations of recurrent cascade correlation and a simple solution," IEEE Transactions on Neural Networks, Vol. 6, No. 4, pp. 829-836, 1995.
11. M. Lehtokangas, "Learning with constructive backpropagation," Proceedings of 5th International Conference on Soft Computing and Information/Intelligent Systems, Vol. 1, pp. 183-186, 1998.
12. S. Fahlman and C. Lebiere, "The cascade-correlation learning architecture," Advances in Neural Information Processing Systems 2, pp. 524-532, 1989.
13. M. Lehtokangas, "Extended constructive backpropagation for time series modelling," Proceedings of 5th International Conference on Soft Computing and Information/Intelligent Systems, Vol. 2, pp. 793-796, 1998.
14. J. Elman, "Finding structure in time," Cognitive Science, Vol. 14, pp. 179-211, 1990.
15. J. Thompson and H. Stewart, Nonlinear Dynamics and Chaos: Geometrical Methods for Engineers and Scientists, Wiley, 1986.
16. M. Riedmiller and H. Braun, "A direct adaptive method for faster backpropagation learning: the RPROP algorithm," Proceedings of the IEEE International Conference on Neural Networks, ICNN'93, San Francisco, CA, pp. 586-591, 1993.
17. R. Williams and Z. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural Computation, Vol. 1, pp. 270-280, 1989.