Combined learning and pruning for recurrent radial basis function networks based on recursive least square algorithms

Neural Computing and Applications

Volumn 15, Issue 1, 2006, Pages 62-78

  Leung, Chi Sing ^a   Tsoi, Ah Chung ^b  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^b Australian Government Australian Research Council   (Australia)

Author keywords

Pruning method; Recurrent radial basis function; Recursive least square method

Indexed keywords

EID: 28344431839     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-005-0009-7     Document Type: Article

References (47)

1. Ljung L (1987) System identification: theory for the user. Prentice Hall, Englewood Cliffs
2. Gerhenfeld N A, Weigend AS (1993) The future of time series. In: Time series prediction: forecasting the future and understanding the past. Addison Wesley, Reading, pp 1-70
3. Tong H (1989) Nonlinear time series. Oxford University Press, Oxford
4. Hecht-Nielsen R (1990) Neurocomputing. Addison-Wesley, Reading
5. Simpson PK (1990) Artificial neural systems: foundations, paradigms, applications, and implementations. Pergamon, New York
6. Ripley B, Haykin S (1994) Neural networks: a comprehensive foundation. Macmillan College Publishing Company, New York
7. Sejnowski T, Rosenberg R (1989) NETtalk: a parallel network that learns to read aloud. The Johns Hopkins University, Electrical and Computer Science Technical Report JHU/EECS-86/01, 32 pages.
8. Reprinted in Neurocomputing Foundations of Research, Anderson JA, Rosenfeld E (eds) MIT, Cambridge, pp 663-672
9. Hornik K, Stinchombe M, White H (1989) Multilayer feed-forward networks are universal approximators. Neural Netw 2:359-366
10. Elman JL (1990) Finding structure in time. Cognit Sci 14:179-211
11. Williams R, Zipser D (1989) A Learning algorithm for continually running fully recurrent neural networks. Neural Comput 1:270-280
12. Robinson T, Fallside F (1989) A recurrent error propagation network speech recognition system. Computer Speech and Language, pp 259-274
13. Connor JT, Martin RD, Atlas LE (1994) Recurrent neural network and robust time series prediction. IEEE Trans Neural Netw 5:240-254
14. Watrous RL (1992) Induction of finite-state languages using second-order recurrent networks. Neural Comput 4:406-414
15. Back AD, Tsoi AC (1991) FIR and IIR synapses, a new neural network architecture for time series modelling. Neural Comput 3:375-385
16. Tsoi AC, Back AD (1997) Discrete time recurrent neural network architectures, a unifying review. Neurocomputing 15(3-4):183-223
17. Tsoi AC, Back AD (1994) Locally recurrent globally feedforward networks, a critical review of architectures. IEEE Trans Neural Netw 5:229-239
18. Nerrand O, Roussel-Ragot P, Personnaz L, Dreyfus G, Marocs S (1993) Neural networks and nonlinear adaptive filtering: unifying concepts and new algorithms. Neural Comput 5:165-199
19. Mulgrew B (1996) Applying radial basis functions. IEEE Signal Process Mag, March
20. Moody J, Darken C (1989) Fast learning in networks of locally tuned processing units. Neural Comput 1:281-294
21. Moakes PA, Steve W (1994) Non-linear speech analysis using recurrent radial basis function networks. Neural Networks for Signal Processing- Proceedings of the IEEE Workshop 1994. IEEE, Piscataway, NJ, USA, pp 319-328
22. Koivisto H, Vahteri J (1996) A training method for feedforward and recurrent RBF type neural network. STEP'96 Genes, Nets and Symbols. Finnish Artificial Intelligence Conference, Vassa, Finland, p 89
23. Billings SA, Fung CF (1995) Recurrent radial basis function networks for adaptive noise cancelation. Neural Netw 8:273-290
24. Chen S, Billings SA, Grant PM (1992) A recursive hybrid algorithm for nonlinear system identification using radial basis function networks for adaptive noise cancelation. Int J Control 5:1051-1070
25. Mak MW (1995) A learning algorithm for recurrent radial basis function. Neural Process Lett 2:27-31
26. Cid-Sueiro J, Artes-Rodriguez A, Figueiras-Vidal AR (1994) Recurrent radial basis function networks for optimal symbol-by-symbol equalization. Signal Process 40:53-63
27. Ye X, Loh NK (1994) Dynamic system identification using recurrent radial basis function network. In: Proceedings of the 1993 American Control Conference, vol 3, pp 2912-2916
28. Linde Y, Buzo A, Gray M (1980) An algorithm for vector quantizer design. IEEE Trans Commun 28:84-95
29. Tsoi AC (1989) Multilayer perceptron trained using radial basis functions. Electron Lett 25:1296-1297
30. Singhal S, Wu L (1989) Training feed-forward networks with the extended Kalman filter. In: Proceedings IEEE international conference ASSP, Glasgow, pp 1187-1190
31. Shah S, Palmieri F, Datum M (1992) Optimal filtering algorithm for fast learning in feedforward neural networks. Neural Netw 5:779-787
32. Leung CS, Wong KW, Sum J, Chan LW (1996) On-line training and pruning for RLS algorithms. Electron Lett pp 2152-2153
33. Giles CL, Omlin CW (1994) Pruning recurrent neural networks for improved generalization performance. IEEE Trans Neural Netw 5:848-851
34. Reed R (1993) Pruning algorithm-a survey. IEEE Trans Neural Netw 4:740-747
35. Tsoi AC, Tan S (1997) Recurrent neural networks: a constructive algorithm, and its properties. Neurocomputing 15:309-326
36. LeCun Y, Denker JS, Solla SA (1989) Optimal brain damage. In: Touretzky DS (ed) Advances in neural information processing, vol 2, pp 598-605
37. Goodwin GC, Sin KS (1986) Adaptive estimation, filtering, and control. Prentice Hall, Englewood
38. Narenda KS, Parthasarathy K (1990) Identification and control of dynamical systems using neural networks. IEEE Trans Neural Netw 1:4-27
39. Shynk JJ (1989) Adaptive IIR filtering. IEEE ASSP Mag, April, 1989
40. Puskorius GV, Feldkamp LA (1994) Neurocontrol of nonlinear dynamical system with Kalman filter trained recurrent networks. IEEE Trans Neural Netw 5:279-297
41. William H (1989) Applied numerical linear algebra. Prentice-Hall, Englewood Cliffs
42. Narenda KS, Parthasarathy K (1992) Neural networks and dynamical systems. Int J Approx Reason 6:109-131
43. Weigend AS, Huberman BA, Rumelhart DE (1990) Predicting the future: a connectionist approach. Int J Neural Syst 1:193-209
44. Weigend AS, Rumelhart DE, Huberman BA (1990) Backpropagation, weight-elimination and time series prediction. In: Touretzky DS, Elman JL, Sejnowski TJ, Hinton GE (eds) Proceedings of the 1990 Connectionist Models Summer School. Morgan Kaufmann, San Mateo, pp 105-116
45. Jones AJ (2004) New tools in non-linear modelling and prediction. Comput Manag Sci 1 (2): 109-149
46. Svarer C, Hansen LK, Larsen J (1993) On design and evaluation of tapped-delay neural network architectures. In: Proceedings of IEEE international conference on neural networks, pp 46-51
47. Leung CT, Chow TWS (1997) A novel noise robust fourth-order cumulants cost function. Neurocomputing 16:139-147