Pipelined recurrent fuzzy neural networks for nonlinear adaptive speech prediction

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 5, 2007, Pages 1305-1320

  Stavrakoudis, Dimitris G ^a   Theocharis, John B ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Dynamic fuzzy inference; Extended Kalman filtering; Modular network; Ordered derivatives; Pipelined predictor; Recurrent fuzzy neural network (RFNN)

Indexed keywords

EXTENDED KALMAN FILTERS; FUZZY INFERENCE; FUZZY NEURAL NETWORKS; RECURRENT NEURAL NETWORKS;

ADAPTIVE SPEECH PREDICTION; DYNAMIC FUZZY INFERENCE; EXTENDED KALMAN FILTERING; MODULAR NETWORK; RECURRENT FUZZY NEURAL NETWORK (RFNN);

SPEECH PROCESSING;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; AUTOMATIC SPEECH RECOGNITION; FUZZY LOGIC; METHODOLOGY; NONLINEAR SYSTEM;

ALGORITHMS; FUZZY LOGIC; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED; SPEECH RECOGNITION SOFTWARE;

EID: 35148816468     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2007.900516     Document Type: Article

References (32)

1. R. J. Williams and D. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural Comput., vol. 1, no. 2, pp. 270-280, 1989.
2. S.-S. Kim, "Time-delay recurrent neural network for temporal correlations and prediction," Neurocomputing, vol. 20, no. 1-3, pp. 253-263, Aug. 1998.
3. A. C. Tsoi and A. D. Back, "Locally recurrent globally feedforward networks: A critical review of architectures," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 229-239, Mar. 1994.
4. A. D. Back and A. C. Tsoi, "FIR and IIR synapses, a new neural network architecture for time series modeling," Neural Comput., vol. 3, no. 3, pp. 375-385, 1991.
5. P. S. Sastry, G. Santharam, and K. P. Unnikrishann, "Memory neuron networks for identification and control of dynamical systems," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 306-319, Mar. 1994.
6. C.-C. Ku and K. Y. Lee, "Diagonal recurrent neural networks for dynamic systems control," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 144-156, Jan. 1995.
7. J. T. Connor, R. D. Martin, and L. E. Atlas, "Recurrent neural networks and robust time series prediction," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 240-254, Mar. 1994.
8. T. Lin, B. G. Horne, P. Tino, and C. L. Giles, "Learning long-term dependences in NARX recurrent neural networks," IEEE Trans. Neural Netw., vol. 7, no. 6, pp. 1329-1338, Nov. 1996.
9. S. Haykin and L. Li, "Nonlinear adaptive prediction of nonstationary signals," IEEE Trans. Signal Process., vol. 43, no. 2, pp. 526-535, Feb. 1995.
10. P.-R. Chang and J.-T. Hu, "Optimal nonlinear adaptive prediction and modeling of MPEG video in ATM networks using pipelined recurrent neural networks," IEEE J. Sel. Areas Commun., vol. 15, no. 6, pp. 1087-1100, Aug. 1997.
11. J. Beltersee and J. A. Chambers, "Nonlinear adaptive prediction of speech with a pipelined recurrent neural network," IEEE Trans. Signal Process., vol. 46, no. 8, pp. 2207-2216, Aug. 1998.
12. D. P. Mandic and J. A. Chambers, "Toward an optimal PRNN-based nonlinear prediction," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1435-1442, Nov. 1999.
13. D. P. Mandic and J. A. Chambers, "On the choice of parameters of the cost function in nested modular RNN's," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 315-322, Mar. 2000.
14. J. Zhang and A. J. Morris, "Recurrent neuro-fuzzy networks for nonlinear process modeling," IEEE Trans. Neural Netw., vol. 10, no. 2, pp. 313-326, Mar. 1999.
15. J. B. Theocharis and G. V. Vachtsevanos, "Recursive learning algorithms for training fuzzy recurrent models," Int. J. Intell. Syst., vol. 11, no. 12, pp. 1059-1098, 1996.
16. C.-H. Lee and C.-C. Teng, "Identification and control of dynamic systems using recurrent fuzzy neural networks," IEEE Trans. Fuzzy Syst., vol. 8, no. 4, pp. 349-366, Aug. 2000.
17. C.-J. Lin and C.-H. Chen, "Identification and prediction using recurrent compensatory neuro-fuzzy systems," Fuzzy Sets Syst., vol. 150, no. 2, pp. 307-330, 2005.
18. C. J. Lin and C. C. Chin, "Prediction and identification using wavelet-based recurrent fuzzy neural network," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 5, pp. 2144-2154, Oct. 2004.
19. H. Surmann and M. Maniadakis, "Learning feed-forward and recurrent fuzzy systems: A genetic approach," Int. J. Syst. Archit., vol. 47, no. 7, pp. 649-662, 2001.
20. P. A. Mastorocostas and J. B. Theocharis, "A recurrent fuzzy-neural model for dynamic system identification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 2, pp. 176-190, Apr. 2002.
21. Y. Gao and M. J. Er, "NARMAX time series model prediction: Feedforward and recurrent fuzzy neural network approaches," Fuzzy Sets Syst., vol. 150, no. 2, pp. 331-350, 2005.
22. C.-F. Juang and C.-T. Lin, "A recurrent self-organizing neural fuzzy inference network," IEEE Trans. Neural Netw., vol. 10, no. 4, pp. 828-845, Jul. 1999.
23. C.-F. Juang, "A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 155-170, Apr. 2002.
24. C.-F. Juang, "Temporal problems solved by dynamic fuzzy network based on genetic algorithm with variable-length chromosomes," Fuzzy Sets Syst., vol. 142, no. 2, pp. 199-219, Mar. 2004.
25. C.-F. Juang and C.-T. Lin, "Noisy signal processing by recurrently adaptive fuzzy filters," IEEE Trans. Fuzzy Syst., vol. 9, no. 1, pp. 139-152, Feb. 2001.
26. C.-F. Juang and J. S. Chen, "Water bath temperature control by a recurrent fuzzy controller and its FPGA implementation," IEEE Trans. Ind. Electron., vol. 53, no. 3, pp. 941-949, Jun. 2006.
27. J. B. Theocharis, "A high-order recurrent neuro-fuzzy system with internal dynamics: Application to adaptive noise cancellation," Fuzzy Sets Syst., vol. 157, no. 4, pp. 471-500, 2006.
28. R. J. Williams and J. Peng, "An efficient gradient-based algorithm for online training of recurrent network trajectories," Neural Comput. vol. 2, no. 4, pp. 490-501, 1990.
29. S. Shah, F. Palmieri, and M. Datum, "Optimal filtering algorithms for fast learning in feedforward neural networks," Neural Netw., vol. 5, no. 5, pp. 779-787, Sep./Oct. 1992.
30. P. J. Werbos, "Beyond regression: New tools for prediction and analysis in the behavioral sciences," Ph.D. dissertation, Committee Appl. Math, Harvard Univ., Cambridge, MA, 1974.
31. S. W. Piche, "Steepest descent algorithms for neural network controllers and filters," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 198-212, Mar. 1994.
32. L. Ljung and T. Söderström, Theory and Practice of Recursive Identification. Cambridge, U.K.: MIT Press, 1983.