Nonlinear adaptive prediction of complex-valued signals by complex-valued PRNN

IEEE Transactions on Signal Processing

Volumn 53, Issue 5, 2005, Pages 1827-1836

  Goh, Su Lee ^a   Mandic, Danilo P ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Complex valued analysis; Multidimension forecasting; Nonlinear adaptive prediction; RNNs

Indexed keywords

ADAPTIVE FILTERING; COMPUTER SIMULATION; FIR FILTERS; LEARNING ALGORITHMS; SIGNAL PROCESSING;

COMPLEX VALUED ANALYSIS; MULTIDIMENSION FORECASTING; NONLINEAR ADAPTIVE PREDICTION;

RECURRENT NEURAL NETWORKS;

EID: 18844423555     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2005.845462     Document Type: Article

References (40)

1. N. Benvenuto and F. Piazza, "On the complex backpropagation algorithm," IEEE Trans. Signal Process., vol. 40, no. 4, pp. 967-969, Apr. 1992.
2. G. E. P. Box, G. M. Jenkins, and G. C. Reinsel, Time Series Analysis: Forecasting and Control. Englewood Cliffs, NJ: Prentice-Hall, 1994.
3. P. R. Chang and J. T. Hu, "Optimal nonlinear adaptive prediction and modeling of MPEG video in ATM networks using pipelined recurrent neural networks," IEEE J. Sel. Areas Commun., vol. 15, no. 6, pp. 1087-1100, Aug. 1997.
4. J. T. Connor, R. D. Martin, and L. E. Atlas, "Recurrent neural networks and robust time series prediction," IEEE Trans. Neural Networks, vol. 5, no. 2, pp. 240-254, Mar. 2001.
5. G. Cybenko, "Approximation by superpositions of a sigmoidal function," Math. Contr., Signals, Syst., vol. 2, pp. 303-314, 1989.
6. R. Drossu and Z Obradovic "Rapid design of neural networks for time series prediction," IEEE Computat. Sci. Eng., vol. 3, no. 2, pp. 78-89, Summer 1996.
7. K. I. Funahashi, "On the approximate realization of continuous mappings by neural networks," Neural Networks, vol. 2, pp. 183-192, 1989.
8. T. Gautama, D. P. Mandic, and M. M. Van Hulle, "A nonparametric test for detecting the complex-valued nature of time series," in Proc. Knowledge-Based Intell. Inf. Eng. Syst.: Seventh Int. Conf., vol. 2773, Oxford, U.K., 2003, pp. 1364-1371.
9. G. M. Georgiou and C. Koutsougeras, "Complex domain backpropagation," IEEE Trans. Circuits Syst. II: Analog Digit. Signal Process., vol. 39, no. 5, pp. 330-334, May 1992.
10. S. L. Goh and D. P. Mandic, "Recurrent neural networks with trainable amplitude of activation functions," Neural Netw., vol. 16, no. 8, pp. 1095-1100, 2003.
11. A. I. Hanna and D. P. Mandic, "Nonlinear FIR adaptive filters with a gradient adaptive amplitude in the nonlinearity," IEEE Signal Process. Lett., vol. 9, no. 8, pp. 253-255, Aug. 2002.
12. A. I. Hanna and D. P. Mandic, "A complex-valued nonlinear neural adaptive filter with a gradient adaptive amplitude of the activation function," Neural Networks Lett.: Neural Netw., vol. 16, no. 2, pp. 155-159, 2003.
13. S. Haykin, Neural Networks, A Comprehensive Foundation. Englewood Cliffs, NJ: Prentice-Hall, 1994.
14. S. Haykin and L. Li, "Nonlinear adaptive prediction of nonstationary signals," IEEE Trans. Signal Process., vol. 43, no. 2, pp. 526-535, Feb. 1995.
15. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximations," Neural Netw., vol. 2, pp. 359-366, 1989.
16. Y.L. Hsieh, C. J. Chang, and Y. S. Chen, "A power control scheme with link gain prediction using PRNN/ERLS for DS-CDMA cellular mobile systems," in Proc. IEEE Int. Conf. Commun., vol. 1, 2003, pp. 407-411.
17. G. Kechriotis and E. S. Manolakos, "Training fully recurrent neural networks with complex weights," IEEE Trans. Circuits Syst. II: Analog Digit. Signal Process., vol. 41, no. 3, pp. 235-238, Mar. 1994.
18. T. Kim and T. Adali, "Approximation by fully complex MLP using elementary transcendental activation functions," in Proc. XI IEEE Workshop Neural Networks Signal Process., 2001, pp. 203-212.
19. T. Kim and T. Adali, "Complex backpropagation neural network using elementary transcendental activation functions," in Proc. Int. Conf. Acoust., Speech, Signal Process., vol. 2, 2001, pp. 1281-1284.
20. T. Kim and T. Adali, "Approximation by fully complex multilayer perceptrons," Neural Comput., vol. 15, no. 7, pp. 1641-1666, 2003.
21. I. R. Krcmar and D. P. Mandic, "A fully adaptive normalized nonlinear gradient descent algorithm for nonlinear system identification," in Proc. Int. Conf. Acoust., Speech, Signal Process., vol. 6, 2001, pp. 3493-3496.
22. H. Leung and S. Haykin, "The complex backpropagation algorithm," IEEE Trans. Signal Process., vol. 39, no. 9, pp. 2101-2104, Sep. 1991.
23. J. Makhoul, "Linear prediction: A tutorial review," Proc. IEEE, vol. 63, no. 4, pp. 140-148, Apr. 1975.
24. D. Mandic, J. Baltersee, and J. Chambers, "Nonlinear adaptive prediction of speech with a pipelined recurrent neural network and advanced learning algorithms," in Signal Analysis and Prediction, A. Prochazka, J. Uhlir, P. W. Rayner, and N. G. Kingsbury, Eds. Boston, MA: Birkhauser, 1998.
25. D. P. Mandic and J. A. Chambers, "Relating the slope of the activation function and the learning rate within a recurrent neural network," Neural Comput., vol. 11, no. 5, pp. 1069-1077, 1999.
26. D. P. Mandic and J. A. Chambers, "Toward an optimal PRNN-based nonlinear predictor," IEEE Trans. Neural Networks, vol. 10, no. 6, pp. 1435-1442, Nov. 1999.
27. D. P. Mandic and J. A. Chambers, "On the choice of parameters of the cost function in nested modular RNNs," IEEE Trans. Neural Networks , vol. 11, no. 2, pp. 315-322, Mar. 2000.
28. D. P. Mandic and J. A. Chambers, Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability. Chichester, U.K.: Wiley, 2001.
29. L. R. Medsker and L. C. Jain, Recurrent Neural Networks: Design and Applications, ser. International Series on Computational Intelligence. Boca Raton, FL: CRC, 2000.
30. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Networks, vol. 1, no. 1, pp. 4-27, Mar. 1990.
31. T. Needham, Visual Complex Analysis. Oxford, U.K.: Oxford Univ. Press, 1997.
32. O. Nerrand, P. Roussel-Ragot, L. Personnaz, and G. Dreyfus, "Neural networks and nonlinear adaptive filtering: unifying concepts and new algorithms," Neural Comput., vol. 5, pp. 165-199, 1993.
33. J. C. Principe, N. R. Euliano, and W. C. Lefebvre, Neural and Adaptive Systems: Fundamentals Through Simulations. New York: Wiley, 2000.
34. F. C. Ren, C. J. Chang, and R. G. Cheng, "An intelligent transmission controller for TDMA/PRMA wireless multimedia communication systems," in Proc. IEEE 50th Vehicular Technol. Conf., vol. 1, 1999, pp. 406-410.
35. E. Trentin, "Networks with trainable amplitude of activation functions," Neural Networks, vol. 14, no. 5, pp. 471-493, 2001.
36. L. Tsungnan, B. G. Horne, P. Tino, and C. L. Giles, "Learning long-term dependencies in NARX recurrent neural networks," IEEE Trans. Neural Networks, vol. 7, no. 6, pp. 1329-1338, Nov. 1996.
37. F. Vitagliano, R. Parisi, and A. Uncini, "Generalized splitting 2D flexible activation function," in Proc. 14th Italian Workshop Neural Nets, 2003, pp. 85-95.
38. B. Widrow and M. A. Lehr, "30 years of adaptive neural networks: perceptron, madaline, and backpropagation," Proc. IEEE, vol. 78, no. 9, pp. 1415-1442, Sep. 1990.
39. B. Widrow, J. McCool, and M. Ball, "The complex LMS algorithm," Proc. IEEE, vol. 63, pp. 712-720, 1975.
40. R. J. Williams and D. A. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural Comput., vol. 1, no. 2, pp. 270-280, 1989.