The quaternion LMS algorithm for adaptive filtering of hypercomplex processes

IEEE Transactions on Signal Processing

Volumn 57, Issue 4, 2009, Pages 1316-1327

  Took, Clive Cheong ^a   Mandic, Danilo P ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Adaptive multistep ahead prediction; Data fusion via vector spaces; Multidimensional adaptive filters; Quaternion signal processing; Wind modeling

Indexed keywords

ADAPTIVE FILTERING; ADAPTIVE FILTERS; DATA FUSION; ELECTRIC FILTERS; INFORMATION FUSION; SIGNAL PROCESSING; VECTORS;

ADAPTIVE MULTISTEP AHEAD PREDICTION; AIR TEMPERATURES; ATMOSPHERIC MODELING; BIVARIATE; COMPLEX NONLINEAR DYNAMICS; COMPONENT WISE; FUSION OF HETEROGENEOUS DATUM; INPUT VECTORS; LEAST MEAN SQUARES; LMS ALGORITHMS; MULTICHANNEL; MULTIDIMENSIONAL ADAPTIVE FILTERS; QUATERNION SIGNAL PROCESSING; REAL-WORLD DATUM; UNIVARIATE; VECTOR FIELDS; WIND FIELDS; WIND MODELING;

ADAPTIVE ALGORITHMS;

EID: 63449098959     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2008.2010600     Document Type: Article

References (48)

1. A. H. Sayed, Fundamentals of Adaptive Filtering. New York: Wiley IEEE Press, 2003.
2. B. Farhang-Boroujeny, Adaptive Filters Theory and Applications. New York: Wiley, 1999.
3. S. V. Vaseghi, Advanced Digital Signal Processing and Noise Reduction 2nd ed. New York: Wiley, 2002.
4. V. J. Mathews and Z. Xie, "A stochastic gradient adaptive filter with gradient adaptive stepsize," IEEE Trans. Signal Process., vol. 41, no. 6, pp. 2075-2087, Jun. 1993.
5. T. Aboulnasr and K. Mayyas, "A robust variable step-size LMS-type algorithm: Analysis and simulations," IEEE Trans. Signal Process. vol. 45, no. 3, pp. 631-639, Mar. 1997.
6. Y. Gong and C. F. N. Cowan, "An LMS style variable tap-length algorithm for structure adaptation," IEEE Trans. Signal Process., vol. 53, no. 7, pp. 2400-2407, Jul. 2005.
7. S. H. Strogatz, Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry and Engineering (Studies in Nonlinearity) 1st ed. Boulder, CO: Westview Press, 2001.
8. S. L. Goh, M. Chen, D. H. Popovic, K. Aihara, D. Obradovic, and D. P. Mandic, "Complex valued forecasting of wind profile," Renewable Energy, vol. 31, pp. 1733-1750, 2006.
9. B. Widrow, J. McCool, and M. Ball, "The complex LMS algorithm," Proc. IEEE, vol. 63, pp. 719-720, 1975.
10. S. L. Goh and D. P. Mandic, "An augmented extended kalman filter algorithm for complex-valued recurrent neural networks," Neural Comput., vol. 19, no. 4, pp. 1039-1055, 2007.
11. P. J. Schreier and L. L. Scharf, "Second-order analysis of improper complex random vectors and processes," IEEE Trans. Signal Process. vol. 51, no. 3, pp. 714-725, Mar. 2003.
12. W. Hamilton, Elements of Quaternions, 2nd ed. London, U.K.: Longmans, Green, & Company, 1899.
13. F. Zhang, "Quaternions and matrices of quaternions," Linear Algebra Appl., vol. 251, pp. 21-57, 1997.
14. S. B. Choe and J. J. Faraway, "Modeling head and hand orientation during motion using quaternions," J. Aerosp., vol. 113, no. 1, pp. 186-192, 2004.
15. D. Biamino, G. Cannata, M. Maggiali, and A. Piazza, "Mac-eye: A tendon driven fully embedded robot eye," in Proc. IEEE-RAS Int. Conf. Humanoid Robots, 2005, pp. 62-67.
16. C. F. F. Karney, "Quaternions in molecular modelling," J. Molecul. Graphics Model., vol. 25, no. 5, pp. 595-604, 2007.
17. S.-C. Pei and C.-M. Cheng, "Color image processing by using binary quaternion-moment-preserving thresholding technique," IEEE Trans. Image Process., vol. 8, no. 5, pp. 614-628, N\May 1999.
18. H. Toyoshima, "Computationally efficient implementation of hyper-complex digital filters," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 1998, vol. 3, pp. 1761-1764.
19. T. Bülow and G. Sommer, "Hypercomplex signals - A novel extension of the analytic signal to the multidimensional case," IEEE Trans. Signal Process., vol. 49, no. 11, pp. 2844-2852, Nov. 2001.
20. V. Zarzoso and A. K. Nandi, "Closed-form semi-blind separation of three sources from three real-valued instantaneous linear mixtures via quaternions," in Proc. IEEE 6th Symp. Signal Processing Applications 2001, vol. 1, pp. 1-4.
21. P. Bas, N. L. Bihan, and J. M. Chassery, "Color image watermarking using quaternion Fourier transform," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, 2003, vol. 3, pp. III-521.
22. S. Said, N. L. Bihan, and S. J. Sangwine, "Fast complexified quaternion Fourier transform," IEEE Trans. Signal Process., vol. 56, no. 4, pp. 1522-1531, Apr. 2008.
23. N. L. Bihan and J. Mars, "Singular value decomposition of quaternion matrices: A new tool for vector-sensor signal processing," Signal Process., vol. 84, no. 7, pp. 1177-1199, 2004.
24. S. Miron, N. L. Bihan, and J. Mars, "Quaternion-music for vector-sensor array processing," IEEE Trans. Signal Process., vol. 54, no. 4, pp. 1218-1229, Apr. 2006.
25. T. Jiang and L. Chen, "Algebraic algorithms for least squares next term problem in quaternionic quantum theory," Comput. Phys. Commun., vol. 176, no. 7, pp. 481-485, 2007.
26. A. Ude, "Nonlinear least squares optimisation of unit quaternion functions for pose estimation from corresponding features," in Proc. IEEE 14th Int. Conf. Pattern Recognit., 1998, vol. 1, pp. 425-427.
27. B. Picinbono and P. Chevalier, "Widely linear estimation with complex data," IEEE Trans. Signal Process., vol. 43, no. 8, pp. 2030-2033, Aug. 1995.
28. S. Javidi, M. Pedzisz, S. L. Goh, and D. Mandic, "The augmented complex least mean square algorithm with application to adaptive prediction problems," in IAPR Workshop Cognitive Information Processing, Santorini, Greece, Jun. 2008, pp. 54-57.
29. D. P. Mandic, S. Javidi, S. L. Goh, A. Kuh, and K. Aihara, "Complex-valued prediction of wind profile using augmented complex statistics," Renew. Energy, vol. 34, pp. 196-201, 2009.
30. Y. Huang and J. Benesty, Audio Signal Processing for Next Generation Multimedia Communication Systems. Boston, MA: Kluwer, 2004.
31. I. Kantor and A. Solodovnikov, Hypercomplex Numbers: An Elementary Introduction to Algebras. New York: Springer, 1989.
32. J. P. Ward, Quaternions and Cayley Numbers: Algebra and Applications Boston, MA: Kluwer, 1997.
33. D. P. Mandic and V. S. L. Goh, Complex Valued Nonlinear Adaptive Filters: A Neural Network Approach. New York: Wiley, 2008.
34. M. Novey and T. Adali, "Complex ICA by negentropy maximization," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 596-609, 2008.
35. M. Novey and T. Adali, "On extending the complex fastICA algorithm to non-circular sources," IEEE Trans. Signal Process., vol. 56, no. 5, pp. 2148-2154, May 2008.
36. B. Picinbono, "On circularity," IEEE Trans. Signal Process., vol. 42, no. 12, pp. 3473-3482, Dec. 1994.
37. B. Picinbono and P. Bondon, "Second-order statistics of complex signals," IEEE Trans. Signal Process., vol. 45, no. 2, pp. 411-420, Feb. 1997.
38. N. N. Vakhania, "Random vectors with values in quaternion Hilbert spaces," Theory Probab. Appl., vol. 43, no. 1, pp. 99-115, 1999.
39. P. O. Amblard and N. L. Bihan, "On properness of quaternion valued random variables," in Proc. IMA Conf. Mathematics in Signal Processing, Cirencester, U.K., Dec. 2004, pp. 23-26.
40. S. L. Goh and D. P. Mandic, "An augmented ACRTRL for complex valued recurrent neural networks," Elsevier Neural Netw., vol. 20, no. 10, pp. 1061-1066, 2007.
41. S. C. Douglas and D. P. Mandic, "Mean and mean-square analysis of the complex LMS algorithm for non-circular Gaussian signals," presented at the IEEE Digital Signal Processing and Signal Processing Education Workshop, Marco Island, FL, Jan. 2008 [Online]. Available: http://www.2009dsp.org/index.html
42. J. Seberry, K. Finlayson, S. S. Adams, T. A. Wysocki, T. Xia, and B. J. Wysocki, "The theory of quaternion orthogonal designs," IEEE Trans. Signal Process., vol. 56, no. 1, pp. 256-265, Jan. 2008.
43. S. Haykin, Adaptive Filter Theory, 4th ed. Englewood Cliffs, NJ: Prentice-Hall, 2001.
44. L. Huang and W. So, "On left eigenvalues of a quaternionic matrix," Linear Algebra Appl., vol. 323, pp. 105-116, 2001.
45. S. Haykin and L. Li, "Nonlinear adaptive prediction of nonstationary signals," IEEE Trans. Signal Process., vol. 43, no. 2, pp. 526-535, Feb. 1995.
46. J. G. M. J. F. Manwell and A. L. Rogers, Wind Energy Explained: Theory, Design and Application. New York: Wiley, 2002.
47. D. Mandic, M. Golz, A. Kuh, D. Obradovic, and T. Tanaka, Signal Processing Techniques for Knowledge Extraction and Information Fusion New York: Springer, 2008.
48. S. Sangwine and N. L. Bihan, Quaternion Toolbox for Matlab 2005 [Online]. Available: http://qtfm.sourceforge.net/