Quaternion ICA from second-order statistics

IEEE Transactions on Signal Processing

Volumn 59, Issue 4, 2011, Pages 1586-1600

  Vía, Javier ^a   Palomar, Daniel P ^b   Vielva, Luis ^a   Santamaría, Ignacio ^a  

^a UNIVERSITY OF CANTABRIA   (Spain)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Approximated joint diagonalization (AJD); blind source separation (BSS); independent component analysis (ICA); properness; properness profile; propriety; quaternions; second order circularity

Indexed keywords

JOINT DIAGONALIZATION; PROPERNESS; PROPRIETY; QUATERNIONS; SECOND-ORDER CIRCULARITY;

BLIND SOURCE SEPARATION; COVARIANCE MATRIX; MAXIMUM LIKELIHOOD; NEWTON-RAPHSON METHOD; RANDOM VARIABLES;

INDEPENDENT COMPONENT ANALYSIS;

EID: 79952654668     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2101065     Document Type: Article

References (62)

1. W. R. Hamilton, "On quaternions," in Proc. Roy. Irish Acad., Nov. 11, 1844, pp. 1-16.
2. J. P. Ward, Quaternions and Cayley Numbers: Algebra and Applications. Dordrecht, The Netherlands: Kluwer, 1997.
3. A. J. Hanson, Visualizing Quaternions. San Mateo, CA: Morgan Kaufmann, 2005.
4. L. Fortuna, G. Muscato, and M. Xibilia, "A comparison between HMLP and HRBF for attitude control," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 318-328, Mar. 2001. (Pubitemid 32371486)
5. J. B. Kuipers, Quaternions and Rotation Sequences: A Primer With Applications to Orbits, Aerospace and Virtual Reality. Princeton, NJ: Princeton Univ. Press, 2002.
6. S.-C. Pei and C.-M. Cheng, "Color image processing by using binary quaternion-moment-preserving thresholding technique," IEEE Trans. Image Process., vol. 8, no. 5, pp. 614-628, May 1999.
7. C. Moxey, S. Sangwine, and T. Ell, "Hypercomplex correlation techniques for vector images," IEEE Trans. Signal Process., vol. 51, no. 7, pp. 1941-1953, Jul. 2003.
8. T. Bulow and G. Sommer, "Hypercomplex signals-a novel extension of the analytic signal to the multidimensional case," IEEE Trans. Signal Process., vol. 49, no. 11, pp. 2844-2852, Nov. 2001. (Pubitemid 33048453)
9. M. Felsberg and G. Sommer, "The monogenic signal," IEEE Trans. Signal Process., vol. 49, no. 12, pp. 3136-3144, Dec. 2001. (Pubitemid 34035668)
10. C. C. Took and D. P. Mandic, "The quaternion LMS algorithm for adaptive filtering of hypercomplex processes," IEEE Trans. Signal Process., vol. 57, no. 4, pp. 1316-1327, Apr. 2009.
11. N. ur Rehman and D. P. Mandic, "Empirical mode decomposition for trivariate signals," IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1059-1068, Mar. 2010.
12. J. Seberry, K. Finlayson, S. Adams, T. Wysocki, T. Xia, and B. Wysocki, "The theory of quaternion orthogonal designs," IEEE Trans. Signal Process., vol. 56, no. 1, pp. 256-265, Jan. 2008.
13. J.-C. Belfiore and G. Rekaya, "Quaternionic lattices for space-time coding," in Proc. IEEE Inf. Theory Workshop, Apr. 2003, pp. 267-270.
14. J.-C. Belfiore, G. Rekaya, and E. Viterbo, "The golden code: A 2×2 full-rate space-tie code with non-vanishing determinant," IEEE Trans. Inf. Theory, vol. 51, no. 4, pp. 1432-1436, Apr. 2005. (Pubitemid 40555885)
15. M.-Y. Chen, H.-C. Li, and S.-C. Pei, "Algebraic identification for optimal nonorthogonality 4×4 complex space-time block codes using tensor product on quaternions," IEEE Trans. Inf. Theory, vol. 51, no. 1, pp. 324-330, Jan. 2005. (Pubitemid 40146005)
16. C. Hollanti, J. Lahtonen, K. Ranto, R. Vehkalahti, and E. Viterbo, "On the algebraic structure of the silver code: A 2×2 perfect space-time block code," in Proc. IEEE ITW, May 2008, pp. 91-94.
17. S. Sirianunpiboon, A. Calderbank, and S. Howard, "Bayesian analysis of interference cancellation for Alamouti multiplexing," IEEE Trans. Inf. Theory, vol. 54, no. 10, pp. 4755-4761, Oct. 2008.
18. J. Vía, D. Ramírez, and I. Santamaría, "Properness and widely linear processing of quaternion random vectors," IEEE Trans. Inf. Theory, vol. 56, no. 7, pp. 3502-3515, Jul. 2010.
19. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
20. N. Le Bihan and S. Buchholz, "Quaternionic idependent component analysis using hypercomplex nonlinearities," presented at the IMA Conf. Math. Signal Process., Cirenceister, U.K., 2006.
21. G. M. Menanno and N. L. Bihan, "Quaternion polynomial matrix diagonalization for the separation of polarized convolutive mixture," Signal Process., vol. 90, no. 7, pp. 2219-2231, Jul. 2010.
22. S. Alamouti, "A simple transmit diversity technique for wireless communications," IEEE J. Sel. Areas Commun., vol. 16, no. 8, pp. 1451-1458, 1998. (Pubitemid 128566830)
23. S. Barbarossa, Multiantenna Wireless Communication Systems. Boston, MA: Artech House, 2005.
24. C. C. Took and D. P. Mandic, "Augmented second-order statistics of quaternion random signals," Signal Process., vol. 91, no. 2, pp. 214-224, Feb. 2011.
25. P. Schreier, L. Scharf, and C. Mullis, "Detection and estimation of improper complex random signals," IEEE Trans. Inf. Theory, vol. 51, no. 1, pp. 306-312, Jan. 2005. (Pubitemid 40146002)
26. P. Schreier, L. Scharf, and A. Hanssen, "A generalized likelihood ratio test for impropriety of complex signals," IEEE Signal Process. Lett., vol. 13, no. 7, pp. 433-436, Jul. 2006. (Pubitemid 43997205)
27. J. Eriksson and V. Koivunen, "Complex random vectors and ICA models: Identifiability, uniqueness and separability," IEEE Trans. Inf. Theory, vol. 52, no. 3, pp. 1017-1029, Mar. 2006. (Pubitemid 46444889)
28. D.-T. Pham, "Joint approximate diagonalization of positive definite hermitian matrices," SIAM J. Matrix Anal. Appl., vol. 22, no. 4, pp. 1136-1152, 2000.
29. D.-T. Pham and J.-F. Cardoso, "Blind separation of instantaneous mixtures of nonstationary sources," IEEE Trans. Signal Process., vol. 49, no. 9, pp. 1837-1848, Sep. 2001. (Pubitemid 32866193)
30. A. Ziehe, P. Laskov, G. Nolte, and K. R. MÜller, "A fast algorithm for joint diagonalization with non-orthogonal transformations and its application to blind source separation," J. Mach. Learn. Res., vol. 5, pp. 777-800, 2004.
31. R. Vollgraf and K. Obermayer, "Quadratic optimization for simultaneous matrix diagonalization," IEEE Trans. Signal Process., vol. 54, no. 9, pp. 3270-3278, Sep. 2006. (Pubitemid 46405368)
32. X.-L. Li and X.-D. Zhang, "Nonorthogonal joint diagonalization free of degenerate solution," IEEE Trans. Signal Process., vol. 55, no. 5, pp. 1803-1814, May 2007. (Pubitemid 46695365)
33. P. Tichavsky and A. Yeredor, "Fast approximate joint diagonalization incorporating weight matrices," IEEE Trans. Signal Process., vol. 57, no. 3, pp. 878-891, Mar. 2009.
34. A. Souloumiac, "Nonorthogonal joint diagonalization by combining givens and hyperbolic rotations," IEEE Trans. Signal Process., vol. 57, no. 6, pp. 2222-2231, Jun. 2009.
35. J. Nocedal and S. J. Wright, Numerical Optimization, ser. Operations Research. New York: Springer-Verlag, 1999.
36. M. Novey and T. Adali, "Complex ICA by negentropy maximization," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 596-609, Apr. 2008. (Pubitemid 351583577)
37. T. Adali, H. Li, M. Novey, and J.-F. Cardoso, "Complex ICA using nonlinear functions," IEEE Trans. Signal Process., vol. 56, no. 9, pp. 4536-4544, Sep. 2008.
38. H. Li and T. Adali, "A class of complex ICA algorithms based on the kurtosis cost function," IEEE Trans. Neural Netw., vol. 19, no. 3, pp. 408-420, Mar. 2008. (Pubitemid 351418955)
39. S. Buchholz and N. L. Bihan, "Polarized signal classification by complex and quaternionic multi-layer perceptrons," Int. J. Neural Syst., vol. 18, no. 2, pp. 75-85, 2008. (Pubitemid 351730107)
40. A. J. Bell and T. J. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural Comput., vol. 7, no. 6, pp. 1129-1159, 1995.
41. T. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1991.
42. F. Zhang, "Quaternions and matrices of quaternions," Linear Algebra Appl., vol. 251, pp. 21-57, 1997. (Pubitemid 127379941)
43. N. L. Bihan and J. Mars, "Singular value decomposition of quaternion matrices: A new tool for vector-sensor signal processing," Signal Process., vol. 84, no. 7, pp. 1177-1199, 2004.
44. T. Ell and S. Sangwine, "Hypercomplex Fourier transforms of color images," IEEE Trans. Image Process., vol. 16, no. 1, pp. 22-35, Jan. 2007. (Pubitemid 46437466)
45. F. Neeser and J. Massey, "Proper complex random processes with applications to information theory," IEEE Trans. Inf. Theory, vol. 39, no. 4, pp. 1293-1302, Jul. 1993.
46. A. van den Bos, "The multivariate complex normal distribution-a generalization," IEEE Trans. Inf. Theory, vol. 41, no. 2, pp. 537-539, Mar. 1995.
47. B. Picinbono, "Second-order complex random vectors and normal distributions," IEEE Trans. Signal Process., vol. 44, no. 10, pp. 2637-2640, Oct. 1996. (Pubitemid 126776569)
48. P. Schreier and L. Scharf, "Second-order analysis of improper complex random vectors and processes," IEEE Trans. Signal Process., vol. 51, no. 3, pp. 714-725, Mar. 2003.
49. N. N. Vakhania, "Random vectors with values in quaternion Hilbert spaces," Theory Probab. Appl., vol. 43, no. 1, pp. 99-115, 1999.
50. P. Amblard and N. Le Bihan, "On properness of quaternion valued random variables," in Proc. IMA Conf. Math. Signal Process., Cirencester, U.K., 2004, pp. 23-26.
51. E. Ollila, "On the circularity of a complex random variable," IEEE Signal Process. Lett., vol. 15, pp. 841-844, 2008.
52. J. Eriksson, E. Ollila, and V. Koivunen, "Essential statistics and tools for complex random variables," IEEE Trans. Signal Process., vol. 58, no. 10, pp. 5400-5408, Oct. 2010.
53. E. L. Lehmann and J. P. Romano, Testing Statistical Hypothesis, 3rd ed. New York: Springer, 2005.
54. A.Walden and P. Rubin-Delanchy, "On testing for impropriety of complex- valued Gaussian vectors," IEEE Trans. Signal Process., vol. 57, no. 3, pp. 825-834, Mar. 2009.
55. P. J. Schreier and L. L. Scharf, Statistical Signal Processing of Complex- Valued Data: The Theory of Improper and Noncircular Signals. Cambridge, U.K.: Cambridge Univ. Press, 2010.
56. J. Cardoso, "Unsupervised adaptive filtering, volume 1, blind source separation," in Ch. Entropic Contrasts for Source Separation: Geometry and Stability. New York: Wiley, 2000, vol. 1, pp. 139-190.
57. J. Vía, I. Santamaría, and J. Pérez, "A learning algorithm for adaptive canonical correlation analysis of several data sets," Neural Netw., vol. 20, no. 1, pp. 139-152, Jan. 2007. (Pubitemid 44960627)
58. J. R. Kettenring, "Canonical analysis of several sets of variables," Biometrika, vol. 58, no. 3, pp. 433-451, 1971.
59. S.-I. Amari and H. Nagaoka, Methods of Information Geometry, A. M. Society, Ed. Oxford, U.K.: Oxford Univ. Press, 1993.
60. F. R. Bach and M. I. Jordan, "Kernel independent component analysis," J. Mach. Learn. Res., vol. 3, pp. 1-48, 2002.
61. J. Vía and I. Santamaría, "On the blind identifiability of orthogonal space-time block codes from second order statistics," IEEE Trans. Inf. Theory, vol. 54, no. 2, pp. 709-722, Feb. 2008. (Pubitemid 351314661)
62. J. Vía and I. Santamaría, "Correlation matching approaches for blind OSTBC channel estimation," IEEE Trans. Signal Process., vol. 56, no. 12, pp. 5950-5961, Dec. 2008.