A class of frobenius norm-based algorithms using penalty term and natural gradient for blind signal separation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 6, 2008, Pages 1181-1193

  Manmontri, Uttachai ^a,b   Naylor, Patrick A ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b THAILAND INSTITUTE OF SCIENTIFIC AND TECHNOLOGICAL RESEARCH   (Thailand)

Author keywords

Blind signal separation (BSS); Natural gradient methods; Penalty term; Second order statistics

Indexed keywords

BLIND SEPARATION; BLIND SIGNAL SEPARATION; BLIND SIGNAL SEPARATION (BSS); DEMIXING MATRIX; FROBENIUS NORM; GRADIENT NOISE; INSTANTANEOUS MIXTURES; NATURAL GRADIENT; NATURAL GRADIENT METHODS; NON-STATIONARITY; NON-WHITE SIGNALS; NONSTATIONARY; NUMERICAL EXPERIMENTS; OFFLINE; ONLINE DATA; ONLINE PROCESSING; ORIGINAL ALGORITHMS; PENALTY TERM; REGULARIZATION PARAMETERS; SCALING FACTORS; SECOND-ORDER STATISTICS; SOURCE SIGNALS; UPPER BOUND;

ALGEBRA; APARTMENT HOUSES; BLIND SOURCE SEPARATION; FEATURE EXTRACTION; GRADIENT METHODS; NOISE POLLUTION; SEPARATION; SPEECH ANALYSIS;

BACKPROPAGATION ALGORITHMS;

EID: 66149153820     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.2001388     Document Type: Article

References (36)

1. A. Belouchrani, K. Abed-Meraim, J.-F. Cardoso, and E. Moulines, "A blind source separation technique using second-order statistics," IEEE Trans. Signal Process., vol. 45, no. 2, pp. 434-444, Feb. 1997. (Pubitemid 127765906)
2. H. Buchner, R. Aichner, and W. Kellermann, "A generalization of blind source separation algorithms for convolutive mixtures based on second- order statistics," IEEE Trans. Speech Audio Process., vol. 13, no.1, pp. 120-134, Jan. 2005.
3. L. Tong, R. Liu, V. C. Soon, and Y.-F. Huang, "Indeterminacy and identifiability of blind identification," IEEE Trans. Circuits Syst., vol. 38, no. 5, pp. 499-509, May 1991.
4. L. Parra and C. Spence, "Convolutive blind separation of non-sta-tionary sources," IEEE Trans. Speech Audio Process., vol. 8, no. 3, pp. 320-327, May 2000.
5. S. Choi and A. Cichocki, "Blind separation of nonstationary sources in noisy mixtures," Electron. Lett., vol. 36, pp. 848-849, Apr. 2000.
6. J.-F. Cardoso and A. Souloumiac, "Jacobi angles for simultaneous diagonalization," SIAM J. Matrix Anal. Applicat., vol. 17, no. 1, pp. 161-164,1996. (Pubitemid 126330213)
7. A. Ziehe, K.-R. Miiller, G. Nolle, B.-M. Mackert, and G. Curio, "Artifact reduction in magnetoneurography based on lime-delayed second-order correlations," IEEE Trans. Biomed. Eng., vol. 47, no. 1, pp. 75-87, Jan. 2000. (Pubitemid 30044003)
8. N. Murata, S. Ikeda, and A. Ziehe, "An approach to blind source separation based on temporal structure of speech signals," Neurcomputing, vol. 41, pp. 1-24, Oct. 2001. (Pubitemid 33713446)
9. J.-F. Cardoso, "On the performance of orthogonal source separation algorithms," in Proc. EUSIPCO'94, Edinburgh, U.K., Sep. 1994, pp. 776-779.
10. D. T. Pham, "Joint approximate diagonalization of positive definite Hermitian matrices," SIAM J. Matrix Anal. Applicat., vol. 22, no. 4, pp. 1136-1152,2000.
11. A. Yeredor, "Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation," IEEE Trans. Signal Process., vol. 50, no. 7, pp. 1545-1553, Jul. 2002.
12. K. Matsuoka, M. Ohya, and M. Kawamoto, "A neural net for blind separation of nonstationary signals," Neural Netw., vol. 8, no. 3, pp. 411-419, 1995.
13. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.
14. R. Aichner, H. Buchner, F. Yan, and W. Kellermann, "A real-time blind source separation scheme and its application to reverberant and noisy acoustic environment," Signal Process., vol. 86, pp. 1260-1277, Jun. 2006.
15. U. Manmontri and P. A. Naylor, "Blind identification using second-order statistics: a nonstationarity and nonwhiteness approach," in Proc. IEEEICASSP'05, Mar. 2005, vol. 5, pp. 305-308. (Pubitemid 43762404)
16. R. Aichner, H. Buchner, F. Yan, and W. Kellermann, "Blind signal separation using a criterion based on principle of minimal disturbance," in Proc. IEEE lcASSP'06, May 2006, vol. 5, pp. 829-832.
17. S. Amari, "Natural gradient works efficiently in learning," Neural Com-putat., vol. 10, pp. 251-276, Feb. 1998. (Pubitemid 128463152)
18. J.-F. Cardoso and B. H. Laheld, "Equivariant adaptive source separation," IEEE Trans. Signal Process., vol. 44, no. 12, pp. 3017-3030, Dec. 1996. (Pubitemid 126778048)
19. D.-T. Pham and J.-F. Cardoso, "Blind separation of instantaneous mixtures of nonstationary sources," IEEE Trans. Signal Process., vol. 49, no. 9, pp. 1837-1848, Sep. 2001.
20. C. D. Meyer, Matrix Analysis and Applied Linear Algebra. Philadelphia, PA: SIAM, 2000.
21. M. Joho, R. H. Lambert, and H. Mathis, "Elementary cost functions for blind separation of non-stationary source signals," in Proc. IEEE ICASSPVI, May 2001, pp. 2793-2796.
22. M. Joho and H. Mathis, "Joint diagonalization of correlation matrices by using gradient methods with application to blind signal separation," in Proc. IEEE SAM '02, Aug. 2002, pp. 273-277.
23. R. Thawonmas and A. Cichocki, "Blind signal extraction of arbitrarily distributed, but temporally correlated signals-A neural network approach," IEICE Trans. Fundamentals Electron., Commun., Comput. Sci., vol. E82-A, pp. 1834-1844, Sep. 1999.
24. Y.V. Wang, S. Sanei, and J. A. Chambers, "Penalty function-based joint diagonalization approach for convolutive blind separation of nonstationary sources," IEEE Trans. Signal Process., vol. 53, no. 5, pp. 1654-1669, May 2005.
25. D. G. Luenberger, Linear and Nonlinear Programming. Reading, MA: Addison-Wesley, 1984, ch. 12.
26. M. S. Bazaraa, H. D. Sherali, and C. M. Shetty, Nonlinear Programming Theory and Algorithms. New York: Wiley, 1993, ch. 9
27. R. D. DeGroat, E. M. Dowling, and D. A. Linebarger, V. K. Madisetti and D. B. Williams, Eds., "Subspace tracking," in Digital Signal Processing Handbook. Boca Raton, FL: CRC, 1998.
28. B. Widrow and M. Lehr, "30 years of adaptive neural networks: per-ceptron, madaline, and backpropaaation," Proc. IEEE, vol. 78, no. 9, pp. 1415-1442, Sep. 1990.
29. J. Dattorro, Comer Optimization and Euclidean Distance Geometry. Palo Alto, CA: Meboo, 2005.
30. E. Moreau, "A generalization of joint-diagonalization criteria for source separation," IEEE Trans. Signal Process., vol. 49, no. 3, pp. 530-541, Mar. 2001.
31. A. Souloumiac, "Blind source detection and separation using second order non-stationarity," in Proc. IEEE ICASSP'95, May 1995, pp. 1912-1915.
32. M. K. Tsatsanis and C. Kweon, "Blind source separation os non-stationary sources using second-order statistics," in Proc. 32nd Asilomar Conf. Signals, Syst., Comput., Nov. 1998, pp. 1574-1578.
33. A. H. Karp, "Exponential and logarithm by sequential squaring," IEEE Trans. Comput., vol. C-33, no. 5, pp. 462-464, May 1984. (Pubitemid 14564703)
34. K. Abed-Meraim, Y. Xiang, J. H. Manton, and Y. Hua, "Blind source-separation using second-order cyclostationary statistics," IEEE Trans. Signal Process., vol. 49, no. 4, pp. 694-701, Apr. 2001.
35. K. Abed-Meraim, Y. Xiang, and Y. Hua, "Generalized second order identifiability condition and relevant testing technique," in Proc. IEEE ICASSP'00, Jun. 2000, pp. 2989-2992.
36. J. D. Erdogmus, Y. N. Rao, K. E. Hild, II, and J. C. Principe, "Simultaneous principal-component extraction with application to adaptive blind multiuser detection," EURASIPJ. Appl. Signal Process., vol. 2002, no. 12, pp. 1473-1484, 2002.