Extended Hebbian learning for blind separation of complex-valued sources

IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing

Volumn 50, Issue 4, 2003, Pages 195-202

  Fiori, Simone ^a  

^a UNIVERSITY OF PERUGIA   (Italy)

Author keywords

Artificial neural networks; Blind source separation; Complex weighted networks; Hebbian learning; Parallel sequential signal processing

Indexed keywords

BLIND SOURCE SEPARATION; ITERATIVE METHODS; LEARNING ALGORITHMS; NEURAL NETWORKS;

HEBBIAN LEARNING;

SIGNAL PROCESSING;

EID: 0037399395     PISSN: 10577130     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSII.2003.810486     Document Type: Article

References (40)

1. E. Bingham and A. Hyvärinen, "ICA of complex valued signals: A fast and robust deflationary algorithm," in Proc. Int. Joint Conf. Neural Networks (IJCNN), vol. III, Como, Italy, July 2000, pp. 357-362.
2. J.-F. Cardoso, "High-order contrasts for independent component analysis," Neural Comput., vol. 11, no. 1, pp. 157-192, Jan. 1999.
3. J. F. Cardoso and B. Laheld, "Equivariant adaptive source separation," IEEE Trans. Signal Processing, vol. 44, pp. 3017-3030, Dec. 1996.
4. Y. Chen and C. Hou, "High resolution adaptive bearing estimation using a complex-weighted neural network," in Proc. Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), vol. II, 1992, pp. 317-320.
5. H. Chen and R.-w. Liu, "An on-line unsupervised learning machine for adaptive feature extraction," IEEE Trans. Circuits Syst. II, vol. 41, pp. 87-98, Feb. 1994.
6. S. Cho, O. K. Ersoy, and M. R. Lehto, "Parallel, self-organizing, hierarchical neural networks with competitive learning and safe rejection schemes," IEEE Trans. Circuits Syst. II, vol. 40, pp. 556-567, Sept. 1993.
7. A. Cichocki, W. Kasprzak, and W. Skarbek, "Adaptive learning algorithm for principal component analysis with partial data," in Proc. Cybernetics and Systems, vol. 2, 1996, pp. 1014-1019.
8. A. Cichocki and R. Unbehauen, "Robust neural networks with on-line learning for blind identification and blind separation of sources," IEEE Trans. Circuits Syst. II, vol. 43, pp. 894-906, Nov. 1996.
9. P. Comon, "Independent component analysis, a new concept?," Signal Processing, vol. 36, pp. 287-314, 1994.
10. S. Costa and S. Fiori, "Image compression using principal component neural networks," Image and Vision Comput. J., vol. 19, no. 9-10, pp. 649-668, Aug. 2001.
11. M. C. F. De Castro, F. C. C. De Castro, J. N. Amaral, and P. R. G. Franco, "A complex valued Hebbian learning algorithm," in Proc. Int. Joint Conf. Neural Networks (IJCNN), Anchorage, AK, 1998, pp. 1235-1238.
12. G. Desodt and D. Muller, "Complex ICA applied to the separation of radar signals," in Proc. Eur. Signal Processing Conf. (EUSIPCO), vol. I, 1990, pp. 665-668.
13. K. I. Diamantaras and S.-Y. Kung, Principal Component Neural Networks: Theory and Applications. New York: Wiley, 1996.
14. Y. Ephraim and H. L. Van Trees, "A signal subspace approach for speech enhancement," IEEE Trans. Speech Audio Processing, vol. 3, pp. 251-266, July 1995.
15. S. Fiori, "Neural blind separation of complex sources by extended Hebbian learning," in Proc. Int. Symp. Circuits and Systems (ISCAS), vol. V, Orlando, FL, 1999, pp. 339-342.
16. _, "Blind signal processing by the adaptive activation function neurons," Neural Networks, vol. 13, no. 6, pp. 597-611, Aug. 2000.
17. _, "Blind separation of circularly-distributed sources by neural extended APEX algorithm," Neurocomput., vol. 34, no. 1-4, pp. 239-252, Aug. 2000,
18. S. Fiori and F. Piazza, "Neural MCA for robust beamforming," in Proc. Int. Symp. Circuits and Systems (ISCAS), vol. III, Geneva, Switzerland, May 2000, pp. 614-617.
19. _. "A general class of ψ-APEX PCA neural algorithms," IEEE Trans. Circuits Syst. I, vol. 47, pp. 1394-1398, Sept. 2000.
20. S. Fiori, "A theory for learning by weight flow on Stiefel-Grassman manifold," Neural Computation, vol. 13, no. 7, pp. 1625-1647, July 2001.
21. _, "A theory for learning based on rigid bodies dynamics," IEEE Trans. Neural Networks, vol. 13, pp. 521-531, May 2002.
22. K. Gao, M. O. Ahmed, and M. N. S. Swamy, "A constrained anti-Hebbian learning algorithm for total least-squares estimation with applications to adaptive FIR and IIR filtering," IEEE Trans. Circuits Syst. II, vol. 41, pp. 718-729, Nov. 1994.
23. G. M. Georgiou and C. Koutsougeras, "Complex domain backpropagation," IEEE Trans. Circuits Syst. II, vol. 39, pp. 330-334, May 1992.
24. C. Jutten and J. Herault, "Independent component analysis (INCA) versus principal component analysis," in Proc. Eur. Signal Processing Conf. (EUSIPCO), vol. 2, 1988, pp. 643-646.
25. _, "Blind separation of sources, Part I: An adaptive algorithm based on neuromimetic architecture," Signal Processing, vol. 24, pp. 1-10, 1991.
26. N.B. Karayiannis and A. N. Venetsanopoulos, "Fast learning algorithms for neural networks," IEEE Trans. Circuits Syst. II, vol. 39, pp. 453-474, July 1992.
27. J. Karhunen and J. Joutsensalo, "Representation and separation of signals using nonlinear PCA type learning," Neural Networks, vol. 7, no. 1, pp. 113-127, 1994.
28. T. Lehmann, "Classical conditioning with pulsed integrated neural networks: Circuits and system," IEEE Trans. Circuits Syst. II, vol. 45, pp. 720-728, June 1998.
29. R.-w. Liu, "Blind signal processing: An introduction," in Proc. Int. Symp. Circuits and Systems (ISCAS), vol. 2, 1996, pp. 81-84.
30. E. Oja, "Nonlinear PCA criterion and maximum likelihood in independent component analysis," in Proc. 1st Int. Conf. Independent Component Analysis and Blind Source Separation (ICA), Aussois, France, 1998, pp. 143-148.
31. E. Oja, H. Ogawa, and J. Wangviwattana, "Learning in nonlinear constrained Hebbian networks," in Proc. Int. Conf. Artificial Neural Networks (ICANN), 1991, pp. 385-390.
32. M. Oguz Sunay and M. M. Fahmy, "An orthogonal approach to the spatial-domain design of 2-D recursive and nonrecursive nonlinear filters," IEEE Trans. Circuits Syst. II, vol. 41, pp. 669-677, Oct. 1994.
33. R. Perfetti, "On the robust design of k-winners-take-all networks," IEEE Trans. Circuits Syst. II, vol. 42, pp. 55-58, Jan. 1995.
34. K. Reif, F.-L. Luo, and R. Unbehauen, "The exponential stability of the invariant-norm PCA algorithm," IEEE Trans. Circuits Syst. II, vol. 44, pp. 873-876, Oct. 1997.
35. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Networks, vol. 2, pp. 459-473, 1989.
36. M. R. Smith and Y. Hui, "A data extrapolation algorithm using a complex domain neural network," IEEE Trans. Circuits Syst. II, vol. 44, pp. 143-147, Feb. 1997.
37. A. Sudjianto and M. H. Hassoun, "Nonlinear Hebbian rule: A statistical interpretation," in Proc. Int. Conf. Neural Networks (ICNN), vol. 2, 1994, pp. 1247-1252.
38. R. Thawonmas, A. Cichocki, and S.-i. Amari, "A cascade neural network for blind signal extraction without spurious equilibria," IEICE Trans. Fundamentals, vol. E81-A, no. 9, pp. 1833-1846, Sept. 1998.
39. K. Torkkola, "Blind deconvolution, information maximization, and recursive filters," in Proc. Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Munich, Germany, 1997, pp. 3301-3304.
40. Q. Zhang and Y.-W. Leung, "Convergence of a Hebbian-type learning algorithm," IEEE Trans. Circuits Syst. II, vol. 45, pp. 1599-1601, Dec. 1998.