Neural network approach to blind signal separation of mono-nonlinearly mixed sources

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 52, Issue 6, 2005, Pages 1236-1247

  Woo, W L ^a   Dlay, S S ^a  

^a NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

Independent component analysis (ICA); Neural networks; Nonlinear distortion; Nonlinear systems; Signal reconstruction

Indexed keywords

COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; INDEPENDENT COMPONENT ANALYSIS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; MATHEMATICAL TRANSFORMATIONS; MAXIMUM LIKELIHOOD ESTIMATION; NEURAL NETWORKS; NONLINEAR DISTORTION; NONLINEAR SYSTEMS; SIGNAL RECONSTRUCTION; STATISTICAL METHODS;

GRADIENT ALGORITHM; METROPOLIS ALGORITHM; MONO-NONLINEARLY MIXED SOURCES;

BLIND SOURCE SEPARATION;

EID: 22144484536     PISSN: 10577122     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2005.849122     Document Type: Article

References (37)

1. A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
2. A. Cichocki and S. Amari, Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications. London, U.K.: Wiley, 2002.
3. T. Gautama, D. P. Mandic, and M. M. Van Hulle, "Signal nonlinearity in fMRI: A comparison between BOLD and MION," IEEE Trans. Med. Imag., vol. 22, no. 5, pp. 636-644, May 2003.
4. W. L. Woo and S. Sali, "The use of sub-space transforms in signal and array processing," in Proc. Int. Conf. 2nd 3G Mobile Communications, London, U.K., Mar. 2001.
5. A. Saleh, "Frequency-independent and frequency-dependent nonlinear models of TWT amplifiers," IEEE Trans. Commun., vol. COM-29, no. 11, pp. 1715-1720, Nov. 1981.
6. L. Parra, "Sympletic nonlinear component analysis," in Advances in Neural Inform. Process. Systems. Cambridge, MA: MIT Press, 1996, vol. 8, pp. 437-443.
7. S. Harmeling, A. Ziehe, B. Blankertz, and K. R. Kuller, "Nonlinear blind source separation using kernel feature spaces," in Proc. Int. Conf. on ICA and Signal Separation, San Diego, CA, 2001.
8. Y. Tan and J. Wang, "Nonlinear blind source separation using higher-order statistics and a genetic algorithm," IEEE Trans. Evol. Computat., vol. 5, no. 6, pp. 600-612, Dec. 2001.
9. Y. Tan, J. Wang, and J. Zurada, "Nonlinear blind source separation using a radial basis function network," IEEE Trans. Neural Netw., vol. 12, no. 1, pp. 124-134, Feb. 2001.
10. J. K. Lin, D. G. Grier, and J. D. Cowan, "Source separation and density estimation by faithful equivariant SOM," in Advances in Neural Inform. Process. Systems. Cambridge, MA: MIT Press, 1997, vol. 9.
11. P. Pajunen, A. Hyvarinen, and J. Karhunen, "Nonlinear blind source separation by self-organizing maps," in Advances in Neural Inform. Process. Systems. Cambridge, MA: MIT Press, 1996, pp. 1207-1210.
12. G. Burel, "Blind separation of sources: A nonlinear neural algorithm," Neural Netw., pp. 937-947, 1992.
13. H. Valpola and J. Karhunen, "An unsupervised ensemble learning method for nonlinear dynamic state-space models," Neural Computat., vol. 14, pp. 2647-2692, 2002.
14. H. Valpola, E. Oja, A. Ilin, A. Honkela, and J. Karhunen, "Nonlinear blind source separation by variational Bayesian learning," IEICE Trans. Fund., Electron., Commun., Comp. Sci., vol. E86-A, pp. 532-541,2003.
15. A. Taleb and C. Jutten, "Source separation in post-nonlinear mixtures," IEEE Trans. Signal Process., vol. 47, no. 10, pp. 2807-2820, Oct. 1999.
16. W. L. Woo and L. C. Khor, "Blind restoration of nonlinearly mixed signals using multilayer polynomial neural network," Proc. Inst. Elect. Eng. - Vision, Image Signal Process., vol. 151, no. 1, pp. 51-61, 2004.
17. T. W. Lee, "Blind source separation of nonlinear mixing models," Neural Netw., pp. 121-131, 1997.
18. M. Solazzi, R. Parisi, and A. Uncini, "Blind source separation in nonlinear mixtures by adaptive spline neural network," in Proc. Int. Conf. ICA Signal Separation, San Diego, CA, 2001.
19. H. H. Yang, S. Amari, and A. Cichocki, "Information-theoretic approach to blind separation of sources in nonlinear mixture," Signal Process., vol. 64, pp. 291-300, 1998.
20. W. L. Woo and S. Sali, "General multilayer perceptron demixer scheme for nonlinear blind signal separation," Proc. Inst. Elect. Eng. - Vision, Image Signal Process., vol. 149, no. 5, pp. 253-262, 2002.
21. A. Hyvarinen and P. Pajunen, "Nonlinear independent component analysis: Existence and uniqueness results," Neural Netw., vol. 8, pp. 525-535, 1999.
22. C. Jutten and J. Karhunen, "Advances in blind source separation and independent component analysis for nonlinear mixtures," Int. J. Neur. Syst., vol. 14, no. 5, pp. 1-26, 2004.
23. E. Zeidler, Nonlinear Functional Analysis and its Applications. New York: Springer-Verlag, 1989.
24. J. Eriksson and V. Koivunen, "Blind identifiability of class of nonlinear instantaneous ICA models," in Proc. XI Eur. Signal Processing Conf., Toulouse, France, 2002.
25. J. F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," Proc. Inst. Elect. Eng., pt. F, vol. 140, pp. 362-370, 1993.
26. H. Lappalainen and J. W. Miskin, "Ensemble learning," in Advances in Independent Component Analysis, M. Girolami, Ed. London, U.K.: Springer-Verlag, 2000, pp. 75-92.
27. G. Cybenko, "Approximation by superpositions of a sigmoidal function," Math. Contr. Signal. Syst., vol. 2, 1987.
28. C. Nikias and A. Petropulu, Higher-Order Spectral Analysis - A Nonlinear Signal Processing Framework. Englewood Cliffs, NJ: Prentice-Hall, 1993.
29. A. M. Kagan, Y. V. Linnik, and C. R. Rao, Characterization Problems in Mathematical Statistics. New York: Wiley, 1973.
30. S. Amari, "Natural gradient works efficiently on learning," Neur. Comp., vol. 10, pp. 287-314, 1998.
31. S. Kirkpatrick, "Optimization by simulated annealing: Quantitative studies," J. Stat. Phys., vol. 34, 1984.
32. R. M. Clemente, C. G. Puntonet, and F. Rojas, "Post-nonlinear blind source separation using methaheuristics," Electron. Lett., vol. 39, pp. 1765-1766, 2003.
33. C. G. Puntonet, A. Mansour, C. Bauer, and E. Lang, "Separation of sources using simulated annealing and competitive learning," Neurocomp., vol. 49, pp. 39-60, 2002.
34. S. Amari, A. Cichocki, and H. H. Yang, "A new learning algorithm for blind signal separation," Adv. Neur. Inf. Process. Syst., vol. 8, pp. 757-763, 1996.
35. P. Comon, "Independent component analysis: A new concept?," Signal Process., vol. 36, 1994.
36. W. Frank, R. Roger, and U. U. Appel, "Loudspeaker nonlinearities - Analysis and compensation," in Proc. Int. Asilomar on Signals, Systems and Computers, Pacific Grove, CA, 1992.
37. T. F. Quatieri, D. A. Reynolds, and G. C. O'Leary, "Estimation of handset nonlinearity with application to speaker recognition," IEEE Trans. Speech Audio Process., vol. 8, no. 5, pp. 567-584, Sep. 2000.