Effective learning rate adjustment of blind source separation based on an improved particle swarm optimizer

IEEE Transactions on Evolutionary Computation

Volumn 12, Issue 2, 2008, Pages 242-251

  Hsieh, Sheng Ta ^a   Sun, Tsung Ying ^a   Lin, Chun Ling ^a,b   Liu, Chan Cheng ^a  

^a NATIONAL DONG HWA UNIVERSITY   (Taiwan)

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Blind source separation (BSS); Learning rate; Particle swarm optimization (PSO); Turnaround factor (TF)

Indexed keywords

ALGORITHMS; INDEPENDENT COMPONENT ANALYSIS; PARTICLE SWARM OPTIMIZATION (PSO); PROBABILITY DISTRIBUTIONS;

LEARNING RATE; SOURCE SIGNALS; TURNAROUND FACTOR;

BLIND SOURCE SEPARATION;

EID: 42249093168     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2007.898781     Document Type: Article

References (32)

1. A. Cichocki and R. Unbehauen, "Robust neural network with on-line learning for blind identification and blind separation of source," IEEE Trans. Circuits and Syst.-I: Fundamental Theory and Applications vol. 43, no. 11, Nov. 1996.
2. A. J. Bell and T. J. Sejnowski, "Learning the higher-order structure of a natural sound," Network: Computation in Neural Systems, pp. 261-266, 1996.
3. A. J. Bell and T. J. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural Comput., vol. 7, no. 6, pp. 1129-1159, 1995.
4. S. Amari, "Theory of adaptive pattern classfiers," IEEE Trans. Electr. Comput., vol. EC-16, pp. 299-307, 1967.
5. R. W. Harris, D. M. Chabries, and F. A. Bishop, "A variable step (VS) adaptive filter algorithm," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-34, pp. 309-316, Apr. 1986.
6. R. H. Kwong and E. W. Johnston, "A variable step-size LMS algorithm", IEEE Trans. Signal Process., vol. 40, pp. 1631-1642, July 1992.
7. W. S. Gan, "Fuzzy step-size adjustment for the LMS algorithm", Signal Process., vol. 49, pp. 145-149, 1996.
8. M. G. Jafari, H. W. Seah, and J. A. Chambers, "A combined Kalman filter and natural gradient algorithm approach for blind separation of binary distributed sources in time-varying channels," in Proc. Acoustics, Speech, Signal Process., 2001, vol. 5, pp. 2769-2772.
9. A. Cichocki, S. Amari, M. Adachi, and W. Kasprzak, "Self-adaptive neural networks for blind separation of sources," in Proc. Int. Symp. Circuits Syst., 1996, vol. 2, pp. 157-160.
10. N. Murata, K.-R, Müller, A. Ziehe, and S. Amari, "Adaptive on-line learning in changing environments," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1997, vol. 9, pp. 599-605.
11. S. C. Dougles and A. Cichoki, "Adaptive step size techniques for decorrelation and blind source separation," in Proc. 32nd Asilomar Conf. Signals. Syst.. Comput., Nov. 1998, vol. 2, pp. 1991-1995.
12. S. T. Lou and X.D. Zhang, "Fuzzy-based learning rate determination for blind source separation," IEEE Trans. Fuzzy Syst., vol. 11, no. 3, pp. 375-383, Jun. 2003.
13. P. Comon, "Independent component analysis, a new concept," Signal Process., vol. 36, 287-314, 1994.
14. J. F. Cardoso and B. H. Laheld, "Equivariant adaptive source separation." IEEE Trans. Signal Process., vol. 44, p. 3017-3030, Dec. 1996.
15. S. Amari, A. Cichocki, and H. H. Yang, "A new learning algorithm for blind signal separation," Adv. Neural Inf. Process. Syst., vol. 8, pp. 757-763, 1996.
16. S. Cruces, A. Cichocki, and L. Castedo, "An iterative inversion approach to blind source separation," IEEE Trans. Neural Netw., vol. 11, pp. 1423-1437, Nov. 2000.
17. B. H. Cardoso and B. H. Laheld, "Equivariant adaptive source separation," IEEE Trans. Signal Process., vol. 44, pp. 3017-3030, Dec. 1996.
18. R. C. Eberhart and J. Kennedy, "A new optimizer using particle swarm theory," in Proc. 6th Int. Symp. Micro Mach. Human, 1995, pp. 39-43.
19. V. G. Gudise and G. K. Venayagamoorthy, "Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks," in Proc. IEEE Swarm Intell. Symp., Apr. 2003, pp. 110-117.
20. Y. Shi and R. Eberhart, "A modined particle swarm optimizer," in Proc. IEEE World Congr. Comput. Intell., May 1998, pp. 69-73.
21. J. Kennedy and R. Mendes, "Population structure and particle swarm performance" in Proc. IEEE World Congr. Evol. Comput. 2001 (CEC 2002), May 2002, pp. 1671-1676.
22. K. E. Parsopoulos and M. N. Vrahatis, "UPSO - A unitied particle swarm optimization secheme," Lecturee Series on Computational Sciences, pp. 868-873, 2004.
23. F. V. D. Bergh and A. P. Engelbrecht, "A cooperative approach to particle swarm optimization," IEEE Trans. Evol. Comput., vol. 8, pp. 225-239, Jun. 2004.
24. Y, Ong, A. Keane, and P. Nair, "Surrogate-assisted coenvolutionary search," in Proc. 9th Int. Conf. Neural Inf. Process., Nov. 2002, pp. 1140-1145.
25. T. Peram, K. Veeramachaneni, and C. K. Mohan, "Fitness-distance-ratio based particle swarm optimization," in Proc. Swarm Intell. Symp., 2003, pp. 174-181.
26. M. El-Abd and M. S. Kamel, "A hierarchal cooperative particle swarm optimizer," in Proc. Swarm Intell. Symp., 2007. pp. 43-47.
27. J. J. Liang, A. K. Qin, P. N. Suganthan, and S. Baskar, "Comprehensive learning particle swarm optimizer for global optimization of mutimodal functions." IEEE Trans. Evol. Comput., vol. 10. pp. 281-296, Jun. 2007.
28. J. Riget and J. S. Vesterstrom, A Diversity-guided Particle Swarm Optimizer - The ARPSO EVALife, Tech. Rep. 2002-02.
29. C. L. Lin, S. T. Hsieh, T. Y. Sun, and C. C. Liu, "PSO-based learning rate adjustment for blind source separation," in Proc. Int. Symp. Intell. Signal Process. Commun. Syst., Dec. 2005, pp. 181-184.
30. S. Amari and A. Cichocki, "Adaptive blind signal processing: Neural network approaches," Proc. IEEE, vol. 886, no. 10, pp. 2026-2048, 2040-2041, Oct. 1998.
31. H. H. Yang, S. Amari, and A. Cichocki, "Information-theoretic approach to blind separation of sources in nonlinear mixture," Signal Process., vol. 64, pp. 291-300, 1998.
32. S. Baskar and P. N. Suganthan, "A novel concurrent particle swarm optimization," in Proc. IEEE Congr. Evol. Comput., 2004, vol. 1, pp. 792-796.