Generalized Correntropy for Robust newline ?Adaptive Filtering

IEEE Transactions on Signal Processing

Volumn 64, Issue 13, 2016, Pages 3376-3387

  Chen, Badong ^a   Xing, Lei ^a   Zhao, Haiquan ^a   Zheng, Nanning ^b   Principe, Jose C ^a,c  

^a XI'AN JIAOTONG UNIVERSITY   (China)

^b SOUTHWEST JIAOTONG UNIVERSITY   (China)

^c J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

Author keywords

adaptive filtering; Correntropy; generalized correntropy; GMCC algorithm

Indexed keywords

ADAPTIVE ALGORITHMS; ADAPTIVE FILTERING; ALGORITHMS; ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; SIGNAL PROCESSING;

CORRENTROPY; GAUSSIAN KERNELS; GENERALIZED GAUSSIAN DENSITY; KERNEL FUNCTION; ROBUST REGRESSIONS; SIMILARITY MEASURE; STABILITY PROBLEM; STEADY STATE PERFORMANCE;

ADAPTIVE FILTERS;

EID: 84973561208     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2016.2539127     Document Type: Article

References (35)

1. S. Haykin, Adaptive Filter Theory, 3rd ed. Englewood Cliffs, NJ, USA: Prentice-Hall, 1996.
2. Sayed and H. Ali, "Fundamentals of adaptive filtering, " IEEE Control Syst., vol. 25, no. 4, pp. 77-79, 2003.
3. B. Chen, Y. Zhu, J. Hu, and J. C. Principe, System Parameter Identification: Information Criteria and Algorithms. New York, NY, USA: Newnes, 2013.
4. E. Walach and B. Widrow, "The least mean fourth (LMF) adaptive algorithm and its family, " IEEE Trans. Inf. Theory, vol. 30, no. 2, pp. 275-283, 1984.
5. S.-C. Pei and C.-C. Tseng, "Least mean p-power error criterion for adaptive fir filter, " IEEE J. Sel. Areas Commun., vol. 12, no. 9, pp. 1540-1547, 1994.
6. V. J. Mathews and S. H. Cho, "Improved convergence analysis of stochastic gradient adaptive filters using the sign algorithm, " IEEE Trans. Acoust., Speech, Signal Process., vol. 35, no. 4, pp. 450-454, 1987.
7. T. Shao, Y. R. Zheng, and J. Benesty, "An affine projection sign algorithm robust against impulsive interferences, " IEEE Signal Process. Lett., vol. 17, no. 4, pp. 327-330, 2010.
8. M. Shao and C. L. Nikias, "Signal processing with fractional lower order moments: Stable processes and their applications, " Proc. IEEE, vol. 81, no. 7, pp. 986-1010, 1993.
9. J. Chambers et al., "Least mean mixed-norm adaptive filtering, " Electron. Lett., vol. 30, no. 19, pp. 1574-1575, 1994.
10. J. Chambers and A. Avlonitis, "A robust mixed-norm adaptive filter algorithm, " IEEE Signal Process. Lett., vol. 4, no. 2, pp. 46-48, 1997.
11. Y. Zou, S.-C. Chan, and T.-S. Ng, "Least mean m-estimate algorithms for robust adaptive filtering in impulse noise, " IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 47, no. 12, pp. 1564-1569, 2000.
12. S.-C. Chan and Y.-X. Zou, "A recursive least m-estimate algorithm for robust adaptive filtering in impulsive noise: Fast algorithm and convergence performance analysis, " IEEE Trans. Signal Process., vol. 52, no. 4, pp. 975-991, 2004.
13. J. C. Principe, Information Theoretic Learning: Renyi's Entropy and Kernel Perspectives. New York, NY, USA: Springer Science & Business Media, 2010.
14. D. Erdogmus and J. C. Principe, "From linear adaptive filtering to nonlinear information processing-The design and analysis of information processing systems, " IEEE Signal Process. Mag., vol. 23, no. 6, pp. 14-33, 2006.
15. D. Erdogmus and J. C. Principe, "An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems, " IEEE Trans. Signal Process., vol. 50, no. 7, pp. 1780-1786, 2002.
16. B. Chen, J. Hu, L. Pu, and Z. Sun, "Stochastic gradient algorithm under (h, )-entropy criterion, " Circuits, Syst., Signal Process., vol. 26, no. 6, pp. 941-960, 2007.
17. B. Chen, Y. Zhu, and J. Hu, "Mean-square convergence analysis of Adaline training with minimum error entropy criterion, " IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1168-1179, 2010.
18. B. Chen, P. Zhu, and J. C. Príncipe, "Survival information potential: A new criterion for adaptive system training, " IEEE Transactions on Signal Processing, vol. 60, no. 3, pp. 1184-1194, 2012.
19. W. Liu, P. P. Pokharel, and J. Príncipe, "Correntropy: Properties and applications in non-Gaussian signal processing, " IEEE Trans. Signal Process., vol. 55, no. 11, pp. 5286-5298, 2007.
20. A. Singh and J. C. Principe, "Using correntropy as a cost function in linear adaptive filters, " in Proc. IEEE Int. Joint Conf. Neural Netw. (IJCNN), 2009, pp. 2950-2955.
21. S. Zhao, B. Chen, and J. C. Principe, "Kernel adaptive filtering with maximum correntropy criterion, " in Proc. IEEE Int. Joint Conf. Neural Netw. (IJCNN), 2011, pp. 2012-2017.
22. A. Singh and J. C. Principe, "A loss function for classification based on a robust similarity metric, " in Proc. IEEE Int. Joint Conf. Neural Netw. (IJCNN), 2010, pp. 1-6.
23. B. Chen, L. Xing, J. Liang, N. Zheng, and J. C. Principe, "Steady-state mean-square error analysis for adaptive filtering under the maximum correntropy criterion, " IEEE Signal Process. Lett., vol. 21, no. 7, pp. 880-884, 2014.
24. L. Shi and Y. Lin, "Convex combination of adaptive filters under the maximum correntropy criterion in impulsive interference, " IEEE Signal Process. Lett., vol. 21, no. 11, pp. 1385-1388, 2014.
25. S. Seth and J. Príncipe, "Compressed signal reconstruction using the correntropy induced metric, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2008, pp. 3845-3848.
26. M. K. Varanasi and B. Aazhang, "Parametric generalized Gaussian density estimation, " J. Acoust. Soc. Amer., vol. 86, no. 4, pp. 1404-1415, 1989.
27. B. Chen, J. C. Principe, J. Hu, and Y. Zhu, "Stochastic information gradient algorithm with generalized Gaussian distribution model, " J. Circuits, Syst., Comput., vol. 21, no. 01, p. 1250006, 2012.
28. B. Chen and J. C. Príncipe, "Maximum correntropy estimation is a smoothed map estimation, " IEEE Signal Process. Lett., vol. 19, no. 8, pp. 491-494, 2012.
29. V. N. Vapnik and V. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998, vol. 1.
30. M. N. Syed, J. C. Principe, and P. M. Pardalos, "Correntropy in data classification, " in Dynamics of Information Systems: Mathematical Foundations. New York, NY, USA: Springer, 2012, pp. 81-117.
31. M. N. Syed, P. M. Pardalos, and J. C. Principe, "On the optimization properties of the correntropic loss function in data analysis, " Optim. Lett., vol. 8, no. 3, pp. 823-839, 2014.
32. J. Weston, A. Elisseeff, B. Schölkopf, and M. Tipping, "Use of the zero norm with linear models and kernel methods, " J. Mach. Learn. Res., vol. 3, pp. 1439-1461, 2003.
33. T. Y. Al, "Adaptive filters with error nonlinearities: Mean-square analysis and optimum design, " EURASIP J. Adv. Signal Process., vol. 2001, no. 4, pp. 192-205, 2001.
34. V. H. Nascimento and J. C. M. Bermudez, "Probability of divergence for the least-mean fourth algorithm, " IEEE Trans. Signal Process., vol. 54, no. 4, pp. 1376-1385, 2006.
35. T. Y. Al-Naffouri and A. H. Sayed, "Transient analysis of adaptive filters with error nonlinearities, " IEEE Trans. Signal Process., vol. 51, no. 3, pp. 653-663, 2003.