Correntropy: Properties and applications in non-Gaussian signal processing

IEEE Transactions on Signal Processing

Volumn 55, Issue 11, 2007, Pages 5286-5298

  Liu, Weifeng ^a   Pokharel, Puskal P ^a   Principe, Jose C ^a  

^a University of Florida   (United States)

Author keywords

Generalized correlation function; Information theoretic learning; Kernel methods; Metric; Temporal principal component analysis (TPCA)

Indexed keywords

COMPUTATIONAL GEOMETRY; IMPULSE NOISE; PRINCIPAL COMPONENT ANALYSIS; PROBABILITY; STATISTICS;

CORRENTROPY FUNCTION; GENERALIZED CORRELATION FUNCTION; INFORMATION THEORETIC LEARNING; KERNEL METHODS; NON-GAUSSIAN SIGNAL PROCESSING;

SIGNAL PROCESSING;

EID: 36249029853     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2007.896065     Document Type: Article

References (25)

1. D. Erdogmus and J. C. Principe, "An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems," IEEE Trans. Signal Process., vol. 50, pp. 1780-1786, Jul. 2002.
2. E. Parzen, "On the estimation of a probability density function and the mode," Ann. Math. Stat., vol. 33, pp. 1065-1962.
3. J. C. Principe, D. Xu, and J. Fisher, "Information theoretic learning," in Unsupervised Adaptive Filtering, S. Haykin, Ed. New York: Wiley, 2000.
4. D. Erdogmus and J. C. Principe, "Generalized information potential criterion for adaptive system training," Trans. Neural Netw., vol. 13, no. 5, pp. 1035-1044, Sept. 2002.
5. D. Erdogmus, J. C. Principe, and K. E. Hild II, "Beyond second-order statistics for learning: A pair-wise interaction model for entropy estimation," Natural Comput., vol. 1, no. 1, pp. 85-108, May 2002.
6. K. E. Hild II, D. Erdogmus, K. Torkkola, and J. C. Principe, "Feature extraction using information-theoretic learning," Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1385-1392, Sep. 2006.
7. D. Erdogmus, R. Agrawal, and J. C. Principe, "A mutual information extension to the matched filter," Signal Process., vol. 85, no. 5, pp. 927-935, May 2005.
8. K.-H. Jeong, P. P. Pokharel, J.-W. Xu, S. Han, and J. C. Principe, "Kernel based synthetic discrimmant function for object recognition," in Int. Conf. Acoust., Speech, Signal Process., France, May 2006, pp. 765-768.
9. I. Santamaria, P. P. Pokharel, and J. C. Principe, "Generalized correlation function: Definition, properties and application to blind equalization," IEEE Trans. Signal Process., vol. 54, no. 6, pp. 2187-2197, Jun. 2006.
10. E. Parzen, "Statistical methods on time series by Hilbert space methods," Appl. Math. Statistics Lab., Stanford Univ., Tech. Rep. 23, 1959.
11. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
12. P. P. Pokharel, J. Xu, D. Erdogmus, and J. C. Principe, "A closed form solution for a nonlinear wiener Filter," presented at the Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2006.
13. A. Hyvärinen, "Fast and robust fixed-point algorithms for independent component analysis," IEEE Trans. Neural Netw., vol. 10, no. 3, pp. 626-634, 1999.
14. R. Jenssen, D. Erdogmus, J. C. Principe, and T. Eltoft, "Towards a unification of information theoretic learning and kernel methods," in Proc. 2004 IEEE Int. Work. Mach. Learn. Signal Process., Sao Luis, Brazil, Sep. 2004, pp. 443-451.
15. J. C. Principe, N. R. Euliano, and W. C. Lefebvre, Neural and Adaptive Systems: Fundamentals Through Simulations. New York: Wiley, 2000, pp. 371-375.
16. B. Scholkopf, A. J. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
17. W. DuMouchel and F. O'Brien, K. Berk and L. Malone, Eds., "Integrating a robust option into a multiple regression computing environment," in Computing Science and Statistics: Proc. 21st Symp. Interface, Alexandria, VA, 1989, pp. 297-301, Amer. Statist. Assoc..
18. W. Liu, P. P. Pokharel, and J. C. Principe, "Correntropy: A localized similarity measure," in Proc. Int. Joint Conf. Neural Networks (IJCNN), 2006, pp. 4919-4924.
19. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
20. P. Huber, Robust Statistics. New York: Wiley, 1981.
21. N. Aronszajn, "Theory of reproducing kernels," Trans. Amer. Math. Soc., vol. 68, pp. 337-404, 1950.
22. A. Gretton, R. Herbrich, A. Smola, O. Bousquet, and B. Schölkopf, "Kernel methods for measuring independence," J. Mach. Learning Res. 6, pp. 2075-2129, 2005.
23. B. W. Silverman, Density Estimation for Statistics and Data Analysis London, U.K.: Chapman and Hall, 1986.
24. D. Erdogmus and J. Principe, "From linear adaptive filtering to non-linear information processing," IEEE Signal Process. Mag., Nov. 2006.
25. K. H. Jeong and J. C. Principe, "The correntropy MACE filter for image recognition," in Proc. IEEE Int. Work. Mach. Learning for Signal Process., Ireland, 2006, pp. 9-14.