Flexible adaptive filtering by minimization of error entropy bound and its application to system identification

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2010, Pages 1886-1889

  Li, Xi Lin ^a   Adali, Tülay ^a  

^a UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

Author keywords

Adaptive filtering; Identification; Minimum error entropy; Supervised training

Indexed keywords

ADAPTIVE FILTERS; COST FUNCTIONS; ENTROPY; ERRORS; GAUSSIAN NOISE (ELECTRONIC); RELIGIOUS BUILDINGS;

COST-FUNCTION; ENTROPY BOUND; ERROR-ENTROPY; IDENTIFICATION; ITS APPLICATIONS; MINIMISATION; MINIMUM ERROR ENTROPY; PERFORMANCE GAIN; SUPERVISED TRAININGS; SYSTEM-IDENTIFICATION;

ADAPTIVE FILTERING;

EID: 78049361677     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2010.5495347     Document Type: Conference Paper

References (9)

1. S. Haykin, Adaptive Filter Theory, Prentice Hall, 2002.
2. J.C. Principe, D. Xu and J.W. Fisher, "Information Theoretic Learning," in Unsupervised Adaptive Filtering, S. Haykin, Ed. New York: Wiley, 2000, pp. 265-319.
3. D. Erdogmus and J.C. Principe, "An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems," IEEE Trans. Signal Process., vol. 50, no. 7, pp. 1780-1786, July, 2002.
4. D. Erdogmus and J.C. Principe, "Generalized information potential criterion for adaptive system training," IEEE Trans. Neural Networks, vol. 13, no. 5, pp. 1035-1044, Sept. 2002.
5. D. Erdogmus, J.C. Principe, and K. Hild II, "On-line entropy manipulation: stochastic information gradient," IEEE Signal Process. Letters, vol. 10, no. 8, pp. 242-245, Aug. 2003.
6. X.-L. Li and T. Adali, "A novel entropy estimator and its application to ICA," in Proc. IEEE Workshop on Machine Learning for Signal Processing, Grenoble, France, Sep. 2009.
7. J. Beirlant, E. Dudewicz, L. Gyorfi, and E. van der Meulen, "Nonparametric entropy estimation: an overview," International Journal of the Mathematical Statistics Sciences, vol. 6, pp. 17-39, 1997.
8. B.W. Silverman, Density Estimation for Statistics and Data Analysis. London: Chapman and Hall, 1986.
9. E.T. Jaynes, "Information theory and statistical mechanics," Physical Review, vol. 106, pp. 620-630, 1957.