A minimum-error entropy criterion with self-adjusting step-size (MEE-SAS)

Signal Processing

Volumn 87, Issue 11, 2007, Pages 2733-2745

  Han, Seungju ^a   Rao, Sudhir ^a   Erdogmus, Deniz ^b   Jeong, Kyu Hwa ^a   Principe, Jose ^a  

^a UNIVERSITY OF FLORIDA   (United States)

^b OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

MEE SAS; Minimum error entropy (MEE); Renyi's entropy; Supervised training

Indexed keywords

MEE-SAS; MINIMUM-ERROR ENTROPY (MEE); RENYI'S ENTROPY; SUPERVISED TRAINING;

ADAPTIVE SYSTEMS; ALGORITHMS; COMPUTER SIMULATION; ERROR ANALYSIS; IDENTIFICATION (CONTROL SYSTEMS); OPTIMAL SYSTEMS; SIGNAL ANALYSIS;

SELF ADJUSTING CONTROL SYSTEMS;

EID: 34447268451     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2007.05.003     Document Type: Article

References (25)

1. Kalouptsidis N., and Theodoridis S. Adaptive System Identification and Signal Processing Algorithms (1993), Prentice-Hall, Englewood Cliffs, NJ
2. Zerguine A., Cowan C.F.N., and Bettayeb M. Adaptive echo cancellation using least mean mixed-norm algorithm. IEEE Trans. Signal Process. 45 5 (May 1997) 1340-1343
3. Cowan C.F.N. Channel equalization. In: Kalouptsidis N., and Theodorids S. (Eds). Adaptive System Identification and Signal Processing Algorithms (1993), Prentice-Hall, Englewood Cliffs, NJ 388-406
4. Widrow B., and Stearns S.D. Adaptive Signal Processing (1985), Prentice-Hall, Englewood Cliff, NJ
5. Haykin S. Adaptive Filter Theory. fourth ed (2001), Prentice-Hall, Upper Saddle River
6. Walach E., and Widrow B. The least mean fourth (LMF) adaptive algorithm and its family. IEEE Trans. Inform. Theory 30 2 (March 1984) 275-283
7. Chambers J.A., Tanrikulu O., and Constantinides A.G. Least mean mixed-norm adaptive filtering. IEE Electron. Lett. 30 19 (September 1994) 1574-1575
8. Tanrikulu O., and Chambers J.A. Convergence and steady-state properties of the least-mean mixed norm (LMMN) adaptive algorithm. IEEE Proc. Vision, Image, Signal Process. 143 (June 1996) 137-142
9. C.F.N. Cowan, C. Rusu, Adaptive echo cancellation using cost function adaptation, in: Conference Digest of Fourth IMA International Conference on Mathematics in Signal Processing, Warwick, UK, December 1996.
10. Principe J.C., Xu D., and Fisher J. Information theoretic learning. In: Haykin S. (Ed). Unsupervised Adaptive Filtering vol. I (2000), Wiley, New York 265-319
11. Shannon C.E. A mathematical theory of communications. Bell Syst. Tech. J. 27 (1948) 379-423
12. A. Renyi, Some Fundamental Questions of Information Theory, Selected Papers of Alfred Renyi, 2, Akademia Kiado, Budapest, 1976, pp. 526-552.
13. Erdogmus D., and Principe J.C. Generalized information potential criterion for adaptive system training. IEEE Trans. Neural Networks 13 5 (September 2002) 1035-1044
14. Erdogmus D., and Principe J.C. An error entropy minimization algorithm for supervised training of nonlinear adaptive systems. IEEE Trans. Signal Process. 50 7 (July 2002) 1780-1786
15. Morejon R.A., and Principe J.C. Advanced search algorithms for information-theoretic learning with kernel-based estimators. IEEE Trans. Neural Networks 15 4 (July 2004) 874-884
16. Erdogmus D., Principe J.C., and Hild II K.E. Online entropy manipulation: stochastic information gradient. IEEE Signal Process. Lett. 10 8 (August 2003) 242-245
17. Kwong R.H., and Johnston E.W. A variable step size LMS algorithm. IEEE Trans. Signal Process. 40 7 (1992) 1633-1642
18. Aboulnasr T., and Mayyas K. A robust variable step-size LMS-type algorithm: analysis and simulations. IEEE Trans. Signal Process. 45 3 (1997) 631-639
19. Pazaitis D.I., and Constantinides A.G. A novel kurtosis driven variable step-size adaptive algorithm. IEEE Trans. Signal Process. 47 3 (1997) 864-872
20. H-C. Shin, A.H. Sayed, W-J. Song, Variable step-size NLMS and affine projection algorithms, IEEE Signal Process. Lett. (2004).
21. Erdogmus D., and Principe J.C. Convergence properties and data efficiency of the minimum error entropy criterion in adaline training. IEEE Trans. Signal Process. 51 7 (July 2003) 1966-1978
22. S. Han, S. Rao, D. Erdogmus, J.C. Principe, An Improved Minimum Error Entropy Criterion with Self-Adjusting Step-Size, IEEE International Workshop on Machine Learning for Signal Processing (MLSP'05), Mystic, Connecticut, September 2005, pp. 317-322.
23. Khalil H. Nonlinear Systems (1992), Macmillan, New York
24. Principe J.C., Euliano N., and Lefebvre C. Neural and Adaptive Systems: Fundamentals Through Simulations (1999), Wiley, New York
25. Silverman B.W. Density Estimation for Statistics and Data Analysis (1986), Chapman and Hall, London