An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems

IEEE Transactions on Signal Processing

Volumn 50, Issue 7, 2002, Pages 1780-1786

  Erdogmus, Deniz ^a,b   Principe, Jose C ^a,b  

^a IEEE   (United States)

^b UNIVERSITY OF FLORIDA   (United States)

Author keywords

Minimum error entropy; Renyi's entropy

Indexed keywords

MINIMUM ERROR ENTROPY; RENYI ENTROPY; SUPERVISED LEARNING;

ADAPTIVE SYSTEMS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; NONLINEAR SYSTEMS; OPTIMIZATION; PROBABILITY DENSITY FUNCTION; PROBABILITY DISTRIBUTIONS;

LEARNING SYSTEMS;

EID: 0036647905     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2002.1011217     Document Type: Article

References (25)

1. Optimal state estimation for stochastic systems: An information theoretic approach
2. Source separation techniques applied to linear prediction
3. Comparison of entropy and mean square error criteria in adaptive system training using higher order statistics
4. Learning informative statistics: A nonparameteric approach
5. A mathematical theory of communications
6. Dynamic modeling with neural networks
7. On estimation of a probability density function and mode
8. Information theoretic learning
9. Some fundamental questions of information theory
10. Learning from examples with information theoretic criteria
11. Phoneme recognition using time delay neural networks
12. Learning internal representations by error backpropagation
13. Nonlinear dynamic modeling with artificial neural networks
14. Two sample test statistics for measuring discrepancies between two multivariate probability density functions using kernel-based density estimators
15. Detecting differences between delay vector distributions