Minimum entropy estimation as a near maximum-likelihood method and its application in system identification with non-Gaussian noise

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2, Issue , 2004, Pages

  Ta, Minh ^a   DeBrunner, Victor ^a  

^a University of Oklahoma   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; ENTROPY; FUNCTIONS; INFORMATION THEORY; INTEGRATION; LEAST SQUARES APPROXIMATIONS; REGRESSION ANALYSIS; SPURIOUS SIGNAL NOISE; VECTORS;

EXPECTATION-MAXIMIZATION (EM); KULLBACK-LEIBLER (K-L) DISTANCE; MAXIMUM LIKELIHOOD (ML) ESTIMATORS; MINIMUM ENTROPY ESTIMATION (MEE);

IDENTIFICATION (CONTROL SYSTEMS);

EID: 4644342521     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum Likelihood from incomplete data via the EM algorithm (with discussion)", Journal of the Royal Statistical Society B, 39, 1-38, 1977.
2. L. Pronzato and E. Thierry. "Entropy minimization for parameter estimation problems with unknown distribution of the output noise," Proc. ICASSP'2001, 6-11 May 2001, Salt Lake City (USA).
3. Paul Viola, Nicol N. Schraudolph, Terrence J. Sejnowski, "Empirical Entropy Manipulation for Real-World Problems", Advances in Neural Information Processing Systems 8, MIT Press, 1996.
4. H. Y. Kim, J. H. Kim, "Minimum Entropy Estimation of Hierarchical Random Graph Parameters for Character Recognition," Proceedings of 15th International Conference on Pattern Recognition, Vol. 2, 2000.
5. nd Symposium on Information Theory, pp. 267-281, 1973.
6. E. Parzen, "On estimation of a probability density function and mode," Annals of Math. Stat., vol. 35, pp. 1065-1076, 1962.
7. P. P. B. Eggermont and V. N. LaRiccia, Maximum Penalized Likelihood Estimation, Springer, New York, 2001.
8. I. A. Ahmad and P. E. Lin, "A Nonparametric Estimation of the Entropy for Absolutely Continuous Distributions," IEEE Trans, on Information Theory, May 1976.
9. J. Beirland, E. J. Dudewicz, L. Gyorfi, and E. C. Van der Meulen, "Nonparametric Entropy Estimation: An Overview," International J. Mathematical and Statistical Sciences, vol. 6, pp. 17-39, 1997.
10. L. Pronzato and E. Thierry, "A minimum- entropy estimator for regression problems with unknown distribution of observation errors," Tech. Rep. 00-08, Laboratoire I3S, CNRS- Universite de Nice-Sophia Antipolis, 06903 Sophia Antipolis, France 2000, http://www.i3s.unice.fr/~pronzato/.