A class of adaptive algorithms based on entropy estimation achieving CRLB for linear non-Gaussian filtering

IEEE Transactions on Signal Processing

Volumn 60, Issue 4, 2012, Pages 2049-2055

  Li, Hualiang ^a   Li, Xi Lin ^a   Anderson, Matthew ^a   Adali, Tülay ^a  

^a Baltimore County   (United States)

Author keywords

Adaptive signal processing; Cram r Rao bounds; entropy estimation; non Gaussian noise

Indexed keywords

ADAPTIVE SIGNAL PROCESSING; ENTROPY BOUND; ENTROPY ESTIMATION; GAUSSIANS; GENERALIZED GAUSSIAN DISTRIBUTION; LOWER BOUNDS; NOISE DISTRIBUTION; NOISE MODELS; NON-GAUSSIAN; NON-GAUSSIAN DISTRIBUTION; NON-GAUSSIAN NOISE; ONLINE LEARNING; PARAMETRIC MODELS; PERFORMANCE GAIN; SAMPLE SIZES; STABLE DISTRIBUTIONS;

ADAPTIVE ALGORITHMS; ENTROPY; ESTIMATION; GAUSSIAN DISTRIBUTION; SIGNAL PROCESSING;

GAUSSIAN NOISE (ELECTRONIC);

EID: 84863338779     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2011.2182345     Document Type: Article

References (15)

1. M. Shao and C. L. Nikias, "Signal processing with fractional lower order moments: Stable processes and their applications," Proc. IEEE, vol. 81, pp. 986-1010, 1993.
2. S. Haykin, Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice- Hall, 2001.
3. K. N. Plataniotis, D. Androutsos, and A. N. Venetsanopoulos, "Nonlinear filtering of non-Gaussian noise," J. Intell. Robot. Syst., vol. 19, pp. 207-231, 1997.
4. B. Weng and K. E. Barner, "Nonlinear system identification in impulsive environments," IEEE Trans. Signal Process., vol. 53, no. 7, pp. 2588-2594, Jul. 2005.
5. J. C. Principe, D. Xu, and J. W. Fisher, "Information theoretic learning," in Unsupervised Adaptive Filtering, S. Haykin, Ed. New York: Wiley, 2000, pp. 265-319.
6. X.-L. Li and T. Adali, "Flexible adaptive filtering by minimization of error entropy bound and its application to system identification," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Dallas, TX, 2010, pp. 1886-1889.
7. X.-L. Li and T. Adali, "Independent component analysis by entropy bound minimization," IEEE Trans. Signal Process., vol. 58, no. 10, pp. 5151-5164, Oct. 2010.
8. R. Prasad, H. Saruwatari, and K. Shikano, "Estimation of shape parameter of GGD function by negentropy matching," Neural Process. Lett., vol. 22, pp. 377-389, 2005.
9. K. Song, "A globally convergent and consistent method for estimating the shape parameter of a generalized Gaussian distribution," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 510-527, 2006.
10. X. Ma and C. L. Nikias, "Parameter estimation and blind channel identification in impulsive signal environments," IEEE Trans. Signal Process., vol. 43, no. 12, pp. 2884-2895, 1995.
11. R. Weron, "STABLERND: Matlab function to generate random numbers from the stable distribution," Econom. Dept., Boston College, Boston, MA, 2010 [Online]. Available: http://ideas.repec.org/c/boc/ bocode/m429003.html
12. V. G. Chavali and C. R. Silva, "Maximum-likelihood classification of digital amplitude-phase modulated signals in flat fading non-Gaussian channels," IEEE Trans. Commun., vol. 59, no. 8, pp. 2051-2056, 2011.
13. Y. Fu, G. A. Williamson, and P. M. Clarkson, "Adaptive algorithms for non-Gaussian noise environments: The order statistic least mean square algorithms," IEEE Trans. Signal Process., vol. 42, no. 11, pp. 2945-2954, 1994.
14. S. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Englewood Cliffs, NJ: Prentice-Hall, 1993.
15. K. Kokkinakis and A. K. Nandi, "Exponent parameter estimation for generalized Gaussian probability density functions with application to speech modeling," Signal Process., vol. 85, pp. 1852-1858, 2005.