Stochastic information gradient algorithm with generalized gaussian distribution model

Journal of Circuits, Systems and Computers

Volumn 21, Issue 1, 2012, Pages

  Chen, Badong ^a   Principe, Jose C ^a   Hu, Jinchun ^b   Zhu, Yu ^b  

^a J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

generalized Gaussian density (GGD); least mean p power (LMP); Minimum error entropy criterion (MEE); stochastic information gradient (SIG) algorithm

Indexed keywords

AUTOMATIC SWITCHING; DENSITY ESTIMATION; DISPERSION PARAMETERS; ERROR DISTRIBUTIONS; GENERALIZED GAUSSIAN DENSITY; GENERALIZED GAUSSIAN DISTRIBUTIONS; GRADIENT ALGORITHM; IN-LINE; LEAST MEAN P-POWER (LMP); MINIMUM ERROR ENTROPY CRITERIONS; PARAMETERIZED; STOCHASTIC INFORMATION; VARIABLE STEP SIZE;

STOCHASTIC SYSTEMS;

ADAPTIVE ALGORITHMS;

EID: 84863272885     PISSN: 02181266     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218126612500065     Document Type: Article

References (24)

1. S. Haykin, Adaptive Filtering Theory, 3rd edn. (Prentice Hall, NY, 1996).
2. B. Widrow and S. D. Stearns, Adaptive Signal Processing (Prentice Hall, Englewood Cliffs, NJ, 1985).
3. E. Walach and B. Widrow, The least mean fourth (LMF) adaptive algorithm and its family, IEEE Trans. Inform. Theory 30 (1984) 275-283. (Pubitemid 14564534)
4. S. C. Douglas and H. Y. Meng, Stochastic gradient adaptation under general error criteria, IEEE Trans. Signal Process. 42 (1994) 1335-1351.
5. S. C. Pei and C. C. Tseng, Least mean p-power error criterion for adaptive FIR filter, IEEE J. Select. Areas Commun. 12 (1994) 1540-1547.
6. Y. Xiao, Y. Tadokoro and K. Shida, Adaptive algorithm based on least mean p-power error criterion for Fourier analysis in additive noise, IEEE Trans. Signal Process. 47 (1999) 1172-1181.
7. V. J. Mathews and S. H. Cho, Improved convergence analysis of stochastic gradient adaptive filter using the sign algorithm, IEEE, Trans. Acoust. Speech, Signal Process. 35 (1987) 450-454. (Pubitemid 17566058)
8. D. Erdogmus and J. C. Principe, Generalized information potential criterion for adaptive system training, IEEE Trans. Neural Ntw 13 (2002) 1035-1044.
9. D. Erdogmus, E. H. Kenneth and J. C. Principe, Online entropy manipulation: Stochastic information gradient, IEEE Signal Process. Lett. 10 (2003) 242-245.
10. D. Erdogmus and J. C. Principe, Convergence properties and data efficiency of the minimum error entropy criterion in Adaline training, IEEE Trans. Signal Process. 51 (2003) 1966-1978.
11. T. M. Cover and J. A. Thomas, Element of Information Theory (Wiley & Son, Inc., Chichester, 1991).
12. D. Erdogmus and J. C. Principe, Comparison of entropy and mean square error criteria in adaptive system training using higher order statistics, Second Int. Workshop on Independent Component Analysis and Blind Signal Separation (2000), pp. 75-80.
13. B. W. Silverman, Density Estimation for Statistic and Data Analysis (Chapman & Hall, NY, 1986).
14. M. K. Varanasi and B. Aazhang, Parametric generalized Gaussian density estimation, J. Acoust. Soc. Amer. 86 (1989) 1404-1415.
15. R. L. Joshi and T. R. Fisher, Comparison of generalized Gaussian and Laplacian modeling in DCT image coding, IEEE Signal Process. Lett. 2 (1995) 81-82.
16. F. Wang, H. Li and R. Li, Unified parametric and nonparametric ICA algorithms for hybrid source signals and stability analysis, Int. J. Innovative Comput. Inform. Control 4 (2008) 933-942.
17. K. Sharifi and A. Leon-Garcia, Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video, IEEE Trans. Circuits Syst. Video Technol. 5 (1995) 52-56.
18. K. Kokkinakis and A. K. Nandi, Exponent parameter estimation for generalized Gaussian probability density functions with application to speech modeling, Signal Process. 85 (2005) 1852-1858. (Pubitemid 40940845)
19. M. Abramowitz and I. A. Stegun, Handbook of Mathematical Functions (Dover, New York, 1970).
20. E. T. Jaynes, Information theory and statistical mechanics, Phys. Rev. 106 (1957) 620-630.
21. S. Mallat, A theory for multiresolution signal decomposition: The wavelet representation, IEEE Trans. Pattern Anal. Machine Intell. 11 (1989) 674-693.
22. S. Choi, A. Cichocki and S. Amari, Flexible independent component analysis, J. VLSI Signal Process. 26 (2000) 25-38.
23. B. Chen, J. Hu, L. Pu and Z. Sun, Stochastic gradient algorithm under (h; -)-entropy criterion, Circuits Syst. Signal Process. 26 (2007) 941-960.
24. A. Singh and J. C. Principe, Information theoretic learning with adaptive kernels, Signal Process. 91 (2011) 203-213.