Stochastic gradient identification of Wiener system with maximum mutual information criterion

IET Signal Processing

Volumn 5, Issue 6, 2011, Pages 589-597

  Chen, B ^a   Zhu, Y ^b   Hu, J ^b   Principe J C ^a  

^a University of Florida   (United States)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE IDENTIFICATION; FINITE IMPULSE RESPONSE FILTER; GRADIENT BASED ALGORITHM; IDENTIFICATION SCHEME; INFORMATION-THEORETIC APPROACH; LEAST MEAN SQUARE ALGORITHMS; MAXIMUM MUTUAL INFORMATION; MEAN SQUARE ERROR CRITERIONS; MONTE CARLO SIMULATION; MUTUAL INFORMATIONS; NON-LINEARITY; OPTIMUM SOLUTION; PERFORMANCE IMPROVEMENTS; STOCHASTIC GRADIENT; WIENER SYSTEMS;

ADAPTIVE SYSTEMS; COMMUNICATION CHANNELS (INFORMATION THEORY); IMPULSE RESPONSE; STEREOPHONIC BROADCASTING; STOCHASTIC SYSTEMS;

ALGORITHMS;

EID: 80052799930     PISSN: 17519675     EISSN: 17519683     Source Type: Journal    
DOI: 10.1049/iet-spr.2010.0171     Document Type: Article

References (21)

1. Haykin, S.: 'Adaptive filtering theory', 3rd(Prentice-Hall 1996)
2. Sayed, A.H.: 'Fundamentals of adaptive filtering', (Wiley, NJ 2003)
3. Walach, E., and Widrow, B.: 'The least mean fourth (LMF) adaptive algorithm and its family', IEEE Trans. Inf. Theory, 1984, IT-30, (2), p. 275-28310.1109/TIT.1984.1056886 0018-9448
4. Pei, S.C., and Tseng, C.C.: 'Least mean p-power error criterion for adaptive FIR filter', IEEE J. Sel. Areas Commun., 1994, 12, (9), p. 1540-154710.1109/49.339922 0733-8716
5. Chambers, J.A., Tanrikulu, O., and Constantinides, A.G.: 'Least mean mixed-norm adaptive filtering', Electron. Lett., 1994, 30, (19), p. 1574-157510.1049/el:19941060 0013-5194
6. Erdogmus, D., Kenneth, E.H., and Principe, J.C.: 'Online entropy manipulation: stochastic information gradient', IEEE Signal Process. Lett., 2003, 10, p. 242-24510.1109/LSP.2003.814400 1070-9908
7. Erdogmus, D., and Principe, J.C.: 'Generalized information potential criterion for adaptive system training', IEEE Trans. Neural Netw., 2002, 13, p. 1035-104410.1109/TNN.2002.1031936 1045-9227
8. Erdogmus, D., and Principe, J.C.: 'From linear adaptive filtering to nonlinear information processing', IEEE Signal Process. Mag., 2006, 23, (6), p. 15-3310.1109/SP-M.2006.248709 1053-5888
9. Han, S., Rao, S., and Erdogmus, D.: et al. 'A minimum-error entropy criterion with self-adjusting step-size (MEE-SAS)', Signal Process., 2007, 87, p. 2733-274510.1016/j.sigpro.2007.05.003 0165-1684
10. Ozertem, U., Uysal, I., and Erdogmus, D.: 'Continuously differentiable sample-spacing entropy estimation', IEEE Trans. Neural Netw., 2008, 19, p. 1978-198410.1109/TNN.2008.2006167 1045-9227
11. Chen, B., Hu, J., Pu, L., and Sun, Z.: 'Stochastic gradient algorithm under (h, )-entropy criterion', Circuits Syst. Signal Process., 2007, 26, p. 941-96010.1007/s00034-007-9004-9 0278-081X
12. Chen, B., Hu, J., Li, H., and Sun, Z.: 'Adaptive filtering under maximum mutual information criterion', Neurocomputing, 2008, 71, p. 3680-368410.1016/j.neucom.2008.02.003 0925-2312
13. Chen, B., Zhu, Y., Hu, J., and Sun, Z.: 'Adaptive filtering under minimum information divergence criterion', Int. J. Control Autom. Syst., 2009, 7, (2), p. 1-810.1007/s12555-009-0201-0 1598-6446
14. Cover, T.M., and Thomas, J.A.: 'Element of information theory', (Wiley, Chichester 1991)
15. Kapur, J.N., and Kesavan, H.K.: 'Entropy optimization principles with applications', (Academic Press 1992)
16. Schetzen, M.: 'The Volterra and Wiener theories of nonlinear systems', (Krieger, Malabar, FL 1980)
17. Hunter, I.W., and Korenberg, M.J.: 'The identification of nonlinear biological systems: Wiener and Hammerstein cascade models', Biol. Cybern., 1986, 55, p. 135-1440340-1200
18. Greblicki, W.: 'Nonparametric approach to Wiener system identification', IEEE Trans. Circuits Syst. 1, Fundam. Theory Appl., 1997, 44, p. 538-54510.1109/81.586027 1057-7122
19. Bershad, N.J., Celka, P., and Vesin, J.M.: 'Stochastic analysis of gradient adaptive identification of nonlinear systems with memory for Gaussian data and noisy input and output measurements', IEEE Trans. Signal Process., 1999, 47, p. 675-68910.1109/78.747775 1053-587X
20. Celka, P., Bershad, N.J., and Vesin, J.M.: 'Stochastic gradient identification of polynomial Wiener systems: analysis and application', IEEE Trans. Signal Process., 2001, 49, p. 301-31310.1109/78.902112 1053-587X
21. Silverman, B.W.: 'Density estimation for statistic and data analysis', (Chapman & Hall, NY 1986)