Survival information potential: A new criterion for adaptive system training

IEEE Transactions on Signal Processing

Volumn 60, Issue 3, 2012, Pages 1184-1194

  Chen, Badong ^a   Zhu, Pingping ^a   Príncipe, José C ^a  

^a J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

Author keywords

Minimum error entropy (MEE); supervised training; survival information potential

Indexed keywords

ABSOLUTE VALUES; ERROR ENTROPY; INFORMATION POTENTIAL; INFORMATION THEORETIC CRITERION; RENYI ENTROPY; SIMULATION EXAMPLE; SURVIVAL FUNCTION; SURVIVAL INFORMATION; TIME DELAY NEURAL NETWORKS;

ADAPTIVE FILTERING; ADAPTIVE SYSTEMS; ENTROPY; INFORMATION THEORY;

INTERNET PROTOCOLS;

EID: 84863142780     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2011.2178406     Document Type: Article

References (22)

1. J. C. Principe, Information Theoretic Learning: Renyi's Entropy and Kernel Perspectives. New York: Springer, 2010.
2. J. C. Principe, D. Xu, Q. Zhao, and J. W. Fisher, "Learning from examples with information theoretic criteria," J. VLSI Signal Process. Syst., vol. 26, pp. 61-77, 2000.
3. D. Erdogmus and J. C. Principe, "From linear adaptive filtering to nonlinear information processing," IEEE Signal Process. Mag., vol. 23, no. 6, pp. 15-33, 2006.
4. D. Erdogmus and J. C. Principe, "An error entropy minimization algorithm for supervised training of nonlinear adaptive systems," IEEE Trans. Signal Process., vol. 50, no. 7, pp. 1780-1786, 2002. (Pubitemid 34882696)
5. D. Erdogmus and J. C. Principe, "Generalized information potential criterion for adaptive system training," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1035-1044, 2002.
6. I. Santamaria, D. Erdogmus, and J. C. Principe, "Entropy minimization for supervised digital communications channel equalization," IEEE Trans. Signal Process., vol. 50, no. 5, pp. 1184-1192, 2002. (Pubitemid 34515278)
7. B. Chen, J. Hu, L. Pu, and Z. Sun, "Stochastic gradient algorithm under (h, )-entropy criterion," Circuits Syst. Signal Process., vol. 26, pp. 941-960, 2007.
8. B. Chen, Y. Zhu, J. Hu, and J. C. Principe, "Entropy: Definition, properties and applications in system identification quantized data," Inf. Sci., vol. 181, pp. 1384-1402, 2011.
9. T. M. Cover and J. A. Thomas, Element of Information Theory. Chichester, U.K.: Wiley, 1991.
10. A. Renyi, "On measures of entropy and information," in Proc. 4rth Berkeley Symp. Math. Stat. Probab., 1961, vol. 1, pp. 547-561.
11. E. Parzen, "On estimation of a probability density function and mode," in Time Series Analysis Papers. San Francisco, CA: Holden-Day, 1967.
12. B. W. Silverman, Density Estimation for Statistic and Data Analysis. New York: Chapman & Hall, 1986.
13. M. Rao, Y. Chen, B. C. Vemuri, and F. Wang, "Cumulative residual entropy: A new measure of information," IEEE Trans. Inf. Theory, vol. 50, no. 6, pp. 1220-1228, 2004.
14. K. Zografos and S. Nadarajah, "Survival exponential entropies," IEEE Trans. Inf. Theory, vol. 51, no. 3, pp. 1239-1246, 2005. (Pubitemid 40377593)
15. B. L. S. P. Rao, Asymptotic Theory of Statistical Inference. New York: Wiley, 1987.
16. S. Min and L. N. Chrysostomos, "Signal processing with fractional lower order moments: Stable processes and their applications," Proc. IEEE, vol. 81, no. 7, pp. 986-1009, 1993.
17. G. A. Clark, S. K. Mitra, and S. R. Parker, "Block implementation of adaptive digital filters," IEEE Trans. Acoust., Speech, Signal Process., vol. 28, no. 6, pp. 744-752, 1981.
18. W. Liu, P. Pokharel, and J. Principe, "The kernel least mean square algorithm," IEEE Trans. Signal Process., vol. 56, no. 2, pp. 543-554, 2008. (Pubitemid 351285052)
19. W. Liu, J. Principe, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction. New York: Wiley, 2010.
20. D. Kaplan and L. Glass, Understanding Nonlinear Dynamics. New York: Springer-Verlag, 1995.
21. J. M. Kuo, "Nonlinear dynamic modeling with artificial neural networks," Ph.D. dissertation, Univ. of Florida, Gainesville, 1993.
22. D. G. Luenberger, Linear and Nonlinear Programming. Reading, MA: Addison-Wesley, 1973.