Convergence analysis of the information potential criterion in adaline training

Neural Networks for Signal Processing - Proceedings of the IEEE Workshop

Volumn , Issue , 2001, Pages 123-132

  Erdogmus, Deniz ^a   Principe, Jose C ^a  

^a University of Florida   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; ALGORITHMS; APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; ENTROPY; PROBABILITY DENSITY FUNCTION; TIME SERIES ANALYSIS; TOPOLOGY;

MEAN SQUARE ERRORS (MSE);

ADAPTIVE FILTERING;

EID: 0035783526     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Wiener N., Extrapolation Interpolation, and Smoothing of Stationary Time Series with Engineering Applications, Cambridge, MA: MIT Press, 1949.
2. rd ed., NJ: Prentice Hall, Inc., 1996.
3. Farhang-Boroujeny, B., Adaptive Filters: Theory and Applications, NY: John Wiley & Son Ltd., 1998.
4. Widrow, B., S.D. Stearns, Adaptive Signal Processing, NJ: Prentice Hall, 1985.
5. D. Erdogmus, J.C. Principe, "Comparison Of Entropy And Mean Square Error Criteria In Adaptive System Training Using Higher Order Statistics", Proceedings of 2nd International Workshop on Independent Component Analysis (ICA 2000), Helsinki, Finland, June 2000.
6. D. Erdogrnus, J.C. Principe, "An Entropy Minimization Algorithm For Short-Term Prediction of Chaotic Time Series," submitted to IEEE Transactions on Signal Processing, Sept. 2000.
7. D. Erdogmus, J.C. Principe, "Generalized Information Potential Criterion for Adaptive System Training," submitted to IEEE Transactions on Neural Networks, Feb. 2001.
8. J.C. Principe, D. Xu, J. Fisher, "Information Theoretic Learning," in Unsupervised Adaptive Filtering, vol I, Simon Haykin Editor, NY: Wiley, 2000, pp 265-319.
9. S. Amari, Differential-Geometrical Methods in Statistics, Berlin: Springer-Verlag, 1985.
10. A. Renyi, Probability Theory, NY: American Elsevier Publishing Company Inc., 1970.
11. E. Parzen, "On Estimation of a Probability Density Function and Mode", in Time Series Analysis Papers, CA: Holden-Day, Inc., 1967.
12. R.Y. Rubinstein, Simulation and the Monte Carlo Method, NY: John Wiley & Sons, 1981.