From adaptive linear to information filtering

IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium, AS-SPCC 2000

Volumn , Issue , 2000, Pages 99-104

  Principe, J C ^a   Erdogmus, D ^a  

^a University of Florida   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; ADAPTIVE FILTERS; ADAPTIVE SYSTEMS; ENTROPY; INFORMATION THEORY; MEAN SQUARE ERROR; SIGNAL PROCESSING;

ADAPTIVE NETWORKS; ADAPTIVE SIGNAL PROCESSING; CHAOTIC TIME SERIES PREDICTION; ENTROPY MAXIMIZATION; LINEAR FILTERING; LINEAR PROJECTIONS; MEAN SQUARE ERROR CRITERIONS; NONPARAMETRIC ENTROPY ESTIMATOR;

INFORMATION FILTERING;

EID: 14844350245     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASSPCC.2000.882454     Document Type: Conference Paper

References (16)

1. Haykin, S., Introduction to Adaptive Filters, MacMillan, NY, 1984.
2. Principe, J., Xu, D., Fisher, J., Information Theoretic Learning, in Unsupervised Adaptive Filtering, Simon Haykin Editor, 265-319, Wiley, 2000.
3. Shannon C. and W. Weaver, The mathematical theory of communications, U. Illinois Press, 1949.
4. Fisher, J.W., Nonlinear Extensions to the Minimum Average Correlation Energy Filter, Ph.D. Dissertation, University of Florida, 1997.
5. Parzen, E., "On Estimation of a Probability Density Function and Mode", in Time Series Analysis Papers, Holden-Day, Inc., CA, 1967.
6. Rumelhart, D.E., Chauvin, Y., Backpropogation: Theory, Architectures, and Applications, Lawrence Erlbaum Associates, NJ, 1995.
7. Renyi, A., A Diary on Information Theory, Wiley, NY, 1987.
8. Kaplan, D., Glass, L., Understanding Nonlinear Dynamics, Springer-Verlag, NY, 1995.
9. Luenberger, D.G., Linear and Nonlinear Programming, Addison-Wesley Pub. Co., MA, 1973.
10. Cardoso J., "Infomax and maximum likelihood for blind source separation", IEEE Signal Proc. Letters, vol 4, 112-114, 1997.
11. Cover T. and J. Thomas, Elements of Information Theory, New York, Wiley, 1991.
12. Erdogmus D., and J. Principe, "Comparison of entropy and mean square error criteria in adaptive system training" accepted in ICA 2000, Helsinki, Finland.
13. Bell T., T. Sejnowski, An information maximization approach to blind source separation and blind deconvolution", Neural Computation, vol 6, 1129-1159, 1995.
14. Fisher J., and J. Principe, "Blind source separation by local interaction of output signals", 1998 IEEE DSP Workshop, Bryce Canyon, UT, 1998.
15. Xu D., J. Principe, J. Fisher H-C Wu, "A novel measure for independent component analysis", in Proc ICASSP'98, vol II, 1161-1164, 1998.
16. Principe, J., D. Xu, Q. Zhao, J Fisher, "Learning from examples with information theoretic criteria", VLSI Signal Processing Systems, Special issue on neural networks, 2000 (in press).