Adaptive blind deconvolution of linear channels using Renyi's entropy with Parzen window estimation

IEEE Transactions on Signal Processing

Volumn 52, Issue 6, 2004, Pages 1489-1498

  Erdogmus, Deniz ^a   Hild, Kenneth E ^a   Principe, Jose C ^a   Lazaro, Marcelino ^b   Santamaria, Ignacio ^c  

^a UNIVERSITY OF FLORIDA   (United States)

^b UNIVERSIDAD CARLOS III DE MADRID   (Spain)

^c UNIVERSITY OF CANTABRIA   (Spain)

Author keywords

Blind deconvolution; Parzen windowing; Renyi's entropy

Indexed keywords

ALGORITHMS; COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTER SIMULATION; CONVOLUTION; MONTE CARLO METHODS; PARAMETER ESTIMATION;

ADAPTIVE BLIND DECONVOLUTION; LINEAR CHANNEL; PARZEN WINDOW ESTIMATION; RENYI ENTROPY;

BLIND SOURCE SEPARATION;

EID: 2942592838     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2004.827202     Document Type: Article

References (45)

1. E. Oja, Subspace Methods of Pattern Recognition. New York: Wiley, 1983.
2. C. Jutten and J. Herault, "Blind separation of sources, Part I: An adaptive algorithm based on neuromimetic architecture," Signal Process., vol. 24, no. 1, pp. 1-10, 1991.
3. A. Hyvarinen, J. Karhune, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
4. R. A. Wiggins, "Minimum entropy deconvolution," Geoexploration, vol. 16, pp. 21-35, 1978.
5. A. Benveniste, M. Goursat, and G. Ruget, "Robust identification of a nonminimum phase system: Blind adjustment of a linear equalizer in data communication," IEEE Trans. Automat. Contr., vol. 25, pp. 385-199, 1980.
6. D. Donoho, "On minimum entropy deconvolution," in Applied Time Series Analysis II. New York: Academic, 1981, pp. 565-609.
7. J. J. Bussgang, "Crosscorrelation Functions of Amplitude-Distorted Gaussian Signals," Mass. Inst. Technol. Res. Lab. Electron., Cambridge, MA, Tech. Rep. 216, 1952.
8. S. Haykin, Ed., Blind Deconvolution. Englewood Cliffs, NJ: Prentice-Hall, 1994.
9. I. Sabala, A. Cichocki, and S.-I. Amari, "Relationships between instantaneous blind source separation and multichannel blind deconvolution," in Proc. IEEE Int. Joint Conf. Neural Networks, 1998, pp. 39-44.
10. J. K. Tugnait, "On blind separation of convolutive mixtures of independent linear signals in unknown additive noise," IEEE Trans. Signal Processing, vol. 46, pp. 3117-3123, Nov. 1998.
11. Y. Inouye and K. Hirano, "Cumulant-based blind identification of linear multi-input-multi-output systems driven by colored inputs," IEEE Trans. Signal Processing, vol. 45, pp. 1543-1552, June 1997.
12. K. I. Diamantaras, A. P. Petropulu, and B. Chen, "Blind two-input-two-output FIR channel identification based on second order statistics," IEEE Trans. Signal Processing, vol. 48, pp. 534-542, Feb. 2000.
13. B. Chen and A. P. Petropulu, "Frequency domain MIMO system identification based on second and higher order statistics," IEEE Trans. Signal Processing, vol. 49, pp. 1677-1688, Aug. 2001.
14. O. Grellier, P. Comon, B. Mourrain, and P. Trebuchet, "Analytical blind channel identification," IEEE Trans. Signal Processing, vol. 50, pp. 2196-2207, Sept. 2002.
15. O. Shalvi and E. Weinstein, "New criteria for blind deconvolution of nonminimum phase systems (channels)," IEEE Trans. Inform. Theory, vol. 36, pp. 312-321, Mar. 1990.
16. Y. Inouye and T. Sato, "Iterative algorithms based on multistage criteria for multichannel blind deconvolution," IEEE Trans. Signal Processing, vol. 47, pp. 1759-1764, June 1999.
17. C.-Y. Chi and C.-H. Chen, "Cumulant-Based inverse filter criteria for MIMO blind deconvolution: Properties, algorithms, and application to DS/CDMA systems in multipath," IEEE Trans. Signal Processing, vol. 49, pp. 1282-1299, July 2001.
18. C. L. Nikias and A. P. Petropulu, Higher-Order Spectra Analysis: A Nonlinear Signal Processing Framework. Englewood Cliffs, NJ: Prentice-Hall, 1993.
19. S. Haykin, Ed., Unsupervised Adaptive Filtering, Volume 2: Blind Deconvolution. New York: Wiley, 2000.
20. J. A. Cadzow, "Blind deconvolution via cumulant extrema," IEEE Signal Processing Mag., vol. 13, no. 3, pp. 24-42, 1996.
21. A. Bell and T. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural Computation, vol. 7, pp. 1129-1159, 1995.
22. J.-F. Bercher and C. Vignat, "Estimating the entropy of a signal with applications," IEEE Trans. Signal Processing, vol. 48, pp. 1687-1694, June 2000.
23. D. Erdogmus, J. C. Principe, and L. Vielva, "Blind deconvolution with Renyi's minimum entropy," in Proc. EUSIPCO, vol. 2, Toulouse, France, 2002, pp. 71-74.
24. J. F. Bercher and C. Vignat, "A Renyi entropy convolution inequality with application," in Proc. EUSIPCO, Tolouse, France, 2002.
25. I. Santamaria, C. Pantaleon, L. Vielva, and J. C. Principe, "A fast algorithm for adaptive blind equalization using order-α Renyi's entropy," in Proc. ICASSP, vol. 3, Orlando, FL, 2002, pp. 2657-2660.
26. J. Beirlant, E. Dudewicz, L. Gyorfi, and E. Van der Meulen, "Nonparametric entropy estimation," Int. J. Math. Statist. Sci., vol. 6, no. 1, pp. 17-39, 1997.
27. E. Parzen, "On estimation of a probability density function and mode," in Time Series Analysis Papers. San Francisco, CA: Holden-Day, 1967.
28. P. Viola, N. Schraudolph, and T. Sejnowski, "Empirical entropy manipulation for real-world problems," in Proc. NIPS, 1995, pp. 851-857.
29. J. H. Friedman and J. W. Tukey, "A projection pursuit algorithm for exploratory data analysis," IEEE Trans. Comput., vol. 23, pp. 881-889, 1974.
30. C. Diks, J. Houwelingen, F. Takens, and J. deGoede, "Detecting differences between delay vector distributions," Phys. Rev. E, vol. 53, pp. 2169-2176, 1996.
31. J. C. Principe, D. Xu, and J. W. Fisher, "Information theoretic learning," in Unsupervised Adaptive Filtering, vol. 1: Blind Source Separation, S. Haykin, Ed. New York: Wiley, 2000, vol. 1, pp. 265-319.
32. D. Erdogmus and J. C. Principe, "Generalized information potential criterion for adaptive system training," IEEE Trans. Neural Networks, vol. 13, pp. 1035-1044, Sept. 2002.
33. K. E. Hild II, D. Erdogmus, and J. C. Principe, "Blind source separation using Renyi's mutual information," IEEE Signal Processing Lett., vol. 8, pp. 174-176, June 2001.
34. J. D. Aczel and Z. Daroczy, "Uber verallegmeinerte quasilineare mittelwerte die mit gewichtsfunktionnen gebildet sind," Publications Mathematicae, vol. 10, pp. 171-190, 1963.
35. J. N. Kapur, "Generalized entropy of order and type," in Mathematics Seminar, vol. 4, 1967, pp. 78-94.
36. J. Havrda and F. Charvat, "Quantification method of classification process: Concept of structural α-entropy," Kybernetika, vol. 3, pp. 30-35, 1967.
37. B. D. Sharma and I. J. Taneja, "Entropy of type and other generalized additive measures in information theory," Metrika, vol. 22, pp. 205-215, 1975.
38. C. Tsallis, "Possible generalization of Boltzmann-Gibbs statistics," J. Statist. Phys., vol. 52, pp. 479-487, 1988.
39. A. Renyi, Probability Theory. New York: Elsevier, 1970.
40. D. Erdogmus, "Information theoretic learning: Renyi's entropy and its applications to adaptive system training," Ph.D. dissertation, Univ. Florida, Gainesville, FL, 2002.
41. S.-I. Amari, S. C. Douglas, A. Cichocki, and H. H. Yang, "Multichannel blind deconvolution and equalization using the natural gradient," in Proc. First IEEE Signal Process. Workshop Signal Process. Advances Wireless Commun., 1997, pp. 101-104.
42. A. Touzni, I. Fijalkow, M. G. Larimore, and J. R. Triechler, "A globally convergent approach for blind MIMO adaptive deconvolution," IEEE Trans. Signal Processing, vol. 49, pp. 1166-1178, June 2001.
43. R. Y. Rubinstein, Simulation and the Monte Carlo Method. New York: Wiley, 1981.
44. D. Erdogmus, K. E. Hild II, and J. C. Principe, "Blind source separation using Renyi's α-Marginal entropies," Special Issue on BSS and ICA, Neurocomputation, 2002, to be published.
45. J. E. Shore and R. W. Johnson, "Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy," IEEE Trans. Inform. Theory, vol. 26, pp. 26-37, 1980.