Conditional distribution learning with neural networks and its application to channel equalization

IEEE Transactions on Signal Processing

Volumn 45, Issue 4, 1997, Pages 1051-1064

  Adah, Tiilay ^a  

^a University of Marylandw Baltimore County   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; INFORMATION THEORY; LEARNING SYSTEMS; NEURAL NETWORKS; PROBABILITY; REAL TIME SYSTEMS; STATISTICAL METHODS;

ACCUMULATED RELATIVE ENTROPY (ARE) MINIMIZATION; ADAPTIVE CHANNEL EQUALIZATION; MULTILAYER PERCEPTRON MODEL; PARTIAL LIKELIHOOD (PL) ESTIMATION; SINGLE LAYER PERCEPTRON MODEL;

SIGNAL PROCESSING;

EID: 0031122341     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.564193     Document Type: Article

References (34)

1. T. Adah, M. K. Sönmez, and X. Liu, "Partial likelihood estimation for real-time signal processing," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP), Atlanta, GA, 1996, vol. 6, pp. 3562-3565.
2. T. Adah, M. K. Sönmez, and K. Patel, "On the dynamics of the LRE algorithm: A distribution learning approach to adaptive equalization," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP), Detroit, MI, 1995, pp. 929-932.
3. T. Adah and M. K. Sönmez, "Channel equalization with perceptrons: An information-theoretic approach," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP), Adelaide, Australia, 1994, pp. 297-300.
4. T. Adah, X. Liu, N. Li, and M. K. Sönmez, "A maximum partial likelihood framework for channel equalization by distribution learning," in Proc. IEEE Workshop Neural Networks Signal Processing, Boston, MA, 1995, pp. 541-550.
5. S. Amari, "The EM algorithms and information geometry in neural network learning," Neural Computat., vol. 7, pp. 13-18, 1994.
6. B. M. Brown, "Martingale central limit theorems," Ann. Math. Statist., vol. 44, pp. 59-66, 1971.
7. T. X. Brown, "Neural networks for adaptive equalization," in Applications Neural Networks Telecommun., J. Alspector, R. Goodman, and T. X. Brown Eds. Hillsdale, NJ: Erlbaum, 1993, pp. 27-33.
8. I. Cha and S. A. Kassam, "Channel equalization using adaptive complex radial basis function networks," IEEE J. Select. Areas Commun., vol. 13, pp. 122-131, 1995.
9. S. Chen, S. McLaughlin, and B. Mulgrew, "Complex-valued radial basis function network, Part II: Application to digital communications channel equalization," Signal Processing, vol. 35, pp. 19-31, 1994.
10. S. Chen, G. J. Gibson, C. F. N. Cowan, and P. M. Grant, "Adaptive equalization of finite nonlinear channels using multilayer perceptrons," Signal Processing, vol. 10, pp. 107-119, 1990.
11. D. R. Cox, "Partial likelihood," Biometrika, vol. 62, pp. 69-72, 1975.
12. I. Csiszâr and G. Tusnâdy, "Information geometry and alternating minimization procedure," Statistics and decisions, Supplementary issue, no. I, E. Dedewicz et al., Eds. Munich: Oldenburg Verlag, 1984, pp. 205-237.
13. A. R. Figueiras-Vidal, A. Artés-Rodriguez, J. Sid-Sueiro, and M. Martinez-Ramon, "Adaptive signal processing: A discussion of tradeoffs from the perspective of artificial learning," in Proc. 1996 European Conf. Signal Processing, Trieste, Italy, 1996, pp. 1635-1640.
14. G. D. Forney, Jr., "Maximum likelihood sequence estimation of digital sequences in the presence of intersymbol interference," IEEE Trans. Inform. Theory, vol. IT-18, pp. 378-383, 1972.
15. G. J. Gibson, S. Siu, and C. F. N. Cowan, "The application of nonlinear structures to the reconstruction of binary signals," IEEE Trans. Signal Processing, vol. 39, pp. 1877-1884, 1991.
16. F. Girosi et al., Eds., Neural Networks for Signal Processing V, Proc. IEEE Workshop, Boston, MA. New York: IEEE, 1995.
17. R. M. Gray and L. D. Davisson, Random Processes: A Mathematical Approach for Engineers. Englewood Cliffs, NJ: Prentice-Hall, 1986.
18. J. Cid-Sueiro, A. Artès-Rodriguez, and A. R. Figueiras-Vidal, "Recurrent radial basis function networks for optimal symbol-by-symbol equalization," Signal Processing, vol. 40, pp. 53-63, 1994.
19. M. I. Jordan and R. A. Jacobs, "Hierarchical mixture of experts and the EM algorithm," Neural Comput., no. 6, pp. 181-214, 1994.
20. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ: Macmillan, 1994.
21. G. E. Hinton, "Connectionist learning procedures," Artif. Intell., vol. 40, pp. 185-234, 1989.
22. J. J. Hopfield, "Learning algorithms and probability distributions in feedforward and feed-back networks," in Proc. Nat. Acad. Sei. USA, 1987, vol. 84, pp. 8429-8433.
23. G. Kechriotis, E. Zervas, and E. S. Manolakos, "Using recurrent neural networks for adaptive communication channel equalization," IEEE Trans. Neural Networks, vol. 5, pp. 267-278, 1994.
24. L. Kullback and R. A. Leibler, "On information and sufficiency," Ann. Math. Statist., vol. 22, pp. 79-86, 1951.
25. M. Meyer and G. Pfeiffer, "Multilayer perceptron based decision feedback equalisers for channels with intersymbol interference," in Proc. Inst. Elec. Eng., vol. 140, no. 6, pp. 42024, 1993.
26. M. K. Sönmez and J. S. Baras, "Time series modeling by perceptrons: A likelihood approach," in Proc. World Congr. Neural Networks, Portland, OR, 1993, pp. 601-604.
27. E. Slud and B. Kedem, "Partial likelihood analysis of logistic regression and autoregression," Statistica Sinica, vol. 4, no. 1, pp. 89-106, 1994.
28. S. Theodoridis, C. F. N. Cowan, and C. M. S. See, "Schemes for equalization of communication channels with nonlinear impairments," in Proc. Inst. Elec. Commun., vol. 142, no. 3, pp. 1350-2425, 1995.
29. Y. Wang and T. Adah, "Efficient learning of finite normal mixtures for image quantification," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP), Atlanta, GA, vol. 6, 1996, pp. 3423-3426.
30. H. White, Estimation, Inference, and Specification Analysis. New York: Cambridge Univ. Press, 1994.
31. "Learning in artificial neural networks: A statistical perspective," Neural Comput., vol. 1, pp. 42564, 1989.
32. B. S. Wittner and J. S. Denker, "Strategies for teaching layered networks classification tasks," in Neural Inform. Proc. Syst., Denver, CO, 1988, pp. 850-859.
33. W. H. Wong,"Theory of partial likelihood," Ann. Statist., vol. 14, pp. 88-123, 1986.
34. J. Xuan, T. Adah, and X. Liu, "Information geometry of maximum partial likelihood estimation for channel equalization," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP), Atlanta, GA, vol. 6, 1996, pp. 3534-3537.