A variational inference framework for soft-in soft-out detection in multiple-access channels

IEEE Transactions on Information Theory

Volumn 55, Issue 5, 2009, Pages 2345-2364

  Lin, Darryl Dexu ^a,b   Lim, Teng Joon ^a  

^a UNIVERSITY OF TORONTO   (Canada)

^b QUALCOMM INC   (United States)

Author keywords

Free energy; Interference cancellation; Message passing; Soft in soft out (SISO) detection; tTurbo multiuser detection; Variational inference

Indexed keywords

A-POSTERIORI PROBABILITIES; CHANNEL KNOWLEDGE; DATA DETECTION; DETECTION SCHEME; DETRIMENTAL EFFECTS; ERROR CONTROL CODE; EXPECTATION-MAXIMIZATION ALGORITHMS; EXPONENTIAL COMPLEXITY; INTERFERENCE CANCELLATION; JOINT DETECTION AND DECODING; MULTIPLE ACCESS CHANNELS; MULTIPLE-INPUT MULTIPLE-OUTPUT CHANNELS; OBJECTIVE FUNCTIONS; OPTIMALITY; SOFT-IN SOFT-OUT; SOFT-IN SOFT-OUT (SISO) DETECTION; SOFT-IN SOFT-OUT DETECTION; TTURBO MULTIUSER DETECTION; TURBO MULTIUSER DETECTION; TURBO PRINCIPLE; UNIFIED FRAMEWORK; VARIATIONAL FREE ENERGY; VARIATIONAL INFERENCE;

CHANNEL ESTIMATION; ERROR DETECTION; FREE ENERGY; INTERSYMBOL INTERFERENCE; MESSAGE PASSING; MULTIPLE ACCESS INTERFERENCE; MULTIPLEXING; MULTIUSER DETECTION; PARAMETER ESTIMATION; QUADRATURE AMPLITUDE MODULATION; RADIO INTERFERENCE;

DETECTORS;

EID: 65749088033     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2016054     Document Type: Article

References (42)

1. C. Berrou, A. Glavieux, and P. Titmajshima, "Near Shannon limit error-correction coding and decoding: Turbo codes," in Proc. IEEE Int. Conf. Communications (ICC'93), May 1993, pp. 1064-1070.
2. P. D. Alexander, A. J. Grant, and M. C. Reed, "Iterative detection in code-division multiple-access with error control coding," Europ. Trans. Telecommun., vol. 9, no. 5, pp. 419-426, Oct. 1998.
3. X. Wang and H. V. Poor, "Iterative (turbo) soft interference cancellation and decoding for coded CDMA," IEEE Trans. Commun., vol. 47, no. 7, pp. 1046-1061, Jul. 1999.
4. C. Douillard, A. Picart, P. Didier, M. Jézéquel, C. Berrou, and A. Glavieux, "Iterative correction of intersymbol interference: Turbo equalization," Europ. Trans. Telecommun., vol. 6, pp. 507-511, Sep. 1995.
5. M. Tüchler, A. C. Singer, and R. Koetter, "Turbo equalization: Principles and new results," IEEE Trans. Commun., vol. 50, no. 5, pp. 754-767, May 2002.
6. S. L. Ariyavisitakul, "Turbo space-time processing to improve wireless channel capacity," IEEE Trans. Commun., vol. 48, no. 8, pp. 1347-1359, Aug. 2000.
7. S. Haykin, M. Sellathurai, Y. de Jong, and T. Willink, "Turbo-MIMO for wireless communications," IEEE Commun. Mag., vol. 42, no. 10, pp. 48-53, Oct. 2004.
8. S. Verdù, Multiuser Detection. Cambridge, U.K.: Cambridge Univ. Press, 1998.
9. L. Bahl, J. Cocke, F. Jelinek, and J. Raviv, "Optimal decoding of linear codes for minimizing symbol error rate," IEEE Trans. Inf. Theory, vol. IT-20, no. 2, pp. 284-287, Mar. 1974.
10. D. MacKay, Information Theory, Inference and Learning Algorithms. Cambridge, U.K.: Cambridge Univ. Press, 2003.
11. F. R. Kschischang, B. J. Frey, and H. A. Loeliger, "Factor graphs and the sum-product algorithm," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 498-519, Feb. 2001.
12. J. Boutros and G. Caire, "Iterative multiuser joint decoding: Unified framework and asymptotic analysis," IEEE Trans. Inf. Theory, vol. 48, no. 7, pp. 1772-1793, Jul. 2002.
13. T. Tanaka, "A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors," IEEE Trans. Inf. Theory, vol. 48, no. 11, pp. 2888-2910, Nov. 2002.
14. D. Guo and S. Verdú, "Randomly spread CDMA: Asymptotics via statistical physics," IEEE Trans. Inf. Theory, vol. 51, no. 6, pp. 1983-2010, Jun. 2005.
15. R. M. Neal and G. E. Hinton, "A view of the EM algorithm that justifies incremental, sparse, and other variants," in Learning in Graphical Models, M. I. Jordan, Ed. New York: Kluwer Academic, 1998.
16. D. D. Lin and T. J. Lim, "Bit-level equalization and soft detection for Gray-coded multilevel modulation," IEEE Trans. Inf. Theory, vol. 54, no. 10, pp. 4731-4742, Oct. 2008.
17. F. R. Kschischang and B. J. Frey, "Iterative decoding of compound codes by probability propagation in graphical models," IEEE J. Sel. Areas Commun., vol. 16, no. 2, pp. 219-230, Feb. 1998.
18. N. Yacov, H. Efraim, H. Kfir, I. Kanter, and O. Shental, "Parallel vs. sequential belief propagation decoding of LDPC codes over GF (q and Markov sources," Physica A: Statistical Mechanics and Its Applications, vol. 378, no. 2, pp. 329-335, May 2007.
19. M. Wainwright and M. I. Jordan, "Graphical models, exponential families, and variational inference," Found. Trends Mach. Learn., vol. 1, no. 1-2, pp. 1-305, 2008.
20. B. J. Frey, Graphical Models for Machine Learning and Digital Communication. Cambridge, MA: MIT Press, 1998.
21. M. I. Jordan, Z. Ghahramani, T. Jaakkola, and L. K. Saul, "An introduction to variational methods for graphical models," Machine Learning, vol. 37, no. 2, pp. 183-233, 1999.
22. R. K. Pathria, Statistical Mechanics. Oxford, U.K.: Elsevier Butterworth-Heinemann, 2004.
23. H. Elders-Boll, H. D. Schotten, and A. Busboom, "Efficient implementation of linear multiuser detectors for asynchronous CDMA systems by linear interference cancellation," Europ. Trans. Telecommun., vol. 9, no. 5, pp. 427-438, Oct. 1998.
24. L. K. Rasmussen, T. J. Lim, and A. L. Johansson, "A matrix-algebraic approach to successive interference cancellation in CDMA," IEEE Trans. Commun., vol. 48, no. 1, pp. 145-151, Jan. 2000.
25. D. Guo, L. K. Rasmussen, S. Sun, and T. J. Lim, "A matrix-algebraic approach to linear parallel interference cancellation in CDMA," IEEE Trans. Commun., vol. 48, no. 1, pp. 152-161, Jan. 2000.
26. P. H. Tan, L. K. Rasmussen, and T. J. Lim, "Constrained maximum-likelihood detection in CDMA," IEEE Trans. Commun., vol. 49, no. 1, pp. 142-153, Jan. 2001.
27. Z. Q. Luo and P. Tseng, "On the convergence of the coordinate descent method for convex differentiable minimization," J. Optim. Theory Appl., vol. 72, no. 1, pp. 7-35, Jan. 1992.
28. T. Fabricius and O. Nøklit, "Approximations to joint-ML and ML symbol-channel estimators in MUD CDMA," in Proc. IEEE Global Telecommunications Conf. (GLOBECOM'02), Nov. 2002, vol. 1, pp. 389-393.
29. Y. Kabashima, "A CDMA multiuser detection algorithm on the basis of belief propagation," J. Phys. A: Math. Gen., vol. 36, pp. 11111-11121, Oct. 2003.
30. M. Kobayashi, J. Boutros, and G. Caire, "Successive interference cancellation with SISO decoding and E Mchannel estimation," IEEE J. Sel. Areas Commun., vol. 19, no. 8, pp. 1450-1460, Aug. 2001.
31. A. Duel-Hallen, "Decorrelating decision-feedback multiuser detector for synchronous code-division multiple-access channel," IEEE Trans. Commun., vol. 41, no. 2, pp. 285-290, Feb. 1993.
32. J. Evans and D. N. C. Tse, "Large system performance of linear multiuser receivers in multipath fading channels," IEEE Trans. Inf. Theory, vol. 46, no. 6, pp. 2059-2078, Sep. 2000.
33. H. Li and H. V. Poor, "Impact of imperfect channel estimation on turbo multiuser detection in DS-CDMA systems," in Proc. IEEE Wireless Communications Networking Conf. (WCNC'04), Mar. 2004, vol. 1, pp. 30-35.
34. H. Li and H. V. Poor, "Impact of channel estimation errors on multiuser detection via the replica method," EURASIP J. Wireless Commun. Netw. vol. 2005, no. 2, pp. 175-186, 2005.
35. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Stat. Soc., vol. 39, no. 1, pp. 1-38, 1977.
36. A. Kocian and B. H. Fleury, "EM-based joint data detection and channel estimation of DS-CDMA signals," IEEE Trans. Commun., vol. 51, no. 10, pp. 1709-1720, Oct. 2003.
37. B. J. Frey and N. Jojic, "A comparison of algorithms for inference and learning in probabilistic graphical models," IEEE Trans. Patt. Anal. Machine Intell., vol. 27, no. 9, pp. 1392-1416, Sep. 2005.
38. D. D. Lin and T. J. Lim, "The variational inference approach to joint data detection and phase noise estimation in OFDM," IEEE Trans. Signal Process., vol. 55, no. 5, pp. 1862-1874, May 2007.
39. M. Nissilä and S. Pasupathy, "Joint estimation of carrier frequency offset and statistical parameters of the multipath fading channel," IEEE Trans. Commun., vol. 54, no. 6, pp. 1038-1048, Jun. 2006.
40. M. Médard, "The effect upon channel capacity in wireless communications of perfect and imperfect knowledge of the channel," IEEE Trans. Inf. Theory, vol. 46, no. 3, pp. 933-946, May 2000.
41. D. Mackay, "Introduction to Monte Carlo methods," in Learning in Graphical Models, M. I. Jordan, Ed. New York: Kluwer Academic, 1998.
42. J. S. Yedidia, W. T. Freeman, and Y.Weiss, "Constructing free-energy approximations and generalized belief propagation algorithms," IEEE Trans. Inf. Theory, vol. 51, no. 7, pp. 2282-2312, Jul. 2005.