Convergence analysis of the variance in Gaussian belief propagation

IEEE Transactions on Signal Processing

Volumn 62, Issue 19, 2014, Pages 5119-5131

  Su, Qinliang ^a   Wu, Yik Chung ^a  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Convergence; factor graph; Gaussian belief propagation; graphical model; loopy belief propagation; message passing; sum product algorithm

Indexed keywords

EID: 84906819119     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2014.2345635     Document Type: Article

References (34)

1. F. R. Kschischang, B. J. Frey, and H. A. Loeliger, "Factor graphs and the sum-product algorithm," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 498-519, Feb. 2001. (Pubitemid 32318087)
2. H. A. Loeliger, "An introduction to factor graphs," IEEE Signal Process. Mag., vol. 21, no. 1, pp. 28-41, Jan. 2004.
3. H. A. Loeliger, J. Dauwels, H. Junli, S. Korl, P. Li, and F. R. Kschischang, "The factor graph approach to model-based signal processing," Proc. IEEE, vol. 95, no. 6, pp. 1295-1322, Jun, 2007.
4. C. M. Bishop, Pattern Recognition and Machine Learning. Berlin, Germany: Springer-Verlag, Aug. 2006.
5. D. Koller and N. Friedman, Probabilistic Graphical Models Principles and Techniques. Cambridge, MA, USA: MIT Press, 2009.
6. Y. Weiss and W. T. Freeman, "Correctness of belief propagation in Gaussian graphical models of arbitrary topology," Neural Comput., vol. 13, pp. 2173-2200, 2001. (Pubitemid 33676880)
7. Y. Liu, V. Chandrasekaran, A. Anandkumar, and A. S. Willsky, "Feedback message passing for inference in Gaussian graphical models," IEEE Trans. Signal Process., vol. 60, no. 8, pp. 4135-4150, Aug. 2012.
8. A. Montanari, B. Prabhakar, and D. Tse, "Belief propagation based multiuser detection," presented at the IEEE Inf. Theory Workshop, Punta del Este, Uruguay, Mar. 2006.
9. Q. Guo and D. Huang, "EM-based joint channel estimation and detection for frequency selective channels using Gaussianmessage passing," IEEE Trans. Signal Process., vol. 59, no. 8, pp. 4030-4035, Aug. 2011.
10. Q. Guo and P. Li, "LMMSE turbo equalization based on factor graphs," IEEE J. Sel. Areas Commun., vol. 26, no. 2, pp. 311-319, Feb. 2008. (Pubitemid 351207498)
11. Y. El-Kurdi, W. J. Gross, and D. Giannacopoulos, "Efficient implementation of Gaussian belief propagation solver for large sparse diagonally dominant linear systems," IEEE Trans. Magn., vol. 48, no. 2, pp. 471-474, Feb. 2012.
12. O. Shental, P. H. Siegel, J. K. Wolf, D. Bickson, and D. Dolev, "Gaussian belief propagation solver for systems of linear equations," in Proc. IEEE Int. Symp. Inf. Theory (ISIT), 2008, pp. 1863-1867.
13. X. Tan and J. Li, "Computationally efficient sparse Bayesian learning via belief propagation," IEEE Trans. Signal Process., vol. 58, no. 4, pp. 2010-2021, Apr. 2010.
14. V. Chandrasekaran, J. K. Johnson, and A. S. Willsky, "Estimation in Gaussian graphical models using tractable subgraphs: A walk-sum analysis," IEEE Trans. Signal Process., vol. 56, no. 5, pp. 1916-1930, May 2008.
15. N. B. Loong, J. S. Evans, S. V. Hanly, and D. Aktas, "Distributed downlink beamforming with cooperative base stations," IEEE Trans. Inf. Theory, vol. 54, no. 12, pp. 5491-5499, Dec. 2008.
16. F. Lehmann, "Iterative mitigation of intercell interference in cellular networks based on Gaussian belief propagation," IEEE Trans. Veh. Technol., vol. 61, no. 6, pp. 2544-2558, Jul. 2012.
17. M. Leng and Y. C. Wu, "Distributed clock synchronization for wireless sensor networks using belief propagation," IEEE Trans. Signal Process., vol. 59, no. 11, pp. 5404-5414, Nov. 2011.
18. A. Ahmad, D. Zennaro, E. Serpedin, and L. Vangelista, "A factor graph approach to clock offset estimation in wireless sensor networks," IEEE Trans. Inf. Theory, vol. 58, no. 7, pp. 4244-4260, Jul. 2012.
19. M. Leng, T. Wee-Peng, and T. Q. S. Quek, "Cooperative and distributed localization for wireless sensor networks in multipath environments," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process. (ICASSP), 2012, pp. 3125-3128.
20. Y. Song, B. Wang, Z. Shi, K. Pattipati, and S. Gupta, "Distributed algorithms for energy-efficient even self-deployment in mobile sensor networks," IEEE Trans. Mobile Comput., vol. 13, no. 5, pp. 1-14, May 2013.
21. G. Zhang, W. Xu, and Y. Wang, "Fast distributed rate control algorithm with QoS support in Ad Hoc networks," presented at the IEEE Global Telecommun. Conf. (Globecom), 2010.
22. D. Dolev, A. Zymnis, S. P. Boyd, D. Bickson, and Y. Tock, "Distributed large scale network utility maximization," in Proc. IEEE Int. Symp. Inf. Theory (ISIT), 2009, pp. 829-833.
23. M. W. Seeger and D. P. Wipf, "Variational Bayesian inference techniques," IEEE Signal Process. Mag., vol. 27, no. 6, pp. 81-91, Nov. 2010.
24. D.M. Malioutov, J. K. Johnson, and A. S. Willsky, "Walk-sums and belief propagation in Gaussian graphical models," J. Mach. Learn. Res., vol. 7, no. 1, pp. 2031-2064, 2006. (Pubitemid 44497455)
25. C. C. Moallemi and B. Van Roy, "Convergence of min-sum message passing for quadratic optimization," IEEE Trans. Inf. Theory, vol. 55, no. 5, pp. 2413-2423, May 2009.
26. S. Tatikonda and M. I. Jordan, "Loopy belief propagation and Gibbs measures," in Proc. 18th Annu. Conf. Uncertainty Artif. Intell. (UAI-02), San Francisco, CA, USA, Aug. 2002, pp. 493-500.
27. D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Englewood Cliffs, NJ, USA: Prentice-Hall, 1989.
28. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
29. C. C. Moallemi and B. Van Roy, "Convergence of min-sum message passing for convex optimization," IEEE Trans. Inf. Theory, vol. 56, no. 4, pp. 2041-2050, Apr. 2010.
30. L. Vandenberghe and S. Boyd, "Semidefinite programming," SIAM Rev., vol. 38, no. 1, pp. 49-95, Mar. 1996. (Pubitemid 126610912)
31. M. Grant, S. Boyd, and Y. Ye, "CVX:Matlab Software for Disciplined Convex Programming," [Online]. Available: http://www.stanford.edu/boyd/cvx/
32. J. F. Sturm, "Using SeDumi 1.02, a MATLAB toolbox for optimization over symmetric cones," Optim. Methods Software, no. 11-22, pp. 625-653, 1999.
33. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating method of multipliers," Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, 2011.
34. R. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.