Inference for Generalized Linear Models via alternating directions and Bethe Free Energy minimization

IEEE International Symposium on Information Theory - Proceedings

Volumn 2015-June, Issue , 2015, Pages 1640-1644

  Rangan, Sundeep ^a   Fletcher, Alyson K ^b   Schniter, Philip ^c   Kamilov, Ulugbek S ^d  

^a POLYTECHNIC UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c OHIO STATE UNIVERSITY   (United States)

^d EPFL   (Switzerland)

Author keywords

ADMM; Belief propagation; generalized linear models; message passing; variational optimization

Indexed keywords

APPROXIMATION ALGORITHMS; FREE ENERGY; INFORMATION THEORY; LEAST SQUARES APPROXIMATIONS; MESSAGE PASSING; OPTIMIZATION;

ADMM; ALTERNATING DIRECTION METHOD OF MULTIPLIERS; ALTERNATING DIRECTIONS; BELIEF PROPAGATION; GENERALIZED LINEAR MODEL; LEAST SQUARES MINIMIZATION; LOOPY BELIEF PROPAGATION; VARIATIONAL OPTIMIZATION;

MATHEMATICAL TRANSFORMATIONS;

EID: 84969844615     PISSN: 21578095     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2015.7282734     Document Type: Conference Paper

References (23)

1. D. L. Donoho, A. Maleki, and A. Montanari, "Message-passing algorithms for compressed sensing, " Proc. Nat. Acad. Sci., vol. 106, no. 45, pp. 18 914-18 919, Nov. 2009.
2. -, "Message passing algorithms for compressed sensing I: motivation and construction, " in Proc. Info. Theory Workshop, Jan. 2010.
3. S. Rangan, "Estimation with random linear mixing, belief propagation and compressed sensing, " in Proc. Conf. on Inform. Sci. & Sys., Princeton, NJ, Mar. 2010, pp. 1-6.
4. -, "Generalized approximate message passing for estimation with random linear mixing, " in Proc. IEEE Int. Symp. Inform. Theory, Saint Petersburg, Russia, Jul.-Aug. 2011, pp. 2174-2178.
5. M. Bayati and A. Montanari, "The dynamics of message passing on dense graphs, with applications to compressed sensing, " IEEE Trans. Inform. Theory, vol. 57, no. 2, pp. 764-785, Feb. 2011.
6. A. Javanmard and A. Montanari, "State evolution for general approximate message passing algorithms, with applications to spatial coupling, " arXiv: 1211. 5164 [math. PR]., Nov. 2012.
7. S. Rangan, P. Schniter, and A. Fletcher, "On the convergence of approximate message passing with arbitrary matrices, " in Proc. ISIT, Jul. 2014, pp. 236-240.
8. F. Caltagirone, L. Zdeborová, and F. Krzakala, "On convergence of approximate message passing, " in Proc. ISIT, Jul. 2014, pp. 1812-1816.
9. A. Manoel, F. Krzakala, E. W. Tramel, and L. Zdeborová, "Sparse estimation with the swept approximated message-passing algorithm, " arXiv: 1406. 4311, Jun. 2014.
10. J. Vila, P. Schniter, S. Rangan, F. Krzakala, and L. Zdeborová, "Adaptive damping and mean removal for the generalized approximate message passing algorithm, " in Proc. IEEE ICASSP, 2015, to appear.
11. A. K. Fletcher, S. Rangan, L. Varshney, and A. Bhargava, "Neural reconstruction with approximate message passing (NeuRAMP), " in Proc. Neural Information Process. Syst., Granada, Spain, Dec. 2011.
12. P. Schniter and S. Rangan, "Compressive phase retrieval via generalized approximate message passing, " IEEE Trans. Signal Process., vol. 63, no. 4, pp. 1043-1055, 2015.
13. J. Ziniel, P. Schniter, and P. Sederberg, "Binary linear classification and feature selection via generalized approximate message passing, " IEEE Trans. Signal Process., vol. 63, no. 8, pp. 2020-2032, 2015.
14. S. Rangan, P. Schniter, E. Riegler, A. Fletcher, and V. Cevher, "Fixed points of generalized approximate message passing with arbitrary matrices, " in Proc. ISIT, Jul. 2013, pp. 664-668.
15. F. Krzakala, A. Manoel, E. W. Tramel, and L. Zdeborová, "Variational free energies for compressed sensing, " in Proc. ISIT, Jul. 2014, pp. 1499-1503.
16. A. L. Yuille and A. Rangarajan, "The concave-convex procedure (CCCP), " Proc. NIPS, vol. 2, pp. 1033-1040, 2002.
17. J. S. Yedidia, W. T. Freeman, and Y. Weiss, "Understanding belief propagation and its generalizations, " in Exploring Artificial Intelligence in the New Millennium. San Francisco, CA: Morgan Kaufmann Publishers, 2003, pp. 239-269.
18. S. Rangan, A. K. Fletcher, P. Schniter, and U. S. Kamilov, "Inference for generalized linear models via alternating directions and Bethe free energy minimization, " arXiv: 1501. 01797, Jan. 2015.
19. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers, " Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, 2010.
20. R. T. Rockafellar, "Monotropic programming: Descent algorithms and duality, " in Nonlinear Programming, O. L. Mangasarian, R. R. Meyer, and S. M. Robinson, Eds. Academic Press, 1981, vol. 4, pp. 327-366.
21. R. Tibshirani, "Regression shrinkage and selection via the lasso, " J. Royal Stat. Soc., Ser. B, vol. 58, no. 1, pp. 267-288, 1996.
22. P. T. Boufounos and R. G. Baraniuk, "1-bit compressive sensing, " in Proc. Conf. on Inform. Sci. & Sys., 2008, pp. 16-21.
23. U. S. Kamilov, V. K. Goyal, and S. Rangan, "Message-passing dequantization with applications to compressed sensing, " IEEE Trans. Signal Process., vol. 60, no. 12, pp. 6270-6281, Dec. 2012.