State evolution for general approximate message passing algorithms, with applications to spatial coupling

Information and Inference

Volumn 2, Issue 2, 2013, Pages 115-144

  Javanmard, Adel ^a   Montanari, Andrea ^a  

^a Stanford University   (United States)

Author keywords

Compressed sensing; Message passing; Signal recovery; Spatial coupling; State evolution

Indexed keywords

EID: 84969891693     PISSN: None     EISSN: 20498772     Source Type: Journal    
DOI: 10.1093/imaiai/iat004     Document Type: Article

References (30)

1. Bayati, M., Lelarge, M. & Montanari, A. (2012) Universality in Polytope Phase Transitions and Message Passing Algorithms. Preprint, arXiv:1207.7321v1.
2. Bayati, M. & Montanari, A. (2011) The dynamics of message passing on dense graphs, with applications to compressed sensing. IEEE Trans. Inform. Theory, 57, 764-785.
3. Bayati, M. & Montanari, A. (2012) The LASSO risk for gaussian matrices. IEEE Trans. Inform. Theory, 58, 1997-2017.
4. Bean, D., Bickel, P., El Karoui, N. & Yu, B. (2012) Optimal objective function in high-dimensional regression. Tech. Rep., http://statistics.berkeley.edu/sites/default/files/tech-reports/810.pdf.
5. Bolthausen, E. (2012) An iterative construction of solutions of the tap equations for the sherrington-kirkpatrick model. Preprint, arXiv:1201.2891.
6. Donoho, D. L., Javanmard, A. & Montanari, A. (2011) Information-theoretically optimal compressed sensing via spatial coupling and approximate message passing. Preprint arXiv:1112.0708v1.
7. Donoho, D., Johnstone, I. & Montanari, A. (2011) Accurate prediction of phase transitions in compressed sensing via a connection to minimax denoising. Preprint arXiv:1111.1041.
8. Donoho, D. L., Maleki, A. & Montanari, A. (2009) Message passing algorithms for compressed sensing. Proc. Natl Acad. Sci. USA, 106, 18914-18919.
9. Donoho, D. L., Maleki, A. & Montanari, A. (2011) The noise sensitivity phase transition in compressed sensing. IEEE Trans. Inform. Theory, 57, 6920-6941.
10. El Karoui, N., Bean, D., Bickel, P., Lim, C. & Yu, B. (2012) On robust regression with high-dimensional predictors. Tech. Rep., http://statistics.berkeley.edu/sites/default/files/tech-reports/812.pdf.
11. Fletcher, A. K., Rangan, S., Varshney, L. R. & Bhargava, A. (2011) Neural reconstruction with approximate message passing (neuramp). Proceedings of the 25th Annual Conference on Neural Information Processing Systems, Granada, Spain, pp. 2555-2563.
12. Hu, T. C. & Taylor, R. L. (1997) Strong law for arrays and for the bootstrap mean and variance. Int. J. Math. Math. Sci., 20, 375-383.
13. Javanmard, A. & Montanari, A. (July 2012) Subsampling at Information Theoretically Optimal Rates. IEEE Int. Symp. Inform. Theory (Cambridge), pp. 2431-2435.
14. Kamilov, U. S., Bourquard, A., Amini, A. & Unser, M. (2012) One-bit measurements with adaptive thresholds. IEEE Signal Process. Lett., 19, 607-610.
15. Kamilov, U. S., Goyal, V. K. & Rangan, S. (2011) Message-passing estimation from quantized samples. Preprint arXiv:1105.6368.
16. Krzakala, F., Mézard, M., Sausset, F., Sun, Y. & Zdeborová, L. (2012) Probabilistic reconstruction in compressed sensing: algorithms, phase diagrams, and threshold achieving matrices. J. Statist. Mech. Theory Exp., 2012, P08009.
17. Krzakala, F., Mézard, M., Sausset, F., Sun, Y. F. & Zdeborová, L. (2012) Statistical-physics-based reconstruction in compressed sensing. Phys. Rev. X, 2, 021005.
18. Kudekar, S. & Pfister, H. D. (2010) The effect of spatial coupling on compressive sensing. 48th Annual Allerton Conference on Communication, Control, and Computing, Illinois, USA, pp. 347-353.
19. McCullagh, P. & Nelder, J. A. (1989) Generalized Linear Models, 2nd edn. London: Chapman & Hall.
20. Mézard, M. & Montanari, A. (2009) Information, Physics and Computation. Oxford: Oxford University Press.
21. Mézard, M., Parisi, G. & Virasoro, M. A. (1987) Spin Glass Theory and Beyond. Singapore: World Scientific.
22. Nelder, J. A. & Wedderburn, R. W. M. (1972) Generalized linear models. J. R. Statist. Soc., Ser. A, 135, 370-384.
23. Pearl, J. (1988) Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco: Morgan Kaufmann.
24. Rangan, S. (August 2011) Generalized approximate message passing for estimation with random linear mixing. IEEE Int. Symp. Inform. Theory (St. Petersburg), pp. 2168-2172.
25. Rényi, A. (1959) On the dimension and entropy of probability distributions. Acta Math. Hungarica, 10, 193-215.
26. Richardson, T. J. & Urbanke, R. (2008) Modern Coding Theory. Cambridge: Cambridge University Press.
27. Schniter, P. (2010) Turbo reconstruction of structured sparse signals. Proceedings of the Conference on Information Sciences and Systems (Princeton).
28. Som, S. & Schniter, P. (2012) Compressive imaging using approximate message passing and a Markov-tree prior. IEEE Trans. Signal Process., 60, 3439-3448.
29. Stein, C. (1972) A bound for the error in the normal approximation to the distribution of a sum of dependent random variables. Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability, pp. 583-602. Berkeley, USA: University of California Press.
30. Wu, Y. & Verdú, S. (2010) Rényi information dimension: fundamental limits of almost lossless analog compression. IEEE Trans. Inform. Theory, 56, 3721-3748.