Signal recovery using expectation consistent approximation for linear observations

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2014, Pages 226-230

  Kabashima, Yoshiyuki ^a   Vehkapera, Mikko ^b  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION THEORY; MATRIX ALGEBRA;

BAYESIAN; LARGE SYSTEM; LINEAR OBSERVATIONS; MEAN FIELD APPROXIMATION; OBSERVATION MATRIX; OPTIMAL SIGNALS; REPLICA THEORIES; SIGNAL RECOVERY;

SIGNAL RECONSTRUCTION;

EID: 84906536415     PISSN: 21578095     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2014.6874828     Document Type: Conference Paper

References (31)

1. S. Rangan, A. K. Fletcher, and V. K. Goyal, "Asymptotic analysis of MAP estimation via the replica method and applications to compressed sensing, " IEEE Trans. Inform. Theory, vol. 58, no. 3, pp. 1902-1923, 2012.
2. D. Donoho and J. Tanner, "Counting faces of randomly projected polytopes when the projection radically lowers dimension, " Journal of the American Mathematical Society, vol. 22, no. 1, pp. 1-53, 2009.
3. Y. Kabashima, T. Wadayama, and T. Tanaka, "A typical reconstruction limit for compressed sensing based on lp-norm minimization, " J. Stat. Mech., vol. 2009, no. 9, pp. L09003(1-12), 2009.
4. D. L. Donoho, A. Maleki, and A. Montanari, "Message passing algorithms for compressed sensing, " Proc. Nat. Acad. Sci., vol. 106, pp. 18914-18919, 2009.
5. M. Opper and O. Winther, "Adaptive and self-averaging Thouless- Anderson-Palmer mean-field theory for probabilistic modeling, " Phys. Rev. E, vol. 64, pp. 056131(1-14), 2001.
6. M. Opper and O. Winther, "Expectation Consistent Approximate Inference, " Journal of Machine Learning Research, vol. 6, pp. 2177-2204, 2005.
7. T. P. Minka, "Expectation propagation for approximate Bayesian inference, " in Proceedings UAI-2001 (Ed. by J. S. Breese and D. Koller, Morgan Kaufmann), pp. 362-369, 2001.
8. D. Guo, D. Baron, and S. Shamai, "A single-letter characterization of optimal noisy compressed sensing, " Proc. Annual Allerton Conf. Commun. Contr. Computing, pp. 52-59, 2009.
9. W. Huleihel and N. Merhav, "Asymptotic MMSE Analysis Under Sparse Representation Modeling, " arXiv:1312.3417 [cs.IT].
10. A. M. Tulino, G. Caire, S. Verd́u, and Shamai, "Support Recovery With Sparsely Sampled Free Random Matrices, " IEEE Trans. Inform. Theory, vol. 59, pp. 4243-4271, 2013.
11. M. Opper and O. Winther, "A mean field algorithms for Bayes learning in large feed-forward neural networks, ", in Advances in Neural Information Processing Systems (Ed. by M. C. Mozer, M. I. Jordan, and T. Petche, The MIT Press), vol. 9, pp. 225-231, 1996.
12. Y. Kabashima, "A CDMA multiuser detection algorithm on the basis of belief propagation, " J. Phys. A: Math. Gen., vol. 36, pp. 11111-11121, 2003.
13. T. Tanaka and M. Okada, "Approximate belief propagation, density evolution, and statistical neurodynamics for CDMA multiuser detection, " IEEE Trans. on Inform. Theory, vol. 51, pp. 700-706, 2005.
14. J. P. Vila and P. Schniter, "Expectation-Maximization Bernoulli- Gaussian Approximate Message Passing, " in Proc. Asilomar Conf. on Signals, Systems, and Computers (Pacific Grove, CA),, Nov. 2011.
15. F. Krzakala, M. Mezard, F. Sausset, Y. F. Sun, and L. Zdeborova, "Statistical-Physics-Based Reconstruction in Compressed Sensing, " Phys. Rev. X, vol. 2, 021005(1-18), 2012.
16. S. Rangan, "Generalized Approximate Message Passing for Estimation with Random Linear Mixing, ", arXiv:1010.5141.
17. T. Shinzato and Y. Kabashima, "Learning from correlated patterns by simple perceptrons, " J. Phys. A: Math. Theor., vol. 42, 015005(1-12), 2009.
18. K. Takeda, S. Uda, and Y. Kabashima, "Analysis of CDMA systems that are characterized by eigenvalue spectrum, " Europhysics Letters, vol. 76, pp. 1193-1199, 2006.
19. A. Hatabu, K. Takeda, and Y. Kabashima, "Statistical mechanical analysis of the Kronecker channel model for multiple-input multipleoutput wireless communication, " Phys. Rev. E, vol. 80, 061124(1-12), 2009.
20. Y. Kabashima, "Inference from correlated patterns: A unified theory for perceptron learning and linear vector channels, " J. Phys. Conf. Ser. vol. 95, 012001(1-13), 2008.
21. M. Mezard, G. Parisi, and M. Virasoro, "Spin Glass Theory and Beyond, " World Scientific, 1986.
22. H. Nishimori, "Statistical Physics of Spin Glasses and Information Processing, " Oxford University Press, 2001.
23. T. Tanaka, "Asymptotics of Harish-Chandra-Itzykson-Zuber integrals and free probability theory, " J. Phys. Conf. Ser., vol. 95, 012002(1-9), 2008.
24. R. R. Muller, D. Guo, and A. L. Moustakas, "Vector Precoding for Wireless MIMO Systems and its Replica Analysis, " IEEE JSAC, vol. 26, no. 3, pp. 530-540, 2008.
25. M. Vehkapera, Y. Kabashima, and S. Chatterjee, "Analysis of Regularized LS Reconstruction and Random Matrix Ensembles in Compressed Sensing, " arXiv:1312.0256.
26. H. Nishimori and D. Sherrington, "Absence of Replica Symmetry Breaking in a Region of the Phase Diagram of the Ising Spin Glass, " in Disordered and Complex Systems (Ed. by P. Sollich et al, AIP Conf. Proc. 553), pp. 67-72, 2001.
27. T. Plefka, "Convergence condition of the TAP equation for the infiniteranged Ising spin glass model, " J. Phys. A: Math. Gen., vol. 15, pp. 1971-1978, 1982.
28. K. Nakanishi and H. Takayama, "Mean-field theory for a spin-glass model of neural networks: TAP free energy and paramagnetic to spinglass transition, " J. Phys. A: Math. Gen., vol. 30, pp. 8085-8094, 1997.
29. J. Barbier, F. Krzakala, and C. Schulke, "Compressed sensing and Approximate Message Passing with spatially-coupled Fourier and Hadamard matrices, " arXiv:1312.1740.
30. T. Fabricius and O. Winther, "Improved Multistage Detector by Mean- Field Annealing in Multi-User CDMA, " In Proceedings of IEEE Intelligent Signal Processing, Applications, and Communication Systems, 2002.
31. D. L. Donoho and J. Tanner, "Observed universality of phase transitions in high-dimensional geometry, with implications for modern data analysis and signal processing, " Phil. Trans. R. Soc. A, vol. 367, 4273-4293, 2009.