High dimensional robust M-estimation: asymptotic variance via approximate message passing

Probability Theory and Related Fields

Volumn 166, Issue 3-4, 2016, Pages 935-969

  Donoho, David ^a   Montanari, Andrea ^a,b  

^a STANFORD UNIVERSITY   (United States)

^b Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84946763649     PISSN: 01788051     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00440-015-0675-z     Document Type: Article

References (36)

1. Anderson, G.W., Guionnet, A., Zeitouni, O.: An introduction to random matrices. Cambridge University Press, (2009)
2. Bickel, Peter J.: One-step Huber estimates in the linear model. Journal of the American Statistical Association 70(350), 428–434 (1975)
3. Bayati, Mohsen, Lelarge, Marc, Montanari, Andrea: Universality in polytope phase transitions and message passing algorithms. Annals of Applied Probability 25, 753–822 (2015)
4. Bayati, M., Montanari, A.: The dynamics of message passing on dense graphs, with applications to compressed sensing. IEEE Trans. on Inform. Theory 57, 764–785 (2011)
5. Bayati, M., Montanari, A.: The LASSO risk for gaussian matrices. IEEE Trans. on Inform. Theory 58, 1997–2017 (2012)
6. Bolthausen, Erwin: An iterative construction of solutions of the tap equations for the sherrington-kirkpatrick model. Communications in Mathematical Physics 325(1), 333–366 (2014)
7. Chen, S.S., Donoho, D.L.: Examples of basis pursuit. Proceedings of Wavelet Applications in Signal and Image Processing III (San Diego, CA), 1995
8. Chang, C.-I.: Hyperspectral Imaging: Techniques for Spectral Detection and Classification. Springer, (2003)
9. p -balls: Minimax mean square error. Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on, IEEE, 129–133 (2011)
10. Deshpande, Yash, Montanari, Andrea: Finding Hidden Cliques of Size N/e in Nearly Linear Time. Foundations of Computational Mathematics, 1–60 (2013)
11. Donoho, D.L., Maleki, A., Montanari, A.: Message Passing Algorithms for Compressed Sensing. Proceedings of the National Academy of Sciences 106, 18914–18919 (2009)
12. Donoho, D.L., Maleki, A., Montanari, A.: Message Passing Algorithms for Compressed Sensing: I. Motivation and Construction. Proceedings of IEEE Inform, Theory Workshop (Cairo), (2010)
13. Donoho, D.L., Maleki, A., Montanari, A.: The Noise Sensitivity Phase Transition in Compressed Sensing. IEEE Trans. on Inform. Theory 57, 6920–6941 (2011)
14. Donoho, David, Tanner, Jared: Observed universality of phase transitions in high-dimensional geometry, with implications for modern data analysis and signal processing. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 367(1906), 4273–4293 (2009)
15. El Karoui, Noureddine, Bean, Derek, Bickel, Peter J., Lim, Chingwayand, Yu, Bin: On robust regression with high-dimensional predictors. Proceedings of the National Academy of Sciences 110(36), 14557–14562 (2013)
16. Huber, P.J., Ronchetti, E.: Robust statistics, 2nd edn. J. Wiley and Sons, (2009)
17. Huber, P.J.: Robust estimation of a location parameter. The Annals of Mathematical Statistics 35(1), 73–101 (1964)
18. Huber, Peter J.: Robust regression: asymptotics, conjectures and monte carlo. The Annals of Statistics 1(5), 799–821 (1973)
19. Javanmard, A., Montanari, A.: State Evolution for General Approximate Message Passing Algorithms, with Applications to Spatial Coupling. arXiv:1211.5164v1 (2012)
20. Karoui, Noureddine El: Asymptotic behavior of unregularized and ridge-regularized high-dimensional robust regression estimators: rigorous results, arXiv:1311.2445 (2013)
21. Korada, S., Montanari, A.: Applications of Lindeberg Principle in Communications and Statistical Learning. IEEE Trans. on Inform. Theory 57, 2440–2450 (2011)
22. Krzakala, Florent, Mézard, Marc, Zdeborová, Lenka: Phase diagram and approximate message passing for blind calibration and dictionary learning. Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on, IEEE, pp. 659–663 (2013)
23. Lustig, M., Donoho, D.L., Santos, J.M., Pauly, J.M.: Compressed sensing mri. IEEE Signal Processing Magazine 25, 72–82 (2008)
24. Mézard, M., Montanari, A.: Information. Physics and Computation, Oxford (2009)
25. Montanari, A.: Graphical Models Concepts in Compressed Sensing. In: Eldar, Y.C., Kutyniok, G. (eds.) Compressed Sensing: Theory and Applications. Cambridge University Press, (2012)
26. Mézard, M., Parisi, G., Virasoro, M.A.: Spin glass theory and beyond. World Scientific, (1987)
27. Rangan, S.: Generalized Approximate Message Passing for Estimation with Random Linear Mixing. IEEE Intl. Symp. on Inform. Theory (St. Perersbourg), August 2011
28. Richards, M.A.: Fundamentals of Radar Signal Processing. McGraw-Hill, (2005)
29. Scales, J.A.: Theory of Seismic Imaging. Samizdat Press, (1997)
30. Schniter, P.: Turbo Reconstruction of Structured Sparse Signals. Proceedings of the Conference on Information Sciences and Systems (Princeton), (2010)
31. Potter, L.C., Som, S., Schniter, P.: On Approximate Message Passing for Reconstruction of Non-Uniformly Sparse Signals. Proceedings of the National Aereospace and Electronics Conference (Dayton, OH), (2010)
32. Shcherbina, Mariya, Tirozzi, Brunello: Rigorous solution of the gardner problem. Communications in mathematical physics 234(3), 383–422 (2003)
33. Talagrand, M.: Mean field models for spin glasses: Volume i. Springer-Verlag, Berlin (2010)
34. Tibshirani, R.: Regression shrinkage and selection with the Lasso. J. Royal. Statist. Soc B 58, 267–288 (1996)
35. Tramel, Eric W., Kumar, Santhosh, Giurgiu, Andrei, Montanari, Andrea: Statistical estimation: From denoising to sparse regression and hidden cliques. In: Krzakala, F., Ricci-Tersenghi, F., Zdeborova, L., Zecchina, R., Tramel, E.W., Cugliandolo, L.F. (eds.) Statistical Physics, Optimization, Inference, and Message-Passing Algorithms. Oxford University Press, (2015)
36. Vershynin, R.: Introduction to the non-asymptotic analysis of random matrices. In: Eldar, Y.C., Kutyniok, G. (eds.) Compressed Sensing: Theory and Applications, pp. 210–268. Cambridge University Press, (2012)