High-dimensional Ising model selection with Bayesian information criteria

Electronic Journal of Statistics

Volumn 9, Issue , 2015, Pages 567-607

  Barber, Rina Foygel ^a   Drton, Mathias ^b  

^a UNIVERSITY OF CHICAGO   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Bayesian information criterion; Graphical model; Log linear model; Logistic regression; Neighborhood selection; Variable selection

Indexed keywords

EID: 84926371271     PISSN: 19357524     EISSN: None     Source Type: Journal    
DOI: 10.1214/15-EJS1012     Document Type: Article

References (32)

1. Anandkumar, A., Tan, V. Y. F., Huang, F. and Willsky, A. S. (2012). High-dimensional structure estimation in Ising models: Local separation criterion. Ann. Statist. 40 1346–1375. MR3015028
2. Besag, J. E. (1972). Nearest-neighbour systems and the auto-logistic model for binary data. J. Roy. Statist. Soc. Ser. B 34 75–83. MR0323276 (48 ##1634)
3. Besag, J. (1974). Spatial interaction and the statistical analysis of lattice systems. J. Roy. Statist. Soc. Ser. B 36 192–236. With discussion by D. R. Cox, A. G. Hawkes, P. Clifford, P. Whittle, K. Ord, R. Mead, J. M. Hammersley, and M. S. Bartlett and with a reply by the author. MR0373208 (51 ##9409)
4. Bogdan, M., Ghosh, J. K. and Doerge, R. W. (2004). Modifying the Schwarz Bayesian information criterion to locate multiple interacting quantitative trait loci. Genetics 167 989–999.
5. Broman, K. W. and Speed, T. P. (2002). A model selection approach for the identification of quantitative trait loci in experimental crosses. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 641–656. MR1979381
6. Bühlmann, P. and van de Geer, S. (2011). Statistics for high-dimensional data. Springer Series in Statistics. Springer, Heidelberg. Methods, theory and applications. MR2807761 (2012e:62006)
7. Chen, J. and Chen, Z. (2008). Extended Bayesian information criteria for model selection with large model spaces. Biometrika 95 759–771.MR2443189
8. Chen, J. and Chen, Z. (2012). Extended BIC for small-n-large-P sparse GLM. Statist. Sinica 22 555–574. MR2954352
9. Foygel, R. (2012). Prediction and model selection for high-dimensional data with sparse or low-rank structure. PhD thesis, The University of Chicago.
10. Foygel, R. and Drton, M. (2011). Bayesian model choice and information criteria in sparse generalized linear models. ArXiv e-prints 1112.5635.
11. Foygel, R. and Drton, M. (2014). High-dimensional Ising model selection with Bayesian information criteria. ArXiv e-prints 1403.3374v1.
12. Friedman, J., Hastie, T. and Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software 33 1–22.
13. Frommlet, F., Ruhaltinger, F., Twaróg, P. and Bogdan, M. (2012). Modified versions of Bayesian information criterion for genome-wide association studies. Comput. Statist. Data Anal. 56 1038–1051. MR2897552
14. Höfling, H. and Tibshirani, R. (2009). Estimation of sparse binary pairwise Markov networks using pseudo-likelihoods. J. Mach. Learn. Res. 10 883–906. MR2505138 (2011b:62041)
15. Hothorn, T., Bühlmann, P., Kneib, T., Schmid, M. and Hofner, B. (2013). Mboost: Model-based boosting. R package version 2.2-3.
16. Jalali, A., Johnson, C. C. and Ravikumar, P. K. (2011). On learning discrete graphical models using greedy methods. In Advances in Neural In- formation Processing Systems 1935–1943.
17. Kindermann, R. and Snell, J. L. (1980). Markov random fields and their applications. Contemporary Mathematics 1. American Mathematical Society, Providence, R.I. MR620955 (82j:60183)
18. Koltchinskii, V. (2011). Oracle inequalities in empirical risk minimization and sparse recovery problems. Lecture Notes in Mathematics 2033. Springer, Heidelberg. Lectures from the 38th Probability Summer School held in Saint- Flour, 2008, ´Ecole d’Èté de Probabilités de Saint-Flour. [Saint-Flour Probability Summer School]. MR2829871 (2012i:91165)
19. Lauritzen, S. L. (1996). Graphical models. Oxford Statistical Science Series 17. The Clarendon Press Oxford University Press, New York. Oxford Science Publications. MR1419991 (98g:62001)
20. Loh, P.-L. and Wainwright, M. J. (2013). Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses. Ann. Statist. 41 3022–3049. MR3161456
21. Lorentz, G. G., Golitschek, M. v. and Makovoz, Y. (1996). Constructive approximation. Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences] 304. Springer-Verlag, Berlin. Advanced problems. MR1393437 (97k:41002)
22. Luo, S. and Chen, Z. (2013). Selection consistency of EBIC for GLIM with non-canonical links and diverging number of parameters. Stat. Interface 6 275–284. MR3066691
23. Meinshausen, N. and Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. Ann. Statist. 34 1436–1462. MR2278363 (2008b:62044)
24. Meinshausen, N. and Bühlmann, P. (2010). Stability selection. J. R. Stat. Soc. Ser. B Stat. Methodol. 72 417–473. MR2758523
25. Menne, M. J., Williams Jr., C. N. and Vose, R. S. (2011). United States Historical Climatology Network Daily Temperature, Precipitation, and Snow Data.
26. Ravikumar, P., Wainwright, M. J. and Lafferty, J. D. (2010). Highdimensional Ising model selection using ℓ1-regularized logistic regression. Ann. Statist. 38 1287–1319. MR2662343 (2011d:62066)
27. Roudi, Y., Aurell, E. and Hertz, J. A. (2009). Statistical physics of pairwise probability models. Frontiers in Computational Neuroscience 3.
28. Santhanam, N. P. and Wainwright, M. J. (2012). Information-theoretic limits of selecting binary graphical models in high dimensions. IEEE Trans- actions on Information Theory 58 4117–4134. MR2943079
29. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461–464. MR0468014 (57 ##7855)
30. Scott, J. G. and Berger, J. O. (2010). Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem. Ann. Statist. 38 2587–2619. MR2722450 (2011h:62268)
31. Shorack, G. R. (2000). Probability for statisticians. Springer Texts in Statistics. Springer-Verlag, New York. MR1762415 (2001d:60002) ˙
32. Żak-Szatkowska, M. and Bogdan, M. (2011). Modified versions of the Bayesian information criterion for sparse generalized linear models. Comput. Statist. Data Anal. 55 2908–2924. MR2813055 (2012g:62313)