Pseudo-likelihood methods for community detection in large sparse networks

Annals of Statistics

Volumn 41, Issue 4, 2013, Pages 2097-2122

  Amini, Arash A ^a   Chen, Aiyou ^b   Bickel, Peter J ^c   Levina, Elizaveta ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

^b GOOGLE INC   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Community detection; Network; Pseudo likelihood

Indexed keywords

EID: 84907144758     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/13-AOS1138     Document Type: Article

References (38)

1. ADAMIC, L. A. and GLANCE, N. (2005). The political blogosphere and the 2004 US election. In Proceedings of the WWW-2005 Workshop on the Weblogging Ecosystem. ACM, New York.
2. AIROLDI, E. M., BLEI, D. M., FIENBERG, S. E. and XING, E. P. (2008). Mixed membership stochastic blockmodels. J. Mach. Learn. Res. 9 1981-2014.
3. AMINI, A. A., CHEN, A., BICKEL, P. J. and LEVINA, E. (2013). Supplement to "Pseudolikelihood methods for community detection in large sparse networks." DOI:10.1214/13-AOS1138SUPP.
4. BALL, B., KARRER, B. and NEWMAN, M. E. J. (2011). An efficient and principled method for detecting communities in networks. Phys. Rev. E (3) 34 036103.
5. BESAG, J. (1974). Spatial interaction and the statistical analysis of lattice systems. J. R. Stat. Soc. Ser. B Stat. Methodol. 36 192-236. MR0373208
6. BICKEL, P. J. and CHEN, A. (2009). A nonparametric view of network models and Newman-Girvan and other modularities. Proc. Natl. Acad. Sci. USA 106 21068-21073.
7. BICKEL, P. J., CHEN, A. and LEVINA, E. (2011). The method of moments and degree distributions for network models. Ann. Statist. 39 2280-2301. MR2906868
8. BICKEL, P. J., CHOI, D., CHANG, X. and ZHANG, H. (2012). Asymptotic normality of maximum likelihood and its variational approximation for stochastic blockmodels. Available at arXiv:1207.0865.
9. BICKEL, P. J. and DOKSUM, K. A. (2007). Mathematical Statistics: Basic Ideas and Selected Topics, 2nd ed. Prentice Hall, New York.
10. CELISSE, A., DAUDIN, J.-J. and PIERRE, L. (2012). Consistency of maximum-likelihood and variational estimators in the stochastic block model. Electron. J. Stat. 6 1847-1899. MR2988467
11. CHANNAROND, A., DAUDIN, J. J. and ROBIN, S. (2011). Classification and estimation in the stochastic block model based on the empirical degrees. Available at arXiv:1110.6517.
12. CHATTERJEE, S. (2012). Matrix estimation by universal singular value thresholding. Available at arXiv:1212.1247.
13. CHAUDHURI, K., CHUNG, F. and TSIATAS, A. (2012). Spectral clustering of graphs with general degrees in the extended planted partition model. JMLR Workshop and Conference Proceedings 23 35.1-35.23.
14. DECELLE, A., KRZAKALA, F., MOORE, C. and ZDEBOROVÁ, L. (2012). Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications. Phys. Rev. E (3) 84 066106.
15. FORTUNATO, S. (2010). Community detection in graphs. Phys. Rep. 486 75-174. MR2580414
16. GLESER, L. J. (1975). On the distribution of the number of successes in independent trials. Ann. Probab. 3 182-188. MR0365651
17. HANDCOCK, M. S., RAFTERY, A. E. and TANTRUM, J. M. (2007). Model-based clustering for social networks. J. Roy. Statist. Soc. Ser. A 170 301-354. MR2364300
18. HOEFFDING, W. (1956). On the distribution of the number of successes in independent trials. Ann. Math. Statist. 27 713-721. MR0080391
19. HOFF, P. D. (2007). Modeling homophily and stochastic equivalence in symmetric relational data. In Advances in Neural Information Processing Systems, Vol. 19. MIT Press, Cambridge, MA.
20. HOLLAND, P. W., LASKEY, K. B. and LEINHARDT, S. (1983). Stochastic blockmodels: First steps. Social Networks 5 109-137. MR0718088
21. HOLLAND, P. W. and LEINHARDT, S. (1981). An exponential family of probability distributions for directed graphs. J. Amer. Statist. Assoc. 76 33-65. MR0608176
22. KARRER, B. and NEWMAN, M. E. J. (2011). Stochastic blockmodels and community structure in networks. Phys. Rev. E (3) 83 016107, 10. MR2788206
23. MARIADASSOU, M., ROBIN, S. and VACHER, C. (2010). Uncovering latent structure in valued graphs: A variational approach. Ann. Appl. Stat. 4 715-742. MR2758646
24. MOSSEL, E., NEEMAN, J. and SLY, A. (2012). Stochastic block models and reconstruction. Available at arXiv:1202.1499.
25. NEWMAN, M. E. J. (2004). Detecting community structure in networks. Eur. Phys. J. B 38 321-330.
26. NEWMAN, M. E. J. (2006). Finding community structure in networks using the eigenvectors of matrices. Phys. Rev. E (3) 74 036104, 19. MR2282139
27. NEWMAN, M. E. J. (2006). Modularity and community structure in networks. Proc. Natl. Acad. Sci. USA 103 8577-8582.
28. NEWMAN, M. E. J. and GIRVAN, M. (2004). Finding and evaluating community structure in networks. Phys. Rev. E (3) 69 026113.
29. NEWMAN, M. E. J. and LEICHT, E. A. (2007). Mixture models and exploratory analysis in networks. Proc. Natl. Acad. Sci. USA 104 9564-9569.
30. NOWICKI, K. and SNIJDERS, T. A. B. (2001). Estimation and prediction for stochastic block-structures. J. Amer. Statist. Assoc. 96 1077-1087. MR1947255
31. PERRY, P. O. and WOLFE, P. J. (2012). Null models for network data. Available at arXiv:1201.5871v1.
32. ROHE, K., CHATTERJEE, S. and YU, B. (2011). Spectral clustering and the high-dimensional stochastic blockmodel. Ann. Statist. 39 1878-1915. MR2893856
33. SHI, J. and MALIK, J. (2000). Normalized cuts and image segmentation. IEEE Trans. Pattern Analysis and Machine Intelligence 22 888-905.
34. SNIJDERS, T. A. B. and NOWICKI, K. (1997). Estimation and prediction for stochastic blockmodels for graphs with latent block structure. J. Classification 14 75-100. MR1449742
35. WANG, Y. J. and WONG, G. Y. (1987). Stochastic blockmodels for directed graphs. J. Amer. Statist. Assoc. 82 8-19. MR0883333
36. WU, C. F. J. (1983). On the convergence properties of the EM algorithm. Ann. Statist. 11 95-103. MR0684867
37. YAO, Y. Y. (2003). Information-theoretic measures for knowledge discovery and data mining. In Entropy Measures, Maximum Entropy Principle and Emerging Applications 115-136. Springer, New York.
38. ZHAO, Y., LEVINA, E. and ZHU, J. (2012). Consistency of community detection in networks under degree-corrected stochastic block models. Ann. Statist. 40 2266-2292. MR3059083