Model-based clustering for social networks

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 170, Issue 2, 2007, Pages 301-354

  Handcock, Mark S ^a   Raftery, Adrian E ^a   Tantrum, Jeremy M ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Bayes factor; Dyad; Latent space; Markov chain Monte Carlo methods; Mixture model; Transitivity

Indexed keywords

EID: 34247111980     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2007.00471.x     Document Type: Article

References (107)

1. Airoldi, E. M. (2006) Bayesian mixed membership models of complex and evolving networks. Doctoral Disserta tion. School of Computer Science, Carnegie Mellon University, Pittsburgh.
2. Airoldi, E. M., Blei, D. M., Fienberg, S. E. and Xing, E. P. (2007a) Admixtures of latent blocks with application to protein interaction networks. To be published.
3. Airoldi, E. M., Blei, D. M., Fienberg, S. E. and Xing, E. P. (2007b) Combining stochastic block models and mixed membership for statistical network analysis. Lect. Notes Comput. Sci., to be published.
4. Aldous, D. J. (1985) Exchangeability and related topics. Lect. Notes Math., 1117, 1-198.
5. Atkinson, A. C. and Riani, M. (2007) Exploratory tools for clustering multivariate data. Computnl Statist. Data Anal., to be published (doi:10.1016/j.csda2006.12.034).
6. Atkinson, A. C., Riani, M. and Cerioli, A. (2004) Exploring Multivariate Data with the Forward Search. New York: Springer.
7. Atkinson, A. C., Riani, M. and Cerioli, A. (2006a) An econometric application of the forward search in cluster ing: robustness and graphics. In Prague Stochastics 2006 (eds M. Husková and M. Janžura), pp. 63-72. Prague: Matfyz.
8. Atkinson, A. C., Riani, M. and Cerioli, A. (2006b) Random start forward searches with envelopes for detecting clusters in multivariate data. In Data Analysis, Classification and the Forward Search (eds S. Zani, A. Cerioli M. Riani and M. Vichi), pp. 163-171. Berlin: Springer.
9. Azzalini, A. and Bowman, A. W. (1990) A look at some data on the Old Faithful Geyser. Appl. Statist., 39, 357-365.
10. Banfield, J. D. and Raftery, A. E. (1993) Model-based Gaussian and non-Gaussian clustering. Biometrics, 49, 803-821.
11. Barbour, A. D. and Reinert, G. (2001) Small worlds. Rand. Struct. Algs, 19, 57-74; correction, 25 (2004), 115.
12. Barbour, A. D. and Reinert, G. (2006) Discrete small worlds. Electron. J. Probab., 11, 1234-1283.
13. Bartholomew, D. J. (1987) Latent Variable Models and Factor Analysis. London: Griffin.
14. Bearman, P., Moody, J. and Stovel, K. (2004) The structure of adolescent romantic and sexual networks. Am. J. Social., 110, 44-91.
15. Besag, J. (1986) On the statistical analysis of dirty pictures (with discussion). J. R. Statist. Soc. B, 48, 259 -302.
16. Blei, D. M., Ng, A. and Jordan, M. I. (2003) Latent Dirichlet allocation. J. Mach. Learn. Res., 3, 993-1022.
17. Boer, P., Huisman, M., Snijders, T. and Zeggelink, E. (2003) StOCNET: an open software system for the advanced statistical analysis of social networks. (Available from http://stat.gamma.rug.nl/stocnet.)
18. Bollobas, B., Janson, S. and Riordan, O. (2006) The phase transition in inhomogeneous random graphs. Rand. Struct. Algs, to be published.
19. Borgatti, S. P., Everett, M. G. and Freeman, L. C. (2002) UCINET for Windows: Software for Social Network Analysis. Harvard: Analytic Technologies.
20. Breiger, R. L. (1974) The duality of persons and groups. Socl Forces, 53, 181-190.
21. Cartwright, D. and Harary, F. (1956) Structural balance: a generalization of Heider's theory. Psychol. Rev., 63, 277-292.
22. Cerioli, A., Riani, M. and Atkinson, A. C. (2006) Robust classification with categorical variables. In COMPSTAT 2006: Proc. Computational Statistics (eds A. Rizzi and M. Vichi), pp. 507-519. Heidelberg: Physica.
23. Davis, J. A. and Leinhardt, S. (1972) The structure of positive interpersonal relations in small groups. In Socio logical Theories in Progress, vol. 2, pp. 218-251. Boston: Houghton Mifflin.
24. Doreian, P., Batagelj, V. and Ferligoj, A. (2005) Generalized Blockmodeling. Cambridge: Cambridge University Press.
25. Dorogovtsev, S. N. and Mendes, J. F. F. (2003) Evolution of Networks: from Biological Nets to the Internet and WWW. Oxford: Oxford University Press.
26. 2: a random effects model with covariates for directed graphs. Statist. Neerland., 58, 234-254.
27. Durrett, R. (2006) Random Graph Dynamics. Cambridge: Cambridge University Press.
28. Erosheva, E. A. (2003) Bayesian estimation of the grade of membership model. In Bayesian Statistics 7 (eds J. M. Bernardo, A. P. Dawid, J. O. Berger, M. West, D. Heckerman, M. J. Bayarri and A. F. M. Smith), pp. 501-510. Oxford: Oxford University Press.
29. Erosheva, E. A., Fienberg, S. E. and Lafferty, J. (2004) Mixed-membership models of scientific publications. Proc. Natn. Acad. Sci. USA, 97, 11885-11892.
30. Fokoué, E. (2005) Mixtures of factor analyzers: an extension with covariates. J. Multiv. Anal., 95, 370-384.
31. Fokoué, E. and Titterington, D. M. (2003) Mixtures of factor analysers: Bayesian estimation and inference by stochastic simulation. Mach. Learn., 50, 73-94.
32. Fraley, C. and Raftery, A. E. (1998) How many clusters? Which clustering method? Answers via model-based cluster analysis. Comput. J., 41, 578-588.
33. Fraley, C. and Raftery, A. E. (2006) MCLUST version 3: an R package for normal mixture modeling and model -based clustering. Technical Report 504. Department of Statistics, University of Washington, Seattle.
34. Frank, O. and Strauss, D. (1986) Markov graphs. J. Am. Statist. Ass., 81, 832-842.
35. Gelfand, A. E., Kim, H.-J., Sirmans, C. F. and Banerjee, S. (2003) Spatial modeling with spatially varying coeffi cient processes. J. Am. Statist. Ass., 98, 387-396.
36. Gelman, A., Meng, X. and Stern, H. (1996) Posterior predictive assessment of model fitness via realized discrep ancies (with discussion). Statist. Sin., 6, 753-807.
37. Gelman, A., Pasarica, C. and Dodhia, R. (2002) Let's practice what we preach: turning tables into graphs. Am. Statistn, 56, 121-130.
38. Ghahramani, Z. and Beal, M. (2000) Variational inference for Bayesian mixture of factor analysers. In Advances in Neural Information Processing Systems, vol. 12 (eds S. A. Solla et al.). Cambridge: MIT Press.
39. Goodreau, S. M. (2006) Birds of a feather, or friend of a friend?: using statistical network analysis to investigate adolescent social networks. Working Paper. Center for Studies in Ecology and Demography, University of Washington, Seattle.
40. Goodreau, S. (2007) Applying advances in exponential random graph (p*) models to a large social network. Socl Networks, to be published.
41. Gormley, I. C. (2006) Statistical models for rank data. PhD Thesis. Trinity College Dublin, Dublin.
42. Gormley, I. C. and Murphy, T. B. (2005) Exploring irish election data: a mixture modelling approach. Technical Report 05108. Department of Statistics, Trinity College Dublin, Dublin.
43. Gormley, I. C. and Murphy, T. B. (2006a) A latent space model for rank data. In Statistical Network Analysis: Models, Issues, and New Directions. New York: Springer. To be published.
44. Gormley, I. C. and Murphy, T. B. (2006b) Analysis of Irish third-level college applications data. J. R. Statist. Soc. A, 169, 361-379.
45. Gormley, I. C. and Murphy, T. B. (2007) Discussion on 'Estimating the integrated likelihood via posterior simu lation using the harmonic mean identity' (by A. E. Raftery, M. A. Newton, J. M. Satagopan and P. Krivitsiy). In Bayesian Statistics 8 (eds J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West). Oxford: Oxford University Press.
46. Handcock, M. S. (2002) Statistical models for social networks: inference and degeneracy. In Dynamic Social Net work Modelling and Analysis: Workshop Summary and Papers (eds R. Breiger, K. Carley and P. E. Pattison), pp. 229-240. Washington DC: National Academy Press.
47. Handcock, M. S. (2003) Assessing degeneracy in statistical models of social networks. Working Paper 39. Center for Statistics and the Social Sciences, University of Washington, Seattle. (Available from http://www.csss. washington.edu/Papers/.)
48. Handcock, M. S., Hunter, D. R., Butts, C. T., Goodreau, S. M. and Morris, M. (2003a) statnet: an R package for the statistical modeling of social networks. (Available from http://www.csde.washington.edu/ statnet.)
49. Handcock, M. S., Hunter, D. R. and Tantrum, J. (2003b) Latent space models for social network in practice. Institute for Mathematics and Its Applications Wrkshp 3: Networks and the Population Dynamics of Disease Transmission, Minneapolis.
50. Handcock, M. S. and Jones, J. (2004) Likelihood-based inference for stochastic models of sexual network forma tion. Theoret. Popln Biol., 65, 413-422.
51. Handcock, M. S. and Morris, M. (2007) A simple model for complex networks with arbitrary degree distribution and clustering. Lect. Notes Comput. Sci., to be published.
52. Handcock, M.S., Tantrum J., Shortreed, S. and Hoff, P. (2004) latentnet: an R package for latent position and clus ter modeling of statistical networks. (Available from http://www.csde.washington.edu/statnet/ latentnet.)
53. Hennig, C. (2004) Breakdown points for maximum likelihood-estimators of location-scale mixtures. Ann. Statist., 32, 1313-1340.
54. Hoff, P. D. (2003) Random effects models for network data. In Dynamic Social Network Modeling and Analysis: Workshop Summary and Papers (eds K. C. R. Breiger and P. Pattison), pp. 303-312. Washington DC: National Academy Press.
55. Hoff, P. D. (2005) Bilinear mixed-effects models for dyadic data. J. Am. Statist. Ass., 100, 286-295.
56. Hoff, P. D. (2007) Multiplicative latent factor models for description and prediction of social networks. Computnl Math. Organizn Theory, to be published.
57. Hoff, P. D., Raftery, A. E. and Handcock, M. S. (2002) Latent space approaches to social network analysis. J. Am. Statist. Ass., 97, 1090-1098.
58. Holland, P. W. and Leinhardt, S. (1970) A method for detecting structure in sociometric data. Am. J. Sociol., 70, 492-513.
59. Holland, P. W. and Leinhardt, S. (1981) An exponential family of probability distributions for directed graphs (with discussion). J. Am. Statist. Ass., 76, 33-65.
60. Hunter, D. R., Goodreau, S. M. and Handcock, M. S. (2007) Goodness of fit of social network models. J. Am. Statist. Ass., to be published.
61. Hunter, D. R. and Handcock, M. S. (2006) Inference in curved exponential family models for networks. J. Computnl Graph. Statist., 15, 565-583.
62. Jacobs, R. A., Jordan, M. I., Nowlan, S. J. and Hinton, G. E. (1991) Adaptive mixture of local experts. Neur. Computn, 3, 79-87.
63. Kass, R. E. and Raftery, A. E. (1995) Bayes factors. J. Am. Statist. Ass., 90, 773-795.
64. Kass, R. E. and Wasserman, L. A. (1995) A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. J. Am. Statist. Ass., 90, 928-934.
65. Keribin, C. (2000) Consistent estimation of the order of mixture models. Sankhya A, 62, 49-66.
66. Kim, H. and Mallick, B. K. (2002) Analyzing spatial data using skew-Gaussian processes. In Spatial Cluster Modelling (eds A. B. Lawson and D. Denision), ch 9. London: CRC.
67. Kossinets, G. and Watts, D. J. (2006) Empirical analysis of an evolving social network. Science, 311, 88-90.
68. Krackhardt, D. (1988) Predicting with networks: a multiple regression approach to analyzing dyadic data. Socl Netwrks, 10, 359-381.
69. Lazega, E. and Pattison, P. E. (1999) Multiplexity, generalized exchange and cooperation in organizations: a case study. Socl Netwrks, 21, 67-90.
70. Lehmann, E. L. (1983) Theory of Point Estimation. New York: Wiley.
71. Leslie, D. S., Kohn, R. and Fiebig, D. G., (2006) Binary choice models with general distributional forms. To be published.
72. Little, R. J. A. and Rubin, D. B. (1983) On jointly estimating parameters and missing values by maximizing the complete data likelihood. Am. Statistn, 37, 218-220.
73. Longford, N. T. and Pittau, M. G. (2006) Stability of household income in European countries in the 1990's. Computnl Statist. Data Anal., 51, 1364-1383.
74. Luce, R. D. and Perry, A. (1949) A method of matrix analysis of group structure. Psychometrika, 51, 1364-1383.
75. MacKay, D. J. C. (1995) Bayesian neural networks and density networks. Instr. Meth. Phys. Res. A, 354, 73-80.
76. Manton, K. G., Woodbury, M. A. and Tolley, D. H. (1994) Statistical Applications using Fuzzy Sets. New York: Wiley.
77. Marriott, F. H. C. (1975) Separating mixtures of normal distributions. Biometrics, 31, 767-769.
78. Milo, R., Itzkovitz, S., Kashtan, N., Levitt, R., Shen-Orr, S., Ayzenshtat, I., Sheffer, M. and Alon, U. (2004) Superfamilies of evolved and designed networks. Science, 303, 1538-1542.
79. Murphy, T. B. and Martin, D. (2003) Mixtures of distance-based models for ranking data. Computnl Statist. Data Anal., 41, 645-655.
80. Neal, R. M. (2000) Markov chain sampling methods for Dirichlet process mixture models. J. Comput. Graph. Statist., 9, 249-265.
81. Newman, M. E. J. (2003) The structure and function of complex networks. SIAM Rev., 45, 167-256.
82. Nowicki, K. and Snijders, T. A. B. (2001) Estimation and prediction for stochastic blockstructures. J. Am. Statist. Ass., 96, 1077-1087.
83. Oh, M. S. and Raftery, A. E. (2001) Bayesian multidimensional scaling and choice of dimension. J. Am. Statist. Ass., 96, 1031-1044.
84. Oh, M. S. and Raftery, A. E. (2003) Model-based clustering with dissimilarities: a Bayesian approach. Technical Report 441. Department of Statistics, University of Washington, Seattle.
85. Petrone, S. and Raftery, A. E. (1997) A note on the Dirichlet process prior in Bayesian nonparametric inference with partial exchangeability. Statist. Probab. Lett., 36, 69-83.
86. Quintana, F. A. and Iglesias, P. L. (2003) Bayesian clustering and product partition models. J. R. Statist. Soc. B, 65, 557-574.
87. Raftery, A. E., Newton, M. A., Satagopan, J. M. and Krivitsiy, P. (2007) Estimating the integrated likelihood via posterior simulation using the harmonic mean identity (with discussion). In Bayesian Statistics 8 (eds J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West), pp. 1-45. Oxford: Oxford University Press.
88. Robins, G. L., Pattison, P. E., Kalish, Y. and Lusher, D. (2007a) An introduction to exponential random graph (p*) models for social networks. Socl Netwrks, to be published.
89. Robins, G. L., Snijders, T. A. B., Weng, P., Handcock, M. S. and Pattison, P. E. (2007b) Recent developments in exponential random graph (p*) models for social networks. Socl Netwrks, to be published.
90. Sasik, R., Hwa, T., Iranfar, N. and Loomis, W. F. (2001) Percolation clustering: a novel approach to the clustering of gene expression patterns in Dictyostelium development. In Proc. Pacific Symp. Biocomputing (eds R. B. Altman, A. K. Dunker, L. Hunter, K. Lauderdale and T. E. Klein), pp. 335-347. Singapore: World Scientific Press.
91. Schweinberger, M. and Snijders, T. A. B. (2003) Settings in social networks: a measurement model. Sociol. Meth odol., 33, 307-341.
92. Sethuraman, J. (1994) A constructive definition of Dirichlet priors. Ann. Statist., 4, 639-650.
93. Shannon, P., Markiel, A., Ozier, O., Baliga, N. S., Wang, J. T., Ramage, D., Amin, N., Schwikowski, B. and Ideker, T. (2003) Cytoscape: a software environment for integrated models of biomolecular interaction net works. Genome Res., 13, 2498-2504.
94. Shortreed, S., Handcock, M. S. and Hoff, P. (2006) Positional estimation within a latent space model for networks. Methodology, 2, 24-33.
95. Simmel, G. (1955) Conflict and the Web of Group Affiliations. New York: Free Press.
96. Snijders, T. A. B. (2002) Markov Chain Monte Carlo estimation of exponential random graph models. J. Socl Struct., 3.
97. Snijders, T. A. B., Pattison, P. E., Robins, G. L. and Handcock, M. S. (2006) New specifications for exponential random graph models. Sociol. Methodol., 36, 99-153.
98. Tobler, W. R. (1976) Spatial interaction patterns. J. Environ. Syst., 6, 271-301.
99. Tobler, W. R. (2005) Using asymmetry to estimate potential. 25th Int. Sunbelt Social Network Conf., Redondo Beach.
100. Venables, W. N. and Ripley, B. D. (2002) Modern Applied Statistics with S, 4th edn. New York: Springer.
101. Wang, X. F. and Chen, G. (2003) Complex networks: small-world, scale-free and beyond. IEEE Circ. Syst. Mag., 3, 6-20.
102. Wang, Y. J. and Wong, G. Y. (1987) Stochastic blockmodels for directed graphs. J. Am. Statist. Ass., 82, 8-19.
103. Watts, D. J., Dodds, P. S. and Newman, M. E. J. (2002) Identity and search in social networks. Science, 296, 1302-1305.
104. Westveld, A. and Hoff, P. D. (2005) Statistical methodology for longitudinal social network data. In Proc. A. Meet. American Political Science Association. American Political Science Association.
105. White, H. C., Boorman, S. A. and Breiger, R. L. (1976) Social structure from multiple networks: I, Blockmodels of roles and positions. Am. J. Sociol., 81, 730-780.
106. Zadeh, L. (1965) Fuzzy sets. Inform. Control, 8, 338-353.
107. Zijlstra, B. J. H., van Duijn, M. A. J. and Snijders, T. A. B. (2005) Model selection in random effects models for directed graphs using approximated Bayesian factors. Statist. Neerland., 59, 107-118.